2021-10-08T19:04:22.783 INFO:root:teuthology version: 1.1.0-6f40c4ca 2021-10-08T19:04:22.785 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --description orch:cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} --owner scheduled_sage@teuthology --name sage-2021-10-08_18:44:18-orch:cephadm-master-distro-basic-smithi --archive /home/teuthworker/archive/sage-2021-10-08_18:44:18-orch:cephadm-master-distro-basic-smithi/6428702 -- /home/teuthworker/archive/sage-2021-10-08_18:44:18-orch:cephadm-master-distro-basic-smithi/6428702/orig.config.yaml 2021-10-08T19:04:22.837 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-10-08T19:04:22.904 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/sage-2021-10-08_18:44:18-orch:cephadm-master-distro-basic-smithi/6428702 branch: master description: orch:cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} email: null first_in_suite: false job_id: '6428702' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: sage-2021-10-08_18:44:18-orch:cephadm-master-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: centos os_version: '8.2' overrides: admin_socket: branch: master ceph: conf: client.0: debug ms: 1 debug objecter: 20 debug rados: 20 global: ms bind msgr2: false ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 paxos service trim min: 10 osd: debug ms: 1 debug osd: 20 osd debug reject backfill probability: 0.3 osd delete sleep: 1 osd max backfills: 3 osd scrub max interval: 120 osd scrub min interval: 60 osd shutdown pgref assert: true osd snap trim sleep: 2 log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - but it is still running - objects unfound and apparently lost log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) mon_bind_msgr2: false sha1: 103b6cc3554193fcd0852d9c647cef19e99920cf ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 cephadm: cephadm_mode: root install: ceph: sha1: 103b6cc3554193fcd0852d9c647cef19e99920cf selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 workunit: branch: qa-nvme-loop sha1: 6d1d7181c8e91145ded12e11fc2a9c8ce31671f6 owner: scheduled_sage@teuthology priority: 75 repo: https://github.com/ceph/ceph roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - ceph.rgw.foo.a - node-exporter.a - alertmanager.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - grafana.a - node-exporter.b - ceph.iscsi.iscsi.a sha1: 103b6cc3554193fcd0852d9c647cef19e99920cf sleep_before_teardown: 0 suite: orch:cephadm suite_branch: qa-nvme-loop suite_path: /home/teuthworker/src/github.com_liewegas_ceph_6d1d7181c8e91145ded12e11fc2a9c8ce31671f6/qa suite_relpath: qa suite_repo: https://github.com/liewegas/ceph suite_sha1: 6d1d7181c8e91145ded12e11fc2a9c8ce31671f6 targets: smithi097.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDO2OCX+ev9H/kmnNum2VI33yWzW3r2kL/P9t7BUvMpNogHmcdej3ZLD3BdZIzpuU2oLkThwIal7aJwK9ax3s9r8qSpGNruWQCzHzGXUUKvpv2uWZovHb9pIwg6VuF1BT53PYj151aRU049DIb1P7W7m0sBFUfKkreSfaLfTtJBiIh9jr15F0Fwmi8kJVaTr4uvs+XsO8TIrECOh/tFn6Rvq0PQ7TNJxIlmpUZCwq4ZqPYCPzlbtajfUcuYF29hYu+0sT4gowxrM3FEsfLG9Qv5IoXpqEShTc3AXsfMSCROZOMLspEaLrRtS73RoxXQIn1p8LQTmjYpD4tIQZiPK6ucTBvOA+PgOLMHMwoN6BONNgdNleGRj3ygmEfiWj1dAu3lXuCoW5Gv5yHFbjtnPN/1RDlTBsLo9eMs16pjfsGCnPPgiwPDujPYsDCCuLo7Jt4/+Q4dvI0itCUfJ+Z07tVEnKsuoLA0r1bZvds1rnVNFmn/G+yPffjPsrqO8PtMU+M= smithi117.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMWm24VPJJL3GwGhKMH0qzfuEeO0wChLfmV9cmtoUl+TkIeSQBQ0xbhBAws0s4n0hQ4lbZecmCtvX/tGDadKh6nQyIz+EBQzPeiikaWxOpDK10NyRhQpPgNtZxUBriKBfKE3rHJJGpXmchQqGYXzu+nTKKieBVfDOkPGgimnKjLTraUsa0r+y5BK0ZhvmOg40pg84CNdd5SSM5yTyZchOlqaTiWFfScbYsFs7ynnz04rgzqrLpEvNbmd2y2l3yvebnf569W7y0XpHLzcAacU9lZj40uK0MuGDJYbEpPzKoWCJ+kaRb7m9N6InkcLWsOH5toPWAkk5pbbSMJ4BHiUxqAtxZyY56oay/gcfCxAOScv255wGvfXhGQTZGeKWk1sQUVOBhNZHT4cdxcSNWsFNmM2hN58y7FQi4dgrPwevKRk2SnxrTvqaJZaBbe2m8GJ/POcSObXHjsLoaxHm9S/LJd9wbX6TsbMShSTx/IgYSseo3r6ckwnz96XMDIPMtJ3U= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools:3.0 - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: null - cephadm: conf: mgr: debug mgr: 20 debug ms: 1 - thrashosds: chance_pgnum_grow: 1 chance_pgnum_shrink: 1 chance_pgpnum_fix: 1 timeout: 1200 - full_sequential: - radosbench: clients: - client.0 time: 90 - radosbench: clients: - client.0 time: 90 - radosbench: clients: - client.0 time: 90 - radosbench: clients: - client.0 time: 90 - radosbench: clients: - client.0 time: 90 teuthology_branch: master teuthology_sha1: 6f40c4ca66d0ac515a149c2e25df0d91b2dd1a9b timestamp: 2021-10-08_18:44:18 tube: smithi user: sage verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.18925 2021-10-08T19:04:22.905 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_liewegas_ceph_6d1d7181c8e91145ded12e11fc2a9c8ce31671f6/qa; will attempt to use it 2021-10-08T19:04:22.906 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_liewegas_ceph_6d1d7181c8e91145ded12e11fc2a9c8ce31671f6/qa/tasks 2021-10-08T19:04:22.906 INFO:teuthology.run_tasks:Running task internal.check_packages... 2021-10-08T19:04:22.908 INFO:teuthology.task.internal:Checking packages... 2021-10-08T19:04:22.930 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'basic' and ceph hash '103b6cc3554193fcd0852d9c647cef19e99920cf' 2021-10-08T19:04:22.930 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-10-08T19:04:22.931 INFO:teuthology.packaging:ref: None 2021-10-08T19:04:22.931 INFO:teuthology.packaging:tag: None 2021-10-08T19:04:22.932 INFO:teuthology.packaging:branch: master 2021-10-08T19:04:22.932 INFO:teuthology.packaging:sha1: 103b6cc3554193fcd0852d9c647cef19e99920cf 2021-10-08T19:04:22.932 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=master 2021-10-08T19:04:23.206 INFO:teuthology.task.internal:Found packages for ceph version 17.0.0-8109.gd66a7ec3 2021-10-08T19:04:23.208 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2021-10-08T19:04:23.216 INFO:teuthology.task.internal:no buildpackages task found 2021-10-08T19:04:23.216 INFO:teuthology.run_tasks:Running task internal.save_config... 2021-10-08T19:04:23.243 INFO:teuthology.task.internal:Saving configuration 2021-10-08T19:04:23.261 INFO:teuthology.run_tasks:Running task internal.check_lock... 2021-10-08T19:04:23.269 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-10-08T19:04:23.290 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi097.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/sage-2021-10-08_18:44:18-orch:cephadm-master-distro-basic-smithi/6428702', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2021-10-08 18:59:38.786070', 'locked_by': 'scheduled_sage@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGMDFuxDxO7axa9LppXpW5kdHpYM8DZKdb0pFfj4VqCwFWshZxz3GppCLDakKB4GaLk/oa1rO50+WzZsv+HrvyM='} 2021-10-08T19:04:23.319 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi117.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/sage-2021-10-08_18:44:18-orch:cephadm-master-distro-basic-smithi/6428702', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2021-10-08 18:59:38.786048', 'locked_by': 'scheduled_sage@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMNTMlPFd6aiahzR2XRRiSrswh6jJflJDk1GEOUsPn3zKBqe4yauci60CPlmnWCiU9w2rsZpAafMB7vH6mBCXI4='} 2021-10-08T19:04:23.320 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2021-10-08T19:04:23.327 INFO:teuthology.task.internal:roles: ubuntu@smithi097.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'ceph.rgw.foo.a', 'node-exporter.a', 'alertmanager.a'] 2021-10-08T19:04:23.328 INFO:teuthology.task.internal:roles: ubuntu@smithi117.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b', 'ceph.iscsi.iscsi.a'] 2021-10-08T19:04:23.328 INFO:teuthology.run_tasks:Running task console_log... 2021-10-08T19:04:23.451 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd069491e18>, signals=[15]) 2021-10-08T19:04:23.453 INFO:teuthology.run_tasks:Running task internal.connect... 2021-10-08T19:04:23.462 INFO:teuthology.task.internal:Opening connections... 2021-10-08T19:04:23.462 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi097.front.sepia.ceph.com 2021-10-08T19:04:23.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-08T19:04:23.534 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi117.front.sepia.ceph.com 2021-10-08T19:04:23.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-08T19:04:23.607 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2021-10-08T19:04:23.616 DEBUG:teuthology.orchestra.run.smithi097:> uname -m 2021-10-08T19:04:23.637 INFO:teuthology.orchestra.run.smithi097.stdout:x86_64 2021-10-08T19:04:23.638 DEBUG:teuthology.orchestra.run.smithi097:> cat /etc/os-release 2021-10-08T19:04:23.692 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="CentOS Linux" 2021-10-08T19:04:23.692 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="8 (Core)" 2021-10-08T19:04:23.692 INFO:teuthology.orchestra.run.smithi097.stdout:ID="centos" 2021-10-08T19:04:23.693 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE="rhel fedora" 2021-10-08T19:04:23.693 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="8" 2021-10-08T19:04:23.693 INFO:teuthology.orchestra.run.smithi097.stdout:PLATFORM_ID="platform:el8" 2021-10-08T19:04:23.693 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2021-10-08T19:04:23.694 INFO:teuthology.orchestra.run.smithi097.stdout:ANSI_COLOR="0;31" 2021-10-08T19:04:23.694 INFO:teuthology.orchestra.run.smithi097.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-10-08T19:04:23.694 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://www.centos.org/" 2021-10-08T19:04:23.694 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-10-08T19:04:23.694 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:04:23.695 INFO:teuthology.orchestra.run.smithi097.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-10-08T19:04:23.695 INFO:teuthology.orchestra.run.smithi097.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-10-08T19:04:23.695 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2021-10-08T19:04:23.695 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2021-10-08T19:04:23.696 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:04:23.696 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server 2021-10-08T19:04:23.714 DEBUG:teuthology.orchestra.run.smithi117:> uname -m 2021-10-08T19:04:23.730 INFO:teuthology.orchestra.run.smithi117.stdout:x86_64 2021-10-08T19:04:23.731 DEBUG:teuthology.orchestra.run.smithi117:> cat /etc/os-release 2021-10-08T19:04:23.785 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="CentOS Linux" 2021-10-08T19:04:23.786 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="8 (Core)" 2021-10-08T19:04:23.786 INFO:teuthology.orchestra.run.smithi117.stdout:ID="centos" 2021-10-08T19:04:23.786 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE="rhel fedora" 2021-10-08T19:04:23.786 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="8" 2021-10-08T19:04:23.787 INFO:teuthology.orchestra.run.smithi117.stdout:PLATFORM_ID="platform:el8" 2021-10-08T19:04:23.787 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2021-10-08T19:04:23.787 INFO:teuthology.orchestra.run.smithi117.stdout:ANSI_COLOR="0;31" 2021-10-08T19:04:23.787 INFO:teuthology.orchestra.run.smithi117.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-10-08T19:04:23.788 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://www.centos.org/" 2021-10-08T19:04:23.788 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-10-08T19:04:23.788 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:04:23.788 INFO:teuthology.orchestra.run.smithi117.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-10-08T19:04:23.788 INFO:teuthology.orchestra.run.smithi117.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-10-08T19:04:23.789 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2021-10-08T19:04:23.789 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2021-10-08T19:04:23.789 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:04:23.789 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server 2021-10-08T19:04:23.808 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2021-10-08T19:04:23.819 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2021-10-08T19:04:23.838 INFO:teuthology.task.internal:Checking for old test directory... 2021-10-08T19:04:23.838 DEBUG:teuthology.orchestra.run.smithi097:> test '!' -e /home/ubuntu/cephtest 2021-10-08T19:04:23.841 DEBUG:teuthology.orchestra.run.smithi117:> test '!' -e /home/ubuntu/cephtest 2021-10-08T19:04:23.855 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2021-10-08T19:04:23.868 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2021-10-08T19:04:23.869 DEBUG:teuthology.orchestra.run.smithi097:> test -z $(ls -A /var/lib/ceph) 2021-10-08T19:04:23.895 DEBUG:teuthology.orchestra.run.smithi117:> test -z $(ls -A /var/lib/ceph) 2021-10-08T19:04:24.175 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2021-10-08T19:04:24.223 INFO:teuthology.run_tasks:Running task kernel... 2021-10-08T19:04:24.243 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2021-10-08T19:04:24.244 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}, 'mgr.y': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}, 'osd.3': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'ceph.rgw.foo.a': {'kdb': True, 'sha1': 'distro'}, 'node-exporter.a': {'kdb': True, 'sha1': 'distro'}, 'alertmanager.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}, 'osd.4': {'kdb': True, 'sha1': 'distro'}, 'osd.5': {'kdb': True, 'sha1': 'distro'}, 'osd.6': {'kdb': True, 'sha1': 'distro'}, 'osd.7': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}, 'prometheus.a': {'kdb': True, 'sha1': 'distro'}, 'grafana.a': {'kdb': True, 'sha1': 'distro'}, 'node-exporter.b': {'kdb': True, 'sha1': 'distro'}, 'ceph.iscsi.iscsi.a': {'kdb': True, 'sha1': 'distro'}} 2021-10-08T19:04:24.244 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2021-10-08T19:04:24.244 DEBUG:teuthology.orchestra.run.smithi097:> uname -r 2021-10-08T19:04:24.259 INFO:teuthology.orchestra.run.smithi097.stdout:4.18.0-305.12.1.el8_4.x86_64 2021-10-08T19:04:24.259 INFO:teuthology.task.kernel:Running kernel on smithi097: 4.18.0-305.12.1.el8_4.x86_64 2021-10-08T19:04:24.260 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum install -y kernel 2021-10-08T19:04:26.689 INFO:teuthology.orchestra.run.smithi097.stdout:CentOS-8 - AppStream 45 MB/s | 9.3 MB 00:00 2021-10-08T19:04:28.246 INFO:teuthology.orchestra.run.smithi097.stdout:CentOS-8 - Base 50 MB/s | 7.5 MB 00:00 2021-10-08T19:04:29.329 INFO:teuthology.orchestra.run.smithi097.stdout:CentOS-8 - Extras 164 kB/s | 10 kB 00:00 2021-10-08T19:04:29.474 INFO:teuthology.orchestra.run.smithi097.stdout:CentOS-8 - PowerTools 26 MB/s | 2.4 MB 00:00 2021-10-08T19:04:31.778 INFO:teuthology.orchestra.run.smithi097.stdout:Copr repo for python3-asyncssh owned by ceph 1.8 kB/s | 3.5 kB 00:01 2021-10-08T19:04:32.440 INFO:teuthology.orchestra.run.smithi097.stdout:Extra Packages for Enterprise Linux 17 MB/s | 10 MB 00:00 2021-10-08T19:04:34.568 INFO:teuthology.orchestra.run.smithi097.stdout:lab-extras 2.6 MB/s | 24 kB 00:00 2021-10-08T19:04:35.997 INFO:teuthology.orchestra.run.smithi097.stdout:Package kernel-4.18.0-193.el8.x86_64 is already installed. 2021-10-08T19:04:35.998 INFO:teuthology.orchestra.run.smithi097.stdout:Package kernel-4.18.0-305.12.1.el8_4.x86_64 is already installed. 2021-10-08T19:04:36.243 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2021-10-08T19:04:36.243 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2021-10-08T19:04:36.243 INFO:teuthology.orchestra.run.smithi097.stdout: Package Arch Version Repository Size 2021-10-08T19:04:36.244 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2021-10-08T19:04:36.244 INFO:teuthology.orchestra.run.smithi097.stdout:Installing: 2021-10-08T19:04:36.244 INFO:teuthology.orchestra.run.smithi097.stdout: kernel x86_64 4.18.0-305.19.1.el8_4 CentOS-Base 5.9 M 2021-10-08T19:04:36.244 INFO:teuthology.orchestra.run.smithi097.stdout:Installing dependencies: 2021-10-08T19:04:36.245 INFO:teuthology.orchestra.run.smithi097.stdout: kernel-core x86_64 4.18.0-305.19.1.el8_4 CentOS-Base 36 M 2021-10-08T19:04:36.245 INFO:teuthology.orchestra.run.smithi097.stdout: kernel-modules x86_64 4.18.0-305.19.1.el8_4 CentOS-Base 28 M 2021-10-08T19:04:36.245 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:04:36.245 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction Summary 2021-10-08T19:04:36.245 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2021-10-08T19:04:36.246 INFO:teuthology.orchestra.run.smithi097.stdout:Install 3 Packages 2021-10-08T19:04:36.246 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:04:36.247 INFO:teuthology.orchestra.run.smithi097.stdout:Total download size: 70 M 2021-10-08T19:04:36.247 INFO:teuthology.orchestra.run.smithi097.stdout:Installed size: 88 M 2021-10-08T19:04:36.247 INFO:teuthology.orchestra.run.smithi097.stdout:Downloading Packages: 2021-10-08T19:04:36.366 INFO:teuthology.orchestra.run.smithi097.stdout:(1/3): kernel-4.18.0-305.19.1.el8_4.x86_64.rpm 49 MB/s | 5.9 MB 00:00 2021-10-08T19:04:36.965 INFO:teuthology.orchestra.run.smithi097.stdout:(2/3): kernel-modules-4.18.0-305.19.1.el8_4.x86 39 MB/s | 28 MB 00:00 2021-10-08T19:04:37.311 INFO:teuthology.orchestra.run.smithi097.stdout:(3/3): kernel-core-4.18.0-305.19.1.el8_4.x86_64 34 MB/s | 36 MB 00:01 2021-10-08T19:04:37.313 INFO:teuthology.orchestra.run.smithi097.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:04:37.314 INFO:teuthology.orchestra.run.smithi097.stdout:Total 65 MB/s | 70 MB 00:01 2021-10-08T19:04:37.424 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction check 2021-10-08T19:04:37.719 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction check succeeded. 2021-10-08T19:04:37.720 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction test 2021-10-08T19:04:38.885 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction test succeeded. 2021-10-08T19:04:38.915 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction 2021-10-08T19:04:41.287 INFO:teuthology.orchestra.run.smithi097.stdout: Preparing : 1/1 2021-10-08T19:04:41.837 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : kernel-core-4.18.0-305.19.1.el8_4.x86_64 1/3 2021-10-08T19:04:44.660 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: kernel-core-4.18.0-305.19.1.el8_4.x86_64 1/3 2021-10-08T19:04:44.994 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : kernel-modules-4.18.0-305.19.1.el8_4.x86_64 2/3 2021-10-08T19:04:47.968 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: kernel-modules-4.18.0-305.19.1.el8_4.x86_64 2/3 2021-10-08T19:04:48.196 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : kernel-4.18.0-305.19.1.el8_4.x86_64 3/3 2021-10-08T19:05:07.807 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: kernel-core-4.18.0-305.19.1.el8_4.x86_64 3/3 2021-10-08T19:05:08.103 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: kernel-4.18.0-305.19.1.el8_4.x86_64 3/3 2021-10-08T19:05:08.103 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : kernel-4.18.0-305.19.1.el8_4.x86_64 1/3 2021-10-08T19:05:08.103 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : kernel-core-4.18.0-305.19.1.el8_4.x86_64 2/3 2021-10-08T19:05:08.489 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : kernel-modules-4.18.0-305.19.1.el8_4.x86_64 3/3 2021-10-08T19:05:08.489 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:05:08.489 INFO:teuthology.orchestra.run.smithi097.stdout:Installed: 2021-10-08T19:05:08.490 INFO:teuthology.orchestra.run.smithi097.stdout: kernel-4.18.0-305.19.1.el8_4.x86_64 2021-10-08T19:05:08.490 INFO:teuthology.orchestra.run.smithi097.stdout: kernel-core-4.18.0-305.19.1.el8_4.x86_64 2021-10-08T19:05:08.490 INFO:teuthology.orchestra.run.smithi097.stdout: kernel-modules-4.18.0-305.19.1.el8_4.x86_64 2021-10-08T19:05:08.490 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:05:08.491 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2021-10-08T19:05:08.596 DEBUG:teuthology.orchestra.run.smithi097:> rpm -q kernel --last | head -n 1 2021-10-08T19:05:08.740 INFO:teuthology.orchestra.run.smithi097.stdout:kernel-4.18.0-305.19.1.el8_4.x86_64 Fri 08 Oct 2021 07:04:47 PM UTC 2021-10-08T19:05:08.743 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-305.19.1.el8_4.x86_64 2021-10-08T19:05:08.743 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.12.1.el8_4.x86_64 Expected: 4.18.0-305.19.1.el8_4.x86_64 2021-10-08T19:05:08.744 DEBUG:teuthology.orchestra.run.smithi117:> uname -r 2021-10-08T19:05:08.762 INFO:teuthology.orchestra.run.smithi117.stdout:4.18.0-305.12.1.el8_4.x86_64 2021-10-08T19:05:08.762 INFO:teuthology.task.kernel:Running kernel on smithi117: 4.18.0-305.12.1.el8_4.x86_64 2021-10-08T19:05:08.763 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum install -y kernel 2021-10-08T19:05:11.134 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS-8 - AppStream 40 MB/s | 9.3 MB 00:00 2021-10-08T19:05:12.692 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS-8 - Base 50 MB/s | 7.5 MB 00:00 2021-10-08T19:05:13.768 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS-8 - Extras 164 kB/s | 10 kB 00:00 2021-10-08T19:05:13.912 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS-8 - PowerTools 27 MB/s | 2.4 MB 00:00 2021-10-08T19:05:16.262 INFO:teuthology.orchestra.run.smithi117.stdout:Copr repo for python3-asyncssh owned by ceph 1.8 kB/s | 3.5 kB 00:01 2021-10-08T19:05:17.170 INFO:teuthology.orchestra.run.smithi117.stdout:Extra Packages for Enterprise Linux 12 MB/s | 10 MB 00:00 2021-10-08T19:05:19.454 INFO:teuthology.orchestra.run.smithi117.stdout:lab-extras 4.3 MB/s | 24 kB 00:00 2021-10-08T19:05:20.882 INFO:teuthology.orchestra.run.smithi117.stdout:Package kernel-4.18.0-193.el8.x86_64 is already installed. 2021-10-08T19:05:20.883 INFO:teuthology.orchestra.run.smithi117.stdout:Package kernel-4.18.0-305.12.1.el8_4.x86_64 is already installed. 2021-10-08T19:05:21.133 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2021-10-08T19:05:21.134 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2021-10-08T19:05:21.134 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2021-10-08T19:05:21.134 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2021-10-08T19:05:21.134 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2021-10-08T19:05:21.135 INFO:teuthology.orchestra.run.smithi117.stdout: kernel x86_64 4.18.0-305.19.1.el8_4 CentOS-Base 5.9 M 2021-10-08T19:05:21.135 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2021-10-08T19:05:21.135 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-core x86_64 4.18.0-305.19.1.el8_4 CentOS-Base 36 M 2021-10-08T19:05:21.135 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-modules x86_64 4.18.0-305.19.1.el8_4 CentOS-Base 28 M 2021-10-08T19:05:21.136 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:05:21.136 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2021-10-08T19:05:21.136 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2021-10-08T19:05:21.136 INFO:teuthology.orchestra.run.smithi117.stdout:Install 3 Packages 2021-10-08T19:05:21.137 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:05:21.137 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 70 M 2021-10-08T19:05:21.137 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 88 M 2021-10-08T19:05:21.138 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2021-10-08T19:05:21.254 INFO:teuthology.orchestra.run.smithi117.stdout:(1/3): kernel-4.18.0-305.19.1.el8_4.x86_64.rpm 50 MB/s | 5.9 MB 00:00 2021-10-08T19:05:21.968 INFO:teuthology.orchestra.run.smithi117.stdout:(2/3): kernel-core-4.18.0-305.19.1.el8_4.x86_64 43 MB/s | 36 MB 00:00 2021-10-08T19:05:22.216 INFO:teuthology.orchestra.run.smithi117.stdout:(3/3): kernel-modules-4.18.0-305.19.1.el8_4.x86 26 MB/s | 28 MB 00:01 2021-10-08T19:05:22.219 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:05:22.220 INFO:teuthology.orchestra.run.smithi117.stdout:Total 64 MB/s | 70 MB 00:01 2021-10-08T19:05:22.330 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2021-10-08T19:05:22.613 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2021-10-08T19:05:22.614 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2021-10-08T19:05:23.761 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2021-10-08T19:05:23.788 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2021-10-08T19:05:26.132 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2021-10-08T19:05:26.656 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : kernel-core-4.18.0-305.19.1.el8_4.x86_64 1/3 2021-10-08T19:05:29.494 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: kernel-core-4.18.0-305.19.1.el8_4.x86_64 1/3 2021-10-08T19:05:29.853 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : kernel-modules-4.18.0-305.19.1.el8_4.x86_64 2/3 2021-10-08T19:05:32.824 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: kernel-modules-4.18.0-305.19.1.el8_4.x86_64 2/3 2021-10-08T19:05:33.013 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : kernel-4.18.0-305.19.1.el8_4.x86_64 3/3 2021-10-08T19:05:52.609 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: kernel-core-4.18.0-305.19.1.el8_4.x86_64 3/3 2021-10-08T19:05:52.916 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: kernel-4.18.0-305.19.1.el8_4.x86_64 3/3 2021-10-08T19:05:52.917 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : kernel-4.18.0-305.19.1.el8_4.x86_64 1/3 2021-10-08T19:05:52.917 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : kernel-core-4.18.0-305.19.1.el8_4.x86_64 2/3 2021-10-08T19:05:53.519 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : kernel-modules-4.18.0-305.19.1.el8_4.x86_64 3/3 2021-10-08T19:05:53.519 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:05:53.519 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2021-10-08T19:05:53.520 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-4.18.0-305.19.1.el8_4.x86_64 2021-10-08T19:05:53.520 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-core-4.18.0-305.19.1.el8_4.x86_64 2021-10-08T19:05:53.520 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-modules-4.18.0-305.19.1.el8_4.x86_64 2021-10-08T19:05:53.520 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:05:53.520 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2021-10-08T19:05:53.614 DEBUG:teuthology.orchestra.run.smithi117:> rpm -q kernel --last | head -n 1 2021-10-08T19:05:53.754 INFO:teuthology.orchestra.run.smithi117.stdout:kernel-4.18.0-305.19.1.el8_4.x86_64 Fri 08 Oct 2021 07:05:32 PM UTC 2021-10-08T19:05:53.756 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-305.19.1.el8_4.x86_64 2021-10-08T19:05:53.757 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.12.1.el8_4.x86_64 Expected: 4.18.0-305.19.1.el8_4.x86_64 2021-10-08T19:05:53.757 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2021-10-08T19:05:53.758 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-10-08T19:05:53.758 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-10-08T19:05:53.758 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2021-10-08T19:05:53.759 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi097.front.sepia.ceph.com, path=None, version=distro) 2021-10-08T19:05:53.759 DEBUG:teuthology.orchestra.run.smithi097:> rpm -q kernel --last | head -n 1 2021-10-08T19:05:53.893 INFO:teuthology.orchestra.run.smithi097.stdout:kernel-4.18.0-305.19.1.el8_4.x86_64 Fri 08 Oct 2021 07:04:47 PM UTC 2021-10-08T19:05:53.895 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-305.19.1.el8_4.x86_64 2021-10-08T19:05:53.895 DEBUG:teuthology.orchestra.run.smithi097:> sudo rpm -qi grub2-tools 2021-10-08T19:05:53.925 INFO:teuthology.orchestra.run.smithi097.stdout:Name : grub2-tools 2021-10-08T19:05:53.925 INFO:teuthology.orchestra.run.smithi097.stdout:Epoch : 1 2021-10-08T19:05:53.926 INFO:teuthology.orchestra.run.smithi097.stdout:Version : 2.02 2021-10-08T19:05:53.926 INFO:teuthology.orchestra.run.smithi097.stdout:Release : 81.el8 2021-10-08T19:05:53.926 INFO:teuthology.orchestra.run.smithi097.stdout:Architecture: x86_64 2021-10-08T19:05:53.926 INFO:teuthology.orchestra.run.smithi097.stdout:Install Date: Wed 11 Aug 2021 09:47:13 PM UTC 2021-10-08T19:05:53.927 INFO:teuthology.orchestra.run.smithi097.stdout:Group : System Environment/Base 2021-10-08T19:05:53.927 INFO:teuthology.orchestra.run.smithi097.stdout:Size : 9192705 2021-10-08T19:05:53.927 INFO:teuthology.orchestra.run.smithi097.stdout:License : GPLv3+ 2021-10-08T19:05:53.927 INFO:teuthology.orchestra.run.smithi097.stdout:Signature : RSA/SHA256, Tue 14 Apr 2020 03:18:37 PM UTC, Key ID 05b555b38483c65d 2021-10-08T19:05:53.928 INFO:teuthology.orchestra.run.smithi097.stdout:Source RPM : grub2-2.02-81.el8.src.rpm 2021-10-08T19:05:53.928 INFO:teuthology.orchestra.run.smithi097.stdout:Build Date : Tue 14 Apr 2020 02:54:04 PM UTC 2021-10-08T19:05:53.928 INFO:teuthology.orchestra.run.smithi097.stdout:Build Host : kbuilder.bsys.centos.org 2021-10-08T19:05:53.928 INFO:teuthology.orchestra.run.smithi097.stdout:Relocations : (not relocatable) 2021-10-08T19:05:53.928 INFO:teuthology.orchestra.run.smithi097.stdout:Packager : CentOS BuildSystem 2021-10-08T19:05:53.929 INFO:teuthology.orchestra.run.smithi097.stdout:Vendor : CentOS 2021-10-08T19:05:53.929 INFO:teuthology.orchestra.run.smithi097.stdout:URL : http://www.gnu.org/software/grub/ 2021-10-08T19:05:53.929 INFO:teuthology.orchestra.run.smithi097.stdout:Summary : Support tools for GRUB. 2021-10-08T19:05:53.929 INFO:teuthology.orchestra.run.smithi097.stdout:Description : 2021-10-08T19:05:53.930 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:05:53.930 INFO:teuthology.orchestra.run.smithi097.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2021-10-08T19:05:53.930 INFO:teuthology.orchestra.run.smithi097.stdout:customizable bootloader with modular architecture. It supports a rich 2021-10-08T19:05:53.930 INFO:teuthology.orchestra.run.smithi097.stdout:variety of kernel formats, file systems, computer architectures and 2021-10-08T19:05:53.930 INFO:teuthology.orchestra.run.smithi097.stdout:hardware devices. 2021-10-08T19:05:53.931 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:05:53.931 INFO:teuthology.orchestra.run.smithi097.stdout:This subpackage provides tools for support of all platforms. 2021-10-08T19:05:53.932 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2021-10-08T19:05:53.932 INFO:teuthology.task.kernel:Updating grub on smithi097 to boot 4.18.0-305.19.1.el8_4.x86_64 2021-10-08T19:05:53.933 DEBUG:teuthology.orchestra.run.smithi097:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2021-10-08T19:05:54.556 INFO:teuthology.orchestra.run.smithi097.stderr:Generating grub configuration file ... 2021-10-08T19:05:56.697 INFO:teuthology.orchestra.run.smithi097.stderr:done 2021-10-08T19:05:56.699 DEBUG:teuthology.orchestra.run.smithi097:> mktemp 2021-10-08T19:05:56.726 INFO:teuthology.orchestra.run.smithi097.stdout:/tmp/tmp.HuKSwrsi8X 2021-10-08T19:05:56.726 DEBUG:teuthology.orchestra.run.smithi097:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.HuKSwrsi8X 2021-10-08T19:05:56.795 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0666 /tmp/tmp.HuKSwrsi8X 2021-10-08T19:05:56.933 DEBUG:teuthology.orchestra.remote:smithi097:/tmp/tmp.HuKSwrsi8X is 4KB 2021-10-08T19:05:56.981 DEBUG:teuthology.orchestra.run.smithi097:> rm -fr /tmp/tmp.HuKSwrsi8X 2021-10-08T19:05:56.995 DEBUG:teuthology.orchestra.run.smithi097:> sudo /bin/ls /boot/loader/entries || true 2021-10-08T19:05:57.057 INFO:teuthology.orchestra.run.smithi097.stdout:d578f9996ed248e7a61be64fca30ef97-0-rescue.conf 2021-10-08T19:05:57.057 INFO:teuthology.orchestra.run.smithi097.stdout:d578f9996ed248e7a61be64fca30ef97-4.18.0-193.el8.x86_64.conf 2021-10-08T19:05:57.058 INFO:teuthology.orchestra.run.smithi097.stdout:d578f9996ed248e7a61be64fca30ef97-4.18.0-305.12.1.el8_4.x86_64.conf 2021-10-08T19:05:57.058 INFO:teuthology.orchestra.run.smithi097.stdout:d578f9996ed248e7a61be64fca30ef97-4.18.0-305.19.1.el8_4.x86_64.conf 2021-10-08T19:05:57.059 DEBUG:teuthology.orchestra.run.smithi097:> sudo grub2-set-default d578f9996ed248e7a61be64fca30ef97-4.18.0-305.19.1.el8_4.x86_64 2021-10-08T19:05:57.219 DEBUG:teuthology.orchestra.run.smithi097:> sudo shutdown -r now 2021-10-08T19:05:57.222 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2021-10-08T19:05:57.222 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi117.front.sepia.ceph.com, path=None, version=distro) 2021-10-08T19:05:57.223 DEBUG:teuthology.orchestra.run.smithi117:> rpm -q kernel --last | head -n 1 2021-10-08T19:05:57.353 INFO:teuthology.orchestra.run.smithi117.stdout:kernel-4.18.0-305.19.1.el8_4.x86_64 Fri 08 Oct 2021 07:05:32 PM UTC 2021-10-08T19:05:57.355 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-305.19.1.el8_4.x86_64 2021-10-08T19:05:57.355 DEBUG:teuthology.orchestra.run.smithi117:> sudo rpm -qi grub2-tools 2021-10-08T19:05:57.385 INFO:teuthology.orchestra.run.smithi117.stdout:Name : grub2-tools 2021-10-08T19:05:57.386 INFO:teuthology.orchestra.run.smithi117.stdout:Epoch : 1 2021-10-08T19:05:57.386 INFO:teuthology.orchestra.run.smithi117.stdout:Version : 2.02 2021-10-08T19:05:57.386 INFO:teuthology.orchestra.run.smithi117.stdout:Release : 81.el8 2021-10-08T19:05:57.386 INFO:teuthology.orchestra.run.smithi117.stdout:Architecture: x86_64 2021-10-08T19:05:57.387 INFO:teuthology.orchestra.run.smithi117.stdout:Install Date: Wed 11 Aug 2021 09:47:13 PM UTC 2021-10-08T19:05:57.387 INFO:teuthology.orchestra.run.smithi117.stdout:Group : System Environment/Base 2021-10-08T19:05:57.387 INFO:teuthology.orchestra.run.smithi117.stdout:Size : 9192705 2021-10-08T19:05:57.387 INFO:teuthology.orchestra.run.smithi117.stdout:License : GPLv3+ 2021-10-08T19:05:57.387 INFO:teuthology.orchestra.run.smithi117.stdout:Signature : RSA/SHA256, Tue 14 Apr 2020 03:18:37 PM UTC, Key ID 05b555b38483c65d 2021-10-08T19:05:57.388 INFO:teuthology.orchestra.run.smithi117.stdout:Source RPM : grub2-2.02-81.el8.src.rpm 2021-10-08T19:05:57.388 INFO:teuthology.orchestra.run.smithi117.stdout:Build Date : Tue 14 Apr 2020 02:54:04 PM UTC 2021-10-08T19:05:57.388 INFO:teuthology.orchestra.run.smithi117.stdout:Build Host : kbuilder.bsys.centos.org 2021-10-08T19:05:57.388 INFO:teuthology.orchestra.run.smithi117.stdout:Relocations : (not relocatable) 2021-10-08T19:05:57.389 INFO:teuthology.orchestra.run.smithi117.stdout:Packager : CentOS BuildSystem 2021-10-08T19:05:57.389 INFO:teuthology.orchestra.run.smithi117.stdout:Vendor : CentOS 2021-10-08T19:05:57.389 INFO:teuthology.orchestra.run.smithi117.stdout:URL : http://www.gnu.org/software/grub/ 2021-10-08T19:05:57.389 INFO:teuthology.orchestra.run.smithi117.stdout:Summary : Support tools for GRUB. 2021-10-08T19:05:57.390 INFO:teuthology.orchestra.run.smithi117.stdout:Description : 2021-10-08T19:05:57.390 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:05:57.390 INFO:teuthology.orchestra.run.smithi117.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2021-10-08T19:05:57.391 INFO:teuthology.orchestra.run.smithi117.stdout:customizable bootloader with modular architecture. It supports a rich 2021-10-08T19:05:57.391 INFO:teuthology.orchestra.run.smithi117.stdout:variety of kernel formats, file systems, computer architectures and 2021-10-08T19:05:57.391 INFO:teuthology.orchestra.run.smithi117.stdout:hardware devices. 2021-10-08T19:05:57.391 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:05:57.391 INFO:teuthology.orchestra.run.smithi117.stdout:This subpackage provides tools for support of all platforms. 2021-10-08T19:05:57.393 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2021-10-08T19:05:57.393 INFO:teuthology.task.kernel:Updating grub on smithi117 to boot 4.18.0-305.19.1.el8_4.x86_64 2021-10-08T19:05:57.393 DEBUG:teuthology.orchestra.run.smithi117:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2021-10-08T19:05:58.809 INFO:teuthology.orchestra.run.smithi117.stderr:Generating grub configuration file ... 2021-10-08T19:06:00.644 INFO:teuthology.orchestra.run.smithi117.stderr:done 2021-10-08T19:06:00.646 DEBUG:teuthology.orchestra.run.smithi117:> mktemp 2021-10-08T19:06:00.677 INFO:teuthology.orchestra.run.smithi117.stdout:/tmp/tmp.rXfuOk5ubV 2021-10-08T19:06:00.678 DEBUG:teuthology.orchestra.run.smithi117:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.rXfuOk5ubV 2021-10-08T19:06:00.747 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0666 /tmp/tmp.rXfuOk5ubV 2021-10-08T19:06:00.897 DEBUG:teuthology.orchestra.remote:smithi117:/tmp/tmp.rXfuOk5ubV is 4KB 2021-10-08T19:06:00.916 DEBUG:teuthology.orchestra.run.smithi117:> rm -fr /tmp/tmp.rXfuOk5ubV 2021-10-08T19:06:00.930 DEBUG:teuthology.orchestra.run.smithi117:> sudo /bin/ls /boot/loader/entries || true 2021-10-08T19:06:00.996 INFO:teuthology.orchestra.run.smithi117.stdout:d578f9996ed248e7a61be64fca30ef97-0-rescue.conf 2021-10-08T19:06:00.996 INFO:teuthology.orchestra.run.smithi117.stdout:d578f9996ed248e7a61be64fca30ef97-4.18.0-193.el8.x86_64.conf 2021-10-08T19:06:00.996 INFO:teuthology.orchestra.run.smithi117.stdout:d578f9996ed248e7a61be64fca30ef97-4.18.0-305.12.1.el8_4.x86_64.conf 2021-10-08T19:06:00.997 INFO:teuthology.orchestra.run.smithi117.stdout:d578f9996ed248e7a61be64fca30ef97-4.18.0-305.19.1.el8_4.x86_64.conf 2021-10-08T19:06:00.998 DEBUG:teuthology.orchestra.run.smithi117:> sudo grub2-set-default d578f9996ed248e7a61be64fca30ef97-4.18.0-305.19.1.el8_4.x86_64 2021-10-08T19:06:01.152 DEBUG:teuthology.orchestra.run.smithi117:> sudo shutdown -r now 2021-10-08T19:06:31.183 INFO:teuthology.misc:Re-opening connections... 2021-10-08T19:06:31.183 INFO:teuthology.misc:trying to connect to ubuntu@smithi097.front.sepia.ceph.com 2021-10-08T19:06:31.184 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2021-10-08T19:06:31.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-08T19:07:31.247 DEBUG:teuthology.orchestra.remote:timed out 2021-10-08T19:07:31.249 INFO:teuthology.misc:trying to connect to ubuntu@smithi117.front.sepia.ceph.com 2021-10-08T19:07:31.249 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2021-10-08T19:07:31.250 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-08T19:07:34.315 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.117 2021-10-08T19:07:34.316 DEBUG:teuthology.misc:waited 63.13210582733154 2021-10-08T19:07:35.317 INFO:teuthology.misc:trying to connect to ubuntu@smithi097.front.sepia.ceph.com 2021-10-08T19:07:35.318 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2021-10-08T19:07:35.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-08T19:07:35.652 DEBUG:teuthology.orchestra.run.smithi097:> true 2021-10-08T19:07:35.959 DEBUG:teuthology.misc:waited 64.77561664581299 2021-10-08T19:07:36.961 INFO:teuthology.misc:trying to connect to ubuntu@smithi117.front.sepia.ceph.com 2021-10-08T19:07:36.961 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2021-10-08T19:07:36.962 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-08T19:07:37.307 DEBUG:teuthology.orchestra.run.smithi117:> true 2021-10-08T19:07:37.686 DEBUG:teuthology.misc:waited 66.50303554534912 2021-10-08T19:07:38.688 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2021-10-08T19:07:38.688 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-305.19.1.el8_4.x86_64"... 2021-10-08T19:07:38.689 DEBUG:teuthology.orchestra.run.smithi097:> uname -r 2021-10-08T19:07:38.704 INFO:teuthology.orchestra.run.smithi097.stdout:4.18.0-305.19.1.el8_4.x86_64 2021-10-08T19:07:38.705 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-305.19.1.el8_4.x86_64 vs 4.18.0-305.19.1.el8_4.x86_64 2021-10-08T19:07:38.705 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-10-08T19:07:38.706 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2021-10-08T19:07:38.706 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2021-10-08T19:07:38.706 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "4.18.0-305.19.1.el8_4.x86_64"... 2021-10-08T19:07:38.707 DEBUG:teuthology.orchestra.run.smithi117:> uname -r 2021-10-08T19:07:38.724 INFO:teuthology.orchestra.run.smithi117.stdout:4.18.0-305.19.1.el8_4.x86_64 2021-10-08T19:07:38.724 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-305.19.1.el8_4.x86_64 vs 4.18.0-305.19.1.el8_4.x86_64 2021-10-08T19:07:38.725 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-10-08T19:07:38.725 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2021-10-08T19:07:39.726 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2021-10-08T19:07:39.727 DEBUG:teuthology.orchestra.run.smithi097:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-10-08T19:07:39.909 INFO:teuthology.orchestra.run.smithi097.stdout:ttyS1 2021-10-08T19:07:39.974 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2021-10-08T19:07:39.974 DEBUG:teuthology.orchestra.run.smithi117:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-10-08T19:07:40.080 INFO:teuthology.orchestra.run.smithi117.stdout:ttyS1 2021-10-08T19:07:40.105 INFO:teuthology.run_tasks:Running task internal.base... 2021-10-08T19:07:40.121 INFO:teuthology.task.internal:Creating test directory... 2021-10-08T19:07:40.122 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-10-08T19:07:40.131 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-10-08T19:07:40.154 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2021-10-08T19:07:40.167 INFO:teuthology.run_tasks:Running task internal.archive... 2021-10-08T19:07:40.198 INFO:teuthology.task.internal:Creating archive directory... 2021-10-08T19:07:40.198 DEBUG:teuthology.orchestra.run.smithi097:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-10-08T19:07:40.214 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-10-08T19:07:40.454 INFO:teuthology.run_tasks:Running task internal.coredump... 2021-10-08T19:07:40.466 INFO:teuthology.task.internal:Enabling coredump saving... 2021-10-08T19:07:40.467 DEBUG:teuthology.orchestra.run.smithi097:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-10-08T19:07:40.510 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-10-08T19:07:40.546 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-10-08T19:07:40.556 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-10-08T19:07:40.879 INFO:teuthology.orchestra.run.smithi097.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-10-08T19:07:41.043 INFO:teuthology.orchestra.run.smithi097.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-10-08T19:07:41.056 INFO:teuthology.run_tasks:Running task internal.sudo... 2021-10-08T19:07:41.067 INFO:teuthology.task.internal:Configuring sudo... 2021-10-08T19:07:41.067 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-10-08T19:07:41.109 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-10-08T19:07:41.292 INFO:teuthology.run_tasks:Running task internal.syslog... 2021-10-08T19:07:41.308 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2021-10-08T19:07:41.308 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-10-08T19:07:41.312 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-10-08T19:07:41.326 DEBUG:teuthology.orchestra.run.smithi097:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-10-08T19:07:41.417 DEBUG:teuthology.orchestra.run.smithi097:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2021-10-08T19:07:41.517 DEBUG:teuthology.orchestra.run.smithi097:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-10-08T19:07:41.628 DEBUG:teuthology.orchestra.run.smithi097:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2021-10-08T19:07:41.670 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2021-10-08T19:07:41.670 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-10-08T19:07:41.757 DEBUG:teuthology.orchestra.run.smithi117:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-10-08T19:07:41.799 DEBUG:teuthology.orchestra.run.smithi117:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2021-10-08T19:07:41.838 DEBUG:teuthology.orchestra.run.smithi117:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-10-08T19:07:41.914 DEBUG:teuthology.orchestra.run.smithi117:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2021-10-08T19:07:41.952 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2021-10-08T19:07:41.952 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-10-08T19:07:42.019 DEBUG:teuthology.orchestra.run.smithi097:> sudo service rsyslog restart 2021-10-08T19:07:42.022 DEBUG:teuthology.orchestra.run.smithi117:> sudo service rsyslog restart 2021-10-08T19:07:42.133 INFO:teuthology.orchestra.run.smithi117.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2021-10-08T19:07:42.331 INFO:teuthology.orchestra.run.smithi097.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2021-10-08T19:07:42.351 INFO:teuthology.run_tasks:Running task internal.timer... 2021-10-08T19:07:42.362 INFO:teuthology.task.internal:Starting timer... 2021-10-08T19:07:42.363 INFO:teuthology.run_tasks:Running task pcp... 2021-10-08T19:07:42.408 INFO:teuthology.run_tasks:Running task selinux... 2021-10-08T19:07:42.441 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2021-10-08T19:07:42.442 DEBUG:teuthology.orchestra.run.smithi097:> sudo service auditd rotate 2021-10-08T19:07:42.508 INFO:teuthology.orchestra.run.smithi097.stdout:Rotating logs: [ OK ] 2021-10-08T19:07:42.508 DEBUG:teuthology.orchestra.run.smithi117:> sudo service auditd rotate 2021-10-08T19:07:42.563 INFO:teuthology.orchestra.run.smithi117.stdout:Rotating logs: [ OK ] 2021-10-08T19:07:42.564 DEBUG:teuthology.task.selinux:Getting current SELinux state 2021-10-08T19:07:42.565 DEBUG:teuthology.orchestra.run.smithi097:> /usr/sbin/getenforce 2021-10-08T19:07:42.597 INFO:teuthology.orchestra.run.smithi097.stdout:Permissive 2021-10-08T19:07:42.598 DEBUG:teuthology.orchestra.run.smithi117:> /usr/sbin/getenforce 2021-10-08T19:07:42.631 INFO:teuthology.orchestra.run.smithi117.stdout:Permissive 2021-10-08T19:07:42.631 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi097.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi117.front.sepia.ceph.com': 'permissive'} 2021-10-08T19:07:42.632 DEBUG:teuthology.orchestra.run.smithi097:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|scontext=system_u:system_r:logrotate_t:s0\)' 2021-10-08T19:07:42.660 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-08T19:07:42.661 DEBUG:teuthology.orchestra.run.smithi117:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|scontext=system_u:system_r:logrotate_t:s0\)' 2021-10-08T19:07:42.693 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-08T19:07:42.693 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2021-10-08T19:07:42.694 DEBUG:teuthology.orchestra.run.smithi097:> sudo /usr/sbin/setenforce permissive 2021-10-08T19:07:42.725 DEBUG:teuthology.orchestra.run.smithi117:> sudo /usr/sbin/setenforce permissive 2021-10-08T19:07:42.754 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2021-10-08T19:07:42.766 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated or references a specific commit; assuming it is current 2021-10-08T19:07:42.767 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to origin/master 2021-10-08T19:07:42.793 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2021-10-08T19:07:42.795 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi097.front.sepia.ceph.com,smithi117.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2021-10-08T19:07:43.232 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2021-10-08T19:07:44.202 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2021-10-08T19:07:47.097 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2021-10-08T19:07:47.120 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:07:47 +0000 (0:00:00.039) 0:00:00.039 ******** 2021-10-08T19:07:47.132 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:07:47 +0000 (0:00:00.011) 0:00:00.050 ******** 2021-10-08T19:07:48.627 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi117.front.sepia.ceph.com] 2021-10-08T19:07:48.678 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:07:48 +0000 (0:00:01.546) 0:00:01.597 ******** 2021-10-08T19:07:48.958 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2021-10-08T19:07:48.960 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2021-10-08T19:07:48.984 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:07:48 +0000 (0:00:00.306) 0:00:01.903 ******** 2021-10-08T19:07:49.382 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2021-10-08T19:07:49.384 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-10-08T19:07:49.409 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:07:49 +0000 (0:00:00.424) 0:00:02.327 ******** 2021-10-08T19:07:49.480 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2021-10-08T19:07:49.485 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:07:49.514 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:07:49 +0000 (0:00:00.102) 0:00:02.429 ******** 2021-10-08T19:07:49.538 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi097.front.sepia.ceph.com] 2021-10-08T19:07:49.589 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:07:49 +0000 (0:00:00.078) 0:00:02.508 ******** 2021-10-08T19:07:49.789 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2021-10-08T19:07:49.792 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} TASK [ansible-managed : Create the sudo group.] ******************************** ok: [smithi097.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2021-10-08T19:07:49.812 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:07:49 +0000 (0:00:00.222) 0:00:02.731 ******** 2021-10-08T19:07:49.833 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:07:49 +0000 (0:00:00.020) 0:00:02.752 ******** 2021-10-08T19:07:50.096 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2021-10-08T19:07:50.097 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-10-08T19:07:50.121 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:07:50 +0000 (0:00:00.287) 0:00:03.039 ******** 2021-10-08T19:07:50.203 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2021-10-08T19:07:50.205 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:07:50.226 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:07:50 +0000 (0:00:00.104) 0:00:03.144 ******** 2021-10-08T19:07:50.411 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** ok: [smithi097.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-08T19:07:50.435 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:07:50 +0000 (0:00:00.209) 0:00:03.354 ******** 2021-10-08T19:07:50.748 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2021-10-08T19:07:50.750 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1633720069.8807101-2141-268922855656821/source", "state": "file", "uid": 0} 2021-10-08T19:07:50.771 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:07:50 +0000 (0:00:00.336) 0:00:03.690 ******** 2021-10-08T19:07:51.063 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1633720070.4866087-2267-105322962483497/source", "state": "file", "uid": 0} 2021-10-08T19:07:51.088 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:07:51 +0000 (0:00:00.316) 0:00:04.007 ******** 2021-10-08T19:07:51.181 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2021-10-08T19:07:51.183 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2021-10-08T19:07:51.185 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-10-08T19:07:51.392 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2021-10-08T19:07:51.394 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-10-08T19:07:51.457 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2021-10-08T19:07:51.459 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-10-08T19:07:51.473 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* Friday 08 October 2021 19:07:51 +0000 (0:00:00.385) 0:00:04.392 ******** 2021-10-08T19:07:51.996 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] 2021-10-08T19:07:52.015 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] 2021-10-08T19:07:52.033 INFO:teuthology.task.ansible.out: TASK [set_fact] **************************************************************** Friday 08 October 2021 19:07:52 +0000 (0:00:00.559) 0:00:04.952 ******** 2021-10-08T19:07:52.058 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-10-08T19:07:52.069 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-10-08T19:07:52.074 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-10-08T19:07:52.223 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:07:52 +0000 (0:00:00.189) 0:00:05.142 ******** 2021-10-08T19:07:52.241 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:07:52 +0000 (0:00:00.018) 0:00:05.160 ******** 2021-10-08T19:07:52.869 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-10-08T19:07:52.871 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] 2021-10-08T19:07:52.922 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2021-10-08T19:07:52.924 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:07:52 +0000 (0:00:00.681) 0:00:05.842 ******** 2021-10-08T19:07:53.611 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** changed: [smithi117.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.177784", "end": "2021-10-08 19:07:53.582869", "rc": 0, "start": "2021-10-08 19:07:53.405085", "stderr": "", "stderr_lines": [], "stdout": "ee931718ec906fcbc1b8afc120f625a06f1ece1a", "stdout_lines": ["ee931718ec906fcbc1b8afc120f625a06f1ece1a"]} 2021-10-08T19:07:53.636 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:07:53 +0000 (0:00:00.713) 0:00:06.555 ******** 2021-10-08T19:07:53.844 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** changed: [smithi117.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.017757", "end": "2021-10-08 19:07:53.827546", "failed_when_result": false, "rc": 0, "start": "2021-10-08 19:07:53.809789", "stderr": "", "stderr_lines": [], "stdout": "c29274177b79f72740fc714fa28b55400cd0737f", "stdout_lines": ["c29274177b79f72740fc714fa28b55400cd0737f"]} 2021-10-08T19:07:53.867 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:07:53 +0000 (0:00:00.231) 0:00:06.786 ******** 2021-10-08T19:07:53.878 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi097.front.sepia.ceph.com] 2021-10-08T19:07:53.930 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:07:53 +0000 (0:00:00.063) 0:00:06.849 ******** 2021-10-08T19:07:53.936 INFO:teuthology.task.ansible.out: TASK [Determine if we can skip users and pubkeys updates] ********************** 2021-10-08T19:07:53.937 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:07:53.960 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:07:53 +0000 (0:00:00.029) 0:00:06.879 ******** 2021-10-08T19:07:54.032 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:07:54.054 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:07:54 +0000 (0:00:00.093) 0:00:06.973 ******** 2021-10-08T19:07:54.123 INFO:teuthology.task.ansible.out: TASK [Remove managed_admin_users from managed_users] *************************** 2021-10-08T19:07:54.125 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:07:54.149 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:07:54 +0000 (0:00:00.095) 0:00:07.068 ******** 2021-10-08T19:07:54.231 INFO:teuthology.task.ansible.out: TASK [Filter the managed_users list] ******************************************* skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:07:54.253 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:07:54 +0000 (0:00:00.103) 0:00:07.172 ******** 2021-10-08T19:07:54.331 INFO:teuthology.task.ansible.out: TASK [Filter the managed_admin_users list] ************************************* 2021-10-08T19:07:54.333 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:07:54.353 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:07:54 +0000 (0:00:00.100) 0:00:07.272 ******** 2021-10-08T19:07:54.391 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2021-10-08T19:07:54.393 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.197032", "end": "2021-10-08 19:07:54.363836", "rc": 0, "start": "2021-10-08 19:07:54.166804", "stderr": "", "stderr_lines": [], "stdout": "ee931718ec906fcbc1b8afc120f625a06f1ece1a", "stdout_lines": ["ee931718ec906fcbc1b8afc120f625a06f1ece1a"]} 2021-10-08T19:07:54.416 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:07:54 +0000 (0:00:00.062) 0:00:07.335 ******** 2021-10-08T19:07:54.591 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2021-10-08T19:07:54.593 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-08T19:07:54.616 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:07:54 +0000 (0:00:00.200) 0:00:07.535 ******** 2021-10-08T19:07:54.623 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-10-08T19:07:54.625 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.016517", "end": "2021-10-08 19:07:54.605277", "failed_when_result": false, "rc": 0, "start": "2021-10-08 19:07:54.588760", "stderr": "", "stderr_lines": [], "stdout": "c29274177b79f72740fc714fa28b55400cd0737f", "stdout_lines": ["c29274177b79f72740fc714fa28b55400cd0737f"]} 2021-10-08T19:07:54.648 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:07:54 +0000 (0:00:00.031) 0:00:07.567 ******** 2021-10-08T19:07:54.717 INFO:teuthology.task.ansible.out: TASK [Determine if we can skip users and pubkeys updates] ********************** 2021-10-08T19:07:54.718 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:07:54.740 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:07:54 +0000 (0:00:00.092) 0:00:07.659 ******** 2021-10-08T19:07:54.809 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ 2021-10-08T19:07:54.811 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:07:54.832 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:07:54 +0000 (0:00:00.092) 0:00:07.751 ******** 2021-10-08T19:07:54.894 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-10-08T19:07:54.896 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-10-08T19:07:54.907 INFO:teuthology.task.ansible.out: TASK [Remove managed_admin_users from managed_users] *************************** 2021-10-08T19:07:54.908 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:07:54.930 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:07:54 +0000 (0:00:00.098) 0:00:07.849 ******** 2021-10-08T19:07:55.000 INFO:teuthology.task.ansible.out: TASK [Filter the managed_users list] ******************************************* skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:07:55.022 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:07:55 +0000 (0:00:00.091) 0:00:07.941 ******** 2021-10-08T19:07:55.091 INFO:teuthology.task.ansible.out: TASK [Filter the managed_admin_users list] ************************************* 2021-10-08T19:07:55.093 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [Create all admin users with sudo access.] ******************************** ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-10-08T19:07:55.122 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:07:55 +0000 (0:00:00.099) 0:00:08.040 ******** 2021-10-08T19:07:55.297 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-10-08T19:07:55.360 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2021-10-08T19:07:55.362 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-08T19:07:55.383 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:07:55 +0000 (0:00:00.261) 0:00:08.302 ******** 2021-10-08T19:07:55.493 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-10-08T19:07:55.495 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-10-08T19:07:55.664 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-10-08T19:07:55.697 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-10-08T19:07:55.865 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-10-08T19:07:55.897 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-10-08T19:07:56.066 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-10-08T19:07:56.098 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-10-08T19:07:56.255 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-10-08T19:07:56.287 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-10-08T19:07:56.457 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-10-08T19:07:56.488 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-10-08T19:07:56.658 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-10-08T19:07:56.690 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-10-08T19:07:56.846 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-10-08T19:07:56.879 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-10-08T19:07:57.038 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-10-08T19:07:57.102 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-10-08T19:07:57.240 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-10-08T19:07:57.303 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-10-08T19:07:57.429 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-10-08T19:07:57.494 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-10-08T19:07:57.623 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-10-08T19:07:57.697 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-10-08T19:07:57.857 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-10-08T19:07:57.891 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-10-08T19:07:58.051 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-10-08T19:07:58.095 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-10-08T19:07:58.254 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-10-08T19:07:58.287 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-10-08T19:07:58.446 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-10-08T19:07:58.489 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-10-08T19:07:58.648 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-10-08T19:07:58.680 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-10-08T19:07:58.839 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-10-08T19:07:58.872 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-10-08T19:07:59.041 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-10-08T19:07:59.073 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-10-08T19:07:59.232 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-10-08T19:07:59.275 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-10-08T19:07:59.424 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-10-08T19:07:59.467 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-10-08T19:07:59.615 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-10-08T19:07:59.668 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-10-08T19:07:59.818 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-10-08T19:07:59.872 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-10-08T19:08:00.009 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-10-08T19:08:00.073 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-10-08T19:08:00.209 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-10-08T19:08:00.263 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-10-08T19:08:00.410 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-10-08T19:08:00.464 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-10-08T19:08:00.603 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-10-08T19:08:00.670 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-10-08T19:08:00.794 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-10-08T19:08:00.858 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-10-08T19:08:00.995 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-10-08T19:08:01.060 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-10-08T19:08:01.187 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-10-08T19:08:01.255 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-10-08T19:08:01.377 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-10-08T19:08:01.451 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1137} 2021-10-08T19:08:01.577 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-10-08T19:08:01.652 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-10-08T19:08:01.779 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-10-08T19:08:01.844 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-10-08T19:08:01.969 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-10-08T19:08:02.044 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-10-08T19:08:02.171 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1137} 2021-10-08T19:08:02.235 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-10-08T19:08:02.366 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-10-08T19:08:02.432 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-10-08T19:08:02.556 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-10-08T19:08:02.630 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-10-08T19:08:02.757 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-10-08T19:08:02.832 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-10-08T19:08:02.949 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-10-08T19:08:03.023 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-10-08T19:08:03.149 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-10-08T19:08:03.216 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-10-08T19:08:03.343 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-10-08T19:08:03.406 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-10-08T19:08:03.533 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-10-08T19:08:03.613 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-10-08T19:08:03.730 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-10-08T19:08:03.808 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-10-08T19:08:03.934 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-10-08T19:08:04.008 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-10-08T19:08:04.124 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-10-08T19:08:04.209 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-10-08T19:08:04.329 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-10-08T19:08:04.426 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-10-08T19:08:04.537 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-10-08T19:08:04.621 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-10-08T19:08:04.729 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-10-08T19:08:04.825 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-10-08T19:08:04.919 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-10-08T19:08:05.025 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-10-08T19:08:05.120 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-10-08T19:08:05.216 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-10-08T19:08:05.311 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-10-08T19:08:05.409 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-10-08T19:08:05.519 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-10-08T19:08:05.604 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-10-08T19:08:05.713 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-10-08T19:08:05.821 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-10-08T19:08:05.908 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-10-08T19:08:06.007 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-10-08T19:08:06.106 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-10-08T19:08:06.210 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-10-08T19:08:06.309 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-10-08T19:08:06.418 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-10-08T19:08:06.506 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-10-08T19:08:06.613 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-10-08T19:08:06.701 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-10-08T19:08:06.807 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-10-08T19:08:06.902 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-10-08T19:08:07.008 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-10-08T19:08:07.104 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-10-08T19:08:07.210 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-10-08T19:08:07.309 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-10-08T19:08:07.414 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-10-08T19:08:07.503 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-10-08T19:08:07.620 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-10-08T19:08:07.710 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-10-08T19:08:07.818 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-10-08T19:08:07.904 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-10-08T19:08:08.020 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-10-08T19:08:08.103 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-10-08T19:08:08.210 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-10-08T19:08:08.298 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-10-08T19:08:08.416 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-10-08T19:08:08.502 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-10-08T19:08:08.607 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-10-08T19:08:08.694 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-10-08T19:08:08.814 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-10-08T19:08:08.893 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-10-08T19:08:09.005 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-10-08T19:08:09.093 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-10-08T19:08:09.201 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-10-08T19:08:09.286 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-10-08T19:08:09.418 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-10-08T19:08:09.497 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-10-08T19:08:09.649 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-10-08T19:08:09.717 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-10-08T19:08:09.868 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-10-08T19:08:09.921 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-10-08T19:08:10.063 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-10-08T19:08:10.119 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-10-08T19:08:10.274 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-10-08T19:08:10.314 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-10-08T19:08:10.468 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-10-08T19:08:10.517 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-10-08T19:08:10.679 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-10-08T19:08:10.724 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-10-08T19:08:10.882 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-10-08T19:08:10.926 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-10-08T19:08:11.075 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-10-08T19:08:11.129 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-10-08T19:08:11.278 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-10-08T19:08:11.322 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-10-08T19:08:11.471 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-10-08T19:08:11.516 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-10-08T19:08:11.671 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-10-08T19:08:11.714 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-10-08T19:08:11.873 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-10-08T19:08:11.916 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-10-08T19:08:12.065 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-10-08T19:08:12.108 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-10-08T19:08:12.261 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-10-08T19:08:12.306 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-10-08T19:08:12.464 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-10-08T19:08:12.506 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-10-08T19:08:12.657 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-10-08T19:08:12.700 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-10-08T19:08:12.859 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-10-08T19:08:12.892 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-10-08T19:08:13.061 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-10-08T19:08:13.094 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-10-08T19:08:13.252 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-10-08T19:08:13.297 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-10-08T19:08:13.454 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-10-08T19:08:13.497 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-10-08T19:08:13.657 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-10-08T19:08:13.693 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-10-08T19:08:13.852 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-10-08T19:08:13.884 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-10-08T19:08:14.053 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-10-08T19:08:14.085 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-10-08T19:08:14.243 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-10-08T19:08:14.276 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-10-08T19:08:14.446 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-10-08T19:08:14.479 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-10-08T19:08:14.634 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-10-08T19:08:14.690 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-10-08T19:08:14.827 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-10-08T19:08:14.882 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-10-08T19:08:15.029 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-10-08T19:08:15.083 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-10-08T19:08:15.230 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-10-08T19:08:15.273 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-10-08T19:08:15.424 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-10-08T19:08:15.479 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-10-08T19:08:15.617 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-10-08T19:08:15.680 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-10-08T19:08:15.817 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-10-08T19:08:15.871 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-10-08T19:08:16.009 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-10-08T19:08:16.064 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-10-08T19:08:16.211 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-10-08T19:08:16.254 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-10-08T19:08:16.423 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-10-08T19:08:16.456 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-10-08T19:08:16.617 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-10-08T19:08:16.649 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-10-08T19:08:16.821 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-10-08T19:08:16.843 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-10-08T19:08:17.014 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-10-08T19:08:17.036 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-10-08T19:08:17.207 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-10-08T19:08:17.238 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-10-08T19:08:17.409 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-10-08T19:08:17.432 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-10-08T19:08:17.612 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-10-08T19:08:17.634 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-10-08T19:08:17.807 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-10-08T19:08:17.839 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-10-08T19:08:18.009 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-10-08T19:08:18.053 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-10-08T19:08:18.210 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-10-08T19:08:18.242 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-10-08T19:08:18.400 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-10-08T19:08:18.444 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-10-08T19:08:18.604 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-10-08T19:08:18.637 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-10-08T19:08:18.794 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-10-08T19:08:18.837 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-10-08T19:08:18.996 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-10-08T19:08:19.029 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-10-08T19:08:19.189 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-10-08T19:08:19.222 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-10-08T19:08:19.384 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-10-08T19:08:19.415 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-10-08T19:08:19.574 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-10-08T19:08:19.618 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-10-08T19:08:19.774 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-10-08T19:08:19.815 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-10-08T19:08:19.969 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-10-08T19:08:20.020 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-10-08T19:08:20.170 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-10-08T19:08:20.223 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-10-08T19:08:20.373 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-10-08T19:08:20.418 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-10-08T19:08:20.565 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-10-08T19:08:20.618 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-10-08T19:08:20.767 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-10-08T19:08:20.822 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-10-08T19:08:20.969 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-10-08T19:08:21.014 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-10-08T19:08:21.166 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "move_home": false, "name": "dachary", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-10-08T19:08:21.219 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-10-08T19:08:21.360 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1238, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "move_home": false, "name": "amctagga", "shell": "/bin/bash", "state": "present", "uid": 1238} 2021-10-08T19:08:21.411 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-10-08T19:08:21.560 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1239, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "move_home": false, "name": "kevinz", "shell": "/bin/bash", "state": "present", "uid": 1239} 2021-10-08T19:08:21.614 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-10-08T19:08:21.767 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1240, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "move_home": false, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "uid": 1240} 2021-10-08T19:08:21.822 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "move_home": false, "name": "dachary", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-10-08T19:08:21.961 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1241, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "move_home": false, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "uid": 1241} 2021-10-08T19:08:22.016 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1238, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "move_home": false, "name": "amctagga", "shell": "/bin/bash", "state": "present", "uid": 1238} 2021-10-08T19:08:22.159 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1242, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "move_home": false, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "uid": 1242} 2021-10-08T19:08:22.212 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1239, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "move_home": false, "name": "kevinz", "shell": "/bin/bash", "state": "present", "uid": 1239} 2021-10-08T19:08:22.351 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1243, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "move_home": false, "name": "lflores", "shell": "/bin/bash", "state": "present", "uid": 1243} 2021-10-08T19:08:22.405 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1240, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "move_home": false, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "uid": 1240} 2021-10-08T19:08:22.551 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1244, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "move_home": false, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "uid": 1244} 2021-10-08T19:08:22.608 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1241, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "move_home": false, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "uid": 1241} 2021-10-08T19:08:22.747 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1245, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "move_home": false, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "uid": 1245} 2021-10-08T19:08:22.805 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1242, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "move_home": false, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "uid": 1242} 2021-10-08T19:08:22.942 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1246, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "move_home": false, "name": "luisrico", "shell": "/bin/bash", "state": "present", "uid": 1246} 2021-10-08T19:08:23.008 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1243, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "move_home": false, "name": "lflores", "shell": "/bin/bash", "state": "present", "uid": 1243} 2021-10-08T19:08:23.148 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1247, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "move_home": false, "name": "matan", "shell": "/bin/bash", "state": "present", "uid": 1247} 2021-10-08T19:08:23.222 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1244, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "move_home": false, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "uid": 1244} 2021-10-08T19:08:23.347 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1248, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "move_home": false, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "uid": 1248} 2021-10-08T19:08:23.423 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1245, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "move_home": false, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "uid": 1245} 2021-10-08T19:08:23.541 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1249, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "move_home": false, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "uid": 1249} 2021-10-08T19:08:23.616 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1246, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "move_home": false, "name": "luisrico", "shell": "/bin/bash", "state": "present", "uid": 1246} 2021-10-08T19:08:23.744 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1250, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "move_home": false, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "uid": 1250} 2021-10-08T19:08:23.819 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1247, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "move_home": false, "name": "matan", "shell": "/bin/bash", "state": "present", "uid": 1247} 2021-10-08T19:08:23.954 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1251, "groups": "sudo", "home": "/home/mayagilad", "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "move_home": false, "name": "mayagilad", "shell": "/bin/bash", "state": "present", "uid": 1251} 2021-10-08T19:08:24.022 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1248, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "move_home": false, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "uid": 1248} 2021-10-08T19:08:24.158 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1252, "groups": "sudo", "home": "/home/arjsharm", "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "move_home": false, "name": "arjsharm", "shell": "/bin/bash", "state": "present", "uid": 1252} 2021-10-08T19:08:24.222 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1249, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "move_home": false, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "uid": 1249} 2021-10-08T19:08:24.332 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1253, "groups": "sudo", "home": "/home/melissali", "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "move_home": false, "name": "melissali", "shell": "/bin/bash", "state": "present", "uid": 1253} 2021-10-08T19:08:24.410 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1250, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "move_home": false, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "uid": 1250} 2021-10-08T19:08:24.611 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1251, "groups": "sudo", "home": "/home/mayagilad", "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "move_home": false, "name": "mayagilad", "shell": "/bin/bash", "state": "present", "uid": 1251} 2021-10-08T19:08:24.812 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1252, "groups": "sudo", "home": "/home/arjsharm", "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "move_home": false, "name": "arjsharm", "shell": "/bin/bash", "state": "present", "uid": 1252} 2021-10-08T19:08:25.004 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1253, "groups": "sudo", "home": "/home/melissali", "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "move_home": false, "name": "melissali", "shell": "/bin/bash", "state": "present", "uid": 1253} 2021-10-08T19:08:25.968 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10102, "groups": "sudo", "home": "/home/ionutbalutoiu", "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "name": "ionutbalutoiu", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2021-10-08T19:08:26.660 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10102, "groups": "sudo", "home": "/home/ionutbalutoiu", "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "name": "ionutbalutoiu", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2021-10-08T19:08:27.391 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/pdiazbou", "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "name": "pdiazbou", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2021-10-08T19:08:28.180 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/pdiazbou", "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "name": "pdiazbou", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2021-10-08T19:08:28.794 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/xuwang", "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "name": "xuwang", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2021-10-08T19:08:29.669 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/xuwang", "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "name": "xuwang", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2021-10-08T19:08:30.209 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/blaine", "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "name": "blaine", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2021-10-08T19:08:30.358 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:30 +0000 (0:00:34.975) 0:00:43.277 ******** 2021-10-08T19:08:30.430 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** 2021-10-08T19:08:30.452 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:30 +0000 (0:00:00.093) 0:00:43.371 ******** 2021-10-08T19:08:30.546 INFO:teuthology.task.ansible.out: TASK [Merge managed_users and managed_admin users] ***************************** 2021-10-08T19:08:30.549 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora 2021-10-08T19:08:30.551 INFO:teuthology.task.ansible.out:rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2021-10-08T19:08:30.553 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed208 2021-10-08T19:08:30.554 INFO:teuthology.task.ansible.out:2caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": 2021-10-08T19:08:30.556 INFO:teuthology.task.ansible.out: "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d 2021-10-08T19:08:30.558 INFO:teuthology.task.ansible.out:3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZY 2021-10-08T19:08:30.560 INFO:teuthology.task.ansible.out:M7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95 2021-10-08T19:08:30.560 INFO:teuthology.task.ansible.out:579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 2021-10-08T19:08:30.562 INFO:teuthology.task.ansible.out:4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp" 2021-10-08T19:08:30.564 INFO:teuthology.task.ansible.out:, "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f36 2021-10-08T19:08:30.566 INFO:teuthology.task.ansible.out:24b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9Jje 2021-10-08T19:08:30.570 INFO:teuthology.task.ansible.out:nDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, 2021-10-08T19:08:30.575 INFO:teuthology.task.ansible.out:{"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shy 2021-10-08T19:08:30.577 INFO:teuthology.task.ansible.out:amsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878 2021-10-08T19:08:30.578 INFO:teuthology.task.ansible.out:bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", "ovpn": 2021-10-08T19:08:30.580 INFO:teuthology.task.ansible.out: "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}]}, "changed": false} 2021-10-08T19:08:30.598 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:30 +0000 (0:00:00.146) 0:00:43.517 ******** 2021-10-08T19:08:31.110 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-10-08T19:08:31.112 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/blaine", "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "name": "blaine", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2021-10-08T19:08:31.248 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:31 +0000 (0:00:00.649) 0:00:44.167 ******** 2021-10-08T19:08:31.318 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** 2021-10-08T19:08:31.344 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:31 +0000 (0:00:00.096) 0:00:44.263 ******** 2021-10-08T19:08:31.442 INFO:teuthology.task.ansible.out: TASK [Merge managed_users and managed_admin users] ***************************** ok: [smithi097.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c 2021-10-08T19:08:31.444 INFO:teuthology.task.ansible.out:68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "a 2021-10-08T19:08:31.446 INFO:teuthology.task.ansible.out:li@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\n 2021-10-08T19:08:31.448 INFO:teuthology.task.ansible.out:yuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2 2021-10-08T19:08:31.449 INFO:teuthology.task.ansible.out:s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f1 2021-10-08T19:08:31.451 INFO:teuthology.task.ansible.out:1af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d 2021-10-08T19:08:31.453 INFO:teuthology.task.ansible.out:5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95 2021-10-08T19:08:31.453 INFO:teuthology.task.ansible.out:579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b 2021-10-08T19:08:31.455 INFO:teuthology.task.ansible.out:10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a 2021-10-08T19:08:31.456 INFO:teuthology.task.ansible.out:1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, 2021-10-08T19:08:31.458 INFO:teuthology.task.ansible.out:{"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f 2021-10-08T19:08:31.460 INFO:teuthology.task.ansible.out:60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, 2021-10-08T19:08:31.460 INFO:teuthology.task.ansible.out:{"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f4 2021-10-08T19:08:31.464 INFO:teuthology.task.ansible.out:1cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b5 2021-10-08T19:08:31.465 INFO:teuthology.task.ansible.out:9cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9ab 2021-10-08T19:08:31.468 INFO:teuthology.task.ansible.out:fe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}]}, "changed": false} 2021-10-08T19:08:31.490 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:31 +0000 (0:00:00.144) 0:00:44.407 ******** 2021-10-08T19:08:31.539 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* ok: [smithi117.front.sepia.ceph.com] => {"after": "ee931718ec906fcbc1b8afc120f625a06f1ece1a", "attempts": 1, "before": "ee931718ec906fcbc1b8afc120f625a06f1ece1a", "changed": false, "remote_url_changed": false} 2021-10-08T19:08:31.560 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:31 +0000 (0:00:00.071) 0:00:44.479 ******** 2021-10-08T19:08:31.899 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-10-08T19:08:32.114 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-10-08T19:08:32.193 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* ok: [smithi097.front.sepia.ceph.com] => {"after": "ee931718ec906fcbc1b8afc120f625a06f1ece1a", "attempts": 1, "before": "ee931718ec906fcbc1b8afc120f625a06f1ece1a", "changed": false, "remote_url_changed": false} 2021-10-08T19:08:32.216 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:32 +0000 (0:00:00.655) 0:00:45.135 ******** 2021-10-08T19:08:32.345 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-10-08T19:08:32.347 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-10-08T19:08:32.544 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-10-08T19:08:32.567 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-10-08T19:08:32.569 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-10-08T19:08:32.766 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-10-08T19:08:32.770 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-10-08T19:08:32.977 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-10-08T19:08:32.988 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-10-08T19:08:32.990 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-10-08T19:08:33.192 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-10-08T19:08:33.194 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-10-08T19:08:33.227 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-10-08T19:08:33.407 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-10-08T19:08:33.440 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-10-08T19:08:33.609 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-10-08T19:08:33.610 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-10-08T19:08:33.653 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1s 2021-10-08T19:08:33.655 INFO:teuthology.task.ansible.out:cr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:33.816 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-10-08T19:08:33.882 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-10-08T19:08:33.885 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-10-08T19:08:34.078 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-10-08T19:08:34.089 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-10-08T19:08:34.091 INFO:teuthology.task.ansible.out:son", "validate_certs": true} 2021-10-08T19:08:34.100 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:34.112 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:34.292 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-10-08T19:08:34.299 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:34.345 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-10-08T19:08:34.512 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-10-08T19:08:34.514 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-10-08T19:08:34.547 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-10-08T19:08:34.554 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-10-08T19:08:34.718 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-10-08T19:08:34.720 INFO:teuthology.task.ansible.out:son", "validate_certs": true} 2021-10-08T19:08:34.729 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:34.755 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZM 2021-10-08T19:08:34.758 INFO:teuthology.task.ansible.out:bVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-10-08T19:08:34.949 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-10-08T19:08:34.971 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-10-08T19:08:35.168 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-10-08T19:08:35.221 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU 2021-10-08T19:08:35.223 INFO:teuthology.task.ansible.out:8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-10-08T19:08:35.384 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-10-08T19:08:35.415 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-10-08T19:08:35.418 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-10-08T19:08:35.593 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-10-08T19:08:35.626 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-10-08T19:08:35.628 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-10-08T19:08:35.814 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-10-08T19:08:35.832 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-10-08T19:08:36.017 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-10-08T19:08:36.019 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-10-08T19:08:36.039 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-10-08T19:08:36.224 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-10-08T19:08:36.226 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-10-08T19:08:36.255 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlI 2021-10-08T19:08:36.257 INFO:teuthology.task.ansible.out:Qv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-10-08T19:08:36.424 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-10-08T19:08:36.458 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-10-08T19:08:36.631 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-10-08T19:08:36.674 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-10-08T19:08:36.846 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlI 2021-10-08T19:08:36.848 INFO:teuthology.task.ansible.out:Qv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-10-08T19:08:36.889 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-10-08T19:08:37.045 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-10-08T19:08:37.106 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-10-08T19:08:37.251 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-10-08T19:08:37.314 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-10-08T19:08:37.458 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-10-08T19:08:37.533 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-10-08T19:08:37.535 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-10-08T19:08:37.663 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-10-08T19:08:37.738 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-10-08T19:08:37.879 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-10-08T19:08:37.946 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-10-08T19:08:38.094 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-10-08T19:08:38.096 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-10-08T19:08:38.160 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-10-08T19:08:38.308 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-10-08T19:08:38.384 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-10-08T19:08:38.501 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-10-08T19:08:38.587 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-10-08T19:08:38.713 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-10-08T19:08:38.809 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-10-08T19:08:38.925 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-10-08T19:08:39.023 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-10-08T19:08:39.130 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-10-08T19:08:39.230 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-10-08T19:08:39.233 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-10-08T19:08:39.337 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-10-08T19:08:39.434 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2021-10-08T19:08:39.436 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-10-08T19:08:39.543 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-10-08T19:08:39.638 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-10-08T19:08:39.744 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-10-08T19:08:39.746 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-10-08T19:08:39.853 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-10-08T19:08:39.964 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2021-10-08T19:08:39.966 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-10-08T19:08:40.061 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-10-08T19:08:40.167 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-10-08T19:08:40.263 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNH 2021-10-08T19:08:40.264 INFO:teuthology.task.ansible.out:ORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-10-08T19:08:40.371 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-10-08T19:08:40.476 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2021-10-08T19:08:40.478 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2021-10-08T19:08:40.481 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-10-08T19:08:40.699 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-10-08T19:08:40.731 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-10-08T19:08:40.898 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-10-08T19:08:40.940 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNH 2021-10-08T19:08:40.942 INFO:teuthology.task.ansible.out:ORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-10-08T19:08:41.103 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-10-08T19:08:41.158 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2021-10-08T19:08:41.160 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2021-10-08T19:08:41.161 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-10-08T19:08:41.317 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-10-08T19:08:41.361 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-10-08T19:08:41.575 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-10-08T19:08:41.704 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-10-08T19:08:41.784 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-10-08T19:08:41.906 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-10-08T19:08:41.911 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-10-08T19:08:41.984 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-10-08T19:08:42.112 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-10-08T19:08:42.187 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-10-08T19:08:42.315 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-10-08T19:08:42.400 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-10-08T19:08:42.402 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-10-08T19:08:42.527 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2021-10-08T19:08:42.529 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2021-10-08T19:08:42.613 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-10-08T19:08:42.752 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-10-08T19:08:42.825 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-10-08T19:08:42.964 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-10-08T19:08:43.029 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2021-10-08T19:08:43.030 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2021-10-08T19:08:43.186 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2021-10-08T19:08:43.187 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-10-08T19:08:43.260 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-10-08T19:08:43.398 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-10-08T19:08:43.463 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-10-08T19:08:43.601 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-10-08T19:08:43.686 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2021-10-08T19:08:43.688 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-10-08T19:08:43.812 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-10-08T19:08:43.894 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-10-08T19:08:44.026 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-10-08T19:08:44.118 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-10-08T19:08:44.237 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-10-08T19:08:44.330 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-10-08T19:08:44.434 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-10-08T19:08:44.541 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-10-08T19:08:44.638 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-10-08T19:08:44.756 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-10-08T19:08:44.861 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-10-08T19:08:44.957 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-10-08T19:08:45.064 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-10-08T19:08:45.160 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-10-08T19:08:45.278 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-10-08T19:08:45.373 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-10-08T19:08:45.481 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-10-08T19:08:45.598 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-10-08T19:08:45.691 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-10-08T19:08:45.804 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-10-08T19:08:45.910 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-10-08T19:08:46.011 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-10-08T19:08:46.115 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-10-08T19:08:46.220 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-10-08T19:08:46.320 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-10-08T19:08:46.428 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-10-08T19:08:46.542 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-10-08T19:08:46.637 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-10-08T19:08:46.745 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-10-08T19:08:46.852 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-10-08T19:08:46.972 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-10-08T19:08:47.059 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-10-08T19:08:47.185 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-10-08T19:08:47.272 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-10-08T19:08:47.403 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-10-08T19:08:47.469 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-10-08T19:08:47.608 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-10-08T19:08:47.610 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-10-08T19:08:47.688 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-10-08T19:08:47.826 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-10-08T19:08:47.901 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-10-08T19:08:48.039 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-10-08T19:08:48.114 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-10-08T19:08:48.118 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-10-08T19:08:48.253 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-10-08T19:08:48.328 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-10-08T19:08:48.454 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-10-08T19:08:48.455 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-10-08T19:08:48.528 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-10-08T19:08:48.666 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-10-08T19:08:48.740 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-10-08T19:08:48.867 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-10-08T19:08:48.952 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-10-08T19:08:48.954 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-10-08T19:08:49.080 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-10-08T19:08:49.154 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-10-08T19:08:49.282 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-10-08T19:08:49.357 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-10-08T19:08:49.494 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-10-08T19:08:49.570 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-10-08T19:08:49.707 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-10-08T19:08:49.782 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-10-08T19:08:49.909 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-10-08T19:08:49.994 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-10-08T19:08:50.134 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2021-10-08T19:08:50.136 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-10-08T19:08:50.209 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-10-08T19:08:50.345 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-10-08T19:08:50.409 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-10-08T19:08:50.559 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-10-08T19:08:50.613 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2021-10-08T19:08:50.615 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-10-08T19:08:50.763 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-10-08T19:08:50.826 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-10-08T19:08:50.966 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-10-08T19:08:51.031 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-10-08T19:08:51.191 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-10-08T19:08:51.234 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-10-08T19:08:51.409 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-10-08T19:08:51.452 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-10-08T19:08:51.629 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/ 2021-10-08T19:08:51.632 INFO:teuthology.task.ansible.out:yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-10-08T19:08:51.665 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-10-08T19:08:51.833 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-10-08T19:08:51.888 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-10-08T19:08:52.038 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-10-08T19:08:52.093 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/ 2021-10-08T19:08:52.095 INFO:teuthology.task.ansible.out:yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-10-08T19:08:52.254 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-10-08T19:08:52.307 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-10-08T19:08:52.468 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-10-08T19:08:52.523 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-10-08T19:08:52.675 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-10-08T19:08:52.729 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-10-08T19:08:52.887 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-10-08T19:08:52.939 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-10-08T19:08:53.078 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-10-08T19:08:53.142 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-10-08T19:08:53.283 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-10-08T19:08:53.349 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-10-08T19:08:53.496 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-10-08T19:08:53.562 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-10-08T19:08:53.708 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-10-08T19:08:53.771 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-10-08T19:08:53.919 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-10-08T19:08:53.972 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-10-08T19:08:54.122 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-10-08T19:08:54.184 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-10-08T19:08:54.330 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-10-08T19:08:54.384 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-10-08T19:08:54.553 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-10-08T19:08:54.598 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-10-08T19:08:54.757 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-10-08T19:08:54.813 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-10-08T19:08:54.969 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-10-08T19:08:55.018 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-10-08T19:08:55.177 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-10-08T19:08:55.231 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-10-08T19:08:55.379 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-10-08T19:08:55.436 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-10-08T19:08:55.594 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2021-10-08T19:08:55.596 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-10-08T19:08:55.640 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-10-08T19:08:55.642 INFO:teuthology.task.ansible.out: 2021-10-08T19:08:55.794 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-10-08T19:08:55.848 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-10-08T19:08:56.002 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-10-08T19:08:56.059 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2021-10-08T19:08:56.061 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-10-08T19:08:56.207 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-10-08T19:08:56.274 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-10-08T19:08:56.414 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-10-08T19:08:56.489 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-10-08T19:08:56.627 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-10-08T19:08:56.689 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-10-08T19:08:56.839 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-10-08T19:08:56.913 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-10-08T19:08:57.038 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-10-08T19:08:57.112 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-10-08T19:08:57.252 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-10-08T19:08:57.330 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-10-08T19:08:57.457 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-10-08T19:08:57.543 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-10-08T19:08:57.670 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-10-08T19:08:57.737 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-10-08T19:08:57.877 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-10-08T19:08:57.951 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-10-08T19:08:58.081 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-10-08T19:08:58.170 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-10-08T19:08:58.297 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4m0LAcC7XiFiXFtYcCvZqX1CtyV9JU+VUEawZJpWrGTOr8c+vIexq7+WKg+eIUMot4+dtfwG8lByS1VofglIe5/quv17Xj7dO/hF2WkV8O7RYt7NhzmrKg54yB73pbRpvqzGceWWDvGRsWQGzbY7ARqOp4FPIDJvgXABCkak+hmjXyXpvXN418CBDbDmxHWwFb9QtB/MpQFiFrfl1EMDj8DaXZNWgo5J/qytic6LgiyPHhHfhSylk4cl9TGftNatobpMjqBT0O2/plk/qf+7pHPuvGSgihjijdpEPzVfctXE2OmsQAIZgkzXeCqts+s6ZYdUKq1FvpV5rMM8ZLqfCkDjEzFENJS68YYE2EjxAEgMzj7h/sWc4B5I5pxkAqVAQSGjYRu6rCCbFz8PXUdTyW+Vs1YeylnlBMiCa4xE4gwvW3HlWEnumtyURd1PRENrGJsJ/0uX6bpltbSg4sGACRYpLPJMm3OhqI3Jm/J/e2NLjfCw+svU2447xnfJOh68= pdhange@vaquita", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-10-08T19:08:58.383 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-10-08T19:08:58.510 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-10-08T19:08:58.595 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-10-08T19:08:58.725 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-10-08T19:08:58.825 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4m0LAcC7XiFiXFtYcCvZqX1CtyV9JU+VUEawZJpWrGTOr8c+vIexq7+WKg+eIUMot4+dtfwG8lByS1VofglIe5/quv17Xj7dO/hF2WkV8O7RYt7NhzmrKg54yB73pbRpvqzGceWWDvGRsWQGzbY7ARqOp4FPIDJvgXABCkak+hmjXyXpvXN418CBDbDmxHWwFb9QtB/MpQFiFrfl1EMDj8DaXZNWgo5J/qytic6LgiyPHhHfhSylk4cl9TGftNatobpMjqBT0O2/plk/qf+7pHPuvGSgihjijdpEPzVfctXE2OmsQAIZgkzXeCqts+s6ZYdUKq1FvpV5rMM8ZLqfCkDjEzFENJS68YYE2EjxAEgMzj7h/sWc4B5I5pxkAqVAQSGjYRu6rCCbFz8PXUdTyW+Vs1YeylnlBMiCa4xE4gwvW3HlWEnumtyURd1PRENrGJsJ/0uX6bpltbSg4sGACRYpLPJMm3OhqI3Jm/J/e2NLjfCw+svU2447xnfJOh68= pdhange@vaquita", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-10-08T19:08:58.943 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_ 2021-10-08T19:08:58.945 INFO:teuthology.task.ansible.out:options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-10-08T19:08:59.039 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-10-08T19:08:59.156 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-10-08T19:08:59.245 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-10-08T19:08:59.361 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-10-08T19:08:59.456 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_ 2021-10-08T19:08:59.459 INFO:teuthology.task.ansible.out:options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-10-08T19:08:59.564 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2021-10-08T19:08:59.669 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-10-08T19:08:59.775 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2021-10-08T19:08:59.869 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-10-08T19:08:59.984 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2021-10-08T19:09:00.084 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2021-10-08T19:09:00.189 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-10-08T19:09:00.308 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2021-10-08T19:09:00.392 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2021-10-08T19:09:00.529 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2021-10-08T19:09:00.605 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2021-10-08T19:09:00.723 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-10-08T19:09:00.821 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2021-10-08T19:09:00.823 INFO:teuthology.task.ansible.out: 2021-10-08T19:09:00.952 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2021-10-08T19:09:01.067 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2021-10-08T19:09:01.175 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2021-10-08T19:09:01.275 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2021-10-08T19:09:01.393 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2021-10-08T19:09:01.489 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKjxTgyhL1yFriyNvvuhUc6SE8+6f6lT6FTF8cZL9uiz matan.brz@gmail.com\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM8l7qvSQR7fnZdQ1yB1F1jgde0OmLcwcDFzc/o2dYBb matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2021-10-08T19:09:01.606 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2021-10-08T19:09:01.702 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkFTEUxQkQ1cplOLOf86Teu4qTYGkMqWtjIwzsU/AcimjFolSI5fJ3B72PH7bhQKkSnOlTjiOos2LrD5i/XgxkJD6icVWwHO11lczsq/8K5x0ZMJbJaiT3QphBB4yItoge2Y4/7g4o/78Ne+U7eZ1L5fgeO1fExtIaEXK1lS8pVlpZQXyproTIzp1WLHoaXb38Mxc5jAtuvEKfEycdX3c8k/9ti2qBCZnmjPH05WOxkqCRyNBT+bSJZyFMYt9RDUuycn3BYVSXTAzPW0qwgvKY5vij+qiFoxij7nKNMH7w6C0arolCcJxhiMyEF3UbTuOxgVONWyqFk/vScGGSYj9ytQYjv0L1cFyOVhlpbu+tnptulfQ3faMpjROE/eYxTIoY7OPDgWbFqEUJ4eEhKwAC7aYIYUhvoI/8k+4u64nsyEJQdHXmB+OY3WE5TegYUCuqSsdPY74eO1o8dDgxF363eggDSBmYqSSs+Tpu9TNhJG7iJFX1tiAPwmKvjVrJOac= ozeneva@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2021-10-08T19:09:01.817 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2021-10-08T19:09:01.912 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} 2021-10-08T19:09:02.019 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKjxTgyhL1yFriyNvvuhUc6SE8+6f6lT6FTF8cZL9uiz matan.brz@gmail.com\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM8l7qvSQR7fnZdQ1yB1F1jgde0OmLcwcDFzc/o2dYBb matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2021-10-08T19:09:02.117 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2021-10-08T19:09:02.224 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkFTEUxQkQ1cplOLOf86Teu4qTYGkMqWtjIwzsU/AcimjFolSI5fJ3B72PH7bhQKkSnOlTjiOos2LrD5i/XgxkJD6icVWwHO11lczsq/8K5x0ZMJbJaiT3QphBB4yItoge2Y4/7g4o/78Ne+U7eZ1L5fgeO1fExtIaEXK1lS8pVlpZQXyproTIzp1WLHoaXb38Mxc5jAtuvEKfEycdX3c8k/9ti2qBCZnmjPH05WOxkqCRyNBT+bSJZyFMYt9RDUuycn3BYVSXTAzPW0qwgvKY5vij+qiFoxij7nKNMH7w6C0arolCcJxhiMyEF3UbTuOxgVONWyqFk/vScGGSYj9ytQYjv0L1cFyOVhlpbu+tnptulfQ3faMpjROE/eYxTIoY7OPDgWbFqEUJ4eEhKwAC7aYIYUhvoI/8k+4u64nsyEJQdHXmB+OY3WE5TegYUCuqSsdPY74eO1o8dDgxF363eggDSBmYqSSs+Tpu9TNhJG7iJFX1tiAPwmKvjVrJOac= ozeneva@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2021-10-08T19:09:02.330 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIi8JMOVD91QR7EXBkhxeAsB2UO2gyWqYPiP6HjJO/TzzMKf7QtO928XzdORwQ1/jm2hDF1kaNPaU/XIHD0hHSvfICS4ELQcBPa5uPya6d5Kn5fVlpGqBcXBxKGbHB01PGjn0214eupt2LebWxkm7TP/BGDHKXXaoR748AlbyyG2L3TaNoGkwQiEoZe3CWgH4qkrf2CEpyfOa7BM7U0h+lceJxIGe+Yo6Ll14zyngDBa059E+ndFTpkQ6vECII7FdB1+A4Orhu40XHZgyVnlRudD1l80pIVnZves8N2zHZhQo8hp0sB5oY8HENiB09j7Xa6YQ/c1c2wm9E2xJHSNo7muFiHz48vQEgvNmu0lZdbVwXIy3IgLEBHjs6Kyqjtg618V4UaoP/LBOqtWtLd6TvGJ3qBlNyvhO5gZ2DGeLMN2WWoHxfl3VM+QGCGI2dnzUyHhfG1VBDYj8fzWXOuUVpVCMUw8fEg8GWmYLDwm3SbdMACWU87J0kAmaDPKcwwL6AwtWJZr/p89sSypl6y50JlOoDrbDbxrIbHQgbf1tcEgPOuLUN+O06qpi+OxKMtFdbvz+NQ4V4CpXpvMMQZj5AbuHp0EJ5Vme/Kcmpl/xoYGyFDzOEGR8lw6LMz+CpQ4GtnK5XXe1Xn3TJh6Tn2tVyS20p7artemGQQquCN8iQOw== mayag@gett.com", "key_options": null, "keyfile": "/home/mayagilad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mayagilad", "validate_certs": true} 2021-10-08T19:09:02.426 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} 2021-10-08T19:09:02.531 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFG1CoPZEh4KBANdJZIzLsutHsF6tAYZTdDdEW+5E+8YyNHOy42D8iBLg+eCAbIl4SFmJTsPNtyO4L8/Ut79tkG3usA9nuGoAwGYuctZUTgOiTiV61940Y+NTvwan9vFNoknVi/3qIGNSXdm90I1aWRTKLCXRbGA1qvu+qyJv93O8LFaPni2TJmtAebY/xf0fHhW2fURUoeoCsoobrTkPA8SojT0A3SM+31iOD7sxbmsqLBR790wz/FHh152PiqpupIijS9TaZgGuVpejM3rgAC7H2kVmKJlrmDlmfcbKLS6BBi+uUDi6ta8whnDRq03nP/4LJE7ZDIxX3I4mHztZeJggURlsfpJdo99+VHkeWlGDBIP41QgD4UX1neuMcIO3nuEnZmLeJyvo9JOR/I7AudbQCDPjSMNbrF+el70mWLhvPe33NA3x6eOBRPc3r+qrSwMhXEPatZlbywJRY+O6yC2TYqdlUKsUEVA/D0Iw7tO+pf3yH3Y/iUDJJLvViRZs= Arjun@localhost.localdomain", "key_options": null, "keyfile": "/home/arjsharm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "arjsharm", "validate_certs": true} 2021-10-08T19:09:02.631 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2021-10-08T19:09:02.747 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXZDAUNEK4+/6Y+ywEtFnabnfvZmzzHhO6y4PbRHgx8SoQ8+7au/5ElB0vjjiJJSChnDymdqP0UzwcShzhWA8is6K9c6tXUHg6NcgV5tN2xYYmGIIWwm66Z1kYH6u1x2Jkv9LO04rXgebkzXPPYK401agCWjkjUv5acZE12+M/B6d4h2lpFjzBqZ/mmRNp0tHdCapdG/nS1i6GRi3Yi3fQ89CbiZArG9268DSEnLe+npeyBMVdDkWpVIytQ6pU1+g0prrePIVaMvrK3yEooduD4HeLr4liqkINj6rCs90xedPcFi0++UaLFRcgWh3OOnrI952Oe19dx5hlbmcnMPGjaXnkng2keWFyZMOQRRti5l8C/TXPUTaYGWEoqFEEabIKnCura0NWuZHpeF9xEK0tnvNVeauuUfkPxWQ7PH8QQ/9XjOkKbmy0+2q9tug8RC5i5NwcRE4W3ijM7pLwhWMdxkmIOe3w1taPq8HU95hMQchl2749oj8DRyVePVK9aH0= melissali@melissali-ubuntu", "key_options": null, "keyfile": "/home/melissali/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "melissali", "validate_certs": true} 2021-10-08T19:09:02.846 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIi8JMOVD91QR7EXBkhxeAsB2UO2gyWqYPiP6HjJO/TzzMKf7QtO928XzdORwQ1/jm2hDF1kaNPaU/XIHD0hHSvfICS4ELQcBPa5uPya6d5Kn5fVlpGqBcXBxKGbHB01PGjn0214eupt2LebWxkm7TP/BGDHKXXaoR748AlbyyG2L3TaNoGkwQiEoZe3CWgH4qkrf2CEpyfOa7BM7U0h+lceJxIGe+Yo6Ll14zyngDBa059E+ndFTpkQ6vECII7FdB1+A4Orhu40XHZgyVnlRudD1l80pIVnZves8N2zHZhQo8hp0sB5oY8HENiB09j7Xa6YQ/c1c2wm9E2xJHSNo7muFiHz48vQEgvNmu0lZdbVwXIy3IgLEBHjs6Kyqjtg618V4UaoP/LBOqtWtLd6TvGJ3qBlNyvhO5gZ2DGeLMN2WWoHxfl3VM+QGCGI2dnzUyHhfG1VBDYj8fzWXOuUVpVCMUw8fEg8GWmYLDwm3SbdMACWU87J0kAmaDPKcwwL6AwtWJZr/p89sSypl6y50JlOoDrbDbxrIbHQgbf1tcEgPOuLUN+O06qpi+OxKMtFdbvz+NQ4V4CpXpvMMQZj5AbuHp0EJ5Vme/Kcmpl/xoYGyFDzOEGR8lw6LMz+CpQ4GtnK5XXe1Xn3TJh6Tn2tVyS20p7artemGQQquCN8iQOw== mayag@gett.com", "key_options": null, "keyfile": "/home/mayagilad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mayagilad", "validate_certs": true} 2021-10-08T19:09:02.961 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYdmNB3np8OLc49B4cAh59CdNYIb4fAq2XBQ1sbOZMMZmhpFobyy+i6s4lBnovMNWAB6HmpsECHrKRU4IFl9lQ7vV+++J08SLoAkl6G0Gk9tmbgEs+/ovCZg+qUfZA1ZccSAPHmtqfZOiJcnlIlhQq2BoFnLUwmpeIQ4H5D+Y2q7DMdyGkdCenH80aD5KuiwLIyiBL9q7RYz0U5cdCO3wDFU4+5XuZiT8VYDUgp3mWPpAiPdGsJmCn41tpt3PViPDQlKh4vLW0ieQUJI/v2f6oHbM9YkxSoVlwLcrjTv+Nl+dVymqVTF4UaT1kz+ZnoH6khKZxSHvKm9YHc4LNZKYoVdyCxdZvBfxbEbXpT702vLqDNGEfZSlzJs5kVqP30m8fI/yzTQeD7tgjzzrKWdLZacyo+9cWeH6nFfZAQuZ9ug1lv3UAs5x6MsidEH5u6Iymi8BE+mUsOXnSpSfUDDo5n6+CMVe93brdW21iSX9Hbuz5RKB6xile1ROHpvpi1u7VQ9Hp3FIZFFiix9S5jniyB2OqjGKTO6RULfPsJo8sXCLq9YKq9zrkpMv5wURMQKnjtS5OHUWh0cde3U/VikPIfLkzEsfLV8ICAksyuWHQJGVUMxhPmSTKtRsPScbklekT+n65rexDt4Qr73YOy9BUIPV4Mo+kkl4ugQd6VCKJ6w== ibalutoiu@cloudbasesolutions.com", "key_options": null, "keyfile": "/home/ionutbalutoiu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ionutbalutoiu", "validate_certs": true} 2021-10-08T19:09:03.060 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFG1CoPZEh4KBANdJZIzLsutHsF6tAYZTdDdEW+5E+8YyNHOy42D8iBLg+eCAbIl4SFmJTsPNtyO4L8/Ut79tkG3usA9nuGoAwGYuctZUTgOiTiV61940Y+NTvwan9vFNoknVi/3qIGNSXdm90I1aWRTKLCXRbGA1qvu+qyJv93O8LFaPni2TJmtAebY/xf0fHhW2fURUoeoCsoobrTkPA8SojT0A3SM+31iOD7sxbmsqLBR790wz/FHh152PiqpupIijS9TaZgGuVpejM3rgAC7H2kVmKJlrmDlmfcbKLS6BBi+uUDi6ta8whnDRq03nP/4LJE7ZDIxX3I4mHztZeJggURlsfpJdo99+VHkeWlGDBIP41QgD4UX1neuMcIO3nuEnZmLeJyvo9JOR/I7AudbQCDPjSMNbrF+el70mWLhvPe33NA3x6eOBRPc3r+qrSwMhXEPatZlbywJRY+O6yC2TYqdlUKsUEVA/D0Iw7tO+pf3yH3Y/iUDJJLvViRZs= Arjun@localhost.localdomain", "key_options": null, "keyfile": "/home/arjsharm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "arjsharm", "validate_certs": true} 2021-10-08T19:09:03.192 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuyLB5rnyjlglcHVCoCSG7pDVJQcTYq/I2yGr3ohK9p6boWxk+zW/a2Q7+qNdKk2DtUC4WvvZ76BU56FC6/LPIUKSJLbN/Xv9/dnZcqKf+ZVlCQgMrE8yGoWt8WLtejJ1iBj0EdoDfYwDiL09ygUim1L1hNxFDOVq9RA2Lo6Tqk5lcAgjoCnU4NZY2YzTXOUSZTzsv/1bd6WVudKHJuWF6ZPb+mbbMoWqwnUZCHwjW8PgTXaPhk1929P0ftWT4ncfKnCc46LXf8OkvzQgCrLyh8964tGKPWppp3wNg2AJ/zFvRY8kkJZSxOawp9Gu8+kCNwWUmLvE9bqYJKT7EMDrU+8TMUEWLFl5fGoxoLWD113PPBcFrpUhvRAJa625eec8a/inv4cqPf6dY6qyXAReXURJm7LnHT4fDq+F6op8+tmZT6Tzkw4+YMUd9h0XDJ4pnPQpk5tjWER/HuWm73+ialXo+ERQWnnVCB1IXq1FEOeF8YAslKC7aSYIZjG9uUkM= peristocles@localhost.localdomain", "key_options": null, "keyfile": "/home/pdiazbou/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdiazbou", "validate_certs": true} 2021-10-08T19:09:03.278 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXZDAUNEK4+/6Y+ywEtFnabnfvZmzzHhO6y4PbRHgx8SoQ8+7au/5ElB0vjjiJJSChnDymdqP0UzwcShzhWA8is6K9c6tXUHg6NcgV5tN2xYYmGIIWwm66Z1kYH6u1x2Jkv9LO04rXgebkzXPPYK401agCWjkjUv5acZE12+M/B6d4h2lpFjzBqZ/mmRNp0tHdCapdG/nS1i6GRi3Yi3fQ89CbiZArG9268DSEnLe+npeyBMVdDkWpVIytQ6pU1+g0prrePIVaMvrK3yEooduD4HeLr4liqkINj6rCs90xedPcFi0++UaLFRcgWh3OOnrI952Oe19dx5hlbmcnMPGjaXnkng2keWFyZMOQRRti5l8C/TXPUTaYGWEoqFEEabIKnCura0NWuZHpeF9xEK0tnvNVeauuUfkPxWQ7PH8QQ/9XjOkKbmy0+2q9tug8RC5i5NwcRE4W3ijM7pLwhWMdxkmIOe3w1taPq8HU95hMQchl2749oj8DRyVePVK9aH0= melissali@melissali-ubuntu", "key_options": null, "keyfile": "/home/melissali/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "melissali", "validate_certs": true} 2021-10-08T19:09:03.396 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2iBYL614KRYvFhow408yzMljYRdfyMmbnkUVN8waja4RCsmxTpvIU1aBQ02bMTsY/0n+WMWAbI1D6C1HbuG+JbFYBLSgPCTSG8FIpukFU8y1by8piPu2/ZBD1XdFcPO6u1Nr/tZC08EXhfqvnDAVJUyg6rLLs5+TFKAiPSuv5GyrMRWvMI8eoPk+4u2r/ThxXZTDaIfJhPXlULMLL5ZxR4KZU+WtWbCGSFDGjSugCqdTzpZyX5jUq9C9JB83RxojCtI5n9rCoXLcGOvW9HBnVMxhS56zE8BwxLxLhGy6S1lOoyBPzu7w6XIc160JjCK5iAmlXRqG93nWEVrhZkxCz wangxu298@foxmail.com", "key_options": null, "keyfile": "/home/xuwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuwang", "validate_certs": true} 2021-10-08T19:09:03.482 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYdmNB3np8OLc49B4cAh59CdNYIb4fAq2XBQ1sbOZMMZmhpFobyy+i6s4lBnovMNWAB6HmpsECHrKRU4IFl9lQ7vV+++J08SLoAkl6G0Gk9tmbgEs+/ovCZg+qUfZA1ZccSAPHmtqfZOiJcnlIlhQq2BoFnLUwmpeIQ4H5D+Y2q7DMdyGkdCenH80aD5KuiwLIyiBL9q7RYz0U5cdCO3wDFU4+5XuZiT8VYDUgp3mWPpAiPdGsJmCn41tpt3PViPDQlKh4vLW0ieQUJI/v2f6oHbM9YkxSoVlwLcrjTv+Nl+dVymqVTF4UaT1kz+ZnoH6khKZxSHvKm9YHc4LNZKYoVdyCxdZvBfxbEbXpT702vLqDNGEfZSlzJs5kVqP30m8fI/yzTQeD7tgjzzrKWdLZacyo+9cWeH6nFfZAQuZ9ug1lv3UAs5x6MsidEH5u6Iymi8BE+mUsOXnSpSfUDDo5n6+CMVe93brdW21iSX9Hbuz5RKB6xile1ROHpvpi1u7VQ9Hp3FIZFFiix9S5jniyB2OqjGKTO6RULfPsJo8sXCLq9YKq9zrkpMv5wURMQKnjtS5OHUWh0cde3U/VikPIfLkzEsfLV8ICAksyuWHQJGVUMxhPmSTKtRsPScbklekT+n65rexDt4Qr73YOy9BUIPV4Mo+kkl4ugQd6VCKJ6w== ibalutoiu@cloudbasesolutions.com", "key_options": null, "keyfile": "/home/ionutbalutoiu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ionutbalutoiu", "validate_certs": true} 2021-10-08T19:09:03.607 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKSdu3rI8o3qId+GU5KYsxB9CLPTODJFiwy+ww6SgrNKgPfiaSUsZAvcQwoxHfuaEXj6VGaOS6HyFFmvHKhzbecSQCzPIucIuKJJDA7VTaA9Jet0aT2b8Vk4p0Ud9j4WoausmxEdBQC+ZpJxSuqajplejYK1Yi3YEqXSCvM6Md76HCustS8efPvzLsLYttDd34Lw0/zp7ALE8hrepLYJgzQS5Z6btvQEjL7lvtHk80/Y+M6ZIQAl6nPcjb8u+wfs/lxcRA5i94GsZhEoYAeMQptJNvOaA5vYK4QtNyV6lyjGVJl4RUUAtLKKp4JE/kdx7sa0Gy99L+u4MjzBoP5B7SkdJnJx7FioXEen5l5DpiJ6xRixw+SjbqEffW4HHI5+1k6jP6kuHPbWfcrw693+aiFVDQA+myzfWo7iDTjY2H5CtnCh+wr1t3VktXhoyPob/XfMPzMNg4W8nA9KVePwzEXSy2Ro0t71GiFQqBviUuqfktqz4a52PqGyFHtskhFAH3H/h6JYM88vfc7Bw7P/u4eVaoCNgNIbLA/kmf689Q1H2KENj2SX7CDwNL9GCOy/pg89qai63+PFT8258zTi0TywWduP1D0DXXtIB3e5K1yK4Zt6VCinXZAze4bsT+z8y4f9W2Xs/FhhtUmo3mOiDJuaGmuWRzHQQTjL//v/Rimw== blaine@brgardne-mac", "key_options": null, "keyfile": "/home/blaine/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "blaine", "validate_certs": true} 2021-10-08T19:09:03.839 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuyLB5rnyjlglcHVCoCSG7pDVJQcTYq/I2yGr3ohK9p6boWxk+zW/a2Q7+qNdKk2DtUC4WvvZ76BU56FC6/LPIUKSJLbN/Xv9/dnZcqKf+ZVlCQgMrE8yGoWt8WLtejJ1iBj0EdoDfYwDiL09ygUim1L1hNxFDOVq9RA2Lo6Tqk5lcAgjoCnU4NZY2YzTXOUSZTzsv/1bd6WVudKHJuWF6ZPb+mbbMoWqwnUZCHwjW8PgTXaPhk1929P0ftWT4ncfKnCc46LXf8OkvzQgCrLyh8964tGKPWppp3wNg2AJ/zFvRY8kkJZSxOawp9Gu8+kCNwWUmLvE9bqYJKT7EMDrU+8TMUEWLFl5fGoxoLWD113PPBcFrpUhvRAJa625eec8a/inv4cqPf6dY6qyXAReXURJm7LnHT4fDq+F6op8+tmZT6Tzkw4+YMUd9h0XDJ4pnPQpk5tjWER/HuWm73+ialXo+ERQWnnVCB1IXq1FEOeF8YAslKC7aSYIZjG9uUkM= peristocles@localhost.localdomain", "key_options": null, "keyfile": "/home/pdiazbou/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdiazbou", "validate_certs": true} 2021-10-08T19:09:03.862 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:03 +0000 (0:00:31.643) 0:01:16.779 ******** 2021-10-08T19:09:03.914 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2iBYL614KRYvFhow408yzMljYRdfyMmbnkUVN8waja4RCsmxTpvIU1aBQ02bMTsY/0n+WMWAbI1D6C1HbuG+JbFYBLSgPCTSG8FIpukFU8y1by8piPu2/ZBD1XdFcPO6u1Nr/tZC08EXhfqvnDAVJUyg6rLLs5+TFKAiPSuv5GyrMRWvMI8eoPk+4u2r/ThxXZTDaIfJhPXlULMLL5ZxR4KZU+WtWbCGSFDGjSugCqdTzpZyX5jUq9C9JB83RxojCtI5n9rCoXLcGOvW9HBnVMxhS56zE8BwxLxLhGy6S1lOoyBPzu7w6XIc160JjCK5iAmlXRqG93nWEVrhZkxCz wangxu298@foxmail.com", "key_options": null, "keyfile": "/home/xuwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuwang", "validate_certs": true} 2021-10-08T19:09:03.960 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-10-08T19:09:03.962 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:03.972 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:03.974 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:03.984 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:03.986 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:03.996 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:04.007 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:04.171 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** changed: [smithi097.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKSdu3rI8o3qId+GU5KYsxB9CLPTODJFiwy+ww6SgrNKgPfiaSUsZAvcQwoxHfuaEXj6VGaOS6HyFFmvHKhzbecSQCzPIucIuKJJDA7VTaA9Jet0aT2b8Vk4p0Ud9j4WoausmxEdBQC+ZpJxSuqajplejYK1Yi3YEqXSCvM6Md76HCustS8efPvzLsLYttDd34Lw0/zp7ALE8hrepLYJgzQS5Z6btvQEjL7lvtHk80/Y+M6ZIQAl6nPcjb8u+wfs/lxcRA5i94GsZhEoYAeMQptJNvOaA5vYK4QtNyV6lyjGVJl4RUUAtLKKp4JE/kdx7sa0Gy99L+u4MjzBoP5B7SkdJnJx7FioXEen5l5DpiJ6xRixw+SjbqEffW4HHI5+1k6jP6kuHPbWfcrw693+aiFVDQA+myzfWo7iDTjY2H5CtnCh+wr1t3VktXhoyPob/XfMPzMNg4W8nA9KVePwzEXSy2Ro0t71GiFQqBviUuqfktqz4a52PqGyFHtskhFAH3H/h6JYM88vfc7Bw7P/u4eVaoCNgNIbLA/kmf689Q1H2KENj2SX7CDwNL9GCOy/pg89qai63+PFT8258zTi0TywWduP1D0DXXtIB3e5K1yK4Zt6VCinXZAze4bsT+z8y4f9W2Xs/FhhtUmo3mOiDJuaGmuWRzHQQTjL//v/Rimw== blaine@brgardne-mac", "key_options": null, "keyfile": "/home/blaine/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "blaine", "validate_certs": true} 2021-10-08T19:09:04.262 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-10-08T19:09:04.263 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-10-08T19:09:04.264 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e 2021-10-08T19:09:04.266 INFO:teuthology.task.ansible.out:1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:04.291 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:04 +0000 (0:00:00.431) 0:01:17.210 ******** 2021-10-08T19:09:04.390 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:04.403 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:04.414 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:04.416 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:04.426 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:04.428 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:04.437 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:04.448 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:04.450 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:04.460 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-10-08T19:09:04.672 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-10-08T19:09:04.674 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-10-08T19:09:04.674 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69c 2021-10-08T19:09:04.676 INFO:teuthology.task.ansible.out:dcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:04.684 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:04.686 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:04.701 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:04.709 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:04.724 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:04.725 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:04.727 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:04.738 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:04.740 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:04.750 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:04.761 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:04.763 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:04.773 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:04.775 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:04.784 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:04.787 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:04.796 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:04.809 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:04.819 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:04.830 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:04.831 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:04.842 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:04.844 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:04.855 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:04.856 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:04.868 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:04.870 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:04.879 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:04.890 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:04.892 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:04.902 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-10-08T19:09:04.903 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:04.903 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:04.914 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:04.916 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:04.927 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:04.938 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:04.940 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:04.950 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:04.965 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:04.973 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:04.975 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:04.985 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:04.997 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.008 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.020 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.022 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.032 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.034 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.045 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.056 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.067 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.068 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.081 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.092 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.094 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.115 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.118 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} ok: [smithi097.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJs 2021-10-08T19:09:05.120 INFO:teuthology.task.ansible.out:YqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134c 2021-10-08T19:09:05.121 INFO:teuthology.task.ansible.out:cf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.131 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.141 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.143 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.144 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'gsalomon', 2021-10-08T19:09:05.145 INFO:teuthology.task.ansible.out:'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.159 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.168 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.180 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.191 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.193 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovp 2021-10-08T19:09:05.195 INFO:teuthology.task.ansible.out:n': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@m 2021-10-08T19:09:05.196 INFO:teuthology.task.ansible.out:yhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.206 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.207 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.207 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.208 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.220 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.241 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.243 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.244 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37 2021-10-08T19:09:05.246 INFO:teuthology.task.ansible.out:985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.256 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.258 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.269 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.271 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.272 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.282 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.283 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.284 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.296 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.310 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.321 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.324 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.336 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.338 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.347 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.349 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.360 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.362 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.377 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.378 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.390 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.392 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.403 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.405 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.405 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.416 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.418 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.428 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.440 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.441 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.455 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false 2021-10-08T19:09:05.457 INFO:teuthology.task.ansible.out:, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.466 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.468 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.478 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.480 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.490 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.502 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.516 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.518 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.528 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.529 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.531 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.542 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.553 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.556 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.572 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.575 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.589 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.598 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.609 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.611 INFO:teuthology.task.ansible.out: 2021-10-08T19:09:05.621 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.623 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.633 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.636 INFO:teuthology.task.ansible.out: skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.647 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.649 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "skip_reason": "Conditional result was False"} skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.660 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.661 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.672 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.692 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.694 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.716 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:05 +0000 (0:00:01.424) 0:01:18.635 ******** 2021-10-08T19:09:05.725 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.736 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.738 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.748 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.750 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.761 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.772 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.789 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.798 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} TASK [Filter the revoked_users list] ******************************************* skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.821 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:05 +0000 (0:00:00.104) 0:01:18.740 ******** 2021-10-08T19:09:05.829 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.830 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.831 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.843 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.845 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.854 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.857 INFO:teuthology.task.ansible.out: 2021-10-08T19:09:05.868 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.880 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.891 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.902 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.903 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.914 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.926 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.927 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.937 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.939 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.949 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.960 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.962 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.974 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.986 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.996 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:05.998 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:06.007 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:06.019 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:06.020 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:06.034 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, "skip_reason": "Conditional result was False"} skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:06.054 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:06.065 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:06.076 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:06.077 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:06.087 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:06.089 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:06.098 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:06.100 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:06.110 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi117.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-10-08T19:09:06.112 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:06.122 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:06.127 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:06.218 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} skipping: [smithi097.front.sepia.cep 2021-10-08T19:09:06.219 INFO:teuthology.task.ansible.out:h.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "skip_reason": "Conditional result was False"} skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "skip_reason": "Conditional result was False"} skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "skip_reason": "Conditional result was False"} skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "skip_reason": "Conditional result was False"} skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "ch 2021-10-08T19:09:06.220 INFO:teuthology.task.ansible.out:anged": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "skip_reason": "Conditional result was False"} skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "skip_reason": "Conditional result was False"} skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "skip_reason": "Conditional result was False"} skipping: [smithi097.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:06.246 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:06 +0000 (0:00:00.424) 0:01:19.164 ******** 2021-10-08T19:09:06.296 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-10-08T19:09:06.298 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-10-08T19:09:06.319 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* 2021-10-08T19:09:06.319 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:06.343 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:06 +0000 (0:00:00.096) 0:01:19.261 ******** 2021-10-08T19:09:06.496 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-10-08T19:09:06.499 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-10-08T19:09:06.624 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-10-08T19:09:06.689 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-10-08T19:09:06.816 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-10-08T19:09:06.879 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-10-08T19:09:07.006 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-10-08T19:09:07.070 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-10-08T19:09:07.197 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-10-08T19:09:07.261 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-10-08T19:09:07.389 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-10-08T19:09:07.473 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-10-08T19:09:07.581 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-10-08T19:09:07.656 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-10-08T19:09:07.772 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-10-08T19:09:07.846 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-10-08T19:09:07.964 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-10-08T19:09:08.048 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-10-08T19:09:08.154 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-10-08T19:09:08.257 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-10-08T19:09:08.344 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-10-08T19:09:08.439 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-10-08T19:09:08.535 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-10-08T19:09:08.630 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-10-08T19:09:08.726 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-10-08T19:09:08.823 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-10-08T19:09:08.918 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-10-08T19:09:09.013 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-10-08T19:09:09.109 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-10-08T19:09:09.205 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-10-08T19:09:09.310 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-10-08T19:09:09.409 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-10-08T19:09:09.493 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-10-08T19:09:09.598 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-10-08T19:09:09.686 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-10-08T19:09:09.785 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-10-08T19:09:09.882 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-10-08T19:09:09.989 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-10-08T19:09:10.090 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-10-08T19:09:10.187 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-10-08T19:09:10.272 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-10-08T19:09:10.378 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-10-08T19:09:10.474 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-10-08T19:09:10.572 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-10-08T19:09:10.662 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-10-08T19:09:10.762 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-10-08T19:09:10.855 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-10-08T19:09:10.964 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-10-08T19:09:11.051 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-10-08T19:09:11.159 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-10-08T19:09:11.260 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-10-08T19:09:11.364 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-10-08T19:09:11.442 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-10-08T19:09:11.548 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-10-08T19:09:11.657 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-10-08T19:09:11.745 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-10-08T19:09:11.840 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-10-08T19:09:11.949 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-10-08T19:09:12.042 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-10-08T19:09:12.132 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-10-08T19:09:12.238 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-10-08T19:09:12.334 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-10-08T19:09:12.430 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-10-08T19:09:12.524 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-10-08T19:09:12.620 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-10-08T19:09:12.725 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-10-08T19:09:12.810 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-10-08T19:09:12.916 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-10-08T19:09:13.001 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-10-08T19:09:13.109 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-10-08T19:09:13.204 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-10-08T19:09:13.305 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-10-08T19:09:13.402 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-10-08T19:09:13.501 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": false, "item": "jdillaman", "name": "jdillaman", "state": "absent"} 2021-10-08T19:09:13.598 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-10-08T19:09:13.797 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-10-08T19:09:13.988 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": false, "item": "jdillaman", "name": "jdillaman", "state": "absent"} 2021-10-08T19:09:14.886 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item=davidz) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "davidz", "name": "davidz", "remove": false, "state": "absent"} 2021-10-08T19:09:15.427 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => (item=davidz) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "davidz", "name": "davidz", "remove": false, "state": "absent"} 2021-10-08T19:09:16.295 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item=wusui) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "wusui", "name": "wusui", "remove": false, "state": "absent"} 2021-10-08T19:09:16.822 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => (item=wusui) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "wusui", "name": "wusui", "remove": false, "state": "absent"} 2021-10-08T19:09:17.621 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item=nwatkins) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "nwatkins", "name": "nwatkins", "remove": false, "state": "absent"} 2021-10-08T19:09:18.180 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => (item=nwatkins) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "nwatkins", "name": "nwatkins", "remove": false, "state": "absent"} 2021-10-08T19:09:18.960 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item=sidharthanup) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "sidharthanup", "name": "sidharthanup", "remove": false, "state": "absent"} 2021-10-08T19:09:19.501 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => (item=sidharthanup) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "sidharthanup", "name": "sidharthanup", "remove": false, "state": "absent"} 2021-10-08T19:09:20.263 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item=varsha) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "varsha", "name": "varsha", "remove": false, "state": "absent"} 2021-10-08T19:09:20.917 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => (item=varsha) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "varsha", "name": "varsha", "remove": false, "state": "absent"} 2021-10-08T19:09:21.642 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item=hmunjulu) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "hmunjulu", "name": "hmunjulu", "remove": false, "state": "absent"} 2021-10-08T19:09:21.846 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-10-08T19:09:22.046 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-10-08T19:09:22.235 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-10-08T19:09:22.306 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => (item=hmunjulu) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "hmunjulu", "name": "hmunjulu", "remove": false, "state": "absent"} 2021-10-08T19:09:22.434 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-10-08T19:09:22.519 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-10-08T19:09:22.629 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-10-08T19:09:22.708 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-10-08T19:09:22.826 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-10-08T19:09:22.902 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-10-08T19:09:23.022 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-10-08T19:09:23.101 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-10-08T19:09:23.218 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-10-08T19:09:23.305 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-10-08T19:09:23.427 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-10-08T19:09:23.515 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-10-08T19:09:23.620 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-10-08T19:09:23.690 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:23 +0000 (0:00:17.348) 0:01:36.609 ******** 2021-10-08T19:09:23.708 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-10-08T19:09:23.888 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-10-08T19:09:24.091 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-10-08T19:09:24.273 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-10-08T19:09:24.274 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => {"changed": true, "checksum": "12c5dc5e271ed86fec0116e9b72d51cbad447485", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "e85382e2ab97f552f968a3d84b6a725a", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1633720163.7973986-19878-46801525810591/source", "state": "file", "uid": 0} 2021-10-08T19:09:24.313 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:24 +0000 (0:00:00.623) 0:01:37.232 ******** 2021-10-08T19:09:24.322 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-10-08T19:09:24.323 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-10-08T19:09:24.382 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:24 +0000 (0:00:00.068) 0:01:37.301 ******** 2021-10-08T19:09:24.399 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-10-08T19:09:24.401 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => { "msg": "Host smithi117.front.sepia.ceph.com is running CentOS 8.2 (Core)" } 2021-10-08T19:09:24.425 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:24 +0000 (0:00:00.041) 0:01:37.342 ******** 2021-10-08T19:09:24.502 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** ok: [smithi117.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"} 2021-10-08T19:09:24.542 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:24 +0000 (0:00:00.105) 0:01:37.448 ******** 2021-10-08T19:09:24.611 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:24.636 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:24 +0000 (0:00:00.105) 0:01:37.553 ******** 2021-10-08T19:09:24.949 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.081423", "end": "2021-10-08 19:09:24.930313", "rc": 0, "start": "2021-10-08 19:09:24.848890", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-10-08T19:09:24.971 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:24 +0000 (0:00:00.336) 0:01:37.889 ******** 2021-10-08T19:09:24.977 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-10-08T19:09:24.979 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => {"changed": true, "checksum": "12c5dc5e271ed86fec0116e9b72d51cbad447485", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "e85382e2ab97f552f968a3d84b6a725a", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1633720164.4759622-20098-138155842942426/source", "state": "file", "uid": 0} 2021-10-08T19:09:25.004 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:25 +0000 (0:00:00.033) 0:01:37.923 ******** 2021-10-08T19:09:25.046 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:25.077 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:25 +0000 (0:00:00.071) 0:01:37.994 ******** 2021-10-08T19:09:25.083 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-10-08T19:09:25.086 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => { "msg": "Host smithi097.front.sepia.ceph.com is running CentOS 8.2 (Core)" } 2021-10-08T19:09:25.113 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:25 +0000 (0:00:00.034) 0:01:38.029 ******** 2021-10-08T19:09:25.157 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:25.185 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:25 +0000 (0:00:00.074) 0:01:38.103 ******** 2021-10-08T19:09:25.214 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** ok: [smithi097.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"} 2021-10-08T19:09:25.239 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:25 +0000 (0:00:00.054) 0:01:38.158 ******** 2021-10-08T19:09:25.258 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-10-08T19:09:25.260 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:25.283 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:25 +0000 (0:00:00.044) 0:01:38.202 ******** 2021-10-08T19:09:25.322 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:25.340 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:25 +0000 (0:00:00.056) 0:01:38.259 ******** 2021-10-08T19:09:25.371 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:25.396 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:25 +0000 (0:00:00.055) 0:01:38.314 ******** 2021-10-08T19:09:25.495 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:25.527 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:25 +0000 (0:00:00.131) 0:01:38.446 ******** 2021-10-08T19:09:25.636 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:25.664 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:25 +0000 (0:00:00.135) 0:01:38.581 ******** 2021-10-08T19:09:25.671 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** ok: [smithi097.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.072242", "end": "2021-10-08 19:09:25.639008", "rc": 0, "start": "2021-10-08 19:09:25.566766", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-10-08T19:09:25.698 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:25 +0000 (0:00:00.036) 0:01:38.617 ******** 2021-10-08T19:09:25.768 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** skipping: [smithi117.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi117.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-08T19:09:25.799 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:25 +0000 (0:00:00.095) 0:01:38.712 ******** 2021-10-08T19:09:25.813 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:25.839 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:25 +0000 (0:00:00.043) 0:01:38.756 ******** 2021-10-08T19:09:25.865 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:25.895 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:25 +0000 (0:00:00.057) 0:01:38.813 ******** 2021-10-08T19:09:25.924 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-10-08T19:09:25.926 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:25.961 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:25 +0000 (0:00:00.054) 0:01:38.868 ******** 2021-10-08T19:09:25.978 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-10-08T19:09:25.980 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:26.007 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:26 +0000 (0:00:00.055) 0:01:38.923 ******** 2021-10-08T19:09:26.027 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:26.055 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:26 +0000 (0:00:00.048) 0:01:38.972 ******** 2021-10-08T19:09:26.083 INFO:teuthology.task.ansible.out: TASK [common : Set the releasever] ********************************************* 2021-10-08T19:09:26.086 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:26.109 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:26 +0000 (0:00:00.056) 0:01:39.028 ******** 2021-10-08T19:09:26.128 INFO:teuthology.task.ansible.out: 2021-10-08T19:09:26.130 INFO:teuthology.task.ansible.out:TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:26.160 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:26 +0000 (0:00:00.046) 0:01:39.075 ******** 2021-10-08T19:09:26.183 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** skipping: [smithi117.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-08T19:09:26.211 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:26 +0000 (0:00:00.053) 0:01:39.129 ******** 2021-10-08T19:09:26.238 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:26.264 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:26 +0000 (0:00:00.053) 0:01:39.183 ******** 2021-10-08T19:09:26.287 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:26.314 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:26 +0000 (0:00:00.050) 0:01:39.233 ******** 2021-10-08T19:09:26.343 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:26.360 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:26 +0000 (0:00:00.045) 0:01:39.279 ******** 2021-10-08T19:09:26.390 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** skipping: [smithi117.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-08T19:09:26.414 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:26 +0000 (0:00:00.052) 0:01:39.331 ******** 2021-10-08T19:09:26.455 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** skipping: [smithi097.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi097.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-08T19:09:26.479 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:26 +0000 (0:00:00.065) 0:01:39.397 ******** 2021-10-08T19:09:26.486 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:26.511 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:26 +0000 (0:00:00.031) 0:01:39.429 ******** 2021-10-08T19:09:26.559 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:26.600 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:26 +0000 (0:00:00.089) 0:01:39.518 ******** 2021-10-08T19:09:26.607 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-10-08T19:09:26.609 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:26.635 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:26 +0000 (0:00:00.033) 0:01:39.552 ******** 2021-10-08T19:09:26.683 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-10-08T19:09:26.685 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:26.710 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:26 +0000 (0:00:00.073) 0:01:39.626 ******** 2021-10-08T19:09:26.726 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-10-08T19:09:26.728 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:26.752 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:26 +0000 (0:00:00.044) 0:01:39.671 ******** 2021-10-08T19:09:26.781 INFO:teuthology.task.ansible.out: TASK [common : Set the releasever] ********************************************* skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:26.807 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:26 +0000 (0:00:00.054) 0:01:39.726 ******** 2021-10-08T19:09:26.829 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:26.853 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:26 +0000 (0:00:00.046) 0:01:39.772 ******** 2021-10-08T19:09:26.894 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-10-08T19:09:26.896 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-08T19:09:26.922 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:26 +0000 (0:00:00.069) 0:01:39.841 ******** 2021-10-08T19:09:26.944 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [smithi117.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-08T19:09:26.970 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:26 +0000 (0:00:00.047) 0:01:39.889 ******** 2021-10-08T19:09:27.000 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-10-08T19:09:27.003 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:27.028 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:27 +0000 (0:00:00.057) 0:01:39.946 ******** 2021-10-08T19:09:27.046 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-10-08T19:09:27.048 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:27.073 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:27 +0000 (0:00:00.045) 0:01:39.992 ******** 2021-10-08T19:09:27.114 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-10-08T19:09:27.118 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-08T19:09:27.142 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:27 +0000 (0:00:00.068) 0:01:40.061 ******** 2021-10-08T19:09:27.160 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-10-08T19:09:27.162 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:27.198 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:27 +0000 (0:00:00.055) 0:01:40.117 ******** 2021-10-08T19:09:27.219 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:27.259 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:27 +0000 (0:00:00.046) 0:01:40.163 ******** 2021-10-08T19:09:27.266 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:27.295 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:27 +0000 (0:00:00.049) 0:01:40.213 ******** 2021-10-08T19:09:27.324 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-10-08T19:09:27.326 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:27.351 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:27 +0000 (0:00:00.054) 0:01:40.267 ******** 2021-10-08T19:09:27.370 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:27.396 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:27 +0000 (0:00:00.046) 0:01:40.314 ******** 2021-10-08T19:09:27.424 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:27.451 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:27 +0000 (0:00:00.056) 0:01:40.370 ******** 2021-10-08T19:09:27.470 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-10-08T19:09:27.472 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:27.514 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:27 +0000 (0:00:00.059) 0:01:40.430 ******** 2021-10-08T19:09:27.533 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:27.559 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:27 +0000 (0:00:00.048) 0:01:40.478 ******** 2021-10-08T19:09:27.562 INFO:teuthology.task.ansible.out: 2021-10-08T19:09:27.596 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:27.615 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:27 +0000 (0:00:00.055) 0:01:40.534 ******** 2021-10-08T19:09:27.637 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [smithi097.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-08T19:09:27.667 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:27 +0000 (0:00:00.052) 0:01:40.586 ******** 2021-10-08T19:09:27.697 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-10-08T19:09:27.701 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-08T19:09:27.722 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:27 +0000 (0:00:00.054) 0:01:40.641 ******** 2021-10-08T19:09:27.742 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:27.774 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:27 +0000 (0:00:00.046) 0:01:40.687 ******** 2021-10-08T19:09:27.801 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-10-08T19:09:27.803 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:27.835 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:27 +0000 (0:00:00.057) 0:01:40.745 ******** 2021-10-08T19:09:27.847 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:27.875 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:27 +0000 (0:00:00.048) 0:01:40.794 ******** 2021-10-08T19:09:27.906 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-10-08T19:09:27.908 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:27.929 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:27 +0000 (0:00:00.054) 0:01:40.848 ******** 2021-10-08T19:09:27.957 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-10-08T19:09:27.959 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:27.981 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:27 +0000 (0:00:00.051) 0:01:40.900 ******** 2021-10-08T19:09:28.055 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:28.080 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:28 +0000 (0:00:00.098) 0:01:40.998 ******** 2021-10-08T19:09:28.154 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-10-08T19:09:28.155 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:28.181 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:28 +0000 (0:00:00.101) 0:01:41.100 ******** 2021-10-08T19:09:28.212 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-10-08T19:09:28.214 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-08T19:09:28.237 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:28 +0000 (0:00:00.055) 0:01:41.156 ******** 2021-10-08T19:09:28.277 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:28.298 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:28 +0000 (0:00:00.058) 0:01:41.214 ******** 2021-10-08T19:09:28.391 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** skipping: [smithi097.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-08T19:09:28.436 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:28 +0000 (0:00:00.132) 0:01:41.346 ******** 2021-10-08T19:09:28.529 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:28.557 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:28 +0000 (0:00:00.129) 0:01:41.475 ******** 2021-10-08T19:09:28.637 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-10-08T19:09:28.639 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:28.660 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:28 +0000 (0:00:00.103) 0:01:41.579 ******** 2021-10-08T19:09:28.957 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** ok: [smithi097.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-08T19:09:28.988 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:28 +0000 (0:00:00.327) 0:01:41.907 ******** 2021-10-08T19:09:28.991 INFO:teuthology.task.ansible.out: 2021-10-08T19:09:29.153 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** ok: [smithi117.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2021-10-08T19:09:29.593 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2021-10-08T19:09:29.635 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2021-10-08T19:09:29.666 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:29 +0000 (0:00:00.678) 0:01:42.585 ******** 2021-10-08T19:09:30.057 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2021-10-08T19:09:30.087 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:30 +0000 (0:00:00.420) 0:01:43.006 ******** 2021-10-08T19:09:30.233 INFO:teuthology.task.ansible.out: 2021-10-08T19:09:30.239 INFO:teuthology.task.ansible.out:TASK [common : Configure local epel mirrorlists] ******************************* ok: [smithi117.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2021-10-08T19:09:30.242 INFO:teuthology.task.ansible.out: 2021-10-08T19:09:30.617 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2021-10-08T19:09:30.712 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2021-10-08T19:09:30.736 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:30 +0000 (0:00:00.647) 0:01:43.653 ******** 2021-10-08T19:09:30.837 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-10-08T19:09:30.838 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:30.860 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:30 +0000 (0:00:00.124) 0:01:43.778 ******** 2021-10-08T19:09:30.932 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-10-08T19:09:30.934 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:30.961 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:30 +0000 (0:00:00.102) 0:01:43.880 ******** 2021-10-08T19:09:31.035 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:31.066 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:31 +0000 (0:00:00.103) 0:01:43.984 ******** 2021-10-08T19:09:31.072 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-10-08T19:09:31.073 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2021-10-08T19:09:31.104 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:31 +0000 (0:00:00.039) 0:01:44.023 ******** 2021-10-08T19:09:31.134 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:31.157 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:31 +0000 (0:00:00.053) 0:01:44.076 ******** 2021-10-08T19:09:31.190 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:31.212 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:31 +0000 (0:00:00.055) 0:01:44.131 ******** 2021-10-08T19:09:31.233 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** skipping: [smithi117.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "skip_reason": "Conditional result was False"} 2021-10-08T19:09:31.250 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "skip_reason": "Conditional result was False"} 2021-10-08T19:09:31.272 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:31 +0000 (0:00:00.059) 0:01:44.191 ******** 2021-10-08T19:09:31.291 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:31.319 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:31 +0000 (0:00:00.044) 0:01:44.236 ******** 2021-10-08T19:09:31.335 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-10-08T19:09:31.337 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:31.360 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:31 +0000 (0:00:00.042) 0:01:44.278 ******** 2021-10-08T19:09:31.389 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-10-08T19:09:31.390 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:31.420 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:31 +0000 (0:00:00.060) 0:01:44.339 ******** 2021-10-08T19:09:31.431 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:31.455 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:31 +0000 (0:00:00.034) 0:01:44.374 ******** 2021-10-08T19:09:31.485 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:31.507 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:31 +0000 (0:00:00.051) 0:01:44.426 ******** 2021-10-08T19:09:31.525 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-10-08T19:09:31.526 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:31.550 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:31 +0000 (0:00:00.042) 0:01:44.468 ******** 2021-10-08T19:09:31.583 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-10-08T19:09:31.585 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "skip_reason": "Conditional result was False"} 2021-10-08T19:09:31.595 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "skip_reason": "Conditional result was False"} 2021-10-08T19:09:31.596 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "skip_reason": "Conditional result was False"} skipping: [smithi097.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "skip_reason": "Conditional result was False"} 2021-10-08T19:09:31.620 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:31 +0000 (0:00:00.070) 0:01:44.539 ******** 2021-10-08T19:09:31.627 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-10-08T19:09:31.629 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:31.654 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:31 +0000 (0:00:00.032) 0:01:44.571 ******** 2021-10-08T19:09:31.697 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-10-08T19:09:31.698 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:31.739 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:31 +0000 (0:00:00.082) 0:01:44.654 ******** 2021-10-08T19:09:31.751 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:31.784 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:31 +0000 (0:00:00.048) 0:01:44.703 ******** 2021-10-08T19:09:31.811 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:31.844 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:31 +0000 (0:00:00.056) 0:01:44.760 ******** 2021-10-08T19:09:31.914 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:31.934 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:31 +0000 (0:00:00.093) 0:01:44.853 ******** 2021-10-08T19:09:32.019 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-10-08T19:09:32.020 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:32.041 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:32 +0000 (0:00:00.106) 0:01:44.960 ******** 2021-10-08T19:09:32.112 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-10-08T19:09:32.115 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:32.145 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:32 +0000 (0:00:00.100) 0:01:45.061 ******** 2021-10-08T19:09:32.520 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** changed: [smithi117.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.498920", "end": "2021-10-08 19:09:32.500340", "rc": 0, "start": "2021-10-08 19:09:32.001420", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} changed: [smithi097.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.180626", "end": "2021-10-08 19:09:32.500350", "rc": 0, "start": "2021-10-08 19:09:32.319724", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:09:32.545 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:32 +0000 (0:00:00.402) 0:01:45.464 ******** 2021-10-08T19:09:32.567 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:32 +0000 (0:00:00.022) 0:01:45.486 ******** 2021-10-08T19:09:36.180 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-10-08T19:09:36.182 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-10-08T19:09:36.206 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:36 +0000 (0:00:03.638) 0:01:49.125 ******** 2021-10-08T19:09:36.256 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-10-08T19:09:36.279 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:36 +0000 (0:00:00.073) 0:01:49.198 ******** 2021-10-08T19:09:36.285 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:36.311 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:36 +0000 (0:00:00.031) 0:01:49.230 ******** 2021-10-08T19:09:36.351 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:36.377 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:36 +0000 (0:00:00.066) 0:01:49.296 ******** 2021-10-08T19:09:36.383 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-10-08T19:09:36.385 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:36.408 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:36 +0000 (0:00:00.030) 0:01:49.327 ******** 2021-10-08T19:09:36.457 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:36.480 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:36 +0000 (0:00:00.072) 0:01:49.399 ******** 2021-10-08T19:09:36.487 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-10-08T19:09:36.489 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:36.512 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:36 +0000 (0:00:00.031) 0:01:49.431 ******** 2021-10-08T19:09:36.560 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:36.586 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:36 +0000 (0:00:00.071) 0:01:49.502 ******** 2021-10-08T19:09:36.591 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-10-08T19:09:36.592 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:36.617 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:36 +0000 (0:00:00.033) 0:01:49.536 ******** 2021-10-08T19:09:36.680 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:36.704 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:36 +0000 (0:00:00.087) 0:01:49.623 ******** 2021-10-08T19:09:37.124 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-10-08T19:09:37.178 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} Friday 08 October 2021 19:09:37 +0000 (0:00:00.444) 0:01:50.067 ******** 2021-10-08T19:09:37.208 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2021-10-08T19:09:37.232 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:37 +0000 (0:00:00.083) 0:01:50.151 ******** 2021-10-08T19:09:38.478 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-10-08T19:09:38.480 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-10-08T19:09:38.504 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:38 +0000 (0:00:01.272) 0:01:51.423 ******** 2021-10-08T19:09:38.554 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-10-08T19:09:38.580 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:38 +0000 (0:00:00.075) 0:01:51.498 ******** 2021-10-08T19:09:39.033 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-10-08T19:09:39.034 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2021-10-08T19:09:39.098 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2021-10-08T19:09:39.467 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2021-10-08T19:09:39.543 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2021-10-08T19:09:39.882 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2021-10-08T19:09:39.908 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:39 +0000 (0:00:01.327) 0:01:52.826 ******** 2021-10-08T19:09:39.971 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2021-10-08T19:09:39.997 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:39 +0000 (0:00:00.089) 0:01:52.916 ******** 2021-10-08T19:09:40.100 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* ok: [smithi097.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-10-08T19:09:40.126 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:40 +0000 (0:00:00.128) 0:01:53.044 ******** 2021-10-08T19:09:40.185 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-10-08T19:09:40.209 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:40 +0000 (0:00:00.083) 0:01:53.128 ******** 2021-10-08T19:09:40.628 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-10-08T19:09:40.630 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 13355, "state": "file", "uid": 0} 2021-10-08T19:09:40.729 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 13355, "state": "file", "uid": 0} 2021-10-08T19:09:41.055 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2021-10-08T19:09:41.139 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2021-10-08T19:09:41.456 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3612, "state": "file", "uid": 0} 2021-10-08T19:09:41.480 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:41 +0000 (0:00:01.271) 0:01:54.399 ******** 2021-10-08T19:09:41.550 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-10-08T19:09:41.552 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:41.572 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:41 +0000 (0:00:00.091) 0:01:54.491 ******** 2021-10-08T19:09:41.579 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-10-08T19:09:41.581 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3612, "state": "file", "uid": 0} 2021-10-08T19:09:41.609 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:41 +0000 (0:00:00.034) 0:01:54.526 ******** 2021-10-08T19:09:41.646 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-10-08T19:09:41.647 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2021-10-08T19:09:41.670 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:41 +0000 (0:00:00.062) 0:01:54.589 ******** 2021-10-08T19:09:41.689 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-10-08T19:09:41.690 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:41.713 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:41 +0000 (0:00:00.043) 0:01:54.632 ******** 2021-10-08T19:09:41.793 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-10-08T19:09:41.794 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2021-10-08T19:09:41.816 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:41 +0000 (0:00:00.103) 0:01:54.735 ******** 2021-10-08T19:09:41.907 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-10-08T19:09:41.909 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2021-10-08T19:09:41.931 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:41 +0000 (0:00:00.115) 0:01:54.850 ******** 2021-10-08T19:09:42.023 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-10-08T19:09:42.025 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-10-08T19:09:42.045 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-10-08T19:09:42.047 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* changed: [smithi117.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2021-10-08T19:09:42.069 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:42 +0000 (0:00:00.138) 0:01:54.988 ******** 2021-10-08T19:09:42.076 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-10-08T19:09:42.077 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi097.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-10-08T19:09:42.101 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:42 +0000 (0:00:00.032) 0:01:55.020 ******** 2021-10-08T19:09:42.161 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-10-08T19:09:42.182 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-10-08T19:09:42.183 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-10-08T19:09:42.204 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-10-08T19:09:42.227 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:42 +0000 (0:00:00.125) 0:01:55.146 ******** 2021-10-08T19:09:43.435 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ ok: [smithi097.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-10-08T19:09:43.458 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:43 +0000 (0:00:01.230) 0:01:56.376 ******** 2021-10-08T19:09:43.541 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-10-08T19:09:43.565 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:43 +0000 (0:00:00.107) 0:01:56.484 ******** 2021-10-08T19:09:43.586 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:43 +0000 (0:00:00.021) 0:01:56.505 ******** 2021-10-08T19:09:43.657 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:43.681 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:43 +0000 (0:00:00.094) 0:01:56.600 ******** 2021-10-08T19:09:44.063 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-10-08T19:09:44.065 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2021-10-08T19:09:44.088 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:44 +0000 (0:00:00.406) 0:01:57.007 ******** 2021-10-08T19:09:44.192 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2021-10-08T19:09:44.216 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:44 +0000 (0:00:00.127) 0:01:57.135 ******** 2021-10-08T19:09:44.602 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-10-08T19:09:44.604 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2021-10-08T19:09:44.626 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:44 +0000 (0:00:00.410) 0:01:57.545 ******** 2021-10-08T19:09:44.710 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ skipping: [smithi097.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} 2021-10-08T19:09:44.712 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2021-10-08T19:09:44.733 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:44 +0000 (0:00:00.106) 0:01:57.652 ******** 2021-10-08T19:09:44.740 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ skipping: [smithi097.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2021-10-08T19:09:44.767 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:44 +0000 (0:00:00.032) 0:01:57.684 ******** 2021-10-08T19:09:44.826 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} 2021-10-08T19:09:44.842 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2021-10-08T19:09:44.862 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:44 +0000 (0:00:00.096) 0:01:57.781 ******** 2021-10-08T19:09:45.006 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* ok: [smithi097.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-08T19:09:45.025 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:45 +0000 (0:00:00.163) 0:01:57.944 ******** 2021-10-08T19:09:45.101 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-08T19:09:45.124 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:45 +0000 (0:00:00.098) 0:01:58.043 ******** 2021-10-08T19:09:45.321 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-10-08T19:09:45.325 INFO:teuthology.task.ansible.out:fatal: [smithi097.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2021-10-08T19:09:45.345 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:45 +0000 (0:00:00.220) 0:01:58.264 ******** 2021-10-08T19:09:45.415 INFO:teuthology.task.ansible.out:fatal: [smithi117.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2021-10-08T19:09:45.417 INFO:teuthology.task.ansible.out:...ignoring TASK [common : Open nrpe port if firewalld enabled] **************************** skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:45.442 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:45 +0000 (0:00:00.097) 0:01:58.361 ******** 2021-10-08T19:09:45.465 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:45 +0000 (0:00:00.022) 0:01:58.384 ******** 2021-10-08T19:09:45.538 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:45.561 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:45 +0000 (0:00:00.095) 0:01:58.480 ******** 2021-10-08T19:09:45.951 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-10-08T19:09:45.953 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => {"changed": false, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "state": "file", "uid": 0} 2021-10-08T19:09:45.976 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:45 +0000 (0:00:00.415) 0:01:58.895 ******** 2021-10-08T19:09:46.061 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "state": "file", "uid": 0} 2021-10-08T19:09:46.084 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:46 +0000 (0:00:00.108) 0:01:59.003 ******** 2021-10-08T19:09:46.649 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-10-08T19:09:46.651 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveState": "active", "AllowedCPUs": "", "AllowedMemoryNodes": "", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "Delegate": "no", "DevicePolicy": "auto", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/nrpe (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1252", "ExecMainStartTimestamp": "Fri 2021-10-08 19:07:34 UTC", "ExecMainStartTimestampMonotonic": "20281124", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_SSL_OPT ; ignore_errors=no ; start_time=[Fri 2021-10-08 19:07:34 UTC] ; stop_time=[n/a] ; pid=1252 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FileDescriptorStoreMax": "0", "GID": "984", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "Limi 2021-10-08T19:09:46.653 INFO:teuthology.task.ansible.out:tDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127262", "LimitNPROCSoft": "127262", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127262", "LimitSIGPENDINGSoft": "127262", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "MainPID": "1252", "MemoryAccounting": "yes", "MemoryCurrent": "675840", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Nice": "0", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "PIDFile": "/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "RemainAfterExit": "no", "Restart": "on-abort", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeMaxUSec": "infinity", "SecureBits": "0", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StatusErrno": "0", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203619", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Type": "simple", "UID": "98 2021-10-08T19:09:46.654 INFO:teuthology.task.ansible.out:8", "UMask": "0022", "WatchdogTimestamp": "Fri 2021-10-08 19:07:34 UTC", "WatchdogTimestampMonotonic": "20281472", "WatchdogUSec": "0"}} ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveState": "active", "AllowedCPUs": "", "AllowedMemoryNodes": "", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "Delegate": "no", "DevicePolicy": "auto", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/nrpe (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1278", "ExecMainStartTimestamp": "Fri 2021-10-08 19:07:38 UTC", "ExecMainStartTimestampMonotonic": "20447053", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_SSL_OPT ; ignore_errors=no ; start_time=[Fri 2021-10-08 19:07:38 UTC] ; stop_time=[n/a] ; pid=1278 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FileDescriptorStoreMax": "0", "GID": "984", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "LimitAS": "infinity", 2021-10-08T19:09:46.656 INFO:teuthology.task.ansible.out:"LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127262", "LimitNPROCSoft": "127262", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127262", "LimitSIGPENDINGSoft": "127262", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "MainPID": "1278", "MemoryAccounting": "yes", "MemoryCurrent": "675840", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Nice": "0", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "PIDFile": "/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "RemainAfterExit": "no", "Restart": "on-abort", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeMaxUSec": "infinity", "SecureBits": "0", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StatusErrno": "0", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1" 2021-10-08T19:09:46.658 INFO:teuthology.task.ansible.out:, "TasksMax": "203619", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Type": "simple", "UID": "988", "UMask": "0022", "WatchdogTimestamp": "Fri 2021-10-08 19:07:38 UTC", "WatchdogTimestampMonotonic": "20447465", "WatchdogUSec": "0"}} 2021-10-08T19:09:46.675 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:46 +0000 (0:00:00.590) 0:01:59.594 ******** 2021-10-08T19:09:46.695 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:46 +0000 (0:00:00.019) 0:01:59.613 ******** 2021-10-08T19:09:46.903 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* changed: [smithi097.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001863", "end": "2021-10-08 19:09:46.881257", "rc": 0, "start": "2021-10-08 19:09:46.879394", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2021-10-08T19:09:46.927 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:46 +0000 (0:00:00.232) 0:01:59.846 ******** 2021-10-08T19:09:46.935 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001696", "end": "2021-10-08 19:09:46.907652", "rc": 0, "start": "2021-10-08 19:09:46.905956", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2021-10-08T19:09:46.959 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:46 +0000 (0:00:00.032) 0:01:59.878 ******** 2021-10-08T19:09:48.224 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-10-08T19:09:48.226 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-10-08T19:09:48.250 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:48 +0000 (0:00:01.287) 0:02:01.166 ******** 2021-10-08T19:09:48.266 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-10-08T19:09:48.298 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:48 +0000 (0:00:00.050) 0:02:01.216 ******** 2021-10-08T19:10:25.191 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* changed: [smithi097.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: selinux-policy-targeted-3.14.3-67.el8_4.2.noarch", "Installed: selinux-policy-3.14.3-67.el8_4.2.noarch", "Removed: selinux-policy-3.14.3-67.el8_4.1.noarch", "Removed: selinux-policy-targeted-3.14.3-67.el8_4.1.noarch"]} 2021-10-08T19:10:25.216 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:10:25 +0000 (0:00:36.918) 0:02:38.135 ******** 2021-10-08T19:10:25.483 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: selinux-policy-targeted-3.14.3-67.el8_4.2.noarch", "Installed: selinux-policy-3.14.3-67.el8_4.2.noarch", "Removed: selinux-policy-3.14.3-67.el8_4.1.noarch", "Removed: selinux-policy-targeted-3.14.3-67.el8_4.1.noarch"]} 2021-10-08T19:10:25.512 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:10:25 +0000 (0:00:00.295) 0:02:38.431 ******** 2021-10-08T19:10:25.990 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** ok: [smithi097.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2021-10-08T19:10:26.014 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:10:26 +0000 (0:00:00.502) 0:02:38.933 ******** 2021-10-08T19:10:26.048 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2021-10-08T19:10:26.073 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:10:26 +0000 (0:00:00.048) 0:02:38.981 ******** 2021-10-08T19:10:40.850 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-10-08T19:10:40.852 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:14.542205", "end": "2021-10-08 19:10:40.820683", "failed_when_result": false, "rc": 0, "start": "2021-10-08 19:10:26.278478", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2021-10-08T19:10:40.873 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:10:40 +0000 (0:00:14.810) 0:02:53.792 ******** 2021-10-08T19:10:40.901 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:14.635109", "end": "2021-10-08 19:10:40.872484", "failed_when_result": false, "rc": 0, "start": "2021-10-08 19:10:26.237375", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2021-10-08T19:10:40.932 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:10:40 +0000 (0:00:00.058) 0:02:53.851 ******** 2021-10-08T19:10:41.392 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2021-10-08T19:10:41.413 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:10:41 +0000 (0:00:00.479) 0:02:54.331 ******** 2021-10-08T19:10:41.451 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2021-10-08T19:10:41.474 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:10:41 +0000 (0:00:00.061) 0:02:54.393 ******** 2021-10-08T19:10:41.663 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-10-08T19:10:41.665 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.022390", "end": "2021-10-08 19:10:41.641232", "rc": 0, "start": "2021-10-08 19:10:41.618842", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:10:41.688 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:10:41 +0000 (0:00:00.213) 0:02:54.606 ******** 2021-10-08T19:10:41.707 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.008212", "end": "2021-10-08 19:10:41.691824", "rc": 0, "start": "2021-10-08 19:10:41.683612", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:10:41.739 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:10:41 +0000 (0:00:00.050) 0:02:54.657 ******** 2021-10-08T19:10:41.951 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-10-08T19:10:41.954 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.013228", "end": "2021-10-08 19:10:41.930310", "rc": 0, "start": "2021-10-08 19:10:41.917082", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:10:41.977 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:10:41 +0000 (0:00:00.236) 0:02:54.894 ******** 2021-10-08T19:10:41.984 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.011237", "end": "2021-10-08 19:10:41.962085", "rc": 0, "start": "2021-10-08 19:10:41.950848", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:10:42.009 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:10:42 +0000 (0:00:00.034) 0:02:54.928 ******** 2021-10-08T19:10:56.782 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** changed: [smithi117.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:14.578261", "end": "2021-10-08 19:10:56.760171", "rc": 0, "start": "2021-10-08 19:10:42.181910", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:10:56.806 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:10:56 +0000 (0:00:14.795) 0:03:09.724 ******** 2021-10-08T19:10:56.817 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:14.561080", "end": "2021-10-08 19:10:56.778356", "rc": 0, "start": "2021-10-08 19:10:42.217276", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:10:56.847 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:10:56 +0000 (0:00:00.038) 0:03:09.763 ******** 2021-10-08T19:10:57.053 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-10-08T19:10:57.054 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2021-10-08T19:10:57.077 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:10:57 +0000 (0:00:00.232) 0:03:09.996 ******** 2021-10-08T19:10:57.094 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2021-10-08T19:10:57.118 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:10:57 +0000 (0:00:00.041) 0:03:10.037 ******** 2021-10-08T19:10:57.147 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-10-08T19:10:57.148 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "dash_stream": "", "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2021-10-08T19:10:57.171 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:10:57 +0000 (0:00:00.052) 0:03:10.090 ******** 2021-10-08T19:10:57.189 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "dash_stream": "", "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2021-10-08T19:10:57.213 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:10:57 +0000 (0:00:00.042) 0:03:10.132 ******** 2021-10-08T19:10:57.273 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-10-08T19:10:57.275 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-10-08T19:10:57.300 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:10:57 +0000 (0:00:00.085) 0:03:10.218 ******** 2021-10-08T19:10:57.307 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-10-08T19:10:57.333 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:10:57 +0000 (0:00:00.034) 0:03:10.252 ******** 2021-10-08T19:10:57.374 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-10-08T19:10:57.377 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "copr_repos": ["ceph/python3-asyncssh"], "epel_packages": [], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["redhat-lsb-core", "dnf-utils", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "podman", "podman-docker", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "dbench", "autoconf", "gdb", "iozone"], "packages_to_upgrade": ["libgcrypt"], "yum_mirrorlists": ["CentOS-AppStream-mirrorlist", "CentOS-Base-mirrorlist", "CentOS-Extras-mirrorlist", "CentOS-PowerTools-mirrorlist"], "yum_repos": {"CentOS-AppStream": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}, "CentOS-Base": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}, "CentOS-Extras": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}, "CentOS-PowerTools": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-PowerTools-mirrorlist", "name": "CentOS-$releasever - PowerTools"}}}, "a 2021-10-08T19:10:57.379 INFO:teuthology.task.ansible.out:nsible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"} 2021-10-08T19:10:57.401 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:10:57 +0000 (0:00:00.067) 0:03:10.320 ******** 2021-10-08T19:10:57.420 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "copr_repos": ["ceph/python3-asyncssh"], "epel_packages": [], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["redhat-lsb-core", "dnf-utils", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "podman", "podman-docker", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "dbench", "autoconf", "gdb", "iozone"], "packages_to_upgrade": ["libgcrypt"], "yum_mirrorlists": ["CentOS-AppStream-mirrorlist", "CentOS-Base-mirrorlist", "CentOS-Extras-mirrorlist", "CentOS-PowerTools-mirrorlist"], "yum_repos": {"CentOS-AppStream": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}, "CentOS-Base": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}, "CentOS-Extras": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}, "CentOS-PowerTools": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-PowerTools-mirrorlist", "name": "CentOS-$releasever - PowerTools"}}}, "a 2021-10-08T19:10:57.422 INFO:teuthology.task.ansible.out:nsible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"} 2021-10-08T19:10:57.447 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:10:57 +0000 (0:00:00.046) 0:03:10.366 ******** 2021-10-08T19:10:57.489 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-10-08T19:10:57.491 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-10-08T19:10:57.516 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:10:57 +0000 (0:00:00.068) 0:03:10.435 ******** 2021-10-08T19:10:57.534 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-10-08T19:10:57.561 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:10:57 +0000 (0:00:00.045) 0:03:10.480 ******** 2021-10-08T19:10:57.707 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2021-10-08T19:10:57.731 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:10:57 +0000 (0:00:00.170) 0:03:10.650 ******** 2021-10-08T19:10:57.749 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2021-10-08T19:10:57.773 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:10:57 +0000 (0:00:00.042) 0:03:10.692 ******** 2021-10-08T19:10:57.960 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-10-08T19:10:57.962 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "gid": 1254, "name": "ubuntu", "state": "present", "system": false} 2021-10-08T19:10:57.983 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:10:57 +0000 (0:00:00.210) 0:03:10.902 ******** 2021-10-08T19:10:58.033 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => {"changed": false, "gid": 1254, "name": "ubuntu", "state": "present", "system": false} 2021-10-08T19:10:58.057 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:10:58 +0000 (0:00:00.073) 0:03:10.976 ******** 2021-10-08T19:10:58.066 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-10-08T19:10:58.068 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:10:58.091 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:10:58 +0000 (0:00:00.033) 0:03:11.010 ******** 2021-10-08T19:10:58.139 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:10:58.169 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:10:58 +0000 (0:00:00.078) 0:03:11.088 ******** 2021-10-08T19:10:58.180 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:10:58.203 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:10:58 +0000 (0:00:00.033) 0:03:11.122 ******** 2021-10-08T19:10:58.280 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:10:58.308 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:10:58 +0000 (0:00:00.103) 0:03:11.226 ******** 2021-10-08T19:10:58.475 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-10-08T19:10:58.476 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2021-10-08T19:10:58.507 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:10:58 +0000 (0:00:00.199) 0:03:11.426 ******** 2021-10-08T19:10:58.572 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2021-10-08T19:10:58.608 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:10:58 +0000 (0:00:00.100) 0:03:11.527 ******** 2021-10-08T19:10:59.095 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-10-08T19:10:59.097 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2021-10-08T19:10:59.133 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:10:59 +0000 (0:00:00.524) 0:03:12.052 ******** 2021-10-08T19:10:59.184 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2021-10-08T19:10:59.214 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:10:59 +0000 (0:00:00.081) 0:03:12.133 ******** 2021-10-08T19:10:59.222 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* ok: [smithi117.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi117"}, "changed": false} 2021-10-08T19:10:59.246 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:10:59 +0000 (0:00:00.031) 0:03:12.165 ******** 2021-10-08T19:10:59.296 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi097"}, "changed": false} 2021-10-08T19:10:59.321 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:10:59 +0000 (0:00:00.073) 0:03:12.238 ******** 2021-10-08T19:11:00.176 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2021-10-08T19:11:00.179 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi117.front.sepia.ceph.com", "ansible_hostname": "smithi117", "ansible_nodename": "smithi117"}, "changed": true, "name": "smithi117"} 2021-10-08T19:11:00.202 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:00 +0000 (0:00:00.879) 0:03:13.118 ******** 2021-10-08T19:11:00.207 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi097.front.sepia.ceph.com", "ansible_hostname": "smithi097", "ansible_nodename": "smithi097"}, "changed": true, "name": "smithi097"} 2021-10-08T19:11:00.232 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:00 +0000 (0:00:00.032) 0:03:13.151 ******** 2021-10-08T19:11:00.718 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2021-10-08T19:11:00.743 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:00 +0000 (0:00:00.510) 0:03:13.662 ******** 2021-10-08T19:11:00.754 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2021-10-08T19:11:00.785 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:00 +0000 (0:00:00.042) 0:03:13.704 ******** 2021-10-08T19:11:01.248 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-10-08T19:11:01.250 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2021-10-08T19:11:01.274 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:01 +0000 (0:00:00.488) 0:03:14.192 ******** 2021-10-08T19:11:01.292 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2021-10-08T19:11:01.317 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:01 +0000 (0:00:00.042) 0:03:14.235 ******** 2021-10-08T19:11:01.881 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** changed: [smithi117.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-10-08T19:11:01.905 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:01 +0000 (0:00:00.588) 0:03:14.824 ******** 2021-10-08T19:11:01.948 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-10-08T19:11:01.973 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:01 +0000 (0:00:00.067) 0:03:14.892 ******** 2021-10-08T19:11:02.422 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-10-08T19:11:02.424 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2021-10-08T19:11:02.446 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:02 +0000 (0:00:00.472) 0:03:15.364 ******** 2021-10-08T19:11:02.496 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2021-10-08T19:11:02.527 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:02 +0000 (0:00:00.074) 0:03:15.439 ******** 2021-10-08T19:11:02.692 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2021-10-08T19:11:02.715 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:02 +0000 (0:00:00.194) 0:03:15.634 ******** 2021-10-08T19:11:02.780 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2021-10-08T19:11:02.805 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:02 +0000 (0:00:00.090) 0:03:15.724 ******** 2021-10-08T19:11:02.808 INFO:teuthology.task.ansible.out: 2021-10-08T19:11:02.959 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2021-10-08T19:11:02.983 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:02 +0000 (0:00:00.177) 0:03:15.901 ******** 2021-10-08T19:11:03.106 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2021-10-08T19:11:03.130 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:03 +0000 (0:00:00.147) 0:03:16.049 ******** 2021-10-08T19:11:03.259 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-10-08T19:11:03.261 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1254, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-10-08T19:11:03.287 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:03 +0000 (0:00:00.156) 0:03:16.206 ******** 2021-10-08T19:11:03.391 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1254, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-10-08T19:11:03.420 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:03 +0000 (0:00:00.132) 0:03:16.339 ******** 2021-10-08T19:11:03.813 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-10-08T19:11:03.815 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2021-10-08T19:11:03.838 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:03 +0000 (0:00:00.417) 0:03:16.756 ******** 2021-10-08T19:11:03.957 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2021-10-08T19:11:03.987 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:03 +0000 (0:00:00.143) 0:03:16.900 ******** 2021-10-08T19:11:04.367 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2021-10-08T19:11:04.394 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:04 +0000 (0:00:00.412) 0:03:17.313 ******** 2021-10-08T19:11:04.487 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2021-10-08T19:11:04.512 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:04 +0000 (0:00:00.118) 0:03:17.431 ******** 2021-10-08T19:11:06.877 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-10-08T19:11:06.879 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi117.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:02.254970", "end": "2021-10-08 19:11:06.855315", "rc": 0, "start": "2021-10-08 19:11:04.600345", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:11:06.911 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:06 +0000 (0:00:02.398) 0:03:19.829 ******** 2021-10-08T19:11:06.981 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:02.236577", "end": "2021-10-08 19:11:06.957992", "rc": 0, "start": "2021-10-08 19:11:04.721415", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:11:06.983 INFO:teuthology.task.ansible.out: TASK [testnode : Clean up Stream distro-provided repos] ************************ skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:07.005 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:07 +0000 (0:00:00.093) 0:03:19.923 ******** 2021-10-08T19:11:07.024 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:07 +0000 (0:00:00.020) 0:03:19.943 ******** 2021-10-08T19:11:07.074 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:07.105 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:07 +0000 (0:00:00.080) 0:03:20.024 ******** 2021-10-08T19:11:07.113 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-08T19:11:07.114 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:07.140 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:07 +0000 (0:00:00.034) 0:03:20.058 ******** 2021-10-08T19:11:07.189 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:07.191 INFO:teuthology.task.ansible.out: 2021-10-08T19:11:07.215 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:07 +0000 (0:00:00.075) 0:03:20.134 ******** 2021-10-08T19:11:07.234 INFO:teuthology.task.ansible.out: TASK [testnode : Include CentOS Stream specific variables] ********************* 2021-10-08T19:11:07.236 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml", "skip_reason": "Conditional result was False"} 2021-10-08T19:11:07.261 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:07 +0000 (0:00:00.045) 0:03:20.180 ******** 2021-10-08T19:11:07.328 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml", "skip_reason": "Conditional result was False"} 2021-10-08T19:11:07.355 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:07 +0000 (0:00:00.093) 0:03:20.274 ******** 2021-10-08T19:11:07.789 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** ok: [smithi117.front.sepia.ceph.com] => (item=CentOS-AppStream-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "aa5ad73629677ef17172417e50d2cdadccb7a3f2", "dest": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-AppStream-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 397, "state": "file", "uid": 0} 2021-10-08T19:11:07.889 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=CentOS-AppStream-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "aa5ad73629677ef17172417e50d2cdadccb7a3f2", "dest": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-AppStream-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 397, "state": "file", "uid": 0} 2021-10-08T19:11:08.227 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=CentOS-Base-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "4ed3c0272e6c4ec99169cd68f0b43d40bdd4b296", "dest": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Base-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 380, "state": "file", "uid": 0} 2021-10-08T19:11:08.325 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=CentOS-Base-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "4ed3c0272e6c4ec99169cd68f0b43d40bdd4b296", "dest": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Base-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 380, "state": "file", "uid": 0} 2021-10-08T19:11:08.653 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=CentOS-Extras-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "a862f43d3b3c7b8b592aa7dce23a6d013ab20bc3", "dest": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Extras-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 382, "state": "file", "uid": 0} 2021-10-08T19:11:08.774 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=CentOS-Extras-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "a862f43d3b3c7b8b592aa7dce23a6d013ab20bc3", "dest": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Extras-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 382, "state": "file", "uid": 0} 2021-10-08T19:11:09.090 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=CentOS-PowerTools-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "20107eac0ba9a84b318fa5f29b02a387051bff98", "dest": "/etc/yum.repos.d/CentOS-PowerTools-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-PowerTools-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-PowerTools-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 397, "state": "file", "uid": 0} 2021-10-08T19:11:09.117 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:09 +0000 (0:00:01.762) 0:03:22.036 ******** 2021-10-08T19:11:09.212 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=CentOS-PowerTools-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "20107eac0ba9a84b318fa5f29b02a387051bff98", "dest": "/etc/yum.repos.d/CentOS-PowerTools-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-PowerTools-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-PowerTools-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 397, "state": "file", "uid": 0} 2021-10-08T19:11:09.245 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:09 +0000 (0:00:00.127) 0:03:22.163 ******** 2021-10-08T19:11:09.633 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-10-08T19:11:09.635 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2021-10-08T19:11:09.658 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:09 +0000 (0:00:00.413) 0:03:22.577 ******** 2021-10-08T19:11:09.762 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2021-10-08T19:11:09.798 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:09 +0000 (0:00:00.139) 0:03:22.716 ******** 2021-10-08T19:11:10.167 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-10-08T19:11:10.168 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'key': 'CentOS-AppStream', 'value': {'name': 'CentOS-$releasever - AppStream', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "9b147c879e95cd23f3bbde027da102febcaad1a8", "dest": "/etc/yum.repos.d/CentOS-AppStream.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-AppStream", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 289, "state": "file", "uid": 0} 2021-10-08T19:11:10.316 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'key': 'CentOS-AppStream', 'value': {'name': 'CentOS-$releasever - AppStream', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "9b147c879e95cd23f3bbde027da102febcaad1a8", "dest": "/etc/yum.repos.d/CentOS-AppStream.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-AppStream", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 289, "state": "file", "uid": 0} 2021-10-08T19:11:10.601 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'key': 'CentOS-Base', 'value': {'name': 'CentOS-$releasever - Base', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Base-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "77e4590ed0ecec056fa44f4e65af60e110822b85", "dest": "/etc/yum.repos.d/CentOS-Base.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Base", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 274, "state": "file", "uid": 0} 2021-10-08T19:11:10.760 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'key': 'CentOS-Base', 'value': {'name': 'CentOS-$releasever - Base', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Base-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "77e4590ed0ecec056fa44f4e65af60e110822b85", "dest": "/etc/yum.repos.d/CentOS-Base.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Base", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 274, "state": "file", "uid": 0} 2021-10-08T19:11:11.034 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'key': 'CentOS-Extras', 'value': {'name': 'CentOS-$releasever - Extras', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Extras-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "2856826614c7f1cb9409228f6c41319a023ca754", "dest": "/etc/yum.repos.d/CentOS-Extras.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Extras", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 280, "state": "file", "uid": 0} 2021-10-08T19:11:11.203 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'key': 'CentOS-Extras', 'value': {'name': 'CentOS-$releasever - Extras', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Extras-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "2856826614c7f1cb9409228f6c41319a023ca754", "dest": "/etc/yum.repos.d/CentOS-Extras.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Extras", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 280, "state": "file", "uid": 0} 2021-10-08T19:11:11.478 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'key': 'CentOS-PowerTools', 'value': {'name': 'CentOS-$releasever - PowerTools', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-PowerTools-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "76441d1028936932e965a46c12ad393f767201d3", "dest": "/etc/yum.repos.d/CentOS-PowerTools.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-PowerTools", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-PowerTools-mirrorlist", "name": "CentOS-$releasever - PowerTools"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-PowerTools.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 292, "state": "file", "uid": 0} 2021-10-08T19:11:11.506 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:11 +0000 (0:00:01.708) 0:03:24.425 ******** 2021-10-08T19:11:11.630 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item={'key': 'CentOS-PowerTools', 'value': {'name': 'CentOS-$releasever - PowerTools', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-PowerTools-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "76441d1028936932e965a46c12ad393f767201d3", "dest": "/etc/yum.repos.d/CentOS-PowerTools.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-PowerTools", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-PowerTools-mirrorlist", "name": "CentOS-$releasever - PowerTools"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-PowerTools.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 292, "state": "file", "uid": 0} 2021-10-08T19:11:11.658 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:11 +0000 (0:00:00.152) 0:03:24.577 ******** 2021-10-08T19:11:12.086 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** changed: [smithi117.front.sepia.ceph.com] => (item=ceph/python3-asyncssh) => {"ansible_loop_var": "item", "changed": true, "cmd": ["dnf", "-y", "copr", "enable", "ceph/python3-asyncssh"], "delta": "0:00:00.338922", "end": "2021-10-08 19:11:12.066497", "item": "ceph/python3-asyncssh", "rc": 0, "start": "2021-10-08 19:11:11.727575", "stderr": "Enabling a Copr repository. Please note that this repository is not part\nof the main distribution, and quality may vary.\n\nThe Fedora Project does not exercise any power over the contents of\nthis repository beyond the rules outlined in the Copr FAQ at\n,\nand packages are not held to any quality or security level.\n\nPlease do not file bug reports about these packages in Fedora\nBugzilla. In case of problems, contact the owner of this repository.", "stderr_lines": ["Enabling a Copr repository. Please note that this repository is not part", "of the main distribution, and quality may vary.", "", "The Fedora Project does not exercise any power over the contents of", "this repository beyond the rules outlined in the Copr FAQ at", ",", "and packages are not held to any quality or security level.", "", "Please do not file bug reports about these packages in Fedora", "Bugzilla. In case of problems, contact the owner of this repository."], "stdout": "Repository successfully enabled.", "stdout_lines": ["Repository successfully enabled."], "warnings": ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]} 2021-10-08T19:11:12.088 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. 2021-10-08T19:11:12.111 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:12 +0000 (0:00:00.452) 0:03:25.030 ******** 2021-10-08T19:11:12.192 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:12.215 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:12 +0000 (0:00:00.103) 0:03:25.134 ******** 2021-10-08T19:11:12.234 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-10-08T19:11:12.237 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => (item=ceph/python3-asyncssh) => {"ansible_loop_var": "item", "changed": true, "cmd": ["dnf", "-y", "copr", "enable", "ceph/python3-asyncssh"], "delta": "0:00:00.319139", "end": "2021-10-08 19:11:12.208054", "item": "ceph/python3-asyncssh", "rc": 0, "start": "2021-10-08 19:11:11.888915", "stderr": "Enabling a Copr repository. Please note that this repository is not part\nof the main distribution, and quality may vary.\n\nThe Fedora Project does not exercise any power over the contents of\nthis repository beyond the rules outlined in the Copr FAQ at\n,\nand packages are not held to any quality or security level.\n\nPlease do not file bug reports about these packages in Fedora\nBugzilla. In case of problems, contact the owner of this repository.", "stderr_lines": ["Enabling a Copr repository. Please note that this repository is not part", "of the main distribution, and quality may vary.", "", "The Fedora Project does not exercise any power over the contents of", "this repository beyond the rules outlined in the Copr FAQ at", ",", "and packages are not held to any quality or security level.", "", "Please do not file bug reports about these packages in Fedora", "Bugzilla. In case of problems, contact the owner of this repository."], "stdout": "Repository successfully enabled.", "stdout_lines": ["Repository successfully enabled."], "warnings": ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]} 2021-10-08T19:11:12.263 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:12 +0000 (0:00:00.047) 0:03:25.181 ******** 2021-10-08T19:11:12.305 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-10-08T19:11:12.307 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-10-08T19:11:12.332 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:12 +0000 (0:00:00.067) 0:03:25.249 ******** 2021-10-08T19:11:12.348 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:12.371 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:12 +0000 (0:00:00.041) 0:03:25.290 ******** 2021-10-08T19:11:12.400 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-10-08T19:11:12.402 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:12.433 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:12 +0000 (0:00:00.061) 0:03:25.352 ******** 2021-10-08T19:11:12.452 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* skipping: [smithi097.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-10-08T19:11:12.463 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-10-08T19:11:12.488 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:12 +0000 (0:00:00.055) 0:03:25.407 ******** 2021-10-08T19:11:12.518 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-08T19:11:12.519 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2021-10-08T19:11:12.551 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:12 +0000 (0:00:00.063) 0:03:25.470 ******** 2021-10-08T19:11:12.572 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-10-08T19:11:12.574 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:12.597 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:12 +0000 (0:00:00.045) 0:03:25.515 ******** 2021-10-08T19:11:12.636 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-10-08T19:11:12.638 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:12.660 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:12 +0000 (0:00:00.063) 0:03:25.579 ******** 2021-10-08T19:11:12.678 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-08T19:11:12.680 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2021-10-08T19:11:12.709 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:12 +0000 (0:00:00.042) 0:03:25.622 ******** 2021-10-08T19:11:12.758 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:12.785 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:12 +0000 (0:00:00.081) 0:03:25.704 ******** 2021-10-08T19:11:12.798 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:12.823 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:12 +0000 (0:00:00.037) 0:03:25.741 ******** 2021-10-08T19:11:12.906 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:12.930 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:12 +0000 (0:00:00.107) 0:03:25.849 ******** 2021-10-08T19:11:13.032 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-10-08T19:11:13.033 INFO:teuthology.task.ansible.out:fatal: [smithi117.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.006302", "end": "2021-10-08 19:11:13.014906", "msg": "non-zero return code", "rc": 1, "start": "2021-10-08 19:11:13.008604", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2021-10-08T19:11:13.058 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:13 +0000 (0:00:00.128) 0:03:25.977 ******** 2021-10-08T19:11:13.060 INFO:teuthology.task.ansible.out: 2021-10-08T19:11:13.149 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-10-08T19:11:13.151 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:13.178 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:13 +0000 (0:00:00.119) 0:03:26.097 ******** 2021-10-08T19:11:13.198 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-10-08T19:11:13.201 INFO:teuthology.task.ansible.out:fatal: [smithi097.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.006496", "end": "2021-10-08 19:11:13.168278", "msg": "non-zero return code", "rc": 1, "start": "2021-10-08 19:11:13.161782", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2021-10-08T19:11:13.226 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:13 +0000 (0:00:00.048) 0:03:26.145 ******** 2021-10-08T19:11:13.317 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-10-08T19:11:13.318 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:13.339 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:13 +0000 (0:00:00.112) 0:03:26.258 ******** 2021-10-08T19:11:17.139 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-10-08T19:11:17.141 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: librbd1-1:12.2.7-9.el8.x86_64", "Removed: qemu-kvm-block-rbd-15:4.2.0-48.module_el8.4.0+783+f8734d30.x86_64", "Removed: librados2-1:12.2.7-9.el8.x86_64"]} 2021-10-08T19:11:17.162 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:17 +0000 (0:00:03.822) 0:03:30.081 ******** 2021-10-08T19:11:17.186 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: librbd1-1:12.2.7-9.el8.x86_64", "Removed: qemu-kvm-block-rbd-15:4.2.0-48.module_el8.4.0+783+f8734d30.x86_64", "Removed: librados2-1:12.2.7-9.el8.x86_64"]} 2021-10-08T19:11:17.214 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:17 +0000 (0:00:00.051) 0:03:30.133 ******** 2021-10-08T19:11:19.592 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-10-08T19:11:19.595 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-10.el8.x86_64", "Removed: boost-random-1.66.0-10.el8.x86_64"]} 2021-10-08T19:11:19.616 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:19 +0000 (0:00:02.402) 0:03:32.535 ******** 2021-10-08T19:11:19.710 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-10.el8.x86_64", "Removed: boost-random-1.66.0-10.el8.x86_64"]} 2021-10-08T19:11:19.737 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:19 +0000 (0:00:00.120) 0:03:32.656 ******** 2021-10-08T19:11:26.503 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-10-08T19:11:26.506 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: boost-program-options-1.66.0-10.el8.x86_64", "Installed: boost-random-1.66.0-10.el8.x86_64", "Installed: qemu-img-15:4.2.0-48.module_el8.4.0+885+5e18b468.3.x86_64", "Installed: qemu-kvm-common-15:4.2.0-48.module_el8.4.0+885+5e18b468.3.x86_64", "Installed: qemu-kvm-block-rbd-15:4.2.0-48.module_el8.4.0+885+5e18b468.3.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: qemu-kvm-core-15:4.2.0-48.module_el8.4.0+885+5e18b468.3.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Removed: qemu-img-15:4.2.0-48.module_el8.4.0+783+f8734d30.x86_64", "Removed: qemu-kvm-common-15:4.2.0-48.module_el8.4.0+783+f8734d30.x86_64", "Removed: qemu-kvm-core-15:4.2.0-48.module_el8.4.0+783+f8734d30.x86_64"]} 2021-10-08T19:11:26.528 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:26 +0000 (0:00:06.790) 0:03:39.447 ******** 2021-10-08T19:11:26.598 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-10-08T19:11:26.600 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:26.620 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:26 +0000 (0:00:00.092) 0:03:39.539 ******** 2021-10-08T19:11:26.776 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* changed: [smithi097.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: boost-program-options-1.66.0-10.el8.x86_64", "Installed: boost-random-1.66.0-10.el8.x86_64", "Installed: qemu-img-15:4.2.0-48.module_el8.4.0+885+5e18b468.3.x86_64", "Installed: qemu-kvm-common-15:4.2.0-48.module_el8.4.0+885+5e18b468.3.x86_64", "Installed: qemu-kvm-block-rbd-15:4.2.0-48.module_el8.4.0+885+5e18b468.3.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: qemu-kvm-core-15:4.2.0-48.module_el8.4.0+885+5e18b468.3.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Removed: qemu-img-15:4.2.0-48.module_el8.4.0+783+f8734d30.x86_64", "Removed: qemu-kvm-common-15:4.2.0-48.module_el8.4.0+783+f8734d30.x86_64", "Removed: qemu-kvm-core-15:4.2.0-48.module_el8.4.0+783+f8734d30.x86_64"]} 2021-10-08T19:11:26.799 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:26 +0000 (0:00:00.179) 0:03:39.718 ******** 2021-10-08T19:11:26.869 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-10-08T19:11:26.871 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:26.894 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:26 +0000 (0:00:00.094) 0:03:39.812 ******** 2021-10-08T19:11:28.080 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-10-08T19:11:28.082 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-10-08T19:11:28.104 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:28 +0000 (0:00:01.210) 0:03:41.023 ******** 2021-10-08T19:11:28.282 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-10-08T19:11:28.306 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:28 +0000 (0:00:00.201) 0:03:41.225 ******** 2021-10-08T19:11:29.462 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-10-08T19:11:29.485 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:29 +0000 (0:00:01.178) 0:03:42.403 ******** 2021-10-08T19:11:29.642 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-10-08T19:11:29.666 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:29 +0000 (0:00:00.181) 0:03:42.585 ******** 2021-10-08T19:11:29.835 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveState": "inactive", "AllowedCPUs": "", "AllowedMemoryNodes": "", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "ControlPID": "0", "Delegate": "no", "DevicePolicy": "auto", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FileDescriptorStoreMax": "0", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity 2021-10-08T19:11:29.838 INFO:teuthology.task.ansible.out:", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127262", "LimitNPROCSoft": "127262", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127262", "LimitSIGPENDINGSoft": "127262", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Nice": "0", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "PermissionsStartOnly": "no", "RemainAfterExit": "no", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeMaxUSec": "infinity", "SecureBits": "0", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StatusErrno": "0", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "203619", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-10-08T19:11:29.860 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:29 +0000 (0:00:00.194) 0:03:42.779 ******** 2021-10-08T19:11:30.024 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveState": "inactive", "AllowedCPUs": "", "AllowedMemoryNodes": "", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "ControlPID": "0", "Delegate": "no", "DevicePolicy": "auto", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FileDescriptorStoreMax": "0", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", 2021-10-08T19:11:30.026 INFO:teuthology.task.ansible.out:"LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127262", "LimitNPROCSoft": "127262", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127262", "LimitSIGPENDINGSoft": "127262", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Nice": "0", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "PermissionsStartOnly": "no", "RemainAfterExit": "no", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeMaxUSec": "infinity", "SecureBits": "0", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StatusErrno": "0", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "203619", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-10-08T19:11:30.059 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:30 +0000 (0:00:00.189) 0:03:42.969 ******** 2021-10-08T19:11:30.199 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ fatal: [smithi117.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2021-10-08T19:11:30.223 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:30 +0000 (0:00:00.172) 0:03:43.141 ******** 2021-10-08T19:11:30.391 INFO:teuthology.task.ansible.out:fatal: [smithi097.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2021-10-08T19:11:30.418 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:30 +0000 (0:00:00.195) 0:03:43.337 ******** 2021-10-08T19:11:30.890 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-10-08T19:11:30.891 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2021-10-08T19:11:30.916 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:30 +0000 (0:00:00.497) 0:03:43.834 ******** 2021-10-08T19:11:30.935 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:30 +0000 (0:00:00.019) 0:03:43.854 ******** 2021-10-08T19:11:30.983 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-10-08T19:11:30.985 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:31.007 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:31 +0000 (0:00:00.072) 0:03:43.926 ******** 2021-10-08T19:11:31.014 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:31.039 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:31 +0000 (0:00:00.031) 0:03:43.958 ******** 2021-10-08T19:11:31.077 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-10-08T19:11:31.079 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:31.101 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:31 +0000 (0:00:00.062) 0:03:44.020 ******** 2021-10-08T19:11:31.118 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:31.142 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:31 +0000 (0:00:00.040) 0:03:44.061 ******** 2021-10-08T19:11:31.169 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-10-08T19:11:31.171 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:31.193 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:31 +0000 (0:00:00.050) 0:03:44.111 ******** 2021-10-08T19:11:31.210 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:31.234 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:31 +0000 (0:00:00.041) 0:03:44.153 ******** 2021-10-08T19:11:31.262 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-10-08T19:11:31.264 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:31.294 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:31 +0000 (0:00:00.060) 0:03:44.213 ******** 2021-10-08T19:11:31.312 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:31.336 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:31 +0000 (0:00:00.041) 0:03:44.255 ******** 2021-10-08T19:11:31.364 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:31.389 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:31 +0000 (0:00:00.052) 0:03:44.308 ******** 2021-10-08T19:11:31.419 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:31.448 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:31 +0000 (0:00:00.059) 0:03:44.367 ******** 2021-10-08T19:11:31.477 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:31.509 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:31 +0000 (0:00:00.061) 0:03:44.428 ******** 2021-10-08T19:11:31.523 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:31.564 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:31 +0000 (0:00:00.054) 0:03:44.483 ******** 2021-10-08T19:11:31.597 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-10-08T19:11:31.624 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:31 +0000 (0:00:00.060) 0:03:44.543 ******** 2021-10-08T19:11:31.673 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:31 +0000 (0:00:00.048) 0:03:44.592 ******** 2021-10-08T19:11:31.693 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-10-08T19:11:31.695 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:31.722 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:31 +0000 (0:00:00.049) 0:03:44.641 ******** 2021-10-08T19:11:31.752 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:31.777 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:31 +0000 (0:00:00.055) 0:03:44.696 ******** 2021-10-08T19:11:31.794 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-10-08T19:11:31.796 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:31.818 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:31 +0000 (0:00:00.040) 0:03:44.737 ******** 2021-10-08T19:11:31.847 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:31.870 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:31 +0000 (0:00:00.052) 0:03:44.789 ******** 2021-10-08T19:11:31.889 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-10-08T19:11:31.890 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-10-08T19:11:31.900 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-10-08T19:11:31.927 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:31 +0000 (0:00:00.056) 0:03:44.845 ******** 2021-10-08T19:11:31.955 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-10-08T19:11:31.957 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-10-08T19:11:31.981 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:31 +0000 (0:00:00.053) 0:03:44.900 ******** 2021-10-08T19:11:32.001 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-10-08T19:11:32.003 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:32.038 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:32 +0000 (0:00:00.056) 0:03:44.956 ******** 2021-10-08T19:11:32.056 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:32.080 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:32 +0000 (0:00:00.042) 0:03:44.999 ******** 2021-10-08T19:11:32.111 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-10-08T19:11:32.136 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:32 +0000 (0:00:00.055) 0:03:45.055 ******** 2021-10-08T19:11:32.179 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:32 +0000 (0:00:00.042) 0:03:45.098 ******** 2021-10-08T19:11:32.217 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-10-08T19:11:32.219 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:32.243 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:32 +0000 (0:00:00.063) 0:03:45.161 ******** 2021-10-08T19:11:32.283 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:32.306 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:32 +0000 (0:00:00.063) 0:03:45.225 ******** 2021-10-08T19:11:32.309 INFO:teuthology.task.ansible.out: 2021-10-08T19:11:32.326 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-10-08T19:11:32.328 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:32.353 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:32 +0000 (0:00:00.045) 0:03:45.271 ******** 2021-10-08T19:11:32.376 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:32.378 INFO:teuthology.task.ansible.out: 2021-10-08T19:11:32.413 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:32 +0000 (0:00:00.060) 0:03:45.332 ******** 2021-10-08T19:11:32.457 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-10-08T19:11:32.458 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:32.485 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:32 +0000 (0:00:00.072) 0:03:45.404 ******** 2021-10-08T19:11:32.649 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 08 October 2021 19:11:32 +0000 (0:00:00.047) 0:03:45.451 ******** TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 08 October 2021 19:11:32 +0000 (0:00:00.056) 0:03:45.507 ******** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 08 October 2021 19:11:32 +0000 (0:00:00.045) 0:03:45.553 ******** 2021-10-08T19:11:32.684 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:32.707 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:32 +0000 (0:00:00.072) 0:03:45.626 ******** 2021-10-08T19:11:32.716 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:32.747 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:32 +0000 (0:00:00.039) 0:03:45.665 ******** 2021-10-08T19:11:32.775 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-10-08T19:11:32.778 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:32.800 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:32 +0000 (0:00:00.053) 0:03:45.719 ******** 2021-10-08T19:11:32.829 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:32.852 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:32 +0000 (0:00:00.052) 0:03:45.771 ******** 2021-10-08T19:11:32.870 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:32.894 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:32 +0000 (0:00:00.041) 0:03:45.813 ******** 2021-10-08T19:11:32.914 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:32.938 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:32 +0000 (0:00:00.044) 0:03:45.857 ******** 2021-10-08T19:11:32.967 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:32.991 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:32 +0000 (0:00:00.052) 0:03:45.910 ******** 2021-10-08T19:11:33.010 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:33.032 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:33 +0000 (0:00:00.040) 0:03:45.951 ******** 2021-10-08T19:11:33.060 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:33.084 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:33 +0000 (0:00:00.051) 0:03:46.002 ******** 2021-10-08T19:11:33.101 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:33.125 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:33 +0000 (0:00:00.041) 0:03:46.044 ******** 2021-10-08T19:11:33.153 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:33.177 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:33 +0000 (0:00:00.052) 0:03:46.096 ******** 2021-10-08T19:11:33.195 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:33.223 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:33 +0000 (0:00:00.046) 0:03:46.142 ******** 2021-10-08T19:11:33.284 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 08 October 2021 19:11:33 +0000 (0:00:00.053) 0:03:46.196 ******** 2021-10-08T19:11:33.317 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:33.340 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:33 +0000 (0:00:00.063) 0:03:46.259 ******** 2021-10-08T19:11:33.375 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:33.392 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:33 +0000 (0:00:00.051) 0:03:46.311 ******** 2021-10-08T19:11:33.421 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:33.445 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:33 +0000 (0:00:00.052) 0:03:46.363 ******** 2021-10-08T19:11:33.483 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-10-08T19:11:33.484 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:33.509 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:33 +0000 (0:00:00.064) 0:03:46.428 ******** 2021-10-08T19:11:33.526 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:33.549 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:33 +0000 (0:00:00.040) 0:03:46.468 ******** 2021-10-08T19:11:33.578 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:33.654 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:33 +0000 (0:00:00.052) 0:03:46.521 ******** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 08 October 2021 19:11:33 +0000 (0:00:00.040) 0:03:46.562 ******** 2021-10-08T19:11:33.682 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-10-08T19:11:33.683 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:33.705 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:33 +0000 (0:00:00.061) 0:03:46.624 ******** 2021-10-08T19:11:33.723 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:33.746 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:33 +0000 (0:00:00.040) 0:03:46.665 ******** 2021-10-08T19:11:33.773 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:33.803 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:33 +0000 (0:00:00.057) 0:03:46.722 ******** 2021-10-08T19:11:33.824 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:33.848 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:33 +0000 (0:00:00.045) 0:03:46.767 ******** 2021-10-08T19:11:33.877 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:33.904 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:33 +0000 (0:00:00.055) 0:03:46.822 ******** 2021-10-08T19:11:33.984 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 08 October 2021 19:11:33 +0000 (0:00:00.044) 0:03:46.867 ******** TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:34.011 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:34 +0000 (0:00:00.062) 0:03:46.930 ******** 2021-10-08T19:11:34.032 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:34.065 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:34 +0000 (0:00:00.054) 0:03:46.984 ******** 2021-10-08T19:11:34.084 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-10-08T19:11:34.085 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:34.109 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:34 +0000 (0:00:00.043) 0:03:47.028 ******** 2021-10-08T19:11:34.138 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:34.162 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:34 +0000 (0:00:00.052) 0:03:47.080 ******** 2021-10-08T19:11:34.227 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 08 October 2021 19:11:34 +0000 (0:00:00.040) 0:03:47.121 ******** 2021-10-08T19:11:34.231 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:34.254 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:34 +0000 (0:00:00.051) 0:03:47.172 ******** 2021-10-08T19:11:34.271 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-10-08T19:11:34.273 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:34.295 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:34 +0000 (0:00:00.041) 0:03:47.214 ******** 2021-10-08T19:11:34.325 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:34.347 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:34 +0000 (0:00:00.051) 0:03:47.266 ******** 2021-10-08T19:11:34.364 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-10-08T19:11:34.366 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:34.388 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:34 +0000 (0:00:00.040) 0:03:47.307 ******** 2021-10-08T19:11:34.417 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:34.441 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:34 +0000 (0:00:00.052) 0:03:47.360 ******** 2021-10-08T19:11:34.520 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 08 October 2021 19:11:34 +0000 (0:00:00.041) 0:03:47.401 ******** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:34.535 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:34 +0000 (0:00:00.052) 0:03:47.454 ******** 2021-10-08T19:11:34.553 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-08T19:11:34.555 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:34.579 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:34 +0000 (0:00:00.042) 0:03:47.497 ******** 2021-10-08T19:11:34.606 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:34.630 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:34 +0000 (0:00:00.051) 0:03:47.548 ******** 2021-10-08T19:11:34.658 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-10-08T19:11:34.661 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:34.682 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:34 +0000 (0:00:00.052) 0:03:47.601 ******** 2021-10-08T19:11:34.702 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:34.726 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:34 +0000 (0:00:00.043) 0:03:47.645 ******** 2021-10-08T19:11:34.794 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 08 October 2021 19:11:34 +0000 (0:00:00.051) 0:03:47.696 ******** 2021-10-08T19:11:34.805 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:34.828 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:34 +0000 (0:00:00.051) 0:03:47.747 ******** 2021-10-08T19:11:34.846 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:34.870 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:34 +0000 (0:00:00.041) 0:03:47.789 ******** 2021-10-08T19:11:34.900 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:34.923 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:34 +0000 (0:00:00.052) 0:03:47.842 ******** 2021-10-08T19:11:34.940 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-10-08T19:11:34.942 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:34.969 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:34 +0000 (0:00:00.046) 0:03:47.888 ******** 2021-10-08T19:11:35.037 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 08 October 2021 19:11:35 +0000 (0:00:00.054) 0:03:47.942 ******** 2021-10-08T19:11:35.233 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** ok: [smithi097.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2021-10-08T19:11:35.256 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:35 +0000 (0:00:00.232) 0:03:48.175 ******** 2021-10-08T19:11:35.285 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2021-10-08T19:11:35.338 INFO:teuthology.task.ansible.out: Friday 08 October 2021 19:11:35 +0000 (0:00:00.071) 0:03:48.247 ******** 2021-10-08T19:11:35.515 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-10-08T19:11:35.517 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-10-08T19:11:35.538 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:35 +0000 (0:00:00.210) 0:03:48.457 ******** 2021-10-08T19:11:35.569 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-10-08T19:11:35.592 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:35 +0000 (0:00:00.054) 0:03:48.511 ******** 2021-10-08T19:11:35.779 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-10-08T19:11:35.781 INFO:teuthology.task.ansible.out:[WARNING]: Cannot set fs attributes on a non-existent symlink target. follow should be set to False to avoid this. ok: [smithi097.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2021-10-08T19:11:35.806 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:35 +0000 (0:00:00.213) 0:03:48.725 ******** 2021-10-08T19:11:35.835 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2021-10-08T19:11:35.861 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:35 +0000 (0:00:00.055) 0:03:48.780 ******** 2021-10-08T19:11:35.890 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-10-08T19:11:35.892 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:35.920 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:35 +0000 (0:00:00.058) 0:03:48.839 ******** 2021-10-08T19:11:35.942 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:35.969 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:35 +0000 (0:00:00.048) 0:03:48.887 ******** 2021-10-08T19:11:35.997 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-10-08T19:11:35.999 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:36.023 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:36 +0000 (0:00:00.054) 0:03:48.941 ******** 2021-10-08T19:11:36.043 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:36.068 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:36 +0000 (0:00:00.045) 0:03:48.986 ******** 2021-10-08T19:11:36.096 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:36.128 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:36 +0000 (0:00:00.060) 0:03:49.047 ******** 2021-10-08T19:11:36.146 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:36.171 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:36 +0000 (0:00:00.042) 0:03:49.090 ******** 2021-10-08T19:11:36.199 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-10-08T19:11:36.200 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:36.226 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:36 +0000 (0:00:00.055) 0:03:49.145 ******** 2021-10-08T19:11:36.255 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:36.280 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:36 +0000 (0:00:00.053) 0:03:49.198 ******** 2021-10-08T19:11:36.298 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:36.322 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:36 +0000 (0:00:00.042) 0:03:49.240 ******** 2021-10-08T19:11:36.350 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:36.375 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:36 +0000 (0:00:00.053) 0:03:49.294 ******** 2021-10-08T19:11:36.404 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:36.427 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:36 +0000 (0:00:00.051) 0:03:49.346 ******** 2021-10-08T19:11:36.444 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:36.472 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:36 +0000 (0:00:00.044) 0:03:49.391 ******** 2021-10-08T19:11:36.502 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:36.528 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:36 +0000 (0:00:00.056) 0:03:49.447 ******** 2021-10-08T19:11:36.547 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:36.572 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:36 +0000 (0:00:00.043) 0:03:49.491 ******** 2021-10-08T19:11:36.601 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:36.627 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:36 +0000 (0:00:00.055) 0:03:49.546 ******** 2021-10-08T19:11:36.653 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:36.681 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:36 +0000 (0:00:00.053) 0:03:49.600 ******** 2021-10-08T19:11:36.712 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:36.736 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:36 +0000 (0:00:00.053) 0:03:49.654 ******** 2021-10-08T19:11:36.752 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:36.779 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:36 +0000 (0:00:00.043) 0:03:49.697 ******** 2021-10-08T19:11:36.808 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-10-08T19:11:36.810 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:36.843 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:36 +0000 (0:00:00.063) 0:03:49.761 ******** 2021-10-08T19:11:36.861 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:36.884 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:36 +0000 (0:00:00.042) 0:03:49.803 ******** 2021-10-08T19:11:36.924 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-10-08T19:11:36.926 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:36.950 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:36 +0000 (0:00:00.065) 0:03:49.869 ******** 2021-10-08T19:11:36.959 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:36.986 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:36 +0000 (0:00:00.035) 0:03:49.905 ******** 2021-10-08T19:11:37.018 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:37.044 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:37 +0000 (0:00:00.057) 0:03:49.963 ******** 2021-10-08T19:11:37.079 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:37.115 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:37 +0000 (0:00:00.070) 0:03:50.034 ******** 2021-10-08T19:11:37.135 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-10-08T19:11:37.137 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:37.163 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:37 +0000 (0:00:00.047) 0:03:50.082 ******** 2021-10-08T19:11:37.195 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:37.225 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:37 +0000 (0:00:00.062) 0:03:50.144 ******** 2021-10-08T19:11:37.246 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-10-08T19:11:37.248 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:37.272 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:37 +0000 (0:00:00.047) 0:03:50.191 ******** 2021-10-08T19:11:37.303 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:37.335 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:37 +0000 (0:00:00.062) 0:03:50.254 ******** 2021-10-08T19:11:37.376 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-10-08T19:11:37.378 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:37.406 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:37 +0000 (0:00:00.070) 0:03:50.325 ******** 2021-10-08T19:11:37.416 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:37.441 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:37 +0000 (0:00:00.034) 0:03:50.360 ******** 2021-10-08T19:11:37.486 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:37.505 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:37 +0000 (0:00:00.064) 0:03:50.424 ******** 2021-10-08T19:11:37.524 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:37.550 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:37 +0000 (0:00:00.045) 0:03:50.469 ******** 2021-10-08T19:11:37.581 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-10-08T19:11:37.585 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:37.604 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:37 +0000 (0:00:00.053) 0:03:50.523 ******** 2021-10-08T19:11:37.643 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:37.668 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:37 +0000 (0:00:00.063) 0:03:50.587 ******** 2021-10-08T19:11:37.687 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:37.714 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:37 +0000 (0:00:00.045) 0:03:50.632 ******** 2021-10-08T19:11:37.742 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:37.768 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:37 +0000 (0:00:00.054) 0:03:50.687 ******** 2021-10-08T19:11:37.787 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:37.811 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:37 +0000 (0:00:00.043) 0:03:50.730 ******** 2021-10-08T19:11:37.839 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:37.862 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:37 +0000 (0:00:00.050) 0:03:50.781 ******** 2021-10-08T19:11:37.879 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-10-08T19:11:37.880 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:37.904 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:37 +0000 (0:00:00.041) 0:03:50.823 ******** 2021-10-08T19:11:37.933 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:37.958 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:37 +0000 (0:00:00.053) 0:03:50.876 ******** 2021-10-08T19:11:37.977 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-10-08T19:11:37.979 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:38.003 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:38 +0000 (0:00:00.045) 0:03:50.922 ******** 2021-10-08T19:11:38.033 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:38.059 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:38 +0000 (0:00:00.055) 0:03:50.978 ******** 2021-10-08T19:11:38.078 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-10-08T19:11:38.080 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:38.103 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:38 +0000 (0:00:00.044) 0:03:51.022 ******** 2021-10-08T19:11:38.136 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:38.159 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:38 +0000 (0:00:00.055) 0:03:51.078 ******** 2021-10-08T19:11:38.176 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-08T19:11:38.178 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-10-08T19:11:38.201 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:38 +0000 (0:00:00.041) 0:03:51.120 ******** 2021-10-08T19:11:38.231 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-10-08T19:11:38.254 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:38 +0000 (0:00:00.053) 0:03:51.173 ******** 2021-10-08T19:11:38.282 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-10-08T19:11:38.284 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-10-08T19:11:38.293 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-10-08T19:11:38.294 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-10-08T19:11:38.305 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-10-08T19:11:38.316 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-10-08T19:11:38.317 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-10-08T19:11:38.317 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-10-08T19:11:38.345 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:38 +0000 (0:00:00.090) 0:03:51.264 ******** 2021-10-08T19:11:38.352 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-10-08T19:11:38.364 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-10-08T19:11:38.366 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-10-08T19:11:38.375 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-10-08T19:11:38.377 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-10-08T19:11:38.387 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-10-08T19:11:38.398 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-10-08T19:11:38.425 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:38 +0000 (0:00:00.080) 0:03:51.344 ******** 2021-10-08T19:11:38.590 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-10-08T19:11:38.592 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003684", "end": "2021-10-08 19:11:38.562715", "rc": 0, "start": "2021-10-08 19:11:38.559031", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_6f40c4ca66d0ac515a149c2e25df0d91b2dd1a9b/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_6f40c4ca66d0ac515a149c2e25df0d91b2dd1a9b/virtualenv/bin/teuthology-lock"]} 2021-10-08T19:11:38.617 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:38 +0000 (0:00:00.191) 0:03:51.536 ******** 2021-10-08T19:11:38.686 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.004800", "end": "2021-10-08 19:11:38.658036", "rc": 0, "start": "2021-10-08 19:11:38.653236", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_6f40c4ca66d0ac515a149c2e25df0d91b2dd1a9b/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_6f40c4ca66d0ac515a149c2e25df0d91b2dd1a9b/virtualenv/bin/teuthology-lock"]} 2021-10-08T19:11:38.711 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:38 +0000 (0:00:00.094) 0:03:51.630 ******** 2021-10-08T19:11:38.718 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:38.748 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:38 +0000 (0:00:00.037) 0:03:51.667 ******** 2021-10-08T19:11:38.787 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:38.812 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:38 +0000 (0:00:00.063) 0:03:51.731 ******** 2021-10-08T19:11:38.829 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-10-08T19:11:38.831 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:38.853 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:38 +0000 (0:00:00.040) 0:03:51.772 ******** 2021-10-08T19:11:38.882 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:38.906 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:38 +0000 (0:00:00.053) 0:03:51.825 ******** 2021-10-08T19:11:38.924 INFO:teuthology.task.ansible.out: 2021-10-08T19:11:38.926 INFO:teuthology.task.ansible.out:TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:38.948 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:38 +0000 (0:00:00.041) 0:03:51.867 ******** 2021-10-08T19:11:38.986 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:39.013 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:39 +0000 (0:00:00.065) 0:03:51.932 ******** 2021-10-08T19:11:39.033 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-10-08T19:11:39.035 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:39.058 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:39 +0000 (0:00:00.044) 0:03:51.977 ******** 2021-10-08T19:11:39.075 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:39.099 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:39 +0000 (0:00:00.041) 0:03:52.018 ******** 2021-10-08T19:11:40.387 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-10-08T19:11:40.390 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-10-08T19:11:40.415 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:40 +0000 (0:00:01.313) 0:03:53.332 ******** 2021-10-08T19:11:40.434 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-10-08T19:11:40.461 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:40 +0000 (0:00:00.048) 0:03:53.380 ******** 2021-10-08T19:11:40.491 INFO:teuthology.task.ansible.out: 2021-10-08T19:11:40.493 INFO:teuthology.task.ansible.out:TASK [testnode : Set root disk] ************************************************ ok: [smithi097.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930289623040, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227121490, 'block_used': 12973618, 'inode_total': 61054976, 'inode_available': 60985419, 'inode_used': 69557, 'uuid': '617a2b93-35a0-462f-bde1-46e282c74935'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227121490, "block_size": 4096, "block_total": 240095108, "block_used": 12973618, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60985419, "inode_total": 61054976, "inode_used": 69557, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930289623040, "size_total": 983429562368, "uuid": "617a2b93-35a0-462f-bde1-46e282c74935"}} 2021-10-08T19:11:40.524 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:40 +0000 (0:00:00.062) 0:03:53.442 ******** 2021-10-08T19:11:40.595 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930289631232, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227121492, 'block_used': 12973616, 'inode_total': 61054976, 'inode_available': 60985419, 'inode_used': 69557, 'uuid': '617a2b93-35a0-462f-bde1-46e282c74935'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227121492, "block_size": 4096, "block_total": 240095108, "block_used": 12973616, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60985419, "inode_total": 61054976, "inode_used": 69557, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930289631232, "size_total": 983429562368, "uuid": "617a2b93-35a0-462f-bde1-46e282c74935"}} 2021-10-08T19:11:40.623 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:40 +0000 (0:00:00.099) 0:03:53.542 ******** 2021-10-08T19:11:40.788 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** changed: [smithi097.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005055", "end": "2021-10-08 19:11:40.765922", "rc": 0, "start": "2021-10-08 19:11:40.760867", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:11:40.812 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:40 +0000 (0:00:00.188) 0:03:53.731 ******** 2021-10-08T19:11:40.864 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005144", "end": "2021-10-08 19:11:40.840231", "rc": 0, "start": "2021-10-08 19:11:40.835087", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:11:40.888 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:40 +0000 (0:00:00.076) 0:03:53.807 ******** 2021-10-08T19:11:40.917 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-10-08T19:11:40.919 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930289623040, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227121490, 'block_used': 12973618, 'inode_total': 61054976, 'inode_available': 60985419, 'inode_used': 69557, 'uuid': '617a2b93-35a0-462f-bde1-46e282c74935'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227121490, "block_size": 4096, "block_total": 240095108, "block_used": 12973618, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60985419, "inode_total": 61054976, "inode_used": 69557, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930289623040, "size_total": 983429562368, "uuid": "617a2b93-35a0-462f-bde1-46e282c74935"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:40.946 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:40 +0000 (0:00:00.056) 0:03:53.864 ******** 2021-10-08T19:11:40.974 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930289631232, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227121492, 'block_used': 12973616, 'inode_total': 61054976, 'inode_available': 60985419, 'inode_used': 69557, 'uuid': '617a2b93-35a0-462f-bde1-46e282c74935'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227121492, "block_size": 4096, "block_total": 240095108, "block_used": 12973616, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60985419, "inode_total": 61054976, "inode_used": 69557, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930289631232, "size_total": 983429562368, "uuid": "617a2b93-35a0-462f-bde1-46e282c74935"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:41.001 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:40 +0000 (0:00:00.055) 0:03:53.920 ******** 2021-10-08T19:11:41.021 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-10-08T19:11:41.045 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:41 +0000 (0:00:00.044) 0:03:53.964 ******** 2021-10-08T19:11:41.097 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:41 +0000 (0:00:00.051) 0:03:54.016 ******** 2021-10-08T19:11:42.609 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi097.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-f2emtV3FB1aGCbv26Gzm2q3Wnkx3P39G1xYoAV9OCDEA6O1aMx6SLBk4BAOg0Jx3'], 'uuids': ['1796f8ac-51c2-4a0d-bc5a-bb1b9844c50a'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.282808", "end": "2021-10-08 19:11:42.571205", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-f2emtV3FB1aGCbv26Gzm2q3Wnkx3P39G1xYoAV9OCDEA6O1aMx6SLBk4BAOg0Jx3"], "labels": [], "masters": [], "uuids": ["1796f8ac-51c2-4a0d-bc5a-bb1b9844c50a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:11:41.288397", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk u 2021-10-08T19:11:42.612 INFO:teuthology.task.ansible.out:sing fdisk or", "other utilities."]} 2021-10-08T19:11:42.637 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-iMIouQHS6IvymYQreKm7QYPzG122Xf52lPM1A75UoQz94OE0rU72wvrUjtVLxh9u'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.286925", "end": "2021-10-08 19:11:42.611418", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-iMIouQHS6IvymYQreKm7QYPzG122Xf52lPM1A75UoQz94OE0rU72wvrUjtVLxh9u"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:11:41.324493", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-08T19:11:43.871 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-11Gld9-hvBg-NBkf-AQOZ-tAhA-zYcJ-C2pKEx', 'nvme-INTEL_SSDPEDMD400G4_PHFT6204013T400BGN', 'nvme-nvme.8086-50484654363230343031335434303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.066678", "end": "2021-10-08 19:11:43.830013", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-11Gld9-hvBg-NBkf-AQOZ-tAhA-zYcJ-C2pKEx", "nvme-INTEL_SSDPEDMD400G4_PHFT6204013T400BGN", "nvme-nvme.8086-50484654363230343031335434303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:11:42.763335", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2021-10-08T19:11:43.874 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-08T19:11:43.905 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-2e04oC-nk11-nbNo-55rZ-NE6R-uCkK-o7Zcj2', 'nvme-INTEL_SSDPEDMD400G4_PHFT620400V6400BGN', 'nvme-nvme.8086-50484654363230343030563634303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.071994", "end": "2021-10-08 19:11:43.874294", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-2e04oC-nk11-nbNo-55rZ-NE6R-uCkK-o7Zcj2", "nvme-INTEL_SSDPEDMD400G4_PHFT620400V6400BGN", "nvme-nvme.8086-50484654363230343030563634303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:11:42.802300", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2021-10-08T19:11:43.907 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-08T19:11:45.106 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-f2emtV3FB1aGCbv26Gzm2q3Wnkx3P39GQlxnCm7lGe37F3IbmzcHBlXDwAhlPb2P'], 'uuids': ['6bb55e67-2b88-4e43-a279-9aea63ee804a'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.065820", "end": "2021-10-08 19:11:45.079074", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-f2emtV3FB1aGCbv26Gzm2q3Wnkx3P39GQlxnCm7lGe37F3IbmzcHBlXDwAhlPb2P"], "labels": [], "masters": [], "uuids": ["6bb55e67-2b88-4e43-a279-9aea63ee804a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:11:44.013254", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-08T19:11:45.149 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-iMIouQHS6IvymYQreKm7QYPzG122Xf52WX4QchBwgPTJF4f8UC9akQB3ed967UA1'], 'uuids': ['05b216c8-f667-403e-9284-dee1debc352e'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.065042", "end": "2021-10-08 19:11:45.126617", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-iMIouQHS6IvymYQreKm7QYPzG122Xf52WX4QchBwgPTJF4f8UC9akQB3ed967UA1"], "labels": [], "masters": [], "uuids": ["05b216c8-f667-403e-9284-dee1debc352e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:11:44.061575", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-08T19:11:46.353 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-f2emtV3FB1aGCbv26Gzm2q3Wnkx3P39GU8lGA0b0KPLu1E3JKegtOA58AyZh7EY9'], 'uuids': ['d17e09db-3c67-46fc-b3b5-6d2911d3121b'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.068877", "end": "2021-10-08 19:11:46.329950", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-f2emtV3FB1aGCbv26Gzm2q3Wnkx3P39GU8lGA0b0KPLu1E3JKegtOA58AyZh7EY9"], "labels": [], "masters": [], "uuids": ["d17e09db-3c67-46fc-b3b5-6d2911d3121b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:11:45.261073", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-08T19:11:46.410 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-iMIouQHS6IvymYQreKm7QYPzG122Xf52oSMFTQhGFFRAemna6Rdtu8keAdWQIQvP'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.066227", "end": "2021-10-08 19:11:46.376015", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-iMIouQHS6IvymYQreKm7QYPzG122Xf52oSMFTQhGFFRAemna6Rdtu8keAdWQIQvP"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:11:45.309788", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-08T19:11:47.600 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-f2emtV3FB1aGCbv26Gzm2q3Wnkx3P39GkSY6atvMJof5xAWnU0LRPvdvZrE61bUR'], 'uuids': ['812950f4-6b80-4c79-af5f-87ca28177602'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.058613", "end": "2021-10-08 19:11:47.571572", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-f2emtV3FB1aGCbv26Gzm2q3Wnkx3P39GkSY6atvMJof5xAWnU0LRPvdvZrE61bUR"], "labels": [], "masters": [], "uuids": ["812950f4-6b80-4c79-af5f-87ca28177602"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:11:46.512959", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-08T19:11:47.612 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5LHWQ', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5LHWQ', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5LHWQ', 'scsi-35000c500918da23e', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5LHWQ', 'wwn-0x5000c500918da23e'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5LHWQ', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c500918da23e', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5LHWQ-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5LHWQ-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5LHWQ-part1', 'scsi-35000c500918da23e-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5LHWQ-part1', 'wwn-0x5000c500918da23e-part1'], 'uuids': ['617a2b93-35a0-462f-bde1-46e282c74935'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '617a2b93-35a0-462f-bde1-46e282c74935', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LHWQ", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5LHWQ", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W5LHWQ", "scsi-35000c500918da23e", "scsi-SATA_ST1000NM0033-9ZM_Z1W5LHWQ", "wwn-0x5000c500918da23e"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LHWQ-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5LHWQ-part1", "scsi-1ATA_ST1000NM0033-9ZM173_ 2021-10-08T19:11:47.615 INFO:teuthology.task.ansible.out:Z1W5LHWQ-part1", "scsi-35000c500918da23e-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W5LHWQ-part1", "wwn-0x5000c500918da23e-part1"], "labels": [], "masters": [], "uuids": ["617a2b93-35a0-462f-bde1-46e282c74935"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "617a2b93-35a0-462f-bde1-46e282c74935"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5LHWQ", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500918da23e"}}, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:47.666 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-iMIouQHS6IvymYQreKm7QYPzG122Xf52vwoAAKu2ecVGgq3J3EfBMXIsCPzRHkci'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.071982", "end": "2021-10-08 19:11:47.635254", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-iMIouQHS6IvymYQreKm7QYPzG122Xf52vwoAAKu2ecVGgq3J3EfBMXIsCPzRHkci"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:11:46.563272", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-08T19:11:47.668 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5R17F', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5R17F', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5R17F', 'scsi-35000c50091e2fc17', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5R17F', 'wwn-0x5000c50091e2fc17'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5R17F', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c50091e2fc17', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5R17F-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5R17F-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5R17F-part1', 'scsi-35000c50091e2fc17-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5R17F-part1', 'wwn-0x5000c50091e2fc17-part1'], 'uuids': ['617a2b93-35a0-462f-bde1-46e282c74935'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '617a2b93-35a0-462f-bde1-46e282c74935', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5R17F", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5R17F", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W5R17F", "scsi-35000c50091e2fc17", "scsi-SATA_ST1000NM0033-9ZM_Z1W5R17F", "wwn-0x5000c50091e2fc17"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5R17F-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5R17F-part1", "scsi-1ATA_ST1000NM0033-9ZM173_ 2021-10-08T19:11:47.670 INFO:teuthology.task.ansible.out:Z1W5R17F-part1", "scsi-35000c50091e2fc17-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W5R17F-part1", "wwn-0x5000c50091e2fc17-part1"], "labels": [], "masters": [], "uuids": ["617a2b93-35a0-462f-bde1-46e282c74935"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "617a2b93-35a0-462f-bde1-46e282c74935"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5R17F", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e2fc17"}}, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:48.891 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-f2emtV3FB1aGCbv26Gzm2q3Wnkx3P39GeyoHSYU9gvED5VYBLsgEzzWq8PdJRGtC'], 'uuids': ['477121d1-2559-4b92-80bf-aeaa059909b1'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.103619", "end": "2021-10-08 19:11:48.863558", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-f2emtV3FB1aGCbv26Gzm2q3Wnkx3P39GeyoHSYU9gvED5VYBLsgEzzWq8PdJRGtC"], "labels": [], "masters": [], "uuids": ["477121d1-2559-4b92-80bf-aeaa059909b1"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:11:47.759939", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-08T19:11:48.920 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:48 +0000 (0:00:07.822) 0:04:01.839 ******** 2021-10-08T19:11:48.929 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-iMIouQHS6IvymYQreKm7QYPzG122Xf521oWEy4HKJRpYv6EwCIdE8b7UWfDQO5Wh'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.053557", "end": "2021-10-08 19:11:48.876935", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-iMIouQHS6IvymYQreKm7QYPzG122Xf521oWEy4HKJRpYv6EwCIdE8b7UWfDQO5Wh"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:11:47.823378", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-08T19:11:48.962 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:48 +0000 (0:00:00.042) 0:04:01.881 ******** 2021-10-08T19:11:49.326 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi097.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-f2emtV3FB1aGCbv26Gzm2q3Wnkx3P39G1xYoAV9OCDEA6O1aMx6SLBk4BAOg0Jx3'], 'uuids': ['1796f8ac-51c2-4a0d-bc5a-bb1b9844c50a'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.142373", "end": "2021-10-08 19:11:49.297630", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-f2emtV3FB1aGCbv26Gzm2q3Wnkx3P39G1xYoAV9OCDEA6O1aMx6SLBk4BAOg0Jx3"], "labels": [], "masters": [], "uuids": ["1796f8ac-51c2-4a0d-bc5a-bb1b9844c50a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:11:49.155257", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.139642 s, 826 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.139642 s, 826 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-08T19:11:49.379 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-iMIouQHS6IvymYQreKm7QYPzG122Xf52lPM1A75UoQz94OE0rU72wvrUjtVLxh9u'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.142993", "end": "2021-10-08 19:11:49.349480", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-iMIouQHS6IvymYQreKm7QYPzG122Xf52lPM1A75UoQz94OE0rU72wvrUjtVLxh9u"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:11:49.206487", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.140341 s, 822 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.140341 s, 822 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-08T19:11:49.533 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-11Gld9-hvBg-NBkf-AQOZ-tAhA-zYcJ-C2pKEx', 'nvme-INTEL_SSDPEDMD400G4_PHFT6204013T400BGN', 'nvme-nvme.8086-50484654363230343031335434303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.039454", "end": "2021-10-08 19:11:49.510985", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-11Gld9-hvBg-NBkf-AQOZ-tAhA-zYcJ-C2pKEx", "nvme-INTEL_SSDPEDMD400G4_PHFT6204013T400BGN", "nvme-nvme.8086-50484654363230343031335434303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:11:49.471531", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0368844 s, 3.1 GB/s", "std 2021-10-08T19:11:49.535 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0368844 s, 3.1 GB/s"], "stdout": "", "stdout_lines": []} 2021-10-08T19:11:49.597 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-2e04oC-nk11-nbNo-55rZ-NE6R-uCkK-o7Zcj2', 'nvme-INTEL_SSDPEDMD400G4_PHFT620400V6400BGN', 'nvme-nvme.8086-50484654363230343030563634303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.039845", "end": "2021-10-08 19:11:49.568753", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-2e04oC-nk11-nbNo-55rZ-NE6R-uCkK-o7Zcj2", "nvme-INTEL_SSDPEDMD400G4_PHFT620400V6400BGN", "nvme-nvme.8086-50484654363230343030563634303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:11:49.528908", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0371973 s, 3.1 GB/s", "std 2021-10-08T19:11:49.599 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0371973 s, 3.1 GB/s"], "stdout": "", "stdout_lines": []} 2021-10-08T19:11:49.852 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-f2emtV3FB1aGCbv26Gzm2q3Wnkx3P39GQlxnCm7lGe37F3IbmzcHBlXDwAhlPb2P'], 'uuids': ['6bb55e67-2b88-4e43-a279-9aea63ee804a'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.142718", "end": "2021-10-08 19:11:49.829417", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-f2emtV3FB1aGCbv26Gzm2q3Wnkx3P39GQlxnCm7lGe37F3IbmzcHBlXDwAhlPb2P"], "labels": [], "masters": [], "uuids": ["6bb55e67-2b88-4e43-a279-9aea63ee804a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:11:49.686699", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.140071 s, 823 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.140071 s, 823 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-08T19:11:49.916 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-iMIouQHS6IvymYQreKm7QYPzG122Xf52WX4QchBwgPTJF4f8UC9akQB3ed967UA1'], 'uuids': ['05b216c8-f667-403e-9284-dee1debc352e'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.146144", "end": "2021-10-08 19:11:49.897169", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-iMIouQHS6IvymYQreKm7QYPzG122Xf52WX4QchBwgPTJF4f8UC9akQB3ed967UA1"], "labels": [], "masters": [], "uuids": ["05b216c8-f667-403e-9284-dee1debc352e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:11:49.751025", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.143583 s, 803 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.143583 s, 803 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-08T19:11:50.163 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-f2emtV3FB1aGCbv26Gzm2q3Wnkx3P39GU8lGA0b0KPLu1E3JKegtOA58AyZh7EY9'], 'uuids': ['d17e09db-3c67-46fc-b3b5-6d2911d3121b'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.144015", "end": "2021-10-08 19:11:50.143143", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-f2emtV3FB1aGCbv26Gzm2q3Wnkx3P39GU8lGA0b0KPLu1E3JKegtOA58AyZh7EY9"], "labels": [], "masters": [], "uuids": ["d17e09db-3c67-46fc-b3b5-6d2911d3121b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:11:49.999128", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.141386 s, 816 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.141386 s, 816 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-08T19:11:50.227 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-iMIouQHS6IvymYQreKm7QYPzG122Xf52oSMFTQhGFFRAemna6Rdtu8keAdWQIQvP'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.141687", "end": "2021-10-08 19:11:50.209955", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-iMIouQHS6IvymYQreKm7QYPzG122Xf52oSMFTQhGFFRAemna6Rdtu8keAdWQIQvP"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:11:50.068268", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.139118 s, 829 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.139118 s, 829 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-08T19:11:50.490 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-f2emtV3FB1aGCbv26Gzm2q3Wnkx3P39GkSY6atvMJof5xAWnU0LRPvdvZrE61bUR'], 'uuids': ['812950f4-6b80-4c79-af5f-87ca28177602'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.148104", "end": "2021-10-08 19:11:50.464244", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-f2emtV3FB1aGCbv26Gzm2q3Wnkx3P39GkSY6atvMJof5xAWnU0LRPvdvZrE61bUR"], "labels": [], "masters": [], "uuids": ["812950f4-6b80-4c79-af5f-87ca28177602"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:11:50.316140", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.145426 s, 793 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.145426 s, 793 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-08T19:11:50.502 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5LHWQ', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5LHWQ', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5LHWQ', 'scsi-35000c500918da23e', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5LHWQ', 'wwn-0x5000c500918da23e'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5LHWQ', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c500918da23e', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5LHWQ-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5LHWQ-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5LHWQ-part1', 'scsi-35000c500918da23e-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5LHWQ-part1', 'wwn-0x5000c500918da23e-part1'], 'uuids': ['617a2b93-35a0-462f-bde1-46e282c74935'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '617a2b93-35a0-462f-bde1-46e282c74935', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LHWQ", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5LHWQ", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W5LHWQ", "scsi-35000c500918da23e", "scsi-SATA_ST1000NM0033-9ZM_Z1W5LHWQ", "wwn-0x5000c500918da23e"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LHWQ-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5LHWQ-part1", "scsi-1ATA_ST1000NM0033-9ZM173_ 2021-10-08T19:11:50.504 INFO:teuthology.task.ansible.out:Z1W5LHWQ-part1", "scsi-35000c500918da23e-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W5LHWQ-part1", "wwn-0x5000c500918da23e-part1"], "labels": [], "masters": [], "uuids": ["617a2b93-35a0-462f-bde1-46e282c74935"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "617a2b93-35a0-462f-bde1-46e282c74935"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5LHWQ", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500918da23e"}}, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:50.546 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-iMIouQHS6IvymYQreKm7QYPzG122Xf52vwoAAKu2ecVGgq3J3EfBMXIsCPzRHkci'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.144315", "end": "2021-10-08 19:11:50.524346", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-iMIouQHS6IvymYQreKm7QYPzG122Xf52vwoAAKu2ecVGgq3J3EfBMXIsCPzRHkci"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:11:50.380031", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.141596 s, 815 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.141596 s, 815 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-08T19:11:50.559 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5R17F', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5R17F', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5R17F', 'scsi-35000c50091e2fc17', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5R17F', 'wwn-0x5000c50091e2fc17'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5R17F', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c50091e2fc17', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5R17F-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5R17F-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5R17F-part1', 'scsi-35000c50091e2fc17-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5R17F-part1', 'wwn-0x5000c50091e2fc17-part1'], 'uuids': ['617a2b93-35a0-462f-bde1-46e282c74935'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '617a2b93-35a0-462f-bde1-46e282c74935', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5R17F", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5R17F", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W5R17F", "scsi-35000c50091e2fc17", "scsi-SATA_ST1000NM0033-9ZM_Z1W5R17F", "wwn-0x5000c50091e2fc17"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5R17F-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5R17F-part1", "scsi-1ATA_ST1000NM0033-9ZM173_ 2021-10-08T19:11:50.561 INFO:teuthology.task.ansible.out:Z1W5R17F-part1", "scsi-35000c50091e2fc17-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W5R17F-part1", "wwn-0x5000c50091e2fc17-part1"], "labels": [], "masters": [], "uuids": ["617a2b93-35a0-462f-bde1-46e282c74935"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "617a2b93-35a0-462f-bde1-46e282c74935"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5R17F", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e2fc17"}}, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:50.824 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-f2emtV3FB1aGCbv26Gzm2q3Wnkx3P39GeyoHSYU9gvED5VYBLsgEzzWq8PdJRGtC'], 'uuids': ['477121d1-2559-4b92-80bf-aeaa059909b1'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.146182", "end": "2021-10-08 19:11:50.796683", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-f2emtV3FB1aGCbv26Gzm2q3Wnkx3P39GeyoHSYU9gvED5VYBLsgEzzWq8PdJRGtC"], "labels": [], "masters": [], "uuids": ["477121d1-2559-4b92-80bf-aeaa059909b1"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:11:50.650501", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.143565 s, 803 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.143565 s, 803 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-08T19:11:50.864 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:50 +0000 (0:00:01.900) 0:04:03.782 ******** 2021-10-08T19:11:50.873 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-iMIouQHS6IvymYQreKm7QYPzG122Xf521oWEy4HKJRpYv6EwCIdE8b7UWfDQO5Wh'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.143487", "end": "2021-10-08 19:11:50.846818", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-iMIouQHS6IvymYQreKm7QYPzG122Xf521oWEy4HKJRpYv6EwCIdE8b7UWfDQO5Wh"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:11:50.703331", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.140934 s, 818 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.140934 s, 818 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-08T19:11:50.906 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:50 +0000 (0:00:00.043) 0:04:03.825 ******** 2021-10-08T19:11:51.158 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-10-08T19:11:51.160 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.060065", "end": "2021-10-08 19:11:51.086594", "rc": 0, "start": "2021-10-08 19:11:51.026529", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:11:51.183 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:51 +0000 (0:00:00.276) 0:04:04.102 ******** 2021-10-08T19:11:51.191 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.047673", "end": "2021-10-08 19:11:51.122007", "rc": 0, "start": "2021-10-08 19:11:51.074334", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:11:51.219 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:51 +0000 (0:00:00.036) 0:04:04.138 ******** 2021-10-08T19:11:51.416 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-10-08T19:11:51.418 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.054251", "end": "2021-10-08 19:11:51.396620", "rc": 0, "start": "2021-10-08 19:11:51.342369", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:11:51.446 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:51 +0000 (0:00:00.226) 0:04:04.365 ******** 2021-10-08T19:11:51.464 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.046049", "end": "2021-10-08 19:11:51.429183", "rc": 0, "start": "2021-10-08 19:11:51.383134", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:11:51.491 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:51 +0000 (0:00:00.044) 0:04:04.409 ******** 2021-10-08T19:11:51.510 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-10-08T19:11:51.597 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:51 +0000 (0:00:00.106) 0:04:04.516 ******** 2021-10-08T19:11:51.635 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:51 +0000 (0:00:00.037) 0:04:04.554 ******** 2021-10-08T19:11:51.642 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-10-08T19:11:51.644 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:51.669 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:51 +0000 (0:00:00.034) 0:04:04.588 ******** 2021-10-08T19:11:51.676 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:51.706 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:51 +0000 (0:00:00.034) 0:04:04.623 ******** 2021-10-08T19:11:51.713 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-10-08T19:11:51.714 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:51.743 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:51 +0000 (0:00:00.039) 0:04:04.662 ******** 2021-10-08T19:11:51.755 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:51.779 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:51 +0000 (0:00:00.035) 0:04:04.698 ******** 2021-10-08T19:11:51.786 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-10-08T19:11:51.788 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:51.812 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:51 +0000 (0:00:00.033) 0:04:04.731 ******** 2021-10-08T19:11:51.822 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:51.852 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:51 +0000 (0:00:00.039) 0:04:04.771 ******** 2021-10-08T19:11:51.858 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-10-08T19:11:51.860 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:51.884 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:51 +0000 (0:00:00.031) 0:04:04.803 ******** 2021-10-08T19:11:51.891 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:51.917 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:51 +0000 (0:00:00.032) 0:04:04.835 ******** 2021-10-08T19:11:52.072 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-10-08T19:11:52.074 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-08T19:11:52.097 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:52 +0000 (0:00:00.180) 0:04:05.016 ******** 2021-10-08T19:11:52.115 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-08T19:11:52.140 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:52 +0000 (0:00:00.042) 0:04:05.059 ******** 2021-10-08T19:11:52.148 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-10-08T19:11:52.150 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930289623040, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227121490, 'block_used': 12973618, 'inode_total': 61054976, 'inode_available': 60985419, 'inode_used': 69557, 'uuid': '617a2b93-35a0-462f-bde1-46e282c74935'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227121490, "block_size": 4096, "block_total": 240095108, "block_used": 12973618, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60985419, "inode_total": 61054976, "inode_used": 69557, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930289623040, "size_total": 983429562368, "uuid": "617a2b93-35a0-462f-bde1-46e282c74935"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:52.175 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:52 +0000 (0:00:00.034) 0:04:05.094 ******** 2021-10-08T19:11:52.186 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930289631232, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227121492, 'block_used': 12973616, 'inode_total': 61054976, 'inode_available': 60985419, 'inode_used': 69557, 'uuid': '617a2b93-35a0-462f-bde1-46e282c74935'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227121492, "block_size": 4096, "block_total": 240095108, "block_used": 12973616, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60985419, "inode_total": 61054976, "inode_used": 69557, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930289631232, "size_total": 983429562368, "uuid": "617a2b93-35a0-462f-bde1-46e282c74935"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:52.211 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:52 +0000 (0:00:00.036) 0:04:05.130 ******** 2021-10-08T19:11:52.218 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-10-08T19:11:52.220 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:52.244 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:52 +0000 (0:00:00.032) 0:04:05.163 ******** 2021-10-08T19:11:52.251 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:52.277 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:52 +0000 (0:00:00.032) 0:04:05.196 ******** 2021-10-08T19:11:52.285 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-08T19:11:52.287 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:52.310 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:52 +0000 (0:00:00.033) 0:04:05.229 ******** 2021-10-08T19:11:52.318 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:52.344 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:52 +0000 (0:00:00.032) 0:04:05.262 ******** 2021-10-08T19:11:52.350 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-08T19:11:52.352 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:52.376 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:52 +0000 (0:00:00.032) 0:04:05.294 ******** 2021-10-08T19:11:52.383 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:52.407 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:52 +0000 (0:00:00.031) 0:04:05.326 ******** 2021-10-08T19:11:52.424 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-10-08T19:11:52.426 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:52.455 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:52 +0000 (0:00:00.048) 0:04:05.374 ******** 2021-10-08T19:11:52.466 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:52.500 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:52 +0000 (0:00:00.044) 0:04:05.419 ******** 2021-10-08T19:11:52.510 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-10-08T19:11:52.512 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:52.544 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:52 +0000 (0:00:00.044) 0:04:05.463 ******** 2021-10-08T19:11:52.555 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:52.592 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:52 +0000 (0:00:00.046) 0:04:05.510 ******** 2021-10-08T19:11:52.602 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-10-08T19:11:52.605 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:52.627 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:52 +0000 (0:00:00.035) 0:04:05.546 ******** 2021-10-08T19:11:52.635 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:52.661 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:52 +0000 (0:00:00.033) 0:04:05.580 ******** 2021-10-08T19:11:53.365 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-10-08T19:11:53.367 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} changed: [smithi117.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-10-08T19:11:53.510 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:53 +0000 (0:00:00.849) 0:04:06.429 ******** 2021-10-08T19:11:53.530 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:53 +0000 (0:00:00.019) 0:04:06.449 ******** 2021-10-08T19:11:53.980 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-10-08T19:11:53.982 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} changed: [smithi117.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-08T19:11:54.317 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-08T19:11:54.329 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-08T19:11:54.657 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-08T19:11:54.679 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-08T19:11:55.006 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-08T19:11:55.018 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-08T19:11:55.365 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-08T19:11:55.368 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-08T19:11:55.396 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:55 +0000 (0:00:01.865) 0:04:08.315 ******** 2021-10-08T19:11:55.428 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:55 +0000 (0:00:00.031) 0:04:08.346 ******** 2021-10-08T19:11:55.595 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-10-08T19:11:55.596 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-10-08T19:11:55.624 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:55 +0000 (0:00:00.196) 0:04:08.542 ******** 2021-10-08T19:11:55.645 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-10-08T19:11:55.672 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:55 +0000 (0:00:00.048) 0:04:08.591 ******** 2021-10-08T19:11:55.851 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-10-08T19:11:55.854 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-10-08T19:11:55.897 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-10-08T19:11:56.024 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-10-08T19:11:56.077 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-10-08T19:11:56.216 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-10-08T19:11:56.250 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-10-08T19:11:56.399 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-10-08T19:11:56.410 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:56.438 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:56 +0000 (0:00:00.766) 0:04:09.357 ******** 2021-10-08T19:11:56.448 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-10-08T19:11:56.449 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:56.474 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:56 +0000 (0:00:00.036) 0:04:09.393 ******** 2021-10-08T19:11:56.482 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-10-08T19:11:56.483 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:56.506 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:56 +0000 (0:00:00.031) 0:04:09.425 ******** 2021-10-08T19:11:56.512 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:56.539 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:56 +0000 (0:00:00.033) 0:04:09.458 ******** 2021-10-08T19:11:56.547 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:56.571 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:56 +0000 (0:00:00.031) 0:04:09.489 ******** 2021-10-08T19:11:56.577 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:56.602 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:56 +0000 (0:00:00.031) 0:04:09.521 ******** 2021-10-08T19:11:56.768 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-10-08T19:11:56.770 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-10-08T19:11:56.792 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:56 +0000 (0:00:00.189) 0:04:09.711 ******** 2021-10-08T19:11:56.810 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-10-08T19:11:56.833 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:56 +0000 (0:00:00.041) 0:04:09.752 ******** 2021-10-08T19:11:56.840 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-10-08T19:11:56.842 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-10-08T19:11:56.868 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:56 +0000 (0:00:00.034) 0:04:09.787 ******** 2021-10-08T19:11:56.875 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-10-08T19:11:56.900 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:56 +0000 (0:00:00.031) 0:04:09.818 ******** 2021-10-08T19:11:57.244 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-10-08T19:11:57.246 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => {"changed": true} changed: [smithi117.front.sepia.ceph.com] => {"changed": true} 2021-10-08T19:11:57.269 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:57 +0000 (0:00:00.369) 0:04:10.188 ******** 2021-10-08T19:11:57.291 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:57 +0000 (0:00:00.021) 0:04:10.209 ******** 2021-10-08T19:11:57.677 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* changed: [smithi117.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-10-08T19:11:57.701 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:57 +0000 (0:00:00.410) 0:04:10.620 ******** 2021-10-08T19:11:57.712 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-10-08T19:11:57.740 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:57 +0000 (0:00:00.038) 0:04:10.659 ******** 2021-10-08T19:11:57.751 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-10-08T19:11:57.753 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:57.778 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:57 +0000 (0:00:00.038) 0:04:10.697 ******** 2021-10-08T19:11:57.788 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:57.817 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:57 +0000 (0:00:00.038) 0:04:10.736 ******** 2021-10-08T19:11:57.827 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-10-08T19:11:57.829 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:57.856 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:57 +0000 (0:00:00.038) 0:04:10.774 ******** 2021-10-08T19:11:57.866 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:57.892 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:57 +0000 (0:00:00.036) 0:04:10.811 ******** 2021-10-08T19:11:57.902 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-10-08T19:11:57.904 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:57.934 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:57 +0000 (0:00:00.042) 0:04:10.853 ******** 2021-10-08T19:11:57.944 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:57.969 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:57 +0000 (0:00:00.035) 0:04:10.888 ******** 2021-10-08T19:11:57.988 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-10-08T19:11:57.990 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:58.011 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:58 +0000 (0:00:00.041) 0:04:10.930 ******** 2021-10-08T19:11:58.020 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:58.045 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:58 +0000 (0:00:00.034) 0:04:10.964 ******** 2021-10-08T19:11:58.054 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-10-08T19:11:58.056 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:58.082 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:58 +0000 (0:00:00.036) 0:04:11.001 ******** 2021-10-08T19:11:58.092 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:58.121 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:58 +0000 (0:00:00.037) 0:04:11.039 ******** 2021-10-08T19:11:58.130 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-10-08T19:11:58.132 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:58.162 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:58 +0000 (0:00:00.041) 0:04:11.081 ******** 2021-10-08T19:11:58.175 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:58.209 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:58 +0000 (0:00:00.046) 0:04:11.127 ******** 2021-10-08T19:11:58.216 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-10-08T19:11:58.218 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:58.243 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:58 +0000 (0:00:00.034) 0:04:11.162 ******** 2021-10-08T19:11:58.251 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:58.274 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:58 +0000 (0:00:00.031) 0:04:11.193 ******** 2021-10-08T19:11:58.281 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-10-08T19:11:58.282 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:58.305 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:58 +0000 (0:00:00.030) 0:04:11.224 ******** 2021-10-08T19:11:58.313 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:58.338 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:58 +0000 (0:00:00.033) 0:04:11.257 ******** 2021-10-08T19:11:58.346 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-10-08T19:11:58.347 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:58.374 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:58 +0000 (0:00:00.035) 0:04:11.293 ******** 2021-10-08T19:11:58.383 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:58.418 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:58 +0000 (0:00:00.043) 0:04:11.337 ******** 2021-10-08T19:11:58.428 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-10-08T19:11:58.430 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:58.454 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:58 +0000 (0:00:00.035) 0:04:11.372 ******** 2021-10-08T19:11:58.460 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:58.485 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:58 +0000 (0:00:00.031) 0:04:11.404 ******** 2021-10-08T19:11:58.491 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-10-08T19:11:58.493 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:58.516 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:58 +0000 (0:00:00.031) 0:04:11.435 ******** 2021-10-08T19:11:58.525 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:58.548 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:58 +0000 (0:00:00.031) 0:04:11.467 ******** 2021-10-08T19:11:58.556 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-10-08T19:11:58.557 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:58.581 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:58 +0000 (0:00:00.033) 0:04:11.500 ******** 2021-10-08T19:11:58.589 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:58.614 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:58 +0000 (0:00:00.032) 0:04:11.532 ******** 2021-10-08T19:11:58.621 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-10-08T19:11:58.623 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:58.647 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:58 +0000 (0:00:00.033) 0:04:11.566 ******** 2021-10-08T19:11:58.653 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:58.677 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:58 +0000 (0:00:00.030) 0:04:11.596 ******** 2021-10-08T19:11:58.684 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-10-08T19:11:58.686 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:58.710 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:58 +0000 (0:00:00.033) 0:04:11.629 ******** 2021-10-08T19:11:58.718 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:58.741 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:58 +0000 (0:00:00.030) 0:04:11.660 ******** 2021-10-08T19:11:58.748 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:58.778 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:58 +0000 (0:00:00.036) 0:04:11.696 ******** 2021-10-08T19:11:58.784 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:58.810 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:58 +0000 (0:00:00.032) 0:04:11.729 ******** 2021-10-08T19:11:59.242 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-10-08T19:11:59.244 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2021-10-08T19:11:59.268 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:59 +0000 (0:00:00.457) 0:04:12.186 ******** 2021-10-08T19:11:59.285 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2021-10-08T19:11:59.309 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:59 +0000 (0:00:00.041) 0:04:12.228 ******** 2021-10-08T19:11:59.581 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-10-08T19:11:59.583 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveState": "active", "AllowedCPUs": "", "AllowedMemoryNodes": "", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "Delegate": "no", "DevicePolicy": "auto", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "887", "ExecMainStartTimestamp": "Fri 2021-10-08 19:07:30 UTC", "ExecMainStartTimestampMonotonic": "12808612", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FileDescriptorStoreMax": "0", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitM 2021-10-08T19:11:59.584 INFO:teuthology.task.ansible.out:EMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127262", "LimitNPROCSoft": "127262", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127262", "LimitSIGPENDINGSoft": "127262", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "MainPID": "887", "MemoryAccounting": "yes", "MemoryCurrent": "1814528", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Nice": "0", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "RemainAfterExit": "no", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeMaxUSec": "infinity", "SecureBits": "0", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StatusErrno": "0", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203619", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Type": "forking", "UID": "[not set]", "UMask": "0022", "WatchdogTimestamp": "Fri 2021-10-08 19:07:30 UTC", "WatchdogTimestampMonotonic": "12808622", "WatchdogUSec": "0"}} 2021-10-08T19:11:59.606 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:59 +0000 (0:00:00.297) 0:04:12.525 ******** 2021-10-08T19:11:59.626 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveState": "active", "AllowedCPUs": "", "AllowedMemoryNodes": "", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "Delegate": "no", "DevicePolicy": "auto", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "905", "ExecMainStartTimestamp": "Fri 2021-10-08 19:07:27 UTC", "ExecMainStartTimestampMonotonic": "12558439", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FileDescriptorStoreMax": "0", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitM 2021-10-08T19:11:59.628 INFO:teuthology.task.ansible.out:EMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127262", "LimitNPROCSoft": "127262", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127262", "LimitSIGPENDINGSoft": "127262", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "MainPID": "905", "MemoryAccounting": "yes", "MemoryCurrent": "1818624", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Nice": "0", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "RemainAfterExit": "no", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeMaxUSec": "infinity", "SecureBits": "0", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StatusErrno": "0", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203619", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Type": "forking", "UID": "[not set]", "UMask": "0022", "WatchdogTimestamp": "Fri 2021-10-08 19:07:27 UTC", "WatchdogTimestampMonotonic": "12558455", "WatchdogUSec": "0"}} 2021-10-08T19:11:59.650 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:59 +0000 (0:00:00.043) 0:04:12.568 ******** 2021-10-08T19:11:59.656 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-08T19:11:59.658 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-10-08T19:11:59.681 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:59 +0000 (0:00:00.031) 0:04:12.600 ******** 2021-10-08T19:11:59.689 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-10-08T19:11:59.713 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:59 +0000 (0:00:00.031) 0:04:12.632 ******** 2021-10-08T19:11:59.720 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-08T19:11:59.721 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-10-08T19:11:59.744 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:59 +0000 (0:00:00.031) 0:04:12.663 ******** 2021-10-08T19:11:59.751 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-10-08T19:11:59.774 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:59 +0000 (0:00:00.029) 0:04:12.693 ******** 2021-10-08T19:11:59.781 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-10-08T19:11:59.782 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:59.805 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:59 +0000 (0:00:00.031) 0:04:12.724 ******** 2021-10-08T19:11:59.813 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:59.837 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:59 +0000 (0:00:00.031) 0:04:12.756 ******** 2021-10-08T19:11:59.843 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-10-08T19:11:59.845 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:59.867 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:59 +0000 (0:00:00.030) 0:04:12.786 ******** 2021-10-08T19:11:59.874 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:59.898 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:59 +0000 (0:00:00.030) 0:04:12.817 ******** 2021-10-08T19:11:59.906 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:59.933 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:59 +0000 (0:00:00.034) 0:04:12.852 ******** 2021-10-08T19:11:59.942 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:59.969 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:59 +0000 (0:00:00.035) 0:04:12.887 ******** 2021-10-08T19:12:00.128 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "gid": 1254, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2021-10-08T19:12:00.152 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:00 +0000 (0:00:00.183) 0:04:13.071 ******** 2021-10-08T19:12:00.171 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => {"changed": false, "gid": 1254, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2021-10-08T19:12:00.195 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:00 +0000 (0:00:00.043) 0:04:13.114 ******** 2021-10-08T19:12:00.623 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-10-08T19:12:00.625 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1254, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2021-10-08T19:12:00.647 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:00 +0000 (0:00:00.451) 0:04:13.566 ******** 2021-10-08T19:12:00.677 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1254, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2021-10-08T19:12:00.701 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:00 +0000 (0:00:00.054) 0:04:13.620 ******** 2021-10-08T19:12:01.773 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-10-08T19:12:01.901 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)"], "version": null, "virtualenv": null} ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)"], "version": null, "virtualenv": null} Friday 08 October 2021 19:12:01 +0000 (0:00:01.100) 0:04:14.720 ******** Friday 08 October 2021 19:12:01 +0000 (0:00:00.022) 0:04:14.743 ******** TASK [testnode : Purge 2021-10-08T19:12:01.903 INFO:teuthology.task.ansible.out: resolvconf] ********************************************* skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 08 October 2021 19:12:01 +0000 (0:00:00.052) 0:04:14.795 ******** 2021-10-08T19:12:01.905 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:01 +0000 (0:00:00.028) 0:04:14.824 ******** 2021-10-08T19:12:01.914 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-10-08T19:12:01.916 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-10-08T19:12:01.951 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:01 +0000 (0:00:00.040) 0:04:14.864 ******** 2021-10-08T19:12:01.955 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-10-08T19:12:01.987 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:01 +0000 (0:00:00.040) 0:04:14.904 ******** 2021-10-08T19:12:02.149 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-10-08T19:12:02.151 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-10-08T19:12:02.173 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:02 +0000 (0:00:00.187) 0:04:15.092 ******** 2021-10-08T19:12:02.180 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-10-08T19:12:02.204 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:02 +0000 (0:00:00.031) 0:04:15.123 ******** 2021-10-08T19:12:02.211 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-10-08T19:12:02.214 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:02.235 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:02 +0000 (0:00:00.030) 0:04:15.154 ******** 2021-10-08T19:12:02.241 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:02.267 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:02 +0000 (0:00:00.032) 0:04:15.186 ******** 2021-10-08T19:12:02.274 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** ok: [smithi097.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-10-08T19:12:02.298 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:02 +0000 (0:00:00.030) 0:04:15.217 ******** 2021-10-08T19:12:02.305 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-10-08T19:12:02.335 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:02 +0000 (0:00:00.035) 0:04:15.252 ******** 2021-10-08T19:12:02.341 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-10-08T19:12:02.343 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:02.365 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:02 +0000 (0:00:00.031) 0:04:15.284 ******** 2021-10-08T19:12:02.373 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:02.402 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:02 +0000 (0:00:00.036) 0:04:15.321 ******** 2021-10-08T19:12:02.558 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-10-08T19:12:02.560 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-10-08T19:12:02.601 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:02 +0000 (0:00:00.193) 0:04:15.514 ******** 2021-10-08T19:12:02.616 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-10-08T19:12:02.640 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:02 +0000 (0:00:00.044) 0:04:15.559 ******** 2021-10-08T19:12:02.787 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-10-08T19:12:02.789 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-10-08T19:12:02.811 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:02 +0000 (0:00:00.171) 0:04:15.730 ******** 2021-10-08T19:12:02.829 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-10-08T19:12:02.853 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:02 +0000 (0:00:00.042) 0:04:15.772 ******** 2021-10-08T19:12:02.860 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-10-08T19:12:02.862 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:02.887 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:02 +0000 (0:00:00.033) 0:04:15.806 ******** 2021-10-08T19:12:02.895 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:02.922 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:02 +0000 (0:00:00.035) 0:04:15.841 ******** 2021-10-08T19:12:02.936 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-10-08T19:12:02.938 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-10-08T19:12:02.939 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2021-10-08T19:12:02.940 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi097.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-10-08T19:12:02.942 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2021-10-08T19:12:02.972 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:02 +0000 (0:00:00.049) 0:04:15.890 ******** 2021-10-08T19:12:02.980 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2021-10-08T19:12:02.983 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-10-08T19:12:02.984 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-10-08T19:12:03.014 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:03 +0000 (0:00:00.042) 0:04:15.933 ******** 2021-10-08T19:12:03.023 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-10-08T19:12:03.027 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi097.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:03.040 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:03.042 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:03.052 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:03.087 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:03 +0000 (0:00:00.073) 0:04:16.006 ******** 2021-10-08T19:12:03.100 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:03.102 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:03.113 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:03.114 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:03.115 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:03.141 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:03 +0000 (0:00:00.054) 0:04:16.060 ******** 2021-10-08T19:12:03.151 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-08T19:12:03.153 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:03.182 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:03 +0000 (0:00:00.040) 0:04:16.101 ******** 2021-10-08T19:12:03.192 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:03.230 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:03 +0000 (0:00:00.047) 0:04:16.148 ******** 2021-10-08T19:12:03.240 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-10-08T19:12:03.259 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:03.269 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:03 +0000 (0:00:00.039) 0:04:16.188 ******** 2021-10-08T19:12:03.277 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:03.313 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:03 +0000 (0:00:00.042) 0:04:16.230 ******** 2021-10-08T19:12:03.322 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-10-08T19:12:03.324 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:03.359 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:03 +0000 (0:00:00.047) 0:04:16.278 ******** 2021-10-08T19:12:03.366 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:03.392 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:03 +0000 (0:00:00.032) 0:04:16.311 ******** 2021-10-08T19:12:03.399 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-10-08T19:12:03.401 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:03.425 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:03 +0000 (0:00:00.033) 0:04:16.344 ******** 2021-10-08T19:12:03.432 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:03.459 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:03 +0000 (0:00:00.033) 0:04:16.378 ******** 2021-10-08T19:12:03.466 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-10-08T19:12:03.468 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:03.492 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:03 +0000 (0:00:00.033) 0:04:16.411 ******** 2021-10-08T19:12:03.499 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:03.528 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:03 +0000 (0:00:00.035) 0:04:16.447 ******** 2021-10-08T19:12:03.538 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-10-08T19:12:03.540 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:03.566 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:03 +0000 (0:00:00.038) 0:04:16.485 ******** 2021-10-08T19:12:03.573 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:03.600 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:03 +0000 (0:00:00.033) 0:04:16.519 ******** 2021-10-08T19:12:03.608 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-10-08T19:12:03.609 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:03.635 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:03 +0000 (0:00:00.035) 0:04:16.554 ******** 2021-10-08T19:12:03.643 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:03.670 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:03 +0000 (0:00:00.034) 0:04:16.589 ******** 2021-10-08T19:12:03.677 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-10-08T19:12:03.679 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:03.704 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:03 +0000 (0:00:00.033) 0:04:16.623 ******** 2021-10-08T19:12:03.711 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:03.736 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:03 +0000 (0:00:00.032) 0:04:16.655 ******** 2021-10-08T19:12:03.921 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-10-08T19:12:03.923 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.004850", "end": "2021-10-08 19:12:03.893190", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-10-08 19:12:03.888340", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:12:03.954 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.005220", "end": "2021-10-08 19:12:03.929607", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-10-08 19:12:03.924387", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:12:04.101 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003003", "end": "2021-10-08 19:12:04.069047", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-10-08 19:12:04.066044", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:12:04.133 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.002996", "end": "2021-10-08 19:12:04.104033", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-10-08 19:12:04.101037", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:12:04.270 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002783", "end": "2021-10-08 19:12:04.241773", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-10-08 19:12:04.238990", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2021-10-08T19:12:04.302 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002780", "end": "2021-10-08 19:12:04.271056", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-10-08 19:12:04.268276", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2021-10-08T19:12:04.440 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.003199", "end": "2021-10-08 19:12:04.414749", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-10-08 19:12:04.411550", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:12:04.466 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:04 +0000 (0:00:00.729) 0:04:17.385 ******** 2021-10-08T19:12:04.487 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.003087", "end": "2021-10-08 19:12:04.452068", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-10-08 19:12:04.448981", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:12:04.513 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:04 +0000 (0:00:00.047) 0:04:17.432 ******** 2021-10-08T19:12:04.520 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-10-08T19:12:04.546 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:04 +0000 (0:00:00.032) 0:04:17.464 ******** 2021-10-08T19:12:04.576 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:04 +0000 (0:00:00.030) 0:04:17.495 ******** 2021-10-08T19:12:04.583 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-10-08T19:12:04.585 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:04.608 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:04.685 INFO:teuthology.task.ansible.out: PLAY [testnodes,senta,vossi,jenkins_slaves] ************************************ 2021-10-08T19:12:04.705 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:04 +0000 (0:00:00.128) 0:04:17.624 ******** 2021-10-08T19:12:04.733 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:04 +0000 (0:00:00.028) 0:04:17.652 ******** 2021-10-08T19:12:05.364 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi097.front.sepia.ceph.com] 2021-10-08T19:12:05.414 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:05 +0000 (0:00:00.680) 0:04:18.333 ******** 2021-10-08T19:12:05.444 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:05.469 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:05 +0000 (0:00:00.054) 0:04:18.388 ******** 2021-10-08T19:12:05.511 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-10-08T19:12:05.513 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "yum"}, "changed": false} 2021-10-08T19:12:05.534 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:05 +0000 (0:00:00.065) 0:04:18.453 ******** 2021-10-08T19:12:05.584 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** ok: [smithi097.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml) => {"ansible_facts": {"container_packages": ["podman", "podman-docker"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"} 2021-10-08T19:12:05.610 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:05 +0000 (0:00:00.075) 0:04:18.529 ******** 2021-10-08T19:12:06.388 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi117.front.sepia.ceph.com] 2021-10-08T19:12:06.437 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:06 +0000 (0:00:00.827) 0:04:19.356 ******** 2021-10-08T19:12:06.478 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-10-08T19:12:06.480 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:06.502 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:06 +0000 (0:00:00.064) 0:04:19.420 ******** 2021-10-08T19:12:06.540 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-10-08T19:12:06.542 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "yum"}, "changed": false} 2021-10-08T19:12:06.564 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:06 +0000 (0:00:00.062) 0:04:19.483 ******** 2021-10-08T19:12:06.624 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-10-08T19:12:06.625 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml) => {"ansible_facts": {"container_packages": ["podman", "podman-docker"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"} 2021-10-08T19:12:06.651 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:06 +0000 (0:00:00.086) 0:04:19.570 ******** 2021-10-08T19:12:11.178 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-10-08T19:12:11.180 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: podman-3.2.3-0.11.module_el8.4.0+942+d25aada8.x86_64", "Installed: podman-docker-3.2.3-0.11.module_el8.4.0+942+d25aada8.noarch", "Installed: podman-catatonit-3.2.3-0.11.module_el8.4.0+942+d25aada8.x86_64", "Removed: podman-3.0.1-7.module_el8.4.0+830+8027e1c4.x86_64", "Removed: podman-catatonit-3.0.1-7.module_el8.4.0+830+8027e1c4.x86_64", "Removed: podman-docker-3.0.1-7.module_el8.4.0+830+8027e1c4.noarch"]} 2021-10-08T19:12:11.202 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:11 +0000 (0:00:04.550) 0:04:24.121 ******** 2021-10-08T19:12:11.233 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** ok: [smithi097.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/containers/registries.conf"}, "changed": false} 2021-10-08T19:12:11.255 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:11 +0000 (0:00:00.053) 0:04:24.174 ******** 2021-10-08T19:12:11.282 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-10-08T19:12:11.284 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:11.305 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:11 +0000 (0:00:00.049) 0:04:24.224 ******** 2021-10-08T19:12:11.557 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-10-08T19:12:11.559 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-10-08T19:12:11.750 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-10-08T19:12:11.782 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:11 +0000 (0:00:00.477) 0:04:24.701 ******** 2021-10-08T19:12:12.234 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-10-08T19:12:12.236 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: podman-3.2.3-0.11.module_el8.4.0+942+d25aada8.x86_64", "Installed: podman-docker-3.2.3-0.11.module_el8.4.0+942+d25aada8.noarch", "Installed: podman-catatonit-3.2.3-0.11.module_el8.4.0+942+d25aada8.x86_64", "Removed: podman-3.0.1-7.module_el8.4.0+830+8027e1c4.x86_64", "Removed: podman-catatonit-3.0.1-7.module_el8.4.0+830+8027e1c4.x86_64", "Removed: podman-docker-3.0.1-7.module_el8.4.0+830+8027e1c4.noarch"]} 2021-10-08T19:12:12.263 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:12 +0000 (0:00:00.479) 0:04:25.181 ******** 2021-10-08T19:12:12.270 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-10-08T19:12:12.272 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "secontext": "system_u:object_r:cert_t:s0", "size": 2334, "state": "file", "uid": 0} 2021-10-08T19:12:12.293 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-10-08T19:12:12.295 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/containers/registries.conf"}, "changed": false} 2021-10-08T19:12:12.316 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:12 +0000 (0:00:00.053) 0:04:25.234 ******** 2021-10-08T19:12:12.343 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:12.366 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:12 +0000 (0:00:00.051) 0:04:25.285 ******** 2021-10-08T19:12:12.593 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-10-08T19:12:12.595 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-10-08T19:12:12.701 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-10-08T19:12:12.703 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "secontext": "system_u:object_r:etc_t:s0", "size": 2334, "state": "file", "uid": 0} 2021-10-08T19:12:12.731 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:12 +0000 (0:00:00.364) 0:04:25.650 ******** 2021-10-08T19:12:12.796 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-10-08T19:12:12.798 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-10-08T19:12:12.825 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:12 +0000 (0:00:00.094) 0:04:25.744 ******** 2021-10-08T19:12:13.327 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** ok: [smithi117.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "secontext": "system_u:object_r:cert_t:s0", "size": 2334, "state": "file", "uid": 0} 2021-10-08T19:12:13.774 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "secontext": "system_u:object_r:etc_t:s0", "size": 2334, "state": "file", "uid": 0} 2021-10-08T19:12:13.798 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:13 +0000 (0:00:00.973) 0:04:26.717 ******** 2021-10-08T19:12:13.988 INFO:teuthology.task.ansible.out: TASK [container-host : Ensure git is installed] ******************************** ok: [smithi097.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-10-08T19:12:14.013 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:14 +0000 (0:00:00.214) 0:04:26.932 ******** 2021-10-08T19:12:15.085 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-10-08T19:12:15.114 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:15 +0000 (0:00:01.100) 0:04:28.032 ******** 2021-10-08T19:12:16.510 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-10-08T19:12:16.513 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-l7ytm407-build\nRequirement already up-to-date: toml in /usr/local/lib/python3.6/site-packages (from registries-conf-ctl==1.0)\nRequirement already up-to-date: docopt in /usr/local/lib/python3.6/site-packages (from registries-conf-ctl==1.0)\nInstalling collected packages: registries-conf-ctl\n Found existing installation: registries-conf-ctl 1.0\n Uninstalling registries-conf-ctl-1.0:\n Successfully uninstalled registries-conf-ctl-1.0\n Running setup.py install for registries-conf-ctl: started\n Running setup.py install for registries-conf-ctl: finished with status 'done'\nSuccessfully installed registries-conf-ctl-1.0\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-l7ytm407-build", "Requirement already up-to-date: toml in /usr/local/lib/python3.6/site-packages (from registries-conf-ctl==1.0)", "Requirement already up-to-date: docopt in /usr/local/lib/python3.6/site-packages (from registries-conf-ctl==1.0)", "Installing collected packages: registries-conf-ctl", " Found existing installation: registries-conf-ctl 1.0", " Uninstalling registries-conf-ctl-1.0:", " Successfully uninstalled registries-conf-ctl-1.0", " Running setup.py in 2021-10-08T19:12:16.515 INFO:teuthology.task.ansible.out:stall for registries-conf-ctl: started", " Running setup.py install for registries-conf-ctl: finished with status 'done'", "Successfully installed registries-conf-ctl-1.0"], "version": null, "virtualenv": null} 2021-10-08T19:12:16.534 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:16 +0000 (0:00:01.420) 0:04:29.453 ******** 2021-10-08T19:12:16.579 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:16.602 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:16 +0000 (0:00:00.067) 0:04:29.521 ******** 2021-10-08T19:12:16.640 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/containers/registries.conf if necessary] **** 2021-10-08T19:12:16.641 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:16.663 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:16 +0000 (0:00:00.060) 0:04:29.581 ******** 2021-10-08T19:12:17.029 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-10-08T19:12:17.030 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.163634", "end": "2021-10-08 19:12:17.004543", "rc": 0, "start": "2021-10-08 19:12:16.840909", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:12:17.052 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:17 +0000 (0:00:00.389) 0:04:29.971 ******** 2021-10-08T19:12:17.081 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* 2021-10-08T19:12:17.083 INFO:teuthology.task.ansible.out:skipping: [smithi097.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:17.621 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-6hjw1ong-build\nRequirement already up-to-date: toml in /usr/local/lib/python3.6/site-packages (from registries-conf-ctl==1.0)\nRequirement already up-to-date: docopt in /usr/local/lib/python3.6/site-packages (from registries-conf-ctl==1.0)\nInstalling collected packages: registries-conf-ctl\n Found existing installation: registries-conf-ctl 1.0\n Uninstalling registries-conf-ctl-1.0:\n Successfully uninstalled registries-conf-ctl-1.0\n Running setup.py install for registries-conf-ctl: started\n Running setup.py install for registries-conf-ctl: finished with status 'done'\nSuccessfully installed registries-conf-ctl-1.0\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-6hjw1ong-build", "Requirement already up-to-date: toml in /usr/local/lib/python3.6/site-packages (from registries-conf-ctl==1.0)", "Requirement already up-to-date: docopt in /usr/local/lib/python3.6/site-packages (from registries-conf-ctl==1.0)", "Installing collected packages: registries-conf-ctl", " Found existing installation: registries-conf-ctl 1.0", " Uninstalling registries-conf-ctl-1.0 2021-10-08T19:12:17.623 INFO:teuthology.task.ansible.out::", " Successfully uninstalled registries-conf-ctl-1.0", " Running setup.py install for registries-conf-ctl: started", " Running setup.py install for registries-conf-ctl: finished with status 'done'", "Successfully installed registries-conf-ctl-1.0"], "version": null, "virtualenv": null} 2021-10-08T19:12:17.642 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:17 +0000 (0:00:00.589) 0:04:30.561 ******** 2021-10-08T19:12:17.684 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-10-08T19:12:17.685 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:17.707 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:17 +0000 (0:00:00.064) 0:04:30.626 ******** 2021-10-08T19:12:17.734 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/containers/registries.conf if necessary] **** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:17.760 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:17 +0000 (0:00:00.053) 0:04:30.679 ******** 2021-10-08T19:12:18.116 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-10-08T19:12:18.118 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.156025", "end": "2021-10-08 19:12:18.096993", "rc": 0, "start": "2021-10-08 19:12:17.940968", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:12:18.138 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:18 +0000 (0:00:00.377) 0:04:31.057 ******** 2021-10-08T19:12:18.176 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* 2021-10-08T19:12:18.178 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:18.254 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2021-10-08T19:12:18.256 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2021-10-08T19:12:18.258 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched 2021-10-08T19:12:18.260 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-10-08T19:12:18.274 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* Friday 08 October 2021 19:12:18 +0000 (0:00:00.136) 0:04:31.194 ******** 2021-10-08T19:12:18.920 INFO:teuthology.task.ansible.out:ok: [smithi097.front.sepia.ceph.com] 2021-10-08T19:12:18.940 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] 2021-10-08T19:12:18.957 INFO:teuthology.task.ansible.out: TASK [Touch /ceph-qa-ready] **************************************************** Friday 08 October 2021 19:12:18 +0000 (0:00:00.682) 0:04:31.876 ******** 2021-10-08T19:12:19.160 INFO:teuthology.task.ansible.out:changed: [smithi097.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2021-10-08T19:12:19.184 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2021-10-08T19:12:19.187 INFO:teuthology.task.ansible.out: PLAY RECAP ********************************************************************* smithi097.front.sepia.ceph.com : ok=132 changed=40 unreachable=0 failed=0 skipped=188 rescued=0 ignored=3 smithi117.front.sepia.ceph.com : ok=132 changed=40 unreachable=0 failed=0 skipped=188 rescued=0 ignored=3 Friday 08 October 2021 19:12:19 +0000 (0:00:00.228) 0:04:32.104 ******** =============================================================================== common : nrpe - Ensure SELinux policy is up to date -------------------- 36.92s Create all admin users with sudo access. ------------------------------- 34.98s users : Update authorized_keys using the keys repo --------------------- 31.64s Remove revoked users --------------------------------------------------- 17.35s common : nrpe - Remove SELinux policy package -------------------------- 14.81s common : nrpe - Load SELinux policy package ---------------------------- 14.80s testnode : Zap all non-root disks --------------------------------------- 7.82s testnode : Install packages --------------------------------------------- 6.79s container-host : Install container packages ----------------------------- 4.55s testnode : Ensure ceph packages are not present. ------------------------ 3.82s common : Install Kerberos Packages (RedHat) ----------------------------- 3.64s testnode : Ensure ceph dependency packages are not present. ------------- 2.40s testnode : Rebuild rpmdb ------------------------------------------------ 2.40s testnode : Blow away lingering OSD data and FSIDs ----------------------- 1.90s testnode : Create logical volume(s) ------------------------------------- 1.87s testnode : Configure local mirrorlists ---------------------------------- 1.76s testnode : Configure version specific repos in /etc/yum.repos.d/ -------- 1.71s Gathering Facts --------------------------------------------------------- 1.55s users : Update authorized_keys for each user w 2021-10-08T19:12:19.189 INFO:teuthology.task.ansible.out:ith literal keys ---------- 1.42s container-host : Install registries-conf-ctl ---------------------------- 1.42s 2021-10-08T19:12:19.590 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi097.front.sepia.ceph.com'), Remote(name='ubuntu@smithi117.front.sepia.ceph.com')] 2021-10-08T19:12:19.592 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2021-10-08T19:12:19.594 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-08T19:12:19.669 DEBUG:teuthology.orchestra.run.smithi097:> true 2021-10-08T19:12:19.743 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2021-10-08T19:12:19.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-08T19:12:19.812 DEBUG:teuthology.orchestra.run.smithi117:> true 2021-10-08T19:12:19.892 INFO:teuthology.run_tasks:Running task clock... 2021-10-08T19:12:19.904 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2021-10-08T19:12:19.904 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-10-08T19:12:19.906 DEBUG:teuthology.orchestra.run.smithi097:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-10-08T19:12:19.937 INFO:teuthology.orchestra.run.smithi097.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2021-10-08T19:12:19.951 INFO:teuthology.orchestra.run.smithi097.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2021-10-08T19:12:19.984 INFO:teuthology.orchestra.run.smithi097.stderr:sudo: ntpd: command not found 2021-10-08T19:12:19.992 INFO:teuthology.orchestra.run.smithi097.stdout:506 Cannot talk to daemon 2021-10-08T19:12:20.006 INFO:teuthology.orchestra.run.smithi097.stderr:Failed to start ntp.service: Unit ntp.service not found. 2021-10-08T19:12:20.018 INFO:teuthology.orchestra.run.smithi097.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2021-10-08T19:12:20.082 INFO:teuthology.orchestra.run.smithi097.stderr:bash: ntpq: command not found 2021-10-08T19:12:20.087 INFO:teuthology.orchestra.run.smithi097.stdout:210 Number of sources = 4 2021-10-08T19:12:20.088 INFO:teuthology.orchestra.run.smithi097.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2021-10-08T19:12:20.088 INFO:teuthology.orchestra.run.smithi097.stdout:=============================================================================== 2021-10-08T19:12:20.088 INFO:teuthology.orchestra.run.smithi097.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-10-08T19:12:20.088 INFO:teuthology.orchestra.run.smithi097.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-10-08T19:12:20.089 INFO:teuthology.orchestra.run.smithi097.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-10-08T19:12:20.089 INFO:teuthology.orchestra.run.smithi097.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-10-08T19:12:20.089 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-10-08T19:12:20.090 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-10-08T19:12:20.120 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2021-10-08T19:12:20.134 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2021-10-08T19:12:20.183 INFO:teuthology.orchestra.run.smithi117.stderr:sudo: ntpd: command not found 2021-10-08T19:12:20.192 INFO:teuthology.orchestra.run.smithi117.stdout:506 Cannot talk to daemon 2021-10-08T19:12:20.205 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to start ntp.service: Unit ntp.service not found. 2021-10-08T19:12:20.218 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2021-10-08T19:12:20.278 INFO:teuthology.orchestra.run.smithi117.stderr:bash: ntpq: command not found 2021-10-08T19:12:20.281 INFO:teuthology.orchestra.run.smithi117.stdout:210 Number of sources = 4 2021-10-08T19:12:20.281 INFO:teuthology.orchestra.run.smithi117.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2021-10-08T19:12:20.281 INFO:teuthology.orchestra.run.smithi117.stdout:=============================================================================== 2021-10-08T19:12:20.282 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-10-08T19:12:20.282 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-10-08T19:12:20.282 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-10-08T19:12:20.282 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-10-08T19:12:20.283 INFO:teuthology.run_tasks:Running task pexec... 2021-10-08T19:12:20.294 INFO:teuthology.task.pexec:Executing custom commands... 2021-10-08T19:12:20.295 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi097.front.sepia.ceph.com 2021-10-08T19:12:20.295 DEBUG:teuthology.orchestra.run.smithi097:> TESTDIR=/home/ubuntu/cephtest bash -s 2021-10-08T19:12:20.296 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi117.front.sepia.ceph.com 2021-10-08T19:12:20.297 DEBUG:teuthology.orchestra.run.smithi117:> TESTDIR=/home/ubuntu/cephtest bash -s 2021-10-08T19:12:20.799 INFO:teuthology.orchestra.run.smithi097.stdout:Last metadata expiration check: 0:01:05 ago on Fri 08 Oct 2021 07:11:15 PM UTC. 2021-10-08T19:12:20.823 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:01:05 ago on Fri 08 Oct 2021 07:11:15 PM UTC. 2021-10-08T19:12:21.501 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2021-10-08T19:12:21.502 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2021-10-08T19:12:21.502 INFO:teuthology.orchestra.run.smithi097.stdout: Package Architecture Version Repository Size 2021-10-08T19:12:21.502 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2021-10-08T19:12:21.502 INFO:teuthology.orchestra.run.smithi097.stdout:Resetting modules: 2021-10-08T19:12:21.503 INFO:teuthology.orchestra.run.smithi097.stdout: container-tools 2021-10-08T19:12:21.503 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:12:21.503 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction Summary 2021-10-08T19:12:21.503 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2021-10-08T19:12:21.503 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:12:21.522 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2021-10-08T19:12:21.523 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2021-10-08T19:12:21.523 INFO:teuthology.orchestra.run.smithi117.stdout: Package Architecture Version Repository Size 2021-10-08T19:12:21.523 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2021-10-08T19:12:21.523 INFO:teuthology.orchestra.run.smithi117.stdout:Resetting modules: 2021-10-08T19:12:21.524 INFO:teuthology.orchestra.run.smithi117.stdout: container-tools 2021-10-08T19:12:21.524 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:12:21.524 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2021-10-08T19:12:21.524 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2021-10-08T19:12:21.524 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:12:21.711 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2021-10-08T19:12:21.737 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2021-10-08T19:12:22.246 INFO:teuthology.orchestra.run.smithi097.stdout:Last metadata expiration check: 0:01:07 ago on Fri 08 Oct 2021 07:11:15 PM UTC. 2021-10-08T19:12:22.264 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:01:07 ago on Fri 08 Oct 2021 07:11:15 PM UTC. 2021-10-08T19:12:22.967 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2021-10-08T19:12:22.968 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2021-10-08T19:12:22.970 INFO:teuthology.orchestra.run.smithi097.stdout:======================================================================================================== 2021-10-08T19:12:22.970 INFO:teuthology.orchestra.run.smithi097.stdout: Package Arch Version Repository Size 2021-10-08T19:12:22.970 INFO:teuthology.orchestra.run.smithi097.stdout:======================================================================================================== 2021-10-08T19:12:22.970 INFO:teuthology.orchestra.run.smithi097.stdout:Upgrading: 2021-10-08T19:12:22.971 INFO:teuthology.orchestra.run.smithi097.stdout: containernetworking-plugins x86_64 0.9.1-1.module_el8.4.0+786+4668b267 CentOS-AppStream 20 M 2021-10-08T19:12:22.971 INFO:teuthology.orchestra.run.smithi097.stdout: criu x86_64 3.15-1.module_el8.4.0+786+4668b267 CentOS-AppStream 511 k 2021-10-08T19:12:22.971 INFO:teuthology.orchestra.run.smithi097.stdout: libslirp x86_64 4.3.1-1.module_el8.4.0+786+4668b267 CentOS-AppStream 69 k 2021-10-08T19:12:22.971 INFO:teuthology.orchestra.run.smithi097.stdout: slirp4netns x86_64 1.1.8-1.module_el8.4.0+786+4668b267 CentOS-AppStream 51 k 2021-10-08T19:12:22.972 INFO:teuthology.orchestra.run.smithi097.stdout:Installing group/module packages: 2021-10-08T19:12:22.972 INFO:teuthology.orchestra.run.smithi097.stdout: buildah x86_64 1.19.7-1.module_el8.4.0+786+4668b267 CentOS-AppStream 6.9 M 2021-10-08T19:12:22.972 INFO:teuthology.orchestra.run.smithi097.stdout: cockpit-podman noarch 29-2.module_el8.4.0+786+4668b267 CentOS-AppStream 1.1 M 2021-10-08T19:12:22.972 INFO:teuthology.orchestra.run.smithi097.stdout: skopeo x86_64 1:1.2.2-7.module_el8.4.0+786+4668b267 CentOS-AppStream 5.9 M 2021-10-08T19:12:22.973 INFO:teuthology.orchestra.run.smithi097.stdout: toolbox noarch 0.0.8-1.module_el8.4.0+786+4668b267 CentOS-AppStream 16 k 2021-10-08T19:12:22.973 INFO:teuthology.orchestra.run.smithi097.stdout: udica noarch 0.2.4-1.module_el8.4.0+786+4668b267 CentOS-AppStream 51 k 2021-10-08T19:12:22.973 INFO:teuthology.orchestra.run.smithi097.stdout:Downgrading: 2021-10-08T19:12:22.973 INFO:teuthology.orchestra.run.smithi097.stdout: conmon x86_64 2:2.0.26-1.module_el8.4.0+786+4668b267 CentOS-AppStream 51 k 2021-10-08T19:12:22.973 INFO:teuthology.orchestra.run.smithi097.stdout: container-selinux noarch 2:2.158.0-1.module_el8.4.0+786+4668b267 CentOS-AppStream 51 k 2021-10-08T19:12:22.974 INFO:teuthology.orchestra.run.smithi097.stdout: containers-common x86_64 1:1.2.2-7.module_el8.4.0+786+4668b267 CentOS-AppStream 97 k 2021-10-08T19:12:22.974 INFO:teuthology.orchestra.run.smithi097.stdout: crun x86_64 0.18-2.module_el8.4.0+786+4668b267 CentOS-AppStream 185 k 2021-10-08T19:12:22.974 INFO:teuthology.orchestra.run.smithi097.stdout: fuse-overlayfs x86_64 1.4.0-2.module_el8.4.0+786+4668b267 CentOS-AppStream 72 k 2021-10-08T19:12:22.974 INFO:teuthology.orchestra.run.smithi097.stdout: podman x86_64 3.0.1-6.module_el8.4.0+786+4668b267 CentOS-AppStream 11 M 2021-10-08T19:12:22.974 INFO:teuthology.orchestra.run.smithi097.stdout: podman-catatonit x86_64 3.0.1-6.module_el8.4.0+786+4668b267 CentOS-AppStream 320 k 2021-10-08T19:12:22.975 INFO:teuthology.orchestra.run.smithi097.stdout: podman-docker noarch 3.0.1-6.module_el8.4.0+786+4668b267 CentOS-AppStream 55 k 2021-10-08T19:12:22.975 INFO:teuthology.orchestra.run.smithi097.stdout: runc x86_64 1.0.0-71.rc92.module_el8.4.0+833+9763146c CentOS-AppStream 3.1 M 2021-10-08T19:12:22.975 INFO:teuthology.orchestra.run.smithi097.stdout:Installing module profiles: 2021-10-08T19:12:22.975 INFO:teuthology.orchestra.run.smithi097.stdout: container-tools/common 2021-10-08T19:12:22.976 INFO:teuthology.orchestra.run.smithi097.stdout:Enabling module streams: 2021-10-08T19:12:22.976 INFO:teuthology.orchestra.run.smithi097.stdout: container-tools 3.0 2021-10-08T19:12:22.976 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:12:22.976 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction Summary 2021-10-08T19:12:22.976 INFO:teuthology.orchestra.run.smithi097.stdout:======================================================================================================== 2021-10-08T19:12:22.977 INFO:teuthology.orchestra.run.smithi097.stdout:Install 5 Packages 2021-10-08T19:12:22.977 INFO:teuthology.orchestra.run.smithi097.stdout:Upgrade 4 Packages 2021-10-08T19:12:22.977 INFO:teuthology.orchestra.run.smithi097.stdout:Downgrade 9 Packages 2021-10-08T19:12:22.977 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:12:22.978 INFO:teuthology.orchestra.run.smithi097.stdout:Total download size: 49 M 2021-10-08T19:12:22.978 INFO:teuthology.orchestra.run.smithi097.stdout:Downloading Packages: 2021-10-08T19:12:22.979 INFO:teuthology.orchestra.run.smithi117.stdout:======================================================================================================== 2021-10-08T19:12:22.979 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2021-10-08T19:12:22.979 INFO:teuthology.orchestra.run.smithi117.stdout:======================================================================================================== 2021-10-08T19:12:22.979 INFO:teuthology.orchestra.run.smithi117.stdout:Upgrading: 2021-10-08T19:12:22.980 INFO:teuthology.orchestra.run.smithi117.stdout: containernetworking-plugins x86_64 0.9.1-1.module_el8.4.0+786+4668b267 CentOS-AppStream 20 M 2021-10-08T19:12:22.980 INFO:teuthology.orchestra.run.smithi117.stdout: criu x86_64 3.15-1.module_el8.4.0+786+4668b267 CentOS-AppStream 511 k 2021-10-08T19:12:22.980 INFO:teuthology.orchestra.run.smithi117.stdout: libslirp x86_64 4.3.1-1.module_el8.4.0+786+4668b267 CentOS-AppStream 69 k 2021-10-08T19:12:22.980 INFO:teuthology.orchestra.run.smithi117.stdout: slirp4netns x86_64 1.1.8-1.module_el8.4.0+786+4668b267 CentOS-AppStream 51 k 2021-10-08T19:12:22.981 INFO:teuthology.orchestra.run.smithi117.stdout:Installing group/module packages: 2021-10-08T19:12:22.981 INFO:teuthology.orchestra.run.smithi117.stdout: buildah x86_64 1.19.7-1.module_el8.4.0+786+4668b267 CentOS-AppStream 6.9 M 2021-10-08T19:12:22.981 INFO:teuthology.orchestra.run.smithi117.stdout: cockpit-podman noarch 29-2.module_el8.4.0+786+4668b267 CentOS-AppStream 1.1 M 2021-10-08T19:12:22.981 INFO:teuthology.orchestra.run.smithi117.stdout: skopeo x86_64 1:1.2.2-7.module_el8.4.0+786+4668b267 CentOS-AppStream 5.9 M 2021-10-08T19:12:22.981 INFO:teuthology.orchestra.run.smithi117.stdout: toolbox noarch 0.0.8-1.module_el8.4.0+786+4668b267 CentOS-AppStream 16 k 2021-10-08T19:12:22.982 INFO:teuthology.orchestra.run.smithi117.stdout: udica noarch 0.2.4-1.module_el8.4.0+786+4668b267 CentOS-AppStream 51 k 2021-10-08T19:12:22.982 INFO:teuthology.orchestra.run.smithi117.stdout:Downgrading: 2021-10-08T19:12:22.983 INFO:teuthology.orchestra.run.smithi117.stdout: conmon x86_64 2:2.0.26-1.module_el8.4.0+786+4668b267 CentOS-AppStream 51 k 2021-10-08T19:12:22.983 INFO:teuthology.orchestra.run.smithi117.stdout: container-selinux noarch 2:2.158.0-1.module_el8.4.0+786+4668b267 CentOS-AppStream 51 k 2021-10-08T19:12:22.983 INFO:teuthology.orchestra.run.smithi117.stdout: containers-common x86_64 1:1.2.2-7.module_el8.4.0+786+4668b267 CentOS-AppStream 97 k 2021-10-08T19:12:22.983 INFO:teuthology.orchestra.run.smithi117.stdout: crun x86_64 0.18-2.module_el8.4.0+786+4668b267 CentOS-AppStream 185 k 2021-10-08T19:12:22.983 INFO:teuthology.orchestra.run.smithi117.stdout: fuse-overlayfs x86_64 1.4.0-2.module_el8.4.0+786+4668b267 CentOS-AppStream 72 k 2021-10-08T19:12:22.984 INFO:teuthology.orchestra.run.smithi117.stdout: podman x86_64 3.0.1-6.module_el8.4.0+786+4668b267 CentOS-AppStream 11 M 2021-10-08T19:12:22.984 INFO:teuthology.orchestra.run.smithi117.stdout: podman-catatonit x86_64 3.0.1-6.module_el8.4.0+786+4668b267 CentOS-AppStream 320 k 2021-10-08T19:12:22.984 INFO:teuthology.orchestra.run.smithi117.stdout: podman-docker noarch 3.0.1-6.module_el8.4.0+786+4668b267 CentOS-AppStream 55 k 2021-10-08T19:12:22.984 INFO:teuthology.orchestra.run.smithi117.stdout: runc x86_64 1.0.0-71.rc92.module_el8.4.0+833+9763146c CentOS-AppStream 3.1 M 2021-10-08T19:12:22.985 INFO:teuthology.orchestra.run.smithi117.stdout:Installing module profiles: 2021-10-08T19:12:22.985 INFO:teuthology.orchestra.run.smithi117.stdout: container-tools/common 2021-10-08T19:12:22.985 INFO:teuthology.orchestra.run.smithi117.stdout:Enabling module streams: 2021-10-08T19:12:22.985 INFO:teuthology.orchestra.run.smithi117.stdout: container-tools 3.0 2021-10-08T19:12:22.985 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:12:22.986 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2021-10-08T19:12:22.986 INFO:teuthology.orchestra.run.smithi117.stdout:======================================================================================================== 2021-10-08T19:12:22.986 INFO:teuthology.orchestra.run.smithi117.stdout:Install 5 Packages 2021-10-08T19:12:22.986 INFO:teuthology.orchestra.run.smithi117.stdout:Upgrade 4 Packages 2021-10-08T19:12:22.986 INFO:teuthology.orchestra.run.smithi117.stdout:Downgrade 9 Packages 2021-10-08T19:12:22.987 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:12:22.987 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 49 M 2021-10-08T19:12:22.987 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2021-10-08T19:12:23.009 INFO:teuthology.orchestra.run.smithi097.stdout:(1/18): container-selinux-2.158.0-1.module_el8. 1.4 MB/s | 51 kB 00:00 2021-10-08T19:12:23.010 INFO:teuthology.orchestra.run.smithi117.stdout:(1/18): conmon-2.0.26-1.module_el8.4.0+786+4668 1.4 MB/s | 51 kB 00:00 2021-10-08T19:12:23.011 INFO:teuthology.orchestra.run.smithi097.stdout:(2/18): conmon-2.0.26-1.module_el8.4.0+786+4668 1.3 MB/s | 51 kB 00:00 2021-10-08T19:12:23.013 INFO:teuthology.orchestra.run.smithi117.stdout:(2/18): container-selinux-2.158.0-1.module_el8. 1.3 MB/s | 51 kB 00:00 2021-10-08T19:12:23.014 INFO:teuthology.orchestra.run.smithi097.stdout:(3/18): fuse-overlayfs-1.4.0-2.module_el8.4.0+7 25 MB/s | 72 kB 00:00 2021-10-08T19:12:23.015 INFO:teuthology.orchestra.run.smithi117.stdout:(3/18): crun-0.18-2.module_el8.4.0+786+4668b267 37 MB/s | 185 kB 00:00 2021-10-08T19:12:23.016 INFO:teuthology.orchestra.run.smithi097.stdout:(4/18): crun-0.18-2.module_el8.4.0+786+4668b267 28 MB/s | 185 kB 00:00 2021-10-08T19:12:23.016 INFO:teuthology.orchestra.run.smithi117.stdout:(4/18): fuse-overlayfs-1.4.0-2.module_el8.4.0+7 23 MB/s | 72 kB 00:00 2021-10-08T19:12:23.026 INFO:teuthology.orchestra.run.smithi097.stdout:(5/18): containers-common-1.2.2-7.module_el8.4. 1.8 MB/s | 97 kB 00:00 2021-10-08T19:12:23.030 INFO:teuthology.orchestra.run.smithi117.stdout:(5/18): containers-common-1.2.2-7.module_el8.4. 1.7 MB/s | 97 kB 00:00 2021-10-08T19:12:23.031 INFO:teuthology.orchestra.run.smithi097.stdout:(6/18): podman-docker-3.0.1-6.module_el8.4.0+78 11 MB/s | 55 kB 00:00 2021-10-08T19:12:23.033 INFO:teuthology.orchestra.run.smithi097.stdout:(7/18): podman-catatonit-3.0.1-6.module_el8.4.0 18 MB/s | 320 kB 00:00 2021-10-08T19:12:23.037 INFO:teuthology.orchestra.run.smithi117.stdout:(6/18): podman-docker-3.0.1-6.module_el8.4.0+78 8.2 MB/s | 55 kB 00:00 2021-10-08T19:12:23.038 INFO:teuthology.orchestra.run.smithi117.stdout:(7/18): podman-catatonit-3.0.1-6.module_el8.4.0 15 MB/s | 320 kB 00:00 2021-10-08T19:12:23.276 INFO:teuthology.orchestra.run.smithi097.stdout:(8/18): runc-1.0.0-71.rc92.module_el8.4.0+833+9 13 MB/s | 3.1 MB 00:00 2021-10-08T19:12:23.369 INFO:teuthology.orchestra.run.smithi097.stdout:(9/18): cockpit-podman-29-2.module_el8.4.0+786+ 12 MB/s | 1.1 MB 00:00 2021-10-08T19:12:23.390 INFO:teuthology.orchestra.run.smithi117.stdout:(8/18): runc-1.0.0-71.rc92.module_el8.4.0+833+9 8.7 MB/s | 3.1 MB 00:00 2021-10-08T19:12:23.421 INFO:teuthology.orchestra.run.smithi097.stdout:(10/18): podman-3.0.1-6.module_el8.4.0+786+4668 28 MB/s | 11 MB 00:00 2021-10-08T19:12:23.426 INFO:teuthology.orchestra.run.smithi097.stdout:(11/18): toolbox-0.0.8-1.module_el8.4.0+786+466 3.1 MB/s | 16 kB 00:00 2021-10-08T19:12:23.428 INFO:teuthology.orchestra.run.smithi117.stdout:(9/18): podman-3.0.1-6.module_el8.4.0+786+4668b 27 MB/s | 11 MB 00:00 2021-10-08T19:12:23.432 INFO:teuthology.orchestra.run.smithi097.stdout:(12/18): udica-0.2.4-1.module_el8.4.0+786+4668b 9.7 MB/s | 51 kB 00:00 2021-10-08T19:12:23.471 INFO:teuthology.orchestra.run.smithi097.stdout:(13/18): buildah-1.19.7-1.module_el8.4.0+786+46 16 MB/s | 6.9 MB 00:00 2021-10-08T19:12:23.487 INFO:teuthology.orchestra.run.smithi117.stdout:(10/18): buildah-1.19.7-1.module_el8.4.0+786+46 15 MB/s | 6.9 MB 00:00 2021-10-08T19:12:23.495 INFO:teuthology.orchestra.run.smithi097.stdout:(14/18): criu-3.15-1.module_el8.4.0+786+4668b26 20 MB/s | 511 kB 00:00 2021-10-08T19:12:23.503 INFO:teuthology.orchestra.run.smithi117.stdout:(11/18): toolbox-0.0.8-1.module_el8.4.0+786+466 1.0 MB/s | 16 kB 00:00 2021-10-08T19:12:23.510 INFO:teuthology.orchestra.run.smithi097.stdout:(15/18): libslirp-4.3.1-1.module_el8.4.0+786+46 4.6 MB/s | 69 kB 00:00 2021-10-08T19:12:23.518 INFO:teuthology.orchestra.run.smithi117.stdout:(12/18): udica-0.2.4-1.module_el8.4.0+786+4668b 3.4 MB/s | 51 kB 00:00 2021-10-08T19:12:23.525 INFO:teuthology.orchestra.run.smithi097.stdout:(16/18): slirp4netns-1.1.8-1.module_el8.4.0+786 3.3 MB/s | 51 kB 00:00 2021-10-08T19:12:23.528 INFO:teuthology.orchestra.run.smithi117.stdout:(13/18): cockpit-podman-29-2.module_el8.4.0+786 7.7 MB/s | 1.1 MB 00:00 2021-10-08T19:12:23.584 INFO:teuthology.orchestra.run.smithi117.stdout:(14/18): criu-3.15-1.module_el8.4.0+786+4668b26 9.0 MB/s | 511 kB 00:00 2021-10-08T19:12:23.604 INFO:teuthology.orchestra.run.smithi117.stdout:(15/18): libslirp-4.3.1-1.module_el8.4.0+786+46 3.3 MB/s | 69 kB 00:00 2021-10-08T19:12:23.634 INFO:teuthology.orchestra.run.smithi117.stdout:(16/18): skopeo-1.2.2-7.module_el8.4.0+786+4668 29 MB/s | 5.9 MB 00:00 2021-10-08T19:12:23.634 INFO:teuthology.orchestra.run.smithi117.stdout:(17/18): slirp4netns-1.1.8-1.module_el8.4.0+786 1.7 MB/s | 51 kB 00:00 2021-10-08T19:12:23.738 INFO:teuthology.orchestra.run.smithi097.stdout:(17/18): skopeo-1.2.2-7.module_el8.4.0+786+4668 16 MB/s | 5.9 MB 00:00 2021-10-08T19:12:23.970 INFO:teuthology.orchestra.run.smithi097.stdout:(18/18): containernetworking-plugins-0.9.1-1.mo 37 MB/s | 20 MB 00:00 2021-10-08T19:12:23.973 INFO:teuthology.orchestra.run.smithi097.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:12:23.973 INFO:teuthology.orchestra.run.smithi097.stdout:Total 49 MB/s | 49 MB 00:01 2021-10-08T19:12:23.987 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction check 2021-10-08T19:12:24.029 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction check succeeded. 2021-10-08T19:12:24.030 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction test 2021-10-08T19:12:24.089 INFO:teuthology.orchestra.run.smithi117.stdout:(18/18): containernetworking-plugins-0.9.1-1.mo 34 MB/s | 20 MB 00:00 2021-10-08T19:12:24.092 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:12:24.093 INFO:teuthology.orchestra.run.smithi117.stdout:Total 44 MB/s | 49 MB 00:01 2021-10-08T19:12:24.107 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2021-10-08T19:12:24.149 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2021-10-08T19:12:24.150 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2021-10-08T19:12:24.589 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction test succeeded. 2021-10-08T19:12:24.591 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction 2021-10-08T19:12:24.665 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2021-10-08T19:12:24.668 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2021-10-08T19:12:25.800 INFO:teuthology.orchestra.run.smithi097.stdout: Preparing : 1/1 2021-10-08T19:12:25.840 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: fuse-overlayfs-1.4.0-2.module_el8.4.0+786+4668b267.x 1/1 2021-10-08T19:12:25.923 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2021-10-08T19:12:25.967 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: fuse-overlayfs-1.4.0-2.module_el8.4.0+786+4668b267.x 1/1 2021-10-08T19:12:25.983 INFO:teuthology.orchestra.run.smithi097.stdout: Downgrading : fuse-overlayfs-1.4.0-2.module_el8.4.0+786+4668b267 1/31 2021-10-08T19:12:25.991 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: fuse-overlayfs-1.4.0-2.module_el8.4.0+786+4668b267 1/31 2021-10-08T19:12:26.008 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: container-selinux-2:2.158.0-1.module_el8.4.0+786+4 2/31 2021-10-08T19:12:26.116 INFO:teuthology.orchestra.run.smithi117.stdout: Downgrading : fuse-overlayfs-1.4.0-2.module_el8.4.0+786+4668b267 1/31 2021-10-08T19:12:26.124 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: fuse-overlayfs-1.4.0-2.module_el8.4.0+786+4668b267 1/31 2021-10-08T19:12:26.144 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: container-selinux-2:2.158.0-1.module_el8.4.0+786+4 2/31 2021-10-08T19:12:26.228 INFO:teuthology.orchestra.run.smithi097.stdout: Downgrading : container-selinux-2:2.158.0-1.module_el8.4.0+786+4 2/31 2021-10-08T19:12:26.314 INFO:teuthology.orchestra.run.smithi117.stdout: Downgrading : container-selinux-2:2.158.0-1.module_el8.4.0+786+4 2/31 2021-10-08T19:12:41.198 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: container-selinux-2:2.158.0-1.module_el8.4.0+786+4 2/31 2021-10-08T19:12:41.244 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: container-selinux-2:2.158.0-1.module_el8.4.0+786+4 2/31 2021-10-08T19:12:41.396 INFO:teuthology.orchestra.run.smithi097.stdout: Upgrading : libslirp-4.3.1-1.module_el8.4.0+786+4668b267.x86_6 3/31 2021-10-08T19:12:41.399 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : libslirp-4.3.1-1.module_el8.4.0+786+4668b267.x86_6 3/31 2021-10-08T19:12:41.554 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : slirp4netns-1.1.8-1.module_el8.4.0+786+4668b267.x8 4/31 2021-10-08T19:12:41.569 INFO:teuthology.orchestra.run.smithi097.stdout: Upgrading : slirp4netns-1.1.8-1.module_el8.4.0+786+4668b267.x8 4/31 2021-10-08T19:12:41.780 INFO:teuthology.orchestra.run.smithi097.stdout: Downgrading : containers-common-1:1.2.2-7.module_el8.4.0+786+466 5/31 2021-10-08T19:12:41.785 INFO:teuthology.orchestra.run.smithi117.stdout: Downgrading : containers-common-1:1.2.2-7.module_el8.4.0+786+466 5/31 2021-10-08T19:12:42.318 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : criu-3.15-1.module_el8.4.0+786+4668b267.x86_64 6/31 2021-10-08T19:12:42.327 INFO:teuthology.orchestra.run.smithi097.stdout: Upgrading : criu-3.15-1.module_el8.4.0+786+4668b267.x86_64 6/31 2021-10-08T19:12:44.157 INFO:teuthology.orchestra.run.smithi117.stdout: Downgrading : runc-1.0.0-71.rc92.module_el8.4.0+833+9763146c.x86 7/31 2021-10-08T19:12:44.210 INFO:teuthology.orchestra.run.smithi097.stdout: Downgrading : runc-1.0.0-71.rc92.module_el8.4.0+833+9763146c.x86 7/31 2021-10-08T19:12:44.371 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : containernetworking-plugins-0.9.1-1.module_el8.4.0 8/31 2021-10-08T19:12:44.464 INFO:teuthology.orchestra.run.smithi097.stdout: Upgrading : containernetworking-plugins-0.9.1-1.module_el8.4.0 8/31 2021-10-08T19:12:44.528 INFO:teuthology.orchestra.run.smithi117.stdout: Downgrading : crun-0.18-2.module_el8.4.0+786+4668b267.x86_64 9/31 2021-10-08T19:12:44.630 INFO:teuthology.orchestra.run.smithi097.stdout: Downgrading : crun-0.18-2.module_el8.4.0+786+4668b267.x86_64 9/31 2021-10-08T19:12:44.662 INFO:teuthology.orchestra.run.smithi117.stdout: Downgrading : conmon-2:2.0.26-1.module_el8.4.0+786+4668b267.x86_ 10/31 2021-10-08T19:12:44.805 INFO:teuthology.orchestra.run.smithi097.stdout: Downgrading : conmon-2:2.0.26-1.module_el8.4.0+786+4668b267.x86_ 10/31 2021-10-08T19:12:46.094 INFO:teuthology.orchestra.run.smithi117.stdout: Downgrading : podman-catatonit-3.0.1-6.module_el8.4.0+786+4668b2 11/31 2021-10-08T19:12:46.270 INFO:teuthology.orchestra.run.smithi097.stdout: Downgrading : podman-catatonit-3.0.1-6.module_el8.4.0+786+4668b2 11/31 2021-10-08T19:12:46.359 INFO:teuthology.orchestra.run.smithi117.stdout: Downgrading : podman-3.0.1-6.module_el8.4.0+786+4668b267.x86_64 12/31 2021-10-08T19:12:46.540 INFO:teuthology.orchestra.run.smithi097.stdout: Downgrading : podman-3.0.1-6.module_el8.4.0+786+4668b267.x86_64 12/31 2021-10-08T19:12:46.601 INFO:teuthology.orchestra.run.smithi117.stdout: Downgrading : podman-docker-3.0.1-6.module_el8.4.0+786+4668b267. 13/31 2021-10-08T19:12:46.736 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : cockpit-podman-29-2.module_el8.4.0+786+4668b267.no 14/31 2021-10-08T19:12:46.813 INFO:teuthology.orchestra.run.smithi097.stdout: Downgrading : podman-docker-3.0.1-6.module_el8.4.0+786+4668b267. 13/31 2021-10-08T19:12:46.978 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : cockpit-podman-29-2.module_el8.4.0+786+4668b267.no 14/31 2021-10-08T19:12:47.463 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : toolbox-0.0.8-1.module_el8.4.0+786+4668b267.noarch 15/31 2021-10-08T19:12:47.743 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : toolbox-0.0.8-1.module_el8.4.0+786+4668b267.noarch 15/31 2021-10-08T19:12:48.126 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : buildah-1.19.7-1.module_el8.4.0+786+4668b267.x86_6 16/31 2021-10-08T19:12:48.311 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : skopeo-1:1.2.2-7.module_el8.4.0+786+4668b267.x86_6 17/31 2021-10-08T19:12:48.422 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : buildah-1.19.7-1.module_el8.4.0+786+4668b267.x86_6 16/31 2021-10-08T19:12:48.487 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : udica-0.2.4-1.module_el8.4.0+786+4668b267.noarch 18/31 2021-10-08T19:12:48.583 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : podman-docker-3.2.3-0.11.module_el8.4.0+942+d25aad 19/31 2021-10-08T19:12:48.630 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : skopeo-1:1.2.2-7.module_el8.4.0+786+4668b267.x86_6 17/31 2021-10-08T19:12:48.773 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : podman-3.2.3-0.11.module_el8.4.0+942+d25aada8.x86_ 20/31 2021-10-08T19:12:48.822 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : udica-0.2.4-1.module_el8.4.0+786+4668b267.noarch 18/31 2021-10-08T19:12:48.930 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : containers-common-1:1.2.2-10.module_el8.4.0+830+80 21/31 2021-10-08T19:12:48.943 INFO:teuthology.orchestra.run.smithi097.stdout: Cleanup : podman-docker-3.2.3-0.11.module_el8.4.0+942+d25aad 19/31 2021-10-08T19:12:49.105 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : slirp4netns-1.1.8-1.module_el8.4.0+641+6116a774.x8 22/31 2021-10-08T19:12:49.148 INFO:teuthology.orchestra.run.smithi097.stdout: Cleanup : podman-3.2.3-0.11.module_el8.4.0+942+d25aada8.x86_ 20/31 2021-10-08T19:12:49.262 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : runc-1.0.0-73.rc93.module_el8.4.0+830+8027e1c4.x86 23/31 2021-10-08T19:12:49.262 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : container-selinux-2:2.162.0-1.module_el8.4.0+830+8 24/31 2021-10-08T19:12:49.356 INFO:teuthology.orchestra.run.smithi097.stdout: Cleanup : containers-common-1:1.2.2-10.module_el8.4.0+830+80 21/31 2021-10-08T19:12:49.587 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: container-selinux-2:2.162.0-1.module_el8.4.0+830+8 24/31 2021-10-08T19:12:49.906 INFO:teuthology.orchestra.run.smithi097.stdout: Cleanup : slirp4netns-1.1.8-1.module_el8.4.0+641+6116a774.x8 22/31 2021-10-08T19:12:50.046 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : podman-catatonit-3.2.3-0.11.module_el8.4.0+942+d25 25/31 2021-10-08T19:12:50.064 INFO:teuthology.orchestra.run.smithi097.stdout: Cleanup : runc-1.0.0-73.rc93.module_el8.4.0+830+8027e1c4.x86 23/31 2021-10-08T19:12:50.065 INFO:teuthology.orchestra.run.smithi097.stdout: Cleanup : container-selinux-2:2.162.0-1.module_el8.4.0+830+8 24/31 2021-10-08T19:12:50.264 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : criu-3.15-1.module_el8.4.0+641+6116a774.x86_64 26/31 2021-10-08T19:12:50.265 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: container-selinux-2:2.162.0-1.module_el8.4.0+830+8 24/31 2021-10-08T19:12:50.395 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : libslirp-4.3.1-1.module_el8.4.0+575+63b40ad7.x86_6 27/31 2021-10-08T19:12:50.397 INFO:teuthology.orchestra.run.smithi097.stdout: Cleanup : podman-catatonit-3.2.3-0.11.module_el8.4.0+942+d25 25/31 2021-10-08T19:12:50.562 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : crun-0.18-2.module_el8.4.0+830+8027e1c4.x86_64 28/31 2021-10-08T19:12:50.660 INFO:teuthology.orchestra.run.smithi097.stdout: Cleanup : criu-3.15-1.module_el8.4.0+641+6116a774.x86_64 26/31 2021-10-08T19:12:50.712 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : fuse-overlayfs-1.4.0-3.module_el8.4.0+830+8027e1c4 29/31 2021-10-08T19:12:50.822 INFO:teuthology.orchestra.run.smithi097.stdout: Cleanup : libslirp-4.3.1-1.module_el8.4.0+575+63b40ad7.x86_6 27/31 2021-10-08T19:12:50.857 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : conmon-2:2.0.26-3.module_el8.4.0+830+8027e1c4.x86_ 30/31 2021-10-08T19:12:50.980 INFO:teuthology.orchestra.run.smithi097.stdout: Cleanup : crun-0.18-2.module_el8.4.0+830+8027e1c4.x86_64 28/31 2021-10-08T19:12:51.011 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : containernetworking-plugins-0.9.1-1.module_el8.4.0 31/31 2021-10-08T19:12:51.155 INFO:teuthology.orchestra.run.smithi097.stdout: Cleanup : fuse-overlayfs-1.4.0-3.module_el8.4.0+830+8027e1c4 29/31 2021-10-08T19:12:51.316 INFO:teuthology.orchestra.run.smithi097.stdout: Cleanup : conmon-2:2.0.26-3.module_el8.4.0+830+8027e1c4.x86_ 30/31 2021-10-08T19:12:51.513 INFO:teuthology.orchestra.run.smithi097.stdout: Cleanup : containernetworking-plugins-0.9.1-1.module_el8.4.0 31/31 2021-10-08T19:13:10.289 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: container-selinux-2:2.158.0-1.module_el8.4.0+786+4 31/31 2021-10-08T19:13:10.366 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: container-selinux-2:2.158.0-1.module_el8.4.0+786+4 31/31 2021-10-08T19:13:10.809 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: containernetworking-plugins-0.9.1-1.module_el8.4.0 31/31 2021-10-08T19:13:10.810 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : conmon-2:2.0.26-1.module_el8.4.0+786+4668b267.x86_ 1/31 2021-10-08T19:13:10.810 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : conmon-2:2.0.26-3.module_el8.4.0+830+8027e1c4.x86_ 2/31 2021-10-08T19:13:10.810 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : container-selinux-2:2.158.0-1.module_el8.4.0+786+4 3/31 2021-10-08T19:13:10.811 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : container-selinux-2:2.162.0-1.module_el8.4.0+830+8 4/31 2021-10-08T19:13:10.811 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : containers-common-1:1.2.2-7.module_el8.4.0+786+466 5/31 2021-10-08T19:13:10.811 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : containers-common-1:1.2.2-10.module_el8.4.0+830+80 6/31 2021-10-08T19:13:10.812 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : crun-0.18-2.module_el8.4.0+786+4668b267.x86_64 7/31 2021-10-08T19:13:10.812 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : crun-0.18-2.module_el8.4.0+830+8027e1c4.x86_64 8/31 2021-10-08T19:13:10.812 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : fuse-overlayfs-1.4.0-2.module_el8.4.0+786+4668b267 9/31 2021-10-08T19:13:10.813 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : fuse-overlayfs-1.4.0-3.module_el8.4.0+830+8027e1c4 10/31 2021-10-08T19:13:10.813 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : podman-3.0.1-6.module_el8.4.0+786+4668b267.x86_64 11/31 2021-10-08T19:13:10.813 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : podman-3.2.3-0.11.module_el8.4.0+942+d25aada8.x86_ 12/31 2021-10-08T19:13:10.814 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : podman-catatonit-3.0.1-6.module_el8.4.0+786+4668b2 13/31 2021-10-08T19:13:10.814 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : podman-catatonit-3.2.3-0.11.module_el8.4.0+942+d25 14/31 2021-10-08T19:13:10.814 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : podman-docker-3.0.1-6.module_el8.4.0+786+4668b267. 15/31 2021-10-08T19:13:10.815 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : podman-docker-3.2.3-0.11.module_el8.4.0+942+d25aad 16/31 2021-10-08T19:13:10.815 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : runc-1.0.0-71.rc92.module_el8.4.0+833+9763146c.x86 17/31 2021-10-08T19:13:10.815 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : runc-1.0.0-73.rc93.module_el8.4.0+830+8027e1c4.x86 18/31 2021-10-08T19:13:10.816 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : buildah-1.19.7-1.module_el8.4.0+786+4668b267.x86_6 19/31 2021-10-08T19:13:10.816 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : cockpit-podman-29-2.module_el8.4.0+786+4668b267.no 20/31 2021-10-08T19:13:10.816 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : skopeo-1:1.2.2-7.module_el8.4.0+786+4668b267.x86_6 21/31 2021-10-08T19:13:10.817 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : toolbox-0.0.8-1.module_el8.4.0+786+4668b267.noarch 22/31 2021-10-08T19:13:10.817 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : udica-0.2.4-1.module_el8.4.0+786+4668b267.noarch 23/31 2021-10-08T19:13:10.817 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : containernetworking-plugins-0.9.1-1.module_el8.4.0 24/31 2021-10-08T19:13:10.818 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : containernetworking-plugins-0.9.1-1.module_el8.4.0 25/31 2021-10-08T19:13:10.818 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : criu-3.15-1.module_el8.4.0+786+4668b267.x86_64 26/31 2021-10-08T19:13:10.818 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : criu-3.15-1.module_el8.4.0+641+6116a774.x86_64 27/31 2021-10-08T19:13:10.819 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libslirp-4.3.1-1.module_el8.4.0+786+4668b267.x86_6 28/31 2021-10-08T19:13:10.819 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libslirp-4.3.1-1.module_el8.4.0+575+63b40ad7.x86_6 29/31 2021-10-08T19:13:10.819 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : slirp4netns-1.1.8-1.module_el8.4.0+786+4668b267.x8 30/31 2021-10-08T19:13:10.925 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: containernetworking-plugins-0.9.1-1.module_el8.4.0 31/31 2021-10-08T19:13:10.926 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : conmon-2:2.0.26-1.module_el8.4.0+786+4668b267.x86_ 1/31 2021-10-08T19:13:10.926 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : conmon-2:2.0.26-3.module_el8.4.0+830+8027e1c4.x86_ 2/31 2021-10-08T19:13:10.926 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : container-selinux-2:2.158.0-1.module_el8.4.0+786+4 3/31 2021-10-08T19:13:10.926 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : container-selinux-2:2.162.0-1.module_el8.4.0+830+8 4/31 2021-10-08T19:13:10.927 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : containers-common-1:1.2.2-7.module_el8.4.0+786+466 5/31 2021-10-08T19:13:10.927 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : containers-common-1:1.2.2-10.module_el8.4.0+830+80 6/31 2021-10-08T19:13:10.927 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : crun-0.18-2.module_el8.4.0+786+4668b267.x86_64 7/31 2021-10-08T19:13:10.927 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : crun-0.18-2.module_el8.4.0+830+8027e1c4.x86_64 8/31 2021-10-08T19:13:10.927 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : fuse-overlayfs-1.4.0-2.module_el8.4.0+786+4668b267 9/31 2021-10-08T19:13:10.928 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : fuse-overlayfs-1.4.0-3.module_el8.4.0+830+8027e1c4 10/31 2021-10-08T19:13:10.928 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : podman-3.0.1-6.module_el8.4.0+786+4668b267.x86_64 11/31 2021-10-08T19:13:10.928 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : podman-3.2.3-0.11.module_el8.4.0+942+d25aada8.x86_ 12/31 2021-10-08T19:13:10.929 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : podman-catatonit-3.0.1-6.module_el8.4.0+786+4668b2 13/31 2021-10-08T19:13:10.929 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : podman-catatonit-3.2.3-0.11.module_el8.4.0+942+d25 14/31 2021-10-08T19:13:10.929 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : podman-docker-3.0.1-6.module_el8.4.0+786+4668b267. 15/31 2021-10-08T19:13:10.929 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : podman-docker-3.2.3-0.11.module_el8.4.0+942+d25aad 16/31 2021-10-08T19:13:10.930 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : runc-1.0.0-71.rc92.module_el8.4.0+833+9763146c.x86 17/31 2021-10-08T19:13:10.930 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : runc-1.0.0-73.rc93.module_el8.4.0+830+8027e1c4.x86 18/31 2021-10-08T19:13:10.930 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : buildah-1.19.7-1.module_el8.4.0+786+4668b267.x86_6 19/31 2021-10-08T19:13:10.930 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : cockpit-podman-29-2.module_el8.4.0+786+4668b267.no 20/31 2021-10-08T19:13:10.930 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : skopeo-1:1.2.2-7.module_el8.4.0+786+4668b267.x86_6 21/31 2021-10-08T19:13:10.931 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : toolbox-0.0.8-1.module_el8.4.0+786+4668b267.noarch 22/31 2021-10-08T19:13:10.931 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : udica-0.2.4-1.module_el8.4.0+786+4668b267.noarch 23/31 2021-10-08T19:13:10.931 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : containernetworking-plugins-0.9.1-1.module_el8.4.0 24/31 2021-10-08T19:13:10.931 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : containernetworking-plugins-0.9.1-1.module_el8.4.0 25/31 2021-10-08T19:13:10.932 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : criu-3.15-1.module_el8.4.0+786+4668b267.x86_64 26/31 2021-10-08T19:13:10.932 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : criu-3.15-1.module_el8.4.0+641+6116a774.x86_64 27/31 2021-10-08T19:13:10.932 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libslirp-4.3.1-1.module_el8.4.0+786+4668b267.x86_6 28/31 2021-10-08T19:13:10.932 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libslirp-4.3.1-1.module_el8.4.0+575+63b40ad7.x86_6 29/31 2021-10-08T19:13:10.932 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : slirp4netns-1.1.8-1.module_el8.4.0+786+4668b267.x8 30/31 2021-10-08T19:13:11.439 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : slirp4netns-1.1.8-1.module_el8.4.0+641+6116a774.x8 31/31 2021-10-08T19:13:11.439 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:13:11.439 INFO:teuthology.orchestra.run.smithi097.stdout:Upgraded: 2021-10-08T19:13:11.440 INFO:teuthology.orchestra.run.smithi097.stdout: containernetworking-plugins-0.9.1-1.module_el8.4.0+786+4668b267.x86_64 2021-10-08T19:13:11.440 INFO:teuthology.orchestra.run.smithi097.stdout: criu-3.15-1.module_el8.4.0+786+4668b267.x86_64 2021-10-08T19:13:11.440 INFO:teuthology.orchestra.run.smithi097.stdout: libslirp-4.3.1-1.module_el8.4.0+786+4668b267.x86_64 2021-10-08T19:13:11.440 INFO:teuthology.orchestra.run.smithi097.stdout: slirp4netns-1.1.8-1.module_el8.4.0+786+4668b267.x86_64 2021-10-08T19:13:11.441 INFO:teuthology.orchestra.run.smithi097.stdout:Downgraded: 2021-10-08T19:13:11.441 INFO:teuthology.orchestra.run.smithi097.stdout: conmon-2:2.0.26-1.module_el8.4.0+786+4668b267.x86_64 2021-10-08T19:13:11.441 INFO:teuthology.orchestra.run.smithi097.stdout: container-selinux-2:2.158.0-1.module_el8.4.0+786+4668b267.noarch 2021-10-08T19:13:11.442 INFO:teuthology.orchestra.run.smithi097.stdout: containers-common-1:1.2.2-7.module_el8.4.0+786+4668b267.x86_64 2021-10-08T19:13:11.442 INFO:teuthology.orchestra.run.smithi097.stdout: crun-0.18-2.module_el8.4.0+786+4668b267.x86_64 2021-10-08T19:13:11.442 INFO:teuthology.orchestra.run.smithi097.stdout: fuse-overlayfs-1.4.0-2.module_el8.4.0+786+4668b267.x86_64 2021-10-08T19:13:11.442 INFO:teuthology.orchestra.run.smithi097.stdout: podman-3.0.1-6.module_el8.4.0+786+4668b267.x86_64 2021-10-08T19:13:11.443 INFO:teuthology.orchestra.run.smithi097.stdout: podman-catatonit-3.0.1-6.module_el8.4.0+786+4668b267.x86_64 2021-10-08T19:13:11.443 INFO:teuthology.orchestra.run.smithi097.stdout: podman-docker-3.0.1-6.module_el8.4.0+786+4668b267.noarch 2021-10-08T19:13:11.443 INFO:teuthology.orchestra.run.smithi097.stdout: runc-1.0.0-71.rc92.module_el8.4.0+833+9763146c.x86_64 2021-10-08T19:13:11.443 INFO:teuthology.orchestra.run.smithi097.stdout:Installed: 2021-10-08T19:13:11.444 INFO:teuthology.orchestra.run.smithi097.stdout: buildah-1.19.7-1.module_el8.4.0+786+4668b267.x86_64 2021-10-08T19:13:11.444 INFO:teuthology.orchestra.run.smithi097.stdout: cockpit-podman-29-2.module_el8.4.0+786+4668b267.noarch 2021-10-08T19:13:11.444 INFO:teuthology.orchestra.run.smithi097.stdout: skopeo-1:1.2.2-7.module_el8.4.0+786+4668b267.x86_64 2021-10-08T19:13:11.444 INFO:teuthology.orchestra.run.smithi097.stdout: toolbox-0.0.8-1.module_el8.4.0+786+4668b267.noarch 2021-10-08T19:13:11.444 INFO:teuthology.orchestra.run.smithi097.stdout: udica-0.2.4-1.module_el8.4.0+786+4668b267.noarch 2021-10-08T19:13:11.445 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:13:11.445 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2021-10-08T19:13:11.610 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : slirp4netns-1.1.8-1.module_el8.4.0+641+6116a774.x8 31/31 2021-10-08T19:13:11.611 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:13:11.611 INFO:teuthology.orchestra.run.smithi117.stdout:Upgraded: 2021-10-08T19:13:11.611 INFO:teuthology.orchestra.run.smithi117.stdout: containernetworking-plugins-0.9.1-1.module_el8.4.0+786+4668b267.x86_64 2021-10-08T19:13:11.611 INFO:teuthology.orchestra.run.smithi117.stdout: criu-3.15-1.module_el8.4.0+786+4668b267.x86_64 2021-10-08T19:13:11.612 INFO:teuthology.orchestra.run.smithi117.stdout: libslirp-4.3.1-1.module_el8.4.0+786+4668b267.x86_64 2021-10-08T19:13:11.612 INFO:teuthology.orchestra.run.smithi117.stdout: slirp4netns-1.1.8-1.module_el8.4.0+786+4668b267.x86_64 2021-10-08T19:13:11.612 INFO:teuthology.orchestra.run.smithi117.stdout:Downgraded: 2021-10-08T19:13:11.613 INFO:teuthology.orchestra.run.smithi117.stdout: conmon-2:2.0.26-1.module_el8.4.0+786+4668b267.x86_64 2021-10-08T19:13:11.613 INFO:teuthology.orchestra.run.smithi117.stdout: container-selinux-2:2.158.0-1.module_el8.4.0+786+4668b267.noarch 2021-10-08T19:13:11.613 INFO:teuthology.orchestra.run.smithi117.stdout: containers-common-1:1.2.2-7.module_el8.4.0+786+4668b267.x86_64 2021-10-08T19:13:11.614 INFO:teuthology.orchestra.run.smithi117.stdout: crun-0.18-2.module_el8.4.0+786+4668b267.x86_64 2021-10-08T19:13:11.614 INFO:teuthology.orchestra.run.smithi117.stdout: fuse-overlayfs-1.4.0-2.module_el8.4.0+786+4668b267.x86_64 2021-10-08T19:13:11.614 INFO:teuthology.orchestra.run.smithi117.stdout: podman-3.0.1-6.module_el8.4.0+786+4668b267.x86_64 2021-10-08T19:13:11.614 INFO:teuthology.orchestra.run.smithi117.stdout: podman-catatonit-3.0.1-6.module_el8.4.0+786+4668b267.x86_64 2021-10-08T19:13:11.614 INFO:teuthology.orchestra.run.smithi117.stdout: podman-docker-3.0.1-6.module_el8.4.0+786+4668b267.noarch 2021-10-08T19:13:11.615 INFO:teuthology.orchestra.run.smithi117.stdout: runc-1.0.0-71.rc92.module_el8.4.0+833+9763146c.x86_64 2021-10-08T19:13:11.615 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2021-10-08T19:13:11.615 INFO:teuthology.orchestra.run.smithi117.stdout: buildah-1.19.7-1.module_el8.4.0+786+4668b267.x86_64 2021-10-08T19:13:11.615 INFO:teuthology.orchestra.run.smithi117.stdout: cockpit-podman-29-2.module_el8.4.0+786+4668b267.noarch 2021-10-08T19:13:11.615 INFO:teuthology.orchestra.run.smithi117.stdout: skopeo-1:1.2.2-7.module_el8.4.0+786+4668b267.x86_64 2021-10-08T19:13:11.616 INFO:teuthology.orchestra.run.smithi117.stdout: toolbox-0.0.8-1.module_el8.4.0+786+4668b267.noarch 2021-10-08T19:13:11.616 INFO:teuthology.orchestra.run.smithi117.stdout: udica-0.2.4-1.module_el8.4.0+786+4668b267.noarch 2021-10-08T19:13:11.616 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:13:11.616 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2021-10-08T19:13:11.701 DEBUG:teuthology.parallel:result is None 2021-10-08T19:13:11.852 DEBUG:teuthology.parallel:result is None 2021-10-08T19:13:11.852 INFO:teuthology.run_tasks:Running task install... 2021-10-08T19:13:11.862 DEBUG:teuthology.task.install:project ceph 2021-10-08T19:13:11.863 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': '103b6cc3554193fcd0852d9c647cef19e99920cf'}} 2021-10-08T19:13:11.863 DEBUG:teuthology.task.install:config {'sha1': '103b6cc3554193fcd0852d9c647cef19e99920cf'} 2021-10-08T19:13:11.863 INFO:teuthology.task.install:Using flavor: basic 2021-10-08T19:13:11.871 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2021-10-08T19:13:11.872 INFO:teuthology.task.install:extra packages: [] 2021-10-08T19:13:11.872 DEBUG:teuthology.orchestra.run.smithi097:> sudo lsb_release -is 2021-10-08T19:13:11.904 INFO:teuthology.orchestra.run.smithi097.stdout:CentOS 2021-10-08T19:13:11.905 DEBUG:teuthology.misc:System to be installed: CentOS 2021-10-08T19:13:11.906 DEBUG:teuthology.orchestra.run.smithi117:> sudo lsb_release -is 2021-10-08T19:13:11.907 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'flavor': 'basic', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '103b6cc3554193fcd0852d9c647cef19e99920cf', 'tag': None, 'wait_for_package': False} 2021-10-08T19:13:11.908 DEBUG:teuthology.orchestra.run.smithi097:> sudo lsb_release -is 2021-10-08T19:13:11.940 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS 2021-10-08T19:13:11.941 DEBUG:teuthology.misc:System to be installed: CentOS 2021-10-08T19:13:11.941 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'flavor': 'basic', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '103b6cc3554193fcd0852d9c647cef19e99920cf', 'tag': None, 'wait_for_package': False} 2021-10-08T19:13:11.942 DEBUG:teuthology.orchestra.run.smithi117:> sudo lsb_release -is 2021-10-08T19:13:11.976 INFO:teuthology.orchestra.run.smithi097.stdout:CentOS 2021-10-08T19:13:11.978 DEBUG:teuthology.misc:System to be installed: CentOS 2021-10-08T19:13:11.979 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=103b6cc3554193fcd0852d9c647cef19e99920cf 2021-10-08T19:13:12.017 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS 2021-10-08T19:13:12.017 DEBUG:teuthology.misc:System to be installed: CentOS 2021-10-08T19:13:12.018 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=103b6cc3554193fcd0852d9c647cef19e99920cf 2021-10-08T19:13:12.151 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/master/103b6cc3554193fcd0852d9c647cef19e99920cf/centos/8/flavors/default/ 2021-10-08T19:13:12.152 INFO:teuthology.task.install.rpm:Package version is 17.0.0-8087.g103b6cc3 2021-10-08T19:13:12.167 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/master/103b6cc3554193fcd0852d9c647cef19e99920cf/centos/8/flavors/default/ 2021-10-08T19:13:12.168 INFO:teuthology.task.install.rpm:Package version is 17.0.0-8087.g103b6cc3 2021-10-08T19:13:12.282 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/master/103b6cc3554193fcd0852d9c647cef19e99920cf/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/master/103b6cc3554193fcd0852d9c647cef19e99920cf/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/master/103b6cc3554193fcd0852d9c647cef19e99920cf/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2021-10-08T19:13:12.282 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2021-10-08T19:13:12.283 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/yum.repos.d/ceph.repo 2021-10-08T19:13:12.287 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/master/103b6cc3554193fcd0852d9c647cef19e99920cf/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/master/103b6cc3554193fcd0852d9c647cef19e99920cf/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/master/103b6cc3554193fcd0852d9c647cef19e99920cf/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2021-10-08T19:13:12.288 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2021-10-08T19:13:12.288 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/yum.repos.d/ceph.repo 2021-10-08T19:13:12.308 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2021-10-08T19:13:12.308 DEBUG:teuthology.orchestra.run.smithi097:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/103b6cc3554193fcd0852d9c647cef19e99920cf/;g' /etc/yum.repos.d/ceph.repo ; fi 2021-10-08T19:13:12.313 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2021-10-08T19:13:12.314 DEBUG:teuthology.orchestra.run.smithi117:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/103b6cc3554193fcd0852d9c647cef19e99920cf/;g' /etc/yum.repos.d/ceph.repo ; fi 2021-10-08T19:13:12.372 DEBUG:teuthology.orchestra.run.smithi097:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2021-10-08T19:13:12.378 DEBUG:teuthology.orchestra.run.smithi117:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2021-10-08T19:13:12.445 DEBUG:teuthology.orchestra.run.smithi097:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2021-10-08T19:13:12.451 DEBUG:teuthology.orchestra.run.smithi117:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2021-10-08T19:13:12.508 INFO:teuthology.orchestra.run.smithi097.stdout:check_obsoletes = 1 2021-10-08T19:13:12.510 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum clean all 2021-10-08T19:13:12.513 INFO:teuthology.orchestra.run.smithi117.stdout:check_obsoletes = 1 2021-10-08T19:13:12.515 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum clean all 2021-10-08T19:13:12.784 INFO:teuthology.orchestra.run.smithi097.stdout:63 files removed 2021-10-08T19:13:12.789 INFO:teuthology.orchestra.run.smithi117.stdout:63 files removed 2021-10-08T19:13:12.813 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum -y install ceph-radosgw 2021-10-08T19:13:12.819 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-radosgw 2021-10-08T19:13:13.445 INFO:teuthology.orchestra.run.smithi097.stdout:ceph packages for x86_64 304 kB/s | 75 kB 00:00 2021-10-08T19:13:13.446 INFO:teuthology.orchestra.run.smithi117.stdout:ceph packages for x86_64 306 kB/s | 75 kB 00:00 2021-10-08T19:13:13.683 INFO:teuthology.orchestra.run.smithi117.stdout:ceph noarch packages 45 kB/s | 9.0 kB 00:00 2021-10-08T19:13:13.683 INFO:teuthology.orchestra.run.smithi097.stdout:ceph noarch packages 44 kB/s | 9.0 kB 00:00 2021-10-08T19:13:13.910 INFO:teuthology.orchestra.run.smithi097.stdout:ceph source packages 7.0 kB/s | 1.4 kB 00:00 2021-10-08T19:13:13.910 INFO:teuthology.orchestra.run.smithi117.stdout:ceph source packages 7.0 kB/s | 1.4 kB 00:00 2021-10-08T19:13:14.162 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS-8 - AppStream 40 MB/s | 9.3 MB 00:00 2021-10-08T19:13:14.211 INFO:teuthology.orchestra.run.smithi097.stdout:CentOS-8 - AppStream 33 MB/s | 9.3 MB 00:00 2021-10-08T19:13:15.767 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS-8 - Base 48 MB/s | 7.5 MB 00:00 2021-10-08T19:13:15.829 INFO:teuthology.orchestra.run.smithi097.stdout:CentOS-8 - Base 42 MB/s | 7.5 MB 00:00 2021-10-08T19:13:16.866 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS-8 - Extras 162 kB/s | 10 kB 00:00 2021-10-08T19:13:16.931 INFO:teuthology.orchestra.run.smithi097.stdout:CentOS-8 - Extras 162 kB/s | 10 kB 00:00 2021-10-08T19:13:17.012 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS-8 - PowerTools 26 MB/s | 2.4 MB 00:00 2021-10-08T19:13:17.094 INFO:teuthology.orchestra.run.smithi097.stdout:CentOS-8 - PowerTools 22 MB/s | 2.4 MB 00:00 2021-10-08T19:13:19.343 INFO:teuthology.orchestra.run.smithi117.stdout:Copr repo for python3-asyncssh owned by ceph 1.8 kB/s | 3.5 kB 00:01 2021-10-08T19:13:19.353 INFO:teuthology.orchestra.run.smithi097.stdout:Copr repo for python3-asyncssh owned by ceph 1.9 kB/s | 3.5 kB 00:01 2021-10-08T19:13:20.137 INFO:teuthology.orchestra.run.smithi117.stdout:Extra Packages for Enterprise Linux 14 MB/s | 10 MB 00:00 2021-10-08T19:13:20.155 INFO:teuthology.orchestra.run.smithi097.stdout:Extra Packages for Enterprise Linux 14 MB/s | 10 MB 00:00 2021-10-08T19:13:22.359 INFO:teuthology.orchestra.run.smithi117.stdout:lab-extras 4.0 MB/s | 24 kB 00:00 2021-10-08T19:13:22.384 INFO:teuthology.orchestra.run.smithi097.stdout:lab-extras 4.7 MB/s | 24 kB 00:00 2021-10-08T19:13:23.940 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2021-10-08T19:13:23.942 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2021-10-08T19:13:23.942 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2021-10-08T19:13:23.943 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2021-10-08T19:13:23.943 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2021-10-08T19:13:23.943 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-radosgw x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 8.9 M 2021-10-08T19:13:23.943 INFO:teuthology.orchestra.run.smithi117.stdout:Upgrading: 2021-10-08T19:13:23.944 INFO:teuthology.orchestra.run.smithi117.stdout: librados2 x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 3.4 M 2021-10-08T19:13:23.944 INFO:teuthology.orchestra.run.smithi117.stdout: librbd1 x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 3.9 M 2021-10-08T19:13:23.944 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2021-10-08T19:13:23.944 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-base x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 5.2 M 2021-10-08T19:13:23.944 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-common x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 20 M 2021-10-08T19:13:23.945 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-selinux x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 24 k 2021-10-08T19:13:23.945 INFO:teuthology.orchestra.run.smithi117.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2021-10-08T19:13:23.945 INFO:teuthology.orchestra.run.smithi117.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2021-10-08T19:13:23.945 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs2 x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 784 k 2021-10-08T19:13:23.945 INFO:teuthology.orchestra.run.smithi117.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2021-10-08T19:13:23.946 INFO:teuthology.orchestra.run.smithi117.stdout: librabbitmq x86_64 0.9.0-3.el8 CentOS-Base 47 k 2021-10-08T19:13:23.946 INFO:teuthology.orchestra.run.smithi117.stdout: libradosstriper1 x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 483 k 2021-10-08T19:13:23.946 INFO:teuthology.orchestra.run.smithi117.stdout: librdkafka x86_64 0.11.4-1.el8 CentOS-AppStream 353 k 2021-10-08T19:13:23.946 INFO:teuthology.orchestra.run.smithi117.stdout: librgw2 x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 3.8 M 2021-10-08T19:13:23.947 INFO:teuthology.orchestra.run.smithi117.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2021-10-08T19:13:23.947 INFO:teuthology.orchestra.run.smithi117.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2021-10-08T19:13:23.947 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-argparse 2021-10-08T19:13:23.947 INFO:teuthology.orchestra.run.smithi117.stdout: x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 44 k 2021-10-08T19:13:23.947 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-common x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 78 k 2021-10-08T19:13:23.948 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cephfs x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 178 k 2021-10-08T19:13:23.948 INFO:teuthology.orchestra.run.smithi117.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2021-10-08T19:13:23.948 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rados x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 366 k 2021-10-08T19:13:23.948 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rbd x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 345 k 2021-10-08T19:13:23.949 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rgw x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 109 k 2021-10-08T19:13:23.949 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:13:23.949 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2021-10-08T19:13:23.949 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2021-10-08T19:13:23.949 INFO:teuthology.orchestra.run.smithi117.stdout:Install 21 Packages 2021-10-08T19:13:23.950 INFO:teuthology.orchestra.run.smithi117.stdout:Upgrade 2 Packages 2021-10-08T19:13:23.950 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:13:23.951 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 49 M 2021-10-08T19:13:23.951 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2021-10-08T19:13:23.952 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2021-10-08T19:13:23.955 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2021-10-08T19:13:23.955 INFO:teuthology.orchestra.run.smithi097.stdout: Package Arch Version Repository Size 2021-10-08T19:13:23.955 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2021-10-08T19:13:23.956 INFO:teuthology.orchestra.run.smithi097.stdout:Installing: 2021-10-08T19:13:23.956 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-radosgw x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 8.9 M 2021-10-08T19:13:23.956 INFO:teuthology.orchestra.run.smithi097.stdout:Upgrading: 2021-10-08T19:13:23.956 INFO:teuthology.orchestra.run.smithi097.stdout: librados2 x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 3.4 M 2021-10-08T19:13:23.956 INFO:teuthology.orchestra.run.smithi097.stdout: librbd1 x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 3.9 M 2021-10-08T19:13:23.957 INFO:teuthology.orchestra.run.smithi097.stdout:Installing dependencies: 2021-10-08T19:13:23.957 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-base x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 5.2 M 2021-10-08T19:13:23.957 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-common x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 20 M 2021-10-08T19:13:23.957 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-selinux x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 24 k 2021-10-08T19:13:23.958 INFO:teuthology.orchestra.run.smithi097.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2021-10-08T19:13:23.958 INFO:teuthology.orchestra.run.smithi097.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2021-10-08T19:13:23.958 INFO:teuthology.orchestra.run.smithi097.stdout: libcephfs2 x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 784 k 2021-10-08T19:13:23.958 INFO:teuthology.orchestra.run.smithi097.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2021-10-08T19:13:23.959 INFO:teuthology.orchestra.run.smithi097.stdout: librabbitmq x86_64 0.9.0-3.el8 CentOS-Base 47 k 2021-10-08T19:13:23.959 INFO:teuthology.orchestra.run.smithi097.stdout: libradosstriper1 x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 483 k 2021-10-08T19:13:23.959 INFO:teuthology.orchestra.run.smithi097.stdout: librdkafka x86_64 0.11.4-1.el8 CentOS-AppStream 353 k 2021-10-08T19:13:23.959 INFO:teuthology.orchestra.run.smithi097.stdout: librgw2 x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 3.8 M 2021-10-08T19:13:23.959 INFO:teuthology.orchestra.run.smithi097.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2021-10-08T19:13:23.960 INFO:teuthology.orchestra.run.smithi097.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2021-10-08T19:13:23.960 INFO:teuthology.orchestra.run.smithi097.stdout: python3-ceph-argparse 2021-10-08T19:13:23.960 INFO:teuthology.orchestra.run.smithi097.stdout: x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 44 k 2021-10-08T19:13:23.960 INFO:teuthology.orchestra.run.smithi097.stdout: python3-ceph-common x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 78 k 2021-10-08T19:13:23.961 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cephfs x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 178 k 2021-10-08T19:13:23.961 INFO:teuthology.orchestra.run.smithi097.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2021-10-08T19:13:23.961 INFO:teuthology.orchestra.run.smithi097.stdout: python3-rados x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 366 k 2021-10-08T19:13:23.961 INFO:teuthology.orchestra.run.smithi097.stdout: python3-rbd x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 345 k 2021-10-08T19:13:23.962 INFO:teuthology.orchestra.run.smithi097.stdout: python3-rgw x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 109 k 2021-10-08T19:13:23.962 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:13:23.962 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction Summary 2021-10-08T19:13:23.963 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2021-10-08T19:13:23.963 INFO:teuthology.orchestra.run.smithi097.stdout:Install 21 Packages 2021-10-08T19:13:23.963 INFO:teuthology.orchestra.run.smithi097.stdout:Upgrade 2 Packages 2021-10-08T19:13:23.963 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:13:23.964 INFO:teuthology.orchestra.run.smithi097.stdout:Total download size: 49 M 2021-10-08T19:13:23.964 INFO:teuthology.orchestra.run.smithi097.stdout:Downloading Packages: 2021-10-08T19:13:25.020 INFO:teuthology.orchestra.run.smithi117.stdout:(1/23): ceph-base-17.0.0-8087.g103b6cc3.el8.x86 4.9 MB/s | 5.2 MB 00:01 2021-10-08T19:13:25.078 INFO:teuthology.orchestra.run.smithi117.stdout:(2/23): ceph-selinux-17.0.0-8087.g103b6cc3.el8. 416 kB/s | 24 kB 00:00 2021-10-08T19:13:25.111 INFO:teuthology.orchestra.run.smithi097.stdout:(1/23): ceph-base-17.0.0-8087.g103b6cc3.el8.x86 4.5 MB/s | 5.2 MB 00:01 2021-10-08T19:13:25.170 INFO:teuthology.orchestra.run.smithi097.stdout:(2/23): ceph-selinux-17.0.0-8087.g103b6cc3.el8. 406 kB/s | 24 kB 00:00 2021-10-08T19:13:25.263 INFO:teuthology.orchestra.run.smithi117.stdout:(3/23): libcephfs2-17.0.0-8087.g103b6cc3.el8.x8 4.2 MB/s | 784 kB 00:00 2021-10-08T19:13:25.361 INFO:teuthology.orchestra.run.smithi097.stdout:(3/23): libcephfs2-17.0.0-8087.g103b6cc3.el8.x8 4.0 MB/s | 784 kB 00:00 2021-10-08T19:13:25.387 INFO:teuthology.orchestra.run.smithi117.stdout:(4/23): libradosstriper1-17.0.0-8087.g103b6cc3. 3.8 MB/s | 483 kB 00:00 2021-10-08T19:13:25.488 INFO:teuthology.orchestra.run.smithi097.stdout:(4/23): libradosstriper1-17.0.0-8087.g103b6cc3. 3.7 MB/s | 483 kB 00:00 2021-10-08T19:13:25.750 INFO:teuthology.orchestra.run.smithi117.stdout:(5/23): ceph-radosgw-17.0.0-8087.g103b6cc3.el8. 5.0 MB/s | 8.9 MB 00:01 2021-10-08T19:13:25.815 INFO:teuthology.orchestra.run.smithi117.stdout:(6/23): python3-ceph-argparse-17.0.0-8087.g103b 689 kB/s | 44 kB 00:00 2021-10-08T19:13:25.880 INFO:teuthology.orchestra.run.smithi117.stdout:(7/23): python3-ceph-common-17.0.0-8087.g103b6c 1.2 MB/s | 78 kB 00:00 2021-10-08T19:13:25.949 INFO:teuthology.orchestra.run.smithi117.stdout:(8/23): python3-cephfs-17.0.0-8087.g103b6cc3.el 2.5 MB/s | 178 kB 00:00 2021-10-08T19:13:26.027 INFO:teuthology.orchestra.run.smithi117.stdout:(9/23): python3-rados-17.0.0-8087.g103b6cc3.el8 4.7 MB/s | 366 kB 00:00 2021-10-08T19:13:26.091 INFO:teuthology.orchestra.run.smithi117.stdout:(10/23): librgw2-17.0.0-8087.g103b6cc3.el8.x86_ 5.5 MB/s | 3.8 MB 00:00 2021-10-08T19:13:26.099 INFO:teuthology.orchestra.run.smithi117.stdout:(11/23): python3-rbd-17.0.0-8087.g103b6cc3.el8. 4.6 MB/s | 345 kB 00:00 2021-10-08T19:13:26.133 INFO:teuthology.orchestra.run.smithi117.stdout:(12/23): librdkafka-0.11.4-1.el8.x86_64.rpm 10 MB/s | 353 kB 00:00 2021-10-08T19:13:26.137 INFO:teuthology.orchestra.run.smithi117.stdout:(13/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 69 MB/s | 259 kB 00:00 2021-10-08T19:13:26.139 INFO:teuthology.orchestra.run.smithi117.stdout:(14/23): python3-prettytable-0.7.2-14.el8.noarc 35 MB/s | 44 kB 00:00 2021-10-08T19:13:26.140 INFO:teuthology.orchestra.run.smithi117.stdout:(15/23): librabbitmq-0.9.0-3.el8.x86_64.rpm 39 MB/s | 47 kB 00:00 2021-10-08T19:13:26.152 INFO:teuthology.orchestra.run.smithi117.stdout:(16/23): python3-rgw-17.0.0-8087.g103b6cc3.el8. 1.7 MB/s | 109 kB 00:00 2021-10-08T19:13:26.219 INFO:teuthology.orchestra.run.smithi097.stdout:(5/23): librgw2-17.0.0-8087.g103b6cc3.el8.x86_6 5.3 MB/s | 3.8 MB 00:00 2021-10-08T19:13:26.258 INFO:teuthology.orchestra.run.smithi097.stdout:(6/23): python3-ceph-argparse-17.0.0-8087.g103b 1.1 MB/s | 44 kB 00:00 2021-10-08T19:13:26.279 INFO:teuthology.orchestra.run.smithi117.stdout:(17/23): leveldb-1.22-1.el8.x86_64.rpm 1.4 MB/s | 181 kB 00:00 2021-10-08T19:13:26.297 INFO:teuthology.orchestra.run.smithi097.stdout:(7/23): python3-ceph-common-17.0.0-8087.g103b6c 1.9 MB/s | 78 kB 00:00 2021-10-08T19:13:26.312 INFO:teuthology.orchestra.run.smithi117.stdout:(18/23): gperftools-libs-2.7-9.el8.x86_64.rpm 1.7 MB/s | 306 kB 00:00 2021-10-08T19:13:26.314 INFO:teuthology.orchestra.run.smithi117.stdout:(19/23): liboath-2.6.2-3.el8.x86_64.rpm 1.6 MB/s | 59 kB 00:00 2021-10-08T19:13:26.340 INFO:teuthology.orchestra.run.smithi097.stdout:(8/23): python3-cephfs-17.0.0-8087.g103b6cc3.el 4.1 MB/s | 178 kB 00:00 2021-10-08T19:13:26.344 INFO:teuthology.orchestra.run.smithi117.stdout:(20/23): libunwind-1.3.1-3.el8.x86_64.rpm 2.3 MB/s | 75 kB 00:00 2021-10-08T19:13:26.407 INFO:teuthology.orchestra.run.smithi097.stdout:(9/23): python3-rados-17.0.0-8087.g103b6cc3.el8 5.4 MB/s | 366 kB 00:00 2021-10-08T19:13:26.479 INFO:teuthology.orchestra.run.smithi097.stdout:(10/23): python3-rbd-17.0.0-8087.g103b6cc3.el8. 4.7 MB/s | 345 kB 00:00 2021-10-08T19:13:26.547 INFO:teuthology.orchestra.run.smithi097.stdout:(11/23): python3-rgw-17.0.0-8087.g103b6cc3.el8. 1.6 MB/s | 109 kB 00:00 2021-10-08T19:13:26.589 INFO:teuthology.orchestra.run.smithi097.stdout:(12/23): librdkafka-0.11.4-1.el8.x86_64.rpm 8.2 MB/s | 353 kB 00:00 2021-10-08T19:13:26.593 INFO:teuthology.orchestra.run.smithi097.stdout:(13/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 68 MB/s | 259 kB 00:00 2021-10-08T19:13:26.594 INFO:teuthology.orchestra.run.smithi097.stdout:(14/23): python3-prettytable-0.7.2-14.el8.noarc 35 MB/s | 44 kB 00:00 2021-10-08T19:13:26.596 INFO:teuthology.orchestra.run.smithi097.stdout:(15/23): librabbitmq-0.9.0-3.el8.x86_64.rpm 33 MB/s | 47 kB 00:00 2021-10-08T19:13:26.674 INFO:teuthology.orchestra.run.smithi097.stdout:(16/23): ceph-radosgw-17.0.0-8087.g103b6cc3.el8 3.3 MB/s | 8.9 MB 00:02 2021-10-08T19:13:26.744 INFO:teuthology.orchestra.run.smithi097.stdout:(17/23): gperftools-libs-2.7-9.el8.x86_64.rpm 2.0 MB/s | 306 kB 00:00 2021-10-08T19:13:26.770 INFO:teuthology.orchestra.run.smithi097.stdout:(18/23): liboath-2.6.2-3.el8.x86_64.rpm 2.3 MB/s | 59 kB 00:00 2021-10-08T19:13:26.795 INFO:teuthology.orchestra.run.smithi097.stdout:(19/23): libunwind-1.3.1-3.el8.x86_64.rpm 2.9 MB/s | 75 kB 00:00 2021-10-08T19:13:26.808 INFO:teuthology.orchestra.run.smithi097.stdout:(20/23): leveldb-1.22-1.el8.x86_64.rpm 1.3 MB/s | 181 kB 00:00 2021-10-08T19:13:26.892 INFO:teuthology.orchestra.run.smithi117.stdout:(21/23): librados2-17.0.0-8087.g103b6cc3.el8.x8 5.9 MB/s | 3.4 MB 00:00 2021-10-08T19:13:27.042 INFO:teuthology.orchestra.run.smithi117.stdout:(22/23): librbd1-17.0.0-8087.g103b6cc3.el8.x86_ 5.5 MB/s | 3.9 MB 00:00 2021-10-08T19:13:27.381 INFO:teuthology.orchestra.run.smithi097.stdout:(21/23): ceph-common-17.0.0-8087.g103b6cc3.el8. 5.8 MB/s | 20 MB 00:03 2021-10-08T19:13:27.392 INFO:teuthology.orchestra.run.smithi097.stdout:(22/23): librados2-17.0.0-8087.g103b6cc3.el8.x8 5.7 MB/s | 3.4 MB 00:00 2021-10-08T19:13:27.406 INFO:teuthology.orchestra.run.smithi117.stdout:(23/23): ceph-common-17.0.0-8087.g103b6cc3.el8. 5.8 MB/s | 20 MB 00:03 2021-10-08T19:13:27.409 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:13:27.410 INFO:teuthology.orchestra.run.smithi117.stdout:Total 14 MB/s | 49 MB 00:03 2021-10-08T19:13:27.413 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2021-10-08T19:13:27.458 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2021-10-08T19:13:27.458 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2021-10-08T19:13:27.510 INFO:teuthology.orchestra.run.smithi097.stdout:(23/23): librbd1-17.0.0-8087.g103b6cc3.el8.x86_ 5.5 MB/s | 3.9 MB 00:00 2021-10-08T19:13:27.512 INFO:teuthology.orchestra.run.smithi097.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:13:27.513 INFO:teuthology.orchestra.run.smithi097.stdout:Total 14 MB/s | 49 MB 00:03 2021-10-08T19:13:27.518 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction check 2021-10-08T19:13:27.561 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction check succeeded. 2021-10-08T19:13:27.561 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction test 2021-10-08T19:13:27.736 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2021-10-08T19:13:27.737 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2021-10-08T19:13:27.842 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction test succeeded. 2021-10-08T19:13:27.844 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction 2021-10-08T19:13:28.736 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2021-10-08T19:13:28.821 INFO:teuthology.orchestra.run.smithi097.stdout: Preparing : 1/1 2021-10-08T19:13:28.903 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2021-10-08T19:13:29.001 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2021-10-08T19:13:29.094 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2021-10-08T19:13:29.216 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2021-10-08T19:13:29.477 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2021-10-08T19:13:29.596 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2021-10-08T19:13:29.635 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : librados2-2:17.0.0-8087.g103b6cc3.el8.x86_64 3/25 2021-10-08T19:13:29.718 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librados2-2:17.0.0-8087.g103b6cc3.el8.x86_64 3/25 2021-10-08T19:13:29.799 INFO:teuthology.orchestra.run.smithi097.stdout: Upgrading : librados2-2:17.0.0-8087.g103b6cc3.el8.x86_64 3/25 2021-10-08T19:13:29.893 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: librados2-2:17.0.0-8087.g103b6cc3.el8.x86_64 3/25 2021-10-08T19:13:29.925 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rados-2:17.0.0-8087.g103b6cc3.el8.x86_64 4/25 2021-10-08T19:13:30.077 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephfs2-2:17.0.0-8087.g103b6cc3.el8.x86_64 5/25 2021-10-08T19:13:30.140 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-rados-2:17.0.0-8087.g103b6cc3.el8.x86_64 4/25 2021-10-08T19:13:30.333 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libcephfs2-2:17.0.0-8087.g103b6cc3.el8.x86_64 5/25 2021-10-08T19:13:30.522 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libcephfs2-2:17.0.0-8087.g103b6cc3.el8.x86_64 5/25 2021-10-08T19:13:30.727 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : librbd1-2:17.0.0-8087.g103b6cc3.el8.x86_64 6/25 2021-10-08T19:13:30.756 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: libcephfs2-2:17.0.0-8087.g103b6cc3.el8.x86_64 5/25 2021-10-08T19:13:30.789 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librbd1-2:17.0.0-8087.g103b6cc3.el8.x86_64 6/25 2021-10-08T19:13:30.934 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 7/25 2021-10-08T19:13:30.974 INFO:teuthology.orchestra.run.smithi097.stdout: Upgrading : librbd1-2:17.0.0-8087.g103b6cc3.el8.x86_64 6/25 2021-10-08T19:13:31.040 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: librbd1-2:17.0.0-8087.g103b6cc3.el8.x86_64 6/25 2021-10-08T19:13:31.094 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 8/25 2021-10-08T19:13:31.223 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 7/25 2021-10-08T19:13:31.433 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 8/25 2021-10-08T19:13:31.497 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 8/25 2021-10-08T19:13:31.685 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librgw2-2:17.0.0-8087.g103b6cc3.el8.x86_64 9/25 2021-10-08T19:13:31.763 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librgw2-2:17.0.0-8087.g103b6cc3.el8.x86_64 9/25 2021-10-08T19:13:31.839 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 8/25 2021-10-08T19:13:31.917 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : leveldb-1.22-1.el8.x86_64 10/25 2021-10-08T19:13:32.007 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : librgw2-2:17.0.0-8087.g103b6cc3.el8.x86_64 9/25 2021-10-08T19:13:32.019 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-ceph-argparse-2:17.0.0-8087.g103b6cc3.el8. 11/25 2021-10-08T19:13:32.072 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: librgw2-2:17.0.0-8087.g103b6cc3.el8.x86_64 9/25 2021-10-08T19:13:32.179 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cephfs-2:17.0.0-8087.g103b6cc3.el8.x86_64 12/25 2021-10-08T19:13:32.256 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : leveldb-1.22-1.el8.x86_64 10/25 2021-10-08T19:13:32.343 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rgw-2:17.0.0-8087.g103b6cc3.el8.x86_64 13/25 2021-10-08T19:13:32.392 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-ceph-argparse-2:17.0.0-8087.g103b6cc3.el8. 11/25 2021-10-08T19:13:32.561 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rbd-2:17.0.0-8087.g103b6cc3.el8.x86_64 14/25 2021-10-08T19:13:32.568 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-cephfs-2:17.0.0-8087.g103b6cc3.el8.x86_64 12/25 2021-10-08T19:13:32.718 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libradosstriper1-2:17.0.0-8087.g103b6cc3.el8.x86_6 15/25 2021-10-08T19:13:32.789 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libradosstriper1-2:17.0.0-8087.g103b6cc3.el8.x86_6 15/25 2021-10-08T19:13:32.791 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-rgw-2:17.0.0-8087.g103b6cc3.el8.x86_64 13/25 2021-10-08T19:13:32.943 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2021-10-08T19:13:33.000 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-rbd-2:17.0.0-8087.g103b6cc3.el8.x86_64 14/25 2021-10-08T19:13:33.118 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2021-10-08T19:13:33.182 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libradosstriper1-2:17.0.0-8087.g103b6cc3.el8.x86_6 15/25 2021-10-08T19:13:33.232 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: libradosstriper1-2:17.0.0-8087.g103b6cc3.el8.x86_6 15/25 2021-10-08T19:13:33.308 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2021-10-08T19:13:33.415 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2021-10-08T19:13:33.427 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-ceph-common-2:17.0.0-8087.g103b6cc3.el8.x8 19/25 2021-10-08T19:13:33.640 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2021-10-08T19:13:33.833 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2021-10-08T19:13:33.958 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-ceph-common-2:17.0.0-8087.g103b6cc3.el8.x8 19/25 2021-10-08T19:13:36.876 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-common-2:17.0.0-8087.g103b6cc3.el8.x86_64 20/25 2021-10-08T19:13:37.068 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-common-2:17.0.0-8087.g103b6cc3.el8.x86_64 20/25 2021-10-08T19:13:37.444 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-common-2:17.0.0-8087.g103b6cc3.el8.x86_64 20/25 2021-10-08T19:13:37.629 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-common-2:17.0.0-8087.g103b6cc3.el8.x86_64 20/25 2021-10-08T19:13:37.641 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-common-2:17.0.0-8087.g103b6cc3.el8.x86_64 20/25 2021-10-08T19:13:37.862 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-base-2:17.0.0-8087.g103b6cc3.el8.x86_64 21/25 2021-10-08T19:13:37.947 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-base-2:17.0.0-8087.g103b6cc3.el8.x86_64 21/25 2021-10-08T19:13:38.100 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-selinux-2:17.0.0-8087.g103b6cc3.el8.x86_64 22/25 2021-10-08T19:13:38.200 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-common-2:17.0.0-8087.g103b6cc3.el8.x86_64 20/25 2021-10-08T19:13:38.478 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-base-2:17.0.0-8087.g103b6cc3.el8.x86_64 21/25 2021-10-08T19:13:38.565 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-base-2:17.0.0-8087.g103b6cc3.el8.x86_64 21/25 2021-10-08T19:13:38.715 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-selinux-2:17.0.0-8087.g103b6cc3.el8.x86_64 22/25 2021-10-08T19:13:53.890 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-selinux-2:17.0.0-8087.g103b6cc3.el8.x86_64 22/25 2021-10-08T19:13:53.891 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /sys 2021-10-08T19:13:53.891 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /proc 2021-10-08T19:13:53.891 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /dev 2021-10-08T19:13:53.892 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /run 2021-10-08T19:13:53.892 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /mnt 2021-10-08T19:13:53.892 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /var/tmp 2021-10-08T19:13:53.892 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /home 2021-10-08T19:13:53.893 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /tmp 2021-10-08T19:13:53.893 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /dev 2021-10-08T19:13:53.894 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:13:54.050 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-selinux-2:17.0.0-8087.g103b6cc3.el8.x86_64 22/25 2021-10-08T19:13:54.051 INFO:teuthology.orchestra.run.smithi097.stdout:skipping the directory /sys 2021-10-08T19:13:54.052 INFO:teuthology.orchestra.run.smithi097.stdout:skipping the directory /proc 2021-10-08T19:13:54.052 INFO:teuthology.orchestra.run.smithi097.stdout:skipping the directory /dev 2021-10-08T19:13:54.052 INFO:teuthology.orchestra.run.smithi097.stdout:skipping the directory /run 2021-10-08T19:13:54.052 INFO:teuthology.orchestra.run.smithi097.stdout:skipping the directory /mnt 2021-10-08T19:13:54.053 INFO:teuthology.orchestra.run.smithi097.stdout:skipping the directory /var/tmp 2021-10-08T19:13:54.053 INFO:teuthology.orchestra.run.smithi097.stdout:skipping the directory /home 2021-10-08T19:13:54.053 INFO:teuthology.orchestra.run.smithi097.stdout:skipping the directory /tmp 2021-10-08T19:13:54.053 INFO:teuthology.orchestra.run.smithi097.stdout:skipping the directory /dev 2021-10-08T19:13:54.054 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:13:54.932 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-radosgw-2:17.0.0-8087.g103b6cc3.el8.x86_64 23/25 2021-10-08T19:13:55.037 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-radosgw-2:17.0.0-8087.g103b6cc3.el8.x86_64 23/25 2021-10-08T19:13:55.038 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2021-10-08T19:13:55.143 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-radosgw-2:17.0.0-8087.g103b6cc3.el8.x86_64 23/25 2021-10-08T19:13:55.215 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2021-10-08T19:13:55.216 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2021-10-08T19:13:55.243 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-radosgw-2:17.0.0-8087.g103b6cc3.el8.x86_64 23/25 2021-10-08T19:13:55.244 INFO:teuthology.orchestra.run.smithi097.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2021-10-08T19:13:55.448 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2021-10-08T19:13:55.448 INFO:teuthology.orchestra.run.smithi097.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2021-10-08T19:13:55.944 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2021-10-08T19:13:55.944 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-base-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/25 2021-10-08T19:13:55.944 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-common-2:17.0.0-8087.g103b6cc3.el8.x86_64 2/25 2021-10-08T19:13:55.945 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-radosgw-2:17.0.0-8087.g103b6cc3.el8.x86_64 3/25 2021-10-08T19:13:55.945 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-selinux-2:17.0.0-8087.g103b6cc3.el8.x86_64 4/25 2021-10-08T19:13:55.945 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephfs2-2:17.0.0-8087.g103b6cc3.el8.x86_64 5/25 2021-10-08T19:13:55.945 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libradosstriper1-2:17.0.0-8087.g103b6cc3.el8.x86_6 6/25 2021-10-08T19:13:55.946 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librgw2-2:17.0.0-8087.g103b6cc3.el8.x86_64 7/25 2021-10-08T19:13:55.946 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-ceph-argparse-2:17.0.0-8087.g103b6cc3.el8. 8/25 2021-10-08T19:13:55.946 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-ceph-common-2:17.0.0-8087.g103b6cc3.el8.x8 9/25 2021-10-08T19:13:55.946 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cephfs-2:17.0.0-8087.g103b6cc3.el8.x86_64 10/25 2021-10-08T19:13:55.946 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rados-2:17.0.0-8087.g103b6cc3.el8.x86_64 11/25 2021-10-08T19:13:55.947 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rbd-2:17.0.0-8087.g103b6cc3.el8.x86_64 12/25 2021-10-08T19:13:55.947 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rgw-2:17.0.0-8087.g103b6cc3.el8.x86_64 13/25 2021-10-08T19:13:55.947 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 14/25 2021-10-08T19:13:55.947 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2021-10-08T19:13:55.948 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2021-10-08T19:13:55.948 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 17/25 2021-10-08T19:13:55.948 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2021-10-08T19:13:55.948 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : leveldb-1.22-1.el8.x86_64 19/25 2021-10-08T19:13:55.949 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 20/25 2021-10-08T19:13:55.949 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 21/25 2021-10-08T19:13:55.949 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados2-2:17.0.0-8087.g103b6cc3.el8.x86_64 22/25 2021-10-08T19:13:55.950 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2021-10-08T19:13:55.950 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librbd1-2:17.0.0-8087.g103b6cc3.el8.x86_64 24/25 2021-10-08T19:13:56.191 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2021-10-08T19:13:56.191 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-base-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/25 2021-10-08T19:13:56.192 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-common-2:17.0.0-8087.g103b6cc3.el8.x86_64 2/25 2021-10-08T19:13:56.192 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-radosgw-2:17.0.0-8087.g103b6cc3.el8.x86_64 3/25 2021-10-08T19:13:56.192 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-selinux-2:17.0.0-8087.g103b6cc3.el8.x86_64 4/25 2021-10-08T19:13:56.192 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libcephfs2-2:17.0.0-8087.g103b6cc3.el8.x86_64 5/25 2021-10-08T19:13:56.193 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libradosstriper1-2:17.0.0-8087.g103b6cc3.el8.x86_6 6/25 2021-10-08T19:13:56.193 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : librgw2-2:17.0.0-8087.g103b6cc3.el8.x86_64 7/25 2021-10-08T19:13:56.193 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-ceph-argparse-2:17.0.0-8087.g103b6cc3.el8. 8/25 2021-10-08T19:13:56.193 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-ceph-common-2:17.0.0-8087.g103b6cc3.el8.x8 9/25 2021-10-08T19:13:56.193 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-cephfs-2:17.0.0-8087.g103b6cc3.el8.x86_64 10/25 2021-10-08T19:13:56.194 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-rados-2:17.0.0-8087.g103b6cc3.el8.x86_64 11/25 2021-10-08T19:13:56.194 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-rbd-2:17.0.0-8087.g103b6cc3.el8.x86_64 12/25 2021-10-08T19:13:56.194 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-rgw-2:17.0.0-8087.g103b6cc3.el8.x86_64 13/25 2021-10-08T19:13:56.194 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 14/25 2021-10-08T19:13:56.195 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2021-10-08T19:13:56.195 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2021-10-08T19:13:56.195 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 17/25 2021-10-08T19:13:56.195 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2021-10-08T19:13:56.195 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : leveldb-1.22-1.el8.x86_64 19/25 2021-10-08T19:13:56.196 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 20/25 2021-10-08T19:13:56.196 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 21/25 2021-10-08T19:13:56.196 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : librados2-2:17.0.0-8087.g103b6cc3.el8.x86_64 22/25 2021-10-08T19:13:56.196 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2021-10-08T19:13:56.197 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : librbd1-2:17.0.0-8087.g103b6cc3.el8.x86_64 24/25 2021-10-08T19:13:56.838 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2021-10-08T19:13:56.839 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:13:56.839 INFO:teuthology.orchestra.run.smithi117.stdout:Upgraded: 2021-10-08T19:13:56.840 INFO:teuthology.orchestra.run.smithi117.stdout: librados2-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:13:56.840 INFO:teuthology.orchestra.run.smithi117.stdout: librbd1-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:13:56.840 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2021-10-08T19:13:56.841 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-base-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:13:56.841 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-common-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:13:56.842 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-radosgw-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:13:56.842 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-selinux-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:13:56.842 INFO:teuthology.orchestra.run.smithi117.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2021-10-08T19:13:56.843 INFO:teuthology.orchestra.run.smithi117.stdout: leveldb-1.22-1.el8.x86_64 2021-10-08T19:13:56.843 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs2-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:13:56.844 INFO:teuthology.orchestra.run.smithi117.stdout: liboath-2.6.2-3.el8.x86_64 2021-10-08T19:13:56.844 INFO:teuthology.orchestra.run.smithi117.stdout: librabbitmq-0.9.0-3.el8.x86_64 2021-10-08T19:13:56.844 INFO:teuthology.orchestra.run.smithi117.stdout: libradosstriper1-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:13:56.845 INFO:teuthology.orchestra.run.smithi117.stdout: librdkafka-0.11.4-1.el8.x86_64 2021-10-08T19:13:56.845 INFO:teuthology.orchestra.run.smithi117.stdout: librgw2-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:13:56.846 INFO:teuthology.orchestra.run.smithi117.stdout: libunwind-1.3.1-3.el8.x86_64 2021-10-08T19:13:56.846 INFO:teuthology.orchestra.run.smithi117.stdout: lttng-ust-2.8.1-11.el8.x86_64 2021-10-08T19:13:56.846 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-argparse-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:13:56.846 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-common-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:13:56.847 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cephfs-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:13:56.847 INFO:teuthology.orchestra.run.smithi117.stdout: python3-prettytable-0.7.2-14.el8.noarch 2021-10-08T19:13:56.847 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rados-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:13:56.848 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rbd-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:13:56.848 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rgw-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:13:56.848 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:13:56.849 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2021-10-08T19:13:57.091 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2021-10-08T19:13:57.091 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:13:57.091 INFO:teuthology.orchestra.run.smithi097.stdout:Upgraded: 2021-10-08T19:13:57.091 INFO:teuthology.orchestra.run.smithi097.stdout: librados2-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:13:57.092 INFO:teuthology.orchestra.run.smithi097.stdout: librbd1-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:13:57.092 INFO:teuthology.orchestra.run.smithi097.stdout:Installed: 2021-10-08T19:13:57.092 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-base-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:13:57.093 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-common-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:13:57.093 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-radosgw-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:13:57.093 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-selinux-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:13:57.094 INFO:teuthology.orchestra.run.smithi097.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2021-10-08T19:13:57.094 INFO:teuthology.orchestra.run.smithi097.stdout: leveldb-1.22-1.el8.x86_64 2021-10-08T19:13:57.095 INFO:teuthology.orchestra.run.smithi097.stdout: libcephfs2-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:13:57.095 INFO:teuthology.orchestra.run.smithi097.stdout: liboath-2.6.2-3.el8.x86_64 2021-10-08T19:13:57.096 INFO:teuthology.orchestra.run.smithi097.stdout: librabbitmq-0.9.0-3.el8.x86_64 2021-10-08T19:13:57.097 INFO:teuthology.orchestra.run.smithi097.stdout: libradosstriper1-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:13:57.097 INFO:teuthology.orchestra.run.smithi097.stdout: librdkafka-0.11.4-1.el8.x86_64 2021-10-08T19:13:57.098 INFO:teuthology.orchestra.run.smithi097.stdout: librgw2-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:13:57.098 INFO:teuthology.orchestra.run.smithi097.stdout: libunwind-1.3.1-3.el8.x86_64 2021-10-08T19:13:57.098 INFO:teuthology.orchestra.run.smithi097.stdout: lttng-ust-2.8.1-11.el8.x86_64 2021-10-08T19:13:57.099 INFO:teuthology.orchestra.run.smithi097.stdout: python3-ceph-argparse-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:13:57.099 INFO:teuthology.orchestra.run.smithi097.stdout: python3-ceph-common-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:13:57.100 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cephfs-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:13:57.100 INFO:teuthology.orchestra.run.smithi097.stdout: python3-prettytable-0.7.2-14.el8.noarch 2021-10-08T19:13:57.100 INFO:teuthology.orchestra.run.smithi097.stdout: python3-rados-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:13:57.101 INFO:teuthology.orchestra.run.smithi097.stdout: python3-rbd-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:13:57.101 INFO:teuthology.orchestra.run.smithi097.stdout: python3-rgw-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:13:57.103 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:13:57.103 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2021-10-08T19:13:57.129 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-test 2021-10-08T19:13:57.319 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum -y install ceph-test 2021-10-08T19:13:57.621 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:00:35 ago on Fri 08 Oct 2021 07:13:22 PM UTC. 2021-10-08T19:13:57.807 INFO:teuthology.orchestra.run.smithi097.stdout:Last metadata expiration check: 0:00:35 ago on Fri 08 Oct 2021 07:13:22 PM UTC. 2021-10-08T19:13:58.552 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2021-10-08T19:13:58.553 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2021-10-08T19:13:58.553 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2021-10-08T19:13:58.553 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2021-10-08T19:13:58.554 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2021-10-08T19:13:58.554 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-test x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 44 M 2021-10-08T19:13:58.554 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2021-10-08T19:13:58.554 INFO:teuthology.orchestra.run.smithi117.stdout: jq x86_64 1.5-12.el8 CentOS-AppStream 161 k 2021-10-08T19:13:58.555 INFO:teuthology.orchestra.run.smithi117.stdout: libcephsqlite x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 170 k 2021-10-08T19:13:58.555 INFO:teuthology.orchestra.run.smithi117.stdout: libxslt x86_64 1.1.32-6.el8 CentOS-Base 250 k 2021-10-08T19:13:58.555 INFO:teuthology.orchestra.run.smithi117.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2021-10-08T19:13:58.555 INFO:teuthology.orchestra.run.smithi117.stdout: socat x86_64 1.7.3.3-2.el8 CentOS-AppStream 302 k 2021-10-08T19:13:58.555 INFO:teuthology.orchestra.run.smithi117.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2021-10-08T19:13:58.556 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:13:58.556 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2021-10-08T19:13:58.556 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2021-10-08T19:13:58.556 INFO:teuthology.orchestra.run.smithi117.stdout:Install 7 Packages 2021-10-08T19:13:58.556 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:13:58.557 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 46 M 2021-10-08T19:13:58.557 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 211 M 2021-10-08T19:13:58.558 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2021-10-08T19:13:58.596 INFO:teuthology.orchestra.run.smithi117.stdout:(1/7): jq-1.5-12.el8.x86_64.rpm 4.0 MB/s | 161 kB 00:00 2021-10-08T19:13:58.599 INFO:teuthology.orchestra.run.smithi117.stdout:(2/7): oniguruma-6.8.2-2.el8.x86_64.rpm 54 MB/s | 187 kB 00:00 2021-10-08T19:13:58.605 INFO:teuthology.orchestra.run.smithi117.stdout:(3/7): socat-1.7.3.3-2.el8.x86_64.rpm 66 MB/s | 302 kB 00:00 2021-10-08T19:13:58.608 INFO:teuthology.orchestra.run.smithi117.stdout:(4/7): libxslt-1.1.32-6.el8.x86_64.rpm 66 MB/s | 250 kB 00:00 2021-10-08T19:13:58.637 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2021-10-08T19:13:58.638 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2021-10-08T19:13:58.638 INFO:teuthology.orchestra.run.smithi097.stdout: Package Arch Version Repository Size 2021-10-08T19:13:58.638 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2021-10-08T19:13:58.638 INFO:teuthology.orchestra.run.smithi097.stdout:Installing: 2021-10-08T19:13:58.639 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-test x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 44 M 2021-10-08T19:13:58.639 INFO:teuthology.orchestra.run.smithi097.stdout:Installing dependencies: 2021-10-08T19:13:58.639 INFO:teuthology.orchestra.run.smithi097.stdout: jq x86_64 1.5-12.el8 CentOS-AppStream 161 k 2021-10-08T19:13:58.639 INFO:teuthology.orchestra.run.smithi097.stdout: libcephsqlite x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 170 k 2021-10-08T19:13:58.640 INFO:teuthology.orchestra.run.smithi097.stdout: libxslt x86_64 1.1.32-6.el8 CentOS-Base 250 k 2021-10-08T19:13:58.640 INFO:teuthology.orchestra.run.smithi097.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2021-10-08T19:13:58.640 INFO:teuthology.orchestra.run.smithi097.stdout: socat x86_64 1.7.3.3-2.el8 CentOS-AppStream 302 k 2021-10-08T19:13:58.640 INFO:teuthology.orchestra.run.smithi097.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2021-10-08T19:13:58.640 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:13:58.641 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction Summary 2021-10-08T19:13:58.641 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2021-10-08T19:13:58.641 INFO:teuthology.orchestra.run.smithi097.stdout:Install 7 Packages 2021-10-08T19:13:58.642 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:13:58.642 INFO:teuthology.orchestra.run.smithi097.stdout:Total download size: 46 M 2021-10-08T19:13:58.643 INFO:teuthology.orchestra.run.smithi097.stdout:Installed size: 211 M 2021-10-08T19:13:58.643 INFO:teuthology.orchestra.run.smithi097.stdout:Downloading Packages: 2021-10-08T19:13:58.680 INFO:teuthology.orchestra.run.smithi097.stdout:(1/7): jq-1.5-12.el8.x86_64.rpm 4.1 MB/s | 161 kB 00:00 2021-10-08T19:13:58.682 INFO:teuthology.orchestra.run.smithi097.stdout:(2/7): oniguruma-6.8.2-2.el8.x86_64.rpm 62 MB/s | 187 kB 00:00 2021-10-08T19:13:58.687 INFO:teuthology.orchestra.run.smithi097.stdout:(3/7): socat-1.7.3.3-2.el8.x86_64.rpm 72 MB/s | 302 kB 00:00 2021-10-08T19:13:58.692 INFO:teuthology.orchestra.run.smithi097.stdout:(4/7): libxslt-1.1.32-6.el8.x86_64.rpm 66 MB/s | 250 kB 00:00 2021-10-08T19:13:58.710 INFO:teuthology.orchestra.run.smithi117.stdout:(5/7): xmlstarlet-1.6.1-11.el8.x86_64.rpm 689 kB/s | 69 kB 00:00 2021-10-08T19:13:58.728 INFO:teuthology.orchestra.run.smithi117.stdout:(6/7): libcephsqlite-17.0.0-8087.g103b6cc3.el8. 988 kB/s | 170 kB 00:00 2021-10-08T19:13:58.790 INFO:teuthology.orchestra.run.smithi097.stdout:(5/7): xmlstarlet-1.6.1-11.el8.x86_64.rpm 697 kB/s | 69 kB 00:00 2021-10-08T19:13:58.813 INFO:teuthology.orchestra.run.smithi097.stdout:(6/7): libcephsqlite-17.0.0-8087.g103b6cc3.el8. 988 kB/s | 170 kB 00:00 2021-10-08T19:14:02.079 INFO:teuthology.orchestra.run.smithi117.stdout:(7/7): ceph-test-17.0.0-8087.g103b6cc3.el8.x86_ 13 MB/s | 44 MB 00:03 2021-10-08T19:14:02.082 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:14:02.083 INFO:teuthology.orchestra.run.smithi117.stdout:Total 13 MB/s | 46 MB 00:03 2021-10-08T19:14:02.087 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2021-10-08T19:14:02.111 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2021-10-08T19:14:02.111 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2021-10-08T19:14:02.300 INFO:teuthology.orchestra.run.smithi097.stdout:(7/7): ceph-test-17.0.0-8087.g103b6cc3.el8.x86_ 12 MB/s | 44 MB 00:03 2021-10-08T19:14:02.303 INFO:teuthology.orchestra.run.smithi097.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:14:02.304 INFO:teuthology.orchestra.run.smithi097.stdout:Total 12 MB/s | 46 MB 00:03 2021-10-08T19:14:02.308 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction check 2021-10-08T19:14:02.330 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction check succeeded. 2021-10-08T19:14:02.331 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction test 2021-10-08T19:14:02.359 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2021-10-08T19:14:02.361 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2021-10-08T19:14:02.579 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction test succeeded. 2021-10-08T19:14:02.581 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction 2021-10-08T19:14:02.847 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2021-10-08T19:14:03.038 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libxslt-1.1.32-6.el8.x86_64 1/7 2021-10-08T19:14:03.083 INFO:teuthology.orchestra.run.smithi097.stdout: Preparing : 1/1 2021-10-08T19:14:03.206 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 2/7 2021-10-08T19:14:03.322 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libxslt-1.1.32-6.el8.x86_64 1/7 2021-10-08T19:14:03.414 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 3/7 2021-10-08T19:14:03.507 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 2/7 2021-10-08T19:14:03.603 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 4/7 2021-10-08T19:14:03.944 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 4/7 2021-10-08T19:14:04.434 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 3/7 2021-10-08T19:14:04.695 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 4/7 2021-10-08T19:14:04.719 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : jq-1.5-12.el8.x86_64 5/7 2021-10-08T19:14:04.763 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 4/7 2021-10-08T19:14:04.844 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephsqlite-2:17.0.0-8087.g103b6cc3.el8.x86_64 6/7 2021-10-08T19:14:04.928 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : jq-1.5-12.el8.x86_64 5/7 2021-10-08T19:14:05.128 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libcephsqlite-2:17.0.0-8087.g103b6cc3.el8.x86_64 6/7 2021-10-08T19:14:09.164 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libcephsqlite-2:17.0.0-8087.g103b6cc3.el8.x86_64 6/7 2021-10-08T19:14:09.394 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-test-2:17.0.0-8087.g103b6cc3.el8.x86_64 7/7 2021-10-08T19:14:09.446 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: libcephsqlite-2:17.0.0-8087.g103b6cc3.el8.x86_64 6/7 2021-10-08T19:14:09.664 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-test-2:17.0.0-8087.g103b6cc3.el8.x86_64 7/7 2021-10-08T19:14:09.664 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-test-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/7 2021-10-08T19:14:09.664 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephsqlite-2:17.0.0-8087.g103b6cc3.el8.x86_64 2/7 2021-10-08T19:14:09.665 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : jq-1.5-12.el8.x86_64 3/7 2021-10-08T19:14:09.665 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/7 2021-10-08T19:14:09.667 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 5/7 2021-10-08T19:14:09.667 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libxslt-1.1.32-6.el8.x86_64 6/7 2021-10-08T19:14:09.701 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-test-2:17.0.0-8087.g103b6cc3.el8.x86_64 7/7 2021-10-08T19:14:10.113 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-test-2:17.0.0-8087.g103b6cc3.el8.x86_64 7/7 2021-10-08T19:14:10.116 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-test-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/7 2021-10-08T19:14:10.116 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libcephsqlite-2:17.0.0-8087.g103b6cc3.el8.x86_64 2/7 2021-10-08T19:14:10.117 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : jq-1.5-12.el8.x86_64 3/7 2021-10-08T19:14:10.117 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/7 2021-10-08T19:14:10.117 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 5/7 2021-10-08T19:14:10.117 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libxslt-1.1.32-6.el8.x86_64 6/7 2021-10-08T19:14:10.600 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 7/7 2021-10-08T19:14:10.601 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:14:10.601 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2021-10-08T19:14:10.602 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-test-2:17.0.0-8087.g103b6cc3.el8.x86_64 jq-1.5-12.el8.x86_64 2021-10-08T19:14:10.602 INFO:teuthology.orchestra.run.smithi117.stdout: libcephsqlite-2:17.0.0-8087.g103b6cc3.el8.x86_64 libxslt-1.1.32-6.el8.x86_64 2021-10-08T19:14:10.602 INFO:teuthology.orchestra.run.smithi117.stdout: oniguruma-6.8.2-2.el8.x86_64 socat-1.7.3.3-2.el8.x86_64 2021-10-08T19:14:10.603 INFO:teuthology.orchestra.run.smithi117.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2021-10-08T19:14:10.603 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:14:10.603 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2021-10-08T19:14:11.491 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph 2021-10-08T19:14:11.547 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 7/7 2021-10-08T19:14:11.547 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:14:11.548 INFO:teuthology.orchestra.run.smithi097.stdout:Installed: 2021-10-08T19:14:11.548 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-test-2:17.0.0-8087.g103b6cc3.el8.x86_64 jq-1.5-12.el8.x86_64 2021-10-08T19:14:11.548 INFO:teuthology.orchestra.run.smithi097.stdout: libcephsqlite-2:17.0.0-8087.g103b6cc3.el8.x86_64 libxslt-1.1.32-6.el8.x86_64 2021-10-08T19:14:11.548 INFO:teuthology.orchestra.run.smithi097.stdout: oniguruma-6.8.2-2.el8.x86_64 socat-1.7.3.3-2.el8.x86_64 2021-10-08T19:14:11.549 INFO:teuthology.orchestra.run.smithi097.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2021-10-08T19:14:11.549 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:14:11.549 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2021-10-08T19:14:11.671 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum -y install ceph 2021-10-08T19:14:11.971 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:00:49 ago on Fri 08 Oct 2021 07:13:22 PM UTC. 2021-10-08T19:14:12.146 INFO:teuthology.orchestra.run.smithi097.stdout:Last metadata expiration check: 0:00:50 ago on Fri 08 Oct 2021 07:13:22 PM UTC. 2021-10-08T19:14:12.625 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2021-10-08T19:14:12.627 INFO:teuthology.orchestra.run.smithi117.stdout:======================================================================================= 2021-10-08T19:14:12.628 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2021-10-08T19:14:12.628 INFO:teuthology.orchestra.run.smithi117.stdout:======================================================================================= 2021-10-08T19:14:12.628 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2021-10-08T19:14:12.629 INFO:teuthology.orchestra.run.smithi117.stdout: ceph x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 6.4 k 2021-10-08T19:14:12.629 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2021-10-08T19:14:12.630 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mds x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 2.3 M 2021-10-08T19:14:12.630 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 1.5 M 2021-10-08T19:14:12.631 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-modules-core noarch 2:17.0.0-8087.g103b6cc3.el8 ceph-noarch 214 k 2021-10-08T19:14:12.631 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mon x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 3.9 M 2021-10-08T19:14:12.631 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-osd x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 17 M 2021-10-08T19:14:12.632 INFO:teuthology.orchestra.run.smithi117.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2021-10-08T19:14:12.632 INFO:teuthology.orchestra.run.smithi117.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2021-10-08T19:14:12.633 INFO:teuthology.orchestra.run.smithi117.stdout: python3-chardet noarch 3.0.4-7.el8 CentOS-Base 195 k 2021-10-08T19:14:12.633 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2021-10-08T19:14:12.633 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2021-10-08T19:14:12.634 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2021-10-08T19:14:12.634 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2021-10-08T19:14:12.635 INFO:teuthology.orchestra.run.smithi117.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2021-10-08T19:14:12.635 INFO:teuthology.orchestra.run.smithi117.stdout: python3-lxml x86_64 4.2.3-2.el8 CentOS-AppStream 1.5 M 2021-10-08T19:14:12.635 INFO:teuthology.orchestra.run.smithi117.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2021-10-08T19:14:12.636 INFO:teuthology.orchestra.run.smithi117.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2021-10-08T19:14:12.644 INFO:teuthology.orchestra.run.smithi117.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2021-10-08T19:14:12.644 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2021-10-08T19:14:12.645 INFO:teuthology.orchestra.run.smithi117.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2021-10-08T19:14:12.645 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pysocks noarch 1.6.8-3.el8 CentOS-Base 34 k 2021-10-08T19:14:12.645 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2021-10-08T19:14:12.646 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests noarch 2.20.0-2.1.el8_1 CentOS-Base 123 k 2021-10-08T19:14:12.646 INFO:teuthology.orchestra.run.smithi117.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2021-10-08T19:14:12.666 INFO:teuthology.orchestra.run.smithi117.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2021-10-08T19:14:12.667 INFO:teuthology.orchestra.run.smithi117.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2021-10-08T19:14:12.667 INFO:teuthology.orchestra.run.smithi117.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2021-10-08T19:14:12.667 INFO:teuthology.orchestra.run.smithi117.stdout: python3-urllib3 noarch 1.24.2-5.el8 CentOS-Base 177 k 2021-10-08T19:14:12.668 INFO:teuthology.orchestra.run.smithi117.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2021-10-08T19:14:12.668 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webencodings noarch 0.5.1-6.el8 CentOS-AppStream 27 k 2021-10-08T19:14:12.668 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2021-10-08T19:14:12.668 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2021-10-08T19:14:12.669 INFO:teuthology.orchestra.run.smithi117.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2021-10-08T19:14:12.669 INFO:teuthology.orchestra.run.smithi117.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2021-10-08T19:14:12.669 INFO:teuthology.orchestra.run.smithi117.stdout:Installing weak dependencies: 2021-10-08T19:14:12.670 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cssselect noarch 0.9.2-10.el8 epel 40 k 2021-10-08T19:14:12.670 INFO:teuthology.orchestra.run.smithi117.stdout: python3-html5lib noarch 1:0.999999999-6.el8 CentOS-AppStream 214 k 2021-10-08T19:14:12.671 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:14:12.671 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2021-10-08T19:14:12.671 INFO:teuthology.orchestra.run.smithi117.stdout:======================================================================================= 2021-10-08T19:14:12.672 INFO:teuthology.orchestra.run.smithi117.stdout:Install 36 Packages 2021-10-08T19:14:12.672 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:14:12.673 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 29 M 2021-10-08T19:14:12.674 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 115 M 2021-10-08T19:14:12.674 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2021-10-08T19:14:12.736 INFO:teuthology.orchestra.run.smithi117.stdout:(1/36): ceph-17.0.0-8087.g103b6cc3.el8.x86_64.r 65 kB/s | 6.4 kB 00:00 2021-10-08T19:14:12.782 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2021-10-08T19:14:12.792 INFO:teuthology.orchestra.run.smithi097.stdout:======================================================================================= 2021-10-08T19:14:12.796 INFO:teuthology.orchestra.run.smithi097.stdout: Package Arch Version Repository Size 2021-10-08T19:14:12.796 INFO:teuthology.orchestra.run.smithi097.stdout:======================================================================================= 2021-10-08T19:14:12.796 INFO:teuthology.orchestra.run.smithi097.stdout:Installing: 2021-10-08T19:14:12.796 INFO:teuthology.orchestra.run.smithi097.stdout: ceph x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 6.4 k 2021-10-08T19:14:12.797 INFO:teuthology.orchestra.run.smithi097.stdout:Installing dependencies: 2021-10-08T19:14:12.797 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mds x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 2.3 M 2021-10-08T19:14:12.797 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 1.5 M 2021-10-08T19:14:12.797 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-modules-core noarch 2:17.0.0-8087.g103b6cc3.el8 ceph-noarch 214 k 2021-10-08T19:14:12.797 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mon x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 3.9 M 2021-10-08T19:14:12.798 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-osd x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 17 M 2021-10-08T19:14:12.798 INFO:teuthology.orchestra.run.smithi097.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2021-10-08T19:14:12.799 INFO:teuthology.orchestra.run.smithi097.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2021-10-08T19:14:12.799 INFO:teuthology.orchestra.run.smithi097.stdout: python3-chardet noarch 3.0.4-7.el8 CentOS-Base 195 k 2021-10-08T19:14:12.811 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2021-10-08T19:14:12.811 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2021-10-08T19:14:12.811 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2021-10-08T19:14:12.811 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2021-10-08T19:14:12.812 INFO:teuthology.orchestra.run.smithi097.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2021-10-08T19:14:12.812 INFO:teuthology.orchestra.run.smithi097.stdout: python3-lxml x86_64 4.2.3-2.el8 CentOS-AppStream 1.5 M 2021-10-08T19:14:12.812 INFO:teuthology.orchestra.run.smithi097.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2021-10-08T19:14:12.812 INFO:teuthology.orchestra.run.smithi097.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2021-10-08T19:14:12.813 INFO:teuthology.orchestra.run.smithi097.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2021-10-08T19:14:12.813 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2021-10-08T19:14:12.813 INFO:teuthology.orchestra.run.smithi097.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2021-10-08T19:14:12.813 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pysocks noarch 1.6.8-3.el8 CentOS-Base 34 k 2021-10-08T19:14:12.814 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2021-10-08T19:14:12.814 INFO:teuthology.orchestra.run.smithi097.stdout: python3-requests noarch 2.20.0-2.1.el8_1 CentOS-Base 123 k 2021-10-08T19:14:12.814 INFO:teuthology.orchestra.run.smithi097.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2021-10-08T19:14:12.814 INFO:teuthology.orchestra.run.smithi097.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2021-10-08T19:14:12.815 INFO:teuthology.orchestra.run.smithi097.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2021-10-08T19:14:12.815 INFO:teuthology.orchestra.run.smithi097.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2021-10-08T19:14:12.815 INFO:teuthology.orchestra.run.smithi097.stdout: python3-urllib3 noarch 1.24.2-5.el8 CentOS-Base 177 k 2021-10-08T19:14:12.815 INFO:teuthology.orchestra.run.smithi097.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2021-10-08T19:14:12.816 INFO:teuthology.orchestra.run.smithi097.stdout: python3-webencodings noarch 0.5.1-6.el8 CentOS-AppStream 27 k 2021-10-08T19:14:12.816 INFO:teuthology.orchestra.run.smithi097.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2021-10-08T19:14:12.816 INFO:teuthology.orchestra.run.smithi097.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2021-10-08T19:14:12.817 INFO:teuthology.orchestra.run.smithi097.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2021-10-08T19:14:12.817 INFO:teuthology.orchestra.run.smithi097.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2021-10-08T19:14:12.817 INFO:teuthology.orchestra.run.smithi097.stdout:Installing weak dependencies: 2021-10-08T19:14:12.817 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cssselect noarch 0.9.2-10.el8 epel 40 k 2021-10-08T19:14:12.817 INFO:teuthology.orchestra.run.smithi097.stdout: python3-html5lib noarch 1:0.999999999-6.el8 CentOS-AppStream 214 k 2021-10-08T19:14:12.818 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:14:12.818 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction Summary 2021-10-08T19:14:12.818 INFO:teuthology.orchestra.run.smithi097.stdout:======================================================================================= 2021-10-08T19:14:12.818 INFO:teuthology.orchestra.run.smithi097.stdout:Install 36 Packages 2021-10-08T19:14:12.819 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:14:12.819 INFO:teuthology.orchestra.run.smithi097.stdout:Total download size: 29 M 2021-10-08T19:14:12.819 INFO:teuthology.orchestra.run.smithi097.stdout:Installed size: 115 M 2021-10-08T19:14:12.819 INFO:teuthology.orchestra.run.smithi097.stdout:Downloading Packages: 2021-10-08T19:14:12.943 INFO:teuthology.orchestra.run.smithi097.stdout:(1/36): ceph-17.0.0-8087.g103b6cc3.el8.x86_64.r 43 kB/s | 6.4 kB 00:00 2021-10-08T19:14:12.947 INFO:teuthology.orchestra.run.smithi117.stdout:(2/36): ceph-mgr-17.0.0-8087.g103b6cc3.el8.x86_ 4.9 MB/s | 1.5 MB 00:00 2021-10-08T19:14:13.049 INFO:teuthology.orchestra.run.smithi117.stdout:(3/36): ceph-mds-17.0.0-8087.g103b6cc3.el8.x86_ 5.4 MB/s | 2.3 MB 00:00 2021-10-08T19:14:13.123 INFO:teuthology.orchestra.run.smithi117.stdout:(4/36): ceph-mgr-modules-core-17.0.0-8087.g103b 3.0 MB/s | 214 kB 00:00 2021-10-08T19:14:13.153 INFO:teuthology.orchestra.run.smithi117.stdout:(5/36): python3-html5lib-0.999999999-6.el8.noar 6.7 MB/s | 214 kB 00:00 2021-10-08T19:14:13.174 INFO:teuthology.orchestra.run.smithi117.stdout:(6/36): ceph-mon-17.0.0-8087.g103b6cc3.el8.x86_ 8.8 MB/s | 3.9 MB 00:00 2021-10-08T19:14:13.179 INFO:teuthology.orchestra.run.smithi117.stdout:(7/36): python3-lxml-4.2.3-2.el8.x86_64.rpm 53 MB/s | 1.5 MB 00:00 2021-10-08T19:14:13.192 INFO:teuthology.orchestra.run.smithi117.stdout:(8/36): python3-markupsafe-0.23-19.el8.x86_64.r 28 MB/s | 39 kB 00:00 2021-10-08T19:14:13.192 INFO:teuthology.orchestra.run.smithi117.stdout:(9/36): python3-pytz-2017.2-9.el8.noarch.rpm 38 MB/s | 54 kB 00:00 2021-10-08T19:14:13.193 INFO:teuthology.orchestra.run.smithi117.stdout:(10/36): python3-webencodings-0.5.1-6.el8.noarc 26 MB/s | 27 kB 00:00 2021-10-08T19:14:13.195 INFO:teuthology.orchestra.run.smithi117.stdout:(11/36): python3-werkzeug-0.12.2-4.el8.noarch.r 76 MB/s | 457 kB 00:00 2021-10-08T19:14:13.204 INFO:teuthology.orchestra.run.smithi117.stdout:(12/36): python3-chardet-3.0.4-7.el8.noarch.rpm 61 MB/s | 195 kB 00:00 2021-10-08T19:14:13.204 INFO:teuthology.orchestra.run.smithi117.stdout:(13/36): python3-pysocks-1.6.8-3.el8.noarch.rpm 29 MB/s | 34 kB 00:00 2021-10-08T19:14:13.205 INFO:teuthology.orchestra.run.smithi117.stdout:(14/36): python3-requests-2.20.0-2.1.el8_1.noar 54 MB/s | 123 kB 00:00 2021-10-08T19:14:13.205 INFO:teuthology.orchestra.run.smithi117.stdout:(15/36): python3-urllib3-1.24.2-5.el8.noarch.rp 53 MB/s | 177 kB 00:00 2021-10-08T19:14:13.211 INFO:teuthology.orchestra.run.smithi117.stdout:(16/36): python3-mako-1.0.6-13.el8.noarch.rpm 4.5 MB/s | 157 kB 00:00 2021-10-08T19:14:13.317 INFO:teuthology.orchestra.run.smithi117.stdout:(17/36): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 394 kB/s | 44 kB 00:00 2021-10-08T19:14:13.335 INFO:teuthology.orchestra.run.smithi117.stdout:(18/36): python3-beautifulsoup4-4.6.3-2.el8.1.n 1.4 MB/s | 185 kB 00:00 2021-10-08T19:14:13.388 INFO:teuthology.orchestra.run.smithi117.stdout:(19/36): python3-cherrypy-18.4.0-1.el8.noarch.r 7.3 MB/s | 384 kB 00:00 2021-10-08T19:14:13.399 INFO:teuthology.orchestra.run.smithi117.stdout:(20/36): python3-cheroot-8.5.2-1.el8.noarch.rpm 2.0 MB/s | 173 kB 00:00 2021-10-08T19:14:13.411 INFO:teuthology.orchestra.run.smithi117.stdout:(21/36): python3-cssselect-0.9.2-10.el8.noarch. 1.6 MB/s | 40 kB 00:00 2021-10-08T19:14:13.428 INFO:teuthology.orchestra.run.smithi117.stdout:(22/36): python3-jaraco-6.2-6.el8.noarch.rpm 395 kB/s | 11 kB 00:00 2021-10-08T19:14:13.436 INFO:teuthology.orchestra.run.smithi117.stdout:(23/36): python3-jaraco-functools-2.0-4.el8.noa 717 kB/s | 18 kB 00:00 2021-10-08T19:14:13.464 INFO:teuthology.orchestra.run.smithi117.stdout:(24/36): python3-logutils-0.3.5-11.el8.noarch.r 1.7 MB/s | 49 kB 00:00 2021-10-08T19:14:13.464 INFO:teuthology.orchestra.run.smithi117.stdout:(25/36): python3-more-itertools-7.2.0-3.el8.noa 2.3 MB/s | 59 kB 00:00 2021-10-08T19:14:13.487 INFO:teuthology.orchestra.run.smithi117.stdout:(26/36): python3-portend-2.6-1.el8.noarch.rpm 589 kB/s | 16 kB 00:00 2021-10-08T19:14:13.513 INFO:teuthology.orchestra.run.smithi117.stdout:(27/36): python3-pecan-1.3.2-9.el8.noarch.rpm 4.9 MB/s | 283 kB 00:00 2021-10-08T19:14:13.513 INFO:teuthology.orchestra.run.smithi117.stdout:(28/36): python3-simplegeneric-0.8.1-17.el8.noa 732 kB/s | 19 kB 00:00 2021-10-08T19:14:13.546 INFO:teuthology.orchestra.run.smithi117.stdout:(29/36): python3-tempora-1.14.1-5.el8.noarch.rp 1.1 MB/s | 29 kB 00:00 2021-10-08T19:14:13.546 INFO:teuthology.orchestra.run.smithi117.stdout:(30/36): python3-singledispatch-3.4.0.3-18.el8. 856 kB/s | 24 kB 00:00 2021-10-08T19:14:13.565 INFO:teuthology.orchestra.run.smithi117.stdout:(31/36): python3-trustme-0.6.0-4.el8.noarch.rpm 1.1 MB/s | 27 kB 00:00 2021-10-08T19:14:13.572 INFO:teuthology.orchestra.run.smithi117.stdout:(32/36): python3-waitress-1.2.1-2.el8.1.noarch. 7.5 MB/s | 241 kB 00:00 2021-10-08T19:14:13.593 INFO:teuthology.orchestra.run.smithi117.stdout:(33/36): python3-webob-1.8.5-1.el8.1.noarch.rpm 8.6 MB/s | 251 kB 00:00 2021-10-08T19:14:13.602 INFO:teuthology.orchestra.run.smithi117.stdout:(34/36): python3-webtest-2.0.33-1.el8.noarch.rp 2.9 MB/s | 85 kB 00:00 2021-10-08T19:14:13.630 INFO:teuthology.orchestra.run.smithi117.stdout:(35/36): python3-zc-lockfile-2.0-2.el8.noarch.r 919 kB/s | 23 kB 00:00 2021-10-08T19:14:13.845 INFO:teuthology.orchestra.run.smithi117.stdout:(36/36): ceph-osd-17.0.0-8087.g103b6cc3.el8.x86 19 MB/s | 17 MB 00:00 2021-10-08T19:14:13.850 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:14:13.850 INFO:teuthology.orchestra.run.smithi117.stdout:Total 24 MB/s | 29 MB 00:01 2021-10-08T19:14:13.859 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2021-10-08T19:14:13.883 INFO:teuthology.orchestra.run.smithi097.stdout:(2/36): ceph-mgr-17.0.0-8087.g103b6cc3.el8.x86_ 1.4 MB/s | 1.5 MB 00:01 2021-10-08T19:14:13.898 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2021-10-08T19:14:13.898 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2021-10-08T19:14:14.041 INFO:teuthology.orchestra.run.smithi097.stdout:(3/36): ceph-mds-17.0.0-8087.g103b6cc3.el8.x86_ 1.8 MB/s | 2.3 MB 00:01 2021-10-08T19:14:14.090 INFO:teuthology.orchestra.run.smithi097.stdout:(4/36): ceph-mgr-modules-core-17.0.0-8087.g103b 4.3 MB/s | 214 kB 00:00 2021-10-08T19:14:14.110 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2021-10-08T19:14:14.112 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2021-10-08T19:14:14.122 INFO:teuthology.orchestra.run.smithi097.stdout:(5/36): python3-html5lib-0.999999999-6.el8.noar 6.6 MB/s | 214 kB 00:00 2021-10-08T19:14:14.141 INFO:teuthology.orchestra.run.smithi097.stdout:(6/36): python3-lxml-4.2.3-2.el8.x86_64.rpm 82 MB/s | 1.5 MB 00:00 2021-10-08T19:14:14.143 INFO:teuthology.orchestra.run.smithi097.stdout:(7/36): python3-mako-1.0.6-13.el8.noarch.rpm 58 MB/s | 157 kB 00:00 2021-10-08T19:14:14.153 INFO:teuthology.orchestra.run.smithi097.stdout:(8/36): python3-markupsafe-0.23-19.el8.x86_64.r 33 MB/s | 39 kB 00:00 2021-10-08T19:14:14.153 INFO:teuthology.orchestra.run.smithi097.stdout:(9/36): python3-pytz-2017.2-9.el8.noarch.rpm 37 MB/s | 54 kB 00:00 2021-10-08T19:14:14.154 INFO:teuthology.orchestra.run.smithi097.stdout:(10/36): python3-webencodings-0.5.1-6.el8.noarc 26 MB/s | 27 kB 00:00 2021-10-08T19:14:14.176 INFO:teuthology.orchestra.run.smithi097.stdout:(11/36): python3-werkzeug-0.12.2-4.el8.noarch.r 76 MB/s | 457 kB 00:00 2021-10-08T19:14:14.177 INFO:teuthology.orchestra.run.smithi097.stdout:(12/36): python3-chardet-3.0.4-7.el8.noarch.rpm 68 MB/s | 195 kB 00:00 2021-10-08T19:14:14.177 INFO:teuthology.orchestra.run.smithi097.stdout:(13/36): python3-pysocks-1.6.8-3.el8.noarch.rpm 30 MB/s | 34 kB 00:00 2021-10-08T19:14:14.178 INFO:teuthology.orchestra.run.smithi097.stdout:(14/36): python3-requests-2.20.0-2.1.el8_1.noar 56 MB/s | 123 kB 00:00 2021-10-08T19:14:14.178 INFO:teuthology.orchestra.run.smithi097.stdout:(15/36): python3-urllib3-1.24.2-5.el8.noarch.rp 62 MB/s | 177 kB 00:00 2021-10-08T19:14:14.220 INFO:teuthology.orchestra.run.smithi097.stdout:(16/36): ceph-mon-17.0.0-8087.g103b6cc3.el8.x86 3.0 MB/s | 3.9 MB 00:01 2021-10-08T19:14:14.271 INFO:teuthology.orchestra.run.smithi097.stdout:(17/36): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 439 kB/s | 44 kB 00:00 2021-10-08T19:14:14.343 INFO:teuthology.orchestra.run.smithi097.stdout:(18/36): python3-cheroot-8.5.2-1.el8.noarch.rpm 2.3 MB/s | 173 kB 00:00 2021-10-08T19:14:14.359 INFO:teuthology.orchestra.run.smithi097.stdout:(19/36): python3-beautifulsoup4-4.6.3-2.el8.1.n 1.3 MB/s | 185 kB 00:00 2021-10-08T19:14:14.388 INFO:teuthology.orchestra.run.smithi097.stdout:(20/36): python3-cssselect-0.9.2-10.el8.noarch. 1.4 MB/s | 40 kB 00:00 2021-10-08T19:14:14.389 INFO:teuthology.orchestra.run.smithi097.stdout:(21/36): python3-cherrypy-18.4.0-1.el8.noarch.r 7.2 MB/s | 384 kB 00:00 2021-10-08T19:14:14.414 INFO:teuthology.orchestra.run.smithi097.stdout:(22/36): python3-jaraco-6.2-6.el8.noarch.rpm 450 kB/s | 11 kB 00:00 2021-10-08T19:14:14.426 INFO:teuthology.orchestra.run.smithi097.stdout:(23/36): python3-jaraco-functools-2.0-4.el8.noa 634 kB/s | 18 kB 00:00 2021-10-08T19:14:14.439 INFO:teuthology.orchestra.run.smithi097.stdout:(24/36): python3-logutils-0.3.5-11.el8.noarch.r 1.9 MB/s | 49 kB 00:00 2021-10-08T19:14:14.446 INFO:teuthology.orchestra.run.smithi097.stdout:(25/36): python3-more-itertools-7.2.0-3.el8.noa 2.0 MB/s | 59 kB 00:00 2021-10-08T19:14:14.472 INFO:teuthology.orchestra.run.smithi097.stdout:(26/36): python3-pecan-1.3.2-9.el8.noarch.rpm 10 MB/s | 283 kB 00:00 2021-10-08T19:14:14.474 INFO:teuthology.orchestra.run.smithi097.stdout:(27/36): python3-portend-2.6-1.el8.noarch.rpm 559 kB/s | 16 kB 00:00 2021-10-08T19:14:14.492 INFO:teuthology.orchestra.run.smithi097.stdout:(28/36): python3-simplegeneric-0.8.1-17.el8.noa 756 kB/s | 19 kB 00:00 2021-10-08T19:14:14.503 INFO:teuthology.orchestra.run.smithi097.stdout:(29/36): python3-singledispatch-3.4.0.3-18.el8. 859 kB/s | 24 kB 00:00 2021-10-08T19:14:14.517 INFO:teuthology.orchestra.run.smithi097.stdout:(30/36): python3-tempora-1.14.1-5.el8.noarch.rp 1.2 MB/s | 29 kB 00:00 2021-10-08T19:14:14.535 INFO:teuthology.orchestra.run.smithi097.stdout:(31/36): python3-trustme-0.6.0-4.el8.noarch.rpm 978 kB/s | 27 kB 00:00 2021-10-08T19:14:14.554 INFO:teuthology.orchestra.run.smithi097.stdout:(32/36): python3-waitress-1.2.1-2.el8.1.noarch. 8.4 MB/s | 241 kB 00:00 2021-10-08T19:14:14.570 INFO:teuthology.orchestra.run.smithi097.stdout:(33/36): python3-webtest-2.0.33-1.el8.noarch.rp 3.3 MB/s | 85 kB 00:00 2021-10-08T19:14:14.587 INFO:teuthology.orchestra.run.smithi097.stdout:(34/36): python3-webob-1.8.5-1.el8.1.noarch.rpm 4.3 MB/s | 251 kB 00:00 2021-10-08T19:14:14.596 INFO:teuthology.orchestra.run.smithi097.stdout:(35/36): python3-zc-lockfile-2.0-2.el8.noarch.r 921 kB/s | 23 kB 00:00 2021-10-08T19:14:15.040 INFO:teuthology.orchestra.run.smithi097.stdout:(36/36): ceph-osd-17.0.0-8087.g103b6cc3.el8.x86 14 MB/s | 17 MB 00:01 2021-10-08T19:14:15.043 INFO:teuthology.orchestra.run.smithi097.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:14:15.044 INFO:teuthology.orchestra.run.smithi097.stdout:Total 13 MB/s | 29 MB 00:02 2021-10-08T19:14:15.053 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction check 2021-10-08T19:14:15.092 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction check succeeded. 2021-10-08T19:14:15.092 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction test 2021-10-08T19:14:15.310 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction test succeeded. 2021-10-08T19:14:15.311 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction 2021-10-08T19:14:15.397 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2021-10-08T19:14:15.597 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/36 2021-10-08T19:14:15.793 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/36 2021-10-08T19:14:16.024 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/36 2021-10-08T19:14:16.184 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 4/36 2021-10-08T19:14:16.365 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 5/36 2021-10-08T19:14:16.512 INFO:teuthology.orchestra.run.smithi097.stdout: Preparing : 1/1 2021-10-08T19:14:16.522 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 6/36 2021-10-08T19:14:16.669 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 7/36 2021-10-08T19:14:16.760 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/36 2021-10-08T19:14:16.853 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 8/36 2021-10-08T19:14:16.952 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/36 2021-10-08T19:14:16.974 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 9/36 2021-10-08T19:14:17.191 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 10/36 2021-10-08T19:14:17.218 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/36 2021-10-08T19:14:17.412 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 11/36 2021-10-08T19:14:17.440 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 4/36 2021-10-08T19:14:17.571 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 12/36 2021-10-08T19:14:17.609 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 5/36 2021-10-08T19:14:17.748 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 6/36 2021-10-08T19:14:17.775 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 13/36 2021-10-08T19:14:17.996 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 7/36 2021-10-08T19:14:18.002 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pysocks-1.6.8-3.el8.noarch 14/36 2021-10-08T19:14:18.164 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 8/36 2021-10-08T19:14:18.231 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-urllib3-1.24.2-5.el8.noarch 15/36 2021-10-08T19:14:18.308 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 9/36 2021-10-08T19:14:18.415 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-chardet-3.0.4-7.el8.noarch 16/36 2021-10-08T19:14:18.553 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 10/36 2021-10-08T19:14:18.671 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-requests-2.20.0-2.1.el8_1.noarch 17/36 2021-10-08T19:14:18.747 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 11/36 2021-10-08T19:14:18.907 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 18/36 2021-10-08T19:14:18.946 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 12/36 2021-10-08T19:14:19.104 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 19/36 2021-10-08T19:14:19.168 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 13/36 2021-10-08T19:14:19.304 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 20/36 2021-10-08T19:14:19.415 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-pysocks-1.6.8-3.el8.noarch 14/36 2021-10-08T19:14:19.653 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-urllib3-1.24.2-5.el8.noarch 15/36 2021-10-08T19:14:19.693 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 21/36 2021-10-08T19:14:19.857 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-chardet-3.0.4-7.el8.noarch 16/36 2021-10-08T19:14:19.986 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-lxml-4.2.3-2.el8.x86_64 22/36 2021-10-08T19:14:20.155 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 23/36 2021-10-08T19:14:20.172 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-requests-2.20.0-2.1.el8_1.noarch 17/36 2021-10-08T19:14:20.368 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/36 2021-10-08T19:14:20.387 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 18/36 2021-10-08T19:14:20.571 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 25/36 2021-10-08T19:14:20.622 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 19/36 2021-10-08T19:14:20.809 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-portend-2.6-1.el8.noarch 26/36 2021-10-08T19:14:20.857 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 20/36 2021-10-08T19:14:21.013 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 27/36 2021-10-08T19:14:21.237 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/36 2021-10-08T19:14:21.286 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 21/36 2021-10-08T19:14:21.591 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 29/36 2021-10-08T19:14:21.615 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-lxml-4.2.3-2.el8.x86_64 22/36 2021-10-08T19:14:21.849 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 23/36 2021-10-08T19:14:21.913 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 30/36 2021-10-08T19:14:22.029 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/36 2021-10-08T19:14:22.215 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 25/36 2021-10-08T19:14:22.311 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-modules-core-2:17.0.0-8087.g103b6cc3.el8. 31/36 2021-10-08T19:14:22.487 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-2:17.0.0-8087.g103b6cc3.el8.x86_64 32/36 2021-10-08T19:14:22.528 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-portend-2.6-1.el8.noarch 26/36 2021-10-08T19:14:22.789 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 27/36 2021-10-08T19:14:23.032 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/36 2021-10-08T19:14:23.446 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 29/36 2021-10-08T19:14:23.815 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 30/36 2021-10-08T19:14:23.962 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-2:17.0.0-8087.g103b6cc3.el8.x86_64 32/36 2021-10-08T19:14:24.159 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-osd-2:17.0.0-8087.g103b6cc3.el8.x86_64 33/36 2021-10-08T19:14:24.266 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-mgr-modules-core-2:17.0.0-8087.g103b6cc3.el8. 31/36 2021-10-08T19:14:24.522 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-mgr-2:17.0.0-8087.g103b6cc3.el8.x86_64 32/36 2021-10-08T19:14:24.547 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-osd-2:17.0.0-8087.g103b6cc3.el8.x86_64 33/36 2021-10-08T19:14:24.715 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mon-2:17.0.0-8087.g103b6cc3.el8.x86_64 34/36 2021-10-08T19:14:24.929 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mon-2:17.0.0-8087.g103b6cc3.el8.x86_64 34/36 2021-10-08T19:14:25.115 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mds-2:17.0.0-8087.g103b6cc3.el8.x86_64 35/36 2021-10-08T19:14:25.131 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mds-2:17.0.0-8087.g103b6cc3.el8.x86_64 35/36 2021-10-08T19:14:25.239 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-2:17.0.0-8087.g103b6cc3.el8.x86_64 36/36 2021-10-08T19:14:25.589 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-2:17.0.0-8087.g103b6cc3.el8.x86_64 36/36 2021-10-08T19:14:25.589 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/36 2021-10-08T19:14:25.589 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mds-2:17.0.0-8087.g103b6cc3.el8.x86_64 2/36 2021-10-08T19:14:25.590 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-2:17.0.0-8087.g103b6cc3.el8.x86_64 3/36 2021-10-08T19:14:25.590 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mon-2:17.0.0-8087.g103b6cc3.el8.x86_64 4/36 2021-10-08T19:14:25.590 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-osd-2:17.0.0-8087.g103b6cc3.el8.x86_64 5/36 2021-10-08T19:14:25.590 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-modules-core-2:17.0.0-8087.g103b6cc3.el8. 6/36 2021-10-08T19:14:25.591 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 7/36 2021-10-08T19:14:25.591 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-lxml-4.2.3-2.el8.x86_64 8/36 2021-10-08T19:14:25.591 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 9/36 2021-10-08T19:14:25.591 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 10/36 2021-10-08T19:14:25.591 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 11/36 2021-10-08T19:14:25.592 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 12/36 2021-10-08T19:14:25.592 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 13/36 2021-10-08T19:14:25.592 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-chardet-3.0.4-7.el8.noarch 14/36 2021-10-08T19:14:25.593 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pysocks-1.6.8-3.el8.noarch 15/36 2021-10-08T19:14:25.593 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-requests-2.20.0-2.1.el8_1.noarch 16/36 2021-10-08T19:14:25.593 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-urllib3-1.24.2-5.el8.noarch 17/36 2021-10-08T19:14:25.593 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/36 2021-10-08T19:14:25.594 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 19/36 2021-10-08T19:14:25.594 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 20/36 2021-10-08T19:14:25.594 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 21/36 2021-10-08T19:14:25.595 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 22/36 2021-10-08T19:14:25.595 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 23/36 2021-10-08T19:14:25.596 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 24/36 2021-10-08T19:14:25.596 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 25/36 2021-10-08T19:14:25.596 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 26/36 2021-10-08T19:14:25.597 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 27/36 2021-10-08T19:14:25.598 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-portend-2.6-1.el8.noarch 28/36 2021-10-08T19:14:25.599 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 29/36 2021-10-08T19:14:25.600 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 30/36 2021-10-08T19:14:25.600 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 31/36 2021-10-08T19:14:25.601 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 32/36 2021-10-08T19:14:25.601 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 33/36 2021-10-08T19:14:25.601 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 34/36 2021-10-08T19:14:25.601 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 35/36 2021-10-08T19:14:26.001 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-mgr-2:17.0.0-8087.g103b6cc3.el8.x86_64 32/36 2021-10-08T19:14:26.256 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-osd-2:17.0.0-8087.g103b6cc3.el8.x86_64 33/36 2021-10-08T19:14:26.381 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 36/36 2021-10-08T19:14:26.382 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:14:26.383 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2021-10-08T19:14:26.384 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:14:26.384 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mds-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:14:26.384 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:14:26.385 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-modules-core-2:17.0.0-8087.g103b6cc3.el8.noarch 2021-10-08T19:14:26.386 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mon-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:14:26.386 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-osd-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:14:26.391 INFO:teuthology.orchestra.run.smithi117.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2021-10-08T19:14:26.391 INFO:teuthology.orchestra.run.smithi117.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2021-10-08T19:14:26.391 INFO:teuthology.orchestra.run.smithi117.stdout: python3-chardet-3.0.4-7.el8.noarch 2021-10-08T19:14:26.391 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cheroot-8.5.2-1.el8.noarch 2021-10-08T19:14:26.392 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2021-10-08T19:14:26.392 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cssselect-0.9.2-10.el8.noarch 2021-10-08T19:14:26.392 INFO:teuthology.orchestra.run.smithi117.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2021-10-08T19:14:26.393 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-6.2-6.el8.noarch 2021-10-08T19:14:26.393 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2021-10-08T19:14:26.393 INFO:teuthology.orchestra.run.smithi117.stdout: python3-logutils-0.3.5-11.el8.noarch 2021-10-08T19:14:26.393 INFO:teuthology.orchestra.run.smithi117.stdout: python3-lxml-4.2.3-2.el8.x86_64 2021-10-08T19:14:26.393 INFO:teuthology.orchestra.run.smithi117.stdout: python3-mako-1.0.6-13.el8.noarch 2021-10-08T19:14:26.394 INFO:teuthology.orchestra.run.smithi117.stdout: python3-markupsafe-0.23-19.el8.x86_64 2021-10-08T19:14:26.394 INFO:teuthology.orchestra.run.smithi117.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2021-10-08T19:14:26.394 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pecan-1.3.2-9.el8.noarch 2021-10-08T19:14:26.394 INFO:teuthology.orchestra.run.smithi117.stdout: python3-portend-2.6-1.el8.noarch 2021-10-08T19:14:26.395 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pysocks-1.6.8-3.el8.noarch 2021-10-08T19:14:26.395 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pytz-2017.2-9.el8.noarch 2021-10-08T19:14:26.395 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-2.20.0-2.1.el8_1.noarch 2021-10-08T19:14:26.395 INFO:teuthology.orchestra.run.smithi117.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2021-10-08T19:14:26.395 INFO:teuthology.orchestra.run.smithi117.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2021-10-08T19:14:26.396 INFO:teuthology.orchestra.run.smithi117.stdout: python3-tempora-1.14.1-5.el8.noarch 2021-10-08T19:14:26.396 INFO:teuthology.orchestra.run.smithi117.stdout: python3-trustme-0.6.0-4.el8.noarch 2021-10-08T19:14:26.396 INFO:teuthology.orchestra.run.smithi117.stdout: python3-urllib3-1.24.2-5.el8.noarch 2021-10-08T19:14:26.396 INFO:teuthology.orchestra.run.smithi117.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2021-10-08T19:14:26.396 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webencodings-0.5.1-6.el8.noarch 2021-10-08T19:14:26.397 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webob-1.8.5-1.el8.1.noarch 2021-10-08T19:14:26.397 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webtest-2.0.33-1.el8.noarch 2021-10-08T19:14:26.397 INFO:teuthology.orchestra.run.smithi117.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2021-10-08T19:14:26.398 INFO:teuthology.orchestra.run.smithi117.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2021-10-08T19:14:26.398 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:14:26.398 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2021-10-08T19:14:26.631 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-base 2021-10-08T19:14:26.643 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-osd-2:17.0.0-8087.g103b6cc3.el8.x86_64 33/36 2021-10-08T19:14:27.129 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:01:05 ago on Fri 08 Oct 2021 07:13:22 PM UTC. 2021-10-08T19:14:27.269 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-mon-2:17.0.0-8087.g103b6cc3.el8.x86_64 34/36 2021-10-08T19:14:27.491 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-mon-2:17.0.0-8087.g103b6cc3.el8.x86_64 34/36 2021-10-08T19:14:27.596 INFO:teuthology.orchestra.run.smithi117.stdout:Package ceph-base-2:17.0.0-8087.g103b6cc3.el8.x86_64 is already installed. 2021-10-08T19:14:27.709 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-mds-2:17.0.0-8087.g103b6cc3.el8.x86_64 35/36 2021-10-08T19:14:27.758 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-mds-2:17.0.0-8087.g103b6cc3.el8.x86_64 35/36 2021-10-08T19:14:27.778 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2021-10-08T19:14:27.780 INFO:teuthology.orchestra.run.smithi117.stdout:Nothing to do. 2021-10-08T19:14:27.781 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2021-10-08T19:14:27.845 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install cephadm 2021-10-08T19:14:27.849 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-2:17.0.0-8087.g103b6cc3.el8.x86_64 36/36 2021-10-08T19:14:28.203 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-2:17.0.0-8087.g103b6cc3.el8.x86_64 36/36 2021-10-08T19:14:28.204 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/36 2021-10-08T19:14:28.204 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-mds-2:17.0.0-8087.g103b6cc3.el8.x86_64 2/36 2021-10-08T19:14:28.204 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-mgr-2:17.0.0-8087.g103b6cc3.el8.x86_64 3/36 2021-10-08T19:14:28.205 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-mon-2:17.0.0-8087.g103b6cc3.el8.x86_64 4/36 2021-10-08T19:14:28.205 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-osd-2:17.0.0-8087.g103b6cc3.el8.x86_64 5/36 2021-10-08T19:14:28.205 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-mgr-modules-core-2:17.0.0-8087.g103b6cc3.el8. 6/36 2021-10-08T19:14:28.205 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 7/36 2021-10-08T19:14:28.205 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-lxml-4.2.3-2.el8.x86_64 8/36 2021-10-08T19:14:28.206 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 9/36 2021-10-08T19:14:28.206 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 10/36 2021-10-08T19:14:28.206 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 11/36 2021-10-08T19:14:28.207 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 12/36 2021-10-08T19:14:28.207 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 13/36 2021-10-08T19:14:28.207 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-chardet-3.0.4-7.el8.noarch 14/36 2021-10-08T19:14:28.207 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-pysocks-1.6.8-3.el8.noarch 15/36 2021-10-08T19:14:28.208 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-requests-2.20.0-2.1.el8_1.noarch 16/36 2021-10-08T19:14:28.208 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-urllib3-1.24.2-5.el8.noarch 17/36 2021-10-08T19:14:28.208 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/36 2021-10-08T19:14:28.209 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 19/36 2021-10-08T19:14:28.209 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 20/36 2021-10-08T19:14:28.209 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 21/36 2021-10-08T19:14:28.210 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 22/36 2021-10-08T19:14:28.210 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 23/36 2021-10-08T19:14:28.211 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 24/36 2021-10-08T19:14:28.211 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 25/36 2021-10-08T19:14:28.211 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 26/36 2021-10-08T19:14:28.211 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 27/36 2021-10-08T19:14:28.212 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-portend-2.6-1.el8.noarch 28/36 2021-10-08T19:14:28.212 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 29/36 2021-10-08T19:14:28.212 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 30/36 2021-10-08T19:14:28.213 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 31/36 2021-10-08T19:14:28.213 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 32/36 2021-10-08T19:14:28.213 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 33/36 2021-10-08T19:14:28.213 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 34/36 2021-10-08T19:14:28.215 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 35/36 2021-10-08T19:14:28.315 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:01:06 ago on Fri 08 Oct 2021 07:13:22 PM UTC. 2021-10-08T19:14:28.971 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2021-10-08T19:14:28.972 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2021-10-08T19:14:28.973 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2021-10-08T19:14:28.973 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2021-10-08T19:14:28.974 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2021-10-08T19:14:28.975 INFO:teuthology.orchestra.run.smithi117.stdout: cephadm noarch 2:17.0.0-8087.g103b6cc3.el8 ceph-noarch 66 k 2021-10-08T19:14:28.975 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:14:28.975 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2021-10-08T19:14:28.975 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2021-10-08T19:14:28.976 INFO:teuthology.orchestra.run.smithi117.stdout:Install 1 Package 2021-10-08T19:14:28.976 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:14:28.976 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 66 k 2021-10-08T19:14:28.976 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 291 k 2021-10-08T19:14:28.976 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2021-10-08T19:14:28.977 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 36/36 2021-10-08T19:14:28.977 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:14:28.978 INFO:teuthology.orchestra.run.smithi097.stdout:Installed: 2021-10-08T19:14:28.978 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:14:28.978 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mds-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:14:28.978 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:14:28.979 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-modules-core-2:17.0.0-8087.g103b6cc3.el8.noarch 2021-10-08T19:14:28.979 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mon-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:14:28.979 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-osd-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:14:28.979 INFO:teuthology.orchestra.run.smithi097.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2021-10-08T19:14:28.979 INFO:teuthology.orchestra.run.smithi097.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2021-10-08T19:14:28.980 INFO:teuthology.orchestra.run.smithi097.stdout: python3-chardet-3.0.4-7.el8.noarch 2021-10-08T19:14:28.980 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cheroot-8.5.2-1.el8.noarch 2021-10-08T19:14:28.980 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2021-10-08T19:14:28.980 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cssselect-0.9.2-10.el8.noarch 2021-10-08T19:14:28.981 INFO:teuthology.orchestra.run.smithi097.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2021-10-08T19:14:28.981 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco-6.2-6.el8.noarch 2021-10-08T19:14:28.981 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2021-10-08T19:14:28.981 INFO:teuthology.orchestra.run.smithi097.stdout: python3-logutils-0.3.5-11.el8.noarch 2021-10-08T19:14:28.981 INFO:teuthology.orchestra.run.smithi097.stdout: python3-lxml-4.2.3-2.el8.x86_64 2021-10-08T19:14:28.982 INFO:teuthology.orchestra.run.smithi097.stdout: python3-mako-1.0.6-13.el8.noarch 2021-10-08T19:14:28.982 INFO:teuthology.orchestra.run.smithi097.stdout: python3-markupsafe-0.23-19.el8.x86_64 2021-10-08T19:14:28.982 INFO:teuthology.orchestra.run.smithi097.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2021-10-08T19:14:28.983 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pecan-1.3.2-9.el8.noarch 2021-10-08T19:14:28.983 INFO:teuthology.orchestra.run.smithi097.stdout: python3-portend-2.6-1.el8.noarch 2021-10-08T19:14:28.983 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pysocks-1.6.8-3.el8.noarch 2021-10-08T19:14:28.983 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pytz-2017.2-9.el8.noarch 2021-10-08T19:14:28.984 INFO:teuthology.orchestra.run.smithi097.stdout: python3-requests-2.20.0-2.1.el8_1.noarch 2021-10-08T19:14:28.984 INFO:teuthology.orchestra.run.smithi097.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2021-10-08T19:14:28.984 INFO:teuthology.orchestra.run.smithi097.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2021-10-08T19:14:28.984 INFO:teuthology.orchestra.run.smithi097.stdout: python3-tempora-1.14.1-5.el8.noarch 2021-10-08T19:14:28.985 INFO:teuthology.orchestra.run.smithi097.stdout: python3-trustme-0.6.0-4.el8.noarch 2021-10-08T19:14:28.985 INFO:teuthology.orchestra.run.smithi097.stdout: python3-urllib3-1.24.2-5.el8.noarch 2021-10-08T19:14:28.985 INFO:teuthology.orchestra.run.smithi097.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2021-10-08T19:14:28.985 INFO:teuthology.orchestra.run.smithi097.stdout: python3-webencodings-0.5.1-6.el8.noarch 2021-10-08T19:14:28.985 INFO:teuthology.orchestra.run.smithi097.stdout: python3-webob-1.8.5-1.el8.1.noarch 2021-10-08T19:14:28.986 INFO:teuthology.orchestra.run.smithi097.stdout: python3-webtest-2.0.33-1.el8.noarch 2021-10-08T19:14:28.986 INFO:teuthology.orchestra.run.smithi097.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2021-10-08T19:14:28.986 INFO:teuthology.orchestra.run.smithi097.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2021-10-08T19:14:28.986 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:14:28.987 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2021-10-08T19:14:29.118 INFO:teuthology.orchestra.run.smithi117.stdout:cephadm-17.0.0-8087.g103b6cc3.el8.noarch.rpm 457 kB/s | 66 kB 00:00 2021-10-08T19:14:29.119 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:14:29.119 INFO:teuthology.orchestra.run.smithi117.stdout:Total 453 kB/s | 66 kB 00:00 2021-10-08T19:14:29.120 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2021-10-08T19:14:29.126 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2021-10-08T19:14:29.126 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2021-10-08T19:14:29.127 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2021-10-08T19:14:29.130 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2021-10-08T19:14:29.207 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2021-10-08T19:14:29.213 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum -y install ceph-base 2021-10-08T19:14:29.693 INFO:teuthology.orchestra.run.smithi097.stdout:Last metadata expiration check: 0:01:07 ago on Fri 08 Oct 2021 07:13:22 PM UTC. 2021-10-08T19:14:30.158 INFO:teuthology.orchestra.run.smithi097.stdout:Package ceph-base-2:17.0.0-8087.g103b6cc3.el8.x86_64 is already installed. 2021-10-08T19:14:30.336 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2021-10-08T19:14:30.336 INFO:teuthology.orchestra.run.smithi097.stdout:Nothing to do. 2021-10-08T19:14:30.337 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2021-10-08T19:14:30.404 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum -y install cephadm 2021-10-08T19:14:30.834 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: cephadm-2:17.0.0-8087.g103b6cc3.el8.noarch 1/1 2021-10-08T19:14:30.873 INFO:teuthology.orchestra.run.smithi097.stdout:Last metadata expiration check: 0:01:08 ago on Fri 08 Oct 2021 07:13:22 PM UTC. 2021-10-08T19:14:31.013 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : cephadm-2:17.0.0-8087.g103b6cc3.el8.noarch 1/1 2021-10-08T19:14:31.199 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: cephadm-2:17.0.0-8087.g103b6cc3.el8.noarch 1/1 2021-10-08T19:14:31.502 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : cephadm-2:17.0.0-8087.g103b6cc3.el8.noarch 1/1 2021-10-08T19:14:31.503 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:14:31.503 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2021-10-08T19:14:31.503 INFO:teuthology.orchestra.run.smithi117.stdout: cephadm-2:17.0.0-8087.g103b6cc3.el8.noarch 2021-10-08T19:14:31.503 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:14:31.503 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2021-10-08T19:14:31.521 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2021-10-08T19:14:31.522 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2021-10-08T19:14:31.522 INFO:teuthology.orchestra.run.smithi097.stdout: Package Arch Version Repository Size 2021-10-08T19:14:31.522 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2021-10-08T19:14:31.522 INFO:teuthology.orchestra.run.smithi097.stdout:Installing: 2021-10-08T19:14:31.523 INFO:teuthology.orchestra.run.smithi097.stdout: cephadm noarch 2:17.0.0-8087.g103b6cc3.el8 ceph-noarch 66 k 2021-10-08T19:14:31.523 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:14:31.523 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction Summary 2021-10-08T19:14:31.523 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2021-10-08T19:14:31.523 INFO:teuthology.orchestra.run.smithi097.stdout:Install 1 Package 2021-10-08T19:14:31.524 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:14:31.524 INFO:teuthology.orchestra.run.smithi097.stdout:Total download size: 66 k 2021-10-08T19:14:31.524 INFO:teuthology.orchestra.run.smithi097.stdout:Installed size: 291 k 2021-10-08T19:14:31.525 INFO:teuthology.orchestra.run.smithi097.stdout:Downloading Packages: 2021-10-08T19:14:31.664 INFO:teuthology.orchestra.run.smithi097.stdout:cephadm-17.0.0-8087.g103b6cc3.el8.noarch.rpm 458 kB/s | 66 kB 00:00 2021-10-08T19:14:31.758 INFO:teuthology.orchestra.run.smithi097.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:14:31.760 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-immutable-object-cache 2021-10-08T19:14:31.762 INFO:teuthology.orchestra.run.smithi097.stdout:Total 454 kB/s | 66 kB 00:00 2021-10-08T19:14:31.762 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction check 2021-10-08T19:14:31.762 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction check succeeded. 2021-10-08T19:14:31.763 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction test 2021-10-08T19:14:31.763 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction test succeeded. 2021-10-08T19:14:31.763 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction 2021-10-08T19:14:31.763 INFO:teuthology.orchestra.run.smithi097.stdout: Preparing : 1/1 2021-10-08T19:14:32.252 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:01:10 ago on Fri 08 Oct 2021 07:13:22 PM UTC. 2021-10-08T19:14:32.933 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2021-10-08T19:14:32.934 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2021-10-08T19:14:32.934 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repo Size 2021-10-08T19:14:32.934 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2021-10-08T19:14:32.934 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2021-10-08T19:14:32.935 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-immutable-object-cache x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 169 k 2021-10-08T19:14:32.935 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:14:32.935 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2021-10-08T19:14:32.935 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2021-10-08T19:14:32.936 INFO:teuthology.orchestra.run.smithi117.stdout:Install 1 Package 2021-10-08T19:14:32.936 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:14:32.936 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 169 k 2021-10-08T19:14:32.936 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 567 k 2021-10-08T19:14:32.936 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2021-10-08T19:14:33.101 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-immutable-object-cache-17.0.0-8087.g103b6c 1.0 MB/s | 169 kB 00:00 2021-10-08T19:14:33.101 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:14:33.102 INFO:teuthology.orchestra.run.smithi117.stdout:Total 1.0 MB/s | 169 kB 00:00 2021-10-08T19:14:33.102 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2021-10-08T19:14:33.114 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2021-10-08T19:14:33.114 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2021-10-08T19:14:33.162 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2021-10-08T19:14:33.165 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2021-10-08T19:14:33.314 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2021-10-08T19:14:33.516 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-immutable-object-cache-2:17.0.0-8087.g103b6cc3. 1/1 2021-10-08T19:14:33.680 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: cephadm-2:17.0.0-8087.g103b6cc3.el8.noarch 1/1 2021-10-08T19:14:33.900 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : cephadm-2:17.0.0-8087.g103b6cc3.el8.noarch 1/1 2021-10-08T19:14:33.900 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.0.0-8087.g103b6cc3. 1/1 2021-10-08T19:14:34.083 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: cephadm-2:17.0.0-8087.g103b6cc3.el8.noarch 1/1 2021-10-08T19:14:34.190 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-immutable-object-cache-2:17.0.0-8087.g103b6cc3. 1/1 2021-10-08T19:14:34.190 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:14:34.191 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2021-10-08T19:14:34.191 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-immutable-object-cache-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:14:34.191 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:14:34.191 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2021-10-08T19:14:34.362 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-mgr 2021-10-08T19:14:34.377 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : cephadm-2:17.0.0-8087.g103b6cc3.el8.noarch 1/1 2021-10-08T19:14:34.377 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:14:34.378 INFO:teuthology.orchestra.run.smithi097.stdout:Installed: 2021-10-08T19:14:34.378 INFO:teuthology.orchestra.run.smithi097.stdout: cephadm-2:17.0.0-8087.g103b6cc3.el8.noarch 2021-10-08T19:14:34.378 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:14:34.378 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2021-10-08T19:14:34.549 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum -y install ceph-immutable-object-cache 2021-10-08T19:14:34.846 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:01:12 ago on Fri 08 Oct 2021 07:13:22 PM UTC. 2021-10-08T19:14:35.037 INFO:teuthology.orchestra.run.smithi097.stdout:Last metadata expiration check: 0:01:13 ago on Fri 08 Oct 2021 07:13:22 PM UTC. 2021-10-08T19:14:35.345 INFO:teuthology.orchestra.run.smithi117.stdout:Package ceph-mgr-2:17.0.0-8087.g103b6cc3.el8.x86_64 is already installed. 2021-10-08T19:14:35.523 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2021-10-08T19:14:35.524 INFO:teuthology.orchestra.run.smithi117.stdout:Nothing to do. 2021-10-08T19:14:35.524 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2021-10-08T19:14:35.583 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-mgr-dashboard 2021-10-08T19:14:35.682 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2021-10-08T19:14:35.683 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2021-10-08T19:14:35.684 INFO:teuthology.orchestra.run.smithi097.stdout: Package Arch Version Repo Size 2021-10-08T19:14:35.684 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2021-10-08T19:14:35.684 INFO:teuthology.orchestra.run.smithi097.stdout:Installing: 2021-10-08T19:14:35.684 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-immutable-object-cache x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 169 k 2021-10-08T19:14:35.685 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:14:35.685 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction Summary 2021-10-08T19:14:35.685 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2021-10-08T19:14:35.686 INFO:teuthology.orchestra.run.smithi097.stdout:Install 1 Package 2021-10-08T19:14:35.686 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:14:35.686 INFO:teuthology.orchestra.run.smithi097.stdout:Total download size: 169 k 2021-10-08T19:14:35.687 INFO:teuthology.orchestra.run.smithi097.stdout:Installed size: 567 k 2021-10-08T19:14:35.687 INFO:teuthology.orchestra.run.smithi097.stdout:Downloading Packages: 2021-10-08T19:14:35.853 INFO:teuthology.orchestra.run.smithi097.stdout:ceph-immutable-object-cache-17.0.0-8087.g103b6c 1.0 MB/s | 169 kB 00:00 2021-10-08T19:14:35.853 INFO:teuthology.orchestra.run.smithi097.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:14:35.854 INFO:teuthology.orchestra.run.smithi097.stdout:Total 996 kB/s | 169 kB 00:00 2021-10-08T19:14:35.854 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction check 2021-10-08T19:14:35.865 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction check succeeded. 2021-10-08T19:14:35.866 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction test 2021-10-08T19:14:35.917 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction test succeeded. 2021-10-08T19:14:35.918 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction 2021-10-08T19:14:36.057 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:01:14 ago on Fri 08 Oct 2021 07:13:22 PM UTC. 2021-10-08T19:14:36.084 INFO:teuthology.orchestra.run.smithi097.stdout: Preparing : 1/1 2021-10-08T19:14:36.283 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-immutable-object-cache-2:17.0.0-8087.g103b6cc3. 1/1 2021-10-08T19:14:36.654 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.0.0-8087.g103b6cc3. 1/1 2021-10-08T19:14:36.734 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2021-10-08T19:14:36.735 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2021-10-08T19:14:36.735 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2021-10-08T19:14:36.736 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2021-10-08T19:14:36.736 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2021-10-08T19:14:36.736 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-dashboard noarch 2:17.0.0-8087.g103b6cc3.el8 ceph-noarch 1.5 M 2021-10-08T19:14:36.736 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2021-10-08T19:14:36.737 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-grafana-dashboards noarch 2:17.0.0-8087.g103b6cc3.el8 ceph-noarch 24 k 2021-10-08T19:14:36.737 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-prometheus-alerts noarch 2:17.0.0-8087.g103b6cc3.el8 ceph-noarch 8.9 k 2021-10-08T19:14:36.737 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jwt noarch 1.6.1-2.el8 CentOS-Base 43 k 2021-10-08T19:14:36.737 INFO:teuthology.orchestra.run.smithi117.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2021-10-08T19:14:36.737 INFO:teuthology.orchestra.run.smithi117.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2021-10-08T19:14:36.738 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:14:36.738 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2021-10-08T19:14:36.738 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2021-10-08T19:14:36.738 INFO:teuthology.orchestra.run.smithi117.stdout:Install 6 Packages 2021-10-08T19:14:36.739 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:14:36.739 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 1.8 M 2021-10-08T19:14:36.739 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 7.5 M 2021-10-08T19:14:36.739 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2021-10-08T19:14:36.847 INFO:teuthology.orchestra.run.smithi117.stdout:(1/6): ceph-prometheus-alerts-17.0.0-8087.g103b 82 kB/s | 8.9 kB 00:00 2021-10-08T19:14:36.860 INFO:teuthology.orchestra.run.smithi117.stdout:(2/6): ceph-grafana-dashboards-17.0.0-8087.g103 195 kB/s | 24 kB 00:00 2021-10-08T19:14:36.878 INFO:teuthology.orchestra.run.smithi117.stdout:(3/6): python3-jwt-1.6.1-2.el8.noarch.rpm 1.3 MB/s | 43 kB 00:00 2021-10-08T19:14:36.935 INFO:teuthology.orchestra.run.smithi117.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 449 kB/s | 34 kB 00:00 2021-10-08T19:14:36.952 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-immutable-object-cache-2:17.0.0-8087.g103b6cc3. 1/1 2021-10-08T19:14:36.953 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:14:36.953 INFO:teuthology.orchestra.run.smithi097.stdout:Installed: 2021-10-08T19:14:36.953 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-immutable-object-cache-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:14:36.953 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:14:36.954 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2021-10-08T19:14:37.005 INFO:teuthology.orchestra.run.smithi117.stdout:(5/6): ceph-mgr-dashboard-17.0.0-8087.g103b6cc3 5.7 MB/s | 1.5 MB 00:00 2021-10-08T19:14:37.026 INFO:teuthology.orchestra.run.smithi117.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 1.3 MB/s | 196 kB 00:00 2021-10-08T19:14:37.027 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:14:37.029 INFO:teuthology.orchestra.run.smithi117.stdout:Total 6.3 MB/s | 1.8 MB 00:00 2021-10-08T19:14:37.030 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2021-10-08T19:14:37.037 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2021-10-08T19:14:37.037 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2021-10-08T19:14:37.095 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2021-10-08T19:14:37.097 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2021-10-08T19:14:37.105 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum -y install ceph-mgr 2021-10-08T19:14:37.356 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2021-10-08T19:14:37.562 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2021-10-08T19:14:37.581 INFO:teuthology.orchestra.run.smithi097.stdout:Last metadata expiration check: 0:01:15 ago on Fri 08 Oct 2021 07:13:22 PM UTC. 2021-10-08T19:14:37.798 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2021-10-08T19:14:38.684 INFO:teuthology.orchestra.run.smithi097.stdout:Package ceph-mgr-2:17.0.0-8087.g103b6cc3.el8.x86_64 is already installed. 2021-10-08T19:14:38.866 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2021-10-08T19:14:38.867 INFO:teuthology.orchestra.run.smithi097.stdout:Nothing to do. 2021-10-08T19:14:38.868 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2021-10-08T19:14:39.006 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2021-10-08T19:14:39.279 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum -y install ceph-mgr-dashboard 2021-10-08T19:14:39.756 INFO:teuthology.orchestra.run.smithi097.stdout:Last metadata expiration check: 0:01:17 ago on Fri 08 Oct 2021 07:13:22 PM UTC. 2021-10-08T19:14:40.046 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-prometheus-alerts-2:17.0.0-8087.g103b6cc3.el8.n 4/6 2021-10-08T19:14:40.375 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-grafana-dashboards-2:17.0.0-8087.g103b6cc3.el8. 5/6 2021-10-08T19:14:40.439 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2021-10-08T19:14:40.440 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2021-10-08T19:14:40.441 INFO:teuthology.orchestra.run.smithi097.stdout: Package Arch Version Repository Size 2021-10-08T19:14:40.441 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2021-10-08T19:14:40.442 INFO:teuthology.orchestra.run.smithi097.stdout:Installing: 2021-10-08T19:14:40.442 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-dashboard noarch 2:17.0.0-8087.g103b6cc3.el8 ceph-noarch 1.5 M 2021-10-08T19:14:40.443 INFO:teuthology.orchestra.run.smithi097.stdout:Installing dependencies: 2021-10-08T19:14:40.443 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-grafana-dashboards noarch 2:17.0.0-8087.g103b6cc3.el8 ceph-noarch 24 k 2021-10-08T19:14:40.443 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-prometheus-alerts noarch 2:17.0.0-8087.g103b6cc3.el8 ceph-noarch 8.9 k 2021-10-08T19:14:40.444 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jwt noarch 1.6.1-2.el8 CentOS-Base 43 k 2021-10-08T19:14:40.444 INFO:teuthology.orchestra.run.smithi097.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2021-10-08T19:14:40.445 INFO:teuthology.orchestra.run.smithi097.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2021-10-08T19:14:40.445 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:14:40.446 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction Summary 2021-10-08T19:14:40.446 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2021-10-08T19:14:40.446 INFO:teuthology.orchestra.run.smithi097.stdout:Install 6 Packages 2021-10-08T19:14:40.447 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:14:40.447 INFO:teuthology.orchestra.run.smithi097.stdout:Total download size: 1.8 M 2021-10-08T19:14:40.448 INFO:teuthology.orchestra.run.smithi097.stdout:Installed size: 7.5 M 2021-10-08T19:14:40.448 INFO:teuthology.orchestra.run.smithi097.stdout:Downloading Packages: 2021-10-08T19:14:40.551 INFO:teuthology.orchestra.run.smithi097.stdout:(1/6): ceph-prometheus-alerts-17.0.0-8087.g103b 82 kB/s | 8.9 kB 00:00 2021-10-08T19:14:40.565 INFO:teuthology.orchestra.run.smithi097.stdout:(2/6): ceph-grafana-dashboards-17.0.0-8087.g103 195 kB/s | 24 kB 00:00 2021-10-08T19:14:40.581 INFO:teuthology.orchestra.run.smithi097.stdout:(3/6): python3-jwt-1.6.1-2.el8.noarch.rpm 1.4 MB/s | 43 kB 00:00 2021-10-08T19:14:40.630 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-dashboard-2:17.0.0-8087.g103b6cc3.el8.noarc 6/6 2021-10-08T19:14:40.639 INFO:teuthology.orchestra.run.smithi097.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 456 kB/s | 34 kB 00:00 2021-10-08T19:14:40.709 INFO:teuthology.orchestra.run.smithi097.stdout:(5/6): ceph-mgr-dashboard-17.0.0-8087.g103b6cc3 5.8 MB/s | 1.5 MB 00:00 2021-10-08T19:14:40.723 INFO:teuthology.orchestra.run.smithi097.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 1.4 MB/s | 196 kB 00:00 2021-10-08T19:14:40.725 INFO:teuthology.orchestra.run.smithi097.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:14:40.726 INFO:teuthology.orchestra.run.smithi097.stdout:Total 6.5 MB/s | 1.8 MB 00:00 2021-10-08T19:14:40.727 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction check 2021-10-08T19:14:40.734 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction check succeeded. 2021-10-08T19:14:40.735 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction test 2021-10-08T19:14:40.792 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction test succeeded. 2021-10-08T19:14:40.794 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction 2021-10-08T19:14:40.886 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.0.0-8087.g103b6cc3.el8.noarc 6/6 2021-10-08T19:14:40.887 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-grafana-dashboards-2:17.0.0-8087.g103b6cc3.el8. 1/6 2021-10-08T19:14:40.887 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-dashboard-2:17.0.0-8087.g103b6cc3.el8.noarc 2/6 2021-10-08T19:14:40.887 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-prometheus-alerts-2:17.0.0-8087.g103b6cc3.el8.n 3/6 2021-10-08T19:14:40.887 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2021-10-08T19:14:40.887 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2021-10-08T19:14:41.054 INFO:teuthology.orchestra.run.smithi097.stdout: Preparing : 1/1 2021-10-08T19:14:41.189 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2021-10-08T19:14:41.190 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:14:41.190 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2021-10-08T19:14:41.190 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-grafana-dashboards-2:17.0.0-8087.g103b6cc3.el8.noarch 2021-10-08T19:14:41.191 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-dashboard-2:17.0.0-8087.g103b6cc3.el8.noarch 2021-10-08T19:14:41.191 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-prometheus-alerts-2:17.0.0-8087.g103b6cc3.el8.noarch 2021-10-08T19:14:41.191 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jwt-1.6.1-2.el8.noarch 2021-10-08T19:14:41.191 INFO:teuthology.orchestra.run.smithi117.stdout: python3-repoze-lru-0.7-6.el8.noarch 2021-10-08T19:14:41.191 INFO:teuthology.orchestra.run.smithi117.stdout: python3-routes-2.4.1-12.el8.noarch 2021-10-08T19:14:41.192 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:14:41.192 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2021-10-08T19:14:41.269 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-mgr-diskprediction-local 2021-10-08T19:14:41.342 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2021-10-08T19:14:41.576 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2021-10-08T19:14:41.740 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:01:19 ago on Fri 08 Oct 2021 07:13:22 PM UTC. 2021-10-08T19:14:41.818 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2021-10-08T19:14:41.989 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-prometheus-alerts-2:17.0.0-8087.g103b6cc3.el8.n 4/6 2021-10-08T19:14:42.351 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-grafana-dashboards-2:17.0.0-8087.g103b6cc3.el8. 5/6 2021-10-08T19:14:42.395 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2021-10-08T19:14:42.396 INFO:teuthology.orchestra.run.smithi117.stdout:===================================================================================================== 2021-10-08T19:14:42.397 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2021-10-08T19:14:42.397 INFO:teuthology.orchestra.run.smithi117.stdout:===================================================================================================== 2021-10-08T19:14:42.397 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2021-10-08T19:14:42.397 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-diskprediction-local noarch 2:17.0.0-8087.g103b6cc3.el8 ceph-noarch 7.4 M 2021-10-08T19:14:42.398 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2021-10-08T19:14:42.398 INFO:teuthology.orchestra.run.smithi117.stdout: libgfortran x86_64 8.4.1-1.el8 CentOS-Base 639 k 2021-10-08T19:14:42.399 INFO:teuthology.orchestra.run.smithi117.stdout: libquadmath x86_64 8.4.1-1.el8 CentOS-Base 169 k 2021-10-08T19:14:42.399 INFO:teuthology.orchestra.run.smithi117.stdout: openblas x86_64 0.3.12-1.el8 CentOS-AppStream 4.6 M 2021-10-08T19:14:42.399 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-threads x86_64 0.3.12-1.el8 CentOS-AppStream 4.7 M 2021-10-08T19:14:42.400 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy x86_64 1:1.14.3-9.el8 CentOS-AppStream 3.7 M 2021-10-08T19:14:42.400 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 CentOS-AppStream 225 k 2021-10-08T19:14:42.400 INFO:teuthology.orchestra.run.smithi117.stdout: python3-scipy x86_64 1.0.0-20.module_el8.4.0+790+083e3d81 CentOS-AppStream 15 M 2021-10-08T19:14:42.400 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:14:42.400 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2021-10-08T19:14:42.401 INFO:teuthology.orchestra.run.smithi117.stdout:===================================================================================================== 2021-10-08T19:14:42.401 INFO:teuthology.orchestra.run.smithi117.stdout:Install 8 Packages 2021-10-08T19:14:42.401 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:14:42.401 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 36 M 2021-10-08T19:14:42.401 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 197 M 2021-10-08T19:14:42.402 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2021-10-08T19:14:42.492 INFO:teuthology.orchestra.run.smithi117.stdout:(1/8): openblas-threads-0.3.12-1.el8.x86_64.rpm 51 MB/s | 4.7 MB 00:00 2021-10-08T19:14:42.542 INFO:teuthology.orchestra.run.smithi117.stdout:(2/8): python3-numpy-1.14.3-9.el8.x86_64.rpm 75 MB/s | 3.7 MB 00:00 2021-10-08T19:14:42.549 INFO:teuthology.orchestra.run.smithi117.stdout:(3/8): python3-numpy-f2py-1.14.3-9.el8.x86_64.r 36 MB/s | 225 kB 00:00 2021-10-08T19:14:42.611 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-mgr-dashboard-2:17.0.0-8087.g103b6cc3.el8.noarc 6/6 2021-10-08T19:14:42.690 INFO:teuthology.orchestra.run.smithi117.stdout:(4/8): openblas-0.3.12-1.el8.x86_64.rpm 16 MB/s | 4.6 MB 00:00 2021-10-08T19:14:42.795 INFO:teuthology.orchestra.run.smithi117.stdout:(5/8): python3-scipy-1.0.0-20.module_el8.4.0+79 59 MB/s | 15 MB 00:00 2021-10-08T19:14:42.798 INFO:teuthology.orchestra.run.smithi117.stdout:(6/8): libgfortran-8.4.1-1.el8.x86_64.rpm 5.7 MB/s | 639 kB 00:00 2021-10-08T19:14:42.800 INFO:teuthology.orchestra.run.smithi117.stdout:(7/8): libquadmath-8.4.1-1.el8.x86_64.rpm 38 MB/s | 169 kB 00:00 2021-10-08T19:14:42.856 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.0.0-8087.g103b6cc3.el8.noarc 6/6 2021-10-08T19:14:42.857 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-grafana-dashboards-2:17.0.0-8087.g103b6cc3.el8. 1/6 2021-10-08T19:14:42.857 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-mgr-dashboard-2:17.0.0-8087.g103b6cc3.el8.noarc 2/6 2021-10-08T19:14:42.857 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-prometheus-alerts-2:17.0.0-8087.g103b6cc3.el8.n 3/6 2021-10-08T19:14:42.857 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2021-10-08T19:14:42.858 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2021-10-08T19:14:43.014 INFO:teuthology.orchestra.run.smithi117.stdout:(8/8): ceph-mgr-diskprediction-local-17.0.0-808 12 MB/s | 7.4 MB 00:00 2021-10-08T19:14:43.020 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:14:43.021 INFO:teuthology.orchestra.run.smithi117.stdout:Total 58 MB/s | 36 MB 00:00 2021-10-08T19:14:43.025 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2021-10-08T19:14:43.044 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2021-10-08T19:14:43.044 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2021-10-08T19:14:43.159 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2021-10-08T19:14:43.159 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:14:43.159 INFO:teuthology.orchestra.run.smithi097.stdout:Installed: 2021-10-08T19:14:43.160 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-grafana-dashboards-2:17.0.0-8087.g103b6cc3.el8.noarch 2021-10-08T19:14:43.160 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-dashboard-2:17.0.0-8087.g103b6cc3.el8.noarch 2021-10-08T19:14:43.160 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-prometheus-alerts-2:17.0.0-8087.g103b6cc3.el8.noarch 2021-10-08T19:14:43.160 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jwt-1.6.1-2.el8.noarch 2021-10-08T19:14:43.161 INFO:teuthology.orchestra.run.smithi097.stdout: python3-repoze-lru-0.7-6.el8.noarch 2021-10-08T19:14:43.161 INFO:teuthology.orchestra.run.smithi097.stdout: python3-routes-2.4.1-12.el8.noarch 2021-10-08T19:14:43.161 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:14:43.162 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2021-10-08T19:14:43.231 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum -y install ceph-mgr-diskprediction-local 2021-10-08T19:14:43.341 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2021-10-08T19:14:43.341 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2021-10-08T19:14:43.704 INFO:teuthology.orchestra.run.smithi097.stdout:Last metadata expiration check: 0:01:21 ago on Fri 08 Oct 2021 07:13:22 PM UTC. 2021-10-08T19:14:43.891 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2021-10-08T19:14:44.060 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 1/8 2021-10-08T19:14:44.207 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 1/8 2021-10-08T19:14:44.343 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2021-10-08T19:14:44.344 INFO:teuthology.orchestra.run.smithi097.stdout:===================================================================================================== 2021-10-08T19:14:44.344 INFO:teuthology.orchestra.run.smithi097.stdout: Package Arch Version Repository Size 2021-10-08T19:14:44.344 INFO:teuthology.orchestra.run.smithi097.stdout:===================================================================================================== 2021-10-08T19:14:44.344 INFO:teuthology.orchestra.run.smithi097.stdout:Installing: 2021-10-08T19:14:44.345 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-diskprediction-local noarch 2:17.0.0-8087.g103b6cc3.el8 ceph-noarch 7.4 M 2021-10-08T19:14:44.345 INFO:teuthology.orchestra.run.smithi097.stdout:Installing dependencies: 2021-10-08T19:14:44.345 INFO:teuthology.orchestra.run.smithi097.stdout: libgfortran x86_64 8.4.1-1.el8 CentOS-Base 639 k 2021-10-08T19:14:44.345 INFO:teuthology.orchestra.run.smithi097.stdout: libquadmath x86_64 8.4.1-1.el8 CentOS-Base 169 k 2021-10-08T19:14:44.345 INFO:teuthology.orchestra.run.smithi097.stdout: openblas x86_64 0.3.12-1.el8 CentOS-AppStream 4.6 M 2021-10-08T19:14:44.346 INFO:teuthology.orchestra.run.smithi097.stdout: openblas-threads x86_64 0.3.12-1.el8 CentOS-AppStream 4.7 M 2021-10-08T19:14:44.346 INFO:teuthology.orchestra.run.smithi097.stdout: python3-numpy x86_64 1:1.14.3-9.el8 CentOS-AppStream 3.7 M 2021-10-08T19:14:44.346 INFO:teuthology.orchestra.run.smithi097.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 CentOS-AppStream 225 k 2021-10-08T19:14:44.346 INFO:teuthology.orchestra.run.smithi097.stdout: python3-scipy x86_64 1.0.0-20.module_el8.4.0+790+083e3d81 CentOS-AppStream 15 M 2021-10-08T19:14:44.347 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:14:44.347 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction Summary 2021-10-08T19:14:44.347 INFO:teuthology.orchestra.run.smithi097.stdout:===================================================================================================== 2021-10-08T19:14:44.347 INFO:teuthology.orchestra.run.smithi097.stdout:Install 8 Packages 2021-10-08T19:14:44.347 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:14:44.348 INFO:teuthology.orchestra.run.smithi097.stdout:Total download size: 36 M 2021-10-08T19:14:44.349 INFO:teuthology.orchestra.run.smithi097.stdout:Installed size: 197 M 2021-10-08T19:14:44.349 INFO:teuthology.orchestra.run.smithi097.stdout:Downloading Packages: 2021-10-08T19:14:44.386 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 2/8 2021-10-08T19:14:44.446 INFO:teuthology.orchestra.run.smithi097.stdout:(1/8): openblas-0.3.12-1.el8.x86_64.rpm 46 MB/s | 4.6 MB 00:00 2021-10-08T19:14:44.504 INFO:teuthology.orchestra.run.smithi097.stdout:(2/8): python3-numpy-1.14.3-9.el8.x86_64.rpm 65 MB/s | 3.7 MB 00:00 2021-10-08T19:14:44.509 INFO:teuthology.orchestra.run.smithi097.stdout:(3/8): python3-numpy-f2py-1.14.3-9.el8.x86_64.r 41 MB/s | 225 kB 00:00 2021-10-08T19:14:44.568 INFO:teuthology.orchestra.run.smithi097.stdout:(4/8): openblas-threads-0.3.12-1.el8.x86_64.rpm 21 MB/s | 4.7 MB 00:00 2021-10-08T19:14:44.597 INFO:teuthology.orchestra.run.smithi097.stdout:(5/8): libgfortran-8.4.1-1.el8.x86_64.rpm 22 MB/s | 639 kB 00:00 2021-10-08T19:14:44.607 INFO:teuthology.orchestra.run.smithi097.stdout:(6/8): libquadmath-8.4.1-1.el8.x86_64.rpm 16 MB/s | 169 kB 00:00 2021-10-08T19:14:44.767 INFO:teuthology.orchestra.run.smithi097.stdout:(7/8): python3-scipy-1.0.0-20.module_el8.4.0+79 56 MB/s | 15 MB 00:00 2021-10-08T19:14:44.910 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 2/8 2021-10-08T19:14:45.052 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : openblas-0.3.12-1.el8.x86_64 3/8 2021-10-08T19:14:45.311 INFO:teuthology.orchestra.run.smithi097.stdout:(8/8): ceph-mgr-diskprediction-local-17.0.0-808 7.7 MB/s | 7.4 MB 00:00 2021-10-08T19:14:45.314 INFO:teuthology.orchestra.run.smithi097.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:14:45.315 INFO:teuthology.orchestra.run.smithi097.stdout:Total 37 MB/s | 36 MB 00:00 2021-10-08T19:14:45.324 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction check 2021-10-08T19:14:45.342 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction check succeeded. 2021-10-08T19:14:45.342 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction test 2021-10-08T19:14:45.629 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 3/8 2021-10-08T19:14:45.636 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction test succeeded. 2021-10-08T19:14:45.638 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction 2021-10-08T19:14:45.802 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 4/8 2021-10-08T19:14:46.190 INFO:teuthology.orchestra.run.smithi097.stdout: Preparing : 1/1 2021-10-08T19:14:46.381 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 1/8 2021-10-08T19:14:46.499 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 4/8 2021-10-08T19:14:46.511 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 1/8 2021-10-08T19:14:46.706 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 2/8 2021-10-08T19:14:46.817 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 5/8 2021-10-08T19:14:47.062 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2021-10-08T19:14:47.216 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 2/8 2021-10-08T19:14:47.432 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : openblas-0.3.12-1.el8.x86_64 3/8 2021-10-08T19:14:47.976 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 3/8 2021-10-08T19:14:48.173 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 4/8 2021-10-08T19:14:48.884 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 4/8 2021-10-08T19:14:49.025 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2021-10-08T19:14:49.225 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 5/8 2021-10-08T19:14:49.532 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2021-10-08T19:14:50.312 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-scipy-1.0.0-20.module_el8.4.0+790+083e3d81.x 7/8 2021-10-08T19:14:50.643 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-diskprediction-local-2:17.0.0-8087.g103b6cc 8/8 2021-10-08T19:14:50.924 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.0.0-8087.g103b6cc 8/8 2021-10-08T19:14:50.925 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.0.0-8087.g103b6cc 1/8 2021-10-08T19:14:50.925 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 2/8 2021-10-08T19:14:50.925 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 3/8 2021-10-08T19:14:50.926 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 4/8 2021-10-08T19:14:50.926 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 5/8 2021-10-08T19:14:50.926 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-scipy-1.0.0-20.module_el8.4.0+790+083e3d81.x 6/8 2021-10-08T19:14:50.926 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 7/8 2021-10-08T19:14:51.246 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 8/8 2021-10-08T19:14:51.247 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:14:51.247 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2021-10-08T19:14:51.247 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-diskprediction-local-2:17.0.0-8087.g103b6cc3.el8.noarch 2021-10-08T19:14:51.247 INFO:teuthology.orchestra.run.smithi117.stdout: libgfortran-8.4.1-1.el8.x86_64 2021-10-08T19:14:51.247 INFO:teuthology.orchestra.run.smithi117.stdout: libquadmath-8.4.1-1.el8.x86_64 2021-10-08T19:14:51.248 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-0.3.12-1.el8.x86_64 2021-10-08T19:14:51.248 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-threads-0.3.12-1.el8.x86_64 2021-10-08T19:14:51.248 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2021-10-08T19:14:51.248 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2021-10-08T19:14:51.249 INFO:teuthology.orchestra.run.smithi117.stdout: python3-scipy-1.0.0-20.module_el8.4.0+790+083e3d81.x86_64 2021-10-08T19:14:51.249 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:14:51.249 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2021-10-08T19:14:51.333 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-mgr-rook 2021-10-08T19:14:51.500 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2021-10-08T19:14:51.804 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:01:29 ago on Fri 08 Oct 2021 07:13:22 PM UTC. 2021-10-08T19:14:52.452 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2021-10-08T19:14:52.454 INFO:teuthology.orchestra.run.smithi117.stdout:======================================================================================== 2021-10-08T19:14:52.454 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2021-10-08T19:14:52.454 INFO:teuthology.orchestra.run.smithi117.stdout:======================================================================================== 2021-10-08T19:14:52.455 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2021-10-08T19:14:52.455 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-rook noarch 2:17.0.0-8087.g103b6cc3.el8 ceph-noarch 45 k 2021-10-08T19:14:52.455 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2021-10-08T19:14:52.455 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2021-10-08T19:14:52.456 INFO:teuthology.orchestra.run.smithi117.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2021-10-08T19:14:52.456 INFO:teuthology.orchestra.run.smithi117.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2021-10-08T19:14:52.456 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2021-10-08T19:14:52.456 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2021-10-08T19:14:52.457 INFO:teuthology.orchestra.run.smithi117.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2021-10-08T19:14:52.457 INFO:teuthology.orchestra.run.smithi117.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-Base 155 k 2021-10-08T19:14:52.457 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2021-10-08T19:14:52.457 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2021-10-08T19:14:52.457 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-Base 43 k 2021-10-08T19:14:52.458 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rsa noarch 4.7.2-1.el8 epel 61 k 2021-10-08T19:14:52.458 INFO:teuthology.orchestra.run.smithi117.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2021-10-08T19:14:52.458 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:14:52.458 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2021-10-08T19:14:52.459 INFO:teuthology.orchestra.run.smithi117.stdout:======================================================================================== 2021-10-08T19:14:52.459 INFO:teuthology.orchestra.run.smithi117.stdout:Install 13 Packages 2021-10-08T19:14:52.459 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:14:52.460 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 1.9 M 2021-10-08T19:14:52.460 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 25 M 2021-10-08T19:14:52.460 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2021-10-08T19:14:52.500 INFO:teuthology.orchestra.run.smithi117.stdout:(1/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 633 kB/s | 27 kB 00:00 2021-10-08T19:14:52.503 INFO:teuthology.orchestra.run.smithi117.stdout:(2/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 37 MB/s | 126 kB 00:00 2021-10-08T19:14:52.503 INFO:teuthology.orchestra.run.smithi117.stdout:(3/13): python3-jsonpointer-1.10-11.el8.noarch. 434 kB/s | 20 kB 00:00 2021-10-08T19:14:52.506 INFO:teuthology.orchestra.run.smithi117.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 39 MB/s | 110 kB 00:00 2021-10-08T19:14:52.507 INFO:teuthology.orchestra.run.smithi117.stdout:(5/13): python3-requests-oauthlib-1.0.0-1.el8.n 31 MB/s | 43 kB 00:00 2021-10-08T19:14:52.509 INFO:teuthology.orchestra.run.smithi117.stdout:(6/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 31 MB/s | 155 kB 00:00 2021-10-08T19:14:52.585 INFO:teuthology.orchestra.run.smithi117.stdout:(7/13): python3-certifi-2018.10.15-7.el8.noarch 223 kB/s | 16 kB 00:00 2021-10-08T19:14:52.592 INFO:teuthology.orchestra.run.smithi117.stdout:(8/13): python3-cachetools-3.1.1-4.el8.noarch.r 392 kB/s | 33 kB 00:00 2021-10-08T19:14:52.603 INFO:teuthology.orchestra.run.smithi117.stdout:(9/13): ceph-mgr-rook-17.0.0-8087.g103b6cc3.el8 308 kB/s | 45 kB 00:00 2021-10-08T19:14:52.655 INFO:teuthology.orchestra.run.smithi117.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 1.1 MB/s | 81 kB 00:00 2021-10-08T19:14:52.681 INFO:teuthology.orchestra.run.smithi117.stdout:(11/13): python3-websocket-client-0.56.0-5.el8. 2.3 MB/s | 61 kB 00:00 2021-10-08T19:14:52.700 INFO:teuthology.orchestra.run.smithi117.stdout:(12/13): python3-rsa-4.7.2-1.el8.noarch.rpm 629 kB/s | 61 kB 00:00 2021-10-08T19:14:52.747 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-scipy-1.0.0-20.module_el8.4.0+790+083e3d81.x 7/8 2021-10-08T19:14:52.767 INFO:teuthology.orchestra.run.smithi117.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 6.7 MB/s | 1.2 MB 00:00 2021-10-08T19:14:52.769 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:14:52.769 INFO:teuthology.orchestra.run.smithi117.stdout:Total 6.1 MB/s | 1.9 MB 00:00 2021-10-08T19:14:52.774 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2021-10-08T19:14:52.792 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2021-10-08T19:14:52.792 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2021-10-08T19:14:52.865 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2021-10-08T19:14:52.868 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2021-10-08T19:14:52.922 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-mgr-diskprediction-local-2:17.0.0-8087.g103b6cc 8/8 2021-10-08T19:14:53.221 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.0.0-8087.g103b6cc 8/8 2021-10-08T19:14:53.221 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.0.0-8087.g103b6cc 1/8 2021-10-08T19:14:53.221 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 2/8 2021-10-08T19:14:53.222 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 3/8 2021-10-08T19:14:53.222 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 4/8 2021-10-08T19:14:53.222 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 5/8 2021-10-08T19:14:53.222 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-scipy-1.0.0-20.module_el8.4.0+790+083e3d81.x 6/8 2021-10-08T19:14:53.223 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 7/8 2021-10-08T19:14:53.372 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2021-10-08T19:14:53.550 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 8/8 2021-10-08T19:14:53.551 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:14:53.551 INFO:teuthology.orchestra.run.smithi097.stdout:Installed: 2021-10-08T19:14:53.551 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-diskprediction-local-2:17.0.0-8087.g103b6cc3.el8.noarch 2021-10-08T19:14:53.551 INFO:teuthology.orchestra.run.smithi097.stdout: libgfortran-8.4.1-1.el8.x86_64 2021-10-08T19:14:53.552 INFO:teuthology.orchestra.run.smithi097.stdout: libquadmath-8.4.1-1.el8.x86_64 2021-10-08T19:14:53.552 INFO:teuthology.orchestra.run.smithi097.stdout: openblas-0.3.12-1.el8.x86_64 2021-10-08T19:14:53.552 INFO:teuthology.orchestra.run.smithi097.stdout: openblas-threads-0.3.12-1.el8.x86_64 2021-10-08T19:14:53.552 INFO:teuthology.orchestra.run.smithi097.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2021-10-08T19:14:53.553 INFO:teuthology.orchestra.run.smithi097.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2021-10-08T19:14:53.553 INFO:teuthology.orchestra.run.smithi097.stdout: python3-scipy-1.0.0-20.module_el8.4.0+790+083e3d81.x86_64 2021-10-08T19:14:53.553 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:14:53.554 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2021-10-08T19:14:53.633 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum -y install ceph-mgr-rook 2021-10-08T19:14:53.697 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2021-10-08T19:14:53.878 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2021-10-08T19:14:54.086 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rsa-4.7.2-1.el8.noarch 3/13 2021-10-08T19:14:54.106 INFO:teuthology.orchestra.run.smithi097.stdout:Last metadata expiration check: 0:01:32 ago on Fri 08 Oct 2021 07:13:22 PM UTC. 2021-10-08T19:14:54.282 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2021-10-08T19:14:54.456 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2021-10-08T19:14:54.646 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2021-10-08T19:14:54.756 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2021-10-08T19:14:54.757 INFO:teuthology.orchestra.run.smithi097.stdout:======================================================================================== 2021-10-08T19:14:54.757 INFO:teuthology.orchestra.run.smithi097.stdout: Package Arch Version Repository Size 2021-10-08T19:14:54.758 INFO:teuthology.orchestra.run.smithi097.stdout:======================================================================================== 2021-10-08T19:14:54.758 INFO:teuthology.orchestra.run.smithi097.stdout:Installing: 2021-10-08T19:14:54.758 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-rook noarch 2:17.0.0-8087.g103b6cc3.el8 ceph-noarch 45 k 2021-10-08T19:14:54.758 INFO:teuthology.orchestra.run.smithi097.stdout:Installing dependencies: 2021-10-08T19:14:54.759 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2021-10-08T19:14:54.759 INFO:teuthology.orchestra.run.smithi097.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2021-10-08T19:14:54.759 INFO:teuthology.orchestra.run.smithi097.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2021-10-08T19:14:54.759 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2021-10-08T19:14:54.760 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2021-10-08T19:14:54.760 INFO:teuthology.orchestra.run.smithi097.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2021-10-08T19:14:54.760 INFO:teuthology.orchestra.run.smithi097.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-Base 155 k 2021-10-08T19:14:54.761 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2021-10-08T19:14:54.761 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2021-10-08T19:14:54.763 INFO:teuthology.orchestra.run.smithi097.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-Base 43 k 2021-10-08T19:14:54.763 INFO:teuthology.orchestra.run.smithi097.stdout: python3-rsa noarch 4.7.2-1.el8 epel 61 k 2021-10-08T19:14:54.763 INFO:teuthology.orchestra.run.smithi097.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2021-10-08T19:14:54.763 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:14:54.764 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction Summary 2021-10-08T19:14:54.764 INFO:teuthology.orchestra.run.smithi097.stdout:======================================================================================== 2021-10-08T19:14:54.764 INFO:teuthology.orchestra.run.smithi097.stdout:Install 13 Packages 2021-10-08T19:14:54.765 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:14:54.766 INFO:teuthology.orchestra.run.smithi097.stdout:Total download size: 1.9 M 2021-10-08T19:14:54.767 INFO:teuthology.orchestra.run.smithi097.stdout:Installed size: 25 M 2021-10-08T19:14:54.767 INFO:teuthology.orchestra.run.smithi097.stdout:Downloading Packages: 2021-10-08T19:14:54.794 INFO:teuthology.orchestra.run.smithi097.stdout:(1/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 786 kB/s | 27 kB 00:00 2021-10-08T19:14:54.795 INFO:teuthology.orchestra.run.smithi097.stdout:(2/13): python3-jsonpointer-1.10-11.el8.noarch. 582 kB/s | 20 kB 00:00 2021-10-08T19:14:54.797 INFO:teuthology.orchestra.run.smithi097.stdout:(3/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 41 MB/s | 126 kB 00:00 2021-10-08T19:14:54.798 INFO:teuthology.orchestra.run.smithi097.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 31 MB/s | 110 kB 00:00 2021-10-08T19:14:54.800 INFO:teuthology.orchestra.run.smithi097.stdout:(5/13): python3-requests-oauthlib-1.0.0-1.el8.n 27 MB/s | 43 kB 00:00 2021-10-08T19:14:54.801 INFO:teuthology.orchestra.run.smithi097.stdout:(6/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 45 MB/s | 155 kB 00:00 2021-10-08T19:14:54.872 INFO:teuthology.orchestra.run.smithi097.stdout:(7/13): python3-cachetools-3.1.1-4.el8.noarch.r 458 kB/s | 33 kB 00:00 2021-10-08T19:14:54.879 INFO:teuthology.orchestra.run.smithi097.stdout:(8/13): python3-certifi-2018.10.15-7.el8.noarch 222 kB/s | 16 kB 00:00 2021-10-08T19:14:54.889 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2021-10-08T19:14:54.907 INFO:teuthology.orchestra.run.smithi097.stdout:(9/13): ceph-mgr-rook-17.0.0-8087.g103b6cc3.el8 306 kB/s | 45 kB 00:00 2021-10-08T19:14:54.921 INFO:teuthology.orchestra.run.smithi097.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 1.6 MB/s | 81 kB 00:00 2021-10-08T19:14:54.945 INFO:teuthology.orchestra.run.smithi097.stdout:(11/13): python3-websocket-client-0.56.0-5.el8. 2.5 MB/s | 61 kB 00:00 2021-10-08T19:14:55.003 INFO:teuthology.orchestra.run.smithi097.stdout:(12/13): python3-rsa-4.7.2-1.el8.noarch.rpm 637 kB/s | 61 kB 00:00 2021-10-08T19:14:55.060 INFO:teuthology.orchestra.run.smithi097.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 6.3 MB/s | 1.2 MB 00:00 2021-10-08T19:14:55.062 INFO:teuthology.orchestra.run.smithi097.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:14:55.063 INFO:teuthology.orchestra.run.smithi097.stdout:Total 6.3 MB/s | 1.9 MB 00:00 2021-10-08T19:14:55.067 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction check 2021-10-08T19:14:55.081 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction check succeeded. 2021-10-08T19:14:55.081 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction test 2021-10-08T19:14:55.097 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2021-10-08T19:14:55.155 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction test succeeded. 2021-10-08T19:14:55.157 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction 2021-10-08T19:14:56.152 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2021-10-08T19:14:56.415 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2021-10-08T19:14:56.458 INFO:teuthology.orchestra.run.smithi097.stdout: Preparing : 1/1 2021-10-08T19:14:56.548 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2021-10-08T19:14:56.767 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2021-10-08T19:14:56.787 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2021-10-08T19:14:56.958 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-rook-2:17.0.0-8087.g103b6cc3.el8.noarch 13/13 2021-10-08T19:14:57.034 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2021-10-08T19:14:57.211 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-rook-2:17.0.0-8087.g103b6cc3.el8.noarch 13/13 2021-10-08T19:14:57.211 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-rook-2:17.0.0-8087.g103b6cc3.el8.noarch 1/13 2021-10-08T19:14:57.211 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2021-10-08T19:14:57.211 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2021-10-08T19:14:57.212 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2021-10-08T19:14:57.212 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2021-10-08T19:14:57.212 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2021-10-08T19:14:57.212 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2021-10-08T19:14:57.212 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2021-10-08T19:14:57.213 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2021-10-08T19:14:57.213 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2021-10-08T19:14:57.213 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2021-10-08T19:14:57.213 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rsa-4.7.2-1.el8.noarch 12/13 2021-10-08T19:14:57.301 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-rsa-4.7.2-1.el8.noarch 3/13 2021-10-08T19:14:57.504 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2021-10-08T19:14:57.584 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2021-10-08T19:14:57.584 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:14:57.585 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2021-10-08T19:14:57.585 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-rook-2:17.0.0-8087.g103b6cc3.el8.noarch 2021-10-08T19:14:57.585 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cachetools-3.1.1-4.el8.noarch 2021-10-08T19:14:57.585 INFO:teuthology.orchestra.run.smithi117.stdout: python3-certifi-2018.10.15-7.el8.noarch 2021-10-08T19:14:57.585 INFO:teuthology.orchestra.run.smithi117.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2021-10-08T19:14:57.586 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpatch-1.21-2.el8.noarch 2021-10-08T19:14:57.586 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpointer-1.10-11.el8.noarch 2021-10-08T19:14:57.586 INFO:teuthology.orchestra.run.smithi117.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2021-10-08T19:14:57.586 INFO:teuthology.orchestra.run.smithi117.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2021-10-08T19:14:57.587 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2021-10-08T19:14:57.587 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2021-10-08T19:14:57.587 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2021-10-08T19:14:57.587 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rsa-4.7.2-1.el8.noarch 2021-10-08T19:14:57.587 INFO:teuthology.orchestra.run.smithi117.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2021-10-08T19:14:57.588 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:14:57.588 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2021-10-08T19:14:57.674 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-mgr-cephadm 2021-10-08T19:14:57.745 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2021-10-08T19:14:57.969 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2021-10-08T19:14:58.149 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:01:36 ago on Fri 08 Oct 2021 07:13:22 PM UTC. 2021-10-08T19:14:58.279 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2021-10-08T19:14:58.477 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2021-10-08T19:14:58.844 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2021-10-08T19:14:58.844 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2021-10-08T19:14:58.845 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2021-10-08T19:14:58.845 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2021-10-08T19:14:58.845 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2021-10-08T19:14:58.845 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-cephadm noarch 2:17.0.0-8087.g103b6cc3.el8 ceph-noarch 96 k 2021-10-08T19:14:58.846 INFO:teuthology.orchestra.run.smithi117.stdout:Upgrading: 2021-10-08T19:14:58.846 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cryptography x86_64 3.2.1-4.el8 CentOS-Base 559 k 2021-10-08T19:14:58.846 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2021-10-08T19:14:58.846 INFO:teuthology.orchestra.run.smithi117.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2021-10-08T19:14:58.846 INFO:teuthology.orchestra.run.smithi117.stdout: python3-babel noarch 2.5.1-5.el8 CentOS-AppStream 4.8 M 2021-10-08T19:14:58.847 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 CentOS-AppStream 538 k 2021-10-08T19:14:58.847 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:14:58.847 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2021-10-08T19:14:58.847 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2021-10-08T19:14:58.848 INFO:teuthology.orchestra.run.smithi117.stdout:Install 4 Packages 2021-10-08T19:14:58.848 INFO:teuthology.orchestra.run.smithi117.stdout:Upgrade 1 Package 2021-10-08T19:14:58.848 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:14:58.849 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 6.4 M 2021-10-08T19:14:58.849 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2021-10-08T19:14:58.894 INFO:teuthology.orchestra.run.smithi117.stdout:(1/5): python3-jinja2-2.10.1-2.el8_0.noarch.rpm 11 MB/s | 538 kB 00:00 2021-10-08T19:14:58.943 INFO:teuthology.orchestra.run.smithi117.stdout:(2/5): python3-babel-2.5.1-5.el8.noarch.rpm 50 MB/s | 4.8 MB 00:00 2021-10-08T19:14:58.951 INFO:teuthology.orchestra.run.smithi117.stdout:(3/5): python3-cryptography-3.2.1-4.el8.x86_64. 75 MB/s | 559 kB 00:00 2021-10-08T19:14:59.014 INFO:teuthology.orchestra.run.smithi117.stdout:(4/5): ceph-mgr-cephadm-17.0.0-8087.g103b6cc3.e 573 kB/s | 96 kB 00:00 2021-10-08T19:14:59.088 INFO:teuthology.orchestra.run.smithi117.stdout:(5/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 2.4 MB/s | 476 kB 00:00 2021-10-08T19:14:59.090 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:14:59.091 INFO:teuthology.orchestra.run.smithi117.stdout:Total 26 MB/s | 6.4 MB 00:00 2021-10-08T19:14:59.095 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2021-10-08T19:14:59.111 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2021-10-08T19:14:59.112 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2021-10-08T19:14:59.236 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2021-10-08T19:14:59.236 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2021-10-08T19:14:59.609 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2021-10-08T19:14:59.718 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2021-10-08T19:14:59.887 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2021-10-08T19:15:00.058 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : python3-cryptography-3.2.1-4.el8.x86_64 1/6 2021-10-08T19:15:00.071 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2021-10-08T19:15:00.309 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2021-10-08T19:15:00.463 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-mgr-rook-2:17.0.0-8087.g103b6cc3.el8.noarch 13/13 2021-10-08T19:15:00.724 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-mgr-rook-2:17.0.0-8087.g103b6cc3.el8.noarch 13/13 2021-10-08T19:15:00.726 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-mgr-rook-2:17.0.0-8087.g103b6cc3.el8.noarch 1/13 2021-10-08T19:15:00.726 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2021-10-08T19:15:00.727 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2021-10-08T19:15:00.727 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2021-10-08T19:15:00.728 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2021-10-08T19:15:00.728 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2021-10-08T19:15:00.728 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2021-10-08T19:15:00.728 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2021-10-08T19:15:00.728 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2021-10-08T19:15:00.729 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2021-10-08T19:15:00.735 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2021-10-08T19:15:00.735 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-rsa-4.7.2-1.el8.noarch 12/13 2021-10-08T19:15:00.999 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 2/6 2021-10-08T19:15:01.084 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2021-10-08T19:15:01.085 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:15:01.085 INFO:teuthology.orchestra.run.smithi097.stdout:Installed: 2021-10-08T19:15:01.086 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-rook-2:17.0.0-8087.g103b6cc3.el8.noarch 2021-10-08T19:15:01.086 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cachetools-3.1.1-4.el8.noarch 2021-10-08T19:15:01.086 INFO:teuthology.orchestra.run.smithi097.stdout: python3-certifi-2018.10.15-7.el8.noarch 2021-10-08T19:15:01.086 INFO:teuthology.orchestra.run.smithi097.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2021-10-08T19:15:01.087 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jsonpatch-1.21-2.el8.noarch 2021-10-08T19:15:01.087 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jsonpointer-1.10-11.el8.noarch 2021-10-08T19:15:01.087 INFO:teuthology.orchestra.run.smithi097.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2021-10-08T19:15:01.088 INFO:teuthology.orchestra.run.smithi097.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2021-10-08T19:15:01.089 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2021-10-08T19:15:01.089 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2021-10-08T19:15:01.089 INFO:teuthology.orchestra.run.smithi097.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2021-10-08T19:15:01.089 INFO:teuthology.orchestra.run.smithi097.stdout: python3-rsa-4.7.2-1.el8.noarch 2021-10-08T19:15:01.089 INFO:teuthology.orchestra.run.smithi097.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2021-10-08T19:15:01.090 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:15:01.090 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2021-10-08T19:15:01.215 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum -y install ceph-mgr-cephadm 2021-10-08T19:15:01.693 INFO:teuthology.orchestra.run.smithi097.stdout:Last metadata expiration check: 0:01:39 ago on Fri 08 Oct 2021 07:13:22 PM UTC. 2021-10-08T19:15:01.741 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 3/6 2021-10-08T19:15:01.991 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 4/6 2021-10-08T19:15:02.149 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-cephadm-2:17.0.0-8087.g103b6cc3.el8.noarch 5/6 2021-10-08T19:15:02.168 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.0.0-8087.g103b6cc3.el8.noarch 5/6 2021-10-08T19:15:02.339 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : python3-cryptography-2.3-3.el8.x86_64 6/6 2021-10-08T19:15:02.349 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2021-10-08T19:15:02.350 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2021-10-08T19:15:02.350 INFO:teuthology.orchestra.run.smithi097.stdout: Package Arch Version Repository Size 2021-10-08T19:15:02.351 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2021-10-08T19:15:02.351 INFO:teuthology.orchestra.run.smithi097.stdout:Installing: 2021-10-08T19:15:02.351 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-cephadm noarch 2:17.0.0-8087.g103b6cc3.el8 ceph-noarch 96 k 2021-10-08T19:15:02.351 INFO:teuthology.orchestra.run.smithi097.stdout:Upgrading: 2021-10-08T19:15:02.352 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cryptography x86_64 3.2.1-4.el8 CentOS-Base 559 k 2021-10-08T19:15:02.352 INFO:teuthology.orchestra.run.smithi097.stdout:Installing dependencies: 2021-10-08T19:15:02.352 INFO:teuthology.orchestra.run.smithi097.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2021-10-08T19:15:02.352 INFO:teuthology.orchestra.run.smithi097.stdout: python3-babel noarch 2.5.1-5.el8 CentOS-AppStream 4.8 M 2021-10-08T19:15:02.352 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 CentOS-AppStream 538 k 2021-10-08T19:15:02.353 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:15:02.353 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction Summary 2021-10-08T19:15:02.354 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2021-10-08T19:15:02.354 INFO:teuthology.orchestra.run.smithi097.stdout:Install 4 Packages 2021-10-08T19:15:02.354 INFO:teuthology.orchestra.run.smithi097.stdout:Upgrade 1 Package 2021-10-08T19:15:02.354 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:15:02.355 INFO:teuthology.orchestra.run.smithi097.stdout:Total download size: 6.4 M 2021-10-08T19:15:02.355 INFO:teuthology.orchestra.run.smithi097.stdout:Downloading Packages: 2021-10-08T19:15:02.406 INFO:teuthology.orchestra.run.smithi097.stdout:(1/5): python3-jinja2-2.10.1-2.el8_0.noarch.rpm 10 MB/s | 538 kB 00:00 2021-10-08T19:15:02.453 INFO:teuthology.orchestra.run.smithi097.stdout:(2/5): python3-babel-2.5.1-5.el8.noarch.rpm 48 MB/s | 4.8 MB 00:00 2021-10-08T19:15:02.461 INFO:teuthology.orchestra.run.smithi097.stdout:(3/5): python3-cryptography-3.2.1-4.el8.x86_64. 75 MB/s | 559 kB 00:00 2021-10-08T19:15:02.546 INFO:teuthology.orchestra.run.smithi097.stdout:(4/5): ceph-mgr-cephadm-17.0.0-8087.g103b6cc3.e 497 kB/s | 96 kB 00:00 2021-10-08T19:15:02.601 INFO:teuthology.orchestra.run.smithi097.stdout:(5/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 2.4 MB/s | 476 kB 00:00 2021-10-08T19:15:02.613 INFO:teuthology.orchestra.run.smithi097.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:15:02.613 INFO:teuthology.orchestra.run.smithi097.stdout:Total 25 MB/s | 6.4 MB 00:00 2021-10-08T19:15:02.615 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction check 2021-10-08T19:15:02.625 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction check succeeded. 2021-10-08T19:15:02.626 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction test 2021-10-08T19:15:02.674 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: python3-cryptography-2.3-3.el8.x86_64 6/6 2021-10-08T19:15:02.674 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-cephadm-2:17.0.0-8087.g103b6cc3.el8.noarch 1/6 2021-10-08T19:15:02.674 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 2/6 2021-10-08T19:15:02.674 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 3/6 2021-10-08T19:15:02.675 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 4/6 2021-10-08T19:15:02.675 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cryptography-3.2.1-4.el8.x86_64 5/6 2021-10-08T19:15:02.750 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction test succeeded. 2021-10-08T19:15:02.752 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction 2021-10-08T19:15:03.083 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cryptography-2.3-3.el8.x86_64 6/6 2021-10-08T19:15:03.083 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:15:03.083 INFO:teuthology.orchestra.run.smithi117.stdout:Upgraded: 2021-10-08T19:15:03.083 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cryptography-3.2.1-4.el8.x86_64 2021-10-08T19:15:03.084 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2021-10-08T19:15:03.084 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-cephadm-2:17.0.0-8087.g103b6cc3.el8.noarch 2021-10-08T19:15:03.084 INFO:teuthology.orchestra.run.smithi117.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2021-10-08T19:15:03.084 INFO:teuthology.orchestra.run.smithi117.stdout: python3-babel-2.5.1-5.el8.noarch 2021-10-08T19:15:03.085 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2021-10-08T19:15:03.085 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:15:03.085 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2021-10-08T19:15:03.183 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-fuse 2021-10-08T19:15:03.228 INFO:teuthology.orchestra.run.smithi097.stdout: Preparing : 1/1 2021-10-08T19:15:03.625 INFO:teuthology.orchestra.run.smithi097.stdout: Upgrading : python3-cryptography-3.2.1-4.el8.x86_64 1/6 2021-10-08T19:15:03.652 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:01:41 ago on Fri 08 Oct 2021 07:13:22 PM UTC. 2021-10-08T19:15:04.341 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2021-10-08T19:15:04.342 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2021-10-08T19:15:04.343 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2021-10-08T19:15:04.343 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2021-10-08T19:15:04.343 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2021-10-08T19:15:04.344 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-fuse x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 869 k 2021-10-08T19:15:04.344 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2021-10-08T19:15:04.344 INFO:teuthology.orchestra.run.smithi117.stdout: fuse x86_64 2.9.7-12.el8 CentOS-Base 82 k 2021-10-08T19:15:04.344 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:15:04.344 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2021-10-08T19:15:04.345 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2021-10-08T19:15:04.345 INFO:teuthology.orchestra.run.smithi117.stdout:Install 2 Packages 2021-10-08T19:15:04.345 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:15:04.345 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 952 k 2021-10-08T19:15:04.346 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 3.1 M 2021-10-08T19:15:04.346 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2021-10-08T19:15:04.377 INFO:teuthology.orchestra.run.smithi117.stdout:(1/2): fuse-2.9.7-12.el8.x86_64.rpm 2.5 MB/s | 82 kB 00:00 2021-10-08T19:15:04.581 INFO:teuthology.orchestra.run.smithi117.stdout:(2/2): ceph-fuse-17.0.0-8087.g103b6cc3.el8.x86_ 3.6 MB/s | 869 kB 00:00 2021-10-08T19:15:04.582 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:15:04.583 INFO:teuthology.orchestra.run.smithi117.stdout:Total 3.9 MB/s | 952 kB 00:00 2021-10-08T19:15:04.584 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2021-10-08T19:15:04.605 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2021-10-08T19:15:04.606 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2021-10-08T19:15:04.620 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 2/6 2021-10-08T19:15:04.683 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2021-10-08T19:15:04.685 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2021-10-08T19:15:04.847 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2021-10-08T19:15:04.999 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 3/6 2021-10-08T19:15:05.123 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : fuse-2.9.7-12.el8.x86_64 1/2 2021-10-08T19:15:05.280 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 4/6 2021-10-08T19:15:05.296 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-fuse-2:17.0.0-8087.g103b6cc3.el8.x86_64 2/2 2021-10-08T19:15:05.438 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-mgr-cephadm-2:17.0.0-8087.g103b6cc3.el8.noarch 5/6 2021-10-08T19:15:05.456 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.0.0-8087.g103b6cc3.el8.noarch 5/6 2021-10-08T19:15:05.647 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-fuse-2:17.0.0-8087.g103b6cc3.el8.x86_64 2/2 2021-10-08T19:15:05.647 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-fuse-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/2 2021-10-08T19:15:05.677 INFO:teuthology.orchestra.run.smithi097.stdout: Cleanup : python3-cryptography-2.3-3.el8.x86_64 6/6 2021-10-08T19:15:05.954 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: python3-cryptography-2.3-3.el8.x86_64 6/6 2021-10-08T19:15:05.954 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-mgr-cephadm-2:17.0.0-8087.g103b6cc3.el8.noarch 1/6 2021-10-08T19:15:05.954 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 2/6 2021-10-08T19:15:05.954 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 3/6 2021-10-08T19:15:05.955 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 4/6 2021-10-08T19:15:05.955 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-cryptography-3.2.1-4.el8.x86_64 5/6 2021-10-08T19:15:05.967 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 2/2 2021-10-08T19:15:05.967 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:15:05.967 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2021-10-08T19:15:05.968 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-fuse-2:17.0.0-8087.g103b6cc3.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2021-10-08T19:15:05.968 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:15:05.968 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2021-10-08T19:15:06.186 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-volume 2021-10-08T19:15:06.311 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-cryptography-2.3-3.el8.x86_64 6/6 2021-10-08T19:15:06.311 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:15:06.312 INFO:teuthology.orchestra.run.smithi097.stdout:Upgraded: 2021-10-08T19:15:06.312 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cryptography-3.2.1-4.el8.x86_64 2021-10-08T19:15:06.312 INFO:teuthology.orchestra.run.smithi097.stdout:Installed: 2021-10-08T19:15:06.312 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-cephadm-2:17.0.0-8087.g103b6cc3.el8.noarch 2021-10-08T19:15:06.312 INFO:teuthology.orchestra.run.smithi097.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2021-10-08T19:15:06.313 INFO:teuthology.orchestra.run.smithi097.stdout: python3-babel-2.5.1-5.el8.noarch 2021-10-08T19:15:06.313 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2021-10-08T19:15:06.313 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:15:06.314 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2021-10-08T19:15:06.411 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum -y install ceph-fuse 2021-10-08T19:15:06.664 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:01:44 ago on Fri 08 Oct 2021 07:13:22 PM UTC. 2021-10-08T19:15:06.878 INFO:teuthology.orchestra.run.smithi097.stdout:Last metadata expiration check: 0:01:44 ago on Fri 08 Oct 2021 07:13:22 PM UTC. 2021-10-08T19:15:07.435 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2021-10-08T19:15:07.436 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2021-10-08T19:15:07.436 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2021-10-08T19:15:07.437 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2021-10-08T19:15:07.437 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2021-10-08T19:15:07.437 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-volume noarch 2:17.0.0-8087.g103b6cc3.el8 ceph-noarch 253 k 2021-10-08T19:15:07.437 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:15:07.438 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2021-10-08T19:15:07.438 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2021-10-08T19:15:07.438 INFO:teuthology.orchestra.run.smithi117.stdout:Install 1 Package 2021-10-08T19:15:07.438 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:15:07.439 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 253 k 2021-10-08T19:15:07.440 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 1.2 M 2021-10-08T19:15:07.440 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2021-10-08T19:15:07.631 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-volume-17.0.0-8087.g103b6cc3.el8.noarch.rp 1.3 MB/s | 253 kB 00:00 2021-10-08T19:15:07.632 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:15:07.632 INFO:teuthology.orchestra.run.smithi117.stdout:Total 1.3 MB/s | 253 kB 00:00 2021-10-08T19:15:07.632 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2021-10-08T19:15:07.640 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2021-10-08T19:15:07.640 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2021-10-08T19:15:07.656 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2021-10-08T19:15:07.663 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2021-10-08T19:15:07.856 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2021-10-08T19:15:08.025 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2021-10-08T19:15:08.025 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2021-10-08T19:15:08.026 INFO:teuthology.orchestra.run.smithi097.stdout: Package Arch Version Repository Size 2021-10-08T19:15:08.026 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2021-10-08T19:15:08.026 INFO:teuthology.orchestra.run.smithi097.stdout:Installing: 2021-10-08T19:15:08.026 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-fuse x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 869 k 2021-10-08T19:15:08.027 INFO:teuthology.orchestra.run.smithi097.stdout:Installing dependencies: 2021-10-08T19:15:08.027 INFO:teuthology.orchestra.run.smithi097.stdout: fuse x86_64 2.9.7-12.el8 CentOS-Base 82 k 2021-10-08T19:15:08.027 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:15:08.027 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction Summary 2021-10-08T19:15:08.027 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2021-10-08T19:15:08.028 INFO:teuthology.orchestra.run.smithi097.stdout:Install 2 Packages 2021-10-08T19:15:08.028 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:15:08.028 INFO:teuthology.orchestra.run.smithi097.stdout:Total download size: 952 k 2021-10-08T19:15:08.028 INFO:teuthology.orchestra.run.smithi097.stdout:Installed size: 3.1 M 2021-10-08T19:15:08.028 INFO:teuthology.orchestra.run.smithi097.stdout:Downloading Packages: 2021-10-08T19:15:08.061 INFO:teuthology.orchestra.run.smithi097.stdout:(1/2): fuse-2.9.7-12.el8.x86_64.rpm 2.3 MB/s | 82 kB 00:00 2021-10-08T19:15:08.072 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-volume-2:17.0.0-8087.g103b6cc3.el8.noarch 1/1 2021-10-08T19:15:08.265 INFO:teuthology.orchestra.run.smithi097.stdout:(2/2): ceph-fuse-17.0.0-8087.g103b6cc3.el8.x86_ 3.6 MB/s | 869 kB 00:00 2021-10-08T19:15:08.266 INFO:teuthology.orchestra.run.smithi097.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:15:08.266 INFO:teuthology.orchestra.run.smithi097.stdout:Total 3.9 MB/s | 952 kB 00:00 2021-10-08T19:15:08.267 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction check 2021-10-08T19:15:08.289 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction check succeeded. 2021-10-08T19:15:08.289 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction test 2021-10-08T19:15:08.365 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction test succeeded. 2021-10-08T19:15:08.367 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction 2021-10-08T19:15:08.447 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-volume-2:17.0.0-8087.g103b6cc3.el8.noarch 1/1 2021-10-08T19:15:08.523 INFO:teuthology.orchestra.run.smithi097.stdout: Preparing : 1/1 2021-10-08T19:15:08.725 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-volume-2:17.0.0-8087.g103b6cc3.el8.noarch 1/1 2021-10-08T19:15:08.725 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:15:08.725 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2021-10-08T19:15:08.725 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-volume-2:17.0.0-8087.g103b6cc3.el8.noarch 2021-10-08T19:15:08.726 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:15:08.726 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2021-10-08T19:15:08.813 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : fuse-2.9.7-12.el8.x86_64 1/2 2021-10-08T19:15:08.915 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install librados-devel 2021-10-08T19:15:08.970 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-fuse-2:17.0.0-8087.g103b6cc3.el8.x86_64 2/2 2021-10-08T19:15:09.331 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-fuse-2:17.0.0-8087.g103b6cc3.el8.x86_64 2/2 2021-10-08T19:15:09.331 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-fuse-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/2 2021-10-08T19:15:09.394 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:01:47 ago on Fri 08 Oct 2021 07:13:22 PM UTC. 2021-10-08T19:15:09.672 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 2/2 2021-10-08T19:15:09.672 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:15:09.673 INFO:teuthology.orchestra.run.smithi097.stdout:Installed: 2021-10-08T19:15:09.673 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-fuse-2:17.0.0-8087.g103b6cc3.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2021-10-08T19:15:09.673 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:15:09.673 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2021-10-08T19:15:09.837 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum -y install ceph-volume 2021-10-08T19:15:10.061 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2021-10-08T19:15:10.061 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2021-10-08T19:15:10.062 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repo Size 2021-10-08T19:15:10.062 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2021-10-08T19:15:10.062 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2021-10-08T19:15:10.062 INFO:teuthology.orchestra.run.smithi117.stdout: librados-devel x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 125 k 2021-10-08T19:15:10.063 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:15:10.063 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2021-10-08T19:15:10.063 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2021-10-08T19:15:10.068 INFO:teuthology.orchestra.run.smithi117.stdout:Install 1 Package 2021-10-08T19:15:10.068 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:15:10.069 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 125 k 2021-10-08T19:15:10.069 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 432 k 2021-10-08T19:15:10.069 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2021-10-08T19:15:10.230 INFO:teuthology.orchestra.run.smithi117.stdout:librados-devel-17.0.0-8087.g103b6cc3.el8.x86_64 736 kB/s | 125 kB 00:00 2021-10-08T19:15:10.231 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:15:10.231 INFO:teuthology.orchestra.run.smithi117.stdout:Total 730 kB/s | 125 kB 00:00 2021-10-08T19:15:10.232 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2021-10-08T19:15:10.237 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2021-10-08T19:15:10.237 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2021-10-08T19:15:10.287 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2021-10-08T19:15:10.289 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2021-10-08T19:15:10.321 INFO:teuthology.orchestra.run.smithi097.stdout:Last metadata expiration check: 0:01:48 ago on Fri 08 Oct 2021 07:13:22 PM UTC. 2021-10-08T19:15:10.400 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2021-10-08T19:15:10.570 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librados-devel-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:15:10.821 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librados-devel-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:15:10.962 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2021-10-08T19:15:10.963 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2021-10-08T19:15:10.964 INFO:teuthology.orchestra.run.smithi097.stdout: Package Arch Version Repository Size 2021-10-08T19:15:10.964 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2021-10-08T19:15:10.964 INFO:teuthology.orchestra.run.smithi097.stdout:Installing: 2021-10-08T19:15:10.964 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-volume noarch 2:17.0.0-8087.g103b6cc3.el8 ceph-noarch 253 k 2021-10-08T19:15:10.965 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:15:10.965 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction Summary 2021-10-08T19:15:10.965 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2021-10-08T19:15:10.965 INFO:teuthology.orchestra.run.smithi097.stdout:Install 1 Package 2021-10-08T19:15:10.965 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:15:10.966 INFO:teuthology.orchestra.run.smithi097.stdout:Total download size: 253 k 2021-10-08T19:15:10.966 INFO:teuthology.orchestra.run.smithi097.stdout:Installed size: 1.2 M 2021-10-08T19:15:10.966 INFO:teuthology.orchestra.run.smithi097.stdout:Downloading Packages: 2021-10-08T19:15:11.102 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados-devel-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:15:11.102 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:15:11.103 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2021-10-08T19:15:11.103 INFO:teuthology.orchestra.run.smithi117.stdout: librados-devel-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:15:11.103 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:15:11.103 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2021-10-08T19:15:11.159 INFO:teuthology.orchestra.run.smithi097.stdout:ceph-volume-17.0.0-8087.g103b6cc3.el8.noarch.rp 1.3 MB/s | 253 kB 00:00 2021-10-08T19:15:11.159 INFO:teuthology.orchestra.run.smithi097.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:15:11.160 INFO:teuthology.orchestra.run.smithi097.stdout:Total 1.3 MB/s | 253 kB 00:00 2021-10-08T19:15:11.160 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction check 2021-10-08T19:15:11.169 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction check succeeded. 2021-10-08T19:15:11.169 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction test 2021-10-08T19:15:11.184 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction test succeeded. 2021-10-08T19:15:11.188 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction 2021-10-08T19:15:11.298 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install libcephfs2 2021-10-08T19:15:11.355 INFO:teuthology.orchestra.run.smithi097.stdout: Preparing : 1/1 2021-10-08T19:15:11.587 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-volume-2:17.0.0-8087.g103b6cc3.el8.noarch 1/1 2021-10-08T19:15:11.771 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:01:49 ago on Fri 08 Oct 2021 07:13:22 PM UTC. 2021-10-08T19:15:11.992 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-volume-2:17.0.0-8087.g103b6cc3.el8.noarch 1/1 2021-10-08T19:15:12.292 INFO:teuthology.orchestra.run.smithi117.stdout:Package libcephfs2-2:17.0.0-8087.g103b6cc3.el8.x86_64 is already installed. 2021-10-08T19:15:12.307 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-volume-2:17.0.0-8087.g103b6cc3.el8.noarch 1/1 2021-10-08T19:15:12.308 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:15:12.308 INFO:teuthology.orchestra.run.smithi097.stdout:Installed: 2021-10-08T19:15:12.308 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-volume-2:17.0.0-8087.g103b6cc3.el8.noarch 2021-10-08T19:15:12.308 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:15:12.309 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2021-10-08T19:15:12.452 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum -y install librados-devel 2021-10-08T19:15:12.467 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2021-10-08T19:15:12.468 INFO:teuthology.orchestra.run.smithi117.stdout:Nothing to do. 2021-10-08T19:15:12.468 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2021-10-08T19:15:12.530 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install libcephfs-devel 2021-10-08T19:15:12.922 INFO:teuthology.orchestra.run.smithi097.stdout:Last metadata expiration check: 0:01:50 ago on Fri 08 Oct 2021 07:13:22 PM UTC. 2021-10-08T19:15:12.998 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:01:50 ago on Fri 08 Oct 2021 07:13:22 PM UTC. 2021-10-08T19:15:13.603 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2021-10-08T19:15:13.604 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2021-10-08T19:15:13.604 INFO:teuthology.orchestra.run.smithi097.stdout: Package Arch Version Repo Size 2021-10-08T19:15:13.604 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2021-10-08T19:15:13.605 INFO:teuthology.orchestra.run.smithi097.stdout:Installing: 2021-10-08T19:15:13.605 INFO:teuthology.orchestra.run.smithi097.stdout: librados-devel x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 125 k 2021-10-08T19:15:13.605 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:15:13.605 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction Summary 2021-10-08T19:15:13.606 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2021-10-08T19:15:13.606 INFO:teuthology.orchestra.run.smithi097.stdout:Install 1 Package 2021-10-08T19:15:13.606 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:15:13.606 INFO:teuthology.orchestra.run.smithi097.stdout:Total download size: 125 k 2021-10-08T19:15:13.606 INFO:teuthology.orchestra.run.smithi097.stdout:Installed size: 432 k 2021-10-08T19:15:13.607 INFO:teuthology.orchestra.run.smithi097.stdout:Downloading Packages: 2021-10-08T19:15:13.660 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2021-10-08T19:15:13.661 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2021-10-08T19:15:13.662 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repo Size 2021-10-08T19:15:13.662 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2021-10-08T19:15:13.662 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2021-10-08T19:15:13.663 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs-devel x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 24 k 2021-10-08T19:15:13.663 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:15:13.663 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2021-10-08T19:15:13.663 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2021-10-08T19:15:13.664 INFO:teuthology.orchestra.run.smithi117.stdout:Install 1 Package 2021-10-08T19:15:13.664 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:15:13.664 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 24 k 2021-10-08T19:15:13.664 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 102 k 2021-10-08T19:15:13.664 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2021-10-08T19:15:13.780 INFO:teuthology.orchestra.run.smithi097.stdout:librados-devel-17.0.0-8087.g103b6cc3.el8.x86_64 714 kB/s | 125 kB 00:00 2021-10-08T19:15:13.780 INFO:teuthology.orchestra.run.smithi097.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:15:13.780 INFO:teuthology.orchestra.run.smithi097.stdout:Total 708 kB/s | 125 kB 00:00 2021-10-08T19:15:13.781 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction check 2021-10-08T19:15:13.785 INFO:teuthology.orchestra.run.smithi117.stdout:libcephfs-devel-17.0.0-8087.g103b6cc3.el8.x86_6 194 kB/s | 24 kB 00:00 2021-10-08T19:15:13.785 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:15:13.786 INFO:teuthology.orchestra.run.smithi117.stdout:Total 192 kB/s | 24 kB 00:00 2021-10-08T19:15:13.786 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2021-10-08T19:15:13.787 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction check succeeded. 2021-10-08T19:15:13.787 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction test 2021-10-08T19:15:13.789 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2021-10-08T19:15:13.789 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2021-10-08T19:15:13.791 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2021-10-08T19:15:13.793 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2021-10-08T19:15:13.836 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction test succeeded. 2021-10-08T19:15:13.838 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction 2021-10-08T19:15:13.850 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2021-10-08T19:15:13.952 INFO:teuthology.orchestra.run.smithi097.stdout: Preparing : 1/1 2021-10-08T19:15:14.028 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephfs-devel-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:15:14.168 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : librados-devel-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:15:14.273 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libcephfs-devel-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:15:14.418 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: librados-devel-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:15:14.552 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephfs-devel-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:15:14.552 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:15:14.552 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2021-10-08T19:15:14.553 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs-devel-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:15:14.553 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:15:14.553 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2021-10-08T19:15:14.636 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install librados2 2021-10-08T19:15:14.772 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : librados-devel-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:15:14.773 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:15:14.773 INFO:teuthology.orchestra.run.smithi097.stdout:Installed: 2021-10-08T19:15:14.773 INFO:teuthology.orchestra.run.smithi097.stdout: librados-devel-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:15:14.774 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:15:14.774 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2021-10-08T19:15:14.945 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum -y install libcephfs2 2021-10-08T19:15:15.106 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:01:53 ago on Fri 08 Oct 2021 07:13:22 PM UTC. 2021-10-08T19:15:15.421 INFO:teuthology.orchestra.run.smithi097.stdout:Last metadata expiration check: 0:01:53 ago on Fri 08 Oct 2021 07:13:22 PM UTC. 2021-10-08T19:15:15.585 INFO:teuthology.orchestra.run.smithi117.stdout:Package librados2-2:17.0.0-8087.g103b6cc3.el8.x86_64 is already installed. 2021-10-08T19:15:15.760 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2021-10-08T19:15:15.761 INFO:teuthology.orchestra.run.smithi117.stdout:Nothing to do. 2021-10-08T19:15:15.761 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2021-10-08T19:15:15.833 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install librbd1 2021-10-08T19:15:15.886 INFO:teuthology.orchestra.run.smithi097.stdout:Package libcephfs2-2:17.0.0-8087.g103b6cc3.el8.x86_64 is already installed. 2021-10-08T19:15:16.061 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2021-10-08T19:15:16.063 INFO:teuthology.orchestra.run.smithi097.stdout:Nothing to do. 2021-10-08T19:15:16.063 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2021-10-08T19:15:16.130 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum -y install libcephfs-devel 2021-10-08T19:15:16.300 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:01:54 ago on Fri 08 Oct 2021 07:13:22 PM UTC. 2021-10-08T19:15:16.598 INFO:teuthology.orchestra.run.smithi097.stdout:Last metadata expiration check: 0:01:54 ago on Fri 08 Oct 2021 07:13:22 PM UTC. 2021-10-08T19:15:16.801 INFO:teuthology.orchestra.run.smithi117.stdout:Package librbd1-2:17.0.0-8087.g103b6cc3.el8.x86_64 is already installed. 2021-10-08T19:15:16.977 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2021-10-08T19:15:16.978 INFO:teuthology.orchestra.run.smithi117.stdout:Nothing to do. 2021-10-08T19:15:16.979 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2021-10-08T19:15:17.045 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install python3-rados 2021-10-08T19:15:17.246 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2021-10-08T19:15:17.247 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2021-10-08T19:15:17.248 INFO:teuthology.orchestra.run.smithi097.stdout: Package Arch Version Repo Size 2021-10-08T19:15:17.248 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2021-10-08T19:15:17.248 INFO:teuthology.orchestra.run.smithi097.stdout:Installing: 2021-10-08T19:15:17.248 INFO:teuthology.orchestra.run.smithi097.stdout: libcephfs-devel x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 24 k 2021-10-08T19:15:17.249 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:15:17.249 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction Summary 2021-10-08T19:15:17.249 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2021-10-08T19:15:17.249 INFO:teuthology.orchestra.run.smithi097.stdout:Install 1 Package 2021-10-08T19:15:17.249 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:15:17.250 INFO:teuthology.orchestra.run.smithi097.stdout:Total download size: 24 k 2021-10-08T19:15:17.250 INFO:teuthology.orchestra.run.smithi097.stdout:Installed size: 102 k 2021-10-08T19:15:17.250 INFO:teuthology.orchestra.run.smithi097.stdout:Downloading Packages: 2021-10-08T19:15:17.372 INFO:teuthology.orchestra.run.smithi097.stdout:libcephfs-devel-17.0.0-8087.g103b6cc3.el8.x86_6 195 kB/s | 24 kB 00:00 2021-10-08T19:15:17.372 INFO:teuthology.orchestra.run.smithi097.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:15:17.373 INFO:teuthology.orchestra.run.smithi097.stdout:Total 193 kB/s | 24 kB 00:00 2021-10-08T19:15:17.373 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction check 2021-10-08T19:15:17.376 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction check succeeded. 2021-10-08T19:15:17.376 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction test 2021-10-08T19:15:17.378 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction test succeeded. 2021-10-08T19:15:17.379 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction 2021-10-08T19:15:17.435 INFO:teuthology.orchestra.run.smithi097.stdout: Preparing : 1/1 2021-10-08T19:15:17.513 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:01:55 ago on Fri 08 Oct 2021 07:13:22 PM UTC. 2021-10-08T19:15:17.602 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libcephfs-devel-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:15:17.817 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: libcephfs-devel-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:15:18.071 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libcephfs-devel-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:15:18.072 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:15:18.072 INFO:teuthology.orchestra.run.smithi097.stdout:Installed: 2021-10-08T19:15:18.072 INFO:teuthology.orchestra.run.smithi097.stdout: libcephfs-devel-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:15:18.073 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:15:18.073 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2021-10-08T19:15:18.145 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum -y install librados2 2021-10-08T19:15:18.502 INFO:teuthology.orchestra.run.smithi117.stdout:Package python3-rados-2:17.0.0-8087.g103b6cc3.el8.x86_64 is already installed. 2021-10-08T19:15:18.614 INFO:teuthology.orchestra.run.smithi097.stdout:Last metadata expiration check: 0:01:56 ago on Fri 08 Oct 2021 07:13:22 PM UTC. 2021-10-08T19:15:18.676 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2021-10-08T19:15:18.677 INFO:teuthology.orchestra.run.smithi117.stdout:Nothing to do. 2021-10-08T19:15:18.677 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2021-10-08T19:15:18.757 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install python3-rgw 2021-10-08T19:15:19.085 INFO:teuthology.orchestra.run.smithi097.stdout:Package librados2-2:17.0.0-8087.g103b6cc3.el8.x86_64 is already installed. 2021-10-08T19:15:19.225 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:01:57 ago on Fri 08 Oct 2021 07:13:22 PM UTC. 2021-10-08T19:15:19.260 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2021-10-08T19:15:19.261 INFO:teuthology.orchestra.run.smithi097.stdout:Nothing to do. 2021-10-08T19:15:19.261 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2021-10-08T19:15:19.333 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum -y install librbd1 2021-10-08T19:15:19.709 INFO:teuthology.orchestra.run.smithi117.stdout:Package python3-rgw-2:17.0.0-8087.g103b6cc3.el8.x86_64 is already installed. 2021-10-08T19:15:19.799 INFO:teuthology.orchestra.run.smithi097.stdout:Last metadata expiration check: 0:01:57 ago on Fri 08 Oct 2021 07:13:22 PM UTC. 2021-10-08T19:15:19.883 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2021-10-08T19:15:19.885 INFO:teuthology.orchestra.run.smithi117.stdout:Nothing to do. 2021-10-08T19:15:19.886 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2021-10-08T19:15:19.957 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install python3-cephfs 2021-10-08T19:15:20.286 INFO:teuthology.orchestra.run.smithi097.stdout:Package librbd1-2:17.0.0-8087.g103b6cc3.el8.x86_64 is already installed. 2021-10-08T19:15:20.425 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:01:58 ago on Fri 08 Oct 2021 07:13:22 PM UTC. 2021-10-08T19:15:20.460 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2021-10-08T19:15:20.461 INFO:teuthology.orchestra.run.smithi097.stdout:Nothing to do. 2021-10-08T19:15:20.461 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2021-10-08T19:15:20.531 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum -y install python3-rados 2021-10-08T19:15:20.934 INFO:teuthology.orchestra.run.smithi117.stdout:Package python3-cephfs-2:17.0.0-8087.g103b6cc3.el8.x86_64 is already installed. 2021-10-08T19:15:20.997 INFO:teuthology.orchestra.run.smithi097.stdout:Last metadata expiration check: 0:01:58 ago on Fri 08 Oct 2021 07:13:22 PM UTC. 2021-10-08T19:15:21.110 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2021-10-08T19:15:21.110 INFO:teuthology.orchestra.run.smithi117.stdout:Nothing to do. 2021-10-08T19:15:21.110 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2021-10-08T19:15:21.182 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install python3-rbd 2021-10-08T19:15:21.468 INFO:teuthology.orchestra.run.smithi097.stdout:Package python3-rados-2:17.0.0-8087.g103b6cc3.el8.x86_64 is already installed. 2021-10-08T19:15:21.643 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2021-10-08T19:15:21.644 INFO:teuthology.orchestra.run.smithi097.stdout:Nothing to do. 2021-10-08T19:15:21.644 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2021-10-08T19:15:21.649 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:01:59 ago on Fri 08 Oct 2021 07:13:22 PM UTC. 2021-10-08T19:15:21.709 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum -y install python3-rgw 2021-10-08T19:15:22.125 INFO:teuthology.orchestra.run.smithi117.stdout:Package python3-rbd-2:17.0.0-8087.g103b6cc3.el8.x86_64 is already installed. 2021-10-08T19:15:22.178 INFO:teuthology.orchestra.run.smithi097.stdout:Last metadata expiration check: 0:02:00 ago on Fri 08 Oct 2021 07:13:22 PM UTC. 2021-10-08T19:15:22.300 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2021-10-08T19:15:22.301 INFO:teuthology.orchestra.run.smithi117.stdout:Nothing to do. 2021-10-08T19:15:22.301 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2021-10-08T19:15:22.373 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install rbd-fuse 2021-10-08T19:15:22.668 INFO:teuthology.orchestra.run.smithi097.stdout:Package python3-rgw-2:17.0.0-8087.g103b6cc3.el8.x86_64 is already installed. 2021-10-08T19:15:22.839 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:02:00 ago on Fri 08 Oct 2021 07:13:22 PM UTC. 2021-10-08T19:15:22.842 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2021-10-08T19:15:22.843 INFO:teuthology.orchestra.run.smithi097.stdout:Nothing to do. 2021-10-08T19:15:22.846 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2021-10-08T19:15:22.908 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum -y install python3-cephfs 2021-10-08T19:15:23.372 INFO:teuthology.orchestra.run.smithi097.stdout:Last metadata expiration check: 0:02:01 ago on Fri 08 Oct 2021 07:13:22 PM UTC. 2021-10-08T19:15:23.515 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2021-10-08T19:15:23.516 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2021-10-08T19:15:23.516 INFO:teuthology.orchestra.run.smithi117.stdout: Package Architecture Version Repository Size 2021-10-08T19:15:23.516 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2021-10-08T19:15:23.516 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2021-10-08T19:15:23.517 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-fuse x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 93 k 2021-10-08T19:15:23.517 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:15:23.517 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2021-10-08T19:15:23.517 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2021-10-08T19:15:23.517 INFO:teuthology.orchestra.run.smithi117.stdout:Install 1 Package 2021-10-08T19:15:23.518 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:15:23.518 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 93 k 2021-10-08T19:15:23.518 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 281 k 2021-10-08T19:15:23.518 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2021-10-08T19:15:23.689 INFO:teuthology.orchestra.run.smithi117.stdout:rbd-fuse-17.0.0-8087.g103b6cc3.el8.x86_64.rpm 539 kB/s | 93 kB 00:00 2021-10-08T19:15:23.690 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:15:23.690 INFO:teuthology.orchestra.run.smithi117.stdout:Total 535 kB/s | 93 kB 00:00 2021-10-08T19:15:23.690 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2021-10-08T19:15:23.701 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2021-10-08T19:15:23.702 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2021-10-08T19:15:23.752 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2021-10-08T19:15:23.754 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2021-10-08T19:15:23.843 INFO:teuthology.orchestra.run.smithi097.stdout:Package python3-cephfs-2:17.0.0-8087.g103b6cc3.el8.x86_64 is already installed. 2021-10-08T19:15:23.870 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2021-10-08T19:15:24.021 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2021-10-08T19:15:24.021 INFO:teuthology.orchestra.run.smithi097.stdout:Nothing to do. 2021-10-08T19:15:24.022 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2021-10-08T19:15:24.270 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum -y install python3-rbd 2021-10-08T19:15:24.507 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-fuse-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:15:24.739 INFO:teuthology.orchestra.run.smithi097.stdout:Last metadata expiration check: 0:02:02 ago on Fri 08 Oct 2021 07:13:22 PM UTC. 2021-10-08T19:15:25.019 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: rbd-fuse-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:15:25.236 INFO:teuthology.orchestra.run.smithi097.stdout:Package python3-rbd-2:17.0.0-8087.g103b6cc3.el8.x86_64 is already installed. 2021-10-08T19:15:25.305 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-fuse-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:15:25.305 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:15:25.305 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2021-10-08T19:15:25.306 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-fuse-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:15:25.306 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:15:25.306 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2021-10-08T19:15:25.410 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2021-10-08T19:15:25.412 INFO:teuthology.orchestra.run.smithi097.stdout:Nothing to do. 2021-10-08T19:15:25.412 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2021-10-08T19:15:25.481 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum -y install rbd-fuse 2021-10-08T19:15:25.483 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install rbd-mirror 2021-10-08T19:15:25.949 INFO:teuthology.orchestra.run.smithi097.stdout:Last metadata expiration check: 0:02:03 ago on Fri 08 Oct 2021 07:13:22 PM UTC. 2021-10-08T19:15:25.967 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:02:03 ago on Fri 08 Oct 2021 07:13:22 PM UTC. 2021-10-08T19:15:26.611 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2021-10-08T19:15:26.614 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2021-10-08T19:15:26.614 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repo Size 2021-10-08T19:15:26.615 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2021-10-08T19:15:26.615 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2021-10-08T19:15:26.615 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-mirror x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 3.8 M 2021-10-08T19:15:26.615 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:15:26.616 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2021-10-08T19:15:26.616 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2021-10-08T19:15:26.616 INFO:teuthology.orchestra.run.smithi117.stdout:Install 1 Package 2021-10-08T19:15:26.617 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:15:26.617 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 3.8 M 2021-10-08T19:15:26.617 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 19 M 2021-10-08T19:15:26.618 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2021-10-08T19:15:26.618 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2021-10-08T19:15:26.618 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2021-10-08T19:15:26.619 INFO:teuthology.orchestra.run.smithi097.stdout: Package Architecture Version Repository Size 2021-10-08T19:15:26.619 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2021-10-08T19:15:26.619 INFO:teuthology.orchestra.run.smithi097.stdout:Installing: 2021-10-08T19:15:26.619 INFO:teuthology.orchestra.run.smithi097.stdout: rbd-fuse x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 93 k 2021-10-08T19:15:26.620 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:15:26.620 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction Summary 2021-10-08T19:15:26.620 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2021-10-08T19:15:26.620 INFO:teuthology.orchestra.run.smithi097.stdout:Install 1 Package 2021-10-08T19:15:26.620 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:15:26.621 INFO:teuthology.orchestra.run.smithi097.stdout:Total download size: 93 k 2021-10-08T19:15:26.621 INFO:teuthology.orchestra.run.smithi097.stdout:Installed size: 281 k 2021-10-08T19:15:26.621 INFO:teuthology.orchestra.run.smithi097.stdout:Downloading Packages: 2021-10-08T19:15:26.785 INFO:teuthology.orchestra.run.smithi097.stdout:rbd-fuse-17.0.0-8087.g103b6cc3.el8.x86_64.rpm 542 kB/s | 93 kB 00:00 2021-10-08T19:15:26.912 INFO:teuthology.orchestra.run.smithi097.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:15:26.914 INFO:teuthology.orchestra.run.smithi097.stdout:Total 538 kB/s | 93 kB 00:00 2021-10-08T19:15:26.915 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction check 2021-10-08T19:15:26.915 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction check succeeded. 2021-10-08T19:15:26.916 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction test 2021-10-08T19:15:26.916 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction test succeeded. 2021-10-08T19:15:26.916 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction 2021-10-08T19:15:26.962 INFO:teuthology.orchestra.run.smithi117.stdout:rbd-mirror-17.0.0-8087.g103b6cc3.el8.x86_64.rpm 11 MB/s | 3.8 MB 00:00 2021-10-08T19:15:26.963 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:15:26.963 INFO:teuthology.orchestra.run.smithi117.stdout:Total 11 MB/s | 3.8 MB 00:00 2021-10-08T19:15:26.964 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2021-10-08T19:15:26.974 INFO:teuthology.orchestra.run.smithi097.stdout: Preparing : 1/1 2021-10-08T19:15:26.977 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2021-10-08T19:15:26.977 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2021-10-08T19:15:27.039 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2021-10-08T19:15:27.042 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2021-10-08T19:15:27.158 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : rbd-fuse-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:15:27.391 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: rbd-fuse-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:15:27.521 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2021-10-08T19:15:27.689 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : rbd-fuse-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:15:27.689 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:15:27.690 INFO:teuthology.orchestra.run.smithi097.stdout:Installed: 2021-10-08T19:15:27.690 INFO:teuthology.orchestra.run.smithi097.stdout: rbd-fuse-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:15:27.690 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:15:27.690 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2021-10-08T19:15:27.693 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-mirror-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:15:27.850 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum -y install rbd-mirror 2021-10-08T19:15:28.076 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: rbd-mirror-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:15:28.325 INFO:teuthology.orchestra.run.smithi097.stdout:Last metadata expiration check: 0:02:06 ago on Fri 08 Oct 2021 07:13:22 PM UTC. 2021-10-08T19:15:28.391 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-mirror-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:15:28.429 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:15:28.430 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2021-10-08T19:15:28.430 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-mirror-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:15:28.430 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:15:28.431 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2021-10-08T19:15:28.554 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install rbd-nbd 2021-10-08T19:15:28.985 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2021-10-08T19:15:28.986 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2021-10-08T19:15:28.986 INFO:teuthology.orchestra.run.smithi097.stdout: Package Arch Version Repo Size 2021-10-08T19:15:28.987 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2021-10-08T19:15:28.987 INFO:teuthology.orchestra.run.smithi097.stdout:Installing: 2021-10-08T19:15:28.987 INFO:teuthology.orchestra.run.smithi097.stdout: rbd-mirror x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 3.8 M 2021-10-08T19:15:28.987 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:15:28.988 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction Summary 2021-10-08T19:15:28.988 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2021-10-08T19:15:28.988 INFO:teuthology.orchestra.run.smithi097.stdout:Install 1 Package 2021-10-08T19:15:28.988 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:15:28.988 INFO:teuthology.orchestra.run.smithi097.stdout:Total download size: 3.8 M 2021-10-08T19:15:28.989 INFO:teuthology.orchestra.run.smithi097.stdout:Installed size: 19 M 2021-10-08T19:15:28.989 INFO:teuthology.orchestra.run.smithi097.stdout:Downloading Packages: 2021-10-08T19:15:29.030 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:02:07 ago on Fri 08 Oct 2021 07:13:22 PM UTC. 2021-10-08T19:15:29.549 INFO:teuthology.orchestra.run.smithi097.stdout:rbd-mirror-17.0.0-8087.g103b6cc3.el8.x86_64.rpm 6.7 MB/s | 3.8 MB 00:00 2021-10-08T19:15:29.550 INFO:teuthology.orchestra.run.smithi097.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:15:29.551 INFO:teuthology.orchestra.run.smithi097.stdout:Total 6.7 MB/s | 3.8 MB 00:00 2021-10-08T19:15:29.551 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction check 2021-10-08T19:15:29.563 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction check succeeded. 2021-10-08T19:15:29.564 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction test 2021-10-08T19:15:29.627 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction test succeeded. 2021-10-08T19:15:29.629 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction 2021-10-08T19:15:29.722 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2021-10-08T19:15:29.724 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2021-10-08T19:15:29.725 INFO:teuthology.orchestra.run.smithi117.stdout: Package Architecture Version Repository Size 2021-10-08T19:15:29.725 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2021-10-08T19:15:29.725 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2021-10-08T19:15:29.727 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-nbd x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 173 k 2021-10-08T19:15:29.727 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:15:29.727 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2021-10-08T19:15:29.728 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2021-10-08T19:15:29.728 INFO:teuthology.orchestra.run.smithi117.stdout:Install 1 Package 2021-10-08T19:15:29.728 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:15:29.729 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 173 k 2021-10-08T19:15:29.729 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 563 k 2021-10-08T19:15:29.730 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2021-10-08T19:15:29.903 INFO:teuthology.orchestra.run.smithi117.stdout:rbd-nbd-17.0.0-8087.g103b6cc3.el8.x86_64.rpm 1.0 MB/s | 173 kB 00:00 2021-10-08T19:15:29.904 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:15:29.904 INFO:teuthology.orchestra.run.smithi117.stdout:Total 996 kB/s | 173 kB 00:00 2021-10-08T19:15:29.905 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2021-10-08T19:15:29.909 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2021-10-08T19:15:29.909 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2021-10-08T19:15:29.960 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2021-10-08T19:15:29.962 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2021-10-08T19:15:30.110 INFO:teuthology.orchestra.run.smithi097.stdout: Preparing : 1/1 2021-10-08T19:15:30.113 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2021-10-08T19:15:30.652 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-nbd-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:15:30.743 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : rbd-mirror-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:15:31.114 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: rbd-nbd-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:15:31.134 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: rbd-mirror-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:15:31.404 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-nbd-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:15:31.404 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:15:31.405 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2021-10-08T19:15:31.405 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-nbd-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:15:31.405 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:15:31.405 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2021-10-08T19:15:31.439 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : rbd-mirror-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:15:31.439 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:15:31.440 INFO:teuthology.orchestra.run.smithi097.stdout:Installed: 2021-10-08T19:15:31.440 INFO:teuthology.orchestra.run.smithi097.stdout: rbd-mirror-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:15:31.440 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:15:31.441 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2021-10-08T19:15:31.592 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum -y install rbd-nbd 2021-10-08T19:15:31.625 DEBUG:teuthology.parallel:result is None 2021-10-08T19:15:32.067 INFO:teuthology.orchestra.run.smithi097.stdout:Last metadata expiration check: 0:02:10 ago on Fri 08 Oct 2021 07:13:22 PM UTC. 2021-10-08T19:15:32.709 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2021-10-08T19:15:32.709 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2021-10-08T19:15:32.710 INFO:teuthology.orchestra.run.smithi097.stdout: Package Architecture Version Repository Size 2021-10-08T19:15:32.710 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2021-10-08T19:15:32.710 INFO:teuthology.orchestra.run.smithi097.stdout:Installing: 2021-10-08T19:15:32.710 INFO:teuthology.orchestra.run.smithi097.stdout: rbd-nbd x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 173 k 2021-10-08T19:15:32.711 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:15:32.711 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction Summary 2021-10-08T19:15:32.711 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2021-10-08T19:15:32.711 INFO:teuthology.orchestra.run.smithi097.stdout:Install 1 Package 2021-10-08T19:15:32.711 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:15:32.712 INFO:teuthology.orchestra.run.smithi097.stdout:Total download size: 173 k 2021-10-08T19:15:32.712 INFO:teuthology.orchestra.run.smithi097.stdout:Installed size: 563 k 2021-10-08T19:15:32.712 INFO:teuthology.orchestra.run.smithi097.stdout:Downloading Packages: 2021-10-08T19:15:32.878 INFO:teuthology.orchestra.run.smithi097.stdout:rbd-nbd-17.0.0-8087.g103b6cc3.el8.x86_64.rpm 1.0 MB/s | 173 kB 00:00 2021-10-08T19:15:32.881 INFO:teuthology.orchestra.run.smithi097.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:15:32.881 INFO:teuthology.orchestra.run.smithi097.stdout:Total 1.0 MB/s | 173 kB 00:00 2021-10-08T19:15:32.882 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction check 2021-10-08T19:15:32.891 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction check succeeded. 2021-10-08T19:15:32.892 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction test 2021-10-08T19:15:32.941 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction test succeeded. 2021-10-08T19:15:32.943 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction 2021-10-08T19:15:33.071 INFO:teuthology.orchestra.run.smithi097.stdout: Preparing : 1/1 2021-10-08T19:15:33.290 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : rbd-nbd-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:15:33.546 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: rbd-nbd-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:15:33.818 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : rbd-nbd-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:15:33.819 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:15:33.819 INFO:teuthology.orchestra.run.smithi097.stdout:Installed: 2021-10-08T19:15:33.820 INFO:teuthology.orchestra.run.smithi097.stdout: rbd-nbd-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:15:33.820 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:15:33.820 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2021-10-08T19:15:34.038 DEBUG:teuthology.parallel:result is None 2021-10-08T19:15:34.039 DEBUG:teuthology.orchestra.run.smithi097:> sudo lsb_release -is 2021-10-08T19:15:34.071 INFO:teuthology.orchestra.run.smithi097.stdout:CentOS 2021-10-08T19:15:34.072 DEBUG:teuthology.misc:System to be installed: CentOS 2021-10-08T19:15:34.073 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=103b6cc3554193fcd0852d9c647cef19e99920cf 2021-10-08T19:15:34.234 DEBUG:teuthology.orchestra.run.smithi097:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2021-10-08T19:15:34.252 INFO:teuthology.orchestra.run.smithi097.stdout:17.0.0-8087.g103b6cc3.el8 2021-10-08T19:15:34.253 INFO:teuthology.packaging:The installed version of ceph is 17.0.0-8087.g103b6cc3.el8 2021-10-08T19:15:34.254 INFO:teuthology.task.install:The correct ceph version 17.0.0-8087.g103b6cc3 is installed. 2021-10-08T19:15:34.254 DEBUG:teuthology.orchestra.run.smithi117:> sudo lsb_release -is 2021-10-08T19:15:34.295 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS 2021-10-08T19:15:34.296 DEBUG:teuthology.misc:System to be installed: CentOS 2021-10-08T19:15:34.297 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=103b6cc3554193fcd0852d9c647cef19e99920cf 2021-10-08T19:15:34.458 DEBUG:teuthology.orchestra.run.smithi117:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2021-10-08T19:15:34.481 INFO:teuthology.orchestra.run.smithi117.stdout:17.0.0-8087.g103b6cc3.el8 2021-10-08T19:15:34.481 INFO:teuthology.packaging:The installed version of ceph is 17.0.0-8087.g103b6cc3.el8 2021-10-08T19:15:34.482 INFO:teuthology.task.install:The correct ceph version 17.0.0-8087.g103b6cc3 is installed. 2021-10-08T19:15:34.482 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2021-10-08T19:15:34.483 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2021-10-08T19:15:34.483 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-10-08T19:15:34.508 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2021-10-08T19:15:34.508 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-10-08T19:15:34.548 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2021-10-08T19:15:34.549 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2021-10-08T19:15:34.549 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/usr/bin/daemon-helper 2021-10-08T19:15:34.573 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-10-08T19:15:34.636 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2021-10-08T19:15:34.637 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/daemon-helper 2021-10-08T19:15:34.663 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-10-08T19:15:34.729 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2021-10-08T19:15:34.729 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2021-10-08T19:15:34.730 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/usr/bin/adjust-ulimits 2021-10-08T19:15:34.753 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-10-08T19:15:34.816 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2021-10-08T19:15:34.816 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/adjust-ulimits 2021-10-08T19:15:34.842 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-10-08T19:15:34.911 INFO:teuthology.run_tasks:Running task cephadm... 2021-10-08T19:15:34.987 INFO:tasks.cephadm:Config: {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'ms bind msgr2': False, 'ms type': 'async'}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10}, 'osd': {'debug ms': 1, 'debug osd': 20, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd max backfills': 3, 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2}}, 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'but it is still running', 'objects unfound and apparently lost'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'mon_bind_msgr2': False, 'sha1': '103b6cc3554193fcd0852d9c647cef19e99920cf', 'cephadm_mode': 'root'} 2021-10-08T19:15:34.988 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf 2021-10-08T19:15:34.989 INFO:tasks.cephadm:Cluster fsid is 1d01f6d6-286c-11ec-8c25-001a4aab830c 2021-10-08T19:15:34.989 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2021-10-08T19:15:34.989 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '[v1:172.21.15.97:6789]', 'mon.c': '[v1:172.21.15.97:6790]', 'mon.b': '[v1:172.21.15.117:6789]'} 2021-10-08T19:15:34.990 INFO:tasks.cephadm:First mon is mon.a on smithi097 2021-10-08T19:15:34.990 INFO:tasks.cephadm:First mgr is y 2021-10-08T19:15:34.990 INFO:tasks.cephadm:Normalizing hostnames... 2021-10-08T19:15:34.991 DEBUG:teuthology.orchestra.run.smithi097:> sudo hostname $(hostname -s) 2021-10-08T19:15:35.015 DEBUG:teuthology.orchestra.run.smithi117:> sudo hostname $(hostname -s) 2021-10-08T19:15:35.040 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref 103b6cc3554193fcd0852d9c647cef19e99920cf)... 2021-10-08T19:15:35.041 DEBUG:teuthology.orchestra.run.smithi097:> curl --silent https://raw.githubusercontent.com/ceph/ceph/103b6cc3554193fcd0852d9c647cef19e99920cf/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2021-10-08T19:15:35.164 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-rw-r--. 1 ubuntu ubuntu 293258 Oct 8 19:15 /home/ubuntu/cephtest/cephadm 2021-10-08T19:15:35.164 DEBUG:teuthology.orchestra.run.smithi117:> curl --silent https://raw.githubusercontent.com/ceph/ceph/103b6cc3554193fcd0852d9c647cef19e99920cf/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2021-10-08T19:15:35.274 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-rw-r--. 1 ubuntu ubuntu 293258 Oct 8 19:15 /home/ubuntu/cephtest/cephadm 2021-10-08T19:15:35.275 DEBUG:teuthology.orchestra.run.smithi097:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2021-10-08T19:15:35.290 DEBUG:teuthology.orchestra.run.smithi117:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2021-10-08T19:15:35.320 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /etc/ceph 2021-10-08T19:15:35.354 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /etc/ceph 2021-10-08T19:15:35.379 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 777 /etc/ceph 2021-10-08T19:15:35.417 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 777 /etc/ceph 2021-10-08T19:15:35.443 INFO:tasks.cephadm:Writing seed config... 2021-10-08T19:15:35.444 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2021-10-08T19:15:35.445 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2021-10-08T19:15:35.445 INFO:tasks.cephadm: override: [client.0] debug ms = 1 2021-10-08T19:15:35.445 INFO:tasks.cephadm: override: [client.0] debug objecter = 20 2021-10-08T19:15:35.446 INFO:tasks.cephadm: override: [client.0] debug rados = 20 2021-10-08T19:15:35.446 INFO:tasks.cephadm: override: [global] ms bind msgr2 = False 2021-10-08T19:15:35.446 INFO:tasks.cephadm: override: [global] ms type = async 2021-10-08T19:15:35.447 INFO:tasks.cephadm: override: [mon] debug mon = 20 2021-10-08T19:15:35.447 INFO:tasks.cephadm: override: [mon] debug ms = 1 2021-10-08T19:15:35.447 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2021-10-08T19:15:35.448 INFO:tasks.cephadm: override: [mon] mon min osdmap epochs = 50 2021-10-08T19:15:35.448 INFO:tasks.cephadm: override: [mon] mon osdmap full prune interval = 2 2021-10-08T19:15:35.449 INFO:tasks.cephadm: override: [mon] mon osdmap full prune min = 15 2021-10-08T19:15:35.449 INFO:tasks.cephadm: override: [mon] mon osdmap full prune txsize = 2 2021-10-08T19:15:35.449 INFO:tasks.cephadm: override: [mon] paxos service trim min = 10 2021-10-08T19:15:35.450 INFO:tasks.cephadm: override: [osd] debug ms = 1 2021-10-08T19:15:35.450 INFO:tasks.cephadm: override: [osd] debug osd = 20 2021-10-08T19:15:35.452 INFO:tasks.cephadm: override: [osd] osd debug reject backfill probability = 0.3 2021-10-08T19:15:35.452 INFO:tasks.cephadm: override: [osd] osd delete sleep = 1 2021-10-08T19:15:35.452 INFO:tasks.cephadm: override: [osd] osd max backfills = 3 2021-10-08T19:15:35.453 INFO:tasks.cephadm: override: [osd] osd scrub max interval = 120 2021-10-08T19:15:35.453 INFO:tasks.cephadm: override: [osd] osd scrub min interval = 60 2021-10-08T19:15:35.453 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2021-10-08T19:15:35.454 INFO:tasks.cephadm: override: [osd] osd snap trim sleep = 2 2021-10-08T19:15:35.455 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2021-10-08T19:15:35.455 DEBUG:teuthology.orchestra.run.smithi097:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2021-10-08T19:15:35.471 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 1d01f6d6-286c-11ec-8c25-001a4aab830c ms bind msgr2 = False ms type = async [osd] osd scrub load threshold = 5.0 osd scrub max interval = 120 osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 osd debug reject backfill probability = 0.3 osd delete sleep = 1 osd max backfills = 3 osd scrub min interval = 60 osd snap trim sleep = 2 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon min osdmap epochs = 50 mon osdmap full prune interval = 2 mon osdmap full prune min = 15 mon osdmap full prune txsize = 2 paxos service trim min = 10 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client.0] debug ms = 1 debug objecter = 20 debug rados = 20 2021-10-08T19:15:35.472 DEBUG:teuthology.orchestra.run.smithi097:mon.a> sudo journalctl -f -n 0 -u ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@mon.a.service 2021-10-08T19:15:35.514 DEBUG:teuthology.orchestra.run.smithi097:mgr.y> sudo journalctl -f -n 0 -u ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@mgr.y.service 2021-10-08T19:15:35.536 INFO:journalctl@ceph.mon.a.smithi097.stdout:-- Logs begin at Fri 2021-10-08 19:07:18 UTC. -- 2021-10-08T19:15:35.538 INFO:tasks.cephadm:Bootstrapping... 2021-10-08T19:15:35.538 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -v bootstrap --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-addrv '[v1:172.21.15.97:6789]' --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2021-10-08T19:15:35.559 INFO:journalctl@ceph.mgr.y.smithi097.stdout:-- Logs begin at Fri 2021-10-08 19:07:18 UTC. -- 2021-10-08T19:15:35.754 INFO:teuthology.orchestra.run.smithi097.stderr:-------------------------------------------------------------------------------- 2021-10-08T19:15:35.755 INFO:teuthology.orchestra.run.smithi097.stderr:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf', '-v', 'bootstrap', '--fsid', '1d01f6d6-286c-11ec-8c25-001a4aab830c', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'y', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-addrv', '[v1:172.21.15.97:6789]', '--skip-admin-label'] 2021-10-08T19:15:35.756 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: /bin/podman version --format {{.Client.Version}} 2021-10-08T19:15:37.071 INFO:teuthology.orchestra.run.smithi097.stderr:/bin/podman: 3.0.2-dev 2021-10-08T19:15:37.086 INFO:teuthology.orchestra.run.smithi097.stderr:Verifying podman|docker is present... 2021-10-08T19:15:37.086 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: /bin/podman version --format {{.Client.Version}} 2021-10-08T19:15:37.137 INFO:teuthology.orchestra.run.smithi097.stderr:/bin/podman: 3.0.2-dev 2021-10-08T19:15:37.162 INFO:teuthology.orchestra.run.smithi097.stderr:Verifying lvm2 is present... 2021-10-08T19:15:37.162 INFO:teuthology.orchestra.run.smithi097.stderr:Verifying time synchronization is in place... 2021-10-08T19:15:37.163 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: systemctl is-enabled chrony.service 2021-10-08T19:15:37.168 INFO:teuthology.orchestra.run.smithi097.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2021-10-08T19:15:37.170 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: systemctl is-active chrony.service 2021-10-08T19:15:37.174 INFO:teuthology.orchestra.run.smithi097.stderr:systemctl: inactive 2021-10-08T19:15:37.175 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: systemctl is-enabled chronyd.service 2021-10-08T19:15:37.181 INFO:teuthology.orchestra.run.smithi097.stderr:systemctl: enabled 2021-10-08T19:15:37.181 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: systemctl is-active chronyd.service 2021-10-08T19:15:37.188 INFO:teuthology.orchestra.run.smithi097.stderr:systemctl: active 2021-10-08T19:15:37.188 INFO:teuthology.orchestra.run.smithi097.stderr:Unit chronyd.service is enabled and running 2021-10-08T19:15:37.188 INFO:teuthology.orchestra.run.smithi097.stderr:Repeating the final host check... 2021-10-08T19:15:37.189 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: /bin/podman version --format {{.Client.Version}} 2021-10-08T19:15:37.230 INFO:teuthology.orchestra.run.smithi097.stderr:/bin/podman: 3.0.2-dev 2021-10-08T19:15:37.244 INFO:teuthology.orchestra.run.smithi097.stderr:podman (/bin/podman) version 3.0.2 is present 2021-10-08T19:15:37.244 INFO:teuthology.orchestra.run.smithi097.stderr:systemctl is present 2021-10-08T19:15:37.244 INFO:teuthology.orchestra.run.smithi097.stderr:lvcreate is present 2021-10-08T19:15:37.246 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: systemctl is-enabled chrony.service 2021-10-08T19:15:37.249 INFO:teuthology.orchestra.run.smithi097.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2021-10-08T19:15:37.249 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: systemctl is-active chrony.service 2021-10-08T19:15:37.254 INFO:teuthology.orchestra.run.smithi097.stderr:systemctl: inactive 2021-10-08T19:15:37.255 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: systemctl is-enabled chronyd.service 2021-10-08T19:15:37.260 INFO:teuthology.orchestra.run.smithi097.stderr:systemctl: enabled 2021-10-08T19:15:37.261 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: systemctl is-active chronyd.service 2021-10-08T19:15:37.266 INFO:teuthology.orchestra.run.smithi097.stderr:systemctl: active 2021-10-08T19:15:37.267 INFO:teuthology.orchestra.run.smithi097.stderr:Unit chronyd.service is enabled and running 2021-10-08T19:15:37.267 INFO:teuthology.orchestra.run.smithi097.stderr:Host looks OK 2021-10-08T19:15:37.267 INFO:teuthology.orchestra.run.smithi097.stderr:Cluster fsid: 1d01f6d6-286c-11ec-8c25-001a4aab830c 2021-10-08T19:15:37.267 INFO:teuthology.orchestra.run.smithi097.stderr:Acquiring lock 139802583016056 on /run/cephadm/1d01f6d6-286c-11ec-8c25-001a4aab830c.lock 2021-10-08T19:15:37.268 INFO:teuthology.orchestra.run.smithi097.stderr:Lock 139802583016056 acquired on /run/cephadm/1d01f6d6-286c-11ec-8c25-001a4aab830c.lock 2021-10-08T19:15:37.268 INFO:teuthology.orchestra.run.smithi097.stderr:Verifying IP 172.21.15.97 port 6789 ... 2021-10-08T19:15:37.269 INFO:teuthology.orchestra.run.smithi097.stderr:Base mon IP is 172.21.15.97, final addrv is [v1:172.21.15.97:6789] 2021-10-08T19:15:37.269 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: /sbin/ip route ls 2021-10-08T19:15:37.269 INFO:teuthology.orchestra.run.smithi097.stderr:/sbin/ip: default via 172.21.15.254 dev enp3s0f1 proto dhcp metric 100 2021-10-08T19:15:37.270 INFO:teuthology.orchestra.run.smithi097.stderr:/sbin/ip: 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.97 metric 100 2021-10-08T19:15:37.270 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: /sbin/ip -6 route ls 2021-10-08T19:15:37.272 INFO:teuthology.orchestra.run.smithi097.stderr:/sbin/ip: ::1 dev lo proto kernel metric 256 pref medium 2021-10-08T19:15:37.272 INFO:teuthology.orchestra.run.smithi097.stderr:/sbin/ip: fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2021-10-08T19:15:37.272 INFO:teuthology.orchestra.run.smithi097.stderr:/sbin/ip: default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1797sec hoplimit 64 pref medium 2021-10-08T19:15:37.273 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: /sbin/ip -6 addr ls 2021-10-08T19:15:37.274 INFO:teuthology.orchestra.run.smithi097.stderr:/sbin/ip: 1: lo: mtu 65536 state UNKNOWN qlen 1000 2021-10-08T19:15:37.274 INFO:teuthology.orchestra.run.smithi097.stderr:/sbin/ip: inet6 ::1/128 scope host 2021-10-08T19:15:37.275 INFO:teuthology.orchestra.run.smithi097.stderr:/sbin/ip: valid_lft forever preferred_lft forever 2021-10-08T19:15:37.275 INFO:teuthology.orchestra.run.smithi097.stderr:/sbin/ip: 5: enp3s0f1: mtu 1500 state UP qlen 1000 2021-10-08T19:15:37.275 INFO:teuthology.orchestra.run.smithi097.stderr:/sbin/ip: inet6 fe80::ec4:7aff:fe8f:d805/64 scope link noprefixroute 2021-10-08T19:15:37.275 INFO:teuthology.orchestra.run.smithi097.stderr:/sbin/ip: valid_lft forever preferred_lft forever 2021-10-08T19:15:37.276 INFO:teuthology.orchestra.run.smithi097.stderr:Mon IP `172.21.15.97` is in CIDR network `172.21.0.0/20` 2021-10-08T19:15:37.276 INFO:teuthology.orchestra.run.smithi097.stderr:- internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2021-10-08T19:15:37.277 INFO:teuthology.orchestra.run.smithi097.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf... 2021-10-08T19:15:37.277 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: /bin/podman pull quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf 2021-10-08T19:15:37.363 INFO:teuthology.orchestra.run.smithi097.stderr:/bin/podman: Trying to pull quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf... 2021-10-08T19:15:37.461 INFO:teuthology.orchestra.run.smithi097.stderr:/bin/podman: Getting image source signatures 2021-10-08T19:15:37.579 INFO:teuthology.orchestra.run.smithi097.stderr:/bin/podman: Copying blob sha256:be118be2c7433f0fef49ac99462184a67ed6f0c5b5723500aea70f60acdb522f 2021-10-08T19:15:37.648 INFO:teuthology.orchestra.run.smithi097.stderr:/bin/podman: Copying blob sha256:bf399268b236a88e4db94bb617389c57056c51b9b05d91ff5b48f1ad6f845f5e 2021-10-08T19:15:55.021 INFO:teuthology.orchestra.run.smithi097.stderr:/bin/podman: Copying config sha256:085fa9937774283f2e7d932e3f979b6814e0da92c6b18e0753c7a57d64a9fc79 2021-10-08T19:15:55.070 INFO:teuthology.orchestra.run.smithi097.stderr:/bin/podman: Writing manifest to image destination 2021-10-08T19:15:55.071 INFO:teuthology.orchestra.run.smithi097.stderr:/bin/podman: Storing signatures 2021-10-08T19:16:07.054 INFO:teuthology.orchestra.run.smithi097.stderr:/bin/podman: 085fa9937774283f2e7d932e3f979b6814e0da92c6b18e0753c7a57d64a9fc79 2021-10-08T19:16:07.071 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi097 -e CEPH_USE_RANDOM_NONCE=1 quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf --version 2021-10-08T19:16:07.719 INFO:teuthology.orchestra.run.smithi097.stderr:ceph: ceph version 17.0.0-8087-g103b6cc3 (103b6cc3554193fcd0852d9c647cef19e99920cf) quincy (dev) 2021-10-08T19:16:18.651 INFO:teuthology.orchestra.run.smithi097.stderr:Ceph version: ceph version 17.0.0-8087-g103b6cc3 (103b6cc3554193fcd0852d9c647cef19e99920cf) quincy (dev) 2021-10-08T19:16:18.652 INFO:teuthology.orchestra.run.smithi097.stderr:Extracting ceph user uid/gid from container image... 2021-10-08T19:16:18.652 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint stat --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi097 -e CEPH_USE_RANDOM_NONCE=1 quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -c %u %g /var/lib/ceph 2021-10-08T19:16:19.193 INFO:teuthology.orchestra.run.smithi097.stderr:stat: 167 167 2021-10-08T19:16:19.643 INFO:teuthology.orchestra.run.smithi097.stderr:Creating initial keys... 2021-10-08T19:16:19.644 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph-authtool --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi097 -e CEPH_USE_RANDOM_NONCE=1 quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf --gen-print-key 2021-10-08T19:16:20.140 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph-authtool: AQAEmWBh8p35BxAA7nS6bsNjTO1lQI+7Vhbj1A== 2021-10-08T19:16:20.524 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph-authtool --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi097 -e CEPH_USE_RANDOM_NONCE=1 quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf --gen-print-key 2021-10-08T19:16:21.006 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph-authtool: AQAFmWBhg/UKABAAS9JPhICB5b3Aha7z8Oq4ag== 2021-10-08T19:16:21.451 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph-authtool --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi097 -e CEPH_USE_RANDOM_NONCE=1 quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf --gen-print-key 2021-10-08T19:16:21.931 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph-authtool: AQAFmWBhUTMfNxAA/yQk6oTYGQynX086xKhsUg== 2021-10-08T19:16:22.349 INFO:teuthology.orchestra.run.smithi097.stderr:Creating initial monmap... 2021-10-08T19:16:22.349 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/monmaptool --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi097 -e CEPH_USE_RANDOM_NONCE=1 -v /tmp/ceph-tmpycl0ad78:/tmp/monmap:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf --create --clobber --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c --addv a [v1:172.21.15.97:6789] /tmp/monmap 2021-10-08T19:16:22.847 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: monmap file /tmp/monmap 2021-10-08T19:16:22.848 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/monmaptool: setting min_mon_release = octopus 2021-10-08T19:16:22.848 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: set fsid to 1d01f6d6-286c-11ec-8c25-001a4aab830c 2021-10-08T19:16:22.848 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2021-10-08T19:16:23.319 INFO:teuthology.orchestra.run.smithi097.stderr:monmaptool for a [v1:172.21.15.97:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2021-10-08T19:16:23.319 INFO:teuthology.orchestra.run.smithi097.stderr:setting min_mon_release = octopus 2021-10-08T19:16:23.320 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/monmaptool: set fsid to 1d01f6d6-286c-11ec-8c25-001a4aab830c 2021-10-08T19:16:23.320 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2021-10-08T19:16:23.320 INFO:teuthology.orchestra.run.smithi097.stderr: 2021-10-08T19:16:23.320 INFO:teuthology.orchestra.run.smithi097.stderr:Creating mon... 2021-10-08T19:16:23.321 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph-mon --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi097 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z -v /tmp/ceph-tmpkabylpki:/tmp/keyring:z -v /tmp/ceph-tmpycl0ad78:/tmp/monmap:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf --mkfs -i a --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -c /dev/null --monmap /tmp/monmap --keyring /tmp/keyring --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false 2021-10-08T19:16:24.284 INFO:teuthology.orchestra.run.smithi097.stderr:create mon.a on 2021-10-08T19:16:24.285 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: install -d -m0770 -o 167 -g 167 /var/run/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c 2021-10-08T19:16:24.291 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: systemctl disable ceph.target 2021-10-08T19:16:24.298 INFO:teuthology.orchestra.run.smithi097.stderr:systemctl: Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2021-10-08T19:16:24.370 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: systemctl enable ceph.target 2021-10-08T19:16:24.375 INFO:teuthology.orchestra.run.smithi097.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2021-10-08T19:16:24.450 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: systemctl start ceph.target 2021-10-08T19:16:24.458 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: systemctl enable ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c.target 2021-10-08T19:16:24.463 INFO:teuthology.orchestra.run.smithi097.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c.target → /etc/systemd/system/ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c.target. 2021-10-08T19:16:24.463 INFO:teuthology.orchestra.run.smithi097.stderr:systemctl: Created symlink /etc/systemd/system/ceph.target.wants/ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c.target → /etc/systemd/system/ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c.target. 2021-10-08T19:16:24.532 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: systemctl start ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c.target 2021-10-08T19:16:24.539 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: systemctl daemon-reload 2021-10-08T19:16:24.616 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: systemctl stop ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@mon.a 2021-10-08T19:16:24.642 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: systemctl reset-failed ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@mon.a 2021-10-08T19:16:24.648 INFO:teuthology.orchestra.run.smithi097.stderr:systemctl: Failed to reset failed state of unit ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@mon.a.service: Unit ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@mon.a.service not loaded. 2021-10-08T19:16:24.648 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: systemctl enable ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@mon.a 2021-10-08T19:16:24.654 INFO:teuthology.orchestra.run.smithi097.stderr:systemctl: Created symlink /etc/systemd/system/ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c.target.wants/ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@mon.a.service → /etc/systemd/system/ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@.service. 2021-10-08T19:16:24.727 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: systemctl start ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@mon.a 2021-10-08T19:16:24.968 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:24 smithi097 systemd[1]: Starting Ceph mon.a for 1d01f6d6-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:16:25.246 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: systemctl is-enabled firewalld.service 2021-10-08T19:16:25.255 INFO:teuthology.orchestra.run.smithi097.stderr:systemctl: disabled 2021-10-08T19:16:25.256 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: systemctl is-active firewalld.service 2021-10-08T19:16:25.263 INFO:teuthology.orchestra.run.smithi097.stderr:systemctl: inactive 2021-10-08T19:16:25.264 INFO:teuthology.orchestra.run.smithi097.stderr:firewalld.service is not enabled 2021-10-08T19:16:25.265 INFO:teuthology.orchestra.run.smithi097.stderr:Not possible to enable service . firewalld.service is not available 2021-10-08T19:16:25.265 INFO:teuthology.orchestra.run.smithi097.stderr:Waiting for mon to start... 2021-10-08T19:16:25.266 INFO:teuthology.orchestra.run.smithi097.stderr:Waiting for mon... 2021-10-08T19:16:25.266 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi097 -e CEPH_USE_RANDOM_NONCE=1 -v /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z -v /tmp/ceph-tmpmhbq68kq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp9oueg4pa:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf status 2021-10-08T19:16:25.517 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:25 smithi097 bash[31605]: 687a28e0c35cc0d27f5784e1df9afc6542d20bf8c8f823b1a52306c64aa95a32 2021-10-08T19:16:25.517 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:25 smithi097 systemd[1]: Started Ceph mon.a for 1d01f6d6-286c-11ec-8c25-001a4aab830c. 2021-10-08T19:16:25.518 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:25 smithi097 ceph-mon[31816]: mkfs 1d01f6d6-286c-11ec-8c25-001a4aab830c 2021-10-08T19:16:25.518 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:25 smithi097 ceph-mon[31816]: mon.a is new leader, mons a in quorum (ranks 0) 2021-10-08T19:16:25.921 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: cluster: 2021-10-08T19:16:25.921 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: id: 1d01f6d6-286c-11ec-8c25-001a4aab830c 2021-10-08T19:16:25.922 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: health: HEALTH_OK 2021-10-08T19:16:25.922 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: 2021-10-08T19:16:25.922 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: services: 2021-10-08T19:16:25.923 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: mon: 1 daemons, quorum a (age 662305913) 2021-10-08T19:16:25.923 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: mgr: no daemons active 2021-10-08T19:16:25.923 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: osd: 0 osds: 0 up, 0 in 2021-10-08T19:16:25.923 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: 2021-10-08T19:16:25.924 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: data: 2021-10-08T19:16:25.924 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: pools: 0 pools, 0 pgs 2021-10-08T19:16:25.924 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: objects: 0 objects, 0 B 2021-10-08T19:16:25.924 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: usage: 0 B used, 0 B / 0 B avail 2021-10-08T19:16:25.925 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: pgs: 2021-10-08T19:16:25.925 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: 2021-10-08T19:16:26.657 INFO:teuthology.orchestra.run.smithi097.stderr:mon is available 2021-10-08T19:16:26.658 INFO:teuthology.orchestra.run.smithi097.stderr:Assimilating anything we can from ceph.conf... 2021-10-08T19:16:26.658 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi097 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpmhbq68kq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp9oueg4pa:/etc/ceph/ceph.conf:z -v /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf config assimilate-conf -i /var/lib/ceph/mon/ceph-a/config 2021-10-08T19:16:26.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:26 smithi097 ceph-mon[31816]: mon.a is new leader, mons a in quorum (ranks 0) 2021-10-08T19:16:26.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:26 smithi097 ceph-mon[31816]: monmap e1: 1 mons at {a=v1:172.21.15.97:6789/0} 2021-10-08T19:16:26.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:26 smithi097 ceph-mon[31816]: fsmap 2021-10-08T19:16:26.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:26 smithi097 ceph-mon[31816]: osdmap e1: 0 total, 0 up, 0 in 2021-10-08T19:16:26.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:26 smithi097 ceph-mon[31816]: mgrmap e1: no daemons active 2021-10-08T19:16:26.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:26 smithi097 ceph-mon[31816]: from='client.? v1:172.21.15.97:0/196102667' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2021-10-08T19:16:27.346 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: 2021-10-08T19:16:27.347 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: [global] 2021-10-08T19:16:27.347 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: fsid = 1d01f6d6-286c-11ec-8c25-001a4aab830c 2021-10-08T19:16:27.348 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: mon_host = [v1:172.21.15.97:6789] 2021-10-08T19:16:27.348 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: mon_osd_allow_pg_remap = true 2021-10-08T19:16:27.348 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: mon_osd_allow_primary_affinity = true 2021-10-08T19:16:27.349 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: mon_warn_on_no_sortbitwise = false 2021-10-08T19:16:27.349 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: osd_crush_chooseleaf_type = 0 2021-10-08T19:16:27.350 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: 2021-10-08T19:16:27.351 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: [mgr] 2021-10-08T19:16:27.351 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: mgr/telemetry/nag = false 2021-10-08T19:16:27.351 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: 2021-10-08T19:16:27.351 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: [osd] 2021-10-08T19:16:27.352 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: osd_map_max_advance = 10 2021-10-08T19:16:27.352 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: osd_sloppy_crc = true 2021-10-08T19:16:27.718 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:27 smithi097 ceph-mon[31816]: from='client.? v1:172.21.15.97:0/1019903222' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2021-10-08T19:16:27.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:27 smithi097 ceph-mon[31816]: from='client.? v1:172.21.15.97:0/1019903222' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2021-10-08T19:16:27.915 INFO:teuthology.orchestra.run.smithi097.stderr:Generating new minimal ceph.conf... 2021-10-08T19:16:27.915 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi097 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpmhbq68kq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp9oueg4pa:/etc/ceph/ceph.conf:z -v /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf config generate-minimal-conf -o /var/lib/ceph/mon/ceph-a/config 2021-10-08T19:16:28.968 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:28 smithi097 ceph-mon[31816]: from='client.? v1:172.21.15.97:0/928414799' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:16:29.107 INFO:teuthology.orchestra.run.smithi097.stderr:Restarting the monitor... 2021-10-08T19:16:29.108 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: systemctl restart ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@mon.a 2021-10-08T19:16:29.469 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:29 smithi097 systemd[1]: Stopping Ceph mon.a for 1d01f6d6-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:16:29.469 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:29 smithi097 bash[32301]: Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-mon.a found: no such container 2021-10-08T19:16:29.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:29 smithi097 conmon[31793]: 2021-10-08T19:16:29.253+0000 7f4a3f638700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2021-10-08T19:16:29.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:29 smithi097 conmon[31793]: 2021-10-08T19:16:29.253+0000 7f4a3f638700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2021-10-08T19:16:30.219 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:29 smithi097 bash[32301]: 687a28e0c35cc0d27f5784e1df9afc6542d20bf8c8f823b1a52306c64aa95a32 2021-10-08T19:16:30.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:29 smithi097 bash[32301]: Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-mon.a found: no such container 2021-10-08T19:16:30.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:29 smithi097 systemd[1]: Stopped Ceph mon.a for 1d01f6d6-286c-11ec-8c25-001a4aab830c. 2021-10-08T19:16:30.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:29 smithi097 systemd[1]: Starting Ceph mon.a for 1d01f6d6-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:16:30.371 INFO:teuthology.orchestra.run.smithi097.stderr:Setting mon public_network to 172.21.0.0/20 2021-10-08T19:16:30.371 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi097 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpmhbq68kq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp9oueg4pa:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf config set mon public_network 172.21.0.0/20 2021-10-08T19:16:30.586 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: set uid:gid to 167:167 (ceph:ceph) 2021-10-08T19:16:30.586 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: ceph version 17.0.0-8087-g103b6cc3 (103b6cc3554193fcd0852d9c647cef19e99920cf) quincy (dev), process ceph-mon, pid 7 2021-10-08T19:16:30.586 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: pidfile_write: ignore empty --pid-file 2021-10-08T19:16:30.587 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: load: jerasure load: lrc 2021-10-08T19:16:30.587 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: RocksDB version: 6.15.5 2021-10-08T19:16:30.587 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-10-08T19:16:30.587 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Compile date Oct 7 2021 2021-10-08T19:16:30.588 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: DB SUMMARY 2021-10-08T19:16:30.588 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: DB Session ID: KSEBW5M8V3ILW7C6F5N4 2021-10-08T19:16:30.588 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: CURRENT file: CURRENT 2021-10-08T19:16:30.588 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: IDENTITY file: IDENTITY 2021-10-08T19:16:30.589 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2021-10-08T19:16:30.589 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2021-10-08T19:16:30.589 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000010.log size: 87215 ; 2021-10-08T19:16:30.589 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.error_if_exists: 0 2021-10-08T19:16:30.589 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.create_if_missing: 0 2021-10-08T19:16:30.590 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.paranoid_checks: 1 2021-10-08T19:16:30.591 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2021-10-08T19:16:30.591 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.env: 0x55fc9d0f6b60 2021-10-08T19:16:30.591 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.fs: Posix File System 2021-10-08T19:16:30.591 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.info_log: 0x55fc9f90a0c0 2021-10-08T19:16:30.592 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.max_file_opening_threads: 16 2021-10-08T19:16:30.592 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.statistics: (nil) 2021-10-08T19:16:30.592 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.use_fsync: 0 2021-10-08T19:16:30.593 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.max_log_file_size: 0 2021-10-08T19:16:30.593 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.max_manifest_file_size: 1073741824 2021-10-08T19:16:30.593 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.log_file_time_to_roll: 0 2021-10-08T19:16:30.594 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.keep_log_file_num: 1000 2021-10-08T19:16:30.594 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.recycle_log_file_num: 0 2021-10-08T19:16:30.594 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.allow_fallocate: 1 2021-10-08T19:16:30.595 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.allow_mmap_reads: 0 2021-10-08T19:16:30.595 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.allow_mmap_writes: 0 2021-10-08T19:16:30.595 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.use_direct_reads: 0 2021-10-08T19:16:30.595 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-10-08T19:16:30.595 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.create_missing_column_families: 0 2021-10-08T19:16:30.596 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.db_log_dir: 2021-10-08T19:16:30.596 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2021-10-08T19:16:30.596 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.table_cache_numshardbits: 6 2021-10-08T19:16:30.596 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.WAL_ttl_seconds: 0 2021-10-08T19:16:30.597 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.WAL_size_limit_MB: 0 2021-10-08T19:16:30.597 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2021-10-08T19:16:30.597 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.manifest_preallocation_size: 4194304 2021-10-08T19:16:30.597 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.is_fd_close_on_exec: 1 2021-10-08T19:16:30.598 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.advise_random_on_open: 1 2021-10-08T19:16:30.598 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.db_write_buffer_size: 0 2021-10-08T19:16:30.598 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.write_buffer_manager: 0x55fc9f97fdd0 2021-10-08T19:16:30.598 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.access_hint_on_compaction_start: 1 2021-10-08T19:16:30.599 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-10-08T19:16:30.599 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.random_access_max_buffer_size: 1048576 2021-10-08T19:16:30.599 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.use_adaptive_mutex: 0 2021-10-08T19:16:30.599 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.rate_limiter: (nil) 2021-10-08T19:16:30.600 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-10-08T19:16:30.601 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.wal_recovery_mode: 2 2021-10-08T19:16:30.601 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.enable_thread_tracking: 0 2021-10-08T19:16:30.602 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.enable_pipelined_write: 0 2021-10-08T19:16:30.602 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.unordered_write: 0 2021-10-08T19:16:30.602 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.allow_concurrent_memtable_write: 1 2021-10-08T19:16:30.602 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-10-08T19:16:30.603 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.write_thread_max_yield_usec: 100 2021-10-08T19:16:30.603 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.write_thread_slow_yield_usec: 3 2021-10-08T19:16:30.603 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.row_cache: None 2021-10-08T19:16:30.603 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.wal_filter: None 2021-10-08T19:16:30.604 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.avoid_flush_during_recovery: 0 2021-10-08T19:16:30.604 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.allow_ingest_behind: 0 2021-10-08T19:16:30.604 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.preserve_deletes: 0 2021-10-08T19:16:30.605 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.two_write_queues: 0 2021-10-08T19:16:30.605 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.manual_wal_flush: 0 2021-10-08T19:16:30.606 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.atomic_flush: 0 2021-10-08T19:16:30.606 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-10-08T19:16:30.606 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.persist_stats_to_disk: 0 2021-10-08T19:16:30.607 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.write_dbid_to_manifest: 0 2021-10-08T19:16:30.607 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.log_readahead_size: 0 2021-10-08T19:16:30.607 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.file_checksum_gen_factory: Unknown 2021-10-08T19:16:30.608 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.best_efforts_recovery: 0 2021-10-08T19:16:30.608 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2021-10-08T19:16:30.609 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2021-10-08T19:16:30.609 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.allow_data_in_errors: 0 2021-10-08T19:16:30.610 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.db_host_id: __hostname__ 2021-10-08T19:16:30.610 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.max_background_jobs: 2 2021-10-08T19:16:30.615 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.max_background_compactions: -1 2021-10-08T19:16:30.615 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.max_subcompactions: 1 2021-10-08T19:16:30.616 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.avoid_flush_during_shutdown: 0 2021-10-08T19:16:30.616 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-10-08T19:16:30.616 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.delayed_write_rate : 16777216 2021-10-08T19:16:30.617 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.max_total_wal_size: 0 2021-10-08T19:16:30.617 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-10-08T19:16:30.617 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.stats_dump_period_sec: 600 2021-10-08T19:16:30.617 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.stats_persist_period_sec: 600 2021-10-08T19:16:30.618 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.stats_history_buffer_size: 1048576 2021-10-08T19:16:30.618 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.max_open_files: -1 2021-10-08T19:16:30.618 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.bytes_per_sync: 0 2021-10-08T19:16:30.618 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.wal_bytes_per_sync: 0 2021-10-08T19:16:30.619 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.strict_bytes_per_sync: 0 2021-10-08T19:16:30.619 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.compaction_readahead_size: 0 2021-10-08T19:16:30.619 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.max_background_flushes: -1 2021-10-08T19:16:30.619 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Compression algorithms supported: 2021-10-08T19:16:30.620 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: kZSTDNotFinalCompression supported: 0 2021-10-08T19:16:30.620 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: kZSTD supported: 0 2021-10-08T19:16:30.620 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: kXpressCompression supported: 0 2021-10-08T19:16:30.620 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: kLZ4HCCompression supported: 1 2021-10-08T19:16:30.620 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: kLZ4Compression supported: 1 2021-10-08T19:16:30.621 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: kBZip2Compression supported: 0 2021-10-08T19:16:30.621 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: kZlibCompression supported: 1 2021-10-08T19:16:30.622 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: kSnappyCompression supported: 1 2021-10-08T19:16:30.622 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Fast CRC32 supported: Supported on x86 2021-10-08T19:16:30.622 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: [db/version_set.cc:4725] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000009 2021-10-08T19:16:30.623 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: [db/column_family.cc:597] --------------- Options for column family [default]: 2021-10-08T19:16:30.623 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-10-08T19:16:30.623 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.merge_operator: 2021-10-08T19:16:30.624 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.compaction_filter: None 2021-10-08T19:16:30.624 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.compaction_filter_factory: None 2021-10-08T19:16:30.624 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.sst_partitioner_factory: None 2021-10-08T19:16:30.624 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.memtable_factory: SkipListFactory 2021-10-08T19:16:30.625 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.table_factory: BlockBasedTable 2021-10-08T19:16:30.625 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55fc9f8d3b80) 2021-10-08T19:16:30.625 INFO:journalctl@ceph.mon.a.smithi097.stdout: cache_index_and_filter_blocks: 1 2021-10-08T19:16:30.625 INFO:journalctl@ceph.mon.a.smithi097.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2021-10-08T19:16:30.625 INFO:journalctl@ceph.mon.a.smithi097.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2021-10-08T19:16:30.626 INFO:journalctl@ceph.mon.a.smithi097.stdout: pin_top_level_index_and_filter: 1 2021-10-08T19:16:30.626 INFO:journalctl@ceph.mon.a.smithi097.stdout: index_type: 0 2021-10-08T19:16:30.626 INFO:journalctl@ceph.mon.a.smithi097.stdout: data_block_index_type: 0 2021-10-08T19:16:30.626 INFO:journalctl@ceph.mon.a.smithi097.stdout: index_shortening: 1 2021-10-08T19:16:30.627 INFO:journalctl@ceph.mon.a.smithi097.stdout: data_block_hash_table_util_ratio: 0.750000 2021-10-08T19:16:30.628 INFO:journalctl@ceph.mon.a.smithi097.stdout: hash_index_allow_collision: 1 2021-10-08T19:16:30.628 INFO:journalctl@ceph.mon.a.smithi097.stdout: checksum: 1 2021-10-08T19:16:30.628 INFO:journalctl@ceph.mon.a.smithi097.stdout: no_block_cache: 0 2021-10-08T19:16:30.628 INFO:journalctl@ceph.mon.a.smithi097.stdout: block_cache: 0x55fc9f908d10 2021-10-08T19:16:30.629 INFO:journalctl@ceph.mon.a.smithi097.stdout: block_cache_name: BinnedLRUCache 2021-10-08T19:16:30.629 INFO:journalctl@ceph.mon.a.smithi097.stdout: block_cache_options: 2021-10-08T19:16:30.629 INFO:journalctl@ceph.mon.a.smithi097.stdout: capacity : 536870912 2021-10-08T19:16:30.629 INFO:journalctl@ceph.mon.a.smithi097.stdout: num_shard_bits : 4 2021-10-08T19:16:30.630 INFO:journalctl@ceph.mon.a.smithi097.stdout: strict_capacity_limit : 0 2021-10-08T19:16:30.630 INFO:journalctl@ceph.mon.a.smithi097.stdout: high_pri_pool_ratio: 0.000 2021-10-08T19:16:30.630 INFO:journalctl@ceph.mon.a.smithi097.stdout: block_cache_compressed: (nil) 2021-10-08T19:16:30.630 INFO:journalctl@ceph.mon.a.smithi097.stdout: persistent_cache: (nil) 2021-10-08T19:16:30.631 INFO:journalctl@ceph.mon.a.smithi097.stdout: block_size: 4096 2021-10-08T19:16:30.631 INFO:journalctl@ceph.mon.a.smithi097.stdout: block_size_deviation: 10 2021-10-08T19:16:30.631 INFO:journalctl@ceph.mon.a.smithi097.stdout: block_restart_interval: 16 2021-10-08T19:16:30.631 INFO:journalctl@ceph.mon.a.smithi097.stdout: index_block_restart_interval: 1 2021-10-08T19:16:30.631 INFO:journalctl@ceph.mon.a.smithi097.stdout: metadata_block_size: 4096 2021-10-08T19:16:30.632 INFO:journalctl@ceph.mon.a.smithi097.stdout: partition_filters: 0 2021-10-08T19:16:30.632 INFO:journalctl@ceph.mon.a.smithi097.stdout: use_delta_encoding: 1 2021-10-08T19:16:30.632 INFO:journalctl@ceph.mon.a.smithi097.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2021-10-08T19:16:30.632 INFO:journalctl@ceph.mon.a.smithi097.stdout: whole_key_filtering: 1 2021-10-08T19:16:30.632 INFO:journalctl@ceph.mon.a.smithi097.stdout: verify_compression: 0 2021-10-08T19:16:30.633 INFO:journalctl@ceph.mon.a.smithi097.stdout: read_amp_bytes_per_bit: 0 2021-10-08T19:16:30.633 INFO:journalctl@ceph.mon.a.smithi097.stdout: format_version: 4 2021-10-08T19:16:30.633 INFO:journalctl@ceph.mon.a.smithi097.stdout: enable_index_compression: 1 2021-10-08T19:16:30.633 INFO:journalctl@ceph.mon.a.smithi097.stdout: block_align: 0 2021-10-08T19:16:30.634 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.write_buffer_size: 33554432 2021-10-08T19:16:30.634 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.max_write_buffer_number: 2 2021-10-08T19:16:30.634 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.compression: NoCompression 2021-10-08T19:16:30.634 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.bottommost_compression: Disabled 2021-10-08T19:16:30.634 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.prefix_extractor: nullptr 2021-10-08T19:16:30.635 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-10-08T19:16:30.635 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.num_levels: 7 2021-10-08T19:16:30.635 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-10-08T19:16:30.635 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-10-08T19:16:30.636 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2021-10-08T19:16:30.636 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-10-08T19:16:30.636 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.bottommost_compression_opts.level: 32767 2021-10-08T19:16:30.636 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-10-08T19:16:30.636 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-10-08T19:16:30.637 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-10-08T19:16:30.637 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2021-10-08T19:16:30.637 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.bottommost_compression_opts.enabled: false 2021-10-08T19:16:30.637 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.compression_opts.window_bits: -14 2021-10-08T19:16:30.637 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.compression_opts.level: 32767 2021-10-08T19:16:30.638 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.compression_opts.strategy: 0 2021-10-08T19:16:30.638 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-10-08T19:16:30.638 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-10-08T19:16:30.638 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.compression_opts.parallel_threads: 1 2021-10-08T19:16:30.639 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.compression_opts.enabled: false 2021-10-08T19:16:30.639 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-10-08T19:16:30.639 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-10-08T19:16:30.639 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.level0_stop_writes_trigger: 36 2021-10-08T19:16:30.640 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.target_file_size_base: 67108864 2021-10-08T19:16:30.640 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.target_file_size_multiplier: 1 2021-10-08T19:16:30.640 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.max_bytes_for_level_base: 268435456 2021-10-08T19:16:30.640 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-10-08T19:16:30.640 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-10-08T19:16:30.641 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-10-08T19:16:30.641 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-10-08T19:16:30.641 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-10-08T19:16:30.641 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-10-08T19:16:30.641 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-10-08T19:16:30.642 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-10-08T19:16:30.642 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-10-08T19:16:30.642 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-10-08T19:16:30.642 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.max_compaction_bytes: 1677721600 2021-10-08T19:16:30.643 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.arena_block_size: 4194304 2021-10-08T19:16:30.643 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-10-08T19:16:30.643 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-10-08T19:16:30.643 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-10-08T19:16:30.643 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.disable_auto_compactions: 0 2021-10-08T19:16:30.644 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-10-08T19:16:30.644 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-10-08T19:16:30.644 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-10-08T19:16:30.644 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-10-08T19:16:30.645 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-10-08T19:16:30.645 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-10-08T19:16:30.645 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-10-08T19:16:30.645 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-10-08T19:16:30.645 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-10-08T19:16:30.646 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-10-08T19:16:30.646 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.table_properties_collectors: 2021-10-08T19:16:30.646 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.inplace_update_support: 0 2021-10-08T19:16:30.647 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.inplace_update_num_locks: 10000 2021-10-08T19:16:30.647 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-10-08T19:16:30.647 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.memtable_whole_key_filtering: 0 2021-10-08T19:16:30.647 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.memtable_huge_page_size: 0 2021-10-08T19:16:30.648 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.bloom_locality: 0 2021-10-08T19:16:30.648 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.max_successive_merges: 0 2021-10-08T19:16:30.648 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.optimize_filters_for_hits: 0 2021-10-08T19:16:30.648 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.paranoid_file_checks: 0 2021-10-08T19:16:30.648 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.force_consistency_checks: 1 2021-10-08T19:16:30.649 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.report_bg_io_stats: 0 2021-10-08T19:16:30.649 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.ttl: 2592000 2021-10-08T19:16:30.649 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.periodic_compaction_seconds: 0 2021-10-08T19:16:30.649 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.enable_blob_files: false 2021-10-08T19:16:30.649 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.min_blob_size: 0 2021-10-08T19:16:30.650 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.blob_file_size: 268435456 2021-10-08T19:16:30.650 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.blob_compression_type: NoCompression 2021-10-08T19:16:30.650 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.enable_blob_garbage_collection: false 2021-10-08T19:16:30.650 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2021-10-08T19:16:30.651 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: [db/version_set.cc:4773] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-10-08T19:16:30.651 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: [db/version_set.cc:4782] Column family [default] (ID 0), log number is 5 2021-10-08T19:16:30.651 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: [db/version_set.cc:4083] Creating manifest 13 2021-10-08T19:16:30.651 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: EVENT_LOG_v1 {"time_micros": 1633720590330709, "job": 1, "event": "recovery_started", "wal_files": [10]} 2021-10-08T19:16:30.651 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: [db/db_impl/db_impl_open.cc:847] Recovering log #10 mode 2 2021-10-08T19:16:30.652 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: [table/block_based/filter_policy.cc:996] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2021-10-08T19:16:30.652 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: EVENT_LOG_v1 {"time_micros": 1633720590331634, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 83209, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 81350, "index_size": 219, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 11514, "raw_average_key_size": 48, "raw_value_size": 74978, "raw_average_value_size": 317, "num_data_blocks": 10, "num_entries": 236, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1633720590, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "5fe8d33e-85d1-4f28-bde0-4cbdbd695b1e", "db_session_id": "KSEBW5M8V3ILW7C6F5N4"}} 2021-10-08T19:16:30.652 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: [db/version_set.cc:4083] Creating manifest 15 2021-10-08T19:16:30.652 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: EVENT_LOG_v1 {"time_micros": 1633720590332064, "job": 1, "event": "recovery_finished"} 2021-10-08T19:16:30.653 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: [file/delete_scheduler.cc:73] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2021-10-08T19:16:30.653 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: [db/db_impl/db_impl_open.cc:1701] SstFileManager instance 0x55fc9f924a80 2021-10-08T19:16:30.653 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: DB pointer 0x55fc9f934000 2021-10-08T19:16:30.653 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: [db/db_impl/db_impl.cc:902] ------- DUMPING STATS ------- 2021-10-08T19:16:30.653 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: rocksdb: [db/db_impl/db_impl.cc:903] 2021-10-08T19:16:30.654 INFO:journalctl@ceph.mon.a.smithi097.stdout: ** DB Stats ** 2021-10-08T19:16:30.654 INFO:journalctl@ceph.mon.a.smithi097.stdout: Uptime(secs): 0.0 total, 0.0 interval 2021-10-08T19:16:30.654 INFO:journalctl@ceph.mon.a.smithi097.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-10-08T19:16:30.654 INFO:journalctl@ceph.mon.a.smithi097.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-10-08T19:16:30.655 INFO:journalctl@ceph.mon.a.smithi097.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-10-08T19:16:30.655 INFO:journalctl@ceph.mon.a.smithi097.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-10-08T19:16:30.655 INFO:journalctl@ceph.mon.a.smithi097.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-10-08T19:16:30.655 INFO:journalctl@ceph.mon.a.smithi097.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-10-08T19:16:30.655 INFO:journalctl@ceph.mon.a.smithi097.stdout: 2021-10-08T19:16:30.656 INFO:journalctl@ceph.mon.a.smithi097.stdout: ** Compaction Stats [default] ** 2021-10-08T19:16:30.656 INFO:journalctl@ceph.mon.a.smithi097.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-10-08T19:16:30.656 INFO:journalctl@ceph.mon.a.smithi097.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-10-08T19:16:30.656 INFO:journalctl@ceph.mon.a.smithi097.stdout: L0 2/0 82.98 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 130.7 0.00 0.00 1 0.001 0 0 2021-10-08T19:16:30.657 INFO:journalctl@ceph.mon.a.smithi097.stdout: Sum 2/0 82.98 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 130.7 0.00 0.00 1 0.001 0 0 2021-10-08T19:16:30.657 INFO:journalctl@ceph.mon.a.smithi097.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 130.7 0.00 0.00 1 0.001 0 0 2021-10-08T19:16:30.657 INFO:journalctl@ceph.mon.a.smithi097.stdout: 2021-10-08T19:16:30.657 INFO:journalctl@ceph.mon.a.smithi097.stdout: ** Compaction Stats [default] ** 2021-10-08T19:16:30.657 INFO:journalctl@ceph.mon.a.smithi097.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-10-08T19:16:30.658 INFO:journalctl@ceph.mon.a.smithi097.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-10-08T19:16:30.658 INFO:journalctl@ceph.mon.a.smithi097.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 130.7 0.00 0.00 1 0.001 0 0 2021-10-08T19:16:30.658 INFO:journalctl@ceph.mon.a.smithi097.stdout: Uptime(secs): 0.0 total, 0.0 interval 2021-10-08T19:16:30.658 INFO:journalctl@ceph.mon.a.smithi097.stdout: Flush(GB): cumulative 0.000, interval 0.000 2021-10-08T19:16:30.659 INFO:journalctl@ceph.mon.a.smithi097.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2021-10-08T19:16:30.659 INFO:journalctl@ceph.mon.a.smithi097.stdout: AddFile(Total Files): cumulative 0, interval 0 2021-10-08T19:16:30.659 INFO:journalctl@ceph.mon.a.smithi097.stdout: AddFile(L0 Files): cumulative 0, interval 0 2021-10-08T19:16:30.659 INFO:journalctl@ceph.mon.a.smithi097.stdout: AddFile(Keys): cumulative 0, interval 0 2021-10-08T19:16:30.660 INFO:journalctl@ceph.mon.a.smithi097.stdout: Cumulative compaction: 0.00 GB write, 20.24 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-10-08T19:16:30.660 INFO:journalctl@ceph.mon.a.smithi097.stdout: Interval compaction: 0.00 GB write, 20.24 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-10-08T19:16:30.660 INFO:journalctl@ceph.mon.a.smithi097.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-10-08T19:16:30.661 INFO:journalctl@ceph.mon.a.smithi097.stdout: 2021-10-08T19:16:30.661 INFO:journalctl@ceph.mon.a.smithi097.stdout: ** File Read Latency Histogram By Level [default] ** 2021-10-08T19:16:30.661 INFO:journalctl@ceph.mon.a.smithi097.stdout: 2021-10-08T19:16:30.661 INFO:journalctl@ceph.mon.a.smithi097.stdout: ** Compaction Stats [default] ** 2021-10-08T19:16:30.662 INFO:journalctl@ceph.mon.a.smithi097.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-10-08T19:16:30.662 INFO:journalctl@ceph.mon.a.smithi097.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-10-08T19:16:30.662 INFO:journalctl@ceph.mon.a.smithi097.stdout: L0 2/0 82.98 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 130.7 0.00 0.00 1 0.001 0 0 2021-10-08T19:16:30.662 INFO:journalctl@ceph.mon.a.smithi097.stdout: Sum 2/0 82.98 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 130.7 0.00 0.00 1 0.001 0 0 2021-10-08T19:16:30.663 INFO:journalctl@ceph.mon.a.smithi097.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-10-08T19:16:30.663 INFO:journalctl@ceph.mon.a.smithi097.stdout: 2021-10-08T19:16:30.663 INFO:journalctl@ceph.mon.a.smithi097.stdout: ** Compaction Stats [default] ** 2021-10-08T19:16:30.663 INFO:journalctl@ceph.mon.a.smithi097.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-10-08T19:16:30.663 INFO:journalctl@ceph.mon.a.smithi097.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-10-08T19:16:30.664 INFO:journalctl@ceph.mon.a.smithi097.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 130.7 0.00 0.00 1 0.001 0 0 2021-10-08T19:16:30.664 INFO:journalctl@ceph.mon.a.smithi097.stdout: Uptime(secs): 0.0 total, 0.0 interval 2021-10-08T19:16:30.664 INFO:journalctl@ceph.mon.a.smithi097.stdout: Flush(GB): cumulative 0.000, interval 0.000 2021-10-08T19:16:30.664 INFO:journalctl@ceph.mon.a.smithi097.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2021-10-08T19:16:30.665 INFO:journalctl@ceph.mon.a.smithi097.stdout: AddFile(Total Files): cumulative 0, interval 0 2021-10-08T19:16:30.665 INFO:journalctl@ceph.mon.a.smithi097.stdout: AddFile(L0 Files): cumulative 0, interval 0 2021-10-08T19:16:30.665 INFO:journalctl@ceph.mon.a.smithi097.stdout: AddFile(Keys): cumulative 0, interval 0 2021-10-08T19:16:30.665 INFO:journalctl@ceph.mon.a.smithi097.stdout: Cumulative compaction: 0.00 GB write, 20.08 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-10-08T19:16:30.665 INFO:journalctl@ceph.mon.a.smithi097.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-10-08T19:16:30.666 INFO:journalctl@ceph.mon.a.smithi097.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-10-08T19:16:30.666 INFO:journalctl@ceph.mon.a.smithi097.stdout: 2021-10-08T19:16:30.666 INFO:journalctl@ceph.mon.a.smithi097.stdout: ** File Read Latency Histogram By Level [default] ** 2021-10-08T19:16:30.666 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: starting mon.a rank 0 at public addrs v1:172.21.15.97:6789/0 at bind addrs v1:172.21.15.97:6789/0 mon_data /var/lib/ceph/mon/ceph-a fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c 2021-10-08T19:16:30.667 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: mon.a@-1(???) e1 preinit fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c 2021-10-08T19:16:30.667 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: mon.a@-1(???).mds e1 new map 2021-10-08T19:16:30.667 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: mon.a@-1(???).mds e1 print_map 2021-10-08T19:16:30.667 INFO:journalctl@ceph.mon.a.smithi097.stdout: e1 2021-10-08T19:16:30.668 INFO:journalctl@ceph.mon.a.smithi097.stdout: enable_multiple, ever_enabled_multiple: 1,1 2021-10-08T19:16:30.668 INFO:journalctl@ceph.mon.a.smithi097.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-10-08T19:16:30.668 INFO:journalctl@ceph.mon.a.smithi097.stdout: legacy client fscid: -1 2021-10-08T19:16:30.668 INFO:journalctl@ceph.mon.a.smithi097.stdout: 2021-10-08T19:16:30.668 INFO:journalctl@ceph.mon.a.smithi097.stdout: No filesystems configured 2021-10-08T19:16:30.669 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2021-10-08T19:16:30.669 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2021-10-08T19:16:30.669 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2021-10-08T19:16:30.669 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2021-10-08T19:16:30.669 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2021-10-08T19:16:30.670 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 bash[32477]: bfb7577afdf5b06ff44d6c3d2f8ce60a2e6f7c2aff03bf92e99d729d46a0abbb 2021-10-08T19:16:30.670 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 systemd[1]: Started Ceph mon.a for 1d01f6d6-286c-11ec-8c25-001a4aab830c. 2021-10-08T19:16:30.670 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: mon.a is new leader, mons a in quorum (ranks 0) 2021-10-08T19:16:30.670 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: monmap e1: 1 mons at {a=v1:172.21.15.97:6789/0} 2021-10-08T19:16:30.671 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: fsmap 2021-10-08T19:16:30.671 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: osdmap e1: 0 total, 0 up, 0 in 2021-10-08T19:16:30.671 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:30 smithi097 ceph-mon[32687]: mgrmap e1: no daemons active 2021-10-08T19:16:31.648 INFO:teuthology.orchestra.run.smithi097.stderr:Wrote config to /etc/ceph/ceph.conf 2021-10-08T19:16:31.649 INFO:teuthology.orchestra.run.smithi097.stderr:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2021-10-08T19:16:31.649 INFO:teuthology.orchestra.run.smithi097.stderr:Creating mgr... 2021-10-08T19:16:31.650 INFO:teuthology.orchestra.run.smithi097.stderr:Verifying port 9283 ... 2021-10-08T19:16:31.651 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: systemctl daemon-reload 2021-10-08T19:16:31.736 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: systemctl stop ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@mgr.y 2021-10-08T19:16:31.757 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: systemctl reset-failed ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@mgr.y 2021-10-08T19:16:31.762 INFO:teuthology.orchestra.run.smithi097.stderr:systemctl: Failed to reset failed state of unit ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@mgr.y.service: Unit ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@mgr.y.service not loaded. 2021-10-08T19:16:31.763 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: systemctl enable ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@mgr.y 2021-10-08T19:16:31.769 INFO:teuthology.orchestra.run.smithi097.stderr:systemctl: Created symlink /etc/systemd/system/ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c.target.wants/ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@mgr.y.service → /etc/systemd/system/ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@.service. 2021-10-08T19:16:31.842 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: systemctl start ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@mgr.y 2021-10-08T19:16:31.969 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:16:31 smithi097 systemd[1]: Starting Ceph mgr.y for 1d01f6d6-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:16:32.308 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:32 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2512594420' entity='client.admin' 2021-10-08T19:16:32.555 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: systemctl is-enabled firewalld.service 2021-10-08T19:16:32.564 INFO:teuthology.orchestra.run.smithi097.stderr:systemctl: disabled 2021-10-08T19:16:32.565 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: systemctl is-active firewalld.service 2021-10-08T19:16:32.571 INFO:teuthology.orchestra.run.smithi097.stderr:systemctl: inactive 2021-10-08T19:16:32.573 INFO:teuthology.orchestra.run.smithi097.stderr:firewalld.service is not enabled 2021-10-08T19:16:32.573 INFO:teuthology.orchestra.run.smithi097.stderr:Not possible to enable service . firewalld.service is not available 2021-10-08T19:16:32.573 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: systemctl is-enabled firewalld.service 2021-10-08T19:16:32.580 INFO:teuthology.orchestra.run.smithi097.stderr:systemctl: disabled 2021-10-08T19:16:32.581 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: systemctl is-active firewalld.service 2021-10-08T19:16:32.588 INFO:teuthology.orchestra.run.smithi097.stderr:systemctl: inactive 2021-10-08T19:16:32.589 INFO:teuthology.orchestra.run.smithi097.stderr:firewalld.service is not enabled 2021-10-08T19:16:32.589 INFO:teuthology.orchestra.run.smithi097.stderr:Not possible to open ports <[9283]>. firewalld.service is not available 2021-10-08T19:16:32.590 INFO:teuthology.orchestra.run.smithi097.stderr:Waiting for mgr to start... 2021-10-08T19:16:32.590 INFO:teuthology.orchestra.run.smithi097.stderr:Waiting for mgr... 2021-10-08T19:16:32.590 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi097 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpmhbq68kq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp9oueg4pa:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf status -f json-pretty 2021-10-08T19:16:32.810 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:16:32 smithi097 bash[32921]: 9b35d54b43439fcee3c00a23f65a4657b297e88bd65e8899c3bd8cdbbc544157 2021-10-08T19:16:32.811 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:16:32 smithi097 systemd[1]: Started Ceph mgr.y for 1d01f6d6-286c-11ec-8c25-001a4aab830c. 2021-10-08T19:16:33.242 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: 2021-10-08T19:16:33.242 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: { 2021-10-08T19:16:33.242 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "fsid": "1d01f6d6-286c-11ec-8c25-001a4aab830c", 2021-10-08T19:16:33.243 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "health": { 2021-10-08T19:16:33.243 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2021-10-08T19:16:33.243 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "checks": {}, 2021-10-08T19:16:33.243 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "mutes": [] 2021-10-08T19:16:33.244 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: }, 2021-10-08T19:16:33.244 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "election_epoch": 5, 2021-10-08T19:16:33.244 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "quorum": [ 2021-10-08T19:16:33.245 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: 0 2021-10-08T19:16:33.245 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: ], 2021-10-08T19:16:33.245 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "quorum_names": [ 2021-10-08T19:16:33.246 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "a" 2021-10-08T19:16:33.246 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: ], 2021-10-08T19:16:33.246 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "quorum_age": -1400400227, 2021-10-08T19:16:33.246 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "monmap": { 2021-10-08T19:16:33.247 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "epoch": 1, 2021-10-08T19:16:33.247 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "min_mon_release_name": "quincy", 2021-10-08T19:16:33.247 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "num_mons": 1 2021-10-08T19:16:33.248 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: }, 2021-10-08T19:16:33.248 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "osdmap": { 2021-10-08T19:16:33.248 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "epoch": 1, 2021-10-08T19:16:33.249 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "num_osds": 0, 2021-10-08T19:16:33.249 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "num_up_osds": 0, 2021-10-08T19:16:33.249 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "osd_up_since": 0, 2021-10-08T19:16:33.249 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "num_in_osds": 0, 2021-10-08T19:16:33.249 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "osd_in_since": 0, 2021-10-08T19:16:33.250 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2021-10-08T19:16:33.250 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: }, 2021-10-08T19:16:33.250 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "pgmap": { 2021-10-08T19:16:33.250 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "pgs_by_state": [], 2021-10-08T19:16:33.251 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "num_pgs": 0, 2021-10-08T19:16:33.251 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "num_pools": 0, 2021-10-08T19:16:33.251 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "num_objects": 0, 2021-10-08T19:16:33.251 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "data_bytes": 0, 2021-10-08T19:16:33.251 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "bytes_used": 0, 2021-10-08T19:16:33.252 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "bytes_avail": 0, 2021-10-08T19:16:33.252 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "bytes_total": 0 2021-10-08T19:16:33.252 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: }, 2021-10-08T19:16:33.252 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "fsmap": { 2021-10-08T19:16:33.252 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "epoch": 1, 2021-10-08T19:16:33.253 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "by_rank": [], 2021-10-08T19:16:33.253 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "up:standby": 0 2021-10-08T19:16:33.253 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: }, 2021-10-08T19:16:33.253 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "mgrmap": { 2021-10-08T19:16:33.254 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "available": false, 2021-10-08T19:16:33.254 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "num_standbys": 0, 2021-10-08T19:16:33.254 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "modules": [ 2021-10-08T19:16:33.254 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "iostat", 2021-10-08T19:16:33.255 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "nfs", 2021-10-08T19:16:33.255 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "restful" 2021-10-08T19:16:33.255 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: ], 2021-10-08T19:16:33.255 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "services": {} 2021-10-08T19:16:33.256 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: }, 2021-10-08T19:16:33.256 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "servicemap": { 2021-10-08T19:16:33.256 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "epoch": 1, 2021-10-08T19:16:33.256 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "modified": "2021-10-08T19:16:25.258735+0000", 2021-10-08T19:16:33.256 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "services": {} 2021-10-08T19:16:33.257 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: }, 2021-10-08T19:16:33.257 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "progress_events": {} 2021-10-08T19:16:33.257 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: } 2021-10-08T19:16:33.718 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:33 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3643033881' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2021-10-08T19:16:33.811 INFO:teuthology.orchestra.run.smithi097.stderr:mgr not available, waiting (1/15)... 2021-10-08T19:16:35.813 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi097 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpmhbq68kq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp9oueg4pa:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf status -f json-pretty 2021-10-08T19:16:36.555 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: 2021-10-08T19:16:36.556 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: { 2021-10-08T19:16:36.556 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "fsid": "1d01f6d6-286c-11ec-8c25-001a4aab830c", 2021-10-08T19:16:36.557 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "health": { 2021-10-08T19:16:36.557 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2021-10-08T19:16:36.557 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "checks": {}, 2021-10-08T19:16:36.557 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "mutes": [] 2021-10-08T19:16:36.558 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: }, 2021-10-08T19:16:36.558 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "election_epoch": 5, 2021-10-08T19:16:36.558 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "quorum": [ 2021-10-08T19:16:36.558 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: 0 2021-10-08T19:16:36.559 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: ], 2021-10-08T19:16:36.559 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "quorum_names": [ 2021-10-08T19:16:36.559 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "a" 2021-10-08T19:16:36.559 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: ], 2021-10-08T19:16:36.560 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "quorum_age": 1912765479, 2021-10-08T19:16:36.560 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "monmap": { 2021-10-08T19:16:36.560 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "epoch": 1, 2021-10-08T19:16:36.560 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "min_mon_release_name": "quincy", 2021-10-08T19:16:36.563 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "num_mons": 1 2021-10-08T19:16:36.563 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: }, 2021-10-08T19:16:36.563 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "osdmap": { 2021-10-08T19:16:36.563 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "epoch": 1, 2021-10-08T19:16:36.563 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "num_osds": 0, 2021-10-08T19:16:36.564 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "num_up_osds": 0, 2021-10-08T19:16:36.564 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "osd_up_since": 0, 2021-10-08T19:16:36.564 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "num_in_osds": 0, 2021-10-08T19:16:36.564 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "osd_in_since": 0, 2021-10-08T19:16:36.565 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2021-10-08T19:16:36.565 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: }, 2021-10-08T19:16:36.565 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "pgmap": { 2021-10-08T19:16:36.565 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "pgs_by_state": [], 2021-10-08T19:16:36.566 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "num_pgs": 0, 2021-10-08T19:16:36.566 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "num_pools": 0, 2021-10-08T19:16:36.566 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "num_objects": 0, 2021-10-08T19:16:36.566 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "data_bytes": 0, 2021-10-08T19:16:36.567 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "bytes_used": 0, 2021-10-08T19:16:36.567 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "bytes_avail": 0, 2021-10-08T19:16:36.567 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "bytes_total": 0 2021-10-08T19:16:36.567 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: }, 2021-10-08T19:16:36.567 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "fsmap": { 2021-10-08T19:16:36.568 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "epoch": 1, 2021-10-08T19:16:36.568 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "by_rank": [], 2021-10-08T19:16:36.568 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "up:standby": 0 2021-10-08T19:16:36.569 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: }, 2021-10-08T19:16:36.569 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "mgrmap": { 2021-10-08T19:16:36.570 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "available": false, 2021-10-08T19:16:36.570 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "num_standbys": 0, 2021-10-08T19:16:36.570 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "modules": [ 2021-10-08T19:16:36.570 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "iostat", 2021-10-08T19:16:36.570 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "nfs", 2021-10-08T19:16:36.571 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "restful" 2021-10-08T19:16:36.571 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: ], 2021-10-08T19:16:36.571 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "services": {} 2021-10-08T19:16:36.571 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: }, 2021-10-08T19:16:36.572 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "servicemap": { 2021-10-08T19:16:36.572 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "epoch": 1, 2021-10-08T19:16:36.572 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "modified": "2021-10-08T19:16:25.258735+0000", 2021-10-08T19:16:36.572 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "services": {} 2021-10-08T19:16:36.572 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: }, 2021-10-08T19:16:36.573 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "progress_events": {} 2021-10-08T19:16:36.573 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: } 2021-10-08T19:16:36.968 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:36 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2566670949' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2021-10-08T19:16:37.039 INFO:teuthology.orchestra.run.smithi097.stderr:mgr not available, waiting (2/15)... 2021-10-08T19:16:38.469 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:38 smithi097 ceph-mon[32687]: Activating manager daemon y 2021-10-08T19:16:38.469 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:38 smithi097 ceph-mon[32687]: mgrmap e2: y(active, starting, since 0.00280336s) 2021-10-08T19:16:38.469 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:38 smithi097 ceph-mon[32687]: from='mgr.14100 v1:172.21.15.97:0/37230412' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-10-08T19:16:38.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:38 smithi097 ceph-mon[32687]: from='mgr.14100 v1:172.21.15.97:0/37230412' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-10-08T19:16:38.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:38 smithi097 ceph-mon[32687]: from='mgr.14100 v1:172.21.15.97:0/37230412' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-10-08T19:16:38.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:38 smithi097 ceph-mon[32687]: from='mgr.14100 v1:172.21.15.97:0/37230412' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-10-08T19:16:38.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:38 smithi097 ceph-mon[32687]: from='mgr.14100 v1:172.21.15.97:0/37230412' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-10-08T19:16:38.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:38 smithi097 ceph-mon[32687]: from='mgr.14100 v1:172.21.15.97:0/37230412' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-10-08T19:16:38.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:38 smithi097 ceph-mon[32687]: from='mgr.14100 v1:172.21.15.97:0/37230412' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:16:38.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:38 smithi097 ceph-mon[32687]: from='mgr.14100 v1:172.21.15.97:0/37230412' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-10-08T19:16:38.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:38 smithi097 ceph-mon[32687]: Manager daemon y is now available 2021-10-08T19:16:38.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:38 smithi097 ceph-mon[32687]: from='mgr.14100 v1:172.21.15.97:0/37230412' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:16:38.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:38 smithi097 ceph-mon[32687]: from='mgr.14100 v1:172.21.15.97:0/37230412' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:16:38.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:38 smithi097 ceph-mon[32687]: from='mgr.14100 v1:172.21.15.97:0/37230412' entity='mgr.y' 2021-10-08T19:16:38.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:38 smithi097 ceph-mon[32687]: from='mgr.14100 v1:172.21.15.97:0/37230412' entity='mgr.y' 2021-10-08T19:16:39.042 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi097 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpmhbq68kq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp9oueg4pa:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf status -f json-pretty 2021-10-08T19:16:39.871 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: 2021-10-08T19:16:39.871 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: { 2021-10-08T19:16:39.872 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "fsid": "1d01f6d6-286c-11ec-8c25-001a4aab830c", 2021-10-08T19:16:39.872 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "health": { 2021-10-08T19:16:39.872 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2021-10-08T19:16:39.872 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "checks": {}, 2021-10-08T19:16:39.873 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "mutes": [] 2021-10-08T19:16:39.873 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: }, 2021-10-08T19:16:39.873 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "election_epoch": 5, 2021-10-08T19:16:39.875 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "quorum": [ 2021-10-08T19:16:39.876 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: 0 2021-10-08T19:16:39.876 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: ], 2021-10-08T19:16:39.876 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "quorum_names": [ 2021-10-08T19:16:39.876 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "a" 2021-10-08T19:16:39.877 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: ], 2021-10-08T19:16:39.877 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "quorum_age": 935903836, 2021-10-08T19:16:39.877 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "monmap": { 2021-10-08T19:16:39.877 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "epoch": 1, 2021-10-08T19:16:39.877 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "min_mon_release_name": "quincy", 2021-10-08T19:16:39.878 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "num_mons": 1 2021-10-08T19:16:39.878 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: }, 2021-10-08T19:16:39.878 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "osdmap": { 2021-10-08T19:16:39.878 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "epoch": 1, 2021-10-08T19:16:39.878 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "num_osds": 0, 2021-10-08T19:16:39.879 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "num_up_osds": 0, 2021-10-08T19:16:39.879 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "osd_up_since": 0, 2021-10-08T19:16:39.879 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "num_in_osds": 0, 2021-10-08T19:16:39.879 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "osd_in_since": 0, 2021-10-08T19:16:39.880 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2021-10-08T19:16:39.880 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: }, 2021-10-08T19:16:39.880 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "pgmap": { 2021-10-08T19:16:39.880 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "pgs_by_state": [], 2021-10-08T19:16:39.881 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "num_pgs": 0, 2021-10-08T19:16:39.881 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "num_pools": 0, 2021-10-08T19:16:39.881 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "num_objects": 0, 2021-10-08T19:16:39.881 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "data_bytes": 0, 2021-10-08T19:16:39.881 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "bytes_used": 0, 2021-10-08T19:16:39.882 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "bytes_avail": 0, 2021-10-08T19:16:39.882 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "bytes_total": 0 2021-10-08T19:16:39.882 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: }, 2021-10-08T19:16:39.882 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "fsmap": { 2021-10-08T19:16:39.883 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "epoch": 1, 2021-10-08T19:16:39.883 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "by_rank": [], 2021-10-08T19:16:39.883 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "up:standby": 0 2021-10-08T19:16:39.883 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: }, 2021-10-08T19:16:39.883 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "mgrmap": { 2021-10-08T19:16:39.884 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "available": true, 2021-10-08T19:16:39.884 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "num_standbys": 0, 2021-10-08T19:16:39.884 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "modules": [ 2021-10-08T19:16:39.885 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "iostat", 2021-10-08T19:16:39.886 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "nfs", 2021-10-08T19:16:39.886 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "restful" 2021-10-08T19:16:39.886 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: ], 2021-10-08T19:16:39.886 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "services": {} 2021-10-08T19:16:39.887 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: }, 2021-10-08T19:16:39.887 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "servicemap": { 2021-10-08T19:16:39.887 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "epoch": 1, 2021-10-08T19:16:39.887 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "modified": "2021-10-08T19:16:25.258735+0000", 2021-10-08T19:16:39.888 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "services": {} 2021-10-08T19:16:39.888 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: }, 2021-10-08T19:16:39.888 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "progress_events": {} 2021-10-08T19:16:39.888 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: } 2021-10-08T19:16:40.219 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:40 smithi097 ceph-mon[32687]: mgrmap e3: y(active, since 1.00607s) 2021-10-08T19:16:40.219 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:40 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/160304816' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2021-10-08T19:16:40.380 INFO:teuthology.orchestra.run.smithi097.stderr:mgr is available 2021-10-08T19:16:40.381 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi097 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpmhbq68kq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp9oueg4pa:/etc/ceph/ceph.conf:z -v /tmp/tmppd6oh3e0:/var/lib/ceph/user.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf config assimilate-conf -i /var/lib/ceph/user.conf 2021-10-08T19:16:41.116 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: 2021-10-08T19:16:41.116 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: [global] 2021-10-08T19:16:41.116 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: fsid = 1d01f6d6-286c-11ec-8c25-001a4aab830c 2021-10-08T19:16:41.117 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: mon_osd_allow_pg_remap = true 2021-10-08T19:16:41.117 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: mon_osd_allow_primary_affinity = true 2021-10-08T19:16:41.117 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: mon_warn_on_no_sortbitwise = false 2021-10-08T19:16:41.117 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: osd_crush_chooseleaf_type = 0 2021-10-08T19:16:41.118 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: 2021-10-08T19:16:41.118 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: [mgr] 2021-10-08T19:16:41.118 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: mgr/telemetry/nag = false 2021-10-08T19:16:41.119 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: 2021-10-08T19:16:41.119 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: [osd] 2021-10-08T19:16:41.119 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: osd_map_max_advance = 10 2021-10-08T19:16:41.119 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: osd_sloppy_crc = true 2021-10-08T19:16:41.469 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:41 smithi097 ceph-mon[32687]: mgrmap e4: y(active, since 2s) 2021-10-08T19:16:41.627 INFO:teuthology.orchestra.run.smithi097.stderr:Enabling cephadm module... 2021-10-08T19:16:41.627 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi097 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpmhbq68kq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp9oueg4pa:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf mgr module enable cephadm 2021-10-08T19:16:42.469 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:42 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/115931161' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2021-10-08T19:16:43.469 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:43 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2237728191' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2021-10-08T19:16:43.470 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:16:43 smithi097 conmon[33110]: ignoring --setuser ceph since I am not root 2021-10-08T19:16:43.470 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:16:43 smithi097 conmon[33110]: ignoring --setgroup ceph since I am not root 2021-10-08T19:16:43.630 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi097 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpmhbq68kq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp9oueg4pa:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf mgr stat 2021-10-08T19:16:44.405 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: { 2021-10-08T19:16:44.405 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "epoch": 5, 2021-10-08T19:16:44.405 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "available": true, 2021-10-08T19:16:44.405 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "active_name": "y", 2021-10-08T19:16:44.406 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "num_standby": 0 2021-10-08T19:16:44.406 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: } 2021-10-08T19:16:44.429 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:44 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2237728191' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2021-10-08T19:16:44.430 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:44 smithi097 ceph-mon[32687]: mgrmap e5: y(active, since 5s) 2021-10-08T19:16:44.863 INFO:teuthology.orchestra.run.smithi097.stderr:Waiting for the mgr to restart... 2021-10-08T19:16:44.864 INFO:teuthology.orchestra.run.smithi097.stderr:Waiting for mgr epoch 5... 2021-10-08T19:16:44.864 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi097 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpmhbq68kq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp9oueg4pa:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf tell mgr mgr_status 2021-10-08T19:16:45.469 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:45 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2736704410' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2021-10-08T19:16:48.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:48 smithi097 ceph-mon[32687]: Active manager daemon y restarted 2021-10-08T19:16:48.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:48 smithi097 ceph-mon[32687]: Activating manager daemon y 2021-10-08T19:16:48.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:48 smithi097 ceph-mon[32687]: osdmap e2: 0 total, 0 up, 0 in 2021-10-08T19:16:49.717 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: { 2021-10-08T19:16:49.717 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "mgrmap_epoch": 7, 2021-10-08T19:16:49.717 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "initialized": true 2021-10-08T19:16:49.717 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: } 2021-10-08T19:16:49.969 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:16:49 smithi097 conmon[33110]: [08/Oct/2021:19:16:49] ENGINE Bus STARTING 2021-10-08T19:16:49.969 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:16:49 smithi097 conmon[33110]: [08/Oct/2021:19:16:49] ENGINE Serving on https://172.21.15.97:8499 2021-10-08T19:16:49.969 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:16:49 smithi097 conmon[33110]: [08/Oct/2021:19:16:49] ENGINE Bus STARTED 2021-10-08T19:16:49.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:49 smithi097 ceph-mon[32687]: mgrmap e6: y(active, starting, since 0.0525981s) 2021-10-08T19:16:49.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:49 smithi097 ceph-mon[32687]: from='mgr.14118 v1:172.21.15.97:0/1459140368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:16:49.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:49 smithi097 ceph-mon[32687]: from='mgr.14118 v1:172.21.15.97:0/1459140368' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-10-08T19:16:49.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:49 smithi097 ceph-mon[32687]: from='mgr.14118 v1:172.21.15.97:0/1459140368' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-10-08T19:16:49.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:49 smithi097 ceph-mon[32687]: from='mgr.14118 v1:172.21.15.97:0/1459140368' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-10-08T19:16:49.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:49 smithi097 ceph-mon[32687]: from='mgr.14118 v1:172.21.15.97:0/1459140368' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-10-08T19:16:49.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:49 smithi097 ceph-mon[32687]: Manager daemon y is now available 2021-10-08T19:16:49.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:49 smithi097 ceph-mon[32687]: from='mgr.14118 v1:172.21.15.97:0/1459140368' entity='mgr.y' 2021-10-08T19:16:49.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:49 smithi097 ceph-mon[32687]: from='mgr.14118 v1:172.21.15.97:0/1459140368' entity='mgr.y' 2021-10-08T19:16:49.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:49 smithi097 ceph-mon[32687]: from='mgr.14118 v1:172.21.15.97:0/1459140368' entity='mgr.y' 2021-10-08T19:16:49.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:49 smithi097 ceph-mon[32687]: from='mgr.14118 v1:172.21.15.97:0/1459140368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:16:49.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:49 smithi097 ceph-mon[32687]: from='mgr.14118 v1:172.21.15.97:0/1459140368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:16:49.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:49 smithi097 ceph-mon[32687]: from='mgr.14118 v1:172.21.15.97:0/1459140368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:16:49.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:49 smithi097 ceph-mon[32687]: from='mgr.14118 v1:172.21.15.97:0/1459140368' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:16:49.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:49 smithi097 ceph-mon[32687]: from='mgr.14118 v1:172.21.15.97:0/1459140368' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:16:50.187 INFO:teuthology.orchestra.run.smithi097.stderr:mgr epoch 5 is available 2021-10-08T19:16:50.188 INFO:teuthology.orchestra.run.smithi097.stderr:Setting orchestrator backend to cephadm... 2021-10-08T19:16:50.188 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi097 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpmhbq68kq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp9oueg4pa:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf orch set backend cephadm 2021-10-08T19:16:50.967 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:50 smithi097 ceph-mon[32687]: mgrmap e7: y(active, since 1.05998s) 2021-10-08T19:16:50.967 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:50 smithi097 ceph-mon[32687]: Starting cherrypy engine... 2021-10-08T19:16:50.967 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:50 smithi097 ceph-mon[32687]: [08/Oct/2021:19:16:49] ENGINE Bus STARTING 2021-10-08T19:16:50.968 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:50 smithi097 ceph-mon[32687]: [08/Oct/2021:19:16:49] ENGINE Serving on https://172.21.15.97:8499 2021-10-08T19:16:50.968 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:50 smithi097 ceph-mon[32687]: [08/Oct/2021:19:16:49] ENGINE Bus STARTED 2021-10-08T19:16:50.968 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:50 smithi097 ceph-mon[32687]: Cherrypy engine started. 2021-10-08T19:16:51.404 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi097 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpmhbq68kq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp9oueg4pa:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf cephadm set-user root 2021-10-08T19:16:52.127 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: value unchanged 2021-10-08T19:16:52.218 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:51 smithi097 ceph-mon[32687]: from='client.14130 v1:172.21.15.97:0/2653889092' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:16:52.219 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:51 smithi097 ceph-mon[32687]: from='mgr.14118 v1:172.21.15.97:0/1459140368' entity='mgr.y' 2021-10-08T19:16:52.219 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:51 smithi097 ceph-mon[32687]: from='mgr.14118 v1:172.21.15.97:0/1459140368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:16:52.219 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:51 smithi097 ceph-mon[32687]: mgrmap e8: y(active, since 2s) 2021-10-08T19:16:52.670 INFO:teuthology.orchestra.run.smithi097.stderr:Generating ssh key... 2021-10-08T19:16:52.671 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi097 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpmhbq68kq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp9oueg4pa:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf cephadm generate-key 2021-10-08T19:16:53.219 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:52 smithi097 ceph-mon[32687]: from='client.14132 v1:172.21.15.97:0/387760327' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:16:53.969 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:16:53 smithi097 conmon[33110]: Generating public/private rsa key pair. 2021-10-08T19:16:53.969 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:16:53 smithi097 conmon[33110]: Your identification has been saved in /tmp/tmp67gy_ukj/key. 2021-10-08T19:16:53.969 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:16:53 smithi097 conmon[33110]: Your public key has been saved in /tmp/tmp67gy_ukj/key.pub. 2021-10-08T19:16:53.969 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:16:53 smithi097 conmon[33110]: The key fingerprint is: 2021-10-08T19:16:53.970 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:16:53 smithi097 conmon[33110]: SHA256:+f2LSWmq0so/ymXLINaMeFws/+1mvmydfiIW+JdDtYg ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c 2021-10-08T19:16:53.970 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:16:53 smithi097 conmon[33110]: The key's randomart image is: 2021-10-08T19:16:53.970 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:16:53 smithi097 conmon[33110]: +---[RSA 3072]----+ 2021-10-08T19:16:53.971 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:16:53 smithi097 conmon[33110]: | | 2021-10-08T19:16:53.971 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:16:53 smithi097 conmon[33110]: | | 2021-10-08T19:16:53.971 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:16:53 smithi097 conmon[33110]: | | 2021-10-08T19:16:53.971 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:16:53 smithi097 conmon[33110]: | . . . | 2021-10-08T19:16:53.972 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:16:53 smithi097 conmon[33110]: | . o S. . o . | 2021-10-08T19:16:53.972 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:16:53 smithi097 conmon[33110]: | o B ..E.o.. | 2021-10-08T19:16:53.972 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:16:53 smithi097 conmon[33110]: | . * =.o..+=o | 2021-10-08T19:16:53.972 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:16:53 smithi097 conmon[33110]: | o +.*o+B+B+. | 2021-10-08T19:16:53.972 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:16:53 smithi097 conmon[33110]: | ==*XB=++o. | 2021-10-08T19:16:53.973 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:16:53 smithi097 conmon[33110]: +----[SHA256]-----+ 2021-10-08T19:16:54.029 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi097 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpmhbq68kq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp9oueg4pa:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf cephadm get-pub-key 2021-10-08T19:16:54.748 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4hsNpW/aPXdT9XTxcyginsXU8X70pMJjrzn5reLBjPQCrfyOTeuwyGCdBY3Wp+uhZw/St+VSeE+J39Ve9q5MB2SDnfjX7vWI+hl+2klDGnhFAiCmZLU2fVk26jrlnOc2ej23X+z39KHF35UmsIkBRK9wtPClrydSlRmGMubywW5UHFlqyPbO7v1L1OmAwUl09V/REyi8ZSO9hEritJpVZL9Qh6W2cbKF/tw0VFjwz0FE/4LGtW0mHkUxbp7kgsjTIciLRohLhLvAhPN/yG+ytE/ehRPoLT9HruEUIYlfIX+Z6tppEEtcy7lZWVEwtrcWgxLwyemlWZnzh2WL7DV1dfoOCy2Y9pnTda7+qQR0gKzOHOFxOgCkEAq4wluIVCxFfj0lwUdHeBRLr57xMBwwdnBMYTUyuZ2gu8wSNfoUYzYTDUaezkEhaIkQ/L3a2KW7RmgKeSkOXjGxFJBlVFu/MxKqrbYxtqG/S49NuwFj6Kdk85AkvX/j2lSqRZ3OrqTM= ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c 2021-10-08T19:16:54.968 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:54 smithi097 ceph-mon[32687]: from='client.14134 v1:172.21.15.97:0/1727866483' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:16:54.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:54 smithi097 ceph-mon[32687]: Generating ssh key... 2021-10-08T19:16:54.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:54 smithi097 ceph-mon[32687]: from='mgr.14118 v1:172.21.15.97:0/1459140368' entity='mgr.y' 2021-10-08T19:16:54.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:54 smithi097 ceph-mon[32687]: from='mgr.14118 v1:172.21.15.97:0/1459140368' entity='mgr.y' 2021-10-08T19:16:55.270 INFO:teuthology.orchestra.run.smithi097.stderr:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2021-10-08T19:16:55.271 INFO:teuthology.orchestra.run.smithi097.stderr:Adding key to root@localhost authorized_keys... 2021-10-08T19:16:55.272 INFO:teuthology.orchestra.run.smithi097.stderr:Adding host smithi097... 2021-10-08T19:16:55.272 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi097 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpmhbq68kq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp9oueg4pa:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf orch host add smithi097 2021-10-08T19:16:55.718 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:55 smithi097 ceph-mon[32687]: from='client.14136 v1:172.21.15.97:0/3887236183' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:16:56.915 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:56 smithi097 ceph-mon[32687]: from='client.14138 v1:172.21.15.97:0/3323700979' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi097", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:16:56.915 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:56 smithi097 ceph-mon[32687]: poll took 7280.811 ms: 1 events 2021-10-08T19:16:56.922 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: Added host 'smithi097' with addr '127.0.1.1' 2021-10-08T19:16:57.445 INFO:teuthology.orchestra.run.smithi097.stderr:Deploying unmanaged mon service... 2021-10-08T19:16:57.445 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi097 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpmhbq68kq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp9oueg4pa:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf orch apply mon --unmanaged 2021-10-08T19:16:58.195 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:57 smithi097 ceph-mon[32687]: Deploying cephadm binary to smithi097 2021-10-08T19:16:58.195 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:57 smithi097 ceph-mon[32687]: Executing () created at /lib/python3.6/site-packages/asyncssh/channel.py:596> took 0.157 seconds 2021-10-08T19:16:58.196 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:57 smithi097 ceph-mon[32687]: Executing took 0.143 seconds 2021-10-08T19:16:58.196 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:57 smithi097 ceph-mon[32687]: from='mgr.14118 v1:172.21.15.97:0/1459140368' entity='mgr.y' 2021-10-08T19:16:58.196 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:57 smithi097 ceph-mon[32687]: Added host smithi097 2021-10-08T19:16:58.197 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:57 smithi097 ceph-mon[32687]: from='mgr.14118 v1:172.21.15.97:0/1459140368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:16:58.207 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: Scheduled mon update... 2021-10-08T19:16:59.078 INFO:teuthology.orchestra.run.smithi097.stderr:Deploying unmanaged mgr service... 2021-10-08T19:16:59.079 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi097 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpmhbq68kq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp9oueg4pa:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf orch apply mgr --unmanaged 2021-10-08T19:16:59.468 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:59 smithi097 ceph-mon[32687]: from='client.14140 v1:172.21.15.97:0/3083115964' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:16:59.469 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:59 smithi097 ceph-mon[32687]: Saving service mon spec with placement count:5 2021-10-08T19:16:59.469 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:16:59 smithi097 ceph-mon[32687]: from='mgr.14118 v1:172.21.15.97:0/1459140368' entity='mgr.y' 2021-10-08T19:16:59.934 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: Scheduled mgr update... 2021-10-08T19:17:00.453 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi097 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpmhbq68kq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp9oueg4pa:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf config set mgr mgr/cephadm/container_init True --force 2021-10-08T19:17:00.634 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:00 smithi097 ceph-mon[32687]: poll took 1983.165 ms: 1 events 2021-10-08T19:17:00.634 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:00 smithi097 ceph-mon[32687]: from='mgr.14118 v1:172.21.15.97:0/1459140368' entity='mgr.y' 2021-10-08T19:17:00.635 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:00 smithi097 ceph-mon[32687]: from='mgr.14118 v1:172.21.15.97:0/1459140368' entity='mgr.y' 2021-10-08T19:17:00.635 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:00 smithi097 ceph-mon[32687]: from='mgr.14118 v1:172.21.15.97:0/1459140368' entity='mgr.y' 2021-10-08T19:17:00.635 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:00 smithi097 ceph-mon[32687]: from='mgr.14118 v1:172.21.15.97:0/1459140368' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi097", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:17:00.635 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:00 smithi097 ceph-mon[32687]: from='mgr.14118 v1:172.21.15.97:0/1459140368' entity='mgr.y' 2021-10-08T19:17:00.636 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:00 smithi097 ceph-mon[32687]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:17:00.636 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:00 smithi097 ceph-mon[32687]: from='mgr.14118 v1:172.21.15.97:0/1459140368' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi097", "caps": []}]: dispatch 2021-10-08T19:17:00.637 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:00 smithi097 ceph-mon[32687]: from='mgr.14118 v1:172.21.15.97:0/1459140368' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.agent.smithi097", "caps": []}]': finished 2021-10-08T19:17:00.637 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:00 smithi097 ceph-mon[32687]: from='client.14142 v1:172.21.15.97:0/142925764' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:17:00.637 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:00 smithi097 ceph-mon[32687]: Saving service mgr spec with placement count:2 2021-10-08T19:17:00.638 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:00 smithi097 ceph-mon[32687]: from='mgr.14118 v1:172.21.15.97:0/1459140368' entity='mgr.y' 2021-10-08T19:17:01.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:01 smithi097 ceph-mon[32687]: Deploying daemon agent.smithi097 on smithi097 2021-10-08T19:17:01.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:01 smithi097 ceph-mon[32687]: Executing () created at /lib/python3.6/site-packages/asyncssh/channel.py:596> took 0.177 seconds 2021-10-08T19:17:01.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:01 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1746593392' entity='client.admin' 2021-10-08T19:17:01.744 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi097 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpmhbq68kq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp9oueg4pa:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf config set mgr mgr/dashboard/ssl_server_port 8443 2021-10-08T19:17:02.978 INFO:teuthology.orchestra.run.smithi097.stderr:Enabling the dashboard module... 2021-10-08T19:17:02.978 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi097 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpmhbq68kq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp9oueg4pa:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf mgr module enable dashboard 2021-10-08T19:17:03.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:03 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1098380037' entity='client.admin' 2021-10-08T19:17:04.968 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:04 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1523968408' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2021-10-08T19:17:04.969 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:17:04 smithi097 conmon[33110]: ignoring --setuser ceph since I am not root 2021-10-08T19:17:04.970 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:17:04 smithi097 conmon[33110]: ignoring --setgroup ceph since I am not root 2021-10-08T19:17:05.028 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi097 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpmhbq68kq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp9oueg4pa:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf mgr stat 2021-10-08T19:17:05.868 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: { 2021-10-08T19:17:05.868 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "epoch": 9, 2021-10-08T19:17:05.869 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "available": true, 2021-10-08T19:17:05.869 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "active_name": "y", 2021-10-08T19:17:05.869 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "num_standby": 0 2021-10-08T19:17:05.869 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: } 2021-10-08T19:17:05.901 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:05 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1523968408' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2021-10-08T19:17:05.902 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:05 smithi097 ceph-mon[32687]: mgrmap e9: y(active, since 15s) 2021-10-08T19:17:06.364 INFO:teuthology.orchestra.run.smithi097.stderr:Waiting for the mgr to restart... 2021-10-08T19:17:06.364 INFO:teuthology.orchestra.run.smithi097.stderr:Waiting for mgr epoch 9... 2021-10-08T19:17:06.364 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi097 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpmhbq68kq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp9oueg4pa:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf tell mgr mgr_status 2021-10-08T19:17:06.968 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:06 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2595195664' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2021-10-08T19:17:11.115 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: { 2021-10-08T19:17:11.116 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "mgrmap_epoch": 11, 2021-10-08T19:17:11.116 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: "initialized": true 2021-10-08T19:17:11.116 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: } 2021-10-08T19:17:11.442 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:11 smithi097 ceph-mon[32687]: Active manager daemon y restarted 2021-10-08T19:17:11.442 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:11 smithi097 ceph-mon[32687]: Activating manager daemon y 2021-10-08T19:17:11.442 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:11 smithi097 ceph-mon[32687]: osdmap e3: 0 total, 0 up, 0 in 2021-10-08T19:17:11.442 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:11 smithi097 ceph-mon[32687]: mgrmap e10: y(active, starting, since 0.0524152s) 2021-10-08T19:17:11.443 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:11 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:17:11.443 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:11 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-10-08T19:17:11.443 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:11 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-10-08T19:17:11.443 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:11 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-10-08T19:17:11.444 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:11 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-10-08T19:17:11.444 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:11 smithi097 ceph-mon[32687]: Manager daemon y is now available 2021-10-08T19:17:11.444 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:11 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:17:11.444 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:11 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:17:11.444 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:11 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:17:11.445 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:11 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi097", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:17:11.445 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:11 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:17:11.445 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:11 smithi097 ceph-mon[32687]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:17:11.445 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:11 smithi097 ceph-mon[32687]: Delaying applying agent spec until cephadm endpoint root cert created 2021-10-08T19:17:11.445 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:11 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:17:11.446 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:11 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:17:11.446 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:11 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:17:11.446 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:11 smithi097 ceph-mon[32687]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:17:11.447 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:11 smithi097 ceph-mon[32687]: Delaying applying agent spec until cephadm endpoint root cert created 2021-10-08T19:17:11.447 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:11 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:17:11.635 INFO:teuthology.orchestra.run.smithi097.stderr:mgr epoch 9 is available 2021-10-08T19:17:11.635 INFO:teuthology.orchestra.run.smithi097.stderr:Generating a dashboard self-signed certificate... 2021-10-08T19:17:11.635 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi097 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpmhbq68kq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp9oueg4pa:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf dashboard create-self-signed-cert 2021-10-08T19:17:11.719 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:17:11 smithi097 conmon[33110]: [08/Oct/2021:19:17:11] ENGINE Bus STARTING 2021-10-08T19:17:11.719 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:17:11 smithi097 conmon[33110]: [08/Oct/2021:19:17:11] ENGINE Serving on https://172.21.15.97:8499 2021-10-08T19:17:11.719 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:17:11 smithi097 conmon[33110]: [08/Oct/2021:19:17:11] ENGINE Bus STARTED 2021-10-08T19:17:12.469 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:12 smithi097 ceph-mon[32687]: from='client.14154 v1:172.21.15.97:0/3601882470' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2021-10-08T19:17:12.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:12 smithi097 ceph-mon[32687]: mgrmap e11: y(active, since 1.05757s) 2021-10-08T19:17:12.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:12 smithi097 ceph-mon[32687]: from='client.14154 v1:172.21.15.97:0/3601882470' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2021-10-08T19:17:12.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:12 smithi097 ceph-mon[32687]: Starting cherrypy engine... 2021-10-08T19:17:12.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:12 smithi097 ceph-mon[32687]: [08/Oct/2021:19:17:11] ENGINE Bus STARTING 2021-10-08T19:17:12.561 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: Self-signed certificate created 2021-10-08T19:17:13.039 INFO:teuthology.orchestra.run.smithi097.stderr:Creating initial admin user... 2021-10-08T19:17:13.039 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi097 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpmhbq68kq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp9oueg4pa:/etc/ceph/ceph.conf:z -v /tmp/ceph-tmp3d722eit:/tmp/dashboard.pw:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf dashboard ac-user-create admin -i /tmp/dashboard.pw administrator --force-password --pwd-update-required 2021-10-08T19:17:13.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:13 smithi097 ceph-mon[32687]: [08/Oct/2021:19:17:11] ENGINE Serving on https://172.21.15.97:8499 2021-10-08T19:17:13.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:13 smithi097 ceph-mon[32687]: [08/Oct/2021:19:17:11] ENGINE Bus STARTED 2021-10-08T19:17:13.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:13 smithi097 ceph-mon[32687]: Cherrypy engine started. 2021-10-08T19:17:13.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:13 smithi097 ceph-mon[32687]: mgrmap e12: y(active, since 2s) 2021-10-08T19:17:13.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:13 smithi097 ceph-mon[32687]: from='client.14162 v1:172.21.15.97:0/1273164841' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:17:13.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:13 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:17:13.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:13 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:17:14.039 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: {"username": "admin", "password": "$2b$12$1OkFVqw.NlJYxI6o9aMXxOtTNHwj8Duhx9ip.a/qD3zz9SHOfAyPa", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1633720634, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2021-10-08T19:17:14.526 INFO:teuthology.orchestra.run.smithi097.stderr:Fetching dashboard port number... 2021-10-08T19:17:14.526 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi097 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpmhbq68kq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp9oueg4pa:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf config get mgr mgr/dashboard/ssl_server_port 2021-10-08T19:17:15.273 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/bin/ceph: 8443 2021-10-08T19:17:15.296 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:15 smithi097 ceph-mon[32687]: from='client.14164 v1:172.21.15.97:0/759594265' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:17:15.297 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:15 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:17:15.801 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: systemctl is-enabled firewalld.service 2021-10-08T19:17:15.809 INFO:teuthology.orchestra.run.smithi097.stderr:systemctl: disabled 2021-10-08T19:17:15.810 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: systemctl is-active firewalld.service 2021-10-08T19:17:15.816 INFO:teuthology.orchestra.run.smithi097.stderr:systemctl: inactive 2021-10-08T19:17:15.817 INFO:teuthology.orchestra.run.smithi097.stderr:firewalld.service is not enabled 2021-10-08T19:17:15.817 INFO:teuthology.orchestra.run.smithi097.stderr:Not possible to open ports <[8443]>. firewalld.service is not available 2021-10-08T19:17:15.820 INFO:teuthology.orchestra.run.smithi097.stderr:Ceph Dashboard is now available at: 2021-10-08T19:17:15.820 INFO:teuthology.orchestra.run.smithi097.stderr: 2021-10-08T19:17:15.820 INFO:teuthology.orchestra.run.smithi097.stderr: URL: https://smithi097.front.sepia.ceph.com:8443/ 2021-10-08T19:17:15.820 INFO:teuthology.orchestra.run.smithi097.stderr: User: admin 2021-10-08T19:17:15.820 INFO:teuthology.orchestra.run.smithi097.stderr: Password: mhd7bn3ey8 2021-10-08T19:17:15.821 INFO:teuthology.orchestra.run.smithi097.stderr: 2021-10-08T19:17:15.821 INFO:teuthology.orchestra.run.smithi097.stderr:You can access the Ceph CLI with: 2021-10-08T19:17:15.822 INFO:teuthology.orchestra.run.smithi097.stderr: 2021-10-08T19:17:15.822 INFO:teuthology.orchestra.run.smithi097.stderr: sudo /home/ubuntu/cephtest/cephadm shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2021-10-08T19:17:15.822 INFO:teuthology.orchestra.run.smithi097.stderr: 2021-10-08T19:17:15.822 INFO:teuthology.orchestra.run.smithi097.stderr:Please consider enabling telemetry to help improve Ceph: 2021-10-08T19:17:15.823 INFO:teuthology.orchestra.run.smithi097.stderr: 2021-10-08T19:17:15.823 INFO:teuthology.orchestra.run.smithi097.stderr: ceph telemetry on 2021-10-08T19:17:15.823 INFO:teuthology.orchestra.run.smithi097.stderr: 2021-10-08T19:17:15.823 INFO:teuthology.orchestra.run.smithi097.stderr:For more information see: 2021-10-08T19:17:15.823 INFO:teuthology.orchestra.run.smithi097.stderr: 2021-10-08T19:17:15.824 INFO:teuthology.orchestra.run.smithi097.stderr: https://docs.ceph.com/docs/master/mgr/telemetry/ 2021-10-08T19:17:15.824 INFO:teuthology.orchestra.run.smithi097.stderr: 2021-10-08T19:17:15.825 INFO:teuthology.orchestra.run.smithi097.stderr:Bootstrap complete. 2021-10-08T19:17:15.855 INFO:tasks.cephadm:Fetching config... 2021-10-08T19:17:15.855 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2021-10-08T19:17:15.856 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2021-10-08T19:17:15.870 INFO:tasks.cephadm:Fetching client.admin keyring... 2021-10-08T19:17:15.871 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2021-10-08T19:17:15.871 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2021-10-08T19:17:15.925 INFO:tasks.cephadm:Fetching mon keyring... 2021-10-08T19:17:15.926 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2021-10-08T19:17:15.926 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/keyring of=/dev/stdout 2021-10-08T19:17:15.991 INFO:tasks.cephadm:Fetching pub ssh key... 2021-10-08T19:17:15.991 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2021-10-08T19:17:15.991 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2021-10-08T19:17:16.045 INFO:tasks.cephadm:Installing pub ssh key for root users... 2021-10-08T19:17:16.046 DEBUG:teuthology.orchestra.run.smithi097:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4hsNpW/aPXdT9XTxcyginsXU8X70pMJjrzn5reLBjPQCrfyOTeuwyGCdBY3Wp+uhZw/St+VSeE+J39Ve9q5MB2SDnfjX7vWI+hl+2klDGnhFAiCmZLU2fVk26jrlnOc2ej23X+z39KHF35UmsIkBRK9wtPClrydSlRmGMubywW5UHFlqyPbO7v1L1OmAwUl09V/REyi8ZSO9hEritJpVZL9Qh6W2cbKF/tw0VFjwz0FE/4LGtW0mHkUxbp7kgsjTIciLRohLhLvAhPN/yG+ytE/ehRPoLT9HruEUIYlfIX+Z6tppEEtcy7lZWVEwtrcWgxLwyemlWZnzh2WL7DV1dfoOCy2Y9pnTda7+qQR0gKzOHOFxOgCkEAq4wluIVCxFfj0lwUdHeBRLr57xMBwwdnBMYTUyuZ2gu8wSNfoUYzYTDUaezkEhaIkQ/L3a2KW7RmgKeSkOXjGxFJBlVFu/MxKqrbYxtqG/S49NuwFj6Kdk85AkvX/j2lSqRZ3OrqTM= ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2021-10-08T19:17:16.105 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:16 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2844724444' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2021-10-08T19:17:16.117 INFO:teuthology.orchestra.run.smithi097.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4hsNpW/aPXdT9XTxcyginsXU8X70pMJjrzn5reLBjPQCrfyOTeuwyGCdBY3Wp+uhZw/St+VSeE+J39Ve9q5MB2SDnfjX7vWI+hl+2klDGnhFAiCmZLU2fVk26jrlnOc2ej23X+z39KHF35UmsIkBRK9wtPClrydSlRmGMubywW5UHFlqyPbO7v1L1OmAwUl09V/REyi8ZSO9hEritJpVZL9Qh6W2cbKF/tw0VFjwz0FE/4LGtW0mHkUxbp7kgsjTIciLRohLhLvAhPN/yG+ytE/ehRPoLT9HruEUIYlfIX+Z6tppEEtcy7lZWVEwtrcWgxLwyemlWZnzh2WL7DV1dfoOCy2Y9pnTda7+qQR0gKzOHOFxOgCkEAq4wluIVCxFfj0lwUdHeBRLr57xMBwwdnBMYTUyuZ2gu8wSNfoUYzYTDUaezkEhaIkQ/L3a2KW7RmgKeSkOXjGxFJBlVFu/MxKqrbYxtqG/S49NuwFj6Kdk85AkvX/j2lSqRZ3OrqTM= ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c 2021-10-08T19:17:16.128 DEBUG:teuthology.orchestra.run.smithi117:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4hsNpW/aPXdT9XTxcyginsXU8X70pMJjrzn5reLBjPQCrfyOTeuwyGCdBY3Wp+uhZw/St+VSeE+J39Ve9q5MB2SDnfjX7vWI+hl+2klDGnhFAiCmZLU2fVk26jrlnOc2ej23X+z39KHF35UmsIkBRK9wtPClrydSlRmGMubywW5UHFlqyPbO7v1L1OmAwUl09V/REyi8ZSO9hEritJpVZL9Qh6W2cbKF/tw0VFjwz0FE/4LGtW0mHkUxbp7kgsjTIciLRohLhLvAhPN/yG+ytE/ehRPoLT9HruEUIYlfIX+Z6tppEEtcy7lZWVEwtrcWgxLwyemlWZnzh2WL7DV1dfoOCy2Y9pnTda7+qQR0gKzOHOFxOgCkEAq4wluIVCxFfj0lwUdHeBRLr57xMBwwdnBMYTUyuZ2gu8wSNfoUYzYTDUaezkEhaIkQ/L3a2KW7RmgKeSkOXjGxFJBlVFu/MxKqrbYxtqG/S49NuwFj6Kdk85AkvX/j2lSqRZ3OrqTM= ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2021-10-08T19:17:16.169 INFO:teuthology.orchestra.run.smithi117.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4hsNpW/aPXdT9XTxcyginsXU8X70pMJjrzn5reLBjPQCrfyOTeuwyGCdBY3Wp+uhZw/St+VSeE+J39Ve9q5MB2SDnfjX7vWI+hl+2klDGnhFAiCmZLU2fVk26jrlnOc2ej23X+z39KHF35UmsIkBRK9wtPClrydSlRmGMubywW5UHFlqyPbO7v1L1OmAwUl09V/REyi8ZSO9hEritJpVZL9Qh6W2cbKF/tw0VFjwz0FE/4LGtW0mHkUxbp7kgsjTIciLRohLhLvAhPN/yG+ytE/ehRPoLT9HruEUIYlfIX+Z6tppEEtcy7lZWVEwtrcWgxLwyemlWZnzh2WL7DV1dfoOCy2Y9pnTda7+qQR0gKzOHOFxOgCkEAq4wluIVCxFfj0lwUdHeBRLr57xMBwwdnBMYTUyuZ2gu8wSNfoUYzYTDUaezkEhaIkQ/L3a2KW7RmgKeSkOXjGxFJBlVFu/MxKqrbYxtqG/S49NuwFj6Kdk85AkvX/j2lSqRZ3OrqTM= ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c 2021-10-08T19:17:16.181 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph config set mgr mgr/cephadm/allow_ptrace true 2021-10-08T19:17:18.296 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:18 smithi097 ceph-mon[32687]: mgrmap e13: y(active, since 6s) 2021-10-08T19:17:18.296 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:18 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/730640741' entity='client.admin' 2021-10-08T19:17:18.297 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:18 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:17:18.297 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:18 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:17:18.297 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:18 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi097", "caps": []}]: dispatch 2021-10-08T19:17:18.523 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2021-10-08T19:17:18.524 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph orch client-keyring set client.admin '*' --mode 0755 2021-10-08T19:17:19.106 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:19 smithi097 ceph-mon[32687]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:17:19.107 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:19 smithi097 ceph-mon[32687]: Deploying daemon agent.smithi097 on smithi097 2021-10-08T19:17:19.107 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:19 smithi097 ceph-mon[32687]: poll took 8117.932 ms: 1 events 2021-10-08T19:17:19.107 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:19 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:17:19.108 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:19 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:17:19.108 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:19 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:17:19.108 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:19 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:17:19.108 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:19 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:17:20.294 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:20 smithi097 ceph-mon[32687]: Executing () created at /lib/python3.6/site-packages/asyncssh/channel.py:596> took 0.177 seconds 2021-10-08T19:17:20.294 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:20 smithi097 ceph-mon[32687]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:17:20.294 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:20 smithi097 ceph-mon[32687]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:17:21.219 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:21 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:17:21.219 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:21 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:17:21.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:21 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:17:21.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:21 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:17:21.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:21 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:17:21.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:21 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:17:21.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:21 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:17:21.423 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi117 2021-10-08T19:17:21.424 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2021-10-08T19:17:21.424 DEBUG:teuthology.orchestra.run.smithi117:> dd of=/etc/ceph/ceph.conf 2021-10-08T19:17:21.442 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2021-10-08T19:17:21.442 DEBUG:teuthology.orchestra.run.smithi117:> dd of=/etc/ceph/ceph.client.admin.keyring 2021-10-08T19:17:21.498 INFO:tasks.cephadm:Adding host smithi117 to orchestrator... 2021-10-08T19:17:21.499 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph orch host add smithi117 2021-10-08T19:17:22.469 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:22 smithi097 ceph-mon[32687]: from='client.14170 v1:172.21.15.97:0/4252025467' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:17:22.469 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:22 smithi097 ceph-mon[32687]: Updating smithi097:/etc/ceph/ceph.conf 2021-10-08T19:17:22.469 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:22 smithi097 ceph-mon[32687]: poll took 1700.104 ms: 1 events 2021-10-08T19:17:22.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:22 smithi097 ceph-mon[32687]: Updating smithi097:/etc/ceph/ceph.client.admin.keyring 2021-10-08T19:17:22.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:22 smithi097 ceph-mon[32687]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:17:24.219 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:17:23 smithi097 conmon[33110]: 172.21.15.97 - - [08/Oct/2021:19:17:23] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:17:25.219 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:24 smithi097 ceph-mon[32687]: Sending message to agent on host smithi097 2021-10-08T19:17:25.219 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:24 smithi097 ceph-mon[32687]: Received old metadata from agent on host smithi097. Requested up-to-date metadata. 2021-10-08T19:17:25.219 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:24 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:17:25.219 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:24 smithi097 ceph-mon[32687]: 172.21.15.97 - - [08/Oct/2021:19:17:23] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:17:26.678 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:26 smithi097 ceph-mon[32687]: Received "ACK" from agent on host smithi097 2021-10-08T19:17:28.469 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:17:28 smithi097 conmon[33110]: 172.21.15.97 - - [08/Oct/2021:19:17:28] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:17:29.469 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:29 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:17:29.469 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:29 smithi097 ceph-mon[32687]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:17:29.469 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:29 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:17:29.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:29 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:17:29.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:29 smithi097 ceph-mon[32687]: 172.21.15.97 - - [08/Oct/2021:19:17:28] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:17:29.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:29 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:17:29.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:29 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:17:29.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:29 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:17:33.469 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:33 smithi097 ceph-mon[32687]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:17:35.469 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:35 smithi097 ceph-mon[32687]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:17:37.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:37 smithi097 ceph-mon[32687]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:17:39.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:39 smithi097 ceph-mon[32687]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:17:41.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:41 smithi097 ceph-mon[32687]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:17:43.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:43 smithi097 ceph-mon[32687]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:17:45.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:45 smithi097 ceph-mon[32687]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:17:47.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:47 smithi097 ceph-mon[32687]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:17:49.469 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:49 smithi097 ceph-mon[32687]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:17:51.719 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:17:51 smithi097 conmon[33110]: 172.21.15.97 - - [08/Oct/2021:19:17:51] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:17:51.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:51 smithi097 ceph-mon[32687]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:17:51.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:51 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:17:52.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:52 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:17:52.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:52 smithi097 ceph-mon[32687]: 172.21.15.97 - - [08/Oct/2021:19:17:51] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:17:53.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:53 smithi097 ceph-mon[32687]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:17:55.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:55 smithi097 ceph-mon[32687]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:17:57.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:57 smithi097 ceph-mon[32687]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:17:59.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:17:59 smithi097 ceph-mon[32687]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:01.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:01 smithi097 ceph-mon[32687]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:03.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:03 smithi097 ceph-mon[32687]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:05.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:05 smithi097 ceph-mon[32687]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:07.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:07 smithi097 ceph-mon[32687]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:09.200 INFO:teuthology.orchestra.run.smithi117.stdout:Added host 'smithi117' with addr '172.21.15.117' 2021-10-08T19:18:09.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:09 smithi097 ceph-mon[32687]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:09.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:09 smithi097 ceph-mon[32687]: from='client.14172 v1:172.21.15.117:0/3530416354' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi117", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:18:09.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:09 smithi097 ceph-mon[32687]: poll took 47344.690 ms: 1 events 2021-10-08T19:18:09.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:09 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:09.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:09 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:18:09.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:09 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:09.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:09 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:18:09.808 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph orch host ls --format=json 2021-10-08T19:18:10.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:10 smithi097 ceph-mon[32687]: Deploying cephadm binary to smithi117 2021-10-08T19:18:10.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:10 smithi097 ceph-mon[32687]: Executing () created at /lib/python3.6/site-packages/asyncssh/channel.py:596> took 0.155 seconds 2021-10-08T19:18:10.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:10 smithi097 ceph-mon[32687]: Executing took 0.141 seconds 2021-10-08T19:18:10.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:10 smithi097 ceph-mon[32687]: Added host smithi117 2021-10-08T19:18:10.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:10 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:10.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:10 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:10.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:10 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi117", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:18:10.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:10 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:10.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:10 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi117", "caps": []}]: dispatch 2021-10-08T19:18:10.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:10 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.agent.smithi117", "caps": []}]': finished 2021-10-08T19:18:10.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:10 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:18:10.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:10 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:18:11.781 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:11 smithi097 ceph-mon[32687]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:18:11.782 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:11 smithi097 ceph-mon[32687]: Deploying daemon agent.smithi117 on smithi117 2021-10-08T19:18:11.782 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:11 smithi097 ceph-mon[32687]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:11.782 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:11 smithi097 ceph-mon[32687]: Executing () created at /lib/python3.6/site-packages/asyncssh/channel.py:596> took 0.167 seconds 2021-10-08T19:18:11.782 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:11 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:11.783 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:11 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:18:11.783 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:11 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:11.783 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:11 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:18:11.783 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:11 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:11.783 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:11 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:11.784 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:11 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:18:11.784 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:11 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:11.784 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:11 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:18:11.784 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:11 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:11.894 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:18:11.894 INFO:teuthology.orchestra.run.smithi117.stdout:[{"addr": "127.0.1.1", "hostname": "smithi097", "labels": [], "status": ""}, {"addr": "172.21.15.117", "hostname": "smithi117", "labels": [], "status": ""}] 2021-10-08T19:18:12.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:12 smithi097 ceph-mon[32687]: Updating smithi117:/etc/ceph/ceph.conf 2021-10-08T19:18:12.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:12 smithi097 ceph-mon[32687]: Updating smithi117:/etc/ceph/ceph.client.admin.keyring 2021-10-08T19:18:12.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:12 smithi097 ceph-mon[32687]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:18:12.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:12 smithi097 ceph-mon[32687]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:18:12.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:12 smithi097 ceph-mon[32687]: from='client.14174 v1:172.21.15.117:0/1380967349' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:18:12.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:12 smithi097 ceph-mon[32687]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:13.129 INFO:tasks.cephadm:Setting crush tunables to default 2021-10-08T19:18:13.130 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd crush tunables default 2021-10-08T19:18:15.219 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:15 smithi097 ceph-mon[32687]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:15.220 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:18:15 smithi097 conmon[33110]: 172.21.15.97 - - [08/Oct/2021:19:18:15] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:18:15.220 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:18:15 smithi097 conmon[33110]: 172.21.15.117 - - [08/Oct/2021:19:18:15] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:18:16.169 INFO:teuthology.orchestra.run.smithi097.stderr:adjusted tunables profile to default 2021-10-08T19:18:16.469 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:16 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:16.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:16 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:16.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:16 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:18:16.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:16 smithi097 ceph-mon[32687]: 172.21.15.97 - - [08/Oct/2021:19:18:15] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:18:16.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:16 smithi097 ceph-mon[32687]: Sending message to agent on host smithi117 2021-10-08T19:18:16.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:16 smithi097 ceph-mon[32687]: 172.21.15.117 - - [08/Oct/2021:19:18:15] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:18:16.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:16 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1773808900' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2021-10-08T19:18:16.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:16 smithi097 ceph-mon[32687]: Received "ACK" from agent on host smithi117 2021-10-08T19:18:16.769 INFO:tasks.cephadm:Adding mon.a on smithi097 2021-10-08T19:18:16.770 INFO:tasks.cephadm:Adding mon.c on smithi097 2021-10-08T19:18:16.770 INFO:tasks.cephadm:Adding mon.b on smithi117 2021-10-08T19:18:16.771 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph orch apply mon '3;smithi097:[v1:172.21.15.97:6789]=a;smithi097:[v1:172.21.15.97:6790]=c;smithi117:[v1:172.21.15.117:6789]=b' 2021-10-08T19:18:17.469 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:17 smithi097 ceph-mon[32687]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:17.469 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:17 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1773808900' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2021-10-08T19:18:17.469 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:17 smithi097 ceph-mon[32687]: osdmap e4: 0 total, 0 up, 0 in 2021-10-08T19:18:19.419 INFO:teuthology.orchestra.run.smithi117.stdout:Scheduled mon update... 2021-10-08T19:18:19.455 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:19 smithi097 ceph-mon[32687]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:19.455 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:18:19 smithi097 conmon[33110]: 172.21.15.117 - - [08/Oct/2021:19:18:19] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:18:20.081 DEBUG:teuthology.orchestra.run.smithi097:mon.c> sudo journalctl -f -n 0 -u ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@mon.c.service 2021-10-08T19:18:20.084 DEBUG:teuthology.orchestra.run.smithi117:mon.b> sudo journalctl -f -n 0 -u ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@mon.b.service 2021-10-08T19:18:20.087 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2021-10-08T19:18:20.087 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph mon dump -f json 2021-10-08T19:18:20.109 INFO:journalctl@ceph.mon.c.smithi097.stdout:-- Logs begin at Fri 2021-10-08 19:07:18 UTC. -- 2021-10-08T19:18:20.115 INFO:journalctl@ceph.mon.b.smithi117.stdout:-- Logs begin at Fri 2021-10-08 19:07:21 UTC. -- 2021-10-08T19:18:20.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:20 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:20.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:20 smithi097 ceph-mon[32687]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:18:20.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:20 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:18:20.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:20 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:18:20.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:20 smithi097 ceph-mon[32687]: 172.21.15.117 - - [08/Oct/2021:19:18:19] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:18:20.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:20 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:20.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:20 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:18:20.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:20 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:20.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:20 smithi097 ceph-mon[32687]: from='client.14178 v1:172.21.15.117:0/2951155805' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi097:[v1:172.21.15.97:6789]=a;smithi097:[v1:172.21.15.97:6790]=c;smithi117:[v1:172.21.15.117:6789]=b", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:18:20.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:20 smithi097 ceph-mon[32687]: Saving service mon spec with placement smithi097:[v1:172.21.15.97:6789]=a;smithi097:[v1:172.21.15.97:6790]=c;smithi117:[v1:172.21.15.117:6789]=b;count:3 2021-10-08T19:18:20.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:20 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:20.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:20 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:18:20.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:20 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:20.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:20 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:18:20.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:20 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:20.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:20 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-10-08T19:18:20.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:20 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:20.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:20 smithi097 ceph-mon[32687]: Deploying daemon mon.c on smithi097 2021-10-08T19:18:20.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:20 smithi097 ceph-mon[32687]: poll took 8531.353 ms: 1 events 2021-10-08T19:18:21.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:21 smithi097 ceph-mon[32687]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:22.106 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:18:22.106 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":1,"fsid":"1d01f6d6-286c-11ec-8c25-001a4aab830c","modified":"2021-10-08T19:16:22.846745Z","created":"2021-10-08T19:16:22.846745Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6789","nonce":0}]},"addr":"172.21.15.97:6789/0","public_addr":"172.21.15.97:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2021-10-08T19:18:22.107 INFO:teuthology.orchestra.run.smithi117.stderr:dumped monmap epoch 1 2021-10-08T19:18:22.219 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 systemd[1]: Starting Ceph mon.c for 1d01f6d6-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:18:22.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.117:0/2328144542' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-10-08T19:18:22.726 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: set uid:gid to 167:167 (ceph:ceph) 2021-10-08T19:18:22.726 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: ceph version 17.0.0-8087-g103b6cc3 (103b6cc3554193fcd0852d9c647cef19e99920cf) quincy (dev), process ceph-mon, pid 7 2021-10-08T19:18:22.726 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: pidfile_write: ignore empty --pid-file 2021-10-08T19:18:22.727 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: load: jerasure load: lrc 2021-10-08T19:18:22.727 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: RocksDB version: 6.15.5 2021-10-08T19:18:22.727 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-10-08T19:18:22.727 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Compile date Oct 7 2021 2021-10-08T19:18:22.728 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: DB SUMMARY 2021-10-08T19:18:22.728 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: DB Session ID: O711V69B77ZYUHAV10FZ 2021-10-08T19:18:22.728 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: CURRENT file: CURRENT 2021-10-08T19:18:22.728 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: IDENTITY file: IDENTITY 2021-10-08T19:18:22.728 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: MANIFEST file: MANIFEST-000003 size: 57 Bytes 2021-10-08T19:18:22.729 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2021-10-08T19:18:22.729 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 476 ; 2021-10-08T19:18:22.729 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.error_if_exists: 0 2021-10-08T19:18:22.729 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.create_if_missing: 0 2021-10-08T19:18:22.729 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.paranoid_checks: 1 2021-10-08T19:18:22.730 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2021-10-08T19:18:22.730 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.env: 0x557bb0f1bb60 2021-10-08T19:18:22.730 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.fs: Posix File System 2021-10-08T19:18:22.731 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.info_log: 0x557bb32020a0 2021-10-08T19:18:22.731 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.max_file_opening_threads: 16 2021-10-08T19:18:22.731 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.statistics: (nil) 2021-10-08T19:18:22.731 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.use_fsync: 0 2021-10-08T19:18:22.732 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.max_log_file_size: 0 2021-10-08T19:18:22.732 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.max_manifest_file_size: 1073741824 2021-10-08T19:18:22.732 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.log_file_time_to_roll: 0 2021-10-08T19:18:22.732 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.keep_log_file_num: 1000 2021-10-08T19:18:22.733 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.recycle_log_file_num: 0 2021-10-08T19:18:22.733 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.allow_fallocate: 1 2021-10-08T19:18:22.733 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.allow_mmap_reads: 0 2021-10-08T19:18:22.733 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.allow_mmap_writes: 0 2021-10-08T19:18:22.733 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.use_direct_reads: 0 2021-10-08T19:18:22.734 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-10-08T19:18:22.734 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.create_missing_column_families: 0 2021-10-08T19:18:22.734 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.db_log_dir: 2021-10-08T19:18:22.735 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-c/store.db 2021-10-08T19:18:22.735 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.table_cache_numshardbits: 6 2021-10-08T19:18:22.735 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.WAL_ttl_seconds: 0 2021-10-08T19:18:22.735 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.WAL_size_limit_MB: 0 2021-10-08T19:18:22.736 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2021-10-08T19:18:22.736 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.manifest_preallocation_size: 4194304 2021-10-08T19:18:22.736 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.is_fd_close_on_exec: 1 2021-10-08T19:18:22.736 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.advise_random_on_open: 1 2021-10-08T19:18:22.736 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.db_write_buffer_size: 0 2021-10-08T19:18:22.737 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.write_buffer_manager: 0x557bb3277e30 2021-10-08T19:18:22.737 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.access_hint_on_compaction_start: 1 2021-10-08T19:18:22.737 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-10-08T19:18:22.737 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.random_access_max_buffer_size: 1048576 2021-10-08T19:18:22.738 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.use_adaptive_mutex: 0 2021-10-08T19:18:22.738 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.rate_limiter: (nil) 2021-10-08T19:18:22.738 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-10-08T19:18:22.738 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.wal_recovery_mode: 2 2021-10-08T19:18:22.739 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.enable_thread_tracking: 0 2021-10-08T19:18:22.739 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.enable_pipelined_write: 0 2021-10-08T19:18:22.739 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.unordered_write: 0 2021-10-08T19:18:22.739 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.allow_concurrent_memtable_write: 1 2021-10-08T19:18:22.740 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-10-08T19:18:22.740 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.write_thread_max_yield_usec: 100 2021-10-08T19:18:22.740 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.write_thread_slow_yield_usec: 3 2021-10-08T19:18:22.740 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.row_cache: None 2021-10-08T19:18:22.740 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.wal_filter: None 2021-10-08T19:18:22.741 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.avoid_flush_during_recovery: 0 2021-10-08T19:18:22.741 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.allow_ingest_behind: 0 2021-10-08T19:18:22.741 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.preserve_deletes: 0 2021-10-08T19:18:22.742 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.two_write_queues: 0 2021-10-08T19:18:22.742 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.manual_wal_flush: 0 2021-10-08T19:18:22.742 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.atomic_flush: 0 2021-10-08T19:18:22.743 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-10-08T19:18:22.743 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.persist_stats_to_disk: 0 2021-10-08T19:18:22.743 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.write_dbid_to_manifest: 0 2021-10-08T19:18:22.743 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.log_readahead_size: 0 2021-10-08T19:18:22.743 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.file_checksum_gen_factory: Unknown 2021-10-08T19:18:22.744 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.best_efforts_recovery: 0 2021-10-08T19:18:22.744 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2021-10-08T19:18:22.744 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2021-10-08T19:18:22.744 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.allow_data_in_errors: 0 2021-10-08T19:18:22.745 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.db_host_id: __hostname__ 2021-10-08T19:18:22.745 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.max_background_jobs: 2 2021-10-08T19:18:22.745 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.max_background_compactions: -1 2021-10-08T19:18:22.745 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.max_subcompactions: 1 2021-10-08T19:18:22.746 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.avoid_flush_during_shutdown: 0 2021-10-08T19:18:22.746 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-10-08T19:18:22.746 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.delayed_write_rate : 16777216 2021-10-08T19:18:22.746 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.max_total_wal_size: 0 2021-10-08T19:18:22.746 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-10-08T19:18:22.747 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.stats_dump_period_sec: 600 2021-10-08T19:18:22.747 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.stats_persist_period_sec: 600 2021-10-08T19:18:22.747 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.stats_history_buffer_size: 1048576 2021-10-08T19:18:22.747 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.max_open_files: -1 2021-10-08T19:18:22.748 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.bytes_per_sync: 0 2021-10-08T19:18:22.748 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.wal_bytes_per_sync: 0 2021-10-08T19:18:22.748 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.strict_bytes_per_sync: 0 2021-10-08T19:18:22.749 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.compaction_readahead_size: 0 2021-10-08T19:18:22.749 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.max_background_flushes: -1 2021-10-08T19:18:22.749 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Compression algorithms supported: 2021-10-08T19:18:22.749 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: kZSTDNotFinalCompression supported: 0 2021-10-08T19:18:22.749 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: kZSTD supported: 0 2021-10-08T19:18:22.750 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: kXpressCompression supported: 0 2021-10-08T19:18:22.750 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: kLZ4HCCompression supported: 1 2021-10-08T19:18:22.750 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: kLZ4Compression supported: 1 2021-10-08T19:18:22.750 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: kBZip2Compression supported: 0 2021-10-08T19:18:22.751 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: kZlibCompression supported: 1 2021-10-08T19:18:22.751 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: kSnappyCompression supported: 1 2021-10-08T19:18:22.751 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Fast CRC32 supported: Supported on x86 2021-10-08T19:18:22.751 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: [db/version_set.cc:4725] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000003 2021-10-08T19:18:22.751 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: [db/column_family.cc:597] --------------- Options for column family [default]: 2021-10-08T19:18:22.752 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-10-08T19:18:22.752 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.merge_operator: 2021-10-08T19:18:22.752 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.compaction_filter: None 2021-10-08T19:18:22.752 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.compaction_filter_factory: None 2021-10-08T19:18:22.752 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.sst_partitioner_factory: None 2021-10-08T19:18:22.753 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.memtable_factory: SkipListFactory 2021-10-08T19:18:22.753 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.table_factory: BlockBasedTable 2021-10-08T19:18:22.753 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x557bb31cbb80) 2021-10-08T19:18:22.753 INFO:journalctl@ceph.mon.c.smithi097.stdout: cache_index_and_filter_blocks: 1 2021-10-08T19:18:22.754 INFO:journalctl@ceph.mon.c.smithi097.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2021-10-08T19:18:22.754 INFO:journalctl@ceph.mon.c.smithi097.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2021-10-08T19:18:22.754 INFO:journalctl@ceph.mon.c.smithi097.stdout: pin_top_level_index_and_filter: 1 2021-10-08T19:18:22.754 INFO:journalctl@ceph.mon.c.smithi097.stdout: index_type: 0 2021-10-08T19:18:22.754 INFO:journalctl@ceph.mon.c.smithi097.stdout: data_block_index_type: 0 2021-10-08T19:18:22.755 INFO:journalctl@ceph.mon.c.smithi097.stdout: index_shortening: 1 2021-10-08T19:18:22.755 INFO:journalctl@ceph.mon.c.smithi097.stdout: data_block_hash_table_util_ratio: 0.750000 2021-10-08T19:18:22.755 INFO:journalctl@ceph.mon.c.smithi097.stdout: hash_index_allow_collision: 1 2021-10-08T19:18:22.755 INFO:journalctl@ceph.mon.c.smithi097.stdout: checksum: 1 2021-10-08T19:18:22.755 INFO:journalctl@ceph.mon.c.smithi097.stdout: no_block_cache: 0 2021-10-08T19:18:22.756 INFO:journalctl@ceph.mon.c.smithi097.stdout: block_cache: 0x557bb3200d10 2021-10-08T19:18:22.756 INFO:journalctl@ceph.mon.c.smithi097.stdout: block_cache_name: BinnedLRUCache 2021-10-08T19:18:22.756 INFO:journalctl@ceph.mon.c.smithi097.stdout: block_cache_options: 2021-10-08T19:18:22.756 INFO:journalctl@ceph.mon.c.smithi097.stdout: capacity : 536870912 2021-10-08T19:18:22.757 INFO:journalctl@ceph.mon.c.smithi097.stdout: num_shard_bits : 4 2021-10-08T19:18:22.757 INFO:journalctl@ceph.mon.c.smithi097.stdout: strict_capacity_limit : 0 2021-10-08T19:18:22.757 INFO:journalctl@ceph.mon.c.smithi097.stdout: high_pri_pool_ratio: 0.000 2021-10-08T19:18:22.757 INFO:journalctl@ceph.mon.c.smithi097.stdout: block_cache_compressed: (nil) 2021-10-08T19:18:22.757 INFO:journalctl@ceph.mon.c.smithi097.stdout: persistent_cache: (nil) 2021-10-08T19:18:22.758 INFO:journalctl@ceph.mon.c.smithi097.stdout: block_size: 4096 2021-10-08T19:18:22.758 INFO:journalctl@ceph.mon.c.smithi097.stdout: block_size_deviation: 10 2021-10-08T19:18:22.758 INFO:journalctl@ceph.mon.c.smithi097.stdout: block_restart_interval: 16 2021-10-08T19:18:22.758 INFO:journalctl@ceph.mon.c.smithi097.stdout: index_block_restart_interval: 1 2021-10-08T19:18:22.758 INFO:journalctl@ceph.mon.c.smithi097.stdout: metadata_block_size: 4096 2021-10-08T19:18:22.759 INFO:journalctl@ceph.mon.c.smithi097.stdout: partition_filters: 0 2021-10-08T19:18:22.759 INFO:journalctl@ceph.mon.c.smithi097.stdout: use_delta_encoding: 1 2021-10-08T19:18:22.759 INFO:journalctl@ceph.mon.c.smithi097.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2021-10-08T19:18:22.759 INFO:journalctl@ceph.mon.c.smithi097.stdout: whole_key_filtering: 1 2021-10-08T19:18:22.760 INFO:journalctl@ceph.mon.c.smithi097.stdout: verify_compression: 0 2021-10-08T19:18:22.760 INFO:journalctl@ceph.mon.c.smithi097.stdout: read_amp_bytes_per_bit: 0 2021-10-08T19:18:22.760 INFO:journalctl@ceph.mon.c.smithi097.stdout: format_version: 4 2021-10-08T19:18:22.760 INFO:journalctl@ceph.mon.c.smithi097.stdout: enable_index_compression: 1 2021-10-08T19:18:22.760 INFO:journalctl@ceph.mon.c.smithi097.stdout: block_align: 0 2021-10-08T19:18:22.761 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.write_buffer_size: 33554432 2021-10-08T19:18:22.761 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.max_write_buffer_number: 2 2021-10-08T19:18:22.761 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.compression: NoCompression 2021-10-08T19:18:22.761 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.bottommost_compression: Disabled 2021-10-08T19:18:22.761 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.prefix_extractor: nullptr 2021-10-08T19:18:22.762 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-10-08T19:18:22.762 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.num_levels: 7 2021-10-08T19:18:22.762 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-10-08T19:18:22.762 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-10-08T19:18:22.763 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2021-10-08T19:18:22.763 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-10-08T19:18:22.763 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.bottommost_compression_opts.level: 32767 2021-10-08T19:18:22.763 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-10-08T19:18:22.763 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-10-08T19:18:22.764 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-10-08T19:18:22.764 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2021-10-08T19:18:22.764 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.bottommost_compression_opts.enabled: false 2021-10-08T19:18:22.764 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.compression_opts.window_bits: -14 2021-10-08T19:18:22.765 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.compression_opts.level: 32767 2021-10-08T19:18:22.765 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.compression_opts.strategy: 0 2021-10-08T19:18:22.765 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-10-08T19:18:22.765 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-10-08T19:18:22.766 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.compression_opts.parallel_threads: 1 2021-10-08T19:18:22.766 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.compression_opts.enabled: false 2021-10-08T19:18:22.766 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-10-08T19:18:22.766 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-10-08T19:18:22.766 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.level0_stop_writes_trigger: 36 2021-10-08T19:18:22.767 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.target_file_size_base: 67108864 2021-10-08T19:18:22.767 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.target_file_size_multiplier: 1 2021-10-08T19:18:22.767 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.max_bytes_for_level_base: 268435456 2021-10-08T19:18:22.767 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-10-08T19:18:22.768 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-10-08T19:18:22.768 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-10-08T19:18:22.768 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-10-08T19:18:22.768 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-10-08T19:18:22.768 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-10-08T19:18:22.769 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-10-08T19:18:22.769 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-10-08T19:18:22.769 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-10-08T19:18:22.769 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-10-08T19:18:22.769 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.max_compaction_bytes: 1677721600 2021-10-08T19:18:22.770 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.arena_block_size: 4194304 2021-10-08T19:18:22.770 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-10-08T19:18:22.770 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-10-08T19:18:22.770 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-10-08T19:18:22.771 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.disable_auto_compactions: 0 2021-10-08T19:18:22.771 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-10-08T19:18:22.771 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-10-08T19:18:22.771 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-10-08T19:18:22.771 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-10-08T19:18:22.772 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-10-08T19:18:22.772 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-10-08T19:18:22.772 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-10-08T19:18:22.772 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-10-08T19:18:22.772 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-10-08T19:18:22.773 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-10-08T19:18:22.773 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.table_properties_collectors: 2021-10-08T19:18:22.773 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.inplace_update_support: 0 2021-10-08T19:18:22.773 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.inplace_update_num_locks: 10000 2021-10-08T19:18:22.774 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-10-08T19:18:22.774 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.memtable_whole_key_filtering: 0 2021-10-08T19:18:22.774 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.memtable_huge_page_size: 0 2021-10-08T19:18:22.774 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.bloom_locality: 0 2021-10-08T19:18:22.775 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.max_successive_merges: 0 2021-10-08T19:18:22.775 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.optimize_filters_for_hits: 0 2021-10-08T19:18:22.775 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.paranoid_file_checks: 0 2021-10-08T19:18:22.775 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.force_consistency_checks: 1 2021-10-08T19:18:22.775 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.report_bg_io_stats: 0 2021-10-08T19:18:22.776 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.ttl: 2592000 2021-10-08T19:18:22.776 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.periodic_compaction_seconds: 0 2021-10-08T19:18:22.776 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.enable_blob_files: false 2021-10-08T19:18:22.776 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.min_blob_size: 0 2021-10-08T19:18:22.777 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.blob_file_size: 268435456 2021-10-08T19:18:22.777 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.blob_compression_type: NoCompression 2021-10-08T19:18:22.777 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.enable_blob_garbage_collection: false 2021-10-08T19:18:22.777 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2021-10-08T19:18:22.777 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: [db/version_set.cc:4773] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000003 succeeded,manifest_file_number is 3, next_file_number is 5, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-10-08T19:18:22.778 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: [db/version_set.cc:4782] Column family [default] (ID 0), log number is 0 2021-10-08T19:18:22.778 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: [db/version_set.cc:4083] Creating manifest 7 2021-10-08T19:18:22.778 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: EVENT_LOG_v1 {"time_micros": 1633720702573864, "job": 1, "event": "recovery_started", "wal_files": [4]} 2021-10-08T19:18:22.778 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: [db/db_impl/db_impl_open.cc:847] Recovering log #4 mode 2 2021-10-08T19:18:22.779 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: [table/block_based/filter_policy.cc:996] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2021-10-08T19:18:22.779 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: EVENT_LOG_v1 {"time_micros": 1633720702574138, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1510, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 488, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 366, "raw_average_value_size": 73, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1633720702, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "3213b2c1-3602-409c-97c5-a6d523bc657c", "db_session_id": "O711V69B77ZYUHAV10FZ"}} 2021-10-08T19:18:22.779 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: [db/version_set.cc:4083] Creating manifest 9 2021-10-08T19:18:22.779 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: EVENT_LOG_v1 {"time_micros": 1633720702574449, "job": 1, "event": "recovery_finished"} 2021-10-08T19:18:22.779 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: [file/delete_scheduler.cc:73] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2021-10-08T19:18:22.780 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: [db/db_impl/db_impl_open.cc:1701] SstFileManager instance 0x557bb321ca80 2021-10-08T19:18:22.780 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: DB pointer 0x557bb322c000 2021-10-08T19:18:22.780 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: [db/db_impl/db_impl.cc:902] ------- DUMPING STATS ------- 2021-10-08T19:18:22.780 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: [db/db_impl/db_impl.cc:903] 2021-10-08T19:18:22.781 INFO:journalctl@ceph.mon.c.smithi097.stdout: ** DB Stats ** 2021-10-08T19:18:22.781 INFO:journalctl@ceph.mon.c.smithi097.stdout: Uptime(secs): 0.0 total, 0.0 interval 2021-10-08T19:18:22.781 INFO:journalctl@ceph.mon.c.smithi097.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-10-08T19:18:22.781 INFO:journalctl@ceph.mon.c.smithi097.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-10-08T19:18:22.781 INFO:journalctl@ceph.mon.c.smithi097.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-10-08T19:18:22.782 INFO:journalctl@ceph.mon.c.smithi097.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-10-08T19:18:22.782 INFO:journalctl@ceph.mon.c.smithi097.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-10-08T19:18:22.782 INFO:journalctl@ceph.mon.c.smithi097.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-10-08T19:18:22.782 INFO:journalctl@ceph.mon.c.smithi097.stdout: 2021-10-08T19:18:22.783 INFO:journalctl@ceph.mon.c.smithi097.stdout: ** Compaction Stats [default] ** 2021-10-08T19:18:22.783 INFO:journalctl@ceph.mon.c.smithi097.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-10-08T19:18:22.783 INFO:journalctl@ceph.mon.c.smithi097.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-10-08T19:18:22.783 INFO:journalctl@ceph.mon.c.smithi097.stdout: L0 1/0 1.47 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.5 0.00 0.00 1 0.000 0 0 2021-10-08T19:18:22.783 INFO:journalctl@ceph.mon.c.smithi097.stdout: Sum 1/0 1.47 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.5 0.00 0.00 1 0.000 0 0 2021-10-08T19:18:22.784 INFO:journalctl@ceph.mon.c.smithi097.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.5 0.00 0.00 1 0.000 0 0 2021-10-08T19:18:22.784 INFO:journalctl@ceph.mon.c.smithi097.stdout: 2021-10-08T19:18:22.784 INFO:journalctl@ceph.mon.c.smithi097.stdout: ** Compaction Stats [default] ** 2021-10-08T19:18:22.784 INFO:journalctl@ceph.mon.c.smithi097.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-10-08T19:18:22.785 INFO:journalctl@ceph.mon.c.smithi097.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-10-08T19:18:22.785 INFO:journalctl@ceph.mon.c.smithi097.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 5.5 0.00 0.00 1 0.000 0 0 2021-10-08T19:18:22.785 INFO:journalctl@ceph.mon.c.smithi097.stdout: Uptime(secs): 0.0 total, 0.0 interval 2021-10-08T19:18:22.785 INFO:journalctl@ceph.mon.c.smithi097.stdout: Flush(GB): cumulative 0.000, interval 0.000 2021-10-08T19:18:22.785 INFO:journalctl@ceph.mon.c.smithi097.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2021-10-08T19:18:22.786 INFO:journalctl@ceph.mon.c.smithi097.stdout: AddFile(Total Files): cumulative 0, interval 0 2021-10-08T19:18:22.786 INFO:journalctl@ceph.mon.c.smithi097.stdout: AddFile(L0 Files): cumulative 0, interval 0 2021-10-08T19:18:22.786 INFO:journalctl@ceph.mon.c.smithi097.stdout: AddFile(Keys): cumulative 0, interval 0 2021-10-08T19:18:22.786 INFO:journalctl@ceph.mon.c.smithi097.stdout: Cumulative compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-10-08T19:18:22.787 INFO:journalctl@ceph.mon.c.smithi097.stdout: Interval compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-10-08T19:18:22.787 INFO:journalctl@ceph.mon.c.smithi097.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-10-08T19:18:22.787 INFO:journalctl@ceph.mon.c.smithi097.stdout: 2021-10-08T19:18:22.787 INFO:journalctl@ceph.mon.c.smithi097.stdout: ** File Read Latency Histogram By Level [default] ** 2021-10-08T19:18:22.787 INFO:journalctl@ceph.mon.c.smithi097.stdout: 2021-10-08T19:18:22.788 INFO:journalctl@ceph.mon.c.smithi097.stdout: ** Compaction Stats [default] ** 2021-10-08T19:18:22.788 INFO:journalctl@ceph.mon.c.smithi097.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-10-08T19:18:22.788 INFO:journalctl@ceph.mon.c.smithi097.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-10-08T19:18:22.788 INFO:journalctl@ceph.mon.c.smithi097.stdout: L0 1/0 1.47 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.5 0.00 0.00 1 0.000 0 0 2021-10-08T19:18:22.788 INFO:journalctl@ceph.mon.c.smithi097.stdout: Sum 1/0 1.47 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.5 0.00 0.00 1 0.000 0 0 2021-10-08T19:18:22.789 INFO:journalctl@ceph.mon.c.smithi097.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-10-08T19:18:22.789 INFO:journalctl@ceph.mon.c.smithi097.stdout: 2021-10-08T19:18:22.789 INFO:journalctl@ceph.mon.c.smithi097.stdout: ** Compaction Stats [default] ** 2021-10-08T19:18:22.789 INFO:journalctl@ceph.mon.c.smithi097.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-10-08T19:18:22.790 INFO:journalctl@ceph.mon.c.smithi097.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-10-08T19:18:22.790 INFO:journalctl@ceph.mon.c.smithi097.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 5.5 0.00 0.00 1 0.000 0 0 2021-10-08T19:18:22.790 INFO:journalctl@ceph.mon.c.smithi097.stdout: Uptime(secs): 0.0 total, 0.0 interval 2021-10-08T19:18:22.790 INFO:journalctl@ceph.mon.c.smithi097.stdout: Flush(GB): cumulative 0.000, interval 0.000 2021-10-08T19:18:22.790 INFO:journalctl@ceph.mon.c.smithi097.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2021-10-08T19:18:22.791 INFO:journalctl@ceph.mon.c.smithi097.stdout: AddFile(Total Files): cumulative 0, interval 0 2021-10-08T19:18:22.791 INFO:journalctl@ceph.mon.c.smithi097.stdout: AddFile(L0 Files): cumulative 0, interval 0 2021-10-08T19:18:22.791 INFO:journalctl@ceph.mon.c.smithi097.stdout: AddFile(Keys): cumulative 0, interval 0 2021-10-08T19:18:22.791 INFO:journalctl@ceph.mon.c.smithi097.stdout: Cumulative compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-10-08T19:18:22.792 INFO:journalctl@ceph.mon.c.smithi097.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-10-08T19:18:22.792 INFO:journalctl@ceph.mon.c.smithi097.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-10-08T19:18:22.792 INFO:journalctl@ceph.mon.c.smithi097.stdout: 2021-10-08T19:18:22.792 INFO:journalctl@ceph.mon.c.smithi097.stdout: ** File Read Latency Histogram By Level [default] ** 2021-10-08T19:18:22.792 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: mon.c does not exist in monmap, will attempt to join an existing cluster 2021-10-08T19:18:22.793 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: using public_addrv v1:172.21.15.97:6790/0 2021-10-08T19:18:22.793 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: starting mon.c rank -1 at public addrs v1:172.21.15.97:6790/0 at bind addrs v1:172.21.15.97:6790/0 mon_data /var/lib/ceph/mon/ceph-c fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c 2021-10-08T19:18:22.793 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: mon.c@-1(???) e0 preinit fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c 2021-10-08T19:18:22.793 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: [db/db_impl/db_impl_write.cc:1739] [default] New memtable created with log file: #13. Immutable memtables: 0. 2021-10-08T19:18:22.793 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: (Original Log Time 2021/10/08-19:18:22.588200) [db/db_impl/db_impl_compaction_flush.cc:2402] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots available 1, flush slots scheduled 1, compaction slots scheduled 0 2021-10-08T19:18:22.794 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: [db/flush_job.cc:338] [default] [JOB 3] Flushing memtable with next log file: 13 2021-10-08T19:18:22.794 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: EVENT_LOG_v1 {"time_micros": 1633720702588319, "job": 3, "event": "flush_started", "num_memtables": 1, "num_entries": 1293, "num_deletes": 12, "total_data_size": 2049094, "memory_usage": 2073440, "flush_reason": "Manual Compaction"} 2021-10-08T19:18:22.794 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: [db/flush_job.cc:367] [default] [JOB 3] Level-0 flush table #14: started 2021-10-08T19:18:22.794 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: mon.c@-1(synchronizing).mds e1 new map 2021-10-08T19:18:22.795 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: mon.c@-1(synchronizing).mds e1 print_map 2021-10-08T19:18:22.795 INFO:journalctl@ceph.mon.c.smithi097.stdout: e1 2021-10-08T19:18:22.795 INFO:journalctl@ceph.mon.c.smithi097.stdout: enable_multiple, ever_enabled_multiple: 1,1 2021-10-08T19:18:22.795 INFO:journalctl@ceph.mon.c.smithi097.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-10-08T19:18:22.795 INFO:journalctl@ceph.mon.c.smithi097.stdout: legacy client fscid: -1 2021-10-08T19:18:22.796 INFO:journalctl@ceph.mon.c.smithi097.stdout: 2021-10-08T19:18:22.796 INFO:journalctl@ceph.mon.c.smithi097.stdout: No filesystems configured 2021-10-08T19:18:22.796 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2021-10-08T19:18:22.796 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2021-10-08T19:18:22.796 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2021-10-08T19:18:22.797 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2021-10-08T19:18:22.797 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2021-10-08T19:18:22.797 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2021-10-08T19:18:22.797 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2021-10-08T19:18:22.797 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2021-10-08T19:18:22.798 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2021-10-08T19:18:22.798 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2021-10-08T19:18:22.798 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:22.798 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:22.798 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:22.799 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:22.799 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:22.799 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:18:22.799 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: 172.21.15.97 - - [08/Oct/2021:19:17:51] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:18:22.800 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:22.800 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:22.800 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:22.800 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:22.800 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:22.801 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:22.801 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:22.801 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:22.801 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:22.802 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: from='client.14172 v1:172.21.15.117:0/3530416354' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi117", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:18:22.802 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: poll took 47344.690 ms: 1 events 2021-10-08T19:18:22.802 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:22.802 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:18:22.802 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:22.803 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:18:22.803 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: Deploying cephadm binary to smithi117 2021-10-08T19:18:22.803 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: Executing () created at /lib/python3.6/site-packages/asyncssh/channel.py:596> took 0.155 seconds 2021-10-08T19:18:22.803 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: Executing took 0.141 seconds 2021-10-08T19:18:22.804 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: Added host smithi117 2021-10-08T19:18:22.804 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:22.804 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:22.804 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi117", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:18:22.804 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:22.805 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi117", "caps": []}]: dispatch 2021-10-08T19:18:22.805 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.agent.smithi117", "caps": []}]': finished 2021-10-08T19:18:22.805 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:18:22.805 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:18:22.805 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:18:22.806 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: Deploying daemon agent.smithi117 on smithi117 2021-10-08T19:18:22.806 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:22.806 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: Executing () created at /lib/python3.6/site-packages/asyncssh/channel.py:596> took 0.167 seconds 2021-10-08T19:18:22.806 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:22.806 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:18:22.807 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:22.807 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:18:22.807 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:22.807 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:22.808 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:18:22.808 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:22.808 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:18:22.808 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:22.808 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: Updating smithi117:/etc/ceph/ceph.conf 2021-10-08T19:18:22.809 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: Updating smithi117:/etc/ceph/ceph.client.admin.keyring 2021-10-08T19:18:22.809 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:18:22.809 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:18:22.809 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: from='client.14174 v1:172.21.15.117:0/1380967349' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:18:22.809 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:22.810 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:22.810 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:22.810 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:22.810 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:18:22.810 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: 172.21.15.97 - - [08/Oct/2021:19:18:15] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:18:22.811 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: Sending message to agent on host smithi117 2021-10-08T19:18:22.811 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: 172.21.15.117 - - [08/Oct/2021:19:18:15] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:18:22.811 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1773808900' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2021-10-08T19:18:22.811 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: Received "ACK" from agent on host smithi117 2021-10-08T19:18:22.812 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:22.812 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1773808900' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2021-10-08T19:18:22.812 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: osdmap e4: 0 total, 0 up, 0 in 2021-10-08T19:18:22.812 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:22.812 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:22.813 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:18:22.813 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:18:22.813 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:18:22.813 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: 172.21.15.117 - - [08/Oct/2021:19:18:19] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:18:22.813 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:22.814 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:18:22.814 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:22.814 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: from='client.14178 v1:172.21.15.117:0/2951155805' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi097:[v1:172.21.15.97:6789]=a;smithi097:[v1:172.21.15.97:6790]=c;smithi117:[v1:172.21.15.117:6789]=b", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:18:22.814 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: Saving service mon spec with placement smithi097:[v1:172.21.15.97:6789]=a;smithi097:[v1:172.21.15.97:6790]=c;smithi117:[v1:172.21.15.117:6789]=b;count:3 2021-10-08T19:18:22.815 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:22.815 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:18:22.815 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:22.815 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:18:22.815 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:22.816 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-10-08T19:18:22.816 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:22.816 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: Deploying daemon mon.c on smithi097 2021-10-08T19:18:22.816 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: poll took 8531.353 ms: 1 events 2021-10-08T19:18:22.817 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:22.817 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.117:0/2328144542' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-10-08T19:18:22.817 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: mon.c@-1(synchronizing).paxosservice(auth 1..5) refresh upgraded, format 0 -> 3 2021-10-08T19:18:22.817 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: EVENT_LOG_v1 {"time_micros": 1633720702591083, "cf_name": "default", "job": 3, "event": "table_file_creation", "file_number": 14, "file_size": 1824713, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 1819003, "index_size": 2506, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 2245, "raw_key_size": 26435, "raw_average_key_size": 29, "raw_value_size": 1800934, "raw_average_value_size": 2014, "num_data_blocks": 118, "num_entries": 894, "num_deletions": 12, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1633720702, "oldest_key_time": 1633720702, "file_creation_time": 1633720702, "db_id": "3213b2c1-3602-409c-97c5-a6d523bc657c", "db_session_id": "O711V69B77ZYUHAV10FZ"}} 2021-10-08T19:18:22.817 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: rocksdb: [db/flush_job.cc:431] [default] [JOB 3] Level-0 flush table #14: 1824713 bytes OK 2021-10-08T19:18:22.818 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 ceph-mon[41966]: mon.c@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete,mon_osdmap_full_prune_interval,mon_osdmap_full_prune_min,mon_osdmap_full_prune_txsize 2021-10-08T19:18:22.818 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 bash[41752]: dd7b5445b0b2148eabb7f54f4a357b8651e49105753b215085048998f4b4612a 2021-10-08T19:18:22.818 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:22 smithi097 systemd[1]: Started Ceph mon.c for 1d01f6d6-286c-11ec-8c25-001a4aab830c. 2021-10-08T19:18:23.695 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2021-10-08T19:18:23.696 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph mon dump -f json 2021-10-08T19:18:27.865 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:18:27.866 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":2,"fsid":"1d01f6d6-286c-11ec-8c25-001a4aab830c","modified":"2021-10-08T19:18:22.593371Z","created":"2021-10-08T19:16:22.846745Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6789","nonce":0}]},"addr":"172.21.15.97:6789/0","public_addr":"172.21.15.97:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6790","nonce":0}]},"addr":"172.21.15.97:6790/0","public_addr":"172.21.15.97:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2021-10-08T19:18:27.867 INFO:teuthology.orchestra.run.smithi117.stderr:dumped monmap epoch 2 2021-10-08T19:18:27.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:27 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:18:27.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:27 smithi097 ceph-mon[32687]: mon.a calling monitor election 2021-10-08T19:18:27.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:27 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:18:27.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:27 smithi097 ceph-mon[32687]: poll took 2843.724 ms: 1 events 2021-10-08T19:18:27.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:27 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:18:27.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:27 smithi097 ceph-mon[32687]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:27.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:27 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:18:27.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:27 smithi097 ceph-mon[32687]: mon.c calling monitor election 2021-10-08T19:18:27.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:27 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:18:27.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:27 smithi097 ceph-mon[32687]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:27.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:27 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:18:27.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:27 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:18:27.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:27 smithi097 ceph-mon[32687]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2021-10-08T19:18:27.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:27 smithi097 ceph-mon[32687]: monmap e2: 2 mons at {a=v1:172.21.15.97:6789/0,c=v1:172.21.15.97:6790/0} 2021-10-08T19:18:27.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:27 smithi097 ceph-mon[32687]: fsmap 2021-10-08T19:18:27.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:27 smithi097 ceph-mon[32687]: osdmap e4: 0 total, 0 up, 0 in 2021-10-08T19:18:27.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:27 smithi097 ceph-mon[32687]: mgrmap e13: y(active, since 77s) 2021-10-08T19:18:27.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:27 smithi097 ceph-mon[32687]: overall HEALTH_OK 2021-10-08T19:18:27.974 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:27 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:27.974 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:27 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-10-08T19:18:27.974 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:27 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:27.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:27 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:18:27.975 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:27 smithi097 ceph-mon[41966]: mon.a calling monitor election 2021-10-08T19:18:27.975 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:27 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:18:27.975 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:27 smithi097 ceph-mon[41966]: poll took 2843.724 ms: 1 events 2021-10-08T19:18:27.975 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:27 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:18:27.976 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:27 smithi097 ceph-mon[41966]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:27.976 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:27 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:18:27.976 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:27 smithi097 ceph-mon[41966]: mon.c calling monitor election 2021-10-08T19:18:27.976 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:27 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:18:27.976 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:27 smithi097 ceph-mon[41966]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:27.977 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:27 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:18:27.977 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:27 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:18:27.977 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:27 smithi097 ceph-mon[41966]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2021-10-08T19:18:27.977 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:27 smithi097 ceph-mon[41966]: monmap e2: 2 mons at {a=v1:172.21.15.97:6789/0,c=v1:172.21.15.97:6790/0} 2021-10-08T19:18:27.978 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:27 smithi097 ceph-mon[41966]: fsmap 2021-10-08T19:18:27.978 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:27 smithi097 ceph-mon[41966]: osdmap e4: 0 total, 0 up, 0 in 2021-10-08T19:18:27.978 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:27 smithi097 ceph-mon[41966]: mgrmap e13: y(active, since 77s) 2021-10-08T19:18:27.978 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:27 smithi097 ceph-mon[41966]: overall HEALTH_OK 2021-10-08T19:18:27.979 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:27 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:27.979 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:27 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-10-08T19:18:27.979 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:27 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:28.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:28 smithi097 ceph-mon[32687]: Deploying daemon mon.b on smithi117 2021-10-08T19:18:28.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:28 smithi097 ceph-mon[32687]: poll took 4993.992 ms: 1 events 2021-10-08T19:18:28.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:28 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.117:0/4239565542' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-10-08T19:18:28.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:28 smithi097 ceph-mon[32687]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:28.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:28 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:18:28.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:28 smithi097 ceph-mon[41966]: Deploying daemon mon.b on smithi117 2021-10-08T19:18:28.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:28 smithi097 ceph-mon[41966]: poll took 4993.992 ms: 1 events 2021-10-08T19:18:28.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:28 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.117:0/4239565542' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-10-08T19:18:28.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:28 smithi097 ceph-mon[41966]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:28.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:28 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:18:29.494 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2021-10-08T19:18:29.494 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph mon dump -f json 2021-10-08T19:18:31.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:31 smithi097 ceph-mon[32687]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:31.719 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:31 smithi097 ceph-mon[41966]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:31.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:31 smithi117 systemd[1]: Starting Ceph mon.b for 1d01f6d6-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:18:32.062 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:18:32.062 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":2,"fsid":"1d01f6d6-286c-11ec-8c25-001a4aab830c","modified":"2021-10-08T19:18:22.593371Z","created":"2021-10-08T19:16:22.846745Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6789","nonce":0}]},"addr":"172.21.15.97:6789/0","public_addr":"172.21.15.97:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6790","nonce":0}]},"addr":"172.21.15.97:6790/0","public_addr":"172.21.15.97:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2021-10-08T19:18:32.063 INFO:teuthology.orchestra.run.smithi117.stderr:dumped monmap epoch 2 2021-10-08T19:18:32.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:32 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.117:0/1910819012' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-10-08T19:18:32.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:32 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.117:0/1910819012' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-10-08T19:18:32.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: set uid:gid to 167:167 (ceph:ceph) 2021-10-08T19:18:32.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: ceph version 17.0.0-8087-g103b6cc3 (103b6cc3554193fcd0852d9c647cef19e99920cf) quincy (dev), process ceph-mon, pid 7 2021-10-08T19:18:32.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: pidfile_write: ignore empty --pid-file 2021-10-08T19:18:32.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: load: jerasure load: lrc 2021-10-08T19:18:32.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: RocksDB version: 6.15.5 2021-10-08T19:18:32.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-10-08T19:18:32.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Compile date Oct 7 2021 2021-10-08T19:18:32.908 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: DB SUMMARY 2021-10-08T19:18:32.908 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: DB Session ID: WKO7A38TS17VS30E8DSV 2021-10-08T19:18:32.908 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: CURRENT file: CURRENT 2021-10-08T19:18:32.908 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: IDENTITY file: IDENTITY 2021-10-08T19:18:32.908 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: MANIFEST file: MANIFEST-000003 size: 57 Bytes 2021-10-08T19:18:32.909 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2021-10-08T19:18:32.909 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 566 ; 2021-10-08T19:18:32.909 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.error_if_exists: 0 2021-10-08T19:18:32.909 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.create_if_missing: 0 2021-10-08T19:18:32.909 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.paranoid_checks: 1 2021-10-08T19:18:32.910 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2021-10-08T19:18:32.910 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.env: 0x55b18cf24b60 2021-10-08T19:18:32.910 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.fs: Posix File System 2021-10-08T19:18:32.910 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.info_log: 0x55b18df0e100 2021-10-08T19:18:32.911 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.max_file_opening_threads: 16 2021-10-08T19:18:32.911 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.statistics: (nil) 2021-10-08T19:18:32.911 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.use_fsync: 0 2021-10-08T19:18:32.911 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.max_log_file_size: 0 2021-10-08T19:18:32.912 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.max_manifest_file_size: 1073741824 2021-10-08T19:18:32.912 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.log_file_time_to_roll: 0 2021-10-08T19:18:32.912 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.keep_log_file_num: 1000 2021-10-08T19:18:32.912 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.recycle_log_file_num: 0 2021-10-08T19:18:32.912 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.allow_fallocate: 1 2021-10-08T19:18:32.913 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.allow_mmap_reads: 0 2021-10-08T19:18:32.913 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.allow_mmap_writes: 0 2021-10-08T19:18:32.913 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.use_direct_reads: 0 2021-10-08T19:18:32.913 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-10-08T19:18:32.914 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.create_missing_column_families: 0 2021-10-08T19:18:32.914 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.db_log_dir: 2021-10-08T19:18:32.914 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-b/store.db 2021-10-08T19:18:32.915 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.table_cache_numshardbits: 6 2021-10-08T19:18:32.915 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.WAL_ttl_seconds: 0 2021-10-08T19:18:32.915 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.WAL_size_limit_MB: 0 2021-10-08T19:18:32.915 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2021-10-08T19:18:32.916 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.manifest_preallocation_size: 4194304 2021-10-08T19:18:32.916 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.is_fd_close_on_exec: 1 2021-10-08T19:18:32.916 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.advise_random_on_open: 1 2021-10-08T19:18:32.916 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.db_write_buffer_size: 0 2021-10-08T19:18:32.916 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.write_buffer_manager: 0x55b18df83e90 2021-10-08T19:18:32.917 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.access_hint_on_compaction_start: 1 2021-10-08T19:18:32.917 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-10-08T19:18:32.917 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.random_access_max_buffer_size: 1048576 2021-10-08T19:18:32.917 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.use_adaptive_mutex: 0 2021-10-08T19:18:32.918 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.rate_limiter: (nil) 2021-10-08T19:18:32.918 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-10-08T19:18:32.918 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.wal_recovery_mode: 2 2021-10-08T19:18:32.918 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.enable_thread_tracking: 0 2021-10-08T19:18:32.918 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.enable_pipelined_write: 0 2021-10-08T19:18:32.919 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.unordered_write: 0 2021-10-08T19:18:32.919 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.allow_concurrent_memtable_write: 1 2021-10-08T19:18:32.919 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-10-08T19:18:32.919 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.write_thread_max_yield_usec: 100 2021-10-08T19:18:32.919 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.write_thread_slow_yield_usec: 3 2021-10-08T19:18:32.920 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.row_cache: None 2021-10-08T19:18:32.920 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.wal_filter: None 2021-10-08T19:18:32.920 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.avoid_flush_during_recovery: 0 2021-10-08T19:18:32.920 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.allow_ingest_behind: 0 2021-10-08T19:18:32.920 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.preserve_deletes: 0 2021-10-08T19:18:32.921 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.two_write_queues: 0 2021-10-08T19:18:32.921 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.manual_wal_flush: 0 2021-10-08T19:18:32.921 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.atomic_flush: 0 2021-10-08T19:18:32.921 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-10-08T19:18:32.921 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.persist_stats_to_disk: 0 2021-10-08T19:18:32.922 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.write_dbid_to_manifest: 0 2021-10-08T19:18:32.922 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.log_readahead_size: 0 2021-10-08T19:18:32.922 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.file_checksum_gen_factory: Unknown 2021-10-08T19:18:32.922 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.best_efforts_recovery: 0 2021-10-08T19:18:32.923 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2021-10-08T19:18:32.923 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2021-10-08T19:18:32.923 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.allow_data_in_errors: 0 2021-10-08T19:18:32.923 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.db_host_id: __hostname__ 2021-10-08T19:18:32.923 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.max_background_jobs: 2 2021-10-08T19:18:32.924 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.max_background_compactions: -1 2021-10-08T19:18:32.924 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.max_subcompactions: 1 2021-10-08T19:18:32.924 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.avoid_flush_during_shutdown: 0 2021-10-08T19:18:32.924 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-10-08T19:18:32.925 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.delayed_write_rate : 16777216 2021-10-08T19:18:32.925 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.max_total_wal_size: 0 2021-10-08T19:18:32.925 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-10-08T19:18:32.925 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.stats_dump_period_sec: 600 2021-10-08T19:18:32.925 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.stats_persist_period_sec: 600 2021-10-08T19:18:32.926 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.stats_history_buffer_size: 1048576 2021-10-08T19:18:32.926 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.max_open_files: -1 2021-10-08T19:18:32.926 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.bytes_per_sync: 0 2021-10-08T19:18:32.926 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.wal_bytes_per_sync: 0 2021-10-08T19:18:32.926 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.strict_bytes_per_sync: 0 2021-10-08T19:18:32.927 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.compaction_readahead_size: 0 2021-10-08T19:18:32.927 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.max_background_flushes: -1 2021-10-08T19:18:32.927 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Compression algorithms supported: 2021-10-08T19:18:32.927 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: kZSTDNotFinalCompression supported: 0 2021-10-08T19:18:32.928 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: kZSTD supported: 0 2021-10-08T19:18:32.928 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: kXpressCompression supported: 0 2021-10-08T19:18:32.928 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: kLZ4HCCompression supported: 1 2021-10-08T19:18:32.928 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: kLZ4Compression supported: 1 2021-10-08T19:18:32.929 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: kBZip2Compression supported: 0 2021-10-08T19:18:32.930 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: kZlibCompression supported: 1 2021-10-08T19:18:32.930 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: kSnappyCompression supported: 1 2021-10-08T19:18:32.930 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Fast CRC32 supported: Supported on x86 2021-10-08T19:18:32.931 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: [db/version_set.cc:4725] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000003 2021-10-08T19:18:32.931 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: [db/column_family.cc:597] --------------- Options for column family [default]: 2021-10-08T19:18:32.931 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-10-08T19:18:32.931 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.merge_operator: 2021-10-08T19:18:32.932 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.compaction_filter: None 2021-10-08T19:18:32.932 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.compaction_filter_factory: None 2021-10-08T19:18:32.932 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.sst_partitioner_factory: None 2021-10-08T19:18:32.932 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.memtable_factory: SkipListFactory 2021-10-08T19:18:32.932 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.table_factory: BlockBasedTable 2021-10-08T19:18:32.933 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55b18ded7b80) 2021-10-08T19:18:32.933 INFO:journalctl@ceph.mon.b.smithi117.stdout: cache_index_and_filter_blocks: 1 2021-10-08T19:18:32.933 INFO:journalctl@ceph.mon.b.smithi117.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2021-10-08T19:18:32.933 INFO:journalctl@ceph.mon.b.smithi117.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2021-10-08T19:18:32.933 INFO:journalctl@ceph.mon.b.smithi117.stdout: pin_top_level_index_and_filter: 1 2021-10-08T19:18:32.934 INFO:journalctl@ceph.mon.b.smithi117.stdout: index_type: 0 2021-10-08T19:18:32.934 INFO:journalctl@ceph.mon.b.smithi117.stdout: data_block_index_type: 0 2021-10-08T19:18:32.934 INFO:journalctl@ceph.mon.b.smithi117.stdout: index_shortening: 1 2021-10-08T19:18:32.934 INFO:journalctl@ceph.mon.b.smithi117.stdout: data_block_hash_table_util_ratio: 0.750000 2021-10-08T19:18:32.935 INFO:journalctl@ceph.mon.b.smithi117.stdout: hash_index_allow_collision: 1 2021-10-08T19:18:32.935 INFO:journalctl@ceph.mon.b.smithi117.stdout: checksum: 1 2021-10-08T19:18:32.935 INFO:journalctl@ceph.mon.b.smithi117.stdout: no_block_cache: 0 2021-10-08T19:18:32.935 INFO:journalctl@ceph.mon.b.smithi117.stdout: block_cache: 0x55b18df0cd10 2021-10-08T19:18:32.935 INFO:journalctl@ceph.mon.b.smithi117.stdout: block_cache_name: BinnedLRUCache 2021-10-08T19:18:32.936 INFO:journalctl@ceph.mon.b.smithi117.stdout: block_cache_options: 2021-10-08T19:18:32.936 INFO:journalctl@ceph.mon.b.smithi117.stdout: capacity : 536870912 2021-10-08T19:18:32.936 INFO:journalctl@ceph.mon.b.smithi117.stdout: num_shard_bits : 4 2021-10-08T19:18:32.936 INFO:journalctl@ceph.mon.b.smithi117.stdout: strict_capacity_limit : 0 2021-10-08T19:18:32.937 INFO:journalctl@ceph.mon.b.smithi117.stdout: high_pri_pool_ratio: 0.000 2021-10-08T19:18:32.937 INFO:journalctl@ceph.mon.b.smithi117.stdout: block_cache_compressed: (nil) 2021-10-08T19:18:32.937 INFO:journalctl@ceph.mon.b.smithi117.stdout: persistent_cache: (nil) 2021-10-08T19:18:32.937 INFO:journalctl@ceph.mon.b.smithi117.stdout: block_size: 4096 2021-10-08T19:18:32.937 INFO:journalctl@ceph.mon.b.smithi117.stdout: block_size_deviation: 10 2021-10-08T19:18:32.938 INFO:journalctl@ceph.mon.b.smithi117.stdout: block_restart_interval: 16 2021-10-08T19:18:32.938 INFO:journalctl@ceph.mon.b.smithi117.stdout: index_block_restart_interval: 1 2021-10-08T19:18:32.938 INFO:journalctl@ceph.mon.b.smithi117.stdout: metadata_block_size: 4096 2021-10-08T19:18:32.938 INFO:journalctl@ceph.mon.b.smithi117.stdout: partition_filters: 0 2021-10-08T19:18:32.938 INFO:journalctl@ceph.mon.b.smithi117.stdout: use_delta_encoding: 1 2021-10-08T19:18:32.939 INFO:journalctl@ceph.mon.b.smithi117.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2021-10-08T19:18:32.939 INFO:journalctl@ceph.mon.b.smithi117.stdout: whole_key_filtering: 1 2021-10-08T19:18:32.939 INFO:journalctl@ceph.mon.b.smithi117.stdout: verify_compression: 0 2021-10-08T19:18:32.939 INFO:journalctl@ceph.mon.b.smithi117.stdout: read_amp_bytes_per_bit: 0 2021-10-08T19:18:32.940 INFO:journalctl@ceph.mon.b.smithi117.stdout: format_version: 4 2021-10-08T19:18:32.940 INFO:journalctl@ceph.mon.b.smithi117.stdout: enable_index_compression: 1 2021-10-08T19:18:32.940 INFO:journalctl@ceph.mon.b.smithi117.stdout: block_align: 0 2021-10-08T19:18:32.940 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.write_buffer_size: 33554432 2021-10-08T19:18:32.940 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.max_write_buffer_number: 2 2021-10-08T19:18:32.941 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.compression: NoCompression 2021-10-08T19:18:32.941 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.bottommost_compression: Disabled 2021-10-08T19:18:32.941 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.prefix_extractor: nullptr 2021-10-08T19:18:32.941 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-10-08T19:18:32.941 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.num_levels: 7 2021-10-08T19:18:32.942 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-10-08T19:18:32.942 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-10-08T19:18:32.942 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2021-10-08T19:18:32.942 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-10-08T19:18:32.943 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.bottommost_compression_opts.level: 32767 2021-10-08T19:18:32.943 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-10-08T19:18:32.943 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-10-08T19:18:32.943 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-10-08T19:18:32.943 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2021-10-08T19:18:32.944 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.bottommost_compression_opts.enabled: false 2021-10-08T19:18:32.944 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.compression_opts.window_bits: -14 2021-10-08T19:18:32.944 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.compression_opts.level: 32767 2021-10-08T19:18:32.944 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.compression_opts.strategy: 0 2021-10-08T19:18:32.945 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-10-08T19:18:32.945 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-10-08T19:18:32.945 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.compression_opts.parallel_threads: 1 2021-10-08T19:18:32.945 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.compression_opts.enabled: false 2021-10-08T19:18:32.945 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-10-08T19:18:32.946 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-10-08T19:18:32.946 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.level0_stop_writes_trigger: 36 2021-10-08T19:18:32.946 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.target_file_size_base: 67108864 2021-10-08T19:18:32.946 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.target_file_size_multiplier: 1 2021-10-08T19:18:32.947 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.max_bytes_for_level_base: 268435456 2021-10-08T19:18:32.947 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-10-08T19:18:32.947 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-10-08T19:18:32.947 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-10-08T19:18:32.947 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-10-08T19:18:32.948 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-10-08T19:18:32.948 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-10-08T19:18:32.948 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-10-08T19:18:32.948 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-10-08T19:18:32.948 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-10-08T19:18:32.949 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-10-08T19:18:32.949 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.max_compaction_bytes: 1677721600 2021-10-08T19:18:32.949 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.arena_block_size: 4194304 2021-10-08T19:18:32.949 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-10-08T19:18:32.949 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-10-08T19:18:32.950 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-10-08T19:18:32.950 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.disable_auto_compactions: 0 2021-10-08T19:18:32.950 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-10-08T19:18:32.950 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-10-08T19:18:32.951 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-10-08T19:18:32.951 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-10-08T19:18:32.951 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-10-08T19:18:32.951 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-10-08T19:18:32.951 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-10-08T19:18:32.952 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-10-08T19:18:32.952 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-10-08T19:18:32.952 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-10-08T19:18:32.952 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.table_properties_collectors: 2021-10-08T19:18:32.954 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.inplace_update_support: 0 2021-10-08T19:18:32.954 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.inplace_update_num_locks: 10000 2021-10-08T19:18:32.954 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-10-08T19:18:32.955 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.memtable_whole_key_filtering: 0 2021-10-08T19:18:32.955 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.memtable_huge_page_size: 0 2021-10-08T19:18:32.955 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.bloom_locality: 0 2021-10-08T19:18:32.955 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.max_successive_merges: 0 2021-10-08T19:18:32.956 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.optimize_filters_for_hits: 0 2021-10-08T19:18:32.956 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.paranoid_file_checks: 0 2021-10-08T19:18:32.956 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.force_consistency_checks: 1 2021-10-08T19:18:32.956 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.report_bg_io_stats: 0 2021-10-08T19:18:32.956 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.ttl: 2592000 2021-10-08T19:18:32.957 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.periodic_compaction_seconds: 0 2021-10-08T19:18:32.957 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.enable_blob_files: false 2021-10-08T19:18:32.957 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.min_blob_size: 0 2021-10-08T19:18:32.957 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.blob_file_size: 268435456 2021-10-08T19:18:32.957 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.blob_compression_type: NoCompression 2021-10-08T19:18:32.958 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.enable_blob_garbage_collection: false 2021-10-08T19:18:32.958 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2021-10-08T19:18:32.958 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: [db/version_set.cc:4773] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000003 succeeded,manifest_file_number is 3, next_file_number is 5, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-10-08T19:18:32.958 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: [db/version_set.cc:4782] Column family [default] (ID 0), log number is 0 2021-10-08T19:18:32.958 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: [db/version_set.cc:4083] Creating manifest 7 2021-10-08T19:18:32.959 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: EVENT_LOG_v1 {"time_micros": 1633720712639014, "job": 1, "event": "recovery_started", "wal_files": [4]} 2021-10-08T19:18:32.959 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: [db/db_impl/db_impl_open.cc:847] Recovering log #4 mode 2 2021-10-08T19:18:32.959 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: [table/block_based/filter_policy.cc:996] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2021-10-08T19:18:32.959 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: EVENT_LOG_v1 {"time_micros": 1633720712639269, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1600, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 578, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 456, "raw_average_value_size": 91, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1633720712, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "8f7ec363-2b6f-4096-aa3f-eee6d524fc1f", "db_session_id": "WKO7A38TS17VS30E8DSV"}} 2021-10-08T19:18:32.960 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: [db/version_set.cc:4083] Creating manifest 9 2021-10-08T19:18:32.960 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: EVENT_LOG_v1 {"time_micros": 1633720712639624, "job": 1, "event": "recovery_finished"} 2021-10-08T19:18:32.960 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: [file/delete_scheduler.cc:73] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2021-10-08T19:18:32.960 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: [db/db_impl/db_impl_open.cc:1701] SstFileManager instance 0x55b18df28a80 2021-10-08T19:18:32.960 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: DB pointer 0x55b18df38000 2021-10-08T19:18:32.961 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: [db/db_impl/db_impl.cc:902] ------- DUMPING STATS ------- 2021-10-08T19:18:32.961 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: [db/db_impl/db_impl.cc:903] 2021-10-08T19:18:32.961 INFO:journalctl@ceph.mon.b.smithi117.stdout: ** DB Stats ** 2021-10-08T19:18:32.962 INFO:journalctl@ceph.mon.b.smithi117.stdout: Uptime(secs): 0.0 total, 0.0 interval 2021-10-08T19:18:32.962 INFO:journalctl@ceph.mon.b.smithi117.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-10-08T19:18:32.962 INFO:journalctl@ceph.mon.b.smithi117.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-10-08T19:18:32.962 INFO:journalctl@ceph.mon.b.smithi117.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-10-08T19:18:32.963 INFO:journalctl@ceph.mon.b.smithi117.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-10-08T19:18:32.963 INFO:journalctl@ceph.mon.b.smithi117.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-10-08T19:18:32.963 INFO:journalctl@ceph.mon.b.smithi117.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-10-08T19:18:32.963 INFO:journalctl@ceph.mon.b.smithi117.stdout: 2021-10-08T19:18:32.963 INFO:journalctl@ceph.mon.b.smithi117.stdout: ** Compaction Stats [default] ** 2021-10-08T19:18:32.964 INFO:journalctl@ceph.mon.b.smithi117.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-10-08T19:18:32.964 INFO:journalctl@ceph.mon.b.smithi117.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-10-08T19:18:32.964 INFO:journalctl@ceph.mon.b.smithi117.stdout: L0 1/0 1.56 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 6.2 0.00 0.00 1 0.000 0 0 2021-10-08T19:18:32.964 INFO:journalctl@ceph.mon.b.smithi117.stdout: Sum 1/0 1.56 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 6.2 0.00 0.00 1 0.000 0 0 2021-10-08T19:18:32.965 INFO:journalctl@ceph.mon.b.smithi117.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 6.2 0.00 0.00 1 0.000 0 0 2021-10-08T19:18:32.965 INFO:journalctl@ceph.mon.b.smithi117.stdout: 2021-10-08T19:18:32.965 INFO:journalctl@ceph.mon.b.smithi117.stdout: ** Compaction Stats [default] ** 2021-10-08T19:18:32.965 INFO:journalctl@ceph.mon.b.smithi117.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-10-08T19:18:32.965 INFO:journalctl@ceph.mon.b.smithi117.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-10-08T19:18:32.966 INFO:journalctl@ceph.mon.b.smithi117.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 6.2 0.00 0.00 1 0.000 0 0 2021-10-08T19:18:32.966 INFO:journalctl@ceph.mon.b.smithi117.stdout: Uptime(secs): 0.0 total, 0.0 interval 2021-10-08T19:18:32.966 INFO:journalctl@ceph.mon.b.smithi117.stdout: Flush(GB): cumulative 0.000, interval 0.000 2021-10-08T19:18:32.966 INFO:journalctl@ceph.mon.b.smithi117.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2021-10-08T19:18:32.967 INFO:journalctl@ceph.mon.b.smithi117.stdout: AddFile(Total Files): cumulative 0, interval 0 2021-10-08T19:18:32.967 INFO:journalctl@ceph.mon.b.smithi117.stdout: AddFile(L0 Files): cumulative 0, interval 0 2021-10-08T19:18:32.967 INFO:journalctl@ceph.mon.b.smithi117.stdout: AddFile(Keys): cumulative 0, interval 0 2021-10-08T19:18:32.967 INFO:journalctl@ceph.mon.b.smithi117.stdout: Cumulative compaction: 0.00 GB write, 0.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-10-08T19:18:32.968 INFO:journalctl@ceph.mon.b.smithi117.stdout: Interval compaction: 0.00 GB write, 0.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-10-08T19:18:32.968 INFO:journalctl@ceph.mon.b.smithi117.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-10-08T19:18:32.968 INFO:journalctl@ceph.mon.b.smithi117.stdout: 2021-10-08T19:18:32.968 INFO:journalctl@ceph.mon.b.smithi117.stdout: ** File Read Latency Histogram By Level [default] ** 2021-10-08T19:18:32.968 INFO:journalctl@ceph.mon.b.smithi117.stdout: 2021-10-08T19:18:32.969 INFO:journalctl@ceph.mon.b.smithi117.stdout: ** Compaction Stats [default] ** 2021-10-08T19:18:32.969 INFO:journalctl@ceph.mon.b.smithi117.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-10-08T19:18:32.969 INFO:journalctl@ceph.mon.b.smithi117.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-10-08T19:18:32.969 INFO:journalctl@ceph.mon.b.smithi117.stdout: L0 1/0 1.56 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 6.2 0.00 0.00 1 0.000 0 0 2021-10-08T19:18:32.969 INFO:journalctl@ceph.mon.b.smithi117.stdout: Sum 1/0 1.56 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 6.2 0.00 0.00 1 0.000 0 0 2021-10-08T19:18:32.970 INFO:journalctl@ceph.mon.b.smithi117.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-10-08T19:18:32.970 INFO:journalctl@ceph.mon.b.smithi117.stdout: 2021-10-08T19:18:32.970 INFO:journalctl@ceph.mon.b.smithi117.stdout: ** Compaction Stats [default] ** 2021-10-08T19:18:32.970 INFO:journalctl@ceph.mon.b.smithi117.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-10-08T19:18:32.971 INFO:journalctl@ceph.mon.b.smithi117.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-10-08T19:18:32.971 INFO:journalctl@ceph.mon.b.smithi117.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 6.2 0.00 0.00 1 0.000 0 0 2021-10-08T19:18:32.971 INFO:journalctl@ceph.mon.b.smithi117.stdout: Uptime(secs): 0.0 total, 0.0 interval 2021-10-08T19:18:32.971 INFO:journalctl@ceph.mon.b.smithi117.stdout: Flush(GB): cumulative 0.000, interval 0.000 2021-10-08T19:18:32.972 INFO:journalctl@ceph.mon.b.smithi117.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2021-10-08T19:18:32.972 INFO:journalctl@ceph.mon.b.smithi117.stdout: AddFile(Total Files): cumulative 0, interval 0 2021-10-08T19:18:32.972 INFO:journalctl@ceph.mon.b.smithi117.stdout: AddFile(L0 Files): cumulative 0, interval 0 2021-10-08T19:18:32.972 INFO:journalctl@ceph.mon.b.smithi117.stdout: AddFile(Keys): cumulative 0, interval 0 2021-10-08T19:18:32.972 INFO:journalctl@ceph.mon.b.smithi117.stdout: Cumulative compaction: 0.00 GB write, 0.62 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-10-08T19:18:32.973 INFO:journalctl@ceph.mon.b.smithi117.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-10-08T19:18:32.973 INFO:journalctl@ceph.mon.b.smithi117.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-10-08T19:18:32.973 INFO:journalctl@ceph.mon.b.smithi117.stdout: 2021-10-08T19:18:32.973 INFO:journalctl@ceph.mon.b.smithi117.stdout: ** File Read Latency Histogram By Level [default] ** 2021-10-08T19:18:32.973 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: mon.b does not exist in monmap, will attempt to join an existing cluster 2021-10-08T19:18:32.974 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: using public_addrv v1:172.21.15.117:6789/0 2021-10-08T19:18:32.974 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: starting mon.b rank -1 at public addrs v1:172.21.15.117:6789/0 at bind addrs v1:172.21.15.117:6789/0 mon_data /var/lib/ceph/mon/ceph-b fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c 2021-10-08T19:18:32.974 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: mon.b@-1(???) e0 preinit fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c 2021-10-08T19:18:32.974 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: [db/db_impl/db_impl_write.cc:1739] [default] New memtable created with log file: #13. Immutable memtables: 0. 2021-10-08T19:18:32.975 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: (Original Log Time 2021/10/08-19:18:32.655807) [db/db_impl/db_impl_compaction_flush.cc:2402] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots available 1, flush slots scheduled 1, compaction slots scheduled 0 2021-10-08T19:18:32.975 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: [db/flush_job.cc:338] [default] [JOB 3] Flushing memtable with next log file: 13 2021-10-08T19:18:32.975 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: EVENT_LOG_v1 {"time_micros": 1633720712655978, "job": 3, "event": "flush_started", "num_memtables": 1, "num_entries": 1337, "num_deletes": 12, "total_data_size": 2095859, "memory_usage": 2120680, "flush_reason": "Manual Compaction"} 2021-10-08T19:18:32.975 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: [db/flush_job.cc:367] [default] [JOB 3] Level-0 flush table #14: started 2021-10-08T19:18:32.975 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: mon.b@-1(synchronizing).mds e1 new map 2021-10-08T19:18:32.976 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: mon.b@-1(synchronizing).mds e1 print_map 2021-10-08T19:18:32.976 INFO:journalctl@ceph.mon.b.smithi117.stdout: e1 2021-10-08T19:18:32.976 INFO:journalctl@ceph.mon.b.smithi117.stdout: enable_multiple, ever_enabled_multiple: 1,1 2021-10-08T19:18:32.976 INFO:journalctl@ceph.mon.b.smithi117.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-10-08T19:18:32.976 INFO:journalctl@ceph.mon.b.smithi117.stdout: legacy client fscid: -1 2021-10-08T19:18:32.977 INFO:journalctl@ceph.mon.b.smithi117.stdout: 2021-10-08T19:18:32.977 INFO:journalctl@ceph.mon.b.smithi117.stdout: No filesystems configured 2021-10-08T19:18:32.977 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2021-10-08T19:18:32.977 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2021-10-08T19:18:32.977 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2021-10-08T19:18:32.978 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2021-10-08T19:18:32.978 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2021-10-08T19:18:32.978 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2021-10-08T19:18:32.978 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2021-10-08T19:18:32.979 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2021-10-08T19:18:32.979 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2021-10-08T19:18:32.979 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2021-10-08T19:18:32.979 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:32.979 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:32.980 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:32.980 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:32.980 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:32.980 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:18:32.981 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: 172.21.15.97 - - [08/Oct/2021:19:17:51] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:18:32.981 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:32.981 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:32.981 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:32.981 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:32.982 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:32.982 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:32.982 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:32.982 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:32.982 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:32.983 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: from='client.14172 v1:172.21.15.117:0/3530416354' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi117", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:18:32.983 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: poll took 47344.690 ms: 1 events 2021-10-08T19:18:32.983 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:32.983 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:18:32.984 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:32.984 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:18:32.984 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: Deploying cephadm binary to smithi117 2021-10-08T19:18:32.984 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: Executing () created at /lib/python3.6/site-packages/asyncssh/channel.py:596> took 0.155 seconds 2021-10-08T19:18:32.984 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: Executing took 0.141 seconds 2021-10-08T19:18:32.985 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: Added host smithi117 2021-10-08T19:18:32.985 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:32.985 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:32.985 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi117", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:18:32.985 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:32.986 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi117", "caps": []}]: dispatch 2021-10-08T19:18:32.986 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.agent.smithi117", "caps": []}]': finished 2021-10-08T19:18:32.986 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:18:32.986 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:18:32.987 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:18:32.987 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: Deploying daemon agent.smithi117 on smithi117 2021-10-08T19:18:32.987 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:32.987 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: Executing () created at /lib/python3.6/site-packages/asyncssh/channel.py:596> took 0.167 seconds 2021-10-08T19:18:32.987 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:32.988 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:18:32.988 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:32.988 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:18:32.988 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:32.989 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:32.989 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:18:32.989 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:32.989 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:18:32.989 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:32.990 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: Updating smithi117:/etc/ceph/ceph.conf 2021-10-08T19:18:32.990 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: Updating smithi117:/etc/ceph/ceph.client.admin.keyring 2021-10-08T19:18:32.990 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:18:32.990 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:18:32.991 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: from='client.14174 v1:172.21.15.117:0/1380967349' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:18:32.991 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:32.991 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:32.991 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:32.991 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:32.992 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:18:32.992 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: 172.21.15.97 - - [08/Oct/2021:19:18:15] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:18:32.992 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: Sending message to agent on host smithi117 2021-10-08T19:18:32.992 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: 172.21.15.117 - - [08/Oct/2021:19:18:15] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:18:32.993 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1773808900' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2021-10-08T19:18:32.993 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: Received "ACK" from agent on host smithi117 2021-10-08T19:18:32.993 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:32.993 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1773808900' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2021-10-08T19:18:32.993 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: osdmap e4: 0 total, 0 up, 0 in 2021-10-08T19:18:32.994 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:32.994 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:32.994 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:18:32.994 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:18:32.995 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:18:32.995 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: 172.21.15.117 - - [08/Oct/2021:19:18:19] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:18:32.995 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:32.995 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:18:32.995 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:32.996 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: from='client.14178 v1:172.21.15.117:0/2951155805' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi097:[v1:172.21.15.97:6789]=a;smithi097:[v1:172.21.15.97:6790]=c;smithi117:[v1:172.21.15.117:6789]=b", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:18:32.996 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: Saving service mon spec with placement smithi097:[v1:172.21.15.97:6789]=a;smithi097:[v1:172.21.15.97:6790]=c;smithi117:[v1:172.21.15.117:6789]=b;count:3 2021-10-08T19:18:32.996 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:32.996 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:18:32.996 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:32.997 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:18:32.997 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:32.997 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-10-08T19:18:32.997 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:32.998 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: Deploying daemon mon.c on smithi097 2021-10-08T19:18:32.998 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: poll took 8531.353 ms: 1 events 2021-10-08T19:18:32.998 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:32.998 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.117:0/2328144542' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-10-08T19:18:32.998 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:18:32.999 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: mon.a calling monitor election 2021-10-08T19:18:32.999 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:18:32.999 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: poll took 2843.724 ms: 1 events 2021-10-08T19:18:32.999 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:18:33.000 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:33.000 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:18:33.000 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: mon.c calling monitor election 2021-10-08T19:18:33.000 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:18:33.000 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:33.001 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:18:33.001 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:18:33.001 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2021-10-08T19:18:33.001 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: monmap e2: 2 mons at {a=v1:172.21.15.97:6789/0,c=v1:172.21.15.97:6790/0} 2021-10-08T19:18:33.002 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: fsmap 2021-10-08T19:18:33.002 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: osdmap e4: 0 total, 0 up, 0 in 2021-10-08T19:18:33.002 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: mgrmap e13: y(active, since 77s) 2021-10-08T19:18:33.002 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: overall HEALTH_OK 2021-10-08T19:18:33.002 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:33.003 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-10-08T19:18:33.003 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:33.003 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: Deploying daemon mon.b on smithi117 2021-10-08T19:18:33.003 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: poll took 4993.992 ms: 1 events 2021-10-08T19:18:33.003 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.117:0/4239565542' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-10-08T19:18:33.004 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:33.004 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:18:33.004 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:33.004 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.117:0/1910819012' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-10-08T19:18:33.005 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: mon.b@-1(synchronizing).paxosservice(auth 1..6) refresh upgraded, format 0 -> 3 2021-10-08T19:18:33.005 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: EVENT_LOG_v1 {"time_micros": 1633720712659071, "cf_name": "default", "job": 3, "event": "table_file_creation", "file_number": 14, "file_size": 1863889, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 1857956, "index_size": 2601, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 2373, "raw_key_size": 27167, "raw_average_key_size": 29, "raw_value_size": 1839368, "raw_average_value_size": 1990, "num_data_blocks": 123, "num_entries": 924, "num_deletions": 12, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1633720712, "oldest_key_time": 1633720712, "file_creation_time": 1633720712, "db_id": "8f7ec363-2b6f-4096-aa3f-eee6d524fc1f", "db_session_id": "WKO7A38TS17VS30E8DSV"}} 2021-10-08T19:18:33.005 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: rocksdb: [db/flush_job.cc:431] [default] [JOB 3] Level-0 flush table #14: 1863889 bytes OK 2021-10-08T19:18:33.005 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 ceph-mon[34585]: mon.b@-1(synchronizing) e2 handle_conf_change mon_allow_pool_delete,mon_osdmap_full_prune_interval,mon_osdmap_full_prune_min,mon_osdmap_full_prune_txsize 2021-10-08T19:18:33.005 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 bash[34298]: 32f4b15cf9fb9e2802530a7206349e01243fbcf7094c8ceeff451e1fba109c01 2021-10-08T19:18:33.006 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:32 smithi117 systemd[1]: Started Ceph mon.b for 1d01f6d6-286c-11ec-8c25-001a4aab830c. 2021-10-08T19:18:33.828 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2021-10-08T19:18:33.829 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph mon dump -f json 2021-10-08T19:18:37.933 INFO:teuthology.orchestra.run.smithi117.stdout: 2021-10-08T19:18:37.933 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":3,"fsid":"1d01f6d6-286c-11ec-8c25-001a4aab830c","modified":"2021-10-08T19:18:32.662143Z","created":"2021-10-08T19:16:22.846745Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6789","nonce":0}]},"addr":"172.21.15.97:6789/0","public_addr":"172.21.15.97:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6790","nonce":0}]},"addr":"172.21.15.97:6790/0","public_addr":"172.21.15.97:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2021-10-08T19:18:37.935 INFO:teuthology.orchestra.run.smithi117.stderr:dumped monmap epoch 3 2021-10-08T19:18:38.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:37 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:18:38.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:37 smithi117 ceph-mon[34585]: mon.a calling monitor election 2021-10-08T19:18:38.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:37 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:18:38.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:37 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:18:38.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:37 smithi117 ceph-mon[34585]: mon.c calling monitor election 2021-10-08T19:18:38.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:37 smithi117 ceph-mon[34585]: poll took 4674.012 ms: 1 events 2021-10-08T19:18:38.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:37 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:18:38.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:37 smithi117 ceph-mon[34585]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:38.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:37 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:18:38.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:37 smithi117 ceph-mon[34585]: mon.b calling monitor election 2021-10-08T19:18:38.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:37 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:18:38.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:37 smithi117 ceph-mon[34585]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:38.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:37 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:18:38.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:37 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:18:38.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:37 smithi117 ceph-mon[34585]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-10-08T19:18:38.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:37 smithi117 ceph-mon[34585]: monmap e3: 3 mons at {a=v1:172.21.15.97:6789/0,b=v1:172.21.15.117:6789/0,c=v1:172.21.15.97:6790/0} 2021-10-08T19:18:38.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:37 smithi117 ceph-mon[34585]: fsmap 2021-10-08T19:18:38.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:37 smithi117 ceph-mon[34585]: osdmap e4: 0 total, 0 up, 0 in 2021-10-08T19:18:38.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:37 smithi117 ceph-mon[34585]: mgrmap e13: y(active, since 87s) 2021-10-08T19:18:38.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:37 smithi117 ceph-mon[34585]: overall HEALTH_OK 2021-10-08T19:18:38.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:37 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:38.160 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:37 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:18:38.160 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:37 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:38.160 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:37 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:18:38.219 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:37 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:18:38.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:37 smithi097 ceph-mon[32687]: mon.a calling monitor election 2021-10-08T19:18:38.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:37 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:18:38.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:37 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:18:38.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:37 smithi097 ceph-mon[32687]: mon.c calling monitor election 2021-10-08T19:18:38.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:37 smithi097 ceph-mon[32687]: poll took 4674.012 ms: 1 events 2021-10-08T19:18:38.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:37 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:18:38.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:37 smithi097 ceph-mon[32687]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:38.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:37 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:18:38.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:37 smithi097 ceph-mon[32687]: mon.b calling monitor election 2021-10-08T19:18:38.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:37 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:18:38.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:37 smithi097 ceph-mon[32687]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:38.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:37 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:18:38.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:37 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:18:38.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:37 smithi097 ceph-mon[32687]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-10-08T19:18:38.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:37 smithi097 ceph-mon[32687]: monmap e3: 3 mons at {a=v1:172.21.15.97:6789/0,b=v1:172.21.15.117:6789/0,c=v1:172.21.15.97:6790/0} 2021-10-08T19:18:38.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:37 smithi097 ceph-mon[32687]: fsmap 2021-10-08T19:18:38.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:37 smithi097 ceph-mon[32687]: osdmap e4: 0 total, 0 up, 0 in 2021-10-08T19:18:38.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:37 smithi097 ceph-mon[32687]: mgrmap e13: y(active, since 87s) 2021-10-08T19:18:38.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:37 smithi097 ceph-mon[32687]: overall HEALTH_OK 2021-10-08T19:18:38.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:37 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:38.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:37 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:18:38.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:37 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:38.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:37 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:18:38.225 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:37 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:18:38.225 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:37 smithi097 ceph-mon[41966]: mon.a calling monitor election 2021-10-08T19:18:38.225 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:37 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:18:38.226 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:37 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:18:38.226 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:37 smithi097 ceph-mon[41966]: mon.c calling monitor election 2021-10-08T19:18:38.226 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:37 smithi097 ceph-mon[41966]: poll took 4674.012 ms: 1 events 2021-10-08T19:18:38.226 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:37 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:18:38.227 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:37 smithi097 ceph-mon[41966]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:38.227 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:37 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:18:38.227 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:37 smithi097 ceph-mon[41966]: mon.b calling monitor election 2021-10-08T19:18:38.227 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:37 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:18:38.227 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:37 smithi097 ceph-mon[41966]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:38.228 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:37 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:18:38.228 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:37 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:18:38.228 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:37 smithi097 ceph-mon[41966]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-10-08T19:18:38.228 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:37 smithi097 ceph-mon[41966]: monmap e3: 3 mons at {a=v1:172.21.15.97:6789/0,b=v1:172.21.15.117:6789/0,c=v1:172.21.15.97:6790/0} 2021-10-08T19:18:38.228 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:37 smithi097 ceph-mon[41966]: fsmap 2021-10-08T19:18:38.229 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:37 smithi097 ceph-mon[41966]: osdmap e4: 0 total, 0 up, 0 in 2021-10-08T19:18:38.229 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:37 smithi097 ceph-mon[41966]: mgrmap e13: y(active, since 87s) 2021-10-08T19:18:38.229 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:37 smithi097 ceph-mon[41966]: overall HEALTH_OK 2021-10-08T19:18:38.229 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:37 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:38.230 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:37 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:18:38.230 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:37 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:38.230 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:37 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:18:38.500 INFO:tasks.cephadm:Generating final ceph.conf file... 2021-10-08T19:18:38.501 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph config generate-minimal-conf 2021-10-08T19:18:39.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:38 smithi117 ceph-mon[34585]: Sending message to agent on host smithi097 2021-10-08T19:18:39.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:38 smithi117 ceph-mon[34585]: Sending message to agent on host smithi117 2021-10-08T19:18:39.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:38 smithi117 ceph-mon[34585]: Updating smithi097:/etc/ceph/ceph.conf 2021-10-08T19:18:39.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:38 smithi117 ceph-mon[34585]: Updating smithi117:/etc/ceph/ceph.conf 2021-10-08T19:18:39.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:38 smithi117 ceph-mon[34585]: poll took 4872.106 ms: 1 events 2021-10-08T19:18:39.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:38 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:39.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:38 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:39.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:38 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:39.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:38 smithi117 ceph-mon[34585]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:18:39.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:38 smithi117 ceph-mon[34585]: Reconfiguring mon.a (unknown last config time)... 2021-10-08T19:18:39.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:38 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-10-08T19:18:39.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:38 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-10-08T19:18:39.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:38 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:39.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:38 smithi117 ceph-mon[34585]: Reconfiguring daemon mon.a on smithi097 2021-10-08T19:18:39.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:38 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.117:0/3067692513' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-10-08T19:18:39.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:38 smithi117 ceph-mon[34585]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:39.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:38 smithi117 ceph-mon[34585]: Received "ACK" from agent on host smithi117 2021-10-08T19:18:39.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:38 smithi117 ceph-mon[34585]: Received "ACK" from agent on host smithi097 2021-10-08T19:18:39.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:38 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:18:39.219 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:18:38 smithi097 conmon[33110]: 172.21.15.97 - - [08/Oct/2021:19:18:38] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:18:39.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:38 smithi097 ceph-mon[32687]: Sending message to agent on host smithi097 2021-10-08T19:18:39.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:38 smithi097 ceph-mon[32687]: Sending message to agent on host smithi117 2021-10-08T19:18:39.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:38 smithi097 ceph-mon[32687]: Updating smithi097:/etc/ceph/ceph.conf 2021-10-08T19:18:39.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:38 smithi097 ceph-mon[32687]: Updating smithi117:/etc/ceph/ceph.conf 2021-10-08T19:18:39.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:38 smithi097 ceph-mon[32687]: poll took 4872.106 ms: 1 events 2021-10-08T19:18:39.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:38 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:39.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:38 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:39.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:38 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:39.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:38 smithi097 ceph-mon[32687]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:18:39.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:38 smithi097 ceph-mon[32687]: Reconfiguring mon.a (unknown last config time)... 2021-10-08T19:18:39.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:38 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-10-08T19:18:39.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:38 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-10-08T19:18:39.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:38 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:39.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:38 smithi097 ceph-mon[32687]: Reconfiguring daemon mon.a on smithi097 2021-10-08T19:18:39.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:38 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.117:0/3067692513' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-10-08T19:18:39.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:38 smithi097 ceph-mon[32687]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:39.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:38 smithi097 ceph-mon[32687]: Received "ACK" from agent on host smithi117 2021-10-08T19:18:39.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:38 smithi097 ceph-mon[32687]: Received "ACK" from agent on host smithi097 2021-10-08T19:18:39.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:38 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:18:39.225 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:38 smithi097 ceph-mon[41966]: Sending message to agent on host smithi097 2021-10-08T19:18:39.225 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:38 smithi097 ceph-mon[41966]: Sending message to agent on host smithi117 2021-10-08T19:18:39.225 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:38 smithi097 ceph-mon[41966]: Updating smithi097:/etc/ceph/ceph.conf 2021-10-08T19:18:39.225 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:38 smithi097 ceph-mon[41966]: Updating smithi117:/etc/ceph/ceph.conf 2021-10-08T19:18:39.226 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:38 smithi097 ceph-mon[41966]: poll took 4872.106 ms: 1 events 2021-10-08T19:18:39.226 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:38 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:39.226 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:38 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:39.226 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:38 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:39.227 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:38 smithi097 ceph-mon[41966]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:18:39.227 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:38 smithi097 ceph-mon[41966]: Reconfiguring mon.a (unknown last config time)... 2021-10-08T19:18:39.227 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:38 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-10-08T19:18:39.227 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:38 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-10-08T19:18:39.228 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:38 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:39.228 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:38 smithi097 ceph-mon[41966]: Reconfiguring daemon mon.a on smithi097 2021-10-08T19:18:39.228 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:38 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.117:0/3067692513' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-10-08T19:18:39.228 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:38 smithi097 ceph-mon[41966]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:39.228 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:38 smithi097 ceph-mon[41966]: Received "ACK" from agent on host smithi117 2021-10-08T19:18:39.229 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:38 smithi097 ceph-mon[41966]: Received "ACK" from agent on host smithi097 2021-10-08T19:18:39.229 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:38 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:18:40.013 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:39 smithi097 ceph-mon[41966]: Received old metadata from agent on host smithi097. Requested up-to-date metadata. 2021-10-08T19:18:40.014 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:39 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:40.014 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:39 smithi097 ceph-mon[41966]: 172.21.15.97 - - [08/Oct/2021:19:18:38] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:18:40.014 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:39 smithi097 ceph-mon[41966]: poll took 1314.480 ms: 1 events 2021-10-08T19:18:40.015 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:39 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:40.015 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:39 smithi097 ceph-mon[41966]: Reconfiguring mon.c (monmap changed)... 2021-10-08T19:18:40.015 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:39 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-10-08T19:18:40.015 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:39 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-10-08T19:18:40.016 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:39 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:40.016 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:39 smithi097 ceph-mon[41966]: Reconfiguring daemon mon.c on smithi097 2021-10-08T19:18:40.017 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:39 smithi097 ceph-mon[32687]: Received old metadata from agent on host smithi097. Requested up-to-date metadata. 2021-10-08T19:18:40.017 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:39 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:40.017 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:39 smithi097 ceph-mon[32687]: 172.21.15.97 - - [08/Oct/2021:19:18:38] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:18:40.018 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:39 smithi097 ceph-mon[32687]: poll took 1314.480 ms: 1 events 2021-10-08T19:18:40.018 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:39 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:40.018 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:39 smithi097 ceph-mon[32687]: Reconfiguring mon.c (monmap changed)... 2021-10-08T19:18:40.018 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:39 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-10-08T19:18:40.019 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:39 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-10-08T19:18:40.019 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:39 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:40.019 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:39 smithi097 ceph-mon[32687]: Reconfiguring daemon mon.c on smithi097 2021-10-08T19:18:40.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:39 smithi117 ceph-mon[34585]: Received old metadata from agent on host smithi097. Requested up-to-date metadata. 2021-10-08T19:18:40.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:39 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:40.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:39 smithi117 ceph-mon[34585]: 172.21.15.97 - - [08/Oct/2021:19:18:38] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:18:40.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:39 smithi117 ceph-mon[34585]: poll took 1314.480 ms: 1 events 2021-10-08T19:18:40.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:39 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:40.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:39 smithi117 ceph-mon[34585]: Reconfiguring mon.c (monmap changed)... 2021-10-08T19:18:40.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:39 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-10-08T19:18:40.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:39 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-10-08T19:18:40.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:39 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:40.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:39 smithi117 ceph-mon[34585]: Reconfiguring daemon mon.c on smithi097 2021-10-08T19:18:41.450 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:41 smithi097 ceph-mon[32687]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:41.450 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:41 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:41.450 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:41 smithi097 ceph-mon[41966]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:41.451 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:41 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:41.654 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:41 smithi117 ceph-mon[34585]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:41.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:41 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:41.862 INFO:teuthology.orchestra.run.smithi097.stdout:# minimal ceph.conf for 1d01f6d6-286c-11ec-8c25-001a4aab830c 2021-10-08T19:18:41.862 INFO:teuthology.orchestra.run.smithi097.stdout:[global] 2021-10-08T19:18:41.862 INFO:teuthology.orchestra.run.smithi097.stdout: fsid = 1d01f6d6-286c-11ec-8c25-001a4aab830c 2021-10-08T19:18:41.863 INFO:teuthology.orchestra.run.smithi097.stdout: mon_host = 172.21.15.97:6789/0 172.21.15.117:6789/0 v1:172.21.15.97:6790/0 2021-10-08T19:18:42.219 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:18:41 smithi097 conmon[33110]: 172.21.15.117 - - [08/Oct/2021:19:18:41] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:18:42.468 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2021-10-08T19:18:42.468 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2021-10-08T19:18:42.469 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/ceph/ceph.conf 2021-10-08T19:18:42.496 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2021-10-08T19:18:42.497 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2021-10-08T19:18:42.549 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:42 smithi097 ceph-mon[32687]: poll took 1480.467 ms: 1 events 2021-10-08T19:18:42.549 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:42 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:42.549 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:42 smithi097 ceph-mon[32687]: Reconfiguring mon.b (monmap changed)... 2021-10-08T19:18:42.550 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:42 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-10-08T19:18:42.550 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:42 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-10-08T19:18:42.550 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:42 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:42.550 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:42 smithi097 ceph-mon[32687]: Reconfiguring daemon mon.b on smithi117 2021-10-08T19:18:42.551 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:42 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2330489322' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:42.551 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:42 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:42.551 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:42 smithi097 ceph-mon[41966]: poll took 1480.467 ms: 1 events 2021-10-08T19:18:42.551 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:42 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:42.552 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:42 smithi097 ceph-mon[41966]: Reconfiguring mon.b (monmap changed)... 2021-10-08T19:18:42.552 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:42 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-10-08T19:18:42.552 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:42 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-10-08T19:18:42.552 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:42 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:42.553 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:42 smithi097 ceph-mon[41966]: Reconfiguring daemon mon.b on smithi117 2021-10-08T19:18:42.553 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:42 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2330489322' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:42.553 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:42 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:42.559 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2021-10-08T19:18:42.560 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/ceph/ceph.conf 2021-10-08T19:18:42.589 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:42 smithi117 ceph-mon[34585]: poll took 1480.467 ms: 1 events 2021-10-08T19:18:42.589 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:42 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:42.590 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:42 smithi117 ceph-mon[34585]: Reconfiguring mon.b (monmap changed)... 2021-10-08T19:18:42.590 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:42 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-10-08T19:18:42.590 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:42 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-10-08T19:18:42.590 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:42 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:42.591 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:42 smithi117 ceph-mon[34585]: Reconfiguring daemon mon.b on smithi117 2021-10-08T19:18:42.591 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:42 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2330489322' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:42.591 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:42 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:42.592 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2021-10-08T19:18:42.593 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2021-10-08T19:18:42.656 INFO:tasks.cephadm:Adding mgr.y on smithi097 2021-10-08T19:18:42.656 INFO:tasks.cephadm:Adding mgr.x on smithi117 2021-10-08T19:18:42.657 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph orch apply mgr '2;smithi097=y;smithi117=x' 2021-10-08T19:18:43.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:43 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:18:43.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:43 smithi117 ceph-mon[34585]: 172.21.15.117 - - [08/Oct/2021:19:18:41] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:18:43.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:43 smithi117 ceph-mon[34585]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:43.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:43 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:43.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:43 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:18:43.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:43 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:43.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:43 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:18:43.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:43 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:43.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:43 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:18:43.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:43 smithi097 ceph-mon[32687]: 172.21.15.117 - - [08/Oct/2021:19:18:41] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:18:43.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:43 smithi097 ceph-mon[32687]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:43.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:43 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:43.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:43 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:18:43.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:43 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:43.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:43 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:18:43.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:43 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:43.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:43 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:18:43.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:43 smithi097 ceph-mon[41966]: 172.21.15.117 - - [08/Oct/2021:19:18:41] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:18:43.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:43 smithi097 ceph-mon[41966]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:43.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:43 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:43.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:43 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:18:43.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:43 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:43.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:43 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:18:43.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:43 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:44.219 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:18:43 smithi097 conmon[33110]: 172.21.15.97 - - [08/Oct/2021:19:18:43] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:18:44.546 INFO:teuthology.orchestra.run.smithi117.stdout:Scheduled mgr update... 2021-10-08T19:18:44.577 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:44 smithi117 ceph-mon[34585]: poll took 1318.892 ms: 1 events 2021-10-08T19:18:44.577 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:44 smithi117 ceph-mon[34585]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:18:44.577 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:44 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:44.577 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:44 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:18:44.578 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:44 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:44.578 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:44 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:18:44.578 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:44 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:44.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:44 smithi097 ceph-mon[32687]: poll took 1318.892 ms: 1 events 2021-10-08T19:18:44.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:44 smithi097 ceph-mon[32687]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:18:44.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:44 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:44.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:44 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:18:44.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:44 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:44.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:44 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:18:44.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:44 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:44.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:44 smithi097 ceph-mon[41966]: poll took 1318.892 ms: 1 events 2021-10-08T19:18:44.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:44 smithi097 ceph-mon[41966]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:18:44.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:44 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:44.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:44 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:18:44.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:44 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:44.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:44 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:18:44.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:44 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:45.116 DEBUG:teuthology.orchestra.run.smithi117:mgr.x> sudo journalctl -f -n 0 -u ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@mgr.x.service 2021-10-08T19:18:45.118 INFO:tasks.cephadm:Deploying OSDs... 2021-10-08T19:18:45.119 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2021-10-08T19:18:45.119 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/scratch_devs of=/dev/stdout 2021-10-08T19:18:45.138 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-10-08T19:18:45.138 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-10-08T19:18:45.144 INFO:journalctl@ceph.mgr.x.smithi117.stdout:-- Logs begin at Fri 2021-10-08 19:07:21 UTC. -- 2021-10-08T19:18:45.195 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-10-08T19:18:45.195 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-10-08T19:18:45.196 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 6h/6d Inode: 106269 Links: 1 2021-10-08T19:18:45.196 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-10-08T19:18:45.196 INFO:teuthology.orchestra.run.smithi097.stdout:Context: system_u:object_r:device_t:s0 2021-10-08T19:18:45.196 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2021-10-08 19:18:42.444931597 +0000 2021-10-08T19:18:45.197 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2021-10-08 19:11:53.943548608 +0000 2021-10-08T19:18:45.197 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2021-10-08 19:11:53.943548608 +0000 2021-10-08T19:18:45.197 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: - 2021-10-08T19:18:45.208 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2021-10-08T19:18:45.209 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2021-10-08T19:18:45.209 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.000254299 s, 2.0 MB/s 2021-10-08T19:18:45.212 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-10-08T19:18:45.269 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-10-08T19:18:45.269 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-10-08T19:18:45.269 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 6h/6d Inode: 106320 Links: 1 2021-10-08T19:18:45.269 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-10-08T19:18:45.270 INFO:teuthology.orchestra.run.smithi097.stdout:Context: system_u:object_r:device_t:s0 2021-10-08T19:18:45.270 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2021-10-08 19:18:42.444931597 +0000 2021-10-08T19:18:45.270 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2021-10-08 19:11:54.293543071 +0000 2021-10-08T19:18:45.270 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2021-10-08 19:11:54.293543071 +0000 2021-10-08T19:18:45.271 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: - 2021-10-08T19:18:45.279 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2021-10-08T19:18:45.280 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2021-10-08T19:18:45.280 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.000219147 s, 2.3 MB/s 2021-10-08T19:18:45.283 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-10-08T19:18:45.339 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-10-08T19:18:45.340 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-10-08T19:18:45.340 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 6h/6d Inode: 110221 Links: 1 2021-10-08T19:18:45.340 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-10-08T19:18:45.340 INFO:teuthology.orchestra.run.smithi097.stdout:Context: system_u:object_r:device_t:s0 2021-10-08T19:18:45.341 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2021-10-08 19:18:42.444931597 +0000 2021-10-08T19:18:45.341 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2021-10-08 19:11:54.630537739 +0000 2021-10-08T19:18:45.341 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2021-10-08 19:11:54.630537739 +0000 2021-10-08T19:18:45.341 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: - 2021-10-08T19:18:45.350 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2021-10-08T19:18:45.350 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2021-10-08T19:18:45.350 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.000225026 s, 2.3 MB/s 2021-10-08T19:18:45.353 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-10-08T19:18:45.409 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-10-08T19:18:45.409 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-10-08T19:18:45.410 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 6h/6d Inode: 109155 Links: 1 2021-10-08T19:18:45.410 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-10-08T19:18:45.410 INFO:teuthology.orchestra.run.smithi097.stdout:Context: system_u:object_r:device_t:s0 2021-10-08T19:18:45.410 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2021-10-08 19:18:42.444931597 +0000 2021-10-08T19:18:45.411 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2021-10-08 19:11:54.983532154 +0000 2021-10-08T19:18:45.411 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2021-10-08 19:11:54.983532154 +0000 2021-10-08T19:18:45.411 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: - 2021-10-08T19:18:45.419 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2021-10-08T19:18:45.419 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2021-10-08T19:18:45.419 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.000166966 s, 3.1 MB/s 2021-10-08T19:18:45.422 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2021-10-08T19:18:45.423 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/scratch_devs of=/dev/stdout 2021-10-08T19:18:45.440 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-10-08T19:18:45.440 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-10-08T19:18:45.495 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-10-08T19:18:45.495 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-10-08T19:18:45.496 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 6h/6d Inode: 110028 Links: 1 2021-10-08T19:18:45.496 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-10-08T19:18:45.496 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2021-10-08T19:18:45.496 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2021-10-08 19:18:40.400792531 +0000 2021-10-08T19:18:45.496 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2021-10-08 19:11:53.947121133 +0000 2021-10-08T19:18:45.497 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2021-10-08 19:11:53.947121133 +0000 2021-10-08T19:18:45.497 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: - 2021-10-08T19:18:45.505 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2021-10-08T19:18:45.505 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2021-10-08T19:18:45.506 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000213349 s, 2.4 MB/s 2021-10-08T19:18:45.508 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-10-08T19:18:45.562 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-10-08T19:18:45.562 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-10-08T19:18:45.563 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 6h/6d Inode: 107482 Links: 1 2021-10-08T19:18:45.563 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-10-08T19:18:45.563 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2021-10-08T19:18:45.563 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2021-10-08 19:18:40.400792531 +0000 2021-10-08T19:18:45.564 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2021-10-08 19:11:54.298114040 +0000 2021-10-08T19:18:45.564 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2021-10-08 19:11:54.298114040 +0000 2021-10-08T19:18:45.564 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: - 2021-10-08T19:18:45.572 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2021-10-08T19:18:45.572 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2021-10-08T19:18:45.572 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000190811 s, 2.7 MB/s 2021-10-08T19:18:45.574 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-10-08T19:18:45.628 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-10-08T19:18:45.628 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-10-08T19:18:45.629 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 6h/6d Inode: 111689 Links: 1 2021-10-08T19:18:45.629 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-10-08T19:18:45.629 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2021-10-08T19:18:45.629 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2021-10-08 19:18:40.400792531 +0000 2021-10-08T19:18:45.629 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2021-10-08 19:11:54.639107149 +0000 2021-10-08T19:18:45.630 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2021-10-08 19:11:54.639107149 +0000 2021-10-08T19:18:45.630 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: - 2021-10-08T19:18:45.635 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:45 smithi117 ceph-mon[34585]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:18:45.636 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:45 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:18:45.636 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:45 smithi117 ceph-mon[34585]: 172.21.15.97 - - [08/Oct/2021:19:18:43] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:18:45.636 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:45 smithi117 ceph-mon[34585]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:45.637 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:45 smithi117 ceph-mon[34585]: from='client.34103 v1:172.21.15.117:0/3921755161' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi097=y;smithi117=x", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:18:45.637 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:45 smithi117 ceph-mon[34585]: Saving service mgr spec with placement smithi097=y;smithi117=x;count:2 2021-10-08T19:18:45.637 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:45 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:45.638 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:45 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:18:45.638 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:45 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:45.638 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:45 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:18:45.638 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:45 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:45.639 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:45 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-10-08T19:18:45.639 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:45 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-10-08T19:18:45.639 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:45 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2021-10-08T19:18:45.639 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:45 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:45.640 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2021-10-08T19:18:45.641 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2021-10-08T19:18:45.641 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000204592 s, 2.5 MB/s 2021-10-08T19:18:45.641 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-10-08T19:18:45.695 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-10-08T19:18:45.695 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-10-08T19:18:45.695 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 6h/6d Inode: 113709 Links: 1 2021-10-08T19:18:45.696 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-10-08T19:18:45.696 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2021-10-08T19:18:45.696 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2021-10-08 19:18:40.400792531 +0000 2021-10-08T19:18:45.696 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2021-10-08 19:11:54.971100440 +0000 2021-10-08T19:18:45.697 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2021-10-08 19:11:54.971100440 +0000 2021-10-08T19:18:45.697 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: - 2021-10-08T19:18:45.704 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2021-10-08T19:18:45.704 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2021-10-08T19:18:45.705 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000183698 s, 2.8 MB/s 2021-10-08T19:18:45.707 INFO:tasks.cephadm:Deploying osd.0 on smithi097 with /dev/vg_nvme/lv_4... 2021-10-08T19:18:45.707 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2021-10-08T19:18:45.969 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:45 smithi097 ceph-mon[41966]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:18:45.969 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:45 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:18:45.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:45 smithi097 ceph-mon[41966]: 172.21.15.97 - - [08/Oct/2021:19:18:43] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:18:45.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:45 smithi097 ceph-mon[41966]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:45.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:45 smithi097 ceph-mon[41966]: from='client.34103 v1:172.21.15.117:0/3921755161' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi097=y;smithi117=x", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:18:45.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:45 smithi097 ceph-mon[41966]: Saving service mgr spec with placement smithi097=y;smithi117=x;count:2 2021-10-08T19:18:45.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:45 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:45.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:45 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:18:45.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:45 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:45.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:45 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:18:45.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:45 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:45.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:45 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-10-08T19:18:45.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:45 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-10-08T19:18:45.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:45 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2021-10-08T19:18:45.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:45 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:45.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:45 smithi097 ceph-mon[32687]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:18:45.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:45 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:18:45.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:45 smithi097 ceph-mon[32687]: 172.21.15.97 - - [08/Oct/2021:19:18:43] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:18:45.974 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:45 smithi097 ceph-mon[32687]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:45.974 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:45 smithi097 ceph-mon[32687]: from='client.34103 v1:172.21.15.117:0/3921755161' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi097=y;smithi117=x", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:18:45.974 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:45 smithi097 ceph-mon[32687]: Saving service mgr spec with placement smithi097=y;smithi117=x;count:2 2021-10-08T19:18:45.974 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:45 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:45.975 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:45 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:18:45.975 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:45 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:45.975 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:45 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:18:45.975 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:45 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:45.976 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:45 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-10-08T19:18:45.976 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:45 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-10-08T19:18:45.976 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:45 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2021-10-08T19:18:45.976 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:45 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:46.552 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:18:46 smithi117 systemd[1]: Starting Ceph mgr.x for 1d01f6d6-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:18:46.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:46 smithi097 ceph-mon[32687]: Deploying daemon mgr.x on smithi117 2021-10-08T19:18:46.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:46 smithi097 ceph-mon[32687]: poll took 1693.792 ms: 1 events 2021-10-08T19:18:46.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:46 smithi097 ceph-mon[41966]: Deploying daemon mgr.x on smithi117 2021-10-08T19:18:46.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:46 smithi097 ceph-mon[41966]: poll took 1693.792 ms: 1 events 2021-10-08T19:18:46.883 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:46 smithi117 ceph-mon[34585]: Deploying daemon mgr.x on smithi117 2021-10-08T19:18:46.883 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:46 smithi117 ceph-mon[34585]: poll took 1693.792 ms: 1 events 2021-10-08T19:18:47.555 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:18:47 smithi117 bash[36589]: 9f2414c3710b4dcfd5305ceedfd80f4759d91e1d917379a332300f517899a90e 2021-10-08T19:18:47.555 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:18:47 smithi117 systemd[1]: Started Ceph mgr.x for 1d01f6d6-286c-11ec-8c25-001a4aab830c. 2021-10-08T19:18:47.691 INFO:teuthology.orchestra.run.smithi097.stderr:--> Zapping: /dev/vg_nvme/lv_4 2021-10-08T19:18:47.691 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2021-10-08T19:18:47.691 INFO:teuthology.orchestra.run.smithi097.stderr: stderr: 10+0 records in 2021-10-08T19:18:47.691 INFO:teuthology.orchestra.run.smithi097.stderr:10+0 records out 2021-10-08T19:18:47.692 INFO:teuthology.orchestra.run.smithi097.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0112291 s, 934 MB/s 2021-10-08T19:18:47.692 INFO:teuthology.orchestra.run.smithi097.stderr:--> Zapping successful for: 2021-10-08T19:18:47.807 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:47 smithi117 ceph-mon[34585]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:47.807 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:47 smithi117 ceph-mon[34585]: poll took 1064.185 ms: 1 events 2021-10-08T19:18:47.807 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:47 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:47.807 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:47 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:18:47.808 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:47 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:47.808 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:47 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:18:47.808 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:47 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:47.808 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:47 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-10-08T19:18:47.809 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:47 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2021-10-08T19:18:47.809 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:47 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:47.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:47 smithi097 ceph-mon[32687]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:47.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:47 smithi097 ceph-mon[32687]: poll took 1064.185 ms: 1 events 2021-10-08T19:18:47.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:47 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:47.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:47 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:18:47.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:47 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:47.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:47 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:18:47.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:47 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:47.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:47 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-10-08T19:18:47.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:47 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2021-10-08T19:18:47.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:47 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:47.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:47 smithi097 ceph-mon[41966]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:47.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:47 smithi097 ceph-mon[41966]: poll took 1064.185 ms: 1 events 2021-10-08T19:18:47.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:47 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:47.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:47 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:18:47.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:47 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:47.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:47 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:18:47.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:47 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:47.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:47 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-10-08T19:18:47.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:47 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2021-10-08T19:18:47.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:47 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:48.435 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph orch daemon add osd smithi097:vg_nvme/lv_4 2021-10-08T19:18:48.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:48 smithi097 ceph-mon[32687]: Sending message to agent on host smithi117 2021-10-08T19:18:48.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:48 smithi097 ceph-mon[32687]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:18:48.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:48 smithi097 ceph-mon[32687]: Reconfiguring mgr.y (unknown last config time)... 2021-10-08T19:18:48.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:48 smithi097 ceph-mon[32687]: Reconfiguring daemon mgr.y on smithi097 2021-10-08T19:18:48.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:48 smithi097 ceph-mon[32687]: Received "ACK" from agent on host smithi117 2021-10-08T19:18:48.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:48 smithi097 ceph-mon[41966]: Sending message to agent on host smithi117 2021-10-08T19:18:48.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:48 smithi097 ceph-mon[41966]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:18:48.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:48 smithi097 ceph-mon[41966]: Reconfiguring mgr.y (unknown last config time)... 2021-10-08T19:18:48.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:48 smithi097 ceph-mon[41966]: Reconfiguring daemon mgr.y on smithi097 2021-10-08T19:18:48.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:48 smithi097 ceph-mon[41966]: Received "ACK" from agent on host smithi117 2021-10-08T19:18:48.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:48 smithi117 ceph-mon[34585]: Sending message to agent on host smithi117 2021-10-08T19:18:48.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:48 smithi117 ceph-mon[34585]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:18:48.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:48 smithi117 ceph-mon[34585]: Reconfiguring mgr.y (unknown last config time)... 2021-10-08T19:18:48.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:48 smithi117 ceph-mon[34585]: Reconfiguring daemon mgr.y on smithi097 2021-10-08T19:18:48.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:48 smithi117 ceph-mon[34585]: Received "ACK" from agent on host smithi117 2021-10-08T19:18:49.719 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:49 smithi097 ceph-mon[41966]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:49.719 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:49 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:49.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:49 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:18:49.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:49 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:49.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:49 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:18:49.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:49 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:49.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:49 smithi097 ceph-mon[32687]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:49.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:49 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:49.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:49 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:18:49.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:49 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:49.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:49 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:18:49.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:49 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:49.904 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:49 smithi117 ceph-mon[34585]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:49.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:49 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:49.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:49 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:18:49.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:49 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:49.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:49 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:18:49.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:49 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:50.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:50 smithi097 ceph-mon[32687]: poll took 1363.057 ms: 1 events 2021-10-08T19:18:50.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:50 smithi097 ceph-mon[32687]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:18:50.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:50 smithi097 ceph-mon[32687]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:50.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:50 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:50.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:50 smithi097 ceph-mon[32687]: from='client.14217 v1:172.21.15.97:0/1121318519' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi097:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:18:50.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:50 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:18:50.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:50 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:18:50.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:50 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:50.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:50 smithi097 ceph-mon[32687]: poll took 1548.034 ms: 1 events 2021-10-08T19:18:50.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:50 smithi097 ceph-mon[41966]: poll took 1363.057 ms: 1 events 2021-10-08T19:18:50.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:50 smithi097 ceph-mon[41966]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:18:50.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:50 smithi097 ceph-mon[41966]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:50.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:50 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:50.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:50 smithi097 ceph-mon[41966]: from='client.14217 v1:172.21.15.97:0/1121318519' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi097:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:18:50.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:50 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:18:50.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:50 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:18:50.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:50 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:50.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:50 smithi097 ceph-mon[41966]: poll took 1548.034 ms: 1 events 2021-10-08T19:18:50.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:50 smithi117 ceph-mon[34585]: poll took 1363.057 ms: 1 events 2021-10-08T19:18:50.945 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:50 smithi117 ceph-mon[34585]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:18:50.945 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:50 smithi117 ceph-mon[34585]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:50.946 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:50 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:50.946 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:50 smithi117 ceph-mon[34585]: from='client.14217 v1:172.21.15.97:0/1121318519' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi097:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:18:50.946 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:50 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:18:50.946 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:50 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:18:50.947 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:50 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:50.947 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:50 smithi117 ceph-mon[34585]: poll took 1548.034 ms: 1 events 2021-10-08T19:18:51.469 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:18:51 smithi097 conmon[33110]: 172.21.15.117 - - [08/Oct/2021:19:18:51] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:18:52.469 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:52 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:52.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:52 smithi097 ceph-mon[32687]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:18:52.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:52 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:18:52.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:52 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:18:52.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:52 smithi097 ceph-mon[32687]: 172.21.15.117 - - [08/Oct/2021:19:18:51] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:18:52.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:52 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:52.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:52 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:18:52.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:52 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:52.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:52 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:52.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:52 smithi097 ceph-mon[41966]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:18:52.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:52 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:18:52.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:52 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:18:52.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:52 smithi097 ceph-mon[41966]: 172.21.15.117 - - [08/Oct/2021:19:18:51] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:18:52.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:52 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:52.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:52 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:18:52.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:52 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:52.654 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:52 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:52.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:52 smithi117 ceph-mon[34585]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:18:52.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:52 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:18:52.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:52 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:18:52.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:52 smithi117 ceph-mon[34585]: 172.21.15.117 - - [08/Oct/2021:19:18:51] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:18:52.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:52 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:52.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:52 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:18:52.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:52 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:18:53.469 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:53 smithi097 ceph-mon[32687]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:53.469 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:53 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2840873202' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9e64e714-a5d5-4fbb-ae2b-1df4bf14b8e0"}]: dispatch 2021-10-08T19:18:53.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:53 smithi097 ceph-mon[32687]: from='client.24130 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9e64e714-a5d5-4fbb-ae2b-1df4bf14b8e0"}]: dispatch 2021-10-08T19:18:53.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:53 smithi097 ceph-mon[32687]: from='client.24130 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9e64e714-a5d5-4fbb-ae2b-1df4bf14b8e0"}]': finished 2021-10-08T19:18:53.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:53 smithi097 ceph-mon[32687]: osdmap e5: 1 total, 0 up, 1 in 2021-10-08T19:18:53.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:53 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:18:53.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:53 smithi097 ceph-mon[32687]: Standby manager daemon x started 2021-10-08T19:18:53.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:53 smithi097 ceph-mon[32687]: from='mgr.? v1:172.21.15.117:0/2046548' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2021-10-08T19:18:53.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:53 smithi097 ceph-mon[32687]: from='mgr.? v1:172.21.15.117:0/2046548' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-10-08T19:18:53.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:53 smithi097 ceph-mon[32687]: from='mgr.? v1:172.21.15.117:0/2046548' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2021-10-08T19:18:53.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:53 smithi097 ceph-mon[32687]: from='mgr.? v1:172.21.15.117:0/2046548' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-10-08T19:18:53.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:53 smithi097 ceph-mon[41966]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:53.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:53 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2840873202' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9e64e714-a5d5-4fbb-ae2b-1df4bf14b8e0"}]: dispatch 2021-10-08T19:18:53.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:53 smithi097 ceph-mon[41966]: from='client.24130 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9e64e714-a5d5-4fbb-ae2b-1df4bf14b8e0"}]: dispatch 2021-10-08T19:18:53.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:53 smithi097 ceph-mon[41966]: from='client.24130 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9e64e714-a5d5-4fbb-ae2b-1df4bf14b8e0"}]': finished 2021-10-08T19:18:53.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:53 smithi097 ceph-mon[41966]: osdmap e5: 1 total, 0 up, 1 in 2021-10-08T19:18:53.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:53 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:18:53.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:53 smithi097 ceph-mon[41966]: Standby manager daemon x started 2021-10-08T19:18:53.474 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:53 smithi097 ceph-mon[41966]: from='mgr.? v1:172.21.15.117:0/2046548' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2021-10-08T19:18:53.474 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:53 smithi097 ceph-mon[41966]: from='mgr.? v1:172.21.15.117:0/2046548' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-10-08T19:18:53.474 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:53 smithi097 ceph-mon[41966]: from='mgr.? v1:172.21.15.117:0/2046548' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2021-10-08T19:18:53.474 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:53 smithi097 ceph-mon[41966]: from='mgr.? v1:172.21.15.117:0/2046548' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-10-08T19:18:53.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:53 smithi117 ceph-mon[34585]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:53.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:53 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2840873202' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9e64e714-a5d5-4fbb-ae2b-1df4bf14b8e0"}]: dispatch 2021-10-08T19:18:53.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:53 smithi117 ceph-mon[34585]: from='client.24130 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9e64e714-a5d5-4fbb-ae2b-1df4bf14b8e0"}]: dispatch 2021-10-08T19:18:53.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:53 smithi117 ceph-mon[34585]: from='client.24130 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9e64e714-a5d5-4fbb-ae2b-1df4bf14b8e0"}]': finished 2021-10-08T19:18:53.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:53 smithi117 ceph-mon[34585]: osdmap e5: 1 total, 0 up, 1 in 2021-10-08T19:18:53.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:53 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:18:53.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:53 smithi117 ceph-mon[34585]: Standby manager daemon x started 2021-10-08T19:18:53.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:53 smithi117 ceph-mon[34585]: from='mgr.? v1:172.21.15.117:0/2046548' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2021-10-08T19:18:53.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:53 smithi117 ceph-mon[34585]: from='mgr.? v1:172.21.15.117:0/2046548' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-10-08T19:18:53.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:53 smithi117 ceph-mon[34585]: from='mgr.? v1:172.21.15.117:0/2046548' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2021-10-08T19:18:53.659 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:53 smithi117 ceph-mon[34585]: from='mgr.? v1:172.21.15.117:0/2046548' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-10-08T19:18:54.469 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:54 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/118345253' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:18:54.469 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:54 smithi097 ceph-mon[32687]: mgrmap e14: y(active, since 103s), standbys: x 2021-10-08T19:18:54.469 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:54 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-10-08T19:18:54.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:54 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/118345253' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:18:54.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:54 smithi097 ceph-mon[41966]: mgrmap e14: y(active, since 103s), standbys: x 2021-10-08T19:18:54.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:54 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-10-08T19:18:54.654 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:54 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/118345253' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:18:54.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:54 smithi117 ceph-mon[34585]: mgrmap e14: y(active, since 103s), standbys: x 2021-10-08T19:18:54.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:54 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-10-08T19:18:55.469 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:55 smithi097 ceph-mon[32687]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:55.469 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:55 smithi097 ceph-mon[41966]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:55.654 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:55 smithi117 ceph-mon[34585]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:57.654 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:57 smithi117 ceph-mon[34585]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:57.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:57 smithi117 ceph-mon[34585]: poll took 5387.350 ms: 1 events 2021-10-08T19:18:57.672 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:57 smithi097 ceph-mon[32687]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:57.672 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:57 smithi097 ceph-mon[32687]: poll took 5387.350 ms: 1 events 2021-10-08T19:18:57.673 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:57 smithi097 ceph-mon[41966]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:57.673 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:57 smithi097 ceph-mon[41966]: poll took 5387.350 ms: 1 events 2021-10-08T19:18:59.469 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:59 smithi097 ceph-mon[41966]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:59.469 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:59 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2021-10-08T19:18:59.469 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:18:59 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:59.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:59 smithi097 ceph-mon[32687]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:59.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:59 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2021-10-08T19:18:59.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:18:59 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:18:59.654 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:59 smithi117 ceph-mon[34585]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:18:59.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:59 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2021-10-08T19:18:59.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:18:59 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:19:00.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:00 smithi117 ceph-mon[34585]: poll took 2172.493 ms: 1 events 2021-10-08T19:19:00.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:00 smithi117 ceph-mon[34585]: Deploying daemon osd.0 on smithi097 2021-10-08T19:19:00.681 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:00 smithi097 ceph-mon[41966]: poll took 2172.493 ms: 1 events 2021-10-08T19:19:00.682 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:00 smithi097 ceph-mon[41966]: Deploying daemon osd.0 on smithi097 2021-10-08T19:19:00.682 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:00 smithi097 ceph-mon[32687]: poll took 2172.493 ms: 1 events 2021-10-08T19:19:00.682 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:00 smithi097 ceph-mon[32687]: Deploying daemon osd.0 on smithi097 2021-10-08T19:19:01.654 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:01 smithi117 ceph-mon[34585]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:19:01.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:01 smithi097 ceph-mon[32687]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:19:01.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:01 smithi097 ceph-mon[41966]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:19:02.179 INFO:teuthology.orchestra.run.smithi097.stdout:Created osd(s) 0 on host 'smithi097' 2021-10-08T19:19:02.641 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:02 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:19:02.642 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:02 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:19:02.642 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:02 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:02.642 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:02 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:19:02.643 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:02 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:19:02.643 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:02 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:02.643 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:02 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:02.643 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:02 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:02.643 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:02 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:19:02.644 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:02 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:19:02.644 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:02 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:19:02.644 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:02 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:02.645 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:02 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:19:02.645 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:02 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:19:02.645 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:02 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:02.645 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:02 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:19:02.645 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:02 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:19:02.646 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:02 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:02.646 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:02 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:02.646 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:02 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:02.646 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:02 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:19:02.646 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:02 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:19:02.647 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:02 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:19:02.647 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:02 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:02.654 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:02 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:19:02.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:02 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:19:02.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:02 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:02.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:02 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:19:02.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:02 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:19:02.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:02 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:02.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:02 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:02.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:02 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:02.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:02 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:19:02.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:02 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:19:02.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:02 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:19:02.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:02 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:02.750 DEBUG:teuthology.orchestra.run.smithi097:osd.0> sudo journalctl -f -n 0 -u ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@osd.0.service 2021-10-08T19:19:02.752 INFO:tasks.cephadm:Deploying osd.1 on smithi097 with /dev/vg_nvme/lv_3... 2021-10-08T19:19:02.753 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2021-10-08T19:19:02.779 INFO:journalctl@ceph.osd.0.smithi097.stdout:-- Logs begin at Fri 2021-10-08 19:07:18 UTC. -- 2021-10-08T19:19:03.469 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:03 smithi097 ceph-mon[32687]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:19:03.469 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:03 smithi097 ceph-mon[32687]: poll took 3229.485 ms: 1 events 2021-10-08T19:19:03.469 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:03 smithi097 ceph-mon[32687]: Adjusting osd_memory_target on smithi097 to 15124M 2021-10-08T19:19:03.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:03 smithi097 ceph-mon[41966]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:19:03.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:03 smithi097 ceph-mon[41966]: poll took 3229.485 ms: 1 events 2021-10-08T19:19:03.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:03 smithi097 ceph-mon[41966]: Adjusting osd_memory_target on smithi097 to 15124M 2021-10-08T19:19:03.654 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:03 smithi117 ceph-mon[34585]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:19:03.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:03 smithi117 ceph-mon[34585]: poll took 3229.485 ms: 1 events 2021-10-08T19:19:03.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:03 smithi117 ceph-mon[34585]: Adjusting osd_memory_target on smithi097 to 15124M 2021-10-08T19:19:04.932 INFO:teuthology.orchestra.run.smithi097.stderr:--> Zapping: /dev/vg_nvme/lv_3 2021-10-08T19:19:04.932 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2021-10-08T19:19:04.933 INFO:teuthology.orchestra.run.smithi097.stderr: stderr: 10+0 records in 2021-10-08T19:19:04.933 INFO:teuthology.orchestra.run.smithi097.stderr:10+0 records out 2021-10-08T19:19:04.933 INFO:teuthology.orchestra.run.smithi097.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0120917 s, 867 MB/s 2021-10-08T19:19:04.933 INFO:teuthology.orchestra.run.smithi097.stderr:--> Zapping successful for: 2021-10-08T19:19:05.639 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:05 smithi097 ceph-mon[41966]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:19:05.640 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:05 smithi097 ceph-mon[41966]: from='osd.0 v1:172.21.15.97:6801/3354161282' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-10-08T19:19:05.640 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:05 smithi097 ceph-mon[41966]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-10-08T19:19:05.641 INFO:journalctl@ceph.osd.0.smithi097.stdout:Oct 08 19:19:05 smithi097 conmon[47373]: 2021-10-08T19:19:05.362+0000 7f835988b0c0 -1 osd.0 0 log_to_monitors {default=true} 2021-10-08T19:19:05.641 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:05 smithi097 ceph-mon[32687]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:19:05.641 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:05 smithi097 ceph-mon[32687]: from='osd.0 v1:172.21.15.97:6801/3354161282' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-10-08T19:19:05.642 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:05 smithi097 ceph-mon[32687]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-10-08T19:19:05.643 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph orch daemon add osd smithi097:vg_nvme/lv_3 2021-10-08T19:19:05.654 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:05 smithi117 ceph-mon[34585]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:19:05.654 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:05 smithi117 ceph-mon[34585]: from='osd.0 v1:172.21.15.97:6801/3354161282' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-10-08T19:19:05.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:05 smithi117 ceph-mon[34585]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-10-08T19:19:07.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:07 smithi117 ceph-mon[34585]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:19:07.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:07 smithi117 ceph-mon[34585]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-10-08T19:19:07.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:07 smithi117 ceph-mon[34585]: osdmap e6: 1 total, 0 up, 1 in 2021-10-08T19:19:07.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:07 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:19:07.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:07 smithi117 ceph-mon[34585]: from='osd.0 v1:172.21.15.97:6801/3354161282' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]: dispatch 2021-10-08T19:19:07.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:07 smithi117 ceph-mon[34585]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]: dispatch 2021-10-08T19:19:07.679 INFO:journalctl@ceph.osd.0.smithi097.stdout:Oct 08 19:19:07 smithi097 conmon[47373]: 2021-10-08T19:19:07.377+0000 7f8350033700 -1 osd.0 0 waiting for initial osdmap 2021-10-08T19:19:07.680 INFO:journalctl@ceph.osd.0.smithi097.stdout:Oct 08 19:19:07 smithi097 conmon[47373]: 2021-10-08T19:19:07.380+0000 7f834c9ce700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-10-08T19:19:07.680 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:07 smithi097 ceph-mon[41966]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:19:07.680 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:07 smithi097 ceph-mon[41966]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-10-08T19:19:07.680 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:07 smithi097 ceph-mon[41966]: osdmap e6: 1 total, 0 up, 1 in 2021-10-08T19:19:07.681 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:07 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:19:07.681 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:07 smithi097 ceph-mon[41966]: from='osd.0 v1:172.21.15.97:6801/3354161282' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]: dispatch 2021-10-08T19:19:07.681 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:07 smithi097 ceph-mon[41966]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]: dispatch 2021-10-08T19:19:07.681 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:07 smithi097 ceph-mon[32687]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:19:07.682 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:07 smithi097 ceph-mon[32687]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-10-08T19:19:07.682 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:07 smithi097 ceph-mon[32687]: osdmap e6: 1 total, 0 up, 1 in 2021-10-08T19:19:07.682 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:07 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:19:07.682 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:07 smithi097 ceph-mon[32687]: from='osd.0 v1:172.21.15.97:6801/3354161282' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]: dispatch 2021-10-08T19:19:07.683 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:07 smithi097 ceph-mon[32687]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]: dispatch 2021-10-08T19:19:08.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:08 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:19:08.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:08 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:19:08.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:08 smithi117 ceph-mon[34585]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]': finished 2021-10-08T19:19:08.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:08 smithi117 ceph-mon[34585]: osdmap e7: 1 total, 0 up, 1 in 2021-10-08T19:19:08.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:08 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:19:08.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:08 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:19:08.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:08 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:19:08.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:08 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:19:08.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:08 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:19:08.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:08 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:19:08.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:08 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:19:08.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:08 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:19:08.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:08 smithi097 ceph-mon[32687]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]': finished 2021-10-08T19:19:08.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:08 smithi097 ceph-mon[32687]: osdmap e7: 1 total, 0 up, 1 in 2021-10-08T19:19:08.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:08 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:19:08.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:08 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:19:08.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:08 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:19:08.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:08 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:19:08.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:08 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:19:08.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:08 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:19:08.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:08 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:19:08.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:08 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:19:08.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:08 smithi097 ceph-mon[41966]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]': finished 2021-10-08T19:19:08.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:08 smithi097 ceph-mon[41966]: osdmap e7: 1 total, 0 up, 1 in 2021-10-08T19:19:08.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:08 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:19:08.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:08 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:19:08.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:08 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:19:08.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:08 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:19:08.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:08 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:19:08.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:08 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:19:09.219 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:19:08 smithi097 conmon[33110]: 172.21.15.97 - - [08/Oct/2021:19:19:08] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:19:09.654 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:09 smithi117 ceph-mon[34585]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:19:09.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:09 smithi117 ceph-mon[34585]: from='client.14244 v1:172.21.15.97:0/1731452857' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi097:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:19:09.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:09 smithi117 ceph-mon[34585]: poll took 5896.839 ms: 1 events 2021-10-08T19:19:09.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:09 smithi117 ceph-mon[34585]: osd.0 v1:172.21.15.97:6801/3354161282 boot 2021-10-08T19:19:09.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:09 smithi117 ceph-mon[34585]: osdmap e8: 1 total, 1 up, 1 in 2021-10-08T19:19:09.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:09 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:19:09.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:09 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:09.677 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:09 smithi097 ceph-mon[41966]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:19:09.678 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:09 smithi097 ceph-mon[41966]: from='client.14244 v1:172.21.15.97:0/1731452857' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi097:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:19:09.678 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:09 smithi097 ceph-mon[41966]: poll took 5896.839 ms: 1 events 2021-10-08T19:19:09.678 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:09 smithi097 ceph-mon[41966]: osd.0 v1:172.21.15.97:6801/3354161282 boot 2021-10-08T19:19:09.678 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:09 smithi097 ceph-mon[41966]: osdmap e8: 1 total, 1 up, 1 in 2021-10-08T19:19:09.679 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:09 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:19:09.679 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:09 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:09.679 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:09 smithi097 ceph-mon[32687]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:19:09.680 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:09 smithi097 ceph-mon[32687]: from='client.14244 v1:172.21.15.97:0/1731452857' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi097:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:19:09.680 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:09 smithi097 ceph-mon[32687]: poll took 5896.839 ms: 1 events 2021-10-08T19:19:09.680 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:09 smithi097 ceph-mon[32687]: osd.0 v1:172.21.15.97:6801/3354161282 boot 2021-10-08T19:19:09.680 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:09 smithi097 ceph-mon[32687]: osdmap e8: 1 total, 1 up, 1 in 2021-10-08T19:19:09.680 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:09 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:19:09.681 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:09 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:10.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:10 smithi117 ceph-mon[34585]: Detected new or changed devices on smithi097 2021-10-08T19:19:10.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:10 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:19:10.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:10 smithi117 ceph-mon[34585]: 172.21.15.97 - - [08/Oct/2021:19:19:08] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:19:10.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:10 smithi117 ceph-mon[34585]: osdmap e9: 1 total, 1 up, 1 in 2021-10-08T19:19:10.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:10 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:19:10.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:10 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:19:10.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:10 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2699184160' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "32602a22-f263-4b62-a8d8-50fddfb73fa8"}]: dispatch 2021-10-08T19:19:10.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:10 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2699184160' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "32602a22-f263-4b62-a8d8-50fddfb73fa8"}]': finished 2021-10-08T19:19:10.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:10 smithi117 ceph-mon[34585]: osdmap e10: 2 total, 1 up, 2 in 2021-10-08T19:19:10.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:10 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:19:10.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:10 smithi097 ceph-mon[32687]: Detected new or changed devices on smithi097 2021-10-08T19:19:10.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:10 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:19:10.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:10 smithi097 ceph-mon[32687]: 172.21.15.97 - - [08/Oct/2021:19:19:08] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:19:10.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:10 smithi097 ceph-mon[32687]: osdmap e9: 1 total, 1 up, 1 in 2021-10-08T19:19:10.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:10 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:19:10.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:10 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:19:10.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:10 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2699184160' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "32602a22-f263-4b62-a8d8-50fddfb73fa8"}]: dispatch 2021-10-08T19:19:10.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:10 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2699184160' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "32602a22-f263-4b62-a8d8-50fddfb73fa8"}]': finished 2021-10-08T19:19:10.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:10 smithi097 ceph-mon[32687]: osdmap e10: 2 total, 1 up, 2 in 2021-10-08T19:19:10.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:10 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:19:10.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:10 smithi097 ceph-mon[41966]: Detected new or changed devices on smithi097 2021-10-08T19:19:10.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:10 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:19:10.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:10 smithi097 ceph-mon[41966]: 172.21.15.97 - - [08/Oct/2021:19:19:08] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:19:10.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:10 smithi097 ceph-mon[41966]: osdmap e9: 1 total, 1 up, 1 in 2021-10-08T19:19:10.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:10 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:19:10.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:10 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:19:10.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:10 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2699184160' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "32602a22-f263-4b62-a8d8-50fddfb73fa8"}]: dispatch 2021-10-08T19:19:10.725 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:10 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2699184160' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "32602a22-f263-4b62-a8d8-50fddfb73fa8"}]': finished 2021-10-08T19:19:10.725 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:10 smithi097 ceph-mon[41966]: osdmap e10: 2 total, 1 up, 2 in 2021-10-08T19:19:10.725 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:10 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:19:11.654 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:11 smithi117 ceph-mon[34585]: pgmap v58: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:19:11.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:11 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/477347008' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:19:11.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:11 smithi097 ceph-mon[32687]: pgmap v58: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:19:11.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:11 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/477347008' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:19:11.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:11 smithi097 ceph-mon[41966]: pgmap v58: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:19:11.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:11 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/477347008' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:19:13.654 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:13 smithi117 ceph-mon[34585]: pgmap v60: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:19:13.668 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:13 smithi097 ceph-mon[32687]: pgmap v60: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:19:13.669 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:13 smithi097 ceph-mon[41966]: pgmap v60: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:19:15.202 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:19:14 smithi097 conmon[33110]: 172.21.15.117 - - [08/Oct/2021:19:19:14] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:19:15.469 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:15 smithi097 ceph-mon[32687]: poll took 5248.900 ms: 1 events 2021-10-08T19:19:15.469 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:15 smithi097 ceph-mon[32687]: pgmap v61: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:19:15.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:15 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:15.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:15 smithi097 ceph-mon[41966]: poll took 5248.900 ms: 1 events 2021-10-08T19:19:15.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:15 smithi097 ceph-mon[41966]: pgmap v61: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:19:15.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:15 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:15.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:15 smithi117 ceph-mon[34585]: poll took 5248.900 ms: 1 events 2021-10-08T19:19:15.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:15 smithi117 ceph-mon[34585]: pgmap v61: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:19:15.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:15 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:16.409 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:16 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:19:16.409 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:16 smithi097 ceph-mon[32687]: 172.21.15.117 - - [08/Oct/2021:19:19:14] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:19:16.409 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:16 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2021-10-08T19:19:16.410 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:16 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:19:16.691 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:16 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:19:16.691 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:16 smithi097 ceph-mon[41966]: 172.21.15.117 - - [08/Oct/2021:19:19:14] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:19:16.691 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:16 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2021-10-08T19:19:16.692 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:16 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:19:16.904 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:16 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:19:16.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:16 smithi117 ceph-mon[34585]: 172.21.15.117 - - [08/Oct/2021:19:19:14] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:19:16.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:16 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2021-10-08T19:19:16.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:16 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:19:17.709 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:17 smithi097 ceph-mon[32687]: pgmap v62: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:19:17.709 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:17 smithi097 ceph-mon[32687]: poll took 2201.240 ms: 1 events 2021-10-08T19:19:17.709 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:17 smithi097 ceph-mon[32687]: Deploying daemon osd.1 on smithi097 2021-10-08T19:19:17.710 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:17 smithi097 ceph-mon[41966]: pgmap v62: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:19:17.710 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:17 smithi097 ceph-mon[41966]: poll took 2201.240 ms: 1 events 2021-10-08T19:19:17.710 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:17 smithi097 ceph-mon[41966]: Deploying daemon osd.1 on smithi097 2021-10-08T19:19:17.904 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:17 smithi117 ceph-mon[34585]: pgmap v62: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:19:17.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:17 smithi117 ceph-mon[34585]: poll took 2201.240 ms: 1 events 2021-10-08T19:19:17.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:17 smithi117 ceph-mon[34585]: Deploying daemon osd.1 on smithi097 2021-10-08T19:19:19.687 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:19 smithi097 ceph-mon[41966]: pgmap v63: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:19:19.688 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:19 smithi097 ceph-mon[32687]: pgmap v63: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:19:19.711 INFO:teuthology.orchestra.run.smithi097.stdout:Created osd(s) 1 on host 'smithi097' 2021-10-08T19:19:19.904 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:19 smithi117 ceph-mon[34585]: pgmap v63: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:19:20.237 DEBUG:teuthology.orchestra.run.smithi097:osd.1> sudo journalctl -f -n 0 -u ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@osd.1.service 2021-10-08T19:19:20.240 INFO:tasks.cephadm:Deploying osd.2 on smithi097 with /dev/vg_nvme/lv_2... 2021-10-08T19:19:20.240 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2021-10-08T19:19:20.266 INFO:journalctl@ceph.osd.1.smithi097.stdout:-- Logs begin at Fri 2021-10-08 19:07:18 UTC. -- 2021-10-08T19:19:20.469 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:20 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:19:20.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:20 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:19:20.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:20 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:19:20.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:20 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:20.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:20 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:20.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:20 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:19:20.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:20 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:19:20.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:20 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:19:20.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:20 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:19:20.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:20 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:20.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:20 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:19:20.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:20 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:20.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:20 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:20.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:20 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:19:20.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:20 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:19:20.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:20 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:19:20.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:20 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:20.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:20 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:20.474 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:20 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:19:20.474 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:20 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:19:20.474 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:20 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:19:20.474 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:20 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:19:20.474 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:20 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:20.475 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:20 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:19:20.475 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:20 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:20.475 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:20 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:20.904 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:20 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:19:20.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:20 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:19:20.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:20 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:19:20.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:20 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:20.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:20 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:20.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:20 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:19:20.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:20 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:19:20.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:20 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:19:20.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:20 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:19:20.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:20 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:20.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:20 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:19:20.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:20 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:20.908 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:20 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:21.710 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:21 smithi097 ceph-mon[41966]: poll took 3180.918 ms: 1 events 2021-10-08T19:19:21.711 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:21 smithi097 ceph-mon[41966]: Adjusting osd_memory_target on smithi097 to 7562M 2021-10-08T19:19:21.711 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:21 smithi097 ceph-mon[41966]: pgmap v64: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:19:21.711 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:21 smithi097 ceph-mon[32687]: poll took 3180.918 ms: 1 events 2021-10-08T19:19:21.711 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:21 smithi097 ceph-mon[32687]: Adjusting osd_memory_target on smithi097 to 7562M 2021-10-08T19:19:21.712 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:21 smithi097 ceph-mon[32687]: pgmap v64: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:19:21.904 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:21 smithi117 ceph-mon[34585]: poll took 3180.918 ms: 1 events 2021-10-08T19:19:21.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:21 smithi117 ceph-mon[34585]: Adjusting osd_memory_target on smithi097 to 7562M 2021-10-08T19:19:21.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:21 smithi117 ceph-mon[34585]: pgmap v64: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:19:22.118 INFO:teuthology.orchestra.run.smithi097.stderr:--> Zapping: /dev/vg_nvme/lv_2 2021-10-08T19:19:22.119 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2021-10-08T19:19:22.119 INFO:teuthology.orchestra.run.smithi097.stderr: stderr: 10+0 records in 2021-10-08T19:19:22.119 INFO:teuthology.orchestra.run.smithi097.stderr:10+0 records out 2021-10-08T19:19:22.120 INFO:teuthology.orchestra.run.smithi097.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0138511 s, 757 MB/s 2021-10-08T19:19:22.120 INFO:teuthology.orchestra.run.smithi097.stderr:--> Zapping successful for: 2021-10-08T19:19:22.657 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph orch daemon add osd smithi097:vg_nvme/lv_2 2021-10-08T19:19:23.219 INFO:journalctl@ceph.osd.1.smithi097.stdout:Oct 08 19:19:22 smithi097 conmon[51607]: 2021-10-08T19:19:22.922+0000 7f6f4812c0c0 -1 osd.1 0 log_to_monitors {default=true} 2021-10-08T19:19:23.719 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:23 smithi097 ceph-mon[41966]: pgmap v65: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:19:23.719 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:23 smithi097 ceph-mon[41966]: from='osd.1 v1:172.21.15.97:6805/735799205' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-10-08T19:19:23.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:23 smithi097 ceph-mon[41966]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-10-08T19:19:23.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:23 smithi097 ceph-mon[32687]: pgmap v65: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:19:23.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:23 smithi097 ceph-mon[32687]: from='osd.1 v1:172.21.15.97:6805/735799205' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-10-08T19:19:23.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:23 smithi097 ceph-mon[32687]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-10-08T19:19:23.904 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:23 smithi117 ceph-mon[34585]: pgmap v65: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:19:23.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:23 smithi117 ceph-mon[34585]: from='osd.1 v1:172.21.15.97:6805/735799205' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-10-08T19:19:23.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:23 smithi117 ceph-mon[34585]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-10-08T19:19:24.719 INFO:journalctl@ceph.osd.1.smithi097.stdout:Oct 08 19:19:24 smithi097 conmon[51607]: 2021-10-08T19:19:24.431+0000 7f6f3e8d4700 -1 osd.1 0 waiting for initial osdmap 2021-10-08T19:19:24.720 INFO:journalctl@ceph.osd.1.smithi097.stdout:Oct 08 19:19:24 smithi097 conmon[51607]: 2021-10-08T19:19:24.433+0000 7f6f39a6c700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-10-08T19:19:24.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:24 smithi097 ceph-mon[41966]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-10-08T19:19:24.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:24 smithi097 ceph-mon[41966]: osdmap e11: 2 total, 1 up, 2 in 2021-10-08T19:19:24.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:24 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:19:24.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:24 smithi097 ceph-mon[41966]: from='osd.1 v1:172.21.15.97:6805/735799205' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]: dispatch 2021-10-08T19:19:24.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:24 smithi097 ceph-mon[41966]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]: dispatch 2021-10-08T19:19:24.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:24 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:19:24.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:24 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:19:24.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:24 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:19:24.724 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:24 smithi097 ceph-mon[32687]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-10-08T19:19:24.725 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:24 smithi097 ceph-mon[32687]: osdmap e11: 2 total, 1 up, 2 in 2021-10-08T19:19:24.725 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:24 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:19:24.726 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:24 smithi097 ceph-mon[32687]: from='osd.1 v1:172.21.15.97:6805/735799205' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]: dispatch 2021-10-08T19:19:24.726 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:24 smithi097 ceph-mon[32687]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]: dispatch 2021-10-08T19:19:24.727 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:24 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:19:24.727 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:24 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:19:24.728 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:24 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:19:24.904 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:24 smithi117 ceph-mon[34585]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-10-08T19:19:24.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:24 smithi117 ceph-mon[34585]: osdmap e11: 2 total, 1 up, 2 in 2021-10-08T19:19:24.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:24 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:19:24.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:24 smithi117 ceph-mon[34585]: from='osd.1 v1:172.21.15.97:6805/735799205' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]: dispatch 2021-10-08T19:19:24.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:24 smithi117 ceph-mon[34585]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]: dispatch 2021-10-08T19:19:24.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:24 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:19:24.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:24 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:19:24.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:24 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:19:25.469 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:25 smithi097 ceph-mon[41966]: pgmap v67: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:19:25.469 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:25 smithi097 ceph-mon[41966]: from='client.14271 v1:172.21.15.97:0/1335304485' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi097:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:19:25.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:25 smithi097 ceph-mon[41966]: poll took 4728.821 ms: 1 events 2021-10-08T19:19:25.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:25 smithi097 ceph-mon[41966]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]': finished 2021-10-08T19:19:25.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:25 smithi097 ceph-mon[41966]: osdmap e12: 2 total, 1 up, 2 in 2021-10-08T19:19:25.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:25 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:19:25.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:25 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:19:25.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:25 smithi097 ceph-mon[32687]: pgmap v67: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:19:25.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:25 smithi097 ceph-mon[32687]: from='client.14271 v1:172.21.15.97:0/1335304485' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi097:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:19:25.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:25 smithi097 ceph-mon[32687]: poll took 4728.821 ms: 1 events 2021-10-08T19:19:25.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:25 smithi097 ceph-mon[32687]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]': finished 2021-10-08T19:19:25.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:25 smithi097 ceph-mon[32687]: osdmap e12: 2 total, 1 up, 2 in 2021-10-08T19:19:25.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:25 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:19:25.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:25 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:19:25.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:25 smithi117 ceph-mon[34585]: pgmap v67: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:19:25.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:25 smithi117 ceph-mon[34585]: from='client.14271 v1:172.21.15.97:0/1335304485' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi097:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:19:25.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:25 smithi117 ceph-mon[34585]: poll took 4728.821 ms: 1 events 2021-10-08T19:19:25.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:25 smithi117 ceph-mon[34585]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]': finished 2021-10-08T19:19:25.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:25 smithi117 ceph-mon[34585]: osdmap e12: 2 total, 1 up, 2 in 2021-10-08T19:19:25.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:25 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:19:25.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:25 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:19:26.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:26 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:19:26.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:26 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:19:26.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:26 smithi097 ceph-mon[32687]: osd.1 v1:172.21.15.97:6805/735799205 boot 2021-10-08T19:19:26.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:26 smithi097 ceph-mon[32687]: osdmap e13: 2 total, 2 up, 2 in 2021-10-08T19:19:26.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:26 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:19:26.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:26 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:19:26.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:26 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:19:26.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:26 smithi097 ceph-mon[41966]: osd.1 v1:172.21.15.97:6805/735799205 boot 2021-10-08T19:19:26.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:26 smithi097 ceph-mon[41966]: osdmap e13: 2 total, 2 up, 2 in 2021-10-08T19:19:26.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:26 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:19:26.904 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:26 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:19:26.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:26 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:19:26.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:26 smithi117 ceph-mon[34585]: osd.1 v1:172.21.15.97:6805/735799205 boot 2021-10-08T19:19:26.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:26 smithi117 ceph-mon[34585]: osdmap e13: 2 total, 2 up, 2 in 2021-10-08T19:19:26.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:26 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:19:27.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:27 smithi097 ceph-mon[32687]: pgmap v70: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:19:27.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:27 smithi097 ceph-mon[32687]: osdmap e14: 2 total, 2 up, 2 in 2021-10-08T19:19:27.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:27 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1434121341' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "88e0e4a2-b4a3-4a00-8669-03c3d9b166c5"}]: dispatch 2021-10-08T19:19:27.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:27 smithi097 ceph-mon[32687]: from='client.24184 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "88e0e4a2-b4a3-4a00-8669-03c3d9b166c5"}]: dispatch 2021-10-08T19:19:27.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:27 smithi097 ceph-mon[32687]: from='client.24184 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "88e0e4a2-b4a3-4a00-8669-03c3d9b166c5"}]': finished 2021-10-08T19:19:27.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:27 smithi097 ceph-mon[32687]: osdmap e15: 3 total, 2 up, 3 in 2021-10-08T19:19:27.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:27 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-10-08T19:19:27.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:27 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/669922703' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:19:27.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:27 smithi097 ceph-mon[41966]: pgmap v70: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:19:27.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:27 smithi097 ceph-mon[41966]: osdmap e14: 2 total, 2 up, 2 in 2021-10-08T19:19:27.725 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:27 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1434121341' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "88e0e4a2-b4a3-4a00-8669-03c3d9b166c5"}]: dispatch 2021-10-08T19:19:27.725 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:27 smithi097 ceph-mon[41966]: from='client.24184 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "88e0e4a2-b4a3-4a00-8669-03c3d9b166c5"}]: dispatch 2021-10-08T19:19:27.725 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:27 smithi097 ceph-mon[41966]: from='client.24184 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "88e0e4a2-b4a3-4a00-8669-03c3d9b166c5"}]': finished 2021-10-08T19:19:27.726 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:27 smithi097 ceph-mon[41966]: osdmap e15: 3 total, 2 up, 3 in 2021-10-08T19:19:27.726 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:27 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-10-08T19:19:27.727 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:27 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/669922703' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:19:27.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:27 smithi117 ceph-mon[34585]: pgmap v70: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:19:27.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:27 smithi117 ceph-mon[34585]: osdmap e14: 2 total, 2 up, 2 in 2021-10-08T19:19:27.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:27 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1434121341' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "88e0e4a2-b4a3-4a00-8669-03c3d9b166c5"}]: dispatch 2021-10-08T19:19:27.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:27 smithi117 ceph-mon[34585]: from='client.24184 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "88e0e4a2-b4a3-4a00-8669-03c3d9b166c5"}]: dispatch 2021-10-08T19:19:27.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:27 smithi117 ceph-mon[34585]: from='client.24184 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "88e0e4a2-b4a3-4a00-8669-03c3d9b166c5"}]': finished 2021-10-08T19:19:27.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:27 smithi117 ceph-mon[34585]: osdmap e15: 3 total, 2 up, 3 in 2021-10-08T19:19:27.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:27 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-10-08T19:19:27.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:27 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/669922703' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:19:29.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:29 smithi097 ceph-mon[32687]: pgmap v73: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:19:29.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:29 smithi097 ceph-mon[41966]: pgmap v73: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:19:29.904 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:29 smithi117 ceph-mon[34585]: pgmap v73: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:19:31.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:31 smithi097 ceph-mon[32687]: pgmap v74: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:19:31.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:31 smithi097 ceph-mon[32687]: poll took 5648.397 ms: 1 events 2021-10-08T19:19:31.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:31 smithi097 ceph-mon[41966]: pgmap v74: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:19:31.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:31 smithi097 ceph-mon[41966]: poll took 5648.397 ms: 1 events 2021-10-08T19:19:31.904 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:31 smithi117 ceph-mon[34585]: pgmap v74: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:19:31.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:31 smithi117 ceph-mon[34585]: poll took 5648.397 ms: 1 events 2021-10-08T19:19:33.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:33 smithi097 ceph-mon[32687]: pgmap v75: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:19:33.719 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:33 smithi097 ceph-mon[41966]: pgmap v75: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:19:33.904 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:33 smithi117 ceph-mon[34585]: pgmap v75: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:19:34.214 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:19:33 smithi097 conmon[33110]: 172.21.15.97 - - [08/Oct/2021:19:19:33] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:19:34.469 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:34 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2021-10-08T19:19:34.469 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:34 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:19:34.469 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:34 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:34.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:34 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2021-10-08T19:19:34.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:34 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:19:34.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:34 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:34.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:34 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2021-10-08T19:19:34.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:34 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:19:34.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:34 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:35.453 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:35 smithi097 ceph-mon[32687]: poll took 2847.305 ms: 1 events 2021-10-08T19:19:35.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:35 smithi117 ceph-mon[34585]: poll took 2847.305 ms: 1 events 2021-10-08T19:19:35.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:35 smithi117 ceph-mon[34585]: Deploying daemon osd.2 on smithi097 2021-10-08T19:19:35.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:35 smithi117 ceph-mon[34585]: Detected new or changed devices on smithi097 2021-10-08T19:19:35.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:35 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:19:35.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:35 smithi117 ceph-mon[34585]: 172.21.15.97 - - [08/Oct/2021:19:19:33] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:19:35.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:35 smithi117 ceph-mon[34585]: pgmap v76: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:19:35.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:35 smithi097 ceph-mon[32687]: Deploying daemon osd.2 on smithi097 2021-10-08T19:19:35.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:35 smithi097 ceph-mon[32687]: Detected new or changed devices on smithi097 2021-10-08T19:19:35.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:35 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:19:35.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:35 smithi097 ceph-mon[32687]: 172.21.15.97 - - [08/Oct/2021:19:19:33] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:19:35.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:35 smithi097 ceph-mon[32687]: pgmap v76: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:19:35.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:35 smithi097 ceph-mon[41966]: poll took 2847.305 ms: 1 events 2021-10-08T19:19:35.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:35 smithi097 ceph-mon[41966]: Deploying daemon osd.2 on smithi097 2021-10-08T19:19:35.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:35 smithi097 ceph-mon[41966]: Detected new or changed devices on smithi097 2021-10-08T19:19:35.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:35 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:19:35.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:35 smithi097 ceph-mon[41966]: 172.21.15.97 - - [08/Oct/2021:19:19:33] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:19:35.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:35 smithi097 ceph-mon[41966]: pgmap v76: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:19:37.249 INFO:teuthology.orchestra.run.smithi097.stdout:Created osd(s) 2 on host 'smithi097' 2021-10-08T19:19:37.715 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:37 smithi097 ceph-mon[32687]: pgmap v77: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:19:37.716 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:37 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:19:37.716 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:37 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:19:37.716 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:37 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:37.717 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:37 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:19:37.717 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:37 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:19:37.717 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:37 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:37.717 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:37 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:19:37.718 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:37 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:19:37.718 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:37 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:37.718 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:37 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:37.718 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:37 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:19:37.718 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:37 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:19:37.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:37 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:19:37.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:37 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:37.719 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:37 smithi097 ceph-mon[41966]: pgmap v77: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:19:37.719 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:37 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:19:37.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:37 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:19:37.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:37 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:37.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:37 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:19:37.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:37 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:19:37.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:37 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:37.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:37 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:19:37.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:37 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:19:37.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:37 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:37.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:37 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:37.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:37 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:19:37.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:37 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:19:37.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:37 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:19:37.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:37 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:37.794 DEBUG:teuthology.orchestra.run.smithi097:osd.2> sudo journalctl -f -n 0 -u ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@osd.2.service 2021-10-08T19:19:37.796 INFO:tasks.cephadm:Deploying osd.3 on smithi097 with /dev/vg_nvme/lv_1... 2021-10-08T19:19:37.797 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2021-10-08T19:19:37.831 INFO:journalctl@ceph.osd.2.smithi097.stdout:-- Logs begin at Fri 2021-10-08 19:07:18 UTC. -- 2021-10-08T19:19:37.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:37 smithi117 ceph-mon[34585]: pgmap v77: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:19:37.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:37 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:19:37.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:37 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:19:37.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:37 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:37.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:37 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:19:37.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:37 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:19:37.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:37 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:37.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:37 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:19:37.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:37 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:19:37.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:37 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:37.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:37 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:37.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:37 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:19:37.908 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:37 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:19:37.908 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:37 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:19:37.908 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:37 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:38.563 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:19:38 smithi097 conmon[33110]: 172.21.15.117 - - [08/Oct/2021:19:19:38] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:19:38.563 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:38 smithi097 ceph-mon[32687]: poll took 3207.444 ms: 1 events 2021-10-08T19:19:38.564 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:38 smithi097 ceph-mon[32687]: Adjusting osd_memory_target on smithi097 to 5041M 2021-10-08T19:19:38.564 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:38 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:38.565 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:38 smithi097 ceph-mon[41966]: poll took 3207.444 ms: 1 events 2021-10-08T19:19:38.565 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:38 smithi097 ceph-mon[41966]: Adjusting osd_memory_target on smithi097 to 5041M 2021-10-08T19:19:38.565 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:38 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:38.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:38 smithi117 ceph-mon[34585]: poll took 3207.444 ms: 1 events 2021-10-08T19:19:38.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:38 smithi117 ceph-mon[34585]: Adjusting osd_memory_target on smithi097 to 5041M 2021-10-08T19:19:38.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:38 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:39.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:39 smithi097 ceph-mon[32687]: pgmap v78: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:19:39.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:39 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:19:39.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:39 smithi097 ceph-mon[32687]: 172.21.15.117 - - [08/Oct/2021:19:19:38] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:19:39.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:39 smithi097 ceph-mon[41966]: pgmap v78: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:19:39.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:39 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:19:39.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:39 smithi097 ceph-mon[41966]: 172.21.15.117 - - [08/Oct/2021:19:19:38] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:19:39.729 INFO:teuthology.orchestra.run.smithi097.stderr:--> Zapping: /dev/vg_nvme/lv_1 2021-10-08T19:19:39.729 INFO:teuthology.orchestra.run.smithi097.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2021-10-08T19:19:39.729 INFO:teuthology.orchestra.run.smithi097.stderr: stderr: 10+0 records in 2021-10-08T19:19:39.729 INFO:teuthology.orchestra.run.smithi097.stderr:10+0 records out 2021-10-08T19:19:39.730 INFO:teuthology.orchestra.run.smithi097.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0124608 s, 842 MB/s 2021-10-08T19:19:39.730 INFO:teuthology.orchestra.run.smithi097.stderr:--> Zapping successful for: 2021-10-08T19:19:39.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:39 smithi117 ceph-mon[34585]: pgmap v78: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:19:39.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:39 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:19:39.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:39 smithi117 ceph-mon[34585]: 172.21.15.117 - - [08/Oct/2021:19:19:38] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:19:40.295 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph orch daemon add osd smithi097:vg_nvme/lv_1 2021-10-08T19:19:40.719 INFO:journalctl@ceph.osd.2.smithi097.stdout:Oct 08 19:19:40 smithi097 conmon[55904]: 2021-10-08T19:19:40.476+0000 7f59c174a0c0 -1 osd.2 0 log_to_monitors {default=true} 2021-10-08T19:19:41.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:41 smithi097 ceph-mon[32687]: pgmap v79: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:19:41.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:41 smithi097 ceph-mon[32687]: from='osd.2 v1:172.21.15.97:6809/2366482649' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-10-08T19:19:41.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:41 smithi097 ceph-mon[41966]: pgmap v79: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:19:41.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:41 smithi097 ceph-mon[41966]: from='osd.2 v1:172.21.15.97:6809/2366482649' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-10-08T19:19:41.904 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:41 smithi117 ceph-mon[34585]: pgmap v79: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:19:41.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:41 smithi117 ceph-mon[34585]: from='osd.2 v1:172.21.15.97:6809/2366482649' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-10-08T19:19:42.904 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:42 smithi117 ceph-mon[34585]: from='osd.2 v1:172.21.15.97:6809/2366482649' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-10-08T19:19:42.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:42 smithi117 ceph-mon[34585]: osdmap e16: 3 total, 2 up, 3 in 2021-10-08T19:19:42.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:42 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-10-08T19:19:42.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:42 smithi117 ceph-mon[34585]: from='osd.2 v1:172.21.15.97:6809/2366482649' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]: dispatch 2021-10-08T19:19:42.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:42 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:19:42.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:42 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:19:42.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:42 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:19:42.923 INFO:journalctl@ceph.osd.2.smithi097.stdout:Oct 08 19:19:42 smithi097 conmon[55904]: 2021-10-08T19:19:42.490+0000 7f59b7ef2700 -1 osd.2 0 waiting for initial osdmap 2021-10-08T19:19:42.923 INFO:journalctl@ceph.osd.2.smithi097.stdout:Oct 08 19:19:42 smithi097 conmon[55904]: 2021-10-08T19:19:42.493+0000 7f59b2088700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-10-08T19:19:42.924 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:42 smithi097 ceph-mon[32687]: from='osd.2 v1:172.21.15.97:6809/2366482649' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-10-08T19:19:42.924 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:42 smithi097 ceph-mon[32687]: osdmap e16: 3 total, 2 up, 3 in 2021-10-08T19:19:42.924 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:42 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-10-08T19:19:42.924 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:42 smithi097 ceph-mon[32687]: from='osd.2 v1:172.21.15.97:6809/2366482649' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]: dispatch 2021-10-08T19:19:42.925 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:42 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:19:42.925 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:42 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:19:42.925 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:42 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:19:42.925 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:42 smithi097 ceph-mon[41966]: from='osd.2 v1:172.21.15.97:6809/2366482649' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-10-08T19:19:42.926 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:42 smithi097 ceph-mon[41966]: osdmap e16: 3 total, 2 up, 3 in 2021-10-08T19:19:42.926 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:42 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-10-08T19:19:42.926 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:42 smithi097 ceph-mon[41966]: from='osd.2 v1:172.21.15.97:6809/2366482649' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]: dispatch 2021-10-08T19:19:42.926 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:42 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:19:42.927 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:42 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:19:42.927 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:42 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:19:43.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:43 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:19:43.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:43 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:19:43.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:43 smithi117 ceph-mon[34585]: pgmap v81: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:19:43.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:43 smithi117 ceph-mon[34585]: from='client.14298 v1:172.21.15.97:0/316697689' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi097:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:19:43.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:43 smithi117 ceph-mon[34585]: poll took 4861.148 ms: 1 events 2021-10-08T19:19:43.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:43 smithi117 ceph-mon[34585]: from='osd.2 v1:172.21.15.97:6809/2366482649' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]': finished 2021-10-08T19:19:43.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:43 smithi117 ceph-mon[34585]: osdmap e17: 3 total, 2 up, 3 in 2021-10-08T19:19:43.908 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:43 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-10-08T19:19:43.908 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:43 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-10-08T19:19:43.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:43 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:19:43.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:43 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:19:43.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:43 smithi097 ceph-mon[32687]: pgmap v81: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:19:43.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:43 smithi097 ceph-mon[32687]: from='client.14298 v1:172.21.15.97:0/316697689' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi097:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:19:43.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:43 smithi097 ceph-mon[32687]: poll took 4861.148 ms: 1 events 2021-10-08T19:19:43.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:43 smithi097 ceph-mon[32687]: from='osd.2 v1:172.21.15.97:6809/2366482649' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]': finished 2021-10-08T19:19:43.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:43 smithi097 ceph-mon[32687]: osdmap e17: 3 total, 2 up, 3 in 2021-10-08T19:19:43.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:43 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-10-08T19:19:43.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:43 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-10-08T19:19:43.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:43 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:19:43.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:43 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:19:43.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:43 smithi097 ceph-mon[41966]: pgmap v81: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:19:43.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:43 smithi097 ceph-mon[41966]: from='client.14298 v1:172.21.15.97:0/316697689' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi097:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:19:43.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:43 smithi097 ceph-mon[41966]: poll took 4861.148 ms: 1 events 2021-10-08T19:19:43.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:43 smithi097 ceph-mon[41966]: from='osd.2 v1:172.21.15.97:6809/2366482649' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]': finished 2021-10-08T19:19:43.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:43 smithi097 ceph-mon[41966]: osdmap e17: 3 total, 2 up, 3 in 2021-10-08T19:19:43.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:43 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-10-08T19:19:43.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:43 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-10-08T19:19:44.904 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:44 smithi117 ceph-mon[34585]: osd.2 v1:172.21.15.97:6809/2366482649 boot 2021-10-08T19:19:44.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:44 smithi117 ceph-mon[34585]: osdmap e18: 3 total, 3 up, 3 in 2021-10-08T19:19:44.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:44 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-10-08T19:19:44.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:44 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1}]: dispatch 2021-10-08T19:19:44.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:44 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2025760973' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e689d708-b501-4526-a31a-1e598b74654d"}]: dispatch 2021-10-08T19:19:44.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:44 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1}]': finished 2021-10-08T19:19:44.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:44 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2025760973' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e689d708-b501-4526-a31a-1e598b74654d"}]': finished 2021-10-08T19:19:44.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:44 smithi117 ceph-mon[34585]: osdmap e19: 4 total, 3 up, 4 in 2021-10-08T19:19:44.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:44 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:19:44.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:44 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:19:44.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:44 smithi097 ceph-mon[32687]: osd.2 v1:172.21.15.97:6809/2366482649 boot 2021-10-08T19:19:44.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:44 smithi097 ceph-mon[32687]: osdmap e18: 3 total, 3 up, 3 in 2021-10-08T19:19:44.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:44 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-10-08T19:19:44.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:44 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1}]: dispatch 2021-10-08T19:19:44.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:44 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2025760973' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e689d708-b501-4526-a31a-1e598b74654d"}]: dispatch 2021-10-08T19:19:44.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:44 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1}]': finished 2021-10-08T19:19:44.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:44 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2025760973' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e689d708-b501-4526-a31a-1e598b74654d"}]': finished 2021-10-08T19:19:44.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:44 smithi097 ceph-mon[32687]: osdmap e19: 4 total, 3 up, 4 in 2021-10-08T19:19:44.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:44 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:19:44.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:44 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:19:44.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:44 smithi097 ceph-mon[41966]: osd.2 v1:172.21.15.97:6809/2366482649 boot 2021-10-08T19:19:44.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:44 smithi097 ceph-mon[41966]: osdmap e18: 3 total, 3 up, 3 in 2021-10-08T19:19:44.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:44 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-10-08T19:19:44.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:44 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1}]: dispatch 2021-10-08T19:19:44.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:44 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2025760973' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e689d708-b501-4526-a31a-1e598b74654d"}]: dispatch 2021-10-08T19:19:44.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:44 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1}]': finished 2021-10-08T19:19:44.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:44 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2025760973' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e689d708-b501-4526-a31a-1e598b74654d"}]': finished 2021-10-08T19:19:44.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:44 smithi097 ceph-mon[41966]: osdmap e19: 4 total, 3 up, 4 in 2021-10-08T19:19:44.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:44 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:19:44.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:44 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:19:45.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:45 smithi117 ceph-mon[34585]: pgmap v84: 0 pgs: ; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:19:45.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:45 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2631372985' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:19:45.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:45 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2021-10-08T19:19:45.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:45 smithi117 ceph-mon[34585]: osdmap e20: 4 total, 3 up, 4 in 2021-10-08T19:19:45.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:45 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:19:45.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:45 smithi097 ceph-mon[32687]: pgmap v84: 0 pgs: ; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:19:45.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:45 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2631372985' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:19:45.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:45 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2021-10-08T19:19:45.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:45 smithi097 ceph-mon[32687]: osdmap e20: 4 total, 3 up, 4 in 2021-10-08T19:19:45.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:45 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:19:45.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:45 smithi097 ceph-mon[41966]: pgmap v84: 0 pgs: ; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:19:45.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:45 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2631372985' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:19:45.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:45 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2021-10-08T19:19:45.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:45 smithi097 ceph-mon[41966]: osdmap e20: 4 total, 3 up, 4 in 2021-10-08T19:19:45.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:45 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:19:46.247 INFO:journalctl@ceph.osd.0.smithi097.stdout:Oct 08 19:19:45 smithi097 sudo[57874]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2021-10-08T19:19:46.247 INFO:journalctl@ceph.osd.0.smithi097.stdout:Oct 08 19:19:45 smithi097 sudo[57874]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2021-10-08T19:19:46.247 INFO:journalctl@ceph.osd.0.smithi097.stdout:Oct 08 19:19:45 smithi097 sudo[57874]: pam_unix(sudo:session): session opened for user root by (uid=0) 2021-10-08T19:19:46.248 INFO:journalctl@ceph.osd.0.smithi097.stdout:Oct 08 19:19:46 smithi097 sudo[57874]: pam_unix(sudo:session): session closed for user root 2021-10-08T19:19:46.514 INFO:journalctl@ceph.osd.0.smithi097.stdout:Oct 08 19:19:46 smithi097 sudo[57879]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2021-10-08T19:19:46.514 INFO:journalctl@ceph.osd.0.smithi097.stdout:Oct 08 19:19:46 smithi097 sudo[57879]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2021-10-08T19:19:46.515 INFO:journalctl@ceph.osd.0.smithi097.stdout:Oct 08 19:19:46 smithi097 sudo[57879]: pam_unix(sudo:session): session opened for user root by (uid=0) 2021-10-08T19:19:46.515 INFO:journalctl@ceph.osd.0.smithi097.stdout:Oct 08 19:19:46 smithi097 sudo[57879]: pam_unix(sudo:session): session closed for user root 2021-10-08T19:19:46.773 INFO:journalctl@ceph.osd.1.smithi097.stdout:Oct 08 19:19:46 smithi097 sudo[58069]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2021-10-08T19:19:46.773 INFO:journalctl@ceph.osd.1.smithi097.stdout:Oct 08 19:19:46 smithi097 sudo[58069]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2021-10-08T19:19:46.773 INFO:journalctl@ceph.osd.1.smithi097.stdout:Oct 08 19:19:46 smithi097 sudo[58069]: pam_unix(sudo:session): session opened for user root by (uid=0) 2021-10-08T19:19:46.774 INFO:journalctl@ceph.osd.1.smithi097.stdout:Oct 08 19:19:46 smithi097 sudo[58069]: pam_unix(sudo:session): session closed for user root 2021-10-08T19:19:47.033 INFO:journalctl@ceph.osd.1.smithi097.stdout:Oct 08 19:19:46 smithi097 sudo[58265]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2021-10-08T19:19:47.033 INFO:journalctl@ceph.osd.1.smithi097.stdout:Oct 08 19:19:46 smithi097 sudo[58265]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2021-10-08T19:19:47.033 INFO:journalctl@ceph.osd.1.smithi097.stdout:Oct 08 19:19:46 smithi097 sudo[58265]: pam_unix(sudo:session): session opened for user root by (uid=0) 2021-10-08T19:19:47.033 INFO:journalctl@ceph.osd.1.smithi097.stdout:Oct 08 19:19:46 smithi097 sudo[58265]: pam_unix(sudo:session): session closed for user root 2021-10-08T19:19:47.034 INFO:journalctl@ceph.osd.2.smithi097.stdout:Oct 08 19:19:47 smithi097 sudo[58270]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2021-10-08T19:19:47.034 INFO:journalctl@ceph.osd.2.smithi097.stdout:Oct 08 19:19:47 smithi097 sudo[58270]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2021-10-08T19:19:47.034 INFO:journalctl@ceph.osd.2.smithi097.stdout:Oct 08 19:19:47 smithi097 sudo[58270]: pam_unix(sudo:session): session opened for user root by (uid=0) 2021-10-08T19:19:47.035 INFO:journalctl@ceph.osd.2.smithi097.stdout:Oct 08 19:19:47 smithi097 sudo[58270]: pam_unix(sudo:session): session closed for user root 2021-10-08T19:19:47.285 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:47 smithi097 ceph-mon[32687]: pgmap v87: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:19:47.285 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:47 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:47.286 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:47 smithi097 ceph-mon[32687]: osdmap e21: 4 total, 3 up, 4 in 2021-10-08T19:19:47.286 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:47 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:19:47.286 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:47 smithi097 ceph-mon[41966]: pgmap v87: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:19:47.287 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:47 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:47.287 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:47 smithi097 ceph-mon[41966]: osdmap e21: 4 total, 3 up, 4 in 2021-10-08T19:19:47.287 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:47 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:19:47.544 INFO:journalctl@ceph.osd.2.smithi097.stdout:Oct 08 19:19:47 smithi097 sudo[58294]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2021-10-08T19:19:47.545 INFO:journalctl@ceph.osd.2.smithi097.stdout:Oct 08 19:19:47 smithi097 sudo[58294]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2021-10-08T19:19:47.545 INFO:journalctl@ceph.osd.2.smithi097.stdout:Oct 08 19:19:47 smithi097 sudo[58294]: pam_unix(sudo:session): session opened for user root by (uid=0) 2021-10-08T19:19:47.545 INFO:journalctl@ceph.osd.2.smithi097.stdout:Oct 08 19:19:47 smithi097 sudo[58294]: pam_unix(sudo:session): session closed for user root 2021-10-08T19:19:47.654 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:47 smithi117 ceph-mon[34585]: pgmap v87: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:19:47.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:47 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:47.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:47 smithi117 ceph-mon[34585]: osdmap e21: 4 total, 3 up, 4 in 2021-10-08T19:19:47.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:47 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:19:47.799 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:47 smithi097 sudo[58333]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2021-10-08T19:19:47.799 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:47 smithi097 sudo[58333]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2021-10-08T19:19:47.800 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:47 smithi097 sudo[58333]: pam_unix(sudo:session): session opened for user root by (uid=0) 2021-10-08T19:19:47.800 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:47 smithi097 sudo[58333]: pam_unix(sudo:session): session closed for user root 2021-10-08T19:19:48.055 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:47 smithi097 sudo[58336]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2021-10-08T19:19:48.056 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:47 smithi097 sudo[58336]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2021-10-08T19:19:48.056 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:47 smithi097 sudo[58336]: pam_unix(sudo:session): session opened for user root by (uid=0) 2021-10-08T19:19:48.056 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:47 smithi097 sudo[58336]: pam_unix(sudo:session): session closed for user root 2021-10-08T19:19:48.328 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:48 smithi097 sudo[58372]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2021-10-08T19:19:48.328 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:48 smithi097 sudo[58372]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2021-10-08T19:19:48.329 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:48 smithi097 sudo[58372]: pam_unix(sudo:session): session opened for user root by (uid=0) 2021-10-08T19:19:48.329 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:48 smithi097 sudo[58372]: pam_unix(sudo:session): session closed for user root 2021-10-08T19:19:48.591 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:48 smithi117 ceph-mon[34585]: mgrmap e15: y(active, since 2m), standbys: x 2021-10-08T19:19:48.592 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:48 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:19:48.592 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:48 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:19:48.592 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:48 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:19:48.593 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:48 smithi117 ceph-mon[34585]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2021-10-08T19:19:48.593 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:48 smithi117 ceph-mon[34585]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2021-10-08T19:19:48.593 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:48 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:19:48.593 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:48 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:19:48.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:48 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:19:48.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:48 smithi117 sudo[38713]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2021-10-08T19:19:48.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:48 smithi117 sudo[38713]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2021-10-08T19:19:48.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:48 smithi117 sudo[38713]: pam_unix(sudo:session): session opened for user root by (uid=0) 2021-10-08T19:19:48.595 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:48 smithi117 sudo[38713]: pam_unix(sudo:session): session closed for user root 2021-10-08T19:19:48.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:48 smithi097 ceph-mon[32687]: mgrmap e15: y(active, since 2m), standbys: x 2021-10-08T19:19:48.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:48 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:19:48.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:48 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:19:48.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:48 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:19:48.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:48 smithi097 ceph-mon[32687]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2021-10-08T19:19:48.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:48 smithi097 ceph-mon[32687]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2021-10-08T19:19:48.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:48 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:19:48.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:48 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:19:48.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:48 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:19:48.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:48 smithi097 sudo[58491]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2021-10-08T19:19:48.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:48 smithi097 sudo[58491]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2021-10-08T19:19:48.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:48 smithi097 sudo[58491]: pam_unix(sudo:session): session opened for user root by (uid=0) 2021-10-08T19:19:48.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:48 smithi097 sudo[58491]: pam_unix(sudo:session): session closed for user root 2021-10-08T19:19:48.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:48 smithi097 ceph-mon[41966]: mgrmap e15: y(active, since 2m), standbys: x 2021-10-08T19:19:48.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:48 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:19:48.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:48 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:19:48.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:48 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:19:48.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:48 smithi097 ceph-mon[41966]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2021-10-08T19:19:48.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:48 smithi097 ceph-mon[41966]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2021-10-08T19:19:48.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:48 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:19:48.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:48 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:19:48.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:48 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:19:48.904 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:48 smithi117 sudo[38716]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2021-10-08T19:19:48.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:48 smithi117 sudo[38716]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2021-10-08T19:19:48.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:48 smithi117 sudo[38716]: pam_unix(sudo:session): session opened for user root by (uid=0) 2021-10-08T19:19:48.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:48 smithi117 sudo[38716]: pam_unix(sudo:session): session closed for user root 2021-10-08T19:19:49.587 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:49 smithi097 ceph-mon[41966]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2021-10-08T19:19:49.588 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:49 smithi097 ceph-mon[41966]: poll took 5511.609 ms: 1 events 2021-10-08T19:19:49.588 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:49 smithi097 ceph-mon[41966]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 16 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:19:49.588 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:49 smithi097 ceph-mon[41966]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2021-10-08T19:19:49.588 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:49 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:19:49.588 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:49 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:19:49.589 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:49 smithi097 ceph-mon[41966]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2021-10-08T19:19:49.589 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:49 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:19:49.589 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:49 smithi097 ceph-mon[41966]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2021-10-08T19:19:49.589 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:49 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:49.590 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:49 smithi097 ceph-mon[32687]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2021-10-08T19:19:49.590 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:49 smithi097 ceph-mon[32687]: poll took 5511.609 ms: 1 events 2021-10-08T19:19:49.590 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:49 smithi097 ceph-mon[32687]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 16 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:19:49.590 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:49 smithi097 ceph-mon[32687]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2021-10-08T19:19:49.591 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:49 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:19:49.591 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:49 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:19:49.591 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:49 smithi097 ceph-mon[32687]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2021-10-08T19:19:49.591 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:49 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:19:49.591 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:49 smithi097 ceph-mon[32687]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2021-10-08T19:19:49.592 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:49 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:49.654 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:49 smithi117 ceph-mon[34585]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2021-10-08T19:19:49.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:49 smithi117 ceph-mon[34585]: poll took 5511.609 ms: 1 events 2021-10-08T19:19:49.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:49 smithi117 ceph-mon[34585]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 16 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:19:49.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:49 smithi117 ceph-mon[34585]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2021-10-08T19:19:49.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:49 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:19:49.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:49 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:19:49.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:49 smithi117 ceph-mon[34585]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2021-10-08T19:19:49.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:49 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:19:49.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:49 smithi117 ceph-mon[34585]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2021-10-08T19:19:49.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:49 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:51.433 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:51 smithi097 ceph-mon[41966]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:19:51.433 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:51 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2021-10-08T19:19:51.433 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:51 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:19:51.434 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:51 smithi097 ceph-mon[32687]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:19:51.434 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:51 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2021-10-08T19:19:51.434 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:51 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:19:51.654 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:51 smithi117 ceph-mon[34585]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:19:51.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:51 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2021-10-08T19:19:51.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:51 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:19:52.651 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:52 smithi097 ceph-mon[32687]: poll took 2364.498 ms: 1 events 2021-10-08T19:19:52.651 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:52 smithi097 ceph-mon[32687]: Deploying daemon osd.3 on smithi097 2021-10-08T19:19:52.652 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:52 smithi097 ceph-mon[41966]: poll took 2364.498 ms: 1 events 2021-10-08T19:19:52.652 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:52 smithi097 ceph-mon[41966]: Deploying daemon osd.3 on smithi097 2021-10-08T19:19:52.654 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:52 smithi117 ceph-mon[34585]: poll took 2364.498 ms: 1 events 2021-10-08T19:19:52.654 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:52 smithi117 ceph-mon[34585]: Deploying daemon osd.3 on smithi097 2021-10-08T19:19:53.654 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:53 smithi117 ceph-mon[34585]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 142 KiB/s wr, 10 op/s 2021-10-08T19:19:53.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:53 smithi097 ceph-mon[32687]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 142 KiB/s wr, 10 op/s 2021-10-08T19:19:53.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:53 smithi097 ceph-mon[41966]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 142 KiB/s wr, 10 op/s 2021-10-08T19:19:54.141 INFO:teuthology.orchestra.run.smithi097.stdout:Created osd(s) 3 on host 'smithi097' 2021-10-08T19:19:54.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:54 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:19:54.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:54 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:19:54.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:54 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:54.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:54 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:19:54.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:54 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:19:54.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:54 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:54.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:54 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:19:54.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:54 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:19:54.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:54 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:19:54.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:54 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:54.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:54 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:54.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:54 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:19:54.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:54 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:19:54.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:54 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:19:54.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:54 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:54.681 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:54 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:19:54.681 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:54 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:19:54.681 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:54 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:54.681 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:54 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:19:54.682 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:54 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:19:54.682 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:54 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:54.683 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:54 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:19:54.684 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:54 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:19:54.684 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:54 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:19:54.684 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:54 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:54.684 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:54 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:54.685 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:54 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:19:54.685 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:54 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:19:54.685 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:54 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:19:54.685 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:54 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:54.686 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:54 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:19:54.686 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:54 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:19:54.686 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:54 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:54.687 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:54 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:19:54.687 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:54 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:19:54.687 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:54 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:54.687 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:54 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:19:54.687 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:54 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:19:54.688 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:54 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:19:54.688 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:54 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:54.688 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:54 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:54.688 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:54 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:19:54.689 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:54 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:19:54.689 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:54 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:19:54.689 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:54 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:54.935 DEBUG:teuthology.orchestra.run.smithi097:osd.3> sudo journalctl -f -n 0 -u ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@osd.3.service 2021-10-08T19:19:54.938 INFO:tasks.cephadm:Deploying osd.4 on smithi117 with /dev/vg_nvme/lv_4... 2021-10-08T19:19:54.939 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2021-10-08T19:19:54.965 INFO:journalctl@ceph.osd.3.smithi097.stdout:-- Logs begin at Fri 2021-10-08 19:07:18 UTC. -- 2021-10-08T19:19:55.654 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:55 smithi117 ceph-mon[34585]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 104 KiB/s wr, 7 op/s 2021-10-08T19:19:55.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:55 smithi117 ceph-mon[34585]: poll took 3178.141 ms: 1 events 2021-10-08T19:19:55.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:55 smithi117 ceph-mon[34585]: Adjusting osd_memory_target on smithi097 to 3781M 2021-10-08T19:19:55.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:55 smithi097 ceph-mon[32687]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 104 KiB/s wr, 7 op/s 2021-10-08T19:19:55.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:55 smithi097 ceph-mon[32687]: poll took 3178.141 ms: 1 events 2021-10-08T19:19:55.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:55 smithi097 ceph-mon[32687]: Adjusting osd_memory_target on smithi097 to 3781M 2021-10-08T19:19:55.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:55 smithi097 ceph-mon[41966]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 104 KiB/s wr, 7 op/s 2021-10-08T19:19:55.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:55 smithi097 ceph-mon[41966]: poll took 3178.141 ms: 1 events 2021-10-08T19:19:55.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:55 smithi097 ceph-mon[41966]: Adjusting osd_memory_target on smithi097 to 3781M 2021-10-08T19:19:56.872 INFO:teuthology.orchestra.run.smithi117.stderr:--> Zapping: /dev/vg_nvme/lv_4 2021-10-08T19:19:56.872 INFO:teuthology.orchestra.run.smithi117.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2021-10-08T19:19:56.872 INFO:teuthology.orchestra.run.smithi117.stderr: stderr: 10+0 records in 2021-10-08T19:19:56.872 INFO:teuthology.orchestra.run.smithi117.stderr:10+0 records out 2021-10-08T19:19:56.873 INFO:teuthology.orchestra.run.smithi117.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0109811 s, 955 MB/s 2021-10-08T19:19:56.873 INFO:teuthology.orchestra.run.smithi117.stderr:--> Zapping successful for: 2021-10-08T19:19:57.434 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph orch daemon add osd smithi117:vg_nvme/lv_4 2021-10-08T19:19:57.654 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:57 smithi117 ceph-mon[34585]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 82 KiB/s wr, 5 op/s 2021-10-08T19:19:57.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:57 smithi117 ceph-mon[34585]: from='osd.3 v1:172.21.15.97:6813/3191181122' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-10-08T19:19:57.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:57 smithi117 ceph-mon[34585]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-10-08T19:19:57.719 INFO:journalctl@ceph.osd.3.smithi097.stdout:Oct 08 19:19:57 smithi097 conmon[59546]: 2021-10-08T19:19:57.325+0000 7facbe9120c0 -1 osd.3 0 log_to_monitors {default=true} 2021-10-08T19:19:57.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:57 smithi097 ceph-mon[32687]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 82 KiB/s wr, 5 op/s 2021-10-08T19:19:57.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:57 smithi097 ceph-mon[32687]: from='osd.3 v1:172.21.15.97:6813/3191181122' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-10-08T19:19:57.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:57 smithi097 ceph-mon[32687]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-10-08T19:19:57.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:57 smithi097 ceph-mon[41966]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 82 KiB/s wr, 5 op/s 2021-10-08T19:19:57.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:57 smithi097 ceph-mon[41966]: from='osd.3 v1:172.21.15.97:6813/3191181122' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-10-08T19:19:57.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:57 smithi097 ceph-mon[41966]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-10-08T19:19:58.406 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:19:58 smithi097 conmon[33110]: 172.21.15.97 - - [08/Oct/2021:19:19:58] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:19:58.407 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:58 smithi097 ceph-mon[32687]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-10-08T19:19:58.407 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:58 smithi097 ceph-mon[32687]: osdmap e22: 4 total, 3 up, 4 in 2021-10-08T19:19:58.407 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:58 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:19:58.408 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:58 smithi097 ceph-mon[32687]: from='osd.3 v1:172.21.15.97:6813/3191181122' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]: dispatch 2021-10-08T19:19:58.408 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:58 smithi097 ceph-mon[32687]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]: dispatch 2021-10-08T19:19:58.408 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:58 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:58.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:58 smithi117 ceph-mon[34585]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-10-08T19:19:58.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:58 smithi117 ceph-mon[34585]: osdmap e22: 4 total, 3 up, 4 in 2021-10-08T19:19:58.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:58 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:19:58.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:58 smithi117 ceph-mon[34585]: from='osd.3 v1:172.21.15.97:6813/3191181122' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]: dispatch 2021-10-08T19:19:58.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:58 smithi117 ceph-mon[34585]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]: dispatch 2021-10-08T19:19:58.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:58 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:58.719 INFO:journalctl@ceph.osd.3.smithi097.stdout:Oct 08 19:19:58 smithi097 conmon[59546]: 2021-10-08T19:19:58.407+0000 7facb50ba700 -1 osd.3 0 waiting for initial osdmap 2021-10-08T19:19:58.719 INFO:journalctl@ceph.osd.3.smithi097.stdout:Oct 08 19:19:58 smithi097 conmon[59546]: 2021-10-08T19:19:58.413+0000 7facae24e700 -1 osd.3 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-10-08T19:19:58.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:58 smithi097 ceph-mon[41966]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-10-08T19:19:58.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:58 smithi097 ceph-mon[41966]: osdmap e22: 4 total, 3 up, 4 in 2021-10-08T19:19:58.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:58 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:19:58.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:58 smithi097 ceph-mon[41966]: from='osd.3 v1:172.21.15.97:6813/3191181122' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]: dispatch 2021-10-08T19:19:58.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:58 smithi097 ceph-mon[41966]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]: dispatch 2021-10-08T19:19:58.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:58 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:19:59.654 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:59 smithi117 ceph-mon[34585]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2021-10-08T19:19:59.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:59 smithi117 ceph-mon[34585]: Detected new or changed devices on smithi097 2021-10-08T19:19:59.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:59 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:19:59.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:59 smithi117 ceph-mon[34585]: 172.21.15.97 - - [08/Oct/2021:19:19:58] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:19:59.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:59 smithi117 ceph-mon[34585]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]': finished 2021-10-08T19:19:59.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:59 smithi117 ceph-mon[34585]: osdmap e23: 4 total, 3 up, 4 in 2021-10-08T19:19:59.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:59 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:19:59.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:59 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:19:59.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:19:59 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:19:59.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:59 smithi097 ceph-mon[32687]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2021-10-08T19:19:59.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:59 smithi097 ceph-mon[32687]: Detected new or changed devices on smithi097 2021-10-08T19:19:59.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:59 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:19:59.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:59 smithi097 ceph-mon[32687]: 172.21.15.97 - - [08/Oct/2021:19:19:58] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:19:59.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:59 smithi097 ceph-mon[32687]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]': finished 2021-10-08T19:19:59.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:59 smithi097 ceph-mon[32687]: osdmap e23: 4 total, 3 up, 4 in 2021-10-08T19:19:59.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:59 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:19:59.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:59 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:19:59.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:19:59 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:19:59.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:59 smithi097 ceph-mon[41966]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2021-10-08T19:19:59.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:59 smithi097 ceph-mon[41966]: Detected new or changed devices on smithi097 2021-10-08T19:19:59.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:59 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:19:59.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:59 smithi097 ceph-mon[41966]: 172.21.15.97 - - [08/Oct/2021:19:19:58] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:19:59.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:59 smithi097 ceph-mon[41966]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]': finished 2021-10-08T19:19:59.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:59 smithi097 ceph-mon[41966]: osdmap e23: 4 total, 3 up, 4 in 2021-10-08T19:19:59.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:59 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:19:59.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:59 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:19:59.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:19:59 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:20:00.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:00 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:20:00.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:00 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:20:00.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:00 smithi097 ceph-mon[32687]: osd.3 v1:172.21.15.97:6813/3191181122 boot 2021-10-08T19:20:00.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:00 smithi097 ceph-mon[32687]: osdmap e24: 4 total, 4 up, 4 in 2021-10-08T19:20:00.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:00 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:20:00.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:00 smithi097 ceph-mon[32687]: from='client.34232 v1:172.21.15.117:0/1984605500' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:20:00.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:00 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:20:00.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:00 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:20:00.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:00 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:20:00.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:00 smithi097 ceph-mon[32687]: poll took 5370.286 ms: 1 events 2021-10-08T19:20:00.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:00 smithi097 ceph-mon[32687]: overall HEALTH_OK 2021-10-08T19:20:00.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:00 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:20:00.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:00 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:20:00.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:00 smithi097 ceph-mon[41966]: osd.3 v1:172.21.15.97:6813/3191181122 boot 2021-10-08T19:20:00.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:00 smithi097 ceph-mon[41966]: osdmap e24: 4 total, 4 up, 4 in 2021-10-08T19:20:00.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:00 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:20:00.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:00 smithi097 ceph-mon[41966]: from='client.34232 v1:172.21.15.117:0/1984605500' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:20:00.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:00 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:20:00.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:00 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:20:00.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:00 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:20:00.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:00 smithi097 ceph-mon[41966]: poll took 5370.286 ms: 1 events 2021-10-08T19:20:00.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:00 smithi097 ceph-mon[41966]: overall HEALTH_OK 2021-10-08T19:20:00.836 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:00 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:20:00.836 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:00 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:20:00.836 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:00 smithi117 ceph-mon[34585]: osd.3 v1:172.21.15.97:6813/3191181122 boot 2021-10-08T19:20:00.837 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:00 smithi117 ceph-mon[34585]: osdmap e24: 4 total, 4 up, 4 in 2021-10-08T19:20:00.837 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:00 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:20:00.837 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:00 smithi117 ceph-mon[34585]: from='client.34232 v1:172.21.15.117:0/1984605500' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:20:00.837 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:00 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:20:00.838 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:00 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:20:00.838 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:00 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:20:00.838 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:00 smithi117 ceph-mon[34585]: poll took 5370.286 ms: 1 events 2021-10-08T19:20:00.838 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:00 smithi117 ceph-mon[34585]: overall HEALTH_OK 2021-10-08T19:20:01.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:01 smithi097 ceph-mon[32687]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:20:01.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:01 smithi097 ceph-mon[41966]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:20:01.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:01 smithi117 ceph-mon[34585]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:20:02.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:02 smithi117 ceph-mon[34585]: osdmap e25: 4 total, 4 up, 4 in 2021-10-08T19:20:02.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:02 smithi097 ceph-mon[32687]: osdmap e25: 4 total, 4 up, 4 in 2021-10-08T19:20:02.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:02 smithi097 ceph-mon[41966]: osdmap e25: 4 total, 4 up, 4 in 2021-10-08T19:20:03.430 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:20:03 smithi097 conmon[33110]: 172.21.15.117 - - [08/Oct/2021:19:20:03] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:20:03.719 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:03 smithi097 ceph-mon[41966]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:20:03.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:03 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.117:0/1090088885' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "67e4730a-be1c-4d88-9307-e3c2cf3ab2ef"}]: dispatch 2021-10-08T19:20:03.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:03 smithi097 ceph-mon[41966]: from='client.34238 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "67e4730a-be1c-4d88-9307-e3c2cf3ab2ef"}]: dispatch 2021-10-08T19:20:03.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:03 smithi097 ceph-mon[41966]: from='client.34238 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "67e4730a-be1c-4d88-9307-e3c2cf3ab2ef"}]': finished 2021-10-08T19:20:03.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:03 smithi097 ceph-mon[41966]: osdmap e26: 5 total, 4 up, 5 in 2021-10-08T19:20:03.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:03 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:20:03.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:03 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:03.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:03 smithi097 ceph-mon[32687]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:20:03.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:03 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.117:0/1090088885' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "67e4730a-be1c-4d88-9307-e3c2cf3ab2ef"}]: dispatch 2021-10-08T19:20:03.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:03 smithi097 ceph-mon[32687]: from='client.34238 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "67e4730a-be1c-4d88-9307-e3c2cf3ab2ef"}]: dispatch 2021-10-08T19:20:03.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:03 smithi097 ceph-mon[32687]: from='client.34238 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "67e4730a-be1c-4d88-9307-e3c2cf3ab2ef"}]': finished 2021-10-08T19:20:03.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:03 smithi097 ceph-mon[32687]: osdmap e26: 5 total, 4 up, 5 in 2021-10-08T19:20:03.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:03 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:20:03.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:03 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:03.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:03 smithi117 ceph-mon[34585]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:20:03.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:03 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.117:0/1090088885' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "67e4730a-be1c-4d88-9307-e3c2cf3ab2ef"}]: dispatch 2021-10-08T19:20:03.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:03 smithi117 ceph-mon[34585]: from='client.34238 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "67e4730a-be1c-4d88-9307-e3c2cf3ab2ef"}]: dispatch 2021-10-08T19:20:03.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:03 smithi117 ceph-mon[34585]: from='client.34238 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "67e4730a-be1c-4d88-9307-e3c2cf3ab2ef"}]': finished 2021-10-08T19:20:03.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:03 smithi117 ceph-mon[34585]: osdmap e26: 5 total, 4 up, 5 in 2021-10-08T19:20:03.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:03 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:20:03.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:03 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:04.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:04 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:20:04.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:04 smithi097 ceph-mon[32687]: 172.21.15.117 - - [08/Oct/2021:19:20:03] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:20:04.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:04 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.117:0/2530302189' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:20:04.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:04 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:20:04.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:04 smithi097 ceph-mon[41966]: 172.21.15.117 - - [08/Oct/2021:19:20:03] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:20:04.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:04 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.117:0/2530302189' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:20:04.904 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:04 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:20:04.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:04 smithi117 ceph-mon[34585]: 172.21.15.117 - - [08/Oct/2021:19:20:03] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:20:04.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:04 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.117:0/2530302189' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:20:05.719 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:05 smithi097 ceph-mon[41966]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:20:05.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:05 smithi097 ceph-mon[32687]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:20:05.853 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:05 smithi117 ceph-mon[34585]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:20:07.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:07 smithi117 ceph-mon[34585]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:20:07.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:07 smithi117 ceph-mon[34585]: poll took 6500.538 ms: 1 events 2021-10-08T19:20:07.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:07 smithi097 ceph-mon[32687]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:20:07.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:07 smithi097 ceph-mon[32687]: poll took 6500.538 ms: 1 events 2021-10-08T19:20:07.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:07 smithi097 ceph-mon[41966]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:20:07.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:07 smithi097 ceph-mon[41966]: poll took 6500.538 ms: 1 events 2021-10-08T19:20:09.717 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:09 smithi117 ceph-mon[34585]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:20:09.718 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:09 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2021-10-08T19:20:09.718 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:09 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:20:09.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:09 smithi097 ceph-mon[32687]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:20:09.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:09 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2021-10-08T19:20:09.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:09 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:20:09.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:09 smithi097 ceph-mon[41966]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:20:09.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:09 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2021-10-08T19:20:09.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:09 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:20:10.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:10 smithi097 ceph-mon[32687]: poll took 2281.639 ms: 1 events 2021-10-08T19:20:10.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:10 smithi097 ceph-mon[32687]: Deploying daemon osd.4 on smithi117 2021-10-08T19:20:10.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:10 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:20:10.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:10 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:20:10.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:10 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:20:10.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:10 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:20:10.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:10 smithi097 ceph-mon[41966]: poll took 2281.639 ms: 1 events 2021-10-08T19:20:10.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:10 smithi097 ceph-mon[41966]: Deploying daemon osd.4 on smithi117 2021-10-08T19:20:10.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:10 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:20:10.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:10 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:20:10.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:10 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:20:10.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:10 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:20:10.775 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:10 smithi117 ceph-mon[34585]: poll took 2281.639 ms: 1 events 2021-10-08T19:20:10.776 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:10 smithi117 ceph-mon[34585]: Deploying daemon osd.4 on smithi117 2021-10-08T19:20:10.776 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:10 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:20:10.776 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:10 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:20:10.776 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:10 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:20:10.777 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:10 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:20:11.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:11 smithi117 ceph-mon[34585]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:20:11.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:11 smithi117 ceph-mon[34585]: osdmap e27: 5 total, 4 up, 5 in 2021-10-08T19:20:11.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:11 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:20:11.719 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:11 smithi097 ceph-mon[41966]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:20:11.719 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:11 smithi097 ceph-mon[41966]: osdmap e27: 5 total, 4 up, 5 in 2021-10-08T19:20:11.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:11 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:20:11.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:11 smithi097 ceph-mon[32687]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:20:11.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:11 smithi097 ceph-mon[32687]: osdmap e27: 5 total, 4 up, 5 in 2021-10-08T19:20:11.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:11 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:20:12.903 INFO:teuthology.orchestra.run.smithi117.stdout:Created osd(s) 4 on host 'smithi117' 2021-10-08T19:20:13.496 DEBUG:teuthology.orchestra.run.smithi117:osd.4> sudo journalctl -f -n 0 -u ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@osd.4.service 2021-10-08T19:20:13.499 INFO:tasks.cephadm:Deploying osd.5 on smithi117 with /dev/vg_nvme/lv_3... 2021-10-08T19:20:13.500 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2021-10-08T19:20:13.526 INFO:journalctl@ceph.osd.4.smithi117.stdout:-- Logs begin at Fri 2021-10-08 19:07:21 UTC. -- 2021-10-08T19:20:13.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:13 smithi117 ceph-mon[34585]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:20:13.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:13 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:20:13.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:13 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:20:13.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:13 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:13.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:13 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:20:13.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:13 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:13.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:13 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:20:13.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:13 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:13.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:13 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:13.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:13 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:20:13.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:13 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:20:13.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:13 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:20:13.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:13 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:13.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:13 smithi097 ceph-mon[32687]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:20:13.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:13 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:20:13.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:13 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:20:13.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:13 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:13.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:13 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:20:13.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:13 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:13.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:13 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:20:13.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:13 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:13.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:13 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:13.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:13 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:20:13.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:13 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:20:13.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:13 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:20:13.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:13 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:13.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:13 smithi097 ceph-mon[41966]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:20:13.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:13 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:20:13.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:13 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:20:13.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:13 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:13.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:13 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:20:13.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:13 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:13.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:13 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:20:13.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:13 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:13.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:13 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:13.725 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:13 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:20:13.725 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:13 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:20:13.725 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:13 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:20:13.725 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:13 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:14.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:14 smithi117 ceph-mon[34585]: poll took 3418.709 ms: 1 events 2021-10-08T19:20:14.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:14 smithi117 ceph-mon[34585]: Adjusting osd_memory_target on smithi117 to 16148M 2021-10-08T19:20:14.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:14 smithi097 ceph-mon[32687]: poll took 3418.709 ms: 1 events 2021-10-08T19:20:14.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:14 smithi097 ceph-mon[32687]: Adjusting osd_memory_target on smithi117 to 16148M 2021-10-08T19:20:14.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:14 smithi097 ceph-mon[41966]: poll took 3418.709 ms: 1 events 2021-10-08T19:20:14.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:14 smithi097 ceph-mon[41966]: Adjusting osd_memory_target on smithi117 to 16148M 2021-10-08T19:20:15.535 INFO:teuthology.orchestra.run.smithi117.stderr:--> Zapping: /dev/vg_nvme/lv_3 2021-10-08T19:20:15.536 INFO:teuthology.orchestra.run.smithi117.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2021-10-08T19:20:15.536 INFO:teuthology.orchestra.run.smithi117.stderr: stderr: 10+0 records in 2021-10-08T19:20:15.536 INFO:teuthology.orchestra.run.smithi117.stderr:10+0 records out 2021-10-08T19:20:15.536 INFO:teuthology.orchestra.run.smithi117.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0119151 s, 880 MB/s 2021-10-08T19:20:15.537 INFO:teuthology.orchestra.run.smithi117.stderr:--> Zapping successful for: 2021-10-08T19:20:15.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:15 smithi097 ceph-mon[32687]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:20:15.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:15 smithi097 ceph-mon[41966]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:20:15.904 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:15 smithi117 ceph-mon[34585]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:20:16.154 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph orch daemon add osd smithi117:vg_nvme/lv_3 2021-10-08T19:20:16.405 INFO:journalctl@ceph.osd.4.smithi117.stdout:Oct 08 19:20:16 smithi117 conmon[42287]: 2021-10-08T19:20:16.110+0000 7f7eafb0a0c0 -1 osd.4 0 log_to_monitors {default=true} 2021-10-08T19:20:16.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:16 smithi117 ceph-mon[34585]: from='osd.4 v1:172.21.15.117:6800/106778208' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-10-08T19:20:16.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:16 smithi117 ceph-mon[34585]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-10-08T19:20:16.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:16 smithi097 ceph-mon[32687]: from='osd.4 v1:172.21.15.117:6800/106778208' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-10-08T19:20:16.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:16 smithi097 ceph-mon[32687]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-10-08T19:20:16.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:16 smithi097 ceph-mon[41966]: from='osd.4 v1:172.21.15.117:6800/106778208' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-10-08T19:20:16.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:16 smithi097 ceph-mon[41966]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-10-08T19:20:17.760 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:17 smithi117 ceph-mon[34585]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:20:17.761 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:17 smithi117 ceph-mon[34585]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-10-08T19:20:17.761 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:17 smithi117 ceph-mon[34585]: osdmap e28: 5 total, 4 up, 5 in 2021-10-08T19:20:17.761 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:17 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:20:17.761 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:17 smithi117 ceph-mon[34585]: from='osd.4 v1:172.21.15.117:6800/106778208' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2021-10-08T19:20:17.762 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:17 smithi117 ceph-mon[34585]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2021-10-08T19:20:17.762 INFO:journalctl@ceph.osd.4.smithi117.stdout:Oct 08 19:20:17 smithi117 conmon[42287]: 2021-10-08T19:20:17.479+0000 7f7ea62b2700 -1 osd.4 0 waiting for initial osdmap 2021-10-08T19:20:17.762 INFO:journalctl@ceph.osd.4.smithi117.stdout:Oct 08 19:20:17 smithi117 conmon[42287]: 2021-10-08T19:20:17.484+0000 7f7ea0448700 -1 osd.4 29 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-10-08T19:20:17.969 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:17 smithi097 ceph-mon[41966]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:20:17.969 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:17 smithi097 ceph-mon[41966]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-10-08T19:20:17.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:17 smithi097 ceph-mon[41966]: osdmap e28: 5 total, 4 up, 5 in 2021-10-08T19:20:17.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:17 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:20:17.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:17 smithi097 ceph-mon[41966]: from='osd.4 v1:172.21.15.117:6800/106778208' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2021-10-08T19:20:17.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:17 smithi097 ceph-mon[41966]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2021-10-08T19:20:17.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:17 smithi097 ceph-mon[32687]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:20:17.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:17 smithi097 ceph-mon[32687]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-10-08T19:20:17.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:17 smithi097 ceph-mon[32687]: osdmap e28: 5 total, 4 up, 5 in 2021-10-08T19:20:17.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:17 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:20:17.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:17 smithi097 ceph-mon[32687]: from='osd.4 v1:172.21.15.117:6800/106778208' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2021-10-08T19:20:17.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:17 smithi097 ceph-mon[32687]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2021-10-08T19:20:18.675 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:18 smithi097 ceph-mon[32687]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2021-10-08T19:20:18.675 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:18 smithi097 ceph-mon[32687]: osdmap e29: 5 total, 4 up, 5 in 2021-10-08T19:20:18.676 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:18 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:20:18.676 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:18 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:20:18.676 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:18 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:20:18.676 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:18 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:20:18.676 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:18 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:20:18.677 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:18 smithi097 ceph-mon[41966]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2021-10-08T19:20:18.677 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:18 smithi097 ceph-mon[41966]: osdmap e29: 5 total, 4 up, 5 in 2021-10-08T19:20:18.677 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:18 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:20:18.677 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:18 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:20:18.678 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:18 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:20:18.678 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:18 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:20:18.678 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:18 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:20:18.898 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:18 smithi117 ceph-mon[34585]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2021-10-08T19:20:18.899 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:18 smithi117 ceph-mon[34585]: osdmap e29: 5 total, 4 up, 5 in 2021-10-08T19:20:18.899 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:18 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:20:18.899 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:18 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:20:18.899 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:18 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:20:18.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:18 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:20:18.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:18 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:20:19.719 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:19 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:20:19.719 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:19 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:20:19.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:19 smithi097 ceph-mon[41966]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:20:19.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:19 smithi097 ceph-mon[41966]: from='client.34259 v1:172.21.15.117:0/1567225922' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:20:19.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:19 smithi097 ceph-mon[41966]: poll took 5176.911 ms: 1 events 2021-10-08T19:20:19.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:19 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:20:19.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:19 smithi097 ceph-mon[41966]: osd.4 v1:172.21.15.117:6800/106778208 boot 2021-10-08T19:20:19.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:19 smithi097 ceph-mon[41966]: osdmap e30: 5 total, 5 up, 5 in 2021-10-08T19:20:19.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:19 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:20:19.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:19 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:20:19.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:19 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:20:19.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:19 smithi097 ceph-mon[32687]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:20:19.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:19 smithi097 ceph-mon[32687]: from='client.34259 v1:172.21.15.117:0/1567225922' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:20:19.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:19 smithi097 ceph-mon[32687]: poll took 5176.911 ms: 1 events 2021-10-08T19:20:19.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:19 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:20:19.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:19 smithi097 ceph-mon[32687]: osd.4 v1:172.21.15.117:6800/106778208 boot 2021-10-08T19:20:19.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:19 smithi097 ceph-mon[32687]: osdmap e30: 5 total, 5 up, 5 in 2021-10-08T19:20:19.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:19 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:20:19.817 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:19 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:20:19.817 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:19 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:20:19.817 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:19 smithi117 ceph-mon[34585]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:20:19.818 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:19 smithi117 ceph-mon[34585]: from='client.34259 v1:172.21.15.117:0/1567225922' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:20:19.818 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:19 smithi117 ceph-mon[34585]: poll took 5176.911 ms: 1 events 2021-10-08T19:20:19.818 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:19 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:20:19.818 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:19 smithi117 ceph-mon[34585]: osd.4 v1:172.21.15.117:6800/106778208 boot 2021-10-08T19:20:19.818 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:19 smithi117 ceph-mon[34585]: osdmap e30: 5 total, 5 up, 5 in 2021-10-08T19:20:19.819 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:19 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:20:20.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:20 smithi117 ceph-mon[34585]: osdmap e31: 5 total, 5 up, 5 in 2021-10-08T19:20:20.969 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:20 smithi097 ceph-mon[41966]: osdmap e31: 5 total, 5 up, 5 in 2021-10-08T19:20:20.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:20 smithi097 ceph-mon[32687]: osdmap e31: 5 total, 5 up, 5 in 2021-10-08T19:20:21.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:21 smithi117 ceph-mon[34585]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2021-10-08T19:20:21.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:21 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.117:0/1734877792' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f9fd3153-3e4e-4489-8927-a65641f05d42"}]: dispatch 2021-10-08T19:20:21.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:21 smithi117 ceph-mon[34585]: osdmap e32: 5 total, 5 up, 5 in 2021-10-08T19:20:21.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:21 smithi117 ceph-mon[34585]: from='client.34265 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f9fd3153-3e4e-4489-8927-a65641f05d42"}]: dispatch 2021-10-08T19:20:21.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:21 smithi117 ceph-mon[34585]: from='client.34265 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f9fd3153-3e4e-4489-8927-a65641f05d42"}]': finished 2021-10-08T19:20:21.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:21 smithi117 ceph-mon[34585]: osdmap e33: 6 total, 5 up, 6 in 2021-10-08T19:20:21.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:21 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:20:21.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:21 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.117:0/1803689977' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:20:21.944 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:21 smithi097 ceph-mon[32687]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2021-10-08T19:20:21.944 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:21 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.117:0/1734877792' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f9fd3153-3e4e-4489-8927-a65641f05d42"}]: dispatch 2021-10-08T19:20:21.944 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:21 smithi097 ceph-mon[32687]: osdmap e32: 5 total, 5 up, 5 in 2021-10-08T19:20:21.945 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:21 smithi097 ceph-mon[32687]: from='client.34265 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f9fd3153-3e4e-4489-8927-a65641f05d42"}]: dispatch 2021-10-08T19:20:21.945 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:21 smithi097 ceph-mon[32687]: from='client.34265 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f9fd3153-3e4e-4489-8927-a65641f05d42"}]': finished 2021-10-08T19:20:21.945 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:21 smithi097 ceph-mon[32687]: osdmap e33: 6 total, 5 up, 6 in 2021-10-08T19:20:21.945 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:21 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:20:21.946 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:21 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.117:0/1803689977' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:20:21.946 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:21 smithi097 ceph-mon[41966]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2021-10-08T19:20:21.946 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:21 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.117:0/1734877792' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f9fd3153-3e4e-4489-8927-a65641f05d42"}]: dispatch 2021-10-08T19:20:21.946 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:21 smithi097 ceph-mon[41966]: osdmap e32: 5 total, 5 up, 5 in 2021-10-08T19:20:21.947 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:21 smithi097 ceph-mon[41966]: from='client.34265 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f9fd3153-3e4e-4489-8927-a65641f05d42"}]: dispatch 2021-10-08T19:20:21.947 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:21 smithi097 ceph-mon[41966]: from='client.34265 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f9fd3153-3e4e-4489-8927-a65641f05d42"}]': finished 2021-10-08T19:20:21.947 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:21 smithi097 ceph-mon[41966]: osdmap e33: 6 total, 5 up, 6 in 2021-10-08T19:20:21.948 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:21 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:20:21.948 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:21 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.117:0/1803689977' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:20:22.219 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:20:21 smithi097 conmon[33110]: 172.21.15.97 - - [08/Oct/2021:19:20:21] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:20:22.904 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:22 smithi117 ceph-mon[34585]: osdmap e34: 6 total, 5 up, 6 in 2021-10-08T19:20:22.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:22 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:20:22.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:22 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:22.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:22 smithi097 ceph-mon[32687]: osdmap e34: 6 total, 5 up, 6 in 2021-10-08T19:20:22.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:22 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:20:22.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:22 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:22.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:22 smithi097 ceph-mon[41966]: osdmap e34: 6 total, 5 up, 6 in 2021-10-08T19:20:22.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:22 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:20:22.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:22 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:23.508 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:23 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:20:23.509 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:23 smithi117 ceph-mon[34585]: 172.21.15.97 - - [08/Oct/2021:19:20:21] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:20:23.809 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:23 smithi117 ceph-mon[34585]: pgmap v119: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail; 162 KiB/s, 0 objects/s recovering 2021-10-08T19:20:23.810 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:23 smithi117 ceph-mon[34585]: osdmap e35: 6 total, 5 up, 6 in 2021-10-08T19:20:23.810 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:23 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:20:23.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:23 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:20:23.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:23 smithi097 ceph-mon[32687]: 172.21.15.97 - - [08/Oct/2021:19:20:21] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:20:23.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:23 smithi097 ceph-mon[32687]: pgmap v119: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail; 162 KiB/s, 0 objects/s recovering 2021-10-08T19:20:23.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:23 smithi097 ceph-mon[32687]: osdmap e35: 6 total, 5 up, 6 in 2021-10-08T19:20:23.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:23 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:20:23.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:23 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:20:23.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:23 smithi097 ceph-mon[41966]: 172.21.15.97 - - [08/Oct/2021:19:20:21] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:20:23.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:23 smithi097 ceph-mon[41966]: pgmap v119: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail; 162 KiB/s, 0 objects/s recovering 2021-10-08T19:20:23.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:23 smithi097 ceph-mon[41966]: osdmap e35: 6 total, 5 up, 6 in 2021-10-08T19:20:23.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:23 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:20:25.614 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:25 smithi117 ceph-mon[34585]: poll took 5645.960 ms: 1 events 2021-10-08T19:20:25.614 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:25 smithi117 ceph-mon[34585]: pgmap v121: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail; 144 KiB/s, 0 objects/s recovering 2021-10-08T19:20:25.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:25 smithi097 ceph-mon[32687]: poll took 5645.960 ms: 1 events 2021-10-08T19:20:25.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:25 smithi097 ceph-mon[32687]: pgmap v121: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail; 144 KiB/s, 0 objects/s recovering 2021-10-08T19:20:25.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:25 smithi097 ceph-mon[41966]: poll took 5645.960 ms: 1 events 2021-10-08T19:20:25.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:25 smithi097 ceph-mon[41966]: pgmap v121: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail; 144 KiB/s, 0 objects/s recovering 2021-10-08T19:20:27.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:27 smithi117 ceph-mon[34585]: pgmap v122: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 104 KiB/s, 0 objects/s recovering 2021-10-08T19:20:27.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:27 smithi097 ceph-mon[32687]: pgmap v122: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 104 KiB/s, 0 objects/s recovering 2021-10-08T19:20:27.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:27 smithi097 ceph-mon[41966]: pgmap v122: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 104 KiB/s, 0 objects/s recovering 2021-10-08T19:20:28.969 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:20:28 smithi097 conmon[33110]: 172.21.15.117 - - [08/Oct/2021:19:20:28] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:20:29.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:29 smithi117 ceph-mon[34585]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 76 KiB/s, 0 objects/s recovering 2021-10-08T19:20:29.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:29 smithi117 ceph-mon[34585]: poll took 3710.945 ms: 1 events 2021-10-08T19:20:29.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:29 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2021-10-08T19:20:29.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:29 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:20:29.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:29 smithi117 ceph-mon[34585]: Deploying daemon osd.5 on smithi117 2021-10-08T19:20:29.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:29 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:29.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:29 smithi117 ceph-mon[34585]: Detected new or changed devices on smithi117 2021-10-08T19:20:29.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:29 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:20:29.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:29 smithi117 ceph-mon[34585]: 172.21.15.117 - - [08/Oct/2021:19:20:28] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:20:29.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:29 smithi097 ceph-mon[32687]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 76 KiB/s, 0 objects/s recovering 2021-10-08T19:20:29.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:29 smithi097 ceph-mon[32687]: poll took 3710.945 ms: 1 events 2021-10-08T19:20:29.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:29 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2021-10-08T19:20:29.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:29 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:20:29.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:29 smithi097 ceph-mon[32687]: Deploying daemon osd.5 on smithi117 2021-10-08T19:20:29.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:29 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:29.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:29 smithi097 ceph-mon[32687]: Detected new or changed devices on smithi117 2021-10-08T19:20:29.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:29 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:20:29.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:29 smithi097 ceph-mon[32687]: 172.21.15.117 - - [08/Oct/2021:19:20:28] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:20:29.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:29 smithi097 ceph-mon[41966]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 76 KiB/s, 0 objects/s recovering 2021-10-08T19:20:29.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:29 smithi097 ceph-mon[41966]: poll took 3710.945 ms: 1 events 2021-10-08T19:20:29.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:29 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2021-10-08T19:20:29.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:29 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:20:29.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:29 smithi097 ceph-mon[41966]: Deploying daemon osd.5 on smithi117 2021-10-08T19:20:29.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:29 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:29.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:29 smithi097 ceph-mon[41966]: Detected new or changed devices on smithi117 2021-10-08T19:20:29.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:29 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:20:29.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:29 smithi097 ceph-mon[41966]: 172.21.15.117 - - [08/Oct/2021:19:20:28] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:20:31.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:31 smithi117 ceph-mon[34585]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2021-10-08T19:20:31.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:31 smithi097 ceph-mon[32687]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2021-10-08T19:20:31.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:31 smithi097 ceph-mon[41966]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2021-10-08T19:20:32.200 INFO:teuthology.orchestra.run.smithi117.stdout:Created osd(s) 5 on host 'smithi117' 2021-10-08T19:20:32.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:20:32.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:20:32.901 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:32.901 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:20:32.902 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:32.902 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:20:32.903 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:20:32.903 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:32.904 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:32.904 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:20:32.904 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:20:32.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:20:32.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:32.907 DEBUG:teuthology.orchestra.run.smithi117:osd.5> sudo journalctl -f -n 0 -u ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@osd.5.service 2021-10-08T19:20:32.911 INFO:tasks.cephadm:Deploying osd.6 on smithi117 with /dev/vg_nvme/lv_2... 2021-10-08T19:20:32.912 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2021-10-08T19:20:32.938 INFO:journalctl@ceph.osd.5.smithi117.stdout:-- Logs begin at Fri 2021-10-08 19:07:21 UTC. -- 2021-10-08T19:20:32.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:32 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:20:32.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:32 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:20:32.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:32 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:32.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:32 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:20:32.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:32 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:32.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:32 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:20:32.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:32 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:20:32.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:32 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:32.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:32 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:32.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:32 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:20:32.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:32 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:20:32.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:32 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:20:32.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:32 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:32.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:32 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:20:32.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:32 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:20:32.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:32 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:32.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:32 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:20:32.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:32 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:32.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:32 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:20:32.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:32 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:20:32.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:32 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:32.975 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:32 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:32.975 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:32 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:20:32.975 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:32 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:20:32.975 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:32 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:20:32.976 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:32 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:33.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:33 smithi117 ceph-mon[34585]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2021-10-08T19:20:33.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:33 smithi117 ceph-mon[34585]: poll took 3317.856 ms: 1 events 2021-10-08T19:20:33.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:33 smithi117 ceph-mon[34585]: Adjusting osd_memory_target on smithi117 to 8074M 2021-10-08T19:20:33.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:33 smithi097 ceph-mon[32687]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2021-10-08T19:20:33.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:33 smithi097 ceph-mon[32687]: poll took 3317.856 ms: 1 events 2021-10-08T19:20:33.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:33 smithi097 ceph-mon[32687]: Adjusting osd_memory_target on smithi117 to 8074M 2021-10-08T19:20:33.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:33 smithi097 ceph-mon[41966]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2021-10-08T19:20:33.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:33 smithi097 ceph-mon[41966]: poll took 3317.856 ms: 1 events 2021-10-08T19:20:33.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:33 smithi097 ceph-mon[41966]: Adjusting osd_memory_target on smithi117 to 8074M 2021-10-08T19:20:34.968 INFO:teuthology.orchestra.run.smithi117.stderr:--> Zapping: /dev/vg_nvme/lv_2 2021-10-08T19:20:34.968 INFO:teuthology.orchestra.run.smithi117.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2021-10-08T19:20:34.968 INFO:teuthology.orchestra.run.smithi117.stderr: stderr: 10+0 records in 2021-10-08T19:20:34.968 INFO:teuthology.orchestra.run.smithi117.stderr:10+0 records out 2021-10-08T19:20:34.969 INFO:teuthology.orchestra.run.smithi117.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0121409 s, 864 MB/s 2021-10-08T19:20:34.969 INFO:teuthology.orchestra.run.smithi117.stderr:--> Zapping successful for: 2021-10-08T19:20:35.535 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph orch daemon add osd smithi117:vg_nvme/lv_2 2021-10-08T19:20:35.655 INFO:journalctl@ceph.osd.5.smithi117.stdout:Oct 08 19:20:35 smithi117 conmon[46504]: 2021-10-08T19:20:35.370+0000 7f7c208620c0 -1 osd.5 0 log_to_monitors {default=true} 2021-10-08T19:20:35.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:35 smithi117 ceph-mon[34585]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2021-10-08T19:20:35.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:35 smithi117 ceph-mon[34585]: from='osd.5 v1:172.21.15.117:6804/3199889891' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-10-08T19:20:35.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:35 smithi117 ceph-mon[34585]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-10-08T19:20:35.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:35 smithi097 ceph-mon[32687]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2021-10-08T19:20:35.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:35 smithi097 ceph-mon[32687]: from='osd.5 v1:172.21.15.117:6804/3199889891' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-10-08T19:20:35.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:35 smithi097 ceph-mon[32687]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-10-08T19:20:35.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:35 smithi097 ceph-mon[41966]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2021-10-08T19:20:35.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:35 smithi097 ceph-mon[41966]: from='osd.5 v1:172.21.15.117:6804/3199889891' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-10-08T19:20:35.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:35 smithi097 ceph-mon[41966]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-10-08T19:20:36.905 INFO:journalctl@ceph.osd.5.smithi117.stdout:Oct 08 19:20:36 smithi117 conmon[46504]: 2021-10-08T19:20:36.543+0000 7f7c1700a700 -1 osd.5 0 waiting for initial osdmap 2021-10-08T19:20:36.905 INFO:journalctl@ceph.osd.5.smithi117.stdout:Oct 08 19:20:36 smithi117 conmon[46504]: 2021-10-08T19:20:36.547+0000 7f7c111a0700 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-10-08T19:20:36.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:36 smithi117 ceph-mon[34585]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-10-08T19:20:36.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:36 smithi117 ceph-mon[34585]: osdmap e36: 6 total, 5 up, 6 in 2021-10-08T19:20:36.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:36 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:20:36.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:36 smithi117 ceph-mon[34585]: from='osd.5 v1:172.21.15.117:6804/3199889891' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2021-10-08T19:20:36.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:36 smithi117 ceph-mon[34585]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2021-10-08T19:20:36.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:36 smithi097 ceph-mon[32687]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-10-08T19:20:36.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:36 smithi097 ceph-mon[32687]: osdmap e36: 6 total, 5 up, 6 in 2021-10-08T19:20:36.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:36 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:20:36.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:36 smithi097 ceph-mon[32687]: from='osd.5 v1:172.21.15.117:6804/3199889891' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2021-10-08T19:20:36.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:36 smithi097 ceph-mon[32687]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2021-10-08T19:20:36.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:36 smithi097 ceph-mon[41966]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-10-08T19:20:36.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:36 smithi097 ceph-mon[41966]: osdmap e36: 6 total, 5 up, 6 in 2021-10-08T19:20:36.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:36 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:20:36.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:36 smithi097 ceph-mon[41966]: from='osd.5 v1:172.21.15.117:6804/3199889891' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2021-10-08T19:20:36.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:36 smithi097 ceph-mon[41966]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2021-10-08T19:20:37.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:37 smithi117 ceph-mon[34585]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2021-10-08T19:20:37.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:37 smithi117 ceph-mon[34585]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2021-10-08T19:20:37.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:37 smithi117 ceph-mon[34585]: osdmap e37: 6 total, 5 up, 6 in 2021-10-08T19:20:37.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:37 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:20:37.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:37 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:20:37.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:37 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:20:37.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:37 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:20:37.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:37 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:20:37.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:37 smithi117 ceph-mon[34585]: osd.5 v1:172.21.15.117:6804/3199889891 boot 2021-10-08T19:20:37.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:37 smithi117 ceph-mon[34585]: osdmap e38: 6 total, 6 up, 6 in 2021-10-08T19:20:37.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:37 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:20:37.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:37 smithi097 ceph-mon[32687]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2021-10-08T19:20:37.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:37 smithi097 ceph-mon[32687]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2021-10-08T19:20:37.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:37 smithi097 ceph-mon[32687]: osdmap e37: 6 total, 5 up, 6 in 2021-10-08T19:20:37.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:37 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:20:37.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:37 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:20:37.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:37 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:20:37.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:37 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:20:37.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:37 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:20:37.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:37 smithi097 ceph-mon[32687]: osd.5 v1:172.21.15.117:6804/3199889891 boot 2021-10-08T19:20:37.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:37 smithi097 ceph-mon[32687]: osdmap e38: 6 total, 6 up, 6 in 2021-10-08T19:20:37.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:37 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:20:37.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:37 smithi097 ceph-mon[41966]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2021-10-08T19:20:37.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:37 smithi097 ceph-mon[41966]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2021-10-08T19:20:37.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:37 smithi097 ceph-mon[41966]: osdmap e37: 6 total, 5 up, 6 in 2021-10-08T19:20:37.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:37 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:20:37.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:37 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:20:37.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:37 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:20:37.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:37 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:20:37.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:37 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:20:37.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:37 smithi097 ceph-mon[41966]: osd.5 v1:172.21.15.117:6804/3199889891 boot 2021-10-08T19:20:37.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:37 smithi097 ceph-mon[41966]: osdmap e38: 6 total, 6 up, 6 in 2021-10-08T19:20:37.975 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:37 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:20:38.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:38 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:20:38.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:38 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:20:38.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:38 smithi117 ceph-mon[34585]: from='client.34286 v1:172.21.15.117:0/3405994558' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:20:38.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:38 smithi117 ceph-mon[34585]: poll took 5281.854 ms: 1 events 2021-10-08T19:20:38.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:38 smithi117 ceph-mon[34585]: osdmap e39: 6 total, 6 up, 6 in 2021-10-08T19:20:38.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:38 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:20:38.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:38 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:20:38.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:38 smithi097 ceph-mon[32687]: from='client.34286 v1:172.21.15.117:0/3405994558' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:20:38.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:38 smithi097 ceph-mon[32687]: poll took 5281.854 ms: 1 events 2021-10-08T19:20:38.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:38 smithi097 ceph-mon[32687]: osdmap e39: 6 total, 6 up, 6 in 2021-10-08T19:20:38.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:38 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:20:38.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:38 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:20:38.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:38 smithi097 ceph-mon[41966]: from='client.34286 v1:172.21.15.117:0/3405994558' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:20:38.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:38 smithi097 ceph-mon[41966]: poll took 5281.854 ms: 1 events 2021-10-08T19:20:38.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:38 smithi097 ceph-mon[41966]: osdmap e39: 6 total, 6 up, 6 in 2021-10-08T19:20:39.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:39 smithi117 ceph-mon[34585]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2021-10-08T19:20:39.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:39 smithi117 ceph-mon[34585]: osdmap e40: 6 total, 6 up, 6 in 2021-10-08T19:20:39.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:39 smithi097 ceph-mon[32687]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2021-10-08T19:20:39.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:39 smithi097 ceph-mon[32687]: osdmap e40: 6 total, 6 up, 6 in 2021-10-08T19:20:39.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:39 smithi097 ceph-mon[41966]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2021-10-08T19:20:39.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:39 smithi097 ceph-mon[41966]: osdmap e40: 6 total, 6 up, 6 in 2021-10-08T19:20:40.904 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:40 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.117:0/1057761706' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "84898f12-c37d-4eb6-8b71-5b86bfe16e7d"}]: dispatch 2021-10-08T19:20:40.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:40 smithi117 ceph-mon[34585]: from='client.34292 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "84898f12-c37d-4eb6-8b71-5b86bfe16e7d"}]: dispatch 2021-10-08T19:20:40.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:40 smithi117 ceph-mon[34585]: from='client.34292 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "84898f12-c37d-4eb6-8b71-5b86bfe16e7d"}]': finished 2021-10-08T19:20:40.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:40 smithi117 ceph-mon[34585]: osdmap e41: 7 total, 6 up, 7 in 2021-10-08T19:20:40.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:40 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:20:40.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:40 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.117:0/1177211653' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:20:40.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:40 smithi117 ceph-mon[34585]: osdmap e42: 7 total, 6 up, 7 in 2021-10-08T19:20:40.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:40 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:20:40.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:40 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.117:0/1057761706' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "84898f12-c37d-4eb6-8b71-5b86bfe16e7d"}]: dispatch 2021-10-08T19:20:40.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:40 smithi097 ceph-mon[32687]: from='client.34292 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "84898f12-c37d-4eb6-8b71-5b86bfe16e7d"}]: dispatch 2021-10-08T19:20:40.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:40 smithi097 ceph-mon[32687]: from='client.34292 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "84898f12-c37d-4eb6-8b71-5b86bfe16e7d"}]': finished 2021-10-08T19:20:40.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:40 smithi097 ceph-mon[32687]: osdmap e41: 7 total, 6 up, 7 in 2021-10-08T19:20:40.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:40 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:20:40.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:40 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.117:0/1177211653' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:20:40.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:40 smithi097 ceph-mon[32687]: osdmap e42: 7 total, 6 up, 7 in 2021-10-08T19:20:40.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:40 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:20:40.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:40 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.117:0/1057761706' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "84898f12-c37d-4eb6-8b71-5b86bfe16e7d"}]: dispatch 2021-10-08T19:20:40.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:40 smithi097 ceph-mon[41966]: from='client.34292 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "84898f12-c37d-4eb6-8b71-5b86bfe16e7d"}]: dispatch 2021-10-08T19:20:40.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:40 smithi097 ceph-mon[41966]: from='client.34292 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "84898f12-c37d-4eb6-8b71-5b86bfe16e7d"}]': finished 2021-10-08T19:20:40.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:40 smithi097 ceph-mon[41966]: osdmap e41: 7 total, 6 up, 7 in 2021-10-08T19:20:40.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:40 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:20:40.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:40 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.117:0/1177211653' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:20:40.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:40 smithi097 ceph-mon[41966]: osdmap e42: 7 total, 6 up, 7 in 2021-10-08T19:20:40.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:40 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:20:41.904 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:41 smithi117 ceph-mon[34585]: pgmap v135: 1 pgs: 1 remapped+peering; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2021-10-08T19:20:41.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:41 smithi117 ceph-mon[34585]: osdmap e43: 7 total, 6 up, 7 in 2021-10-08T19:20:41.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:41 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:20:41.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:41 smithi097 ceph-mon[32687]: pgmap v135: 1 pgs: 1 remapped+peering; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2021-10-08T19:20:41.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:41 smithi097 ceph-mon[32687]: osdmap e43: 7 total, 6 up, 7 in 2021-10-08T19:20:41.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:41 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:20:41.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:41 smithi097 ceph-mon[41966]: pgmap v135: 1 pgs: 1 remapped+peering; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2021-10-08T19:20:41.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:41 smithi097 ceph-mon[41966]: osdmap e43: 7 total, 6 up, 7 in 2021-10-08T19:20:41.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:41 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:20:43.654 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:43 smithi117 ceph-mon[34585]: pgmap v138: 1 pgs: 1 remapped+peering; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2021-10-08T19:20:43.934 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:43 smithi097 ceph-mon[32687]: pgmap v138: 1 pgs: 1 remapped+peering; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2021-10-08T19:20:43.935 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:43 smithi097 ceph-mon[41966]: pgmap v138: 1 pgs: 1 remapped+peering; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2021-10-08T19:20:44.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:44 smithi117 ceph-mon[34585]: poll took 5554.251 ms: 1 events 2021-10-08T19:20:44.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:44 smithi097 ceph-mon[32687]: poll took 5554.251 ms: 1 events 2021-10-08T19:20:44.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:44 smithi097 ceph-mon[41966]: poll took 5554.251 ms: 1 events 2021-10-08T19:20:45.904 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:45 smithi117 ceph-mon[34585]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 128 KiB/s, 0 objects/s recovering 2021-10-08T19:20:45.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:45 smithi097 ceph-mon[32687]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 128 KiB/s, 0 objects/s recovering 2021-10-08T19:20:45.970 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:20:45 smithi097 conmon[33110]: 172.21.15.97 - - [08/Oct/2021:19:20:45] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:20:45.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:45 smithi097 ceph-mon[41966]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 128 KiB/s, 0 objects/s recovering 2021-10-08T19:20:46.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:46 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:46.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:46 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:20:46.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:46 smithi117 ceph-mon[34585]: 172.21.15.97 - - [08/Oct/2021:19:20:45] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:20:46.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:46 smithi117 ceph-mon[34585]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail; 93 KiB/s, 0 objects/s recovering 2021-10-08T19:20:46.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:46 smithi117 ceph-mon[34585]: poll took 2463.434 ms: 1 events 2021-10-08T19:20:46.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:46 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2021-10-08T19:20:46.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:46 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:20:46.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:46 smithi117 ceph-mon[34585]: Deploying daemon osd.6 on smithi117 2021-10-08T19:20:46.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:46 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:46.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:46 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:20:46.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:46 smithi097 ceph-mon[32687]: 172.21.15.97 - - [08/Oct/2021:19:20:45] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:20:46.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:46 smithi097 ceph-mon[32687]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail; 93 KiB/s, 0 objects/s recovering 2021-10-08T19:20:46.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:46 smithi097 ceph-mon[32687]: poll took 2463.434 ms: 1 events 2021-10-08T19:20:46.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:46 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2021-10-08T19:20:46.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:46 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:20:46.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:46 smithi097 ceph-mon[32687]: Deploying daemon osd.6 on smithi117 2021-10-08T19:20:46.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:46 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:46.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:46 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:20:46.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:46 smithi097 ceph-mon[41966]: 172.21.15.97 - - [08/Oct/2021:19:20:45] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:20:46.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:46 smithi097 ceph-mon[41966]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail; 93 KiB/s, 0 objects/s recovering 2021-10-08T19:20:46.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:46 smithi097 ceph-mon[41966]: poll took 2463.434 ms: 1 events 2021-10-08T19:20:46.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:46 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2021-10-08T19:20:46.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:46 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:20:46.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:46 smithi097 ceph-mon[41966]: Deploying daemon osd.6 on smithi117 2021-10-08T19:20:47.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:47 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:20:47.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:47 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:20:47.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:47 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:20:47.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:47 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:20:47.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:47 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:20:47.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:47 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:20:48.877 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:48 smithi117 ceph-mon[34585]: osdmap e44: 7 total, 6 up, 7 in 2021-10-08T19:20:48.878 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:48 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:20:48.878 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:48 smithi117 ceph-mon[34585]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail; 75 KiB/s, 0 objects/s recovering 2021-10-08T19:20:48.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:48 smithi097 ceph-mon[32687]: osdmap e44: 7 total, 6 up, 7 in 2021-10-08T19:20:48.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:48 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:20:48.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:48 smithi097 ceph-mon[32687]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail; 75 KiB/s, 0 objects/s recovering 2021-10-08T19:20:48.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:48 smithi097 ceph-mon[41966]: osdmap e44: 7 total, 6 up, 7 in 2021-10-08T19:20:48.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:48 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:20:48.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:48 smithi097 ceph-mon[41966]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail; 75 KiB/s, 0 objects/s recovering 2021-10-08T19:20:50.621 INFO:teuthology.orchestra.run.smithi117.stdout:Created osd(s) 6 on host 'smithi117' 2021-10-08T19:20:51.498 DEBUG:teuthology.orchestra.run.smithi117:osd.6> sudo journalctl -f -n 0 -u ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@osd.6.service 2021-10-08T19:20:51.501 INFO:tasks.cephadm:Deploying osd.7 on smithi117 with /dev/vg_nvme/lv_1... 2021-10-08T19:20:51.501 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2021-10-08T19:20:51.528 INFO:journalctl@ceph.osd.6.smithi117.stdout:-- Logs begin at Fri 2021-10-08 19:07:21 UTC. -- 2021-10-08T19:20:51.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:51 smithi117 ceph-mon[34585]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 67 KiB/s, 0 objects/s recovering 2021-10-08T19:20:51.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:51 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:20:51.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:51 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:20:51.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:51 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:51.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:51 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:20:51.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:51 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:20:51.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:51 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:51.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:51 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:20:51.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:51 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:20:51.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:51 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:51.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:51 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:51.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:51 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:20:51.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:51 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:20:51.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:51 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:20:51.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:51 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:51.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:51 smithi097 ceph-mon[32687]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 67 KiB/s, 0 objects/s recovering 2021-10-08T19:20:51.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:51 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:20:51.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:51 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:20:51.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:51 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:51.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:51 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:20:51.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:51 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:20:51.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:51 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:51.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:51 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:20:51.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:51 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:20:51.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:51 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:51.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:51 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:51.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:51 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:20:51.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:51 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:20:51.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:51 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:20:51.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:51 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:51.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:51 smithi097 ceph-mon[41966]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 67 KiB/s, 0 objects/s recovering 2021-10-08T19:20:51.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:51 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:20:51.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:51 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:20:51.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:51 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:51.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:51 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:20:51.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:51 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:20:51.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:51 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:51.725 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:51 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:20:51.725 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:51 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:20:51.725 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:51 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:51.725 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:51 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:51.725 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:51 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:20:51.726 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:51 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:20:51.726 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:51 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:20:51.726 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:51 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:52.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:52 smithi117 ceph-mon[34585]: poll took 4153.076 ms: 1 events 2021-10-08T19:20:52.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:52 smithi117 ceph-mon[34585]: Adjusting osd_memory_target on smithi117 to 5382M 2021-10-08T19:20:52.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:52 smithi097 ceph-mon[32687]: poll took 4153.076 ms: 1 events 2021-10-08T19:20:52.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:52 smithi097 ceph-mon[32687]: Adjusting osd_memory_target on smithi117 to 5382M 2021-10-08T19:20:52.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:52 smithi097 ceph-mon[41966]: poll took 4153.076 ms: 1 events 2021-10-08T19:20:52.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:52 smithi097 ceph-mon[41966]: Adjusting osd_memory_target on smithi117 to 5382M 2021-10-08T19:20:53.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:53 smithi117 ceph-mon[34585]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2021-10-08T19:20:53.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:53 smithi097 ceph-mon[32687]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2021-10-08T19:20:53.812 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:53 smithi097 ceph-mon[41966]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2021-10-08T19:20:54.076 INFO:teuthology.orchestra.run.smithi117.stderr:--> Zapping: /dev/vg_nvme/lv_1 2021-10-08T19:20:54.076 INFO:teuthology.orchestra.run.smithi117.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2021-10-08T19:20:54.077 INFO:teuthology.orchestra.run.smithi117.stderr: stderr: 10+0 records in 2021-10-08T19:20:54.077 INFO:teuthology.orchestra.run.smithi117.stderr:10+0 records out 2021-10-08T19:20:54.077 INFO:teuthology.orchestra.run.smithi117.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0188705 s, 556 MB/s 2021-10-08T19:20:54.077 INFO:teuthology.orchestra.run.smithi117.stderr:--> Zapping successful for: 2021-10-08T19:20:54.118 INFO:journalctl@ceph.osd.6.smithi117.stdout:Oct 08 19:20:53 smithi117 conmon[50186]: 2021-10-08T19:20:53.830+0000 7f0fd37b60c0 -1 osd.6 0 log_to_monitors {default=true} 2021-10-08T19:20:54.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:54 smithi117 ceph-mon[34585]: from='osd.6 v1:172.21.15.117:6808/2185843951' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-10-08T19:20:54.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:54 smithi117 ceph-mon[34585]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-10-08T19:20:54.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:54 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:20:54.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:54 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:20:54.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:54 smithi097 ceph-mon[32687]: from='osd.6 v1:172.21.15.117:6808/2185843951' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-10-08T19:20:54.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:54 smithi097 ceph-mon[32687]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-10-08T19:20:54.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:54 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:20:54.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:54 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:20:54.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:54 smithi097 ceph-mon[41966]: from='osd.6 v1:172.21.15.117:6808/2185843951' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-10-08T19:20:54.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:54 smithi097 ceph-mon[41966]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-10-08T19:20:54.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:54 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:20:54.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:54 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:20:54.935 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph orch daemon add osd smithi117:vg_nvme/lv_1 2021-10-08T19:20:55.719 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:20:55 smithi097 conmon[33110]: 172.21.15.117 - - [08/Oct/2021:19:20:55] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:20:55.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:55 smithi097 ceph-mon[32687]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2021-10-08T19:20:55.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:55 smithi097 ceph-mon[32687]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-10-08T19:20:55.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:55 smithi097 ceph-mon[32687]: osdmap e45: 7 total, 6 up, 7 in 2021-10-08T19:20:55.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:55 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:20:55.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:55 smithi097 ceph-mon[32687]: from='osd.6 v1:172.21.15.117:6808/2185843951' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2021-10-08T19:20:55.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:55 smithi097 ceph-mon[32687]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2021-10-08T19:20:55.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:55 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:55.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:55 smithi097 ceph-mon[41966]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2021-10-08T19:20:55.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:55 smithi097 ceph-mon[41966]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-10-08T19:20:55.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:55 smithi097 ceph-mon[41966]: osdmap e45: 7 total, 6 up, 7 in 2021-10-08T19:20:55.725 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:55 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:20:55.725 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:55 smithi097 ceph-mon[41966]: from='osd.6 v1:172.21.15.117:6808/2185843951' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2021-10-08T19:20:55.725 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:55 smithi097 ceph-mon[41966]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2021-10-08T19:20:55.726 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:55 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:55.743 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:55 smithi117 ceph-mon[34585]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2021-10-08T19:20:55.744 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:55 smithi117 ceph-mon[34585]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-10-08T19:20:55.744 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:55 smithi117 ceph-mon[34585]: osdmap e45: 7 total, 6 up, 7 in 2021-10-08T19:20:55.744 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:55 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:20:55.745 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:55 smithi117 ceph-mon[34585]: from='osd.6 v1:172.21.15.117:6808/2185843951' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2021-10-08T19:20:55.745 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:55 smithi117 ceph-mon[34585]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2021-10-08T19:20:55.745 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:55 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:20:55.746 INFO:journalctl@ceph.osd.6.smithi117.stdout:Oct 08 19:20:55 smithi117 conmon[50186]: 2021-10-08T19:20:55.423+0000 7f0fc9f5e700 -1 osd.6 0 waiting for initial osdmap 2021-10-08T19:20:55.746 INFO:journalctl@ceph.osd.6.smithi117.stdout:Oct 08 19:20:55 smithi117 conmon[50186]: 2021-10-08T19:20:55.432+0000 7f0fc68f9700 -1 osd.6 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-10-08T19:20:56.680 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:56 smithi117 ceph-mon[34585]: Detected new or changed devices on smithi117 2021-10-08T19:20:56.680 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:56 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:20:56.681 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:56 smithi117 ceph-mon[34585]: 172.21.15.117 - - [08/Oct/2021:19:20:55] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:20:56.681 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:56 smithi117 ceph-mon[34585]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2021-10-08T19:20:56.681 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:56 smithi117 ceph-mon[34585]: osdmap e46: 7 total, 6 up, 7 in 2021-10-08T19:20:56.681 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:56 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:20:56.681 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:56 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:20:56.682 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:56 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:20:56.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:56 smithi097 ceph-mon[32687]: Detected new or changed devices on smithi117 2021-10-08T19:20:56.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:56 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:20:56.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:56 smithi097 ceph-mon[32687]: 172.21.15.117 - - [08/Oct/2021:19:20:55] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:20:56.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:56 smithi097 ceph-mon[32687]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2021-10-08T19:20:56.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:56 smithi097 ceph-mon[32687]: osdmap e46: 7 total, 6 up, 7 in 2021-10-08T19:20:56.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:56 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:20:56.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:56 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:20:56.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:56 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:20:56.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:56 smithi097 ceph-mon[41966]: Detected new or changed devices on smithi117 2021-10-08T19:20:56.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:56 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:20:56.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:56 smithi097 ceph-mon[41966]: 172.21.15.117 - - [08/Oct/2021:19:20:55] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:20:56.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:56 smithi097 ceph-mon[41966]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2021-10-08T19:20:56.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:56 smithi097 ceph-mon[41966]: osdmap e46: 7 total, 6 up, 7 in 2021-10-08T19:20:56.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:56 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:20:56.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:56 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:20:56.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:56 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:20:57.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:57 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:20:57.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:57 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:20:57.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:57 smithi097 ceph-mon[41966]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2021-10-08T19:20:57.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:57 smithi097 ceph-mon[41966]: osd.6 v1:172.21.15.117:6808/2185843951 boot 2021-10-08T19:20:57.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:57 smithi097 ceph-mon[41966]: osdmap e47: 7 total, 7 up, 7 in 2021-10-08T19:20:57.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:57 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:20:57.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:57 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:20:57.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:57 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:20:57.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:57 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:20:57.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:57 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:20:57.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:57 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:20:57.724 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:57 smithi097 ceph-mon[32687]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2021-10-08T19:20:57.731 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:57 smithi097 ceph-mon[32687]: osd.6 v1:172.21.15.117:6808/2185843951 boot 2021-10-08T19:20:57.731 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:57 smithi097 ceph-mon[32687]: osdmap e47: 7 total, 7 up, 7 in 2021-10-08T19:20:57.731 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:57 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:20:57.732 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:57 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:20:57.732 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:57 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:20:57.732 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:57 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:20:57.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:57 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:20:57.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:57 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:20:57.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:57 smithi117 ceph-mon[34585]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2021-10-08T19:20:57.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:57 smithi117 ceph-mon[34585]: osd.6 v1:172.21.15.117:6808/2185843951 boot 2021-10-08T19:20:57.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:57 smithi117 ceph-mon[34585]: osdmap e47: 7 total, 7 up, 7 in 2021-10-08T19:20:57.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:57 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:20:57.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:57 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:20:57.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:57 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:20:57.908 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:57 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:20:58.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:58 smithi097 ceph-mon[32687]: from='client.34313 v1:172.21.15.117:0/3085422625' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:20:58.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:58 smithi097 ceph-mon[32687]: poll took 6455.246 ms: 1 events 2021-10-08T19:20:58.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:58 smithi097 ceph-mon[32687]: osdmap e48: 7 total, 7 up, 7 in 2021-10-08T19:20:58.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:58 smithi097 ceph-mon[41966]: from='client.34313 v1:172.21.15.117:0/3085422625' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:20:58.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:58 smithi097 ceph-mon[41966]: poll took 6455.246 ms: 1 events 2021-10-08T19:20:58.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:58 smithi097 ceph-mon[41966]: osdmap e48: 7 total, 7 up, 7 in 2021-10-08T19:20:58.816 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:58 smithi117 ceph-mon[34585]: from='client.34313 v1:172.21.15.117:0/3085422625' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:20:58.816 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:58 smithi117 ceph-mon[34585]: poll took 6455.246 ms: 1 events 2021-10-08T19:20:58.816 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:58 smithi117 ceph-mon[34585]: osdmap e48: 7 total, 7 up, 7 in 2021-10-08T19:20:59.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:59 smithi097 ceph-mon[32687]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2021-10-08T19:20:59.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:20:59 smithi097 ceph-mon[32687]: osdmap e49: 7 total, 7 up, 7 in 2021-10-08T19:20:59.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:59 smithi097 ceph-mon[41966]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2021-10-08T19:20:59.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:20:59 smithi097 ceph-mon[41966]: osdmap e49: 7 total, 7 up, 7 in 2021-10-08T19:20:59.904 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:59 smithi117 ceph-mon[34585]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2021-10-08T19:20:59.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:20:59 smithi117 ceph-mon[34585]: osdmap e49: 7 total, 7 up, 7 in 2021-10-08T19:21:00.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:00 smithi097 ceph-mon[32687]: osdmap e50: 7 total, 7 up, 7 in 2021-10-08T19:21:00.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:00 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.117:0/1696372951' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "529af2ce-2ae9-41ed-8c8e-d133628cfd20"}]: dispatch 2021-10-08T19:21:00.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:00 smithi097 ceph-mon[32687]: from='client.34319 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "529af2ce-2ae9-41ed-8c8e-d133628cfd20"}]: dispatch 2021-10-08T19:21:00.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:00 smithi097 ceph-mon[32687]: from='client.34319 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "529af2ce-2ae9-41ed-8c8e-d133628cfd20"}]': finished 2021-10-08T19:21:00.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:00 smithi097 ceph-mon[32687]: osdmap e51: 8 total, 7 up, 8 in 2021-10-08T19:21:00.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:00 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:21:00.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:00 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.117:0/890712041' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:21:00.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:00 smithi097 ceph-mon[41966]: osdmap e50: 7 total, 7 up, 7 in 2021-10-08T19:21:00.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:00 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.117:0/1696372951' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "529af2ce-2ae9-41ed-8c8e-d133628cfd20"}]: dispatch 2021-10-08T19:21:00.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:00 smithi097 ceph-mon[41966]: from='client.34319 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "529af2ce-2ae9-41ed-8c8e-d133628cfd20"}]: dispatch 2021-10-08T19:21:00.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:00 smithi097 ceph-mon[41966]: from='client.34319 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "529af2ce-2ae9-41ed-8c8e-d133628cfd20"}]': finished 2021-10-08T19:21:00.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:00 smithi097 ceph-mon[41966]: osdmap e51: 8 total, 7 up, 8 in 2021-10-08T19:21:00.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:00 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:21:00.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:00 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.117:0/890712041' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:21:00.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:00 smithi117 ceph-mon[34585]: osdmap e50: 7 total, 7 up, 7 in 2021-10-08T19:21:00.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:00 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.117:0/1696372951' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "529af2ce-2ae9-41ed-8c8e-d133628cfd20"}]: dispatch 2021-10-08T19:21:00.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:00 smithi117 ceph-mon[34585]: from='client.34319 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "529af2ce-2ae9-41ed-8c8e-d133628cfd20"}]: dispatch 2021-10-08T19:21:00.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:00 smithi117 ceph-mon[34585]: from='client.34319 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "529af2ce-2ae9-41ed-8c8e-d133628cfd20"}]': finished 2021-10-08T19:21:00.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:00 smithi117 ceph-mon[34585]: osdmap e51: 8 total, 7 up, 8 in 2021-10-08T19:21:00.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:00 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:21:00.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:00 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.117:0/890712041' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:21:01.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:01 smithi117 ceph-mon[34585]: pgmap v155: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail; 159 KiB/s, 0 objects/s recovering 2021-10-08T19:21:01.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:01 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:21:01.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:01 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:21:01.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:01 smithi117 ceph-mon[34585]: osdmap e52: 8 total, 7 up, 8 in 2021-10-08T19:21:01.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:01 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:21:01.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:01 smithi097 ceph-mon[32687]: pgmap v155: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail; 159 KiB/s, 0 objects/s recovering 2021-10-08T19:21:01.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:01 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:21:01.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:01 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:21:01.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:01 smithi097 ceph-mon[32687]: osdmap e52: 8 total, 7 up, 8 in 2021-10-08T19:21:01.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:01 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:21:01.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:01 smithi097 ceph-mon[41966]: pgmap v155: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail; 159 KiB/s, 0 objects/s recovering 2021-10-08T19:21:01.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:01 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:21:01.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:01 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:21:01.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:01 smithi097 ceph-mon[41966]: osdmap e52: 8 total, 7 up, 8 in 2021-10-08T19:21:01.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:01 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:21:03.752 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:03 smithi117 ceph-mon[34585]: pgmap v157: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail; 144 KiB/s, 0 objects/s recovering 2021-10-08T19:21:03.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:03 smithi097 ceph-mon[32687]: pgmap v157: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail; 144 KiB/s, 0 objects/s recovering 2021-10-08T19:21:03.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:03 smithi097 ceph-mon[41966]: pgmap v157: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail; 144 KiB/s, 0 objects/s recovering 2021-10-08T19:21:04.797 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:04 smithi117 ceph-mon[34585]: 1.0 scrub ok 2021-10-08T19:21:04.798 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:04 smithi117 ceph-mon[34585]: poll took 5546.797 ms: 1 events 2021-10-08T19:21:04.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:04 smithi097 ceph-mon[32687]: 1.0 scrub ok 2021-10-08T19:21:04.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:04 smithi097 ceph-mon[32687]: poll took 5546.797 ms: 1 events 2021-10-08T19:21:04.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:04 smithi097 ceph-mon[41966]: 1.0 scrub ok 2021-10-08T19:21:04.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:04 smithi097 ceph-mon[41966]: poll took 5546.797 ms: 1 events 2021-10-08T19:21:05.867 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:05 smithi117 ceph-mon[34585]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail; 103 KiB/s, 0 objects/s recovering 2021-10-08T19:21:05.905 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:05 smithi097 ceph-mon[41966]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail; 103 KiB/s, 0 objects/s recovering 2021-10-08T19:21:05.906 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:05 smithi097 ceph-mon[32687]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail; 103 KiB/s, 0 objects/s recovering 2021-10-08T19:21:06.745 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:06 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2021-10-08T19:21:06.745 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:06 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:21:06.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:06 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2021-10-08T19:21:06.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:06 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:21:06.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:06 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2021-10-08T19:21:06.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:06 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:21:07.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:07 smithi117 ceph-mon[34585]: poll took 2637.286 ms: 1 events 2021-10-08T19:21:07.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:07 smithi117 ceph-mon[34585]: Deploying daemon osd.7 on smithi117 2021-10-08T19:21:07.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:07 smithi117 ceph-mon[34585]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2021-10-08T19:21:07.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:07 smithi097 ceph-mon[32687]: poll took 2637.286 ms: 1 events 2021-10-08T19:21:07.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:07 smithi097 ceph-mon[32687]: Deploying daemon osd.7 on smithi117 2021-10-08T19:21:07.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:07 smithi097 ceph-mon[32687]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2021-10-08T19:21:07.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:07 smithi097 ceph-mon[41966]: poll took 2637.286 ms: 1 events 2021-10-08T19:21:07.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:07 smithi097 ceph-mon[41966]: Deploying daemon osd.7 on smithi117 2021-10-08T19:21:07.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:07 smithi097 ceph-mon[41966]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2021-10-08T19:21:09.713 INFO:teuthology.orchestra.run.smithi117.stdout:Created osd(s) 7 on host 'smithi117' 2021-10-08T19:21:09.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:09 smithi097 ceph-mon[32687]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2021-10-08T19:21:09.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:09 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:09.720 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:21:09 smithi097 conmon[33110]: 172.21.15.97 - - [08/Oct/2021:19:21:09] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:21:09.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:09 smithi097 ceph-mon[41966]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2021-10-08T19:21:09.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:09 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:09.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:09 smithi117 ceph-mon[34585]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2021-10-08T19:21:09.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:09 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:10.376 DEBUG:teuthology.orchestra.run.smithi117:osd.7> sudo journalctl -f -n 0 -u ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@osd.7.service 2021-10-08T19:21:10.379 INFO:tasks.cephadm:Waiting for 8 OSDs to come up... 2021-10-08T19:21:10.380 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd stat -f json 2021-10-08T19:21:10.410 INFO:journalctl@ceph.osd.7.smithi117.stdout:-- Logs begin at Fri 2021-10-08 19:07:21 UTC. -- 2021-10-08T19:21:10.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:10 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:21:10.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:10 smithi097 ceph-mon[32687]: 172.21.15.97 - - [08/Oct/2021:19:21:09] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:21:10.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:10 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:21:10.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:10 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:21:10.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:10 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:10.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:10 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:21:10.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:10 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:21:10.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:10 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:10.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:10 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:21:10.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:10 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:21:10.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:10 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:21:10.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:10 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:10.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:10 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:10.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:10 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:21:10.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:10 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:21:10.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:10 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:21:10.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:10 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:10.724 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:10 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:21:10.724 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:10 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:21:10.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:10 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:21:10.725 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:10 smithi097 ceph-mon[41966]: 172.21.15.97 - - [08/Oct/2021:19:21:09] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:21:10.725 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:10 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:21:10.725 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:10 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:21:10.725 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:10 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:10.725 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:10 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:21:10.726 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:10 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:21:10.726 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:10 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:10.726 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:10 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:21:10.726 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:10 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:21:10.727 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:10 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:21:10.727 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:10 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:10.727 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:10 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:10.727 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:10 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:21:10.727 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:10 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:21:10.728 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:10 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:21:10.728 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:10 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:10.728 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:10 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:21:10.728 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:10 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:21:10.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:10 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:21:10.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:10 smithi117 ceph-mon[34585]: 172.21.15.97 - - [08/Oct/2021:19:21:09] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:21:10.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:10 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:21:10.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:10 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:21:10.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:10 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:10.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:10 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:21:10.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:10 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:21:10.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:10 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:10.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:10 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:21:10.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:10 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:21:10.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:10 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:21:10.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:10 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:10.908 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:10 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:10.908 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:10 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:21:10.908 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:10 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:21:10.908 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:10 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:21:10.908 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:10 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:10.909 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:10 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:21:10.909 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:10 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:21:11.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:11 smithi117 ceph-mon[34585]: poll took 3483.518 ms: 1 events 2021-10-08T19:21:11.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:11 smithi117 ceph-mon[34585]: Adjusting osd_memory_target on smithi117 to 4037M 2021-10-08T19:21:11.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:11 smithi117 ceph-mon[34585]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2021-10-08T19:21:11.945 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:11 smithi097 ceph-mon[32687]: poll took 3483.518 ms: 1 events 2021-10-08T19:21:11.946 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:11 smithi097 ceph-mon[32687]: Adjusting osd_memory_target on smithi117 to 4037M 2021-10-08T19:21:11.946 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:11 smithi097 ceph-mon[32687]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2021-10-08T19:21:11.947 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:11 smithi097 ceph-mon[41966]: poll took 3483.518 ms: 1 events 2021-10-08T19:21:11.947 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:11 smithi097 ceph-mon[41966]: Adjusting osd_memory_target on smithi117 to 4037M 2021-10-08T19:21:11.947 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:11 smithi097 ceph-mon[41966]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2021-10-08T19:21:12.294 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:21:12.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:12 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1730001482' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2021-10-08T19:21:12.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:12 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1730001482' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2021-10-08T19:21:12.889 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:12 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1730001482' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2021-10-08T19:21:12.891 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":52,"num_osds":8,"num_up_osds":7,"osd_up_since":1633720856,"num_in_osds":8,"osd_in_since":1633720859,"num_remapped_pgs":0} 2021-10-08T19:21:13.155 INFO:journalctl@ceph.osd.7.smithi117.stdout:Oct 08 19:21:12 smithi117 conmon[54364]: 2021-10-08T19:21:12.888+0000 7ff3b19410c0 -1 osd.7 0 log_to_monitors {default=true} 2021-10-08T19:21:13.893 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd stat -f json 2021-10-08T19:21:13.904 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:13 smithi117 ceph-mon[34585]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2021-10-08T19:21:13.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:13 smithi117 ceph-mon[34585]: from='osd.7 v1:172.21.15.117:6812/2817683239' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-10-08T19:21:13.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:13 smithi117 ceph-mon[34585]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-10-08T19:21:13.922 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:13 smithi097 ceph-mon[41966]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2021-10-08T19:21:13.923 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:13 smithi097 ceph-mon[41966]: from='osd.7 v1:172.21.15.117:6812/2817683239' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-10-08T19:21:13.924 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:13 smithi097 ceph-mon[41966]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-10-08T19:21:13.924 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:13 smithi097 ceph-mon[32687]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2021-10-08T19:21:13.925 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:13 smithi097 ceph-mon[32687]: from='osd.7 v1:172.21.15.117:6812/2817683239' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-10-08T19:21:13.925 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:13 smithi097 ceph-mon[32687]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-10-08T19:21:14.631 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:14 smithi097 ceph-mon[41966]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-10-08T19:21:14.631 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:14 smithi097 ceph-mon[41966]: osdmap e53: 8 total, 7 up, 8 in 2021-10-08T19:21:14.632 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:14 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:21:14.632 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:14 smithi097 ceph-mon[41966]: from='osd.7 v1:172.21.15.117:6812/2817683239' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2021-10-08T19:21:14.632 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:14 smithi097 ceph-mon[41966]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2021-10-08T19:21:14.633 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:14 smithi097 ceph-mon[32687]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-10-08T19:21:14.633 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:14 smithi097 ceph-mon[32687]: osdmap e53: 8 total, 7 up, 8 in 2021-10-08T19:21:14.633 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:14 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:21:14.633 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:14 smithi097 ceph-mon[32687]: from='osd.7 v1:172.21.15.117:6812/2817683239' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2021-10-08T19:21:14.634 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:14 smithi097 ceph-mon[32687]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2021-10-08T19:21:14.905 INFO:journalctl@ceph.osd.7.smithi117.stdout:Oct 08 19:21:14 smithi117 conmon[54364]: 2021-10-08T19:21:14.553+0000 7ff3a80e9700 -1 osd.7 0 waiting for initial osdmap 2021-10-08T19:21:14.905 INFO:journalctl@ceph.osd.7.smithi117.stdout:Oct 08 19:21:14 smithi117 conmon[54364]: 2021-10-08T19:21:14.560+0000 7ff3a3281700 -1 osd.7 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-10-08T19:21:14.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:14 smithi117 ceph-mon[34585]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-10-08T19:21:14.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:14 smithi117 ceph-mon[34585]: osdmap e53: 8 total, 7 up, 8 in 2021-10-08T19:21:14.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:14 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:21:14.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:14 smithi117 ceph-mon[34585]: from='osd.7 v1:172.21.15.117:6812/2817683239' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2021-10-08T19:21:14.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:14 smithi117 ceph-mon[34585]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2021-10-08T19:21:15.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:15 smithi097 ceph-mon[32687]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2021-10-08T19:21:15.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:15 smithi097 ceph-mon[32687]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2021-10-08T19:21:15.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:15 smithi097 ceph-mon[32687]: osdmap e54: 8 total, 7 up, 8 in 2021-10-08T19:21:15.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:15 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:21:15.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:15 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:21:15.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:15 smithi097 ceph-mon[32687]: osd.7 v1:172.21.15.117:6812/2817683239 boot 2021-10-08T19:21:15.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:15 smithi097 ceph-mon[32687]: osdmap e55: 8 total, 8 up, 8 in 2021-10-08T19:21:15.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:15 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:21:15.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:15 smithi097 ceph-mon[41966]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2021-10-08T19:21:15.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:15 smithi097 ceph-mon[41966]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2021-10-08T19:21:15.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:15 smithi097 ceph-mon[41966]: osdmap e54: 8 total, 7 up, 8 in 2021-10-08T19:21:15.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:15 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:21:15.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:15 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:21:15.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:15 smithi097 ceph-mon[41966]: osd.7 v1:172.21.15.117:6812/2817683239 boot 2021-10-08T19:21:15.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:15 smithi097 ceph-mon[41966]: osdmap e55: 8 total, 8 up, 8 in 2021-10-08T19:21:15.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:15 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:21:15.736 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:21:15.822 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:15 smithi117 ceph-mon[34585]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2021-10-08T19:21:15.823 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:15 smithi117 ceph-mon[34585]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2021-10-08T19:21:15.823 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:15 smithi117 ceph-mon[34585]: osdmap e54: 8 total, 7 up, 8 in 2021-10-08T19:21:15.823 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:15 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:21:15.824 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:15 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:21:15.824 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:15 smithi117 ceph-mon[34585]: osd.7 v1:172.21.15.117:6812/2817683239 boot 2021-10-08T19:21:15.824 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:15 smithi117 ceph-mon[34585]: osdmap e55: 8 total, 8 up, 8 in 2021-10-08T19:21:15.825 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:15 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:21:16.308 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":55,"num_osds":8,"num_up_osds":8,"osd_up_since":1633720875,"num_in_osds":8,"osd_in_since":1633720859,"num_remapped_pgs":1} 2021-10-08T19:21:16.309 INFO:tasks.cephadm:Adding ceph.rgw.foo.a on smithi097 2021-10-08T19:21:16.309 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph orch apply rgw foo.a --placement '1;smithi097=foo.a' 2021-10-08T19:21:16.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:16 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:21:16.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:16 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:21:16.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:16 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3436035339' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2021-10-08T19:21:16.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:16 smithi117 ceph-mon[34585]: osdmap e56: 8 total, 8 up, 8 in 2021-10-08T19:21:16.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:16 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:21:16.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:16 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:21:16.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:16 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3436035339' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2021-10-08T19:21:16.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:16 smithi097 ceph-mon[32687]: osdmap e56: 8 total, 8 up, 8 in 2021-10-08T19:21:16.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:16 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:21:16.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:16 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:21:16.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:16 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3436035339' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2021-10-08T19:21:16.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:16 smithi097 ceph-mon[41966]: osdmap e56: 8 total, 8 up, 8 in 2021-10-08T19:21:17.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:17 smithi117 ceph-mon[34585]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:21:17.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:17 smithi117 ceph-mon[34585]: osdmap e57: 8 total, 8 up, 8 in 2021-10-08T19:21:17.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:17 smithi097 ceph-mon[32687]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:21:17.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:17 smithi097 ceph-mon[32687]: osdmap e57: 8 total, 8 up, 8 in 2021-10-08T19:21:17.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:17 smithi097 ceph-mon[41966]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:21:17.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:17 smithi097 ceph-mon[41966]: osdmap e57: 8 total, 8 up, 8 in 2021-10-08T19:21:19.301 INFO:teuthology.orchestra.run.smithi117.stdout:Scheduled rgw.foo.a update... 2021-10-08T19:21:19.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:19 smithi097 ceph-mon[32687]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:21:19.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:19 smithi097 ceph-mon[32687]: osdmap e58: 8 total, 8 up, 8 in 2021-10-08T19:21:19.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:19 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:19.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:19 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:21:19.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:19 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:21:19.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:19 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:21:19.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:19 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:19.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:19 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:19.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:19 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-10-08T19:21:19.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:19 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2021-10-08T19:21:19.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:19 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:19.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:19 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:21:19.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:19 smithi097 ceph-mon[41966]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:21:19.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:19 smithi097 ceph-mon[41966]: osdmap e58: 8 total, 8 up, 8 in 2021-10-08T19:21:19.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:19 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:19.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:19 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:21:19.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:19 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:21:19.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:19 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:21:19.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:19 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:19.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:19 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:19.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:19 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-10-08T19:21:19.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:19 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2021-10-08T19:21:19.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:19 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:19.725 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:19 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:21:19.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:19 smithi117 ceph-mon[34585]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:21:19.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:19 smithi117 ceph-mon[34585]: osdmap e58: 8 total, 8 up, 8 in 2021-10-08T19:21:19.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:19 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:19.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:19 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:21:19.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:19 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:21:19.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:19 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:21:19.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:19 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:19.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:19 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:19.908 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:19 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-10-08T19:21:19.908 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:19 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2021-10-08T19:21:19.909 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:19 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:19.909 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:19 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:21:20.241 DEBUG:teuthology.orchestra.run.smithi097:rgw.foo.a> sudo journalctl -f -n 0 -u ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@rgw.foo.a.service 2021-10-08T19:21:20.246 INFO:tasks.cephadm:Adding ceph.iscsi.iscsi.a on smithi117 2021-10-08T19:21:20.246 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd pool create iscsi 3 3 replicated 2021-10-08T19:21:20.271 INFO:journalctl@ceph.rgw.foo.a.smithi097.stdout:-- Logs begin at Fri 2021-10-08 19:07:18 UTC. -- 2021-10-08T19:21:20.882 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:21:20 smithi097 conmon[33110]: 172.21.15.117 - - [08/Oct/2021:19:21:20] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:21:20.883 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:20 smithi097 ceph-mon[41966]: from='client.34352 v1:172.21.15.117:0/1950988013' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi097=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:21:20.883 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:20 smithi097 ceph-mon[41966]: Saving service rgw.foo.a spec with placement smithi097=foo.a;count:1 2021-10-08T19:21:20.883 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:20 smithi097 ceph-mon[41966]: Saving service rgw.foo.a spec with placement smithi097=foo.a;count:1 2021-10-08T19:21:20.884 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:20 smithi097 ceph-mon[41966]: Deploying daemon rgw.foo.a on smithi097 2021-10-08T19:21:20.884 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:20 smithi097 ceph-mon[41966]: poll took 9632.857 ms: 1 events 2021-10-08T19:21:20.884 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:20 smithi097 ceph-mon[41966]: osdmap e59: 8 total, 8 up, 8 in 2021-10-08T19:21:20.885 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:20 smithi097 ceph-mon[32687]: from='client.34352 v1:172.21.15.117:0/1950988013' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi097=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:21:20.885 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:20 smithi097 ceph-mon[32687]: Saving service rgw.foo.a spec with placement smithi097=foo.a;count:1 2021-10-08T19:21:20.885 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:20 smithi097 ceph-mon[32687]: Saving service rgw.foo.a spec with placement smithi097=foo.a;count:1 2021-10-08T19:21:20.885 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:20 smithi097 ceph-mon[32687]: Deploying daemon rgw.foo.a on smithi097 2021-10-08T19:21:20.886 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:20 smithi097 ceph-mon[32687]: poll took 9632.857 ms: 1 events 2021-10-08T19:21:20.886 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:20 smithi097 ceph-mon[32687]: osdmap e59: 8 total, 8 up, 8 in 2021-10-08T19:21:20.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:20 smithi117 ceph-mon[34585]: from='client.34352 v1:172.21.15.117:0/1950988013' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi097=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:21:20.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:20 smithi117 ceph-mon[34585]: Saving service rgw.foo.a spec with placement smithi097=foo.a;count:1 2021-10-08T19:21:20.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:20 smithi117 ceph-mon[34585]: Saving service rgw.foo.a spec with placement smithi097=foo.a;count:1 2021-10-08T19:21:20.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:20 smithi117 ceph-mon[34585]: Deploying daemon rgw.foo.a on smithi097 2021-10-08T19:21:20.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:20 smithi117 ceph-mon[34585]: poll took 9632.857 ms: 1 events 2021-10-08T19:21:20.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:20 smithi117 ceph-mon[34585]: osdmap e59: 8 total, 8 up, 8 in 2021-10-08T19:21:21.219 INFO:journalctl@ceph.rgw.foo.a.smithi097.stdout:Oct 08 19:21:20 smithi097 systemd[1]: Starting Ceph rgw.foo.a for 1d01f6d6-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:21:21.691 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:21 smithi097 ceph-mon[32687]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:21:21.692 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:21 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:21.692 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:21 smithi097 ceph-mon[41966]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:21:21.693 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:21 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:21.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:21 smithi117 ceph-mon[34585]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:21:21.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:21 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:21.969 INFO:journalctl@ceph.rgw.foo.a.smithi097.stdout:Oct 08 19:21:21 smithi097 bash[64377]: a73053d15952a467e13a6d6ff1ad24b4fc0e28e100aab1503cf265f2e086b853 2021-10-08T19:21:21.969 INFO:journalctl@ceph.rgw.foo.a.smithi097.stdout:Oct 08 19:21:21 smithi097 systemd[1]: Started Ceph rgw.foo.a for 1d01f6d6-286c-11ec-8c25-001a4aab830c. 2021-10-08T19:21:22.596 INFO:teuthology.orchestra.run.smithi117.stderr:pool 'iscsi' created 2021-10-08T19:21:22.904 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:22 smithi117 ceph-mon[34585]: Detected new or changed devices on smithi117 2021-10-08T19:21:22.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:22 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:21:22.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:22 smithi117 ceph-mon[34585]: 172.21.15.117 - - [08/Oct/2021:19:21:20] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:21:22.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:22 smithi117 ceph-mon[34585]: poll took 1061.309 ms: 1 events 2021-10-08T19:21:22.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:22 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:22.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:22 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:21:22.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:22 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:21:22.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:22 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:21:22.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:22 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.117:0/502696405' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2021-10-08T19:21:22.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:22 smithi117 ceph-mon[34585]: from='client.34382 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2021-10-08T19:21:22.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:22 smithi097 ceph-mon[32687]: Detected new or changed devices on smithi117 2021-10-08T19:21:22.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:22 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:21:22.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:22 smithi097 ceph-mon[32687]: 172.21.15.117 - - [08/Oct/2021:19:21:20] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:21:22.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:22 smithi097 ceph-mon[32687]: poll took 1061.309 ms: 1 events 2021-10-08T19:21:22.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:22 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:22.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:22 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:21:22.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:22 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:21:22.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:22 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:21:22.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:22 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.117:0/502696405' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2021-10-08T19:21:22.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:22 smithi097 ceph-mon[32687]: from='client.34382 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2021-10-08T19:21:22.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:22 smithi097 ceph-mon[41966]: Detected new or changed devices on smithi117 2021-10-08T19:21:22.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:22 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:21:22.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:22 smithi097 ceph-mon[41966]: 172.21.15.117 - - [08/Oct/2021:19:21:20] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:21:22.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:22 smithi097 ceph-mon[41966]: poll took 1061.309 ms: 1 events 2021-10-08T19:21:22.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:22 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:22.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:22 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:21:22.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:22 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:21:22.975 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:22 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:21:22.975 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:22 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.117:0/502696405' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2021-10-08T19:21:22.975 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:22 smithi097 ceph-mon[41966]: from='client.34382 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2021-10-08T19:21:23.319 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd pool application enable iscsi rbd 2021-10-08T19:21:23.586 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:23 smithi117 ceph-mon[34585]: Sending message to agent on host smithi097 2021-10-08T19:21:23.586 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:23 smithi117 ceph-mon[34585]: Checking dashboard <-> RGW credentials 2021-10-08T19:21:23.587 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:23 smithi117 ceph-mon[34585]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail; 102 KiB/s, 0 objects/s recovering 2021-10-08T19:21:23.587 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:23 smithi117 ceph-mon[34585]: Received "ACK" from agent on host smithi097 2021-10-08T19:21:23.587 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:23 smithi117 ceph-mon[34585]: from='client.34382 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2021-10-08T19:21:23.588 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:23 smithi117 ceph-mon[34585]: osdmap e60: 8 total, 8 up, 8 in 2021-10-08T19:21:23.588 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:23 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1622493358' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-10-08T19:21:23.589 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:23 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1599842043' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-10-08T19:21:23.589 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:23 smithi117 ceph-mon[34585]: from='client.24379 ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-10-08T19:21:23.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:23 smithi097 ceph-mon[32687]: Sending message to agent on host smithi097 2021-10-08T19:21:23.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:23 smithi097 ceph-mon[32687]: Checking dashboard <-> RGW credentials 2021-10-08T19:21:23.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:23 smithi097 ceph-mon[32687]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail; 102 KiB/s, 0 objects/s recovering 2021-10-08T19:21:23.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:23 smithi097 ceph-mon[32687]: Received "ACK" from agent on host smithi097 2021-10-08T19:21:23.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:23 smithi097 ceph-mon[32687]: from='client.34382 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2021-10-08T19:21:23.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:23 smithi097 ceph-mon[32687]: osdmap e60: 8 total, 8 up, 8 in 2021-10-08T19:21:23.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:23 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1622493358' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-10-08T19:21:23.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:23 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1599842043' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-10-08T19:21:23.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:23 smithi097 ceph-mon[32687]: from='client.24379 ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-10-08T19:21:23.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:23 smithi097 ceph-mon[41966]: Sending message to agent on host smithi097 2021-10-08T19:21:23.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:23 smithi097 ceph-mon[41966]: Checking dashboard <-> RGW credentials 2021-10-08T19:21:23.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:23 smithi097 ceph-mon[41966]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail; 102 KiB/s, 0 objects/s recovering 2021-10-08T19:21:23.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:23 smithi097 ceph-mon[41966]: Received "ACK" from agent on host smithi097 2021-10-08T19:21:23.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:23 smithi097 ceph-mon[41966]: from='client.34382 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2021-10-08T19:21:23.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:23 smithi097 ceph-mon[41966]: osdmap e60: 8 total, 8 up, 8 in 2021-10-08T19:21:23.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:23 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1622493358' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-10-08T19:21:23.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:23 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1599842043' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-10-08T19:21:23.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:23 smithi097 ceph-mon[41966]: from='client.24379 ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-10-08T19:21:24.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:24 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1622493358' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2021-10-08T19:21:24.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:24 smithi117 ceph-mon[34585]: from='client.24379 ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2021-10-08T19:21:24.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:24 smithi117 ceph-mon[34585]: osdmap e61: 8 total, 8 up, 8 in 2021-10-08T19:21:24.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:24 smithi117 ceph-mon[34585]: pgmap v177: 36 pgs: 4 creating+peering, 1 active+clean, 31 unknown; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail; 105 KiB/s, 0 objects/s recovering 2021-10-08T19:21:24.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:24 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1622493358' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2021-10-08T19:21:24.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:24 smithi097 ceph-mon[32687]: from='client.24379 ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2021-10-08T19:21:24.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:24 smithi097 ceph-mon[32687]: osdmap e61: 8 total, 8 up, 8 in 2021-10-08T19:21:24.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:24 smithi097 ceph-mon[32687]: pgmap v177: 36 pgs: 4 creating+peering, 1 active+clean, 31 unknown; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail; 105 KiB/s, 0 objects/s recovering 2021-10-08T19:21:24.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:24 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1622493358' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2021-10-08T19:21:24.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:24 smithi097 ceph-mon[41966]: from='client.24379 ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2021-10-08T19:21:24.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:24 smithi097 ceph-mon[41966]: osdmap e61: 8 total, 8 up, 8 in 2021-10-08T19:21:24.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:24 smithi097 ceph-mon[41966]: pgmap v177: 36 pgs: 4 creating+peering, 1 active+clean, 31 unknown; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail; 105 KiB/s, 0 objects/s recovering 2021-10-08T19:21:25.608 INFO:teuthology.orchestra.run.smithi117.stderr:enabled application 'rbd' on pool 'iscsi' 2021-10-08T19:21:25.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:25 smithi117 ceph-mon[34585]: osdmap e62: 8 total, 8 up, 8 in 2021-10-08T19:21:25.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:25 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1622493358' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2021-10-08T19:21:25.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:25 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1098048758' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2021-10-08T19:21:25.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:25 smithi117 ceph-mon[34585]: from='client.24400 ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2021-10-08T19:21:25.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:25 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:25.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:25 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.117:0/2687166159' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2021-10-08T19:21:25.908 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:25 smithi117 ceph-mon[34585]: from='client.34397 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2021-10-08T19:21:25.969 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:25 smithi097 ceph-mon[41966]: osdmap e62: 8 total, 8 up, 8 in 2021-10-08T19:21:25.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:25 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1622493358' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2021-10-08T19:21:25.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:25 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1098048758' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2021-10-08T19:21:25.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:25 smithi097 ceph-mon[41966]: from='client.24400 ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2021-10-08T19:21:25.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:25 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:25.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:25 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.117:0/2687166159' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2021-10-08T19:21:25.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:25 smithi097 ceph-mon[41966]: from='client.34397 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2021-10-08T19:21:25.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:25 smithi097 ceph-mon[32687]: osdmap e62: 8 total, 8 up, 8 in 2021-10-08T19:21:25.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:25 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1622493358' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2021-10-08T19:21:25.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:25 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1098048758' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2021-10-08T19:21:25.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:25 smithi097 ceph-mon[32687]: from='client.24400 ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2021-10-08T19:21:25.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:25 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:25.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:25 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.117:0/2687166159' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2021-10-08T19:21:25.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:25 smithi097 ceph-mon[32687]: from='client.34397 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2021-10-08T19:21:26.249 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph orch apply iscsi iscsi user password --placement '1;smithi117=iscsi.a' 2021-10-08T19:21:26.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:26 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1622493358' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2021-10-08T19:21:26.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:26 smithi117 ceph-mon[34585]: from='client.24400 ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2021-10-08T19:21:26.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:26 smithi117 ceph-mon[34585]: from='client.34397 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]': finished 2021-10-08T19:21:26.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:26 smithi117 ceph-mon[34585]: osdmap e63: 8 total, 8 up, 8 in 2021-10-08T19:21:26.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:26 smithi117 ceph-mon[34585]: pgmap v180: 68 pgs: 11 creating+peering, 15 active+clean, 42 unknown; 578 KiB data, 47 MiB used, 715 GiB / 715 GiB avail; 4.5 KiB/s rd, 1023 B/s wr, 5 op/s 2021-10-08T19:21:26.969 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:21:26 smithi097 conmon[33110]: 172.21.15.97 - - [08/Oct/2021:19:21:26] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:21:26.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:26 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1622493358' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2021-10-08T19:21:26.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:26 smithi097 ceph-mon[41966]: from='client.24400 ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2021-10-08T19:21:26.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:26 smithi097 ceph-mon[41966]: from='client.34397 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]': finished 2021-10-08T19:21:26.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:26 smithi097 ceph-mon[41966]: osdmap e63: 8 total, 8 up, 8 in 2021-10-08T19:21:26.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:26 smithi097 ceph-mon[41966]: pgmap v180: 68 pgs: 11 creating+peering, 15 active+clean, 42 unknown; 578 KiB data, 47 MiB used, 715 GiB / 715 GiB avail; 4.5 KiB/s rd, 1023 B/s wr, 5 op/s 2021-10-08T19:21:26.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:26 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1622493358' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2021-10-08T19:21:26.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:26 smithi097 ceph-mon[32687]: from='client.24400 ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2021-10-08T19:21:26.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:26 smithi097 ceph-mon[32687]: from='client.34397 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]': finished 2021-10-08T19:21:26.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:26 smithi097 ceph-mon[32687]: osdmap e63: 8 total, 8 up, 8 in 2021-10-08T19:21:26.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:26 smithi097 ceph-mon[32687]: pgmap v180: 68 pgs: 11 creating+peering, 15 active+clean, 42 unknown; 578 KiB data, 47 MiB used, 715 GiB / 715 GiB avail; 4.5 KiB/s rd, 1023 B/s wr, 5 op/s 2021-10-08T19:21:27.893 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:27 smithi117 ceph-mon[34585]: osdmap e64: 8 total, 8 up, 8 in 2021-10-08T19:21:27.893 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:27 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1622493358' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2021-10-08T19:21:27.894 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:27 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1098048758' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2021-10-08T19:21:27.894 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:27 smithi117 ceph-mon[34585]: from='client.24400 ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2021-10-08T19:21:27.895 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:27 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:27.895 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:27 smithi117 ceph-mon[34585]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:21:27.896 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:27 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:21:27.896 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:27 smithi117 ceph-mon[34585]: 172.21.15.97 - - [08/Oct/2021:19:21:26] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:21:27.969 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:27 smithi097 ceph-mon[41966]: osdmap e64: 8 total, 8 up, 8 in 2021-10-08T19:21:27.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:27 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1622493358' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2021-10-08T19:21:27.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:27 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1098048758' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2021-10-08T19:21:27.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:27 smithi097 ceph-mon[41966]: from='client.24400 ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2021-10-08T19:21:27.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:27 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:27.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:27 smithi097 ceph-mon[41966]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:21:27.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:27 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:21:27.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:27 smithi097 ceph-mon[41966]: 172.21.15.97 - - [08/Oct/2021:19:21:26] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:21:27.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:27 smithi097 ceph-mon[32687]: osdmap e64: 8 total, 8 up, 8 in 2021-10-08T19:21:27.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:27 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1622493358' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2021-10-08T19:21:27.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:27 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1098048758' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2021-10-08T19:21:27.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:27 smithi097 ceph-mon[32687]: from='client.24400 ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2021-10-08T19:21:27.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:27 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:27.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:27 smithi097 ceph-mon[32687]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:21:27.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:27 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:21:27.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:27 smithi097 ceph-mon[32687]: 172.21.15.97 - - [08/Oct/2021:19:21:26] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:21:28.271 INFO:teuthology.orchestra.run.smithi117.stdout:Scheduled iscsi.iscsi update... 2021-10-08T19:21:28.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:28 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1622493358' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2021-10-08T19:21:28.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:28 smithi117 ceph-mon[34585]: from='client.24400 ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2021-10-08T19:21:28.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:28 smithi117 ceph-mon[34585]: osdmap e65: 8 total, 8 up, 8 in 2021-10-08T19:21:28.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:28 smithi117 ceph-mon[34585]: pgmap v183: 100 pgs: 19 creating+peering, 42 active+clean, 39 unknown; 578 KiB data, 48 MiB used, 715 GiB / 715 GiB avail; 4.5 KiB/s rd, 1023 B/s wr, 5 op/s 2021-10-08T19:21:28.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:28 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:21:28.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:28 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:21:28.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:28 smithi117 ceph-mon[34585]: from='client.34415 v1:172.21.15.117:0/3121786117' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "iscsi", "api_user": "user", "api_password": "password", "placement": "1;smithi117=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:21:28.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:28 smithi117 ceph-mon[34585]: Saving service iscsi.iscsi spec with placement smithi117=iscsi.a;count:1 2021-10-08T19:21:28.908 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:28 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:28.969 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:28 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1622493358' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2021-10-08T19:21:28.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:28 smithi097 ceph-mon[41966]: from='client.24400 ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2021-10-08T19:21:28.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:28 smithi097 ceph-mon[41966]: osdmap e65: 8 total, 8 up, 8 in 2021-10-08T19:21:28.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:28 smithi097 ceph-mon[41966]: pgmap v183: 100 pgs: 19 creating+peering, 42 active+clean, 39 unknown; 578 KiB data, 48 MiB used, 715 GiB / 715 GiB avail; 4.5 KiB/s rd, 1023 B/s wr, 5 op/s 2021-10-08T19:21:28.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:28 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:21:28.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:28 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:21:28.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:28 smithi097 ceph-mon[41966]: from='client.34415 v1:172.21.15.117:0/3121786117' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "iscsi", "api_user": "user", "api_password": "password", "placement": "1;smithi117=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:21:28.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:28 smithi097 ceph-mon[41966]: Saving service iscsi.iscsi spec with placement smithi117=iscsi.a;count:1 2021-10-08T19:21:28.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:28 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:28.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:28 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1622493358' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2021-10-08T19:21:28.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:28 smithi097 ceph-mon[32687]: from='client.24400 ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2021-10-08T19:21:28.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:28 smithi097 ceph-mon[32687]: osdmap e65: 8 total, 8 up, 8 in 2021-10-08T19:21:28.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:28 smithi097 ceph-mon[32687]: pgmap v183: 100 pgs: 19 creating+peering, 42 active+clean, 39 unknown; 578 KiB data, 48 MiB used, 715 GiB / 715 GiB avail; 4.5 KiB/s rd, 1023 B/s wr, 5 op/s 2021-10-08T19:21:28.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:28 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:21:28.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:28 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:21:28.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:28 smithi097 ceph-mon[32687]: from='client.34415 v1:172.21.15.117:0/3121786117' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "iscsi", "api_user": "user", "api_password": "password", "placement": "1;smithi117=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:21:28.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:28 smithi097 ceph-mon[32687]: Saving service iscsi.iscsi spec with placement smithi117=iscsi.a;count:1 2021-10-08T19:21:28.974 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:28 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:29.089 DEBUG:teuthology.orchestra.run.smithi117:iscsi.iscsi.a> sudo journalctl -f -n 0 -u ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@iscsi.iscsi.a.service 2021-10-08T19:21:29.092 INFO:tasks.cephadm:Adding prometheus.a on smithi117 2021-10-08T19:21:29.092 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph orch apply prometheus '1;smithi117=a' 2021-10-08T19:21:29.118 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:-- Logs begin at Fri 2021-10-08 19:07:21 UTC. -- 2021-10-08T19:21:29.838 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:29 smithi117 ceph-mon[34585]: osdmap e66: 8 total, 8 up, 8 in 2021-10-08T19:21:29.838 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:29 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1356965238' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2021-10-08T19:21:29.839 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:29 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1028334527' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2021-10-08T19:21:29.839 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:29 smithi117 ceph-mon[34585]: from='client.34406 ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2021-10-08T19:21:29.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:29 smithi097 ceph-mon[32687]: osdmap e66: 8 total, 8 up, 8 in 2021-10-08T19:21:29.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:29 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1356965238' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2021-10-08T19:21:29.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:29 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1028334527' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2021-10-08T19:21:29.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:29 smithi097 ceph-mon[32687]: from='client.34406 ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2021-10-08T19:21:29.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:29 smithi097 ceph-mon[41966]: osdmap e66: 8 total, 8 up, 8 in 2021-10-08T19:21:29.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:29 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1356965238' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2021-10-08T19:21:29.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:29 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1028334527' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2021-10-08T19:21:29.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:29 smithi097 ceph-mon[41966]: from='client.34406 ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2021-10-08T19:21:30.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:30 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1356965238' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2021-10-08T19:21:30.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:30 smithi117 ceph-mon[34585]: from='client.34406 ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2021-10-08T19:21:30.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:30 smithi117 ceph-mon[34585]: osdmap e67: 8 total, 8 up, 8 in 2021-10-08T19:21:30.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:30 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1356965238' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-10-08T19:21:30.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:30 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1028334527' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-10-08T19:21:30.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:30 smithi117 ceph-mon[34585]: from='client.34406 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-10-08T19:21:30.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:30 smithi117 ceph-mon[34585]: pgmap v186: 132 pgs: 25 creating+peering, 73 active+clean, 34 unknown; 578 KiB data, 49 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:21:30.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:30 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1356965238' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2021-10-08T19:21:30.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:30 smithi117 ceph-mon[34585]: from='client.34406 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2021-10-08T19:21:30.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:30 smithi117 ceph-mon[34585]: osdmap e68: 8 total, 8 up, 8 in 2021-10-08T19:21:30.908 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:30 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1028334527' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-10-08T19:21:30.908 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:30 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1356965238' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-10-08T19:21:30.908 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:30 smithi117 ceph-mon[34585]: from='client.34406 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-10-08T19:21:30.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:30 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1356965238' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2021-10-08T19:21:30.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:30 smithi097 ceph-mon[32687]: from='client.34406 ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2021-10-08T19:21:30.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:30 smithi097 ceph-mon[32687]: osdmap e67: 8 total, 8 up, 8 in 2021-10-08T19:21:30.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:30 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1356965238' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-10-08T19:21:30.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:30 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1028334527' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-10-08T19:21:30.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:30 smithi097 ceph-mon[32687]: from='client.34406 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-10-08T19:21:30.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:30 smithi097 ceph-mon[32687]: pgmap v186: 132 pgs: 25 creating+peering, 73 active+clean, 34 unknown; 578 KiB data, 49 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:21:30.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:30 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1356965238' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2021-10-08T19:21:30.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:30 smithi097 ceph-mon[32687]: from='client.34406 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2021-10-08T19:21:30.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:30 smithi097 ceph-mon[32687]: osdmap e68: 8 total, 8 up, 8 in 2021-10-08T19:21:30.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:30 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1028334527' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-10-08T19:21:30.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:30 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1356965238' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-10-08T19:21:30.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:30 smithi097 ceph-mon[32687]: from='client.34406 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-10-08T19:21:30.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:30 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1356965238' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2021-10-08T19:21:30.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:30 smithi097 ceph-mon[41966]: from='client.34406 ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2021-10-08T19:21:30.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:30 smithi097 ceph-mon[41966]: osdmap e67: 8 total, 8 up, 8 in 2021-10-08T19:21:30.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:30 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1356965238' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-10-08T19:21:30.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:30 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1028334527' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-10-08T19:21:30.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:30 smithi097 ceph-mon[41966]: from='client.34406 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-10-08T19:21:30.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:30 smithi097 ceph-mon[41966]: pgmap v186: 132 pgs: 25 creating+peering, 73 active+clean, 34 unknown; 578 KiB data, 49 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:21:30.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:30 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1356965238' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2021-10-08T19:21:30.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:30 smithi097 ceph-mon[41966]: from='client.34406 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2021-10-08T19:21:30.975 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:30 smithi097 ceph-mon[41966]: osdmap e68: 8 total, 8 up, 8 in 2021-10-08T19:21:30.975 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:30 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1028334527' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-10-08T19:21:30.975 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:30 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1356965238' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-10-08T19:21:30.975 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:30 smithi097 ceph-mon[41966]: from='client.34406 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-10-08T19:21:31.147 INFO:teuthology.orchestra.run.smithi117.stdout:Scheduled prometheus update... 2021-10-08T19:21:31.891 DEBUG:teuthology.orchestra.run.smithi117:prometheus.a> sudo journalctl -f -n 0 -u ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@prometheus.a.service 2021-10-08T19:21:31.893 INFO:tasks.cephadm:Adding node-exporter.a on smithi097 2021-10-08T19:21:31.894 INFO:tasks.cephadm:Adding node-exporter.b on smithi117 2021-10-08T19:21:31.894 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph orch apply node-exporter '2;smithi097=a;smithi117=b' 2021-10-08T19:21:31.917 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:-- Logs begin at Fri 2021-10-08 19:07:21 UTC. -- 2021-10-08T19:21:32.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:32 smithi117 ceph-mon[34585]: from='client.34421 v1:172.21.15.117:0/2734055937' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi117=a", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:21:32.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:32 smithi117 ceph-mon[34585]: Saving service prometheus spec with placement smithi117=a;count:1 2021-10-08T19:21:32.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:32.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:32 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1356965238' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2021-10-08T19:21:32.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:32 smithi117 ceph-mon[34585]: from='client.34406 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2021-10-08T19:21:32.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:32 smithi117 ceph-mon[34585]: osdmap e69: 8 total, 8 up, 8 in 2021-10-08T19:21:32.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:32.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:32.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:32.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:32 smithi117 ceph-mon[34585]: Checking pool "iscsi" exists for service iscsi.iscsi 2021-10-08T19:21:32.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2021-10-08T19:21:32.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2021-10-08T19:21:32.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:32 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:21:32.469 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:32 smithi097 ceph-mon[41966]: from='client.34421 v1:172.21.15.117:0/2734055937' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi117=a", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:21:32.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:32 smithi097 ceph-mon[41966]: Saving service prometheus spec with placement smithi117=a;count:1 2021-10-08T19:21:32.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:32 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:32.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:32 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1356965238' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2021-10-08T19:21:32.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:32 smithi097 ceph-mon[41966]: from='client.34406 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2021-10-08T19:21:32.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:32 smithi097 ceph-mon[41966]: osdmap e69: 8 total, 8 up, 8 in 2021-10-08T19:21:32.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:32 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:32.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:32 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:32.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:32 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:32.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:32 smithi097 ceph-mon[41966]: Checking pool "iscsi" exists for service iscsi.iscsi 2021-10-08T19:21:32.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:32 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2021-10-08T19:21:32.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:32 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2021-10-08T19:21:32.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:32 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:21:32.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:32 smithi097 ceph-mon[32687]: from='client.34421 v1:172.21.15.117:0/2734055937' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi117=a", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:21:32.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:32 smithi097 ceph-mon[32687]: Saving service prometheus spec with placement smithi117=a;count:1 2021-10-08T19:21:32.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:32 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:32.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:32 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1356965238' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2021-10-08T19:21:32.474 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:32 smithi097 ceph-mon[32687]: from='client.34406 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2021-10-08T19:21:32.474 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:32 smithi097 ceph-mon[32687]: osdmap e69: 8 total, 8 up, 8 in 2021-10-08T19:21:32.474 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:32 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:32.474 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:32 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:32.475 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:32 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:32.475 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:32 smithi097 ceph-mon[32687]: Checking pool "iscsi" exists for service iscsi.iscsi 2021-10-08T19:21:32.475 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:32 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2021-10-08T19:21:32.475 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:32 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2021-10-08T19:21:32.475 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:32 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:21:33.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:33 smithi117 ceph-mon[34585]: Deploying daemon iscsi.iscsi.a on smithi117 2021-10-08T19:21:33.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:33 smithi117 ceph-mon[34585]: poll took 9850.909 ms: 1 events 2021-10-08T19:21:33.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:33 smithi117 ceph-mon[34585]: pgmap v189: 132 pgs: 18 creating+peering, 108 active+clean, 6 unknown; 578 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 1.7 KiB/s wr, 7 op/s 2021-10-08T19:21:33.469 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:33 smithi097 ceph-mon[41966]: Deploying daemon iscsi.iscsi.a on smithi117 2021-10-08T19:21:33.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:33 smithi097 ceph-mon[41966]: poll took 9850.909 ms: 1 events 2021-10-08T19:21:33.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:33 smithi097 ceph-mon[41966]: pgmap v189: 132 pgs: 18 creating+peering, 108 active+clean, 6 unknown; 578 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 1.7 KiB/s wr, 7 op/s 2021-10-08T19:21:33.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:33 smithi097 ceph-mon[32687]: Deploying daemon iscsi.iscsi.a on smithi117 2021-10-08T19:21:33.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:33 smithi097 ceph-mon[32687]: poll took 9850.909 ms: 1 events 2021-10-08T19:21:33.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:33 smithi097 ceph-mon[32687]: pgmap v189: 132 pgs: 18 creating+peering, 108 active+clean, 6 unknown; 578 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 1.7 KiB/s wr, 7 op/s 2021-10-08T19:21:34.155 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:21:34 smithi117 systemd[1]: Starting Ceph iscsi.iscsi.a for 1d01f6d6-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:21:34.608 INFO:teuthology.orchestra.run.smithi117.stdout:Scheduled node-exporter update... 2021-10-08T19:21:34.871 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:34 smithi117 ceph-mon[34585]: mgrmap e16: y(active, since 4m), standbys: x 2021-10-08T19:21:34.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:34 smithi117 ceph-mon[34585]: poll took 1845.054 ms: 1 events 2021-10-08T19:21:34.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:34 smithi117 ceph-mon[34585]: pgmap v190: 132 pgs: 10 creating+peering, 122 active+clean; 579 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 2.4 KiB/s wr, 48 op/s 2021-10-08T19:21:34.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:34 smithi097 ceph-mon[32687]: mgrmap e16: y(active, since 4m), standbys: x 2021-10-08T19:21:34.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:34 smithi097 ceph-mon[32687]: poll took 1845.054 ms: 1 events 2021-10-08T19:21:34.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:34 smithi097 ceph-mon[32687]: pgmap v190: 132 pgs: 10 creating+peering, 122 active+clean; 579 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 2.4 KiB/s wr, 48 op/s 2021-10-08T19:21:34.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:34 smithi097 ceph-mon[41966]: mgrmap e16: y(active, since 4m), standbys: x 2021-10-08T19:21:34.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:34 smithi097 ceph-mon[41966]: poll took 1845.054 ms: 1 events 2021-10-08T19:21:34.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:34 smithi097 ceph-mon[41966]: pgmap v190: 132 pgs: 10 creating+peering, 122 active+clean; 579 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 2.4 KiB/s wr, 48 op/s 2021-10-08T19:21:35.721 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:21:35 smithi117 bash[57934]: log file path now is '/var/log/tcmu-runner.log' 2021-10-08T19:21:35.721 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:35 smithi117 ceph-mon[34585]: from='client.34448 v1:172.21.15.117:0/475551323' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi097=a;smithi117=b", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:21:35.722 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:35 smithi117 ceph-mon[34585]: Saving service node-exporter spec with placement smithi097=a;smithi117=b;count:2 2021-10-08T19:21:35.722 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:35 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:35.722 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:35 smithi117 ceph-mon[34585]: osdmap e70: 8 total, 8 up, 8 in 2021-10-08T19:21:35.723 DEBUG:teuthology.orchestra.run.smithi097:node-exporter.a> sudo journalctl -f -n 0 -u ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@node-exporter.a.service 2021-10-08T19:21:35.727 DEBUG:teuthology.orchestra.run.smithi117:node-exporter.b> sudo journalctl -f -n 0 -u ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@node-exporter.b.service 2021-10-08T19:21:35.730 INFO:tasks.cephadm:Adding alertmanager.a on smithi097 2021-10-08T19:21:35.731 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph orch apply alertmanager '1;smithi097=a' 2021-10-08T19:21:35.758 INFO:journalctl@ceph.node-exporter.b.smithi117.stdout:-- Logs begin at Fri 2021-10-08 19:07:21 UTC. -- 2021-10-08T19:21:35.762 INFO:journalctl@ceph.node-exporter.a.smithi097.stdout:-- Logs begin at Fri 2021-10-08 19:07:18 UTC. -- 2021-10-08T19:21:35.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:35 smithi097 ceph-mon[32687]: from='client.34448 v1:172.21.15.117:0/475551323' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi097=a;smithi117=b", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:21:35.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:35 smithi097 ceph-mon[32687]: Saving service node-exporter spec with placement smithi097=a;smithi117=b;count:2 2021-10-08T19:21:35.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:35 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:35.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:35 smithi097 ceph-mon[32687]: osdmap e70: 8 total, 8 up, 8 in 2021-10-08T19:21:35.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:35 smithi097 ceph-mon[41966]: from='client.34448 v1:172.21.15.117:0/475551323' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi097=a;smithi117=b", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:21:35.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:35 smithi097 ceph-mon[41966]: Saving service node-exporter spec with placement smithi097=a;smithi117=b;count:2 2021-10-08T19:21:35.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:35 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:35.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:35 smithi097 ceph-mon[41966]: osdmap e70: 8 total, 8 up, 8 in 2021-10-08T19:21:36.038 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:21:35 smithi117 bash[57934]: 93aabcf2bb6ebb27ad1fba9bab1300094089d2ca46ad71675e51a6638e87d056 2021-10-08T19:21:36.038 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:21:35 smithi117 systemd[1]: Started Ceph iscsi.iscsi.a for 1d01f6d6-286c-11ec-8c25-001a4aab830c. 2021-10-08T19:21:36.333 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:21:36 smithi117 conmon[58440]: debug Started the configuration object watcher 2021-10-08T19:21:36.333 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:21:36 smithi117 conmon[58440]: debug Checking for config object changes every 1s 2021-10-08T19:21:36.334 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:21:36 smithi117 conmon[58440]: debug Processing osd blocklist entries for this node 2021-10-08T19:21:36.655 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:21:36 smithi117 conmon[58440]: debug Reading the configuration object to update local LIO configuration 2021-10-08T19:21:36.655 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:21:36 smithi117 conmon[58440]: debug Configuration does not have an entry for this host(smithi117) - nothing to define to LIO 2021-10-08T19:21:36.655 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:21:36 smithi117 conmon[58440]: debug * Running on http://[::]:5000/ (Press CTRL+C to quit) 2021-10-08T19:21:37.107 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:21:36 smithi117 conmon[36778]: ignoring --setuser ceph since I am not root 2021-10-08T19:21:37.107 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:21:36 smithi117 conmon[36778]: ignoring --setgroup ceph since I am not root 2021-10-08T19:21:37.108 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:36 smithi117 ceph-mon[34585]: poll took 1958.953 ms: 1 events 2021-10-08T19:21:37.108 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:36 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:37.108 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:36 smithi117 ceph-mon[34585]: Sending message to agent on host smithi117 2021-10-08T19:21:37.108 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:36 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2021-10-08T19:21:37.108 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:36 smithi117 ceph-mon[34585]: Received "ACK" from agent on host smithi117 2021-10-08T19:21:37.109 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:36 smithi117 ceph-mon[34585]: pgmap v192: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 63 KiB/s rd, 5.5 KiB/s wr, 156 op/s 2021-10-08T19:21:37.109 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:36 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.117:0/3982986631' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2021-10-08T19:21:37.220 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:21:36 smithi097 conmon[33110]: ignoring --setuser ceph since I am not root 2021-10-08T19:21:37.220 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:21:36 smithi097 conmon[33110]: ignoring --setgroup ceph since I am not root 2021-10-08T19:21:37.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:36 smithi097 ceph-mon[41966]: poll took 1958.953 ms: 1 events 2021-10-08T19:21:37.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:36 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:37.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:36 smithi097 ceph-mon[41966]: Sending message to agent on host smithi117 2021-10-08T19:21:37.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:36 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2021-10-08T19:21:37.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:36 smithi097 ceph-mon[41966]: Received "ACK" from agent on host smithi117 2021-10-08T19:21:37.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:36 smithi097 ceph-mon[41966]: pgmap v192: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 63 KiB/s rd, 5.5 KiB/s wr, 156 op/s 2021-10-08T19:21:37.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:36 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.117:0/3982986631' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2021-10-08T19:21:37.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:36 smithi097 ceph-mon[32687]: poll took 1958.953 ms: 1 events 2021-10-08T19:21:37.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:36 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' 2021-10-08T19:21:37.225 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:36 smithi097 ceph-mon[32687]: Sending message to agent on host smithi117 2021-10-08T19:21:37.225 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:36 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2021-10-08T19:21:37.225 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:36 smithi097 ceph-mon[32687]: Received "ACK" from agent on host smithi117 2021-10-08T19:21:37.226 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:36 smithi097 ceph-mon[32687]: pgmap v192: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 63 KiB/s rd, 5.5 KiB/s wr, 156 op/s 2021-10-08T19:21:37.226 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:36 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.117:0/3982986631' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2021-10-08T19:21:38.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:37 smithi117 ceph-mon[34585]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2021-10-08T19:21:38.160 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:37 smithi117 ceph-mon[34585]: mgrmap e17: y(active, since 4m), standbys: x 2021-10-08T19:21:38.219 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:37 smithi097 ceph-mon[32687]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2021-10-08T19:21:38.219 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:37 smithi097 ceph-mon[32687]: mgrmap e17: y(active, since 4m), standbys: x 2021-10-08T19:21:38.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:37 smithi097 ceph-mon[41966]: from='mgr.14150 v1:172.21.15.97:0/4057394019' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2021-10-08T19:21:38.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:37 smithi097 ceph-mon[41966]: mgrmap e17: y(active, since 4m), standbys: x 2021-10-08T19:21:40.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:40 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:21:40.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:40 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:21:40.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:40 smithi117 ceph-mon[34585]: osdmap e71: 8 total, 8 up, 8 in 2021-10-08T19:21:40.719 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:40 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:21:40.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:40 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:21:40.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:40 smithi097 ceph-mon[41966]: osdmap e71: 8 total, 8 up, 8 in 2021-10-08T19:21:40.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:40 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:21:40.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:40 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:21:40.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:40 smithi097 ceph-mon[32687]: osdmap e71: 8 total, 8 up, 8 in 2021-10-08T19:21:41.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:41 smithi117 ceph-mon[34585]: osdmap e72: 8 total, 8 up, 8 in 2021-10-08T19:21:41.719 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:41 smithi097 ceph-mon[41966]: osdmap e72: 8 total, 8 up, 8 in 2021-10-08T19:21:41.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:41 smithi097 ceph-mon[32687]: osdmap e72: 8 total, 8 up, 8 in 2021-10-08T19:21:42.655 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:21:42 smithi117 conmon[36778]: [08/Oct/2021:19:21:42] ENGINE Bus STARTING 2021-10-08T19:21:42.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:42 smithi117 ceph-mon[34585]: Active manager daemon y restarted 2021-10-08T19:21:42.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:42 smithi117 ceph-mon[34585]: Activating manager daemon y 2021-10-08T19:21:42.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:42 smithi117 ceph-mon[34585]: osdmap e73: 8 total, 8 up, 8 in 2021-10-08T19:21:42.719 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:21:42 smithi097 conmon[33110]: [08/Oct/2021:19:21:42] ENGINE Bus STARTING 2021-10-08T19:21:42.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:42 smithi097 ceph-mon[32687]: Active manager daemon y restarted 2021-10-08T19:21:42.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:42 smithi097 ceph-mon[32687]: Activating manager daemon y 2021-10-08T19:21:42.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:42 smithi097 ceph-mon[32687]: osdmap e73: 8 total, 8 up, 8 in 2021-10-08T19:21:42.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:42 smithi097 ceph-mon[41966]: Active manager daemon y restarted 2021-10-08T19:21:42.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:42 smithi097 ceph-mon[41966]: Activating manager daemon y 2021-10-08T19:21:42.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:42 smithi097 ceph-mon[41966]: osdmap e73: 8 total, 8 up, 8 in 2021-10-08T19:21:42.993 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:21:42 smithi117 conmon[36778]: CherryPy Checker: 2021-10-08T19:21:42.993 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:21:42 smithi117 conmon[36778]: The Application mounted at '' has an empty config. 2021-10-08T19:21:42.993 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:21:42 smithi117 conmon[36778]: 2021-10-08T19:21:42.994 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:21:42 smithi117 conmon[36778]: [08/Oct/2021:19:21:42] ENGINE Serving on http://:::9283 2021-10-08T19:21:42.994 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:21:42 smithi117 conmon[36778]: [08/Oct/2021:19:21:42] ENGINE Bus STARTED 2021-10-08T19:21:43.105 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:21:42 smithi097 conmon[33110]: CherryPy Checker: 2021-10-08T19:21:43.105 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:21:42 smithi097 conmon[33110]: The Application mounted at '' has an empty config. 2021-10-08T19:21:43.106 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:21:42 smithi097 conmon[33110]: 2021-10-08T19:21:43.106 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:21:42 smithi097 conmon[33110]: [08/Oct/2021:19:21:42] ENGINE Serving on http://:::9283 2021-10-08T19:21:43.106 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:21:42 smithi097 conmon[33110]: [08/Oct/2021:19:21:42] ENGINE Bus STARTED 2021-10-08T19:21:43.423 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[32687]: mgrmap e18: y(active, starting, since 0.0859051s), standbys: x 2021-10-08T19:21:43.423 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:21:43.423 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:21:43.424 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:21:43.424 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-10-08T19:21:43.424 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-10-08T19:21:43.424 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:21:43.424 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:21:43.425 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-10-08T19:21:43.425 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:21:43.425 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:21:43.425 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:21:43.426 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:21:43.426 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:21:43.426 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-10-08T19:21:43.426 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-10-08T19:21:43.426 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-10-08T19:21:43.427 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[32687]: Manager daemon y is now available 2021-10-08T19:21:43.427 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:21:43.433 INFO:teuthology.orchestra.run.smithi117.stdout:Scheduled alertmanager update... 2021-10-08T19:21:43.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:43 smithi117 ceph-mon[34585]: mgrmap e18: y(active, starting, since 0.0859051s), standbys: x 2021-10-08T19:21:43.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:21:43.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:21:43.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:21:43.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-10-08T19:21:43.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-10-08T19:21:43.659 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:21:43.659 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:21:43.659 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-10-08T19:21:43.659 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:21:43.660 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:21:43.660 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:21:43.660 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:21:43.660 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:21:43.660 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-10-08T19:21:43.661 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-10-08T19:21:43.661 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-10-08T19:21:43.661 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:43 smithi117 ceph-mon[34585]: Manager daemon y is now available 2021-10-08T19:21:43.662 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:21:43.662 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:21:43.662 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:21:43.662 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:21:43.663 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:21:43.663 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi097", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:21:43.663 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi117", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:21:43.664 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi097", "name": "osd_memory_target"}]': finished 2021-10-08T19:21:43.664 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:43 smithi117 ceph-mon[34585]: Updating smithi097:/etc/ceph/ceph.conf 2021-10-08T19:21:43.664 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi117", "name": "osd_memory_target"}]': finished 2021-10-08T19:21:43.665 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:43 smithi117 ceph-mon[34585]: Updating smithi117:/etc/ceph/ceph.conf 2021-10-08T19:21:43.665 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:21:43.665 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:21:43.665 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:43 smithi117 ceph-mon[34585]: Standby manager daemon x restarted 2021-10-08T19:21:43.666 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:43 smithi117 ceph-mon[34585]: Standby manager daemon x started 2021-10-08T19:21:43.666 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:43 smithi117 ceph-mon[34585]: from='mgr.? v1:172.21.15.117:0/4240140855' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2021-10-08T19:21:43.666 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:43 smithi117 ceph-mon[34585]: from='mgr.? v1:172.21.15.117:0/4240140855' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-10-08T19:21:43.666 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:43 smithi117 ceph-mon[34585]: from='mgr.? v1:172.21.15.117:0/4240140855' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2021-10-08T19:21:43.666 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:43 smithi117 ceph-mon[34585]: from='mgr.? v1:172.21.15.117:0/4240140855' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-10-08T19:21:43.667 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:43 smithi117 ceph-mon[34585]: Executing took 0.301 seconds 2021-10-08T19:21:43.667 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:21:43.667 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:21:43.667 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:21:43.668 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi097", "caps": []}]: dispatch 2021-10-08T19:21:43.719 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:21:43 smithi097 conmon[33110]: [08/Oct/2021:19:21:43] ENGINE Bus STARTING 2021-10-08T19:21:43.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:21:43.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:21:43.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:21:43.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:21:43.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi097", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:21:43.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi117", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:21:43.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi097", "name": "osd_memory_target"}]': finished 2021-10-08T19:21:43.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[32687]: Updating smithi097:/etc/ceph/ceph.conf 2021-10-08T19:21:43.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi117", "name": "osd_memory_target"}]': finished 2021-10-08T19:21:43.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[32687]: Updating smithi117:/etc/ceph/ceph.conf 2021-10-08T19:21:43.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:21:43.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:21:43.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[32687]: Standby manager daemon x restarted 2021-10-08T19:21:43.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[32687]: Standby manager daemon x started 2021-10-08T19:21:43.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[32687]: from='mgr.? v1:172.21.15.117:0/4240140855' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2021-10-08T19:21:43.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[32687]: from='mgr.? v1:172.21.15.117:0/4240140855' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-10-08T19:21:43.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[32687]: from='mgr.? v1:172.21.15.117:0/4240140855' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2021-10-08T19:21:43.724 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[32687]: from='mgr.? v1:172.21.15.117:0/4240140855' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-10-08T19:21:43.724 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[32687]: Executing took 0.301 seconds 2021-10-08T19:21:43.724 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:21:43.724 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:21:43.724 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:21:43.725 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi097", "caps": []}]: dispatch 2021-10-08T19:21:43.725 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[41966]: mgrmap e18: y(active, starting, since 0.0859051s), standbys: x 2021-10-08T19:21:43.725 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:21:43.726 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:21:43.726 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:21:43.726 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-10-08T19:21:43.726 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-10-08T19:21:43.726 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:21:43.727 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:21:43.727 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-10-08T19:21:43.727 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:21:43.727 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:21:43.728 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:21:43.728 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:21:43.728 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:21:43.728 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-10-08T19:21:43.728 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-10-08T19:21:43.729 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-10-08T19:21:43.729 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[41966]: Manager daemon y is now available 2021-10-08T19:21:43.729 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:21:43.729 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:21:43.729 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:21:43.730 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:21:43.730 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:21:43.730 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi097", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:21:43.730 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi117", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:21:43.731 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi097", "name": "osd_memory_target"}]': finished 2021-10-08T19:21:43.731 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[41966]: Updating smithi097:/etc/ceph/ceph.conf 2021-10-08T19:21:43.731 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi117", "name": "osd_memory_target"}]': finished 2021-10-08T19:21:43.731 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[41966]: Updating smithi117:/etc/ceph/ceph.conf 2021-10-08T19:21:43.731 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:21:43.732 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:21:43.732 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[41966]: Standby manager daemon x restarted 2021-10-08T19:21:43.732 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[41966]: Standby manager daemon x started 2021-10-08T19:21:43.732 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[41966]: from='mgr.? v1:172.21.15.117:0/4240140855' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2021-10-08T19:21:43.733 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[41966]: from='mgr.? v1:172.21.15.117:0/4240140855' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-10-08T19:21:43.733 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[41966]: from='mgr.? v1:172.21.15.117:0/4240140855' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2021-10-08T19:21:43.733 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[41966]: from='mgr.? v1:172.21.15.117:0/4240140855' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-10-08T19:21:43.733 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[41966]: Executing took 0.301 seconds 2021-10-08T19:21:43.733 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:21:43.734 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:21:43.734 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:21:43.734 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi097", "caps": []}]: dispatch 2021-10-08T19:21:44.031 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:21:43 smithi097 conmon[33110]: [08/Oct/2021:19:21:43] ENGINE Serving on https://172.21.15.97:8499 2021-10-08T19:21:44.032 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:21:43 smithi097 conmon[33110]: [08/Oct/2021:19:21:43] ENGINE Bus STARTED 2021-10-08T19:21:44.194 DEBUG:teuthology.orchestra.run.smithi097:alertmanager.a> sudo journalctl -f -n 0 -u ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@alertmanager.a.service 2021-10-08T19:21:44.197 INFO:tasks.cephadm:Adding grafana.a on smithi117 2021-10-08T19:21:44.198 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph orch apply grafana '1;smithi117=a' 2021-10-08T19:21:44.222 INFO:journalctl@ceph.alertmanager.a.smithi097.stdout:-- Logs begin at Fri 2021-10-08 19:07:18 UTC. -- 2021-10-08T19:21:44.646 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:44 smithi117 ceph-mon[34585]: Updating smithi097:/etc/ceph/ceph.client.admin.keyring 2021-10-08T19:21:44.647 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:44 smithi117 ceph-mon[34585]: Updating smithi117:/etc/ceph/ceph.client.admin.keyring 2021-10-08T19:21:44.647 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:44 smithi117 ceph-mon[34585]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:21:44.647 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:44 smithi117 ceph-mon[34585]: Reconfiguring agent.smithi097 (dependencies changed)... 2021-10-08T19:21:44.647 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:44 smithi117 ceph-mon[34585]: mgrmap e19: y(active, since 1.09125s), standbys: x 2021-10-08T19:21:44.647 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:44 smithi117 ceph-mon[34585]: from='client.34490 v1:172.21.15.117:0/401019685' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi097=a", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:21:44.648 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:44 smithi117 ceph-mon[34585]: Saving service alertmanager spec with placement smithi097=a;count:1 2021-10-08T19:21:44.649 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:44 smithi117 ceph-mon[34585]: pgmap v3: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:21:44.649 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:44 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:21:44.649 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:44 smithi117 ceph-mon[34585]: Starting cherrypy engine... 2021-10-08T19:21:44.649 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:44 smithi117 ceph-mon[34585]: [08/Oct/2021:19:21:43] ENGINE Bus STARTING 2021-10-08T19:21:44.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:44 smithi117 ceph-mon[34585]: [08/Oct/2021:19:21:43] ENGINE Serving on https://172.21.15.97:8499 2021-10-08T19:21:44.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:44 smithi117 ceph-mon[34585]: [08/Oct/2021:19:21:43] ENGINE Bus STARTED 2021-10-08T19:21:44.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:44 smithi117 ceph-mon[34585]: Cherrypy engine started. 2021-10-08T19:21:44.680 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:44 smithi097 ceph-mon[41966]: Updating smithi097:/etc/ceph/ceph.client.admin.keyring 2021-10-08T19:21:44.683 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:44 smithi097 ceph-mon[41966]: Updating smithi117:/etc/ceph/ceph.client.admin.keyring 2021-10-08T19:21:44.683 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:44 smithi097 ceph-mon[41966]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:21:44.684 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:44 smithi097 ceph-mon[41966]: Reconfiguring agent.smithi097 (dependencies changed)... 2021-10-08T19:21:44.684 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:44 smithi097 ceph-mon[41966]: mgrmap e19: y(active, since 1.09125s), standbys: x 2021-10-08T19:21:44.684 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:44 smithi097 ceph-mon[41966]: from='client.34490 v1:172.21.15.117:0/401019685' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi097=a", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:21:44.685 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:44 smithi097 ceph-mon[41966]: Saving service alertmanager spec with placement smithi097=a;count:1 2021-10-08T19:21:44.685 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:44 smithi097 ceph-mon[41966]: pgmap v3: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:21:44.686 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:44 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:21:44.686 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:44 smithi097 ceph-mon[41966]: Starting cherrypy engine... 2021-10-08T19:21:44.687 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:44 smithi097 ceph-mon[41966]: [08/Oct/2021:19:21:43] ENGINE Bus STARTING 2021-10-08T19:21:44.687 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:44 smithi097 ceph-mon[41966]: [08/Oct/2021:19:21:43] ENGINE Serving on https://172.21.15.97:8499 2021-10-08T19:21:44.688 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:44 smithi097 ceph-mon[41966]: [08/Oct/2021:19:21:43] ENGINE Bus STARTED 2021-10-08T19:21:44.688 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:44 smithi097 ceph-mon[41966]: Cherrypy engine started. 2021-10-08T19:21:44.689 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:44 smithi097 ceph-mon[32687]: Updating smithi097:/etc/ceph/ceph.client.admin.keyring 2021-10-08T19:21:44.689 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:44 smithi097 ceph-mon[32687]: Updating smithi117:/etc/ceph/ceph.client.admin.keyring 2021-10-08T19:21:44.690 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:44 smithi097 ceph-mon[32687]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:21:44.690 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:44 smithi097 ceph-mon[32687]: Reconfiguring agent.smithi097 (dependencies changed)... 2021-10-08T19:21:44.691 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:44 smithi097 ceph-mon[32687]: mgrmap e19: y(active, since 1.09125s), standbys: x 2021-10-08T19:21:44.691 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:44 smithi097 ceph-mon[32687]: from='client.34490 v1:172.21.15.117:0/401019685' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi097=a", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:21:44.691 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:44 smithi097 ceph-mon[32687]: Saving service alertmanager spec with placement smithi097=a;count:1 2021-10-08T19:21:44.692 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:44 smithi097 ceph-mon[32687]: pgmap v3: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:21:44.693 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:44 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:21:44.693 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:44 smithi097 ceph-mon[32687]: Starting cherrypy engine... 2021-10-08T19:21:44.693 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:44 smithi097 ceph-mon[32687]: [08/Oct/2021:19:21:43] ENGINE Bus STARTING 2021-10-08T19:21:44.694 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:44 smithi097 ceph-mon[32687]: [08/Oct/2021:19:21:43] ENGINE Serving on https://172.21.15.97:8499 2021-10-08T19:21:44.694 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:44 smithi097 ceph-mon[32687]: [08/Oct/2021:19:21:43] ENGINE Bus STARTED 2021-10-08T19:21:44.695 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:44 smithi097 ceph-mon[32687]: Cherrypy engine started. 2021-10-08T19:21:45.694 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:45 smithi117 ceph-mon[34585]: Reconfiguring daemon agent.smithi097 on smithi097 2021-10-08T19:21:45.694 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:45 smithi117 ceph-mon[34585]: Executing () created at /lib/python3.6/site-packages/asyncssh/channel.py:596> took 0.172 seconds 2021-10-08T19:21:45.695 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:45 smithi117 ceph-mon[34585]: pgmap v4: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:21:45.695 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:45 smithi117 ceph-mon[34585]: mgrmap e20: y(active, since 2s), standbys: x 2021-10-08T19:21:45.696 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:45 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:21:45.697 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:45 smithi117 ceph-mon[34585]: Reconfiguring agent.smithi117 (dependencies changed)... 2021-10-08T19:21:45.697 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:45 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi117", "caps": []}]: dispatch 2021-10-08T19:21:45.698 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:45 smithi117 ceph-mon[34585]: Reconfiguring daemon agent.smithi117 on smithi117 2021-10-08T19:21:45.699 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:45 smithi117 ceph-mon[34585]: osdmap e74: 8 total, 8 up, 8 in 2021-10-08T19:21:45.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:45 smithi097 ceph-mon[32687]: Reconfiguring daemon agent.smithi097 on smithi097 2021-10-08T19:21:45.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:45 smithi097 ceph-mon[32687]: Executing () created at /lib/python3.6/site-packages/asyncssh/channel.py:596> took 0.172 seconds 2021-10-08T19:21:45.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:45 smithi097 ceph-mon[32687]: pgmap v4: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:21:45.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:45 smithi097 ceph-mon[32687]: mgrmap e20: y(active, since 2s), standbys: x 2021-10-08T19:21:45.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:45 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:21:45.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:45 smithi097 ceph-mon[32687]: Reconfiguring agent.smithi117 (dependencies changed)... 2021-10-08T19:21:45.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:45 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi117", "caps": []}]: dispatch 2021-10-08T19:21:45.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:45 smithi097 ceph-mon[32687]: Reconfiguring daemon agent.smithi117 on smithi117 2021-10-08T19:21:45.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:45 smithi097 ceph-mon[32687]: osdmap e74: 8 total, 8 up, 8 in 2021-10-08T19:21:45.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:45 smithi097 ceph-mon[41966]: Reconfiguring daemon agent.smithi097 on smithi097 2021-10-08T19:21:45.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:45 smithi097 ceph-mon[41966]: Executing () created at /lib/python3.6/site-packages/asyncssh/channel.py:596> took 0.172 seconds 2021-10-08T19:21:45.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:45 smithi097 ceph-mon[41966]: pgmap v4: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:21:45.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:45 smithi097 ceph-mon[41966]: mgrmap e20: y(active, since 2s), standbys: x 2021-10-08T19:21:45.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:45 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:21:45.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:45 smithi097 ceph-mon[41966]: Reconfiguring agent.smithi117 (dependencies changed)... 2021-10-08T19:21:45.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:45 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi117", "caps": []}]: dispatch 2021-10-08T19:21:45.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:45 smithi097 ceph-mon[41966]: Reconfiguring daemon agent.smithi117 on smithi117 2021-10-08T19:21:45.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:45 smithi097 ceph-mon[41966]: osdmap e74: 8 total, 8 up, 8 in 2021-10-08T19:21:46.320 INFO:teuthology.orchestra.run.smithi117.stdout:Scheduled grafana update... 2021-10-08T19:21:46.343 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:21:46 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:21:46.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:46 smithi097 ceph-mon[32687]: Executing () created at /lib/python3.6/site-packages/asyncssh/channel.py:596> took 0.181 seconds 2021-10-08T19:21:46.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:46 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:21:46.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:46 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:21:46.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:46 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:21:46.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:46 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:21:46.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:46 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:21:46.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:46 smithi097 ceph-mon[32687]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:21:46.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:46 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:21:46.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:46 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:21:46.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:46 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:21:46.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:46 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:21:46.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:46 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:21:46.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:46 smithi097 ceph-mon[41966]: Executing () created at /lib/python3.6/site-packages/asyncssh/channel.py:596> took 0.181 seconds 2021-10-08T19:21:46.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:46 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:21:46.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:46 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:21:46.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:46 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:21:46.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:46 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:21:46.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:46 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:21:46.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:46 smithi097 ceph-mon[41966]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:21:46.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:46 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:21:46.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:46 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:21:46.975 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:46 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:21:46.975 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:46 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:21:46.975 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:46 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:21:46.996 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:46 smithi117 ceph-mon[34585]: Executing () created at /lib/python3.6/site-packages/asyncssh/channel.py:596> took 0.181 seconds 2021-10-08T19:21:46.997 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:46 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:21:46.997 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:46 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:21:46.997 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:46 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:21:46.997 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:46 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:21:46.998 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:46 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:21:46.998 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:46 smithi117 ceph-mon[34585]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:21:46.998 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:46 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:21:46.998 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:46 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:21:46.999 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:46 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:21:46.999 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:46 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:21:46.999 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:46 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:21:47.585 DEBUG:teuthology.orchestra.run.smithi117:grafana.a> sudo journalctl -f -n 0 -u ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@grafana.a.service 2021-10-08T19:21:47.588 INFO:tasks.cephadm:Setting up client nodes... 2021-10-08T19:21:47.588 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2021-10-08T19:21:47.617 INFO:journalctl@ceph.grafana.a.smithi117.stdout:-- Logs begin at Fri 2021-10-08 19:07:21 UTC. -- 2021-10-08T19:21:47.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:47 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:21:47.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:47 smithi117 ceph-mon[34585]: from='client.34517 v1:172.21.15.117:0/1278900730' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi117=a", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:21:47.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:47 smithi117 ceph-mon[34585]: Saving service grafana spec with placement smithi117=a;count:1 2021-10-08T19:21:47.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:47 smithi117 ceph-mon[34585]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:21:47.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:47 smithi117 ceph-mon[34585]: pgmap v6: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:21:47.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:47 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:21:47.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:47 smithi097 ceph-mon[32687]: from='client.34517 v1:172.21.15.117:0/1278900730' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi117=a", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:21:47.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:47 smithi097 ceph-mon[32687]: Saving service grafana spec with placement smithi117=a;count:1 2021-10-08T19:21:47.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:47 smithi097 ceph-mon[32687]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:21:47.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:47 smithi097 ceph-mon[32687]: pgmap v6: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:21:47.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:47 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:21:47.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:47 smithi097 ceph-mon[41966]: from='client.34517 v1:172.21.15.117:0/1278900730' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi117=a", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:21:47.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:47 smithi097 ceph-mon[41966]: Saving service grafana spec with placement smithi117=a;count:1 2021-10-08T19:21:47.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:47 smithi097 ceph-mon[41966]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:21:47.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:47 smithi097 ceph-mon[41966]: pgmap v6: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:21:49.847 INFO:teuthology.orchestra.run.smithi097.stdout:[client.0] 2021-10-08T19:21:49.847 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBNmmBhYwAuMhAAexqhG6faGyjt7RlwLc3ZWQ== 2021-10-08T19:21:49.969 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:49 smithi097 ceph-mon[41966]: pgmap v7: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:21:49.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:49 smithi097 ceph-mon[32687]: pgmap v7: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:21:50.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:49 smithi117 ceph-mon[34585]: pgmap v7: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:21:50.525 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2021-10-08T19:21:50.526 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2021-10-08T19:21:50.526 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2021-10-08T19:21:50.565 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2021-10-08T19:21:50.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:50 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/917391015' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-10-08T19:21:50.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:50 smithi117 ceph-mon[34585]: from='client.24532 ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-10-08T19:21:50.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:50 smithi117 ceph-mon[34585]: from='client.24532 ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-10-08T19:21:50.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:50 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:21:50.969 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:21:50 smithi097 conmon[33110]: 172.21.15.97 - - [08/Oct/2021:19:21:50] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:21:50.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:50 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/917391015' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-10-08T19:21:50.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:50 smithi097 ceph-mon[41966]: from='client.24532 ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-10-08T19:21:50.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:50 smithi097 ceph-mon[41966]: from='client.24532 ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-10-08T19:21:50.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:50 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:21:50.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:50 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/917391015' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-10-08T19:21:50.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:50 smithi097 ceph-mon[32687]: from='client.24532 ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-10-08T19:21:50.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:50 smithi097 ceph-mon[32687]: from='client.24532 ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-10-08T19:21:50.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:50 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:21:51.470 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:21:51 smithi097 conmon[33110]: 172.21.15.117 - - [08/Oct/2021:19:21:51] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:21:51.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:51 smithi117 ceph-mon[34585]: pgmap v8: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 732 B/s rd, 0 op/s 2021-10-08T19:21:51.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:51 smithi117 ceph-mon[34585]: Sending message to agent on host smithi097 2021-10-08T19:21:51.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:51 smithi117 ceph-mon[34585]: Received old metadata from agent on host smithi097. Requested up-to-date metadata. 2021-10-08T19:21:51.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:51 smithi117 ceph-mon[34585]: 172.21.15.97 - - [08/Oct/2021:19:21:50] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:21:51.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:51 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:21:51.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:51 smithi097 ceph-mon[32687]: pgmap v8: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 732 B/s rd, 0 op/s 2021-10-08T19:21:51.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:51 smithi097 ceph-mon[32687]: Sending message to agent on host smithi097 2021-10-08T19:21:51.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:51 smithi097 ceph-mon[32687]: Received old metadata from agent on host smithi097. Requested up-to-date metadata. 2021-10-08T19:21:51.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:51 smithi097 ceph-mon[32687]: 172.21.15.97 - - [08/Oct/2021:19:21:50] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:21:51.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:51 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:21:51.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:51 smithi097 ceph-mon[41966]: pgmap v8: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 732 B/s rd, 0 op/s 2021-10-08T19:21:51.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:51 smithi097 ceph-mon[41966]: Sending message to agent on host smithi097 2021-10-08T19:21:51.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:51 smithi097 ceph-mon[41966]: Received old metadata from agent on host smithi097. Requested up-to-date metadata. 2021-10-08T19:21:51.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:51 smithi097 ceph-mon[41966]: 172.21.15.97 - - [08/Oct/2021:19:21:50] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:21:51.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:51 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:21:52.733 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:52 smithi117 ceph-mon[34585]: Received "ACK" from agent on host smithi097 2021-10-08T19:21:52.733 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:52 smithi117 ceph-mon[34585]: Sending message to agent on host smithi117 2021-10-08T19:21:52.734 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:52 smithi117 ceph-mon[34585]: Received old metadata from agent on host smithi117. Requested up-to-date metadata. 2021-10-08T19:21:52.734 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:52 smithi117 ceph-mon[34585]: 172.21.15.117 - - [08/Oct/2021:19:21:51] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:21:52.734 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:52 smithi117 ceph-mon[34585]: Received "ACK" from agent on host smithi117 2021-10-08T19:21:52.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:52 smithi097 ceph-mon[32687]: Received "ACK" from agent on host smithi097 2021-10-08T19:21:52.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:52 smithi097 ceph-mon[32687]: Sending message to agent on host smithi117 2021-10-08T19:21:52.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:52 smithi097 ceph-mon[32687]: Received old metadata from agent on host smithi117. Requested up-to-date metadata. 2021-10-08T19:21:52.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:52 smithi097 ceph-mon[32687]: 172.21.15.117 - - [08/Oct/2021:19:21:51] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:21:52.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:52 smithi097 ceph-mon[32687]: Received "ACK" from agent on host smithi117 2021-10-08T19:21:52.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:52 smithi097 ceph-mon[41966]: Received "ACK" from agent on host smithi097 2021-10-08T19:21:52.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:52 smithi097 ceph-mon[41966]: Sending message to agent on host smithi117 2021-10-08T19:21:52.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:52 smithi097 ceph-mon[41966]: Received old metadata from agent on host smithi117. Requested up-to-date metadata. 2021-10-08T19:21:52.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:52 smithi097 ceph-mon[41966]: 172.21.15.117 - - [08/Oct/2021:19:21:51] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:21:52.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:52 smithi097 ceph-mon[41966]: Received "ACK" from agent on host smithi117 2021-10-08T19:21:53.128 INFO:teuthology.orchestra.run.smithi117.stdout:[client.1] 2021-10-08T19:21:53.129 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBRmmBhYoQkBxAAf9AEyK9W3ity16g7WGuqMw== 2021-10-08T19:21:53.969 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:53 smithi097 ceph-mon[41966]: pgmap v9: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 569 B/s rd, 0 op/s 2021-10-08T19:21:53.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:53 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.117:0/1672148512' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-10-08T19:21:53.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:53 smithi097 ceph-mon[41966]: from='client.24538 ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-10-08T19:21:53.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:53 smithi097 ceph-mon[41966]: from='client.24538 ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-10-08T19:21:53.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:53 smithi097 ceph-mon[32687]: pgmap v9: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 569 B/s rd, 0 op/s 2021-10-08T19:21:53.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:53 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.117:0/1672148512' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-10-08T19:21:53.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:53 smithi097 ceph-mon[32687]: from='client.24538 ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-10-08T19:21:53.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:53 smithi097 ceph-mon[32687]: from='client.24538 ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-10-08T19:21:54.114 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:53 smithi117 ceph-mon[34585]: pgmap v9: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 569 B/s rd, 0 op/s 2021-10-08T19:21:54.114 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:53 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.117:0/1672148512' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-10-08T19:21:54.115 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:53 smithi117 ceph-mon[34585]: from='client.24538 ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-10-08T19:21:54.115 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:53 smithi117 ceph-mon[34585]: from='client.24538 ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-10-08T19:21:54.116 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2021-10-08T19:21:54.116 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2021-10-08T19:21:54.117 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2021-10-08T19:21:54.155 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd dump --format=json 2021-10-08T19:21:54.447 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:21:54.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:54 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:21:54.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:54 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:21:54.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:54 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:21:54.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:54 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:21:55.091 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:54 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:21:55.091 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:54 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:21:56.061 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:55 smithi117 ceph-mon[34585]: pgmap v10: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:21:56.062 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:55 smithi117 ceph-mon[34585]: osdmap e75: 8 total, 8 up, 8 in 2021-10-08T19:21:56.062 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:55 smithi117 ceph-mon[34585]: osdmap e76: 8 total, 8 up, 8 in 2021-10-08T19:21:56.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:55 smithi097 ceph-mon[32687]: pgmap v10: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:21:56.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:55 smithi097 ceph-mon[32687]: osdmap e75: 8 total, 8 up, 8 in 2021-10-08T19:21:56.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:55 smithi097 ceph-mon[32687]: osdmap e76: 8 total, 8 up, 8 in 2021-10-08T19:21:56.223 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:21:55 smithi097 conmon[33110]: 172.21.15.97 - - [08/Oct/2021:19:21:55] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:21:56.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:55 smithi097 ceph-mon[41966]: pgmap v10: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:21:56.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:55 smithi097 ceph-mon[41966]: osdmap e75: 8 total, 8 up, 8 in 2021-10-08T19:21:56.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:55 smithi097 ceph-mon[41966]: osdmap e76: 8 total, 8 up, 8 in 2021-10-08T19:21:56.225 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:21:56.225 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":76,"fsid":"1d01f6d6-286c-11ec-8c25-001a4aab830c","created":"2021-10-08T19:16:25.258003+0000","modified":"2021-10-08T19:21:55.398555+0000","last_up_change":"2021-10-08T19:21:15.388758+0000","last_in_change":"2021-10-08T19:20:59.507952+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2021-10-08T19:19:44.413311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":".rgw.root","create_time":"2021-10-08T19:21:21.940881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":3,"pool_name":"iscsi","create_time":"2021-10-08T19:21:22.536945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"default.rgw.log","create_time":"2021-10-08T19:21:23.886328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":5,"pool_name":"default.rgw.control","create_time":"2021-10-08T19:21:25.865032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2021-10-08T19:21:27.940767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":8},"application_metadata":{"rgw":{}}}],"osds":[{"osd":0,"uuid":"9e64e714-a5d5-4fbb-ae2b-1df4bf14b8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6801","nonce":3354161282}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6802","nonce":3354161282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6804","nonce":3354161282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6803","nonce":3354161282}]},"public_addr":"172.21.15.97:6801/3354161282","cluster_addr":"172.21.15.97:6802/3354161282","heartbeat_back_addr":"172.21.15.97:6804/3354161282","heartbeat_front_addr":"172.21.15.97:6803/3354161282","state":["exists","up"]},{"osd":1,"uuid":"32602a22-f263-4b62-a8d8-50fddfb73fa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6805","nonce":735799205}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6806","nonce":735799205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6808","nonce":735799205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6807","nonce":735799205}]},"public_addr":"172.21.15.97:6805/735799205","cluster_addr":"172.21.15.97:6806/735799205","heartbeat_back_addr":"172.21.15.97:6808/735799205","heartbeat_front_addr":"172.21.15.97:6807/735799205","state":["exists","up"]},{"osd":2,"uuid":"88e0e4a2-b4a3-4a00-8669-03c3d9b166c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6809","nonce":2366482649}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6810","nonce":2366482649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6812","nonce":2366482649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6811","nonce":2366482649}]},"public_addr":"172.21.15.97:6809/2366482649","cluster_addr":"172.21.15.97:6810/2366482649","heartbeat_back_addr":"172.21.15.97:6812/2366482649","heartbeat_front_addr":"172.21.15.97:6811/2366482649","state":["exists","up"]},{"osd":3,"uuid":"e689d708-b501-4526-a31a-1e598b74654d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6813","nonce":3191181122}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6814","nonce":3191181122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6816","nonce":3191181122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6815","nonce":3191181122}]},"public_addr":"172.21.15.97:6813/3191181122","cluster_addr":"172.21.15.97:6814/3191181122","heartbeat_back_addr":"172.21.15.97:6816/3191181122","heartbeat_front_addr":"172.21.15.97:6815/3191181122","state":["exists","up"]},{"osd":4,"uuid":"67e4730a-be1c-4d88-9307-e3c2cf3ab2ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6800","nonce":106778208}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6801","nonce":106778208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6803","nonce":106778208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6802","nonce":106778208}]},"public_addr":"172.21.15.117:6800/106778208","cluster_addr":"172.21.15.117:6801/106778208","heartbeat_back_addr":"172.21.15.117:6803/106778208","heartbeat_front_addr":"172.21.15.117:6802/106778208","state":["exists","up"]},{"osd":5,"uuid":"f9fd3153-3e4e-4489-8927-a65641f05d42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6804","nonce":3199889891}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6805","nonce":3199889891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6807","nonce":3199889891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6806","nonce":3199889891}]},"public_addr":"172.21.15.117:6804/3199889891","cluster_addr":"172.21.15.117:6805/3199889891","heartbeat_back_addr":"172.21.15.117:6807/3199889891","heartbeat_front_addr":"172.21.15.117:6806/3199889891","state":["exists","up"]},{"osd":6,"uuid":"84898f12-c37d-4eb6-8b71-5b86bfe16e7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6808","nonce":2185843951}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6809","nonce":2185843951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6811","nonce":2185843951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6810","nonce":2185843951}]},"public_addr":"172.21.15.117:6808/2185843951","cluster_addr":"172.21.15.117:6809/2185843951","heartbeat_back_addr":"172.21.15.117:6811/2185843951","heartbeat_front_addr":"172.21.15.117:6810/2185843951","state":["exists","up"]},{"osd":7,"uuid":"529af2ce-2ae9-41ed-8c8e-d133628cfd20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6812","nonce":2817683239}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6813","nonce":2817683239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6815","nonce":2817683239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6814","nonce":2817683239}]},"public_addr":"172.21.15.117:6812/2817683239","cluster_addr":"172.21.15.117:6813/2817683239","heartbeat_back_addr":"172.21.15.117:6815/2817683239","heartbeat_front_addr":"172.21.15.117:6814/2817683239","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:21:39.273521+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:20:53.862243+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:20:46.878951+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:21:00.429377+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:21:28.104529+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:21:54.066870+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:20:54.876452+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:21:13.885684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.97:0/2600364788":"2021-10-09T19:21:42.325540+0000","172.21.15.97:0/4129083289":"2021-10-09T19:21:42.325540+0000","172.21.15.97:0/1443158975":"2021-10-09T19:21:42.325540+0000","172.21.15.97:0/2472640384":"2021-10-09T19:21:42.325540+0000","172.21.15.97:0/3196919488":"2021-10-09T19:21:42.325540+0000","172.21.15.97:6800/3195862546":"2021-10-09T19:21:42.325540+0000","172.21.15.97:6800/3931202434":"2021-10-09T19:17:10.051948+0000","172.21.15.97:0/2761595213":"2021-10-09T19:17:10.051948+0000","172.21.15.97:0/900681504":"2021-10-09T19:17:10.051948+0000","172.21.15.97:0/3932251406":"2021-10-09T19:17:10.051948+0000","172.21.15.97:0/398006785":"2021-10-09T19:16:48.651177+0000","172.21.15.97:0/1642570050":"2021-10-09T19:16:48.651177+0000","172.21.15.97:0/300178790":"2021-10-09T19:16:48.651177+0000","172.21.15.97:6800/845999767":"2021-10-09T19:16:48.651177+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-10-08T19:21:56.405 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:21:56 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:21:56.811 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2021-10-08T19:19:44.413311+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': '.rgw.root', 'create_time': '2021-10-08T19:21:21.940881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 3, 'pool_name': 'iscsi', 'create_time': '2021-10-08T19:21:22.536945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 3, 'pg_placement_num': 3, 'pg_placement_num_target': 3, 'pg_num_target': 3, 'pg_num_pending': 3, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '63', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 4, 'pool_name': 'default.rgw.log', 'create_time': '2021-10-08T19:21:23.886328+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 5, 'pool_name': 'default.rgw.control', 'create_time': '2021-10-08T19:21:25.865032+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 6, 'pool_name': 'default.rgw.meta', 'create_time': '2021-10-08T19:21:27.940767+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '69', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 8}, 'application_metadata': {'rgw': {}}}] 2021-10-08T19:21:56.812 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd pool get .mgr pg_num 2021-10-08T19:21:57.084 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:21:57.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:56 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:21:57.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:56 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:21:57.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:56 smithi117 ceph-mon[34585]: 172.21.15.97 - - [08/Oct/2021:19:21:55] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:21:57.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:56 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3501387600' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-10-08T19:21:57.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:56 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:21:57.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:56 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:21:57.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:56 smithi097 ceph-mon[32687]: 172.21.15.97 - - [08/Oct/2021:19:21:55] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:21:57.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:56 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3501387600' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-10-08T19:21:57.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:56 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:21:57.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:56 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:21:57.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:56 smithi097 ceph-mon[41966]: 172.21.15.97 - - [08/Oct/2021:19:21:55] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:21:57.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:56 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3501387600' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-10-08T19:21:57.573 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:21:57 smithi097 conmon[33110]: 172.21.15.117 - - [08/Oct/2021:19:21:57] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:21:58.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:57 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:21:58.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:57 smithi117 ceph-mon[34585]: pgmap v13: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:21:58.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:57 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:21:58.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:57 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:21:58.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:57 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:21:58.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:57 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:21:58.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:57 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:21:58.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:57 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:21:58.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:57 smithi097 ceph-mon[32687]: pgmap v13: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:21:58.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:57 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:21:58.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:57 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:21:58.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:57 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:21:58.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:57 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:21:58.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:57 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:21:58.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:57 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:21:58.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:57 smithi097 ceph-mon[41966]: pgmap v13: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:21:58.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:57 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:21:58.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:57 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:21:58.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:57 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:21:58.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:57 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:21:58.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:57 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:21:58.848 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2021-10-08T19:21:59.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:58 smithi117 ceph-mon[34585]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:21:59.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:58 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:21:59.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:58 smithi117 ceph-mon[34585]: 172.21.15.117 - - [08/Oct/2021:19:21:57] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:21:59.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:58 smithi117 ceph-mon[34585]: Deploying daemon node-exporter.a on smithi097 2021-10-08T19:21:59.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:58 smithi117 ceph-mon[34585]: poll took 11884.136 ms: 1 events 2021-10-08T19:21:59.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:58 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3775186896' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2021-10-08T19:21:59.219 INFO:journalctl@ceph.node-exporter.a.smithi097.stdout:Oct 08 19:21:58 smithi097 bash[69902]: Trying to pull quay.io/prometheus/node-exporter:v0.18.1... 2021-10-08T19:21:59.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:58 smithi097 ceph-mon[32687]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:21:59.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:58 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:21:59.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:58 smithi097 ceph-mon[32687]: 172.21.15.117 - - [08/Oct/2021:19:21:57] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:21:59.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:58 smithi097 ceph-mon[32687]: Deploying daemon node-exporter.a on smithi097 2021-10-08T19:21:59.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:58 smithi097 ceph-mon[32687]: poll took 11884.136 ms: 1 events 2021-10-08T19:21:59.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:58 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3775186896' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2021-10-08T19:21:59.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:58 smithi097 ceph-mon[41966]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:21:59.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:58 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:21:59.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:58 smithi097 ceph-mon[41966]: 172.21.15.117 - - [08/Oct/2021:19:21:57] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:21:59.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:58 smithi097 ceph-mon[41966]: Deploying daemon node-exporter.a on smithi097 2021-10-08T19:21:59.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:58 smithi097 ceph-mon[41966]: poll took 11884.136 ms: 1 events 2021-10-08T19:21:59.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:58 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3775186896' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2021-10-08T19:21:59.552 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd pool get .rgw.root pg_num 2021-10-08T19:21:59.822 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:22:00.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:21:59 smithi117 ceph-mon[34585]: pgmap v14: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:22:00.219 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:21:59 smithi097 ceph-mon[41966]: pgmap v14: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:22:00.220 INFO:journalctl@ceph.node-exporter.a.smithi097.stdout:Oct 08 19:21:59 smithi097 bash[69902]: Getting image source signatures 2021-10-08T19:22:00.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:21:59 smithi097 ceph-mon[32687]: pgmap v14: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:22:01.193 INFO:journalctl@ceph.node-exporter.a.smithi097.stdout:Oct 08 19:22:00 smithi097 bash[69902]: Copying blob sha256:190160031744b0810999dd6f293478be0b41524654c70782cf09437095430f2f 2021-10-08T19:22:01.193 INFO:journalctl@ceph.node-exporter.a.smithi097.stdout:Oct 08 19:22:00 smithi097 bash[69902]: Copying blob sha256:3589a6efd9ce96b2f2218a80bacb84f60d5e584d024023617b0f56b87fe798c3 2021-10-08T19:22:01.193 INFO:journalctl@ceph.node-exporter.a.smithi097.stdout:Oct 08 19:22:01 smithi097 bash[69902]: Copying blob sha256:49a2d53aa1af115e87f7e23a7fe4b7a3e12304d37982fb6528b035d0f68a3b56 2021-10-08T19:22:01.504 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2021-10-08T19:22:01.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:01 smithi097 ceph-mon[32687]: pgmap v15: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:22:01.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:01 smithi097 ceph-mon[41966]: pgmap v15: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:22:01.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:01 smithi117 ceph-mon[34585]: pgmap v15: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:22:02.186 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd pool get iscsi pg_num 2021-10-08T19:22:02.469 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:22:02.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:02 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/224861151' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".rgw.root", "var": "pg_num"}]: dispatch 2021-10-08T19:22:02.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:02 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/224861151' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".rgw.root", "var": "pg_num"}]: dispatch 2021-10-08T19:22:02.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:02 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/224861151' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".rgw.root", "var": "pg_num"}]: dispatch 2021-10-08T19:22:03.415 INFO:journalctl@ceph.node-exporter.a.smithi097.stdout:Oct 08 19:22:03 smithi097 bash[69902]: Copying config sha256:e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87 2021-10-08T19:22:03.415 INFO:journalctl@ceph.node-exporter.a.smithi097.stdout:Oct 08 19:22:03 smithi097 bash[69902]: Writing manifest to image destination 2021-10-08T19:22:03.416 INFO:journalctl@ceph.node-exporter.a.smithi097.stdout:Oct 08 19:22:03 smithi097 bash[69902]: Storing signatures 2021-10-08T19:22:03.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:03 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:22:03.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:03 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:22:03.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:03 smithi097 ceph-mon[32687]: osdmap e77: 8 total, 8 up, 8 in 2021-10-08T19:22:03.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:03 smithi097 ceph-mon[32687]: pgmap v17: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 665 B/s rd, 0 op/s 2021-10-08T19:22:03.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:03 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:22:03.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:03 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:22:03.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:03 smithi097 ceph-mon[41966]: osdmap e77: 8 total, 8 up, 8 in 2021-10-08T19:22:03.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:03 smithi097 ceph-mon[41966]: pgmap v17: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 665 B/s rd, 0 op/s 2021-10-08T19:22:03.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:03 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:22:03.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:03 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:22:03.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:03 smithi117 ceph-mon[34585]: osdmap e77: 8 total, 8 up, 8 in 2021-10-08T19:22:03.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:03 smithi117 ceph-mon[34585]: pgmap v17: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 665 B/s rd, 0 op/s 2021-10-08T19:22:05.667 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 3 2021-10-08T19:22:05.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:05 smithi117 ceph-mon[34585]: pgmap v18: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-10-08T19:22:05.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:05 smithi117 ceph-mon[34585]: osdmap e78: 8 total, 8 up, 8 in 2021-10-08T19:22:05.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:05 smithi097 ceph-mon[32687]: pgmap v18: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-10-08T19:22:05.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:05 smithi097 ceph-mon[32687]: osdmap e78: 8 total, 8 up, 8 in 2021-10-08T19:22:05.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:05 smithi097 ceph-mon[41966]: pgmap v18: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-10-08T19:22:05.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:05 smithi097 ceph-mon[41966]: osdmap e78: 8 total, 8 up, 8 in 2021-10-08T19:22:05.971 INFO:journalctl@ceph.node-exporter.a.smithi097.stdout:Oct 08 19:22:05 smithi097 conmon[70840]: time="2021-10-08T19:22:05Z" level=info msg="Starting node_exporter (version=0.18.1, branch=HEAD, revision=3db77732e925c08f675d7404a8c46466b2ece83e)" source="node_exporter.go:156" 2021-10-08T19:22:05.971 INFO:journalctl@ceph.node-exporter.a.smithi097.stdout:Oct 08 19:22:05 smithi097 conmon[70840]: time="2021-10-08T19:22:05Z" level=info msg="Build context (go=go1.12.5, user=root@b50852a1acba, date=20190604-16:41:18)" source="node_exporter.go:157" 2021-10-08T19:22:05.971 INFO:journalctl@ceph.node-exporter.a.smithi097.stdout:Oct 08 19:22:05 smithi097 conmon[70840]: time="2021-10-08T19:22:05Z" level=info msg="Enabled collectors:" source="node_exporter.go:97" 2021-10-08T19:22:05.972 INFO:journalctl@ceph.node-exporter.a.smithi097.stdout:Oct 08 19:22:05 smithi097 conmon[70840]: time="2021-10-08T19:22:05Z" level=info msg=" - arp" source="node_exporter.go:104" 2021-10-08T19:22:05.972 INFO:journalctl@ceph.node-exporter.a.smithi097.stdout:Oct 08 19:22:05 smithi097 conmon[70840]: time="2021-10-08T19:22:05Z" level=info msg=" - bcache" source="node_exporter.go:104" 2021-10-08T19:22:05.972 INFO:journalctl@ceph.node-exporter.a.smithi097.stdout:Oct 08 19:22:05 smithi097 conmon[70840]: time="2021-10-08T19:22:05Z" level=info msg=" - bonding" source="node_exporter.go:104" 2021-10-08T19:22:05.972 INFO:journalctl@ceph.node-exporter.a.smithi097.stdout:Oct 08 19:22:05 smithi097 conmon[70840]: time="2021-10-08T19:22:05Z" level=info msg=" - conntrack" source="node_exporter.go:104" 2021-10-08T19:22:05.972 INFO:journalctl@ceph.node-exporter.a.smithi097.stdout:Oct 08 19:22:05 smithi097 conmon[70840]: time="2021-10-08T19:22:05Z" level=info msg=" - cpu" source="node_exporter.go:104" 2021-10-08T19:22:05.973 INFO:journalctl@ceph.node-exporter.a.smithi097.stdout:Oct 08 19:22:05 smithi097 conmon[70840]: time="2021-10-08T19:22:05Z" level=info msg=" - cpufreq" source="node_exporter.go:104" 2021-10-08T19:22:05.973 INFO:journalctl@ceph.node-exporter.a.smithi097.stdout:Oct 08 19:22:05 smithi097 conmon[70840]: time="2021-10-08T19:22:05Z" level=info msg=" - diskstats" source="node_exporter.go:104" 2021-10-08T19:22:05.974 INFO:journalctl@ceph.node-exporter.a.smithi097.stdout:Oct 08 19:22:05 smithi097 conmon[70840]: time="2021-10-08T19:22:05Z" level=info msg=" - edac" source="node_exporter.go:104" 2021-10-08T19:22:05.974 INFO:journalctl@ceph.node-exporter.a.smithi097.stdout:Oct 08 19:22:05 smithi097 conmon[70840]: time="2021-10-08T19:22:05Z" level=info msg=" - entropy" source="node_exporter.go:104" 2021-10-08T19:22:05.974 INFO:journalctl@ceph.node-exporter.a.smithi097.stdout:Oct 08 19:22:05 smithi097 conmon[70840]: time="2021-10-08T19:22:05Z" level=info msg=" - filefd" source="node_exporter.go:104" 2021-10-08T19:22:05.974 INFO:journalctl@ceph.node-exporter.a.smithi097.stdout:Oct 08 19:22:05 smithi097 conmon[70840]: time="2021-10-08T19:22:05Z" level=info msg=" - filesystem" source="node_exporter.go:104" 2021-10-08T19:22:05.975 INFO:journalctl@ceph.node-exporter.a.smithi097.stdout:Oct 08 19:22:05 smithi097 conmon[70840]: time="2021-10-08T19:22:05Z" level=info msg=" - hwmon" source="node_exporter.go:104" 2021-10-08T19:22:05.975 INFO:journalctl@ceph.node-exporter.a.smithi097.stdout:Oct 08 19:22:05 smithi097 conmon[70840]: time="2021-10-08T19:22:05Z" level=info msg=" - infiniband" source="node_exporter.go:104" 2021-10-08T19:22:05.975 INFO:journalctl@ceph.node-exporter.a.smithi097.stdout:Oct 08 19:22:05 smithi097 conmon[70840]: time="2021-10-08T19:22:05Z" level=info msg=" - ipvs" source="node_exporter.go:104" 2021-10-08T19:22:05.975 INFO:journalctl@ceph.node-exporter.a.smithi097.stdout:Oct 08 19:22:05 smithi097 conmon[70840]: time="2021-10-08T19:22:05Z" level=info msg=" - loadavg" source="node_exporter.go:104" 2021-10-08T19:22:05.976 INFO:journalctl@ceph.node-exporter.a.smithi097.stdout:Oct 08 19:22:05 smithi097 conmon[70840]: time="2021-10-08T19:22:05Z" level=info msg=" - mdadm" source="node_exporter.go:104" 2021-10-08T19:22:05.976 INFO:journalctl@ceph.node-exporter.a.smithi097.stdout:Oct 08 19:22:05 smithi097 conmon[70840]: time="2021-10-08T19:22:05Z" level=info msg=" - meminfo" source="node_exporter.go:104" 2021-10-08T19:22:05.976 INFO:journalctl@ceph.node-exporter.a.smithi097.stdout:Oct 08 19:22:05 smithi097 conmon[70840]: time="2021-10-08T19:22:05Z" level=info msg=" - netclass" source="node_exporter.go:104" 2021-10-08T19:22:05.976 INFO:journalctl@ceph.node-exporter.a.smithi097.stdout:Oct 08 19:22:05 smithi097 conmon[70840]: time="2021-10-08T19:22:05Z" level=info msg=" - netdev" source="node_exporter.go:104" 2021-10-08T19:22:05.977 INFO:journalctl@ceph.node-exporter.a.smithi097.stdout:Oct 08 19:22:05 smithi097 conmon[70840]: time="2021-10-08T19:22:05Z" level=info msg=" - netstat" source="node_exporter.go:104" 2021-10-08T19:22:05.977 INFO:journalctl@ceph.node-exporter.a.smithi097.stdout:Oct 08 19:22:05 smithi097 conmon[70840]: time="2021-10-08T19:22:05Z" level=info msg=" - nfs" source="node_exporter.go:104" 2021-10-08T19:22:05.977 INFO:journalctl@ceph.node-exporter.a.smithi097.stdout:Oct 08 19:22:05 smithi097 conmon[70840]: time="2021-10-08T19:22:05Z" level=info msg=" - nfsd" source="node_exporter.go:104" 2021-10-08T19:22:05.977 INFO:journalctl@ceph.node-exporter.a.smithi097.stdout:Oct 08 19:22:05 smithi097 conmon[70840]: time="2021-10-08T19:22:05Z" level=info msg=" - pressure" source="node_exporter.go:104" 2021-10-08T19:22:05.977 INFO:journalctl@ceph.node-exporter.a.smithi097.stdout:Oct 08 19:22:05 smithi097 conmon[70840]: time="2021-10-08T19:22:05Z" level=info msg=" - sockstat" source="node_exporter.go:104" 2021-10-08T19:22:05.978 INFO:journalctl@ceph.node-exporter.a.smithi097.stdout:Oct 08 19:22:05 smithi097 conmon[70840]: time="2021-10-08T19:22:05Z" level=info msg=" - stat" source="node_exporter.go:104" 2021-10-08T19:22:05.978 INFO:journalctl@ceph.node-exporter.a.smithi097.stdout:Oct 08 19:22:05 smithi097 conmon[70840]: time="2021-10-08T19:22:05Z" level=info msg=" - textfile" source="node_exporter.go:104" 2021-10-08T19:22:05.978 INFO:journalctl@ceph.node-exporter.a.smithi097.stdout:Oct 08 19:22:05 smithi097 conmon[70840]: time="2021-10-08T19:22:05Z" level=info msg=" - time" source="node_exporter.go:104" 2021-10-08T19:22:05.978 INFO:journalctl@ceph.node-exporter.a.smithi097.stdout:Oct 08 19:22:05 smithi097 conmon[70840]: time="2021-10-08T19:22:05Z" level=info msg=" - uname" source="node_exporter.go:104" 2021-10-08T19:22:05.978 INFO:journalctl@ceph.node-exporter.a.smithi097.stdout:Oct 08 19:22:05 smithi097 conmon[70840]: time="2021-10-08T19:22:05Z" level=info msg=" - vmstat" source="node_exporter.go:104" 2021-10-08T19:22:05.979 INFO:journalctl@ceph.node-exporter.a.smithi097.stdout:Oct 08 19:22:05 smithi097 conmon[70840]: time="2021-10-08T19:22:05Z" level=info msg=" - xfs" source="node_exporter.go:104" 2021-10-08T19:22:05.979 INFO:journalctl@ceph.node-exporter.a.smithi097.stdout:Oct 08 19:22:05 smithi097 conmon[70840]: time="2021-10-08T19:22:05Z" level=info msg=" - zfs" source="node_exporter.go:104" 2021-10-08T19:22:05.979 INFO:journalctl@ceph.node-exporter.a.smithi097.stdout:Oct 08 19:22:05 smithi097 conmon[70840]: time="2021-10-08T19:22:05Z" level=info msg="Listening on :9100" source="node_exporter.go:170" 2021-10-08T19:22:05.979 INFO:journalctl@ceph.node-exporter.a.smithi097.stdout:Oct 08 19:22:05 smithi097 bash[69902]: d1fb0a004060c525c3525138753fc448db1648b86b45a75d59485f90557801e3 2021-10-08T19:22:05.979 INFO:journalctl@ceph.node-exporter.a.smithi097.stdout:Oct 08 19:22:05 smithi097 systemd[1]: Started Ceph node-exporter.a for 1d01f6d6-286c-11ec-8c25-001a4aab830c. 2021-10-08T19:22:06.335 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd pool get default.rgw.log pg_num 2021-10-08T19:22:06.405 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:22:06 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:22:06.406 INFO:journalctl@ceph.node-exporter.b.smithi117.stdout:Oct 08 19:22:06 smithi117 systemd[1]: Starting Ceph node-exporter.b for 1d01f6d6-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:22:06.608 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:22:06.719 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:06 smithi097 ceph-mon[41966]: poll took 7337.763 ms: 1 events 2021-10-08T19:22:06.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:06 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:22:06.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:06 smithi097 ceph-mon[41966]: Deploying daemon node-exporter.b on smithi117 2021-10-08T19:22:06.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:06 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1287004695' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "iscsi", "var": "pg_num"}]: dispatch 2021-10-08T19:22:06.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:06 smithi097 ceph-mon[32687]: poll took 7337.763 ms: 1 events 2021-10-08T19:22:06.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:06 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:22:06.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:06 smithi097 ceph-mon[32687]: Deploying daemon node-exporter.b on smithi117 2021-10-08T19:22:06.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:06 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1287004695' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "iscsi", "var": "pg_num"}]: dispatch 2021-10-08T19:22:06.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:06 smithi117 ceph-mon[34585]: poll took 7337.763 ms: 1 events 2021-10-08T19:22:06.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:06 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:22:06.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:06 smithi117 ceph-mon[34585]: Deploying daemon node-exporter.b on smithi117 2021-10-08T19:22:06.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:06 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1287004695' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "iscsi", "var": "pg_num"}]: dispatch 2021-10-08T19:22:06.907 INFO:journalctl@ceph.node-exporter.b.smithi117.stdout:Oct 08 19:22:06 smithi117 bash[62916]: Trying to pull quay.io/prometheus/node-exporter:v0.18.1... 2021-10-08T19:22:07.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:07 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:22:07.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:07 smithi117 ceph-mon[34585]: pgmap v20: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:22:07.906 INFO:journalctl@ceph.node-exporter.b.smithi117.stdout:Oct 08 19:22:07 smithi117 bash[62916]: Getting image source signatures 2021-10-08T19:22:07.969 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:07 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:22:07.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:07 smithi097 ceph-mon[41966]: pgmap v20: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:22:07.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:07 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:22:07.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:07 smithi097 ceph-mon[32687]: pgmap v20: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:22:08.352 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2021-10-08T19:22:08.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:08 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1758298369' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "default.rgw.log", "var": "pg_num"}]: dispatch 2021-10-08T19:22:08.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:08 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1758298369' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "default.rgw.log", "var": "pg_num"}]: dispatch 2021-10-08T19:22:08.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:08 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1758298369' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "default.rgw.log", "var": "pg_num"}]: dispatch 2021-10-08T19:22:08.905 INFO:journalctl@ceph.node-exporter.b.smithi117.stdout:Oct 08 19:22:08 smithi117 bash[62916]: Copying blob sha256:190160031744b0810999dd6f293478be0b41524654c70782cf09437095430f2f 2021-10-08T19:22:08.906 INFO:journalctl@ceph.node-exporter.b.smithi117.stdout:Oct 08 19:22:08 smithi117 bash[62916]: Copying blob sha256:3589a6efd9ce96b2f2218a80bacb84f60d5e584d024023617b0f56b87fe798c3 2021-10-08T19:22:08.906 INFO:journalctl@ceph.node-exporter.b.smithi117.stdout:Oct 08 19:22:08 smithi117 bash[62916]: Copying blob sha256:49a2d53aa1af115e87f7e23a7fe4b7a3e12304d37982fb6528b035d0f68a3b56 2021-10-08T19:22:08.909 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd pool get default.rgw.control pg_num 2021-10-08T19:22:09.179 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:22:09.719 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:09 smithi097 ceph-mon[41966]: pgmap v21: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:22:09.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:09 smithi097 ceph-mon[32687]: pgmap v21: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:22:09.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:09 smithi117 ceph-mon[34585]: pgmap v21: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:22:10.905 INFO:journalctl@ceph.node-exporter.b.smithi117.stdout:Oct 08 19:22:10 smithi117 bash[62916]: Copying config sha256:e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87 2021-10-08T19:22:10.905 INFO:journalctl@ceph.node-exporter.b.smithi117.stdout:Oct 08 19:22:10 smithi117 bash[62916]: Writing manifest to image destination 2021-10-08T19:22:10.905 INFO:journalctl@ceph.node-exporter.b.smithi117.stdout:Oct 08 19:22:10 smithi117 bash[62916]: Storing signatures 2021-10-08T19:22:10.968 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2021-10-08T19:22:11.536 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd pool get default.rgw.meta pg_num 2021-10-08T19:22:11.811 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:22:11.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:11 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:22:11.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:11 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:22:11.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:11 smithi117 ceph-mon[34585]: pgmap v22: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:22:11.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:11 smithi117 ceph-mon[34585]: osdmap e79: 8 total, 8 up, 8 in 2021-10-08T19:22:11.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:11 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2874210290' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "default.rgw.control", "var": "pg_num"}]: dispatch 2021-10-08T19:22:11.969 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:11 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:22:11.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:11 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:22:11.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:11 smithi097 ceph-mon[41966]: pgmap v22: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:22:11.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:11 smithi097 ceph-mon[41966]: osdmap e79: 8 total, 8 up, 8 in 2021-10-08T19:22:11.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:11 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2874210290' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "default.rgw.control", "var": "pg_num"}]: dispatch 2021-10-08T19:22:11.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:11 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:22:11.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:11 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:22:11.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:11 smithi097 ceph-mon[32687]: pgmap v22: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:22:11.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:11 smithi097 ceph-mon[32687]: osdmap e79: 8 total, 8 up, 8 in 2021-10-08T19:22:11.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:11 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2874210290' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "default.rgw.control", "var": "pg_num"}]: dispatch 2021-10-08T19:22:12.655 INFO:journalctl@ceph.node-exporter.b.smithi117.stdout:Oct 08 19:22:12 smithi117 conmon[63138]: time="2021-10-08T19:22:12Z" level=info msg="Starting node_exporter (version=0.18.1, branch=HEAD, revision=3db77732e925c08f675d7404a8c46466b2ece83e)" source="node_exporter.go:156" 2021-10-08T19:22:12.656 INFO:journalctl@ceph.node-exporter.b.smithi117.stdout:Oct 08 19:22:12 smithi117 conmon[63138]: time="2021-10-08T19:22:12Z" level=info msg="Build context (go=go1.12.5, user=root@b50852a1acba, date=20190604-16:41:18)" source="node_exporter.go:157" 2021-10-08T19:22:12.656 INFO:journalctl@ceph.node-exporter.b.smithi117.stdout:Oct 08 19:22:12 smithi117 conmon[63138]: time="2021-10-08T19:22:12Z" level=info msg="Enabled collectors:" source="node_exporter.go:97" 2021-10-08T19:22:12.656 INFO:journalctl@ceph.node-exporter.b.smithi117.stdout:Oct 08 19:22:12 smithi117 conmon[63138]: time="2021-10-08T19:22:12Z" level=info msg=" - arp" source="node_exporter.go:104" 2021-10-08T19:22:12.656 INFO:journalctl@ceph.node-exporter.b.smithi117.stdout:Oct 08 19:22:12 smithi117 conmon[63138]: time="2021-10-08T19:22:12Z" level=info msg=" - bcache" source="node_exporter.go:104" 2021-10-08T19:22:12.657 INFO:journalctl@ceph.node-exporter.b.smithi117.stdout:Oct 08 19:22:12 smithi117 conmon[63138]: time="2021-10-08T19:22:12Z" level=info msg=" - bonding" source="node_exporter.go:104" 2021-10-08T19:22:12.657 INFO:journalctl@ceph.node-exporter.b.smithi117.stdout:Oct 08 19:22:12 smithi117 conmon[63138]: time="2021-10-08T19:22:12Z" level=info msg=" - conntrack" source="node_exporter.go:104" 2021-10-08T19:22:12.657 INFO:journalctl@ceph.node-exporter.b.smithi117.stdout:Oct 08 19:22:12 smithi117 conmon[63138]: time="2021-10-08T19:22:12Z" level=info msg=" - cpu" source="node_exporter.go:104" 2021-10-08T19:22:12.657 INFO:journalctl@ceph.node-exporter.b.smithi117.stdout:Oct 08 19:22:12 smithi117 conmon[63138]: time="2021-10-08T19:22:12Z" level=info msg=" - cpufreq" source="node_exporter.go:104" 2021-10-08T19:22:12.658 INFO:journalctl@ceph.node-exporter.b.smithi117.stdout:Oct 08 19:22:12 smithi117 conmon[63138]: time="2021-10-08T19:22:12Z" level=info msg=" - diskstats" source="node_exporter.go:104" 2021-10-08T19:22:12.658 INFO:journalctl@ceph.node-exporter.b.smithi117.stdout:Oct 08 19:22:12 smithi117 conmon[63138]: time="2021-10-08T19:22:12Z" level=info msg=" - edac" source="node_exporter.go:104" 2021-10-08T19:22:12.658 INFO:journalctl@ceph.node-exporter.b.smithi117.stdout:Oct 08 19:22:12 smithi117 conmon[63138]: time="2021-10-08T19:22:12Z" level=info msg=" - entropy" source="node_exporter.go:104" 2021-10-08T19:22:12.658 INFO:journalctl@ceph.node-exporter.b.smithi117.stdout:Oct 08 19:22:12 smithi117 conmon[63138]: time="2021-10-08T19:22:12Z" level=info msg=" - filefd" source="node_exporter.go:104" 2021-10-08T19:22:12.659 INFO:journalctl@ceph.node-exporter.b.smithi117.stdout:Oct 08 19:22:12 smithi117 conmon[63138]: time="2021-10-08T19:22:12Z" level=info msg=" - filesystem" source="node_exporter.go:104" 2021-10-08T19:22:12.659 INFO:journalctl@ceph.node-exporter.b.smithi117.stdout:Oct 08 19:22:12 smithi117 conmon[63138]: time="2021-10-08T19:22:12Z" level=info msg=" - hwmon" source="node_exporter.go:104" 2021-10-08T19:22:12.659 INFO:journalctl@ceph.node-exporter.b.smithi117.stdout:Oct 08 19:22:12 smithi117 conmon[63138]: time="2021-10-08T19:22:12Z" level=info msg=" - infiniband" source="node_exporter.go:104" 2021-10-08T19:22:12.659 INFO:journalctl@ceph.node-exporter.b.smithi117.stdout:Oct 08 19:22:12 smithi117 conmon[63138]: time="2021-10-08T19:22:12Z" level=info msg=" - ipvs" source="node_exporter.go:104" 2021-10-08T19:22:12.659 INFO:journalctl@ceph.node-exporter.b.smithi117.stdout:Oct 08 19:22:12 smithi117 conmon[63138]: time="2021-10-08T19:22:12Z" level=info msg=" - loadavg" source="node_exporter.go:104" 2021-10-08T19:22:12.660 INFO:journalctl@ceph.node-exporter.b.smithi117.stdout:Oct 08 19:22:12 smithi117 conmon[63138]: time="2021-10-08T19:22:12Z" level=info msg=" - mdadm" source="node_exporter.go:104" 2021-10-08T19:22:12.660 INFO:journalctl@ceph.node-exporter.b.smithi117.stdout:Oct 08 19:22:12 smithi117 conmon[63138]: time="2021-10-08T19:22:12Z" level=info msg=" - meminfo" source="node_exporter.go:104" 2021-10-08T19:22:12.660 INFO:journalctl@ceph.node-exporter.b.smithi117.stdout:Oct 08 19:22:12 smithi117 conmon[63138]: time="2021-10-08T19:22:12Z" level=info msg=" - netclass" source="node_exporter.go:104" 2021-10-08T19:22:12.660 INFO:journalctl@ceph.node-exporter.b.smithi117.stdout:Oct 08 19:22:12 smithi117 conmon[63138]: time="2021-10-08T19:22:12Z" level=info msg=" - netdev" source="node_exporter.go:104" 2021-10-08T19:22:12.661 INFO:journalctl@ceph.node-exporter.b.smithi117.stdout:Oct 08 19:22:12 smithi117 conmon[63138]: time="2021-10-08T19:22:12Z" level=info msg=" - netstat" source="node_exporter.go:104" 2021-10-08T19:22:12.661 INFO:journalctl@ceph.node-exporter.b.smithi117.stdout:Oct 08 19:22:12 smithi117 conmon[63138]: time="2021-10-08T19:22:12Z" level=info msg=" - nfs" source="node_exporter.go:104" 2021-10-08T19:22:12.661 INFO:journalctl@ceph.node-exporter.b.smithi117.stdout:Oct 08 19:22:12 smithi117 conmon[63138]: time="2021-10-08T19:22:12Z" level=info msg=" - nfsd" source="node_exporter.go:104" 2021-10-08T19:22:12.661 INFO:journalctl@ceph.node-exporter.b.smithi117.stdout:Oct 08 19:22:12 smithi117 conmon[63138]: time="2021-10-08T19:22:12Z" level=info msg=" - pressure" source="node_exporter.go:104" 2021-10-08T19:22:12.661 INFO:journalctl@ceph.node-exporter.b.smithi117.stdout:Oct 08 19:22:12 smithi117 conmon[63138]: time="2021-10-08T19:22:12Z" level=info msg=" - sockstat" source="node_exporter.go:104" 2021-10-08T19:22:12.662 INFO:journalctl@ceph.node-exporter.b.smithi117.stdout:Oct 08 19:22:12 smithi117 conmon[63138]: time="2021-10-08T19:22:12Z" level=info msg=" - stat" source="node_exporter.go:104" 2021-10-08T19:22:12.662 INFO:journalctl@ceph.node-exporter.b.smithi117.stdout:Oct 08 19:22:12 smithi117 conmon[63138]: time="2021-10-08T19:22:12Z" level=info msg=" - textfile" source="node_exporter.go:104" 2021-10-08T19:22:12.662 INFO:journalctl@ceph.node-exporter.b.smithi117.stdout:Oct 08 19:22:12 smithi117 conmon[63138]: time="2021-10-08T19:22:12Z" level=info msg=" - time" source="node_exporter.go:104" 2021-10-08T19:22:12.663 INFO:journalctl@ceph.node-exporter.b.smithi117.stdout:Oct 08 19:22:12 smithi117 conmon[63138]: time="2021-10-08T19:22:12Z" level=info msg=" - uname" source="node_exporter.go:104" 2021-10-08T19:22:12.663 INFO:journalctl@ceph.node-exporter.b.smithi117.stdout:Oct 08 19:22:12 smithi117 conmon[63138]: time="2021-10-08T19:22:12Z" level=info msg=" - vmstat" source="node_exporter.go:104" 2021-10-08T19:22:12.664 INFO:journalctl@ceph.node-exporter.b.smithi117.stdout:Oct 08 19:22:12 smithi117 conmon[63138]: time="2021-10-08T19:22:12Z" level=info msg=" - xfs" source="node_exporter.go:104" 2021-10-08T19:22:12.664 INFO:journalctl@ceph.node-exporter.b.smithi117.stdout:Oct 08 19:22:12 smithi117 conmon[63138]: time="2021-10-08T19:22:12Z" level=info msg=" - zfs" source="node_exporter.go:104" 2021-10-08T19:22:12.664 INFO:journalctl@ceph.node-exporter.b.smithi117.stdout:Oct 08 19:22:12 smithi117 conmon[63138]: time="2021-10-08T19:22:12Z" level=info msg="Listening on :9100" source="node_exporter.go:170" 2021-10-08T19:22:12.664 INFO:journalctl@ceph.node-exporter.b.smithi117.stdout:Oct 08 19:22:12 smithi117 bash[62916]: cf4507ef2c2e8167e26c8e8688ddc376a6566b2840f9598b11cf6b97726ba70d 2021-10-08T19:22:12.665 INFO:journalctl@ceph.node-exporter.b.smithi117.stdout:Oct 08 19:22:12 smithi117 systemd[1]: Started Ceph node-exporter.b for 1d01f6d6-286c-11ec-8c25-001a4aab830c. 2021-10-08T19:22:13.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:13 smithi117 ceph-mon[34585]: poll took 6396.295 ms: 1 events 2021-10-08T19:22:13.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:13 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:22:13.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:13 smithi117 ceph-mon[34585]: Sending message to agent on host smithi097 2021-10-08T19:22:13.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:13 smithi117 ceph-mon[34585]: Sending message to agent on host smithi117 2021-10-08T19:22:13.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:13 smithi117 ceph-mon[34585]: Deploying daemon prometheus.a on smithi117 2021-10-08T19:22:13.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:13 smithi117 ceph-mon[34585]: pgmap v24: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:22:13.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:13 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:22:13.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:13 smithi117 ceph-mon[34585]: Received "ACK" from agent on host smithi117 2021-10-08T19:22:13.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:13 smithi097 ceph-mon[41966]: poll took 6396.295 ms: 1 events 2021-10-08T19:22:13.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:13 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:22:13.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:13 smithi097 ceph-mon[41966]: Sending message to agent on host smithi097 2021-10-08T19:22:13.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:13 smithi097 ceph-mon[41966]: Sending message to agent on host smithi117 2021-10-08T19:22:13.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:13 smithi097 ceph-mon[41966]: Deploying daemon prometheus.a on smithi117 2021-10-08T19:22:13.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:13 smithi097 ceph-mon[41966]: pgmap v24: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:22:13.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:13 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:22:13.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:13 smithi097 ceph-mon[41966]: Received "ACK" from agent on host smithi117 2021-10-08T19:22:13.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:13 smithi097 ceph-mon[32687]: poll took 6396.295 ms: 1 events 2021-10-08T19:22:13.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:13 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:22:13.474 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:13 smithi097 ceph-mon[32687]: Sending message to agent on host smithi097 2021-10-08T19:22:13.474 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:13 smithi097 ceph-mon[32687]: Sending message to agent on host smithi117 2021-10-08T19:22:13.474 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:13 smithi097 ceph-mon[32687]: Deploying daemon prometheus.a on smithi117 2021-10-08T19:22:13.478 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:13 smithi097 ceph-mon[32687]: pgmap v24: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:22:13.479 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:13 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:22:13.479 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:13 smithi097 ceph-mon[32687]: Received "ACK" from agent on host smithi117 2021-10-08T19:22:13.822 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2021-10-08T19:22:14.597 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:14 smithi097 ceph-mon[41966]: Received "ACK" from agent on host smithi097 2021-10-08T19:22:14.597 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:14 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/4239849031' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "default.rgw.meta", "var": "pg_num"}]: dispatch 2021-10-08T19:22:14.597 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:14 smithi097 ceph-mon[32687]: Received "ACK" from agent on host smithi097 2021-10-08T19:22:14.598 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:14 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/4239849031' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "default.rgw.meta", "var": "pg_num"}]: dispatch 2021-10-08T19:22:14.619 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2021-10-08T19:22:14.620 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2021-10-08T19:22:14.620 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph mgr dump --format=json 2021-10-08T19:22:14.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:14 smithi117 ceph-mon[34585]: Received "ACK" from agent on host smithi097 2021-10-08T19:22:14.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:14 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/4239849031' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "default.rgw.meta", "var": "pg_num"}]: dispatch 2021-10-08T19:22:15.002 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:22:15.469 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:15 smithi097 ceph-mon[32687]: 1.0 scrub ok 2021-10-08T19:22:15.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:15 smithi097 ceph-mon[32687]: pgmap v25: 132 pgs: 132 active+clean; 582 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-10-08T19:22:15.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:15 smithi097 ceph-mon[41966]: 1.0 scrub ok 2021-10-08T19:22:15.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:15 smithi097 ceph-mon[41966]: pgmap v25: 132 pgs: 132 active+clean; 582 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-10-08T19:22:15.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:15 smithi117 ceph-mon[34585]: 1.0 scrub ok 2021-10-08T19:22:15.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:15 smithi117 ceph-mon[34585]: pgmap v25: 132 pgs: 132 active+clean; 582 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-10-08T19:22:16.350 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:22:16 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:22:16.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:16 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:22:16.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:16 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:22:16.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:16 smithi117 ceph-mon[34585]: osdmap e80: 8 total, 8 up, 8 in 2021-10-08T19:22:16.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:16 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:22:16.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:16 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:22:16.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:16 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:22:16.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:16 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:22:16.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:16 smithi097 ceph-mon[32687]: osdmap e80: 8 total, 8 up, 8 in 2021-10-08T19:22:16.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:16 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:22:16.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:16 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:22:16.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:16 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:22:16.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:16 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:22:16.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:16 smithi097 ceph-mon[41966]: osdmap e80: 8 total, 8 up, 8 in 2021-10-08T19:22:16.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:16 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:22:16.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:16 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:22:17.311 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:22:17.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:17 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:22:17.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:17 smithi097 ceph-mon[41966]: osdmap e81: 8 total, 8 up, 8 in 2021-10-08T19:22:17.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:17 smithi097 ceph-mon[41966]: pgmap v28: 132 pgs: 132 active+clean; 582 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:22:17.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:17 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3827527910' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2021-10-08T19:22:17.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:17 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:22:17.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:17 smithi097 ceph-mon[32687]: osdmap e81: 8 total, 8 up, 8 in 2021-10-08T19:22:17.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:17 smithi097 ceph-mon[32687]: pgmap v28: 132 pgs: 132 active+clean; 582 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:22:17.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:17 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3827527910' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2021-10-08T19:22:17.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:17 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:22:17.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:17 smithi117 ceph-mon[34585]: osdmap e81: 8 total, 8 up, 8 in 2021-10-08T19:22:17.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:17 smithi117 ceph-mon[34585]: pgmap v28: 132 pgs: 132 active+clean; 582 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:22:17.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:17 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3827527910' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2021-10-08T19:22:18.076 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":20,"active_gid":24493,"active_name":"y","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6800","nonce":3027955200}]},"active_addr":"172.21.15.97:6800/3027955200","active_change":"2021-10-08T19:21:42.325909+0000","active_mgr_features":4540138303579357183,"available":true,"standbys":[{"gid":34478,"name":"x","mgr_features":4540138303579357183,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Registry to which we should normalize unqualified image names","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"endpoint_port":{"name":"endpoint_port","type":"int","level":"advanced","flags":0,"default_value":"8499","min":"","max":"","enum_allowed":[],"desc":"Which port cephadm http endpoint will listen on","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"autoscale_profile":{"name":"autoscale_profile","type":"str","level":"advanced","flags":1,"default_value":"scale-up","min":"","max":"","enum_allowed":[],"desc":"pg_autoscale profiler","long_desc":"Determines the behavior of the autoscaler algorithm `scale-up` means that it starts out with minmum pgs and scales up when there is pressure, `scale-down` means starts out with full pgs and scales down when there is pressure ","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share perf counter metrics summed across the whole cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Registry to which we should normalize unqualified image names","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"endpoint_port":{"name":"endpoint_port","type":"int","level":"advanced","flags":0,"default_value":"8499","min":"","max":"","enum_allowed":[],"desc":"Which port cephadm http endpoint will listen on","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"autoscale_profile":{"name":"autoscale_profile","type":"str","level":"advanced","flags":1,"default_value":"scale-up","min":"","max":"","enum_allowed":[],"desc":"pg_autoscale profiler","long_desc":"Determines the behavior of the autoscaler algorithm `scale-up` means that it starts out with minmum pgs and scales up when there is pressure, `scale-down` means starts out with full pgs and scales down when there is pressure ","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share perf counter metrics summed across the whole cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"cephadm":"https://172.21.15.97:8499/","dashboard":"https://172.21.15.97:8443/","prometheus":"http://172.21.15.97:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":73,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.97:0","nonce":1188673725}]},{"addrvec":[{"type":"v2","addr":"172.21.15.97:0","nonce":4000781819}]},{"addrvec":[{"type":"v2","addr":"172.21.15.97:0","nonce":560730001}]},{"addrvec":[{"type":"v2","addr":"172.21.15.97:0","nonce":3328063009}]}]}} 2021-10-08T19:22:18.082 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2021-10-08T19:22:18.082 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2021-10-08T19:22:18.082 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd dump --format=json 2021-10-08T19:22:18.434 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:22:19.747 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:19 smithi117 ceph-mon[34585]: pgmap v29: 132 pgs: 132 active+clean; 582 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 653 B/s rd, 0 op/s 2021-10-08T19:22:19.955 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:19 smithi097 ceph-mon[32687]: pgmap v29: 132 pgs: 132 active+clean; 582 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 653 B/s rd, 0 op/s 2021-10-08T19:22:19.956 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:19 smithi097 ceph-mon[41966]: pgmap v29: 132 pgs: 132 active+clean; 582 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 653 B/s rd, 0 op/s 2021-10-08T19:22:20.219 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:22:19 smithi097 conmon[33110]: 172.21.15.97 - - [08/Oct/2021:19:22:19] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:20.400 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:22:20.401 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":81,"fsid":"1d01f6d6-286c-11ec-8c25-001a4aab830c","created":"2021-10-08T19:16:25.258003+0000","modified":"2021-10-08T19:22:16.406156+0000","last_up_change":"2021-10-08T19:21:15.388758+0000","last_in_change":"2021-10-08T19:20:59.507952+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2021-10-08T19:19:44.413311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":".rgw.root","create_time":"2021-10-08T19:21:21.940881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":3,"pool_name":"iscsi","create_time":"2021-10-08T19:21:22.536945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"default.rgw.log","create_time":"2021-10-08T19:21:23.886328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":5,"pool_name":"default.rgw.control","create_time":"2021-10-08T19:21:25.865032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2021-10-08T19:21:27.940767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":8},"application_metadata":{"rgw":{}}}],"osds":[{"osd":0,"uuid":"9e64e714-a5d5-4fbb-ae2b-1df4bf14b8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6801","nonce":3354161282}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6802","nonce":3354161282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6804","nonce":3354161282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6803","nonce":3354161282}]},"public_addr":"172.21.15.97:6801/3354161282","cluster_addr":"172.21.15.97:6802/3354161282","heartbeat_back_addr":"172.21.15.97:6804/3354161282","heartbeat_front_addr":"172.21.15.97:6803/3354161282","state":["exists","up"]},{"osd":1,"uuid":"32602a22-f263-4b62-a8d8-50fddfb73fa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6805","nonce":735799205}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6806","nonce":735799205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6808","nonce":735799205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6807","nonce":735799205}]},"public_addr":"172.21.15.97:6805/735799205","cluster_addr":"172.21.15.97:6806/735799205","heartbeat_back_addr":"172.21.15.97:6808/735799205","heartbeat_front_addr":"172.21.15.97:6807/735799205","state":["exists","up"]},{"osd":2,"uuid":"88e0e4a2-b4a3-4a00-8669-03c3d9b166c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6809","nonce":2366482649}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6810","nonce":2366482649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6812","nonce":2366482649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6811","nonce":2366482649}]},"public_addr":"172.21.15.97:6809/2366482649","cluster_addr":"172.21.15.97:6810/2366482649","heartbeat_back_addr":"172.21.15.97:6812/2366482649","heartbeat_front_addr":"172.21.15.97:6811/2366482649","state":["exists","up"]},{"osd":3,"uuid":"e689d708-b501-4526-a31a-1e598b74654d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6813","nonce":3191181122}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6814","nonce":3191181122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6816","nonce":3191181122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6815","nonce":3191181122}]},"public_addr":"172.21.15.97:6813/3191181122","cluster_addr":"172.21.15.97:6814/3191181122","heartbeat_back_addr":"172.21.15.97:6816/3191181122","heartbeat_front_addr":"172.21.15.97:6815/3191181122","state":["exists","up"]},{"osd":4,"uuid":"67e4730a-be1c-4d88-9307-e3c2cf3ab2ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6800","nonce":106778208}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6801","nonce":106778208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6803","nonce":106778208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6802","nonce":106778208}]},"public_addr":"172.21.15.117:6800/106778208","cluster_addr":"172.21.15.117:6801/106778208","heartbeat_back_addr":"172.21.15.117:6803/106778208","heartbeat_front_addr":"172.21.15.117:6802/106778208","state":["exists","up"]},{"osd":5,"uuid":"f9fd3153-3e4e-4489-8927-a65641f05d42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6804","nonce":3199889891}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6805","nonce":3199889891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6807","nonce":3199889891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6806","nonce":3199889891}]},"public_addr":"172.21.15.117:6804/3199889891","cluster_addr":"172.21.15.117:6805/3199889891","heartbeat_back_addr":"172.21.15.117:6807/3199889891","heartbeat_front_addr":"172.21.15.117:6806/3199889891","state":["exists","up"]},{"osd":6,"uuid":"84898f12-c37d-4eb6-8b71-5b86bfe16e7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6808","nonce":2185843951}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6809","nonce":2185843951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6811","nonce":2185843951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6810","nonce":2185843951}]},"public_addr":"172.21.15.117:6808/2185843951","cluster_addr":"172.21.15.117:6809/2185843951","heartbeat_back_addr":"172.21.15.117:6811/2185843951","heartbeat_front_addr":"172.21.15.117:6810/2185843951","state":["exists","up"]},{"osd":7,"uuid":"529af2ce-2ae9-41ed-8c8e-d133628cfd20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6812","nonce":2817683239}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6813","nonce":2817683239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6815","nonce":2817683239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6814","nonce":2817683239}]},"public_addr":"172.21.15.117:6812/2817683239","cluster_addr":"172.21.15.117:6813/2817683239","heartbeat_back_addr":"172.21.15.117:6815/2817683239","heartbeat_front_addr":"172.21.15.117:6814/2817683239","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:21:39.273521+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:22:09.999346+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:22:14.613055+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:22:15.713666+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:21:28.104529+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:21:54.066870+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:22:02.264002+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:21:13.885684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.97:0/2600364788":"2021-10-09T19:21:42.325540+0000","172.21.15.97:0/4129083289":"2021-10-09T19:21:42.325540+0000","172.21.15.97:0/1443158975":"2021-10-09T19:21:42.325540+0000","172.21.15.97:0/2472640384":"2021-10-09T19:21:42.325540+0000","172.21.15.97:0/3196919488":"2021-10-09T19:21:42.325540+0000","172.21.15.97:6800/3195862546":"2021-10-09T19:21:42.325540+0000","172.21.15.97:6800/3931202434":"2021-10-09T19:17:10.051948+0000","172.21.15.97:0/2761595213":"2021-10-09T19:17:10.051948+0000","172.21.15.97:0/900681504":"2021-10-09T19:17:10.051948+0000","172.21.15.97:0/3932251406":"2021-10-09T19:17:10.051948+0000","172.21.15.97:0/398006785":"2021-10-09T19:16:48.651177+0000","172.21.15.97:0/1642570050":"2021-10-09T19:16:48.651177+0000","172.21.15.97:0/300178790":"2021-10-09T19:16:48.651177+0000","172.21.15.97:6800/845999767":"2021-10-09T19:16:48.651177+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-10-08T19:22:21.057 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2021-10-08T19:22:21.058 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd dump --format=json 2021-10-08T19:22:21.219 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:20 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:22:21.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:20 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:22:21.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:20 smithi097 ceph-mon[41966]: 172.21.15.97 - - [08/Oct/2021:19:22:19] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:21.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:20 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/366516509' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-10-08T19:22:21.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:20 smithi097 ceph-mon[41966]: osdmap e82: 8 total, 8 up, 8 in 2021-10-08T19:22:21.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:20 smithi097 ceph-mon[41966]: pgmap v31: 132 pgs: 132 active+clean; 582 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:22:21.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:20 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:22:21.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:20 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:22:21.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:20 smithi097 ceph-mon[32687]: 172.21.15.97 - - [08/Oct/2021:19:22:19] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:21.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:20 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/366516509' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-10-08T19:22:21.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:20 smithi097 ceph-mon[32687]: osdmap e82: 8 total, 8 up, 8 in 2021-10-08T19:22:21.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:20 smithi097 ceph-mon[32687]: pgmap v31: 132 pgs: 132 active+clean; 582 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:22:21.328 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:22:21.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:20 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:22:21.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:20 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:22:21.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:20 smithi117 ceph-mon[34585]: 172.21.15.97 - - [08/Oct/2021:19:22:19] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:21.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:20 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/366516509' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-10-08T19:22:21.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:20 smithi117 ceph-mon[34585]: osdmap e82: 8 total, 8 up, 8 in 2021-10-08T19:22:21.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:20 smithi117 ceph-mon[34585]: pgmap v31: 132 pgs: 132 active+clean; 582 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:22:23.075 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:22:23.076 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":82,"fsid":"1d01f6d6-286c-11ec-8c25-001a4aab830c","created":"2021-10-08T19:16:25.258003+0000","modified":"2021-10-08T19:22:20.403346+0000","last_up_change":"2021-10-08T19:21:15.388758+0000","last_in_change":"2021-10-08T19:20:59.507952+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2021-10-08T19:19:44.413311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":".rgw.root","create_time":"2021-10-08T19:21:21.940881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":3,"pool_name":"iscsi","create_time":"2021-10-08T19:21:22.536945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"default.rgw.log","create_time":"2021-10-08T19:21:23.886328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":5,"pool_name":"default.rgw.control","create_time":"2021-10-08T19:21:25.865032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2021-10-08T19:21:27.940767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":8},"application_metadata":{"rgw":{}}}],"osds":[{"osd":0,"uuid":"9e64e714-a5d5-4fbb-ae2b-1df4bf14b8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6801","nonce":3354161282}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6802","nonce":3354161282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6804","nonce":3354161282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6803","nonce":3354161282}]},"public_addr":"172.21.15.97:6801/3354161282","cluster_addr":"172.21.15.97:6802/3354161282","heartbeat_back_addr":"172.21.15.97:6804/3354161282","heartbeat_front_addr":"172.21.15.97:6803/3354161282","state":["exists","up"]},{"osd":1,"uuid":"32602a22-f263-4b62-a8d8-50fddfb73fa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6805","nonce":735799205}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6806","nonce":735799205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6808","nonce":735799205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6807","nonce":735799205}]},"public_addr":"172.21.15.97:6805/735799205","cluster_addr":"172.21.15.97:6806/735799205","heartbeat_back_addr":"172.21.15.97:6808/735799205","heartbeat_front_addr":"172.21.15.97:6807/735799205","state":["exists","up"]},{"osd":2,"uuid":"88e0e4a2-b4a3-4a00-8669-03c3d9b166c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6809","nonce":2366482649}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6810","nonce":2366482649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6812","nonce":2366482649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6811","nonce":2366482649}]},"public_addr":"172.21.15.97:6809/2366482649","cluster_addr":"172.21.15.97:6810/2366482649","heartbeat_back_addr":"172.21.15.97:6812/2366482649","heartbeat_front_addr":"172.21.15.97:6811/2366482649","state":["exists","up"]},{"osd":3,"uuid":"e689d708-b501-4526-a31a-1e598b74654d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6813","nonce":3191181122}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6814","nonce":3191181122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6816","nonce":3191181122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6815","nonce":3191181122}]},"public_addr":"172.21.15.97:6813/3191181122","cluster_addr":"172.21.15.97:6814/3191181122","heartbeat_back_addr":"172.21.15.97:6816/3191181122","heartbeat_front_addr":"172.21.15.97:6815/3191181122","state":["exists","up"]},{"osd":4,"uuid":"67e4730a-be1c-4d88-9307-e3c2cf3ab2ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6800","nonce":106778208}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6801","nonce":106778208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6803","nonce":106778208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6802","nonce":106778208}]},"public_addr":"172.21.15.117:6800/106778208","cluster_addr":"172.21.15.117:6801/106778208","heartbeat_back_addr":"172.21.15.117:6803/106778208","heartbeat_front_addr":"172.21.15.117:6802/106778208","state":["exists","up"]},{"osd":5,"uuid":"f9fd3153-3e4e-4489-8927-a65641f05d42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6804","nonce":3199889891}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6805","nonce":3199889891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6807","nonce":3199889891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6806","nonce":3199889891}]},"public_addr":"172.21.15.117:6804/3199889891","cluster_addr":"172.21.15.117:6805/3199889891","heartbeat_back_addr":"172.21.15.117:6807/3199889891","heartbeat_front_addr":"172.21.15.117:6806/3199889891","state":["exists","up"]},{"osd":6,"uuid":"84898f12-c37d-4eb6-8b71-5b86bfe16e7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6808","nonce":2185843951}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6809","nonce":2185843951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6811","nonce":2185843951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6810","nonce":2185843951}]},"public_addr":"172.21.15.117:6808/2185843951","cluster_addr":"172.21.15.117:6809/2185843951","heartbeat_back_addr":"172.21.15.117:6811/2185843951","heartbeat_front_addr":"172.21.15.117:6810/2185843951","state":["exists","up"]},{"osd":7,"uuid":"529af2ce-2ae9-41ed-8c8e-d133628cfd20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6812","nonce":2817683239}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6813","nonce":2817683239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6815","nonce":2817683239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6814","nonce":2817683239}]},"public_addr":"172.21.15.117:6812/2817683239","cluster_addr":"172.21.15.117:6813/2817683239","heartbeat_back_addr":"172.21.15.117:6815/2817683239","heartbeat_front_addr":"172.21.15.117:6814/2817683239","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:21:39.273521+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:22:09.999346+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:22:14.613055+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:22:15.713666+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:21:28.104529+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:21:54.066870+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:22:02.264002+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:21:13.885684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.97:0/2600364788":"2021-10-09T19:21:42.325540+0000","172.21.15.97:0/4129083289":"2021-10-09T19:21:42.325540+0000","172.21.15.97:0/1443158975":"2021-10-09T19:21:42.325540+0000","172.21.15.97:0/2472640384":"2021-10-09T19:21:42.325540+0000","172.21.15.97:0/3196919488":"2021-10-09T19:21:42.325540+0000","172.21.15.97:6800/3195862546":"2021-10-09T19:21:42.325540+0000","172.21.15.97:6800/3931202434":"2021-10-09T19:17:10.051948+0000","172.21.15.97:0/2761595213":"2021-10-09T19:17:10.051948+0000","172.21.15.97:0/900681504":"2021-10-09T19:17:10.051948+0000","172.21.15.97:0/3932251406":"2021-10-09T19:17:10.051948+0000","172.21.15.97:0/398006785":"2021-10-09T19:16:48.651177+0000","172.21.15.97:0/1642570050":"2021-10-09T19:16:48.651177+0000","172.21.15.97:0/300178790":"2021-10-09T19:16:48.651177+0000","172.21.15.97:6800/845999767":"2021-10-09T19:16:48.651177+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-10-08T19:22:23.642 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph tell osd.0 flush_pg_stats 2021-10-08T19:22:23.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:23 smithi117 ceph-mon[34585]: pgmap v32: 132 pgs: 132 active+clean; 582 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 723 B/s rd, 0 op/s 2021-10-08T19:22:23.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:23 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2907600225' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-10-08T19:22:23.914 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:22:23.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:23 smithi097 ceph-mon[32687]: pgmap v32: 132 pgs: 132 active+clean; 582 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 723 B/s rd, 0 op/s 2021-10-08T19:22:23.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:23 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2907600225' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-10-08T19:22:23.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:23 smithi097 ceph-mon[41966]: pgmap v32: 132 pgs: 132 active+clean; 582 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 723 B/s rd, 0 op/s 2021-10-08T19:22:23.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:23 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2907600225' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-10-08T19:22:25.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:25 smithi117 ceph-mon[34585]: 2.10 scrub ok 2021-10-08T19:22:25.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:25 smithi117 ceph-mon[34585]: pgmap v33: 132 pgs: 132 active+clean; 582 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:22:25.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:25 smithi117 ceph-mon[34585]: 2.13 scrub ok 2021-10-08T19:22:25.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:25 smithi097 ceph-mon[32687]: 2.10 scrub ok 2021-10-08T19:22:25.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:25 smithi097 ceph-mon[32687]: pgmap v33: 132 pgs: 132 active+clean; 582 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:22:25.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:25 smithi097 ceph-mon[32687]: 2.13 scrub ok 2021-10-08T19:22:25.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:25 smithi097 ceph-mon[41966]: 2.10 scrub ok 2021-10-08T19:22:25.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:25 smithi097 ceph-mon[41966]: pgmap v33: 132 pgs: 132 active+clean; 582 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:22:25.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:25 smithi097 ceph-mon[41966]: 2.13 scrub ok 2021-10-08T19:22:26.125 INFO:teuthology.orchestra.run.smithi097.stdout:34359738410 2021-10-08T19:22:26.126 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph tell osd.1 flush_pg_stats 2021-10-08T19:22:26.401 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:22:26.449 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:22:26 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:22:26.905 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:22:26 smithi117 systemd[1]: Starting Ceph prometheus.a for 1d01f6d6-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:22:27.617 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:27 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:22:27.617 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:27 smithi117 ceph-mon[34585]: poll took 13593.017 ms: 1 events 2021-10-08T19:22:27.618 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:27 smithi117 ceph-mon[34585]: 4.1 scrub ok 2021-10-08T19:22:27.618 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:27 smithi117 ceph-mon[34585]: pgmap v34: 132 pgs: 132 active+clean; 582 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:22:27.618 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:27 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:22:27.618 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:22:27 smithi117 conmon[64056]: level=info ts=2021-10-08T19:22:27.280Z caller=main.go:302 msg="No time or size retention was set so using the default time retention" duration=15d 2021-10-08T19:22:27.619 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:22:27 smithi117 conmon[64056]: level=info ts=2021-10-08T19:22:27.280Z caller=main.go:337 msg="Starting Prometheus" version="(version=2.18.1, branch=HEAD, revision=ecee9c8abfd118f139014cb1b174b08db3f342cf)" 2021-10-08T19:22:27.619 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:22:27 smithi117 conmon[64056]: level=info ts=2021-10-08T19:22:27.281Z caller=main.go:338 build_context="(go=go1.14.2, user=root@2117a9e64a7e, date=20200507-16:51:47)" 2021-10-08T19:22:27.619 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:22:27 smithi117 conmon[64056]: level=info ts=2021-10-08T19:22:27.281Z caller=main.go:339 host_details="(Linux 4.18.0-305.19.1.el8_4.x86_64 #1 SMP Wed Sep 15 15:39:39 UTC 2021 x86_64 smithi117 (none))" 2021-10-08T19:22:27.619 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:22:27 smithi117 conmon[64056]: level=info ts=2021-10-08T19:22:27.281Z caller=main.go:340 fd_limits="(soft=1048576, hard=1048576)" 2021-10-08T19:22:27.620 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:22:27 smithi117 conmon[64056]: level=info ts=2021-10-08T19:22:27.281Z caller=main.go:341 vm_limits="(soft=unlimited, hard=unlimited)" 2021-10-08T19:22:27.620 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:22:27 smithi117 conmon[64056]: level=info ts=2021-10-08T19:22:27.282Z caller=main.go:678 msg="Starting TSDB ..." 2021-10-08T19:22:27.620 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:22:27 smithi117 conmon[64056]: level=info ts=2021-10-08T19:22:27.282Z caller=web.go:523 component=web msg="Start listening for connections" address=:9095 2021-10-08T19:22:27.620 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:22:27 smithi117 conmon[64056]: level=info ts=2021-10-08T19:22:27.284Z caller=head.go:575 component=tsdb msg="Replaying WAL, this may take awhile" 2021-10-08T19:22:27.620 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:22:27 smithi117 conmon[64056]: level=info ts=2021-10-08T19:22:27.284Z caller=head.go:624 component=tsdb msg="WAL segment loaded" segment=0 maxSegment=0 2021-10-08T19:22:27.621 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:22:27 smithi117 conmon[64056]: level=info ts=2021-10-08T19:22:27.284Z caller=head.go:627 component=tsdb msg="WAL replay completed" duration=128.086µs 2021-10-08T19:22:27.621 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:22:27 smithi117 bash[63869]: 578d13891bab8a9a49800665a3727a9c64c5964685c855df750df4aa561e3d38 2021-10-08T19:22:27.621 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:22:27 smithi117 conmon[64056]: level=info ts=2021-10-08T19:22:27.285Z caller=main.go:694 fs_type=XFS_SUPER_MAGIC 2021-10-08T19:22:27.622 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:22:27 smithi117 conmon[64056]: level=info ts=2021-10-08T19:22:27.285Z caller=main.go:695 msg="TSDB started" 2021-10-08T19:22:27.622 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:22:27 smithi117 conmon[64056]: level=info ts=2021-10-08T19:22:27.285Z caller=main.go:799 msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2021-10-08T19:22:27.622 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:22:27 smithi117 systemd[1]: Started Ceph prometheus.a for 1d01f6d6-286c-11ec-8c25-001a4aab830c. 2021-10-08T19:22:27.623 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:22:27 smithi117 conmon[64056]: level=info ts=2021-10-08T19:22:27.291Z caller=main.go:827 msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml 2021-10-08T19:22:27.623 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:22:27 smithi117 conmon[64056]: level=info ts=2021-10-08T19:22:27.291Z caller=main.go:646 msg="Server is ready to receive web requests." 2021-10-08T19:22:27.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:27 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:22:27.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:27 smithi097 ceph-mon[32687]: poll took 13593.017 ms: 1 events 2021-10-08T19:22:27.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:27 smithi097 ceph-mon[32687]: 4.1 scrub ok 2021-10-08T19:22:27.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:27 smithi097 ceph-mon[32687]: pgmap v34: 132 pgs: 132 active+clean; 582 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:22:27.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:27 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:22:27.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:27 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:22:27.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:27 smithi097 ceph-mon[41966]: poll took 13593.017 ms: 1 events 2021-10-08T19:22:27.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:27 smithi097 ceph-mon[41966]: 4.1 scrub ok 2021-10-08T19:22:27.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:27 smithi097 ceph-mon[41966]: pgmap v34: 132 pgs: 132 active+clean; 582 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:22:27.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:27 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:22:28.655 INFO:teuthology.orchestra.run.smithi097.stdout:55834574887 2021-10-08T19:22:28.656 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph tell osd.2 flush_pg_stats 2021-10-08T19:22:28.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:28 smithi117 ceph-mon[34585]: 2.5 scrub ok 2021-10-08T19:22:28.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:28 smithi117 ceph-mon[34585]: 2.9 scrub ok 2021-10-08T19:22:28.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:28 smithi117 ceph-mon[34585]: poll took 1040.621 ms: 1 events 2021-10-08T19:22:28.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:28 smithi117 ceph-mon[34585]: Sending message to agent on host smithi117 2021-10-08T19:22:28.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:28 smithi117 ceph-mon[34585]: Deploying daemon alertmanager.a on smithi097 2021-10-08T19:22:28.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:28 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:22:28.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:28 smithi117 ceph-mon[34585]: 4.1e scrub ok 2021-10-08T19:22:28.921 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:22:28.969 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:28 smithi097 ceph-mon[41966]: 2.5 scrub ok 2021-10-08T19:22:28.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:28 smithi097 ceph-mon[41966]: 2.9 scrub ok 2021-10-08T19:22:28.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:28 smithi097 ceph-mon[41966]: poll took 1040.621 ms: 1 events 2021-10-08T19:22:28.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:28 smithi097 ceph-mon[41966]: Sending message to agent on host smithi117 2021-10-08T19:22:28.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:28 smithi097 ceph-mon[41966]: Deploying daemon alertmanager.a on smithi097 2021-10-08T19:22:28.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:28 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:22:28.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:28 smithi097 ceph-mon[41966]: 4.1e scrub ok 2021-10-08T19:22:28.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:28 smithi097 ceph-mon[32687]: 2.5 scrub ok 2021-10-08T19:22:28.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:28 smithi097 ceph-mon[32687]: 2.9 scrub ok 2021-10-08T19:22:28.974 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:28 smithi097 ceph-mon[32687]: poll took 1040.621 ms: 1 events 2021-10-08T19:22:28.974 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:28 smithi097 ceph-mon[32687]: Sending message to agent on host smithi117 2021-10-08T19:22:28.974 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:28 smithi097 ceph-mon[32687]: Deploying daemon alertmanager.a on smithi097 2021-10-08T19:22:28.975 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:28 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:22:28.975 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:28 smithi097 ceph-mon[32687]: 4.1e scrub ok 2021-10-08T19:22:29.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:29 smithi097 ceph-mon[32687]: Received "ACK" from agent on host smithi117 2021-10-08T19:22:29.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:29 smithi097 ceph-mon[32687]: pgmap v35: 132 pgs: 132 active+clean; 582 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2021-10-08T19:22:29.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:29 smithi097 ceph-mon[32687]: 5.15 scrub ok 2021-10-08T19:22:29.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:29 smithi097 ceph-mon[41966]: Received "ACK" from agent on host smithi117 2021-10-08T19:22:29.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:29 smithi097 ceph-mon[41966]: pgmap v35: 132 pgs: 132 active+clean; 582 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2021-10-08T19:22:29.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:29 smithi097 ceph-mon[41966]: 5.15 scrub ok 2021-10-08T19:22:29.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:29 smithi117 ceph-mon[34585]: Received "ACK" from agent on host smithi117 2021-10-08T19:22:29.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:29 smithi117 ceph-mon[34585]: pgmap v35: 132 pgs: 132 active+clean; 582 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2021-10-08T19:22:29.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:29 smithi117 ceph-mon[34585]: 5.15 scrub ok 2021-10-08T19:22:30.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:30 smithi097 ceph-mon[32687]: 2.a scrub ok 2021-10-08T19:22:30.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:30 smithi097 ceph-mon[32687]: 4.3 scrub ok 2021-10-08T19:22:30.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:30 smithi097 ceph-mon[41966]: 2.a scrub ok 2021-10-08T19:22:30.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:30 smithi097 ceph-mon[41966]: 4.3 scrub ok 2021-10-08T19:22:30.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:30 smithi117 ceph-mon[34585]: 2.a scrub ok 2021-10-08T19:22:30.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:30 smithi117 ceph-mon[34585]: 4.3 scrub ok 2021-10-08T19:22:31.414 INFO:teuthology.orchestra.run.smithi097.stdout:77309411363 2021-10-08T19:22:31.415 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph tell osd.3 flush_pg_stats 2021-10-08T19:22:31.701 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:22:31.719 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:31 smithi097 ceph-mon[41966]: 2.8 scrub ok 2021-10-08T19:22:31.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:31 smithi097 ceph-mon[41966]: pgmap v36: 132 pgs: 132 active+clean; 582 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 1021 B/s rd, 0 op/s 2021-10-08T19:22:31.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:31 smithi097 ceph-mon[32687]: 2.8 scrub ok 2021-10-08T19:22:31.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:31 smithi097 ceph-mon[32687]: pgmap v36: 132 pgs: 132 active+clean; 582 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 1021 B/s rd, 0 op/s 2021-10-08T19:22:31.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:31 smithi117 ceph-mon[34585]: 2.8 scrub ok 2021-10-08T19:22:31.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:31 smithi117 ceph-mon[34585]: pgmap v36: 132 pgs: 132 active+clean; 582 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 1021 B/s rd, 0 op/s 2021-10-08T19:22:32.219 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:22:31 smithi097 conmon[33110]: 172.21.15.117 - - [08/Oct/2021:19:22:31] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:32.511 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:32 smithi097 ceph-mon[32687]: 2.17 scrub ok 2021-10-08T19:22:32.512 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:32 smithi097 ceph-mon[32687]: 3.1 scrub ok 2021-10-08T19:22:32.512 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:32 smithi097 ceph-mon[32687]: Received old metadata from agent on host smithi117. Requested up-to-date metadata. 2021-10-08T19:22:32.512 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:32 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:22:32.512 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:32 smithi097 ceph-mon[32687]: 172.21.15.117 - - [08/Oct/2021:19:22:31] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:32.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:32 smithi117 ceph-mon[34585]: 2.17 scrub ok 2021-10-08T19:22:32.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:32 smithi117 ceph-mon[34585]: 3.1 scrub ok 2021-10-08T19:22:32.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:32 smithi117 ceph-mon[34585]: Received old metadata from agent on host smithi117. Requested up-to-date metadata. 2021-10-08T19:22:32.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:32 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:22:32.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:32 smithi117 ceph-mon[34585]: 172.21.15.117 - - [08/Oct/2021:19:22:31] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:32.969 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:22:32 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:22:32] "GET /metrics HTTP/1.1" 200 153740 "" "Prometheus/2.18.1" 2021-10-08T19:22:32.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:32 smithi097 ceph-mon[41966]: 2.17 scrub ok 2021-10-08T19:22:32.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:32 smithi097 ceph-mon[41966]: 3.1 scrub ok 2021-10-08T19:22:32.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:32 smithi097 ceph-mon[41966]: Received old metadata from agent on host smithi117. Requested up-to-date metadata. 2021-10-08T19:22:32.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:32 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:22:32.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:32 smithi097 ceph-mon[41966]: 172.21.15.117 - - [08/Oct/2021:19:22:31] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:34.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:22:33 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:22:33] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:22:34.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:33 smithi117 ceph-mon[34585]: 5.14 scrub ok 2021-10-08T19:22:34.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:33 smithi117 ceph-mon[34585]: pgmap v37: 132 pgs: 132 active+clean; 582 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:22:34.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:33 smithi117 ceph-mon[34585]: 5.3 scrub ok 2021-10-08T19:22:34.219 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:33 smithi097 ceph-mon[41966]: 5.14 scrub ok 2021-10-08T19:22:34.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:33 smithi097 ceph-mon[41966]: pgmap v37: 132 pgs: 132 active+clean; 582 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:22:34.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:33 smithi097 ceph-mon[41966]: 5.3 scrub ok 2021-10-08T19:22:34.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:33 smithi097 ceph-mon[32687]: 5.14 scrub ok 2021-10-08T19:22:34.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:33 smithi097 ceph-mon[32687]: pgmap v37: 132 pgs: 132 active+clean; 582 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:22:34.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:33 smithi097 ceph-mon[32687]: 5.3 scrub ok 2021-10-08T19:22:35.151 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:34 smithi097 ceph-mon[32687]: 2.0 deep-scrub ok 2021-10-08T19:22:35.152 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:34 smithi097 ceph-mon[32687]: 4.13 scrub ok 2021-10-08T19:22:35.152 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:34 smithi097 ceph-mon[32687]: 6.1b scrub ok 2021-10-08T19:22:35.152 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:34 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:22:35.152 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:34 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:22:35.153 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:34 smithi097 ceph-mon[32687]: osdmap e83: 8 total, 8 up, 8 in 2021-10-08T19:22:35.153 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:34 smithi097 ceph-mon[32687]: 2.e scrub ok 2021-10-08T19:22:35.153 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:34 smithi097 ceph-mon[41966]: 2.0 deep-scrub ok 2021-10-08T19:22:35.154 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:34 smithi097 ceph-mon[41966]: 4.13 scrub ok 2021-10-08T19:22:35.154 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:34 smithi097 ceph-mon[41966]: 6.1b scrub ok 2021-10-08T19:22:35.154 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:34 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:22:35.154 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:34 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:22:35.154 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:34 smithi097 ceph-mon[41966]: osdmap e83: 8 total, 8 up, 8 in 2021-10-08T19:22:35.155 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:34 smithi097 ceph-mon[41966]: 2.e scrub ok 2021-10-08T19:22:35.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:34 smithi117 ceph-mon[34585]: 2.0 deep-scrub ok 2021-10-08T19:22:35.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:34 smithi117 ceph-mon[34585]: 4.13 scrub ok 2021-10-08T19:22:35.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:34 smithi117 ceph-mon[34585]: 6.1b scrub ok 2021-10-08T19:22:35.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:34 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:22:35.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:34 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:22:35.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:34 smithi117 ceph-mon[34585]: osdmap e83: 8 total, 8 up, 8 in 2021-10-08T19:22:35.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:34 smithi117 ceph-mon[34585]: 2.e scrub ok 2021-10-08T19:22:36.155 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:22:36 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:22:36.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:35 smithi117 ceph-mon[34585]: 2.1d scrub ok 2021-10-08T19:22:36.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:35 smithi117 ceph-mon[34585]: 5.18 scrub ok 2021-10-08T19:22:36.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:35 smithi117 ceph-mon[34585]: pgmap v39: 132 pgs: 132 active+clean; 582 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:22:36.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:35 smithi117 ceph-mon[34585]: 4.10 scrub ok 2021-10-08T19:22:36.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:35 smithi117 ceph-mon[34585]: 5.7 scrub ok 2021-10-08T19:22:36.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:35 smithi117 ceph-mon[34585]: 2.11 scrub ok 2021-10-08T19:22:36.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:35 smithi117 ceph-mon[34585]: osdmap e84: 8 total, 8 up, 8 in 2021-10-08T19:22:36.219 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:35 smithi097 ceph-mon[32687]: 2.1d scrub ok 2021-10-08T19:22:36.219 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:35 smithi097 ceph-mon[32687]: 5.18 scrub ok 2021-10-08T19:22:36.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:35 smithi097 ceph-mon[32687]: pgmap v39: 132 pgs: 132 active+clean; 582 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:22:36.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:35 smithi097 ceph-mon[32687]: 4.10 scrub ok 2021-10-08T19:22:36.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:35 smithi097 ceph-mon[32687]: 5.7 scrub ok 2021-10-08T19:22:36.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:35 smithi097 ceph-mon[32687]: 2.11 scrub ok 2021-10-08T19:22:36.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:35 smithi097 ceph-mon[32687]: osdmap e84: 8 total, 8 up, 8 in 2021-10-08T19:22:36.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:35 smithi097 ceph-mon[41966]: 2.1d scrub ok 2021-10-08T19:22:36.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:35 smithi097 ceph-mon[41966]: 5.18 scrub ok 2021-10-08T19:22:36.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:35 smithi097 ceph-mon[41966]: pgmap v39: 132 pgs: 132 active+clean; 582 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:22:36.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:35 smithi097 ceph-mon[41966]: 4.10 scrub ok 2021-10-08T19:22:36.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:35 smithi097 ceph-mon[41966]: 5.7 scrub ok 2021-10-08T19:22:36.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:35 smithi097 ceph-mon[41966]: 2.11 scrub ok 2021-10-08T19:22:36.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:35 smithi097 ceph-mon[41966]: osdmap e84: 8 total, 8 up, 8 in 2021-10-08T19:22:36.923 INFO:teuthology.orchestra.run.smithi097.stdout:103079215138 2021-10-08T19:22:36.924 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph tell osd.4 flush_pg_stats 2021-10-08T19:22:37.177 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:36 smithi097 ceph-mon[32687]: 5.c scrub ok 2021-10-08T19:22:37.177 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:36 smithi097 ceph-mon[32687]: 4.c scrub ok 2021-10-08T19:22:37.178 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:36 smithi097 ceph-mon[41966]: 5.c scrub ok 2021-10-08T19:22:37.178 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:36 smithi097 ceph-mon[41966]: 4.c scrub ok 2021-10-08T19:22:37.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:36 smithi117 ceph-mon[34585]: 5.c scrub ok 2021-10-08T19:22:37.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:36 smithi117 ceph-mon[34585]: 4.c scrub ok 2021-10-08T19:22:37.459 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:22:37.719 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:22:37 smithi097 conmon[33110]: 172.21.15.117 - - [08/Oct/2021:19:22:37] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:38.219 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:37 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:22:38.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:37 smithi097 ceph-mon[41966]: pgmap v41: 132 pgs: 132 active+clean; 582 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2021-10-08T19:22:38.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:37 smithi097 ceph-mon[41966]: 5.17 scrub ok 2021-10-08T19:22:38.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:37 smithi097 ceph-mon[41966]: 4.b scrub ok 2021-10-08T19:22:38.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:37 smithi097 ceph-mon[41966]: 6.15 scrub ok 2021-10-08T19:22:38.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:37 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:22:38.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:37 smithi097 ceph-mon[41966]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:22:38.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:37 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:22:38.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:37 smithi097 ceph-mon[41966]: 172.21.15.117 - - [08/Oct/2021:19:22:37] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:38.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:37 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:22:38.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:37 smithi097 ceph-mon[32687]: pgmap v41: 132 pgs: 132 active+clean; 582 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2021-10-08T19:22:38.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:37 smithi097 ceph-mon[32687]: 5.17 scrub ok 2021-10-08T19:22:38.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:37 smithi097 ceph-mon[32687]: 4.b scrub ok 2021-10-08T19:22:38.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:37 smithi097 ceph-mon[32687]: 6.15 scrub ok 2021-10-08T19:22:38.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:37 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:22:38.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:37 smithi097 ceph-mon[32687]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:22:38.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:37 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:22:38.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:37 smithi097 ceph-mon[32687]: 172.21.15.117 - - [08/Oct/2021:19:22:37] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:38.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:37 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:22:38.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:37 smithi117 ceph-mon[34585]: pgmap v41: 132 pgs: 132 active+clean; 582 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2021-10-08T19:22:38.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:37 smithi117 ceph-mon[34585]: 5.17 scrub ok 2021-10-08T19:22:38.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:37 smithi117 ceph-mon[34585]: 4.b scrub ok 2021-10-08T19:22:38.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:37 smithi117 ceph-mon[34585]: 6.15 scrub ok 2021-10-08T19:22:38.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:37 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:22:38.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:37 smithi117 ceph-mon[34585]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:22:38.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:37 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:22:38.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:37 smithi117 ceph-mon[34585]: 172.21.15.117 - - [08/Oct/2021:19:22:37] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:38.667 INFO:journalctl@ceph.alertmanager.a.smithi097.stdout:Oct 08 19:22:38 smithi097 systemd[1]: Starting Ceph alertmanager.a for 1d01f6d6-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:22:38.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:38 smithi097 ceph-mon[32687]: 6.e scrub ok 2021-10-08T19:22:38.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:38 smithi097 ceph-mon[32687]: poll took 10323.211 ms: 1 events 2021-10-08T19:22:38.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:38 smithi097 ceph-mon[32687]: pgmap v42: 132 pgs: 132 active+clean; 582 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:22:38.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:38 smithi097 ceph-mon[41966]: 6.e scrub ok 2021-10-08T19:22:38.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:38 smithi097 ceph-mon[41966]: poll took 10323.211 ms: 1 events 2021-10-08T19:22:38.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:38 smithi097 ceph-mon[41966]: pgmap v42: 132 pgs: 132 active+clean; 582 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:22:39.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:38 smithi117 ceph-mon[34585]: 6.e scrub ok 2021-10-08T19:22:39.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:38 smithi117 ceph-mon[34585]: poll took 10323.211 ms: 1 events 2021-10-08T19:22:39.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:38 smithi117 ceph-mon[34585]: pgmap v42: 132 pgs: 132 active+clean; 582 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:22:39.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:39 smithi097 ceph-mon[41966]: 6.1f deep-scrub ok 2021-10-08T19:22:39.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:39 smithi097 ceph-mon[41966]: 4.a scrub ok 2021-10-08T19:22:39.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:39 smithi097 ceph-mon[41966]: poll took 1592.521 ms: 1 events 2021-10-08T19:22:39.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:39 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:22:39.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:39 smithi097 ceph-mon[41966]: Sending message to agent on host smithi097 2021-10-08T19:22:39.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:39 smithi097 ceph-mon[32687]: 6.1f deep-scrub ok 2021-10-08T19:22:39.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:39 smithi097 ceph-mon[32687]: 4.a scrub ok 2021-10-08T19:22:39.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:39 smithi097 ceph-mon[32687]: poll took 1592.521 ms: 1 events 2021-10-08T19:22:39.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:39 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:22:39.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:39 smithi097 ceph-mon[32687]: Sending message to agent on host smithi097 2021-10-08T19:22:39.973 INFO:journalctl@ceph.alertmanager.a.smithi097.stdout:Oct 08 19:22:39 smithi097 conmon[76566]: level=info ts=2021-10-08T19:22:39.667Z caller=main.go:231 msg="Starting Alertmanager" version="(version=0.20.0, branch=HEAD, revision=f74be0400a6243d10bb53812d6fa408ad71ff32d)" 2021-10-08T19:22:39.973 INFO:journalctl@ceph.alertmanager.a.smithi097.stdout:Oct 08 19:22:39 smithi097 conmon[76566]: level=info ts=2021-10-08T19:22:39.667Z caller=main.go:232 build_context="(go=go1.13.5, user=root@00c3106655f8, date=20191211-14:13:14)" 2021-10-08T19:22:39.973 INFO:journalctl@ceph.alertmanager.a.smithi097.stdout:Oct 08 19:22:39 smithi097 conmon[76566]: level=info ts=2021-10-08T19:22:39.668Z caller=cluster.go:161 component=cluster msg="setting advertise address explicitly" addr=172.21.15.97 port=9094 2021-10-08T19:22:39.973 INFO:journalctl@ceph.alertmanager.a.smithi097.stdout:Oct 08 19:22:39 smithi097 conmon[76566]: level=info ts=2021-10-08T19:22:39.669Z caller=cluster.go:623 component=cluster msg="Waiting for gossip to settle..." interval=2s 2021-10-08T19:22:39.973 INFO:journalctl@ceph.alertmanager.a.smithi097.stdout:Oct 08 19:22:39 smithi097 bash[76321]: 5098b7584b5703fb18cff65e8794d38614e327db9d98c2ae8f6997f418ec0f74 2021-10-08T19:22:39.974 INFO:journalctl@ceph.alertmanager.a.smithi097.stdout:Oct 08 19:22:39 smithi097 systemd[1]: Started Ceph alertmanager.a for 1d01f6d6-286c-11ec-8c25-001a4aab830c. 2021-10-08T19:22:39.974 INFO:journalctl@ceph.alertmanager.a.smithi097.stdout:Oct 08 19:22:39 smithi097 conmon[76566]: level=info ts=2021-10-08T19:22:39.691Z caller=coordinator.go:119 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2021-10-08T19:22:39.974 INFO:journalctl@ceph.alertmanager.a.smithi097.stdout:Oct 08 19:22:39 smithi097 conmon[76566]: level=info ts=2021-10-08T19:22:39.691Z caller=coordinator.go:131 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2021-10-08T19:22:39.974 INFO:journalctl@ceph.alertmanager.a.smithi097.stdout:Oct 08 19:22:39 smithi097 conmon[76566]: level=info ts=2021-10-08T19:22:39.694Z caller=main.go:497 msg=Listening address=:9093 2021-10-08T19:22:40.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:39 smithi117 ceph-mon[34585]: 6.1f deep-scrub ok 2021-10-08T19:22:40.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:39 smithi117 ceph-mon[34585]: 4.a scrub ok 2021-10-08T19:22:40.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:39 smithi117 ceph-mon[34585]: poll took 1592.521 ms: 1 events 2021-10-08T19:22:40.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:39 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:22:40.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:39 smithi117 ceph-mon[34585]: Sending message to agent on host smithi097 2021-10-08T19:22:40.703 INFO:teuthology.orchestra.run.smithi097.stdout:128849018911 2021-10-08T19:22:40.704 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph tell osd.5 flush_pg_stats 2021-10-08T19:22:41.219 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:40 smithi097 ceph-mon[32687]: 2.4 scrub ok 2021-10-08T19:22:41.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:40 smithi097 ceph-mon[32687]: Received "ACK" from agent on host smithi097 2021-10-08T19:22:41.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:40 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:22:41.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:40 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:22:41.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:40 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2021-10-08T19:22:41.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:40 smithi097 ceph-mon[32687]: from='mon.0 v1:172.21.15.97:0/1599861082' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2021-10-08T19:22:41.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:40 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:22:41.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:40 smithi097 ceph-mon[32687]: Deploying daemon grafana.a on smithi117 2021-10-08T19:22:41.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:40 smithi097 ceph-mon[32687]: 6.14 scrub ok 2021-10-08T19:22:41.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:40 smithi097 ceph-mon[32687]: pgmap v43: 132 pgs: 132 active+clean; 582 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:22:41.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:40 smithi097 ceph-mon[41966]: 2.4 scrub ok 2021-10-08T19:22:41.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:40 smithi097 ceph-mon[41966]: Received "ACK" from agent on host smithi097 2021-10-08T19:22:41.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:40 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:22:41.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:40 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:22:41.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:40 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2021-10-08T19:22:41.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:40 smithi097 ceph-mon[41966]: from='mon.0 v1:172.21.15.97:0/1599861082' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2021-10-08T19:22:41.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:40 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:22:41.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:40 smithi097 ceph-mon[41966]: Deploying daemon grafana.a on smithi117 2021-10-08T19:22:41.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:40 smithi097 ceph-mon[41966]: 6.14 scrub ok 2021-10-08T19:22:41.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:40 smithi097 ceph-mon[41966]: pgmap v43: 132 pgs: 132 active+clean; 582 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:22:41.394 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:22:41.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:40 smithi117 ceph-mon[34585]: 2.4 scrub ok 2021-10-08T19:22:41.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:40 smithi117 ceph-mon[34585]: Received "ACK" from agent on host smithi097 2021-10-08T19:22:41.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:40 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:22:41.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:40 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:22:41.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:40 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2021-10-08T19:22:41.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:40 smithi117 ceph-mon[34585]: from='mon.0 v1:172.21.15.97:0/1599861082' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2021-10-08T19:22:41.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:40 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:22:41.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:40 smithi117 ceph-mon[34585]: Deploying daemon grafana.a on smithi117 2021-10-08T19:22:41.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:40 smithi117 ceph-mon[34585]: 6.14 scrub ok 2021-10-08T19:22:41.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:40 smithi117 ceph-mon[34585]: pgmap v43: 132 pgs: 132 active+clean; 582 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:22:41.881 INFO:journalctl@ceph.alertmanager.a.smithi097.stdout:Oct 08 19:22:41 smithi097 conmon[76566]: level=info ts=2021-10-08T19:22:41.669Z caller=cluster.go:648 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000101797s 2021-10-08T19:22:42.165 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:41 smithi097 ceph-mon[41966]: 4.4 scrub ok 2021-10-08T19:22:42.166 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:41 smithi097 ceph-mon[41966]: 6.2 scrub ok 2021-10-08T19:22:42.166 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:41 smithi097 ceph-mon[41966]: 3.2 scrub ok 2021-10-08T19:22:42.166 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:41 smithi097 ceph-mon[32687]: 4.4 scrub ok 2021-10-08T19:22:42.166 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:41 smithi097 ceph-mon[32687]: 6.2 scrub ok 2021-10-08T19:22:42.167 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:41 smithi097 ceph-mon[32687]: 3.2 scrub ok 2021-10-08T19:22:42.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:41 smithi117 ceph-mon[34585]: 4.4 scrub ok 2021-10-08T19:22:42.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:41 smithi117 ceph-mon[34585]: 6.2 scrub ok 2021-10-08T19:22:42.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:41 smithi117 ceph-mon[34585]: 3.2 scrub ok 2021-10-08T19:22:42.929 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:22:42 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:22:42] "GET /metrics HTTP/1.1" 200 153740 "" "Prometheus/2.18.1" 2021-10-08T19:22:43.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:42 smithi097 ceph-mon[41966]: 2.6 scrub ok 2021-10-08T19:22:43.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:42 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:22:43.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:42 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:22:43.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:42 smithi097 ceph-mon[41966]: 2.1c scrub ok 2021-10-08T19:22:43.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:42 smithi097 ceph-mon[41966]: 5.a scrub ok 2021-10-08T19:22:43.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:42 smithi097 ceph-mon[41966]: 5.2 scrub ok 2021-10-08T19:22:43.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:42 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-10-08T19:22:43.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:42 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-10-08T19:22:43.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:42 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-10-08T19:22:43.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:42 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-10-08T19:22:43.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:42 smithi097 ceph-mon[41966]: pgmap v44: 132 pgs: 132 active+clean; 582 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 600 B/s rd, 0 op/s 2021-10-08T19:22:43.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:42 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:22:43.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:42 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:22:43.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:42 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:22:43.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:42 smithi097 ceph-mon[32687]: 2.6 scrub ok 2021-10-08T19:22:43.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:42 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:22:43.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:42 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:22:43.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:42 smithi097 ceph-mon[32687]: 2.1c scrub ok 2021-10-08T19:22:43.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:42 smithi097 ceph-mon[32687]: 5.a scrub ok 2021-10-08T19:22:43.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:42 smithi097 ceph-mon[32687]: 5.2 scrub ok 2021-10-08T19:22:43.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:42 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-10-08T19:22:43.225 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:42 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-10-08T19:22:43.225 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:42 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-10-08T19:22:43.225 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:42 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-10-08T19:22:43.225 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:42 smithi097 ceph-mon[32687]: pgmap v44: 132 pgs: 132 active+clean; 582 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 600 B/s rd, 0 op/s 2021-10-08T19:22:43.226 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:42 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:22:43.226 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:42 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:22:43.226 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:42 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:22:43.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:42 smithi117 ceph-mon[34585]: 2.6 scrub ok 2021-10-08T19:22:43.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:42 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:22:43.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:42 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:22:43.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:42 smithi117 ceph-mon[34585]: 2.1c scrub ok 2021-10-08T19:22:43.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:42 smithi117 ceph-mon[34585]: 5.a scrub ok 2021-10-08T19:22:43.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:42 smithi117 ceph-mon[34585]: 5.2 scrub ok 2021-10-08T19:22:43.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:42 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-10-08T19:22:43.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:42 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-10-08T19:22:43.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:42 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-10-08T19:22:43.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:42 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-10-08T19:22:43.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:42 smithi117 ceph-mon[34585]: pgmap v44: 132 pgs: 132 active+clean; 582 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 600 B/s rd, 0 op/s 2021-10-08T19:22:43.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:42 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:22:43.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:42 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:22:43.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:42 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:22:43.969 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:43 smithi097 ceph-mon[41966]: 4.15 scrub ok 2021-10-08T19:22:43.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]': finished 2021-10-08T19:22:43.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]': finished 2021-10-08T19:22:43.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]': finished 2021-10-08T19:22:43.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]': finished 2021-10-08T19:22:43.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:43 smithi097 ceph-mon[41966]: osdmap e85: 8 total, 8 up, 8 in 2021-10-08T19:22:43.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:43 smithi097 ceph-mon[41966]: 5.1a scrub ok 2021-10-08T19:22:43.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:43 smithi097 ceph-mon[41966]: 5.1f scrub ok 2021-10-08T19:22:43.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:43 smithi097 ceph-mon[32687]: 4.15 scrub ok 2021-10-08T19:22:43.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]': finished 2021-10-08T19:22:43.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]': finished 2021-10-08T19:22:43.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]': finished 2021-10-08T19:22:43.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]': finished 2021-10-08T19:22:43.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:43 smithi097 ceph-mon[32687]: osdmap e85: 8 total, 8 up, 8 in 2021-10-08T19:22:43.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:43 smithi097 ceph-mon[32687]: 5.1a scrub ok 2021-10-08T19:22:43.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:43 smithi097 ceph-mon[32687]: 5.1f scrub ok 2021-10-08T19:22:44.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:22:43 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:22:43] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:22:44.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:43 smithi117 ceph-mon[34585]: 4.15 scrub ok 2021-10-08T19:22:44.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]': finished 2021-10-08T19:22:44.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]': finished 2021-10-08T19:22:44.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]': finished 2021-10-08T19:22:44.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]': finished 2021-10-08T19:22:44.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:43 smithi117 ceph-mon[34585]: osdmap e85: 8 total, 8 up, 8 in 2021-10-08T19:22:44.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:43 smithi117 ceph-mon[34585]: 5.1a scrub ok 2021-10-08T19:22:44.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:43 smithi117 ceph-mon[34585]: 5.1f scrub ok 2021-10-08T19:22:44.445 INFO:teuthology.orchestra.run.smithi097.stdout:163208757274 2021-10-08T19:22:44.446 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph tell osd.6 flush_pg_stats 2021-10-08T19:22:44.766 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:22:45.219 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:44 smithi097 ceph-mon[41966]: 5.12 deep-scrub ok 2021-10-08T19:22:45.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:44 smithi097 ceph-mon[41966]: osdmap e86: 8 total, 8 up, 8 in 2021-10-08T19:22:45.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:44 smithi097 ceph-mon[41966]: pgmap v47: 132 pgs: 4 peering, 128 active+clean; 582 KiB data, 55 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:22:45.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:44 smithi097 ceph-mon[32687]: 5.12 deep-scrub ok 2021-10-08T19:22:45.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:44 smithi097 ceph-mon[32687]: osdmap e86: 8 total, 8 up, 8 in 2021-10-08T19:22:45.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:44 smithi097 ceph-mon[32687]: pgmap v47: 132 pgs: 4 peering, 128 active+clean; 582 KiB data, 55 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:22:45.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:44 smithi117 ceph-mon[34585]: 5.12 deep-scrub ok 2021-10-08T19:22:45.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:44 smithi117 ceph-mon[34585]: osdmap e86: 8 total, 8 up, 8 in 2021-10-08T19:22:45.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:44 smithi117 ceph-mon[34585]: pgmap v47: 132 pgs: 4 peering, 128 active+clean; 582 KiB data, 55 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:22:46.405 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:22:46 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:22:46.666 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:46 smithi097 ceph-mon[41966]: 5.1c scrub ok 2021-10-08T19:22:46.667 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:46 smithi097 ceph-mon[32687]: 5.1c scrub ok 2021-10-08T19:22:46.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:46 smithi117 ceph-mon[34585]: 5.1c scrub ok 2021-10-08T19:22:47.456 INFO:teuthology.orchestra.run.smithi097.stdout:201863462936 2021-10-08T19:22:47.457 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph tell osd.7 flush_pg_stats 2021-10-08T19:22:47.719 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:22:47 smithi097 conmon[33110]: 172.21.15.97 - - [08/Oct/2021:19:22:47] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:47.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:47 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:22:47.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:47 smithi097 ceph-mon[32687]: 4.7 scrub ok 2021-10-08T19:22:47.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:47 smithi097 ceph-mon[32687]: 2.1a deep-scrub ok 2021-10-08T19:22:47.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:47 smithi097 ceph-mon[32687]: pgmap v48: 132 pgs: 4 peering, 128 active+clean; 582 KiB data, 55 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:22:47.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:47 smithi097 ceph-mon[32687]: 6.0 scrub ok 2021-10-08T19:22:47.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:47 smithi097 ceph-mon[32687]: 4.d scrub ok 2021-10-08T19:22:47.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:47 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:22:47.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:47 smithi097 ceph-mon[41966]: 4.7 scrub ok 2021-10-08T19:22:47.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:47 smithi097 ceph-mon[41966]: 2.1a deep-scrub ok 2021-10-08T19:22:47.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:47 smithi097 ceph-mon[41966]: pgmap v48: 132 pgs: 4 peering, 128 active+clean; 582 KiB data, 55 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:22:47.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:47 smithi097 ceph-mon[41966]: 6.0 scrub ok 2021-10-08T19:22:47.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:47 smithi097 ceph-mon[41966]: 4.d scrub ok 2021-10-08T19:22:47.733 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:22:47.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:47 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:22:47.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:47 smithi117 ceph-mon[34585]: 4.7 scrub ok 2021-10-08T19:22:47.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:47 smithi117 ceph-mon[34585]: 2.1a deep-scrub ok 2021-10-08T19:22:47.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:47 smithi117 ceph-mon[34585]: pgmap v48: 132 pgs: 4 peering, 128 active+clean; 582 KiB data, 55 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:22:47.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:47 smithi117 ceph-mon[34585]: 6.0 scrub ok 2021-10-08T19:22:47.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:47 smithi117 ceph-mon[34585]: 4.d scrub ok 2021-10-08T19:22:48.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:48 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:22:48.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:48 smithi097 ceph-mon[32687]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:22:48.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:48 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:22:48.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:48 smithi097 ceph-mon[32687]: 172.21.15.97 - - [08/Oct/2021:19:22:47] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:48.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:48 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:22:48.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:48 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:22:48.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:48 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:22:48.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:48 smithi097 ceph-mon[41966]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:22:48.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:48 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:22:48.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:48 smithi097 ceph-mon[41966]: 172.21.15.97 - - [08/Oct/2021:19:22:47] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:48.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:48 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:22:48.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:48 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:22:48.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:48 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:22:48.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:48 smithi117 ceph-mon[34585]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:22:48.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:48 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:22:48.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:48 smithi117 ceph-mon[34585]: 172.21.15.97 - - [08/Oct/2021:19:22:47] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:48.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:48 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:22:48.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:48 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:22:49.672 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:49 smithi097 ceph-mon[32687]: 3.0 scrub ok 2021-10-08T19:22:49.672 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:49 smithi097 ceph-mon[32687]: osdmap e87: 8 total, 8 up, 8 in 2021-10-08T19:22:49.672 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:49 smithi097 ceph-mon[32687]: pgmap v50: 132 pgs: 132 active+clean; 582 KiB data, 55 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 54 B/s, 2 objects/s recovering 2021-10-08T19:22:49.672 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:49 smithi097 ceph-mon[32687]: 6.17 scrub ok 2021-10-08T19:22:49.673 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:49 smithi097 ceph-mon[41966]: 3.0 scrub ok 2021-10-08T19:22:49.673 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:49 smithi097 ceph-mon[41966]: osdmap e87: 8 total, 8 up, 8 in 2021-10-08T19:22:49.673 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:49 smithi097 ceph-mon[41966]: pgmap v50: 132 pgs: 132 active+clean; 582 KiB data, 55 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 54 B/s, 2 objects/s recovering 2021-10-08T19:22:49.674 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:49 smithi097 ceph-mon[41966]: 6.17 scrub ok 2021-10-08T19:22:49.854 INFO:teuthology.orchestra.run.smithi097.stdout:236223201301 2021-10-08T19:22:49.854 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd last-stat-seq osd.0 2021-10-08T19:22:49.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:49 smithi117 ceph-mon[34585]: 3.0 scrub ok 2021-10-08T19:22:49.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:49 smithi117 ceph-mon[34585]: osdmap e87: 8 total, 8 up, 8 in 2021-10-08T19:22:49.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:49 smithi117 ceph-mon[34585]: pgmap v50: 132 pgs: 132 active+clean; 582 KiB data, 55 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 54 B/s, 2 objects/s recovering 2021-10-08T19:22:49.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:49 smithi117 ceph-mon[34585]: 6.17 scrub ok 2021-10-08T19:22:49.969 INFO:journalctl@ceph.alertmanager.a.smithi097.stdout:Oct 08 19:22:49 smithi097 conmon[76566]: level=info ts=2021-10-08T19:22:49.670Z caller=cluster.go:640 component=cluster msg="gossip settled; proceeding" elapsed=10.00096124s 2021-10-08T19:22:50.129 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:22:50.655 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:50 smithi097 ceph-mon[41966]: 2.7 scrub ok 2021-10-08T19:22:50.656 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:50 smithi097 ceph-mon[41966]: 6.d scrub ok 2021-10-08T19:22:50.656 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:50 smithi097 ceph-mon[41966]: 6.1a deep-scrub ok 2021-10-08T19:22:50.656 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:50 smithi097 ceph-mon[32687]: 2.7 scrub ok 2021-10-08T19:22:50.657 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:50 smithi097 ceph-mon[32687]: 6.d scrub ok 2021-10-08T19:22:50.657 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:50 smithi097 ceph-mon[32687]: 6.1a deep-scrub ok 2021-10-08T19:22:50.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:50 smithi117 ceph-mon[34585]: 2.7 scrub ok 2021-10-08T19:22:50.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:50 smithi117 ceph-mon[34585]: 6.d scrub ok 2021-10-08T19:22:50.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:50 smithi117 ceph-mon[34585]: 6.1a deep-scrub ok 2021-10-08T19:22:51.719 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:51 smithi097 ceph-mon[41966]: 6.1d scrub ok 2021-10-08T19:22:51.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:51 smithi097 ceph-mon[41966]: pgmap v51: 132 pgs: 132 active+clean; 582 KiB data, 55 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s; 43 B/s, 2 objects/s recovering 2021-10-08T19:22:51.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:51 smithi097 ceph-mon[41966]: 5.8 deep-scrub ok 2021-10-08T19:22:51.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:51 smithi097 ceph-mon[41966]: 5.16 scrub ok 2021-10-08T19:22:51.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:51 smithi097 ceph-mon[32687]: 6.1d scrub ok 2021-10-08T19:22:51.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:51 smithi097 ceph-mon[32687]: pgmap v51: 132 pgs: 132 active+clean; 582 KiB data, 55 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s; 43 B/s, 2 objects/s recovering 2021-10-08T19:22:51.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:51 smithi097 ceph-mon[32687]: 5.8 deep-scrub ok 2021-10-08T19:22:51.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:51 smithi097 ceph-mon[32687]: 5.16 scrub ok 2021-10-08T19:22:51.848 INFO:teuthology.orchestra.run.smithi097.stdout:34359738415 2021-10-08T19:22:51.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:51 smithi117 ceph-mon[34585]: 6.1d scrub ok 2021-10-08T19:22:51.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:51 smithi117 ceph-mon[34585]: pgmap v51: 132 pgs: 132 active+clean; 582 KiB data, 55 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s; 43 B/s, 2 objects/s recovering 2021-10-08T19:22:51.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:51 smithi117 ceph-mon[34585]: 5.8 deep-scrub ok 2021-10-08T19:22:51.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:51 smithi117 ceph-mon[34585]: 5.16 scrub ok 2021-10-08T19:22:52.460 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738410 got 34359738415 for osd.0 2021-10-08T19:22:52.460 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd last-stat-seq osd.1 2021-10-08T19:22:52.719 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:22:52 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:22:52] "GET /metrics HTTP/1.1" 200 153740 "" "Prometheus/2.18.1" 2021-10-08T19:22:52.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:52 smithi097 ceph-mon[41966]: 5.9 scrub ok 2021-10-08T19:22:52.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:52 smithi097 ceph-mon[41966]: 6.18 scrub ok 2021-10-08T19:22:52.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:52 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1161839614' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2021-10-08T19:22:52.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:52 smithi097 ceph-mon[41966]: 5.1 scrub ok 2021-10-08T19:22:52.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:52 smithi097 ceph-mon[32687]: 5.9 scrub ok 2021-10-08T19:22:52.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:52 smithi097 ceph-mon[32687]: 6.18 scrub ok 2021-10-08T19:22:52.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:52 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1161839614' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2021-10-08T19:22:52.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:52 smithi097 ceph-mon[32687]: 5.1 scrub ok 2021-10-08T19:22:52.734 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:22:52.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:52 smithi117 ceph-mon[34585]: 5.9 scrub ok 2021-10-08T19:22:52.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:52 smithi117 ceph-mon[34585]: 6.18 scrub ok 2021-10-08T19:22:52.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:52 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1161839614' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2021-10-08T19:22:52.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:52 smithi117 ceph-mon[34585]: 5.1 scrub ok 2021-10-08T19:22:53.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:53 smithi097 ceph-mon[32687]: 6.12 scrub ok 2021-10-08T19:22:53.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:53 smithi097 ceph-mon[32687]: 2.14 scrub ok 2021-10-08T19:22:53.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:53 smithi097 ceph-mon[32687]: pgmap v52: 132 pgs: 132 active+clean; 582 KiB data, 55 MiB used, 715 GiB / 715 GiB avail; 602 B/s rd, 0 op/s; 38 B/s, 1 objects/s recovering 2021-10-08T19:22:53.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:53 smithi097 ceph-mon[32687]: 4.1c scrub ok 2021-10-08T19:22:53.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:53 smithi097 ceph-mon[32687]: 4.14 scrub ok 2021-10-08T19:22:53.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:53 smithi097 ceph-mon[41966]: 6.12 scrub ok 2021-10-08T19:22:53.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:53 smithi097 ceph-mon[41966]: 2.14 scrub ok 2021-10-08T19:22:53.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:53 smithi097 ceph-mon[41966]: pgmap v52: 132 pgs: 132 active+clean; 582 KiB data, 55 MiB used, 715 GiB / 715 GiB avail; 602 B/s rd, 0 op/s; 38 B/s, 1 objects/s recovering 2021-10-08T19:22:53.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:53 smithi097 ceph-mon[41966]: 4.1c scrub ok 2021-10-08T19:22:53.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:53 smithi097 ceph-mon[41966]: 4.14 scrub ok 2021-10-08T19:22:53.867 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:53 smithi117 ceph-mon[34585]: 6.12 scrub ok 2021-10-08T19:22:53.867 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:53 smithi117 ceph-mon[34585]: 2.14 scrub ok 2021-10-08T19:22:53.867 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:53 smithi117 ceph-mon[34585]: pgmap v52: 132 pgs: 132 active+clean; 582 KiB data, 55 MiB used, 715 GiB / 715 GiB avail; 602 B/s rd, 0 op/s; 38 B/s, 1 objects/s recovering 2021-10-08T19:22:53.867 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:53 smithi117 ceph-mon[34585]: 4.1c scrub ok 2021-10-08T19:22:53.868 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:53 smithi117 ceph-mon[34585]: 4.14 scrub ok 2021-10-08T19:22:54.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:22:53 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:22:53] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:22:54.341 INFO:teuthology.orchestra.run.smithi097.stdout:55834574892 2021-10-08T19:22:54.719 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:54 smithi097 ceph-mon[41966]: 4.12 deep-scrub ok 2021-10-08T19:22:54.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:54 smithi097 ceph-mon[41966]: 4.1f scrub ok 2021-10-08T19:22:54.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:54 smithi097 ceph-mon[41966]: 2.1 scrub ok 2021-10-08T19:22:54.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:54 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/4226724621' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2021-10-08T19:22:54.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:54 smithi097 ceph-mon[32687]: 4.12 deep-scrub ok 2021-10-08T19:22:54.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:54 smithi097 ceph-mon[32687]: 4.1f scrub ok 2021-10-08T19:22:54.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:54 smithi097 ceph-mon[32687]: 2.1 scrub ok 2021-10-08T19:22:54.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:54 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/4226724621' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2021-10-08T19:22:54.794 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574887 got 55834574892 for osd.1 2021-10-08T19:22:54.795 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd last-stat-seq osd.2 2021-10-08T19:22:54.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:54 smithi117 ceph-mon[34585]: 4.12 deep-scrub ok 2021-10-08T19:22:54.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:54 smithi117 ceph-mon[34585]: 4.1f scrub ok 2021-10-08T19:22:54.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:54 smithi117 ceph-mon[34585]: 2.1 scrub ok 2021-10-08T19:22:54.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:54 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/4226724621' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2021-10-08T19:22:55.064 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:22:55.575 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:55 smithi097 ceph-mon[41966]: 4.2 scrub ok 2021-10-08T19:22:55.575 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:55 smithi097 ceph-mon[41966]: 4.5 scrub ok 2021-10-08T19:22:55.575 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:55 smithi097 ceph-mon[41966]: pgmap v53: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 32 B/s, 1 objects/s recovering 2021-10-08T19:22:55.576 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:55 smithi097 ceph-mon[41966]: 2.1f scrub ok 2021-10-08T19:22:55.576 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:55 smithi097 ceph-mon[32687]: 4.2 scrub ok 2021-10-08T19:22:55.576 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:55 smithi097 ceph-mon[32687]: 4.5 scrub ok 2021-10-08T19:22:55.577 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:55 smithi097 ceph-mon[32687]: pgmap v53: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 32 B/s, 1 objects/s recovering 2021-10-08T19:22:55.577 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:55 smithi097 ceph-mon[32687]: 2.1f scrub ok 2021-10-08T19:22:55.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:55 smithi117 ceph-mon[34585]: 4.2 scrub ok 2021-10-08T19:22:55.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:55 smithi117 ceph-mon[34585]: 4.5 scrub ok 2021-10-08T19:22:55.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:55 smithi117 ceph-mon[34585]: pgmap v53: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 32 B/s, 1 objects/s recovering 2021-10-08T19:22:55.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:55 smithi117 ceph-mon[34585]: 2.1f scrub ok 2021-10-08T19:22:56.405 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:22:56 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:22:56.713 INFO:teuthology.orchestra.run.smithi097.stdout:77309411368 2021-10-08T19:22:56.719 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:56 smithi097 ceph-mon[41966]: 2.b scrub ok 2021-10-08T19:22:56.719 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:56 smithi097 ceph-mon[41966]: 6.4 scrub ok 2021-10-08T19:22:56.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:56 smithi097 ceph-mon[41966]: 4.6 scrub ok 2021-10-08T19:22:56.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:56 smithi097 ceph-mon[41966]: 6.1e deep-scrub ok 2021-10-08T19:22:56.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:56 smithi097 ceph-mon[32687]: 2.b scrub ok 2021-10-08T19:22:56.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:56 smithi097 ceph-mon[32687]: 6.4 scrub ok 2021-10-08T19:22:56.726 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:56 smithi097 ceph-mon[32687]: 4.6 scrub ok 2021-10-08T19:22:56.727 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:56 smithi097 ceph-mon[32687]: 6.1e deep-scrub ok 2021-10-08T19:22:56.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:56 smithi117 ceph-mon[34585]: 2.b scrub ok 2021-10-08T19:22:56.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:56 smithi117 ceph-mon[34585]: 6.4 scrub ok 2021-10-08T19:22:56.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:56 smithi117 ceph-mon[34585]: 4.6 scrub ok 2021-10-08T19:22:56.908 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:56 smithi117 ceph-mon[34585]: 6.1e deep-scrub ok 2021-10-08T19:22:57.320 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411363 got 77309411368 for osd.2 2021-10-08T19:22:57.320 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd last-stat-seq osd.3 2021-10-08T19:22:57.594 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:22:57.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:57 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:22:57.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:57 smithi097 ceph-mon[32687]: 4.f scrub ok 2021-10-08T19:22:57.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:57 smithi097 ceph-mon[32687]: pgmap v54: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 32 B/s, 1 objects/s recovering 2021-10-08T19:22:57.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:57 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/126383169' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2021-10-08T19:22:57.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:57 smithi097 ceph-mon[32687]: 4.9 scrub ok 2021-10-08T19:22:57.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:57 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:22:57.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:57 smithi097 ceph-mon[41966]: 4.f scrub ok 2021-10-08T19:22:57.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:57 smithi097 ceph-mon[41966]: pgmap v54: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 32 B/s, 1 objects/s recovering 2021-10-08T19:22:57.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:57 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/126383169' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2021-10-08T19:22:57.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:57 smithi097 ceph-mon[41966]: 4.9 scrub ok 2021-10-08T19:22:57.766 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:57 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:22:57.766 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:57 smithi117 ceph-mon[34585]: 4.f scrub ok 2021-10-08T19:22:57.766 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:57 smithi117 ceph-mon[34585]: pgmap v54: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 32 B/s, 1 objects/s recovering 2021-10-08T19:22:57.767 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:57 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/126383169' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2021-10-08T19:22:57.767 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:57 smithi117 ceph-mon[34585]: 4.9 scrub ok 2021-10-08T19:22:58.719 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:58 smithi097 ceph-mon[41966]: 2.c scrub ok 2021-10-08T19:22:58.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:58 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:22:58.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:58 smithi097 ceph-mon[41966]: 6.9 scrub ok 2021-10-08T19:22:58.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:58 smithi097 ceph-mon[32687]: 2.c scrub ok 2021-10-08T19:22:58.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:58 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:22:58.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:58 smithi097 ceph-mon[32687]: 6.9 scrub ok 2021-10-08T19:22:58.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:58 smithi117 ceph-mon[34585]: 2.c scrub ok 2021-10-08T19:22:58.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:58 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:22:58.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:58 smithi117 ceph-mon[34585]: 6.9 scrub ok 2021-10-08T19:22:59.179 INFO:teuthology.orchestra.run.smithi097.stdout:103079215143 2021-10-08T19:22:59.752 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215138 got 103079215143 for osd.3 2021-10-08T19:22:59.753 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd last-stat-seq osd.4 2021-10-08T19:22:59.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:59 smithi117 ceph-mon[34585]: pgmap v55: 132 pgs: 132 active+clean; 582 KiB data, 57 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2021-10-08T19:22:59.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:59 smithi117 ceph-mon[34585]: 5.1e scrub ok 2021-10-08T19:22:59.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:59 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:22:59.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:59 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:22:59.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:59 smithi117 ceph-mon[34585]: 4.8 deep-scrub ok 2021-10-08T19:22:59.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:22:59 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/227577471' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2021-10-08T19:22:59.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:59 smithi097 ceph-mon[32687]: pgmap v55: 132 pgs: 132 active+clean; 582 KiB data, 57 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2021-10-08T19:22:59.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:59 smithi097 ceph-mon[32687]: 5.1e scrub ok 2021-10-08T19:22:59.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:59 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:22:59.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:59 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:22:59.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:59 smithi097 ceph-mon[32687]: 4.8 deep-scrub ok 2021-10-08T19:22:59.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:22:59 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/227577471' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2021-10-08T19:22:59.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:59 smithi097 ceph-mon[41966]: pgmap v55: 132 pgs: 132 active+clean; 582 KiB data, 57 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2021-10-08T19:22:59.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:59 smithi097 ceph-mon[41966]: 5.1e scrub ok 2021-10-08T19:22:59.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:59 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:22:59.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:59 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:22:59.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:59 smithi097 ceph-mon[41966]: 4.8 deep-scrub ok 2021-10-08T19:22:59.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:22:59 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/227577471' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2021-10-08T19:23:00.026 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:23:00.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:00 smithi117 ceph-mon[34585]: osdmap e88: 8 total, 8 up, 8 in 2021-10-08T19:23:00.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:00 smithi117 ceph-mon[34585]: 5.e deep-scrub ok 2021-10-08T19:23:00.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:00 smithi117 ceph-mon[34585]: 5.d scrub ok 2021-10-08T19:23:00.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:00 smithi097 ceph-mon[32687]: osdmap e88: 8 total, 8 up, 8 in 2021-10-08T19:23:00.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:00 smithi097 ceph-mon[32687]: 5.e deep-scrub ok 2021-10-08T19:23:00.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:00 smithi097 ceph-mon[32687]: 5.d scrub ok 2021-10-08T19:23:00.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:00 smithi097 ceph-mon[41966]: osdmap e88: 8 total, 8 up, 8 in 2021-10-08T19:23:00.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:00 smithi097 ceph-mon[41966]: 5.e deep-scrub ok 2021-10-08T19:23:00.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:00 smithi097 ceph-mon[41966]: 5.d scrub ok 2021-10-08T19:23:01.682 INFO:teuthology.orchestra.run.smithi097.stdout:128849018915 2021-10-08T19:23:01.712 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:01 smithi097 ceph-mon[41966]: 5.10 scrub ok 2021-10-08T19:23:01.713 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:01 smithi097 ceph-mon[41966]: pgmap v57: 132 pgs: 132 active+clean; 582 KiB data, 57 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:23:01.713 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:01 smithi097 ceph-mon[41966]: 4.16 scrub ok 2021-10-08T19:23:01.713 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:01 smithi097 ceph-mon[32687]: 5.10 scrub ok 2021-10-08T19:23:01.713 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:01 smithi097 ceph-mon[32687]: pgmap v57: 132 pgs: 132 active+clean; 582 KiB data, 57 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:23:01.714 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:01 smithi097 ceph-mon[32687]: 4.16 scrub ok 2021-10-08T19:23:01.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:01 smithi117 ceph-mon[34585]: 5.10 scrub ok 2021-10-08T19:23:01.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:01 smithi117 ceph-mon[34585]: pgmap v57: 132 pgs: 132 active+clean; 582 KiB data, 57 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:23:01.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:01 smithi117 ceph-mon[34585]: 4.16 scrub ok 2021-10-08T19:23:02.193 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018911 got 128849018915 for osd.4 2021-10-08T19:23:02.194 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd last-stat-seq osd.5 2021-10-08T19:23:02.466 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:23:02.904 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:02 smithi117 ceph-mon[34585]: 6.5 scrub ok 2021-10-08T19:23:02.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:02 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2516925708' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2021-10-08T19:23:02.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:02 smithi117 ceph-mon[34585]: 2.2 scrub ok 2021-10-08T19:23:02.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:02 smithi117 ceph-mon[34585]: 4.e scrub ok 2021-10-08T19:23:02.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:02 smithi097 ceph-mon[32687]: 6.5 scrub ok 2021-10-08T19:23:02.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:02 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2516925708' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2021-10-08T19:23:02.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:02 smithi097 ceph-mon[32687]: 2.2 scrub ok 2021-10-08T19:23:02.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:02 smithi097 ceph-mon[32687]: 4.e scrub ok 2021-10-08T19:23:02.970 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:23:02 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:23:02] "GET /metrics HTTP/1.1" 200 153757 "" "Prometheus/2.18.1" 2021-10-08T19:23:02.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:02 smithi097 ceph-mon[41966]: 6.5 scrub ok 2021-10-08T19:23:02.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:02 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2516925708' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2021-10-08T19:23:02.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:02 smithi097 ceph-mon[41966]: 2.2 scrub ok 2021-10-08T19:23:02.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:02 smithi097 ceph-mon[41966]: 4.e scrub ok 2021-10-08T19:23:03.867 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:03 smithi117 ceph-mon[34585]: 2.15 scrub ok 2021-10-08T19:23:03.867 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:03 smithi117 ceph-mon[34585]: 5.4 scrub ok 2021-10-08T19:23:03.867 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:03 smithi117 ceph-mon[34585]: pgmap v58: 132 pgs: 132 active+clean; 582 KiB data, 57 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:23:03.868 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:03 smithi117 ceph-mon[34585]: 5.11 scrub ok 2021-10-08T19:23:03.868 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:03 smithi117 ceph-mon[34585]: 6.10 scrub ok 2021-10-08T19:23:03.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:03 smithi097 ceph-mon[32687]: 2.15 scrub ok 2021-10-08T19:23:03.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:03 smithi097 ceph-mon[32687]: 5.4 scrub ok 2021-10-08T19:23:03.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:03 smithi097 ceph-mon[32687]: pgmap v58: 132 pgs: 132 active+clean; 582 KiB data, 57 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:23:03.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:03 smithi097 ceph-mon[32687]: 5.11 scrub ok 2021-10-08T19:23:03.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:03 smithi097 ceph-mon[32687]: 6.10 scrub ok 2021-10-08T19:23:03.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:03 smithi097 ceph-mon[41966]: 2.15 scrub ok 2021-10-08T19:23:03.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:03 smithi097 ceph-mon[41966]: 5.4 scrub ok 2021-10-08T19:23:03.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:03 smithi097 ceph-mon[41966]: pgmap v58: 132 pgs: 132 active+clean; 582 KiB data, 57 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:23:03.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:03 smithi097 ceph-mon[41966]: 5.11 scrub ok 2021-10-08T19:23:03.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:03 smithi097 ceph-mon[41966]: 6.10 scrub ok 2021-10-08T19:23:04.068 INFO:teuthology.orchestra.run.smithi097.stdout:163208757277 2021-10-08T19:23:04.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:23:03 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:23:03] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:23:04.685 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757274 got 163208757277 for osd.5 2021-10-08T19:23:04.685 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd last-stat-seq osd.6 2021-10-08T19:23:04.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:04 smithi117 ceph-mon[34585]: 6.8 scrub ok 2021-10-08T19:23:04.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:04 smithi117 ceph-mon[34585]: 5.5 scrub ok 2021-10-08T19:23:04.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:04 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3321212612' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2021-10-08T19:23:04.957 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:23:04.969 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:04 smithi097 ceph-mon[41966]: 6.8 scrub ok 2021-10-08T19:23:04.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:04 smithi097 ceph-mon[41966]: 5.5 scrub ok 2021-10-08T19:23:04.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:04 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3321212612' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2021-10-08T19:23:04.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:04 smithi097 ceph-mon[32687]: 6.8 scrub ok 2021-10-08T19:23:04.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:04 smithi097 ceph-mon[32687]: 5.5 scrub ok 2021-10-08T19:23:04.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:04 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3321212612' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2021-10-08T19:23:05.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:05 smithi117 ceph-mon[34585]: 6.1c scrub ok 2021-10-08T19:23:05.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:05 smithi117 ceph-mon[34585]: pgmap v59: 132 pgs: 132 active+clean; 582 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:23:05.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:05 smithi117 ceph-mon[34585]: 2.12 scrub ok 2021-10-08T19:23:05.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:05 smithi097 ceph-mon[32687]: 6.1c scrub ok 2021-10-08T19:23:05.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:05 smithi097 ceph-mon[32687]: pgmap v59: 132 pgs: 132 active+clean; 582 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:23:05.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:05 smithi097 ceph-mon[32687]: 2.12 scrub ok 2021-10-08T19:23:05.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:05 smithi097 ceph-mon[41966]: 6.1c scrub ok 2021-10-08T19:23:05.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:05 smithi097 ceph-mon[41966]: pgmap v59: 132 pgs: 132 active+clean; 582 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:23:05.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:05 smithi097 ceph-mon[41966]: 2.12 scrub ok 2021-10-08T19:23:06.405 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:23:06 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:23:06.611 INFO:teuthology.orchestra.run.smithi097.stdout:201863462940 2021-10-08T19:23:06.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:06 smithi117 ceph-mon[34585]: 5.19 scrub ok 2021-10-08T19:23:06.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:06 smithi117 ceph-mon[34585]: 6.3 scrub ok 2021-10-08T19:23:06.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:06 smithi117 ceph-mon[34585]: 5.1b deep-scrub ok 2021-10-08T19:23:06.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:06 smithi117 ceph-mon[34585]: 5.6 scrub ok 2021-10-08T19:23:06.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:06 smithi097 ceph-mon[32687]: 5.19 scrub ok 2021-10-08T19:23:06.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:06 smithi097 ceph-mon[32687]: 6.3 scrub ok 2021-10-08T19:23:06.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:06 smithi097 ceph-mon[32687]: 5.1b deep-scrub ok 2021-10-08T19:23:06.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:06 smithi097 ceph-mon[32687]: 5.6 scrub ok 2021-10-08T19:23:06.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:06 smithi097 ceph-mon[41966]: 5.19 scrub ok 2021-10-08T19:23:06.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:06 smithi097 ceph-mon[41966]: 6.3 scrub ok 2021-10-08T19:23:06.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:06 smithi097 ceph-mon[41966]: 5.1b deep-scrub ok 2021-10-08T19:23:06.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:06 smithi097 ceph-mon[41966]: 5.6 scrub ok 2021-10-08T19:23:07.201 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462936 got 201863462940 for osd.6 2021-10-08T19:23:07.202 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd last-stat-seq osd.7 2021-10-08T19:23:07.479 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:23:07.858 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:07 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:23:07.858 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:07 smithi097 ceph-mon[41966]: 6.1 scrub ok 2021-10-08T19:23:07.859 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:07 smithi097 ceph-mon[41966]: pgmap v60: 132 pgs: 132 active+clean; 582 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:23:07.859 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:07 smithi097 ceph-mon[41966]: 6.13 scrub ok 2021-10-08T19:23:07.859 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:07 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/365100086' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2021-10-08T19:23:07.859 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:07 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:23:07.860 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:07 smithi097 ceph-mon[32687]: 6.1 scrub ok 2021-10-08T19:23:07.860 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:07 smithi097 ceph-mon[32687]: pgmap v60: 132 pgs: 132 active+clean; 582 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:23:07.860 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:07 smithi097 ceph-mon[32687]: 6.13 scrub ok 2021-10-08T19:23:07.860 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:07 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/365100086' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2021-10-08T19:23:07.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:07 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:23:07.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:07 smithi117 ceph-mon[34585]: 6.1 scrub ok 2021-10-08T19:23:07.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:07 smithi117 ceph-mon[34585]: pgmap v60: 132 pgs: 132 active+clean; 582 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:23:07.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:07 smithi117 ceph-mon[34585]: 6.13 scrub ok 2021-10-08T19:23:07.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:07 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/365100086' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2021-10-08T19:23:08.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:08 smithi097 ceph-mon[32687]: 2.1b scrub ok 2021-10-08T19:23:08.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:08 smithi097 ceph-mon[32687]: 2.f scrub ok 2021-10-08T19:23:08.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:08 smithi097 ceph-mon[41966]: 2.1b scrub ok 2021-10-08T19:23:08.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:08 smithi097 ceph-mon[41966]: 2.f scrub ok 2021-10-08T19:23:08.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:08 smithi117 ceph-mon[34585]: 2.1b scrub ok 2021-10-08T19:23:08.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:08 smithi117 ceph-mon[34585]: 2.f scrub ok 2021-10-08T19:23:09.569 INFO:teuthology.orchestra.run.smithi097.stdout:236223201305 2021-10-08T19:23:09.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:09 smithi117 ceph-mon[34585]: pgmap v61: 132 pgs: 132 active+clean; 582 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:23:09.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:09 smithi117 ceph-mon[34585]: 5.b scrub ok 2021-10-08T19:23:09.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:09 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1080960473' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2021-10-08T19:23:09.969 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:09 smithi097 ceph-mon[41966]: pgmap v61: 132 pgs: 132 active+clean; 582 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:23:09.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:09 smithi097 ceph-mon[41966]: 5.b scrub ok 2021-10-08T19:23:09.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:09 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1080960473' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2021-10-08T19:23:09.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:09 smithi097 ceph-mon[32687]: pgmap v61: 132 pgs: 132 active+clean; 582 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:23:09.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:09 smithi097 ceph-mon[32687]: 5.b scrub ok 2021-10-08T19:23:09.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:09 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1080960473' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2021-10-08T19:23:10.209 INFO:tasks.cephadm.ceph_manager.ceph:need seq 236223201301 got 236223201305 for osd.7 2021-10-08T19:23:10.209 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2021-10-08T19:23:10.210 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph pg dump --format=json 2021-10-08T19:23:10.495 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:23:11.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:11 smithi097 ceph-mon[41966]: 5.1d scrub ok 2021-10-08T19:23:11.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:11 smithi097 ceph-mon[41966]: 6.f scrub ok 2021-10-08T19:23:11.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:11 smithi097 ceph-mon[41966]: pgmap v62: 132 pgs: 132 active+clean; 582 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 942 B/s rd, 0 op/s 2021-10-08T19:23:11.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:11 smithi097 ceph-mon[41966]: 4.1d scrub ok 2021-10-08T19:23:11.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:11 smithi097 ceph-mon[41966]: 6.a scrub ok 2021-10-08T19:23:11.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:11 smithi097 ceph-mon[32687]: 5.1d scrub ok 2021-10-08T19:23:11.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:11 smithi097 ceph-mon[32687]: 6.f scrub ok 2021-10-08T19:23:11.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:11 smithi097 ceph-mon[32687]: pgmap v62: 132 pgs: 132 active+clean; 582 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 942 B/s rd, 0 op/s 2021-10-08T19:23:11.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:11 smithi097 ceph-mon[32687]: 4.1d scrub ok 2021-10-08T19:23:11.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:11 smithi097 ceph-mon[32687]: 6.a scrub ok 2021-10-08T19:23:11.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:11 smithi117 ceph-mon[34585]: 5.1d scrub ok 2021-10-08T19:23:11.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:11 smithi117 ceph-mon[34585]: 6.f scrub ok 2021-10-08T19:23:11.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:11 smithi117 ceph-mon[34585]: pgmap v62: 132 pgs: 132 active+clean; 582 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 942 B/s rd, 0 op/s 2021-10-08T19:23:11.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:11 smithi117 ceph-mon[34585]: 4.1d scrub ok 2021-10-08T19:23:11.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:11 smithi117 ceph-mon[34585]: 6.a scrub ok 2021-10-08T19:23:12.720 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:23:12 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:23:12] "GET /metrics HTTP/1.1" 200 153763 "" "Prometheus/2.18.1" 2021-10-08T19:23:12.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:12 smithi097 ceph-mon[41966]: 2.d scrub ok 2021-10-08T19:23:12.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:12 smithi097 ceph-mon[41966]: 6.16 scrub ok 2021-10-08T19:23:12.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:12 smithi097 ceph-mon[32687]: 2.d scrub ok 2021-10-08T19:23:12.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:12 smithi097 ceph-mon[32687]: 6.16 scrub ok 2021-10-08T19:23:12.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:12 smithi117 ceph-mon[34585]: 2.d scrub ok 2021-10-08T19:23:12.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:12 smithi117 ceph-mon[34585]: 6.16 scrub ok 2021-10-08T19:23:12.915 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:23:12.918 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2021-10-08T19:23:13.495 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2021-10-08T19:23:12.436911+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596164,"num_objects":194,"num_object_clones":0,"num_object_copies":582,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":1035,"num_read_kb":881,"num_write":607,"num_write_kb":2457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":1771434,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":606,"ondisk_log_size":606,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":396,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":58888,"kb_used_data":6600,"kb_used_omap":0,"kb_used_meta":52224,"kb_avail":749902328,"statfs":{"total":767960285184,"available":767899983872,"internally_reserved":0,"allocated":6758400,"data_stored":4072036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":53477376},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002956"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.429686+0000","last_change":"2021-10-08T19:22:33.411869+0000","last_active":"2021-10-08T19:22:48.429686+0000","last_peered":"2021-10-08T19:22:48.429686+0000","last_clean":"2021-10-08T19:22:48.429686+0000","last_became_active":"2021-10-08T19:21:29.681121+0000","last_became_peered":"2021-10-08T19:21:29.681121+0000","last_unstale":"2021-10-08T19:22:48.429686+0000","last_undegraded":"2021-10-08T19:22:48.429686+0000","last_fullsized":"2021-10-08T19:22:48.429686+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:33.411753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:33.411753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0038057030000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.428089+0000","last_change":"2021-10-08T19:22:34.356580+0000","last_active":"2021-10-08T19:22:48.428089+0000","last_peered":"2021-10-08T19:22:48.428089+0000","last_clean":"2021-10-08T19:22:48.428089+0000","last_became_active":"2021-10-08T19:21:27.636886+0000","last_became_peered":"2021-10-08T19:21:27.636886+0000","last_unstale":"2021-10-08T19:22:48.428089+0000","last_undegraded":"2021-10-08T19:22:48.428089+0000","last_fullsized":"2021-10-08T19:22:48.428089+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:34.356501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:34.356501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034783520000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:54.671530+0000","last_change":"2021-10-08T19:22:54.671364+0000","last_active":"2021-10-08T19:22:54.671530+0000","last_peered":"2021-10-08T19:22:54.671530+0000","last_clean":"2021-10-08T19:22:54.671530+0000","last_became_active":"2021-10-08T19:21:23.603422+0000","last_became_peered":"2021-10-08T19:21:23.603422+0000","last_unstale":"2021-10-08T19:22:54.671530+0000","last_undegraded":"2021-10-08T19:22:54.671530+0000","last_fullsized":"2021-10-08T19:22:54.671530+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:54.671289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:54.671289+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001752221,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"69'15","reported_seq":59,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.429439+0000","last_change":"2021-10-08T19:21:25.613266+0000","last_active":"2021-10-08T19:22:48.429439+0000","last_peered":"2021-10-08T19:22:48.429439+0000","last_clean":"2021-10-08T19:22:48.429439+0000","last_became_active":"2021-10-08T19:21:25.612873+0000","last_became_peered":"2021-10-08T19:21:25.612873+0000","last_unstale":"2021-10-08T19:22:48.429439+0000","last_undegraded":"2021-10-08T19:22:48.429439+0000","last_fullsized":"2021-10-08T19:22:48.429439+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:21:24.589054+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:50.032928+0000","last_change":"2021-10-08T19:22:50.032446+0000","last_active":"2021-10-08T19:22:50.032928+0000","last_peered":"2021-10-08T19:22:50.032928+0000","last_clean":"2021-10-08T19:22:50.032928+0000","last_became_active":"2021-10-08T19:21:29.639039+0000","last_became_peered":"2021-10-08T19:21:29.639039+0000","last_unstale":"2021-10-08T19:22:50.032928+0000","last_undegraded":"2021-10-08T19:22:50.032928+0000","last_fullsized":"2021-10-08T19:22:50.032928+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:50.032367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:50.032367+0000","last_clean_scrub_stamp":"2021-10-08T19:22:50.032367+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034102759999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:05.196359+0000","last_change":"2021-10-08T19:23:05.196328+0000","last_active":"2021-10-08T19:23:05.196359+0000","last_peered":"2021-10-08T19:23:05.196359+0000","last_clean":"2021-10-08T19:23:05.196359+0000","last_became_active":"2021-10-08T19:21:27.634883+0000","last_became_peered":"2021-10-08T19:21:27.634883+0000","last_unstale":"2021-10-08T19:23:05.196359+0000","last_undegraded":"2021-10-08T19:23:05.196359+0000","last_fullsized":"2021-10-08T19:23:05.196359+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:05.196252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:05.196252+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0016803230000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.430064+0000","last_change":"2021-10-08T19:21:23.598564+0000","last_active":"2021-10-08T19:22:48.430064+0000","last_peered":"2021-10-08T19:22:48.430064+0000","last_clean":"2021-10-08T19:22:48.430064+0000","last_became_active":"2021-10-08T19:21:23.598272+0000","last_became_peered":"2021-10-08T19:21:23.598272+0000","last_unstale":"2021-10-08T19:22:48.430064+0000","last_undegraded":"2021-10-08T19:22:48.430064+0000","last_fullsized":"2021-10-08T19:22:48.430064+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:21:22.582293+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"69'9","reported_seq":69,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.428218+0000","last_change":"2021-10-08T19:22:44.282532+0000","last_active":"2021-10-08T19:22:48.428218+0000","last_peered":"2021-10-08T19:22:48.428218+0000","last_clean":"2021-10-08T19:22:48.428218+0000","last_became_active":"2021-10-08T19:22:43.936718+0000","last_became_peered":"2021-10-08T19:22:43.936718+0000","last_unstale":"2021-10-08T19:22:48.428218+0000","last_undegraded":"2021-10-08T19:22:48.428218+0000","last_fullsized":"2021-10-08T19:22:48.428218+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:21:24.589054+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.438252+0000","last_change":"2021-10-08T19:21:29.649955+0000","last_active":"2021-10-08T19:22:48.438252+0000","last_peered":"2021-10-08T19:22:48.438252+0000","last_clean":"2021-10-08T19:22:48.438252+0000","last_became_active":"2021-10-08T19:21:29.649640+0000","last_became_peered":"2021-10-08T19:21:29.649640+0000","last_unstale":"2021-10-08T19:22:48.438252+0000","last_undegraded":"2021-10-08T19:22:48.438252+0000","last_fullsized":"2021-10-08T19:22:48.438252+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:21:28.621762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.441117+0000","last_change":"2021-10-08T19:22:43.016906+0000","last_active":"2021-10-08T19:22:48.441117+0000","last_peered":"2021-10-08T19:22:48.441117+0000","last_clean":"2021-10-08T19:22:48.441117+0000","last_became_active":"2021-10-08T19:21:27.637178+0000","last_became_peered":"2021-10-08T19:21:27.637178+0000","last_unstale":"2021-10-08T19:22:48.441117+0000","last_undegraded":"2021-10-08T19:22:48.441117+0000","last_fullsized":"2021-10-08T19:22:48.441117+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:43.016815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:43.016815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034706469999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.439380+0000","last_change":"2021-10-08T19:22:33.926376+0000","last_active":"2021-10-08T19:22:48.439380+0000","last_peered":"2021-10-08T19:22:48.439380+0000","last_clean":"2021-10-08T19:22:48.439380+0000","last_became_active":"2021-10-08T19:21:23.609037+0000","last_became_peered":"2021-10-08T19:21:23.609037+0000","last_unstale":"2021-10-08T19:22:48.439380+0000","last_undegraded":"2021-10-08T19:22:48.439380+0000","last_fullsized":"2021-10-08T19:22:48.439380+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:33.926256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:33.926256+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0015495210000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"69'5","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.428429+0000","last_change":"2021-10-08T19:21:25.609310+0000","last_active":"2021-10-08T19:22:48.428429+0000","last_peered":"2021-10-08T19:22:48.428429+0000","last_clean":"2021-10-08T19:22:48.428429+0000","last_became_active":"2021-10-08T19:21:25.609029+0000","last_became_peered":"2021-10-08T19:21:25.609029+0000","last_unstale":"2021-10-08T19:22:48.428429+0000","last_undegraded":"2021-10-08T19:22:48.428429+0000","last_fullsized":"2021-10-08T19:22:48.428429+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:21:24.589054+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:51.689425+0000","last_change":"2021-10-08T19:22:51.689295+0000","last_active":"2021-10-08T19:22:51.689425+0000","last_peered":"2021-10-08T19:22:51.689425+0000","last_clean":"2021-10-08T19:22:51.689425+0000","last_became_active":"2021-10-08T19:21:29.640978+0000","last_became_peered":"2021-10-08T19:21:29.640978+0000","last_unstale":"2021-10-08T19:22:51.689425+0000","last_undegraded":"2021-10-08T19:22:51.689425+0000","last_fullsized":"2021-10-08T19:22:51.689425+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:51.689220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:51.689220+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001435541,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:05.799460+0000","last_change":"2021-10-08T19:23:05.799433+0000","last_active":"2021-10-08T19:23:05.799460+0000","last_peered":"2021-10-08T19:23:05.799460+0000","last_clean":"2021-10-08T19:23:05.799460+0000","last_became_active":"2021-10-08T19:21:27.633979+0000","last_became_peered":"2021-10-08T19:21:27.633979+0000","last_unstale":"2021-10-08T19:23:05.799460+0000","last_undegraded":"2021-10-08T19:23:05.799460+0000","last_fullsized":"2021-10-08T19:23:05.799460+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:05.799361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:05.799361+0000","last_clean_scrub_stamp":"2021-10-08T19:23:05.799361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0036358100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.440798+0000","last_change":"2021-10-08T19:22:42.042609+0000","last_active":"2021-10-08T19:22:48.440798+0000","last_peered":"2021-10-08T19:22:48.440798+0000","last_clean":"2021-10-08T19:22:48.440798+0000","last_became_active":"2021-10-08T19:21:23.607785+0000","last_became_peered":"2021-10-08T19:21:23.607785+0000","last_unstale":"2021-10-08T19:22:48.440798+0000","last_undegraded":"2021-10-08T19:22:48.440798+0000","last_fullsized":"2021-10-08T19:22:48.440798+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:42.042510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:42.042510+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034710639999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"69'9","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.428306+0000","last_change":"2021-10-08T19:21:25.608580+0000","last_active":"2021-10-08T19:22:48.428306+0000","last_peered":"2021-10-08T19:22:48.428306+0000","last_clean":"2021-10-08T19:22:48.428306+0000","last_became_active":"2021-10-08T19:21:25.608263+0000","last_became_peered":"2021-10-08T19:21:25.608263+0000","last_unstale":"2021-10-08T19:22:48.428306+0000","last_undegraded":"2021-10-08T19:22:48.428306+0000","last_fullsized":"2021-10-08T19:22:48.428306+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:21:24.589054+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.430220+0000","last_change":"2021-10-08T19:22:38.544751+0000","last_active":"2021-10-08T19:22:48.430220+0000","last_peered":"2021-10-08T19:22:48.430220+0000","last_clean":"2021-10-08T19:22:48.430220+0000","last_became_active":"2021-10-08T19:21:29.681017+0000","last_became_peered":"2021-10-08T19:21:29.681017+0000","last_unstale":"2021-10-08T19:22:48.430220+0000","last_undegraded":"2021-10-08T19:22:48.430220+0000","last_fullsized":"2021-10-08T19:22:48.430220+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:38.544673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:38.544673+0000","last_clean_scrub_stamp":"2021-10-08T19:22:38.544673+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0019818940000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.428567+0000","last_change":"2021-10-08T19:22:45.177384+0000","last_active":"2021-10-08T19:22:48.428567+0000","last_peered":"2021-10-08T19:22:48.428567+0000","last_clean":"2021-10-08T19:22:48.428567+0000","last_became_active":"2021-10-08T19:21:27.635242+0000","last_became_peered":"2021-10-08T19:21:27.635242+0000","last_unstale":"2021-10-08T19:22:48.428567+0000","last_undegraded":"2021-10-08T19:22:48.428567+0000","last_fullsized":"2021-10-08T19:22:48.428567+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:45.177306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:45.177306+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034162229999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:07.581754+0000","last_change":"2021-10-08T19:23:07.581727+0000","last_active":"2021-10-08T19:23:07.581754+0000","last_peered":"2021-10-08T19:23:07.581754+0000","last_clean":"2021-10-08T19:23:07.581754+0000","last_became_active":"2021-10-08T19:21:23.605327+0000","last_became_peered":"2021-10-08T19:21:23.605327+0000","last_unstale":"2021-10-08T19:23:07.581754+0000","last_undegraded":"2021-10-08T19:23:07.581754+0000","last_fullsized":"2021-10-08T19:23:07.581754+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:07.581653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:07.581653+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034956309999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"69'12","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.429945+0000","last_change":"2021-10-08T19:21:25.614155+0000","last_active":"2021-10-08T19:22:48.429945+0000","last_peered":"2021-10-08T19:22:48.429945+0000","last_clean":"2021-10-08T19:22:48.429945+0000","last_became_active":"2021-10-08T19:21:25.612541+0000","last_became_peered":"2021-10-08T19:21:25.612541+0000","last_unstale":"2021-10-08T19:22:48.429945+0000","last_undegraded":"2021-10-08T19:22:48.429945+0000","last_fullsized":"2021-10-08T19:22:48.429945+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:21:24.589054+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:56.020956+0000","last_change":"2021-10-08T19:22:56.020836+0000","last_active":"2021-10-08T19:22:56.020956+0000","last_peered":"2021-10-08T19:22:56.020956+0000","last_clean":"2021-10-08T19:22:56.020956+0000","last_became_active":"2021-10-08T19:21:29.679050+0000","last_became_peered":"2021-10-08T19:21:29.679050+0000","last_unstale":"2021-10-08T19:22:56.020956+0000","last_undegraded":"2021-10-08T19:22:56.020956+0000","last_fullsized":"2021-10-08T19:22:56.020956+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:56.020759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:56.020759+0000","last_clean_scrub_stamp":"2021-10-08T19:22:56.020759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001373478,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.439508+0000","last_change":"2021-10-08T19:21:27.636975+0000","last_active":"2021-10-08T19:22:48.439508+0000","last_peered":"2021-10-08T19:22:48.439508+0000","last_clean":"2021-10-08T19:22:48.439508+0000","last_became_active":"2021-10-08T19:21:27.636398+0000","last_became_peered":"2021-10-08T19:21:27.636398+0000","last_unstale":"2021-10-08T19:22:48.439508+0000","last_undegraded":"2021-10-08T19:22:48.439508+0000","last_fullsized":"2021-10-08T19:22:48.439508+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:21:26.604244+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":51,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.439357+0000","last_change":"2021-10-08T19:22:46.422938+0000","last_active":"2021-10-08T19:22:48.439357+0000","last_peered":"2021-10-08T19:22:48.439357+0000","last_clean":"2021-10-08T19:22:48.439357+0000","last_became_active":"2021-10-08T19:22:43.936982+0000","last_became_peered":"2021-10-08T19:22:43.936982+0000","last_unstale":"2021-10-08T19:22:48.439357+0000","last_undegraded":"2021-10-08T19:22:48.439357+0000","last_fullsized":"2021-10-08T19:22:48.439357+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:46.422866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:46.422866+0000","last_clean_scrub_stamp":"2021-10-08T19:22:46.422866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0014556809999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"69'15","reported_seq":90,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:52.475188+0000","last_change":"2021-10-08T19:22:52.474731+0000","last_active":"2021-10-08T19:22:52.475188+0000","last_peered":"2021-10-08T19:22:52.475188+0000","last_clean":"2021-10-08T19:22:52.475188+0000","last_became_active":"2021-10-08T19:22:44.005356+0000","last_became_peered":"2021-10-08T19:22:44.005356+0000","last_unstale":"2021-10-08T19:22:52.475188+0000","last_undegraded":"2021-10-08T19:22:52.475188+0000","last_fullsized":"2021-10-08T19:22:52.475188+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'15","last_scrub_stamp":"2021-10-08T19:22:52.474651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:52.474651+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040638499999999999,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"69'1","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:50.227056+0000","last_change":"2021-10-08T19:22:50.226593+0000","last_active":"2021-10-08T19:22:50.227056+0000","last_peered":"2021-10-08T19:22:50.227056+0000","last_clean":"2021-10-08T19:22:50.227056+0000","last_became_active":"2021-10-08T19:21:29.637392+0000","last_became_peered":"2021-10-08T19:21:29.637392+0000","last_unstale":"2021-10-08T19:22:50.227056+0000","last_undegraded":"2021-10-08T19:22:50.227056+0000","last_fullsized":"2021-10-08T19:22:50.227056+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2021-10-08T19:22:50.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:50.226504+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040000080000000002,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:58.625367+0000","last_change":"2021-10-08T19:22:58.625225+0000","last_active":"2021-10-08T19:22:58.625367+0000","last_peered":"2021-10-08T19:22:58.625367+0000","last_clean":"2021-10-08T19:22:58.625367+0000","last_became_active":"2021-10-08T19:21:27.632648+0000","last_became_peered":"2021-10-08T19:21:27.632648+0000","last_unstale":"2021-10-08T19:22:58.625367+0000","last_undegraded":"2021-10-08T19:22:58.625367+0000","last_fullsized":"2021-10-08T19:22:58.625367+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:58.625153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:58.625153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0015820020000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.429184+0000","last_change":"2021-10-08T19:21:23.604120+0000","last_active":"2021-10-08T19:22:48.429184+0000","last_peered":"2021-10-08T19:22:48.429184+0000","last_clean":"2021-10-08T19:22:48.429184+0000","last_became_active":"2021-10-08T19:21:23.603777+0000","last_became_peered":"2021-10-08T19:21:23.603777+0000","last_unstale":"2021-10-08T19:22:48.429184+0000","last_undegraded":"2021-10-08T19:22:48.429184+0000","last_fullsized":"2021-10-08T19:22:48.429184+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:21:22.582293+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"69'11","reported_seq":59,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:53.420426+0000","last_change":"2021-10-08T19:22:53.420275+0000","last_active":"2021-10-08T19:22:53.420426+0000","last_peered":"2021-10-08T19:22:53.420426+0000","last_clean":"2021-10-08T19:22:53.420426+0000","last_became_active":"2021-10-08T19:21:25.610902+0000","last_became_peered":"2021-10-08T19:21:25.610902+0000","last_unstale":"2021-10-08T19:22:53.420426+0000","last_undegraded":"2021-10-08T19:22:53.420426+0000","last_fullsized":"2021-10-08T19:22:53.420426+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'11","last_scrub_stamp":"2021-10-08T19:22:53.420199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:53.420199+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0023910469999999999,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"69'1","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:04.311518+0000","last_change":"2021-10-08T19:23:04.311491+0000","last_active":"2021-10-08T19:23:04.311518+0000","last_peered":"2021-10-08T19:23:04.311518+0000","last_clean":"2021-10-08T19:23:04.311518+0000","last_became_active":"2021-10-08T19:21:29.640296+0000","last_became_peered":"2021-10-08T19:21:29.640296+0000","last_unstale":"2021-10-08T19:23:04.311518+0000","last_undegraded":"2021-10-08T19:23:04.311518+0000","last_fullsized":"2021-10-08T19:23:04.311518+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2021-10-08T19:23:04.311406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:04.311406+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0041668299999999998,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"69'8","reported_seq":70,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:01.718876+0000","last_change":"2021-10-08T19:22:43.380890+0000","last_active":"2021-10-08T19:23:01.718876+0000","last_peered":"2021-10-08T19:23:01.718876+0000","last_clean":"2021-10-08T19:23:01.718876+0000","last_became_active":"2021-10-08T19:21:27.638792+0000","last_became_peered":"2021-10-08T19:21:27.638792+0000","last_unstale":"2021-10-08T19:23:01.718876+0000","last_undegraded":"2021-10-08T19:23:01.718876+0000","last_fullsized":"2021-10-08T19:23:01.718876+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'8","last_scrub_stamp":"2021-10-08T19:22:43.380786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:43.380786+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002000403,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.438180+0000","last_change":"2021-10-08T19:21:23.604789+0000","last_active":"2021-10-08T19:22:48.438180+0000","last_peered":"2021-10-08T19:22:48.438180+0000","last_clean":"2021-10-08T19:22:48.438180+0000","last_became_active":"2021-10-08T19:21:23.604530+0000","last_became_peered":"2021-10-08T19:21:23.604530+0000","last_unstale":"2021-10-08T19:22:48.438180+0000","last_undegraded":"2021-10-08T19:22:48.438180+0000","last_fullsized":"2021-10-08T19:22:48.438180+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:21:22.582293+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"69'10","reported_seq":55,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.439415+0000","last_change":"2021-10-08T19:22:27.654003+0000","last_active":"2021-10-08T19:22:48.439415+0000","last_peered":"2021-10-08T19:22:48.439415+0000","last_clean":"2021-10-08T19:22:48.439415+0000","last_became_active":"2021-10-08T19:21:25.743519+0000","last_became_peered":"2021-10-08T19:21:25.743519+0000","last_unstale":"2021-10-08T19:22:48.439415+0000","last_undegraded":"2021-10-08T19:22:48.439415+0000","last_fullsized":"2021-10-08T19:22:48.439415+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'10","last_scrub_stamp":"2021-10-08T19:22:27.653872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:27.653872+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0028937009999999998,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:06.570945+0000","last_change":"2021-10-08T19:23:06.570919+0000","last_active":"2021-10-08T19:23:06.570945+0000","last_peered":"2021-10-08T19:23:06.570945+0000","last_clean":"2021-10-08T19:23:06.570945+0000","last_became_active":"2021-10-08T19:21:29.681023+0000","last_became_peered":"2021-10-08T19:21:29.681023+0000","last_unstale":"2021-10-08T19:23:06.570945+0000","last_undegraded":"2021-10-08T19:23:06.570945+0000","last_fullsized":"2021-10-08T19:23:06.570945+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:06.570853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:06.570853+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034079790000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.194984+0000","last_change":"2021-10-08T19:23:00.194960+0000","last_active":"2021-10-08T19:23:00.194984+0000","last_peered":"2021-10-08T19:23:00.194984+0000","last_clean":"2021-10-08T19:23:00.194984+0000","last_became_active":"2021-10-08T19:21:27.637131+0000","last_became_peered":"2021-10-08T19:21:27.637131+0000","last_unstale":"2021-10-08T19:23:00.194984+0000","last_undegraded":"2021-10-08T19:23:00.194984+0000","last_fullsized":"2021-10-08T19:23:00.194984+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:00.194892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:00.194892+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020373650000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.439635+0000","last_change":"2021-10-08T19:22:31.311191+0000","last_active":"2021-10-08T19:22:48.439635+0000","last_peered":"2021-10-08T19:22:48.439635+0000","last_clean":"2021-10-08T19:22:48.439635+0000","last_became_active":"2021-10-08T19:21:23.606708+0000","last_became_peered":"2021-10-08T19:21:23.606708+0000","last_unstale":"2021-10-08T19:22:48.439635+0000","last_undegraded":"2021-10-08T19:22:48.439635+0000","last_fullsized":"2021-10-08T19:22:48.439635+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:31.311083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:31.311083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0015648369999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"69'11","reported_seq":53,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.429390+0000","last_change":"2021-10-08T19:21:25.742854+0000","last_active":"2021-10-08T19:22:48.429390+0000","last_peered":"2021-10-08T19:22:48.429390+0000","last_clean":"2021-10-08T19:22:48.429390+0000","last_became_active":"2021-10-08T19:21:25.742586+0000","last_became_peered":"2021-10-08T19:21:25.742586+0000","last_unstale":"2021-10-08T19:22:48.429390+0000","last_undegraded":"2021-10-08T19:22:48.429390+0000","last_fullsized":"2021-10-08T19:22:48.429390+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:21:24.589054+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:52.059744+0000","last_change":"2021-10-08T19:22:52.059253+0000","last_active":"2021-10-08T19:22:52.059744+0000","last_peered":"2021-10-08T19:22:52.059744+0000","last_clean":"2021-10-08T19:22:52.059744+0000","last_became_active":"2021-10-08T19:21:29.642835+0000","last_became_peered":"2021-10-08T19:21:29.642835+0000","last_unstale":"2021-10-08T19:22:52.059744+0000","last_undegraded":"2021-10-08T19:22:52.059744+0000","last_fullsized":"2021-10-08T19:22:52.059744+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:52.059181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:52.059181+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034376540000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:02.446499+0000","last_change":"2021-10-08T19:23:02.446476+0000","last_active":"2021-10-08T19:23:02.446499+0000","last_peered":"2021-10-08T19:23:02.446499+0000","last_clean":"2021-10-08T19:23:02.446499+0000","last_became_active":"2021-10-08T19:21:27.643513+0000","last_became_peered":"2021-10-08T19:21:27.643513+0000","last_unstale":"2021-10-08T19:23:02.446499+0000","last_undegraded":"2021-10-08T19:23:02.446499+0000","last_fullsized":"2021-10-08T19:23:02.446499+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:02.446394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:02.446394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001225133,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.440741+0000","last_change":"2021-10-08T19:21:23.600451+0000","last_active":"2021-10-08T19:22:48.440741+0000","last_peered":"2021-10-08T19:22:48.440741+0000","last_clean":"2021-10-08T19:22:48.440741+0000","last_became_active":"2021-10-08T19:21:23.600192+0000","last_became_peered":"2021-10-08T19:21:23.600192+0000","last_unstale":"2021-10-08T19:22:48.440741+0000","last_undegraded":"2021-10-08T19:22:48.440741+0000","last_fullsized":"2021-10-08T19:22:48.440741+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:21:22.582293+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"69'4","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.429144+0000","last_change":"2021-10-08T19:22:34.447928+0000","last_active":"2021-10-08T19:22:48.429144+0000","last_peered":"2021-10-08T19:22:48.429144+0000","last_clean":"2021-10-08T19:22:48.429144+0000","last_became_active":"2021-10-08T19:21:25.612729+0000","last_became_peered":"2021-10-08T19:21:25.612729+0000","last_unstale":"2021-10-08T19:22:48.429144+0000","last_undegraded":"2021-10-08T19:22:48.429144+0000","last_fullsized":"2021-10-08T19:22:48.429144+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'4","last_scrub_stamp":"2021-10-08T19:22:34.447854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:34.447854+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040770490000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.429003+0000","last_change":"2021-10-08T19:21:29.649527+0000","last_active":"2021-10-08T19:22:48.429003+0000","last_peered":"2021-10-08T19:22:48.429003+0000","last_clean":"2021-10-08T19:22:48.429003+0000","last_became_active":"2021-10-08T19:21:29.649225+0000","last_became_peered":"2021-10-08T19:21:29.649225+0000","last_unstale":"2021-10-08T19:22:48.429003+0000","last_undegraded":"2021-10-08T19:22:48.429003+0000","last_fullsized":"2021-10-08T19:22:48.429003+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:21:28.621762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.438777+0000","last_change":"2021-10-08T19:22:43.186757+0000","last_active":"2021-10-08T19:22:48.438777+0000","last_peered":"2021-10-08T19:22:48.438777+0000","last_clean":"2021-10-08T19:22:48.438777+0000","last_became_active":"2021-10-08T19:21:27.635623+0000","last_became_peered":"2021-10-08T19:21:27.635623+0000","last_unstale":"2021-10-08T19:22:48.438777+0000","last_undegraded":"2021-10-08T19:22:48.438777+0000","last_fullsized":"2021-10-08T19:22:48.438777+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:43.186684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:43.186684+0000","last_clean_scrub_stamp":"2021-10-08T19:22:43.186684+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0015123129999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:02.242564+0000","last_change":"2021-10-08T19:23:02.242539+0000","last_active":"2021-10-08T19:23:02.242564+0000","last_peered":"2021-10-08T19:23:02.242564+0000","last_clean":"2021-10-08T19:23:02.242564+0000","last_became_active":"2021-10-08T19:21:23.607048+0000","last_became_peered":"2021-10-08T19:21:23.607048+0000","last_unstale":"2021-10-08T19:23:02.242564+0000","last_undegraded":"2021-10-08T19:23:02.242564+0000","last_fullsized":"2021-10-08T19:23:02.242564+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:02.242462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:02.242462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034031740000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"69'11","reported_seq":80,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.428611+0000","last_change":"2021-10-08T19:22:44.368163+0000","last_active":"2021-10-08T19:22:48.428611+0000","last_peered":"2021-10-08T19:22:48.428611+0000","last_clean":"2021-10-08T19:22:48.428611+0000","last_became_active":"2021-10-08T19:22:43.936354+0000","last_became_peered":"2021-10-08T19:22:43.936354+0000","last_unstale":"2021-10-08T19:22:48.428611+0000","last_undegraded":"2021-10-08T19:22:48.428611+0000","last_fullsized":"2021-10-08T19:22:48.428611+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'11","last_scrub_stamp":"2021-10-08T19:22:33.337032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:33.337032+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040894970000000001,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:02.605126+0000","last_change":"2021-10-08T19:23:02.605102+0000","last_active":"2021-10-08T19:23:02.605126+0000","last_peered":"2021-10-08T19:23:02.605126+0000","last_clean":"2021-10-08T19:23:02.605126+0000","last_became_active":"2021-10-08T19:21:29.641431+0000","last_became_peered":"2021-10-08T19:21:29.641431+0000","last_unstale":"2021-10-08T19:23:02.605126+0000","last_undegraded":"2021-10-08T19:23:02.605126+0000","last_fullsized":"2021-10-08T19:23:02.605126+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:02.605025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:02.605025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001265305,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.429830+0000","last_change":"2021-10-08T19:21:27.638133+0000","last_active":"2021-10-08T19:22:48.429830+0000","last_peered":"2021-10-08T19:22:48.429830+0000","last_clean":"2021-10-08T19:22:48.429830+0000","last_became_active":"2021-10-08T19:21:27.637800+0000","last_became_peered":"2021-10-08T19:21:27.637800+0000","last_unstale":"2021-10-08T19:22:48.429830+0000","last_undegraded":"2021-10-08T19:22:48.429830+0000","last_fullsized":"2021-10-08T19:22:48.429830+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:21:26.604244+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:52.409100+0000","last_change":"2021-10-08T19:22:52.408971+0000","last_active":"2021-10-08T19:22:52.409100+0000","last_peered":"2021-10-08T19:22:52.409100+0000","last_clean":"2021-10-08T19:22:52.409100+0000","last_became_active":"2021-10-08T19:21:23.606797+0000","last_became_peered":"2021-10-08T19:21:23.606797+0000","last_unstale":"2021-10-08T19:22:52.409100+0000","last_undegraded":"2021-10-08T19:22:52.409100+0000","last_fullsized":"2021-10-08T19:22:52.409100+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:52.408893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:52.408893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0015921889999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"87'13","reported_seq":60,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:53.263815+0000","last_change":"2021-10-08T19:22:53.263693+0000","last_active":"2021-10-08T19:22:53.263815+0000","last_peered":"2021-10-08T19:22:53.263815+0000","last_clean":"2021-10-08T19:22:53.263815+0000","last_became_active":"2021-10-08T19:21:25.615596+0000","last_became_peered":"2021-10-08T19:21:25.615596+0000","last_unstale":"2021-10-08T19:22:53.263815+0000","last_undegraded":"2021-10-08T19:22:53.263815+0000","last_fullsized":"2021-10-08T19:22:53.263815+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'13","last_scrub_stamp":"2021-10-08T19:22:53.263631+0000","last_deep_scrub":"87'13","last_deep_scrub_stamp":"2021-10-08T19:22:53.263631+0000","last_clean_scrub_stamp":"2021-10-08T19:22:53.263631+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0036954140000000002,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:49.049561+0000","last_change":"2021-10-08T19:22:49.049456+0000","last_active":"2021-10-08T19:22:49.049561+0000","last_peered":"2021-10-08T19:22:49.049561+0000","last_clean":"2021-10-08T19:22:49.049561+0000","last_became_active":"2021-10-08T19:21:29.640302+0000","last_became_peered":"2021-10-08T19:21:29.640302+0000","last_unstale":"2021-10-08T19:22:49.049561+0000","last_undegraded":"2021-10-08T19:22:49.049561+0000","last_fullsized":"2021-10-08T19:22:49.049561+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:49.049379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:49.049379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.00162856,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"69'8","reported_seq":67,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:01.718647+0000","last_change":"2021-10-08T19:22:32.372773+0000","last_active":"2021-10-08T19:23:01.718647+0000","last_peered":"2021-10-08T19:23:01.718647+0000","last_clean":"2021-10-08T19:23:01.718647+0000","last_became_active":"2021-10-08T19:21:27.636440+0000","last_became_peered":"2021-10-08T19:21:27.636440+0000","last_unstale":"2021-10-08T19:23:01.718647+0000","last_undegraded":"2021-10-08T19:23:01.718647+0000","last_fullsized":"2021-10-08T19:23:01.718647+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'8","last_scrub_stamp":"2021-10-08T19:22:32.372699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:32.372699+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039965820000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.439659+0000","last_change":"2021-10-08T19:22:24.698543+0000","last_active":"2021-10-08T19:22:48.439659+0000","last_peered":"2021-10-08T19:22:48.439659+0000","last_clean":"2021-10-08T19:22:48.439659+0000","last_became_active":"2021-10-08T19:21:23.606478+0000","last_became_peered":"2021-10-08T19:21:23.606478+0000","last_unstale":"2021-10-08T19:22:48.439659+0000","last_undegraded":"2021-10-08T19:22:48.439659+0000","last_fullsized":"2021-10-08T19:22:48.439659+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:24.698471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:24.698471+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001682846,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"69'9","reported_seq":56,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.440816+0000","last_change":"2021-10-08T19:22:42.517875+0000","last_active":"2021-10-08T19:22:48.440816+0000","last_peered":"2021-10-08T19:22:48.440816+0000","last_clean":"2021-10-08T19:22:48.440816+0000","last_became_active":"2021-10-08T19:21:25.741755+0000","last_became_peered":"2021-10-08T19:21:25.741755+0000","last_unstale":"2021-10-08T19:22:48.440816+0000","last_undegraded":"2021-10-08T19:22:48.440816+0000","last_fullsized":"2021-10-08T19:22:48.440816+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'9","last_scrub_stamp":"2021-10-08T19:22:42.517786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:42.517786+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0042286850000000003,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.439224+0000","last_change":"2021-10-08T19:21:29.646674+0000","last_active":"2021-10-08T19:22:48.439224+0000","last_peered":"2021-10-08T19:22:48.439224+0000","last_clean":"2021-10-08T19:22:48.439224+0000","last_became_active":"2021-10-08T19:21:29.646331+0000","last_became_peered":"2021-10-08T19:21:29.646331+0000","last_unstale":"2021-10-08T19:22:48.439224+0000","last_undegraded":"2021-10-08T19:22:48.439224+0000","last_fullsized":"2021-10-08T19:22:48.439224+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:21:28.621762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"69'8","reported_seq":67,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:01.718905+0000","last_change":"2021-10-08T19:22:28.467610+0000","last_active":"2021-10-08T19:23:01.718905+0000","last_peered":"2021-10-08T19:23:01.718905+0000","last_clean":"2021-10-08T19:23:01.718905+0000","last_became_active":"2021-10-08T19:21:27.635924+0000","last_became_peered":"2021-10-08T19:21:27.635924+0000","last_unstale":"2021-10-08T19:23:01.718905+0000","last_undegraded":"2021-10-08T19:23:01.718905+0000","last_fullsized":"2021-10-08T19:23:01.718905+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'8","last_scrub_stamp":"2021-10-08T19:22:28.467539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:28.467539+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039782960000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:04.759574+0000","last_change":"2021-10-08T19:23:04.759546+0000","last_active":"2021-10-08T19:23:04.759574+0000","last_peered":"2021-10-08T19:23:04.759574+0000","last_clean":"2021-10-08T19:23:04.759574+0000","last_became_active":"2021-10-08T19:21:23.603637+0000","last_became_peered":"2021-10-08T19:21:23.603637+0000","last_unstale":"2021-10-08T19:23:04.759574+0000","last_undegraded":"2021-10-08T19:23:04.759574+0000","last_fullsized":"2021-10-08T19:23:04.759574+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:04.759470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:04.759470+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001376447,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"69'10","reported_seq":55,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:52.611610+0000","last_change":"2021-10-08T19:22:52.611146+0000","last_active":"2021-10-08T19:22:52.611610+0000","last_peered":"2021-10-08T19:22:52.611610+0000","last_clean":"2021-10-08T19:22:52.611610+0000","last_became_active":"2021-10-08T19:21:25.741716+0000","last_became_peered":"2021-10-08T19:21:25.741716+0000","last_unstale":"2021-10-08T19:22:52.611610+0000","last_undegraded":"2021-10-08T19:22:52.611610+0000","last_fullsized":"2021-10-08T19:22:52.611610+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'10","last_scrub_stamp":"2021-10-08T19:22:52.611060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:52.611060+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040684459999999999,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.439304+0000","last_change":"2021-10-08T19:22:36.973546+0000","last_active":"2021-10-08T19:22:48.439304+0000","last_peered":"2021-10-08T19:22:48.439304+0000","last_clean":"2021-10-08T19:22:48.439304+0000","last_became_active":"2021-10-08T19:21:29.681255+0000","last_became_peered":"2021-10-08T19:21:29.681255+0000","last_unstale":"2021-10-08T19:22:48.439304+0000","last_undegraded":"2021-10-08T19:22:48.439304+0000","last_fullsized":"2021-10-08T19:22:48.439304+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:36.973452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:36.973452+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001482431,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:50.573566+0000","last_change":"2021-10-08T19:22:50.573085+0000","last_active":"2021-10-08T19:22:50.573566+0000","last_peered":"2021-10-08T19:22:50.573566+0000","last_clean":"2021-10-08T19:22:50.573566+0000","last_became_active":"2021-10-08T19:21:27.634443+0000","last_became_peered":"2021-10-08T19:21:27.634443+0000","last_unstale":"2021-10-08T19:22:50.573566+0000","last_undegraded":"2021-10-08T19:22:50.573566+0000","last_fullsized":"2021-10-08T19:22:50.573566+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:50.573010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:50.573010+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034131029999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.439487+0000","last_change":"2021-10-08T19:22:35.361033+0000","last_active":"2021-10-08T19:22:48.439487+0000","last_peered":"2021-10-08T19:22:48.439487+0000","last_clean":"2021-10-08T19:22:48.439487+0000","last_became_active":"2021-10-08T19:21:23.611362+0000","last_became_peered":"2021-10-08T19:21:23.611362+0000","last_unstale":"2021-10-08T19:22:48.439487+0000","last_undegraded":"2021-10-08T19:22:48.439487+0000","last_fullsized":"2021-10-08T19:22:48.439487+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:35.360970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:35.360970+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001166795,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"69'6","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.430212+0000","last_change":"2021-10-08T19:21:25.742930+0000","last_active":"2021-10-08T19:22:48.430212+0000","last_peered":"2021-10-08T19:22:48.430212+0000","last_clean":"2021-10-08T19:22:48.430212+0000","last_became_active":"2021-10-08T19:21:25.742631+0000","last_became_peered":"2021-10-08T19:21:25.742631+0000","last_unstale":"2021-10-08T19:22:48.430212+0000","last_undegraded":"2021-10-08T19:22:48.430212+0000","last_fullsized":"2021-10-08T19:22:48.430212+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:21:24.589054+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.428422+0000","last_change":"2021-10-08T19:22:40.421310+0000","last_active":"2021-10-08T19:22:48.428422+0000","last_peered":"2021-10-08T19:22:48.428422+0000","last_clean":"2021-10-08T19:22:48.428422+0000","last_became_active":"2021-10-08T19:21:29.640674+0000","last_became_peered":"2021-10-08T19:21:29.640674+0000","last_unstale":"2021-10-08T19:22:48.428422+0000","last_undegraded":"2021-10-08T19:22:48.428422+0000","last_fullsized":"2021-10-08T19:22:48.428422+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:40.421229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.421229+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034873370000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.430293+0000","last_change":"2021-10-08T19:22:36.466178+0000","last_active":"2021-10-08T19:22:48.430293+0000","last_peered":"2021-10-08T19:22:48.430293+0000","last_clean":"2021-10-08T19:22:48.430293+0000","last_became_active":"2021-10-08T19:21:27.638112+0000","last_became_peered":"2021-10-08T19:21:27.638112+0000","last_unstale":"2021-10-08T19:22:48.430293+0000","last_undegraded":"2021-10-08T19:22:48.430293+0000","last_fullsized":"2021-10-08T19:22:48.430293+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:36.466077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:36.466077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0018534809999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.428025+0000","last_change":"2021-10-08T19:22:24.268774+0000","last_active":"2021-10-08T19:22:48.428025+0000","last_peered":"2021-10-08T19:22:48.428025+0000","last_clean":"2021-10-08T19:22:48.428025+0000","last_became_active":"2021-10-08T19:21:23.598125+0000","last_became_peered":"2021-10-08T19:21:23.598125+0000","last_unstale":"2021-10-08T19:22:48.428025+0000","last_undegraded":"2021-10-08T19:22:48.428025+0000","last_fullsized":"2021-10-08T19:22:48.428025+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:24.268699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:24.268699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001617215,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"69'9","reported_seq":56,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.644563+0000","last_change":"2021-10-08T19:23:00.644527+0000","last_active":"2021-10-08T19:23:00.644563+0000","last_peered":"2021-10-08T19:23:00.644563+0000","last_clean":"2021-10-08T19:23:00.644563+0000","last_became_active":"2021-10-08T19:21:25.743804+0000","last_became_peered":"2021-10-08T19:21:25.743804+0000","last_unstale":"2021-10-08T19:23:00.644563+0000","last_undegraded":"2021-10-08T19:23:00.644563+0000","last_fullsized":"2021-10-08T19:23:00.644563+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'9","last_scrub_stamp":"2021-10-08T19:23:00.644449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:00.644449+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0023246959999999998,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.429852+0000","last_change":"2021-10-08T19:21:29.647439+0000","last_active":"2021-10-08T19:22:48.429852+0000","last_peered":"2021-10-08T19:22:48.429852+0000","last_clean":"2021-10-08T19:22:48.429852+0000","last_became_active":"2021-10-08T19:21:29.647140+0000","last_became_peered":"2021-10-08T19:21:29.647140+0000","last_unstale":"2021-10-08T19:22:48.429852+0000","last_undegraded":"2021-10-08T19:22:48.429852+0000","last_fullsized":"2021-10-08T19:22:48.429852+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:21:28.621762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"61'2","reported_seq":58,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:07.991495+0000","last_change":"2021-10-08T19:23:07.991466+0000","last_active":"2021-10-08T19:23:07.991495+0000","last_peered":"2021-10-08T19:23:07.991495+0000","last_clean":"2021-10-08T19:23:07.991495+0000","last_became_active":"2021-10-08T19:21:23.603614+0000","last_became_peered":"2021-10-08T19:21:23.603614+0000","last_unstale":"2021-10-08T19:23:07.991495+0000","last_undegraded":"2021-10-08T19:23:07.991495+0000","last_fullsized":"2021-10-08T19:23:07.991495+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'2","last_scrub_stamp":"2021-10-08T19:23:07.991388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:07.991388+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001614983,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"69'12","reported_seq":63,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:57.004206+0000","last_change":"2021-10-08T19:22:57.003718+0000","last_active":"2021-10-08T19:22:57.004206+0000","last_peered":"2021-10-08T19:22:57.004206+0000","last_clean":"2021-10-08T19:22:57.004206+0000","last_became_active":"2021-10-08T19:21:25.609079+0000","last_became_peered":"2021-10-08T19:21:25.609079+0000","last_unstale":"2021-10-08T19:22:57.004206+0000","last_undegraded":"2021-10-08T19:22:57.004206+0000","last_fullsized":"2021-10-08T19:22:57.004206+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'12","last_scrub_stamp":"2021-10-08T19:22:57.003641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:57.003641+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0041017010000000001,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:50.435743+0000","last_change":"2021-10-08T19:22:50.435623+0000","last_active":"2021-10-08T19:22:50.435743+0000","last_peered":"2021-10-08T19:22:50.435743+0000","last_clean":"2021-10-08T19:22:50.435743+0000","last_became_active":"2021-10-08T19:21:27.633878+0000","last_became_peered":"2021-10-08T19:21:27.633878+0000","last_unstale":"2021-10-08T19:22:50.435743+0000","last_undegraded":"2021-10-08T19:22:50.435743+0000","last_fullsized":"2021-10-08T19:22:50.435743+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:50.435552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:50.435552+0000","last_clean_scrub_stamp":"2021-10-08T19:22:50.435552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0012976140000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.438192+0000","last_change":"2021-10-08T19:22:46.569728+0000","last_active":"2021-10-08T19:22:48.438192+0000","last_peered":"2021-10-08T19:22:48.438192+0000","last_clean":"2021-10-08T19:22:48.438192+0000","last_became_active":"2021-10-08T19:21:29.649735+0000","last_became_peered":"2021-10-08T19:21:29.649735+0000","last_unstale":"2021-10-08T19:22:48.438192+0000","last_undegraded":"2021-10-08T19:22:48.438192+0000","last_fullsized":"2021-10-08T19:22:48.438192+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:46.569603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:46.569603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001693387,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.439274+0000","last_change":"2021-10-08T19:22:39.168725+0000","last_active":"2021-10-08T19:22:48.439274+0000","last_peered":"2021-10-08T19:22:48.439274+0000","last_clean":"2021-10-08T19:22:48.439274+0000","last_became_active":"2021-10-08T19:21:23.605441+0000","last_became_peered":"2021-10-08T19:21:23.605441+0000","last_unstale":"2021-10-08T19:22:48.439274+0000","last_undegraded":"2021-10-08T19:22:48.439274+0000","last_fullsized":"2021-10-08T19:22:48.439274+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:39.168642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:39.168642+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001714901,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"69'10","reported_seq":55,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:54.269332+0000","last_change":"2021-10-08T19:22:54.269202+0000","last_active":"2021-10-08T19:22:54.269332+0000","last_peered":"2021-10-08T19:22:54.269332+0000","last_clean":"2021-10-08T19:22:54.269332+0000","last_became_active":"2021-10-08T19:21:25.608581+0000","last_became_peered":"2021-10-08T19:21:25.608581+0000","last_unstale":"2021-10-08T19:22:54.269332+0000","last_undegraded":"2021-10-08T19:22:54.269332+0000","last_fullsized":"2021-10-08T19:22:54.269332+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'10","last_scrub_stamp":"2021-10-08T19:22:54.269123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:54.269123+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0024762310000000002,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"69'8","reported_seq":67,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:01.718597+0000","last_change":"2021-10-08T19:22:32.603483+0000","last_active":"2021-10-08T19:23:01.718597+0000","last_peered":"2021-10-08T19:23:01.718597+0000","last_clean":"2021-10-08T19:23:01.718597+0000","last_became_active":"2021-10-08T19:21:27.636151+0000","last_became_peered":"2021-10-08T19:21:27.636151+0000","last_unstale":"2021-10-08T19:23:01.718597+0000","last_undegraded":"2021-10-08T19:23:01.718597+0000","last_fullsized":"2021-10-08T19:23:01.718597+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'8","last_scrub_stamp":"2021-10-08T19:22:32.603379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:32.603379+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0022390349999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.430106+0000","last_change":"2021-10-08T19:21:29.647729+0000","last_active":"2021-10-08T19:22:48.430106+0000","last_peered":"2021-10-08T19:22:48.430106+0000","last_clean":"2021-10-08T19:22:48.430106+0000","last_became_active":"2021-10-08T19:21:29.647403+0000","last_became_peered":"2021-10-08T19:21:29.647403+0000","last_unstale":"2021-10-08T19:22:48.430106+0000","last_undegraded":"2021-10-08T19:22:48.430106+0000","last_fullsized":"2021-10-08T19:22:48.430106+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:21:28.621762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:01.747062+0000","last_change":"2021-10-08T19:23:01.747028+0000","last_active":"2021-10-08T19:23:01.747062+0000","last_peered":"2021-10-08T19:23:01.747062+0000","last_clean":"2021-10-08T19:23:01.747062+0000","last_became_active":"2021-10-08T19:21:23.601309+0000","last_became_peered":"2021-10-08T19:21:23.601309+0000","last_unstale":"2021-10-08T19:23:01.747062+0000","last_undegraded":"2021-10-08T19:23:01.747062+0000","last_fullsized":"2021-10-08T19:23:01.747062+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:01.746914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:01.746914+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001402506,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"69'28","reported_seq":109,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:01.718573+0000","last_change":"2021-10-08T19:22:40.195245+0000","last_active":"2021-10-08T19:23:01.718573+0000","last_peered":"2021-10-08T19:23:01.718573+0000","last_clean":"2021-10-08T19:23:01.718573+0000","last_became_active":"2021-10-08T19:21:25.613663+0000","last_became_peered":"2021-10-08T19:21:25.613663+0000","last_unstale":"2021-10-08T19:23:01.718573+0000","last_undegraded":"2021-10-08T19:23:01.718573+0000","last_fullsized":"2021-10-08T19:23:01.718573+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'28","last_scrub_stamp":"2021-10-08T19:22:40.195166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.195166+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0029295340000000001,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:03.639051+0000","last_change":"2021-10-08T19:23:03.639015+0000","last_active":"2021-10-08T19:23:03.639051+0000","last_peered":"2021-10-08T19:23:03.639051+0000","last_clean":"2021-10-08T19:23:03.639051+0000","last_became_active":"2021-10-08T19:21:27.636192+0000","last_became_peered":"2021-10-08T19:21:27.636192+0000","last_unstale":"2021-10-08T19:23:03.639051+0000","last_undegraded":"2021-10-08T19:23:03.639051+0000","last_fullsized":"2021-10-08T19:23:03.639051+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:03.638920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:03.638920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0016933230000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:01.215702+0000","last_change":"2021-10-08T19:23:01.215676+0000","last_active":"2021-10-08T19:23:01.215702+0000","last_peered":"2021-10-08T19:23:01.215702+0000","last_clean":"2021-10-08T19:23:01.215702+0000","last_became_active":"2021-10-08T19:21:29.679259+0000","last_became_peered":"2021-10-08T19:21:29.679259+0000","last_unstale":"2021-10-08T19:23:01.215702+0000","last_undegraded":"2021-10-08T19:23:01.215702+0000","last_fullsized":"2021-10-08T19:23:01.215702+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:01.215579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:01.215579+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001463748,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"70'5","reported_seq":143,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:07.175830+0000","last_change":"2021-10-08T19:22:48.239798+0000","last_active":"2021-10-08T19:23:07.175830+0000","last_peered":"2021-10-08T19:23:07.175830+0000","last_clean":"2021-10-08T19:23:07.175830+0000","last_became_active":"2021-10-08T19:21:23.601969+0000","last_became_peered":"2021-10-08T19:21:23.601969+0000","last_unstale":"2021-10-08T19:23:07.175830+0000","last_undegraded":"2021-10-08T19:23:07.175830+0000","last_fullsized":"2021-10-08T19:23:07.175830+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:22:48.239721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:48.239721+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001618092,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":98,"num_read_kb":93,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:53.423462+0000","last_change":"2021-10-08T19:22:53.423318+0000","last_active":"2021-10-08T19:22:53.423462+0000","last_peered":"2021-10-08T19:22:53.423462+0000","last_clean":"2021-10-08T19:22:53.423462+0000","last_became_active":"2021-10-08T19:21:23.602967+0000","last_became_peered":"2021-10-08T19:21:23.602967+0000","last_unstale":"2021-10-08T19:22:53.423462+0000","last_undegraded":"2021-10-08T19:22:53.423462+0000","last_fullsized":"2021-10-08T19:22:53.423462+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:53.423249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:53.423249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001264587,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"69'13","reported_seq":67,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.439589+0000","last_change":"2021-10-08T19:22:46.281753+0000","last_active":"2021-10-08T19:22:48.439589+0000","last_peered":"2021-10-08T19:22:48.439589+0000","last_clean":"2021-10-08T19:22:48.439589+0000","last_became_active":"2021-10-08T19:21:25.608584+0000","last_became_peered":"2021-10-08T19:21:25.608584+0000","last_unstale":"2021-10-08T19:22:48.439589+0000","last_undegraded":"2021-10-08T19:22:48.439589+0000","last_fullsized":"2021-10-08T19:22:48.439589+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'13","last_scrub_stamp":"2021-10-08T19:22:46.281626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:46.281626+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0047889999999999999,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:06.487881+0000","last_change":"2021-10-08T19:23:06.487842+0000","last_active":"2021-10-08T19:23:06.487881+0000","last_peered":"2021-10-08T19:23:06.487881+0000","last_clean":"2021-10-08T19:23:06.487881+0000","last_became_active":"2021-10-08T19:21:27.637875+0000","last_became_peered":"2021-10-08T19:21:27.637875+0000","last_unstale":"2021-10-08T19:23:06.487881+0000","last_undegraded":"2021-10-08T19:23:06.487881+0000","last_fullsized":"2021-10-08T19:23:06.487881+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:06.487723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:06.487723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034218619999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.440903+0000","last_change":"2021-10-08T19:21:29.646537+0000","last_active":"2021-10-08T19:22:48.440903+0000","last_peered":"2021-10-08T19:22:48.440903+0000","last_clean":"2021-10-08T19:22:48.440903+0000","last_became_active":"2021-10-08T19:21:29.646242+0000","last_became_peered":"2021-10-08T19:21:29.646242+0000","last_unstale":"2021-10-08T19:22:48.440903+0000","last_undegraded":"2021-10-08T19:22:48.440903+0000","last_fullsized":"2021-10-08T19:22:48.440903+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:21:28.621762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.429499+0000","last_change":"2021-10-08T19:22:40.563324+0000","last_active":"2021-10-08T19:22:48.429499+0000","last_peered":"2021-10-08T19:22:48.429499+0000","last_clean":"2021-10-08T19:22:48.429499+0000","last_became_active":"2021-10-08T19:21:23.608665+0000","last_became_peered":"2021-10-08T19:21:23.608665+0000","last_unstale":"2021-10-08T19:22:48.429499+0000","last_undegraded":"2021-10-08T19:22:48.429499+0000","last_fullsized":"2021-10-08T19:22:48.429499+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:40.563247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.563247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.024890005999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.439242+0000","last_change":"2021-10-08T19:21:23.599479+0000","last_active":"2021-10-08T19:22:48.439242+0000","last_peered":"2021-10-08T19:22:48.439242+0000","last_clean":"2021-10-08T19:22:48.439242+0000","last_became_active":"2021-10-08T19:21:23.599143+0000","last_became_peered":"2021-10-08T19:21:23.599143+0000","last_unstale":"2021-10-08T19:22:48.439242+0000","last_undegraded":"2021-10-08T19:22:48.439242+0000","last_fullsized":"2021-10-08T19:22:48.439242+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:21:22.582293+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"73'128","reported_seq":291,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.438557+0000","last_change":"2021-10-08T19:22:13.939106+0000","last_active":"2021-10-08T19:22:48.438557+0000","last_peered":"2021-10-08T19:22:48.438557+0000","last_clean":"2021-10-08T19:22:48.438557+0000","last_became_active":"2021-10-08T19:21:19.594086+0000","last_became_peered":"2021-10-08T19:21:19.594086+0000","last_unstale":"2021-10-08T19:22:48.438557+0000","last_undegraded":"2021-10-08T19:22:48.438557+0000","last_fullsized":"2021-10-08T19:22:48.438557+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'128","last_scrub_stamp":"2021-10-08T19:22:13.939025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:19:44.414003+0000","last_clean_scrub_stamp":"2021-10-08T19:22:13.939025+0000","log_size":128,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020087920000000001,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"69'14","reported_seq":62,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:54.379580+0000","last_change":"2021-10-08T19:22:54.379424+0000","last_active":"2021-10-08T19:22:54.379580+0000","last_peered":"2021-10-08T19:22:54.379580+0000","last_clean":"2021-10-08T19:22:54.379580+0000","last_became_active":"2021-10-08T19:21:25.743499+0000","last_became_peered":"2021-10-08T19:21:25.743499+0000","last_unstale":"2021-10-08T19:22:54.379580+0000","last_undegraded":"2021-10-08T19:22:54.379580+0000","last_fullsized":"2021-10-08T19:22:54.379580+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'14","last_scrub_stamp":"2021-10-08T19:22:54.379349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:54.379349+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0021365989999999999,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:02.267604+0000","last_change":"2021-10-08T19:23:02.267580+0000","last_active":"2021-10-08T19:23:02.267604+0000","last_peered":"2021-10-08T19:23:02.267604+0000","last_clean":"2021-10-08T19:23:02.267604+0000","last_became_active":"2021-10-08T19:21:27.636086+0000","last_became_peered":"2021-10-08T19:21:27.636086+0000","last_unstale":"2021-10-08T19:23:02.267604+0000","last_undegraded":"2021-10-08T19:23:02.267604+0000","last_fullsized":"2021-10-08T19:23:02.267604+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:02.267508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:02.267508+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034499700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:55.235130+0000","last_change":"2021-10-08T19:22:55.234981+0000","last_active":"2021-10-08T19:22:55.235130+0000","last_peered":"2021-10-08T19:22:55.235130+0000","last_clean":"2021-10-08T19:22:55.235130+0000","last_became_active":"2021-10-08T19:21:29.648784+0000","last_became_peered":"2021-10-08T19:21:29.648784+0000","last_unstale":"2021-10-08T19:22:55.235130+0000","last_undegraded":"2021-10-08T19:22:55.235130+0000","last_fullsized":"2021-10-08T19:22:55.235130+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:55.234909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:55.234909+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0014461070000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.438607+0000","last_change":"2021-10-08T19:22:31.557761+0000","last_active":"2021-10-08T19:22:48.438607+0000","last_peered":"2021-10-08T19:22:48.438607+0000","last_clean":"2021-10-08T19:22:48.438607+0000","last_became_active":"2021-10-08T19:21:23.602857+0000","last_became_peered":"2021-10-08T19:21:23.602857+0000","last_unstale":"2021-10-08T19:22:48.438607+0000","last_undegraded":"2021-10-08T19:22:48.438607+0000","last_fullsized":"2021-10-08T19:22:48.438607+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:31.557650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:31.557650+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001454997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.438457+0000","last_change":"2021-10-08T19:22:32.922768+0000","last_active":"2021-10-08T19:22:48.438457+0000","last_peered":"2021-10-08T19:22:48.438457+0000","last_clean":"2021-10-08T19:22:48.438457+0000","last_became_active":"2021-10-08T19:21:23.606755+0000","last_became_peered":"2021-10-08T19:21:23.606755+0000","last_unstale":"2021-10-08T19:22:48.438457+0000","last_undegraded":"2021-10-08T19:22:48.438457+0000","last_fullsized":"2021-10-08T19:22:48.438457+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:32.922694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:32.922694+0000","last_clean_scrub_stamp":"2021-10-08T19:22:32.922694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001758531,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"69'12","reported_seq":58,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:55.640154+0000","last_change":"2021-10-08T19:22:55.639993+0000","last_active":"2021-10-08T19:22:55.640154+0000","last_peered":"2021-10-08T19:22:55.640154+0000","last_clean":"2021-10-08T19:22:55.640154+0000","last_became_active":"2021-10-08T19:21:25.610233+0000","last_became_peered":"2021-10-08T19:21:25.610233+0000","last_unstale":"2021-10-08T19:22:55.640154+0000","last_undegraded":"2021-10-08T19:22:55.640154+0000","last_fullsized":"2021-10-08T19:22:55.640154+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'12","last_scrub_stamp":"2021-10-08T19:22:55.639881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:55.639881+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0032422169999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.440916+0000","last_change":"2021-10-08T19:22:34.475012+0000","last_active":"2021-10-08T19:22:48.440916+0000","last_peered":"2021-10-08T19:22:48.440916+0000","last_clean":"2021-10-08T19:22:48.440916+0000","last_became_active":"2021-10-08T19:21:27.635800+0000","last_became_peered":"2021-10-08T19:21:27.635800+0000","last_unstale":"2021-10-08T19:22:48.440916+0000","last_undegraded":"2021-10-08T19:22:48.440916+0000","last_fullsized":"2021-10-08T19:22:48.440916+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:34.474918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:34.474918+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0037343509999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:06.155184+0000","last_change":"2021-10-08T19:23:06.155149+0000","last_active":"2021-10-08T19:23:06.155184+0000","last_peered":"2021-10-08T19:23:06.155184+0000","last_clean":"2021-10-08T19:23:06.155184+0000","last_became_active":"2021-10-08T19:21:29.679477+0000","last_became_peered":"2021-10-08T19:21:29.679477+0000","last_unstale":"2021-10-08T19:23:06.155184+0000","last_undegraded":"2021-10-08T19:23:06.155184+0000","last_fullsized":"2021-10-08T19:23:06.155184+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:06.155068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:06.155068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001436805,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"61'1","reported_seq":49,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.439612+0000","last_change":"2021-10-08T19:22:26.905589+0000","last_active":"2021-10-08T19:22:48.439612+0000","last_peered":"2021-10-08T19:22:48.439612+0000","last_clean":"2021-10-08T19:22:48.439612+0000","last_became_active":"2021-10-08T19:21:23.604258+0000","last_became_peered":"2021-10-08T19:21:23.604258+0000","last_unstale":"2021-10-08T19:22:48.439612+0000","last_undegraded":"2021-10-08T19:22:48.439612+0000","last_fullsized":"2021-10-08T19:22:48.439612+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'1","last_scrub_stamp":"2021-10-08T19:22:26.905517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:26.905517+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001822178,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"69'19","reported_seq":76,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.439619+0000","last_change":"2021-10-08T19:22:29.614784+0000","last_active":"2021-10-08T19:22:48.439619+0000","last_peered":"2021-10-08T19:22:48.439619+0000","last_clean":"2021-10-08T19:22:48.439619+0000","last_became_active":"2021-10-08T19:21:25.741812+0000","last_became_peered":"2021-10-08T19:21:25.741812+0000","last_unstale":"2021-10-08T19:22:48.439619+0000","last_undegraded":"2021-10-08T19:22:48.439619+0000","last_fullsized":"2021-10-08T19:22:48.439619+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'19","last_scrub_stamp":"2021-10-08T19:22:29.614706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:29.614706+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0024396359999999998,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.439280+0000","last_change":"2021-10-08T19:22:42.399514+0000","last_active":"2021-10-08T19:22:48.439280+0000","last_peered":"2021-10-08T19:22:48.439280+0000","last_clean":"2021-10-08T19:22:48.439280+0000","last_became_active":"2021-10-08T19:21:27.637846+0000","last_became_peered":"2021-10-08T19:21:27.637846+0000","last_unstale":"2021-10-08T19:22:48.439280+0000","last_undegraded":"2021-10-08T19:22:48.439280+0000","last_fullsized":"2021-10-08T19:22:48.439280+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:42.399412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:42.399412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0019951610000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.428557+0000","last_change":"2021-10-08T19:22:40.264230+0000","last_active":"2021-10-08T19:22:48.428557+0000","last_peered":"2021-10-08T19:22:48.428557+0000","last_clean":"2021-10-08T19:22:48.428557+0000","last_became_active":"2021-10-08T19:21:29.646491+0000","last_became_peered":"2021-10-08T19:21:29.646491+0000","last_unstale":"2021-10-08T19:22:48.428557+0000","last_undegraded":"2021-10-08T19:22:48.428557+0000","last_fullsized":"2021-10-08T19:22:48.428557+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:40.264110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.264110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003475845,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.438995+0000","last_change":"2021-10-08T19:22:41.187045+0000","last_active":"2021-10-08T19:22:48.438995+0000","last_peered":"2021-10-08T19:22:48.438995+0000","last_clean":"2021-10-08T19:22:48.438995+0000","last_became_active":"2021-10-08T19:21:23.607770+0000","last_became_peered":"2021-10-08T19:21:23.607770+0000","last_unstale":"2021-10-08T19:22:48.438995+0000","last_undegraded":"2021-10-08T19:22:48.438995+0000","last_fullsized":"2021-10-08T19:22:48.438995+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:41.186945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:41.186945+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0037557269999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"69'18","reported_seq":66,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.429004+0000","last_change":"2021-10-08T19:21:25.743203+0000","last_active":"2021-10-08T19:22:48.429004+0000","last_peered":"2021-10-08T19:22:48.429004+0000","last_clean":"2021-10-08T19:22:48.429004+0000","last_became_active":"2021-10-08T19:21:25.742909+0000","last_became_peered":"2021-10-08T19:21:25.742909+0000","last_unstale":"2021-10-08T19:22:48.429004+0000","last_undegraded":"2021-10-08T19:22:48.429004+0000","last_fullsized":"2021-10-08T19:22:48.429004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:21:24.589054+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:52.022288+0000","last_change":"2021-10-08T19:22:52.021819+0000","last_active":"2021-10-08T19:22:52.022288+0000","last_peered":"2021-10-08T19:22:52.022288+0000","last_clean":"2021-10-08T19:22:52.022288+0000","last_became_active":"2021-10-08T19:21:27.637547+0000","last_became_peered":"2021-10-08T19:21:27.637547+0000","last_unstale":"2021-10-08T19:22:52.022288+0000","last_undegraded":"2021-10-08T19:22:52.022288+0000","last_fullsized":"2021-10-08T19:22:52.022288+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:52.021733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:52.021733+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034012640000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:05.263610+0000","last_change":"2021-10-08T19:23:05.263582+0000","last_active":"2021-10-08T19:23:05.263610+0000","last_peered":"2021-10-08T19:23:05.263610+0000","last_clean":"2021-10-08T19:23:05.263610+0000","last_became_active":"2021-10-08T19:21:29.681295+0000","last_became_peered":"2021-10-08T19:21:29.681295+0000","last_unstale":"2021-10-08T19:23:05.263610+0000","last_undegraded":"2021-10-08T19:23:05.263610+0000","last_fullsized":"2021-10-08T19:23:05.263610+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:05.263508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:05.263508+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034369000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:49.391440+0000","last_change":"2021-10-08T19:22:49.391329+0000","last_active":"2021-10-08T19:22:49.391440+0000","last_peered":"2021-10-08T19:22:49.391440+0000","last_clean":"2021-10-08T19:22:49.391440+0000","last_became_active":"2021-10-08T19:21:23.606848+0000","last_became_peered":"2021-10-08T19:21:23.606848+0000","last_unstale":"2021-10-08T19:22:49.391440+0000","last_undegraded":"2021-10-08T19:22:49.391440+0000","last_fullsized":"2021-10-08T19:22:49.391440+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:49.391258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:49.391258+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0014044610000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"69'14","reported_seq":61,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.428192+0000","last_change":"2021-10-08T19:22:26.321058+0000","last_active":"2021-10-08T19:22:48.428192+0000","last_peered":"2021-10-08T19:22:48.428192+0000","last_clean":"2021-10-08T19:22:48.428192+0000","last_became_active":"2021-10-08T19:21:25.613140+0000","last_became_peered":"2021-10-08T19:21:25.613140+0000","last_unstale":"2021-10-08T19:22:48.428192+0000","last_undegraded":"2021-10-08T19:22:48.428192+0000","last_fullsized":"2021-10-08T19:22:48.428192+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'14","last_scrub_stamp":"2021-10-08T19:22:26.320928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:26.320928+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0048335899999999996,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"69'8","reported_seq":61,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:01.718579+0000","last_change":"2021-10-08T19:21:27.641064+0000","last_active":"2021-10-08T19:23:01.718579+0000","last_peered":"2021-10-08T19:23:01.718579+0000","last_clean":"2021-10-08T19:23:01.718579+0000","last_became_active":"2021-10-08T19:21:27.640694+0000","last_became_peered":"2021-10-08T19:21:27.640694+0000","last_unstale":"2021-10-08T19:23:01.718579+0000","last_undegraded":"2021-10-08T19:23:01.718579+0000","last_fullsized":"2021-10-08T19:23:01.718579+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:21:26.604244+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.429842+0000","last_change":"2021-10-08T19:21:29.679596+0000","last_active":"2021-10-08T19:22:48.429842+0000","last_peered":"2021-10-08T19:22:48.429842+0000","last_clean":"2021-10-08T19:22:48.429842+0000","last_became_active":"2021-10-08T19:21:29.679295+0000","last_became_peered":"2021-10-08T19:21:29.679295+0000","last_unstale":"2021-10-08T19:22:48.429842+0000","last_undegraded":"2021-10-08T19:22:48.429842+0000","last_fullsized":"2021-10-08T19:22:48.429842+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:21:28.621762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.440838+0000","last_change":"2021-10-08T19:21:27.637846+0000","last_active":"2021-10-08T19:22:48.440838+0000","last_peered":"2021-10-08T19:22:48.440838+0000","last_clean":"2021-10-08T19:22:48.440838+0000","last_became_active":"2021-10-08T19:21:27.637547+0000","last_became_peered":"2021-10-08T19:21:27.637547+0000","last_unstale":"2021-10-08T19:22:48.440838+0000","last_undegraded":"2021-10-08T19:22:48.440838+0000","last_fullsized":"2021-10-08T19:22:48.440838+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:21:26.604244+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.438640+0000","last_change":"2021-10-08T19:22:29.954439+0000","last_active":"2021-10-08T19:22:48.438640+0000","last_peered":"2021-10-08T19:22:48.438640+0000","last_clean":"2021-10-08T19:22:48.438640+0000","last_became_active":"2021-10-08T19:21:23.606597+0000","last_became_peered":"2021-10-08T19:21:23.606597+0000","last_unstale":"2021-10-08T19:22:48.438640+0000","last_undegraded":"2021-10-08T19:22:48.438640+0000","last_fullsized":"2021-10-08T19:22:48.438640+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:29.954337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:29.954337+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0018351859999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"69'11","reported_seq":59,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:01.988487+0000","last_change":"2021-10-08T19:23:01.988442+0000","last_active":"2021-10-08T19:23:01.988487+0000","last_peered":"2021-10-08T19:23:01.988487+0000","last_clean":"2021-10-08T19:23:01.988487+0000","last_became_active":"2021-10-08T19:21:25.609211+0000","last_became_peered":"2021-10-08T19:21:25.609211+0000","last_unstale":"2021-10-08T19:23:01.988487+0000","last_undegraded":"2021-10-08T19:23:01.988487+0000","last_fullsized":"2021-10-08T19:23:01.988487+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'11","last_scrub_stamp":"2021-10-08T19:23:01.988336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:01.988336+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0026768489999999998,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:49.531135+0000","last_change":"2021-10-08T19:22:49.530669+0000","last_active":"2021-10-08T19:22:49.531135+0000","last_peered":"2021-10-08T19:22:49.531135+0000","last_clean":"2021-10-08T19:22:49.531135+0000","last_became_active":"2021-10-08T19:21:29.639358+0000","last_became_peered":"2021-10-08T19:21:29.639358+0000","last_unstale":"2021-10-08T19:22:49.531135+0000","last_undegraded":"2021-10-08T19:22:49.531135+0000","last_fullsized":"2021-10-08T19:22:49.531135+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:49.530586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:49.530586+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0036198910000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"88'9","reported_seq":71,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:01.718892+0000","last_change":"2021-10-08T19:23:00.048324+0000","last_active":"2021-10-08T19:23:01.718892+0000","last_peered":"2021-10-08T19:23:01.718892+0000","last_clean":"2021-10-08T19:23:01.718892+0000","last_became_active":"2021-10-08T19:21:27.636432+0000","last_became_peered":"2021-10-08T19:21:27.636432+0000","last_unstale":"2021-10-08T19:23:01.718892+0000","last_undegraded":"2021-10-08T19:23:01.718892+0000","last_fullsized":"2021-10-08T19:23:01.718892+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'9","last_scrub_stamp":"2021-10-08T19:23:00.048245+0000","last_deep_scrub":"88'9","last_deep_scrub_stamp":"2021-10-08T19:23:00.048245+0000","last_clean_scrub_stamp":"2021-10-08T19:23:00.048245+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0031661179999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.438697+0000","last_change":"2021-10-08T19:22:27.212471+0000","last_active":"2021-10-08T19:22:48.438697+0000","last_peered":"2021-10-08T19:22:48.438697+0000","last_clean":"2021-10-08T19:22:48.438697+0000","last_became_active":"2021-10-08T19:21:23.603264+0000","last_became_peered":"2021-10-08T19:21:23.603264+0000","last_unstale":"2021-10-08T19:22:48.438697+0000","last_undegraded":"2021-10-08T19:22:48.438697+0000","last_fullsized":"2021-10-08T19:22:48.438697+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:27.212397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:27.212397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0013817009999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"69'15","reported_seq":65,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:56.214042+0000","last_change":"2021-10-08T19:22:56.213566+0000","last_active":"2021-10-08T19:22:56.214042+0000","last_peered":"2021-10-08T19:22:56.214042+0000","last_clean":"2021-10-08T19:22:56.214042+0000","last_became_active":"2021-10-08T19:21:25.617776+0000","last_became_peered":"2021-10-08T19:21:25.617776+0000","last_unstale":"2021-10-08T19:22:56.214042+0000","last_undegraded":"2021-10-08T19:22:56.214042+0000","last_fullsized":"2021-10-08T19:22:56.214042+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'15","last_scrub_stamp":"2021-10-08T19:22:56.213493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:56.213493+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039771219999999996,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.428709+0000","last_change":"2021-10-08T19:22:37.292691+0000","last_active":"2021-10-08T19:22:48.428709+0000","last_peered":"2021-10-08T19:22:48.428709+0000","last_clean":"2021-10-08T19:22:48.428709+0000","last_became_active":"2021-10-08T19:21:29.640249+0000","last_became_peered":"2021-10-08T19:21:29.640249+0000","last_unstale":"2021-10-08T19:22:48.428709+0000","last_undegraded":"2021-10-08T19:22:48.428709+0000","last_fullsized":"2021-10-08T19:22:48.428709+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:37.292621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:37.292621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001513517,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"69'8","reported_seq":67,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:01.718572+0000","last_change":"2021-10-08T19:23:00.384891+0000","last_active":"2021-10-08T19:23:01.718572+0000","last_peered":"2021-10-08T19:23:01.718572+0000","last_clean":"2021-10-08T19:23:01.718572+0000","last_became_active":"2021-10-08T19:21:27.637930+0000","last_became_peered":"2021-10-08T19:21:27.637930+0000","last_unstale":"2021-10-08T19:23:01.718572+0000","last_undegraded":"2021-10-08T19:23:01.718572+0000","last_fullsized":"2021-10-08T19:23:01.718572+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'8","last_scrub_stamp":"2021-10-08T19:23:00.384808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:00.384808+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040307110000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.438584+0000","last_change":"2021-10-08T19:22:29.177318+0000","last_active":"2021-10-08T19:22:48.438584+0000","last_peered":"2021-10-08T19:22:48.438584+0000","last_clean":"2021-10-08T19:22:48.438584+0000","last_became_active":"2021-10-08T19:21:23.603207+0000","last_became_peered":"2021-10-08T19:21:23.603207+0000","last_unstale":"2021-10-08T19:22:48.438584+0000","last_undegraded":"2021-10-08T19:22:48.438584+0000","last_fullsized":"2021-10-08T19:22:48.438584+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:29.177157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:29.177157+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020581419999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"69'10","reported_seq":55,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.428422+0000","last_change":"2021-10-08T19:22:35.356371+0000","last_active":"2021-10-08T19:22:48.428422+0000","last_peered":"2021-10-08T19:22:48.428422+0000","last_clean":"2021-10-08T19:22:48.428422+0000","last_became_active":"2021-10-08T19:21:25.613155+0000","last_became_peered":"2021-10-08T19:21:25.613155+0000","last_unstale":"2021-10-08T19:22:48.428422+0000","last_undegraded":"2021-10-08T19:22:48.428422+0000","last_fullsized":"2021-10-08T19:22:48.428422+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'10","last_scrub_stamp":"2021-10-08T19:22:35.356292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:35.356292+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040689319999999999,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.428541+0000","last_change":"2021-10-08T19:21:29.646937+0000","last_active":"2021-10-08T19:22:48.428541+0000","last_peered":"2021-10-08T19:22:48.428541+0000","last_clean":"2021-10-08T19:22:48.428541+0000","last_became_active":"2021-10-08T19:21:29.646455+0000","last_became_peered":"2021-10-08T19:21:29.646455+0000","last_unstale":"2021-10-08T19:22:48.428541+0000","last_undegraded":"2021-10-08T19:22:48.428541+0000","last_fullsized":"2021-10-08T19:22:48.428541+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:21:28.621762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.439117+0000","last_change":"2021-10-08T19:22:35.110008+0000","last_active":"2021-10-08T19:22:48.439117+0000","last_peered":"2021-10-08T19:22:48.439117+0000","last_clean":"2021-10-08T19:22:48.439117+0000","last_became_active":"2021-10-08T19:21:27.636429+0000","last_became_peered":"2021-10-08T19:21:27.636429+0000","last_unstale":"2021-10-08T19:22:48.439117+0000","last_undegraded":"2021-10-08T19:22:48.439117+0000","last_fullsized":"2021-10-08T19:22:48.439117+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:35.109928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:35.109928+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001854304,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"61'1","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:55.080583+0000","last_change":"2021-10-08T19:22:55.080106+0000","last_active":"2021-10-08T19:22:55.080583+0000","last_peered":"2021-10-08T19:22:55.080583+0000","last_clean":"2021-10-08T19:22:55.080583+0000","last_became_active":"2021-10-08T19:21:23.607064+0000","last_became_peered":"2021-10-08T19:21:23.607064+0000","last_unstale":"2021-10-08T19:22:55.080583+0000","last_undegraded":"2021-10-08T19:22:55.080583+0000","last_fullsized":"2021-10-08T19:22:55.080583+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'1","last_scrub_stamp":"2021-10-08T19:22:55.080028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:55.080028+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040037620000000001,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"69'17","reported_seq":68,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.428877+0000","last_change":"2021-10-08T19:22:47.109498+0000","last_active":"2021-10-08T19:22:48.428877+0000","last_peered":"2021-10-08T19:22:48.428877+0000","last_clean":"2021-10-08T19:22:48.428877+0000","last_became_active":"2021-10-08T19:21:25.609086+0000","last_became_peered":"2021-10-08T19:21:25.609086+0000","last_unstale":"2021-10-08T19:22:48.428877+0000","last_undegraded":"2021-10-08T19:22:48.428877+0000","last_fullsized":"2021-10-08T19:22:48.428877+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'17","last_scrub_stamp":"2021-10-08T19:22:47.109407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:47.109407+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0025026100000000002,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:03.272684+0000","last_change":"2021-10-08T19:23:03.272654+0000","last_active":"2021-10-08T19:23:03.272684+0000","last_peered":"2021-10-08T19:23:03.272684+0000","last_clean":"2021-10-08T19:23:03.272684+0000","last_became_active":"2021-10-08T19:21:29.648922+0000","last_became_peered":"2021-10-08T19:21:29.648922+0000","last_unstale":"2021-10-08T19:23:03.272684+0000","last_undegraded":"2021-10-08T19:23:03.272684+0000","last_fullsized":"2021-10-08T19:23:03.272684+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:03.272581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:03.272581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001525874,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.428393+0000","last_change":"2021-10-08T19:21:27.638931+0000","last_active":"2021-10-08T19:22:48.428393+0000","last_peered":"2021-10-08T19:22:48.428393+0000","last_clean":"2021-10-08T19:22:48.428393+0000","last_became_active":"2021-10-08T19:21:27.638583+0000","last_became_peered":"2021-10-08T19:21:27.638583+0000","last_unstale":"2021-10-08T19:22:48.428393+0000","last_undegraded":"2021-10-08T19:22:48.428393+0000","last_fullsized":"2021-10-08T19:22:48.428393+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:21:26.604244+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:57.380499+0000","last_change":"2021-10-08T19:22:57.380012+0000","last_active":"2021-10-08T19:22:57.380499+0000","last_peered":"2021-10-08T19:22:57.380499+0000","last_clean":"2021-10-08T19:22:57.380499+0000","last_became_active":"2021-10-08T19:21:23.595919+0000","last_became_peered":"2021-10-08T19:21:23.595919+0000","last_unstale":"2021-10-08T19:22:57.380499+0000","last_undegraded":"2021-10-08T19:22:57.380499+0000","last_fullsized":"2021-10-08T19:22:57.380499+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:57.379935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:57.379935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034209349999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"69'19","reported_seq":71,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.439202+0000","last_change":"2021-10-08T19:22:39.356624+0000","last_active":"2021-10-08T19:22:48.439202+0000","last_peered":"2021-10-08T19:22:48.439202+0000","last_clean":"2021-10-08T19:22:48.439202+0000","last_became_active":"2021-10-08T19:21:25.741945+0000","last_became_peered":"2021-10-08T19:21:25.741945+0000","last_unstale":"2021-10-08T19:22:48.439202+0000","last_undegraded":"2021-10-08T19:22:48.439202+0000","last_fullsized":"2021-10-08T19:22:48.439202+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'19","last_scrub_stamp":"2021-10-08T19:22:39.356508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:39.356508+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0030817370000000002,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:57.645001+0000","last_change":"2021-10-08T19:22:57.644734+0000","last_active":"2021-10-08T19:22:57.645001+0000","last_peered":"2021-10-08T19:22:57.645001+0000","last_clean":"2021-10-08T19:22:57.645001+0000","last_became_active":"2021-10-08T19:21:29.643022+0000","last_became_peered":"2021-10-08T19:21:29.643022+0000","last_unstale":"2021-10-08T19:22:57.645001+0000","last_undegraded":"2021-10-08T19:22:57.645001+0000","last_fullsized":"2021-10-08T19:22:57.645001+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:57.644627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:57.644627+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002174952,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.428389+0000","last_change":"2021-10-08T19:22:42.359224+0000","last_active":"2021-10-08T19:22:48.428389+0000","last_peered":"2021-10-08T19:22:48.428389+0000","last_clean":"2021-10-08T19:22:48.428389+0000","last_became_active":"2021-10-08T19:21:27.635310+0000","last_became_peered":"2021-10-08T19:21:27.635310+0000","last_unstale":"2021-10-08T19:22:48.428389+0000","last_undegraded":"2021-10-08T19:22:48.428389+0000","last_fullsized":"2021-10-08T19:22:48.428389+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:42.359130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:42.359130+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001847357,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.439453+0000","last_change":"2021-10-08T19:22:44.234112+0000","last_active":"2021-10-08T19:22:48.439453+0000","last_peered":"2021-10-08T19:22:48.439453+0000","last_clean":"2021-10-08T19:22:48.439453+0000","last_became_active":"2021-10-08T19:21:23.607639+0000","last_became_peered":"2021-10-08T19:21:23.607639+0000","last_unstale":"2021-10-08T19:22:48.439453+0000","last_undegraded":"2021-10-08T19:22:48.439453+0000","last_fullsized":"2021-10-08T19:22:48.439453+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:21:22.582293+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"69'9","reported_seq":56,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.439701+0000","last_change":"2021-10-08T19:22:36.590210+0000","last_active":"2021-10-08T19:22:48.439701+0000","last_peered":"2021-10-08T19:22:48.439701+0000","last_clean":"2021-10-08T19:22:48.439701+0000","last_became_active":"2021-10-08T19:21:25.610072+0000","last_became_peered":"2021-10-08T19:21:25.610072+0000","last_unstale":"2021-10-08T19:22:48.439701+0000","last_undegraded":"2021-10-08T19:22:48.439701+0000","last_fullsized":"2021-10-08T19:22:48.439701+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'9","last_scrub_stamp":"2021-10-08T19:22:36.590071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:36.590071+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0026030699999999999,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.438568+0000","last_change":"2021-10-08T19:21:29.679540+0000","last_active":"2021-10-08T19:22:48.438568+0000","last_peered":"2021-10-08T19:22:48.438568+0000","last_clean":"2021-10-08T19:22:48.438568+0000","last_became_active":"2021-10-08T19:21:29.679264+0000","last_became_peered":"2021-10-08T19:21:29.679264+0000","last_unstale":"2021-10-08T19:22:48.438568+0000","last_undegraded":"2021-10-08T19:22:48.438568+0000","last_fullsized":"2021-10-08T19:22:48.438568+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:21:28.621762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.428674+0000","last_change":"2021-10-08T19:22:34.484570+0000","last_active":"2021-10-08T19:22:48.428674+0000","last_peered":"2021-10-08T19:22:48.428674+0000","last_clean":"2021-10-08T19:22:48.428674+0000","last_became_active":"2021-10-08T19:21:23.600352+0000","last_became_peered":"2021-10-08T19:21:23.600352+0000","last_unstale":"2021-10-08T19:22:48.428674+0000","last_undegraded":"2021-10-08T19:22:48.428674+0000","last_fullsized":"2021-10-08T19:22:48.428674+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:34.484488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:34.484488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034565799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"87'22","reported_seq":72,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:58.705870+0000","last_change":"2021-10-08T19:22:58.705708+0000","last_active":"2021-10-08T19:22:58.705870+0000","last_peered":"2021-10-08T19:22:58.705870+0000","last_clean":"2021-10-08T19:22:58.705870+0000","last_became_active":"2021-10-08T19:21:25.741675+0000","last_became_peered":"2021-10-08T19:21:25.741675+0000","last_unstale":"2021-10-08T19:22:58.705870+0000","last_undegraded":"2021-10-08T19:22:58.705870+0000","last_fullsized":"2021-10-08T19:22:58.705870+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'22","last_scrub_stamp":"2021-10-08T19:22:58.705632+0000","last_deep_scrub":"87'22","last_deep_scrub_stamp":"2021-10-08T19:22:58.705632+0000","last_clean_scrub_stamp":"2021-10-08T19:22:58.705632+0000","log_size":22,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0051832670000000001,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"69'8","reported_seq":67,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:01.718821+0000","last_change":"2021-10-08T19:22:51.066026+0000","last_active":"2021-10-08T19:23:01.718821+0000","last_peered":"2021-10-08T19:23:01.718821+0000","last_clean":"2021-10-08T19:23:01.718821+0000","last_became_active":"2021-10-08T19:21:27.637056+0000","last_became_peered":"2021-10-08T19:21:27.637056+0000","last_unstale":"2021-10-08T19:23:01.718821+0000","last_undegraded":"2021-10-08T19:23:01.718821+0000","last_fullsized":"2021-10-08T19:23:01.718821+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'8","last_scrub_stamp":"2021-10-08T19:22:51.065949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:51.065949+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020224639999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":65,"ondisk_log_size":65,"up":96,"acting":96,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":698,"num_read_kb":455,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":402,"ondisk_log_size":402,"up":96,"acting":96,"num_store_stats":8},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":98,"num_read_kb":93,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201305,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6896,"kb_used_data":1192,"kb_used_omap":0,"kb_used_meta":5696,"kb_avail":93738256,"statfs":{"total":95995035648,"available":95987974144,"internally_reserved":0,"allocated":1220608,"data_stored":878904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5832704},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:22:15 2021","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":2.5960000000000001}]},{"osd":1,"last update":"Fri Oct 8 19:22:15 2021","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":2.6640000000000001}]},{"osd":2,"last update":"Fri Oct 8 19:22:15 2021","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.57799999999999996}]},{"osd":3,"last update":"Fri Oct 8 19:22:15 2021","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.5},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":2.6299999999999999}]},{"osd":4,"last update":"Fri Oct 8 19:22:15 2021","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.53300000000000003}]},{"osd":5,"last update":"Fri Oct 8 19:22:15 2021","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.63},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.66100000000000003}]},{"osd":6,"last update":"Fri Oct 8 19:22:15 2021","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":2.4550000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.78600000000000003}]}]},{"osd":6,"up_from":47,"seq":201863462941,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6868,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":5696,"kb_avail":93738284,"statfs":{"total":95995035648,"available":95988002816,"internally_reserved":0,"allocated":1191936,"data_stored":877058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5832704},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:22:56 2021","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.45700000000000002,"15min":0.46400000000000002},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.59099999999999997,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.48699999999999999,"15min":0.49299999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.59699999999999998}]},{"osd":1,"last update":"Fri Oct 8 19:22:56 2021","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.499,"15min":0.504},"min":{"1min":0.34699999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.69799999999999995,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.61499999999999999}]},{"osd":2,"last update":"Fri Oct 8 19:22:56 2021","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.51600000000000001,"15min":0.52000000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.48399999999999999,"15min":0.48899999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.66600000000000004,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.44700000000000001}]},{"osd":3,"last update":"Fri Oct 8 19:22:56 2021","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.48199999999999998,"15min":0.48799999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.64800000000000002,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.502,"5min":0.501,"15min":0.501},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.54900000000000004}]},{"osd":4,"last update":"Fri Oct 8 19:22:56 2021","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40999999999999998,"15min":0.41199999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.59099999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.433,"5min":0.44500000000000001,"15min":0.44700000000000001},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.56499999999999995,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.43099999999999999}]},{"osd":5,"last update":"Fri Oct 8 19:22:56 2021","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.46700000000000003,"15min":0.46899999999999997},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.67600000000000005,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.47599999999999998}]},{"osd":7,"last update":"Fri Oct 8 19:22:15 2021","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.39000000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574896,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":11328,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":10688,"kb_avail":93733824,"statfs":{"total":95995035648,"available":95983435776,"internally_reserved":0,"allocated":647168,"data_stored":288000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":10944512},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:22:30 2021","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.33400000000000002,"15min":0.32900000000000001},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.432,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.312},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.36199999999999999,"15min":0.35999999999999999},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.53400000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.35199999999999998}]},{"osd":2,"last update":"Fri Oct 8 19:22:52 2021","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.38300000000000001,"15min":0.39400000000000002},"min":{"1min":0.25600000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.53900000000000003,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.42799999999999999,"15min":0.42399999999999999},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.29099999999999998}]},{"osd":3,"last update":"Fri Oct 8 19:22:06 2021","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.45800000000000002,"15min":0.46700000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.45000000000000001,"15min":0.45800000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.35999999999999999}]},{"osd":4,"last update":"Fri Oct 8 19:22:22 2021","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.51300000000000001,"15min":0.51400000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53800000000000003,"15min":0.53900000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.51100000000000001}]},{"osd":5,"last update":"Fri Oct 8 19:22:42 2021","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.55200000000000005,"15min":0.56000000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73899999999999999,"5min":0.754,"15min":0.754},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55700000000000005,"15min":0.55800000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.46600000000000003}]},{"osd":6,"last update":"Fri Oct 8 19:23:00 2021","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53400000000000003,"15min":0.53700000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.64300000000000002,"15min":0.66300000000000003},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.77000000000000002,"5min":2.5219999999999998,"15min":2.5219999999999998},"last":0.45700000000000002}]},{"osd":7,"last update":"Fri Oct 8 19:22:20 2021","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.48799999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738419,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7592,"kb_used_data":1184,"kb_used_omap":0,"kb_used_meta":6400,"kb_avail":93737560,"statfs":{"total":95995035648,"available":95987261440,"internally_reserved":0,"allocated":1212416,"data_stored":877463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6553600},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 8 19:22:32 2021","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":0.33000000000000002,"15min":0.32800000000000001},"min":{"1min":0.21199999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.45000000000000001,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.25},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.379,"15min":0.371},"min":{"1min":0.25,"5min":0.219,"15min":0.219},"max":{"1min":0.44900000000000001,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.35199999999999998}]},{"osd":2,"last update":"Fri Oct 8 19:22:53 2021","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.38900000000000001,"15min":0.39400000000000002},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.54900000000000004,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.38800000000000001,"15min":0.39600000000000002},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.51900000000000002,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.443}]},{"osd":3,"last update":"Fri Oct 8 19:23:05 2021","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.45200000000000001,"15min":0.48299999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.56599999999999995,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.311},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.42799999999999999,"15min":0.45200000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.53500000000000003,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.47299999999999998}]},{"osd":4,"last update":"Fri Oct 8 19:22:23 2021","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.54000000000000004,"15min":0.54300000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.77500000000000002,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.57099999999999995,"15min":0.57899999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.68300000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.38500000000000001}]},{"osd":5,"last update":"Fri Oct 8 19:22:40 2021","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.54700000000000004,"15min":0.55100000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72899999999999998,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.749,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.34200000000000003}]},{"osd":6,"last update":"Fri Oct 8 19:22:59 2021","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.58099999999999996,"15min":0.57899999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.497}]},{"osd":7,"last update":"Fri Oct 8 19:22:15 2021","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.40899999999999997}]}]},{"osd":2,"up_from":18,"seq":77309411371,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6876,"kb_used_data":596,"kb_used_omap":0,"kb_used_meta":6272,"kb_avail":93738276,"statfs":{"total":95995035648,"available":95987994624,"internally_reserved":0,"allocated":610304,"data_stored":287366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6422528},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:22:46 2021","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.34200000000000003,"15min":0.34399999999999997},"min":{"1min":0.193,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.253},{"interface":"front","average":{"1min":0.371,"5min":0.36599999999999999,"15min":0.35999999999999999},"min":{"1min":0.25800000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.24099999999999999}]},{"osd":1,"last update":"Fri Oct 8 19:22:46 2021","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.36099999999999999,"15min":0.36299999999999999},"min":{"1min":0.24399999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.53900000000000003,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.40699999999999997,"15min":0.39600000000000002},"min":{"1min":0.28000000000000003,"5min":0.218,"15min":0.218},"max":{"1min":2.2890000000000001,"5min":2.2890000000000001,"15min":2.2890000000000001},"last":0.27700000000000002}]},{"osd":3,"last update":"Fri Oct 8 19:23:05 2021","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.41999999999999998,"15min":0.442},"min":{"1min":0.26800000000000002,"5min":0.218,"15min":0.218},"max":{"1min":0.50700000000000001,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.317},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.40300000000000002,"15min":0.41499999999999998},"min":{"1min":0.248,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.45600000000000002,"5min":0.625,"15min":0.625},"last":0.37}]},{"osd":4,"last update":"Fri Oct 8 19:22:20 2021","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.54500000000000004,"15min":0.55100000000000005},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.753,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.57299999999999995,"15min":0.57699999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.377}]},{"osd":5,"last update":"Fri Oct 8 19:22:40 2021","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.56999999999999995,"15min":0.57599999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.44}]},{"osd":6,"last update":"Fri Oct 8 19:23:05 2021","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.55800000000000005,"15min":0.56499999999999995},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.74099999999999999,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.57899999999999996,"15min":0.58699999999999997},"min":{"1min":0.41699999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.66300000000000003,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.46300000000000002}]},{"osd":7,"last update":"Fri Oct 8 19:22:20 2021","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.52300000000000002}]}]},{"osd":3,"up_from":24,"seq":103079215145,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6516,"kb_used_data":620,"kb_used_omap":0,"kb_used_meta":5888,"kb_avail":93738636,"statfs":{"total":95995035648,"available":95988363264,"internally_reserved":0,"allocated":634880,"data_stored":287488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6029312},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:23:07 2021","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.34899999999999998,"15min":0.35099999999999998},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.61399999999999999,"5min":1.002,"15min":1.002},"last":0.20399999999999999},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.38200000000000001,"15min":0.39700000000000002},"min":{"1min":0.23000000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.217}]},{"osd":1,"last update":"Fri Oct 8 19:23:07 2021","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.39000000000000001,"15min":0.40400000000000003},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.39100000000000001,"15min":0.40699999999999997},"min":{"1min":0.219,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.23200000000000001}]},{"osd":2,"last update":"Fri Oct 8 19:23:07 2021","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.41599999999999998,"15min":0.433},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.42599999999999999,"15min":0.42799999999999999},"min":{"1min":0.27000000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.94199999999999995,"5min":1.026,"15min":1.026},"last":0.29099999999999998}]},{"osd":4,"last update":"Fri Oct 8 19:22:23 2021","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58499999999999996,"15min":0.58599999999999997},"min":{"1min":0.38300000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.0549999999999999,"5min":2.0590000000000002,"15min":2.0590000000000002},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.76000000000000001,"15min":0.79300000000000004},"min":{"1min":0.38400000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.78900000000000003,"5min":3.4670000000000001,"15min":3.4670000000000001},"last":0.39400000000000002}]},{"osd":5,"last update":"Fri Oct 8 19:22:41 2021","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.57799999999999996,"15min":0.58599999999999997},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.746,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":2.6739999999999999},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.69499999999999995,"15min":0.71599999999999997},"min":{"1min":0.432,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.996,"5min":3.4020000000000001,"15min":3.4020000000000001},"last":0.31900000000000001}]},{"osd":6,"last update":"Fri Oct 8 19:23:02 2021","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":1.5189999999999999,"15min":1.681},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.72899999999999998,"5min":21.538,"15min":21.538},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.55400000000000005,"15min":0.56200000000000006},"min":{"1min":0.377,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.69999999999999996,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.41599999999999998}]},{"osd":7,"last update":"Fri Oct 8 19:22:16 2021","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.47099999999999997}]}]},{"osd":4,"up_from":30,"seq":128849018917,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6516,"kb_used_data":620,"kb_used_omap":0,"kb_used_meta":5888,"kb_avail":93738636,"statfs":{"total":95995035648,"available":95988363264,"internally_reserved":0,"allocated":634880,"data_stored":288400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6029312},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:22:22 2021","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.51900000000000002,"15min":0.52500000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.68500000000000005,"5min":0.755,"15min":0.755},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.52100000000000002,"15min":0.52400000000000002},"min":{"1min":0.33300000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.52400000000000002}]},{"osd":1,"last update":"Fri Oct 8 19:22:22 2021","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.51200000000000001,"15min":0.51800000000000002},"min":{"1min":0.316,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.60399999999999998,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.498,"15min":0.505},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.61099999999999999}]},{"osd":2,"last update":"Fri Oct 8 19:22:22 2021","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.50800000000000001,"15min":0.51500000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.495,"5min":0.52900000000000003,"15min":0.53500000000000003},"min":{"1min":0.33600000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.628,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.58799999999999997}]},{"osd":3,"last update":"Fri Oct 8 19:22:22 2021","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.51200000000000001,"15min":0.51900000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.628,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.52200000000000002,"15min":0.52700000000000002},"min":{"1min":0.376,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.66400000000000003,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.624}]},{"osd":5,"last update":"Fri Oct 8 19:22:43 2021","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.38700000000000001,"15min":0.378},"min":{"1min":0.30499999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.435,"5min":0.39400000000000002,"15min":0.38700000000000001},"min":{"1min":0.28899999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.38700000000000001}]},{"osd":6,"last update":"Fri Oct 8 19:23:00 2021","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.41199999999999998,"15min":0.40500000000000003},"min":{"1min":0.27900000000000003,"5min":0.252,"15min":0.252},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.42899999999999999,"15min":0.42299999999999999},"min":{"1min":0.30499999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.36599999999999999}]},{"osd":7,"last update":"Fri Oct 8 19:22:15 2021","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.377}]}]},{"osd":5,"up_from":38,"seq":163208757279,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6296,"kb_used_data":592,"kb_used_omap":0,"kb_used_meta":5696,"kb_avail":93738856,"statfs":{"total":95995035648,"available":95988588544,"internally_reserved":0,"allocated":606208,"data_stored":287357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5832704},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:22:42 2021","interfaces":[{"interface":"back","average":{"1min":1.6399999999999999,"5min":0.70399999999999996,"15min":0.54800000000000004},"min":{"1min":0.27700000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":22.966999999999999,"5min":22.966999999999999,"15min":22.966999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.46300000000000002,"15min":0.46600000000000003},"min":{"1min":0.28499999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.68400000000000005,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.32000000000000001}]},{"osd":1,"last update":"Fri Oct 8 19:22:42 2021","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.48699999999999999,"15min":0.497},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.64900000000000002,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.499,"15min":0.50700000000000001},"min":{"1min":0.30399999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.69499999999999995,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.39900000000000002}]},{"osd":2,"last update":"Fri Oct 8 19:22:42 2021","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.45900000000000002,"15min":0.46300000000000002},"min":{"1min":0.29999999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.54900000000000004,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.56599999999999995},{"interface":"front","average":{"1min":1.629,"5min":0.72499999999999998,"15min":0.57499999999999996},"min":{"1min":0.30099999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":23.073,"5min":23.073,"15min":23.073},"last":0.30299999999999999}]},{"osd":3,"last update":"Fri Oct 8 19:22:42 2021","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.47999999999999998,"15min":0.48599999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.66800000000000004,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.439,"5min":0.48299999999999998,"15min":0.48999999999999999},"min":{"1min":0.36499999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.64900000000000002,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.44900000000000001}]},{"osd":4,"last update":"Fri Oct 8 19:22:42 2021","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.26300000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.58499999999999996,"5min":0.626,"15min":0.626},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.439,"15min":0.432},"min":{"1min":0.371,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.623,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.59799999999999998}]},{"osd":6,"last update":"Fri Oct 8 19:22:58 2021","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.35599999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.373},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.495,"15min":0.497},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.60899999999999999,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.61299999999999999}]},{"osd":7,"last update":"Fri Oct 8 19:22:15 2021","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":0.437}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":2008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-10-08T19:23:13.506 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph pg dump --format=json 2021-10-08T19:23:13.719 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:13 smithi097 ceph-mon[41966]: pgmap v63: 132 pgs: 132 active+clean; 582 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:23:13.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:13 smithi097 ceph-mon[41966]: 6.11 scrub ok 2021-10-08T19:23:13.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:13 smithi097 ceph-mon[41966]: from='client.24700 v1:172.21.15.97:0/1566738536' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:23:13.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:13 smithi097 ceph-mon[32687]: pgmap v63: 132 pgs: 132 active+clean; 582 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:23:13.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:13 smithi097 ceph-mon[32687]: 6.11 scrub ok 2021-10-08T19:23:13.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:13 smithi097 ceph-mon[32687]: from='client.24700 v1:172.21.15.97:0/1566738536' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:23:13.869 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:13 smithi117 ceph-mon[34585]: pgmap v63: 132 pgs: 132 active+clean; 582 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:23:13.870 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:13 smithi117 ceph-mon[34585]: 6.11 scrub ok 2021-10-08T19:23:13.870 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:13 smithi117 ceph-mon[34585]: from='client.24700 v1:172.21.15.97:0/1566738536' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:23:14.064 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:23:14.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:23:13 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:23:13] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:23:14.686 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:14 smithi097 ceph-mon[41966]: 2.16 deep-scrub ok 2021-10-08T19:23:14.687 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:14 smithi097 ceph-mon[32687]: 2.16 deep-scrub ok 2021-10-08T19:23:14.785 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:14 smithi117 ceph-mon[34585]: 2.16 deep-scrub ok 2021-10-08T19:23:15.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:15 smithi097 ceph-mon[32687]: pgmap v64: 132 pgs: 132 active+clean; 582 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:23:15.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:15 smithi097 ceph-mon[32687]: 2.1e scrub ok 2021-10-08T19:23:15.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:15 smithi097 ceph-mon[32687]: 6.7 scrub ok 2021-10-08T19:23:15.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:15 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:23:15.721 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:23:15 smithi097 conmon[33110]: 172.21.15.97 - - [08/Oct/2021:19:23:15] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:23:15.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:15 smithi097 ceph-mon[41966]: pgmap v64: 132 pgs: 132 active+clean; 582 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:23:15.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:15 smithi097 ceph-mon[41966]: 2.1e scrub ok 2021-10-08T19:23:15.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:15 smithi097 ceph-mon[41966]: 6.7 scrub ok 2021-10-08T19:23:15.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:15 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:23:15.816 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:15 smithi117 ceph-mon[34585]: pgmap v64: 132 pgs: 132 active+clean; 582 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:23:15.816 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:15 smithi117 ceph-mon[34585]: 2.1e scrub ok 2021-10-08T19:23:15.816 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:15 smithi117 ceph-mon[34585]: 6.7 scrub ok 2021-10-08T19:23:15.817 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:15 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:23:15.910 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:23:15.913 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2021-10-08T19:23:16.134 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:15 smithi117 systemd[1]: Starting Ceph grafana.a for 1d01f6d6-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:23:16.390 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:23:16 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:23:16.452 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2021-10-08T19:23:14.437204+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596164,"num_objects":194,"num_object_clones":0,"num_object_copies":582,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":1040,"num_read_kb":886,"num_write":607,"num_write_kb":2457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":1771434,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":606,"ondisk_log_size":606,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":396,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":58888,"kb_used_data":6600,"kb_used_omap":0,"kb_used_meta":52224,"kb_avail":749902328,"statfs":{"total":767960285184,"available":767899983872,"internally_reserved":0,"allocated":6758400,"data_stored":4072036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":53477376},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002966"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.429686+0000","last_change":"2021-10-08T19:22:33.411869+0000","last_active":"2021-10-08T19:22:48.429686+0000","last_peered":"2021-10-08T19:22:48.429686+0000","last_clean":"2021-10-08T19:22:48.429686+0000","last_became_active":"2021-10-08T19:21:29.681121+0000","last_became_peered":"2021-10-08T19:21:29.681121+0000","last_unstale":"2021-10-08T19:22:48.429686+0000","last_undegraded":"2021-10-08T19:22:48.429686+0000","last_fullsized":"2021-10-08T19:22:48.429686+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:33.411753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:33.411753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0038057030000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.428089+0000","last_change":"2021-10-08T19:22:34.356580+0000","last_active":"2021-10-08T19:22:48.428089+0000","last_peered":"2021-10-08T19:22:48.428089+0000","last_clean":"2021-10-08T19:22:48.428089+0000","last_became_active":"2021-10-08T19:21:27.636886+0000","last_became_peered":"2021-10-08T19:21:27.636886+0000","last_unstale":"2021-10-08T19:22:48.428089+0000","last_undegraded":"2021-10-08T19:22:48.428089+0000","last_fullsized":"2021-10-08T19:22:48.428089+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:34.356501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:34.356501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034783520000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:54.671530+0000","last_change":"2021-10-08T19:22:54.671364+0000","last_active":"2021-10-08T19:22:54.671530+0000","last_peered":"2021-10-08T19:22:54.671530+0000","last_clean":"2021-10-08T19:22:54.671530+0000","last_became_active":"2021-10-08T19:21:23.603422+0000","last_became_peered":"2021-10-08T19:21:23.603422+0000","last_unstale":"2021-10-08T19:22:54.671530+0000","last_undegraded":"2021-10-08T19:22:54.671530+0000","last_fullsized":"2021-10-08T19:22:54.671530+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:54.671289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:54.671289+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001752221,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"69'15","reported_seq":59,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.429439+0000","last_change":"2021-10-08T19:21:25.613266+0000","last_active":"2021-10-08T19:22:48.429439+0000","last_peered":"2021-10-08T19:22:48.429439+0000","last_clean":"2021-10-08T19:22:48.429439+0000","last_became_active":"2021-10-08T19:21:25.612873+0000","last_became_peered":"2021-10-08T19:21:25.612873+0000","last_unstale":"2021-10-08T19:22:48.429439+0000","last_undegraded":"2021-10-08T19:22:48.429439+0000","last_fullsized":"2021-10-08T19:22:48.429439+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:21:24.589054+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:50.032928+0000","last_change":"2021-10-08T19:22:50.032446+0000","last_active":"2021-10-08T19:22:50.032928+0000","last_peered":"2021-10-08T19:22:50.032928+0000","last_clean":"2021-10-08T19:22:50.032928+0000","last_became_active":"2021-10-08T19:21:29.639039+0000","last_became_peered":"2021-10-08T19:21:29.639039+0000","last_unstale":"2021-10-08T19:22:50.032928+0000","last_undegraded":"2021-10-08T19:22:50.032928+0000","last_fullsized":"2021-10-08T19:22:50.032928+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:50.032367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:50.032367+0000","last_clean_scrub_stamp":"2021-10-08T19:22:50.032367+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034102759999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:05.196359+0000","last_change":"2021-10-08T19:23:05.196328+0000","last_active":"2021-10-08T19:23:05.196359+0000","last_peered":"2021-10-08T19:23:05.196359+0000","last_clean":"2021-10-08T19:23:05.196359+0000","last_became_active":"2021-10-08T19:21:27.634883+0000","last_became_peered":"2021-10-08T19:21:27.634883+0000","last_unstale":"2021-10-08T19:23:05.196359+0000","last_undegraded":"2021-10-08T19:23:05.196359+0000","last_fullsized":"2021-10-08T19:23:05.196359+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:05.196252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:05.196252+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0016803230000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.430064+0000","last_change":"2021-10-08T19:21:23.598564+0000","last_active":"2021-10-08T19:22:48.430064+0000","last_peered":"2021-10-08T19:22:48.430064+0000","last_clean":"2021-10-08T19:22:48.430064+0000","last_became_active":"2021-10-08T19:21:23.598272+0000","last_became_peered":"2021-10-08T19:21:23.598272+0000","last_unstale":"2021-10-08T19:22:48.430064+0000","last_undegraded":"2021-10-08T19:22:48.430064+0000","last_fullsized":"2021-10-08T19:22:48.430064+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:21:22.582293+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"69'9","reported_seq":69,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.428218+0000","last_change":"2021-10-08T19:22:44.282532+0000","last_active":"2021-10-08T19:22:48.428218+0000","last_peered":"2021-10-08T19:22:48.428218+0000","last_clean":"2021-10-08T19:22:48.428218+0000","last_became_active":"2021-10-08T19:22:43.936718+0000","last_became_peered":"2021-10-08T19:22:43.936718+0000","last_unstale":"2021-10-08T19:22:48.428218+0000","last_undegraded":"2021-10-08T19:22:48.428218+0000","last_fullsized":"2021-10-08T19:22:48.428218+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:21:24.589054+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.438252+0000","last_change":"2021-10-08T19:21:29.649955+0000","last_active":"2021-10-08T19:22:48.438252+0000","last_peered":"2021-10-08T19:22:48.438252+0000","last_clean":"2021-10-08T19:22:48.438252+0000","last_became_active":"2021-10-08T19:21:29.649640+0000","last_became_peered":"2021-10-08T19:21:29.649640+0000","last_unstale":"2021-10-08T19:22:48.438252+0000","last_undegraded":"2021-10-08T19:22:48.438252+0000","last_fullsized":"2021-10-08T19:22:48.438252+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:21:28.621762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.441117+0000","last_change":"2021-10-08T19:22:43.016906+0000","last_active":"2021-10-08T19:22:48.441117+0000","last_peered":"2021-10-08T19:22:48.441117+0000","last_clean":"2021-10-08T19:22:48.441117+0000","last_became_active":"2021-10-08T19:21:27.637178+0000","last_became_peered":"2021-10-08T19:21:27.637178+0000","last_unstale":"2021-10-08T19:22:48.441117+0000","last_undegraded":"2021-10-08T19:22:48.441117+0000","last_fullsized":"2021-10-08T19:22:48.441117+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:43.016815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:43.016815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034706469999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.439380+0000","last_change":"2021-10-08T19:22:33.926376+0000","last_active":"2021-10-08T19:22:48.439380+0000","last_peered":"2021-10-08T19:22:48.439380+0000","last_clean":"2021-10-08T19:22:48.439380+0000","last_became_active":"2021-10-08T19:21:23.609037+0000","last_became_peered":"2021-10-08T19:21:23.609037+0000","last_unstale":"2021-10-08T19:22:48.439380+0000","last_undegraded":"2021-10-08T19:22:48.439380+0000","last_fullsized":"2021-10-08T19:22:48.439380+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:33.926256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:33.926256+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0015495210000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"69'5","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.428429+0000","last_change":"2021-10-08T19:21:25.609310+0000","last_active":"2021-10-08T19:22:48.428429+0000","last_peered":"2021-10-08T19:22:48.428429+0000","last_clean":"2021-10-08T19:22:48.428429+0000","last_became_active":"2021-10-08T19:21:25.609029+0000","last_became_peered":"2021-10-08T19:21:25.609029+0000","last_unstale":"2021-10-08T19:22:48.428429+0000","last_undegraded":"2021-10-08T19:22:48.428429+0000","last_fullsized":"2021-10-08T19:22:48.428429+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:21:24.589054+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:51.689425+0000","last_change":"2021-10-08T19:22:51.689295+0000","last_active":"2021-10-08T19:22:51.689425+0000","last_peered":"2021-10-08T19:22:51.689425+0000","last_clean":"2021-10-08T19:22:51.689425+0000","last_became_active":"2021-10-08T19:21:29.640978+0000","last_became_peered":"2021-10-08T19:21:29.640978+0000","last_unstale":"2021-10-08T19:22:51.689425+0000","last_undegraded":"2021-10-08T19:22:51.689425+0000","last_fullsized":"2021-10-08T19:22:51.689425+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:51.689220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:51.689220+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001435541,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:05.799460+0000","last_change":"2021-10-08T19:23:05.799433+0000","last_active":"2021-10-08T19:23:05.799460+0000","last_peered":"2021-10-08T19:23:05.799460+0000","last_clean":"2021-10-08T19:23:05.799460+0000","last_became_active":"2021-10-08T19:21:27.633979+0000","last_became_peered":"2021-10-08T19:21:27.633979+0000","last_unstale":"2021-10-08T19:23:05.799460+0000","last_undegraded":"2021-10-08T19:23:05.799460+0000","last_fullsized":"2021-10-08T19:23:05.799460+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:05.799361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:05.799361+0000","last_clean_scrub_stamp":"2021-10-08T19:23:05.799361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0036358100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.440798+0000","last_change":"2021-10-08T19:22:42.042609+0000","last_active":"2021-10-08T19:22:48.440798+0000","last_peered":"2021-10-08T19:22:48.440798+0000","last_clean":"2021-10-08T19:22:48.440798+0000","last_became_active":"2021-10-08T19:21:23.607785+0000","last_became_peered":"2021-10-08T19:21:23.607785+0000","last_unstale":"2021-10-08T19:22:48.440798+0000","last_undegraded":"2021-10-08T19:22:48.440798+0000","last_fullsized":"2021-10-08T19:22:48.440798+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:42.042510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:42.042510+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034710639999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"69'9","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.428306+0000","last_change":"2021-10-08T19:21:25.608580+0000","last_active":"2021-10-08T19:22:48.428306+0000","last_peered":"2021-10-08T19:22:48.428306+0000","last_clean":"2021-10-08T19:22:48.428306+0000","last_became_active":"2021-10-08T19:21:25.608263+0000","last_became_peered":"2021-10-08T19:21:25.608263+0000","last_unstale":"2021-10-08T19:22:48.428306+0000","last_undegraded":"2021-10-08T19:22:48.428306+0000","last_fullsized":"2021-10-08T19:22:48.428306+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:21:24.589054+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.430220+0000","last_change":"2021-10-08T19:22:38.544751+0000","last_active":"2021-10-08T19:22:48.430220+0000","last_peered":"2021-10-08T19:22:48.430220+0000","last_clean":"2021-10-08T19:22:48.430220+0000","last_became_active":"2021-10-08T19:21:29.681017+0000","last_became_peered":"2021-10-08T19:21:29.681017+0000","last_unstale":"2021-10-08T19:22:48.430220+0000","last_undegraded":"2021-10-08T19:22:48.430220+0000","last_fullsized":"2021-10-08T19:22:48.430220+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:38.544673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:38.544673+0000","last_clean_scrub_stamp":"2021-10-08T19:22:38.544673+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0019818940000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.428567+0000","last_change":"2021-10-08T19:22:45.177384+0000","last_active":"2021-10-08T19:22:48.428567+0000","last_peered":"2021-10-08T19:22:48.428567+0000","last_clean":"2021-10-08T19:22:48.428567+0000","last_became_active":"2021-10-08T19:21:27.635242+0000","last_became_peered":"2021-10-08T19:21:27.635242+0000","last_unstale":"2021-10-08T19:22:48.428567+0000","last_undegraded":"2021-10-08T19:22:48.428567+0000","last_fullsized":"2021-10-08T19:22:48.428567+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:45.177306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:45.177306+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034162229999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:07.581754+0000","last_change":"2021-10-08T19:23:07.581727+0000","last_active":"2021-10-08T19:23:07.581754+0000","last_peered":"2021-10-08T19:23:07.581754+0000","last_clean":"2021-10-08T19:23:07.581754+0000","last_became_active":"2021-10-08T19:21:23.605327+0000","last_became_peered":"2021-10-08T19:21:23.605327+0000","last_unstale":"2021-10-08T19:23:07.581754+0000","last_undegraded":"2021-10-08T19:23:07.581754+0000","last_fullsized":"2021-10-08T19:23:07.581754+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:07.581653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:07.581653+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034956309999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"69'12","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:10.562945+0000","last_change":"2021-10-08T19:23:10.562916+0000","last_active":"2021-10-08T19:23:10.562945+0000","last_peered":"2021-10-08T19:23:10.562945+0000","last_clean":"2021-10-08T19:23:10.562945+0000","last_became_active":"2021-10-08T19:21:25.612541+0000","last_became_peered":"2021-10-08T19:21:25.612541+0000","last_unstale":"2021-10-08T19:23:10.562945+0000","last_undegraded":"2021-10-08T19:23:10.562945+0000","last_fullsized":"2021-10-08T19:23:10.562945+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'12","last_scrub_stamp":"2021-10-08T19:23:10.562820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:10.562820+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040692890000000002,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:56.020956+0000","last_change":"2021-10-08T19:22:56.020836+0000","last_active":"2021-10-08T19:22:56.020956+0000","last_peered":"2021-10-08T19:22:56.020956+0000","last_clean":"2021-10-08T19:22:56.020956+0000","last_became_active":"2021-10-08T19:21:29.679050+0000","last_became_peered":"2021-10-08T19:21:29.679050+0000","last_unstale":"2021-10-08T19:22:56.020956+0000","last_undegraded":"2021-10-08T19:22:56.020956+0000","last_fullsized":"2021-10-08T19:22:56.020956+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:56.020759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:56.020759+0000","last_clean_scrub_stamp":"2021-10-08T19:22:56.020759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001373478,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:10.148869+0000","last_change":"2021-10-08T19:23:10.148845+0000","last_active":"2021-10-08T19:23:10.148869+0000","last_peered":"2021-10-08T19:23:10.148869+0000","last_clean":"2021-10-08T19:23:10.148869+0000","last_became_active":"2021-10-08T19:21:27.636398+0000","last_became_peered":"2021-10-08T19:21:27.636398+0000","last_unstale":"2021-10-08T19:23:10.148869+0000","last_undegraded":"2021-10-08T19:23:10.148869+0000","last_fullsized":"2021-10-08T19:23:10.148869+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:10.148774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:10.148774+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034045170000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":51,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.439357+0000","last_change":"2021-10-08T19:22:46.422938+0000","last_active":"2021-10-08T19:22:48.439357+0000","last_peered":"2021-10-08T19:22:48.439357+0000","last_clean":"2021-10-08T19:22:48.439357+0000","last_became_active":"2021-10-08T19:22:43.936982+0000","last_became_peered":"2021-10-08T19:22:43.936982+0000","last_unstale":"2021-10-08T19:22:48.439357+0000","last_undegraded":"2021-10-08T19:22:48.439357+0000","last_fullsized":"2021-10-08T19:22:48.439357+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:46.422866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:46.422866+0000","last_clean_scrub_stamp":"2021-10-08T19:22:46.422866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0014556809999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"69'15","reported_seq":90,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:52.475188+0000","last_change":"2021-10-08T19:22:52.474731+0000","last_active":"2021-10-08T19:22:52.475188+0000","last_peered":"2021-10-08T19:22:52.475188+0000","last_clean":"2021-10-08T19:22:52.475188+0000","last_became_active":"2021-10-08T19:22:44.005356+0000","last_became_peered":"2021-10-08T19:22:44.005356+0000","last_unstale":"2021-10-08T19:22:52.475188+0000","last_undegraded":"2021-10-08T19:22:52.475188+0000","last_fullsized":"2021-10-08T19:22:52.475188+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'15","last_scrub_stamp":"2021-10-08T19:22:52.474651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:52.474651+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040638499999999999,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"69'1","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:50.227056+0000","last_change":"2021-10-08T19:22:50.226593+0000","last_active":"2021-10-08T19:22:50.227056+0000","last_peered":"2021-10-08T19:22:50.227056+0000","last_clean":"2021-10-08T19:22:50.227056+0000","last_became_active":"2021-10-08T19:21:29.637392+0000","last_became_peered":"2021-10-08T19:21:29.637392+0000","last_unstale":"2021-10-08T19:22:50.227056+0000","last_undegraded":"2021-10-08T19:22:50.227056+0000","last_fullsized":"2021-10-08T19:22:50.227056+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2021-10-08T19:22:50.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:50.226504+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040000080000000002,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:58.625367+0000","last_change":"2021-10-08T19:22:58.625225+0000","last_active":"2021-10-08T19:22:58.625367+0000","last_peered":"2021-10-08T19:22:58.625367+0000","last_clean":"2021-10-08T19:22:58.625367+0000","last_became_active":"2021-10-08T19:21:27.632648+0000","last_became_peered":"2021-10-08T19:21:27.632648+0000","last_unstale":"2021-10-08T19:22:58.625367+0000","last_undegraded":"2021-10-08T19:22:58.625367+0000","last_fullsized":"2021-10-08T19:22:58.625367+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:58.625153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:58.625153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0015820020000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.429184+0000","last_change":"2021-10-08T19:21:23.604120+0000","last_active":"2021-10-08T19:22:48.429184+0000","last_peered":"2021-10-08T19:22:48.429184+0000","last_clean":"2021-10-08T19:22:48.429184+0000","last_became_active":"2021-10-08T19:21:23.603777+0000","last_became_peered":"2021-10-08T19:21:23.603777+0000","last_unstale":"2021-10-08T19:22:48.429184+0000","last_undegraded":"2021-10-08T19:22:48.429184+0000","last_fullsized":"2021-10-08T19:22:48.429184+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:21:22.582293+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"69'11","reported_seq":59,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:53.420426+0000","last_change":"2021-10-08T19:22:53.420275+0000","last_active":"2021-10-08T19:22:53.420426+0000","last_peered":"2021-10-08T19:22:53.420426+0000","last_clean":"2021-10-08T19:22:53.420426+0000","last_became_active":"2021-10-08T19:21:25.610902+0000","last_became_peered":"2021-10-08T19:21:25.610902+0000","last_unstale":"2021-10-08T19:22:53.420426+0000","last_undegraded":"2021-10-08T19:22:53.420426+0000","last_fullsized":"2021-10-08T19:22:53.420426+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'11","last_scrub_stamp":"2021-10-08T19:22:53.420199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:53.420199+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0023910469999999999,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"69'1","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:04.311518+0000","last_change":"2021-10-08T19:23:04.311491+0000","last_active":"2021-10-08T19:23:04.311518+0000","last_peered":"2021-10-08T19:23:04.311518+0000","last_clean":"2021-10-08T19:23:04.311518+0000","last_became_active":"2021-10-08T19:21:29.640296+0000","last_became_peered":"2021-10-08T19:21:29.640296+0000","last_unstale":"2021-10-08T19:23:04.311518+0000","last_undegraded":"2021-10-08T19:23:04.311518+0000","last_fullsized":"2021-10-08T19:23:04.311518+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2021-10-08T19:23:04.311406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:04.311406+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0041668299999999998,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"69'8","reported_seq":71,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:06.719778+0000","last_change":"2021-10-08T19:22:43.380890+0000","last_active":"2021-10-08T19:23:06.719778+0000","last_peered":"2021-10-08T19:23:06.719778+0000","last_clean":"2021-10-08T19:23:06.719778+0000","last_became_active":"2021-10-08T19:21:27.638792+0000","last_became_peered":"2021-10-08T19:21:27.638792+0000","last_unstale":"2021-10-08T19:23:06.719778+0000","last_undegraded":"2021-10-08T19:23:06.719778+0000","last_fullsized":"2021-10-08T19:23:06.719778+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'8","last_scrub_stamp":"2021-10-08T19:22:43.380786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:43.380786+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002000403,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.438180+0000","last_change":"2021-10-08T19:21:23.604789+0000","last_active":"2021-10-08T19:22:48.438180+0000","last_peered":"2021-10-08T19:22:48.438180+0000","last_clean":"2021-10-08T19:22:48.438180+0000","last_became_active":"2021-10-08T19:21:23.604530+0000","last_became_peered":"2021-10-08T19:21:23.604530+0000","last_unstale":"2021-10-08T19:22:48.438180+0000","last_undegraded":"2021-10-08T19:22:48.438180+0000","last_fullsized":"2021-10-08T19:22:48.438180+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:21:22.582293+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"69'10","reported_seq":55,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.439415+0000","last_change":"2021-10-08T19:22:27.654003+0000","last_active":"2021-10-08T19:22:48.439415+0000","last_peered":"2021-10-08T19:22:48.439415+0000","last_clean":"2021-10-08T19:22:48.439415+0000","last_became_active":"2021-10-08T19:21:25.743519+0000","last_became_peered":"2021-10-08T19:21:25.743519+0000","last_unstale":"2021-10-08T19:22:48.439415+0000","last_undegraded":"2021-10-08T19:22:48.439415+0000","last_fullsized":"2021-10-08T19:22:48.439415+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'10","last_scrub_stamp":"2021-10-08T19:22:27.653872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:27.653872+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0028937009999999998,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:06.570945+0000","last_change":"2021-10-08T19:23:06.570919+0000","last_active":"2021-10-08T19:23:06.570945+0000","last_peered":"2021-10-08T19:23:06.570945+0000","last_clean":"2021-10-08T19:23:06.570945+0000","last_became_active":"2021-10-08T19:21:29.681023+0000","last_became_peered":"2021-10-08T19:21:29.681023+0000","last_unstale":"2021-10-08T19:23:06.570945+0000","last_undegraded":"2021-10-08T19:23:06.570945+0000","last_fullsized":"2021-10-08T19:23:06.570945+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:06.570853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:06.570853+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034079790000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.194984+0000","last_change":"2021-10-08T19:23:00.194960+0000","last_active":"2021-10-08T19:23:00.194984+0000","last_peered":"2021-10-08T19:23:00.194984+0000","last_clean":"2021-10-08T19:23:00.194984+0000","last_became_active":"2021-10-08T19:21:27.637131+0000","last_became_peered":"2021-10-08T19:21:27.637131+0000","last_unstale":"2021-10-08T19:23:00.194984+0000","last_undegraded":"2021-10-08T19:23:00.194984+0000","last_fullsized":"2021-10-08T19:23:00.194984+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:00.194892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:00.194892+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020373650000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.439635+0000","last_change":"2021-10-08T19:22:31.311191+0000","last_active":"2021-10-08T19:22:48.439635+0000","last_peered":"2021-10-08T19:22:48.439635+0000","last_clean":"2021-10-08T19:22:48.439635+0000","last_became_active":"2021-10-08T19:21:23.606708+0000","last_became_peered":"2021-10-08T19:21:23.606708+0000","last_unstale":"2021-10-08T19:22:48.439635+0000","last_undegraded":"2021-10-08T19:22:48.439635+0000","last_fullsized":"2021-10-08T19:22:48.439635+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:31.311083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:31.311083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0015648369999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"69'11","reported_seq":53,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.429390+0000","last_change":"2021-10-08T19:21:25.742854+0000","last_active":"2021-10-08T19:22:48.429390+0000","last_peered":"2021-10-08T19:22:48.429390+0000","last_clean":"2021-10-08T19:22:48.429390+0000","last_became_active":"2021-10-08T19:21:25.742586+0000","last_became_peered":"2021-10-08T19:21:25.742586+0000","last_unstale":"2021-10-08T19:22:48.429390+0000","last_undegraded":"2021-10-08T19:22:48.429390+0000","last_fullsized":"2021-10-08T19:22:48.429390+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:21:24.589054+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:52.059744+0000","last_change":"2021-10-08T19:22:52.059253+0000","last_active":"2021-10-08T19:22:52.059744+0000","last_peered":"2021-10-08T19:22:52.059744+0000","last_clean":"2021-10-08T19:22:52.059744+0000","last_became_active":"2021-10-08T19:21:29.642835+0000","last_became_peered":"2021-10-08T19:21:29.642835+0000","last_unstale":"2021-10-08T19:22:52.059744+0000","last_undegraded":"2021-10-08T19:22:52.059744+0000","last_fullsized":"2021-10-08T19:22:52.059744+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:52.059181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:52.059181+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034376540000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:02.446499+0000","last_change":"2021-10-08T19:23:02.446476+0000","last_active":"2021-10-08T19:23:02.446499+0000","last_peered":"2021-10-08T19:23:02.446499+0000","last_clean":"2021-10-08T19:23:02.446499+0000","last_became_active":"2021-10-08T19:21:27.643513+0000","last_became_peered":"2021-10-08T19:21:27.643513+0000","last_unstale":"2021-10-08T19:23:02.446499+0000","last_undegraded":"2021-10-08T19:23:02.446499+0000","last_fullsized":"2021-10-08T19:23:02.446499+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:02.446394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:02.446394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001225133,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.440741+0000","last_change":"2021-10-08T19:21:23.600451+0000","last_active":"2021-10-08T19:22:48.440741+0000","last_peered":"2021-10-08T19:22:48.440741+0000","last_clean":"2021-10-08T19:22:48.440741+0000","last_became_active":"2021-10-08T19:21:23.600192+0000","last_became_peered":"2021-10-08T19:21:23.600192+0000","last_unstale":"2021-10-08T19:22:48.440741+0000","last_undegraded":"2021-10-08T19:22:48.440741+0000","last_fullsized":"2021-10-08T19:22:48.440741+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:21:22.582293+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"69'4","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.429144+0000","last_change":"2021-10-08T19:22:34.447928+0000","last_active":"2021-10-08T19:22:48.429144+0000","last_peered":"2021-10-08T19:22:48.429144+0000","last_clean":"2021-10-08T19:22:48.429144+0000","last_became_active":"2021-10-08T19:21:25.612729+0000","last_became_peered":"2021-10-08T19:21:25.612729+0000","last_unstale":"2021-10-08T19:22:48.429144+0000","last_undegraded":"2021-10-08T19:22:48.429144+0000","last_fullsized":"2021-10-08T19:22:48.429144+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'4","last_scrub_stamp":"2021-10-08T19:22:34.447854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:34.447854+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040770490000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:12.504248+0000","last_change":"2021-10-08T19:23:12.504222+0000","last_active":"2021-10-08T19:23:12.504248+0000","last_peered":"2021-10-08T19:23:12.504248+0000","last_clean":"2021-10-08T19:23:12.504248+0000","last_became_active":"2021-10-08T19:21:29.649225+0000","last_became_peered":"2021-10-08T19:21:29.649225+0000","last_unstale":"2021-10-08T19:23:12.504248+0000","last_undegraded":"2021-10-08T19:23:12.504248+0000","last_fullsized":"2021-10-08T19:23:12.504248+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:12.504136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:12.504136+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0038704550000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.438777+0000","last_change":"2021-10-08T19:22:43.186757+0000","last_active":"2021-10-08T19:22:48.438777+0000","last_peered":"2021-10-08T19:22:48.438777+0000","last_clean":"2021-10-08T19:22:48.438777+0000","last_became_active":"2021-10-08T19:21:27.635623+0000","last_became_peered":"2021-10-08T19:21:27.635623+0000","last_unstale":"2021-10-08T19:22:48.438777+0000","last_undegraded":"2021-10-08T19:22:48.438777+0000","last_fullsized":"2021-10-08T19:22:48.438777+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:43.186684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:43.186684+0000","last_clean_scrub_stamp":"2021-10-08T19:22:43.186684+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0015123129999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:02.242564+0000","last_change":"2021-10-08T19:23:02.242539+0000","last_active":"2021-10-08T19:23:02.242564+0000","last_peered":"2021-10-08T19:23:02.242564+0000","last_clean":"2021-10-08T19:23:02.242564+0000","last_became_active":"2021-10-08T19:21:23.607048+0000","last_became_peered":"2021-10-08T19:21:23.607048+0000","last_unstale":"2021-10-08T19:23:02.242564+0000","last_undegraded":"2021-10-08T19:23:02.242564+0000","last_fullsized":"2021-10-08T19:23:02.242564+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:02.242462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:02.242462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034031740000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"69'11","reported_seq":80,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.428611+0000","last_change":"2021-10-08T19:22:44.368163+0000","last_active":"2021-10-08T19:22:48.428611+0000","last_peered":"2021-10-08T19:22:48.428611+0000","last_clean":"2021-10-08T19:22:48.428611+0000","last_became_active":"2021-10-08T19:22:43.936354+0000","last_became_peered":"2021-10-08T19:22:43.936354+0000","last_unstale":"2021-10-08T19:22:48.428611+0000","last_undegraded":"2021-10-08T19:22:48.428611+0000","last_fullsized":"2021-10-08T19:22:48.428611+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'11","last_scrub_stamp":"2021-10-08T19:22:33.337032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:33.337032+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040894970000000001,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:02.605126+0000","last_change":"2021-10-08T19:23:02.605102+0000","last_active":"2021-10-08T19:23:02.605126+0000","last_peered":"2021-10-08T19:23:02.605126+0000","last_clean":"2021-10-08T19:23:02.605126+0000","last_became_active":"2021-10-08T19:21:29.641431+0000","last_became_peered":"2021-10-08T19:21:29.641431+0000","last_unstale":"2021-10-08T19:23:02.605126+0000","last_undegraded":"2021-10-08T19:23:02.605126+0000","last_fullsized":"2021-10-08T19:23:02.605126+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:02.605025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:02.605025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001265305,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.429830+0000","last_change":"2021-10-08T19:21:27.638133+0000","last_active":"2021-10-08T19:22:48.429830+0000","last_peered":"2021-10-08T19:22:48.429830+0000","last_clean":"2021-10-08T19:22:48.429830+0000","last_became_active":"2021-10-08T19:21:27.637800+0000","last_became_peered":"2021-10-08T19:21:27.637800+0000","last_unstale":"2021-10-08T19:22:48.429830+0000","last_undegraded":"2021-10-08T19:22:48.429830+0000","last_fullsized":"2021-10-08T19:22:48.429830+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:21:26.604244+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:52.409100+0000","last_change":"2021-10-08T19:22:52.408971+0000","last_active":"2021-10-08T19:22:52.409100+0000","last_peered":"2021-10-08T19:22:52.409100+0000","last_clean":"2021-10-08T19:22:52.409100+0000","last_became_active":"2021-10-08T19:21:23.606797+0000","last_became_peered":"2021-10-08T19:21:23.606797+0000","last_unstale":"2021-10-08T19:22:52.409100+0000","last_undegraded":"2021-10-08T19:22:52.409100+0000","last_fullsized":"2021-10-08T19:22:52.409100+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:52.408893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:52.408893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0015921889999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"87'13","reported_seq":60,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:53.263815+0000","last_change":"2021-10-08T19:22:53.263693+0000","last_active":"2021-10-08T19:22:53.263815+0000","last_peered":"2021-10-08T19:22:53.263815+0000","last_clean":"2021-10-08T19:22:53.263815+0000","last_became_active":"2021-10-08T19:21:25.615596+0000","last_became_peered":"2021-10-08T19:21:25.615596+0000","last_unstale":"2021-10-08T19:22:53.263815+0000","last_undegraded":"2021-10-08T19:22:53.263815+0000","last_fullsized":"2021-10-08T19:22:53.263815+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'13","last_scrub_stamp":"2021-10-08T19:22:53.263631+0000","last_deep_scrub":"87'13","last_deep_scrub_stamp":"2021-10-08T19:22:53.263631+0000","last_clean_scrub_stamp":"2021-10-08T19:22:53.263631+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0036954140000000002,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:49.049561+0000","last_change":"2021-10-08T19:22:49.049456+0000","last_active":"2021-10-08T19:22:49.049561+0000","last_peered":"2021-10-08T19:22:49.049561+0000","last_clean":"2021-10-08T19:22:49.049561+0000","last_became_active":"2021-10-08T19:21:29.640302+0000","last_became_peered":"2021-10-08T19:21:29.640302+0000","last_unstale":"2021-10-08T19:22:49.049561+0000","last_undegraded":"2021-10-08T19:22:49.049561+0000","last_fullsized":"2021-10-08T19:22:49.049561+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:49.049379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:49.049379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.00162856,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"69'8","reported_seq":68,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:06.719658+0000","last_change":"2021-10-08T19:22:32.372773+0000","last_active":"2021-10-08T19:23:06.719658+0000","last_peered":"2021-10-08T19:23:06.719658+0000","last_clean":"2021-10-08T19:23:06.719658+0000","last_became_active":"2021-10-08T19:21:27.636440+0000","last_became_peered":"2021-10-08T19:21:27.636440+0000","last_unstale":"2021-10-08T19:23:06.719658+0000","last_undegraded":"2021-10-08T19:23:06.719658+0000","last_fullsized":"2021-10-08T19:23:06.719658+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'8","last_scrub_stamp":"2021-10-08T19:22:32.372699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:32.372699+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039965820000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.439659+0000","last_change":"2021-10-08T19:22:24.698543+0000","last_active":"2021-10-08T19:22:48.439659+0000","last_peered":"2021-10-08T19:22:48.439659+0000","last_clean":"2021-10-08T19:22:48.439659+0000","last_became_active":"2021-10-08T19:21:23.606478+0000","last_became_peered":"2021-10-08T19:21:23.606478+0000","last_unstale":"2021-10-08T19:22:48.439659+0000","last_undegraded":"2021-10-08T19:22:48.439659+0000","last_fullsized":"2021-10-08T19:22:48.439659+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:24.698471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:24.698471+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001682846,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"69'9","reported_seq":56,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.440816+0000","last_change":"2021-10-08T19:22:42.517875+0000","last_active":"2021-10-08T19:22:48.440816+0000","last_peered":"2021-10-08T19:22:48.440816+0000","last_clean":"2021-10-08T19:22:48.440816+0000","last_became_active":"2021-10-08T19:21:25.741755+0000","last_became_peered":"2021-10-08T19:21:25.741755+0000","last_unstale":"2021-10-08T19:22:48.440816+0000","last_undegraded":"2021-10-08T19:22:48.440816+0000","last_fullsized":"2021-10-08T19:22:48.440816+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'9","last_scrub_stamp":"2021-10-08T19:22:42.517786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:42.517786+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0042286850000000003,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:11.535786+0000","last_change":"2021-10-08T19:23:11.535748+0000","last_active":"2021-10-08T19:23:11.535786+0000","last_peered":"2021-10-08T19:23:11.535786+0000","last_clean":"2021-10-08T19:23:11.535786+0000","last_became_active":"2021-10-08T19:21:29.646331+0000","last_became_peered":"2021-10-08T19:21:29.646331+0000","last_unstale":"2021-10-08T19:23:11.535786+0000","last_undegraded":"2021-10-08T19:23:11.535786+0000","last_fullsized":"2021-10-08T19:23:11.535786+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:11.535641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:11.535641+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001740417,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"69'8","reported_seq":68,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:06.719772+0000","last_change":"2021-10-08T19:22:28.467610+0000","last_active":"2021-10-08T19:23:06.719772+0000","last_peered":"2021-10-08T19:23:06.719772+0000","last_clean":"2021-10-08T19:23:06.719772+0000","last_became_active":"2021-10-08T19:21:27.635924+0000","last_became_peered":"2021-10-08T19:21:27.635924+0000","last_unstale":"2021-10-08T19:23:06.719772+0000","last_undegraded":"2021-10-08T19:23:06.719772+0000","last_fullsized":"2021-10-08T19:23:06.719772+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'8","last_scrub_stamp":"2021-10-08T19:22:28.467539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:28.467539+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039782960000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:04.759574+0000","last_change":"2021-10-08T19:23:04.759546+0000","last_active":"2021-10-08T19:23:04.759574+0000","last_peered":"2021-10-08T19:23:04.759574+0000","last_clean":"2021-10-08T19:23:04.759574+0000","last_became_active":"2021-10-08T19:21:23.603637+0000","last_became_peered":"2021-10-08T19:21:23.603637+0000","last_unstale":"2021-10-08T19:23:04.759574+0000","last_undegraded":"2021-10-08T19:23:04.759574+0000","last_fullsized":"2021-10-08T19:23:04.759574+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:04.759470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:04.759470+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001376447,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"69'10","reported_seq":55,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:52.611610+0000","last_change":"2021-10-08T19:22:52.611146+0000","last_active":"2021-10-08T19:22:52.611610+0000","last_peered":"2021-10-08T19:22:52.611610+0000","last_clean":"2021-10-08T19:22:52.611610+0000","last_became_active":"2021-10-08T19:21:25.741716+0000","last_became_peered":"2021-10-08T19:21:25.741716+0000","last_unstale":"2021-10-08T19:22:52.611610+0000","last_undegraded":"2021-10-08T19:22:52.611610+0000","last_fullsized":"2021-10-08T19:22:52.611610+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'10","last_scrub_stamp":"2021-10-08T19:22:52.611060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:52.611060+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040684459999999999,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.439304+0000","last_change":"2021-10-08T19:22:36.973546+0000","last_active":"2021-10-08T19:22:48.439304+0000","last_peered":"2021-10-08T19:22:48.439304+0000","last_clean":"2021-10-08T19:22:48.439304+0000","last_became_active":"2021-10-08T19:21:29.681255+0000","last_became_peered":"2021-10-08T19:21:29.681255+0000","last_unstale":"2021-10-08T19:22:48.439304+0000","last_undegraded":"2021-10-08T19:22:48.439304+0000","last_fullsized":"2021-10-08T19:22:48.439304+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:36.973452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:36.973452+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001482431,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:50.573566+0000","last_change":"2021-10-08T19:22:50.573085+0000","last_active":"2021-10-08T19:22:50.573566+0000","last_peered":"2021-10-08T19:22:50.573566+0000","last_clean":"2021-10-08T19:22:50.573566+0000","last_became_active":"2021-10-08T19:21:27.634443+0000","last_became_peered":"2021-10-08T19:21:27.634443+0000","last_unstale":"2021-10-08T19:22:50.573566+0000","last_undegraded":"2021-10-08T19:22:50.573566+0000","last_fullsized":"2021-10-08T19:22:50.573566+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:50.573010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:50.573010+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034131029999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.439487+0000","last_change":"2021-10-08T19:22:35.361033+0000","last_active":"2021-10-08T19:22:48.439487+0000","last_peered":"2021-10-08T19:22:48.439487+0000","last_clean":"2021-10-08T19:22:48.439487+0000","last_became_active":"2021-10-08T19:21:23.611362+0000","last_became_peered":"2021-10-08T19:21:23.611362+0000","last_unstale":"2021-10-08T19:22:48.439487+0000","last_undegraded":"2021-10-08T19:22:48.439487+0000","last_fullsized":"2021-10-08T19:22:48.439487+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:35.360970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:35.360970+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001166795,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"69'6","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.430212+0000","last_change":"2021-10-08T19:21:25.742930+0000","last_active":"2021-10-08T19:22:48.430212+0000","last_peered":"2021-10-08T19:22:48.430212+0000","last_clean":"2021-10-08T19:22:48.430212+0000","last_became_active":"2021-10-08T19:21:25.742631+0000","last_became_peered":"2021-10-08T19:21:25.742631+0000","last_unstale":"2021-10-08T19:22:48.430212+0000","last_undegraded":"2021-10-08T19:22:48.430212+0000","last_fullsized":"2021-10-08T19:22:48.430212+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:21:24.589054+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.428422+0000","last_change":"2021-10-08T19:22:40.421310+0000","last_active":"2021-10-08T19:22:48.428422+0000","last_peered":"2021-10-08T19:22:48.428422+0000","last_clean":"2021-10-08T19:22:48.428422+0000","last_became_active":"2021-10-08T19:21:29.640674+0000","last_became_peered":"2021-10-08T19:21:29.640674+0000","last_unstale":"2021-10-08T19:22:48.428422+0000","last_undegraded":"2021-10-08T19:22:48.428422+0000","last_fullsized":"2021-10-08T19:22:48.428422+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:40.421229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.421229+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034873370000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.430293+0000","last_change":"2021-10-08T19:22:36.466178+0000","last_active":"2021-10-08T19:22:48.430293+0000","last_peered":"2021-10-08T19:22:48.430293+0000","last_clean":"2021-10-08T19:22:48.430293+0000","last_became_active":"2021-10-08T19:21:27.638112+0000","last_became_peered":"2021-10-08T19:21:27.638112+0000","last_unstale":"2021-10-08T19:22:48.430293+0000","last_undegraded":"2021-10-08T19:22:48.430293+0000","last_fullsized":"2021-10-08T19:22:48.430293+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:36.466077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:36.466077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0018534809999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.428025+0000","last_change":"2021-10-08T19:22:24.268774+0000","last_active":"2021-10-08T19:22:48.428025+0000","last_peered":"2021-10-08T19:22:48.428025+0000","last_clean":"2021-10-08T19:22:48.428025+0000","last_became_active":"2021-10-08T19:21:23.598125+0000","last_became_peered":"2021-10-08T19:21:23.598125+0000","last_unstale":"2021-10-08T19:22:48.428025+0000","last_undegraded":"2021-10-08T19:22:48.428025+0000","last_fullsized":"2021-10-08T19:22:48.428025+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:24.268699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:24.268699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001617215,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"69'9","reported_seq":56,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.644563+0000","last_change":"2021-10-08T19:23:00.644527+0000","last_active":"2021-10-08T19:23:00.644563+0000","last_peered":"2021-10-08T19:23:00.644563+0000","last_clean":"2021-10-08T19:23:00.644563+0000","last_became_active":"2021-10-08T19:21:25.743804+0000","last_became_peered":"2021-10-08T19:21:25.743804+0000","last_unstale":"2021-10-08T19:23:00.644563+0000","last_undegraded":"2021-10-08T19:23:00.644563+0000","last_fullsized":"2021-10-08T19:23:00.644563+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'9","last_scrub_stamp":"2021-10-08T19:23:00.644449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:00.644449+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0023246959999999998,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.429852+0000","last_change":"2021-10-08T19:21:29.647439+0000","last_active":"2021-10-08T19:22:48.429852+0000","last_peered":"2021-10-08T19:22:48.429852+0000","last_clean":"2021-10-08T19:22:48.429852+0000","last_became_active":"2021-10-08T19:21:29.647140+0000","last_became_peered":"2021-10-08T19:21:29.647140+0000","last_unstale":"2021-10-08T19:22:48.429852+0000","last_undegraded":"2021-10-08T19:22:48.429852+0000","last_fullsized":"2021-10-08T19:22:48.429852+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:21:28.621762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"61'2","reported_seq":58,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:07.991495+0000","last_change":"2021-10-08T19:23:07.991466+0000","last_active":"2021-10-08T19:23:07.991495+0000","last_peered":"2021-10-08T19:23:07.991495+0000","last_clean":"2021-10-08T19:23:07.991495+0000","last_became_active":"2021-10-08T19:21:23.603614+0000","last_became_peered":"2021-10-08T19:21:23.603614+0000","last_unstale":"2021-10-08T19:23:07.991495+0000","last_undegraded":"2021-10-08T19:23:07.991495+0000","last_fullsized":"2021-10-08T19:23:07.991495+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'2","last_scrub_stamp":"2021-10-08T19:23:07.991388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:07.991388+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001614983,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"69'12","reported_seq":63,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:57.004206+0000","last_change":"2021-10-08T19:22:57.003718+0000","last_active":"2021-10-08T19:22:57.004206+0000","last_peered":"2021-10-08T19:22:57.004206+0000","last_clean":"2021-10-08T19:22:57.004206+0000","last_became_active":"2021-10-08T19:21:25.609079+0000","last_became_peered":"2021-10-08T19:21:25.609079+0000","last_unstale":"2021-10-08T19:22:57.004206+0000","last_undegraded":"2021-10-08T19:22:57.004206+0000","last_fullsized":"2021-10-08T19:22:57.004206+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'12","last_scrub_stamp":"2021-10-08T19:22:57.003641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:57.003641+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0041017010000000001,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:50.435743+0000","last_change":"2021-10-08T19:22:50.435623+0000","last_active":"2021-10-08T19:22:50.435743+0000","last_peered":"2021-10-08T19:22:50.435743+0000","last_clean":"2021-10-08T19:22:50.435743+0000","last_became_active":"2021-10-08T19:21:27.633878+0000","last_became_peered":"2021-10-08T19:21:27.633878+0000","last_unstale":"2021-10-08T19:22:50.435743+0000","last_undegraded":"2021-10-08T19:22:50.435743+0000","last_fullsized":"2021-10-08T19:22:50.435743+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:50.435552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:50.435552+0000","last_clean_scrub_stamp":"2021-10-08T19:22:50.435552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0012976140000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.438192+0000","last_change":"2021-10-08T19:22:46.569728+0000","last_active":"2021-10-08T19:22:48.438192+0000","last_peered":"2021-10-08T19:22:48.438192+0000","last_clean":"2021-10-08T19:22:48.438192+0000","last_became_active":"2021-10-08T19:21:29.649735+0000","last_became_peered":"2021-10-08T19:21:29.649735+0000","last_unstale":"2021-10-08T19:22:48.438192+0000","last_undegraded":"2021-10-08T19:22:48.438192+0000","last_fullsized":"2021-10-08T19:22:48.438192+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:46.569603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:46.569603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001693387,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.439274+0000","last_change":"2021-10-08T19:22:39.168725+0000","last_active":"2021-10-08T19:22:48.439274+0000","last_peered":"2021-10-08T19:22:48.439274+0000","last_clean":"2021-10-08T19:22:48.439274+0000","last_became_active":"2021-10-08T19:21:23.605441+0000","last_became_peered":"2021-10-08T19:21:23.605441+0000","last_unstale":"2021-10-08T19:22:48.439274+0000","last_undegraded":"2021-10-08T19:22:48.439274+0000","last_fullsized":"2021-10-08T19:22:48.439274+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:39.168642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:39.168642+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001714901,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"69'10","reported_seq":55,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:54.269332+0000","last_change":"2021-10-08T19:22:54.269202+0000","last_active":"2021-10-08T19:22:54.269332+0000","last_peered":"2021-10-08T19:22:54.269332+0000","last_clean":"2021-10-08T19:22:54.269332+0000","last_became_active":"2021-10-08T19:21:25.608581+0000","last_became_peered":"2021-10-08T19:21:25.608581+0000","last_unstale":"2021-10-08T19:22:54.269332+0000","last_undegraded":"2021-10-08T19:22:54.269332+0000","last_fullsized":"2021-10-08T19:22:54.269332+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'10","last_scrub_stamp":"2021-10-08T19:22:54.269123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:54.269123+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0024762310000000002,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"69'8","reported_seq":68,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:06.719666+0000","last_change":"2021-10-08T19:22:32.603483+0000","last_active":"2021-10-08T19:23:06.719666+0000","last_peered":"2021-10-08T19:23:06.719666+0000","last_clean":"2021-10-08T19:23:06.719666+0000","last_became_active":"2021-10-08T19:21:27.636151+0000","last_became_peered":"2021-10-08T19:21:27.636151+0000","last_unstale":"2021-10-08T19:23:06.719666+0000","last_undegraded":"2021-10-08T19:23:06.719666+0000","last_fullsized":"2021-10-08T19:23:06.719666+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'8","last_scrub_stamp":"2021-10-08T19:22:32.603379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:32.603379+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0022390349999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.430106+0000","last_change":"2021-10-08T19:21:29.647729+0000","last_active":"2021-10-08T19:22:48.430106+0000","last_peered":"2021-10-08T19:22:48.430106+0000","last_clean":"2021-10-08T19:22:48.430106+0000","last_became_active":"2021-10-08T19:21:29.647403+0000","last_became_peered":"2021-10-08T19:21:29.647403+0000","last_unstale":"2021-10-08T19:22:48.430106+0000","last_undegraded":"2021-10-08T19:22:48.430106+0000","last_fullsized":"2021-10-08T19:22:48.430106+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:21:28.621762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:01.747062+0000","last_change":"2021-10-08T19:23:01.747028+0000","last_active":"2021-10-08T19:23:01.747062+0000","last_peered":"2021-10-08T19:23:01.747062+0000","last_clean":"2021-10-08T19:23:01.747062+0000","last_became_active":"2021-10-08T19:21:23.601309+0000","last_became_peered":"2021-10-08T19:21:23.601309+0000","last_unstale":"2021-10-08T19:23:01.747062+0000","last_undegraded":"2021-10-08T19:23:01.747062+0000","last_fullsized":"2021-10-08T19:23:01.747062+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:01.746914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:01.746914+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001402506,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"69'28","reported_seq":110,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:06.719664+0000","last_change":"2021-10-08T19:22:40.195245+0000","last_active":"2021-10-08T19:23:06.719664+0000","last_peered":"2021-10-08T19:23:06.719664+0000","last_clean":"2021-10-08T19:23:06.719664+0000","last_became_active":"2021-10-08T19:21:25.613663+0000","last_became_peered":"2021-10-08T19:21:25.613663+0000","last_unstale":"2021-10-08T19:23:06.719664+0000","last_undegraded":"2021-10-08T19:23:06.719664+0000","last_fullsized":"2021-10-08T19:23:06.719664+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'28","last_scrub_stamp":"2021-10-08T19:22:40.195166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.195166+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0029295340000000001,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:03.639051+0000","last_change":"2021-10-08T19:23:03.639015+0000","last_active":"2021-10-08T19:23:03.639051+0000","last_peered":"2021-10-08T19:23:03.639051+0000","last_clean":"2021-10-08T19:23:03.639051+0000","last_became_active":"2021-10-08T19:21:27.636192+0000","last_became_peered":"2021-10-08T19:21:27.636192+0000","last_unstale":"2021-10-08T19:23:03.639051+0000","last_undegraded":"2021-10-08T19:23:03.639051+0000","last_fullsized":"2021-10-08T19:23:03.639051+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:03.638920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:03.638920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0016933230000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:01.215702+0000","last_change":"2021-10-08T19:23:01.215676+0000","last_active":"2021-10-08T19:23:01.215702+0000","last_peered":"2021-10-08T19:23:01.215702+0000","last_clean":"2021-10-08T19:23:01.215702+0000","last_became_active":"2021-10-08T19:21:29.679259+0000","last_became_peered":"2021-10-08T19:21:29.679259+0000","last_unstale":"2021-10-08T19:23:01.215702+0000","last_undegraded":"2021-10-08T19:23:01.215702+0000","last_fullsized":"2021-10-08T19:23:01.215702+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:01.215579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:01.215579+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001463748,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"70'5","reported_seq":148,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:12.183810+0000","last_change":"2021-10-08T19:22:48.239798+0000","last_active":"2021-10-08T19:23:12.183810+0000","last_peered":"2021-10-08T19:23:12.183810+0000","last_clean":"2021-10-08T19:23:12.183810+0000","last_became_active":"2021-10-08T19:21:23.601969+0000","last_became_peered":"2021-10-08T19:21:23.601969+0000","last_unstale":"2021-10-08T19:23:12.183810+0000","last_undegraded":"2021-10-08T19:23:12.183810+0000","last_fullsized":"2021-10-08T19:23:12.183810+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:22:48.239721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:48.239721+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001618092,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":103,"num_read_kb":98,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:53.423462+0000","last_change":"2021-10-08T19:22:53.423318+0000","last_active":"2021-10-08T19:22:53.423462+0000","last_peered":"2021-10-08T19:22:53.423462+0000","last_clean":"2021-10-08T19:22:53.423462+0000","last_became_active":"2021-10-08T19:21:23.602967+0000","last_became_peered":"2021-10-08T19:21:23.602967+0000","last_unstale":"2021-10-08T19:22:53.423462+0000","last_undegraded":"2021-10-08T19:22:53.423462+0000","last_fullsized":"2021-10-08T19:22:53.423462+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:53.423249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:53.423249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001264587,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"69'13","reported_seq":67,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.439589+0000","last_change":"2021-10-08T19:22:46.281753+0000","last_active":"2021-10-08T19:22:48.439589+0000","last_peered":"2021-10-08T19:22:48.439589+0000","last_clean":"2021-10-08T19:22:48.439589+0000","last_became_active":"2021-10-08T19:21:25.608584+0000","last_became_peered":"2021-10-08T19:21:25.608584+0000","last_unstale":"2021-10-08T19:22:48.439589+0000","last_undegraded":"2021-10-08T19:22:48.439589+0000","last_fullsized":"2021-10-08T19:22:48.439589+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'13","last_scrub_stamp":"2021-10-08T19:22:46.281626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:46.281626+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0047889999999999999,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:06.487881+0000","last_change":"2021-10-08T19:23:06.487842+0000","last_active":"2021-10-08T19:23:06.487881+0000","last_peered":"2021-10-08T19:23:06.487881+0000","last_clean":"2021-10-08T19:23:06.487881+0000","last_became_active":"2021-10-08T19:21:27.637875+0000","last_became_peered":"2021-10-08T19:21:27.637875+0000","last_unstale":"2021-10-08T19:23:06.487881+0000","last_undegraded":"2021-10-08T19:23:06.487881+0000","last_fullsized":"2021-10-08T19:23:06.487881+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:06.487723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:06.487723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034218619999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.440903+0000","last_change":"2021-10-08T19:21:29.646537+0000","last_active":"2021-10-08T19:22:48.440903+0000","last_peered":"2021-10-08T19:22:48.440903+0000","last_clean":"2021-10-08T19:22:48.440903+0000","last_became_active":"2021-10-08T19:21:29.646242+0000","last_became_peered":"2021-10-08T19:21:29.646242+0000","last_unstale":"2021-10-08T19:22:48.440903+0000","last_undegraded":"2021-10-08T19:22:48.440903+0000","last_fullsized":"2021-10-08T19:22:48.440903+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:21:28.621762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.429499+0000","last_change":"2021-10-08T19:22:40.563324+0000","last_active":"2021-10-08T19:22:48.429499+0000","last_peered":"2021-10-08T19:22:48.429499+0000","last_clean":"2021-10-08T19:22:48.429499+0000","last_became_active":"2021-10-08T19:21:23.608665+0000","last_became_peered":"2021-10-08T19:21:23.608665+0000","last_unstale":"2021-10-08T19:22:48.429499+0000","last_undegraded":"2021-10-08T19:22:48.429499+0000","last_fullsized":"2021-10-08T19:22:48.429499+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:40.563247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.563247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.024890005999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.439242+0000","last_change":"2021-10-08T19:21:23.599479+0000","last_active":"2021-10-08T19:22:48.439242+0000","last_peered":"2021-10-08T19:22:48.439242+0000","last_clean":"2021-10-08T19:22:48.439242+0000","last_became_active":"2021-10-08T19:21:23.599143+0000","last_became_peered":"2021-10-08T19:21:23.599143+0000","last_unstale":"2021-10-08T19:22:48.439242+0000","last_undegraded":"2021-10-08T19:22:48.439242+0000","last_fullsized":"2021-10-08T19:22:48.439242+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:21:22.582293+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"73'128","reported_seq":291,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.438557+0000","last_change":"2021-10-08T19:22:13.939106+0000","last_active":"2021-10-08T19:22:48.438557+0000","last_peered":"2021-10-08T19:22:48.438557+0000","last_clean":"2021-10-08T19:22:48.438557+0000","last_became_active":"2021-10-08T19:21:19.594086+0000","last_became_peered":"2021-10-08T19:21:19.594086+0000","last_unstale":"2021-10-08T19:22:48.438557+0000","last_undegraded":"2021-10-08T19:22:48.438557+0000","last_fullsized":"2021-10-08T19:22:48.438557+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'128","last_scrub_stamp":"2021-10-08T19:22:13.939025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:19:44.414003+0000","last_clean_scrub_stamp":"2021-10-08T19:22:13.939025+0000","log_size":128,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020087920000000001,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"69'14","reported_seq":62,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:54.379580+0000","last_change":"2021-10-08T19:22:54.379424+0000","last_active":"2021-10-08T19:22:54.379580+0000","last_peered":"2021-10-08T19:22:54.379580+0000","last_clean":"2021-10-08T19:22:54.379580+0000","last_became_active":"2021-10-08T19:21:25.743499+0000","last_became_peered":"2021-10-08T19:21:25.743499+0000","last_unstale":"2021-10-08T19:22:54.379580+0000","last_undegraded":"2021-10-08T19:22:54.379580+0000","last_fullsized":"2021-10-08T19:22:54.379580+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'14","last_scrub_stamp":"2021-10-08T19:22:54.379349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:54.379349+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0021365989999999999,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:02.267604+0000","last_change":"2021-10-08T19:23:02.267580+0000","last_active":"2021-10-08T19:23:02.267604+0000","last_peered":"2021-10-08T19:23:02.267604+0000","last_clean":"2021-10-08T19:23:02.267604+0000","last_became_active":"2021-10-08T19:21:27.636086+0000","last_became_peered":"2021-10-08T19:21:27.636086+0000","last_unstale":"2021-10-08T19:23:02.267604+0000","last_undegraded":"2021-10-08T19:23:02.267604+0000","last_fullsized":"2021-10-08T19:23:02.267604+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:02.267508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:02.267508+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034499700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:55.235130+0000","last_change":"2021-10-08T19:22:55.234981+0000","last_active":"2021-10-08T19:22:55.235130+0000","last_peered":"2021-10-08T19:22:55.235130+0000","last_clean":"2021-10-08T19:22:55.235130+0000","last_became_active":"2021-10-08T19:21:29.648784+0000","last_became_peered":"2021-10-08T19:21:29.648784+0000","last_unstale":"2021-10-08T19:22:55.235130+0000","last_undegraded":"2021-10-08T19:22:55.235130+0000","last_fullsized":"2021-10-08T19:22:55.235130+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:55.234909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:55.234909+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0014461070000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.438607+0000","last_change":"2021-10-08T19:22:31.557761+0000","last_active":"2021-10-08T19:22:48.438607+0000","last_peered":"2021-10-08T19:22:48.438607+0000","last_clean":"2021-10-08T19:22:48.438607+0000","last_became_active":"2021-10-08T19:21:23.602857+0000","last_became_peered":"2021-10-08T19:21:23.602857+0000","last_unstale":"2021-10-08T19:22:48.438607+0000","last_undegraded":"2021-10-08T19:22:48.438607+0000","last_fullsized":"2021-10-08T19:22:48.438607+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:31.557650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:31.557650+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001454997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.438457+0000","last_change":"2021-10-08T19:22:32.922768+0000","last_active":"2021-10-08T19:22:48.438457+0000","last_peered":"2021-10-08T19:22:48.438457+0000","last_clean":"2021-10-08T19:22:48.438457+0000","last_became_active":"2021-10-08T19:21:23.606755+0000","last_became_peered":"2021-10-08T19:21:23.606755+0000","last_unstale":"2021-10-08T19:22:48.438457+0000","last_undegraded":"2021-10-08T19:22:48.438457+0000","last_fullsized":"2021-10-08T19:22:48.438457+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:32.922694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:32.922694+0000","last_clean_scrub_stamp":"2021-10-08T19:22:32.922694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001758531,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"69'12","reported_seq":58,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:55.640154+0000","last_change":"2021-10-08T19:22:55.639993+0000","last_active":"2021-10-08T19:22:55.640154+0000","last_peered":"2021-10-08T19:22:55.640154+0000","last_clean":"2021-10-08T19:22:55.640154+0000","last_became_active":"2021-10-08T19:21:25.610233+0000","last_became_peered":"2021-10-08T19:21:25.610233+0000","last_unstale":"2021-10-08T19:22:55.640154+0000","last_undegraded":"2021-10-08T19:22:55.640154+0000","last_fullsized":"2021-10-08T19:22:55.640154+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'12","last_scrub_stamp":"2021-10-08T19:22:55.639881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:55.639881+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0032422169999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.440916+0000","last_change":"2021-10-08T19:22:34.475012+0000","last_active":"2021-10-08T19:22:48.440916+0000","last_peered":"2021-10-08T19:22:48.440916+0000","last_clean":"2021-10-08T19:22:48.440916+0000","last_became_active":"2021-10-08T19:21:27.635800+0000","last_became_peered":"2021-10-08T19:21:27.635800+0000","last_unstale":"2021-10-08T19:22:48.440916+0000","last_undegraded":"2021-10-08T19:22:48.440916+0000","last_fullsized":"2021-10-08T19:22:48.440916+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:34.474918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:34.474918+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0037343509999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:06.155184+0000","last_change":"2021-10-08T19:23:06.155149+0000","last_active":"2021-10-08T19:23:06.155184+0000","last_peered":"2021-10-08T19:23:06.155184+0000","last_clean":"2021-10-08T19:23:06.155184+0000","last_became_active":"2021-10-08T19:21:29.679477+0000","last_became_peered":"2021-10-08T19:21:29.679477+0000","last_unstale":"2021-10-08T19:23:06.155184+0000","last_undegraded":"2021-10-08T19:23:06.155184+0000","last_fullsized":"2021-10-08T19:23:06.155184+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:06.155068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:06.155068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001436805,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"61'1","reported_seq":49,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.439612+0000","last_change":"2021-10-08T19:22:26.905589+0000","last_active":"2021-10-08T19:22:48.439612+0000","last_peered":"2021-10-08T19:22:48.439612+0000","last_clean":"2021-10-08T19:22:48.439612+0000","last_became_active":"2021-10-08T19:21:23.604258+0000","last_became_peered":"2021-10-08T19:21:23.604258+0000","last_unstale":"2021-10-08T19:22:48.439612+0000","last_undegraded":"2021-10-08T19:22:48.439612+0000","last_fullsized":"2021-10-08T19:22:48.439612+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'1","last_scrub_stamp":"2021-10-08T19:22:26.905517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:26.905517+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001822178,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"69'19","reported_seq":76,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.439619+0000","last_change":"2021-10-08T19:22:29.614784+0000","last_active":"2021-10-08T19:22:48.439619+0000","last_peered":"2021-10-08T19:22:48.439619+0000","last_clean":"2021-10-08T19:22:48.439619+0000","last_became_active":"2021-10-08T19:21:25.741812+0000","last_became_peered":"2021-10-08T19:21:25.741812+0000","last_unstale":"2021-10-08T19:22:48.439619+0000","last_undegraded":"2021-10-08T19:22:48.439619+0000","last_fullsized":"2021-10-08T19:22:48.439619+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'19","last_scrub_stamp":"2021-10-08T19:22:29.614706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:29.614706+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0024396359999999998,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.439280+0000","last_change":"2021-10-08T19:22:42.399514+0000","last_active":"2021-10-08T19:22:48.439280+0000","last_peered":"2021-10-08T19:22:48.439280+0000","last_clean":"2021-10-08T19:22:48.439280+0000","last_became_active":"2021-10-08T19:21:27.637846+0000","last_became_peered":"2021-10-08T19:21:27.637846+0000","last_unstale":"2021-10-08T19:22:48.439280+0000","last_undegraded":"2021-10-08T19:22:48.439280+0000","last_fullsized":"2021-10-08T19:22:48.439280+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:42.399412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:42.399412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0019951610000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.428557+0000","last_change":"2021-10-08T19:22:40.264230+0000","last_active":"2021-10-08T19:22:48.428557+0000","last_peered":"2021-10-08T19:22:48.428557+0000","last_clean":"2021-10-08T19:22:48.428557+0000","last_became_active":"2021-10-08T19:21:29.646491+0000","last_became_peered":"2021-10-08T19:21:29.646491+0000","last_unstale":"2021-10-08T19:22:48.428557+0000","last_undegraded":"2021-10-08T19:22:48.428557+0000","last_fullsized":"2021-10-08T19:22:48.428557+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:40.264110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.264110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003475845,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.438995+0000","last_change":"2021-10-08T19:22:41.187045+0000","last_active":"2021-10-08T19:22:48.438995+0000","last_peered":"2021-10-08T19:22:48.438995+0000","last_clean":"2021-10-08T19:22:48.438995+0000","last_became_active":"2021-10-08T19:21:23.607770+0000","last_became_peered":"2021-10-08T19:21:23.607770+0000","last_unstale":"2021-10-08T19:22:48.438995+0000","last_undegraded":"2021-10-08T19:22:48.438995+0000","last_fullsized":"2021-10-08T19:22:48.438995+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:41.186945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:41.186945+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0037557269999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"69'18","reported_seq":66,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.429004+0000","last_change":"2021-10-08T19:21:25.743203+0000","last_active":"2021-10-08T19:22:48.429004+0000","last_peered":"2021-10-08T19:22:48.429004+0000","last_clean":"2021-10-08T19:22:48.429004+0000","last_became_active":"2021-10-08T19:21:25.742909+0000","last_became_peered":"2021-10-08T19:21:25.742909+0000","last_unstale":"2021-10-08T19:22:48.429004+0000","last_undegraded":"2021-10-08T19:22:48.429004+0000","last_fullsized":"2021-10-08T19:22:48.429004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:21:24.589054+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:52.022288+0000","last_change":"2021-10-08T19:22:52.021819+0000","last_active":"2021-10-08T19:22:52.022288+0000","last_peered":"2021-10-08T19:22:52.022288+0000","last_clean":"2021-10-08T19:22:52.022288+0000","last_became_active":"2021-10-08T19:21:27.637547+0000","last_became_peered":"2021-10-08T19:21:27.637547+0000","last_unstale":"2021-10-08T19:22:52.022288+0000","last_undegraded":"2021-10-08T19:22:52.022288+0000","last_fullsized":"2021-10-08T19:22:52.022288+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:52.021733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:52.021733+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034012640000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:05.263610+0000","last_change":"2021-10-08T19:23:05.263582+0000","last_active":"2021-10-08T19:23:05.263610+0000","last_peered":"2021-10-08T19:23:05.263610+0000","last_clean":"2021-10-08T19:23:05.263610+0000","last_became_active":"2021-10-08T19:21:29.681295+0000","last_became_peered":"2021-10-08T19:21:29.681295+0000","last_unstale":"2021-10-08T19:23:05.263610+0000","last_undegraded":"2021-10-08T19:23:05.263610+0000","last_fullsized":"2021-10-08T19:23:05.263610+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:05.263508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:05.263508+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034369000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:49.391440+0000","last_change":"2021-10-08T19:22:49.391329+0000","last_active":"2021-10-08T19:22:49.391440+0000","last_peered":"2021-10-08T19:22:49.391440+0000","last_clean":"2021-10-08T19:22:49.391440+0000","last_became_active":"2021-10-08T19:21:23.606848+0000","last_became_peered":"2021-10-08T19:21:23.606848+0000","last_unstale":"2021-10-08T19:22:49.391440+0000","last_undegraded":"2021-10-08T19:22:49.391440+0000","last_fullsized":"2021-10-08T19:22:49.391440+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:49.391258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:49.391258+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0014044610000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"69'14","reported_seq":61,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.428192+0000","last_change":"2021-10-08T19:22:26.321058+0000","last_active":"2021-10-08T19:22:48.428192+0000","last_peered":"2021-10-08T19:22:48.428192+0000","last_clean":"2021-10-08T19:22:48.428192+0000","last_became_active":"2021-10-08T19:21:25.613140+0000","last_became_peered":"2021-10-08T19:21:25.613140+0000","last_unstale":"2021-10-08T19:22:48.428192+0000","last_undegraded":"2021-10-08T19:22:48.428192+0000","last_fullsized":"2021-10-08T19:22:48.428192+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'14","last_scrub_stamp":"2021-10-08T19:22:26.320928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:26.320928+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0048335899999999996,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"69'8","reported_seq":62,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:06.719674+0000","last_change":"2021-10-08T19:21:27.641064+0000","last_active":"2021-10-08T19:23:06.719674+0000","last_peered":"2021-10-08T19:23:06.719674+0000","last_clean":"2021-10-08T19:23:06.719674+0000","last_became_active":"2021-10-08T19:21:27.640694+0000","last_became_peered":"2021-10-08T19:21:27.640694+0000","last_unstale":"2021-10-08T19:23:06.719674+0000","last_undegraded":"2021-10-08T19:23:06.719674+0000","last_fullsized":"2021-10-08T19:23:06.719674+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:21:26.604244+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.429842+0000","last_change":"2021-10-08T19:21:29.679596+0000","last_active":"2021-10-08T19:22:48.429842+0000","last_peered":"2021-10-08T19:22:48.429842+0000","last_clean":"2021-10-08T19:22:48.429842+0000","last_became_active":"2021-10-08T19:21:29.679295+0000","last_became_peered":"2021-10-08T19:21:29.679295+0000","last_unstale":"2021-10-08T19:22:48.429842+0000","last_undegraded":"2021-10-08T19:22:48.429842+0000","last_fullsized":"2021-10-08T19:22:48.429842+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:21:28.621762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.440838+0000","last_change":"2021-10-08T19:21:27.637846+0000","last_active":"2021-10-08T19:22:48.440838+0000","last_peered":"2021-10-08T19:22:48.440838+0000","last_clean":"2021-10-08T19:22:48.440838+0000","last_became_active":"2021-10-08T19:21:27.637547+0000","last_became_peered":"2021-10-08T19:21:27.637547+0000","last_unstale":"2021-10-08T19:22:48.440838+0000","last_undegraded":"2021-10-08T19:22:48.440838+0000","last_fullsized":"2021-10-08T19:22:48.440838+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:21:26.604244+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.438640+0000","last_change":"2021-10-08T19:22:29.954439+0000","last_active":"2021-10-08T19:22:48.438640+0000","last_peered":"2021-10-08T19:22:48.438640+0000","last_clean":"2021-10-08T19:22:48.438640+0000","last_became_active":"2021-10-08T19:21:23.606597+0000","last_became_peered":"2021-10-08T19:21:23.606597+0000","last_unstale":"2021-10-08T19:22:48.438640+0000","last_undegraded":"2021-10-08T19:22:48.438640+0000","last_fullsized":"2021-10-08T19:22:48.438640+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:29.954337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:29.954337+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0018351859999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"69'11","reported_seq":59,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:01.988487+0000","last_change":"2021-10-08T19:23:01.988442+0000","last_active":"2021-10-08T19:23:01.988487+0000","last_peered":"2021-10-08T19:23:01.988487+0000","last_clean":"2021-10-08T19:23:01.988487+0000","last_became_active":"2021-10-08T19:21:25.609211+0000","last_became_peered":"2021-10-08T19:21:25.609211+0000","last_unstale":"2021-10-08T19:23:01.988487+0000","last_undegraded":"2021-10-08T19:23:01.988487+0000","last_fullsized":"2021-10-08T19:23:01.988487+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'11","last_scrub_stamp":"2021-10-08T19:23:01.988336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:01.988336+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0026768489999999998,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:49.531135+0000","last_change":"2021-10-08T19:22:49.530669+0000","last_active":"2021-10-08T19:22:49.531135+0000","last_peered":"2021-10-08T19:22:49.531135+0000","last_clean":"2021-10-08T19:22:49.531135+0000","last_became_active":"2021-10-08T19:21:29.639358+0000","last_became_peered":"2021-10-08T19:21:29.639358+0000","last_unstale":"2021-10-08T19:22:49.531135+0000","last_undegraded":"2021-10-08T19:22:49.531135+0000","last_fullsized":"2021-10-08T19:22:49.531135+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:49.530586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:49.530586+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0036198910000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"88'9","reported_seq":72,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:06.719843+0000","last_change":"2021-10-08T19:23:00.048324+0000","last_active":"2021-10-08T19:23:06.719843+0000","last_peered":"2021-10-08T19:23:06.719843+0000","last_clean":"2021-10-08T19:23:06.719843+0000","last_became_active":"2021-10-08T19:21:27.636432+0000","last_became_peered":"2021-10-08T19:21:27.636432+0000","last_unstale":"2021-10-08T19:23:06.719843+0000","last_undegraded":"2021-10-08T19:23:06.719843+0000","last_fullsized":"2021-10-08T19:23:06.719843+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'9","last_scrub_stamp":"2021-10-08T19:23:00.048245+0000","last_deep_scrub":"88'9","last_deep_scrub_stamp":"2021-10-08T19:23:00.048245+0000","last_clean_scrub_stamp":"2021-10-08T19:23:00.048245+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0031661179999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.438697+0000","last_change":"2021-10-08T19:22:27.212471+0000","last_active":"2021-10-08T19:22:48.438697+0000","last_peered":"2021-10-08T19:22:48.438697+0000","last_clean":"2021-10-08T19:22:48.438697+0000","last_became_active":"2021-10-08T19:21:23.603264+0000","last_became_peered":"2021-10-08T19:21:23.603264+0000","last_unstale":"2021-10-08T19:22:48.438697+0000","last_undegraded":"2021-10-08T19:22:48.438697+0000","last_fullsized":"2021-10-08T19:22:48.438697+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:27.212397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:27.212397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0013817009999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"69'15","reported_seq":65,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:56.214042+0000","last_change":"2021-10-08T19:22:56.213566+0000","last_active":"2021-10-08T19:22:56.214042+0000","last_peered":"2021-10-08T19:22:56.214042+0000","last_clean":"2021-10-08T19:22:56.214042+0000","last_became_active":"2021-10-08T19:21:25.617776+0000","last_became_peered":"2021-10-08T19:21:25.617776+0000","last_unstale":"2021-10-08T19:22:56.214042+0000","last_undegraded":"2021-10-08T19:22:56.214042+0000","last_fullsized":"2021-10-08T19:22:56.214042+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'15","last_scrub_stamp":"2021-10-08T19:22:56.213493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:56.213493+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039771219999999996,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.428709+0000","last_change":"2021-10-08T19:22:37.292691+0000","last_active":"2021-10-08T19:22:48.428709+0000","last_peered":"2021-10-08T19:22:48.428709+0000","last_clean":"2021-10-08T19:22:48.428709+0000","last_became_active":"2021-10-08T19:21:29.640249+0000","last_became_peered":"2021-10-08T19:21:29.640249+0000","last_unstale":"2021-10-08T19:22:48.428709+0000","last_undegraded":"2021-10-08T19:22:48.428709+0000","last_fullsized":"2021-10-08T19:22:48.428709+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:37.292621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:37.292621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001513517,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"69'8","reported_seq":68,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:06.719667+0000","last_change":"2021-10-08T19:23:00.384891+0000","last_active":"2021-10-08T19:23:06.719667+0000","last_peered":"2021-10-08T19:23:06.719667+0000","last_clean":"2021-10-08T19:23:06.719667+0000","last_became_active":"2021-10-08T19:21:27.637930+0000","last_became_peered":"2021-10-08T19:21:27.637930+0000","last_unstale":"2021-10-08T19:23:06.719667+0000","last_undegraded":"2021-10-08T19:23:06.719667+0000","last_fullsized":"2021-10-08T19:23:06.719667+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'8","last_scrub_stamp":"2021-10-08T19:23:00.384808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:00.384808+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040307110000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.438584+0000","last_change":"2021-10-08T19:22:29.177318+0000","last_active":"2021-10-08T19:22:48.438584+0000","last_peered":"2021-10-08T19:22:48.438584+0000","last_clean":"2021-10-08T19:22:48.438584+0000","last_became_active":"2021-10-08T19:21:23.603207+0000","last_became_peered":"2021-10-08T19:21:23.603207+0000","last_unstale":"2021-10-08T19:22:48.438584+0000","last_undegraded":"2021-10-08T19:22:48.438584+0000","last_fullsized":"2021-10-08T19:22:48.438584+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:29.177157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:29.177157+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020581419999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"69'10","reported_seq":55,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.428422+0000","last_change":"2021-10-08T19:22:35.356371+0000","last_active":"2021-10-08T19:22:48.428422+0000","last_peered":"2021-10-08T19:22:48.428422+0000","last_clean":"2021-10-08T19:22:48.428422+0000","last_became_active":"2021-10-08T19:21:25.613155+0000","last_became_peered":"2021-10-08T19:21:25.613155+0000","last_unstale":"2021-10-08T19:22:48.428422+0000","last_undegraded":"2021-10-08T19:22:48.428422+0000","last_fullsized":"2021-10-08T19:22:48.428422+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'10","last_scrub_stamp":"2021-10-08T19:22:35.356292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:35.356292+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040689319999999999,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:10.377130+0000","last_change":"2021-10-08T19:23:10.377105+0000","last_active":"2021-10-08T19:23:10.377130+0000","last_peered":"2021-10-08T19:23:10.377130+0000","last_clean":"2021-10-08T19:23:10.377130+0000","last_became_active":"2021-10-08T19:21:29.646455+0000","last_became_peered":"2021-10-08T19:21:29.646455+0000","last_unstale":"2021-10-08T19:23:10.377130+0000","last_undegraded":"2021-10-08T19:23:10.377130+0000","last_fullsized":"2021-10-08T19:23:10.377130+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:10.377024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:10.377024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0035706969999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.439117+0000","last_change":"2021-10-08T19:22:35.110008+0000","last_active":"2021-10-08T19:22:48.439117+0000","last_peered":"2021-10-08T19:22:48.439117+0000","last_clean":"2021-10-08T19:22:48.439117+0000","last_became_active":"2021-10-08T19:21:27.636429+0000","last_became_peered":"2021-10-08T19:21:27.636429+0000","last_unstale":"2021-10-08T19:22:48.439117+0000","last_undegraded":"2021-10-08T19:22:48.439117+0000","last_fullsized":"2021-10-08T19:22:48.439117+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:35.109928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:35.109928+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001854304,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"61'1","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:55.080583+0000","last_change":"2021-10-08T19:22:55.080106+0000","last_active":"2021-10-08T19:22:55.080583+0000","last_peered":"2021-10-08T19:22:55.080583+0000","last_clean":"2021-10-08T19:22:55.080583+0000","last_became_active":"2021-10-08T19:21:23.607064+0000","last_became_peered":"2021-10-08T19:21:23.607064+0000","last_unstale":"2021-10-08T19:22:55.080583+0000","last_undegraded":"2021-10-08T19:22:55.080583+0000","last_fullsized":"2021-10-08T19:22:55.080583+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'1","last_scrub_stamp":"2021-10-08T19:22:55.080028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:55.080028+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040037620000000001,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"69'17","reported_seq":68,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.428877+0000","last_change":"2021-10-08T19:22:47.109498+0000","last_active":"2021-10-08T19:22:48.428877+0000","last_peered":"2021-10-08T19:22:48.428877+0000","last_clean":"2021-10-08T19:22:48.428877+0000","last_became_active":"2021-10-08T19:21:25.609086+0000","last_became_peered":"2021-10-08T19:21:25.609086+0000","last_unstale":"2021-10-08T19:22:48.428877+0000","last_undegraded":"2021-10-08T19:22:48.428877+0000","last_fullsized":"2021-10-08T19:22:48.428877+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'17","last_scrub_stamp":"2021-10-08T19:22:47.109407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:47.109407+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0025026100000000002,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:03.272684+0000","last_change":"2021-10-08T19:23:03.272654+0000","last_active":"2021-10-08T19:23:03.272684+0000","last_peered":"2021-10-08T19:23:03.272684+0000","last_clean":"2021-10-08T19:23:03.272684+0000","last_became_active":"2021-10-08T19:21:29.648922+0000","last_became_peered":"2021-10-08T19:21:29.648922+0000","last_unstale":"2021-10-08T19:23:03.272684+0000","last_undegraded":"2021-10-08T19:23:03.272684+0000","last_fullsized":"2021-10-08T19:23:03.272684+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:03.272581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:03.272581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001525874,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:09.419605+0000","last_change":"2021-10-08T19:23:09.419579+0000","last_active":"2021-10-08T19:23:09.419605+0000","last_peered":"2021-10-08T19:23:09.419605+0000","last_clean":"2021-10-08T19:23:09.419605+0000","last_became_active":"2021-10-08T19:21:27.638583+0000","last_became_peered":"2021-10-08T19:21:27.638583+0000","last_unstale":"2021-10-08T19:23:09.419605+0000","last_undegraded":"2021-10-08T19:23:09.419605+0000","last_fullsized":"2021-10-08T19:23:09.419605+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:09.419493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:09.419493+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003406498,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:57.380499+0000","last_change":"2021-10-08T19:22:57.380012+0000","last_active":"2021-10-08T19:22:57.380499+0000","last_peered":"2021-10-08T19:22:57.380499+0000","last_clean":"2021-10-08T19:22:57.380499+0000","last_became_active":"2021-10-08T19:21:23.595919+0000","last_became_peered":"2021-10-08T19:21:23.595919+0000","last_unstale":"2021-10-08T19:22:57.380499+0000","last_undegraded":"2021-10-08T19:22:57.380499+0000","last_fullsized":"2021-10-08T19:22:57.380499+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:57.379935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:57.379935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034209349999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"69'19","reported_seq":71,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.439202+0000","last_change":"2021-10-08T19:22:39.356624+0000","last_active":"2021-10-08T19:22:48.439202+0000","last_peered":"2021-10-08T19:22:48.439202+0000","last_clean":"2021-10-08T19:22:48.439202+0000","last_became_active":"2021-10-08T19:21:25.741945+0000","last_became_peered":"2021-10-08T19:21:25.741945+0000","last_unstale":"2021-10-08T19:22:48.439202+0000","last_undegraded":"2021-10-08T19:22:48.439202+0000","last_fullsized":"2021-10-08T19:22:48.439202+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'19","last_scrub_stamp":"2021-10-08T19:22:39.356508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:39.356508+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0030817370000000002,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:57.645001+0000","last_change":"2021-10-08T19:22:57.644734+0000","last_active":"2021-10-08T19:22:57.645001+0000","last_peered":"2021-10-08T19:22:57.645001+0000","last_clean":"2021-10-08T19:22:57.645001+0000","last_became_active":"2021-10-08T19:21:29.643022+0000","last_became_peered":"2021-10-08T19:21:29.643022+0000","last_unstale":"2021-10-08T19:22:57.645001+0000","last_undegraded":"2021-10-08T19:22:57.645001+0000","last_fullsized":"2021-10-08T19:22:57.645001+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:57.644627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:57.644627+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002174952,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.428389+0000","last_change":"2021-10-08T19:22:42.359224+0000","last_active":"2021-10-08T19:22:48.428389+0000","last_peered":"2021-10-08T19:22:48.428389+0000","last_clean":"2021-10-08T19:22:48.428389+0000","last_became_active":"2021-10-08T19:21:27.635310+0000","last_became_peered":"2021-10-08T19:21:27.635310+0000","last_unstale":"2021-10-08T19:22:48.428389+0000","last_undegraded":"2021-10-08T19:22:48.428389+0000","last_fullsized":"2021-10-08T19:22:48.428389+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:42.359130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:42.359130+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001847357,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:11.176257+0000","last_change":"2021-10-08T19:23:11.176225+0000","last_active":"2021-10-08T19:23:11.176257+0000","last_peered":"2021-10-08T19:23:11.176257+0000","last_clean":"2021-10-08T19:23:11.176257+0000","last_became_active":"2021-10-08T19:21:23.607639+0000","last_became_peered":"2021-10-08T19:21:23.607639+0000","last_unstale":"2021-10-08T19:23:11.176257+0000","last_undegraded":"2021-10-08T19:23:11.176257+0000","last_fullsized":"2021-10-08T19:23:11.176257+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:11.176122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:11.176122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040114119999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"69'9","reported_seq":56,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.439701+0000","last_change":"2021-10-08T19:22:36.590210+0000","last_active":"2021-10-08T19:22:48.439701+0000","last_peered":"2021-10-08T19:22:48.439701+0000","last_clean":"2021-10-08T19:22:48.439701+0000","last_became_active":"2021-10-08T19:21:25.610072+0000","last_became_peered":"2021-10-08T19:21:25.610072+0000","last_unstale":"2021-10-08T19:22:48.439701+0000","last_undegraded":"2021-10-08T19:22:48.439701+0000","last_fullsized":"2021-10-08T19:22:48.439701+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'9","last_scrub_stamp":"2021-10-08T19:22:36.590071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:36.590071+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0026030699999999999,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:10.805171+0000","last_change":"2021-10-08T19:23:10.805144+0000","last_active":"2021-10-08T19:23:10.805171+0000","last_peered":"2021-10-08T19:23:10.805171+0000","last_clean":"2021-10-08T19:23:10.805171+0000","last_became_active":"2021-10-08T19:21:29.679264+0000","last_became_peered":"2021-10-08T19:21:29.679264+0000","last_unstale":"2021-10-08T19:23:10.805171+0000","last_undegraded":"2021-10-08T19:23:10.805171+0000","last_fullsized":"2021-10-08T19:23:10.805171+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:10.805052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:10.805052+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.00168849,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:48.428674+0000","last_change":"2021-10-08T19:22:34.484570+0000","last_active":"2021-10-08T19:22:48.428674+0000","last_peered":"2021-10-08T19:22:48.428674+0000","last_clean":"2021-10-08T19:22:48.428674+0000","last_became_active":"2021-10-08T19:21:23.600352+0000","last_became_peered":"2021-10-08T19:21:23.600352+0000","last_unstale":"2021-10-08T19:22:48.428674+0000","last_undegraded":"2021-10-08T19:22:48.428674+0000","last_fullsized":"2021-10-08T19:22:48.428674+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:34.484488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:34.484488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034565799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"87'22","reported_seq":72,"reported_epoch":87,"state":"active+clean","last_fresh":"2021-10-08T19:22:58.705870+0000","last_change":"2021-10-08T19:22:58.705708+0000","last_active":"2021-10-08T19:22:58.705870+0000","last_peered":"2021-10-08T19:22:58.705870+0000","last_clean":"2021-10-08T19:22:58.705870+0000","last_became_active":"2021-10-08T19:21:25.741675+0000","last_became_peered":"2021-10-08T19:21:25.741675+0000","last_unstale":"2021-10-08T19:22:58.705870+0000","last_undegraded":"2021-10-08T19:22:58.705870+0000","last_fullsized":"2021-10-08T19:22:58.705870+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'22","last_scrub_stamp":"2021-10-08T19:22:58.705632+0000","last_deep_scrub":"87'22","last_deep_scrub_stamp":"2021-10-08T19:22:58.705632+0000","last_clean_scrub_stamp":"2021-10-08T19:22:58.705632+0000","log_size":22,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0051832670000000001,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"69'8","reported_seq":68,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:06.719777+0000","last_change":"2021-10-08T19:22:51.066026+0000","last_active":"2021-10-08T19:23:06.719777+0000","last_peered":"2021-10-08T19:23:06.719777+0000","last_clean":"2021-10-08T19:23:06.719777+0000","last_became_active":"2021-10-08T19:21:27.637056+0000","last_became_peered":"2021-10-08T19:21:27.637056+0000","last_unstale":"2021-10-08T19:23:06.719777+0000","last_undegraded":"2021-10-08T19:23:06.719777+0000","last_fullsized":"2021-10-08T19:23:06.719777+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'8","last_scrub_stamp":"2021-10-08T19:22:51.065949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:51.065949+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020224639999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":65,"ondisk_log_size":65,"up":96,"acting":96,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":698,"num_read_kb":455,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":402,"ondisk_log_size":402,"up":96,"acting":96,"num_store_stats":8},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":103,"num_read_kb":98,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201306,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6896,"kb_used_data":1192,"kb_used_omap":0,"kb_used_meta":5696,"kb_avail":93738256,"statfs":{"total":95995035648,"available":95987974144,"internally_reserved":0,"allocated":1220608,"data_stored":878904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5832704},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:22:15 2021","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.66900000000000004}]},{"osd":1,"last update":"Fri Oct 8 19:22:15 2021","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.46700000000000003}]},{"osd":2,"last update":"Fri Oct 8 19:22:15 2021","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.435}]},{"osd":3,"last update":"Fri Oct 8 19:22:15 2021","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.54300000000000004}]},{"osd":4,"last update":"Fri Oct 8 19:22:15 2021","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.37},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.39200000000000002}]},{"osd":5,"last update":"Fri Oct 8 19:22:15 2021","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.49299999999999999}]},{"osd":6,"last update":"Fri Oct 8 19:22:15 2021","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.47699999999999998}]}]},{"osd":6,"up_from":47,"seq":201863462942,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6868,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":5696,"kb_avail":93738284,"statfs":{"total":95995035648,"available":95988002816,"internally_reserved":0,"allocated":1191936,"data_stored":877058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5832704},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:22:56 2021","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.45700000000000002,"15min":0.46400000000000002},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.59099999999999997,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.48699999999999999,"15min":0.49299999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.432}]},{"osd":1,"last update":"Fri Oct 8 19:22:56 2021","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.499,"15min":0.504},"min":{"1min":0.34699999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.69799999999999995,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.66900000000000004}]},{"osd":2,"last update":"Fri Oct 8 19:22:56 2021","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.51600000000000001,"15min":0.52000000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.48399999999999999,"15min":0.48899999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.66600000000000004,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.54200000000000004}]},{"osd":3,"last update":"Fri Oct 8 19:22:56 2021","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.48199999999999998,"15min":0.48799999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.64800000000000002,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.502,"5min":0.501,"15min":0.501},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.76200000000000001}]},{"osd":4,"last update":"Fri Oct 8 19:22:56 2021","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40999999999999998,"15min":0.41199999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.59099999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.433,"5min":0.44500000000000001,"15min":0.44700000000000001},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.56499999999999995,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.64200000000000002}]},{"osd":5,"last update":"Fri Oct 8 19:22:56 2021","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.63},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.46700000000000003,"15min":0.46899999999999997},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.67600000000000005,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.71199999999999997}]},{"osd":7,"last update":"Fri Oct 8 19:22:15 2021","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.65200000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574897,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":11328,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":10688,"kb_avail":93733824,"statfs":{"total":95995035648,"available":95983435776,"internally_reserved":0,"allocated":647168,"data_stored":288000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":10944512},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:22:30 2021","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.33400000000000002,"15min":0.32900000000000001},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.432,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.22700000000000001},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.36199999999999999,"15min":0.35999999999999999},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.53400000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.34899999999999998}]},{"osd":2,"last update":"Fri Oct 8 19:22:52 2021","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.38300000000000001,"15min":0.39400000000000002},"min":{"1min":0.25600000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.53900000000000003,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.42799999999999999,"15min":0.42399999999999999},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.317}]},{"osd":3,"last update":"Fri Oct 8 19:23:10 2021","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.438,"15min":0.46000000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.56399999999999995,"5min":0.748,"15min":0.748},"last":0.372},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.42799999999999999,"15min":0.45000000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.502,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.308}]},{"osd":4,"last update":"Fri Oct 8 19:22:22 2021","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.51300000000000001,"15min":0.51400000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53800000000000003,"15min":0.53900000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.45500000000000002}]},{"osd":5,"last update":"Fri Oct 8 19:22:42 2021","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.55200000000000005,"15min":0.56000000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73899999999999999,"5min":0.754,"15min":0.754},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55700000000000005,"15min":0.55800000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.48499999999999999}]},{"osd":6,"last update":"Fri Oct 8 19:23:00 2021","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53400000000000003,"15min":0.53700000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.64300000000000002,"15min":0.66300000000000003},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.77000000000000002,"5min":2.5219999999999998,"15min":2.5219999999999998},"last":0.49299999999999999}]},{"osd":7,"last update":"Fri Oct 8 19:22:20 2021","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.57299999999999995}]}]},{"osd":0,"up_from":8,"seq":34359738420,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7592,"kb_used_data":1184,"kb_used_omap":0,"kb_used_meta":6400,"kb_avail":93737560,"statfs":{"total":95995035648,"available":95987261440,"internally_reserved":0,"allocated":1212416,"data_stored":877463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6553600},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 8 19:22:32 2021","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":0.33000000000000002,"15min":0.32800000000000001},"min":{"1min":0.21199999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.45000000000000001,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.379,"15min":0.371},"min":{"1min":0.25,"5min":0.219,"15min":0.219},"max":{"1min":0.44900000000000001,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.45800000000000002}]},{"osd":2,"last update":"Fri Oct 8 19:22:53 2021","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.38900000000000001,"15min":0.39400000000000002},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.54900000000000004,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.38800000000000001,"15min":0.39600000000000002},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.51900000000000002,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.40200000000000002}]},{"osd":3,"last update":"Fri Oct 8 19:23:05 2021","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.45200000000000001,"15min":0.48299999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.56599999999999995,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.42799999999999999,"15min":0.45200000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.53500000000000003,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.439}]},{"osd":4,"last update":"Fri Oct 8 19:22:23 2021","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.54000000000000004,"15min":0.54300000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.77500000000000002,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.57099999999999995,"15min":0.57899999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.68300000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.73599999999999999}]},{"osd":5,"last update":"Fri Oct 8 19:22:40 2021","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.54700000000000004,"15min":0.55100000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72899999999999998,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.749,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.65200000000000002}]},{"osd":6,"last update":"Fri Oct 8 19:22:59 2021","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.58099999999999996,"15min":0.57899999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.61799999999999999}]},{"osd":7,"last update":"Fri Oct 8 19:22:15 2021","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.82099999999999995}]}]},{"osd":2,"up_from":18,"seq":77309411372,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6876,"kb_used_data":596,"kb_used_omap":0,"kb_used_meta":6272,"kb_avail":93738276,"statfs":{"total":95995035648,"available":95987994624,"internally_reserved":0,"allocated":610304,"data_stored":287366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6422528},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:22:46 2021","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.34200000000000003,"15min":0.34399999999999997},"min":{"1min":0.193,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.25800000000000001},{"interface":"front","average":{"1min":0.371,"5min":0.36599999999999999,"15min":0.35999999999999999},"min":{"1min":0.25800000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.26800000000000002}]},{"osd":1,"last update":"Fri Oct 8 19:22:46 2021","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.36099999999999999,"15min":0.36299999999999999},"min":{"1min":0.24399999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.53900000000000003,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.40699999999999997,"15min":0.39600000000000002},"min":{"1min":0.28000000000000003,"5min":0.218,"15min":0.218},"max":{"1min":2.2890000000000001,"5min":2.2890000000000001,"15min":2.2890000000000001},"last":0.307}]},{"osd":3,"last update":"Fri Oct 8 19:23:05 2021","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.41999999999999998,"15min":0.442},"min":{"1min":0.26800000000000002,"5min":0.218,"15min":0.218},"max":{"1min":0.50700000000000001,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.40300000000000002,"15min":0.41499999999999998},"min":{"1min":0.248,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.45600000000000002,"5min":0.625,"15min":0.625},"last":0.312}]},{"osd":4,"last update":"Fri Oct 8 19:22:20 2021","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.54500000000000004,"15min":0.55100000000000005},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.753,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.57299999999999995,"15min":0.57699999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.59999999999999998}]},{"osd":5,"last update":"Fri Oct 8 19:22:40 2021","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.56999999999999995,"15min":0.57599999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.61799999999999999}]},{"osd":6,"last update":"Fri Oct 8 19:23:05 2021","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.55800000000000005,"15min":0.56499999999999995},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.74099999999999999,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.57899999999999996,"15min":0.58699999999999997},"min":{"1min":0.41699999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.66300000000000003,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.66100000000000003}]},{"osd":7,"last update":"Fri Oct 8 19:22:20 2021","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.63900000000000001}]}]},{"osd":3,"up_from":24,"seq":103079215146,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6516,"kb_used_data":620,"kb_used_omap":0,"kb_used_meta":5888,"kb_avail":93738636,"statfs":{"total":95995035648,"available":95988363264,"internally_reserved":0,"allocated":634880,"data_stored":287488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6029312},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:23:07 2021","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.34899999999999998,"15min":0.35099999999999998},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.61399999999999999,"5min":1.002,"15min":1.002},"last":0.246},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.38200000000000001,"15min":0.39700000000000002},"min":{"1min":0.23000000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.36299999999999999}]},{"osd":1,"last update":"Fri Oct 8 19:23:07 2021","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.39000000000000001,"15min":0.40400000000000003},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.39100000000000001,"15min":0.40699999999999997},"min":{"1min":0.219,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.31}]},{"osd":2,"last update":"Fri Oct 8 19:23:07 2021","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.41599999999999998,"15min":0.433},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.42599999999999999,"15min":0.42799999999999999},"min":{"1min":0.27000000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.94199999999999995,"5min":1.026,"15min":1.026},"last":0.27800000000000002}]},{"osd":4,"last update":"Fri Oct 8 19:22:23 2021","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58499999999999996,"15min":0.58599999999999997},"min":{"1min":0.38300000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.0549999999999999,"5min":2.0590000000000002,"15min":2.0590000000000002},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.76000000000000001,"15min":0.79300000000000004},"min":{"1min":0.38400000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.78900000000000003,"5min":3.4670000000000001,"15min":3.4670000000000001},"last":0.47099999999999997}]},{"osd":5,"last update":"Fri Oct 8 19:22:41 2021","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.57799999999999996,"15min":0.58599999999999997},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.746,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.502},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.69499999999999995,"15min":0.71599999999999997},"min":{"1min":0.432,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.996,"5min":3.4020000000000001,"15min":3.4020000000000001},"last":0.41999999999999998}]},{"osd":6,"last update":"Fri Oct 8 19:23:02 2021","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":1.5189999999999999,"15min":1.681},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.72899999999999998,"5min":21.538,"15min":21.538},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.55400000000000005,"15min":0.56200000000000006},"min":{"1min":0.377,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.69999999999999996,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.44900000000000001}]},{"osd":7,"last update":"Fri Oct 8 19:22:16 2021","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.47999999999999998}]}]},{"osd":4,"up_from":30,"seq":128849018918,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6516,"kb_used_data":620,"kb_used_omap":0,"kb_used_meta":5888,"kb_avail":93738636,"statfs":{"total":95995035648,"available":95988363264,"internally_reserved":0,"allocated":634880,"data_stored":288400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6029312},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:22:22 2021","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.51900000000000002,"15min":0.52500000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.68500000000000005,"5min":0.755,"15min":0.755},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.505,"5min":0.52100000000000002,"15min":0.52400000000000002},"min":{"1min":0.33300000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.49299999999999999}]},{"osd":1,"last update":"Fri Oct 8 19:22:22 2021","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.51200000000000001,"15min":0.51800000000000002},"min":{"1min":0.316,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.60399999999999998,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.498,"15min":0.505},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.505}]},{"osd":2,"last update":"Fri Oct 8 19:22:22 2021","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.50800000000000001,"15min":0.51500000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.52900000000000003,"15min":0.53500000000000003},"min":{"1min":0.33600000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.628,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.52100000000000002}]},{"osd":3,"last update":"Fri Oct 8 19:22:22 2021","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.51200000000000001,"15min":0.51900000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.628,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.52200000000000002,"15min":0.52700000000000002},"min":{"1min":0.376,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.66400000000000003,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.41599999999999998}]},{"osd":5,"last update":"Fri Oct 8 19:22:43 2021","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.38700000000000001,"15min":0.378},"min":{"1min":0.30499999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.435,"5min":0.39400000000000002,"15min":0.38700000000000001},"min":{"1min":0.28899999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.60099999999999998}]},{"osd":6,"last update":"Fri Oct 8 19:23:00 2021","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.41199999999999998,"15min":0.40500000000000003},"min":{"1min":0.27900000000000003,"5min":0.252,"15min":0.252},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.42899999999999999,"15min":0.42299999999999999},"min":{"1min":0.30499999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.53700000000000003}]},{"osd":7,"last update":"Fri Oct 8 19:22:15 2021","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.57499999999999996}]}]},{"osd":5,"up_from":38,"seq":163208757280,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6296,"kb_used_data":592,"kb_used_omap":0,"kb_used_meta":5696,"kb_avail":93738856,"statfs":{"total":95995035648,"available":95988588544,"internally_reserved":0,"allocated":606208,"data_stored":287357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5832704},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:22:42 2021","interfaces":[{"interface":"back","average":{"1min":1.6399999999999999,"5min":0.70399999999999996,"15min":0.54800000000000004},"min":{"1min":0.27700000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":22.966999999999999,"5min":22.966999999999999,"15min":22.966999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.46300000000000002,"15min":0.46600000000000003},"min":{"1min":0.28499999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.68400000000000005,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.60499999999999998}]},{"osd":1,"last update":"Fri Oct 8 19:22:42 2021","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.48699999999999999,"15min":0.497},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.64900000000000002,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.499,"15min":0.50700000000000001},"min":{"1min":0.30399999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.69499999999999995,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.51100000000000001}]},{"osd":2,"last update":"Fri Oct 8 19:22:42 2021","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.45900000000000002,"15min":0.46300000000000002},"min":{"1min":0.29999999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.54900000000000004,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.53100000000000003},{"interface":"front","average":{"1min":1.629,"5min":0.72499999999999998,"15min":0.57499999999999996},"min":{"1min":0.30099999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":23.073,"5min":23.073,"15min":23.073},"last":0.55600000000000005}]},{"osd":3,"last update":"Fri Oct 8 19:22:42 2021","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.47999999999999998,"15min":0.48599999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.66800000000000004,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.439,"5min":0.48299999999999998,"15min":0.48999999999999999},"min":{"1min":0.36499999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.64900000000000002,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.54600000000000004}]},{"osd":4,"last update":"Fri Oct 8 19:22:42 2021","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.26300000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.58499999999999996,"5min":0.626,"15min":0.626},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.439,"15min":0.432},"min":{"1min":0.371,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.623,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.71899999999999997}]},{"osd":6,"last update":"Fri Oct 8 19:22:58 2021","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.35599999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.495,"15min":0.497},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.60899999999999999,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.754}]},{"osd":7,"last update":"Fri Oct 8 19:22:15 2021","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.628},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":0.64100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":2008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-10-08T19:23:16.464 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2021-10-08T19:23:16.465 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2021-10-08T19:23:16.465 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2021-10-08T19:23:16.465 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph health --format=json 2021-10-08T19:23:16.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:16 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:23:16.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:16 smithi097 ceph-mon[41966]: 172.21.15.97 - - [08/Oct/2021:19:23:15] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:23:16.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:16 smithi097 ceph-mon[41966]: poll took 35322.556 ms: 1 events 2021-10-08T19:23:16.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:16 smithi097 ceph-mon[41966]: from='client.24706 v1:172.21.15.97:0/1195566773' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:23:16.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:16 smithi097 ceph-mon[41966]: 4.18 deep-scrub ok 2021-10-08T19:23:16.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:16 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:23:16.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:16 smithi097 ceph-mon[32687]: 172.21.15.97 - - [08/Oct/2021:19:23:15] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:23:16.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:16 smithi097 ceph-mon[32687]: poll took 35322.556 ms: 1 events 2021-10-08T19:23:16.724 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:16 smithi097 ceph-mon[32687]: from='client.24706 v1:172.21.15.97:0/1195566773' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:23:16.724 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:16 smithi097 ceph-mon[32687]: 4.18 deep-scrub ok 2021-10-08T19:23:16.725 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:16 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:23:16.726 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:16 smithi117 ceph-mon[34585]: 172.21.15.97 - - [08/Oct/2021:19:23:15] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:23:16.726 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:16 smithi117 ceph-mon[34585]: poll took 35322.556 ms: 1 events 2021-10-08T19:23:16.727 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:16 smithi117 ceph-mon[34585]: from='client.24706 v1:172.21.15.97:0/1195566773' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:23:16.727 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:16 smithi117 ceph-mon[34585]: 4.18 deep-scrub ok 2021-10-08T19:23:16.728 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:16 smithi117 conmon[67121]: t=2021-10-08T19:23:16+0000 lvl=info msg="Starting Grafana" logger=server version=6.7.4 commit=8e44bbc5f5 branch=HEAD compiled=2020-05-26T17:35:38+0000 2021-10-08T19:23:16.728 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:16 smithi117 conmon[67121]: t=2021-10-08T19:23:16+0000 lvl=info msg="Config loaded from" logger=settings file=/usr/share/grafana/conf/defaults.ini 2021-10-08T19:23:16.729 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:16 smithi117 conmon[67121]: t=2021-10-08T19:23:16+0000 lvl=info msg="Config loaded from" logger=settings file=/etc/grafana/grafana.ini 2021-10-08T19:23:16.729 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:16 smithi117 conmon[67121]: t=2021-10-08T19:23:16+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_DATA=/var/lib/grafana" 2021-10-08T19:23:16.729 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:16 smithi117 conmon[67121]: t=2021-10-08T19:23:16+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_LOGS=/var/log/grafana" 2021-10-08T19:23:16.730 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:16 smithi117 conmon[67121]: t=2021-10-08T19:23:16+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2021-10-08T19:23:16.730 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:16 smithi117 conmon[67121]: t=2021-10-08T19:23:16+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2021-10-08T19:23:16.731 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:16 smithi117 conmon[67121]: t=2021-10-08T19:23:16+0000 lvl=info msg="Path Home" logger=settings path=/usr/share/grafana 2021-10-08T19:23:16.731 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:16 smithi117 conmon[67121]: t=2021-10-08T19:23:16+0000 lvl=info msg="Path Data" logger=settings path=/var/lib/grafana 2021-10-08T19:23:16.732 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:16 smithi117 conmon[67121]: t=2021-10-08T19:23:16+0000 lvl=info msg="Path Logs" logger=settings path=/var/log/grafana 2021-10-08T19:23:16.732 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:16 smithi117 conmon[67121]: t=2021-10-08T19:23:16+0000 lvl=info msg="Path Plugins" logger=settings path=/var/lib/grafana/plugins 2021-10-08T19:23:16.733 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:16 smithi117 conmon[67121]: t=2021-10-08T19:23:16+0000 lvl=info msg="Path Provisioning" logger=settings path=/etc/grafana/provisioning 2021-10-08T19:23:16.733 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:16 smithi117 conmon[67121]: t=2021-10-08T19:23:16+0000 lvl=info msg="App mode production" logger=settings 2021-10-08T19:23:16.733 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:16 smithi117 conmon[67121]: t=2021-10-08T19:23:16+0000 lvl=info msg="Initializing SqlStore" logger=server 2021-10-08T19:23:16.734 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:16 smithi117 conmon[67121]: t=2021-10-08T19:23:16+0000 lvl=info msg="Connecting to DB" logger=sqlstore dbtype=sqlite3 2021-10-08T19:23:16.734 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:16 smithi117 conmon[67121]: t=2021-10-08T19:23:16+0000 lvl=info msg="Starting DB migration" logger=migrator 2021-10-08T19:23:16.735 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:16 smithi117 conmon[67121]: t=2021-10-08T19:23:16+0000 lvl=info msg="Executing migration" logger=migrator id="create migration_log table" 2021-10-08T19:23:16.735 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:16 smithi117 bash[66931]: 9d5fc99ba23fd0d98d9810cdccbc5835c569b656c8d7552b2f9556796a62f57e 2021-10-08T19:23:16.736 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:16 smithi117 systemd[1]: Started Ceph grafana.a for 1d01f6d6-286c-11ec-8c25-001a4aab830c. 2021-10-08T19:23:16.742 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:23:17.020 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:16 smithi117 conmon[67121]: t=2021-10-08T19:23:16+0000 lvl=info msg="Executing migration" logger=migrator id="create user table" 2021-10-08T19:23:17.020 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:16 smithi117 conmon[67121]: t=2021-10-08T19:23:16+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.login" 2021-10-08T19:23:17.021 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:16 smithi117 conmon[67121]: t=2021-10-08T19:23:16+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.email" 2021-10-08T19:23:17.021 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:16 smithi117 conmon[67121]: t=2021-10-08T19:23:16+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_login - v1" 2021-10-08T19:23:17.021 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:16 smithi117 conmon[67121]: t=2021-10-08T19:23:16+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_email - v1" 2021-10-08T19:23:17.021 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:17 smithi117 conmon[67121]: t=2021-10-08T19:23:17+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table user to user_v1 - v1" 2021-10-08T19:23:17.305 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:17 smithi117 conmon[67121]: t=2021-10-08T19:23:17+0000 lvl=info msg="Executing migration" logger=migrator id="create user table v2" 2021-10-08T19:23:17.306 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:17 smithi117 conmon[67121]: t=2021-10-08T19:23:17+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_login - v2" 2021-10-08T19:23:17.306 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:17 smithi117 conmon[67121]: t=2021-10-08T19:23:17+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_email - v2" 2021-10-08T19:23:17.306 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:17 smithi117 conmon[67121]: t=2021-10-08T19:23:17+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2021-10-08T19:23:17.306 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:17 smithi117 conmon[67121]: t=2021-10-08T19:23:17+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table user_v1" 2021-10-08T19:23:17.307 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:17 smithi117 conmon[67121]: t=2021-10-08T19:23:17+0000 lvl=info msg="Executing migration" logger=migrator id="Add column help_flags1 to user table" 2021-10-08T19:23:17.607 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:17 smithi117 conmon[67121]: t=2021-10-08T19:23:17+0000 lvl=info msg="Executing migration" logger=migrator id="Update user table charset" 2021-10-08T19:23:17.607 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:17 smithi117 conmon[67121]: t=2021-10-08T19:23:17+0000 lvl=info msg="Executing migration" logger=migrator id="Add last_seen_at column to user" 2021-10-08T19:23:17.607 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:17 smithi117 conmon[67121]: t=2021-10-08T19:23:17+0000 lvl=info msg="Executing migration" logger=migrator id="Add missing user data" 2021-10-08T19:23:17.608 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:17 smithi117 conmon[67121]: t=2021-10-08T19:23:17+0000 lvl=info msg="Executing migration" logger=migrator id="Add is_disabled column to user" 2021-10-08T19:23:17.608 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:17 smithi117 conmon[67121]: t=2021-10-08T19:23:17+0000 lvl=info msg="Executing migration" logger=migrator id="create temp user table v1-7" 2021-10-08T19:23:17.608 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:17 smithi117 conmon[67121]: t=2021-10-08T19:23:17+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_email - v1-7" 2021-10-08T19:23:17.863 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:17 smithi117 conmon[67121]: t=2021-10-08T19:23:17+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_org_id - v1-7" 2021-10-08T19:23:17.863 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:17 smithi117 conmon[67121]: t=2021-10-08T19:23:17+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_code - v1-7" 2021-10-08T19:23:17.864 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:17 smithi117 conmon[67121]: t=2021-10-08T19:23:17+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_status - v1-7" 2021-10-08T19:23:17.864 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:17 smithi117 conmon[67121]: t=2021-10-08T19:23:17+0000 lvl=info msg="Executing migration" logger=migrator id="Update temp_user table charset" 2021-10-08T19:23:17.864 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:17 smithi117 conmon[67121]: t=2021-10-08T19:23:17+0000 lvl=info msg="Executing migration" logger=migrator id="create star table" 2021-10-08T19:23:17.865 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:17 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:23:17.865 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:17 smithi117 ceph-mon[34585]: pgmap v65: 132 pgs: 132 active+clean; 582 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:23:17.865 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:17 smithi117 ceph-mon[34585]: poll took 1040.483 ms: 1 events 2021-10-08T19:23:17.865 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:17 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:23:17.866 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:17 smithi117 ceph-mon[34585]: Sending message to agent on host smithi117 2021-10-08T19:23:17.866 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:17 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:17.866 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:17 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:17.866 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:17 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:17.867 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:17 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:23:17.867 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:17 smithi117 ceph-mon[34585]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:23:17.867 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:17 smithi117 ceph-mon[34585]: Reconfiguring alertmanager.a (dependencies changed)... 2021-10-08T19:23:17.867 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:17 smithi117 ceph-mon[34585]: Reconfiguring daemon alertmanager.a on smithi097 2021-10-08T19:23:17.868 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:17 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:23:18.118 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:17 smithi117 conmon[67121]: t=2021-10-08T19:23:17+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index star.user_id_dashboard_id" 2021-10-08T19:23:18.118 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:17 smithi117 conmon[67121]: t=2021-10-08T19:23:17+0000 lvl=info msg="Executing migration" logger=migrator id="create org table v1" 2021-10-08T19:23:18.119 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:18 smithi117 conmon[67121]: t=2021-10-08T19:23:18+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_name - v1" 2021-10-08T19:23:18.119 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:18 smithi117 conmon[67121]: t=2021-10-08T19:23:18+0000 lvl=info msg="Executing migration" logger=migrator id="create org_user table v1" 2021-10-08T19:23:18.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:17 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:23:18.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:17 smithi097 ceph-mon[41966]: pgmap v65: 132 pgs: 132 active+clean; 582 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:23:18.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:17 smithi097 ceph-mon[41966]: poll took 1040.483 ms: 1 events 2021-10-08T19:23:18.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:17 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:23:18.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:17 smithi097 ceph-mon[41966]: Sending message to agent on host smithi117 2021-10-08T19:23:18.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:17 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:18.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:17 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:18.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:17 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:18.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:17 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:23:18.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:17 smithi097 ceph-mon[41966]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:23:18.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:17 smithi097 ceph-mon[41966]: Reconfiguring alertmanager.a (dependencies changed)... 2021-10-08T19:23:18.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:17 smithi097 ceph-mon[41966]: Reconfiguring daemon alertmanager.a on smithi097 2021-10-08T19:23:18.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:17 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:23:18.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:17 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:23:18.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:17 smithi097 ceph-mon[32687]: pgmap v65: 132 pgs: 132 active+clean; 582 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:23:18.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:17 smithi097 ceph-mon[32687]: poll took 1040.483 ms: 1 events 2021-10-08T19:23:18.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:17 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:23:18.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:17 smithi097 ceph-mon[32687]: Sending message to agent on host smithi117 2021-10-08T19:23:18.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:17 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:18.225 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:17 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:18.225 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:17 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:18.225 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:17 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:23:18.225 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:17 smithi097 ceph-mon[32687]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:23:18.226 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:17 smithi097 ceph-mon[32687]: Reconfiguring alertmanager.a (dependencies changed)... 2021-10-08T19:23:18.226 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:17 smithi097 ceph-mon[32687]: Reconfiguring daemon alertmanager.a on smithi097 2021-10-08T19:23:18.226 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:17 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:23:18.750 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:18 smithi117 conmon[67121]: t=2021-10-08T19:23:18+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_org_user_org_id - v1" 2021-10-08T19:23:18.751 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:18 smithi117 conmon[67121]: t=2021-10-08T19:23:18+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_user_org_id_user_id - v1" 2021-10-08T19:23:18.939 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:18 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:23:18.939 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:18 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:23:18.939 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:18 smithi097 ceph-mon[41966]: 6.c deep-scrub ok 2021-10-08T19:23:18.940 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:18 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:23:18.940 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:18 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:23:18.940 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:18 smithi097 ceph-mon[41966]: Received "ACK" from agent on host smithi117 2021-10-08T19:23:18.940 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:18 smithi097 ceph-mon[41966]: 5.f scrub ok 2021-10-08T19:23:18.940 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:18 smithi097 ceph-mon[41966]: osdmap e89: 8 total, 8 up, 8 in 2021-10-08T19:23:18.941 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:18 smithi097 ceph-mon[41966]: 4.1b scrub ok 2021-10-08T19:23:18.941 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:18 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:23:18.941 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:18 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:23:18.942 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:18 smithi097 ceph-mon[32687]: 6.c deep-scrub ok 2021-10-08T19:23:18.942 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:18 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:23:18.942 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:18 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:23:18.942 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:18 smithi097 ceph-mon[32687]: Received "ACK" from agent on host smithi117 2021-10-08T19:23:18.942 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:18 smithi097 ceph-mon[32687]: 5.f scrub ok 2021-10-08T19:23:18.943 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:18 smithi097 ceph-mon[32687]: osdmap e89: 8 total, 8 up, 8 in 2021-10-08T19:23:18.943 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:18 smithi097 ceph-mon[32687]: 4.1b scrub ok 2021-10-08T19:23:19.006 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:18 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:23:19.006 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:18 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:23:19.006 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:18 smithi117 ceph-mon[34585]: 6.c deep-scrub ok 2021-10-08T19:23:19.007 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:18 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:23:19.007 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:18 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:23:19.007 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:18 smithi117 ceph-mon[34585]: Received "ACK" from agent on host smithi117 2021-10-08T19:23:19.007 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:18 smithi117 ceph-mon[34585]: 5.f scrub ok 2021-10-08T19:23:19.007 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:18 smithi117 ceph-mon[34585]: osdmap e89: 8 total, 8 up, 8 in 2021-10-08T19:23:19.008 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:18 smithi117 ceph-mon[34585]: 4.1b scrub ok 2021-10-08T19:23:19.008 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:18 smithi117 conmon[67121]: t=2021-10-08T19:23:18+0000 lvl=info msg="Executing migration" logger=migrator id="Update org table charset" 2021-10-08T19:23:19.008 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:18 smithi117 conmon[67121]: t=2021-10-08T19:23:18+0000 lvl=info msg="Executing migration" logger=migrator id="Update org_user table charset" 2021-10-08T19:23:19.009 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:18 smithi117 conmon[67121]: t=2021-10-08T19:23:18+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate all Read Only Viewers to Viewers" 2021-10-08T19:23:19.009 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:18 smithi117 conmon[67121]: t=2021-10-08T19:23:18+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard table" 2021-10-08T19:23:19.009 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:19 smithi117 conmon[67121]: t=2021-10-08T19:23:19+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard.account_id" 2021-10-08T19:23:19.078 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:23:19.079 INFO:teuthology.orchestra.run.smithi097.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2021-10-08T19:23:19.257 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:19 smithi117 conmon[67121]: t=2021-10-08T19:23:19+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_account_id_slug" 2021-10-08T19:23:19.258 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:19 smithi117 conmon[67121]: t=2021-10-08T19:23:19+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_tag table" 2021-10-08T19:23:19.258 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:19 smithi117 conmon[67121]: t=2021-10-08T19:23:19+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_tag.dasboard_id_term" 2021-10-08T19:23:19.258 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:19 smithi117 conmon[67121]: t=2021-10-08T19:23:19+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_dashboard_tag_dashboard_id_term - v1" 2021-10-08T19:23:19.258 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:19 smithi117 conmon[67121]: t=2021-10-08T19:23:19+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard to dashboard_v1 - v1" 2021-10-08T19:23:19.258 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:19 smithi117 conmon[67121]: t=2021-10-08T19:23:19+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard v2" 2021-10-08T19:23:19.259 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:19 smithi117 conmon[67121]: t=2021-10-08T19:23:19+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_org_id - v2" 2021-10-08T19:23:19.519 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:19 smithi117 conmon[67121]: t=2021-10-08T19:23:19+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_org_id_slug - v2" 2021-10-08T19:23:19.519 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:19 smithi117 conmon[67121]: t=2021-10-08T19:23:19+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard v1 to v2" 2021-10-08T19:23:19.519 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:19 smithi117 conmon[67121]: t=2021-10-08T19:23:19+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_v1" 2021-10-08T19:23:19.519 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:19 smithi117 conmon[67121]: t=2021-10-08T19:23:19+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard.data to mediumtext v1" 2021-10-08T19:23:19.805 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:19 smithi117 ceph-mon[34585]: pgmap v67: 132 pgs: 132 active+clean; 582 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:23:19.805 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:19 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3892982627' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-10-08T19:23:19.806 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:19 smithi117 conmon[67121]: t=2021-10-08T19:23:19+0000 lvl=info msg="Executing migration" logger=migrator id="Add column updated_by in dashboard - v2" 2021-10-08T19:23:19.806 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:19 smithi117 conmon[67121]: t=2021-10-08T19:23:19+0000 lvl=info msg="Executing migration" logger=migrator id="Add column created_by in dashboard - v2" 2021-10-08T19:23:19.806 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:19 smithi117 conmon[67121]: t=2021-10-08T19:23:19+0000 lvl=info msg="Executing migration" logger=migrator id="Add column gnetId in dashboard" 2021-10-08T19:23:19.936 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2021-10-08T19:23:19.936 INFO:tasks.cephadm:Setup complete, yielding 2021-10-08T19:23:19.936 INFO:teuthology.run_tasks:Running task thrashosds... 2021-10-08T19:23:19.949 INFO:tasks.thrashosds:config is {'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2021-10-08T19:23:19.950 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'master'}, 'ceph': {'conf': {'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'ms bind msgr2': False, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10}, 'osd': {'debug ms': 1, 'debug osd': 20, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd max backfills': 3, 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2}}, 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'but it is still running', 'objects unfound and apparently lost'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'mon_bind_msgr2': False, 'sha1': '103b6cc3554193fcd0852d9c647cef19e99920cf'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'cephadm': {'cephadm_mode': 'root'}, 'install': {'ceph': {'sha1': '103b6cc3554193fcd0852d9c647cef19e99920cf'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'workunit': {'branch': 'qa-nvme-loop', 'sha1': '6d1d7181c8e91145ded12e11fc2a9c8ce31671f6'}} 2021-10-08T19:23:19.951 INFO:tasks.thrashosds:config is {'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2021-10-08T19:23:19.951 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2021-10-08T19:23:20.062 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:19 smithi117 conmon[67121]: t=2021-10-08T19:23:19+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for gnetId in dashboard" 2021-10-08T19:23:20.062 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:19 smithi117 conmon[67121]: t=2021-10-08T19:23:19+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_id in dashboard" 2021-10-08T19:23:20.062 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:19 smithi117 conmon[67121]: t=2021-10-08T19:23:19+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for plugin_id in dashboard" 2021-10-08T19:23:20.063 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:19 smithi117 conmon[67121]: t=2021-10-08T19:23:19+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for dashboard_id in dashboard_tag" 2021-10-08T19:23:20.063 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:20 smithi117 conmon[67121]: t=2021-10-08T19:23:20+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard table charset" 2021-10-08T19:23:20.063 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:20 smithi117 conmon[67121]: t=2021-10-08T19:23:20+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_tag table charset" 2021-10-08T19:23:20.185 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:19 smithi097 ceph-mon[41966]: pgmap v67: 132 pgs: 132 active+clean; 582 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:23:20.186 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:19 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3892982627' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-10-08T19:23:20.186 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:19 smithi097 ceph-mon[32687]: pgmap v67: 132 pgs: 132 active+clean; 582 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:23:20.187 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:19 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3892982627' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-10-08T19:23:20.237 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:23:20.372 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:20 smithi117 conmon[67121]: t=2021-10-08T19:23:20+0000 lvl=info msg="Executing migration" logger=migrator id="Add column folder_id in dashboard" 2021-10-08T19:23:20.372 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:20 smithi117 conmon[67121]: t=2021-10-08T19:23:20+0000 lvl=info msg="Executing migration" logger=migrator id="Add column isFolder in dashboard" 2021-10-08T19:23:20.372 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:20 smithi117 conmon[67121]: t=2021-10-08T19:23:20+0000 lvl=info msg="Executing migration" logger=migrator id="Add column has_acl in dashboard" 2021-10-08T19:23:20.373 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:20 smithi117 conmon[67121]: t=2021-10-08T19:23:20+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in dashboard" 2021-10-08T19:23:20.373 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:20 smithi117 conmon[67121]: t=2021-10-08T19:23:20+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in dashboard" 2021-10-08T19:23:20.373 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:20 smithi117 conmon[67121]: t=2021-10-08T19:23:20+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index dashboard_org_id_uid" 2021-10-08T19:23:20.373 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:20 smithi117 conmon[67121]: t=2021-10-08T19:23:20+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_slug" 2021-10-08T19:23:20.470 INFO:journalctl@ceph.alertmanager.a.smithi097.stdout:Oct 08 19:23:20 smithi097 systemd[1]: Stopping Ceph alertmanager.a for 1d01f6d6-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:23:20.470 INFO:journalctl@ceph.alertmanager.a.smithi097.stdout:Oct 08 19:23:20 smithi097 bash[84588]: Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-alertmanager.a found: no such container 2021-10-08T19:23:20.470 INFO:journalctl@ceph.alertmanager.a.smithi097.stdout:Oct 08 19:23:20 smithi097 conmon[76566]: level=info ts=2021-10-08T19:23:20.358Z caller=main.go:536 msg="Received SIGTERM, exiting gracefully..." 2021-10-08T19:23:20.623 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:20 smithi117 conmon[67121]: t=2021-10-08T19:23:20+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard title length" 2021-10-08T19:23:20.624 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:20 smithi117 conmon[67121]: t=2021-10-08T19:23:20+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index for dashboard_org_id_title_folder_id" 2021-10-08T19:23:20.624 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:20 smithi117 conmon[67121]: t=2021-10-08T19:23:20+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning" 2021-10-08T19:23:20.624 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:20 smithi117 conmon[67121]: t=2021-10-08T19:23:20+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" 2021-10-08T19:23:20.624 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:20 smithi117 conmon[67121]: t=2021-10-08T19:23:20+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning v2" 2021-10-08T19:23:20.875 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:20 smithi117 conmon[67121]: t=2021-10-08T19:23:20+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id - v2" 2021-10-08T19:23:20.875 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:20 smithi117 conmon[67121]: t=2021-10-08T19:23:20+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" 2021-10-08T19:23:20.876 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:20 smithi117 conmon[67121]: t=2021-10-08T19:23:20+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard_provisioning v1 to v2" 2021-10-08T19:23:20.876 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:20 smithi117 conmon[67121]: t=2021-10-08T19:23:20+0000 lvl=info msg="Executing migration" logger=migrator id="drop dashboard_provisioning_tmp_qwerty" 2021-10-08T19:23:20.877 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:20 smithi117 ceph-mon[34585]: 2.18 scrub ok 2021-10-08T19:23:20.877 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:20 smithi117 ceph-mon[34585]: 4.1a scrub ok 2021-10-08T19:23:20.952 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:20 smithi097 ceph-mon[41966]: 2.18 scrub ok 2021-10-08T19:23:20.952 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:20 smithi097 ceph-mon[41966]: 4.1a scrub ok 2021-10-08T19:23:20.953 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:20 smithi097 ceph-mon[32687]: 2.18 scrub ok 2021-10-08T19:23:20.953 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:20 smithi097 ceph-mon[32687]: 4.1a scrub ok 2021-10-08T19:23:20.953 INFO:journalctl@ceph.alertmanager.a.smithi097.stdout:Oct 08 19:23:20 smithi097 bash[84588]: 5098b7584b5703fb18cff65e8794d38614e327db9d98c2ae8f6997f418ec0f74 2021-10-08T19:23:20.954 INFO:journalctl@ceph.alertmanager.a.smithi097.stdout:Oct 08 19:23:20 smithi097 bash[84588]: Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-alertmanager.a found: no such container 2021-10-08T19:23:21.143 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:20 smithi117 conmon[67121]: t=2021-10-08T19:23:20+0000 lvl=info msg="Executing migration" logger=migrator id="Add check_sum column" 2021-10-08T19:23:21.143 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:20 smithi117 conmon[67121]: t=2021-10-08T19:23:20+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table" 2021-10-08T19:23:21.143 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:21 smithi117 conmon[67121]: t=2021-10-08T19:23:21+0000 lvl=info msg="Executing migration" logger=migrator id="add index data_source.account_id" 2021-10-08T19:23:21.144 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:21 smithi117 conmon[67121]: t=2021-10-08T19:23:21+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index data_source.account_id_name" 2021-10-08T19:23:21.144 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:21 smithi117 conmon[67121]: t=2021-10-08T19:23:21+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_data_source_account_id - v1" 2021-10-08T19:23:21.403 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:21 smithi117 conmon[67121]: t=2021-10-08T19:23:21+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_data_source_account_id_name - v1" 2021-10-08T19:23:21.403 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:21 smithi117 conmon[67121]: t=2021-10-08T19:23:21+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table data_source to data_source_v1 - v1" 2021-10-08T19:23:21.403 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:21 smithi117 conmon[67121]: t=2021-10-08T19:23:21+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table v2" 2021-10-08T19:23:21.404 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:21 smithi117 conmon[67121]: t=2021-10-08T19:23:21+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_data_source_org_id - v2" 2021-10-08T19:23:21.404 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:21 smithi117 conmon[67121]: t=2021-10-08T19:23:21+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_data_source_org_id_name - v2" 2021-10-08T19:23:21.655 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:21 smithi117 conmon[67121]: t=2021-10-08T19:23:21+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2021-10-08T19:23:21.656 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:21 smithi117 conmon[67121]: t=2021-10-08T19:23:21+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table data_source_v1 #2" 2021-10-08T19:23:21.656 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:21 smithi117 conmon[67121]: t=2021-10-08T19:23:21+0000 lvl=info msg="Executing migration" logger=migrator id="Add column with_credentials" 2021-10-08T19:23:21.656 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:21 smithi117 conmon[67121]: t=2021-10-08T19:23:21+0000 lvl=info msg="Executing migration" logger=migrator id="Add secure json data column" 2021-10-08T19:23:21.758 INFO:journalctl@ceph.alertmanager.a.smithi097.stdout:Oct 08 19:23:21 smithi097 systemd[1]: Stopped Ceph alertmanager.a for 1d01f6d6-286c-11ec-8c25-001a4aab830c. 2021-10-08T19:23:21.758 INFO:journalctl@ceph.alertmanager.a.smithi097.stdout:Oct 08 19:23:21 smithi097 systemd[1]: Starting Ceph alertmanager.a for 1d01f6d6-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:23:21.953 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:21 smithi117 ceph-mon[34585]: 4.0 scrub ok 2021-10-08T19:23:21.953 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:21 smithi117 ceph-mon[34585]: pgmap v68: 132 pgs: 132 active+clean; 582 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:23:21.954 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:21 smithi117 conmon[67121]: t=2021-10-08T19:23:21+0000 lvl=info msg="Executing migration" logger=migrator id="Update data_source table charset" 2021-10-08T19:23:21.954 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:21 smithi117 conmon[67121]: t=2021-10-08T19:23:21+0000 lvl=info msg="Executing migration" logger=migrator id="Update initial version to 1" 2021-10-08T19:23:21.955 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:21 smithi117 conmon[67121]: t=2021-10-08T19:23:21+0000 lvl=info msg="Executing migration" logger=migrator id="Add read_only data column" 2021-10-08T19:23:21.955 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:21 smithi117 conmon[67121]: t=2021-10-08T19:23:21+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate logging ds to loki ds" 2021-10-08T19:23:21.955 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:21 smithi117 conmon[67121]: t=2021-10-08T19:23:21+0000 lvl=info msg="Executing migration" logger=migrator id="Update json_data with nulls" 2021-10-08T19:23:21.955 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:21 smithi117 conmon[67121]: t=2021-10-08T19:23:21+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table" 2021-10-08T19:23:21.955 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:21 smithi117 conmon[67121]: t=2021-10-08T19:23:21+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id" 2021-10-08T19:23:22.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:21 smithi097 ceph-mon[32687]: 4.0 scrub ok 2021-10-08T19:23:22.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:21 smithi097 ceph-mon[32687]: pgmap v68: 132 pgs: 132 active+clean; 582 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:23:22.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:21 smithi097 ceph-mon[41966]: 4.0 scrub ok 2021-10-08T19:23:22.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:21 smithi097 ceph-mon[41966]: pgmap v68: 132 pgs: 132 active+clean; 582 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:23:22.222 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:22 smithi117 conmon[67121]: t=2021-10-08T19:23:22+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.key" 2021-10-08T19:23:22.223 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:22 smithi117 conmon[67121]: t=2021-10-08T19:23:22+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id_name" 2021-10-08T19:23:22.223 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:22 smithi117 conmon[67121]: t=2021-10-08T19:23:22+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_api_key_account_id - v1" 2021-10-08T19:23:22.223 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:22 smithi117 conmon[67121]: t=2021-10-08T19:23:22+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_key - v1" 2021-10-08T19:23:22.489 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:22 smithi117 conmon[67121]: t=2021-10-08T19:23:22+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_account_id_name - v1" 2021-10-08T19:23:22.490 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:22 smithi117 conmon[67121]: t=2021-10-08T19:23:22+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table api_key to api_key_v1 - v1" 2021-10-08T19:23:22.490 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:22 smithi117 conmon[67121]: t=2021-10-08T19:23:22+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table v2" 2021-10-08T19:23:22.490 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:22 smithi117 conmon[67121]: t=2021-10-08T19:23:22+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_api_key_org_id - v2" 2021-10-08T19:23:22.491 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:22 smithi117 conmon[67121]: t=2021-10-08T19:23:22+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_key - v2" 2021-10-08T19:23:22.752 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:22 smithi117 conmon[67121]: t=2021-10-08T19:23:22+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_org_id_name - v2" 2021-10-08T19:23:22.752 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:22 smithi117 conmon[67121]: t=2021-10-08T19:23:22+0000 lvl=info msg="Executing migration" logger=migrator id="copy api_key v1 to v2" 2021-10-08T19:23:22.752 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:22 smithi117 conmon[67121]: t=2021-10-08T19:23:22+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table api_key_v1" 2021-10-08T19:23:22.752 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:22 smithi117 conmon[67121]: t=2021-10-08T19:23:22+0000 lvl=info msg="Executing migration" logger=migrator id="Update api_key table charset" 2021-10-08T19:23:22.754 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:22 smithi117 conmon[67121]: t=2021-10-08T19:23:22+0000 lvl=info msg="Executing migration" logger=migrator id="Add expires to api_key table" 2021-10-08T19:23:22.956 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:23:22 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:23:22] "GET /metrics HTTP/1.1" 200 153763 "" "Prometheus/2.18.1" 2021-10-08T19:23:22.956 INFO:journalctl@ceph.alertmanager.a.smithi097.stdout:Oct 08 19:23:22 smithi097 conmon[85195]: level=info ts=2021-10-08T19:23:22.694Z caller=main.go:231 msg="Starting Alertmanager" version="(version=0.20.0, branch=HEAD, revision=f74be0400a6243d10bb53812d6fa408ad71ff32d)" 2021-10-08T19:23:22.956 INFO:journalctl@ceph.alertmanager.a.smithi097.stdout:Oct 08 19:23:22 smithi097 conmon[85195]: level=info ts=2021-10-08T19:23:22.694Z caller=main.go:232 build_context="(go=go1.13.5, user=root@00c3106655f8, date=20191211-14:13:14)" 2021-10-08T19:23:22.957 INFO:journalctl@ceph.alertmanager.a.smithi097.stdout:Oct 08 19:23:22 smithi097 conmon[85195]: level=info ts=2021-10-08T19:23:22.694Z caller=cluster.go:161 component=cluster msg="setting advertise address explicitly" addr=172.21.15.97 port=9094 2021-10-08T19:23:22.957 INFO:journalctl@ceph.alertmanager.a.smithi097.stdout:Oct 08 19:23:22 smithi097 conmon[85195]: level=info ts=2021-10-08T19:23:22.695Z caller=cluster.go:623 component=cluster msg="Waiting for gossip to settle..." interval=2s 2021-10-08T19:23:22.957 INFO:journalctl@ceph.alertmanager.a.smithi097.stdout:Oct 08 19:23:22 smithi097 conmon[85195]: level=info ts=2021-10-08T19:23:22.714Z caller=coordinator.go:119 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2021-10-08T19:23:22.957 INFO:journalctl@ceph.alertmanager.a.smithi097.stdout:Oct 08 19:23:22 smithi097 conmon[85195]: level=info ts=2021-10-08T19:23:22.714Z caller=coordinator.go:131 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2021-10-08T19:23:22.958 INFO:journalctl@ceph.alertmanager.a.smithi097.stdout:Oct 08 19:23:22 smithi097 conmon[85195]: level=info ts=2021-10-08T19:23:22.717Z caller=main.go:497 msg=Listening address=:9093 2021-10-08T19:23:22.958 INFO:journalctl@ceph.alertmanager.a.smithi097.stdout:Oct 08 19:23:22 smithi097 bash[84903]: 9b7b72325c1b43388715a13dff76e0caf73c3aea38a483c0eae7b128b73ec1e3 2021-10-08T19:23:22.958 INFO:journalctl@ceph.alertmanager.a.smithi097.stdout:Oct 08 19:23:22 smithi097 systemd[1]: Started Ceph alertmanager.a for 1d01f6d6-286c-11ec-8c25-001a4aab830c. 2021-10-08T19:23:22.959 INFO:tasks.thrashosds:Beginning thrashosds... 2021-10-08T19:23:22.959 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2021-10-08T19:23:22.960 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph pg dump --format=json 2021-10-08T19:23:23.040 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:22 smithi117 conmon[67121]: t=2021-10-08T19:23:22+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v4" 2021-10-08T19:23:23.040 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:22 smithi117 conmon[67121]: t=2021-10-08T19:23:22+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_snapshot_v4 #1" 2021-10-08T19:23:23.041 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:22 smithi117 conmon[67121]: t=2021-10-08T19:23:22+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v5 #2" 2021-10-08T19:23:23.041 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:23 smithi117 conmon[67121]: t=2021-10-08T19:23:23+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_key - v5" 2021-10-08T19:23:23.219 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:23:23 smithi097 conmon[33110]: 172.21.15.117 - - [08/Oct/2021:19:23:23] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:23:23.237 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:23:23.298 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:23 smithi117 conmon[67121]: t=2021-10-08T19:23:23+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_delete_key - v5" 2021-10-08T19:23:23.299 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:23 smithi117 conmon[67121]: t=2021-10-08T19:23:23+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_snapshot_user_id - v5" 2021-10-08T19:23:23.300 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:23 smithi117 conmon[67121]: t=2021-10-08T19:23:23+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_snapshot to mediumtext v2" 2021-10-08T19:23:23.564 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:23 smithi117 conmon[67121]: t=2021-10-08T19:23:23+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_snapshot table charset" 2021-10-08T19:23:23.565 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:23 smithi117 conmon[67121]: t=2021-10-08T19:23:23+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external_delete_url to dashboard_snapshots table" 2021-10-08T19:23:23.565 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:23 smithi117 conmon[67121]: t=2021-10-08T19:23:23+0000 lvl=info msg="Executing migration" logger=migrator id="create quota table v1" 2021-10-08T19:23:23.565 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:23 smithi117 ceph-mon[34585]: 4.17 scrub ok 2021-10-08T19:23:23.566 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:23 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2663268603' entity='client.admin' 2021-10-08T19:23:23.566 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:23 smithi117 ceph-mon[34585]: pgmap v69: 132 pgs: 132 active+clean; 582 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:23:23.566 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:23 smithi117 ceph-mon[34585]: poll took 5810.194 ms: 1 events 2021-10-08T19:23:23.566 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:23 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:23:23.567 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:23 smithi117 ceph-mon[34585]: Reconfiguring prometheus.a (dependencies changed)... 2021-10-08T19:23:23.567 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:23 smithi117 ceph-mon[34585]: Reconfiguring daemon prometheus.a on smithi117 2021-10-08T19:23:23.567 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:23 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:23:23.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:23 smithi097 ceph-mon[32687]: 4.17 scrub ok 2021-10-08T19:23:23.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:23 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2663268603' entity='client.admin' 2021-10-08T19:23:23.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:23 smithi097 ceph-mon[32687]: pgmap v69: 132 pgs: 132 active+clean; 582 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:23:23.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:23 smithi097 ceph-mon[32687]: poll took 5810.194 ms: 1 events 2021-10-08T19:23:23.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:23 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:23:23.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:23 smithi097 ceph-mon[32687]: Reconfiguring prometheus.a (dependencies changed)... 2021-10-08T19:23:23.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:23 smithi097 ceph-mon[32687]: Reconfiguring daemon prometheus.a on smithi117 2021-10-08T19:23:23.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:23 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:23:23.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:23 smithi097 ceph-mon[41966]: 4.17 scrub ok 2021-10-08T19:23:23.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:23 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2663268603' entity='client.admin' 2021-10-08T19:23:23.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:23 smithi097 ceph-mon[41966]: pgmap v69: 132 pgs: 132 active+clean; 582 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:23:23.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:23 smithi097 ceph-mon[41966]: poll took 5810.194 ms: 1 events 2021-10-08T19:23:23.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:23 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:23:23.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:23 smithi097 ceph-mon[41966]: Reconfiguring prometheus.a (dependencies changed)... 2021-10-08T19:23:23.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:23 smithi097 ceph-mon[41966]: Reconfiguring daemon prometheus.a on smithi117 2021-10-08T19:23:23.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:23 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:23:23.867 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:23 smithi117 conmon[67121]: t=2021-10-08T19:23:23+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_quota_org_id_user_id_target - v1" 2021-10-08T19:23:23.867 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:23 smithi117 conmon[67121]: t=2021-10-08T19:23:23+0000 lvl=info msg="Executing migration" logger=migrator id="Update quota table charset" 2021-10-08T19:23:23.867 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:23 smithi117 conmon[67121]: t=2021-10-08T19:23:23+0000 lvl=info msg="Executing migration" logger=migrator id="create plugin_setting table" 2021-10-08T19:23:23.868 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:23 smithi117 conmon[67121]: t=2021-10-08T19:23:23+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_plugin_setting_org_id_plugin_id - v1" 2021-10-08T19:23:23.868 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:23 smithi117 conmon[67121]: t=2021-10-08T19:23:23+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_version to plugin_settings" 2021-10-08T19:23:24.123 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:23:23 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:23:23] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:23:24.124 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:23 smithi117 conmon[67121]: t=2021-10-08T19:23:23+0000 lvl=info msg="Executing migration" logger=migrator id="Update plugin_setting table charset" 2021-10-08T19:23:24.124 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:23 smithi117 conmon[67121]: t=2021-10-08T19:23:23+0000 lvl=info msg="Executing migration" logger=migrator id="create session table" 2021-10-08T19:23:24.124 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:24 smithi117 conmon[67121]: t=2021-10-08T19:23:24+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist table" 2021-10-08T19:23:24.124 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:24 smithi117 conmon[67121]: t=2021-10-08T19:23:24+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist_item table" 2021-10-08T19:23:24.124 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:24 smithi117 conmon[67121]: t=2021-10-08T19:23:24+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist table v2" 2021-10-08T19:23:24.406 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:24 smithi117 conmon[67121]: t=2021-10-08T19:23:24+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist item table v2" 2021-10-08T19:23:24.406 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:24 smithi117 conmon[67121]: t=2021-10-08T19:23:24+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist table charset" 2021-10-08T19:23:24.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:24 smithi117 ceph-mon[34585]: 2.3 scrub ok 2021-10-08T19:23:24.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:24 smithi117 ceph-mon[34585]: Received old metadata from agent on host smithi117. Requested up-to-date metadata. 2021-10-08T19:23:24.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:24 smithi117 ceph-mon[34585]: 172.21.15.117 - - [08/Oct/2021:19:23:23] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:23:24.697 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:24 smithi097 ceph-mon[41966]: 2.3 scrub ok 2021-10-08T19:23:24.697 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:24 smithi097 ceph-mon[41966]: Received old metadata from agent on host smithi117. Requested up-to-date metadata. 2021-10-08T19:23:24.698 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:24 smithi097 ceph-mon[41966]: 172.21.15.117 - - [08/Oct/2021:19:23:23] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:23:24.698 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:24 smithi097 ceph-mon[32687]: 2.3 scrub ok 2021-10-08T19:23:24.699 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:24 smithi097 ceph-mon[32687]: Received old metadata from agent on host smithi117. Requested up-to-date metadata. 2021-10-08T19:23:24.699 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:24 smithi097 ceph-mon[32687]: 172.21.15.117 - - [08/Oct/2021:19:23:23] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:23:24.814 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:23:24.816 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2021-10-08T19:23:24.969 INFO:journalctl@ceph.alertmanager.a.smithi097.stdout:Oct 08 19:23:24 smithi097 conmon[85195]: level=info ts=2021-10-08T19:23:24.695Z caller=cluster.go:648 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000081524s 2021-10-08T19:23:25.056 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:24 smithi117 conmon[67121]: t=2021-10-08T19:23:24+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist_item table charset" 2021-10-08T19:23:25.057 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:24 smithi117 conmon[67121]: t=2021-10-08T19:23:24+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v2" 2021-10-08T19:23:25.057 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:25 smithi117 conmon[67121]: t=2021-10-08T19:23:25+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v3" 2021-10-08T19:23:25.323 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:25 smithi117 conmon[67121]: t=2021-10-08T19:23:25+0000 lvl=info msg="Executing migration" logger=migrator id="create preferences table v3" 2021-10-08T19:23:25.323 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:25 smithi117 conmon[67121]: t=2021-10-08T19:23:25+0000 lvl=info msg="Executing migration" logger=migrator id="Update preferences table charset" 2021-10-08T19:23:25.323 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:25 smithi117 conmon[67121]: t=2021-10-08T19:23:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add column team_id in preferences" 2021-10-08T19:23:25.415 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2021-10-08T19:23:24.439626+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596164,"num_objects":194,"num_object_clones":0,"num_object_copies":582,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":1050,"num_read_kb":896,"num_write":607,"num_write_kb":2457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":1771434,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":610,"ondisk_log_size":610,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":396,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":59112,"kb_used_data":6696,"kb_used_omap":0,"kb_used_meta":52352,"kb_avail":749902104,"statfs":{"total":767960285184,"available":767899754496,"internally_reserved":0,"allocated":6856704,"data_stored":4124620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":53608448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002421"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.507784+0000","last_change":"2021-10-08T19:22:33.411869+0000","last_active":"2021-10-08T19:23:00.507784+0000","last_peered":"2021-10-08T19:23:00.507784+0000","last_clean":"2021-10-08T19:23:00.507784+0000","last_became_active":"2021-10-08T19:21:29.681121+0000","last_became_peered":"2021-10-08T19:21:29.681121+0000","last_unstale":"2021-10-08T19:23:00.507784+0000","last_undegraded":"2021-10-08T19:23:00.507784+0000","last_fullsized":"2021-10-08T19:23:00.507784+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:33.411753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:33.411753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0038057030000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.046482+0000","last_change":"2021-10-08T19:22:34.356580+0000","last_active":"2021-10-08T19:23:00.046482+0000","last_peered":"2021-10-08T19:23:00.046482+0000","last_clean":"2021-10-08T19:23:00.046482+0000","last_became_active":"2021-10-08T19:21:27.636886+0000","last_became_peered":"2021-10-08T19:21:27.636886+0000","last_unstale":"2021-10-08T19:23:00.046482+0000","last_undegraded":"2021-10-08T19:23:00.046482+0000","last_fullsized":"2021-10-08T19:23:00.046482+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:34.356501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:34.356501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034783520000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:22:59.570151+0000","last_change":"2021-10-08T19:22:54.671364+0000","last_active":"2021-10-08T19:22:59.570151+0000","last_peered":"2021-10-08T19:22:59.570151+0000","last_clean":"2021-10-08T19:22:59.570151+0000","last_became_active":"2021-10-08T19:21:23.603422+0000","last_became_peered":"2021-10-08T19:21:23.603422+0000","last_unstale":"2021-10-08T19:22:59.570151+0000","last_undegraded":"2021-10-08T19:22:59.570151+0000","last_fullsized":"2021-10-08T19:22:59.570151+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:54.671289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:54.671289+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001752221,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"69'15","reported_seq":60,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.507980+0000","last_change":"2021-10-08T19:21:25.613266+0000","last_active":"2021-10-08T19:23:00.507980+0000","last_peered":"2021-10-08T19:23:00.507980+0000","last_clean":"2021-10-08T19:23:00.507980+0000","last_became_active":"2021-10-08T19:21:25.612873+0000","last_became_peered":"2021-10-08T19:21:25.612873+0000","last_unstale":"2021-10-08T19:23:00.507980+0000","last_undegraded":"2021-10-08T19:23:00.507980+0000","last_fullsized":"2021-10-08T19:23:00.507980+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:21:24.589054+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.047052+0000","last_change":"2021-10-08T19:22:50.032446+0000","last_active":"2021-10-08T19:23:00.047052+0000","last_peered":"2021-10-08T19:23:00.047052+0000","last_clean":"2021-10-08T19:23:00.047052+0000","last_became_active":"2021-10-08T19:21:29.639039+0000","last_became_peered":"2021-10-08T19:21:29.639039+0000","last_unstale":"2021-10-08T19:23:00.047052+0000","last_undegraded":"2021-10-08T19:23:00.047052+0000","last_fullsized":"2021-10-08T19:23:00.047052+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:50.032367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:50.032367+0000","last_clean_scrub_stamp":"2021-10-08T19:22:50.032367+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034102759999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:05.196469+0000","last_change":"2021-10-08T19:23:05.196328+0000","last_active":"2021-10-08T19:23:05.196469+0000","last_peered":"2021-10-08T19:23:05.196469+0000","last_clean":"2021-10-08T19:23:05.196469+0000","last_became_active":"2021-10-08T19:21:27.634883+0000","last_became_peered":"2021-10-08T19:21:27.634883+0000","last_unstale":"2021-10-08T19:23:05.196469+0000","last_undegraded":"2021-10-08T19:23:05.196469+0000","last_fullsized":"2021-10-08T19:23:05.196469+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:05.196252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:05.196252+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0016803230000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:14.443697+0000","last_change":"2021-10-08T19:23:14.443220+0000","last_active":"2021-10-08T19:23:14.443697+0000","last_peered":"2021-10-08T19:23:14.443697+0000","last_clean":"2021-10-08T19:23:14.443697+0000","last_became_active":"2021-10-08T19:21:23.598272+0000","last_became_peered":"2021-10-08T19:21:23.598272+0000","last_unstale":"2021-10-08T19:23:14.443697+0000","last_undegraded":"2021-10-08T19:23:14.443697+0000","last_fullsized":"2021-10-08T19:23:14.443697+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:14.443147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:14.443147+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003489631,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"88'13","reported_seq":80,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:16.017298+0000","last_change":"2021-10-08T19:23:16.016750+0000","last_active":"2021-10-08T19:23:16.017298+0000","last_peered":"2021-10-08T19:23:16.017298+0000","last_clean":"2021-10-08T19:23:16.017298+0000","last_became_active":"2021-10-08T19:22:43.936718+0000","last_became_peered":"2021-10-08T19:22:43.936718+0000","last_unstale":"2021-10-08T19:23:16.017298+0000","last_undegraded":"2021-10-08T19:23:16.017298+0000","last_fullsized":"2021-10-08T19:23:16.017298+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'13","last_scrub_stamp":"2021-10-08T19:23:16.016646+0000","last_deep_scrub":"88'13","last_deep_scrub_stamp":"2021-10-08T19:23:16.016646+0000","last_clean_scrub_stamp":"2021-10-08T19:23:16.016646+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0052093469999999996,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:22:59.563336+0000","last_change":"2021-10-08T19:21:29.649955+0000","last_active":"2021-10-08T19:22:59.563336+0000","last_peered":"2021-10-08T19:22:59.563336+0000","last_clean":"2021-10-08T19:22:59.563336+0000","last_became_active":"2021-10-08T19:21:29.649640+0000","last_became_peered":"2021-10-08T19:21:29.649640+0000","last_unstale":"2021-10-08T19:22:59.563336+0000","last_undegraded":"2021-10-08T19:22:59.563336+0000","last_fullsized":"2021-10-08T19:22:59.563336+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:21:28.621762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.194682+0000","last_change":"2021-10-08T19:22:43.016906+0000","last_active":"2021-10-08T19:23:00.194682+0000","last_peered":"2021-10-08T19:23:00.194682+0000","last_clean":"2021-10-08T19:23:00.194682+0000","last_became_active":"2021-10-08T19:21:27.637178+0000","last_became_peered":"2021-10-08T19:21:27.637178+0000","last_unstale":"2021-10-08T19:23:00.194682+0000","last_undegraded":"2021-10-08T19:23:00.194682+0000","last_fullsized":"2021-10-08T19:23:00.194682+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:43.016815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:43.016815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034706469999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.194161+0000","last_change":"2021-10-08T19:22:33.926376+0000","last_active":"2021-10-08T19:23:00.194161+0000","last_peered":"2021-10-08T19:23:00.194161+0000","last_clean":"2021-10-08T19:23:00.194161+0000","last_became_active":"2021-10-08T19:21:23.609037+0000","last_became_peered":"2021-10-08T19:21:23.609037+0000","last_unstale":"2021-10-08T19:23:00.194161+0000","last_undegraded":"2021-10-08T19:23:00.194161+0000","last_fullsized":"2021-10-08T19:23:00.194161+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:33.926256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:33.926256+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0015495210000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"69'5","reported_seq":51,"reported_epoch":89,"state":"active+clean","last_fresh":"2021-10-08T19:23:17.993637+0000","last_change":"2021-10-08T19:23:17.993609+0000","last_active":"2021-10-08T19:23:17.993637+0000","last_peered":"2021-10-08T19:23:17.993637+0000","last_clean":"2021-10-08T19:23:17.993637+0000","last_became_active":"2021-10-08T19:21:25.609029+0000","last_became_peered":"2021-10-08T19:21:25.609029+0000","last_unstale":"2021-10-08T19:23:17.993637+0000","last_undegraded":"2021-10-08T19:23:17.993637+0000","last_fullsized":"2021-10-08T19:23:17.993637+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'5","last_scrub_stamp":"2021-10-08T19:23:17.993532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:17.993532+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040855580000000004,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:22:59.569494+0000","last_change":"2021-10-08T19:22:51.689295+0000","last_active":"2021-10-08T19:22:59.569494+0000","last_peered":"2021-10-08T19:22:59.569494+0000","last_clean":"2021-10-08T19:22:59.569494+0000","last_became_active":"2021-10-08T19:21:29.640978+0000","last_became_peered":"2021-10-08T19:21:29.640978+0000","last_unstale":"2021-10-08T19:22:59.569494+0000","last_undegraded":"2021-10-08T19:22:59.569494+0000","last_fullsized":"2021-10-08T19:22:59.569494+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:51.689220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:51.689220+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001435541,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:05.799919+0000","last_change":"2021-10-08T19:23:05.799433+0000","last_active":"2021-10-08T19:23:05.799919+0000","last_peered":"2021-10-08T19:23:05.799919+0000","last_clean":"2021-10-08T19:23:05.799919+0000","last_became_active":"2021-10-08T19:21:27.633979+0000","last_became_peered":"2021-10-08T19:21:27.633979+0000","last_unstale":"2021-10-08T19:23:05.799919+0000","last_undegraded":"2021-10-08T19:23:05.799919+0000","last_fullsized":"2021-10-08T19:23:05.799919+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:05.799361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:05.799361+0000","last_clean_scrub_stamp":"2021-10-08T19:23:05.799361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0036358100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.194128+0000","last_change":"2021-10-08T19:22:42.042609+0000","last_active":"2021-10-08T19:23:00.194128+0000","last_peered":"2021-10-08T19:23:00.194128+0000","last_clean":"2021-10-08T19:23:00.194128+0000","last_became_active":"2021-10-08T19:21:23.607785+0000","last_became_peered":"2021-10-08T19:21:23.607785+0000","last_unstale":"2021-10-08T19:23:00.194128+0000","last_undegraded":"2021-10-08T19:23:00.194128+0000","last_fullsized":"2021-10-08T19:23:00.194128+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:42.042510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:42.042510+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034710639999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"69'9","reported_seq":57,"reported_epoch":89,"state":"active+clean","last_fresh":"2021-10-08T19:23:19.997407+0000","last_change":"2021-10-08T19:23:19.997379+0000","last_active":"2021-10-08T19:23:19.997407+0000","last_peered":"2021-10-08T19:23:19.997407+0000","last_clean":"2021-10-08T19:23:19.997407+0000","last_became_active":"2021-10-08T19:21:25.608263+0000","last_became_peered":"2021-10-08T19:21:25.608263+0000","last_unstale":"2021-10-08T19:23:19.997407+0000","last_undegraded":"2021-10-08T19:23:19.997407+0000","last_fullsized":"2021-10-08T19:23:19.997407+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'9","last_scrub_stamp":"2021-10-08T19:23:19.997296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:19.997296+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040259689999999999,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.508671+0000","last_change":"2021-10-08T19:22:38.544751+0000","last_active":"2021-10-08T19:23:00.508671+0000","last_peered":"2021-10-08T19:23:00.508671+0000","last_clean":"2021-10-08T19:23:00.508671+0000","last_became_active":"2021-10-08T19:21:29.681017+0000","last_became_peered":"2021-10-08T19:21:29.681017+0000","last_unstale":"2021-10-08T19:23:00.508671+0000","last_undegraded":"2021-10-08T19:23:00.508671+0000","last_fullsized":"2021-10-08T19:23:00.508671+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:38.544673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:38.544673+0000","last_clean_scrub_stamp":"2021-10-08T19:22:38.544673+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0019818940000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.046773+0000","last_change":"2021-10-08T19:22:45.177384+0000","last_active":"2021-10-08T19:23:00.046773+0000","last_peered":"2021-10-08T19:23:00.046773+0000","last_clean":"2021-10-08T19:23:00.046773+0000","last_became_active":"2021-10-08T19:21:27.635242+0000","last_became_peered":"2021-10-08T19:21:27.635242+0000","last_unstale":"2021-10-08T19:23:00.046773+0000","last_undegraded":"2021-10-08T19:23:00.046773+0000","last_fullsized":"2021-10-08T19:23:00.046773+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:45.177306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:45.177306+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034162229999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:07.582193+0000","last_change":"2021-10-08T19:23:07.581727+0000","last_active":"2021-10-08T19:23:07.582193+0000","last_peered":"2021-10-08T19:23:07.582193+0000","last_clean":"2021-10-08T19:23:07.582193+0000","last_became_active":"2021-10-08T19:21:23.605327+0000","last_became_peered":"2021-10-08T19:21:23.605327+0000","last_unstale":"2021-10-08T19:23:07.582193+0000","last_undegraded":"2021-10-08T19:23:07.582193+0000","last_fullsized":"2021-10-08T19:23:07.582193+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:07.581653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:07.581653+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034956309999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"69'12","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:10.563374+0000","last_change":"2021-10-08T19:23:10.562916+0000","last_active":"2021-10-08T19:23:10.563374+0000","last_peered":"2021-10-08T19:23:10.563374+0000","last_clean":"2021-10-08T19:23:10.563374+0000","last_became_active":"2021-10-08T19:21:25.612541+0000","last_became_peered":"2021-10-08T19:21:25.612541+0000","last_unstale":"2021-10-08T19:23:10.563374+0000","last_undegraded":"2021-10-08T19:23:10.563374+0000","last_fullsized":"2021-10-08T19:23:10.563374+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'12","last_scrub_stamp":"2021-10-08T19:23:10.562820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:10.562820+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040692890000000002,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.046993+0000","last_change":"2021-10-08T19:22:56.020836+0000","last_active":"2021-10-08T19:23:00.046993+0000","last_peered":"2021-10-08T19:23:00.046993+0000","last_clean":"2021-10-08T19:23:00.046993+0000","last_became_active":"2021-10-08T19:21:29.679050+0000","last_became_peered":"2021-10-08T19:21:29.679050+0000","last_unstale":"2021-10-08T19:23:00.046993+0000","last_undegraded":"2021-10-08T19:23:00.046993+0000","last_fullsized":"2021-10-08T19:23:00.046993+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:56.020759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:56.020759+0000","last_clean_scrub_stamp":"2021-10-08T19:22:56.020759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001373478,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:10.149333+0000","last_change":"2021-10-08T19:23:10.148845+0000","last_active":"2021-10-08T19:23:10.149333+0000","last_peered":"2021-10-08T19:23:10.149333+0000","last_clean":"2021-10-08T19:23:10.149333+0000","last_became_active":"2021-10-08T19:21:27.636398+0000","last_became_peered":"2021-10-08T19:21:27.636398+0000","last_unstale":"2021-10-08T19:23:10.149333+0000","last_undegraded":"2021-10-08T19:23:10.149333+0000","last_fullsized":"2021-10-08T19:23:10.149333+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:10.148774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:10.148774+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034045170000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":52,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.195936+0000","last_change":"2021-10-08T19:22:46.422938+0000","last_active":"2021-10-08T19:23:00.195936+0000","last_peered":"2021-10-08T19:23:00.195936+0000","last_clean":"2021-10-08T19:23:00.195936+0000","last_became_active":"2021-10-08T19:22:43.936982+0000","last_became_peered":"2021-10-08T19:22:43.936982+0000","last_unstale":"2021-10-08T19:23:00.195936+0000","last_undegraded":"2021-10-08T19:23:00.195936+0000","last_fullsized":"2021-10-08T19:23:00.195936+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:46.422866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:46.422866+0000","last_clean_scrub_stamp":"2021-10-08T19:22:46.422866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0014556809999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"69'15","reported_seq":91,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:22:59.569424+0000","last_change":"2021-10-08T19:22:52.474731+0000","last_active":"2021-10-08T19:22:59.569424+0000","last_peered":"2021-10-08T19:22:59.569424+0000","last_clean":"2021-10-08T19:22:59.569424+0000","last_became_active":"2021-10-08T19:22:44.005356+0000","last_became_peered":"2021-10-08T19:22:44.005356+0000","last_unstale":"2021-10-08T19:22:59.569424+0000","last_undegraded":"2021-10-08T19:22:59.569424+0000","last_fullsized":"2021-10-08T19:22:59.569424+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'15","last_scrub_stamp":"2021-10-08T19:22:52.474651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:52.474651+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040638499999999999,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"69'1","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.251518+0000","last_change":"2021-10-08T19:22:50.226593+0000","last_active":"2021-10-08T19:23:00.251518+0000","last_peered":"2021-10-08T19:23:00.251518+0000","last_clean":"2021-10-08T19:23:00.251518+0000","last_became_active":"2021-10-08T19:21:29.637392+0000","last_became_peered":"2021-10-08T19:21:29.637392+0000","last_unstale":"2021-10-08T19:23:00.251518+0000","last_undegraded":"2021-10-08T19:23:00.251518+0000","last_fullsized":"2021-10-08T19:23:00.251518+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2021-10-08T19:22:50.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:50.226504+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040000080000000002,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:22:59.570259+0000","last_change":"2021-10-08T19:22:58.625225+0000","last_active":"2021-10-08T19:22:59.570259+0000","last_peered":"2021-10-08T19:22:59.570259+0000","last_clean":"2021-10-08T19:22:59.570259+0000","last_became_active":"2021-10-08T19:21:27.632648+0000","last_became_peered":"2021-10-08T19:21:27.632648+0000","last_unstale":"2021-10-08T19:22:59.570259+0000","last_undegraded":"2021-10-08T19:22:59.570259+0000","last_fullsized":"2021-10-08T19:22:59.570259+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:58.625153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:58.625153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0015820020000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.507510+0000","last_change":"2021-10-08T19:21:23.604120+0000","last_active":"2021-10-08T19:23:00.507510+0000","last_peered":"2021-10-08T19:23:00.507510+0000","last_clean":"2021-10-08T19:23:00.507510+0000","last_became_active":"2021-10-08T19:21:23.603777+0000","last_became_peered":"2021-10-08T19:21:23.603777+0000","last_unstale":"2021-10-08T19:23:00.507510+0000","last_undegraded":"2021-10-08T19:23:00.507510+0000","last_fullsized":"2021-10-08T19:23:00.507510+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:21:22.582293+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"69'11","reported_seq":60,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.197087+0000","last_change":"2021-10-08T19:22:53.420275+0000","last_active":"2021-10-08T19:23:00.197087+0000","last_peered":"2021-10-08T19:23:00.197087+0000","last_clean":"2021-10-08T19:23:00.197087+0000","last_became_active":"2021-10-08T19:21:25.610902+0000","last_became_peered":"2021-10-08T19:21:25.610902+0000","last_unstale":"2021-10-08T19:23:00.197087+0000","last_undegraded":"2021-10-08T19:23:00.197087+0000","last_fullsized":"2021-10-08T19:23:00.197087+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'11","last_scrub_stamp":"2021-10-08T19:22:53.420199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:53.420199+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0023910469999999999,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"69'1","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:04.311967+0000","last_change":"2021-10-08T19:23:04.311491+0000","last_active":"2021-10-08T19:23:04.311967+0000","last_peered":"2021-10-08T19:23:04.311967+0000","last_clean":"2021-10-08T19:23:04.311967+0000","last_became_active":"2021-10-08T19:21:29.640296+0000","last_became_peered":"2021-10-08T19:21:29.640296+0000","last_unstale":"2021-10-08T19:23:04.311967+0000","last_undegraded":"2021-10-08T19:23:04.311967+0000","last_fullsized":"2021-10-08T19:23:04.311967+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2021-10-08T19:23:04.311406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:04.311406+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0041668299999999998,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"69'8","reported_seq":74,"reported_epoch":89,"state":"active+clean","last_fresh":"2021-10-08T19:23:17.912118+0000","last_change":"2021-10-08T19:22:43.380890+0000","last_active":"2021-10-08T19:23:17.912118+0000","last_peered":"2021-10-08T19:23:17.912118+0000","last_clean":"2021-10-08T19:23:17.912118+0000","last_became_active":"2021-10-08T19:21:27.638792+0000","last_became_peered":"2021-10-08T19:21:27.638792+0000","last_unstale":"2021-10-08T19:23:17.912118+0000","last_undegraded":"2021-10-08T19:23:17.912118+0000","last_fullsized":"2021-10-08T19:23:17.912118+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'8","last_scrub_stamp":"2021-10-08T19:22:43.380786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:43.380786+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002000403,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2021-10-08T19:23:19.631823+0000","last_change":"2021-10-08T19:23:19.631788+0000","last_active":"2021-10-08T19:23:19.631823+0000","last_peered":"2021-10-08T19:23:19.631823+0000","last_clean":"2021-10-08T19:23:19.631823+0000","last_became_active":"2021-10-08T19:21:23.604530+0000","last_became_peered":"2021-10-08T19:21:23.604530+0000","last_unstale":"2021-10-08T19:23:19.631823+0000","last_undegraded":"2021-10-08T19:23:19.631823+0000","last_fullsized":"2021-10-08T19:23:19.631823+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:19.631715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:19.631715+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0013318340000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"69'10","reported_seq":56,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:22:59.570235+0000","last_change":"2021-10-08T19:22:27.654003+0000","last_active":"2021-10-08T19:22:59.570235+0000","last_peered":"2021-10-08T19:22:59.570235+0000","last_clean":"2021-10-08T19:22:59.570235+0000","last_became_active":"2021-10-08T19:21:25.743519+0000","last_became_peered":"2021-10-08T19:21:25.743519+0000","last_unstale":"2021-10-08T19:22:59.570235+0000","last_undegraded":"2021-10-08T19:22:59.570235+0000","last_fullsized":"2021-10-08T19:22:59.570235+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'10","last_scrub_stamp":"2021-10-08T19:22:27.653872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:27.653872+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0028937009999999998,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:06.571411+0000","last_change":"2021-10-08T19:23:06.570919+0000","last_active":"2021-10-08T19:23:06.571411+0000","last_peered":"2021-10-08T19:23:06.571411+0000","last_clean":"2021-10-08T19:23:06.571411+0000","last_became_active":"2021-10-08T19:21:29.681023+0000","last_became_peered":"2021-10-08T19:21:29.681023+0000","last_unstale":"2021-10-08T19:23:06.571411+0000","last_undegraded":"2021-10-08T19:23:06.571411+0000","last_fullsized":"2021-10-08T19:23:06.571411+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:06.570853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:06.570853+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034079790000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.195073+0000","last_change":"2021-10-08T19:23:00.194960+0000","last_active":"2021-10-08T19:23:00.195073+0000","last_peered":"2021-10-08T19:23:00.195073+0000","last_clean":"2021-10-08T19:23:00.195073+0000","last_became_active":"2021-10-08T19:21:27.637131+0000","last_became_peered":"2021-10-08T19:21:27.637131+0000","last_unstale":"2021-10-08T19:23:00.195073+0000","last_undegraded":"2021-10-08T19:23:00.195073+0000","last_fullsized":"2021-10-08T19:23:00.195073+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:00.194892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:00.194892+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020373650000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.196094+0000","last_change":"2021-10-08T19:22:31.311191+0000","last_active":"2021-10-08T19:23:00.196094+0000","last_peered":"2021-10-08T19:23:00.196094+0000","last_clean":"2021-10-08T19:23:00.196094+0000","last_became_active":"2021-10-08T19:21:23.606708+0000","last_became_peered":"2021-10-08T19:21:23.606708+0000","last_unstale":"2021-10-08T19:23:00.196094+0000","last_undegraded":"2021-10-08T19:23:00.196094+0000","last_fullsized":"2021-10-08T19:23:00.196094+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:31.311083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:31.311083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0015648369999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"69'11","reported_seq":54,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.507961+0000","last_change":"2021-10-08T19:21:25.742854+0000","last_active":"2021-10-08T19:23:00.507961+0000","last_peered":"2021-10-08T19:23:00.507961+0000","last_clean":"2021-10-08T19:23:00.507961+0000","last_became_active":"2021-10-08T19:21:25.742586+0000","last_became_peered":"2021-10-08T19:21:25.742586+0000","last_unstale":"2021-10-08T19:23:00.507961+0000","last_undegraded":"2021-10-08T19:23:00.507961+0000","last_fullsized":"2021-10-08T19:23:00.507961+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:21:24.589054+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.194574+0000","last_change":"2021-10-08T19:22:52.059253+0000","last_active":"2021-10-08T19:23:00.194574+0000","last_peered":"2021-10-08T19:23:00.194574+0000","last_clean":"2021-10-08T19:23:00.194574+0000","last_became_active":"2021-10-08T19:21:29.642835+0000","last_became_peered":"2021-10-08T19:21:29.642835+0000","last_unstale":"2021-10-08T19:23:00.194574+0000","last_undegraded":"2021-10-08T19:23:00.194574+0000","last_fullsized":"2021-10-08T19:23:00.194574+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:52.059181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:52.059181+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034376540000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:02.446577+0000","last_change":"2021-10-08T19:23:02.446476+0000","last_active":"2021-10-08T19:23:02.446577+0000","last_peered":"2021-10-08T19:23:02.446577+0000","last_clean":"2021-10-08T19:23:02.446577+0000","last_became_active":"2021-10-08T19:21:27.643513+0000","last_became_peered":"2021-10-08T19:21:27.643513+0000","last_unstale":"2021-10-08T19:23:02.446577+0000","last_undegraded":"2021-10-08T19:23:02.446577+0000","last_fullsized":"2021-10-08T19:23:02.446577+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:02.446394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:02.446394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001225133,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:13.716885+0000","last_change":"2021-10-08T19:23:13.716452+0000","last_active":"2021-10-08T19:23:13.716885+0000","last_peered":"2021-10-08T19:23:13.716885+0000","last_clean":"2021-10-08T19:23:13.716885+0000","last_became_active":"2021-10-08T19:21:23.600192+0000","last_became_peered":"2021-10-08T19:21:23.600192+0000","last_unstale":"2021-10-08T19:23:13.716885+0000","last_undegraded":"2021-10-08T19:23:13.716885+0000","last_fullsized":"2021-10-08T19:23:13.716885+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:13.716331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:13.716331+0000","last_clean_scrub_stamp":"2021-10-08T19:23:13.716331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0033906079999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"69'4","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.507825+0000","last_change":"2021-10-08T19:22:34.447928+0000","last_active":"2021-10-08T19:23:00.507825+0000","last_peered":"2021-10-08T19:23:00.507825+0000","last_clean":"2021-10-08T19:23:00.507825+0000","last_became_active":"2021-10-08T19:21:25.612729+0000","last_became_peered":"2021-10-08T19:21:25.612729+0000","last_unstale":"2021-10-08T19:23:00.507825+0000","last_undegraded":"2021-10-08T19:23:00.507825+0000","last_fullsized":"2021-10-08T19:23:00.507825+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'4","last_scrub_stamp":"2021-10-08T19:22:34.447854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:34.447854+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040770490000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:12.504672+0000","last_change":"2021-10-08T19:23:12.504222+0000","last_active":"2021-10-08T19:23:12.504672+0000","last_peered":"2021-10-08T19:23:12.504672+0000","last_clean":"2021-10-08T19:23:12.504672+0000","last_became_active":"2021-10-08T19:21:29.649225+0000","last_became_peered":"2021-10-08T19:21:29.649225+0000","last_unstale":"2021-10-08T19:23:12.504672+0000","last_undegraded":"2021-10-08T19:23:12.504672+0000","last_fullsized":"2021-10-08T19:23:12.504672+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:12.504136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:12.504136+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0038704550000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.251800+0000","last_change":"2021-10-08T19:22:43.186757+0000","last_active":"2021-10-08T19:23:00.251800+0000","last_peered":"2021-10-08T19:23:00.251800+0000","last_clean":"2021-10-08T19:23:00.251800+0000","last_became_active":"2021-10-08T19:21:27.635623+0000","last_became_peered":"2021-10-08T19:21:27.635623+0000","last_unstale":"2021-10-08T19:23:00.251800+0000","last_undegraded":"2021-10-08T19:23:00.251800+0000","last_fullsized":"2021-10-08T19:23:00.251800+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:43.186684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:43.186684+0000","last_clean_scrub_stamp":"2021-10-08T19:22:43.186684+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0015123129999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:02.243028+0000","last_change":"2021-10-08T19:23:02.242539+0000","last_active":"2021-10-08T19:23:02.243028+0000","last_peered":"2021-10-08T19:23:02.243028+0000","last_clean":"2021-10-08T19:23:02.243028+0000","last_became_active":"2021-10-08T19:21:23.607048+0000","last_became_peered":"2021-10-08T19:21:23.607048+0000","last_unstale":"2021-10-08T19:23:02.243028+0000","last_undegraded":"2021-10-08T19:23:02.243028+0000","last_fullsized":"2021-10-08T19:23:02.243028+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:02.242462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:02.242462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034031740000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"69'11","reported_seq":81,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.046263+0000","last_change":"2021-10-08T19:22:44.368163+0000","last_active":"2021-10-08T19:23:00.046263+0000","last_peered":"2021-10-08T19:23:00.046263+0000","last_clean":"2021-10-08T19:23:00.046263+0000","last_became_active":"2021-10-08T19:22:43.936354+0000","last_became_peered":"2021-10-08T19:22:43.936354+0000","last_unstale":"2021-10-08T19:23:00.046263+0000","last_undegraded":"2021-10-08T19:23:00.046263+0000","last_fullsized":"2021-10-08T19:23:00.046263+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'11","last_scrub_stamp":"2021-10-08T19:22:33.337032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:33.337032+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040894970000000001,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:02.605208+0000","last_change":"2021-10-08T19:23:02.605102+0000","last_active":"2021-10-08T19:23:02.605208+0000","last_peered":"2021-10-08T19:23:02.605208+0000","last_clean":"2021-10-08T19:23:02.605208+0000","last_became_active":"2021-10-08T19:21:29.641431+0000","last_became_peered":"2021-10-08T19:21:29.641431+0000","last_unstale":"2021-10-08T19:23:02.605208+0000","last_undegraded":"2021-10-08T19:23:02.605208+0000","last_fullsized":"2021-10-08T19:23:02.605208+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:02.605025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:02.605025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001265305,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.508031+0000","last_change":"2021-10-08T19:21:27.638133+0000","last_active":"2021-10-08T19:23:00.508031+0000","last_peered":"2021-10-08T19:23:00.508031+0000","last_clean":"2021-10-08T19:23:00.508031+0000","last_became_active":"2021-10-08T19:21:27.637800+0000","last_became_peered":"2021-10-08T19:21:27.637800+0000","last_unstale":"2021-10-08T19:23:00.508031+0000","last_undegraded":"2021-10-08T19:23:00.508031+0000","last_fullsized":"2021-10-08T19:23:00.508031+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:21:26.604244+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.195954+0000","last_change":"2021-10-08T19:22:52.408971+0000","last_active":"2021-10-08T19:23:00.195954+0000","last_peered":"2021-10-08T19:23:00.195954+0000","last_clean":"2021-10-08T19:23:00.195954+0000","last_became_active":"2021-10-08T19:21:23.606797+0000","last_became_peered":"2021-10-08T19:21:23.606797+0000","last_unstale":"2021-10-08T19:23:00.195954+0000","last_undegraded":"2021-10-08T19:23:00.195954+0000","last_fullsized":"2021-10-08T19:23:00.195954+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:52.408893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:52.408893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0015921889999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"87'13","reported_seq":61,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.251454+0000","last_change":"2021-10-08T19:22:53.263693+0000","last_active":"2021-10-08T19:23:00.251454+0000","last_peered":"2021-10-08T19:23:00.251454+0000","last_clean":"2021-10-08T19:23:00.251454+0000","last_became_active":"2021-10-08T19:21:25.615596+0000","last_became_peered":"2021-10-08T19:21:25.615596+0000","last_unstale":"2021-10-08T19:23:00.251454+0000","last_undegraded":"2021-10-08T19:23:00.251454+0000","last_fullsized":"2021-10-08T19:23:00.251454+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'13","last_scrub_stamp":"2021-10-08T19:22:53.263631+0000","last_deep_scrub":"87'13","last_deep_scrub_stamp":"2021-10-08T19:22:53.263631+0000","last_clean_scrub_stamp":"2021-10-08T19:22:53.263631+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0036954140000000002,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.047063+0000","last_change":"2021-10-08T19:22:49.049456+0000","last_active":"2021-10-08T19:23:00.047063+0000","last_peered":"2021-10-08T19:23:00.047063+0000","last_clean":"2021-10-08T19:23:00.047063+0000","last_became_active":"2021-10-08T19:21:29.640302+0000","last_became_peered":"2021-10-08T19:21:29.640302+0000","last_unstale":"2021-10-08T19:23:00.047063+0000","last_undegraded":"2021-10-08T19:23:00.047063+0000","last_fullsized":"2021-10-08T19:23:00.047063+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:49.049379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:49.049379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.00162856,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"69'8","reported_seq":71,"reported_epoch":89,"state":"active+clean","last_fresh":"2021-10-08T19:23:17.911689+0000","last_change":"2021-10-08T19:22:32.372773+0000","last_active":"2021-10-08T19:23:17.911689+0000","last_peered":"2021-10-08T19:23:17.911689+0000","last_clean":"2021-10-08T19:23:17.911689+0000","last_became_active":"2021-10-08T19:21:27.636440+0000","last_became_peered":"2021-10-08T19:21:27.636440+0000","last_unstale":"2021-10-08T19:23:17.911689+0000","last_undegraded":"2021-10-08T19:23:17.911689+0000","last_fullsized":"2021-10-08T19:23:17.911689+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'8","last_scrub_stamp":"2021-10-08T19:22:32.372699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:32.372699+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039965820000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:22:59.569921+0000","last_change":"2021-10-08T19:22:24.698543+0000","last_active":"2021-10-08T19:22:59.569921+0000","last_peered":"2021-10-08T19:22:59.569921+0000","last_clean":"2021-10-08T19:22:59.569921+0000","last_became_active":"2021-10-08T19:21:23.606478+0000","last_became_peered":"2021-10-08T19:21:23.606478+0000","last_unstale":"2021-10-08T19:22:59.569921+0000","last_undegraded":"2021-10-08T19:22:59.569921+0000","last_fullsized":"2021-10-08T19:22:59.569921+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:24.698471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:24.698471+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001682846,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"69'9","reported_seq":57,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:22:59.563917+0000","last_change":"2021-10-08T19:22:42.517875+0000","last_active":"2021-10-08T19:22:59.563917+0000","last_peered":"2021-10-08T19:22:59.563917+0000","last_clean":"2021-10-08T19:22:59.563917+0000","last_became_active":"2021-10-08T19:21:25.741755+0000","last_became_peered":"2021-10-08T19:21:25.741755+0000","last_unstale":"2021-10-08T19:22:59.563917+0000","last_undegraded":"2021-10-08T19:22:59.563917+0000","last_fullsized":"2021-10-08T19:22:59.563917+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'9","last_scrub_stamp":"2021-10-08T19:22:42.517786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:42.517786+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0042286850000000003,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:11.535890+0000","last_change":"2021-10-08T19:23:11.535748+0000","last_active":"2021-10-08T19:23:11.535890+0000","last_peered":"2021-10-08T19:23:11.535890+0000","last_clean":"2021-10-08T19:23:11.535890+0000","last_became_active":"2021-10-08T19:21:29.646331+0000","last_became_peered":"2021-10-08T19:21:29.646331+0000","last_unstale":"2021-10-08T19:23:11.535890+0000","last_undegraded":"2021-10-08T19:23:11.535890+0000","last_fullsized":"2021-10-08T19:23:11.535890+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:11.535641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:11.535641+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001740417,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"69'8","reported_seq":71,"reported_epoch":89,"state":"active+clean","last_fresh":"2021-10-08T19:23:17.911041+0000","last_change":"2021-10-08T19:22:28.467610+0000","last_active":"2021-10-08T19:23:17.911041+0000","last_peered":"2021-10-08T19:23:17.911041+0000","last_clean":"2021-10-08T19:23:17.911041+0000","last_became_active":"2021-10-08T19:21:27.635924+0000","last_became_peered":"2021-10-08T19:21:27.635924+0000","last_unstale":"2021-10-08T19:23:17.911041+0000","last_undegraded":"2021-10-08T19:23:17.911041+0000","last_fullsized":"2021-10-08T19:23:17.911041+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'8","last_scrub_stamp":"2021-10-08T19:22:28.467539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:28.467539+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039782960000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:04.759675+0000","last_change":"2021-10-08T19:23:04.759546+0000","last_active":"2021-10-08T19:23:04.759675+0000","last_peered":"2021-10-08T19:23:04.759675+0000","last_clean":"2021-10-08T19:23:04.759675+0000","last_became_active":"2021-10-08T19:21:23.603637+0000","last_became_peered":"2021-10-08T19:21:23.603637+0000","last_unstale":"2021-10-08T19:23:04.759675+0000","last_undegraded":"2021-10-08T19:23:04.759675+0000","last_fullsized":"2021-10-08T19:23:04.759675+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:04.759470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:04.759470+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001376447,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"69'10","reported_seq":56,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.508320+0000","last_change":"2021-10-08T19:22:52.611146+0000","last_active":"2021-10-08T19:23:00.508320+0000","last_peered":"2021-10-08T19:23:00.508320+0000","last_clean":"2021-10-08T19:23:00.508320+0000","last_became_active":"2021-10-08T19:21:25.741716+0000","last_became_peered":"2021-10-08T19:21:25.741716+0000","last_unstale":"2021-10-08T19:23:00.508320+0000","last_undegraded":"2021-10-08T19:23:00.508320+0000","last_fullsized":"2021-10-08T19:23:00.508320+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'10","last_scrub_stamp":"2021-10-08T19:22:52.611060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:52.611060+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040684459999999999,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.195162+0000","last_change":"2021-10-08T19:22:36.973546+0000","last_active":"2021-10-08T19:23:00.195162+0000","last_peered":"2021-10-08T19:23:00.195162+0000","last_clean":"2021-10-08T19:23:00.195162+0000","last_became_active":"2021-10-08T19:21:29.681255+0000","last_became_peered":"2021-10-08T19:21:29.681255+0000","last_unstale":"2021-10-08T19:23:00.195162+0000","last_undegraded":"2021-10-08T19:23:00.195162+0000","last_fullsized":"2021-10-08T19:23:00.195162+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:36.973452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:36.973452+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001482431,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:22:59.563710+0000","last_change":"2021-10-08T19:22:50.573085+0000","last_active":"2021-10-08T19:22:59.563710+0000","last_peered":"2021-10-08T19:22:59.563710+0000","last_clean":"2021-10-08T19:22:59.563710+0000","last_became_active":"2021-10-08T19:21:27.634443+0000","last_became_peered":"2021-10-08T19:21:27.634443+0000","last_unstale":"2021-10-08T19:22:59.563710+0000","last_undegraded":"2021-10-08T19:22:59.563710+0000","last_fullsized":"2021-10-08T19:22:59.563710+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:50.573010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:50.573010+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034131029999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.196511+0000","last_change":"2021-10-08T19:22:35.361033+0000","last_active":"2021-10-08T19:23:00.196511+0000","last_peered":"2021-10-08T19:23:00.196511+0000","last_clean":"2021-10-08T19:23:00.196511+0000","last_became_active":"2021-10-08T19:21:23.611362+0000","last_became_peered":"2021-10-08T19:21:23.611362+0000","last_unstale":"2021-10-08T19:23:00.196511+0000","last_undegraded":"2021-10-08T19:23:00.196511+0000","last_fullsized":"2021-10-08T19:23:00.196511+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:35.360970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:35.360970+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001166795,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"69'6","reported_seq":50,"reported_epoch":89,"state":"active+clean","last_fresh":"2021-10-08T19:23:21.395496+0000","last_change":"2021-10-08T19:23:21.395469+0000","last_active":"2021-10-08T19:23:21.395496+0000","last_peered":"2021-10-08T19:23:21.395496+0000","last_clean":"2021-10-08T19:23:21.395496+0000","last_became_active":"2021-10-08T19:21:25.742631+0000","last_became_peered":"2021-10-08T19:21:25.742631+0000","last_unstale":"2021-10-08T19:23:21.395496+0000","last_undegraded":"2021-10-08T19:23:21.395496+0000","last_fullsized":"2021-10-08T19:23:21.395496+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'6","last_scrub_stamp":"2021-10-08T19:23:21.395390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:21.395390+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002416241,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:22:59.569067+0000","last_change":"2021-10-08T19:22:40.421310+0000","last_active":"2021-10-08T19:22:59.569067+0000","last_peered":"2021-10-08T19:22:59.569067+0000","last_clean":"2021-10-08T19:22:59.569067+0000","last_became_active":"2021-10-08T19:21:29.640674+0000","last_became_peered":"2021-10-08T19:21:29.640674+0000","last_unstale":"2021-10-08T19:22:59.569067+0000","last_undegraded":"2021-10-08T19:22:59.569067+0000","last_fullsized":"2021-10-08T19:22:59.569067+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:40.421229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.421229+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034873370000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.508705+0000","last_change":"2021-10-08T19:22:36.466178+0000","last_active":"2021-10-08T19:23:00.508705+0000","last_peered":"2021-10-08T19:23:00.508705+0000","last_clean":"2021-10-08T19:23:00.508705+0000","last_became_active":"2021-10-08T19:21:27.638112+0000","last_became_peered":"2021-10-08T19:21:27.638112+0000","last_unstale":"2021-10-08T19:23:00.508705+0000","last_undegraded":"2021-10-08T19:23:00.508705+0000","last_fullsized":"2021-10-08T19:23:00.508705+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:36.466077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:36.466077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0018534809999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:22:59.569308+0000","last_change":"2021-10-08T19:22:24.268774+0000","last_active":"2021-10-08T19:22:59.569308+0000","last_peered":"2021-10-08T19:22:59.569308+0000","last_clean":"2021-10-08T19:22:59.569308+0000","last_became_active":"2021-10-08T19:21:23.598125+0000","last_became_peered":"2021-10-08T19:21:23.598125+0000","last_unstale":"2021-10-08T19:22:59.569308+0000","last_undegraded":"2021-10-08T19:22:59.569308+0000","last_fullsized":"2021-10-08T19:22:59.569308+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:24.268699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:24.268699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001617215,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"69'9","reported_seq":57,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.644670+0000","last_change":"2021-10-08T19:23:00.644527+0000","last_active":"2021-10-08T19:23:00.644670+0000","last_peered":"2021-10-08T19:23:00.644670+0000","last_clean":"2021-10-08T19:23:00.644670+0000","last_became_active":"2021-10-08T19:21:25.743804+0000","last_became_peered":"2021-10-08T19:21:25.743804+0000","last_unstale":"2021-10-08T19:23:00.644670+0000","last_undegraded":"2021-10-08T19:23:00.644670+0000","last_fullsized":"2021-10-08T19:23:00.644670+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'9","last_scrub_stamp":"2021-10-08T19:23:00.644449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:00.644449+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0023246959999999998,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.508087+0000","last_change":"2021-10-08T19:21:29.647439+0000","last_active":"2021-10-08T19:23:00.508087+0000","last_peered":"2021-10-08T19:23:00.508087+0000","last_clean":"2021-10-08T19:23:00.508087+0000","last_became_active":"2021-10-08T19:21:29.647140+0000","last_became_peered":"2021-10-08T19:21:29.647140+0000","last_unstale":"2021-10-08T19:23:00.508087+0000","last_undegraded":"2021-10-08T19:23:00.508087+0000","last_fullsized":"2021-10-08T19:23:00.508087+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:21:28.621762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"61'2","reported_seq":59,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:07.991602+0000","last_change":"2021-10-08T19:23:07.991466+0000","last_active":"2021-10-08T19:23:07.991602+0000","last_peered":"2021-10-08T19:23:07.991602+0000","last_clean":"2021-10-08T19:23:07.991602+0000","last_became_active":"2021-10-08T19:21:23.603614+0000","last_became_peered":"2021-10-08T19:21:23.603614+0000","last_unstale":"2021-10-08T19:23:07.991602+0000","last_undegraded":"2021-10-08T19:23:07.991602+0000","last_fullsized":"2021-10-08T19:23:07.991602+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'2","last_scrub_stamp":"2021-10-08T19:23:07.991388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:07.991388+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001614983,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"69'12","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.046670+0000","last_change":"2021-10-08T19:22:57.003718+0000","last_active":"2021-10-08T19:23:00.046670+0000","last_peered":"2021-10-08T19:23:00.046670+0000","last_clean":"2021-10-08T19:23:00.046670+0000","last_became_active":"2021-10-08T19:21:25.609079+0000","last_became_peered":"2021-10-08T19:21:25.609079+0000","last_unstale":"2021-10-08T19:23:00.046670+0000","last_undegraded":"2021-10-08T19:23:00.046670+0000","last_fullsized":"2021-10-08T19:23:00.046670+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'12","last_scrub_stamp":"2021-10-08T19:22:57.003641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:57.003641+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0041017010000000001,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:22:59.570184+0000","last_change":"2021-10-08T19:22:50.435623+0000","last_active":"2021-10-08T19:22:59.570184+0000","last_peered":"2021-10-08T19:22:59.570184+0000","last_clean":"2021-10-08T19:22:59.570184+0000","last_became_active":"2021-10-08T19:21:27.633878+0000","last_became_peered":"2021-10-08T19:21:27.633878+0000","last_unstale":"2021-10-08T19:22:59.570184+0000","last_undegraded":"2021-10-08T19:22:59.570184+0000","last_fullsized":"2021-10-08T19:22:59.570184+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:50.435552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:50.435552+0000","last_clean_scrub_stamp":"2021-10-08T19:22:50.435552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0012976140000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:22:59.568578+0000","last_change":"2021-10-08T19:22:46.569728+0000","last_active":"2021-10-08T19:22:59.568578+0000","last_peered":"2021-10-08T19:22:59.568578+0000","last_clean":"2021-10-08T19:22:59.568578+0000","last_became_active":"2021-10-08T19:21:29.649735+0000","last_became_peered":"2021-10-08T19:21:29.649735+0000","last_unstale":"2021-10-08T19:22:59.568578+0000","last_undegraded":"2021-10-08T19:22:59.568578+0000","last_fullsized":"2021-10-08T19:22:59.568578+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:46.569603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:46.569603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001693387,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.250922+0000","last_change":"2021-10-08T19:22:39.168725+0000","last_active":"2021-10-08T19:23:00.250922+0000","last_peered":"2021-10-08T19:23:00.250922+0000","last_clean":"2021-10-08T19:23:00.250922+0000","last_became_active":"2021-10-08T19:21:23.605441+0000","last_became_peered":"2021-10-08T19:21:23.605441+0000","last_unstale":"2021-10-08T19:23:00.250922+0000","last_undegraded":"2021-10-08T19:23:00.250922+0000","last_fullsized":"2021-10-08T19:23:00.250922+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:39.168642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:39.168642+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001714901,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"69'10","reported_seq":56,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.251712+0000","last_change":"2021-10-08T19:22:54.269202+0000","last_active":"2021-10-08T19:23:00.251712+0000","last_peered":"2021-10-08T19:23:00.251712+0000","last_clean":"2021-10-08T19:23:00.251712+0000","last_became_active":"2021-10-08T19:21:25.608581+0000","last_became_peered":"2021-10-08T19:21:25.608581+0000","last_unstale":"2021-10-08T19:23:00.251712+0000","last_undegraded":"2021-10-08T19:23:00.251712+0000","last_fullsized":"2021-10-08T19:23:00.251712+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'10","last_scrub_stamp":"2021-10-08T19:22:54.269123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:54.269123+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0024762310000000002,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"69'8","reported_seq":71,"reported_epoch":89,"state":"active+clean","last_fresh":"2021-10-08T19:23:17.748661+0000","last_change":"2021-10-08T19:22:32.603483+0000","last_active":"2021-10-08T19:23:17.748661+0000","last_peered":"2021-10-08T19:23:17.748661+0000","last_clean":"2021-10-08T19:23:17.748661+0000","last_became_active":"2021-10-08T19:21:27.636151+0000","last_became_peered":"2021-10-08T19:21:27.636151+0000","last_unstale":"2021-10-08T19:23:17.748661+0000","last_undegraded":"2021-10-08T19:23:17.748661+0000","last_fullsized":"2021-10-08T19:23:17.748661+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'8","last_scrub_stamp":"2021-10-08T19:22:32.603379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:32.603379+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0022390349999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.508514+0000","last_change":"2021-10-08T19:21:29.647729+0000","last_active":"2021-10-08T19:23:00.508514+0000","last_peered":"2021-10-08T19:23:00.508514+0000","last_clean":"2021-10-08T19:23:00.508514+0000","last_became_active":"2021-10-08T19:21:29.647403+0000","last_became_peered":"2021-10-08T19:21:29.647403+0000","last_unstale":"2021-10-08T19:23:00.508514+0000","last_undegraded":"2021-10-08T19:23:00.508514+0000","last_fullsized":"2021-10-08T19:23:00.508514+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:21:28.621762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:01.747155+0000","last_change":"2021-10-08T19:23:01.747028+0000","last_active":"2021-10-08T19:23:01.747155+0000","last_peered":"2021-10-08T19:23:01.747155+0000","last_clean":"2021-10-08T19:23:01.747155+0000","last_became_active":"2021-10-08T19:21:23.601309+0000","last_became_peered":"2021-10-08T19:21:23.601309+0000","last_unstale":"2021-10-08T19:23:01.747155+0000","last_undegraded":"2021-10-08T19:23:01.747155+0000","last_fullsized":"2021-10-08T19:23:01.747155+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:01.746914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:01.746914+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001402506,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"69'28","reported_seq":113,"reported_epoch":89,"state":"active+clean","last_fresh":"2021-10-08T19:23:17.911409+0000","last_change":"2021-10-08T19:22:40.195245+0000","last_active":"2021-10-08T19:23:17.911409+0000","last_peered":"2021-10-08T19:23:17.911409+0000","last_clean":"2021-10-08T19:23:17.911409+0000","last_became_active":"2021-10-08T19:21:25.613663+0000","last_became_peered":"2021-10-08T19:21:25.613663+0000","last_unstale":"2021-10-08T19:23:17.911409+0000","last_undegraded":"2021-10-08T19:23:17.911409+0000","last_fullsized":"2021-10-08T19:23:17.911409+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'28","last_scrub_stamp":"2021-10-08T19:22:40.195166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.195166+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0029295340000000001,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:03.639174+0000","last_change":"2021-10-08T19:23:03.639015+0000","last_active":"2021-10-08T19:23:03.639174+0000","last_peered":"2021-10-08T19:23:03.639174+0000","last_clean":"2021-10-08T19:23:03.639174+0000","last_became_active":"2021-10-08T19:21:27.636192+0000","last_became_peered":"2021-10-08T19:21:27.636192+0000","last_unstale":"2021-10-08T19:23:03.639174+0000","last_undegraded":"2021-10-08T19:23:03.639174+0000","last_fullsized":"2021-10-08T19:23:03.639174+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:03.638920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:03.638920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0016933230000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:01.215816+0000","last_change":"2021-10-08T19:23:01.215676+0000","last_active":"2021-10-08T19:23:01.215816+0000","last_peered":"2021-10-08T19:23:01.215816+0000","last_clean":"2021-10-08T19:23:01.215816+0000","last_became_active":"2021-10-08T19:21:29.679259+0000","last_became_peered":"2021-10-08T19:21:29.679259+0000","last_unstale":"2021-10-08T19:23:01.215816+0000","last_undegraded":"2021-10-08T19:23:01.215816+0000","last_fullsized":"2021-10-08T19:23:01.215816+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:01.215579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:01.215579+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001463748,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"70'5","reported_seq":159,"reported_epoch":89,"state":"active+clean","last_fresh":"2021-10-08T19:23:22.197493+0000","last_change":"2021-10-08T19:22:48.239798+0000","last_active":"2021-10-08T19:23:22.197493+0000","last_peered":"2021-10-08T19:23:22.197493+0000","last_clean":"2021-10-08T19:23:22.197493+0000","last_became_active":"2021-10-08T19:21:23.601969+0000","last_became_peered":"2021-10-08T19:21:23.601969+0000","last_unstale":"2021-10-08T19:23:22.197493+0000","last_undegraded":"2021-10-08T19:23:22.197493+0000","last_fullsized":"2021-10-08T19:23:22.197493+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:22:48.239721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:48.239721+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001618092,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":113,"num_read_kb":108,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:22:59.568660+0000","last_change":"2021-10-08T19:22:53.423318+0000","last_active":"2021-10-08T19:22:59.568660+0000","last_peered":"2021-10-08T19:22:59.568660+0000","last_clean":"2021-10-08T19:22:59.568660+0000","last_became_active":"2021-10-08T19:21:23.602967+0000","last_became_peered":"2021-10-08T19:21:23.602967+0000","last_unstale":"2021-10-08T19:22:59.568660+0000","last_undegraded":"2021-10-08T19:22:59.568660+0000","last_fullsized":"2021-10-08T19:22:59.568660+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:53.423249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:53.423249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001264587,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"69'13","reported_seq":68,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.251636+0000","last_change":"2021-10-08T19:22:46.281753+0000","last_active":"2021-10-08T19:23:00.251636+0000","last_peered":"2021-10-08T19:23:00.251636+0000","last_clean":"2021-10-08T19:23:00.251636+0000","last_became_active":"2021-10-08T19:21:25.608584+0000","last_became_peered":"2021-10-08T19:21:25.608584+0000","last_unstale":"2021-10-08T19:23:00.251636+0000","last_undegraded":"2021-10-08T19:23:00.251636+0000","last_fullsized":"2021-10-08T19:23:00.251636+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'13","last_scrub_stamp":"2021-10-08T19:22:46.281626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:46.281626+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0047889999999999999,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:06.488243+0000","last_change":"2021-10-08T19:23:06.487842+0000","last_active":"2021-10-08T19:23:06.488243+0000","last_peered":"2021-10-08T19:23:06.488243+0000","last_clean":"2021-10-08T19:23:06.488243+0000","last_became_active":"2021-10-08T19:21:27.637875+0000","last_became_peered":"2021-10-08T19:21:27.637875+0000","last_unstale":"2021-10-08T19:23:06.488243+0000","last_undegraded":"2021-10-08T19:23:06.488243+0000","last_fullsized":"2021-10-08T19:23:06.488243+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:06.487723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:06.487723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034218619999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:14.763837+0000","last_change":"2021-10-08T19:23:14.763360+0000","last_active":"2021-10-08T19:23:14.763837+0000","last_peered":"2021-10-08T19:23:14.763837+0000","last_clean":"2021-10-08T19:23:14.763837+0000","last_became_active":"2021-10-08T19:21:29.646242+0000","last_became_peered":"2021-10-08T19:21:29.646242+0000","last_unstale":"2021-10-08T19:23:14.763837+0000","last_undegraded":"2021-10-08T19:23:14.763837+0000","last_fullsized":"2021-10-08T19:23:14.763837+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:14.763280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:14.763280+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034824790000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.507506+0000","last_change":"2021-10-08T19:22:40.563324+0000","last_active":"2021-10-08T19:23:00.507506+0000","last_peered":"2021-10-08T19:23:00.507506+0000","last_clean":"2021-10-08T19:23:00.507506+0000","last_became_active":"2021-10-08T19:21:23.608665+0000","last_became_peered":"2021-10-08T19:21:23.608665+0000","last_unstale":"2021-10-08T19:23:00.507506+0000","last_undegraded":"2021-10-08T19:23:00.507506+0000","last_fullsized":"2021-10-08T19:23:00.507506+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:40.563247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.563247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.024890005999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2021-10-08T19:23:22.620694+0000","last_change":"2021-10-08T19:23:22.620672+0000","last_active":"2021-10-08T19:23:22.620694+0000","last_peered":"2021-10-08T19:23:22.620694+0000","last_clean":"2021-10-08T19:23:22.620694+0000","last_became_active":"2021-10-08T19:21:23.599143+0000","last_became_peered":"2021-10-08T19:21:23.599143+0000","last_unstale":"2021-10-08T19:23:22.620694+0000","last_undegraded":"2021-10-08T19:23:22.620694+0000","last_fullsized":"2021-10-08T19:23:22.620694+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:22.620600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:22.620600+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003478133,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"73'128","reported_seq":292,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.194516+0000","last_change":"2021-10-08T19:22:13.939106+0000","last_active":"2021-10-08T19:23:00.194516+0000","last_peered":"2021-10-08T19:23:00.194516+0000","last_clean":"2021-10-08T19:23:00.194516+0000","last_became_active":"2021-10-08T19:21:19.594086+0000","last_became_peered":"2021-10-08T19:21:19.594086+0000","last_unstale":"2021-10-08T19:23:00.194516+0000","last_undegraded":"2021-10-08T19:23:00.194516+0000","last_fullsized":"2021-10-08T19:23:00.194516+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'128","last_scrub_stamp":"2021-10-08T19:22:13.939025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:19:44.414003+0000","last_clean_scrub_stamp":"2021-10-08T19:22:13.939025+0000","log_size":128,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020087920000000001,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"69'14","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.196910+0000","last_change":"2021-10-08T19:22:54.379424+0000","last_active":"2021-10-08T19:23:00.196910+0000","last_peered":"2021-10-08T19:23:00.196910+0000","last_clean":"2021-10-08T19:23:00.196910+0000","last_became_active":"2021-10-08T19:21:25.743499+0000","last_became_peered":"2021-10-08T19:21:25.743499+0000","last_unstale":"2021-10-08T19:23:00.196910+0000","last_undegraded":"2021-10-08T19:23:00.196910+0000","last_fullsized":"2021-10-08T19:23:00.196910+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'14","last_scrub_stamp":"2021-10-08T19:22:54.379349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:54.379349+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0021365989999999999,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:02.268070+0000","last_change":"2021-10-08T19:23:02.267580+0000","last_active":"2021-10-08T19:23:02.268070+0000","last_peered":"2021-10-08T19:23:02.268070+0000","last_clean":"2021-10-08T19:23:02.268070+0000","last_became_active":"2021-10-08T19:21:27.636086+0000","last_became_peered":"2021-10-08T19:21:27.636086+0000","last_unstale":"2021-10-08T19:23:02.268070+0000","last_undegraded":"2021-10-08T19:23:02.268070+0000","last_fullsized":"2021-10-08T19:23:02.268070+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:02.267508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:02.267508+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034499700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.251557+0000","last_change":"2021-10-08T19:22:55.234981+0000","last_active":"2021-10-08T19:23:00.251557+0000","last_peered":"2021-10-08T19:23:00.251557+0000","last_clean":"2021-10-08T19:23:00.251557+0000","last_became_active":"2021-10-08T19:21:29.648784+0000","last_became_peered":"2021-10-08T19:21:29.648784+0000","last_unstale":"2021-10-08T19:23:00.251557+0000","last_undegraded":"2021-10-08T19:23:00.251557+0000","last_fullsized":"2021-10-08T19:23:00.251557+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:55.234909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:55.234909+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0014461070000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:22:59.569127+0000","last_change":"2021-10-08T19:22:31.557761+0000","last_active":"2021-10-08T19:22:59.569127+0000","last_peered":"2021-10-08T19:22:59.569127+0000","last_clean":"2021-10-08T19:22:59.569127+0000","last_became_active":"2021-10-08T19:21:23.602857+0000","last_became_peered":"2021-10-08T19:21:23.602857+0000","last_unstale":"2021-10-08T19:22:59.569127+0000","last_undegraded":"2021-10-08T19:22:59.569127+0000","last_fullsized":"2021-10-08T19:22:59.569127+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:31.557650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:31.557650+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001454997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.194298+0000","last_change":"2021-10-08T19:22:32.922768+0000","last_active":"2021-10-08T19:23:00.194298+0000","last_peered":"2021-10-08T19:23:00.194298+0000","last_clean":"2021-10-08T19:23:00.194298+0000","last_became_active":"2021-10-08T19:21:23.606755+0000","last_became_peered":"2021-10-08T19:21:23.606755+0000","last_unstale":"2021-10-08T19:23:00.194298+0000","last_undegraded":"2021-10-08T19:23:00.194298+0000","last_fullsized":"2021-10-08T19:23:00.194298+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:32.922694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:32.922694+0000","last_clean_scrub_stamp":"2021-10-08T19:22:32.922694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001758531,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"69'12","reported_seq":59,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:22:59.570015+0000","last_change":"2021-10-08T19:22:55.639993+0000","last_active":"2021-10-08T19:22:59.570015+0000","last_peered":"2021-10-08T19:22:59.570015+0000","last_clean":"2021-10-08T19:22:59.570015+0000","last_became_active":"2021-10-08T19:21:25.610233+0000","last_became_peered":"2021-10-08T19:21:25.610233+0000","last_unstale":"2021-10-08T19:22:59.570015+0000","last_undegraded":"2021-10-08T19:22:59.570015+0000","last_fullsized":"2021-10-08T19:22:59.570015+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'12","last_scrub_stamp":"2021-10-08T19:22:55.639881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:55.639881+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0032422169999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:22:59.564153+0000","last_change":"2021-10-08T19:22:34.475012+0000","last_active":"2021-10-08T19:22:59.564153+0000","last_peered":"2021-10-08T19:22:59.564153+0000","last_clean":"2021-10-08T19:22:59.564153+0000","last_became_active":"2021-10-08T19:21:27.635800+0000","last_became_peered":"2021-10-08T19:21:27.635800+0000","last_unstale":"2021-10-08T19:22:59.564153+0000","last_undegraded":"2021-10-08T19:22:59.564153+0000","last_fullsized":"2021-10-08T19:22:59.564153+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:34.474918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:34.474918+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0037343509999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:06.155286+0000","last_change":"2021-10-08T19:23:06.155149+0000","last_active":"2021-10-08T19:23:06.155286+0000","last_peered":"2021-10-08T19:23:06.155286+0000","last_clean":"2021-10-08T19:23:06.155286+0000","last_became_active":"2021-10-08T19:21:29.679477+0000","last_became_peered":"2021-10-08T19:21:29.679477+0000","last_unstale":"2021-10-08T19:23:06.155286+0000","last_undegraded":"2021-10-08T19:23:06.155286+0000","last_fullsized":"2021-10-08T19:23:06.155286+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:06.155068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:06.155068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001436805,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"61'1","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.194146+0000","last_change":"2021-10-08T19:22:26.905589+0000","last_active":"2021-10-08T19:23:00.194146+0000","last_peered":"2021-10-08T19:23:00.194146+0000","last_clean":"2021-10-08T19:23:00.194146+0000","last_became_active":"2021-10-08T19:21:23.604258+0000","last_became_peered":"2021-10-08T19:21:23.604258+0000","last_unstale":"2021-10-08T19:23:00.194146+0000","last_undegraded":"2021-10-08T19:23:00.194146+0000","last_fullsized":"2021-10-08T19:23:00.194146+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'1","last_scrub_stamp":"2021-10-08T19:22:26.905517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:26.905517+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001822178,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"69'19","reported_seq":77,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:22:59.570319+0000","last_change":"2021-10-08T19:22:29.614784+0000","last_active":"2021-10-08T19:22:59.570319+0000","last_peered":"2021-10-08T19:22:59.570319+0000","last_clean":"2021-10-08T19:22:59.570319+0000","last_became_active":"2021-10-08T19:21:25.741812+0000","last_became_peered":"2021-10-08T19:21:25.741812+0000","last_unstale":"2021-10-08T19:22:59.570319+0000","last_undegraded":"2021-10-08T19:22:59.570319+0000","last_fullsized":"2021-10-08T19:22:59.570319+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'19","last_scrub_stamp":"2021-10-08T19:22:29.614706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:29.614706+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0024396359999999998,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.196592+0000","last_change":"2021-10-08T19:22:42.399514+0000","last_active":"2021-10-08T19:23:00.196592+0000","last_peered":"2021-10-08T19:23:00.196592+0000","last_clean":"2021-10-08T19:23:00.196592+0000","last_became_active":"2021-10-08T19:21:27.637846+0000","last_became_peered":"2021-10-08T19:21:27.637846+0000","last_unstale":"2021-10-08T19:23:00.196592+0000","last_undegraded":"2021-10-08T19:23:00.196592+0000","last_fullsized":"2021-10-08T19:23:00.196592+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:42.399412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:42.399412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0019951610000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.047331+0000","last_change":"2021-10-08T19:22:40.264230+0000","last_active":"2021-10-08T19:23:00.047331+0000","last_peered":"2021-10-08T19:23:00.047331+0000","last_clean":"2021-10-08T19:23:00.047331+0000","last_became_active":"2021-10-08T19:21:29.646491+0000","last_became_peered":"2021-10-08T19:21:29.646491+0000","last_unstale":"2021-10-08T19:23:00.047331+0000","last_undegraded":"2021-10-08T19:23:00.047331+0000","last_fullsized":"2021-10-08T19:23:00.047331+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:40.264110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.264110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003475845,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.251779+0000","last_change":"2021-10-08T19:22:41.187045+0000","last_active":"2021-10-08T19:23:00.251779+0000","last_peered":"2021-10-08T19:23:00.251779+0000","last_clean":"2021-10-08T19:23:00.251779+0000","last_became_active":"2021-10-08T19:21:23.607770+0000","last_became_peered":"2021-10-08T19:21:23.607770+0000","last_unstale":"2021-10-08T19:23:00.251779+0000","last_undegraded":"2021-10-08T19:23:00.251779+0000","last_fullsized":"2021-10-08T19:23:00.251779+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:41.186945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:41.186945+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0037557269999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"69'18","reported_seq":73,"reported_epoch":89,"state":"active+clean","last_fresh":"2021-10-08T19:23:20.405639+0000","last_change":"2021-10-08T19:23:20.405609+0000","last_active":"2021-10-08T19:23:20.405639+0000","last_peered":"2021-10-08T19:23:20.405639+0000","last_clean":"2021-10-08T19:23:20.405639+0000","last_became_active":"2021-10-08T19:21:25.742909+0000","last_became_peered":"2021-10-08T19:21:25.742909+0000","last_unstale":"2021-10-08T19:23:20.405639+0000","last_undegraded":"2021-10-08T19:23:20.405639+0000","last_fullsized":"2021-10-08T19:23:20.405639+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'18","last_scrub_stamp":"2021-10-08T19:23:20.405525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:20.405525+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039753820000000004,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.046547+0000","last_change":"2021-10-08T19:22:52.021819+0000","last_active":"2021-10-08T19:23:00.046547+0000","last_peered":"2021-10-08T19:23:00.046547+0000","last_clean":"2021-10-08T19:23:00.046547+0000","last_became_active":"2021-10-08T19:21:27.637547+0000","last_became_peered":"2021-10-08T19:21:27.637547+0000","last_unstale":"2021-10-08T19:23:00.046547+0000","last_undegraded":"2021-10-08T19:23:00.046547+0000","last_fullsized":"2021-10-08T19:23:00.046547+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:52.021733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:52.021733+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034012640000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:05.264064+0000","last_change":"2021-10-08T19:23:05.263582+0000","last_active":"2021-10-08T19:23:05.264064+0000","last_peered":"2021-10-08T19:23:05.264064+0000","last_clean":"2021-10-08T19:23:05.264064+0000","last_became_active":"2021-10-08T19:21:29.681295+0000","last_became_peered":"2021-10-08T19:21:29.681295+0000","last_unstale":"2021-10-08T19:23:05.264064+0000","last_undegraded":"2021-10-08T19:23:05.264064+0000","last_fullsized":"2021-10-08T19:23:05.264064+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:05.263508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:05.263508+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034369000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.196200+0000","last_change":"2021-10-08T19:22:49.391329+0000","last_active":"2021-10-08T19:23:00.196200+0000","last_peered":"2021-10-08T19:23:00.196200+0000","last_clean":"2021-10-08T19:23:00.196200+0000","last_became_active":"2021-10-08T19:21:23.606848+0000","last_became_peered":"2021-10-08T19:21:23.606848+0000","last_unstale":"2021-10-08T19:23:00.196200+0000","last_undegraded":"2021-10-08T19:23:00.196200+0000","last_fullsized":"2021-10-08T19:23:00.196200+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:49.391258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:49.391258+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0014044610000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"69'14","reported_seq":62,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.046416+0000","last_change":"2021-10-08T19:22:26.321058+0000","last_active":"2021-10-08T19:23:00.046416+0000","last_peered":"2021-10-08T19:23:00.046416+0000","last_clean":"2021-10-08T19:23:00.046416+0000","last_became_active":"2021-10-08T19:21:25.613140+0000","last_became_peered":"2021-10-08T19:21:25.613140+0000","last_unstale":"2021-10-08T19:23:00.046416+0000","last_undegraded":"2021-10-08T19:23:00.046416+0000","last_fullsized":"2021-10-08T19:23:00.046416+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'14","last_scrub_stamp":"2021-10-08T19:22:26.320928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:26.320928+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0048335899999999996,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"69'8","reported_seq":65,"reported_epoch":89,"state":"active+clean","last_fresh":"2021-10-08T19:23:17.910279+0000","last_change":"2021-10-08T19:21:27.641064+0000","last_active":"2021-10-08T19:23:17.910279+0000","last_peered":"2021-10-08T19:23:17.910279+0000","last_clean":"2021-10-08T19:23:17.910279+0000","last_became_active":"2021-10-08T19:21:27.640694+0000","last_became_peered":"2021-10-08T19:21:27.640694+0000","last_unstale":"2021-10-08T19:23:17.910279+0000","last_undegraded":"2021-10-08T19:23:17.910279+0000","last_fullsized":"2021-10-08T19:23:17.910279+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:21:26.604244+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:17.422728+0000","last_change":"2021-10-08T19:23:17.422256+0000","last_active":"2021-10-08T19:23:17.422728+0000","last_peered":"2021-10-08T19:23:17.422728+0000","last_clean":"2021-10-08T19:23:17.422728+0000","last_became_active":"2021-10-08T19:21:29.679295+0000","last_became_peered":"2021-10-08T19:21:29.679295+0000","last_unstale":"2021-10-08T19:23:17.422728+0000","last_undegraded":"2021-10-08T19:23:17.422728+0000","last_fullsized":"2021-10-08T19:23:17.422728+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:17.422176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:17.422176+0000","last_clean_scrub_stamp":"2021-10-08T19:23:17.422176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0036221249999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:17.689869+0000","last_change":"2021-10-08T19:23:17.689386+0000","last_active":"2021-10-08T19:23:17.689869+0000","last_peered":"2021-10-08T19:23:17.689869+0000","last_clean":"2021-10-08T19:23:17.689869+0000","last_became_active":"2021-10-08T19:21:27.637547+0000","last_became_peered":"2021-10-08T19:21:27.637547+0000","last_unstale":"2021-10-08T19:23:17.689869+0000","last_undegraded":"2021-10-08T19:23:17.689869+0000","last_fullsized":"2021-10-08T19:23:17.689869+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:17.689312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:17.689312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0033939769999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.194005+0000","last_change":"2021-10-08T19:22:29.954439+0000","last_active":"2021-10-08T19:23:00.194005+0000","last_peered":"2021-10-08T19:23:00.194005+0000","last_clean":"2021-10-08T19:23:00.194005+0000","last_became_active":"2021-10-08T19:21:23.606597+0000","last_became_peered":"2021-10-08T19:21:23.606597+0000","last_unstale":"2021-10-08T19:23:00.194005+0000","last_undegraded":"2021-10-08T19:23:00.194005+0000","last_fullsized":"2021-10-08T19:23:00.194005+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:29.954337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:29.954337+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0018351859999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"69'11","reported_seq":60,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:01.988602+0000","last_change":"2021-10-08T19:23:01.988442+0000","last_active":"2021-10-08T19:23:01.988602+0000","last_peered":"2021-10-08T19:23:01.988602+0000","last_clean":"2021-10-08T19:23:01.988602+0000","last_became_active":"2021-10-08T19:21:25.609211+0000","last_became_peered":"2021-10-08T19:21:25.609211+0000","last_unstale":"2021-10-08T19:23:01.988602+0000","last_undegraded":"2021-10-08T19:23:01.988602+0000","last_fullsized":"2021-10-08T19:23:01.988602+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'11","last_scrub_stamp":"2021-10-08T19:23:01.988336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:01.988336+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0026768489999999998,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:22:59.563597+0000","last_change":"2021-10-08T19:22:49.530669+0000","last_active":"2021-10-08T19:22:59.563597+0000","last_peered":"2021-10-08T19:22:59.563597+0000","last_clean":"2021-10-08T19:22:59.563597+0000","last_became_active":"2021-10-08T19:21:29.639358+0000","last_became_peered":"2021-10-08T19:21:29.639358+0000","last_unstale":"2021-10-08T19:22:59.563597+0000","last_undegraded":"2021-10-08T19:22:59.563597+0000","last_fullsized":"2021-10-08T19:22:59.563597+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:49.530586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:49.530586+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0036198910000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"88'9","reported_seq":75,"reported_epoch":89,"state":"active+clean","last_fresh":"2021-10-08T19:23:17.745923+0000","last_change":"2021-10-08T19:23:00.048324+0000","last_active":"2021-10-08T19:23:17.745923+0000","last_peered":"2021-10-08T19:23:17.745923+0000","last_clean":"2021-10-08T19:23:17.745923+0000","last_became_active":"2021-10-08T19:21:27.636432+0000","last_became_peered":"2021-10-08T19:21:27.636432+0000","last_unstale":"2021-10-08T19:23:17.745923+0000","last_undegraded":"2021-10-08T19:23:17.745923+0000","last_fullsized":"2021-10-08T19:23:17.745923+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'9","last_scrub_stamp":"2021-10-08T19:23:00.048245+0000","last_deep_scrub":"88'9","last_deep_scrub_stamp":"2021-10-08T19:23:00.048245+0000","last_clean_scrub_stamp":"2021-10-08T19:23:00.048245+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0031661179999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.251317+0000","last_change":"2021-10-08T19:22:27.212471+0000","last_active":"2021-10-08T19:23:00.251317+0000","last_peered":"2021-10-08T19:23:00.251317+0000","last_clean":"2021-10-08T19:23:00.251317+0000","last_became_active":"2021-10-08T19:21:23.603264+0000","last_became_peered":"2021-10-08T19:21:23.603264+0000","last_unstale":"2021-10-08T19:23:00.251317+0000","last_undegraded":"2021-10-08T19:23:00.251317+0000","last_fullsized":"2021-10-08T19:23:00.251317+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:27.212397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:27.212397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0013817009999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"69'15","reported_seq":66,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.251722+0000","last_change":"2021-10-08T19:22:56.213566+0000","last_active":"2021-10-08T19:23:00.251722+0000","last_peered":"2021-10-08T19:23:00.251722+0000","last_clean":"2021-10-08T19:23:00.251722+0000","last_became_active":"2021-10-08T19:21:25.617776+0000","last_became_peered":"2021-10-08T19:21:25.617776+0000","last_unstale":"2021-10-08T19:23:00.251722+0000","last_undegraded":"2021-10-08T19:23:00.251722+0000","last_fullsized":"2021-10-08T19:23:00.251722+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'15","last_scrub_stamp":"2021-10-08T19:22:56.213493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:56.213493+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039771219999999996,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.046870+0000","last_change":"2021-10-08T19:22:37.292691+0000","last_active":"2021-10-08T19:23:00.046870+0000","last_peered":"2021-10-08T19:23:00.046870+0000","last_clean":"2021-10-08T19:23:00.046870+0000","last_became_active":"2021-10-08T19:21:29.640249+0000","last_became_peered":"2021-10-08T19:21:29.640249+0000","last_unstale":"2021-10-08T19:23:00.046870+0000","last_undegraded":"2021-10-08T19:23:00.046870+0000","last_fullsized":"2021-10-08T19:23:00.046870+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:37.292621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:37.292621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001513517,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"69'8","reported_seq":71,"reported_epoch":89,"state":"active+clean","last_fresh":"2021-10-08T19:23:17.747340+0000","last_change":"2021-10-08T19:23:00.384891+0000","last_active":"2021-10-08T19:23:17.747340+0000","last_peered":"2021-10-08T19:23:17.747340+0000","last_clean":"2021-10-08T19:23:17.747340+0000","last_became_active":"2021-10-08T19:21:27.637930+0000","last_became_peered":"2021-10-08T19:21:27.637930+0000","last_unstale":"2021-10-08T19:23:17.747340+0000","last_undegraded":"2021-10-08T19:23:17.747340+0000","last_fullsized":"2021-10-08T19:23:17.747340+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'8","last_scrub_stamp":"2021-10-08T19:23:00.384808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:00.384808+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040307110000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.251395+0000","last_change":"2021-10-08T19:22:29.177318+0000","last_active":"2021-10-08T19:23:00.251395+0000","last_peered":"2021-10-08T19:23:00.251395+0000","last_clean":"2021-10-08T19:23:00.251395+0000","last_became_active":"2021-10-08T19:21:23.603207+0000","last_became_peered":"2021-10-08T19:21:23.603207+0000","last_unstale":"2021-10-08T19:23:00.251395+0000","last_undegraded":"2021-10-08T19:23:00.251395+0000","last_fullsized":"2021-10-08T19:23:00.251395+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:29.177157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:29.177157+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020581419999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"69'10","reported_seq":56,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.046686+0000","last_change":"2021-10-08T19:22:35.356371+0000","last_active":"2021-10-08T19:23:00.046686+0000","last_peered":"2021-10-08T19:23:00.046686+0000","last_clean":"2021-10-08T19:23:00.046686+0000","last_became_active":"2021-10-08T19:21:25.613155+0000","last_became_peered":"2021-10-08T19:21:25.613155+0000","last_unstale":"2021-10-08T19:23:00.046686+0000","last_undegraded":"2021-10-08T19:23:00.046686+0000","last_fullsized":"2021-10-08T19:23:00.046686+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'10","last_scrub_stamp":"2021-10-08T19:22:35.356292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:35.356292+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040689319999999999,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:10.377559+0000","last_change":"2021-10-08T19:23:10.377105+0000","last_active":"2021-10-08T19:23:10.377559+0000","last_peered":"2021-10-08T19:23:10.377559+0000","last_clean":"2021-10-08T19:23:10.377559+0000","last_became_active":"2021-10-08T19:21:29.646455+0000","last_became_peered":"2021-10-08T19:21:29.646455+0000","last_unstale":"2021-10-08T19:23:10.377559+0000","last_undegraded":"2021-10-08T19:23:10.377559+0000","last_fullsized":"2021-10-08T19:23:10.377559+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:10.377024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:10.377024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0035706969999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.251638+0000","last_change":"2021-10-08T19:22:35.110008+0000","last_active":"2021-10-08T19:23:00.251638+0000","last_peered":"2021-10-08T19:23:00.251638+0000","last_clean":"2021-10-08T19:23:00.251638+0000","last_became_active":"2021-10-08T19:21:27.636429+0000","last_became_peered":"2021-10-08T19:21:27.636429+0000","last_unstale":"2021-10-08T19:23:00.251638+0000","last_undegraded":"2021-10-08T19:23:00.251638+0000","last_fullsized":"2021-10-08T19:23:00.251638+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:35.109928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:35.109928+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001854304,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"61'1","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.194108+0000","last_change":"2021-10-08T19:22:55.080106+0000","last_active":"2021-10-08T19:23:00.194108+0000","last_peered":"2021-10-08T19:23:00.194108+0000","last_clean":"2021-10-08T19:23:00.194108+0000","last_became_active":"2021-10-08T19:21:23.607064+0000","last_became_peered":"2021-10-08T19:21:23.607064+0000","last_unstale":"2021-10-08T19:23:00.194108+0000","last_undegraded":"2021-10-08T19:23:00.194108+0000","last_fullsized":"2021-10-08T19:23:00.194108+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'1","last_scrub_stamp":"2021-10-08T19:22:55.080028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:55.080028+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040037620000000001,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"69'17","reported_seq":69,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.046945+0000","last_change":"2021-10-08T19:22:47.109498+0000","last_active":"2021-10-08T19:23:00.046945+0000","last_peered":"2021-10-08T19:23:00.046945+0000","last_clean":"2021-10-08T19:23:00.046945+0000","last_became_active":"2021-10-08T19:21:25.609086+0000","last_became_peered":"2021-10-08T19:21:25.609086+0000","last_unstale":"2021-10-08T19:23:00.046945+0000","last_undegraded":"2021-10-08T19:23:00.046945+0000","last_fullsized":"2021-10-08T19:23:00.046945+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'17","last_scrub_stamp":"2021-10-08T19:22:47.109407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:47.109407+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0025026100000000002,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:03.272791+0000","last_change":"2021-10-08T19:23:03.272654+0000","last_active":"2021-10-08T19:23:03.272791+0000","last_peered":"2021-10-08T19:23:03.272791+0000","last_clean":"2021-10-08T19:23:03.272791+0000","last_became_active":"2021-10-08T19:21:29.648922+0000","last_became_peered":"2021-10-08T19:21:29.648922+0000","last_unstale":"2021-10-08T19:23:03.272791+0000","last_undegraded":"2021-10-08T19:23:03.272791+0000","last_fullsized":"2021-10-08T19:23:03.272791+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:03.272581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:03.272581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001525874,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:09.420055+0000","last_change":"2021-10-08T19:23:09.419579+0000","last_active":"2021-10-08T19:23:09.420055+0000","last_peered":"2021-10-08T19:23:09.420055+0000","last_clean":"2021-10-08T19:23:09.420055+0000","last_became_active":"2021-10-08T19:21:27.638583+0000","last_became_peered":"2021-10-08T19:21:27.638583+0000","last_unstale":"2021-10-08T19:23:09.420055+0000","last_undegraded":"2021-10-08T19:23:09.420055+0000","last_fullsized":"2021-10-08T19:23:09.420055+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:09.419493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:09.419493+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003406498,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:22:59.569496+0000","last_change":"2021-10-08T19:22:57.380012+0000","last_active":"2021-10-08T19:22:59.569496+0000","last_peered":"2021-10-08T19:22:59.569496+0000","last_clean":"2021-10-08T19:22:59.569496+0000","last_became_active":"2021-10-08T19:21:23.595919+0000","last_became_peered":"2021-10-08T19:21:23.595919+0000","last_unstale":"2021-10-08T19:22:59.569496+0000","last_undegraded":"2021-10-08T19:22:59.569496+0000","last_fullsized":"2021-10-08T19:22:59.569496+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:57.379935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:57.379935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034209349999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"69'19","reported_seq":72,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.196536+0000","last_change":"2021-10-08T19:22:39.356624+0000","last_active":"2021-10-08T19:23:00.196536+0000","last_peered":"2021-10-08T19:23:00.196536+0000","last_clean":"2021-10-08T19:23:00.196536+0000","last_became_active":"2021-10-08T19:21:25.741945+0000","last_became_peered":"2021-10-08T19:21:25.741945+0000","last_unstale":"2021-10-08T19:23:00.196536+0000","last_undegraded":"2021-10-08T19:23:00.196536+0000","last_fullsized":"2021-10-08T19:23:00.196536+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'19","last_scrub_stamp":"2021-10-08T19:22:39.356508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:39.356508+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0030817370000000002,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:22:59.568813+0000","last_change":"2021-10-08T19:22:57.644734+0000","last_active":"2021-10-08T19:22:59.568813+0000","last_peered":"2021-10-08T19:22:59.568813+0000","last_clean":"2021-10-08T19:22:59.568813+0000","last_became_active":"2021-10-08T19:21:29.643022+0000","last_became_peered":"2021-10-08T19:21:29.643022+0000","last_unstale":"2021-10-08T19:22:59.568813+0000","last_undegraded":"2021-10-08T19:22:59.568813+0000","last_fullsized":"2021-10-08T19:22:59.568813+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:57.644627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:57.644627+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002174952,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:22:59.569016+0000","last_change":"2021-10-08T19:22:42.359224+0000","last_active":"2021-10-08T19:22:59.569016+0000","last_peered":"2021-10-08T19:22:59.569016+0000","last_clean":"2021-10-08T19:22:59.569016+0000","last_became_active":"2021-10-08T19:21:27.635310+0000","last_became_peered":"2021-10-08T19:21:27.635310+0000","last_unstale":"2021-10-08T19:22:59.569016+0000","last_undegraded":"2021-10-08T19:22:59.569016+0000","last_fullsized":"2021-10-08T19:22:59.569016+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:42.359130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:42.359130+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001847357,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:11.176650+0000","last_change":"2021-10-08T19:23:11.176225+0000","last_active":"2021-10-08T19:23:11.176650+0000","last_peered":"2021-10-08T19:23:11.176650+0000","last_clean":"2021-10-08T19:23:11.176650+0000","last_became_active":"2021-10-08T19:21:23.607639+0000","last_became_peered":"2021-10-08T19:21:23.607639+0000","last_unstale":"2021-10-08T19:23:11.176650+0000","last_undegraded":"2021-10-08T19:23:11.176650+0000","last_fullsized":"2021-10-08T19:23:11.176650+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:11.176122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:11.176122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040114119999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"69'9","reported_seq":57,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:22:59.570012+0000","last_change":"2021-10-08T19:22:36.590210+0000","last_active":"2021-10-08T19:22:59.570012+0000","last_peered":"2021-10-08T19:22:59.570012+0000","last_clean":"2021-10-08T19:22:59.570012+0000","last_became_active":"2021-10-08T19:21:25.610072+0000","last_became_peered":"2021-10-08T19:21:25.610072+0000","last_unstale":"2021-10-08T19:22:59.570012+0000","last_undegraded":"2021-10-08T19:22:59.570012+0000","last_fullsized":"2021-10-08T19:22:59.570012+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'9","last_scrub_stamp":"2021-10-08T19:22:36.590071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:36.590071+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0026030699999999999,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:10.805244+0000","last_change":"2021-10-08T19:23:10.805144+0000","last_active":"2021-10-08T19:23:10.805244+0000","last_peered":"2021-10-08T19:23:10.805244+0000","last_clean":"2021-10-08T19:23:10.805244+0000","last_became_active":"2021-10-08T19:21:29.679264+0000","last_became_peered":"2021-10-08T19:21:29.679264+0000","last_unstale":"2021-10-08T19:23:10.805244+0000","last_undegraded":"2021-10-08T19:23:10.805244+0000","last_fullsized":"2021-10-08T19:23:10.805244+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:10.805052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:10.805052+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.00168849,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:22:59.569072+0000","last_change":"2021-10-08T19:22:34.484570+0000","last_active":"2021-10-08T19:22:59.569072+0000","last_peered":"2021-10-08T19:22:59.569072+0000","last_clean":"2021-10-08T19:22:59.569072+0000","last_became_active":"2021-10-08T19:21:23.600352+0000","last_became_peered":"2021-10-08T19:21:23.600352+0000","last_unstale":"2021-10-08T19:22:59.569072+0000","last_undegraded":"2021-10-08T19:22:59.569072+0000","last_fullsized":"2021-10-08T19:22:59.569072+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:34.484488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:34.484488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034565799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"87'22","reported_seq":73,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:22:59.563372+0000","last_change":"2021-10-08T19:22:58.705708+0000","last_active":"2021-10-08T19:22:59.563372+0000","last_peered":"2021-10-08T19:22:59.563372+0000","last_clean":"2021-10-08T19:22:59.563372+0000","last_became_active":"2021-10-08T19:21:25.741675+0000","last_became_peered":"2021-10-08T19:21:25.741675+0000","last_unstale":"2021-10-08T19:22:59.563372+0000","last_undegraded":"2021-10-08T19:22:59.563372+0000","last_fullsized":"2021-10-08T19:22:59.563372+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'22","last_scrub_stamp":"2021-10-08T19:22:58.705632+0000","last_deep_scrub":"87'22","last_deep_scrub_stamp":"2021-10-08T19:22:58.705632+0000","last_clean_scrub_stamp":"2021-10-08T19:22:58.705632+0000","log_size":22,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0051832670000000001,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"69'8","reported_seq":71,"reported_epoch":89,"state":"active+clean","last_fresh":"2021-10-08T19:23:17.911239+0000","last_change":"2021-10-08T19:22:51.066026+0000","last_active":"2021-10-08T19:23:17.911239+0000","last_peered":"2021-10-08T19:23:17.911239+0000","last_clean":"2021-10-08T19:23:17.911239+0000","last_became_active":"2021-10-08T19:21:27.637056+0000","last_became_peered":"2021-10-08T19:21:27.637056+0000","last_unstale":"2021-10-08T19:23:17.911239+0000","last_undegraded":"2021-10-08T19:23:17.911239+0000","last_fullsized":"2021-10-08T19:23:17.911239+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'8","last_scrub_stamp":"2021-10-08T19:22:51.065949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:51.065949+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020224639999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":65,"ondisk_log_size":65,"up":96,"acting":96,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":698,"num_read_kb":455,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":406,"ondisk_log_size":406,"up":96,"acting":96,"num_store_stats":8},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":113,"num_read_kb":108,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201308,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6908,"kb_used_data":1204,"kb_used_omap":0,"kb_used_meta":5696,"kb_avail":93738244,"statfs":{"total":95995035648,"available":95987961856,"internally_reserved":0,"allocated":1232896,"data_stored":885477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5832704},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:23:16 2021","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.46100000000000002,"15min":0.46600000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.69599999999999995,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.622},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.48799999999999999,"15min":0.47699999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":2.5960000000000001,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":0.46600000000000003}]},{"osd":1,"last update":"Fri Oct 8 19:23:16 2021","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.48199999999999998,"15min":0.49099999999999999},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.44},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.52300000000000002,"15min":0.51500000000000001},"min":{"1min":0.30599999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":2.6640000000000001,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.57799999999999996}]},{"osd":2,"last update":"Fri Oct 8 19:23:16 2021","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.48599999999999999,"15min":0.48799999999999999},"min":{"1min":0.313,"5min":0.308,"15min":0.308},"max":{"1min":0.65800000000000003,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.46999999999999997,"15min":0.47399999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.67700000000000005,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.51600000000000001}]},{"osd":3,"last update":"Fri Oct 8 19:23:16 2021","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.48199999999999998,"15min":0.48799999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.70499999999999996,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.52900000000000003,"15min":0.51500000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":2.6299999999999999,"5min":2.6299999999999999,"15min":2.6299999999999999},"last":0.60499999999999998}]},{"osd":4,"last update":"Fri Oct 8 19:23:16 2021","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.46600000000000003,"15min":0.47099999999999997},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.65500000000000003,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45000000000000001,"15min":0.44900000000000001},"min":{"1min":0.313,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68700000000000006,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.38}]},{"osd":5,"last update":"Fri Oct 8 19:23:16 2021","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.47299999999999998,"15min":0.47499999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.65500000000000003,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.50700000000000001,"15min":0.51000000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.73399999999999999,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.34999999999999998}]},{"osd":6,"last update":"Fri Oct 8 19:23:16 2021","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.53300000000000003,"15min":0.51500000000000001},"min":{"1min":0.36499999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":2.4550000000000001,"5min":2.4550000000000001,"15min":2.4550000000000001},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.37,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.36499999999999999}]}]},{"osd":6,"up_from":47,"seq":201863462944,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6880,"kb_used_data":1176,"kb_used_omap":0,"kb_used_meta":5696,"kb_avail":93738272,"statfs":{"total":95995035648,"available":95987990528,"internally_reserved":0,"allocated":1204224,"data_stored":883631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5832704},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:22:56 2021","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.45700000000000002,"15min":0.46400000000000002},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.59099999999999997,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.48699999999999999,"15min":0.49299999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.40200000000000002}]},{"osd":1,"last update":"Fri Oct 8 19:22:56 2021","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.499,"15min":0.504},"min":{"1min":0.34699999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.69799999999999995,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.378},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.39000000000000001}]},{"osd":2,"last update":"Fri Oct 8 19:22:56 2021","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.51600000000000001,"15min":0.52000000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.48399999999999999,"15min":0.48899999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.66600000000000004,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.44500000000000001}]},{"osd":3,"last update":"Fri Oct 8 19:22:56 2021","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.48199999999999998,"15min":0.48799999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.64800000000000002,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.502,"5min":0.501,"15min":0.501},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.44800000000000001}]},{"osd":4,"last update":"Fri Oct 8 19:22:56 2021","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40999999999999998,"15min":0.41199999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.59099999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.433,"5min":0.44500000000000001,"15min":0.44700000000000001},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.56499999999999995,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.40899999999999997}]},{"osd":5,"last update":"Fri Oct 8 19:22:56 2021","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.46700000000000003,"15min":0.46899999999999997},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.67600000000000005,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.436}]},{"osd":7,"last update":"Fri Oct 8 19:23:18 2021","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.49199999999999999,"15min":0.49399999999999999},"min":{"1min":0.32500000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.53300000000000003,"15min":0.54000000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.67600000000000005,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.54200000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":11340,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":10688,"kb_avail":93733812,"statfs":{"total":95995035648,"available":95983423488,"internally_reserved":0,"allocated":659456,"data_stored":294573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":10944512},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:22:30 2021","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.33400000000000002,"15min":0.32900000000000001},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.432,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.309},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.36199999999999999,"15min":0.35999999999999999},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.53400000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.315}]},{"osd":2,"last update":"Fri Oct 8 19:22:52 2021","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.38300000000000001,"15min":0.39400000000000002},"min":{"1min":0.25600000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.53900000000000003,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.42799999999999999,"15min":0.42399999999999999},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.34699999999999998}]},{"osd":3,"last update":"Fri Oct 8 19:23:10 2021","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.438,"15min":0.46000000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.56399999999999995,"5min":0.748,"15min":0.748},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.42799999999999999,"15min":0.45000000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.502,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.34100000000000003}]},{"osd":4,"last update":"Fri Oct 8 19:23:23 2021","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.50600000000000001,"15min":0.51200000000000001},"min":{"1min":0.34699999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.52600000000000002,"15min":0.53500000000000003},"min":{"1min":0.371,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.70599999999999996,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.439}]},{"osd":5,"last update":"Fri Oct 8 19:22:42 2021","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.55200000000000005,"15min":0.56000000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73899999999999999,"5min":0.754,"15min":0.754},"last":0.502},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55700000000000005,"15min":0.55800000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.52000000000000002}]},{"osd":6,"last update":"Fri Oct 8 19:23:00 2021","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53400000000000003,"15min":0.53700000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.64300000000000002,"15min":0.66300000000000003},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.77000000000000002,"5min":2.5219999999999998,"15min":2.5219999999999998},"last":0.53400000000000003}]},{"osd":7,"last update":"Fri Oct 8 19:23:23 2021","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.56200000000000006,"15min":0.56599999999999995},"min":{"1min":0.38900000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.73699999999999999,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.56299999999999994,"15min":0.57099999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.68300000000000005,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.49099999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738422,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7668,"kb_used_data":1196,"kb_used_omap":0,"kb_used_meta":6464,"kb_avail":93737484,"statfs":{"total":95995035648,"available":95987183616,"internally_reserved":0,"allocated":1224704,"data_stored":884036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6619136},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 8 19:22:32 2021","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":0.33000000000000002,"15min":0.32800000000000001},"min":{"1min":0.21199999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.45000000000000001,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.379,"15min":0.371},"min":{"1min":0.25,"5min":0.219,"15min":0.219},"max":{"1min":0.44900000000000001,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.42999999999999999}]},{"osd":2,"last update":"Fri Oct 8 19:22:53 2021","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.38900000000000001,"15min":0.39400000000000002},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.54900000000000004,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.38800000000000001,"15min":0.39600000000000002},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.51900000000000002,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.27800000000000002}]},{"osd":3,"last update":"Fri Oct 8 19:23:05 2021","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.45200000000000001,"15min":0.48299999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.56599999999999995,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.42799999999999999,"15min":0.45200000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.53500000000000003,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.317}]},{"osd":4,"last update":"Fri Oct 8 19:22:23 2021","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.54000000000000004,"15min":0.54300000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.77500000000000002,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.57099999999999995,"15min":0.57899999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.68300000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.55500000000000005}]},{"osd":5,"last update":"Fri Oct 8 19:22:40 2021","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.54700000000000004,"15min":0.55100000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72899999999999998,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.749,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.56000000000000005}]},{"osd":6,"last update":"Fri Oct 8 19:22:59 2021","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.58099999999999996,"15min":0.57899999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.56999999999999995}]},{"osd":7,"last update":"Fri Oct 8 19:23:16 2021","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57699999999999996,"15min":0.57499999999999996},"min":{"1min":0.40799999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.57599999999999996}]}]},{"osd":2,"up_from":18,"seq":77309411374,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6952,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":6336,"kb_avail":93738200,"statfs":{"total":95995035648,"available":95987916800,"internally_reserved":0,"allocated":622592,"data_stored":293939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6488064},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:22:46 2021","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.34200000000000003,"15min":0.34399999999999997},"min":{"1min":0.193,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.371,"5min":0.36599999999999999,"15min":0.35999999999999999},"min":{"1min":0.25800000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.34899999999999998}]},{"osd":1,"last update":"Fri Oct 8 19:22:46 2021","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.36099999999999999,"15min":0.36299999999999999},"min":{"1min":0.24399999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.53900000000000003,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.313},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.40699999999999997,"15min":0.39600000000000002},"min":{"1min":0.28000000000000003,"5min":0.218,"15min":0.218},"max":{"1min":2.2890000000000001,"5min":2.2890000000000001,"15min":2.2890000000000001},"last":0.37}]},{"osd":3,"last update":"Fri Oct 8 19:23:05 2021","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.41999999999999998,"15min":0.442},"min":{"1min":0.26800000000000002,"5min":0.218,"15min":0.218},"max":{"1min":0.50700000000000001,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.40300000000000002,"15min":0.41499999999999998},"min":{"1min":0.248,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.45600000000000002,"5min":0.625,"15min":0.625},"last":0.34000000000000002}]},{"osd":4,"last update":"Fri Oct 8 19:23:21 2021","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.52900000000000003,"15min":0.54600000000000004},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.65400000000000003,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.442},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56299999999999994,"15min":0.57399999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.70699999999999996,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.55300000000000005}]},{"osd":5,"last update":"Fri Oct 8 19:22:40 2021","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.56999999999999995,"15min":0.57599999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.433}]},{"osd":6,"last update":"Fri Oct 8 19:23:05 2021","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.55800000000000005,"15min":0.56499999999999995},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.74099999999999999,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.57899999999999996,"15min":0.58699999999999997},"min":{"1min":0.41699999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.66300000000000003,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.52600000000000002}]},{"osd":7,"last update":"Fri Oct 8 19:23:21 2021","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.55600000000000005,"15min":0.56399999999999995},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.71799999999999997,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.59099999999999997,"15min":0.59999999999999998},"min":{"1min":0.433,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.66200000000000003,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.46000000000000002}]}]},{"osd":3,"up_from":24,"seq":103079215148,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6528,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":5888,"kb_avail":93738624,"statfs":{"total":95995035648,"available":95988350976,"internally_reserved":0,"allocated":647168,"data_stored":294061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6029312},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:23:07 2021","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.34899999999999998,"15min":0.35099999999999998},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.61399999999999999,"5min":1.002,"15min":1.002},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.38200000000000001,"15min":0.39700000000000002},"min":{"1min":0.23000000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.27500000000000002}]},{"osd":1,"last update":"Fri Oct 8 19:23:07 2021","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.39000000000000001,"15min":0.40400000000000003},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.39100000000000001,"15min":0.40699999999999997},"min":{"1min":0.219,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.25800000000000001}]},{"osd":2,"last update":"Fri Oct 8 19:23:07 2021","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.41599999999999998,"15min":0.433},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.42599999999999999,"15min":0.42799999999999999},"min":{"1min":0.27000000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.94199999999999995,"5min":1.026,"15min":1.026},"last":0.30499999999999999}]},{"osd":4,"last update":"Fri Oct 8 19:22:23 2021","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58499999999999996,"15min":0.58599999999999997},"min":{"1min":0.38300000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.0549999999999999,"5min":2.0590000000000002,"15min":2.0590000000000002},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.76000000000000001,"15min":0.79300000000000004},"min":{"1min":0.38400000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.78900000000000003,"5min":3.4670000000000001,"15min":3.4670000000000001},"last":0.35099999999999998}]},{"osd":5,"last update":"Fri Oct 8 19:22:41 2021","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.57799999999999996,"15min":0.58599999999999997},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.746,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.69499999999999995,"15min":0.71599999999999997},"min":{"1min":0.432,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.996,"5min":3.4020000000000001,"15min":3.4020000000000001},"last":0.42299999999999999}]},{"osd":6,"last update":"Fri Oct 8 19:23:02 2021","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":1.5189999999999999,"15min":1.681},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.72899999999999998,"5min":21.538,"15min":21.538},"last":0.377},{"interface":"front","average":{"1min":0.503,"5min":0.55400000000000005,"15min":0.56200000000000006},"min":{"1min":0.377,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.69999999999999996,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.48099999999999998}]},{"osd":7,"last update":"Fri Oct 8 19:23:19 2021","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.58999999999999997,"15min":0.59999999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.66500000000000004,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.59999999999999998,"15min":0.61499999999999999},"min":{"1min":0.39900000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.71599999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.46500000000000002}]}]},{"osd":4,"up_from":30,"seq":128849018920,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6528,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":5888,"kb_avail":93738624,"statfs":{"total":95995035648,"available":95988350976,"internally_reserved":0,"allocated":647168,"data_stored":294973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6029312},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:22:22 2021","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.51900000000000002,"15min":0.52500000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.68500000000000005,"5min":0.755,"15min":0.755},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.505,"5min":0.52100000000000002,"15min":0.52400000000000002},"min":{"1min":0.33300000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.38200000000000001}]},{"osd":1,"last update":"Fri Oct 8 19:22:22 2021","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.51200000000000001,"15min":0.51800000000000002},"min":{"1min":0.316,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.60399999999999998,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.498,"15min":0.505},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.51900000000000002}]},{"osd":2,"last update":"Fri Oct 8 19:22:22 2021","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.50800000000000001,"15min":0.51500000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.497},{"interface":"front","average":{"1min":0.495,"5min":0.52900000000000003,"15min":0.53500000000000003},"min":{"1min":0.33600000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.628,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.48799999999999999}]},{"osd":3,"last update":"Fri Oct 8 19:22:22 2021","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.51200000000000001,"15min":0.51900000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.628,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.52200000000000002,"15min":0.52700000000000002},"min":{"1min":0.376,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.66400000000000003,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.443}]},{"osd":5,"last update":"Fri Oct 8 19:22:43 2021","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.38700000000000001,"15min":0.378},"min":{"1min":0.30499999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.435,"5min":0.39400000000000002,"15min":0.38700000000000001},"min":{"1min":0.28899999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.53700000000000003}]},{"osd":6,"last update":"Fri Oct 8 19:23:00 2021","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.41199999999999998,"15min":0.40500000000000003},"min":{"1min":0.27900000000000003,"5min":0.252,"15min":0.252},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.42899999999999999,"15min":0.42299999999999999},"min":{"1min":0.30499999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.47299999999999998}]},{"osd":7,"last update":"Fri Oct 8 19:23:18 2021","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.47999999999999998,"15min":0.48199999999999998},"min":{"1min":0.33100000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.64500000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.49399999999999999,"15min":0.49199999999999999},"min":{"1min":0.35499999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.66800000000000004,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.52900000000000003}]}]},{"osd":5,"up_from":38,"seq":163208757282,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6308,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":5696,"kb_avail":93738844,"statfs":{"total":95995035648,"available":95988576256,"internally_reserved":0,"allocated":618496,"data_stored":293930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5832704},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:22:42 2021","interfaces":[{"interface":"back","average":{"1min":1.6399999999999999,"5min":0.70399999999999996,"15min":0.54800000000000004},"min":{"1min":0.27700000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":22.966999999999999,"5min":22.966999999999999,"15min":22.966999999999999},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.46300000000000002,"15min":0.46600000000000003},"min":{"1min":0.28499999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.68400000000000005,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.38100000000000001}]},{"osd":1,"last update":"Fri Oct 8 19:22:42 2021","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.48699999999999999,"15min":0.497},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.64900000000000002,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.499,"15min":0.50700000000000001},"min":{"1min":0.30399999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.69499999999999995,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.308}]},{"osd":2,"last update":"Fri Oct 8 19:22:42 2021","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.45900000000000002,"15min":0.46300000000000002},"min":{"1min":0.29999999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.54900000000000004,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.29699999999999999},{"interface":"front","average":{"1min":1.629,"5min":0.72499999999999998,"15min":0.57499999999999996},"min":{"1min":0.30099999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":23.073,"5min":23.073,"15min":23.073},"last":0.36899999999999999}]},{"osd":3,"last update":"Fri Oct 8 19:22:42 2021","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.47999999999999998,"15min":0.48599999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.66800000000000004,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.439,"5min":0.48299999999999998,"15min":0.48999999999999999},"min":{"1min":0.36499999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.64900000000000002,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.42699999999999999}]},{"osd":4,"last update":"Fri Oct 8 19:22:42 2021","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.26300000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.58499999999999996,"5min":0.626,"15min":0.626},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.439,"15min":0.432},"min":{"1min":0.371,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.623,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.45000000000000001}]},{"osd":6,"last update":"Fri Oct 8 19:22:58 2021","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.35599999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.495,"15min":0.497},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.60899999999999999,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.39600000000000002}]},{"osd":7,"last update":"Fri Oct 8 19:23:17 2021","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.5,"15min":0.504},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.55800000000000005,"15min":0.56999999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.64100000000000001,"5min":1.653,"15min":1.653},"last":0.442}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":2008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-10-08T19:23:25.424 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph pg dump --format=json 2021-10-08T19:23:25.574 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:25 smithi117 ceph-mon[34585]: 6.19 scrub ok 2021-10-08T19:23:25.575 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:25 smithi117 ceph-mon[34585]: pgmap v70: 132 pgs: 132 active+clean; 582 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:23:25.575 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:25 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:23:25.575 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:25 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:23:25.576 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:25 smithi117 ceph-mon[34585]: from='client.24724 v1:172.21.15.97:0/1132242763' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:23:25.704 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:23:25.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:25 smithi097 ceph-mon[32687]: 6.19 scrub ok 2021-10-08T19:23:25.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:25 smithi097 ceph-mon[32687]: pgmap v70: 132 pgs: 132 active+clean; 582 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:23:25.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:25 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:23:25.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:25 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:23:25.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:25 smithi097 ceph-mon[32687]: from='client.24724 v1:172.21.15.97:0/1132242763' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:23:25.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:25 smithi097 ceph-mon[41966]: 6.19 scrub ok 2021-10-08T19:23:25.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:25 smithi097 ceph-mon[41966]: pgmap v70: 132 pgs: 132 active+clean; 582 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:23:25.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:25 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:23:25.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:25 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:23:25.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:25 smithi097 ceph-mon[41966]: from='client.24724 v1:172.21.15.97:0/1132242763' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:23:25.906 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:25 smithi117 conmon[67121]: t=2021-10-08T19:23:25+0000 lvl=info msg="Executing migration" logger=migrator id="Update team_id column values in preferences" 2021-10-08T19:23:25.906 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:25 smithi117 conmon[67121]: t=2021-10-08T19:23:25+0000 lvl=info msg="Executing migration" logger=migrator id="create alert table v1" 2021-10-08T19:23:25.906 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:25 smithi117 conmon[67121]: t=2021-10-08T19:23:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert org_id & id " 2021-10-08T19:23:26.206 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:23:26 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:23:26.207 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:25 smithi117 conmon[67121]: t=2021-10-08T19:23:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert state" 2021-10-08T19:23:26.207 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:25 smithi117 conmon[67121]: t=2021-10-08T19:23:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert dashboard_id" 2021-10-08T19:23:26.208 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:26 smithi117 conmon[67121]: t=2021-10-08T19:23:26+0000 lvl=info msg="Executing migration" logger=migrator id="Create alert_rule_tag table v1" 2021-10-08T19:23:26.208 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:26 smithi117 conmon[67121]: t=2021-10-08T19:23:26+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_rule_tag.alert_id_tag_id" 2021-10-08T19:23:26.208 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:26 smithi117 conmon[67121]: t=2021-10-08T19:23:26+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification table v1" 2021-10-08T19:23:26.457 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:26 smithi117 ceph-mon[34585]: osdmap e90: 8 total, 8 up, 8 in 2021-10-08T19:23:26.458 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:26 smithi117 conmon[67121]: t=2021-10-08T19:23:26+0000 lvl=info msg="Executing migration" logger=migrator id="Add column is_default" 2021-10-08T19:23:26.459 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:26 smithi117 conmon[67121]: t=2021-10-08T19:23:26+0000 lvl=info msg="Executing migration" logger=migrator id="Add column frequency" 2021-10-08T19:23:26.459 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:26 smithi117 conmon[67121]: t=2021-10-08T19:23:26+0000 lvl=info msg="Executing migration" logger=migrator id="Add column send_reminder" 2021-10-08T19:23:26.459 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:26 smithi117 conmon[67121]: t=2021-10-08T19:23:26+0000 lvl=info msg="Executing migration" logger=migrator id="Add column disable_resolve_message" 2021-10-08T19:23:26.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:26 smithi097 ceph-mon[32687]: osdmap e90: 8 total, 8 up, 8 in 2021-10-08T19:23:26.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:26 smithi097 ceph-mon[41966]: osdmap e90: 8 total, 8 up, 8 in 2021-10-08T19:23:26.725 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:26 smithi117 conmon[67121]: t=2021-10-08T19:23:26+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification org_id & name" 2021-10-08T19:23:26.725 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:26 smithi117 conmon[67121]: t=2021-10-08T19:23:26+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert table charset" 2021-10-08T19:23:26.726 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:26 smithi117 conmon[67121]: t=2021-10-08T19:23:26+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert_notification table charset" 2021-10-08T19:23:26.726 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:26 smithi117 conmon[67121]: t=2021-10-08T19:23:26+0000 lvl=info msg="Executing migration" logger=migrator id="create notification_journal table v1" 2021-10-08T19:23:26.726 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:26 smithi117 conmon[67121]: t=2021-10-08T19:23:26+0000 lvl=info msg="Executing migration" logger=migrator id="add index notification_journal org_id & alert_id & notifier_id" 2021-10-08T19:23:27.156 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:26 smithi117 conmon[67121]: t=2021-10-08T19:23:26+0000 lvl=info msg="Executing migration" logger=migrator id="drop alert_notification_journal" 2021-10-08T19:23:27.156 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:26 smithi117 conmon[67121]: t=2021-10-08T19:23:26+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification_state table v1" 2021-10-08T19:23:27.156 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:26 smithi117 conmon[67121]: t=2021-10-08T19:23:26+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification_state org_id & alert_id & notifier_id" 2021-10-08T19:23:27.386 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:23:27.388 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2021-10-08T19:23:27.488 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:27 smithi117 ceph-mon[34585]: 6.6 scrub ok 2021-10-08T19:23:27.488 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:27 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:23:27.488 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:27 smithi117 ceph-mon[34585]: pgmap v72: 132 pgs: 132 active+clean; 582 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-10-08T19:23:27.489 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:27 smithi117 conmon[67121]: t=2021-10-08T19:23:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add for to alert table" 2021-10-08T19:23:27.489 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:27 smithi117 conmon[67121]: t=2021-10-08T19:23:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in alert_notification" 2021-10-08T19:23:27.489 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:27 smithi117 conmon[67121]: t=2021-10-08T19:23:27+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in alert_notification" 2021-10-08T19:23:27.719 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:27 smithi097 ceph-mon[41966]: 6.6 scrub ok 2021-10-08T19:23:27.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:27 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:23:27.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:27 smithi097 ceph-mon[41966]: pgmap v72: 132 pgs: 132 active+clean; 582 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-10-08T19:23:27.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:27 smithi097 ceph-mon[32687]: 6.6 scrub ok 2021-10-08T19:23:27.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:27 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:23:27.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:27 smithi097 ceph-mon[32687]: pgmap v72: 132 pgs: 132 active+clean; 582 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-10-08T19:23:27.739 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:23:27 smithi117 systemd[1]: Stopping Ceph prometheus.a for 1d01f6d6-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:23:27.740 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:23:27 smithi117 bash[68824]: Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-prometheus.a found: no such container 2021-10-08T19:23:27.740 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:27 smithi117 conmon[67121]: t=2021-10-08T19:23:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_notification_org_id_uid" 2021-10-08T19:23:27.740 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:27 smithi117 conmon[67121]: t=2021-10-08T19:23:27+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_name" 2021-10-08T19:23:27.741 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:27 smithi117 conmon[67121]: t=2021-10-08T19:23:27+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old annotation table v4" 2021-10-08T19:23:27.741 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:27 smithi117 conmon[67121]: t=2021-10-08T19:23:27+0000 lvl=info msg="Executing migration" logger=migrator id="create annotation table v5" 2021-10-08T19:23:27.914 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":72,"stamp":"2021-10-08T19:23:26.440242+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596164,"num_objects":194,"num_object_clones":0,"num_object_copies":582,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":1050,"num_read_kb":896,"num_write":607,"num_write_kb":2457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":1771434,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":610,"ondisk_log_size":610,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":396,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":59112,"kb_used_data":6696,"kb_used_omap":0,"kb_used_meta":52352,"kb_avail":749902104,"statfs":{"total":767960285184,"available":767899754496,"internally_reserved":0,"allocated":6856704,"data_stored":4124620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":53608448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.694141"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.507784+0000","last_change":"2021-10-08T19:22:33.411869+0000","last_active":"2021-10-08T19:23:00.507784+0000","last_peered":"2021-10-08T19:23:00.507784+0000","last_clean":"2021-10-08T19:23:00.507784+0000","last_became_active":"2021-10-08T19:21:29.681121+0000","last_became_peered":"2021-10-08T19:21:29.681121+0000","last_unstale":"2021-10-08T19:23:00.507784+0000","last_undegraded":"2021-10-08T19:23:00.507784+0000","last_fullsized":"2021-10-08T19:23:00.507784+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:33.411753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:33.411753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0038057030000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.046482+0000","last_change":"2021-10-08T19:22:34.356580+0000","last_active":"2021-10-08T19:23:00.046482+0000","last_peered":"2021-10-08T19:23:00.046482+0000","last_clean":"2021-10-08T19:23:00.046482+0000","last_became_active":"2021-10-08T19:21:27.636886+0000","last_became_peered":"2021-10-08T19:21:27.636886+0000","last_unstale":"2021-10-08T19:23:00.046482+0000","last_undegraded":"2021-10-08T19:23:00.046482+0000","last_fullsized":"2021-10-08T19:23:00.046482+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:34.356501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:34.356501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034783520000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:22:59.570151+0000","last_change":"2021-10-08T19:22:54.671364+0000","last_active":"2021-10-08T19:22:59.570151+0000","last_peered":"2021-10-08T19:22:59.570151+0000","last_clean":"2021-10-08T19:22:59.570151+0000","last_became_active":"2021-10-08T19:21:23.603422+0000","last_became_peered":"2021-10-08T19:21:23.603422+0000","last_unstale":"2021-10-08T19:22:59.570151+0000","last_undegraded":"2021-10-08T19:22:59.570151+0000","last_fullsized":"2021-10-08T19:22:59.570151+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:54.671289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:54.671289+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001752221,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"69'15","reported_seq":60,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.507980+0000","last_change":"2021-10-08T19:21:25.613266+0000","last_active":"2021-10-08T19:23:00.507980+0000","last_peered":"2021-10-08T19:23:00.507980+0000","last_clean":"2021-10-08T19:23:00.507980+0000","last_became_active":"2021-10-08T19:21:25.612873+0000","last_became_peered":"2021-10-08T19:21:25.612873+0000","last_unstale":"2021-10-08T19:23:00.507980+0000","last_undegraded":"2021-10-08T19:23:00.507980+0000","last_fullsized":"2021-10-08T19:23:00.507980+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:21:24.589054+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.047052+0000","last_change":"2021-10-08T19:22:50.032446+0000","last_active":"2021-10-08T19:23:00.047052+0000","last_peered":"2021-10-08T19:23:00.047052+0000","last_clean":"2021-10-08T19:23:00.047052+0000","last_became_active":"2021-10-08T19:21:29.639039+0000","last_became_peered":"2021-10-08T19:21:29.639039+0000","last_unstale":"2021-10-08T19:23:00.047052+0000","last_undegraded":"2021-10-08T19:23:00.047052+0000","last_fullsized":"2021-10-08T19:23:00.047052+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:50.032367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:50.032367+0000","last_clean_scrub_stamp":"2021-10-08T19:22:50.032367+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034102759999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:05.196469+0000","last_change":"2021-10-08T19:23:05.196328+0000","last_active":"2021-10-08T19:23:05.196469+0000","last_peered":"2021-10-08T19:23:05.196469+0000","last_clean":"2021-10-08T19:23:05.196469+0000","last_became_active":"2021-10-08T19:21:27.634883+0000","last_became_peered":"2021-10-08T19:21:27.634883+0000","last_unstale":"2021-10-08T19:23:05.196469+0000","last_undegraded":"2021-10-08T19:23:05.196469+0000","last_fullsized":"2021-10-08T19:23:05.196469+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:05.196252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:05.196252+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0016803230000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:14.443697+0000","last_change":"2021-10-08T19:23:14.443220+0000","last_active":"2021-10-08T19:23:14.443697+0000","last_peered":"2021-10-08T19:23:14.443697+0000","last_clean":"2021-10-08T19:23:14.443697+0000","last_became_active":"2021-10-08T19:21:23.598272+0000","last_became_peered":"2021-10-08T19:21:23.598272+0000","last_unstale":"2021-10-08T19:23:14.443697+0000","last_undegraded":"2021-10-08T19:23:14.443697+0000","last_fullsized":"2021-10-08T19:23:14.443697+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:14.443147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:14.443147+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003489631,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"88'13","reported_seq":80,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:16.017298+0000","last_change":"2021-10-08T19:23:16.016750+0000","last_active":"2021-10-08T19:23:16.017298+0000","last_peered":"2021-10-08T19:23:16.017298+0000","last_clean":"2021-10-08T19:23:16.017298+0000","last_became_active":"2021-10-08T19:22:43.936718+0000","last_became_peered":"2021-10-08T19:22:43.936718+0000","last_unstale":"2021-10-08T19:23:16.017298+0000","last_undegraded":"2021-10-08T19:23:16.017298+0000","last_fullsized":"2021-10-08T19:23:16.017298+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'13","last_scrub_stamp":"2021-10-08T19:23:16.016646+0000","last_deep_scrub":"88'13","last_deep_scrub_stamp":"2021-10-08T19:23:16.016646+0000","last_clean_scrub_stamp":"2021-10-08T19:23:16.016646+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0052093469999999996,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:22:59.563336+0000","last_change":"2021-10-08T19:21:29.649955+0000","last_active":"2021-10-08T19:22:59.563336+0000","last_peered":"2021-10-08T19:22:59.563336+0000","last_clean":"2021-10-08T19:22:59.563336+0000","last_became_active":"2021-10-08T19:21:29.649640+0000","last_became_peered":"2021-10-08T19:21:29.649640+0000","last_unstale":"2021-10-08T19:22:59.563336+0000","last_undegraded":"2021-10-08T19:22:59.563336+0000","last_fullsized":"2021-10-08T19:22:59.563336+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:21:28.621762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.194682+0000","last_change":"2021-10-08T19:22:43.016906+0000","last_active":"2021-10-08T19:23:00.194682+0000","last_peered":"2021-10-08T19:23:00.194682+0000","last_clean":"2021-10-08T19:23:00.194682+0000","last_became_active":"2021-10-08T19:21:27.637178+0000","last_became_peered":"2021-10-08T19:21:27.637178+0000","last_unstale":"2021-10-08T19:23:00.194682+0000","last_undegraded":"2021-10-08T19:23:00.194682+0000","last_fullsized":"2021-10-08T19:23:00.194682+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:43.016815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:43.016815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034706469999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.194161+0000","last_change":"2021-10-08T19:22:33.926376+0000","last_active":"2021-10-08T19:23:00.194161+0000","last_peered":"2021-10-08T19:23:00.194161+0000","last_clean":"2021-10-08T19:23:00.194161+0000","last_became_active":"2021-10-08T19:21:23.609037+0000","last_became_peered":"2021-10-08T19:21:23.609037+0000","last_unstale":"2021-10-08T19:23:00.194161+0000","last_undegraded":"2021-10-08T19:23:00.194161+0000","last_fullsized":"2021-10-08T19:23:00.194161+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:33.926256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:33.926256+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0015495210000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"69'5","reported_seq":51,"reported_epoch":89,"state":"active+clean","last_fresh":"2021-10-08T19:23:17.993637+0000","last_change":"2021-10-08T19:23:17.993609+0000","last_active":"2021-10-08T19:23:17.993637+0000","last_peered":"2021-10-08T19:23:17.993637+0000","last_clean":"2021-10-08T19:23:17.993637+0000","last_became_active":"2021-10-08T19:21:25.609029+0000","last_became_peered":"2021-10-08T19:21:25.609029+0000","last_unstale":"2021-10-08T19:23:17.993637+0000","last_undegraded":"2021-10-08T19:23:17.993637+0000","last_fullsized":"2021-10-08T19:23:17.993637+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'5","last_scrub_stamp":"2021-10-08T19:23:17.993532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:17.993532+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040855580000000004,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:22:59.569494+0000","last_change":"2021-10-08T19:22:51.689295+0000","last_active":"2021-10-08T19:22:59.569494+0000","last_peered":"2021-10-08T19:22:59.569494+0000","last_clean":"2021-10-08T19:22:59.569494+0000","last_became_active":"2021-10-08T19:21:29.640978+0000","last_became_peered":"2021-10-08T19:21:29.640978+0000","last_unstale":"2021-10-08T19:22:59.569494+0000","last_undegraded":"2021-10-08T19:22:59.569494+0000","last_fullsized":"2021-10-08T19:22:59.569494+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:51.689220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:51.689220+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001435541,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:05.799919+0000","last_change":"2021-10-08T19:23:05.799433+0000","last_active":"2021-10-08T19:23:05.799919+0000","last_peered":"2021-10-08T19:23:05.799919+0000","last_clean":"2021-10-08T19:23:05.799919+0000","last_became_active":"2021-10-08T19:21:27.633979+0000","last_became_peered":"2021-10-08T19:21:27.633979+0000","last_unstale":"2021-10-08T19:23:05.799919+0000","last_undegraded":"2021-10-08T19:23:05.799919+0000","last_fullsized":"2021-10-08T19:23:05.799919+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:05.799361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:05.799361+0000","last_clean_scrub_stamp":"2021-10-08T19:23:05.799361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0036358100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.194128+0000","last_change":"2021-10-08T19:22:42.042609+0000","last_active":"2021-10-08T19:23:00.194128+0000","last_peered":"2021-10-08T19:23:00.194128+0000","last_clean":"2021-10-08T19:23:00.194128+0000","last_became_active":"2021-10-08T19:21:23.607785+0000","last_became_peered":"2021-10-08T19:21:23.607785+0000","last_unstale":"2021-10-08T19:23:00.194128+0000","last_undegraded":"2021-10-08T19:23:00.194128+0000","last_fullsized":"2021-10-08T19:23:00.194128+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:42.042510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:42.042510+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034710639999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"69'9","reported_seq":57,"reported_epoch":89,"state":"active+clean","last_fresh":"2021-10-08T19:23:19.997407+0000","last_change":"2021-10-08T19:23:19.997379+0000","last_active":"2021-10-08T19:23:19.997407+0000","last_peered":"2021-10-08T19:23:19.997407+0000","last_clean":"2021-10-08T19:23:19.997407+0000","last_became_active":"2021-10-08T19:21:25.608263+0000","last_became_peered":"2021-10-08T19:21:25.608263+0000","last_unstale":"2021-10-08T19:23:19.997407+0000","last_undegraded":"2021-10-08T19:23:19.997407+0000","last_fullsized":"2021-10-08T19:23:19.997407+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'9","last_scrub_stamp":"2021-10-08T19:23:19.997296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:19.997296+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040259689999999999,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.508671+0000","last_change":"2021-10-08T19:22:38.544751+0000","last_active":"2021-10-08T19:23:00.508671+0000","last_peered":"2021-10-08T19:23:00.508671+0000","last_clean":"2021-10-08T19:23:00.508671+0000","last_became_active":"2021-10-08T19:21:29.681017+0000","last_became_peered":"2021-10-08T19:21:29.681017+0000","last_unstale":"2021-10-08T19:23:00.508671+0000","last_undegraded":"2021-10-08T19:23:00.508671+0000","last_fullsized":"2021-10-08T19:23:00.508671+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:38.544673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:38.544673+0000","last_clean_scrub_stamp":"2021-10-08T19:22:38.544673+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0019818940000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.046773+0000","last_change":"2021-10-08T19:22:45.177384+0000","last_active":"2021-10-08T19:23:00.046773+0000","last_peered":"2021-10-08T19:23:00.046773+0000","last_clean":"2021-10-08T19:23:00.046773+0000","last_became_active":"2021-10-08T19:21:27.635242+0000","last_became_peered":"2021-10-08T19:21:27.635242+0000","last_unstale":"2021-10-08T19:23:00.046773+0000","last_undegraded":"2021-10-08T19:23:00.046773+0000","last_fullsized":"2021-10-08T19:23:00.046773+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:45.177306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:45.177306+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034162229999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:07.582193+0000","last_change":"2021-10-08T19:23:07.581727+0000","last_active":"2021-10-08T19:23:07.582193+0000","last_peered":"2021-10-08T19:23:07.582193+0000","last_clean":"2021-10-08T19:23:07.582193+0000","last_became_active":"2021-10-08T19:21:23.605327+0000","last_became_peered":"2021-10-08T19:21:23.605327+0000","last_unstale":"2021-10-08T19:23:07.582193+0000","last_undegraded":"2021-10-08T19:23:07.582193+0000","last_fullsized":"2021-10-08T19:23:07.582193+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:07.581653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:07.581653+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034956309999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"69'12","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:10.563374+0000","last_change":"2021-10-08T19:23:10.562916+0000","last_active":"2021-10-08T19:23:10.563374+0000","last_peered":"2021-10-08T19:23:10.563374+0000","last_clean":"2021-10-08T19:23:10.563374+0000","last_became_active":"2021-10-08T19:21:25.612541+0000","last_became_peered":"2021-10-08T19:21:25.612541+0000","last_unstale":"2021-10-08T19:23:10.563374+0000","last_undegraded":"2021-10-08T19:23:10.563374+0000","last_fullsized":"2021-10-08T19:23:10.563374+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'12","last_scrub_stamp":"2021-10-08T19:23:10.562820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:10.562820+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040692890000000002,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.046993+0000","last_change":"2021-10-08T19:22:56.020836+0000","last_active":"2021-10-08T19:23:00.046993+0000","last_peered":"2021-10-08T19:23:00.046993+0000","last_clean":"2021-10-08T19:23:00.046993+0000","last_became_active":"2021-10-08T19:21:29.679050+0000","last_became_peered":"2021-10-08T19:21:29.679050+0000","last_unstale":"2021-10-08T19:23:00.046993+0000","last_undegraded":"2021-10-08T19:23:00.046993+0000","last_fullsized":"2021-10-08T19:23:00.046993+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:56.020759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:56.020759+0000","last_clean_scrub_stamp":"2021-10-08T19:22:56.020759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001373478,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:10.149333+0000","last_change":"2021-10-08T19:23:10.148845+0000","last_active":"2021-10-08T19:23:10.149333+0000","last_peered":"2021-10-08T19:23:10.149333+0000","last_clean":"2021-10-08T19:23:10.149333+0000","last_became_active":"2021-10-08T19:21:27.636398+0000","last_became_peered":"2021-10-08T19:21:27.636398+0000","last_unstale":"2021-10-08T19:23:10.149333+0000","last_undegraded":"2021-10-08T19:23:10.149333+0000","last_fullsized":"2021-10-08T19:23:10.149333+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:10.148774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:10.148774+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034045170000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":52,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.195936+0000","last_change":"2021-10-08T19:22:46.422938+0000","last_active":"2021-10-08T19:23:00.195936+0000","last_peered":"2021-10-08T19:23:00.195936+0000","last_clean":"2021-10-08T19:23:00.195936+0000","last_became_active":"2021-10-08T19:22:43.936982+0000","last_became_peered":"2021-10-08T19:22:43.936982+0000","last_unstale":"2021-10-08T19:23:00.195936+0000","last_undegraded":"2021-10-08T19:23:00.195936+0000","last_fullsized":"2021-10-08T19:23:00.195936+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:46.422866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:46.422866+0000","last_clean_scrub_stamp":"2021-10-08T19:22:46.422866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0014556809999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"69'15","reported_seq":91,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:22:59.569424+0000","last_change":"2021-10-08T19:22:52.474731+0000","last_active":"2021-10-08T19:22:59.569424+0000","last_peered":"2021-10-08T19:22:59.569424+0000","last_clean":"2021-10-08T19:22:59.569424+0000","last_became_active":"2021-10-08T19:22:44.005356+0000","last_became_peered":"2021-10-08T19:22:44.005356+0000","last_unstale":"2021-10-08T19:22:59.569424+0000","last_undegraded":"2021-10-08T19:22:59.569424+0000","last_fullsized":"2021-10-08T19:22:59.569424+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'15","last_scrub_stamp":"2021-10-08T19:22:52.474651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:52.474651+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040638499999999999,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"69'1","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.251518+0000","last_change":"2021-10-08T19:22:50.226593+0000","last_active":"2021-10-08T19:23:00.251518+0000","last_peered":"2021-10-08T19:23:00.251518+0000","last_clean":"2021-10-08T19:23:00.251518+0000","last_became_active":"2021-10-08T19:21:29.637392+0000","last_became_peered":"2021-10-08T19:21:29.637392+0000","last_unstale":"2021-10-08T19:23:00.251518+0000","last_undegraded":"2021-10-08T19:23:00.251518+0000","last_fullsized":"2021-10-08T19:23:00.251518+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2021-10-08T19:22:50.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:50.226504+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040000080000000002,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:22:59.570259+0000","last_change":"2021-10-08T19:22:58.625225+0000","last_active":"2021-10-08T19:22:59.570259+0000","last_peered":"2021-10-08T19:22:59.570259+0000","last_clean":"2021-10-08T19:22:59.570259+0000","last_became_active":"2021-10-08T19:21:27.632648+0000","last_became_peered":"2021-10-08T19:21:27.632648+0000","last_unstale":"2021-10-08T19:22:59.570259+0000","last_undegraded":"2021-10-08T19:22:59.570259+0000","last_fullsized":"2021-10-08T19:22:59.570259+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:58.625153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:58.625153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0015820020000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.507510+0000","last_change":"2021-10-08T19:21:23.604120+0000","last_active":"2021-10-08T19:23:00.507510+0000","last_peered":"2021-10-08T19:23:00.507510+0000","last_clean":"2021-10-08T19:23:00.507510+0000","last_became_active":"2021-10-08T19:21:23.603777+0000","last_became_peered":"2021-10-08T19:21:23.603777+0000","last_unstale":"2021-10-08T19:23:00.507510+0000","last_undegraded":"2021-10-08T19:23:00.507510+0000","last_fullsized":"2021-10-08T19:23:00.507510+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:21:22.582293+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"69'11","reported_seq":60,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.197087+0000","last_change":"2021-10-08T19:22:53.420275+0000","last_active":"2021-10-08T19:23:00.197087+0000","last_peered":"2021-10-08T19:23:00.197087+0000","last_clean":"2021-10-08T19:23:00.197087+0000","last_became_active":"2021-10-08T19:21:25.610902+0000","last_became_peered":"2021-10-08T19:21:25.610902+0000","last_unstale":"2021-10-08T19:23:00.197087+0000","last_undegraded":"2021-10-08T19:23:00.197087+0000","last_fullsized":"2021-10-08T19:23:00.197087+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'11","last_scrub_stamp":"2021-10-08T19:22:53.420199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:53.420199+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0023910469999999999,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"69'1","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:04.311967+0000","last_change":"2021-10-08T19:23:04.311491+0000","last_active":"2021-10-08T19:23:04.311967+0000","last_peered":"2021-10-08T19:23:04.311967+0000","last_clean":"2021-10-08T19:23:04.311967+0000","last_became_active":"2021-10-08T19:21:29.640296+0000","last_became_peered":"2021-10-08T19:21:29.640296+0000","last_unstale":"2021-10-08T19:23:04.311967+0000","last_undegraded":"2021-10-08T19:23:04.311967+0000","last_fullsized":"2021-10-08T19:23:04.311967+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2021-10-08T19:23:04.311406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:04.311406+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0041668299999999998,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"69'8","reported_seq":74,"reported_epoch":89,"state":"active+clean","last_fresh":"2021-10-08T19:23:17.912118+0000","last_change":"2021-10-08T19:22:43.380890+0000","last_active":"2021-10-08T19:23:17.912118+0000","last_peered":"2021-10-08T19:23:17.912118+0000","last_clean":"2021-10-08T19:23:17.912118+0000","last_became_active":"2021-10-08T19:21:27.638792+0000","last_became_peered":"2021-10-08T19:21:27.638792+0000","last_unstale":"2021-10-08T19:23:17.912118+0000","last_undegraded":"2021-10-08T19:23:17.912118+0000","last_fullsized":"2021-10-08T19:23:17.912118+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'8","last_scrub_stamp":"2021-10-08T19:22:43.380786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:43.380786+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002000403,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2021-10-08T19:23:19.631823+0000","last_change":"2021-10-08T19:23:19.631788+0000","last_active":"2021-10-08T19:23:19.631823+0000","last_peered":"2021-10-08T19:23:19.631823+0000","last_clean":"2021-10-08T19:23:19.631823+0000","last_became_active":"2021-10-08T19:21:23.604530+0000","last_became_peered":"2021-10-08T19:21:23.604530+0000","last_unstale":"2021-10-08T19:23:19.631823+0000","last_undegraded":"2021-10-08T19:23:19.631823+0000","last_fullsized":"2021-10-08T19:23:19.631823+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:19.631715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:19.631715+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0013318340000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"69'10","reported_seq":56,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:22:59.570235+0000","last_change":"2021-10-08T19:22:27.654003+0000","last_active":"2021-10-08T19:22:59.570235+0000","last_peered":"2021-10-08T19:22:59.570235+0000","last_clean":"2021-10-08T19:22:59.570235+0000","last_became_active":"2021-10-08T19:21:25.743519+0000","last_became_peered":"2021-10-08T19:21:25.743519+0000","last_unstale":"2021-10-08T19:22:59.570235+0000","last_undegraded":"2021-10-08T19:22:59.570235+0000","last_fullsized":"2021-10-08T19:22:59.570235+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'10","last_scrub_stamp":"2021-10-08T19:22:27.653872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:27.653872+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0028937009999999998,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:06.571411+0000","last_change":"2021-10-08T19:23:06.570919+0000","last_active":"2021-10-08T19:23:06.571411+0000","last_peered":"2021-10-08T19:23:06.571411+0000","last_clean":"2021-10-08T19:23:06.571411+0000","last_became_active":"2021-10-08T19:21:29.681023+0000","last_became_peered":"2021-10-08T19:21:29.681023+0000","last_unstale":"2021-10-08T19:23:06.571411+0000","last_undegraded":"2021-10-08T19:23:06.571411+0000","last_fullsized":"2021-10-08T19:23:06.571411+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:06.570853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:06.570853+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034079790000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.195073+0000","last_change":"2021-10-08T19:23:00.194960+0000","last_active":"2021-10-08T19:23:00.195073+0000","last_peered":"2021-10-08T19:23:00.195073+0000","last_clean":"2021-10-08T19:23:00.195073+0000","last_became_active":"2021-10-08T19:21:27.637131+0000","last_became_peered":"2021-10-08T19:21:27.637131+0000","last_unstale":"2021-10-08T19:23:00.195073+0000","last_undegraded":"2021-10-08T19:23:00.195073+0000","last_fullsized":"2021-10-08T19:23:00.195073+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:00.194892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:00.194892+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020373650000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.196094+0000","last_change":"2021-10-08T19:22:31.311191+0000","last_active":"2021-10-08T19:23:00.196094+0000","last_peered":"2021-10-08T19:23:00.196094+0000","last_clean":"2021-10-08T19:23:00.196094+0000","last_became_active":"2021-10-08T19:21:23.606708+0000","last_became_peered":"2021-10-08T19:21:23.606708+0000","last_unstale":"2021-10-08T19:23:00.196094+0000","last_undegraded":"2021-10-08T19:23:00.196094+0000","last_fullsized":"2021-10-08T19:23:00.196094+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:31.311083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:31.311083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0015648369999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"69'11","reported_seq":54,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.507961+0000","last_change":"2021-10-08T19:21:25.742854+0000","last_active":"2021-10-08T19:23:00.507961+0000","last_peered":"2021-10-08T19:23:00.507961+0000","last_clean":"2021-10-08T19:23:00.507961+0000","last_became_active":"2021-10-08T19:21:25.742586+0000","last_became_peered":"2021-10-08T19:21:25.742586+0000","last_unstale":"2021-10-08T19:23:00.507961+0000","last_undegraded":"2021-10-08T19:23:00.507961+0000","last_fullsized":"2021-10-08T19:23:00.507961+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:21:24.589054+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.194574+0000","last_change":"2021-10-08T19:22:52.059253+0000","last_active":"2021-10-08T19:23:00.194574+0000","last_peered":"2021-10-08T19:23:00.194574+0000","last_clean":"2021-10-08T19:23:00.194574+0000","last_became_active":"2021-10-08T19:21:29.642835+0000","last_became_peered":"2021-10-08T19:21:29.642835+0000","last_unstale":"2021-10-08T19:23:00.194574+0000","last_undegraded":"2021-10-08T19:23:00.194574+0000","last_fullsized":"2021-10-08T19:23:00.194574+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:52.059181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:52.059181+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034376540000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:02.446577+0000","last_change":"2021-10-08T19:23:02.446476+0000","last_active":"2021-10-08T19:23:02.446577+0000","last_peered":"2021-10-08T19:23:02.446577+0000","last_clean":"2021-10-08T19:23:02.446577+0000","last_became_active":"2021-10-08T19:21:27.643513+0000","last_became_peered":"2021-10-08T19:21:27.643513+0000","last_unstale":"2021-10-08T19:23:02.446577+0000","last_undegraded":"2021-10-08T19:23:02.446577+0000","last_fullsized":"2021-10-08T19:23:02.446577+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:02.446394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:02.446394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001225133,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:13.716885+0000","last_change":"2021-10-08T19:23:13.716452+0000","last_active":"2021-10-08T19:23:13.716885+0000","last_peered":"2021-10-08T19:23:13.716885+0000","last_clean":"2021-10-08T19:23:13.716885+0000","last_became_active":"2021-10-08T19:21:23.600192+0000","last_became_peered":"2021-10-08T19:21:23.600192+0000","last_unstale":"2021-10-08T19:23:13.716885+0000","last_undegraded":"2021-10-08T19:23:13.716885+0000","last_fullsized":"2021-10-08T19:23:13.716885+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:13.716331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:13.716331+0000","last_clean_scrub_stamp":"2021-10-08T19:23:13.716331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0033906079999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"69'4","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.507825+0000","last_change":"2021-10-08T19:22:34.447928+0000","last_active":"2021-10-08T19:23:00.507825+0000","last_peered":"2021-10-08T19:23:00.507825+0000","last_clean":"2021-10-08T19:23:00.507825+0000","last_became_active":"2021-10-08T19:21:25.612729+0000","last_became_peered":"2021-10-08T19:21:25.612729+0000","last_unstale":"2021-10-08T19:23:00.507825+0000","last_undegraded":"2021-10-08T19:23:00.507825+0000","last_fullsized":"2021-10-08T19:23:00.507825+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'4","last_scrub_stamp":"2021-10-08T19:22:34.447854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:34.447854+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040770490000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:12.504672+0000","last_change":"2021-10-08T19:23:12.504222+0000","last_active":"2021-10-08T19:23:12.504672+0000","last_peered":"2021-10-08T19:23:12.504672+0000","last_clean":"2021-10-08T19:23:12.504672+0000","last_became_active":"2021-10-08T19:21:29.649225+0000","last_became_peered":"2021-10-08T19:21:29.649225+0000","last_unstale":"2021-10-08T19:23:12.504672+0000","last_undegraded":"2021-10-08T19:23:12.504672+0000","last_fullsized":"2021-10-08T19:23:12.504672+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:12.504136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:12.504136+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0038704550000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.251800+0000","last_change":"2021-10-08T19:22:43.186757+0000","last_active":"2021-10-08T19:23:00.251800+0000","last_peered":"2021-10-08T19:23:00.251800+0000","last_clean":"2021-10-08T19:23:00.251800+0000","last_became_active":"2021-10-08T19:21:27.635623+0000","last_became_peered":"2021-10-08T19:21:27.635623+0000","last_unstale":"2021-10-08T19:23:00.251800+0000","last_undegraded":"2021-10-08T19:23:00.251800+0000","last_fullsized":"2021-10-08T19:23:00.251800+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:43.186684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:43.186684+0000","last_clean_scrub_stamp":"2021-10-08T19:22:43.186684+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0015123129999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:02.243028+0000","last_change":"2021-10-08T19:23:02.242539+0000","last_active":"2021-10-08T19:23:02.243028+0000","last_peered":"2021-10-08T19:23:02.243028+0000","last_clean":"2021-10-08T19:23:02.243028+0000","last_became_active":"2021-10-08T19:21:23.607048+0000","last_became_peered":"2021-10-08T19:21:23.607048+0000","last_unstale":"2021-10-08T19:23:02.243028+0000","last_undegraded":"2021-10-08T19:23:02.243028+0000","last_fullsized":"2021-10-08T19:23:02.243028+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:02.242462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:02.242462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034031740000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"69'11","reported_seq":81,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.046263+0000","last_change":"2021-10-08T19:22:44.368163+0000","last_active":"2021-10-08T19:23:00.046263+0000","last_peered":"2021-10-08T19:23:00.046263+0000","last_clean":"2021-10-08T19:23:00.046263+0000","last_became_active":"2021-10-08T19:22:43.936354+0000","last_became_peered":"2021-10-08T19:22:43.936354+0000","last_unstale":"2021-10-08T19:23:00.046263+0000","last_undegraded":"2021-10-08T19:23:00.046263+0000","last_fullsized":"2021-10-08T19:23:00.046263+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'11","last_scrub_stamp":"2021-10-08T19:22:33.337032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:33.337032+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040894970000000001,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:02.605208+0000","last_change":"2021-10-08T19:23:02.605102+0000","last_active":"2021-10-08T19:23:02.605208+0000","last_peered":"2021-10-08T19:23:02.605208+0000","last_clean":"2021-10-08T19:23:02.605208+0000","last_became_active":"2021-10-08T19:21:29.641431+0000","last_became_peered":"2021-10-08T19:21:29.641431+0000","last_unstale":"2021-10-08T19:23:02.605208+0000","last_undegraded":"2021-10-08T19:23:02.605208+0000","last_fullsized":"2021-10-08T19:23:02.605208+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:02.605025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:02.605025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001265305,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.508031+0000","last_change":"2021-10-08T19:21:27.638133+0000","last_active":"2021-10-08T19:23:00.508031+0000","last_peered":"2021-10-08T19:23:00.508031+0000","last_clean":"2021-10-08T19:23:00.508031+0000","last_became_active":"2021-10-08T19:21:27.637800+0000","last_became_peered":"2021-10-08T19:21:27.637800+0000","last_unstale":"2021-10-08T19:23:00.508031+0000","last_undegraded":"2021-10-08T19:23:00.508031+0000","last_fullsized":"2021-10-08T19:23:00.508031+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:21:26.604244+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.195954+0000","last_change":"2021-10-08T19:22:52.408971+0000","last_active":"2021-10-08T19:23:00.195954+0000","last_peered":"2021-10-08T19:23:00.195954+0000","last_clean":"2021-10-08T19:23:00.195954+0000","last_became_active":"2021-10-08T19:21:23.606797+0000","last_became_peered":"2021-10-08T19:21:23.606797+0000","last_unstale":"2021-10-08T19:23:00.195954+0000","last_undegraded":"2021-10-08T19:23:00.195954+0000","last_fullsized":"2021-10-08T19:23:00.195954+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:52.408893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:52.408893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0015921889999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"87'13","reported_seq":61,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.251454+0000","last_change":"2021-10-08T19:22:53.263693+0000","last_active":"2021-10-08T19:23:00.251454+0000","last_peered":"2021-10-08T19:23:00.251454+0000","last_clean":"2021-10-08T19:23:00.251454+0000","last_became_active":"2021-10-08T19:21:25.615596+0000","last_became_peered":"2021-10-08T19:21:25.615596+0000","last_unstale":"2021-10-08T19:23:00.251454+0000","last_undegraded":"2021-10-08T19:23:00.251454+0000","last_fullsized":"2021-10-08T19:23:00.251454+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'13","last_scrub_stamp":"2021-10-08T19:22:53.263631+0000","last_deep_scrub":"87'13","last_deep_scrub_stamp":"2021-10-08T19:22:53.263631+0000","last_clean_scrub_stamp":"2021-10-08T19:22:53.263631+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0036954140000000002,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.047063+0000","last_change":"2021-10-08T19:22:49.049456+0000","last_active":"2021-10-08T19:23:00.047063+0000","last_peered":"2021-10-08T19:23:00.047063+0000","last_clean":"2021-10-08T19:23:00.047063+0000","last_became_active":"2021-10-08T19:21:29.640302+0000","last_became_peered":"2021-10-08T19:21:29.640302+0000","last_unstale":"2021-10-08T19:23:00.047063+0000","last_undegraded":"2021-10-08T19:23:00.047063+0000","last_fullsized":"2021-10-08T19:23:00.047063+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:49.049379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:49.049379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.00162856,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"69'8","reported_seq":71,"reported_epoch":89,"state":"active+clean","last_fresh":"2021-10-08T19:23:17.911689+0000","last_change":"2021-10-08T19:22:32.372773+0000","last_active":"2021-10-08T19:23:17.911689+0000","last_peered":"2021-10-08T19:23:17.911689+0000","last_clean":"2021-10-08T19:23:17.911689+0000","last_became_active":"2021-10-08T19:21:27.636440+0000","last_became_peered":"2021-10-08T19:21:27.636440+0000","last_unstale":"2021-10-08T19:23:17.911689+0000","last_undegraded":"2021-10-08T19:23:17.911689+0000","last_fullsized":"2021-10-08T19:23:17.911689+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'8","last_scrub_stamp":"2021-10-08T19:22:32.372699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:32.372699+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039965820000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:22:59.569921+0000","last_change":"2021-10-08T19:22:24.698543+0000","last_active":"2021-10-08T19:22:59.569921+0000","last_peered":"2021-10-08T19:22:59.569921+0000","last_clean":"2021-10-08T19:22:59.569921+0000","last_became_active":"2021-10-08T19:21:23.606478+0000","last_became_peered":"2021-10-08T19:21:23.606478+0000","last_unstale":"2021-10-08T19:22:59.569921+0000","last_undegraded":"2021-10-08T19:22:59.569921+0000","last_fullsized":"2021-10-08T19:22:59.569921+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:24.698471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:24.698471+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001682846,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"69'9","reported_seq":57,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:22:59.563917+0000","last_change":"2021-10-08T19:22:42.517875+0000","last_active":"2021-10-08T19:22:59.563917+0000","last_peered":"2021-10-08T19:22:59.563917+0000","last_clean":"2021-10-08T19:22:59.563917+0000","last_became_active":"2021-10-08T19:21:25.741755+0000","last_became_peered":"2021-10-08T19:21:25.741755+0000","last_unstale":"2021-10-08T19:22:59.563917+0000","last_undegraded":"2021-10-08T19:22:59.563917+0000","last_fullsized":"2021-10-08T19:22:59.563917+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'9","last_scrub_stamp":"2021-10-08T19:22:42.517786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:42.517786+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0042286850000000003,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:11.535890+0000","last_change":"2021-10-08T19:23:11.535748+0000","last_active":"2021-10-08T19:23:11.535890+0000","last_peered":"2021-10-08T19:23:11.535890+0000","last_clean":"2021-10-08T19:23:11.535890+0000","last_became_active":"2021-10-08T19:21:29.646331+0000","last_became_peered":"2021-10-08T19:21:29.646331+0000","last_unstale":"2021-10-08T19:23:11.535890+0000","last_undegraded":"2021-10-08T19:23:11.535890+0000","last_fullsized":"2021-10-08T19:23:11.535890+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:11.535641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:11.535641+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001740417,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"69'8","reported_seq":71,"reported_epoch":89,"state":"active+clean","last_fresh":"2021-10-08T19:23:17.911041+0000","last_change":"2021-10-08T19:22:28.467610+0000","last_active":"2021-10-08T19:23:17.911041+0000","last_peered":"2021-10-08T19:23:17.911041+0000","last_clean":"2021-10-08T19:23:17.911041+0000","last_became_active":"2021-10-08T19:21:27.635924+0000","last_became_peered":"2021-10-08T19:21:27.635924+0000","last_unstale":"2021-10-08T19:23:17.911041+0000","last_undegraded":"2021-10-08T19:23:17.911041+0000","last_fullsized":"2021-10-08T19:23:17.911041+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'8","last_scrub_stamp":"2021-10-08T19:22:28.467539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:28.467539+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039782960000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:04.759675+0000","last_change":"2021-10-08T19:23:04.759546+0000","last_active":"2021-10-08T19:23:04.759675+0000","last_peered":"2021-10-08T19:23:04.759675+0000","last_clean":"2021-10-08T19:23:04.759675+0000","last_became_active":"2021-10-08T19:21:23.603637+0000","last_became_peered":"2021-10-08T19:21:23.603637+0000","last_unstale":"2021-10-08T19:23:04.759675+0000","last_undegraded":"2021-10-08T19:23:04.759675+0000","last_fullsized":"2021-10-08T19:23:04.759675+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:04.759470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:04.759470+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001376447,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"69'10","reported_seq":56,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.508320+0000","last_change":"2021-10-08T19:22:52.611146+0000","last_active":"2021-10-08T19:23:00.508320+0000","last_peered":"2021-10-08T19:23:00.508320+0000","last_clean":"2021-10-08T19:23:00.508320+0000","last_became_active":"2021-10-08T19:21:25.741716+0000","last_became_peered":"2021-10-08T19:21:25.741716+0000","last_unstale":"2021-10-08T19:23:00.508320+0000","last_undegraded":"2021-10-08T19:23:00.508320+0000","last_fullsized":"2021-10-08T19:23:00.508320+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'10","last_scrub_stamp":"2021-10-08T19:22:52.611060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:52.611060+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040684459999999999,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.195162+0000","last_change":"2021-10-08T19:22:36.973546+0000","last_active":"2021-10-08T19:23:00.195162+0000","last_peered":"2021-10-08T19:23:00.195162+0000","last_clean":"2021-10-08T19:23:00.195162+0000","last_became_active":"2021-10-08T19:21:29.681255+0000","last_became_peered":"2021-10-08T19:21:29.681255+0000","last_unstale":"2021-10-08T19:23:00.195162+0000","last_undegraded":"2021-10-08T19:23:00.195162+0000","last_fullsized":"2021-10-08T19:23:00.195162+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:36.973452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:36.973452+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001482431,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:22:59.563710+0000","last_change":"2021-10-08T19:22:50.573085+0000","last_active":"2021-10-08T19:22:59.563710+0000","last_peered":"2021-10-08T19:22:59.563710+0000","last_clean":"2021-10-08T19:22:59.563710+0000","last_became_active":"2021-10-08T19:21:27.634443+0000","last_became_peered":"2021-10-08T19:21:27.634443+0000","last_unstale":"2021-10-08T19:22:59.563710+0000","last_undegraded":"2021-10-08T19:22:59.563710+0000","last_fullsized":"2021-10-08T19:22:59.563710+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:50.573010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:50.573010+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034131029999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.196511+0000","last_change":"2021-10-08T19:22:35.361033+0000","last_active":"2021-10-08T19:23:00.196511+0000","last_peered":"2021-10-08T19:23:00.196511+0000","last_clean":"2021-10-08T19:23:00.196511+0000","last_became_active":"2021-10-08T19:21:23.611362+0000","last_became_peered":"2021-10-08T19:21:23.611362+0000","last_unstale":"2021-10-08T19:23:00.196511+0000","last_undegraded":"2021-10-08T19:23:00.196511+0000","last_fullsized":"2021-10-08T19:23:00.196511+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:35.360970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:35.360970+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001166795,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"69'6","reported_seq":50,"reported_epoch":89,"state":"active+clean","last_fresh":"2021-10-08T19:23:21.395496+0000","last_change":"2021-10-08T19:23:21.395469+0000","last_active":"2021-10-08T19:23:21.395496+0000","last_peered":"2021-10-08T19:23:21.395496+0000","last_clean":"2021-10-08T19:23:21.395496+0000","last_became_active":"2021-10-08T19:21:25.742631+0000","last_became_peered":"2021-10-08T19:21:25.742631+0000","last_unstale":"2021-10-08T19:23:21.395496+0000","last_undegraded":"2021-10-08T19:23:21.395496+0000","last_fullsized":"2021-10-08T19:23:21.395496+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'6","last_scrub_stamp":"2021-10-08T19:23:21.395390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:21.395390+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002416241,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:22:59.569067+0000","last_change":"2021-10-08T19:22:40.421310+0000","last_active":"2021-10-08T19:22:59.569067+0000","last_peered":"2021-10-08T19:22:59.569067+0000","last_clean":"2021-10-08T19:22:59.569067+0000","last_became_active":"2021-10-08T19:21:29.640674+0000","last_became_peered":"2021-10-08T19:21:29.640674+0000","last_unstale":"2021-10-08T19:22:59.569067+0000","last_undegraded":"2021-10-08T19:22:59.569067+0000","last_fullsized":"2021-10-08T19:22:59.569067+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:40.421229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.421229+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034873370000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.508705+0000","last_change":"2021-10-08T19:22:36.466178+0000","last_active":"2021-10-08T19:23:00.508705+0000","last_peered":"2021-10-08T19:23:00.508705+0000","last_clean":"2021-10-08T19:23:00.508705+0000","last_became_active":"2021-10-08T19:21:27.638112+0000","last_became_peered":"2021-10-08T19:21:27.638112+0000","last_unstale":"2021-10-08T19:23:00.508705+0000","last_undegraded":"2021-10-08T19:23:00.508705+0000","last_fullsized":"2021-10-08T19:23:00.508705+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:36.466077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:36.466077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0018534809999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:22:59.569308+0000","last_change":"2021-10-08T19:22:24.268774+0000","last_active":"2021-10-08T19:22:59.569308+0000","last_peered":"2021-10-08T19:22:59.569308+0000","last_clean":"2021-10-08T19:22:59.569308+0000","last_became_active":"2021-10-08T19:21:23.598125+0000","last_became_peered":"2021-10-08T19:21:23.598125+0000","last_unstale":"2021-10-08T19:22:59.569308+0000","last_undegraded":"2021-10-08T19:22:59.569308+0000","last_fullsized":"2021-10-08T19:22:59.569308+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:24.268699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:24.268699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001617215,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"69'9","reported_seq":57,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.644670+0000","last_change":"2021-10-08T19:23:00.644527+0000","last_active":"2021-10-08T19:23:00.644670+0000","last_peered":"2021-10-08T19:23:00.644670+0000","last_clean":"2021-10-08T19:23:00.644670+0000","last_became_active":"2021-10-08T19:21:25.743804+0000","last_became_peered":"2021-10-08T19:21:25.743804+0000","last_unstale":"2021-10-08T19:23:00.644670+0000","last_undegraded":"2021-10-08T19:23:00.644670+0000","last_fullsized":"2021-10-08T19:23:00.644670+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'9","last_scrub_stamp":"2021-10-08T19:23:00.644449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:00.644449+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0023246959999999998,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.508087+0000","last_change":"2021-10-08T19:21:29.647439+0000","last_active":"2021-10-08T19:23:00.508087+0000","last_peered":"2021-10-08T19:23:00.508087+0000","last_clean":"2021-10-08T19:23:00.508087+0000","last_became_active":"2021-10-08T19:21:29.647140+0000","last_became_peered":"2021-10-08T19:21:29.647140+0000","last_unstale":"2021-10-08T19:23:00.508087+0000","last_undegraded":"2021-10-08T19:23:00.508087+0000","last_fullsized":"2021-10-08T19:23:00.508087+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:21:28.621762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"61'2","reported_seq":59,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:07.991602+0000","last_change":"2021-10-08T19:23:07.991466+0000","last_active":"2021-10-08T19:23:07.991602+0000","last_peered":"2021-10-08T19:23:07.991602+0000","last_clean":"2021-10-08T19:23:07.991602+0000","last_became_active":"2021-10-08T19:21:23.603614+0000","last_became_peered":"2021-10-08T19:21:23.603614+0000","last_unstale":"2021-10-08T19:23:07.991602+0000","last_undegraded":"2021-10-08T19:23:07.991602+0000","last_fullsized":"2021-10-08T19:23:07.991602+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'2","last_scrub_stamp":"2021-10-08T19:23:07.991388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:07.991388+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001614983,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"69'12","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.046670+0000","last_change":"2021-10-08T19:22:57.003718+0000","last_active":"2021-10-08T19:23:00.046670+0000","last_peered":"2021-10-08T19:23:00.046670+0000","last_clean":"2021-10-08T19:23:00.046670+0000","last_became_active":"2021-10-08T19:21:25.609079+0000","last_became_peered":"2021-10-08T19:21:25.609079+0000","last_unstale":"2021-10-08T19:23:00.046670+0000","last_undegraded":"2021-10-08T19:23:00.046670+0000","last_fullsized":"2021-10-08T19:23:00.046670+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'12","last_scrub_stamp":"2021-10-08T19:22:57.003641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:57.003641+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0041017010000000001,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:22:59.570184+0000","last_change":"2021-10-08T19:22:50.435623+0000","last_active":"2021-10-08T19:22:59.570184+0000","last_peered":"2021-10-08T19:22:59.570184+0000","last_clean":"2021-10-08T19:22:59.570184+0000","last_became_active":"2021-10-08T19:21:27.633878+0000","last_became_peered":"2021-10-08T19:21:27.633878+0000","last_unstale":"2021-10-08T19:22:59.570184+0000","last_undegraded":"2021-10-08T19:22:59.570184+0000","last_fullsized":"2021-10-08T19:22:59.570184+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:50.435552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:50.435552+0000","last_clean_scrub_stamp":"2021-10-08T19:22:50.435552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0012976140000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:22:59.568578+0000","last_change":"2021-10-08T19:22:46.569728+0000","last_active":"2021-10-08T19:22:59.568578+0000","last_peered":"2021-10-08T19:22:59.568578+0000","last_clean":"2021-10-08T19:22:59.568578+0000","last_became_active":"2021-10-08T19:21:29.649735+0000","last_became_peered":"2021-10-08T19:21:29.649735+0000","last_unstale":"2021-10-08T19:22:59.568578+0000","last_undegraded":"2021-10-08T19:22:59.568578+0000","last_fullsized":"2021-10-08T19:22:59.568578+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:46.569603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:46.569603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001693387,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.250922+0000","last_change":"2021-10-08T19:22:39.168725+0000","last_active":"2021-10-08T19:23:00.250922+0000","last_peered":"2021-10-08T19:23:00.250922+0000","last_clean":"2021-10-08T19:23:00.250922+0000","last_became_active":"2021-10-08T19:21:23.605441+0000","last_became_peered":"2021-10-08T19:21:23.605441+0000","last_unstale":"2021-10-08T19:23:00.250922+0000","last_undegraded":"2021-10-08T19:23:00.250922+0000","last_fullsized":"2021-10-08T19:23:00.250922+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:39.168642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:39.168642+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001714901,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"69'10","reported_seq":56,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.251712+0000","last_change":"2021-10-08T19:22:54.269202+0000","last_active":"2021-10-08T19:23:00.251712+0000","last_peered":"2021-10-08T19:23:00.251712+0000","last_clean":"2021-10-08T19:23:00.251712+0000","last_became_active":"2021-10-08T19:21:25.608581+0000","last_became_peered":"2021-10-08T19:21:25.608581+0000","last_unstale":"2021-10-08T19:23:00.251712+0000","last_undegraded":"2021-10-08T19:23:00.251712+0000","last_fullsized":"2021-10-08T19:23:00.251712+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'10","last_scrub_stamp":"2021-10-08T19:22:54.269123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:54.269123+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0024762310000000002,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"69'8","reported_seq":71,"reported_epoch":89,"state":"active+clean","last_fresh":"2021-10-08T19:23:17.748661+0000","last_change":"2021-10-08T19:22:32.603483+0000","last_active":"2021-10-08T19:23:17.748661+0000","last_peered":"2021-10-08T19:23:17.748661+0000","last_clean":"2021-10-08T19:23:17.748661+0000","last_became_active":"2021-10-08T19:21:27.636151+0000","last_became_peered":"2021-10-08T19:21:27.636151+0000","last_unstale":"2021-10-08T19:23:17.748661+0000","last_undegraded":"2021-10-08T19:23:17.748661+0000","last_fullsized":"2021-10-08T19:23:17.748661+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'8","last_scrub_stamp":"2021-10-08T19:22:32.603379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:32.603379+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0022390349999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.508514+0000","last_change":"2021-10-08T19:21:29.647729+0000","last_active":"2021-10-08T19:23:00.508514+0000","last_peered":"2021-10-08T19:23:00.508514+0000","last_clean":"2021-10-08T19:23:00.508514+0000","last_became_active":"2021-10-08T19:21:29.647403+0000","last_became_peered":"2021-10-08T19:21:29.647403+0000","last_unstale":"2021-10-08T19:23:00.508514+0000","last_undegraded":"2021-10-08T19:23:00.508514+0000","last_fullsized":"2021-10-08T19:23:00.508514+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:21:28.621762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:01.747155+0000","last_change":"2021-10-08T19:23:01.747028+0000","last_active":"2021-10-08T19:23:01.747155+0000","last_peered":"2021-10-08T19:23:01.747155+0000","last_clean":"2021-10-08T19:23:01.747155+0000","last_became_active":"2021-10-08T19:21:23.601309+0000","last_became_peered":"2021-10-08T19:21:23.601309+0000","last_unstale":"2021-10-08T19:23:01.747155+0000","last_undegraded":"2021-10-08T19:23:01.747155+0000","last_fullsized":"2021-10-08T19:23:01.747155+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:01.746914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:01.746914+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001402506,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"69'28","reported_seq":113,"reported_epoch":89,"state":"active+clean","last_fresh":"2021-10-08T19:23:17.911409+0000","last_change":"2021-10-08T19:22:40.195245+0000","last_active":"2021-10-08T19:23:17.911409+0000","last_peered":"2021-10-08T19:23:17.911409+0000","last_clean":"2021-10-08T19:23:17.911409+0000","last_became_active":"2021-10-08T19:21:25.613663+0000","last_became_peered":"2021-10-08T19:21:25.613663+0000","last_unstale":"2021-10-08T19:23:17.911409+0000","last_undegraded":"2021-10-08T19:23:17.911409+0000","last_fullsized":"2021-10-08T19:23:17.911409+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'28","last_scrub_stamp":"2021-10-08T19:22:40.195166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.195166+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0029295340000000001,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:03.639174+0000","last_change":"2021-10-08T19:23:03.639015+0000","last_active":"2021-10-08T19:23:03.639174+0000","last_peered":"2021-10-08T19:23:03.639174+0000","last_clean":"2021-10-08T19:23:03.639174+0000","last_became_active":"2021-10-08T19:21:27.636192+0000","last_became_peered":"2021-10-08T19:21:27.636192+0000","last_unstale":"2021-10-08T19:23:03.639174+0000","last_undegraded":"2021-10-08T19:23:03.639174+0000","last_fullsized":"2021-10-08T19:23:03.639174+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:03.638920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:03.638920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0016933230000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:01.215816+0000","last_change":"2021-10-08T19:23:01.215676+0000","last_active":"2021-10-08T19:23:01.215816+0000","last_peered":"2021-10-08T19:23:01.215816+0000","last_clean":"2021-10-08T19:23:01.215816+0000","last_became_active":"2021-10-08T19:21:29.679259+0000","last_became_peered":"2021-10-08T19:21:29.679259+0000","last_unstale":"2021-10-08T19:23:01.215816+0000","last_undegraded":"2021-10-08T19:23:01.215816+0000","last_fullsized":"2021-10-08T19:23:01.215816+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:01.215579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:01.215579+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001463748,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"70'5","reported_seq":159,"reported_epoch":89,"state":"active+clean","last_fresh":"2021-10-08T19:23:22.197493+0000","last_change":"2021-10-08T19:22:48.239798+0000","last_active":"2021-10-08T19:23:22.197493+0000","last_peered":"2021-10-08T19:23:22.197493+0000","last_clean":"2021-10-08T19:23:22.197493+0000","last_became_active":"2021-10-08T19:21:23.601969+0000","last_became_peered":"2021-10-08T19:21:23.601969+0000","last_unstale":"2021-10-08T19:23:22.197493+0000","last_undegraded":"2021-10-08T19:23:22.197493+0000","last_fullsized":"2021-10-08T19:23:22.197493+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:22:48.239721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:48.239721+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001618092,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":113,"num_read_kb":108,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:22:59.568660+0000","last_change":"2021-10-08T19:22:53.423318+0000","last_active":"2021-10-08T19:22:59.568660+0000","last_peered":"2021-10-08T19:22:59.568660+0000","last_clean":"2021-10-08T19:22:59.568660+0000","last_became_active":"2021-10-08T19:21:23.602967+0000","last_became_peered":"2021-10-08T19:21:23.602967+0000","last_unstale":"2021-10-08T19:22:59.568660+0000","last_undegraded":"2021-10-08T19:22:59.568660+0000","last_fullsized":"2021-10-08T19:22:59.568660+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:53.423249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:53.423249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001264587,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"69'13","reported_seq":68,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.251636+0000","last_change":"2021-10-08T19:22:46.281753+0000","last_active":"2021-10-08T19:23:00.251636+0000","last_peered":"2021-10-08T19:23:00.251636+0000","last_clean":"2021-10-08T19:23:00.251636+0000","last_became_active":"2021-10-08T19:21:25.608584+0000","last_became_peered":"2021-10-08T19:21:25.608584+0000","last_unstale":"2021-10-08T19:23:00.251636+0000","last_undegraded":"2021-10-08T19:23:00.251636+0000","last_fullsized":"2021-10-08T19:23:00.251636+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'13","last_scrub_stamp":"2021-10-08T19:22:46.281626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:46.281626+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0047889999999999999,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:06.488243+0000","last_change":"2021-10-08T19:23:06.487842+0000","last_active":"2021-10-08T19:23:06.488243+0000","last_peered":"2021-10-08T19:23:06.488243+0000","last_clean":"2021-10-08T19:23:06.488243+0000","last_became_active":"2021-10-08T19:21:27.637875+0000","last_became_peered":"2021-10-08T19:21:27.637875+0000","last_unstale":"2021-10-08T19:23:06.488243+0000","last_undegraded":"2021-10-08T19:23:06.488243+0000","last_fullsized":"2021-10-08T19:23:06.488243+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:06.487723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:06.487723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034218619999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:14.763837+0000","last_change":"2021-10-08T19:23:14.763360+0000","last_active":"2021-10-08T19:23:14.763837+0000","last_peered":"2021-10-08T19:23:14.763837+0000","last_clean":"2021-10-08T19:23:14.763837+0000","last_became_active":"2021-10-08T19:21:29.646242+0000","last_became_peered":"2021-10-08T19:21:29.646242+0000","last_unstale":"2021-10-08T19:23:14.763837+0000","last_undegraded":"2021-10-08T19:23:14.763837+0000","last_fullsized":"2021-10-08T19:23:14.763837+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:14.763280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:14.763280+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034824790000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.507506+0000","last_change":"2021-10-08T19:22:40.563324+0000","last_active":"2021-10-08T19:23:00.507506+0000","last_peered":"2021-10-08T19:23:00.507506+0000","last_clean":"2021-10-08T19:23:00.507506+0000","last_became_active":"2021-10-08T19:21:23.608665+0000","last_became_peered":"2021-10-08T19:21:23.608665+0000","last_unstale":"2021-10-08T19:23:00.507506+0000","last_undegraded":"2021-10-08T19:23:00.507506+0000","last_fullsized":"2021-10-08T19:23:00.507506+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:40.563247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.563247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.024890005999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2021-10-08T19:23:22.620694+0000","last_change":"2021-10-08T19:23:22.620672+0000","last_active":"2021-10-08T19:23:22.620694+0000","last_peered":"2021-10-08T19:23:22.620694+0000","last_clean":"2021-10-08T19:23:22.620694+0000","last_became_active":"2021-10-08T19:21:23.599143+0000","last_became_peered":"2021-10-08T19:21:23.599143+0000","last_unstale":"2021-10-08T19:23:22.620694+0000","last_undegraded":"2021-10-08T19:23:22.620694+0000","last_fullsized":"2021-10-08T19:23:22.620694+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:22.620600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:22.620600+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003478133,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"73'128","reported_seq":292,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.194516+0000","last_change":"2021-10-08T19:22:13.939106+0000","last_active":"2021-10-08T19:23:00.194516+0000","last_peered":"2021-10-08T19:23:00.194516+0000","last_clean":"2021-10-08T19:23:00.194516+0000","last_became_active":"2021-10-08T19:21:19.594086+0000","last_became_peered":"2021-10-08T19:21:19.594086+0000","last_unstale":"2021-10-08T19:23:00.194516+0000","last_undegraded":"2021-10-08T19:23:00.194516+0000","last_fullsized":"2021-10-08T19:23:00.194516+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'128","last_scrub_stamp":"2021-10-08T19:22:13.939025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:19:44.414003+0000","last_clean_scrub_stamp":"2021-10-08T19:22:13.939025+0000","log_size":128,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020087920000000001,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"69'14","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.196910+0000","last_change":"2021-10-08T19:22:54.379424+0000","last_active":"2021-10-08T19:23:00.196910+0000","last_peered":"2021-10-08T19:23:00.196910+0000","last_clean":"2021-10-08T19:23:00.196910+0000","last_became_active":"2021-10-08T19:21:25.743499+0000","last_became_peered":"2021-10-08T19:21:25.743499+0000","last_unstale":"2021-10-08T19:23:00.196910+0000","last_undegraded":"2021-10-08T19:23:00.196910+0000","last_fullsized":"2021-10-08T19:23:00.196910+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'14","last_scrub_stamp":"2021-10-08T19:22:54.379349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:54.379349+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0021365989999999999,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:02.268070+0000","last_change":"2021-10-08T19:23:02.267580+0000","last_active":"2021-10-08T19:23:02.268070+0000","last_peered":"2021-10-08T19:23:02.268070+0000","last_clean":"2021-10-08T19:23:02.268070+0000","last_became_active":"2021-10-08T19:21:27.636086+0000","last_became_peered":"2021-10-08T19:21:27.636086+0000","last_unstale":"2021-10-08T19:23:02.268070+0000","last_undegraded":"2021-10-08T19:23:02.268070+0000","last_fullsized":"2021-10-08T19:23:02.268070+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:02.267508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:02.267508+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034499700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.251557+0000","last_change":"2021-10-08T19:22:55.234981+0000","last_active":"2021-10-08T19:23:00.251557+0000","last_peered":"2021-10-08T19:23:00.251557+0000","last_clean":"2021-10-08T19:23:00.251557+0000","last_became_active":"2021-10-08T19:21:29.648784+0000","last_became_peered":"2021-10-08T19:21:29.648784+0000","last_unstale":"2021-10-08T19:23:00.251557+0000","last_undegraded":"2021-10-08T19:23:00.251557+0000","last_fullsized":"2021-10-08T19:23:00.251557+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:55.234909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:55.234909+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0014461070000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:22:59.569127+0000","last_change":"2021-10-08T19:22:31.557761+0000","last_active":"2021-10-08T19:22:59.569127+0000","last_peered":"2021-10-08T19:22:59.569127+0000","last_clean":"2021-10-08T19:22:59.569127+0000","last_became_active":"2021-10-08T19:21:23.602857+0000","last_became_peered":"2021-10-08T19:21:23.602857+0000","last_unstale":"2021-10-08T19:22:59.569127+0000","last_undegraded":"2021-10-08T19:22:59.569127+0000","last_fullsized":"2021-10-08T19:22:59.569127+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:31.557650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:31.557650+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001454997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.194298+0000","last_change":"2021-10-08T19:22:32.922768+0000","last_active":"2021-10-08T19:23:00.194298+0000","last_peered":"2021-10-08T19:23:00.194298+0000","last_clean":"2021-10-08T19:23:00.194298+0000","last_became_active":"2021-10-08T19:21:23.606755+0000","last_became_peered":"2021-10-08T19:21:23.606755+0000","last_unstale":"2021-10-08T19:23:00.194298+0000","last_undegraded":"2021-10-08T19:23:00.194298+0000","last_fullsized":"2021-10-08T19:23:00.194298+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:32.922694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:32.922694+0000","last_clean_scrub_stamp":"2021-10-08T19:22:32.922694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001758531,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"69'12","reported_seq":59,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:22:59.570015+0000","last_change":"2021-10-08T19:22:55.639993+0000","last_active":"2021-10-08T19:22:59.570015+0000","last_peered":"2021-10-08T19:22:59.570015+0000","last_clean":"2021-10-08T19:22:59.570015+0000","last_became_active":"2021-10-08T19:21:25.610233+0000","last_became_peered":"2021-10-08T19:21:25.610233+0000","last_unstale":"2021-10-08T19:22:59.570015+0000","last_undegraded":"2021-10-08T19:22:59.570015+0000","last_fullsized":"2021-10-08T19:22:59.570015+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'12","last_scrub_stamp":"2021-10-08T19:22:55.639881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:55.639881+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0032422169999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:22:59.564153+0000","last_change":"2021-10-08T19:22:34.475012+0000","last_active":"2021-10-08T19:22:59.564153+0000","last_peered":"2021-10-08T19:22:59.564153+0000","last_clean":"2021-10-08T19:22:59.564153+0000","last_became_active":"2021-10-08T19:21:27.635800+0000","last_became_peered":"2021-10-08T19:21:27.635800+0000","last_unstale":"2021-10-08T19:22:59.564153+0000","last_undegraded":"2021-10-08T19:22:59.564153+0000","last_fullsized":"2021-10-08T19:22:59.564153+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:34.474918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:34.474918+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0037343509999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:06.155286+0000","last_change":"2021-10-08T19:23:06.155149+0000","last_active":"2021-10-08T19:23:06.155286+0000","last_peered":"2021-10-08T19:23:06.155286+0000","last_clean":"2021-10-08T19:23:06.155286+0000","last_became_active":"2021-10-08T19:21:29.679477+0000","last_became_peered":"2021-10-08T19:21:29.679477+0000","last_unstale":"2021-10-08T19:23:06.155286+0000","last_undegraded":"2021-10-08T19:23:06.155286+0000","last_fullsized":"2021-10-08T19:23:06.155286+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:06.155068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:06.155068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001436805,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"61'1","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.194146+0000","last_change":"2021-10-08T19:22:26.905589+0000","last_active":"2021-10-08T19:23:00.194146+0000","last_peered":"2021-10-08T19:23:00.194146+0000","last_clean":"2021-10-08T19:23:00.194146+0000","last_became_active":"2021-10-08T19:21:23.604258+0000","last_became_peered":"2021-10-08T19:21:23.604258+0000","last_unstale":"2021-10-08T19:23:00.194146+0000","last_undegraded":"2021-10-08T19:23:00.194146+0000","last_fullsized":"2021-10-08T19:23:00.194146+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'1","last_scrub_stamp":"2021-10-08T19:22:26.905517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:26.905517+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001822178,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"69'19","reported_seq":77,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:22:59.570319+0000","last_change":"2021-10-08T19:22:29.614784+0000","last_active":"2021-10-08T19:22:59.570319+0000","last_peered":"2021-10-08T19:22:59.570319+0000","last_clean":"2021-10-08T19:22:59.570319+0000","last_became_active":"2021-10-08T19:21:25.741812+0000","last_became_peered":"2021-10-08T19:21:25.741812+0000","last_unstale":"2021-10-08T19:22:59.570319+0000","last_undegraded":"2021-10-08T19:22:59.570319+0000","last_fullsized":"2021-10-08T19:22:59.570319+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'19","last_scrub_stamp":"2021-10-08T19:22:29.614706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:29.614706+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0024396359999999998,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.196592+0000","last_change":"2021-10-08T19:22:42.399514+0000","last_active":"2021-10-08T19:23:00.196592+0000","last_peered":"2021-10-08T19:23:00.196592+0000","last_clean":"2021-10-08T19:23:00.196592+0000","last_became_active":"2021-10-08T19:21:27.637846+0000","last_became_peered":"2021-10-08T19:21:27.637846+0000","last_unstale":"2021-10-08T19:23:00.196592+0000","last_undegraded":"2021-10-08T19:23:00.196592+0000","last_fullsized":"2021-10-08T19:23:00.196592+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:42.399412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:42.399412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0019951610000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.047331+0000","last_change":"2021-10-08T19:22:40.264230+0000","last_active":"2021-10-08T19:23:00.047331+0000","last_peered":"2021-10-08T19:23:00.047331+0000","last_clean":"2021-10-08T19:23:00.047331+0000","last_became_active":"2021-10-08T19:21:29.646491+0000","last_became_peered":"2021-10-08T19:21:29.646491+0000","last_unstale":"2021-10-08T19:23:00.047331+0000","last_undegraded":"2021-10-08T19:23:00.047331+0000","last_fullsized":"2021-10-08T19:23:00.047331+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:40.264110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.264110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003475845,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.251779+0000","last_change":"2021-10-08T19:22:41.187045+0000","last_active":"2021-10-08T19:23:00.251779+0000","last_peered":"2021-10-08T19:23:00.251779+0000","last_clean":"2021-10-08T19:23:00.251779+0000","last_became_active":"2021-10-08T19:21:23.607770+0000","last_became_peered":"2021-10-08T19:21:23.607770+0000","last_unstale":"2021-10-08T19:23:00.251779+0000","last_undegraded":"2021-10-08T19:23:00.251779+0000","last_fullsized":"2021-10-08T19:23:00.251779+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:41.186945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:41.186945+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0037557269999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"69'18","reported_seq":73,"reported_epoch":89,"state":"active+clean","last_fresh":"2021-10-08T19:23:20.405639+0000","last_change":"2021-10-08T19:23:20.405609+0000","last_active":"2021-10-08T19:23:20.405639+0000","last_peered":"2021-10-08T19:23:20.405639+0000","last_clean":"2021-10-08T19:23:20.405639+0000","last_became_active":"2021-10-08T19:21:25.742909+0000","last_became_peered":"2021-10-08T19:21:25.742909+0000","last_unstale":"2021-10-08T19:23:20.405639+0000","last_undegraded":"2021-10-08T19:23:20.405639+0000","last_fullsized":"2021-10-08T19:23:20.405639+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'18","last_scrub_stamp":"2021-10-08T19:23:20.405525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:20.405525+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039753820000000004,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.046547+0000","last_change":"2021-10-08T19:22:52.021819+0000","last_active":"2021-10-08T19:23:00.046547+0000","last_peered":"2021-10-08T19:23:00.046547+0000","last_clean":"2021-10-08T19:23:00.046547+0000","last_became_active":"2021-10-08T19:21:27.637547+0000","last_became_peered":"2021-10-08T19:21:27.637547+0000","last_unstale":"2021-10-08T19:23:00.046547+0000","last_undegraded":"2021-10-08T19:23:00.046547+0000","last_fullsized":"2021-10-08T19:23:00.046547+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:52.021733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:52.021733+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034012640000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:05.264064+0000","last_change":"2021-10-08T19:23:05.263582+0000","last_active":"2021-10-08T19:23:05.264064+0000","last_peered":"2021-10-08T19:23:05.264064+0000","last_clean":"2021-10-08T19:23:05.264064+0000","last_became_active":"2021-10-08T19:21:29.681295+0000","last_became_peered":"2021-10-08T19:21:29.681295+0000","last_unstale":"2021-10-08T19:23:05.264064+0000","last_undegraded":"2021-10-08T19:23:05.264064+0000","last_fullsized":"2021-10-08T19:23:05.264064+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:05.263508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:05.263508+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034369000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.196200+0000","last_change":"2021-10-08T19:22:49.391329+0000","last_active":"2021-10-08T19:23:00.196200+0000","last_peered":"2021-10-08T19:23:00.196200+0000","last_clean":"2021-10-08T19:23:00.196200+0000","last_became_active":"2021-10-08T19:21:23.606848+0000","last_became_peered":"2021-10-08T19:21:23.606848+0000","last_unstale":"2021-10-08T19:23:00.196200+0000","last_undegraded":"2021-10-08T19:23:00.196200+0000","last_fullsized":"2021-10-08T19:23:00.196200+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:49.391258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:49.391258+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0014044610000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"69'14","reported_seq":62,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.046416+0000","last_change":"2021-10-08T19:22:26.321058+0000","last_active":"2021-10-08T19:23:00.046416+0000","last_peered":"2021-10-08T19:23:00.046416+0000","last_clean":"2021-10-08T19:23:00.046416+0000","last_became_active":"2021-10-08T19:21:25.613140+0000","last_became_peered":"2021-10-08T19:21:25.613140+0000","last_unstale":"2021-10-08T19:23:00.046416+0000","last_undegraded":"2021-10-08T19:23:00.046416+0000","last_fullsized":"2021-10-08T19:23:00.046416+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'14","last_scrub_stamp":"2021-10-08T19:22:26.320928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:26.320928+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0048335899999999996,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"69'8","reported_seq":65,"reported_epoch":89,"state":"active+clean","last_fresh":"2021-10-08T19:23:17.910279+0000","last_change":"2021-10-08T19:21:27.641064+0000","last_active":"2021-10-08T19:23:17.910279+0000","last_peered":"2021-10-08T19:23:17.910279+0000","last_clean":"2021-10-08T19:23:17.910279+0000","last_became_active":"2021-10-08T19:21:27.640694+0000","last_became_peered":"2021-10-08T19:21:27.640694+0000","last_unstale":"2021-10-08T19:23:17.910279+0000","last_undegraded":"2021-10-08T19:23:17.910279+0000","last_fullsized":"2021-10-08T19:23:17.910279+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:21:26.604244+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:17.422728+0000","last_change":"2021-10-08T19:23:17.422256+0000","last_active":"2021-10-08T19:23:17.422728+0000","last_peered":"2021-10-08T19:23:17.422728+0000","last_clean":"2021-10-08T19:23:17.422728+0000","last_became_active":"2021-10-08T19:21:29.679295+0000","last_became_peered":"2021-10-08T19:21:29.679295+0000","last_unstale":"2021-10-08T19:23:17.422728+0000","last_undegraded":"2021-10-08T19:23:17.422728+0000","last_fullsized":"2021-10-08T19:23:17.422728+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:17.422176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:17.422176+0000","last_clean_scrub_stamp":"2021-10-08T19:23:17.422176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0036221249999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:17.689869+0000","last_change":"2021-10-08T19:23:17.689386+0000","last_active":"2021-10-08T19:23:17.689869+0000","last_peered":"2021-10-08T19:23:17.689869+0000","last_clean":"2021-10-08T19:23:17.689869+0000","last_became_active":"2021-10-08T19:21:27.637547+0000","last_became_peered":"2021-10-08T19:21:27.637547+0000","last_unstale":"2021-10-08T19:23:17.689869+0000","last_undegraded":"2021-10-08T19:23:17.689869+0000","last_fullsized":"2021-10-08T19:23:17.689869+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:17.689312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:17.689312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0033939769999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.194005+0000","last_change":"2021-10-08T19:22:29.954439+0000","last_active":"2021-10-08T19:23:00.194005+0000","last_peered":"2021-10-08T19:23:00.194005+0000","last_clean":"2021-10-08T19:23:00.194005+0000","last_became_active":"2021-10-08T19:21:23.606597+0000","last_became_peered":"2021-10-08T19:21:23.606597+0000","last_unstale":"2021-10-08T19:23:00.194005+0000","last_undegraded":"2021-10-08T19:23:00.194005+0000","last_fullsized":"2021-10-08T19:23:00.194005+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:29.954337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:29.954337+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0018351859999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"69'11","reported_seq":60,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:01.988602+0000","last_change":"2021-10-08T19:23:01.988442+0000","last_active":"2021-10-08T19:23:01.988602+0000","last_peered":"2021-10-08T19:23:01.988602+0000","last_clean":"2021-10-08T19:23:01.988602+0000","last_became_active":"2021-10-08T19:21:25.609211+0000","last_became_peered":"2021-10-08T19:21:25.609211+0000","last_unstale":"2021-10-08T19:23:01.988602+0000","last_undegraded":"2021-10-08T19:23:01.988602+0000","last_fullsized":"2021-10-08T19:23:01.988602+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'11","last_scrub_stamp":"2021-10-08T19:23:01.988336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:01.988336+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0026768489999999998,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:22:59.563597+0000","last_change":"2021-10-08T19:22:49.530669+0000","last_active":"2021-10-08T19:22:59.563597+0000","last_peered":"2021-10-08T19:22:59.563597+0000","last_clean":"2021-10-08T19:22:59.563597+0000","last_became_active":"2021-10-08T19:21:29.639358+0000","last_became_peered":"2021-10-08T19:21:29.639358+0000","last_unstale":"2021-10-08T19:22:59.563597+0000","last_undegraded":"2021-10-08T19:22:59.563597+0000","last_fullsized":"2021-10-08T19:22:59.563597+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:49.530586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:49.530586+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0036198910000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"88'9","reported_seq":75,"reported_epoch":89,"state":"active+clean","last_fresh":"2021-10-08T19:23:17.745923+0000","last_change":"2021-10-08T19:23:00.048324+0000","last_active":"2021-10-08T19:23:17.745923+0000","last_peered":"2021-10-08T19:23:17.745923+0000","last_clean":"2021-10-08T19:23:17.745923+0000","last_became_active":"2021-10-08T19:21:27.636432+0000","last_became_peered":"2021-10-08T19:21:27.636432+0000","last_unstale":"2021-10-08T19:23:17.745923+0000","last_undegraded":"2021-10-08T19:23:17.745923+0000","last_fullsized":"2021-10-08T19:23:17.745923+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'9","last_scrub_stamp":"2021-10-08T19:23:00.048245+0000","last_deep_scrub":"88'9","last_deep_scrub_stamp":"2021-10-08T19:23:00.048245+0000","last_clean_scrub_stamp":"2021-10-08T19:23:00.048245+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0031661179999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.251317+0000","last_change":"2021-10-08T19:22:27.212471+0000","last_active":"2021-10-08T19:23:00.251317+0000","last_peered":"2021-10-08T19:23:00.251317+0000","last_clean":"2021-10-08T19:23:00.251317+0000","last_became_active":"2021-10-08T19:21:23.603264+0000","last_became_peered":"2021-10-08T19:21:23.603264+0000","last_unstale":"2021-10-08T19:23:00.251317+0000","last_undegraded":"2021-10-08T19:23:00.251317+0000","last_fullsized":"2021-10-08T19:23:00.251317+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:27.212397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:27.212397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0013817009999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"69'15","reported_seq":66,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.251722+0000","last_change":"2021-10-08T19:22:56.213566+0000","last_active":"2021-10-08T19:23:00.251722+0000","last_peered":"2021-10-08T19:23:00.251722+0000","last_clean":"2021-10-08T19:23:00.251722+0000","last_became_active":"2021-10-08T19:21:25.617776+0000","last_became_peered":"2021-10-08T19:21:25.617776+0000","last_unstale":"2021-10-08T19:23:00.251722+0000","last_undegraded":"2021-10-08T19:23:00.251722+0000","last_fullsized":"2021-10-08T19:23:00.251722+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'15","last_scrub_stamp":"2021-10-08T19:22:56.213493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:56.213493+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039771219999999996,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.046870+0000","last_change":"2021-10-08T19:22:37.292691+0000","last_active":"2021-10-08T19:23:00.046870+0000","last_peered":"2021-10-08T19:23:00.046870+0000","last_clean":"2021-10-08T19:23:00.046870+0000","last_became_active":"2021-10-08T19:21:29.640249+0000","last_became_peered":"2021-10-08T19:21:29.640249+0000","last_unstale":"2021-10-08T19:23:00.046870+0000","last_undegraded":"2021-10-08T19:23:00.046870+0000","last_fullsized":"2021-10-08T19:23:00.046870+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:37.292621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:37.292621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001513517,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"69'8","reported_seq":71,"reported_epoch":89,"state":"active+clean","last_fresh":"2021-10-08T19:23:17.747340+0000","last_change":"2021-10-08T19:23:00.384891+0000","last_active":"2021-10-08T19:23:17.747340+0000","last_peered":"2021-10-08T19:23:17.747340+0000","last_clean":"2021-10-08T19:23:17.747340+0000","last_became_active":"2021-10-08T19:21:27.637930+0000","last_became_peered":"2021-10-08T19:21:27.637930+0000","last_unstale":"2021-10-08T19:23:17.747340+0000","last_undegraded":"2021-10-08T19:23:17.747340+0000","last_fullsized":"2021-10-08T19:23:17.747340+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'8","last_scrub_stamp":"2021-10-08T19:23:00.384808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:00.384808+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040307110000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.251395+0000","last_change":"2021-10-08T19:22:29.177318+0000","last_active":"2021-10-08T19:23:00.251395+0000","last_peered":"2021-10-08T19:23:00.251395+0000","last_clean":"2021-10-08T19:23:00.251395+0000","last_became_active":"2021-10-08T19:21:23.603207+0000","last_became_peered":"2021-10-08T19:21:23.603207+0000","last_unstale":"2021-10-08T19:23:00.251395+0000","last_undegraded":"2021-10-08T19:23:00.251395+0000","last_fullsized":"2021-10-08T19:23:00.251395+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:29.177157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:29.177157+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020581419999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"69'10","reported_seq":56,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.046686+0000","last_change":"2021-10-08T19:22:35.356371+0000","last_active":"2021-10-08T19:23:00.046686+0000","last_peered":"2021-10-08T19:23:00.046686+0000","last_clean":"2021-10-08T19:23:00.046686+0000","last_became_active":"2021-10-08T19:21:25.613155+0000","last_became_peered":"2021-10-08T19:21:25.613155+0000","last_unstale":"2021-10-08T19:23:00.046686+0000","last_undegraded":"2021-10-08T19:23:00.046686+0000","last_fullsized":"2021-10-08T19:23:00.046686+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'10","last_scrub_stamp":"2021-10-08T19:22:35.356292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:35.356292+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040689319999999999,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:10.377559+0000","last_change":"2021-10-08T19:23:10.377105+0000","last_active":"2021-10-08T19:23:10.377559+0000","last_peered":"2021-10-08T19:23:10.377559+0000","last_clean":"2021-10-08T19:23:10.377559+0000","last_became_active":"2021-10-08T19:21:29.646455+0000","last_became_peered":"2021-10-08T19:21:29.646455+0000","last_unstale":"2021-10-08T19:23:10.377559+0000","last_undegraded":"2021-10-08T19:23:10.377559+0000","last_fullsized":"2021-10-08T19:23:10.377559+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:10.377024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:10.377024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0035706969999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.251638+0000","last_change":"2021-10-08T19:22:35.110008+0000","last_active":"2021-10-08T19:23:00.251638+0000","last_peered":"2021-10-08T19:23:00.251638+0000","last_clean":"2021-10-08T19:23:00.251638+0000","last_became_active":"2021-10-08T19:21:27.636429+0000","last_became_peered":"2021-10-08T19:21:27.636429+0000","last_unstale":"2021-10-08T19:23:00.251638+0000","last_undegraded":"2021-10-08T19:23:00.251638+0000","last_fullsized":"2021-10-08T19:23:00.251638+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:35.109928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:35.109928+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001854304,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"61'1","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.194108+0000","last_change":"2021-10-08T19:22:55.080106+0000","last_active":"2021-10-08T19:23:00.194108+0000","last_peered":"2021-10-08T19:23:00.194108+0000","last_clean":"2021-10-08T19:23:00.194108+0000","last_became_active":"2021-10-08T19:21:23.607064+0000","last_became_peered":"2021-10-08T19:21:23.607064+0000","last_unstale":"2021-10-08T19:23:00.194108+0000","last_undegraded":"2021-10-08T19:23:00.194108+0000","last_fullsized":"2021-10-08T19:23:00.194108+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'1","last_scrub_stamp":"2021-10-08T19:22:55.080028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:55.080028+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040037620000000001,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"69'17","reported_seq":69,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.046945+0000","last_change":"2021-10-08T19:22:47.109498+0000","last_active":"2021-10-08T19:23:00.046945+0000","last_peered":"2021-10-08T19:23:00.046945+0000","last_clean":"2021-10-08T19:23:00.046945+0000","last_became_active":"2021-10-08T19:21:25.609086+0000","last_became_peered":"2021-10-08T19:21:25.609086+0000","last_unstale":"2021-10-08T19:23:00.046945+0000","last_undegraded":"2021-10-08T19:23:00.046945+0000","last_fullsized":"2021-10-08T19:23:00.046945+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'17","last_scrub_stamp":"2021-10-08T19:22:47.109407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:47.109407+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0025026100000000002,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:03.272791+0000","last_change":"2021-10-08T19:23:03.272654+0000","last_active":"2021-10-08T19:23:03.272791+0000","last_peered":"2021-10-08T19:23:03.272791+0000","last_clean":"2021-10-08T19:23:03.272791+0000","last_became_active":"2021-10-08T19:21:29.648922+0000","last_became_peered":"2021-10-08T19:21:29.648922+0000","last_unstale":"2021-10-08T19:23:03.272791+0000","last_undegraded":"2021-10-08T19:23:03.272791+0000","last_fullsized":"2021-10-08T19:23:03.272791+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:03.272581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:03.272581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001525874,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:09.420055+0000","last_change":"2021-10-08T19:23:09.419579+0000","last_active":"2021-10-08T19:23:09.420055+0000","last_peered":"2021-10-08T19:23:09.420055+0000","last_clean":"2021-10-08T19:23:09.420055+0000","last_became_active":"2021-10-08T19:21:27.638583+0000","last_became_peered":"2021-10-08T19:21:27.638583+0000","last_unstale":"2021-10-08T19:23:09.420055+0000","last_undegraded":"2021-10-08T19:23:09.420055+0000","last_fullsized":"2021-10-08T19:23:09.420055+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:09.419493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:09.419493+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003406498,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:22:59.569496+0000","last_change":"2021-10-08T19:22:57.380012+0000","last_active":"2021-10-08T19:22:59.569496+0000","last_peered":"2021-10-08T19:22:59.569496+0000","last_clean":"2021-10-08T19:22:59.569496+0000","last_became_active":"2021-10-08T19:21:23.595919+0000","last_became_peered":"2021-10-08T19:21:23.595919+0000","last_unstale":"2021-10-08T19:22:59.569496+0000","last_undegraded":"2021-10-08T19:22:59.569496+0000","last_fullsized":"2021-10-08T19:22:59.569496+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:57.379935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:57.379935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034209349999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"69'19","reported_seq":72,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:00.196536+0000","last_change":"2021-10-08T19:22:39.356624+0000","last_active":"2021-10-08T19:23:00.196536+0000","last_peered":"2021-10-08T19:23:00.196536+0000","last_clean":"2021-10-08T19:23:00.196536+0000","last_became_active":"2021-10-08T19:21:25.741945+0000","last_became_peered":"2021-10-08T19:21:25.741945+0000","last_unstale":"2021-10-08T19:23:00.196536+0000","last_undegraded":"2021-10-08T19:23:00.196536+0000","last_fullsized":"2021-10-08T19:23:00.196536+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'19","last_scrub_stamp":"2021-10-08T19:22:39.356508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:39.356508+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0030817370000000002,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:22:59.568813+0000","last_change":"2021-10-08T19:22:57.644734+0000","last_active":"2021-10-08T19:22:59.568813+0000","last_peered":"2021-10-08T19:22:59.568813+0000","last_clean":"2021-10-08T19:22:59.568813+0000","last_became_active":"2021-10-08T19:21:29.643022+0000","last_became_peered":"2021-10-08T19:21:29.643022+0000","last_unstale":"2021-10-08T19:22:59.568813+0000","last_undegraded":"2021-10-08T19:22:59.568813+0000","last_fullsized":"2021-10-08T19:22:59.568813+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:57.644627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:57.644627+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002174952,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:22:59.569016+0000","last_change":"2021-10-08T19:22:42.359224+0000","last_active":"2021-10-08T19:22:59.569016+0000","last_peered":"2021-10-08T19:22:59.569016+0000","last_clean":"2021-10-08T19:22:59.569016+0000","last_became_active":"2021-10-08T19:21:27.635310+0000","last_became_peered":"2021-10-08T19:21:27.635310+0000","last_unstale":"2021-10-08T19:22:59.569016+0000","last_undegraded":"2021-10-08T19:22:59.569016+0000","last_fullsized":"2021-10-08T19:22:59.569016+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:42.359130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:42.359130+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001847357,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:11.176650+0000","last_change":"2021-10-08T19:23:11.176225+0000","last_active":"2021-10-08T19:23:11.176650+0000","last_peered":"2021-10-08T19:23:11.176650+0000","last_clean":"2021-10-08T19:23:11.176650+0000","last_became_active":"2021-10-08T19:21:23.607639+0000","last_became_peered":"2021-10-08T19:21:23.607639+0000","last_unstale":"2021-10-08T19:23:11.176650+0000","last_undegraded":"2021-10-08T19:23:11.176650+0000","last_fullsized":"2021-10-08T19:23:11.176650+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:11.176122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:11.176122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040114119999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"69'9","reported_seq":57,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:22:59.570012+0000","last_change":"2021-10-08T19:22:36.590210+0000","last_active":"2021-10-08T19:22:59.570012+0000","last_peered":"2021-10-08T19:22:59.570012+0000","last_clean":"2021-10-08T19:22:59.570012+0000","last_became_active":"2021-10-08T19:21:25.610072+0000","last_became_peered":"2021-10-08T19:21:25.610072+0000","last_unstale":"2021-10-08T19:22:59.570012+0000","last_undegraded":"2021-10-08T19:22:59.570012+0000","last_fullsized":"2021-10-08T19:22:59.570012+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'9","last_scrub_stamp":"2021-10-08T19:22:36.590071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:36.590071+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0026030699999999999,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:23:10.805244+0000","last_change":"2021-10-08T19:23:10.805144+0000","last_active":"2021-10-08T19:23:10.805244+0000","last_peered":"2021-10-08T19:23:10.805244+0000","last_clean":"2021-10-08T19:23:10.805244+0000","last_became_active":"2021-10-08T19:21:29.679264+0000","last_became_peered":"2021-10-08T19:21:29.679264+0000","last_unstale":"2021-10-08T19:23:10.805244+0000","last_undegraded":"2021-10-08T19:23:10.805244+0000","last_fullsized":"2021-10-08T19:23:10.805244+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:10.805052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:10.805052+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.00168849,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:22:59.569072+0000","last_change":"2021-10-08T19:22:34.484570+0000","last_active":"2021-10-08T19:22:59.569072+0000","last_peered":"2021-10-08T19:22:59.569072+0000","last_clean":"2021-10-08T19:22:59.569072+0000","last_became_active":"2021-10-08T19:21:23.600352+0000","last_became_peered":"2021-10-08T19:21:23.600352+0000","last_unstale":"2021-10-08T19:22:59.569072+0000","last_undegraded":"2021-10-08T19:22:59.569072+0000","last_fullsized":"2021-10-08T19:22:59.569072+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:34.484488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:34.484488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034565799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"87'22","reported_seq":73,"reported_epoch":88,"state":"active+clean","last_fresh":"2021-10-08T19:22:59.563372+0000","last_change":"2021-10-08T19:22:58.705708+0000","last_active":"2021-10-08T19:22:59.563372+0000","last_peered":"2021-10-08T19:22:59.563372+0000","last_clean":"2021-10-08T19:22:59.563372+0000","last_became_active":"2021-10-08T19:21:25.741675+0000","last_became_peered":"2021-10-08T19:21:25.741675+0000","last_unstale":"2021-10-08T19:22:59.563372+0000","last_undegraded":"2021-10-08T19:22:59.563372+0000","last_fullsized":"2021-10-08T19:22:59.563372+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'22","last_scrub_stamp":"2021-10-08T19:22:58.705632+0000","last_deep_scrub":"87'22","last_deep_scrub_stamp":"2021-10-08T19:22:58.705632+0000","last_clean_scrub_stamp":"2021-10-08T19:22:58.705632+0000","log_size":22,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0051832670000000001,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"69'8","reported_seq":71,"reported_epoch":89,"state":"active+clean","last_fresh":"2021-10-08T19:23:17.911239+0000","last_change":"2021-10-08T19:22:51.066026+0000","last_active":"2021-10-08T19:23:17.911239+0000","last_peered":"2021-10-08T19:23:17.911239+0000","last_clean":"2021-10-08T19:23:17.911239+0000","last_became_active":"2021-10-08T19:21:27.637056+0000","last_became_peered":"2021-10-08T19:21:27.637056+0000","last_unstale":"2021-10-08T19:23:17.911239+0000","last_undegraded":"2021-10-08T19:23:17.911239+0000","last_fullsized":"2021-10-08T19:23:17.911239+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'8","last_scrub_stamp":"2021-10-08T19:22:51.065949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:51.065949+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020224639999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":65,"ondisk_log_size":65,"up":96,"acting":96,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":698,"num_read_kb":455,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":406,"ondisk_log_size":406,"up":96,"acting":96,"num_store_stats":8},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":113,"num_read_kb":108,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201308,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6908,"kb_used_data":1204,"kb_used_omap":0,"kb_used_meta":5696,"kb_avail":93738244,"statfs":{"total":95995035648,"available":95987961856,"internally_reserved":0,"allocated":1232896,"data_stored":885477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5832704},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:23:16 2021","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.46100000000000002,"15min":0.46600000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.69599999999999995,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.622},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.48799999999999999,"15min":0.47699999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":2.5960000000000001,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":0.46600000000000003}]},{"osd":1,"last update":"Fri Oct 8 19:23:16 2021","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.48199999999999998,"15min":0.49099999999999999},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.44},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.52300000000000002,"15min":0.51500000000000001},"min":{"1min":0.30599999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":2.6640000000000001,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.57799999999999996}]},{"osd":2,"last update":"Fri Oct 8 19:23:16 2021","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.48599999999999999,"15min":0.48799999999999999},"min":{"1min":0.313,"5min":0.308,"15min":0.308},"max":{"1min":0.65800000000000003,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.46999999999999997,"15min":0.47399999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.67700000000000005,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.51600000000000001}]},{"osd":3,"last update":"Fri Oct 8 19:23:16 2021","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.48199999999999998,"15min":0.48799999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.70499999999999996,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.52900000000000003,"15min":0.51500000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":2.6299999999999999,"5min":2.6299999999999999,"15min":2.6299999999999999},"last":0.60499999999999998}]},{"osd":4,"last update":"Fri Oct 8 19:23:16 2021","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.46600000000000003,"15min":0.47099999999999997},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.65500000000000003,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45000000000000001,"15min":0.44900000000000001},"min":{"1min":0.313,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68700000000000006,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.38}]},{"osd":5,"last update":"Fri Oct 8 19:23:16 2021","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.47299999999999998,"15min":0.47499999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.65500000000000003,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.50700000000000001,"15min":0.51000000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.73399999999999999,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.34999999999999998}]},{"osd":6,"last update":"Fri Oct 8 19:23:16 2021","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.53300000000000003,"15min":0.51500000000000001},"min":{"1min":0.36499999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":2.4550000000000001,"5min":2.4550000000000001,"15min":2.4550000000000001},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.37,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.36499999999999999}]}]},{"osd":6,"up_from":47,"seq":201863462944,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6880,"kb_used_data":1176,"kb_used_omap":0,"kb_used_meta":5696,"kb_avail":93738272,"statfs":{"total":95995035648,"available":95987990528,"internally_reserved":0,"allocated":1204224,"data_stored":883631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5832704},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:22:56 2021","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.45700000000000002,"15min":0.46400000000000002},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.59099999999999997,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.48699999999999999,"15min":0.49299999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.40200000000000002}]},{"osd":1,"last update":"Fri Oct 8 19:22:56 2021","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.499,"15min":0.504},"min":{"1min":0.34699999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.69799999999999995,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.378},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.39000000000000001}]},{"osd":2,"last update":"Fri Oct 8 19:22:56 2021","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.51600000000000001,"15min":0.52000000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.48399999999999999,"15min":0.48899999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.66600000000000004,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.44500000000000001}]},{"osd":3,"last update":"Fri Oct 8 19:22:56 2021","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.48199999999999998,"15min":0.48799999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.64800000000000002,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.502,"5min":0.501,"15min":0.501},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.44800000000000001}]},{"osd":4,"last update":"Fri Oct 8 19:22:56 2021","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40999999999999998,"15min":0.41199999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.59099999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.433,"5min":0.44500000000000001,"15min":0.44700000000000001},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.56499999999999995,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.40899999999999997}]},{"osd":5,"last update":"Fri Oct 8 19:22:56 2021","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.46700000000000003,"15min":0.46899999999999997},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.67600000000000005,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.436}]},{"osd":7,"last update":"Fri Oct 8 19:23:18 2021","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.49199999999999999,"15min":0.49399999999999999},"min":{"1min":0.32500000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.53300000000000003,"15min":0.54000000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.67600000000000005,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.54200000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":11340,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":10688,"kb_avail":93733812,"statfs":{"total":95995035648,"available":95983423488,"internally_reserved":0,"allocated":659456,"data_stored":294573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":10944512},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:22:30 2021","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.33400000000000002,"15min":0.32900000000000001},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.432,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.309},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.36199999999999999,"15min":0.35999999999999999},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.53400000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.315}]},{"osd":2,"last update":"Fri Oct 8 19:22:52 2021","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.38300000000000001,"15min":0.39400000000000002},"min":{"1min":0.25600000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.53900000000000003,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.42799999999999999,"15min":0.42399999999999999},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.34699999999999998}]},{"osd":3,"last update":"Fri Oct 8 19:23:10 2021","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.438,"15min":0.46000000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.56399999999999995,"5min":0.748,"15min":0.748},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.42799999999999999,"15min":0.45000000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.502,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.34100000000000003}]},{"osd":4,"last update":"Fri Oct 8 19:23:23 2021","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.50600000000000001,"15min":0.51200000000000001},"min":{"1min":0.34699999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.52600000000000002,"15min":0.53500000000000003},"min":{"1min":0.371,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.70599999999999996,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.439}]},{"osd":5,"last update":"Fri Oct 8 19:22:42 2021","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.55200000000000005,"15min":0.56000000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73899999999999999,"5min":0.754,"15min":0.754},"last":0.502},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55700000000000005,"15min":0.55800000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.52000000000000002}]},{"osd":6,"last update":"Fri Oct 8 19:23:00 2021","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53400000000000003,"15min":0.53700000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.64300000000000002,"15min":0.66300000000000003},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.77000000000000002,"5min":2.5219999999999998,"15min":2.5219999999999998},"last":0.53400000000000003}]},{"osd":7,"last update":"Fri Oct 8 19:23:23 2021","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.56200000000000006,"15min":0.56599999999999995},"min":{"1min":0.38900000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.73699999999999999,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.56299999999999994,"15min":0.57099999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.68300000000000005,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.49099999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738422,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7668,"kb_used_data":1196,"kb_used_omap":0,"kb_used_meta":6464,"kb_avail":93737484,"statfs":{"total":95995035648,"available":95987183616,"internally_reserved":0,"allocated":1224704,"data_stored":884036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6619136},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 8 19:22:32 2021","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":0.33000000000000002,"15min":0.32800000000000001},"min":{"1min":0.21199999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.45000000000000001,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.379,"15min":0.371},"min":{"1min":0.25,"5min":0.219,"15min":0.219},"max":{"1min":0.44900000000000001,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.42999999999999999}]},{"osd":2,"last update":"Fri Oct 8 19:22:53 2021","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.38900000000000001,"15min":0.39400000000000002},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.54900000000000004,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.38800000000000001,"15min":0.39600000000000002},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.51900000000000002,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.27800000000000002}]},{"osd":3,"last update":"Fri Oct 8 19:23:05 2021","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.45200000000000001,"15min":0.48299999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.56599999999999995,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.42799999999999999,"15min":0.45200000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.53500000000000003,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.317}]},{"osd":4,"last update":"Fri Oct 8 19:22:23 2021","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.54000000000000004,"15min":0.54300000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.77500000000000002,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.57099999999999995,"15min":0.57899999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.68300000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.55500000000000005}]},{"osd":5,"last update":"Fri Oct 8 19:22:40 2021","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.54700000000000004,"15min":0.55100000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72899999999999998,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.749,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.56000000000000005}]},{"osd":6,"last update":"Fri Oct 8 19:22:59 2021","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.58099999999999996,"15min":0.57899999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.56999999999999995}]},{"osd":7,"last update":"Fri Oct 8 19:23:16 2021","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57699999999999996,"15min":0.57499999999999996},"min":{"1min":0.40799999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.57599999999999996}]}]},{"osd":2,"up_from":18,"seq":77309411374,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6952,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":6336,"kb_avail":93738200,"statfs":{"total":95995035648,"available":95987916800,"internally_reserved":0,"allocated":622592,"data_stored":293939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6488064},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:22:46 2021","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.34200000000000003,"15min":0.34399999999999997},"min":{"1min":0.193,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.371,"5min":0.36599999999999999,"15min":0.35999999999999999},"min":{"1min":0.25800000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.34899999999999998}]},{"osd":1,"last update":"Fri Oct 8 19:22:46 2021","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.36099999999999999,"15min":0.36299999999999999},"min":{"1min":0.24399999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.53900000000000003,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.313},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.40699999999999997,"15min":0.39600000000000002},"min":{"1min":0.28000000000000003,"5min":0.218,"15min":0.218},"max":{"1min":2.2890000000000001,"5min":2.2890000000000001,"15min":2.2890000000000001},"last":0.37}]},{"osd":3,"last update":"Fri Oct 8 19:23:05 2021","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.41999999999999998,"15min":0.442},"min":{"1min":0.26800000000000002,"5min":0.218,"15min":0.218},"max":{"1min":0.50700000000000001,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.40300000000000002,"15min":0.41499999999999998},"min":{"1min":0.248,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.45600000000000002,"5min":0.625,"15min":0.625},"last":0.34000000000000002}]},{"osd":4,"last update":"Fri Oct 8 19:23:21 2021","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.52900000000000003,"15min":0.54600000000000004},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.65400000000000003,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.442},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56299999999999994,"15min":0.57399999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.70699999999999996,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.55300000000000005}]},{"osd":5,"last update":"Fri Oct 8 19:22:40 2021","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.56999999999999995,"15min":0.57599999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.433}]},{"osd":6,"last update":"Fri Oct 8 19:23:05 2021","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.55800000000000005,"15min":0.56499999999999995},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.74099999999999999,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.57899999999999996,"15min":0.58699999999999997},"min":{"1min":0.41699999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.66300000000000003,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.52600000000000002}]},{"osd":7,"last update":"Fri Oct 8 19:23:21 2021","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.55600000000000005,"15min":0.56399999999999995},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.71799999999999997,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.59099999999999997,"15min":0.59999999999999998},"min":{"1min":0.433,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.66200000000000003,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.46000000000000002}]}]},{"osd":3,"up_from":24,"seq":103079215148,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6528,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":5888,"kb_avail":93738624,"statfs":{"total":95995035648,"available":95988350976,"internally_reserved":0,"allocated":647168,"data_stored":294061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6029312},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:23:07 2021","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.34899999999999998,"15min":0.35099999999999998},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.61399999999999999,"5min":1.002,"15min":1.002},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.38200000000000001,"15min":0.39700000000000002},"min":{"1min":0.23000000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.27500000000000002}]},{"osd":1,"last update":"Fri Oct 8 19:23:07 2021","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.39000000000000001,"15min":0.40400000000000003},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.39100000000000001,"15min":0.40699999999999997},"min":{"1min":0.219,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.25800000000000001}]},{"osd":2,"last update":"Fri Oct 8 19:23:07 2021","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.41599999999999998,"15min":0.433},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.42599999999999999,"15min":0.42799999999999999},"min":{"1min":0.27000000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.94199999999999995,"5min":1.026,"15min":1.026},"last":0.30499999999999999}]},{"osd":4,"last update":"Fri Oct 8 19:22:23 2021","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58499999999999996,"15min":0.58599999999999997},"min":{"1min":0.38300000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.0549999999999999,"5min":2.0590000000000002,"15min":2.0590000000000002},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.76000000000000001,"15min":0.79300000000000004},"min":{"1min":0.38400000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.78900000000000003,"5min":3.4670000000000001,"15min":3.4670000000000001},"last":0.35099999999999998}]},{"osd":5,"last update":"Fri Oct 8 19:22:41 2021","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.57799999999999996,"15min":0.58599999999999997},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.746,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.69499999999999995,"15min":0.71599999999999997},"min":{"1min":0.432,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.996,"5min":3.4020000000000001,"15min":3.4020000000000001},"last":0.42299999999999999}]},{"osd":6,"last update":"Fri Oct 8 19:23:02 2021","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":1.5189999999999999,"15min":1.681},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.72899999999999998,"5min":21.538,"15min":21.538},"last":0.377},{"interface":"front","average":{"1min":0.503,"5min":0.55400000000000005,"15min":0.56200000000000006},"min":{"1min":0.377,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.69999999999999996,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.48099999999999998}]},{"osd":7,"last update":"Fri Oct 8 19:23:19 2021","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.58999999999999997,"15min":0.59999999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.66500000000000004,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.59999999999999998,"15min":0.61499999999999999},"min":{"1min":0.39900000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.71599999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.46500000000000002}]}]},{"osd":4,"up_from":30,"seq":128849018920,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6528,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":5888,"kb_avail":93738624,"statfs":{"total":95995035648,"available":95988350976,"internally_reserved":0,"allocated":647168,"data_stored":294973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6029312},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:22:22 2021","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.51900000000000002,"15min":0.52500000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.68500000000000005,"5min":0.755,"15min":0.755},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.505,"5min":0.52100000000000002,"15min":0.52400000000000002},"min":{"1min":0.33300000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.38200000000000001}]},{"osd":1,"last update":"Fri Oct 8 19:22:22 2021","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.51200000000000001,"15min":0.51800000000000002},"min":{"1min":0.316,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.60399999999999998,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.498,"15min":0.505},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.51900000000000002}]},{"osd":2,"last update":"Fri Oct 8 19:22:22 2021","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.50800000000000001,"15min":0.51500000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.497},{"interface":"front","average":{"1min":0.495,"5min":0.52900000000000003,"15min":0.53500000000000003},"min":{"1min":0.33600000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.628,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.48799999999999999}]},{"osd":3,"last update":"Fri Oct 8 19:22:22 2021","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.51200000000000001,"15min":0.51900000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.628,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.52200000000000002,"15min":0.52700000000000002},"min":{"1min":0.376,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.66400000000000003,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.443}]},{"osd":5,"last update":"Fri Oct 8 19:22:43 2021","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.38700000000000001,"15min":0.378},"min":{"1min":0.30499999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.435,"5min":0.39400000000000002,"15min":0.38700000000000001},"min":{"1min":0.28899999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.53700000000000003}]},{"osd":6,"last update":"Fri Oct 8 19:23:00 2021","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.41199999999999998,"15min":0.40500000000000003},"min":{"1min":0.27900000000000003,"5min":0.252,"15min":0.252},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.42899999999999999,"15min":0.42299999999999999},"min":{"1min":0.30499999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.47299999999999998}]},{"osd":7,"last update":"Fri Oct 8 19:23:18 2021","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.47999999999999998,"15min":0.48199999999999998},"min":{"1min":0.33100000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.64500000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.49399999999999999,"15min":0.49199999999999999},"min":{"1min":0.35499999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.66800000000000004,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.52900000000000003}]}]},{"osd":5,"up_from":38,"seq":163208757282,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6308,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":5696,"kb_avail":93738844,"statfs":{"total":95995035648,"available":95988576256,"internally_reserved":0,"allocated":618496,"data_stored":293930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5832704},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:22:42 2021","interfaces":[{"interface":"back","average":{"1min":1.6399999999999999,"5min":0.70399999999999996,"15min":0.54800000000000004},"min":{"1min":0.27700000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":22.966999999999999,"5min":22.966999999999999,"15min":22.966999999999999},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.46300000000000002,"15min":0.46600000000000003},"min":{"1min":0.28499999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.68400000000000005,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.38100000000000001}]},{"osd":1,"last update":"Fri Oct 8 19:22:42 2021","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.48699999999999999,"15min":0.497},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.64900000000000002,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.499,"15min":0.50700000000000001},"min":{"1min":0.30399999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.69499999999999995,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.308}]},{"osd":2,"last update":"Fri Oct 8 19:22:42 2021","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.45900000000000002,"15min":0.46300000000000002},"min":{"1min":0.29999999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.54900000000000004,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.29699999999999999},{"interface":"front","average":{"1min":1.629,"5min":0.72499999999999998,"15min":0.57499999999999996},"min":{"1min":0.30099999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":23.073,"5min":23.073,"15min":23.073},"last":0.36899999999999999}]},{"osd":3,"last update":"Fri Oct 8 19:22:42 2021","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.47999999999999998,"15min":0.48599999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.66800000000000004,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.439,"5min":0.48299999999999998,"15min":0.48999999999999999},"min":{"1min":0.36499999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.64900000000000002,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.42699999999999999}]},{"osd":4,"last update":"Fri Oct 8 19:22:42 2021","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.26300000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.58499999999999996,"5min":0.626,"15min":0.626},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.439,"15min":0.432},"min":{"1min":0.371,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.623,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.45000000000000001}]},{"osd":6,"last update":"Fri Oct 8 19:22:58 2021","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.35599999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.495,"15min":0.497},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.60899999999999999,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.39600000000000002}]},{"osd":7,"last update":"Fri Oct 8 19:23:17 2021","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.5,"15min":0.504},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.55800000000000005,"15min":0.56999999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.64100000000000001,"5min":1.653,"15min":1.653},"last":0.442}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":2008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-10-08T19:23:27.923 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2021-10-08T19:23:27.923 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd dump 2021-10-08T19:23:27.998 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:27 smithi117 conmon[67121]: t=2021-10-08T19:23:27+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 0 v3" 2021-10-08T19:23:27.999 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:27 smithi117 conmon[67121]: t=2021-10-08T19:23:27+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 1 v3" 2021-10-08T19:23:27.999 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:27 smithi117 conmon[67121]: t=2021-10-08T19:23:27+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 2 v3" 2021-10-08T19:23:27.999 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:23:27 smithi117 conmon[64056]: level=warn ts=2021-10-08T19:23:27.888Z caller=main.go:524 msg="Received SIGTERM, exiting gracefully..." 2021-10-08T19:23:28.000 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:23:27 smithi117 conmon[64056]: level=info ts=2021-10-08T19:23:27.888Z caller=main.go:547 msg="Stopping scrape discovery manager..." 2021-10-08T19:23:28.000 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:23:27 smithi117 conmon[64056]: level=info ts=2021-10-08T19:23:27.888Z caller=main.go:561 msg="Stopping notify discovery manager..." 2021-10-08T19:23:28.000 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:23:27 smithi117 conmon[64056]: level=info ts=2021-10-08T19:23:27.888Z caller=main.go:583 msg="Stopping scrape manager..." 2021-10-08T19:23:28.000 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:23:27 smithi117 conmon[64056]: level=info ts=2021-10-08T19:23:27.888Z caller=main.go:557 msg="Notify discovery manager stopped" 2021-10-08T19:23:28.001 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:23:27 smithi117 conmon[64056]: level=info ts=2021-10-08T19:23:27.888Z caller=main.go:543 msg="Scrape discovery manager stopped" 2021-10-08T19:23:28.001 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:23:27 smithi117 conmon[64056]: level=info ts=2021-10-08T19:23:27.888Z caller=manager.go:882 component="rule manager" msg="Stopping rule manager..." 2021-10-08T19:23:28.001 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:23:27 smithi117 conmon[64056]: level=info ts=2021-10-08T19:23:27.888Z caller=main.go:577 msg="Scrape manager stopped" 2021-10-08T19:23:28.001 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:23:27 smithi117 conmon[64056]: level=info ts=2021-10-08T19:23:27.888Z caller=manager.go:892 component="rule manager" msg="Rule manager stopped" 2021-10-08T19:23:28.001 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:23:27 smithi117 conmon[64056]: level=info ts=2021-10-08T19:23:27.889Z caller=notifier.go:601 component=notifier msg="Stopping notification manager..." 2021-10-08T19:23:28.002 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:23:27 smithi117 conmon[64056]: level=info ts=2021-10-08T19:23:27.889Z caller=main.go:749 msg="Notifier manager stopped" 2021-10-08T19:23:28.002 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:23:27 smithi117 conmon[64056]: level=info ts=2021-10-08T19:23:27.889Z caller=main.go:761 msg="See you next time!" 2021-10-08T19:23:28.195 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:23:28.279 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:27 smithi117 conmon[67121]: t=2021-10-08T19:23:27+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 3 v3" 2021-10-08T19:23:28.279 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:28 smithi117 conmon[67121]: t=2021-10-08T19:23:28+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 4 v3" 2021-10-08T19:23:28.581 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:28 smithi117 ceph-mon[34585]: 2.13 scrub ok 2021-10-08T19:23:28.583 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:28 smithi117 ceph-mon[34585]: from='client.24730 v1:172.21.15.97:0/1908568333' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:23:28.583 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:28 smithi117 conmon[67121]: t=2021-10-08T19:23:28+0000 lvl=info msg="Executing migration" logger=migrator id="Update annotation table charset" 2021-10-08T19:23:28.584 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:28 smithi117 conmon[67121]: t=2021-10-08T19:23:28+0000 lvl=info msg="Executing migration" logger=migrator id="Add column region_id to annotation table" 2021-10-08T19:23:28.584 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:28 smithi117 conmon[67121]: t=2021-10-08T19:23:28+0000 lvl=info msg="Executing migration" logger=migrator id="Drop category_id index" 2021-10-08T19:23:28.585 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:28 smithi117 conmon[67121]: t=2021-10-08T19:23:28+0000 lvl=info msg="Executing migration" logger=migrator id="Add column tags to annotation table" 2021-10-08T19:23:28.690 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:28 smithi097 ceph-mon[32687]: 2.13 scrub ok 2021-10-08T19:23:28.690 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:28 smithi097 ceph-mon[32687]: from='client.24730 v1:172.21.15.97:0/1908568333' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:23:28.691 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:28 smithi097 ceph-mon[41966]: 2.13 scrub ok 2021-10-08T19:23:28.691 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:28 smithi097 ceph-mon[41966]: from='client.24730 v1:172.21.15.97:0/1908568333' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:23:28.837 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:23:28 smithi117 bash[68824]: 578d13891bab8a9a49800665a3727a9c64c5964685c855df750df4aa561e3d38 2021-10-08T19:23:28.838 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:23:28 smithi117 bash[68824]: Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-prometheus.a found: no such container 2021-10-08T19:23:28.838 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:23:28 smithi117 systemd[1]: Stopped Ceph prometheus.a for 1d01f6d6-286c-11ec-8c25-001a4aab830c. 2021-10-08T19:23:28.838 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:23:28 smithi117 systemd[1]: Starting Ceph prometheus.a for 1d01f6d6-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:23:28.838 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:28 smithi117 conmon[67121]: t=2021-10-08T19:23:28+0000 lvl=info msg="Executing migration" logger=migrator id="Create annotation_tag table v2" 2021-10-08T19:23:28.839 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:28 smithi117 conmon[67121]: t=2021-10-08T19:23:28+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index annotation_tag.annotation_id_tag_id" 2021-10-08T19:23:28.839 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:28 smithi117 conmon[67121]: t=2021-10-08T19:23:28+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert annotations and set TEXT to empty" 2021-10-08T19:23:28.839 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:28 smithi117 conmon[67121]: t=2021-10-08T19:23:28+0000 lvl=info msg="Executing migration" logger=migrator id="Add created time to annotation table" 2021-10-08T19:23:28.839 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:28 smithi117 conmon[67121]: t=2021-10-08T19:23:28+0000 lvl=info msg="Executing migration" logger=migrator id="Add updated time to annotation table" 2021-10-08T19:23:28.840 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:28 smithi117 conmon[67121]: t=2021-10-08T19:23:28+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for created in annotation table" 2021-10-08T19:23:29.106 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:28 smithi117 conmon[67121]: t=2021-10-08T19:23:28+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for updated in annotation table" 2021-10-08T19:23:29.106 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:28 smithi117 conmon[67121]: t=2021-10-08T19:23:28+0000 lvl=info msg="Executing migration" logger=migrator id="Convert existing annotations from seconds to milliseconds" 2021-10-08T19:23:29.106 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:28 smithi117 conmon[67121]: t=2021-10-08T19:23:28+0000 lvl=info msg="Executing migration" logger=migrator id="Add epoch_end column" 2021-10-08T19:23:29.107 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:29 smithi117 conmon[67121]: t=2021-10-08T19:23:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for epoch_end" 2021-10-08T19:23:29.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:29 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:23:29.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:29 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:23:29.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:29 smithi117 ceph-mon[34585]: 1.0 deep-scrub ok 2021-10-08T19:23:29.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:29 smithi117 ceph-mon[34585]: osdmap e91: 8 total, 8 up, 8 in 2021-10-08T19:23:29.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:29 smithi117 ceph-mon[34585]: pgmap v74: 132 pgs: 132 active+clean; 582 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:23:29.401 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:29 smithi117 conmon[67121]: t=2021-10-08T19:23:29+0000 lvl=info msg="Executing migration" logger=migrator id="Make epoch_end the same as epoch" 2021-10-08T19:23:29.401 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:29 smithi117 conmon[67121]: t=2021-10-08T19:23:29+0000 lvl=info msg="Executing migration" logger=migrator id="Move region to single row" 2021-10-08T19:23:29.401 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:29 smithi117 conmon[67121]: t=2021-10-08T19:23:29+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch from annotation table" 2021-10-08T19:23:29.401 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:29 smithi117 conmon[67121]: t=2021-10-08T19:23:29+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" 2021-10-08T19:23:29.401 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:29 smithi117 conmon[67121]: t=2021-10-08T19:23:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" 2021-10-08T19:23:29.402 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:29 smithi117 conmon[67121]: t=2021-10-08T19:23:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_epoch_end_epoch on annotation table" 2021-10-08T19:23:29.655 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:29 smithi117 conmon[67121]: t=2021-10-08T19:23:29+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch_epoch_end from annotation table" 2021-10-08T19:23:29.655 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:29 smithi117 conmon[67121]: t=2021-10-08T19:23:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for alert_id on annotation table" 2021-10-08T19:23:29.656 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:29 smithi117 conmon[67121]: t=2021-10-08T19:23:29+0000 lvl=info msg="Executing migration" logger=migrator id="create test_data table" 2021-10-08T19:23:29.656 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:29 smithi117 conmon[67121]: t=2021-10-08T19:23:29+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_version table v1" 2021-10-08T19:23:29.656 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:23:29 smithi117 conmon[69189]: level=info ts=2021-10-08T19:23:29.528Z caller=main.go:302 msg="No time or size retention was set so using the default time retention" duration=15d 2021-10-08T19:23:29.656 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:23:29 smithi117 conmon[69189]: level=info ts=2021-10-08T19:23:29.529Z caller=main.go:337 msg="Starting Prometheus" version="(version=2.18.1, branch=HEAD, revision=ecee9c8abfd118f139014cb1b174b08db3f342cf)" 2021-10-08T19:23:29.657 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:23:29 smithi117 conmon[69189]: level=info ts=2021-10-08T19:23:29.529Z caller=main.go:338 build_context="(go=go1.14.2, user=root@2117a9e64a7e, date=20200507-16:51:47)" 2021-10-08T19:23:29.657 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:23:29 smithi117 conmon[69189]: level=info ts=2021-10-08T19:23:29.529Z caller=main.go:339 host_details="(Linux 4.18.0-305.19.1.el8_4.x86_64 #1 SMP Wed Sep 15 15:39:39 UTC 2021 x86_64 smithi117 (none))" 2021-10-08T19:23:29.657 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:23:29 smithi117 conmon[69189]: level=info ts=2021-10-08T19:23:29.529Z caller=main.go:340 fd_limits="(soft=1048576, hard=1048576)" 2021-10-08T19:23:29.658 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:23:29 smithi117 conmon[69189]: level=info ts=2021-10-08T19:23:29.529Z caller=main.go:341 vm_limits="(soft=unlimited, hard=unlimited)" 2021-10-08T19:23:29.658 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:23:29 smithi117 conmon[69189]: level=info ts=2021-10-08T19:23:29.530Z caller=main.go:678 msg="Starting TSDB ..." 2021-10-08T19:23:29.658 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:23:29 smithi117 conmon[69189]: level=info ts=2021-10-08T19:23:29.530Z caller=web.go:523 component=web msg="Start listening for connections" address=:9095 2021-10-08T19:23:29.658 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:23:29 smithi117 conmon[69189]: level=info ts=2021-10-08T19:23:29.532Z caller=head.go:575 component=tsdb msg="Replaying WAL, this may take awhile" 2021-10-08T19:23:29.659 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:23:29 smithi117 conmon[69189]: level=info ts=2021-10-08T19:23:29.542Z caller=head.go:624 component=tsdb msg="WAL segment loaded" segment=0 maxSegment=1 2021-10-08T19:23:29.659 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:23:29 smithi117 conmon[69189]: level=info ts=2021-10-08T19:23:29.542Z caller=head.go:624 component=tsdb msg="WAL segment loaded" segment=1 maxSegment=1 2021-10-08T19:23:29.659 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:23:29 smithi117 conmon[69189]: level=info ts=2021-10-08T19:23:29.542Z caller=head.go:627 component=tsdb msg="WAL replay completed" duration=10.595505ms 2021-10-08T19:23:29.660 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:23:29 smithi117 conmon[69189]: level=info ts=2021-10-08T19:23:29.545Z caller=main.go:694 fs_type=XFS_SUPER_MAGIC 2021-10-08T19:23:29.661 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:23:29 smithi117 conmon[69189]: level=info ts=2021-10-08T19:23:29.545Z caller=main.go:695 msg="TSDB started" 2021-10-08T19:23:29.661 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:23:29 smithi117 conmon[69189]: level=info ts=2021-10-08T19:23:29.545Z caller=main.go:799 msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2021-10-08T19:23:29.661 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:23:29 smithi117 bash[69001]: 90d0e6b6e96db1475ed6fd1c911cd6e405ba143ac853cb17c95536a47b9e71e0 2021-10-08T19:23:29.661 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:23:29 smithi117 systemd[1]: Started Ceph prometheus.a for 1d01f6d6-286c-11ec-8c25-001a4aab830c. 2021-10-08T19:23:29.662 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:23:29 smithi117 conmon[69189]: level=info ts=2021-10-08T19:23:29.551Z caller=main.go:827 msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml 2021-10-08T19:23:29.662 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:23:29 smithi117 conmon[69189]: level=info ts=2021-10-08T19:23:29.551Z caller=main.go:646 msg="Server is ready to receive web requests." 2021-10-08T19:23:29.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:29 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:23:29.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:29 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:23:29.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:29 smithi097 ceph-mon[32687]: 1.0 deep-scrub ok 2021-10-08T19:23:29.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:29 smithi097 ceph-mon[32687]: osdmap e91: 8 total, 8 up, 8 in 2021-10-08T19:23:29.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:29 smithi097 ceph-mon[32687]: pgmap v74: 132 pgs: 132 active+clean; 582 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:23:29.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:29 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:23:29.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:29 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:23:29.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:29 smithi097 ceph-mon[41966]: 1.0 deep-scrub ok 2021-10-08T19:23:29.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:29 smithi097 ceph-mon[41966]: osdmap e91: 8 total, 8 up, 8 in 2021-10-08T19:23:29.725 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:29 smithi097 ceph-mon[41966]: pgmap v74: 132 pgs: 132 active+clean; 582 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:23:29.727 INFO:teuthology.orchestra.run.smithi097.stdout:epoch 91 2021-10-08T19:23:29.727 INFO:teuthology.orchestra.run.smithi097.stdout:fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c 2021-10-08T19:23:29.727 INFO:teuthology.orchestra.run.smithi097.stdout:created 2021-10-08T19:16:25.258003+0000 2021-10-08T19:23:29.727 INFO:teuthology.orchestra.run.smithi097.stdout:modified 2021-10-08T19:23:28.343840+0000 2021-10-08T19:23:29.728 INFO:teuthology.orchestra.run.smithi097.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2021-10-08T19:23:29.728 INFO:teuthology.orchestra.run.smithi097.stdout:crush_version 18 2021-10-08T19:23:29.728 INFO:teuthology.orchestra.run.smithi097.stdout:full_ratio 0.95 2021-10-08T19:23:29.728 INFO:teuthology.orchestra.run.smithi097.stdout:backfillfull_ratio 0.9 2021-10-08T19:23:29.728 INFO:teuthology.orchestra.run.smithi097.stdout:nearfull_ratio 0.85 2021-10-08T19:23:29.729 INFO:teuthology.orchestra.run.smithi097.stdout:require_min_compat_client luminous 2021-10-08T19:23:29.729 INFO:teuthology.orchestra.run.smithi097.stdout:min_compat_client luminous 2021-10-08T19:23:29.729 INFO:teuthology.orchestra.run.smithi097.stdout:require_osd_release quincy 2021-10-08T19:23:29.729 INFO:teuthology.orchestra.run.smithi097.stdout:stretch_mode_enabled false 2021-10-08T19:23:29.730 INFO:teuthology.orchestra.run.smithi097.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_min 1 application mgr 2021-10-08T19:23:29.730 INFO:teuthology.orchestra.run.smithi097.stdout:pool 2 '.rgw.root' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 62 flags hashpspool stripe_width 0 application rgw 2021-10-08T19:23:29.730 INFO:teuthology.orchestra.run.smithi097.stdout:pool 3 'iscsi' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 3 pgp_num 3 autoscale_mode off last_change 63 flags hashpspool stripe_width 0 application rbd 2021-10-08T19:23:29.730 INFO:teuthology.orchestra.run.smithi097.stdout:pool 4 'default.rgw.log' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 64 flags hashpspool stripe_width 0 application rgw 2021-10-08T19:23:29.730 INFO:teuthology.orchestra.run.smithi097.stdout:pool 5 'default.rgw.control' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 66 flags hashpspool stripe_width 0 application rgw 2021-10-08T19:23:29.731 INFO:teuthology.orchestra.run.smithi097.stdout:pool 6 'default.rgw.meta' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 69 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 8 application rgw 2021-10-08T19:23:29.731 INFO:teuthology.orchestra.run.smithi097.stdout:max_osd 8 2021-10-08T19:23:29.731 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0 up in weight 1 up_from 8 up_thru 66 down_at 0 last_clean_interval [0,0) v1:172.21.15.97:6801/3354161282 v1:172.21.15.97:6802/3354161282 exists,up 9e64e714-a5d5-4fbb-ae2b-1df4bf14b8e0 2021-10-08T19:23:29.731 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1 up in weight 1 up_from 13 up_thru 66 down_at 0 last_clean_interval [0,0) v1:172.21.15.97:6805/735799205 v1:172.21.15.97:6806/735799205 exists,up 32602a22-f263-4b62-a8d8-50fddfb73fa8 2021-10-08T19:23:29.732 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2 up in weight 1 up_from 18 up_thru 85 down_at 0 last_clean_interval [0,0) v1:172.21.15.97:6809/2366482649 v1:172.21.15.97:6810/2366482649 exists,up 88e0e4a2-b4a3-4a00-8669-03c3d9b166c5 2021-10-08T19:23:29.732 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3 up in weight 1 up_from 24 up_thru 66 down_at 0 last_clean_interval [0,0) v1:172.21.15.97:6813/3191181122 v1:172.21.15.97:6814/3191181122 exists,up e689d708-b501-4526-a31a-1e598b74654d 2021-10-08T19:23:29.732 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4 up in weight 1 up_from 30 up_thru 85 down_at 0 last_clean_interval [0,0) v1:172.21.15.117:6800/106778208 v1:172.21.15.117:6801/106778208 exists,up 67e4730a-be1c-4d88-9307-e3c2cf3ab2ef 2021-10-08T19:23:29.732 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5 up in weight 1 up_from 38 up_thru 66 down_at 0 last_clean_interval [0,0) v1:172.21.15.117:6804/3199889891 v1:172.21.15.117:6805/3199889891 exists,up f9fd3153-3e4e-4489-8927-a65641f05d42 2021-10-08T19:23:29.732 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6 up in weight 1 up_from 47 up_thru 85 down_at 0 last_clean_interval [0,0) v1:172.21.15.117:6808/2185843951 v1:172.21.15.117:6809/2185843951 exists,up 84898f12-c37d-4eb6-8b71-5b86bfe16e7d 2021-10-08T19:23:29.733 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7 up in weight 1 up_from 55 up_thru 66 down_at 0 last_clean_interval [0,0) v1:172.21.15.117:6812/2817683239 v1:172.21.15.117:6813/2817683239 exists,up 529af2ce-2ae9-41ed-8c8e-d133628cfd20 2021-10-08T19:23:29.733 INFO:teuthology.orchestra.run.smithi097.stdout:pg_upmap_items 2.1a [7,2] 2021-10-08T19:23:29.733 INFO:teuthology.orchestra.run.smithi097.stdout:pg_upmap_items 4.13 [1,2] 2021-10-08T19:23:29.733 INFO:teuthology.orchestra.run.smithi097.stdout:pg_upmap_items 4.18 [1,2] 2021-10-08T19:23:29.734 INFO:teuthology.orchestra.run.smithi097.stdout:pg_upmap_items 4.1c [1,5] 2021-10-08T19:23:29.734 INFO:teuthology.orchestra.run.smithi097.stdout:blocklist 172.21.15.97:0/2600364788 expires 2021-10-09T19:21:42.325540+0000 2021-10-08T19:23:29.734 INFO:teuthology.orchestra.run.smithi097.stdout:blocklist 172.21.15.97:0/4129083289 expires 2021-10-09T19:21:42.325540+0000 2021-10-08T19:23:29.734 INFO:teuthology.orchestra.run.smithi097.stdout:blocklist 172.21.15.97:0/1443158975 expires 2021-10-09T19:21:42.325540+0000 2021-10-08T19:23:29.734 INFO:teuthology.orchestra.run.smithi097.stdout:blocklist 172.21.15.97:0/2472640384 expires 2021-10-09T19:21:42.325540+0000 2021-10-08T19:23:29.735 INFO:teuthology.orchestra.run.smithi097.stdout:blocklist 172.21.15.97:0/3196919488 expires 2021-10-09T19:21:42.325540+0000 2021-10-08T19:23:29.735 INFO:teuthology.orchestra.run.smithi097.stdout:blocklist 172.21.15.97:6800/3195862546 expires 2021-10-09T19:21:42.325540+0000 2021-10-08T19:23:29.735 INFO:teuthology.orchestra.run.smithi097.stdout:blocklist 172.21.15.97:6800/3931202434 expires 2021-10-09T19:17:10.051948+0000 2021-10-08T19:23:29.735 INFO:teuthology.orchestra.run.smithi097.stdout:blocklist 172.21.15.97:0/2761595213 expires 2021-10-09T19:17:10.051948+0000 2021-10-08T19:23:29.736 INFO:teuthology.orchestra.run.smithi097.stdout:blocklist 172.21.15.97:0/900681504 expires 2021-10-09T19:17:10.051948+0000 2021-10-08T19:23:29.736 INFO:teuthology.orchestra.run.smithi097.stdout:blocklist 172.21.15.97:0/3932251406 expires 2021-10-09T19:17:10.051948+0000 2021-10-08T19:23:29.736 INFO:teuthology.orchestra.run.smithi097.stdout:blocklist 172.21.15.97:0/398006785 expires 2021-10-09T19:16:48.651177+0000 2021-10-08T19:23:29.736 INFO:teuthology.orchestra.run.smithi097.stdout:blocklist 172.21.15.97:0/1642570050 expires 2021-10-09T19:16:48.651177+0000 2021-10-08T19:23:29.736 INFO:teuthology.orchestra.run.smithi097.stdout:blocklist 172.21.15.97:0/300178790 expires 2021-10-09T19:16:48.651177+0000 2021-10-08T19:23:29.737 INFO:teuthology.orchestra.run.smithi097.stdout:blocklist 172.21.15.97:6800/845999767 expires 2021-10-09T19:16:48.651177+0000 2021-10-08T19:23:29.922 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:29 smithi117 conmon[67121]: t=2021-10-08T19:23:29+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_version.dashboard_id" 2021-10-08T19:23:29.922 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:29 smithi117 conmon[67121]: t=2021-10-08T19:23:29+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_version.dashboard_id and dashboard_version.version" 2021-10-08T19:23:29.922 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:29 smithi117 conmon[67121]: t=2021-10-08T19:23:29+0000 lvl=info msg="Executing migration" logger=migrator id="Set dashboard version to 1 where 0" 2021-10-08T19:23:29.923 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:29 smithi117 conmon[67121]: t=2021-10-08T19:23:29+0000 lvl=info msg="Executing migration" logger=migrator id="save existing dashboard data in dashboard_version table v1" 2021-10-08T19:23:29.923 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:29 smithi117 conmon[67121]: t=2021-10-08T19:23:29+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_version.data to mediumtext v1" 2021-10-08T19:23:30.172 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:30 smithi117 conmon[67121]: t=2021-10-08T19:23:30+0000 lvl=info msg="Executing migration" logger=migrator id="create team table" 2021-10-08T19:23:30.173 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:30 smithi117 conmon[67121]: t=2021-10-08T19:23:30+0000 lvl=info msg="Executing migration" logger=migrator id="add index team.org_id" 2021-10-08T19:23:30.173 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:30 smithi117 conmon[67121]: t=2021-10-08T19:23:30+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_org_id_name" 2021-10-08T19:23:30.173 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:30 smithi117 conmon[67121]: t=2021-10-08T19:23:30+0000 lvl=info msg="Executing migration" logger=migrator id="create team member table" 2021-10-08T19:23:30.173 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:30 smithi117 conmon[67121]: t=2021-10-08T19:23:30+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_member.org_id" 2021-10-08T19:23:30.312 INFO:tasks.cephadm.ceph_manager.ceph:['osd.0 up in weight 1 up_from 8 up_thru 66 down_at 0 last_clean_interval [0,0) v1:172.21.15.97:6801/3354161282 v1:172.21.15.97:6802/3354161282 exists,up 9e64e714-a5d5-4fbb-ae2b-1df4bf14b8e0', 'osd.1 up in weight 1 up_from 13 up_thru 66 down_at 0 last_clean_interval [0,0) v1:172.21.15.97:6805/735799205 v1:172.21.15.97:6806/735799205 exists,up 32602a22-f263-4b62-a8d8-50fddfb73fa8', 'osd.2 up in weight 1 up_from 18 up_thru 85 down_at 0 last_clean_interval [0,0) v1:172.21.15.97:6809/2366482649 v1:172.21.15.97:6810/2366482649 exists,up 88e0e4a2-b4a3-4a00-8669-03c3d9b166c5', 'osd.3 up in weight 1 up_from 24 up_thru 66 down_at 0 last_clean_interval [0,0) v1:172.21.15.97:6813/3191181122 v1:172.21.15.97:6814/3191181122 exists,up e689d708-b501-4526-a31a-1e598b74654d', 'osd.4 up in weight 1 up_from 30 up_thru 85 down_at 0 last_clean_interval [0,0) v1:172.21.15.117:6800/106778208 v1:172.21.15.117:6801/106778208 exists,up 67e4730a-be1c-4d88-9307-e3c2cf3ab2ef', 'osd.5 up in weight 1 up_from 38 up_thru 66 down_at 0 last_clean_interval [0,0) v1:172.21.15.117:6804/3199889891 v1:172.21.15.117:6805/3199889891 exists,up f9fd3153-3e4e-4489-8927-a65641f05d42', 'osd.6 up in weight 1 up_from 47 up_thru 85 down_at 0 last_clean_interval [0,0) v1:172.21.15.117:6808/2185843951 v1:172.21.15.117:6809/2185843951 exists,up 84898f12-c37d-4eb6-8b71-5b86bfe16e7d', 'osd.7 up in weight 1 up_from 55 up_thru 66 down_at 0 last_clean_interval [0,0) v1:172.21.15.117:6812/2817683239 v1:172.21.15.117:6813/2817683239 exists,up 529af2ce-2ae9-41ed-8c8e-d133628cfd20'] 2021-10-08T19:23:30.313 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon mon.a config show 2021-10-08T19:23:30.462 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:30 smithi117 conmon[67121]: t=2021-10-08T19:23:30+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_member_org_id_team_id_user_id" 2021-10-08T19:23:30.462 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:30 smithi117 conmon[67121]: t=2021-10-08T19:23:30+0000 lvl=info msg="Executing migration" logger=migrator id="Add column email to team table" 2021-10-08T19:23:30.462 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:30 smithi117 conmon[67121]: t=2021-10-08T19:23:30+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external to team_member table" 2021-10-08T19:23:30.463 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:30 smithi117 conmon[67121]: t=2021-10-08T19:23:30+0000 lvl=info msg="Executing migration" logger=migrator id="Add column permission to team_member table" 2021-10-08T19:23:30.463 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:30 smithi117 conmon[67121]: t=2021-10-08T19:23:30+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard acl table" 2021-10-08T19:23:30.463 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:30 smithi117 conmon[67121]: t=2021-10-08T19:23:30+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_dashboard_id" 2021-10-08T19:23:30.464 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:30 smithi117 ceph-mon[34585]: 5.13 scrub ok 2021-10-08T19:23:30.464 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:30 smithi117 ceph-mon[34585]: poll took 6474.894 ms: 1 events 2021-10-08T19:23:30.464 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:30 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:23:30.464 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:30 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-10-08T19:23:30.465 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:30 smithi117 ceph-mon[34585]: from='mon.0 v1:172.21.15.97:0/1599861082' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-10-08T19:23:30.465 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:30 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://127.0.1.1:9093"}]: dispatch 2021-10-08T19:23:30.465 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:30 smithi117 ceph-mon[34585]: from='mon.0 v1:172.21.15.97:0/1599861082' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://127.0.1.1:9093"}]: dispatch 2021-10-08T19:23:30.465 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:30 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:23:30.466 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:30 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-10-08T19:23:30.466 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:30 smithi117 ceph-mon[34585]: from='mon.0 v1:172.21.15.97:0/1599861082' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-10-08T19:23:30.466 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:30 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.117:9095"}]: dispatch 2021-10-08T19:23:30.466 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:30 smithi117 ceph-mon[34585]: from='mon.0 v1:172.21.15.97:0/1599861082' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.117:9095"}]: dispatch 2021-10-08T19:23:30.467 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:30 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:23:30.467 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:30 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-10-08T19:23:30.467 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:30 smithi117 ceph-mon[34585]: from='mon.0 v1:172.21.15.97:0/1599861082' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-10-08T19:23:30.467 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:30 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.117:3000"}]: dispatch 2021-10-08T19:23:30.467 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:30 smithi117 ceph-mon[34585]: from='mon.0 v1:172.21.15.97:0/1599861082' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.117:3000"}]: dispatch 2021-10-08T19:23:30.468 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:30 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:23:30.468 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:30 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:30.468 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:30 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:30.469 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:30 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:30.469 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:30 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:23:30.469 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:30 smithi117 ceph-mon[34585]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:23:30.469 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:30 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:30.470 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:30 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:30.470 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:30 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:30.470 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:30 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:23:30.470 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:30 smithi117 ceph-mon[34585]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:23:30.470 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:30 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1693311621' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2021-10-08T19:23:30.596 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:23:30.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[32687]: 5.13 scrub ok 2021-10-08T19:23:30.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[32687]: poll took 6474.894 ms: 1 events 2021-10-08T19:23:30.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:23:30.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-10-08T19:23:30.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[32687]: from='mon.0 v1:172.21.15.97:0/1599861082' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-10-08T19:23:30.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://127.0.1.1:9093"}]: dispatch 2021-10-08T19:23:30.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[32687]: from='mon.0 v1:172.21.15.97:0/1599861082' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://127.0.1.1:9093"}]: dispatch 2021-10-08T19:23:30.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:23:30.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-10-08T19:23:30.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[32687]: from='mon.0 v1:172.21.15.97:0/1599861082' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-10-08T19:23:30.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.117:9095"}]: dispatch 2021-10-08T19:23:30.724 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[32687]: from='mon.0 v1:172.21.15.97:0/1599861082' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.117:9095"}]: dispatch 2021-10-08T19:23:30.725 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:23:30.725 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-10-08T19:23:30.726 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[32687]: from='mon.0 v1:172.21.15.97:0/1599861082' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-10-08T19:23:30.726 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.117:3000"}]: dispatch 2021-10-08T19:23:30.726 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[32687]: from='mon.0 v1:172.21.15.97:0/1599861082' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.117:3000"}]: dispatch 2021-10-08T19:23:30.726 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:23:30.727 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:30.727 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:30.727 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:30.727 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:23:30.727 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[32687]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:23:30.728 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:30.728 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:30.728 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:30.728 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:23:30.729 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[32687]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:23:30.729 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1693311621' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2021-10-08T19:23:30.729 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[41966]: 5.13 scrub ok 2021-10-08T19:23:30.729 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[41966]: poll took 6474.894 ms: 1 events 2021-10-08T19:23:30.730 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:23:30.730 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-10-08T19:23:30.730 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[41966]: from='mon.0 v1:172.21.15.97:0/1599861082' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-10-08T19:23:30.730 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://127.0.1.1:9093"}]: dispatch 2021-10-08T19:23:30.731 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[41966]: from='mon.0 v1:172.21.15.97:0/1599861082' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://127.0.1.1:9093"}]: dispatch 2021-10-08T19:23:30.731 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:23:30.731 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-10-08T19:23:30.732 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[41966]: from='mon.0 v1:172.21.15.97:0/1599861082' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-10-08T19:23:30.732 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.117:9095"}]: dispatch 2021-10-08T19:23:30.732 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[41966]: from='mon.0 v1:172.21.15.97:0/1599861082' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.117:9095"}]: dispatch 2021-10-08T19:23:30.732 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:23:30.733 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-10-08T19:23:30.733 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[41966]: from='mon.0 v1:172.21.15.97:0/1599861082' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-10-08T19:23:30.733 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.117:3000"}]: dispatch 2021-10-08T19:23:30.733 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[41966]: from='mon.0 v1:172.21.15.97:0/1599861082' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.117:3000"}]: dispatch 2021-10-08T19:23:30.734 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:23:30.734 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:30.734 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:30.734 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:30.735 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:23:30.735 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[41966]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:23:30.735 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:30.735 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:30.736 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:30.736 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:23:30.736 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[41966]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:23:30.736 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:30 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1693311621' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2021-10-08T19:23:30.760 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:30 smithi117 conmon[67121]: t=2021-10-08T19:23:30+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_user_id" 2021-10-08T19:23:30.760 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:30 smithi117 conmon[67121]: t=2021-10-08T19:23:30+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_team_id" 2021-10-08T19:23:30.761 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:30 smithi117 conmon[67121]: t=2021-10-08T19:23:30+0000 lvl=info msg="Executing migration" logger=migrator id="save default acl rules in dashboard_acl table" 2021-10-08T19:23:30.761 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:30 smithi117 conmon[67121]: t=2021-10-08T19:23:30+0000 lvl=info msg="Executing migration" logger=migrator id="create tag table" 2021-10-08T19:23:30.762 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:30 smithi117 conmon[67121]: t=2021-10-08T19:23:30+0000 lvl=info msg="Executing migration" logger=migrator id="add index tag.key_value" 2021-10-08T19:23:31.063 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:30 smithi117 conmon[67121]: t=2021-10-08T19:23:30+0000 lvl=info msg="Executing migration" logger=migrator id="create login attempt table" 2021-10-08T19:23:31.063 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:30 smithi117 conmon[67121]: t=2021-10-08T19:23:30+0000 lvl=info msg="Executing migration" logger=migrator id="add index login_attempt.username" 2021-10-08T19:23:31.064 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:30 smithi117 conmon[67121]: t=2021-10-08T19:23:30+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_login_attempt_username - v1" 2021-10-08T19:23:31.064 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:31 smithi117 conmon[67121]: t=2021-10-08T19:23:31+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" 2021-10-08T19:23:31.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:31 smithi117 ceph-mon[34585]: pgmap v75: 132 pgs: 132 active+clean; 582 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:23:31.655 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:31 smithi117 conmon[67121]: t=2021-10-08T19:23:31+0000 lvl=info msg="Executing migration" logger=migrator id="create login_attempt v2" 2021-10-08T19:23:31.656 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:31 smithi117 conmon[67121]: t=2021-10-08T19:23:31+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_login_attempt_username - v2" 2021-10-08T19:23:31.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:31 smithi097 ceph-mon[32687]: pgmap v75: 132 pgs: 132 active+clean; 582 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:23:31.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:31 smithi097 ceph-mon[41966]: pgmap v75: 132 pgs: 132 active+clean; 582 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:23:32.015 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:31 smithi117 conmon[67121]: t=2021-10-08T19:23:31+0000 lvl=info msg="Executing migration" logger=migrator id="copy login_attempt v1 to v2" 2021-10-08T19:23:32.015 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:31 smithi117 conmon[67121]: t=2021-10-08T19:23:31+0000 lvl=info msg="Executing migration" logger=migrator id="drop login_attempt_tmp_qwerty" 2021-10-08T19:23:32.016 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:31 smithi117 conmon[67121]: t=2021-10-08T19:23:31+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth table" 2021-10-08T19:23:32.016 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:31 smithi117 conmon[67121]: t=2021-10-08T19:23:31+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_user_auth_auth_module_auth_id - v1" 2021-10-08T19:23:32.016 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:32 smithi117 conmon[67121]: t=2021-10-08T19:23:32+0000 lvl=info msg="Executing migration" logger=migrator id="alter user_auth.auth_id to length 190" 2021-10-08T19:23:32.162 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:23:32.163 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "mon.a", 2021-10-08T19:23:32.163 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster": "ceph", 2021-10-08T19:23:32.163 INFO:teuthology.orchestra.run.smithi097.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2021-10-08T19:23:32.163 INFO:teuthology.orchestra.run.smithi097.stdout: "admin_socket_mode": "", 2021-10-08T19:23:32.163 INFO:teuthology.orchestra.run.smithi097.stdout: "auth_allow_insecure_global_id_reclaim": "false", 2021-10-08T19:23:32.164 INFO:teuthology.orchestra.run.smithi097.stdout: "auth_client_required": "cephx, none", 2021-10-08T19:23:32.164 INFO:teuthology.orchestra.run.smithi097.stdout: "auth_cluster_required": "cephx", 2021-10-08T19:23:32.164 INFO:teuthology.orchestra.run.smithi097.stdout: "auth_debug": "true", 2021-10-08T19:23:32.164 INFO:teuthology.orchestra.run.smithi097.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2021-10-08T19:23:32.165 INFO:teuthology.orchestra.run.smithi097.stdout: "auth_mon_ticket_ttl": "660.000000", 2021-10-08T19:23:32.165 INFO:teuthology.orchestra.run.smithi097.stdout: "auth_service_required": "cephx", 2021-10-08T19:23:32.165 INFO:teuthology.orchestra.run.smithi097.stdout: "auth_service_ticket_ttl": "240.000000", 2021-10-08T19:23:32.165 INFO:teuthology.orchestra.run.smithi097.stdout: "auth_supported": "", 2021-10-08T19:23:32.165 INFO:teuthology.orchestra.run.smithi097.stdout: "bdev_aio": "true", 2021-10-08T19:23:32.166 INFO:teuthology.orchestra.run.smithi097.stdout: "bdev_aio_max_queue_depth": "1024", 2021-10-08T19:23:32.166 INFO:teuthology.orchestra.run.smithi097.stdout: "bdev_aio_poll_ms": "250", 2021-10-08T19:23:32.166 INFO:teuthology.orchestra.run.smithi097.stdout: "bdev_aio_reap_max": "16", 2021-10-08T19:23:32.166 INFO:teuthology.orchestra.run.smithi097.stdout: "bdev_async_discard": "false", 2021-10-08T19:23:32.167 INFO:teuthology.orchestra.run.smithi097.stdout: "bdev_block_size": "4096", 2021-10-08T19:23:32.167 INFO:teuthology.orchestra.run.smithi097.stdout: "bdev_debug_aio": "false", 2021-10-08T19:23:32.167 INFO:teuthology.orchestra.run.smithi097.stdout: "bdev_debug_aio_log_age": "5.000000", 2021-10-08T19:23:32.167 INFO:teuthology.orchestra.run.smithi097.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2021-10-08T19:23:32.167 INFO:teuthology.orchestra.run.smithi097.stdout: "bdev_debug_inflight_ios": "false", 2021-10-08T19:23:32.168 INFO:teuthology.orchestra.run.smithi097.stdout: "bdev_enable_discard": "false", 2021-10-08T19:23:32.168 INFO:teuthology.orchestra.run.smithi097.stdout: "bdev_flock_retry": "3", 2021-10-08T19:23:32.168 INFO:teuthology.orchestra.run.smithi097.stdout: "bdev_flock_retry_interval": "0.100000", 2021-10-08T19:23:32.168 INFO:teuthology.orchestra.run.smithi097.stdout: "bdev_inject_crash": "0", 2021-10-08T19:23:32.169 INFO:teuthology.orchestra.run.smithi097.stdout: "bdev_inject_crash_flush_delay": "2", 2021-10-08T19:23:32.169 INFO:teuthology.orchestra.run.smithi097.stdout: "bdev_ioring": "false", 2021-10-08T19:23:32.169 INFO:teuthology.orchestra.run.smithi097.stdout: "bdev_ioring_hipri": "false", 2021-10-08T19:23:32.169 INFO:teuthology.orchestra.run.smithi097.stdout: "bdev_ioring_sqthread_poll": "false", 2021-10-08T19:23:32.170 INFO:teuthology.orchestra.run.smithi097.stdout: "bdev_nvme_unbind_from_kernel": "false", 2021-10-08T19:23:32.170 INFO:teuthology.orchestra.run.smithi097.stdout: "bdev_type": "", 2021-10-08T19:23:32.170 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_alloc_size": "1048576", 2021-10-08T19:23:32.171 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_allocator": "hybrid", 2021-10-08T19:23:32.171 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_buffered_io": "true", 2021-10-08T19:23:32.171 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_check_for_zeros": "false", 2021-10-08T19:23:32.171 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_compact_log_sync": "false", 2021-10-08T19:23:32.172 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2021-10-08T19:23:32.172 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_log_compact_min_size": "16777216", 2021-10-08T19:23:32.172 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_log_replay_check_allocations": "true", 2021-10-08T19:23:32.172 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_max_log_runway": "4194304", 2021-10-08T19:23:32.173 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_max_prefetch": "1048576", 2021-10-08T19:23:32.173 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_min_flush_size": "524288", 2021-10-08T19:23:32.173 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_min_log_runway": "1048576", 2021-10-08T19:23:32.173 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_replay_recovery": "false", 2021-10-08T19:23:32.173 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_replay_recovery_disable_compact": "false", 2021-10-08T19:23:32.174 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_shared_alloc_size": "65536", 2021-10-08T19:23:32.174 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_sync_write": "false", 2021-10-08T19:23:32.174 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2021-10-08T19:23:32.174 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2021-10-08T19:23:32.175 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2021-10-08T19:23:32.176 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_allocation_from_file": "true", 2021-10-08T19:23:32.176 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_allocator": "hybrid", 2021-10-08T19:23:32.176 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2021-10-08T19:23:32.177 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2021-10-08T19:23:32.177 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2021-10-08T19:23:32.177 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2021-10-08T19:23:32.177 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2021-10-08T19:23:32.178 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_bitmapallocator_span_size": "1024", 2021-10-08T19:23:32.178 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_blobid_prealloc": "10240", 2021-10-08T19:23:32.178 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_block_create": "true", 2021-10-08T19:23:32.179 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_block_db_create": "false", 2021-10-08T19:23:32.179 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_block_db_path": "", 2021-10-08T19:23:32.179 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_block_db_size": "0", 2021-10-08T19:23:32.179 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_block_path": "", 2021-10-08T19:23:32.180 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_block_preallocate_file": "false", 2021-10-08T19:23:32.180 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_block_size": "107374182400", 2021-10-08T19:23:32.180 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_block_wal_create": "false", 2021-10-08T19:23:32.180 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_block_wal_path": "", 2021-10-08T19:23:32.181 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_block_wal_size": "100663296", 2021-10-08T19:23:32.181 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_bluefs": "true", 2021-10-08T19:23:32.181 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2021-10-08T19:23:32.181 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_bluefs_env_mirror": "false", 2021-10-08T19:23:32.182 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_bluefs_max_free": "10737418240", 2021-10-08T19:23:32.182 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_autotune": "true", 2021-10-08T19:23:32.182 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_autotune_interval": "5.000000", 2021-10-08T19:23:32.182 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2021-10-08T19:23:32.183 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_kv_ratio": "0.450000", 2021-10-08T19:23:32.183 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_meta_ratio": "0.450000", 2021-10-08T19:23:32.183 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_size": "0", 2021-10-08T19:23:32.183 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_size_hdd": "1073741824", 2021-10-08T19:23:32.184 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_size_ssd": "3221225472", 2021-10-08T19:23:32.184 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_trim_interval": "0.050000", 2021-10-08T19:23:32.184 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2021-10-08T19:23:32.184 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_type": "2q", 2021-10-08T19:23:32.184 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_clone_cow": "true", 2021-10-08T19:23:32.185 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_compression_algorithm": "snappy", 2021-10-08T19:23:32.185 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_compression_max_blob_size": "0", 2021-10-08T19:23:32.185 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2021-10-08T19:23:32.185 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2021-10-08T19:23:32.186 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_compression_min_blob_size": "0", 2021-10-08T19:23:32.186 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2021-10-08T19:23:32.186 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_compression_min_blob_size_ssd": "8192", 2021-10-08T19:23:32.186 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_compression_mode": "none", 2021-10-08T19:23:32.187 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_compression_required_ratio": "0.875000", 2021-10-08T19:23:32.187 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_csum_type": "crc32c", 2021-10-08T19:23:32.187 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_debug_enforce_settings": "default", 2021-10-08T19:23:32.187 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_debug_freelist": "false", 2021-10-08T19:23:32.187 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_debug_fsck_abort": "false", 2021-10-08T19:23:32.188 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_debug_inject_bug21040": "false", 2021-10-08T19:23:32.188 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2021-10-08T19:23:32.188 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_debug_inject_read_err": "false", 2021-10-08T19:23:32.188 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_debug_no_reuse_blocks": "false", 2021-10-08T19:23:32.189 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_debug_omit_block_device_write": "false", 2021-10-08T19:23:32.189 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_debug_omit_kv_commit": "false", 2021-10-08T19:23:32.189 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2021-10-08T19:23:32.189 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_debug_prefill": "0.000000", 2021-10-08T19:23:32.189 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_debug_prefragment_max": "1048576", 2021-10-08T19:23:32.190 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_debug_random_read_err": "0.000000", 2021-10-08T19:23:32.190 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2021-10-08T19:23:32.190 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_debug_small_allocations": "0", 2021-10-08T19:23:32.190 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2021-10-08T19:23:32.191 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_default_buffered_read": "true", 2021-10-08T19:23:32.191 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_default_buffered_write": "false", 2021-10-08T19:23:32.191 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_deferred_batch_ops": "0", 2021-10-08T19:23:32.191 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2021-10-08T19:23:32.192 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2021-10-08T19:23:32.192 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2021-10-08T19:23:32.192 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_extent_map_shard_max_size": "1200", 2021-10-08T19:23:32.192 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_extent_map_shard_min_size": "150", 2021-10-08T19:23:32.192 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_extent_map_shard_target_size": "500", 2021-10-08T19:23:32.193 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2021-10-08T19:23:32.193 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_freelist_blocks_per_key": "128", 2021-10-08T19:23:32.193 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2021-10-08T19:23:32.193 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2021-10-08T19:23:32.194 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2021-10-08T19:23:32.194 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_fsck_on_mkfs": "true", 2021-10-08T19:23:32.194 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2021-10-08T19:23:32.194 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_fsck_on_mount": "false", 2021-10-08T19:23:32.195 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_fsck_on_mount_deep": "false", 2021-10-08T19:23:32.195 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_fsck_on_umount": "false", 2021-10-08T19:23:32.195 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_fsck_on_umount_deep": "false", 2021-10-08T19:23:32.195 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2021-10-08T19:23:32.196 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_fsck_quick_fix_threads": "2", 2021-10-08T19:23:32.196 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2021-10-08T19:23:32.196 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_gc_enable_blob_threshold": "0", 2021-10-08T19:23:32.196 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_gc_enable_total_threshold": "0", 2021-10-08T19:23:32.197 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2021-10-08T19:23:32.197 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_ignore_data_csum": "false", 2021-10-08T19:23:32.197 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2021-10-08T19:23:32.197 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_kvbackend": "rocksdb", 2021-10-08T19:23:32.198 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_log_collection_list_age": "60.000000", 2021-10-08T19:23:32.198 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2021-10-08T19:23:32.198 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_log_op_age": "5.000000", 2021-10-08T19:23:32.198 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_max_alloc_size": "0", 2021-10-08T19:23:32.199 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_max_blob_size": "0", 2021-10-08T19:23:32.199 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_max_blob_size_hdd": "65536", 2021-10-08T19:23:32.199 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_max_blob_size_ssd": "65536", 2021-10-08T19:23:32.199 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_max_defer_interval": "3.000000", 2021-10-08T19:23:32.200 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_max_deferred_txc": "32", 2021-10-08T19:23:32.200 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_min_alloc_size": "0", 2021-10-08T19:23:32.200 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_min_alloc_size_hdd": "4096", 2021-10-08T19:23:32.200 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_min_alloc_size_ssd": "4096", 2021-10-08T19:23:32.200 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_nid_prealloc": "1024", 2021-10-08T19:23:32.201 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_prefer_deferred_size": "0", 2021-10-08T19:23:32.201 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2021-10-08T19:23:32.201 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2021-10-08T19:23:32.201 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_retry_disk_reads": "3", 2021-10-08T19:23:32.202 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_rocksdb_cf": "true", 2021-10-08T19:23:32.202 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L P", 2021-10-08T19:23:32.202 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_rocksdb_options": "compression=kNoCompression,max_write_buffer_number=4,min_write_buffer_number_to_merge=1,recycle_log_file_num=4,write_buffer_size=268435456,writable_file_max_buffer_size=0,compaction_readahead_size=2097152,max_background_compactions=2,max_total_wal_size=1073741824", 2021-10-08T19:23:32.202 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_rocksdb_options_annex": "", 2021-10-08T19:23:32.203 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_spdk_coremask": "0x1", 2021-10-08T19:23:32.203 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_spdk_io_sleep": "5", 2021-10-08T19:23:32.203 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_spdk_max_io_completion": "0", 2021-10-08T19:23:32.203 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_spdk_mem": "512", 2021-10-08T19:23:32.204 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_sync_submit_transaction": "false", 2021-10-08T19:23:32.204 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_throttle_bytes": "67108864", 2021-10-08T19:23:32.204 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_throttle_cost_per_io": "0", 2021-10-08T19:23:32.205 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2021-10-08T19:23:32.205 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2021-10-08T19:23:32.205 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2021-10-08T19:23:32.205 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_throttle_trace_rate": "0.000000", 2021-10-08T19:23:32.206 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_tracing": "false", 2021-10-08T19:23:32.206 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2021-10-08T19:23:32.206 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_volume_selection_reserved": "0", 2021-10-08T19:23:32.206 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2021-10-08T19:23:32.207 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2021-10-08T19:23:32.207 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_warn_on_legacy_statfs": "true", 2021-10-08T19:23:32.207 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2021-10-08T19:23:32.207 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2021-10-08T19:23:32.207 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2021-10-08T19:23:32.208 INFO:teuthology.orchestra.run.smithi097.stdout: "cephadm_path": "/usr/sbin/cephadm", 2021-10-08T19:23:32.208 INFO:teuthology.orchestra.run.smithi097.stdout: "cephfs_mirror_action_update_interval": "2", 2021-10-08T19:23:32.208 INFO:teuthology.orchestra.run.smithi097.stdout: "cephfs_mirror_directory_scan_interval": "10", 2021-10-08T19:23:32.208 INFO:teuthology.orchestra.run.smithi097.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2021-10-08T19:23:32.209 INFO:teuthology.orchestra.run.smithi097.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2021-10-08T19:23:32.209 INFO:teuthology.orchestra.run.smithi097.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2021-10-08T19:23:32.209 INFO:teuthology.orchestra.run.smithi097.stdout: "cephfs_mirror_mount_timeout": "10", 2021-10-08T19:23:32.209 INFO:teuthology.orchestra.run.smithi097.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2021-10-08T19:23:32.209 INFO:teuthology.orchestra.run.smithi097.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2021-10-08T19:23:32.210 INFO:teuthology.orchestra.run.smithi097.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2021-10-08T19:23:32.210 INFO:teuthology.orchestra.run.smithi097.stdout: "cephsqlite_blocklist_dead_locker": "true", 2021-10-08T19:23:32.210 INFO:teuthology.orchestra.run.smithi097.stdout: "cephsqlite_lock_renewal_interval": "2000", 2021-10-08T19:23:32.210 INFO:teuthology.orchestra.run.smithi097.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2021-10-08T19:23:32.211 INFO:teuthology.orchestra.run.smithi097.stdout: "cephx_cluster_require_signatures": "false", 2021-10-08T19:23:32.211 INFO:teuthology.orchestra.run.smithi097.stdout: "cephx_cluster_require_version": "2", 2021-10-08T19:23:32.211 INFO:teuthology.orchestra.run.smithi097.stdout: "cephx_require_signatures": "false", 2021-10-08T19:23:32.211 INFO:teuthology.orchestra.run.smithi097.stdout: "cephx_require_version": "2", 2021-10-08T19:23:32.212 INFO:teuthology.orchestra.run.smithi097.stdout: "cephx_service_require_signatures": "false", 2021-10-08T19:23:32.212 INFO:teuthology.orchestra.run.smithi097.stdout: "cephx_service_require_version": "2", 2021-10-08T19:23:32.212 INFO:teuthology.orchestra.run.smithi097.stdout: "cephx_sign_messages": "true", 2021-10-08T19:23:32.212 INFO:teuthology.orchestra.run.smithi097.stdout: "chdir": "", 2021-10-08T19:23:32.212 INFO:teuthology.orchestra.run.smithi097.stdout: "client_acl_type": "", 2021-10-08T19:23:32.213 INFO:teuthology.orchestra.run.smithi097.stdout: "client_asio_thread_count": "2", 2021-10-08T19:23:32.213 INFO:teuthology.orchestra.run.smithi097.stdout: "client_cache_mid": "0.750000", 2021-10-08T19:23:32.213 INFO:teuthology.orchestra.run.smithi097.stdout: "client_cache_size": "16384", 2021-10-08T19:23:32.213 INFO:teuthology.orchestra.run.smithi097.stdout: "client_caps_release_delay": "5", 2021-10-08T19:23:32.214 INFO:teuthology.orchestra.run.smithi097.stdout: "client_check_pool_perm": "true", 2021-10-08T19:23:32.214 INFO:teuthology.orchestra.run.smithi097.stdout: "client_debug_force_sync_read": "false", 2021-10-08T19:23:32.214 INFO:teuthology.orchestra.run.smithi097.stdout: "client_debug_getattr_caps": "false", 2021-10-08T19:23:32.214 INFO:teuthology.orchestra.run.smithi097.stdout: "client_debug_inject_tick_delay": "0", 2021-10-08T19:23:32.215 INFO:teuthology.orchestra.run.smithi097.stdout: "client_die_on_failed_dentry_invalidate": "true", 2021-10-08T19:23:32.215 INFO:teuthology.orchestra.run.smithi097.stdout: "client_die_on_failed_remount": "false", 2021-10-08T19:23:32.215 INFO:teuthology.orchestra.run.smithi097.stdout: "client_dirsize_rbytes": "true", 2021-10-08T19:23:32.215 INFO:teuthology.orchestra.run.smithi097.stdout: "client_force_lazyio": "false", 2021-10-08T19:23:32.215 INFO:teuthology.orchestra.run.smithi097.stdout: "client_fs": "", 2021-10-08T19:23:32.216 INFO:teuthology.orchestra.run.smithi097.stdout: "client_inject_fixed_oldest_tid": "false", 2021-10-08T19:23:32.216 INFO:teuthology.orchestra.run.smithi097.stdout: "client_inject_release_failure": "false", 2021-10-08T19:23:32.216 INFO:teuthology.orchestra.run.smithi097.stdout: "client_max_inline_size": "4096", 2021-10-08T19:23:32.216 INFO:teuthology.orchestra.run.smithi097.stdout: "client_mds_namespace": "", 2021-10-08T19:23:32.217 INFO:teuthology.orchestra.run.smithi097.stdout: "client_metadata": "", 2021-10-08T19:23:32.217 INFO:teuthology.orchestra.run.smithi097.stdout: "client_mount_gid": "-1", 2021-10-08T19:23:32.217 INFO:teuthology.orchestra.run.smithi097.stdout: "client_mount_timeout": "300.000000", 2021-10-08T19:23:32.217 INFO:teuthology.orchestra.run.smithi097.stdout: "client_mount_uid": "-1", 2021-10-08T19:23:32.217 INFO:teuthology.orchestra.run.smithi097.stdout: "client_mountpoint": "/", 2021-10-08T19:23:32.218 INFO:teuthology.orchestra.run.smithi097.stdout: "client_notify_timeout": "10", 2021-10-08T19:23:32.218 INFO:teuthology.orchestra.run.smithi097.stdout: "client_oc": "true", 2021-10-08T19:23:32.218 INFO:teuthology.orchestra.run.smithi097.stdout: "client_oc_max_dirty": "104857600", 2021-10-08T19:23:32.218 INFO:teuthology.orchestra.run.smithi097.stdout: "client_oc_max_dirty_age": "5.000000", 2021-10-08T19:23:32.219 INFO:teuthology.orchestra.run.smithi097.stdout: "client_oc_max_objects": "1000", 2021-10-08T19:23:32.219 INFO:teuthology.orchestra.run.smithi097.stdout: "client_oc_size": "209715200", 2021-10-08T19:23:32.219 INFO:teuthology.orchestra.run.smithi097.stdout: "client_oc_target_dirty": "8388608", 2021-10-08T19:23:32.219 INFO:teuthology.orchestra.run.smithi097.stdout: "client_permissions": "true", 2021-10-08T19:23:32.220 INFO:teuthology.orchestra.run.smithi097.stdout: "client_quota_df": "true", 2021-10-08T19:23:32.220 INFO:teuthology.orchestra.run.smithi097.stdout: "client_readahead_max_bytes": "0", 2021-10-08T19:23:32.220 INFO:teuthology.orchestra.run.smithi097.stdout: "client_readahead_max_periods": "4", 2021-10-08T19:23:32.220 INFO:teuthology.orchestra.run.smithi097.stdout: "client_readahead_min": "131072", 2021-10-08T19:23:32.220 INFO:teuthology.orchestra.run.smithi097.stdout: "client_reconnect_stale": "false", 2021-10-08T19:23:32.221 INFO:teuthology.orchestra.run.smithi097.stdout: "client_shutdown_timeout": "30", 2021-10-08T19:23:32.221 INFO:teuthology.orchestra.run.smithi097.stdout: "client_snapdir": ".snap", 2021-10-08T19:23:32.221 INFO:teuthology.orchestra.run.smithi097.stdout: "client_tick_interval": "1", 2021-10-08T19:23:32.221 INFO:teuthology.orchestra.run.smithi097.stdout: "client_trace": "", 2021-10-08T19:23:32.222 INFO:teuthology.orchestra.run.smithi097.stdout: "client_try_dentry_invalidate": "false", 2021-10-08T19:23:32.222 INFO:teuthology.orchestra.run.smithi097.stdout: "client_use_faked_inos": "false", 2021-10-08T19:23:32.222 INFO:teuthology.orchestra.run.smithi097.stdout: "client_use_random_mds": "false", 2021-10-08T19:23:32.222 INFO:teuthology.orchestra.run.smithi097.stdout: "clog_to_graylog": "false", 2021-10-08T19:23:32.223 INFO:teuthology.orchestra.run.smithi097.stdout: "clog_to_graylog_host": "127.0.0.1", 2021-10-08T19:23:32.223 INFO:teuthology.orchestra.run.smithi097.stdout: "clog_to_graylog_port": "12201", 2021-10-08T19:23:32.223 INFO:teuthology.orchestra.run.smithi097.stdout: "clog_to_monitors": "default=true", 2021-10-08T19:23:32.223 INFO:teuthology.orchestra.run.smithi097.stdout: "clog_to_syslog": "false", 2021-10-08T19:23:32.223 INFO:teuthology.orchestra.run.smithi097.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2021-10-08T19:23:32.224 INFO:teuthology.orchestra.run.smithi097.stdout: "clog_to_syslog_level": "info", 2021-10-08T19:23:32.224 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "-", 2021-10-08T19:23:32.224 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_network": "", 2021-10-08T19:23:32.224 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_network_interface": "", 2021-10-08T19:23:32.225 INFO:teuthology.orchestra.run.smithi097.stdout: "compressor_zlib_isal": "false", 2021-10-08T19:23:32.225 INFO:teuthology.orchestra.run.smithi097.stdout: "compressor_zlib_level": "5", 2021-10-08T19:23:32.225 INFO:teuthology.orchestra.run.smithi097.stdout: "compressor_zlib_winsize": "-15", 2021-10-08T19:23:32.225 INFO:teuthology.orchestra.run.smithi097.stdout: "compressor_zstd_level": "1", 2021-10-08T19:23:32.225 INFO:teuthology.orchestra.run.smithi097.stdout: "container_image": "quay.ceph.io/ceph-ci/ceph@sha256:b2f2c4c2dd649aad642a7579a3fb89630c03c61d0b31e3dabf8e659344b2becb", 2021-10-08T19:23:32.226 INFO:teuthology.orchestra.run.smithi097.stdout: "crash_dir": "/var/lib/ceph/crash", 2021-10-08T19:23:32.226 INFO:teuthology.orchestra.run.smithi097.stdout: "crimson_alien_op_num_threads": "6", 2021-10-08T19:23:32.226 INFO:teuthology.orchestra.run.smithi097.stdout: "crimson_alien_thread_cpu_cores": "", 2021-10-08T19:23:32.226 INFO:teuthology.orchestra.run.smithi097.stdout: "crimson_osd_obc_lru_size": "10", 2021-10-08T19:23:32.227 INFO:teuthology.orchestra.run.smithi097.stdout: "crimson_osd_scheduler_concurrency": "0", 2021-10-08T19:23:32.227 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_location": "", 2021-10-08T19:23:32.227 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_location_hook": "", 2021-10-08T19:23:32.227 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_location_hook_timeout": "10", 2021-10-08T19:23:32.228 INFO:teuthology.orchestra.run.smithi097.stdout: "daemonize": "false", 2021-10-08T19:23:32.228 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_alienstore": "0/5", 2021-10-08T19:23:32.228 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_allow_any_pool_priority": "false", 2021-10-08T19:23:32.228 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_asok": "1/5", 2021-10-08T19:23:32.228 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_asok_assert_abort": "false", 2021-10-08T19:23:32.229 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_asserts_on_shutdown": "true", 2021-10-08T19:23:32.229 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_auth": "1/5", 2021-10-08T19:23:32.230 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_bdev": "1/3", 2021-10-08T19:23:32.230 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_bluefs": "1/5", 2021-10-08T19:23:32.230 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_bluestore": "1/5", 2021-10-08T19:23:32.230 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_buffer": "0/1", 2021-10-08T19:23:32.231 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_cephfs_mirror": "0/5", 2021-10-08T19:23:32.231 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_cephsqlite": "0/5", 2021-10-08T19:23:32.231 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_civetweb": "1/10", 2021-10-08T19:23:32.231 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_client": "0/5", 2021-10-08T19:23:32.232 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_compressor": "1/5", 2021-10-08T19:23:32.232 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_context": "0/1", 2021-10-08T19:23:32.232 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_crush": "1/1", 2021-10-08T19:23:32.232 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_crypto": "1/5", 2021-10-08T19:23:32.233 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_deliberately_leak_memory": "false", 2021-10-08T19:23:32.233 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_disable_randomized_ping": "false", 2021-10-08T19:23:32.233 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_dpdk": "1/5", 2021-10-08T19:23:32.233 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_eventtrace": "1/5", 2021-10-08T19:23:32.234 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_filer": "0/1", 2021-10-08T19:23:32.234 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_filestore": "1/3", 2021-10-08T19:23:32.234 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_finisher": "1/1", 2021-10-08T19:23:32.234 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_fuse": "1/5", 2021-10-08T19:23:32.235 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_heartbeat_testing_span": "0", 2021-10-08T19:23:32.235 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_heartbeatmap": "1/5", 2021-10-08T19:23:32.235 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_immutable_obj_cache": "0/5", 2021-10-08T19:23:32.235 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_javaclient": "1/5", 2021-10-08T19:23:32.236 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_journal": "1/3", 2021-10-08T19:23:32.236 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_journaler": "0/5", 2021-10-08T19:23:32.236 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_kstore": "1/5", 2021-10-08T19:23:32.236 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_leveldb": "4/5", 2021-10-08T19:23:32.236 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_lockdep": "0/1", 2021-10-08T19:23:32.237 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_mds": "1/5", 2021-10-08T19:23:32.237 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_mds_balancer": "1/5", 2021-10-08T19:23:32.237 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_mds_locker": "1/5", 2021-10-08T19:23:32.237 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_mds_log": "1/5", 2021-10-08T19:23:32.238 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_mds_log_expire": "1/5", 2021-10-08T19:23:32.238 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_mds_migrator": "1/5", 2021-10-08T19:23:32.238 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_memdb": "4/5", 2021-10-08T19:23:32.238 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_mgr": "2/5", 2021-10-08T19:23:32.239 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_mgrc": "1/5", 2021-10-08T19:23:32.239 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_mon": "20/20", 2021-10-08T19:23:32.239 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_monc": "0/10", 2021-10-08T19:23:32.239 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_ms": "1/1", 2021-10-08T19:23:32.239 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_none": "0/5", 2021-10-08T19:23:32.240 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_objclass": "0/5", 2021-10-08T19:23:32.240 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_objectcacher": "0/5", 2021-10-08T19:23:32.240 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_objecter": "0/1", 2021-10-08T19:23:32.240 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_optracker": "0/5", 2021-10-08T19:23:32.241 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_osd": "1/5", 2021-10-08T19:23:32.241 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_paxos": "20/20", 2021-10-08T19:23:32.241 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_perfcounter": "1/5", 2021-10-08T19:23:32.241 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_prioritycache": "1/5", 2021-10-08T19:23:32.241 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_rados": "0/5", 2021-10-08T19:23:32.242 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_rbd": "0/5", 2021-10-08T19:23:32.242 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_rbd_mirror": "0/5", 2021-10-08T19:23:32.242 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_rbd_pwl": "0/5", 2021-10-08T19:23:32.242 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_rbd_replay": "0/5", 2021-10-08T19:23:32.243 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_refs": "0/0", 2021-10-08T19:23:32.243 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_reserver": "1/1", 2021-10-08T19:23:32.243 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_rgw": "1/5", 2021-10-08T19:23:32.243 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_rgw_datacache": "1/5", 2021-10-08T19:23:32.243 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_rgw_sync": "1/5", 2021-10-08T19:23:32.244 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_rocksdb": "4/5", 2021-10-08T19:23:32.244 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_seastore": "0/5", 2021-10-08T19:23:32.244 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_striper": "0/1", 2021-10-08T19:23:32.245 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_test": "0/5", 2021-10-08T19:23:32.245 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_throttle": "1/1", 2021-10-08T19:23:32.245 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_timer": "0/1", 2021-10-08T19:23:32.245 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_tp": "0/5", 2021-10-08T19:23:32.245 INFO:teuthology.orchestra.run.smithi097.stdout: "device_failure_prediction_mode": "none", 2021-10-08T19:23:32.246 INFO:teuthology.orchestra.run.smithi097.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2021-10-08T19:23:32.246 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2021-10-08T19:23:32.246 INFO:teuthology.orchestra.run.smithi097.stdout: "err_to_graylog": "false", 2021-10-08T19:23:32.246 INFO:teuthology.orchestra.run.smithi097.stdout: "err_to_journald": "false", 2021-10-08T19:23:32.247 INFO:teuthology.orchestra.run.smithi097.stdout: "err_to_stderr": "true", 2021-10-08T19:23:32.247 INFO:teuthology.orchestra.run.smithi097.stdout: "err_to_syslog": "false", 2021-10-08T19:23:32.247 INFO:teuthology.orchestra.run.smithi097.stdout: "event_tracing": "false", 2021-10-08T19:23:32.247 INFO:teuthology.orchestra.run.smithi097.stdout: "fake_statfs_for_testing": "0", 2021-10-08T19:23:32.248 INFO:teuthology.orchestra.run.smithi097.stdout: "fatal_signal_handlers": "true", 2021-10-08T19:23:32.248 INFO:teuthology.orchestra.run.smithi097.stdout: "filer_max_purge_ops": "10", 2021-10-08T19:23:32.248 INFO:teuthology.orchestra.run.smithi097.stdout: "filer_max_truncate_ops": "128", 2021-10-08T19:23:32.248 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_apply_finisher_threads": "1", 2021-10-08T19:23:32.248 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_blackhole": "false", 2021-10-08T19:23:32.249 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_btrfs_clone_range": "true", 2021-10-08T19:23:32.249 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_btrfs_snap": "true", 2021-10-08T19:23:32.249 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_caller_concurrency": "10", 2021-10-08T19:23:32.250 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_collect_device_partition_information": "true", 2021-10-08T19:23:32.250 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_commit_timeout": "600.000000", 2021-10-08T19:23:32.250 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_debug_inject_read_err": "false", 2021-10-08T19:23:32.250 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_debug_omap_check": "false", 2021-10-08T19:23:32.251 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_debug_random_read_err": "0.000000", 2021-10-08T19:23:32.251 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_debug_verify_split": "false", 2021-10-08T19:23:32.251 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_dump_file": "", 2021-10-08T19:23:32.251 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2021-10-08T19:23:32.251 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_expected_throughput_ops": "200.000000", 2021-10-08T19:23:32.252 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_fadvise": "true", 2021-10-08T19:23:32.252 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_fail_eio": "true", 2021-10-08T19:23:32.252 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_fd_cache_shards": "16", 2021-10-08T19:23:32.252 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_fd_cache_size": "128", 2021-10-08T19:23:32.253 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_fiemap": "false", 2021-10-08T19:23:32.253 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_fiemap_threshold": "4096", 2021-10-08T19:23:32.253 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_fsync_flushes_journal_data": "false", 2021-10-08T19:23:32.253 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_index_retry_probability": "0.000000", 2021-10-08T19:23:32.253 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_inject_stall": "0", 2021-10-08T19:23:32.254 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_journal_parallel": "false", 2021-10-08T19:23:32.254 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_journal_trailing": "false", 2021-10-08T19:23:32.254 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_journal_writeahead": "false", 2021-10-08T19:23:32.254 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_kill_at": "0", 2021-10-08T19:23:32.255 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_max_alloc_hint_size": "1048576", 2021-10-08T19:23:32.255 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_max_inline_xattr_size": "0", 2021-10-08T19:23:32.255 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2021-10-08T19:23:32.255 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_max_inline_xattr_size_other": "512", 2021-10-08T19:23:32.256 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2021-10-08T19:23:32.256 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_max_inline_xattrs": "0", 2021-10-08T19:23:32.256 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2021-10-08T19:23:32.256 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_max_inline_xattrs_other": "2", 2021-10-08T19:23:32.256 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_max_inline_xattrs_xfs": "10", 2021-10-08T19:23:32.257 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_max_sync_interval": "5.000000", 2021-10-08T19:23:32.257 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_max_xattr_value_size": "0", 2021-10-08T19:23:32.257 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2021-10-08T19:23:32.257 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_max_xattr_value_size_other": "1024", 2021-10-08T19:23:32.258 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2021-10-08T19:23:32.258 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_merge_threshold": "-10", 2021-10-08T19:23:32.258 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_min_sync_interval": "0.010000", 2021-10-08T19:23:32.258 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_odsync_write": "false", 2021-10-08T19:23:32.259 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_omap_backend": "rocksdb", 2021-10-08T19:23:32.259 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_omap_backend_path": "", 2021-10-08T19:23:32.259 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_omap_header_cache_size": "1024", 2021-10-08T19:23:32.259 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_ondisk_finisher_threads": "1", 2021-10-08T19:23:32.260 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_op_thread_suicide_timeout": "180", 2021-10-08T19:23:32.260 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_op_thread_timeout": "60", 2021-10-08T19:23:32.260 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_op_threads": "2", 2021-10-08T19:23:32.260 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_punch_hole": "false", 2021-10-08T19:23:32.260 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2021-10-08T19:23:32.261 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2021-10-08T19:23:32.261 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2021-10-08T19:23:32.261 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_queue_high_threshhold": "0.900000", 2021-10-08T19:23:32.261 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_queue_low_threshhold": "0.300000", 2021-10-08T19:23:32.262 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_queue_max_bytes": "104857600", 2021-10-08T19:23:32.262 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2021-10-08T19:23:32.262 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2021-10-08T19:23:32.262 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2021-10-08T19:23:32.263 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_queue_max_ops": "50", 2021-10-08T19:23:32.263 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2021-10-08T19:23:32.263 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_seek_data_hole": "false", 2021-10-08T19:23:32.263 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_sloppy_crc": "false", 2021-10-08T19:23:32.263 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_sloppy_crc_block_size": "65536", 2021-10-08T19:23:32.264 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_splice": "false", 2021-10-08T19:23:32.264 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_split_multiple": "2", 2021-10-08T19:23:32.264 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_split_rand_factor": "20", 2021-10-08T19:23:32.264 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_update_to": "1000", 2021-10-08T19:23:32.265 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2021-10-08T19:23:32.265 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2021-10-08T19:23:32.265 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2021-10-08T19:23:32.265 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2021-10-08T19:23:32.265 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2021-10-08T19:23:32.266 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2021-10-08T19:23:32.266 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_wbthrottle_enable": "true", 2021-10-08T19:23:32.266 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2021-10-08T19:23:32.266 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2021-10-08T19:23:32.267 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2021-10-08T19:23:32.267 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2021-10-08T19:23:32.267 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2021-10-08T19:23:32.267 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2021-10-08T19:23:32.268 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_xfs_extsize": "false", 2021-10-08T19:23:32.268 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_zfs_snap": "false", 2021-10-08T19:23:32.268 INFO:teuthology.orchestra.run.smithi097.stdout: "fio_dir": "/tmp/fio", 2021-10-08T19:23:32.268 INFO:teuthology.orchestra.run.smithi097.stdout: "fsid": "1d01f6d6-286c-11ec-8c25-001a4aab830c", 2021-10-08T19:23:32.268 INFO:teuthology.orchestra.run.smithi097.stdout: "fuse_allow_other": "true", 2021-10-08T19:23:32.269 INFO:teuthology.orchestra.run.smithi097.stdout: "fuse_atomic_o_trunc": "true", 2021-10-08T19:23:32.269 INFO:teuthology.orchestra.run.smithi097.stdout: "fuse_big_writes": "true", 2021-10-08T19:23:32.269 INFO:teuthology.orchestra.run.smithi097.stdout: "fuse_debug": "false", 2021-10-08T19:23:32.269 INFO:teuthology.orchestra.run.smithi097.stdout: "fuse_default_permissions": "false", 2021-10-08T19:23:32.270 INFO:teuthology.orchestra.run.smithi097.stdout: "fuse_disable_pagecache": "false", 2021-10-08T19:23:32.270 INFO:teuthology.orchestra.run.smithi097.stdout: "fuse_max_write": "0", 2021-10-08T19:23:32.270 INFO:teuthology.orchestra.run.smithi097.stdout: "fuse_multithreaded": "true", 2021-10-08T19:23:32.270 INFO:teuthology.orchestra.run.smithi097.stdout: "fuse_require_active_mds": "true", 2021-10-08T19:23:32.271 INFO:teuthology.orchestra.run.smithi097.stdout: "fuse_set_user_groups": "true", 2021-10-08T19:23:32.271 INFO:teuthology.orchestra.run.smithi097.stdout: "fuse_splice_move": "true", 2021-10-08T19:23:32.271 INFO:teuthology.orchestra.run.smithi097.stdout: "fuse_splice_read": "true", 2021-10-08T19:23:32.271 INFO:teuthology.orchestra.run.smithi097.stdout: "fuse_splice_write": "true", 2021-10-08T19:23:32.272 INFO:teuthology.orchestra.run.smithi097.stdout: "fuse_syncfs_on_mksnap": "true", 2021-10-08T19:23:32.272 INFO:teuthology.orchestra.run.smithi097.stdout: "fuse_use_invalidate_cb": "true", 2021-10-08T19:23:32.272 INFO:teuthology.orchestra.run.smithi097.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2021-10-08T19:23:32.272 INFO:teuthology.orchestra.run.smithi097.stdout: "gss_target_name": "ceph", 2021-10-08T19:23:32.273 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_file": "", 2021-10-08T19:23:32.273 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_inject_failure": "0", 2021-10-08T19:23:32.273 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_interval": "5", 2021-10-08T19:23:32.273 INFO:teuthology.orchestra.run.smithi097.stdout: "host": "smithi097", 2021-10-08T19:23:32.274 INFO:teuthology.orchestra.run.smithi097.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2021-10-08T19:23:32.274 INFO:teuthology.orchestra.run.smithi097.stdout: "immutable_object_cache_max_inflight_ops": "128", 2021-10-08T19:23:32.274 INFO:teuthology.orchestra.run.smithi097.stdout: "immutable_object_cache_max_size": "1073741824", 2021-10-08T19:23:32.274 INFO:teuthology.orchestra.run.smithi097.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2021-10-08T19:23:32.275 INFO:teuthology.orchestra.run.smithi097.stdout: "immutable_object_cache_qos_bps_burst": "0", 2021-10-08T19:23:32.275 INFO:teuthology.orchestra.run.smithi097.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2021-10-08T19:23:32.275 INFO:teuthology.orchestra.run.smithi097.stdout: "immutable_object_cache_qos_bps_limit": "0", 2021-10-08T19:23:32.275 INFO:teuthology.orchestra.run.smithi097.stdout: "immutable_object_cache_qos_iops_burst": "0", 2021-10-08T19:23:32.276 INFO:teuthology.orchestra.run.smithi097.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2021-10-08T19:23:32.276 INFO:teuthology.orchestra.run.smithi097.stdout: "immutable_object_cache_qos_iops_limit": "0", 2021-10-08T19:23:32.276 INFO:teuthology.orchestra.run.smithi097.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2021-10-08T19:23:32.276 INFO:teuthology.orchestra.run.smithi097.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2021-10-08T19:23:32.276 INFO:teuthology.orchestra.run.smithi097.stdout: "immutable_object_cache_watermark": "0.900000", 2021-10-08T19:23:32.277 INFO:teuthology.orchestra.run.smithi097.stdout: "inject_early_sigterm": "false", 2021-10-08T19:23:32.277 INFO:teuthology.orchestra.run.smithi097.stdout: "journal_aio": "true", 2021-10-08T19:23:32.277 INFO:teuthology.orchestra.run.smithi097.stdout: "journal_align_min_size": "65536", 2021-10-08T19:23:32.277 INFO:teuthology.orchestra.run.smithi097.stdout: "journal_block_align": "true", 2021-10-08T19:23:32.278 INFO:teuthology.orchestra.run.smithi097.stdout: "journal_block_size": "4096", 2021-10-08T19:23:32.278 INFO:teuthology.orchestra.run.smithi097.stdout: "journal_dio": "true", 2021-10-08T19:23:32.278 INFO:teuthology.orchestra.run.smithi097.stdout: "journal_discard": "false", 2021-10-08T19:23:32.278 INFO:teuthology.orchestra.run.smithi097.stdout: "journal_force_aio": "false", 2021-10-08T19:23:32.278 INFO:teuthology.orchestra.run.smithi097.stdout: "journal_ignore_corruption": "false", 2021-10-08T19:23:32.279 INFO:teuthology.orchestra.run.smithi097.stdout: "journal_max_write_bytes": "10485760", 2021-10-08T19:23:32.279 INFO:teuthology.orchestra.run.smithi097.stdout: "journal_max_write_entries": "100", 2021-10-08T19:23:32.279 INFO:teuthology.orchestra.run.smithi097.stdout: "journal_replay_from": "0", 2021-10-08T19:23:32.279 INFO:teuthology.orchestra.run.smithi097.stdout: "journal_throttle_high_multiple": "0.000000", 2021-10-08T19:23:32.280 INFO:teuthology.orchestra.run.smithi097.stdout: "journal_throttle_high_threshhold": "0.900000", 2021-10-08T19:23:32.280 INFO:teuthology.orchestra.run.smithi097.stdout: "journal_throttle_low_threshhold": "0.600000", 2021-10-08T19:23:32.280 INFO:teuthology.orchestra.run.smithi097.stdout: "journal_throttle_max_multiple": "0.000000", 2021-10-08T19:23:32.280 INFO:teuthology.orchestra.run.smithi097.stdout: "journal_write_header_frequency": "0", 2021-10-08T19:23:32.280 INFO:teuthology.orchestra.run.smithi097.stdout: "journal_zero_on_create": "false", 2021-10-08T19:23:32.281 INFO:teuthology.orchestra.run.smithi097.stdout: "journaler_prefetch_periods": "10", 2021-10-08T19:23:32.281 INFO:teuthology.orchestra.run.smithi097.stdout: "journaler_prezero_periods": "5", 2021-10-08T19:23:32.281 INFO:teuthology.orchestra.run.smithi097.stdout: "journaler_write_head_interval": "15", 2021-10-08T19:23:32.281 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "", 2021-10-08T19:23:32.282 INFO:teuthology.orchestra.run.smithi097.stdout: "keyfile": "", 2021-10-08T19:23:32.282 INFO:teuthology.orchestra.run.smithi097.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2021-10-08T19:23:32.282 INFO:teuthology.orchestra.run.smithi097.stdout: "kstore_backend": "rocksdb", 2021-10-08T19:23:32.282 INFO:teuthology.orchestra.run.smithi097.stdout: "kstore_default_stripe_size": "65536", 2021-10-08T19:23:32.283 INFO:teuthology.orchestra.run.smithi097.stdout: "kstore_fsck_on_mount": "false", 2021-10-08T19:23:32.283 INFO:teuthology.orchestra.run.smithi097.stdout: "kstore_fsck_on_mount_deep": "true", 2021-10-08T19:23:32.283 INFO:teuthology.orchestra.run.smithi097.stdout: "kstore_max_bytes": "67108864", 2021-10-08T19:23:32.283 INFO:teuthology.orchestra.run.smithi097.stdout: "kstore_max_ops": "512", 2021-10-08T19:23:32.283 INFO:teuthology.orchestra.run.smithi097.stdout: "kstore_nid_prealloc": "1024", 2021-10-08T19:23:32.284 INFO:teuthology.orchestra.run.smithi097.stdout: "kstore_onode_map_size": "1024", 2021-10-08T19:23:32.284 INFO:teuthology.orchestra.run.smithi097.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2021-10-08T19:23:32.284 INFO:teuthology.orchestra.run.smithi097.stdout: "kstore_sync_submit_transaction": "false", 2021-10-08T19:23:32.284 INFO:teuthology.orchestra.run.smithi097.stdout: "kstore_sync_transaction": "false", 2021-10-08T19:23:32.285 INFO:teuthology.orchestra.run.smithi097.stdout: "leveldb_block_size": "65536", 2021-10-08T19:23:32.285 INFO:teuthology.orchestra.run.smithi097.stdout: "leveldb_bloom_size": "0", 2021-10-08T19:23:32.285 INFO:teuthology.orchestra.run.smithi097.stdout: "leveldb_cache_size": "536870912", 2021-10-08T19:23:32.285 INFO:teuthology.orchestra.run.smithi097.stdout: "leveldb_compact_on_mount": "false", 2021-10-08T19:23:32.285 INFO:teuthology.orchestra.run.smithi097.stdout: "leveldb_compression": "false", 2021-10-08T19:23:32.286 INFO:teuthology.orchestra.run.smithi097.stdout: "leveldb_log": "", 2021-10-08T19:23:32.286 INFO:teuthology.orchestra.run.smithi097.stdout: "leveldb_log_to_ceph_log": "true", 2021-10-08T19:23:32.286 INFO:teuthology.orchestra.run.smithi097.stdout: "leveldb_max_open_files": "0", 2021-10-08T19:23:32.286 INFO:teuthology.orchestra.run.smithi097.stdout: "leveldb_paranoid": "false", 2021-10-08T19:23:32.287 INFO:teuthology.orchestra.run.smithi097.stdout: "leveldb_write_buffer_size": "33554432", 2021-10-08T19:23:32.287 INFO:teuthology.orchestra.run.smithi097.stdout: "librados_thread_count": "2", 2021-10-08T19:23:32.287 INFO:teuthology.orchestra.run.smithi097.stdout: "lockdep": "false", 2021-10-08T19:23:32.287 INFO:teuthology.orchestra.run.smithi097.stdout: "lockdep_force_backtrace": "false", 2021-10-08T19:23:32.287 INFO:teuthology.orchestra.run.smithi097.stdout: "log_coarse_timestamps": "true", 2021-10-08T19:23:32.288 INFO:teuthology.orchestra.run.smithi097.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2021-10-08T19:23:32.288 INFO:teuthology.orchestra.run.smithi097.stdout: "log_flush_on_exit": "false", 2021-10-08T19:23:32.288 INFO:teuthology.orchestra.run.smithi097.stdout: "log_graylog_host": "127.0.0.1", 2021-10-08T19:23:32.288 INFO:teuthology.orchestra.run.smithi097.stdout: "log_graylog_port": "12201", 2021-10-08T19:23:32.289 INFO:teuthology.orchestra.run.smithi097.stdout: "log_max_new": "1000", 2021-10-08T19:23:32.289 INFO:teuthology.orchestra.run.smithi097.stdout: "log_max_recent": "10000", 2021-10-08T19:23:32.289 INFO:teuthology.orchestra.run.smithi097.stdout: "log_stderr_prefix": "", 2021-10-08T19:23:32.289 INFO:teuthology.orchestra.run.smithi097.stdout: "log_stop_at_utilization": "0.970000", 2021-10-08T19:23:32.289 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": "true", 2021-10-08T19:23:32.290 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_graylog": "false", 2021-10-08T19:23:32.290 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_journald": "false", 2021-10-08T19:23:32.290 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_stderr": "false", 2021-10-08T19:23:32.290 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_syslog": "false", 2021-10-08T19:23:32.291 INFO:teuthology.orchestra.run.smithi097.stdout: "max_rotating_auth_attempts": "10", 2021-10-08T19:23:32.291 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_action_on_write_error": "1", 2021-10-08T19:23:32.291 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_alternate_name_max": "8192", 2021-10-08T19:23:32.291 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_asio_thread_count": "2", 2021-10-08T19:23:32.292 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_bal_export_pin": "true", 2021-10-08T19:23:32.292 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_bal_fragment_dirs": "true", 2021-10-08T19:23:32.292 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2021-10-08T19:23:32.292 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_bal_fragment_interval": "5", 2021-10-08T19:23:32.292 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_bal_fragment_size_max": "100000", 2021-10-08T19:23:32.293 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_bal_idle_threshold": "0.000000", 2021-10-08T19:23:32.293 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_bal_interval": "10", 2021-10-08T19:23:32.293 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_bal_max": "-1", 2021-10-08T19:23:32.293 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_bal_max_until": "-1", 2021-10-08T19:23:32.294 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_bal_merge_size": "50", 2021-10-08T19:23:32.294 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_bal_midchunk": "0.300000", 2021-10-08T19:23:32.294 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_bal_min_rebalance": "0.100000", 2021-10-08T19:23:32.294 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_bal_min_start": "0.200000", 2021-10-08T19:23:32.295 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_bal_minchunk": "0.001000", 2021-10-08T19:23:32.295 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_bal_mode": "0", 2021-10-08T19:23:32.295 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_bal_need_max": "1.200000", 2021-10-08T19:23:32.296 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_bal_need_min": "0.800000", 2021-10-08T19:23:32.296 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_bal_replicate_threshold": "8000.000000", 2021-10-08T19:23:32.296 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_bal_sample_interval": "3.000000", 2021-10-08T19:23:32.296 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_bal_split_bits": "3", 2021-10-08T19:23:32.296 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_bal_split_rd": "25000.000000", 2021-10-08T19:23:32.297 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_bal_split_size": "10000", 2021-10-08T19:23:32.297 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_bal_split_wr": "10000.000000", 2021-10-08T19:23:32.297 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_bal_target_decay": "10.000000", 2021-10-08T19:23:32.297 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2021-10-08T19:23:32.298 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_beacon_grace": "15.000000", 2021-10-08T19:23:32.298 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_beacon_interval": "4.000000", 2021-10-08T19:23:32.298 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_beacon_mon_down_grace": "60", 2021-10-08T19:23:32.298 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_cache_memory_limit": "4294967296", 2021-10-08T19:23:32.298 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_cache_mid": "0.700000", 2021-10-08T19:23:32.299 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_cache_release_free_interval": "10", 2021-10-08T19:23:32.299 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_cache_reservation": "0.050000", 2021-10-08T19:23:32.299 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_cache_trim_decay_rate": "1.000000", 2021-10-08T19:23:32.299 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_cache_trim_interval": "1", 2021-10-08T19:23:32.300 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_cache_trim_threshold": "262144", 2021-10-08T19:23:32.300 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2021-10-08T19:23:32.300 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2021-10-08T19:23:32.300 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_client_delegate_inos_pct": "50", 2021-10-08T19:23:32.300 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_client_prealloc_inos": "1000", 2021-10-08T19:23:32.301 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2021-10-08T19:23:32.301 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_damage_table_max_entries": "10000", 2021-10-08T19:23:32.301 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2021-10-08T19:23:32.301 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_debug_auth_pins": "false", 2021-10-08T19:23:32.302 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_debug_frag": "false", 2021-10-08T19:23:32.302 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_debug_scatterstat": "false", 2021-10-08T19:23:32.302 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_debug_subtrees": "false", 2021-10-08T19:23:32.302 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_decay_halflife": "5.000000", 2021-10-08T19:23:32.303 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_default_dir_hash": "2", 2021-10-08T19:23:32.303 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_defer_session_stale": "true", 2021-10-08T19:23:32.303 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_deny_all_reconnect": "false", 2021-10-08T19:23:32.304 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_dir_keys_per_op": "16384", 2021-10-08T19:23:32.304 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_dir_max_commit_size": "10", 2021-10-08T19:23:32.304 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_dir_max_entries": "0", 2021-10-08T19:23:32.304 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_dirstat_min_interval": "1.000000", 2021-10-08T19:23:32.305 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_dump_cache_after_rejoin": "false", 2021-10-08T19:23:32.305 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_dump_cache_on_map": "false", 2021-10-08T19:23:32.305 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_dump_cache_threshold_file": "0", 2021-10-08T19:23:32.306 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2021-10-08T19:23:32.306 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_early_reply": "true", 2021-10-08T19:23:32.306 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_enable_op_tracker": "true", 2021-10-08T19:23:32.306 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_enforce_unique_name": "true", 2021-10-08T19:23:32.307 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_export_ephemeral_distributed": "true", 2021-10-08T19:23:32.307 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2021-10-08T19:23:32.307 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_export_ephemeral_random": "true", 2021-10-08T19:23:32.307 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_export_ephemeral_random_max": "0.010000", 2021-10-08T19:23:32.307 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_forward_all_requests_to_auth": "false", 2021-10-08T19:23:32.308 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_freeze_tree_timeout": "30.000000", 2021-10-08T19:23:32.308 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2021-10-08T19:23:32.308 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_health_cache_threshold": "1.500000", 2021-10-08T19:23:32.308 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_health_summarize_threshold": "10", 2021-10-08T19:23:32.309 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_heartbeat_grace": "15.000000", 2021-10-08T19:23:32.309 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_inject_migrator_session_race": "false", 2021-10-08T19:23:32.309 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2021-10-08T19:23:32.309 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_join_fs": "", 2021-10-08T19:23:32.309 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_journal_format": "1", 2021-10-08T19:23:32.310 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_kill_create_at": "0", 2021-10-08T19:23:32.310 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_kill_export_at": "0", 2021-10-08T19:23:32.310 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_kill_import_at": "0", 2021-10-08T19:23:32.310 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_kill_journal_at": "0", 2021-10-08T19:23:32.311 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_kill_journal_expire_at": "0", 2021-10-08T19:23:32.311 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_kill_journal_replay_at": "0", 2021-10-08T19:23:32.311 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_kill_link_at": "0", 2021-10-08T19:23:32.311 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_kill_mdstable_at": "0", 2021-10-08T19:23:32.312 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_kill_openc_at": "0", 2021-10-08T19:23:32.312 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_kill_rename_at": "0", 2021-10-08T19:23:32.312 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_log_events_per_segment": "1024", 2021-10-08T19:23:32.312 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_log_max_events": "-1", 2021-10-08T19:23:32.313 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_log_max_segments": "128", 2021-10-08T19:23:32.313 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_log_pause": "false", 2021-10-08T19:23:32.313 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_log_segment_size": "0", 2021-10-08T19:23:32.313 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_log_skip_corrupt_events": "false", 2021-10-08T19:23:32.314 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_log_warn_factor": "2.000000", 2021-10-08T19:23:32.314 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_max_caps_per_client": "1048576", 2021-10-08T19:23:32.314 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_max_completed_flushes": "100000", 2021-10-08T19:23:32.314 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_max_completed_requests": "100000", 2021-10-08T19:23:32.314 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_max_export_size": "20971520", 2021-10-08T19:23:32.315 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_max_file_recover": "32", 2021-10-08T19:23:32.315 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_max_purge_files": "64", 2021-10-08T19:23:32.315 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_max_purge_ops": "8192", 2021-10-08T19:23:32.315 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2021-10-08T19:23:32.316 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_max_retries_on_remount_failure": "5", 2021-10-08T19:23:32.316 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_max_scrub_ops_in_progress": "5", 2021-10-08T19:23:32.316 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_max_snaps_per_dir": "100", 2021-10-08T19:23:32.316 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_max_xattr_pairs_size": "65536", 2021-10-08T19:23:32.316 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_metrics_update_interval": "2", 2021-10-08T19:23:32.317 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_min_caps_per_client": "100", 2021-10-08T19:23:32.317 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_min_caps_working_set": "10000", 2021-10-08T19:23:32.317 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_mon_shutdown_timeout": "5.000000", 2021-10-08T19:23:32.317 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_numa_node": "-1", 2021-10-08T19:23:32.318 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_oft_prefetch_dirfrags": "true", 2021-10-08T19:23:32.318 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_op_complaint_time": "30.000000", 2021-10-08T19:23:32.318 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_op_history_duration": "600", 2021-10-08T19:23:32.318 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_op_history_size": "20", 2021-10-08T19:23:32.319 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_op_log_threshold": "5", 2021-10-08T19:23:32.319 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_ping_grace": "15", 2021-10-08T19:23:32.319 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_ping_interval": "5", 2021-10-08T19:23:32.319 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2021-10-08T19:23:32.320 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_recall_global_max_decay_threshold": "131072", 2021-10-08T19:23:32.320 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_recall_max_caps": "30000", 2021-10-08T19:23:32.320 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_recall_max_decay_rate": "1.500000", 2021-10-08T19:23:32.320 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_recall_max_decay_threshold": "131072", 2021-10-08T19:23:32.321 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_recall_warning_decay_rate": "60.000000", 2021-10-08T19:23:32.321 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_recall_warning_threshold": "262144", 2021-10-08T19:23:32.321 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_reconnect_timeout": "45.000000", 2021-10-08T19:23:32.321 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_replay_interval": "1.000000", 2021-10-08T19:23:32.322 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_replay_unsafe_with_closed_session": "false", 2021-10-08T19:23:32.322 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_request_load_average_decay_rate": "60.000000", 2021-10-08T19:23:32.322 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_root_ino_gid": "0", 2021-10-08T19:23:32.322 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_root_ino_uid": "0", 2021-10-08T19:23:32.323 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_scatter_nudge_interval": "5.000000", 2021-10-08T19:23:32.323 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_session_blocklist_on_evict": "true", 2021-10-08T19:23:32.323 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_session_blocklist_on_timeout": "true", 2021-10-08T19:23:32.323 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2021-10-08T19:23:32.324 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_session_cache_liveness_magnitude": "10", 2021-10-08T19:23:32.324 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_session_cap_acquisition_decay_rate": "10.000000", 2021-10-08T19:23:32.324 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_session_cap_acquisition_throttle": "500000", 2021-10-08T19:23:32.324 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2021-10-08T19:23:32.325 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_sessionmap_keys_per_op": "1024", 2021-10-08T19:23:32.325 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_shutdown_check": "0", 2021-10-08T19:23:32.326 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_skip_ino": "0", 2021-10-08T19:23:32.326 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_snap_max_uid": "4294967294", 2021-10-08T19:23:32.326 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_snap_min_uid": "0", 2021-10-08T19:23:32.326 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_snap_rstat": "false", 2021-10-08T19:23:32.327 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_standby_replay_damaged": "false", 2021-10-08T19:23:32.327 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_task_status_update_interval": "2.000000", 2021-10-08T19:23:32.327 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_thrash_exports": "0", 2021-10-08T19:23:32.327 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_thrash_fragments": "0", 2021-10-08T19:23:32.328 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_tick_interval": "5.000000", 2021-10-08T19:23:32.328 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_valgrind_exit": "false", 2021-10-08T19:23:32.328 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_verify_backtrace": "1", 2021-10-08T19:23:32.328 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_verify_scatter": "false", 2021-10-08T19:23:32.329 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_wipe_ino_prealloc": "false", 2021-10-08T19:23:32.329 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_wipe_sessions": "false", 2021-10-08T19:23:32.329 INFO:teuthology.orchestra.run.smithi097.stdout: "mempool_debug": "false", 2021-10-08T19:23:32.330 INFO:teuthology.orchestra.run.smithi097.stdout: "memstore_debug_omit_block_device_write": "false", 2021-10-08T19:23:32.330 INFO:teuthology.orchestra.run.smithi097.stdout: "memstore_device_bytes": "1073741824", 2021-10-08T19:23:32.330 INFO:teuthology.orchestra.run.smithi097.stdout: "memstore_page_set": "false", 2021-10-08T19:23:32.331 INFO:teuthology.orchestra.run.smithi097.stdout: "memstore_page_size": "65536", 2021-10-08T19:23:32.331 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr_client_bytes": "134217728", 2021-10-08T19:23:32.331 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr_client_messages": "512", 2021-10-08T19:23:32.331 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2021-10-08T19:23:32.332 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr_connect_retry_interval": "1.000000", 2021-10-08T19:23:32.332 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2021-10-08T19:23:32.332 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2021-10-08T19:23:32.332 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr_disabled_modules": "", 2021-10-08T19:23:32.333 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr_initial_modules": "restful iostat nfs", 2021-10-08T19:23:32.333 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr_mds_bytes": "134217728", 2021-10-08T19:23:32.333 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr_mds_messages": "128", 2021-10-08T19:23:32.333 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2021-10-08T19:23:32.334 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr_mon_bytes": "134217728", 2021-10-08T19:23:32.334 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr_mon_messages": "128", 2021-10-08T19:23:32.334 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr_osd_bytes": "536870912", 2021-10-08T19:23:32.334 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr_osd_messages": "8192", 2021-10-08T19:23:32.334 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr_pool": "true", 2021-10-08T19:23:32.335 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr_service_beacon_grace": "60.000000", 2021-10-08T19:23:32.335 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr_standby_modules": "true", 2021-10-08T19:23:32.335 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr_stats_period": "5", 2021-10-08T19:23:32.335 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr_stats_threshold": "5", 2021-10-08T19:23:32.336 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr_tick_period": "2", 2021-10-08T19:23:32.336 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_accept_timeout_factor": "2.000000", 2021-10-08T19:23:32.336 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_allow_pool_delete": "true", 2021-10-08T19:23:32.336 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_allow_pool_size_one": "false", 2021-10-08T19:23:32.336 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_auth_validate_all_caps": "true", 2021-10-08T19:23:32.337 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2021-10-08T19:23:32.337 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2021-10-08T19:23:32.337 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_client_bytes": "104857600", 2021-10-08T19:23:32.337 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_client_directed_command_retry": "2", 2021-10-08T19:23:32.338 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_client_hunt_interval": "3.000000", 2021-10-08T19:23:32.338 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2021-10-08T19:23:32.338 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2021-10-08T19:23:32.338 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2021-10-08T19:23:32.339 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_client_hunt_parallel": "3", 2021-10-08T19:23:32.339 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_client_log_interval": "1.000000", 2021-10-08T19:23:32.339 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_client_max_log_entries_per_message": "1000", 2021-10-08T19:23:32.339 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_client_ping_interval": "10.000000", 2021-10-08T19:23:32.339 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_client_ping_timeout": "30.000000", 2021-10-08T19:23:32.340 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_clock_drift_allowed": "1.000000", 2021-10-08T19:23:32.340 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2021-10-08T19:23:32.340 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2021-10-08T19:23:32.340 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_cluster_log_file_level": "debug", 2021-10-08T19:23:32.341 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_cluster_log_to_file": "false", 2021-10-08T19:23:32.341 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_cluster_log_to_graylog": "false", 2021-10-08T19:23:32.341 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2021-10-08T19:23:32.341 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_cluster_log_to_graylog_port": "12201", 2021-10-08T19:23:32.341 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_cluster_log_to_journald": "true", 2021-10-08T19:23:32.342 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_cluster_log_to_stderr": "false", 2021-10-08T19:23:32.342 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_cluster_log_to_syslog": "default=false", 2021-10-08T19:23:32.342 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2021-10-08T19:23:32.342 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_cluster_log_to_syslog_level": "info", 2021-10-08T19:23:32.343 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_compact_on_bootstrap": "false", 2021-10-08T19:23:32.343 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_compact_on_start": "false", 2021-10-08T19:23:32.343 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_compact_on_trim": "true", 2021-10-08T19:23:32.343 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_con_tracker_persist_interval": "10", 2021-10-08T19:23:32.344 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_con_tracker_score_halflife": "43200", 2021-10-08T19:23:32.344 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_config_key_max_entry_size": "65536", 2021-10-08T19:23:32.344 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_cpu_threads": "4", 2021-10-08T19:23:32.344 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_crush_min_required_version": "hammer", 2021-10-08T19:23:32.344 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_daemon_bytes": "419430400", 2021-10-08T19:23:32.345 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2021-10-08T19:23:32.345 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_data_avail_crit": "5", 2021-10-08T19:23:32.345 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_data_avail_warn": "5", 2021-10-08T19:23:32.345 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_data_size_warn": "16106127360", 2021-10-08T19:23:32.346 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_debug_block_osdmap_trim": "false", 2021-10-08T19:23:32.346 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_debug_deprecated_as_obsolete": "false", 2021-10-08T19:23:32.346 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_debug_dump_json": "false", 2021-10-08T19:23:32.346 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2021-10-08T19:23:32.346 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_debug_dump_transactions": "false", 2021-10-08T19:23:32.347 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_debug_extra_checks": "false", 2021-10-08T19:23:32.347 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_debug_no_initial_persistent_features": "false", 2021-10-08T19:23:32.347 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2021-10-08T19:23:32.347 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_debug_no_require_pacific": "false", 2021-10-08T19:23:32.348 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_debug_no_require_quincy": "false", 2021-10-08T19:23:32.348 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2021-10-08T19:23:32.348 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_delta_reset_interval": "10.000000", 2021-10-08T19:23:32.348 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_dns_srv_name": "ceph-mon", 2021-10-08T19:23:32.348 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_down_mkfs_grace": "60", 2021-10-08T19:23:32.349 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_election_default_strategy": "1", 2021-10-08T19:23:32.349 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_election_timeout": "5.000000", 2021-10-08T19:23:32.349 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2021-10-08T19:23:32.349 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_elector_ping_divisor": "2", 2021-10-08T19:23:32.350 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_elector_ping_timeout": "2.000000", 2021-10-08T19:23:32.350 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_enable_op_tracker": "true", 2021-10-08T19:23:32.350 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_fake_pool_delete": "false", 2021-10-08T19:23:32.350 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_force_quorum_join": "false", 2021-10-08T19:23:32.350 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_globalid_prealloc": "10000", 2021-10-08T19:23:32.351 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_health_detail_to_clog": "true", 2021-10-08T19:23:32.351 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_health_log_update_period": "5", 2021-10-08T19:23:32.351 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_health_max_detail": "50", 2021-10-08T19:23:32.351 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_health_to_clog": "true", 2021-10-08T19:23:32.352 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_health_to_clog_interval": "600", 2021-10-08T19:23:32.352 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2021-10-08T19:23:32.352 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_host": "172.21.15.97:6789/0", 2021-10-08T19:23:32.352 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_host_override": "", 2021-10-08T19:23:32.353 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_initial_members": "", 2021-10-08T19:23:32.353 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2021-10-08T19:23:32.353 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2021-10-08T19:23:32.353 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_inject_transaction_delay_max": "10.000000", 2021-10-08T19:23:32.354 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2021-10-08T19:23:32.354 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_keyvaluedb": "rocksdb", 2021-10-08T19:23:32.354 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_lease": "5.000000", 2021-10-08T19:23:32.354 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2021-10-08T19:23:32.355 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_lease_renew_interval_factor": "0.600000", 2021-10-08T19:23:32.355 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_log_full_interval": "50", 2021-10-08T19:23:32.355 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_log_max": "10000", 2021-10-08T19:23:32.355 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_log_max_summary": "50", 2021-10-08T19:23:32.355 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_max_log_entries_per_event": "4096", 2021-10-08T19:23:32.356 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_max_log_epochs": "500", 2021-10-08T19:23:32.356 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_max_mdsmap_epochs": "500", 2021-10-08T19:23:32.356 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_max_mgrmap_epochs": "500", 2021-10-08T19:23:32.356 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_max_osd": "10000", 2021-10-08T19:23:32.357 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_max_pg_per_osd": "10000", 2021-10-08T19:23:32.357 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_max_pool_pg_num": "65536", 2021-10-08T19:23:32.357 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_max_snap_prune_per_epoch": "100", 2021-10-08T19:23:32.357 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_mds_blocklist_interval": "86400.000000", 2021-10-08T19:23:32.357 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_mds_force_trim_to": "0", 2021-10-08T19:23:32.358 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_mds_skip_sanity": "false", 2021-10-08T19:23:32.358 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_memory_autotune": "true", 2021-10-08T19:23:32.358 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_memory_target": "2147483648", 2021-10-08T19:23:32.358 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_mgr_beacon_grace": "30", 2021-10-08T19:23:32.359 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2021-10-08T19:23:32.359 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_mgr_digest_period": "5", 2021-10-08T19:23:32.359 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_mgr_inactive_grace": "60", 2021-10-08T19:23:32.359 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_mgr_mkfs_grace": "240", 2021-10-08T19:23:32.360 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2021-10-08T19:23:32.360 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_min_osdmap_epochs": "50", 2021-10-08T19:23:32.360 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_op_complaint_time": "30", 2021-10-08T19:23:32.360 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_op_history_duration": "600", 2021-10-08T19:23:32.360 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_op_history_size": "20", 2021-10-08T19:23:32.361 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_op_history_slow_op_size": "20", 2021-10-08T19:23:32.361 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_op_history_slow_op_threshold": "10", 2021-10-08T19:23:32.361 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_op_log_threshold": "5", 2021-10-08T19:23:32.361 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_adjust_down_out_interval": "true", 2021-10-08T19:23:32.362 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2021-10-08T19:23:32.362 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2021-10-08T19:23:32.362 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_auto_mark_in": "false", 2021-10-08T19:23:32.362 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_auto_mark_new_in": "true", 2021-10-08T19:23:32.362 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2021-10-08T19:23:32.363 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2021-10-08T19:23:32.363 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_cache_size": "500", 2021-10-08T19:23:32.363 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_cache_size_min": "134217728", 2021-10-08T19:23:32.363 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_crush_smoke_test": "true", 2021-10-08T19:23:32.364 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_destroyed_out_interval": "600", 2021-10-08T19:23:32.364 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_down_out_interval": "600", 2021-10-08T19:23:32.364 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_down_out_subtree_limit": "rack", 2021-10-08T19:23:32.364 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2021-10-08T19:23:32.364 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_force_trim_to": "0", 2021-10-08T19:23:32.365 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_full_ratio": "0.950000", 2021-10-08T19:23:32.365 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2021-10-08T19:23:32.365 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_laggy_halflife": "3600", 2021-10-08T19:23:32.365 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_laggy_max_interval": "300", 2021-10-08T19:23:32.366 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_laggy_weight": "0.300000", 2021-10-08T19:23:32.366 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2021-10-08T19:23:32.366 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_max_creating_pgs": "1024", 2021-10-08T19:23:32.366 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_max_initial_pgs": "1024", 2021-10-08T19:23:32.367 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_min_down_reporters": "2", 2021-10-08T19:23:32.367 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_min_in_ratio": "0.750000", 2021-10-08T19:23:32.367 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_min_up_ratio": "0.300000", 2021-10-08T19:23:32.367 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_nearfull_ratio": "0.850000", 2021-10-08T19:23:32.367 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_prime_pg_temp": "true", 2021-10-08T19:23:32.368 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2021-10-08T19:23:32.368 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2021-10-08T19:23:32.368 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_report_timeout": "900", 2021-10-08T19:23:32.368 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_reporter_subtree_level": "osd", 2021-10-08T19:23:32.369 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2021-10-08T19:23:32.369 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_warn_num_repaired": "10", 2021-10-08T19:23:32.369 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_warn_op_age": "32.000000", 2021-10-08T19:23:32.369 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osdmap_full_prune_enabled": "true", 2021-10-08T19:23:32.370 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osdmap_full_prune_interval": "2", 2021-10-08T19:23:32.370 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osdmap_full_prune_min": "15", 2021-10-08T19:23:32.370 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osdmap_full_prune_txsize": "2", 2021-10-08T19:23:32.370 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2021-10-08T19:23:32.371 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_pg_stuck_threshold": "60", 2021-10-08T19:23:32.371 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2021-10-08T19:23:32.371 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_pg_warn_min_objects": "10000", 2021-10-08T19:23:32.371 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_pg_warn_min_per_osd": "0", 2021-10-08T19:23:32.372 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_pg_warn_min_pool_objects": "1000", 2021-10-08T19:23:32.372 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_pool_quota_crit_threshold": "0", 2021-10-08T19:23:32.372 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_pool_quota_warn_threshold": "0", 2021-10-08T19:23:32.372 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_probe_timeout": "2.000000", 2021-10-08T19:23:32.373 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_reweight_max_change": "0.050000", 2021-10-08T19:23:32.373 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_reweight_max_osds": "4", 2021-10-08T19:23:32.373 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_reweight_min_bytes_per_osd": "10", 2021-10-08T19:23:32.373 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_reweight_min_pgs_per_osd": "4", 2021-10-08T19:23:32.374 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2021-10-08T19:23:32.374 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2021-10-08T19:23:32.374 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2021-10-08T19:23:32.374 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_scrub_interval": "86400", 2021-10-08T19:23:32.375 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_scrub_max_keys": "100", 2021-10-08T19:23:32.375 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_scrub_timeout": "300", 2021-10-08T19:23:32.375 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_session_timeout": "300", 2021-10-08T19:23:32.375 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_smart_report_timeout": "5", 2021-10-08T19:23:32.376 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_stat_smooth_intervals": "6", 2021-10-08T19:23:32.376 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2021-10-08T19:23:32.376 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_stretch_pool_min_size": "2", 2021-10-08T19:23:32.376 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_stretch_pool_size": "4", 2021-10-08T19:23:32.377 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2021-10-08T19:23:32.377 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_subscribe_interval": "86400.000000", 2021-10-08T19:23:32.377 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_sync_debug": "false", 2021-10-08T19:23:32.377 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_sync_max_payload_keys": "2000", 2021-10-08T19:23:32.378 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_sync_max_payload_size": "1048576", 2021-10-08T19:23:32.378 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_sync_provider_kill_at": "0", 2021-10-08T19:23:32.378 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_sync_requester_kill_at": "0", 2021-10-08T19:23:32.378 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_sync_timeout": "60.000000", 2021-10-08T19:23:32.378 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_target_pg_per_osd": "100", 2021-10-08T19:23:32.379 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_tick_interval": "5", 2021-10-08T19:23:32.379 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_timecheck_interval": "300.000000", 2021-10-08T19:23:32.379 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_timecheck_skew_interval": "30.000000", 2021-10-08T19:23:32.380 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_warn_older_version_delay": "604800", 2021-10-08T19:23:32.380 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2021-10-08T19:23:32.380 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2021-10-08T19:23:32.380 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2021-10-08T19:23:32.380 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2021-10-08T19:23:32.381 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2021-10-08T19:23:32.381 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2021-10-08T19:23:32.381 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_warn_on_misplaced": "false", 2021-10-08T19:23:32.381 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2021-10-08T19:23:32.382 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_warn_on_older_version": "true", 2021-10-08T19:23:32.382 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2021-10-08T19:23:32.382 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_warn_on_pool_no_app": "true", 2021-10-08T19:23:32.383 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_warn_on_pool_no_redundancy": "true", 2021-10-08T19:23:32.383 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2021-10-08T19:23:32.383 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2021-10-08T19:23:32.383 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2021-10-08T19:23:32.384 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_warn_on_too_few_osds": "false", 2021-10-08T19:23:32.384 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2021-10-08T19:23:32.384 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2021-10-08T19:23:32.384 INFO:teuthology.orchestra.run.smithi097.stdout: "monmap": "", 2021-10-08T19:23:32.384 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_async_op_threads": "3", 2021-10-08T19:23:32.385 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_async_rdma_buffer_size": "131072", 2021-10-08T19:23:32.385 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_async_rdma_cm": "false", 2021-10-08T19:23:32.385 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_async_rdma_device_name": "", 2021-10-08T19:23:32.385 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_async_rdma_dscp": "96", 2021-10-08T19:23:32.386 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_async_rdma_enable_hugepage": "false", 2021-10-08T19:23:32.386 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_async_rdma_gid_idx": "0", 2021-10-08T19:23:32.386 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_async_rdma_local_gid": "", 2021-10-08T19:23:32.386 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_async_rdma_polling_us": "1000", 2021-10-08T19:23:32.387 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_async_rdma_port_num": "1", 2021-10-08T19:23:32.387 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_async_rdma_receive_buffers": "32768", 2021-10-08T19:23:32.387 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_async_rdma_receive_queue_len": "4096", 2021-10-08T19:23:32.387 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_async_rdma_roce_ver": "1", 2021-10-08T19:23:32.388 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_async_rdma_send_buffers": "1024", 2021-10-08T19:23:32.388 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_async_rdma_sl": "3", 2021-10-08T19:23:32.388 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_async_rdma_support_srq": "true", 2021-10-08T19:23:32.388 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_async_rdma_type": "ib", 2021-10-08T19:23:32.389 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_async_reap_threshold": "5", 2021-10-08T19:23:32.389 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_bind_before_connect": "false", 2021-10-08T19:23:32.389 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_bind_ipv4": "true", 2021-10-08T19:23:32.389 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_bind_ipv6": "false", 2021-10-08T19:23:32.390 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_bind_msgr1": "true", 2021-10-08T19:23:32.390 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_bind_msgr2": "false", 2021-10-08T19:23:32.390 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_bind_port_max": "7568", 2021-10-08T19:23:32.390 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_bind_port_min": "6800", 2021-10-08T19:23:32.391 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_bind_prefer_ipv4": "false", 2021-10-08T19:23:32.391 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_bind_retry_count": "3", 2021-10-08T19:23:32.391 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_bind_retry_delay": "5", 2021-10-08T19:23:32.391 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_blackhole_client": "false", 2021-10-08T19:23:32.391 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_blackhole_mds": "false", 2021-10-08T19:23:32.392 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_blackhole_mgr": "false", 2021-10-08T19:23:32.392 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_blackhole_mon": "false", 2021-10-08T19:23:32.392 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_blackhole_osd": "false", 2021-10-08T19:23:32.392 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_client_mode": "crc secure", 2021-10-08T19:23:32.393 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_cluster_mode": "crc secure", 2021-10-08T19:23:32.393 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_cluster_type": "", 2021-10-08T19:23:32.393 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_compress_secure": "false", 2021-10-08T19:23:32.393 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_connection_idle_timeout": "900", 2021-10-08T19:23:32.393 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_connection_ready_timeout": "10", 2021-10-08T19:23:32.394 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_crc_data": "true", 2021-10-08T19:23:32.394 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_crc_header": "true", 2021-10-08T19:23:32.394 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_die_on_bad_msg": "false", 2021-10-08T19:23:32.394 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_die_on_bug": "true", 2021-10-08T19:23:32.395 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_die_on_old_message": "true", 2021-10-08T19:23:32.395 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_die_on_skipped_message": "false", 2021-10-08T19:23:32.395 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_die_on_unhandled_msg": "false", 2021-10-08T19:23:32.395 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_dispatch_throttle_bytes": "104857600", 2021-10-08T19:23:32.396 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_dpdk_coremask": "0xF", 2021-10-08T19:23:32.396 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_dpdk_debug_allow_loopback": "false", 2021-10-08T19:23:32.396 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2021-10-08T19:23:32.396 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_dpdk_host_ipv4_addr": "", 2021-10-08T19:23:32.396 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_dpdk_hugepages": "", 2021-10-08T19:23:32.397 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_dpdk_hw_flow_control": "true", 2021-10-08T19:23:32.397 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2021-10-08T19:23:32.397 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_dpdk_lro": "true", 2021-10-08T19:23:32.397 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_dpdk_memory_channel": "4", 2021-10-08T19:23:32.398 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2021-10-08T19:23:32.398 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_dpdk_pmd": "", 2021-10-08T19:23:32.398 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_dpdk_port_id": "0", 2021-10-08T19:23:32.398 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2021-10-08T19:23:32.398 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_dump_corrupt_message_level": "1", 2021-10-08T19:23:32.399 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_dump_on_send": "false", 2021-10-08T19:23:32.399 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_initial_backoff": "0.200000", 2021-10-08T19:23:32.399 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_inject_delay_max": "1.000000", 2021-10-08T19:23:32.399 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_inject_delay_probability": "0.000000", 2021-10-08T19:23:32.400 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_inject_delay_type": "", 2021-10-08T19:23:32.400 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_inject_internal_delays": "0.000000", 2021-10-08T19:23:32.400 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_inject_socket_failures": "0", 2021-10-08T19:23:32.400 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_learn_addr_from_peer": "true", 2021-10-08T19:23:32.401 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_max_accept_failures": "4", 2021-10-08T19:23:32.401 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_max_backoff": "15.000000", 2021-10-08T19:23:32.401 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_mon_client_mode": "secure crc", 2021-10-08T19:23:32.401 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_mon_cluster_mode": "secure crc", 2021-10-08T19:23:32.401 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_mon_service_mode": "secure crc", 2021-10-08T19:23:32.402 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_osd_compress_min_size": "1024", 2021-10-08T19:23:32.402 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_osd_compress_mode": "none", 2021-10-08T19:23:32.402 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_osd_compression_algorithm": "snappy zlib zstd lz4", 2021-10-08T19:23:32.402 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2021-10-08T19:23:32.403 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_pq_min_cost": "65536", 2021-10-08T19:23:32.403 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_public_type": "", 2021-10-08T19:23:32.403 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_service_mode": "crc secure", 2021-10-08T19:23:32.403 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_tcp_listen_backlog": "512", 2021-10-08T19:23:32.404 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_tcp_nodelay": "true", 2021-10-08T19:23:32.404 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_tcp_prefetch_max_size": "4096", 2021-10-08T19:23:32.404 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_tcp_rcvbuf": "0", 2021-10-08T19:23:32.404 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_type": "async+posix", 2021-10-08T19:23:32.405 INFO:teuthology.orchestra.run.smithi097.stdout: "no_config_file": "false", 2021-10-08T19:23:32.405 INFO:teuthology.orchestra.run.smithi097.stdout: "objecter_completion_locks_per_session": "32", 2021-10-08T19:23:32.405 INFO:teuthology.orchestra.run.smithi097.stdout: "objecter_debug_inject_relock_delay": "false", 2021-10-08T19:23:32.405 INFO:teuthology.orchestra.run.smithi097.stdout: "objecter_inflight_op_bytes": "104857600", 2021-10-08T19:23:32.405 INFO:teuthology.orchestra.run.smithi097.stdout: "objecter_inflight_ops": "1024", 2021-10-08T19:23:32.406 INFO:teuthology.orchestra.run.smithi097.stdout: "objecter_inject_no_watch_ping": "false", 2021-10-08T19:23:32.406 INFO:teuthology.orchestra.run.smithi097.stdout: "objecter_retry_writes_after_first_reply": "false", 2021-10-08T19:23:32.406 INFO:teuthology.orchestra.run.smithi097.stdout: "objecter_tick_interval": "5.000000", 2021-10-08T19:23:32.406 INFO:teuthology.orchestra.run.smithi097.stdout: "objecter_timeout": "10.000000", 2021-10-08T19:23:32.407 INFO:teuthology.orchestra.run.smithi097.stdout: "objectstore_blackhole": "false", 2021-10-08T19:23:32.407 INFO:teuthology.orchestra.run.smithi097.stdout: "openssl_engine_opts": "", 2021-10-08T19:23:32.407 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_agent_delay_time": "5.000000", 2021-10-08T19:23:32.407 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_agent_hist_halflife": "1000", 2021-10-08T19:23:32.407 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_agent_max_low_ops": "2", 2021-10-08T19:23:32.408 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_agent_max_ops": "4", 2021-10-08T19:23:32.408 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_agent_min_evict_effort": "0.100000", 2021-10-08T19:23:32.408 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_agent_quantize_effort": "0.100000", 2021-10-08T19:23:32.408 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_agent_slop": "0.020000", 2021-10-08T19:23:32.409 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_allow_recovery_below_min_size": "true", 2021-10-08T19:23:32.409 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_asio_thread_count": "2", 2021-10-08T19:23:32.409 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_async_recovery_min_cost": "100", 2021-10-08T19:23:32.409 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_auto_mark_unfound_lost": "false", 2021-10-08T19:23:32.409 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_backfill_retry_interval": "30.000000", 2021-10-08T19:23:32.410 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_backfill_scan_max": "512", 2021-10-08T19:23:32.410 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_backfill_scan_min": "64", 2021-10-08T19:23:32.410 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_backoff_on_degraded": "false", 2021-10-08T19:23:32.410 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_backoff_on_peering": "false", 2021-10-08T19:23:32.411 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_backoff_on_unfound": "true", 2021-10-08T19:23:32.411 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_beacon_report_interval": "300", 2021-10-08T19:23:32.411 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_bench_duration": "30", 2021-10-08T19:23:32.411 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_bench_large_size_max_throughput": "104857600", 2021-10-08T19:23:32.412 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_bench_max_block_size": "67108864", 2021-10-08T19:23:32.412 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_bench_small_size_max_iops": "100", 2021-10-08T19:23:32.412 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_blkin_trace_all": "false", 2021-10-08T19:23:32.412 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2021-10-08T19:23:32.412 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2021-10-08T19:23:32.413 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_check_for_log_corruption": "false", 2021-10-08T19:23:32.413 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_check_max_object_name_len_on_startup": "true", 2021-10-08T19:23:32.413 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2021-10-08T19:23:32.413 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2021-10-08T19:23:32.414 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2021-10-08T19:23:32.414 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_class_update_on_start": "true", 2021-10-08T19:23:32.414 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_client_message_cap": "256", 2021-10-08T19:23:32.414 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_client_message_size_cap": "524288000", 2021-10-08T19:23:32.414 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_client_op_priority": "63", 2021-10-08T19:23:32.415 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_client_watch_timeout": "30", 2021-10-08T19:23:32.415 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_command_max_records": "256", 2021-10-08T19:23:32.415 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_compact_on_start": "false", 2021-10-08T19:23:32.415 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_copyfrom_max_chunk": "8388608", 2021-10-08T19:23:32.416 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_crush_chooseleaf_type": "1", 2021-10-08T19:23:32.416 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_crush_initial_weight": "-1.000000", 2021-10-08T19:23:32.416 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_crush_update_on_start": "true", 2021-10-08T19:23:32.416 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_crush_update_weight_set": "true", 2021-10-08T19:23:32.416 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2021-10-08T19:23:32.417 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2021-10-08T19:23:32.417 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2021-10-08T19:23:32.417 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_debug_drop_ping_duration": "0", 2021-10-08T19:23:32.417 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_debug_drop_ping_probability": "0.000000", 2021-10-08T19:23:32.418 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_debug_feed_pullee": "-1", 2021-10-08T19:23:32.418 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_debug_inject_copyfrom_error": "false", 2021-10-08T19:23:32.418 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2021-10-08T19:23:32.418 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2021-10-08T19:23:32.418 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_debug_misdirected_ops": "false", 2021-10-08T19:23:32.419 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_debug_no_acting_change": "false", 2021-10-08T19:23:32.419 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_debug_no_purge_strays": "false", 2021-10-08T19:23:32.419 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_debug_op_order": "false", 2021-10-08T19:23:32.419 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_debug_pg_log_writeout": "false", 2021-10-08T19:23:32.420 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_debug_pretend_recovery_active": "false", 2021-10-08T19:23:32.420 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_debug_random_push_read_error": "0.000000", 2021-10-08T19:23:32.420 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2021-10-08T19:23:32.420 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_debug_shutdown": "false", 2021-10-08T19:23:32.421 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2021-10-08T19:23:32.421 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2021-10-08T19:23:32.421 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_debug_verify_cached_snaps": "false", 2021-10-08T19:23:32.421 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_debug_verify_missing_on_start": "false", 2021-10-08T19:23:32.421 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_debug_verify_snaps": "false", 2021-10-08T19:23:32.422 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_debug_verify_stray_on_activate": "false", 2021-10-08T19:23:32.422 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_deep_scrub_interval": "604800.000000", 2021-10-08T19:23:32.422 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_deep_scrub_keys": "1024", 2021-10-08T19:23:32.423 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2021-10-08T19:23:32.423 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2021-10-08T19:23:32.423 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2021-10-08T19:23:32.423 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_deep_scrub_stride": "524288", 2021-10-08T19:23:32.424 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2021-10-08T19:23:32.424 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_default_data_pool_replay_window": "45", 2021-10-08T19:23:32.424 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_default_notify_timeout": "30", 2021-10-08T19:23:32.424 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_delete_sleep": "0.000000", 2021-10-08T19:23:32.424 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_delete_sleep_hdd": "5.000000", 2021-10-08T19:23:32.425 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_delete_sleep_hybrid": "1.000000", 2021-10-08T19:23:32.425 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_delete_sleep_ssd": "1.000000", 2021-10-08T19:23:32.425 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_discard_disconnected_ops": "true", 2021-10-08T19:23:32.425 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_enable_op_tracker": "true", 2021-10-08T19:23:32.426 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2021-10-08T19:23:32.426 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_failsafe_full_ratio": "0.970000", 2021-10-08T19:23:32.426 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_fast_fail_on_connection_refused": "true", 2021-10-08T19:23:32.426 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_fast_info": "true", 2021-10-08T19:23:32.426 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_fast_shutdown": "true", 2021-10-08T19:23:32.427 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_fast_shutdown_notify_mon": "false", 2021-10-08T19:23:32.427 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_find_best_info_ignore_history_les": "false", 2021-10-08T19:23:32.427 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_force_auth_primary_missing_objects": "100", 2021-10-08T19:23:32.427 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2021-10-08T19:23:32.428 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_function_tracing": "false", 2021-10-08T19:23:32.428 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_heartbeat_grace": "20", 2021-10-08T19:23:32.428 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_heartbeat_interval": "6", 2021-10-08T19:23:32.428 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2021-10-08T19:23:32.428 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_heartbeat_min_peers": "10", 2021-10-08T19:23:32.429 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_heartbeat_min_size": "2000", 2021-10-08T19:23:32.429 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_heartbeat_stale": "600", 2021-10-08T19:23:32.429 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2021-10-08T19:23:32.429 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_hit_set_max_size": "100000", 2021-10-08T19:23:32.430 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_hit_set_min_size": "1000", 2021-10-08T19:23:32.430 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_hit_set_namespace": ".ceph-internal", 2021-10-08T19:23:32.431 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_ignore_stale_divergent_priors": "false", 2021-10-08T19:23:32.431 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2021-10-08T19:23:32.431 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_inject_failure_on_pg_removal": "false", 2021-10-08T19:23:32.431 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2021-10-08T19:23:32.432 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_journal_flush_on_shutdown": "true", 2021-10-08T19:23:32.432 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_journal_size": "5120", 2021-10-08T19:23:32.432 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_kill_backfill_at": "0", 2021-10-08T19:23:32.432 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_loop_before_reset_tphandle": "64", 2021-10-08T19:23:32.433 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_map_cache_size": "50", 2021-10-08T19:23:32.433 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_map_dedup": "true", 2021-10-08T19:23:32.433 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_map_message_max": "40", 2021-10-08T19:23:32.433 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_map_message_max_bytes": "10485760", 2021-10-08T19:23:32.433 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_map_share_max_epochs": "40", 2021-10-08T19:23:32.434 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_max_attr_name_len": "100", 2021-10-08T19:23:32.434 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_max_attr_size": "0", 2021-10-08T19:23:32.434 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_max_backfills": "1", 2021-10-08T19:23:32.434 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_max_markdown_count": "5", 2021-10-08T19:23:32.435 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_max_markdown_period": "600", 2021-10-08T19:23:32.435 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_max_object_name_len": "2048", 2021-10-08T19:23:32.435 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_max_object_namespace_len": "256", 2021-10-08T19:23:32.435 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_max_object_size": "134217728", 2021-10-08T19:23:32.436 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2021-10-08T19:23:32.436 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_max_omap_entries_per_request": "1024", 2021-10-08T19:23:32.436 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_max_pg_blocked_by": "16", 2021-10-08T19:23:32.437 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_max_pg_log_entries": "10000", 2021-10-08T19:23:32.437 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2021-10-08T19:23:32.437 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_max_pgls": "1024", 2021-10-08T19:23:32.438 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_max_push_cost": "8388608", 2021-10-08T19:23:32.438 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_max_push_objects": "10", 2021-10-08T19:23:32.438 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_max_scrubs": "1", 2021-10-08T19:23:32.438 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2021-10-08T19:23:32.439 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_max_trimming_pgs": "2", 2021-10-08T19:23:32.439 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_max_write_op_reply_len": "64", 2021-10-08T19:23:32.439 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_max_write_size": "90", 2021-10-08T19:23:32.439 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mclock_cost_per_byte_usec": "0.000000", 2021-10-08T19:23:32.440 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mclock_cost_per_byte_usec_hdd": "5.200000", 2021-10-08T19:23:32.440 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mclock_cost_per_byte_usec_ssd": "0.011000", 2021-10-08T19:23:32.440 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mclock_cost_per_io_usec": "0.000000", 2021-10-08T19:23:32.440 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mclock_cost_per_io_usec_hdd": "25000.000000", 2021-10-08T19:23:32.441 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mclock_cost_per_io_usec_ssd": "50.000000", 2021-10-08T19:23:32.441 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2021-10-08T19:23:32.441 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2021-10-08T19:23:32.441 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2021-10-08T19:23:32.442 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mclock_profile": "high_client_ops", 2021-10-08T19:23:32.442 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2021-10-08T19:23:32.442 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mclock_scheduler_background_best_effort_lim": "999999", 2021-10-08T19:23:32.442 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mclock_scheduler_background_best_effort_res": "1", 2021-10-08T19:23:32.443 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2021-10-08T19:23:32.443 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mclock_scheduler_background_recovery_lim": "999999", 2021-10-08T19:23:32.443 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mclock_scheduler_background_recovery_res": "1", 2021-10-08T19:23:32.443 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2021-10-08T19:23:32.443 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mclock_scheduler_client_lim": "999999", 2021-10-08T19:23:32.444 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mclock_scheduler_client_res": "1", 2021-10-08T19:23:32.444 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mclock_scheduler_client_wgt": "1", 2021-10-08T19:23:32.444 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mclock_skip_benchmark": "false", 2021-10-08T19:23:32.444 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_memory_base": "805306368", 2021-10-08T19:23:32.445 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_memory_cache_min": "134217728", 2021-10-08T19:23:32.445 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_memory_cache_resize_interval": "1.000000", 2021-10-08T19:23:32.445 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_memory_expected_fragmentation": "0.150000", 2021-10-08T19:23:32.445 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_memory_target": "4294967296", 2021-10-08T19:23:32.446 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_memory_target_autotune": "false", 2021-10-08T19:23:32.446 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2021-10-08T19:23:32.446 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_min_pg_log_entries": "250", 2021-10-08T19:23:32.446 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_min_recovery_priority": "0", 2021-10-08T19:23:32.447 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mon_heartbeat_interval": "30", 2021-10-08T19:23:32.447 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2021-10-08T19:23:32.447 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mon_report_interval": "5", 2021-10-08T19:23:32.447 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mon_report_max_in_flight": "2", 2021-10-08T19:23:32.448 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mon_shutdown_timeout": "5.000000", 2021-10-08T19:23:32.448 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_num_cache_shards": "32", 2021-10-08T19:23:32.448 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_num_op_tracker_shard": "32", 2021-10-08T19:23:32.448 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_numa_auto_affinity": "true", 2021-10-08T19:23:32.448 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_numa_node": "-1", 2021-10-08T19:23:32.449 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_numa_prefer_iface": "true", 2021-10-08T19:23:32.449 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_object_clean_region_max_num_intervals": "10", 2021-10-08T19:23:32.449 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_objecter_finishers": "1", 2021-10-08T19:23:32.449 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_objectstore": "bluestore", 2021-10-08T19:23:32.450 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_objectstore_fuse": "false", 2021-10-08T19:23:32.450 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_objectstore_tracing": "false", 2021-10-08T19:23:32.450 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_op_complaint_time": "30.000000", 2021-10-08T19:23:32.450 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_op_history_duration": "600", 2021-10-08T19:23:32.450 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_op_history_size": "20", 2021-10-08T19:23:32.451 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_op_history_slow_op_size": "20", 2021-10-08T19:23:32.451 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2021-10-08T19:23:32.451 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_op_log_threshold": "5", 2021-10-08T19:23:32.451 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_op_num_shards": "0", 2021-10-08T19:23:32.452 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_op_num_shards_hdd": "5", 2021-10-08T19:23:32.452 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_op_num_shards_ssd": "8", 2021-10-08T19:23:32.452 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_op_num_threads_per_shard": "0", 2021-10-08T19:23:32.452 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2021-10-08T19:23:32.453 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2021-10-08T19:23:32.453 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2021-10-08T19:23:32.453 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_op_pq_min_cost": "65536", 2021-10-08T19:23:32.453 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_op_queue": "mclock_scheduler", 2021-10-08T19:23:32.453 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_op_queue_cut_off": "high", 2021-10-08T19:23:32.454 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_op_thread_suicide_timeout": "150", 2021-10-08T19:23:32.454 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_op_thread_timeout": "15", 2021-10-08T19:23:32.454 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_open_classes_on_start": "true", 2021-10-08T19:23:32.454 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_os_flags": "0", 2021-10-08T19:23:32.455 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_peering_op_priority": "255", 2021-10-08T19:23:32.455 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pg_delete_cost": "1048576", 2021-10-08T19:23:32.455 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pg_delete_priority": "5", 2021-10-08T19:23:32.455 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2021-10-08T19:23:32.455 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2021-10-08T19:23:32.456 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pg_log_dups_tracked": "3000", 2021-10-08T19:23:32.456 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pg_log_trim_max": "10000", 2021-10-08T19:23:32.456 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pg_log_trim_min": "100", 2021-10-08T19:23:32.456 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2021-10-08T19:23:32.457 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pg_object_context_cache_count": "64", 2021-10-08T19:23:32.457 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pg_stat_report_interval_max": "500", 2021-10-08T19:23:32.457 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2021-10-08T19:23:32.457 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pool_default_cache_min_evict_age": "0", 2021-10-08T19:23:32.457 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pool_default_cache_min_flush_age": "0", 2021-10-08T19:23:32.458 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2021-10-08T19:23:32.458 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2021-10-08T19:23:32.458 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2021-10-08T19:23:32.458 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pool_default_crush_rule": "-1", 2021-10-08T19:23:32.459 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pool_default_ec_fast_read": "false", 2021-10-08T19:23:32.459 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2021-10-08T19:23:32.459 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pool_default_flag_hashpspool": "true", 2021-10-08T19:23:32.459 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pool_default_flag_nodelete": "false", 2021-10-08T19:23:32.460 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pool_default_flag_nopgchange": "false", 2021-10-08T19:23:32.460 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pool_default_flag_nosizechange": "false", 2021-10-08T19:23:32.460 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pool_default_flags": "0", 2021-10-08T19:23:32.460 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2021-10-08T19:23:32.461 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pool_default_min_size": "0", 2021-10-08T19:23:32.461 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2021-10-08T19:23:32.461 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pool_default_pg_num": "32", 2021-10-08T19:23:32.461 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pool_default_pgp_num": "0", 2021-10-08T19:23:32.462 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2021-10-08T19:23:32.462 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pool_default_size": "3", 2021-10-08T19:23:32.462 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pool_default_type": "replicated", 2021-10-08T19:23:32.462 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2021-10-08T19:23:32.463 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pool_use_gmt_hitset": "true", 2021-10-08T19:23:32.463 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_push_per_object_cost": "1000", 2021-10-08T19:23:32.463 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_read_ec_check_for_errors": "false", 2021-10-08T19:23:32.463 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_recover_clone_overlap": "true", 2021-10-08T19:23:32.464 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_recover_clone_overlap_limit": "10", 2021-10-08T19:23:32.464 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_recovery_cost": "20971520", 2021-10-08T19:23:32.464 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_recovery_delay_start": "0.000000", 2021-10-08T19:23:32.464 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_recovery_max_active": "0", 2021-10-08T19:23:32.465 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_recovery_max_active_hdd": "3", 2021-10-08T19:23:32.465 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_recovery_max_active_ssd": "10", 2021-10-08T19:23:32.465 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_recovery_max_chunk": "8388608", 2021-10-08T19:23:32.465 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2021-10-08T19:23:32.466 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_recovery_max_single_start": "1", 2021-10-08T19:23:32.466 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_recovery_op_priority": "3", 2021-10-08T19:23:32.466 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_recovery_op_warn_multiple": "16", 2021-10-08T19:23:32.466 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_recovery_priority": "5", 2021-10-08T19:23:32.466 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_recovery_retry_interval": "30.000000", 2021-10-08T19:23:32.467 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_recovery_sleep": "0.000000", 2021-10-08T19:23:32.467 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_recovery_sleep_hdd": "0.100000", 2021-10-08T19:23:32.467 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2021-10-08T19:23:32.467 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_recovery_sleep_ssd": "0.000000", 2021-10-08T19:23:32.468 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_repair_during_recovery": "false", 2021-10-08T19:23:32.468 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_requested_scrub_priority": "120", 2021-10-08T19:23:32.468 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_rollback_to_cluster_snap": "", 2021-10-08T19:23:32.468 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_scrub_auto_repair": "false", 2021-10-08T19:23:32.469 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_scrub_auto_repair_num_errors": "5", 2021-10-08T19:23:32.469 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_scrub_backoff_ratio": "0.660000", 2021-10-08T19:23:32.469 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_scrub_begin_hour": "0", 2021-10-08T19:23:32.469 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_scrub_begin_week_day": "0", 2021-10-08T19:23:32.469 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_scrub_chunk_max": "25", 2021-10-08T19:23:32.470 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_scrub_chunk_min": "5", 2021-10-08T19:23:32.470 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_scrub_cost": "52428800", 2021-10-08T19:23:32.470 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_scrub_during_recovery": "false", 2021-10-08T19:23:32.471 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_scrub_end_hour": "0", 2021-10-08T19:23:32.471 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_scrub_end_week_day": "0", 2021-10-08T19:23:32.471 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_scrub_extended_sleep": "0.000000", 2021-10-08T19:23:32.471 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2021-10-08T19:23:32.472 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_scrub_invalid_stats": "true", 2021-10-08T19:23:32.472 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_scrub_load_threshold": "0.500000", 2021-10-08T19:23:32.472 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_scrub_max_interval": "604800.000000", 2021-10-08T19:23:32.472 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_scrub_max_preemptions": "5", 2021-10-08T19:23:32.472 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_scrub_min_interval": "86400.000000", 2021-10-08T19:23:32.473 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_scrub_priority": "5", 2021-10-08T19:23:32.473 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_scrub_sleep": "0.000000", 2021-10-08T19:23:32.473 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_shutdown_pgref_assert": "false", 2021-10-08T19:23:32.473 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_skip_data_digest": "false", 2021-10-08T19:23:32.474 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_smart_report_timeout": "5", 2021-10-08T19:23:32.474 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_snap_trim_cost": "1048576", 2021-10-08T19:23:32.474 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_snap_trim_priority": "5", 2021-10-08T19:23:32.474 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_snap_trim_sleep": "0.000000", 2021-10-08T19:23:32.474 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2021-10-08T19:23:32.475 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2021-10-08T19:23:32.475 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2021-10-08T19:23:32.475 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2021-10-08T19:23:32.475 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_target_transaction_size": "30", 2021-10-08T19:23:32.476 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_tier_default_cache_hit_set_count": "4", 2021-10-08T19:23:32.476 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2021-10-08T19:23:32.476 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2021-10-08T19:23:32.476 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2021-10-08T19:23:32.476 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2021-10-08T19:23:32.477 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2021-10-08T19:23:32.477 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2021-10-08T19:23:32.477 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_tier_default_cache_mode": "writeback", 2021-10-08T19:23:32.477 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2021-10-08T19:23:32.478 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_tier_promote_max_objects_sec": "25", 2021-10-08T19:23:32.478 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_tracing": "false", 2021-10-08T19:23:32.478 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_use_stale_snap": "false", 2021-10-08T19:23:32.478 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2021-10-08T19:23:32.479 INFO:teuthology.orchestra.run.smithi097.stdout: "osdc_blkin_trace_all": "false", 2021-10-08T19:23:32.479 INFO:teuthology.orchestra.run.smithi097.stdout: "paxos_kill_at": "0", 2021-10-08T19:23:32.479 INFO:teuthology.orchestra.run.smithi097.stdout: "paxos_max_join_drift": "10", 2021-10-08T19:23:32.479 INFO:teuthology.orchestra.run.smithi097.stdout: "paxos_min": "500", 2021-10-08T19:23:32.479 INFO:teuthology.orchestra.run.smithi097.stdout: "paxos_min_wait": "0.050000", 2021-10-08T19:23:32.480 INFO:teuthology.orchestra.run.smithi097.stdout: "paxos_propose_interval": "1.000000", 2021-10-08T19:23:32.480 INFO:teuthology.orchestra.run.smithi097.stdout: "paxos_service_trim_max": "500", 2021-10-08T19:23:32.480 INFO:teuthology.orchestra.run.smithi097.stdout: "paxos_service_trim_max_multiplier": "20", 2021-10-08T19:23:32.480 INFO:teuthology.orchestra.run.smithi097.stdout: "paxos_service_trim_min": "10", 2021-10-08T19:23:32.481 INFO:teuthology.orchestra.run.smithi097.stdout: "paxos_stash_full_interval": "25", 2021-10-08T19:23:32.481 INFO:teuthology.orchestra.run.smithi097.stdout: "paxos_trim_max": "500", 2021-10-08T19:23:32.481 INFO:teuthology.orchestra.run.smithi097.stdout: "paxos_trim_min": "250", 2021-10-08T19:23:32.481 INFO:teuthology.orchestra.run.smithi097.stdout: "perf": "true", 2021-10-08T19:23:32.481 INFO:teuthology.orchestra.run.smithi097.stdout: "pid_file": "", 2021-10-08T19:23:32.482 INFO:teuthology.orchestra.run.smithi097.stdout: "plugin_crypto_accelerator": "crypto_isal", 2021-10-08T19:23:32.482 INFO:teuthology.orchestra.run.smithi097.stdout: "plugin_dir": "/usr/lib64/ceph", 2021-10-08T19:23:32.482 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "-", 2021-10-08T19:23:32.482 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrv": "", 2021-10-08T19:23:32.483 INFO:teuthology.orchestra.run.smithi097.stdout: "public_bind_addr": "-", 2021-10-08T19:23:32.483 INFO:teuthology.orchestra.run.smithi097.stdout: "public_network": "", 2021-10-08T19:23:32.483 INFO:teuthology.orchestra.run.smithi097.stdout: "public_network_interface": "", 2021-10-08T19:23:32.483 INFO:teuthology.orchestra.run.smithi097.stdout: "qat_compressor_enabled": "false", 2021-10-08T19:23:32.483 INFO:teuthology.orchestra.run.smithi097.stdout: "rados_mon_op_timeout": "0", 2021-10-08T19:23:32.484 INFO:teuthology.orchestra.run.smithi097.stdout: "rados_osd_op_timeout": "0", 2021-10-08T19:23:32.484 INFO:teuthology.orchestra.run.smithi097.stdout: "rados_tracing": "false", 2021-10-08T19:23:32.484 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_atime_update_interval": "60", 2021-10-08T19:23:32.484 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2021-10-08T19:23:32.485 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_balance_parent_reads": "false", 2021-10-08T19:23:32.485 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_balance_snap_reads": "false", 2021-10-08T19:23:32.485 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_blkin_trace_all": "false", 2021-10-08T19:23:32.485 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_blocklist_expire_seconds": "0", 2021-10-08T19:23:32.486 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_blocklist_on_break_lock": "true", 2021-10-08T19:23:32.486 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_cache": "true", 2021-10-08T19:23:32.486 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_cache_block_writes_upfront": "false", 2021-10-08T19:23:32.486 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_cache_max_dirty": "25165824", 2021-10-08T19:23:32.487 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_cache_max_dirty_age": "1.000000", 2021-10-08T19:23:32.487 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_cache_max_dirty_object": "0", 2021-10-08T19:23:32.487 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_cache_policy": "writearound", 2021-10-08T19:23:32.487 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_cache_size": "33554432", 2021-10-08T19:23:32.488 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_cache_target_dirty": "16777216", 2021-10-08T19:23:32.488 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_cache_writethrough_until_flush": "true", 2021-10-08T19:23:32.488 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_clone_copy_on_read": "false", 2021-10-08T19:23:32.488 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_compression_hint": "none", 2021-10-08T19:23:32.488 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_concurrent_management_ops": "10", 2021-10-08T19:23:32.489 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_config_pool_override_update_timestamp": "0", 2021-10-08T19:23:32.489 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_default_clone_format": "auto", 2021-10-08T19:23:32.489 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_default_data_pool": "", 2021-10-08T19:23:32.489 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_default_features": "61", 2021-10-08T19:23:32.490 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_default_format": "2", 2021-10-08T19:23:32.490 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_default_map_options": "", 2021-10-08T19:23:32.490 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_default_order": "22", 2021-10-08T19:23:32.491 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_default_pool": "rbd", 2021-10-08T19:23:32.491 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2021-10-08T19:23:32.491 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_default_stripe_count": "0", 2021-10-08T19:23:32.491 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_default_stripe_unit": "0", 2021-10-08T19:23:32.492 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_disable_zero_copy_writes": "true", 2021-10-08T19:23:32.492 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_discard_granularity_bytes": "65536", 2021-10-08T19:23:32.492 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_discard_on_zeroed_write_same": "true", 2021-10-08T19:23:32.492 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_enable_alloc_hint": "true", 2021-10-08T19:23:32.493 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2021-10-08T19:23:32.493 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_io_scheduler": "simple", 2021-10-08T19:23:32.493 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2021-10-08T19:23:32.493 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_journal_commit_age": "5.000000", 2021-10-08T19:23:32.494 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2021-10-08T19:23:32.494 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_journal_max_payload_bytes": "16384", 2021-10-08T19:23:32.494 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_journal_object_flush_age": "0.000000", 2021-10-08T19:23:32.494 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_journal_object_flush_bytes": "1048576", 2021-10-08T19:23:32.495 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_journal_object_flush_interval": "0", 2021-10-08T19:23:32.495 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2021-10-08T19:23:32.495 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2021-10-08T19:23:32.495 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_journal_order": "24", 2021-10-08T19:23:32.495 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_journal_pool": "", 2021-10-08T19:23:32.496 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_journal_splay_width": "4", 2021-10-08T19:23:32.496 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_localize_parent_reads": "false", 2021-10-08T19:23:32.496 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_localize_snap_reads": "false", 2021-10-08T19:23:32.496 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2021-10-08T19:23:32.497 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2021-10-08T19:23:32.497 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2021-10-08T19:23:32.497 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2021-10-08T19:23:32.497 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2021-10-08T19:23:32.497 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2021-10-08T19:23:32.498 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mirror_image_policy_type": "simple", 2021-10-08T19:23:32.498 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2021-10-08T19:23:32.498 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mirror_image_state_check_interval": "30", 2021-10-08T19:23:32.498 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2021-10-08T19:23:32.499 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2021-10-08T19:23:32.499 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2021-10-08T19:23:32.499 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2021-10-08T19:23:32.499 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2021-10-08T19:23:32.500 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mirror_memory_autotune": "true", 2021-10-08T19:23:32.500 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mirror_memory_base": "805306368", 2021-10-08T19:23:32.500 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2021-10-08T19:23:32.500 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mirror_memory_cache_min": "134217728", 2021-10-08T19:23:32.501 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2021-10-08T19:23:32.501 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2021-10-08T19:23:32.501 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mirror_memory_target": "4294967296", 2021-10-08T19:23:32.501 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mirror_perf_stats_prio": "5", 2021-10-08T19:23:32.501 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2021-10-08T19:23:32.502 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2021-10-08T19:23:32.502 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mirroring_delete_delay": "0", 2021-10-08T19:23:32.502 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mirroring_max_mirroring_snapshots": "3", 2021-10-08T19:23:32.502 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mirroring_replay_delay": "0", 2021-10-08T19:23:32.503 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2021-10-08T19:23:32.503 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2021-10-08T19:23:32.503 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_move_to_trash_on_remove": "false", 2021-10-08T19:23:32.503 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2021-10-08T19:23:32.503 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mtime_update_interval": "60", 2021-10-08T19:23:32.504 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_non_blocking_aio": "true", 2021-10-08T19:23:32.504 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_op_thread_timeout": "60", 2021-10-08T19:23:32.504 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_op_threads": "1", 2021-10-08T19:23:32.504 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_parent_cache_enabled": "false", 2021-10-08T19:23:32.505 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_persistent_cache_log_periodic_stats": "false", 2021-10-08T19:23:32.505 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_persistent_cache_mode": "disabled", 2021-10-08T19:23:32.505 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_persistent_cache_path": "/tmp", 2021-10-08T19:23:32.505 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_persistent_cache_size": "1073741824", 2021-10-08T19:23:32.506 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_plugins": "", 2021-10-08T19:23:32.506 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_qos_bps_burst": "0", 2021-10-08T19:23:32.506 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_qos_bps_burst_seconds": "1", 2021-10-08T19:23:32.506 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_qos_bps_limit": "0", 2021-10-08T19:23:32.506 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_qos_exclude_ops": "0", 2021-10-08T19:23:32.507 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_qos_iops_burst": "0", 2021-10-08T19:23:32.507 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_qos_iops_burst_seconds": "1", 2021-10-08T19:23:32.507 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_qos_iops_limit": "0", 2021-10-08T19:23:32.507 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_qos_read_bps_burst": "0", 2021-10-08T19:23:32.508 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2021-10-08T19:23:32.508 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_qos_read_bps_limit": "0", 2021-10-08T19:23:32.508 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_qos_read_iops_burst": "0", 2021-10-08T19:23:32.508 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2021-10-08T19:23:32.509 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_qos_read_iops_limit": "0", 2021-10-08T19:23:32.509 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_qos_schedule_tick_min": "50", 2021-10-08T19:23:32.509 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_qos_write_bps_burst": "0", 2021-10-08T19:23:32.509 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2021-10-08T19:23:32.509 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_qos_write_bps_limit": "0", 2021-10-08T19:23:32.510 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_qos_write_iops_burst": "0", 2021-10-08T19:23:32.510 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2021-10-08T19:23:32.510 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_qos_write_iops_limit": "0", 2021-10-08T19:23:32.510 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_quiesce_notification_attempts": "10", 2021-10-08T19:23:32.511 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_read_from_replica_policy": "default", 2021-10-08T19:23:32.511 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2021-10-08T19:23:32.511 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_readahead_max_bytes": "524288", 2021-10-08T19:23:32.511 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_readahead_trigger_requests": "10", 2021-10-08T19:23:32.511 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_request_timed_out_seconds": "30", 2021-10-08T19:23:32.512 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_skip_partial_discard": "true", 2021-10-08T19:23:32.512 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2021-10-08T19:23:32.512 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_tracing": "false", 2021-10-08T19:23:32.512 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_validate_names": "true", 2021-10-08T19:23:32.513 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_validate_pool": "true", 2021-10-08T19:23:32.513 INFO:teuthology.orchestra.run.smithi097.stdout: "restapi_base_url": "", 2021-10-08T19:23:32.513 INFO:teuthology.orchestra.run.smithi097.stdout: "restapi_log_level": "", 2021-10-08T19:23:32.513 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_acl_grants_max_num": "100", 2021-10-08T19:23:32.513 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_admin_entry": "admin", 2021-10-08T19:23:32.514 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_backend_store": "rados", 2021-10-08T19:23:32.514 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_barbican_url": "", 2021-10-08T19:23:32.514 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_beast_enable_async": "true", 2021-10-08T19:23:32.514 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2021-10-08T19:23:32.515 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_bucket_default_quota_max_size": "-1", 2021-10-08T19:23:32.515 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_bucket_index_max_aio": "128", 2021-10-08T19:23:32.515 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_bucket_quota_cache_size": "10000", 2021-10-08T19:23:32.515 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_bucket_quota_ttl": "600", 2021-10-08T19:23:32.515 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_cache_enabled": "true", 2021-10-08T19:23:32.516 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_cache_expiry_interval": "900", 2021-10-08T19:23:32.516 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_cache_lru_size": "10000", 2021-10-08T19:23:32.516 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_content_length_compat": "false", 2021-10-08T19:23:32.516 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_copy_obj_progress": "true", 2021-10-08T19:23:32.517 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2021-10-08T19:23:32.517 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_cors_rules_max_num": "100", 2021-10-08T19:23:32.517 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_cross_domain_policy": "", 2021-10-08T19:23:32.517 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_default_encryption_key": "", 2021-10-08T19:23:32.518 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_kmip_addr": "", 2021-10-08T19:23:32.518 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_kmip_ca_path": "", 2021-10-08T19:23:32.518 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_kmip_client_cert": "", 2021-10-08T19:23:32.518 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_kmip_client_key": "", 2021-10-08T19:23:32.518 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_kmip_kms_key_template": "", 2021-10-08T19:23:32.519 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_kmip_password": "", 2021-10-08T19:23:32.519 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2021-10-08T19:23:32.519 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_kmip_username": "", 2021-10-08T19:23:32.519 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_require_ssl": "true", 2021-10-08T19:23:32.520 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2021-10-08T19:23:32.520 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2021-10-08T19:23:32.520 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_suppress_logs": "true", 2021-10-08T19:23:32.520 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_vault_addr": "", 2021-10-08T19:23:32.520 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_vault_auth": "token", 2021-10-08T19:23:32.521 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_vault_namespace": "", 2021-10-08T19:23:32.521 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_vault_prefix": "", 2021-10-08T19:23:32.521 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_vault_secret_engine": "transit", 2021-10-08T19:23:32.521 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_vault_ssl_cacert": "", 2021-10-08T19:23:32.522 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2021-10-08T19:23:32.522 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2021-10-08T19:23:32.522 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_vault_token_file": "", 2021-10-08T19:23:32.522 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_vault_verify_ssl": "true", 2021-10-08T19:23:32.523 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_curl_buffersize": "524288", 2021-10-08T19:23:32.523 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_curl_low_speed_limit": "1024", 2021-10-08T19:23:32.523 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_curl_low_speed_time": "300", 2021-10-08T19:23:32.523 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_curl_wait_timeout_ms": "1000", 2021-10-08T19:23:32.523 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2021-10-08T19:23:32.524 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_d3n_l1_datacache_size": "1048576", 2021-10-08T19:23:32.524 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2021-10-08T19:23:32.524 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2021-10-08T19:23:32.524 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_d3n_l1_fadvise": "4", 2021-10-08T19:23:32.525 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2021-10-08T19:23:32.525 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_d3n_libaio_aio_num": "64", 2021-10-08T19:23:32.525 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_d3n_libaio_aio_threads": "20", 2021-10-08T19:23:32.525 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2021-10-08T19:23:32.525 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_data_log_changes_size": "1000", 2021-10-08T19:23:32.526 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_data_log_num_shards": "128", 2021-10-08T19:23:32.526 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_data_log_obj_prefix": "data_log", 2021-10-08T19:23:32.526 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_data_log_window": "30", 2021-10-08T19:23:32.526 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_data_notify_interval_msec": "200", 2021-10-08T19:23:32.527 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_default_data_log_backing": "fifo", 2021-10-08T19:23:32.527 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_default_realm_info_oid": "default.realm", 2021-10-08T19:23:32.527 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_default_region_info_oid": "default.region", 2021-10-08T19:23:32.527 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_default_zone_info_oid": "default.zone", 2021-10-08T19:23:32.528 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2021-10-08T19:23:32.528 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_defer_to_bucket_acls": "", 2021-10-08T19:23:32.528 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_delete_multi_obj_max_num": "1000", 2021-10-08T19:23:32.528 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_dmclock_admin_lim": "0.000000", 2021-10-08T19:23:32.528 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_dmclock_admin_res": "100.000000", 2021-10-08T19:23:32.529 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2021-10-08T19:23:32.529 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_dmclock_auth_lim": "0.000000", 2021-10-08T19:23:32.529 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_dmclock_auth_res": "200.000000", 2021-10-08T19:23:32.529 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2021-10-08T19:23:32.530 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_dmclock_data_lim": "0.000000", 2021-10-08T19:23:32.530 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_dmclock_data_res": "500.000000", 2021-10-08T19:23:32.530 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_dmclock_data_wgt": "500.000000", 2021-10-08T19:23:32.531 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2021-10-08T19:23:32.531 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_dmclock_metadata_res": "500.000000", 2021-10-08T19:23:32.531 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2021-10-08T19:23:32.531 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_dns_name": "", 2021-10-08T19:23:32.532 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_dns_s3website_name": "", 2021-10-08T19:23:32.532 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_dynamic_resharding": "true", 2021-10-08T19:23:32.532 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2021-10-08T19:23:32.532 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_enable_gc_threads": "true", 2021-10-08T19:23:32.533 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_enable_lc_threads": "true", 2021-10-08T19:23:32.533 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_enable_ops_log": "false", 2021-10-08T19:23:32.533 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_enable_quota_threads": "true", 2021-10-08T19:23:32.533 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_enable_static_website": "false", 2021-10-08T19:23:32.533 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_enable_usage_log": "false", 2021-10-08T19:23:32.534 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_enforce_swift_acls": "true", 2021-10-08T19:23:32.534 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_exit_timeout_secs": "120", 2021-10-08T19:23:32.534 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_expose_bucket": "false", 2021-10-08T19:23:32.534 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_extended_http_attrs": "", 2021-10-08T19:23:32.535 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2021-10-08T19:23:32.535 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_frontends": "beast port=7480", 2021-10-08T19:23:32.535 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_gc_max_concurrent_io": "10", 2021-10-08T19:23:32.535 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_gc_max_deferred": "50", 2021-10-08T19:23:32.536 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2021-10-08T19:23:32.536 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_gc_max_objs": "32", 2021-10-08T19:23:32.536 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_gc_max_queue_size": "134213632", 2021-10-08T19:23:32.536 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_gc_max_trim_chunk": "16", 2021-10-08T19:23:32.536 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_gc_obj_min_wait": "7200", 2021-10-08T19:23:32.537 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_gc_processor_max_time": "3600", 2021-10-08T19:23:32.537 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_gc_processor_period": "3600", 2021-10-08T19:23:32.537 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_get_obj_max_req_size": "4194304", 2021-10-08T19:23:32.537 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_get_obj_window_size": "16777216", 2021-10-08T19:23:32.538 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_healthcheck_disabling_path": "", 2021-10-08T19:23:32.538 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_ignore_get_invalid_range": "false", 2021-10-08T19:23:32.538 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_init_timeout": "300", 2021-10-08T19:23:32.538 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2021-10-08T19:23:32.539 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_jaeger_enable": "false", 2021-10-08T19:23:32.539 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_keystone_accepted_admin_roles": "", 2021-10-08T19:23:32.539 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2021-10-08T19:23:32.539 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_keystone_admin_domain": "", 2021-10-08T19:23:32.539 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_keystone_admin_password": "", 2021-10-08T19:23:32.540 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_keystone_admin_password_path": "", 2021-10-08T19:23:32.540 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_keystone_admin_project": "", 2021-10-08T19:23:32.540 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_keystone_admin_tenant": "", 2021-10-08T19:23:32.540 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_keystone_admin_token": "", 2021-10-08T19:23:32.541 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_keystone_admin_token_path": "", 2021-10-08T19:23:32.541 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_keystone_admin_user": "", 2021-10-08T19:23:32.541 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_keystone_api_version": "2", 2021-10-08T19:23:32.541 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_keystone_barbican_domain": "", 2021-10-08T19:23:32.542 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_keystone_barbican_password": "", 2021-10-08T19:23:32.542 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_keystone_barbican_project": "", 2021-10-08T19:23:32.542 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_keystone_barbican_tenant": "", 2021-10-08T19:23:32.542 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_keystone_barbican_user": "", 2021-10-08T19:23:32.542 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_keystone_implicit_tenants": "false", 2021-10-08T19:23:32.543 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_keystone_token_cache_size": "10000", 2021-10-08T19:23:32.543 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_keystone_url": "", 2021-10-08T19:23:32.543 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_keystone_verify_ssl": "true", 2021-10-08T19:23:32.543 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_lc_debug_interval": "-1", 2021-10-08T19:23:32.544 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_lc_lock_max_time": "90", 2021-10-08T19:23:32.544 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_lc_max_objs": "32", 2021-10-08T19:23:32.544 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_lc_max_rules": "1000", 2021-10-08T19:23:32.544 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_lc_max_worker": "3", 2021-10-08T19:23:32.544 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_lc_max_wp_worker": "3", 2021-10-08T19:23:32.545 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_lc_thread_delay": "0", 2021-10-08T19:23:32.545 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2021-10-08T19:23:32.545 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_ldap_dnattr": "uid", 2021-10-08T19:23:32.545 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2021-10-08T19:23:32.546 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_ldap_searchfilter": "", 2021-10-08T19:23:32.546 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2021-10-08T19:23:32.546 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_ldap_uri": "ldaps://", 2021-10-08T19:23:32.546 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2021-10-08T19:23:32.547 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_list_bucket_min_readahead": "1000", 2021-10-08T19:23:32.547 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_list_buckets_max_chunk": "1000", 2021-10-08T19:23:32.547 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_log_http_headers": "", 2021-10-08T19:23:32.547 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_log_nonexistent_bucket": "false", 2021-10-08T19:23:32.548 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2021-10-08T19:23:32.548 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_log_object_name_utc": "false", 2021-10-08T19:23:32.548 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_luarocks_location": "/tmp/luarocks", 2021-10-08T19:23:32.548 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_max_attr_name_len": "0", 2021-10-08T19:23:32.548 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_max_attr_size": "0", 2021-10-08T19:23:32.549 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_max_attrs_num_in_req": "0", 2021-10-08T19:23:32.549 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_max_chunk_size": "4194304", 2021-10-08T19:23:32.549 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_max_concurrent_requests": "1024", 2021-10-08T19:23:32.549 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_max_dynamic_shards": "1999", 2021-10-08T19:23:32.550 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_max_listing_results": "1000", 2021-10-08T19:23:32.550 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_max_notify_retries": "3", 2021-10-08T19:23:32.550 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_max_objs_per_shard": "100000", 2021-10-08T19:23:32.550 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_max_put_param_size": "1048576", 2021-10-08T19:23:32.550 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_max_put_size": "5368709120", 2021-10-08T19:23:32.551 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_max_slo_entries": "1000", 2021-10-08T19:23:32.551 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_md_log_max_shards": "64", 2021-10-08T19:23:32.551 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_md_notify_interval_msec": "200", 2021-10-08T19:23:32.551 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_mime_types_file": "/etc/mime.types", 2021-10-08T19:23:32.552 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_mp_lock_max_time": "600", 2021-10-08T19:23:32.552 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_multipart_min_part_size": "5242880", 2021-10-08T19:23:32.552 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_multipart_part_upload_limit": "10000", 2021-10-08T19:23:32.552 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_nfs_fhcache_partitions": "3", 2021-10-08T19:23:32.552 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_nfs_fhcache_size": "2017", 2021-10-08T19:23:32.553 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2021-10-08T19:23:32.553 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_nfs_lru_lanes": "5", 2021-10-08T19:23:32.553 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_nfs_max_gc": "300", 2021-10-08T19:23:32.553 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_nfs_namespace_expire_secs": "300", 2021-10-08T19:23:32.554 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_nfs_run_gc_threads": "false", 2021-10-08T19:23:32.554 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_nfs_run_lc_threads": "false", 2021-10-08T19:23:32.554 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_nfs_run_quota_threads": "false", 2021-10-08T19:23:32.554 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_nfs_run_sync_thread": "false", 2021-10-08T19:23:32.555 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_nfs_s3_fast_attrs": "false", 2021-10-08T19:23:32.555 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_nfs_write_completion_interval_s": "10", 2021-10-08T19:23:32.555 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_num_async_rados_threads": "32", 2021-10-08T19:23:32.555 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_num_control_oids": "8", 2021-10-08T19:23:32.555 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_numa_node": "-1", 2021-10-08T19:23:32.556 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_obj_stripe_size": "4194304", 2021-10-08T19:23:32.556 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_obj_tombstone_cache_size": "1000", 2021-10-08T19:23:32.556 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_objexp_chunk_size": "100", 2021-10-08T19:23:32.556 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_objexp_gc_interval": "600", 2021-10-08T19:23:32.557 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_objexp_hints_num_shards": "127", 2021-10-08T19:23:32.557 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_olh_pending_timeout_sec": "3600", 2021-10-08T19:23:32.557 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_op_thread_suicide_timeout": "0", 2021-10-08T19:23:32.557 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_op_thread_timeout": "600", 2021-10-08T19:23:32.558 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_op_tracing": "false", 2021-10-08T19:23:32.558 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_opa_token": "", 2021-10-08T19:23:32.558 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_opa_url": "", 2021-10-08T19:23:32.558 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_opa_verify_ssl": "true", 2021-10-08T19:23:32.558 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_ops_log_data_backlog": "5242880", 2021-10-08T19:23:32.559 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_ops_log_rados": "true", 2021-10-08T19:23:32.559 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_ops_log_socket_path": "", 2021-10-08T19:23:32.559 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_override_bucket_index_max_shards": "0", 2021-10-08T19:23:32.559 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2021-10-08T19:23:32.560 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_period_push_interval": "2.000000", 2021-10-08T19:23:32.560 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_period_push_interval_max": "30.000000", 2021-10-08T19:23:32.560 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_period_root_pool": ".rgw.root", 2021-10-08T19:23:32.560 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_print_continue": "true", 2021-10-08T19:23:32.561 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_print_prohibited_content_length": "false", 2021-10-08T19:23:32.561 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_put_obj_max_window_size": "67108864", 2021-10-08T19:23:32.561 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_put_obj_min_window_size": "16777216", 2021-10-08T19:23:32.561 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2021-10-08T19:23:32.561 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_rados_pool_pg_num_min": "8", 2021-10-08T19:23:32.562 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_rados_pool_recovery_priority": "5", 2021-10-08T19:23:32.562 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_rados_tracing": "false", 2021-10-08T19:23:32.562 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_realm": "", 2021-10-08T19:23:32.562 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_realm_id": "", 2021-10-08T19:23:32.563 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_realm_root_pool": ".rgw.root", 2021-10-08T19:23:32.563 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_region": "", 2021-10-08T19:23:32.563 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_region_root_pool": ".rgw.root", 2021-10-08T19:23:32.563 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_relaxed_region_enforcement": "false", 2021-10-08T19:23:32.564 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_relaxed_s3_bucket_names": "false", 2021-10-08T19:23:32.564 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2021-10-08T19:23:32.564 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_request_uri": "", 2021-10-08T19:23:32.564 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_reshard_batch_size": "64", 2021-10-08T19:23:32.564 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_reshard_bucket_lock_duration": "360", 2021-10-08T19:23:32.565 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_reshard_max_aio": "128", 2021-10-08T19:23:32.565 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_reshard_num_logs": "16", 2021-10-08T19:23:32.565 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_reshard_thread_interval": "600", 2021-10-08T19:23:32.565 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_resolve_cname": "false", 2021-10-08T19:23:32.566 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_rest_getusage_op_compat": "false", 2021-10-08T19:23:32.566 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_run_sync_thread": "true", 2021-10-08T19:23:32.566 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_s3_auth_order": "sts, external, local", 2021-10-08T19:23:32.566 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_s3_auth_use_keystone": "false", 2021-10-08T19:23:32.567 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_s3_auth_use_ldap": "false", 2021-10-08T19:23:32.567 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_s3_auth_use_rados": "true", 2021-10-08T19:23:32.567 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_s3_auth_use_sts": "false", 2021-10-08T19:23:32.567 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_s3_client_max_sig_ver": "-1", 2021-10-08T19:23:32.568 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_s3_success_create_obj_status": "0", 2021-10-08T19:23:32.568 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_safe_max_objects_per_shard": "102400", 2021-10-08T19:23:32.568 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_scheduler_type": "throttler", 2021-10-08T19:23:32.568 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_script_uri": "", 2021-10-08T19:23:32.568 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_service_provider_name": "", 2021-10-08T19:23:32.569 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_shard_warning_threshold": "90.000000", 2021-10-08T19:23:32.569 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_sts_client_id": "", 2021-10-08T19:23:32.569 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_sts_client_secret": "", 2021-10-08T19:23:32.569 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_sts_entry": "sts", 2021-10-08T19:23:32.570 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_sts_key": "sts", 2021-10-08T19:23:32.570 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_sts_max_session_duration": "43200", 2021-10-08T19:23:32.570 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_sts_min_session_duration": "900", 2021-10-08T19:23:32.570 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_sts_token_introspection_url": "", 2021-10-08T19:23:32.571 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_swift_account_in_url": "false", 2021-10-08T19:23:32.571 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_swift_auth_entry": "auth", 2021-10-08T19:23:32.571 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_swift_auth_url": "", 2021-10-08T19:23:32.571 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_swift_custom_header": "", 2021-10-08T19:23:32.571 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_swift_enforce_content_length": "false", 2021-10-08T19:23:32.572 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_swift_need_stats": "true", 2021-10-08T19:23:32.572 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_swift_tenant_name": "", 2021-10-08T19:23:32.572 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_swift_token_expiration": "86400", 2021-10-08T19:23:32.572 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_swift_url": "", 2021-10-08T19:23:32.573 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_swift_url_prefix": "swift", 2021-10-08T19:23:32.573 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_swift_versioning_enabled": "false", 2021-10-08T19:23:32.573 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2021-10-08T19:23:32.573 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_sync_lease_period": "120", 2021-10-08T19:23:32.573 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2021-10-08T19:23:32.574 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_sync_log_trim_interval": "1200", 2021-10-08T19:23:32.574 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_sync_log_trim_max_buckets": "16", 2021-10-08T19:23:32.574 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2021-10-08T19:23:32.574 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2021-10-08T19:23:32.575 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_sync_obj_etag_verify": "false", 2021-10-08T19:23:32.575 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_sync_trace_history_size": "4096", 2021-10-08T19:23:32.575 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_sync_trace_per_node_log_size": "32", 2021-10-08T19:23:32.575 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2021-10-08T19:23:32.576 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_thread_pool_size": "512", 2021-10-08T19:23:32.576 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_torrent_comment": "", 2021-10-08T19:23:32.576 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_torrent_createby": "", 2021-10-08T19:23:32.576 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_torrent_encoding": "", 2021-10-08T19:23:32.576 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_torrent_flag": "false", 2021-10-08T19:23:32.577 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_torrent_origin": "", 2021-10-08T19:23:32.577 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_torrent_sha_unit": "524288", 2021-10-08T19:23:32.577 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_torrent_tracker": "", 2021-10-08T19:23:32.577 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_trust_forwarded_https": "false", 2021-10-08T19:23:32.577 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_usage_log_flush_threshold": "1024", 2021-10-08T19:23:32.578 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_usage_log_tick_interval": "30", 2021-10-08T19:23:32.578 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_usage_max_shards": "32", 2021-10-08T19:23:32.578 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_usage_max_user_shards": "1", 2021-10-08T19:23:32.578 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_use_opa_authz": "false", 2021-10-08T19:23:32.579 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_user_default_quota_max_objects": "-1", 2021-10-08T19:23:32.579 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_user_default_quota_max_size": "-1", 2021-10-08T19:23:32.579 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_user_max_buckets": "1000", 2021-10-08T19:23:32.579 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2021-10-08T19:23:32.580 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_user_quota_sync_idle_users": "false", 2021-10-08T19:23:32.580 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_user_quota_sync_interval": "86400", 2021-10-08T19:23:32.580 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_user_quota_sync_wait_time": "86400", 2021-10-08T19:23:32.580 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_user_unique_email": "true", 2021-10-08T19:23:32.581 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_verify_ssl": "true", 2021-10-08T19:23:32.581 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_website_routing_rules_max_num": "50", 2021-10-08T19:23:32.581 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_zone": "", 2021-10-08T19:23:32.581 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_zone_id": "", 2021-10-08T19:23:32.581 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_zone_root_pool": ".rgw.root", 2021-10-08T19:23:32.582 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_zonegroup": "", 2021-10-08T19:23:32.582 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_zonegroup_id": "", 2021-10-08T19:23:32.582 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2021-10-08T19:23:32.583 INFO:teuthology.orchestra.run.smithi097.stdout: "rocksdb_block_size": "4096", 2021-10-08T19:23:32.583 INFO:teuthology.orchestra.run.smithi097.stdout: "rocksdb_bloom_bits_per_key": "20", 2021-10-08T19:23:32.583 INFO:teuthology.orchestra.run.smithi097.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2021-10-08T19:23:32.583 INFO:teuthology.orchestra.run.smithi097.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2021-10-08T19:23:32.583 INFO:teuthology.orchestra.run.smithi097.stdout: "rocksdb_cache_row_ratio": "0.000000", 2021-10-08T19:23:32.584 INFO:teuthology.orchestra.run.smithi097.stdout: "rocksdb_cache_shard_bits": "4", 2021-10-08T19:23:32.584 INFO:teuthology.orchestra.run.smithi097.stdout: "rocksdb_cache_size": "536870912", 2021-10-08T19:23:32.584 INFO:teuthology.orchestra.run.smithi097.stdout: "rocksdb_cache_type": "binned_lru", 2021-10-08T19:23:32.584 INFO:teuthology.orchestra.run.smithi097.stdout: "rocksdb_collect_compaction_stats": "false", 2021-10-08T19:23:32.585 INFO:teuthology.orchestra.run.smithi097.stdout: "rocksdb_collect_extended_stats": "false", 2021-10-08T19:23:32.585 INFO:teuthology.orchestra.run.smithi097.stdout: "rocksdb_collect_memory_stats": "false", 2021-10-08T19:23:32.585 INFO:teuthology.orchestra.run.smithi097.stdout: "rocksdb_delete_range_threshold": "1048576", 2021-10-08T19:23:32.585 INFO:teuthology.orchestra.run.smithi097.stdout: "rocksdb_index_type": "binary_search", 2021-10-08T19:23:32.585 INFO:teuthology.orchestra.run.smithi097.stdout: "rocksdb_log_to_ceph_log": "true", 2021-10-08T19:23:32.586 INFO:teuthology.orchestra.run.smithi097.stdout: "rocksdb_metadata_block_size": "4096", 2021-10-08T19:23:32.586 INFO:teuthology.orchestra.run.smithi097.stdout: "rocksdb_partition_filters": "false", 2021-10-08T19:23:32.586 INFO:teuthology.orchestra.run.smithi097.stdout: "rocksdb_perf": "false", 2021-10-08T19:23:32.586 INFO:teuthology.orchestra.run.smithi097.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2021-10-08T19:23:32.587 INFO:teuthology.orchestra.run.smithi097.stdout: "rotating_keys_bootstrap_timeout": "30", 2021-10-08T19:23:32.587 INFO:teuthology.orchestra.run.smithi097.stdout: "rotating_keys_renewal_timeout": "10", 2021-10-08T19:23:32.587 INFO:teuthology.orchestra.run.smithi097.stdout: "run_dir": "/var/run/ceph", 2021-10-08T19:23:32.587 INFO:teuthology.orchestra.run.smithi097.stdout: "seastore_block_create": "true", 2021-10-08T19:23:32.588 INFO:teuthology.orchestra.run.smithi097.stdout: "seastore_device_size": "107374182400", 2021-10-08T19:23:32.588 INFO:teuthology.orchestra.run.smithi097.stdout: "seastore_init_rewrite_segments_num_per_device": "6", 2021-10-08T19:23:32.588 INFO:teuthology.orchestra.run.smithi097.stdout: "seastore_segment_size": "67108864", 2021-10-08T19:23:32.588 INFO:teuthology.orchestra.run.smithi097.stdout: "setgroup": "ceph", 2021-10-08T19:23:32.588 INFO:teuthology.orchestra.run.smithi097.stdout: "setuser": "ceph", 2021-10-08T19:23:32.589 INFO:teuthology.orchestra.run.smithi097.stdout: "setuser_match_path": "", 2021-10-08T19:23:32.589 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_misplaced_ratio": "0.050000", 2021-10-08T19:23:32.589 INFO:teuthology.orchestra.run.smithi097.stdout: "thp": "false", 2021-10-08T19:23:32.589 INFO:teuthology.orchestra.run.smithi097.stdout: "threadpool_default_timeout": "60", 2021-10-08T19:23:32.590 INFO:teuthology.orchestra.run.smithi097.stdout: "threadpool_empty_queue_max_wait": "2", 2021-10-08T19:23:32.590 INFO:teuthology.orchestra.run.smithi097.stdout: "throttler_perf_counter": "true" 2021-10-08T19:23:32.590 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:23:32.591 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:32 smithi117 conmon[67121]: t=2021-10-08T19:23:32+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth access token to user_auth" 2021-10-08T19:23:32.591 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:32 smithi117 conmon[67121]: t=2021-10-08T19:23:32+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth refresh token to user_auth" 2021-10-08T19:23:32.592 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:32 smithi117 conmon[67121]: t=2021-10-08T19:23:32+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth token type to user_auth" 2021-10-08T19:23:32.592 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:32 smithi117 conmon[67121]: t=2021-10-08T19:23:32+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth expiry to user_auth" 2021-10-08T19:23:32.592 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:32 smithi117 conmon[67121]: t=2021-10-08T19:23:32+0000 lvl=info msg="Executing migration" logger=migrator id="Add index to user_id column in user_auth" 2021-10-08T19:23:32.592 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:32 smithi117 conmon[67121]: t=2021-10-08T19:23:32+0000 lvl=info msg="Executing migration" logger=migrator id="create server_lock table" 2021-10-08T19:23:32.593 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:32 smithi117 conmon[67121]: t=2021-10-08T19:23:32+0000 lvl=info msg="Executing migration" logger=migrator id="add index server_lock.operation_uid" 2021-10-08T19:23:32.593 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:32 smithi117 ceph-mon[34585]: 5.0 deep-scrub ok 2021-10-08T19:23:32.593 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:32 smithi117 conmon[67121]: t=2021-10-08T19:23:32+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth token table" 2021-10-08T19:23:32.594 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:32 smithi117 conmon[67121]: t=2021-10-08T19:23:32+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.auth_token" 2021-10-08T19:23:32.594 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:32 smithi117 conmon[67121]: t=2021-10-08T19:23:32+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.prev_auth_token" 2021-10-08T19:23:32.594 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:32 smithi117 conmon[67121]: t=2021-10-08T19:23:32+0000 lvl=info msg="Executing migration" logger=migrator id="create cache_data table" 2021-10-08T19:23:32.697 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:32 smithi097 ceph-mon[32687]: 5.0 deep-scrub ok 2021-10-08T19:23:32.698 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:32 smithi097 ceph-mon[41966]: 5.0 deep-scrub ok 2021-10-08T19:23:32.740 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2021-10-08T19:23:32.861 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:32 smithi117 conmon[67121]: t=2021-10-08T19:23:32+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index cache_data.cache_key" 2021-10-08T19:23:32.862 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:32 smithi117 conmon[67121]: t=2021-10-08T19:23:32+0000 lvl=info msg="Created default admin" logger=sqlstore user=admin 2021-10-08T19:23:32.969 INFO:journalctl@ceph.alertmanager.a.smithi097.stdout:Oct 08 19:23:32 smithi097 conmon[85195]: level=info ts=2021-10-08T19:23:32.696Z caller=cluster.go:640 component=cluster msg="gossip settled; proceeding" elapsed=10.000848772s 2021-10-08T19:23:33.008 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:23:33.156 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:32 smithi117 conmon[67121]: t=2021-10-08T19:23:32+0000 lvl=info msg="Initializing HTTPServer" logger=server 2021-10-08T19:23:33.157 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:32 smithi117 conmon[67121]: t=2021-10-08T19:23:32+0000 lvl=info msg="Initializing BackendPluginManager" logger=server 2021-10-08T19:23:33.157 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:32 smithi117 conmon[67121]: t=2021-10-08T19:23:32+0000 lvl=info msg="Initializing PluginManager" logger=server 2021-10-08T19:23:33.157 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:32 smithi117 conmon[67121]: t=2021-10-08T19:23:32+0000 lvl=info msg="Starting plugin search" logger=plugins 2021-10-08T19:23:33.157 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:32 smithi117 conmon[67121]: t=2021-10-08T19:23:32+0000 lvl=info msg="Registering plugin" logger=plugins name="Pie Chart" 2021-10-08T19:23:33.158 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:32 smithi117 conmon[67121]: t=2021-10-08T19:23:32+0000 lvl=info msg="Registering plugin" logger=plugins name="Status Panel" 2021-10-08T19:23:33.158 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:32 smithi117 conmon[67121]: t=2021-10-08T19:23:32+0000 lvl=info msg="Initializing HooksService" logger=server 2021-10-08T19:23:33.158 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:32 smithi117 conmon[67121]: t=2021-10-08T19:23:32+0000 lvl=info msg="Initializing OSSLicensingService" logger=server 2021-10-08T19:23:33.158 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:32 smithi117 conmon[67121]: t=2021-10-08T19:23:32+0000 lvl=info msg="Initializing InternalMetricsService" logger=server 2021-10-08T19:23:33.159 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:32 smithi117 conmon[67121]: t=2021-10-08T19:23:32+0000 lvl=info msg="Initializing RemoteCache" logger=server 2021-10-08T19:23:33.159 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:32 smithi117 conmon[67121]: t=2021-10-08T19:23:32+0000 lvl=info msg="Initializing RenderingService" logger=server 2021-10-08T19:23:33.159 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:32 smithi117 conmon[67121]: t=2021-10-08T19:23:32+0000 lvl=info msg="Initializing AlertEngine" logger=server 2021-10-08T19:23:33.159 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:32 smithi117 conmon[67121]: t=2021-10-08T19:23:32+0000 lvl=info msg="Initializing QuotaService" logger=server 2021-10-08T19:23:33.159 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:32 smithi117 conmon[67121]: t=2021-10-08T19:23:32+0000 lvl=info msg="Initializing ServerLockService" logger=server 2021-10-08T19:23:33.160 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:32 smithi117 conmon[67121]: t=2021-10-08T19:23:32+0000 lvl=info msg="Initializing UserAuthTokenService" logger=server 2021-10-08T19:23:33.160 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:32 smithi117 conmon[67121]: t=2021-10-08T19:23:32+0000 lvl=info msg="Initializing DatasourceCacheService" logger=server 2021-10-08T19:23:33.160 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:32 smithi117 conmon[67121]: t=2021-10-08T19:23:32+0000 lvl=info msg="Initializing LoginService" logger=server 2021-10-08T19:23:33.161 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:32 smithi117 conmon[67121]: t=2021-10-08T19:23:32+0000 lvl=info msg="Initializing SearchService" logger=server 2021-10-08T19:23:33.161 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:32 smithi117 conmon[67121]: t=2021-10-08T19:23:32+0000 lvl=info msg="Initializing TracingService" logger=server 2021-10-08T19:23:33.162 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:32 smithi117 conmon[67121]: t=2021-10-08T19:23:32+0000 lvl=info msg="Initializing UsageStatsService" logger=server 2021-10-08T19:23:33.162 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:32 smithi117 conmon[67121]: t=2021-10-08T19:23:32+0000 lvl=info msg="Initializing CleanUpService" logger=server 2021-10-08T19:23:33.162 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:32 smithi117 conmon[67121]: t=2021-10-08T19:23:32+0000 lvl=info msg="Initializing NotificationService" logger=server 2021-10-08T19:23:33.162 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:32 smithi117 conmon[67121]: t=2021-10-08T19:23:32+0000 lvl=info msg="Initializing provisioningServiceImpl" logger=server 2021-10-08T19:23:33.163 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:32 smithi117 conmon[67121]: t=2021-10-08T19:23:32+0000 lvl=warn msg="[Deprecated] the datasource provisioning config is outdated. please upgrade" logger=provisioning.datasources filename=/etc/grafana/provisioning/datasources/ceph-dashboard.yml 2021-10-08T19:23:33.163 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:32 smithi117 conmon[67121]: t=2021-10-08T19:23:32+0000 lvl=info msg="inserting datasource from configuration " logger=provisioning.datasources name=Dashboard1 2021-10-08T19:23:33.163 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:32 smithi117 conmon[67121]: t=2021-10-08T19:23:32+0000 lvl=info msg="Backend rendering via phantomJS" logger=rendering renderer=phantomJS 2021-10-08T19:23:33.163 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:32 smithi117 conmon[67121]: t=2021-10-08T19:23:32+0000 lvl=warn msg="phantomJS is deprecated and will be removed in a future release. You should consider migrating from phantomJS to grafana-image-renderer plugin. Read more at https://grafana.com/docs/grafana/latest/administration/image_rendering/" logger=rendering renderer=phantomJS 2021-10-08T19:23:33.164 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:32 smithi117 conmon[67121]: t=2021-10-08T19:23:32+0000 lvl=info msg="Initializing Stream Manager" 2021-10-08T19:23:33.164 INFO:journalctl@ceph.grafana.a.smithi117.stdout:Oct 08 19:23:32 smithi117 conmon[67121]: t=2021-10-08T19:23:32+0000 lvl=info msg="HTTP Server Listen" logger=http.server address=[::]:3000 protocol=https subUrl= socket= 2021-10-08T19:23:33.450 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:33 smithi097 ceph-mon[32687]: pgmap v76: 132 pgs: 132 active+clean; 582 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:23:33.719 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:33 smithi097 ceph-mon[41966]: pgmap v76: 132 pgs: 132 active+clean; 582 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:23:33.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:33 smithi117 ceph-mon[34585]: pgmap v76: 132 pgs: 132 active+clean; 582 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:23:34.426 INFO:teuthology.orchestra.run.smithi097.stdout:mon.a: {} 2021-10-08T19:23:34.434 INFO:teuthology.orchestra.run.smithi097.stdout:mon.c: {} 2021-10-08T19:23:34.446 INFO:teuthology.orchestra.run.smithi097.stdout:mon.b: {} 2021-10-08T19:23:34.446 INFO:teuthology.orchestra.run.smithi097.stderr:mon.a: mon_osd_down_out_interval = '0' (not observed, change may require restart) 2021-10-08T19:23:34.447 INFO:teuthology.orchestra.run.smithi097.stderr:mon.c: mon_osd_down_out_interval = '0' (not observed, change may require restart) 2021-10-08T19:23:34.447 INFO:teuthology.orchestra.run.smithi097.stderr:mon.b: mon_osd_down_out_interval = '0' (not observed, change may require restart) 2021-10-08T19:23:34.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:34 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3678080446' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-10-08T19:23:34.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:34 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3678080446' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-10-08T19:23:34.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:34 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3678080446' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-10-08T19:23:34.982 INFO:teuthology.run_tasks:Running task full_sequential... 2021-10-08T19:23:34.998 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2021-10-08T19:23:35.001 INFO:tasks.radosbench:Beginning radosbench... 2021-10-08T19:23:35.001 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_0 2021-10-08T19:23:35.002 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd pool create unique_pool_0 16 2021-10-08T19:23:35.003 INFO:tasks.thrashosds.thrasher:starting do_thrash 2021-10-08T19:23:35.003 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2021-10-08T19:23:35.003 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2021-10-08T19:23:35.004 INFO:tasks.thrashosds.thrasher:Removing osd 6, in_osds are: [0, 1, 2, 3, 4, 5, 6, 7] 2021-10-08T19:23:35.004 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd out 6 2021-10-08T19:23:35.005 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2021-10-08T19:23:35.005 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:23:35.006 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2021-10-08T19:23:35.006 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2021-10-08T19:23:35.006 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2021-10-08T19:23:35.007 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2021-10-08T19:23:35.007 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2021-10-08T19:23:35.008 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set noscrub 2021-10-08T19:23:35.042 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:35.113 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:23:35.120 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:35.121 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:23:35.222 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:23:35.252 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:35.298 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:23:35.301 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:35.302 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:23:35.337 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:23:35.391 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:23:35.402 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:23:35.426 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:35.455 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:35 smithi097 ceph-mon[32687]: pgmap v77: 132 pgs: 132 active+clean; 582 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-10-08T19:23:35.455 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:35 smithi097 ceph-mon[32687]: 2.17 deep-scrub ok 2021-10-08T19:23:35.471 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:23:35.473 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:35.474 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:23:35.515 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:23:35.543 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:23:35.575 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:23:35.597 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:35 smithi117 ceph-mon[34585]: pgmap v77: 132 pgs: 132 active+clean; 582 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-10-08T19:23:35.597 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:35 smithi117 ceph-mon[34585]: 2.17 deep-scrub ok 2021-10-08T19:23:35.599 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:35.706 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:35 smithi097 ceph-mon[41966]: pgmap v77: 132 pgs: 132 active+clean; 582 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-10-08T19:23:35.706 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:35 smithi097 ceph-mon[41966]: 2.17 deep-scrub ok 2021-10-08T19:23:35.743 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:23:35.746 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:35.746 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:23:35.847 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:23:35.872 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:35.914 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:23:35.918 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:35.918 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:23:36.020 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:23:36.045 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:23:35 smithi097 conmon[33110]: 172.21.15.117 - - [08/Oct/2021:19:23:35] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:23:36.048 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:36.084 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:23:36.405 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:23:36 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:23:36.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:36 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:23:36.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:36 smithi097 ceph-mon[32687]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:23:36.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:36 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:23:36.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:36 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:36.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:36 smithi097 ceph-mon[32687]: 172.21.15.117 - - [08/Oct/2021:19:23:35] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:23:36.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:36 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:36.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:36 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:36.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:36 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:23:36.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:36 smithi097 ceph-mon[32687]: 4.1e scrub ok 2021-10-08T19:23:36.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:36 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:23:36.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:36 smithi097 ceph-mon[41966]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:23:36.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:36 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:23:36.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:36 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:36.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:36 smithi097 ceph-mon[41966]: 172.21.15.117 - - [08/Oct/2021:19:23:35] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:23:36.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:36 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:36.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:36 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:36.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:36 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:23:36.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:36 smithi097 ceph-mon[41966]: 4.1e scrub ok 2021-10-08T19:23:37.142 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:23:37.146 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:37.147 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:23:37.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:36 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:23:37.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:36 smithi117 ceph-mon[34585]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:23:37.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:36 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:23:37.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:36 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:37.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:36 smithi117 ceph-mon[34585]: 172.21.15.117 - - [08/Oct/2021:19:23:35] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:23:37.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:36 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:37.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:36 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:37.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:36 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:23:37.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:36 smithi117 ceph-mon[34585]: 4.1e scrub ok 2021-10-08T19:23:37.248 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:23:37.277 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:37.327 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:23:37.329 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:37.330 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:23:37.431 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:23:37.459 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:37.602 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:23:37.604 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:37.605 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:23:37.706 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:23:37.735 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:37.784 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:23:37.786 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:37.787 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:23:37.890 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:23:37.919 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:38.083 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:37 smithi097 ceph-mon[41966]: 5.c deep-scrub ok 2021-10-08T19:23:38.083 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:37 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:23:38.083 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:37 smithi097 ceph-mon[41966]: pgmap v78: 132 pgs: 132 active+clean; 582 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:23:38.084 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:37 smithi097 ceph-mon[41966]: 2.10 scrub ok 2021-10-08T19:23:38.084 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:37 smithi097 ceph-mon[32687]: 5.c deep-scrub ok 2021-10-08T19:23:38.085 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:37 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:23:38.085 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:37 smithi097 ceph-mon[32687]: pgmap v78: 132 pgs: 132 active+clean; 582 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:23:38.085 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:37 smithi097 ceph-mon[32687]: 2.10 scrub ok 2021-10-08T19:23:38.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:37 smithi117 ceph-mon[34585]: 5.c deep-scrub ok 2021-10-08T19:23:38.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:37 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:23:38.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:37 smithi117 ceph-mon[34585]: pgmap v78: 132 pgs: 132 active+clean; 582 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:23:38.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:37 smithi117 ceph-mon[34585]: 2.10 scrub ok 2021-10-08T19:23:39.064 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:23:39.067 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:39.068 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:23:39.169 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:23:39.197 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:39.248 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:23:39.250 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:39.251 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:23:39.353 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:23:39.378 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:39.426 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:39.427 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:23:39.427 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:23:39.438 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:23:39.461 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:23:39.482 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:23:39.500 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:23:39.519 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:23:39.528 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:23:39.543 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:23:39.553 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:39.556 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:23:39.575 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:23:39.576 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'false' 2021-10-08T19:23:39.576 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'false' 2021-10-08T19:23:39.576 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'false' 2021-10-08T19:23:39.576 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'false' 2021-10-08T19:23:39.577 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'false' 2021-10-08T19:23:39.577 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'false' 2021-10-08T19:23:39.577 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'false' 2021-10-08T19:23:39.577 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'false' 2021-10-08T19:23:39.594 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:23:39.596 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:39.596 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:23:39.698 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:23:39.722 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:39.764 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:23:39.766 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:39.767 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:23:39.867 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:23:39.890 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:39 smithi117 ceph-mon[34585]: 4.11 scrub ok 2021-10-08T19:23:39.891 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:39 smithi117 ceph-mon[34585]: pgmap v79: 132 pgs: 132 active+clean; 582 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2021-10-08T19:23:39.891 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:39 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1463987502' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:23:39.892 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:39.893 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:39 smithi097 ceph-mon[32687]: 4.11 scrub ok 2021-10-08T19:23:39.894 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:39 smithi097 ceph-mon[32687]: pgmap v79: 132 pgs: 132 active+clean; 582 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2021-10-08T19:23:39.894 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:39 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1463987502' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:23:39.895 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:39 smithi097 ceph-mon[41966]: 4.11 scrub ok 2021-10-08T19:23:39.895 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:39 smithi097 ceph-mon[41966]: pgmap v79: 132 pgs: 132 active+clean; 582 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2021-10-08T19:23:39.895 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:39 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1463987502' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:23:39.934 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:23:39.936 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:39.937 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:23:40.038 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:23:40.068 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:40.617 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:23:40.619 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:40.620 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:23:40.721 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:23:40.749 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:40.799 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:23:40.801 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:40.802 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:23:40.904 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:23:40.929 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:40.975 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:23:40.976 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:40.976 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:23:41.077 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:23:41.102 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:40 smithi097 ceph-mon[41966]: 5.18 scrub ok 2021-10-08T19:23:41.103 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:40 smithi097 ceph-mon[32687]: 5.18 scrub ok 2021-10-08T19:23:41.103 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:40 smithi097 conmon[32664]: 2021-10-08T19:23:40.857+0000 7f605f9d6700 -1 mon.a@0(leader).osd e91 definitely_dead 0 2021-10-08T19:23:41.105 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:41.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:40 smithi117 ceph-mon[34585]: 5.18 scrub ok 2021-10-08T19:23:41.502 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:23:41.504 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:41.504 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:23:41.558 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2021-10-08T19:23:41.559 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:23:41.606 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:23:41.634 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:41.682 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:23:41.684 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:41.685 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:23:41.786 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:23:41.804 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is set 2021-10-08T19:23:41.808 INFO:teuthology.orchestra.run.smithi097.stderr:marked out osd.6. 2021-10-08T19:23:41.824 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:41.869 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:23:41.871 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:41.872 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:23:41.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:41 smithi117 ceph-mon[34585]: 6.15 scrub ok 2021-10-08T19:23:41.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:41 smithi117 ceph-mon[34585]: pgmap v80: 132 pgs: 132 active+clean; 582 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:23:41.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:41 smithi117 ceph-mon[34585]: 2.11 scrub ok 2021-10-08T19:23:41.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:41 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3513581998' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["6"]}]: dispatch 2021-10-08T19:23:41.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:41 smithi117 ceph-mon[34585]: from='client.24760 ' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["6"]}]: dispatch 2021-10-08T19:23:41.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:41 smithi117 ceph-mon[34585]: Client client.admin marked osd.6 out, while it was still marked up 2021-10-08T19:23:41.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:41 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2591481295' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:23:41.974 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:23:42.001 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:42.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:41 smithi097 ceph-mon[32687]: 6.15 scrub ok 2021-10-08T19:23:42.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:41 smithi097 ceph-mon[32687]: pgmap v80: 132 pgs: 132 active+clean; 582 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:23:42.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:41 smithi097 ceph-mon[32687]: 2.11 scrub ok 2021-10-08T19:23:42.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:41 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3513581998' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["6"]}]: dispatch 2021-10-08T19:23:42.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:41 smithi097 ceph-mon[32687]: from='client.24760 ' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["6"]}]: dispatch 2021-10-08T19:23:42.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:41 smithi097 ceph-mon[32687]: Client client.admin marked osd.6 out, while it was still marked up 2021-10-08T19:23:42.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:41 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2591481295' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:23:42.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:41 smithi097 ceph-mon[41966]: 6.15 scrub ok 2021-10-08T19:23:42.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:41 smithi097 ceph-mon[41966]: pgmap v80: 132 pgs: 132 active+clean; 582 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:23:42.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:41 smithi097 ceph-mon[41966]: 2.11 scrub ok 2021-10-08T19:23:42.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:41 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3513581998' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["6"]}]: dispatch 2021-10-08T19:23:42.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:41 smithi097 ceph-mon[41966]: from='client.24760 ' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["6"]}]: dispatch 2021-10-08T19:23:42.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:41 smithi097 ceph-mon[41966]: Client client.admin marked osd.6 out, while it was still marked up 2021-10-08T19:23:42.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:41 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2591481295' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:23:42.782 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2021-10-08T19:23:42.969 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:42 smithi097 ceph-mon[41966]: 5.7 scrub ok 2021-10-08T19:23:42.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:42 smithi097 ceph-mon[41966]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:23:42.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:42 smithi097 ceph-mon[41966]: from='client.24760 ' entity='client.admin' cmd='[{"prefix": "osd out", "ids": ["6"]}]': finished 2021-10-08T19:23:42.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:42 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2591481295' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:23:42.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:42 smithi097 ceph-mon[41966]: osdmap e92: 8 total, 8 up, 7 in 2021-10-08T19:23:42.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:42 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:23:42.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:42 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:23:42.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:42 smithi097 ceph-mon[41966]: osdmap e93: 8 total, 8 up, 7 in 2021-10-08T19:23:42.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:42 smithi097 ceph-mon[32687]: 5.7 scrub ok 2021-10-08T19:23:42.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:42 smithi097 ceph-mon[32687]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:23:42.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:42 smithi097 ceph-mon[32687]: from='client.24760 ' entity='client.admin' cmd='[{"prefix": "osd out", "ids": ["6"]}]': finished 2021-10-08T19:23:42.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:42 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2591481295' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:23:42.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:42 smithi097 ceph-mon[32687]: osdmap e92: 8 total, 8 up, 7 in 2021-10-08T19:23:42.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:42 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:23:42.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:42 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:23:42.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:42 smithi097 ceph-mon[32687]: osdmap e93: 8 total, 8 up, 7 in 2021-10-08T19:23:42.974 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:23:42 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:23:42] "GET /metrics HTTP/1.1" 200 153762 "" "Prometheus/2.18.1" 2021-10-08T19:23:43.010 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:23:43.013 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:43.013 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:23:43.115 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:23:43.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:42 smithi117 ceph-mon[34585]: 5.7 scrub ok 2021-10-08T19:23:43.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:42 smithi117 ceph-mon[34585]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:23:43.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:42 smithi117 ceph-mon[34585]: from='client.24760 ' entity='client.admin' cmd='[{"prefix": "osd out", "ids": ["6"]}]': finished 2021-10-08T19:23:43.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:42 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2591481295' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:23:43.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:42 smithi117 ceph-mon[34585]: osdmap e92: 8 total, 8 up, 7 in 2021-10-08T19:23:43.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:42 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:23:43.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:42 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:23:43.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:42 smithi117 ceph-mon[34585]: osdmap e93: 8 total, 8 up, 7 in 2021-10-08T19:23:43.184 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:43.284 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:23:43.288 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2021-10-08T19:23:43.289 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:43.290 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:23:43.345 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:23:43.392 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:23:43.415 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:43.458 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:23:43.460 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:43.462 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:23:43.563 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:23:43.590 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:43.695 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:23:43.699 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:43.700 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:23:43.801 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:23:43.813 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'unique_pool_0' created 2021-10-08T19:23:43.836 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:43.839 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:43 smithi097 ceph-mon[32687]: pgmap v82: 132 pgs: 132 active+clean; 582 KiB data, 51 MiB used, 626 GiB / 626 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:23:43.839 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-10-08T19:23:43.839 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [3, 2]}]: dispatch 2021-10-08T19:23:43.840 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:43 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2307752034' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}]: dispatch 2021-10-08T19:23:43.840 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:43 smithi097 ceph-mon[32687]: from='client.24772 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}]: dispatch 2021-10-08T19:23:43.840 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]': finished 2021-10-08T19:23:43.840 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [3, 2]}]': finished 2021-10-08T19:23:43.840 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:43 smithi097 ceph-mon[32687]: from='client.24772 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}]': finished 2021-10-08T19:23:43.841 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:43 smithi097 ceph-mon[32687]: osdmap e94: 8 total, 8 up, 7 in 2021-10-08T19:23:43.841 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:43 smithi097 ceph-mon[41966]: pgmap v82: 132 pgs: 132 active+clean; 582 KiB data, 51 MiB used, 626 GiB / 626 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:23:43.841 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-10-08T19:23:43.842 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [3, 2]}]: dispatch 2021-10-08T19:23:43.842 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:43 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2307752034' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}]: dispatch 2021-10-08T19:23:43.842 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:43 smithi097 ceph-mon[41966]: from='client.24772 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}]: dispatch 2021-10-08T19:23:43.843 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]': finished 2021-10-08T19:23:43.843 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [3, 2]}]': finished 2021-10-08T19:23:43.843 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:43 smithi097 ceph-mon[41966]: from='client.24772 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}]': finished 2021-10-08T19:23:43.843 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:43 smithi097 ceph-mon[41966]: osdmap e94: 8 total, 8 up, 7 in 2021-10-08T19:23:44.034 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:23:44.139 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:23:44.142 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:44.143 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:23:44.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:23:43 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:23:43] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:23:44.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:43 smithi117 ceph-mon[34585]: pgmap v82: 132 pgs: 132 active+clean; 582 KiB data, 51 MiB used, 626 GiB / 626 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:23:44.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-10-08T19:23:44.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [3, 2]}]: dispatch 2021-10-08T19:23:44.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:43 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2307752034' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}]: dispatch 2021-10-08T19:23:44.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:43 smithi117 ceph-mon[34585]: from='client.24772 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}]: dispatch 2021-10-08T19:23:44.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]': finished 2021-10-08T19:23:44.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [3, 2]}]': finished 2021-10-08T19:23:44.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:43 smithi117 ceph-mon[34585]: from='client.24772 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}]': finished 2021-10-08T19:23:44.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:43 smithi117 ceph-mon[34585]: osdmap e94: 8 total, 8 up, 7 in 2021-10-08T19:23:44.244 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:23:44.269 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:45.020 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:23:45.025 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:45.026 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:23:45.030 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2021-10-08T19:23:45.110 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set nodeep-scrub 2021-10-08T19:23:45.128 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:23:45.186 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:45.266 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:23:45.281 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:45.281 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:23:45.382 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:23:45.409 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:45.526 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2021-10-08T19:23:45.527 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:23:45.883 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:23:45.884 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:45 smithi097 ceph-mon[41966]: pgmap v85: 148 pgs: 16 unknown, 2 active+recovering, 129 active+clean, 1 remapped+peering; 582 KiB data, 52 MiB used, 626 GiB / 626 GiB avail; 2/582 objects misplaced (0.344%); 218 B/s, 11 objects/s recovering 2021-10-08T19:23:45.884 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:45 smithi097 ceph-mon[41966]: osdmap e95: 8 total, 8 up, 7 in 2021-10-08T19:23:45.885 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:45 smithi097 ceph-mon[32687]: pgmap v85: 148 pgs: 16 unknown, 2 active+recovering, 129 active+clean, 1 remapped+peering; 582 KiB data, 52 MiB used, 626 GiB / 626 GiB avail; 2/582 objects misplaced (0.344%); 218 B/s, 11 objects/s recovering 2021-10-08T19:23:45.885 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:45 smithi097 ceph-mon[32687]: osdmap e95: 8 total, 8 up, 7 in 2021-10-08T19:23:45.886 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:45.886 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:23:45.987 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:23:46.013 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:46.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:45 smithi117 ceph-mon[34585]: pgmap v85: 148 pgs: 16 unknown, 2 active+recovering, 129 active+clean, 1 remapped+peering; 582 KiB data, 52 MiB used, 626 GiB / 626 GiB avail; 2/582 objects misplaced (0.344%); 218 B/s, 11 objects/s recovering 2021-10-08T19:23:46.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:45 smithi117 ceph-mon[34585]: osdmap e95: 8 total, 8 up, 7 in 2021-10-08T19:23:46.516 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:23:46.538 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:23:46.539 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2021-10-08T19:23:46.541 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:46.542 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:23:46.643 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:23:46.647 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:23:46.654 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:23:46 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:23:46.671 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:46.720 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:23:46.722 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:46.723 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:23:46.825 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:23:46.850 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:46.897 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:23:46.899 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:46.900 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:23:46.983 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:23:47.000 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:23:47.001 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:23:47.017 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:23:47.024 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:46 smithi117 ceph-mon[34585]: osdmap e96: 8 total, 8 up, 7 in 2021-10-08T19:23:47.026 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:47.035 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:23:47.056 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:23:47.068 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:23:47.070 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:47.071 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:23:47.085 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:23:47.107 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:23:47.116 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:46 smithi097 ceph-mon[32687]: osdmap e96: 8 total, 8 up, 7 in 2021-10-08T19:23:47.116 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:46 smithi097 ceph-mon[41966]: osdmap e96: 8 total, 8 up, 7 in 2021-10-08T19:23:47.131 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:23:47.133 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true' 2021-10-08T19:23:47.133 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true' 2021-10-08T19:23:47.133 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true' 2021-10-08T19:23:47.134 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true' 2021-10-08T19:23:47.134 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true' 2021-10-08T19:23:47.134 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true' 2021-10-08T19:23:47.134 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'true' 2021-10-08T19:23:47.134 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'true' 2021-10-08T19:23:47.172 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:23:47.196 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:47.237 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:23:47.239 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:47.240 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:23:47.341 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:23:47.364 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:47.406 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:23:47.407 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:47.408 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:23:47.509 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:23:47.537 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:48.080 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 7] out_osds: [6] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2021-10-08T19:23:48.080 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2021-10-08T19:23:48.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:47 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:23:48.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:47 smithi117 ceph-mon[34585]: pgmap v88: 148 pgs: 16 unknown, 2 active+recovering, 129 active+clean, 1 remapped+peering; 582 KiB data, 52 MiB used, 626 GiB / 626 GiB avail; 2/582 objects misplaced (0.344%); 328 B/s, 16 objects/s recovering 2021-10-08T19:23:48.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:47 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/842533070' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:23:48.219 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:47 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:23:48.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:47 smithi097 ceph-mon[41966]: pgmap v88: 148 pgs: 16 unknown, 2 active+recovering, 129 active+clean, 1 remapped+peering; 582 KiB data, 52 MiB used, 626 GiB / 626 GiB avail; 2/582 objects misplaced (0.344%); 328 B/s, 16 objects/s recovering 2021-10-08T19:23:48.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:47 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/842533070' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:23:48.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:47 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:23:48.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:47 smithi097 ceph-mon[32687]: pgmap v88: 148 pgs: 16 unknown, 2 active+recovering, 129 active+clean, 1 remapped+peering; 582 KiB data, 52 MiB used, 626 GiB / 626 GiB avail; 2/582 objects misplaced (0.344%); 328 B/s, 16 objects/s recovering 2021-10-08T19:23:48.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:47 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/842533070' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:23:48.839 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:23:48.842 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:48.843 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:23:48.907 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:23:48.944 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:23:48.970 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:49.075 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:23:49.077 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:48 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:23:49.078 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:48 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:23:49.078 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:48 smithi097 ceph-mon[32687]: osdmap e97: 8 total, 8 up, 7 in 2021-10-08T19:23:49.078 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:48 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:23:49.079 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:48 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:23:49.079 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:48 smithi097 ceph-mon[41966]: osdmap e97: 8 total, 8 up, 7 in 2021-10-08T19:23:49.079 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:49.080 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:23:49.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:48 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:23:49.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:48 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:23:49.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:48 smithi117 ceph-mon[34585]: osdmap e97: 8 total, 8 up, 7 in 2021-10-08T19:23:49.181 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:23:49.214 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:49.489 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:23:49.493 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:49.494 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:23:49.595 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:23:49.625 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:49.674 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:23:49.676 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:49.677 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:23:49.779 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:23:49.805 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:49.829 INFO:teuthology.orchestra.run.smithi097.stderr:enabled application 'rados' on pool 'unique_pool_0' 2021-10-08T19:23:49.853 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:23:49.855 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:49.857 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:23:49.875 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2021-10-08T19:23:49.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:49 smithi117 ceph-mon[34585]: pgmap v90: 148 pgs: 148 active+clean; 582 KiB data, 54 MiB used, 626 GiB / 626 GiB avail; 880 B/s rd, 0 op/s; 124 KiB/s, 1 objects/s recovering 2021-10-08T19:23:49.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:49 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3467044826' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:23:49.959 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:23:49.969 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:49 smithi097 ceph-mon[41966]: pgmap v90: 148 pgs: 148 active+clean; 582 KiB data, 54 MiB used, 626 GiB / 626 GiB avail; 880 B/s rd, 0 op/s; 124 KiB/s, 1 objects/s recovering 2021-10-08T19:23:49.969 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:49 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3467044826' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:23:49.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:49 smithi097 ceph-mon[32687]: pgmap v90: 148 pgs: 148 active+clean; 582 KiB data, 54 MiB used, 626 GiB / 626 GiB avail; 880 B/s rd, 0 op/s; 124 KiB/s, 1 objects/s recovering 2021-10-08T19:23:49.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:49 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3467044826' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:23:49.983 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:50.535 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:23:50.543 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:50.544 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:23:50.645 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:23:50.676 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:50.722 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:23:50.724 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:50.725 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:23:50.808 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:23:50 smithi097 conmon[33110]: 172.21.15.97 - - [08/Oct/2021:19:23:50] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:23:50.826 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:23:50.843 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is set 2021-10-08T19:23:50.857 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:51.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:50 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3467044826' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]': finished 2021-10-08T19:23:51.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:50 smithi117 ceph-mon[34585]: osdmap e98: 8 total, 8 up, 7 in 2021-10-08T19:23:51.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:50 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/820622405' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:23:51.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:50 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:23:51.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:50 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3467044826' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]': finished 2021-10-08T19:23:51.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:50 smithi097 ceph-mon[32687]: osdmap e98: 8 total, 8 up, 7 in 2021-10-08T19:23:51.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:50 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/820622405' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:23:51.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:50 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:23:51.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:50 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3467044826' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]': finished 2021-10-08T19:23:51.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:50 smithi097 ceph-mon[41966]: osdmap e98: 8 total, 8 up, 7 in 2021-10-08T19:23:51.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:50 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/820622405' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:23:51.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:50 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:23:51.531 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:23:51.532 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2021-10-08T19:23:51.532 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2021-10-08T19:23:51.532 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2021-10-08T19:23:51.532 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.533 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.14156.0:162 1.0 e21/19 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 21'116, mlcod=21'114)", 2021-10-08T19:23:51.533 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:19:48.865873+0000", 2021-10-08T19:23:51.534 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 242.32472448600001, 2021-10-08T19:23:51.534 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001638205, 2021-10-08T19:23:51.535 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:23:51.535 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:23:51.535 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:23:51.536 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.536 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:23:51.536 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:19:48.865873+0000", 2021-10-08T19:23:51.536 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:23:51.537 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.537 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.537 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:23:51.537 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:19:48.865873+0000", 2021-10-08T19:23:51.539 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:23:51.539 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.539 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.540 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:23:51.540 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:19:48.865872+0000", 2021-10-08T19:23:51.540 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:23:51.540 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.540 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.541 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:23:51.541 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:19:48.865880+0000", 2021-10-08T19:23:51.541 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8140000000000001e-06 2021-10-08T19:23:51.541 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.542 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.542 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:23:51.542 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:19:48.865890+0000", 2021-10-08T19:23:51.542 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.6600000000000007e-06 2021-10-08T19:23:51.543 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.543 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.543 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:23:51.543 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:19:48.865895+0000", 2021-10-08T19:23:51.544 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4700000000000001e-06 2021-10-08T19:23:51.544 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.544 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.544 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:23:51.546 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:19:48.865934+0000", 2021-10-08T19:23:51.546 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8866999999999999e-05 2021-10-08T19:23:51.546 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.546 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.547 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:23:51.547 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:19:48.865953+0000", 2021-10-08T19:23:51.547 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9139000000000001e-05 2021-10-08T19:23:51.547 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.549 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.550 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:23:51.550 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:19:48.867485+0000", 2021-10-08T19:23:51.550 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0015317620000000001 2021-10-08T19:23:51.551 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.551 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.551 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:23:51.551 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:19:48.867512+0000", 2021-10-08T19:23:51.552 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6488000000000001e-05 2021-10-08T19:23:51.552 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:23:51.552 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:23:51.552 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:23:51.553 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.553 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.556 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24400.0:96 5.3 5:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2021-10-08T19:23:51.557 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:21:27.650471+0000", 2021-10-08T19:23:51.557 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 143.54012662599999, 2021-10-08T19:23:51.558 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001211597, 2021-10-08T19:23:51.558 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:23:51.559 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:23:51.559 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:23:51.561 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24400", 2021-10-08T19:23:51.561 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1098048758", 2021-10-08T19:23:51.561 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 96 2021-10-08T19:23:51.562 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.562 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:23:51.563 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.563 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:23:51.564 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:27.650471+0000", 2021-10-08T19:23:51.564 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:23:51.565 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.565 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.565 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:23:51.566 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:27.650471+0000", 2021-10-08T19:23:51.566 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:23:51.566 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.567 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.567 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:23:51.567 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:27.650468+0000", 2021-10-08T19:23:51.567 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999967 2021-10-08T19:23:51.568 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.568 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.568 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:23:51.568 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:27.650477+0000", 2021-10-08T19:23:51.569 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6850000000000007e-06 2021-10-08T19:23:51.569 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.569 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.569 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:23:51.569 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:27.650491+0000", 2021-10-08T19:23:51.570 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4346e-05 2021-10-08T19:23:51.570 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.570 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.571 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:23:51.571 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:27.650497+0000", 2021-10-08T19:23:51.571 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.733e-06 2021-10-08T19:23:51.572 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.572 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.572 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:23:51.572 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:27.650558+0000", 2021-10-08T19:23:51.572 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1140000000000001e-05 2021-10-08T19:23:51.573 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.573 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.573 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:23:51.573 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:27.650655+0000", 2021-10-08T19:23:51.574 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.7564000000000003e-05 2021-10-08T19:23:51.574 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.574 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.574 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5,6", 2021-10-08T19:23:51.575 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:27.650744+0000", 2021-10-08T19:23:51.575 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8463999999999999e-05 2021-10-08T19:23:51.575 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.576 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.576 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:23:51.576 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:27.651344+0000", 2021-10-08T19:23:51.576 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00059966900000000005 2021-10-08T19:23:51.577 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.577 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.577 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:23:51.578 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:27.651567+0000", 2021-10-08T19:23:51.578 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000223134 2021-10-08T19:23:51.578 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.578 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.579 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:23:51.579 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:27.651622+0000", 2021-10-08T19:23:51.579 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4777000000000001e-05 2021-10-08T19:23:51.579 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.580 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.580 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:23:51.580 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:27.651659+0000", 2021-10-08T19:23:51.581 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7178000000000002e-05 2021-10-08T19:23:51.581 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.581 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.581 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:23:51.582 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:27.651683+0000", 2021-10-08T19:23:51.582 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4128e-05 2021-10-08T19:23:51.582 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:23:51.582 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:23:51.583 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:23:51.583 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.583 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.584 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.14457.0:106 5.3 5:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2021-10-08T19:23:51.584 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:21:27.650647+0000", 2021-10-08T19:23:51.584 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 143.53995133999999, 2021-10-08T19:23:51.585 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012417680000000001, 2021-10-08T19:23:51.585 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:23:51.585 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:23:51.585 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:23:51.586 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.14457", 2021-10-08T19:23:51.586 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1622493358", 2021-10-08T19:23:51.586 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 106 2021-10-08T19:23:51.587 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.587 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:23:51.588 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.588 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:23:51.588 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:27.650647+0000", 2021-10-08T19:23:51.589 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:23:51.589 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.590 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.590 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:23:51.590 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:27.650647+0000", 2021-10-08T19:23:51.591 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:23:51.591 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.592 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.592 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:23:51.592 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:27.650645+0000", 2021-10-08T19:23:51.593 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:23:51.593 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.594 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.594 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:23:51.594 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:27.650652+0000", 2021-10-08T19:23:51.595 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5259999999999996e-06 2021-10-08T19:23:51.595 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.595 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.596 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:23:51.596 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:27.650664+0000", 2021-10-08T19:23:51.596 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1571e-05 2021-10-08T19:23:51.597 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.597 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.598 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:23:51.598 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:27.650670+0000", 2021-10-08T19:23:51.599 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.686e-06 2021-10-08T19:23:51.599 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.599 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.600 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:23:51.600 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:27.650972+0000", 2021-10-08T19:23:51.600 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00030181199999999999 2021-10-08T19:23:51.601 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.601 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.601 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:23:51.601 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:27.651055+0000", 2021-10-08T19:23:51.602 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3075e-05 2021-10-08T19:23:51.602 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.603 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.603 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5,6", 2021-10-08T19:23:51.603 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:27.651165+0000", 2021-10-08T19:23:51.604 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010951300000000001 2021-10-08T19:23:51.604 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.604 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.605 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:23:51.605 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:27.651584+0000", 2021-10-08T19:23:51.606 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00041870299999999998 2021-10-08T19:23:51.606 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.606 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.607 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:23:51.607 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:27.651744+0000", 2021-10-08T19:23:51.607 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016019600000000001 2021-10-08T19:23:51.608 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.608 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.608 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:23:51.609 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:27.651801+0000", 2021-10-08T19:23:51.609 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7398000000000002e-05 2021-10-08T19:23:51.609 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.609 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.609 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:23:51.610 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:27.651851+0000", 2021-10-08T19:23:51.610 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0272000000000003e-05 2021-10-08T19:23:51.610 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.611 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.611 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:23:51.612 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:27.651888+0000", 2021-10-08T19:23:51.612 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6894999999999998e-05 2021-10-08T19:23:51.613 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:23:51.613 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:23:51.614 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:23:51.614 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.614 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.615 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.14457.0:107 5.3 5:c609908c:::notify.5:head [watch watch cookie 94629485167744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2021-10-08T19:23:51.615 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:21:27.652030+0000", 2021-10-08T19:23:51.616 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 143.538567395, 2021-10-08T19:23:51.616 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0019912049999999998, 2021-10-08T19:23:51.617 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:23:51.617 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:23:51.617 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:23:51.618 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.14457", 2021-10-08T19:23:51.619 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1622493358", 2021-10-08T19:23:51.619 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 107 2021-10-08T19:23:51.619 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.620 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:23:51.620 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.621 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:23:51.621 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:27.652030+0000", 2021-10-08T19:23:51.621 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:23:51.622 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.622 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.623 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:23:51.623 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:27.652030+0000", 2021-10-08T19:23:51.624 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:23:51.624 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.625 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.625 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:23:51.625 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:27.652028+0000", 2021-10-08T19:23:51.626 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:23:51.626 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.627 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.627 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:23:51.627 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:27.652036+0000", 2021-10-08T19:23:51.628 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5950000000000001e-06 2021-10-08T19:23:51.628 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.629 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.629 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:23:51.629 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:27.652056+0000", 2021-10-08T19:23:51.630 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9562999999999999e-05 2021-10-08T19:23:51.631 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.631 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.631 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:23:51.632 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:27.652064+0000", 2021-10-08T19:23:51.632 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2689999999999999e-06 2021-10-08T19:23:51.633 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.633 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.634 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:23:51.634 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:27.652383+0000", 2021-10-08T19:23:51.634 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000318621 2021-10-08T19:23:51.635 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.635 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.636 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for rw locks", 2021-10-08T19:23:51.636 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:27.652440+0000", 2021-10-08T19:23:51.637 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7250000000000002e-05 2021-10-08T19:23:51.637 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.637 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.637 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:23:51.638 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:27.652984+0000", 2021-10-08T19:23:51.638 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00054445700000000004 2021-10-08T19:23:51.638 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.639 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.639 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:23:51.639 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:27.653065+0000", 2021-10-08T19:23:51.640 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1101999999999997e-05 2021-10-08T19:23:51.640 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.640 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.641 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5,6", 2021-10-08T19:23:51.641 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:27.653220+0000", 2021-10-08T19:23:51.641 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000154792 2021-10-08T19:23:51.642 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.642 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.643 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:23:51.643 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:27.653586+0000", 2021-10-08T19:23:51.644 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00036592500000000002 2021-10-08T19:23:51.644 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.645 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.645 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:23:51.645 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:27.653811+0000", 2021-10-08T19:23:51.646 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022516600000000001 2021-10-08T19:23:51.646 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.646 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.646 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:23:51.647 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:27.653930+0000", 2021-10-08T19:23:51.647 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011916100000000001 2021-10-08T19:23:51.647 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.647 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.647 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:23:51.648 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:27.653969+0000", 2021-10-08T19:23:51.648 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8275999999999997e-05 2021-10-08T19:23:51.648 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.648 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.648 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:23:51.649 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:27.654022+0000", 2021-10-08T19:23:51.649 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3012e-05 2021-10-08T19:23:51.649 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:23:51.649 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:23:51.649 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:23:51.650 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.650 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.650 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.14487.0:4 4.b 4:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2021-10-08T19:23:51.650 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:21:31.404666+0000", 2021-10-08T19:23:51.651 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 139.78593223799999, 2021-10-08T19:23:51.651 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017740049999999999, 2021-10-08T19:23:51.652 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:23:51.652 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:23:51.652 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:23:51.653 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.14487", 2021-10-08T19:23:51.653 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1356965238", 2021-10-08T19:23:51.653 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 4 2021-10-08T19:23:51.653 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.654 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:23:51.654 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.654 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:23:51.654 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.404666+0000", 2021-10-08T19:23:51.655 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:23:51.655 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.656 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.656 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:23:51.656 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.404666+0000", 2021-10-08T19:23:51.657 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:23:51.657 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.657 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.657 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:23:51.658 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.404663+0000", 2021-10-08T19:23:51.658 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2021-10-08T19:23:51.658 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.658 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.659 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:23:51.659 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.404675+0000", 2021-10-08T19:23:51.659 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2157999999999999e-05 2021-10-08T19:23:51.659 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.660 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.660 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:23:51.660 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.404689+0000", 2021-10-08T19:23:51.660 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4253000000000001e-05 2021-10-08T19:23:51.661 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.661 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.661 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:23:51.661 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.404698+0000", 2021-10-08T19:23:51.661 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7180000000000002e-06 2021-10-08T19:23:51.662 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.662 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.662 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:23:51.662 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.404795+0000", 2021-10-08T19:23:51.663 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.7411000000000006e-05 2021-10-08T19:23:51.663 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.663 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.663 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:23:51.664 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.404933+0000", 2021-10-08T19:23:51.664 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000137868 2021-10-08T19:23:51.664 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.664 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.664 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:23:51.665 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.405333+0000", 2021-10-08T19:23:51.665 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00039984999999999999 2021-10-08T19:23:51.665 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.665 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.666 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:23:51.666 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.406077+0000", 2021-10-08T19:23:51.666 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000744559 2021-10-08T19:23:51.666 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.667 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.667 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:23:51.667 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.406105+0000", 2021-10-08T19:23:51.667 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7440000000000002e-05 2021-10-08T19:23:51.668 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.668 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.668 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:23:51.668 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.406347+0000", 2021-10-08T19:23:51.668 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024237999999999999 2021-10-08T19:23:51.669 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.669 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.669 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:23:51.669 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.406401+0000", 2021-10-08T19:23:51.670 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4147000000000002e-05 2021-10-08T19:23:51.670 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.670 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.670 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:23:51.670 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.406440+0000", 2021-10-08T19:23:51.671 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8210000000000002e-05 2021-10-08T19:23:51.671 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:23:51.671 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:23:51.671 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:23:51.671 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.672 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.672 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.14487.0:6 4.3 4:c60da066:gc::gc.4:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2021-10-08T19:23:51.672 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:21:31.408928+0000", 2021-10-08T19:23:51.672 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 139.78166948800001, 2021-10-08T19:23:51.673 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00128101, 2021-10-08T19:23:51.673 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:23:51.673 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:23:51.673 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:23:51.673 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.14487", 2021-10-08T19:23:51.674 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1356965238", 2021-10-08T19:23:51.674 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 6 2021-10-08T19:23:51.674 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.674 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:23:51.676 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.677 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:23:51.677 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.408928+0000", 2021-10-08T19:23:51.677 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:23:51.677 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.677 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.678 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:23:51.678 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.408928+0000", 2021-10-08T19:23:51.678 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:23:51.678 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.679 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.679 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:23:51.679 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.408926+0000", 2021-10-08T19:23:51.679 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:23:51.679 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.680 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.680 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:23:51.680 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.408935+0000", 2021-10-08T19:23:51.680 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1780000000000003e-06 2021-10-08T19:23:51.681 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.681 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.681 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:23:51.681 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.408948+0000", 2021-10-08T19:23:51.681 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3434999999999999e-05 2021-10-08T19:23:51.682 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.682 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.682 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:23:51.682 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.408954+0000", 2021-10-08T19:23:51.682 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9030000000000001e-06 2021-10-08T19:23:51.683 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.683 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.683 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:23:51.683 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.409016+0000", 2021-10-08T19:23:51.684 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2551999999999993e-05 2021-10-08T19:23:51.684 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.684 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.684 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:23:51.684 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.409131+0000", 2021-10-08T19:23:51.685 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000114922 2021-10-08T19:23:51.685 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.685 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.685 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5,7", 2021-10-08T19:23:51.685 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.409315+0000", 2021-10-08T19:23:51.686 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000183847 2021-10-08T19:23:51.686 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.687 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.687 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:23:51.687 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.409783+0000", 2021-10-08T19:23:51.687 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00046825799999999999 2021-10-08T19:23:51.687 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.688 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.688 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:23:51.688 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.410062+0000", 2021-10-08T19:23:51.689 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00027812399999999998 2021-10-08T19:23:51.689 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.689 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.689 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:23:51.689 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.410121+0000", 2021-10-08T19:23:51.690 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8959000000000003e-05 2021-10-08T19:23:51.690 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.690 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.690 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:23:51.691 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.410173+0000", 2021-10-08T19:23:51.691 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2657000000000001e-05 2021-10-08T19:23:51.691 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.691 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.691 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:23:51.692 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.410209+0000", 2021-10-08T19:23:51.692 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6174000000000003e-05 2021-10-08T19:23:51.692 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:23:51.692 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:23:51.692 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:23:51.693 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.693 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.693 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24400.0:250 5.3 5:c609908c:::notify.5:head [watch unwatch cookie 94386144763648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2021-10-08T19:23:51.694 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:21:31.410290+0000", 2021-10-08T19:23:51.694 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 139.78030749199999, 2021-10-08T19:23:51.694 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001485802, 2021-10-08T19:23:51.694 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:23:51.694 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:23:51.695 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:23:51.695 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24400", 2021-10-08T19:23:51.695 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1098048758", 2021-10-08T19:23:51.695 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 250 2021-10-08T19:23:51.696 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.696 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:23:51.696 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.696 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:23:51.697 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.410290+0000", 2021-10-08T19:23:51.697 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:23:51.697 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.697 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.698 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:23:51.698 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.410290+0000", 2021-10-08T19:23:51.698 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:23:51.698 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.699 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.699 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:23:51.699 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.410288+0000", 2021-10-08T19:23:51.699 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:23:51.699 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.700 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.700 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:23:51.700 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.410297+0000", 2021-10-08T19:23:51.700 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4020000000000002e-06 2021-10-08T19:23:51.701 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.701 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.701 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:23:51.701 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.410310+0000", 2021-10-08T19:23:51.701 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3113e-05 2021-10-08T19:23:51.702 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.702 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.702 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:23:51.702 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.410315+0000", 2021-10-08T19:23:51.703 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3419999999999998e-06 2021-10-08T19:23:51.703 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.703 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.703 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:23:51.703 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.410361+0000", 2021-10-08T19:23:51.704 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6153999999999999e-05 2021-10-08T19:23:51.704 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.704 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.704 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:23:51.704 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.410429+0000", 2021-10-08T19:23:51.705 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7167000000000003e-05 2021-10-08T19:23:51.705 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.705 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.705 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5,6", 2021-10-08T19:23:51.706 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.410534+0000", 2021-10-08T19:23:51.706 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010517 2021-10-08T19:23:51.706 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.706 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.707 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:23:51.707 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.410880+0000", 2021-10-08T19:23:51.708 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000346382 2021-10-08T19:23:51.708 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.708 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.708 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:23:51.709 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.411339+0000", 2021-10-08T19:23:51.709 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00045927000000000001 2021-10-08T19:23:51.709 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.710 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.710 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:23:51.710 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.411706+0000", 2021-10-08T19:23:51.710 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00036624699999999999 2021-10-08T19:23:51.710 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.711 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.711 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:23:51.711 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.411736+0000", 2021-10-08T19:23:51.711 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0446999999999998e-05 2021-10-08T19:23:51.711 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.712 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.712 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:23:51.712 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.411776+0000", 2021-10-08T19:23:51.712 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0046000000000002e-05 2021-10-08T19:23:51.713 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:23:51.713 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:23:51.713 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:23:51.713 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.714 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.714 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.14487.0:12 4.3 4:c31f41d7:gc::gc.10:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2021-10-08T19:23:51.714 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:21:31.419342+0000", 2021-10-08T19:23:51.714 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 139.77125608399999, 2021-10-08T19:23:51.715 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001304857, 2021-10-08T19:23:51.715 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:23:51.715 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:23:51.715 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:23:51.715 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.14487", 2021-10-08T19:23:51.716 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1356965238", 2021-10-08T19:23:51.716 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 12 2021-10-08T19:23:51.716 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.716 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:23:51.717 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.717 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:23:51.717 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.419342+0000", 2021-10-08T19:23:51.718 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:23:51.718 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.718 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.718 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:23:51.719 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.419342+0000", 2021-10-08T19:23:51.719 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:23:51.719 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.719 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.720 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:23:51.720 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.419338+0000", 2021-10-08T19:23:51.720 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999967 2021-10-08T19:23:51.720 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.720 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.721 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:23:51.721 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.419351+0000", 2021-10-08T19:23:51.721 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.216e-05 2021-10-08T19:23:51.721 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.721 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.722 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:23:51.722 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.419370+0000", 2021-10-08T19:23:51.722 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9703000000000001e-05 2021-10-08T19:23:51.722 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.723 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.723 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:23:51.723 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.419379+0000", 2021-10-08T19:23:51.723 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.1949999999999992e-06 2021-10-08T19:23:51.723 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.724 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.724 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:23:51.724 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.419439+0000", 2021-10-08T19:23:51.724 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9450000000000002e-05 2021-10-08T19:23:51.724 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.725 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.725 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:23:51.725 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.419576+0000", 2021-10-08T19:23:51.725 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000136608 2021-10-08T19:23:51.726 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.726 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.726 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5,7", 2021-10-08T19:23:51.726 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.419876+0000", 2021-10-08T19:23:51.726 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00030089899999999998 2021-10-08T19:23:51.727 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.727 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.727 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:23:51.727 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.420307+0000", 2021-10-08T19:23:51.727 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00043032299999999998 2021-10-08T19:23:51.728 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.728 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.729 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:23:51.729 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.420530+0000", 2021-10-08T19:23:51.729 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022345000000000001 2021-10-08T19:23:51.729 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.729 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.730 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:23:51.730 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.420585+0000", 2021-10-08T19:23:51.730 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4805000000000001e-05 2021-10-08T19:23:51.730 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.731 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.731 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:23:51.731 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.420622+0000", 2021-10-08T19:23:51.731 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6853000000000001e-05 2021-10-08T19:23:51.731 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.732 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.732 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:23:51.732 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.420647+0000", 2021-10-08T19:23:51.732 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4765000000000001e-05 2021-10-08T19:23:51.732 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:23:51.733 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:23:51.733 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:23:51.733 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.733 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.733 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.14487.0:18 4.3 4:c623b173:gc::gc.16:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2021-10-08T19:23:51.734 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:21:31.428820+0000", 2021-10-08T19:23:51.734 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 139.761777728, 2021-10-08T19:23:51.734 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011954330000000001, 2021-10-08T19:23:51.734 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:23:51.735 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:23:51.735 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:23:51.735 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.14487", 2021-10-08T19:23:51.735 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1356965238", 2021-10-08T19:23:51.735 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 18 2021-10-08T19:23:51.736 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.736 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:23:51.736 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.736 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:23:51.736 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.428820+0000", 2021-10-08T19:23:51.737 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:23:51.737 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.737 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.737 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:23:51.737 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.428820+0000", 2021-10-08T19:23:51.738 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:23:51.738 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.739 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.739 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:23:51.739 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.428818+0000", 2021-10-08T19:23:51.739 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:23:51.739 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.740 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.740 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:23:51.740 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.428827+0000", 2021-10-08T19:23:51.740 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0089999999999996e-06 2021-10-08T19:23:51.741 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.741 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.741 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:23:51.741 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.428839+0000", 2021-10-08T19:23:51.741 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2427e-05 2021-10-08T19:23:51.742 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.742 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.742 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:23:51.742 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.428846+0000", 2021-10-08T19:23:51.743 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1949999999999997e-06 2021-10-08T19:23:51.743 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.743 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.743 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:23:51.743 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.428908+0000", 2021-10-08T19:23:51.744 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1100999999999997e-05 2021-10-08T19:23:51.744 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.744 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.744 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:23:51.745 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.429084+0000", 2021-10-08T19:23:51.745 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017619000000000001 2021-10-08T19:23:51.745 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.745 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.745 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5,7", 2021-10-08T19:23:51.746 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.429332+0000", 2021-10-08T19:23:51.746 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024779100000000003 2021-10-08T19:23:51.746 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.746 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.746 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:23:51.747 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.429764+0000", 2021-10-08T19:23:51.747 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00043227100000000002 2021-10-08T19:23:51.747 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.747 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.748 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:23:51.748 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.429892+0000", 2021-10-08T19:23:51.748 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012812899999999999 2021-10-08T19:23:51.748 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.748 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.749 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:23:51.749 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.429934+0000", 2021-10-08T19:23:51.749 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1903000000000002e-05 2021-10-08T19:23:51.749 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.749 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.750 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:23:51.750 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.429970+0000", 2021-10-08T19:23:51.750 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6329999999999999e-05 2021-10-08T19:23:51.750 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.751 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.751 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:23:51.751 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.430016+0000", 2021-10-08T19:23:51.751 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5405999999999999e-05 2021-10-08T19:23:51.751 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:23:51.752 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:23:51.752 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:23:51.752 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.752 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.752 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.14487.0:19 4.16 4:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2021-10-08T19:23:51.753 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:21:31.430120+0000", 2021-10-08T19:23:51.753 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 139.76047768000001, 2021-10-08T19:23:51.753 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012821709999999999, 2021-10-08T19:23:51.754 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:23:51.754 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:23:51.754 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:23:51.754 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.14487", 2021-10-08T19:23:51.755 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1356965238", 2021-10-08T19:23:51.755 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 19 2021-10-08T19:23:51.755 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.755 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:23:51.756 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.756 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:23:51.756 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.430120+0000", 2021-10-08T19:23:51.756 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:23:51.756 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.757 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.757 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:23:51.757 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.430120+0000", 2021-10-08T19:23:51.758 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:23:51.758 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.758 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.758 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:23:51.758 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.430119+0000", 2021-10-08T19:23:51.759 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2021-10-08T19:23:51.759 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.759 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.759 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:23:51.760 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.430125+0000", 2021-10-08T19:23:51.760 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5780000000000004e-06 2021-10-08T19:23:51.760 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.760 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.760 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:23:51.761 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.430137+0000", 2021-10-08T19:23:51.761 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1595e-05 2021-10-08T19:23:51.761 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.761 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.761 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:23:51.762 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.430143+0000", 2021-10-08T19:23:51.762 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7300000000000002e-06 2021-10-08T19:23:51.762 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.762 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.763 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:23:51.763 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.430192+0000", 2021-10-08T19:23:51.763 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9194999999999999e-05 2021-10-08T19:23:51.763 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.763 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.764 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:23:51.764 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.430283+0000", 2021-10-08T19:23:51.764 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.1300999999999999e-05 2021-10-08T19:23:51.764 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.764 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.765 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,7", 2021-10-08T19:23:51.765 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.430461+0000", 2021-10-08T19:23:51.765 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000177596 2021-10-08T19:23:51.765 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.766 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.766 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:23:51.766 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.430896+0000", 2021-10-08T19:23:51.766 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000435165 2021-10-08T19:23:51.766 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.767 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.767 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:23:51.767 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.431238+0000", 2021-10-08T19:23:51.767 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00034220300000000002 2021-10-08T19:23:51.767 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.768 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.768 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:23:51.768 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.431345+0000", 2021-10-08T19:23:51.768 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000106772 2021-10-08T19:23:51.769 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.769 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.769 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:23:51.769 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.431377+0000", 2021-10-08T19:23:51.769 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2157999999999999e-05 2021-10-08T19:23:51.770 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.770 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.770 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:23:51.770 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.431402+0000", 2021-10-08T19:23:51.770 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5435e-05 2021-10-08T19:23:51.771 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:23:51.771 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:23:51.771 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:23:51.771 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.772 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.772 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.14487.0:34 4.3 4:c623b173:gc::gc.16:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2021-10-08T19:23:51.772 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:21:31.449874+0000", 2021-10-08T19:23:51.772 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 139.74072417100001, 2021-10-08T19:23:51.772 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011955920000000001, 2021-10-08T19:23:51.773 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:23:51.773 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:23:51.773 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:23:51.773 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.14487", 2021-10-08T19:23:51.773 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1356965238", 2021-10-08T19:23:51.774 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 34 2021-10-08T19:23:51.774 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.774 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:23:51.774 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.775 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:23:51.775 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.449874+0000", 2021-10-08T19:23:51.775 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:23:51.775 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.775 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.776 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:23:51.776 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.449874+0000", 2021-10-08T19:23:51.776 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:23:51.776 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.776 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.777 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:23:51.777 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.449871+0000", 2021-10-08T19:23:51.777 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2021-10-08T19:23:51.777 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.778 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.778 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:23:51.778 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.449882+0000", 2021-10-08T19:23:51.778 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0784999999999999e-05 2021-10-08T19:23:51.778 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.779 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.779 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:23:51.779 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.449902+0000", 2021-10-08T19:23:51.779 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0355000000000001e-05 2021-10-08T19:23:51.779 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.780 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.780 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:23:51.780 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.449910+0000", 2021-10-08T19:23:51.780 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7800000000000001e-06 2021-10-08T19:23:51.780 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.781 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.781 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:23:51.782 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.449978+0000", 2021-10-08T19:23:51.782 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8318000000000006e-05 2021-10-08T19:23:51.782 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.783 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.783 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:23:51.783 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.450110+0000", 2021-10-08T19:23:51.783 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000131903 2021-10-08T19:23:51.784 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.784 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.784 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5,7", 2021-10-08T19:23:51.784 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.450329+0000", 2021-10-08T19:23:51.784 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000219352 2021-10-08T19:23:51.785 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.785 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.785 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:23:51.785 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.450780+0000", 2021-10-08T19:23:51.786 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00045008899999999998 2021-10-08T19:23:51.786 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.786 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.786 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:23:51.786 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.450930+0000", 2021-10-08T19:23:51.787 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015045600000000001 2021-10-08T19:23:51.787 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.787 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.787 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:23:51.787 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.450972+0000", 2021-10-08T19:23:51.788 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1857000000000003e-05 2021-10-08T19:23:51.788 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.788 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.788 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:23:51.789 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.451026+0000", 2021-10-08T19:23:51.789 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4057000000000001e-05 2021-10-08T19:23:51.789 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.789 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.790 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:23:51.790 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.451069+0000", 2021-10-08T19:23:51.790 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3341999999999999e-05 2021-10-08T19:23:51.790 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:23:51.790 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:23:51.791 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:23:51.791 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.791 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.791 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.14487.0:47 4.16 4:6849fd06:gc::gc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2021-10-08T19:23:51.791 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:21:31.454589+0000", 2021-10-08T19:23:51.792 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 139.736009298, 2021-10-08T19:23:51.792 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012213479999999999, 2021-10-08T19:23:51.792 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:23:51.792 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:23:51.793 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:23:51.793 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.14487", 2021-10-08T19:23:51.793 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1356965238", 2021-10-08T19:23:51.793 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 47 2021-10-08T19:23:51.793 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.794 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:23:51.794 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.794 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:23:51.795 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.454589+0000", 2021-10-08T19:23:51.795 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:23:51.795 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.795 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.796 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:23:51.796 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.454589+0000", 2021-10-08T19:23:51.796 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:23:51.796 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.796 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.797 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:23:51.797 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.454587+0000", 2021-10-08T19:23:51.797 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:23:51.797 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.797 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.798 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:23:51.798 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.454596+0000", 2021-10-08T19:23:51.798 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.3899999999999999e-06 2021-10-08T19:23:51.798 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.799 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.799 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:23:51.799 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.454614+0000", 2021-10-08T19:23:51.799 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7609999999999999e-05 2021-10-08T19:23:51.799 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.800 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.800 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:23:51.800 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.454621+0000", 2021-10-08T19:23:51.800 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3900000000000004e-06 2021-10-08T19:23:51.801 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.801 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.801 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:23:51.801 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.454673+0000", 2021-10-08T19:23:51.801 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2046999999999998e-05 2021-10-08T19:23:51.802 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.802 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.802 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:23:51.802 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.454752+0000", 2021-10-08T19:23:51.803 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8689000000000005e-05 2021-10-08T19:23:51.803 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.803 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.803 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,7", 2021-10-08T19:23:51.803 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.454908+0000", 2021-10-08T19:23:51.804 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015639899999999999 2021-10-08T19:23:51.804 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.804 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.804 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:23:51.805 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.455310+0000", 2021-10-08T19:23:51.805 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00040150800000000002 2021-10-08T19:23:51.805 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.805 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.805 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:23:51.806 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.455637+0000", 2021-10-08T19:23:51.806 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032762500000000001 2021-10-08T19:23:51.806 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.806 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.807 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:23:51.807 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.455740+0000", 2021-10-08T19:23:51.807 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010327099999999999 2021-10-08T19:23:51.807 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.807 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.808 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:23:51.808 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.455775+0000", 2021-10-08T19:23:51.808 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4062e-05 2021-10-08T19:23:51.808 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.809 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.809 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:23:51.809 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.455810+0000", 2021-10-08T19:23:51.809 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5388000000000001e-05 2021-10-08T19:23:51.809 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:23:51.810 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:23:51.810 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:23:51.810 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.810 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.811 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.14487.0:78 4.3 4:c3a682d4:reshard::reshard.0000000004:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2021-10-08T19:23:51.811 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:21:31.467170+0000", 2021-10-08T19:23:51.811 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 139.72342785699999, 2021-10-08T19:23:51.811 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00133511, 2021-10-08T19:23:51.811 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:23:51.812 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:23:51.812 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:23:51.812 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.14487", 2021-10-08T19:23:51.813 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1356965238", 2021-10-08T19:23:51.813 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 78 2021-10-08T19:23:51.813 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.813 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:23:51.813 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.814 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:23:51.814 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.467170+0000", 2021-10-08T19:23:51.814 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:23:51.814 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.815 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.815 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:23:51.815 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.467170+0000", 2021-10-08T19:23:51.815 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:23:51.816 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.816 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.816 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:23:51.816 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.467166+0000", 2021-10-08T19:23:51.817 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999962 2021-10-08T19:23:51.817 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.817 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.817 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:23:51.817 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.467182+0000", 2021-10-08T19:23:51.818 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5678000000000001e-05 2021-10-08T19:23:51.818 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.818 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.818 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:23:51.819 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.467206+0000", 2021-10-08T19:23:51.819 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3754e-05 2021-10-08T19:23:51.819 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.819 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.819 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:23:51.820 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.467215+0000", 2021-10-08T19:23:51.820 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4909999999999994e-06 2021-10-08T19:23:51.820 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.820 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.820 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:23:51.821 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.467275+0000", 2021-10-08T19:23:51.821 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9867999999999997e-05 2021-10-08T19:23:51.821 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.821 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.822 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:23:51.822 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.467421+0000", 2021-10-08T19:23:51.822 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014580999999999999 2021-10-08T19:23:51.822 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.823 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.823 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5,7", 2021-10-08T19:23:51.823 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.467638+0000", 2021-10-08T19:23:51.823 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021761 2021-10-08T19:23:51.824 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.824 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.824 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:23:51.824 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.468041+0000", 2021-10-08T19:23:51.824 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00040278900000000002 2021-10-08T19:23:51.825 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.825 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.825 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:23:51.825 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.468201+0000", 2021-10-08T19:23:51.825 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015944900000000001 2021-10-08T19:23:51.826 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.826 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.826 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:23:51.826 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.468420+0000", 2021-10-08T19:23:51.827 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000219421 2021-10-08T19:23:51.827 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.827 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.827 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:23:51.827 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.468468+0000", 2021-10-08T19:23:51.828 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7425000000000001e-05 2021-10-08T19:23:51.828 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.828 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.828 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:23:51.829 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.468505+0000", 2021-10-08T19:23:51.829 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7539000000000001e-05 2021-10-08T19:23:51.829 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:23:51.829 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:23:51.829 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:23:51.830 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.830 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.830 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.14487.0:84 4.3 4:c3a682d4:reshard::reshard.0000000004:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2021-10-08T19:23:51.830 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:21:31.469016+0000", 2021-10-08T19:23:51.831 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 139.721581808, 2021-10-08T19:23:51.831 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013634630000000001, 2021-10-08T19:23:51.831 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:23:51.831 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:23:51.831 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:23:51.832 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.14487", 2021-10-08T19:23:51.832 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1356965238", 2021-10-08T19:23:51.832 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 84 2021-10-08T19:23:51.832 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.833 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:23:51.833 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.833 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:23:51.833 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.469016+0000", 2021-10-08T19:23:51.833 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:23:51.834 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.834 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.834 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:23:51.834 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.469016+0000", 2021-10-08T19:23:51.834 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:23:51.835 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.835 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.835 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:23:51.835 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.469014+0000", 2021-10-08T19:23:51.836 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:23:51.836 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.836 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.836 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:23:51.836 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.469022+0000", 2021-10-08T19:23:51.837 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7090000000000002e-06 2021-10-08T19:23:51.837 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.837 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.837 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:23:51.838 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.469036+0000", 2021-10-08T19:23:51.838 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4134999999999999e-05 2021-10-08T19:23:51.838 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.838 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.838 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:23:51.839 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.469043+0000", 2021-10-08T19:23:51.839 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6209999999999998e-06 2021-10-08T19:23:51.839 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.839 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.840 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:23:51.840 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.469076+0000", 2021-10-08T19:23:51.840 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2943e-05 2021-10-08T19:23:51.840 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.840 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.841 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:23:51.841 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.469136+0000", 2021-10-08T19:23:51.841 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0584000000000001e-05 2021-10-08T19:23:51.841 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.841 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.842 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5,7", 2021-10-08T19:23:51.842 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.469248+0000", 2021-10-08T19:23:51.842 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000111498 2021-10-08T19:23:51.842 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.843 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.843 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:23:51.843 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.469653+0000", 2021-10-08T19:23:51.843 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000405394 2021-10-08T19:23:51.843 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.844 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.844 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:23:51.844 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.469979+0000", 2021-10-08T19:23:51.844 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032553699999999998 2021-10-08T19:23:51.844 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.845 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.845 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:23:51.845 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.470294+0000", 2021-10-08T19:23:51.845 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031563400000000002 2021-10-08T19:23:51.846 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.846 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.846 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:23:51.846 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.470347+0000", 2021-10-08T19:23:51.846 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2141000000000001e-05 2021-10-08T19:23:51.847 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.847 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.847 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:23:51.847 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.470380+0000", 2021-10-08T19:23:51.847 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3008e-05 2021-10-08T19:23:51.848 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:23:51.848 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:23:51.848 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:23:51.848 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.849 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.849 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.14487.0:87 4.6 4:66924383:reshard::reshard.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2021-10-08T19:23:51.849 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:21:31.470554+0000", 2021-10-08T19:23:51.849 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 139.72004365800001, 2021-10-08T19:23:51.849 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0018308899999999999, 2021-10-08T19:23:51.850 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:23:51.850 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:23:51.850 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:23:51.850 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.14487", 2021-10-08T19:23:51.851 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1356965238", 2021-10-08T19:23:51.851 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 87 2021-10-08T19:23:51.851 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.851 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:23:51.851 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.852 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:23:51.852 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.470554+0000", 2021-10-08T19:23:51.852 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:23:51.852 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.853 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.853 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:23:51.853 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.470554+0000", 2021-10-08T19:23:51.853 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:23:51.853 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.854 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.854 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:23:51.854 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.470552+0000", 2021-10-08T19:23:51.854 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:23:51.854 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.855 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.855 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:23:51.855 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.470562+0000", 2021-10-08T19:23:51.855 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5820000000000008e-06 2021-10-08T19:23:51.855 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.856 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.856 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:23:51.856 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.470578+0000", 2021-10-08T19:23:51.856 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6778000000000001e-05 2021-10-08T19:23:51.857 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.857 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.857 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:23:51.858 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.470586+0000", 2021-10-08T19:23:51.858 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3100000000000003e-06 2021-10-08T19:23:51.858 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.858 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.858 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:23:51.859 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.470637+0000", 2021-10-08T19:23:51.859 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1737000000000003e-05 2021-10-08T19:23:51.859 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.859 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.859 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:23:51.860 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.470753+0000", 2021-10-08T19:23:51.860 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011548300000000001 2021-10-08T19:23:51.860 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.860 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.861 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,2", 2021-10-08T19:23:51.861 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.470951+0000", 2021-10-08T19:23:51.861 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019787200000000001 2021-10-08T19:23:51.861 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.861 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.862 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:23:51.862 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.471475+0000", 2021-10-08T19:23:51.862 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00052417900000000005 2021-10-08T19:23:51.862 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.863 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.863 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:23:51.863 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.472040+0000", 2021-10-08T19:23:51.863 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00056452900000000003 2021-10-08T19:23:51.863 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.864 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.864 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:23:51.864 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.472333+0000", 2021-10-08T19:23:51.864 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000293663 2021-10-08T19:23:51.864 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.865 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.865 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:23:51.865 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.472364+0000", 2021-10-08T19:23:51.865 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0910000000000001e-05 2021-10-08T19:23:51.865 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.866 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.866 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:23:51.866 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.472385+0000", 2021-10-08T19:23:51.866 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1019999999999999e-05 2021-10-08T19:23:51.867 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:23:51.867 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:23:51.867 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:23:51.867 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.867 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.868 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.14487.0:95 4.16 4:6dc3b799:reshard::reshard.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2021-10-08T19:23:51.868 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:21:31.474132+0000", 2021-10-08T19:23:51.868 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 139.716465425, 2021-10-08T19:23:51.868 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017826389999999999, 2021-10-08T19:23:51.869 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:23:51.869 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:23:51.869 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:23:51.869 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.14487", 2021-10-08T19:23:51.869 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1356965238", 2021-10-08T19:23:51.870 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 95 2021-10-08T19:23:51.870 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.870 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:23:51.870 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.870 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:23:51.871 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.474132+0000", 2021-10-08T19:23:51.871 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:23:51.871 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.871 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.871 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:23:51.872 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.474132+0000", 2021-10-08T19:23:51.872 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:23:51.872 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.872 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.873 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:23:51.873 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.474131+0000", 2021-10-08T19:23:51.873 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2021-10-08T19:23:51.873 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.873 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.874 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:23:51.874 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.474137+0000", 2021-10-08T19:23:51.874 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1850000000000001e-06 2021-10-08T19:23:51.874 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.875 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.875 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:23:51.875 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.474149+0000", 2021-10-08T19:23:51.875 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1832e-05 2021-10-08T19:23:51.875 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.876 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.876 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:23:51.876 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.474155+0000", 2021-10-08T19:23:51.876 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6100000000000002e-06 2021-10-08T19:23:51.876 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.877 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.877 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:23:51.877 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.474196+0000", 2021-10-08T19:23:51.877 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0151999999999998e-05 2021-10-08T19:23:51.878 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.878 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.878 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:23:51.878 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.474298+0000", 2021-10-08T19:23:51.878 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000102069 2021-10-08T19:23:51.879 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.879 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.879 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,7", 2021-10-08T19:23:51.879 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.474500+0000", 2021-10-08T19:23:51.879 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00020229300000000001 2021-10-08T19:23:51.880 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.880 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.880 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:23:51.880 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.474841+0000", 2021-10-08T19:23:51.881 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00034059599999999998 2021-10-08T19:23:51.881 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.881 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.881 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:23:51.881 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.475032+0000", 2021-10-08T19:23:51.882 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019178700000000001 2021-10-08T19:23:51.882 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.882 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.882 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:23:51.882 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.475835+0000", 2021-10-08T19:23:51.883 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00080230099999999995 2021-10-08T19:23:51.883 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.883 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.883 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:23:51.884 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.475879+0000", 2021-10-08T19:23:51.884 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4496000000000002e-05 2021-10-08T19:23:51.884 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.884 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.884 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:23:51.885 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.475915+0000", 2021-10-08T19:23:51.885 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5892999999999997e-05 2021-10-08T19:23:51.885 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:23:51.885 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:23:51.885 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:23:51.886 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.886 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.886 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.14487.0:106 4.16 4:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2021-10-08T19:23:51.886 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:21:31.477610+0000", 2021-10-08T19:23:51.887 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 139.71298793299999, 2021-10-08T19:23:51.887 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001255073, 2021-10-08T19:23:51.887 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:23:51.887 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:23:51.887 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:23:51.888 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.14487", 2021-10-08T19:23:51.888 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1356965238", 2021-10-08T19:23:51.888 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 106 2021-10-08T19:23:51.888 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.888 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:23:51.889 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.889 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:23:51.889 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.477610+0000", 2021-10-08T19:23:51.889 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:23:51.889 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.890 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.890 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:23:51.890 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.477610+0000", 2021-10-08T19:23:51.890 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:23:51.891 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.891 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.891 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:23:51.891 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.477608+0000", 2021-10-08T19:23:51.891 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:23:51.892 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.892 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.892 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:23:51.892 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.477617+0000", 2021-10-08T19:23:51.892 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4109999999999996e-06 2021-10-08T19:23:51.893 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.893 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.893 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:23:51.893 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.477630+0000", 2021-10-08T19:23:51.894 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3879999999999999e-05 2021-10-08T19:23:51.894 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.894 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.894 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:23:51.894 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.477637+0000", 2021-10-08T19:23:51.895 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7170000000000002e-06 2021-10-08T19:23:51.895 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.895 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.895 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:23:51.895 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.477666+0000", 2021-10-08T19:23:51.896 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8481999999999999e-05 2021-10-08T19:23:51.896 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.896 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.896 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:23:51.897 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.477747+0000", 2021-10-08T19:23:51.897 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1459999999999996e-05 2021-10-08T19:23:51.897 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.897 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.897 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,7", 2021-10-08T19:23:51.898 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.477919+0000", 2021-10-08T19:23:51.898 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017163599999999999 2021-10-08T19:23:51.898 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.898 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.898 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:23:51.899 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.478277+0000", 2021-10-08T19:23:51.899 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00035795800000000002 2021-10-08T19:23:51.899 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.899 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.900 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:23:51.900 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.478733+0000", 2021-10-08T19:23:51.900 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00045654000000000002 2021-10-08T19:23:51.900 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.900 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.901 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:23:51.901 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.478780+0000", 2021-10-08T19:23:51.901 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6839000000000003e-05 2021-10-08T19:23:51.901 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.901 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.902 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:23:51.902 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.478831+0000", 2021-10-08T19:23:51.902 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0720000000000002e-05 2021-10-08T19:23:51.902 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.902 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.903 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:23:51.903 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.478865+0000", 2021-10-08T19:23:51.903 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4153999999999999e-05 2021-10-08T19:23:51.903 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:23:51.904 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:23:51.904 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:23:51.904 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.904 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.904 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.14487.0:111 4.16 4:6a988a9b:reshard::reshard.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2021-10-08T19:23:51.905 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:21:31.479392+0000", 2021-10-08T19:23:51.905 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 139.71120557, 2021-10-08T19:23:51.905 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0015695590000000001, 2021-10-08T19:23:51.905 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:23:51.905 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:23:51.906 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:23:51.906 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.14487", 2021-10-08T19:23:51.906 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1356965238", 2021-10-08T19:23:51.906 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 111 2021-10-08T19:23:51.907 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.907 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:23:51.907 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.907 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:23:51.907 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.479392+0000", 2021-10-08T19:23:51.908 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:23:51.908 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.908 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.908 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:23:51.908 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.479392+0000", 2021-10-08T19:23:51.909 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:23:51.909 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.909 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.909 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:23:51.909 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.479390+0000", 2021-10-08T19:23:51.910 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:23:51.910 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.910 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.910 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:23:51.911 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.479399+0000", 2021-10-08T19:23:51.911 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3890000000000005e-06 2021-10-08T19:23:51.911 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.911 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.911 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:23:51.912 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.479414+0000", 2021-10-08T19:23:51.912 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5540999999999999e-05 2021-10-08T19:23:51.912 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.912 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.912 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:23:51.913 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.479421+0000", 2021-10-08T19:23:51.913 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7390000000000002e-06 2021-10-08T19:23:51.913 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.913 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.914 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:23:51.914 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.479529+0000", 2021-10-08T19:23:51.914 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000107775 2021-10-08T19:23:51.914 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.914 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.915 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:23:51.915 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.479620+0000", 2021-10-08T19:23:51.915 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.1284000000000002e-05 2021-10-08T19:23:51.915 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.915 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.916 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,7", 2021-10-08T19:23:51.916 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.479801+0000", 2021-10-08T19:23:51.916 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000180905 2021-10-08T19:23:51.916 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.917 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.917 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:23:51.917 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.480254+0000", 2021-10-08T19:23:51.917 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00045339399999999998 2021-10-08T19:23:51.917 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.918 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.918 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:23:51.918 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.480578+0000", 2021-10-08T19:23:51.918 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032321299999999998 2021-10-08T19:23:51.918 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.919 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.919 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:23:51.919 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.480882+0000", 2021-10-08T19:23:51.919 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00030477899999999998 2021-10-08T19:23:51.920 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.920 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.920 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:23:51.920 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.480925+0000", 2021-10-08T19:23:51.920 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2364000000000003e-05 2021-10-08T19:23:51.921 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.921 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.921 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:23:51.921 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.480962+0000", 2021-10-08T19:23:51.921 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7047e-05 2021-10-08T19:23:51.922 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:23:51.922 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:23:51.922 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:23:51.922 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.923 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.923 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.34430.0:94 5.3 5:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2021-10-08T19:23:51.923 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:21:31.518306+0000", 2021-10-08T19:23:51.923 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 139.67229187500001, 2021-10-08T19:23:51.923 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001207014, 2021-10-08T19:23:51.924 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:23:51.924 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:23:51.924 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:23:51.924 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.34430", 2021-10-08T19:23:51.924 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2937409415", 2021-10-08T19:23:51.925 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 94 2021-10-08T19:23:51.925 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.925 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:23:51.925 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.926 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:23:51.926 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.518306+0000", 2021-10-08T19:23:51.926 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:23:51.926 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.926 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.927 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:23:51.927 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.518306+0000", 2021-10-08T19:23:51.927 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:23:51.927 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.927 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.928 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:23:51.928 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.518304+0000", 2021-10-08T19:23:51.928 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:23:51.928 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.928 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.929 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:23:51.929 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.518310+0000", 2021-10-08T19:23:51.929 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8309999999999997e-06 2021-10-08T19:23:51.929 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.930 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.930 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:23:51.930 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.518322+0000", 2021-10-08T19:23:51.930 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.163e-05 2021-10-08T19:23:51.930 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.931 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.931 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:23:51.931 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.518328+0000", 2021-10-08T19:23:51.931 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3489999999999997e-06 2021-10-08T19:23:51.931 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.932 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.932 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:23:51.932 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.518618+0000", 2021-10-08T19:23:51.932 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00028993600000000002 2021-10-08T19:23:51.933 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.933 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.933 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:23:51.933 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.518708+0000", 2021-10-08T19:23:51.933 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9980000000000002e-05 2021-10-08T19:23:51.934 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.934 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.934 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5,6", 2021-10-08T19:23:51.934 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.518838+0000", 2021-10-08T19:23:51.934 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013006700000000001 2021-10-08T19:23:51.935 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.935 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.935 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:23:51.935 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.519280+0000", 2021-10-08T19:23:51.935 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000441524 2021-10-08T19:23:51.936 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.936 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.936 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:23:51.936 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.519438+0000", 2021-10-08T19:23:51.937 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015872400000000001 2021-10-08T19:23:51.937 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.937 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.937 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:23:51.937 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.519463+0000", 2021-10-08T19:23:51.938 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.493e-05 2021-10-08T19:23:51.938 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.938 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.938 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:23:51.938 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.519491+0000", 2021-10-08T19:23:51.939 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7373e-05 2021-10-08T19:23:51.939 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.939 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.939 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:23:51.940 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.519513+0000", 2021-10-08T19:23:51.940 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2408e-05 2021-10-08T19:23:51.940 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:23:51.940 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:23:51.940 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:23:51.941 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.941 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.941 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.14487.0:373 4.1e 4:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2021-10-08T19:23:51.941 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:21:31.597649+0000", 2021-10-08T19:23:51.941 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 139.592948675, 2021-10-08T19:23:51.942 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001305563, 2021-10-08T19:23:51.942 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:23:51.942 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:23:51.942 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:23:51.943 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.14487", 2021-10-08T19:23:51.943 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1356965238", 2021-10-08T19:23:51.943 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 373 2021-10-08T19:23:51.943 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.943 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:23:51.944 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.944 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:23:51.944 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.597649+0000", 2021-10-08T19:23:51.944 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:23:51.944 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.945 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.945 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:23:51.945 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.597649+0000", 2021-10-08T19:23:51.945 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:23:51.946 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.946 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.946 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:23:51.946 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.597648+0000", 2021-10-08T19:23:51.946 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2021-10-08T19:23:51.947 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.947 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.947 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:23:51.947 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.597654+0000", 2021-10-08T19:23:51.948 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5470000000000002e-06 2021-10-08T19:23:51.948 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.948 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.948 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:23:51.948 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.597665+0000", 2021-10-08T19:23:51.949 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0682999999999999e-05 2021-10-08T19:23:51.949 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.949 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.949 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:23:51.949 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.597671+0000", 2021-10-08T19:23:51.950 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1099999999999999e-06 2021-10-08T19:23:51.950 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.950 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.950 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:23:51.951 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.597721+0000", 2021-10-08T19:23:51.951 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9777000000000001e-05 2021-10-08T19:23:51.951 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.951 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.951 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:23:51.952 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.597800+0000", 2021-10-08T19:23:51.952 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.9067999999999996e-05 2021-10-08T19:23:51.952 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.952 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.952 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,7", 2021-10-08T19:23:51.953 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.597949+0000", 2021-10-08T19:23:51.953 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014857299999999999 2021-10-08T19:23:51.953 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.953 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.954 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:23:51.954 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.598341+0000", 2021-10-08T19:23:51.954 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00039222299999999997 2021-10-08T19:23:51.954 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.954 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.955 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:23:51.955 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.598484+0000", 2021-10-08T19:23:51.955 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000142826 2021-10-08T19:23:51.955 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.955 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.956 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:23:51.956 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.598904+0000", 2021-10-08T19:23:51.956 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00042058500000000001 2021-10-08T19:23:51.956 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.956 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.957 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:23:51.957 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.598932+0000", 2021-10-08T19:23:51.957 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8019999999999999e-05 2021-10-08T19:23:51.957 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:23:51.958 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:23:51.958 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:23:51.958 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:21:31.598955+0000", 2021-10-08T19:23:51.958 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.245e-05 2021-10-08T19:23:51.958 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:23:51.959 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:23:51.959 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:23:51.959 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:23:51.959 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:23:51.959 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:23:51.961 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:51.961 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:23:51.962 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:23:52.019 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:23:52.063 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:23:52.073 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:51 smithi097 ceph-mon[41966]: pgmap v92: 148 pgs: 148 active+clean; 582 KiB data, 54 MiB used, 626 GiB / 626 GiB avail; 724 B/s rd, 0 op/s; 102 KiB/s, 1 objects/s recovering 2021-10-08T19:23:52.074 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:51 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:23:52.074 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:51 smithi097 ceph-mon[41966]: 172.21.15.97 - - [08/Oct/2021:19:23:50] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:23:52.074 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:51 smithi097 ceph-mon[41966]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:23:52.074 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:51 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/820622405' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:23:52.075 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:51 smithi097 ceph-mon[41966]: osdmap e99: 8 total, 8 up, 7 in 2021-10-08T19:23:52.075 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:51 smithi097 ceph-mon[32687]: pgmap v92: 148 pgs: 148 active+clean; 582 KiB data, 54 MiB used, 626 GiB / 626 GiB avail; 724 B/s rd, 0 op/s; 102 KiB/s, 1 objects/s recovering 2021-10-08T19:23:52.075 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:51 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:23:52.076 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:51 smithi097 ceph-mon[32687]: 172.21.15.97 - - [08/Oct/2021:19:23:50] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:23:52.076 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:51 smithi097 ceph-mon[32687]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:23:52.076 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:51 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/820622405' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:23:52.076 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:51 smithi097 ceph-mon[32687]: osdmap e99: 8 total, 8 up, 7 in 2021-10-08T19:23:52.088 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:51 smithi117 ceph-mon[34585]: pgmap v92: 148 pgs: 148 active+clean; 582 KiB data, 54 MiB used, 626 GiB / 626 GiB avail; 724 B/s rd, 0 op/s; 102 KiB/s, 1 objects/s recovering 2021-10-08T19:23:52.089 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:51 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:23:52.089 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:51 smithi117 ceph-mon[34585]: 172.21.15.97 - - [08/Oct/2021:19:23:50] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:23:52.089 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:51 smithi117 ceph-mon[34585]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:23:52.089 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:51 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/820622405' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:23:52.090 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:51 smithi117 ceph-mon[34585]: osdmap e99: 8 total, 8 up, 7 in 2021-10-08T19:23:52.091 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:52.140 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:23:52.143 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:52.144 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:23:52.245 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:23:52.269 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:52.315 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:23:52.317 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:52.319 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:23:52.413 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2021-10-08T19:23:52.420 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:23:52.479 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:52.524 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:23:52.526 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:52.527 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:23:52.628 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:23:52.653 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:52.696 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:23:52.698 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:52.701 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:23:52.802 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:23:52.825 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:52.868 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:23:52.870 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:52.871 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:23:52.969 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:23:52 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:23:52] "GET /metrics HTTP/1.1" 200 153762 "" "Prometheus/2.18.1" 2021-10-08T19:23:52.972 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:23:52.998 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:53.043 DEBUG:teuthology.orchestra.run.smithi097:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_0 bench 90 write' 2021-10-08T19:23:53.044 INFO:tasks.thrashosds.thrasher:Growing pool iscsi 2021-10-08T19:23:53.045 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph pg dump --format=json 2021-10-08T19:23:53.047 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2021-10-08T19:23:53.047 INFO:teuthology.orchestra.run:waiting for 3000 2021-10-08T19:23:53.228 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:hints = 1 2021-10-08T19:23:53.228 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2021-10-08T19:23:53.228 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Object prefix: benchmark_data_smithi097_93198 2021-10-08T19:23:53.229 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2021-10-08T19:23:53.229 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 0 0 0 0 0 0 - 0 2021-10-08T19:23:53.261 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:23:53.267 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:53.268 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:23:53.314 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:23:53.370 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:23:53.434 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:53.482 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:23:53.573 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:23:53.576 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:53.577 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:23:53.678 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:23:53.704 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:53.755 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:23:53.757 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:53.758 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:23:53.834 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:53 smithi097 ceph-mon[32687]: pgmap v94: 148 pgs: 148 active+clean; 582 KiB data, 54 MiB used, 626 GiB / 626 GiB avail; 682 B/s rd, 0 op/s; 96 KiB/s, 1 objects/s recovering 2021-10-08T19:23:53.858 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:23:53.884 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:53.934 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:23:53.936 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:53.937 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:23:54.038 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:23:54.078 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset noscrub 2021-10-08T19:23:54.085 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:23:54.098 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:53 smithi097 ceph-mon[41966]: pgmap v94: 148 pgs: 148 active+clean; 582 KiB data, 54 MiB used, 626 GiB / 626 GiB avail; 682 B/s rd, 0 op/s; 96 KiB/s, 1 objects/s recovering 2021-10-08T19:23:54.110 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:54.123 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:23:54.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:23:53 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:23:53] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:23:54.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:53 smithi117 ceph-mon[34585]: pgmap v94: 148 pgs: 148 active+clean; 582 KiB data, 54 MiB used, 626 GiB / 626 GiB avail; 682 B/s rd, 0 op/s; 96 KiB/s, 1 objects/s recovering 2021-10-08T19:23:54.161 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:23:54.204 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:23:54.229 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 1 16 2287 2271 141.877 141.938 0.00920388 0.0069857 2021-10-08T19:23:54.236 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:23:54.261 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:23:54.268 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:54.270 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:23:54.270 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:23:54.306 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:23:54.338 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:23:54.354 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'false' 2021-10-08T19:23:54.354 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'false' 2021-10-08T19:23:54.354 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'false' 2021-10-08T19:23:54.354 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'false' 2021-10-08T19:23:54.355 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'false' 2021-10-08T19:23:54.355 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'false' 2021-10-08T19:23:54.355 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'false' 2021-10-08T19:23:54.355 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'false' 2021-10-08T19:23:54.371 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:23:54.397 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:54.448 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:23:54.450 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:54.451 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:23:54.552 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:23:54.598 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:55.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:54 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1102193053' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:23:55.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:54 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1102193053' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:23:55.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:54 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1102193053' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:23:55.230 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 2 16 5171 5155 160.957 180.25 0.00243803 0.00619886 2021-10-08T19:23:55.406 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:23:55.409 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:55.410 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:23:55.518 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:23:55.565 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:56.111 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:55 smithi117 ceph-mon[34585]: pgmap v95: 148 pgs: 148 active+clean; 31 MiB data, 90 MiB used, 626 GiB / 626 GiB avail; 1.4 KiB/s rd, 4.5 MiB/s wr, 73 op/s; 87 KiB/s, 1 objects/s recovering 2021-10-08T19:23:56.219 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:55 smithi097 ceph-mon[32687]: pgmap v95: 148 pgs: 148 active+clean; 31 MiB data, 90 MiB used, 626 GiB / 626 GiB avail; 1.4 KiB/s rd, 4.5 MiB/s wr, 73 op/s; 87 KiB/s, 1 objects/s recovering 2021-10-08T19:23:56.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:55 smithi097 ceph-mon[41966]: pgmap v95: 148 pgs: 148 active+clean; 31 MiB data, 90 MiB used, 626 GiB / 626 GiB avail; 1.4 KiB/s rd, 4.5 MiB/s wr, 73 op/s; 87 KiB/s, 1 objects/s recovering 2021-10-08T19:23:56.230 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 3 16 8000 7984 166.221 176.812 0.00688665 0.00600624 2021-10-08T19:23:56.405 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:23:56 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:23:57.089 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:23:57.091 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:57.092 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:23:57.193 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:23:57.231 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 4 16 10506 10490 163.82 156.625 0.00601023 0.00609716 2021-10-08T19:23:57.238 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:58.134 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:23:58.139 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:58.140 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:23:58.141 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:57 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:23:58.141 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:57 smithi097 ceph-mon[41966]: pgmap v96: 148 pgs: 148 active+clean; 31 MiB data, 90 MiB used, 626 GiB / 626 GiB avail; 639 B/s rd, 3.7 MiB/s wr, 60 op/s 2021-10-08T19:23:58.141 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:57 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:23:58.142 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:57 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:23:58.142 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:57 smithi097 ceph-mon[32687]: pgmap v96: 148 pgs: 148 active+clean; 31 MiB data, 90 MiB used, 626 GiB / 626 GiB avail; 639 B/s rd, 3.7 MiB/s wr, 60 op/s 2021-10-08T19:23:58.142 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:57 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:23:58.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:57 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:23:58.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:57 smithi117 ceph-mon[34585]: pgmap v96: 148 pgs: 148 active+clean; 31 MiB data, 90 MiB used, 626 GiB / 626 GiB avail; 639 B/s rd, 3.7 MiB/s wr, 60 op/s 2021-10-08T19:23:58.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:57 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:23:58.196 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:23:58.230 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 5 16 12903 12887 161.017 149.812 0.0115143 0.00619845 2021-10-08T19:23:58.242 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:23:58.278 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:58.337 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:23:58.341 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:58.342 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:23:58.444 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:23:58.510 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:58.658 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:23:58.664 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:58.666 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:23:58.739 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2021-10-08T19:23:58.740 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:23:58.772 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:23:58.839 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:23:59.088 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:23:59.098 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:23:59.099 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:23:59.200 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:23:59.214 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:23:59.225 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2021-10-08T19:23:59.231 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 6 16 14722 14706 153.116 113.688 0.00771062 0.00651991 2021-10-08T19:23:59.255 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:00.110 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2021-10-08T19:24:00.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:23:59 smithi117 ceph-mon[34585]: pgmap v97: 148 pgs: 148 active+clean; 832 MiB data, 2.4 GiB used, 623 GiB / 626 GiB avail; 1.2 KiB/s rd, 96 MiB/s wr, 1.54k op/s 2021-10-08T19:24:00.160 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:23:59 smithi097 ceph-mon[32687]: pgmap v97: 148 pgs: 148 active+clean; 832 MiB data, 2.4 GiB used, 623 GiB / 626 GiB avail; 1.2 KiB/s rd, 96 MiB/s wr, 1.54k op/s 2021-10-08T19:24:00.161 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:23:59 smithi097 ceph-mon[41966]: pgmap v97: 148 pgs: 148 active+clean; 832 MiB data, 2.4 GiB used, 623 GiB / 626 GiB avail; 1.2 KiB/s rd, 96 MiB/s wr, 1.54k op/s 2021-10-08T19:24:00.231 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 7 16 16743 16727 149.287 126.312 0.0075257 0.0066907 2021-10-08T19:24:00.262 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:24:00.273 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:00.274 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:24:00.375 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:24:00.406 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:00.453 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:24:00.459 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:00.460 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:24:00.561 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:24:00.590 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:00.649 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:24:00.651 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:00.653 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:24:00.754 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:24:00.781 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:00.884 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:24:00.887 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:00.888 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:24:00.989 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:24:01.019 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:01.075 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:24:01.079 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:00 smithi117 ceph-mon[34585]: from='client.34790 v1:172.21.15.97:0/4120803395' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:24:01.080 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:01.080 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:24:01.182 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:24:01.210 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:01.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:00 smithi097 ceph-mon[32687]: from='client.34790 v1:172.21.15.97:0/4120803395' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:24:01.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:00 smithi097 ceph-mon[41966]: from='client.34790 v1:172.21.15.97:0/4120803395' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:24:01.231 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 8 16 18667 18651 145.657 120.25 0.00750387 0.00685704 2021-10-08T19:24:01.268 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:24:01.271 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:01.272 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:24:01.365 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2021-10-08T19:24:01.374 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:24:01.401 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:01.411 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":97,"stamp":"2021-10-08T19:23:58.447979+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":872159428,"num_objects":13493,"num_object_clones":0,"num_object_copies":40479,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13493,"num_whiteouts":0,"num_read":1078,"num_read_kb":924,"num_write":13906,"num_write_kb":853593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":2363225,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13915,"ondisk_log_size":13915,"up":444,"acting":444,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":444,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":656216064,"kb_used":2559612,"kb_used_data":2431172,"kb_used_omap":0,"kb_used_meta":128448,"kb_avail":653656452,"statfs":{"total":671965249536,"available":669344206848,"internally_reserved":0,"allocated":2489520128,"data_stored":2486693099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":131530752},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":871563264,"num_objects":13299,"num_object_clones":0,"num_object_copies":39897,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13299,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":13299,"num_write_kb":851136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.624323"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":55,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:48.307531+0000","last_change":"2021-10-08T19:23:42.818109+0000","last_active":"2021-10-08T19:23:48.307531+0000","last_peered":"2021-10-08T19:23:48.307531+0000","last_clean":"2021-10-08T19:23:48.307531+0000","last_became_active":"2021-10-08T19:23:42.817831+0000","last_became_peered":"2021-10-08T19:23:42.817831+0000","last_unstale":"2021-10-08T19:23:48.307531+0000","last_undegraded":"2021-10-08T19:23:48.307531+0000","last_fullsized":"2021-10-08T19:23:48.307531+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:33.411753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:33.411753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0038057030000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":63,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:47.809071+0000","last_change":"2021-10-08T19:23:42.811920+0000","last_active":"2021-10-08T19:23:47.809071+0000","last_peered":"2021-10-08T19:23:47.809071+0000","last_clean":"2021-10-08T19:23:47.809071+0000","last_became_active":"2021-10-08T19:23:42.811565+0000","last_became_peered":"2021-10-08T19:23:42.811565+0000","last_unstale":"2021-10-08T19:23:47.809071+0000","last_undegraded":"2021-10-08T19:23:47.809071+0000","last_fullsized":"2021-10-08T19:23:47.809071+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:39.931718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:39.931718+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0036493649999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":53,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:49.828156+0000","last_change":"2021-10-08T19:22:54.671364+0000","last_active":"2021-10-08T19:23:49.828156+0000","last_peered":"2021-10-08T19:23:49.828156+0000","last_clean":"2021-10-08T19:23:49.828156+0000","last_became_active":"2021-10-08T19:21:23.603422+0000","last_became_peered":"2021-10-08T19:21:23.603422+0000","last_unstale":"2021-10-08T19:23:49.828156+0000","last_undegraded":"2021-10-08T19:23:49.828156+0000","last_fullsized":"2021-10-08T19:23:49.828156+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:54.671289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:54.671289+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001752221,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"69'15","reported_seq":69,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:48.307742+0000","last_change":"2021-10-08T19:21:25.613266+0000","last_active":"2021-10-08T19:23:48.307742+0000","last_peered":"2021-10-08T19:23:48.307742+0000","last_clean":"2021-10-08T19:23:48.307742+0000","last_became_active":"2021-10-08T19:21:25.612873+0000","last_became_peered":"2021-10-08T19:21:25.612873+0000","last_unstale":"2021-10-08T19:23:48.307742+0000","last_undegraded":"2021-10-08T19:23:48.307742+0000","last_fullsized":"2021-10-08T19:23:48.307742+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:21:24.589054+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":46,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:47.808959+0000","last_change":"2021-10-08T19:22:50.032446+0000","last_active":"2021-10-08T19:23:47.808959+0000","last_peered":"2021-10-08T19:23:47.808959+0000","last_clean":"2021-10-08T19:23:47.808959+0000","last_became_active":"2021-10-08T19:21:29.639039+0000","last_became_peered":"2021-10-08T19:21:29.639039+0000","last_unstale":"2021-10-08T19:23:47.808959+0000","last_undegraded":"2021-10-08T19:23:47.808959+0000","last_fullsized":"2021-10-08T19:23:47.808959+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:50.032367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:50.032367+0000","last_clean_scrub_stamp":"2021-10-08T19:22:50.032367+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034102759999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":49,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:50.459131+0000","last_change":"2021-10-08T19:23:05.196328+0000","last_active":"2021-10-08T19:23:50.459131+0000","last_peered":"2021-10-08T19:23:50.459131+0000","last_clean":"2021-10-08T19:23:50.459131+0000","last_became_active":"2021-10-08T19:21:27.634883+0000","last_became_peered":"2021-10-08T19:21:27.634883+0000","last_unstale":"2021-10-08T19:23:50.459131+0000","last_undegraded":"2021-10-08T19:23:50.459131+0000","last_fullsized":"2021-10-08T19:23:50.459131+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:05.196252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:05.196252+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0016803230000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":52,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:48.308123+0000","last_change":"2021-10-08T19:23:14.443220+0000","last_active":"2021-10-08T19:23:48.308123+0000","last_peered":"2021-10-08T19:23:48.308123+0000","last_clean":"2021-10-08T19:23:48.308123+0000","last_became_active":"2021-10-08T19:21:23.598272+0000","last_became_peered":"2021-10-08T19:21:23.598272+0000","last_unstale":"2021-10-08T19:23:48.308123+0000","last_undegraded":"2021-10-08T19:23:48.308123+0000","last_fullsized":"2021-10-08T19:23:48.308123+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:14.443147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:14.443147+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003489631,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"88'13","reported_seq":108,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:47.808783+0000","last_change":"2021-10-08T19:23:43.598351+0000","last_active":"2021-10-08T19:23:47.808783+0000","last_peered":"2021-10-08T19:23:47.808783+0000","last_clean":"2021-10-08T19:23:47.808783+0000","last_became_active":"2021-10-08T19:23:42.811480+0000","last_became_peered":"2021-10-08T19:23:42.811480+0000","last_unstale":"2021-10-08T19:23:47.808783+0000","last_undegraded":"2021-10-08T19:23:47.808783+0000","last_fullsized":"2021-10-08T19:23:47.808783+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'13","last_scrub_stamp":"2021-10-08T19:23:16.016646+0000","last_deep_scrub":"88'13","last_deep_scrub_stamp":"2021-10-08T19:23:16.016646+0000","last_clean_scrub_stamp":"2021-10-08T19:23:16.016646+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0052093469999999996,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,3],"acting":[4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":46,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:48.467594+0000","last_change":"2021-10-08T19:23:23.659594+0000","last_active":"2021-10-08T19:23:48.467594+0000","last_peered":"2021-10-08T19:23:48.467594+0000","last_clean":"2021-10-08T19:23:48.467594+0000","last_became_active":"2021-10-08T19:21:29.649640+0000","last_became_peered":"2021-10-08T19:21:29.649640+0000","last_unstale":"2021-10-08T19:23:48.467594+0000","last_undegraded":"2021-10-08T19:23:48.467594+0000","last_fullsized":"2021-10-08T19:23:48.467594+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:23.659524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:23.659524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0013747169999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":49,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:49.825331+0000","last_change":"2021-10-08T19:22:43.016906+0000","last_active":"2021-10-08T19:23:49.825331+0000","last_peered":"2021-10-08T19:23:49.825331+0000","last_clean":"2021-10-08T19:23:49.825331+0000","last_became_active":"2021-10-08T19:21:27.637178+0000","last_became_peered":"2021-10-08T19:21:27.637178+0000","last_unstale":"2021-10-08T19:23:49.825331+0000","last_undegraded":"2021-10-08T19:23:49.825331+0000","last_fullsized":"2021-10-08T19:23:49.825331+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:43.016815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:43.016815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034706469999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":62,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:49.825506+0000","last_change":"2021-10-08T19:23:42.815633+0000","last_active":"2021-10-08T19:23:49.825506+0000","last_peered":"2021-10-08T19:23:49.825506+0000","last_clean":"2021-10-08T19:23:49.825506+0000","last_became_active":"2021-10-08T19:23:42.813920+0000","last_became_peered":"2021-10-08T19:23:42.813920+0000","last_unstale":"2021-10-08T19:23:49.825506+0000","last_undegraded":"2021-10-08T19:23:49.825506+0000","last_fullsized":"2021-10-08T19:23:49.825506+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:33.926256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:33.926256+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0015495210000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,3],"acting":[7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"69'5","reported_seq":60,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:47.809229+0000","last_change":"2021-10-08T19:23:17.993609+0000","last_active":"2021-10-08T19:23:47.809229+0000","last_peered":"2021-10-08T19:23:47.809229+0000","last_clean":"2021-10-08T19:23:47.809229+0000","last_became_active":"2021-10-08T19:21:25.609029+0000","last_became_peered":"2021-10-08T19:21:25.609029+0000","last_unstale":"2021-10-08T19:23:47.809229+0000","last_undegraded":"2021-10-08T19:23:47.809229+0000","last_fullsized":"2021-10-08T19:23:47.809229+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'5","last_scrub_stamp":"2021-10-08T19:23:17.993532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:17.993532+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040855580000000004,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":47,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:49.827331+0000","last_change":"2021-10-08T19:22:51.689295+0000","last_active":"2021-10-08T19:23:49.827331+0000","last_peered":"2021-10-08T19:23:49.827331+0000","last_clean":"2021-10-08T19:23:49.827331+0000","last_became_active":"2021-10-08T19:21:29.640978+0000","last_became_peered":"2021-10-08T19:21:29.640978+0000","last_unstale":"2021-10-08T19:23:49.827331+0000","last_undegraded":"2021-10-08T19:23:49.827331+0000","last_fullsized":"2021-10-08T19:23:49.827331+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:51.689220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:51.689220+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001435541,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":48,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:48.467860+0000","last_change":"2021-10-08T19:23:05.799433+0000","last_active":"2021-10-08T19:23:48.467860+0000","last_peered":"2021-10-08T19:23:48.467860+0000","last_clean":"2021-10-08T19:23:48.467860+0000","last_became_active":"2021-10-08T19:21:27.633979+0000","last_became_peered":"2021-10-08T19:21:27.633979+0000","last_unstale":"2021-10-08T19:23:48.467860+0000","last_undegraded":"2021-10-08T19:23:48.467860+0000","last_fullsized":"2021-10-08T19:23:48.467860+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:05.799361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:05.799361+0000","last_clean_scrub_stamp":"2021-10-08T19:23:05.799361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0036358100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":53,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:49.825550+0000","last_change":"2021-10-08T19:22:42.042609+0000","last_active":"2021-10-08T19:23:49.825550+0000","last_peered":"2021-10-08T19:23:49.825550+0000","last_clean":"2021-10-08T19:23:49.825550+0000","last_became_active":"2021-10-08T19:21:23.607785+0000","last_became_peered":"2021-10-08T19:21:23.607785+0000","last_unstale":"2021-10-08T19:23:49.825550+0000","last_undegraded":"2021-10-08T19:23:49.825550+0000","last_fullsized":"2021-10-08T19:23:49.825550+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:42.042510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:42.042510+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034710639999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"69'9","reported_seq":66,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:47.809106+0000","last_change":"2021-10-08T19:23:19.997379+0000","last_active":"2021-10-08T19:23:47.809106+0000","last_peered":"2021-10-08T19:23:47.809106+0000","last_clean":"2021-10-08T19:23:47.809106+0000","last_became_active":"2021-10-08T19:21:25.608263+0000","last_became_peered":"2021-10-08T19:21:25.608263+0000","last_unstale":"2021-10-08T19:23:47.809106+0000","last_undegraded":"2021-10-08T19:23:47.809106+0000","last_fullsized":"2021-10-08T19:23:47.809106+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'9","last_scrub_stamp":"2021-10-08T19:23:19.997296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:19.997296+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040259689999999999,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":55,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:48.308161+0000","last_change":"2021-10-08T19:23:42.815515+0000","last_active":"2021-10-08T19:23:48.308161+0000","last_peered":"2021-10-08T19:23:48.308161+0000","last_clean":"2021-10-08T19:23:48.308161+0000","last_became_active":"2021-10-08T19:23:42.815172+0000","last_became_peered":"2021-10-08T19:23:42.815172+0000","last_unstale":"2021-10-08T19:23:48.308161+0000","last_undegraded":"2021-10-08T19:23:48.308161+0000","last_fullsized":"2021-10-08T19:23:48.308161+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:38.544673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:38.544673+0000","last_clean_scrub_stamp":"2021-10-08T19:22:38.544673+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0019818940000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":48,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:47.809398+0000","last_change":"2021-10-08T19:22:45.177384+0000","last_active":"2021-10-08T19:23:47.809398+0000","last_peered":"2021-10-08T19:23:47.809398+0000","last_clean":"2021-10-08T19:23:47.809398+0000","last_became_active":"2021-10-08T19:21:27.635242+0000","last_became_peered":"2021-10-08T19:21:27.635242+0000","last_unstale":"2021-10-08T19:23:47.809398+0000","last_undegraded":"2021-10-08T19:23:47.809398+0000","last_fullsized":"2021-10-08T19:23:47.809398+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:45.177306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:45.177306+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034162229999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":61,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:48.307805+0000","last_change":"2021-10-08T19:23:42.818129+0000","last_active":"2021-10-08T19:23:48.307805+0000","last_peered":"2021-10-08T19:23:48.307805+0000","last_clean":"2021-10-08T19:23:48.307805+0000","last_became_active":"2021-10-08T19:23:42.817514+0000","last_became_peered":"2021-10-08T19:23:42.817514+0000","last_unstale":"2021-10-08T19:23:48.307805+0000","last_undegraded":"2021-10-08T19:23:48.307805+0000","last_fullsized":"2021-10-08T19:23:48.307805+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:07.581653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:07.581653+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034956309999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,4],"acting":[3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"69'12","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:48.307920+0000","last_change":"2021-10-08T19:23:10.562916+0000","last_active":"2021-10-08T19:23:48.307920+0000","last_peered":"2021-10-08T19:23:48.307920+0000","last_clean":"2021-10-08T19:23:48.307920+0000","last_became_active":"2021-10-08T19:21:25.612541+0000","last_became_peered":"2021-10-08T19:21:25.612541+0000","last_unstale":"2021-10-08T19:23:48.307920+0000","last_undegraded":"2021-10-08T19:23:48.307920+0000","last_fullsized":"2021-10-08T19:23:48.307920+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'12","last_scrub_stamp":"2021-10-08T19:23:10.562820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:10.562820+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040692890000000002,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":55,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:47.809727+0000","last_change":"2021-10-08T19:23:42.810806+0000","last_active":"2021-10-08T19:23:47.809727+0000","last_peered":"2021-10-08T19:23:47.809727+0000","last_clean":"2021-10-08T19:23:47.809727+0000","last_became_active":"2021-10-08T19:23:42.810374+0000","last_became_peered":"2021-10-08T19:23:42.810374+0000","last_unstale":"2021-10-08T19:23:47.809727+0000","last_undegraded":"2021-10-08T19:23:47.809727+0000","last_fullsized":"2021-10-08T19:23:47.809727+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:56.020759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:56.020759+0000","last_clean_scrub_stamp":"2021-10-08T19:22:56.020759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001373478,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,3],"acting":[4,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":49,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:50.459785+0000","last_change":"2021-10-08T19:23:10.148845+0000","last_active":"2021-10-08T19:23:50.459785+0000","last_peered":"2021-10-08T19:23:50.459785+0000","last_clean":"2021-10-08T19:23:50.459785+0000","last_became_active":"2021-10-08T19:21:27.636398+0000","last_became_peered":"2021-10-08T19:21:27.636398+0000","last_unstale":"2021-10-08T19:23:50.459785+0000","last_undegraded":"2021-10-08T19:23:50.459785+0000","last_fullsized":"2021-10-08T19:23:50.459785+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:10.148774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:10.148774+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034045170000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":51,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:47.809079+0000","last_change":"2021-10-08T19:23:42.811874+0000","last_active":"2021-10-08T19:23:47.809079+0000","last_peered":"2021-10-08T19:23:47.809079+0000","last_clean":"2021-10-08T19:23:47.809079+0000","last_became_active":"2021-10-08T19:23:42.811489+0000","last_became_peered":"2021-10-08T19:23:42.811489+0000","last_unstale":"2021-10-08T19:23:47.809079+0000","last_undegraded":"2021-10-08T19:23:47.809079+0000","last_fullsized":"2021-10-08T19:23:47.809079+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:46.422866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:46.422866+0000","last_clean_scrub_stamp":"2021-10-08T19:22:46.422866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"69'15","reported_seq":101,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:49.826624+0000","last_change":"2021-10-08T19:22:52.474731+0000","last_active":"2021-10-08T19:23:49.826624+0000","last_peered":"2021-10-08T19:23:49.826624+0000","last_clean":"2021-10-08T19:23:49.826624+0000","last_became_active":"2021-10-08T19:22:44.005356+0000","last_became_peered":"2021-10-08T19:22:44.005356+0000","last_unstale":"2021-10-08T19:23:49.826624+0000","last_undegraded":"2021-10-08T19:23:49.826624+0000","last_fullsized":"2021-10-08T19:23:49.826624+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'15","last_scrub_stamp":"2021-10-08T19:22:52.474651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:52.474651+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040638499999999999,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"69'1","reported_seq":48,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:50.459572+0000","last_change":"2021-10-08T19:22:50.226593+0000","last_active":"2021-10-08T19:23:50.459572+0000","last_peered":"2021-10-08T19:23:50.459572+0000","last_clean":"2021-10-08T19:23:50.459572+0000","last_became_active":"2021-10-08T19:21:29.637392+0000","last_became_peered":"2021-10-08T19:21:29.637392+0000","last_unstale":"2021-10-08T19:23:50.459572+0000","last_undegraded":"2021-10-08T19:23:50.459572+0000","last_fullsized":"2021-10-08T19:23:50.459572+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2021-10-08T19:22:50.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:50.226504+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040000080000000002,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":49,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:49.827917+0000","last_change":"2021-10-08T19:22:58.625225+0000","last_active":"2021-10-08T19:23:49.827917+0000","last_peered":"2021-10-08T19:23:49.827917+0000","last_clean":"2021-10-08T19:23:49.827917+0000","last_became_active":"2021-10-08T19:21:27.632648+0000","last_became_peered":"2021-10-08T19:21:27.632648+0000","last_unstale":"2021-10-08T19:23:49.827917+0000","last_undegraded":"2021-10-08T19:23:49.827917+0000","last_fullsized":"2021-10-08T19:23:49.827917+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:58.625153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:58.625153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0015820020000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":55,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:48.307507+0000","last_change":"2021-10-08T19:23:42.809345+0000","last_active":"2021-10-08T19:23:48.307507+0000","last_peered":"2021-10-08T19:23:48.307507+0000","last_clean":"2021-10-08T19:23:48.307507+0000","last_became_active":"2021-10-08T19:23:42.808586+0000","last_became_peered":"2021-10-08T19:23:42.808586+0000","last_unstale":"2021-10-08T19:23:48.307507+0000","last_undegraded":"2021-10-08T19:23:48.307507+0000","last_fullsized":"2021-10-08T19:23:48.307507+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:21:22.582293+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"69'11","reported_seq":61,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:48.468592+0000","last_change":"2021-10-08T19:23:43.268865+0000","last_active":"2021-10-08T19:23:48.468592+0000","last_peered":"2021-10-08T19:23:48.468592+0000","last_clean":"2021-10-08T19:23:48.468592+0000","last_became_active":"2021-10-08T19:23:42.809907+0000","last_became_peered":"2021-10-08T19:23:42.809907+0000","last_unstale":"2021-10-08T19:23:48.468592+0000","last_undegraded":"2021-10-08T19:23:48.468592+0000","last_fullsized":"2021-10-08T19:23:48.468592+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'11","last_scrub_stamp":"2021-10-08T19:22:53.420199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:53.420199+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"69'1","reported_seq":48,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:49.825706+0000","last_change":"2021-10-08T19:23:04.311491+0000","last_active":"2021-10-08T19:23:49.825706+0000","last_peered":"2021-10-08T19:23:49.825706+0000","last_clean":"2021-10-08T19:23:49.825706+0000","last_became_active":"2021-10-08T19:21:29.640296+0000","last_became_peered":"2021-10-08T19:21:29.640296+0000","last_unstale":"2021-10-08T19:23:49.825706+0000","last_undegraded":"2021-10-08T19:23:49.825706+0000","last_fullsized":"2021-10-08T19:23:49.825706+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2021-10-08T19:23:04.311406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:04.311406+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0041668299999999998,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"93'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2021-10-08T19:23:51.728029+0000","last_change":"2021-10-08T19:23:43.275745+0000","last_active":"2021-10-08T19:23:51.728029+0000","last_peered":"2021-10-08T19:23:51.728029+0000","last_clean":"2021-10-08T19:23:51.728029+0000","last_became_active":"2021-10-08T19:23:42.811419+0000","last_became_peered":"2021-10-08T19:23:42.811419+0000","last_unstale":"2021-10-08T19:23:51.728029+0000","last_undegraded":"2021-10-08T19:23:51.728029+0000","last_fullsized":"2021-10-08T19:23:51.728029+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'8","last_scrub_stamp":"2021-10-08T19:22:43.380786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:43.380786+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":52,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:48.467585+0000","last_change":"2021-10-08T19:23:19.631788+0000","last_active":"2021-10-08T19:23:48.467585+0000","last_peered":"2021-10-08T19:23:48.467585+0000","last_clean":"2021-10-08T19:23:48.467585+0000","last_became_active":"2021-10-08T19:21:23.604530+0000","last_became_peered":"2021-10-08T19:21:23.604530+0000","last_unstale":"2021-10-08T19:23:48.467585+0000","last_undegraded":"2021-10-08T19:23:48.467585+0000","last_fullsized":"2021-10-08T19:23:48.467585+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:19.631715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:19.631715+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0013318340000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"69'10","reported_seq":72,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:49.827899+0000","last_change":"2021-10-08T19:23:36.223620+0000","last_active":"2021-10-08T19:23:49.827899+0000","last_peered":"2021-10-08T19:23:49.827899+0000","last_clean":"2021-10-08T19:23:49.827899+0000","last_became_active":"2021-10-08T19:21:25.743519+0000","last_became_peered":"2021-10-08T19:21:25.743519+0000","last_unstale":"2021-10-08T19:23:49.827899+0000","last_undegraded":"2021-10-08T19:23:49.827899+0000","last_fullsized":"2021-10-08T19:23:49.827899+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'10","last_scrub_stamp":"2021-10-08T19:23:36.223545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:36.223545+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0023151259999999998,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":55,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:48.307972+0000","last_change":"2021-10-08T19:23:42.811570+0000","last_active":"2021-10-08T19:23:48.307972+0000","last_peered":"2021-10-08T19:23:48.307972+0000","last_clean":"2021-10-08T19:23:48.307972+0000","last_became_active":"2021-10-08T19:23:42.811246+0000","last_became_peered":"2021-10-08T19:23:42.811246+0000","last_unstale":"2021-10-08T19:23:48.307972+0000","last_undegraded":"2021-10-08T19:23:48.307972+0000","last_fullsized":"2021-10-08T19:23:48.307972+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:06.570853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:06.570853+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034079790000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":58,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:49.825441+0000","last_change":"2021-10-08T19:23:42.806476+0000","last_active":"2021-10-08T19:23:49.825441+0000","last_peered":"2021-10-08T19:23:49.825441+0000","last_clean":"2021-10-08T19:23:49.825441+0000","last_became_active":"2021-10-08T19:23:42.806087+0000","last_became_peered":"2021-10-08T19:23:42.806087+0000","last_unstale":"2021-10-08T19:23:49.825441+0000","last_undegraded":"2021-10-08T19:23:49.825441+0000","last_fullsized":"2021-10-08T19:23:49.825441+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:00.194892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:00.194892+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020373650000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":17,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:48.468514+0000","last_change":"2021-10-08T19:23:42.812133+0000","last_active":"2021-10-08T19:23:48.468514+0000","last_peered":"2021-10-08T19:23:48.468514+0000","last_clean":"2021-10-08T19:23:48.468514+0000","last_became_active":"2021-10-08T19:23:42.811828+0000","last_became_peered":"2021-10-08T19:23:42.811828+0000","last_unstale":"2021-10-08T19:23:48.468514+0000","last_undegraded":"2021-10-08T19:23:48.468514+0000","last_fullsized":"2021-10-08T19:23:48.468514+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:34.508558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:34.508558+0000","last_clean_scrub_stamp":"2021-10-08T19:23:34.508558+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,1],"acting":[5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"69'11","reported_seq":90,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:48.307705+0000","last_change":"2021-10-08T19:23:43.264872+0000","last_active":"2021-10-08T19:23:48.307705+0000","last_peered":"2021-10-08T19:23:48.307705+0000","last_clean":"2021-10-08T19:23:48.307705+0000","last_became_active":"2021-10-08T19:23:42.817558+0000","last_became_peered":"2021-10-08T19:23:42.817558+0000","last_unstale":"2021-10-08T19:23:48.307705+0000","last_undegraded":"2021-10-08T19:23:48.307705+0000","last_fullsized":"2021-10-08T19:23:48.307705+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'11","last_scrub_stamp":"2021-10-08T19:23:38.388959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:38.388959+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039620519999999998,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,5],"acting":[3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":47,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:49.825108+0000","last_change":"2021-10-08T19:22:52.059253+0000","last_active":"2021-10-08T19:23:49.825108+0000","last_peered":"2021-10-08T19:23:49.825108+0000","last_clean":"2021-10-08T19:23:49.825108+0000","last_became_active":"2021-10-08T19:21:29.642835+0000","last_became_peered":"2021-10-08T19:21:29.642835+0000","last_unstale":"2021-10-08T19:23:49.825108+0000","last_undegraded":"2021-10-08T19:23:49.825108+0000","last_fullsized":"2021-10-08T19:23:49.825108+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:52.059181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:52.059181+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034376540000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":17,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:47.808813+0000","last_change":"2021-10-08T19:23:42.812209+0000","last_active":"2021-10-08T19:23:47.808813+0000","last_peered":"2021-10-08T19:23:47.808813+0000","last_clean":"2021-10-08T19:23:47.808813+0000","last_became_active":"2021-10-08T19:23:42.811091+0000","last_became_peered":"2021-10-08T19:23:42.811091+0000","last_unstale":"2021-10-08T19:23:47.808813+0000","last_undegraded":"2021-10-08T19:23:47.808813+0000","last_fullsized":"2021-10-08T19:23:47.808813+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:02.446394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:02.446394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,0],"acting":[4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":61,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:48.468367+0000","last_change":"2021-10-08T19:23:42.808417+0000","last_active":"2021-10-08T19:23:48.468367+0000","last_peered":"2021-10-08T19:23:48.468367+0000","last_clean":"2021-10-08T19:23:48.468367+0000","last_became_active":"2021-10-08T19:23:42.808034+0000","last_became_peered":"2021-10-08T19:23:42.808034+0000","last_unstale":"2021-10-08T19:23:48.468367+0000","last_undegraded":"2021-10-08T19:23:48.468367+0000","last_fullsized":"2021-10-08T19:23:48.468367+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:13.716331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:13.716331+0000","last_clean_scrub_stamp":"2021-10-08T19:23:13.716331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0033906079999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,1],"acting":[5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"69'4","reported_seq":71,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:48.307226+0000","last_change":"2021-10-08T19:23:42.989366+0000","last_active":"2021-10-08T19:23:48.307226+0000","last_peered":"2021-10-08T19:23:48.307226+0000","last_clean":"2021-10-08T19:23:48.307226+0000","last_became_active":"2021-10-08T19:23:42.807135+0000","last_became_peered":"2021-10-08T19:23:42.807135+0000","last_unstale":"2021-10-08T19:23:48.307226+0000","last_undegraded":"2021-10-08T19:23:48.307226+0000","last_fullsized":"2021-10-08T19:23:48.307226+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'4","last_scrub_stamp":"2021-10-08T19:22:34.447854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:34.447854+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040770490000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":46,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:48.307349+0000","last_change":"2021-10-08T19:23:12.504222+0000","last_active":"2021-10-08T19:23:48.307349+0000","last_peered":"2021-10-08T19:23:48.307349+0000","last_clean":"2021-10-08T19:23:48.307349+0000","last_became_active":"2021-10-08T19:21:29.649225+0000","last_became_peered":"2021-10-08T19:21:29.649225+0000","last_unstale":"2021-10-08T19:23:48.307349+0000","last_undegraded":"2021-10-08T19:23:48.307349+0000","last_fullsized":"2021-10-08T19:23:48.307349+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:12.504136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:12.504136+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0038704550000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":49,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:50.459489+0000","last_change":"2021-10-08T19:22:43.186757+0000","last_active":"2021-10-08T19:23:50.459489+0000","last_peered":"2021-10-08T19:23:50.459489+0000","last_clean":"2021-10-08T19:23:50.459489+0000","last_became_active":"2021-10-08T19:21:27.635623+0000","last_became_peered":"2021-10-08T19:21:27.635623+0000","last_unstale":"2021-10-08T19:23:50.459489+0000","last_undegraded":"2021-10-08T19:23:50.459489+0000","last_fullsized":"2021-10-08T19:23:50.459489+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:43.186684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:43.186684+0000","last_clean_scrub_stamp":"2021-10-08T19:22:43.186684+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0015123129999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":53,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:50.459676+0000","last_change":"2021-10-08T19:23:02.242539+0000","last_active":"2021-10-08T19:23:50.459676+0000","last_peered":"2021-10-08T19:23:50.459676+0000","last_clean":"2021-10-08T19:23:50.459676+0000","last_became_active":"2021-10-08T19:21:23.607048+0000","last_became_peered":"2021-10-08T19:21:23.607048+0000","last_unstale":"2021-10-08T19:23:50.459676+0000","last_undegraded":"2021-10-08T19:23:50.459676+0000","last_fullsized":"2021-10-08T19:23:50.459676+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:02.242462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:02.242462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034031740000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"69'11","reported_seq":111,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:47.809097+0000","last_change":"2021-10-08T19:23:43.253696+0000","last_active":"2021-10-08T19:23:47.809097+0000","last_peered":"2021-10-08T19:23:47.809097+0000","last_clean":"2021-10-08T19:23:47.809097+0000","last_became_active":"2021-10-08T19:23:42.807835+0000","last_became_peered":"2021-10-08T19:23:42.807835+0000","last_unstale":"2021-10-08T19:23:47.809097+0000","last_undegraded":"2021-10-08T19:23:47.809097+0000","last_fullsized":"2021-10-08T19:23:47.809097+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'11","last_scrub_stamp":"2021-10-08T19:22:33.337032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:33.337032+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040894970000000001,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":47,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:49.826825+0000","last_change":"2021-10-08T19:23:02.605102+0000","last_active":"2021-10-08T19:23:49.826825+0000","last_peered":"2021-10-08T19:23:49.826825+0000","last_clean":"2021-10-08T19:23:49.826825+0000","last_became_active":"2021-10-08T19:21:29.641431+0000","last_became_peered":"2021-10-08T19:21:29.641431+0000","last_unstale":"2021-10-08T19:23:49.826825+0000","last_undegraded":"2021-10-08T19:23:49.826825+0000","last_fullsized":"2021-10-08T19:23:49.826825+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:02.605025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:02.605025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001265305,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":48,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:48.307786+0000","last_change":"2021-10-08T19:23:28.367444+0000","last_active":"2021-10-08T19:23:48.307786+0000","last_peered":"2021-10-08T19:23:48.307786+0000","last_clean":"2021-10-08T19:23:48.307786+0000","last_became_active":"2021-10-08T19:21:27.637800+0000","last_became_peered":"2021-10-08T19:21:27.637800+0000","last_unstale":"2021-10-08T19:23:48.307786+0000","last_undegraded":"2021-10-08T19:23:48.307786+0000","last_fullsized":"2021-10-08T19:23:48.307786+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:28.367323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.367323+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034823359999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":17,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:48.307980+0000","last_change":"2021-10-08T19:23:42.818874+0000","last_active":"2021-10-08T19:23:48.307980+0000","last_peered":"2021-10-08T19:23:48.307980+0000","last_clean":"2021-10-08T19:23:48.307980+0000","last_became_active":"2021-10-08T19:23:42.818393+0000","last_became_peered":"2021-10-08T19:23:42.818393+0000","last_unstale":"2021-10-08T19:23:48.307980+0000","last_undegraded":"2021-10-08T19:23:48.307980+0000","last_fullsized":"2021-10-08T19:23:48.307980+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:52.408893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:52.408893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"87'13","reported_seq":90,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:50.459364+0000","last_change":"2021-10-08T19:23:42.835204+0000","last_active":"2021-10-08T19:23:50.459364+0000","last_peered":"2021-10-08T19:23:50.459364+0000","last_clean":"2021-10-08T19:23:50.459364+0000","last_became_active":"2021-10-08T19:23:42.811548+0000","last_became_peered":"2021-10-08T19:23:42.811548+0000","last_unstale":"2021-10-08T19:23:50.459364+0000","last_undegraded":"2021-10-08T19:23:50.459364+0000","last_fullsized":"2021-10-08T19:23:50.459364+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'13","last_scrub_stamp":"2021-10-08T19:22:53.263631+0000","last_deep_scrub":"87'13","last_deep_scrub_stamp":"2021-10-08T19:22:53.263631+0000","last_clean_scrub_stamp":"2021-10-08T19:22:53.263631+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0036954140000000002,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":46,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:47.809774+0000","last_change":"2021-10-08T19:22:49.049456+0000","last_active":"2021-10-08T19:23:47.809774+0000","last_peered":"2021-10-08T19:23:47.809774+0000","last_clean":"2021-10-08T19:23:47.809774+0000","last_became_active":"2021-10-08T19:21:29.640302+0000","last_became_peered":"2021-10-08T19:21:29.640302+0000","last_unstale":"2021-10-08T19:23:47.809774+0000","last_undegraded":"2021-10-08T19:23:47.809774+0000","last_fullsized":"2021-10-08T19:23:47.809774+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:49.049379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:49.049379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.00162856,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"69'8","reported_seq":87,"reported_epoch":99,"state":"active+clean","last_fresh":"2021-10-08T19:23:51.727822+0000","last_change":"2021-10-08T19:22:32.372773+0000","last_active":"2021-10-08T19:23:51.727822+0000","last_peered":"2021-10-08T19:23:51.727822+0000","last_clean":"2021-10-08T19:23:51.727822+0000","last_became_active":"2021-10-08T19:21:27.636440+0000","last_became_peered":"2021-10-08T19:21:27.636440+0000","last_unstale":"2021-10-08T19:23:51.727822+0000","last_undegraded":"2021-10-08T19:23:51.727822+0000","last_fullsized":"2021-10-08T19:23:51.727822+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'8","last_scrub_stamp":"2021-10-08T19:22:32.372699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:32.372699+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039965820000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":59,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:49.827298+0000","last_change":"2021-10-08T19:23:27.367010+0000","last_active":"2021-10-08T19:23:49.827298+0000","last_peered":"2021-10-08T19:23:49.827298+0000","last_clean":"2021-10-08T19:23:49.827298+0000","last_became_active":"2021-10-08T19:21:23.606478+0000","last_became_peered":"2021-10-08T19:21:23.606478+0000","last_unstale":"2021-10-08T19:23:49.827298+0000","last_undegraded":"2021-10-08T19:23:49.827298+0000","last_fullsized":"2021-10-08T19:23:49.827298+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:27.366934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:27.366934+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0016199809999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"69'9","reported_seq":66,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:48.468170+0000","last_change":"2021-10-08T19:22:42.517875+0000","last_active":"2021-10-08T19:23:48.468170+0000","last_peered":"2021-10-08T19:23:48.468170+0000","last_clean":"2021-10-08T19:23:48.468170+0000","last_became_active":"2021-10-08T19:21:25.741755+0000","last_became_peered":"2021-10-08T19:21:25.741755+0000","last_unstale":"2021-10-08T19:23:48.468170+0000","last_undegraded":"2021-10-08T19:23:48.468170+0000","last_fullsized":"2021-10-08T19:23:48.468170+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'9","last_scrub_stamp":"2021-10-08T19:22:42.517786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:42.517786+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0042286850000000003,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":47,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:49.827556+0000","last_change":"2021-10-08T19:23:11.535748+0000","last_active":"2021-10-08T19:23:49.827556+0000","last_peered":"2021-10-08T19:23:49.827556+0000","last_clean":"2021-10-08T19:23:49.827556+0000","last_became_active":"2021-10-08T19:21:29.646331+0000","last_became_peered":"2021-10-08T19:21:29.646331+0000","last_unstale":"2021-10-08T19:23:49.827556+0000","last_undegraded":"2021-10-08T19:23:49.827556+0000","last_fullsized":"2021-10-08T19:23:49.827556+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:11.535641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:11.535641+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001740417,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"69'8","reported_seq":87,"reported_epoch":99,"state":"active+clean","last_fresh":"2021-10-08T19:23:51.727932+0000","last_change":"2021-10-08T19:22:28.467610+0000","last_active":"2021-10-08T19:23:51.727932+0000","last_peered":"2021-10-08T19:23:51.727932+0000","last_clean":"2021-10-08T19:23:51.727932+0000","last_became_active":"2021-10-08T19:21:27.635924+0000","last_became_peered":"2021-10-08T19:21:27.635924+0000","last_unstale":"2021-10-08T19:23:51.727932+0000","last_undegraded":"2021-10-08T19:23:51.727932+0000","last_fullsized":"2021-10-08T19:23:51.727932+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'8","last_scrub_stamp":"2021-10-08T19:22:28.467539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:28.467539+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039782960000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":52,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:48.467863+0000","last_change":"2021-10-08T19:23:04.759546+0000","last_active":"2021-10-08T19:23:48.467863+0000","last_peered":"2021-10-08T19:23:48.467863+0000","last_clean":"2021-10-08T19:23:48.467863+0000","last_became_active":"2021-10-08T19:21:23.603637+0000","last_became_peered":"2021-10-08T19:21:23.603637+0000","last_unstale":"2021-10-08T19:23:48.467863+0000","last_undegraded":"2021-10-08T19:23:48.467863+0000","last_fullsized":"2021-10-08T19:23:48.467863+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:04.759470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:04.759470+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001376447,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"69'10","reported_seq":26,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:49.826018+0000","last_change":"2021-10-08T19:23:45.670593+0000","last_active":"2021-10-08T19:23:49.826018+0000","last_peered":"2021-10-08T19:23:49.826018+0000","last_clean":"2021-10-08T19:23:49.826018+0000","last_became_active":"2021-10-08T19:23:44.806124+0000","last_became_peered":"2021-10-08T19:23:44.806124+0000","last_unstale":"2021-10-08T19:23:49.826018+0000","last_undegraded":"2021-10-08T19:23:49.826018+0000","last_fullsized":"2021-10-08T19:23:49.826018+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'10","last_scrub_stamp":"2021-10-08T19:22:52.611060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:52.611060+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,7],"acting":[2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":62,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:49.825428+0000","last_change":"2021-10-08T19:23:42.806523+0000","last_active":"2021-10-08T19:23:49.825428+0000","last_peered":"2021-10-08T19:23:49.825428+0000","last_clean":"2021-10-08T19:23:49.825428+0000","last_became_active":"2021-10-08T19:23:42.806178+0000","last_became_peered":"2021-10-08T19:23:42.806178+0000","last_unstale":"2021-10-08T19:23:49.825428+0000","last_undegraded":"2021-10-08T19:23:49.825428+0000","last_fullsized":"2021-10-08T19:23:49.825428+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:40.417858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:40.417858+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0014005230000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":48,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:48.468248+0000","last_change":"2021-10-08T19:22:50.573085+0000","last_active":"2021-10-08T19:23:48.468248+0000","last_peered":"2021-10-08T19:23:48.468248+0000","last_clean":"2021-10-08T19:23:48.468248+0000","last_became_active":"2021-10-08T19:21:27.634443+0000","last_became_peered":"2021-10-08T19:21:27.634443+0000","last_unstale":"2021-10-08T19:23:48.468248+0000","last_undegraded":"2021-10-08T19:23:48.468248+0000","last_fullsized":"2021-10-08T19:23:48.468248+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:50.573010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:50.573010+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034131029999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":17,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:47.808984+0000","last_change":"2021-10-08T19:23:42.808848+0000","last_active":"2021-10-08T19:23:47.808984+0000","last_peered":"2021-10-08T19:23:47.808984+0000","last_clean":"2021-10-08T19:23:47.808984+0000","last_became_active":"2021-10-08T19:23:42.807975+0000","last_became_peered":"2021-10-08T19:23:42.807975+0000","last_unstale":"2021-10-08T19:23:47.808984+0000","last_undegraded":"2021-10-08T19:23:47.808984+0000","last_fullsized":"2021-10-08T19:23:47.808984+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:40.579610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:40.579610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5],"acting":[4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"69'6","reported_seq":59,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:48.308198+0000","last_change":"2021-10-08T19:23:21.395469+0000","last_active":"2021-10-08T19:23:48.308198+0000","last_peered":"2021-10-08T19:23:48.308198+0000","last_clean":"2021-10-08T19:23:48.308198+0000","last_became_active":"2021-10-08T19:21:25.742631+0000","last_became_peered":"2021-10-08T19:21:25.742631+0000","last_unstale":"2021-10-08T19:23:48.308198+0000","last_undegraded":"2021-10-08T19:23:48.308198+0000","last_fullsized":"2021-10-08T19:23:48.308198+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'6","last_scrub_stamp":"2021-10-08T19:23:21.395390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:21.395390+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002416241,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":47,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:49.826196+0000","last_change":"2021-10-08T19:22:40.421310+0000","last_active":"2021-10-08T19:23:49.826196+0000","last_peered":"2021-10-08T19:23:49.826196+0000","last_clean":"2021-10-08T19:23:49.826196+0000","last_became_active":"2021-10-08T19:21:29.640674+0000","last_became_peered":"2021-10-08T19:21:29.640674+0000","last_unstale":"2021-10-08T19:23:49.826196+0000","last_undegraded":"2021-10-08T19:23:49.826196+0000","last_fullsized":"2021-10-08T19:23:49.826196+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:40.421229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.421229+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034873370000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":48,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:48.308236+0000","last_change":"2021-10-08T19:22:36.466178+0000","last_active":"2021-10-08T19:23:48.308236+0000","last_peered":"2021-10-08T19:23:48.308236+0000","last_clean":"2021-10-08T19:23:48.308236+0000","last_became_active":"2021-10-08T19:21:27.638112+0000","last_became_peered":"2021-10-08T19:21:27.638112+0000","last_unstale":"2021-10-08T19:23:48.308236+0000","last_undegraded":"2021-10-08T19:23:48.308236+0000","last_fullsized":"2021-10-08T19:23:48.308236+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:36.466077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:36.466077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0018534809999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":59,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:49.824729+0000","last_change":"2021-10-08T19:23:36.618221+0000","last_active":"2021-10-08T19:23:49.824729+0000","last_peered":"2021-10-08T19:23:49.824729+0000","last_clean":"2021-10-08T19:23:49.824729+0000","last_became_active":"2021-10-08T19:21:23.598125+0000","last_became_peered":"2021-10-08T19:21:23.598125+0000","last_unstale":"2021-10-08T19:23:49.824729+0000","last_undegraded":"2021-10-08T19:23:49.824729+0000","last_fullsized":"2021-10-08T19:23:49.824729+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:36.618136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:36.618136+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0014720390000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"69'9","reported_seq":67,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:49.827704+0000","last_change":"2021-10-08T19:23:00.644527+0000","last_active":"2021-10-08T19:23:49.827704+0000","last_peered":"2021-10-08T19:23:49.827704+0000","last_clean":"2021-10-08T19:23:49.827704+0000","last_became_active":"2021-10-08T19:21:25.743804+0000","last_became_peered":"2021-10-08T19:21:25.743804+0000","last_unstale":"2021-10-08T19:23:49.827704+0000","last_undegraded":"2021-10-08T19:23:49.827704+0000","last_fullsized":"2021-10-08T19:23:49.827704+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'9","last_scrub_stamp":"2021-10-08T19:23:00.644449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:00.644449+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0023246959999999998,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.a","version":"99'815","reported_seq":827,"reported_epoch":99,"state":"active+clean","last_fresh":"2021-10-08T19:23:58.420733+0000","last_change":"2021-10-08T19:23:44.808183+0000","last_active":"2021-10-08T19:23:58.420733+0000","last_peered":"2021-10-08T19:23:58.420733+0000","last_clean":"2021-10-08T19:23:58.420733+0000","last_became_active":"2021-10-08T19:23:44.807891+0000","last_became_peered":"2021-10-08T19:23:44.807891+0000","last_unstale":"2021-10-08T19:23:58.420733+0000","last_undegraded":"2021-10-08T19:23:58.420733+0000","last_fullsized":"2021-10-08T19:23:58.420733+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":815,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":53411840,"num_objects":815,"num_object_clones":0,"num_object_copies":2445,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":815,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":815,"num_write_kb":52160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":40,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:48.307878+0000","last_change":"2021-10-08T19:21:29.647439+0000","last_active":"2021-10-08T19:23:48.307878+0000","last_peered":"2021-10-08T19:23:48.307878+0000","last_clean":"2021-10-08T19:23:48.307878+0000","last_became_active":"2021-10-08T19:21:29.647140+0000","last_became_peered":"2021-10-08T19:21:29.647140+0000","last_unstale":"2021-10-08T19:23:48.307878+0000","last_undegraded":"2021-10-08T19:23:48.307878+0000","last_fullsized":"2021-10-08T19:23:48.307878+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:21:28.621762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"61'2","reported_seq":68,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:47.809629+0000","last_change":"2021-10-08T19:23:07.991466+0000","last_active":"2021-10-08T19:23:47.809629+0000","last_peered":"2021-10-08T19:23:47.809629+0000","last_clean":"2021-10-08T19:23:47.809629+0000","last_became_active":"2021-10-08T19:21:23.603614+0000","last_became_peered":"2021-10-08T19:21:23.603614+0000","last_unstale":"2021-10-08T19:23:47.809629+0000","last_undegraded":"2021-10-08T19:23:47.809629+0000","last_fullsized":"2021-10-08T19:23:47.809629+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'2","last_scrub_stamp":"2021-10-08T19:23:07.991388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:07.991388+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001614983,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"69'12","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:47.809090+0000","last_change":"2021-10-08T19:22:57.003718+0000","last_active":"2021-10-08T19:23:47.809090+0000","last_peered":"2021-10-08T19:23:47.809090+0000","last_clean":"2021-10-08T19:23:47.809090+0000","last_became_active":"2021-10-08T19:21:25.609079+0000","last_became_peered":"2021-10-08T19:21:25.609079+0000","last_unstale":"2021-10-08T19:23:47.809090+0000","last_undegraded":"2021-10-08T19:23:47.809090+0000","last_fullsized":"2021-10-08T19:23:47.809090+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'12","last_scrub_stamp":"2021-10-08T19:22:57.003641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:57.003641+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0041017010000000001,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":49,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:49.824734+0000","last_change":"2021-10-08T19:22:50.435623+0000","last_active":"2021-10-08T19:23:49.824734+0000","last_peered":"2021-10-08T19:23:49.824734+0000","last_clean":"2021-10-08T19:23:49.824734+0000","last_became_active":"2021-10-08T19:21:27.633878+0000","last_became_peered":"2021-10-08T19:21:27.633878+0000","last_unstale":"2021-10-08T19:23:49.824734+0000","last_undegraded":"2021-10-08T19:23:49.824734+0000","last_fullsized":"2021-10-08T19:23:49.824734+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:50.435552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:50.435552+0000","last_clean_scrub_stamp":"2021-10-08T19:22:50.435552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0012976140000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1","version":"99'829","reported_seq":841,"reported_epoch":99,"state":"active+clean","last_fresh":"2021-10-08T19:23:58.426122+0000","last_change":"2021-10-08T19:23:44.806695+0000","last_active":"2021-10-08T19:23:58.426122+0000","last_peered":"2021-10-08T19:23:58.426122+0000","last_clean":"2021-10-08T19:23:58.426122+0000","last_became_active":"2021-10-08T19:23:44.806376+0000","last_became_peered":"2021-10-08T19:23:44.806376+0000","last_unstale":"2021-10-08T19:23:58.426122+0000","last_undegraded":"2021-10-08T19:23:58.426122+0000","last_fullsized":"2021-10-08T19:23:58.426122+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":829,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":54329344,"num_objects":829,"num_object_clones":0,"num_object_copies":2487,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":829,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":829,"num_write_kb":53056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":47,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:49.826881+0000","last_change":"2021-10-08T19:22:46.569728+0000","last_active":"2021-10-08T19:23:49.826881+0000","last_peered":"2021-10-08T19:23:49.826881+0000","last_clean":"2021-10-08T19:23:49.826881+0000","last_became_active":"2021-10-08T19:21:29.649735+0000","last_became_peered":"2021-10-08T19:21:29.649735+0000","last_unstale":"2021-10-08T19:23:49.826881+0000","last_undegraded":"2021-10-08T19:23:49.826881+0000","last_fullsized":"2021-10-08T19:23:49.826881+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:46.569603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:46.569603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001693387,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:50.459754+0000","last_change":"2021-10-08T19:22:39.168725+0000","last_active":"2021-10-08T19:23:50.459754+0000","last_peered":"2021-10-08T19:23:50.459754+0000","last_clean":"2021-10-08T19:23:50.459754+0000","last_became_active":"2021-10-08T19:21:23.605441+0000","last_became_peered":"2021-10-08T19:21:23.605441+0000","last_unstale":"2021-10-08T19:23:50.459754+0000","last_undegraded":"2021-10-08T19:23:50.459754+0000","last_fullsized":"2021-10-08T19:23:50.459754+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:39.168642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:39.168642+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001714901,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"69'10","reported_seq":66,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:50.459429+0000","last_change":"2021-10-08T19:22:54.269202+0000","last_active":"2021-10-08T19:23:50.459429+0000","last_peered":"2021-10-08T19:23:50.459429+0000","last_clean":"2021-10-08T19:23:50.459429+0000","last_became_active":"2021-10-08T19:21:25.608581+0000","last_became_peered":"2021-10-08T19:21:25.608581+0000","last_unstale":"2021-10-08T19:23:50.459429+0000","last_undegraded":"2021-10-08T19:23:50.459429+0000","last_fullsized":"2021-10-08T19:23:50.459429+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'10","last_scrub_stamp":"2021-10-08T19:22:54.269123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:54.269123+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0024762310000000002,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"93'9","reported_seq":102,"reported_epoch":99,"state":"active+clean","last_fresh":"2021-10-08T19:23:51.727635+0000","last_change":"2021-10-08T19:23:42.817147+0000","last_active":"2021-10-08T19:23:51.727635+0000","last_peered":"2021-10-08T19:23:51.727635+0000","last_clean":"2021-10-08T19:23:51.727635+0000","last_became_active":"2021-10-08T19:23:42.808417+0000","last_became_peered":"2021-10-08T19:23:42.808417+0000","last_unstale":"2021-10-08T19:23:51.727635+0000","last_undegraded":"2021-10-08T19:23:51.727635+0000","last_fullsized":"2021-10-08T19:23:51.727635+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'8","last_scrub_stamp":"2021-10-08T19:22:32.603379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:32.603379+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0022390349999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.7","version":"99'801","reported_seq":814,"reported_epoch":99,"state":"active+clean","last_fresh":"2021-10-08T19:23:58.405974+0000","last_change":"2021-10-08T19:23:44.815299+0000","last_active":"2021-10-08T19:23:58.405974+0000","last_peered":"2021-10-08T19:23:58.405974+0000","last_clean":"2021-10-08T19:23:58.405974+0000","last_became_active":"2021-10-08T19:23:44.814999+0000","last_became_peered":"2021-10-08T19:23:44.814999+0000","last_unstale":"2021-10-08T19:23:58.405974+0000","last_undegraded":"2021-10-08T19:23:58.405974+0000","last_fullsized":"2021-10-08T19:23:58.405974+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":801,"ondisk_log_size":801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":52494336,"num_objects":801,"num_object_clones":0,"num_object_copies":2403,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":801,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":801,"num_write_kb":51264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":46,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:48.308127+0000","last_change":"2021-10-08T19:23:25.378511+0000","last_active":"2021-10-08T19:23:48.308127+0000","last_peered":"2021-10-08T19:23:48.308127+0000","last_clean":"2021-10-08T19:23:48.308127+0000","last_became_active":"2021-10-08T19:21:29.647403+0000","last_became_peered":"2021-10-08T19:21:29.647403+0000","last_unstale":"2021-10-08T19:23:48.308127+0000","last_undegraded":"2021-10-08T19:23:48.308127+0000","last_fullsized":"2021-10-08T19:23:48.308127+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:25.378429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:25.378429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0050198400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":61,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:48.467897+0000","last_change":"2021-10-08T19:23:42.809611+0000","last_active":"2021-10-08T19:23:48.467897+0000","last_peered":"2021-10-08T19:23:48.467897+0000","last_clean":"2021-10-08T19:23:48.467897+0000","last_became_active":"2021-10-08T19:23:42.809170+0000","last_became_peered":"2021-10-08T19:23:42.809170+0000","last_unstale":"2021-10-08T19:23:48.467897+0000","last_undegraded":"2021-10-08T19:23:48.467897+0000","last_fullsized":"2021-10-08T19:23:48.467897+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:01.746914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:01.746914+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001402506,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"69'28","reported_seq":130,"reported_epoch":99,"state":"active+clean","last_fresh":"2021-10-08T19:23:51.727489+0000","last_change":"2021-10-08T19:22:40.195245+0000","last_active":"2021-10-08T19:23:51.727489+0000","last_peered":"2021-10-08T19:23:51.727489+0000","last_clean":"2021-10-08T19:23:51.727489+0000","last_became_active":"2021-10-08T19:21:25.613663+0000","last_became_peered":"2021-10-08T19:21:25.613663+0000","last_unstale":"2021-10-08T19:23:51.727489+0000","last_undegraded":"2021-10-08T19:23:51.727489+0000","last_fullsized":"2021-10-08T19:23:51.727489+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'28","last_scrub_stamp":"2021-10-08T19:22:40.195166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.195166+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0029295340000000001,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":49,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:49.827493+0000","last_change":"2021-10-08T19:23:03.639015+0000","last_active":"2021-10-08T19:23:49.827493+0000","last_peered":"2021-10-08T19:23:49.827493+0000","last_clean":"2021-10-08T19:23:49.827493+0000","last_became_active":"2021-10-08T19:21:27.636192+0000","last_became_peered":"2021-10-08T19:21:27.636192+0000","last_unstale":"2021-10-08T19:23:49.827493+0000","last_undegraded":"2021-10-08T19:23:49.827493+0000","last_fullsized":"2021-10-08T19:23:49.827493+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:03.638920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:03.638920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0016933230000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"99'834","reported_seq":847,"reported_epoch":99,"state":"active+clean","last_fresh":"2021-10-08T19:23:58.422931+0000","last_change":"2021-10-08T19:23:44.815167+0000","last_active":"2021-10-08T19:23:58.422931+0000","last_peered":"2021-10-08T19:23:58.422931+0000","last_clean":"2021-10-08T19:23:58.422931+0000","last_became_active":"2021-10-08T19:23:44.814856+0000","last_became_peered":"2021-10-08T19:23:44.814856+0000","last_unstale":"2021-10-08T19:23:58.422931+0000","last_undegraded":"2021-10-08T19:23:58.422931+0000","last_fullsized":"2021-10-08T19:23:58.422931+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":834,"ondisk_log_size":834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":54657024,"num_objects":834,"num_object_clones":0,"num_object_copies":2502,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":834,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":834,"num_write_kb":53376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":56,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:49.825651+0000","last_change":"2021-10-08T19:23:42.814299+0000","last_active":"2021-10-08T19:23:49.825651+0000","last_peered":"2021-10-08T19:23:49.825651+0000","last_clean":"2021-10-08T19:23:49.825651+0000","last_became_active":"2021-10-08T19:23:42.813365+0000","last_became_peered":"2021-10-08T19:23:42.813365+0000","last_unstale":"2021-10-08T19:23:49.825651+0000","last_undegraded":"2021-10-08T19:23:49.825651+0000","last_fullsized":"2021-10-08T19:23:49.825651+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:01.215579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:01.215579+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001463748,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"70'5","reported_seq":216,"reported_epoch":99,"state":"active+clean","last_fresh":"2021-10-08T19:23:56.879947+0000","last_change":"2021-10-08T19:23:42.837137+0000","last_active":"2021-10-08T19:23:56.879947+0000","last_peered":"2021-10-08T19:23:56.879947+0000","last_clean":"2021-10-08T19:23:56.879947+0000","last_became_active":"2021-10-08T19:23:42.812347+0000","last_became_peered":"2021-10-08T19:23:42.812347+0000","last_unstale":"2021-10-08T19:23:56.879947+0000","last_undegraded":"2021-10-08T19:23:56.879947+0000","last_fullsized":"2021-10-08T19:23:56.879947+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:22:48.239721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:48.239721+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001618092,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":145,"num_read_kb":140,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":389,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":53,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:49.824730+0000","last_change":"2021-10-08T19:22:53.423318+0000","last_active":"2021-10-08T19:23:49.824730+0000","last_peered":"2021-10-08T19:23:49.824730+0000","last_clean":"2021-10-08T19:23:49.824730+0000","last_became_active":"2021-10-08T19:21:23.602967+0000","last_became_peered":"2021-10-08T19:21:23.602967+0000","last_unstale":"2021-10-08T19:23:49.824730+0000","last_undegraded":"2021-10-08T19:23:49.824730+0000","last_fullsized":"2021-10-08T19:23:49.824730+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:53.423249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:53.423249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001264587,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"69'13","reported_seq":78,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:50.459948+0000","last_change":"2021-10-08T19:22:46.281753+0000","last_active":"2021-10-08T19:23:50.459948+0000","last_peered":"2021-10-08T19:23:50.459948+0000","last_clean":"2021-10-08T19:23:50.459948+0000","last_became_active":"2021-10-08T19:21:25.608584+0000","last_became_peered":"2021-10-08T19:21:25.608584+0000","last_unstale":"2021-10-08T19:23:50.459948+0000","last_undegraded":"2021-10-08T19:23:50.459948+0000","last_fullsized":"2021-10-08T19:23:50.459948+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'13","last_scrub_stamp":"2021-10-08T19:22:46.281626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:46.281626+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0047889999999999999,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":49,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:49.825817+0000","last_change":"2021-10-08T19:23:06.487842+0000","last_active":"2021-10-08T19:23:49.825817+0000","last_peered":"2021-10-08T19:23:49.825817+0000","last_clean":"2021-10-08T19:23:49.825817+0000","last_became_active":"2021-10-08T19:21:27.637875+0000","last_became_peered":"2021-10-08T19:21:27.637875+0000","last_unstale":"2021-10-08T19:23:49.825817+0000","last_undegraded":"2021-10-08T19:23:49.825817+0000","last_fullsized":"2021-10-08T19:23:49.825817+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:06.487723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:06.487723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034218619999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"99'844","reported_seq":857,"reported_epoch":99,"state":"active+clean","last_fresh":"2021-10-08T19:23:58.401801+0000","last_change":"2021-10-08T19:23:44.811881+0000","last_active":"2021-10-08T19:23:58.401801+0000","last_peered":"2021-10-08T19:23:58.401801+0000","last_clean":"2021-10-08T19:23:58.401801+0000","last_became_active":"2021-10-08T19:23:44.810317+0000","last_became_peered":"2021-10-08T19:23:44.810317+0000","last_unstale":"2021-10-08T19:23:58.401801+0000","last_undegraded":"2021-10-08T19:23:58.401801+0000","last_fullsized":"2021-10-08T19:23:58.401801+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":844,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":55312384,"num_objects":844,"num_object_clones":0,"num_object_copies":2532,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":844,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":844,"num_write_kb":54016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":46,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:48.468658+0000","last_change":"2021-10-08T19:23:14.763360+0000","last_active":"2021-10-08T19:23:48.468658+0000","last_peered":"2021-10-08T19:23:48.468658+0000","last_clean":"2021-10-08T19:23:48.468658+0000","last_became_active":"2021-10-08T19:21:29.646242+0000","last_became_peered":"2021-10-08T19:21:29.646242+0000","last_unstale":"2021-10-08T19:23:48.468658+0000","last_undegraded":"2021-10-08T19:23:48.468658+0000","last_fullsized":"2021-10-08T19:23:48.468658+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:14.763280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:14.763280+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034824790000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":61,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:48.307589+0000","last_change":"2021-10-08T19:23:42.811850+0000","last_active":"2021-10-08T19:23:48.307589+0000","last_peered":"2021-10-08T19:23:48.307589+0000","last_clean":"2021-10-08T19:23:48.307589+0000","last_became_active":"2021-10-08T19:23:42.811365+0000","last_became_peered":"2021-10-08T19:23:42.811365+0000","last_unstale":"2021-10-08T19:23:48.307589+0000","last_undegraded":"2021-10-08T19:23:48.307589+0000","last_fullsized":"2021-10-08T19:23:48.307589+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:40.563247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.563247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.024890005999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4],"acting":[3,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":52,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:48.467933+0000","last_change":"2021-10-08T19:23:22.620672+0000","last_active":"2021-10-08T19:23:48.467933+0000","last_peered":"2021-10-08T19:23:48.467933+0000","last_clean":"2021-10-08T19:23:48.467933+0000","last_became_active":"2021-10-08T19:21:23.599143+0000","last_became_peered":"2021-10-08T19:21:23.599143+0000","last_unstale":"2021-10-08T19:23:48.467933+0000","last_undegraded":"2021-10-08T19:23:48.467933+0000","last_fullsized":"2021-10-08T19:23:48.467933+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:22.620600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:22.620600+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003478133,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"90'130","reported_seq":333,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:49.825049+0000","last_change":"2021-10-08T19:23:45.864092+0000","last_active":"2021-10-08T19:23:49.825049+0000","last_peered":"2021-10-08T19:23:49.825049+0000","last_clean":"2021-10-08T19:23:49.825049+0000","last_became_active":"2021-10-08T19:23:45.863722+0000","last_became_peered":"2021-10-08T19:23:45.863722+0000","last_unstale":"2021-10-08T19:23:49.825049+0000","last_undegraded":"2021-10-08T19:23:49.825049+0000","last_fullsized":"2021-10-08T19:23:49.825049+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.284249+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0045617870000000003,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2361472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"69'14","reported_seq":68,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:47.809872+0000","last_change":"2021-10-08T19:23:42.829800+0000","last_active":"2021-10-08T19:23:47.809872+0000","last_peered":"2021-10-08T19:23:47.809872+0000","last_clean":"2021-10-08T19:23:47.809872+0000","last_became_active":"2021-10-08T19:23:42.803189+0000","last_became_peered":"2021-10-08T19:23:42.803189+0000","last_unstale":"2021-10-08T19:23:47.809872+0000","last_undegraded":"2021-10-08T19:23:47.809872+0000","last_fullsized":"2021-10-08T19:23:47.809872+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'14","last_scrub_stamp":"2021-10-08T19:22:54.379349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:54.379349+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":24,"num_read_kb":14,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,0],"acting":[4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":49,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:49.825627+0000","last_change":"2021-10-08T19:23:02.267580+0000","last_active":"2021-10-08T19:23:49.825627+0000","last_peered":"2021-10-08T19:23:49.825627+0000","last_clean":"2021-10-08T19:23:49.825627+0000","last_became_active":"2021-10-08T19:21:27.636086+0000","last_became_peered":"2021-10-08T19:21:27.636086+0000","last_unstale":"2021-10-08T19:23:49.825627+0000","last_undegraded":"2021-10-08T19:23:49.825627+0000","last_fullsized":"2021-10-08T19:23:49.825627+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:02.267508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:02.267508+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034499700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"99'876","reported_seq":889,"reported_epoch":99,"state":"active+clean","last_fresh":"2021-10-08T19:23:58.426033+0000","last_change":"2021-10-08T19:23:44.811375+0000","last_active":"2021-10-08T19:23:58.426033+0000","last_peered":"2021-10-08T19:23:58.426033+0000","last_clean":"2021-10-08T19:23:58.426033+0000","last_became_active":"2021-10-08T19:23:44.811097+0000","last_became_peered":"2021-10-08T19:23:44.811097+0000","last_unstale":"2021-10-08T19:23:58.426033+0000","last_undegraded":"2021-10-08T19:23:58.426033+0000","last_fullsized":"2021-10-08T19:23:58.426033+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":876,"ondisk_log_size":876,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":57409536,"num_objects":876,"num_object_clones":0,"num_object_copies":2628,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":876,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":876,"num_write_kb":56064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,0],"acting":[7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":47,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:50.459828+0000","last_change":"2021-10-08T19:22:55.234981+0000","last_active":"2021-10-08T19:23:50.459828+0000","last_peered":"2021-10-08T19:23:50.459828+0000","last_clean":"2021-10-08T19:23:50.459828+0000","last_became_active":"2021-10-08T19:21:29.648784+0000","last_became_peered":"2021-10-08T19:21:29.648784+0000","last_unstale":"2021-10-08T19:23:50.459828+0000","last_undegraded":"2021-10-08T19:23:50.459828+0000","last_fullsized":"2021-10-08T19:23:50.459828+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:55.234909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:55.234909+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0014461070000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":53,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:49.827443+0000","last_change":"2021-10-08T19:22:31.557761+0000","last_active":"2021-10-08T19:23:49.827443+0000","last_peered":"2021-10-08T19:23:49.827443+0000","last_clean":"2021-10-08T19:23:49.827443+0000","last_became_active":"2021-10-08T19:21:23.602857+0000","last_became_peered":"2021-10-08T19:21:23.602857+0000","last_unstale":"2021-10-08T19:23:49.827443+0000","last_undegraded":"2021-10-08T19:23:49.827443+0000","last_fullsized":"2021-10-08T19:23:49.827443+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:31.557650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:31.557650+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001454997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:49.824581+0000","last_change":"2021-10-08T19:23:44.813453+0000","last_active":"2021-10-08T19:23:49.824581+0000","last_peered":"2021-10-08T19:23:49.824581+0000","last_clean":"2021-10-08T19:23:49.824581+0000","last_became_active":"2021-10-08T19:23:44.813130+0000","last_became_peered":"2021-10-08T19:23:44.813130+0000","last_unstale":"2021-10-08T19:23:49.824581+0000","last_undegraded":"2021-10-08T19:23:49.824581+0000","last_fullsized":"2021-10-08T19:23:49.824581+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:32.922694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:32.922694+0000","last_clean_scrub_stamp":"2021-10-08T19:22:32.922694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"69'12","reported_seq":69,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:49.827607+0000","last_change":"2021-10-08T19:22:55.639993+0000","last_active":"2021-10-08T19:23:49.827607+0000","last_peered":"2021-10-08T19:23:49.827607+0000","last_clean":"2021-10-08T19:23:49.827607+0000","last_became_active":"2021-10-08T19:21:25.610233+0000","last_became_peered":"2021-10-08T19:21:25.610233+0000","last_unstale":"2021-10-08T19:23:49.827607+0000","last_undegraded":"2021-10-08T19:23:49.827607+0000","last_fullsized":"2021-10-08T19:23:49.827607+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'12","last_scrub_stamp":"2021-10-08T19:22:55.639881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:55.639881+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0032422169999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":54,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:48.468633+0000","last_change":"2021-10-08T19:23:41.487724+0000","last_active":"2021-10-08T19:23:48.468633+0000","last_peered":"2021-10-08T19:23:48.468633+0000","last_clean":"2021-10-08T19:23:48.468633+0000","last_became_active":"2021-10-08T19:21:27.635800+0000","last_became_peered":"2021-10-08T19:21:27.635800+0000","last_unstale":"2021-10-08T19:23:48.468633+0000","last_undegraded":"2021-10-08T19:23:48.468633+0000","last_fullsized":"2021-10-08T19:23:48.468633+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:41.487627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:41.487627+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003650445,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.0","version":"99'796","reported_seq":808,"reported_epoch":99,"state":"active+clean","last_fresh":"2021-10-08T19:23:58.412103+0000","last_change":"2021-10-08T19:23:44.808792+0000","last_active":"2021-10-08T19:23:58.412103+0000","last_peered":"2021-10-08T19:23:58.412103+0000","last_clean":"2021-10-08T19:23:58.412103+0000","last_became_active":"2021-10-08T19:23:44.808533+0000","last_became_peered":"2021-10-08T19:23:44.808533+0000","last_unstale":"2021-10-08T19:23:58.412103+0000","last_undegraded":"2021-10-08T19:23:58.412103+0000","last_fullsized":"2021-10-08T19:23:58.412103+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":796,"ondisk_log_size":796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":52166656,"num_objects":796,"num_object_clones":0,"num_object_copies":2388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":796,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":796,"num_write_kb":50944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":56,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:50.459226+0000","last_change":"2021-10-08T19:23:42.806034+0000","last_active":"2021-10-08T19:23:50.459226+0000","last_peered":"2021-10-08T19:23:50.459226+0000","last_clean":"2021-10-08T19:23:50.459226+0000","last_became_active":"2021-10-08T19:23:42.805705+0000","last_became_peered":"2021-10-08T19:23:42.805705+0000","last_unstale":"2021-10-08T19:23:50.459226+0000","last_undegraded":"2021-10-08T19:23:50.459226+0000","last_fullsized":"2021-10-08T19:23:50.459226+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:06.155068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:06.155068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001436805,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,7],"acting":[1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"61'1","reported_seq":60,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:49.825739+0000","last_change":"2021-10-08T19:22:26.905589+0000","last_active":"2021-10-08T19:23:49.825739+0000","last_peered":"2021-10-08T19:23:49.825739+0000","last_clean":"2021-10-08T19:23:49.825739+0000","last_became_active":"2021-10-08T19:21:23.604258+0000","last_became_peered":"2021-10-08T19:21:23.604258+0000","last_unstale":"2021-10-08T19:23:49.825739+0000","last_undegraded":"2021-10-08T19:23:49.825739+0000","last_fullsized":"2021-10-08T19:23:49.825739+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'1","last_scrub_stamp":"2021-10-08T19:22:26.905517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:26.905517+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001822178,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"69'19","reported_seq":87,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:49.827212+0000","last_change":"2021-10-08T19:22:29.614784+0000","last_active":"2021-10-08T19:23:49.827212+0000","last_peered":"2021-10-08T19:23:49.827212+0000","last_clean":"2021-10-08T19:23:49.827212+0000","last_became_active":"2021-10-08T19:21:25.741812+0000","last_became_peered":"2021-10-08T19:21:25.741812+0000","last_unstale":"2021-10-08T19:23:49.827212+0000","last_undegraded":"2021-10-08T19:23:49.827212+0000","last_fullsized":"2021-10-08T19:23:49.827212+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'19","last_scrub_stamp":"2021-10-08T19:22:29.614706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:29.614706+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0024396359999999998,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":18,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:49.827903+0000","last_change":"2021-10-08T19:23:42.808483+0000","last_active":"2021-10-08T19:23:49.827903+0000","last_peered":"2021-10-08T19:23:49.827903+0000","last_clean":"2021-10-08T19:23:49.827903+0000","last_became_active":"2021-10-08T19:23:42.808169+0000","last_became_peered":"2021-10-08T19:23:42.808169+0000","last_unstale":"2021-10-08T19:23:49.827903+0000","last_undegraded":"2021-10-08T19:23:49.827903+0000","last_fullsized":"2021-10-08T19:23:49.827903+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:42.399412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:42.399412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"99'813","reported_seq":825,"reported_epoch":99,"state":"active+clean","last_fresh":"2021-10-08T19:23:58.425223+0000","last_change":"2021-10-08T19:23:44.799701+0000","last_active":"2021-10-08T19:23:58.425223+0000","last_peered":"2021-10-08T19:23:58.425223+0000","last_clean":"2021-10-08T19:23:58.425223+0000","last_became_active":"2021-10-08T19:23:44.799526+0000","last_became_peered":"2021-10-08T19:23:44.799526+0000","last_unstale":"2021-10-08T19:23:58.425223+0000","last_undegraded":"2021-10-08T19:23:58.425223+0000","last_fullsized":"2021-10-08T19:23:58.425223+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":813,"ondisk_log_size":813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":53280768,"num_objects":813,"num_object_clones":0,"num_object_copies":2439,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":813,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":813,"num_write_kb":52032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4],"acting":[3,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":46,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:47.809259+0000","last_change":"2021-10-08T19:22:40.264230+0000","last_active":"2021-10-08T19:23:47.809259+0000","last_peered":"2021-10-08T19:23:47.809259+0000","last_clean":"2021-10-08T19:23:47.809259+0000","last_became_active":"2021-10-08T19:21:29.646491+0000","last_became_peered":"2021-10-08T19:21:29.646491+0000","last_unstale":"2021-10-08T19:23:47.809259+0000","last_undegraded":"2021-10-08T19:23:47.809259+0000","last_fullsized":"2021-10-08T19:23:47.809259+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:40.264110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.264110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003475845,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":62,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:50.459707+0000","last_change":"2021-10-08T19:23:42.811276+0000","last_active":"2021-10-08T19:23:50.459707+0000","last_peered":"2021-10-08T19:23:50.459707+0000","last_clean":"2021-10-08T19:23:50.459707+0000","last_became_active":"2021-10-08T19:23:42.810949+0000","last_became_peered":"2021-10-08T19:23:42.810949+0000","last_unstale":"2021-10-08T19:23:50.459707+0000","last_undegraded":"2021-10-08T19:23:50.459707+0000","last_fullsized":"2021-10-08T19:23:50.459707+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:41.186945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:41.186945+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0037557269999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"69'18","reported_seq":82,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:48.307314+0000","last_change":"2021-10-08T19:23:20.405609+0000","last_active":"2021-10-08T19:23:48.307314+0000","last_peered":"2021-10-08T19:23:48.307314+0000","last_clean":"2021-10-08T19:23:48.307314+0000","last_became_active":"2021-10-08T19:21:25.742909+0000","last_became_peered":"2021-10-08T19:21:25.742909+0000","last_unstale":"2021-10-08T19:23:48.307314+0000","last_undegraded":"2021-10-08T19:23:48.307314+0000","last_fullsized":"2021-10-08T19:23:48.307314+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'18","last_scrub_stamp":"2021-10-08T19:23:20.405525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:20.405525+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039753820000000004,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":48,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:47.809095+0000","last_change":"2021-10-08T19:22:52.021819+0000","last_active":"2021-10-08T19:23:47.809095+0000","last_peered":"2021-10-08T19:23:47.809095+0000","last_clean":"2021-10-08T19:23:47.809095+0000","last_became_active":"2021-10-08T19:21:27.637547+0000","last_became_peered":"2021-10-08T19:21:27.637547+0000","last_unstale":"2021-10-08T19:23:47.809095+0000","last_undegraded":"2021-10-08T19:23:47.809095+0000","last_fullsized":"2021-10-08T19:23:47.809095+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:52.021733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:52.021733+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034012640000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"99'849","reported_seq":861,"reported_epoch":99,"state":"active+clean","last_fresh":"2021-10-08T19:23:58.417758+0000","last_change":"2021-10-08T19:23:44.807321+0000","last_active":"2021-10-08T19:23:58.417758+0000","last_peered":"2021-10-08T19:23:58.417758+0000","last_clean":"2021-10-08T19:23:58.417758+0000","last_became_active":"2021-10-08T19:23:44.807072+0000","last_became_peered":"2021-10-08T19:23:44.807072+0000","last_unstale":"2021-10-08T19:23:58.417758+0000","last_undegraded":"2021-10-08T19:23:58.417758+0000","last_fullsized":"2021-10-08T19:23:58.417758+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":849,"ondisk_log_size":849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":55640064,"num_objects":849,"num_object_clones":0,"num_object_copies":2547,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":849,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":849,"num_write_kb":54336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":58,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:49.825745+0000","last_change":"2021-10-08T19:23:42.805470+0000","last_active":"2021-10-08T19:23:49.825745+0000","last_peered":"2021-10-08T19:23:49.825745+0000","last_clean":"2021-10-08T19:23:49.825745+0000","last_became_active":"2021-10-08T19:23:42.805092+0000","last_became_peered":"2021-10-08T19:23:42.805092+0000","last_unstale":"2021-10-08T19:23:49.825745+0000","last_undegraded":"2021-10-08T19:23:49.825745+0000","last_fullsized":"2021-10-08T19:23:49.825745+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:05.263508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:05.263508+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034369000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,1],"acting":[7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:49.826069+0000","last_change":"2021-10-08T19:23:42.816361+0000","last_active":"2021-10-08T19:23:49.826069+0000","last_peered":"2021-10-08T19:23:49.826069+0000","last_clean":"2021-10-08T19:23:49.826069+0000","last_became_active":"2021-10-08T19:23:42.815771+0000","last_became_peered":"2021-10-08T19:23:42.815771+0000","last_unstale":"2021-10-08T19:23:49.826069+0000","last_undegraded":"2021-10-08T19:23:49.826069+0000","last_fullsized":"2021-10-08T19:23:49.826069+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:49.391258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:49.391258+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1","version":"69'14","reported_seq":96,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:47.808925+0000","last_change":"2021-10-08T19:23:43.449137+0000","last_active":"2021-10-08T19:23:47.808925+0000","last_peered":"2021-10-08T19:23:47.808925+0000","last_clean":"2021-10-08T19:23:47.808925+0000","last_became_active":"2021-10-08T19:23:42.808469+0000","last_became_peered":"2021-10-08T19:23:42.808469+0000","last_unstale":"2021-10-08T19:23:47.808925+0000","last_undegraded":"2021-10-08T19:23:47.808925+0000","last_fullsized":"2021-10-08T19:23:47.808925+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'14","last_scrub_stamp":"2021-10-08T19:22:26.320928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:26.320928+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0048335899999999996,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"91'9","reported_seq":88,"reported_epoch":99,"state":"active+clean","last_fresh":"2021-10-08T19:23:51.727631+0000","last_change":"2021-10-08T19:23:32.329551+0000","last_active":"2021-10-08T19:23:51.727631+0000","last_peered":"2021-10-08T19:23:51.727631+0000","last_clean":"2021-10-08T19:23:51.727631+0000","last_became_active":"2021-10-08T19:21:27.640694+0000","last_became_peered":"2021-10-08T19:21:27.640694+0000","last_unstale":"2021-10-08T19:23:51.727631+0000","last_undegraded":"2021-10-08T19:23:51.727631+0000","last_fullsized":"2021-10-08T19:23:51.727631+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'9","last_scrub_stamp":"2021-10-08T19:23:32.329475+0000","last_deep_scrub":"91'9","last_deep_scrub_stamp":"2021-10-08T19:23:32.329475+0000","last_clean_scrub_stamp":"2021-10-08T19:23:32.329475+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0045727859999999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"99'819","reported_seq":832,"reported_epoch":99,"state":"active+clean","last_fresh":"2021-10-08T19:23:58.415239+0000","last_change":"2021-10-08T19:23:44.814662+0000","last_active":"2021-10-08T19:23:58.415239+0000","last_peered":"2021-10-08T19:23:58.415239+0000","last_clean":"2021-10-08T19:23:58.415239+0000","last_became_active":"2021-10-08T19:23:44.814370+0000","last_became_peered":"2021-10-08T19:23:44.814370+0000","last_unstale":"2021-10-08T19:23:58.415239+0000","last_undegraded":"2021-10-08T19:23:58.415239+0000","last_fullsized":"2021-10-08T19:23:58.415239+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":819,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":53673984,"num_objects":819,"num_object_clones":0,"num_object_copies":2457,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":819,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":819,"num_write_kb":52416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":55,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:48.307851+0000","last_change":"2021-10-08T19:23:42.818999+0000","last_active":"2021-10-08T19:23:48.307851+0000","last_peered":"2021-10-08T19:23:48.307851+0000","last_clean":"2021-10-08T19:23:48.307851+0000","last_became_active":"2021-10-08T19:23:42.818675+0000","last_became_peered":"2021-10-08T19:23:42.818675+0000","last_unstale":"2021-10-08T19:23:48.307851+0000","last_undegraded":"2021-10-08T19:23:48.307851+0000","last_fullsized":"2021-10-08T19:23:48.307851+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:17.422176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:17.422176+0000","last_clean_scrub_stamp":"2021-10-08T19:23:17.422176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0036221249999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":57,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:48.468578+0000","last_change":"2021-10-08T19:23:42.814439+0000","last_active":"2021-10-08T19:23:48.468578+0000","last_peered":"2021-10-08T19:23:48.468578+0000","last_clean":"2021-10-08T19:23:48.468578+0000","last_became_active":"2021-10-08T19:23:42.814029+0000","last_became_peered":"2021-10-08T19:23:42.814029+0000","last_unstale":"2021-10-08T19:23:48.468578+0000","last_undegraded":"2021-10-08T19:23:48.468578+0000","last_fullsized":"2021-10-08T19:23:48.468578+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:17.689312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:17.689312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0033939769999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,2],"acting":[5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":53,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:49.825072+0000","last_change":"2021-10-08T19:22:29.954439+0000","last_active":"2021-10-08T19:23:49.825072+0000","last_peered":"2021-10-08T19:23:49.825072+0000","last_clean":"2021-10-08T19:23:49.825072+0000","last_became_active":"2021-10-08T19:21:23.606597+0000","last_became_peered":"2021-10-08T19:21:23.606597+0000","last_unstale":"2021-10-08T19:23:49.825072+0000","last_undegraded":"2021-10-08T19:23:49.825072+0000","last_fullsized":"2021-10-08T19:23:49.825072+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:29.954337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:29.954337+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0018351859999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"69'11","reported_seq":90,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:47.809734+0000","last_change":"2021-10-08T19:23:42.843602+0000","last_active":"2021-10-08T19:23:47.809734+0000","last_peered":"2021-10-08T19:23:47.809734+0000","last_clean":"2021-10-08T19:23:47.809734+0000","last_became_active":"2021-10-08T19:23:42.809808+0000","last_became_peered":"2021-10-08T19:23:42.809808+0000","last_unstale":"2021-10-08T19:23:47.809734+0000","last_undegraded":"2021-10-08T19:23:47.809734+0000","last_fullsized":"2021-10-08T19:23:47.809734+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'11","last_scrub_stamp":"2021-10-08T19:23:01.988336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:01.988336+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0026768489999999998,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"99'812","reported_seq":824,"reported_epoch":99,"state":"active+clean","last_fresh":"2021-10-08T19:23:58.406871+0000","last_change":"2021-10-08T19:23:44.803509+0000","last_active":"2021-10-08T19:23:58.406871+0000","last_peered":"2021-10-08T19:23:58.406871+0000","last_clean":"2021-10-08T19:23:58.406871+0000","last_became_active":"2021-10-08T19:23:44.803199+0000","last_became_peered":"2021-10-08T19:23:44.803199+0000","last_unstale":"2021-10-08T19:23:58.406871+0000","last_undegraded":"2021-10-08T19:23:58.406871+0000","last_fullsized":"2021-10-08T19:23:58.406871+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":812,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":53215232,"num_objects":812,"num_object_clones":0,"num_object_copies":2436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":812,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":812,"num_write_kb":51968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":46,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:48.468370+0000","last_change":"2021-10-08T19:22:49.530669+0000","last_active":"2021-10-08T19:23:48.468370+0000","last_peered":"2021-10-08T19:23:48.468370+0000","last_clean":"2021-10-08T19:23:48.468370+0000","last_became_active":"2021-10-08T19:21:29.639358+0000","last_became_peered":"2021-10-08T19:21:29.639358+0000","last_unstale":"2021-10-08T19:23:48.468370+0000","last_undegraded":"2021-10-08T19:23:48.468370+0000","last_fullsized":"2021-10-08T19:23:48.468370+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:49.530586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:49.530586+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0036198910000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"88'9","reported_seq":91,"reported_epoch":99,"state":"active+clean","last_fresh":"2021-10-08T19:23:51.728054+0000","last_change":"2021-10-08T19:23:00.048324+0000","last_active":"2021-10-08T19:23:51.728054+0000","last_peered":"2021-10-08T19:23:51.728054+0000","last_clean":"2021-10-08T19:23:51.728054+0000","last_became_active":"2021-10-08T19:21:27.636432+0000","last_became_peered":"2021-10-08T19:21:27.636432+0000","last_unstale":"2021-10-08T19:23:51.728054+0000","last_undegraded":"2021-10-08T19:23:51.728054+0000","last_fullsized":"2021-10-08T19:23:51.728054+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'9","last_scrub_stamp":"2021-10-08T19:23:00.048245+0000","last_deep_scrub":"88'9","last_deep_scrub_stamp":"2021-10-08T19:23:00.048245+0000","last_clean_scrub_stamp":"2021-10-08T19:23:00.048245+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0031661179999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":53,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:50.459126+0000","last_change":"2021-10-08T19:22:27.212471+0000","last_active":"2021-10-08T19:23:50.459126+0000","last_peered":"2021-10-08T19:23:50.459126+0000","last_clean":"2021-10-08T19:23:50.459126+0000","last_became_active":"2021-10-08T19:21:23.603264+0000","last_became_peered":"2021-10-08T19:21:23.603264+0000","last_unstale":"2021-10-08T19:23:50.459126+0000","last_undegraded":"2021-10-08T19:23:50.459126+0000","last_fullsized":"2021-10-08T19:23:50.459126+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:27.212397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:27.212397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0013817009999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"69'15","reported_seq":76,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:50.459867+0000","last_change":"2021-10-08T19:22:56.213566+0000","last_active":"2021-10-08T19:23:50.459867+0000","last_peered":"2021-10-08T19:23:50.459867+0000","last_clean":"2021-10-08T19:23:50.459867+0000","last_became_active":"2021-10-08T19:21:25.617776+0000","last_became_peered":"2021-10-08T19:21:25.617776+0000","last_unstale":"2021-10-08T19:23:50.459867+0000","last_undegraded":"2021-10-08T19:23:50.459867+0000","last_fullsized":"2021-10-08T19:23:50.459867+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'15","last_scrub_stamp":"2021-10-08T19:22:56.213493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:56.213493+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039771219999999996,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"99'826","reported_seq":839,"reported_epoch":99,"state":"active+clean","last_fresh":"2021-10-08T19:23:58.420972+0000","last_change":"2021-10-08T19:23:44.812210+0000","last_active":"2021-10-08T19:23:58.420972+0000","last_peered":"2021-10-08T19:23:58.420972+0000","last_clean":"2021-10-08T19:23:58.420972+0000","last_became_active":"2021-10-08T19:23:44.810340+0000","last_became_peered":"2021-10-08T19:23:44.810340+0000","last_unstale":"2021-10-08T19:23:58.420972+0000","last_undegraded":"2021-10-08T19:23:58.420972+0000","last_fullsized":"2021-10-08T19:23:58.420972+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":826,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":54132736,"num_objects":826,"num_object_clones":0,"num_object_copies":2478,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":826,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":826,"num_write_kb":52864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":46,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:47.809618+0000","last_change":"2021-10-08T19:22:37.292691+0000","last_active":"2021-10-08T19:23:47.809618+0000","last_peered":"2021-10-08T19:23:47.809618+0000","last_clean":"2021-10-08T19:23:47.809618+0000","last_became_active":"2021-10-08T19:21:29.640249+0000","last_became_peered":"2021-10-08T19:21:29.640249+0000","last_unstale":"2021-10-08T19:23:47.809618+0000","last_undegraded":"2021-10-08T19:23:47.809618+0000","last_fullsized":"2021-10-08T19:23:47.809618+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:37.292621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:37.292621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001513517,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"69'8","reported_seq":88,"reported_epoch":99,"state":"active+clean","last_fresh":"2021-10-08T19:23:51.727640+0000","last_change":"2021-10-08T19:23:00.384891+0000","last_active":"2021-10-08T19:23:51.727640+0000","last_peered":"2021-10-08T19:23:51.727640+0000","last_clean":"2021-10-08T19:23:51.727640+0000","last_became_active":"2021-10-08T19:21:27.637930+0000","last_became_peered":"2021-10-08T19:21:27.637930+0000","last_unstale":"2021-10-08T19:23:51.727640+0000","last_undegraded":"2021-10-08T19:23:51.727640+0000","last_fullsized":"2021-10-08T19:23:51.727640+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'8","last_scrub_stamp":"2021-10-08T19:23:00.384808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:00.384808+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040307110000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":53,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:50.459253+0000","last_change":"2021-10-08T19:22:29.177318+0000","last_active":"2021-10-08T19:23:50.459253+0000","last_peered":"2021-10-08T19:23:50.459253+0000","last_clean":"2021-10-08T19:23:50.459253+0000","last_became_active":"2021-10-08T19:21:23.603207+0000","last_became_peered":"2021-10-08T19:21:23.603207+0000","last_unstale":"2021-10-08T19:23:50.459253+0000","last_undegraded":"2021-10-08T19:23:50.459253+0000","last_fullsized":"2021-10-08T19:23:50.459253+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:29.177157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:29.177157+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020581419999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"69'10","reported_seq":86,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:47.809340+0000","last_change":"2021-10-08T19:23:43.274785+0000","last_active":"2021-10-08T19:23:47.809340+0000","last_peered":"2021-10-08T19:23:47.809340+0000","last_clean":"2021-10-08T19:23:47.809340+0000","last_became_active":"2021-10-08T19:23:42.809775+0000","last_became_peered":"2021-10-08T19:23:42.809775+0000","last_unstale":"2021-10-08T19:23:47.809340+0000","last_undegraded":"2021-10-08T19:23:47.809340+0000","last_fullsized":"2021-10-08T19:23:47.809340+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'10","last_scrub_stamp":"2021-10-08T19:22:35.356292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:35.356292+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040689319999999999,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"99'827","reported_seq":840,"reported_epoch":99,"state":"active+clean","last_fresh":"2021-10-08T19:23:58.420977+0000","last_change":"2021-10-08T19:23:44.811875+0000","last_active":"2021-10-08T19:23:58.420977+0000","last_peered":"2021-10-08T19:23:58.420977+0000","last_clean":"2021-10-08T19:23:58.420977+0000","last_became_active":"2021-10-08T19:23:44.810666+0000","last_became_peered":"2021-10-08T19:23:44.810666+0000","last_unstale":"2021-10-08T19:23:58.420977+0000","last_undegraded":"2021-10-08T19:23:58.420977+0000","last_fullsized":"2021-10-08T19:23:58.420977+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":827,"ondisk_log_size":827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":54198272,"num_objects":827,"num_object_clones":0,"num_object_copies":2481,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":827,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":827,"num_write_kb":52928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":47,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:49.825434+0000","last_change":"2021-10-08T19:23:10.377105+0000","last_active":"2021-10-08T19:23:49.825434+0000","last_peered":"2021-10-08T19:23:49.825434+0000","last_clean":"2021-10-08T19:23:49.825434+0000","last_became_active":"2021-10-08T19:21:29.646455+0000","last_became_peered":"2021-10-08T19:21:29.646455+0000","last_unstale":"2021-10-08T19:23:49.825434+0000","last_undegraded":"2021-10-08T19:23:49.825434+0000","last_fullsized":"2021-10-08T19:23:49.825434+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:10.377024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:10.377024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0035706969999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":55,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:50.459841+0000","last_change":"2021-10-08T19:23:36.055728+0000","last_active":"2021-10-08T19:23:50.459841+0000","last_peered":"2021-10-08T19:23:50.459841+0000","last_clean":"2021-10-08T19:23:50.459841+0000","last_became_active":"2021-10-08T19:21:27.636429+0000","last_became_peered":"2021-10-08T19:21:27.636429+0000","last_unstale":"2021-10-08T19:23:50.459841+0000","last_undegraded":"2021-10-08T19:23:50.459841+0000","last_fullsized":"2021-10-08T19:23:50.459841+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:36.055616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:36.055616+0000","last_clean_scrub_stamp":"2021-10-08T19:23:36.055616+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0022840669999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"61'1","reported_seq":61,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:49.825219+0000","last_change":"2021-10-08T19:22:55.080106+0000","last_active":"2021-10-08T19:23:49.825219+0000","last_peered":"2021-10-08T19:23:49.825219+0000","last_clean":"2021-10-08T19:23:49.825219+0000","last_became_active":"2021-10-08T19:21:23.607064+0000","last_became_peered":"2021-10-08T19:21:23.607064+0000","last_unstale":"2021-10-08T19:23:49.825219+0000","last_undegraded":"2021-10-08T19:23:49.825219+0000","last_fullsized":"2021-10-08T19:23:49.825219+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'1","last_scrub_stamp":"2021-10-08T19:22:55.080028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:55.080028+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040037620000000001,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"69'17","reported_seq":78,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:47.809634+0000","last_change":"2021-10-08T19:22:47.109498+0000","last_active":"2021-10-08T19:23:47.809634+0000","last_peered":"2021-10-08T19:23:47.809634+0000","last_clean":"2021-10-08T19:23:47.809634+0000","last_became_active":"2021-10-08T19:21:25.609086+0000","last_became_peered":"2021-10-08T19:21:25.609086+0000","last_unstale":"2021-10-08T19:23:47.809634+0000","last_undegraded":"2021-10-08T19:23:47.809634+0000","last_fullsized":"2021-10-08T19:23:47.809634+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'17","last_scrub_stamp":"2021-10-08T19:22:47.109407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:47.109407+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0025026100000000002,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"99'837","reported_seq":850,"reported_epoch":99,"state":"active+clean","last_fresh":"2021-10-08T19:23:58.420600+0000","last_change":"2021-10-08T19:23:44.815633+0000","last_active":"2021-10-08T19:23:58.420600+0000","last_peered":"2021-10-08T19:23:58.420600+0000","last_clean":"2021-10-08T19:23:58.420600+0000","last_became_active":"2021-10-08T19:23:44.815346+0000","last_became_peered":"2021-10-08T19:23:44.815346+0000","last_unstale":"2021-10-08T19:23:58.420600+0000","last_undegraded":"2021-10-08T19:23:58.420600+0000","last_fullsized":"2021-10-08T19:23:58.420600+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":837,"ondisk_log_size":837,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":54853632,"num_objects":837,"num_object_clones":0,"num_object_copies":2511,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":837,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":837,"num_write_kb":53568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":47,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:49.825002+0000","last_change":"2021-10-08T19:23:03.272654+0000","last_active":"2021-10-08T19:23:49.825002+0000","last_peered":"2021-10-08T19:23:49.825002+0000","last_clean":"2021-10-08T19:23:49.825002+0000","last_became_active":"2021-10-08T19:21:29.648922+0000","last_became_peered":"2021-10-08T19:21:29.648922+0000","last_unstale":"2021-10-08T19:23:49.825002+0000","last_undegraded":"2021-10-08T19:23:49.825002+0000","last_fullsized":"2021-10-08T19:23:49.825002+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:03.272581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:03.272581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001525874,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":49,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:49.824983+0000","last_change":"2021-10-08T19:23:09.419579+0000","last_active":"2021-10-08T19:23:49.824983+0000","last_peered":"2021-10-08T19:23:49.824983+0000","last_clean":"2021-10-08T19:23:49.824983+0000","last_became_active":"2021-10-08T19:21:27.638583+0000","last_became_peered":"2021-10-08T19:21:27.638583+0000","last_unstale":"2021-10-08T19:23:49.824983+0000","last_undegraded":"2021-10-08T19:23:49.824983+0000","last_fullsized":"2021-10-08T19:23:49.824983+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:09.419493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:09.419493+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003406498,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":53,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:49.826413+0000","last_change":"2021-10-08T19:22:57.380012+0000","last_active":"2021-10-08T19:23:49.826413+0000","last_peered":"2021-10-08T19:23:49.826413+0000","last_clean":"2021-10-08T19:23:49.826413+0000","last_became_active":"2021-10-08T19:21:23.595919+0000","last_became_peered":"2021-10-08T19:21:23.595919+0000","last_unstale":"2021-10-08T19:23:49.826413+0000","last_undegraded":"2021-10-08T19:23:49.826413+0000","last_fullsized":"2021-10-08T19:23:49.826413+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:57.379935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:57.379935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034209349999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"69'19","reported_seq":82,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:50.459173+0000","last_change":"2021-10-08T19:23:42.833232+0000","last_active":"2021-10-08T19:23:50.459173+0000","last_peered":"2021-10-08T19:23:50.459173+0000","last_clean":"2021-10-08T19:23:50.459173+0000","last_became_active":"2021-10-08T19:23:42.804630+0000","last_became_peered":"2021-10-08T19:23:42.804630+0000","last_unstale":"2021-10-08T19:23:50.459173+0000","last_undegraded":"2021-10-08T19:23:50.459173+0000","last_fullsized":"2021-10-08T19:23:50.459173+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'19","last_scrub_stamp":"2021-10-08T19:22:39.356508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:39.356508+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":31,"num_read_kb":20,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,5],"acting":[1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"99'855","reported_seq":868,"reported_epoch":99,"state":"active+clean","last_fresh":"2021-10-08T19:23:58.420302+0000","last_change":"2021-10-08T19:23:44.804233+0000","last_active":"2021-10-08T19:23:58.420302+0000","last_peered":"2021-10-08T19:23:58.420302+0000","last_clean":"2021-10-08T19:23:58.420302+0000","last_became_active":"2021-10-08T19:23:44.803928+0000","last_became_peered":"2021-10-08T19:23:44.803928+0000","last_unstale":"2021-10-08T19:23:58.420302+0000","last_undegraded":"2021-10-08T19:23:58.420302+0000","last_fullsized":"2021-10-08T19:23:58.420302+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":855,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":56033280,"num_objects":855,"num_object_clones":0,"num_object_copies":2565,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":855,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":855,"num_write_kb":54720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4],"acting":[2,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":47,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:49.827833+0000","last_change":"2021-10-08T19:22:57.644734+0000","last_active":"2021-10-08T19:23:49.827833+0000","last_peered":"2021-10-08T19:23:49.827833+0000","last_clean":"2021-10-08T19:23:49.827833+0000","last_became_active":"2021-10-08T19:21:29.643022+0000","last_became_peered":"2021-10-08T19:21:29.643022+0000","last_unstale":"2021-10-08T19:23:49.827833+0000","last_undegraded":"2021-10-08T19:23:49.827833+0000","last_fullsized":"2021-10-08T19:23:49.827833+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:57.644627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:57.644627+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002174952,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":49,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:49.824954+0000","last_change":"2021-10-08T19:22:42.359224+0000","last_active":"2021-10-08T19:23:49.824954+0000","last_peered":"2021-10-08T19:23:49.824954+0000","last_clean":"2021-10-08T19:23:49.824954+0000","last_became_active":"2021-10-08T19:21:27.635310+0000","last_became_peered":"2021-10-08T19:21:27.635310+0000","last_unstale":"2021-10-08T19:23:49.824954+0000","last_undegraded":"2021-10-08T19:23:49.824954+0000","last_fullsized":"2021-10-08T19:23:49.824954+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:42.359130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:42.359130+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001847357,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":55,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:50.459731+0000","last_change":"2021-10-08T19:23:11.176225+0000","last_active":"2021-10-08T19:23:50.459731+0000","last_peered":"2021-10-08T19:23:50.459731+0000","last_clean":"2021-10-08T19:23:50.459731+0000","last_became_active":"2021-10-08T19:21:23.607639+0000","last_became_peered":"2021-10-08T19:21:23.607639+0000","last_unstale":"2021-10-08T19:23:50.459731+0000","last_undegraded":"2021-10-08T19:23:50.459731+0000","last_fullsized":"2021-10-08T19:23:50.459731+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:11.176122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:11.176122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040114119999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"69'9","reported_seq":67,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:49.827383+0000","last_change":"2021-10-08T19:22:36.590210+0000","last_active":"2021-10-08T19:23:49.827383+0000","last_peered":"2021-10-08T19:23:49.827383+0000","last_clean":"2021-10-08T19:23:49.827383+0000","last_became_active":"2021-10-08T19:21:25.610072+0000","last_became_peered":"2021-10-08T19:21:25.610072+0000","last_unstale":"2021-10-08T19:23:49.827383+0000","last_undegraded":"2021-10-08T19:23:49.827383+0000","last_fullsized":"2021-10-08T19:23:49.827383+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'9","last_scrub_stamp":"2021-10-08T19:22:36.590071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:36.590071+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0026030699999999999,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"99'866","reported_seq":879,"reported_epoch":99,"state":"active+clean","last_fresh":"2021-10-08T19:23:58.422214+0000","last_change":"2021-10-08T19:23:44.808664+0000","last_active":"2021-10-08T19:23:58.422214+0000","last_peered":"2021-10-08T19:23:58.422214+0000","last_clean":"2021-10-08T19:23:58.422214+0000","last_became_active":"2021-10-08T19:23:44.808375+0000","last_became_peered":"2021-10-08T19:23:44.808375+0000","last_unstale":"2021-10-08T19:23:58.422214+0000","last_undegraded":"2021-10-08T19:23:58.422214+0000","last_fullsized":"2021-10-08T19:23:58.422214+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":866,"ondisk_log_size":866,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":56754176,"num_objects":866,"num_object_clones":0,"num_object_copies":2598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":866,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":866,"num_write_kb":55424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,2],"acting":[1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":55,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:48.467782+0000","last_change":"2021-10-08T19:23:42.812507+0000","last_active":"2021-10-08T19:23:48.467782+0000","last_peered":"2021-10-08T19:23:48.467782+0000","last_clean":"2021-10-08T19:23:48.467782+0000","last_became_active":"2021-10-08T19:23:42.812119+0000","last_became_peered":"2021-10-08T19:23:42.812119+0000","last_unstale":"2021-10-08T19:23:48.467782+0000","last_undegraded":"2021-10-08T19:23:48.467782+0000","last_fullsized":"2021-10-08T19:23:48.467782+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:10.805052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:10.805052+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.00168849,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,2],"acting":[5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":53,"reported_epoch":98,"state":"active+clean","last_fresh":"2021-10-08T19:23:49.825654+0000","last_change":"2021-10-08T19:22:34.484570+0000","last_active":"2021-10-08T19:23:49.825654+0000","last_peered":"2021-10-08T19:23:49.825654+0000","last_clean":"2021-10-08T19:23:49.825654+0000","last_became_active":"2021-10-08T19:21:23.600352+0000","last_became_peered":"2021-10-08T19:21:23.600352+0000","last_unstale":"2021-10-08T19:23:49.825654+0000","last_undegraded":"2021-10-08T19:23:49.825654+0000","last_fullsized":"2021-10-08T19:23:49.825654+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:34.484488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:34.484488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034565799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"87'22","reported_seq":107,"reported_epoch":97,"state":"active+clean","last_fresh":"2021-10-08T19:23:48.467606+0000","last_change":"2021-10-08T19:23:42.833738+0000","last_active":"2021-10-08T19:23:48.467606+0000","last_peered":"2021-10-08T19:23:48.467606+0000","last_clean":"2021-10-08T19:23:48.467606+0000","last_became_active":"2021-10-08T19:23:42.813179+0000","last_became_peered":"2021-10-08T19:23:42.813179+0000","last_unstale":"2021-10-08T19:23:48.467606+0000","last_undegraded":"2021-10-08T19:23:48.467606+0000","last_fullsized":"2021-10-08T19:23:48.467606+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'22","last_scrub_stamp":"2021-10-08T19:22:58.705632+0000","last_deep_scrub":"87'22","last_deep_scrub_stamp":"2021-10-08T19:22:58.705632+0000","last_clean_scrub_stamp":"2021-10-08T19:22:58.705632+0000","log_size":22,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0051832670000000001,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"93'9","reported_seq":102,"reported_epoch":99,"state":"active+clean","last_fresh":"2021-10-08T19:23:51.728070+0000","last_change":"2021-10-08T19:23:42.818567+0000","last_active":"2021-10-08T19:23:51.728070+0000","last_peered":"2021-10-08T19:23:51.728070+0000","last_clean":"2021-10-08T19:23:51.728070+0000","last_became_active":"2021-10-08T19:23:42.808979+0000","last_became_peered":"2021-10-08T19:23:42.808979+0000","last_unstale":"2021-10-08T19:23:51.728070+0000","last_undegraded":"2021-10-08T19:23:51.728070+0000","last_fullsized":"2021-10-08T19:23:51.728070+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'8","last_scrub_stamp":"2021-10-08T19:22:51.065949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:51.065949+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020224639999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":871563264,"num_objects":13299,"num_object_clones":0,"num_object_copies":39897,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13299,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13299,"num_write_kb":851136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2616918016,"data_stored":2616918016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13299,"ondisk_log_size":13299,"up":48,"acting":48,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2361472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":3,"acting":3,"num_store_stats":4},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":145,"num_read_kb":140,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":389,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":694,"num_read_kb":451,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":1364,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":421888,"data_stored":11216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":406,"ondisk_log_size":406,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":69,"ondisk_log_size":69,"up":96,"acting":96,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201315,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":249460,"kb_used_data":223532,"kb_used_omap":0,"kb_used_meta":25856,"kb_avail":93495692,"statfs":{"total":95995035648,"available":95739588608,"internally_reserved":0,"allocated":228896768,"data_stored":228496142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":26476544},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:23:16 2021","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.46100000000000002,"15min":0.46600000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.69599999999999995,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.48799999999999999,"15min":0.47699999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":2.5960000000000001,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":0.52500000000000002}]},{"osd":1,"last update":"Fri Oct 8 19:23:16 2021","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.48199999999999998,"15min":0.49099999999999999},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.52300000000000002,"15min":0.51500000000000001},"min":{"1min":0.30599999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":2.6640000000000001,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.48399999999999999}]},{"osd":2,"last update":"Fri Oct 8 19:23:16 2021","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.48599999999999999,"15min":0.48799999999999999},"min":{"1min":0.313,"5min":0.308,"15min":0.308},"max":{"1min":0.65800000000000003,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.46999999999999997,"15min":0.47399999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.67700000000000005,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.57699999999999996}]},{"osd":3,"last update":"Fri Oct 8 19:23:16 2021","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.48199999999999998,"15min":0.48799999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.70499999999999996,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.52900000000000003,"15min":0.51500000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":2.6299999999999999,"5min":2.6299999999999999,"15min":2.6299999999999999},"last":0.55200000000000005}]},{"osd":4,"last update":"Fri Oct 8 19:23:16 2021","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.46600000000000003,"15min":0.47099999999999997},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.65500000000000003,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45000000000000001,"15min":0.44900000000000001},"min":{"1min":0.313,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68700000000000006,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.44500000000000001}]},{"osd":5,"last update":"Fri Oct 8 19:23:16 2021","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.47299999999999998,"15min":0.47499999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.65500000000000003,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.50700000000000001,"15min":0.51000000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.73399999999999999,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.5}]},{"osd":6,"last update":"Fri Oct 8 19:23:16 2021","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.53300000000000003,"15min":0.51500000000000001},"min":{"1min":0.36499999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":2.4550000000000001,"5min":2.4550000000000001,"15min":2.4550000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.37,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.58899999999999997}]}]},{"osd":6,"up_from":0,"seq":201863462951,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":1,"up_from":13,"seq":55834574906,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":436360,"kb_used_data":418624,"kb_used_omap":0,"kb_used_meta":17728,"kb_avail":93308792,"statfs":{"total":95995035648,"available":95548203008,"internally_reserved":0,"allocated":428670976,"data_stored":428249334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18153472},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:23:31 2021","interfaces":[{"interface":"back","average":{"1min":0.28599999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.21299999999999999,"5min":0.184,"15min":0.184},"max":{"1min":0.35199999999999998,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.35599999999999998,"15min":0.35799999999999998},"min":{"1min":0.218,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.45800000000000002,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.56599999999999995}]},{"osd":2,"last update":"Fri Oct 8 19:23:55 2021","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.374,"15min":0.39100000000000001},"min":{"1min":0.222,"5min":0.221,"15min":0.221},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.41599999999999998,"15min":0.41999999999999998},"min":{"1min":0.27400000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.70099999999999996,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.70099999999999996}]},{"osd":3,"last update":"Fri Oct 8 19:23:10 2021","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.438,"15min":0.46000000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.56399999999999995,"5min":0.748,"15min":0.748},"last":1.137},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.42799999999999999,"15min":0.45000000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.502,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":2.7639999999999998}]},{"osd":4,"last update":"Fri Oct 8 19:23:23 2021","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.50600000000000001,"15min":0.51200000000000001},"min":{"1min":0.34699999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.52600000000000002,"15min":0.53500000000000003},"min":{"1min":0.371,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.70599999999999996,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.433}]},{"osd":5,"last update":"Fri Oct 8 19:23:43 2021","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.54100000000000004,"15min":0.55700000000000005},"min":{"1min":0.39000000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.66900000000000004,"5min":0.754,"15min":0.754},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.54400000000000004,"15min":0.55400000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.67300000000000004,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.504}]},{"osd":6,"last update":"Fri Oct 8 19:23:00 2021","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53400000000000003,"15min":0.53700000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.64300000000000002,"15min":0.66300000000000003},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.77000000000000002,"5min":2.5219999999999998,"15min":2.5219999999999998},"last":0.59599999999999997}]},{"osd":7,"last update":"Fri Oct 8 19:23:23 2021","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.56200000000000006,"15min":0.56599999999999995},"min":{"1min":0.38900000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.73699999999999999,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.56299999999999994,"15min":0.57099999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.68300000000000005,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.47799999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738429,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":432508,"kb_used_data":415028,"kb_used_omap":0,"kb_used_meta":17472,"kb_avail":93312644,"statfs":{"total":95995035648,"available":95552147456,"internally_reserved":0,"allocated":424988672,"data_stored":424579176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17891328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 8 19:23:33 2021","interfaces":[{"interface":"back","average":{"1min":0.28100000000000003,"5min":0.32100000000000001,"15min":0.32500000000000001},"min":{"1min":0.221,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.42799999999999999,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":2.3370000000000002},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.378,"15min":0.37},"min":{"1min":0.23300000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.52000000000000002,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":1.302}]},{"osd":2,"last update":"Fri Oct 8 19:23:56 2021","interfaces":[{"interface":"back","average":{"1min":3.0680000000000001,"5min":0.92300000000000004,"15min":0.57199999999999995},"min":{"1min":0.23400000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":62.390000000000001,"5min":62.390000000000001,"15min":62.390000000000001},"last":1.2809999999999999},{"interface":"front","average":{"1min":3.1549999999999998,"5min":0.93899999999999995,"15min":0.57999999999999996},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":62.718000000000004,"5min":62.718000000000004,"15min":62.718000000000004},"last":2.9060000000000001}]},{"osd":3,"last update":"Fri Oct 8 19:23:05 2021","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.45200000000000001,"15min":0.48299999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.56599999999999995,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":2.1230000000000002},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.42799999999999999,"15min":0.45200000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.53500000000000003,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":2.8639999999999999}]},{"osd":4,"last update":"Fri Oct 8 19:23:26 2021","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.53600000000000003,"15min":0.54200000000000004},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.82799999999999996,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":2.246},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.56299999999999994,"15min":0.57599999999999996},"min":{"1min":0.36799999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.874}]},{"osd":5,"last update":"Fri Oct 8 19:23:43 2021","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54400000000000004,"15min":0.55000000000000004},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":3.681},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55500000000000005,"15min":0.56499999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73899999999999999,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":2.3119999999999998}]},{"osd":6,"last update":"Fri Oct 8 19:22:59 2021","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.58099999999999996,"15min":0.57899999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":3.5910000000000002}]},{"osd":7,"last update":"Fri Oct 8 19:23:16 2021","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":2.282},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57699999999999996,"15min":0.57499999999999996},"min":{"1min":0.40799999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":1.1930000000000001}]}]},{"osd":2,"up_from":18,"seq":77309411381,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":403168,"kb_used_data":386264,"kb_used_omap":0,"kb_used_meta":16896,"kb_avail":93341984,"statfs":{"total":95995035648,"available":95582191616,"internally_reserved":0,"allocated":395534336,"data_stored":395152476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17301504},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:23:47 2021","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.34000000000000002,"15min":0.34399999999999997},"min":{"1min":0.22900000000000001,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":1.9710000000000001},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.36699999999999999,"15min":0.35999999999999999},"min":{"1min":0.24099999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":1.288}]},{"osd":1,"last update":"Fri Oct 8 19:23:47 2021","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.40400000000000003,"15min":0.377},"min":{"1min":0.253,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":4.9260000000000002,"5min":4.9260000000000002,"15min":4.9260000000000002},"last":1.625},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.40600000000000003,"15min":0.39600000000000002},"min":{"1min":0.27400000000000002,"5min":0.218,"15min":0.218},"max":{"1min":0.83899999999999997,"5min":2.2890000000000001,"15min":2.2890000000000001},"last":0.23599999999999999}]},{"osd":3,"last update":"Fri Oct 8 19:23:05 2021","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.41999999999999998,"15min":0.442},"min":{"1min":0.26800000000000002,"5min":0.218,"15min":0.218},"max":{"1min":0.50700000000000001,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.40300000000000002,"15min":0.41499999999999998},"min":{"1min":0.248,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.45600000000000002,"5min":0.625,"15min":0.625},"last":0.755}]},{"osd":4,"last update":"Fri Oct 8 19:23:21 2021","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.52900000000000003,"15min":0.54600000000000004},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.65400000000000003,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56299999999999994,"15min":0.57399999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.70699999999999996,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.83499999999999996}]},{"osd":5,"last update":"Fri Oct 8 19:23:45 2021","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.55700000000000005,"15min":0.57199999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57499999999999996,"15min":0.58299999999999996},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.76,"5min":1.76,"15min":1.76},"last":0.42999999999999999}]},{"osd":6,"last update":"Fri Oct 8 19:23:05 2021","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.55800000000000005,"15min":0.56499999999999995},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.74099999999999999,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.57899999999999996,"15min":0.58699999999999997},"min":{"1min":0.41699999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.66300000000000003,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.47599999999999998}]},{"osd":7,"last update":"Fri Oct 8 19:23:21 2021","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.55600000000000005,"15min":0.56399999999999995},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.71799999999999997,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.59099999999999997,"15min":0.59999999999999998},"min":{"1min":0.433,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.66200000000000003,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.45500000000000002}]}]},{"osd":3,"up_from":24,"seq":103079215155,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":541376,"kb_used_data":522872,"kb_used_omap":0,"kb_used_meta":18624,"kb_avail":93203776,"statfs":{"total":95995035648,"available":95440666624,"internally_reserved":0,"allocated":535420928,"data_stored":535006642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19070976},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:23:07 2021","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.34899999999999998,"15min":0.35099999999999998},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.61399999999999999,"5min":1.002,"15min":1.002},"last":3.6819999999999999},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.38200000000000001,"15min":0.39700000000000002},"min":{"1min":0.23000000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":1.5960000000000001}]},{"osd":1,"last update":"Fri Oct 8 19:23:07 2021","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.39000000000000001,"15min":0.40400000000000003},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.373},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.39100000000000001,"15min":0.40699999999999997},"min":{"1min":0.219,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":1.161}]},{"osd":2,"last update":"Fri Oct 8 19:23:07 2021","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.41599999999999998,"15min":0.433},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":2.319},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.42599999999999999,"15min":0.42799999999999999},"min":{"1min":0.27000000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.94199999999999995,"5min":1.026,"15min":1.026},"last":0.95399999999999996}]},{"osd":4,"last update":"Fri Oct 8 19:23:25 2021","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.55600000000000005,"15min":0.57599999999999996},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.56699999999999995,"5min":2.0590000000000002,"15min":2.0590000000000002},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.69599999999999995,"15min":0.77200000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.65200000000000002,"5min":3.4670000000000001,"15min":3.4670000000000001},"last":0.40699999999999997}]},{"osd":5,"last update":"Fri Oct 8 19:23:41 2021","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.58399999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":2.6739999999999999,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":1.1100000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.63900000000000001,"15min":0.69699999999999995},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.60799999999999998,"5min":3.4020000000000001,"15min":3.4020000000000001},"last":0.92900000000000005}]},{"osd":6,"last update":"Fri Oct 8 19:23:02 2021","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":1.5189999999999999,"15min":1.681},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.72899999999999998,"5min":21.538,"15min":21.538},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.55400000000000005,"15min":0.56200000000000006},"min":{"1min":0.377,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.69999999999999996,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":1.137}]},{"osd":7,"last update":"Fri Oct 8 19:23:19 2021","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.58999999999999997,"15min":0.59999999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.66500000000000004,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.59999999999999998,"15min":0.61499999999999999},"min":{"1min":0.39900000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.71599999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":1.0760000000000001}]}]},{"osd":4,"up_from":30,"seq":128849018927,"num_pgs":61,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":263036,"kb_used_data":252788,"kb_used_omap":0,"kb_used_meta":10240,"kb_avail":93482116,"statfs":{"total":95995035648,"available":95725686784,"internally_reserved":0,"allocated":258854912,"data_stored":258445524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":10485760},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:23:23 2021","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.498,"15min":0.51800000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.68000000000000005,"5min":0.755,"15min":0.755},"last":2.726},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.50700000000000001,"15min":0.51900000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.59999999999999998,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.215}]},{"osd":1,"last update":"Fri Oct 8 19:23:23 2021","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.497,"15min":0.51300000000000001},"min":{"1min":0.33200000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.68500000000000005,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.48099999999999998,"15min":0.499},"min":{"1min":0.26600000000000001,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.624,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.66800000000000004}]},{"osd":2,"last update":"Fri Oct 8 19:23:23 2021","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.49199999999999999,"15min":0.51000000000000001},"min":{"1min":0.31900000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.65700000000000003,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.51400000000000001,"15min":0.53000000000000003},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.58799999999999997,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.82899999999999996}]},{"osd":3,"last update":"Fri Oct 8 19:23:23 2021","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.499,"15min":0.51500000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.59599999999999997,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.51300000000000001,"15min":0.52400000000000002},"min":{"1min":0.36099999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.71499999999999997,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.38200000000000001}]},{"osd":5,"last update":"Fri Oct 8 19:23:46 2021","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39000000000000001,"15min":0.379},"min":{"1min":0.25900000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.49199999999999999,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.44,"5min":0.40500000000000003,"15min":0.39100000000000001},"min":{"1min":0.29299999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.32200000000000001}]},{"osd":6,"last update":"Fri Oct 8 19:23:00 2021","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.41199999999999998,"15min":0.40500000000000003},"min":{"1min":0.27900000000000003,"5min":0.252,"15min":0.252},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.42899999999999999,"15min":0.42299999999999999},"min":{"1min":0.30499999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.35699999999999998}]},{"osd":7,"last update":"Fri Oct 8 19:23:18 2021","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.47999999999999998,"15min":0.48199999999999998},"min":{"1min":0.33100000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.64500000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.49399999999999999,"15min":0.49199999999999999},"min":{"1min":0.35499999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.66800000000000004,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.34899999999999998}]}]},{"osd":5,"up_from":38,"seq":163208757289,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":233704,"kb_used_data":212064,"kb_used_omap":0,"kb_used_meta":21632,"kb_avail":93511448,"statfs":{"total":95995035648,"available":95755722752,"internally_reserved":0,"allocated":217153536,"data_stored":216763805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22151168},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:23:44 2021","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.69199999999999995,"15min":0.54400000000000004},"min":{"1min":0.32800000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.58199999999999996,"5min":22.966999999999999,"15min":22.966999999999999},"last":0.312},{"interface":"front","average":{"1min":0.435,"5min":0.45600000000000002,"15min":0.46400000000000002},"min":{"1min":0.26300000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.60499999999999998,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.47799999999999998}]},{"osd":1,"last update":"Fri Oct 8 19:23:44 2021","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.47399999999999998,"15min":0.49199999999999999},"min":{"1min":0.33500000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.64500000000000002,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.432,"5min":0.48299999999999998,"15min":0.501},"min":{"1min":0.308,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.53300000000000003,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.35199999999999998}]},{"osd":2,"last update":"Fri Oct 8 19:23:44 2021","interfaces":[{"interface":"back","average":{"1min":1.577,"5min":0.68100000000000005,"15min":0.53700000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":23.515000000000001,"5min":23.515000000000001,"15min":23.515000000000001},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.70899999999999996,"15min":0.56899999999999995},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.55600000000000005,"5min":23.073,"15min":23.073},"last":0.32600000000000001}]},{"osd":3,"last update":"Fri Oct 8 19:23:44 2021","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.47099999999999997,"15min":0.48299999999999998},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.66900000000000004,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":1.536},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.47699999999999998,"15min":0.48799999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.67000000000000004,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.433}]},{"osd":4,"last update":"Fri Oct 8 19:23:44 2021","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.29599999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.61499999999999999,"5min":0.626,"15min":0.626},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.44900000000000001,"15min":0.435},"min":{"1min":0.32300000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.45300000000000001}]},{"osd":6,"last update":"Fri Oct 8 19:22:58 2021","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.35599999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.495,"15min":0.497},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.60899999999999999,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.48699999999999999}]},{"osd":7,"last update":"Fri Oct 8 19:23:17 2021","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.5,"15min":0.504},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.55800000000000005,"15min":0.56999999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.64100000000000001,"5min":1.653,"15min":1.653},"last":0.57499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":2008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":2118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":437059584,"data_stored":437059584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":435421184,"data_stored":435421184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":440205312,"data_stored":440205312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":538181632,"data_stored":538181632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":273154048,"data_stored":273154048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":216662016,"data_stored":216662016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":276234240,"data_stored":276234240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-10-08T19:24:01.425 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2021-10-08T19:24:01.425 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd pool set iscsi pg_num 13 2021-10-08T19:24:01.558 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:24:01.560 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:01.561 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:24:01.663 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:24:01.690 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:01.846 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:24:01.848 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:01.849 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:24:01.950 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:24:01.976 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:01 smithi117 ceph-mon[34585]: pgmap v98: 148 pgs: 148 active+clean; 832 MiB data, 2.4 GiB used, 623 GiB / 626 GiB avail; 1023 B/s rd, 83 MiB/s wr, 1.33k op/s 2021-10-08T19:24:01.978 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:02.039 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:24:02.042 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:02.043 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:24:02.144 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:24:02.174 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:02.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:01 smithi097 ceph-mon[32687]: pgmap v98: 148 pgs: 148 active+clean; 832 MiB data, 2.4 GiB used, 623 GiB / 626 GiB avail; 1023 B/s rd, 83 MiB/s wr, 1.33k op/s 2021-10-08T19:24:02.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:01 smithi097 ceph-mon[41966]: pgmap v98: 148 pgs: 148 active+clean; 832 MiB data, 2.4 GiB used, 623 GiB / 626 GiB avail; 1023 B/s rd, 83 MiB/s wr, 1.33k op/s 2021-10-08T19:24:02.231 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 9 16 20549 20533 142.542 117.625 0.0084165 0.00700886 2021-10-08T19:24:02.234 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:24:02.236 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:02.237 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:24:02.339 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:24:02.354 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:24:02.395 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:24:02.404 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:02.458 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:24:02.556 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:24:02.563 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:02.564 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:24:02.652 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:24:02 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:24:02] "GET /metrics HTTP/1.1" 200 155000 "" "Prometheus/2.18.1" 2021-10-08T19:24:02.666 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:24:02.714 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:02.930 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:24:02.935 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:02.936 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:24:03.037 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:24:03.068 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:03.115 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:24:03.117 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:03.118 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:24:03.219 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:24:03.238 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 10 16 22058 22042 137.674 94.3125 0.019988 0.00725704 2021-10-08T19:24:03.245 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:03.298 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:24:03.300 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:03.302 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:24:03.403 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:24:03.429 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:03.537 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:24:03.541 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:03.542 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:24:03.644 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:24:03.669 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:03.726 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:24:03.729 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:03.730 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:24:03.831 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:24:03.898 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:03.955 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is unset 2021-10-08T19:24:04.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:24:03 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:24:03] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:24:04.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:03 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:24:04.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:03 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:24:04.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:03 smithi117 ceph-mon[34585]: pgmap v99: 148 pgs: 148 active+clean; 832 MiB data, 2.4 GiB used, 623 GiB / 626 GiB avail; 881 B/s rd, 72 MiB/s wr, 1.15k op/s 2021-10-08T19:24:04.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:03 smithi117 ceph-mon[34585]: osdmap e100: 8 total, 8 up, 7 in 2021-10-08T19:24:04.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:03 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2435240552' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:24:04.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:03 smithi117 ceph-mon[34585]: from='client.24808 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:24:04.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:03 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:24:04.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:03 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:24:04.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:03 smithi097 ceph-mon[41966]: pgmap v99: 148 pgs: 148 active+clean; 832 MiB data, 2.4 GiB used, 623 GiB / 626 GiB avail; 881 B/s rd, 72 MiB/s wr, 1.15k op/s 2021-10-08T19:24:04.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:03 smithi097 ceph-mon[41966]: osdmap e100: 8 total, 8 up, 7 in 2021-10-08T19:24:04.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:03 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2435240552' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:24:04.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:03 smithi097 ceph-mon[41966]: from='client.24808 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:24:04.223 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:24:04 smithi097 conmon[33110]: 172.21.15.117 - - [08/Oct/2021:19:24:04] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:24:04.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:03 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:24:04.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:03 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:24:04.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:03 smithi097 ceph-mon[32687]: pgmap v99: 148 pgs: 148 active+clean; 832 MiB data, 2.4 GiB used, 623 GiB / 626 GiB avail; 881 B/s rd, 72 MiB/s wr, 1.15k op/s 2021-10-08T19:24:04.225 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:03 smithi097 ceph-mon[32687]: osdmap e100: 8 total, 8 up, 7 in 2021-10-08T19:24:04.225 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:03 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2435240552' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:24:04.225 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:03 smithi097 ceph-mon[32687]: from='client.24808 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:24:04.234 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 11 16 23660 23644 134.261 100.125 0.00791224 0.00744058 2021-10-08T19:24:05.183 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:24:05.186 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:05.187 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:24:05.188 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:04 smithi097 ceph-mon[32687]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:24:05.189 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:04 smithi097 ceph-mon[32687]: from='client.24808 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:24:05.189 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:04 smithi097 ceph-mon[32687]: osdmap e101: 8 total, 8 up, 7 in 2021-10-08T19:24:05.190 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:04 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:24:05.190 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:04 smithi097 ceph-mon[32687]: 5.3 scrub ok 2021-10-08T19:24:05.191 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:04 smithi097 ceph-mon[32687]: 4.15 scrub ok 2021-10-08T19:24:05.192 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:04 smithi097 ceph-mon[41966]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:24:05.192 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:04 smithi097 ceph-mon[41966]: from='client.24808 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:24:05.193 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:04 smithi097 ceph-mon[41966]: osdmap e101: 8 total, 8 up, 7 in 2021-10-08T19:24:05.193 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:04 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:24:05.194 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:04 smithi097 ceph-mon[41966]: 5.3 scrub ok 2021-10-08T19:24:05.194 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:04 smithi097 ceph-mon[41966]: 4.15 scrub ok 2021-10-08T19:24:05.235 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 12 16 25644 25628 133.405 124 0.00788274 0.00748947 2021-10-08T19:24:05.289 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:24:05.334 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:05.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:04 smithi117 ceph-mon[34585]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:24:05.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:04 smithi117 ceph-mon[34585]: from='client.24808 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:24:05.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:04 smithi117 ceph-mon[34585]: osdmap e101: 8 total, 8 up, 7 in 2021-10-08T19:24:05.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:04 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:24:05.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:04 smithi117 ceph-mon[34585]: 5.3 scrub ok 2021-10-08T19:24:05.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:04 smithi117 ceph-mon[34585]: 4.15 scrub ok 2021-10-08T19:24:06.186 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:05 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:24:06.186 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:05 smithi117 ceph-mon[34585]: 172.21.15.117 - - [08/Oct/2021:19:24:04] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:24:06.186 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:05 smithi117 ceph-mon[34585]: 4.13 scrub ok 2021-10-08T19:24:06.187 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:05 smithi117 ceph-mon[34585]: pgmap v102: 148 pgs: 148 active+clean; 1.4 GiB data, 4.1 GiB used, 622 GiB / 626 GiB avail; 1.2 KiB/s rd, 170 MiB/s wr, 2.73k op/s 2021-10-08T19:24:06.187 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:05 smithi117 ceph-mon[34585]: 2.0 scrub ok 2021-10-08T19:24:06.187 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:05 smithi117 ceph-mon[34585]: osdmap e102: 8 total, 8 up, 7 in 2021-10-08T19:24:06.219 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:05 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:24:06.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:05 smithi097 ceph-mon[41966]: 172.21.15.117 - - [08/Oct/2021:19:24:04] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:24:06.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:05 smithi097 ceph-mon[41966]: 4.13 scrub ok 2021-10-08T19:24:06.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:05 smithi097 ceph-mon[41966]: pgmap v102: 148 pgs: 148 active+clean; 1.4 GiB data, 4.1 GiB used, 622 GiB / 626 GiB avail; 1.2 KiB/s rd, 170 MiB/s wr, 2.73k op/s 2021-10-08T19:24:06.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:05 smithi097 ceph-mon[41966]: 2.0 scrub ok 2021-10-08T19:24:06.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:05 smithi097 ceph-mon[41966]: osdmap e102: 8 total, 8 up, 7 in 2021-10-08T19:24:06.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:05 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:24:06.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:05 smithi097 ceph-mon[32687]: 172.21.15.117 - - [08/Oct/2021:19:24:04] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:24:06.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:05 smithi097 ceph-mon[32687]: 4.13 scrub ok 2021-10-08T19:24:06.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:05 smithi097 ceph-mon[32687]: pgmap v102: 148 pgs: 148 active+clean; 1.4 GiB data, 4.1 GiB used, 622 GiB / 626 GiB avail; 1.2 KiB/s rd, 170 MiB/s wr, 2.73k op/s 2021-10-08T19:24:06.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:05 smithi097 ceph-mon[32687]: 2.0 scrub ok 2021-10-08T19:24:06.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:05 smithi097 ceph-mon[32687]: osdmap e102: 8 total, 8 up, 7 in 2021-10-08T19:24:06.243 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 13 16 27216 27200 130.664 98.25 0.0150962 0.00764755 2021-10-08T19:24:06.344 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:24:06.348 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:06.349 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:24:06.450 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:24:06.471 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:24:06 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:24:06.474 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:06.517 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:24:06.518 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:06.519 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:24:06.620 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:24:06.666 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:06.916 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:06 smithi097 ceph-mon[32687]: 6.14 scrub ok 2021-10-08T19:24:07.179 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:24:07.180 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:06 smithi097 ceph-mon[41966]: 6.14 scrub ok 2021-10-08T19:24:07.185 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:07.186 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:24:07.239 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 14 16 28664 28648 127.795 90.5 0.00482748 0.00781704 2021-10-08T19:24:07.288 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:24:07.312 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:06 smithi117 ceph-mon[34585]: 6.14 scrub ok 2021-10-08T19:24:07.315 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:07.361 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:24:07.363 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:07.364 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:24:07.465 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:24:07.518 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:07.549 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:24:07.597 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:24:07.640 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:24:07.679 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:24:07.718 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:24:07.751 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:24:07.784 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:24:07.787 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:24:07.796 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:07.797 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:24:07.820 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:24:07.840 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true' 2021-10-08T19:24:07.840 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true' 2021-10-08T19:24:07.840 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true' 2021-10-08T19:24:07.840 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true' 2021-10-08T19:24:07.841 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true' 2021-10-08T19:24:07.841 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true' 2021-10-08T19:24:07.841 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'true' 2021-10-08T19:24:07.841 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'true' 2021-10-08T19:24:07.898 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:24:07.923 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:07.973 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:24:07.976 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:07.976 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:24:08.077 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:24:08.102 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:08.145 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:24:08.145 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2021-10-08T19:24:08.146 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2021-10-08T19:24:08.146 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2021-10-08T19:24:08.146 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:24:08.151 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:24:08.153 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:08.154 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:24:08.166 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:07 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:24:08.167 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:07 smithi097 ceph-mon[41966]: pgmap v104: 148 pgs: 148 active+clean; 1.4 GiB data, 4.1 GiB used, 622 GiB / 626 GiB avail; 853 B/s rd, 94 MiB/s wr, 1.50k op/s 2021-10-08T19:24:08.167 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:07 smithi097 ceph-mon[41966]: 2.1d scrub ok 2021-10-08T19:24:08.167 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:07 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:24:08.167 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:07 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:24:08.168 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:07 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2727460189' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:24:08.168 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:07 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:24:08.168 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:07 smithi097 ceph-mon[32687]: pgmap v104: 148 pgs: 148 active+clean; 1.4 GiB data, 4.1 GiB used, 622 GiB / 626 GiB avail; 853 B/s rd, 94 MiB/s wr, 1.50k op/s 2021-10-08T19:24:08.169 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:07 smithi097 ceph-mon[32687]: 2.1d scrub ok 2021-10-08T19:24:08.169 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:07 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:24:08.169 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:07 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:24:08.169 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:07 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2727460189' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:24:08.239 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 15 16 30021 30005 124.931 84.8125 0.0059643 0.00799906 2021-10-08T19:24:08.255 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:24:08.288 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:08.394 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:24:08.398 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:08.399 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:24:08.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:07 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:24:08.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:07 smithi117 ceph-mon[34585]: pgmap v104: 148 pgs: 148 active+clean; 1.4 GiB data, 4.1 GiB used, 622 GiB / 626 GiB avail; 853 B/s rd, 94 MiB/s wr, 1.50k op/s 2021-10-08T19:24:08.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:07 smithi117 ceph-mon[34585]: 2.1d scrub ok 2021-10-08T19:24:08.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:07 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:24:08.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:07 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:24:08.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:07 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2727460189' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:24:08.501 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:24:08.525 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:08.575 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:24:08.578 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:08.579 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:24:08.681 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:24:08.727 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:08.965 INFO:teuthology.orchestra.run.smithi097.stderr:set pool 3 pg_num to 13 2021-10-08T19:24:08.989 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:08 smithi097 ceph-mon[32687]: 5.1f scrub ok 2021-10-08T19:24:08.989 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:08 smithi097 ceph-mon[32687]: 2.9 scrub ok 2021-10-08T19:24:08.989 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:08 smithi097 ceph-mon[32687]: 2.e scrub ok 2021-10-08T19:24:08.989 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:08 smithi097 ceph-mon[32687]: osdmap e103: 8 total, 8 up, 7 in 2021-10-08T19:24:08.990 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:08 smithi097 ceph-mon[32687]: 4.3 scrub ok 2021-10-08T19:24:08.990 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:08 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/412395798' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "iscsi", "var": "pg_num", "val": "13"}]: dispatch 2021-10-08T19:24:08.990 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:08 smithi097 ceph-mon[32687]: from='client.24817 ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "iscsi", "var": "pg_num", "val": "13"}]: dispatch 2021-10-08T19:24:08.991 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:08 smithi097 ceph-mon[32687]: pgmap v106: 148 pgs: 148 active+clean; 1.8 GiB data, 5.6 GiB used, 620 GiB / 626 GiB avail; 1.8 KiB/s rd, 191 MiB/s wr, 3.06k op/s 2021-10-08T19:24:08.991 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:08 smithi097 ceph-mon[41966]: 5.1f scrub ok 2021-10-08T19:24:08.992 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:08 smithi097 ceph-mon[41966]: 2.9 scrub ok 2021-10-08T19:24:08.992 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:08 smithi097 ceph-mon[41966]: 2.e scrub ok 2021-10-08T19:24:08.992 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:08 smithi097 ceph-mon[41966]: osdmap e103: 8 total, 8 up, 7 in 2021-10-08T19:24:08.992 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:08 smithi097 ceph-mon[41966]: 4.3 scrub ok 2021-10-08T19:24:08.993 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:08 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/412395798' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "iscsi", "var": "pg_num", "val": "13"}]: dispatch 2021-10-08T19:24:08.993 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:08 smithi097 ceph-mon[41966]: from='client.24817 ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "iscsi", "var": "pg_num", "val": "13"}]: dispatch 2021-10-08T19:24:08.993 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:08 smithi097 ceph-mon[41966]: pgmap v106: 148 pgs: 148 active+clean; 1.8 GiB data, 5.6 GiB used, 620 GiB / 626 GiB avail; 1.8 KiB/s rd, 191 MiB/s wr, 3.06k op/s 2021-10-08T19:24:08.995 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset nodeep-scrub 2021-10-08T19:24:09.239 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 16 16 31463 31447 122.756 90.125 0.0105944 0.0081398 2021-10-08T19:24:09.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:08 smithi117 ceph-mon[34585]: 5.1f scrub ok 2021-10-08T19:24:09.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:08 smithi117 ceph-mon[34585]: 2.9 scrub ok 2021-10-08T19:24:09.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:08 smithi117 ceph-mon[34585]: 2.e scrub ok 2021-10-08T19:24:09.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:08 smithi117 ceph-mon[34585]: osdmap e103: 8 total, 8 up, 7 in 2021-10-08T19:24:09.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:08 smithi117 ceph-mon[34585]: 4.3 scrub ok 2021-10-08T19:24:09.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:08 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/412395798' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "iscsi", "var": "pg_num", "val": "13"}]: dispatch 2021-10-08T19:24:09.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:08 smithi117 ceph-mon[34585]: from='client.24817 ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "iscsi", "var": "pg_num", "val": "13"}]: dispatch 2021-10-08T19:24:09.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:08 smithi117 ceph-mon[34585]: pgmap v106: 148 pgs: 148 active+clean; 1.8 GiB data, 5.6 GiB used, 620 GiB / 626 GiB avail; 1.8 KiB/s rd, 191 MiB/s wr, 3.06k op/s 2021-10-08T19:24:09.472 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:24:09.479 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:09.480 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:24:09.581 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:24:09.632 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:09.948 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:09 smithi097 ceph-mon[32687]: 4.7 scrub ok 2021-10-08T19:24:09.948 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:09 smithi097 ceph-mon[32687]: from='client.24817 ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "iscsi", "var": "pg_num", "val": "13"}]': finished 2021-10-08T19:24:09.948 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:09 smithi097 ceph-mon[32687]: osdmap e104: 8 total, 8 up, 7 in 2021-10-08T19:24:09.948 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:09 smithi097 ceph-mon[32687]: 3.1 scrub ok 2021-10-08T19:24:10.163 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:24:10.178 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:10.179 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:24:10.219 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:09 smithi097 ceph-mon[41966]: 4.7 scrub ok 2021-10-08T19:24:10.219 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:09 smithi097 ceph-mon[41966]: from='client.24817 ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "iscsi", "var": "pg_num", "val": "13"}]': finished 2021-10-08T19:24:10.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:09 smithi097 ceph-mon[41966]: osdmap e104: 8 total, 8 up, 7 in 2021-10-08T19:24:10.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:09 smithi097 ceph-mon[41966]: 3.1 scrub ok 2021-10-08T19:24:10.239 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 17 15 32922 32907 120.904 91.25 0.0103094 0.00826505 2021-10-08T19:24:10.279 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:24:10.304 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:09 smithi117 ceph-mon[34585]: 4.7 scrub ok 2021-10-08T19:24:10.304 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:09 smithi117 ceph-mon[34585]: from='client.24817 ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "iscsi", "var": "pg_num", "val": "13"}]': finished 2021-10-08T19:24:10.304 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:09 smithi117 ceph-mon[34585]: osdmap e104: 8 total, 8 up, 7 in 2021-10-08T19:24:10.305 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:09 smithi117 ceph-mon[34585]: 3.1 scrub ok 2021-10-08T19:24:10.306 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:10.356 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:24:10.358 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:10.358 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:24:10.460 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:24:10.506 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:10.605 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:24:10.612 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:10.613 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:24:10.715 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:24:10.770 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:10.842 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:24:10.889 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2021-10-08T19:24:10.965 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:24:10.972 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:10.974 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:24:11.065 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:10 smithi097 ceph-mon[41966]: 5.d scrub ok 2021-10-08T19:24:11.066 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:10 smithi097 ceph-mon[41966]: 5.15 scrub ok 2021-10-08T19:24:11.066 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:10 smithi097 ceph-mon[41966]: osdmap e105: 8 total, 8 up, 7 in 2021-10-08T19:24:11.066 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:10 smithi097 ceph-mon[41966]: pgmap v109: 148 pgs: 148 active+clean; 1.8 GiB data, 5.6 GiB used, 620 GiB / 626 GiB avail; 1020 B/s rd, 99 MiB/s wr, 1.59k op/s 2021-10-08T19:24:11.066 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:10 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "iscsi", "var": "pg_num_actual", "val": "13"}]: dispatch 2021-10-08T19:24:11.067 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:10 smithi097 ceph-mon[32687]: 5.d scrub ok 2021-10-08T19:24:11.067 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:10 smithi097 ceph-mon[32687]: 5.15 scrub ok 2021-10-08T19:24:11.067 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:10 smithi097 ceph-mon[32687]: osdmap e105: 8 total, 8 up, 7 in 2021-10-08T19:24:11.068 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:10 smithi097 ceph-mon[32687]: pgmap v109: 148 pgs: 148 active+clean; 1.8 GiB data, 5.6 GiB used, 620 GiB / 626 GiB avail; 1020 B/s rd, 99 MiB/s wr, 1.59k op/s 2021-10-08T19:24:11.068 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:10 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "iscsi", "var": "pg_num_actual", "val": "13"}]: dispatch 2021-10-08T19:24:11.076 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:24:11.099 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:11.149 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:24:11.152 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:11.152 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:24:11.239 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 18 16 34299 34283 118.965 86 0.006739 0.00839776 2021-10-08T19:24:11.254 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:24:11.277 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:10 smithi117 ceph-mon[34585]: 5.d scrub ok 2021-10-08T19:24:11.277 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:10 smithi117 ceph-mon[34585]: 5.15 scrub ok 2021-10-08T19:24:11.277 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:10 smithi117 ceph-mon[34585]: osdmap e105: 8 total, 8 up, 7 in 2021-10-08T19:24:11.278 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:10 smithi117 ceph-mon[34585]: pgmap v109: 148 pgs: 148 active+clean; 1.8 GiB data, 5.6 GiB used, 620 GiB / 626 GiB avail; 1020 B/s rd, 99 MiB/s wr, 1.59k op/s 2021-10-08T19:24:11.278 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:10 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "iscsi", "var": "pg_num_actual", "val": "13"}]: dispatch 2021-10-08T19:24:11.279 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:11.325 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:24:11.327 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:11.328 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:24:11.429 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:24:11.453 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:11.505 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:24:11.507 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:11.507 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:24:11.609 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:24:11.671 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:11.957 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:11 smithi097 ceph-mon[32687]: 4.1 scrub ok 2021-10-08T19:24:11.957 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:11 smithi097 ceph-mon[32687]: 6.d scrub ok 2021-10-08T19:24:11.958 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:11 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "iscsi", "var": "pg_num_actual", "val": "13"}]': finished 2021-10-08T19:24:11.958 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:11 smithi097 ceph-mon[32687]: osdmap e106: 8 total, 8 up, 7 in 2021-10-08T19:24:12.135 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2021-10-08T19:24:12.198 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:24:12.206 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:12.207 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:24:12.226 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:11 smithi097 ceph-mon[41966]: 4.1 scrub ok 2021-10-08T19:24:12.226 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:11 smithi097 ceph-mon[41966]: 6.d scrub ok 2021-10-08T19:24:12.227 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:11 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "iscsi", "var": "pg_num_actual", "val": "13"}]': finished 2021-10-08T19:24:12.227 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:11 smithi097 ceph-mon[41966]: osdmap e106: 8 total, 8 up, 7 in 2021-10-08T19:24:12.239 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 19 16 35679 35663 117.244 86.25 0.0106249 0.00852236 2021-10-08T19:24:12.308 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:24:12.329 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:11 smithi117 ceph-mon[34585]: 4.1 scrub ok 2021-10-08T19:24:12.329 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:11 smithi117 ceph-mon[34585]: 6.d scrub ok 2021-10-08T19:24:12.329 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:11 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "iscsi", "var": "pg_num_actual", "val": "13"}]': finished 2021-10-08T19:24:12.330 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:11 smithi117 ceph-mon[34585]: osdmap e106: 8 total, 8 up, 7 in 2021-10-08T19:24:12.331 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:12.372 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:24:12.374 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:12.375 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:24:12.476 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:24:12.503 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:12.556 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:24:12.558 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:12.559 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:24:12.660 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:24:12.685 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:12.737 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:24:12.739 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:12.740 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:24:12.841 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:24:12.897 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:12.971 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:24:12 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:24:12] "GET /metrics HTTP/1.1" 200 155297 "" "Prometheus/2.18.1" 2021-10-08T19:24:12.986 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:12 smithi117 ceph-mon[34585]: 2.4 scrub ok 2021-10-08T19:24:12.987 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:12 smithi117 ceph-mon[34585]: 2.19 scrub ok 2021-10-08T19:24:12.987 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:12 smithi117 ceph-mon[34585]: pgmap v111: 158 pgs: 10 unknown, 148 active+clean; 1.8 GiB data, 5.6 GiB used, 620 GiB / 626 GiB avail; 1.1 KiB/s rd, 110 MiB/s wr, 1.76k op/s 2021-10-08T19:24:12.987 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:12 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "iscsi", "var": "pgp_num_actual", "val": "13"}]: dispatch 2021-10-08T19:24:12.987 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:12 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "iscsi", "var": "pgp_num_actual", "val": "13"}]': finished 2021-10-08T19:24:12.988 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:12 smithi117 ceph-mon[34585]: osdmap e107: 8 total, 8 up, 7 in 2021-10-08T19:24:13.040 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:24:13.044 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:13.045 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:24:13.146 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:24:13.196 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:13.240 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:2021-10-08T19:24:13.240088+0000 min lat: 0.00115885 max lat: 0.155857 avg lat: 0.00866185 2021-10-08T19:24:13.241 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2021-10-08T19:24:13.241 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 20 16 36955 36939 115.369 79.75 0.0089415 0.00866185 2021-10-08T19:24:13.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:12 smithi097 ceph-mon[32687]: 2.4 scrub ok 2021-10-08T19:24:13.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:12 smithi097 ceph-mon[32687]: 2.19 scrub ok 2021-10-08T19:24:13.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:12 smithi097 ceph-mon[32687]: pgmap v111: 158 pgs: 10 unknown, 148 active+clean; 1.8 GiB data, 5.6 GiB used, 620 GiB / 626 GiB avail; 1.1 KiB/s rd, 110 MiB/s wr, 1.76k op/s 2021-10-08T19:24:13.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:12 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "iscsi", "var": "pgp_num_actual", "val": "13"}]: dispatch 2021-10-08T19:24:13.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:12 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "iscsi", "var": "pgp_num_actual", "val": "13"}]': finished 2021-10-08T19:24:13.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:12 smithi097 ceph-mon[32687]: osdmap e107: 8 total, 8 up, 7 in 2021-10-08T19:24:13.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:12 smithi097 ceph-mon[41966]: 2.4 scrub ok 2021-10-08T19:24:13.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:12 smithi097 ceph-mon[41966]: 2.19 scrub ok 2021-10-08T19:24:13.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:12 smithi097 ceph-mon[41966]: pgmap v111: 158 pgs: 10 unknown, 148 active+clean; 1.8 GiB data, 5.6 GiB used, 620 GiB / 626 GiB avail; 1.1 KiB/s rd, 110 MiB/s wr, 1.76k op/s 2021-10-08T19:24:13.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:12 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "iscsi", "var": "pgp_num_actual", "val": "13"}]: dispatch 2021-10-08T19:24:13.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:12 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "iscsi", "var": "pgp_num_actual", "val": "13"}]': finished 2021-10-08T19:24:13.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:12 smithi097 ceph-mon[41966]: osdmap e107: 8 total, 8 up, 7 in 2021-10-08T19:24:13.613 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:24:13.617 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:13.617 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:24:13.719 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:24:13.746 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:13.752 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:24:13.753 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:24:13.792 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:24:13.795 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:13.796 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:24:13.897 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:24:13.950 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:14.101 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:24:14.106 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:14.107 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:24:14.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:24:13 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:24:13] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:24:14.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:13 smithi117 ceph-mon[34585]: 6.b scrub ok 2021-10-08T19:24:14.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:13 smithi117 ceph-mon[34585]: 5.1e scrub ok 2021-10-08T19:24:14.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:13 smithi117 ceph-mon[34585]: osdmap e108: 8 total, 8 up, 7 in 2021-10-08T19:24:14.208 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:24:14.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:13 smithi097 ceph-mon[41966]: 6.b scrub ok 2021-10-08T19:24:14.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:13 smithi097 ceph-mon[41966]: 5.1e scrub ok 2021-10-08T19:24:14.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:13 smithi097 ceph-mon[41966]: osdmap e108: 8 total, 8 up, 7 in 2021-10-08T19:24:14.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:13 smithi097 ceph-mon[32687]: 6.b scrub ok 2021-10-08T19:24:14.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:13 smithi097 ceph-mon[32687]: 5.1e scrub ok 2021-10-08T19:24:14.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:13 smithi097 ceph-mon[32687]: osdmap e108: 8 total, 8 up, 7 in 2021-10-08T19:24:14.241 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 21 16 38298 38282 113.872 83.9375 0.00913136 0.00877756 2021-10-08T19:24:14.260 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:14.534 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:24:14.540 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:14.541 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:24:14.643 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:24:14.666 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:14.714 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:24:14.715 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:14.717 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:24:14.819 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:24:14.845 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:14.893 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:24:14.895 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:14.895 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:24:14.997 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:24:15.089 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:15.198 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 7] out_osds: [6] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2021-10-08T19:24:15.199 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2021-10-08T19:24:15.199 INFO:tasks.thrashosds.thrasher:Adding osd 6 2021-10-08T19:24:15.199 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd in 6 2021-10-08T19:24:15.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:15 smithi097 ceph-mon[41966]: 5.1c scrub ok 2021-10-08T19:24:15.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:15 smithi097 ceph-mon[41966]: 6.18 scrub ok 2021-10-08T19:24:15.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:15 smithi097 ceph-mon[41966]: pgmap v114: 158 pgs: 10 peering, 148 active+clean; 2.3 GiB data, 6.9 GiB used, 619 GiB / 626 GiB avail; 109 MiB/s wr, 1.74k op/s 2021-10-08T19:24:15.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:15 smithi097 ceph-mon[41966]: 2.8 scrub ok 2021-10-08T19:24:15.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:15 smithi097 ceph-mon[32687]: 5.1c scrub ok 2021-10-08T19:24:15.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:15 smithi097 ceph-mon[32687]: 6.18 scrub ok 2021-10-08T19:24:15.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:15 smithi097 ceph-mon[32687]: pgmap v114: 158 pgs: 10 peering, 148 active+clean; 2.3 GiB data, 6.9 GiB used, 619 GiB / 626 GiB avail; 109 MiB/s wr, 1.74k op/s 2021-10-08T19:24:15.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:15 smithi097 ceph-mon[32687]: 2.8 scrub ok 2021-10-08T19:24:15.240 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 22 16 39298 39282 111.535 62.5 0.0077136 0.0089602 2021-10-08T19:24:15.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:15 smithi117 ceph-mon[34585]: 5.1c scrub ok 2021-10-08T19:24:15.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:15 smithi117 ceph-mon[34585]: 6.18 scrub ok 2021-10-08T19:24:15.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:15 smithi117 ceph-mon[34585]: pgmap v114: 158 pgs: 10 peering, 148 active+clean; 2.3 GiB data, 6.9 GiB used, 619 GiB / 626 GiB avail; 109 MiB/s wr, 1.74k op/s 2021-10-08T19:24:15.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:15 smithi117 ceph-mon[34585]: 2.8 scrub ok 2021-10-08T19:24:15.931 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:24:15.937 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:15.938 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:24:16.017 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is unset 2021-10-08T19:24:16.039 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:24:16.090 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:16.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:16 smithi097 ceph-mon[32687]: 4.19 scrub ok 2021-10-08T19:24:16.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:16 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:24:16.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:16 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:24:16.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:16 smithi097 ceph-mon[32687]: Health check failed: Reduced data availability: 4 pgs inactive, 4 pgs peering (PG_AVAILABILITY) 2021-10-08T19:24:16.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:16 smithi097 ceph-mon[32687]: osdmap e109: 8 total, 8 up, 7 in 2021-10-08T19:24:16.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:16 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/992460880' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:24:16.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:16 smithi097 ceph-mon[32687]: from='client.34811 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:24:16.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:16 smithi097 ceph-mon[32687]: 2.a scrub ok 2021-10-08T19:24:16.225 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:16 smithi097 ceph-mon[32687]: 2.1c scrub ok 2021-10-08T19:24:16.225 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:16 smithi097 ceph-mon[41966]: 4.19 scrub ok 2021-10-08T19:24:16.226 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:16 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:24:16.226 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:16 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:24:16.227 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:16 smithi097 ceph-mon[41966]: Health check failed: Reduced data availability: 4 pgs inactive, 4 pgs peering (PG_AVAILABILITY) 2021-10-08T19:24:16.227 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:16 smithi097 ceph-mon[41966]: osdmap e109: 8 total, 8 up, 7 in 2021-10-08T19:24:16.227 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:16 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/992460880' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:24:16.228 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:16 smithi097 ceph-mon[41966]: from='client.34811 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:24:16.228 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:16 smithi097 ceph-mon[41966]: 2.a scrub ok 2021-10-08T19:24:16.228 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:16 smithi097 ceph-mon[41966]: 2.1c scrub ok 2021-10-08T19:24:16.240 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 23 16 40639 40623 110.33 83.8125 0.00831283 0.00905795 2021-10-08T19:24:16.405 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:24:16 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:24:16.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:16 smithi117 ceph-mon[34585]: 4.19 scrub ok 2021-10-08T19:24:16.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:16 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:24:16.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:16 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:24:16.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:16 smithi117 ceph-mon[34585]: Health check failed: Reduced data availability: 4 pgs inactive, 4 pgs peering (PG_AVAILABILITY) 2021-10-08T19:24:16.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:16 smithi117 ceph-mon[34585]: osdmap e109: 8 total, 8 up, 7 in 2021-10-08T19:24:16.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:16 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/992460880' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:24:16.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:16 smithi117 ceph-mon[34585]: from='client.34811 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:24:16.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:16 smithi117 ceph-mon[34585]: 2.a scrub ok 2021-10-08T19:24:16.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:16 smithi117 ceph-mon[34585]: 2.1c scrub ok 2021-10-08T19:24:17.090 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:24:17.092 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:17.093 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:24:17.194 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:24:17.221 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:17.241 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 24 16 41585 41569 108.197 59.125 0.0128031 0.00923608 2021-10-08T19:24:17.275 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:24:17.276 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:17.277 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:24:17.278 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:17 smithi117 ceph-mon[34585]: 5.1 scrub ok 2021-10-08T19:24:17.278 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:17 smithi117 ceph-mon[34585]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:24:17.278 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:17 smithi117 ceph-mon[34585]: from='client.34811 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:24:17.279 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:17 smithi117 ceph-mon[34585]: osdmap e110: 8 total, 8 up, 7 in 2021-10-08T19:24:17.279 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:17 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:24:17.279 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:17 smithi117 ceph-mon[34585]: 3.c scrub ok 2021-10-08T19:24:17.279 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:17 smithi117 ceph-mon[34585]: pgmap v117: 158 pgs: 10 peering, 148 active+clean; 2.3 GiB data, 6.9 GiB used, 619 GiB / 626 GiB avail; 109 MiB/s wr, 1.75k op/s 2021-10-08T19:24:17.378 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:24:17.404 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:17.458 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:24:17.460 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:17.461 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:24:17.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:17 smithi097 ceph-mon[41966]: 5.1 scrub ok 2021-10-08T19:24:17.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:17 smithi097 ceph-mon[41966]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:24:17.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:17 smithi097 ceph-mon[41966]: from='client.34811 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:24:17.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:17 smithi097 ceph-mon[41966]: osdmap e110: 8 total, 8 up, 7 in 2021-10-08T19:24:17.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:17 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:24:17.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:17 smithi097 ceph-mon[41966]: 3.c scrub ok 2021-10-08T19:24:17.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:17 smithi097 ceph-mon[41966]: pgmap v117: 158 pgs: 10 peering, 148 active+clean; 2.3 GiB data, 6.9 GiB used, 619 GiB / 626 GiB avail; 109 MiB/s wr, 1.75k op/s 2021-10-08T19:24:17.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:17 smithi097 ceph-mon[32687]: 5.1 scrub ok 2021-10-08T19:24:17.474 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:17 smithi097 ceph-mon[32687]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:24:17.474 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:17 smithi097 ceph-mon[32687]: from='client.34811 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:24:17.474 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:17 smithi097 ceph-mon[32687]: osdmap e110: 8 total, 8 up, 7 in 2021-10-08T19:24:17.474 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:17 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:24:17.475 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:17 smithi097 ceph-mon[32687]: 3.c scrub ok 2021-10-08T19:24:17.475 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:17 smithi097 ceph-mon[32687]: pgmap v117: 158 pgs: 10 peering, 148 active+clean; 2.3 GiB data, 6.9 GiB used, 619 GiB / 626 GiB avail; 109 MiB/s wr, 1.75k op/s 2021-10-08T19:24:17.562 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:24:17.588 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:17.638 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:24:17.640 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:17.641 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:24:17.742 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:24:17.797 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:18.046 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:18 smithi097 ceph-mon[32687]: 5.14 scrub ok 2021-10-08T19:24:18.047 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:18 smithi097 ceph-mon[32687]: 4.2 scrub ok 2021-10-08T19:24:18.047 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:18 smithi097 ceph-mon[32687]: 3.5 scrub ok 2021-10-08T19:24:18.047 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:18 smithi097 ceph-mon[32687]: 2.5 scrub ok 2021-10-08T19:24:18.048 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:18 smithi097 ceph-mon[41966]: 5.14 scrub ok 2021-10-08T19:24:18.048 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:18 smithi097 ceph-mon[41966]: 4.2 scrub ok 2021-10-08T19:24:18.048 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:18 smithi097 ceph-mon[41966]: 3.5 scrub ok 2021-10-08T19:24:18.048 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:18 smithi097 ceph-mon[41966]: 2.5 scrub ok 2021-10-08T19:24:18.066 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:24:18.070 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:18.071 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:24:18.172 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:24:18.196 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:24:18.240 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 25 16 42952 42936 107.287 85.4375 0.0128722 0.00931508 2021-10-08T19:24:18.254 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:18.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:18 smithi117 ceph-mon[34585]: 5.14 scrub ok 2021-10-08T19:24:18.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:18 smithi117 ceph-mon[34585]: 4.2 scrub ok 2021-10-08T19:24:18.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:18 smithi117 ceph-mon[34585]: 3.5 scrub ok 2021-10-08T19:24:18.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:18 smithi117 ceph-mon[34585]: 2.5 scrub ok 2021-10-08T19:24:18.475 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:24:18.483 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:18.484 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:24:18.585 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:24:18.650 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:18.803 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:24:18.814 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:18.815 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:24:18.916 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:24:18.929 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:24:18.972 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:24:18.983 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:19.021 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:24:19.077 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:24:19.097 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:24:19.109 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:19.110 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:24:19.123 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:24:19.160 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:24:19.201 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:24:19.211 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:24:19.236 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:19.242 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 26 16 43939 43923 105.526 61.6875 0.0087202 0.00946897 2021-10-08T19:24:19.244 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:24:19.246 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2021-10-08T19:24:19.246 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:24:19.257 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'false' 2021-10-08T19:24:19.257 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'false' 2021-10-08T19:24:19.257 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'false' 2021-10-08T19:24:19.257 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'false' 2021-10-08T19:24:19.258 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'false' 2021-10-08T19:24:19.258 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'false' 2021-10-08T19:24:19.258 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'false' 2021-10-08T19:24:19.258 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'false' 2021-10-08T19:24:19.282 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:24:19.284 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:19.286 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:24:19.304 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:19 smithi097 ceph-mon[32687]: 4.4 scrub ok 2021-10-08T19:24:19.305 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:19 smithi097 ceph-mon[32687]: pgmap v118: 158 pgs: 158 active+clean; 2.6 GiB data, 8.0 GiB used, 618 GiB / 626 GiB avail; 135 MiB/s wr, 2.16k op/s 2021-10-08T19:24:19.305 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:19 smithi097 ceph-mon[32687]: 6.12 scrub ok 2021-10-08T19:24:19.306 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:19 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/605389955' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:24:19.306 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:19 smithi097 ceph-mon[41966]: 4.4 scrub ok 2021-10-08T19:24:19.307 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:19 smithi097 ceph-mon[41966]: pgmap v118: 158 pgs: 158 active+clean; 2.6 GiB data, 8.0 GiB used, 618 GiB / 626 GiB avail; 135 MiB/s wr, 2.16k op/s 2021-10-08T19:24:19.307 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:19 smithi097 ceph-mon[41966]: 6.12 scrub ok 2021-10-08T19:24:19.307 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:19 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/605389955' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:24:19.387 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:24:19.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:19 smithi117 ceph-mon[34585]: 4.4 scrub ok 2021-10-08T19:24:19.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:19 smithi117 ceph-mon[34585]: pgmap v118: 158 pgs: 158 active+clean; 2.6 GiB data, 8.0 GiB used, 618 GiB / 626 GiB avail; 135 MiB/s wr, 2.16k op/s 2021-10-08T19:24:19.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:19 smithi117 ceph-mon[34585]: 6.12 scrub ok 2021-10-08T19:24:19.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:19 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/605389955' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:24:19.411 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:19.465 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:24:19.467 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:19.468 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:24:19.570 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:24:19.622 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:20.050 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set noscrub 2021-10-08T19:24:20.243 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 27 16 45221 45205 104.585 80.125 0.0167989 0.00955634 2021-10-08T19:24:20.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:20 smithi117 ceph-mon[34585]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs inactive, 4 pgs peering) 2021-10-08T19:24:20.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:20 smithi117 ceph-mon[34585]: Cluster is now healthy 2021-10-08T19:24:20.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:20 smithi097 ceph-mon[32687]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs inactive, 4 pgs peering) 2021-10-08T19:24:20.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:20 smithi097 ceph-mon[32687]: Cluster is now healthy 2021-10-08T19:24:20.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:20 smithi097 ceph-mon[41966]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs inactive, 4 pgs peering) 2021-10-08T19:24:20.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:20 smithi097 ceph-mon[41966]: Cluster is now healthy 2021-10-08T19:24:20.705 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:24:20.707 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:20.707 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:24:20.808 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:24:20.838 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:20.891 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:24:20.893 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:20.894 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:24:20.995 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:24:21.053 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:21.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:21 smithi117 ceph-mon[34585]: 6.e scrub ok 2021-10-08T19:24:21.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:21 smithi117 ceph-mon[34585]: 4.8 scrub ok 2021-10-08T19:24:21.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:21 smithi117 ceph-mon[34585]: osdmap e111: 8 total, 8 up, 7 in 2021-10-08T19:24:21.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:21 smithi117 ceph-mon[34585]: pgmap v120: 158 pgs: 158 active+clean; 2.6 GiB data, 8.0 GiB used, 618 GiB / 626 GiB avail; 61 MiB/s wr, 981 op/s 2021-10-08T19:24:21.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:21 smithi117 ceph-mon[34585]: 5.1a scrub ok 2021-10-08T19:24:21.243 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 28 16 46239 46223 103.123 63.625 0.00792535 0.00969187 2021-10-08T19:24:21.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:21 smithi097 ceph-mon[32687]: 6.e scrub ok 2021-10-08T19:24:21.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:21 smithi097 ceph-mon[32687]: 4.8 scrub ok 2021-10-08T19:24:21.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:21 smithi097 ceph-mon[32687]: osdmap e111: 8 total, 8 up, 7 in 2021-10-08T19:24:21.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:21 smithi097 ceph-mon[32687]: pgmap v120: 158 pgs: 158 active+clean; 2.6 GiB data, 8.0 GiB used, 618 GiB / 626 GiB avail; 61 MiB/s wr, 981 op/s 2021-10-08T19:24:21.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:21 smithi097 ceph-mon[32687]: 5.1a scrub ok 2021-10-08T19:24:21.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:21 smithi097 ceph-mon[41966]: 6.e scrub ok 2021-10-08T19:24:21.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:21 smithi097 ceph-mon[41966]: 4.8 scrub ok 2021-10-08T19:24:21.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:21 smithi097 ceph-mon[41966]: osdmap e111: 8 total, 8 up, 7 in 2021-10-08T19:24:21.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:21 smithi097 ceph-mon[41966]: pgmap v120: 158 pgs: 158 active+clean; 2.6 GiB data, 8.0 GiB used, 618 GiB / 626 GiB avail; 61 MiB/s wr, 981 op/s 2021-10-08T19:24:21.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:21 smithi097 ceph-mon[41966]: 5.1a scrub ok 2021-10-08T19:24:21.850 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:24:21.856 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:21.857 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:24:21.958 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:24:21.982 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:22.034 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:24:22.039 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:22.040 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:24:22.104 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2021-10-08T19:24:22.140 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:24:22.157 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:22 smithi097 ceph-mon[32687]: 2.16 scrub ok 2021-10-08T19:24:22.158 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:22 smithi097 ceph-mon[41966]: 2.16 scrub ok 2021-10-08T19:24:22.165 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:22.182 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:24:22.213 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:24:22.214 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:22.215 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:24:22.243 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 29 16 47227 47211 101.696 61.75 0.0233871 0.00982645 2021-10-08T19:24:22.314 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:22 smithi117 ceph-mon[34585]: 2.16 scrub ok 2021-10-08T19:24:22.317 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:24:22.379 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:22.514 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:24:22.525 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:22.526 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:24:22.627 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:24:22.647 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:24:22 smithi117 conmon[69189]: level=error ts=2021-10-08T19:24:22.314Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=1 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:24:22.650 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:22.696 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:24:22.698 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:22.699 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:24:22.724 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:24:22 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:24:22] "GET /metrics HTTP/1.1" 200 155297 "" "Prometheus/2.18.1" 2021-10-08T19:24:22.800 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:24:22.867 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:22.984 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:24:22.992 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:22.993 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:24:23.095 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:24:23.138 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:23 smithi097 ceph-mon[41966]: 2.1 scrub ok 2021-10-08T19:24:23.138 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:23 smithi097 ceph-mon[41966]: 5.16 scrub ok 2021-10-08T19:24:23.138 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:23 smithi097 ceph-mon[41966]: pgmap v121: 158 pgs: 158 active+clean; 2.6 GiB data, 8.0 GiB used, 618 GiB / 626 GiB avail; 49 MiB/s wr, 790 op/s 2021-10-08T19:24:23.139 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:23 smithi097 ceph-mon[32687]: 2.1 scrub ok 2021-10-08T19:24:23.140 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:23 smithi097 ceph-mon[32687]: 5.16 scrub ok 2021-10-08T19:24:23.140 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:23 smithi097 ceph-mon[32687]: pgmap v121: 158 pgs: 158 active+clean; 2.6 GiB data, 8.0 GiB used, 618 GiB / 626 GiB avail; 49 MiB/s wr, 790 op/s 2021-10-08T19:24:23.150 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:23.189 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:24:23.249 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 30 16 48124 48108 100.176 56.0625 0.0125619 0.00997669 2021-10-08T19:24:23.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:23 smithi117 ceph-mon[34585]: 2.1 scrub ok 2021-10-08T19:24:23.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:23 smithi117 ceph-mon[34585]: 5.16 scrub ok 2021-10-08T19:24:23.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:23 smithi117 ceph-mon[34585]: pgmap v121: 158 pgs: 158 active+clean; 2.6 GiB data, 8.0 GiB used, 618 GiB / 626 GiB avail; 49 MiB/s wr, 790 op/s 2021-10-08T19:24:23.412 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:24:23.416 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:23.417 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:24:23.418 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:23 smithi097 conmon[32664]: 2021-10-08T19:24:23.186+0000 7f605f9d6700 -1 mon.a@0(leader).osd e111 definitely_dead 0 2021-10-08T19:24:23.519 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:24:23.544 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:23.595 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:24:23.596 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:23.597 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:24:23.698 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:24:23.748 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:24.087 INFO:teuthology.orchestra.run.smithi097.stderr:marked in osd.6. 2021-10-08T19:24:24.156 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:24:23 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:24:23] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:24:24.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:24 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3736000944' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["6"]}]: dispatch 2021-10-08T19:24:24.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:24 smithi117 ceph-mon[34585]: 2.12 scrub ok 2021-10-08T19:24:24.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:24 smithi117 ceph-mon[34585]: 2.7 scrub ok 2021-10-08T19:24:24.236 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2021-10-08T19:24:24.243 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 31 16 49109 49093 98.9305 61.5625 0.159288 0.0100402 2021-10-08T19:24:24.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:24 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3736000944' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["6"]}]: dispatch 2021-10-08T19:24:24.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:24 smithi097 ceph-mon[32687]: 2.12 scrub ok 2021-10-08T19:24:24.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:24 smithi097 ceph-mon[32687]: 2.7 scrub ok 2021-10-08T19:24:24.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:24 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3736000944' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["6"]}]: dispatch 2021-10-08T19:24:24.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:24 smithi097 ceph-mon[41966]: 2.12 scrub ok 2021-10-08T19:24:24.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:24 smithi097 ceph-mon[41966]: 2.7 scrub ok 2021-10-08T19:24:24.655 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:24:24.658 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:24.658 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:24:24.759 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:24:24.787 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:25.053 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:24:25.243 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 32 16 49109 49093 95.84 0 - 0.0100402 2021-10-08T19:24:25.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:25 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3736000944' entity='client.admin' cmd='[{"prefix": "osd in", "ids": ["6"]}]': finished 2021-10-08T19:24:25.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:25 smithi117 ceph-mon[34585]: osdmap e112: 8 total, 8 up, 8 in 2021-10-08T19:24:25.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:25 smithi117 ceph-mon[34585]: pgmap v123: 158 pgs: 158 active+clean; 3.0 GiB data, 9.0 GiB used, 617 GiB / 626 GiB avail; 86 MiB/s wr, 1.38k op/s 2021-10-08T19:24:25.469 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:25 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3736000944' entity='client.admin' cmd='[{"prefix": "osd in", "ids": ["6"]}]': finished 2021-10-08T19:24:25.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:25 smithi097 ceph-mon[41966]: osdmap e112: 8 total, 8 up, 8 in 2021-10-08T19:24:25.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:25 smithi097 ceph-mon[41966]: pgmap v123: 158 pgs: 158 active+clean; 3.0 GiB data, 9.0 GiB used, 617 GiB / 626 GiB avail; 86 MiB/s wr, 1.38k op/s 2021-10-08T19:24:25.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:25 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3736000944' entity='client.admin' cmd='[{"prefix": "osd in", "ids": ["6"]}]': finished 2021-10-08T19:24:25.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:25 smithi097 ceph-mon[32687]: osdmap e112: 8 total, 8 up, 8 in 2021-10-08T19:24:25.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:25 smithi097 ceph-mon[32687]: pgmap v123: 158 pgs: 158 active+clean; 3.0 GiB data, 9.0 GiB used, 617 GiB / 626 GiB avail; 86 MiB/s wr, 1.38k op/s 2021-10-08T19:24:25.647 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:24:25.651 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:25.651 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:24:25.668 INFO:tasks.thrashosds.thrasher:Added osd 6 2021-10-08T19:24:25.753 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:24:25.781 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:25.929 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:24:25.932 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:25.933 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:24:26.034 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:24:26.066 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:26.149 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:24:26.152 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:26.153 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:24:26.219 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:26 smithi097 ceph-mon[41966]: osdmap e113: 8 total, 8 up, 8 in 2021-10-08T19:24:26.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:26 smithi097 ceph-mon[32687]: osdmap e113: 8 total, 8 up, 8 in 2021-10-08T19:24:26.243 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 33 16 49109 49093 92.9369 0 - 0.0100402 2021-10-08T19:24:26.254 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:24:26.295 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:26.401 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:24:26.404 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:26.405 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:24:26.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:26 smithi117 ceph-mon[34585]: osdmap e113: 8 total, 8 up, 8 in 2021-10-08T19:24:26.406 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:24:26 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:24:26.482 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2021-10-08T19:24:26.482 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:24:26.506 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:24:26.539 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:26.591 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:24:26.592 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:26.593 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:24:26.695 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:24:26.723 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:27.121 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is set 2021-10-08T19:24:27.246 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 34 16 49487 49471 90.898 7.875 0.0199313 0.0109939 2021-10-08T19:24:27.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:27 smithi117 ceph-mon[34585]: osdmap e114: 8 total, 8 up, 8 in 2021-10-08T19:24:27.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:27 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:24:27.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:27 smithi117 ceph-mon[34585]: pgmap v126: 158 pgs: 158 active+clean; 3.0 GiB data, 9.0 GiB used, 617 GiB / 626 GiB avail; 853 B/s rd, 54 MiB/s wr, 864 op/s 2021-10-08T19:24:27.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:27 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2889453239' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:24:27.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:27 smithi117 ceph-mon[34585]: from='client.24838 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:24:27.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:27 smithi097 ceph-mon[32687]: osdmap e114: 8 total, 8 up, 8 in 2021-10-08T19:24:27.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:27 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:24:27.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:27 smithi097 ceph-mon[32687]: pgmap v126: 158 pgs: 158 active+clean; 3.0 GiB data, 9.0 GiB used, 617 GiB / 626 GiB avail; 853 B/s rd, 54 MiB/s wr, 864 op/s 2021-10-08T19:24:27.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:27 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2889453239' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:24:27.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:27 smithi097 ceph-mon[32687]: from='client.24838 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:24:27.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:27 smithi097 ceph-mon[41966]: osdmap e114: 8 total, 8 up, 8 in 2021-10-08T19:24:27.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:27 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:24:27.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:27 smithi097 ceph-mon[41966]: pgmap v126: 158 pgs: 158 active+clean; 3.0 GiB data, 9.0 GiB used, 617 GiB / 626 GiB avail; 853 B/s rd, 54 MiB/s wr, 864 op/s 2021-10-08T19:24:27.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:27 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2889453239' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:24:27.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:27 smithi097 ceph-mon[41966]: from='client.24838 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:24:27.557 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:24:27.561 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:27.562 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:24:27.663 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:24:27.701 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:27.780 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:24:27.783 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:27.784 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:24:27.836 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2021-10-08T19:24:27.885 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:24:27.917 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:27.982 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:24:27.989 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:27.989 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:24:28.090 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:24:28.125 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:28.182 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:24:28.189 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:28 smithi117 ceph-mon[34585]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:24:28.189 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:28 smithi117 ceph-mon[34585]: from='client.24838 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:24:28.190 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:28 smithi117 ceph-mon[34585]: osdmap e115: 8 total, 8 up, 8 in 2021-10-08T19:24:28.191 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:28.192 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:24:28.245 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 35 16 50330 50314 89.8038 52.6875 0.0340687 0.0111276 2021-10-08T19:24:28.293 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:24:28.354 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:28.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:28 smithi097 ceph-mon[32687]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:24:28.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:28 smithi097 ceph-mon[32687]: from='client.24838 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:24:28.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:28 smithi097 ceph-mon[32687]: osdmap e115: 8 total, 8 up, 8 in 2021-10-08T19:24:28.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:28 smithi097 ceph-mon[41966]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:24:28.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:28 smithi097 ceph-mon[41966]: from='client.24838 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:24:28.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:28 smithi097 ceph-mon[41966]: osdmap e115: 8 total, 8 up, 8 in 2021-10-08T19:24:29.075 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:24:29.078 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:29.079 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:24:29.180 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:24:29.210 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:29.246 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 36 16 51321 51305 89.0298 61.9375 0.0236419 0.0112261 2021-10-08T19:24:29.393 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:29 smithi097 ceph-mon[32687]: osdmap e116: 8 total, 8 up, 8 in 2021-10-08T19:24:29.393 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:29 smithi097 ceph-mon[32687]: pgmap v129: 158 pgs: 1 active+recovering+remapped, 1 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+remapped, 155 active+clean; 3.1 GiB data, 9.4 GiB used, 706 GiB / 715 GiB avail; 511 B/s rd, 29 MiB/s wr, 463 op/s; 3052/151155 objects degraded (2.019%); 6052/151155 objects misplaced (4.004%); 752 KiB/s, 22 objects/s recovering 2021-10-08T19:24:29.394 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:29 smithi097 ceph-mon[41966]: osdmap e116: 8 total, 8 up, 8 in 2021-10-08T19:24:29.394 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:29 smithi097 ceph-mon[41966]: pgmap v129: 158 pgs: 1 active+recovering+remapped, 1 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+remapped, 155 active+clean; 3.1 GiB data, 9.4 GiB used, 706 GiB / 715 GiB avail; 511 B/s rd, 29 MiB/s wr, 463 op/s; 3052/151155 objects degraded (2.019%); 6052/151155 objects misplaced (4.004%); 752 KiB/s, 22 objects/s recovering 2021-10-08T19:24:29.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:29 smithi117 ceph-mon[34585]: osdmap e116: 8 total, 8 up, 8 in 2021-10-08T19:24:29.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:29 smithi117 ceph-mon[34585]: pgmap v129: 158 pgs: 1 active+recovering+remapped, 1 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+remapped, 155 active+clean; 3.1 GiB data, 9.4 GiB used, 706 GiB / 715 GiB avail; 511 B/s rd, 29 MiB/s wr, 463 op/s; 3052/151155 objects degraded (2.019%); 6052/151155 objects misplaced (4.004%); 752 KiB/s, 22 objects/s recovering 2021-10-08T19:24:29.487 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:24:29.489 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:29.490 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:24:29.521 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:24:29.592 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:24:29.630 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:29.647 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:24:29.691 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:24:29.693 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:24:29.696 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:29.696 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:24:29.726 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:24:29.763 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:24:29.797 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:24:29.798 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:24:29.830 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:29.835 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:24:29.875 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:24:29.894 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:24:29.897 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:29.897 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:24:29.938 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:24:29.945 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true' 2021-10-08T19:24:29.946 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true' 2021-10-08T19:24:29.946 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true' 2021-10-08T19:24:29.946 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true' 2021-10-08T19:24:29.946 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true' 2021-10-08T19:24:29.946 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true' 2021-10-08T19:24:29.947 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'true' 2021-10-08T19:24:29.947 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'true' 2021-10-08T19:24:29.999 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:24:30.062 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:30.134 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:30 smithi097 ceph-mon[32687]: Health check failed: Degraded data redundancy: 3052/151155 objects degraded (2.019%), 1 pg degraded (PG_DEGRADED) 2021-10-08T19:24:30.134 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:30 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3409058891' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:24:30.135 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:30 smithi117 ceph-mon[34585]: Health check failed: Degraded data redundancy: 3052/151155 objects degraded (2.019%), 1 pg degraded (PG_DEGRADED) 2021-10-08T19:24:30.135 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:30 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3409058891' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:24:30.182 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:24:30.197 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:30.198 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:24:30.247 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 37 16 52081 52065 87.9062 47.5 0.0288197 0.0113685 2021-10-08T19:24:30.299 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:24:30.351 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:30.469 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:30 smithi097 ceph-mon[41966]: Health check failed: Degraded data redundancy: 3052/151155 objects degraded (2.019%), 1 pg degraded (PG_DEGRADED) 2021-10-08T19:24:30.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:30 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3409058891' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:24:30.669 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 7, 6] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2021-10-08T19:24:30.669 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2021-10-08T19:24:30.670 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd dump -f json-pretty 2021-10-08T19:24:31.248 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 38 16 52890 52874 86.9191 50.5625 0.00972357 0.0114977 2021-10-08T19:24:31.396 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set nodeep-scrub 2021-10-08T19:24:31.449 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:31 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:24:31.449 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:31 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:24:31.450 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:31 smithi097 ceph-mon[32687]: osdmap e117: 8 total, 8 up, 8 in 2021-10-08T19:24:31.450 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:31 smithi097 ceph-mon[32687]: pgmap v131: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 153 active+clean; 3.1 GiB data, 9.5 GiB used, 706 GiB / 715 GiB avail; 467 B/s rd, 30 MiB/s wr, 487 op/s; 6114/152007 objects degraded (4.022%); 9106/152007 objects misplaced (5.991%); 1008 KiB/s, 26 objects/s recovering 2021-10-08T19:24:31.450 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:31 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:24:31.451 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:31 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:24:31.451 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:31 smithi097 ceph-mon[41966]: osdmap e117: 8 total, 8 up, 8 in 2021-10-08T19:24:31.451 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:31 smithi097 ceph-mon[41966]: pgmap v131: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 153 active+clean; 3.1 GiB data, 9.5 GiB used, 706 GiB / 715 GiB avail; 467 B/s rd, 30 MiB/s wr, 487 op/s; 6114/152007 objects degraded (4.022%); 9106/152007 objects misplaced (5.991%); 1008 KiB/s, 26 objects/s recovering 2021-10-08T19:24:31.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:31 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:24:31.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:31 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:24:31.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:31 smithi117 ceph-mon[34585]: osdmap e117: 8 total, 8 up, 8 in 2021-10-08T19:24:31.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:31 smithi117 ceph-mon[34585]: pgmap v131: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 153 active+clean; 3.1 GiB data, 9.5 GiB used, 706 GiB / 715 GiB avail; 467 B/s rd, 30 MiB/s wr, 487 op/s; 6114/152007 objects degraded (4.022%); 9106/152007 objects misplaced (5.991%); 1008 KiB/s, 26 objects/s recovering 2021-10-08T19:24:31.817 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:24:31.822 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:31.823 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:24:31.924 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:24:31.960 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:32.250 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 39 16 53801 53785 86.145 56.9375 0.0111924 0.0116029 2021-10-08T19:24:32.399 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:24:32.408 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:32.409 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:24:32.417 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:24:32.421 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:24:32.510 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:24:32.543 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:32.618 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:24:32.620 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:32.621 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:24:32.650 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:24:32 smithi097 conmon[33110]: 172.21.15.97 - - [08/Oct/2021:19:24:32] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:24:32.651 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:24:32 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:24:32] "GET /metrics HTTP/1.1" 200 155315 "" "Prometheus/2.18.1" 2021-10-08T19:24:32.722 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:24:32.764 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:32.837 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:24:32.840 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:32.841 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:24:32.943 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:24:33.041 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:33.179 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:24:33.196 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:33.197 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:24:33.258 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:2021-10-08T19:24:33.258617+0000 min lat: 0.00115885 max lat: 2.88554 avg lat: 0.0117263 2021-10-08T19:24:33.259 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2021-10-08T19:24:33.259 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 40 16 54596 54580 85.2175 49.6875 0.00380355 0.0117263 2021-10-08T19:24:33.298 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:24:33.332 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:33.406 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:24:33.414 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:33.415 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:24:33.460 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:24:33.460 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2021-10-08T19:24:33.460 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2021-10-08T19:24:33.460 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2021-10-08T19:24:33.461 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:24:33.469 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:33 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:24:33.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:33 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:24:33.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:33 smithi097 ceph-mon[32687]: 172.21.15.97 - - [08/Oct/2021:19:24:32] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:24:33.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:33 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:24:33.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:33 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:24:33.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:33 smithi097 ceph-mon[32687]: pgmap v132: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 153 active+clean; 3.1 GiB data, 9.5 GiB used, 706 GiB / 715 GiB avail; 341 B/s rd, 22 MiB/s wr, 356 op/s; 6114/152007 objects degraded (4.022%); 9106/152007 objects misplaced (5.991%); 736 KiB/s, 19 objects/s recovering 2021-10-08T19:24:33.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:33 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:24:33.474 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:33 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:24:33.474 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:33 smithi097 ceph-mon[41966]: 172.21.15.97 - - [08/Oct/2021:19:24:32] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:24:33.474 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:33 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:24:33.474 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:33 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:24:33.475 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:33 smithi097 ceph-mon[41966]: pgmap v132: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 153 active+clean; 3.1 GiB data, 9.5 GiB used, 706 GiB / 715 GiB avail; 341 B/s rd, 22 MiB/s wr, 356 op/s; 6114/152007 objects degraded (4.022%); 9106/152007 objects misplaced (5.991%); 736 KiB/s, 19 objects/s recovering 2021-10-08T19:24:33.516 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:24:33.543 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:33.654 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:24:33.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:33 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:24:33.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:33 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:24:33.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:33 smithi117 ceph-mon[34585]: 172.21.15.97 - - [08/Oct/2021:19:24:32] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:24:33.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:33 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:24:33.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:33 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:24:33.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:33 smithi117 ceph-mon[34585]: pgmap v132: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 153 active+clean; 3.1 GiB data, 9.5 GiB used, 706 GiB / 715 GiB avail; 341 B/s rd, 22 MiB/s wr, 356 op/s; 6114/152007 objects degraded (4.022%); 9106/152007 objects misplaced (5.991%); 736 KiB/s, 19 objects/s recovering 2021-10-08T19:24:33.657 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:33.657 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:24:33.760 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:24:33.802 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:33.883 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:24:33.887 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:33.888 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:24:33.904 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:24:33 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:24:33] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:24:33.989 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:24:34.027 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2021-10-08T19:24:34.042 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:34.224 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:24:33 smithi097 conmon[33110]: 172.21.15.117 - - [08/Oct/2021:19:24:33] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:24:34.258 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 41 16 55452 55436 84.4442 53.5 0.00353823 0.0118322 2021-10-08T19:24:34.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:34 smithi117 ceph-mon[34585]: osdmap e118: 8 total, 8 up, 8 in 2021-10-08T19:24:34.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:34 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:24:34.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:34 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:24:34.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:34 smithi117 ceph-mon[34585]: 172.21.15.117 - - [08/Oct/2021:19:24:33] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:24:34.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:34 smithi097 ceph-mon[41966]: osdmap e118: 8 total, 8 up, 8 in 2021-10-08T19:24:34.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:34 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:24:34.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:34 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:24:34.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:34 smithi097 ceph-mon[41966]: 172.21.15.117 - - [08/Oct/2021:19:24:33] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:24:34.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:34 smithi097 ceph-mon[32687]: osdmap e118: 8 total, 8 up, 8 in 2021-10-08T19:24:34.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:34 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:24:34.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:34 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:24:34.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:34 smithi097 ceph-mon[32687]: 172.21.15.117 - - [08/Oct/2021:19:24:33] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:24:34.739 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:24:34.742 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:34.743 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:24:34.844 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:24:34.908 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:35.259 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 42 16 56246 56230 83.6152 49.625 0.0208076 0.0119531 2021-10-08T19:24:35.442 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2021-10-08T19:24:35.472 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:24:35.475 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:35.476 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:24:35.577 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:24:35.605 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:35.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:35 smithi117 ceph-mon[34585]: pgmap v134: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 153 active+clean; 3.3 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 1.1 KiB/s rd, 63 MiB/s wr, 1.01k op/s; 6114/164775 objects degraded (3.711%); 8932/164775 objects misplaced (5.421%); 2.4 MiB/s, 45 objects/s recovering 2021-10-08T19:24:35.672 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:24:35.675 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:35.676 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:24:35.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:35 smithi097 ceph-mon[41966]: pgmap v134: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 153 active+clean; 3.3 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 1.1 KiB/s rd, 63 MiB/s wr, 1.01k op/s; 6114/164775 objects degraded (3.711%); 8932/164775 objects misplaced (5.421%); 2.4 MiB/s, 45 objects/s recovering 2021-10-08T19:24:35.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:35 smithi097 ceph-mon[32687]: pgmap v134: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 153 active+clean; 3.3 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 1.1 KiB/s rd, 63 MiB/s wr, 1.01k op/s; 6114/164775 objects degraded (3.711%); 8932/164775 objects misplaced (5.421%); 2.4 MiB/s, 45 objects/s recovering 2021-10-08T19:24:35.777 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:24:35.805 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:35.860 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:24:35.864 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:35.864 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:24:35.965 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:24:36.021 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:36.137 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:24:36.155 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:24:36.162 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:24:36.169 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:36.170 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:24:36.259 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 43 16 57103 57087 82.9166 53.5625 0.0339321 0.0120538 2021-10-08T19:24:36.271 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:24:36.296 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:36.353 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:24:36.356 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:36.357 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:24:36.458 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:24:36.536 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:36 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:24:36.536 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:36 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:24:36.536 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:36 smithi097 ceph-mon[32687]: Health check update: Degraded data redundancy: 6114/164775 objects degraded (3.711%), 2 pgs degraded (PG_DEGRADED) 2021-10-08T19:24:36.536 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:36 smithi097 ceph-mon[32687]: osdmap e119: 8 total, 8 up, 8 in 2021-10-08T19:24:36.537 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:36 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:24:36.537 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:36 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:36.537 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:36 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:24:36.537 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:36 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:24:36.538 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:36 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:24:36.538 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:36 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:24:36.538 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:36 smithi097 ceph-mon[41966]: Health check update: Degraded data redundancy: 6114/164775 objects degraded (3.711%), 2 pgs degraded (PG_DEGRADED) 2021-10-08T19:24:36.538 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:36 smithi097 ceph-mon[41966]: osdmap e119: 8 total, 8 up, 8 in 2021-10-08T19:24:36.539 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:36 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:24:36.539 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:36 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:36.539 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:36 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:24:36.539 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:36 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:24:36.543 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:36.655 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:24:36 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:24:36.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:36 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:24:36.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:36 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:24:36.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:36 smithi117 ceph-mon[34585]: Health check update: Degraded data redundancy: 6114/164775 objects degraded (3.711%), 2 pgs degraded (PG_DEGRADED) 2021-10-08T19:24:36.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:36 smithi117 ceph-mon[34585]: osdmap e119: 8 total, 8 up, 8 in 2021-10-08T19:24:36.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:36 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:24:36.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:36 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:36.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:36 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:24:36.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:36 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:24:36.829 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:24:36.834 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:36.835 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:24:36.936 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:24:37.009 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:37.127 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:24:37.139 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:37.140 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:24:37.241 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:24:37.260 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 44 16 57797 57781 82.0184 43.375 0.0241976 0.0121851 2021-10-08T19:24:37.310 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:37.393 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:37 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:24:37.393 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:37 smithi097 ceph-mon[32687]: pgmap v136: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 153 active+clean; 3.3 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 810 B/s rd, 42 MiB/s wr, 674 op/s; 6114/164775 objects degraded (3.711%); 8932/164775 objects misplaced (5.421%); 1.7 MiB/s, 27 objects/s recovering 2021-10-08T19:24:37.394 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:37 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/355825508' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:24:37.450 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is set 2021-10-08T19:24:37.464 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:24:37.465 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:24:37.465 INFO:teuthology.orchestra.run.smithi097.stdout: "epoch": 120, 2021-10-08T19:24:37.465 INFO:teuthology.orchestra.run.smithi097.stdout: "fsid": "1d01f6d6-286c-11ec-8c25-001a4aab830c", 2021-10-08T19:24:37.465 INFO:teuthology.orchestra.run.smithi097.stdout: "created": "2021-10-08T19:16:25.258003+0000", 2021-10-08T19:24:37.466 INFO:teuthology.orchestra.run.smithi097.stdout: "modified": "2021-10-08T19:24:37.371240+0000", 2021-10-08T19:24:37.466 INFO:teuthology.orchestra.run.smithi097.stdout: "last_up_change": "2021-10-08T19:21:15.388758+0000", 2021-10-08T19:24:37.466 INFO:teuthology.orchestra.run.smithi097.stdout: "last_in_change": "2021-10-08T19:24:24.060804+0000", 2021-10-08T19:24:37.466 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-08T19:24:37.467 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_num": 5806080, 2021-10-08T19:24:37.467 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_set": [ 2021-10-08T19:24:37.467 INFO:teuthology.orchestra.run.smithi097.stdout: "nodeep-scrub", 2021-10-08T19:24:37.467 INFO:teuthology.orchestra.run.smithi097.stdout: "noscrub", 2021-10-08T19:24:37.467 INFO:teuthology.orchestra.run.smithi097.stdout: "pglog_hardlimit", 2021-10-08T19:24:37.468 INFO:teuthology.orchestra.run.smithi097.stdout: "purged_snapdirs", 2021-10-08T19:24:37.469 INFO:teuthology.orchestra.run.smithi097.stdout: "recovery_deletes", 2021-10-08T19:24:37.469 INFO:teuthology.orchestra.run.smithi097.stdout: "sortbitwise" 2021-10-08T19:24:37.469 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:24:37.469 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_version": 18, 2021-10-08T19:24:37.470 INFO:teuthology.orchestra.run.smithi097.stdout: "full_ratio": 0.94999998807907104, 2021-10-08T19:24:37.470 INFO:teuthology.orchestra.run.smithi097.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-08T19:24:37.470 INFO:teuthology.orchestra.run.smithi097.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-08T19:24:37.470 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_snapshot": "", 2021-10-08T19:24:37.471 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_max": 7, 2021-10-08T19:24:37.471 INFO:teuthology.orchestra.run.smithi097.stdout: "max_osd": 8, 2021-10-08T19:24:37.471 INFO:teuthology.orchestra.run.smithi097.stdout: "require_min_compat_client": "luminous", 2021-10-08T19:24:37.471 INFO:teuthology.orchestra.run.smithi097.stdout: "min_compat_client": "luminous", 2021-10-08T19:24:37.472 INFO:teuthology.orchestra.run.smithi097.stdout: "require_osd_release": "quincy", 2021-10-08T19:24:37.474 INFO:teuthology.orchestra.run.smithi097.stdout: "pools": [ 2021-10-08T19:24:37.474 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.474 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 1, 2021-10-08T19:24:37.475 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": ".mgr", 2021-10-08T19:24:37.475 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:19:44.413311+0000", 2021-10-08T19:24:37.475 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:24:37.475 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:24:37.475 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:24:37.476 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:24:37.476 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:24:37.476 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:24:37.477 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:24:37.477 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:24:37.477 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:24:37.478 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:24:37.478 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:24:37.478 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:24:37.478 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 1, 2021-10-08T19:24:37.478 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 1, 2021-10-08T19:24:37.479 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 1, 2021-10-08T19:24:37.479 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 1, 2021-10-08T19:24:37.479 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 1, 2021-10-08T19:24:37.479 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:24:37.480 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:24:37.480 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:24:37.480 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:24:37.480 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:24:37.480 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:24:37.481 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:24:37.481 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.481 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "21", 2021-10-08T19:24:37.481 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:24:37.482 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:24:37.482 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2021-10-08T19:24:37.482 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:24:37.482 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:24:37.483 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:24:37.483 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:24:37.483 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:24:37.483 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:24:37.484 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:24:37.484 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:24:37.485 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:24:37.485 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:24:37.485 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:24:37.485 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:24:37.485 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:24:37.486 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:24:37.486 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:24:37.487 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:24:37.487 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:24:37.487 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:24:37.487 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:24:37.488 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:24:37.488 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:24:37.488 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:24:37.488 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:24:37.489 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.489 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:24:37.489 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:24:37.489 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:24:37.489 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:24:37.490 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:24:37.490 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:24:37.490 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:24:37.490 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:24:37.491 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:24:37.491 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:24:37.491 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:24:37.491 INFO:teuthology.orchestra.run.smithi097.stdout: "options": { 2021-10-08T19:24:37.492 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_min": 1 2021-10-08T19:24:37.492 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.492 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:24:37.492 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": {} 2021-10-08T19:24:37.492 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:37.493 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.493 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.493 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 2, 2021-10-08T19:24:37.493 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": ".rgw.root", 2021-10-08T19:24:37.494 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:21:21.940881+0000", 2021-10-08T19:24:37.494 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:24:37.494 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:24:37.495 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:24:37.495 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:24:37.495 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:24:37.496 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:24:37.496 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:24:37.496 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:24:37.497 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:24:37.497 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:24:37.497 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:24:37.498 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:24:37.498 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 32, 2021-10-08T19:24:37.499 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 32, 2021-10-08T19:24:37.499 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 32, 2021-10-08T19:24:37.499 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 32, 2021-10-08T19:24:37.500 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 32, 2021-10-08T19:24:37.500 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:24:37.501 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:24:37.501 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:24:37.501 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:24:37.502 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:24:37.502 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:24:37.503 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:24:37.503 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.504 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "62", 2021-10-08T19:24:37.504 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:24:37.504 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:24:37.505 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2021-10-08T19:24:37.505 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:24:37.506 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:24:37.506 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:24:37.506 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:24:37.507 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:24:37.507 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:24:37.508 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:24:37.508 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:24:37.509 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:24:37.509 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:24:37.510 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:24:37.510 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:24:37.510 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:24:37.511 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:24:37.511 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:24:37.512 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:24:37.512 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:24:37.513 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:24:37.513 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:24:37.514 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:24:37.514 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:24:37.515 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:24:37.515 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:24:37.515 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.516 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:24:37.516 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:24:37.517 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:24:37.517 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:24:37.517 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:24:37.518 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:24:37.518 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:24:37.519 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:24:37.519 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:24:37.519 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:24:37.520 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:24:37.520 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2021-10-08T19:24:37.521 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:24:37.521 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw": {} 2021-10-08T19:24:37.522 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:37.522 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.522 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.523 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 3, 2021-10-08T19:24:37.523 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "iscsi", 2021-10-08T19:24:37.524 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:21:22.536945+0000", 2021-10-08T19:24:37.524 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:24:37.525 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:24:37.525 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:24:37.525 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:24:37.526 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:24:37.526 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:24:37.527 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:24:37.527 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:24:37.528 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:24:37.528 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:24:37.529 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:24:37.529 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:24:37.529 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 13, 2021-10-08T19:24:37.530 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 13, 2021-10-08T19:24:37.530 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 13, 2021-10-08T19:24:37.531 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 13, 2021-10-08T19:24:37.531 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 13, 2021-10-08T19:24:37.532 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:24:37.532 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:24:37.532 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:24:37.533 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:24:37.533 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:24:37.534 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:24:37.534 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:24:37.535 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.535 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "107", 2021-10-08T19:24:37.535 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:24:37.536 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:24:37.536 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "106", 2021-10-08T19:24:37.537 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:24:37.537 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:24:37.538 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:24:37.538 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:24:37.538 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:24:37.539 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:24:37.539 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:24:37.540 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:24:37.540 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:24:37.541 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:24:37.541 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:24:37.541 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:24:37.542 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:24:37.542 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:24:37.543 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:24:37.543 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:24:37.544 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:24:37.544 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:24:37.544 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:24:37.545 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:24:37.545 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:24:37.545 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:24:37.545 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:24:37.546 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.546 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:24:37.547 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:24:37.547 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:24:37.547 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:24:37.548 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:24:37.548 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:24:37.548 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:24:37.549 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:24:37.549 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:24:37.549 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:24:37.549 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:24:37.550 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2021-10-08T19:24:37.550 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:24:37.550 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd": {} 2021-10-08T19:24:37.550 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:37.551 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.551 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.551 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 4, 2021-10-08T19:24:37.551 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "default.rgw.log", 2021-10-08T19:24:37.552 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:21:23.886328+0000", 2021-10-08T19:24:37.552 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:24:37.552 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:24:37.552 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:24:37.553 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:24:37.553 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:24:37.553 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:24:37.553 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:24:37.553 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:24:37.554 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:24:37.554 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:24:37.554 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:24:37.554 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:24:37.555 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 32, 2021-10-08T19:24:37.555 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 32, 2021-10-08T19:24:37.555 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 32, 2021-10-08T19:24:37.555 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 32, 2021-10-08T19:24:37.555 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 32, 2021-10-08T19:24:37.556 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:24:37.556 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:24:37.556 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:24:37.556 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:24:37.557 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:24:37.557 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:24:37.557 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:24:37.557 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.557 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "64", 2021-10-08T19:24:37.558 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:24:37.558 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:24:37.558 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2021-10-08T19:24:37.558 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:24:37.559 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:24:37.559 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:24:37.559 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:24:37.559 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:24:37.560 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:24:37.560 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:24:37.560 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:24:37.560 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:24:37.560 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:24:37.561 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:24:37.561 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:24:37.561 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:24:37.561 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:24:37.562 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:24:37.562 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:24:37.562 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:24:37.562 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:24:37.562 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:24:37.563 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:24:37.563 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:24:37.563 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:24:37.563 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:24:37.564 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.564 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:24:37.564 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:24:37.564 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:24:37.564 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:24:37.565 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:24:37.565 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:24:37.565 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:24:37.565 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:24:37.566 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:24:37.566 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:24:37.566 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:24:37.566 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2021-10-08T19:24:37.567 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:24:37.567 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw": {} 2021-10-08T19:24:37.567 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:37.567 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.567 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.568 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 5, 2021-10-08T19:24:37.568 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "default.rgw.control", 2021-10-08T19:24:37.568 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:21:25.865032+0000", 2021-10-08T19:24:37.568 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:24:37.568 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:24:37.569 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:24:37.569 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:24:37.569 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:24:37.569 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:24:37.570 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:24:37.570 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:24:37.570 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:24:37.570 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:24:37.570 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:24:37.571 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:24:37.571 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 32, 2021-10-08T19:24:37.571 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 32, 2021-10-08T19:24:37.571 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 32, 2021-10-08T19:24:37.572 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 32, 2021-10-08T19:24:37.572 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 32, 2021-10-08T19:24:37.572 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:24:37.572 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:24:37.572 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:24:37.573 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:24:37.573 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:24:37.573 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:24:37.573 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:24:37.573 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.574 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "66", 2021-10-08T19:24:37.574 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:24:37.574 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:24:37.574 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2021-10-08T19:24:37.575 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:24:37.575 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:24:37.575 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:24:37.575 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:24:37.575 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:24:37.576 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:24:37.576 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:24:37.576 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:24:37.576 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:24:37.577 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:24:37.577 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:24:37.577 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:24:37.577 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:24:37.578 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:24:37.578 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:24:37.578 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:24:37.579 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:24:37.579 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:24:37.579 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:24:37.583 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:24:37.583 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:24:37.584 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:24:37.584 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:24:37.584 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.584 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:24:37.584 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:24:37.585 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:24:37.585 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:24:37.585 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:24:37.585 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:24:37.585 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:24:37.586 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:24:37.586 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:24:37.586 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:24:37.586 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:24:37.587 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2021-10-08T19:24:37.587 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:24:37.587 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw": {} 2021-10-08T19:24:37.587 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:37.587 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.588 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.588 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 6, 2021-10-08T19:24:37.588 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "default.rgw.meta", 2021-10-08T19:24:37.588 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:21:27.940767+0000", 2021-10-08T19:24:37.589 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:24:37.589 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:24:37.589 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:24:37.589 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:24:37.590 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:24:37.590 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:24:37.590 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:24:37.590 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:24:37.590 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:24:37.591 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:24:37.591 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:24:37.591 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:24:37.591 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 32, 2021-10-08T19:24:37.592 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 32, 2021-10-08T19:24:37.592 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 32, 2021-10-08T19:24:37.592 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 32, 2021-10-08T19:24:37.592 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 32, 2021-10-08T19:24:37.593 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:24:37.593 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:24:37.593 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:24:37.594 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:24:37.594 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:24:37.594 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:24:37.595 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:24:37.595 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.595 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "69", 2021-10-08T19:24:37.596 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:24:37.596 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:24:37.596 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2021-10-08T19:24:37.597 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:24:37.597 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:24:37.598 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:24:37.598 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:24:37.599 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:24:37.599 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:24:37.599 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:24:37.600 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:24:37.600 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:24:37.601 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:24:37.601 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:24:37.602 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:24:37.602 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:24:37.602 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:24:37.603 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:24:37.603 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:24:37.603 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:24:37.604 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:24:37.604 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:24:37.605 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:24:37.605 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:24:37.605 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:24:37.606 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:24:37.606 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.606 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:24:37.606 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:24:37.607 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:24:37.607 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:24:37.607 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:24:37.607 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:24:37.608 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:24:37.608 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:24:37.608 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:24:37.608 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:24:37.608 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:24:37.609 INFO:teuthology.orchestra.run.smithi097.stdout: "options": { 2021-10-08T19:24:37.609 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_bias": 4, 2021-10-08T19:24:37.609 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_min": 8 2021-10-08T19:24:37.609 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.610 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:24:37.610 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw": {} 2021-10-08T19:24:37.610 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:37.610 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.611 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.611 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 7, 2021-10-08T19:24:37.611 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "unique_pool_0", 2021-10-08T19:24:37.611 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:23:43.485480+0000", 2021-10-08T19:24:37.611 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:24:37.612 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:24:37.612 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:24:37.612 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:24:37.612 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:24:37.613 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:24:37.613 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:24:37.613 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:24:37.613 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:24:37.613 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:24:37.614 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:24:37.614 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:24:37.614 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 16, 2021-10-08T19:24:37.614 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 16, 2021-10-08T19:24:37.615 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 16, 2021-10-08T19:24:37.615 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 16, 2021-10-08T19:24:37.615 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 16, 2021-10-08T19:24:37.615 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:24:37.615 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:24:37.616 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:24:37.616 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:24:37.616 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:24:37.616 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:24:37.616 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:24:37.617 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.617 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "98", 2021-10-08T19:24:37.617 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:24:37.617 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:24:37.618 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2021-10-08T19:24:37.618 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:24:37.618 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:24:37.618 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:24:37.618 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:24:37.619 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:24:37.619 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:24:37.619 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:24:37.619 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:24:37.620 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:24:37.620 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:24:37.620 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:24:37.620 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:24:37.620 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:24:37.621 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:24:37.621 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:24:37.621 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:24:37.621 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:24:37.621 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:24:37.622 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:24:37.622 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:24:37.622 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:24:37.622 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:24:37.623 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:24:37.623 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.623 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:24:37.623 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:24:37.623 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:24:37.624 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:24:37.624 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:24:37.624 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:24:37.624 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:24:37.625 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:24:37.625 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:24:37.625 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:24:37.625 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:24:37.625 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2021-10-08T19:24:37.626 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:24:37.626 INFO:teuthology.orchestra.run.smithi097.stdout: "rados": {} 2021-10-08T19:24:37.626 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:37.626 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:37.627 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:24:37.627 INFO:teuthology.orchestra.run.smithi097.stdout: "osds": [ 2021-10-08T19:24:37.627 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.627 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 0, 2021-10-08T19:24:37.627 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "9e64e714-a5d5-4fbb-ae2b-1df4bf14b8e0", 2021-10-08T19:24:37.628 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:24:37.628 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:24:37.628 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:24:37.629 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:24:37.629 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:24:37.629 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:24:37.630 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 8, 2021-10-08T19:24:37.630 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 113, 2021-10-08T19:24:37.630 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:24:37.631 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:24:37.631 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:24:37.631 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:24:37.632 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.632 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:24:37.633 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6801", 2021-10-08T19:24:37.633 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3354161282 2021-10-08T19:24:37.633 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:37.634 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:37.634 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.634 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:24:37.635 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:24:37.635 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.635 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:24:37.636 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6802", 2021-10-08T19:24:37.636 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3354161282 2021-10-08T19:24:37.637 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:37.637 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:37.637 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.638 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:24:37.638 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:24:37.638 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.639 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:24:37.639 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6804", 2021-10-08T19:24:37.640 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3354161282 2021-10-08T19:24:37.640 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:37.640 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:37.641 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.641 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:24:37.641 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:24:37.642 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.642 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:24:37.642 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6803", 2021-10-08T19:24:37.642 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3354161282 2021-10-08T19:24:37.643 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:37.643 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:37.643 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.643 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.97:6801/3354161282", 2021-10-08T19:24:37.643 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.97:6802/3354161282", 2021-10-08T19:24:37.644 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.97:6804/3354161282", 2021-10-08T19:24:37.644 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.97:6803/3354161282", 2021-10-08T19:24:37.644 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:24:37.644 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:24:37.645 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:24:37.645 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:37.645 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.645 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.645 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 1, 2021-10-08T19:24:37.646 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "32602a22-f263-4b62-a8d8-50fddfb73fa8", 2021-10-08T19:24:37.646 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:24:37.646 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:24:37.646 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:24:37.647 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:24:37.647 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:24:37.647 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:24:37.647 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 13, 2021-10-08T19:24:37.648 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 113, 2021-10-08T19:24:37.648 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:24:37.648 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:24:37.648 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:24:37.649 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:24:37.649 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.649 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:24:37.649 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6805", 2021-10-08T19:24:37.650 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 735799205 2021-10-08T19:24:37.650 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:37.650 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:37.650 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.650 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:24:37.651 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:24:37.651 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.651 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:24:37.651 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6806", 2021-10-08T19:24:37.652 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 735799205 2021-10-08T19:24:37.652 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:37.652 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:37.652 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.653 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:24:37.653 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:24:37.653 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.653 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:24:37.653 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6808", 2021-10-08T19:24:37.654 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 735799205 2021-10-08T19:24:37.654 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:37.654 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:37.654 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.655 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:24:37.655 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:24:37.655 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.655 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:24:37.655 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6807", 2021-10-08T19:24:37.656 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 735799205 2021-10-08T19:24:37.656 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:37.656 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:37.656 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.656 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.97:6805/735799205", 2021-10-08T19:24:37.657 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.97:6806/735799205", 2021-10-08T19:24:37.657 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.97:6808/735799205", 2021-10-08T19:24:37.657 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.97:6807/735799205", 2021-10-08T19:24:37.657 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:24:37.658 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:24:37.658 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:24:37.659 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:37.659 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.659 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.660 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 2, 2021-10-08T19:24:37.660 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "88e0e4a2-b4a3-4a00-8669-03c3d9b166c5", 2021-10-08T19:24:37.660 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:24:37.660 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:24:37.661 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:24:37.661 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:24:37.661 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:24:37.661 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:24:37.662 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 18, 2021-10-08T19:24:37.662 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 113, 2021-10-08T19:24:37.663 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:24:37.663 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:24:37.664 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:24:37.664 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:24:37.664 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.665 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:24:37.665 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6809", 2021-10-08T19:24:37.666 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2366482649 2021-10-08T19:24:37.666 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:37.666 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:37.667 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.667 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:24:37.668 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:24:37.668 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.668 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:24:37.668 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6810", 2021-10-08T19:24:37.669 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2366482649 2021-10-08T19:24:37.669 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:37.669 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:37.669 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.670 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:24:37.670 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:24:37.670 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.670 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:24:37.671 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6812", 2021-10-08T19:24:37.671 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2366482649 2021-10-08T19:24:37.671 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:37.671 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:37.671 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.672 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:24:37.672 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:24:37.672 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.672 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:24:37.673 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6811", 2021-10-08T19:24:37.673 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2366482649 2021-10-08T19:24:37.673 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:37.673 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:37.673 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.674 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.97:6809/2366482649", 2021-10-08T19:24:37.674 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.97:6810/2366482649", 2021-10-08T19:24:37.674 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.97:6812/2366482649", 2021-10-08T19:24:37.674 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.97:6811/2366482649", 2021-10-08T19:24:37.675 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:24:37.675 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:24:37.675 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:24:37.675 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:37.675 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.676 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.676 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 3, 2021-10-08T19:24:37.676 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "e689d708-b501-4526-a31a-1e598b74654d", 2021-10-08T19:24:37.676 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:24:37.677 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:24:37.677 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:24:37.677 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:24:37.677 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:24:37.678 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:24:37.678 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 24, 2021-10-08T19:24:37.678 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 112, 2021-10-08T19:24:37.678 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:24:37.679 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:24:37.679 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:24:37.679 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:24:37.679 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.679 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:24:37.680 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6813", 2021-10-08T19:24:37.680 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3191181122 2021-10-08T19:24:37.680 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:37.680 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:37.680 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.681 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:24:37.681 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:24:37.681 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.681 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:24:37.682 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6814", 2021-10-08T19:24:37.682 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3191181122 2021-10-08T19:24:37.682 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:37.682 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:37.682 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.683 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:24:37.683 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:24:37.683 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.683 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:24:37.683 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6816", 2021-10-08T19:24:37.684 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3191181122 2021-10-08T19:24:37.684 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:37.684 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:37.684 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.685 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:24:37.685 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:24:37.685 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.685 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:24:37.685 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6815", 2021-10-08T19:24:37.686 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3191181122 2021-10-08T19:24:37.686 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:37.686 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:37.686 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.687 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.97:6813/3191181122", 2021-10-08T19:24:37.687 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.97:6814/3191181122", 2021-10-08T19:24:37.687 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.97:6816/3191181122", 2021-10-08T19:24:37.687 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.97:6815/3191181122", 2021-10-08T19:24:37.687 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:24:37.688 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:24:37.688 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:24:37.688 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:37.688 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.688 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.689 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 4, 2021-10-08T19:24:37.689 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "67e4730a-be1c-4d88-9307-e3c2cf3ab2ef", 2021-10-08T19:24:37.689 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:24:37.689 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:24:37.689 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:24:37.690 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:24:37.690 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:24:37.690 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:24:37.690 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 30, 2021-10-08T19:24:37.691 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 113, 2021-10-08T19:24:37.691 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:24:37.691 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:24:37.691 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:24:37.691 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:24:37.692 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.692 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:24:37.692 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6800", 2021-10-08T19:24:37.692 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 106778208 2021-10-08T19:24:37.692 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:37.693 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:37.693 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.693 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:24:37.693 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:24:37.693 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.694 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:24:37.694 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6801", 2021-10-08T19:24:37.694 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 106778208 2021-10-08T19:24:37.695 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:37.695 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:37.695 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.695 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:24:37.696 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:24:37.696 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.696 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:24:37.696 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6803", 2021-10-08T19:24:37.696 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 106778208 2021-10-08T19:24:37.697 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:37.697 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:37.697 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.697 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:24:37.698 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:24:37.698 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.698 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:24:37.698 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6802", 2021-10-08T19:24:37.698 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 106778208 2021-10-08T19:24:37.699 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:37.699 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:37.699 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.699 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.117:6800/106778208", 2021-10-08T19:24:37.699 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.117:6801/106778208", 2021-10-08T19:24:37.700 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.117:6803/106778208", 2021-10-08T19:24:37.700 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.117:6802/106778208", 2021-10-08T19:24:37.700 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:24:37.700 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:24:37.701 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:24:37.701 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:37.701 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.701 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.701 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 5, 2021-10-08T19:24:37.702 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "f9fd3153-3e4e-4489-8927-a65641f05d42", 2021-10-08T19:24:37.702 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:24:37.702 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:24:37.702 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:24:37.703 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:24:37.703 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:24:37.703 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:24:37.703 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 38, 2021-10-08T19:24:37.703 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 112, 2021-10-08T19:24:37.704 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:24:37.704 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:24:37.704 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:24:37.704 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:24:37.704 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.705 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:24:37.705 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6804", 2021-10-08T19:24:37.705 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3199889891 2021-10-08T19:24:37.705 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:37.706 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:37.706 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.706 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:24:37.707 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:24:37.707 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.707 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:24:37.707 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6805", 2021-10-08T19:24:37.707 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3199889891 2021-10-08T19:24:37.708 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:37.708 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:37.708 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.708 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:24:37.709 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:24:37.709 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.709 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:24:37.710 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6807", 2021-10-08T19:24:37.710 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3199889891 2021-10-08T19:24:37.711 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:37.711 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:37.712 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.712 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:24:37.712 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:24:37.712 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.713 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:24:37.713 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6806", 2021-10-08T19:24:37.713 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3199889891 2021-10-08T19:24:37.713 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:37.713 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:37.714 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.714 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.117:6804/3199889891", 2021-10-08T19:24:37.714 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.117:6805/3199889891", 2021-10-08T19:24:37.714 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.117:6807/3199889891", 2021-10-08T19:24:37.715 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.117:6806/3199889891", 2021-10-08T19:24:37.715 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:24:37.715 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:24:37.715 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:24:37.716 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:37.716 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.716 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.716 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 6, 2021-10-08T19:24:37.716 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "84898f12-c37d-4eb6-8b71-5b86bfe16e7d", 2021-10-08T19:24:37.717 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:24:37.717 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:24:37.717 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:24:37.718 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:24:37.718 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:24:37.718 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:24:37.719 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 47, 2021-10-08T19:24:37.719 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 112, 2021-10-08T19:24:37.720 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:24:37.720 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:24:37.720 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:24:37.721 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:24:37.721 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.722 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:24:37.722 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6808", 2021-10-08T19:24:37.723 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2185843951 2021-10-08T19:24:37.723 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:37.723 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:37.724 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.724 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:24:37.725 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:24:37.725 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.726 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:24:37.726 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6809", 2021-10-08T19:24:37.727 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2185843951 2021-10-08T19:24:37.727 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:37.727 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:37.728 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.728 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:24:37.729 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:24:37.729 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.729 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:24:37.730 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6811", 2021-10-08T19:24:37.730 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2185843951 2021-10-08T19:24:37.731 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:37.731 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:37.732 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.732 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:24:37.733 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:24:37.733 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.733 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:24:37.734 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6810", 2021-10-08T19:24:37.734 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2185843951 2021-10-08T19:24:37.735 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:37.735 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:37.736 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.736 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.117:6808/2185843951", 2021-10-08T19:24:37.737 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.117:6809/2185843951", 2021-10-08T19:24:37.737 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.117:6811/2185843951", 2021-10-08T19:24:37.737 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.117:6810/2185843951", 2021-10-08T19:24:37.738 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:24:37.738 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:24:37.739 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:24:37.739 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:37.740 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.740 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.740 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 7, 2021-10-08T19:24:37.741 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "529af2ce-2ae9-41ed-8c8e-d133628cfd20", 2021-10-08T19:24:37.741 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:24:37.741 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:24:37.741 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:24:37.742 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:24:37.742 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:24:37.742 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:24:37.742 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 55, 2021-10-08T19:24:37.743 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 115, 2021-10-08T19:24:37.743 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:24:37.743 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:24:37.743 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:24:37.743 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:24:37.744 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.744 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:24:37.744 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6812", 2021-10-08T19:24:37.744 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2817683239 2021-10-08T19:24:37.745 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:37.745 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:37.745 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.745 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:24:37.745 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:24:37.746 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.746 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:24:37.746 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6813", 2021-10-08T19:24:37.746 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2817683239 2021-10-08T19:24:37.747 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:37.747 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:37.747 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.747 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:24:37.748 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:24:37.748 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.748 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:24:37.749 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6815", 2021-10-08T19:24:37.749 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2817683239 2021-10-08T19:24:37.749 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:37.749 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:37.749 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.750 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:24:37.750 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:24:37.750 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.750 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:24:37.751 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6814", 2021-10-08T19:24:37.751 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2817683239 2021-10-08T19:24:37.751 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:37.751 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:37.751 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.752 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.117:6812/2817683239", 2021-10-08T19:24:37.752 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.117:6813/2817683239", 2021-10-08T19:24:37.752 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.117:6815/2817683239", 2021-10-08T19:24:37.752 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.117:6814/2817683239", 2021-10-08T19:24:37.752 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:24:37.753 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:24:37.753 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:24:37.753 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:37.753 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:37.754 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:24:37.754 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_xinfo": [ 2021-10-08T19:24:37.754 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.754 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 0, 2021-10-08T19:24:37.755 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:24:37.755 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:24:37.756 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:24:37.756 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:24:37.756 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:24:37.757 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:24:07.227563+0000", 2021-10-08T19:24:37.757 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:24:37.757 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.757 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.758 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 1, 2021-10-08T19:24:37.758 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:24:37.758 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:24:37.758 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:24:37.759 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:24:37.759 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:24:37.759 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:23:24.796649+0000", 2021-10-08T19:24:37.759 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:24:37.760 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.760 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.760 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 2, 2021-10-08T19:24:37.761 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:24:37.761 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:24:37.761 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:24:37.762 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:24:37.762 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:24:37.762 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:24:29.688484+0000", 2021-10-08T19:24:37.763 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:24:37.763 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.763 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.764 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 3, 2021-10-08T19:24:37.764 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:24:37.765 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:24:37.765 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:24:37.766 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:24:37.766 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:24:37.766 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:24:34.979406+0000", 2021-10-08T19:24:37.767 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:24:37.767 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.768 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.768 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 4, 2021-10-08T19:24:37.768 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:24:37.769 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:24:37.769 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:24:37.769 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:24:37.769 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:24:37.770 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:24:02.266300+0000", 2021-10-08T19:24:37.770 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:24:37.770 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.770 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.771 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 5, 2021-10-08T19:24:37.771 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:24:37.771 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:24:37.771 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:24:37.771 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:24:37.772 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:24:37.772 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:24:14.720341+0000", 2021-10-08T19:24:37.772 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:24:37.772 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.772 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.773 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 6, 2021-10-08T19:24:37.773 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:24:37.773 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:24:37.774 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:24:37.774 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:24:37.774 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:24:37.774 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:24:32.387840+0000", 2021-10-08T19:24:37.775 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:24:37.775 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.775 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.775 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 7, 2021-10-08T19:24:37.776 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:24:37.776 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:24:37.776 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:24:37.776 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:24:37.776 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:24:37.777 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:23:47.776253+0000", 2021-10-08T19:24:37.777 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:24:37.777 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:37.778 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:24:37.778 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_upmap": [], 2021-10-08T19:24:37.778 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_upmap_items": [ 2021-10-08T19:24:37.778 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.779 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "2.0", 2021-10-08T19:24:37.779 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:24:37.779 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.779 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 7, 2021-10-08T19:24:37.780 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 2 2021-10-08T19:24:37.780 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:37.780 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:37.781 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.781 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.781 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "2.1a", 2021-10-08T19:24:37.781 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:24:37.781 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.782 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 7, 2021-10-08T19:24:37.782 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 2 2021-10-08T19:24:37.782 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:37.783 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:37.783 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.783 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.784 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "4.13", 2021-10-08T19:24:37.784 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:24:37.784 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.784 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 1, 2021-10-08T19:24:37.784 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 2 2021-10-08T19:24:37.785 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:37.785 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:37.785 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.785 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.786 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "4.14", 2021-10-08T19:24:37.786 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:24:37.786 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.786 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 3, 2021-10-08T19:24:37.787 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 2 2021-10-08T19:24:37.787 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:37.787 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:37.787 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.788 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.788 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "4.18", 2021-10-08T19:24:37.788 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:24:37.789 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.789 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 1, 2021-10-08T19:24:37.789 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 2 2021-10-08T19:24:37.789 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:37.789 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:37.790 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.790 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.790 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "4.1c", 2021-10-08T19:24:37.790 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:24:37.791 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.791 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 1, 2021-10-08T19:24:37.791 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 5 2021-10-08T19:24:37.791 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:37.792 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:37.792 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:37.792 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:24:37.793 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_temp": [ 2021-10-08T19:24:37.793 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.794 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "7.1", 2021-10-08T19:24:37.794 INFO:teuthology.orchestra.run.smithi097.stdout: "osds": [ 2021-10-08T19:24:37.794 INFO:teuthology.orchestra.run.smithi097.stdout: 4, 2021-10-08T19:24:37.795 INFO:teuthology.orchestra.run.smithi097.stdout: 3 2021-10-08T19:24:37.795 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:37.796 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.796 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.797 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "7.7", 2021-10-08T19:24:37.797 INFO:teuthology.orchestra.run.smithi097.stdout: "osds": [ 2021-10-08T19:24:37.798 INFO:teuthology.orchestra.run.smithi097.stdout: 0, 2021-10-08T19:24:37.798 INFO:teuthology.orchestra.run.smithi097.stdout: 3 2021-10-08T19:24:37.798 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:37.799 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.799 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.800 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "7.b", 2021-10-08T19:24:37.800 INFO:teuthology.orchestra.run.smithi097.stdout: "osds": [ 2021-10-08T19:24:37.801 INFO:teuthology.orchestra.run.smithi097.stdout: 1, 2021-10-08T19:24:37.801 INFO:teuthology.orchestra.run.smithi097.stdout: 5 2021-10-08T19:24:37.801 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:37.802 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.802 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.803 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "7.c", 2021-10-08T19:24:37.803 INFO:teuthology.orchestra.run.smithi097.stdout: "osds": [ 2021-10-08T19:24:37.803 INFO:teuthology.orchestra.run.smithi097.stdout: 2, 2021-10-08T19:24:37.804 INFO:teuthology.orchestra.run.smithi097.stdout: 3, 2021-10-08T19:24:37.804 INFO:teuthology.orchestra.run.smithi097.stdout: 7 2021-10-08T19:24:37.804 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:37.805 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.805 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:37.806 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "7.d", 2021-10-08T19:24:37.806 INFO:teuthology.orchestra.run.smithi097.stdout: "osds": [ 2021-10-08T19:24:37.806 INFO:teuthology.orchestra.run.smithi097.stdout: 1, 2021-10-08T19:24:37.807 INFO:teuthology.orchestra.run.smithi097.stdout: 0 2021-10-08T19:24:37.807 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:37.807 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:37.807 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:24:37.808 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_temp": [], 2021-10-08T19:24:37.808 INFO:teuthology.orchestra.run.smithi097.stdout: "blocklist": { 2021-10-08T19:24:37.808 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/2600364788": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:24:37.808 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/4129083289": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:24:37.808 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/1443158975": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:24:37.809 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/2472640384": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:24:37.809 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/3196919488": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:24:37.809 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:6800/3195862546": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:24:37.809 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:6800/3931202434": "2021-10-09T19:17:10.051948+0000", 2021-10-08T19:24:37.810 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/2761595213": "2021-10-09T19:17:10.051948+0000", 2021-10-08T19:24:37.810 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/900681504": "2021-10-09T19:17:10.051948+0000", 2021-10-08T19:24:37.810 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/3932251406": "2021-10-09T19:17:10.051948+0000", 2021-10-08T19:24:37.810 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/398006785": "2021-10-09T19:16:48.651177+0000", 2021-10-08T19:24:37.811 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/1642570050": "2021-10-09T19:16:48.651177+0000", 2021-10-08T19:24:37.811 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/300178790": "2021-10-09T19:16:48.651177+0000", 2021-10-08T19:24:37.811 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:6800/845999767": "2021-10-09T19:16:48.651177+0000" 2021-10-08T19:24:37.811 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.811 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profiles": { 2021-10-08T19:24:37.812 INFO:teuthology.orchestra.run.smithi097.stdout: "default": { 2021-10-08T19:24:37.812 INFO:teuthology.orchestra.run.smithi097.stdout: "crush-failure-domain": "osd", 2021-10-08T19:24:37.812 INFO:teuthology.orchestra.run.smithi097.stdout: "k": "2", 2021-10-08T19:24:37.812 INFO:teuthology.orchestra.run.smithi097.stdout: "m": "1", 2021-10-08T19:24:37.812 INFO:teuthology.orchestra.run.smithi097.stdout: "plugin": "jerasure", 2021-10-08T19:24:37.813 INFO:teuthology.orchestra.run.smithi097.stdout: "technique": "reed_sol_van" 2021-10-08T19:24:37.813 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:37.813 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:37.813 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps_queue": [], 2021-10-08T19:24:37.814 INFO:teuthology.orchestra.run.smithi097.stdout: "new_removed_snaps": [], 2021-10-08T19:24:37.814 INFO:teuthology.orchestra.run.smithi097.stdout: "new_purged_snaps": [], 2021-10-08T19:24:37.814 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_node_flags": {}, 2021-10-08T19:24:37.814 INFO:teuthology.orchestra.run.smithi097.stdout: "device_class_flags": {}, 2021-10-08T19:24:37.815 INFO:teuthology.orchestra.run.smithi097.stdout: "stretch_mode": { 2021-10-08T19:24:37.815 INFO:teuthology.orchestra.run.smithi097.stdout: "stretch_mode_enabled": false, 2021-10-08T19:24:37.815 INFO:teuthology.orchestra.run.smithi097.stdout: "stretch_bucket_count": 0, 2021-10-08T19:24:37.815 INFO:teuthology.orchestra.run.smithi097.stdout: "degraded_stretch_mode": 0, 2021-10-08T19:24:37.815 INFO:teuthology.orchestra.run.smithi097.stdout: "recovering_stretch_mode": 0, 2021-10-08T19:24:37.816 INFO:teuthology.orchestra.run.smithi097.stdout: "stretch_mode_bucket": 0 2021-10-08T19:24:37.816 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:37.816 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:24:37.817 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:37 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:24:37.818 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:37 smithi117 ceph-mon[34585]: pgmap v136: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 153 active+clean; 3.3 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 810 B/s rd, 42 MiB/s wr, 674 op/s; 6114/164775 objects degraded (3.711%); 8932/164775 objects misplaced (5.421%); 1.7 MiB/s, 27 objects/s recovering 2021-10-08T19:24:37.818 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:37 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/355825508' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:24:37.818 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:37 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:24:37.818 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:37 smithi097 ceph-mon[41966]: pgmap v136: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 153 active+clean; 3.3 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 810 B/s rd, 42 MiB/s wr, 674 op/s; 6114/164775 objects degraded (3.711%); 8932/164775 objects misplaced (5.421%); 1.7 MiB/s, 27 objects/s recovering 2021-10-08T19:24:37.819 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:37 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/355825508' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:24:38.260 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 45 16 58691 58675 81.4361 55.875 0.0187482 0.0122735 2021-10-08T19:24:38.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:38 smithi117 ceph-mon[34585]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:24:38.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:38 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/355825508' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:24:38.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:38 smithi117 ceph-mon[34585]: osdmap e120: 8 total, 8 up, 8 in 2021-10-08T19:24:38.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:38 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/24034797' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2021-10-08T19:24:38.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:38 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:24:38.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:38 smithi097 ceph-mon[32687]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:24:38.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:38 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/355825508' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:24:38.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:38 smithi097 ceph-mon[32687]: osdmap e120: 8 total, 8 up, 8 in 2021-10-08T19:24:38.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:38 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/24034797' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2021-10-08T19:24:38.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:38 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:24:38.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:38 smithi097 ceph-mon[41966]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:24:38.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:38 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/355825508' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:24:38.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:38 smithi097 ceph-mon[41966]: osdmap e120: 8 total, 8 up, 8 in 2021-10-08T19:24:38.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:38 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/24034797' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2021-10-08T19:24:38.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:38 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:24:39.260 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 46 16 59534 59518 80.8099 52.6875 0.00787326 0.0123691 2021-10-08T19:24:39.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:39 smithi117 ceph-mon[34585]: pgmap v138: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 153 active+clean; 3.5 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1.7 KiB/s rd, 69 MiB/s wr, 1.10k op/s; 6114/171756 objects degraded (3.560%); 8816/171756 objects misplaced (5.133%); 3.0 MiB/s, 48 objects/s recovering 2021-10-08T19:24:39.719 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:39 smithi097 ceph-mon[41966]: pgmap v138: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 153 active+clean; 3.5 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1.7 KiB/s rd, 69 MiB/s wr, 1.10k op/s; 6114/171756 objects degraded (3.560%); 8816/171756 objects misplaced (5.133%); 3.0 MiB/s, 48 objects/s recovering 2021-10-08T19:24:39.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:39 smithi097 ceph-mon[32687]: pgmap v138: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 153 active+clean; 3.5 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1.7 KiB/s rd, 69 MiB/s wr, 1.10k op/s; 6114/171756 objects degraded (3.560%); 8816/171756 objects misplaced (5.133%); 3.0 MiB/s, 48 objects/s recovering 2021-10-08T19:24:39.738 INFO:tasks.thrashosds.thrasher:j is {'epoch': 120, 'fsid': '1d01f6d6-286c-11ec-8c25-001a4aab830c', 'created': '2021-10-08T19:16:25.258003+0000', 'modified': '2021-10-08T19:24:37.371240+0000', 'last_up_change': '2021-10-08T19:21:15.388758+0000', 'last_in_change': '2021-10-08T19:24:24.060804+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 18, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 7, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'quincy', 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2021-10-08T19:19:44.413311+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': '.rgw.root', 'create_time': '2021-10-08T19:21:21.940881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 3, 'pool_name': 'iscsi', 'create_time': '2021-10-08T19:21:22.536945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 13, 'pg_placement_num': 13, 'pg_placement_num_target': 13, 'pg_num_target': 13, 'pg_num_pending': 13, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '107', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '106', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 4, 'pool_name': 'default.rgw.log', 'create_time': '2021-10-08T19:21:23.886328+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 5, 'pool_name': 'default.rgw.control', 'create_time': '2021-10-08T19:21:25.865032+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 6, 'pool_name': 'default.rgw.meta', 'create_time': '2021-10-08T19:21:27.940767+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '69', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 8}, 'application_metadata': {'rgw': {}}}, {'pool': 7, 'pool_name': 'unique_pool_0', 'create_time': '2021-10-08T19:23:43.485480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '98', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}], 'osds': [{'osd': 0, 'uuid': '9e64e714-a5d5-4fbb-ae2b-1df4bf14b8e0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 113, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6801', 'nonce': 3354161282}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6802', 'nonce': 3354161282}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6804', 'nonce': 3354161282}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6803', 'nonce': 3354161282}]}, 'public_addr': '172.21.15.97:6801/3354161282', 'cluster_addr': '172.21.15.97:6802/3354161282', 'heartbeat_back_addr': '172.21.15.97:6804/3354161282', 'heartbeat_front_addr': '172.21.15.97:6803/3354161282', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '32602a22-f263-4b62-a8d8-50fddfb73fa8', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 113, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6805', 'nonce': 735799205}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6806', 'nonce': 735799205}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6808', 'nonce': 735799205}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6807', 'nonce': 735799205}]}, 'public_addr': '172.21.15.97:6805/735799205', 'cluster_addr': '172.21.15.97:6806/735799205', 'heartbeat_back_addr': '172.21.15.97:6808/735799205', 'heartbeat_front_addr': '172.21.15.97:6807/735799205', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '88e0e4a2-b4a3-4a00-8669-03c3d9b166c5', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 18, 'up_thru': 113, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6809', 'nonce': 2366482649}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6810', 'nonce': 2366482649}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6812', 'nonce': 2366482649}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6811', 'nonce': 2366482649}]}, 'public_addr': '172.21.15.97:6809/2366482649', 'cluster_addr': '172.21.15.97:6810/2366482649', 'heartbeat_back_addr': '172.21.15.97:6812/2366482649', 'heartbeat_front_addr': '172.21.15.97:6811/2366482649', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': 'e689d708-b501-4526-a31a-1e598b74654d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 24, 'up_thru': 112, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6813', 'nonce': 3191181122}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6814', 'nonce': 3191181122}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6816', 'nonce': 3191181122}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6815', 'nonce': 3191181122}]}, 'public_addr': '172.21.15.97:6813/3191181122', 'cluster_addr': '172.21.15.97:6814/3191181122', 'heartbeat_back_addr': '172.21.15.97:6816/3191181122', 'heartbeat_front_addr': '172.21.15.97:6815/3191181122', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '67e4730a-be1c-4d88-9307-e3c2cf3ab2ef', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 30, 'up_thru': 113, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6800', 'nonce': 106778208}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6801', 'nonce': 106778208}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6803', 'nonce': 106778208}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6802', 'nonce': 106778208}]}, 'public_addr': '172.21.15.117:6800/106778208', 'cluster_addr': '172.21.15.117:6801/106778208', 'heartbeat_back_addr': '172.21.15.117:6803/106778208', 'heartbeat_front_addr': '172.21.15.117:6802/106778208', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'f9fd3153-3e4e-4489-8927-a65641f05d42', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 38, 'up_thru': 112, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6804', 'nonce': 3199889891}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6805', 'nonce': 3199889891}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6807', 'nonce': 3199889891}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6806', 'nonce': 3199889891}]}, 'public_addr': '172.21.15.117:6804/3199889891', 'cluster_addr': '172.21.15.117:6805/3199889891', 'heartbeat_back_addr': '172.21.15.117:6807/3199889891', 'heartbeat_front_addr': '172.21.15.117:6806/3199889891', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '84898f12-c37d-4eb6-8b71-5b86bfe16e7d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 47, 'up_thru': 112, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6808', 'nonce': 2185843951}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6809', 'nonce': 2185843951}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6811', 'nonce': 2185843951}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6810', 'nonce': 2185843951}]}, 'public_addr': '172.21.15.117:6808/2185843951', 'cluster_addr': '172.21.15.117:6809/2185843951', 'heartbeat_back_addr': '172.21.15.117:6811/2185843951', 'heartbeat_front_addr': '172.21.15.117:6810/2185843951', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '529af2ce-2ae9-41ed-8c8e-d133628cfd20', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 55, 'up_thru': 115, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6812', 'nonce': 2817683239}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6813', 'nonce': 2817683239}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6815', 'nonce': 2817683239}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6814', 'nonce': 2817683239}]}, 'public_addr': '172.21.15.117:6812/2817683239', 'cluster_addr': '172.21.15.117:6813/2817683239', 'heartbeat_back_addr': '172.21.15.117:6815/2817683239', 'heartbeat_front_addr': '172.21.15.117:6814/2817683239', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:24:07.227563+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:23:24.796649+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:24:29.688484+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:24:34.979406+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:24:02.266300+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:24:14.720341+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:24:32.387840+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:23:47.776253+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [{'pgid': '2.0', 'mappings': [{'from': 7, 'to': 2}]}, {'pgid': '2.1a', 'mappings': [{'from': 7, 'to': 2}]}, {'pgid': '4.13', 'mappings': [{'from': 1, 'to': 2}]}, {'pgid': '4.14', 'mappings': [{'from': 3, 'to': 2}]}, {'pgid': '4.18', 'mappings': [{'from': 1, 'to': 2}]}, {'pgid': '4.1c', 'mappings': [{'from': 1, 'to': 5}]}], 'pg_temp': [{'pgid': '7.1', 'osds': [4, 3]}, {'pgid': '7.7', 'osds': [0, 3]}, {'pgid': '7.b', 'osds': [1, 5]}, {'pgid': '7.c', 'osds': [2, 3, 7]}, {'pgid': '7.d', 'osds': [1, 0]}], 'primary_temp': [], 'blocklist': {'172.21.15.97:0/2600364788': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:0/4129083289': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:0/1443158975': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:0/2472640384': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:0/3196919488': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:6800/3195862546': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:6800/3931202434': '2021-10-09T19:17:10.051948+0000', '172.21.15.97:0/2761595213': '2021-10-09T19:17:10.051948+0000', '172.21.15.97:0/900681504': '2021-10-09T19:17:10.051948+0000', '172.21.15.97:0/3932251406': '2021-10-09T19:17:10.051948+0000', '172.21.15.97:0/398006785': '2021-10-09T19:16:48.651177+0000', '172.21.15.97:0/1642570050': '2021-10-09T19:16:48.651177+0000', '172.21.15.97:0/300178790': '2021-10-09T19:16:48.651177+0000', '172.21.15.97:6800/845999767': '2021-10-09T19:16:48.651177+0000'}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2021-10-08T19:24:39.739 INFO:tasks.thrashosds.thrasher:Clearing pg_upmap on 4.13 2021-10-08T19:24:39.739 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd rm-pg-upmap-items 4.13 2021-10-08T19:24:40.187 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:24:40.191 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:40.192 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:24:40.261 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 47 15 60400 60385 80.2437 54.1875 0.00829751 0.0124548 2021-10-08T19:24:40.294 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:24:40.320 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:40.374 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:24:40.378 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:40.379 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:24:40.480 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:24:40.512 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:40.577 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:24:40.579 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:40 smithi117 ceph-mon[34585]: Health check update: Degraded data redundancy: 6114/171756 objects degraded (3.560%), 2 pgs degraded (PG_DEGRADED) 2021-10-08T19:24:40.579 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:40 smithi117 ceph-mon[34585]: osdmap e121: 8 total, 8 up, 8 in 2021-10-08T19:24:40.580 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:40.580 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:24:40.682 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:24:40.714 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:40.774 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:24:40.778 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:40.779 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:24:40.880 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:24:40.951 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:40 smithi097 ceph-mon[32687]: Health check update: Degraded data redundancy: 6114/171756 objects degraded (3.560%), 2 pgs degraded (PG_DEGRADED) 2021-10-08T19:24:40.951 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:40 smithi097 ceph-mon[32687]: osdmap e121: 8 total, 8 up, 8 in 2021-10-08T19:24:40.952 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:40 smithi097 ceph-mon[41966]: Health check update: Degraded data redundancy: 6114/171756 objects degraded (3.560%), 2 pgs degraded (PG_DEGRADED) 2021-10-08T19:24:40.952 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:40 smithi097 ceph-mon[41966]: osdmap e121: 8 total, 8 up, 8 in 2021-10-08T19:24:40.953 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:41.027 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:24:41.136 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:24:41.145 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:41.146 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:24:41.247 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:24:41.263 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 48 16 61252 61236 79.6791 53.1875 0.00973086 0.0125421 2021-10-08T19:24:41.319 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:41.469 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:24:41.488 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:24:41.488 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2021-10-08T19:24:41.489 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2021-10-08T19:24:41.489 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2021-10-08T19:24:41.489 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.490 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:32141 7.e 7:7734bdac:::benchmark_data_smithi097_93198_object32140:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2021-10-08T19:24:41.490 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:09.663951+0000", 2021-10-08T19:24:41.490 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 31.820994684999999, 2021-10-08T19:24:41.490 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.103603693, 2021-10-08T19:24:41.491 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:24:41.491 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:24:41.491 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:24:41.491 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:24:41.491 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:24:41.492 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 32141 2021-10-08T19:24:41.492 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.492 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:24:41.493 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.493 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:24:41.493 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.663951+0000", 2021-10-08T19:24:41.493 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:24:41.493 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.494 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.494 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:24:41.495 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.663951+0000", 2021-10-08T19:24:41.495 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:24:41.495 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.496 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.496 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:24:41.496 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.663948+0000", 2021-10-08T19:24:41.496 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:24:41.497 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.497 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.497 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:24:41.497 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.663974+0000", 2021-10-08T19:24:41.497 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5099000000000001e-05 2021-10-08T19:24:41.498 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.498 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.498 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:24:41.498 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.663984+0000", 2021-10-08T19:24:41.499 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0932e-05 2021-10-08T19:24:41.499 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.499 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.499 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:24:41.500 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.663991+0000", 2021-10-08T19:24:41.500 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3720000000000001e-06 2021-10-08T19:24:41.501 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.501 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.501 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:24:41.501 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.664039+0000", 2021-10-08T19:24:41.502 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7814e-05 2021-10-08T19:24:41.502 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.502 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.502 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:24:41.503 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.664167+0000", 2021-10-08T19:24:41.503 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000128138 2021-10-08T19:24:41.503 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.503 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.504 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:24:41.504 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.664286+0000", 2021-10-08T19:24:41.504 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011924100000000001 2021-10-08T19:24:41.504 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.504 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.505 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:24:41.505 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.667248+0000", 2021-10-08T19:24:41.505 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029622390000000002 2021-10-08T19:24:41.506 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.506 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.506 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:24:41.507 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.667255+0000", 2021-10-08T19:24:41.507 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5189999999999998e-06 2021-10-08T19:24:41.507 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.507 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.507 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:24:41.508 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.767461+0000", 2021-10-08T19:24:41.508 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.100205884 2021-10-08T19:24:41.508 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.508 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.509 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:24:41.509 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.767515+0000", 2021-10-08T19:24:41.509 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4459999999999997e-05 2021-10-08T19:24:41.509 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.510 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.510 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:24:41.510 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.767555+0000", 2021-10-08T19:24:41.511 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9369000000000002e-05 2021-10-08T19:24:41.511 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:41.511 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:41.512 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:41.512 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.512 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.512 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:32142 7.e 7:76ef7bea:::benchmark_data_smithi097_93198_object32141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2021-10-08T19:24:41.513 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:09.665046+0000", 2021-10-08T19:24:41.513 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 31.819899185000001, 2021-10-08T19:24:41.513 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.10262069, 2021-10-08T19:24:41.513 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:24:41.514 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:24:41.514 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:24:41.514 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:24:41.515 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:24:41.515 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 32142 2021-10-08T19:24:41.515 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.515 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:24:41.516 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.516 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:24:41.516 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.665046+0000", 2021-10-08T19:24:41.516 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:24:41.517 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.517 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.517 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:24:41.517 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.665046+0000", 2021-10-08T19:24:41.518 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:24:41.518 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.518 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.519 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:24:41.519 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.665045+0000", 2021-10-08T19:24:41.519 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2021-10-08T19:24:41.519 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.520 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.520 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:24:41.520 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.665065+0000", 2021-10-08T19:24:41.520 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.022e-05 2021-10-08T19:24:41.520 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.521 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.521 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:24:41.521 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.665076+0000", 2021-10-08T19:24:41.521 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0669999999999999e-05 2021-10-08T19:24:41.521 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.522 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.522 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:24:41.522 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.665082+0000", 2021-10-08T19:24:41.522 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2670000000000003e-06 2021-10-08T19:24:41.523 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.523 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.523 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:24:41.523 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.665284+0000", 2021-10-08T19:24:41.523 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00020172000000000001 2021-10-08T19:24:41.524 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.524 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.524 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:24:41.524 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.665383+0000", 2021-10-08T19:24:41.524 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.9408999999999996e-05 2021-10-08T19:24:41.525 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.525 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.525 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:24:41.525 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.665476+0000", 2021-10-08T19:24:41.525 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.3245000000000006e-05 2021-10-08T19:24:41.526 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.526 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.526 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:24:41.526 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.667261+0000", 2021-10-08T19:24:41.527 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001784108 2021-10-08T19:24:41.527 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.527 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.527 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:24:41.527 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.667293+0000", 2021-10-08T19:24:41.528 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2186e-05 2021-10-08T19:24:41.528 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.528 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.528 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:24:41.528 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.767591+0000", 2021-10-08T19:24:41.529 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.100298515 2021-10-08T19:24:41.529 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.529 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.529 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:24:41.529 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.767629+0000", 2021-10-08T19:24:41.530 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7818999999999998e-05 2021-10-08T19:24:41.530 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.530 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.530 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:24:41.531 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.767667+0000", 2021-10-08T19:24:41.531 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7920000000000003e-05 2021-10-08T19:24:41.531 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:41.531 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:41.531 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:41.532 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.532 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.532 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:32143 7.e 7:7f65a458:::benchmark_data_smithi097_93198_object32142:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2021-10-08T19:24:41.532 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:09.665106+0000", 2021-10-08T19:24:41.532 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 31.819839534, 2021-10-08T19:24:41.533 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.10265624299999999, 2021-10-08T19:24:41.533 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:24:41.533 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:24:41.533 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:24:41.533 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:24:41.534 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:24:41.534 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 32143 2021-10-08T19:24:41.534 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.534 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:24:41.535 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.535 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:24:41.535 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.665106+0000", 2021-10-08T19:24:41.535 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:24:41.535 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.536 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.536 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:24:41.536 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.665106+0000", 2021-10-08T19:24:41.536 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:24:41.536 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.537 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.537 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:24:41.537 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.665105+0000", 2021-10-08T19:24:41.537 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:24:41.537 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.538 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.538 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:24:41.538 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.665144+0000", 2021-10-08T19:24:41.538 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9019e-05 2021-10-08T19:24:41.539 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.539 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.539 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:24:41.539 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.665152+0000", 2021-10-08T19:24:41.539 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1829999999999994e-06 2021-10-08T19:24:41.540 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.540 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.540 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:24:41.540 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.665157+0000", 2021-10-08T19:24:41.540 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1309999999999997e-06 2021-10-08T19:24:41.541 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.541 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.541 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:24:41.541 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.666433+0000", 2021-10-08T19:24:41.541 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012755170000000001 2021-10-08T19:24:41.542 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.542 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.542 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:24:41.542 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.666539+0000", 2021-10-08T19:24:41.543 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010647899999999999 2021-10-08T19:24:41.543 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.543 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.543 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:24:41.543 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.666667+0000", 2021-10-08T19:24:41.544 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012779600000000001 2021-10-08T19:24:41.544 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.544 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.544 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:24:41.545 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.667364+0000", 2021-10-08T19:24:41.545 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00069719499999999995 2021-10-08T19:24:41.545 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.545 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.545 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:24:41.546 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.667568+0000", 2021-10-08T19:24:41.546 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00020368799999999999 2021-10-08T19:24:41.546 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.546 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.546 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:24:41.547 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.767703+0000", 2021-10-08T19:24:41.547 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.10013480299999999 2021-10-08T19:24:41.547 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.547 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.548 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:24:41.548 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.767738+0000", 2021-10-08T19:24:41.548 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5509999999999997e-05 2021-10-08T19:24:41.548 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.548 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.549 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:24:41.549 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.767762+0000", 2021-10-08T19:24:41.549 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3869000000000001e-05 2021-10-08T19:24:41.549 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:41.550 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:41.550 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:41.550 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.550 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.550 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:40670 7.e 7:79f4d2b7:::benchmark_data_smithi097_93198_object40669:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2021-10-08T19:24:41.551 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:16.257106+0000", 2021-10-08T19:24:41.551 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 25.227839282000001, 2021-10-08T19:24:41.551 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.123129141, 2021-10-08T19:24:41.551 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:24:41.552 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:24:41.552 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:24:41.552 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:24:41.552 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:24:41.552 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 40670 2021-10-08T19:24:41.553 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.553 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:24:41.553 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.553 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:24:41.553 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.257106+0000", 2021-10-08T19:24:41.554 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:24:41.554 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.554 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.554 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:24:41.554 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.257106+0000", 2021-10-08T19:24:41.555 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:24:41.555 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.555 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.555 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:24:41.555 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.257104+0000", 2021-10-08T19:24:41.556 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:24:41.556 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.556 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.556 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:24:41.557 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.257130+0000", 2021-10-08T19:24:41.557 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5962e-05 2021-10-08T19:24:41.557 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.557 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.557 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:24:41.558 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.257144+0000", 2021-10-08T19:24:41.558 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.45e-05 2021-10-08T19:24:41.558 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.558 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.558 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:24:41.559 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.257152+0000", 2021-10-08T19:24:41.559 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7179999999999996e-06 2021-10-08T19:24:41.559 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.559 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.559 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:24:41.560 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.257212+0000", 2021-10-08T19:24:41.560 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.982e-05 2021-10-08T19:24:41.560 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.560 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.560 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:24:41.561 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.257339+0000", 2021-10-08T19:24:41.561 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012701100000000001 2021-10-08T19:24:41.561 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.561 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.561 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:24:41.562 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.257483+0000", 2021-10-08T19:24:41.562 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014382500000000001 2021-10-08T19:24:41.562 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.562 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.562 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:24:41.563 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.258908+0000", 2021-10-08T19:24:41.563 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0014255209999999999 2021-10-08T19:24:41.563 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.563 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.564 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:24:41.564 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.259885+0000", 2021-10-08T19:24:41.564 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00097671600000000009 2021-10-08T19:24:41.564 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.564 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.565 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:24:41.565 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.380148+0000", 2021-10-08T19:24:41.565 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.12026337600000001 2021-10-08T19:24:41.565 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.565 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.566 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:24:41.566 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.380200+0000", 2021-10-08T19:24:41.566 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1218999999999999e-05 2021-10-08T19:24:41.566 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.567 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.567 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:24:41.567 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.380235+0000", 2021-10-08T19:24:41.567 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5683999999999999e-05 2021-10-08T19:24:41.567 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:41.568 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:41.568 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:41.568 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.568 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.569 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:41096 7.e 7:774f7680:::benchmark_data_smithi097_93198_object41095:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2021-10-08T19:24:41.569 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:16.758785+0000", 2021-10-08T19:24:41.569 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 24.726160813, 2021-10-08T19:24:41.569 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.098916497000000006, 2021-10-08T19:24:41.570 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:24:41.570 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:24:41.570 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:24:41.571 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:24:41.571 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:24:41.571 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 41096 2021-10-08T19:24:41.571 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.571 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:24:41.572 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.572 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:24:41.572 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.758785+0000", 2021-10-08T19:24:41.572 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:24:41.573 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.573 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.573 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:24:41.573 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.758785+0000", 2021-10-08T19:24:41.573 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:24:41.574 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.574 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.574 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:24:41.574 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.758782+0000", 2021-10-08T19:24:41.574 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2021-10-08T19:24:41.575 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.575 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.575 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:24:41.575 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.758816+0000", 2021-10-08T19:24:41.576 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4530000000000003e-05 2021-10-08T19:24:41.576 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.576 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.576 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:24:41.576 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.758831+0000", 2021-10-08T19:24:41.577 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4639e-05 2021-10-08T19:24:41.577 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.577 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.577 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:24:41.577 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.758839+0000", 2021-10-08T19:24:41.578 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.9829999999999996e-06 2021-10-08T19:24:41.578 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.578 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.578 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:24:41.579 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.758893+0000", 2021-10-08T19:24:41.579 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4589999999999997e-05 2021-10-08T19:24:41.579 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.579 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.579 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:24:41.580 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.759022+0000", 2021-10-08T19:24:41.580 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000128288 2021-10-08T19:24:41.580 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.580 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.580 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:24:41.581 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.759160+0000", 2021-10-08T19:24:41.581 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000138734 2021-10-08T19:24:41.581 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.581 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.582 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:24:41.582 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.761139+0000", 2021-10-08T19:24:41.582 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0019787339999999998 2021-10-08T19:24:41.582 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.582 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.583 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:24:41.583 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.761887+0000", 2021-10-08T19:24:41.583 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00074735399999999999 2021-10-08T19:24:41.583 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.583 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.584 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:24:41.584 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.857615+0000", 2021-10-08T19:24:41.584 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.095728005000000005 2021-10-08T19:24:41.584 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.584 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.585 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:24:41.585 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.857662+0000", 2021-10-08T19:24:41.585 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7602999999999998e-05 2021-10-08T19:24:41.585 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.586 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.586 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:24:41.586 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.857701+0000", 2021-10-08T19:24:41.586 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9038000000000001e-05 2021-10-08T19:24:41.586 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:41.587 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:41.587 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:41.587 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.587 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.587 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:41108 7.e 7:7d11b80a:::benchmark_data_smithi097_93198_object41107:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2021-10-08T19:24:41.588 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:16.767962+0000", 2021-10-08T19:24:41.588 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 24.716983205999998, 2021-10-08T19:24:41.588 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.091707496999999999, 2021-10-08T19:24:41.588 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:24:41.588 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:24:41.589 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:24:41.589 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:24:41.589 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:24:41.589 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 41108 2021-10-08T19:24:41.589 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.590 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:24:41.590 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.590 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:24:41.590 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.767962+0000", 2021-10-08T19:24:41.591 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:24:41.591 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.591 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.591 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:24:41.591 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.767962+0000", 2021-10-08T19:24:41.592 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:24:41.592 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.592 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.592 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:24:41.592 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.767960+0000", 2021-10-08T19:24:41.593 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:24:41.593 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.593 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.593 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:24:41.593 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.767984+0000", 2021-10-08T19:24:41.594 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3257000000000001e-05 2021-10-08T19:24:41.594 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.594 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.594 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:24:41.594 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.767994+0000", 2021-10-08T19:24:41.595 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0801999999999999e-05 2021-10-08T19:24:41.595 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.595 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.595 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:24:41.595 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.768001+0000", 2021-10-08T19:24:41.596 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.212e-06 2021-10-08T19:24:41.596 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.596 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.596 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:24:41.597 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.768058+0000", 2021-10-08T19:24:41.597 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7648000000000001e-05 2021-10-08T19:24:41.597 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.597 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.597 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:24:41.598 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.768174+0000", 2021-10-08T19:24:41.598 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011545 2021-10-08T19:24:41.598 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.598 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.598 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:24:41.599 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.768290+0000", 2021-10-08T19:24:41.599 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115914 2021-10-08T19:24:41.599 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.599 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.599 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:24:41.600 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.769593+0000", 2021-10-08T19:24:41.600 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013037319999999999 2021-10-08T19:24:41.600 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.600 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.600 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:24:41.601 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.769833+0000", 2021-10-08T19:24:41.601 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023997600000000001 2021-10-08T19:24:41.601 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.601 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.601 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:24:41.602 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.859577+0000", 2021-10-08T19:24:41.602 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.089743332999999995 2021-10-08T19:24:41.602 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.602 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.603 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:24:41.603 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.859631+0000", 2021-10-08T19:24:41.603 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4509000000000003e-05 2021-10-08T19:24:41.603 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.603 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.604 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:24:41.604 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.859670+0000", 2021-10-08T19:24:41.604 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8608e-05 2021-10-08T19:24:41.604 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:41.604 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:41.605 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:41.605 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.605 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.605 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:41403 7.e 7:70d8bfed:::benchmark_data_smithi097_93198_object41402:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2021-10-08T19:24:41.605 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:17.050766+0000", 2021-10-08T19:24:41.606 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 24.434179675999999, 2021-10-08T19:24:41.606 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.093111305000000005, 2021-10-08T19:24:41.606 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:24:41.606 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:24:41.607 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:24:41.607 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:24:41.607 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:24:41.607 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 41403 2021-10-08T19:24:41.607 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.608 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:24:41.608 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.608 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:24:41.608 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:17.050766+0000", 2021-10-08T19:24:41.609 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:24:41.609 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.609 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.609 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:24:41.609 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:17.050766+0000", 2021-10-08T19:24:41.610 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:24:41.610 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.610 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.610 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:24:41.611 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:17.050764+0000", 2021-10-08T19:24:41.615 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2021-10-08T19:24:41.615 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.615 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.615 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:24:41.616 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:17.050787+0000", 2021-10-08T19:24:41.616 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2714999999999999e-05 2021-10-08T19:24:41.616 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.616 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.617 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:24:41.617 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:17.050801+0000", 2021-10-08T19:24:41.617 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3963e-05 2021-10-08T19:24:41.617 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.617 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.618 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:24:41.618 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:17.050808+0000", 2021-10-08T19:24:41.618 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4609999999999996e-06 2021-10-08T19:24:41.618 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.618 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.619 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:24:41.619 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:17.050859+0000", 2021-10-08T19:24:41.619 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1895999999999999e-05 2021-10-08T19:24:41.619 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.620 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.620 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:24:41.620 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:17.050989+0000", 2021-10-08T19:24:41.620 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000129116 2021-10-08T19:24:41.620 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.621 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.621 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:24:41.621 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:17.051130+0000", 2021-10-08T19:24:41.621 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014100899999999999 2021-10-08T19:24:41.621 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.622 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.622 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:24:41.622 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:17.053038+0000", 2021-10-08T19:24:41.622 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001908157 2021-10-08T19:24:41.622 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.623 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.623 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:24:41.623 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:17.054364+0000", 2021-10-08T19:24:41.623 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001325859 2021-10-08T19:24:41.624 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.624 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.624 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:24:41.624 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:17.143777+0000", 2021-10-08T19:24:41.624 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.089413267000000005 2021-10-08T19:24:41.625 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.625 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.625 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:24:41.625 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:17.143836+0000", 2021-10-08T19:24:41.625 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8891999999999998e-05 2021-10-08T19:24:41.626 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.626 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.626 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:24:41.626 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:17.143877+0000", 2021-10-08T19:24:41.626 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1359000000000002e-05 2021-10-08T19:24:41.627 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:41.627 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:41.627 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:41.627 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.627 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.628 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:41415 7.e 7:72dba47d:::benchmark_data_smithi097_93198_object41414:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2021-10-08T19:24:41.628 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:17.061035+0000", 2021-10-08T19:24:41.628 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 24.42391057, 2021-10-08T19:24:41.628 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.082959206999999993, 2021-10-08T19:24:41.628 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:24:41.629 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:24:41.629 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:24:41.629 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:24:41.629 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:24:41.630 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 41415 2021-10-08T19:24:41.630 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.630 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:24:41.630 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.631 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:24:41.631 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:17.061035+0000", 2021-10-08T19:24:41.631 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:24:41.631 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.631 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.632 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:24:41.632 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:17.061035+0000", 2021-10-08T19:24:41.632 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:24:41.632 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.632 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.633 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:24:41.633 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:17.061032+0000", 2021-10-08T19:24:41.633 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2021-10-08T19:24:41.633 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.633 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.634 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:24:41.634 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:17.061061+0000", 2021-10-08T19:24:41.634 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9249999999999999e-05 2021-10-08T19:24:41.634 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.634 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.635 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:24:41.635 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:17.061077+0000", 2021-10-08T19:24:41.635 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5755000000000001e-05 2021-10-08T19:24:41.635 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.635 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.636 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:24:41.636 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:17.061084+0000", 2021-10-08T19:24:41.636 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7460000000000003e-06 2021-10-08T19:24:41.636 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.636 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.637 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:24:41.637 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:17.061146+0000", 2021-10-08T19:24:41.637 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2386999999999997e-05 2021-10-08T19:24:41.637 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.638 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.638 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:24:41.638 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:17.061300+0000", 2021-10-08T19:24:41.638 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015365100000000001 2021-10-08T19:24:41.639 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.639 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.639 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:24:41.639 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:17.061504+0000", 2021-10-08T19:24:41.640 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000203864 2021-10-08T19:24:41.640 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.640 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.640 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:24:41.640 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:17.062992+0000", 2021-10-08T19:24:41.641 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001488461 2021-10-08T19:24:41.641 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.641 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.641 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:24:41.642 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:17.063111+0000", 2021-10-08T19:24:41.642 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011823 2021-10-08T19:24:41.642 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.642 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.642 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:24:41.643 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:17.143914+0000", 2021-10-08T19:24:41.643 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.080803336000000003 2021-10-08T19:24:41.643 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.643 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.643 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:24:41.644 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:17.143958+0000", 2021-10-08T19:24:41.644 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4552000000000003e-05 2021-10-08T19:24:41.644 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.644 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.644 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:24:41.645 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:17.143994+0000", 2021-10-08T19:24:41.645 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5685999999999997e-05 2021-10-08T19:24:41.645 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:41.645 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:41.645 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:41.646 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.646 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.646 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:51817 7.c 7:3b7150bc:::benchmark_data_smithi097_93198_object51816:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116)", 2021-10-08T19:24:41.646 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:29.870290+0000", 2021-10-08T19:24:41.647 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 11.614655326999999, 2021-10-08T19:24:41.647 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.061554449999999997, 2021-10-08T19:24:41.647 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:24:41.647 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:24:41.647 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:24:41.648 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:24:41.648 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:24:41.648 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 51817 2021-10-08T19:24:41.648 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.648 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:24:41.649 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.649 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:24:41.649 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:29.870290+0000", 2021-10-08T19:24:41.649 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:24:41.649 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.650 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.650 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:24:41.650 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:29.870290+0000", 2021-10-08T19:24:41.650 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:24:41.650 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.651 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.651 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:24:41.651 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:29.870288+0000", 2021-10-08T19:24:41.651 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:24:41.651 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.652 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.652 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:24:41.652 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:29.870314+0000", 2021-10-08T19:24:41.652 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5851999999999999e-05 2021-10-08T19:24:41.652 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.653 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.653 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:24:41.653 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:29.870331+0000", 2021-10-08T19:24:41.653 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6758000000000001e-05 2021-10-08T19:24:41.654 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.654 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.654 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:24:41.654 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:29.870339+0000", 2021-10-08T19:24:41.654 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2570000000000007e-06 2021-10-08T19:24:41.655 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.655 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.655 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:24:41.655 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:29.893450+0000", 2021-10-08T19:24:41.655 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.023111422 2021-10-08T19:24:41.656 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.656 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.656 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:24:41.656 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:29.895382+0000", 2021-10-08T19:24:41.656 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00193205 2021-10-08T19:24:41.657 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.657 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.657 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,6,7", 2021-10-08T19:24:41.657 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:29.895534+0000", 2021-10-08T19:24:41.657 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015149099999999999 2021-10-08T19:24:41.658 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.658 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.658 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:24:41.658 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:29.912128+0000", 2021-10-08T19:24:41.659 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016593763000000001 2021-10-08T19:24:41.659 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.659 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.659 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:24:41.660 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:29.915039+0000", 2021-10-08T19:24:41.660 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029116239999999998 2021-10-08T19:24:41.660 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.660 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.660 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:24:41.661 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:29.918746+0000", 2021-10-08T19:24:41.661 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003706591 2021-10-08T19:24:41.661 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.661 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.661 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:24:41.662 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:29.930474+0000", 2021-10-08T19:24:41.662 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011727912 2021-10-08T19:24:41.662 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.662 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.662 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:24:41.663 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:29.930546+0000", 2021-10-08T19:24:41.663 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2033999999999995e-05 2021-10-08T19:24:41.663 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.663 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.663 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:24:41.664 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:29.931845+0000", 2021-10-08T19:24:41.664 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012988559999999999 2021-10-08T19:24:41.664 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:41.664 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:41.665 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:41.665 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.665 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.665 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:52228 7.e 7:7e6af5bf:::benchmark_data_smithi097_93198_object52227:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117)", 2021-10-08T19:24:41.665 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:30.418498+0000", 2021-10-08T19:24:41.666 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 11.066447188, 2021-10-08T19:24:41.666 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.096454861000000003, 2021-10-08T19:24:41.666 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:24:41.666 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:24:41.666 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:24:41.667 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:24:41.667 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:24:41.667 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 52228 2021-10-08T19:24:41.667 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.667 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:24:41.668 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.668 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:24:41.668 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:30.418498+0000", 2021-10-08T19:24:41.668 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:24:41.668 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.669 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.669 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:24:41.669 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:30.418498+0000", 2021-10-08T19:24:41.669 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:24:41.670 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.670 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.670 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:24:41.670 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:30.418496+0000", 2021-10-08T19:24:41.670 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:24:41.671 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.671 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.671 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:24:41.671 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:30.418528+0000", 2021-10-08T19:24:41.671 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1566999999999998e-05 2021-10-08T19:24:41.672 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.672 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.672 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:24:41.672 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:30.418537+0000", 2021-10-08T19:24:41.672 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2820000000000002e-06 2021-10-08T19:24:41.673 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.673 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.674 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:24:41.674 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:30.418542+0000", 2021-10-08T19:24:41.674 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7280000000000003e-06 2021-10-08T19:24:41.675 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.675 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.675 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:24:41.675 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:30.418580+0000", 2021-10-08T19:24:41.675 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7901999999999997e-05 2021-10-08T19:24:41.676 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.676 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.676 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:24:41.676 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:30.418677+0000", 2021-10-08T19:24:41.676 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.6699000000000004e-05 2021-10-08T19:24:41.677 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.677 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.677 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:24:41.677 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:30.418776+0000", 2021-10-08T19:24:41.678 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.9160000000000006e-05 2021-10-08T19:24:41.678 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.678 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.678 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:24:41.678 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:30.420221+0000", 2021-10-08T19:24:41.679 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0014456269999999999 2021-10-08T19:24:41.679 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.679 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.679 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:24:41.679 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:30.420318+0000", 2021-10-08T19:24:41.680 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.7081000000000001e-05 2021-10-08T19:24:41.680 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.681 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.681 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:24:41.681 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:30.514856+0000", 2021-10-08T19:24:41.681 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.094537805000000003 2021-10-08T19:24:41.681 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.682 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.682 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:24:41.682 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:30.514911+0000", 2021-10-08T19:24:41.682 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5031999999999998e-05 2021-10-08T19:24:41.683 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.683 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.683 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:24:41.683 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:30.514953+0000", 2021-10-08T19:24:41.683 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1937999999999997e-05 2021-10-08T19:24:41.684 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:41.684 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:41.684 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:41.684 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.684 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.685 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:52229 7.e 7:7b0f2bf8:::benchmark_data_smithi097_93198_object52228:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117)", 2021-10-08T19:24:41.685 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:30.420685+0000", 2021-10-08T19:24:41.685 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 11.064260197999999, 2021-10-08T19:24:41.685 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.095329276000000004, 2021-10-08T19:24:41.685 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:24:41.686 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:24:41.686 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:24:41.686 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:24:41.686 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:24:41.687 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 52229 2021-10-08T19:24:41.687 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.687 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:24:41.687 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.687 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:24:41.688 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:30.420685+0000", 2021-10-08T19:24:41.688 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:24:41.688 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.688 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.688 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:24:41.689 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:30.420685+0000", 2021-10-08T19:24:41.689 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:24:41.689 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.689 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.689 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:24:41.690 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:30.420684+0000", 2021-10-08T19:24:41.690 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2021-10-08T19:24:41.690 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.690 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.691 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:24:41.691 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:30.420705+0000", 2021-10-08T19:24:41.691 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0837999999999999e-05 2021-10-08T19:24:41.691 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.691 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.692 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:24:41.692 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:30.420714+0000", 2021-10-08T19:24:41.692 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8710000000000003e-06 2021-10-08T19:24:41.692 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.692 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.693 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:24:41.693 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:30.420718+0000", 2021-10-08T19:24:41.693 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.656e-06 2021-10-08T19:24:41.693 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.693 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.694 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:24:41.694 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:30.420751+0000", 2021-10-08T19:24:41.694 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2629000000000002e-05 2021-10-08T19:24:41.694 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.695 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.695 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:24:41.695 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:30.420825+0000", 2021-10-08T19:24:41.695 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4499999999999995e-05 2021-10-08T19:24:41.695 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.696 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.696 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:24:41.696 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:30.420908+0000", 2021-10-08T19:24:41.696 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2657000000000005e-05 2021-10-08T19:24:41.696 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.697 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.697 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:24:41.697 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:30.421907+0000", 2021-10-08T19:24:41.697 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00099856100000000002 2021-10-08T19:24:41.697 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.698 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.698 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:24:41.698 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:30.422136+0000", 2021-10-08T19:24:41.698 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022975299999999999 2021-10-08T19:24:41.699 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.699 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.699 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:24:41.699 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:30.515932+0000", 2021-10-08T19:24:41.699 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.093796136000000002 2021-10-08T19:24:41.700 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.700 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.700 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:24:41.700 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:30.515980+0000", 2021-10-08T19:24:41.700 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7261e-05 2021-10-08T19:24:41.701 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.701 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.701 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:24:41.701 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:30.516015+0000", 2021-10-08T19:24:41.702 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4901999999999999e-05 2021-10-08T19:24:41.702 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:41.702 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:41.702 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:41.702 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.703 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.703 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:54369 7.c 7:3432ee6a:::benchmark_data_smithi097_93198_object54368:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117)", 2021-10-08T19:24:41.703 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:32.902201+0000", 2021-10-08T19:24:41.703 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 8.5827449139999992, 2021-10-08T19:24:41.704 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.063335578000000003, 2021-10-08T19:24:41.704 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:24:41.704 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:24:41.704 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:24:41.704 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:24:41.705 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:24:41.705 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 54369 2021-10-08T19:24:41.705 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.705 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:24:41.705 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.706 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:24:41.706 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:32.902201+0000", 2021-10-08T19:24:41.706 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:24:41.706 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.706 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.707 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:24:41.707 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:32.902201+0000", 2021-10-08T19:24:41.707 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:24:41.707 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.708 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.708 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:24:41.708 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:32.902199+0000", 2021-10-08T19:24:41.708 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:24:41.708 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.709 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.709 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:24:41.709 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:32.902228+0000", 2021-10-08T19:24:41.709 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8949e-05 2021-10-08T19:24:41.709 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.710 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.710 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:24:41.710 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:32.902236+0000", 2021-10-08T19:24:41.710 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3650000000000004e-06 2021-10-08T19:24:41.711 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.711 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.711 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:24:41.711 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:32.902241+0000", 2021-10-08T19:24:41.711 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3290000000000001e-06 2021-10-08T19:24:41.712 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.712 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.712 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:24:41.712 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:32.908159+0000", 2021-10-08T19:24:41.712 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0059180420000000001 2021-10-08T19:24:41.713 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.713 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.713 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:24:41.713 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:32.908300+0000", 2021-10-08T19:24:41.713 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014074000000000001 2021-10-08T19:24:41.714 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.714 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.714 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,6,7", 2021-10-08T19:24:41.714 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:32.908421+0000", 2021-10-08T19:24:41.714 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012120699999999999 2021-10-08T19:24:41.715 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.715 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.715 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:24:41.715 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:32.912012+0000", 2021-10-08T19:24:41.716 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003591005 2021-10-08T19:24:41.716 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.716 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.716 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:24:41.716 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:32.912049+0000", 2021-10-08T19:24:41.717 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6470000000000001e-05 2021-10-08T19:24:41.717 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.717 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.717 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:24:41.717 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:32.912218+0000", 2021-10-08T19:24:41.718 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016867 2021-10-08T19:24:41.718 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.718 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.718 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:24:41.718 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:32.964380+0000", 2021-10-08T19:24:41.719 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.052162852000000003 2021-10-08T19:24:41.719 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.719 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.719 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:24:41.719 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:32.964417+0000", 2021-10-08T19:24:41.720 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6658e-05 2021-10-08T19:24:41.720 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.720 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.720 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:24:41.721 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:32.965536+0000", 2021-10-08T19:24:41.721 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011191420000000001 2021-10-08T19:24:41.721 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:41.721 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:41.721 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:41.722 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.722 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.722 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:54371 7.c 7:39f2a215:::benchmark_data_smithi097_93198_object54370:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117)", 2021-10-08T19:24:41.722 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:32.905942+0000", 2021-10-08T19:24:41.722 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 8.5790036369999996, 2021-10-08T19:24:41.723 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.060698688000000001, 2021-10-08T19:24:41.723 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:24:41.723 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:24:41.723 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:24:41.723 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:24:41.724 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:24:41.724 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 54371 2021-10-08T19:24:41.724 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.724 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:24:41.725 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.725 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:24:41.725 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:32.905942+0000", 2021-10-08T19:24:41.725 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:24:41.725 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.726 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.726 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:24:41.726 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:32.905942+0000", 2021-10-08T19:24:41.726 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:24:41.726 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.727 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.727 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:24:41.727 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:32.905940+0000", 2021-10-08T19:24:41.727 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:24:41.727 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.728 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.728 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:24:41.728 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:32.905972+0000", 2021-10-08T19:24:41.728 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2048999999999998e-05 2021-10-08T19:24:41.729 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.729 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.729 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:24:41.729 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:32.905980+0000", 2021-10-08T19:24:41.729 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.011e-06 2021-10-08T19:24:41.730 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.730 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.730 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:24:41.730 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:32.905985+0000", 2021-10-08T19:24:41.730 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9180000000000002e-06 2021-10-08T19:24:41.731 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.731 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.731 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:24:41.731 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:32.910118+0000", 2021-10-08T19:24:41.732 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0041328959999999996 2021-10-08T19:24:41.732 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.732 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.732 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:24:41.732 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:32.910241+0000", 2021-10-08T19:24:41.733 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012371800000000001 2021-10-08T19:24:41.733 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.733 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.733 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,6,7", 2021-10-08T19:24:41.733 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:32.910344+0000", 2021-10-08T19:24:41.734 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010301099999999999 2021-10-08T19:24:41.734 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.734 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.734 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:24:41.734 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:32.912252+0000", 2021-10-08T19:24:41.735 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0019079710000000001 2021-10-08T19:24:41.735 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.735 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.735 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:24:41.735 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:32.914889+0000", 2021-10-08T19:24:41.736 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026361599999999998 2021-10-08T19:24:41.736 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.736 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.736 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:24:41.736 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:32.914918+0000", 2021-10-08T19:24:41.737 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9791e-05 2021-10-08T19:24:41.737 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.737 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.737 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:24:41.737 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:32.965587+0000", 2021-10-08T19:24:41.738 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.050668749999999999 2021-10-08T19:24:41.738 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.738 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.738 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:24:41.739 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:32.965641+0000", 2021-10-08T19:24:41.739 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4361999999999999e-05 2021-10-08T19:24:41.739 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.739 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.739 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:24:41.740 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:32.966641+0000", 2021-10-08T19:24:41.740 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00099911899999999992 2021-10-08T19:24:41.740 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:41.740 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:41.740 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:41.741 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.741 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.741 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:54642 7.c 7:370d4f83:::benchmark_data_smithi097_93198_object54641:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117)", 2021-10-08T19:24:41.741 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:33.321613+0000", 2021-10-08T19:24:41.741 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 8.1633329139999997, 2021-10-08T19:24:41.742 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.050878728999999998, 2021-10-08T19:24:41.742 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:24:41.742 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:24:41.742 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:24:41.743 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:24:41.743 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:24:41.743 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 54642 2021-10-08T19:24:41.743 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.743 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:24:41.744 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.744 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:24:41.744 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:33.321613+0000", 2021-10-08T19:24:41.744 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:24:41.744 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.745 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.745 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:24:41.745 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:33.321613+0000", 2021-10-08T19:24:41.745 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:24:41.745 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.746 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.746 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:24:41.746 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:33.321612+0000", 2021-10-08T19:24:41.746 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:24:41.747 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.747 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.747 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:24:41.747 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:33.321636+0000", 2021-10-08T19:24:41.747 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3767000000000001e-05 2021-10-08T19:24:41.748 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.748 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.748 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:24:41.748 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:33.321642+0000", 2021-10-08T19:24:41.748 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5270000000000004e-06 2021-10-08T19:24:41.749 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.749 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.749 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:24:41.749 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:33.321646+0000", 2021-10-08T19:24:41.749 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9820000000000002e-06 2021-10-08T19:24:41.750 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.750 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.750 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:24:41.750 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:33.334329+0000", 2021-10-08T19:24:41.750 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012683231 2021-10-08T19:24:41.751 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.751 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.751 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:24:41.751 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:33.334498+0000", 2021-10-08T19:24:41.751 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016865200000000001 2021-10-08T19:24:41.752 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.752 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.752 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,6,7", 2021-10-08T19:24:41.752 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:33.334683+0000", 2021-10-08T19:24:41.753 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000184966 2021-10-08T19:24:41.753 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.753 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.753 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:24:41.753 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:33.339362+0000", 2021-10-08T19:24:41.754 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0046785589999999997 2021-10-08T19:24:41.754 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.754 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.754 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:24:41.754 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:33.358778+0000", 2021-10-08T19:24:41.755 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019416086999999999 2021-10-08T19:24:41.755 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.755 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.755 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:24:41.755 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:33.362477+0000", 2021-10-08T19:24:41.756 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003699323 2021-10-08T19:24:41.756 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.756 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.756 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:24:41.756 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:33.371041+0000", 2021-10-08T19:24:41.757 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0085637179999999997 2021-10-08T19:24:41.757 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.757 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.757 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:24:41.758 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:33.371128+0000", 2021-10-08T19:24:41.758 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7337999999999996e-05 2021-10-08T19:24:41.758 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.758 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.758 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:24:41.759 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:33.372491+0000", 2021-10-08T19:24:41.759 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001363326 2021-10-08T19:24:41.759 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:41.759 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:41.760 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:41.760 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.760 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.760 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:54874 7.e 7:72ed9f60:::benchmark_data_smithi097_93198_object54873:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118)", 2021-10-08T19:24:41.760 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:33.616945+0000", 2021-10-08T19:24:41.761 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 7.8680004429999997, 2021-10-08T19:24:41.761 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.057876771, 2021-10-08T19:24:41.761 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:24:41.761 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:24:41.761 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:24:41.762 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:24:41.762 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:24:41.762 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 54874 2021-10-08T19:24:41.762 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.762 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:24:41.763 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.763 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:24:41.763 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:33.616945+0000", 2021-10-08T19:24:41.763 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:24:41.764 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.764 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.764 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:24:41.764 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:33.616945+0000", 2021-10-08T19:24:41.764 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:24:41.765 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.765 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.765 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:24:41.765 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:33.616942+0000", 2021-10-08T19:24:41.765 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2021-10-08T19:24:41.766 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.766 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.766 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:24:41.766 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:33.616972+0000", 2021-10-08T19:24:41.766 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9903000000000002e-05 2021-10-08T19:24:41.767 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.767 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.767 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:24:41.767 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:33.616990+0000", 2021-10-08T19:24:41.767 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8508e-05 2021-10-08T19:24:41.768 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.768 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.768 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:24:41.768 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:33.616998+0000", 2021-10-08T19:24:41.768 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5410000000000003e-06 2021-10-08T19:24:41.769 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.769 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.769 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:24:41.769 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:33.617055+0000", 2021-10-08T19:24:41.770 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7240000000000001e-05 2021-10-08T19:24:41.770 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.770 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.770 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:24:41.770 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:33.617198+0000", 2021-10-08T19:24:41.771 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000143175 2021-10-08T19:24:41.771 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.771 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.771 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:24:41.771 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:33.617347+0000", 2021-10-08T19:24:41.772 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000148801 2021-10-08T19:24:41.772 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.772 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.772 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:24:41.772 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:33.619474+0000", 2021-10-08T19:24:41.773 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021271559999999998 2021-10-08T19:24:41.773 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.773 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.773 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:24:41.773 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:33.619650+0000", 2021-10-08T19:24:41.774 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000176069 2021-10-08T19:24:41.774 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.774 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.774 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:24:41.775 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:33.674718+0000", 2021-10-08T19:24:41.775 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.055068006000000003 2021-10-08T19:24:41.775 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.775 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.775 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:24:41.776 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:33.674778+0000", 2021-10-08T19:24:41.776 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9521000000000002e-05 2021-10-08T19:24:41.776 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.776 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.777 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:24:41.777 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:33.674822+0000", 2021-10-08T19:24:41.777 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3866000000000003e-05 2021-10-08T19:24:41.777 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:41.777 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:41.778 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:41.778 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.778 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.778 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:55502 7.c 7:31f44255:::benchmark_data_smithi097_93198_object55501:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118)", 2021-10-08T19:24:41.778 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:34.334889+0000", 2021-10-08T19:24:41.779 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 7.1500569780000003, 2021-10-08T19:24:41.779 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.085151624999999995, 2021-10-08T19:24:41.779 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:24:41.779 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:24:41.779 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:24:41.780 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:24:41.780 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:24:41.780 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 55502 2021-10-08T19:24:41.780 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.781 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:24:41.781 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.781 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:24:41.781 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.334889+0000", 2021-10-08T19:24:41.781 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:24:41.782 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.782 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.782 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:24:41.782 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.334889+0000", 2021-10-08T19:24:41.782 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:24:41.783 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.783 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.783 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:24:41.783 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.334885+0000", 2021-10-08T19:24:41.784 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999967 2021-10-08T19:24:41.784 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.784 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.784 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:24:41.784 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.334915+0000", 2021-10-08T19:24:41.785 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.959e-05 2021-10-08T19:24:41.785 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.785 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.785 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:24:41.785 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.334934+0000", 2021-10-08T19:24:41.786 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8777999999999999e-05 2021-10-08T19:24:41.786 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.786 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.786 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:24:41.786 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.334942+0000", 2021-10-08T19:24:41.787 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8720000000000002e-06 2021-10-08T19:24:41.787 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.787 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.787 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:24:41.787 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.340014+0000", 2021-10-08T19:24:41.788 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0050724519999999999 2021-10-08T19:24:41.788 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.788 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.788 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:24:41.788 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.340172+0000", 2021-10-08T19:24:41.789 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015748699999999999 2021-10-08T19:24:41.789 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.789 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.789 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,6,7", 2021-10-08T19:24:41.790 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.340316+0000", 2021-10-08T19:24:41.790 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014401 2021-10-08T19:24:41.790 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.790 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.790 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:24:41.791 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.342577+0000", 2021-10-08T19:24:41.791 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0022618650000000001 2021-10-08T19:24:41.791 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.791 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.791 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:24:41.792 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.345716+0000", 2021-10-08T19:24:41.792 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00313905 2021-10-08T19:24:41.792 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.792 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.792 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:24:41.793 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.346293+0000", 2021-10-08T19:24:41.793 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00057606400000000005 2021-10-08T19:24:41.793 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.793 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.793 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:24:41.794 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.416928+0000", 2021-10-08T19:24:41.794 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.070635660000000003 2021-10-08T19:24:41.794 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.794 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.795 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:24:41.795 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.416982+0000", 2021-10-08T19:24:41.795 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3640000000000001e-05 2021-10-08T19:24:41.795 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.795 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.796 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:24:41.796 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.420040+0000", 2021-10-08T19:24:41.796 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030583139999999999 2021-10-08T19:24:41.796 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:41.796 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:41.797 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:41.797 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.797 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.797 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:55963 7.c 7:30ddd214:::benchmark_data_smithi097_93198_object55962:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118)", 2021-10-08T19:24:41.797 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:34.887941+0000", 2021-10-08T19:24:41.798 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 6.5970043289999998, 2021-10-08T19:24:41.798 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.093904486999999995, 2021-10-08T19:24:41.798 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:24:41.798 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:24:41.798 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:24:41.799 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:24:41.799 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:24:41.799 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 55963 2021-10-08T19:24:41.799 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.799 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:24:41.800 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.800 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:24:41.800 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.887941+0000", 2021-10-08T19:24:41.800 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:24:41.801 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.801 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.801 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:24:41.801 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.887941+0000", 2021-10-08T19:24:41.801 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:24:41.802 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.802 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.802 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:24:41.802 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.887939+0000", 2021-10-08T19:24:41.803 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:24:41.803 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.803 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.803 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:24:41.803 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.887975+0000", 2021-10-08T19:24:41.804 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6114e-05 2021-10-08T19:24:41.804 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.804 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.804 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:24:41.804 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.887991+0000", 2021-10-08T19:24:41.805 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.645e-05 2021-10-08T19:24:41.805 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.805 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.805 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:24:41.805 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.887999+0000", 2021-10-08T19:24:41.806 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7889999999999995e-06 2021-10-08T19:24:41.806 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.806 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.806 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:24:41.806 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.888061+0000", 2021-10-08T19:24:41.807 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1838e-05 2021-10-08T19:24:41.807 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.807 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.807 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:24:41.807 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.888238+0000", 2021-10-08T19:24:41.808 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017658600000000001 2021-10-08T19:24:41.808 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.808 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.808 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,6,7", 2021-10-08T19:24:41.809 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.888417+0000", 2021-10-08T19:24:41.809 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000179567 2021-10-08T19:24:41.809 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.809 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.809 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:24:41.810 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.895248+0000", 2021-10-08T19:24:41.810 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0068307089999999999 2021-10-08T19:24:41.810 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.810 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.810 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:24:41.811 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.895285+0000", 2021-10-08T19:24:41.811 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7055999999999999e-05 2021-10-08T19:24:41.811 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.811 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.811 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:24:41.812 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.898730+0000", 2021-10-08T19:24:41.812 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0034451740000000001 2021-10-08T19:24:41.812 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.812 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.812 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:24:41.813 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.980589+0000", 2021-10-08T19:24:41.813 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.081859032999999998 2021-10-08T19:24:41.813 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.813 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.813 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:24:41.814 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.980642+0000", 2021-10-08T19:24:41.814 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3112999999999998e-05 2021-10-08T19:24:41.814 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.814 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.815 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:24:41.815 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.981846+0000", 2021-10-08T19:24:41.815 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001203502 2021-10-08T19:24:41.815 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:41.815 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:41.816 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:41.816 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.816 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.816 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:55972 7.e 7:7861c79d:::benchmark_data_smithi097_93198_object55971:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118)", 2021-10-08T19:24:41.817 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:34.899156+0000", 2021-10-08T19:24:41.817 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 6.5857894640000003, 2021-10-08T19:24:41.818 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.085341563999999995, 2021-10-08T19:24:41.818 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:24:41.818 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:24:41.818 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:24:41.819 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:24:41.819 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:24:41.819 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 55972 2021-10-08T19:24:41.819 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.819 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:24:41.820 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.820 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:24:41.820 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.899156+0000", 2021-10-08T19:24:41.820 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:24:41.820 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.821 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.821 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:24:41.821 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.899156+0000", 2021-10-08T19:24:41.821 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:24:41.821 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.822 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.822 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:24:41.822 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.899154+0000", 2021-10-08T19:24:41.822 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:24:41.823 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.823 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.823 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:24:41.823 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.899181+0000", 2021-10-08T19:24:41.823 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6920999999999999e-05 2021-10-08T19:24:41.824 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.824 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.824 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:24:41.824 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.899193+0000", 2021-10-08T19:24:41.824 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2568000000000001e-05 2021-10-08T19:24:41.825 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.825 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.825 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:24:41.825 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.899200+0000", 2021-10-08T19:24:41.826 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7109999999999998e-06 2021-10-08T19:24:41.826 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.826 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.826 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:24:41.826 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.899244+0000", 2021-10-08T19:24:41.827 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3658000000000001e-05 2021-10-08T19:24:41.827 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.827 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.827 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:24:41.827 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.899359+0000", 2021-10-08T19:24:41.828 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115154 2021-10-08T19:24:41.828 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.828 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.828 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:24:41.828 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.899500+0000", 2021-10-08T19:24:41.829 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014106399999999999 2021-10-08T19:24:41.829 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.829 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.829 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:24:41.829 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.902956+0000", 2021-10-08T19:24:41.830 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003455957 2021-10-08T19:24:41.830 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.830 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.830 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:24:41.831 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.903194+0000", 2021-10-08T19:24:41.831 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023854 2021-10-08T19:24:41.831 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.831 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.831 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:24:41.832 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.984408+0000", 2021-10-08T19:24:41.832 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.081213883000000001 2021-10-08T19:24:41.832 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.832 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.832 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:24:41.833 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.984456+0000", 2021-10-08T19:24:41.833 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7855999999999997e-05 2021-10-08T19:24:41.833 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.833 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.833 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:24:41.834 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.984498+0000", 2021-10-08T19:24:41.834 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1414e-05 2021-10-08T19:24:41.834 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:41.834 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:41.834 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:41.835 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.835 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.835 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:57957 7.c 7:349b414b:::benchmark_data_smithi097_93198_object57956:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2021-10-08T19:24:41.835 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:37.514292+0000", 2021-10-08T19:24:41.835 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.9706533459999998, 2021-10-08T19:24:41.836 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.054621953000000001, 2021-10-08T19:24:41.836 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:24:41.836 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:24:41.836 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:24:41.837 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:24:41.837 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:24:41.837 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 57957 2021-10-08T19:24:41.837 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.837 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:24:41.838 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.838 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:24:41.838 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:37.514292+0000", 2021-10-08T19:24:41.838 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:24:41.838 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.839 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.839 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:24:41.839 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:37.514292+0000", 2021-10-08T19:24:41.839 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:24:41.840 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.840 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.840 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:24:41.840 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:37.514290+0000", 2021-10-08T19:24:41.840 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:24:41.841 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.841 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.841 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:24:41.841 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:37.514317+0000", 2021-10-08T19:24:41.842 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6673999999999999e-05 2021-10-08T19:24:41.842 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.842 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.842 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:24:41.842 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:37.514331+0000", 2021-10-08T19:24:41.843 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4139e-05 2021-10-08T19:24:41.843 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.843 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.843 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:24:41.844 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:37.514338+0000", 2021-10-08T19:24:41.844 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5950000000000004e-06 2021-10-08T19:24:41.844 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.844 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.844 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:24:41.845 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:37.530933+0000", 2021-10-08T19:24:41.845 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016595042000000001 2021-10-08T19:24:41.845 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.845 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.845 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:24:41.846 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:37.531082+0000", 2021-10-08T19:24:41.846 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000149357 2021-10-08T19:24:41.846 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.846 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.846 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,6,7", 2021-10-08T19:24:41.847 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:37.531299+0000", 2021-10-08T19:24:41.847 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021724099999999999 2021-10-08T19:24:41.847 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.847 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.847 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:24:41.848 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:37.551192+0000", 2021-10-08T19:24:41.848 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019892554999999999 2021-10-08T19:24:41.848 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.848 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.849 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:24:41.849 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:37.551232+0000", 2021-10-08T19:24:41.849 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9675999999999998e-05 2021-10-08T19:24:41.849 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.849 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.850 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:24:41.850 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:37.551273+0000", 2021-10-08T19:24:41.850 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0840999999999997e-05 2021-10-08T19:24:41.850 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.850 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.851 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:24:41.851 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:37.567278+0000", 2021-10-08T19:24:41.851 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016005904000000001 2021-10-08T19:24:41.851 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.852 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.852 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:24:41.852 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:37.567343+0000", 2021-10-08T19:24:41.852 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4283999999999996e-05 2021-10-08T19:24:41.852 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.853 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.853 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:24:41.853 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:37.568914+0000", 2021-10-08T19:24:41.853 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001571383 2021-10-08T19:24:41.853 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:41.854 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:41.854 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:41.854 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.854 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.854 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:61298 7.c 7:39726294:::benchmark_data_smithi097_93198_object61297:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121)", 2021-10-08T19:24:41.855 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:41.338178+0000", 2021-10-08T19:24:41.855 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.146767493, 2021-10-08T19:24:41.855 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.050541913000000001, 2021-10-08T19:24:41.855 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:24:41.856 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:24:41.856 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:24:41.856 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:24:41.856 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:24:41.856 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 61298 2021-10-08T19:24:41.857 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.857 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:24:41.857 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.857 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:24:41.857 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:41.338178+0000", 2021-10-08T19:24:41.858 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:24:41.858 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.858 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.858 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:24:41.858 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:41.338178+0000", 2021-10-08T19:24:41.859 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:24:41.859 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.859 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.859 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:24:41.859 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:41.338177+0000", 2021-10-08T19:24:41.860 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:24:41.860 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.860 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.860 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:24:41.861 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:41.338198+0000", 2021-10-08T19:24:41.861 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0542000000000001e-05 2021-10-08T19:24:41.861 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.861 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.861 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:24:41.862 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:41.338207+0000", 2021-10-08T19:24:41.862 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4259999999999992e-06 2021-10-08T19:24:41.862 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.862 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.862 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:24:41.863 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:41.338212+0000", 2021-10-08T19:24:41.863 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5000000000000001e-06 2021-10-08T19:24:41.863 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.863 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.863 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:24:41.864 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:41.373151+0000", 2021-10-08T19:24:41.864 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.034939380999999999 2021-10-08T19:24:41.864 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.864 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.864 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:24:41.865 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:41.373292+0000", 2021-10-08T19:24:41.865 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014066600000000001 2021-10-08T19:24:41.865 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.865 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.865 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,6,7", 2021-10-08T19:24:41.866 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:41.373474+0000", 2021-10-08T19:24:41.866 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00018245699999999999 2021-10-08T19:24:41.866 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.866 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.867 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:24:41.867 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:41.378686+0000", 2021-10-08T19:24:41.867 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0052117689999999998 2021-10-08T19:24:41.867 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.867 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.868 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:24:41.868 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:41.386318+0000", 2021-10-08T19:24:41.868 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0076315410000000004 2021-10-08T19:24:41.868 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.868 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.869 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:24:41.869 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:41.387323+0000", 2021-10-08T19:24:41.869 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001005459 2021-10-08T19:24:41.869 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.869 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.870 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:24:41.870 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:41.387510+0000", 2021-10-08T19:24:41.870 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000186863 2021-10-08T19:24:41.870 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.870 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.871 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:24:41.871 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:41.387571+0000", 2021-10-08T19:24:41.871 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0788000000000001e-05 2021-10-08T19:24:41.871 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:24:41.872 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:24:41.872 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:24:41.872 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:41.388720+0000", 2021-10-08T19:24:41.872 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011492550000000001 2021-10-08T19:24:41.872 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:41.873 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:41.873 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:41.873 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:24:41.873 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:24:41.873 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:24:41.874 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:24:41.874 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:41 smithi097 ceph-mon[32687]: pgmap v139: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 153 active+clean; 3.6 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1.4 KiB/s rd, 73 MiB/s wr, 1.17k op/s; 6114/177084 objects degraded (3.453%); 8757/177084 objects misplaced (4.945%); 3.1 MiB/s, 48 objects/s recovering 2021-10-08T19:24:41.875 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:41 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2855975972' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:24:41.875 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:41 smithi097 ceph-mon[41966]: pgmap v139: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 153 active+clean; 3.6 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1.4 KiB/s rd, 73 MiB/s wr, 1.17k op/s; 6114/177084 objects degraded (3.453%); 8757/177084 objects misplaced (4.945%); 3.1 MiB/s, 48 objects/s recovering 2021-10-08T19:24:41.875 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:41 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2855975972' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:24:41.876 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:41.877 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:24:41.877 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:24:41.878 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:24:41.879 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:24:41.879 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:24:41.879 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:24:41.879 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:24:41.880 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:24:41.880 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'false' 2021-10-08T19:24:41.880 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'false' 2021-10-08T19:24:41.880 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'false' 2021-10-08T19:24:41.881 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'false' 2021-10-08T19:24:41.881 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'false' 2021-10-08T19:24:41.881 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'false' 2021-10-08T19:24:41.881 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'false' 2021-10-08T19:24:41.881 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'false' 2021-10-08T19:24:41.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:41 smithi117 ceph-mon[34585]: pgmap v139: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 153 active+clean; 3.6 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1.4 KiB/s rd, 73 MiB/s wr, 1.17k op/s; 6114/177084 objects degraded (3.453%); 8757/177084 objects misplaced (4.945%); 3.1 MiB/s, 48 objects/s recovering 2021-10-08T19:24:41.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:41 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2855975972' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:24:41.979 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:24:42.007 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:42.071 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:24:42.074 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:42.074 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:24:42.176 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:24:42.207 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:42.262 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 49 16 61993 61977 78.9984 46.3125 0.00823926 0.0126525 2021-10-08T19:24:42.668 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:24:42.677 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:42.678 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:24:42.779 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:24:42.809 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:42 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:24:42.812 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:42.888 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:24:42.891 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:42.891 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:24:42.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:42 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:24:42.970 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:24:42 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:24:42] "GET /metrics HTTP/1.1" 200 155574 "" "Prometheus/2.18.1" 2021-10-08T19:24:42.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:42 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:24:42.992 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:24:43.026 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset noscrub 2021-10-08T19:24:43.029 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2021-10-08T19:24:43.068 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:43.263 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 50 16 62861 62845 78.5022 54.25 0.0190525 0.0127305 2021-10-08T19:24:43.481 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:24:43.485 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:43.485 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:24:43.586 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:24:43.642 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:43.867 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:43 smithi117 ceph-mon[34585]: pgmap v141: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 153 active+clean; 3.6 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 721 B/s rd, 36 MiB/s wr, 578 op/s; 6114/177084 objects degraded (3.453%); 8757/177084 objects misplaced (4.945%); 1.5 MiB/s, 24 objects/s recovering 2021-10-08T19:24:43.867 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:24:43.869 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:24:43 smithi117 conmon[69189]: level=error ts=2021-10-08T19:24:43.504Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=2 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:24:43.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:43 smithi097 ceph-mon[32687]: pgmap v141: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 153 active+clean; 3.6 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 721 B/s rd, 36 MiB/s wr, 578 op/s; 6114/177084 objects degraded (3.453%); 8757/177084 objects misplaced (4.945%); 1.5 MiB/s, 24 objects/s recovering 2021-10-08T19:24:43.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:24:43.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:43 smithi097 ceph-mon[41966]: pgmap v141: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 153 active+clean; 3.6 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 721 B/s rd, 36 MiB/s wr, 578 op/s; 6114/177084 objects degraded (3.453%); 8757/177084 objects misplaced (4.945%); 1.5 MiB/s, 24 objects/s recovering 2021-10-08T19:24:43.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:24:44.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:24:43 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:24:43] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:24:44.267 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 51 16 63694 63678 77.9811 52.0625 0.00972572 0.0128167 2021-10-08T19:24:44.346 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:24:44.354 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:44.354 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:24:44.385 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:24:44.397 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:24:44.457 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:24:44.483 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:44.548 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:24:44.550 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:44.550 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:24:44.651 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:24:44.683 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:44.741 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:24:44.748 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:44.749 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:24:44.850 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:24:44.879 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:44.931 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:24:44.937 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:44.938 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:24:45.039 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:24:45.091 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:45.265 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 52 16 64402 64386 77.3327 44.25 0.021998 0.012923 2021-10-08T19:24:45.274 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:24:45.289 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:45.290 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:24:45.391 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:24:45.417 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:45.476 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:24:45.478 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:45.479 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:24:45.563 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:45 smithi097 ceph-mon[41966]: pgmap v142: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 153 active+clean; 3.8 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1.2 KiB/s rd, 65 MiB/s wr, 1.04k op/s; 6114/189684 objects degraded (3.223%); 8582/189684 objects misplaced (4.524%); 2.7 MiB/s, 43 objects/s recovering 2021-10-08T19:24:45.563 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:45 smithi097 ceph-mon[41966]: Health check update: Degraded data redundancy: 6114/189684 objects degraded (3.223%), 2 pgs degraded (PG_DEGRADED) 2021-10-08T19:24:45.564 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:45 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3168047923' entity='client.admin' cmd=[{"prefix": "osd rm-pg-upmap-items", "pgid": "4.13"}]: dispatch 2021-10-08T19:24:45.564 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:45 smithi097 ceph-mon[32687]: pgmap v142: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 153 active+clean; 3.8 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1.2 KiB/s rd, 65 MiB/s wr, 1.04k op/s; 6114/189684 objects degraded (3.223%); 8582/189684 objects misplaced (4.524%); 2.7 MiB/s, 43 objects/s recovering 2021-10-08T19:24:45.564 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:45 smithi097 ceph-mon[32687]: Health check update: Degraded data redundancy: 6114/189684 objects degraded (3.223%), 2 pgs degraded (PG_DEGRADED) 2021-10-08T19:24:45.565 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:45 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3168047923' entity='client.admin' cmd=[{"prefix": "osd rm-pg-upmap-items", "pgid": "4.13"}]: dispatch 2021-10-08T19:24:45.580 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:24:45.604 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:45.659 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:24:45.666 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:45 smithi117 ceph-mon[34585]: pgmap v142: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 153 active+clean; 3.8 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1.2 KiB/s rd, 65 MiB/s wr, 1.04k op/s; 6114/189684 objects degraded (3.223%); 8582/189684 objects misplaced (4.524%); 2.7 MiB/s, 43 objects/s recovering 2021-10-08T19:24:45.666 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:45 smithi117 ceph-mon[34585]: Health check update: Degraded data redundancy: 6114/189684 objects degraded (3.223%), 2 pgs degraded (PG_DEGRADED) 2021-10-08T19:24:45.666 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:45 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3168047923' entity='client.admin' cmd=[{"prefix": "osd rm-pg-upmap-items", "pgid": "4.13"}]: dispatch 2021-10-08T19:24:45.667 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:45.668 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:24:45.769 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:24:45.800 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:45.856 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:24:45.858 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:45.859 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:24:45.961 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:24:46.014 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:46.133 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:24:46.150 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:46.152 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:24:46.253 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:24:46.265 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 53 16 65243 65227 76.8655 52.5625 0.022395 0.0130043 2021-10-08T19:24:46.318 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:46.356 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2021-10-08T19:24:46.438 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:24:46.450 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:46.451 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:24:46.502 INFO:teuthology.orchestra.run.smithi097.stderr:clear 4.13 pg_upmap_items mapping 2021-10-08T19:24:46.552 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:24:46.575 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:24:46 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:24:46.578 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:46.635 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:24:46.637 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:46.638 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:24:46.740 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:24:46.795 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:47.224 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:24:47.235 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:47.236 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:24:47.265 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 54 16 66065 66049 76.3937 51.375 0.0187955 0.0130846 2021-10-08T19:24:47.337 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:24:47.391 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:47.485 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:47 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:24:47.486 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:47 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3168047923' entity='client.admin' cmd='[{"prefix": "osd rm-pg-upmap-items", "pgid": "4.13"}]': finished 2021-10-08T19:24:47.486 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:47 smithi097 ceph-mon[32687]: osdmap e122: 8 total, 8 up, 8 in 2021-10-08T19:24:47.486 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:47 smithi097 ceph-mon[32687]: pgmap v143: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 153 active+clean; 3.8 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1.1 KiB/s rd, 57 MiB/s wr, 915 op/s; 6114/189684 objects degraded (3.223%); 8582/189684 objects misplaced (4.524%); 2.4 MiB/s, 38 objects/s recovering 2021-10-08T19:24:47.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:47 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:24:47.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:47 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3168047923' entity='client.admin' cmd='[{"prefix": "osd rm-pg-upmap-items", "pgid": "4.13"}]': finished 2021-10-08T19:24:47.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:47 smithi117 ceph-mon[34585]: osdmap e122: 8 total, 8 up, 8 in 2021-10-08T19:24:47.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:47 smithi117 ceph-mon[34585]: pgmap v143: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 153 active+clean; 3.8 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1.1 KiB/s rd, 57 MiB/s wr, 915 op/s; 6114/189684 objects degraded (3.223%); 8582/189684 objects misplaced (4.524%); 2.4 MiB/s, 38 objects/s recovering 2021-10-08T19:24:47.966 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:24:47.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:47 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:24:47.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:47 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3168047923' entity='client.admin' cmd='[{"prefix": "osd rm-pg-upmap-items", "pgid": "4.13"}]': finished 2021-10-08T19:24:47.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:47 smithi097 ceph-mon[41966]: osdmap e122: 8 total, 8 up, 8 in 2021-10-08T19:24:47.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:47 smithi097 ceph-mon[41966]: pgmap v143: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 153 active+clean; 3.8 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1.1 KiB/s rd, 57 MiB/s wr, 915 op/s; 6114/189684 objects degraded (3.223%); 8582/189684 objects misplaced (4.524%); 2.4 MiB/s, 38 objects/s recovering 2021-10-08T19:24:47.985 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:47.986 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:24:48.067 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:24:48.088 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:24:48.113 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:48.175 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:24:48.177 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:48.178 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:24:48.270 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 55 16 66834 66818 75.8748 48.0625 0.0271447 0.0131734 2021-10-08T19:24:48.279 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:24:48.314 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:48.385 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:24:48.388 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:48.389 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:24:48.490 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:24:48.505 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:48 smithi097 ceph-mon[32687]: osdmap e123: 8 total, 8 up, 8 in 2021-10-08T19:24:48.515 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:48.569 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:24:48.573 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:48.573 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:24:48.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:48 smithi117 ceph-mon[34585]: osdmap e123: 8 total, 8 up, 8 in 2021-10-08T19:24:48.675 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:24:48.749 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:48.804 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2021-10-08T19:24:48.804 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:24:48.830 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:48 smithi097 ceph-mon[41966]: osdmap e123: 8 total, 8 up, 8 in 2021-10-08T19:24:49.270 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 56 16 67538 67522 75.305 44 0.032079 0.0132726 2021-10-08T19:24:49.552 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is unset 2021-10-08T19:24:49.572 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:49 smithi097 ceph-mon[32687]: pgmap v146: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 1 active+recovery_wait+degraded, 152 active+clean; 3.9 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1.2 KiB/s rd, 38 MiB/s wr, 615 op/s; 6119/191841 objects degraded (3.190%); 8524/191841 objects misplaced (4.443%); 1.8 MiB/s, 29 objects/s recovering 2021-10-08T19:24:49.572 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:49 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2672272133' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:24:49.572 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:49 smithi097 ceph-mon[32687]: from='client.34862 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:24:49.573 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:49 smithi097 ceph-mon[41966]: pgmap v146: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 1 active+recovery_wait+degraded, 152 active+clean; 3.9 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1.2 KiB/s rd, 38 MiB/s wr, 615 op/s; 6119/191841 objects degraded (3.190%); 8524/191841 objects misplaced (4.443%); 1.8 MiB/s, 29 objects/s recovering 2021-10-08T19:24:49.574 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:49 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2672272133' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:24:49.574 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:49 smithi097 ceph-mon[41966]: from='client.34862 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:24:49.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:49 smithi117 ceph-mon[34585]: pgmap v146: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 1 active+recovery_wait+degraded, 152 active+clean; 3.9 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1.2 KiB/s rd, 38 MiB/s wr, 615 op/s; 6119/191841 objects degraded (3.190%); 8524/191841 objects misplaced (4.443%); 1.8 MiB/s, 29 objects/s recovering 2021-10-08T19:24:49.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:49 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2672272133' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:24:49.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:49 smithi117 ceph-mon[34585]: from='client.34862 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:24:50.269 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 57 16 68411 68395 74.9412 54.5625 0.0166201 0.0133383 2021-10-08T19:24:50.423 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:24:50.435 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:50.437 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:24:50.540 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:24:50.567 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:50.629 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:50.629 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:24:50.630 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:24:50.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:50 smithi097 ceph-mon[32687]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:24:50.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:50 smithi097 ceph-mon[32687]: from='client.34862 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:24:50.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:50 smithi097 ceph-mon[32687]: osdmap e124: 8 total, 8 up, 8 in 2021-10-08T19:24:50.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:50 smithi097 ceph-mon[32687]: Health check update: Degraded data redundancy: 6119/191841 objects degraded (3.190%), 3 pgs degraded (PG_DEGRADED) 2021-10-08T19:24:50.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:50 smithi097 ceph-mon[32687]: osdmap e125: 8 total, 8 up, 8 in 2021-10-08T19:24:50.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:50 smithi097 ceph-mon[41966]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:24:50.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:50 smithi097 ceph-mon[41966]: from='client.34862 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:24:50.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:50 smithi097 ceph-mon[41966]: osdmap e124: 8 total, 8 up, 8 in 2021-10-08T19:24:50.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:50 smithi097 ceph-mon[41966]: Health check update: Degraded data redundancy: 6119/191841 objects degraded (3.190%), 3 pgs degraded (PG_DEGRADED) 2021-10-08T19:24:50.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:50 smithi097 ceph-mon[41966]: osdmap e125: 8 total, 8 up, 8 in 2021-10-08T19:24:50.731 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:24:50.784 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2021-10-08T19:24:50.836 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:50.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:50 smithi117 ceph-mon[34585]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:24:50.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:50 smithi117 ceph-mon[34585]: from='client.34862 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:24:50.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:50 smithi117 ceph-mon[34585]: osdmap e124: 8 total, 8 up, 8 in 2021-10-08T19:24:50.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:50 smithi117 ceph-mon[34585]: Health check update: Degraded data redundancy: 6119/191841 objects degraded (3.190%), 3 pgs degraded (PG_DEGRADED) 2021-10-08T19:24:50.908 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:50 smithi117 ceph-mon[34585]: osdmap e125: 8 total, 8 up, 8 in 2021-10-08T19:24:51.269 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 58 16 69187 69171 74.4855 48.5 0.0103522 0.0134196 2021-10-08T19:24:51.422 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:24:51.432 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:51.433 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:24:51.534 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:24:51.607 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:51.649 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:24:51.710 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:24:51.721 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:51.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:51 smithi097 ceph-mon[41966]: pgmap v149: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 1 active+recovery_wait+degraded, 152 active+clean; 4.1 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 1.2 KiB/s rd, 62 MiB/s wr, 991 op/s; 6119/201573 objects degraded (3.036%); 8408/201573 objects misplaced (4.171%); 2.7 MiB/s, 43 objects/s recovering 2021-10-08T19:24:51.723 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:24:51.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:51 smithi097 ceph-mon[32687]: pgmap v149: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 1 active+recovery_wait+degraded, 152 active+clean; 4.1 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 1.2 KiB/s rd, 62 MiB/s wr, 991 op/s; 6119/201573 objects degraded (3.036%); 8408/201573 objects misplaced (4.171%); 2.7 MiB/s, 43 objects/s recovering 2021-10-08T19:24:51.825 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:24:51.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:51 smithi117 ceph-mon[34585]: pgmap v149: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 1 active+recovery_wait+degraded, 152 active+clean; 4.1 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 1.2 KiB/s rd, 62 MiB/s wr, 991 op/s; 6119/201573 objects degraded (3.036%); 8408/201573 objects misplaced (4.171%); 2.7 MiB/s, 43 objects/s recovering 2021-10-08T19:24:51.911 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:52.115 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:24:52.123 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:52.124 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:24:52.207 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:24:52.225 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:24:52.241 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:24:52.272 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 59 16 69900 69884 73.9756 44.5625 0.023007 0.0135123 2021-10-08T19:24:52.287 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:24:52.300 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:52.338 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:24:52.383 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:24:52.424 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:24:52.433 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:24:52.439 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:52.441 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:24:52.466 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:24:52.512 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:24:52.542 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:24:52.551 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true' 2021-10-08T19:24:52.551 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true' 2021-10-08T19:24:52.552 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true' 2021-10-08T19:24:52.552 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true' 2021-10-08T19:24:52.552 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true' 2021-10-08T19:24:52.552 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true' 2021-10-08T19:24:52.552 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'true' 2021-10-08T19:24:52.553 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'true' 2021-10-08T19:24:52.607 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:52.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:52 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:24:52.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:52 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:24:52.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:52 smithi097 ceph-mon[41966]: osdmap e126: 8 total, 8 up, 8 in 2021-10-08T19:24:52.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:52 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:24:52.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:52 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:24:52.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:52 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1922053804' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:24:52.724 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:52 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:24:52.725 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:52 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:24:52.725 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:52 smithi097 ceph-mon[32687]: osdmap e126: 8 total, 8 up, 8 in 2021-10-08T19:24:52.725 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:52 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:24:52.725 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:52 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:24:52.725 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:52 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1922053804' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:24:52.726 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:24:52 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:24:52] "GET /metrics HTTP/1.1" 200 155574 "" "Prometheus/2.18.1" 2021-10-08T19:24:52.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:52 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:24:52.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:52 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:24:52.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:52 smithi117 ceph-mon[34585]: osdmap e126: 8 total, 8 up, 8 in 2021-10-08T19:24:52.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:52 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:24:52.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:52 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:24:52.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:52 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1922053804' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:24:52.993 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 7, 6] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2021-10-08T19:24:52.994 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2021-10-08T19:24:52.994 INFO:tasks.thrashosds.thrasher:Growing pool iscsi 2021-10-08T19:24:52.995 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph pg dump --format=json 2021-10-08T19:24:53.273 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:2021-10-08T19:24:53.273100+0000 min lat: 0.00115885 max lat: 2.88554 avg lat: 0.0136108 2021-10-08T19:24:53.273 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2021-10-08T19:24:53.273 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 60 16 70575 70559 73.4446 42.1875 0.0219 0.0136108 2021-10-08T19:24:53.409 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset nodeep-scrub 2021-10-08T19:24:53.571 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:24:53.587 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:53.588 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:24:53.690 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:24:53.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:53 smithi097 ceph-mon[41966]: pgmap v151: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 1 active+recovery_wait+degraded, 152 active+clean; 4.1 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 1.0 KiB/s rd, 50 MiB/s wr, 795 op/s; 6119/201573 objects degraded (3.036%); 8408/201573 objects misplaced (4.171%); 2.2 MiB/s, 34 objects/s recovering 2021-10-08T19:24:53.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:53 smithi097 ceph-mon[41966]: osdmap e127: 8 total, 8 up, 8 in 2021-10-08T19:24:53.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:53 smithi097 ceph-mon[32687]: pgmap v151: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 1 active+recovery_wait+degraded, 152 active+clean; 4.1 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 1.0 KiB/s rd, 50 MiB/s wr, 795 op/s; 6119/201573 objects degraded (3.036%); 8408/201573 objects misplaced (4.171%); 2.2 MiB/s, 34 objects/s recovering 2021-10-08T19:24:53.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:53 smithi097 ceph-mon[32687]: osdmap e127: 8 total, 8 up, 8 in 2021-10-08T19:24:53.756 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:53.868 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:53 smithi117 ceph-mon[34585]: pgmap v151: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 1 active+recovery_wait+degraded, 152 active+clean; 4.1 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 1.0 KiB/s rd, 50 MiB/s wr, 795 op/s; 6119/201573 objects degraded (3.036%); 8408/201573 objects misplaced (4.171%); 2.2 MiB/s, 34 objects/s recovering 2021-10-08T19:24:53.868 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:53 smithi117 ceph-mon[34585]: osdmap e127: 8 total, 8 up, 8 in 2021-10-08T19:24:54.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:24:53 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:24:53] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:24:54.273 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 61 16 71308 71292 72.9918 45.8125 0.00999297 0.013694 2021-10-08T19:24:55.080 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:24:55.083 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:55.084 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:24:55.185 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:24:55.199 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:24:55.216 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:24:55.229 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:55.277 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 62 16 72087 72071 72.599 48.6875 0.0147369 0.0137671 2021-10-08T19:24:55.289 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:24:55.292 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:55.293 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:24:55.394 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:24:55.422 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:55.478 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:24:55.481 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:55.482 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:24:55.584 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:24:55.640 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:55.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:55 smithi097 ceph-mon[32687]: pgmap v153: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 1 active+recovery_wait+degraded, 152 active+clean; 4.3 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1.0 KiB/s rd, 47 MiB/s wr, 756 op/s; 6119/212823 objects degraded (2.875%); 8233/212823 objects misplaced (3.868%); 2.2 MiB/s, 35 objects/s recovering 2021-10-08T19:24:55.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:55 smithi097 ceph-mon[32687]: Health check update: Degraded data redundancy: 6119/212823 objects degraded (2.875%), 3 pgs degraded (PG_DEGRADED) 2021-10-08T19:24:55.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:55 smithi097 ceph-mon[41966]: pgmap v153: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 1 active+recovery_wait+degraded, 152 active+clean; 4.3 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1.0 KiB/s rd, 47 MiB/s wr, 756 op/s; 6119/212823 objects degraded (2.875%); 8233/212823 objects misplaced (3.868%); 2.2 MiB/s, 35 objects/s recovering 2021-10-08T19:24:55.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:55 smithi097 ceph-mon[41966]: Health check update: Degraded data redundancy: 6119/212823 objects degraded (2.875%), 3 pgs degraded (PG_DEGRADED) 2021-10-08T19:24:55.895 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:24:55.896 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2021-10-08T19:24:55.896 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2021-10-08T19:24:55.896 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2021-10-08T19:24:55.897 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:24:55.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:55 smithi117 ceph-mon[34585]: pgmap v153: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 1 active+recovery_wait+degraded, 152 active+clean; 4.3 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1.0 KiB/s rd, 47 MiB/s wr, 756 op/s; 6119/212823 objects degraded (2.875%); 8233/212823 objects misplaced (3.868%); 2.2 MiB/s, 35 objects/s recovering 2021-10-08T19:24:55.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:55 smithi117 ceph-mon[34585]: Health check update: Degraded data redundancy: 6119/212823 objects degraded (2.875%), 3 pgs degraded (PG_DEGRADED) 2021-10-08T19:24:56.013 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:24:56.035 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:56.036 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:24:56.137 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:24:56.164 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:56.215 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:24:56.218 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:56.219 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:24:56.274 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 63 16 72732 72716 72.0868 40.3125 0.0216637 0.0138649 2021-10-08T19:24:56.321 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:24:56.396 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:56.509 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2021-10-08T19:24:56.655 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:24:56 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:24:56.947 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:24:56.959 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:56.960 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:24:57.061 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:24:57.114 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:57.265 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:24:57.271 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:57.272 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:24:57.274 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 64 16 73428 73412 71.6403 43.5 0.0234179 0.013953 2021-10-08T19:24:57.374 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:24:57.428 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2021-10-08T19:24:57.440 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:57.596 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:57 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:24:57.596 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:57 smithi097 ceph-mon[32687]: pgmap v154: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 1 active+recovery_wait+degraded, 152 active+clean; 4.3 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 850 B/s rd, 39 MiB/s wr, 623 op/s; 6119/212823 objects degraded (2.875%); 8233/212823 objects misplaced (3.868%); 1.8 MiB/s, 29 objects/s recovering 2021-10-08T19:24:57.870 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:57 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:24:57.870 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:57 smithi117 ceph-mon[34585]: pgmap v154: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 1 active+recovery_wait+degraded, 152 active+clean; 4.3 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 850 B/s rd, 39 MiB/s wr, 623 op/s; 6119/212823 objects degraded (2.875%); 8233/212823 objects misplaced (3.868%); 1.8 MiB/s, 29 objects/s recovering 2021-10-08T19:24:57.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:57 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:24:57.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:57 smithi097 ceph-mon[41966]: pgmap v154: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 1 active+recovery_wait+degraded, 152 active+clean; 4.3 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 850 B/s rd, 39 MiB/s wr, 623 op/s; 6119/212823 objects degraded (2.875%); 8233/212823 objects misplaced (3.868%); 1.8 MiB/s, 29 objects/s recovering 2021-10-08T19:24:57.998 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:24:58.003 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:58.004 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:24:58.106 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:24:58.143 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:58.222 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:24:58.227 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:58.228 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:24:58.276 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 65 16 74176 74160 71.2557 46.75 0.0238015 0.0140288 2021-10-08T19:24:58.330 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:24:58.365 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:58.446 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:24:58.452 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:58.452 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:24:58.554 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:24:58.583 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:58.628 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:24:58.631 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:58.631 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:24:58.732 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:24:58.776 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:58.945 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:24:58.949 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:58.950 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:24:59.051 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:24:59.103 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:59.264 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:24:59.270 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:59.271 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:24:59.277 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 66 16 74950 74934 70.9071 48.375 0.0231431 0.0140972 2021-10-08T19:24:59.372 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:24:59.389 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:24:59.390 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:24:59.437 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:24:59.695 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:24:59 smithi097 ceph-mon[41966]: pgmap v155: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 1 active+recovery_wait+degraded, 152 active+clean; 4.4 GiB data, 14 GiB used, 702 GiB / 715 GiB avail; 1.2 KiB/s rd, 34 MiB/s wr, 552 op/s; 6119/214824 objects degraded (2.848%); 8175/214824 objects misplaced (3.805%); 1.8 MiB/s, 29 objects/s recovering 2021-10-08T19:24:59.697 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:24:59 smithi097 ceph-mon[32687]: pgmap v155: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 1 active+recovery_wait+degraded, 152 active+clean; 4.4 GiB data, 14 GiB used, 702 GiB / 715 GiB avail; 1.2 KiB/s rd, 34 MiB/s wr, 552 op/s; 6119/214824 objects degraded (2.848%); 8175/214824 objects misplaced (3.805%); 1.8 MiB/s, 29 objects/s recovering 2021-10-08T19:24:59.731 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:24:59.735 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:24:59.736 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:24:59.836 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:24:59.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:24:59 smithi117 ceph-mon[34585]: pgmap v155: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 1 active+recovery_wait+degraded, 152 active+clean; 4.4 GiB data, 14 GiB used, 702 GiB / 715 GiB avail; 1.2 KiB/s rd, 34 MiB/s wr, 552 op/s; 6119/214824 objects degraded (2.848%); 8175/214824 objects misplaced (3.805%); 1.8 MiB/s, 29 objects/s recovering 2021-10-08T19:24:59.926 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:00.198 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:25:00.207 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:00.208 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:25:00.284 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 67 16 75553 75537 70.4054 37.6875 0.0323987 0.0141925 2021-10-08T19:25:00.309 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:25:00.351 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:00.460 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:25:00.464 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:00.464 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:25:00.497 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:25:00.528 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2021-10-08T19:25:00.565 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:25:00.598 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:00.652 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:25:00.656 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:00.657 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:25:00.758 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:25:00.826 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:00 smithi097 ceph-mon[32687]: Health check update: Degraded data redundancy: 6119/214824 objects degraded (2.848%), 3 pgs degraded (PG_DEGRADED) 2021-10-08T19:25:00.827 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:00 smithi097 ceph-mon[41966]: Health check update: Degraded data redundancy: 6119/214824 objects degraded (2.848%), 3 pgs degraded (PG_DEGRADED) 2021-10-08T19:25:00.836 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:00.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:00 smithi117 ceph-mon[34585]: Health check update: Degraded data redundancy: 6119/214824 objects degraded (2.848%), 3 pgs degraded (PG_DEGRADED) 2021-10-08T19:25:01.285 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 68 16 76235 76219 69.9971 42.625 0.0101974 0.0142804 2021-10-08T19:25:01.667 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is unset 2021-10-08T19:25:01.888 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:01 smithi097 ceph-mon[41966]: from='client.14925 v1:172.21.15.97:0/1358343922' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:25:01.888 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:01 smithi097 ceph-mon[41966]: pgmap v156: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 1 active+recovery_wait+degraded, 152 active+clean; 4.5 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1.1 KiB/s rd, 51 MiB/s wr, 824 op/s; 6119/223692 objects degraded (2.735%); 8058/223692 objects misplaced (3.602%); 2.4 MiB/s, 39 objects/s recovering 2021-10-08T19:25:01.889 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:01 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1261575351' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:25:01.889 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:01 smithi097 ceph-mon[41966]: from='client.24871 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:25:01.889 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:01 smithi097 ceph-mon[32687]: from='client.14925 v1:172.21.15.97:0/1358343922' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:25:01.890 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:01 smithi097 ceph-mon[32687]: pgmap v156: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 1 active+recovery_wait+degraded, 152 active+clean; 4.5 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1.1 KiB/s rd, 51 MiB/s wr, 824 op/s; 6119/223692 objects degraded (2.735%); 8058/223692 objects misplaced (3.602%); 2.4 MiB/s, 39 objects/s recovering 2021-10-08T19:25:01.890 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:01 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1261575351' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:25:01.890 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:01 smithi097 ceph-mon[32687]: from='client.24871 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:25:01.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:01 smithi117 ceph-mon[34585]: from='client.14925 v1:172.21.15.97:0/1358343922' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:25:01.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:01 smithi117 ceph-mon[34585]: pgmap v156: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 1 active+recovery_wait+degraded, 152 active+clean; 4.5 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1.1 KiB/s rd, 51 MiB/s wr, 824 op/s; 6119/223692 objects degraded (2.735%); 8058/223692 objects misplaced (3.602%); 2.4 MiB/s, 39 objects/s recovering 2021-10-08T19:25:01.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:01 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1261575351' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:25:01.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:01 smithi117 ceph-mon[34585]: from='client.24871 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:25:02.286 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 69 16 77010 76994 69.6829 48.4375 0.0327116 0.014345 2021-10-08T19:25:02.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:02 smithi117 ceph-mon[34585]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:25:02.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:02 smithi117 ceph-mon[34585]: from='client.24871 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:25:02.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:02 smithi117 ceph-mon[34585]: osdmap e128: 8 total, 8 up, 8 in 2021-10-08T19:25:02.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:02 smithi097 ceph-mon[32687]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:25:02.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:02 smithi097 ceph-mon[32687]: from='client.24871 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:25:02.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:02 smithi097 ceph-mon[32687]: osdmap e128: 8 total, 8 up, 8 in 2021-10-08T19:25:02.971 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:25:02 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:25:02] "GET /metrics HTTP/1.1" 200 155676 "" "Prometheus/2.18.1" 2021-10-08T19:25:02.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:02 smithi097 ceph-mon[41966]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:25:02.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:02 smithi097 ceph-mon[41966]: from='client.24871 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:25:02.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:02 smithi097 ceph-mon[41966]: osdmap e128: 8 total, 8 up, 8 in 2021-10-08T19:25:03.206 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:25:03.209 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:03.210 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:25:03.286 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 70 16 77774 77758 69.3698 47.75 0.0160727 0.0144085 2021-10-08T19:25:03.312 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:25:03.350 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:03.411 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:25:03.415 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:03.416 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:25:03.517 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:25:03.575 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:03.655 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:25:03 smithi117 conmon[69189]: level=error ts=2021-10-08T19:25:03.504Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=1 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:25:03.969 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:03 smithi097 ceph-mon[41966]: pgmap v158: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 1 active+recovery_wait+degraded, 152 active+clean; 4.5 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1.0 KiB/s rd, 46 MiB/s wr, 744 op/s; 6119/223692 objects degraded (2.735%); 8058/223692 objects misplaced (3.602%); 2.2 MiB/s, 35 objects/s recovering 2021-10-08T19:25:03.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:03 smithi097 ceph-mon[32687]: pgmap v158: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 1 active+recovery_wait+degraded, 152 active+clean; 4.5 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1.0 KiB/s rd, 46 MiB/s wr, 744 op/s; 6119/223692 objects degraded (2.735%); 8058/223692 objects misplaced (3.602%); 2.2 MiB/s, 35 objects/s recovering 2021-10-08T19:25:04.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:25:03 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:25:03] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:25:04.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:03 smithi117 ceph-mon[34585]: pgmap v158: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 1 active+recovery_wait+degraded, 152 active+clean; 4.5 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1.0 KiB/s rd, 46 MiB/s wr, 744 op/s; 6119/223692 objects degraded (2.735%); 8058/223692 objects misplaced (3.602%); 2.2 MiB/s, 35 objects/s recovering 2021-10-08T19:25:04.287 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 71 16 78546 78530 69.0717 48.25 0.0178538 0.0144727 2021-10-08T19:25:04.296 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":155,"stamp":"2021-10-08T19:24:58.476133+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4680718824,"num_objects":71608,"num_object_clones":0,"num_object_copies":214824,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6119,"num_objects_misplaced":8175,"num_objects_unfound":0,"num_objects_dirty":71608,"num_whiteouts":0,"num_read":1083,"num_read_kb":930,"num_write":72019,"num_write_kb":4572889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1147,"num_bytes_recovered":67900734,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71947,"ondisk_log_size":71947,"up":474,"acting":470,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":480,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":14305384,"kb_used_data":13940072,"kb_used_omap":0,"kb_used_meta":365312,"kb_avail":735655832,"statfs":{"total":767960285184,"available":753311571968,"internally_reserved":0,"allocated":14274633728,"data_stored":14270308908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":374079488},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,5,5,7,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":289472512,"num_objects":4417,"num_object_clones":0,"num_object_copies":13251,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-233,"num_objects_unfound":0,"num_objects_dirty":4417,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4417,"num_write_kb":282688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":233,"num_bytes_recovered":15269888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.005998"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":92,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.536390+0000","last_change":"2021-10-08T19:24:25.101949+0000","last_active":"2021-10-08T19:24:51.536390+0000","last_peered":"2021-10-08T19:24:51.536390+0000","last_clean":"2021-10-08T19:24:51.536390+0000","last_became_active":"2021-10-08T19:24:25.097417+0000","last_became_peered":"2021-10-08T19:24:25.097417+0000","last_unstale":"2021-10-08T19:24:51.536390+0000","last_undegraded":"2021-10-08T19:24:51.536390+0000","last_fullsized":"2021-10-08T19:24:51.536390+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:33.411753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:33.411753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0038057030000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":100,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.529576+0000","last_change":"2021-10-08T19:24:25.091115+0000","last_active":"2021-10-08T19:24:51.529576+0000","last_peered":"2021-10-08T19:24:51.529576+0000","last_clean":"2021-10-08T19:24:51.529576+0000","last_became_active":"2021-10-08T19:24:25.090759+0000","last_became_peered":"2021-10-08T19:24:25.090759+0000","last_unstale":"2021-10-08T19:24:51.529576+0000","last_undegraded":"2021-10-08T19:24:51.529576+0000","last_fullsized":"2021-10-08T19:24:51.529576+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:39.931718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:39.931718+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0036493649999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":81,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.542279+0000","last_change":"2021-10-08T19:22:54.671364+0000","last_active":"2021-10-08T19:24:51.542279+0000","last_peered":"2021-10-08T19:24:51.542279+0000","last_clean":"2021-10-08T19:24:51.542279+0000","last_became_active":"2021-10-08T19:21:23.603422+0000","last_became_peered":"2021-10-08T19:21:23.603422+0000","last_unstale":"2021-10-08T19:24:51.542279+0000","last_undegraded":"2021-10-08T19:24:51.542279+0000","last_fullsized":"2021-10-08T19:24:51.542279+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:54.671289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:54.671289+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001752221,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"69'15","reported_seq":103,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.536628+0000","last_change":"2021-10-08T19:24:14.482657+0000","last_active":"2021-10-08T19:24:51.536628+0000","last_peered":"2021-10-08T19:24:51.536628+0000","last_clean":"2021-10-08T19:24:51.536628+0000","last_became_active":"2021-10-08T19:21:25.612873+0000","last_became_peered":"2021-10-08T19:21:25.612873+0000","last_unstale":"2021-10-08T19:24:51.536628+0000","last_undegraded":"2021-10-08T19:24:51.536628+0000","last_fullsized":"2021-10-08T19:24:51.536628+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'15","last_scrub_stamp":"2021-10-08T19:24:14.482511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:24:14.482511+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012310702999999999,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":74,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.529586+0000","last_change":"2021-10-08T19:22:50.032446+0000","last_active":"2021-10-08T19:24:51.529586+0000","last_peered":"2021-10-08T19:24:51.529586+0000","last_clean":"2021-10-08T19:24:51.529586+0000","last_became_active":"2021-10-08T19:21:29.639039+0000","last_became_peered":"2021-10-08T19:21:29.639039+0000","last_unstale":"2021-10-08T19:24:51.529586+0000","last_undegraded":"2021-10-08T19:24:51.529586+0000","last_fullsized":"2021-10-08T19:24:51.529586+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:50.032367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:50.032367+0000","last_clean_scrub_stamp":"2021-10-08T19:22:50.032367+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034102759999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":77,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.564316+0000","last_change":"2021-10-08T19:23:05.196328+0000","last_active":"2021-10-08T19:24:51.564316+0000","last_peered":"2021-10-08T19:24:51.564316+0000","last_clean":"2021-10-08T19:24:51.564316+0000","last_became_active":"2021-10-08T19:21:27.634883+0000","last_became_peered":"2021-10-08T19:21:27.634883+0000","last_unstale":"2021-10-08T19:24:51.564316+0000","last_undegraded":"2021-10-08T19:24:51.564316+0000","last_fullsized":"2021-10-08T19:24:51.564316+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:05.196252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:05.196252+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0016803230000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":80,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.537333+0000","last_change":"2021-10-08T19:23:14.443220+0000","last_active":"2021-10-08T19:24:51.537333+0000","last_peered":"2021-10-08T19:24:51.537333+0000","last_clean":"2021-10-08T19:24:51.537333+0000","last_became_active":"2021-10-08T19:21:23.598272+0000","last_became_peered":"2021-10-08T19:21:23.598272+0000","last_unstale":"2021-10-08T19:24:51.537333+0000","last_undegraded":"2021-10-08T19:24:51.537333+0000","last_fullsized":"2021-10-08T19:24:51.537333+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:14.443147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:14.443147+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003489631,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"88'13","reported_seq":155,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.529422+0000","last_change":"2021-10-08T19:24:25.450475+0000","last_active":"2021-10-08T19:24:51.529422+0000","last_peered":"2021-10-08T19:24:51.529422+0000","last_clean":"2021-10-08T19:24:51.529422+0000","last_became_active":"2021-10-08T19:24:25.092496+0000","last_became_peered":"2021-10-08T19:24:25.092496+0000","last_unstale":"2021-10-08T19:24:51.529422+0000","last_undegraded":"2021-10-08T19:24:51.529422+0000","last_fullsized":"2021-10-08T19:24:51.529422+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'13","last_scrub_stamp":"2021-10-08T19:23:16.016646+0000","last_deep_scrub":"88'13","last_deep_scrub_stamp":"2021-10-08T19:23:16.016646+0000","last_clean_scrub_stamp":"2021-10-08T19:23:16.016646+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0052093469999999996,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":74,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.540564+0000","last_change":"2021-10-08T19:23:23.659594+0000","last_active":"2021-10-08T19:24:51.540564+0000","last_peered":"2021-10-08T19:24:51.540564+0000","last_clean":"2021-10-08T19:24:51.540564+0000","last_became_active":"2021-10-08T19:21:29.649640+0000","last_became_peered":"2021-10-08T19:21:29.649640+0000","last_unstale":"2021-10-08T19:24:51.540564+0000","last_undegraded":"2021-10-08T19:24:51.540564+0000","last_fullsized":"2021-10-08T19:24:51.540564+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:23.659524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:23.659524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0013747169999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":83,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.536041+0000","last_change":"2021-10-08T19:24:20.517151+0000","last_active":"2021-10-08T19:24:51.536041+0000","last_peered":"2021-10-08T19:24:51.536041+0000","last_clean":"2021-10-08T19:24:51.536041+0000","last_became_active":"2021-10-08T19:21:27.637178+0000","last_became_peered":"2021-10-08T19:21:27.637178+0000","last_unstale":"2021-10-08T19:24:51.536041+0000","last_undegraded":"2021-10-08T19:24:51.536041+0000","last_fullsized":"2021-10-08T19:24:51.536041+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:20.517044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:20.517044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0053303969999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":105,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.537277+0000","last_change":"2021-10-08T19:24:25.096540+0000","last_active":"2021-10-08T19:24:51.537277+0000","last_peered":"2021-10-08T19:24:51.537277+0000","last_clean":"2021-10-08T19:24:51.537277+0000","last_became_active":"2021-10-08T19:24:25.096225+0000","last_became_peered":"2021-10-08T19:24:25.096225+0000","last_unstale":"2021-10-08T19:24:51.537277+0000","last_undegraded":"2021-10-08T19:24:51.537277+0000","last_fullsized":"2021-10-08T19:24:51.537277+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:06.609550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:06.609550+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0037828580000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"69'5","reported_seq":88,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.530039+0000","last_change":"2021-10-08T19:23:17.993609+0000","last_active":"2021-10-08T19:24:51.530039+0000","last_peered":"2021-10-08T19:24:51.530039+0000","last_clean":"2021-10-08T19:24:51.530039+0000","last_became_active":"2021-10-08T19:21:25.609029+0000","last_became_peered":"2021-10-08T19:21:25.609029+0000","last_unstale":"2021-10-08T19:24:51.530039+0000","last_undegraded":"2021-10-08T19:24:51.530039+0000","last_fullsized":"2021-10-08T19:24:51.530039+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'5","last_scrub_stamp":"2021-10-08T19:23:17.993532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:17.993532+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040855580000000004,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":81,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.539586+0000","last_change":"2021-10-08T19:24:14.144555+0000","last_active":"2021-10-08T19:24:51.539586+0000","last_peered":"2021-10-08T19:24:51.539586+0000","last_clean":"2021-10-08T19:24:51.539586+0000","last_became_active":"2021-10-08T19:21:29.640978+0000","last_became_peered":"2021-10-08T19:21:29.640978+0000","last_unstale":"2021-10-08T19:24:51.539586+0000","last_undegraded":"2021-10-08T19:24:51.539586+0000","last_fullsized":"2021-10-08T19:24:51.539586+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:14.144450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:24:14.144450+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0032569320000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":76,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.540780+0000","last_change":"2021-10-08T19:23:05.799433+0000","last_active":"2021-10-08T19:24:51.540780+0000","last_peered":"2021-10-08T19:24:51.540780+0000","last_clean":"2021-10-08T19:24:51.540780+0000","last_became_active":"2021-10-08T19:21:27.633979+0000","last_became_peered":"2021-10-08T19:21:27.633979+0000","last_unstale":"2021-10-08T19:24:51.540780+0000","last_undegraded":"2021-10-08T19:24:51.540780+0000","last_fullsized":"2021-10-08T19:24:51.540780+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:05.799361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:05.799361+0000","last_clean_scrub_stamp":"2021-10-08T19:23:05.799361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0036358100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":87,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.536847+0000","last_change":"2021-10-08T19:24:15.574426+0000","last_active":"2021-10-08T19:24:51.536847+0000","last_peered":"2021-10-08T19:24:51.536847+0000","last_clean":"2021-10-08T19:24:51.536847+0000","last_became_active":"2021-10-08T19:21:23.607785+0000","last_became_peered":"2021-10-08T19:21:23.607785+0000","last_unstale":"2021-10-08T19:24:51.536847+0000","last_undegraded":"2021-10-08T19:24:51.536847+0000","last_fullsized":"2021-10-08T19:24:51.536847+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:15.574344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:15.574344+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0085919499999999992,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"69'9","reported_seq":94,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.529618+0000","last_change":"2021-10-08T19:23:19.997379+0000","last_active":"2021-10-08T19:24:51.529618+0000","last_peered":"2021-10-08T19:24:51.529618+0000","last_clean":"2021-10-08T19:24:51.529618+0000","last_became_active":"2021-10-08T19:21:25.608263+0000","last_became_peered":"2021-10-08T19:21:25.608263+0000","last_unstale":"2021-10-08T19:24:51.529618+0000","last_undegraded":"2021-10-08T19:24:51.529618+0000","last_fullsized":"2021-10-08T19:24:51.529618+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'9","last_scrub_stamp":"2021-10-08T19:23:19.997296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:19.997296+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040259689999999999,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":92,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.538307+0000","last_change":"2021-10-08T19:24:25.096752+0000","last_active":"2021-10-08T19:24:51.538307+0000","last_peered":"2021-10-08T19:24:51.538307+0000","last_clean":"2021-10-08T19:24:51.538307+0000","last_became_active":"2021-10-08T19:24:25.096419+0000","last_became_peered":"2021-10-08T19:24:25.096419+0000","last_unstale":"2021-10-08T19:24:51.538307+0000","last_undegraded":"2021-10-08T19:24:51.538307+0000","last_fullsized":"2021-10-08T19:24:51.538307+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:38.544673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:38.544673+0000","last_clean_scrub_stamp":"2021-10-08T19:22:38.544673+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0019818940000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":82,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.529967+0000","last_change":"2021-10-08T19:24:13.289692+0000","last_active":"2021-10-08T19:24:51.529967+0000","last_peered":"2021-10-08T19:24:51.529967+0000","last_clean":"2021-10-08T19:24:51.529967+0000","last_became_active":"2021-10-08T19:21:27.635242+0000","last_became_peered":"2021-10-08T19:21:27.635242+0000","last_unstale":"2021-10-08T19:24:51.529967+0000","last_undegraded":"2021-10-08T19:24:51.529967+0000","last_fullsized":"2021-10-08T19:24:51.529967+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:13.289586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:13.289586+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0093791299999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":98,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.536671+0000","last_change":"2021-10-08T19:24:25.097146+0000","last_active":"2021-10-08T19:24:51.536671+0000","last_peered":"2021-10-08T19:24:51.536671+0000","last_clean":"2021-10-08T19:24:51.536671+0000","last_became_active":"2021-10-08T19:24:25.096570+0000","last_became_peered":"2021-10-08T19:24:25.096570+0000","last_unstale":"2021-10-08T19:24:51.536671+0000","last_undegraded":"2021-10-08T19:24:51.536671+0000","last_fullsized":"2021-10-08T19:24:51.536671+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:07.581653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:07.581653+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034956309999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"69'12","reported_seq":101,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.536725+0000","last_change":"2021-10-08T19:23:10.562916+0000","last_active":"2021-10-08T19:24:51.536725+0000","last_peered":"2021-10-08T19:24:51.536725+0000","last_clean":"2021-10-08T19:24:51.536725+0000","last_became_active":"2021-10-08T19:21:25.612541+0000","last_became_peered":"2021-10-08T19:21:25.612541+0000","last_unstale":"2021-10-08T19:24:51.536725+0000","last_undegraded":"2021-10-08T19:24:51.536725+0000","last_fullsized":"2021-10-08T19:24:51.536725+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'12","last_scrub_stamp":"2021-10-08T19:23:10.562820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:10.562820+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040692890000000002,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":92,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.530814+0000","last_change":"2021-10-08T19:24:25.098136+0000","last_active":"2021-10-08T19:24:51.530814+0000","last_peered":"2021-10-08T19:24:51.530814+0000","last_clean":"2021-10-08T19:24:51.530814+0000","last_became_active":"2021-10-08T19:24:25.097782+0000","last_became_peered":"2021-10-08T19:24:25.097782+0000","last_unstale":"2021-10-08T19:24:51.530814+0000","last_undegraded":"2021-10-08T19:24:51.530814+0000","last_fullsized":"2021-10-08T19:24:51.530814+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:56.020759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:56.020759+0000","last_clean_scrub_stamp":"2021-10-08T19:22:56.020759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001373478,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":77,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.567397+0000","last_change":"2021-10-08T19:23:10.148845+0000","last_active":"2021-10-08T19:24:51.567397+0000","last_peered":"2021-10-08T19:24:51.567397+0000","last_clean":"2021-10-08T19:24:51.567397+0000","last_became_active":"2021-10-08T19:21:27.636398+0000","last_became_peered":"2021-10-08T19:21:27.636398+0000","last_unstale":"2021-10-08T19:24:51.567397+0000","last_undegraded":"2021-10-08T19:24:51.567397+0000","last_fullsized":"2021-10-08T19:24:51.567397+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:10.148774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:10.148774+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034045170000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":24,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.536378+0000","last_change":"2021-10-08T19:24:25.106611+0000","last_active":"2021-10-08T19:24:51.536378+0000","last_peered":"2021-10-08T19:24:51.536378+0000","last_clean":"2021-10-08T19:24:51.536378+0000","last_became_active":"2021-10-08T19:24:25.106119+0000","last_became_peered":"2021-10-08T19:24:25.106119+0000","last_unstale":"2021-10-08T19:24:51.536378+0000","last_undegraded":"2021-10-08T19:24:51.536378+0000","last_fullsized":"2021-10-08T19:24:51.536378+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:46.422866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:46.422866+0000","last_clean_scrub_stamp":"2021-10-08T19:22:46.422866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"69'15","reported_seq":129,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.537857+0000","last_change":"2021-10-08T19:22:52.474731+0000","last_active":"2021-10-08T19:24:51.537857+0000","last_peered":"2021-10-08T19:24:51.537857+0000","last_clean":"2021-10-08T19:24:51.537857+0000","last_became_active":"2021-10-08T19:22:44.005356+0000","last_became_peered":"2021-10-08T19:22:44.005356+0000","last_unstale":"2021-10-08T19:24:51.537857+0000","last_undegraded":"2021-10-08T19:24:51.537857+0000","last_fullsized":"2021-10-08T19:24:51.537857+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'15","last_scrub_stamp":"2021-10-08T19:22:52.474651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:52.474651+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040638499999999999,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"69'1","reported_seq":76,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.566950+0000","last_change":"2021-10-08T19:22:50.226593+0000","last_active":"2021-10-08T19:24:51.566950+0000","last_peered":"2021-10-08T19:24:51.566950+0000","last_clean":"2021-10-08T19:24:51.566950+0000","last_became_active":"2021-10-08T19:21:29.637392+0000","last_became_peered":"2021-10-08T19:21:29.637392+0000","last_unstale":"2021-10-08T19:24:51.566950+0000","last_undegraded":"2021-10-08T19:24:51.566950+0000","last_fullsized":"2021-10-08T19:24:51.566950+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2021-10-08T19:22:50.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:50.226504+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040000080000000002,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":83,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.542001+0000","last_change":"2021-10-08T19:24:13.178473+0000","last_active":"2021-10-08T19:24:51.542001+0000","last_peered":"2021-10-08T19:24:51.542001+0000","last_clean":"2021-10-08T19:24:51.542001+0000","last_became_active":"2021-10-08T19:21:27.632648+0000","last_became_peered":"2021-10-08T19:21:27.632648+0000","last_unstale":"2021-10-08T19:24:51.542001+0000","last_undegraded":"2021-10-08T19:24:51.542001+0000","last_fullsized":"2021-10-08T19:24:51.542001+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:13.178370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:13.178370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0056659290000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":98,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.536270+0000","last_change":"2021-10-08T19:24:25.098061+0000","last_active":"2021-10-08T19:24:51.536270+0000","last_peered":"2021-10-08T19:24:51.536270+0000","last_clean":"2021-10-08T19:24:51.536270+0000","last_became_active":"2021-10-08T19:24:25.097164+0000","last_became_peered":"2021-10-08T19:24:25.097164+0000","last_unstale":"2021-10-08T19:24:51.536270+0000","last_undegraded":"2021-10-08T19:24:51.536270+0000","last_fullsized":"2021-10-08T19:24:51.536270+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:11.535464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:11.535464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012302489999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"69'11","reported_seq":36,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.537741+0000","last_change":"2021-10-08T19:24:25.129616+0000","last_active":"2021-10-08T19:24:51.537741+0000","last_peered":"2021-10-08T19:24:51.537741+0000","last_clean":"2021-10-08T19:24:51.537741+0000","last_became_active":"2021-10-08T19:24:25.104985+0000","last_became_peered":"2021-10-08T19:24:25.104985+0000","last_unstale":"2021-10-08T19:24:51.537741+0000","last_undegraded":"2021-10-08T19:24:51.537741+0000","last_fullsized":"2021-10-08T19:24:51.537741+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'11","last_scrub_stamp":"2021-10-08T19:22:53.420199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:53.420199+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"69'1","reported_seq":76,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.537127+0000","last_change":"2021-10-08T19:23:04.311491+0000","last_active":"2021-10-08T19:24:51.537127+0000","last_peered":"2021-10-08T19:24:51.537127+0000","last_clean":"2021-10-08T19:24:51.537127+0000","last_became_active":"2021-10-08T19:21:29.640296+0000","last_became_peered":"2021-10-08T19:21:29.640296+0000","last_unstale":"2021-10-08T19:24:51.537127+0000","last_undegraded":"2021-10-08T19:24:51.537127+0000","last_fullsized":"2021-10-08T19:24:51.537127+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2021-10-08T19:23:04.311406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:04.311406+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0041668299999999998,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"114'10","reported_seq":35,"reported_epoch":127,"state":"active+clean","last_fresh":"2021-10-08T19:24:52.589155+0000","last_change":"2021-10-08T19:24:25.122871+0000","last_active":"2021-10-08T19:24:52.589155+0000","last_peered":"2021-10-08T19:24:52.589155+0000","last_clean":"2021-10-08T19:24:52.589155+0000","last_became_active":"2021-10-08T19:24:25.105742+0000","last_became_peered":"2021-10-08T19:24:25.105742+0000","last_unstale":"2021-10-08T19:24:52.589155+0000","last_undegraded":"2021-10-08T19:24:52.589155+0000","last_fullsized":"2021-10-08T19:24:52.589155+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'9","last_scrub_stamp":"2021-10-08T19:24:07.171989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:07.171989+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":80,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.540540+0000","last_change":"2021-10-08T19:23:19.631788+0000","last_active":"2021-10-08T19:24:51.540540+0000","last_peered":"2021-10-08T19:24:51.540540+0000","last_clean":"2021-10-08T19:24:51.540540+0000","last_became_active":"2021-10-08T19:21:23.604530+0000","last_became_peered":"2021-10-08T19:21:23.604530+0000","last_unstale":"2021-10-08T19:24:51.540540+0000","last_undegraded":"2021-10-08T19:24:51.540540+0000","last_fullsized":"2021-10-08T19:24:51.540540+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:19.631715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:19.631715+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0013318340000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"69'10","reported_seq":100,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.541923+0000","last_change":"2021-10-08T19:23:36.223620+0000","last_active":"2021-10-08T19:24:51.541923+0000","last_peered":"2021-10-08T19:24:51.541923+0000","last_clean":"2021-10-08T19:24:51.541923+0000","last_became_active":"2021-10-08T19:21:25.743519+0000","last_became_peered":"2021-10-08T19:21:25.743519+0000","last_unstale":"2021-10-08T19:24:51.541923+0000","last_undegraded":"2021-10-08T19:24:51.541923+0000","last_fullsized":"2021-10-08T19:24:51.541923+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'10","last_scrub_stamp":"2021-10-08T19:23:36.223545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:36.223545+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0023151259999999998,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":92,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.536989+0000","last_change":"2021-10-08T19:24:25.102165+0000","last_active":"2021-10-08T19:24:51.536989+0000","last_peered":"2021-10-08T19:24:51.536989+0000","last_clean":"2021-10-08T19:24:51.536989+0000","last_became_active":"2021-10-08T19:24:25.100477+0000","last_became_peered":"2021-10-08T19:24:25.100477+0000","last_unstale":"2021-10-08T19:24:51.536989+0000","last_undegraded":"2021-10-08T19:24:51.536989+0000","last_fullsized":"2021-10-08T19:24:51.536989+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:06.570853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:06.570853+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034079790000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":95,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.536618+0000","last_change":"2021-10-08T19:24:25.096183+0000","last_active":"2021-10-08T19:24:51.536618+0000","last_peered":"2021-10-08T19:24:51.536618+0000","last_clean":"2021-10-08T19:24:51.536618+0000","last_became_active":"2021-10-08T19:24:25.095490+0000","last_became_peered":"2021-10-08T19:24:25.095490+0000","last_unstale":"2021-10-08T19:24:51.536618+0000","last_undegraded":"2021-10-08T19:24:51.536618+0000","last_fullsized":"2021-10-08T19:24:51.536618+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:00.194892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:00.194892+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020373650000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.536873+0000","last_change":"2021-10-08T19:24:25.098448+0000","last_active":"2021-10-08T19:24:51.536873+0000","last_peered":"2021-10-08T19:24:51.536873+0000","last_clean":"2021-10-08T19:24:51.536873+0000","last_became_active":"2021-10-08T19:24:25.098128+0000","last_became_peered":"2021-10-08T19:24:25.098128+0000","last_unstale":"2021-10-08T19:24:51.536873+0000","last_undegraded":"2021-10-08T19:24:51.536873+0000","last_fullsized":"2021-10-08T19:24:51.536873+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:34.508558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:34.508558+0000","last_clean_scrub_stamp":"2021-10-08T19:23:34.508558+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"69'11","reported_seq":139,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.536540+0000","last_change":"2021-10-08T19:24:25.550057+0000","last_active":"2021-10-08T19:24:51.536540+0000","last_peered":"2021-10-08T19:24:51.536540+0000","last_clean":"2021-10-08T19:24:51.536540+0000","last_became_active":"2021-10-08T19:24:25.097676+0000","last_became_peered":"2021-10-08T19:24:25.097676+0000","last_unstale":"2021-10-08T19:24:51.536540+0000","last_undegraded":"2021-10-08T19:24:51.536540+0000","last_fullsized":"2021-10-08T19:24:51.536540+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'11","last_scrub_stamp":"2021-10-08T19:23:38.388959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:38.388959+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039620519999999998,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":81,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.535902+0000","last_change":"2021-10-08T19:24:18.542192+0000","last_active":"2021-10-08T19:24:51.535902+0000","last_peered":"2021-10-08T19:24:51.535902+0000","last_clean":"2021-10-08T19:24:51.535902+0000","last_became_active":"2021-10-08T19:21:29.642835+0000","last_became_peered":"2021-10-08T19:21:29.642835+0000","last_unstale":"2021-10-08T19:24:51.535902+0000","last_undegraded":"2021-10-08T19:24:51.535902+0000","last_fullsized":"2021-10-08T19:24:51.535902+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:18.542124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:24:18.542124+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0051790259999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":24,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.536524+0000","last_change":"2021-10-08T19:24:25.106499+0000","last_active":"2021-10-08T19:24:51.536524+0000","last_peered":"2021-10-08T19:24:51.536524+0000","last_clean":"2021-10-08T19:24:51.536524+0000","last_became_active":"2021-10-08T19:24:25.106186+0000","last_became_peered":"2021-10-08T19:24:25.106186+0000","last_unstale":"2021-10-08T19:24:51.536524+0000","last_undegraded":"2021-10-08T19:24:51.536524+0000","last_fullsized":"2021-10-08T19:24:51.536524+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:02.446394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:02.446394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":104,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.542900+0000","last_change":"2021-10-08T19:24:25.094735+0000","last_active":"2021-10-08T19:24:51.542900+0000","last_peered":"2021-10-08T19:24:51.542900+0000","last_clean":"2021-10-08T19:24:51.542900+0000","last_became_active":"2021-10-08T19:24:25.094384+0000","last_became_peered":"2021-10-08T19:24:25.094384+0000","last_unstale":"2021-10-08T19:24:51.542900+0000","last_undegraded":"2021-10-08T19:24:51.542900+0000","last_fullsized":"2021-10-08T19:24:51.542900+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:21.346014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:13.716331+0000","last_clean_scrub_stamp":"2021-10-08T19:24:21.346014+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0086210910000000009,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"69'4","reported_seq":114,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.535674+0000","last_change":"2021-10-08T19:24:25.622912+0000","last_active":"2021-10-08T19:24:51.535674+0000","last_peered":"2021-10-08T19:24:51.535674+0000","last_clean":"2021-10-08T19:24:51.535674+0000","last_became_active":"2021-10-08T19:24:25.097674+0000","last_became_peered":"2021-10-08T19:24:25.097674+0000","last_unstale":"2021-10-08T19:24:51.535674+0000","last_undegraded":"2021-10-08T19:24:51.535674+0000","last_fullsized":"2021-10-08T19:24:51.535674+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'4","last_scrub_stamp":"2021-10-08T19:22:34.447854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:34.447854+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040770490000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":74,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.536056+0000","last_change":"2021-10-08T19:23:12.504222+0000","last_active":"2021-10-08T19:24:51.536056+0000","last_peered":"2021-10-08T19:24:51.536056+0000","last_clean":"2021-10-08T19:24:51.536056+0000","last_became_active":"2021-10-08T19:21:29.649225+0000","last_became_peered":"2021-10-08T19:21:29.649225+0000","last_unstale":"2021-10-08T19:24:51.536056+0000","last_undegraded":"2021-10-08T19:24:51.536056+0000","last_fullsized":"2021-10-08T19:24:51.536056+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:12.504136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:12.504136+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0038704550000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":77,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.565741+0000","last_change":"2021-10-08T19:22:43.186757+0000","last_active":"2021-10-08T19:24:51.565741+0000","last_peered":"2021-10-08T19:24:51.565741+0000","last_clean":"2021-10-08T19:24:51.565741+0000","last_became_active":"2021-10-08T19:21:27.635623+0000","last_became_peered":"2021-10-08T19:21:27.635623+0000","last_unstale":"2021-10-08T19:24:51.565741+0000","last_undegraded":"2021-10-08T19:24:51.565741+0000","last_fullsized":"2021-10-08T19:24:51.565741+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:43.186684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:43.186684+0000","last_clean_scrub_stamp":"2021-10-08T19:22:43.186684+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0015123129999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":81,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.567148+0000","last_change":"2021-10-08T19:23:02.242539+0000","last_active":"2021-10-08T19:24:51.567148+0000","last_peered":"2021-10-08T19:24:51.567148+0000","last_clean":"2021-10-08T19:24:51.567148+0000","last_became_active":"2021-10-08T19:21:23.607048+0000","last_became_peered":"2021-10-08T19:21:23.607048+0000","last_unstale":"2021-10-08T19:24:51.567148+0000","last_undegraded":"2021-10-08T19:24:51.567148+0000","last_fullsized":"2021-10-08T19:24:51.567148+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:02.242462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:02.242462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034031740000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"69'11","reported_seq":173,"reported_epoch":126,"state":"active+recovery_wait+degraded","last_fresh":"2021-10-08T19:24:51.529947+0000","last_change":"2021-10-08T19:24:47.503908+0000","last_active":"2021-10-08T19:24:51.529947+0000","last_peered":"2021-10-08T19:24:51.529947+0000","last_clean":"2021-10-08T19:24:40.461198+0000","last_became_active":"2021-10-08T19:24:47.503536+0000","last_became_peered":"2021-10-08T19:24:47.503536+0000","last_unstale":"2021-10-08T19:24:51.529947+0000","last_undegraded":"2021-10-08T19:24:47.488427+0000","last_fullsized":"2021-10-08T19:24:51.529947+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'11","last_scrub_stamp":"2021-10-08T19:24:04.177847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:24:04.177847+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0047576429999999998,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":["4","2","6"],"object_location_counts":[{"shards":"2,4,6","objects":5}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":75,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.539125+0000","last_change":"2021-10-08T19:23:02.605102+0000","last_active":"2021-10-08T19:24:51.539125+0000","last_peered":"2021-10-08T19:24:51.539125+0000","last_clean":"2021-10-08T19:24:51.539125+0000","last_became_active":"2021-10-08T19:21:29.641431+0000","last_became_peered":"2021-10-08T19:21:29.641431+0000","last_unstale":"2021-10-08T19:24:51.539125+0000","last_undegraded":"2021-10-08T19:24:51.539125+0000","last_fullsized":"2021-10-08T19:24:51.539125+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:02.605025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:02.605025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001265305,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":76,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.536748+0000","last_change":"2021-10-08T19:23:28.367444+0000","last_active":"2021-10-08T19:24:51.536748+0000","last_peered":"2021-10-08T19:24:51.536748+0000","last_clean":"2021-10-08T19:24:51.536748+0000","last_became_active":"2021-10-08T19:21:27.637800+0000","last_became_peered":"2021-10-08T19:21:27.637800+0000","last_unstale":"2021-10-08T19:24:51.536748+0000","last_undegraded":"2021-10-08T19:24:51.536748+0000","last_fullsized":"2021-10-08T19:24:51.536748+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:28.367323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.367323+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034823359999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":24,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.536737+0000","last_change":"2021-10-08T19:24:25.105338+0000","last_active":"2021-10-08T19:24:51.536737+0000","last_peered":"2021-10-08T19:24:51.536737+0000","last_clean":"2021-10-08T19:24:51.536737+0000","last_became_active":"2021-10-08T19:24:25.105096+0000","last_became_peered":"2021-10-08T19:24:25.105096+0000","last_unstale":"2021-10-08T19:24:51.536737+0000","last_undegraded":"2021-10-08T19:24:51.536737+0000","last_fullsized":"2021-10-08T19:24:51.536737+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:52.408893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:52.408893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"87'13","reported_seq":137,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.565602+0000","last_change":"2021-10-08T19:24:25.114792+0000","last_active":"2021-10-08T19:24:51.565602+0000","last_peered":"2021-10-08T19:24:51.565602+0000","last_clean":"2021-10-08T19:24:51.565602+0000","last_became_active":"2021-10-08T19:24:25.091885+0000","last_became_peered":"2021-10-08T19:24:25.091885+0000","last_unstale":"2021-10-08T19:24:51.565602+0000","last_undegraded":"2021-10-08T19:24:51.565602+0000","last_fullsized":"2021-10-08T19:24:51.565602+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'13","last_scrub_stamp":"2021-10-08T19:22:53.263631+0000","last_deep_scrub":"87'13","last_deep_scrub_stamp":"2021-10-08T19:22:53.263631+0000","last_clean_scrub_stamp":"2021-10-08T19:22:53.263631+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0036954140000000002,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":74,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.531347+0000","last_change":"2021-10-08T19:22:49.049456+0000","last_active":"2021-10-08T19:24:51.531347+0000","last_peered":"2021-10-08T19:24:51.531347+0000","last_clean":"2021-10-08T19:24:51.531347+0000","last_became_active":"2021-10-08T19:21:29.640302+0000","last_became_peered":"2021-10-08T19:21:29.640302+0000","last_unstale":"2021-10-08T19:24:51.531347+0000","last_undegraded":"2021-10-08T19:24:51.531347+0000","last_fullsized":"2021-10-08T19:24:51.531347+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:49.049379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:49.049379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.00162856,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"69'8","reported_seq":132,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.746763+0000","last_change":"2021-10-08T19:24:16.547591+0000","last_active":"2021-10-08T19:24:51.746763+0000","last_peered":"2021-10-08T19:24:51.746763+0000","last_clean":"2021-10-08T19:24:51.746763+0000","last_became_active":"2021-10-08T19:21:27.636440+0000","last_became_peered":"2021-10-08T19:21:27.636440+0000","last_unstale":"2021-10-08T19:24:51.746763+0000","last_undegraded":"2021-10-08T19:24:51.746763+0000","last_fullsized":"2021-10-08T19:24:51.746763+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'8","last_scrub_stamp":"2021-10-08T19:24:16.547475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:16.547475+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0084390609999999994,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":87,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.540061+0000","last_change":"2021-10-08T19:23:27.367010+0000","last_active":"2021-10-08T19:24:51.540061+0000","last_peered":"2021-10-08T19:24:51.540061+0000","last_clean":"2021-10-08T19:24:51.540061+0000","last_became_active":"2021-10-08T19:21:23.606478+0000","last_became_peered":"2021-10-08T19:21:23.606478+0000","last_unstale":"2021-10-08T19:24:51.540061+0000","last_undegraded":"2021-10-08T19:24:51.540061+0000","last_fullsized":"2021-10-08T19:24:51.540061+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:27.366934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:27.366934+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0016199809999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"69'9","reported_seq":100,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.541360+0000","last_change":"2021-10-08T19:24:04.286963+0000","last_active":"2021-10-08T19:24:51.541360+0000","last_peered":"2021-10-08T19:24:51.541360+0000","last_clean":"2021-10-08T19:24:51.541360+0000","last_became_active":"2021-10-08T19:21:25.741755+0000","last_became_peered":"2021-10-08T19:21:25.741755+0000","last_unstale":"2021-10-08T19:24:51.541360+0000","last_undegraded":"2021-10-08T19:24:51.541360+0000","last_fullsized":"2021-10-08T19:24:51.541360+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'9","last_scrub_stamp":"2021-10-08T19:24:04.286857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:24:04.286857+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0047281429999999998,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":75,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.541401+0000","last_change":"2021-10-08T19:23:11.535748+0000","last_active":"2021-10-08T19:24:51.541401+0000","last_peered":"2021-10-08T19:24:51.541401+0000","last_clean":"2021-10-08T19:24:51.541401+0000","last_became_active":"2021-10-08T19:21:29.646331+0000","last_became_peered":"2021-10-08T19:21:29.646331+0000","last_unstale":"2021-10-08T19:24:51.541401+0000","last_undegraded":"2021-10-08T19:24:51.541401+0000","last_fullsized":"2021-10-08T19:24:51.541401+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:11.535641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:11.535641+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001740417,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"69'8","reported_seq":133,"reported_epoch":127,"state":"active+clean","last_fresh":"2021-10-08T19:24:52.599552+0000","last_change":"2021-10-08T19:24:10.319907+0000","last_active":"2021-10-08T19:24:52.599552+0000","last_peered":"2021-10-08T19:24:52.599552+0000","last_clean":"2021-10-08T19:24:52.599552+0000","last_became_active":"2021-10-08T19:21:27.635924+0000","last_became_peered":"2021-10-08T19:21:27.635924+0000","last_unstale":"2021-10-08T19:24:52.599552+0000","last_undegraded":"2021-10-08T19:24:52.599552+0000","last_fullsized":"2021-10-08T19:24:52.599552+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'8","last_scrub_stamp":"2021-10-08T19:24:10.319809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:10.319809+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0087040810000000007,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":86,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.540875+0000","last_change":"2021-10-08T19:24:23.338025+0000","last_active":"2021-10-08T19:24:51.540875+0000","last_peered":"2021-10-08T19:24:51.540875+0000","last_clean":"2021-10-08T19:24:51.540875+0000","last_became_active":"2021-10-08T19:21:23.603637+0000","last_became_peered":"2021-10-08T19:21:23.603637+0000","last_unstale":"2021-10-08T19:24:51.540875+0000","last_undegraded":"2021-10-08T19:24:51.540875+0000","last_fullsized":"2021-10-08T19:24:51.540875+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:23.337954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:23.337954+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0033141500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"69'10","reported_seq":54,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.537256+0000","last_change":"2021-10-08T19:23:45.670593+0000","last_active":"2021-10-08T19:24:51.537256+0000","last_peered":"2021-10-08T19:24:51.537256+0000","last_clean":"2021-10-08T19:24:51.537256+0000","last_became_active":"2021-10-08T19:23:44.806124+0000","last_became_peered":"2021-10-08T19:23:44.806124+0000","last_unstale":"2021-10-08T19:24:51.537256+0000","last_undegraded":"2021-10-08T19:24:51.537256+0000","last_fullsized":"2021-10-08T19:24:51.537256+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'10","last_scrub_stamp":"2021-10-08T19:22:52.611060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:52.611060+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,7],"acting":[2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":99,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.537236+0000","last_change":"2021-10-08T19:24:25.099693+0000","last_active":"2021-10-08T19:24:51.537236+0000","last_peered":"2021-10-08T19:24:51.537236+0000","last_clean":"2021-10-08T19:24:51.537236+0000","last_became_active":"2021-10-08T19:24:25.099371+0000","last_became_peered":"2021-10-08T19:24:25.099371+0000","last_unstale":"2021-10-08T19:24:51.537236+0000","last_undegraded":"2021-10-08T19:24:51.537236+0000","last_fullsized":"2021-10-08T19:24:51.537236+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:40.417858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:40.417858+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0014005230000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":82,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.542823+0000","last_change":"2021-10-08T19:24:22.361236+0000","last_active":"2021-10-08T19:24:51.542823+0000","last_peered":"2021-10-08T19:24:51.542823+0000","last_clean":"2021-10-08T19:24:51.542823+0000","last_became_active":"2021-10-08T19:21:27.634443+0000","last_became_peered":"2021-10-08T19:21:27.634443+0000","last_unstale":"2021-10-08T19:24:51.542823+0000","last_undegraded":"2021-10-08T19:24:51.542823+0000","last_fullsized":"2021-10-08T19:24:51.542823+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:22.361166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:22.361166+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011785238,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.536441+0000","last_change":"2021-10-08T19:24:25.105291+0000","last_active":"2021-10-08T19:24:51.536441+0000","last_peered":"2021-10-08T19:24:51.536441+0000","last_clean":"2021-10-08T19:24:51.536441+0000","last_became_active":"2021-10-08T19:24:25.104551+0000","last_became_peered":"2021-10-08T19:24:25.104551+0000","last_unstale":"2021-10-08T19:24:51.536441+0000","last_undegraded":"2021-10-08T19:24:51.536441+0000","last_fullsized":"2021-10-08T19:24:51.536441+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:40.579610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:40.579610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"69'6","reported_seq":87,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.538386+0000","last_change":"2021-10-08T19:23:21.395469+0000","last_active":"2021-10-08T19:24:51.538386+0000","last_peered":"2021-10-08T19:24:51.538386+0000","last_clean":"2021-10-08T19:24:51.538386+0000","last_became_active":"2021-10-08T19:21:25.742631+0000","last_became_peered":"2021-10-08T19:21:25.742631+0000","last_unstale":"2021-10-08T19:24:51.538386+0000","last_undegraded":"2021-10-08T19:24:51.538386+0000","last_fullsized":"2021-10-08T19:24:51.538386+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'6","last_scrub_stamp":"2021-10-08T19:23:21.395390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:21.395390+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002416241,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":81,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.537419+0000","last_change":"2021-10-08T19:24:05.869865+0000","last_active":"2021-10-08T19:24:51.537419+0000","last_peered":"2021-10-08T19:24:51.537419+0000","last_clean":"2021-10-08T19:24:51.537419+0000","last_became_active":"2021-10-08T19:21:29.640674+0000","last_became_peered":"2021-10-08T19:21:29.640674+0000","last_unstale":"2021-10-08T19:24:51.537419+0000","last_undegraded":"2021-10-08T19:24:51.537419+0000","last_fullsized":"2021-10-08T19:24:51.537419+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:05.869774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:24:05.869774+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0041453820000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":76,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.538457+0000","last_change":"2021-10-08T19:22:36.466178+0000","last_active":"2021-10-08T19:24:51.538457+0000","last_peered":"2021-10-08T19:24:51.538457+0000","last_clean":"2021-10-08T19:24:51.538457+0000","last_became_active":"2021-10-08T19:21:27.638112+0000","last_became_peered":"2021-10-08T19:21:27.638112+0000","last_unstale":"2021-10-08T19:24:51.538457+0000","last_undegraded":"2021-10-08T19:24:51.538457+0000","last_fullsized":"2021-10-08T19:24:51.538457+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:36.466077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:36.466077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0018534809999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":87,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.534541+0000","last_change":"2021-10-08T19:23:36.618221+0000","last_active":"2021-10-08T19:24:51.534541+0000","last_peered":"2021-10-08T19:24:51.534541+0000","last_clean":"2021-10-08T19:24:51.534541+0000","last_became_active":"2021-10-08T19:21:23.598125+0000","last_became_peered":"2021-10-08T19:21:23.598125+0000","last_unstale":"2021-10-08T19:24:51.534541+0000","last_undegraded":"2021-10-08T19:24:51.534541+0000","last_fullsized":"2021-10-08T19:24:51.534541+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:36.618136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:36.618136+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0014720390000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"69'9","reported_seq":95,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.541663+0000","last_change":"2021-10-08T19:23:00.644527+0000","last_active":"2021-10-08T19:24:51.541663+0000","last_peered":"2021-10-08T19:24:51.541663+0000","last_clean":"2021-10-08T19:24:51.541663+0000","last_became_active":"2021-10-08T19:21:25.743804+0000","last_became_peered":"2021-10-08T19:21:25.743804+0000","last_unstale":"2021-10-08T19:24:51.541663+0000","last_undegraded":"2021-10-08T19:24:51.541663+0000","last_fullsized":"2021-10-08T19:24:51.541663+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'9","last_scrub_stamp":"2021-10-08T19:23:00.644449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:00.644449+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0023246959999999998,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.a","version":"127'4419","reported_seq":4459,"reported_epoch":127,"state":"active+clean","last_fresh":"2021-10-08T19:24:53.481901+0000","last_change":"2021-10-08T19:23:44.808183+0000","last_active":"2021-10-08T19:24:53.481901+0000","last_peered":"2021-10-08T19:24:53.481901+0000","last_clean":"2021-10-08T19:24:53.481901+0000","last_became_active":"2021-10-08T19:23:44.807891+0000","last_became_peered":"2021-10-08T19:23:44.807891+0000","last_unstale":"2021-10-08T19:24:53.481901+0000","last_undegraded":"2021-10-08T19:24:53.481901+0000","last_fullsized":"2021-10-08T19:24:53.481901+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":4419,"ondisk_log_size":4419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":289603584,"num_objects":4419,"num_object_clones":0,"num_object_copies":13257,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4419,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4419,"num_write_kb":282816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":74,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.536825+0000","last_change":"2021-10-08T19:24:12.484917+0000","last_active":"2021-10-08T19:24:51.536825+0000","last_peered":"2021-10-08T19:24:51.536825+0000","last_clean":"2021-10-08T19:24:51.536825+0000","last_became_active":"2021-10-08T19:21:29.647140+0000","last_became_peered":"2021-10-08T19:21:29.647140+0000","last_unstale":"2021-10-08T19:24:51.536825+0000","last_undegraded":"2021-10-08T19:24:51.536825+0000","last_fullsized":"2021-10-08T19:24:51.536825+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:12.484818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:24:12.484818+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0047233090000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"61'2","reported_seq":96,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.531253+0000","last_change":"2021-10-08T19:23:07.991466+0000","last_active":"2021-10-08T19:24:51.531253+0000","last_peered":"2021-10-08T19:24:51.531253+0000","last_clean":"2021-10-08T19:24:51.531253+0000","last_became_active":"2021-10-08T19:21:23.603614+0000","last_became_peered":"2021-10-08T19:21:23.603614+0000","last_unstale":"2021-10-08T19:24:51.531253+0000","last_undegraded":"2021-10-08T19:24:51.531253+0000","last_fullsized":"2021-10-08T19:24:51.531253+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'2","last_scrub_stamp":"2021-10-08T19:23:07.991388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:07.991388+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001614983,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"69'12","reported_seq":101,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.531253+0000","last_change":"2021-10-08T19:22:57.003718+0000","last_active":"2021-10-08T19:24:51.531253+0000","last_peered":"2021-10-08T19:24:51.531253+0000","last_clean":"2021-10-08T19:24:51.531253+0000","last_became_active":"2021-10-08T19:21:25.609079+0000","last_became_peered":"2021-10-08T19:21:25.609079+0000","last_unstale":"2021-10-08T19:24:51.531253+0000","last_undegraded":"2021-10-08T19:24:51.531253+0000","last_fullsized":"2021-10-08T19:24:51.531253+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'12","last_scrub_stamp":"2021-10-08T19:22:57.003641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:57.003641+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0041017010000000001,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":77,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.534618+0000","last_change":"2021-10-08T19:22:50.435623+0000","last_active":"2021-10-08T19:24:51.534618+0000","last_peered":"2021-10-08T19:24:51.534618+0000","last_clean":"2021-10-08T19:24:51.534618+0000","last_became_active":"2021-10-08T19:21:27.633878+0000","last_became_peered":"2021-10-08T19:21:27.633878+0000","last_unstale":"2021-10-08T19:24:51.534618+0000","last_undegraded":"2021-10-08T19:24:51.534618+0000","last_fullsized":"2021-10-08T19:24:51.534618+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:50.435552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:50.435552+0000","last_clean_scrub_stamp":"2021-10-08T19:22:50.435552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0012976140000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":35,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.540959+0000","last_change":"2021-10-08T19:24:17.379625+0000","last_active":"2021-10-08T19:24:51.540959+0000","last_peered":"2021-10-08T19:24:51.540959+0000","last_clean":"2021-10-08T19:24:51.540959+0000","last_became_active":"2021-10-08T19:24:13.510808+0000","last_became_peered":"2021-10-08T19:24:13.510808+0000","last_unstale":"2021-10-08T19:24:51.540959+0000","last_undegraded":"2021-10-08T19:24:51.540959+0000","last_fullsized":"2021-10-08T19:24:51.540959+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:17.379559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:17.379559+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0052805589999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1","version":"127'4604","reported_seq":5385,"reported_epoch":127,"state":"active+recovering+undersized+remapped","last_fresh":"2021-10-08T19:24:58.424344+0000","last_change":"2021-10-08T19:24:26.866446+0000","last_active":"2021-10-08T19:24:58.424344+0000","last_peered":"2021-10-08T19:24:58.424344+0000","last_clean":"2021-10-08T19:24:23.998781+0000","last_became_active":"2021-10-08T19:24:26.845215+0000","last_became_peered":"2021-10-08T19:24:26.845215+0000","last_unstale":"2021-10-08T19:24:58.424344+0000","last_undegraded":"2021-10-08T19:24:58.424344+0000","last_fullsized":"2021-10-08T19:24:26.076656+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":4604,"ondisk_log_size":4604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":301727744,"num_objects":4604,"num_object_clones":0,"num_object_copies":13812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2676,"num_objects_unfound":0,"num_objects_dirty":4604,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4604,"num_write_kb":294656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":368,"num_bytes_recovered":24117248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3],"avail_no_missing":["4","1","3"],"object_location_counts":[{"shards":"1,3,4","objects":2676},{"shards":"3,4","objects":1928}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":75,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.539214+0000","last_change":"2021-10-08T19:22:46.569728+0000","last_active":"2021-10-08T19:24:51.539214+0000","last_peered":"2021-10-08T19:24:51.539214+0000","last_clean":"2021-10-08T19:24:51.539214+0000","last_became_active":"2021-10-08T19:21:29.649735+0000","last_became_peered":"2021-10-08T19:21:29.649735+0000","last_unstale":"2021-10-08T19:24:51.539214+0000","last_undegraded":"2021-10-08T19:24:51.539214+0000","last_fullsized":"2021-10-08T19:24:51.539214+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:46.569603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:46.569603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001693387,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":87,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.565509+0000","last_change":"2021-10-08T19:24:11.227195+0000","last_active":"2021-10-08T19:24:51.565509+0000","last_peered":"2021-10-08T19:24:51.565509+0000","last_clean":"2021-10-08T19:24:51.565509+0000","last_became_active":"2021-10-08T19:21:23.605441+0000","last_became_peered":"2021-10-08T19:21:23.605441+0000","last_unstale":"2021-10-08T19:24:51.565509+0000","last_undegraded":"2021-10-08T19:24:51.565509+0000","last_fullsized":"2021-10-08T19:24:51.565509+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:11.227079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:11.227079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014709302,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"69'10","reported_seq":100,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.565674+0000","last_change":"2021-10-08T19:24:17.162629+0000","last_active":"2021-10-08T19:24:51.565674+0000","last_peered":"2021-10-08T19:24:51.565674+0000","last_clean":"2021-10-08T19:24:51.565674+0000","last_became_active":"2021-10-08T19:21:25.608581+0000","last_became_peered":"2021-10-08T19:21:25.608581+0000","last_unstale":"2021-10-08T19:24:51.565674+0000","last_undegraded":"2021-10-08T19:24:51.565674+0000","last_fullsized":"2021-10-08T19:24:51.565674+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'10","last_scrub_stamp":"2021-10-08T19:24:17.162525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:24:17.162525+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0071187819999999997,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"114'10","reported_seq":160,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.751646+0000","last_change":"2021-10-08T19:24:25.551891+0000","last_active":"2021-10-08T19:24:51.751646+0000","last_peered":"2021-10-08T19:24:51.751646+0000","last_clean":"2021-10-08T19:24:51.751646+0000","last_became_active":"2021-10-08T19:24:25.106695+0000","last_became_peered":"2021-10-08T19:24:25.106695+0000","last_unstale":"2021-10-08T19:24:51.751646+0000","last_undegraded":"2021-10-08T19:24:51.751646+0000","last_fullsized":"2021-10-08T19:24:51.751646+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'9","last_scrub_stamp":"2021-10-08T19:24:04.193898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:04.193898+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0022019909999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":40,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.529959+0000","last_change":"2021-10-08T19:24:25.099885+0000","last_active":"2021-10-08T19:24:51.529959+0000","last_peered":"2021-10-08T19:24:51.529959+0000","last_clean":"2021-10-08T19:24:51.529959+0000","last_became_active":"2021-10-08T19:24:25.099574+0000","last_became_peered":"2021-10-08T19:24:25.099574+0000","last_unstale":"2021-10-08T19:24:51.529959+0000","last_undegraded":"2021-10-08T19:24:51.529959+0000","last_fullsized":"2021-10-08T19:24:51.529959+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:09.177525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:09.177525+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.7","version":"127'4356","reported_seq":4402,"reported_epoch":127,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-10-08T19:24:53.453675+0000","last_change":"2021-10-08T19:24:26.876521+0000","last_active":"2021-10-08T19:24:53.453675+0000","last_peered":"2021-10-08T19:24:53.453675+0000","last_clean":"2021-10-08T19:24:23.994230+0000","last_became_active":"2021-10-08T19:24:26.869772+0000","last_became_peered":"2021-10-08T19:24:26.869772+0000","last_unstale":"2021-10-08T19:24:53.453675+0000","last_undegraded":"2021-10-08T19:24:26.123494+0000","last_fullsized":"2021-10-08T19:24:26.101870+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":4356,"ondisk_log_size":4356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":285474816,"num_objects":4356,"num_object_clones":0,"num_object_copies":13068,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3052,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4356,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4356,"num_write_kb":278784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[0,3],"avail_no_missing":["0","1","3"],"object_location_counts":[{"shards":"0,1,3","objects":3052},{"shards":"0,3","objects":1304}],"blocked_by":[],"up_primary":6,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":74,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.537410+0000","last_change":"2021-10-08T19:23:25.378511+0000","last_active":"2021-10-08T19:24:51.537410+0000","last_peered":"2021-10-08T19:24:51.537410+0000","last_clean":"2021-10-08T19:24:51.537410+0000","last_became_active":"2021-10-08T19:21:29.647403+0000","last_became_peered":"2021-10-08T19:21:29.647403+0000","last_unstale":"2021-10-08T19:24:51.537410+0000","last_undegraded":"2021-10-08T19:24:51.537410+0000","last_fullsized":"2021-10-08T19:24:51.537410+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:25.378429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:25.378429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0050198400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":98,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.540958+0000","last_change":"2021-10-08T19:24:25.089874+0000","last_active":"2021-10-08T19:24:51.540958+0000","last_peered":"2021-10-08T19:24:51.540958+0000","last_clean":"2021-10-08T19:24:51.540958+0000","last_became_active":"2021-10-08T19:24:25.089422+0000","last_became_peered":"2021-10-08T19:24:25.089422+0000","last_unstale":"2021-10-08T19:24:51.540958+0000","last_undegraded":"2021-10-08T19:24:51.540958+0000","last_fullsized":"2021-10-08T19:24:51.540958+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:01.746914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:01.746914+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001402506,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"69'28","reported_seq":175,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.752344+0000","last_change":"2021-10-08T19:24:18.179832+0000","last_active":"2021-10-08T19:24:51.752344+0000","last_peered":"2021-10-08T19:24:51.752344+0000","last_clean":"2021-10-08T19:24:51.752344+0000","last_became_active":"2021-10-08T19:21:25.613663+0000","last_became_peered":"2021-10-08T19:21:25.613663+0000","last_unstale":"2021-10-08T19:24:51.752344+0000","last_undegraded":"2021-10-08T19:24:51.752344+0000","last_fullsized":"2021-10-08T19:24:51.752344+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'28","last_scrub_stamp":"2021-10-08T19:24:18.179708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:24:18.179708+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0076258280000000003,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":77,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.541519+0000","last_change":"2021-10-08T19:23:03.639015+0000","last_active":"2021-10-08T19:24:51.541519+0000","last_peered":"2021-10-08T19:24:51.541519+0000","last_clean":"2021-10-08T19:24:51.541519+0000","last_became_active":"2021-10-08T19:21:27.636192+0000","last_became_peered":"2021-10-08T19:21:27.636192+0000","last_unstale":"2021-10-08T19:24:51.541519+0000","last_undegraded":"2021-10-08T19:24:51.541519+0000","last_fullsized":"2021-10-08T19:24:51.541519+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:03.638920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:03.638920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0016933230000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"127'4395","reported_seq":4436,"reported_epoch":127,"state":"active+clean","last_fresh":"2021-10-08T19:24:53.562178+0000","last_change":"2021-10-08T19:23:44.815167+0000","last_active":"2021-10-08T19:24:53.562178+0000","last_peered":"2021-10-08T19:24:53.562178+0000","last_clean":"2021-10-08T19:24:53.562178+0000","last_became_active":"2021-10-08T19:23:44.814856+0000","last_became_peered":"2021-10-08T19:23:44.814856+0000","last_unstale":"2021-10-08T19:24:53.562178+0000","last_undegraded":"2021-10-08T19:24:53.562178+0000","last_fullsized":"2021-10-08T19:24:53.562178+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":4395,"ondisk_log_size":4395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":288030720,"num_objects":4395,"num_object_clones":0,"num_object_copies":13185,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4395,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4395,"num_write_kb":281280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":93,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.537351+0000","last_change":"2021-10-08T19:24:25.096670+0000","last_active":"2021-10-08T19:24:51.537351+0000","last_peered":"2021-10-08T19:24:51.537351+0000","last_clean":"2021-10-08T19:24:51.537351+0000","last_became_active":"2021-10-08T19:24:25.095748+0000","last_became_peered":"2021-10-08T19:24:25.095748+0000","last_unstale":"2021-10-08T19:24:51.537351+0000","last_undegraded":"2021-10-08T19:24:51.537351+0000","last_fullsized":"2021-10-08T19:24:51.537351+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:01.215579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:01.215579+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001463748,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"70'5","reported_seq":276,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.564307+0000","last_change":"2021-10-08T19:24:25.093611+0000","last_active":"2021-10-08T19:24:51.564307+0000","last_peered":"2021-10-08T19:24:51.564307+0000","last_clean":"2021-10-08T19:24:51.564307+0000","last_became_active":"2021-10-08T19:24:25.092538+0000","last_became_peered":"2021-10-08T19:24:25.092538+0000","last_unstale":"2021-10-08T19:24:51.564307+0000","last_undegraded":"2021-10-08T19:24:51.564307+0000","last_fullsized":"2021-10-08T19:24:51.564307+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:22:48.239721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:48.239721+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001618092,"stat_sum":{"num_bytes":97,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":38,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":97,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":87,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.533055+0000","last_change":"2021-10-08T19:24:21.997890+0000","last_active":"2021-10-08T19:24:51.533055+0000","last_peered":"2021-10-08T19:24:51.533055+0000","last_clean":"2021-10-08T19:24:51.533055+0000","last_became_active":"2021-10-08T19:21:23.602967+0000","last_became_peered":"2021-10-08T19:21:23.602967+0000","last_unstale":"2021-10-08T19:24:51.533055+0000","last_undegraded":"2021-10-08T19:24:51.533055+0000","last_fullsized":"2021-10-08T19:24:51.533055+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:21.997791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:21.997791+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0069284359999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"69'13","reported_seq":112,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.566465+0000","last_change":"2021-10-08T19:24:08.192556+0000","last_active":"2021-10-08T19:24:51.566465+0000","last_peered":"2021-10-08T19:24:51.566465+0000","last_clean":"2021-10-08T19:24:51.566465+0000","last_became_active":"2021-10-08T19:21:25.608584+0000","last_became_peered":"2021-10-08T19:21:25.608584+0000","last_unstale":"2021-10-08T19:24:51.566465+0000","last_undegraded":"2021-10-08T19:24:51.566465+0000","last_fullsized":"2021-10-08T19:24:51.566465+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'13","last_scrub_stamp":"2021-10-08T19:24:08.192428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:24:08.192428+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.015716936000000001,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":77,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.536724+0000","last_change":"2021-10-08T19:23:06.487842+0000","last_active":"2021-10-08T19:24:51.536724+0000","last_peered":"2021-10-08T19:24:51.536724+0000","last_clean":"2021-10-08T19:24:51.536724+0000","last_became_active":"2021-10-08T19:21:27.637875+0000","last_became_peered":"2021-10-08T19:21:27.637875+0000","last_unstale":"2021-10-08T19:24:51.536724+0000","last_undegraded":"2021-10-08T19:24:51.536724+0000","last_fullsized":"2021-10-08T19:24:51.536724+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:06.487723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:06.487723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034218619999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"127'4352","reported_seq":4393,"reported_epoch":127,"state":"active+clean","last_fresh":"2021-10-08T19:24:53.546165+0000","last_change":"2021-10-08T19:23:44.811881+0000","last_active":"2021-10-08T19:24:53.546165+0000","last_peered":"2021-10-08T19:24:53.546165+0000","last_clean":"2021-10-08T19:24:53.546165+0000","last_became_active":"2021-10-08T19:23:44.810317+0000","last_became_peered":"2021-10-08T19:23:44.810317+0000","last_unstale":"2021-10-08T19:24:53.546165+0000","last_undegraded":"2021-10-08T19:24:53.546165+0000","last_fullsized":"2021-10-08T19:24:53.546165+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":4352,"ondisk_log_size":4352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":285212672,"num_objects":4352,"num_object_clones":0,"num_object_copies":13056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4352,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4352,"num_write_kb":278528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":74,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.541625+0000","last_change":"2021-10-08T19:23:14.763360+0000","last_active":"2021-10-08T19:24:51.541625+0000","last_peered":"2021-10-08T19:24:51.541625+0000","last_clean":"2021-10-08T19:24:51.541625+0000","last_became_active":"2021-10-08T19:21:29.646242+0000","last_became_peered":"2021-10-08T19:21:29.646242+0000","last_unstale":"2021-10-08T19:24:51.541625+0000","last_undegraded":"2021-10-08T19:24:51.541625+0000","last_fullsized":"2021-10-08T19:24:51.541625+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:14.763280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:14.763280+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034824790000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":107,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.536418+0000","last_change":"2021-10-08T19:24:25.097072+0000","last_active":"2021-10-08T19:24:51.536418+0000","last_peered":"2021-10-08T19:24:51.536418+0000","last_clean":"2021-10-08T19:24:51.536418+0000","last_became_active":"2021-10-08T19:24:25.096709+0000","last_became_peered":"2021-10-08T19:24:25.096709+0000","last_unstale":"2021-10-08T19:24:51.536418+0000","last_undegraded":"2021-10-08T19:24:51.536418+0000","last_fullsized":"2021-10-08T19:24:51.536418+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:40.563247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.563247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.024890005999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":80,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.540860+0000","last_change":"2021-10-08T19:23:22.620672+0000","last_active":"2021-10-08T19:24:51.540860+0000","last_peered":"2021-10-08T19:24:51.540860+0000","last_clean":"2021-10-08T19:24:51.540860+0000","last_became_active":"2021-10-08T19:21:23.599143+0000","last_became_peered":"2021-10-08T19:21:23.599143+0000","last_unstale":"2021-10-08T19:24:51.540860+0000","last_undegraded":"2021-10-08T19:24:51.540860+0000","last_fullsized":"2021-10-08T19:24:51.540860+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:22.620600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:22.620600+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003478133,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"90'130","reported_seq":384,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.535640+0000","last_change":"2021-10-08T19:24:28.151931+0000","last_active":"2021-10-08T19:24:51.535640+0000","last_peered":"2021-10-08T19:24:51.535640+0000","last_clean":"2021-10-08T19:24:51.535640+0000","last_became_active":"2021-10-08T19:24:28.151587+0000","last_became_peered":"2021-10-08T19:24:28.151587+0000","last_unstale":"2021-10-08T19:24:51.535640+0000","last_undegraded":"2021-10-08T19:24:51.535640+0000","last_fullsized":"2021-10-08T19:24:51.535640+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.284249+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0045617870000000003,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"69'14","reported_seq":40,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.536175+0000","last_change":"2021-10-08T19:24:25.119727+0000","last_active":"2021-10-08T19:24:51.536175+0000","last_peered":"2021-10-08T19:24:51.536175+0000","last_clean":"2021-10-08T19:24:51.536175+0000","last_became_active":"2021-10-08T19:24:25.100384+0000","last_became_peered":"2021-10-08T19:24:25.100384+0000","last_unstale":"2021-10-08T19:24:51.536175+0000","last_undegraded":"2021-10-08T19:24:51.536175+0000","last_fullsized":"2021-10-08T19:24:51.536175+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'14","last_scrub_stamp":"2021-10-08T19:22:54.379349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:54.379349+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":24,"num_read_kb":14,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":77,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.537023+0000","last_change":"2021-10-08T19:23:02.267580+0000","last_active":"2021-10-08T19:24:51.537023+0000","last_peered":"2021-10-08T19:24:51.537023+0000","last_clean":"2021-10-08T19:24:51.537023+0000","last_became_active":"2021-10-08T19:21:27.636086+0000","last_became_peered":"2021-10-08T19:21:27.636086+0000","last_unstale":"2021-10-08T19:24:51.537023+0000","last_undegraded":"2021-10-08T19:24:51.537023+0000","last_fullsized":"2021-10-08T19:24:51.537023+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:02.267508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:02.267508+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034499700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"127'4755","reported_seq":4796,"reported_epoch":127,"state":"active+clean","last_fresh":"2021-10-08T19:24:58.367844+0000","last_change":"2021-10-08T19:23:44.811375+0000","last_active":"2021-10-08T19:24:58.367844+0000","last_peered":"2021-10-08T19:24:58.367844+0000","last_clean":"2021-10-08T19:24:58.367844+0000","last_became_active":"2021-10-08T19:23:44.811097+0000","last_became_peered":"2021-10-08T19:23:44.811097+0000","last_unstale":"2021-10-08T19:24:58.367844+0000","last_undegraded":"2021-10-08T19:24:58.367844+0000","last_fullsized":"2021-10-08T19:24:58.367844+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":4755,"ondisk_log_size":4755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":311623680,"num_objects":4755,"num_object_clones":0,"num_object_copies":14265,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4755,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4755,"num_write_kb":304320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,0],"acting":[7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":75,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.565712+0000","last_change":"2021-10-08T19:22:55.234981+0000","last_active":"2021-10-08T19:24:51.565712+0000","last_peered":"2021-10-08T19:24:51.565712+0000","last_clean":"2021-10-08T19:24:51.565712+0000","last_became_active":"2021-10-08T19:21:29.648784+0000","last_became_peered":"2021-10-08T19:21:29.648784+0000","last_unstale":"2021-10-08T19:24:51.565712+0000","last_undegraded":"2021-10-08T19:24:51.565712+0000","last_fullsized":"2021-10-08T19:24:51.565712+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:55.234909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:55.234909+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0014461070000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":96,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.540394+0000","last_change":"2021-10-08T19:24:12.505667+0000","last_active":"2021-10-08T19:24:51.540394+0000","last_peered":"2021-10-08T19:24:51.540394+0000","last_clean":"2021-10-08T19:24:51.540394+0000","last_became_active":"2021-10-08T19:24:12.505366+0000","last_became_peered":"2021-10-08T19:24:12.505366+0000","last_unstale":"2021-10-08T19:24:51.540394+0000","last_undegraded":"2021-10-08T19:24:51.540394+0000","last_fullsized":"2021-10-08T19:24:51.540394+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:09.177525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:09.177525+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0090469920000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":48,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.534324+0000","last_change":"2021-10-08T19:24:04.888931+0000","last_active":"2021-10-08T19:24:51.534324+0000","last_peered":"2021-10-08T19:24:51.534324+0000","last_clean":"2021-10-08T19:24:51.534324+0000","last_became_active":"2021-10-08T19:23:44.813130+0000","last_became_peered":"2021-10-08T19:23:44.813130+0000","last_unstale":"2021-10-08T19:24:51.534324+0000","last_undegraded":"2021-10-08T19:24:51.534324+0000","last_fullsized":"2021-10-08T19:24:51.534324+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:04.888825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:32.922694+0000","last_clean_scrub_stamp":"2021-10-08T19:24:04.888825+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0052928530000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"69'12","reported_seq":97,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.541488+0000","last_change":"2021-10-08T19:22:55.639993+0000","last_active":"2021-10-08T19:24:51.541488+0000","last_peered":"2021-10-08T19:24:51.541488+0000","last_clean":"2021-10-08T19:24:51.541488+0000","last_became_active":"2021-10-08T19:21:25.610233+0000","last_became_peered":"2021-10-08T19:21:25.610233+0000","last_unstale":"2021-10-08T19:24:51.541488+0000","last_undegraded":"2021-10-08T19:24:51.541488+0000","last_fullsized":"2021-10-08T19:24:51.541488+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'12","last_scrub_stamp":"2021-10-08T19:22:55.639881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:55.639881+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0032422169999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":82,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.541604+0000","last_change":"2021-10-08T19:23:41.487724+0000","last_active":"2021-10-08T19:24:51.541604+0000","last_peered":"2021-10-08T19:24:51.541604+0000","last_clean":"2021-10-08T19:24:51.541604+0000","last_became_active":"2021-10-08T19:21:27.635800+0000","last_became_peered":"2021-10-08T19:21:27.635800+0000","last_unstale":"2021-10-08T19:24:51.541604+0000","last_undegraded":"2021-10-08T19:24:51.541604+0000","last_fullsized":"2021-10-08T19:24:51.541604+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:41.487627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:41.487627+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003650445,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.4","version":"70'5","reported_seq":266,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.565293+0000","last_change":"2021-10-08T19:24:13.518097+0000","last_active":"2021-10-08T19:24:51.565293+0000","last_peered":"2021-10-08T19:24:51.565293+0000","last_clean":"2021-10-08T19:24:51.565293+0000","last_became_active":"2021-10-08T19:24:13.517653+0000","last_became_peered":"2021-10-08T19:24:13.517653+0000","last_unstale":"2021-10-08T19:24:51.565293+0000","last_undegraded":"2021-10-08T19:24:51.565293+0000","last_fullsized":"2021-10-08T19:24:51.565293+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:22:48.239721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:48.239721+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001618092,"stat_sum":{"num_bytes":98,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":40,"num_read_kb":38,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":98,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"127'4576","reported_seq":4616,"reported_epoch":127,"state":"active+clean","last_fresh":"2021-10-08T19:24:58.362011+0000","last_change":"2021-10-08T19:23:44.808792+0000","last_active":"2021-10-08T19:24:58.362011+0000","last_peered":"2021-10-08T19:24:58.362011+0000","last_clean":"2021-10-08T19:24:58.362011+0000","last_became_active":"2021-10-08T19:23:44.808533+0000","last_became_peered":"2021-10-08T19:23:44.808533+0000","last_unstale":"2021-10-08T19:24:58.362011+0000","last_undegraded":"2021-10-08T19:24:58.362011+0000","last_fullsized":"2021-10-08T19:24:58.362011+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":4576,"ondisk_log_size":4576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":299892736,"num_objects":4576,"num_object_clones":0,"num_object_copies":13728,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4576,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4576,"num_write_kb":292864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":93,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.564404+0000","last_change":"2021-10-08T19:24:25.094704+0000","last_active":"2021-10-08T19:24:51.564404+0000","last_peered":"2021-10-08T19:24:51.564404+0000","last_clean":"2021-10-08T19:24:51.564404+0000","last_became_active":"2021-10-08T19:24:25.092510+0000","last_became_peered":"2021-10-08T19:24:25.092510+0000","last_unstale":"2021-10-08T19:24:51.564404+0000","last_undegraded":"2021-10-08T19:24:51.564404+0000","last_fullsized":"2021-10-08T19:24:51.564404+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:06.155068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:06.155068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001436805,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"61'1","reported_seq":94,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.537394+0000","last_change":"2021-10-08T19:24:17.582143+0000","last_active":"2021-10-08T19:24:51.537394+0000","last_peered":"2021-10-08T19:24:51.537394+0000","last_clean":"2021-10-08T19:24:51.537394+0000","last_became_active":"2021-10-08T19:21:23.604258+0000","last_became_peered":"2021-10-08T19:21:23.604258+0000","last_unstale":"2021-10-08T19:24:51.537394+0000","last_undegraded":"2021-10-08T19:24:51.537394+0000","last_fullsized":"2021-10-08T19:24:51.537394+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'1","last_scrub_stamp":"2021-10-08T19:24:17.582063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:17.582063+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0043026640000000003,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"69'19","reported_seq":121,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.539951+0000","last_change":"2021-10-08T19:24:08.149331+0000","last_active":"2021-10-08T19:24:51.539951+0000","last_peered":"2021-10-08T19:24:51.539951+0000","last_clean":"2021-10-08T19:24:51.539951+0000","last_became_active":"2021-10-08T19:21:25.741812+0000","last_became_peered":"2021-10-08T19:21:25.741812+0000","last_unstale":"2021-10-08T19:24:51.539951+0000","last_undegraded":"2021-10-08T19:24:51.539951+0000","last_fullsized":"2021-10-08T19:24:51.539951+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'19","last_scrub_stamp":"2021-10-08T19:24:08.149225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:24:08.149225+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0082661220000000007,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":24,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.536301+0000","last_change":"2021-10-08T19:24:25.095749+0000","last_active":"2021-10-08T19:24:51.536301+0000","last_peered":"2021-10-08T19:24:51.536301+0000","last_clean":"2021-10-08T19:24:51.536301+0000","last_became_active":"2021-10-08T19:24:25.095389+0000","last_became_peered":"2021-10-08T19:24:25.095389+0000","last_unstale":"2021-10-08T19:24:51.536301+0000","last_undegraded":"2021-10-08T19:24:51.536301+0000","last_fullsized":"2021-10-08T19:24:51.536301+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:42.399412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:42.399412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":31,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.538032+0000","last_change":"2021-10-08T19:24:13.518823+0000","last_active":"2021-10-08T19:24:51.538032+0000","last_peered":"2021-10-08T19:24:51.538032+0000","last_clean":"2021-10-08T19:24:51.538032+0000","last_became_active":"2021-10-08T19:24:13.518531+0000","last_became_peered":"2021-10-08T19:24:13.518531+0000","last_unstale":"2021-10-08T19:24:51.538032+0000","last_undegraded":"2021-10-08T19:24:51.538032+0000","last_fullsized":"2021-10-08T19:24:51.538032+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:09.177525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:09.177525+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"127'4480","reported_seq":4520,"reported_epoch":127,"state":"active+clean","last_fresh":"2021-10-08T19:24:53.427602+0000","last_change":"2021-10-08T19:23:44.799701+0000","last_active":"2021-10-08T19:24:53.427602+0000","last_peered":"2021-10-08T19:24:53.427602+0000","last_clean":"2021-10-08T19:24:53.427602+0000","last_became_active":"2021-10-08T19:23:44.799526+0000","last_became_peered":"2021-10-08T19:23:44.799526+0000","last_unstale":"2021-10-08T19:24:53.427602+0000","last_undegraded":"2021-10-08T19:24:53.427602+0000","last_fullsized":"2021-10-08T19:24:53.427602+0000","mapping_epoch":94,"log_start":"99'100","ondisk_log_start":"99'100","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":4380,"ondisk_log_size":4380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":293601280,"num_objects":4480,"num_object_clones":0,"num_object_copies":13440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4480,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4480,"num_write_kb":286720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4],"acting":[3,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":74,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.529840+0000","last_change":"2021-10-08T19:22:40.264230+0000","last_active":"2021-10-08T19:24:51.529840+0000","last_peered":"2021-10-08T19:24:51.529840+0000","last_clean":"2021-10-08T19:24:51.529840+0000","last_became_active":"2021-10-08T19:21:29.646491+0000","last_became_peered":"2021-10-08T19:21:29.646491+0000","last_unstale":"2021-10-08T19:24:51.529840+0000","last_undegraded":"2021-10-08T19:24:51.529840+0000","last_fullsized":"2021-10-08T19:24:51.529840+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:40.264110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.264110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003475845,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":99,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.565993+0000","last_change":"2021-10-08T19:24:25.099209+0000","last_active":"2021-10-08T19:24:51.565993+0000","last_peered":"2021-10-08T19:24:51.565993+0000","last_clean":"2021-10-08T19:24:51.565993+0000","last_became_active":"2021-10-08T19:24:25.098790+0000","last_became_peered":"2021-10-08T19:24:25.098790+0000","last_unstale":"2021-10-08T19:24:51.565993+0000","last_undegraded":"2021-10-08T19:24:51.565993+0000","last_fullsized":"2021-10-08T19:24:51.565993+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:41.186945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:41.186945+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0037557269999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"69'18","reported_seq":110,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.535820+0000","last_change":"2021-10-08T19:23:20.405609+0000","last_active":"2021-10-08T19:24:51.535820+0000","last_peered":"2021-10-08T19:24:51.535820+0000","last_clean":"2021-10-08T19:24:51.535820+0000","last_became_active":"2021-10-08T19:21:25.742909+0000","last_became_peered":"2021-10-08T19:21:25.742909+0000","last_unstale":"2021-10-08T19:24:51.535820+0000","last_undegraded":"2021-10-08T19:24:51.535820+0000","last_fullsized":"2021-10-08T19:24:51.535820+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'18","last_scrub_stamp":"2021-10-08T19:23:20.405525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:20.405525+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039753820000000004,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":82,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.531333+0000","last_change":"2021-10-08T19:24:15.302574+0000","last_active":"2021-10-08T19:24:51.531333+0000","last_peered":"2021-10-08T19:24:51.531333+0000","last_clean":"2021-10-08T19:24:51.531333+0000","last_became_active":"2021-10-08T19:21:27.637547+0000","last_became_peered":"2021-10-08T19:21:27.637547+0000","last_unstale":"2021-10-08T19:24:51.531333+0000","last_undegraded":"2021-10-08T19:24:51.531333+0000","last_fullsized":"2021-10-08T19:24:51.531333+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:15.302475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:15.302475+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0050588849999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":29,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.541317+0000","last_change":"2021-10-08T19:24:13.516811+0000","last_active":"2021-10-08T19:24:51.541317+0000","last_peered":"2021-10-08T19:24:51.541317+0000","last_clean":"2021-10-08T19:24:51.541317+0000","last_became_active":"2021-10-08T19:24:13.516510+0000","last_became_peered":"2021-10-08T19:24:13.516510+0000","last_unstale":"2021-10-08T19:24:51.541317+0000","last_undegraded":"2021-10-08T19:24:51.541317+0000","last_fullsized":"2021-10-08T19:24:51.541317+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:40.563247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.563247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.024890005999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"127'4441","reported_seq":4480,"reported_epoch":127,"state":"active+clean","last_fresh":"2021-10-08T19:24:53.447864+0000","last_change":"2021-10-08T19:23:44.807321+0000","last_active":"2021-10-08T19:24:53.447864+0000","last_peered":"2021-10-08T19:24:53.447864+0000","last_clean":"2021-10-08T19:24:53.447864+0000","last_became_active":"2021-10-08T19:23:44.807072+0000","last_became_peered":"2021-10-08T19:23:44.807072+0000","last_unstale":"2021-10-08T19:24:53.447864+0000","last_undegraded":"2021-10-08T19:24:53.447864+0000","last_fullsized":"2021-10-08T19:24:53.447864+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":4441,"ondisk_log_size":4441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":291045376,"num_objects":4441,"num_object_clones":0,"num_object_copies":13323,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4441,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4441,"num_write_kb":284224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":95,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.536526+0000","last_change":"2021-10-08T19:24:25.095155+0000","last_active":"2021-10-08T19:24:51.536526+0000","last_peered":"2021-10-08T19:24:51.536526+0000","last_clean":"2021-10-08T19:24:51.536526+0000","last_became_active":"2021-10-08T19:24:25.094848+0000","last_became_peered":"2021-10-08T19:24:25.094848+0000","last_unstale":"2021-10-08T19:24:51.536526+0000","last_undegraded":"2021-10-08T19:24:51.536526+0000","last_fullsized":"2021-10-08T19:24:51.536526+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:05.263508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:05.263508+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034369000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":24,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.537538+0000","last_change":"2021-10-08T19:24:25.094838+0000","last_active":"2021-10-08T19:24:51.537538+0000","last_peered":"2021-10-08T19:24:51.537538+0000","last_clean":"2021-10-08T19:24:51.537538+0000","last_became_active":"2021-10-08T19:24:25.094364+0000","last_became_peered":"2021-10-08T19:24:25.094364+0000","last_unstale":"2021-10-08T19:24:51.537538+0000","last_undegraded":"2021-10-08T19:24:51.537538+0000","last_fullsized":"2021-10-08T19:24:51.537538+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:23.529696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:23.529696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"69'14","reported_seq":155,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.531053+0000","last_change":"2021-10-08T19:24:26.225004+0000","last_active":"2021-10-08T19:24:51.531053+0000","last_peered":"2021-10-08T19:24:51.531053+0000","last_clean":"2021-10-08T19:24:51.531053+0000","last_became_active":"2021-10-08T19:24:25.098743+0000","last_became_peered":"2021-10-08T19:24:25.098743+0000","last_unstale":"2021-10-08T19:24:51.531053+0000","last_undegraded":"2021-10-08T19:24:51.531053+0000","last_fullsized":"2021-10-08T19:24:51.531053+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'14","last_scrub_stamp":"2021-10-08T19:24:10.235796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:24:10.235796+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0042036319999999997,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"91'9","reported_seq":127,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.746579+0000","last_change":"2021-10-08T19:23:32.329551+0000","last_active":"2021-10-08T19:24:51.746579+0000","last_peered":"2021-10-08T19:24:51.746579+0000","last_clean":"2021-10-08T19:24:51.746579+0000","last_became_active":"2021-10-08T19:21:27.640694+0000","last_became_peered":"2021-10-08T19:21:27.640694+0000","last_unstale":"2021-10-08T19:24:51.746579+0000","last_undegraded":"2021-10-08T19:24:51.746579+0000","last_fullsized":"2021-10-08T19:24:51.746579+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'9","last_scrub_stamp":"2021-10-08T19:23:32.329475+0000","last_deep_scrub":"91'9","last_deep_scrub_stamp":"2021-10-08T19:23:32.329475+0000","last_clean_scrub_stamp":"2021-10-08T19:23:32.329475+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0045727859999999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":31,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.529457+0000","last_change":"2021-10-08T19:24:13.506996+0000","last_active":"2021-10-08T19:24:51.529457+0000","last_peered":"2021-10-08T19:24:51.529457+0000","last_clean":"2021-10-08T19:24:51.529457+0000","last_became_active":"2021-10-08T19:24:13.506602+0000","last_became_peered":"2021-10-08T19:24:13.506602+0000","last_unstale":"2021-10-08T19:24:51.529457+0000","last_undegraded":"2021-10-08T19:24:51.529457+0000","last_fullsized":"2021-10-08T19:24:51.529457+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:09.177525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:09.177525+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"127'4462","reported_seq":5133,"reported_epoch":127,"state":"active+recovering+undersized+remapped","last_fresh":"2021-10-08T19:24:53.456306+0000","last_change":"2021-10-08T19:24:26.902103+0000","last_active":"2021-10-08T19:24:53.456306+0000","last_peered":"2021-10-08T19:24:53.456306+0000","last_clean":"2021-10-08T19:24:24.154821+0000","last_became_active":"2021-10-08T19:24:26.860648+0000","last_became_peered":"2021-10-08T19:24:26.860648+0000","last_unstale":"2021-10-08T19:24:53.456306+0000","last_undegraded":"2021-10-08T19:24:53.456306+0000","last_fullsized":"2021-10-08T19:24:26.085882+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":4462,"ondisk_log_size":4462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":292421632,"num_objects":4462,"num_object_clones":0,"num_object_copies":13386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2763,"num_objects_unfound":0,"num_objects_dirty":4462,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4462,"num_write_kb":285568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":311,"num_bytes_recovered":20381696,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0],"acting":[1,0],"avail_no_missing":["1","0","3"],"object_location_counts":[{"shards":"0,1","objects":1699},{"shards":"0,1,3","objects":2763}],"blocked_by":[],"up_primary":6,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":92,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.537267+0000","last_change":"2021-10-08T19:24:25.096748+0000","last_active":"2021-10-08T19:24:51.537267+0000","last_peered":"2021-10-08T19:24:51.537267+0000","last_clean":"2021-10-08T19:24:51.537267+0000","last_became_active":"2021-10-08T19:24:25.096415+0000","last_became_peered":"2021-10-08T19:24:25.096415+0000","last_unstale":"2021-10-08T19:24:51.537267+0000","last_undegraded":"2021-10-08T19:24:51.537267+0000","last_fullsized":"2021-10-08T19:24:51.537267+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:17.422176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:17.422176+0000","last_clean_scrub_stamp":"2021-10-08T19:23:17.422176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0036221249999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":94,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.541531+0000","last_change":"2021-10-08T19:24:25.105582+0000","last_active":"2021-10-08T19:24:51.541531+0000","last_peered":"2021-10-08T19:24:51.541531+0000","last_clean":"2021-10-08T19:24:51.541531+0000","last_became_active":"2021-10-08T19:24:25.105244+0000","last_became_peered":"2021-10-08T19:24:25.105244+0000","last_unstale":"2021-10-08T19:24:51.541531+0000","last_undegraded":"2021-10-08T19:24:51.541531+0000","last_fullsized":"2021-10-08T19:24:51.541531+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:17.689312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:17.689312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0033939769999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":87,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.535687+0000","last_change":"2021-10-08T19:24:14.537933+0000","last_active":"2021-10-08T19:24:51.535687+0000","last_peered":"2021-10-08T19:24:51.535687+0000","last_clean":"2021-10-08T19:24:51.535687+0000","last_became_active":"2021-10-08T19:21:23.606597+0000","last_became_peered":"2021-10-08T19:21:23.606597+0000","last_unstale":"2021-10-08T19:24:51.535687+0000","last_undegraded":"2021-10-08T19:24:51.535687+0000","last_fullsized":"2021-10-08T19:24:51.535687+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:14.537859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:14.537859+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.00235264,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"69'11","reported_seq":139,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.530731+0000","last_change":"2021-10-08T19:24:25.123530+0000","last_active":"2021-10-08T19:24:51.530731+0000","last_peered":"2021-10-08T19:24:51.530731+0000","last_clean":"2021-10-08T19:24:51.530731+0000","last_became_active":"2021-10-08T19:24:25.097983+0000","last_became_peered":"2021-10-08T19:24:25.097983+0000","last_unstale":"2021-10-08T19:24:51.530731+0000","last_undegraded":"2021-10-08T19:24:51.530731+0000","last_fullsized":"2021-10-08T19:24:51.530731+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'11","last_scrub_stamp":"2021-10-08T19:23:01.988336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:01.988336+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0026768489999999998,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"70'5","reported_seq":30,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.536025+0000","last_change":"2021-10-08T19:24:13.513690+0000","last_active":"2021-10-08T19:24:51.536025+0000","last_peered":"2021-10-08T19:24:51.536025+0000","last_clean":"2021-10-08T19:24:51.536025+0000","last_became_active":"2021-10-08T19:24:13.513289+0000","last_became_peered":"2021-10-08T19:24:13.513289+0000","last_unstale":"2021-10-08T19:24:51.536025+0000","last_undegraded":"2021-10-08T19:24:51.536025+0000","last_fullsized":"2021-10-08T19:24:51.536025+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:22:48.239721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:48.239721+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001618092,"stat_sum":{"num_bytes":97,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":31,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.c","version":"127'4365","reported_seq":5031,"reported_epoch":127,"state":"active+recovering+remapped","last_fresh":"2021-10-08T19:24:53.449261+0000","last_change":"2021-10-08T19:24:26.855973+0000","last_active":"2021-10-08T19:24:53.449261+0000","last_peered":"2021-10-08T19:24:53.449261+0000","last_clean":"2021-10-08T19:24:24.005251+0000","last_became_active":"2021-10-08T19:24:26.848578+0000","last_became_peered":"2021-10-08T19:24:26.848578+0000","last_unstale":"2021-10-08T19:24:53.449261+0000","last_undegraded":"2021-10-08T19:24:53.449261+0000","last_fullsized":"2021-10-08T19:24:53.449261+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":4365,"ondisk_log_size":4365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":286064640,"num_objects":4365,"num_object_clones":0,"num_object_copies":13095,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2736,"num_objects_unfound":0,"num_objects_dirty":4365,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4365,"num_write_kb":279360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":310,"num_bytes_recovered":20316160,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[2,3,7],"avail_no_missing":["2","3","7"],"object_location_counts":[{"shards":"2,3,7","objects":1629}],"blocked_by":[],"up_primary":6,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":80,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.541227+0000","last_change":"2021-10-08T19:24:11.330063+0000","last_active":"2021-10-08T19:24:51.541227+0000","last_peered":"2021-10-08T19:24:51.541227+0000","last_clean":"2021-10-08T19:24:51.541227+0000","last_became_active":"2021-10-08T19:21:29.639358+0000","last_became_peered":"2021-10-08T19:21:29.639358+0000","last_unstale":"2021-10-08T19:24:51.541227+0000","last_undegraded":"2021-10-08T19:24:51.541227+0000","last_fullsized":"2021-10-08T19:24:51.541227+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:11.329954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:24:11.329954+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.01088446,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"88'9","reported_seq":131,"reported_epoch":127,"state":"active+clean","last_fresh":"2021-10-08T19:24:52.568781+0000","last_change":"2021-10-08T19:23:00.048324+0000","last_active":"2021-10-08T19:24:52.568781+0000","last_peered":"2021-10-08T19:24:52.568781+0000","last_clean":"2021-10-08T19:24:52.568781+0000","last_became_active":"2021-10-08T19:21:27.636432+0000","last_became_peered":"2021-10-08T19:21:27.636432+0000","last_unstale":"2021-10-08T19:24:52.568781+0000","last_undegraded":"2021-10-08T19:24:52.568781+0000","last_fullsized":"2021-10-08T19:24:52.568781+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'9","last_scrub_stamp":"2021-10-08T19:23:00.048245+0000","last_deep_scrub":"88'9","last_deep_scrub_stamp":"2021-10-08T19:23:00.048245+0000","last_clean_scrub_stamp":"2021-10-08T19:23:00.048245+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0031661179999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":87,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.564234+0000","last_change":"2021-10-08T19:24:07.213134+0000","last_active":"2021-10-08T19:24:51.564234+0000","last_peered":"2021-10-08T19:24:51.564234+0000","last_clean":"2021-10-08T19:24:51.564234+0000","last_became_active":"2021-10-08T19:21:23.603264+0000","last_became_peered":"2021-10-08T19:21:23.603264+0000","last_unstale":"2021-10-08T19:24:51.564234+0000","last_undegraded":"2021-10-08T19:24:51.564234+0000","last_fullsized":"2021-10-08T19:24:51.564234+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:07.213008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:07.213008+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0079250429999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"69'15","reported_seq":104,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.566347+0000","last_change":"2021-10-08T19:22:56.213566+0000","last_active":"2021-10-08T19:24:51.566347+0000","last_peered":"2021-10-08T19:24:51.566347+0000","last_clean":"2021-10-08T19:24:51.566347+0000","last_became_active":"2021-10-08T19:21:25.617776+0000","last_became_peered":"2021-10-08T19:21:25.617776+0000","last_unstale":"2021-10-08T19:24:51.566347+0000","last_undegraded":"2021-10-08T19:24:51.566347+0000","last_fullsized":"2021-10-08T19:24:51.566347+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'15","last_scrub_stamp":"2021-10-08T19:22:56.213493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:56.213493+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039771219999999996,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":31,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.536593+0000","last_change":"2021-10-08T19:24:13.518853+0000","last_active":"2021-10-08T19:24:51.536593+0000","last_peered":"2021-10-08T19:24:51.536593+0000","last_clean":"2021-10-08T19:24:51.536593+0000","last_became_active":"2021-10-08T19:24:13.518601+0000","last_became_peered":"2021-10-08T19:24:13.518601+0000","last_unstale":"2021-10-08T19:24:51.536593+0000","last_undegraded":"2021-10-08T19:24:51.536593+0000","last_fullsized":"2021-10-08T19:24:51.536593+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:09.177525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:09.177525+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"127'4381","reported_seq":4422,"reported_epoch":127,"state":"active+clean","last_fresh":"2021-10-08T19:24:53.544528+0000","last_change":"2021-10-08T19:23:44.812210+0000","last_active":"2021-10-08T19:24:53.544528+0000","last_peered":"2021-10-08T19:24:53.544528+0000","last_clean":"2021-10-08T19:24:53.544528+0000","last_became_active":"2021-10-08T19:23:44.810340+0000","last_became_peered":"2021-10-08T19:23:44.810340+0000","last_unstale":"2021-10-08T19:24:53.544528+0000","last_undegraded":"2021-10-08T19:24:53.544528+0000","last_fullsized":"2021-10-08T19:24:53.544528+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":4381,"ondisk_log_size":4381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":287113216,"num_objects":4381,"num_object_clones":0,"num_object_copies":13143,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4381,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4381,"num_write_kb":280384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":80,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.531030+0000","last_change":"2021-10-08T19:24:19.303768+0000","last_active":"2021-10-08T19:24:51.531030+0000","last_peered":"2021-10-08T19:24:51.531030+0000","last_clean":"2021-10-08T19:24:51.531030+0000","last_became_active":"2021-10-08T19:21:29.640249+0000","last_became_peered":"2021-10-08T19:21:29.640249+0000","last_unstale":"2021-10-08T19:24:51.531030+0000","last_undegraded":"2021-10-08T19:24:51.531030+0000","last_fullsized":"2021-10-08T19:24:51.531030+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:19.303695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:24:19.303695+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0069500159999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"69'8","reported_seq":133,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.746628+0000","last_change":"2021-10-08T19:24:09.793029+0000","last_active":"2021-10-08T19:24:51.746628+0000","last_peered":"2021-10-08T19:24:51.746628+0000","last_clean":"2021-10-08T19:24:51.746628+0000","last_became_active":"2021-10-08T19:21:27.637930+0000","last_became_peered":"2021-10-08T19:21:27.637930+0000","last_unstale":"2021-10-08T19:24:51.746628+0000","last_undegraded":"2021-10-08T19:24:51.746628+0000","last_fullsized":"2021-10-08T19:24:51.746628+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'8","last_scrub_stamp":"2021-10-08T19:24:09.792928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:09.792928+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0052042049999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":87,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.565479+0000","last_change":"2021-10-08T19:24:15.233590+0000","last_active":"2021-10-08T19:24:51.565479+0000","last_peered":"2021-10-08T19:24:51.565479+0000","last_clean":"2021-10-08T19:24:51.565479+0000","last_became_active":"2021-10-08T19:21:23.603207+0000","last_became_peered":"2021-10-08T19:21:23.603207+0000","last_unstale":"2021-10-08T19:24:51.565479+0000","last_undegraded":"2021-10-08T19:24:51.565479+0000","last_fullsized":"2021-10-08T19:24:51.565479+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:15.233394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:15.233394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0046454499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"69'10","reported_seq":135,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.529884+0000","last_change":"2021-10-08T19:24:25.983761+0000","last_active":"2021-10-08T19:24:51.529884+0000","last_peered":"2021-10-08T19:24:51.529884+0000","last_clean":"2021-10-08T19:24:51.529884+0000","last_became_active":"2021-10-08T19:24:25.098048+0000","last_became_peered":"2021-10-08T19:24:25.098048+0000","last_unstale":"2021-10-08T19:24:51.529884+0000","last_undegraded":"2021-10-08T19:24:51.529884+0000","last_fullsized":"2021-10-08T19:24:51.529884+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'10","last_scrub_stamp":"2021-10-08T19:22:35.356292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:35.356292+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040689319999999999,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.536454+0000","last_change":"2021-10-08T19:24:25.106422+0000","last_active":"2021-10-08T19:24:51.536454+0000","last_peered":"2021-10-08T19:24:51.536454+0000","last_clean":"2021-10-08T19:24:51.536454+0000","last_became_active":"2021-10-08T19:24:25.105702+0000","last_became_peered":"2021-10-08T19:24:25.105702+0000","last_unstale":"2021-10-08T19:24:51.536454+0000","last_undegraded":"2021-10-08T19:24:51.536454+0000","last_fullsized":"2021-10-08T19:24:51.536454+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:40.563247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.563247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.024890005999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.e","version":"127'4538","reported_seq":4577,"reported_epoch":127,"state":"active+clean","last_fresh":"2021-10-08T19:24:53.468726+0000","last_change":"2021-10-08T19:23:44.811875+0000","last_active":"2021-10-08T19:24:53.468726+0000","last_peered":"2021-10-08T19:24:53.468726+0000","last_clean":"2021-10-08T19:24:53.468726+0000","last_became_active":"2021-10-08T19:23:44.810666+0000","last_became_peered":"2021-10-08T19:23:44.810666+0000","last_unstale":"2021-10-08T19:24:53.468726+0000","last_undegraded":"2021-10-08T19:24:53.468726+0000","last_fullsized":"2021-10-08T19:24:53.468726+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":297402368,"num_objects":4538,"num_object_clones":0,"num_object_copies":13614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4538,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4538,"num_write_kb":290432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":75,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.533523+0000","last_change":"2021-10-08T19:23:10.377105+0000","last_active":"2021-10-08T19:24:51.533523+0000","last_peered":"2021-10-08T19:24:51.533523+0000","last_clean":"2021-10-08T19:24:51.533523+0000","last_became_active":"2021-10-08T19:21:29.646455+0000","last_became_peered":"2021-10-08T19:21:29.646455+0000","last_unstale":"2021-10-08T19:24:51.533523+0000","last_undegraded":"2021-10-08T19:24:51.533523+0000","last_fullsized":"2021-10-08T19:24:51.533523+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:10.377024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:10.377024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0035706969999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":83,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.565633+0000","last_change":"2021-10-08T19:23:36.055728+0000","last_active":"2021-10-08T19:24:51.565633+0000","last_peered":"2021-10-08T19:24:51.565633+0000","last_clean":"2021-10-08T19:24:51.565633+0000","last_became_active":"2021-10-08T19:21:27.636429+0000","last_became_peered":"2021-10-08T19:21:27.636429+0000","last_unstale":"2021-10-08T19:24:51.565633+0000","last_undegraded":"2021-10-08T19:24:51.565633+0000","last_fullsized":"2021-10-08T19:24:51.565633+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:36.055616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:36.055616+0000","last_clean_scrub_stamp":"2021-10-08T19:23:36.055616+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0022840669999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"61'1","reported_seq":89,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.536308+0000","last_change":"2021-10-08T19:22:55.080106+0000","last_active":"2021-10-08T19:24:51.536308+0000","last_peered":"2021-10-08T19:24:51.536308+0000","last_clean":"2021-10-08T19:24:51.536308+0000","last_became_active":"2021-10-08T19:21:23.607064+0000","last_became_peered":"2021-10-08T19:21:23.607064+0000","last_unstale":"2021-10-08T19:24:51.536308+0000","last_undegraded":"2021-10-08T19:24:51.536308+0000","last_fullsized":"2021-10-08T19:24:51.536308+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'1","last_scrub_stamp":"2021-10-08T19:22:55.080028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:55.080028+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040037620000000001,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"69'17","reported_seq":106,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.530649+0000","last_change":"2021-10-08T19:22:47.109498+0000","last_active":"2021-10-08T19:24:51.530649+0000","last_peered":"2021-10-08T19:24:51.530649+0000","last_clean":"2021-10-08T19:24:51.530649+0000","last_became_active":"2021-10-08T19:21:25.609086+0000","last_became_peered":"2021-10-08T19:21:25.609086+0000","last_unstale":"2021-10-08T19:24:51.530649+0000","last_undegraded":"2021-10-08T19:24:51.530649+0000","last_fullsized":"2021-10-08T19:24:51.530649+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'17","last_scrub_stamp":"2021-10-08T19:22:47.109407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:47.109407+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0025026100000000002,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"127'4469","reported_seq":4510,"reported_epoch":127,"state":"active+clean","last_fresh":"2021-10-08T19:24:53.560434+0000","last_change":"2021-10-08T19:23:44.815633+0000","last_active":"2021-10-08T19:24:53.560434+0000","last_peered":"2021-10-08T19:24:53.560434+0000","last_clean":"2021-10-08T19:24:53.560434+0000","last_became_active":"2021-10-08T19:23:44.815346+0000","last_became_peered":"2021-10-08T19:23:44.815346+0000","last_unstale":"2021-10-08T19:24:53.560434+0000","last_undegraded":"2021-10-08T19:24:53.560434+0000","last_fullsized":"2021-10-08T19:24:53.560434+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":4469,"ondisk_log_size":4469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":292880384,"num_objects":4469,"num_object_clones":0,"num_object_copies":13407,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4469,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4469,"num_write_kb":286016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":75,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.535609+0000","last_change":"2021-10-08T19:23:03.272654+0000","last_active":"2021-10-08T19:24:51.535609+0000","last_peered":"2021-10-08T19:24:51.535609+0000","last_clean":"2021-10-08T19:24:51.535609+0000","last_became_active":"2021-10-08T19:21:29.648922+0000","last_became_peered":"2021-10-08T19:21:29.648922+0000","last_unstale":"2021-10-08T19:24:51.535609+0000","last_undegraded":"2021-10-08T19:24:51.535609+0000","last_fullsized":"2021-10-08T19:24:51.535609+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:03.272581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:03.272581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001525874,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":77,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.533786+0000","last_change":"2021-10-08T19:23:09.419579+0000","last_active":"2021-10-08T19:24:51.533786+0000","last_peered":"2021-10-08T19:24:51.533786+0000","last_clean":"2021-10-08T19:24:51.533786+0000","last_became_active":"2021-10-08T19:21:27.638583+0000","last_became_peered":"2021-10-08T19:21:27.638583+0000","last_unstale":"2021-10-08T19:24:51.533786+0000","last_undegraded":"2021-10-08T19:24:51.533786+0000","last_fullsized":"2021-10-08T19:24:51.533786+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:09.419493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:09.419493+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003406498,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":81,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.537625+0000","last_change":"2021-10-08T19:22:57.380012+0000","last_active":"2021-10-08T19:24:51.537625+0000","last_peered":"2021-10-08T19:24:51.537625+0000","last_clean":"2021-10-08T19:24:51.537625+0000","last_became_active":"2021-10-08T19:21:23.595919+0000","last_became_peered":"2021-10-08T19:21:23.595919+0000","last_unstale":"2021-10-08T19:24:51.537625+0000","last_undegraded":"2021-10-08T19:24:51.537625+0000","last_fullsized":"2021-10-08T19:24:51.537625+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:57.379935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:57.379935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034209349999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"69'19","reported_seq":44,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.536224+0000","last_change":"2021-10-08T19:24:25.121334+0000","last_active":"2021-10-08T19:24:51.536224+0000","last_peered":"2021-10-08T19:24:51.536224+0000","last_clean":"2021-10-08T19:24:51.536224+0000","last_became_active":"2021-10-08T19:24:25.094547+0000","last_became_peered":"2021-10-08T19:24:25.094547+0000","last_unstale":"2021-10-08T19:24:51.536224+0000","last_undegraded":"2021-10-08T19:24:51.536224+0000","last_fullsized":"2021-10-08T19:24:51.536224+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'19","last_scrub_stamp":"2021-10-08T19:22:39.356508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:39.356508+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":31,"num_read_kb":20,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"70'5","reported_seq":99,"reported_epoch":127,"state":"active+clean","last_fresh":"2021-10-08T19:24:57.143748+0000","last_change":"2021-10-08T19:24:25.638250+0000","last_active":"2021-10-08T19:24:57.143748+0000","last_peered":"2021-10-08T19:24:57.143748+0000","last_clean":"2021-10-08T19:24:57.143748+0000","last_became_active":"2021-10-08T19:24:25.103095+0000","last_became_peered":"2021-10-08T19:24:25.103095+0000","last_unstale":"2021-10-08T19:24:57.143748+0000","last_undegraded":"2021-10-08T19:24:57.143748+0000","last_fullsized":"2021-10-08T19:24:57.143748+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:24:16.396790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:16.396790+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0078447029999999997,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":389,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"127'4370","reported_seq":4411,"reported_epoch":127,"state":"active+clean","last_fresh":"2021-10-08T19:24:53.461481+0000","last_change":"2021-10-08T19:23:44.804233+0000","last_active":"2021-10-08T19:24:53.461481+0000","last_peered":"2021-10-08T19:24:53.461481+0000","last_clean":"2021-10-08T19:24:53.461481+0000","last_became_active":"2021-10-08T19:23:44.803928+0000","last_became_peered":"2021-10-08T19:23:44.803928+0000","last_unstale":"2021-10-08T19:24:53.461481+0000","last_undegraded":"2021-10-08T19:24:53.461481+0000","last_fullsized":"2021-10-08T19:24:53.461481+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":4370,"ondisk_log_size":4370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":286392320,"num_objects":4370,"num_object_clones":0,"num_object_copies":13110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4370,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4370,"num_write_kb":279680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4],"acting":[2,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":75,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.540656+0000","last_change":"2021-10-08T19:22:57.644734+0000","last_active":"2021-10-08T19:24:51.540656+0000","last_peered":"2021-10-08T19:24:51.540656+0000","last_clean":"2021-10-08T19:24:51.540656+0000","last_became_active":"2021-10-08T19:21:29.643022+0000","last_became_peered":"2021-10-08T19:21:29.643022+0000","last_unstale":"2021-10-08T19:24:51.540656+0000","last_undegraded":"2021-10-08T19:24:51.540656+0000","last_fullsized":"2021-10-08T19:24:51.540656+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:57.644627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:57.644627+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002174952,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":77,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.533024+0000","last_change":"2021-10-08T19:22:42.359224+0000","last_active":"2021-10-08T19:24:51.533024+0000","last_peered":"2021-10-08T19:24:51.533024+0000","last_clean":"2021-10-08T19:24:51.533024+0000","last_became_active":"2021-10-08T19:21:27.635310+0000","last_became_peered":"2021-10-08T19:21:27.635310+0000","last_unstale":"2021-10-08T19:24:51.533024+0000","last_undegraded":"2021-10-08T19:24:51.533024+0000","last_fullsized":"2021-10-08T19:24:51.533024+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:42.359130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:42.359130+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001847357,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":83,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.567273+0000","last_change":"2021-10-08T19:23:11.176225+0000","last_active":"2021-10-08T19:24:51.567273+0000","last_peered":"2021-10-08T19:24:51.567273+0000","last_clean":"2021-10-08T19:24:51.567273+0000","last_became_active":"2021-10-08T19:21:23.607639+0000","last_became_peered":"2021-10-08T19:21:23.607639+0000","last_unstale":"2021-10-08T19:24:51.567273+0000","last_undegraded":"2021-10-08T19:24:51.567273+0000","last_fullsized":"2021-10-08T19:24:51.567273+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:11.176122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:11.176122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040114119999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"69'9","reported_seq":95,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.540148+0000","last_change":"2021-10-08T19:22:36.590210+0000","last_active":"2021-10-08T19:24:51.540148+0000","last_peered":"2021-10-08T19:24:51.540148+0000","last_clean":"2021-10-08T19:24:51.540148+0000","last_became_active":"2021-10-08T19:21:25.610072+0000","last_became_peered":"2021-10-08T19:21:25.610072+0000","last_unstale":"2021-10-08T19:24:51.540148+0000","last_undegraded":"2021-10-08T19:24:51.540148+0000","last_fullsized":"2021-10-08T19:24:51.540148+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'9","last_scrub_stamp":"2021-10-08T19:22:36.590071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:36.590071+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0026030699999999999,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"127'4450","reported_seq":4504,"reported_epoch":127,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-10-08T19:24:53.475216+0000","last_change":"2021-10-08T19:24:26.874507+0000","last_active":"2021-10-08T19:24:53.475216+0000","last_peered":"2021-10-08T19:24:53.475216+0000","last_clean":"2021-10-08T19:24:23.992830+0000","last_became_active":"2021-10-08T19:24:26.866104+0000","last_became_peered":"2021-10-08T19:24:26.866104+0000","last_unstale":"2021-10-08T19:24:53.475216+0000","last_undegraded":"2021-10-08T19:24:26.186413+0000","last_fullsized":"2021-10-08T19:24:26.089542+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":4450,"ondisk_log_size":4450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":291635200,"num_objects":4450,"num_object_clones":0,"num_object_copies":13350,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3062,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4450,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4450,"num_write_kb":284800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5],"avail_no_missing":["1","2","5"],"object_location_counts":[{"shards":"1,2,5","objects":3062},{"shards":"1,5","objects":1388}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":92,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.540790+0000","last_change":"2021-10-08T19:24:25.089736+0000","last_active":"2021-10-08T19:24:51.540790+0000","last_peered":"2021-10-08T19:24:51.540790+0000","last_clean":"2021-10-08T19:24:51.540790+0000","last_became_active":"2021-10-08T19:24:25.089002+0000","last_became_peered":"2021-10-08T19:24:25.089002+0000","last_unstale":"2021-10-08T19:24:51.540790+0000","last_undegraded":"2021-10-08T19:24:51.540790+0000","last_fullsized":"2021-10-08T19:24:51.540790+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:10.805052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:10.805052+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.00168849,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":87,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.536546+0000","last_change":"2021-10-08T19:24:07.800878+0000","last_active":"2021-10-08T19:24:51.536546+0000","last_peered":"2021-10-08T19:24:51.536546+0000","last_clean":"2021-10-08T19:24:51.536546+0000","last_became_active":"2021-10-08T19:21:23.600352+0000","last_became_peered":"2021-10-08T19:21:23.600352+0000","last_unstale":"2021-10-08T19:24:51.536546+0000","last_undegraded":"2021-10-08T19:24:51.536546+0000","last_fullsized":"2021-10-08T19:24:51.536546+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:07.800787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:07.800787+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012798608,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"87'22","reported_seq":166,"reported_epoch":126,"state":"active+clean","last_fresh":"2021-10-08T19:24:51.540585+0000","last_change":"2021-10-08T19:24:25.118654+0000","last_active":"2021-10-08T19:24:51.540585+0000","last_peered":"2021-10-08T19:24:51.540585+0000","last_clean":"2021-10-08T19:24:51.540585+0000","last_became_active":"2021-10-08T19:24:25.088861+0000","last_became_peered":"2021-10-08T19:24:25.088861+0000","last_unstale":"2021-10-08T19:24:51.540585+0000","last_undegraded":"2021-10-08T19:24:51.540585+0000","last_fullsized":"2021-10-08T19:24:51.540585+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'22","last_scrub_stamp":"2021-10-08T19:24:20.355553+0000","last_deep_scrub":"87'22","last_deep_scrub_stamp":"2021-10-08T19:22:58.705632+0000","last_clean_scrub_stamp":"2021-10-08T19:24:20.355553+0000","log_size":22,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0022961499999999998,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"114'10","reported_seq":155,"reported_epoch":127,"state":"active+clean","last_fresh":"2021-10-08T19:24:52.580880+0000","last_change":"2021-10-08T19:24:25.116744+0000","last_active":"2021-10-08T19:24:52.580880+0000","last_peered":"2021-10-08T19:24:52.580880+0000","last_clean":"2021-10-08T19:24:52.580880+0000","last_became_active":"2021-10-08T19:24:25.096162+0000","last_became_peered":"2021-10-08T19:24:25.096162+0000","last_unstale":"2021-10-08T19:24:52.580880+0000","last_undegraded":"2021-10-08T19:24:52.580880+0000","last_fullsized":"2021-10-08T19:24:52.580880+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'8","last_scrub_stamp":"2021-10-08T19:22:51.065949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:51.065949+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020224639999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":4680122368,"num_objects":71413,"num_object_clones":0,"num_object_copies":214239,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6114,"num_objects_misplaced":8175,"num_objects_unfound":0,"num_objects_dirty":71413,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71413,"num_write_kb":4570432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":991,"num_bytes_recovered":64946176,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":14346158080,"data_stored":14346158080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71313,"ondisk_log_size":71313,"up":48,"acting":44,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":3,"acting":3,"num_store_stats":4},{"poolid":3,"num_pg":13,"stat_sum":{"num_bytes":681,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":150,"num_read_kb":146,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":584,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20,"ondisk_log_size":20,"up":39,"acting":39,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":694,"num_read_kb":451,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":139,"num_bytes_recovered":2134,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":406,"ondisk_log_size":406,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":96,"acting":96,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201327,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1506692,"kb_used_data":1467644,"kb_used_omap":0,"kb_used_meta":39040,"kb_avail":92238460,"statfs":{"total":95995035648,"available":94452183040,"internally_reserved":0,"allocated":1502867456,"data_stored":1502320945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":39976960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:24:18 2021","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.51700000000000002,"15min":0.48499999999999999},"min":{"1min":0.36499999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":2.4380000000000002,"5min":2.4380000000000002,"15min":2.4380000000000002},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.502,"15min":0.48199999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.3100000000000001,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":0.318}]},{"osd":1,"last update":"Fri Oct 8 19:24:18 2021","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.54300000000000004,"15min":0.51100000000000001},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":5.5019999999999998,"5min":5.5019999999999998,"15min":5.5019999999999998},"last":4.4029999999999996},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.52700000000000002,"15min":0.51600000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.3100000000000001,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":3.1669999999999998}]},{"osd":2,"last update":"Fri Oct 8 19:24:18 2021","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":0.65300000000000002,"15min":0.54400000000000004},"min":{"1min":0.36799999999999999,"5min":0.308,"15min":0.308},"max":{"1min":8.9570000000000007,"5min":8.9570000000000007,"15min":8.9570000000000007},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.502,"15min":0.48499999999999999},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":1.4830000000000001}]},{"osd":3,"last update":"Fri Oct 8 19:24:18 2021","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.53400000000000003,"15min":0.50600000000000001},"min":{"1min":0.36399999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":2.79,"5min":2.79,"15min":2.79},"last":2.2250000000000001},{"interface":"front","average":{"1min":1.7430000000000001,"5min":0.77600000000000002,"15min":0.59699999999999998},"min":{"1min":0.35299999999999998,"5min":0.313,"15min":0.313},"max":{"1min":10.1,"5min":10.1,"15min":10.1},"last":2.9409999999999998}]},{"osd":4,"last update":"Fri Oct 8 19:24:18 2021","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.46000000000000002,"15min":0.46899999999999997},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.433},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.45400000000000001,"15min":0.45000000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.41199999999999998}]},{"osd":5,"last update":"Fri Oct 8 19:24:18 2021","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.27700000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.498},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50600000000000001,"15min":0.51000000000000001},"min":{"1min":0.32400000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.45200000000000001}]},{"osd":6,"last update":"Fri Oct 8 19:24:18 2021","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.53200000000000003,"15min":0.51500000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.90800000000000003,"5min":2.4550000000000001,"15min":2.4550000000000001},"last":0.505},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.55800000000000005,"15min":0.56200000000000006},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.97099999999999997,"5min":1.02,"15min":1.02},"last":0.61099999999999999}]}]},{"osd":6,"up_from":47,"seq":201863462963,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":599464,"kb_used_data":566752,"kb_used_omap":0,"kb_used_meta":32704,"kb_avail":93145688,"statfs":{"total":95995035648,"available":95381184512,"internally_reserved":0,"allocated":580354048,"data_stored":579834363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":33488896},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:23:57 2021","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.45000000000000001,"15min":0.46200000000000002},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.497,"15min":0.497},"min":{"1min":0.312,"5min":0.247,"15min":0.247},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.39400000000000002}]},{"osd":1,"last update":"Fri Oct 8 19:23:57 2021","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":2.907},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.50900000000000001,"15min":0.499},"min":{"1min":0.36399999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":2.9350000000000001}]},{"osd":2,"last update":"Fri Oct 8 19:23:57 2021","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52000000000000002,"15min":0.52200000000000002},"min":{"1min":0.33100000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":1.9910000000000001},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.52600000000000002,"15min":0.503},"min":{"1min":0.35999999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":2.9929999999999999,"5min":2.9929999999999999,"15min":2.9929999999999999},"last":0.46600000000000003}]},{"osd":3,"last update":"Fri Oct 8 19:23:57 2021","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.496,"15min":0.49199999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":2.0059999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.51400000000000001,"15min":0.505},"min":{"1min":0.34399999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.75,"5min":1.75,"15min":1.75},"last":2.8199999999999998}]},{"osd":4,"last update":"Fri Oct 8 19:23:57 2021","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.41599999999999998,"15min":0.41399999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.69399999999999995,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44500000000000001,"15min":0.44700000000000001},"min":{"1min":0.27400000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.64500000000000002,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":1.972}]},{"osd":5,"last update":"Fri Oct 8 19:23:57 2021","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.63,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.436},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.46800000000000003,"15min":0.46899999999999997},"min":{"1min":0.35399999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.71199999999999997,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.34799999999999998}]},{"osd":7,"last update":"Fri Oct 8 19:24:20 2021","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.49199999999999999,"15min":0.49399999999999999},"min":{"1min":0.38400000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53100000000000003,"15min":0.53900000000000003},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.63500000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2130320,"kb_used_data":2083912,"kb_used_omap":0,"kb_used_meta":46464,"kb_avail":91614832,"statfs":{"total":95995035648,"available":93813587968,"internally_reserved":0,"allocated":2133925888,"data_stored":2133365620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47579136},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,3,1,3,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:24:33 2021","interfaces":[{"interface":"back","average":{"1min":7.9710000000000001,"5min":1.855,"15min":0.83599999999999997},"min":{"1min":0.20399999999999999,"5min":0.184,"15min":0.184},"max":{"1min":98.734999999999999,"5min":98.734999999999999,"15min":98.734999999999999},"last":1.22},{"interface":"front","average":{"1min":7.5060000000000002,"5min":1.7849999999999999,"15min":0.83399999999999996},"min":{"1min":0.23100000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":98.843999999999994,"5min":98.843999999999994,"15min":98.843999999999994},"last":1.667}]},{"osd":2,"last update":"Fri Oct 8 19:23:55 2021","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.374,"15min":0.39100000000000001},"min":{"1min":0.222,"5min":0.221,"15min":0.221},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":7.8010000000000002},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.41599999999999998,"15min":0.41999999999999998},"min":{"1min":0.27400000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.70099999999999996,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":5.625}]},{"osd":3,"last update":"Fri Oct 8 19:24:11 2021","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.496,"15min":0.47999999999999998},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":3.2999999999999998,"5min":3.2999999999999998,"15min":3.2999999999999998},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.749,"5min":0.48599999999999999,"15min":0.46999999999999997},"min":{"1min":0.28399999999999997,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":3.9180000000000001,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":1.0249999999999999}]},{"osd":4,"last update":"Fri Oct 8 19:24:24 2021","interfaces":[{"interface":"back","average":{"1min":1.569,"5min":0.71699999999999997,"15min":0.58199999999999996},"min":{"1min":0.33800000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":16.872,"5min":16.872,"15min":16.872},"last":2.3170000000000002},{"interface":"front","average":{"1min":1.024,"5min":0.623,"15min":0.56699999999999995},"min":{"1min":0.375,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":5.6719999999999997,"5min":5.6719999999999997,"15min":5.6719999999999997},"last":0.42499999999999999}]},{"osd":5,"last update":"Fri Oct 8 19:24:45 2021","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":0.69399999999999995,"15min":0.60799999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":4.0359999999999996,"5min":4.0359999999999996,"15min":4.0359999999999996},"last":0.51700000000000002},{"interface":"front","average":{"1min":1.222,"5min":0.67600000000000005,"15min":0.59799999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":5.7350000000000003,"5min":5.7350000000000003,"15min":5.7350000000000003},"last":0.46000000000000002}]},{"osd":6,"last update":"Fri Oct 8 19:24:01 2021","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52800000000000002,"15min":0.53500000000000003},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.73399999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":2.3580000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.63700000000000001,"15min":0.66100000000000003},"min":{"1min":0.40799999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":2.0579999999999998,"5min":2.5219999999999998,"15min":2.5219999999999998},"last":0.58299999999999996}]},{"osd":7,"last update":"Fri Oct 8 19:24:24 2021","interfaces":[{"interface":"back","average":{"1min":1.6819999999999999,"5min":0.78400000000000003,"15min":0.64000000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":15.384,"5min":15.384,"15min":15.384},"last":1.698},{"interface":"front","average":{"1min":1.024,"5min":0.65200000000000002,"15min":0.60099999999999998},"min":{"1min":0.375,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":5.7119999999999997,"5min":5.7119999999999997,"15min":5.7119999999999997},"last":0.48499999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2307772,"kb_used_data":2250740,"kb_used_omap":0,"kb_used_meta":57024,"kb_avail":91437380,"statfs":{"total":95995035648,"available":93631877120,"internally_reserved":0,"allocated":2304757760,"data_stored":2304218000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58392576},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1,4,4],"upper_bound":64},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 8 19:24:36 2021","interfaces":[{"interface":"back","average":{"1min":1.6679999999999999,"5min":0.58899999999999997,"15min":0.41499999999999998},"min":{"1min":0.23799999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":9.4019999999999992,"5min":9.4019999999999992,"15min":9.4019999999999992},"last":0.52900000000000003},{"interface":"front","average":{"1min":1.5389999999999999,"5min":0.61199999999999999,"15min":0.44800000000000001},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":9.9060000000000006,"5min":9.9060000000000006,"15min":9.9060000000000006},"last":7.0279999999999996}]},{"osd":2,"last update":"Fri Oct 8 19:23:56 2021","interfaces":[{"interface":"back","average":{"1min":3.0680000000000001,"5min":0.92300000000000004,"15min":0.57199999999999995},"min":{"1min":0.23400000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":62.390000000000001,"5min":62.390000000000001,"15min":62.390000000000001},"last":5.8319999999999999},{"interface":"front","average":{"1min":3.1549999999999998,"5min":0.93899999999999995,"15min":0.57999999999999996},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":62.718000000000004,"5min":62.718000000000004,"15min":62.718000000000004},"last":6.9989999999999997}]},{"osd":3,"last update":"Fri Oct 8 19:24:07 2021","interfaces":[{"interface":"back","average":{"1min":3.5089999999999999,"5min":1.054,"15min":0.68400000000000005},"min":{"1min":0.26500000000000001,"5min":0.246,"15min":0.246},"max":{"1min":62.491,"5min":62.491,"15min":62.491},"last":5.8600000000000003},{"interface":"front","average":{"1min":3.6440000000000001,"5min":1.0640000000000001,"15min":0.66400000000000003},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":62.673000000000002,"5min":62.673000000000002,"15min":62.673000000000002},"last":6.7080000000000002}]},{"osd":4,"last update":"Fri Oct 8 19:24:27 2021","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":0.66900000000000004,"15min":0.58599999999999997},"min":{"1min":0.312,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":5.5570000000000004,"5min":5.5570000000000004,"15min":5.5570000000000004},"last":0.46600000000000003},{"interface":"front","average":{"1min":1.079,"5min":0.66200000000000003,"15min":0.60899999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":5.2510000000000003,"5min":5.2510000000000003,"15min":5.2510000000000003},"last":4.0979999999999999}]},{"osd":5,"last update":"Fri Oct 8 19:24:44 2021","interfaces":[{"interface":"back","average":{"1min":1.494,"5min":0.73199999999999998,"15min":0.61299999999999999},"min":{"1min":0.34200000000000003,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":10.611000000000001,"5min":10.611000000000001,"15min":10.611000000000001},"last":4.5880000000000001},{"interface":"front","average":{"1min":1.4199999999999999,"5min":0.72499999999999998,"15min":0.621},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":5.4800000000000004,"5min":5.4800000000000004,"15min":5.4800000000000004},"last":0.50900000000000001}]},{"osd":6,"last update":"Fri Oct 8 19:23:59 2021","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.58599999999999997,"15min":0.57999999999999996},"min":{"1min":0.41399999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":4.032},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.59299999999999997,"15min":0.57799999999999996},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":3.5910000000000002,"5min":3.5910000000000002,"15min":3.5910000000000002},"last":4.6440000000000001}]},{"osd":7,"last update":"Fri Oct 8 19:24:18 2021","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":0.67500000000000004,"15min":0.59799999999999998},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":5.5170000000000003,"5min":5.5170000000000003,"15min":5.5170000000000003},"last":0.48999999999999999},{"interface":"front","average":{"1min":1.2470000000000001,"5min":0.71099999999999997,"15min":0.62},"min":{"1min":0.45100000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":5.6360000000000001,"5min":5.6360000000000001,"15min":5.6360000000000001},"last":4.0650000000000004}]}]},{"osd":2,"up_from":18,"seq":77309411392,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2231660,"kb_used_data":2176676,"kb_used_omap":0,"kb_used_meta":54976,"kb_avail":91513492,"statfs":{"total":95995035648,"available":93709815808,"internally_reserved":0,"allocated":2228916224,"data_stored":2228392186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":56295424},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:24:50 2021","interfaces":[{"interface":"back","average":{"1min":4.2709999999999999,"5min":1.125,"15min":0.60499999999999998},"min":{"1min":0.32100000000000001,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":31.376999999999999,"5min":31.376999999999999,"15min":31.376999999999999},"last":1.2629999999999999},{"interface":"front","average":{"1min":2.5049999999999999,"5min":0.79600000000000004,"15min":0.503},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":9.3469999999999995,"5min":9.3469999999999995,"15min":9.3469999999999995},"last":5.1070000000000002}]},{"osd":1,"last update":"Fri Oct 8 19:24:50 2021","interfaces":[{"interface":"back","average":{"1min":4.1639999999999997,"5min":1.1639999999999999,"15min":0.63},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":31.303999999999998,"5min":31.303999999999998,"15min":31.303999999999998},"last":1.2909999999999999},{"interface":"front","average":{"1min":4.7169999999999996,"5min":1.2709999999999999,"15min":0.68400000000000005},"min":{"1min":0.22,"5min":0.218,"15min":0.218},"max":{"1min":31.696999999999999,"5min":31.696999999999999,"15min":31.696999999999999},"last":1.629}]},{"osd":3,"last update":"Fri Oct 8 19:24:07 2021","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.49399999999999999,"15min":0.46600000000000003},"min":{"1min":0.255,"5min":0.218,"15min":0.218},"max":{"1min":5.9340000000000002,"5min":5.9340000000000002,"15min":5.9340000000000002},"last":1.6870000000000001},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.48999999999999999,"15min":0.44400000000000001},"min":{"1min":0.254,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":7.9400000000000004,"5min":7.9400000000000004,"15min":7.9400000000000004},"last":6.4139999999999997}]},{"osd":4,"last update":"Fri Oct 8 19:24:22 2021","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":0.66400000000000003,"15min":0.59099999999999997},"min":{"1min":0.42899999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":8.0329999999999995,"5min":8.0329999999999995,"15min":8.0329999999999995},"last":6.1920000000000002},{"interface":"front","average":{"1min":1.2689999999999999,"5min":0.69999999999999996,"15min":0.62},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":5.9690000000000003,"5min":5.9690000000000003,"15min":5.9690000000000003},"last":1.7230000000000001}]},{"osd":5,"last update":"Fri Oct 8 19:24:45 2021","interfaces":[{"interface":"back","average":{"1min":2.391,"5min":0.91900000000000004,"15min":0.69299999999999995},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":9.4420000000000002,"5min":9.4420000000000002,"15min":9.4420000000000002},"last":1.7749999999999999},{"interface":"front","average":{"1min":1.786,"5min":0.81499999999999995,"15min":0.66300000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":8.2690000000000001,"5min":8.2690000000000001,"15min":8.2690000000000001},"last":1.3169999999999999}]},{"osd":6,"last update":"Fri Oct 8 19:24:07 2021","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.63500000000000001,"15min":0.59099999999999997},"min":{"1min":0.38800000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":8.0050000000000008,"5min":8.0050000000000008,"15min":8.0050000000000008},"last":6.1660000000000004},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.60399999999999998,"15min":0.59499999999999997},"min":{"1min":0.39900000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":2.6619999999999999,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":1.359}]},{"osd":7,"last update":"Fri Oct 8 19:24:22 2021","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":0.68700000000000006,"15min":0.60699999999999998},"min":{"1min":0.40600000000000003,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":8.0640000000000001,"5min":8.0640000000000001,"15min":8.0640000000000001},"last":6.1360000000000001},{"interface":"front","average":{"1min":1.1559999999999999,"5min":0.70099999999999996,"15min":0.63700000000000001},"min":{"1min":0.44600000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":4.4829999999999997,"5min":4.4829999999999997,"15min":4.4829999999999997},"last":1.3380000000000001}]}]},{"osd":3,"up_from":24,"seq":103079215166,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2789324,"kb_used_data":2728452,"kb_used_omap":0,"kb_used_meta":60864,"kb_avail":90955828,"statfs":{"total":95995035648,"available":93138767872,"internally_reserved":0,"allocated":2793934848,"data_stored":2793378942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":62324736},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:24:10 2021","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.40100000000000002,"15min":0.36899999999999999},"min":{"1min":0.20399999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":3.6819999999999999,"5min":3.6819999999999999,"15min":3.6819999999999999},"last":3.133},{"interface":"front","average":{"1min":1.1990000000000001,"5min":0.54100000000000004,"15min":0.45000000000000001},"min":{"1min":0.217,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":6.3090000000000002,"5min":6.3090000000000002,"15min":6.3090000000000002},"last":3.7090000000000001}]},{"osd":1,"last update":"Fri Oct 8 19:24:10 2021","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":0.52600000000000002,"15min":0.45000000000000001},"min":{"1min":0.24099999999999999,"5min":0.219,"15min":0.219},"max":{"1min":7.016,"5min":7.016,"15min":7.016},"last":3.7370000000000001},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.48099999999999998,"15min":0.437},"min":{"1min":0.23200000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":7.0419999999999998,"5min":7.0419999999999998,"15min":7.0419999999999998},"last":3.0190000000000001}]},{"osd":2,"last update":"Fri Oct 8 19:24:10 2021","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.504,"15min":0.46200000000000002},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":7.1379999999999999,"5min":7.1379999999999999,"15min":7.1379999999999999},"last":6.3470000000000004},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.434,"15min":0.43099999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":2.0009999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":0.61699999999999999}]},{"osd":4,"last update":"Fri Oct 8 19:24:27 2021","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.58099999999999996,"15min":0.58499999999999996},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":2.5649999999999999,"5min":2.5649999999999999,"15min":2.5649999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":1.3640000000000001,"5min":0.80700000000000005,"15min":0.80900000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":5.8129999999999997,"5min":5.8129999999999997,"15min":5.8129999999999997},"last":0.58699999999999997}]},{"osd":5,"last update":"Fri Oct 8 19:24:42 2021","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":0.73399999999999999,"15min":0.63800000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":7.0960000000000001,"5min":7.0960000000000001,"15min":7.0960000000000001},"last":1.5369999999999999},{"interface":"front","average":{"1min":1.5029999999999999,"5min":0.79400000000000004,"15min":0.749},"min":{"1min":0.33000000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":8.7590000000000003,"5min":8.7590000000000003,"15min":8.7590000000000003},"last":0.45600000000000002}]},{"osd":6,"last update":"Fri Oct 8 19:24:05 2021","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":1.3180000000000001,"15min":1.6140000000000001},"min":{"1min":0.377,"5min":0.376,"15min":0.376},"max":{"1min":5.6159999999999997,"5min":21.538,"15min":21.538},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.60999999999999999,"15min":0.58099999999999996},"min":{"1min":0.36899999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":7.1210000000000004,"5min":7.1210000000000004,"15min":7.1210000000000004},"last":1.5649999999999999}]},{"osd":7,"last update":"Fri Oct 8 19:24:23 2021","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":0.72299999999999998,"15min":0.64400000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":5.7750000000000004,"5min":5.7750000000000004,"15min":5.7750000000000004},"last":0.54500000000000004},{"interface":"front","average":{"1min":1.3979999999999999,"5min":0.755,"15min":0.66700000000000004},"min":{"1min":0.41799999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":8.1059999999999999,"5min":8.1059999999999999,"15min":8.1059999999999999},"last":1.585}]}]},{"osd":4,"up_from":30,"seq":128849018939,"num_pgs":62,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1521736,"kb_used_data":1482112,"kb_used_omap":0,"kb_used_meta":39616,"kb_avail":92223416,"statfs":{"total":95995035648,"available":94436777984,"internally_reserved":0,"allocated":1517682688,"data_stored":1517131401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40566784},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:24:26 2021","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.56699999999999995,"15min":0.54100000000000004},"min":{"1min":0.28199999999999997,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":3.2240000000000002,"5min":3.2240000000000002,"15min":3.2240000000000002},"last":6.0410000000000004},{"interface":"front","average":{"1min":0.629,"5min":0.52700000000000002,"15min":0.52600000000000002},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":2.1600000000000001,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":4.0019999999999998}]},{"osd":1,"last update":"Fri Oct 8 19:24:26 2021","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.53400000000000003,"15min":0.52500000000000002},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":3.7250000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.47999999999999998,"15min":0.499},"min":{"1min":0.246,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":2.4380000000000002}]},{"osd":2,"last update":"Fri Oct 8 19:24:26 2021","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.53300000000000003,"15min":0.52300000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":2.403,"5min":2.403,"15min":2.403},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.52900000000000003,"15min":0.53500000000000003},"min":{"1min":0.34000000000000002,"5min":0.308,"15min":0.308},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":3.9039999999999999}]},{"osd":3,"last update":"Fri Oct 8 19:24:26 2021","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":0.65000000000000002,"15min":0.56499999999999995},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":5.4100000000000001,"5min":5.4100000000000001,"15min":5.4100000000000001},"last":3.0430000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.52300000000000002,"15min":0.52700000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":5.4470000000000001}]},{"osd":5,"last update":"Fri Oct 8 19:24:46 2021","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.39600000000000002,"15min":0.38100000000000001},"min":{"1min":0.23899999999999999,"5min":0.222,"15min":0.222},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.45100000000000001,"15min":0.40600000000000003},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":2.4689999999999999,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":0.29299999999999998}]},{"osd":6,"last update":"Fri Oct 8 19:24:01 2021","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.42499999999999999,"15min":0.40899999999999997},"min":{"1min":0.30399999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.44400000000000001,"15min":0.42799999999999999},"min":{"1min":0.315,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.375}]},{"osd":7,"last update":"Fri Oct 8 19:24:21 2021","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.48899999999999999,"15min":0.48499999999999999},"min":{"1min":0.35999999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.53000000000000003,"15min":0.504},"min":{"1min":0.34899999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":4.3120000000000003,"5min":4.3120000000000003,"15min":4.3120000000000003},"last":0.38500000000000001}]}]},{"osd":5,"up_from":38,"seq":163208757301,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1218416,"kb_used_data":1183784,"kb_used_omap":0,"kb_used_meta":34624,"kb_avail":92526736,"statfs":{"total":95995035648,"available":94747377664,"internally_reserved":0,"allocated":1212194816,"data_stored":1211667451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35454976},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:24:45 2021","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":0.88400000000000001,"15min":0.60799999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":5.1890000000000001,"5min":22.966999999999999,"15min":22.966999999999999},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.0169999999999999,"5min":0.56599999999999995,"15min":0.5},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":3.7120000000000002,"5min":3.7120000000000002,"15min":3.7120000000000002},"last":0.32700000000000001}]},{"osd":1,"last update":"Fri Oct 8 19:24:45 2021","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":0.64100000000000001,"15min":0.54800000000000004},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":5.1950000000000003,"5min":5.1950000000000003,"15min":5.1950000000000003},"last":0.27100000000000002},{"interface":"front","average":{"1min":1.5009999999999999,"5min":0.68100000000000005,"15min":0.56699999999999995},"min":{"1min":0.34799999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":5.1900000000000004,"5min":5.1900000000000004,"15min":5.1900000000000004},"last":0.308}]},{"osd":2,"last update":"Fri Oct 8 19:24:45 2021","interfaces":[{"interface":"back","average":{"1min":1.5029999999999999,"5min":0.88900000000000001,"15min":0.60599999999999998},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":6.1360000000000001,"5min":23.515000000000001,"15min":23.515000000000001},"last":0.44600000000000001},{"interface":"front","average":{"1min":1.351,"5min":0.879,"15min":0.626},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":4.3140000000000001,"5min":23.073,"15min":23.073},"last":6.9480000000000004}]},{"osd":3,"last update":"Fri Oct 8 19:24:45 2021","interfaces":[{"interface":"back","average":{"1min":2.0449999999999999,"5min":0.78200000000000003,"15min":0.58699999999999997},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":5.8609999999999998,"5min":5.8609999999999998,"15min":5.8609999999999998},"last":4.1449999999999996},{"interface":"front","average":{"1min":1.4870000000000001,"5min":0.67600000000000005,"15min":0.55400000000000005},"min":{"1min":0.32000000000000001,"5min":0.313,"15min":0.313},"max":{"1min":6.9020000000000001,"5min":6.9020000000000001,"15min":6.9020000000000001},"last":4.1669999999999998}]},{"osd":4,"last update":"Fri Oct 8 19:24:45 2021","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.46200000000000002,"15min":0.42599999999999999},"min":{"1min":0.249,"5min":0.224,"15min":0.224},"max":{"1min":3.6789999999999998,"5min":3.6789999999999998,"15min":3.6789999999999998},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.50800000000000001,"15min":0.45500000000000002},"min":{"1min":0.28699999999999998,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":3.3999999999999999,"5min":3.3999999999999999,"15min":3.3999999999999999},"last":0.41799999999999998}]},{"osd":6,"last update":"Fri Oct 8 19:23:59 2021","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.45000000000000001,"15min":0.44800000000000001},"min":{"1min":0.35399999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.497},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.496,"15min":0.498},"min":{"1min":0.33700000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.39000000000000001}]},{"osd":7,"last update":"Fri Oct 8 19:24:18 2021","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.5,"15min":0.504},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54900000000000004,"15min":0.56699999999999995},"min":{"1min":0.36299999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.171,"5min":1.653,"15min":1.653},"last":0.46100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":2008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2324299776,"data_stored":2324299776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2141126656,"data_stored":2141126656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2240282624,"data_stored":2240282624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2793603072,"data_stored":2793603072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1520369664,"data_stored":1520369664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1224278016,"data_stored":1224278016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":587464704,"data_stored":587464704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1514733568,"data_stored":1514733568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-10-08T19:25:04.314 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2021-10-08T19:25:04.315 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd pool set iscsi pg_num 23 2021-10-08T19:25:04.364 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:25:04 smithi097 conmon[33110]: 172.21.15.117 - - [08/Oct/2021:19:25:04] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:04.400 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:25:04.405 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:04.406 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:25:04.508 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:25:04.537 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:04.600 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:25:04.602 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:04.603 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:25:04.704 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:25:04.779 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:05.001 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:25:05.001 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2021-10-08T19:25:05.002 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2021-10-08T19:25:05.002 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2021-10-08T19:25:05.002 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.002 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:32146 7.a 7:5711dd9d:::benchmark_data_smithi097_93198_object32145:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2021-10-08T19:25:05.003 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:09.665255+0000", 2021-10-08T19:25:05.003 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 55.324217558000001, 2021-10-08T19:25:05.003 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.096890712000000004, 2021-10-08T19:25:05.003 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:25:05.003 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:05.004 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:25:05.004 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:25:05.004 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:25:05.004 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 32146 2021-10-08T19:25:05.004 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.005 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:25:05.005 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.005 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:25:05.005 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.665255+0000", 2021-10-08T19:25:05.005 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:25:05.006 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.006 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.006 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:25:05.006 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.665255+0000", 2021-10-08T19:25:05.007 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:25:05.007 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.007 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.007 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:25:05.007 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.665253+0000", 2021-10-08T19:25:05.008 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:25:05.008 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.008 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.008 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:25:05.008 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.665277+0000", 2021-10-08T19:25:05.009 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.421e-05 2021-10-08T19:25:05.009 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.009 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.009 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:25:05.009 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.757815+0000", 2021-10-08T19:25:05.010 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.092538147000000001 2021-10-08T19:25:05.010 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.010 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.010 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:25:05.011 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.757836+0000", 2021-10-08T19:25:05.011 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0825000000000001e-05 2021-10-08T19:25:05.011 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.011 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.012 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:25:05.012 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.757935+0000", 2021-10-08T19:25:05.012 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.9214000000000002e-05 2021-10-08T19:25:05.012 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.012 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.013 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:25:05.013 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.758106+0000", 2021-10-08T19:25:05.013 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017054900000000001 2021-10-08T19:25:05.013 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.014 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.014 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2,5", 2021-10-08T19:25:05.014 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.758287+0000", 2021-10-08T19:25:05.014 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00018175400000000001 2021-10-08T19:25:05.014 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.015 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.015 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:05.015 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.761167+0000", 2021-10-08T19:25:05.015 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028791480000000002 2021-10-08T19:25:05.015 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.016 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.016 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:25:05.016 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.761180+0000", 2021-10-08T19:25:05.016 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3699e-05 2021-10-08T19:25:05.016 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.017 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.017 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:05.017 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.762061+0000", 2021-10-08T19:25:05.017 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00088111999999999999 2021-10-08T19:25:05.017 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.018 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.018 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:25:05.018 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.762114+0000", 2021-10-08T19:25:05.018 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3001999999999998e-05 2021-10-08T19:25:05.019 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.019 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.019 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:25:05.019 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.762145+0000", 2021-10-08T19:25:05.019 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1018e-05 2021-10-08T19:25:05.020 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:05.020 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:05.020 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:05.020 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.020 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.021 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:35697 7.c 7:38456c0c:::benchmark_data_smithi097_93198_object35696:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106)", 2021-10-08T19:25:05.021 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:12.253514+0000", 2021-10-08T19:25:05.021 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 52.735958144999998, 2021-10-08T19:25:05.021 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.149840001, 2021-10-08T19:25:05.022 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:25:05.022 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:05.022 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:25:05.022 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:25:05.022 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:25:05.023 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 35697 2021-10-08T19:25:05.023 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.023 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:25:05.023 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.023 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:25:05.024 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.253514+0000", 2021-10-08T19:25:05.024 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:25:05.024 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.025 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.025 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:25:05.025 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.253514+0000", 2021-10-08T19:25:05.025 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:25:05.025 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.026 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.026 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:25:05.026 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.253513+0000", 2021-10-08T19:25:05.026 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:25:05.026 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.027 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.027 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:25:05.027 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.253542+0000", 2021-10-08T19:25:05.027 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8481999999999999e-05 2021-10-08T19:25:05.028 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.028 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.028 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:25:05.028 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.253550+0000", 2021-10-08T19:25:05.028 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1780000000000003e-06 2021-10-08T19:25:05.029 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.029 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.029 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:25:05.030 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.253555+0000", 2021-10-08T19:25:05.030 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.843e-06 2021-10-08T19:25:05.030 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.030 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.030 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:25:05.031 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.258211+0000", 2021-10-08T19:25:05.031 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0046566669999999998 2021-10-08T19:25:05.031 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.031 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.031 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:25:05.032 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.258329+0000", 2021-10-08T19:25:05.032 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011772100000000001 2021-10-08T19:25:05.032 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.032 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.032 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2,7", 2021-10-08T19:25:05.033 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.396732+0000", 2021-10-08T19:25:05.033 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.138402898 2021-10-08T19:25:05.033 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.033 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.033 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:05.034 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.398651+0000", 2021-10-08T19:25:05.034 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001919511 2021-10-08T19:25:05.034 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.034 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.035 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:25:05.035 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.402133+0000", 2021-10-08T19:25:05.035 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0034813169999999998 2021-10-08T19:25:05.035 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.035 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.036 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:05.036 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.403265+0000", 2021-10-08T19:25:05.036 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011324600000000001 2021-10-08T19:25:05.036 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.037 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.037 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:25:05.037 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.403318+0000", 2021-10-08T19:25:05.037 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2636999999999998e-05 2021-10-08T19:25:05.037 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.038 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.038 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:25:05.038 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.403354+0000", 2021-10-08T19:25:05.038 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6358e-05 2021-10-08T19:25:05.038 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:05.039 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:05.039 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:05.039 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.039 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.039 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:35698 7.3 7:ce511a02:::benchmark_data_smithi097_93198_object35697:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106)", 2021-10-08T19:25:05.040 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:12.258052+0000", 2021-10-08T19:25:05.040 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 52.731420651000001, 2021-10-08T19:25:05.040 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.14845515100000001, 2021-10-08T19:25:05.040 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:25:05.041 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:05.041 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:25:05.041 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:25:05.041 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:25:05.041 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 35698 2021-10-08T19:25:05.042 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.042 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:25:05.042 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.042 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:25:05.042 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.258052+0000", 2021-10-08T19:25:05.043 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:25:05.043 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.043 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.043 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:25:05.043 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.258052+0000", 2021-10-08T19:25:05.044 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:25:05.044 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.044 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.044 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:25:05.045 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.258050+0000", 2021-10-08T19:25:05.045 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:25:05.045 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.045 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.045 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:25:05.046 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.258107+0000", 2021-10-08T19:25:05.046 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7309000000000003e-05 2021-10-08T19:25:05.046 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.046 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.046 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:25:05.047 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.258120+0000", 2021-10-08T19:25:05.047 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2639e-05 2021-10-08T19:25:05.047 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.047 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.047 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:25:05.048 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.258127+0000", 2021-10-08T19:25:05.048 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3819999999999998e-06 2021-10-08T19:25:05.048 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.048 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.048 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:25:05.049 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.258212+0000", 2021-10-08T19:25:05.049 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5101999999999999e-05 2021-10-08T19:25:05.049 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.049 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.049 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:25:05.050 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.258316+0000", 2021-10-08T19:25:05.050 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000104085 2021-10-08T19:25:05.050 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.050 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.051 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2,4", 2021-10-08T19:25:05.051 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.396994+0000", 2021-10-08T19:25:05.051 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.13867813500000001 2021-10-08T19:25:05.051 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.051 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.052 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:05.052 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.400905+0000", 2021-10-08T19:25:05.052 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0039107899999999999 2021-10-08T19:25:05.052 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.052 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.053 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:25:05.053 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.400957+0000", 2021-10-08T19:25:05.053 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2169999999999997e-05 2021-10-08T19:25:05.053 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.054 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.054 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:05.054 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.406414+0000", 2021-10-08T19:25:05.054 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.005456397 2021-10-08T19:25:05.054 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.055 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.055 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:25:05.055 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.406469+0000", 2021-10-08T19:25:05.055 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5448999999999997e-05 2021-10-08T19:25:05.056 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.056 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.056 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:25:05.056 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.406507+0000", 2021-10-08T19:25:05.056 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7622e-05 2021-10-08T19:25:05.057 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:05.057 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:05.057 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:05.057 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.058 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.058 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:35700 7.3 7:ca400aa7:::benchmark_data_smithi097_93198_object35699:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106)", 2021-10-08T19:25:05.058 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:12.258147+0000", 2021-10-08T19:25:05.058 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 52.731325284, 2021-10-08T19:25:05.059 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.148477053, 2021-10-08T19:25:05.059 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:25:05.059 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:05.059 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:25:05.059 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:25:05.060 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:25:05.060 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 35700 2021-10-08T19:25:05.060 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.060 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:25:05.061 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.061 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:25:05.061 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.258147+0000", 2021-10-08T19:25:05.061 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:25:05.062 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.062 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.062 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:25:05.062 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.258147+0000", 2021-10-08T19:25:05.062 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:25:05.063 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.063 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.063 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:25:05.063 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.258146+0000", 2021-10-08T19:25:05.063 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:25:05.064 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.064 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.064 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:25:05.064 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.258170+0000", 2021-10-08T19:25:05.064 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4198000000000001e-05 2021-10-08T19:25:05.065 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.065 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.065 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:25:05.065 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.258178+0000", 2021-10-08T19:25:05.065 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.593e-06 2021-10-08T19:25:05.066 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.066 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.066 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:25:05.066 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.258183+0000", 2021-10-08T19:25:05.067 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0900000000000004e-06 2021-10-08T19:25:05.067 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.067 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.067 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:25:05.067 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.399233+0000", 2021-10-08T19:25:05.068 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.141049862 2021-10-08T19:25:05.068 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.068 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.068 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:25:05.068 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.399387+0000", 2021-10-08T19:25:05.069 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015389900000000001 2021-10-08T19:25:05.069 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.069 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.069 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2,4", 2021-10-08T19:25:05.069 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.399536+0000", 2021-10-08T19:25:05.070 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014961299999999999 2021-10-08T19:25:05.070 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.070 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.070 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:05.070 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.400950+0000", 2021-10-08T19:25:05.071 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0014142409999999999 2021-10-08T19:25:05.071 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.071 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.071 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:25:05.071 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.402523+0000", 2021-10-08T19:25:05.072 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0015724440000000001 2021-10-08T19:25:05.072 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.072 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.072 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:05.073 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.406542+0000", 2021-10-08T19:25:05.073 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0040186060000000001 2021-10-08T19:25:05.073 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.073 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.073 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:25:05.074 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.406586+0000", 2021-10-08T19:25:05.074 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4073000000000003e-05 2021-10-08T19:25:05.074 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.074 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.074 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:25:05.075 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.406624+0000", 2021-10-08T19:25:05.075 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8423999999999997e-05 2021-10-08T19:25:05.075 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:05.075 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:05.075 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:05.076 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.076 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.076 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:35701 7.a 7:5bd5e740:::benchmark_data_smithi097_93198_object35700:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106)", 2021-10-08T19:25:05.076 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:12.258423+0000", 2021-10-08T19:25:05.077 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 52.731048829999999, 2021-10-08T19:25:05.077 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.14922896199999999, 2021-10-08T19:25:05.077 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:25:05.077 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:05.077 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:25:05.078 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:25:05.078 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:25:05.078 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 35701 2021-10-08T19:25:05.078 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.078 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:25:05.079 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.079 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:25:05.079 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.258423+0000", 2021-10-08T19:25:05.079 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:25:05.079 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.080 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.080 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:25:05.080 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.258423+0000", 2021-10-08T19:25:05.080 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:25:05.080 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.081 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.081 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:25:05.081 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.258418+0000", 2021-10-08T19:25:05.081 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999948 2021-10-08T19:25:05.082 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.082 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.082 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:25:05.082 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.258445+0000", 2021-10-08T19:25:05.082 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7192999999999999e-05 2021-10-08T19:25:05.083 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.083 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.083 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:25:05.083 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.396635+0000", 2021-10-08T19:25:05.083 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.13818986999999999 2021-10-08T19:25:05.084 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.084 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.084 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:25:05.084 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.396649+0000", 2021-10-08T19:25:05.084 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.382e-05 2021-10-08T19:25:05.085 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.085 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.085 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:25:05.085 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.396711+0000", 2021-10-08T19:25:05.085 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1987000000000001e-05 2021-10-08T19:25:05.086 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.086 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.086 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:25:05.086 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.396858+0000", 2021-10-08T19:25:05.087 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014705 2021-10-08T19:25:05.087 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.087 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.087 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2,5", 2021-10-08T19:25:05.087 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.396995+0000", 2021-10-08T19:25:05.088 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013697000000000001 2021-10-08T19:25:05.088 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.088 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.088 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:05.088 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.400258+0000", 2021-10-08T19:25:05.089 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032632030000000001 2021-10-08T19:25:05.089 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.089 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.089 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:25:05.089 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.400806+0000", 2021-10-08T19:25:05.090 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00054806099999999997 2021-10-08T19:25:05.090 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.090 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.090 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:05.091 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.407559+0000", 2021-10-08T19:25:05.091 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0067530860000000002 2021-10-08T19:25:05.091 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.091 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.091 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:25:05.092 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.407613+0000", 2021-10-08T19:25:05.092 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3869999999999998e-05 2021-10-08T19:25:05.092 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.092 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.092 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:25:05.093 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.407652+0000", 2021-10-08T19:25:05.093 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9140999999999997e-05 2021-10-08T19:25:05.093 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:05.093 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:05.093 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:05.094 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.094 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.094 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.24796.0:35708 7.6 e106/94 7:6ac91e09:::benchmark_data_smithi097_93198_object35707:head v 106'2177, mlcod=106'2175)", 2021-10-08T19:25:05.094 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:12.264601+0000", 2021-10-08T19:25:05.094 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 52.724871057000001, 2021-10-08T19:25:05.095 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.135642611, 2021-10-08T19:25:05.095 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:25:05.095 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:05.095 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:25:05.095 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.096 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:25:05.096 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.264601+0000", 2021-10-08T19:25:05.096 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:25:05.096 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.097 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.097 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:25:05.097 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.264601+0000", 2021-10-08T19:25:05.097 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:25:05.097 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.098 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.098 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:25:05.098 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.264599+0000", 2021-10-08T19:25:05.098 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:25:05.098 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.099 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.099 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:25:05.099 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.264631+0000", 2021-10-08T19:25:05.099 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2209000000000003e-05 2021-10-08T19:25:05.099 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.100 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.100 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:25:05.100 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.396655+0000", 2021-10-08T19:25:05.101 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.13202387400000001 2021-10-08T19:25:05.101 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.101 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.101 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:25:05.101 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.396663+0000", 2021-10-08T19:25:05.102 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3669999999999999e-06 2021-10-08T19:25:05.102 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.102 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.102 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:25:05.102 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.396926+0000", 2021-10-08T19:25:05.103 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00026396600000000003 2021-10-08T19:25:05.103 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.103 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.103 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:25:05.103 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.396947+0000", 2021-10-08T19:25:05.104 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0594e-05 2021-10-08T19:25:05.104 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.104 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.104 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:25:05.104 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.400213+0000", 2021-10-08T19:25:05.105 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032656719999999998 2021-10-08T19:25:05.105 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.105 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.105 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:25:05.105 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.400244+0000", 2021-10-08T19:25:05.106 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1041000000000003e-05 2021-10-08T19:25:05.106 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:05.106 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:05.106 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:05.107 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.107 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.107 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.24796.0:35716 7.1 e106/94 7:8e2c561f:::benchmark_data_smithi097_93198_object35715:head v 106'2203, mlcod=106'2201)", 2021-10-08T19:25:05.107 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:12.268945+0000", 2021-10-08T19:25:05.107 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 52.720527031000003, 2021-10-08T19:25:05.108 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.13389158300000001, 2021-10-08T19:25:05.108 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:25:05.108 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:05.108 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:25:05.108 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.109 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:25:05.109 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.268945+0000", 2021-10-08T19:25:05.109 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:25:05.109 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.109 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.110 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:25:05.110 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.268945+0000", 2021-10-08T19:25:05.110 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:25:05.110 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.110 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.111 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:25:05.111 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.268943+0000", 2021-10-08T19:25:05.111 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:25:05.111 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.111 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.112 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:25:05.112 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.269050+0000", 2021-10-08T19:25:05.112 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010633600000000001 2021-10-08T19:25:05.112 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.112 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.113 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:25:05.113 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.396628+0000", 2021-10-08T19:25:05.113 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.12757862 2021-10-08T19:25:05.113 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.113 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.114 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:25:05.114 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.396645+0000", 2021-10-08T19:25:05.114 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7198999999999999e-05 2021-10-08T19:25:05.114 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.115 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.115 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:25:05.115 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.396785+0000", 2021-10-08T19:25:05.115 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013936299999999999 2021-10-08T19:25:05.115 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.116 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.116 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:25:05.116 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.396808+0000", 2021-10-08T19:25:05.116 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3575999999999999e-05 2021-10-08T19:25:05.116 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.117 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.117 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:25:05.117 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.402808+0000", 2021-10-08T19:25:05.117 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0059998589999999997 2021-10-08T19:25:05.117 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.118 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.118 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:25:05.118 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.402837+0000", 2021-10-08T19:25:05.118 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8600999999999999e-05 2021-10-08T19:25:05.119 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:05.119 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:05.119 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:05.119 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.119 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.120 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.24796.0:40762 7.d e110/94 7:b78dbecb:::benchmark_data_smithi097_93198_object40761:head v 110'2569, mlcod=110'2567)", 2021-10-08T19:25:05.120 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:16.429967+0000", 2021-10-08T19:25:05.120 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 48.559504922000002, 2021-10-08T19:25:05.120 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.107953114, 2021-10-08T19:25:05.120 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:25:05.121 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:05.121 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:25:05.121 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.121 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:25:05.121 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.429967+0000", 2021-10-08T19:25:05.122 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:25:05.122 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.122 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.122 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:25:05.122 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.429967+0000", 2021-10-08T19:25:05.123 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:25:05.123 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.123 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.123 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:25:05.123 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.429966+0000", 2021-10-08T19:25:05.124 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2021-10-08T19:25:05.124 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.124 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.124 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:25:05.125 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.429990+0000", 2021-10-08T19:25:05.125 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3686e-05 2021-10-08T19:25:05.125 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.125 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.125 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:25:05.126 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.430000+0000", 2021-10-08T19:25:05.126 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.8810000000000008e-06 2021-10-08T19:25:05.126 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.126 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.126 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:25:05.127 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.430006+0000", 2021-10-08T19:25:05.127 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.122e-06 2021-10-08T19:25:05.127 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.127 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.127 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:25:05.128 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.430859+0000", 2021-10-08T19:25:05.128 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00085339400000000005 2021-10-08T19:25:05.128 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.128 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.128 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:25:05.129 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.430876+0000", 2021-10-08T19:25:05.129 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7396000000000001e-05 2021-10-08T19:25:05.129 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.130 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.130 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:25:05.130 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.433207+0000", 2021-10-08T19:25:05.130 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0023307100000000002 2021-10-08T19:25:05.130 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.131 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.131 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:25:05.131 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.537920+0000", 2021-10-08T19:25:05.131 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.104713232 2021-10-08T19:25:05.131 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:05.132 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:05.132 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:05.132 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.132 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.132 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:40767 7.3 7:c3230ab9:::benchmark_data_smithi097_93198_object40766:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2021-10-08T19:25:05.133 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:16.432235+0000", 2021-10-08T19:25:05.133 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 48.557237503000003, 2021-10-08T19:25:05.133 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.110108937, 2021-10-08T19:25:05.133 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:25:05.134 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:05.134 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:25:05.134 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:25:05.134 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:25:05.134 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 40767 2021-10-08T19:25:05.135 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.135 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:25:05.135 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.135 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:25:05.135 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.432235+0000", 2021-10-08T19:25:05.136 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:25:05.136 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.136 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.136 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:25:05.136 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.432235+0000", 2021-10-08T19:25:05.137 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:25:05.137 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.137 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.137 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:25:05.137 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.432233+0000", 2021-10-08T19:25:05.138 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:25:05.138 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.138 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.138 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:25:05.139 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.432262+0000", 2021-10-08T19:25:05.139 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8493999999999999e-05 2021-10-08T19:25:05.139 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.139 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.139 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:25:05.140 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.432269+0000", 2021-10-08T19:25:05.140 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1770000000000001e-06 2021-10-08T19:25:05.140 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.140 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.140 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:25:05.141 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.432274+0000", 2021-10-08T19:25:05.141 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.938e-06 2021-10-08T19:25:05.141 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.141 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.141 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:25:05.142 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.432422+0000", 2021-10-08T19:25:05.142 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000148632 2021-10-08T19:25:05.142 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.142 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.142 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:25:05.143 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.432538+0000", 2021-10-08T19:25:05.143 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115374 2021-10-08T19:25:05.143 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.143 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.143 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2,4", 2021-10-08T19:25:05.144 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.536388+0000", 2021-10-08T19:25:05.144 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.10385037699999999 2021-10-08T19:25:05.144 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.144 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.145 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:05.145 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.539814+0000", 2021-10-08T19:25:05.145 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0034261370000000001 2021-10-08T19:25:05.145 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.145 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.146 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:25:05.146 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.539828+0000", 2021-10-08T19:25:05.146 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3893000000000001e-05 2021-10-08T19:25:05.146 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.146 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.147 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:05.147 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.542259+0000", 2021-10-08T19:25:05.147 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0024311609999999998 2021-10-08T19:25:05.147 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.147 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.148 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:25:05.148 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.542305+0000", 2021-10-08T19:25:05.148 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6096e-05 2021-10-08T19:25:05.148 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.148 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.149 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:25:05.149 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.542344+0000", 2021-10-08T19:25:05.149 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8368999999999998e-05 2021-10-08T19:25:05.149 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:05.149 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:05.150 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:05.150 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.150 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.150 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:40770 7.3 7:cdb74326:::benchmark_data_smithi097_93198_object40769:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2021-10-08T19:25:05.150 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:16.432290+0000", 2021-10-08T19:25:05.151 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 48.557182701999999, 2021-10-08T19:25:05.151 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.112272416, 2021-10-08T19:25:05.151 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:25:05.151 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:05.152 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:25:05.152 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:25:05.152 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:25:05.152 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 40770 2021-10-08T19:25:05.152 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.153 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:25:05.153 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.153 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:25:05.153 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.432290+0000", 2021-10-08T19:25:05.153 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:25:05.154 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.154 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.154 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:25:05.154 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.432290+0000", 2021-10-08T19:25:05.154 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:25:05.155 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.155 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.155 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:25:05.155 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.432289+0000", 2021-10-08T19:25:05.155 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:25:05.156 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.156 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.156 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:25:05.156 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.432311+0000", 2021-10-08T19:25:05.156 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2183000000000001e-05 2021-10-08T19:25:05.157 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.157 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.157 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:25:05.157 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.432318+0000", 2021-10-08T19:25:05.158 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3459999999999996e-06 2021-10-08T19:25:05.158 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.158 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.158 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:25:05.159 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.432322+0000", 2021-10-08T19:25:05.159 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2509999999999996e-06 2021-10-08T19:25:05.159 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.159 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.159 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:25:05.160 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.538114+0000", 2021-10-08T19:25:05.160 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.10579114100000001 2021-10-08T19:25:05.160 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.160 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.161 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:25:05.161 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.538249+0000", 2021-10-08T19:25:05.161 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000135442 2021-10-08T19:25:05.161 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.161 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.162 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2,4", 2021-10-08T19:25:05.162 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.538401+0000", 2021-10-08T19:25:05.162 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000151755 2021-10-08T19:25:05.162 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.163 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.163 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:25:05.163 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.540134+0000", 2021-10-08T19:25:05.163 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001733503 2021-10-08T19:25:05.163 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.164 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.164 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:05.164 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.540314+0000", 2021-10-08T19:25:05.164 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017943000000000001 2021-10-08T19:25:05.164 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.165 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.165 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:05.165 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.544480+0000", 2021-10-08T19:25:05.165 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0041658329999999999 2021-10-08T19:25:05.165 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.166 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.166 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:25:05.166 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.544528+0000", 2021-10-08T19:25:05.166 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8229999999999997e-05 2021-10-08T19:25:05.166 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.167 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.167 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:25:05.167 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.544562+0000", 2021-10-08T19:25:05.167 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4174999999999997e-05 2021-10-08T19:25:05.167 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:05.168 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:05.168 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:05.168 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.168 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.168 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:40773 7.c 7:356de8d3:::benchmark_data_smithi097_93198_object40772:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2021-10-08T19:25:05.169 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:16.432327+0000", 2021-10-08T19:25:05.169 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 48.557145540999997, 2021-10-08T19:25:05.169 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.10744812500000001, 2021-10-08T19:25:05.169 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:25:05.170 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:05.170 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:25:05.170 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:25:05.170 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:25:05.170 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 40773 2021-10-08T19:25:05.171 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.171 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:25:05.171 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.171 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:25:05.171 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.432327+0000", 2021-10-08T19:25:05.172 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:25:05.172 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.172 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.172 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:25:05.172 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.432327+0000", 2021-10-08T19:25:05.173 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:25:05.173 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.173 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.173 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:25:05.173 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.432326+0000", 2021-10-08T19:25:05.174 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2021-10-08T19:25:05.174 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.174 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.174 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:25:05.174 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.432341+0000", 2021-10-08T19:25:05.175 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4793e-05 2021-10-08T19:25:05.175 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.175 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.175 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:25:05.176 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.432345+0000", 2021-10-08T19:25:05.176 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6569999999999999e-06 2021-10-08T19:25:05.176 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.176 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.176 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:25:05.177 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.432348+0000", 2021-10-08T19:25:05.177 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5470000000000001e-06 2021-10-08T19:25:05.177 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.177 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.177 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:25:05.178 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.432385+0000", 2021-10-08T19:25:05.178 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7061999999999999e-05 2021-10-08T19:25:05.178 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.178 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.178 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:25:05.179 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.432503+0000", 2021-10-08T19:25:05.179 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011728800000000001 2021-10-08T19:25:05.179 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.179 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.179 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2,7", 2021-10-08T19:25:05.180 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.534676+0000", 2021-10-08T19:25:05.180 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.10217361799999999 2021-10-08T19:25:05.180 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.180 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.180 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:05.181 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.539406+0000", 2021-10-08T19:25:05.181 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0047297190000000003 2021-10-08T19:25:05.181 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.181 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.182 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:25:05.182 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.539548+0000", 2021-10-08T19:25:05.182 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014249600000000001 2021-10-08T19:25:05.182 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.182 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.183 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:05.183 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.539690+0000", 2021-10-08T19:25:05.183 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014205000000000001 2021-10-08T19:25:05.183 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.183 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.184 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:25:05.184 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.539739+0000", 2021-10-08T19:25:05.184 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8618000000000001e-05 2021-10-08T19:25:05.184 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.184 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.185 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:25:05.185 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.539775+0000", 2021-10-08T19:25:05.185 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5781000000000002e-05 2021-10-08T19:25:05.185 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:05.186 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:05.186 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:05.186 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.186 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.186 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.24796.0:40766 7.1 e110/94 7:85f5c7b7:::benchmark_data_smithi097_93198_object40765:head v 110'2516, mlcod=110'2514)", 2021-10-08T19:25:05.187 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:16.432573+0000", 2021-10-08T19:25:05.187 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 48.556899647000002, 2021-10-08T19:25:05.187 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.106873315, 2021-10-08T19:25:05.187 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:25:05.187 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:05.188 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:25:05.188 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.188 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:25:05.188 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.432573+0000", 2021-10-08T19:25:05.188 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:25:05.189 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.189 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.189 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:25:05.189 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.432573+0000", 2021-10-08T19:25:05.190 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:25:05.190 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.190 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.190 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:25:05.190 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.432571+0000", 2021-10-08T19:25:05.191 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2021-10-08T19:25:05.191 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.191 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.191 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:25:05.191 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.432654+0000", 2021-10-08T19:25:05.192 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2791000000000001e-05 2021-10-08T19:25:05.192 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.192 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.192 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:25:05.193 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.536217+0000", 2021-10-08T19:25:05.193 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.103562555 2021-10-08T19:25:05.193 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.193 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.193 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:25:05.194 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.536225+0000", 2021-10-08T19:25:05.194 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5920000000000001e-06 2021-10-08T19:25:05.194 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.194 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.194 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:25:05.195 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.536294+0000", 2021-10-08T19:25:05.195 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9008000000000001e-05 2021-10-08T19:25:05.195 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.195 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.196 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:25:05.196 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.536314+0000", 2021-10-08T19:25:05.196 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0100000000000001e-05 2021-10-08T19:25:05.196 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.196 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.197 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:25:05.197 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.539416+0000", 2021-10-08T19:25:05.197 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031019950000000002 2021-10-08T19:25:05.197 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.197 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.198 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:25:05.198 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.539446+0000", 2021-10-08T19:25:05.198 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9577000000000002e-05 2021-10-08T19:25:05.198 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:05.199 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:05.199 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:05.199 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.199 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.199 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.24796.0:40768 7.0 e110/94 7:0fd3788f:::benchmark_data_smithi097_93198_object40767:head v 110'2508, mlcod=110'2506)", 2021-10-08T19:25:05.200 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:16.432695+0000", 2021-10-08T19:25:05.200 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 48.556777730999997, 2021-10-08T19:25:05.200 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.10673136699999999, 2021-10-08T19:25:05.200 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:25:05.201 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:05.201 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:25:05.201 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.201 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:25:05.201 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.432695+0000", 2021-10-08T19:25:05.202 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:25:05.202 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.202 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.202 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:25:05.203 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.432695+0000", 2021-10-08T19:25:05.203 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:25:05.203 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.203 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.203 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:25:05.204 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.432693+0000", 2021-10-08T19:25:05.204 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2021-10-08T19:25:05.204 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.204 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.204 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:25:05.205 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.432786+0000", 2021-10-08T19:25:05.205 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2397000000000003e-05 2021-10-08T19:25:05.205 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.205 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.206 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:25:05.206 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.535391+0000", 2021-10-08T19:25:05.206 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.10260485499999999 2021-10-08T19:25:05.206 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.206 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.207 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:25:05.207 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.535400+0000", 2021-10-08T19:25:05.207 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.1300000000000007e-06 2021-10-08T19:25:05.207 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.207 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.208 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:25:05.208 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.536158+0000", 2021-10-08T19:25:05.208 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00075829800000000002 2021-10-08T19:25:05.208 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.209 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.209 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:25:05.209 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.536182+0000", 2021-10-08T19:25:05.209 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.402e-05 2021-10-08T19:25:05.209 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.210 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.210 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:25:05.210 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.539391+0000", 2021-10-08T19:25:05.210 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032094160000000001 2021-10-08T19:25:05.210 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.211 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.211 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:25:05.211 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.539426+0000", 2021-10-08T19:25:05.211 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4468000000000003e-05 2021-10-08T19:25:05.212 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:05.212 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:05.212 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:05.212 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.212 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.213 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.24796.0:40777 7.d e110/94 7:bfff1840:::benchmark_data_smithi097_93198_object40776:head v 110'2570, mlcod=110'2567)", 2021-10-08T19:25:05.213 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:16.434885+0000", 2021-10-08T19:25:05.213 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 48.554587263000002, 2021-10-08T19:25:05.213 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.105241843, 2021-10-08T19:25:05.213 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:25:05.214 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:05.214 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:25:05.214 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.214 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:25:05.215 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.434885+0000", 2021-10-08T19:25:05.215 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:25:05.215 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.215 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.215 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:25:05.216 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.434885+0000", 2021-10-08T19:25:05.216 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:25:05.216 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.216 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.216 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:25:05.217 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.434883+0000", 2021-10-08T19:25:05.217 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:25:05.217 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.217 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.217 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:25:05.218 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.434906+0000", 2021-10-08T19:25:05.218 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.321e-05 2021-10-08T19:25:05.218 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.218 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.218 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:25:05.219 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.536297+0000", 2021-10-08T19:25:05.219 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.101390148 2021-10-08T19:25:05.219 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.219 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.219 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:25:05.220 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.536303+0000", 2021-10-08T19:25:05.220 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8680000000000001e-06 2021-10-08T19:25:05.220 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.220 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.221 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:25:05.221 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.537947+0000", 2021-10-08T19:25:05.221 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001643376 2021-10-08T19:25:05.221 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.221 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.222 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:25:05.222 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.537964+0000", 2021-10-08T19:25:05.222 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7499999999999998e-05 2021-10-08T19:25:05.222 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.222 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.223 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:25:05.223 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.540108+0000", 2021-10-08T19:25:05.223 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021433619999999998 2021-10-08T19:25:05.223 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.223 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.224 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:25:05.224 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.540127+0000", 2021-10-08T19:25:05.224 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9179999999999999e-05 2021-10-08T19:25:05.224 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:05.224 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:05.225 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:05.225 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.225 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.225 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:55475 7.2 7:47750e74:::benchmark_data_smithi097_93198_object55474:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118)", 2021-10-08T19:25:05.225 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:34.300867+0000", 2021-10-08T19:25:05.226 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 30.688605592000002, 2021-10-08T19:25:05.226 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.11263094999999999, 2021-10-08T19:25:05.226 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:25:05.226 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:05.226 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:25:05.227 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:25:05.227 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:25:05.227 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 55475 2021-10-08T19:25:05.227 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.228 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:25:05.228 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.228 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:25:05.228 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.300867+0000", 2021-10-08T19:25:05.228 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:25:05.229 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.229 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.229 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:25:05.229 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.300867+0000", 2021-10-08T19:25:05.229 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:25:05.230 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.230 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.230 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:25:05.230 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.300863+0000", 2021-10-08T19:25:05.230 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999967 2021-10-08T19:25:05.231 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.231 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.231 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:25:05.231 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.300897+0000", 2021-10-08T19:25:05.231 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3479999999999998e-05 2021-10-08T19:25:05.232 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.232 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.232 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:25:05.232 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.300912+0000", 2021-10-08T19:25:05.232 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5418999999999999e-05 2021-10-08T19:25:05.233 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.233 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.233 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:25:05.233 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.300921+0000", 2021-10-08T19:25:05.233 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2859999999999999e-06 2021-10-08T19:25:05.234 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.234 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.234 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:25:05.234 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.310167+0000", 2021-10-08T19:25:05.235 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0092465280000000004 2021-10-08T19:25:05.235 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.235 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.235 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:25:05.235 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.310290+0000", 2021-10-08T19:25:05.236 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012294399999999999 2021-10-08T19:25:05.236 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.236 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.236 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,2", 2021-10-08T19:25:05.236 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.310434+0000", 2021-10-08T19:25:05.237 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000143528 2021-10-08T19:25:05.237 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.237 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.237 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:25:05.237 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.320299+0000", 2021-10-08T19:25:05.238 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0098656939999999995 2021-10-08T19:25:05.238 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.238 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.238 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:05.238 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.321625+0000", 2021-10-08T19:25:05.239 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00132606 2021-10-08T19:25:05.239 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.239 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.239 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:05.239 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.413401+0000", 2021-10-08T19:25:05.240 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.091775445999999997 2021-10-08T19:25:05.240 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.240 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.240 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:25:05.240 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.413456+0000", 2021-10-08T19:25:05.241 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5345e-05 2021-10-08T19:25:05.241 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.241 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.241 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:25:05.242 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.413498+0000", 2021-10-08T19:25:05.242 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1508999999999998e-05 2021-10-08T19:25:05.242 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:05.242 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:05.242 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:05.243 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.243 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.243 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:55487 7.a 7:57ccfcf4:::benchmark_data_smithi097_93198_object55486:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118)", 2021-10-08T19:25:05.243 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:34.314268+0000", 2021-10-08T19:25:05.243 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 30.675204486999998, 2021-10-08T19:25:05.244 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.099229832000000004, 2021-10-08T19:25:05.244 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:25:05.244 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:05.244 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:25:05.244 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:25:05.245 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:25:05.245 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 55487 2021-10-08T19:25:05.245 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.245 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:25:05.245 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.246 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:25:05.246 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.314268+0000", 2021-10-08T19:25:05.246 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:25:05.246 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.247 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.247 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:25:05.247 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.314268+0000", 2021-10-08T19:25:05.247 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:25:05.247 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.248 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.248 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:25:05.248 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.314264+0000", 2021-10-08T19:25:05.248 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999962 2021-10-08T19:25:05.248 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.249 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.249 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:25:05.249 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.314296+0000", 2021-10-08T19:25:05.249 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2060999999999997e-05 2021-10-08T19:25:05.249 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.250 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.250 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:25:05.250 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.314311+0000", 2021-10-08T19:25:05.250 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5014000000000001e-05 2021-10-08T19:25:05.251 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.251 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.251 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:25:05.251 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.314319+0000", 2021-10-08T19:25:05.251 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.96e-06 2021-10-08T19:25:05.252 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.252 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.252 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:25:05.252 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.314477+0000", 2021-10-08T19:25:05.252 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000157746 2021-10-08T19:25:05.253 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.253 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.253 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:25:05.253 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.314629+0000", 2021-10-08T19:25:05.253 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015205700000000001 2021-10-08T19:25:05.254 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.254 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.254 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2,5", 2021-10-08T19:25:05.254 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.314791+0000", 2021-10-08T19:25:05.255 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000162411 2021-10-08T19:25:05.255 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.255 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.255 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:25:05.255 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.319958+0000", 2021-10-08T19:25:05.256 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0051670070000000004 2021-10-08T19:25:05.256 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.256 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.256 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:05.256 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.322386+0000", 2021-10-08T19:25:05.257 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0024279879999999998 2021-10-08T19:25:05.257 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.257 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.257 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:05.258 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.413420+0000", 2021-10-08T19:25:05.258 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.091033481999999999 2021-10-08T19:25:05.258 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.258 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.258 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:25:05.259 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.413463+0000", 2021-10-08T19:25:05.259 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2735999999999999e-05 2021-10-08T19:25:05.259 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.259 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.259 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:25:05.260 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.413498+0000", 2021-10-08T19:25:05.260 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4983e-05 2021-10-08T19:25:05.260 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:05.260 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:05.260 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:05.261 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.261 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.261 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:55489 7.2 7:4381fffa:::benchmark_data_smithi097_93198_object55488:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118)", 2021-10-08T19:25:05.261 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:34.316972+0000", 2021-10-08T19:25:05.261 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 30.672499828999999, 2021-10-08T19:25:05.262 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.096753429000000002, 2021-10-08T19:25:05.262 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:25:05.262 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:05.262 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:25:05.263 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:25:05.263 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:25:05.263 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 55489 2021-10-08T19:25:05.263 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.263 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:25:05.264 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.264 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:25:05.264 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.316972+0000", 2021-10-08T19:25:05.264 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:25:05.264 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.265 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.265 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:25:05.265 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.316972+0000", 2021-10-08T19:25:05.265 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:25:05.265 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.266 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.266 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:25:05.266 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.316972+0000", 2021-10-08T19:25:05.266 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:25:05.266 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.267 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.267 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:25:05.267 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.316995+0000", 2021-10-08T19:25:05.267 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3478000000000001e-05 2021-10-08T19:25:05.267 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.268 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.268 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:25:05.268 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.317002+0000", 2021-10-08T19:25:05.268 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6529999999999997e-06 2021-10-08T19:25:05.268 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.269 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.269 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:25:05.269 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.317006+0000", 2021-10-08T19:25:05.269 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5940000000000004e-06 2021-10-08T19:25:05.270 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.270 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.270 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:25:05.270 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.317764+0000", 2021-10-08T19:25:05.270 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00075715899999999998 2021-10-08T19:25:05.271 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.271 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.271 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:25:05.271 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.317882+0000", 2021-10-08T19:25:05.271 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000118513 2021-10-08T19:25:05.272 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.272 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.272 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,2", 2021-10-08T19:25:05.272 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.318033+0000", 2021-10-08T19:25:05.272 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000151309 2021-10-08T19:25:05.273 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.273 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.273 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:25:05.273 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.320307+0000", 2021-10-08T19:25:05.274 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002273733 2021-10-08T19:25:05.274 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.274 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.274 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:05.274 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.324131+0000", 2021-10-08T19:25:05.275 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003823637 2021-10-08T19:25:05.275 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.275 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.275 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:05.275 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.413656+0000", 2021-10-08T19:25:05.276 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.08952483 2021-10-08T19:25:05.276 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.276 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.276 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:25:05.276 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.413694+0000", 2021-10-08T19:25:05.277 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8210000000000002e-05 2021-10-08T19:25:05.277 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.277 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.277 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:25:05.278 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.413726+0000", 2021-10-08T19:25:05.278 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2101999999999999e-05 2021-10-08T19:25:05.278 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:05.278 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:05.278 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:05.279 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.279 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.279 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:55952 7.2 7:4d358d02:::benchmark_data_smithi097_93198_object55951:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118)", 2021-10-08T19:25:05.279 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:34.879120+0000", 2021-10-08T19:25:05.279 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 30.110351759, 2021-10-08T19:25:05.280 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.100350356, 2021-10-08T19:25:05.280 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:25:05.280 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:05.280 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:25:05.281 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:25:05.281 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:25:05.281 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 55952 2021-10-08T19:25:05.281 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.281 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:25:05.282 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.282 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:25:05.282 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.879120+0000", 2021-10-08T19:25:05.282 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:25:05.282 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.283 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.283 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:25:05.283 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.879120+0000", 2021-10-08T19:25:05.283 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:25:05.283 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.284 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.284 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:25:05.284 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.879118+0000", 2021-10-08T19:25:05.284 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:25:05.285 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.285 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.285 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:25:05.285 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.879147+0000", 2021-10-08T19:25:05.285 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9091e-05 2021-10-08T19:25:05.286 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.286 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.286 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:25:05.286 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.879160+0000", 2021-10-08T19:25:05.286 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3054000000000001e-05 2021-10-08T19:25:05.287 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.287 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.287 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:25:05.287 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.879167+0000", 2021-10-08T19:25:05.287 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.939e-06 2021-10-08T19:25:05.288 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.288 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.288 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:25:05.288 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.879319+0000", 2021-10-08T19:25:05.288 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000151459 2021-10-08T19:25:05.289 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.289 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.289 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:25:05.289 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.879457+0000", 2021-10-08T19:25:05.289 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013845200000000001 2021-10-08T19:25:05.290 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.290 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.290 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,2", 2021-10-08T19:25:05.290 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.879596+0000", 2021-10-08T19:25:05.291 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013879100000000001 2021-10-08T19:25:05.291 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.291 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.291 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:25:05.291 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.883650+0000", 2021-10-08T19:25:05.292 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0040541500000000003 2021-10-08T19:25:05.292 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.292 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.292 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:05.292 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.896535+0000", 2021-10-08T19:25:05.293 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012884473 2021-10-08T19:25:05.293 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.293 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.293 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:05.293 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.979373+0000", 2021-10-08T19:25:05.294 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.082838117000000003 2021-10-08T19:25:05.294 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.294 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.294 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:25:05.294 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.979431+0000", 2021-10-08T19:25:05.295 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8038999999999998e-05 2021-10-08T19:25:05.295 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.295 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.295 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:25:05.295 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.979471+0000", 2021-10-08T19:25:05.296 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9987000000000002e-05 2021-10-08T19:25:05.296 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:05.296 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:05.296 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:05.296 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.297 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.297 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:55953 7.2 7:4176c565:::benchmark_data_smithi097_93198_object55952:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118)", 2021-10-08T19:25:05.297 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:34.879186+0000", 2021-10-08T19:25:05.297 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 30.110286693999999, 2021-10-08T19:25:05.298 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.10059685, 2021-10-08T19:25:05.298 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:25:05.298 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:05.298 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:25:05.298 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:25:05.299 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:25:05.299 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 55953 2021-10-08T19:25:05.299 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.299 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:25:05.299 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.300 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:25:05.300 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.879186+0000", 2021-10-08T19:25:05.300 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:25:05.300 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.301 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.301 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:25:05.301 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.879186+0000", 2021-10-08T19:25:05.301 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:25:05.301 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.302 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.302 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:25:05.302 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.879185+0000", 2021-10-08T19:25:05.302 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:25:05.302 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.303 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.303 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:25:05.303 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.879221+0000", 2021-10-08T19:25:05.303 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5848e-05 2021-10-08T19:25:05.304 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.304 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.304 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:25:05.304 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.879227+0000", 2021-10-08T19:25:05.304 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9789999999999996e-06 2021-10-08T19:25:05.305 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.305 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.305 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:25:05.305 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.879233+0000", 2021-10-08T19:25:05.305 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2530000000000004e-06 2021-10-08T19:25:05.306 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.306 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.306 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:25:05.306 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.881511+0000", 2021-10-08T19:25:05.306 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0022786490000000002 2021-10-08T19:25:05.307 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.307 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.307 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:25:05.307 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.881654+0000", 2021-10-08T19:25:05.307 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014262500000000001 2021-10-08T19:25:05.308 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.308 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.308 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,2", 2021-10-08T19:25:05.308 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.881789+0000", 2021-10-08T19:25:05.308 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013525700000000001 2021-10-08T19:25:05.309 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.309 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.309 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:25:05.309 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.896542+0000", 2021-10-08T19:25:05.309 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.014752235000000001 2021-10-08T19:25:05.310 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.310 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.310 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:05.310 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.896612+0000", 2021-10-08T19:25:05.311 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0418000000000002e-05 2021-10-08T19:25:05.311 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.311 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.311 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:05.311 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.979634+0000", 2021-10-08T19:25:05.312 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.083022504999999996 2021-10-08T19:25:05.312 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.312 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.312 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:25:05.312 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.979747+0000", 2021-10-08T19:25:05.313 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000112921 2021-10-08T19:25:05.313 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.313 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.313 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:25:05.313 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.979782+0000", 2021-10-08T19:25:05.314 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5048000000000001e-05 2021-10-08T19:25:05.314 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:05.314 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:05.314 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:05.314 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.315 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.315 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:55955 7.a 7:508296bd:::benchmark_data_smithi097_93198_object55954:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118)", 2021-10-08T19:25:05.315 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:34.879238+0000", 2021-10-08T19:25:05.315 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 30.110234314, 2021-10-08T19:25:05.315 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.100348929, 2021-10-08T19:25:05.316 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:25:05.316 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:05.316 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:25:05.316 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:25:05.317 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:25:05.317 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 55955 2021-10-08T19:25:05.317 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.317 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:25:05.317 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.318 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:25:05.318 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.879238+0000", 2021-10-08T19:25:05.318 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:25:05.318 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.318 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.319 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:25:05.319 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.879238+0000", 2021-10-08T19:25:05.319 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:25:05.319 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.319 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.320 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:25:05.320 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:25:05.321 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.879237+0000", 2021-10-08T19:25:05.321 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:25:05.321 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.322 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.322 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:25:05.322 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.879269+0000", 2021-10-08T19:25:05.322 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1338999999999999e-05 2021-10-08T19:25:05.322 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.323 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.323 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:25:05.323 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.879276+0000", 2021-10-08T19:25:05.323 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2490000000000004e-06 2021-10-08T19:25:05.324 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.324 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.324 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:25:05.324 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.879280+0000", 2021-10-08T19:25:05.324 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6140000000000002e-06 2021-10-08T19:25:05.325 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.325 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.325 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:25:05.325 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.883703+0000", 2021-10-08T19:25:05.325 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0044230729999999996 2021-10-08T19:25:05.326 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.326 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.326 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:25:05.326 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.883820+0000", 2021-10-08T19:25:05.326 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011687400000000001 2021-10-08T19:25:05.327 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.327 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.327 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2,5", 2021-10-08T19:25:05.327 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.883958+0000", 2021-10-08T19:25:05.327 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013775300000000001 2021-10-08T19:25:05.328 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.328 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.328 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:05.328 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.896513+0000", 2021-10-08T19:25:05.329 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012554513 2021-10-08T19:25:05.329 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.329 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.329 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:25:05.329 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.896547+0000", 2021-10-08T19:25:05.330 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4415000000000002e-05 2021-10-08T19:25:05.330 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.330 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.330 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:05.330 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.979509+0000", 2021-10-08T19:25:05.331 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.082962219000000004 2021-10-08T19:25:05.331 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.331 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.331 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:25:05.332 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.979552+0000", 2021-10-08T19:25:05.332 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2928e-05 2021-10-08T19:25:05.332 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:05.332 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:05.332 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:25:05.333 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:34.979587+0000", 2021-10-08T19:25:05.333 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.468e-05 2021-10-08T19:25:05.333 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:05.333 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:05.333 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:05.334 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:05.334 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:05.334 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:25:05.334 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:05.335 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:25:05.336 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 72 16 79140 79124 68.6282 37.125 0.0075586 0.0145659 2021-10-08T19:25:05.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:05 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:25:05.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:05 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:25:05.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:05 smithi117 ceph-mon[34585]: 172.21.15.117 - - [08/Oct/2021:19:25:04] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:05.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:05 smithi117 ceph-mon[34585]: pgmap v159: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 1 active+recovery_wait+degraded, 152 active+clean; 4.8 GiB data, 15 GiB used, 701 GiB / 715 GiB avail; 1022 B/s rd, 45 MiB/s wr, 717 op/s; 6119/234345 objects degraded (2.611%); 7884/234345 objects misplaced (3.364%); 2.2 MiB/s, 34 objects/s recovering 2021-10-08T19:25:05.410 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set noscrub 2021-10-08T19:25:05.437 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:25:05.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:05 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:25:05.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:05 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:25:05.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:05 smithi097 ceph-mon[41966]: 172.21.15.117 - - [08/Oct/2021:19:25:04] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:05.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:05 smithi097 ceph-mon[41966]: pgmap v159: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 1 active+recovery_wait+degraded, 152 active+clean; 4.8 GiB data, 15 GiB used, 701 GiB / 715 GiB avail; 1022 B/s rd, 45 MiB/s wr, 717 op/s; 6119/234345 objects degraded (2.611%); 7884/234345 objects misplaced (3.364%); 2.2 MiB/s, 34 objects/s recovering 2021-10-08T19:25:05.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:05 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:25:05.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:05 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:25:05.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:05 smithi097 ceph-mon[32687]: 172.21.15.117 - - [08/Oct/2021:19:25:04] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:05.474 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:05 smithi097 ceph-mon[32687]: pgmap v159: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 1 active+recovery_wait+degraded, 152 active+clean; 4.8 GiB data, 15 GiB used, 701 GiB / 715 GiB avail; 1022 B/s rd, 45 MiB/s wr, 717 op/s; 6119/234345 objects degraded (2.611%); 7884/234345 objects misplaced (3.364%); 2.2 MiB/s, 34 objects/s recovering 2021-10-08T19:25:05.517 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:05.842 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:25:05.860 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:25:05.866 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:05.867 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:25:05.874 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:25:05.925 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:25:05.968 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:25:05.973 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:25:06.013 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:25:06.030 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:06.047 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:25:06.084 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:25:06.088 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:25:06.124 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:25:06.141 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2021-10-08T19:25:06.142 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'false' 2021-10-08T19:25:06.143 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'false' 2021-10-08T19:25:06.143 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'false' 2021-10-08T19:25:06.143 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'false' 2021-10-08T19:25:06.143 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'false' 2021-10-08T19:25:06.144 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'false' 2021-10-08T19:25:06.144 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'false' 2021-10-08T19:25:06.144 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'false' 2021-10-08T19:25:06.172 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:25:06.178 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:06.179 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:25:06.280 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:25:06.294 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 73 16 79781 79765 68.2371 40.0625 0.0164531 0.0146507 2021-10-08T19:25:06.348 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:06.405 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:25:06 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:25:06.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:06 smithi117 ceph-mon[34585]: Health check update: Degraded data redundancy: 6119/234345 objects degraded (2.611%), 3 pgs degraded (PG_DEGRADED) 2021-10-08T19:25:06.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:06 smithi117 ceph-mon[34585]: osdmap e129: 8 total, 8 up, 8 in 2021-10-08T19:25:06.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:06 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2362788847' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:25:06.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:06 smithi097 ceph-mon[41966]: Health check update: Degraded data redundancy: 6119/234345 objects degraded (2.611%), 3 pgs degraded (PG_DEGRADED) 2021-10-08T19:25:06.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:06 smithi097 ceph-mon[41966]: osdmap e129: 8 total, 8 up, 8 in 2021-10-08T19:25:06.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:06 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2362788847' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:25:06.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:06 smithi097 ceph-mon[32687]: Health check update: Degraded data redundancy: 6119/234345 objects degraded (2.611%), 3 pgs degraded (PG_DEGRADED) 2021-10-08T19:25:06.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:06 smithi097 ceph-mon[32687]: osdmap e129: 8 total, 8 up, 8 in 2021-10-08T19:25:06.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:06 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2362788847' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:25:06.506 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:25:06.949 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:25:06.966 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:06.967 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:25:07.068 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:25:07.137 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:07.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:07 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:25:07.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:07 smithi117 ceph-mon[34585]: pgmap v161: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 1 active+recovery_wait+degraded, 152 active+clean; 4.8 GiB data, 15 GiB used, 701 GiB / 715 GiB avail; 639 B/s rd, 51 MiB/s wr, 812 op/s; 6119/234345 objects degraded (2.611%); 7884/234345 objects misplaced (3.364%); 2.3 MiB/s, 36 objects/s recovering 2021-10-08T19:25:07.179 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:25:07.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:07 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:25:07.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:07 smithi097 ceph-mon[32687]: pgmap v161: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 1 active+recovery_wait+degraded, 152 active+clean; 4.8 GiB data, 15 GiB used, 701 GiB / 715 GiB avail; 639 B/s rd, 51 MiB/s wr, 812 op/s; 6119/234345 objects degraded (2.611%); 7884/234345 objects misplaced (3.364%); 2.3 MiB/s, 36 objects/s recovering 2021-10-08T19:25:07.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:07 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:25:07.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:07 smithi097 ceph-mon[41966]: pgmap v161: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 1 active+recovery_wait+degraded, 152 active+clean; 4.8 GiB data, 15 GiB used, 701 GiB / 715 GiB avail; 639 B/s rd, 51 MiB/s wr, 812 op/s; 6119/234345 objects degraded (2.611%); 7884/234345 objects misplaced (3.364%); 2.3 MiB/s, 36 objects/s recovering 2021-10-08T19:25:07.253 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:25:07.271 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:07.272 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:25:07.288 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 74 16 80510 80494 67.9302 45.5625 0.0449595 0.0147151 2021-10-08T19:25:07.374 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:25:07.455 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:07.568 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:25:07.573 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:07.575 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:25:07.676 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:25:07.708 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:07.765 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:25:07.770 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:07.771 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:25:07.872 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:25:07.906 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:07.959 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:25:07.961 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:07.962 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:25:08.063 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:25:08.126 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:08.288 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 75 16 81171 81155 67.5755 41.3125 0.0137983 0.0147925 2021-10-08T19:25:08.900 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:25:08.906 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:08.907 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:25:09.008 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:25:09.061 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2021-10-08T19:25:09.073 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:09.288 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 76 16 81952 81936 67.3288 48.8125 0.0244111 0.0148467 2021-10-08T19:25:09.292 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2021-10-08T19:25:09.292 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:25:09.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:09 smithi117 ceph-mon[34585]: pgmap v162: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 1 active+recovery_wait+degraded, 152 active+clean; 4.8 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 32 MiB/s wr, 520 op/s; 6119/236157 objects degraded (2.591%); 7826/236157 objects misplaced (3.314%); 1.8 MiB/s, 28 objects/s recovering 2021-10-08T19:25:09.668 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:25:09.678 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:09.679 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:25:09.780 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:25:09.845 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:09 smithi097 ceph-mon[32687]: pgmap v162: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 1 active+recovery_wait+degraded, 152 active+clean; 4.8 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 32 MiB/s wr, 520 op/s; 6119/236157 objects degraded (2.591%); 7826/236157 objects misplaced (3.314%); 1.8 MiB/s, 28 objects/s recovering 2021-10-08T19:25:09.845 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:09 smithi097 ceph-mon[41966]: pgmap v162: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 1 active+recovery_wait+degraded, 152 active+clean; 4.8 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 32 MiB/s wr, 520 op/s; 6119/236157 objects degraded (2.591%); 7826/236157 objects misplaced (3.314%); 1.8 MiB/s, 28 objects/s recovering 2021-10-08T19:25:09.852 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:09.893 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:25:10.111 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:25:10.122 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:10.122 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:25:10.214 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2021-10-08T19:25:10.224 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:25:10.289 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 77 16 82608 82592 66.9864 41 0.0121427 0.0149194 2021-10-08T19:25:10.302 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:10.533 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:25:10.539 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:10.540 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:25:10.561 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:25:10.640 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:25:10.713 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:10.841 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:25:10.850 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:10.851 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:25:10.952 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:25:10.989 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:11.059 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:25:11.062 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:11.063 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:25:11.164 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:25:11.233 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:11.289 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 78 16 83188 83172 66.5926 36.25 0.03445 0.0150114 2021-10-08T19:25:11.347 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:25:11.356 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:11.357 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:25:11.457 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:25:11.479 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:11 smithi097 ceph-mon[32687]: Health check update: Degraded data redundancy: 6119/236157 objects degraded (2.591%), 3 pgs degraded (PG_DEGRADED) 2021-10-08T19:25:11.479 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:11 smithi097 ceph-mon[32687]: pgmap v163: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 1 active+recovery_wait+degraded, 152 active+clean; 5.0 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.1 KiB/s rd, 49 MiB/s wr, 787 op/s; 6119/244611 objects degraded (2.502%); 7709/244611 objects misplaced (3.152%); 2.5 MiB/s, 39 objects/s recovering 2021-10-08T19:25:11.480 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:11 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2079829127' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:25:11.480 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:11 smithi097 ceph-mon[32687]: from='client.24877 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:25:11.480 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:11 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/4015475414' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "iscsi", "var": "pg_num", "val": "23"}]: dispatch 2021-10-08T19:25:11.480 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:11 smithi097 ceph-mon[32687]: from='client.34889 ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "iscsi", "var": "pg_num", "val": "23"}]: dispatch 2021-10-08T19:25:11.487 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:11.502 INFO:teuthology.orchestra.run.smithi097.stderr:set pool 3 pg_num to 23 2021-10-08T19:25:11.520 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is set 2021-10-08T19:25:11.612 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:25:11.613 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:11 smithi117 ceph-mon[34585]: Health check update: Degraded data redundancy: 6119/236157 objects degraded (2.591%), 3 pgs degraded (PG_DEGRADED) 2021-10-08T19:25:11.613 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:11 smithi117 ceph-mon[34585]: pgmap v163: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 1 active+recovery_wait+degraded, 152 active+clean; 5.0 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.1 KiB/s rd, 49 MiB/s wr, 787 op/s; 6119/244611 objects degraded (2.502%); 7709/244611 objects misplaced (3.152%); 2.5 MiB/s, 39 objects/s recovering 2021-10-08T19:25:11.614 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:11 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2079829127' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:25:11.614 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:11 smithi117 ceph-mon[34585]: from='client.24877 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:25:11.614 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:11 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/4015475414' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "iscsi", "var": "pg_num", "val": "23"}]: dispatch 2021-10-08T19:25:11.614 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:11 smithi117 ceph-mon[34585]: from='client.34889 ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "iscsi", "var": "pg_num", "val": "23"}]: dispatch 2021-10-08T19:25:11.615 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:11.616 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:25:11.717 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:25:11.773 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:11 smithi097 ceph-mon[41966]: Health check update: Degraded data redundancy: 6119/236157 objects degraded (2.591%), 3 pgs degraded (PG_DEGRADED) 2021-10-08T19:25:11.773 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:11 smithi097 ceph-mon[41966]: pgmap v163: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 1 active+recovery_wait+degraded, 152 active+clean; 5.0 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.1 KiB/s rd, 49 MiB/s wr, 787 op/s; 6119/244611 objects degraded (2.502%); 7709/244611 objects misplaced (3.152%); 2.5 MiB/s, 39 objects/s recovering 2021-10-08T19:25:11.773 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:11 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2079829127' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:25:11.774 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:11 smithi097 ceph-mon[41966]: from='client.24877 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:25:11.774 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:11 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/4015475414' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "iscsi", "var": "pg_num", "val": "23"}]: dispatch 2021-10-08T19:25:11.774 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:11 smithi097 ceph-mon[41966]: from='client.34889 ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "iscsi", "var": "pg_num", "val": "23"}]: dispatch 2021-10-08T19:25:11.788 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:12.289 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 79 16 83946 83930 66.3494 47.375 0.0161476 0.0150662 2021-10-08T19:25:12.750 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2021-10-08T19:25:12.751 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:25:12.778 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:12 smithi117 ceph-mon[34585]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:25:12.778 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:12 smithi117 ceph-mon[34585]: from='client.24877 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:25:12.778 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:12 smithi117 ceph-mon[34585]: from='client.34889 ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "iscsi", "var": "pg_num", "val": "23"}]': finished 2021-10-08T19:25:12.778 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:12 smithi117 ceph-mon[34585]: osdmap e130: 8 total, 8 up, 8 in 2021-10-08T19:25:12.970 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:25:12 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:25:12] "GET /metrics HTTP/1.1" 200 155712 "" "Prometheus/2.18.1" 2021-10-08T19:25:12.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:12 smithi097 ceph-mon[41966]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:25:12.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:12 smithi097 ceph-mon[41966]: from='client.24877 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:25:12.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:12 smithi097 ceph-mon[41966]: from='client.34889 ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "iscsi", "var": "pg_num", "val": "23"}]': finished 2021-10-08T19:25:12.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:12 smithi097 ceph-mon[41966]: osdmap e130: 8 total, 8 up, 8 in 2021-10-08T19:25:12.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:12 smithi097 ceph-mon[32687]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:25:12.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:12 smithi097 ceph-mon[32687]: from='client.24877 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:25:12.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:12 smithi097 ceph-mon[32687]: from='client.34889 ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "iscsi", "var": "pg_num", "val": "23"}]': finished 2021-10-08T19:25:12.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:12 smithi097 ceph-mon[32687]: osdmap e130: 8 total, 8 up, 8 in 2021-10-08T19:25:13.289 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:2021-10-08T19:25:13.289382+0000 min lat: 0.00115885 max lat: 2.88554 avg lat: 0.0151362 2021-10-08T19:25:13.289 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2021-10-08T19:25:13.289 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 80 16 84616 84600 66.0436 41.875 0.0290599 0.0151362 2021-10-08T19:25:13.588 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:25:13.592 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:13.594 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:25:13.606 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2021-10-08T19:25:13.694 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:25:13.746 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:13 smithi097 ceph-mon[32687]: pgmap v165: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 1 active+recovery_wait+degraded, 152 active+clean; 5.0 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 639 B/s rd, 27 MiB/s wr, 428 op/s; 6119/244611 objects degraded (2.502%); 7709/244611 objects misplaced (3.152%); 1.4 MiB/s, 21 objects/s recovering 2021-10-08T19:25:13.746 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:13 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "iscsi", "var": "pg_num_actual", "val": "23"}]: dispatch 2021-10-08T19:25:13.747 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:13 smithi097 ceph-mon[41966]: pgmap v165: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 1 active+recovery_wait+degraded, 152 active+clean; 5.0 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 639 B/s rd, 27 MiB/s wr, 428 op/s; 6119/244611 objects degraded (2.502%); 7709/244611 objects misplaced (3.152%); 1.4 MiB/s, 21 objects/s recovering 2021-10-08T19:25:13.747 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:13 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "iscsi", "var": "pg_num_actual", "val": "23"}]: dispatch 2021-10-08T19:25:13.781 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:13.876 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:13 smithi117 ceph-mon[34585]: pgmap v165: 158 pgs: 1 active+recovering+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering+undersized+remapped, 1 active+recovery_wait+degraded, 152 active+clean; 5.0 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 639 B/s rd, 27 MiB/s wr, 428 op/s; 6119/244611 objects degraded (2.502%); 7709/244611 objects misplaced (3.152%); 1.4 MiB/s, 21 objects/s recovering 2021-10-08T19:25:13.877 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:13 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "iscsi", "var": "pg_num_actual", "val": "23"}]: dispatch 2021-10-08T19:25:13.877 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:25:13 smithi117 conmon[69189]: level=error ts=2021-10-08T19:25:13.505Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=1 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:25:13.977 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:25:14.044 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:25:14.048 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:14.049 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:25:14.150 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:25:14.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:25:13 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:25:13] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:25:14.224 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:14.297 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 81 16 85290 85274 65.7472 42.125 0.0156415 0.0152039 2021-10-08T19:25:14.365 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:25:14.422 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:25:14.457 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:25:14.458 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:25:14.465 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:14.466 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:25:14.501 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:25:14.558 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:25:14.567 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:25:14.600 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:25:14.636 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:25:14.662 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:14.679 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:25:14.691 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true' 2021-10-08T19:25:14.691 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true' 2021-10-08T19:25:14.691 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true' 2021-10-08T19:25:14.692 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true' 2021-10-08T19:25:14.692 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true' 2021-10-08T19:25:14.692 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true' 2021-10-08T19:25:14.692 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'true' 2021-10-08T19:25:14.692 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'true' 2021-10-08T19:25:14.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:14 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "iscsi", "var": "pg_num_actual", "val": "23"}]': finished 2021-10-08T19:25:14.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:14 smithi097 ceph-mon[32687]: osdmap e131: 8 total, 8 up, 8 in 2021-10-08T19:25:14.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:14 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/4198981764' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:25:14.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:14 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "iscsi", "var": "pgp_num_actual", "val": "23"}]: dispatch 2021-10-08T19:25:14.722 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:25:14 smithi097 conmon[33110]: 172.21.15.97 - - [08/Oct/2021:19:25:14] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:14.726 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:14 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "iscsi", "var": "pg_num_actual", "val": "23"}]': finished 2021-10-08T19:25:14.726 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:14 smithi097 ceph-mon[41966]: osdmap e131: 8 total, 8 up, 8 in 2021-10-08T19:25:14.726 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:14 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/4198981764' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:25:14.727 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:14 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "iscsi", "var": "pgp_num_actual", "val": "23"}]: dispatch 2021-10-08T19:25:14.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:14 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "iscsi", "var": "pg_num_actual", "val": "23"}]': finished 2021-10-08T19:25:14.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:14 smithi117 ceph-mon[34585]: osdmap e131: 8 total, 8 up, 8 in 2021-10-08T19:25:14.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:14 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/4198981764' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:25:14.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:14 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "iscsi", "var": "pgp_num_actual", "val": "23"}]: dispatch 2021-10-08T19:25:14.907 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:25:14.909 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:14.910 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:25:15.011 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:25:15.073 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:15.164 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:25:15.175 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:15.176 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:25:15.277 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:25:15.292 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 82 16 86032 86016 65.5095 46.375 0.00883227 0.0152603 2021-10-08T19:25:15.321 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:15.369 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:25:15.371 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:15.372 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:25:15.473 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:25:15.521 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:15.640 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:25:15.644 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:15.645 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:25:15.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:15 smithi097 ceph-mon[41966]: pgmap v167: 168 pgs: 4 peering, 148 active+clean, 2 active+recovering+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 1 active+recovery_wait+degraded, 10 unknown; 5.2 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 54 MiB/s wr, 857 op/s; 6119/254946 objects degraded (2.400%); 7535/254946 objects misplaced (2.956%); 2.7 MiB/s, 43 objects/s recovering 2021-10-08T19:25:15.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:15 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "iscsi", "var": "pgp_num_actual", "val": "23"}]': finished 2021-10-08T19:25:15.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:15 smithi097 ceph-mon[41966]: osdmap e132: 8 total, 8 up, 8 in 2021-10-08T19:25:15.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:15 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:25:15.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:15 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:25:15.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:15 smithi097 ceph-mon[41966]: 172.21.15.97 - - [08/Oct/2021:19:25:14] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:15.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:15 smithi097 ceph-mon[41966]: Health check update: Degraded data redundancy: 6119/254946 objects degraded (2.400%), 3 pgs degraded (PG_DEGRADED) 2021-10-08T19:25:15.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:15 smithi097 ceph-mon[41966]: osdmap e133: 8 total, 8 up, 8 in 2021-10-08T19:25:15.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:15 smithi097 ceph-mon[32687]: pgmap v167: 168 pgs: 4 peering, 148 active+clean, 2 active+recovering+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 1 active+recovery_wait+degraded, 10 unknown; 5.2 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 54 MiB/s wr, 857 op/s; 6119/254946 objects degraded (2.400%); 7535/254946 objects misplaced (2.956%); 2.7 MiB/s, 43 objects/s recovering 2021-10-08T19:25:15.724 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:15 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "iscsi", "var": "pgp_num_actual", "val": "23"}]': finished 2021-10-08T19:25:15.724 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:15 smithi097 ceph-mon[32687]: osdmap e132: 8 total, 8 up, 8 in 2021-10-08T19:25:15.724 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:15 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:25:15.724 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:15 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:25:15.725 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:15 smithi097 ceph-mon[32687]: 172.21.15.97 - - [08/Oct/2021:19:25:14] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:15.725 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:15 smithi097 ceph-mon[32687]: Health check update: Degraded data redundancy: 6119/254946 objects degraded (2.400%), 3 pgs degraded (PG_DEGRADED) 2021-10-08T19:25:15.725 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:15 smithi097 ceph-mon[32687]: osdmap e133: 8 total, 8 up, 8 in 2021-10-08T19:25:15.746 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:25:15.771 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:15 smithi117 ceph-mon[34585]: pgmap v167: 168 pgs: 4 peering, 148 active+clean, 2 active+recovering+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 1 active+recovery_wait+degraded, 10 unknown; 5.2 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 54 MiB/s wr, 857 op/s; 6119/254946 objects degraded (2.400%); 7535/254946 objects misplaced (2.956%); 2.7 MiB/s, 43 objects/s recovering 2021-10-08T19:25:15.772 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:15 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "iscsi", "var": "pgp_num_actual", "val": "23"}]': finished 2021-10-08T19:25:15.772 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:15 smithi117 ceph-mon[34585]: osdmap e132: 8 total, 8 up, 8 in 2021-10-08T19:25:15.772 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:15 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:25:15.773 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:15 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:25:15.773 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:15 smithi117 ceph-mon[34585]: 172.21.15.97 - - [08/Oct/2021:19:25:14] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:15.773 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:15 smithi117 ceph-mon[34585]: Health check update: Degraded data redundancy: 6119/254946 objects degraded (2.400%), 3 pgs degraded (PG_DEGRADED) 2021-10-08T19:25:15.773 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:15 smithi117 ceph-mon[34585]: osdmap e133: 8 total, 8 up, 8 in 2021-10-08T19:25:15.776 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set nodeep-scrub 2021-10-08T19:25:15.779 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:15.941 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:25:15.948 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:15.948 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:25:16.050 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:25:16.113 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:16.204 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:25:16.207 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:25:16.208 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2021-10-08T19:25:16.208 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2021-10-08T19:25:16.208 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2021-10-08T19:25:16.208 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.209 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:31351 7.1 7:803eed4f:::benchmark_data_smithi097_93198_object31350:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2021-10-08T19:25:16.209 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:24:09.085708+0000", 2021-10-08T19:25:16.209 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 67.118291083000003, 2021-10-08T19:25:16.209 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.091722185999999997, 2021-10-08T19:25:16.209 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:25:16.210 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:16.210 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:25:16.210 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:25:16.210 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:25:16.211 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 31351 2021-10-08T19:25:16.211 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.211 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:25:16.211 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.211 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:25:16.212 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.085708+0000", 2021-10-08T19:25:16.212 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:16.212 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.212 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.213 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:25:16.213 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.085708+0000", 2021-10-08T19:25:16.213 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:16.213 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.213 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.214 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:25:16.214 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.085707+0000", 2021-10-08T19:25:16.214 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:25:16.214 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.215 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.215 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:25:16.215 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.085797+0000", 2021-10-08T19:25:16.215 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0183e-05 2021-10-08T19:25:16.215 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.216 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.216 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:25:16.216 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.085807+0000", 2021-10-08T19:25:16.216 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0045e-05 2021-10-08T19:25:16.217 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.217 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.217 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:25:16.217 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.085811+0000", 2021-10-08T19:25:16.217 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.3490000000000002e-06 2021-10-08T19:25:16.218 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.218 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.218 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:25:16.218 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.085853+0000", 2021-10-08T19:25:16.218 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1343e-05 2021-10-08T19:25:16.219 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.219 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.219 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:25:16.219 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.085997+0000", 2021-10-08T19:25:16.220 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014453900000000001 2021-10-08T19:25:16.220 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.220 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.220 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 1,3", 2021-10-08T19:25:16.220 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.086159+0000", 2021-10-08T19:25:16.221 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016215399999999999 2021-10-08T19:25:16.221 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.221 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.221 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:25:16.222 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.087414+0000", 2021-10-08T19:25:16.222 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001254551 2021-10-08T19:25:16.222 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.222 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.223 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:16.223 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.087568+0000", 2021-10-08T19:25:16.223 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015427099999999999 2021-10-08T19:25:16.223 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.224 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.224 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:16.224 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.177346+0000", 2021-10-08T19:25:16.224 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.089778122000000002 2021-10-08T19:25:16.225 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.225 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.225 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:25:16.225 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.177383+0000", 2021-10-08T19:25:16.226 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6227999999999999e-05 2021-10-08T19:25:16.226 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.226 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.226 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:25:16.227 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.177431+0000", 2021-10-08T19:25:16.227 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7889999999999997e-05 2021-10-08T19:25:16.227 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:16.227 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:25:16.227 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:16.228 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.228 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.229 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:32139 7.1 7:8e4329a1:::benchmark_data_smithi097_93198_object32138:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2021-10-08T19:25:16.229 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:24:09.661725+0000", 2021-10-08T19:25:16.229 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 66.542274328999994, 2021-10-08T19:25:16.229 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.096579021000000001, 2021-10-08T19:25:16.229 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:25:16.230 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:16.230 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:25:16.230 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:25:16.230 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:25:16.230 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 32139 2021-10-08T19:25:16.231 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.231 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:25:16.231 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.231 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:25:16.232 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.661725+0000", 2021-10-08T19:25:16.232 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:16.232 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.232 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.232 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:25:16.233 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.661725+0000", 2021-10-08T19:25:16.233 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:16.233 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.233 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.234 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:25:16.234 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.661724+0000", 2021-10-08T19:25:16.234 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:25:16.234 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.235 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.235 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:25:16.235 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.661781+0000", 2021-10-08T19:25:16.235 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7639000000000002e-05 2021-10-08T19:25:16.235 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.236 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.236 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:25:16.236 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.661792+0000", 2021-10-08T19:25:16.236 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0529e-05 2021-10-08T19:25:16.237 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.237 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.237 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:25:16.237 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.661797+0000", 2021-10-08T19:25:16.237 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9579999999999998e-06 2021-10-08T19:25:16.238 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.238 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.238 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:25:16.238 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.661839+0000", 2021-10-08T19:25:16.239 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2072e-05 2021-10-08T19:25:16.239 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.239 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.239 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:25:16.239 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.661939+0000", 2021-10-08T19:25:16.240 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000100263 2021-10-08T19:25:16.240 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.240 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.240 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 1,3", 2021-10-08T19:25:16.240 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.662039+0000", 2021-10-08T19:25:16.241 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9848999999999999e-05 2021-10-08T19:25:16.241 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.241 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.241 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:25:16.242 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.662967+0000", 2021-10-08T19:25:16.242 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00092829499999999999 2021-10-08T19:25:16.242 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.242 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.243 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:16.243 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.664733+0000", 2021-10-08T19:25:16.243 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001765656 2021-10-08T19:25:16.243 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.243 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.244 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:16.244 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.758236+0000", 2021-10-08T19:25:16.244 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.093502627000000005 2021-10-08T19:25:16.244 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.244 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.245 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:25:16.245 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.758279+0000", 2021-10-08T19:25:16.245 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2907000000000001e-05 2021-10-08T19:25:16.245 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.245 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.246 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:25:16.246 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.758304+0000", 2021-10-08T19:25:16.246 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.561e-05 2021-10-08T19:25:16.246 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:16.247 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:25:16.247 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:16.247 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.247 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.248 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:35716 7.1 7:8e2c561f:::benchmark_data_smithi097_93198_object35715:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106)", 2021-10-08T19:25:16.248 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:24:12.268638+0000", 2021-10-08T19:25:16.248 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 63.935361217999997, 2021-10-08T19:25:16.248 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.13454338800000001, 2021-10-08T19:25:16.248 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:25:16.249 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:16.249 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:25:16.249 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:25:16.249 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:25:16.249 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 35716 2021-10-08T19:25:16.250 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.250 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:25:16.250 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.250 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:25:16.251 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:12.268638+0000", 2021-10-08T19:25:16.251 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:16.251 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.251 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.251 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:25:16.252 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:12.268638+0000", 2021-10-08T19:25:16.252 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:16.252 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.252 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.253 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:25:16.253 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:12.268636+0000", 2021-10-08T19:25:16.253 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:25:16.253 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.253 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.254 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:25:16.254 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:12.268687+0000", 2021-10-08T19:25:16.254 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0484e-05 2021-10-08T19:25:16.254 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.255 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.255 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:25:16.255 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:12.268699+0000", 2021-10-08T19:25:16.255 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1719000000000001e-05 2021-10-08T19:25:16.255 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.256 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.256 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:25:16.256 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:12.268704+0000", 2021-10-08T19:25:16.256 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4639999999999997e-06 2021-10-08T19:25:16.257 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.257 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.257 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:25:16.257 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:12.268743+0000", 2021-10-08T19:25:16.257 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8729000000000001e-05 2021-10-08T19:25:16.258 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.258 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.258 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:25:16.258 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:12.268836+0000", 2021-10-08T19:25:16.259 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3214999999999994e-05 2021-10-08T19:25:16.259 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.259 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.259 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 1,3", 2021-10-08T19:25:16.260 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:12.268934+0000", 2021-10-08T19:25:16.260 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7851999999999998e-05 2021-10-08T19:25:16.260 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.260 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.260 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:25:16.260 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:12.269968+0000", 2021-10-08T19:25:16.261 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001034407 2021-10-08T19:25:16.261 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.261 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.261 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:16.261 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:12.270351+0000", 2021-10-08T19:25:16.262 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00038286899999999998 2021-10-08T19:25:16.262 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.262 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.262 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:16.263 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:12.403088+0000", 2021-10-08T19:25:16.263 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.132736671 2021-10-08T19:25:16.263 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.263 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.263 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:25:16.264 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:12.403144+0000", 2021-10-08T19:25:16.264 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5810999999999998e-05 2021-10-08T19:25:16.264 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.264 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.264 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:25:16.265 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:12.403182+0000", 2021-10-08T19:25:16.265 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8037999999999997e-05 2021-10-08T19:25:16.265 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:16.265 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:25:16.265 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:16.266 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.266 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.266 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:40766 7.1 7:85f5c7b7:::benchmark_data_smithi097_93198_object40765:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2021-10-08T19:25:16.266 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:24:16.432171+0000", 2021-10-08T19:25:16.267 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 59.771828653, 2021-10-08T19:25:16.267 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.107571416, 2021-10-08T19:25:16.267 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:25:16.267 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:16.267 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:25:16.268 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:25:16.268 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:25:16.268 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 40766 2021-10-08T19:25:16.268 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.268 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:25:16.269 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.269 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:25:16.269 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.432171+0000", 2021-10-08T19:25:16.269 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:16.270 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.270 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.270 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:25:16.270 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.432171+0000", 2021-10-08T19:25:16.271 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:16.271 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.271 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.271 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:25:16.271 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.432169+0000", 2021-10-08T19:25:16.272 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:25:16.272 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.272 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.272 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:25:16.272 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.432266+0000", 2021-10-08T19:25:16.273 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7022999999999996e-05 2021-10-08T19:25:16.273 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.273 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.273 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:25:16.273 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.432282+0000", 2021-10-08T19:25:16.274 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5789000000000001e-05 2021-10-08T19:25:16.274 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.274 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.274 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:25:16.274 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.432287+0000", 2021-10-08T19:25:16.275 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2900000000000002e-06 2021-10-08T19:25:16.275 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.275 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.275 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:25:16.276 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.432337+0000", 2021-10-08T19:25:16.276 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9429999999999999e-05 2021-10-08T19:25:16.276 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.276 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.276 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:25:16.277 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.432443+0000", 2021-10-08T19:25:16.277 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010613200000000001 2021-10-08T19:25:16.277 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.277 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.278 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 1,3", 2021-10-08T19:25:16.278 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.432546+0000", 2021-10-08T19:25:16.278 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000102989 2021-10-08T19:25:16.278 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.278 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.279 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:25:16.279 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.434341+0000", 2021-10-08T19:25:16.279 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001795622 2021-10-08T19:25:16.279 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.280 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.280 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:16.280 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.434898+0000", 2021-10-08T19:25:16.280 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000556925 2021-10-08T19:25:16.281 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.281 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.281 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:16.281 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.539661+0000", 2021-10-08T19:25:16.282 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.104763155 2021-10-08T19:25:16.282 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.282 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.282 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:25:16.282 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.539701+0000", 2021-10-08T19:25:16.283 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9249000000000003e-05 2021-10-08T19:25:16.283 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.283 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.283 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:25:16.284 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.539742+0000", 2021-10-08T19:25:16.284 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1561999999999999e-05 2021-10-08T19:25:16.284 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:16.284 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:25:16.285 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:16.285 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.285 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.285 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:52411 7.1 7:86acd6d8:::benchmark_data_smithi097_93198_object52410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117)", 2021-10-08T19:25:16.286 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:24:30.672134+0000", 2021-10-08T19:25:16.286 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 45.531864962999997, 2021-10-08T19:25:16.286 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.088977871, 2021-10-08T19:25:16.286 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:25:16.286 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:16.287 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:25:16.287 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:25:16.287 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:25:16.287 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 52411 2021-10-08T19:25:16.288 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.288 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:25:16.288 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.288 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:25:16.289 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.672134+0000", 2021-10-08T19:25:16.289 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:16.289 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.289 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.289 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:25:16.290 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.672134+0000", 2021-10-08T19:25:16.290 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:16.290 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.290 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.291 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:25:16.291 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.672132+0000", 2021-10-08T19:25:16.291 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:25:16.291 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.292 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.292 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:25:16.292 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.672185+0000", 2021-10-08T19:25:16.292 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.3332999999999999e-05 2021-10-08T19:25:16.293 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.293 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.293 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:25:16.293 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.672200+0000", 2021-10-08T19:25:16.294 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4072e-05 2021-10-08T19:25:16.294 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.294 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.294 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:25:16.294 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.672206+0000", 2021-10-08T19:25:16.295 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.993e-06 2021-10-08T19:25:16.295 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.295 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.295 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:25:16.296 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.672249+0000", 2021-10-08T19:25:16.296 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.3961000000000001e-05 2021-10-08T19:25:16.296 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.296 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.296 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:25:16.297 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.672379+0000", 2021-10-08T19:25:16.297 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012968999999999999 2021-10-08T19:25:16.297 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.297 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.298 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 3,6", 2021-10-08T19:25:16.298 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.672589+0000", 2021-10-08T19:25:16.298 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000210022 2021-10-08T19:25:16.298 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.298 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.299 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:25:16.299 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.674241+0000", 2021-10-08T19:25:16.299 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0016521929999999999 2021-10-08T19:25:16.299 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.300 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.300 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:16.300 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.676005+0000", 2021-10-08T19:25:16.300 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001763545 2021-10-08T19:25:16.301 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.301 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.301 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:16.301 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.759409+0000", 2021-10-08T19:25:16.302 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.083404108000000005 2021-10-08T19:25:16.302 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.302 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.302 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:25:16.303 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.759455+0000", 2021-10-08T19:25:16.303 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.6254000000000001e-05 2021-10-08T19:25:16.303 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.303 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.304 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:25:16.304 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.761112+0000", 2021-10-08T19:25:16.304 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001657057 2021-10-08T19:25:16.304 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:16.304 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:25:16.305 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:16.305 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.305 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.305 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:52419 7.1 7:848c6779:::benchmark_data_smithi097_93198_object52418:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117)", 2021-10-08T19:25:16.306 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:24:30.709329+0000", 2021-10-08T19:25:16.306 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 45.494670151999998, 2021-10-08T19:25:16.306 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.05963309, 2021-10-08T19:25:16.306 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:25:16.306 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:16.307 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:25:16.307 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:25:16.307 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:25:16.307 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 52419 2021-10-08T19:25:16.308 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.308 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:25:16.308 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.308 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:25:16.309 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.709329+0000", 2021-10-08T19:25:16.309 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:16.309 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.309 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.309 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:25:16.310 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.709329+0000", 2021-10-08T19:25:16.310 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:16.310 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.310 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.310 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:25:16.311 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.709327+0000", 2021-10-08T19:25:16.311 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:25:16.311 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.311 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.311 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:25:16.312 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.709418+0000", 2021-10-08T19:25:16.312 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.1230000000000006e-05 2021-10-08T19:25:16.312 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.312 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.313 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:25:16.313 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.709434+0000", 2021-10-08T19:25:16.313 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6337999999999998e-05 2021-10-08T19:25:16.313 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.313 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.314 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:25:16.314 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.709442+0000", 2021-10-08T19:25:16.314 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.328e-06 2021-10-08T19:25:16.314 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.315 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.315 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:25:16.315 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.709514+0000", 2021-10-08T19:25:16.315 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2323999999999994e-05 2021-10-08T19:25:16.316 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.316 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.316 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:25:16.316 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.709699+0000", 2021-10-08T19:25:16.316 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000185071 2021-10-08T19:25:16.317 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.317 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.317 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 3,6", 2021-10-08T19:25:16.317 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.709894+0000", 2021-10-08T19:25:16.318 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00019467099999999999 2021-10-08T19:25:16.318 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.318 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.318 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:25:16.319 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.713218+0000", 2021-10-08T19:25:16.319 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0033239810000000002 2021-10-08T19:25:16.319 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.319 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.319 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:16.320 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.716560+0000", 2021-10-08T19:25:16.320 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0033420170000000001 2021-10-08T19:25:16.320 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.320 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.321 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:16.321 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.766704+0000", 2021-10-08T19:25:16.321 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.050144301000000002 2021-10-08T19:25:16.321 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.321 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.322 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:25:16.322 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.766786+0000", 2021-10-08T19:25:16.322 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2350999999999998e-05 2021-10-08T19:25:16.322 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.323 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.323 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:25:16.323 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.768962+0000", 2021-10-08T19:25:16.323 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021760899999999999 2021-10-08T19:25:16.324 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:16.324 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:25:16.324 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:16.324 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.324 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.325 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:52420 7.1 7:8d084038:::benchmark_data_smithi097_93198_object52419:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117)", 2021-10-08T19:25:16.325 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:24:30.709460+0000", 2021-10-08T19:25:16.325 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 45.494539709000001, 2021-10-08T19:25:16.325 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.061038909000000002, 2021-10-08T19:25:16.326 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:25:16.326 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:16.326 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:25:16.326 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:25:16.327 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:25:16.327 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 52420 2021-10-08T19:25:16.327 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.327 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:25:16.328 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.328 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:25:16.328 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.709460+0000", 2021-10-08T19:25:16.328 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:16.328 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.329 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.329 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:25:16.329 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.709460+0000", 2021-10-08T19:25:16.329 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:16.330 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.330 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.330 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:25:16.330 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.709459+0000", 2021-10-08T19:25:16.330 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:25:16.331 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.331 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.331 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:25:16.331 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.709570+0000", 2021-10-08T19:25:16.332 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000110921 2021-10-08T19:25:16.332 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.332 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.332 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:25:16.332 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.709581+0000", 2021-10-08T19:25:16.333 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1551e-05 2021-10-08T19:25:16.333 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.333 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.333 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:25:16.334 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.709587+0000", 2021-10-08T19:25:16.334 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5600000000000001e-06 2021-10-08T19:25:16.334 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.334 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.334 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:25:16.335 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.711505+0000", 2021-10-08T19:25:16.335 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001918454 2021-10-08T19:25:16.335 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.335 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.336 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:25:16.336 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.711674+0000", 2021-10-08T19:25:16.336 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000168994 2021-10-08T19:25:16.336 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.336 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.337 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 3,6", 2021-10-08T19:25:16.337 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.711826+0000", 2021-10-08T19:25:16.337 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015145299999999999 2021-10-08T19:25:16.337 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.338 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.338 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:25:16.338 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.713395+0000", 2021-10-08T19:25:16.338 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0015696359999999999 2021-10-08T19:25:16.338 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.339 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.339 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:16.339 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.716610+0000", 2021-10-08T19:25:16.339 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032142949999999998 2021-10-08T19:25:16.339 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.340 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.340 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:16.340 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.769030+0000", 2021-10-08T19:25:16.340 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.052420210000000002 2021-10-08T19:25:16.341 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.341 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.341 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:25:16.341 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.769075+0000", 2021-10-08T19:25:16.341 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5226999999999999e-05 2021-10-08T19:25:16.342 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.342 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.342 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:25:16.342 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.770499+0000", 2021-10-08T19:25:16.343 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001423648 2021-10-08T19:25:16.343 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:16.343 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:25:16.343 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:16.343 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.344 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.344 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:71231 7.1 7:883875db:::benchmark_data_smithi097_93198_object71230:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127)", 2021-10-08T19:25:16.344 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:24:54.183402+0000", 2021-10-08T19:25:16.344 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 22.020597012, 2021-10-08T19:25:16.345 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.036752478999999998, 2021-10-08T19:25:16.345 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:25:16.345 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:16.345 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:25:16.345 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:25:16.346 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:25:16.346 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 71231 2021-10-08T19:25:16.346 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.346 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:25:16.347 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.347 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:25:16.347 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:54.183402+0000", 2021-10-08T19:25:16.347 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:16.348 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.348 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.348 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:25:16.348 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:54.183402+0000", 2021-10-08T19:25:16.348 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:16.349 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.349 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.349 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:25:16.349 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:54.183399+0000", 2021-10-08T19:25:16.350 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999971 2021-10-08T19:25:16.350 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.350 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.350 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:25:16.351 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:54.183443+0000", 2021-10-08T19:25:16.351 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.3767000000000003e-05 2021-10-08T19:25:16.351 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.351 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.351 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:25:16.352 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:54.183454+0000", 2021-10-08T19:25:16.352 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1127e-05 2021-10-08T19:25:16.352 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.352 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.353 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:25:16.353 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:54.183468+0000", 2021-10-08T19:25:16.353 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3344e-05 2021-10-08T19:25:16.353 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.353 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.354 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:25:16.354 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:54.183710+0000", 2021-10-08T19:25:16.354 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000241945 2021-10-08T19:25:16.354 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.355 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.355 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:25:16.355 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:54.183913+0000", 2021-10-08T19:25:16.355 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00020372200000000001 2021-10-08T19:25:16.356 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.356 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.356 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 3,6", 2021-10-08T19:25:16.356 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:54.184124+0000", 2021-10-08T19:25:16.356 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000210779 2021-10-08T19:25:16.357 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.357 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.357 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:16.357 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:54.193530+0000", 2021-10-08T19:25:16.358 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094056179999999993 2021-10-08T19:25:16.358 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.358 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.358 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:25:16.359 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:54.194618+0000", 2021-10-08T19:25:16.359 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001088089 2021-10-08T19:25:16.359 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.359 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.359 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:16.360 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:54.218178+0000", 2021-10-08T19:25:16.360 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.023560096999999999 2021-10-08T19:25:16.360 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.360 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.360 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:25:16.361 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:54.218236+0000", 2021-10-08T19:25:16.361 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7587000000000003e-05 2021-10-08T19:25:16.361 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.361 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.362 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:25:16.362 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:54.220155+0000", 2021-10-08T19:25:16.362 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001919399 2021-10-08T19:25:16.362 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:16.363 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:25:16.363 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:16.363 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.363 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.363 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:71634 7.1 7:8f347c55:::benchmark_data_smithi097_93198_object71633:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127)", 2021-10-08T19:25:16.364 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:24:54.656561+0000", 2021-10-08T19:25:16.364 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 21.547438391, 2021-10-08T19:25:16.364 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.06794617, 2021-10-08T19:25:16.364 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:25:16.365 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:16.365 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:25:16.365 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:25:16.365 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:25:16.365 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 71634 2021-10-08T19:25:16.366 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.366 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:25:16.366 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.366 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:25:16.366 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:54.656561+0000", 2021-10-08T19:25:16.367 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:16.367 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.367 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.367 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:25:16.368 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:54.656561+0000", 2021-10-08T19:25:16.368 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:16.368 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.368 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.368 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:25:16.369 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:54.656559+0000", 2021-10-08T19:25:16.369 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:25:16.369 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.369 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.370 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:25:16.370 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:54.656604+0000", 2021-10-08T19:25:16.370 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5615000000000003e-05 2021-10-08T19:25:16.370 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.370 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.371 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:25:16.371 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:54.656616+0000", 2021-10-08T19:25:16.371 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2184999999999999e-05 2021-10-08T19:25:16.371 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.371 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.372 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:25:16.372 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:54.656622+0000", 2021-10-08T19:25:16.372 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1869999999999996e-06 2021-10-08T19:25:16.372 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.372 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.373 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:25:16.373 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:54.656679+0000", 2021-10-08T19:25:16.373 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7794000000000003e-05 2021-10-08T19:25:16.373 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.373 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.374 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:25:16.374 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:54.656838+0000", 2021-10-08T19:25:16.374 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000158317 2021-10-08T19:25:16.374 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.375 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.375 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 3,6", 2021-10-08T19:25:16.375 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:54.657058+0000", 2021-10-08T19:25:16.375 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000219955 2021-10-08T19:25:16.375 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.376 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.376 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:25:16.376 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:54.661134+0000", 2021-10-08T19:25:16.377 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0040760659999999997 2021-10-08T19:25:16.377 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.377 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.377 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:16.377 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:54.663292+0000", 2021-10-08T19:25:16.378 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021580150000000001 2021-10-08T19:25:16.378 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.378 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.378 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:16.379 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:54.722578+0000", 2021-10-08T19:25:16.379 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.059286679000000002 2021-10-08T19:25:16.379 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.379 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.379 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:25:16.380 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:54.722647+0000", 2021-10-08T19:25:16.380 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8853e-05 2021-10-08T19:25:16.380 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.380 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.381 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:25:16.381 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:54.724507+0000", 2021-10-08T19:25:16.381 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018599420000000001 2021-10-08T19:25:16.381 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:16.381 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:25:16.382 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:16.382 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.382 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.382 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:71967 7.1 7:840164b1:::benchmark_data_smithi097_93198_object71966:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127)", 2021-10-08T19:25:16.383 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:24:55.093376+0000", 2021-10-08T19:25:16.383 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 21.110623421, 2021-10-08T19:25:16.383 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.033471863999999997, 2021-10-08T19:25:16.383 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:25:16.383 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:16.384 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:25:16.384 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:25:16.384 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:25:16.384 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 71967 2021-10-08T19:25:16.384 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.385 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:25:16.385 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.385 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:25:16.385 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:55.093376+0000", 2021-10-08T19:25:16.386 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:16.386 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.386 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.386 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:25:16.387 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:55.093376+0000", 2021-10-08T19:25:16.387 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:16.387 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.387 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.387 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:25:16.388 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:55.093374+0000", 2021-10-08T19:25:16.388 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:25:16.388 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.388 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.389 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:25:16.389 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:55.093425+0000", 2021-10-08T19:25:16.389 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1563000000000001e-05 2021-10-08T19:25:16.389 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.389 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.390 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:25:16.390 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:55.093437+0000", 2021-10-08T19:25:16.390 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1861999999999999e-05 2021-10-08T19:25:16.390 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.391 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.391 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:25:16.391 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:55.093442+0000", 2021-10-08T19:25:16.391 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0440000000000003e-06 2021-10-08T19:25:16.391 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.392 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.392 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:25:16.392 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:55.093497+0000", 2021-10-08T19:25:16.392 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5458000000000003e-05 2021-10-08T19:25:16.392 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.393 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.393 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:25:16.393 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:55.093626+0000", 2021-10-08T19:25:16.393 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000128768 2021-10-08T19:25:16.393 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.394 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.394 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 3,6", 2021-10-08T19:25:16.394 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:55.093762+0000", 2021-10-08T19:25:16.394 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000135983 2021-10-08T19:25:16.395 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.395 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.395 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:25:16.395 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:55.095861+0000", 2021-10-08T19:25:16.395 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020986770000000002 2021-10-08T19:25:16.396 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.396 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.396 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:16.396 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:55.097958+0000", 2021-10-08T19:25:16.397 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020968279999999998 2021-10-08T19:25:16.397 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.397 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.397 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:16.397 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:55.125441+0000", 2021-10-08T19:25:16.398 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.027483225 2021-10-08T19:25:16.398 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.398 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.398 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:25:16.399 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:55.125490+0000", 2021-10-08T19:25:16.399 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9277000000000003e-05 2021-10-08T19:25:16.399 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.399 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.399 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:25:16.400 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:55.126848+0000", 2021-10-08T19:25:16.400 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013576339999999999 2021-10-08T19:25:16.400 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:16.400 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:25:16.400 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:16.401 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.401 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.401 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:72777 7.1 7:86587383:::benchmark_data_smithi097_93198_object72776:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127)", 2021-10-08T19:25:16.401 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:24:56.353416+0000", 2021-10-08T19:25:16.402 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 19.850583685, 2021-10-08T19:25:16.402 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.035518223000000002, 2021-10-08T19:25:16.402 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:25:16.402 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:16.402 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:25:16.403 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:25:16.403 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:25:16.403 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 72777 2021-10-08T19:25:16.403 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.404 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:25:16.404 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.404 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:25:16.404 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:56.353416+0000", 2021-10-08T19:25:16.404 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:16.405 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.405 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.405 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:25:16.405 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:56.353416+0000", 2021-10-08T19:25:16.405 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:16.406 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.406 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.406 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:25:16.406 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:56.353413+0000", 2021-10-08T19:25:16.407 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:25:16.407 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.407 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.407 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:25:16.407 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:56.353449+0000", 2021-10-08T19:25:16.408 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.5099999999999999e-05 2021-10-08T19:25:16.408 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.408 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.408 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:25:16.408 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:56.353475+0000", 2021-10-08T19:25:16.409 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6168000000000001e-05 2021-10-08T19:25:16.409 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.409 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.409 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:25:16.410 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:56.353481+0000", 2021-10-08T19:25:16.410 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7100000000000001e-06 2021-10-08T19:25:16.410 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.410 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.410 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:25:16.411 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:56.353535+0000", 2021-10-08T19:25:16.411 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.3752000000000003e-05 2021-10-08T19:25:16.411 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.411 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.412 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:25:16.412 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:56.353715+0000", 2021-10-08T19:25:16.412 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017980399999999999 2021-10-08T19:25:16.412 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.412 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.413 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 3,6", 2021-10-08T19:25:16.413 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:56.353916+0000", 2021-10-08T19:25:16.413 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00020067699999999999 2021-10-08T19:25:16.413 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.413 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.414 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:25:16.414 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:56.360583+0000", 2021-10-08T19:25:16.414 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0066676160000000003 2021-10-08T19:25:16.414 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.415 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.415 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:16.415 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:56.360668+0000", 2021-10-08T19:25:16.415 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5229999999999995e-05 2021-10-08T19:25:16.416 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.416 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.416 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:16.416 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:56.387403+0000", 2021-10-08T19:25:16.416 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026734520000000001 2021-10-08T19:25:16.417 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.417 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.417 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:25:16.417 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:56.387481+0000", 2021-10-08T19:25:16.417 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.7638000000000004e-05 2021-10-08T19:25:16.418 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.418 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.418 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:25:16.418 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:56.388934+0000", 2021-10-08T19:25:16.419 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00145334 2021-10-08T19:25:16.419 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:16.419 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:25:16.419 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:16.420 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.420 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.420 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:73529 7.1 7:856549c3:::benchmark_data_smithi097_93198_object73528:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127)", 2021-10-08T19:25:16.420 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:24:57.413515+0000", 2021-10-08T19:25:16.420 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 18.790484269, 2021-10-08T19:25:16.421 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.034574787000000003, 2021-10-08T19:25:16.421 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:25:16.421 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:16.421 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:25:16.422 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:25:16.422 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:25:16.422 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 73529 2021-10-08T19:25:16.422 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.422 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:25:16.423 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.423 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:25:16.423 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:57.413515+0000", 2021-10-08T19:25:16.423 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:16.424 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.424 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.424 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:25:16.424 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:57.413515+0000", 2021-10-08T19:25:16.425 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:16.425 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.425 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.425 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:25:16.425 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:57.413512+0000", 2021-10-08T19:25:16.426 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999971 2021-10-08T19:25:16.426 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.426 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.426 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:25:16.427 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:57.413570+0000", 2021-10-08T19:25:16.427 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7635e-05 2021-10-08T19:25:16.427 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.427 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.427 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:25:16.428 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:57.413590+0000", 2021-10-08T19:25:16.428 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0318000000000001e-05 2021-10-08T19:25:16.428 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.428 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.428 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:25:16.429 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:57.413598+0000", 2021-10-08T19:25:16.429 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9449999999999993e-06 2021-10-08T19:25:16.429 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.429 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.430 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:25:16.430 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:57.413659+0000", 2021-10-08T19:25:16.430 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0781e-05 2021-10-08T19:25:16.430 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.430 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.431 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:25:16.431 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:57.413837+0000", 2021-10-08T19:25:16.431 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017829200000000001 2021-10-08T19:25:16.431 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.432 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.432 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 3,6", 2021-10-08T19:25:16.432 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:57.414015+0000", 2021-10-08T19:25:16.432 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017824599999999999 2021-10-08T19:25:16.432 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.433 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.433 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:25:16.433 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:57.416148+0000", 2021-10-08T19:25:16.433 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002133107 2021-10-08T19:25:16.433 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.434 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.434 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:16.434 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:57.417423+0000", 2021-10-08T19:25:16.434 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001274701 2021-10-08T19:25:16.435 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.435 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.435 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:16.435 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:57.446549+0000", 2021-10-08T19:25:16.436 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.029125861999999999 2021-10-08T19:25:16.436 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.436 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.436 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:25:16.436 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:57.446620+0000", 2021-10-08T19:25:16.437 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0970000000000007e-05 2021-10-08T19:25:16.437 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.437 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.437 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:25:16.438 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:57.448090+0000", 2021-10-08T19:25:16.438 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001469925 2021-10-08T19:25:16.438 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:16.438 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:25:16.438 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:16.439 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.439 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.439 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:74610 7.1 7:842ad0d7:::benchmark_data_smithi097_93198_object74609:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127)", 2021-10-08T19:25:16.439 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:24:58.819717+0000", 2021-10-08T19:25:16.439 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 17.384282642999999, 2021-10-08T19:25:16.440 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.068863451000000006, 2021-10-08T19:25:16.440 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:25:16.440 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:16.440 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:25:16.441 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:25:16.441 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:25:16.441 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 74610 2021-10-08T19:25:16.441 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.441 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:25:16.442 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.442 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:25:16.442 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.819717+0000", 2021-10-08T19:25:16.442 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:16.443 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.443 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.443 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:25:16.443 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.819717+0000", 2021-10-08T19:25:16.443 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:16.444 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.444 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.444 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:25:16.444 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.819716+0000", 2021-10-08T19:25:16.444 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:25:16.445 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.445 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.445 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:25:16.445 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.819786+0000", 2021-10-08T19:25:16.446 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0489999999999998e-05 2021-10-08T19:25:16.446 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.446 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.446 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:25:16.446 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.819796+0000", 2021-10-08T19:25:16.447 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3729999999999999e-06 2021-10-08T19:25:16.447 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.447 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.447 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:25:16.448 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.819801+0000", 2021-10-08T19:25:16.448 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1329999999999998e-06 2021-10-08T19:25:16.448 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.448 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.448 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:25:16.449 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.832972+0000", 2021-10-08T19:25:16.449 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013170673000000001 2021-10-08T19:25:16.449 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.449 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.449 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:25:16.450 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.833113+0000", 2021-10-08T19:25:16.450 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014161600000000001 2021-10-08T19:25:16.450 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.450 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.451 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 3,6", 2021-10-08T19:25:16.451 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.833264+0000", 2021-10-08T19:25:16.451 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000151037 2021-10-08T19:25:16.451 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.451 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.452 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:25:16.452 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.838337+0000", 2021-10-08T19:25:16.452 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00507245 2021-10-08T19:25:16.452 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.452 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.453 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:16.453 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.849408+0000", 2021-10-08T19:25:16.453 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011071796 2021-10-08T19:25:16.453 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.454 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.454 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:16.454 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.887838+0000", 2021-10-08T19:25:16.454 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.038429773 2021-10-08T19:25:16.454 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.455 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.455 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:25:16.455 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.887916+0000", 2021-10-08T19:25:16.455 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.7342999999999995e-05 2021-10-08T19:25:16.456 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.456 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.456 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:25:16.456 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.888580+0000", 2021-10-08T19:25:16.456 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00066469299999999995 2021-10-08T19:25:16.457 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:16.457 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:25:16.457 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:16.457 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.457 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.458 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:75543 7.1 7:89800ab1:::benchmark_data_smithi097_93198_object75542:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127)", 2021-10-08T19:25:16.458 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:25:00.250659+0000", 2021-10-08T19:25:16.458 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 15.953340715, 2021-10-08T19:25:16.458 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.042946239999999997, 2021-10-08T19:25:16.459 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:25:16.459 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:16.459 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:25:16.459 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:25:16.459 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:25:16.460 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 75543 2021-10-08T19:25:16.460 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.460 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:25:16.460 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.461 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:25:16.461 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.250659+0000", 2021-10-08T19:25:16.461 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:16.461 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.461 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.462 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:25:16.462 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.250659+0000", 2021-10-08T19:25:16.462 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:16.462 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.463 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.463 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:25:16.463 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.250657+0000", 2021-10-08T19:25:16.463 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:25:16.463 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.464 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.464 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:25:16.464 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.250701+0000", 2021-10-08T19:25:16.464 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4298999999999997e-05 2021-10-08T19:25:16.465 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.465 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.465 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:25:16.465 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.250714+0000", 2021-10-08T19:25:16.466 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2962000000000001e-05 2021-10-08T19:25:16.466 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.466 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.466 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:25:16.466 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.250719+0000", 2021-10-08T19:25:16.467 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0950000000000003e-06 2021-10-08T19:25:16.467 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.467 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.467 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:25:16.468 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.250764+0000", 2021-10-08T19:25:16.468 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4499000000000002e-05 2021-10-08T19:25:16.468 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.468 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.468 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:25:16.469 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.250886+0000", 2021-10-08T19:25:16.469 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012271100000000001 2021-10-08T19:25:16.469 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.469 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.470 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 3,6", 2021-10-08T19:25:16.470 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.251020+0000", 2021-10-08T19:25:16.470 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013345499999999999 2021-10-08T19:25:16.470 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.470 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.471 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:25:16.471 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.253158+0000", 2021-10-08T19:25:16.471 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021384609999999999 2021-10-08T19:25:16.471 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.472 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.472 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:16.472 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.254183+0000", 2021-10-08T19:25:16.472 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0010246439999999999 2021-10-08T19:25:16.473 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.473 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.473 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:16.473 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.292184+0000", 2021-10-08T19:25:16.473 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.038000990999999998 2021-10-08T19:25:16.474 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.474 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.474 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:25:16.474 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.292254+0000", 2021-10-08T19:25:16.475 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0388000000000004e-05 2021-10-08T19:25:16.475 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.475 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.475 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:25:16.475 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.293605+0000", 2021-10-08T19:25:16.476 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013507230000000001 2021-10-08T19:25:16.476 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:16.476 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:25:16.476 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:16.477 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.477 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.477 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:75551 7.1 7:8641f16e:::benchmark_data_smithi097_93198_object75550:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127)", 2021-10-08T19:25:16.477 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:25:00.270260+0000", 2021-10-08T19:25:16.477 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 15.933739367999999, 2021-10-08T19:25:16.478 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.050588845, 2021-10-08T19:25:16.478 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:25:16.478 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:16.478 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:25:16.479 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:25:16.479 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:25:16.479 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 75551 2021-10-08T19:25:16.479 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.479 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:25:16.480 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.480 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:25:16.480 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.270260+0000", 2021-10-08T19:25:16.480 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:16.480 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.481 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.481 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:25:16.481 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.270260+0000", 2021-10-08T19:25:16.481 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:16.482 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.482 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.482 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:25:16.482 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.270258+0000", 2021-10-08T19:25:16.483 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:25:16.483 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.483 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.483 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:25:16.483 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.270312+0000", 2021-10-08T19:25:16.484 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4459999999999997e-05 2021-10-08T19:25:16.484 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.484 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.484 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:25:16.484 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.270324+0000", 2021-10-08T19:25:16.485 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1659e-05 2021-10-08T19:25:16.485 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.485 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.485 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:25:16.486 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.270337+0000", 2021-10-08T19:25:16.486 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2788e-05 2021-10-08T19:25:16.486 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.486 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.486 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:25:16.487 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.270387+0000", 2021-10-08T19:25:16.487 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0290000000000001e-05 2021-10-08T19:25:16.487 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.487 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.488 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:25:16.488 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.270519+0000", 2021-10-08T19:25:16.488 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000132151 2021-10-08T19:25:16.488 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.488 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.489 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 3,6", 2021-10-08T19:25:16.489 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.270631+0000", 2021-10-08T19:25:16.489 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112402 2021-10-08T19:25:16.489 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.489 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.490 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:25:16.490 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.272761+0000", 2021-10-08T19:25:16.490 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021298530000000001 2021-10-08T19:25:16.490 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.491 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.491 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:16.491 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.273829+0000", 2021-10-08T19:25:16.491 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0010678420000000001 2021-10-08T19:25:16.491 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.492 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.492 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:16.492 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.318625+0000", 2021-10-08T19:25:16.492 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.044795656000000003 2021-10-08T19:25:16.493 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.493 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.493 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:25:16.493 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.318671+0000", 2021-10-08T19:25:16.493 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.6010999999999997e-05 2021-10-08T19:25:16.494 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.494 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.494 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:25:16.494 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.320849+0000", 2021-10-08T19:25:16.495 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002178115 2021-10-08T19:25:16.495 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:16.495 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:25:16.495 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:16.495 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.496 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.496 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:76387 7.1 7:88420a8f:::benchmark_data_smithi097_93198_object76386:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127)", 2021-10-08T19:25:16.496 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:25:01.458670+0000", 2021-10-08T19:25:16.496 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 14.745328942, 2021-10-08T19:25:16.496 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.062925363999999998, 2021-10-08T19:25:16.497 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:25:16.497 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:16.497 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:25:16.497 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:25:16.498 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:25:16.498 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 76387 2021-10-08T19:25:16.498 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.498 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:25:16.498 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.499 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:25:16.499 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:01.458670+0000", 2021-10-08T19:25:16.499 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:16.499 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.500 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.500 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:25:16.500 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:01.458670+0000", 2021-10-08T19:25:16.500 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:16.500 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.501 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.501 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:25:16.501 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:01.458669+0000", 2021-10-08T19:25:16.501 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:25:16.501 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.502 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.502 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:25:16.502 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:01.458692+0000", 2021-10-08T19:25:16.502 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3927999999999999e-05 2021-10-08T19:25:16.503 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.503 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.503 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:25:16.503 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:01.458704+0000", 2021-10-08T19:25:16.503 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1702000000000001e-05 2021-10-08T19:25:16.504 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.504 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.504 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:25:16.504 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:01.458710+0000", 2021-10-08T19:25:16.505 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.896e-06 2021-10-08T19:25:16.505 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.505 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.505 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:25:16.506 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:01.458765+0000", 2021-10-08T19:25:16.506 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4419999999999997e-05 2021-10-08T19:25:16.506 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.506 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.506 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:25:16.507 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:01.458966+0000", 2021-10-08T19:25:16.507 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00020121700000000001 2021-10-08T19:25:16.507 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.507 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.508 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 3,6", 2021-10-08T19:25:16.508 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:01.459204+0000", 2021-10-08T19:25:16.508 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00023856800000000001 2021-10-08T19:25:16.508 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.509 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.509 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:25:16.509 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:01.462167+0000", 2021-10-08T19:25:16.509 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002963144 2021-10-08T19:25:16.510 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.510 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.510 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:16.510 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:01.463137+0000", 2021-10-08T19:25:16.511 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00096916400000000001 2021-10-08T19:25:16.511 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.511 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.511 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:16.511 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:01.520308+0000", 2021-10-08T19:25:16.512 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.057171412999999997 2021-10-08T19:25:16.512 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.512 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.512 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:25:16.513 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:01.520343+0000", 2021-10-08T19:25:16.513 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.5185000000000003e-05 2021-10-08T19:25:16.513 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.513 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.513 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:25:16.514 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:01.521596+0000", 2021-10-08T19:25:16.514 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001252656 2021-10-08T19:25:16.514 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:16.514 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:25:16.515 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:16.515 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.515 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.515 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:76406 7.1 7:8ae020aa:::benchmark_data_smithi097_93198_object76405:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127)", 2021-10-08T19:25:16.516 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:25:01.479417+0000", 2021-10-08T19:25:16.516 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 14.724582590000001, 2021-10-08T19:25:16.516 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.043228100999999998, 2021-10-08T19:25:16.516 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:25:16.517 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:16.517 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:25:16.517 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:25:16.517 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:25:16.517 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 76406 2021-10-08T19:25:16.518 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.518 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:25:16.518 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.518 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:25:16.519 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:01.479417+0000", 2021-10-08T19:25:16.519 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:16.519 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.520 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.520 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:25:16.520 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:01.479417+0000", 2021-10-08T19:25:16.520 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:16.521 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.521 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.521 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:25:16.521 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:01.479414+0000", 2021-10-08T19:25:16.521 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:25:16.522 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.522 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.522 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:25:16.522 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:01.479477+0000", 2021-10-08T19:25:16.523 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2187000000000006e-05 2021-10-08T19:25:16.523 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.523 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.523 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:25:16.523 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:01.479492+0000", 2021-10-08T19:25:16.524 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.523e-05 2021-10-08T19:25:16.524 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.524 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.524 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:25:16.525 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:01.479499+0000", 2021-10-08T19:25:16.525 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4580000000000004e-06 2021-10-08T19:25:16.525 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.525 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.525 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:25:16.526 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:01.479565+0000", 2021-10-08T19:25:16.526 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5684000000000003e-05 2021-10-08T19:25:16.526 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.526 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.527 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:25:16.527 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:01.479789+0000", 2021-10-08T19:25:16.527 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000223625 2021-10-08T19:25:16.527 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.528 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.528 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 3,6", 2021-10-08T19:25:16.528 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:01.480020+0000", 2021-10-08T19:25:16.528 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000231812 2021-10-08T19:25:16.528 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.529 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.529 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:25:16.529 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:01.482850+0000", 2021-10-08T19:25:16.529 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028297750000000001 2021-10-08T19:25:16.530 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.530 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.530 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:16.530 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:01.484455+0000", 2021-10-08T19:25:16.530 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001604716 2021-10-08T19:25:16.531 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.531 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.531 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:16.531 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:01.521653+0000", 2021-10-08T19:25:16.531 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.037198097999999999 2021-10-08T19:25:16.532 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.532 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.532 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:25:16.532 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:01.521696+0000", 2021-10-08T19:25:16.533 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2769999999999999e-05 2021-10-08T19:25:16.533 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.533 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.533 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:25:16.533 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:01.522645+0000", 2021-10-08T19:25:16.534 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00094915199999999998 2021-10-08T19:25:16.534 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:16.534 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:25:16.534 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:16.535 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.535 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.535 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:76512 7.1 7:869b0f78:::benchmark_data_smithi097_93198_object76511:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127)", 2021-10-08T19:25:16.535 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:25:01.635351+0000", 2021-10-08T19:25:16.535 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 14.568648512999999, 2021-10-08T19:25:16.536 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.042885616000000001, 2021-10-08T19:25:16.536 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:25:16.536 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:16.536 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:25:16.537 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:25:16.537 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:25:16.537 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 76512 2021-10-08T19:25:16.537 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.537 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:25:16.538 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.538 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:25:16.538 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:01.635351+0000", 2021-10-08T19:25:16.538 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:16.538 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.539 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.539 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:25:16.539 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:01.635351+0000", 2021-10-08T19:25:16.539 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:16.540 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.540 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.540 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:25:16.540 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:01.635348+0000", 2021-10-08T19:25:16.540 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:25:16.541 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.541 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.541 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:25:16.541 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:01.635408+0000", 2021-10-08T19:25:16.542 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9132999999999998e-05 2021-10-08T19:25:16.542 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.542 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.542 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:25:16.542 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:01.635424+0000", 2021-10-08T19:25:16.543 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6725e-05 2021-10-08T19:25:16.543 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.543 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.543 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:25:16.544 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:01.635431+0000", 2021-10-08T19:25:16.544 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0550000000000002e-06 2021-10-08T19:25:16.544 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.544 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.544 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:25:16.545 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:01.635519+0000", 2021-10-08T19:25:16.545 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.7287000000000006e-05 2021-10-08T19:25:16.545 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.545 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.546 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:25:16.546 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:01.635651+0000", 2021-10-08T19:25:16.546 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013243900000000001 2021-10-08T19:25:16.546 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.546 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.547 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 3,6", 2021-10-08T19:25:16.547 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:01.635858+0000", 2021-10-08T19:25:16.547 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00020688400000000001 2021-10-08T19:25:16.547 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.548 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.548 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:25:16.548 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:01.639064+0000", 2021-10-08T19:25:16.548 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032064609999999999 2021-10-08T19:25:16.548 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.549 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.549 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:16.549 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:01.640695+0000", 2021-10-08T19:25:16.549 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001630533 2021-10-08T19:25:16.550 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.550 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.550 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:16.550 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:01.677328+0000", 2021-10-08T19:25:16.550 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.036633423999999998 2021-10-08T19:25:16.551 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.551 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.551 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:25:16.551 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:01.677371+0000", 2021-10-08T19:25:16.552 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2511e-05 2021-10-08T19:25:16.552 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.552 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.552 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:25:16.553 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:01.678237+0000", 2021-10-08T19:25:16.553 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00086566300000000002 2021-10-08T19:25:16.553 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:16.553 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:25:16.553 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:16.554 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.554 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.554 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:78167 7.1 7:8ca4d80b:::benchmark_data_smithi097_93198_object78166:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128)", 2021-10-08T19:25:16.554 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:25:03.789304+0000", 2021-10-08T19:25:16.555 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 12.414695746, 2021-10-08T19:25:16.555 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.065035344999999994, 2021-10-08T19:25:16.555 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:25:16.555 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:16.555 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:25:16.556 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:25:16.556 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:25:16.556 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 78167 2021-10-08T19:25:16.556 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.557 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:25:16.557 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.557 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:25:16.557 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:03.789304+0000", 2021-10-08T19:25:16.557 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:16.558 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.558 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.558 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:25:16.558 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:03.789304+0000", 2021-10-08T19:25:16.558 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:16.559 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.559 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.559 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:25:16.559 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:03.789301+0000", 2021-10-08T19:25:16.560 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:25:16.560 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.560 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.560 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:25:16.561 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:03.789350+0000", 2021-10-08T19:25:16.561 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9215000000000002e-05 2021-10-08T19:25:16.561 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.561 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.561 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:25:16.562 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:03.789367+0000", 2021-10-08T19:25:16.562 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6494000000000002e-05 2021-10-08T19:25:16.562 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.562 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.563 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:25:16.563 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:03.789374+0000", 2021-10-08T19:25:16.563 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5220000000000001e-06 2021-10-08T19:25:16.563 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.563 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.564 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:25:16.564 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:03.789429+0000", 2021-10-08T19:25:16.564 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4950000000000001e-05 2021-10-08T19:25:16.564 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.565 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.565 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:25:16.565 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:03.789633+0000", 2021-10-08T19:25:16.565 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00020395799999999999 2021-10-08T19:25:16.566 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.566 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.566 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 3,6", 2021-10-08T19:25:16.566 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:03.789857+0000", 2021-10-08T19:25:16.566 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000223935 2021-10-08T19:25:16.567 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.567 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.567 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:25:16.567 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:03.792871+0000", 2021-10-08T19:25:16.568 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0030137150000000001 2021-10-08T19:25:16.568 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.568 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.568 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:16.569 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:03.796406+0000", 2021-10-08T19:25:16.569 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003534817 2021-10-08T19:25:16.569 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.569 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.569 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:16.570 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:03.852538+0000", 2021-10-08T19:25:16.570 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.056132348999999998 2021-10-08T19:25:16.570 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.570 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.571 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:25:16.571 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:03.852610+0000", 2021-10-08T19:25:16.571 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2163999999999996e-05 2021-10-08T19:25:16.571 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.571 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.572 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:25:16.572 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:03.854339+0000", 2021-10-08T19:25:16.572 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00172875 2021-10-08T19:25:16.572 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:16.573 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:25:16.573 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:16.573 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.573 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.574 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:78170 7.1 7:895c62f5:::benchmark_data_smithi097_93198_object78169:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128)", 2021-10-08T19:25:16.574 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:25:03.793204+0000", 2021-10-08T19:25:16.574 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 12.410795500000001, 2021-10-08T19:25:16.574 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.062139391000000002, 2021-10-08T19:25:16.574 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:25:16.575 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:16.575 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:25:16.575 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:25:16.575 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:25:16.576 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 78170 2021-10-08T19:25:16.576 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.576 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:25:16.576 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.576 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:25:16.577 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:03.793204+0000", 2021-10-08T19:25:16.577 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:16.577 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.577 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.577 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:25:16.578 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:03.793204+0000", 2021-10-08T19:25:16.578 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:16.578 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.578 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.578 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:25:16.579 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:03.793202+0000", 2021-10-08T19:25:16.579 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:25:16.579 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.579 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.580 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:25:16.580 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:03.793255+0000", 2021-10-08T19:25:16.580 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.3278e-05 2021-10-08T19:25:16.580 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.581 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.581 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:25:16.581 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:03.793268+0000", 2021-10-08T19:25:16.581 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2659e-05 2021-10-08T19:25:16.581 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.582 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.582 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:25:16.582 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:03.793275+0000", 2021-10-08T19:25:16.582 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5490000000000003e-06 2021-10-08T19:25:16.583 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.583 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.583 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:25:16.583 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:03.793333+0000", 2021-10-08T19:25:16.583 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8544000000000001e-05 2021-10-08T19:25:16.584 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.584 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.584 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:25:16.584 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:03.793506+0000", 2021-10-08T19:25:16.585 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017303199999999999 2021-10-08T19:25:16.585 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.585 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.585 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 3,6", 2021-10-08T19:25:16.586 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:03.793730+0000", 2021-10-08T19:25:16.586 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000223379 2021-10-08T19:25:16.586 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.586 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.587 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:25:16.587 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:03.799105+0000", 2021-10-08T19:25:16.587 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053757170000000003 2021-10-08T19:25:16.587 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.588 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.588 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:16.588 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:03.799168+0000", 2021-10-08T19:25:16.588 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2353000000000004e-05 2021-10-08T19:25:16.588 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.589 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.589 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:16.589 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:03.854416+0000", 2021-10-08T19:25:16.589 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.055248331999999997 2021-10-08T19:25:16.590 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.590 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.590 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:25:16.590 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:03.854460+0000", 2021-10-08T19:25:16.591 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.3705999999999998e-05 2021-10-08T19:25:16.591 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:16.591 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:16.591 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:25:16.592 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:03.855343+0000", 2021-10-08T19:25:16.592 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00088368799999999999 2021-10-08T19:25:16.592 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:16.592 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:25:16.592 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:16.593 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:16.593 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:25:16.593 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:25:16.594 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:16.595 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:25:16.596 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:25:16.596 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 83 15 86717 86702 65.2362 42.875 0.0365623 0.0153241 2021-10-08T19:25:16.655 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:25:16 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:25:16.697 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:25:16.734 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:16.793 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:25:16.798 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:16.799 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:25:16.900 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:25:16.929 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:17.157 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:25:17.160 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:17.161 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:25:17.164 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2021-10-08T19:25:17.262 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:25:17.294 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 84 15 87479 87464 65.0267 47.625 0.0256811 0.0153718 2021-10-08T19:25:17.320 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:17.420 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:25:17.428 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:17.429 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:25:17.530 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:25:17.549 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:17 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:25:17.549 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:17 smithi117 ceph-mon[34585]: pgmap v170: 168 pgs: 4 peering, 148 active+clean, 2 active+recovering+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 1 active+recovery_wait+degraded, 10 unknown; 5.2 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 43 MiB/s wr, 687 op/s; 6119/254946 objects degraded (2.400%); 7535/254946 objects misplaced (2.956%); 2.2 MiB/s, 34 objects/s recovering 2021-10-08T19:25:17.577 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:25:17.596 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:17 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:25:17.596 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:17 smithi097 ceph-mon[32687]: pgmap v170: 168 pgs: 4 peering, 148 active+clean, 2 active+recovering+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 1 active+recovery_wait+degraded, 10 unknown; 5.2 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 43 MiB/s wr, 687 op/s; 6119/254946 objects degraded (2.400%); 7535/254946 objects misplaced (2.956%); 2.2 MiB/s, 34 objects/s recovering 2021-10-08T19:25:17.596 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:17 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:25:17.597 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:17 smithi097 ceph-mon[41966]: pgmap v170: 168 pgs: 4 peering, 148 active+clean, 2 active+recovering+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 1 active+recovery_wait+degraded, 10 unknown; 5.2 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 43 MiB/s wr, 687 op/s; 6119/254946 objects degraded (2.400%); 7535/254946 objects misplaced (2.956%); 2.2 MiB/s, 34 objects/s recovering 2021-10-08T19:25:17.608 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:17.719 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:25:17.724 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:17.724 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:25:17.826 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:25:17.836 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2021-10-08T19:25:17.863 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:17.934 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:25:17.938 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:17.939 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:25:18.041 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:25:18.079 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:18.145 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:25:18.147 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:18.148 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:25:18.249 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:25:18.281 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:18.294 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 85 16 88266 88250 64.8397 49.125 0.0145666 0.0154163 2021-10-08T19:25:18.367 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:25:18.499 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:25:18.503 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:18.503 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:25:18.604 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:25:18.630 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:18.694 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:25:18.698 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:18.698 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:25:18.746 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 7, 6] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2021-10-08T19:25:18.747 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2021-10-08T19:25:18.747 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd dump -f json-pretty 2021-10-08T19:25:18.799 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:25:18.847 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:18 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:25:18.847 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:18 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:25:18.847 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:18 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:25:18.848 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:18 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:25:18.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:18 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:25:18.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:18 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:25:18.933 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:19.085 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:25:19.093 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:19.094 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:25:19.195 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:25:19.262 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:19.294 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 86 16 88888 88872 64.5379 38.875 0.0284093 0.0154877 2021-10-08T19:25:19.623 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is set 2021-10-08T19:25:19.625 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:25:19.630 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:19.631 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:25:19.732 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:25:19.735 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:25:19.736 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2021-10-08T19:25:19.736 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2021-10-08T19:25:19.736 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:25:19.764 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:19 smithi117 ceph-mon[34585]: pgmap v171: 168 pgs: 4 peering, 157 active+clean, 2 active+recovering+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovery_wait+degraded, 1 active+recovering+remapped, 1 unknown; 5.2 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.7 KiB/s rd, 43 MiB/s wr, 684 op/s; 6119/256911 objects degraded (2.382%); 7476/256911 objects misplaced (2.910%); 2.4 MiB/s, 38 objects/s recovering 2021-10-08T19:25:19.764 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:19 smithi117 ceph-mon[34585]: osdmap e134: 8 total, 8 up, 8 in 2021-10-08T19:25:19.765 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:19 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2351870485' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:25:19.793 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:19.924 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:25:19.927 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:19 smithi097 ceph-mon[32687]: pgmap v171: 168 pgs: 4 peering, 157 active+clean, 2 active+recovering+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovery_wait+degraded, 1 active+recovering+remapped, 1 unknown; 5.2 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.7 KiB/s rd, 43 MiB/s wr, 684 op/s; 6119/256911 objects degraded (2.382%); 7476/256911 objects misplaced (2.910%); 2.4 MiB/s, 38 objects/s recovering 2021-10-08T19:25:19.927 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:19 smithi097 ceph-mon[32687]: osdmap e134: 8 total, 8 up, 8 in 2021-10-08T19:25:19.927 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:19 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2351870485' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:25:19.929 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:19.930 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:19 smithi097 ceph-mon[41966]: pgmap v171: 168 pgs: 4 peering, 157 active+clean, 2 active+recovering+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovery_wait+degraded, 1 active+recovering+remapped, 1 unknown; 5.2 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.7 KiB/s rd, 43 MiB/s wr, 684 op/s; 6119/256911 objects degraded (2.382%); 7476/256911 objects misplaced (2.910%); 2.4 MiB/s, 38 objects/s recovering 2021-10-08T19:25:19.930 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:19 smithi097 ceph-mon[41966]: osdmap e134: 8 total, 8 up, 8 in 2021-10-08T19:25:19.931 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:19 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2351870485' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:25:19.932 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:25:20.033 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:25:20.069 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:20.131 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:25:20.134 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:20.134 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:25:20.235 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:25:20.279 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:20.294 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 87 16 89566 89550 64.2833 42.375 0.0110768 0.0155499 2021-10-08T19:25:20.630 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2021-10-08T19:25:20.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:20 smithi117 ceph-mon[34585]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:25:20.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:20 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2351870485' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:25:20.908 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:20 smithi117 ceph-mon[34585]: osdmap e135: 8 total, 8 up, 8 in 2021-10-08T19:25:20.908 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:20 smithi117 ceph-mon[34585]: Health check update: Degraded data redundancy: 6119/256911 objects degraded (2.382%), 3 pgs degraded (PG_DEGRADED) 2021-10-08T19:25:20.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:20 smithi097 ceph-mon[41966]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:25:20.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:20 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2351870485' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:25:20.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:20 smithi097 ceph-mon[41966]: osdmap e135: 8 total, 8 up, 8 in 2021-10-08T19:25:20.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:20 smithi097 ceph-mon[41966]: Health check update: Degraded data redundancy: 6119/256911 objects degraded (2.382%), 3 pgs degraded (PG_DEGRADED) 2021-10-08T19:25:20.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:20 smithi097 ceph-mon[32687]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:25:20.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:20 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2351870485' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:25:20.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:20 smithi097 ceph-mon[32687]: osdmap e135: 8 total, 8 up, 8 in 2021-10-08T19:25:20.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:20 smithi097 ceph-mon[32687]: Health check update: Degraded data redundancy: 6119/256911 objects degraded (2.382%), 3 pgs degraded (PG_DEGRADED) 2021-10-08T19:25:21.026 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:25:21.258 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:25:21.261 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:25:21.279 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:21.280 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:25:21.297 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 88 16 90375 90359 64.1248 50.5625 0.0128826 0.0155888 2021-10-08T19:25:21.381 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:25:21.413 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:21.475 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:25:21.481 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:21.482 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:25:21.583 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:25:21.647 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:21.845 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:21 smithi097 ceph-mon[41966]: pgmap v174: 168 pgs: 162 active+clean, 2 active+recovering+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 1 active+recovery_wait+degraded; 5.4 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 7.2 KiB/s rd, 38 MiB/s wr, 618 op/s; 6119/265875 objects degraded (2.301%); 7361/265875 objects misplaced (2.769%); 1.8 MiB/s, 29 objects/s recovering 2021-10-08T19:25:21.846 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:21 smithi097 ceph-mon[32687]: pgmap v174: 168 pgs: 162 active+clean, 2 active+recovering+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 1 active+recovery_wait+degraded; 5.4 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 7.2 KiB/s rd, 38 MiB/s wr, 618 op/s; 6119/265875 objects degraded (2.301%); 7361/265875 objects misplaced (2.769%); 1.8 MiB/s, 29 objects/s recovering 2021-10-08T19:25:21.877 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:25:21.881 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:21.882 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:25:21.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:21 smithi117 ceph-mon[34585]: pgmap v174: 168 pgs: 162 active+clean, 2 active+recovering+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 1 active+recovery_wait+degraded; 5.4 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 7.2 KiB/s rd, 38 MiB/s wr, 618 op/s; 6119/265875 objects degraded (2.301%); 7361/265875 objects misplaced (2.769%); 1.8 MiB/s, 29 objects/s recovering 2021-10-08T19:25:21.983 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:25:22.021 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:25:22.060 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:22.075 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:25:22.118 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:25:22.151 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:25:22.200 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:25:22.230 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:25:22.269 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:25:22.298 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 89 16 91036 91020 63.8686 41.3125 0.00998575 0.0156513 2021-10-08T19:25:22.310 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:25:22.327 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'false' 2021-10-08T19:25:22.328 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'false' 2021-10-08T19:25:22.328 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'false' 2021-10-08T19:25:22.328 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'false' 2021-10-08T19:25:22.328 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'false' 2021-10-08T19:25:22.329 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'false' 2021-10-08T19:25:22.329 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'false' 2021-10-08T19:25:22.329 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'false' 2021-10-08T19:25:22.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:22 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2861817705' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:25:22.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:22 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2861817705' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:25:22.970 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:25:22 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:25:22] "GET /metrics HTTP/1.1" 200 155712 "" "Prometheus/2.18.1" 2021-10-08T19:25:22.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:22 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2861817705' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:25:23.254 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2021-10-08T19:25:23.255 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:25:23.298 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Total time run: 90.0099 2021-10-08T19:25:23.298 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Total writes made: 91817 2021-10-08T19:25:23.299 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Write size: 65536 2021-10-08T19:25:23.299 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Object size: 65536 2021-10-08T19:25:23.299 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Bandwidth (MB/sec): 63.7548 2021-10-08T19:25:23.299 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Stddev Bandwidth: 33.9631 2021-10-08T19:25:23.300 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Max bandwidth (MB/sec): 180.25 2021-10-08T19:25:23.300 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Min bandwidth (MB/sec): 0 2021-10-08T19:25:23.300 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Average IOPS: 1020 2021-10-08T19:25:23.300 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Stddev IOPS: 543.41 2021-10-08T19:25:23.301 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Max IOPS: 2884 2021-10-08T19:25:23.301 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Min IOPS: 0 2021-10-08T19:25:23.301 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Average Latency(s): 0.0156807 2021-10-08T19:25:23.301 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Stddev Latency(s): 0.039048 2021-10-08T19:25:23.301 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Max latency(s): 2.88554 2021-10-08T19:25:23.302 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Min latency(s): 0.00115885 2021-10-08T19:25:23.302 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset noscrub 2021-10-08T19:25:23.306 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Cleaning up (deleting benchmark objects) 2021-10-08T19:25:23.615 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:25:23 smithi117 conmon[69189]: level=error ts=2021-10-08T19:25:23.505Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=2 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:25:23.615 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:23 smithi117 ceph-mon[34585]: pgmap v175: 168 pgs: 162 active+clean, 2 active+recovering+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 1 active+recovery_wait+degraded; 5.4 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 6.1 KiB/s rd, 32 MiB/s wr, 525 op/s; 6119/265875 objects degraded (2.301%); 7361/265875 objects misplaced (2.769%); 1.5 MiB/s, 24 objects/s recovering 2021-10-08T19:25:23.618 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:23 smithi097 ceph-mon[32687]: pgmap v175: 168 pgs: 162 active+clean, 2 active+recovering+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 1 active+recovery_wait+degraded; 5.4 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 6.1 KiB/s rd, 32 MiB/s wr, 525 op/s; 6119/265875 objects degraded (2.301%); 7361/265875 objects misplaced (2.769%); 1.5 MiB/s, 24 objects/s recovering 2021-10-08T19:25:23.619 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:23 smithi097 ceph-mon[41966]: pgmap v175: 168 pgs: 162 active+clean, 2 active+recovering+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 1 active+recovery_wait+degraded; 5.4 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 6.1 KiB/s rd, 32 MiB/s wr, 525 op/s; 6119/265875 objects degraded (2.301%); 7361/265875 objects misplaced (2.769%); 1.5 MiB/s, 24 objects/s recovering 2021-10-08T19:25:24.006 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:25:24.015 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:24.016 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:25:24.117 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:25:24.151 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:25:23 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:25:23] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:25:24.158 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:24.247 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:25:24.253 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:24.254 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:25:24.257 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2021-10-08T19:25:24.355 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:25:24.404 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:24.508 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:25:24.563 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:25:24.571 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:24.572 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:25:24.672 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:25:24.743 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:24.890 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:25:24.914 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:25:24.918 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:24.919 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:25:24.977 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:25:24.977 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:25:24.978 INFO:teuthology.orchestra.run.smithi097.stdout: "epoch": 135, 2021-10-08T19:25:24.978 INFO:teuthology.orchestra.run.smithi097.stdout: "fsid": "1d01f6d6-286c-11ec-8c25-001a4aab830c", 2021-10-08T19:25:24.978 INFO:teuthology.orchestra.run.smithi097.stdout: "created": "2021-10-08T19:16:25.258003+0000", 2021-10-08T19:25:24.978 INFO:teuthology.orchestra.run.smithi097.stdout: "modified": "2021-10-08T19:25:19.564772+0000", 2021-10-08T19:25:24.978 INFO:teuthology.orchestra.run.smithi097.stdout: "last_up_change": "2021-10-08T19:21:15.388758+0000", 2021-10-08T19:25:24.979 INFO:teuthology.orchestra.run.smithi097.stdout: "last_in_change": "2021-10-08T19:24:24.060804+0000", 2021-10-08T19:25:24.979 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-08T19:25:24.979 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_num": 5806080, 2021-10-08T19:25:24.979 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_set": [ 2021-10-08T19:25:24.980 INFO:teuthology.orchestra.run.smithi097.stdout: "nodeep-scrub", 2021-10-08T19:25:24.980 INFO:teuthology.orchestra.run.smithi097.stdout: "noscrub", 2021-10-08T19:25:24.980 INFO:teuthology.orchestra.run.smithi097.stdout: "pglog_hardlimit", 2021-10-08T19:25:24.980 INFO:teuthology.orchestra.run.smithi097.stdout: "purged_snapdirs", 2021-10-08T19:25:24.980 INFO:teuthology.orchestra.run.smithi097.stdout: "recovery_deletes", 2021-10-08T19:25:24.981 INFO:teuthology.orchestra.run.smithi097.stdout: "sortbitwise" 2021-10-08T19:25:24.981 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:25:24.981 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_version": 18, 2021-10-08T19:25:24.981 INFO:teuthology.orchestra.run.smithi097.stdout: "full_ratio": 0.94999998807907104, 2021-10-08T19:25:24.982 INFO:teuthology.orchestra.run.smithi097.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-08T19:25:24.982 INFO:teuthology.orchestra.run.smithi097.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-08T19:25:24.982 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_snapshot": "", 2021-10-08T19:25:24.982 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_max": 7, 2021-10-08T19:25:24.982 INFO:teuthology.orchestra.run.smithi097.stdout: "max_osd": 8, 2021-10-08T19:25:24.983 INFO:teuthology.orchestra.run.smithi097.stdout: "require_min_compat_client": "luminous", 2021-10-08T19:25:24.983 INFO:teuthology.orchestra.run.smithi097.stdout: "min_compat_client": "luminous", 2021-10-08T19:25:24.983 INFO:teuthology.orchestra.run.smithi097.stdout: "require_osd_release": "quincy", 2021-10-08T19:25:24.983 INFO:teuthology.orchestra.run.smithi097.stdout: "pools": [ 2021-10-08T19:25:24.983 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:24.984 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 1, 2021-10-08T19:25:24.984 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": ".mgr", 2021-10-08T19:25:24.984 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:19:44.413311+0000", 2021-10-08T19:25:24.984 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:25:24.984 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:25:24.985 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:25:24.985 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:25:24.985 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:25:24.985 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:25:24.985 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:25:24.986 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:25:24.986 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:25:24.986 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:25:24.987 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:25:24.987 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:25:24.987 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 1, 2021-10-08T19:25:24.987 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 1, 2021-10-08T19:25:24.987 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 1, 2021-10-08T19:25:24.988 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 1, 2021-10-08T19:25:24.988 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 1, 2021-10-08T19:25:24.988 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:25:24.988 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:25:24.989 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:25:24.989 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:25:24.989 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:25:24.989 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:25:24.989 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:25:24.990 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:24.990 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "21", 2021-10-08T19:25:24.990 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:25:24.990 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:25:24.990 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2021-10-08T19:25:24.991 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:25:24.991 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:25:24.991 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:25:24.991 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:25:24.991 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:25:24.992 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:25:24.992 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:25:24.992 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:25:24.992 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:25:24.993 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:25:24.993 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:25:24.993 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:25:24.993 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:25:24.993 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:25:24.993 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:25:24.994 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:25:24.994 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:25:24.994 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:25:24.994 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:25:24.995 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:25:24.995 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:25:24.995 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:25:24.995 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:25:24.996 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:24.996 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:25:24.996 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:25:24.996 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:25:24.996 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:25:24.997 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:25:24.997 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:25:24.997 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:25:24.997 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:25:24.998 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:25:24.998 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:25:24.998 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:25:24.998 INFO:teuthology.orchestra.run.smithi097.stdout: "options": { 2021-10-08T19:25:24.998 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_min": 1 2021-10-08T19:25:24.999 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:24.999 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:25:24.999 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": {} 2021-10-08T19:25:24.999 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:24.999 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.000 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.000 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 2, 2021-10-08T19:25:25.000 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": ".rgw.root", 2021-10-08T19:25:25.000 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:21:21.940881+0000", 2021-10-08T19:25:25.000 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:25:25.001 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:25:25.001 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:25:25.001 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:25:25.001 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:25:25.001 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:25:25.002 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:25:25.002 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:25:25.002 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:25:25.002 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:25:25.002 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:25:25.003 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:25:25.003 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 32, 2021-10-08T19:25:25.003 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 32, 2021-10-08T19:25:25.003 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 32, 2021-10-08T19:25:25.003 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 32, 2021-10-08T19:25:25.004 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 32, 2021-10-08T19:25:25.004 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:25:25.004 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:25:25.004 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:25:25.004 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:25:25.005 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:25:25.005 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:25:25.005 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:25:25.005 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.005 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "62", 2021-10-08T19:25:25.006 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:25:25.006 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:25:25.006 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2021-10-08T19:25:25.006 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:25:25.007 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:25:25.007 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:25:25.007 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:25:25.007 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:25:25.007 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:25:25.008 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:25:25.008 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:25:25.008 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:25:25.008 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:25:25.009 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:25:25.009 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:25:25.009 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:25:25.009 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:25:25.009 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:25:25.010 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:25:25.010 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:25:25.010 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:25:25.010 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:25:25.010 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:25:25.011 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:25:25.011 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:25:25.011 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:25:25.011 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.012 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:25:25.012 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:25:25.012 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:25:25.012 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:25:25.012 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:25:25.013 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:25:25.013 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:25:25.013 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:25:25.013 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:25:25.013 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:25:25.014 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:25:25.014 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2021-10-08T19:25:25.014 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:25:25.014 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw": {} 2021-10-08T19:25:25.014 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:25.015 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.015 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.015 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 3, 2021-10-08T19:25:25.015 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "iscsi", 2021-10-08T19:25:25.015 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:21:22.536945+0000", 2021-10-08T19:25:25.016 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:25:25.016 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:25:25.016 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:25:25.016 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:25:25.017 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:25:25.017 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:25:25.017 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:25:25.017 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:25:25.017 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:25:25.018 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:25:25.018 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:25:25.018 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:25:25.018 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 23, 2021-10-08T19:25:25.018 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 23, 2021-10-08T19:25:25.019 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 23, 2021-10-08T19:25:25.019 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 23, 2021-10-08T19:25:25.019 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 23, 2021-10-08T19:25:25.019 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:25:25.019 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:25:25.020 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:25:25.020 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:25:25.020 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:25:25.020 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:25:25.021 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:25:25.021 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.021 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "132", 2021-10-08T19:25:25.021 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:25:25.021 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:25:25.022 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "131", 2021-10-08T19:25:25.022 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:25:25.022 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:25:25.022 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:25:25.023 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:25:25.023 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:25:25.023 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:25:25.023 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:25:25.023 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:25:25.024 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:25:25.024 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:25:25.024 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:25:25.024 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:25:25.024 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:25:25.025 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:25:25.025 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:25:25.025 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:25:25.025 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:25:25.026 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:25:25.026 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:25:25.026 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:25:25.026 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:25:25.026 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:25:25.027 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:25:25.027 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.027 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:25:25.027 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:25:25.028 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:25:25.028 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:25:25.028 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:25:25.028 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:25:25.028 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:25:25.029 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:25:25.029 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:25:25.029 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:25:25.029 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:25:25.029 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2021-10-08T19:25:25.030 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:25:25.030 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd": {} 2021-10-08T19:25:25.030 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:25.030 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.031 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.031 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 4, 2021-10-08T19:25:25.031 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "default.rgw.log", 2021-10-08T19:25:25.031 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:21:23.886328+0000", 2021-10-08T19:25:25.031 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:25:25.032 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:25:25.032 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:25:25.032 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:25:25.032 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:25:25.032 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:25:25.033 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:25:25.033 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:25:25.033 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:25:25.033 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:25:25.033 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:25:25.034 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:25:25.034 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 32, 2021-10-08T19:25:25.034 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 32, 2021-10-08T19:25:25.034 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 32, 2021-10-08T19:25:25.035 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 32, 2021-10-08T19:25:25.035 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 32, 2021-10-08T19:25:25.035 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:25:25.035 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:25:25.035 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:25:25.036 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:25:25.036 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:25:25.036 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:25:25.036 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:25:25.037 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.037 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "64", 2021-10-08T19:25:25.037 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:25:25.037 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:25:25.037 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2021-10-08T19:25:25.038 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:25:25.038 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:25:25.038 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:25:25.038 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:25:25.039 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:25:25.039 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:25:25.039 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:25:25.039 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:25:25.039 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:25:25.040 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:25:25.040 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:25:25.040 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:25:25.040 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:25:25.040 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:25:25.041 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:25:25.041 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:25:25.041 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:25:25.041 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:25:25.042 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:25:25.042 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:25:25.042 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:25:25.042 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:25:25.042 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:25:25.043 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.043 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:25:25.043 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:25:25.043 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:25:25.044 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:25:25.044 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:25:25.044 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:25:25.044 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:25:25.045 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:25:25.045 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:25:25.045 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:25:25.045 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:25:25.045 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2021-10-08T19:25:25.046 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:25:25.046 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw": {} 2021-10-08T19:25:25.046 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:25.046 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.047 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.047 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 5, 2021-10-08T19:25:25.047 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "default.rgw.control", 2021-10-08T19:25:25.047 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:21:25.865032+0000", 2021-10-08T19:25:25.047 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:25:25.047 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:25:25.048 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:25:25.048 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:25:25.048 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:25:25.048 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:25:25.049 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:25:25.049 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:25:25.049 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:25:25.049 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:25:25.049 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:25:25.050 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:25:25.050 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 32, 2021-10-08T19:25:25.050 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 32, 2021-10-08T19:25:25.050 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 32, 2021-10-08T19:25:25.050 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 32, 2021-10-08T19:25:25.051 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 32, 2021-10-08T19:25:25.051 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:25:25.051 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:25:25.051 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:25:25.052 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:25:25.052 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:25:25.052 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:25:25.052 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:25:25.052 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.053 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "66", 2021-10-08T19:25:25.053 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:25:25.053 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:25:25.053 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2021-10-08T19:25:25.053 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:25:25.054 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:25:25.054 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:25:25.054 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:25:25.054 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:25:25.055 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:25:25.055 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:25:25.055 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:25:25.055 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:25:25.055 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:25:25.056 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:25:25.056 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:25:25.056 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:25:25.056 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:25:25.057 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:25:25.057 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:25:25.057 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:25:25.057 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:25:25.057 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:25:25.058 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:25:25.058 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:25:25.058 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:25:25.058 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:25:25.059 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.059 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:25:25.059 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:25:25.059 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:25:25.059 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:25:25.060 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:25:25.060 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:25:25.060 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:25:25.060 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:25:25.061 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:25:25.061 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:25:25.061 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:25:25.061 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2021-10-08T19:25:25.061 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:25:25.062 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw": {} 2021-10-08T19:25:25.062 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:25.062 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.062 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.063 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 6, 2021-10-08T19:25:25.063 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "default.rgw.meta", 2021-10-08T19:25:25.063 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:21:27.940767+0000", 2021-10-08T19:25:25.063 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:25:25.063 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:25:25.064 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:25:25.064 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:25:25.064 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:25:25.064 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:25:25.064 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:25:25.065 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:25:25.065 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:25:25.065 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:25:25.065 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:25:25.065 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:25:25.066 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 32, 2021-10-08T19:25:25.066 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 32, 2021-10-08T19:25:25.066 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 32, 2021-10-08T19:25:25.066 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 32, 2021-10-08T19:25:25.066 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 32, 2021-10-08T19:25:25.067 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:25:25.067 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:25:25.067 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:25:25.067 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:25:25.067 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:25:25.068 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:25:25.068 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:25:25.068 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.068 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "69", 2021-10-08T19:25:25.069 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:25:25.069 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:25:25.069 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2021-10-08T19:25:25.069 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:25:25.069 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:25:25.069 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:25:25.070 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:25:25.070 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:25:25.070 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:25:25.070 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:25:25.071 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:25:25.071 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:25:25.071 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:25:25.071 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:25:25.071 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:25:25.072 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:25:25.072 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:25:25.072 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:25:25.072 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:25:25.072 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:25:25.073 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:25:25.073 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:25:25.073 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:25:25.073 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:25:25.074 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:25:25.074 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:25:25.074 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.074 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:25:25.074 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:25:25.075 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:25:25.075 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:25:25.075 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:25:25.075 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:25:25.075 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:25:25.076 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:25:25.076 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:25:25.076 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:25:25.076 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:25:25.076 INFO:teuthology.orchestra.run.smithi097.stdout: "options": { 2021-10-08T19:25:25.077 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_bias": 4, 2021-10-08T19:25:25.077 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_min": 8 2021-10-08T19:25:25.077 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.077 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:25:25.077 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw": {} 2021-10-08T19:25:25.078 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:25.078 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.078 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.078 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 7, 2021-10-08T19:25:25.079 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "unique_pool_0", 2021-10-08T19:25:25.079 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:23:43.485480+0000", 2021-10-08T19:25:25.079 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:25:25.079 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:25:25.079 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:25:25.080 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:25:25.080 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:25:25.080 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:25:25.080 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:25:25.080 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:25:25.081 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:25:25.081 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:25:25.081 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:25:25.081 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:25:25.081 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 16, 2021-10-08T19:25:25.082 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 16, 2021-10-08T19:25:25.082 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 16, 2021-10-08T19:25:25.082 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 16, 2021-10-08T19:25:25.082 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 16, 2021-10-08T19:25:25.082 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:25:25.083 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:25:25.083 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:25:25.083 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:25:25.083 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:25:25.084 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:25:25.084 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:25:25.084 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.084 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "98", 2021-10-08T19:25:25.085 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:25:25.085 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:25:25.085 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2021-10-08T19:25:25.085 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:25:25.085 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:25:25.086 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:25:25.086 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:25:25.086 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:25:25.086 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:25:25.086 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:25:25.087 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:25:25.087 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:25:25.087 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:25:25.087 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:25:25.087 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:25:25.088 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:25:25.088 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:25:25.088 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:25:25.088 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:25:25.088 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:25:25.089 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:25:25.089 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:25:25.089 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:25:25.089 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:25:25.089 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:25:25.090 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:25:25.090 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.090 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:25:25.090 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:25:25.090 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:25:25.091 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:25:25.091 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:25:25.091 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:25:25.091 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:25:25.091 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:25:25.092 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:25:25.092 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:25:25.092 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:25:25.092 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2021-10-08T19:25:25.093 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:25:25.093 INFO:teuthology.orchestra.run.smithi097.stdout: "rados": {} 2021-10-08T19:25:25.093 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:25.093 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:25.093 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:25:25.094 INFO:teuthology.orchestra.run.smithi097.stdout: "osds": [ 2021-10-08T19:25:25.094 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.094 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 0, 2021-10-08T19:25:25.094 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "9e64e714-a5d5-4fbb-ae2b-1df4bf14b8e0", 2021-10-08T19:25:25.094 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:25:25.095 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:25:25.095 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:25:25.095 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:25:25.095 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:25:25.096 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:25:25.096 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 8, 2021-10-08T19:25:25.096 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 132, 2021-10-08T19:25:25.096 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:25:25.096 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:25:25.097 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:25:25.097 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:25.097 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.097 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:25.097 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6801", 2021-10-08T19:25:25.098 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3354161282 2021-10-08T19:25:25.098 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:25.098 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:25.098 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.098 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:25:25.099 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:25.099 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.099 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:25.099 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6802", 2021-10-08T19:25:25.099 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3354161282 2021-10-08T19:25:25.100 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:25.100 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:25.100 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.100 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:25:25.100 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:25.101 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.101 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:25.101 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6804", 2021-10-08T19:25:25.101 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3354161282 2021-10-08T19:25:25.102 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:25.102 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:25.102 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.102 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:25:25.102 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:25.103 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.103 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:25.103 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6803", 2021-10-08T19:25:25.103 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3354161282 2021-10-08T19:25:25.104 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:25.104 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:25.104 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.104 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.97:6801/3354161282", 2021-10-08T19:25:25.104 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.97:6802/3354161282", 2021-10-08T19:25:25.105 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.97:6804/3354161282", 2021-10-08T19:25:25.105 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.97:6803/3354161282", 2021-10-08T19:25:25.105 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:25:25.105 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:25:25.105 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:25:25.106 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:25.106 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.106 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.106 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 1, 2021-10-08T19:25:25.107 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "32602a22-f263-4b62-a8d8-50fddfb73fa8", 2021-10-08T19:25:25.107 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:25:25.107 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:25:25.107 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:25:25.107 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:25:25.108 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:25:25.108 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:25:25.108 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 13, 2021-10-08T19:25:25.108 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 131, 2021-10-08T19:25:25.108 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:25:25.109 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:25:25.109 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:25:25.109 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:25.109 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.110 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:25.110 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6805", 2021-10-08T19:25:25.110 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 735799205 2021-10-08T19:25:25.110 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:25.110 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:25.111 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.111 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:25:25.111 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:25.111 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.112 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:25.112 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6806", 2021-10-08T19:25:25.112 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 735799205 2021-10-08T19:25:25.112 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:25.112 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:25.113 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.113 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:25:25.113 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:25.113 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.113 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:25.114 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6808", 2021-10-08T19:25:25.114 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 735799205 2021-10-08T19:25:25.114 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:25.114 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:25.115 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.115 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:25:25.115 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:25.115 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.115 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:25.116 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6807", 2021-10-08T19:25:25.116 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 735799205 2021-10-08T19:25:25.116 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:25.116 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:25.116 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.117 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.97:6805/735799205", 2021-10-08T19:25:25.117 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.97:6806/735799205", 2021-10-08T19:25:25.117 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.97:6808/735799205", 2021-10-08T19:25:25.117 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.97:6807/735799205", 2021-10-08T19:25:25.118 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:25:25.118 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:25:25.118 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:25:25.118 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:25.118 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.119 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.119 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 2, 2021-10-08T19:25:25.119 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "88e0e4a2-b4a3-4a00-8669-03c3d9b166c5", 2021-10-08T19:25:25.119 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:25:25.120 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:25:25.120 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:25:25.120 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:25:25.120 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:25:25.120 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:25:25.121 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 18, 2021-10-08T19:25:25.121 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 113, 2021-10-08T19:25:25.121 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:25:25.121 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:25:25.121 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:25:25.122 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:25.122 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.122 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:25.122 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6809", 2021-10-08T19:25:25.123 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2366482649 2021-10-08T19:25:25.123 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:25.123 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:25.123 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.123 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:25:25.124 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:25.124 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.124 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:25.124 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6810", 2021-10-08T19:25:25.125 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2366482649 2021-10-08T19:25:25.125 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:25.125 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:25.125 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.126 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:25:25.126 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:25.126 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.126 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:25.126 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6812", 2021-10-08T19:25:25.127 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2366482649 2021-10-08T19:25:25.127 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:25.127 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:25.127 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.127 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:25:25.128 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:25.128 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.128 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:25.128 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6811", 2021-10-08T19:25:25.129 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2366482649 2021-10-08T19:25:25.129 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:25.129 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:25.129 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.129 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.97:6809/2366482649", 2021-10-08T19:25:25.130 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.97:6810/2366482649", 2021-10-08T19:25:25.130 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.97:6812/2366482649", 2021-10-08T19:25:25.130 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.97:6811/2366482649", 2021-10-08T19:25:25.130 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:25:25.130 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:25:25.131 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:25:25.131 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:25.131 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.131 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.131 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 3, 2021-10-08T19:25:25.132 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "e689d708-b501-4526-a31a-1e598b74654d", 2021-10-08T19:25:25.132 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:25:25.132 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:25:25.132 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:25:25.133 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:25:25.133 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:25:25.133 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:25:25.133 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 24, 2021-10-08T19:25:25.133 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 131, 2021-10-08T19:25:25.134 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:25:25.134 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:25:25.134 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:25:25.134 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:25.135 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.135 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:25.135 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6813", 2021-10-08T19:25:25.135 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3191181122 2021-10-08T19:25:25.135 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:25.136 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:25.136 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.136 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:25:25.136 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:25.136 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.137 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:25.137 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6814", 2021-10-08T19:25:25.137 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3191181122 2021-10-08T19:25:25.137 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:25.138 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:25.138 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.138 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:25:25.138 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:25.138 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.139 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:25.139 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6816", 2021-10-08T19:25:25.139 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3191181122 2021-10-08T19:25:25.139 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:25.139 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:25.140 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.140 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:25:25.140 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:25.140 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.141 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:25.141 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6815", 2021-10-08T19:25:25.141 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3191181122 2021-10-08T19:25:25.141 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:25.141 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:25.142 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.142 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.97:6813/3191181122", 2021-10-08T19:25:25.142 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.97:6814/3191181122", 2021-10-08T19:25:25.142 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.97:6816/3191181122", 2021-10-08T19:25:25.143 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.97:6815/3191181122", 2021-10-08T19:25:25.143 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:25:25.143 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:25:25.143 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:25:25.143 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:25.144 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.144 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.144 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 4, 2021-10-08T19:25:25.144 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "67e4730a-be1c-4d88-9307-e3c2cf3ab2ef", 2021-10-08T19:25:25.145 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:25:25.145 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:25:25.145 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:25:25.145 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:25:25.145 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:25:25.146 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:25:25.146 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 30, 2021-10-08T19:25:25.146 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 132, 2021-10-08T19:25:25.146 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:25:25.147 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:25:25.147 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:25:25.147 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:25.147 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.147 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:25.148 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6800", 2021-10-08T19:25:25.148 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 106778208 2021-10-08T19:25:25.148 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:25.148 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:25.148 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.149 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:25:25.149 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:25.149 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.149 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:25.149 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6801", 2021-10-08T19:25:25.150 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 106778208 2021-10-08T19:25:25.150 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:25.150 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:25.150 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.150 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:25:25.151 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:25.151 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.151 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:25.151 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6803", 2021-10-08T19:25:25.152 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 106778208 2021-10-08T19:25:25.152 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:25.152 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:25.152 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.152 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:25:25.153 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:25.153 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.153 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:25.153 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6802", 2021-10-08T19:25:25.153 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 106778208 2021-10-08T19:25:25.154 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:25.154 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:25.154 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.154 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.117:6800/106778208", 2021-10-08T19:25:25.155 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.117:6801/106778208", 2021-10-08T19:25:25.155 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.117:6803/106778208", 2021-10-08T19:25:25.155 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.117:6802/106778208", 2021-10-08T19:25:25.155 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:25:25.155 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:25:25.156 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:25:25.156 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:25.156 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.156 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.156 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 5, 2021-10-08T19:25:25.157 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "f9fd3153-3e4e-4489-8927-a65641f05d42", 2021-10-08T19:25:25.157 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:25:25.157 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:25:25.157 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:25:25.157 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:25:25.158 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:25:25.158 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:25:25.158 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 38, 2021-10-08T19:25:25.158 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 132, 2021-10-08T19:25:25.159 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:25:25.159 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:25:25.159 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:25:25.159 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:25.159 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.160 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:25.160 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6804", 2021-10-08T19:25:25.160 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3199889891 2021-10-08T19:25:25.160 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:25.160 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:25.161 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.161 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:25:25.161 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:25.161 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.161 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:25.162 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6805", 2021-10-08T19:25:25.162 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3199889891 2021-10-08T19:25:25.162 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:25.162 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:25.163 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.163 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:25:25.163 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:25.163 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.163 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:25.164 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6807", 2021-10-08T19:25:25.164 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3199889891 2021-10-08T19:25:25.164 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:25.164 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:25.164 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.165 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:25:25.165 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:25.165 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.165 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:25.166 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6806", 2021-10-08T19:25:25.166 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3199889891 2021-10-08T19:25:25.166 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:25.166 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:25.167 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.167 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.117:6804/3199889891", 2021-10-08T19:25:25.167 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.117:6805/3199889891", 2021-10-08T19:25:25.167 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.117:6807/3199889891", 2021-10-08T19:25:25.167 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.117:6806/3199889891", 2021-10-08T19:25:25.168 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:25:25.168 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:25:25.168 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:25:25.168 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:25.168 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.169 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.169 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 6, 2021-10-08T19:25:25.169 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "84898f12-c37d-4eb6-8b71-5b86bfe16e7d", 2021-10-08T19:25:25.169 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:25:25.170 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:25:25.170 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:25:25.170 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:25:25.170 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:25:25.170 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:25:25.171 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 47, 2021-10-08T19:25:25.171 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 132, 2021-10-08T19:25:25.171 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:25:25.171 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:25:25.171 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:25:25.172 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:25.172 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.172 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:25.172 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6808", 2021-10-08T19:25:25.173 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2185843951 2021-10-08T19:25:25.173 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:25.173 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:25.174 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.174 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:25:25.174 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:25.174 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.174 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:25.175 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6809", 2021-10-08T19:25:25.175 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2185843951 2021-10-08T19:25:25.175 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:25.175 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:25.176 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.176 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:25:25.176 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:25.176 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.177 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:25.177 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6811", 2021-10-08T19:25:25.177 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2185843951 2021-10-08T19:25:25.177 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:25.177 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:25.178 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.178 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:25:25.178 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:25.178 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.179 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:25.179 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6810", 2021-10-08T19:25:25.179 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2185843951 2021-10-08T19:25:25.179 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:25.179 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:25.180 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.180 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.117:6808/2185843951", 2021-10-08T19:25:25.180 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.117:6809/2185843951", 2021-10-08T19:25:25.180 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.117:6811/2185843951", 2021-10-08T19:25:25.180 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.117:6810/2185843951", 2021-10-08T19:25:25.181 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:25:25.181 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:25:25.181 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:25:25.181 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:25.182 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.182 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.182 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 7, 2021-10-08T19:25:25.182 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "529af2ce-2ae9-41ed-8c8e-d133628cfd20", 2021-10-08T19:25:25.182 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:25:25.183 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:25:25.183 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:25:25.183 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:25:25.183 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:25:25.184 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:25:25.184 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 55, 2021-10-08T19:25:25.184 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 132, 2021-10-08T19:25:25.184 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:25:25.184 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:25:25.185 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:25:25.185 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:25.185 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.185 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:25.185 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6812", 2021-10-08T19:25:25.186 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2817683239 2021-10-08T19:25:25.186 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:25.186 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:25.186 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.187 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:25:25.187 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:25.187 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.187 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:25.187 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6813", 2021-10-08T19:25:25.188 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2817683239 2021-10-08T19:25:25.188 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:25.188 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:25.188 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.188 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:25:25.189 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:25.189 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.189 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:25.189 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6815", 2021-10-08T19:25:25.190 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2817683239 2021-10-08T19:25:25.190 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:25.190 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:25.190 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.190 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:25:25.191 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:25.191 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.191 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:25.191 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6814", 2021-10-08T19:25:25.191 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2817683239 2021-10-08T19:25:25.192 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:25.192 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:25.192 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.192 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.117:6812/2817683239", 2021-10-08T19:25:25.193 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.117:6813/2817683239", 2021-10-08T19:25:25.193 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.117:6815/2817683239", 2021-10-08T19:25:25.193 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.117:6814/2817683239", 2021-10-08T19:25:25.193 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:25:25.193 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:25:25.194 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:25:25.194 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:25.194 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:25.194 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:25:25.195 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_xinfo": [ 2021-10-08T19:25:25.195 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.195 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 0, 2021-10-08T19:25:25.195 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:25:25.195 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:25:25.196 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:25:25.196 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:25:25.196 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:25:25.196 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:24:07.227563+0000", 2021-10-08T19:25:25.197 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:25:25.197 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.197 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.197 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 1, 2021-10-08T19:25:25.197 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:25:25.198 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:25:25.198 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:25:25.198 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:25:25.198 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:25:25.198 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:24:51.166410+0000", 2021-10-08T19:25:25.199 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:25:25.199 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.199 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.199 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 2, 2021-10-08T19:25:25.200 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:25:25.200 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:25:25.200 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:25:25.200 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:25:25.200 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:25:25.201 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:24:29.688484+0000", 2021-10-08T19:25:25.201 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:25:25.201 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.201 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.201 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 3, 2021-10-08T19:25:25.202 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:25:25.202 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:25:25.202 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:25:25.202 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:25:25.203 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:25:25.203 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:24:34.979406+0000", 2021-10-08T19:25:25.203 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:25:25.203 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.203 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.204 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 4, 2021-10-08T19:25:25.204 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:25:25.204 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:25:25.204 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:25:25.204 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:25:25.205 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:25:25.205 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:24:02.266300+0000", 2021-10-08T19:25:25.205 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:25:25.205 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.206 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.206 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 5, 2021-10-08T19:25:25.206 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:25:25.206 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:25:25.206 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:25:25.207 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:25:25.207 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:25:25.207 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:25:17.830171+0000", 2021-10-08T19:25:25.207 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:25:25.207 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.208 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.208 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 6, 2021-10-08T19:25:25.208 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:25:25.208 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:25:25.208 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:25:25.209 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:25:25.209 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:25:25.209 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:24:32.387840+0000", 2021-10-08T19:25:25.209 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:25:25.210 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.210 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.210 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 7, 2021-10-08T19:25:25.210 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:25:25.210 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:25:25.211 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:25:25.211 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:25:25.211 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:25:25.211 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:24:51.598871+0000", 2021-10-08T19:25:25.211 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:25:25.212 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:25.212 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:25:25.212 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_upmap": [], 2021-10-08T19:25:25.212 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_upmap_items": [ 2021-10-08T19:25:25.212 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.213 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "2.0", 2021-10-08T19:25:25.213 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:25:25.213 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.213 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 7, 2021-10-08T19:25:25.214 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 2 2021-10-08T19:25:25.214 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:25.214 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:25.214 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.214 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.215 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "2.1a", 2021-10-08T19:25:25.215 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:25:25.215 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.215 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 7, 2021-10-08T19:25:25.215 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 2 2021-10-08T19:25:25.216 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:25.216 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:25.216 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.216 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.216 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "4.14", 2021-10-08T19:25:25.217 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:25:25.217 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.217 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 3, 2021-10-08T19:25:25.217 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 2 2021-10-08T19:25:25.218 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:25.218 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:25.218 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.218 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.218 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "4.18", 2021-10-08T19:25:25.219 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:25:25.219 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.219 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 1, 2021-10-08T19:25:25.219 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 2 2021-10-08T19:25:25.220 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:25.220 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:25.220 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.220 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.220 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "4.1c", 2021-10-08T19:25:25.221 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:25:25.221 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.221 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 1, 2021-10-08T19:25:25.221 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 5 2021-10-08T19:25:25.221 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:25.222 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:25.222 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:25.222 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:25:25.222 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_temp": [ 2021-10-08T19:25:25.223 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.223 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "7.1", 2021-10-08T19:25:25.223 INFO:teuthology.orchestra.run.smithi097.stdout: "osds": [ 2021-10-08T19:25:25.223 INFO:teuthology.orchestra.run.smithi097.stdout: 4, 2021-10-08T19:25:25.223 INFO:teuthology.orchestra.run.smithi097.stdout: 3 2021-10-08T19:25:25.224 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:25.224 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.224 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.224 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "7.7", 2021-10-08T19:25:25.224 INFO:teuthology.orchestra.run.smithi097.stdout: "osds": [ 2021-10-08T19:25:25.225 INFO:teuthology.orchestra.run.smithi097.stdout: 0, 2021-10-08T19:25:25.225 INFO:teuthology.orchestra.run.smithi097.stdout: 3 2021-10-08T19:25:25.225 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:25.225 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.226 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.226 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "7.b", 2021-10-08T19:25:25.226 INFO:teuthology.orchestra.run.smithi097.stdout: "osds": [ 2021-10-08T19:25:25.226 INFO:teuthology.orchestra.run.smithi097.stdout: 1, 2021-10-08T19:25:25.226 INFO:teuthology.orchestra.run.smithi097.stdout: 5 2021-10-08T19:25:25.227 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:25.227 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.227 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.227 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "7.c", 2021-10-08T19:25:25.228 INFO:teuthology.orchestra.run.smithi097.stdout: "osds": [ 2021-10-08T19:25:25.228 INFO:teuthology.orchestra.run.smithi097.stdout: 2, 2021-10-08T19:25:25.228 INFO:teuthology.orchestra.run.smithi097.stdout: 3, 2021-10-08T19:25:25.228 INFO:teuthology.orchestra.run.smithi097.stdout: 7 2021-10-08T19:25:25.228 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:25.229 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.229 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:25.229 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "7.d", 2021-10-08T19:25:25.229 INFO:teuthology.orchestra.run.smithi097.stdout: "osds": [ 2021-10-08T19:25:25.229 INFO:teuthology.orchestra.run.smithi097.stdout: 1, 2021-10-08T19:25:25.230 INFO:teuthology.orchestra.run.smithi097.stdout: 0 2021-10-08T19:25:25.230 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:25.230 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:25.230 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:25:25.231 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_temp": [], 2021-10-08T19:25:25.231 INFO:teuthology.orchestra.run.smithi097.stdout: "blocklist": { 2021-10-08T19:25:25.231 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/2600364788": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:25:25.231 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/4129083289": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:25:25.231 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/1443158975": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:25:25.232 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/2472640384": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:25:25.232 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/3196919488": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:25:25.232 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:6800/3195862546": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:25:25.232 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:6800/3931202434": "2021-10-09T19:17:10.051948+0000", 2021-10-08T19:25:25.233 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/2761595213": "2021-10-09T19:17:10.051948+0000", 2021-10-08T19:25:25.233 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/900681504": "2021-10-09T19:17:10.051948+0000", 2021-10-08T19:25:25.233 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/3932251406": "2021-10-09T19:17:10.051948+0000", 2021-10-08T19:25:25.233 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/398006785": "2021-10-09T19:16:48.651177+0000", 2021-10-08T19:25:25.233 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/1642570050": "2021-10-09T19:16:48.651177+0000", 2021-10-08T19:25:25.234 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/300178790": "2021-10-09T19:16:48.651177+0000", 2021-10-08T19:25:25.234 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:6800/845999767": "2021-10-09T19:16:48.651177+0000" 2021-10-08T19:25:25.234 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.234 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profiles": { 2021-10-08T19:25:25.234 INFO:teuthology.orchestra.run.smithi097.stdout: "default": { 2021-10-08T19:25:25.235 INFO:teuthology.orchestra.run.smithi097.stdout: "crush-failure-domain": "osd", 2021-10-08T19:25:25.235 INFO:teuthology.orchestra.run.smithi097.stdout: "k": "2", 2021-10-08T19:25:25.235 INFO:teuthology.orchestra.run.smithi097.stdout: "m": "1", 2021-10-08T19:25:25.235 INFO:teuthology.orchestra.run.smithi097.stdout: "plugin": "jerasure", 2021-10-08T19:25:25.236 INFO:teuthology.orchestra.run.smithi097.stdout: "technique": "reed_sol_van" 2021-10-08T19:25:25.236 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:25.236 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:25.236 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps_queue": [], 2021-10-08T19:25:25.236 INFO:teuthology.orchestra.run.smithi097.stdout: "new_removed_snaps": [], 2021-10-08T19:25:25.237 INFO:teuthology.orchestra.run.smithi097.stdout: "new_purged_snaps": [], 2021-10-08T19:25:25.237 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_node_flags": {}, 2021-10-08T19:25:25.237 INFO:teuthology.orchestra.run.smithi097.stdout: "device_class_flags": {}, 2021-10-08T19:25:25.237 INFO:teuthology.orchestra.run.smithi097.stdout: "stretch_mode": { 2021-10-08T19:25:25.238 INFO:teuthology.orchestra.run.smithi097.stdout: "stretch_mode_enabled": false, 2021-10-08T19:25:25.238 INFO:teuthology.orchestra.run.smithi097.stdout: "stretch_bucket_count": 0, 2021-10-08T19:25:25.238 INFO:teuthology.orchestra.run.smithi097.stdout: "degraded_stretch_mode": 0, 2021-10-08T19:25:25.238 INFO:teuthology.orchestra.run.smithi097.stdout: "recovering_stretch_mode": 0, 2021-10-08T19:25:25.238 INFO:teuthology.orchestra.run.smithi097.stdout: "stretch_mode_bucket": 0 2021-10-08T19:25:25.239 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:25.239 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:25:25.239 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:25:25.272 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:25.624 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:25:25.626 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:25.627 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:25:25.728 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:25:25.776 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:25.895 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:25 smithi117 ceph-mon[34585]: pgmap v176: 168 pgs: 162 active+clean, 2 active+recovering+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 1 active+recovery_wait+degraded; 5.6 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 6.1 KiB/s rd, 55 MiB/s wr, 906 op/s; 6119/275523 objects degraded (2.221%); 7187/275523 objects misplaced (2.608%); 2.7 MiB/s, 43 objects/s recovering 2021-10-08T19:25:25.895 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:25 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3223880534' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2021-10-08T19:25:25.895 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:25 smithi117 ceph-mon[34585]: Health check update: Degraded data redundancy: 6119/275523 objects degraded (2.221%), 3 pgs degraded (PG_DEGRADED) 2021-10-08T19:25:25.897 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:25:25.909 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:25.909 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:25:25.911 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:25 smithi097 ceph-mon[32687]: pgmap v176: 168 pgs: 162 active+clean, 2 active+recovering+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 1 active+recovery_wait+degraded; 5.6 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 6.1 KiB/s rd, 55 MiB/s wr, 906 op/s; 6119/275523 objects degraded (2.221%); 7187/275523 objects misplaced (2.608%); 2.7 MiB/s, 43 objects/s recovering 2021-10-08T19:25:25.911 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:25 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3223880534' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2021-10-08T19:25:25.911 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:25 smithi097 ceph-mon[32687]: Health check update: Degraded data redundancy: 6119/275523 objects degraded (2.221%), 3 pgs degraded (PG_DEGRADED) 2021-10-08T19:25:25.911 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:25 smithi097 ceph-mon[41966]: pgmap v176: 168 pgs: 162 active+clean, 2 active+recovering+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 1 active+recovery_wait+degraded; 5.6 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 6.1 KiB/s rd, 55 MiB/s wr, 906 op/s; 6119/275523 objects degraded (2.221%); 7187/275523 objects misplaced (2.608%); 2.7 MiB/s, 43 objects/s recovering 2021-10-08T19:25:25.912 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:25 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3223880534' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2021-10-08T19:25:25.912 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:25 smithi097 ceph-mon[41966]: Health check update: Degraded data redundancy: 6119/275523 objects degraded (2.221%), 3 pgs degraded (PG_DEGRADED) 2021-10-08T19:25:26.011 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:25:26.065 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:26.129 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2021-10-08T19:25:26.157 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:25:26.167 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:26.168 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:25:26.269 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:25:26.364 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:26.655 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:25:26 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:25:26.710 INFO:tasks.thrashosds.thrasher:j is {'epoch': 135, 'fsid': '1d01f6d6-286c-11ec-8c25-001a4aab830c', 'created': '2021-10-08T19:16:25.258003+0000', 'modified': '2021-10-08T19:25:19.564772+0000', 'last_up_change': '2021-10-08T19:21:15.388758+0000', 'last_in_change': '2021-10-08T19:24:24.060804+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 18, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 7, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'quincy', 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2021-10-08T19:19:44.413311+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': '.rgw.root', 'create_time': '2021-10-08T19:21:21.940881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 3, 'pool_name': 'iscsi', 'create_time': '2021-10-08T19:21:22.536945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 23, 'pg_placement_num': 23, 'pg_placement_num_target': 23, 'pg_num_target': 23, 'pg_num_pending': 23, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '132', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '131', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 4, 'pool_name': 'default.rgw.log', 'create_time': '2021-10-08T19:21:23.886328+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 5, 'pool_name': 'default.rgw.control', 'create_time': '2021-10-08T19:21:25.865032+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 6, 'pool_name': 'default.rgw.meta', 'create_time': '2021-10-08T19:21:27.940767+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '69', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 8}, 'application_metadata': {'rgw': {}}}, {'pool': 7, 'pool_name': 'unique_pool_0', 'create_time': '2021-10-08T19:23:43.485480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '98', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}], 'osds': [{'osd': 0, 'uuid': '9e64e714-a5d5-4fbb-ae2b-1df4bf14b8e0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 132, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6801', 'nonce': 3354161282}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6802', 'nonce': 3354161282}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6804', 'nonce': 3354161282}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6803', 'nonce': 3354161282}]}, 'public_addr': '172.21.15.97:6801/3354161282', 'cluster_addr': '172.21.15.97:6802/3354161282', 'heartbeat_back_addr': '172.21.15.97:6804/3354161282', 'heartbeat_front_addr': '172.21.15.97:6803/3354161282', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '32602a22-f263-4b62-a8d8-50fddfb73fa8', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 131, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6805', 'nonce': 735799205}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6806', 'nonce': 735799205}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6808', 'nonce': 735799205}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6807', 'nonce': 735799205}]}, 'public_addr': '172.21.15.97:6805/735799205', 'cluster_addr': '172.21.15.97:6806/735799205', 'heartbeat_back_addr': '172.21.15.97:6808/735799205', 'heartbeat_front_addr': '172.21.15.97:6807/735799205', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '88e0e4a2-b4a3-4a00-8669-03c3d9b166c5', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 18, 'up_thru': 113, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6809', 'nonce': 2366482649}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6810', 'nonce': 2366482649}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6812', 'nonce': 2366482649}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6811', 'nonce': 2366482649}]}, 'public_addr': '172.21.15.97:6809/2366482649', 'cluster_addr': '172.21.15.97:6810/2366482649', 'heartbeat_back_addr': '172.21.15.97:6812/2366482649', 'heartbeat_front_addr': '172.21.15.97:6811/2366482649', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': 'e689d708-b501-4526-a31a-1e598b74654d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 24, 'up_thru': 131, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6813', 'nonce': 3191181122}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6814', 'nonce': 3191181122}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6816', 'nonce': 3191181122}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6815', 'nonce': 3191181122}]}, 'public_addr': '172.21.15.97:6813/3191181122', 'cluster_addr': '172.21.15.97:6814/3191181122', 'heartbeat_back_addr': '172.21.15.97:6816/3191181122', 'heartbeat_front_addr': '172.21.15.97:6815/3191181122', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '67e4730a-be1c-4d88-9307-e3c2cf3ab2ef', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 30, 'up_thru': 132, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6800', 'nonce': 106778208}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6801', 'nonce': 106778208}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6803', 'nonce': 106778208}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6802', 'nonce': 106778208}]}, 'public_addr': '172.21.15.117:6800/106778208', 'cluster_addr': '172.21.15.117:6801/106778208', 'heartbeat_back_addr': '172.21.15.117:6803/106778208', 'heartbeat_front_addr': '172.21.15.117:6802/106778208', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'f9fd3153-3e4e-4489-8927-a65641f05d42', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 38, 'up_thru': 132, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6804', 'nonce': 3199889891}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6805', 'nonce': 3199889891}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6807', 'nonce': 3199889891}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6806', 'nonce': 3199889891}]}, 'public_addr': '172.21.15.117:6804/3199889891', 'cluster_addr': '172.21.15.117:6805/3199889891', 'heartbeat_back_addr': '172.21.15.117:6807/3199889891', 'heartbeat_front_addr': '172.21.15.117:6806/3199889891', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '84898f12-c37d-4eb6-8b71-5b86bfe16e7d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 47, 'up_thru': 132, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6808', 'nonce': 2185843951}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6809', 'nonce': 2185843951}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6811', 'nonce': 2185843951}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6810', 'nonce': 2185843951}]}, 'public_addr': '172.21.15.117:6808/2185843951', 'cluster_addr': '172.21.15.117:6809/2185843951', 'heartbeat_back_addr': '172.21.15.117:6811/2185843951', 'heartbeat_front_addr': '172.21.15.117:6810/2185843951', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '529af2ce-2ae9-41ed-8c8e-d133628cfd20', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 55, 'up_thru': 132, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6812', 'nonce': 2817683239}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6813', 'nonce': 2817683239}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6815', 'nonce': 2817683239}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6814', 'nonce': 2817683239}]}, 'public_addr': '172.21.15.117:6812/2817683239', 'cluster_addr': '172.21.15.117:6813/2817683239', 'heartbeat_back_addr': '172.21.15.117:6815/2817683239', 'heartbeat_front_addr': '172.21.15.117:6814/2817683239', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:24:07.227563+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:24:51.166410+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:24:29.688484+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:24:34.979406+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:24:02.266300+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:25:17.830171+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:24:32.387840+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:24:51.598871+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [{'pgid': '2.0', 'mappings': [{'from': 7, 'to': 2}]}, {'pgid': '2.1a', 'mappings': [{'from': 7, 'to': 2}]}, {'pgid': '4.14', 'mappings': [{'from': 3, 'to': 2}]}, {'pgid': '4.18', 'mappings': [{'from': 1, 'to': 2}]}, {'pgid': '4.1c', 'mappings': [{'from': 1, 'to': 5}]}], 'pg_temp': [{'pgid': '7.1', 'osds': [4, 3]}, {'pgid': '7.7', 'osds': [0, 3]}, {'pgid': '7.b', 'osds': [1, 5]}, {'pgid': '7.c', 'osds': [2, 3, 7]}, {'pgid': '7.d', 'osds': [1, 0]}], 'primary_temp': [], 'blocklist': {'172.21.15.97:0/2600364788': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:0/4129083289': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:0/1443158975': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:0/2472640384': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:0/3196919488': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:6800/3195862546': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:6800/3931202434': '2021-10-09T19:17:10.051948+0000', '172.21.15.97:0/2761595213': '2021-10-09T19:17:10.051948+0000', '172.21.15.97:0/900681504': '2021-10-09T19:17:10.051948+0000', '172.21.15.97:0/3932251406': '2021-10-09T19:17:10.051948+0000', '172.21.15.97:0/398006785': '2021-10-09T19:16:48.651177+0000', '172.21.15.97:0/1642570050': '2021-10-09T19:16:48.651177+0000', '172.21.15.97:0/300178790': '2021-10-09T19:16:48.651177+0000', '172.21.15.97:6800/845999767': '2021-10-09T19:16:48.651177+0000'}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2021-10-08T19:25:26.710 INFO:tasks.thrashosds.thrasher:Clearing pg_upmap on 4.18 2021-10-08T19:25:26.711 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd rm-pg-upmap-items 4.18 2021-10-08T19:25:26.932 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:25:26.953 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:26.953 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:25:27.055 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:25:27.070 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:25:27.163 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:27.314 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:25:27.321 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:27.322 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:25:27.423 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:25:27.459 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:27.690 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:25:27.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:27 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:25:27.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:27 smithi117 ceph-mon[34585]: pgmap v177: 168 pgs: 162 active+clean, 2 active+recovering+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 1 active+recovery_wait+degraded; 5.6 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 767 B/s rd, 50 MiB/s wr, 818 op/s; 6119/275523 objects degraded (2.221%); 7187/275523 objects misplaced (2.608%); 2.3 MiB/s, 36 objects/s recovering 2021-10-08T19:25:27.983 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:27 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:25:27.984 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:27 smithi097 ceph-mon[32687]: pgmap v177: 168 pgs: 162 active+clean, 2 active+recovering+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 1 active+recovery_wait+degraded; 5.6 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 767 B/s rd, 50 MiB/s wr, 818 op/s; 6119/275523 objects degraded (2.221%); 7187/275523 objects misplaced (2.608%); 2.3 MiB/s, 36 objects/s recovering 2021-10-08T19:25:27.984 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:27 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:25:27.985 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:27 smithi097 ceph-mon[41966]: pgmap v177: 168 pgs: 162 active+clean, 2 active+recovering+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 1 active+recovery_wait+degraded; 5.6 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 767 B/s rd, 50 MiB/s wr, 818 op/s; 6119/275523 objects degraded (2.221%); 7187/275523 objects misplaced (2.608%); 2.3 MiB/s, 36 objects/s recovering 2021-10-08T19:25:28.042 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:25:28.044 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:28.045 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:25:28.146 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:25:28.189 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:28.399 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:25:28.409 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:28.409 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:25:28.511 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:25:28.547 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:28.663 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:28 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/4116032038' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:25:28.663 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:28 smithi097 ceph-mon[41966]: from='client.24901 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:25:28.664 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:28 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/4116032038' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:25:28.664 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:28 smithi097 ceph-mon[32687]: from='client.24901 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:25:28.664 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:25:28.668 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:28.669 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:25:28.671 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2021-10-08T19:25:28.672 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:25:28.695 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is unset 2021-10-08T19:25:28.771 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:25:28.835 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:29.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:28 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/4116032038' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:25:29.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:28 smithi117 ceph-mon[34585]: from='client.24901 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:25:29.714 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2021-10-08T19:25:29.941 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:25:29.946 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:29 smithi097 ceph-mon[41966]: pgmap v178: 168 pgs: 162 active+clean, 2 active+recovering+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovery_wait+degraded, 1 active+recovering+remapped; 5.6 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.1 KiB/s rd, 28 MiB/s wr, 537 op/s; 6119/273585 objects degraded (2.237%); 7129/273585 objects misplaced (2.606%); 1.5 MiB/s, 23 objects/s recovering 2021-10-08T19:25:29.946 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:29 smithi097 ceph-mon[41966]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:25:29.947 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:29 smithi097 ceph-mon[41966]: from='client.24901 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:25:29.947 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:29 smithi097 ceph-mon[41966]: osdmap e136: 8 total, 8 up, 8 in 2021-10-08T19:25:29.948 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:29.949 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:25:29.949 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:29 smithi097 ceph-mon[32687]: pgmap v178: 168 pgs: 162 active+clean, 2 active+recovering+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovery_wait+degraded, 1 active+recovering+remapped; 5.6 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.1 KiB/s rd, 28 MiB/s wr, 537 op/s; 6119/273585 objects degraded (2.237%); 7129/273585 objects misplaced (2.606%); 1.5 MiB/s, 23 objects/s recovering 2021-10-08T19:25:29.949 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:29 smithi097 ceph-mon[32687]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:25:29.949 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:29 smithi097 ceph-mon[32687]: from='client.24901 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:25:29.950 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:29 smithi097 ceph-mon[32687]: osdmap e136: 8 total, 8 up, 8 in 2021-10-08T19:25:30.050 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:25:30.084 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:29 smithi117 ceph-mon[34585]: pgmap v178: 168 pgs: 162 active+clean, 2 active+recovering+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovery_wait+degraded, 1 active+recovering+remapped; 5.6 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.1 KiB/s rd, 28 MiB/s wr, 537 op/s; 6119/273585 objects degraded (2.237%); 7129/273585 objects misplaced (2.606%); 1.5 MiB/s, 23 objects/s recovering 2021-10-08T19:25:30.085 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:29 smithi117 ceph-mon[34585]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:25:30.086 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:29 smithi117 ceph-mon[34585]: from='client.24901 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:25:30.086 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:29 smithi117 ceph-mon[34585]: osdmap e136: 8 total, 8 up, 8 in 2021-10-08T19:25:30.092 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:30.171 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:25:30.182 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:30.183 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:25:30.286 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:25:30.294 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:25:30.353 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:30.637 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:25:30.651 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:30.652 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:25:30.753 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:25:30.813 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:30.886 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:25:30.892 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:30.893 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:25:30.894 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:30 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:25:30.894 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:30 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:25:30.895 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:30 smithi117 ceph-mon[34585]: osdmap e137: 8 total, 8 up, 8 in 2021-10-08T19:25:30.895 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:30 smithi117 ceph-mon[34585]: Health check update: Degraded data redundancy: 6119/273585 objects degraded (2.237%), 3 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:25:30.935 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:30 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:25:30.936 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:30 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:25:30.936 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:30 smithi097 ceph-mon[32687]: osdmap e137: 8 total, 8 up, 8 in 2021-10-08T19:25:30.936 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:30 smithi097 ceph-mon[32687]: Health check update: Degraded data redundancy: 6119/273585 objects degraded (2.237%), 3 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:25:30.939 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:30 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:25:30.940 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:30 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:25:30.940 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:30 smithi097 ceph-mon[41966]: osdmap e137: 8 total, 8 up, 8 in 2021-10-08T19:25:30.940 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:30 smithi097 ceph-mon[41966]: Health check update: Degraded data redundancy: 6119/273585 objects degraded (2.237%), 3 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:25:30.994 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:25:31.022 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:31.154 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:25:31.159 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:31.160 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:25:31.242 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:25:31.261 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:25:31.288 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:25:31.324 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:25:31.335 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:31.366 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:25:31.409 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:25:31.426 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:25:31.441 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:31.442 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:25:31.453 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:25:31.495 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:25:31.542 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:25:31.544 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:25:31.560 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true' 2021-10-08T19:25:31.560 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true' 2021-10-08T19:25:31.561 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true' 2021-10-08T19:25:31.561 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true' 2021-10-08T19:25:31.561 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true' 2021-10-08T19:25:31.561 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true' 2021-10-08T19:25:31.562 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'true' 2021-10-08T19:25:31.562 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'true' 2021-10-08T19:25:31.610 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:31.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:31 smithi097 ceph-mon[41966]: pgmap v181: 168 pgs: 162 active+clean, 2 active+recovering+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 1 active+recovery_wait+degraded; 5.4 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.4 KiB/s rd, 26 MiB/s wr, 887 op/s; 6119/264915 objects degraded (2.310%); 7011/264915 objects misplaced (2.647%); 2.7 MiB/s, 43 objects/s recovering 2021-10-08T19:25:31.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:31 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3378078603' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:25:31.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:31 smithi097 ceph-mon[32687]: pgmap v181: 168 pgs: 162 active+clean, 2 active+recovering+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 1 active+recovery_wait+degraded; 5.4 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.4 KiB/s rd, 26 MiB/s wr, 887 op/s; 6119/264915 objects degraded (2.310%); 7011/264915 objects misplaced (2.647%); 2.7 MiB/s, 43 objects/s recovering 2021-10-08T19:25:31.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:31 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3378078603' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:25:31.831 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:25:31.836 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:31.837 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:25:31.939 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:25:31.968 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:31 smithi117 ceph-mon[34585]: pgmap v181: 168 pgs: 162 active+clean, 2 active+recovering+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 1 active+recovery_wait+degraded; 5.4 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.4 KiB/s rd, 26 MiB/s wr, 887 op/s; 6119/264915 objects degraded (2.310%); 7011/264915 objects misplaced (2.647%); 2.7 MiB/s, 43 objects/s recovering 2021-10-08T19:25:31.969 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:31 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3378078603' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:25:31.977 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:32.496 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:25:32.500 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:32.501 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:25:32.540 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset nodeep-scrub 2021-10-08T19:25:32.603 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:25:32.655 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:25:32 smithi117 conmon[69189]: level=error ts=2021-10-08T19:25:32.314Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=1 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:25:32.675 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:32.723 INFO:teuthology.orchestra.run.smithi097.stderr:clear 4.18 pg_upmap_items mapping 2021-10-08T19:25:32.853 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:25:32.864 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:32.865 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:25:32.865 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:32 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1720519577' entity='client.admin' cmd=[{"prefix": "osd rm-pg-upmap-items", "pgid": "4.18"}]: dispatch 2021-10-08T19:25:32.866 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:32 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1720519577' entity='client.admin' cmd=[{"prefix": "osd rm-pg-upmap-items", "pgid": "4.18"}]: dispatch 2021-10-08T19:25:32.866 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:25:32 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:25:32] "GET /metrics HTTP/1.1" 200 155717 "" "Prometheus/2.18.1" 2021-10-08T19:25:32.966 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:25:33.004 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:32 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1720519577' entity='client.admin' cmd=[{"prefix": "osd rm-pg-upmap-items", "pgid": "4.18"}]: dispatch 2021-10-08T19:25:33.008 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:33.195 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:25:33.200 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:33.200 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:25:33.301 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:25:33.346 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:33.440 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:25:33.440 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2021-10-08T19:25:33.440 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:33.441 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.24796.0:99328 7.b e138/113 7:d2dfc19e:::benchmark_data_smithi097_93198_object7508:head v 138'6240, mlcod=0'0)", 2021-10-08T19:25:33.441 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:25:33.436281+0000", 2021-10-08T19:25:33.441 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.002812232, 2021-10-08T19:25:33.441 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028385709999999998, 2021-10-08T19:25:33.441 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:25:33.442 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2021-10-08T19:25:33.442 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:25:33.442 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:33.442 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:25:33.443 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:33.436281+0000", 2021-10-08T19:25:33.443 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:33.443 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:33.443 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:33.443 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:25:33.444 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:33.436281+0000", 2021-10-08T19:25:33.444 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:33.444 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:33.444 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:33.445 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:25:33.445 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:33.436279+0000", 2021-10-08T19:25:33.445 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:25:33.446 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:33.446 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:33.446 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:25:33.446 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:33.436289+0000", 2021-10-08T19:25:33.446 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0224000000000001e-05 2021-10-08T19:25:33.447 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:33.447 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:33.447 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:25:33.447 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:33.436305+0000", 2021-10-08T19:25:33.448 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5313999999999999e-05 2021-10-08T19:25:33.448 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:33.448 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:33.448 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:25:33.448 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:33.436311+0000", 2021-10-08T19:25:33.449 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4790000000000001e-06 2021-10-08T19:25:33.449 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:33.449 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:33.449 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:25:33.449 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:33.436370+0000", 2021-10-08T19:25:33.450 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9410000000000002e-05 2021-10-08T19:25:33.450 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:33.450 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:33.450 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:25:33.450 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:33.436395+0000", 2021-10-08T19:25:33.451 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4723999999999999e-05 2021-10-08T19:25:33.451 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:33.451 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:25:33.451 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:33.452 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:33.452 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:33.452 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.24796.0:99325 7.7 e138/113 7:e415afec:::benchmark_data_smithi097_93198_object7505:head v 138'6129, mlcod=0'0)", 2021-10-08T19:25:33.452 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:25:33.439001+0000", 2021-10-08T19:25:33.452 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 9.2214999999999997e-05, 2021-10-08T19:25:33.453 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00018833000000000001, 2021-10-08T19:25:33.453 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:25:33.453 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2021-10-08T19:25:33.453 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:25:33.453 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:33.454 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:25:33.454 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:33.439001+0000", 2021-10-08T19:25:33.454 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:33.454 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:33.454 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:33.455 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:25:33.455 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:33.439001+0000", 2021-10-08T19:25:33.455 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:33.455 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:33.456 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:33.456 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:25:33.456 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:33.438999+0000", 2021-10-08T19:25:33.456 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:25:33.456 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:33.457 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:33.457 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:25:33.457 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:33.439008+0000", 2021-10-08T19:25:33.457 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.1400000000000006e-06 2021-10-08T19:25:33.457 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:33.458 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:33.458 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:25:33.458 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:33.439021+0000", 2021-10-08T19:25:33.458 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3380000000000001e-05 2021-10-08T19:25:33.459 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:33.459 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:33.459 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:25:33.459 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:33.439027+0000", 2021-10-08T19:25:33.459 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.3340000000000001e-06 2021-10-08T19:25:33.460 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:33.460 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:33.460 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:25:33.460 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:33.439073+0000", 2021-10-08T19:25:33.460 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.6088999999999999e-05 2021-10-08T19:25:33.461 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:33.461 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:33.461 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:25:33.461 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:33.439095+0000", 2021-10-08T19:25:33.461 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1871000000000001e-05 2021-10-08T19:25:33.462 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:33.462 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:25:33.462 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:33.462 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:33.463 INFO:teuthology.orchestra.run.smithi117.stdout: ], 2021-10-08T19:25:33.463 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 2 2021-10-08T19:25:33.463 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:25:33.466 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:25:33.469 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:33.470 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:25:33.571 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:25:33.616 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:25:33.665 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:33.790 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:25:33.797 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:33.798 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:25:33.899 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:25:33.946 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:33 smithi097 ceph-mon[32687]: pgmap v182: 168 pgs: 162 active+clean, 2 active+recovering+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 1 active+recovery_wait+degraded; 5.4 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 442 op/s; 6119/264915 objects degraded (2.310%); 7011/264915 objects misplaced (2.647%); 1.4 MiB/s, 21 objects/s recovering 2021-10-08T19:25:33.946 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:33 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1720519577' entity='client.admin' cmd='[{"prefix": "osd rm-pg-upmap-items", "pgid": "4.18"}]': finished 2021-10-08T19:25:33.947 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:33 smithi097 ceph-mon[32687]: osdmap e138: 8 total, 8 up, 8 in 2021-10-08T19:25:33.947 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:33 smithi097 ceph-mon[41966]: pgmap v182: 168 pgs: 162 active+clean, 2 active+recovering+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 1 active+recovery_wait+degraded; 5.4 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 442 op/s; 6119/264915 objects degraded (2.310%); 7011/264915 objects misplaced (2.647%); 1.4 MiB/s, 21 objects/s recovering 2021-10-08T19:25:33.947 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:33 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1720519577' entity='client.admin' cmd='[{"prefix": "osd rm-pg-upmap-items", "pgid": "4.18"}]': finished 2021-10-08T19:25:33.948 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:33 smithi097 ceph-mon[41966]: osdmap e138: 8 total, 8 up, 8 in 2021-10-08T19:25:33.949 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:34.078 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:25:34.081 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:34.082 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:25:34.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:25:33 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:25:33] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:25:34.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:33 smithi117 ceph-mon[34585]: pgmap v182: 168 pgs: 162 active+clean, 2 active+recovering+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 1 active+recovery_wait+degraded; 5.4 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 442 op/s; 6119/264915 objects degraded (2.310%); 7011/264915 objects misplaced (2.647%); 1.4 MiB/s, 21 objects/s recovering 2021-10-08T19:25:34.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:33 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1720519577' entity='client.admin' cmd='[{"prefix": "osd rm-pg-upmap-items", "pgid": "4.18"}]': finished 2021-10-08T19:25:34.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:33 smithi117 ceph-mon[34585]: osdmap e138: 8 total, 8 up, 8 in 2021-10-08T19:25:34.183 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:25:34.215 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:34.629 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2021-10-08T19:25:34.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:34 smithi097 ceph-mon[41966]: osdmap e139: 8 total, 8 up, 8 in 2021-10-08T19:25:34.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:34 smithi097 ceph-mon[32687]: osdmap e139: 8 total, 8 up, 8 in 2021-10-08T19:25:34.971 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:25:34.973 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:34.974 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:25:34.994 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:34 smithi117 ceph-mon[34585]: osdmap e139: 8 total, 8 up, 8 in 2021-10-08T19:25:34.996 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2021-10-08T19:25:35.075 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:25:35.140 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:35.463 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:25:35.495 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:25:35.577 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:25:35.583 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:35.584 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:25:35.685 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:25:35.720 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:35.839 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:35 smithi097 ceph-mon[32687]: pgmap v185: 168 pgs: 1 peering, 161 active+clean, 2 active+recovering+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 1 active+recovery_wait+degraded; 5.1 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 877 B/s rd, 0 B/s wr, 666 op/s; 6119/253257 objects degraded (2.416%); 6837/253257 objects misplaced (2.700%); 1.9 MiB/s, 29 objects/s recovering 2021-10-08T19:25:35.839 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:35 smithi097 ceph-mon[32687]: Health check update: Degraded data redundancy: 6119/253257 objects degraded (2.416%), 3 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:25:35.840 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:35 smithi097 ceph-mon[41966]: pgmap v185: 168 pgs: 1 peering, 161 active+clean, 2 active+recovering+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 1 active+recovery_wait+degraded; 5.1 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 877 B/s rd, 0 B/s wr, 666 op/s; 6119/253257 objects degraded (2.416%); 6837/253257 objects misplaced (2.700%); 1.9 MiB/s, 29 objects/s recovering 2021-10-08T19:25:35.840 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:35 smithi097 ceph-mon[41966]: Health check update: Degraded data redundancy: 6119/253257 objects degraded (2.416%), 3 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:25:35.891 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:25:35.915 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:35.916 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:25:36.017 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:25:36.085 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:36.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:35 smithi117 ceph-mon[34585]: pgmap v185: 168 pgs: 1 peering, 161 active+clean, 2 active+recovering+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 1 active+recovery_wait+degraded; 5.1 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 877 B/s rd, 0 B/s wr, 666 op/s; 6119/253257 objects degraded (2.416%); 6837/253257 objects misplaced (2.700%); 1.9 MiB/s, 29 objects/s recovering 2021-10-08T19:25:36.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:35 smithi117 ceph-mon[34585]: Health check update: Degraded data redundancy: 6119/253257 objects degraded (2.416%), 3 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:25:36.470 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:25:36 smithi097 conmon[33110]: 172.21.15.117 - - [08/Oct/2021:19:25:36] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:36.655 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:25:36 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:25:37.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:36 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:25:37.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:36 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:25:37.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:36 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:25:37.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:36 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:37.160 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:36 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:25:37.160 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:36 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:25:37.160 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:36 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:25:37.160 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:36 smithi117 ceph-mon[34585]: osdmap e140: 8 total, 8 up, 8 in 2021-10-08T19:25:37.173 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:25:37.182 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:36 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:25:37.182 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:36 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:25:37.183 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:36 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:25:37.183 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:36 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:37.183 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:36 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:25:37.183 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:36 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:25:37.184 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:36 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:25:37.184 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:36 smithi097 ceph-mon[41966]: osdmap e140: 8 total, 8 up, 8 in 2021-10-08T19:25:37.185 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:36 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:25:37.185 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:36 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:25:37.185 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:36 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:25:37.186 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:36 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:37.186 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:36 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:25:37.186 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:36 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:25:37.186 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:36 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:25:37.187 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:36 smithi097 ceph-mon[32687]: osdmap e140: 8 total, 8 up, 8 in 2021-10-08T19:25:37.187 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:37.188 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:25:37.289 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:25:37.354 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:37.781 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is unset 2021-10-08T19:25:37.866 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:25:37.867 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2021-10-08T19:25:37.867 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2021-10-08T19:25:37.867 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2021-10-08T19:25:37.868 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:25:37.889 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:37 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:25:37.890 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:37 smithi117 ceph-mon[34585]: 172.21.15.117 - - [08/Oct/2021:19:25:36] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:37.890 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:37 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:25:37.890 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:37 smithi117 ceph-mon[34585]: pgmap v187: 168 pgs: 1 peering, 161 active+clean, 2 active+recovering+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 1 active+recovery_wait+degraded; 5.1 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 648 op/s; 6119/253257 objects degraded (2.416%); 6837/253257 objects misplaced (2.700%); 1.8 MiB/s, 28 objects/s recovering 2021-10-08T19:25:37.890 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:37 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2424936046' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:25:37.891 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:37 smithi117 ceph-mon[34585]: from='client.24916 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:25:38.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:37 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:25:38.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:37 smithi097 ceph-mon[41966]: 172.21.15.117 - - [08/Oct/2021:19:25:36] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:38.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:37 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:25:38.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:37 smithi097 ceph-mon[41966]: pgmap v187: 168 pgs: 1 peering, 161 active+clean, 2 active+recovering+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 1 active+recovery_wait+degraded; 5.1 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 648 op/s; 6119/253257 objects degraded (2.416%); 6837/253257 objects misplaced (2.700%); 1.8 MiB/s, 28 objects/s recovering 2021-10-08T19:25:38.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:37 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2424936046' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:25:38.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:37 smithi097 ceph-mon[41966]: from='client.24916 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:25:38.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:37 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:25:38.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:37 smithi097 ceph-mon[32687]: 172.21.15.117 - - [08/Oct/2021:19:25:36] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:38.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:37 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:25:38.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:37 smithi097 ceph-mon[32687]: pgmap v187: 168 pgs: 1 peering, 161 active+clean, 2 active+recovering+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 1 active+recovery_wait+degraded; 5.1 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 648 op/s; 6119/253257 objects degraded (2.416%); 6837/253257 objects misplaced (2.700%); 1.8 MiB/s, 28 objects/s recovering 2021-10-08T19:25:38.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:37 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2424936046' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:25:38.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:37 smithi097 ceph-mon[32687]: from='client.24916 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:25:38.331 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:25:38.341 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:38.342 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:25:38.444 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:25:38.481 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:38.627 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 7, 6] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2021-10-08T19:25:38.627 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2021-10-08T19:25:38.628 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd dump -f json-pretty 2021-10-08T19:25:38.694 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:25:38.700 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:38.700 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:25:38.801 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:25:38.858 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2021-10-08T19:25:38.884 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:38.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:38 smithi097 ceph-mon[41966]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:25:38.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:38 smithi097 ceph-mon[41966]: from='client.24916 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:25:38.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:38 smithi097 ceph-mon[41966]: osdmap e141: 8 total, 8 up, 8 in 2021-10-08T19:25:38.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:38 smithi097 ceph-mon[32687]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:25:38.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:38 smithi097 ceph-mon[32687]: from='client.24916 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:25:38.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:38 smithi097 ceph-mon[32687]: osdmap e141: 8 total, 8 up, 8 in 2021-10-08T19:25:39.117 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:25:39.127 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:39.128 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:25:39.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:38 smithi117 ceph-mon[34585]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:25:39.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:38 smithi117 ceph-mon[34585]: from='client.24916 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:25:39.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:38 smithi117 ceph-mon[34585]: osdmap e141: 8 total, 8 up, 8 in 2021-10-08T19:25:39.212 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:25:39.231 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:25:39.266 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:39.403 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:25:39.405 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:39.406 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:25:39.407 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:25:39.508 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:25:39.526 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:25:39.538 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:39.567 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:25:39.598 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:25:39.608 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:25:39.613 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:39.614 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:25:39.632 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:25:39.662 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:25:39.695 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:25:39.715 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:25:39.731 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:25:39.781 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:25:39.792 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'false' 2021-10-08T19:25:39.792 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'false' 2021-10-08T19:25:39.792 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'false' 2021-10-08T19:25:39.792 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'false' 2021-10-08T19:25:39.793 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'false' 2021-10-08T19:25:39.793 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'false' 2021-10-08T19:25:39.793 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'false' 2021-10-08T19:25:39.793 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'false' 2021-10-08T19:25:39.799 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:39.962 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:25:39.976 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:39.977 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:25:40.078 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:25:40.090 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:39 smithi097 ceph-mon[41966]: pgmap v189: 168 pgs: 161 active+clean, 2 active+recovering+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovery_wait+degraded, 1 active+recovering+remapped; 5.1 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 792 op/s; 6123/251136 objects degraded (2.438%); 6779/251136 objects misplaced (2.699%); 2.5 MiB/s, 39 objects/s recovering 2021-10-08T19:25:40.092 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:39 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3057443115' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:25:40.092 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:39 smithi097 ceph-mon[32687]: pgmap v189: 168 pgs: 161 active+clean, 2 active+recovering+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovery_wait+degraded, 1 active+recovering+remapped; 5.1 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 792 op/s; 6123/251136 objects degraded (2.438%); 6779/251136 objects misplaced (2.699%); 2.5 MiB/s, 39 objects/s recovering 2021-10-08T19:25:40.093 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:39 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3057443115' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:25:40.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:39 smithi117 ceph-mon[34585]: pgmap v189: 168 pgs: 161 active+clean, 2 active+recovering+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovery_wait+degraded, 1 active+recovering+remapped; 5.1 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 792 op/s; 6123/251136 objects degraded (2.438%); 6779/251136 objects misplaced (2.699%); 2.5 MiB/s, 39 objects/s recovering 2021-10-08T19:25:40.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:39 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3057443115' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:25:40.164 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:41.050 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set noscrub 2021-10-08T19:25:41.087 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:40 smithi117 ceph-mon[34585]: Health check update: Degraded data redundancy: 6123/251136 objects degraded (2.438%), 4 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:25:41.112 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:40 smithi097 ceph-mon[32687]: Health check update: Degraded data redundancy: 6123/251136 objects degraded (2.438%), 4 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:25:41.112 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:40 smithi097 ceph-mon[41966]: Health check update: Degraded data redundancy: 6123/251136 objects degraded (2.438%), 4 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:25:41.138 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:25:41.154 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:41.155 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:25:41.258 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:25:41.304 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:41.349 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2021-10-08T19:25:41.350 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:25:41.368 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:25:41.370 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:41.371 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:25:41.473 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:25:41.517 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:41.633 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:25:41.635 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:41.636 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:25:41.737 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:25:41.807 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:41.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:41 smithi117 ceph-mon[34585]: pgmap v190: 168 pgs: 161 active+clean, 2 active+recovering+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 4.9 GiB data, 16 GiB used, 700 GiB / 715 GiB avail; 752 B/s rd, 0 B/s wr, 565 op/s; 6123/241740 objects degraded (2.533%); 6663/241740 objects misplaced (2.756%); 1.6 MiB/s, 25 objects/s recovering 2021-10-08T19:25:42.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:41 smithi097 ceph-mon[32687]: pgmap v190: 168 pgs: 161 active+clean, 2 active+recovering+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 4.9 GiB data, 16 GiB used, 700 GiB / 715 GiB avail; 752 B/s rd, 0 B/s wr, 565 op/s; 6123/241740 objects degraded (2.533%); 6663/241740 objects misplaced (2.756%); 1.6 MiB/s, 25 objects/s recovering 2021-10-08T19:25:42.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:41 smithi097 ceph-mon[41966]: pgmap v190: 168 pgs: 161 active+clean, 2 active+recovering+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 4.9 GiB data, 16 GiB used, 700 GiB / 715 GiB avail; 752 B/s rd, 0 B/s wr, 565 op/s; 6123/241740 objects degraded (2.533%); 6663/241740 objects misplaced (2.756%); 1.6 MiB/s, 25 objects/s recovering 2021-10-08T19:25:42.241 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2021-10-08T19:25:42.529 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:25:42.536 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:42.537 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:25:42.562 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:25:42.590 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:25:42.638 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:25:42.710 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:42.841 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:42 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:25:42.841 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:25:42 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:25:42] "GET /metrics HTTP/1.1" 200 155724 "" "Prometheus/2.18.1" 2021-10-08T19:25:42.910 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:25:42.915 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:42.916 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:25:43.018 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:25:43.057 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:43.117 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:25:43.119 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:42 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:25:43.119 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:42 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:25:43.119 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:42 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:25:43.120 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:43.121 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:25:43.142 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:42 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:25:43.142 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:42 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:25:43.143 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:42 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:25:43.143 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:42 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:25:43.143 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:42 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:25:43.222 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:25:43.292 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:43.547 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:25:43.560 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:43.561 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:25:43.662 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:25:43.745 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:43.847 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2021-10-08T19:25:43.988 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:25:43.993 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:43.993 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:43 smithi097 ceph-mon[32687]: pgmap v191: 168 pgs: 161 active+clean, 2 active+recovering+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 4.9 GiB data, 16 GiB used, 700 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 480 op/s; 6123/241740 objects degraded (2.533%); 6663/241740 objects misplaced (2.756%); 1.4 MiB/s, 21 objects/s recovering 2021-10-08T19:25:43.994 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:25:43.994 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:43 smithi097 ceph-mon[32687]: osdmap e142: 8 total, 8 up, 8 in 2021-10-08T19:25:43.994 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:43 smithi097 ceph-mon[41966]: pgmap v191: 168 pgs: 161 active+clean, 2 active+recovering+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 4.9 GiB data, 16 GiB used, 700 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 480 op/s; 6123/241740 objects degraded (2.533%); 6663/241740 objects misplaced (2.756%); 1.4 MiB/s, 21 objects/s recovering 2021-10-08T19:25:43.995 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:25:43.995 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:43 smithi097 ceph-mon[41966]: osdmap e142: 8 total, 8 up, 8 in 2021-10-08T19:25:43.996 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:25:44.097 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:25:44.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:25:43 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:25:43] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:25:44.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:43 smithi117 ceph-mon[34585]: pgmap v191: 168 pgs: 161 active+clean, 2 active+recovering+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 4.9 GiB data, 16 GiB used, 700 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 480 op/s; 6123/241740 objects degraded (2.533%); 6663/241740 objects misplaced (2.756%); 1.4 MiB/s, 21 objects/s recovering 2021-10-08T19:25:44.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:25:44.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:43 smithi117 ceph-mon[34585]: osdmap e142: 8 total, 8 up, 8 in 2021-10-08T19:25:44.165 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:44.215 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:25:44.215 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:25:44.216 INFO:teuthology.orchestra.run.smithi097.stdout: "epoch": 142, 2021-10-08T19:25:44.216 INFO:teuthology.orchestra.run.smithi097.stdout: "fsid": "1d01f6d6-286c-11ec-8c25-001a4aab830c", 2021-10-08T19:25:44.216 INFO:teuthology.orchestra.run.smithi097.stdout: "created": "2021-10-08T19:16:25.258003+0000", 2021-10-08T19:25:44.216 INFO:teuthology.orchestra.run.smithi097.stdout: "modified": "2021-10-08T19:25:42.810856+0000", 2021-10-08T19:25:44.217 INFO:teuthology.orchestra.run.smithi097.stdout: "last_up_change": "2021-10-08T19:21:15.388758+0000", 2021-10-08T19:25:44.217 INFO:teuthology.orchestra.run.smithi097.stdout: "last_in_change": "2021-10-08T19:24:24.060804+0000", 2021-10-08T19:25:44.217 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-08T19:25:44.217 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_num": 5799936, 2021-10-08T19:25:44.218 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_set": [ 2021-10-08T19:25:44.218 INFO:teuthology.orchestra.run.smithi097.stdout: "pglog_hardlimit", 2021-10-08T19:25:44.218 INFO:teuthology.orchestra.run.smithi097.stdout: "purged_snapdirs", 2021-10-08T19:25:44.218 INFO:teuthology.orchestra.run.smithi097.stdout: "recovery_deletes", 2021-10-08T19:25:44.219 INFO:teuthology.orchestra.run.smithi097.stdout: "sortbitwise" 2021-10-08T19:25:44.219 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:25:44.219 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_version": 18, 2021-10-08T19:25:44.219 INFO:teuthology.orchestra.run.smithi097.stdout: "full_ratio": 0.94999998807907104, 2021-10-08T19:25:44.220 INFO:teuthology.orchestra.run.smithi097.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-08T19:25:44.220 INFO:teuthology.orchestra.run.smithi097.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-08T19:25:44.220 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_snapshot": "", 2021-10-08T19:25:44.220 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_max": 7, 2021-10-08T19:25:44.221 INFO:teuthology.orchestra.run.smithi097.stdout: "max_osd": 8, 2021-10-08T19:25:44.221 INFO:teuthology.orchestra.run.smithi097.stdout: "require_min_compat_client": "luminous", 2021-10-08T19:25:44.221 INFO:teuthology.orchestra.run.smithi097.stdout: "min_compat_client": "luminous", 2021-10-08T19:25:44.221 INFO:teuthology.orchestra.run.smithi097.stdout: "require_osd_release": "quincy", 2021-10-08T19:25:44.222 INFO:teuthology.orchestra.run.smithi097.stdout: "pools": [ 2021-10-08T19:25:44.222 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.222 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 1, 2021-10-08T19:25:44.222 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": ".mgr", 2021-10-08T19:25:44.223 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:19:44.413311+0000", 2021-10-08T19:25:44.223 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:25:44.223 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:25:44.223 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:25:44.224 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:25:44.224 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:25:44.224 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:25:44.224 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:25:44.224 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:25:44.225 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:25:44.225 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:25:44.225 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:25:44.225 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:25:44.226 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 1, 2021-10-08T19:25:44.226 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 1, 2021-10-08T19:25:44.226 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 1, 2021-10-08T19:25:44.226 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 1, 2021-10-08T19:25:44.227 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 1, 2021-10-08T19:25:44.227 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:25:44.227 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:25:44.228 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:25:44.228 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:25:44.228 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:25:44.228 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:25:44.228 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:25:44.229 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.229 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "21", 2021-10-08T19:25:44.229 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:25:44.230 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:25:44.230 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2021-10-08T19:25:44.230 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:25:44.230 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:25:44.231 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:25:44.231 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:25:44.231 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:25:44.232 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:25:44.232 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:25:44.232 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:25:44.232 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:25:44.233 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:25:44.233 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:25:44.233 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:25:44.233 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:25:44.234 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:25:44.234 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:25:44.234 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:25:44.235 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:25:44.235 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:25:44.235 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:25:44.235 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:25:44.236 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:25:44.236 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:25:44.236 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:25:44.236 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.237 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:25:44.237 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:25:44.237 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:25:44.237 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:25:44.238 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:25:44.238 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:25:44.238 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:25:44.238 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:25:44.238 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:25:44.239 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:25:44.239 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:25:44.239 INFO:teuthology.orchestra.run.smithi097.stdout: "options": { 2021-10-08T19:25:44.239 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_min": 1 2021-10-08T19:25:44.240 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.240 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:25:44.240 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": {} 2021-10-08T19:25:44.240 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:44.241 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.241 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.241 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 2, 2021-10-08T19:25:44.241 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": ".rgw.root", 2021-10-08T19:25:44.242 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:21:21.940881+0000", 2021-10-08T19:25:44.242 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:25:44.242 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:25:44.242 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:25:44.243 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:25:44.243 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:25:44.243 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:25:44.243 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:25:44.243 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:25:44.244 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:25:44.244 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:25:44.244 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:25:44.244 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:25:44.245 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 32, 2021-10-08T19:25:44.245 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 32, 2021-10-08T19:25:44.245 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 32, 2021-10-08T19:25:44.245 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 32, 2021-10-08T19:25:44.246 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 32, 2021-10-08T19:25:44.246 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:25:44.246 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:25:44.246 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:25:44.246 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:25:44.247 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:25:44.247 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:25:44.247 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:25:44.247 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.248 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "62", 2021-10-08T19:25:44.248 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:25:44.248 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:25:44.248 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2021-10-08T19:25:44.249 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:25:44.249 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:25:44.249 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:25:44.249 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:25:44.250 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:25:44.250 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:25:44.250 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:25:44.250 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:25:44.252 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:25:44.253 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:25:44.253 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:25:44.253 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:25:44.253 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:25:44.253 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:25:44.254 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:25:44.254 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:25:44.254 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:25:44.254 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:25:44.255 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:25:44.255 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:25:44.255 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:25:44.255 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:25:44.255 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:25:44.256 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.256 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:25:44.256 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:25:44.256 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:25:44.257 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:25:44.257 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:25:44.257 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:25:44.257 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:25:44.258 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:25:44.258 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:25:44.258 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:25:44.258 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:25:44.258 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2021-10-08T19:25:44.259 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:25:44.259 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw": {} 2021-10-08T19:25:44.259 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:44.260 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.260 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.260 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 3, 2021-10-08T19:25:44.261 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "iscsi", 2021-10-08T19:25:44.261 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:21:22.536945+0000", 2021-10-08T19:25:44.261 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:25:44.261 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:25:44.262 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:25:44.263 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:25:44.263 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:25:44.263 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:25:44.263 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:25:44.264 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:25:44.264 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:25:44.264 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:25:44.264 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:25:44.264 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:25:44.265 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 23, 2021-10-08T19:25:44.265 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 23, 2021-10-08T19:25:44.265 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 23, 2021-10-08T19:25:44.265 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 23, 2021-10-08T19:25:44.266 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 23, 2021-10-08T19:25:44.266 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:25:44.266 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:25:44.266 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:25:44.267 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:25:44.267 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:25:44.267 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:25:44.267 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:25:44.268 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.268 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "132", 2021-10-08T19:25:44.268 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:25:44.268 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:25:44.268 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "131", 2021-10-08T19:25:44.269 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:25:44.269 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:25:44.269 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:25:44.269 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:25:44.270 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:25:44.270 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:25:44.271 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:25:44.271 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:25:44.271 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:25:44.271 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:25:44.272 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:25:44.272 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:25:44.272 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:25:44.273 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:25:44.273 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:25:44.273 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:25:44.273 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:25:44.274 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:25:44.274 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:25:44.274 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:25:44.275 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:25:44.275 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:25:44.275 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:25:44.275 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.275 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:25:44.276 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:25:44.276 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:25:44.276 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:25:44.276 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:25:44.277 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:25:44.277 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:25:44.277 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:25:44.277 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:25:44.277 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:25:44.278 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:25:44.278 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2021-10-08T19:25:44.278 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:25:44.278 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd": {} 2021-10-08T19:25:44.279 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:44.279 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.279 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.279 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 4, 2021-10-08T19:25:44.279 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "default.rgw.log", 2021-10-08T19:25:44.280 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:21:23.886328+0000", 2021-10-08T19:25:44.280 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:25:44.281 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:25:44.281 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:25:44.281 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:25:44.281 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:25:44.281 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:25:44.282 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:25:44.282 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:25:44.283 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:25:44.283 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:25:44.284 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:25:44.284 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:25:44.285 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 32, 2021-10-08T19:25:44.286 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 32, 2021-10-08T19:25:44.286 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 32, 2021-10-08T19:25:44.287 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 32, 2021-10-08T19:25:44.287 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 32, 2021-10-08T19:25:44.287 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:25:44.287 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:25:44.288 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:25:44.288 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:25:44.288 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:25:44.288 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:25:44.289 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:25:44.289 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.289 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "64", 2021-10-08T19:25:44.289 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:25:44.290 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:25:44.290 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2021-10-08T19:25:44.290 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:25:44.290 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:25:44.291 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:25:44.291 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:25:44.291 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:25:44.291 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:25:44.292 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:25:44.292 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:25:44.292 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:25:44.292 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:25:44.292 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:25:44.293 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:25:44.293 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:25:44.293 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:25:44.293 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:25:44.294 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:25:44.294 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:25:44.294 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:25:44.294 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:25:44.294 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:25:44.295 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:25:44.295 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:25:44.295 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:25:44.295 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.296 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:25:44.297 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:25:44.297 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:25:44.298 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:25:44.298 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:25:44.298 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:25:44.298 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:25:44.299 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:25:44.299 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:25:44.299 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:25:44.299 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:25:44.300 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2021-10-08T19:25:44.300 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:25:44.300 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw": {} 2021-10-08T19:25:44.301 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:44.301 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.301 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.301 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 5, 2021-10-08T19:25:44.302 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "default.rgw.control", 2021-10-08T19:25:44.302 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:21:25.865032+0000", 2021-10-08T19:25:44.302 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:25:44.303 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:25:44.303 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:25:44.303 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:25:44.303 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:25:44.304 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:25:44.304 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:25:44.304 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:25:44.304 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:25:44.305 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:25:44.305 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:25:44.305 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:25:44.305 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 32, 2021-10-08T19:25:44.305 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 32, 2021-10-08T19:25:44.306 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 32, 2021-10-08T19:25:44.306 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 32, 2021-10-08T19:25:44.306 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 32, 2021-10-08T19:25:44.306 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:25:44.307 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:25:44.307 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:25:44.307 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:25:44.307 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:25:44.308 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:25:44.308 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:25:44.308 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.308 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "66", 2021-10-08T19:25:44.309 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:25:44.309 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:25:44.309 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2021-10-08T19:25:44.309 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:25:44.309 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:25:44.310 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:25:44.310 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:25:44.310 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:25:44.310 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:25:44.311 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:25:44.311 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:25:44.311 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:25:44.311 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:25:44.312 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:25:44.312 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:25:44.312 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:25:44.312 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:25:44.312 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:25:44.313 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:25:44.313 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:25:44.313 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:25:44.313 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:25:44.314 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:25:44.314 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:25:44.314 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:25:44.314 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:25:44.315 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.315 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:25:44.315 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:25:44.315 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:25:44.315 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:25:44.316 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:25:44.316 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:25:44.316 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:25:44.316 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:25:44.317 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:25:44.317 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:25:44.317 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:25:44.317 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2021-10-08T19:25:44.317 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:25:44.318 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw": {} 2021-10-08T19:25:44.318 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:44.318 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.318 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.319 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 6, 2021-10-08T19:25:44.319 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "default.rgw.meta", 2021-10-08T19:25:44.319 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:21:27.940767+0000", 2021-10-08T19:25:44.319 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:25:44.320 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:25:44.320 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:25:44.321 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:25:44.322 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:25:44.322 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:25:44.322 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:25:44.323 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:25:44.323 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:25:44.323 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:25:44.324 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:25:44.324 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:25:44.324 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 32, 2021-10-08T19:25:44.325 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 32, 2021-10-08T19:25:44.325 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 32, 2021-10-08T19:25:44.325 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 32, 2021-10-08T19:25:44.325 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 32, 2021-10-08T19:25:44.326 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:25:44.326 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:25:44.326 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:25:44.326 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:25:44.328 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:25:44.328 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:25:44.329 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:25:44.329 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.330 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "69", 2021-10-08T19:25:44.330 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:25:44.331 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:25:44.331 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2021-10-08T19:25:44.331 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:25:44.332 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:25:44.333 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:25:44.333 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:25:44.333 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:25:44.334 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:25:44.334 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:25:44.334 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:25:44.334 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:25:44.335 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:25:44.335 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:25:44.336 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:25:44.336 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:25:44.336 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:25:44.337 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:25:44.337 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:25:44.338 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:25:44.338 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:25:44.338 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:25:44.338 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:25:44.339 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:25:44.339 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:25:44.339 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:25:44.339 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.339 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:25:44.340 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:25:44.340 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:25:44.340 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:25:44.340 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:25:44.341 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:25:44.341 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:25:44.341 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:25:44.341 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:25:44.341 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:25:44.342 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:25:44.342 INFO:teuthology.orchestra.run.smithi097.stdout: "options": { 2021-10-08T19:25:44.342 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_bias": 4, 2021-10-08T19:25:44.342 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_min": 8 2021-10-08T19:25:44.343 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.343 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:25:44.343 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw": {} 2021-10-08T19:25:44.343 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:44.343 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.344 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.344 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 7, 2021-10-08T19:25:44.344 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "unique_pool_0", 2021-10-08T19:25:44.344 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:23:43.485480+0000", 2021-10-08T19:25:44.344 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:25:44.345 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:25:44.345 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:25:44.346 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:25:44.346 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:25:44.346 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:25:44.346 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:25:44.347 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:25:44.347 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:25:44.347 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:25:44.347 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:25:44.347 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:25:44.348 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 16, 2021-10-08T19:25:44.348 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 16, 2021-10-08T19:25:44.348 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 16, 2021-10-08T19:25:44.348 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 16, 2021-10-08T19:25:44.349 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 16, 2021-10-08T19:25:44.349 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:25:44.349 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:25:44.349 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:25:44.350 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:25:44.350 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:25:44.350 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:25:44.350 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:25:44.351 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.351 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "98", 2021-10-08T19:25:44.351 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:25:44.351 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:25:44.351 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2021-10-08T19:25:44.352 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:25:44.352 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:25:44.352 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:25:44.352 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:25:44.353 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:25:44.353 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:25:44.354 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:25:44.354 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:25:44.354 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:25:44.354 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:25:44.355 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:25:44.355 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:25:44.356 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:25:44.356 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:25:44.356 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:25:44.356 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:25:44.357 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:25:44.357 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:25:44.357 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:25:44.357 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:25:44.358 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:25:44.358 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:25:44.358 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:25:44.358 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.359 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:25:44.359 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:25:44.359 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:25:44.359 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:25:44.359 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:25:44.360 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:25:44.360 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:25:44.360 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:25:44.360 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:25:44.361 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:25:44.361 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:25:44.361 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2021-10-08T19:25:44.361 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:25:44.361 INFO:teuthology.orchestra.run.smithi097.stdout: "rados": {} 2021-10-08T19:25:44.362 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:44.362 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:44.362 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:25:44.363 INFO:teuthology.orchestra.run.smithi097.stdout: "osds": [ 2021-10-08T19:25:44.363 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.365 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 0, 2021-10-08T19:25:44.365 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "9e64e714-a5d5-4fbb-ae2b-1df4bf14b8e0", 2021-10-08T19:25:44.365 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:25:44.365 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:25:44.366 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:25:44.366 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:25:44.366 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:25:44.366 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:25:44.367 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 8, 2021-10-08T19:25:44.367 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 132, 2021-10-08T19:25:44.367 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:25:44.368 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:25:44.368 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:25:44.368 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:44.368 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.369 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:44.369 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6801", 2021-10-08T19:25:44.369 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3354161282 2021-10-08T19:25:44.369 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:44.369 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:44.370 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.370 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:25:44.370 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:44.370 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.371 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:44.371 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6802", 2021-10-08T19:25:44.371 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3354161282 2021-10-08T19:25:44.371 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:44.371 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:44.372 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.372 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:25:44.372 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:44.372 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.372 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:44.373 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6804", 2021-10-08T19:25:44.373 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3354161282 2021-10-08T19:25:44.373 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:44.373 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:44.373 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.374 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:25:44.374 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:44.374 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.374 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:44.375 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6803", 2021-10-08T19:25:44.375 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3354161282 2021-10-08T19:25:44.375 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:44.375 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:44.375 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.376 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.97:6801/3354161282", 2021-10-08T19:25:44.376 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.97:6802/3354161282", 2021-10-08T19:25:44.376 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.97:6804/3354161282", 2021-10-08T19:25:44.376 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.97:6803/3354161282", 2021-10-08T19:25:44.376 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:25:44.377 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:25:44.377 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:25:44.378 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:44.378 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.378 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.378 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 1, 2021-10-08T19:25:44.379 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "32602a22-f263-4b62-a8d8-50fddfb73fa8", 2021-10-08T19:25:44.379 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:25:44.379 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:25:44.379 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:25:44.379 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:25:44.380 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:25:44.380 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:25:44.380 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 13, 2021-10-08T19:25:44.380 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 131, 2021-10-08T19:25:44.381 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:25:44.381 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:25:44.381 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:25:44.381 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:44.381 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.382 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:44.382 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6805", 2021-10-08T19:25:44.382 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 735799205 2021-10-08T19:25:44.382 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:44.383 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:44.383 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.383 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:25:44.383 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:44.383 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.384 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:44.384 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6806", 2021-10-08T19:25:44.384 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 735799205 2021-10-08T19:25:44.384 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:44.384 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:44.385 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.385 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:25:44.385 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:44.385 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.385 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:44.386 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6808", 2021-10-08T19:25:44.386 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 735799205 2021-10-08T19:25:44.386 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:44.387 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:44.387 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.387 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:25:44.387 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:44.389 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.389 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:44.389 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6807", 2021-10-08T19:25:44.390 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 735799205 2021-10-08T19:25:44.390 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:44.390 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:44.390 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.390 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.97:6805/735799205", 2021-10-08T19:25:44.391 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.97:6806/735799205", 2021-10-08T19:25:44.391 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.97:6808/735799205", 2021-10-08T19:25:44.391 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.97:6807/735799205", 2021-10-08T19:25:44.391 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:25:44.392 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:25:44.392 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:25:44.392 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:44.392 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.392 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.393 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 2, 2021-10-08T19:25:44.393 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "88e0e4a2-b4a3-4a00-8669-03c3d9b166c5", 2021-10-08T19:25:44.393 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:25:44.393 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:25:44.394 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:25:44.394 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:25:44.394 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:25:44.394 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:25:44.394 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 18, 2021-10-08T19:25:44.395 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 113, 2021-10-08T19:25:44.395 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:25:44.395 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:25:44.395 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:25:44.396 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:44.396 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.396 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:44.397 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6809", 2021-10-08T19:25:44.397 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2366482649 2021-10-08T19:25:44.397 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:44.397 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:44.397 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.398 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:25:44.398 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:44.398 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.398 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:44.399 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6810", 2021-10-08T19:25:44.399 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2366482649 2021-10-08T19:25:44.399 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:44.399 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:44.399 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.400 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:25:44.400 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:44.400 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.400 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:44.401 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6812", 2021-10-08T19:25:44.401 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2366482649 2021-10-08T19:25:44.401 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:44.401 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:44.402 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.403 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:25:44.403 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:44.403 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.403 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:44.404 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6811", 2021-10-08T19:25:44.404 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2366482649 2021-10-08T19:25:44.404 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:44.404 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:44.405 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.405 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.97:6809/2366482649", 2021-10-08T19:25:44.405 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.97:6810/2366482649", 2021-10-08T19:25:44.405 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.97:6812/2366482649", 2021-10-08T19:25:44.405 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.97:6811/2366482649", 2021-10-08T19:25:44.406 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:25:44.406 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:25:44.406 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:25:44.406 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:44.410 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.410 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.410 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 3, 2021-10-08T19:25:44.410 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "e689d708-b501-4526-a31a-1e598b74654d", 2021-10-08T19:25:44.414 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:25:44.414 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:25:44.415 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:25:44.415 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:25:44.415 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:25:44.415 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:25:44.416 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 24, 2021-10-08T19:25:44.416 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 131, 2021-10-08T19:25:44.416 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:25:44.416 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:25:44.416 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:25:44.417 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:44.417 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.417 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:44.417 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6813", 2021-10-08T19:25:44.417 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3191181122 2021-10-08T19:25:44.418 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:44.418 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:44.418 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.418 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:25:44.419 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:44.419 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.419 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:44.419 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6814", 2021-10-08T19:25:44.419 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3191181122 2021-10-08T19:25:44.420 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:44.420 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:44.420 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.420 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:25:44.421 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:44.421 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.421 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:44.421 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6816", 2021-10-08T19:25:44.421 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3191181122 2021-10-08T19:25:44.422 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:44.422 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:44.422 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.422 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:25:44.423 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:44.423 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.423 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:44.423 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6815", 2021-10-08T19:25:44.423 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3191181122 2021-10-08T19:25:44.424 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:44.424 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:44.424 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.424 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.97:6813/3191181122", 2021-10-08T19:25:44.425 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.97:6814/3191181122", 2021-10-08T19:25:44.425 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.97:6816/3191181122", 2021-10-08T19:25:44.425 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.97:6815/3191181122", 2021-10-08T19:25:44.425 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:25:44.426 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:25:44.426 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:25:44.426 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:44.426 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.427 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.427 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 4, 2021-10-08T19:25:44.427 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "67e4730a-be1c-4d88-9307-e3c2cf3ab2ef", 2021-10-08T19:25:44.427 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:25:44.427 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:25:44.428 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:25:44.428 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:25:44.428 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:25:44.428 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:25:44.429 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 30, 2021-10-08T19:25:44.429 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 138, 2021-10-08T19:25:44.429 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:25:44.429 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:25:44.429 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:25:44.430 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:44.430 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.430 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:44.430 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6800", 2021-10-08T19:25:44.430 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 106778208 2021-10-08T19:25:44.431 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:44.431 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:44.431 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.431 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:25:44.432 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:44.432 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.432 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:44.432 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6801", 2021-10-08T19:25:44.432 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 106778208 2021-10-08T19:25:44.433 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:44.433 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:44.433 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.433 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:25:44.433 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:44.434 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.434 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:44.434 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6803", 2021-10-08T19:25:44.434 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 106778208 2021-10-08T19:25:44.435 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:44.435 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:44.435 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.435 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:25:44.435 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:44.436 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.436 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:44.436 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6802", 2021-10-08T19:25:44.436 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 106778208 2021-10-08T19:25:44.436 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:44.437 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:44.437 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.437 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.117:6800/106778208", 2021-10-08T19:25:44.437 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.117:6801/106778208", 2021-10-08T19:25:44.438 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.117:6803/106778208", 2021-10-08T19:25:44.438 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.117:6802/106778208", 2021-10-08T19:25:44.438 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:25:44.438 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:25:44.438 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:25:44.439 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:44.439 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.439 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.439 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 5, 2021-10-08T19:25:44.439 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "f9fd3153-3e4e-4489-8927-a65641f05d42", 2021-10-08T19:25:44.440 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:25:44.440 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:25:44.440 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:25:44.440 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:25:44.441 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:25:44.441 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:25:44.441 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 38, 2021-10-08T19:25:44.441 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 132, 2021-10-08T19:25:44.441 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:25:44.442 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:25:44.442 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:25:44.442 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:44.442 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.442 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:44.443 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6804", 2021-10-08T19:25:44.443 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3199889891 2021-10-08T19:25:44.443 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:44.443 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:44.444 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.444 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:25:44.444 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:44.444 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.444 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:44.445 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6805", 2021-10-08T19:25:44.445 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3199889891 2021-10-08T19:25:44.445 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:44.445 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:44.445 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.446 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:25:44.446 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:44.446 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.446 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:44.447 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6807", 2021-10-08T19:25:44.447 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3199889891 2021-10-08T19:25:44.447 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:44.447 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:44.447 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.448 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:25:44.448 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:44.448 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.448 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:44.448 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6806", 2021-10-08T19:25:44.449 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3199889891 2021-10-08T19:25:44.449 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:44.449 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:44.449 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.450 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.117:6804/3199889891", 2021-10-08T19:25:44.450 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.117:6805/3199889891", 2021-10-08T19:25:44.450 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.117:6807/3199889891", 2021-10-08T19:25:44.450 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.117:6806/3199889891", 2021-10-08T19:25:44.450 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:25:44.451 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:25:44.451 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:25:44.451 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:44.451 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.452 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.452 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 6, 2021-10-08T19:25:44.452 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "84898f12-c37d-4eb6-8b71-5b86bfe16e7d", 2021-10-08T19:25:44.452 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:25:44.452 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:25:44.453 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:25:44.453 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:25:44.453 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:25:44.453 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:25:44.453 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 47, 2021-10-08T19:25:44.454 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 132, 2021-10-08T19:25:44.454 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:25:44.454 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:25:44.454 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:25:44.455 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:44.455 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.455 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:44.455 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6808", 2021-10-08T19:25:44.455 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2185843951 2021-10-08T19:25:44.456 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:44.456 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:44.456 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.456 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:25:44.456 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:44.457 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.457 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:44.457 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6809", 2021-10-08T19:25:44.457 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2185843951 2021-10-08T19:25:44.458 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:44.458 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:44.458 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.458 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:25:44.458 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:44.459 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.459 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:44.459 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6811", 2021-10-08T19:25:44.459 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2185843951 2021-10-08T19:25:44.459 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:44.460 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:44.460 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.460 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:25:44.460 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:44.461 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.461 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:44.461 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6810", 2021-10-08T19:25:44.461 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2185843951 2021-10-08T19:25:44.461 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:44.462 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:44.462 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.462 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.117:6808/2185843951", 2021-10-08T19:25:44.462 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.117:6809/2185843951", 2021-10-08T19:25:44.462 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.117:6811/2185843951", 2021-10-08T19:25:44.463 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.117:6810/2185843951", 2021-10-08T19:25:44.463 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:25:44.463 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:25:44.463 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:25:44.464 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:44.464 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.464 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.464 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 7, 2021-10-08T19:25:44.464 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "529af2ce-2ae9-41ed-8c8e-d133628cfd20", 2021-10-08T19:25:44.465 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:25:44.465 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:25:44.465 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:25:44.465 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:25:44.465 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:25:44.466 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:25:44.466 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 55, 2021-10-08T19:25:44.466 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 132, 2021-10-08T19:25:44.466 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:25:44.467 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:25:44.467 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:25:44.467 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:44.467 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.467 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:44.468 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6812", 2021-10-08T19:25:44.468 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2817683239 2021-10-08T19:25:44.468 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:44.468 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:44.468 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.469 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:25:44.469 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:44.469 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.469 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:44.469 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6813", 2021-10-08T19:25:44.470 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2817683239 2021-10-08T19:25:44.470 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:44.470 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:44.470 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.471 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:25:44.471 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:44.471 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.471 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:44.471 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6815", 2021-10-08T19:25:44.472 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2817683239 2021-10-08T19:25:44.472 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:44.472 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:44.472 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.473 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:25:44.473 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:25:44.473 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.473 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:25:44.473 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6814", 2021-10-08T19:25:44.474 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2817683239 2021-10-08T19:25:44.474 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:44.474 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:44.474 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.474 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.117:6812/2817683239", 2021-10-08T19:25:44.475 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.117:6813/2817683239", 2021-10-08T19:25:44.475 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.117:6815/2817683239", 2021-10-08T19:25:44.475 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.117:6814/2817683239", 2021-10-08T19:25:44.475 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:25:44.476 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:25:44.476 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:25:44.476 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:44.476 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:44.476 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:25:44.477 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_xinfo": [ 2021-10-08T19:25:44.477 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.477 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 0, 2021-10-08T19:25:44.477 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:25:44.477 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:25:44.478 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:25:44.478 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:25:44.478 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:25:44.478 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:25:35.568606+0000", 2021-10-08T19:25:44.479 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:25:44.479 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.479 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.479 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 1, 2021-10-08T19:25:44.479 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:25:44.480 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:25:44.480 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:25:44.480 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:25:44.480 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:25:44.480 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:24:51.166410+0000", 2021-10-08T19:25:44.481 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:25:44.481 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.481 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.481 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 2, 2021-10-08T19:25:44.482 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:25:44.482 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:25:44.482 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:25:44.482 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:25:44.482 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:25:44.483 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:25:42.123007+0000", 2021-10-08T19:25:44.483 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:25:44.483 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.483 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.483 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 3, 2021-10-08T19:25:44.484 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:25:44.484 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:25:44.484 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:25:44.484 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:25:44.485 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:25:44.485 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:24:34.979406+0000", 2021-10-08T19:25:44.485 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:25:44.485 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.485 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.486 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 4, 2021-10-08T19:25:44.486 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:25:44.486 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:25:44.486 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:25:44.487 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:25:44.487 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:25:44.487 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:25:29.548772+0000", 2021-10-08T19:25:44.487 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:25:44.488 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.488 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.488 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 5, 2021-10-08T19:25:44.488 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:25:44.488 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:25:44.489 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:25:44.489 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:25:44.489 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:25:44.489 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:25:17.830171+0000", 2021-10-08T19:25:44.490 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:25:44.490 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.490 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.490 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 6, 2021-10-08T19:25:44.491 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:25:44.491 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:25:44.491 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:25:44.491 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:25:44.491 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:25:44.492 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:24:32.387840+0000", 2021-10-08T19:25:44.492 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:25:44.492 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.492 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.492 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 7, 2021-10-08T19:25:44.493 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:25:44.493 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:25:44.493 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:25:44.493 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:25:44.494 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:25:44.494 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:24:51.598871+0000", 2021-10-08T19:25:44.494 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:25:44.494 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:44.494 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:25:44.495 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_upmap": [], 2021-10-08T19:25:44.495 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_upmap_items": [ 2021-10-08T19:25:44.495 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.495 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "2.0", 2021-10-08T19:25:44.495 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:25:44.496 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.496 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 7, 2021-10-08T19:25:44.496 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 2 2021-10-08T19:25:44.496 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:44.497 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:44.497 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.497 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.497 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "2.1a", 2021-10-08T19:25:44.497 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:25:44.498 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.498 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 7, 2021-10-08T19:25:44.498 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 2 2021-10-08T19:25:44.498 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:44.498 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:44.499 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.499 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.499 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "4.14", 2021-10-08T19:25:44.499 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:25:44.500 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.500 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 3, 2021-10-08T19:25:44.500 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 2 2021-10-08T19:25:44.500 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:44.500 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:44.501 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.501 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.501 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "4.1c", 2021-10-08T19:25:44.501 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:25:44.501 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.502 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 1, 2021-10-08T19:25:44.502 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 5 2021-10-08T19:25:44.502 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:44.502 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:44.503 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:44.503 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:25:44.503 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_temp": [ 2021-10-08T19:25:44.503 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.503 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "7.1", 2021-10-08T19:25:44.504 INFO:teuthology.orchestra.run.smithi097.stdout: "osds": [ 2021-10-08T19:25:44.504 INFO:teuthology.orchestra.run.smithi097.stdout: 4, 2021-10-08T19:25:44.504 INFO:teuthology.orchestra.run.smithi097.stdout: 3 2021-10-08T19:25:44.504 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:44.504 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.505 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.505 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "7.7", 2021-10-08T19:25:44.505 INFO:teuthology.orchestra.run.smithi097.stdout: "osds": [ 2021-10-08T19:25:44.505 INFO:teuthology.orchestra.run.smithi097.stdout: 0, 2021-10-08T19:25:44.506 INFO:teuthology.orchestra.run.smithi097.stdout: 3 2021-10-08T19:25:44.506 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:44.506 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.506 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.506 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "7.b", 2021-10-08T19:25:44.507 INFO:teuthology.orchestra.run.smithi097.stdout: "osds": [ 2021-10-08T19:25:44.507 INFO:teuthology.orchestra.run.smithi097.stdout: 1, 2021-10-08T19:25:44.507 INFO:teuthology.orchestra.run.smithi097.stdout: 5 2021-10-08T19:25:44.507 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:44.507 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.508 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.508 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "7.c", 2021-10-08T19:25:44.508 INFO:teuthology.orchestra.run.smithi097.stdout: "osds": [ 2021-10-08T19:25:44.508 INFO:teuthology.orchestra.run.smithi097.stdout: 2, 2021-10-08T19:25:44.509 INFO:teuthology.orchestra.run.smithi097.stdout: 3, 2021-10-08T19:25:44.509 INFO:teuthology.orchestra.run.smithi097.stdout: 7 2021-10-08T19:25:44.509 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:44.509 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.509 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:25:44.510 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "7.d", 2021-10-08T19:25:44.510 INFO:teuthology.orchestra.run.smithi097.stdout: "osds": [ 2021-10-08T19:25:44.510 INFO:teuthology.orchestra.run.smithi097.stdout: 1, 2021-10-08T19:25:44.510 INFO:teuthology.orchestra.run.smithi097.stdout: 0 2021-10-08T19:25:44.510 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:25:44.511 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:44.511 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:25:44.511 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_temp": [], 2021-10-08T19:25:44.511 INFO:teuthology.orchestra.run.smithi097.stdout: "blocklist": { 2021-10-08T19:25:44.512 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/2600364788": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:25:44.512 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/4129083289": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:25:44.512 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/1443158975": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:25:44.512 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/2472640384": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:25:44.512 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/3196919488": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:25:44.513 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:6800/3195862546": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:25:44.513 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:6800/3931202434": "2021-10-09T19:17:10.051948+0000", 2021-10-08T19:25:44.513 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/2761595213": "2021-10-09T19:17:10.051948+0000", 2021-10-08T19:25:44.513 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/900681504": "2021-10-09T19:17:10.051948+0000", 2021-10-08T19:25:44.513 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/3932251406": "2021-10-09T19:17:10.051948+0000", 2021-10-08T19:25:44.514 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/398006785": "2021-10-09T19:16:48.651177+0000", 2021-10-08T19:25:44.514 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/1642570050": "2021-10-09T19:16:48.651177+0000", 2021-10-08T19:25:44.514 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/300178790": "2021-10-09T19:16:48.651177+0000", 2021-10-08T19:25:44.514 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:6800/845999767": "2021-10-09T19:16:48.651177+0000" 2021-10-08T19:25:44.514 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.515 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profiles": { 2021-10-08T19:25:44.515 INFO:teuthology.orchestra.run.smithi097.stdout: "default": { 2021-10-08T19:25:44.515 INFO:teuthology.orchestra.run.smithi097.stdout: "crush-failure-domain": "osd", 2021-10-08T19:25:44.515 INFO:teuthology.orchestra.run.smithi097.stdout: "k": "2", 2021-10-08T19:25:44.516 INFO:teuthology.orchestra.run.smithi097.stdout: "m": "1", 2021-10-08T19:25:44.516 INFO:teuthology.orchestra.run.smithi097.stdout: "plugin": "jerasure", 2021-10-08T19:25:44.516 INFO:teuthology.orchestra.run.smithi097.stdout: "technique": "reed_sol_van" 2021-10-08T19:25:44.516 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:44.516 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:25:44.517 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps_queue": [], 2021-10-08T19:25:44.517 INFO:teuthology.orchestra.run.smithi097.stdout: "new_removed_snaps": [], 2021-10-08T19:25:44.517 INFO:teuthology.orchestra.run.smithi097.stdout: "new_purged_snaps": [], 2021-10-08T19:25:44.517 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_node_flags": {}, 2021-10-08T19:25:44.517 INFO:teuthology.orchestra.run.smithi097.stdout: "device_class_flags": {}, 2021-10-08T19:25:44.518 INFO:teuthology.orchestra.run.smithi097.stdout: "stretch_mode": { 2021-10-08T19:25:44.518 INFO:teuthology.orchestra.run.smithi097.stdout: "stretch_mode_enabled": false, 2021-10-08T19:25:44.518 INFO:teuthology.orchestra.run.smithi097.stdout: "stretch_bucket_count": 0, 2021-10-08T19:25:44.518 INFO:teuthology.orchestra.run.smithi097.stdout: "degraded_stretch_mode": 0, 2021-10-08T19:25:44.519 INFO:teuthology.orchestra.run.smithi097.stdout: "recovering_stretch_mode": 0, 2021-10-08T19:25:44.519 INFO:teuthology.orchestra.run.smithi097.stdout: "stretch_mode_bucket": 0 2021-10-08T19:25:44.519 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:25:44.519 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:25:44.520 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:44.521 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:25:44.521 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:25:44.622 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:25:44.656 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2021-10-08T19:25:44.656 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:25:44.682 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:44.961 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:25:44.967 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:44.968 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:25:44.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:44 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2411951624' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2021-10-08T19:25:44.969 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:44 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2411951624' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2021-10-08T19:25:45.070 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:25:45.101 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:44 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2411951624' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2021-10-08T19:25:45.106 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:45.158 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:25:45.159 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:45.160 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:25:45.261 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:25:45.295 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:45.623 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2021-10-08T19:25:45.624 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:25:45.628 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:45.629 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:25:45.681 INFO:tasks.thrashosds.thrasher:j is {'epoch': 142, 'fsid': '1d01f6d6-286c-11ec-8c25-001a4aab830c', 'created': '2021-10-08T19:16:25.258003+0000', 'modified': '2021-10-08T19:25:42.810856+0000', 'last_up_change': '2021-10-08T19:21:15.388758+0000', 'last_in_change': '2021-10-08T19:24:24.060804+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 18, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 7, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'quincy', 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2021-10-08T19:19:44.413311+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': '.rgw.root', 'create_time': '2021-10-08T19:21:21.940881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 3, 'pool_name': 'iscsi', 'create_time': '2021-10-08T19:21:22.536945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 23, 'pg_placement_num': 23, 'pg_placement_num_target': 23, 'pg_num_target': 23, 'pg_num_pending': 23, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '132', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '131', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 4, 'pool_name': 'default.rgw.log', 'create_time': '2021-10-08T19:21:23.886328+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 5, 'pool_name': 'default.rgw.control', 'create_time': '2021-10-08T19:21:25.865032+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 6, 'pool_name': 'default.rgw.meta', 'create_time': '2021-10-08T19:21:27.940767+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '69', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 8}, 'application_metadata': {'rgw': {}}}, {'pool': 7, 'pool_name': 'unique_pool_0', 'create_time': '2021-10-08T19:23:43.485480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '98', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}], 'osds': [{'osd': 0, 'uuid': '9e64e714-a5d5-4fbb-ae2b-1df4bf14b8e0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 132, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6801', 'nonce': 3354161282}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6802', 'nonce': 3354161282}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6804', 'nonce': 3354161282}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6803', 'nonce': 3354161282}]}, 'public_addr': '172.21.15.97:6801/3354161282', 'cluster_addr': '172.21.15.97:6802/3354161282', 'heartbeat_back_addr': '172.21.15.97:6804/3354161282', 'heartbeat_front_addr': '172.21.15.97:6803/3354161282', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '32602a22-f263-4b62-a8d8-50fddfb73fa8', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 131, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6805', 'nonce': 735799205}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6806', 'nonce': 735799205}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6808', 'nonce': 735799205}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6807', 'nonce': 735799205}]}, 'public_addr': '172.21.15.97:6805/735799205', 'cluster_addr': '172.21.15.97:6806/735799205', 'heartbeat_back_addr': '172.21.15.97:6808/735799205', 'heartbeat_front_addr': '172.21.15.97:6807/735799205', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '88e0e4a2-b4a3-4a00-8669-03c3d9b166c5', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 18, 'up_thru': 113, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6809', 'nonce': 2366482649}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6810', 'nonce': 2366482649}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6812', 'nonce': 2366482649}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6811', 'nonce': 2366482649}]}, 'public_addr': '172.21.15.97:6809/2366482649', 'cluster_addr': '172.21.15.97:6810/2366482649', 'heartbeat_back_addr': '172.21.15.97:6812/2366482649', 'heartbeat_front_addr': '172.21.15.97:6811/2366482649', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': 'e689d708-b501-4526-a31a-1e598b74654d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 24, 'up_thru': 131, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6813', 'nonce': 3191181122}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6814', 'nonce': 3191181122}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6816', 'nonce': 3191181122}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6815', 'nonce': 3191181122}]}, 'public_addr': '172.21.15.97:6813/3191181122', 'cluster_addr': '172.21.15.97:6814/3191181122', 'heartbeat_back_addr': '172.21.15.97:6816/3191181122', 'heartbeat_front_addr': '172.21.15.97:6815/3191181122', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '67e4730a-be1c-4d88-9307-e3c2cf3ab2ef', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 30, 'up_thru': 138, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6800', 'nonce': 106778208}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6801', 'nonce': 106778208}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6803', 'nonce': 106778208}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6802', 'nonce': 106778208}]}, 'public_addr': '172.21.15.117:6800/106778208', 'cluster_addr': '172.21.15.117:6801/106778208', 'heartbeat_back_addr': '172.21.15.117:6803/106778208', 'heartbeat_front_addr': '172.21.15.117:6802/106778208', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'f9fd3153-3e4e-4489-8927-a65641f05d42', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 38, 'up_thru': 132, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6804', 'nonce': 3199889891}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6805', 'nonce': 3199889891}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6807', 'nonce': 3199889891}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6806', 'nonce': 3199889891}]}, 'public_addr': '172.21.15.117:6804/3199889891', 'cluster_addr': '172.21.15.117:6805/3199889891', 'heartbeat_back_addr': '172.21.15.117:6807/3199889891', 'heartbeat_front_addr': '172.21.15.117:6806/3199889891', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '84898f12-c37d-4eb6-8b71-5b86bfe16e7d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 47, 'up_thru': 132, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6808', 'nonce': 2185843951}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6809', 'nonce': 2185843951}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6811', 'nonce': 2185843951}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6810', 'nonce': 2185843951}]}, 'public_addr': '172.21.15.117:6808/2185843951', 'cluster_addr': '172.21.15.117:6809/2185843951', 'heartbeat_back_addr': '172.21.15.117:6811/2185843951', 'heartbeat_front_addr': '172.21.15.117:6810/2185843951', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '529af2ce-2ae9-41ed-8c8e-d133628cfd20', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 55, 'up_thru': 132, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6812', 'nonce': 2817683239}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6813', 'nonce': 2817683239}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6815', 'nonce': 2817683239}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6814', 'nonce': 2817683239}]}, 'public_addr': '172.21.15.117:6812/2817683239', 'cluster_addr': '172.21.15.117:6813/2817683239', 'heartbeat_back_addr': '172.21.15.117:6815/2817683239', 'heartbeat_front_addr': '172.21.15.117:6814/2817683239', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:25:35.568606+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:24:51.166410+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:25:42.123007+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:24:34.979406+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:25:29.548772+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:25:17.830171+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:24:32.387840+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:24:51.598871+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [{'pgid': '2.0', 'mappings': [{'from': 7, 'to': 2}]}, {'pgid': '2.1a', 'mappings': [{'from': 7, 'to': 2}]}, {'pgid': '4.14', 'mappings': [{'from': 3, 'to': 2}]}, {'pgid': '4.1c', 'mappings': [{'from': 1, 'to': 5}]}], 'pg_temp': [{'pgid': '7.1', 'osds': [4, 3]}, {'pgid': '7.7', 'osds': [0, 3]}, {'pgid': '7.b', 'osds': [1, 5]}, {'pgid': '7.c', 'osds': [2, 3, 7]}, {'pgid': '7.d', 'osds': [1, 0]}], 'primary_temp': [], 'blocklist': {'172.21.15.97:0/2600364788': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:0/4129083289': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:0/1443158975': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:0/2472640384': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:0/3196919488': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:6800/3195862546': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:6800/3931202434': '2021-10-09T19:17:10.051948+0000', '172.21.15.97:0/2761595213': '2021-10-09T19:17:10.051948+0000', '172.21.15.97:0/900681504': '2021-10-09T19:17:10.051948+0000', '172.21.15.97:0/3932251406': '2021-10-09T19:17:10.051948+0000', '172.21.15.97:0/398006785': '2021-10-09T19:16:48.651177+0000', '172.21.15.97:0/1642570050': '2021-10-09T19:16:48.651177+0000', '172.21.15.97:0/300178790': '2021-10-09T19:16:48.651177+0000', '172.21.15.97:6800/845999767': '2021-10-09T19:16:48.651177+0000'}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2021-10-08T19:25:45.682 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph pg dump --format=json 2021-10-08T19:25:45.730 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:25:45.742 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:25:45.812 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:45.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:45 smithi097 ceph-mon[32687]: pgmap v193: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 4.7 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 937 op/s; 6225/230781 objects degraded (2.697%); 6385/230781 objects misplaced (2.767%); 2.7 MiB/s, 43 objects/s recovering 2021-10-08T19:25:45.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:45 smithi097 ceph-mon[32687]: Health check update: Degraded data redundancy: 6225/230781 objects degraded (2.697%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:25:45.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:45 smithi097 ceph-mon[32687]: osdmap e143: 8 total, 8 up, 8 in 2021-10-08T19:25:45.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:45 smithi097 ceph-mon[41966]: pgmap v193: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 4.7 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 937 op/s; 6225/230781 objects degraded (2.697%); 6385/230781 objects misplaced (2.767%); 2.7 MiB/s, 43 objects/s recovering 2021-10-08T19:25:45.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:45 smithi097 ceph-mon[41966]: Health check update: Degraded data redundancy: 6225/230781 objects degraded (2.697%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:25:45.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:45 smithi097 ceph-mon[41966]: osdmap e143: 8 total, 8 up, 8 in 2021-10-08T19:25:45.973 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:25:45.986 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:45.987 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:25:46.004 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:25:46.088 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:25:46.120 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:46.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:45 smithi117 ceph-mon[34585]: pgmap v193: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 4.7 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 937 op/s; 6225/230781 objects degraded (2.697%); 6385/230781 objects misplaced (2.767%); 2.7 MiB/s, 43 objects/s recovering 2021-10-08T19:25:46.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:45 smithi117 ceph-mon[34585]: Health check update: Degraded data redundancy: 6225/230781 objects degraded (2.697%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:25:46.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:45 smithi117 ceph-mon[34585]: osdmap e143: 8 total, 8 up, 8 in 2021-10-08T19:25:46.179 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:25:46.180 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:46.181 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:25:46.282 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:25:46.308 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:46.371 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:25:46.377 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:46.378 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:25:46.479 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:25:46.509 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:25:46 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:25:46.511 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:46.577 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:25:46.579 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:46.580 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:25:46.682 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:25:46.755 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:46.756 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:25:46.940 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:25:46.948 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is set 2021-10-08T19:25:46.956 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:46.956 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:25:46.978 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:46 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2406358665' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:25:46.978 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:46 smithi097 ceph-mon[32687]: from='client.34940 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:25:46.979 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:46 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2406358665' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:25:46.979 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:46 smithi097 ceph-mon[41966]: from='client.34940 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:25:47.058 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:25:47.098 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:47.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:46 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2406358665' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:25:47.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:46 smithi117 ceph-mon[34585]: from='client.34940 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:25:47.170 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:25:47.175 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:47.176 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:25:47.277 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:25:47.308 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:47.615 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:25:47.619 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:47.619 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:25:47.721 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:25:47.789 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:47.955 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:25:47.961 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:47.962 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:25:48.064 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:25:48.119 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:47 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:25:48.119 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:47 smithi097 ceph-mon[32687]: pgmap v195: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 4.7 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 848 op/s; 6225/230781 objects degraded (2.697%); 6385/230781 objects misplaced (2.767%); 2.3 MiB/s, 36 objects/s recovering 2021-10-08T19:25:48.119 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:47 smithi097 ceph-mon[32687]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:25:48.120 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:47 smithi097 ceph-mon[32687]: from='client.34940 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:25:48.120 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:47 smithi097 ceph-mon[32687]: osdmap e144: 8 total, 8 up, 8 in 2021-10-08T19:25:48.121 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:47 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:25:48.121 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:47 smithi097 ceph-mon[41966]: pgmap v195: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 4.7 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 848 op/s; 6225/230781 objects degraded (2.697%); 6385/230781 objects misplaced (2.767%); 2.3 MiB/s, 36 objects/s recovering 2021-10-08T19:25:48.121 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:47 smithi097 ceph-mon[41966]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:25:48.122 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:47 smithi097 ceph-mon[41966]: from='client.34940 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:25:48.122 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:47 smithi097 ceph-mon[41966]: osdmap e144: 8 total, 8 up, 8 in 2021-10-08T19:25:48.123 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:48.133 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2021-10-08T19:25:48.133 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:25:48.154 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:47 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:25:48.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:47 smithi117 ceph-mon[34585]: pgmap v195: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 4.7 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 848 op/s; 6225/230781 objects degraded (2.697%); 6385/230781 objects misplaced (2.767%); 2.3 MiB/s, 36 objects/s recovering 2021-10-08T19:25:48.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:47 smithi117 ceph-mon[34585]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:25:48.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:47 smithi117 ceph-mon[34585]: from='client.34940 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:25:48.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:47 smithi117 ceph-mon[34585]: osdmap e144: 8 total, 8 up, 8 in 2021-10-08T19:25:48.656 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:25:48.662 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:48.663 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:25:48.764 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:25:48.800 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:49.087 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:25:49.094 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:49.094 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:25:49.112 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2021-10-08T19:25:49.196 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:25:49.267 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:49.415 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:25:49.476 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:25:49.509 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:25:49.527 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:25:49.573 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:25:49.585 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:25:49.591 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:49.592 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:25:49.615 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:25:49.657 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:25:49.693 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:25:49.697 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:25:49.727 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:49.761 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:25:49.783 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true' 2021-10-08T19:25:49.783 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true' 2021-10-08T19:25:49.784 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true' 2021-10-08T19:25:49.784 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true' 2021-10-08T19:25:49.784 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true' 2021-10-08T19:25:49.784 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true' 2021-10-08T19:25:49.785 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'true' 2021-10-08T19:25:49.785 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'true' 2021-10-08T19:25:49.809 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:25:49.814 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:49.815 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:25:49.916 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:25:49.951 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:50.038 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:25:50.045 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:49 smithi117 ceph-mon[34585]: pgmap v197: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 4.6 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 717 op/s; 6384/228849 objects degraded (2.790%); 6168/228849 objects misplaced (2.695%); 2.4 MiB/s, 38 objects/s recovering 2021-10-08T19:25:50.046 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:49 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/4091159644' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:25:50.047 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:50.047 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:25:50.148 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:25:50.204 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:49 smithi097 ceph-mon[32687]: pgmap v197: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 4.6 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 717 op/s; 6384/228849 objects degraded (2.790%); 6168/228849 objects misplaced (2.695%); 2.4 MiB/s, 38 objects/s recovering 2021-10-08T19:25:50.204 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:49 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/4091159644' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:25:50.205 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:49 smithi097 ceph-mon[41966]: pgmap v197: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 4.6 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 717 op/s; 6384/228849 objects degraded (2.790%); 6168/228849 objects misplaced (2.695%); 2.4 MiB/s, 38 objects/s recovering 2021-10-08T19:25:50.205 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:49 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/4091159644' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:25:50.207 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:50.834 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set nodeep-scrub 2021-10-08T19:25:51.043 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:25:51.047 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:51.048 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:25:51.149 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:25:51.180 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:50 smithi117 ceph-mon[34585]: Health check update: Degraded data redundancy: 6384/228849 objects degraded (2.790%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:25:51.181 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:50 smithi117 ceph-mon[34585]: osdmap e145: 8 total, 8 up, 8 in 2021-10-08T19:25:51.184 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:51.219 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:50 smithi097 ceph-mon[41966]: Health check update: Degraded data redundancy: 6384/228849 objects degraded (2.790%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:25:51.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:50 smithi097 ceph-mon[41966]: osdmap e145: 8 total, 8 up, 8 in 2021-10-08T19:25:51.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:50 smithi097 ceph-mon[32687]: Health check update: Degraded data redundancy: 6384/228849 objects degraded (2.790%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:25:51.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:50 smithi097 ceph-mon[32687]: osdmap e145: 8 total, 8 up, 8 in 2021-10-08T19:25:51.305 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:25:51.308 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:51.309 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:25:51.410 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:25:51.474 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:51.600 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:25:51.603 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:51.604 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:25:51.690 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:25:51.690 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2021-10-08T19:25:51.690 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2021-10-08T19:25:51.691 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2021-10-08T19:25:51.691 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.691 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:31352 7.5 7:a02b2bf0:::benchmark_data_smithi097_93198_object31351:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2021-10-08T19:25:51.691 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:24:09.085832+0000", 2021-10-08T19:25:51.692 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 102.60072357200001, 2021-10-08T19:25:51.692 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.086979116999999995, 2021-10-08T19:25:51.692 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:25:51.692 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:51.693 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:25:51.693 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:25:51.693 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:25:51.693 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 31352 2021-10-08T19:25:51.694 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.694 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:25:51.694 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.694 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:25:51.694 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.085832+0000", 2021-10-08T19:25:51.695 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:51.695 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.695 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.695 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:25:51.696 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.085832+0000", 2021-10-08T19:25:51.696 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:51.697 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.697 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.697 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:25:51.697 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.085830+0000", 2021-10-08T19:25:51.698 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:25:51.698 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.698 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.698 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:25:51.698 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.085944+0000", 2021-10-08T19:25:51.699 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011460599999999999 2021-10-08T19:25:51.699 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.699 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.699 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:25:51.700 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.085973+0000", 2021-10-08T19:25:51.700 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8651000000000001e-05 2021-10-08T19:25:51.700 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.700 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.700 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:25:51.701 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.085990+0000", 2021-10-08T19:25:51.701 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7169000000000001e-05 2021-10-08T19:25:51.701 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.701 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.701 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:25:51.702 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.086047+0000", 2021-10-08T19:25:51.702 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6753999999999999e-05 2021-10-08T19:25:51.702 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.702 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.703 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:25:51.703 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.086178+0000", 2021-10-08T19:25:51.703 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013164200000000001 2021-10-08T19:25:51.703 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.704 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.704 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:25:51.704 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.086306+0000", 2021-10-08T19:25:51.704 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012786899999999999 2021-10-08T19:25:51.704 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.705 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.705 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:25:51.705 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.087375+0000", 2021-10-08T19:25:51.705 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0010691190000000001 2021-10-08T19:25:51.705 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.706 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.706 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:51.706 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.087881+0000", 2021-10-08T19:25:51.707 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00050536500000000002 2021-10-08T19:25:51.707 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.707 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.707 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:51.707 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.172748+0000", 2021-10-08T19:25:51.708 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.084866971999999999 2021-10-08T19:25:51.708 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.708 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.709 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:25:51.709 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.172786+0000", 2021-10-08T19:25:51.709 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.803e-05 2021-10-08T19:25:51.709 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.710 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.710 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:25:51.710 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.172811+0000", 2021-10-08T19:25:51.710 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5463999999999999e-05 2021-10-08T19:25:51.711 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:51.711 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:25:51.711 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:51.711 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.711 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.712 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:40330 7.5 7:ae7a3549:::benchmark_data_smithi097_93198_object40329:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2021-10-08T19:25:51.712 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:24:15.966254+0000", 2021-10-08T19:25:51.712 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 95.720301317999997, 2021-10-08T19:25:51.712 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.061763271000000002, 2021-10-08T19:25:51.712 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:25:51.713 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:51.713 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:25:51.713 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:25:51.713 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:25:51.714 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 40330 2021-10-08T19:25:51.714 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.714 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:25:51.714 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.714 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:25:51.715 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:15.966254+0000", 2021-10-08T19:25:51.715 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:51.715 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.715 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.716 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:25:51.716 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:15.966254+0000", 2021-10-08T19:25:51.716 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:51.716 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.716 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.717 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:25:51.717 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:15.966253+0000", 2021-10-08T19:25:51.717 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:25:51.717 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.717 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.718 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:25:51.718 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:15.966312+0000", 2021-10-08T19:25:51.718 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9271000000000002e-05 2021-10-08T19:25:51.718 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.719 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.719 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:25:51.719 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:15.966325+0000", 2021-10-08T19:25:51.719 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2721000000000001e-05 2021-10-08T19:25:51.719 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.720 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.720 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:25:51.720 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:15.966331+0000", 2021-10-08T19:25:51.720 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.528e-06 2021-10-08T19:25:51.720 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.721 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.721 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:25:51.721 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:15.966376+0000", 2021-10-08T19:25:51.721 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4906e-05 2021-10-08T19:25:51.722 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.722 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.722 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:25:51.722 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:15.966478+0000", 2021-10-08T19:25:51.722 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010139 2021-10-08T19:25:51.723 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.723 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.723 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:25:51.723 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:15.966573+0000", 2021-10-08T19:25:51.724 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.5705999999999995e-05 2021-10-08T19:25:51.724 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.724 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.724 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:25:51.724 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:15.967588+0000", 2021-10-08T19:25:51.725 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00101505 2021-10-08T19:25:51.725 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.725 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.725 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:51.725 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:15.970397+0000", 2021-10-08T19:25:51.726 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002808886 2021-10-08T19:25:51.726 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.726 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.726 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:51.727 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.027931+0000", 2021-10-08T19:25:51.727 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.057533914999999998 2021-10-08T19:25:51.727 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.727 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.727 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:25:51.728 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.027983+0000", 2021-10-08T19:25:51.728 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2080999999999998e-05 2021-10-08T19:25:51.728 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.728 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.729 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:25:51.729 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.028018+0000", 2021-10-08T19:25:51.729 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4369000000000002e-05 2021-10-08T19:25:51.729 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:51.729 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:25:51.730 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:51.730 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.730 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.730 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:40340 7.5 7:a77e8c3a:::benchmark_data_smithi097_93198_object40339:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2021-10-08T19:25:51.730 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:24:15.972032+0000", 2021-10-08T19:25:51.731 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 95.714523327999999, 2021-10-08T19:25:51.731 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.056086250999999997, 2021-10-08T19:25:51.731 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:25:51.731 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:51.732 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:25:51.732 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:25:51.732 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:25:51.735 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:25:51.735 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 40340 2021-10-08T19:25:51.735 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.735 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:25:51.736 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.736 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:25:51.736 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:15.972032+0000", 2021-10-08T19:25:51.736 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:51.737 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.737 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.737 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:25:51.737 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:15.972032+0000", 2021-10-08T19:25:51.737 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:51.738 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.738 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.738 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:25:51.738 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:15.972031+0000", 2021-10-08T19:25:51.739 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:25:51.739 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.739 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.739 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:25:51.740 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:15.972084+0000", 2021-10-08T19:25:51.740 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.3520000000000003e-05 2021-10-08T19:25:51.740 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.740 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.740 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:25:51.741 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:15.972095+0000", 2021-10-08T19:25:51.741 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1283e-05 2021-10-08T19:25:51.741 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.741 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.742 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:25:51.742 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:15.972100+0000", 2021-10-08T19:25:51.742 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9289999999999997e-06 2021-10-08T19:25:51.742 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.742 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.743 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:25:51.743 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:15.972137+0000", 2021-10-08T19:25:51.743 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7101000000000003e-05 2021-10-08T19:25:51.743 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.743 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.744 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:25:51.744 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:15.972238+0000", 2021-10-08T19:25:51.744 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010094699999999999 2021-10-08T19:25:51.744 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.745 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.745 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:25:51.745 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:15.972381+0000", 2021-10-08T19:25:51.745 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000142638 2021-10-08T19:25:51.745 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.746 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.746 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:25:51.746 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:15.973504+0000", 2021-10-08T19:25:51.746 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0011230509999999999 2021-10-08T19:25:51.747 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.747 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.747 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:51.747 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:15.973915+0000", 2021-10-08T19:25:51.747 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00041132400000000002 2021-10-08T19:25:51.748 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.748 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.748 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:51.748 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.028058+0000", 2021-10-08T19:25:51.749 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.054142998999999997 2021-10-08T19:25:51.749 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.749 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.749 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:25:51.749 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.028094+0000", 2021-10-08T19:25:51.750 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.5947e-05 2021-10-08T19:25:51.750 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.750 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.750 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:25:51.750 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.028119+0000", 2021-10-08T19:25:51.751 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4133000000000001e-05 2021-10-08T19:25:51.751 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:51.751 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:25:51.751 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:51.752 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.752 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.752 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:40657 7.5 7:ad4ba151:::benchmark_data_smithi097_93198_object40656:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2021-10-08T19:25:51.752 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:24:16.254937+0000", 2021-10-08T19:25:51.752 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 95.431618803999996, 2021-10-08T19:25:51.753 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.12607659500000001, 2021-10-08T19:25:51.753 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:25:51.753 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:51.753 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:25:51.754 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:25:51.754 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:25:51.754 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 40657 2021-10-08T19:25:51.754 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.755 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:25:51.755 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.755 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:25:51.755 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.254937+0000", 2021-10-08T19:25:51.755 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:51.756 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.756 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.756 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:25:51.756 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.254937+0000", 2021-10-08T19:25:51.757 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:51.757 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.757 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.757 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:25:51.757 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.254935+0000", 2021-10-08T19:25:51.758 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:25:51.758 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.758 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.758 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:25:51.759 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.254984+0000", 2021-10-08T19:25:51.759 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9069000000000001e-05 2021-10-08T19:25:51.759 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.759 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.759 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:25:51.760 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.254996+0000", 2021-10-08T19:25:51.760 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1719000000000001e-05 2021-10-08T19:25:51.760 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.760 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.760 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:25:51.761 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.255002+0000", 2021-10-08T19:25:51.761 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8390000000000003e-06 2021-10-08T19:25:51.761 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.761 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.762 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:25:51.762 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.255050+0000", 2021-10-08T19:25:51.762 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7791999999999999e-05 2021-10-08T19:25:51.762 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.762 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.763 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:25:51.763 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.255182+0000", 2021-10-08T19:25:51.763 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013253599999999999 2021-10-08T19:25:51.763 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.763 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.764 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:25:51.764 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.255333+0000", 2021-10-08T19:25:51.764 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015041100000000001 2021-10-08T19:25:51.764 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.765 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.765 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:25:51.765 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.256605+0000", 2021-10-08T19:25:51.765 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012727019999999999 2021-10-08T19:25:51.765 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.766 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.766 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:51.766 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.258652+0000", 2021-10-08T19:25:51.767 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020462869999999999 2021-10-08T19:25:51.767 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.767 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.767 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:51.768 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.380931+0000", 2021-10-08T19:25:51.768 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.12227929899999999 2021-10-08T19:25:51.768 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.768 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.768 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:25:51.769 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.380974+0000", 2021-10-08T19:25:51.769 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.3145000000000001e-05 2021-10-08T19:25:51.769 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.769 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.770 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:25:51.770 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.381013+0000", 2021-10-08T19:25:51.770 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9397000000000002e-05 2021-10-08T19:25:51.770 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:51.770 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:25:51.771 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:51.771 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.771 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.771 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:40672 7.5 7:a33797a0:::benchmark_data_smithi097_93198_object40671:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2021-10-08T19:25:51.772 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:24:16.261093+0000", 2021-10-08T19:25:51.772 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 95.425462515000007, 2021-10-08T19:25:51.772 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.12001854200000001, 2021-10-08T19:25:51.772 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:25:51.773 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:51.773 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:25:51.773 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:25:51.773 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:25:51.773 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 40672 2021-10-08T19:25:51.774 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.774 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:25:51.774 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.774 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:25:51.774 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.261093+0000", 2021-10-08T19:25:51.775 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:51.775 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.775 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.775 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:25:51.776 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.261093+0000", 2021-10-08T19:25:51.776 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:51.776 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.776 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.776 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:25:51.777 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.261091+0000", 2021-10-08T19:25:51.777 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:25:51.777 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.777 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.778 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:25:51.778 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.261133+0000", 2021-10-08T19:25:51.778 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1736000000000002e-05 2021-10-08T19:25:51.778 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.778 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.779 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:25:51.779 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.261146+0000", 2021-10-08T19:25:51.779 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3066e-05 2021-10-08T19:25:51.779 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.780 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.780 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:25:51.780 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.261151+0000", 2021-10-08T19:25:51.780 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0490000000000003e-06 2021-10-08T19:25:51.780 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.781 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.781 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:25:51.781 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.261207+0000", 2021-10-08T19:25:51.781 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5693999999999999e-05 2021-10-08T19:25:51.782 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.782 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.782 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:25:51.782 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.261362+0000", 2021-10-08T19:25:51.783 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015503700000000001 2021-10-08T19:25:51.783 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.783 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.783 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:25:51.783 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.261527+0000", 2021-10-08T19:25:51.784 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016535599999999999 2021-10-08T19:25:51.784 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.784 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.784 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:25:51.785 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.262785+0000", 2021-10-08T19:25:51.785 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012574280000000001 2021-10-08T19:25:51.785 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.785 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.785 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:51.786 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.264813+0000", 2021-10-08T19:25:51.786 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020283580000000001 2021-10-08T19:25:51.786 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.786 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.787 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:51.787 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.381056+0000", 2021-10-08T19:25:51.787 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.116243267 2021-10-08T19:25:51.787 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.788 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.788 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:25:51.788 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.381087+0000", 2021-10-08T19:25:51.788 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.1038000000000003e-05 2021-10-08T19:25:51.788 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.789 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.789 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:25:51.789 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.381112+0000", 2021-10-08T19:25:51.789 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4349e-05 2021-10-08T19:25:51.790 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:51.790 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:25:51.790 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:51.790 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.790 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.791 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:41393 7.5 7:a29811ee:::benchmark_data_smithi097_93198_object41392:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2021-10-08T19:25:51.791 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:24:17.045990+0000", 2021-10-08T19:25:51.791 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 94.640565296999995, 2021-10-08T19:25:51.791 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.087913859999999996, 2021-10-08T19:25:51.791 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:25:51.792 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:51.792 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:25:51.792 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:25:51.792 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:25:51.793 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 41393 2021-10-08T19:25:51.793 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.793 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:25:51.793 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.793 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:25:51.794 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:17.045990+0000", 2021-10-08T19:25:51.794 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:51.794 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.794 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.795 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:25:51.795 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:17.045990+0000", 2021-10-08T19:25:51.795 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:51.795 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.795 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.796 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:25:51.796 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:17.045988+0000", 2021-10-08T19:25:51.796 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:25:51.796 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.797 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.797 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:25:51.797 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:17.046023+0000", 2021-10-08T19:25:51.797 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.5271999999999997e-05 2021-10-08T19:25:51.797 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.798 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.798 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:25:51.798 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:17.046037+0000", 2021-10-08T19:25:51.798 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3463e-05 2021-10-08T19:25:51.799 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.799 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.799 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:25:51.799 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:17.046042+0000", 2021-10-08T19:25:51.799 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5600000000000001e-06 2021-10-08T19:25:51.800 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.800 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.800 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:25:51.800 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:17.046083+0000", 2021-10-08T19:25:51.800 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0451000000000003e-05 2021-10-08T19:25:51.801 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.801 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.801 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:25:51.801 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:17.046184+0000", 2021-10-08T19:25:51.802 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000101007 2021-10-08T19:25:51.802 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.802 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.802 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:25:51.802 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:17.046291+0000", 2021-10-08T19:25:51.803 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000107191 2021-10-08T19:25:51.803 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.803 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.803 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:25:51.803 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:17.047496+0000", 2021-10-08T19:25:51.804 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012048860000000001 2021-10-08T19:25:51.804 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.804 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.804 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:51.804 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:17.047963+0000", 2021-10-08T19:25:51.805 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00046678300000000002 2021-10-08T19:25:51.805 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.805 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.805 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:51.806 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:17.133816+0000", 2021-10-08T19:25:51.806 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.085853177000000003 2021-10-08T19:25:51.806 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.806 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.806 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:25:51.807 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:17.133857+0000", 2021-10-08T19:25:51.807 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1493999999999999e-05 2021-10-08T19:25:51.807 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.807 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.807 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:25:51.808 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:17.133904+0000", 2021-10-08T19:25:51.808 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.6675000000000003e-05 2021-10-08T19:25:51.808 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:51.808 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:25:51.809 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:51.809 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.809 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.809 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:52231 7.5 7:adbd2332:::benchmark_data_smithi097_93198_object52230:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117)", 2021-10-08T19:25:51.809 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:24:30.422618+0000", 2021-10-08T19:25:51.810 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 81.263937506000005, 2021-10-08T19:25:51.810 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.089976930999999996, 2021-10-08T19:25:51.810 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:25:51.810 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:51.810 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:25:51.811 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:25:51.811 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:25:51.811 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 52231 2021-10-08T19:25:51.811 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.812 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:25:51.812 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.812 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:25:51.812 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.422618+0000", 2021-10-08T19:25:51.812 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:51.813 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.813 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.813 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:25:51.813 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.422618+0000", 2021-10-08T19:25:51.813 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:51.814 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.814 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.814 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:25:51.814 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.422616+0000", 2021-10-08T19:25:51.815 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:25:51.815 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.815 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.815 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:25:51.815 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.422663+0000", 2021-10-08T19:25:51.816 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.6702000000000001e-05 2021-10-08T19:25:51.816 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.816 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.816 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:25:51.816 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.422679+0000", 2021-10-08T19:25:51.817 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5860999999999999e-05 2021-10-08T19:25:51.817 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.817 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.817 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:25:51.817 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.422685+0000", 2021-10-08T19:25:51.818 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8689999999999998e-06 2021-10-08T19:25:51.818 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.818 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.818 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:25:51.819 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.422729+0000", 2021-10-08T19:25:51.819 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4070999999999999e-05 2021-10-08T19:25:51.819 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.819 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.819 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:25:51.820 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.422839+0000", 2021-10-08T19:25:51.820 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000109143 2021-10-08T19:25:51.820 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.820 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.820 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:25:51.821 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.422945+0000", 2021-10-08T19:25:51.821 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010658999999999999 2021-10-08T19:25:51.821 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.821 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.822 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:25:51.822 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.424392+0000", 2021-10-08T19:25:51.822 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0014467219999999999 2021-10-08T19:25:51.822 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.822 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.823 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:51.823 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.425025+0000", 2021-10-08T19:25:51.823 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00063323800000000005 2021-10-08T19:25:51.823 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.823 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.824 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:51.824 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.512496+0000", 2021-10-08T19:25:51.824 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.087470520999999996 2021-10-08T19:25:51.824 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.825 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.825 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:25:51.826 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.512551+0000", 2021-10-08T19:25:51.826 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5158000000000003e-05 2021-10-08T19:25:51.826 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.826 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.827 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:25:51.827 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.512595+0000", 2021-10-08T19:25:51.827 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4184999999999998e-05 2021-10-08T19:25:51.827 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:51.827 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:25:51.828 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:51.828 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.828 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.828 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:54880 7.5 7:aceffdf9:::benchmark_data_smithi097_93198_object54879:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118)", 2021-10-08T19:25:51.828 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:24:33.616377+0000", 2021-10-08T19:25:51.829 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 78.070178929999997, 2021-10-08T19:25:51.829 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.053619301000000001, 2021-10-08T19:25:51.829 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:25:51.829 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:51.830 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:25:51.830 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:25:51.830 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:25:51.830 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 54880 2021-10-08T19:25:51.830 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.831 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:25:51.831 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.831 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:25:51.831 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:33.616377+0000", 2021-10-08T19:25:51.832 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:51.832 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.832 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.832 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:25:51.832 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:33.616377+0000", 2021-10-08T19:25:51.833 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:51.833 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.833 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.833 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:25:51.833 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:33.616374+0000", 2021-10-08T19:25:51.834 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:25:51.834 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.834 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.834 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:25:51.835 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:33.616425+0000", 2021-10-08T19:25:51.835 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0683999999999998e-05 2021-10-08T19:25:51.835 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.835 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.835 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:25:51.836 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:33.616441+0000", 2021-10-08T19:25:51.836 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5548000000000001e-05 2021-10-08T19:25:51.836 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.836 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.836 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:25:51.837 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:33.616449+0000", 2021-10-08T19:25:51.837 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.7530000000000007e-06 2021-10-08T19:25:51.837 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.837 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.837 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:25:51.838 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:33.616504+0000", 2021-10-08T19:25:51.838 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4857e-05 2021-10-08T19:25:51.838 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.838 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.839 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:25:51.839 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:33.616651+0000", 2021-10-08T19:25:51.839 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000146651 2021-10-08T19:25:51.839 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.839 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.840 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:25:51.840 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:33.616821+0000", 2021-10-08T19:25:51.840 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017018600000000001 2021-10-08T19:25:51.840 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.840 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.841 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:25:51.841 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:33.618604+0000", 2021-10-08T19:25:51.841 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001782538 2021-10-08T19:25:51.841 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.841 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.842 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:51.842 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:33.628418+0000", 2021-10-08T19:25:51.842 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0098144129999999993 2021-10-08T19:25:51.842 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.843 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.843 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:51.843 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:33.669902+0000", 2021-10-08T19:25:51.843 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.041483828 2021-10-08T19:25:51.843 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.844 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.844 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:25:51.844 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:33.669957+0000", 2021-10-08T19:25:51.844 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5172e-05 2021-10-08T19:25:51.844 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.845 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.845 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:25:51.845 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:33.669996+0000", 2021-10-08T19:25:51.845 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8967999999999997e-05 2021-10-08T19:25:51.846 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:51.846 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:25:51.846 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:51.846 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.846 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.847 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:55971 7.5 7:aa4e7fa8:::benchmark_data_smithi097_93198_object55970:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118)", 2021-10-08T19:25:51.847 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:24:34.896460+0000", 2021-10-08T19:25:51.847 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 76.790095413000003, 2021-10-08T19:25:51.847 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.085766951999999994, 2021-10-08T19:25:51.848 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:25:51.848 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:51.848 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:25:51.848 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:25:51.848 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:25:51.849 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 55971 2021-10-08T19:25:51.849 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.849 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:25:51.849 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.849 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:25:51.850 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:34.896460+0000", 2021-10-08T19:25:51.850 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:51.850 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.850 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.851 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:25:51.851 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:34.896460+0000", 2021-10-08T19:25:51.851 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:51.851 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.851 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.852 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:25:51.852 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:34.896458+0000", 2021-10-08T19:25:51.852 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:25:51.852 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.852 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.853 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:25:51.853 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:34.896506+0000", 2021-10-08T19:25:51.853 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.761e-05 2021-10-08T19:25:51.853 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.854 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.854 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:25:51.854 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:34.896520+0000", 2021-10-08T19:25:51.854 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4129e-05 2021-10-08T19:25:51.854 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.855 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.855 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:25:51.855 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:34.896528+0000", 2021-10-08T19:25:51.855 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9659999999999996e-06 2021-10-08T19:25:51.855 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.856 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.856 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:25:51.856 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:34.896588+0000", 2021-10-08T19:25:51.856 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0693000000000003e-05 2021-10-08T19:25:51.857 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.857 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.857 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:25:51.857 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:34.896763+0000", 2021-10-08T19:25:51.857 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017436099999999999 2021-10-08T19:25:51.858 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.858 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.858 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:25:51.858 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:34.896962+0000", 2021-10-08T19:25:51.859 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000199378 2021-10-08T19:25:51.859 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.859 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.859 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:25:51.859 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:34.898963+0000", 2021-10-08T19:25:51.860 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020009120000000001 2021-10-08T19:25:51.860 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.860 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.860 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:51.860 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:34.901588+0000", 2021-10-08T19:25:51.861 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0026246020000000002 2021-10-08T19:25:51.861 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.861 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.861 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:51.862 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:34.982151+0000", 2021-10-08T19:25:51.862 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.080562913 2021-10-08T19:25:51.862 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.862 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.862 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:25:51.863 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:34.982202+0000", 2021-10-08T19:25:51.863 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1242000000000002e-05 2021-10-08T19:25:51.863 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.863 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.863 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:25:51.864 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:34.982227+0000", 2021-10-08T19:25:51.864 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5272000000000001e-05 2021-10-08T19:25:51.864 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:51.864 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:25:51.864 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:51.865 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.865 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.865 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:58808 7.5 7:a1085e60:::benchmark_data_smithi097_93198_object58807:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2021-10-08T19:25:51.865 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:24:38.371815+0000", 2021-10-08T19:25:51.866 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 73.314740768999997, 2021-10-08T19:25:51.866 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.20002783099999999, 2021-10-08T19:25:51.866 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:25:51.866 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:51.866 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:25:51.867 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:25:51.867 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:25:51.867 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 58808 2021-10-08T19:25:51.867 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.867 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:25:51.868 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.868 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:25:51.868 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.371815+0000", 2021-10-08T19:25:51.868 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:51.869 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.869 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.869 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:25:51.869 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.371815+0000", 2021-10-08T19:25:51.869 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:51.870 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.870 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.870 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:25:51.870 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.371813+0000", 2021-10-08T19:25:51.870 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:25:51.871 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.871 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.871 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:25:51.871 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.371875+0000", 2021-10-08T19:25:51.872 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2535999999999999e-05 2021-10-08T19:25:51.872 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.872 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.872 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:25:51.872 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.371892+0000", 2021-10-08T19:25:51.873 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6572999999999999e-05 2021-10-08T19:25:51.873 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.873 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.873 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:25:51.873 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.371898+0000", 2021-10-08T19:25:51.874 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8889999999999999e-06 2021-10-08T19:25:51.874 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.874 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.874 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:25:51.875 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.371942+0000", 2021-10-08T19:25:51.875 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4478999999999999e-05 2021-10-08T19:25:51.875 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.875 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.875 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:25:51.876 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.372100+0000", 2021-10-08T19:25:51.876 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000157773 2021-10-08T19:25:51.876 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.876 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.876 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:25:51.877 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.372269+0000", 2021-10-08T19:25:51.877 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016882600000000001 2021-10-08T19:25:51.877 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.877 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.877 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:25:51.878 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.373814+0000", 2021-10-08T19:25:51.878 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0015447289999999999 2021-10-08T19:25:51.878 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.878 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.879 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:51.879 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.374394+0000", 2021-10-08T19:25:51.879 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00058025700000000004 2021-10-08T19:25:51.879 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.879 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.880 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:51.880 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.571758+0000", 2021-10-08T19:25:51.880 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.197364067 2021-10-08T19:25:51.880 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.880 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.881 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:25:51.881 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.571800+0000", 2021-10-08T19:25:51.881 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2485999999999999e-05 2021-10-08T19:25:51.881 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.882 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.882 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:25:51.882 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.571843+0000", 2021-10-08T19:25:51.882 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2262000000000003e-05 2021-10-08T19:25:51.882 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:51.883 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:25:51.883 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:51.883 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.883 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.884 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:58811 7.5 7:a85e4a63:::benchmark_data_smithi097_93198_object58810:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2021-10-08T19:25:51.884 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:24:38.380261+0000", 2021-10-08T19:25:51.884 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 73.306294476999994, 2021-10-08T19:25:51.884 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.19467627000000001, 2021-10-08T19:25:51.884 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:25:51.885 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:51.885 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:25:51.885 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:25:51.885 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:25:51.886 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 58811 2021-10-08T19:25:51.886 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.886 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:25:51.886 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.886 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:25:51.887 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.380261+0000", 2021-10-08T19:25:51.887 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:51.887 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.887 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.888 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:25:51.888 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.380261+0000", 2021-10-08T19:25:51.888 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:51.888 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.888 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.889 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:25:51.889 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.380259+0000", 2021-10-08T19:25:51.889 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:25:51.889 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.890 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.890 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:25:51.890 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.380321+0000", 2021-10-08T19:25:51.890 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1908000000000004e-05 2021-10-08T19:25:51.891 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.891 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.891 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:25:51.891 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.380337+0000", 2021-10-08T19:25:51.891 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6356000000000001e-05 2021-10-08T19:25:51.892 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.892 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.892 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:25:51.892 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.380345+0000", 2021-10-08T19:25:51.893 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6830000000000008e-06 2021-10-08T19:25:51.893 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.893 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.893 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:25:51.893 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.380401+0000", 2021-10-08T19:25:51.894 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6042999999999999e-05 2021-10-08T19:25:51.894 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.894 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.894 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:25:51.895 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.380549+0000", 2021-10-08T19:25:51.895 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014829399999999999 2021-10-08T19:25:51.895 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.895 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.895 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:25:51.896 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.380726+0000", 2021-10-08T19:25:51.896 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000177422 2021-10-08T19:25:51.896 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.896 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.897 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:25:51.897 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.384478+0000", 2021-10-08T19:25:51.897 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0037511739999999999 2021-10-08T19:25:51.897 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.897 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.898 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:51.898 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.386648+0000", 2021-10-08T19:25:51.898 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021706590000000001 2021-10-08T19:25:51.898 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.899 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.899 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:51.899 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.574827+0000", 2021-10-08T19:25:51.899 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.18817901300000001 2021-10-08T19:25:51.899 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.900 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.900 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:25:51.900 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.574888+0000", 2021-10-08T19:25:51.900 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1078e-05 2021-10-08T19:25:51.901 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.901 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.901 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:25:51.901 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.574937+0000", 2021-10-08T19:25:51.901 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9100000000000001e-05 2021-10-08T19:25:51.902 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:51.902 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:25:51.902 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:51.902 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.903 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.903 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:58812 7.5 7:ace934bc:::benchmark_data_smithi097_93198_object58811:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2021-10-08T19:25:51.903 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:24:38.380358+0000", 2021-10-08T19:25:51.903 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 73.306197701000002, 2021-10-08T19:25:51.903 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.19472503899999999, 2021-10-08T19:25:51.904 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:25:51.904 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:51.904 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:25:51.904 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:25:51.905 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:25:51.905 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 58812 2021-10-08T19:25:51.905 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.905 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:25:51.905 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.906 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:25:51.906 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.380358+0000", 2021-10-08T19:25:51.906 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:51.906 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.906 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.907 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:25:51.907 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.380358+0000", 2021-10-08T19:25:51.907 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:51.907 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.908 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.908 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:25:51.908 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.380357+0000", 2021-10-08T19:25:51.908 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:25:51.908 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.909 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.909 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:25:51.909 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.380395+0000", 2021-10-08T19:25:51.909 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7836000000000002e-05 2021-10-08T19:25:51.909 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.910 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.910 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:25:51.910 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.380403+0000", 2021-10-08T19:25:51.910 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9810000000000003e-06 2021-10-08T19:25:51.911 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.911 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.911 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:25:51.911 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.380408+0000", 2021-10-08T19:25:51.911 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.237e-06 2021-10-08T19:25:51.912 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.912 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.912 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:25:51.912 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.382453+0000", 2021-10-08T19:25:51.912 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020453910000000001 2021-10-08T19:25:51.913 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.913 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.913 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:25:51.913 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.382629+0000", 2021-10-08T19:25:51.914 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017584799999999999 2021-10-08T19:25:51.914 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.914 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.914 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:25:51.914 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.382793+0000", 2021-10-08T19:25:51.915 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000163859 2021-10-08T19:25:51.915 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.915 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.915 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:51.915 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.386787+0000", 2021-10-08T19:25:51.916 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0039934790000000003 2021-10-08T19:25:51.916 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.916 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.916 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:25:51.917 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.387500+0000", 2021-10-08T19:25:51.917 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00071292899999999995 2021-10-08T19:25:51.917 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.917 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.917 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:51.918 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.574989+0000", 2021-10-08T19:25:51.918 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.18748959400000001 2021-10-08T19:25:51.918 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.918 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.918 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:25:51.919 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.575044+0000", 2021-10-08T19:25:51.919 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5183999999999999e-05 2021-10-08T19:25:51.919 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.919 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.920 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:25:51.920 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.575083+0000", 2021-10-08T19:25:51.920 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8649000000000002e-05 2021-10-08T19:25:51.920 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:51.920 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:25:51.921 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:51.921 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.921 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.921 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:58838 7.5 7:a978e539:::benchmark_data_smithi097_93198_object58837:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2021-10-08T19:25:51.921 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:24:38.418842+0000", 2021-10-08T19:25:51.922 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 73.267713329000003, 2021-10-08T19:25:51.922 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.15687025600000001, 2021-10-08T19:25:51.922 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:25:51.922 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:51.923 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:25:51.923 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:25:51.923 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:25:51.923 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 58838 2021-10-08T19:25:51.923 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.924 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:25:51.924 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.924 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:25:51.924 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.418842+0000", 2021-10-08T19:25:51.925 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:51.925 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.925 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.925 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:25:51.925 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.418842+0000", 2021-10-08T19:25:51.926 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:51.926 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.926 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.926 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:25:51.926 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.418839+0000", 2021-10-08T19:25:51.927 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999971 2021-10-08T19:25:51.927 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.927 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.927 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:25:51.928 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.418877+0000", 2021-10-08T19:25:51.928 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8019000000000003e-05 2021-10-08T19:25:51.928 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.928 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.928 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:25:51.929 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.418894+0000", 2021-10-08T19:25:51.929 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6755000000000001e-05 2021-10-08T19:25:51.929 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.929 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.929 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:25:51.930 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.418900+0000", 2021-10-08T19:25:51.930 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2910000000000004e-06 2021-10-08T19:25:51.930 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.930 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.931 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:25:51.931 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.418951+0000", 2021-10-08T19:25:51.931 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0330000000000001e-05 2021-10-08T19:25:51.931 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.931 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.932 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:25:51.932 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.419072+0000", 2021-10-08T19:25:51.932 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000121651 2021-10-08T19:25:51.932 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.932 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.933 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:25:51.933 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.419199+0000", 2021-10-08T19:25:51.933 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000126525 2021-10-08T19:25:51.933 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.934 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.934 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:25:51.934 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.420787+0000", 2021-10-08T19:25:51.934 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0015883309999999999 2021-10-08T19:25:51.934 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.935 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.935 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:51.935 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.421139+0000", 2021-10-08T19:25:51.935 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00035210500000000002 2021-10-08T19:25:51.935 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.936 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.936 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:51.936 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.575628+0000", 2021-10-08T19:25:51.936 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.15448861 2021-10-08T19:25:51.937 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.937 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.937 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:25:51.937 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.575675+0000", 2021-10-08T19:25:51.937 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7304e-05 2021-10-08T19:25:51.938 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.938 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.938 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:25:51.938 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.575713+0000", 2021-10-08T19:25:51.938 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7273e-05 2021-10-08T19:25:51.939 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:51.939 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:25:51.939 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:51.939 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.939 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.940 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:75390 7.5 7:adb05600:::benchmark_data_smithi097_93198_object75389:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127)", 2021-10-08T19:25:51.940 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:24:59.949367+0000", 2021-10-08T19:25:51.940 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 51.737188588000002, 2021-10-08T19:25:51.940 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.050960186999999997, 2021-10-08T19:25:51.941 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:25:51.941 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:51.941 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:25:51.941 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:25:51.941 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:25:51.942 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 75390 2021-10-08T19:25:51.942 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.942 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:25:51.942 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.943 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:25:51.943 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:59.949367+0000", 2021-10-08T19:25:51.943 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:51.943 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.943 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.944 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:25:51.944 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:59.949367+0000", 2021-10-08T19:25:51.944 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:51.944 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.944 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.945 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:25:51.945 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:59.949364+0000", 2021-10-08T19:25:51.945 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999971 2021-10-08T19:25:51.945 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.945 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.946 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:25:51.946 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:59.949409+0000", 2021-10-08T19:25:51.946 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4790000000000003e-05 2021-10-08T19:25:51.946 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.947 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.947 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:25:51.947 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:59.949422+0000", 2021-10-08T19:25:51.947 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2816000000000001e-05 2021-10-08T19:25:51.947 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.948 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.948 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:25:51.948 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:59.949429+0000", 2021-10-08T19:25:51.948 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5690000000000001e-06 2021-10-08T19:25:51.948 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.949 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.949 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:25:51.949 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:59.949483+0000", 2021-10-08T19:25:51.949 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4392999999999999e-05 2021-10-08T19:25:51.949 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.950 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.950 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:25:51.950 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:59.949632+0000", 2021-10-08T19:25:51.950 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014861599999999999 2021-10-08T19:25:51.951 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.951 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.951 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:25:51.951 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:59.949809+0000", 2021-10-08T19:25:51.951 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017787400000000001 2021-10-08T19:25:51.952 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.952 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.952 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:25:51.952 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:59.952367+0000", 2021-10-08T19:25:51.952 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0025574819999999998 2021-10-08T19:25:51.953 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.953 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.953 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:51.953 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:59.973611+0000", 2021-10-08T19:25:51.953 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.021243925 2021-10-08T19:25:51.954 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.954 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.954 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:51.954 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.000239+0000", 2021-10-08T19:25:51.955 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026628608000000002 2021-10-08T19:25:51.955 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.955 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.955 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:25:51.955 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.000285+0000", 2021-10-08T19:25:51.956 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5881000000000003e-05 2021-10-08T19:25:51.956 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.956 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.956 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:25:51.956 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.000327+0000", 2021-10-08T19:25:51.957 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1893e-05 2021-10-08T19:25:51.957 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:51.957 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:25:51.957 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:51.957 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.958 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.958 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:75529 7.5 7:a1118b3f:::benchmark_data_smithi097_93198_object75528:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127)", 2021-10-08T19:25:51.958 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:25:00.217352+0000", 2021-10-08T19:25:51.958 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 51.469203747000002, 2021-10-08T19:25:51.959 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.058454335000000003, 2021-10-08T19:25:51.959 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:25:51.959 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:51.959 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:25:51.959 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:25:51.960 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:25:51.960 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 75529 2021-10-08T19:25:51.960 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.960 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:25:51.961 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.961 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:25:51.961 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.217352+0000", 2021-10-08T19:25:51.961 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:51.961 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.962 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.962 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:25:51.962 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.217352+0000", 2021-10-08T19:25:51.962 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:51.962 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.963 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.963 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:25:51.963 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.217349+0000", 2021-10-08T19:25:51.963 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:25:51.963 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.964 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.964 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:25:51.964 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.217400+0000", 2021-10-08T19:25:51.964 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0501000000000003e-05 2021-10-08T19:25:51.965 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.965 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.965 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:25:51.965 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.217410+0000", 2021-10-08T19:25:51.965 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7450000000000007e-06 2021-10-08T19:25:51.966 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.966 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.966 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:25:51.966 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.217415+0000", 2021-10-08T19:25:51.967 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6030000000000004e-06 2021-10-08T19:25:51.967 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.967 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.967 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:25:51.967 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.217471+0000", 2021-10-08T19:25:51.968 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6162999999999997e-05 2021-10-08T19:25:51.968 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.968 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.968 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:25:51.968 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.217630+0000", 2021-10-08T19:25:51.969 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015816499999999999 2021-10-08T19:25:51.969 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.969 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.969 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:25:51.970 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.217834+0000", 2021-10-08T19:25:51.970 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000204267 2021-10-08T19:25:51.970 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.970 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.970 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:25:51.971 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.220493+0000", 2021-10-08T19:25:51.971 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0026591409999999998 2021-10-08T19:25:51.971 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.971 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.972 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:51.972 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.240443+0000", 2021-10-08T19:25:51.972 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019950281 2021-10-08T19:25:51.972 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.972 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.973 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:51.973 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.275735+0000", 2021-10-08T19:25:51.973 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.035291256999999999 2021-10-08T19:25:51.973 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.973 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.974 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:25:51.974 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.275776+0000", 2021-10-08T19:25:51.974 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1692e-05 2021-10-08T19:25:51.974 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.975 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.975 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:25:51.975 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.275806+0000", 2021-10-08T19:25:51.975 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9957000000000001e-05 2021-10-08T19:25:51.975 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:51.976 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:25:51.976 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:51.976 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.976 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.976 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:75533 7.5 7:a8b94296:::benchmark_data_smithi097_93198_object75532:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127)", 2021-10-08T19:25:51.977 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:25:00.225005+0000", 2021-10-08T19:25:51.977 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 51.461550694000003, 2021-10-08T19:25:51.977 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.050897713999999997, 2021-10-08T19:25:51.977 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:25:51.978 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:51.978 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:25:51.978 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:25:51.978 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:25:51.978 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 75533 2021-10-08T19:25:51.979 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.979 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:25:51.979 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.979 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:25:51.980 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.225005+0000", 2021-10-08T19:25:51.980 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:51.980 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.980 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.981 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:25:51.981 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.225005+0000", 2021-10-08T19:25:51.981 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:51.981 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.981 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.982 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:25:51.982 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.225002+0000", 2021-10-08T19:25:51.982 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999971 2021-10-08T19:25:51.982 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.982 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.983 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:25:51.983 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.225053+0000", 2021-10-08T19:25:51.983 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0442000000000003e-05 2021-10-08T19:25:51.983 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.983 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.984 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:25:51.984 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.225069+0000", 2021-10-08T19:25:51.984 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.664e-05 2021-10-08T19:25:51.984 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.985 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.985 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:25:51.985 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.225077+0000", 2021-10-08T19:25:51.985 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3100000000000003e-06 2021-10-08T19:25:51.985 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.986 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.986 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:25:51.986 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.225130+0000", 2021-10-08T19:25:51.986 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.3974000000000002e-05 2021-10-08T19:25:51.986 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.987 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.987 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:25:51.987 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.225288+0000", 2021-10-08T19:25:51.987 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000157054 2021-10-08T19:25:51.988 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.988 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.988 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:25:51.988 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.225483+0000", 2021-10-08T19:25:51.988 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000195677 2021-10-08T19:25:51.989 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.989 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.989 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:25:51.989 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.228300+0000", 2021-10-08T19:25:51.989 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028167930000000002 2021-10-08T19:25:51.990 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.990 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.990 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:51.990 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.250005+0000", 2021-10-08T19:25:51.991 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.021704636999999999 2021-10-08T19:25:51.991 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.991 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.991 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:51.991 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.275842+0000", 2021-10-08T19:25:51.992 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025837315 2021-10-08T19:25:51.992 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.992 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.992 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:25:51.992 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.275876+0000", 2021-10-08T19:25:51.993 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4314999999999999e-05 2021-10-08T19:25:51.993 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.993 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.993 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:25:51.993 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.275903+0000", 2021-10-08T19:25:51.994 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6341000000000001e-05 2021-10-08T19:25:51.994 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:51.994 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:25:51.994 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:51.995 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.995 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.995 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:75540 7.5 7:ae2d1db2:::benchmark_data_smithi097_93198_object75539:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127)", 2021-10-08T19:25:51.995 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:25:00.231199+0000", 2021-10-08T19:25:51.995 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 51.455356301000002, 2021-10-08T19:25:51.996 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.053157583000000001, 2021-10-08T19:25:51.996 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:25:51.996 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:51.996 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:25:51.996 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:25:51.997 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:25:51.997 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 75540 2021-10-08T19:25:51.997 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.997 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:25:51.997 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.998 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:25:51.998 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.231199+0000", 2021-10-08T19:25:51.998 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:51.998 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:51.999 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:51.999 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:25:51.999 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.231199+0000", 2021-10-08T19:25:51.999 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:51.999 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:52.000 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:52.000 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:25:52.000 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.231196+0000", 2021-10-08T19:25:52.000 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999971 2021-10-08T19:25:52.001 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:52.001 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:52.001 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:25:52.001 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.231251+0000", 2021-10-08T19:25:52.001 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4585e-05 2021-10-08T19:25:52.002 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:52.002 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:52.002 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:25:52.002 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.231275+0000", 2021-10-08T19:25:52.003 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3768999999999999e-05 2021-10-08T19:25:52.003 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:52.003 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:52.003 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:25:52.003 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.231284+0000", 2021-10-08T19:25:52.004 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0869999999999996e-06 2021-10-08T19:25:52.004 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:52.004 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:52.004 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:25:52.005 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.231342+0000", 2021-10-08T19:25:52.005 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7723000000000003e-05 2021-10-08T19:25:52.005 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:52.005 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:52.005 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:25:52.006 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.231529+0000", 2021-10-08T19:25:52.006 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00018702599999999999 2021-10-08T19:25:52.006 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:52.006 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:52.007 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:25:52.007 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.231736+0000", 2021-10-08T19:25:52.007 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000207245 2021-10-08T19:25:52.007 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:52.008 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:52.008 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:25:52.008 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.234376+0000", 2021-10-08T19:25:52.008 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0026396900000000001 2021-10-08T19:25:52.008 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:52.009 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:52.009 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:52.009 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.255401+0000", 2021-10-08T19:25:52.009 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.021025193000000001 2021-10-08T19:25:52.009 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:52.010 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:52.010 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:52.010 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.284298+0000", 2021-10-08T19:25:52.010 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.028897656000000001 2021-10-08T19:25:52.011 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:52.011 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:52.011 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:25:52.011 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.284335+0000", 2021-10-08T19:25:52.011 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6726e-05 2021-10-08T19:25:52.012 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:52.012 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:52.012 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:25:52.012 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:00.284357+0000", 2021-10-08T19:25:52.012 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1749000000000001e-05 2021-10-08T19:25:52.013 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:52.013 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:25:52.013 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:52.013 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:52.014 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:52.014 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:77357 7.5 7:a6dd8820:::benchmark_data_smithi097_93198_object77356:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128)", 2021-10-08T19:25:52.014 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:25:02.739475+0000", 2021-10-08T19:25:52.014 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 48.947080145000001, 2021-10-08T19:25:52.014 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.065250465999999993, 2021-10-08T19:25:52.015 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:25:52.015 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:52.015 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:25:52.015 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:25:52.016 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:25:52.016 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 77357 2021-10-08T19:25:52.016 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:52.016 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:25:52.016 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:52.017 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:25:52.017 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:02.739475+0000", 2021-10-08T19:25:52.017 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:52.017 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:52.017 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:52.018 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:25:52.018 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:02.739475+0000", 2021-10-08T19:25:52.018 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:52.018 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:52.019 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:52.019 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:25:52.019 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:02.739473+0000", 2021-10-08T19:25:52.019 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:25:52.019 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:52.020 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:52.020 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:25:52.020 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:02.739571+0000", 2021-10-08T19:25:52.020 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7684999999999997e-05 2021-10-08T19:25:52.020 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:52.021 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:52.021 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:25:52.021 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:02.739586+0000", 2021-10-08T19:25:52.021 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4752e-05 2021-10-08T19:25:52.022 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:52.022 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:52.022 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:25:52.022 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:02.739596+0000", 2021-10-08T19:25:52.023 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0186e-05 2021-10-08T19:25:52.023 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:52.023 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:52.023 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:25:52.023 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:02.739643+0000", 2021-10-08T19:25:52.024 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7175000000000001e-05 2021-10-08T19:25:52.024 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:52.024 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:52.024 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:25:52.024 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:02.739750+0000", 2021-10-08T19:25:52.025 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000107156 2021-10-08T19:25:52.025 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:52.025 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:52.025 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:25:52.026 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:02.739906+0000", 2021-10-08T19:25:52.026 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015540000000000001 2021-10-08T19:25:52.026 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:52.026 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:52.026 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:25:52.027 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:02.742031+0000", 2021-10-08T19:25:52.027 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021252580000000001 2021-10-08T19:25:52.027 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:52.027 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:52.028 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:52.028 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:02.744969+0000", 2021-10-08T19:25:52.028 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0029377660000000001 2021-10-08T19:25:52.028 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:52.028 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:52.029 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:52.029 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:02.804600+0000", 2021-10-08T19:25:52.029 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.059631543000000002 2021-10-08T19:25:52.029 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:52.030 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:52.030 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:25:52.030 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:02.804672+0000", 2021-10-08T19:25:52.030 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1698000000000004e-05 2021-10-08T19:25:52.030 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:52.031 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:52.031 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:25:52.031 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:02.804726+0000", 2021-10-08T19:25:52.031 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4076999999999997e-05 2021-10-08T19:25:52.031 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:52.032 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:25:52.032 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:52.032 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:52.032 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:52.033 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:88736 7.5 7:aae723de:::benchmark_data_smithi097_93198_object88735:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134)", 2021-10-08T19:25:52.033 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:25:18.992357+0000", 2021-10-08T19:25:52.033 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 32.694198637, 2021-10-08T19:25:52.033 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.070934536000000006, 2021-10-08T19:25:52.033 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:25:52.034 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:52.034 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:25:52.034 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:25:52.034 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:25:52.034 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 88736 2021-10-08T19:25:52.035 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:52.035 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:25:52.035 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:52.035 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:25:52.036 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:18.992357+0000", 2021-10-08T19:25:52.036 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:52.036 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:52.036 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:52.036 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:25:52.037 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:18.992357+0000", 2021-10-08T19:25:52.037 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:52.037 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:52.037 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:52.037 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:25:52.038 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:18.992355+0000", 2021-10-08T19:25:52.038 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:25:52.038 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:52.038 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:52.039 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:25:52.039 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:18.992411+0000", 2021-10-08T19:25:52.039 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6070999999999999e-05 2021-10-08T19:25:52.039 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:52.040 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:52.040 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:25:52.040 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:18.992424+0000", 2021-10-08T19:25:52.040 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3084e-05 2021-10-08T19:25:52.040 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:52.041 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:52.041 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:25:52.041 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:18.992431+0000", 2021-10-08T19:25:52.041 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.9299999999999997e-06 2021-10-08T19:25:52.042 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:52.042 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:52.042 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:25:52.042 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:18.992473+0000", 2021-10-08T19:25:52.042 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2058999999999998e-05 2021-10-08T19:25:52.043 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:52.043 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:52.043 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:25:52.043 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:18.992581+0000", 2021-10-08T19:25:52.044 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010795500000000001 2021-10-08T19:25:52.044 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:52.044 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:52.044 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:25:52.044 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:18.992686+0000", 2021-10-08T19:25:52.045 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010554500000000001 2021-10-08T19:25:52.045 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:52.045 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:52.045 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:25:52.045 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:18.994457+0000", 2021-10-08T19:25:52.046 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0017707300000000001 2021-10-08T19:25:52.046 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:52.046 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:52.046 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:52.047 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:19.004536+0000", 2021-10-08T19:25:52.047 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010078897999999999 2021-10-08T19:25:52.047 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:52.047 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:52.047 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:52.048 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:19.060237+0000", 2021-10-08T19:25:52.048 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.055700772000000003 2021-10-08T19:25:52.048 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:52.048 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:52.049 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:25:52.049 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:19.063241+0000", 2021-10-08T19:25:52.049 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0030042549999999999 2021-10-08T19:25:52.049 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:52.049 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:52.050 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:25:52.050 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:19.063291+0000", 2021-10-08T19:25:52.050 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0485000000000002e-05 2021-10-08T19:25:52.050 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:52.050 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:25:52.051 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:52.051 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:52.051 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:52.051 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:89185 7.5 7:acc46ce9:::benchmark_data_smithi097_93198_object89184:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e135)", 2021-10-08T19:25:52.052 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:25:19.692010+0000", 2021-10-08T19:25:52.052 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 31.994545433999999, 2021-10-08T19:25:52.052 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.052607925, 2021-10-08T19:25:52.052 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:25:52.052 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:25:52.053 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:25:52.053 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:25:52.053 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:25:52.053 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 89185 2021-10-08T19:25:52.054 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:52.054 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:25:52.054 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:52.054 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:25:52.054 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:19.692010+0000", 2021-10-08T19:25:52.055 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:52.055 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:52.055 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:52.055 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:25:52.056 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:19.692010+0000", 2021-10-08T19:25:52.056 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:25:52.056 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:52.056 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:52.056 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:25:52.057 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:19.692007+0000", 2021-10-08T19:25:52.057 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999971 2021-10-08T19:25:52.057 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:52.057 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:52.058 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:25:52.058 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:19.692042+0000", 2021-10-08T19:25:52.058 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4869000000000001e-05 2021-10-08T19:25:52.058 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:52.058 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:52.059 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:25:52.059 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:19.692054+0000", 2021-10-08T19:25:52.059 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2163e-05 2021-10-08T19:25:52.059 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:52.060 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:52.060 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:25:52.060 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:19.692062+0000", 2021-10-08T19:25:52.060 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5000000000000002e-06 2021-10-08T19:25:52.060 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:52.061 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:52.061 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:25:52.061 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:19.692116+0000", 2021-10-08T19:25:52.061 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.3987999999999999e-05 2021-10-08T19:25:52.062 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:52.062 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:52.062 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:25:52.062 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:19.692269+0000", 2021-10-08T19:25:52.062 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000153406 2021-10-08T19:25:52.063 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:52.063 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:52.063 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:25:52.063 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:19.692444+0000", 2021-10-08T19:25:52.064 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017496100000000001 2021-10-08T19:25:52.064 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:52.064 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:52.064 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:25:52.064 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:19.694327+0000", 2021-10-08T19:25:52.065 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018825230000000001 2021-10-08T19:25:52.065 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:52.065 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:52.065 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:52.066 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:19.698873+0000", 2021-10-08T19:25:52.066 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0045465569999999997 2021-10-08T19:25:52.066 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:52.066 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:52.067 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:25:52.067 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:19.744526+0000", 2021-10-08T19:25:52.067 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.045653172999999998 2021-10-08T19:25:52.067 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:52.067 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:52.068 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:25:52.068 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:19.744577+0000", 2021-10-08T19:25:52.068 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0762e-05 2021-10-08T19:25:52.068 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:25:52.069 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:25:52.069 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:25:52.069 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:19.744618+0000", 2021-10-08T19:25:52.069 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1046e-05 2021-10-08T19:25:52.070 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:52.070 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:25:52.070 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:52.070 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:25:52.070 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:25:52.071 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:25:52.072 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:25:52.157 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:52.170 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:51 smithi097 ceph-mon[32687]: pgmap v199: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 4.5 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 586 op/s; 6567/220227 objects degraded (2.982%); 5869/220227 objects misplaced (2.665%); 1.8 MiB/s, 28 objects/s recovering 2021-10-08T19:25:52.170 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:51 smithi097 ceph-mon[41966]: pgmap v199: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 4.5 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 586 op/s; 6567/220227 objects degraded (2.982%); 5869/220227 objects misplaced (2.665%); 1.8 MiB/s, 28 objects/s recovering 2021-10-08T19:25:52.252 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:25:52.273 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2021-10-08T19:25:52.336 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:25:52.345 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:52.346 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:25:52.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:51 smithi117 ceph-mon[34585]: pgmap v199: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 4.5 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 586 op/s; 6567/220227 objects degraded (2.982%); 5869/220227 objects misplaced (2.665%); 1.8 MiB/s, 28 objects/s recovering 2021-10-08T19:25:52.447 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:25:52.478 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:52.596 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:25:52.598 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:52.599 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:25:52.603 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2021-10-08T19:25:52.701 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:25:52.728 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:52.788 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:25:52.790 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:52.791 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:25:52.892 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:25:52.905 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:25:52 smithi097 conmon[33110]: 172.21.15.97 - - [08/Oct/2021:19:25:52] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:52.905 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:25:52 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:25:52] "GET /metrics HTTP/1.1" 200 155724 "" "Prometheus/2.18.1" 2021-10-08T19:25:52.917 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:52.988 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:25:52.990 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:52.991 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:25:53.092 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:25:53.126 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:53.191 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:25:53.194 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:53.195 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:25:53.296 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:25:53.313 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2021-10-08T19:25:53.328 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:53.383 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:25:53.386 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:53.386 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:25:53.487 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:25:53.514 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:53.578 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:25:53.580 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:25:53 smithi117 conmon[69189]: level=error ts=2021-10-08T19:25:53.504Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=2 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:25:53.580 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:53 smithi117 ceph-mon[34585]: from='client.14991 v1:172.21.15.97:0/243154559' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:25:53.580 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:53 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:25:53.581 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:53 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:25:53.581 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:53 smithi117 ceph-mon[34585]: 172.21.15.97 - - [08/Oct/2021:19:25:52] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:53.581 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:53 smithi117 ceph-mon[34585]: pgmap v200: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 4.5 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 730 B/s rd, 0 B/s wr, 502 op/s; 6567/220227 objects degraded (2.982%); 5869/220227 objects misplaced (2.665%); 1.6 MiB/s, 24 objects/s recovering 2021-10-08T19:25:53.582 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:53.588 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:25:53.691 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:25:53.712 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:53 smithi097 ceph-mon[41966]: from='client.14991 v1:172.21.15.97:0/243154559' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:25:53.712 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:53 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:25:53.712 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:53 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:25:53.713 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:53 smithi097 ceph-mon[41966]: 172.21.15.97 - - [08/Oct/2021:19:25:52] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:53.713 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:53 smithi097 ceph-mon[41966]: pgmap v200: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 4.5 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 730 B/s rd, 0 B/s wr, 502 op/s; 6567/220227 objects degraded (2.982%); 5869/220227 objects misplaced (2.665%); 1.6 MiB/s, 24 objects/s recovering 2021-10-08T19:25:53.713 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:53 smithi097 ceph-mon[32687]: from='client.14991 v1:172.21.15.97:0/243154559' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:25:53.714 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:53 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:25:53.714 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:53 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:25:53.714 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:53 smithi097 ceph-mon[32687]: 172.21.15.97 - - [08/Oct/2021:19:25:52] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:53.714 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:53 smithi097 ceph-mon[32687]: pgmap v200: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 4.5 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 730 B/s rd, 0 B/s wr, 502 op/s; 6567/220227 objects degraded (2.982%); 5869/220227 objects misplaced (2.665%); 1.6 MiB/s, 24 objects/s recovering 2021-10-08T19:25:53.715 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:53.970 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":199,"stamp":"2021-10-08T19:25:50.506545+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4798683648,"num_objects":73409,"num_object_clones":0,"num_object_copies":220227,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6567,"num_objects_misplaced":5869,"num_objects_unfound":0,"num_objects_dirty":73409,"num_whiteouts":0,"num_read":1134,"num_read_kb":981,"num_write":111028,"num_write_kb":5878746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3009,"num_bytes_recovered":189928766,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":77136,"ondisk_log_size":77136,"up":504,"acting":500,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":511,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":15102228,"kb_used_data":14594452,"kb_used_omap":0,"kb_used_meta":507392,"kb_avail":734858988,"statfs":{"total":767960285184,"available":752495603712,"internally_reserved":0,"allocated":14944718848,"data_stored":14939673812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":519569408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-230555648,"num_objects":-3518,"num_object_clones":0,"num_object_copies":-10554,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":342,"num_objects_misplaced":-516,"num_objects_unfound":0,"num_objects_dirty":-3518,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3518,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":11403264,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002202"},"pg_stats":[{"pgid":"5.9","version":"114'10","reported_seq":182,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:46.764850+0000","last_change":"2021-10-08T19:24:25.116744+0000","last_active":"2021-10-08T19:25:46.764850+0000","last_peered":"2021-10-08T19:25:46.764850+0000","last_clean":"2021-10-08T19:25:46.764850+0000","last_became_active":"2021-10-08T19:24:25.096162+0000","last_became_peered":"2021-10-08T19:24:25.096162+0000","last_unstale":"2021-10-08T19:25:46.764850+0000","last_undegraded":"2021-10-08T19:25:46.764850+0000","last_fullsized":"2021-10-08T19:25:46.764850+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'8","last_scrub_stamp":"2021-10-08T19:22:51.065949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:51.065949+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020224639999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"87'22","reported_seq":183,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.507790+0000","last_change":"2021-10-08T19:24:25.118654+0000","last_active":"2021-10-08T19:25:45.507790+0000","last_peered":"2021-10-08T19:25:45.507790+0000","last_clean":"2021-10-08T19:25:45.507790+0000","last_became_active":"2021-10-08T19:24:25.088861+0000","last_became_peered":"2021-10-08T19:24:25.088861+0000","last_unstale":"2021-10-08T19:25:45.507790+0000","last_undegraded":"2021-10-08T19:25:45.507790+0000","last_fullsized":"2021-10-08T19:25:45.507790+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'22","last_scrub_stamp":"2021-10-08T19:24:20.355553+0000","last_deep_scrub":"87'22","last_deep_scrub_stamp":"2021-10-08T19:22:58.705632+0000","last_clean_scrub_stamp":"2021-10-08T19:24:20.355553+0000","log_size":22,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0022961499999999998,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":104,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.500198+0000","last_change":"2021-10-08T19:24:07.800878+0000","last_active":"2021-10-08T19:25:45.500198+0000","last_peered":"2021-10-08T19:25:45.500198+0000","last_clean":"2021-10-08T19:25:45.500198+0000","last_became_active":"2021-10-08T19:21:23.600352+0000","last_became_peered":"2021-10-08T19:21:23.600352+0000","last_unstale":"2021-10-08T19:25:45.500198+0000","last_undegraded":"2021-10-08T19:25:45.500198+0000","last_fullsized":"2021-10-08T19:25:45.500198+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:07.800787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:07.800787+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012798608,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":109,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.508213+0000","last_change":"2021-10-08T19:24:25.089736+0000","last_active":"2021-10-08T19:25:45.508213+0000","last_peered":"2021-10-08T19:25:45.508213+0000","last_clean":"2021-10-08T19:25:45.508213+0000","last_became_active":"2021-10-08T19:24:25.089002+0000","last_became_peered":"2021-10-08T19:24:25.089002+0000","last_unstale":"2021-10-08T19:25:45.508213+0000","last_undegraded":"2021-10-08T19:25:45.508213+0000","last_fullsized":"2021-10-08T19:25:45.508213+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:10.805052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:10.805052+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.00168849,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"144'6988","reported_seq":7059,"reported_epoch":144,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-10-08T19:25:48.565967+0000","last_change":"2021-10-08T19:24:26.874507+0000","last_active":"2021-10-08T19:25:48.565967+0000","last_peered":"2021-10-08T19:25:48.565967+0000","last_clean":"2021-10-08T19:24:23.992830+0000","last_became_active":"2021-10-08T19:24:26.866104+0000","last_became_peered":"2021-10-08T19:24:26.866104+0000","last_unstale":"2021-10-08T19:25:48.565967+0000","last_undegraded":"2021-10-08T19:24:26.186413+0000","last_fullsized":"2021-10-08T19:24:26.089542+0000","mapping_epoch":113,"log_start":"110'2605","ondisk_log_start":"110'2605","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":4383,"ondisk_log_size":4383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":298844160,"num_objects":4560,"num_object_clones":0,"num_object_copies":13680,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3062,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4560,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6988,"num_write_kb":369536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5],"avail_no_missing":["1","2","5"],"object_location_counts":[{"shards":"1,2,5","objects":1848},{"shards":"1,5","objects":1498}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":26,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.529290+0000","last_change":"2021-10-08T19:25:15.510798+0000","last_active":"2021-10-08T19:25:45.529290+0000","last_peered":"2021-10-08T19:25:45.529290+0000","last_clean":"2021-10-08T19:25:45.529290+0000","last_became_active":"2021-10-08T19:25:15.510457+0000","last_became_peered":"2021-10-08T19:25:15.510457+0000","last_unstale":"2021-10-08T19:25:45.529290+0000","last_undegraded":"2021-10-08T19:25:45.529290+0000","last_fullsized":"2021-10-08T19:25:45.529290+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:09.177525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:09.177525+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"69'9","reported_seq":112,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.510240+0000","last_change":"2021-10-08T19:22:36.590210+0000","last_active":"2021-10-08T19:25:45.510240+0000","last_peered":"2021-10-08T19:25:45.510240+0000","last_clean":"2021-10-08T19:25:45.510240+0000","last_became_active":"2021-10-08T19:21:25.610072+0000","last_became_peered":"2021-10-08T19:21:25.610072+0000","last_unstale":"2021-10-08T19:25:45.510240+0000","last_undegraded":"2021-10-08T19:25:45.510240+0000","last_fullsized":"2021-10-08T19:25:45.510240+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'9","last_scrub_stamp":"2021-10-08T19:22:36.590071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:36.590071+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0026030699999999999,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":100,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.517081+0000","last_change":"2021-10-08T19:23:11.176225+0000","last_active":"2021-10-08T19:25:45.517081+0000","last_peered":"2021-10-08T19:25:45.517081+0000","last_clean":"2021-10-08T19:25:45.517081+0000","last_became_active":"2021-10-08T19:21:23.607639+0000","last_became_peered":"2021-10-08T19:21:23.607639+0000","last_unstale":"2021-10-08T19:25:45.517081+0000","last_undegraded":"2021-10-08T19:25:45.517081+0000","last_fullsized":"2021-10-08T19:25:45.517081+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:11.176122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:11.176122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040114119999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":94,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.500569+0000","last_change":"2021-10-08T19:22:42.359224+0000","last_active":"2021-10-08T19:25:45.500569+0000","last_peered":"2021-10-08T19:25:45.500569+0000","last_clean":"2021-10-08T19:25:45.500569+0000","last_became_active":"2021-10-08T19:21:27.635310+0000","last_became_peered":"2021-10-08T19:21:27.635310+0000","last_unstale":"2021-10-08T19:25:45.500569+0000","last_undegraded":"2021-10-08T19:25:45.500569+0000","last_fullsized":"2021-10-08T19:25:45.500569+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:42.359130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:42.359130+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001847357,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":92,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.509747+0000","last_change":"2021-10-08T19:22:57.644734+0000","last_active":"2021-10-08T19:25:45.509747+0000","last_peered":"2021-10-08T19:25:45.509747+0000","last_clean":"2021-10-08T19:25:45.509747+0000","last_became_active":"2021-10-08T19:21:29.643022+0000","last_became_peered":"2021-10-08T19:21:29.643022+0000","last_unstale":"2021-10-08T19:25:45.509747+0000","last_undegraded":"2021-10-08T19:25:45.509747+0000","last_fullsized":"2021-10-08T19:25:45.509747+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:57.644627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:57.644627+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002174952,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"144'6866","reported_seq":6924,"reported_epoch":144,"state":"active+clean","last_fresh":"2021-10-08T19:25:48.483340+0000","last_change":"2021-10-08T19:23:44.804233+0000","last_active":"2021-10-08T19:25:48.483340+0000","last_peered":"2021-10-08T19:25:48.483340+0000","last_clean":"2021-10-08T19:25:48.483340+0000","last_became_active":"2021-10-08T19:23:44.803928+0000","last_became_peered":"2021-10-08T19:23:44.803928+0000","last_unstale":"2021-10-08T19:25:48.483340+0000","last_undegraded":"2021-10-08T19:25:48.483340+0000","last_fullsized":"2021-10-08T19:25:48.483340+0000","mapping_epoch":94,"log_start":"99'1300","ondisk_log_start":"99'1300","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":5566,"ondisk_log_size":5566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":297664512,"num_objects":4542,"num_object_clones":0,"num_object_copies":13626,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4542,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6866,"num_write_kb":365056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4],"acting":[2,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"70'5","reported_seq":166,"reported_epoch":144,"state":"active+clean","last_fresh":"2021-10-08T19:25:47.282792+0000","last_change":"2021-10-08T19:24:25.638250+0000","last_active":"2021-10-08T19:25:47.282792+0000","last_peered":"2021-10-08T19:25:47.282792+0000","last_clean":"2021-10-08T19:25:47.282792+0000","last_became_active":"2021-10-08T19:24:25.103095+0000","last_became_peered":"2021-10-08T19:24:25.103095+0000","last_unstale":"2021-10-08T19:25:47.282792+0000","last_undegraded":"2021-10-08T19:25:47.282792+0000","last_fullsized":"2021-10-08T19:25:47.282792+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:24:16.396790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:16.396790+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0078447029999999997,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":89,"num_read_kb":89,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":389,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"69'19","reported_seq":61,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.502345+0000","last_change":"2021-10-08T19:24:25.121334+0000","last_active":"2021-10-08T19:25:45.502345+0000","last_peered":"2021-10-08T19:25:45.502345+0000","last_clean":"2021-10-08T19:25:45.502345+0000","last_became_active":"2021-10-08T19:24:25.094547+0000","last_became_peered":"2021-10-08T19:24:25.094547+0000","last_unstale":"2021-10-08T19:25:45.502345+0000","last_undegraded":"2021-10-08T19:25:45.502345+0000","last_fullsized":"2021-10-08T19:25:45.502345+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'19","last_scrub_stamp":"2021-10-08T19:22:39.356508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:39.356508+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":31,"num_read_kb":20,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":98,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.501595+0000","last_change":"2021-10-08T19:22:57.380012+0000","last_active":"2021-10-08T19:25:45.501595+0000","last_peered":"2021-10-08T19:25:45.501595+0000","last_clean":"2021-10-08T19:25:45.501595+0000","last_became_active":"2021-10-08T19:21:23.595919+0000","last_became_peered":"2021-10-08T19:21:23.595919+0000","last_unstale":"2021-10-08T19:25:45.501595+0000","last_undegraded":"2021-10-08T19:25:45.501595+0000","last_fullsized":"2021-10-08T19:25:45.501595+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:57.379935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:57.379935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034209349999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":94,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.499729+0000","last_change":"2021-10-08T19:23:09.419579+0000","last_active":"2021-10-08T19:25:45.499729+0000","last_peered":"2021-10-08T19:25:45.499729+0000","last_clean":"2021-10-08T19:25:45.499729+0000","last_became_active":"2021-10-08T19:21:27.638583+0000","last_became_peered":"2021-10-08T19:21:27.638583+0000","last_unstale":"2021-10-08T19:25:45.499729+0000","last_undegraded":"2021-10-08T19:25:45.499729+0000","last_fullsized":"2021-10-08T19:25:45.499729+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:09.419493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:09.419493+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003406498,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":92,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.527549+0000","last_change":"2021-10-08T19:23:03.272654+0000","last_active":"2021-10-08T19:25:45.527549+0000","last_peered":"2021-10-08T19:25:45.527549+0000","last_clean":"2021-10-08T19:25:45.527549+0000","last_became_active":"2021-10-08T19:21:29.648922+0000","last_became_peered":"2021-10-08T19:21:29.648922+0000","last_unstale":"2021-10-08T19:25:45.527549+0000","last_undegraded":"2021-10-08T19:25:45.527549+0000","last_fullsized":"2021-10-08T19:25:45.527549+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:03.272581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:03.272581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001525874,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"144'6940","reported_seq":6998,"reported_epoch":144,"state":"active+clean","last_fresh":"2021-10-08T19:25:48.580891+0000","last_change":"2021-10-08T19:23:44.815633+0000","last_active":"2021-10-08T19:25:48.580891+0000","last_peered":"2021-10-08T19:25:48.580891+0000","last_clean":"2021-10-08T19:25:48.580891+0000","last_became_active":"2021-10-08T19:23:44.815346+0000","last_became_peered":"2021-10-08T19:23:44.815346+0000","last_unstale":"2021-10-08T19:25:48.580891+0000","last_undegraded":"2021-10-08T19:25:48.580891+0000","last_fullsized":"2021-10-08T19:25:48.580891+0000","mapping_epoch":94,"log_start":"105'2080","ondisk_log_start":"105'2080","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":4860,"ondisk_log_size":4860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":300548096,"num_objects":4586,"num_object_clones":0,"num_object_copies":13758,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4586,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6940,"num_write_kb":368832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.528727+0000","last_change":"2021-10-08T19:25:15.503388+0000","last_active":"2021-10-08T19:25:45.528727+0000","last_peered":"2021-10-08T19:25:45.528727+0000","last_clean":"2021-10-08T19:25:45.528727+0000","last_became_active":"2021-10-08T19:25:15.503081+0000","last_became_peered":"2021-10-08T19:25:15.503081+0000","last_unstale":"2021-10-08T19:25:45.528727+0000","last_undegraded":"2021-10-08T19:25:45.528727+0000","last_fullsized":"2021-10-08T19:25:45.528727+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:17.379559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:17.379559+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0090469920000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"69'17","reported_seq":123,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.498349+0000","last_change":"2021-10-08T19:22:47.109498+0000","last_active":"2021-10-08T19:25:45.498349+0000","last_peered":"2021-10-08T19:25:45.498349+0000","last_clean":"2021-10-08T19:25:45.498349+0000","last_became_active":"2021-10-08T19:21:25.609086+0000","last_became_peered":"2021-10-08T19:21:25.609086+0000","last_unstale":"2021-10-08T19:25:45.498349+0000","last_undegraded":"2021-10-08T19:25:45.498349+0000","last_fullsized":"2021-10-08T19:25:45.498349+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'17","last_scrub_stamp":"2021-10-08T19:22:47.109407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:47.109407+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0025026100000000002,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"61'1","reported_seq":106,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.528222+0000","last_change":"2021-10-08T19:22:55.080106+0000","last_active":"2021-10-08T19:25:45.528222+0000","last_peered":"2021-10-08T19:25:45.528222+0000","last_clean":"2021-10-08T19:25:45.528222+0000","last_became_active":"2021-10-08T19:21:23.607064+0000","last_became_peered":"2021-10-08T19:21:23.607064+0000","last_unstale":"2021-10-08T19:25:45.528222+0000","last_undegraded":"2021-10-08T19:25:45.528222+0000","last_fullsized":"2021-10-08T19:25:45.528222+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'1","last_scrub_stamp":"2021-10-08T19:22:55.080028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:55.080028+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040037620000000001,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":100,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.516142+0000","last_change":"2021-10-08T19:23:36.055728+0000","last_active":"2021-10-08T19:25:45.516142+0000","last_peered":"2021-10-08T19:25:45.516142+0000","last_clean":"2021-10-08T19:25:45.516142+0000","last_became_active":"2021-10-08T19:21:27.636429+0000","last_became_peered":"2021-10-08T19:21:27.636429+0000","last_unstale":"2021-10-08T19:25:45.516142+0000","last_undegraded":"2021-10-08T19:25:45.516142+0000","last_fullsized":"2021-10-08T19:25:45.516142+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:36.055616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:36.055616+0000","last_clean_scrub_stamp":"2021-10-08T19:23:36.055616+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0022840669999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":92,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.499553+0000","last_change":"2021-10-08T19:23:10.377105+0000","last_active":"2021-10-08T19:25:45.499553+0000","last_peered":"2021-10-08T19:25:45.499553+0000","last_clean":"2021-10-08T19:25:45.499553+0000","last_became_active":"2021-10-08T19:21:29.646455+0000","last_became_peered":"2021-10-08T19:21:29.646455+0000","last_unstale":"2021-10-08T19:25:45.499553+0000","last_undegraded":"2021-10-08T19:25:45.499553+0000","last_fullsized":"2021-10-08T19:25:45.499553+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:10.377024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:10.377024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0035706969999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"144'6991","reported_seq":7049,"reported_epoch":144,"state":"active+clean","last_fresh":"2021-10-08T19:25:48.501312+0000","last_change":"2021-10-08T19:23:44.811875+0000","last_active":"2021-10-08T19:25:48.501312+0000","last_peered":"2021-10-08T19:25:48.501312+0000","last_clean":"2021-10-08T19:25:48.501312+0000","last_became_active":"2021-10-08T19:23:44.810666+0000","last_became_peered":"2021-10-08T19:23:44.810666+0000","last_unstale":"2021-10-08T19:25:48.501312+0000","last_undegraded":"2021-10-08T19:25:48.501312+0000","last_fullsized":"2021-10-08T19:25:48.501312+0000","mapping_epoch":94,"log_start":"100'1359","ondisk_log_start":"100'1359","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":5632,"ondisk_log_size":5632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":306774016,"num_objects":4681,"num_object_clones":0,"num_object_copies":14043,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4681,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6991,"num_write_kb":373504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":41,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.502576+0000","last_change":"2021-10-08T19:24:25.106422+0000","last_active":"2021-10-08T19:25:45.502576+0000","last_peered":"2021-10-08T19:25:45.502576+0000","last_clean":"2021-10-08T19:25:45.502576+0000","last_became_active":"2021-10-08T19:24:25.105702+0000","last_became_peered":"2021-10-08T19:24:25.105702+0000","last_unstale":"2021-10-08T19:25:45.502576+0000","last_undegraded":"2021-10-08T19:25:45.502576+0000","last_fullsized":"2021-10-08T19:25:45.502576+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:40.563247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.563247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.024890005999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"69'10","reported_seq":152,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.498432+0000","last_change":"2021-10-08T19:24:25.983761+0000","last_active":"2021-10-08T19:25:45.498432+0000","last_peered":"2021-10-08T19:25:45.498432+0000","last_clean":"2021-10-08T19:25:45.498432+0000","last_became_active":"2021-10-08T19:24:25.098048+0000","last_became_peered":"2021-10-08T19:24:25.098048+0000","last_unstale":"2021-10-08T19:25:45.498432+0000","last_undegraded":"2021-10-08T19:25:45.498432+0000","last_fullsized":"2021-10-08T19:25:45.498432+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'10","last_scrub_stamp":"2021-10-08T19:22:35.356292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:35.356292+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040689319999999999,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":104,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.514264+0000","last_change":"2021-10-08T19:24:15.233590+0000","last_active":"2021-10-08T19:25:45.514264+0000","last_peered":"2021-10-08T19:25:45.514264+0000","last_clean":"2021-10-08T19:25:45.514264+0000","last_became_active":"2021-10-08T19:21:23.603207+0000","last_became_peered":"2021-10-08T19:21:23.603207+0000","last_unstale":"2021-10-08T19:25:45.514264+0000","last_undegraded":"2021-10-08T19:25:45.514264+0000","last_fullsized":"2021-10-08T19:25:45.514264+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:15.233394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:15.233394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0046454499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"69'8","reported_seq":161,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:46.764412+0000","last_change":"2021-10-08T19:24:09.793029+0000","last_active":"2021-10-08T19:25:46.764412+0000","last_peered":"2021-10-08T19:25:46.764412+0000","last_clean":"2021-10-08T19:25:46.764412+0000","last_became_active":"2021-10-08T19:21:27.637930+0000","last_became_peered":"2021-10-08T19:21:27.637930+0000","last_unstale":"2021-10-08T19:25:46.764412+0000","last_undegraded":"2021-10-08T19:25:46.764412+0000","last_fullsized":"2021-10-08T19:25:46.764412+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'8","last_scrub_stamp":"2021-10-08T19:24:09.792928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:09.792928+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0052042049999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":97,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.498866+0000","last_change":"2021-10-08T19:24:19.303768+0000","last_active":"2021-10-08T19:25:45.498866+0000","last_peered":"2021-10-08T19:25:45.498866+0000","last_clean":"2021-10-08T19:25:45.498866+0000","last_became_active":"2021-10-08T19:21:29.640249+0000","last_became_peered":"2021-10-08T19:21:29.640249+0000","last_unstale":"2021-10-08T19:25:45.498866+0000","last_undegraded":"2021-10-08T19:25:45.498866+0000","last_fullsized":"2021-10-08T19:25:45.498866+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:19.303695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:24:19.303695+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0069500159999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"144'6842","reported_seq":6900,"reported_epoch":144,"state":"active+clean","last_fresh":"2021-10-08T19:25:48.594868+0000","last_change":"2021-10-08T19:23:44.812210+0000","last_active":"2021-10-08T19:25:48.594868+0000","last_peered":"2021-10-08T19:25:48.594868+0000","last_clean":"2021-10-08T19:25:48.594868+0000","last_became_active":"2021-10-08T19:23:44.810340+0000","last_became_peered":"2021-10-08T19:23:44.810340+0000","last_unstale":"2021-10-08T19:25:48.594868+0000","last_undegraded":"2021-10-08T19:25:48.594868+0000","last_fullsized":"2021-10-08T19:25:48.594868+0000","mapping_epoch":94,"log_start":"104'2001","ondisk_log_start":"104'2001","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":4841,"ondisk_log_size":4841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":298582016,"num_objects":4556,"num_object_clones":0,"num_object_copies":13668,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4556,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6842,"num_write_kb":364736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":48,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.506968+0000","last_change":"2021-10-08T19:24:13.518853+0000","last_active":"2021-10-08T19:25:45.506968+0000","last_peered":"2021-10-08T19:25:45.506968+0000","last_clean":"2021-10-08T19:25:45.506968+0000","last_became_active":"2021-10-08T19:24:13.518601+0000","last_became_peered":"2021-10-08T19:24:13.518601+0000","last_unstale":"2021-10-08T19:25:45.506968+0000","last_undegraded":"2021-10-08T19:25:45.506968+0000","last_fullsized":"2021-10-08T19:25:45.506968+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:09.177525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:09.177525+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"69'15","reported_seq":121,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.515445+0000","last_change":"2021-10-08T19:22:56.213566+0000","last_active":"2021-10-08T19:25:45.515445+0000","last_peered":"2021-10-08T19:25:45.515445+0000","last_clean":"2021-10-08T19:25:45.515445+0000","last_became_active":"2021-10-08T19:21:25.617776+0000","last_became_peered":"2021-10-08T19:21:25.617776+0000","last_unstale":"2021-10-08T19:25:45.515445+0000","last_undegraded":"2021-10-08T19:25:45.515445+0000","last_fullsized":"2021-10-08T19:25:45.515445+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'15","last_scrub_stamp":"2021-10-08T19:22:56.213493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:56.213493+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039771219999999996,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":104,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.515176+0000","last_change":"2021-10-08T19:24:07.213134+0000","last_active":"2021-10-08T19:25:45.515176+0000","last_peered":"2021-10-08T19:25:45.515176+0000","last_clean":"2021-10-08T19:25:45.515176+0000","last_became_active":"2021-10-08T19:21:23.603264+0000","last_became_peered":"2021-10-08T19:21:23.603264+0000","last_unstale":"2021-10-08T19:25:45.515176+0000","last_undegraded":"2021-10-08T19:25:45.515176+0000","last_fullsized":"2021-10-08T19:25:45.515176+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:07.213008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:07.213008+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0079250429999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"88'9","reported_seq":158,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:46.763812+0000","last_change":"2021-10-08T19:23:00.048324+0000","last_active":"2021-10-08T19:25:46.763812+0000","last_peered":"2021-10-08T19:25:46.763812+0000","last_clean":"2021-10-08T19:25:46.763812+0000","last_became_active":"2021-10-08T19:21:27.636432+0000","last_became_peered":"2021-10-08T19:21:27.636432+0000","last_unstale":"2021-10-08T19:25:46.763812+0000","last_undegraded":"2021-10-08T19:25:46.763812+0000","last_fullsized":"2021-10-08T19:25:46.763812+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'9","last_scrub_stamp":"2021-10-08T19:23:00.048245+0000","last_deep_scrub":"88'9","last_deep_scrub_stamp":"2021-10-08T19:23:00.048245+0000","last_clean_scrub_stamp":"2021-10-08T19:23:00.048245+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0031661179999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":97,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.508397+0000","last_change":"2021-10-08T19:24:11.330063+0000","last_active":"2021-10-08T19:25:45.508397+0000","last_peered":"2021-10-08T19:25:45.508397+0000","last_clean":"2021-10-08T19:25:45.508397+0000","last_became_active":"2021-10-08T19:21:29.639358+0000","last_became_peered":"2021-10-08T19:21:29.639358+0000","last_unstale":"2021-10-08T19:25:45.508397+0000","last_undegraded":"2021-10-08T19:25:45.508397+0000","last_fullsized":"2021-10-08T19:25:45.508397+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:11.329954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:24:11.329954+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.01088446,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"144'6786","reported_seq":8747,"reported_epoch":144,"state":"active+recovering+remapped","last_fresh":"2021-10-08T19:25:48.470860+0000","last_change":"2021-10-08T19:24:26.855973+0000","last_active":"2021-10-08T19:25:48.470860+0000","last_peered":"2021-10-08T19:25:48.470860+0000","last_clean":"2021-10-08T19:24:24.005251+0000","last_became_active":"2021-10-08T19:24:26.848578+0000","last_became_peered":"2021-10-08T19:24:26.848578+0000","last_unstale":"2021-10-08T19:25:48.470860+0000","last_undegraded":"2021-10-08T19:25:48.470860+0000","last_fullsized":"2021-10-08T19:25:48.470860+0000","mapping_epoch":113,"log_start":"99'1200","ondisk_log_start":"99'1200","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":5586,"ondisk_log_size":5586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":297009152,"num_objects":4532,"num_object_clones":0,"num_object_copies":13596,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2097,"num_objects_unfound":0,"num_objects_dirty":4532,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6786,"num_write_kb":362176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":949,"num_bytes_recovered":62193664,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[2,3,7],"avail_no_missing":["2","3","7"],"object_location_counts":[{"shards":"2,3,7","objects":2435}],"blocked_by":[],"up_primary":6,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"70'5","reported_seq":47,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.510777+0000","last_change":"2021-10-08T19:24:13.513690+0000","last_active":"2021-10-08T19:25:45.510777+0000","last_peered":"2021-10-08T19:25:45.510777+0000","last_clean":"2021-10-08T19:25:45.510777+0000","last_became_active":"2021-10-08T19:24:13.513289+0000","last_became_peered":"2021-10-08T19:24:13.513289+0000","last_unstale":"2021-10-08T19:25:45.510777+0000","last_undegraded":"2021-10-08T19:25:45.510777+0000","last_fullsized":"2021-10-08T19:25:45.510777+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:22:48.239721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:48.239721+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001618092,"stat_sum":{"num_bytes":97,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":31,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"69'11","reported_seq":156,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.498671+0000","last_change":"2021-10-08T19:24:25.123530+0000","last_active":"2021-10-08T19:25:45.498671+0000","last_peered":"2021-10-08T19:25:45.498671+0000","last_clean":"2021-10-08T19:25:45.498671+0000","last_became_active":"2021-10-08T19:24:25.097983+0000","last_became_peered":"2021-10-08T19:24:25.097983+0000","last_unstale":"2021-10-08T19:25:45.498671+0000","last_undegraded":"2021-10-08T19:25:45.498671+0000","last_fullsized":"2021-10-08T19:25:45.498671+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'11","last_scrub_stamp":"2021-10-08T19:23:01.988336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:01.988336+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0026768489999999998,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":104,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.527714+0000","last_change":"2021-10-08T19:24:14.537933+0000","last_active":"2021-10-08T19:25:45.527714+0000","last_peered":"2021-10-08T19:25:45.527714+0000","last_clean":"2021-10-08T19:25:45.527714+0000","last_became_active":"2021-10-08T19:21:23.606597+0000","last_became_peered":"2021-10-08T19:21:23.606597+0000","last_unstale":"2021-10-08T19:25:45.527714+0000","last_undegraded":"2021-10-08T19:25:45.527714+0000","last_fullsized":"2021-10-08T19:25:45.527714+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:14.537859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:14.537859+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.00235264,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":111,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.508848+0000","last_change":"2021-10-08T19:24:25.105582+0000","last_active":"2021-10-08T19:25:45.508848+0000","last_peered":"2021-10-08T19:25:45.508848+0000","last_clean":"2021-10-08T19:25:45.508848+0000","last_became_active":"2021-10-08T19:24:25.105244+0000","last_became_peered":"2021-10-08T19:24:25.105244+0000","last_unstale":"2021-10-08T19:25:45.508848+0000","last_undegraded":"2021-10-08T19:25:45.508848+0000","last_fullsized":"2021-10-08T19:25:45.508848+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:17.689312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:17.689312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0033939769999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":109,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.506831+0000","last_change":"2021-10-08T19:24:25.096748+0000","last_active":"2021-10-08T19:25:45.506831+0000","last_peered":"2021-10-08T19:25:45.506831+0000","last_clean":"2021-10-08T19:25:45.506831+0000","last_became_active":"2021-10-08T19:24:25.096415+0000","last_became_peered":"2021-10-08T19:24:25.096415+0000","last_unstale":"2021-10-08T19:25:45.506831+0000","last_undegraded":"2021-10-08T19:25:45.506831+0000","last_fullsized":"2021-10-08T19:25:45.506831+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:17.422176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:17.422176+0000","last_clean_scrub_stamp":"2021-10-08T19:23:17.422176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0036221249999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"144'6961","reported_seq":8929,"reported_epoch":144,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2021-10-08T19:25:48.582185+0000","last_change":"2021-10-08T19:25:42.089847+0000","last_active":"2021-10-08T19:25:48.582185+0000","last_peered":"2021-10-08T19:25:48.582185+0000","last_clean":"2021-10-08T19:24:24.154821+0000","last_became_active":"2021-10-08T19:24:26.860648+0000","last_became_peered":"2021-10-08T19:24:26.860648+0000","last_unstale":"2021-10-08T19:25:48.582185+0000","last_undegraded":"2021-10-08T19:25:42.036806+0000","last_fullsized":"2021-10-08T19:24:26.085882+0000","mapping_epoch":113,"log_start":"109'2523","ondisk_log_start":"109'2523","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":4438,"ondisk_log_size":4438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":299237400,"num_objects":4567,"num_object_clones":0,"num_object_copies":13701,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":247,"num_objects_misplaced":1875,"num_objects_unfound":0,"num_objects_dirty":4567,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6961,"num_write_kb":368833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":952,"num_bytes_recovered":62390272,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0],"acting":[1,0],"avail_no_missing":["1","0","3"],"object_location_counts":[{"shards":"0,1","objects":2445},{"shards":"0,1,3","objects":1875}],"blocked_by":[],"up_primary":6,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":48,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.498134+0000","last_change":"2021-10-08T19:24:13.506996+0000","last_active":"2021-10-08T19:25:45.498134+0000","last_peered":"2021-10-08T19:25:45.498134+0000","last_clean":"2021-10-08T19:25:45.498134+0000","last_became_active":"2021-10-08T19:24:13.506602+0000","last_became_peered":"2021-10-08T19:24:13.506602+0000","last_unstale":"2021-10-08T19:25:45.498134+0000","last_undegraded":"2021-10-08T19:25:45.498134+0000","last_fullsized":"2021-10-08T19:25:45.498134+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:09.177525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:09.177525+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"91'9","reported_seq":155,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:46.764002+0000","last_change":"2021-10-08T19:23:32.329551+0000","last_active":"2021-10-08T19:25:46.764002+0000","last_peered":"2021-10-08T19:25:46.764002+0000","last_clean":"2021-10-08T19:25:46.764002+0000","last_became_active":"2021-10-08T19:21:27.640694+0000","last_became_peered":"2021-10-08T19:21:27.640694+0000","last_unstale":"2021-10-08T19:25:46.764002+0000","last_undegraded":"2021-10-08T19:25:46.764002+0000","last_fullsized":"2021-10-08T19:25:46.764002+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'9","last_scrub_stamp":"2021-10-08T19:23:32.329475+0000","last_deep_scrub":"91'9","last_deep_scrub_stamp":"2021-10-08T19:23:32.329475+0000","last_clean_scrub_stamp":"2021-10-08T19:23:32.329475+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0045727859999999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"69'14","reported_seq":172,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.498867+0000","last_change":"2021-10-08T19:24:26.225004+0000","last_active":"2021-10-08T19:25:45.498867+0000","last_peered":"2021-10-08T19:25:45.498867+0000","last_clean":"2021-10-08T19:25:45.498867+0000","last_became_active":"2021-10-08T19:24:25.098743+0000","last_became_peered":"2021-10-08T19:24:25.098743+0000","last_unstale":"2021-10-08T19:25:45.498867+0000","last_undegraded":"2021-10-08T19:25:45.498867+0000","last_fullsized":"2021-10-08T19:25:45.498867+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'14","last_scrub_stamp":"2021-10-08T19:24:10.235796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:24:10.235796+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0042036319999999997,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.503050+0000","last_change":"2021-10-08T19:24:25.094838+0000","last_active":"2021-10-08T19:25:45.503050+0000","last_peered":"2021-10-08T19:25:45.503050+0000","last_clean":"2021-10-08T19:25:45.503050+0000","last_became_active":"2021-10-08T19:24:25.094364+0000","last_became_peered":"2021-10-08T19:24:25.094364+0000","last_unstale":"2021-10-08T19:25:45.503050+0000","last_undegraded":"2021-10-08T19:25:45.503050+0000","last_fullsized":"2021-10-08T19:25:45.503050+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:23.529696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:23.529696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":112,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.528517+0000","last_change":"2021-10-08T19:24:25.095155+0000","last_active":"2021-10-08T19:25:45.528517+0000","last_peered":"2021-10-08T19:25:45.528517+0000","last_clean":"2021-10-08T19:25:45.528517+0000","last_became_active":"2021-10-08T19:24:25.094848+0000","last_became_peered":"2021-10-08T19:24:25.094848+0000","last_unstale":"2021-10-08T19:25:45.528517+0000","last_undegraded":"2021-10-08T19:25:45.528517+0000","last_fullsized":"2021-10-08T19:25:45.528517+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:05.263508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:05.263508+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034369000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"144'6986","reported_seq":7043,"reported_epoch":144,"state":"active+clean","last_fresh":"2021-10-08T19:25:48.531539+0000","last_change":"2021-10-08T19:23:44.807321+0000","last_active":"2021-10-08T19:25:48.531539+0000","last_peered":"2021-10-08T19:25:48.531539+0000","last_clean":"2021-10-08T19:25:48.531539+0000","last_became_active":"2021-10-08T19:23:44.807072+0000","last_became_peered":"2021-10-08T19:23:44.807072+0000","last_unstale":"2021-10-08T19:25:48.531539+0000","last_undegraded":"2021-10-08T19:25:48.531539+0000","last_fullsized":"2021-10-08T19:25:48.531539+0000","mapping_epoch":94,"log_start":"110'2680","ondisk_log_start":"110'2680","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":4306,"ondisk_log_size":4306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":299761664,"num_objects":4574,"num_object_clones":0,"num_object_copies":13722,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4574,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6986,"num_write_kb":369920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":55,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.513131+0000","last_change":"2021-10-08T19:25:14.582925+0000","last_active":"2021-10-08T19:25:45.513131+0000","last_peered":"2021-10-08T19:25:45.513131+0000","last_clean":"2021-10-08T19:25:45.513131+0000","last_became_active":"2021-10-08T19:25:14.582587+0000","last_became_peered":"2021-10-08T19:25:14.582587+0000","last_unstale":"2021-10-08T19:25:45.513131+0000","last_undegraded":"2021-10-08T19:25:45.513131+0000","last_fullsized":"2021-10-08T19:25:45.513131+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:40.563247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.563247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.024890005999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":99,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.499028+0000","last_change":"2021-10-08T19:24:15.302574+0000","last_active":"2021-10-08T19:25:45.499028+0000","last_peered":"2021-10-08T19:25:45.499028+0000","last_clean":"2021-10-08T19:25:45.499028+0000","last_became_active":"2021-10-08T19:21:27.637547+0000","last_became_peered":"2021-10-08T19:21:27.637547+0000","last_unstale":"2021-10-08T19:25:45.499028+0000","last_undegraded":"2021-10-08T19:25:45.499028+0000","last_fullsized":"2021-10-08T19:25:45.499028+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:15.302475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:15.302475+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0050588849999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"69'18","reported_seq":127,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.510566+0000","last_change":"2021-10-08T19:23:20.405609+0000","last_active":"2021-10-08T19:25:45.510566+0000","last_peered":"2021-10-08T19:25:45.510566+0000","last_clean":"2021-10-08T19:25:45.510566+0000","last_became_active":"2021-10-08T19:21:25.742909+0000","last_became_peered":"2021-10-08T19:21:25.742909+0000","last_unstale":"2021-10-08T19:25:45.510566+0000","last_undegraded":"2021-10-08T19:25:45.510566+0000","last_fullsized":"2021-10-08T19:25:45.510566+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'18","last_scrub_stamp":"2021-10-08T19:23:20.405525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:20.405525+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039753820000000004,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":116,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.516360+0000","last_change":"2021-10-08T19:24:25.099209+0000","last_active":"2021-10-08T19:25:45.516360+0000","last_peered":"2021-10-08T19:25:45.516360+0000","last_clean":"2021-10-08T19:25:45.516360+0000","last_became_active":"2021-10-08T19:24:25.098790+0000","last_became_peered":"2021-10-08T19:24:25.098790+0000","last_unstale":"2021-10-08T19:25:45.516360+0000","last_undegraded":"2021-10-08T19:25:45.516360+0000","last_fullsized":"2021-10-08T19:25:45.516360+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:41.186945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:41.186945+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0037557269999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":91,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.498002+0000","last_change":"2021-10-08T19:22:40.264230+0000","last_active":"2021-10-08T19:25:45.498002+0000","last_peered":"2021-10-08T19:25:45.498002+0000","last_clean":"2021-10-08T19:25:45.498002+0000","last_became_active":"2021-10-08T19:21:29.646491+0000","last_became_peered":"2021-10-08T19:21:29.646491+0000","last_unstale":"2021-10-08T19:25:45.498002+0000","last_undegraded":"2021-10-08T19:25:45.498002+0000","last_fullsized":"2021-10-08T19:25:45.498002+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:40.264110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.264110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003475845,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"144'6969","reported_seq":7026,"reported_epoch":144,"state":"active+clean","last_fresh":"2021-10-08T19:25:48.538316+0000","last_change":"2021-10-08T19:23:44.799701+0000","last_active":"2021-10-08T19:25:48.538316+0000","last_peered":"2021-10-08T19:25:48.538316+0000","last_clean":"2021-10-08T19:25:48.538316+0000","last_became_active":"2021-10-08T19:23:44.799526+0000","last_became_peered":"2021-10-08T19:23:44.799526+0000","last_unstale":"2021-10-08T19:25:48.538316+0000","last_undegraded":"2021-10-08T19:25:48.538316+0000","last_fullsized":"2021-10-08T19:25:48.538316+0000","mapping_epoch":94,"log_start":"110'2712","ondisk_log_start":"110'2712","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":4257,"ondisk_log_size":4257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":306380800,"num_objects":4675,"num_object_clones":0,"num_object_copies":14025,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4675,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6969,"num_write_kb":372608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4],"acting":[3,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":57,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.514231+0000","last_change":"2021-10-08T19:25:14.588222+0000","last_active":"2021-10-08T19:25:45.514231+0000","last_peered":"2021-10-08T19:25:45.514231+0000","last_clean":"2021-10-08T19:25:45.514231+0000","last_became_active":"2021-10-08T19:25:14.587901+0000","last_became_peered":"2021-10-08T19:25:14.587901+0000","last_unstale":"2021-10-08T19:25:45.514231+0000","last_undegraded":"2021-10-08T19:25:45.514231+0000","last_fullsized":"2021-10-08T19:25:45.514231+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:09.177525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:09.177525+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":41,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.502427+0000","last_change":"2021-10-08T19:24:25.095749+0000","last_active":"2021-10-08T19:25:45.502427+0000","last_peered":"2021-10-08T19:25:45.502427+0000","last_clean":"2021-10-08T19:25:45.502427+0000","last_became_active":"2021-10-08T19:24:25.095389+0000","last_became_peered":"2021-10-08T19:24:25.095389+0000","last_unstale":"2021-10-08T19:25:45.502427+0000","last_undegraded":"2021-10-08T19:25:45.502427+0000","last_fullsized":"2021-10-08T19:25:45.502427+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:42.399412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:42.399412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"69'19","reported_seq":138,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.510087+0000","last_change":"2021-10-08T19:24:08.149331+0000","last_active":"2021-10-08T19:25:45.510087+0000","last_peered":"2021-10-08T19:25:45.510087+0000","last_clean":"2021-10-08T19:25:45.510087+0000","last_became_active":"2021-10-08T19:21:25.741812+0000","last_became_peered":"2021-10-08T19:21:25.741812+0000","last_unstale":"2021-10-08T19:25:45.510087+0000","last_undegraded":"2021-10-08T19:25:45.510087+0000","last_fullsized":"2021-10-08T19:25:45.510087+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'19","last_scrub_stamp":"2021-10-08T19:24:08.149225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:24:08.149225+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0082661220000000007,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"61'1","reported_seq":111,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.528879+0000","last_change":"2021-10-08T19:24:17.582143+0000","last_active":"2021-10-08T19:25:45.528879+0000","last_peered":"2021-10-08T19:25:45.528879+0000","last_clean":"2021-10-08T19:25:45.528879+0000","last_became_active":"2021-10-08T19:21:23.604258+0000","last_became_peered":"2021-10-08T19:21:23.604258+0000","last_unstale":"2021-10-08T19:25:45.528879+0000","last_undegraded":"2021-10-08T19:25:45.528879+0000","last_fullsized":"2021-10-08T19:25:45.528879+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'1","last_scrub_stamp":"2021-10-08T19:24:17.582063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:17.582063+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0043026640000000003,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":110,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.515368+0000","last_change":"2021-10-08T19:24:25.094704+0000","last_active":"2021-10-08T19:25:45.515368+0000","last_peered":"2021-10-08T19:25:45.515368+0000","last_clean":"2021-10-08T19:25:45.515368+0000","last_became_active":"2021-10-08T19:24:25.092510+0000","last_became_peered":"2021-10-08T19:24:25.092510+0000","last_unstale":"2021-10-08T19:25:45.515368+0000","last_undegraded":"2021-10-08T19:25:45.515368+0000","last_fullsized":"2021-10-08T19:25:45.515368+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:06.155068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:06.155068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001436805,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"144'6770","reported_seq":6827,"reported_epoch":144,"state":"active+clean","last_fresh":"2021-10-08T19:25:48.435593+0000","last_change":"2021-10-08T19:23:44.808792+0000","last_active":"2021-10-08T19:25:48.435593+0000","last_peered":"2021-10-08T19:25:48.435593+0000","last_clean":"2021-10-08T19:25:48.435593+0000","last_became_active":"2021-10-08T19:23:44.808533+0000","last_became_peered":"2021-10-08T19:23:44.808533+0000","last_unstale":"2021-10-08T19:25:48.435593+0000","last_undegraded":"2021-10-08T19:25:48.435593+0000","last_fullsized":"2021-10-08T19:25:48.435593+0000","mapping_epoch":94,"log_start":"102'1632","ondisk_log_start":"102'1632","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":5138,"ondisk_log_size":5138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":295436288,"num_objects":4508,"num_object_clones":0,"num_object_copies":13524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4508,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6770,"num_write_kb":360896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.4","version":"70'5","reported_seq":292,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.515862+0000","last_change":"2021-10-08T19:25:14.596508+0000","last_active":"2021-10-08T19:25:45.515862+0000","last_peered":"2021-10-08T19:25:45.515862+0000","last_clean":"2021-10-08T19:25:45.515862+0000","last_became_active":"2021-10-08T19:25:14.596177+0000","last_became_peered":"2021-10-08T19:25:14.596177+0000","last_unstale":"2021-10-08T19:25:45.515862+0000","last_undegraded":"2021-10-08T19:25:45.515862+0000","last_fullsized":"2021-10-08T19:25:45.515862+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:22:48.239721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:48.239721+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001618092,"stat_sum":{"num_bytes":49,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":19,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":49,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":99,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.508967+0000","last_change":"2021-10-08T19:23:41.487724+0000","last_active":"2021-10-08T19:25:45.508967+0000","last_peered":"2021-10-08T19:25:45.508967+0000","last_clean":"2021-10-08T19:25:45.508967+0000","last_became_active":"2021-10-08T19:21:27.635800+0000","last_became_peered":"2021-10-08T19:21:27.635800+0000","last_unstale":"2021-10-08T19:25:45.508967+0000","last_undegraded":"2021-10-08T19:25:45.508967+0000","last_fullsized":"2021-10-08T19:25:45.508967+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:41.487627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:41.487627+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003650445,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"69'12","reported_seq":114,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.513309+0000","last_change":"2021-10-08T19:22:55.639993+0000","last_active":"2021-10-08T19:25:45.513309+0000","last_peered":"2021-10-08T19:25:45.513309+0000","last_clean":"2021-10-08T19:25:45.513309+0000","last_became_active":"2021-10-08T19:21:25.610233+0000","last_became_peered":"2021-10-08T19:21:25.610233+0000","last_unstale":"2021-10-08T19:25:45.513309+0000","last_undegraded":"2021-10-08T19:25:45.513309+0000","last_fullsized":"2021-10-08T19:25:45.513309+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'12","last_scrub_stamp":"2021-10-08T19:22:55.639881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:55.639881+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0032422169999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":65,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.499251+0000","last_change":"2021-10-08T19:24:04.888931+0000","last_active":"2021-10-08T19:25:45.499251+0000","last_peered":"2021-10-08T19:25:45.499251+0000","last_clean":"2021-10-08T19:25:45.499251+0000","last_became_active":"2021-10-08T19:23:44.813130+0000","last_became_peered":"2021-10-08T19:23:44.813130+0000","last_unstale":"2021-10-08T19:25:45.499251+0000","last_undegraded":"2021-10-08T19:25:45.499251+0000","last_fullsized":"2021-10-08T19:25:45.499251+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:04.888825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:32.922694+0000","last_clean_scrub_stamp":"2021-10-08T19:24:04.888825+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0052928530000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":122,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.508908+0000","last_change":"2021-10-08T19:25:14.571042+0000","last_active":"2021-10-08T19:25:45.508908+0000","last_peered":"2021-10-08T19:25:45.508908+0000","last_clean":"2021-10-08T19:25:45.508908+0000","last_became_active":"2021-10-08T19:25:14.570716+0000","last_became_peered":"2021-10-08T19:25:14.570716+0000","last_unstale":"2021-10-08T19:25:45.508908+0000","last_undegraded":"2021-10-08T19:25:45.508908+0000","last_fullsized":"2021-10-08T19:25:45.508908+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:09.177525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:09.177525+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0090469920000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":92,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.516225+0000","last_change":"2021-10-08T19:22:55.234981+0000","last_active":"2021-10-08T19:25:45.516225+0000","last_peered":"2021-10-08T19:25:45.516225+0000","last_clean":"2021-10-08T19:25:45.516225+0000","last_became_active":"2021-10-08T19:21:29.648784+0000","last_became_peered":"2021-10-08T19:21:29.648784+0000","last_unstale":"2021-10-08T19:25:45.516225+0000","last_undegraded":"2021-10-08T19:25:45.516225+0000","last_fullsized":"2021-10-08T19:25:45.516225+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:55.234909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:55.234909+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0014461070000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"144'7009","reported_seq":7067,"reported_epoch":144,"state":"active+clean","last_fresh":"2021-10-08T19:25:48.419467+0000","last_change":"2021-10-08T19:23:44.811375+0000","last_active":"2021-10-08T19:25:48.419467+0000","last_peered":"2021-10-08T19:25:48.419467+0000","last_clean":"2021-10-08T19:25:48.419467+0000","last_became_active":"2021-10-08T19:23:44.811097+0000","last_became_peered":"2021-10-08T19:23:44.811097+0000","last_unstale":"2021-10-08T19:25:48.419467+0000","last_undegraded":"2021-10-08T19:25:48.419467+0000","last_fullsized":"2021-10-08T19:25:48.419467+0000","mapping_epoch":94,"log_start":"110'2808","ondisk_log_start":"110'2808","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":4201,"ondisk_log_size":4201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":305070080,"num_objects":4655,"num_object_clones":0,"num_object_copies":13965,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4655,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7009,"num_write_kb":373248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,0],"acting":[7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":94,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.529598+0000","last_change":"2021-10-08T19:23:02.267580+0000","last_active":"2021-10-08T19:25:45.529598+0000","last_peered":"2021-10-08T19:25:45.529598+0000","last_clean":"2021-10-08T19:25:45.529598+0000","last_became_active":"2021-10-08T19:21:27.636086+0000","last_became_peered":"2021-10-08T19:21:27.636086+0000","last_unstale":"2021-10-08T19:25:45.529598+0000","last_undegraded":"2021-10-08T19:25:45.529598+0000","last_fullsized":"2021-10-08T19:25:45.529598+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:02.267508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:02.267508+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034499700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"69'14","reported_seq":57,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.502378+0000","last_change":"2021-10-08T19:24:25.119727+0000","last_active":"2021-10-08T19:25:45.502378+0000","last_peered":"2021-10-08T19:25:45.502378+0000","last_clean":"2021-10-08T19:25:45.502378+0000","last_became_active":"2021-10-08T19:24:25.100384+0000","last_became_peered":"2021-10-08T19:24:25.100384+0000","last_unstale":"2021-10-08T19:25:45.502378+0000","last_undegraded":"2021-10-08T19:25:45.502378+0000","last_fullsized":"2021-10-08T19:25:45.502378+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'14","last_scrub_stamp":"2021-10-08T19:22:54.379349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:54.379349+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":24,"num_read_kb":14,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"90'130","reported_seq":401,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.527637+0000","last_change":"2021-10-08T19:24:28.151931+0000","last_active":"2021-10-08T19:25:45.527637+0000","last_peered":"2021-10-08T19:25:45.527637+0000","last_clean":"2021-10-08T19:25:45.527637+0000","last_became_active":"2021-10-08T19:24:28.151587+0000","last_became_peered":"2021-10-08T19:24:28.151587+0000","last_unstale":"2021-10-08T19:25:45.527637+0000","last_undegraded":"2021-10-08T19:25:45.527637+0000","last_fullsized":"2021-10-08T19:25:45.527637+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.284249+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0045617870000000003,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":97,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.508629+0000","last_change":"2021-10-08T19:23:22.620672+0000","last_active":"2021-10-08T19:25:45.508629+0000","last_peered":"2021-10-08T19:25:45.508629+0000","last_clean":"2021-10-08T19:25:45.508629+0000","last_became_active":"2021-10-08T19:21:23.599143+0000","last_became_peered":"2021-10-08T19:21:23.599143+0000","last_unstale":"2021-10-08T19:25:45.508629+0000","last_undegraded":"2021-10-08T19:25:45.508629+0000","last_fullsized":"2021-10-08T19:25:45.508629+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:22.620600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:22.620600+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003478133,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":133,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.511139+0000","last_change":"2021-10-08T19:25:14.565749+0000","last_active":"2021-10-08T19:25:45.511139+0000","last_peered":"2021-10-08T19:25:45.511139+0000","last_clean":"2021-10-08T19:25:45.511139+0000","last_became_active":"2021-10-08T19:25:14.565479+0000","last_became_peered":"2021-10-08T19:25:14.565479+0000","last_unstale":"2021-10-08T19:25:45.511139+0000","last_undegraded":"2021-10-08T19:25:45.511139+0000","last_fullsized":"2021-10-08T19:25:45.511139+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:40.563247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.563247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.024890005999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":91,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.509035+0000","last_change":"2021-10-08T19:23:14.763360+0000","last_active":"2021-10-08T19:25:45.509035+0000","last_peered":"2021-10-08T19:25:45.509035+0000","last_clean":"2021-10-08T19:25:45.509035+0000","last_became_active":"2021-10-08T19:21:29.646242+0000","last_became_peered":"2021-10-08T19:21:29.646242+0000","last_unstale":"2021-10-08T19:25:45.509035+0000","last_undegraded":"2021-10-08T19:25:45.509035+0000","last_fullsized":"2021-10-08T19:25:45.509035+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:14.763280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:14.763280+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034824790000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"144'6869","reported_seq":6927,"reported_epoch":144,"state":"active+clean","last_fresh":"2021-10-08T19:25:48.519702+0000","last_change":"2021-10-08T19:23:44.811881+0000","last_active":"2021-10-08T19:25:48.519702+0000","last_peered":"2021-10-08T19:25:48.519702+0000","last_clean":"2021-10-08T19:25:48.519702+0000","last_became_active":"2021-10-08T19:23:44.810317+0000","last_became_peered":"2021-10-08T19:23:44.810317+0000","last_unstale":"2021-10-08T19:25:48.519702+0000","last_undegraded":"2021-10-08T19:25:48.519702+0000","last_fullsized":"2021-10-08T19:25:48.519702+0000","mapping_epoch":94,"log_start":"104'2012","ondisk_log_start":"104'2012","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":4857,"ondisk_log_size":4857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":297992192,"num_objects":4547,"num_object_clones":0,"num_object_copies":13641,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4547,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6869,"num_write_kb":365312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":94,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.500436+0000","last_change":"2021-10-08T19:23:06.487842+0000","last_active":"2021-10-08T19:25:45.500436+0000","last_peered":"2021-10-08T19:25:45.500436+0000","last_clean":"2021-10-08T19:25:45.500436+0000","last_became_active":"2021-10-08T19:21:27.637875+0000","last_became_peered":"2021-10-08T19:21:27.637875+0000","last_unstale":"2021-10-08T19:25:45.500436+0000","last_undegraded":"2021-10-08T19:25:45.500436+0000","last_fullsized":"2021-10-08T19:25:45.500436+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:06.487723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:06.487723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034218619999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"69'13","reported_seq":129,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.515606+0000","last_change":"2021-10-08T19:24:08.192556+0000","last_active":"2021-10-08T19:25:45.515606+0000","last_peered":"2021-10-08T19:25:45.515606+0000","last_clean":"2021-10-08T19:25:45.515606+0000","last_became_active":"2021-10-08T19:21:25.608584+0000","last_became_peered":"2021-10-08T19:21:25.608584+0000","last_unstale":"2021-10-08T19:25:45.515606+0000","last_undegraded":"2021-10-08T19:25:45.515606+0000","last_fullsized":"2021-10-08T19:25:45.515606+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'13","last_scrub_stamp":"2021-10-08T19:24:08.192428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:24:08.192428+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.015716936000000001,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":104,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.499443+0000","last_change":"2021-10-08T19:24:21.997890+0000","last_active":"2021-10-08T19:25:45.499443+0000","last_peered":"2021-10-08T19:25:45.499443+0000","last_clean":"2021-10-08T19:25:45.499443+0000","last_became_active":"2021-10-08T19:21:23.602967+0000","last_became_peered":"2021-10-08T19:21:23.602967+0000","last_unstale":"2021-10-08T19:25:45.499443+0000","last_undegraded":"2021-10-08T19:25:45.499443+0000","last_fullsized":"2021-10-08T19:25:45.499443+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:21.997791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:21.997791+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0069284359999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"70'5","reported_seq":302,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.515279+0000","last_change":"2021-10-08T19:25:14.573914+0000","last_active":"2021-10-08T19:25:45.515279+0000","last_peered":"2021-10-08T19:25:45.515279+0000","last_clean":"2021-10-08T19:25:45.515279+0000","last_became_active":"2021-10-08T19:25:14.573525+0000","last_became_peered":"2021-10-08T19:25:14.573525+0000","last_unstale":"2021-10-08T19:25:45.515279+0000","last_undegraded":"2021-10-08T19:25:45.515279+0000","last_fullsized":"2021-10-08T19:25:45.515279+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:22:48.239721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:48.239721+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001618092,"stat_sum":{"num_bytes":48,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":48,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":110,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.528828+0000","last_change":"2021-10-08T19:24:25.096670+0000","last_active":"2021-10-08T19:25:45.528828+0000","last_peered":"2021-10-08T19:25:45.528828+0000","last_clean":"2021-10-08T19:25:45.528828+0000","last_became_active":"2021-10-08T19:24:25.095748+0000","last_became_peered":"2021-10-08T19:24:25.095748+0000","last_unstale":"2021-10-08T19:25:45.528828+0000","last_undegraded":"2021-10-08T19:25:45.528828+0000","last_fullsized":"2021-10-08T19:25:45.528828+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:01.215579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:01.215579+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001463748,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"144'6867","reported_seq":6925,"reported_epoch":144,"state":"active+clean","last_fresh":"2021-10-08T19:25:48.482533+0000","last_change":"2021-10-08T19:23:44.815167+0000","last_active":"2021-10-08T19:25:48.482533+0000","last_peered":"2021-10-08T19:25:48.482533+0000","last_clean":"2021-10-08T19:25:48.482533+0000","last_became_active":"2021-10-08T19:23:44.814856+0000","last_became_peered":"2021-10-08T19:23:44.814856+0000","last_unstale":"2021-10-08T19:25:48.482533+0000","last_undegraded":"2021-10-08T19:25:48.482533+0000","last_fullsized":"2021-10-08T19:25:48.482533+0000","mapping_epoch":94,"log_start":"104'2016","ondisk_log_start":"104'2016","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":4851,"ondisk_log_size":4851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":297730048,"num_objects":4543,"num_object_clones":0,"num_object_copies":13629,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4543,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6867,"num_write_kb":365120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":94,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.510958+0000","last_change":"2021-10-08T19:23:03.639015+0000","last_active":"2021-10-08T19:25:45.510958+0000","last_peered":"2021-10-08T19:25:45.510958+0000","last_clean":"2021-10-08T19:25:45.510958+0000","last_became_active":"2021-10-08T19:21:27.636192+0000","last_became_peered":"2021-10-08T19:21:27.636192+0000","last_unstale":"2021-10-08T19:25:45.510958+0000","last_undegraded":"2021-10-08T19:25:45.510958+0000","last_fullsized":"2021-10-08T19:25:45.510958+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:03.638920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:03.638920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0016933230000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"69'28","reported_seq":203,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:46.765251+0000","last_change":"2021-10-08T19:24:18.179832+0000","last_active":"2021-10-08T19:25:46.765251+0000","last_peered":"2021-10-08T19:25:46.765251+0000","last_clean":"2021-10-08T19:25:46.765251+0000","last_became_active":"2021-10-08T19:21:25.613663+0000","last_became_peered":"2021-10-08T19:21:25.613663+0000","last_unstale":"2021-10-08T19:25:46.765251+0000","last_undegraded":"2021-10-08T19:25:46.765251+0000","last_fullsized":"2021-10-08T19:25:46.765251+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'28","last_scrub_stamp":"2021-10-08T19:24:18.179708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:24:18.179708+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0076258280000000003,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":115,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.508297+0000","last_change":"2021-10-08T19:24:25.089874+0000","last_active":"2021-10-08T19:25:45.508297+0000","last_peered":"2021-10-08T19:25:45.508297+0000","last_clean":"2021-10-08T19:25:45.508297+0000","last_became_active":"2021-10-08T19:24:25.089422+0000","last_became_peered":"2021-10-08T19:24:25.089422+0000","last_unstale":"2021-10-08T19:25:45.508297+0000","last_undegraded":"2021-10-08T19:25:45.508297+0000","last_fullsized":"2021-10-08T19:25:45.508297+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:01.746914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:01.746914+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001402506,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":91,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.511919+0000","last_change":"2021-10-08T19:23:25.378511+0000","last_active":"2021-10-08T19:25:45.511919+0000","last_peered":"2021-10-08T19:25:45.511919+0000","last_clean":"2021-10-08T19:25:45.511919+0000","last_became_active":"2021-10-08T19:21:29.647403+0000","last_became_peered":"2021-10-08T19:21:29.647403+0000","last_unstale":"2021-10-08T19:25:45.511919+0000","last_undegraded":"2021-10-08T19:25:45.511919+0000","last_fullsized":"2021-10-08T19:25:45.511919+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:25.378429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:25.378429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0050198400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"144'6809","reported_seq":6872,"reported_epoch":144,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-10-08T19:25:48.602249+0000","last_change":"2021-10-08T19:24:26.876521+0000","last_active":"2021-10-08T19:25:48.602249+0000","last_peered":"2021-10-08T19:25:48.602249+0000","last_clean":"2021-10-08T19:24:23.994230+0000","last_became_active":"2021-10-08T19:24:26.869772+0000","last_became_peered":"2021-10-08T19:24:26.869772+0000","last_unstale":"2021-10-08T19:25:48.602249+0000","last_undegraded":"2021-10-08T19:24:26.123494+0000","last_fullsized":"2021-10-08T19:24:26.101870+0000","mapping_epoch":113,"log_start":"104'1945","ondisk_log_start":"104'1945","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":4864,"ondisk_log_size":4864,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":296681472,"num_objects":4527,"num_object_clones":0,"num_object_copies":13581,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3052,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4527,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6809,"num_write_kb":362752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[0,3],"avail_no_missing":["0","1","3"],"object_location_counts":[{"shards":"0,1,3","objects":1911},{"shards":"0,3","objects":1475}],"blocked_by":[],"up_primary":6,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":66,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.498294+0000","last_change":"2021-10-08T19:25:14.550996+0000","last_active":"2021-10-08T19:25:45.498294+0000","last_peered":"2021-10-08T19:25:45.498294+0000","last_clean":"2021-10-08T19:25:45.498294+0000","last_became_active":"2021-10-08T19:25:14.550690+0000","last_became_peered":"2021-10-08T19:25:14.550690+0000","last_unstale":"2021-10-08T19:25:45.498294+0000","last_undegraded":"2021-10-08T19:25:45.498294+0000","last_fullsized":"2021-10-08T19:25:45.498294+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:09.177525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:09.177525+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3","version":"114'10","reported_seq":188,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:46.765772+0000","last_change":"2021-10-08T19:24:25.551891+0000","last_active":"2021-10-08T19:25:46.765772+0000","last_peered":"2021-10-08T19:25:46.765772+0000","last_clean":"2021-10-08T19:25:46.765772+0000","last_became_active":"2021-10-08T19:24:25.106695+0000","last_became_peered":"2021-10-08T19:24:25.106695+0000","last_unstale":"2021-10-08T19:25:46.765772+0000","last_undegraded":"2021-10-08T19:25:46.765772+0000","last_fullsized":"2021-10-08T19:25:46.765772+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'9","last_scrub_stamp":"2021-10-08T19:24:04.193898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:04.193898+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0022019909999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"69'10","reported_seq":117,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.514504+0000","last_change":"2021-10-08T19:24:17.162629+0000","last_active":"2021-10-08T19:25:45.514504+0000","last_peered":"2021-10-08T19:25:45.514504+0000","last_clean":"2021-10-08T19:25:45.514504+0000","last_became_active":"2021-10-08T19:21:25.608581+0000","last_became_peered":"2021-10-08T19:21:25.608581+0000","last_unstale":"2021-10-08T19:25:45.514504+0000","last_undegraded":"2021-10-08T19:25:45.514504+0000","last_fullsized":"2021-10-08T19:25:45.514504+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'10","last_scrub_stamp":"2021-10-08T19:24:17.162525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:24:17.162525+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0071187819999999997,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":104,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.515994+0000","last_change":"2021-10-08T19:24:11.227195+0000","last_active":"2021-10-08T19:25:45.515994+0000","last_peered":"2021-10-08T19:25:45.515994+0000","last_clean":"2021-10-08T19:25:45.515994+0000","last_became_active":"2021-10-08T19:21:23.605441+0000","last_became_peered":"2021-10-08T19:21:23.605441+0000","last_unstale":"2021-10-08T19:25:45.515994+0000","last_undegraded":"2021-10-08T19:25:45.515994+0000","last_fullsized":"2021-10-08T19:25:45.515994+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:11.227079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:11.227079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014709302,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":92,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.508914+0000","last_change":"2021-10-08T19:22:46.569728+0000","last_active":"2021-10-08T19:25:45.508914+0000","last_peered":"2021-10-08T19:25:45.508914+0000","last_clean":"2021-10-08T19:25:45.508914+0000","last_became_active":"2021-10-08T19:21:29.649735+0000","last_became_peered":"2021-10-08T19:21:29.649735+0000","last_unstale":"2021-10-08T19:25:45.508914+0000","last_undegraded":"2021-10-08T19:25:45.508914+0000","last_fullsized":"2021-10-08T19:25:45.508914+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:46.569603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:46.569603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001693387,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"144'6849","reported_seq":8810,"reported_epoch":144,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2021-10-08T19:25:48.436054+0000","last_change":"2021-10-08T19:25:42.099559+0000","last_active":"2021-10-08T19:25:48.436054+0000","last_peered":"2021-10-08T19:25:48.436054+0000","last_clean":"2021-10-08T19:24:23.998781+0000","last_became_active":"2021-10-08T19:24:26.845215+0000","last_became_peered":"2021-10-08T19:24:26.845215+0000","last_unstale":"2021-10-08T19:25:48.436054+0000","last_undegraded":"2021-10-08T19:25:42.086581+0000","last_fullsized":"2021-10-08T19:24:26.076656+0000","mapping_epoch":113,"log_start":"108'2411","ondisk_log_start":"108'2411","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":4438,"ondisk_log_size":4438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":298516480,"num_objects":4555,"num_object_clones":0,"num_object_copies":13665,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":197,"num_objects_misplaced":1897,"num_objects_unfound":0,"num_objects_dirty":4555,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6849,"num_write_kb":364928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":950,"num_bytes_recovered":62259200,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3],"avail_no_missing":["4","1","3"],"object_location_counts":[{"shards":"1,3,4","objects":1897},{"shards":"3,4","objects":2461}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":61,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.508101+0000","last_change":"2021-10-08T19:25:14.562179+0000","last_active":"2021-10-08T19:25:45.508101+0000","last_peered":"2021-10-08T19:25:45.508101+0000","last_clean":"2021-10-08T19:25:45.508101+0000","last_became_active":"2021-10-08T19:25:14.561850+0000","last_became_peered":"2021-10-08T19:25:14.561850+0000","last_unstale":"2021-10-08T19:25:45.508101+0000","last_undegraded":"2021-10-08T19:25:45.508101+0000","last_fullsized":"2021-10-08T19:25:45.508101+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:17.379559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:17.379559+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0052805589999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":94,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.499721+0000","last_change":"2021-10-08T19:22:50.435623+0000","last_active":"2021-10-08T19:25:45.499721+0000","last_peered":"2021-10-08T19:25:45.499721+0000","last_clean":"2021-10-08T19:25:45.499721+0000","last_became_active":"2021-10-08T19:21:27.633878+0000","last_became_peered":"2021-10-08T19:21:27.633878+0000","last_unstale":"2021-10-08T19:25:45.499721+0000","last_undegraded":"2021-10-08T19:25:45.499721+0000","last_fullsized":"2021-10-08T19:25:45.499721+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:50.435552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:50.435552+0000","last_clean_scrub_stamp":"2021-10-08T19:22:50.435552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0012976140000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"69'12","reported_seq":118,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.498986+0000","last_change":"2021-10-08T19:22:57.003718+0000","last_active":"2021-10-08T19:25:45.498986+0000","last_peered":"2021-10-08T19:25:45.498986+0000","last_clean":"2021-10-08T19:25:45.498986+0000","last_became_active":"2021-10-08T19:21:25.609079+0000","last_became_peered":"2021-10-08T19:21:25.609079+0000","last_unstale":"2021-10-08T19:25:45.498986+0000","last_undegraded":"2021-10-08T19:25:45.498986+0000","last_fullsized":"2021-10-08T19:25:45.498986+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'12","last_scrub_stamp":"2021-10-08T19:22:57.003641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:57.003641+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0041017010000000001,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"61'2","reported_seq":113,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.499702+0000","last_change":"2021-10-08T19:23:07.991466+0000","last_active":"2021-10-08T19:25:45.499702+0000","last_peered":"2021-10-08T19:25:45.499702+0000","last_clean":"2021-10-08T19:25:45.499702+0000","last_became_active":"2021-10-08T19:21:23.603614+0000","last_became_peered":"2021-10-08T19:21:23.603614+0000","last_unstale":"2021-10-08T19:25:45.499702+0000","last_undegraded":"2021-10-08T19:25:45.499702+0000","last_fullsized":"2021-10-08T19:25:45.499702+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'2","last_scrub_stamp":"2021-10-08T19:23:07.991388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:07.991388+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001614983,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":91,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.507733+0000","last_change":"2021-10-08T19:24:12.484917+0000","last_active":"2021-10-08T19:25:45.507733+0000","last_peered":"2021-10-08T19:25:45.507733+0000","last_clean":"2021-10-08T19:25:45.507733+0000","last_became_active":"2021-10-08T19:21:29.647140+0000","last_became_peered":"2021-10-08T19:21:29.647140+0000","last_unstale":"2021-10-08T19:25:45.507733+0000","last_undegraded":"2021-10-08T19:25:45.507733+0000","last_fullsized":"2021-10-08T19:25:45.507733+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:12.484818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:24:12.484818+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0047233090000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"144'6920","reported_seq":6977,"reported_epoch":144,"state":"active+clean","last_fresh":"2021-10-08T19:25:48.538626+0000","last_change":"2021-10-08T19:23:44.808183+0000","last_active":"2021-10-08T19:25:48.538626+0000","last_peered":"2021-10-08T19:25:48.538626+0000","last_clean":"2021-10-08T19:25:48.538626+0000","last_became_active":"2021-10-08T19:23:44.807891+0000","last_became_peered":"2021-10-08T19:23:44.807891+0000","last_unstale":"2021-10-08T19:25:48.538626+0000","last_undegraded":"2021-10-08T19:25:48.538626+0000","last_fullsized":"2021-10-08T19:25:48.538626+0000","mapping_epoch":94,"log_start":"110'2646","ondisk_log_start":"110'2646","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":4274,"ondisk_log_size":4274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":301858816,"num_objects":4606,"num_object_clones":0,"num_object_copies":13818,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4606,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6920,"num_write_kb":368832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.528608+0000","last_change":"2021-10-08T19:25:15.504116+0000","last_active":"2021-10-08T19:25:45.528608+0000","last_peered":"2021-10-08T19:25:45.528608+0000","last_clean":"2021-10-08T19:25:45.528608+0000","last_became_active":"2021-10-08T19:25:15.503799+0000","last_became_peered":"2021-10-08T19:25:15.503799+0000","last_unstale":"2021-10-08T19:25:45.528608+0000","last_undegraded":"2021-10-08T19:25:45.528608+0000","last_fullsized":"2021-10-08T19:25:45.528608+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:40.563247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.563247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.024890005999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"69'9","reported_seq":112,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.513478+0000","last_change":"2021-10-08T19:23:00.644527+0000","last_active":"2021-10-08T19:25:45.513478+0000","last_peered":"2021-10-08T19:25:45.513478+0000","last_clean":"2021-10-08T19:25:45.513478+0000","last_became_active":"2021-10-08T19:21:25.743804+0000","last_became_peered":"2021-10-08T19:21:25.743804+0000","last_unstale":"2021-10-08T19:25:45.513478+0000","last_undegraded":"2021-10-08T19:25:45.513478+0000","last_fullsized":"2021-10-08T19:25:45.513478+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'9","last_scrub_stamp":"2021-10-08T19:23:00.644449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:00.644449+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0023246959999999998,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":104,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.499646+0000","last_change":"2021-10-08T19:23:36.618221+0000","last_active":"2021-10-08T19:25:45.499646+0000","last_peered":"2021-10-08T19:25:45.499646+0000","last_clean":"2021-10-08T19:25:45.499646+0000","last_became_active":"2021-10-08T19:21:23.598125+0000","last_became_peered":"2021-10-08T19:21:23.598125+0000","last_unstale":"2021-10-08T19:25:45.499646+0000","last_undegraded":"2021-10-08T19:25:45.499646+0000","last_fullsized":"2021-10-08T19:25:45.499646+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:36.618136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:36.618136+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0014720390000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":93,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.514669+0000","last_change":"2021-10-08T19:22:36.466178+0000","last_active":"2021-10-08T19:25:45.514669+0000","last_peered":"2021-10-08T19:25:45.514669+0000","last_clean":"2021-10-08T19:25:45.514669+0000","last_became_active":"2021-10-08T19:21:27.638112+0000","last_became_peered":"2021-10-08T19:21:27.638112+0000","last_unstale":"2021-10-08T19:25:45.514669+0000","last_undegraded":"2021-10-08T19:25:45.514669+0000","last_fullsized":"2021-10-08T19:25:45.514669+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:36.466077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:36.466077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0018534809999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":98,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.501322+0000","last_change":"2021-10-08T19:24:05.869865+0000","last_active":"2021-10-08T19:25:45.501322+0000","last_peered":"2021-10-08T19:25:45.501322+0000","last_clean":"2021-10-08T19:25:45.501322+0000","last_became_active":"2021-10-08T19:21:29.640674+0000","last_became_peered":"2021-10-08T19:21:29.640674+0000","last_unstale":"2021-10-08T19:25:45.501322+0000","last_undegraded":"2021-10-08T19:25:45.501322+0000","last_fullsized":"2021-10-08T19:25:45.501322+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:05.869774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:24:05.869774+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0041453820000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.527637+0000","last_change":"2021-10-08T19:25:15.501489+0000","last_active":"2021-10-08T19:25:45.527637+0000","last_peered":"2021-10-08T19:25:45.527637+0000","last_clean":"2021-10-08T19:25:45.527637+0000","last_became_active":"2021-10-08T19:25:15.501118+0000","last_became_peered":"2021-10-08T19:25:15.501118+0000","last_unstale":"2021-10-08T19:25:45.527637+0000","last_undegraded":"2021-10-08T19:25:45.527637+0000","last_fullsized":"2021-10-08T19:25:45.527637+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:09.177525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:09.177525+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0090469920000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"69'6","reported_seq":104,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.514593+0000","last_change":"2021-10-08T19:23:21.395469+0000","last_active":"2021-10-08T19:25:45.514593+0000","last_peered":"2021-10-08T19:25:45.514593+0000","last_clean":"2021-10-08T19:25:45.514593+0000","last_became_active":"2021-10-08T19:21:25.742631+0000","last_became_peered":"2021-10-08T19:21:25.742631+0000","last_unstale":"2021-10-08T19:25:45.514593+0000","last_undegraded":"2021-10-08T19:25:45.514593+0000","last_fullsized":"2021-10-08T19:25:45.514593+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'6","last_scrub_stamp":"2021-10-08T19:23:21.395390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:21.395390+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002416241,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":41,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.502162+0000","last_change":"2021-10-08T19:24:25.105291+0000","last_active":"2021-10-08T19:25:45.502162+0000","last_peered":"2021-10-08T19:25:45.502162+0000","last_clean":"2021-10-08T19:25:45.502162+0000","last_became_active":"2021-10-08T19:24:25.104551+0000","last_became_peered":"2021-10-08T19:24:25.104551+0000","last_unstale":"2021-10-08T19:25:45.502162+0000","last_undegraded":"2021-10-08T19:25:45.502162+0000","last_fullsized":"2021-10-08T19:25:45.502162+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:40.579610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:40.579610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":99,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.508567+0000","last_change":"2021-10-08T19:24:22.361236+0000","last_active":"2021-10-08T19:25:45.508567+0000","last_peered":"2021-10-08T19:25:45.508567+0000","last_clean":"2021-10-08T19:25:45.508567+0000","last_became_active":"2021-10-08T19:21:27.634443+0000","last_became_peered":"2021-10-08T19:21:27.634443+0000","last_unstale":"2021-10-08T19:25:45.508567+0000","last_undegraded":"2021-10-08T19:25:45.508567+0000","last_fullsized":"2021-10-08T19:25:45.508567+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:22.361166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:22.361166+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011785238,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":116,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.528680+0000","last_change":"2021-10-08T19:24:25.099693+0000","last_active":"2021-10-08T19:25:45.528680+0000","last_peered":"2021-10-08T19:25:45.528680+0000","last_clean":"2021-10-08T19:25:45.528680+0000","last_became_active":"2021-10-08T19:24:25.099371+0000","last_became_peered":"2021-10-08T19:24:25.099371+0000","last_unstale":"2021-10-08T19:25:45.528680+0000","last_undegraded":"2021-10-08T19:25:45.528680+0000","last_fullsized":"2021-10-08T19:25:45.528680+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:40.417858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:40.417858+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0014005230000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"70'5","reported_seq":276,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.501766+0000","last_change":"2021-10-08T19:25:15.495111+0000","last_active":"2021-10-08T19:25:45.501766+0000","last_peered":"2021-10-08T19:25:45.501766+0000","last_clean":"2021-10-08T19:25:45.501766+0000","last_became_active":"2021-10-08T19:25:15.494766+0000","last_became_peered":"2021-10-08T19:25:15.494766+0000","last_unstale":"2021-10-08T19:25:45.501766+0000","last_undegraded":"2021-10-08T19:25:45.501766+0000","last_fullsized":"2021-10-08T19:25:45.501766+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:22:48.239721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:48.239721+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001618092,"stat_sum":{"num_bytes":49,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":19,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":49,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"69'10","reported_seq":71,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.501166+0000","last_change":"2021-10-08T19:23:45.670593+0000","last_active":"2021-10-08T19:25:45.501166+0000","last_peered":"2021-10-08T19:25:45.501166+0000","last_clean":"2021-10-08T19:25:45.501166+0000","last_became_active":"2021-10-08T19:23:44.806124+0000","last_became_peered":"2021-10-08T19:23:44.806124+0000","last_unstale":"2021-10-08T19:25:45.501166+0000","last_undegraded":"2021-10-08T19:25:45.501166+0000","last_fullsized":"2021-10-08T19:25:45.501166+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'10","last_scrub_stamp":"2021-10-08T19:22:52.611060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:52.611060+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,7],"acting":[2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":103,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.508255+0000","last_change":"2021-10-08T19:24:23.338025+0000","last_active":"2021-10-08T19:25:45.508255+0000","last_peered":"2021-10-08T19:25:45.508255+0000","last_clean":"2021-10-08T19:25:45.508255+0000","last_became_active":"2021-10-08T19:21:23.603637+0000","last_became_peered":"2021-10-08T19:21:23.603637+0000","last_unstale":"2021-10-08T19:25:45.508255+0000","last_undegraded":"2021-10-08T19:25:45.508255+0000","last_fullsized":"2021-10-08T19:25:45.508255+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:23.337954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:23.337954+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0033141500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"69'8","reported_seq":160,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:46.763869+0000","last_change":"2021-10-08T19:24:10.319907+0000","last_active":"2021-10-08T19:25:46.763869+0000","last_peered":"2021-10-08T19:25:46.763869+0000","last_clean":"2021-10-08T19:25:46.763869+0000","last_became_active":"2021-10-08T19:21:27.635924+0000","last_became_peered":"2021-10-08T19:21:27.635924+0000","last_unstale":"2021-10-08T19:25:46.763869+0000","last_undegraded":"2021-10-08T19:25:46.763869+0000","last_fullsized":"2021-10-08T19:25:46.763869+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'8","last_scrub_stamp":"2021-10-08T19:24:10.319809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:10.319809+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0087040810000000007,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":92,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.513223+0000","last_change":"2021-10-08T19:23:11.535748+0000","last_active":"2021-10-08T19:25:45.513223+0000","last_peered":"2021-10-08T19:25:45.513223+0000","last_clean":"2021-10-08T19:25:45.513223+0000","last_became_active":"2021-10-08T19:21:29.646331+0000","last_became_peered":"2021-10-08T19:21:29.646331+0000","last_unstale":"2021-10-08T19:25:45.513223+0000","last_undegraded":"2021-10-08T19:25:45.513223+0000","last_fullsized":"2021-10-08T19:25:45.513223+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:11.535641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:11.535641+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001740417,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.528035+0000","last_change":"2021-10-08T19:25:15.499116+0000","last_active":"2021-10-08T19:25:45.528035+0000","last_peered":"2021-10-08T19:25:45.528035+0000","last_clean":"2021-10-08T19:25:45.528035+0000","last_became_active":"2021-10-08T19:25:15.498770+0000","last_became_peered":"2021-10-08T19:25:15.498770+0000","last_unstale":"2021-10-08T19:25:45.528035+0000","last_undegraded":"2021-10-08T19:25:45.528035+0000","last_fullsized":"2021-10-08T19:25:45.528035+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:09.177525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:09.177525+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"69'9","reported_seq":117,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.508018+0000","last_change":"2021-10-08T19:24:04.286963+0000","last_active":"2021-10-08T19:25:45.508018+0000","last_peered":"2021-10-08T19:25:45.508018+0000","last_clean":"2021-10-08T19:25:45.508018+0000","last_became_active":"2021-10-08T19:21:25.741755+0000","last_became_peered":"2021-10-08T19:21:25.741755+0000","last_unstale":"2021-10-08T19:25:45.508018+0000","last_undegraded":"2021-10-08T19:25:45.508018+0000","last_fullsized":"2021-10-08T19:25:45.508018+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'9","last_scrub_stamp":"2021-10-08T19:24:04.286857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:24:04.286857+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0047281429999999998,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":104,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.510179+0000","last_change":"2021-10-08T19:23:27.367010+0000","last_active":"2021-10-08T19:25:45.510179+0000","last_peered":"2021-10-08T19:25:45.510179+0000","last_clean":"2021-10-08T19:25:45.510179+0000","last_became_active":"2021-10-08T19:21:23.606478+0000","last_became_peered":"2021-10-08T19:21:23.606478+0000","last_unstale":"2021-10-08T19:25:45.510179+0000","last_undegraded":"2021-10-08T19:25:45.510179+0000","last_fullsized":"2021-10-08T19:25:45.510179+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:27.366934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:27.366934+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0016199809999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"69'8","reported_seq":160,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:46.772481+0000","last_change":"2021-10-08T19:24:16.547591+0000","last_active":"2021-10-08T19:25:46.772481+0000","last_peered":"2021-10-08T19:25:46.772481+0000","last_clean":"2021-10-08T19:25:46.772481+0000","last_became_active":"2021-10-08T19:21:27.636440+0000","last_became_peered":"2021-10-08T19:21:27.636440+0000","last_unstale":"2021-10-08T19:25:46.772481+0000","last_undegraded":"2021-10-08T19:25:46.772481+0000","last_fullsized":"2021-10-08T19:25:46.772481+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'8","last_scrub_stamp":"2021-10-08T19:24:16.547475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:16.547475+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0084390609999999994,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":91,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.499925+0000","last_change":"2021-10-08T19:22:49.049456+0000","last_active":"2021-10-08T19:25:45.499925+0000","last_peered":"2021-10-08T19:25:45.499925+0000","last_clean":"2021-10-08T19:25:45.499925+0000","last_became_active":"2021-10-08T19:21:29.640302+0000","last_became_peered":"2021-10-08T19:21:29.640302+0000","last_unstale":"2021-10-08T19:25:45.499925+0000","last_undegraded":"2021-10-08T19:25:45.499925+0000","last_fullsized":"2021-10-08T19:25:45.499925+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:49.049379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:49.049379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.00162856,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.509697+0000","last_change":"2021-10-08T19:25:15.502340+0000","last_active":"2021-10-08T19:25:45.509697+0000","last_peered":"2021-10-08T19:25:45.509697+0000","last_clean":"2021-10-08T19:25:45.509697+0000","last_became_active":"2021-10-08T19:25:15.502018+0000","last_became_peered":"2021-10-08T19:25:15.502018+0000","last_unstale":"2021-10-08T19:25:45.509697+0000","last_undegraded":"2021-10-08T19:25:45.509697+0000","last_fullsized":"2021-10-08T19:25:45.509697+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:40.563247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.563247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.024890005999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.528600+0000","last_change":"2021-10-08T19:25:15.505142+0000","last_active":"2021-10-08T19:25:45.528600+0000","last_peered":"2021-10-08T19:25:45.528600+0000","last_clean":"2021-10-08T19:25:45.528600+0000","last_became_active":"2021-10-08T19:25:15.504778+0000","last_became_peered":"2021-10-08T19:25:15.504778+0000","last_unstale":"2021-10-08T19:25:45.528600+0000","last_undegraded":"2021-10-08T19:25:45.528600+0000","last_fullsized":"2021-10-08T19:25:45.528600+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:17.379559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:17.379559+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0090469920000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"87'13","reported_seq":154,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.514413+0000","last_change":"2021-10-08T19:24:25.114792+0000","last_active":"2021-10-08T19:25:45.514413+0000","last_peered":"2021-10-08T19:25:45.514413+0000","last_clean":"2021-10-08T19:25:45.514413+0000","last_became_active":"2021-10-08T19:24:25.091885+0000","last_became_peered":"2021-10-08T19:24:25.091885+0000","last_unstale":"2021-10-08T19:25:45.514413+0000","last_undegraded":"2021-10-08T19:25:45.514413+0000","last_fullsized":"2021-10-08T19:25:45.514413+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'13","last_scrub_stamp":"2021-10-08T19:22:53.263631+0000","last_deep_scrub":"87'13","last_deep_scrub_stamp":"2021-10-08T19:22:53.263631+0000","last_clean_scrub_stamp":"2021-10-08T19:22:53.263631+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0036954140000000002,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":41,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.503317+0000","last_change":"2021-10-08T19:24:25.105338+0000","last_active":"2021-10-08T19:25:45.503317+0000","last_peered":"2021-10-08T19:25:45.503317+0000","last_clean":"2021-10-08T19:25:45.503317+0000","last_became_active":"2021-10-08T19:24:25.105096+0000","last_became_peered":"2021-10-08T19:24:25.105096+0000","last_unstale":"2021-10-08T19:25:45.503317+0000","last_undegraded":"2021-10-08T19:25:45.503317+0000","last_fullsized":"2021-10-08T19:25:45.503317+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:52.408893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:52.408893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":93,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.507654+0000","last_change":"2021-10-08T19:23:28.367444+0000","last_active":"2021-10-08T19:25:45.507654+0000","last_peered":"2021-10-08T19:25:45.507654+0000","last_clean":"2021-10-08T19:25:45.507654+0000","last_became_active":"2021-10-08T19:21:27.637800+0000","last_became_peered":"2021-10-08T19:21:27.637800+0000","last_unstale":"2021-10-08T19:25:45.507654+0000","last_undegraded":"2021-10-08T19:25:45.507654+0000","last_fullsized":"2021-10-08T19:25:45.507654+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:28.367323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.367323+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034823359999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":92,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.508832+0000","last_change":"2021-10-08T19:23:02.605102+0000","last_active":"2021-10-08T19:25:45.508832+0000","last_peered":"2021-10-08T19:25:45.508832+0000","last_clean":"2021-10-08T19:25:45.508832+0000","last_became_active":"2021-10-08T19:21:29.641431+0000","last_became_peered":"2021-10-08T19:21:29.641431+0000","last_unstale":"2021-10-08T19:25:45.508832+0000","last_undegraded":"2021-10-08T19:25:45.508832+0000","last_fullsized":"2021-10-08T19:25:45.508832+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:02.605025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:02.605025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001265305,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"69'11","reported_seq":190,"reported_epoch":143,"state":"active+recovery_wait+degraded","last_fresh":"2021-10-08T19:25:45.498145+0000","last_change":"2021-10-08T19:24:47.503908+0000","last_active":"2021-10-08T19:25:45.498145+0000","last_peered":"2021-10-08T19:25:45.498145+0000","last_clean":"2021-10-08T19:24:40.461198+0000","last_became_active":"2021-10-08T19:24:47.503536+0000","last_became_peered":"2021-10-08T19:24:47.503536+0000","last_unstale":"2021-10-08T19:25:45.498145+0000","last_undegraded":"2021-10-08T19:24:47.488427+0000","last_fullsized":"2021-10-08T19:25:45.498145+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'11","last_scrub_stamp":"2021-10-08T19:24:04.177847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:24:04.177847+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0047576429999999998,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":["4","2","6"],"object_location_counts":[{"shards":"2,4,6","objects":5}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":98,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.516938+0000","last_change":"2021-10-08T19:23:02.242539+0000","last_active":"2021-10-08T19:25:45.516938+0000","last_peered":"2021-10-08T19:25:45.516938+0000","last_clean":"2021-10-08T19:25:45.516938+0000","last_became_active":"2021-10-08T19:21:23.607048+0000","last_became_peered":"2021-10-08T19:21:23.607048+0000","last_unstale":"2021-10-08T19:25:45.516938+0000","last_undegraded":"2021-10-08T19:25:45.516938+0000","last_fullsized":"2021-10-08T19:25:45.516938+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:02.242462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:02.242462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034031740000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":94,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.514584+0000","last_change":"2021-10-08T19:22:43.186757+0000","last_active":"2021-10-08T19:25:45.514584+0000","last_peered":"2021-10-08T19:25:45.514584+0000","last_clean":"2021-10-08T19:25:45.514584+0000","last_became_active":"2021-10-08T19:21:27.635623+0000","last_became_peered":"2021-10-08T19:21:27.635623+0000","last_unstale":"2021-10-08T19:25:45.514584+0000","last_undegraded":"2021-10-08T19:25:45.514584+0000","last_fullsized":"2021-10-08T19:25:45.514584+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:43.186684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:43.186684+0000","last_clean_scrub_stamp":"2021-10-08T19:22:43.186684+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0015123129999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":91,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.505867+0000","last_change":"2021-10-08T19:23:12.504222+0000","last_active":"2021-10-08T19:25:45.505867+0000","last_peered":"2021-10-08T19:25:45.505867+0000","last_clean":"2021-10-08T19:25:45.505867+0000","last_became_active":"2021-10-08T19:21:29.649225+0000","last_became_peered":"2021-10-08T19:21:29.649225+0000","last_unstale":"2021-10-08T19:25:45.505867+0000","last_undegraded":"2021-10-08T19:25:45.505867+0000","last_fullsized":"2021-10-08T19:25:45.505867+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:12.504136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:12.504136+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0038704550000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"70'5","reported_seq":21,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.498294+0000","last_change":"2021-10-08T19:25:15.496726+0000","last_active":"2021-10-08T19:25:45.498294+0000","last_peered":"2021-10-08T19:25:45.498294+0000","last_clean":"2021-10-08T19:25:45.498294+0000","last_became_active":"2021-10-08T19:25:15.496309+0000","last_became_peered":"2021-10-08T19:25:15.496309+0000","last_unstale":"2021-10-08T19:25:45.498294+0000","last_undegraded":"2021-10-08T19:25:45.498294+0000","last_fullsized":"2021-10-08T19:25:45.498294+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:22:48.239721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:48.239721+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001618092,"stat_sum":{"num_bytes":49,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":19,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":49,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.10","version":"69'4","reported_seq":131,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.510427+0000","last_change":"2021-10-08T19:24:25.622912+0000","last_active":"2021-10-08T19:25:45.510427+0000","last_peered":"2021-10-08T19:25:45.510427+0000","last_clean":"2021-10-08T19:25:45.510427+0000","last_became_active":"2021-10-08T19:24:25.097674+0000","last_became_peered":"2021-10-08T19:24:25.097674+0000","last_unstale":"2021-10-08T19:25:45.510427+0000","last_undegraded":"2021-10-08T19:25:45.510427+0000","last_fullsized":"2021-10-08T19:25:45.510427+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'4","last_scrub_stamp":"2021-10-08T19:22:34.447854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:34.447854+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040770490000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":121,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.508764+0000","last_change":"2021-10-08T19:24:25.094735+0000","last_active":"2021-10-08T19:25:45.508764+0000","last_peered":"2021-10-08T19:25:45.508764+0000","last_clean":"2021-10-08T19:25:45.508764+0000","last_became_active":"2021-10-08T19:24:25.094384+0000","last_became_peered":"2021-10-08T19:24:25.094384+0000","last_unstale":"2021-10-08T19:25:45.508764+0000","last_undegraded":"2021-10-08T19:25:45.508764+0000","last_fullsized":"2021-10-08T19:25:45.508764+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:21.346014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:13.716331+0000","last_clean_scrub_stamp":"2021-10-08T19:24:21.346014+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0086210910000000009,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":41,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.502206+0000","last_change":"2021-10-08T19:24:25.106499+0000","last_active":"2021-10-08T19:25:45.502206+0000","last_peered":"2021-10-08T19:25:45.502206+0000","last_clean":"2021-10-08T19:25:45.502206+0000","last_became_active":"2021-10-08T19:24:25.106186+0000","last_became_peered":"2021-10-08T19:24:25.106186+0000","last_unstale":"2021-10-08T19:25:45.502206+0000","last_undegraded":"2021-10-08T19:25:45.502206+0000","last_fullsized":"2021-10-08T19:25:45.502206+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:02.446394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:02.446394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":98,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.528221+0000","last_change":"2021-10-08T19:24:18.542192+0000","last_active":"2021-10-08T19:25:45.528221+0000","last_peered":"2021-10-08T19:25:45.528221+0000","last_clean":"2021-10-08T19:25:45.528221+0000","last_became_active":"2021-10-08T19:21:29.642835+0000","last_became_peered":"2021-10-08T19:21:29.642835+0000","last_unstale":"2021-10-08T19:25:45.528221+0000","last_undegraded":"2021-10-08T19:25:45.528221+0000","last_fullsized":"2021-10-08T19:25:45.528221+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:18.542124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:24:18.542124+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0051790259999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.507874+0000","last_change":"2021-10-08T19:25:15.504574+0000","last_active":"2021-10-08T19:25:45.507874+0000","last_peered":"2021-10-08T19:25:45.507874+0000","last_clean":"2021-10-08T19:25:45.507874+0000","last_became_active":"2021-10-08T19:25:15.504255+0000","last_became_peered":"2021-10-08T19:25:15.504255+0000","last_unstale":"2021-10-08T19:25:45.507874+0000","last_undegraded":"2021-10-08T19:25:45.507874+0000","last_fullsized":"2021-10-08T19:25:45.507874+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:40.563247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.563247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.024890005999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"69'11","reported_seq":156,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.506181+0000","last_change":"2021-10-08T19:24:25.550057+0000","last_active":"2021-10-08T19:25:45.506181+0000","last_peered":"2021-10-08T19:25:45.506181+0000","last_clean":"2021-10-08T19:25:45.506181+0000","last_became_active":"2021-10-08T19:24:25.097676+0000","last_became_peered":"2021-10-08T19:24:25.097676+0000","last_unstale":"2021-10-08T19:25:45.506181+0000","last_undegraded":"2021-10-08T19:25:45.506181+0000","last_fullsized":"2021-10-08T19:25:45.506181+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'11","last_scrub_stamp":"2021-10-08T19:23:38.388959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:38.388959+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039620519999999998,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":41,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.502863+0000","last_change":"2021-10-08T19:24:25.098448+0000","last_active":"2021-10-08T19:25:45.502863+0000","last_peered":"2021-10-08T19:25:45.502863+0000","last_clean":"2021-10-08T19:25:45.502863+0000","last_became_active":"2021-10-08T19:24:25.098128+0000","last_became_peered":"2021-10-08T19:24:25.098128+0000","last_unstale":"2021-10-08T19:25:45.502863+0000","last_undegraded":"2021-10-08T19:25:45.502863+0000","last_fullsized":"2021-10-08T19:25:45.502863+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:34.508558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:34.508558+0000","last_clean_scrub_stamp":"2021-10-08T19:23:34.508558+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":112,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.527886+0000","last_change":"2021-10-08T19:24:25.096183+0000","last_active":"2021-10-08T19:25:45.527886+0000","last_peered":"2021-10-08T19:25:45.527886+0000","last_clean":"2021-10-08T19:25:45.527886+0000","last_became_active":"2021-10-08T19:24:25.095490+0000","last_became_peered":"2021-10-08T19:24:25.095490+0000","last_unstale":"2021-10-08T19:25:45.527886+0000","last_undegraded":"2021-10-08T19:25:45.527886+0000","last_fullsized":"2021-10-08T19:25:45.527886+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:00.194892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:00.194892+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020373650000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":109,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.507881+0000","last_change":"2021-10-08T19:24:25.102165+0000","last_active":"2021-10-08T19:25:45.507881+0000","last_peered":"2021-10-08T19:25:45.507881+0000","last_clean":"2021-10-08T19:25:45.507881+0000","last_became_active":"2021-10-08T19:24:25.100477+0000","last_became_peered":"2021-10-08T19:24:25.100477+0000","last_unstale":"2021-10-08T19:25:45.507881+0000","last_undegraded":"2021-10-08T19:25:45.507881+0000","last_fullsized":"2021-10-08T19:25:45.507881+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:06.570853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:06.570853+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034079790000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"69'10","reported_seq":117,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.513731+0000","last_change":"2021-10-08T19:23:36.223620+0000","last_active":"2021-10-08T19:25:45.513731+0000","last_peered":"2021-10-08T19:25:45.513731+0000","last_clean":"2021-10-08T19:25:45.513731+0000","last_became_active":"2021-10-08T19:21:25.743519+0000","last_became_peered":"2021-10-08T19:21:25.743519+0000","last_unstale":"2021-10-08T19:25:45.513731+0000","last_undegraded":"2021-10-08T19:25:45.513731+0000","last_fullsized":"2021-10-08T19:25:45.513731+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'10","last_scrub_stamp":"2021-10-08T19:23:36.223545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:36.223545+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0023151259999999998,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":97,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.507731+0000","last_change":"2021-10-08T19:23:19.631788+0000","last_active":"2021-10-08T19:25:45.507731+0000","last_peered":"2021-10-08T19:25:45.507731+0000","last_clean":"2021-10-08T19:25:45.507731+0000","last_became_active":"2021-10-08T19:21:23.604530+0000","last_became_peered":"2021-10-08T19:21:23.604530+0000","last_unstale":"2021-10-08T19:25:45.507731+0000","last_undegraded":"2021-10-08T19:25:45.507731+0000","last_fullsized":"2021-10-08T19:25:45.507731+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:19.631715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:19.631715+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0013318340000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1f","version":"114'10","reported_seq":62,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:46.763895+0000","last_change":"2021-10-08T19:24:25.122871+0000","last_active":"2021-10-08T19:25:46.763895+0000","last_peered":"2021-10-08T19:25:46.763895+0000","last_clean":"2021-10-08T19:25:46.763895+0000","last_became_active":"2021-10-08T19:24:25.105742+0000","last_became_peered":"2021-10-08T19:24:25.105742+0000","last_unstale":"2021-10-08T19:25:46.763895+0000","last_undegraded":"2021-10-08T19:25:46.763895+0000","last_fullsized":"2021-10-08T19:25:46.763895+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'9","last_scrub_stamp":"2021-10-08T19:24:07.171989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:07.171989+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"69'1","reported_seq":93,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.529689+0000","last_change":"2021-10-08T19:23:04.311491+0000","last_active":"2021-10-08T19:25:45.529689+0000","last_peered":"2021-10-08T19:25:45.529689+0000","last_clean":"2021-10-08T19:25:45.529689+0000","last_became_active":"2021-10-08T19:21:29.640296+0000","last_became_peered":"2021-10-08T19:21:29.640296+0000","last_unstale":"2021-10-08T19:25:45.529689+0000","last_undegraded":"2021-10-08T19:25:45.529689+0000","last_fullsized":"2021-10-08T19:25:45.529689+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2021-10-08T19:23:04.311406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:04.311406+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0041668299999999998,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"69'11","reported_seq":53,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.503143+0000","last_change":"2021-10-08T19:24:25.129616+0000","last_active":"2021-10-08T19:25:45.503143+0000","last_peered":"2021-10-08T19:25:45.503143+0000","last_clean":"2021-10-08T19:25:45.503143+0000","last_became_active":"2021-10-08T19:24:25.104985+0000","last_became_peered":"2021-10-08T19:24:25.104985+0000","last_unstale":"2021-10-08T19:25:45.503143+0000","last_undegraded":"2021-10-08T19:25:45.503143+0000","last_fullsized":"2021-10-08T19:25:45.503143+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'11","last_scrub_stamp":"2021-10-08T19:22:53.420199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:53.420199+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":115,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.505943+0000","last_change":"2021-10-08T19:24:25.098061+0000","last_active":"2021-10-08T19:25:45.505943+0000","last_peered":"2021-10-08T19:25:45.505943+0000","last_clean":"2021-10-08T19:25:45.505943+0000","last_became_active":"2021-10-08T19:24:25.097164+0000","last_became_peered":"2021-10-08T19:24:25.097164+0000","last_unstale":"2021-10-08T19:25:45.505943+0000","last_undegraded":"2021-10-08T19:25:45.505943+0000","last_fullsized":"2021-10-08T19:25:45.505943+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:11.535464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:11.535464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012302489999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":100,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.513821+0000","last_change":"2021-10-08T19:24:13.178473+0000","last_active":"2021-10-08T19:25:45.513821+0000","last_peered":"2021-10-08T19:25:45.513821+0000","last_clean":"2021-10-08T19:25:45.513821+0000","last_became_active":"2021-10-08T19:21:27.632648+0000","last_became_peered":"2021-10-08T19:21:27.632648+0000","last_unstale":"2021-10-08T19:25:45.513821+0000","last_undegraded":"2021-10-08T19:25:45.513821+0000","last_fullsized":"2021-10-08T19:25:45.513821+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:13.178370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:13.178370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0056659290000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"69'1","reported_seq":93,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.516730+0000","last_change":"2021-10-08T19:22:50.226593+0000","last_active":"2021-10-08T19:25:45.516730+0000","last_peered":"2021-10-08T19:25:45.516730+0000","last_clean":"2021-10-08T19:25:45.516730+0000","last_became_active":"2021-10-08T19:21:29.637392+0000","last_became_peered":"2021-10-08T19:21:29.637392+0000","last_unstale":"2021-10-08T19:25:45.516730+0000","last_undegraded":"2021-10-08T19:25:45.516730+0000","last_fullsized":"2021-10-08T19:25:45.516730+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2021-10-08T19:22:50.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:50.226504+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040000080000000002,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"69'15","reported_seq":146,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.501861+0000","last_change":"2021-10-08T19:22:52.474731+0000","last_active":"2021-10-08T19:25:45.501861+0000","last_peered":"2021-10-08T19:25:45.501861+0000","last_clean":"2021-10-08T19:25:45.501861+0000","last_became_active":"2021-10-08T19:22:44.005356+0000","last_became_peered":"2021-10-08T19:22:44.005356+0000","last_unstale":"2021-10-08T19:25:45.501861+0000","last_undegraded":"2021-10-08T19:25:45.501861+0000","last_fullsized":"2021-10-08T19:25:45.501861+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'15","last_scrub_stamp":"2021-10-08T19:22:52.474651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:52.474651+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040638499999999999,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":41,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.502514+0000","last_change":"2021-10-08T19:24:25.106611+0000","last_active":"2021-10-08T19:25:45.502514+0000","last_peered":"2021-10-08T19:25:45.502514+0000","last_clean":"2021-10-08T19:25:45.502514+0000","last_became_active":"2021-10-08T19:24:25.106119+0000","last_became_peered":"2021-10-08T19:24:25.106119+0000","last_unstale":"2021-10-08T19:25:45.502514+0000","last_undegraded":"2021-10-08T19:25:45.502514+0000","last_fullsized":"2021-10-08T19:25:45.502514+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:46.422866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:46.422866+0000","last_clean_scrub_stamp":"2021-10-08T19:22:46.422866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":94,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.517232+0000","last_change":"2021-10-08T19:23:10.148845+0000","last_active":"2021-10-08T19:25:45.517232+0000","last_peered":"2021-10-08T19:25:45.517232+0000","last_clean":"2021-10-08T19:25:45.517232+0000","last_became_active":"2021-10-08T19:21:27.636398+0000","last_became_peered":"2021-10-08T19:21:27.636398+0000","last_unstale":"2021-10-08T19:25:45.517232+0000","last_undegraded":"2021-10-08T19:25:45.517232+0000","last_fullsized":"2021-10-08T19:25:45.517232+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:10.148774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:10.148774+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034045170000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":109,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.498783+0000","last_change":"2021-10-08T19:24:25.098136+0000","last_active":"2021-10-08T19:25:45.498783+0000","last_peered":"2021-10-08T19:25:45.498783+0000","last_clean":"2021-10-08T19:25:45.498783+0000","last_became_active":"2021-10-08T19:24:25.097782+0000","last_became_peered":"2021-10-08T19:24:25.097782+0000","last_unstale":"2021-10-08T19:25:45.498783+0000","last_undegraded":"2021-10-08T19:25:45.498783+0000","last_fullsized":"2021-10-08T19:25:45.498783+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:56.020759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:56.020759+0000","last_clean_scrub_stamp":"2021-10-08T19:22:56.020759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001373478,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"69'12","reported_seq":118,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.506324+0000","last_change":"2021-10-08T19:23:10.562916+0000","last_active":"2021-10-08T19:25:45.506324+0000","last_peered":"2021-10-08T19:25:45.506324+0000","last_clean":"2021-10-08T19:25:45.506324+0000","last_became_active":"2021-10-08T19:21:25.612541+0000","last_became_peered":"2021-10-08T19:21:25.612541+0000","last_unstale":"2021-10-08T19:25:45.506324+0000","last_undegraded":"2021-10-08T19:25:45.506324+0000","last_fullsized":"2021-10-08T19:25:45.506324+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'12","last_scrub_stamp":"2021-10-08T19:23:10.562820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:10.562820+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040692890000000002,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":115,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.507040+0000","last_change":"2021-10-08T19:24:25.097146+0000","last_active":"2021-10-08T19:25:45.507040+0000","last_peered":"2021-10-08T19:25:45.507040+0000","last_clean":"2021-10-08T19:25:45.507040+0000","last_became_active":"2021-10-08T19:24:25.096570+0000","last_became_peered":"2021-10-08T19:24:25.096570+0000","last_unstale":"2021-10-08T19:25:45.507040+0000","last_undegraded":"2021-10-08T19:25:45.507040+0000","last_fullsized":"2021-10-08T19:25:45.507040+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:07.581653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:07.581653+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034956309999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":99,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.498617+0000","last_change":"2021-10-08T19:24:13.289692+0000","last_active":"2021-10-08T19:25:45.498617+0000","last_peered":"2021-10-08T19:25:45.498617+0000","last_clean":"2021-10-08T19:25:45.498617+0000","last_became_active":"2021-10-08T19:21:27.635242+0000","last_became_peered":"2021-10-08T19:21:27.635242+0000","last_unstale":"2021-10-08T19:25:45.498617+0000","last_undegraded":"2021-10-08T19:25:45.498617+0000","last_fullsized":"2021-10-08T19:25:45.498617+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:13.289586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:13.289586+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0093791299999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":109,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.514512+0000","last_change":"2021-10-08T19:24:25.096752+0000","last_active":"2021-10-08T19:25:45.514512+0000","last_peered":"2021-10-08T19:25:45.514512+0000","last_clean":"2021-10-08T19:25:45.514512+0000","last_became_active":"2021-10-08T19:24:25.096419+0000","last_became_peered":"2021-10-08T19:24:25.096419+0000","last_unstale":"2021-10-08T19:25:45.514512+0000","last_undegraded":"2021-10-08T19:25:45.514512+0000","last_fullsized":"2021-10-08T19:25:45.514512+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:38.544673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:38.544673+0000","last_clean_scrub_stamp":"2021-10-08T19:22:38.544673+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0019818940000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"69'9","reported_seq":111,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.497718+0000","last_change":"2021-10-08T19:23:19.997379+0000","last_active":"2021-10-08T19:25:45.497718+0000","last_peered":"2021-10-08T19:25:45.497718+0000","last_clean":"2021-10-08T19:25:45.497718+0000","last_became_active":"2021-10-08T19:21:25.608263+0000","last_became_peered":"2021-10-08T19:21:25.608263+0000","last_unstale":"2021-10-08T19:25:45.497718+0000","last_undegraded":"2021-10-08T19:25:45.497718+0000","last_fullsized":"2021-10-08T19:25:45.497718+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'9","last_scrub_stamp":"2021-10-08T19:23:19.997296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:19.997296+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040259689999999999,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":104,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.529397+0000","last_change":"2021-10-08T19:24:15.574426+0000","last_active":"2021-10-08T19:25:45.529397+0000","last_peered":"2021-10-08T19:25:45.529397+0000","last_clean":"2021-10-08T19:25:45.529397+0000","last_became_active":"2021-10-08T19:21:23.607785+0000","last_became_peered":"2021-10-08T19:21:23.607785+0000","last_unstale":"2021-10-08T19:25:45.529397+0000","last_undegraded":"2021-10-08T19:25:45.529397+0000","last_fullsized":"2021-10-08T19:25:45.529397+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:15.574344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:15.574344+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0085919499999999992,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":93,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.508609+0000","last_change":"2021-10-08T19:23:05.799433+0000","last_active":"2021-10-08T19:25:45.508609+0000","last_peered":"2021-10-08T19:25:45.508609+0000","last_clean":"2021-10-08T19:25:45.508609+0000","last_became_active":"2021-10-08T19:21:27.633979+0000","last_became_peered":"2021-10-08T19:21:27.633979+0000","last_unstale":"2021-10-08T19:25:45.508609+0000","last_undegraded":"2021-10-08T19:25:45.508609+0000","last_fullsized":"2021-10-08T19:25:45.508609+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:05.799361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:05.799361+0000","last_clean_scrub_stamp":"2021-10-08T19:23:05.799361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0036358100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":98,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.509339+0000","last_change":"2021-10-08T19:24:14.144555+0000","last_active":"2021-10-08T19:25:45.509339+0000","last_peered":"2021-10-08T19:25:45.509339+0000","last_clean":"2021-10-08T19:25:45.509339+0000","last_became_active":"2021-10-08T19:21:29.640978+0000","last_became_peered":"2021-10-08T19:21:29.640978+0000","last_unstale":"2021-10-08T19:25:45.509339+0000","last_undegraded":"2021-10-08T19:25:45.509339+0000","last_fullsized":"2021-10-08T19:25:45.509339+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:14.144450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:24:14.144450+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0032569320000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"69'5","reported_seq":105,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.498431+0000","last_change":"2021-10-08T19:23:17.993609+0000","last_active":"2021-10-08T19:25:45.498431+0000","last_peered":"2021-10-08T19:25:45.498431+0000","last_clean":"2021-10-08T19:25:45.498431+0000","last_became_active":"2021-10-08T19:21:25.609029+0000","last_became_peered":"2021-10-08T19:21:25.609029+0000","last_unstale":"2021-10-08T19:25:45.498431+0000","last_undegraded":"2021-10-08T19:25:45.498431+0000","last_fullsized":"2021-10-08T19:25:45.498431+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'5","last_scrub_stamp":"2021-10-08T19:23:17.993532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:17.993532+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040855580000000004,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":122,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.528752+0000","last_change":"2021-10-08T19:24:25.096540+0000","last_active":"2021-10-08T19:25:45.528752+0000","last_peered":"2021-10-08T19:25:45.528752+0000","last_clean":"2021-10-08T19:25:45.528752+0000","last_became_active":"2021-10-08T19:24:25.096225+0000","last_became_peered":"2021-10-08T19:24:25.096225+0000","last_unstale":"2021-10-08T19:25:45.528752+0000","last_undegraded":"2021-10-08T19:25:45.528752+0000","last_fullsized":"2021-10-08T19:25:45.528752+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:06.609550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:06.609550+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0037828580000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":100,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.528399+0000","last_change":"2021-10-08T19:24:20.517151+0000","last_active":"2021-10-08T19:25:45.528399+0000","last_peered":"2021-10-08T19:25:45.528399+0000","last_clean":"2021-10-08T19:25:45.528399+0000","last_became_active":"2021-10-08T19:21:27.637178+0000","last_became_peered":"2021-10-08T19:21:27.637178+0000","last_unstale":"2021-10-08T19:25:45.528399+0000","last_undegraded":"2021-10-08T19:25:45.528399+0000","last_fullsized":"2021-10-08T19:25:45.528399+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:20.517044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:20.517044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0053303969999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":91,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.507693+0000","last_change":"2021-10-08T19:23:23.659594+0000","last_active":"2021-10-08T19:25:45.507693+0000","last_peered":"2021-10-08T19:25:45.507693+0000","last_clean":"2021-10-08T19:25:45.507693+0000","last_became_active":"2021-10-08T19:21:29.649640+0000","last_became_peered":"2021-10-08T19:21:29.649640+0000","last_unstale":"2021-10-08T19:25:45.507693+0000","last_undegraded":"2021-10-08T19:25:45.507693+0000","last_fullsized":"2021-10-08T19:25:45.507693+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:23.659524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:23.659524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0013747169999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"88'13","reported_seq":179,"reported_epoch":143,"state":"active+recovery_wait+degraded","last_fresh":"2021-10-08T19:25:45.497503+0000","last_change":"2021-10-08T19:25:33.715801+0000","last_active":"2021-10-08T19:25:45.497503+0000","last_peered":"2021-10-08T19:25:45.497503+0000","last_clean":"2021-10-08T19:25:29.684638+0000","last_became_active":"2021-10-08T19:25:33.715297+0000","last_became_peered":"2021-10-08T19:25:33.715297+0000","last_unstale":"2021-10-08T19:25:45.497503+0000","last_undegraded":"2021-10-08T19:25:33.704184+0000","last_fullsized":"2021-10-08T19:25:45.497503+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'13","last_scrub_stamp":"2021-10-08T19:23:16.016646+0000","last_deep_scrub":"88'13","last_deep_scrub_stamp":"2021-10-08T19:23:16.016646+0000","last_clean_scrub_stamp":"2021-10-08T19:23:16.016646+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0052093469999999996,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":["4","2","6"],"object_location_counts":[{"shards":"2,4,6","objects":4}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":97,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.511845+0000","last_change":"2021-10-08T19:23:14.443220+0000","last_active":"2021-10-08T19:25:45.511845+0000","last_peered":"2021-10-08T19:25:45.511845+0000","last_clean":"2021-10-08T19:25:45.511845+0000","last_became_active":"2021-10-08T19:21:23.598272+0000","last_became_peered":"2021-10-08T19:21:23.598272+0000","last_unstale":"2021-10-08T19:25:45.511845+0000","last_undegraded":"2021-10-08T19:25:45.511845+0000","last_fullsized":"2021-10-08T19:25:45.511845+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:14.443147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:14.443147+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003489631,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":94,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.515292+0000","last_change":"2021-10-08T19:23:05.196328+0000","last_active":"2021-10-08T19:25:45.515292+0000","last_peered":"2021-10-08T19:25:45.515292+0000","last_clean":"2021-10-08T19:25:45.515292+0000","last_became_active":"2021-10-08T19:21:27.634883+0000","last_became_peered":"2021-10-08T19:21:27.634883+0000","last_unstale":"2021-10-08T19:25:45.515292+0000","last_undegraded":"2021-10-08T19:25:45.515292+0000","last_fullsized":"2021-10-08T19:25:45.515292+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:05.196252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:05.196252+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0016803230000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":91,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.497634+0000","last_change":"2021-10-08T19:22:50.032446+0000","last_active":"2021-10-08T19:25:45.497634+0000","last_peered":"2021-10-08T19:25:45.497634+0000","last_clean":"2021-10-08T19:25:45.497634+0000","last_became_active":"2021-10-08T19:21:29.639039+0000","last_became_peered":"2021-10-08T19:21:29.639039+0000","last_unstale":"2021-10-08T19:25:45.497634+0000","last_undegraded":"2021-10-08T19:25:45.497634+0000","last_fullsized":"2021-10-08T19:25:45.497634+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:50.032367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:50.032367+0000","last_clean_scrub_stamp":"2021-10-08T19:22:50.032367+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034102759999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"69'15","reported_seq":120,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.506266+0000","last_change":"2021-10-08T19:24:14.482657+0000","last_active":"2021-10-08T19:25:45.506266+0000","last_peered":"2021-10-08T19:25:45.506266+0000","last_clean":"2021-10-08T19:25:45.506266+0000","last_became_active":"2021-10-08T19:21:25.612873+0000","last_became_peered":"2021-10-08T19:21:25.612873+0000","last_unstale":"2021-10-08T19:25:45.506266+0000","last_undegraded":"2021-10-08T19:25:45.506266+0000","last_fullsized":"2021-10-08T19:25:45.506266+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'15","last_scrub_stamp":"2021-10-08T19:24:14.482511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:24:14.482511+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012310702999999999,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":98,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.510345+0000","last_change":"2021-10-08T19:22:54.671364+0000","last_active":"2021-10-08T19:25:45.510345+0000","last_peered":"2021-10-08T19:25:45.510345+0000","last_clean":"2021-10-08T19:25:45.510345+0000","last_became_active":"2021-10-08T19:21:23.603422+0000","last_became_peered":"2021-10-08T19:21:23.603422+0000","last_unstale":"2021-10-08T19:25:45.510345+0000","last_undegraded":"2021-10-08T19:25:45.510345+0000","last_fullsized":"2021-10-08T19:25:45.510345+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:54.671289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:54.671289+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001752221,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":117,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.497819+0000","last_change":"2021-10-08T19:24:25.091115+0000","last_active":"2021-10-08T19:25:45.497819+0000","last_peered":"2021-10-08T19:25:45.497819+0000","last_clean":"2021-10-08T19:25:45.497819+0000","last_became_active":"2021-10-08T19:24:25.090759+0000","last_became_peered":"2021-10-08T19:24:25.090759+0000","last_unstale":"2021-10-08T19:25:45.497819+0000","last_undegraded":"2021-10-08T19:25:45.497819+0000","last_fullsized":"2021-10-08T19:25:45.497819+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:39.931718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:39.931718+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0036493649999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":109,"reported_epoch":143,"state":"active+clean","last_fresh":"2021-10-08T19:25:45.506787+0000","last_change":"2021-10-08T19:24:25.101949+0000","last_active":"2021-10-08T19:25:45.506787+0000","last_peered":"2021-10-08T19:25:45.506787+0000","last_clean":"2021-10-08T19:25:45.506787+0000","last_became_active":"2021-10-08T19:24:25.097417+0000","last_became_peered":"2021-10-08T19:24:25.097417+0000","last_unstale":"2021-10-08T19:25:45.506787+0000","last_undegraded":"2021-10-08T19:25:45.506787+0000","last_fullsized":"2021-10-08T19:25:45.506787+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:33.411753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:33.411753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0038057030000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":4798087192,"num_objects":73214,"num_object_clones":0,"num_object_copies":219642,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6558,"num_objects_misplaced":5869,"num_objects_unfound":0,"num_objects_dirty":73214,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":110422,"num_write_kb":5876289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2853,"num_bytes_recovered":186974208,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":14875242496,"data_stored":14875230280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76492,"ondisk_log_size":76492,"up":48,"acting":44,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":3,"acting":3,"num_store_stats":4},{"poolid":3,"num_pg":23,"stat_sum":{"num_bytes":681,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":200,"num_read_kb":196,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":584,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":69,"acting":69,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":9,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":694,"num_read_kb":451,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":139,"num_bytes_recovered":2134,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":406,"ondisk_log_size":406,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":96,"acting":96,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201337,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1532240,"kb_used_data":1477832,"kb_used_omap":0,"kb_used_meta":54400,"kb_avail":92212912,"statfs":{"total":95995035648,"available":94426021888,"internally_reserved":0,"allocated":1513299968,"data_stored":1512664957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":55705600},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:25:20 2021","interfaces":[{"interface":"back","average":{"1min":3.569,"5min":1.137,"15min":0.69099999999999995},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":32.366999999999997,"5min":32.366999999999997,"15min":32.366999999999997},"last":0.26200000000000001},{"interface":"front","average":{"1min":3.2629999999999999,"5min":1.0600000000000001,"15min":0.66800000000000004},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":29.736000000000001,"5min":29.736000000000001,"15min":29.736000000000001},"last":3.7360000000000002}]},{"osd":1,"last update":"Fri Oct 8 19:25:20 2021","interfaces":[{"interface":"back","average":{"1min":2.9740000000000002,"5min":1.0389999999999999,"15min":0.67700000000000005},"min":{"1min":0.309,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":11.417999999999999,"5min":11.417999999999999,"15min":11.417999999999999},"last":3.0139999999999998},{"interface":"front","average":{"1min":1.548,"5min":0.73399999999999999,"15min":0.58499999999999996},"min":{"1min":0.29999999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":5.2110000000000003,"5min":5.2110000000000003,"15min":5.2110000000000003},"last":1.0329999999999999}]},{"osd":2,"last update":"Fri Oct 8 19:25:20 2021","interfaces":[{"interface":"back","average":{"1min":3.5960000000000001,"5min":1.2749999999999999,"15min":0.751},"min":{"1min":0.39900000000000002,"5min":0.308,"15min":0.308},"max":{"1min":27.018000000000001,"5min":27.018000000000001,"15min":27.018000000000001},"last":3.4569999999999999},{"interface":"front","average":{"1min":3.5209999999999999,"5min":1.111,"15min":0.68799999999999994},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":27.113,"5min":27.113,"15min":27.113},"last":1.1619999999999999}]},{"osd":3,"last update":"Fri Oct 8 19:25:20 2021","interfaces":[{"interface":"back","average":{"1min":2.6579999999999999,"5min":0.96699999999999997,"15min":0.65000000000000002},"min":{"1min":0.378,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":27.010000000000002,"5min":27.010000000000002,"15min":27.010000000000002},"last":0.38300000000000001},{"interface":"front","average":{"1min":3.2389999999999999,"5min":1.3220000000000001,"15min":0.77900000000000003},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":27.263999999999999,"5min":27.263999999999999,"15min":27.263999999999999},"last":0.95199999999999996}]},{"osd":4,"last update":"Fri Oct 8 19:25:20 2021","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.496,"15min":0.48099999999999998},"min":{"1min":0.27100000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":4.7990000000000004,"5min":4.7990000000000004,"15min":4.7990000000000004},"last":0.318},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.51100000000000001,"15min":0.46899999999999997},"min":{"1min":0.308,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":4.0830000000000002,"5min":4.0830000000000002,"15min":4.0830000000000002},"last":0.34599999999999997}]},{"osd":5,"last update":"Fri Oct 8 19:25:20 2021","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.55000000000000004,"15min":0.5},"min":{"1min":0.33200000000000002,"5min":0.251,"15min":0.251},"max":{"1min":4.649,"5min":4.649,"15min":4.649},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.53800000000000003,"15min":0.52000000000000002},"min":{"1min":0.29199999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":4.5259999999999998,"5min":4.5259999999999998,"15min":4.5259999999999998},"last":0.50700000000000001}]},{"osd":6,"last update":"Fri Oct 8 19:25:20 2021","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.57799999999999996,"15min":0.53000000000000003},"min":{"1min":0.32700000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":3.2839999999999998,"5min":3.2839999999999998,"15min":3.2839999999999998},"last":0.443},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.64200000000000002,"15min":0.58999999999999997},"min":{"1min":0.36799999999999999,"5min":0.318,"15min":0.318},"max":{"1min":4.7750000000000004,"5min":4.7750000000000004,"15min":4.7750000000000004},"last":0.38800000000000001}]}]},{"osd":6,"up_from":47,"seq":201863462973,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":908856,"kb_used_data":852400,"kb_used_omap":0,"kb_used_meta":56448,"kb_avail":92836296,"statfs":{"total":95995035648,"available":95064367104,"internally_reserved":0,"allocated":872857600,"data_stored":872245343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":57802752},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:24:58 2021","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":0.62,"15min":0.51800000000000002},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":8.3829999999999991,"5min":8.3829999999999991,"15min":8.3829999999999991},"last":1.319},{"interface":"front","average":{"1min":1.498,"5min":0.69699999999999995,"15min":0.56299999999999994},"min":{"1min":0.32100000000000001,"5min":0.247,"15min":0.247},"max":{"1min":6.0519999999999996,"5min":6.0519999999999996,"15min":6.0519999999999996},"last":0.35199999999999998}]},{"osd":1,"last update":"Fri Oct 8 19:24:58 2021","interfaces":[{"interface":"back","average":{"1min":1.3839999999999999,"5min":0.68100000000000005,"15min":0.56499999999999995},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":6.4240000000000004,"5min":6.4240000000000004,"15min":6.4240000000000004},"last":0.76900000000000002},{"interface":"front","average":{"1min":1.6439999999999999,"5min":0.73899999999999999,"15min":0.57599999999999996},"min":{"1min":0.30499999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":6.452,"5min":6.452,"15min":6.452},"last":1.3680000000000001}]},{"osd":2,"last update":"Fri Oct 8 19:24:58 2021","interfaces":[{"interface":"back","average":{"1min":2.0259999999999998,"5min":0.81999999999999995,"15min":0.622},"min":{"1min":0.40000000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":8.8699999999999992,"5min":8.8699999999999992,"15min":8.8699999999999992},"last":2.3220000000000001},{"interface":"front","average":{"1min":1.8580000000000001,"5min":0.80000000000000004,"15min":0.59399999999999997},"min":{"1min":0.28899999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":5.4290000000000003,"5min":5.4290000000000003,"15min":5.4290000000000003},"last":0.29899999999999999}]},{"osd":3,"last update":"Fri Oct 8 19:24:58 2021","interfaces":[{"interface":"back","average":{"1min":2.0019999999999998,"5min":0.79800000000000004,"15min":0.59299999999999997},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":5.7060000000000004,"5min":5.7060000000000004,"15min":5.7060000000000004},"last":2.8439999999999999},{"interface":"front","average":{"1min":1.4179999999999999,"5min":0.69699999999999995,"15min":0.56599999999999995},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":4.0789999999999997,"5min":4.0789999999999997,"15min":4.0789999999999997},"last":2.2970000000000002}]},{"osd":4,"last update":"Fri Oct 8 19:24:58 2021","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.46300000000000002,"15min":0.42899999999999999},"min":{"1min":0.28999999999999998,"5min":0.255,"15min":0.255},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.376},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.47499999999999998,"15min":0.45700000000000002},"min":{"1min":0.307,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.972,"5min":1.972,"15min":1.972},"last":5.4969999999999999}]},{"osd":5,"last update":"Fri Oct 8 19:24:58 2021","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.53700000000000003,"15min":0.48299999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":6.7949999999999999,"5min":6.7949999999999999,"15min":6.7949999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.51200000000000001,"15min":0.48399999999999999},"min":{"1min":0.33300000000000002,"5min":0.252,"15min":0.252},"max":{"1min":3.2480000000000002,"5min":3.2480000000000002,"15min":3.2480000000000002},"last":0.47799999999999998}]},{"osd":7,"last update":"Fri Oct 8 19:25:23 2021","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.53800000000000003,"15min":0.50900000000000001},"min":{"1min":0.34200000000000003,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":2.2160000000000002,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":1.3480000000000001},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.59199999999999997,"15min":0.56000000000000005},"min":{"1min":0.31900000000000001,"5min":0.313,"15min":0.313},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":0.52300000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574928,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2212000,"kb_used_data":2149272,"kb_used_omap":0,"kb_used_meta":62720,"kb_avail":91533152,"statfs":{"total":95995035648,"available":93729947648,"internally_reserved":0,"allocated":2200854528,"data_stored":2200201688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64225280},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:25:34 2021","interfaces":[{"interface":"back","average":{"1min":4.7130000000000001,"5min":2.7320000000000002,"15min":1.1279999999999999},"min":{"1min":0.20899999999999999,"5min":0.184,"15min":0.184},"max":{"1min":23.956,"5min":98.734999999999999,"15min":98.734999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":4.9630000000000001,"5min":2.706,"15min":1.141},"min":{"1min":0.36099999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":31.422000000000001,"5min":98.843999999999994,"15min":98.843999999999994},"last":5.274}]},{"osd":2,"last update":"Fri Oct 8 19:24:59 2021","interfaces":[{"interface":"back","average":{"1min":6.3029999999999999,"5min":1.5549999999999999,"15min":0.78500000000000003},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":35.124000000000002,"5min":35.124000000000002,"15min":35.124000000000002},"last":0.81399999999999995},{"interface":"front","average":{"1min":5.3639999999999999,"5min":1.4039999999999999,"15min":0.75},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":35.283000000000001,"5min":35.283000000000001,"15min":35.283000000000001},"last":5.2409999999999997}]},{"osd":3,"last update":"Fri Oct 8 19:25:13 2021","interfaces":[{"interface":"back","average":{"1min":6.2969999999999997,"5min":1.661,"15min":0.86799999999999999},"min":{"1min":0.35699999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":34.575000000000003,"5min":34.575000000000003,"15min":34.575000000000003},"last":3.8119999999999998},{"interface":"front","average":{"1min":6.0339999999999998,"5min":1.6000000000000001,"15min":0.84099999999999997},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":35.091000000000001,"5min":35.091000000000001,"15min":35.091000000000001},"last":0.40699999999999997}]},{"osd":4,"last update":"Fri Oct 8 19:25:26 2021","interfaces":[{"interface":"back","average":{"1min":3.9660000000000002,"5min":1.407,"15min":0.81200000000000006},"min":{"1min":0.317,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":15.561999999999999,"5min":16.872,"15min":16.872},"last":2.3149999999999999},{"interface":"front","average":{"1min":1.633,"5min":0.84199999999999997,"15min":0.64000000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":7.3460000000000001,"5min":7.3460000000000001,"15min":7.3460000000000001},"last":0.34799999999999998}]},{"osd":5,"last update":"Fri Oct 8 19:25:47 2021","interfaces":[{"interface":"back","average":{"1min":2.1819999999999999,"5min":1.018,"15min":0.71599999999999997},"min":{"1min":0.33200000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":7.9020000000000001,"5min":7.9020000000000001,"15min":7.9020000000000001},"last":3.7919999999999998},{"interface":"front","average":{"1min":1.7170000000000001,"5min":0.90800000000000003,"15min":0.67500000000000004},"min":{"1min":0.41899999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":7.3719999999999999,"5min":7.3719999999999999,"15min":7.3719999999999999},"last":0.375}]},{"osd":6,"last update":"Fri Oct 8 19:25:04 2021","interfaces":[{"interface":"back","average":{"1min":3.0470000000000002,"5min":1.03,"15min":0.70199999999999996},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":16.815999999999999,"5min":16.815999999999999,"15min":16.815999999999999},"last":2.29},{"interface":"front","average":{"1min":1.589,"5min":0.81999999999999995,"15min":0.72199999999999998},"min":{"1min":0.33800000000000002,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":4.2859999999999996,"5min":4.2859999999999996,"15min":4.2859999999999996},"last":3.7610000000000001}]},{"osd":7,"last update":"Fri Oct 8 19:25:26 2021","interfaces":[{"interface":"back","average":{"1min":2.2959999999999998,"5min":1.1299999999999999,"15min":0.75600000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":7.9580000000000002,"5min":15.384,"15min":15.384},"last":3.8399999999999999},{"interface":"front","average":{"1min":1.673,"5min":0.872,"15min":0.67400000000000004},"min":{"1min":0.34999999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":7.4000000000000004,"5min":7.4000000000000004,"15min":7.4000000000000004},"last":0.42999999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738451,"num_pgs":62,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2421004,"kb_used_data":2351236,"kb_used_omap":0,"kb_used_meta":69568,"kb_avail":91324148,"statfs":{"total":95995035648,"available":93515927552,"internally_reserved":0,"allocated":2407665664,"data_stored":2407033332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":71237632},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 8 19:25:36 2021","interfaces":[{"interface":"back","average":{"1min":2.9630000000000001,"5min":1.1160000000000001,"15min":0.58999999999999997},"min":{"1min":0.26500000000000001,"5min":0.21199999999999999,"15min":0.20599999999999999},"max":{"1min":9.8490000000000002,"5min":9.8490000000000002,"15min":9.8490000000000002},"last":0.33300000000000002},{"interface":"front","average":{"1min":3.8399999999999999,"5min":1.3069999999999999,"15min":0.68000000000000005},"min":{"1min":0.23300000000000001,"5min":0.217,"15min":0.217},"max":{"1min":11.366,"5min":11.366,"15min":11.366},"last":0.29499999999999998}]},{"osd":2,"last update":"Fri Oct 8 19:24:57 2021","interfaces":[{"interface":"back","average":{"1min":3.3359999999999999,"5min":1.5109999999999999,"15min":0.76800000000000002},"min":{"1min":0.30199999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":11.316000000000001,"5min":62.390000000000001,"15min":62.390000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":3.0830000000000002,"5min":1.4750000000000001,"15min":0.75900000000000001},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":13.407999999999999,"5min":62.718000000000004,"15min":62.718000000000004},"last":0.76200000000000001}]},{"osd":3,"last update":"Fri Oct 8 19:25:08 2021","interfaces":[{"interface":"back","average":{"1min":2.7490000000000001,"5min":1.504,"15min":0.83399999999999996},"min":{"1min":0.373,"5min":0.246,"15min":0.246},"max":{"1min":11.340999999999999,"5min":62.491,"15min":62.491},"last":0.59699999999999998},{"interface":"front","average":{"1min":3.6850000000000001,"5min":1.708,"15min":0.879},"min":{"1min":0.30399999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":13.635999999999999,"5min":62.673000000000002,"15min":62.673000000000002},"last":0.78900000000000003}]},{"osd":4,"last update":"Fri Oct 8 19:25:29 2021","interfaces":[{"interface":"back","average":{"1min":2.5099999999999998,"5min":1.0620000000000001,"15min":0.71699999999999997},"min":{"1min":0.44900000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":10.444000000000001,"5min":10.444000000000001,"15min":10.444000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":2.5739999999999998,"5min":1.0600000000000001,"15min":0.74199999999999999},"min":{"1min":0.33900000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":11.294,"5min":11.294,"15min":11.294},"last":0.41099999999999998}]},{"osd":5,"last update":"Fri Oct 8 19:25:45 2021","interfaces":[{"interface":"back","average":{"1min":3.1760000000000002,"5min":1.2569999999999999,"15min":0.78800000000000003},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":15.56,"5min":15.56,"15min":15.56},"last":15.56},{"interface":"front","average":{"1min":2.8530000000000002,"5min":1.181,"15min":0.77300000000000002},"min":{"1min":0.45200000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":15.484999999999999,"5min":15.484999999999999,"15min":15.484999999999999},"last":15.484999999999999}]},{"osd":6,"last update":"Fri Oct 8 19:25:02 2021","interfaces":[{"interface":"back","average":{"1min":2.2080000000000002,"5min":0.91200000000000003,"15min":0.68899999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":11.231999999999999,"5min":11.231999999999999,"15min":11.231999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":2.2290000000000001,"5min":0.92400000000000004,"15min":0.68799999999999994},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":10.519,"5min":10.519,"15min":10.519},"last":0.81200000000000006}]},{"osd":7,"last update":"Fri Oct 8 19:25:18 2021","interfaces":[{"interface":"back","average":{"1min":2.1459999999999999,"5min":0.99199999999999999,"15min":0.70399999999999996},"min":{"1min":0.48499999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":9.3520000000000003,"5min":9.3520000000000003,"15min":9.3520000000000003},"last":0.70099999999999996},{"interface":"front","average":{"1min":3.1179999999999999,"5min":1.22,"15min":0.79000000000000004},"min":{"1min":0.42699999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":11.271000000000001,"5min":11.271000000000001,"15min":11.271000000000001},"last":0.47699999999999998}]}]},{"osd":2,"up_from":18,"seq":77309411403,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2346040,"kb_used_data":2274032,"kb_used_omap":0,"kb_used_meta":72000,"kb_avail":91399112,"statfs":{"total":95995035648,"available":93592690688,"internally_reserved":0,"allocated":2328608768,"data_stored":2327996230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":73728000},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:24:50 2021","interfaces":[{"interface":"back","average":{"1min":4.2709999999999999,"5min":1.125,"15min":0.60499999999999998},"min":{"1min":0.32100000000000001,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":31.376999999999999,"5min":31.376999999999999,"15min":31.376999999999999},"last":61.670999999999999},{"interface":"front","average":{"1min":2.5049999999999999,"5min":0.79600000000000004,"15min":0.503},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":9.3469999999999995,"5min":9.3469999999999995,"15min":9.3469999999999995},"last":65.284999999999997}]},{"osd":1,"last update":"Fri Oct 8 19:24:50 2021","interfaces":[{"interface":"back","average":{"1min":4.1639999999999997,"5min":1.1639999999999999,"15min":0.63},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":31.303999999999998,"5min":31.303999999999998,"15min":31.303999999999998},"last":0.192},{"interface":"front","average":{"1min":4.7169999999999996,"5min":1.2709999999999999,"15min":0.68400000000000005},"min":{"1min":0.22,"5min":0.218,"15min":0.218},"max":{"1min":31.696999999999999,"5min":31.696999999999999,"15min":31.696999999999999},"last":0.21299999999999999}]},{"osd":3,"last update":"Fri Oct 8 19:25:07 2021","interfaces":[{"interface":"back","average":{"1min":3.4279999999999999,"5min":1.089,"15min":0.66500000000000004},"min":{"1min":0.26300000000000001,"5min":0.218,"15min":0.218},"max":{"1min":15.337,"5min":15.337,"15min":15.337},"last":65.322999999999993},{"interface":"front","average":{"1min":3.762,"5min":1.1579999999999999,"15min":0.66600000000000004},"min":{"1min":0.33100000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":9.2899999999999991,"5min":9.2899999999999991,"15min":9.2899999999999991},"last":61.143000000000001}]},{"osd":4,"last update":"Fri Oct 8 19:25:24 2021","interfaces":[{"interface":"back","average":{"1min":2.4740000000000002,"5min":1.048,"15min":0.71899999999999997},"min":{"1min":0.32900000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":6.1920000000000002,"5min":8.0329999999999995,"15min":8.0329999999999995},"last":0.29899999999999999},{"interface":"front","average":{"1min":4.0839999999999996,"5min":1.401,"15min":0.85299999999999998},"min":{"1min":0.34000000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":15.143000000000001,"5min":15.143000000000001,"15min":15.143000000000001},"last":0.377}]},{"osd":5,"last update":"Fri Oct 8 19:25:47 2021","interfaces":[{"interface":"back","average":{"1min":3.399,"5min":1.4830000000000001,"15min":0.88100000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":15.087999999999999,"5min":15.087999999999999,"15min":15.087999999999999},"last":0.33800000000000002},{"interface":"front","average":{"1min":2.3399999999999999,"5min":1.1659999999999999,"15min":0.78000000000000003},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":14.558,"5min":14.558,"15min":14.558},"last":0.27600000000000002}]},{"osd":6,"last update":"Fri Oct 8 19:25:07 2021","interfaces":[{"interface":"back","average":{"1min":2.3109999999999999,"5min":0.98399999999999999,"15min":0.70699999999999996},"min":{"1min":0.38900000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":6.1660000000000004,"5min":8.0050000000000008,"15min":8.0050000000000008},"last":0.33100000000000002},{"interface":"front","average":{"1min":2.1440000000000001,"5min":0.91400000000000003,"15min":0.69799999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":10.406000000000001,"5min":10.406000000000001,"15min":10.406000000000001},"last":0.36799999999999999}]},{"osd":7,"last update":"Fri Oct 8 19:25:24 2021","interfaces":[{"interface":"back","average":{"1min":3.2069999999999999,"5min":1.2150000000000001,"15min":0.78300000000000003},"min":{"1min":0.41799999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":9.3960000000000008,"5min":9.3960000000000008,"15min":9.3960000000000008},"last":0.38600000000000001},{"interface":"front","average":{"1min":2.544,"5min":1.089,"15min":0.76600000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":12.709,"5min":12.709,"15min":12.709},"last":0.41299999999999998}]}]},{"osd":3,"up_from":24,"seq":103079215177,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2920408,"kb_used_data":2831376,"kb_used_omap":0,"kb_used_meta":88896,"kb_avail":90824744,"statfs":{"total":95995035648,"available":93004537856,"internally_reserved":0,"allocated":2899329024,"data_stored":2898684618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":91029504},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:25:12 2021","interfaces":[{"interface":"back","average":{"1min":9.0630000000000006,"5min":2.1429999999999998,"15min":0.94899999999999995},"min":{"1min":0.24199999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":109.601,"5min":109.601,"15min":109.601},"last":4.9249999999999998},{"interface":"front","average":{"1min":9.4019999999999992,"5min":2.3399999999999999,"15min":1.05},"min":{"1min":0.56100000000000005,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":107.84,"5min":107.84,"15min":107.84},"last":0.76000000000000001}]},{"osd":1,"last update":"Fri Oct 8 19:25:12 2021","interfaces":[{"interface":"back","average":{"1min":3.3359999999999999,"5min":1.1100000000000001,"15min":0.64400000000000002},"min":{"1min":0.23699999999999999,"5min":0.219,"15min":0.219},"max":{"1min":11.577999999999999,"5min":11.577999999999999,"15min":11.577999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":3.4620000000000002,"5min":1.091,"15min":0.64000000000000001},"min":{"1min":0.39200000000000002,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":13.372999999999999,"5min":13.372999999999999,"15min":13.372999999999999},"last":4.5720000000000001}]},{"osd":2,"last update":"Fri Oct 8 19:25:12 2021","interfaces":[{"interface":"back","average":{"1min":3.5579999999999998,"5min":1.127,"15min":0.67000000000000004},"min":{"1min":0.29399999999999998,"5min":0.246,"15min":0.246},"max":{"1min":13.333,"5min":13.333,"15min":13.333},"last":8.9789999999999992},{"interface":"front","average":{"1min":3.9820000000000002,"5min":1.145,"15min":0.66800000000000004},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":14.898999999999999,"5min":14.898999999999999,"15min":14.898999999999999},"last":8.8059999999999992}]},{"osd":4,"last update":"Fri Oct 8 19:25:27 2021","interfaces":[{"interface":"back","average":{"1min":2.4009999999999998,"5min":0.94399999999999995,"15min":0.70599999999999996},"min":{"1min":0.42599999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":10.319000000000001,"5min":10.319000000000001,"15min":10.319000000000001},"last":4.6390000000000002},{"interface":"front","average":{"1min":2.8079999999999998,"5min":1.2070000000000001,"15min":0.94199999999999995},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":8.8680000000000003,"5min":8.8680000000000003,"15min":8.8680000000000003},"last":0.73099999999999998}]},{"osd":5,"last update":"Fri Oct 8 19:25:45 2021","interfaces":[{"interface":"back","average":{"1min":3.125,"5min":1.2410000000000001,"15min":0.80700000000000005},"min":{"1min":0.36299999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":13.186,"5min":13.186,"15min":13.186},"last":4.5499999999999998},{"interface":"front","average":{"1min":2.0009999999999999,"5min":1.0489999999999999,"15min":0.83399999999999996},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":10.285,"5min":10.285,"15min":10.285},"last":4.6150000000000002}]},{"osd":6,"last update":"Fri Oct 8 19:25:06 2021","interfaces":[{"interface":"back","average":{"1min":2.6219999999999999,"5min":1.49,"15min":1.671},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":8.8480000000000008,"5min":21.538,"15min":21.538},"last":0.69999999999999996},{"interface":"front","average":{"1min":2.6000000000000001,"5min":1.0169999999999999,"15min":0.71699999999999997},"min":{"1min":0.40000000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":13.298,"5min":13.298,"15min":13.298},"last":4.5279999999999996}]},{"osd":7,"last update":"Fri Oct 8 19:25:27 2021","interfaces":[{"interface":"back","average":{"1min":2.6949999999999998,"5min":1.141,"15min":0.78300000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":8.8350000000000009,"5min":8.8350000000000009,"15min":8.8350000000000009},"last":0.67300000000000004},{"interface":"front","average":{"1min":2.823,"5min":1.1950000000000001,"15min":0.81299999999999994},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":13.225,"5min":13.225,"15min":13.225},"last":4.4960000000000004}]}]},{"osd":4,"up_from":30,"seq":128849018949,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1528468,"kb_used_data":1473292,"kb_used_omap":0,"kb_used_meta":55168,"kb_avail":92216684,"statfs":{"total":95995035648,"available":94429884416,"internally_reserved":0,"allocated":1508651008,"data_stored":1508011221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":56492032},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:25:27 2021","interfaces":[{"interface":"back","average":{"1min":5.4980000000000002,"5min":1.5609999999999999,"15min":0.873},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":59.223999999999997,"5min":59.223999999999997,"15min":59.223999999999997},"last":3.0600000000000001},{"interface":"front","average":{"1min":4.6109999999999998,"5min":1.3440000000000001,"15min":0.79800000000000004},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":58.667999999999999,"5min":58.667999999999999,"15min":58.667999999999999},"last":2.444}]},{"osd":1,"last update":"Fri Oct 8 19:25:27 2021","interfaces":[{"interface":"back","average":{"1min":3.1669999999999998,"5min":1.0629999999999999,"15min":0.70099999999999996},"min":{"1min":0.23899999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":10.039,"5min":10.039,"15min":10.039},"last":0.49199999999999999},{"interface":"front","average":{"1min":1.95,"5min":0.76900000000000002,"15min":0.59499999999999997},"min":{"1min":0.308,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":5.306,"5min":5.306,"15min":5.306},"last":0.25600000000000001}]},{"osd":2,"last update":"Fri Oct 8 19:25:27 2021","interfaces":[{"interface":"back","average":{"1min":2.3570000000000002,"5min":0.90000000000000002,"15min":0.64600000000000002},"min":{"1min":0.36899999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":6.8659999999999997,"5min":6.8659999999999997,"15min":6.8659999999999997},"last":0.374},{"interface":"front","average":{"1min":2.827,"5min":0.98699999999999999,"15min":0.68700000000000006},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":9.7309999999999999,"5min":9.7309999999999999,"15min":9.7309999999999999},"last":3.3650000000000002}]},{"osd":3,"last update":"Fri Oct 8 19:25:27 2021","interfaces":[{"interface":"back","average":{"1min":5.3129999999999997,"5min":1.6080000000000001,"15min":0.88400000000000001},"min":{"1min":0.316,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":58.506999999999998,"5min":58.506999999999998,"15min":58.506999999999998},"last":2.3980000000000001},{"interface":"front","average":{"1min":5.2789999999999999,"5min":1.4730000000000001,"15min":0.84399999999999997},"min":{"1min":0.42699999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":58.521000000000001,"5min":58.521000000000001,"15min":58.521000000000001},"last":2.6699999999999999}]},{"osd":5,"last update":"Fri Oct 8 19:24:46 2021","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.39600000000000002,"15min":0.38100000000000001},"min":{"1min":0.23899999999999999,"5min":0.222,"15min":0.222},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.45100000000000001,"15min":0.40600000000000003},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":2.4689999999999999,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":0.40500000000000003}]},{"osd":6,"last update":"Fri Oct 8 19:25:04 2021","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.501,"15min":0.435},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":3.3079999999999998,"5min":3.3079999999999998,"15min":3.3079999999999998},"last":0.501},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.51900000000000002,"15min":0.45300000000000001},"min":{"1min":0.34499999999999997,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":4.2249999999999996,"5min":4.2249999999999996,"15min":4.2249999999999996},"last":0.58999999999999997}]},{"osd":7,"last update":"Fri Oct 8 19:25:24 2021","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.54600000000000004,"15min":0.504},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":3.0379999999999998,"5min":3.0379999999999998,"15min":3.0379999999999998},"last":0.52600000000000002},{"interface":"front","average":{"1min":1.1399999999999999,"5min":0.66000000000000003,"15min":0.54700000000000004},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":5.0209999999999999,"5min":5.0209999999999999,"15min":5.0209999999999999},"last":0.54200000000000004}]}]},{"osd":5,"up_from":38,"seq":163208757311,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1233212,"kb_used_data":1185012,"kb_used_omap":0,"kb_used_meta":48192,"kb_avail":92511940,"statfs":{"total":95995035648,"available":94732226560,"internally_reserved":0,"allocated":1213452288,"data_stored":1212836423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":49348608},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:25:45 2021","interfaces":[{"interface":"back","average":{"1min":1.6319999999999999,"5min":1.1160000000000001,"15min":0.68600000000000005},"min":{"1min":0.24399999999999999,"5min":0.223,"15min":0.223},"max":{"1min":5.899,"5min":22.966999999999999,"15min":22.966999999999999},"last":2.0379999999999998},{"interface":"front","average":{"1min":1.6359999999999999,"5min":0.80000000000000004,"15min":0.57799999999999996},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":4.3479999999999999,"5min":4.3479999999999999,"15min":4.3479999999999999},"last":0.871}]},{"osd":1,"last update":"Fri Oct 8 19:25:45 2021","interfaces":[{"interface":"back","average":{"1min":1.853,"5min":0.91200000000000003,"15min":0.63800000000000001},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":8.9299999999999997,"5min":8.9299999999999997,"15min":8.9299999999999997},"last":6.0800000000000001},{"interface":"front","average":{"1min":1.831,"5min":0.94499999999999995,"15min":0.65500000000000003},"min":{"1min":0.308,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":8.9199999999999999,"5min":8.9199999999999999,"15min":8.9199999999999999},"last":6.0700000000000003}]},{"osd":2,"last update":"Fri Oct 8 19:25:45 2021","interfaces":[{"interface":"back","average":{"1min":3.7269999999999999,"5min":1.5409999999999999,"15min":0.82299999999999995},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":29.398,"5min":29.398,"15min":29.398},"last":1.8360000000000001},{"interface":"front","average":{"1min":4.9260000000000002,"5min":1.764,"15min":0.92100000000000004},"min":{"1min":0.47499999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":29.387,"5min":29.387,"15min":29.387},"last":1.9259999999999999}]},{"osd":3,"last update":"Fri Oct 8 19:25:45 2021","interfaces":[{"interface":"back","average":{"1min":2.5049999999999999,"5min":1.1850000000000001,"15min":0.72099999999999997},"min":{"1min":0.36899999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":7.1760000000000002,"5min":7.1760000000000002,"15min":7.1760000000000002},"last":4.0490000000000004},{"interface":"front","average":{"1min":1.927,"5min":0.96199999999999997,"15min":0.65000000000000002},"min":{"1min":0.38100000000000001,"5min":0.313,"15min":0.313},"max":{"1min":5.008,"5min":6.9020000000000001,"15min":6.9020000000000001},"last":2.9750000000000001}]},{"osd":4,"last update":"Fri Oct 8 19:25:45 2021","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.504,"15min":0.44},"min":{"1min":0.26600000000000001,"5min":0.224,"15min":0.224},"max":{"1min":3.1150000000000002,"5min":3.6789999999999998,"15min":3.6789999999999998},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53600000000000003,"15min":0.46400000000000002},"min":{"1min":0.28299999999999997,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.994,"5min":3.3999999999999999,"15min":3.3999999999999999},"last":0.34300000000000003}]},{"osd":6,"last update":"Fri Oct 8 19:25:02 2021","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.52200000000000002,"15min":0.47199999999999998},"min":{"1min":0.317,"5min":0.309,"15min":0.309},"max":{"1min":3.3359999999999999,"5min":3.3359999999999999,"15min":3.3359999999999999},"last":0.432},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.56899999999999995,"15min":0.52200000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":5.1580000000000004,"5min":5.1580000000000004,"15min":5.1580000000000004},"last":1.0800000000000001}]},{"osd":7,"last update":"Fri Oct 8 19:25:23 2021","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.54400000000000004,"15min":0.51900000000000002},"min":{"1min":0.33100000000000002,"5min":0.309,"15min":0.309},"max":{"1min":2.3100000000000001,"5min":2.3100000000000001,"15min":2.3100000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.59099999999999997,"15min":0.58099999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":3.4769999999999999,"5min":3.4769999999999999,"15min":3.4769999999999999},"last":0.40400000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":2008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2401439744,"data_stored":2401435672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2190807040,"data_stored":2190802968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2315386880,"data_stored":2315386880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2893152256,"data_stored":2893152256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1501888512,"data_stored":1501888512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1204027392,"data_stored":1204027392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":870977536,"data_stored":870973464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1497563136,"data_stored":1497563136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-10-08T19:25:53.982 INFO:tasks.thrashosds.thrasher:Setting 5.19 to [5, 7, 6, 3, 2, 0] 2021-10-08T19:25:53.982 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '5.19', '5', '7', '6', '3', '2', '0'] 2021-10-08T19:25:53.983 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd pg-upmap-items 5.19 5 7 6 3 2 0 2021-10-08T19:25:54.099 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:25:54.117 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:54.118 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:25:54.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:25:53 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:25:53] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:25:54.219 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:25:54.234 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:25:54.243 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:54.284 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:25:54.298 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:25:54.303 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:54.304 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:25:54.405 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:25:54.437 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:54.496 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:25:54.502 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:54.503 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:25:54.604 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:25:54.630 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:54.695 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:25:54.697 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:54.697 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:25:54.799 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:25:54.881 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:55.116 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:25:55.118 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:55.119 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:25:55.220 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:25:55.323 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:55.435 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:25:55.512 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:25:55.525 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:55.526 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:25:55.576 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:55 smithi097 ceph-mon[32687]: pgmap v201: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 4.2 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 891 op/s; 6917/209397 objects degraded (3.303%); 5344/209397 objects misplaced (2.552%); 2.7 MiB/s, 43 objects/s recovering 2021-10-08T19:25:55.576 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:55 smithi097 ceph-mon[32687]: Health check update: Degraded data redundancy: 6917/209397 objects degraded (3.303%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:25:55.627 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:25:55.654 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:55.714 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:25:55.718 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:55.719 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:25:55.820 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:25:55.846 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:55 smithi117 ceph-mon[34585]: pgmap v201: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 4.2 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 891 op/s; 6917/209397 objects degraded (3.303%); 5344/209397 objects misplaced (2.552%); 2.7 MiB/s, 43 objects/s recovering 2021-10-08T19:25:55.846 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:55 smithi117 ceph-mon[34585]: Health check update: Degraded data redundancy: 6917/209397 objects degraded (3.303%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:25:55.850 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:55.930 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:25:55.933 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:55.933 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:25:55.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:55 smithi097 ceph-mon[41966]: pgmap v201: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 4.2 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 891 op/s; 6917/209397 objects degraded (3.303%); 5344/209397 objects misplaced (2.552%); 2.7 MiB/s, 43 objects/s recovering 2021-10-08T19:25:55.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:55 smithi097 ceph-mon[41966]: Health check update: Degraded data redundancy: 6917/209397 objects degraded (3.303%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:25:56.035 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:25:56.065 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:56.139 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:25:56.144 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:56.145 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:25:56.246 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:25:56.278 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:56.351 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:25:56.357 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:56.358 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:25:56.405 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:25:56 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:25:56.460 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:25:56.501 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:56.575 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:25:56.578 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:56.579 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:25:56.654 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is set 2021-10-08T19:25:56.681 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:25:56.738 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:56.889 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:56 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1748448395' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:25:56.889 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:56 smithi117 ceph-mon[34585]: from='client.24940 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:25:56.974 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:56 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1748448395' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:25:56.974 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:56 smithi097 ceph-mon[32687]: from='client.24940 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:25:56.975 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:56 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1748448395' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:25:56.975 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:56 smithi097 ceph-mon[41966]: from='client.24940 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:25:57.740 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:25:57.746 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:57.747 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:25:57.848 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:25:57.876 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:57 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:25:57.876 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:57 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:25:57.876 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:57 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:25:57.876 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:57 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:25:57.877 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:57 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:25:57.877 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:57 smithi117 ceph-mon[34585]: pgmap v202: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 4.2 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 742 op/s; 6917/209397 objects degraded (3.303%); 5344/209397 objects misplaced (2.552%); 2.3 MiB/s, 36 objects/s recovering 2021-10-08T19:25:57.877 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:57 smithi117 ceph-mon[34585]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:25:57.877 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:57 smithi117 ceph-mon[34585]: from='client.24940 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:25:57.878 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:57 smithi117 ceph-mon[34585]: osdmap e146: 8 total, 8 up, 8 in 2021-10-08T19:25:57.879 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:57.942 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:57 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:25:57.942 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:57 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:25:57.943 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:57 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:25:57.943 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:57 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:25:57.943 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:57 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:25:57.943 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:57 smithi097 ceph-mon[41966]: pgmap v202: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 4.2 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 742 op/s; 6917/209397 objects degraded (3.303%); 5344/209397 objects misplaced (2.552%); 2.3 MiB/s, 36 objects/s recovering 2021-10-08T19:25:57.943 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:57 smithi097 ceph-mon[41966]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:25:57.944 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:57 smithi097 ceph-mon[41966]: from='client.24940 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:25:57.944 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:57 smithi097 ceph-mon[41966]: osdmap e146: 8 total, 8 up, 8 in 2021-10-08T19:25:57.944 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:57 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:25:57.945 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:57 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:25:57.945 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:57 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:25:57.945 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:57 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:25:57.945 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:57 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:25:57.945 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:57 smithi097 ceph-mon[32687]: pgmap v202: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 4.2 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 742 op/s; 6917/209397 objects degraded (3.303%); 5344/209397 objects misplaced (2.552%); 2.3 MiB/s, 36 objects/s recovering 2021-10-08T19:25:57.946 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:57 smithi097 ceph-mon[32687]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:25:57.946 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:57 smithi097 ceph-mon[32687]: from='client.24940 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:25:57.946 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:57 smithi097 ceph-mon[32687]: osdmap e146: 8 total, 8 up, 8 in 2021-10-08T19:25:58.136 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:25:58.144 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:58.145 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:25:58.246 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:25:58.275 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:58.434 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:25:58.438 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:58.439 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:25:58.540 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:25:58.575 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:58.638 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:58 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:25:58.638 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:58 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:25:58.639 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:58 smithi097 ceph-mon[32687]: osdmap e147: 8 total, 8 up, 8 in 2021-10-08T19:25:58.653 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:25:58.656 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:58.657 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:25:58.758 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:25:58.787 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:58 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:25:58.787 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:58 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:25:58.787 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:58 smithi117 ceph-mon[34585]: osdmap e147: 8 total, 8 up, 8 in 2021-10-08T19:25:58.789 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:58.859 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:25:58.864 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:58.865 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:25:58.967 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:25:58.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:58 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:25:58.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:58 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:25:58.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:58 smithi097 ceph-mon[41966]: osdmap e147: 8 total, 8 up, 8 in 2021-10-08T19:25:58.996 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:59.063 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:25:59.066 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:59.067 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:25:59.168 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:25:59.198 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:59.198 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:25:59.199 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:25:59.221 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:25:59.262 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:25:59.267 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:59.268 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:25:59.270 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:25:59.307 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:25:59.353 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:25:59.368 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:25:59.396 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:25:59.432 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:25:59.443 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'false' 2021-10-08T19:25:59.443 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'false' 2021-10-08T19:25:59.443 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'false' 2021-10-08T19:25:59.444 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'false' 2021-10-08T19:25:59.444 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'false' 2021-10-08T19:25:59.444 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'false' 2021-10-08T19:25:59.444 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'false' 2021-10-08T19:25:59.444 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'false' 2021-10-08T19:25:59.445 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:25:59.706 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2021-10-08T19:25:59.706 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:25:59.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:59 smithi097 ceph-mon[41966]: pgmap v205: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 4.2 GiB data, 14 GiB used, 702 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 538 op/s; 7096/207330 objects degraded (3.423%); 5107/207330 objects misplaced (2.463%); 1.8 MiB/s, 29 objects/s recovering 2021-10-08T19:25:59.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:25:59 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3012914350' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:25:59.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:59 smithi097 ceph-mon[32687]: pgmap v205: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 4.2 GiB data, 14 GiB used, 702 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 538 op/s; 7096/207330 objects degraded (3.423%); 5107/207330 objects misplaced (2.463%); 1.8 MiB/s, 29 objects/s recovering 2021-10-08T19:25:59.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:25:59 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3012914350' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:25:59.842 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:25:59.847 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:25:59.848 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:25:59.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:59 smithi117 ceph-mon[34585]: pgmap v205: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 4.2 GiB data, 14 GiB used, 702 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 538 op/s; 7096/207330 objects degraded (3.423%); 5107/207330 objects misplaced (2.463%); 1.8 MiB/s, 29 objects/s recovering 2021-10-08T19:25:59.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:25:59 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3012914350' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:25:59.950 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:25:59.998 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:00.219 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:26:00.222 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:00.223 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:26:00.260 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset noscrub 2021-10-08T19:26:00.324 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:26:00.411 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:00.650 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:00 smithi097 ceph-mon[41966]: Health check update: Degraded data redundancy: 7096/207330 objects degraded (3.423%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:26:00.650 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:00 smithi097 ceph-mon[32687]: Health check update: Degraded data redundancy: 7096/207330 objects degraded (3.423%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:26:00.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:00 smithi117 ceph-mon[34585]: Health check update: Degraded data redundancy: 7096/207330 objects degraded (3.423%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:26:01.101 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:26:01.104 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:01.105 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:26:01.207 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:26:01.217 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2021-10-08T19:26:01.244 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:01.308 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:26:01.311 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:26:01.314 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:01.315 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:26:01.416 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:26:01.455 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:01.516 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:26:01.520 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:01.521 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:26:01.622 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:26:01.657 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:01.719 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:26:01.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:01 smithi097 ceph-mon[32687]: pgmap v206: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 4.0 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 902 op/s; 7271/198582 objects degraded (3.661%); 4816/198582 objects misplaced (2.425%); 2.7 MiB/s, 43 objects/s recovering 2021-10-08T19:26:01.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:01 smithi097 ceph-mon[41966]: pgmap v206: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 4.0 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 902 op/s; 7271/198582 objects degraded (3.661%); 4816/198582 objects misplaced (2.425%); 2.7 MiB/s, 43 objects/s recovering 2021-10-08T19:26:01.722 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:01.723 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:26:01.824 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:26:01.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:01 smithi117 ceph-mon[34585]: pgmap v206: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 4.0 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 902 op/s; 7271/198582 objects degraded (3.661%); 4816/198582 objects misplaced (2.425%); 2.7 MiB/s, 43 objects/s recovering 2021-10-08T19:26:01.928 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:02.028 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:26:02.031 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:02.032 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:26:02.133 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:26:02.165 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:02.281 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:26:02.283 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:02.284 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:26:02.350 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:26:02.385 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:26:02.413 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:02.484 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:26:02.490 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:02.491 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:26:02.592 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:26:02.634 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:02.650 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:26:02 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:26:02] "GET /metrics HTTP/1.1" 200 155723 "" "Prometheus/2.18.1" 2021-10-08T19:26:02.691 INFO:teuthology.orchestra.run.smithi097.stderr:set 5.19 pg_upmap_items mapping to [5->7,6->3,2->0] 2021-10-08T19:26:02.719 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:26:02.723 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:02.724 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:26:02.825 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:26:02.895 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:02.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:02 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2046839795' entity='client.admin' cmd=[{"prefix": "osd pg-upmap-items", "pgid": "5.19", "id": [5, 7, 6, 3, 2, 0]}]: dispatch 2021-10-08T19:26:02.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:02 smithi117 ceph-mon[34585]: from='client.24952 ' entity='client.admin' cmd=[{"prefix": "osd pg-upmap-items", "pgid": "5.19", "id": [5, 7, 6, 3, 2, 0]}]: dispatch 2021-10-08T19:26:02.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:02 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2046839795' entity='client.admin' cmd=[{"prefix": "osd pg-upmap-items", "pgid": "5.19", "id": [5, 7, 6, 3, 2, 0]}]: dispatch 2021-10-08T19:26:02.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:02 smithi097 ceph-mon[41966]: from='client.24952 ' entity='client.admin' cmd=[{"prefix": "osd pg-upmap-items", "pgid": "5.19", "id": [5, 7, 6, 3, 2, 0]}]: dispatch 2021-10-08T19:26:02.978 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:02 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2046839795' entity='client.admin' cmd=[{"prefix": "osd pg-upmap-items", "pgid": "5.19", "id": [5, 7, 6, 3, 2, 0]}]: dispatch 2021-10-08T19:26:02.978 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:02 smithi097 ceph-mon[32687]: from='client.24952 ' entity='client.admin' cmd=[{"prefix": "osd pg-upmap-items", "pgid": "5.19", "id": [5, 7, 6, 3, 2, 0]}]: dispatch 2021-10-08T19:26:03.135 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2021-10-08T19:26:03.560 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:26:03.569 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:03.570 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:26:03.672 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:26:03.738 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:03.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:03 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:26:03.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:03 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:26:03.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:03 smithi097 ceph-mon[41966]: pgmap v207: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 4.0 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 450 op/s; 7271/198582 objects degraded (3.661%); 4816/198582 objects misplaced (2.425%); 1.4 MiB/s, 21 objects/s recovering 2021-10-08T19:26:03.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:03 smithi097 ceph-mon[41966]: from='client.24952 ' entity='client.admin' cmd='[{"prefix": "osd pg-upmap-items", "pgid": "5.19", "id": [5, 7, 6, 3, 2, 0]}]': finished 2021-10-08T19:26:03.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:03 smithi097 ceph-mon[41966]: osdmap e148: 8 total, 8 up, 8 in 2021-10-08T19:26:03.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:03 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:26:03.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:03 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:26:03.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:03 smithi097 ceph-mon[32687]: pgmap v207: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 4.0 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 450 op/s; 7271/198582 objects degraded (3.661%); 4816/198582 objects misplaced (2.425%); 1.4 MiB/s, 21 objects/s recovering 2021-10-08T19:26:03.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:03 smithi097 ceph-mon[32687]: from='client.24952 ' entity='client.admin' cmd='[{"prefix": "osd pg-upmap-items", "pgid": "5.19", "id": [5, 7, 6, 3, 2, 0]}]': finished 2021-10-08T19:26:03.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:03 smithi097 ceph-mon[32687]: osdmap e148: 8 total, 8 up, 8 in 2021-10-08T19:26:04.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:03 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:26:04.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:03 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:26:04.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:03 smithi117 ceph-mon[34585]: pgmap v207: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 4.0 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 450 op/s; 7271/198582 objects degraded (3.661%); 4816/198582 objects misplaced (2.425%); 1.4 MiB/s, 21 objects/s recovering 2021-10-08T19:26:04.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:03 smithi117 ceph-mon[34585]: from='client.24952 ' entity='client.admin' cmd='[{"prefix": "osd pg-upmap-items", "pgid": "5.19", "id": [5, 7, 6, 3, 2, 0]}]': finished 2021-10-08T19:26:04.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:03 smithi117 ceph-mon[34585]: osdmap e148: 8 total, 8 up, 8 in 2021-10-08T19:26:04.158 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:26:03 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:26:03] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:26:04.345 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:26:04.352 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:04.353 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:26:04.454 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:26:04.487 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:04.648 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:26:04.652 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:04.653 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:26:04.754 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:26:04.820 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:04.876 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:26:04.971 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:26:04 smithi097 conmon[33110]: 172.21.15.117 - - [08/Oct/2021:19:26:04] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:26:05.100 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:26:05.107 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:05.108 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:26:05.209 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:26:05.237 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:05.298 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:26:05.302 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:05.303 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:26:05.404 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:26:05.480 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:05.537 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is unset 2021-10-08T19:26:06.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:05 smithi117 ceph-mon[34585]: pgmap v209: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 3.8 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 929 op/s; 7592/187380 objects degraded (4.052%); 4319/187380 objects misplaced (2.305%); 2.8 MiB/s, 44 objects/s recovering 2021-10-08T19:26:06.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:05 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:26:06.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:05 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:26:06.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:05 smithi117 ceph-mon[34585]: 172.21.15.117 - - [08/Oct/2021:19:26:04] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:26:06.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:05 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3285072824' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:26:06.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:05 smithi117 ceph-mon[34585]: from='client.34964 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:26:06.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:05 smithi117 ceph-mon[34585]: Health check update: Degraded data redundancy: 7592/187380 objects degraded (4.052%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:26:06.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:05 smithi117 ceph-mon[34585]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:26:06.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:05 smithi117 ceph-mon[34585]: from='client.34964 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:26:06.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:05 smithi117 ceph-mon[34585]: osdmap e149: 8 total, 8 up, 8 in 2021-10-08T19:26:06.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:05 smithi097 ceph-mon[32687]: pgmap v209: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 3.8 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 929 op/s; 7592/187380 objects degraded (4.052%); 4319/187380 objects misplaced (2.305%); 2.8 MiB/s, 44 objects/s recovering 2021-10-08T19:26:06.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:05 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:26:06.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:05 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:26:06.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:05 smithi097 ceph-mon[32687]: 172.21.15.117 - - [08/Oct/2021:19:26:04] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:26:06.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:05 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3285072824' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:26:06.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:05 smithi097 ceph-mon[32687]: from='client.34964 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:26:06.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:05 smithi097 ceph-mon[32687]: Health check update: Degraded data redundancy: 7592/187380 objects degraded (4.052%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:26:06.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:05 smithi097 ceph-mon[32687]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:26:06.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:05 smithi097 ceph-mon[32687]: from='client.34964 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:26:06.225 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:05 smithi097 ceph-mon[32687]: osdmap e149: 8 total, 8 up, 8 in 2021-10-08T19:26:06.225 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:05 smithi097 ceph-mon[41966]: pgmap v209: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 3.8 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 929 op/s; 7592/187380 objects degraded (4.052%); 4319/187380 objects misplaced (2.305%); 2.8 MiB/s, 44 objects/s recovering 2021-10-08T19:26:06.226 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:05 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:26:06.226 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:05 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:26:06.227 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:05 smithi097 ceph-mon[41966]: 172.21.15.117 - - [08/Oct/2021:19:26:04] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:26:06.227 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:05 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3285072824' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:26:06.227 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:05 smithi097 ceph-mon[41966]: from='client.34964 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:26:06.228 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:05 smithi097 ceph-mon[41966]: Health check update: Degraded data redundancy: 7592/187380 objects degraded (4.052%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:26:06.228 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:05 smithi097 ceph-mon[41966]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:26:06.229 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:05 smithi097 ceph-mon[41966]: from='client.34964 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:26:06.229 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:05 smithi097 ceph-mon[41966]: osdmap e149: 8 total, 8 up, 8 in 2021-10-08T19:26:06.566 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:26:06.570 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:06.570 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:26:06.656 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:26:06 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:26:06.672 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:26:06.740 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:06.930 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:26:06.950 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:06.951 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:26:07.053 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:26:07.079 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:07.137 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:26:07.139 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:07.139 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:26:07.240 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:26:07.269 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:07.333 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2021-10-08T19:26:07.334 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:26:07.336 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:26:07.339 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:07.339 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:26:07.441 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:26:07.499 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:07.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:07 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:26:07.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:07 smithi097 ceph-mon[32687]: pgmap v211: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 3.8 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 831 op/s; 7592/187380 objects degraded (4.052%); 4319/187380 objects misplaced (2.305%); 2.3 MiB/s, 36 objects/s recovering 2021-10-08T19:26:07.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:07 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:26:07.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:07 smithi097 ceph-mon[41966]: pgmap v211: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 3.8 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 831 op/s; 7592/187380 objects degraded (4.052%); 4319/187380 objects misplaced (2.305%); 2.3 MiB/s, 36 objects/s recovering 2021-10-08T19:26:08.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:07 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:26:08.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:07 smithi117 ceph-mon[34585]: pgmap v211: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 3.8 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 831 op/s; 7592/187380 objects degraded (4.052%); 4319/187380 objects misplaced (2.305%); 2.3 MiB/s, 36 objects/s recovering 2021-10-08T19:26:08.841 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset nodeep-scrub 2021-10-08T19:26:09.025 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:26:09.039 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:09.040 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:26:09.073 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2021-10-08T19:26:09.142 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:26:09.241 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:09.432 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:26:09.439 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:09.440 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:26:09.528 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 7, 6] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2021-10-08T19:26:09.528 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2021-10-08T19:26:09.529 INFO:tasks.thrashosds.thrasher:inject_pause on 0 2021-10-08T19:26:09.529 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2021-10-08T19:26:09.529 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2021-10-08T19:26:09.530 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.0 config set filestore_inject_stall 3 2021-10-08T19:26:09.541 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:26:09.568 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:09.622 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:26:09.624 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:09.625 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:26:09.662 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:26:09.726 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:26:09.744 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:26:09.750 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:09.803 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:26:09.805 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:09.806 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:26:09.889 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:26:09.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:09 smithi117 ceph-mon[34585]: pgmap v212: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 3.8 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 560 op/s; 7779/185148 objects degraded (4.202%); 4074/185148 objects misplaced (2.200%); 1.8 MiB/s, 29 objects/s recovering 2021-10-08T19:26:09.907 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:26:09.941 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:26:09.969 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:09.992 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:26:10.023 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:26:10.064 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:26:10.085 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:09 smithi097 ceph-mon[32687]: pgmap v212: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 3.8 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 560 op/s; 7779/185148 objects degraded (4.202%); 4074/185148 objects misplaced (2.200%); 1.8 MiB/s, 29 objects/s recovering 2021-10-08T19:26:10.085 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:09 smithi097 ceph-mon[41966]: pgmap v212: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 3.8 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 560 op/s; 7779/185148 objects degraded (4.202%); 4074/185148 objects misplaced (2.200%); 1.8 MiB/s, 29 objects/s recovering 2021-10-08T19:26:10.109 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:26:10.117 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:26:10.123 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:10.124 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:26:10.156 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:26:10.214 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:26:10.225 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:26:10.233 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true' 2021-10-08T19:26:10.233 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true' 2021-10-08T19:26:10.233 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true' 2021-10-08T19:26:10.234 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true' 2021-10-08T19:26:10.234 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true' 2021-10-08T19:26:10.234 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true' 2021-10-08T19:26:10.234 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'true' 2021-10-08T19:26:10.235 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'true' 2021-10-08T19:26:10.253 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:10.303 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:26:10.305 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:10.306 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:26:10.407 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:26:10.493 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:10.762 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:10 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/388012971' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:26:10.763 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:10 smithi097 ceph-mon[32687]: Health check update: Degraded data redundancy: 7779/185148 objects degraded (4.202%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:26:11.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:10 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/388012971' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:26:11.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:10 smithi117 ceph-mon[34585]: Health check update: Degraded data redundancy: 7779/185148 objects degraded (4.202%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:26:11.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:10 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/388012971' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:26:11.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:10 smithi097 ceph-mon[41966]: Health check update: Degraded data redundancy: 7779/185148 objects degraded (4.202%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:26:11.515 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:26:11.518 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:11.519 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:26:11.620 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:26:11.666 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:11.777 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:11 smithi097 ceph-mon[32687]: pgmap v213: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 3.6 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 958 op/s; 7960/175602 objects degraded (4.533%); 3777/175602 objects misplaced (2.151%); 2.7 MiB/s, 43 objects/s recovering 2021-10-08T19:26:12.107 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:11 smithi097 ceph-mon[41966]: pgmap v213: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 3.6 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 958 op/s; 7960/175602 objects degraded (4.533%); 3777/175602 objects misplaced (2.151%); 2.7 MiB/s, 43 objects/s recovering 2021-10-08T19:26:12.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:11 smithi117 ceph-mon[34585]: pgmap v213: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 3.6 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 958 op/s; 7960/175602 objects degraded (4.533%); 3777/175602 objects misplaced (2.151%); 2.7 MiB/s, 43 objects/s recovering 2021-10-08T19:26:12.393 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:26:12.398 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:12.399 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:26:12.500 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:26:12.522 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:12.578 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:26:12.584 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:12.585 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:26:12.655 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:26:12 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:26:12] "GET /metrics HTTP/1.1" 200 155740 "" "Prometheus/2.18.1" 2021-10-08T19:26:12.687 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:26:12.720 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:12.787 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:26:12.791 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:12.792 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:26:12.810 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:26:12.893 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:26:12.929 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:12.995 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:26:12.997 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:12.999 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:26:13.100 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:26:13.128 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:13.182 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:26:13.184 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:13.184 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:26:13.286 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:26:13.337 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:13.617 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:26:13.629 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:13.629 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:26:13.731 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:26:13.799 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:14.108 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2021-10-08T19:26:14.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:26:13 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:26:13] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:26:14.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:13 smithi117 ceph-mon[34585]: pgmap v214: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 3.6 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 778 op/s; 7960/175602 objects degraded (4.533%); 3777/175602 objects misplaced (2.151%); 2.2 MiB/s, 35 objects/s recovering 2021-10-08T19:26:14.183 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:13 smithi097 ceph-mon[32687]: pgmap v214: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 3.6 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 778 op/s; 7960/175602 objects degraded (4.533%); 3777/175602 objects misplaced (2.151%); 2.2 MiB/s, 35 objects/s recovering 2021-10-08T19:26:14.184 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:13 smithi097 ceph-mon[41966]: pgmap v214: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 3.6 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 778 op/s; 7960/175602 objects degraded (4.533%); 3777/175602 objects misplaced (2.151%); 2.2 MiB/s, 35 objects/s recovering 2021-10-08T19:26:14.671 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:26:14.678 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:14.679 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:26:14.780 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:26:14.820 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:14.826 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is unset 2021-10-08T19:26:14.880 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:26:14.884 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:14.885 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:26:14.969 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:14 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/97306901' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:26:14.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:14 smithi097 ceph-mon[41966]: from='client.24961 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:26:14.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:14 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/97306901' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:26:14.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:14 smithi097 ceph-mon[32687]: from='client.24961 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:26:14.986 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:26:15.061 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:15.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:14 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/97306901' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:26:15.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:14 smithi117 ceph-mon[34585]: from='client.24961 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:26:15.162 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:26:15.163 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2021-10-08T19:26:15.164 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2021-10-08T19:26:15.164 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2021-10-08T19:26:15.165 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.165 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:35708 7.6 7:6ac91e09:::benchmark_data_smithi097_93198_object35707:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106)", 2021-10-08T19:26:15.165 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:12.260446+0000", 2021-10-08T19:26:15.166 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 121.936626377, 2021-10-08T19:26:15.166 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.141301706, 2021-10-08T19:26:15.167 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:15.167 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:26:15.168 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:26:15.168 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:26:15.168 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:26:15.168 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 35708 2021-10-08T19:26:15.168 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.169 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:15.169 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.169 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:15.169 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.260446+0000", 2021-10-08T19:26:15.170 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:15.170 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.170 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.170 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:15.170 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.260446+0000", 2021-10-08T19:26:15.171 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:15.171 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.171 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.171 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:15.172 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.260444+0000", 2021-10-08T19:26:15.172 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:26:15.172 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.173 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.173 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:15.173 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.260478+0000", 2021-10-08T19:26:15.173 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4270000000000002e-05 2021-10-08T19:26:15.174 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.174 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.174 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:15.174 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.260491+0000", 2021-10-08T19:26:15.174 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2977e-05 2021-10-08T19:26:15.175 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.175 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.175 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:15.176 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.260498+0000", 2021-10-08T19:26:15.176 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.764e-06 2021-10-08T19:26:15.176 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.177 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.177 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:15.177 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.260540+0000", 2021-10-08T19:26:15.178 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1520000000000002e-05 2021-10-08T19:26:15.178 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.178 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.178 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:15.178 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.260663+0000", 2021-10-08T19:26:15.179 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012287600000000001 2021-10-08T19:26:15.179 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.179 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.180 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,7", 2021-10-08T19:26:15.180 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.260802+0000", 2021-10-08T19:26:15.181 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013916699999999999 2021-10-08T19:26:15.181 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.182 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.182 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:26:15.182 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.263853+0000", 2021-10-08T19:26:15.182 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030514489999999999 2021-10-08T19:26:15.183 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.183 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.183 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:15.183 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.264169+0000", 2021-10-08T19:26:15.184 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031615300000000001 2021-10-08T19:26:15.184 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.184 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.184 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:15.184 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.401662+0000", 2021-10-08T19:26:15.185 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.13749296 2021-10-08T19:26:15.185 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.185 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.185 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:26:15.186 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.401711+0000", 2021-10-08T19:26:15.186 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8871e-05 2021-10-08T19:26:15.187 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.187 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.187 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:15.188 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.401748+0000", 2021-10-08T19:26:15.188 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6979e-05 2021-10-08T19:26:15.189 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:15.189 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:15.189 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:15.190 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.190 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.191 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:35713 7.6 7:640478e8:::benchmark_data_smithi097_93198_object35712:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106)", 2021-10-08T19:26:15.191 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:12.264903+0000", 2021-10-08T19:26:15.192 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 121.932170103, 2021-10-08T19:26:15.192 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.13701453799999999, 2021-10-08T19:26:15.192 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:15.193 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:26:15.193 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:26:15.194 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:26:15.194 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:26:15.195 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 35713 2021-10-08T19:26:15.195 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.196 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:15.196 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.196 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:15.197 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.264903+0000", 2021-10-08T19:26:15.197 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:15.198 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.198 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.199 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:15.199 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.264903+0000", 2021-10-08T19:26:15.200 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:15.200 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.200 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.201 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:15.201 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.264900+0000", 2021-10-08T19:26:15.202 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:26:15.202 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.203 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.203 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:15.204 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.264927+0000", 2021-10-08T19:26:15.204 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6295000000000002e-05 2021-10-08T19:26:15.204 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.205 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.205 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:15.206 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.264941+0000", 2021-10-08T19:26:15.206 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3959e-05 2021-10-08T19:26:15.207 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.207 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.207 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:15.208 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.264948+0000", 2021-10-08T19:26:15.208 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1790000000000002e-06 2021-10-08T19:26:15.209 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.209 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.209 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:15.209 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.265003+0000", 2021-10-08T19:26:15.210 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4846000000000003e-05 2021-10-08T19:26:15.210 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.210 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.211 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:15.211 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.265136+0000", 2021-10-08T19:26:15.211 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013353799999999999 2021-10-08T19:26:15.212 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.212 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.212 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,7", 2021-10-08T19:26:15.213 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.265239+0000", 2021-10-08T19:26:15.213 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000102397 2021-10-08T19:26:15.213 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.214 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.214 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:15.214 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.266455+0000", 2021-10-08T19:26:15.214 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001215998 2021-10-08T19:26:15.215 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.215 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.215 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:26:15.216 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.267180+0000", 2021-10-08T19:26:15.216 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00072546500000000001 2021-10-08T19:26:15.216 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.217 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.217 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:15.217 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.401838+0000", 2021-10-08T19:26:15.218 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.13465750600000001 2021-10-08T19:26:15.218 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.218 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.219 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:26:15.219 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.401883+0000", 2021-10-08T19:26:15.220 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5837000000000002e-05 2021-10-08T19:26:15.220 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.221 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.221 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:15.222 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.401917+0000", 2021-10-08T19:26:15.222 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.383e-05 2021-10-08T19:26:15.222 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:15.223 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:15.223 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:15.224 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.224 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.225 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:35715 7.7 7:ee362972:::benchmark_data_smithi097_93198_object35714:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106)", 2021-10-08T19:26:15.225 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:12.265063+0000", 2021-10-08T19:26:15.226 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 121.932009616, 2021-10-08T19:26:15.226 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.13572060399999999, 2021-10-08T19:26:15.227 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:15.227 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:26:15.228 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:26:15.228 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:26:15.228 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:26:15.229 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 35715 2021-10-08T19:26:15.229 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.229 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:15.229 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.230 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:15.230 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.265063+0000", 2021-10-08T19:26:15.230 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:15.230 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.231 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.231 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:15.231 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.265063+0000", 2021-10-08T19:26:15.231 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:15.232 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.232 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.232 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:15.232 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.265062+0000", 2021-10-08T19:26:15.232 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:26:15.233 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.233 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.233 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:15.233 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.265083+0000", 2021-10-08T19:26:15.234 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0812e-05 2021-10-08T19:26:15.234 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.234 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.234 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:15.234 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.265109+0000", 2021-10-08T19:26:15.235 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6117000000000001e-05 2021-10-08T19:26:15.235 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.235 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.235 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:15.236 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.265114+0000", 2021-10-08T19:26:15.236 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.164e-06 2021-10-08T19:26:15.236 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.236 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.236 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:15.237 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.265155+0000", 2021-10-08T19:26:15.237 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0988000000000001e-05 2021-10-08T19:26:15.237 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.237 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.237 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:15.238 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.265265+0000", 2021-10-08T19:26:15.238 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000110004 2021-10-08T19:26:15.238 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.238 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.239 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,3", 2021-10-08T19:26:15.239 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.265452+0000", 2021-10-08T19:26:15.239 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000186417 2021-10-08T19:26:15.239 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.239 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.240 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:26:15.240 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.267240+0000", 2021-10-08T19:26:15.240 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001787949 2021-10-08T19:26:15.240 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.241 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.241 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:15.241 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.268428+0000", 2021-10-08T19:26:15.241 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011888389999999999 2021-10-08T19:26:15.241 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.242 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.242 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:15.242 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.400614+0000", 2021-10-08T19:26:15.242 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.13218572200000001 2021-10-08T19:26:15.243 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.243 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.243 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:26:15.243 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.400724+0000", 2021-10-08T19:26:15.243 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010977 2021-10-08T19:26:15.244 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.244 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.244 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:15.245 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.400784+0000", 2021-10-08T19:26:15.245 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9861000000000002e-05 2021-10-08T19:26:15.245 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:15.245 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:15.246 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:15.246 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.246 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.246 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:40656 7.6 7:6aba536b:::benchmark_data_smithi097_93198_object40655:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2021-10-08T19:26:15.246 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:16.254829+0000", 2021-10-08T19:26:15.247 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 117.94224354799999, 2021-10-08T19:26:15.247 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.12507105700000001, 2021-10-08T19:26:15.247 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:15.247 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:26:15.248 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:26:15.248 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:26:15.248 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:26:15.248 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 40656 2021-10-08T19:26:15.249 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.249 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:15.249 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.249 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:15.249 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.254829+0000", 2021-10-08T19:26:15.250 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:15.250 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.250 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.250 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:15.251 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.254829+0000", 2021-10-08T19:26:15.251 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:15.251 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.251 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.251 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:15.252 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.254826+0000", 2021-10-08T19:26:15.252 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2021-10-08T19:26:15.252 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.252 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.253 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:15.253 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.254858+0000", 2021-10-08T19:26:15.253 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1693999999999998e-05 2021-10-08T19:26:15.253 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.254 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.254 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:15.254 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.254868+0000", 2021-10-08T19:26:15.254 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0205e-05 2021-10-08T19:26:15.254 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.255 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.255 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:15.255 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.254880+0000", 2021-10-08T19:26:15.255 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.184e-05 2021-10-08T19:26:15.255 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.256 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.256 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:15.256 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.254922+0000", 2021-10-08T19:26:15.256 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1866000000000002e-05 2021-10-08T19:26:15.257 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.257 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.257 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:15.257 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.375910+0000", 2021-10-08T19:26:15.257 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.120988255 2021-10-08T19:26:15.258 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.258 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.258 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,7", 2021-10-08T19:26:15.258 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.376081+0000", 2021-10-08T19:26:15.258 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000170858 2021-10-08T19:26:15.259 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.259 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.259 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:15.259 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.378202+0000", 2021-10-08T19:26:15.260 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021210030000000002 2021-10-08T19:26:15.260 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.260 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.260 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:15.260 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.379793+0000", 2021-10-08T19:26:15.261 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001590986 2021-10-08T19:26:15.261 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.261 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.261 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:26:15.261 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.379814+0000", 2021-10-08T19:26:15.262 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0757000000000001e-05 2021-10-08T19:26:15.262 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.262 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.262 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:26:15.263 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.379861+0000", 2021-10-08T19:26:15.263 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7021000000000003e-05 2021-10-08T19:26:15.263 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.263 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.263 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:15.264 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.379900+0000", 2021-10-08T19:26:15.264 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9629000000000003e-05 2021-10-08T19:26:15.264 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:15.264 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:15.264 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:15.265 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.265 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.265 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:40662 7.4 7:26a4800c:::benchmark_data_smithi097_93198_object40661:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2021-10-08T19:26:15.265 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:16.254893+0000", 2021-10-08T19:26:15.265 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 117.942179791, 2021-10-08T19:26:15.266 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.12644208000000001, 2021-10-08T19:26:15.266 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:15.266 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:26:15.266 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:26:15.267 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:26:15.267 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:26:15.267 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 40662 2021-10-08T19:26:15.267 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.267 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:15.268 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.268 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:15.268 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.254893+0000", 2021-10-08T19:26:15.268 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:15.269 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.269 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.269 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:15.269 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.254893+0000", 2021-10-08T19:26:15.269 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:15.270 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.270 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.270 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:15.270 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.254892+0000", 2021-10-08T19:26:15.271 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:26:15.271 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.271 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.271 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:15.271 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.254917+0000", 2021-10-08T19:26:15.272 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5041e-05 2021-10-08T19:26:15.272 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.272 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.272 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:15.273 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.254923+0000", 2021-10-08T19:26:15.273 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6030000000000004e-06 2021-10-08T19:26:15.273 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.273 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.273 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:15.274 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.254926+0000", 2021-10-08T19:26:15.274 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2260000000000001e-06 2021-10-08T19:26:15.274 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.274 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.275 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:15.275 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.254968+0000", 2021-10-08T19:26:15.275 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2449e-05 2021-10-08T19:26:15.275 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.275 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.276 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:15.276 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.375953+0000", 2021-10-08T19:26:15.276 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.120985252 2021-10-08T19:26:15.276 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.277 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.277 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:26:15.277 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.376111+0000", 2021-10-08T19:26:15.277 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015787 2021-10-08T19:26:15.277 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.278 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.278 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:15.278 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.381195+0000", 2021-10-08T19:26:15.278 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0050840420000000004 2021-10-08T19:26:15.279 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.279 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.279 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:26:15.279 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.381203+0000", 2021-10-08T19:26:15.279 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2139999999999999e-06 2021-10-08T19:26:15.280 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.280 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.280 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:15.280 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.381240+0000", 2021-10-08T19:26:15.280 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7342000000000003e-05 2021-10-08T19:26:15.281 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.281 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.281 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:26:15.281 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.381298+0000", 2021-10-08T19:26:15.281 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7800999999999998e-05 2021-10-08T19:26:15.282 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.282 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.282 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:15.282 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.381335+0000", 2021-10-08T19:26:15.283 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7348999999999998e-05 2021-10-08T19:26:15.283 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:15.283 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:15.283 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:15.283 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.284 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.284 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:40663 7.4 7:2fc8b992:::benchmark_data_smithi097_93198_object40662:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2021-10-08T19:26:15.284 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:16.254934+0000", 2021-10-08T19:26:15.284 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 117.942138891, 2021-10-08T19:26:15.284 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.129795831, 2021-10-08T19:26:15.285 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:15.285 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:26:15.285 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:26:15.285 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:26:15.286 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:26:15.286 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 40663 2021-10-08T19:26:15.286 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.286 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:15.286 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.287 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:15.287 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.254934+0000", 2021-10-08T19:26:15.287 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:15.287 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.287 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.288 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:15.288 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.254934+0000", 2021-10-08T19:26:15.288 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:15.288 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.288 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.289 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:15.289 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.254933+0000", 2021-10-08T19:26:15.289 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:26:15.289 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.290 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.290 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:15.290 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.254951+0000", 2021-10-08T19:26:15.290 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8301999999999999e-05 2021-10-08T19:26:15.290 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.291 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.291 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:15.291 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.254957+0000", 2021-10-08T19:26:15.291 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4659999999999998e-06 2021-10-08T19:26:15.291 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.292 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.292 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:15.292 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.254961+0000", 2021-10-08T19:26:15.292 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8020000000000002e-06 2021-10-08T19:26:15.293 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.293 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.293 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:15.293 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.377575+0000", 2021-10-08T19:26:15.293 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.12261453 2021-10-08T19:26:15.294 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.294 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.294 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:15.294 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.377689+0000", 2021-10-08T19:26:15.294 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000113402 2021-10-08T19:26:15.295 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.295 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.295 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:26:15.295 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.378185+0000", 2021-10-08T19:26:15.296 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00049599300000000002 2021-10-08T19:26:15.296 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.296 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.296 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:26:15.296 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.381208+0000", 2021-10-08T19:26:15.297 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030229559999999998 2021-10-08T19:26:15.297 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.297 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.297 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:15.297 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.381372+0000", 2021-10-08T19:26:15.298 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000164864 2021-10-08T19:26:15.298 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.298 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.298 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:15.299 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.384656+0000", 2021-10-08T19:26:15.299 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003284113 2021-10-08T19:26:15.299 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.299 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.299 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:26:15.300 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.384697+0000", 2021-10-08T19:26:15.300 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0151000000000002e-05 2021-10-08T19:26:15.300 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.300 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.301 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:15.301 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.384730+0000", 2021-10-08T19:26:15.301 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3101e-05 2021-10-08T19:26:15.301 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:15.301 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:15.302 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:15.302 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.302 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.302 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:40664 7.f 7:f1d08321:::benchmark_data_smithi097_93198_object40663:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2021-10-08T19:26:15.302 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:16.254967+0000", 2021-10-08T19:26:15.303 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 117.94210597599999, 2021-10-08T19:26:15.303 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.132005179, 2021-10-08T19:26:15.303 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:15.303 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:26:15.304 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:26:15.304 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:26:15.304 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:26:15.304 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 40664 2021-10-08T19:26:15.304 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.305 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:15.305 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.305 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:15.305 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.254967+0000", 2021-10-08T19:26:15.305 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:15.306 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.306 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.306 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:15.306 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.254967+0000", 2021-10-08T19:26:15.306 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:15.307 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.307 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.307 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:15.307 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.254966+0000", 2021-10-08T19:26:15.308 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2021-10-08T19:26:15.308 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.308 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.308 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:15.308 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.254985+0000", 2021-10-08T19:26:15.309 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.844e-05 2021-10-08T19:26:15.309 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.309 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.309 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:15.309 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.254988+0000", 2021-10-08T19:26:15.310 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7790000000000002e-06 2021-10-08T19:26:15.310 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.310 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.310 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:15.311 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.254991+0000", 2021-10-08T19:26:15.311 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.429e-06 2021-10-08T19:26:15.311 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.311 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.311 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:15.312 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.255022+0000", 2021-10-08T19:26:15.312 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1301999999999999e-05 2021-10-08T19:26:15.312 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.312 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.312 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:15.313 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.376014+0000", 2021-10-08T19:26:15.313 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.120991637 2021-10-08T19:26:15.313 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.313 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.314 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,7", 2021-10-08T19:26:15.314 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.376159+0000", 2021-10-08T19:26:15.314 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014574999999999999 2021-10-08T19:26:15.314 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.314 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.315 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:15.315 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.379222+0000", 2021-10-08T19:26:15.315 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030627850000000002 2021-10-08T19:26:15.315 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.315 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.316 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:26:15.316 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.379805+0000", 2021-10-08T19:26:15.316 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00058260600000000005 2021-10-08T19:26:15.316 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.317 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.317 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:15.317 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.386891+0000", 2021-10-08T19:26:15.317 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0070862010000000003 2021-10-08T19:26:15.317 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.318 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.318 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:26:15.318 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.386935+0000", 2021-10-08T19:26:15.318 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3993999999999999e-05 2021-10-08T19:26:15.318 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.319 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.319 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:15.319 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.386972+0000", 2021-10-08T19:26:15.319 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.693e-05 2021-10-08T19:26:15.320 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:15.320 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:15.320 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:15.320 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.320 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.321 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:40665 7.4 7:218a9120:::benchmark_data_smithi097_93198_object40664:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2021-10-08T19:26:15.321 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:16.254998+0000", 2021-10-08T19:26:15.321 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 117.942074531, 2021-10-08T19:26:15.321 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.131552102, 2021-10-08T19:26:15.321 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:15.322 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:26:15.322 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:26:15.322 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:26:15.322 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:26:15.322 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 40665 2021-10-08T19:26:15.323 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.323 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:15.323 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.323 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:15.324 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.254998+0000", 2021-10-08T19:26:15.324 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:15.324 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.324 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.324 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:15.325 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.254998+0000", 2021-10-08T19:26:15.325 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:15.325 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.325 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.325 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:15.326 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.254998+0000", 2021-10-08T19:26:15.326 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:26:15.326 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.326 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.327 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:15.327 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.255017+0000", 2021-10-08T19:26:15.327 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9074000000000001e-05 2021-10-08T19:26:15.327 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.327 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.328 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:15.328 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.255022+0000", 2021-10-08T19:26:15.328 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3720000000000004e-06 2021-10-08T19:26:15.328 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.328 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.329 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:15.329 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.255026+0000", 2021-10-08T19:26:15.329 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7960000000000002e-06 2021-10-08T19:26:15.329 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.330 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.330 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:15.330 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.379544+0000", 2021-10-08T19:26:15.330 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.12451825699999999 2021-10-08T19:26:15.330 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.331 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.331 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:15.331 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.379654+0000", 2021-10-08T19:26:15.331 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011010600000000001 2021-10-08T19:26:15.332 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.332 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.332 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:26:15.332 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.379800+0000", 2021-10-08T19:26:15.332 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014584799999999999 2021-10-08T19:26:15.333 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.333 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.333 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:15.333 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.381407+0000", 2021-10-08T19:26:15.334 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001606878 2021-10-08T19:26:15.334 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.334 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.334 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:26:15.334 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.384739+0000", 2021-10-08T19:26:15.335 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033323269999999999 2021-10-08T19:26:15.335 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.335 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.335 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:15.335 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.386467+0000", 2021-10-08T19:26:15.336 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017278479999999999 2021-10-08T19:26:15.336 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.336 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.336 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:26:15.336 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.386514+0000", 2021-10-08T19:26:15.337 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7110000000000001e-05 2021-10-08T19:26:15.337 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.337 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.337 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:15.338 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.386550+0000", 2021-10-08T19:26:15.338 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6217999999999998e-05 2021-10-08T19:26:15.338 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:15.338 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:15.338 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:15.339 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.339 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.339 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.24796.0:40670 7.e e110/94 7:79f4d2b7:::benchmark_data_smithi097_93198_object40669:head v 110'2575, mlcod=110'2573)", 2021-10-08T19:26:15.339 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:16.259049+0000", 2021-10-08T19:26:15.340 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 117.938023376, 2021-10-08T19:26:15.340 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.120876381, 2021-10-08T19:26:15.340 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:15.340 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:26:15.340 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:15.341 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.341 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:15.341 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.259049+0000", 2021-10-08T19:26:15.341 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:15.342 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.342 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.342 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:15.342 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.259049+0000", 2021-10-08T19:26:15.342 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:15.343 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.343 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.343 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:15.343 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.259047+0000", 2021-10-08T19:26:15.344 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:26:15.344 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.344 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.344 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:15.344 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.259075+0000", 2021-10-08T19:26:15.345 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8068e-05 2021-10-08T19:26:15.345 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.345 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.345 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:15.345 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.375861+0000", 2021-10-08T19:26:15.346 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.116785476 2021-10-08T19:26:15.346 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.346 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.346 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:15.347 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.375873+0000", 2021-10-08T19:26:15.347 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1907e-05 2021-10-08T19:26:15.347 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.347 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.347 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:15.348 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.376049+0000", 2021-10-08T19:26:15.348 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000176248 2021-10-08T19:26:15.348 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.348 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.348 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:15.349 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.376066+0000", 2021-10-08T19:26:15.349 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7394999999999999e-05 2021-10-08T19:26:15.349 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.349 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.350 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:26:15.350 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.379904+0000", 2021-10-08T19:26:15.350 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038374540000000001 2021-10-08T19:26:15.350 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.350 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.351 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:15.351 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.379926+0000", 2021-10-08T19:26:15.351 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1889e-05 2021-10-08T19:26:15.351 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:15.352 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:15.352 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:15.352 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.352 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.352 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:52194 7.7 7:e31a8c5e:::benchmark_data_smithi097_93198_object52193:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117)", 2021-10-08T19:26:15.353 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:30.382807+0000", 2021-10-08T19:26:15.353 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 103.814266225, 2021-10-08T19:26:15.353 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.12753968099999999, 2021-10-08T19:26:15.353 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:15.354 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:26:15.354 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:26:15.354 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:26:15.354 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:26:15.354 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 52194 2021-10-08T19:26:15.355 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.355 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:15.355 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.355 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:15.355 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:30.382807+0000", 2021-10-08T19:26:15.356 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:15.356 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.356 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.356 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:15.357 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:30.382807+0000", 2021-10-08T19:26:15.357 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:15.357 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.357 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.357 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:15.358 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:30.382806+0000", 2021-10-08T19:26:15.358 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:26:15.358 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.358 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.358 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:15.359 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:30.382824+0000", 2021-10-08T19:26:15.359 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.84e-05 2021-10-08T19:26:15.359 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.359 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.360 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:15.360 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:30.382831+0000", 2021-10-08T19:26:15.360 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5690000000000001e-06 2021-10-08T19:26:15.360 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.360 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.361 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:15.361 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:30.382835+0000", 2021-10-08T19:26:15.361 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1520000000000002e-06 2021-10-08T19:26:15.361 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.362 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.362 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:15.362 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:30.384416+0000", 2021-10-08T19:26:15.362 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001581275 2021-10-08T19:26:15.362 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.363 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.363 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:15.363 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:30.384560+0000", 2021-10-08T19:26:15.363 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014375600000000001 2021-10-08T19:26:15.364 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.364 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.364 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,6", 2021-10-08T19:26:15.364 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:30.384777+0000", 2021-10-08T19:26:15.364 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021683499999999999 2021-10-08T19:26:15.365 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.365 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.365 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:26:15.365 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:30.392850+0000", 2021-10-08T19:26:15.365 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0080729419999999996 2021-10-08T19:26:15.366 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.366 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.366 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:15.366 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:30.399636+0000", 2021-10-08T19:26:15.366 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0067866699999999999 2021-10-08T19:26:15.367 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.367 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.367 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:15.367 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:30.414017+0000", 2021-10-08T19:26:15.368 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.014380698000000001 2021-10-08T19:26:15.368 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.368 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.368 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:26:15.368 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:30.414068+0000", 2021-10-08T19:26:15.369 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0890000000000002e-05 2021-10-08T19:26:15.369 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.369 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.369 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:15.369 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:30.510346+0000", 2021-10-08T19:26:15.370 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.096278310000000006 2021-10-08T19:26:15.370 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:15.370 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:15.370 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:15.371 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.371 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.371 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:52212 7.f 7:f5357986:::benchmark_data_smithi097_93198_object52211:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117)", 2021-10-08T19:26:15.371 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:30.400726+0000", 2021-10-08T19:26:15.371 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 103.796346343, 2021-10-08T19:26:15.372 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.12583455199999999, 2021-10-08T19:26:15.372 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:15.372 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:26:15.372 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:26:15.372 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:26:15.373 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:26:15.373 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 52212 2021-10-08T19:26:15.373 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.373 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:15.374 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.374 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:15.374 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:30.400726+0000", 2021-10-08T19:26:15.374 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:15.374 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.375 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.375 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:15.375 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:30.400726+0000", 2021-10-08T19:26:15.375 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:15.375 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.376 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.376 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:15.376 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:30.400726+0000", 2021-10-08T19:26:15.376 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:26:15.377 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.377 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.377 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:15.377 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:30.400747+0000", 2021-10-08T19:26:15.377 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1582000000000001e-05 2021-10-08T19:26:15.378 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.378 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.378 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:15.378 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:30.400753+0000", 2021-10-08T19:26:15.378 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0100000000000001e-06 2021-10-08T19:26:15.379 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.379 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.379 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:15.379 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:30.400758+0000", 2021-10-08T19:26:15.379 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5240000000000002e-06 2021-10-08T19:26:15.380 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.380 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.380 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:15.380 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:30.510425+0000", 2021-10-08T19:26:15.381 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.10966769699999999 2021-10-08T19:26:15.381 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.381 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.381 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:15.381 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:30.510539+0000", 2021-10-08T19:26:15.382 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000113579 2021-10-08T19:26:15.382 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.382 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.382 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,7", 2021-10-08T19:26:15.382 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:30.510686+0000", 2021-10-08T19:26:15.383 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014667900000000001 2021-10-08T19:26:15.383 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.383 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.383 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:15.383 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:30.522263+0000", 2021-10-08T19:26:15.384 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011577656 2021-10-08T19:26:15.384 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.384 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.384 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:26:15.385 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:30.522304+0000", 2021-10-08T19:26:15.385 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0164999999999999e-05 2021-10-08T19:26:15.385 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.385 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.385 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:15.386 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:30.526477+0000", 2021-10-08T19:26:15.386 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0041731980000000004 2021-10-08T19:26:15.386 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.386 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.387 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:26:15.387 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:30.526524+0000", 2021-10-08T19:26:15.387 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6838000000000001e-05 2021-10-08T19:26:15.387 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.387 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.388 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:15.388 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:30.526561+0000", 2021-10-08T19:26:15.388 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7397000000000001e-05 2021-10-08T19:26:15.388 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:15.389 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:15.389 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:15.389 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.389 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.389 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:58798 7.4 7:25a383b0:::benchmark_data_smithi097_93198_object58797:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2021-10-08T19:26:15.390 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:38.366201+0000", 2021-10-08T19:26:15.390 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 95.830871833000003, 2021-10-08T19:26:15.390 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.199486627, 2021-10-08T19:26:15.390 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:15.391 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:26:15.391 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:26:15.391 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:26:15.391 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:26:15.391 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 58798 2021-10-08T19:26:15.392 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.392 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:15.392 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.392 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:15.393 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366201+0000", 2021-10-08T19:26:15.393 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:15.393 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.393 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.393 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:15.394 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366201+0000", 2021-10-08T19:26:15.394 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:15.394 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.394 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.395 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:15.395 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366199+0000", 2021-10-08T19:26:15.395 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:26:15.395 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.395 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.396 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:15.396 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366227+0000", 2021-10-08T19:26:15.396 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8860000000000002e-05 2021-10-08T19:26:15.396 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.397 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.397 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:15.397 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366240+0000", 2021-10-08T19:26:15.397 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2388000000000001e-05 2021-10-08T19:26:15.397 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.398 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.398 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:15.398 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366246+0000", 2021-10-08T19:26:15.398 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3339999999999998e-06 2021-10-08T19:26:15.398 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.399 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.399 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:15.399 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366332+0000", 2021-10-08T19:26:15.399 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6215e-05 2021-10-08T19:26:15.400 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.400 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.400 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:15.400 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366501+0000", 2021-10-08T19:26:15.400 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000168875 2021-10-08T19:26:15.401 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.401 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.401 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:26:15.401 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366701+0000", 2021-10-08T19:26:15.401 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000199774 2021-10-08T19:26:15.402 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.402 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.402 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:26:15.402 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.371460+0000", 2021-10-08T19:26:15.403 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0047593369999999998 2021-10-08T19:26:15.403 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.403 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.403 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:15.403 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.371901+0000", 2021-10-08T19:26:15.404 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00044059200000000001 2021-10-08T19:26:15.404 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.404 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.404 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:15.404 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.565596+0000", 2021-10-08T19:26:15.405 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.19369520900000001 2021-10-08T19:26:15.405 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.405 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.405 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:26:15.406 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.565648+0000", 2021-10-08T19:26:15.406 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1826999999999997e-05 2021-10-08T19:26:15.406 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.406 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.407 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:15.407 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.565688+0000", 2021-10-08T19:26:15.407 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9666999999999998e-05 2021-10-08T19:26:15.407 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:15.407 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:15.408 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:15.408 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.408 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.408 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:58799 7.7 7:e1b8d674:::benchmark_data_smithi097_93198_object58798:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2021-10-08T19:26:15.409 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:38.366257+0000", 2021-10-08T19:26:15.409 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 95.830815348000002, 2021-10-08T19:26:15.409 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.20128591500000001, 2021-10-08T19:26:15.409 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:15.409 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:26:15.410 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:26:15.410 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:26:15.410 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:26:15.410 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 58799 2021-10-08T19:26:15.410 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.411 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:15.411 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.411 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:15.411 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366257+0000", 2021-10-08T19:26:15.412 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:15.412 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.412 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.412 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:15.412 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366257+0000", 2021-10-08T19:26:15.413 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:15.413 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.413 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.413 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:15.413 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366257+0000", 2021-10-08T19:26:15.414 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:26:15.414 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.414 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.414 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:15.415 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366284+0000", 2021-10-08T19:26:15.415 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7379999999999999e-05 2021-10-08T19:26:15.415 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.415 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.415 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:15.416 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366291+0000", 2021-10-08T19:26:15.416 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8789999999999997e-06 2021-10-08T19:26:15.416 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.416 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.416 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:15.417 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366295+0000", 2021-10-08T19:26:15.417 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4159999999999997e-06 2021-10-08T19:26:15.417 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.417 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.417 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:15.418 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366372+0000", 2021-10-08T19:26:15.418 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6862999999999999e-05 2021-10-08T19:26:15.418 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.418 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.419 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:15.419 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366506+0000", 2021-10-08T19:26:15.419 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000133516 2021-10-08T19:26:15.419 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.419 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.420 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,6", 2021-10-08T19:26:15.420 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366701+0000", 2021-10-08T19:26:15.420 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000195248 2021-10-08T19:26:15.420 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.421 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.421 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:26:15.421 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.371268+0000", 2021-10-08T19:26:15.421 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.004567181 2021-10-08T19:26:15.421 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.422 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.422 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:15.422 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.371985+0000", 2021-10-08T19:26:15.422 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00071697000000000004 2021-10-08T19:26:15.422 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.423 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.423 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:15.423 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.565393+0000", 2021-10-08T19:26:15.423 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.193408149 2021-10-08T19:26:15.424 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.424 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.424 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:26:15.424 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.565453+0000", 2021-10-08T19:26:15.424 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0132e-05 2021-10-08T19:26:15.425 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.425 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.425 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:15.425 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.567543+0000", 2021-10-08T19:26:15.425 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0020899759999999999 2021-10-08T19:26:15.426 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:15.426 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:15.426 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:15.426 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.427 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.427 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:58800 7.4 7:24212c9b:::benchmark_data_smithi097_93198_object58799:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2021-10-08T19:26:15.427 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:38.366306+0000", 2021-10-08T19:26:15.427 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 95.830767132999995, 2021-10-08T19:26:15.427 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.19999181099999999, 2021-10-08T19:26:15.428 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:15.428 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:26:15.428 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:26:15.428 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:26:15.428 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:26:15.429 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 58800 2021-10-08T19:26:15.429 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.429 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:15.429 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.429 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:15.430 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366306+0000", 2021-10-08T19:26:15.430 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:15.430 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.430 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.431 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:15.431 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366306+0000", 2021-10-08T19:26:15.431 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:15.431 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.432 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.432 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:15.432 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366305+0000", 2021-10-08T19:26:15.432 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:26:15.432 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.433 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.433 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:15.433 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366333+0000", 2021-10-08T19:26:15.433 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7841e-05 2021-10-08T19:26:15.433 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.434 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.434 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:15.434 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366339+0000", 2021-10-08T19:26:15.434 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5910000000000001e-06 2021-10-08T19:26:15.435 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.435 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.435 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:15.435 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366344+0000", 2021-10-08T19:26:15.435 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1270000000000002e-06 2021-10-08T19:26:15.436 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.436 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.436 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:15.436 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.368776+0000", 2021-10-08T19:26:15.437 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0024312790000000002 2021-10-08T19:26:15.437 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.437 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.437 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:15.437 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.368900+0000", 2021-10-08T19:26:15.438 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012395900000000001 2021-10-08T19:26:15.438 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.438 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.438 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:26:15.438 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.368996+0000", 2021-10-08T19:26:15.439 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5937e-05 2021-10-08T19:26:15.439 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.439 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.439 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:26:15.440 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.371464+0000", 2021-10-08T19:26:15.440 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0024682150000000002 2021-10-08T19:26:15.440 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.440 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.440 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:15.441 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.565723+0000", 2021-10-08T19:26:15.441 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.19425885700000001 2021-10-08T19:26:15.441 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.441 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.441 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:15.442 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.565750+0000", 2021-10-08T19:26:15.442 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7707000000000001e-05 2021-10-08T19:26:15.442 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.442 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.443 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:26:15.443 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.565794+0000", 2021-10-08T19:26:15.443 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3130000000000002e-05 2021-10-08T19:26:15.443 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.444 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.444 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:15.444 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.566297+0000", 2021-10-08T19:26:15.444 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00050392299999999998 2021-10-08T19:26:15.444 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:15.445 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:15.445 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:15.445 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.445 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.445 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:58803 7.6 7:6c3d8546:::benchmark_data_smithi097_93198_object58802:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2021-10-08T19:26:15.446 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:38.366503+0000", 2021-10-08T19:26:15.446 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 95.830569456999996, 2021-10-08T19:26:15.446 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.199032767, 2021-10-08T19:26:15.446 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:15.447 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:26:15.447 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:26:15.447 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:26:15.447 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:26:15.447 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 58803 2021-10-08T19:26:15.448 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.448 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:15.448 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.448 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:15.448 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366503+0000", 2021-10-08T19:26:15.449 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:15.449 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.449 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.449 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:15.449 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366503+0000", 2021-10-08T19:26:15.450 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:15.450 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.450 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.450 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:15.451 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366502+0000", 2021-10-08T19:26:15.451 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:26:15.451 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.451 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.451 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:15.452 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366525+0000", 2021-10-08T19:26:15.452 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2897000000000001e-05 2021-10-08T19:26:15.452 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.452 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.452 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:15.453 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366536+0000", 2021-10-08T19:26:15.453 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0555e-05 2021-10-08T19:26:15.453 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.453 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.454 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:15.454 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366542+0000", 2021-10-08T19:26:15.454 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0209999999999996e-06 2021-10-08T19:26:15.454 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.454 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.455 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:15.455 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366581+0000", 2021-10-08T19:26:15.455 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9663999999999998e-05 2021-10-08T19:26:15.455 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.456 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.456 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:15.456 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366684+0000", 2021-10-08T19:26:15.456 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000103062 2021-10-08T19:26:15.456 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.457 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.457 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,7", 2021-10-08T19:26:15.457 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366804+0000", 2021-10-08T19:26:15.457 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119678 2021-10-08T19:26:15.457 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.458 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.458 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:26:15.458 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.371438+0000", 2021-10-08T19:26:15.458 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0046337799999999997 2021-10-08T19:26:15.458 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.459 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.459 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:15.459 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.371728+0000", 2021-10-08T19:26:15.459 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00028967000000000001 2021-10-08T19:26:15.460 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.460 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.460 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:15.460 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.565451+0000", 2021-10-08T19:26:15.460 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.19372335500000001 2021-10-08T19:26:15.461 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.461 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.461 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:26:15.461 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.565497+0000", 2021-10-08T19:26:15.461 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6140000000000002e-05 2021-10-08T19:26:15.462 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.462 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.462 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:15.462 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.565536+0000", 2021-10-08T19:26:15.463 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9057999999999998e-05 2021-10-08T19:26:15.463 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:15.463 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:15.463 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:15.463 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.464 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.464 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop_reply(client.24796.0:58799 7.7 e120/113 ondisk, result = 0)", 2021-10-08T19:26:15.464 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:38.371986+0000", 2021-10-08T19:26:15.464 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 95.825086509000002, 2021-10-08T19:26:15.464 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.19556357799999999, 2021-10-08T19:26:15.465 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:15.465 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2021-10-08T19:26:15.465 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:15.465 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.466 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:15.466 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.371986+0000", 2021-10-08T19:26:15.466 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:15.466 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.466 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.467 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:15.467 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.371986+0000", 2021-10-08T19:26:15.467 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:15.467 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.467 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.468 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:15.468 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.371985+0000", 2021-10-08T19:26:15.468 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:26:15.468 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.469 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.469 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:15.469 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.371989+0000", 2021-10-08T19:26:15.469 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.326e-06 2021-10-08T19:26:15.469 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.470 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.470 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:15.470 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.565300+0000", 2021-10-08T19:26:15.470 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.19331092499999999 2021-10-08T19:26:15.470 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.471 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.471 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:15.471 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.565308+0000", 2021-10-08T19:26:15.471 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.439e-06 2021-10-08T19:26:15.471 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.472 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.472 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:15.472 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.565374+0000", 2021-10-08T19:26:15.472 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5622000000000003e-05 2021-10-08T19:26:15.473 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.473 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.473 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:15.473 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.565385+0000", 2021-10-08T19:26:15.473 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1272e-05 2021-10-08T19:26:15.474 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.474 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.474 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:15.474 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.567550+0000", 2021-10-08T19:26:15.474 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021648269999999998 2021-10-08T19:26:15.475 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:15.475 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:15.475 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:15.475 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.476 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.476 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.24796.0:58808 7.5 e120/94 7:a1085e60:::benchmark_data_smithi097_93198_object58807:head v 120'3752, mlcod=120'3750)", 2021-10-08T19:26:15.476 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:38.372268+0000", 2021-10-08T19:26:15.476 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 95.824804861999993, 2021-10-08T19:26:15.476 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.19919004200000001, 2021-10-08T19:26:15.477 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:15.477 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:26:15.477 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:15.477 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.478 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:15.478 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.372268+0000", 2021-10-08T19:26:15.478 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:15.478 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.478 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.479 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:15.479 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.372268+0000", 2021-10-08T19:26:15.479 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:15.479 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.479 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.480 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:15.480 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.372261+0000", 2021-10-08T19:26:15.480 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999928 2021-10-08T19:26:15.480 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.481 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.481 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:15.481 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.372386+0000", 2021-10-08T19:26:15.481 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000124898 2021-10-08T19:26:15.481 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.482 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.482 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:15.482 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.565295+0000", 2021-10-08T19:26:15.482 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.19290932 2021-10-08T19:26:15.483 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.483 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.483 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:15.483 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.565304+0000", 2021-10-08T19:26:15.483 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8680000000000005e-06 2021-10-08T19:26:15.484 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.484 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.484 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:15.484 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.565359+0000", 2021-10-08T19:26:15.484 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5398000000000001e-05 2021-10-08T19:26:15.485 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.485 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.485 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:15.485 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.565384+0000", 2021-10-08T19:26:15.486 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5082000000000001e-05 2021-10-08T19:26:15.486 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.486 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.486 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:26:15.486 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.571422+0000", 2021-10-08T19:26:15.487 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0060370750000000003 2021-10-08T19:26:15.487 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.487 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.487 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:15.487 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.571458+0000", 2021-10-08T19:26:15.488 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6412000000000003e-05 2021-10-08T19:26:15.488 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:15.488 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:15.488 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:15.488 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.489 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.489 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop_reply(client.24796.0:58798 7.4 e120/94 ondisk, result = 0)", 2021-10-08T19:26:15.489 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:38.373910+0000", 2021-10-08T19:26:15.489 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 95.823162839000005, 2021-10-08T19:26:15.490 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.19178235399999999, 2021-10-08T19:26:15.490 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:15.490 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2021-10-08T19:26:15.490 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:15.490 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.491 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:15.491 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.373910+0000", 2021-10-08T19:26:15.491 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:15.491 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.491 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.492 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:15.492 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.373910+0000", 2021-10-08T19:26:15.492 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:15.492 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.493 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.493 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:15.493 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.373909+0000", 2021-10-08T19:26:15.493 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2021-10-08T19:26:15.493 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.494 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.494 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:15.494 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.373914+0000", 2021-10-08T19:26:15.494 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4750000000000001e-06 2021-10-08T19:26:15.494 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.495 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.495 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:15.495 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.565255+0000", 2021-10-08T19:26:15.495 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.19134111600000001 2021-10-08T19:26:15.496 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.496 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.496 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:15.496 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.565298+0000", 2021-10-08T19:26:15.496 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2929999999999997e-05 2021-10-08T19:26:15.497 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.497 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.497 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:15.497 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.565580+0000", 2021-10-08T19:26:15.497 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00028223400000000002 2021-10-08T19:26:15.498 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.498 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.498 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:15.498 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.565589+0000", 2021-10-08T19:26:15.499 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5150000000000006e-06 2021-10-08T19:26:15.499 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.499 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.499 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:15.499 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.565692+0000", 2021-10-08T19:26:15.500 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010337500000000001 2021-10-08T19:26:15.500 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:15.500 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:15.500 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:15.500 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.501 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.501 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:114097 7.f 7:f9712828:::benchmark_data_smithi097_93198_object22277:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e145)", 2021-10-08T19:26:15.501 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:53.634338+0000", 2021-10-08T19:26:15.501 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 20.562734682999999, 2021-10-08T19:26:15.502 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.121136647, 2021-10-08T19:26:15.502 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:15.502 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:26:15.502 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:26:15.502 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:26:15.503 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:26:15.503 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 114097 2021-10-08T19:26:15.503 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.503 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:15.503 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.504 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:15.504 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.634338+0000", 2021-10-08T19:26:15.504 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:15.504 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.505 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.505 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:15.505 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.634338+0000", 2021-10-08T19:26:15.505 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:15.505 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.506 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.506 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:15.506 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.634337+0000", 2021-10-08T19:26:15.506 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2021-10-08T19:26:15.506 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.507 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.507 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:15.507 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.634341+0000", 2021-10-08T19:26:15.507 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2339999999999999e-06 2021-10-08T19:26:15.508 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.508 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.508 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:15.508 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.634346+0000", 2021-10-08T19:26:15.508 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8919999999999999e-06 2021-10-08T19:26:15.509 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.509 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.509 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:15.509 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.634349+0000", 2021-10-08T19:26:15.509 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.664e-06 2021-10-08T19:26:15.510 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.510 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.510 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:15.510 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.637062+0000", 2021-10-08T19:26:15.511 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0027131070000000002 2021-10-08T19:26:15.511 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.511 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.511 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:15.511 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.637189+0000", 2021-10-08T19:26:15.512 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012695 2021-10-08T19:26:15.512 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.512 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.512 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,7", 2021-10-08T19:26:15.512 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.637300+0000", 2021-10-08T19:26:15.513 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011053900000000001 2021-10-08T19:26:15.513 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.513 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.513 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:26:15.513 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.642132+0000", 2021-10-08T19:26:15.514 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0048322959999999998 2021-10-08T19:26:15.514 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.514 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.514 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:15.515 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.647293+0000", 2021-10-08T19:26:15.515 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0051607570000000002 2021-10-08T19:26:15.515 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.515 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.515 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:15.516 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.755373+0000", 2021-10-08T19:26:15.516 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.108079884 2021-10-08T19:26:15.516 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.516 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.516 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:26:15.517 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.755429+0000", 2021-10-08T19:26:15.517 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5719e-05 2021-10-08T19:26:15.517 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.517 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.518 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:15.518 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.755475+0000", 2021-10-08T19:26:15.518 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6239999999999998e-05 2021-10-08T19:26:15.518 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:15.518 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:15.519 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:15.519 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.519 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.519 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:114114 7.7 7:e6f7b1b2:::benchmark_data_smithi097_93198_object22294:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e145)", 2021-10-08T19:26:15.519 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:53.644312+0000", 2021-10-08T19:26:15.520 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 20.552760886000002, 2021-10-08T19:26:15.520 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.126252265, 2021-10-08T19:26:15.520 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:15.520 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:26:15.521 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:26:15.521 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:26:15.521 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:26:15.521 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 114114 2021-10-08T19:26:15.521 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.522 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:15.522 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.522 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:15.522 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.644312+0000", 2021-10-08T19:26:15.522 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:15.523 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.523 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.523 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:15.523 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.644312+0000", 2021-10-08T19:26:15.524 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:15.524 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.524 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.524 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:15.524 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.644311+0000", 2021-10-08T19:26:15.525 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2021-10-08T19:26:15.525 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.525 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.525 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:15.525 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.644314+0000", 2021-10-08T19:26:15.526 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2010000000000002e-06 2021-10-08T19:26:15.526 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.526 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.526 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:15.527 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.644319+0000", 2021-10-08T19:26:15.527 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1780000000000002e-06 2021-10-08T19:26:15.527 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.527 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.527 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:15.528 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.644321+0000", 2021-10-08T19:26:15.528 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.305e-06 2021-10-08T19:26:15.528 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.528 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.528 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:15.529 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.647273+0000", 2021-10-08T19:26:15.529 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029519530000000002 2021-10-08T19:26:15.529 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.529 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.530 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:15.530 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.647425+0000", 2021-10-08T19:26:15.530 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015238299999999999 2021-10-08T19:26:15.530 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.530 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.531 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,6", 2021-10-08T19:26:15.531 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.647577+0000", 2021-10-08T19:26:15.531 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015135699999999999 2021-10-08T19:26:15.531 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.531 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.532 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:26:15.532 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.651387+0000", 2021-10-08T19:26:15.532 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038103120000000002 2021-10-08T19:26:15.532 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.532 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.533 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:15.533 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.758106+0000", 2021-10-08T19:26:15.533 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.106718779 2021-10-08T19:26:15.533 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.534 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.534 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:15.534 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.763641+0000", 2021-10-08T19:26:15.534 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0055350019999999998 2021-10-08T19:26:15.534 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.535 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.535 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:26:15.535 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.763697+0000", 2021-10-08T19:26:15.535 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5911000000000001e-05 2021-10-08T19:26:15.536 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:15.536 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:15.536 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:15.536 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.770564+0000", 2021-10-08T19:26:15.536 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0068673190000000002 2021-10-08T19:26:15.537 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:15.537 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:15.537 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:15.537 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:15.537 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:15.538 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:26:15.558 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:26:15.563 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:15.563 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:26:15.665 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:26:15.691 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:15.756 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:26:15.763 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:15.764 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:26:15.865 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:26:15.907 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:15 smithi097 ceph-mon[32687]: pgmap v215: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 3.3 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 758 op/s; 8261/164652 objects degraded (5.017%); 3301/164652 objects misplaced (2.005%); 2.2 MiB/s, 34 objects/s recovering 2021-10-08T19:26:15.908 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:15 smithi097 ceph-mon[32687]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:26:15.908 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:15 smithi097 ceph-mon[32687]: from='client.24961 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:26:15.908 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:15 smithi097 ceph-mon[32687]: osdmap e150: 8 total, 8 up, 8 in 2021-10-08T19:26:15.908 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:15 smithi097 ceph-mon[32687]: Health check update: Degraded data redundancy: 8261/164652 objects degraded (5.017%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:26:15.909 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:15 smithi097 ceph-mon[32687]: osdmap e151: 8 total, 8 up, 8 in 2021-10-08T19:26:15.909 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:15 smithi097 ceph-mon[41966]: pgmap v215: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 3.3 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 758 op/s; 8261/164652 objects degraded (5.017%); 3301/164652 objects misplaced (2.005%); 2.2 MiB/s, 34 objects/s recovering 2021-10-08T19:26:15.909 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:15 smithi097 ceph-mon[41966]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:26:15.909 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:15 smithi097 ceph-mon[41966]: from='client.24961 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:26:15.910 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:15 smithi097 ceph-mon[41966]: osdmap e150: 8 total, 8 up, 8 in 2021-10-08T19:26:15.910 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:15 smithi097 ceph-mon[41966]: Health check update: Degraded data redundancy: 8261/164652 objects degraded (5.017%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:26:15.910 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:15 smithi097 ceph-mon[41966]: osdmap e151: 8 total, 8 up, 8 in 2021-10-08T19:26:15.914 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:16.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:15 smithi117 ceph-mon[34585]: pgmap v215: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 3.3 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 758 op/s; 8261/164652 objects degraded (5.017%); 3301/164652 objects misplaced (2.005%); 2.2 MiB/s, 34 objects/s recovering 2021-10-08T19:26:16.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:15 smithi117 ceph-mon[34585]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:26:16.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:15 smithi117 ceph-mon[34585]: from='client.24961 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:26:16.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:15 smithi117 ceph-mon[34585]: osdmap e150: 8 total, 8 up, 8 in 2021-10-08T19:26:16.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:15 smithi117 ceph-mon[34585]: Health check update: Degraded data redundancy: 8261/164652 objects degraded (5.017%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:26:16.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:15 smithi117 ceph-mon[34585]: osdmap e151: 8 total, 8 up, 8 in 2021-10-08T19:26:16.655 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:26:16 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:26:16.847 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:26:16.849 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:26:16.872 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:16.877 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:26:16.893 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2021-10-08T19:26:16.978 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:26:17.008 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:17.065 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:26:17.067 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:17.068 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:26:17.170 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:26:17.271 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:17.514 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:26:17.525 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:17.526 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:26:17.592 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:26:17.592 INFO:teuthology.orchestra.run.smithi097.stdout: "success": "filestore_inject_stall = '3' (not observed, change may require restart) " 2021-10-08T19:26:17.592 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:26:17.627 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:26:17.657 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:17.715 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:26:17.722 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:17.723 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:26:17.824 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:26:17.852 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:17.907 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:26:17.909 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:17 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:26:17.909 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:17 smithi117 ceph-mon[34585]: pgmap v218: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 3.3 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 853 op/s; 8261/164652 objects degraded (5.017%); 3301/164652 objects misplaced (2.005%); 2.3 MiB/s, 36 objects/s recovering 2021-10-08T19:26:17.910 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:17.911 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:26:18.012 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:26:18.062 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:18.161 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:17 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:26:18.162 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:17 smithi097 ceph-mon[32687]: pgmap v218: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 3.3 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 853 op/s; 8261/164652 objects degraded (5.017%); 3301/164652 objects misplaced (2.005%); 2.3 MiB/s, 36 objects/s recovering 2021-10-08T19:26:18.162 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:17 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:26:18.162 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:17 smithi097 ceph-mon[41966]: pgmap v218: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 3.3 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 853 op/s; 8261/164652 objects degraded (5.017%); 3301/164652 objects misplaced (2.005%); 2.3 MiB/s, 36 objects/s recovering 2021-10-08T19:26:18.597 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set noscrub 2021-10-08T19:26:19.643 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:26:19.750 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:26:19.755 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:19.756 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:26:19.857 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:26:19.889 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:19.946 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:26:19.948 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:19.949 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:26:19.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:19 smithi097 ceph-mon[41966]: pgmap v219: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 3.3 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 543 op/s; 8435/162576 objects degraded (5.188%); 3069/162576 objects misplaced (1.888%); 1.8 MiB/s, 29 objects/s recovering 2021-10-08T19:26:19.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:19 smithi097 ceph-mon[32687]: pgmap v219: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 3.3 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 543 op/s; 8435/162576 objects degraded (5.188%); 3069/162576 objects misplaced (1.888%); 1.8 MiB/s, 29 objects/s recovering 2021-10-08T19:26:20.050 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:26:20.105 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:20.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:19 smithi117 ceph-mon[34585]: pgmap v219: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 3.3 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 543 op/s; 8435/162576 objects degraded (5.188%); 3069/162576 objects misplaced (1.888%); 1.8 MiB/s, 29 objects/s recovering 2021-10-08T19:26:20.496 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:26:20.500 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:20.500 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:26:20.501 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:26:20.602 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:26:20.658 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:20.957 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:26:20.962 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:20.963 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:26:21.064 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:26:21.068 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:20 smithi097 ceph-mon[41966]: Health check update: Degraded data redundancy: 8435/162576 objects degraded (5.188%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:26:21.069 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:20 smithi097 ceph-mon[32687]: Health check update: Degraded data redundancy: 8435/162576 objects degraded (5.188%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:26:21.088 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:20 smithi117 ceph-mon[34585]: Health check update: Degraded data redundancy: 8435/162576 objects degraded (5.188%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:26:21.090 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:21.148 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:26:21.150 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:21.151 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:26:21.252 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:26:21.277 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:21.278 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:26:21.319 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:26:21.333 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:26:21.340 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:21.341 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:26:21.361 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:26:21.402 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:26:21.441 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:26:21.443 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:26:21.474 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:21.479 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:26:21.521 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:26:21.532 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:26:21.536 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:21.538 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:26:21.569 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:26:21.598 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'false' 2021-10-08T19:26:21.598 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'false' 2021-10-08T19:26:21.599 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'false' 2021-10-08T19:26:21.599 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'false' 2021-10-08T19:26:21.599 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'false' 2021-10-08T19:26:21.599 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'false' 2021-10-08T19:26:21.599 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'false' 2021-10-08T19:26:21.600 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'false' 2021-10-08T19:26:21.640 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:26:21.687 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:21.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:21 smithi097 ceph-mon[41966]: pgmap v220: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 3.1 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 907 op/s; 8602/153840 objects degraded (5.592%); 2785/153840 objects misplaced (1.810%); 2.7 MiB/s, 43 objects/s recovering 2021-10-08T19:26:21.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:21 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3106942209' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:26:21.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:21 smithi097 ceph-mon[32687]: pgmap v220: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 3.1 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 907 op/s; 8602/153840 objects degraded (5.592%); 2785/153840 objects misplaced (1.810%); 2.7 MiB/s, 43 objects/s recovering 2021-10-08T19:26:21.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:21 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3106942209' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:26:22.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:21 smithi117 ceph-mon[34585]: pgmap v220: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 3.1 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 907 op/s; 8602/153840 objects degraded (5.592%); 2785/153840 objects misplaced (1.810%); 2.7 MiB/s, 43 objects/s recovering 2021-10-08T19:26:22.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:21 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3106942209' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:26:22.806 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:26:22.813 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:22.814 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:26:22.915 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:26:22.960 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:26:22 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:26:22] "GET /metrics HTTP/1.1" 200 155740 "" "Prometheus/2.18.1" 2021-10-08T19:26:22.966 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:23.569 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:26:23.578 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:23.579 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:26:23.680 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:26:23.773 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:24.040 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:26:24.053 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:24.053 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:23 smithi097 ceph-mon[41966]: pgmap v221: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 3.1 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 450 op/s; 8602/153840 objects degraded (5.592%); 2785/153840 objects misplaced (1.810%); 1.4 MiB/s, 21 objects/s recovering 2021-10-08T19:26:24.054 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:26:24.055 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:23 smithi097 ceph-mon[32687]: pgmap v221: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 3.1 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 450 op/s; 8602/153840 objects degraded (5.592%); 2785/153840 objects misplaced (1.810%); 1.4 MiB/s, 21 objects/s recovering 2021-10-08T19:26:24.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:26:23 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:26:23] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:26:24.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:23 smithi117 ceph-mon[34585]: pgmap v221: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 3.1 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 450 op/s; 8602/153840 objects degraded (5.592%); 2785/153840 objects misplaced (1.810%); 1.4 MiB/s, 21 objects/s recovering 2021-10-08T19:26:24.157 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:26:24.260 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:24.538 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:26:24.544 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:24.544 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:26:24.645 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:26:24.670 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2021-10-08T19:26:24.671 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:26:24.672 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:24.680 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 7, 6] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2021-10-08T19:26:24.680 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2021-10-08T19:26:24.681 INFO:tasks.thrashosds.thrasher:inject_pause on 6 2021-10-08T19:26:24.681 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2021-10-08T19:26:24.681 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2021-10-08T19:26:24.682 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.6 config set filestore_inject_stall 3 2021-10-08T19:26:24.755 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:26:24.765 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:24.765 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:26:24.866 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:26:24.921 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:25.009 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:26:25.013 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:25.014 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:26:25.115 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:26:25.163 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:25.222 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:26:25.228 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:25.229 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:26:25.331 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:26:25.401 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:25.410 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:26:25.477 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2021-10-08T19:26:25.874 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:26:25.880 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:25.881 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:26:25.900 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is set 2021-10-08T19:26:25.983 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:26:26.018 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:26.046 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2021-10-08T19:26:26.141 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:25 smithi097 ceph-mon[41966]: pgmap v222: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 2.9 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 745 op/s; 8921/142896 objects degraded (6.243%); 2292/142896 objects misplaced (1.604%); 2.2 MiB/s, 35 objects/s recovering 2021-10-08T19:26:26.142 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:25 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1230121843' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:26:26.142 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:25 smithi097 ceph-mon[41966]: Health check update: Degraded data redundancy: 8921/142896 objects degraded (6.243%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:26:26.143 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:25 smithi097 ceph-mon[32687]: pgmap v222: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 2.9 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 745 op/s; 8921/142896 objects degraded (6.243%); 2292/142896 objects misplaced (1.604%); 2.2 MiB/s, 35 objects/s recovering 2021-10-08T19:26:26.143 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:25 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1230121843' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:26:26.143 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:25 smithi097 ceph-mon[32687]: Health check update: Degraded data redundancy: 8921/142896 objects degraded (6.243%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:26:26.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:25 smithi117 ceph-mon[34585]: pgmap v222: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 2.9 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 745 op/s; 8921/142896 objects degraded (6.243%); 2292/142896 objects misplaced (1.604%); 2.2 MiB/s, 35 objects/s recovering 2021-10-08T19:26:26.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:25 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1230121843' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:26:26.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:25 smithi117 ceph-mon[34585]: Health check update: Degraded data redundancy: 8921/142896 objects degraded (6.243%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:26:26.655 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:26:26 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:26:26.716 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:26:26.769 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:26:27.071 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:26 smithi097 ceph-mon[32687]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:26:27.071 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:26 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1230121843' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:26:27.071 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:26 smithi097 ceph-mon[32687]: osdmap e152: 8 total, 8 up, 8 in 2021-10-08T19:26:27.073 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:26 smithi097 ceph-mon[41966]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:26:27.073 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:26 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1230121843' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:26:27.073 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:26 smithi097 ceph-mon[41966]: osdmap e152: 8 total, 8 up, 8 in 2021-10-08T19:26:27.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:26 smithi117 ceph-mon[34585]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:26:27.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:26 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1230121843' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:26:27.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:26 smithi117 ceph-mon[34585]: osdmap e152: 8 total, 8 up, 8 in 2021-10-08T19:26:27.889 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:27 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:26:27.890 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:27 smithi097 ceph-mon[32687]: pgmap v224: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 2.9 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 725 op/s; 8921/142896 objects degraded (6.243%); 2292/142896 objects misplaced (1.604%); 2.2 MiB/s, 34 objects/s recovering 2021-10-08T19:26:27.890 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:27 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:26:27.891 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:27 smithi097 ceph-mon[41966]: pgmap v224: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 2.9 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 725 op/s; 8921/142896 objects degraded (6.243%); 2292/142896 objects misplaced (1.604%); 2.2 MiB/s, 34 objects/s recovering 2021-10-08T19:26:28.014 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:26:28.019 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:28.020 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:26:28.122 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:26:28.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:27 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:26:28.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:27 smithi117 ceph-mon[34585]: pgmap v224: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 2.9 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 725 op/s; 8921/142896 objects degraded (6.243%); 2292/142896 objects misplaced (1.604%); 2.2 MiB/s, 34 objects/s recovering 2021-10-08T19:26:28.184 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:28.734 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:26:28.739 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:28.740 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:26:28.756 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set nodeep-scrub 2021-10-08T19:26:28.843 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:26:28.889 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:29.007 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:26:29.014 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:29.015 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:26:29.116 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:26:29.150 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:29.220 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:26:29.225 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:29.225 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:26:29.326 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:26:29.356 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:29.495 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:26:29.569 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:26:29.572 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:29.572 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:26:29.674 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:26:29.743 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:29.910 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:29 smithi097 ceph-mon[41966]: pgmap v225: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 2.9 GiB data, 9.9 GiB used, 705 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 726 op/s; 9092/140808 objects degraded (6.457%); 2062/140808 objects misplaced (1.464%); 2.2 MiB/s, 34 objects/s recovering 2021-10-08T19:26:29.911 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:29 smithi097 ceph-mon[32687]: pgmap v225: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 2.9 GiB data, 9.9 GiB used, 705 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 726 op/s; 9092/140808 objects degraded (6.457%); 2062/140808 objects misplaced (1.464%); 2.2 MiB/s, 34 objects/s recovering 2021-10-08T19:26:29.965 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:26:29.971 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:29.972 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:26:30.031 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2021-10-08T19:26:30.031 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:26:30.076 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:26:30.140 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:30.172 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:29 smithi117 ceph-mon[34585]: pgmap v225: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 2.9 GiB data, 9.9 GiB used, 705 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 726 op/s; 9092/140808 objects degraded (6.457%); 2062/140808 objects misplaced (1.464%); 2.2 MiB/s, 34 objects/s recovering 2021-10-08T19:26:30.630 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:26:30.631 INFO:teuthology.orchestra.run.smithi117.stdout: "success": "filestore_inject_stall = '3' (not observed, change may require restart) " 2021-10-08T19:26:30.631 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:26:30.841 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:26:30.869 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:30.870 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:26:30.972 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:26:31.009 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:31.039 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:26:31.076 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:26:31.122 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:26:31.154 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:26:31.187 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:26:31.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:30 smithi097 ceph-mon[32687]: Health check update: Degraded data redundancy: 9092/140808 objects degraded (6.457%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:26:31.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:30 smithi097 ceph-mon[32687]: osdmap e153: 8 total, 8 up, 8 in 2021-10-08T19:26:31.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:30 smithi097 ceph-mon[41966]: Health check update: Degraded data redundancy: 9092/140808 objects degraded (6.457%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:26:31.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:30 smithi097 ceph-mon[41966]: osdmap e153: 8 total, 8 up, 8 in 2021-10-08T19:26:31.235 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:26:31.275 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:26:31.311 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:26:31.316 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true' 2021-10-08T19:26:31.317 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true' 2021-10-08T19:26:31.317 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true' 2021-10-08T19:26:31.317 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true' 2021-10-08T19:26:31.317 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true' 2021-10-08T19:26:31.318 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true' 2021-10-08T19:26:31.318 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'true' 2021-10-08T19:26:31.318 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'true' 2021-10-08T19:26:31.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:30 smithi117 ceph-mon[34585]: Health check update: Degraded data redundancy: 9092/140808 objects degraded (6.457%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:26:31.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:30 smithi117 ceph-mon[34585]: osdmap e153: 8 total, 8 up, 8 in 2021-10-08T19:26:31.574 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:26:31.576 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:31.577 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:26:31.608 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2021-10-08T19:26:31.678 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:26:31.764 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:31.929 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:31 smithi097 ceph-mon[32687]: pgmap v227: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 2.7 GiB data, 9.5 GiB used, 706 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 907 op/s; 9261/132069 objects degraded (7.012%); 1777/132069 objects misplaced (1.346%); 2.7 MiB/s, 43 objects/s recovering 2021-10-08T19:26:31.929 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:31 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1544850100' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:26:32.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:31 smithi097 ceph-mon[41966]: pgmap v227: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 2.7 GiB data, 9.5 GiB used, 706 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 907 op/s; 9261/132069 objects degraded (7.012%); 1777/132069 objects misplaced (1.346%); 2.7 MiB/s, 43 objects/s recovering 2021-10-08T19:26:32.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:31 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1544850100' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:26:32.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:31 smithi117 ceph-mon[34585]: pgmap v227: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 2.7 GiB data, 9.5 GiB used, 706 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 907 op/s; 9261/132069 objects degraded (7.012%); 1777/132069 objects misplaced (1.346%); 2.7 MiB/s, 43 objects/s recovering 2021-10-08T19:26:32.463 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:31 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1544850100' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:26:32.941 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:26:32.951 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:26:32 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:26:32] "GET /metrics HTTP/1.1" 200 155773 "" "Prometheus/2.18.1" 2021-10-08T19:26:32.952 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:32.953 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:26:33.054 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:26:33.095 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:33.250 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:26:33.253 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:33.254 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:26:33.278 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:26:33.356 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:26:33.426 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:33.589 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:26:33 smithi097 conmon[33110]: 172.21.15.97 - - [08/Oct/2021:19:26:33] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:26:33.730 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:26:33.739 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:33.740 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:26:33.843 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:26:33.868 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:26:33 smithi117 conmon[69189]: level=error ts=2021-10-08T19:26:33.504Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=2 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:26:33.926 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:34.079 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:26:34.083 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:34.085 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:26:34.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:26:33 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:26:33] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:26:34.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:33 smithi117 ceph-mon[34585]: pgmap v228: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 2.7 GiB data, 9.5 GiB used, 706 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 451 op/s; 9261/132069 objects degraded (7.012%); 1777/132069 objects misplaced (1.346%); 1.4 MiB/s, 21 objects/s recovering 2021-10-08T19:26:34.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:33 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:26:34.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:33 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:26:34.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:33 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:26:34.186 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:26:34.216 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:33 smithi097 ceph-mon[32687]: pgmap v228: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 2.7 GiB data, 9.5 GiB used, 706 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 451 op/s; 9261/132069 objects degraded (7.012%); 1777/132069 objects misplaced (1.346%); 1.4 MiB/s, 21 objects/s recovering 2021-10-08T19:26:34.217 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:33 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:26:34.217 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:33 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:26:34.218 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:33 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:26:34.218 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:34.219 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:33 smithi097 ceph-mon[41966]: pgmap v228: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 2.7 GiB data, 9.5 GiB used, 706 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 451 op/s; 9261/132069 objects degraded (7.012%); 1777/132069 objects misplaced (1.346%); 1.4 MiB/s, 21 objects/s recovering 2021-10-08T19:26:34.219 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:33 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:26:34.219 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:33 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:26:34.219 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:33 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:26:34.429 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:26:34.431 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:34.432 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:26:34.535 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:26:34.579 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:34.759 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:26:34.766 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:34.766 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:26:34.868 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:26:34.926 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:35.014 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is set 2021-10-08T19:26:35.040 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:26:35.042 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:35.043 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:26:35.144 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:26:35.194 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:34 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:26:35.194 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:34 smithi097 ceph-mon[32687]: 172.21.15.97 - - [08/Oct/2021:19:26:33] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:26:35.194 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:34 smithi097 ceph-mon[32687]: osdmap e154: 8 total, 8 up, 8 in 2021-10-08T19:26:35.195 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:34 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3844413970' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:26:35.195 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:34 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:26:35.195 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:34 smithi097 ceph-mon[41966]: 172.21.15.97 - - [08/Oct/2021:19:26:33] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:26:35.196 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:34 smithi097 ceph-mon[41966]: osdmap e154: 8 total, 8 up, 8 in 2021-10-08T19:26:35.196 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:34 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3844413970' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:26:35.198 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:35.317 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2021-10-08T19:26:35.400 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:26:35.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:34 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:26:35.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:34 smithi117 ceph-mon[34585]: 172.21.15.97 - - [08/Oct/2021:19:26:33] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:26:35.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:34 smithi117 ceph-mon[34585]: osdmap e154: 8 total, 8 up, 8 in 2021-10-08T19:26:35.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:34 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3844413970' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:26:35.411 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:35.412 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:26:35.513 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:26:35.602 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:35.981 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:26:35.991 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:35.991 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:26:36.092 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:26:36.125 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:36.147 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:26:36.178 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:26:36.181 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:36.182 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:26:36.236 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:35 smithi097 ceph-mon[41966]: pgmap v230: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 2.5 GiB data, 8.9 GiB used, 706 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 913 op/s; 9291/120987 objects degraded (7.679%); 1573/120987 objects misplaced (1.300%); 1.8 MiB/s, 43 objects/s recovering 2021-10-08T19:26:36.237 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:35 smithi097 ceph-mon[41966]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:26:36.237 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:35 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3844413970' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:26:36.237 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:35 smithi097 ceph-mon[41966]: osdmap e155: 8 total, 8 up, 8 in 2021-10-08T19:26:36.238 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:35 smithi097 ceph-mon[41966]: Health check update: Degraded data redundancy: 9291/120987 objects degraded (7.679%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:26:36.238 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:35 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:26:36.238 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:35 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:26:36.238 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:35 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:26:36.238 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:35 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:26:36.239 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:26:36 smithi097 conmon[33110]: 172.21.15.117 - - [08/Oct/2021:19:26:36] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:26:36.239 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:35 smithi097 ceph-mon[32687]: pgmap v230: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 2.5 GiB data, 8.9 GiB used, 706 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 913 op/s; 9291/120987 objects degraded (7.679%); 1573/120987 objects misplaced (1.300%); 1.8 MiB/s, 43 objects/s recovering 2021-10-08T19:26:36.240 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:35 smithi097 ceph-mon[32687]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:26:36.240 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:35 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3844413970' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:26:36.240 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:35 smithi097 ceph-mon[32687]: osdmap e155: 8 total, 8 up, 8 in 2021-10-08T19:26:36.240 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:35 smithi097 ceph-mon[32687]: Health check update: Degraded data redundancy: 9291/120987 objects degraded (7.679%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:26:36.241 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:35 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:26:36.241 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:35 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:26:36.241 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:35 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:26:36.241 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:35 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:26:36.283 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:26:36.307 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:35 smithi117 ceph-mon[34585]: pgmap v230: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 2.5 GiB data, 8.9 GiB used, 706 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 913 op/s; 9291/120987 objects degraded (7.679%); 1573/120987 objects misplaced (1.300%); 1.8 MiB/s, 43 objects/s recovering 2021-10-08T19:26:36.307 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:35 smithi117 ceph-mon[34585]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:26:36.307 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:35 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3844413970' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:26:36.308 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:35 smithi117 ceph-mon[34585]: osdmap e155: 8 total, 8 up, 8 in 2021-10-08T19:26:36.308 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:35 smithi117 ceph-mon[34585]: Health check update: Degraded data redundancy: 9291/120987 objects degraded (7.679%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:26:36.308 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:35 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:26:36.308 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:35 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:26:36.309 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:35 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:26:36.309 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:35 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:26:36.309 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:36.370 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:26:36.375 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:36.376 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:26:36.477 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:26:36.506 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:36.551 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 7, 6] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2021-10-08T19:26:36.551 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2021-10-08T19:26:36.552 INFO:tasks.thrashosds.thrasher:inject_pause on 6 2021-10-08T19:26:36.552 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2021-10-08T19:26:36.552 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2021-10-08T19:26:36.553 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.6 config set filestore_inject_stall 3 2021-10-08T19:26:36.559 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:26:36.561 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:26:36 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:26:36.562 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:36.563 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:26:36.608 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:26:36.609 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2021-10-08T19:26:36.609 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2021-10-08T19:26:36.609 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2021-10-08T19:26:36.610 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.610 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.14156.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2021-10-08T19:26:36.610 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:19:45.428061+0000", 2021-10-08T19:26:36.611 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 411.17584683899997, 2021-10-08T19:26:36.611 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.242705912, 2021-10-08T19:26:36.611 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:36.611 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:26:36.612 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:26:36.612 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.14156", 2021-10-08T19:26:36.612 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1443158975", 2021-10-08T19:26:36.612 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1 2021-10-08T19:26:36.613 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.613 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:36.613 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.613 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:36.613 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:19:45.428061+0000", 2021-10-08T19:26:36.614 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:36.614 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.614 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.615 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:36.615 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:19:45.428061+0000", 2021-10-08T19:26:36.615 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:36.615 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.616 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.616 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:36.616 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:19:45.428059+0000", 2021-10-08T19:26:36.616 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:26:36.616 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.617 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.617 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:36.617 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:19:45.428074+0000", 2021-10-08T19:26:36.617 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5523e-05 2021-10-08T19:26:36.618 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.618 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.618 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:36.618 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:19:45.428084+0000", 2021-10-08T19:26:36.618 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.747e-06 2021-10-08T19:26:36.619 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.619 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.619 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:36.619 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:19:45.428096+0000", 2021-10-08T19:26:36.620 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2330000000000001e-05 2021-10-08T19:26:36.620 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.620 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.620 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:36.621 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:19:45.428145+0000", 2021-10-08T19:26:36.621 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8538999999999997e-05 2021-10-08T19:26:36.621 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.621 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.621 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:26:36.622 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:19:45.428158+0000", 2021-10-08T19:26:36.622 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3155e-05 2021-10-08T19:26:36.622 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.623 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.623 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:36.623 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:19:45.669650+0000", 2021-10-08T19:26:36.623 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.241491765 2021-10-08T19:26:36.624 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.624 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.625 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:36.625 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:19:45.669794+0000", 2021-10-08T19:26:36.625 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000144256 2021-10-08T19:26:36.625 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.625 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.626 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:26:36.626 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:19:45.669947+0000", 2021-10-08T19:26:36.626 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000152879 2021-10-08T19:26:36.626 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.627 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.627 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:26:36.627 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:19:45.670485+0000", 2021-10-08T19:26:36.627 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00053823100000000002 2021-10-08T19:26:36.627 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.628 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.628 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:36.629 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:19:45.670639+0000", 2021-10-08T19:26:36.629 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000153397 2021-10-08T19:26:36.629 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.629 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.630 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:36.630 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:19:45.670697+0000", 2021-10-08T19:26:36.630 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8828e-05 2021-10-08T19:26:36.630 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.631 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.631 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:26:36.631 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:19:45.670742+0000", 2021-10-08T19:26:36.631 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4728000000000003e-05 2021-10-08T19:26:36.631 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.632 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.632 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:36.632 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:19:45.670767+0000", 2021-10-08T19:26:36.632 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4332999999999999e-05 2021-10-08T19:26:36.632 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:36.633 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:36.633 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:36.633 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.633 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.633 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24472.0:155 3.c 3.9f137cac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2021-10-08T19:26:36.634 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:11.983164+0000", 2021-10-08T19:26:36.634 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 144.620743172, 2021-10-08T19:26:36.635 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.509488944, 2021-10-08T19:26:36.635 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:36.635 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "reached pg", 2021-10-08T19:26:36.635 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:26:36.636 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24472", 2021-10-08T19:26:36.636 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.117:0/3794682353", 2021-10-08T19:26:36.636 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 155 2021-10-08T19:26:36.636 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.636 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:36.637 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.637 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:36.637 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:11.983164+0000", 2021-10-08T19:26:36.637 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:36.637 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.638 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.638 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:36.638 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:11.983164+0000", 2021-10-08T19:26:36.638 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:36.639 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.639 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.639 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:36.639 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:11.983163+0000", 2021-10-08T19:26:36.639 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2021-10-08T19:26:36.640 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.640 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.640 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:36.640 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:11.983170+0000", 2021-10-08T19:26:36.640 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9589999999999998e-06 2021-10-08T19:26:36.641 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.641 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.641 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:36.641 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:11.983183+0000", 2021-10-08T19:26:36.641 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2772000000000001e-05 2021-10-08T19:26:36.642 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.642 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.642 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:36.642 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:11.983189+0000", 2021-10-08T19:26:36.642 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1539999999999999e-06 2021-10-08T19:26:36.643 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.643 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.643 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:36.643 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:11.983236+0000", 2021-10-08T19:26:36.643 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6962999999999997e-05 2021-10-08T19:26:36.644 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.644 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.644 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:26:36.644 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:11.983245+0000", 2021-10-08T19:26:36.645 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.6020000000000006e-06 2021-10-08T19:26:36.645 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.645 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.645 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:36.645 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.492643+0000", 2021-10-08T19:26:36.646 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.50939752599999999 2021-10-08T19:26:36.646 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.646 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.646 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:36.646 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.492653+0000", 2021-10-08T19:26:36.647 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0399e-05 2021-10-08T19:26:36.647 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:36.647 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:36.647 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:36.647 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.648 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.648 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:35705 7.d 7:b3292952:::benchmark_data_smithi097_93198_object35704:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106)", 2021-10-08T19:26:36.648 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:12.258806+0000", 2021-10-08T19:26:36.648 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 144.34510140200001, 2021-10-08T19:26:36.649 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.14240635400000001, 2021-10-08T19:26:36.649 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:36.649 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:26:36.649 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:26:36.649 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:26:36.650 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:26:36.650 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 35705 2021-10-08T19:26:36.650 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.650 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:36.650 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.651 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:36.651 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.258806+0000", 2021-10-08T19:26:36.651 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:36.651 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.651 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.652 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:36.652 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.258806+0000", 2021-10-08T19:26:36.652 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:36.652 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.652 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.653 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:36.653 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.258804+0000", 2021-10-08T19:26:36.653 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:26:36.653 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.654 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.654 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:36.654 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.258828+0000", 2021-10-08T19:26:36.654 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3951000000000002e-05 2021-10-08T19:26:36.654 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.655 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.655 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:36.655 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.258839+0000", 2021-10-08T19:26:36.655 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1347e-05 2021-10-08T19:26:36.656 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.656 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.656 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:36.656 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.258844+0000", 2021-10-08T19:26:36.656 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7210000000000002e-06 2021-10-08T19:26:36.657 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.657 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.657 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:36.657 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.258889+0000", 2021-10-08T19:26:36.657 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4990999999999997e-05 2021-10-08T19:26:36.658 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.658 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.658 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:36.658 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.259016+0000", 2021-10-08T19:26:36.659 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012655399999999999 2021-10-08T19:26:36.659 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.659 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.659 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,3", 2021-10-08T19:26:36.659 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.259172+0000", 2021-10-08T19:26:36.660 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015580800000000001 2021-10-08T19:26:36.660 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.660 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.660 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:26:36.660 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.263179+0000", 2021-10-08T19:26:36.661 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0040076130000000001 2021-10-08T19:26:36.661 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.661 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.661 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:36.661 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.264457+0000", 2021-10-08T19:26:36.662 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012778539999999999 2021-10-08T19:26:36.662 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.662 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.662 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:36.663 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.401128+0000", 2021-10-08T19:26:36.663 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.136671191 2021-10-08T19:26:36.663 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.663 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.663 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:26:36.664 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.401177+0000", 2021-10-08T19:26:36.664 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8433000000000002e-05 2021-10-08T19:26:36.664 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.664 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.665 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:36.665 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.401212+0000", 2021-10-08T19:26:36.665 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5821000000000001e-05 2021-10-08T19:26:36.665 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:36.666 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:36.666 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:36.666 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.666 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.666 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:40680 7.d 7:b1888b34:::benchmark_data_smithi097_93198_object40679:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2021-10-08T19:26:36.667 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:16.265580+0000", 2021-10-08T19:26:36.667 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 140.33832762500001, 2021-10-08T19:26:36.667 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.11452731400000001, 2021-10-08T19:26:36.667 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:36.667 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:26:36.668 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:26:36.668 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:26:36.668 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:26:36.668 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 40680 2021-10-08T19:26:36.669 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.669 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:36.669 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.669 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:36.670 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.265580+0000", 2021-10-08T19:26:36.670 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:36.670 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.671 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.671 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:36.671 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.265580+0000", 2021-10-08T19:26:36.672 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:36.672 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.672 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.672 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:36.673 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.265578+0000", 2021-10-08T19:26:36.673 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:26:36.673 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.673 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.674 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:36.674 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.265600+0000", 2021-10-08T19:26:36.674 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2099999999999998e-05 2021-10-08T19:26:36.674 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.674 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.675 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:36.675 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.265613+0000", 2021-10-08T19:26:36.675 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3249e-05 2021-10-08T19:26:36.675 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.675 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.676 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:36.676 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.265619+0000", 2021-10-08T19:26:36.676 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.648e-06 2021-10-08T19:26:36.676 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.677 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.677 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:36.677 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.265665+0000", 2021-10-08T19:26:36.677 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6724000000000002e-05 2021-10-08T19:26:36.677 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.678 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.678 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:36.678 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.265776+0000", 2021-10-08T19:26:36.678 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000111205 2021-10-08T19:26:36.678 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.679 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.679 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,3", 2021-10-08T19:26:36.679 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.265878+0000", 2021-10-08T19:26:36.679 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000102024 2021-10-08T19:26:36.680 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.680 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.680 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:26:36.680 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.267580+0000", 2021-10-08T19:26:36.680 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001701712 2021-10-08T19:26:36.681 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.681 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.681 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:36.681 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.267911+0000", 2021-10-08T19:26:36.681 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00033077699999999998 2021-10-08T19:26:36.682 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.682 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.682 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:36.682 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.380004+0000", 2021-10-08T19:26:36.683 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.112092786 2021-10-08T19:26:36.683 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.683 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.683 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:26:36.684 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.380059+0000", 2021-10-08T19:26:36.684 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5395000000000001e-05 2021-10-08T19:26:36.684 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.684 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.684 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:36.685 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.380107+0000", 2021-10-08T19:26:36.685 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8035999999999999e-05 2021-10-08T19:26:36.685 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:36.685 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:36.685 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:36.686 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.686 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.686 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:40762 7.d 7:b78dbecb:::benchmark_data_smithi097_93198_object40761:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2021-10-08T19:26:36.686 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:16.428038+0000", 2021-10-08T19:26:36.687 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 140.17586968000001, 2021-10-08T19:26:36.687 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.11199342700000001, 2021-10-08T19:26:36.687 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:36.687 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:26:36.687 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:26:36.688 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:26:36.688 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:26:36.688 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 40762 2021-10-08T19:26:36.688 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.689 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:36.689 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.689 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:36.689 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.428038+0000", 2021-10-08T19:26:36.689 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:36.690 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.690 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.690 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:36.690 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.428038+0000", 2021-10-08T19:26:36.690 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:36.691 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.691 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.691 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:36.691 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.428036+0000", 2021-10-08T19:26:36.692 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:26:36.692 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.692 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.692 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:36.692 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.428062+0000", 2021-10-08T19:26:36.693 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6928e-05 2021-10-08T19:26:36.693 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.693 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.693 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:36.693 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.428075+0000", 2021-10-08T19:26:36.694 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2199e-05 2021-10-08T19:26:36.694 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.694 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.694 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:36.695 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.428082+0000", 2021-10-08T19:26:36.695 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.922e-06 2021-10-08T19:26:36.695 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.695 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.695 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:36.696 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.428138+0000", 2021-10-08T19:26:36.696 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6746999999999997e-05 2021-10-08T19:26:36.696 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.697 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.697 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:36.697 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.428264+0000", 2021-10-08T19:26:36.697 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000125621 2021-10-08T19:26:36.698 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.698 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.698 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,3", 2021-10-08T19:26:36.698 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.428392+0000", 2021-10-08T19:26:36.698 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000128484 2021-10-08T19:26:36.699 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.699 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.699 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:26:36.699 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.431308+0000", 2021-10-08T19:26:36.700 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029157200000000001 2021-10-08T19:26:36.700 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.700 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.700 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:36.700 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.434388+0000", 2021-10-08T19:26:36.701 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030796970000000002 2021-10-08T19:26:36.701 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.701 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.701 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:36.701 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.539943+0000", 2021-10-08T19:26:36.702 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.10555485000000001 2021-10-08T19:26:36.702 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.702 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.702 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:26:36.703 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.539994+0000", 2021-10-08T19:26:36.703 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0979000000000001e-05 2021-10-08T19:26:36.703 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.703 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.704 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:36.704 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.540031+0000", 2021-10-08T19:26:36.704 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7570000000000001e-05 2021-10-08T19:26:36.704 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:36.704 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:36.705 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:36.705 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.705 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.705 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:58801 7.d 7:b262281b:::benchmark_data_smithi097_93198_object58800:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2021-10-08T19:26:36.705 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:38.366307+0000", 2021-10-08T19:26:36.706 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 118.237600775, 2021-10-08T19:26:36.706 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.21342960399999999, 2021-10-08T19:26:36.706 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:36.706 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:26:36.707 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:26:36.707 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:26:36.707 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:26:36.707 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 58801 2021-10-08T19:26:36.707 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.708 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:36.708 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.708 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:36.708 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366307+0000", 2021-10-08T19:26:36.708 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:36.709 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.709 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.709 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:36.709 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366307+0000", 2021-10-08T19:26:36.710 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:36.710 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.710 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.710 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:36.710 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366305+0000", 2021-10-08T19:26:36.711 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:26:36.711 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.711 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.711 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:36.711 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366336+0000", 2021-10-08T19:26:36.712 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0963000000000002e-05 2021-10-08T19:26:36.712 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.712 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.712 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:36.712 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366346+0000", 2021-10-08T19:26:36.713 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0647e-05 2021-10-08T19:26:36.713 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.713 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.713 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:36.714 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366352+0000", 2021-10-08T19:26:36.714 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2009999999999996e-06 2021-10-08T19:26:36.714 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.714 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.714 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:36.715 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.378942+0000", 2021-10-08T19:26:36.715 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012589107 2021-10-08T19:26:36.715 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.715 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.715 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:36.716 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.379124+0000", 2021-10-08T19:26:36.716 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00018230199999999999 2021-10-08T19:26:36.716 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.716 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.717 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,6", 2021-10-08T19:26:36.717 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.379321+0000", 2021-10-08T19:26:36.717 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019685699999999999 2021-10-08T19:26:36.717 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.717 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.718 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:26:36.718 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.383371+0000", 2021-10-08T19:26:36.718 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0040499960000000002 2021-10-08T19:26:36.718 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.718 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.719 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:36.719 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.387388+0000", 2021-10-08T19:26:36.719 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0040169519999999998 2021-10-08T19:26:36.719 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.720 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.720 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:36.720 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.577524+0000", 2021-10-08T19:26:36.720 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.19013630400000001 2021-10-08T19:26:36.720 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.721 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.721 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:26:36.721 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.577581+0000", 2021-10-08T19:26:36.721 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6897000000000001e-05 2021-10-08T19:26:36.721 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.722 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.722 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:36.722 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.579736+0000", 2021-10-08T19:26:36.722 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021554209999999998 2021-10-08T19:26:36.722 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:36.723 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:36.723 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:36.723 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.723 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.723 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:58813 7.d 7:b624bad3:::benchmark_data_smithi097_93198_object58812:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2021-10-08T19:26:36.724 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:38.380295+0000", 2021-10-08T19:26:36.724 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 118.223612524, 2021-10-08T19:26:36.724 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.20140481099999999, 2021-10-08T19:26:36.724 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:36.725 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:26:36.725 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:26:36.725 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:26:36.725 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:26:36.725 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 58813 2021-10-08T19:26:36.726 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.726 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:36.726 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.726 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:36.726 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.380295+0000", 2021-10-08T19:26:36.727 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:36.727 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.727 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.727 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:36.728 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.380295+0000", 2021-10-08T19:26:36.728 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:36.728 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.728 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.728 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:36.729 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.380293+0000", 2021-10-08T19:26:36.729 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2021-10-08T19:26:36.729 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.729 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.729 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:36.730 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.380324+0000", 2021-10-08T19:26:36.730 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0212000000000001e-05 2021-10-08T19:26:36.730 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.730 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.731 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:36.731 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.380338+0000", 2021-10-08T19:26:36.731 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4177e-05 2021-10-08T19:26:36.731 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.731 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.732 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:36.732 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.380346+0000", 2021-10-08T19:26:36.732 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0989999999999999e-06 2021-10-08T19:26:36.732 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.733 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.733 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:36.733 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.381197+0000", 2021-10-08T19:26:36.733 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00085129300000000004 2021-10-08T19:26:36.733 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.734 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.734 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:36.734 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.381351+0000", 2021-10-08T19:26:36.734 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000153669 2021-10-08T19:26:36.734 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.735 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.735 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,6", 2021-10-08T19:26:36.735 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.381543+0000", 2021-10-08T19:26:36.735 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000192041 2021-10-08T19:26:36.736 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.736 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.736 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:26:36.736 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.384790+0000", 2021-10-08T19:26:36.736 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032473440000000001 2021-10-08T19:26:36.737 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.737 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.737 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:36.737 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.387435+0000", 2021-10-08T19:26:36.738 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00264438 2021-10-08T19:26:36.738 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.738 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.738 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:36.738 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.579787+0000", 2021-10-08T19:26:36.739 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.192352147 2021-10-08T19:26:36.739 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.739 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.739 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:26:36.740 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.579842+0000", 2021-10-08T19:26:36.740 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4979999999999999e-05 2021-10-08T19:26:36.740 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.740 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.740 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:36.741 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.581700+0000", 2021-10-08T19:26:36.741 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001857949 2021-10-08T19:26:36.741 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:36.741 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:36.741 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:36.742 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.742 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.742 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:58830 7.d 7:bfd40ba8:::benchmark_data_smithi097_93198_object58829:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2021-10-08T19:26:36.742 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:38.400825+0000", 2021-10-08T19:26:36.742 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 118.20308251500001, 2021-10-08T19:26:36.743 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.18274169400000001, 2021-10-08T19:26:36.743 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:36.743 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:26:36.743 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:26:36.744 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:26:36.744 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:26:36.744 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 58830 2021-10-08T19:26:36.744 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.744 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:36.745 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.745 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:36.745 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.400825+0000", 2021-10-08T19:26:36.745 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:36.745 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.746 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.746 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:36.746 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.400825+0000", 2021-10-08T19:26:36.746 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:36.747 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.747 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.747 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:36.747 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.400822+0000", 2021-10-08T19:26:36.747 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2021-10-08T19:26:36.748 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.748 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.748 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:36.748 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.400847+0000", 2021-10-08T19:26:36.749 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5021999999999999e-05 2021-10-08T19:26:36.749 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.749 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.749 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:36.749 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.400864+0000", 2021-10-08T19:26:36.750 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7246999999999999e-05 2021-10-08T19:26:36.750 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.750 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.750 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:36.751 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.400872+0000", 2021-10-08T19:26:36.751 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.055e-06 2021-10-08T19:26:36.751 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.751 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.751 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:36.752 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.400922+0000", 2021-10-08T19:26:36.752 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0009999999999997e-05 2021-10-08T19:26:36.752 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.752 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.753 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:36.753 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.401012+0000", 2021-10-08T19:26:36.753 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9949000000000002e-05 2021-10-08T19:26:36.753 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.753 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.754 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,6", 2021-10-08T19:26:36.754 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.401133+0000", 2021-10-08T19:26:36.754 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012076800000000001 2021-10-08T19:26:36.754 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.754 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.755 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:36.755 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.404122+0000", 2021-10-08T19:26:36.755 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002988952 2021-10-08T19:26:36.755 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.756 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.756 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:26:36.756 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.407283+0000", 2021-10-08T19:26:36.756 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031605420000000001 2021-10-08T19:26:36.756 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.757 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.757 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:36.757 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.581757+0000", 2021-10-08T19:26:36.757 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.174474874 2021-10-08T19:26:36.757 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.758 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.758 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:26:36.758 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.581813+0000", 2021-10-08T19:26:36.758 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5517999999999999e-05 2021-10-08T19:26:36.759 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.759 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.759 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:36.759 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.583567+0000", 2021-10-08T19:26:36.759 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017537 2021-10-08T19:26:36.760 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:36.760 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:36.760 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:36.760 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.760 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.761 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:58833 7.d 7:bb6e1eba:::benchmark_data_smithi097_93198_object58832:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2021-10-08T19:26:36.761 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:38.407683+0000", 2021-10-08T19:26:36.761 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 118.196224128, 2021-10-08T19:26:36.761 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.177663185, 2021-10-08T19:26:36.762 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:36.762 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:26:36.762 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:26:36.762 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:26:36.762 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:26:36.763 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 58833 2021-10-08T19:26:36.763 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.763 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:36.763 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.763 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:36.765 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.407683+0000", 2021-10-08T19:26:36.765 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:36.766 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.766 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.766 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:36.767 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.407683+0000", 2021-10-08T19:26:36.767 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:36.767 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.767 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.768 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:36.768 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.407681+0000", 2021-10-08T19:26:36.768 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:26:36.768 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.768 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.769 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:36.769 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.407704+0000", 2021-10-08T19:26:36.769 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2785e-05 2021-10-08T19:26:36.769 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.770 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.770 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:36.770 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.407719+0000", 2021-10-08T19:26:36.770 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4941e-05 2021-10-08T19:26:36.770 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.771 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.771 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:36.771 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.407726+0000", 2021-10-08T19:26:36.771 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0899999999999999e-06 2021-10-08T19:26:36.772 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.772 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.772 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:36.772 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.407769+0000", 2021-10-08T19:26:36.772 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3069999999999999e-05 2021-10-08T19:26:36.773 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.773 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.773 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:36.773 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.407870+0000", 2021-10-08T19:26:36.774 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000100815 2021-10-08T19:26:36.774 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.774 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.774 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,6", 2021-10-08T19:26:36.774 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.407982+0000", 2021-10-08T19:26:36.775 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011223200000000001 2021-10-08T19:26:36.775 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.775 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.775 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:26:36.776 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.410231+0000", 2021-10-08T19:26:36.776 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0022488230000000001 2021-10-08T19:26:36.776 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.776 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.776 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:36.777 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.410409+0000", 2021-10-08T19:26:36.777 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017758100000000001 2021-10-08T19:26:36.777 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.777 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.778 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:36.778 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.583616+0000", 2021-10-08T19:26:36.778 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.17320713900000001 2021-10-08T19:26:36.778 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.778 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.779 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:26:36.779 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.583671+0000", 2021-10-08T19:26:36.779 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5509e-05 2021-10-08T19:26:36.779 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.780 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.780 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:36.780 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.585347+0000", 2021-10-08T19:26:36.780 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001675244 2021-10-08T19:26:36.780 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:36.781 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:36.781 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:36.781 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.781 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.782 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:89507 7.d 7:b52f4359:::benchmark_data_smithi097_93198_object89506:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e135)", 2021-10-08T19:26:36.782 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:20.134189+0000", 2021-10-08T19:26:36.782 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 76.469718290000003, 2021-10-08T19:26:36.782 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.11608017299999999, 2021-10-08T19:26:36.782 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:36.783 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:26:36.783 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:26:36.783 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:26:36.783 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:26:36.784 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 89507 2021-10-08T19:26:36.784 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.784 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:36.784 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.784 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:36.785 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:20.134189+0000", 2021-10-08T19:26:36.785 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:36.785 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.785 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.785 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:36.786 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:20.134189+0000", 2021-10-08T19:26:36.786 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:36.786 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.786 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.787 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:36.787 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:20.134187+0000", 2021-10-08T19:26:36.787 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2021-10-08T19:26:36.787 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.787 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.788 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:36.788 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:20.134214+0000", 2021-10-08T19:26:36.788 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7475e-05 2021-10-08T19:26:36.788 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.789 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.789 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:36.789 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:20.134227+0000", 2021-10-08T19:26:36.789 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2646999999999999e-05 2021-10-08T19:26:36.789 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.790 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.790 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:36.790 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:20.134233+0000", 2021-10-08T19:26:36.790 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8179999999999998e-06 2021-10-08T19:26:36.790 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.791 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.791 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:36.791 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:20.139161+0000", 2021-10-08T19:26:36.791 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0049275330000000004 2021-10-08T19:26:36.792 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.792 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.792 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:36.792 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:20.139320+0000", 2021-10-08T19:26:36.792 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000159483 2021-10-08T19:26:36.793 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.793 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.793 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,6", 2021-10-08T19:26:36.793 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:20.139561+0000", 2021-10-08T19:26:36.793 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024085900000000001 2021-10-08T19:26:36.794 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.794 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.794 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:36.794 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:20.147154+0000", 2021-10-08T19:26:36.795 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.007592484 2021-10-08T19:26:36.795 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.795 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.795 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:26:36.796 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:20.147171+0000", 2021-10-08T19:26:36.796 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7572999999999999e-05 2021-10-08T19:26:36.796 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.796 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.796 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:36.797 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:20.248227+0000", 2021-10-08T19:26:36.797 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.10105518199999999 2021-10-08T19:26:36.797 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.797 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.797 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:26:36.798 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:20.248287+0000", 2021-10-08T19:26:36.798 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0270999999999999e-05 2021-10-08T19:26:36.798 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.798 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.799 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:36.799 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:20.250269+0000", 2021-10-08T19:26:36.799 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0019825200000000002 2021-10-08T19:26:36.799 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:36.799 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:36.800 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:36.800 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.800 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.800 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:89510 7.d 7:b13cd8c5:::benchmark_data_smithi097_93198_object89509:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e135)", 2021-10-08T19:26:36.801 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:20.139133+0000", 2021-10-08T19:26:36.801 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 76.464774704999996, 2021-10-08T19:26:36.801 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.124548306, 2021-10-08T19:26:36.801 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:36.801 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:26:36.802 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:26:36.802 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:26:36.802 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:26:36.802 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 89510 2021-10-08T19:26:36.802 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.803 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:36.803 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.803 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:36.803 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:20.139133+0000", 2021-10-08T19:26:36.804 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:36.804 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.804 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.804 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:36.805 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:20.139133+0000", 2021-10-08T19:26:36.805 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:36.805 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.805 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.806 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:36.806 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:20.139131+0000", 2021-10-08T19:26:36.806 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:26:36.807 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.807 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.807 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:36.808 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:20.139155+0000", 2021-10-08T19:26:36.808 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.482e-05 2021-10-08T19:26:36.808 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.808 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.809 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:36.809 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:20.139167+0000", 2021-10-08T19:26:36.809 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1731e-05 2021-10-08T19:26:36.809 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.810 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.810 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:36.810 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:20.139174+0000", 2021-10-08T19:26:36.811 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4169999999999997e-06 2021-10-08T19:26:36.811 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.811 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.811 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:36.812 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:20.141948+0000", 2021-10-08T19:26:36.812 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002773977 2021-10-08T19:26:36.812 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.812 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.813 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:36.813 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:20.142105+0000", 2021-10-08T19:26:36.813 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015737800000000001 2021-10-08T19:26:36.813 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.814 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.814 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,6", 2021-10-08T19:26:36.814 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:20.142332+0000", 2021-10-08T19:26:36.814 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022705699999999999 2021-10-08T19:26:36.814 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.815 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.815 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:26:36.815 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:20.147181+0000", 2021-10-08T19:26:36.815 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0048494300000000001 2021-10-08T19:26:36.816 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.816 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.816 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:36.816 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:20.152453+0000", 2021-10-08T19:26:36.816 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0052714010000000002 2021-10-08T19:26:36.817 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.817 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.817 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:36.817 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:20.261567+0000", 2021-10-08T19:26:36.817 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.10911431100000001 2021-10-08T19:26:36.818 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.818 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.818 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:26:36.818 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:20.261631+0000", 2021-10-08T19:26:36.819 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4271999999999997e-05 2021-10-08T19:26:36.819 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.819 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.819 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:36.819 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:20.263681+0000", 2021-10-08T19:26:36.820 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002049698 2021-10-08T19:26:36.820 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:36.820 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:36.820 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:36.820 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.821 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.821 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:89516 7.d 7:b5e4c128:::benchmark_data_smithi097_93198_object89515:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e135)", 2021-10-08T19:26:36.821 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:20.143585+0000", 2021-10-08T19:26:36.821 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 76.460322126999998, 2021-10-08T19:26:36.822 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.122152119, 2021-10-08T19:26:36.822 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:36.822 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:26:36.822 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:26:36.823 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:26:36.823 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:26:36.823 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 89516 2021-10-08T19:26:36.823 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.823 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:36.824 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.824 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:36.824 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:20.143585+0000", 2021-10-08T19:26:36.824 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:36.825 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.825 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.825 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:36.825 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:20.143585+0000", 2021-10-08T19:26:36.825 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:36.826 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.826 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.826 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:36.826 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:20.143583+0000", 2021-10-08T19:26:36.827 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:26:36.827 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.827 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.827 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:36.827 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:20.143617+0000", 2021-10-08T19:26:36.828 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4536000000000003e-05 2021-10-08T19:26:36.828 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.828 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.828 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:36.828 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:20.143635+0000", 2021-10-08T19:26:36.829 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7102999999999999e-05 2021-10-08T19:26:36.829 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.829 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.829 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:36.830 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:20.143642+0000", 2021-10-08T19:26:36.830 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.464e-06 2021-10-08T19:26:36.830 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.830 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.830 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:36.831 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:20.144767+0000", 2021-10-08T19:26:36.831 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001125486 2021-10-08T19:26:36.831 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.831 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.832 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:36.832 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:20.144901+0000", 2021-10-08T19:26:36.832 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013343799999999999 2021-10-08T19:26:36.832 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.832 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.833 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,6", 2021-10-08T19:26:36.833 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:20.145072+0000", 2021-10-08T19:26:36.833 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017059399999999999 2021-10-08T19:26:36.833 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.834 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.834 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:26:36.834 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:20.147255+0000", 2021-10-08T19:26:36.834 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021830769999999998 2021-10-08T19:26:36.834 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.835 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.835 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:36.835 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:20.152493+0000", 2021-10-08T19:26:36.835 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0052386339999999998 2021-10-08T19:26:36.836 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.836 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.836 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:36.836 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:20.263888+0000", 2021-10-08T19:26:36.836 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.111394629 2021-10-08T19:26:36.837 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.837 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.837 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:26:36.837 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:20.263948+0000", 2021-10-08T19:26:36.838 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0334999999999997e-05 2021-10-08T19:26:36.838 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.838 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.838 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:36.838 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:20.265737+0000", 2021-10-08T19:26:36.839 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017892769999999999 2021-10-08T19:26:36.839 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:36.839 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:36.839 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:36.840 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.840 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.840 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:114101 7.b 7:d8d00942:::benchmark_data_smithi097_93198_object22281:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e145)", 2021-10-08T19:26:36.840 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:53.641317+0000", 2021-10-08T19:26:36.840 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 42.962590955000003, 2021-10-08T19:26:36.841 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.120522852, 2021-10-08T19:26:36.841 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:36.841 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:26:36.841 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:26:36.842 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:26:36.842 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:26:36.842 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 114101 2021-10-08T19:26:36.842 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.842 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:36.843 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.843 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:36.843 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.641317+0000", 2021-10-08T19:26:36.843 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:36.843 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.844 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.844 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:36.844 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.641317+0000", 2021-10-08T19:26:36.844 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:36.845 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.845 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.845 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:36.845 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.641315+0000", 2021-10-08T19:26:36.845 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:26:36.846 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.846 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.846 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:36.847 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.641321+0000", 2021-10-08T19:26:36.847 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1890000000000004e-06 2021-10-08T19:26:36.847 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.848 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.848 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:36.848 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.641330+0000", 2021-10-08T19:26:36.849 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2119999999999992e-06 2021-10-08T19:26:36.849 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.849 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.849 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:36.849 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.641336+0000", 2021-10-08T19:26:36.850 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6239999999999999e-06 2021-10-08T19:26:36.850 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.850 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.850 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:36.851 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.641384+0000", 2021-10-08T19:26:36.851 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7911000000000003e-05 2021-10-08T19:26:36.851 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.851 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.852 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:36.852 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.641523+0000", 2021-10-08T19:26:36.852 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000139271 2021-10-08T19:26:36.852 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.853 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.853 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5,6", 2021-10-08T19:26:36.853 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.641620+0000", 2021-10-08T19:26:36.853 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.7214999999999997e-05 2021-10-08T19:26:36.853 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.854 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.854 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:26:36.854 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.645629+0000", 2021-10-08T19:26:36.854 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0040093719999999998 2021-10-08T19:26:36.855 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.855 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.855 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:36.855 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.758812+0000", 2021-10-08T19:26:36.855 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.11318253 2021-10-08T19:26:36.856 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.856 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.856 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:36.856 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.759887+0000", 2021-10-08T19:26:36.857 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001075515 2021-10-08T19:26:36.857 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.857 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.857 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:26:36.857 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.759943+0000", 2021-10-08T19:26:36.858 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5915999999999998e-05 2021-10-08T19:26:36.858 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.858 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.858 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:36.859 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.761839+0000", 2021-10-08T19:26:36.859 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001895994 2021-10-08T19:26:36.859 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:36.859 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:36.859 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:36.860 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.860 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.860 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:114105 7.d 7:b833ad2e:::benchmark_data_smithi097_93198_object22285:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e145)", 2021-10-08T19:26:36.860 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:53.643969+0000", 2021-10-08T19:26:36.860 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 42.959938772000001, 2021-10-08T19:26:36.861 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.12316441, 2021-10-08T19:26:36.861 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:36.861 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:26:36.861 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:26:36.862 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:26:36.862 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:26:36.862 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 114105 2021-10-08T19:26:36.862 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.863 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:36.863 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.863 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:36.863 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.643969+0000", 2021-10-08T19:26:36.863 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:36.864 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.864 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.864 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:36.864 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.643969+0000", 2021-10-08T19:26:36.865 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:36.865 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.865 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.865 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:36.865 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.643967+0000", 2021-10-08T19:26:36.866 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:26:36.866 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.866 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.866 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:36.867 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.643973+0000", 2021-10-08T19:26:36.867 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5629999999999997e-06 2021-10-08T19:26:36.867 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.867 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.867 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:36.868 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.643983+0000", 2021-10-08T19:26:36.868 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5149999999999995e-06 2021-10-08T19:26:36.868 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.868 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.869 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:36.869 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.643989+0000", 2021-10-08T19:26:36.869 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8540000000000002e-06 2021-10-08T19:26:36.869 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.869 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.870 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:36.870 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.644034+0000", 2021-10-08T19:26:36.870 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4875e-05 2021-10-08T19:26:36.870 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.870 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.871 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:36.871 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.644201+0000", 2021-10-08T19:26:36.871 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000167331 2021-10-08T19:26:36.871 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.872 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.872 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,6", 2021-10-08T19:26:36.872 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.644362+0000", 2021-10-08T19:26:36.872 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000161528 2021-10-08T19:26:36.872 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.873 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.873 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:26:36.873 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.646784+0000", 2021-10-08T19:26:36.873 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0024220800000000001 2021-10-08T19:26:36.873 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.874 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.874 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:36.874 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.765288+0000", 2021-10-08T19:26:36.874 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.118503938 2021-10-08T19:26:36.875 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.875 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.875 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:36.875 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.765464+0000", 2021-10-08T19:26:36.875 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017512800000000001 2021-10-08T19:26:36.876 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.876 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.876 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:26:36.876 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.765524+0000", 2021-10-08T19:26:36.877 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0259e-05 2021-10-08T19:26:36.877 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.877 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.877 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:36.877 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.767133+0000", 2021-10-08T19:26:36.878 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001609311 2021-10-08T19:26:36.878 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:36.878 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:36.878 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:36.879 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.879 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.879 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:114109 7.b 7:db95c975:::benchmark_data_smithi097_93198_object22289:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e145)", 2021-10-08T19:26:36.879 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:53.644038+0000", 2021-10-08T19:26:36.879 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 42.959869757, 2021-10-08T19:26:36.880 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.119603691, 2021-10-08T19:26:36.880 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:36.880 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:26:36.880 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:26:36.880 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:26:36.881 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:26:36.881 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 114109 2021-10-08T19:26:36.881 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.881 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:36.882 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.882 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:36.882 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.644038+0000", 2021-10-08T19:26:36.882 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:36.882 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.883 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.883 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:36.883 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.644038+0000", 2021-10-08T19:26:36.883 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:36.883 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.884 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.884 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:36.884 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.644037+0000", 2021-10-08T19:26:36.884 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:26:36.885 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.885 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.885 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:36.885 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.644041+0000", 2021-10-08T19:26:36.886 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1520000000000002e-06 2021-10-08T19:26:36.886 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.886 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.886 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:36.887 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.644047+0000", 2021-10-08T19:26:36.887 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4300000000000003e-06 2021-10-08T19:26:36.887 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.887 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.887 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:36.888 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.644051+0000", 2021-10-08T19:26:36.888 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9840000000000003e-06 2021-10-08T19:26:36.888 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.888 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.888 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:36.889 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.645657+0000", 2021-10-08T19:26:36.889 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0016057269999999999 2021-10-08T19:26:36.889 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.889 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.890 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:36.890 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.645802+0000", 2021-10-08T19:26:36.890 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014541200000000001 2021-10-08T19:26:36.890 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.890 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.891 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5,6", 2021-10-08T19:26:36.891 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.645958+0000", 2021-10-08T19:26:36.891 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015551000000000001 2021-10-08T19:26:36.891 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.892 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.892 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:26:36.892 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.758824+0000", 2021-10-08T19:26:36.892 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.112866586 2021-10-08T19:26:36.892 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.893 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.893 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:36.893 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.759317+0000", 2021-10-08T19:26:36.893 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00049284999999999997 2021-10-08T19:26:36.893 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.894 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.894 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:36.894 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.762046+0000", 2021-10-08T19:26:36.894 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0027282109999999999 2021-10-08T19:26:36.895 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.895 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.895 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:26:36.895 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.762109+0000", 2021-10-08T19:26:36.896 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3596000000000006e-05 2021-10-08T19:26:36.896 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.897 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.897 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:36.897 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.763641+0000", 2021-10-08T19:26:36.897 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0015322929999999999 2021-10-08T19:26:36.898 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:36.898 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:36.898 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:36.898 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.899 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.899 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop_reply(client.24796.0:114101 7.b e145/113 ondisk, result = 0)", 2021-10-08T19:26:36.899 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:53.647382+0000", 2021-10-08T19:26:36.899 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 42.956525051, 2021-10-08T19:26:36.899 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.11143236099999999, 2021-10-08T19:26:36.900 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:36.900 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2021-10-08T19:26:36.900 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:36.900 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.900 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:36.901 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.647382+0000", 2021-10-08T19:26:36.901 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:36.901 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.901 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.901 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:36.902 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.647382+0000", 2021-10-08T19:26:36.902 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:36.902 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.902 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.903 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:36.903 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.647382+0000", 2021-10-08T19:26:36.903 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:26:36.904 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.904 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.904 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:36.904 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.647386+0000", 2021-10-08T19:26:36.905 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4240000000000003e-06 2021-10-08T19:26:36.905 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.905 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.905 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:36.905 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.647392+0000", 2021-10-08T19:26:36.906 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2210000000000002e-06 2021-10-08T19:26:36.906 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.906 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.906 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:36.907 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.647399+0000", 2021-10-08T19:26:36.907 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.207e-06 2021-10-08T19:26:36.907 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.907 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.908 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:36.908 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.758793+0000", 2021-10-08T19:26:36.908 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.1113947 2021-10-08T19:26:36.908 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.909 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.909 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:36.909 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.758803+0000", 2021-10-08T19:26:36.909 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0215e-05 2021-10-08T19:26:36.910 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.910 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.910 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:36.910 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.758815+0000", 2021-10-08T19:26:36.910 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1328000000000001e-05 2021-10-08T19:26:36.911 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:36.911 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:36.911 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:36.911 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.912 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.912 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.24796.0:114108 7.0 e145/94 7:0cc89f6d:::benchmark_data_smithi097_93198_object22288:head v 145'7000, mlcod=145'6998)", 2021-10-08T19:26:36.912 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:53.647406+0000", 2021-10-08T19:26:36.912 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 42.956501015000001, 2021-10-08T19:26:36.913 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.11187144, 2021-10-08T19:26:36.913 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:36.913 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:26:36.913 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:36.914 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.914 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:36.914 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.647406+0000", 2021-10-08T19:26:36.914 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:36.914 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.915 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.915 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:36.915 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.647406+0000", 2021-10-08T19:26:36.916 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:36.916 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.916 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.916 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:36.917 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.647406+0000", 2021-10-08T19:26:36.917 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2021-10-08T19:26:36.917 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.917 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.917 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:36.918 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.647412+0000", 2021-10-08T19:26:36.918 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8710000000000002e-06 2021-10-08T19:26:36.918 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.918 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.919 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:36.919 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.647417+0000", 2021-10-08T19:26:36.919 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9400000000000001e-06 2021-10-08T19:26:36.919 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.920 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.920 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:36.920 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.647421+0000", 2021-10-08T19:26:36.920 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8940000000000003e-06 2021-10-08T19:26:36.920 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.921 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.921 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:36.921 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.647452+0000", 2021-10-08T19:26:36.922 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1724000000000003e-05 2021-10-08T19:26:36.922 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.922 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.922 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:36.923 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.756315+0000", 2021-10-08T19:26:36.923 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.108862166 2021-10-08T19:26:36.923 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.923 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.923 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:26:36.924 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.759255+0000", 2021-10-08T19:26:36.924 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029402740000000001 2021-10-08T19:26:36.924 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.925 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.925 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:36.925 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.759278+0000", 2021-10-08T19:26:36.925 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3051e-05 2021-10-08T19:26:36.925 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:36.926 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:36.926 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:36.926 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.926 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.927 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.24796.0:114111 7.2 e145/94 7:47e07a5c:::benchmark_data_smithi097_93198_object22291:head v 145'7201, mlcod=145'7199)", 2021-10-08T19:26:36.927 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:53.647440+0000", 2021-10-08T19:26:36.927 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 42.956467265000001, 2021-10-08T19:26:36.927 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.11161810799999999, 2021-10-08T19:26:36.927 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:36.928 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:26:36.928 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:36.928 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.928 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:36.928 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.647440+0000", 2021-10-08T19:26:36.929 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:36.929 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.929 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.930 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:36.930 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.647440+0000", 2021-10-08T19:26:36.930 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:36.930 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.930 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.931 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:36.931 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.647440+0000", 2021-10-08T19:26:36.931 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2021-10-08T19:26:36.931 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.932 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.932 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:36.932 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.647445+0000", 2021-10-08T19:26:36.932 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4310000000000002e-06 2021-10-08T19:26:36.932 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.933 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.933 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:36.933 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.647450+0000", 2021-10-08T19:26:36.933 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3680000000000001e-06 2021-10-08T19:26:36.934 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.934 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.934 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:36.934 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.647454+0000", 2021-10-08T19:26:36.934 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2219999999999998e-06 2021-10-08T19:26:36.935 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.935 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.935 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:36.935 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.756274+0000", 2021-10-08T19:26:36.936 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.108820023 2021-10-08T19:26:36.936 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.936 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.936 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:36.936 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.756297+0000", 2021-10-08T19:26:36.937 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2971000000000001e-05 2021-10-08T19:26:36.937 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.937 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.937 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:26:36.938 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.759019+0000", 2021-10-08T19:26:36.938 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0027227309999999999 2021-10-08T19:26:36.938 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.938 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.938 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:36.939 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.759058+0000", 2021-10-08T19:26:36.939 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8991e-05 2021-10-08T19:26:36.939 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:36.940 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:36.940 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:36.940 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.940 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.940 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop_reply(client.24796.0:114105 7.d e145/113 ondisk, result = 0)", 2021-10-08T19:26:36.941 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:53.648188+0000", 2021-10-08T19:26:36.941 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 42.955719983999998, 2021-10-08T19:26:36.941 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.11710287900000001, 2021-10-08T19:26:36.941 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:36.942 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2021-10-08T19:26:36.942 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:36.942 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.942 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:36.943 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.648188+0000", 2021-10-08T19:26:36.943 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:36.943 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.943 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.943 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:36.944 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.648188+0000", 2021-10-08T19:26:36.944 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:36.944 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.944 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.945 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:36.945 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.648186+0000", 2021-10-08T19:26:36.945 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:26:36.945 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.945 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.946 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:36.946 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.648192+0000", 2021-10-08T19:26:36.948 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.857e-06 2021-10-08T19:26:36.948 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.949 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.949 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:36.949 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.756282+0000", 2021-10-08T19:26:36.949 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.10809008000000001 2021-10-08T19:26:36.950 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.950 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.950 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:36.950 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.756290+0000", 2021-10-08T19:26:36.951 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.9889999999999992e-06 2021-10-08T19:26:36.951 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.951 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.951 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:36.952 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.765272+0000", 2021-10-08T19:26:36.952 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0089820939999999995 2021-10-08T19:26:36.952 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.952 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.953 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:36.953 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.765281+0000", 2021-10-08T19:26:36.953 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1340000000000004e-06 2021-10-08T19:26:36.953 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.953 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.954 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:36.954 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.765290+0000", 2021-10-08T19:26:36.954 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.8260000000000005e-06 2021-10-08T19:26:36.954 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:36.955 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:36.955 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:36.955 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.955 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.955 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:116723 7.d 7:b630d989:::benchmark_data_smithi097_93198_object24903:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e146)", 2021-10-08T19:26:36.956 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:57.222143+0000", 2021-10-08T19:26:36.956 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 39.381764144999998, 2021-10-08T19:26:36.956 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.107575372, 2021-10-08T19:26:36.957 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:36.957 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:26:36.958 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:26:36.958 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:26:36.958 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:26:36.958 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 116723 2021-10-08T19:26:36.959 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.959 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:36.959 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.959 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:36.960 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.222143+0000", 2021-10-08T19:26:36.960 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:36.960 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.960 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.960 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:36.961 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.222143+0000", 2021-10-08T19:26:36.961 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:36.961 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.961 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.962 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:36.962 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.222143+0000", 2021-10-08T19:26:36.962 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2021-10-08T19:26:36.963 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.963 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.963 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:36.963 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.222145+0000", 2021-10-08T19:26:36.963 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6400000000000001e-06 2021-10-08T19:26:36.964 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.964 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.964 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:36.964 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.222151+0000", 2021-10-08T19:26:36.964 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1159999999999998e-06 2021-10-08T19:26:36.965 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.965 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.965 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:36.965 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.222155+0000", 2021-10-08T19:26:36.966 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.442e-06 2021-10-08T19:26:36.966 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.966 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.967 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:36.967 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.230865+0000", 2021-10-08T19:26:36.967 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0087099320000000001 2021-10-08T19:26:36.967 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.968 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.968 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for rw locks", 2021-10-08T19:26:36.968 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.230981+0000", 2021-10-08T19:26:36.968 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115828 2021-10-08T19:26:36.968 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.969 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.969 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:36.969 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.239832+0000", 2021-10-08T19:26:36.969 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0088513729999999992 2021-10-08T19:26:36.969 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.970 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.970 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:36.970 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.239931+0000", 2021-10-08T19:26:36.970 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.8492999999999994e-05 2021-10-08T19:26:36.971 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.971 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.971 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,6", 2021-10-08T19:26:36.971 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.240086+0000", 2021-10-08T19:26:36.971 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015503199999999999 2021-10-08T19:26:36.972 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.972 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.972 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:26:36.972 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.245014+0000", 2021-10-08T19:26:36.972 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0049279679999999996 2021-10-08T19:26:36.973 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.973 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.973 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:36.973 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.321035+0000", 2021-10-08T19:26:36.973 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.076021285999999993 2021-10-08T19:26:36.974 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.974 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.974 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:36.974 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.328660+0000", 2021-10-08T19:26:36.975 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0076249849999999999 2021-10-08T19:26:36.975 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.975 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.976 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:26:36.976 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.328713+0000", 2021-10-08T19:26:36.976 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3359000000000002e-05 2021-10-08T19:26:36.976 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:36.976 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:36.977 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:36.977 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.329719+0000", 2021-10-08T19:26:36.977 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010054689999999999 2021-10-08T19:26:36.977 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:36.977 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:36.978 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:36.978 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:36.978 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:36.978 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:26:36.979 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:26:36.980 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:26:37.044 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:37.361 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:37 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:26:37.361 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:37 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:26:37.361 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:37 smithi097 ceph-mon[32687]: 172.21.15.117 - - [08/Oct/2021:19:26:36] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:26:37.362 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:37 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:26:37.362 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:37 smithi097 ceph-mon[32687]: pgmap v232: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 2.5 GiB data, 8.9 GiB used, 706 GiB / 715 GiB avail; 851 B/s rd, 0 B/s wr, 615 op/s; 9291/120987 objects degraded (7.679%); 1573/120987 objects misplaced (1.300%); 596 KiB/s, 28 objects/s recovering 2021-10-08T19:26:37.362 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:37 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:26:37.363 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:37 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:26:37.363 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:37 smithi097 ceph-mon[41966]: 172.21.15.117 - - [08/Oct/2021:19:26:36] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:26:37.363 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:37 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:26:37.363 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:37 smithi097 ceph-mon[41966]: pgmap v232: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 2.5 GiB data, 8.9 GiB used, 706 GiB / 715 GiB avail; 851 B/s rd, 0 B/s wr, 615 op/s; 9291/120987 objects degraded (7.679%); 1573/120987 objects misplaced (1.300%); 596 KiB/s, 28 objects/s recovering 2021-10-08T19:26:37.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:37 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:26:37.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:37 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:26:37.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:37 smithi117 ceph-mon[34585]: 172.21.15.117 - - [08/Oct/2021:19:26:36] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:26:37.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:37 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:26:37.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:37 smithi117 ceph-mon[34585]: pgmap v232: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 2.5 GiB data, 8.9 GiB used, 706 GiB / 715 GiB avail; 851 B/s rd, 0 B/s wr, 615 op/s; 9291/120987 objects degraded (7.679%); 1573/120987 objects misplaced (1.300%); 596 KiB/s, 28 objects/s recovering 2021-10-08T19:26:37.919 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2021-10-08T19:26:37.966 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:26:37.975 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:37.976 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:26:38.077 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:26:38.163 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset noscrub 2021-10-08T19:26:38.180 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:38.452 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:26:38.462 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:38.463 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:26:38.564 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:26:38.646 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:38.688 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:26:38.810 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:26:38.896 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:26:38.903 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:38.903 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:26:39.005 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:26:39.076 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:39.401 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:26:39.410 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:39.411 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:26:39.478 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:26:39.512 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:26:39.543 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:26:39.551 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:39.596 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:26:39.626 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:26:39.631 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:39.632 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:26:39.650 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:26:39.662 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:39 smithi097 ceph-mon[32687]: pgmap v233: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 2.4 GiB data, 8.6 GiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 550 op/s; 9233/118878 objects degraded (7.767%); 1573/118878 objects misplaced (1.323%); 448 KiB/s, 28 objects/s recovering 2021-10-08T19:26:39.662 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:39 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/657952707' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:26:39.663 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:39 smithi097 ceph-mon[41966]: pgmap v233: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 2.4 GiB data, 8.6 GiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 550 op/s; 9233/118878 objects degraded (7.767%); 1573/118878 objects misplaced (1.323%); 448 KiB/s, 28 objects/s recovering 2021-10-08T19:26:39.663 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:39 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/657952707' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:26:39.698 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:26:39.699 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:26:39.700 INFO:teuthology.orchestra.run.smithi117.stdout: "success": "" 2021-10-08T19:26:39.700 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:26:39.724 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:39 smithi117 ceph-mon[34585]: pgmap v233: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 2.4 GiB data, 8.6 GiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 550 op/s; 9233/118878 objects degraded (7.767%); 1573/118878 objects misplaced (1.323%); 448 KiB/s, 28 objects/s recovering 2021-10-08T19:26:39.725 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:39 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/657952707' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:26:39.733 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:26:39.748 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:26:39.769 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:39.789 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:26:39.828 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:26:39.854 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'false' 2021-10-08T19:26:39.854 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'false' 2021-10-08T19:26:39.854 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'false' 2021-10-08T19:26:39.855 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'false' 2021-10-08T19:26:39.855 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'false' 2021-10-08T19:26:39.855 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'false' 2021-10-08T19:26:39.855 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'false' 2021-10-08T19:26:39.856 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'false' 2021-10-08T19:26:39.979 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:26:39.981 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:39.982 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:26:40.083 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:26:40.113 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:40.173 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:26:40.176 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:40.177 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:26:40.278 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:26:40.309 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:40.618 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:26:40.626 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:40 smithi117 ceph-mon[34585]: Health check update: Degraded data redundancy: 9233/118878 objects degraded (7.767%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:26:40.627 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:40.628 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:26:40.729 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:26:40.796 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:40.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:40 smithi097 ceph-mon[32687]: Health check update: Degraded data redundancy: 9233/118878 objects degraded (7.767%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:26:40.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:40 smithi097 ceph-mon[41966]: Health check update: Degraded data redundancy: 9233/118878 objects degraded (7.767%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:26:41.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:41 smithi117 ceph-mon[34585]: pgmap v234: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 2.2 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 937 op/s; 9175/109587 objects degraded (8.372%); 1514/109587 objects misplaced (1.382%); 448 KiB/s, 43 objects/s recovering 2021-10-08T19:26:41.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:41 smithi097 ceph-mon[41966]: pgmap v234: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 2.2 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 937 op/s; 9175/109587 objects degraded (8.372%); 1514/109587 objects misplaced (1.382%); 448 KiB/s, 43 objects/s recovering 2021-10-08T19:26:41.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:41 smithi097 ceph-mon[32687]: pgmap v234: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 2.2 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 937 op/s; 9175/109587 objects degraded (8.372%); 1514/109587 objects misplaced (1.382%); 448 KiB/s, 43 objects/s recovering 2021-10-08T19:26:42.218 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:26:42.225 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:42.226 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:26:42.327 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:26:42.361 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:42.423 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:26:42.428 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:42.429 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:26:42.530 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:26:42.597 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:42.633 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:26:42 smithi117 conmon[69189]: level=error ts=2021-10-08T19:26:42.315Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=1 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:26:42.634 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:42 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:26:42.754 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:26:42.761 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:42.762 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:26:42.864 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:26:42.891 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:42.947 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:26:42.948 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:42.949 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:26:42.970 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:26:42 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:26:42] "GET /metrics HTTP/1.1" 200 155770 "" "Prometheus/2.18.1" 2021-10-08T19:26:42.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:42 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:26:42.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:42 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:26:43.002 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2021-10-08T19:26:43.003 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:26:43.050 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:26:43.080 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:43.141 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:26:43.143 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:43.144 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:26:43.245 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:26:43.309 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:43.458 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:26:43.464 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:43.465 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:26:43.566 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:26:43.635 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:43.667 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is unset 2021-10-08T19:26:43.771 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:26:43.783 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:43.784 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:26:43.885 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:26:43.916 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:43.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:43 smithi097 ceph-mon[32687]: pgmap v235: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 2.2 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 597 B/s rd, 0 B/s wr, 443 op/s; 9175/109587 objects degraded (8.372%); 1514/109587 objects misplaced (1.382%); 0 B/s, 20 objects/s recovering 2021-10-08T19:26:43.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:26:43.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:43 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/413763755' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:26:43.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:43 smithi097 ceph-mon[32687]: from='client.34997 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:26:43.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:43 smithi097 ceph-mon[41966]: pgmap v235: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 2.2 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 597 B/s rd, 0 B/s wr, 443 op/s; 9175/109587 objects degraded (8.372%); 1514/109587 objects misplaced (1.382%); 0 B/s, 20 objects/s recovering 2021-10-08T19:26:43.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:26:43.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:43 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/413763755' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:26:43.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:43 smithi097 ceph-mon[41966]: from='client.34997 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:26:43.989 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:26:43.991 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:43.992 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:26:43.993 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:43 smithi117 ceph-mon[34585]: pgmap v235: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 2.2 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 597 B/s rd, 0 B/s wr, 443 op/s; 9175/109587 objects degraded (8.372%); 1514/109587 objects misplaced (1.382%); 0 B/s, 20 objects/s recovering 2021-10-08T19:26:43.993 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:26:43.993 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:43 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/413763755' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:26:43.993 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:43 smithi117 ceph-mon[34585]: from='client.34997 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:26:43.994 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:26:43 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:26:43] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:26:44.094 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:26:44.161 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:44.211 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2021-10-08T19:26:44.303 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2021-10-08T19:26:44.474 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:26:44.494 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:44.496 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:26:44.597 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:26:44.626 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:44.681 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:26:44.684 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:44.685 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:26:44.786 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:26:44.848 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:44 smithi097 ceph-mon[32687]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:26:44.849 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:44 smithi097 ceph-mon[32687]: from='client.34997 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:26:44.849 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:44 smithi097 ceph-mon[32687]: osdmap e156: 8 total, 8 up, 8 in 2021-10-08T19:26:44.849 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:44 smithi097 ceph-mon[41966]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:26:44.850 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:44 smithi097 ceph-mon[41966]: from='client.34997 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:26:44.850 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:44 smithi097 ceph-mon[41966]: osdmap e156: 8 total, 8 up, 8 in 2021-10-08T19:26:44.851 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:44.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:44 smithi117 ceph-mon[34585]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:26:44.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:44 smithi117 ceph-mon[34585]: from='client.34997 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:26:44.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:44 smithi117 ceph-mon[34585]: osdmap e156: 8 total, 8 up, 8 in 2021-10-08T19:26:45.042 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:26:45.073 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:26:45.081 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:26:45.087 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:45.088 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:26:45.189 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:26:45.220 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:45.277 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:26:45.278 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:45.278 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:26:45.380 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:26:45.464 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:45.620 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:26:45.630 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:45.631 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:26:45.641 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 7, 6] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2021-10-08T19:26:45.642 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2021-10-08T19:26:45.642 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd dump -f json-pretty 2021-10-08T19:26:45.732 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:26:45.759 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:45.810 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:26:45.812 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:45.814 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:26:45.914 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:26:45.940 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:45.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:45 smithi097 ceph-mon[41966]: pgmap v237: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 2.0 GiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 785 op/s; 9058/98481 objects degraded (9.198%); 1456/98481 objects misplaced (1.478%); 0 B/s, 36 objects/s recovering 2021-10-08T19:26:45.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:45 smithi097 ceph-mon[41966]: Health check update: Degraded data redundancy: 9058/98481 objects degraded (9.198%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:26:45.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:45 smithi097 ceph-mon[32687]: pgmap v237: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 2.0 GiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 785 op/s; 9058/98481 objects degraded (9.198%); 1456/98481 objects misplaced (1.478%); 0 B/s, 36 objects/s recovering 2021-10-08T19:26:45.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:45 smithi097 ceph-mon[32687]: Health check update: Degraded data redundancy: 9058/98481 objects degraded (9.198%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:26:45.997 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:26:46.000 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:46.001 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:26:46.001 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:45 smithi117 ceph-mon[34585]: pgmap v237: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 2.0 GiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 785 op/s; 9058/98481 objects degraded (9.198%); 1456/98481 objects misplaced (1.478%); 0 B/s, 36 objects/s recovering 2021-10-08T19:26:46.001 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:45 smithi117 ceph-mon[34585]: Health check update: Degraded data redundancy: 9058/98481 objects degraded (9.198%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:26:46.102 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:26:46.154 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:46.371 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:26:46 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:26:47.069 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset nodeep-scrub 2021-10-08T19:26:47.371 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:26:47.375 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:47.376 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:26:47.477 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:26:47.508 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:47.564 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:26:47.570 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:47.571 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:26:47.672 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:26:47.721 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:47.742 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:26:47.821 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:26:47.856 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:26:47.862 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:47.863 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:26:47.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:47 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:26:47.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:47 smithi117 ceph-mon[34585]: pgmap v238: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 2.0 GiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 750 op/s; 9058/98481 objects degraded (9.198%); 1456/98481 objects misplaced (1.478%); 0 B/s, 34 objects/s recovering 2021-10-08T19:26:47.964 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:26:47.975 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:47 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:26:47.976 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:47 smithi097 ceph-mon[32687]: pgmap v238: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 2.0 GiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 750 op/s; 9058/98481 objects degraded (9.198%); 1456/98481 objects misplaced (1.478%); 0 B/s, 34 objects/s recovering 2021-10-08T19:26:47.976 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:47 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:26:47.976 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:47 smithi097 ceph-mon[41966]: pgmap v238: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 2.0 GiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 750 op/s; 9058/98481 objects degraded (9.198%); 1456/98481 objects misplaced (1.478%); 0 B/s, 34 objects/s recovering 2021-10-08T19:26:48.041 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:48.425 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:26:48.430 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:48.431 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:26:48.483 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2021-10-08T19:26:48.484 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:26:48.533 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:26:48.627 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:48.878 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:26:48.895 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:48.896 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:26:48.997 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:26:49.011 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:26:49.070 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:49.072 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:26:49.114 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:26:49.155 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:26:49.195 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:26:49.226 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:26:49.264 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:26:49.295 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:26:49.315 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true' 2021-10-08T19:26:49.316 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true' 2021-10-08T19:26:49.316 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true' 2021-10-08T19:26:49.317 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true' 2021-10-08T19:26:49.317 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true' 2021-10-08T19:26:49.317 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true' 2021-10-08T19:26:49.318 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'true' 2021-10-08T19:26:49.319 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'true' 2021-10-08T19:26:49.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:49 smithi097 ceph-mon[32687]: pgmap v239: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 2.0 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 748 op/s; 9000/96423 objects degraded (9.334%); 1456/96423 objects misplaced (1.510%); 0 B/s, 34 objects/s recovering 2021-10-08T19:26:49.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:49 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1437709428' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:26:49.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:49 smithi097 ceph-mon[41966]: pgmap v239: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 2.0 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 748 op/s; 9000/96423 objects degraded (9.334%); 1456/96423 objects misplaced (1.510%); 0 B/s, 34 objects/s recovering 2021-10-08T19:26:49.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:49 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1437709428' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:26:50.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:49 smithi117 ceph-mon[34585]: pgmap v239: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 2.0 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 748 op/s; 9000/96423 objects degraded (9.334%); 1456/96423 objects misplaced (1.510%); 0 B/s, 34 objects/s recovering 2021-10-08T19:26:50.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:49 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1437709428' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:26:50.599 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:26:50.608 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:50.610 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:26:50.711 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:26:50.737 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:50.811 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:26:50.813 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:50.814 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:26:50.915 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:26:50.959 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:50.969 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:50 smithi097 ceph-mon[41966]: Health check update: Degraded data redundancy: 9000/96423 objects degraded (9.334%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:26:50.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:50 smithi097 ceph-mon[32687]: Health check update: Degraded data redundancy: 9000/96423 objects degraded (9.334%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:26:51.011 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:26:51.015 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2021-10-08T19:26:51.017 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:50 smithi117 ceph-mon[34585]: Health check update: Degraded data redundancy: 9000/96423 objects degraded (9.334%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:26:51.018 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:51.019 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:26:51.120 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:26:51.146 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:51.203 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:26:51.205 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:51.206 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:26:51.308 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:26:51.380 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:51.622 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:26:51.628 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:51.629 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:26:51.730 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:26:51.758 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:51.818 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:26:51.820 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:51.821 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:26:51.922 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:26:51.951 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:51.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:51 smithi097 ceph-mon[41966]: pgmap v240: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 1.8 GiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 738 op/s; 8942/87444 objects degraded (10.226%); 1398/87444 objects misplaced (1.599%); 0 B/s, 34 objects/s recovering 2021-10-08T19:26:51.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:51 smithi097 ceph-mon[32687]: pgmap v240: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 1.8 GiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 738 op/s; 8942/87444 objects degraded (10.226%); 1398/87444 objects misplaced (1.599%); 0 B/s, 34 objects/s recovering 2021-10-08T19:26:52.007 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:26:52.009 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:51 smithi117 ceph-mon[34585]: pgmap v240: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 1.8 GiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 738 op/s; 8942/87444 objects degraded (10.226%); 1398/87444 objects misplaced (1.599%); 0 B/s, 34 objects/s recovering 2021-10-08T19:26:52.010 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:52.011 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:26:52.112 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:26:52.175 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:52.278 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:26:52.303 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:26:52.314 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:52.315 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:26:52.416 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:26:52.479 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:52.720 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:26:52 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:26:52] "GET /metrics HTTP/1.1" 200 155770 "" "Prometheus/2.18.1" 2021-10-08T19:26:52.783 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:26:52.800 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:52.801 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:26:52.903 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:26:52.938 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:52.991 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:26:52.993 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:52 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:26:52.993 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:52 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:26:52.994 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:52.994 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:26:52.995 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:52 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:26:52.996 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:52 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:26:52.996 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:52 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:26:52.996 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:52 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:26:53.095 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:26:53.124 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:53.179 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:26:53.181 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:53.182 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:26:53.283 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:26:53.356 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:53.431 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2021-10-08T19:26:53.477 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:26:53.478 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:26:53.478 INFO:teuthology.orchestra.run.smithi097.stdout: "epoch": 157, 2021-10-08T19:26:53.479 INFO:teuthology.orchestra.run.smithi097.stdout: "fsid": "1d01f6d6-286c-11ec-8c25-001a4aab830c", 2021-10-08T19:26:53.479 INFO:teuthology.orchestra.run.smithi097.stdout: "created": "2021-10-08T19:16:25.258003+0000", 2021-10-08T19:26:53.480 INFO:teuthology.orchestra.run.smithi097.stdout: "modified": "2021-10-08T19:26:52.719967+0000", 2021-10-08T19:26:53.480 INFO:teuthology.orchestra.run.smithi097.stdout: "last_up_change": "2021-10-08T19:21:15.388758+0000", 2021-10-08T19:26:53.480 INFO:teuthology.orchestra.run.smithi097.stdout: "last_in_change": "2021-10-08T19:24:24.060804+0000", 2021-10-08T19:26:53.481 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-08T19:26:53.481 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_num": 5804032, 2021-10-08T19:26:53.482 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_set": [ 2021-10-08T19:26:53.482 INFO:teuthology.orchestra.run.smithi097.stdout: "nodeep-scrub", 2021-10-08T19:26:53.483 INFO:teuthology.orchestra.run.smithi097.stdout: "pglog_hardlimit", 2021-10-08T19:26:53.483 INFO:teuthology.orchestra.run.smithi097.stdout: "purged_snapdirs", 2021-10-08T19:26:53.483 INFO:teuthology.orchestra.run.smithi097.stdout: "recovery_deletes", 2021-10-08T19:26:53.484 INFO:teuthology.orchestra.run.smithi097.stdout: "sortbitwise" 2021-10-08T19:26:53.485 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:26:53.485 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_version": 18, 2021-10-08T19:26:53.486 INFO:teuthology.orchestra.run.smithi097.stdout: "full_ratio": 0.94999998807907104, 2021-10-08T19:26:53.486 INFO:teuthology.orchestra.run.smithi097.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-08T19:26:53.487 INFO:teuthology.orchestra.run.smithi097.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-08T19:26:53.487 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_snapshot": "", 2021-10-08T19:26:53.487 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_max": 7, 2021-10-08T19:26:53.488 INFO:teuthology.orchestra.run.smithi097.stdout: "max_osd": 8, 2021-10-08T19:26:53.488 INFO:teuthology.orchestra.run.smithi097.stdout: "require_min_compat_client": "luminous", 2021-10-08T19:26:53.488 INFO:teuthology.orchestra.run.smithi097.stdout: "min_compat_client": "luminous", 2021-10-08T19:26:53.489 INFO:teuthology.orchestra.run.smithi097.stdout: "require_osd_release": "quincy", 2021-10-08T19:26:53.489 INFO:teuthology.orchestra.run.smithi097.stdout: "pools": [ 2021-10-08T19:26:53.490 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.490 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 1, 2021-10-08T19:26:53.491 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": ".mgr", 2021-10-08T19:26:53.491 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:19:44.413311+0000", 2021-10-08T19:26:53.491 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:26:53.492 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:26:53.492 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:26:53.493 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:26:53.493 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:26:53.493 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:26:53.494 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:26:53.494 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:26:53.495 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:26:53.495 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:26:53.496 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:26:53.496 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:26:53.496 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 1, 2021-10-08T19:26:53.497 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 1, 2021-10-08T19:26:53.497 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 1, 2021-10-08T19:26:53.497 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 1, 2021-10-08T19:26:53.497 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 1, 2021-10-08T19:26:53.498 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:26:53.498 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:26:53.498 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:26:53.498 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:26:53.499 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:26:53.499 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:26:53.499 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:26:53.500 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.503 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "21", 2021-10-08T19:26:53.503 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:26:53.506 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:26:53.506 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2021-10-08T19:26:53.506 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:26:53.507 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:26:53.507 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:26:53.507 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:26:53.507 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:26:53.508 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:26:53.508 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:26:53.508 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:26:53.508 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:26:53.509 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:26:53.509 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:26:53.509 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:26:53.509 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:26:53.509 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:26:53.510 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:26:53.510 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:26:53.510 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:26:53.511 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:26:53.511 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:26:53.511 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:26:53.511 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:26:53.511 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:26:53.512 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:26:53.512 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.513 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:26:53.513 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:26:53.513 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:26:53.513 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:26:53.514 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:26:53.514 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:26:53.514 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:26:53.514 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:26:53.515 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:26:53.515 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:26:53.515 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:26:53.515 INFO:teuthology.orchestra.run.smithi097.stdout: "options": { 2021-10-08T19:26:53.515 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_min": 1 2021-10-08T19:26:53.516 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.517 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:26:53.517 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": {} 2021-10-08T19:26:53.517 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:53.518 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.518 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.518 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 2, 2021-10-08T19:26:53.519 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": ".rgw.root", 2021-10-08T19:26:53.519 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:21:21.940881+0000", 2021-10-08T19:26:53.519 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:26:53.520 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:26:53.521 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:26:53.522 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:26:53.522 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:26:53.522 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:26:53.523 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:26:53.523 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:26:53.523 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:26:53.523 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:26:53.523 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:26:53.524 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:26:53.524 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 32, 2021-10-08T19:26:53.524 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 32, 2021-10-08T19:26:53.524 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 32, 2021-10-08T19:26:53.525 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 32, 2021-10-08T19:26:53.525 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 32, 2021-10-08T19:26:53.525 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:26:53.525 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:26:53.526 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:26:53.526 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:26:53.526 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:26:53.527 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:26:53.527 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:26:53.527 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.527 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "62", 2021-10-08T19:26:53.528 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:26:53.528 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:26:53.528 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2021-10-08T19:26:53.528 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:26:53.529 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:26:53.529 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:26:53.529 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:26:53.529 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:26:53.531 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:26:53.531 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:26:53.532 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:26:53.532 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:26:53.532 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:26:53.532 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:26:53.533 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:26:53.533 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:26:53.533 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:26:53.533 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:26:53.533 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:26:53.534 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:26:53.534 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:26:53.534 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:26:53.540 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:26:53.540 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:26:53.541 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:26:53.541 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:26:53.541 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.541 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:26:53.542 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:26:53.542 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:26:53.543 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:26:53.543 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:26:53.543 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:26:53.544 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:26:53.544 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:26:53.544 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:26:53.544 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:26:53.545 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:26:53.545 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2021-10-08T19:26:53.545 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:26:53.546 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw": {} 2021-10-08T19:26:53.546 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:53.547 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.547 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.547 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 3, 2021-10-08T19:26:53.548 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "iscsi", 2021-10-08T19:26:53.548 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:21:22.536945+0000", 2021-10-08T19:26:53.548 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:26:53.549 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:26:53.549 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:26:53.549 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:26:53.550 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:26:53.550 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:26:53.550 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:26:53.551 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:26:53.551 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:26:53.551 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:26:53.552 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:26:53.553 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:26:53.553 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 23, 2021-10-08T19:26:53.553 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 23, 2021-10-08T19:26:53.553 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 23, 2021-10-08T19:26:53.554 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 23, 2021-10-08T19:26:53.554 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 23, 2021-10-08T19:26:53.554 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:26:53.554 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:26:53.555 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:26:53.555 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:26:53.555 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:26:53.555 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:26:53.556 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:26:53.556 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.556 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "132", 2021-10-08T19:26:53.556 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:26:53.556 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:26:53.557 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "131", 2021-10-08T19:26:53.557 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:26:53.557 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:26:53.557 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:26:53.558 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:26:53.558 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:26:53.558 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:26:53.558 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:26:53.559 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:26:53.559 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:26:53.559 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:26:53.559 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:26:53.559 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:26:53.560 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:26:53.560 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:26:53.560 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:26:53.561 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:26:53.561 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:26:53.561 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:26:53.561 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:26:53.561 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:26:53.562 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:26:53.562 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:26:53.562 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:26:53.562 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.563 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:26:53.563 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:26:53.563 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:26:53.563 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:26:53.564 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:26:53.564 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:26:53.564 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:26:53.564 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:26:53.565 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:26:53.565 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:26:53.565 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:26:53.565 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2021-10-08T19:26:53.565 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:26:53.566 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd": {} 2021-10-08T19:26:53.566 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:53.566 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.567 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.567 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 4, 2021-10-08T19:26:53.567 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "default.rgw.log", 2021-10-08T19:26:53.567 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:21:23.886328+0000", 2021-10-08T19:26:53.568 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:26:53.568 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:26:53.568 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:26:53.568 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:26:53.569 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:26:53.569 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:26:53.569 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:26:53.569 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:26:53.569 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:26:53.570 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:26:53.570 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:26:53.570 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:26:53.570 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 32, 2021-10-08T19:26:53.571 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 32, 2021-10-08T19:26:53.571 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 32, 2021-10-08T19:26:53.571 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 32, 2021-10-08T19:26:53.571 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 32, 2021-10-08T19:26:53.572 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:26:53.572 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:26:53.572 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:26:53.572 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:26:53.573 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:26:53.573 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:26:53.573 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:26:53.573 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.573 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "64", 2021-10-08T19:26:53.574 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:26:53.574 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:26:53.574 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2021-10-08T19:26:53.575 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:26:53.575 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:26:53.575 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:26:53.575 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:26:53.576 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:26:53.576 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:26:53.576 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:26:53.576 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:26:53.577 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:26:53.577 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:26:53.577 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:26:53.577 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:26:53.578 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:26:53.578 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:26:53.578 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:26:53.578 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:26:53.579 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:26:53.579 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:26:53.579 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:26:53.579 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:26:53.580 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:26:53.580 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:26:53.580 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:26:53.580 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.580 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:26:53.581 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:26:53.581 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:26:53.581 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:26:53.581 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:26:53.582 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:26:53.582 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:26:53.582 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:26:53.582 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:26:53.583 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:26:53.583 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:26:53.583 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2021-10-08T19:26:53.583 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:26:53.584 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw": {} 2021-10-08T19:26:53.584 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:53.584 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.584 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.585 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 5, 2021-10-08T19:26:53.585 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "default.rgw.control", 2021-10-08T19:26:53.585 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:21:25.865032+0000", 2021-10-08T19:26:53.585 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:26:53.586 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:26:53.586 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:26:53.586 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:26:53.586 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:26:53.586 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:26:53.587 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:26:53.587 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:26:53.587 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:26:53.587 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:26:53.588 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:26:53.588 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:26:53.588 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 32, 2021-10-08T19:26:53.588 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 32, 2021-10-08T19:26:53.589 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 32, 2021-10-08T19:26:53.589 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 32, 2021-10-08T19:26:53.589 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 32, 2021-10-08T19:26:53.589 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:26:53.589 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:26:53.590 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:26:53.590 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:26:53.590 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:26:53.590 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:26:53.591 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:26:53.591 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.591 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "66", 2021-10-08T19:26:53.591 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:26:53.592 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:26:53.592 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2021-10-08T19:26:53.592 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:26:53.592 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:26:53.592 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:26:53.593 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:26:53.593 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:26:53.593 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:26:53.593 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:26:53.594 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:26:53.594 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:26:53.594 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:26:53.594 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:26:53.595 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:26:53.595 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:26:53.595 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:26:53.595 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:26:53.595 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:26:53.596 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:26:53.596 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:26:53.596 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:26:53.596 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:26:53.597 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:26:53.597 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:26:53.597 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:26:53.597 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.598 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:26:53.598 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:26:53.598 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:26:53.598 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:26:53.598 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:26:53.599 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:26:53.599 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:26:53.599 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:26:53.600 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:26:53.600 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:26:53.600 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:26:53.601 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2021-10-08T19:26:53.601 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:26:53.601 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw": {} 2021-10-08T19:26:53.602 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:53.602 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.602 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.602 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 6, 2021-10-08T19:26:53.603 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "default.rgw.meta", 2021-10-08T19:26:53.603 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:21:27.940767+0000", 2021-10-08T19:26:53.603 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:26:53.604 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:26:53.604 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:26:53.604 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:26:53.604 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:26:53.605 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:26:53.605 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:26:53.605 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:26:53.605 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:26:53.606 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:26:53.606 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:26:53.607 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:26:53.607 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 32, 2021-10-08T19:26:53.607 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 32, 2021-10-08T19:26:53.607 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 32, 2021-10-08T19:26:53.608 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 32, 2021-10-08T19:26:53.608 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 32, 2021-10-08T19:26:53.608 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:26:53.608 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:26:53.608 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:26:53.609 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:26:53.609 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:26:53.609 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:26:53.609 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:26:53.610 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.610 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "69", 2021-10-08T19:26:53.610 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:26:53.610 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:26:53.611 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2021-10-08T19:26:53.611 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:26:53.611 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:26:53.614 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:26:53.614 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:26:53.614 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:26:53.615 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:26:53.615 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:26:53.615 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:26:53.615 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:26:53.616 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:26:53.616 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:26:53.616 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:26:53.616 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:26:53.616 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:26:53.617 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:26:53.617 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:26:53.617 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:26:53.617 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:26:53.618 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:26:53.618 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:26:53.618 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:26:53.618 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:26:53.618 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:26:53.619 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.619 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:26:53.619 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:26:53.619 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:26:53.620 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:26:53.620 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:26:53.620 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:26:53.620 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:26:53.620 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:26:53.621 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:26:53.621 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:26:53.621 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:26:53.621 INFO:teuthology.orchestra.run.smithi097.stdout: "options": { 2021-10-08T19:26:53.622 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_bias": 4, 2021-10-08T19:26:53.622 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_min": 8 2021-10-08T19:26:53.622 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.622 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:26:53.623 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw": {} 2021-10-08T19:26:53.628 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:53.629 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.629 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.629 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 7, 2021-10-08T19:26:53.629 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "unique_pool_0", 2021-10-08T19:26:53.630 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:23:43.485480+0000", 2021-10-08T19:26:53.630 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:26:53.630 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:26:53.630 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:26:53.631 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:26:53.631 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:26:53.631 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:26:53.631 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:26:53.631 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:26:53.632 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:26:53.632 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:26:53.632 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:26:53.632 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:26:53.633 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 16, 2021-10-08T19:26:53.633 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 16, 2021-10-08T19:26:53.633 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 16, 2021-10-08T19:26:53.633 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 16, 2021-10-08T19:26:53.634 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 16, 2021-10-08T19:26:53.634 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:26:53.634 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:26:53.634 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:26:53.634 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:26:53.635 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:26:53.635 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:26:53.635 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:26:53.635 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.636 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "98", 2021-10-08T19:26:53.636 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:26:53.636 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:26:53.636 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2021-10-08T19:26:53.637 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:26:53.637 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:26:53.637 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:26:53.637 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:26:53.637 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:26:53.638 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:26:53.638 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:26:53.638 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:26:53.638 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:26:53.639 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:26:53.639 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:26:53.639 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:26:53.639 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:26:53.639 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:26:53.640 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:26:53.640 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:26:53.640 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:26:53.640 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:26:53.641 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:26:53.641 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:26:53.641 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:26:53.641 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:26:53.641 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:26:53.642 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.642 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:26:53.642 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:26:53.642 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:26:53.643 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:26:53.643 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:26:53.643 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:26:53.643 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:26:53.643 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:26:53.644 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:26:53.644 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:26:53.644 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:26:53.644 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2021-10-08T19:26:53.645 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:26:53.645 INFO:teuthology.orchestra.run.smithi097.stdout: "rados": {} 2021-10-08T19:26:53.645 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:53.645 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:53.645 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:26:53.646 INFO:teuthology.orchestra.run.smithi097.stdout: "osds": [ 2021-10-08T19:26:53.646 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.646 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 0, 2021-10-08T19:26:53.646 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "9e64e714-a5d5-4fbb-ae2b-1df4bf14b8e0", 2021-10-08T19:26:53.647 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:26:53.647 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:26:53.647 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:26:53.647 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:26:53.647 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:26:53.648 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:26:53.648 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 8, 2021-10-08T19:26:53.648 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 132, 2021-10-08T19:26:53.648 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:26:53.649 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:26:53.649 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:26:53.649 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:26:53.649 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.649 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:26:53.650 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6801", 2021-10-08T19:26:53.650 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3354161282 2021-10-08T19:26:53.650 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:53.650 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:53.651 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.651 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:26:53.651 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:26:53.651 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.651 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:26:53.652 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6802", 2021-10-08T19:26:53.652 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3354161282 2021-10-08T19:26:53.652 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:53.653 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:53.653 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.653 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:26:53.653 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:26:53.654 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.654 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:26:53.654 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6804", 2021-10-08T19:26:53.654 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3354161282 2021-10-08T19:26:53.654 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:53.655 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:53.655 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.655 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:26:53.655 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:26:53.656 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.656 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:26:53.656 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6803", 2021-10-08T19:26:53.656 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3354161282 2021-10-08T19:26:53.656 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:53.657 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:53.657 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.657 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.97:6801/3354161282", 2021-10-08T19:26:53.657 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.97:6802/3354161282", 2021-10-08T19:26:53.658 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.97:6804/3354161282", 2021-10-08T19:26:53.658 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.97:6803/3354161282", 2021-10-08T19:26:53.658 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:26:53.658 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:26:53.659 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:26:53.659 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:53.659 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.659 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.659 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 1, 2021-10-08T19:26:53.660 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "32602a22-f263-4b62-a8d8-50fddfb73fa8", 2021-10-08T19:26:53.660 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:26:53.660 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:26:53.660 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:26:53.661 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:26:53.661 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:26:53.661 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:26:53.661 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 13, 2021-10-08T19:26:53.662 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 131, 2021-10-08T19:26:53.662 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:26:53.662 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:26:53.662 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:26:53.662 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:26:53.663 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.663 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:26:53.663 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6805", 2021-10-08T19:26:53.663 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 735799205 2021-10-08T19:26:53.664 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:53.664 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:53.664 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.664 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:26:53.664 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:26:53.665 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.665 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:26:53.665 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6806", 2021-10-08T19:26:53.665 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 735799205 2021-10-08T19:26:53.666 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:53.666 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:53.666 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.666 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:26:53.666 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:26:53.667 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.667 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:26:53.667 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6808", 2021-10-08T19:26:53.667 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 735799205 2021-10-08T19:26:53.668 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:53.668 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:53.668 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.668 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:26:53.668 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:26:53.669 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.669 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:26:53.669 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6807", 2021-10-08T19:26:53.669 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 735799205 2021-10-08T19:26:53.670 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:53.670 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:53.670 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.670 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.97:6805/735799205", 2021-10-08T19:26:53.670 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.97:6806/735799205", 2021-10-08T19:26:53.671 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.97:6808/735799205", 2021-10-08T19:26:53.671 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.97:6807/735799205", 2021-10-08T19:26:53.671 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:26:53.671 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:26:53.672 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:26:53.672 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:53.672 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.672 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.672 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 2, 2021-10-08T19:26:53.673 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "88e0e4a2-b4a3-4a00-8669-03c3d9b166c5", 2021-10-08T19:26:53.673 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:26:53.673 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:26:53.673 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:26:53.673 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:26:53.674 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:26:53.674 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:26:53.674 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 18, 2021-10-08T19:26:53.674 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 113, 2021-10-08T19:26:53.675 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:26:53.675 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:26:53.675 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:26:53.675 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:26:53.675 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.676 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:26:53.676 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6809", 2021-10-08T19:26:53.676 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2366482649 2021-10-08T19:26:53.676 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:53.677 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:53.677 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.677 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:26:53.677 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:26:53.677 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.678 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:26:53.678 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6810", 2021-10-08T19:26:53.678 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2366482649 2021-10-08T19:26:53.678 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:53.679 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:53.679 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.679 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:26:53.679 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:26:53.680 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.680 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:26:53.680 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6812", 2021-10-08T19:26:53.680 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2366482649 2021-10-08T19:26:53.680 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:53.681 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:53.681 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.681 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:26:53.681 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:26:53.682 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.682 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:26:53.682 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6811", 2021-10-08T19:26:53.682 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2366482649 2021-10-08T19:26:53.682 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:53.683 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:53.683 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.683 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.97:6809/2366482649", 2021-10-08T19:26:53.683 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.97:6810/2366482649", 2021-10-08T19:26:53.684 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.97:6812/2366482649", 2021-10-08T19:26:53.684 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.97:6811/2366482649", 2021-10-08T19:26:53.684 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:26:53.684 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:26:53.684 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:26:53.685 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:53.685 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.685 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.685 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 3, 2021-10-08T19:26:53.686 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "e689d708-b501-4526-a31a-1e598b74654d", 2021-10-08T19:26:53.686 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:26:53.686 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:26:53.686 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:26:53.687 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:26:53.687 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:26:53.687 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:26:53.687 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 24, 2021-10-08T19:26:53.687 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 131, 2021-10-08T19:26:53.688 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:26:53.688 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:26:53.688 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:26:53.688 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:26:53.689 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.689 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:26:53.689 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6813", 2021-10-08T19:26:53.689 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3191181122 2021-10-08T19:26:53.689 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:53.690 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:53.690 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.690 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:26:53.690 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:26:53.691 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.691 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:26:53.691 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6814", 2021-10-08T19:26:53.691 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3191181122 2021-10-08T19:26:53.691 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:53.692 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:53.692 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.692 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:26:53.692 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:26:53.693 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.693 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:26:53.693 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6816", 2021-10-08T19:26:53.693 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3191181122 2021-10-08T19:26:53.693 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:53.694 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:53.694 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.694 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:26:53.694 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:26:53.695 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.695 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:26:53.695 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6815", 2021-10-08T19:26:53.695 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3191181122 2021-10-08T19:26:53.695 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:53.696 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:53.696 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.696 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.97:6813/3191181122", 2021-10-08T19:26:53.696 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.97:6814/3191181122", 2021-10-08T19:26:53.697 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.97:6816/3191181122", 2021-10-08T19:26:53.697 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.97:6815/3191181122", 2021-10-08T19:26:53.697 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:26:53.697 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:26:53.697 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:26:53.698 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:53.698 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.698 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.698 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 4, 2021-10-08T19:26:53.699 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "67e4730a-be1c-4d88-9307-e3c2cf3ab2ef", 2021-10-08T19:26:53.699 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:26:53.699 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:26:53.699 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:26:53.699 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:26:53.700 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:26:53.700 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:26:53.700 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 30, 2021-10-08T19:26:53.700 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 138, 2021-10-08T19:26:53.701 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:26:53.701 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:26:53.701 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:26:53.701 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:26:53.702 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.703 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:26:53.703 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6800", 2021-10-08T19:26:53.703 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 106778208 2021-10-08T19:26:53.703 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:53.704 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:53.704 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.704 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:26:53.705 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:26:53.705 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.705 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:26:53.705 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6801", 2021-10-08T19:26:53.706 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 106778208 2021-10-08T19:26:53.706 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:53.706 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:53.707 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.707 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:26:53.707 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:26:53.707 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.708 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:26:53.708 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6803", 2021-10-08T19:26:53.708 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 106778208 2021-10-08T19:26:53.709 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:53.709 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:53.709 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.709 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:26:53.710 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:26:53.710 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.710 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:26:53.711 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6802", 2021-10-08T19:26:53.711 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 106778208 2021-10-08T19:26:53.711 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:53.712 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:53.712 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.713 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.117:6800/106778208", 2021-10-08T19:26:53.713 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.117:6801/106778208", 2021-10-08T19:26:53.713 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.117:6803/106778208", 2021-10-08T19:26:53.713 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.117:6802/106778208", 2021-10-08T19:26:53.714 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:26:53.714 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:26:53.714 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:26:53.715 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:53.715 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.716 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.716 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 5, 2021-10-08T19:26:53.716 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "f9fd3153-3e4e-4489-8927-a65641f05d42", 2021-10-08T19:26:53.717 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:26:53.717 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:26:53.717 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:26:53.718 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:26:53.718 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:26:53.719 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:26:53.719 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 38, 2021-10-08T19:26:53.719 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 132, 2021-10-08T19:26:53.719 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:26:53.720 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:26:53.720 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:26:53.720 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:26:53.720 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.721 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:26:53.721 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6804", 2021-10-08T19:26:53.721 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3199889891 2021-10-08T19:26:53.721 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:53.721 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:53.722 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.722 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:26:53.722 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:26:53.723 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.724 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:26:53.724 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6805", 2021-10-08T19:26:53.724 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3199889891 2021-10-08T19:26:53.724 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:53.724 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:53.725 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.725 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:26:53.726 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:26:53.726 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.726 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:26:53.726 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6807", 2021-10-08T19:26:53.727 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3199889891 2021-10-08T19:26:53.727 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:53.728 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:53.728 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.729 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:26:53.729 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:26:53.729 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.730 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:26:53.730 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6806", 2021-10-08T19:26:53.730 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3199889891 2021-10-08T19:26:53.730 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:53.731 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:53.731 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.731 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.117:6804/3199889891", 2021-10-08T19:26:53.731 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.117:6805/3199889891", 2021-10-08T19:26:53.731 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.117:6807/3199889891", 2021-10-08T19:26:53.732 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.117:6806/3199889891", 2021-10-08T19:26:53.732 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:26:53.732 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:26:53.732 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:26:53.733 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:53.733 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.733 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.733 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 6, 2021-10-08T19:26:53.733 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "84898f12-c37d-4eb6-8b71-5b86bfe16e7d", 2021-10-08T19:26:53.734 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:26:53.734 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:26:53.734 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:26:53.734 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:26:53.735 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:26:53.735 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:26:53.735 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 47, 2021-10-08T19:26:53.735 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 132, 2021-10-08T19:26:53.735 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:26:53.736 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:26:53.736 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:26:53.736 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:26:53.736 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.737 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:26:53.737 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6808", 2021-10-08T19:26:53.737 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2185843951 2021-10-08T19:26:53.737 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:53.737 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:53.738 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.738 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:26:53.738 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:26:53.738 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.739 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:26:53.739 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6809", 2021-10-08T19:26:53.739 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2185843951 2021-10-08T19:26:53.739 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:53.739 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:53.740 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.740 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:26:53.740 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:26:53.740 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.740 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:26:53.741 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6811", 2021-10-08T19:26:53.741 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2185843951 2021-10-08T19:26:53.741 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:53.741 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:53.742 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.742 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:26:53.742 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:26:53.742 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.743 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:26:53.743 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6810", 2021-10-08T19:26:53.743 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2185843951 2021-10-08T19:26:53.743 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:53.743 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:53.744 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.744 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.117:6808/2185843951", 2021-10-08T19:26:53.744 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.117:6809/2185843951", 2021-10-08T19:26:53.744 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.117:6811/2185843951", 2021-10-08T19:26:53.745 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.117:6810/2185843951", 2021-10-08T19:26:53.745 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:26:53.745 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:26:53.745 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:26:53.745 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:53.746 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.746 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.746 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 7, 2021-10-08T19:26:53.746 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "529af2ce-2ae9-41ed-8c8e-d133628cfd20", 2021-10-08T19:26:53.746 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:26:53.747 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:26:53.747 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:26:53.747 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:26:53.747 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:26:53.748 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:26:53.748 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 55, 2021-10-08T19:26:53.748 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 132, 2021-10-08T19:26:53.748 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:26:53.748 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:26:53.749 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:26:53.749 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:26:53.749 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.749 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:26:53.749 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6812", 2021-10-08T19:26:53.750 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2817683239 2021-10-08T19:26:53.750 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:53.750 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:53.750 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.751 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:26:53.751 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:26:53.751 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.751 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:26:53.751 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6813", 2021-10-08T19:26:53.752 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2817683239 2021-10-08T19:26:53.752 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:53.752 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:53.752 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.752 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:26:53.753 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:26:53.753 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.753 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:26:53.754 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6815", 2021-10-08T19:26:53.754 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2817683239 2021-10-08T19:26:53.754 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:53.755 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:53.755 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.755 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:26:53.755 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:26:53.755 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.757 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:26:53.757 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6814", 2021-10-08T19:26:53.757 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2817683239 2021-10-08T19:26:53.758 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:53.758 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:53.758 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.758 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.117:6812/2817683239", 2021-10-08T19:26:53.759 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.117:6813/2817683239", 2021-10-08T19:26:53.759 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.117:6815/2817683239", 2021-10-08T19:26:53.759 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.117:6814/2817683239", 2021-10-08T19:26:53.759 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:26:53.759 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:26:53.760 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:26:53.760 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:53.760 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:53.760 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:26:53.761 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_xinfo": [ 2021-10-08T19:26:53.761 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.761 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 0, 2021-10-08T19:26:53.761 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:26:53.761 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:26:53.762 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:26:53.762 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:26:53.762 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:26:53.762 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:25:35.568606+0000", 2021-10-08T19:26:53.763 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:26:53.763 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.763 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.763 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 1, 2021-10-08T19:26:53.763 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:26:53.764 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:26:53.764 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:26:53.764 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:26:53.764 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:26:53.764 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:25:56.225329+0000", 2021-10-08T19:26:53.765 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:26:53.765 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.765 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.765 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 2, 2021-10-08T19:26:53.766 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:26:53.766 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:26:53.766 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:26:53.766 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:26:53.766 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:26:53.767 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:26:52.444313+0000", 2021-10-08T19:26:53.767 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:26:53.767 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.767 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.767 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 3, 2021-10-08T19:26:53.768 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:26:53.768 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:26:53.768 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:26:53.768 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:26:53.769 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:26:53.769 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:25:55.665952+0000", 2021-10-08T19:26:53.769 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:26:53.769 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.769 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.770 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 4, 2021-10-08T19:26:53.770 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:26:53.770 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:26:53.770 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:26:53.770 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:26:53.771 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:26:53.771 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:25:29.548772+0000", 2021-10-08T19:26:53.771 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:26:53.771 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.772 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.772 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 5, 2021-10-08T19:26:53.772 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:26:53.772 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:26:53.772 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:26:53.773 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:26:53.773 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:26:53.773 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:26:32.959964+0000", 2021-10-08T19:26:53.773 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:26:53.773 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.774 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.774 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 6, 2021-10-08T19:26:53.774 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:26:53.774 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:26:53.775 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:26:53.775 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:26:53.775 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:26:53.775 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:25:56.909137+0000", 2021-10-08T19:26:53.775 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:26:53.776 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.776 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.776 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 7, 2021-10-08T19:26:53.776 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:26:53.776 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:26:53.777 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:26:53.777 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:26:53.777 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:26:53.777 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:26:02.407194+0000", 2021-10-08T19:26:53.777 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:26:53.778 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:53.778 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:26:53.778 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_upmap": [], 2021-10-08T19:26:53.778 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_upmap_items": [ 2021-10-08T19:26:53.779 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.779 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "2.0", 2021-10-08T19:26:53.779 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:26:53.779 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.779 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 7, 2021-10-08T19:26:53.780 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 2 2021-10-08T19:26:53.780 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:53.780 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:53.780 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.780 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.781 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "2.1a", 2021-10-08T19:26:53.781 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:26:53.781 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.781 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 7, 2021-10-08T19:26:53.782 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 2 2021-10-08T19:26:53.782 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:53.782 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:53.782 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.782 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.783 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "4.14", 2021-10-08T19:26:53.783 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:26:53.783 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.783 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 3, 2021-10-08T19:26:53.783 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 2 2021-10-08T19:26:53.784 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:53.784 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:53.784 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.785 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.785 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "4.1c", 2021-10-08T19:26:53.785 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:26:53.785 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.785 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 1, 2021-10-08T19:26:53.786 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 5 2021-10-08T19:26:53.786 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:53.786 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:53.786 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.787 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.787 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "5.19", 2021-10-08T19:26:53.787 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:26:53.787 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.787 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 5, 2021-10-08T19:26:53.788 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 7 2021-10-08T19:26:53.788 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:53.788 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:53.788 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:53.789 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:26:53.789 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_temp": [ 2021-10-08T19:26:53.789 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.789 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "7.1", 2021-10-08T19:26:53.789 INFO:teuthology.orchestra.run.smithi097.stdout: "osds": [ 2021-10-08T19:26:53.790 INFO:teuthology.orchestra.run.smithi097.stdout: 4, 2021-10-08T19:26:53.790 INFO:teuthology.orchestra.run.smithi097.stdout: 3 2021-10-08T19:26:53.790 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:53.790 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.790 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.791 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "7.7", 2021-10-08T19:26:53.791 INFO:teuthology.orchestra.run.smithi097.stdout: "osds": [ 2021-10-08T19:26:53.791 INFO:teuthology.orchestra.run.smithi097.stdout: 0, 2021-10-08T19:26:53.791 INFO:teuthology.orchestra.run.smithi097.stdout: 3 2021-10-08T19:26:53.792 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:53.792 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.792 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.792 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "7.b", 2021-10-08T19:26:53.792 INFO:teuthology.orchestra.run.smithi097.stdout: "osds": [ 2021-10-08T19:26:53.793 INFO:teuthology.orchestra.run.smithi097.stdout: 1, 2021-10-08T19:26:53.793 INFO:teuthology.orchestra.run.smithi097.stdout: 5 2021-10-08T19:26:53.793 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:53.793 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.793 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.794 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "7.c", 2021-10-08T19:26:53.794 INFO:teuthology.orchestra.run.smithi097.stdout: "osds": [ 2021-10-08T19:26:53.794 INFO:teuthology.orchestra.run.smithi097.stdout: 2, 2021-10-08T19:26:53.794 INFO:teuthology.orchestra.run.smithi097.stdout: 3, 2021-10-08T19:26:53.795 INFO:teuthology.orchestra.run.smithi097.stdout: 7 2021-10-08T19:26:53.795 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:53.795 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.795 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:53.795 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "7.d", 2021-10-08T19:26:53.796 INFO:teuthology.orchestra.run.smithi097.stdout: "osds": [ 2021-10-08T19:26:53.796 INFO:teuthology.orchestra.run.smithi097.stdout: 1, 2021-10-08T19:26:53.796 INFO:teuthology.orchestra.run.smithi097.stdout: 0 2021-10-08T19:26:53.796 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:53.796 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:53.797 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:26:53.797 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_temp": [], 2021-10-08T19:26:53.797 INFO:teuthology.orchestra.run.smithi097.stdout: "blocklist": { 2021-10-08T19:26:53.797 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/2600364788": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:26:53.797 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/4129083289": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:26:53.798 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/1443158975": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:26:53.798 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/2472640384": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:26:53.798 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/3196919488": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:26:53.798 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:6800/3195862546": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:26:53.799 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:6800/3931202434": "2021-10-09T19:17:10.051948+0000", 2021-10-08T19:26:53.799 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/2761595213": "2021-10-09T19:17:10.051948+0000", 2021-10-08T19:26:53.799 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/900681504": "2021-10-09T19:17:10.051948+0000", 2021-10-08T19:26:53.799 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/3932251406": "2021-10-09T19:17:10.051948+0000", 2021-10-08T19:26:53.799 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/398006785": "2021-10-09T19:16:48.651177+0000", 2021-10-08T19:26:53.800 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/1642570050": "2021-10-09T19:16:48.651177+0000", 2021-10-08T19:26:53.800 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/300178790": "2021-10-09T19:16:48.651177+0000", 2021-10-08T19:26:53.800 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:6800/845999767": "2021-10-09T19:16:48.651177+0000" 2021-10-08T19:26:53.800 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.800 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profiles": { 2021-10-08T19:26:53.801 INFO:teuthology.orchestra.run.smithi097.stdout: "default": { 2021-10-08T19:26:53.801 INFO:teuthology.orchestra.run.smithi097.stdout: "crush-failure-domain": "osd", 2021-10-08T19:26:53.801 INFO:teuthology.orchestra.run.smithi097.stdout: "k": "2", 2021-10-08T19:26:53.801 INFO:teuthology.orchestra.run.smithi097.stdout: "m": "1", 2021-10-08T19:26:53.801 INFO:teuthology.orchestra.run.smithi097.stdout: "plugin": "jerasure", 2021-10-08T19:26:53.802 INFO:teuthology.orchestra.run.smithi097.stdout: "technique": "reed_sol_van" 2021-10-08T19:26:53.802 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:53.802 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:53.802 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps_queue": [], 2021-10-08T19:26:53.803 INFO:teuthology.orchestra.run.smithi097.stdout: "new_removed_snaps": [], 2021-10-08T19:26:53.803 INFO:teuthology.orchestra.run.smithi097.stdout: "new_purged_snaps": [], 2021-10-08T19:26:53.803 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_node_flags": {}, 2021-10-08T19:26:53.803 INFO:teuthology.orchestra.run.smithi097.stdout: "device_class_flags": {}, 2021-10-08T19:26:53.803 INFO:teuthology.orchestra.run.smithi097.stdout: "stretch_mode": { 2021-10-08T19:26:53.804 INFO:teuthology.orchestra.run.smithi097.stdout: "stretch_mode_enabled": false, 2021-10-08T19:26:53.804 INFO:teuthology.orchestra.run.smithi097.stdout: "stretch_bucket_count": 0, 2021-10-08T19:26:53.804 INFO:teuthology.orchestra.run.smithi097.stdout: "degraded_stretch_mode": 0, 2021-10-08T19:26:53.804 INFO:teuthology.orchestra.run.smithi097.stdout: "recovering_stretch_mode": 0, 2021-10-08T19:26:53.804 INFO:teuthology.orchestra.run.smithi097.stdout: "stretch_mode_bucket": 0 2021-10-08T19:26:53.805 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:53.805 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:26:53.806 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is unset 2021-10-08T19:26:54.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:26:53 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:26:53] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:26:54.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:53 smithi117 ceph-mon[34585]: pgmap v241: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 1.8 GiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 738 op/s; 8942/87444 objects degraded (10.226%); 1398/87444 objects misplaced (1.599%); 0 B/s, 34 objects/s recovering 2021-10-08T19:26:54.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:53 smithi117 ceph-mon[34585]: osdmap e157: 8 total, 8 up, 8 in 2021-10-08T19:26:54.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:53 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2374232490' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:26:54.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:53 smithi117 ceph-mon[34585]: from='client.35009 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:26:54.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:53 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/41787884' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2021-10-08T19:26:54.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:53 smithi097 ceph-mon[32687]: pgmap v241: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 1.8 GiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 738 op/s; 8942/87444 objects degraded (10.226%); 1398/87444 objects misplaced (1.599%); 0 B/s, 34 objects/s recovering 2021-10-08T19:26:54.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:53 smithi097 ceph-mon[32687]: osdmap e157: 8 total, 8 up, 8 in 2021-10-08T19:26:54.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:53 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2374232490' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:26:54.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:53 smithi097 ceph-mon[32687]: from='client.35009 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:26:54.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:53 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/41787884' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2021-10-08T19:26:54.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:53 smithi097 ceph-mon[41966]: pgmap v241: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 1.8 GiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 738 op/s; 8942/87444 objects degraded (10.226%); 1398/87444 objects misplaced (1.599%); 0 B/s, 34 objects/s recovering 2021-10-08T19:26:54.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:53 smithi097 ceph-mon[41966]: osdmap e157: 8 total, 8 up, 8 in 2021-10-08T19:26:54.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:53 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2374232490' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:26:54.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:53 smithi097 ceph-mon[41966]: from='client.35009 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:26:54.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:53 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/41787884' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2021-10-08T19:26:55.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:54 smithi117 ceph-mon[34585]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:26:55.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:54 smithi117 ceph-mon[34585]: from='client.35009 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:26:55.160 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:54 smithi117 ceph-mon[34585]: osdmap e158: 8 total, 8 up, 8 in 2021-10-08T19:26:55.226 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:54 smithi097 ceph-mon[32687]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:26:55.227 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:54 smithi097 ceph-mon[32687]: from='client.35009 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:26:55.227 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:54 smithi097 ceph-mon[32687]: osdmap e158: 8 total, 8 up, 8 in 2021-10-08T19:26:55.227 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:54 smithi097 ceph-mon[41966]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:26:55.228 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:54 smithi097 ceph-mon[41966]: from='client.35009 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:26:55.228 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:54 smithi097 ceph-mon[41966]: osdmap e158: 8 total, 8 up, 8 in 2021-10-08T19:26:55.568 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:26:55.577 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:55.578 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:26:55.679 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:26:55.708 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:55.715 INFO:tasks.thrashosds.thrasher:j is {'epoch': 157, 'fsid': '1d01f6d6-286c-11ec-8c25-001a4aab830c', 'created': '2021-10-08T19:16:25.258003+0000', 'modified': '2021-10-08T19:26:52.719967+0000', 'last_up_change': '2021-10-08T19:21:15.388758+0000', 'last_in_change': '2021-10-08T19:24:24.060804+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 18, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 7, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'quincy', 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2021-10-08T19:19:44.413311+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': '.rgw.root', 'create_time': '2021-10-08T19:21:21.940881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 3, 'pool_name': 'iscsi', 'create_time': '2021-10-08T19:21:22.536945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 23, 'pg_placement_num': 23, 'pg_placement_num_target': 23, 'pg_num_target': 23, 'pg_num_pending': 23, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '132', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '131', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 4, 'pool_name': 'default.rgw.log', 'create_time': '2021-10-08T19:21:23.886328+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 5, 'pool_name': 'default.rgw.control', 'create_time': '2021-10-08T19:21:25.865032+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 6, 'pool_name': 'default.rgw.meta', 'create_time': '2021-10-08T19:21:27.940767+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '69', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 8}, 'application_metadata': {'rgw': {}}}, {'pool': 7, 'pool_name': 'unique_pool_0', 'create_time': '2021-10-08T19:23:43.485480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '98', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}], 'osds': [{'osd': 0, 'uuid': '9e64e714-a5d5-4fbb-ae2b-1df4bf14b8e0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 132, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6801', 'nonce': 3354161282}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6802', 'nonce': 3354161282}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6804', 'nonce': 3354161282}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6803', 'nonce': 3354161282}]}, 'public_addr': '172.21.15.97:6801/3354161282', 'cluster_addr': '172.21.15.97:6802/3354161282', 'heartbeat_back_addr': '172.21.15.97:6804/3354161282', 'heartbeat_front_addr': '172.21.15.97:6803/3354161282', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '32602a22-f263-4b62-a8d8-50fddfb73fa8', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 131, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6805', 'nonce': 735799205}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6806', 'nonce': 735799205}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6808', 'nonce': 735799205}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6807', 'nonce': 735799205}]}, 'public_addr': '172.21.15.97:6805/735799205', 'cluster_addr': '172.21.15.97:6806/735799205', 'heartbeat_back_addr': '172.21.15.97:6808/735799205', 'heartbeat_front_addr': '172.21.15.97:6807/735799205', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '88e0e4a2-b4a3-4a00-8669-03c3d9b166c5', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 18, 'up_thru': 113, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6809', 'nonce': 2366482649}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6810', 'nonce': 2366482649}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6812', 'nonce': 2366482649}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6811', 'nonce': 2366482649}]}, 'public_addr': '172.21.15.97:6809/2366482649', 'cluster_addr': '172.21.15.97:6810/2366482649', 'heartbeat_back_addr': '172.21.15.97:6812/2366482649', 'heartbeat_front_addr': '172.21.15.97:6811/2366482649', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': 'e689d708-b501-4526-a31a-1e598b74654d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 24, 'up_thru': 131, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6813', 'nonce': 3191181122}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6814', 'nonce': 3191181122}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6816', 'nonce': 3191181122}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6815', 'nonce': 3191181122}]}, 'public_addr': '172.21.15.97:6813/3191181122', 'cluster_addr': '172.21.15.97:6814/3191181122', 'heartbeat_back_addr': '172.21.15.97:6816/3191181122', 'heartbeat_front_addr': '172.21.15.97:6815/3191181122', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '67e4730a-be1c-4d88-9307-e3c2cf3ab2ef', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 30, 'up_thru': 138, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6800', 'nonce': 106778208}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6801', 'nonce': 106778208}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6803', 'nonce': 106778208}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6802', 'nonce': 106778208}]}, 'public_addr': '172.21.15.117:6800/106778208', 'cluster_addr': '172.21.15.117:6801/106778208', 'heartbeat_back_addr': '172.21.15.117:6803/106778208', 'heartbeat_front_addr': '172.21.15.117:6802/106778208', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'f9fd3153-3e4e-4489-8927-a65641f05d42', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 38, 'up_thru': 132, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6804', 'nonce': 3199889891}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6805', 'nonce': 3199889891}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6807', 'nonce': 3199889891}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6806', 'nonce': 3199889891}]}, 'public_addr': '172.21.15.117:6804/3199889891', 'cluster_addr': '172.21.15.117:6805/3199889891', 'heartbeat_back_addr': '172.21.15.117:6807/3199889891', 'heartbeat_front_addr': '172.21.15.117:6806/3199889891', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '84898f12-c37d-4eb6-8b71-5b86bfe16e7d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 47, 'up_thru': 132, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6808', 'nonce': 2185843951}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6809', 'nonce': 2185843951}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6811', 'nonce': 2185843951}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6810', 'nonce': 2185843951}]}, 'public_addr': '172.21.15.117:6808/2185843951', 'cluster_addr': '172.21.15.117:6809/2185843951', 'heartbeat_back_addr': '172.21.15.117:6811/2185843951', 'heartbeat_front_addr': '172.21.15.117:6810/2185843951', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '529af2ce-2ae9-41ed-8c8e-d133628cfd20', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 55, 'up_thru': 132, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6812', 'nonce': 2817683239}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6813', 'nonce': 2817683239}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6815', 'nonce': 2817683239}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6814', 'nonce': 2817683239}]}, 'public_addr': '172.21.15.117:6812/2817683239', 'cluster_addr': '172.21.15.117:6813/2817683239', 'heartbeat_back_addr': '172.21.15.117:6815/2817683239', 'heartbeat_front_addr': '172.21.15.117:6814/2817683239', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:25:35.568606+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:25:56.225329+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:26:52.444313+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:25:55.665952+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:25:29.548772+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:26:32.959964+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:25:56.909137+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:26:02.407194+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [{'pgid': '2.0', 'mappings': [{'from': 7, 'to': 2}]}, {'pgid': '2.1a', 'mappings': [{'from': 7, 'to': 2}]}, {'pgid': '4.14', 'mappings': [{'from': 3, 'to': 2}]}, {'pgid': '4.1c', 'mappings': [{'from': 1, 'to': 5}]}, {'pgid': '5.19', 'mappings': [{'from': 5, 'to': 7}]}], 'pg_temp': [{'pgid': '7.1', 'osds': [4, 3]}, {'pgid': '7.7', 'osds': [0, 3]}, {'pgid': '7.b', 'osds': [1, 5]}, {'pgid': '7.c', 'osds': [2, 3, 7]}, {'pgid': '7.d', 'osds': [1, 0]}], 'primary_temp': [], 'blocklist': {'172.21.15.97:0/2600364788': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:0/4129083289': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:0/1443158975': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:0/2472640384': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:0/3196919488': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:6800/3195862546': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:6800/3931202434': '2021-10-09T19:17:10.051948+0000', '172.21.15.97:0/2761595213': '2021-10-09T19:17:10.051948+0000', '172.21.15.97:0/900681504': '2021-10-09T19:17:10.051948+0000', '172.21.15.97:0/3932251406': '2021-10-09T19:17:10.051948+0000', '172.21.15.97:0/398006785': '2021-10-09T19:16:48.651177+0000', '172.21.15.97:0/1642570050': '2021-10-09T19:16:48.651177+0000', '172.21.15.97:0/300178790': '2021-10-09T19:16:48.651177+0000', '172.21.15.97:6800/845999767': '2021-10-09T19:16:48.651177+0000'}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2021-10-08T19:26:55.716 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2021-10-08T19:26:55.773 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:26:55.775 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:55.776 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:26:55.806 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:26:55.877 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:26:55.907 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:55.927 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:55 smithi097 ceph-mon[41966]: pgmap v244: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 1.5 GiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 930 op/s; 8825/76179 objects degraded (11.585%); 1339/76179 objects misplaced (1.758%); 0 B/s, 43 objects/s recovering 2021-10-08T19:26:55.928 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:55 smithi097 ceph-mon[41966]: Health check update: Degraded data redundancy: 8825/76179 objects degraded (11.585%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:26:55.929 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:55 smithi097 ceph-mon[32687]: pgmap v244: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 1.5 GiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 930 op/s; 8825/76179 objects degraded (11.585%); 1339/76179 objects misplaced (1.758%); 0 B/s, 43 objects/s recovering 2021-10-08T19:26:55.929 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:55 smithi097 ceph-mon[32687]: Health check update: Degraded data redundancy: 8825/76179 objects degraded (11.585%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:26:55.964 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:26:55.968 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:55 smithi117 ceph-mon[34585]: pgmap v244: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 1.5 GiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 930 op/s; 8825/76179 objects degraded (11.585%); 1339/76179 objects misplaced (1.758%); 0 B/s, 43 objects/s recovering 2021-10-08T19:26:55.969 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:55 smithi117 ceph-mon[34585]: Health check update: Degraded data redundancy: 8825/76179 objects degraded (11.585%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:26:55.971 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:55.972 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:26:56.078 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:26:56.113 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:56.174 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:26:56.177 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:56.178 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:26:56.280 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:26:56.308 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:56.376 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:26:56.378 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:56.379 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:26:56.484 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:26:56.507 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:26:56.507 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2021-10-08T19:26:56.508 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2021-10-08T19:26:56.508 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2021-10-08T19:26:56.508 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.508 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:32141 7.e 7:7734bdac:::benchmark_data_smithi097_93198_object32140:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2021-10-08T19:26:56.509 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:09.663951+0000", 2021-10-08T19:26:56.509 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 166.81999899900001, 2021-10-08T19:26:56.509 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.103603693, 2021-10-08T19:26:56.509 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:56.509 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:26:56.510 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:26:56.518 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:26:56.518 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:26:56.519 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 32141 2021-10-08T19:26:56.519 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.519 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:56.519 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.519 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:56.520 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.663951+0000", 2021-10-08T19:26:56.520 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:56.520 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.520 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.521 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:56.521 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.663951+0000", 2021-10-08T19:26:56.521 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:56.521 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.521 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.522 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:56.522 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.663948+0000", 2021-10-08T19:26:56.522 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:26:56.523 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.523 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.523 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:56.523 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.663974+0000", 2021-10-08T19:26:56.524 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5099000000000001e-05 2021-10-08T19:26:56.524 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.524 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.525 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:56.525 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.663984+0000", 2021-10-08T19:26:56.525 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0932e-05 2021-10-08T19:26:56.525 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.525 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.526 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:56.526 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.663991+0000", 2021-10-08T19:26:56.526 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3720000000000001e-06 2021-10-08T19:26:56.539 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.539 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.540 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:56.540 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.664039+0000", 2021-10-08T19:26:56.541 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7814e-05 2021-10-08T19:26:56.541 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.541 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.542 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:56.542 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.664167+0000", 2021-10-08T19:26:56.543 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000128138 2021-10-08T19:26:56.543 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.544 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.544 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:26:56.545 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.664286+0000", 2021-10-08T19:26:56.545 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011924100000000001 2021-10-08T19:26:56.545 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.547 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.547 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:56.548 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.667248+0000", 2021-10-08T19:26:56.548 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029622390000000002 2021-10-08T19:26:56.548 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.549 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.549 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:26:56.549 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.667255+0000", 2021-10-08T19:26:56.550 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5189999999999998e-06 2021-10-08T19:26:56.550 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.550 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.551 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:56.551 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.767461+0000", 2021-10-08T19:26:56.551 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.100205884 2021-10-08T19:26:56.551 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.552 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.552 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:26:56.552 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.767515+0000", 2021-10-08T19:26:56.552 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4459999999999997e-05 2021-10-08T19:26:56.552 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.553 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.553 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:56.553 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.767555+0000", 2021-10-08T19:26:56.553 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9369000000000002e-05 2021-10-08T19:26:56.554 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:56.554 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:56.554 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:56.554 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.554 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.555 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:32142 7.e 7:76ef7bea:::benchmark_data_smithi097_93198_object32141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2021-10-08T19:26:56.555 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:09.665046+0000", 2021-10-08T19:26:56.555 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 166.81890349899999, 2021-10-08T19:26:56.555 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.10262069, 2021-10-08T19:26:56.555 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:56.556 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:26:56.556 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:26:56.556 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:26:56.563 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:26:56.563 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 32142 2021-10-08T19:26:56.563 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.564 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:56.570 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.571 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:56.572 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.665046+0000", 2021-10-08T19:26:56.572 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:56.572 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.573 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.573 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:56.573 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.665046+0000", 2021-10-08T19:26:56.573 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:56.574 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.574 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.574 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:56.574 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.665045+0000", 2021-10-08T19:26:56.575 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2021-10-08T19:26:56.575 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.575 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.575 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:56.576 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.665065+0000", 2021-10-08T19:26:56.576 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.022e-05 2021-10-08T19:26:56.576 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.576 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.576 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:56.577 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.665076+0000", 2021-10-08T19:26:56.577 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0669999999999999e-05 2021-10-08T19:26:56.577 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.577 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.577 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:56.578 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.665082+0000", 2021-10-08T19:26:56.578 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2670000000000003e-06 2021-10-08T19:26:56.579 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.579 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.579 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:56.580 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.665284+0000", 2021-10-08T19:26:56.581 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00020172000000000001 2021-10-08T19:26:56.581 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.581 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.581 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:56.582 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.665383+0000", 2021-10-08T19:26:56.582 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.9408999999999996e-05 2021-10-08T19:26:56.582 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.583 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.583 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:26:56.583 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.665476+0000", 2021-10-08T19:26:56.583 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.3245000000000006e-05 2021-10-08T19:26:56.583 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.584 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.584 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:26:56.584 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.667261+0000", 2021-10-08T19:26:56.584 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001784108 2021-10-08T19:26:56.585 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.585 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.585 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:56.585 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.667293+0000", 2021-10-08T19:26:56.585 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2186e-05 2021-10-08T19:26:56.586 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.586 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.586 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:56.587 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.767591+0000", 2021-10-08T19:26:56.587 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.100298515 2021-10-08T19:26:56.587 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.592 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.592 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:26:56.593 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.767629+0000", 2021-10-08T19:26:56.593 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7818999999999998e-05 2021-10-08T19:26:56.593 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.593 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.594 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:56.594 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.767667+0000", 2021-10-08T19:26:56.594 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7920000000000003e-05 2021-10-08T19:26:56.594 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:56.595 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:56.595 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:56.595 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.595 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.595 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:32143 7.e 7:7f65a458:::benchmark_data_smithi097_93198_object32142:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2021-10-08T19:26:56.596 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:09.665106+0000", 2021-10-08T19:26:56.596 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 166.818843848, 2021-10-08T19:26:56.596 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.10265624299999999, 2021-10-08T19:26:56.596 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:56.596 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:26:56.597 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:26:56.597 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:26:56.597 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:26:56.597 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 32143 2021-10-08T19:26:56.598 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.598 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:56.598 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.599 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:56.599 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.665106+0000", 2021-10-08T19:26:56.599 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:56.599 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.599 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.600 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:56.600 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.665106+0000", 2021-10-08T19:26:56.600 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:56.600 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.600 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.601 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:56.601 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.665105+0000", 2021-10-08T19:26:56.601 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:26:56.601 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.602 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.602 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:56.602 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.665144+0000", 2021-10-08T19:26:56.603 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9019e-05 2021-10-08T19:26:56.603 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.603 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.603 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:56.604 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.665152+0000", 2021-10-08T19:26:56.604 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1829999999999994e-06 2021-10-08T19:26:56.604 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.605 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.605 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:56.605 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.665157+0000", 2021-10-08T19:26:56.605 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1309999999999997e-06 2021-10-08T19:26:56.605 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.606 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.606 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:56.606 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.666433+0000", 2021-10-08T19:26:56.606 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012755170000000001 2021-10-08T19:26:56.607 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.607 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.607 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:56.607 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.666539+0000", 2021-10-08T19:26:56.607 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010647899999999999 2021-10-08T19:26:56.608 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.608 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.608 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:26:56.608 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.666667+0000", 2021-10-08T19:26:56.608 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012779600000000001 2021-10-08T19:26:56.609 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.609 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.609 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:26:56.609 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.667364+0000", 2021-10-08T19:26:56.610 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00069719499999999995 2021-10-08T19:26:56.610 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.610 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.610 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:56.610 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.667568+0000", 2021-10-08T19:26:56.611 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00020368799999999999 2021-10-08T19:26:56.611 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.611 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.611 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:56.612 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.767703+0000", 2021-10-08T19:26:56.612 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.10013480299999999 2021-10-08T19:26:56.612 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.612 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.612 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:26:56.613 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.767738+0000", 2021-10-08T19:26:56.613 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5509999999999997e-05 2021-10-08T19:26:56.613 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.613 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.613 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:56.614 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:09.767762+0000", 2021-10-08T19:26:56.614 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3869000000000001e-05 2021-10-08T19:26:56.614 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:56.614 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:56.615 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:56.615 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.615 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.615 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:40670 7.e 7:79f4d2b7:::benchmark_data_smithi097_93198_object40669:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2021-10-08T19:26:56.615 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:16.257106+0000", 2021-10-08T19:26:56.616 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 160.22684359600001, 2021-10-08T19:26:56.616 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.123129141, 2021-10-08T19:26:56.616 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:56.616 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:26:56.616 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:26:56.617 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:26:56.617 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:26:56.617 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 40670 2021-10-08T19:26:56.617 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.618 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:56.618 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.618 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:56.618 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.257106+0000", 2021-10-08T19:26:56.619 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:56.619 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.619 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.619 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:56.620 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.257106+0000", 2021-10-08T19:26:56.620 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:56.620 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.620 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.620 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:56.621 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.257104+0000", 2021-10-08T19:26:56.621 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:26:56.621 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.621 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.621 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:56.622 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.257130+0000", 2021-10-08T19:26:56.622 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5962e-05 2021-10-08T19:26:56.622 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.622 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.623 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:56.623 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.257144+0000", 2021-10-08T19:26:56.623 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.45e-05 2021-10-08T19:26:56.623 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.623 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.624 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:56.624 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.257152+0000", 2021-10-08T19:26:56.624 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7179999999999996e-06 2021-10-08T19:26:56.624 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.624 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.625 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:56.625 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.257212+0000", 2021-10-08T19:26:56.625 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.982e-05 2021-10-08T19:26:56.625 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.625 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.626 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:56.626 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.257339+0000", 2021-10-08T19:26:56.626 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012701100000000001 2021-10-08T19:26:56.626 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.627 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.627 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:26:56.627 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.257483+0000", 2021-10-08T19:26:56.627 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014382500000000001 2021-10-08T19:26:56.627 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.628 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.628 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:56.628 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.258908+0000", 2021-10-08T19:26:56.628 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0014255209999999999 2021-10-08T19:26:56.629 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.629 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.629 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:26:56.629 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.259885+0000", 2021-10-08T19:26:56.630 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00097671600000000009 2021-10-08T19:26:56.630 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.630 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.630 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:56.631 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.380148+0000", 2021-10-08T19:26:56.631 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.12026337600000001 2021-10-08T19:26:56.631 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.631 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.632 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:26:56.632 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.380200+0000", 2021-10-08T19:26:56.632 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1218999999999999e-05 2021-10-08T19:26:56.632 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.632 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.633 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:56.633 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.380235+0000", 2021-10-08T19:26:56.633 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5683999999999999e-05 2021-10-08T19:26:56.633 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:56.633 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:56.634 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:56.634 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.634 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.634 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "MOSDPGPushReply(7.c 132/113 [PushReplyOp(7:369c504f:::benchmark_data_smithi097_93198_object8982:head)])", 2021-10-08T19:26:56.635 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:15.297632+0000", 2021-10-08T19:26:56.635 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 101.186317339, 2021-10-08T19:26:56.635 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.14698830299999999, 2021-10-08T19:26:56.635 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:56.635 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "reached pg", 2021-10-08T19:26:56.636 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:56.636 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.636 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:56.636 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.297632+0000", 2021-10-08T19:26:56.636 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:56.637 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.637 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.637 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:56.637 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.297632+0000", 2021-10-08T19:26:56.638 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:56.638 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.638 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.638 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:56.638 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.297630+0000", 2021-10-08T19:26:56.639 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:26:56.639 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.639 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.639 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:56.639 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.297642+0000", 2021-10-08T19:26:56.640 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2211e-05 2021-10-08T19:26:56.640 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.640 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.640 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:56.641 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.297659+0000", 2021-10-08T19:26:56.641 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6351999999999999e-05 2021-10-08T19:26:56.641 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.641 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.641 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:56.642 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.297668+0000", 2021-10-08T19:26:56.642 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0489999999999993e-06 2021-10-08T19:26:56.642 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.642 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.642 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:56.643 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.297746+0000", 2021-10-08T19:26:56.643 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8319999999999996e-05 2021-10-08T19:26:56.643 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.643 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.644 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:56.644 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.444621+0000", 2021-10-08T19:26:56.644 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.14687476299999999 2021-10-08T19:26:56.644 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:56.644 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:56.645 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:56.645 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.645 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.645 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.24796.0:86021 7.3 e132/94 7:c211d7cd:::benchmark_data_smithi097_93198_object86020:head v 132'5454, mlcod=132'5452)", 2021-10-08T19:26:56.645 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:15.298120+0000", 2021-10-08T19:26:56.646 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 101.185829408, 2021-10-08T19:26:56.646 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.15232842299999999, 2021-10-08T19:26:56.646 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:56.646 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:26:56.647 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:56.647 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.647 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:56.647 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.298120+0000", 2021-10-08T19:26:56.647 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:56.648 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.648 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.648 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:56.648 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.298120+0000", 2021-10-08T19:26:56.648 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:56.649 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.649 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.649 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:56.649 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.298119+0000", 2021-10-08T19:26:56.650 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:26:56.650 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.650 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.650 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:56.650 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.298150+0000", 2021-10-08T19:26:56.651 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1010999999999998e-05 2021-10-08T19:26:56.651 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.651 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.651 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:56.651 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.298161+0000", 2021-10-08T19:26:56.652 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1646e-05 2021-10-08T19:26:56.652 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.652 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.652 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:56.652 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.298168+0000", 2021-10-08T19:26:56.653 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7839999999999998e-06 2021-10-08T19:26:56.653 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.653 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.653 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:56.654 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.298249+0000", 2021-10-08T19:26:56.654 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0531999999999994e-05 2021-10-08T19:26:56.654 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.654 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.654 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:56.655 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.443678+0000", 2021-10-08T19:26:56.655 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.145429118 2021-10-08T19:26:56.655 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.655 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.655 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:26:56.656 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.450421+0000", 2021-10-08T19:26:56.656 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0067429200000000003 2021-10-08T19:26:56.656 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.656 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.657 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:56.657 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.450449+0000", 2021-10-08T19:26:56.657 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8218e-05 2021-10-08T19:26:56.657 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:56.657 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:56.658 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:56.658 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.658 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.658 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.24796.0:86023 7.2 e132/94 7:44f50a37:::benchmark_data_smithi097_93198_object86022:head v 132'5410, mlcod=132'5408)", 2021-10-08T19:26:56.658 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:15.298181+0000", 2021-10-08T19:26:56.659 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 101.185768947, 2021-10-08T19:26:56.659 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.153767984, 2021-10-08T19:26:56.659 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:56.659 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:26:56.660 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:56.660 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.660 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:56.660 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.298181+0000", 2021-10-08T19:26:56.660 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:56.661 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.661 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.661 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:56.661 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.298181+0000", 2021-10-08T19:26:56.661 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:56.662 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.662 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.662 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:56.663 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.298180+0000", 2021-10-08T19:26:56.663 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2021-10-08T19:26:56.663 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.664 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.664 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:56.664 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.298204+0000", 2021-10-08T19:26:56.664 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3807000000000001e-05 2021-10-08T19:26:56.665 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.665 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.665 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:56.665 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.298210+0000", 2021-10-08T19:26:56.665 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5230000000000003e-06 2021-10-08T19:26:56.666 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.666 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.666 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:56.666 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.298214+0000", 2021-10-08T19:26:56.667 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1060000000000002e-06 2021-10-08T19:26:56.667 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.667 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.667 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:56.667 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.443716+0000", 2021-10-08T19:26:56.668 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.14550266100000001 2021-10-08T19:26:56.668 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.668 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.668 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:56.668 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.443740+0000", 2021-10-08T19:26:56.669 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3581999999999999e-05 2021-10-08T19:26:56.669 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.669 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.669 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:26:56.670 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.451911+0000", 2021-10-08T19:26:56.670 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0081709320000000005 2021-10-08T19:26:56.670 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.671 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.671 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:56.671 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.451949+0000", 2021-10-08T19:26:56.671 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7891e-05 2021-10-08T19:26:56.672 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:56.672 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:56.672 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:56.672 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.672 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.673 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.24796.0:86030 7.3 e132/94 7:c00202ed:::benchmark_data_smithi097_93198_object86029:head v 132'5455, mlcod=132'5452)", 2021-10-08T19:26:56.673 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:15.298226+0000", 2021-10-08T19:26:56.673 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 101.18572415600001, 2021-10-08T19:26:56.673 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.15224360100000001, 2021-10-08T19:26:56.673 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:56.674 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:26:56.674 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:56.674 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.674 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:56.675 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.298226+0000", 2021-10-08T19:26:56.675 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:56.675 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.675 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.676 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:56.676 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.298226+0000", 2021-10-08T19:26:56.676 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:56.676 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.677 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.677 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:56.677 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.298225+0000", 2021-10-08T19:26:56.677 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2021-10-08T19:26:56.677 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.678 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.678 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:56.678 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.298257+0000", 2021-10-08T19:26:56.678 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2042000000000003e-05 2021-10-08T19:26:56.678 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.679 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.679 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:56.679 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.443685+0000", 2021-10-08T19:26:56.679 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.14542758 2021-10-08T19:26:56.679 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.680 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.680 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:56.680 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.443696+0000", 2021-10-08T19:26:56.680 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1708e-05 2021-10-08T19:26:56.681 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.681 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.681 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:56.681 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.445731+0000", 2021-10-08T19:26:56.681 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0020341389999999999 2021-10-08T19:26:56.682 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.682 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.682 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:56.682 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.445755+0000", 2021-10-08T19:26:56.682 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.472e-05 2021-10-08T19:26:56.683 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.683 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.690 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:26:56.690 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.450453+0000", 2021-10-08T19:26:56.691 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0046977950000000003 2021-10-08T19:26:56.691 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.691 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.691 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:56.692 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.450469+0000", 2021-10-08T19:26:56.692 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6155e-05 2021-10-08T19:26:56.692 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:56.692 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:56.693 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:56.693 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.693 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.694 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:111955 7.e 7:784c34e9:::benchmark_data_smithi097_93198_object20135:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e145)", 2021-10-08T19:26:56.694 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:50.620080+0000", 2021-10-08T19:26:56.694 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 65.863869714000003, 2021-10-08T19:26:56.694 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.113722382, 2021-10-08T19:26:56.694 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:56.695 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:26:56.695 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:26:56.695 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:26:56.695 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:26:56.696 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 111955 2021-10-08T19:26:56.696 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.696 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:56.696 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.696 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:56.697 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.620080+0000", 2021-10-08T19:26:56.697 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:56.697 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.697 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.697 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:56.698 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.620080+0000", 2021-10-08T19:26:56.698 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:56.698 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.698 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.698 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:56.699 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.620078+0000", 2021-10-08T19:26:56.699 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:26:56.699 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.699 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.699 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:56.700 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.620086+0000", 2021-10-08T19:26:56.700 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3529999999999995e-06 2021-10-08T19:26:56.700 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.700 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.701 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:56.701 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.620121+0000", 2021-10-08T19:26:56.701 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5071999999999999e-05 2021-10-08T19:26:56.701 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.701 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.702 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:56.702 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.620129+0000", 2021-10-08T19:26:56.702 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6249999999999998e-06 2021-10-08T19:26:56.702 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.702 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.703 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:56.703 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.620249+0000", 2021-10-08T19:26:56.703 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000120047 2021-10-08T19:26:56.703 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.703 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.704 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:56.704 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.620495+0000", 2021-10-08T19:26:56.704 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024642799999999998 2021-10-08T19:26:56.704 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.705 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.705 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:26:56.705 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.620591+0000", 2021-10-08T19:26:56.705 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.6405999999999998e-05 2021-10-08T19:26:56.705 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.706 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.706 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:26:56.706 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.627176+0000", 2021-10-08T19:26:56.706 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.006584917 2021-10-08T19:26:56.706 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.707 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.707 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:56.707 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.633380+0000", 2021-10-08T19:26:56.707 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.006203615 2021-10-08T19:26:56.707 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.708 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.708 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:56.708 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.733712+0000", 2021-10-08T19:26:56.708 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.10033193999999999 2021-10-08T19:26:56.708 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.709 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.709 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:26:56.709 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.733763+0000", 2021-10-08T19:26:56.709 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0933000000000002e-05 2021-10-08T19:26:56.710 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.710 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.710 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:56.710 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.733802+0000", 2021-10-08T19:26:56.711 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9616999999999997e-05 2021-10-08T19:26:56.711 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:56.711 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:56.711 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:56.711 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.712 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.712 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:111961 7.e 7:732b47e9:::benchmark_data_smithi097_93198_object20141:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e145)", 2021-10-08T19:26:56.712 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:50.620207+0000", 2021-10-08T19:26:56.712 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 65.863742446000003, 2021-10-08T19:26:56.712 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.124760158, 2021-10-08T19:26:56.713 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:56.713 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:26:56.713 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:26:56.713 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:26:56.714 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:26:56.714 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 111961 2021-10-08T19:26:56.714 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.714 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:56.714 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.715 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:56.715 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.620207+0000", 2021-10-08T19:26:56.715 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:56.715 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.715 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.716 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:56.716 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.620207+0000", 2021-10-08T19:26:56.716 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:56.716 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.716 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.717 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:56.717 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.620207+0000", 2021-10-08T19:26:56.717 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2021-10-08T19:26:56.717 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.717 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.718 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:56.718 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.620210+0000", 2021-10-08T19:26:56.718 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8370000000000001e-06 2021-10-08T19:26:56.718 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.719 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.719 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:56.719 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.620215+0000", 2021-10-08T19:26:56.719 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.276e-06 2021-10-08T19:26:56.719 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.720 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.720 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:56.720 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.620390+0000", 2021-10-08T19:26:56.720 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017530200000000001 2021-10-08T19:26:56.720 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.721 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.721 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:56.721 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.623533+0000", 2021-10-08T19:26:56.721 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003142841 2021-10-08T19:26:56.722 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.722 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.722 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:56.722 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.623648+0000", 2021-10-08T19:26:56.723 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115207 2021-10-08T19:26:56.723 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.723 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.723 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:26:56.724 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.623768+0000", 2021-10-08T19:26:56.724 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119951 2021-10-08T19:26:56.724 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.724 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.724 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:26:56.725 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.635539+0000", 2021-10-08T19:26:56.725 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.01177105 2021-10-08T19:26:56.725 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.725 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.725 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:56.726 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.638723+0000", 2021-10-08T19:26:56.726 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031842709999999998 2021-10-08T19:26:56.726 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.726 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.727 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:56.727 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.744878+0000", 2021-10-08T19:26:56.727 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.106154761 2021-10-08T19:26:56.727 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.727 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.728 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:26:56.728 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.744929+0000", 2021-10-08T19:26:56.728 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0464000000000003e-05 2021-10-08T19:26:56.728 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.728 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.729 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:56.729 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.744968+0000", 2021-10-08T19:26:56.729 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8846e-05 2021-10-08T19:26:56.729 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:56.729 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:56.730 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:56.730 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.730 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.731 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:111963 7.e 7:73b4f7a7:::benchmark_data_smithi097_93198_object20143:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e145)", 2021-10-08T19:26:56.731 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:50.623389+0000", 2021-10-08T19:26:56.731 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 65.860560633999995, 2021-10-08T19:26:56.731 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.12169155500000001, 2021-10-08T19:26:56.731 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:56.732 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:26:56.732 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:26:56.732 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:26:56.732 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:26:56.733 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 111963 2021-10-08T19:26:56.733 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.733 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:56.733 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.733 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:56.734 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.623389+0000", 2021-10-08T19:26:56.734 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:56.734 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.734 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.734 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:56.735 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.623389+0000", 2021-10-08T19:26:56.736 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:56.736 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.736 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.736 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:56.737 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.623387+0000", 2021-10-08T19:26:56.737 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:26:56.737 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.737 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.737 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:56.738 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.623395+0000", 2021-10-08T19:26:56.738 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1540000000000002e-06 2021-10-08T19:26:56.738 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.738 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.738 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:56.739 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.623411+0000", 2021-10-08T19:26:56.739 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6189999999999999e-05 2021-10-08T19:26:56.739 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.739 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.739 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:56.740 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.623418+0000", 2021-10-08T19:26:56.740 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1760000000000004e-06 2021-10-08T19:26:56.740 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.740 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.741 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:56.741 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.627361+0000", 2021-10-08T19:26:56.741 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0039422620000000002 2021-10-08T19:26:56.741 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.741 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.742 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:56.742 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.627471+0000", 2021-10-08T19:26:56.742 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000110739 2021-10-08T19:26:56.742 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.743 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.743 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:26:56.743 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.627591+0000", 2021-10-08T19:26:56.743 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011943999999999999 2021-10-08T19:26:56.743 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.744 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.744 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:26:56.744 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.635546+0000", 2021-10-08T19:26:56.744 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0079551589999999998 2021-10-08T19:26:56.744 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.745 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.745 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:56.745 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.638753+0000", 2021-10-08T19:26:56.745 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003206548 2021-10-08T19:26:56.745 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.746 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.746 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:56.746 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.745011+0000", 2021-10-08T19:26:56.746 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.106258413 2021-10-08T19:26:56.747 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.747 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.747 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:26:56.747 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.745047+0000", 2021-10-08T19:26:56.748 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6412000000000003e-05 2021-10-08T19:26:56.748 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.748 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.748 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:56.748 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.745081+0000", 2021-10-08T19:26:56.749 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3312999999999998e-05 2021-10-08T19:26:56.749 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:56.749 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:56.749 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:56.750 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.750 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.750 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:114107 7.c 7:3ff35dbd:::benchmark_data_smithi097_93198_object22287:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e145)", 2021-10-08T19:26:56.750 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:53.644203+0000", 2021-10-08T19:26:56.750 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 62.839746527999999, 2021-10-08T19:26:56.751 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.111443187, 2021-10-08T19:26:56.751 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:56.751 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:26:56.751 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:26:56.751 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:26:56.752 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:26:56.752 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 114107 2021-10-08T19:26:56.752 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.752 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:56.752 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.753 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:56.753 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.644203+0000", 2021-10-08T19:26:56.753 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:56.753 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.753 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.754 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:56.754 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.644203+0000", 2021-10-08T19:26:56.754 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:56.754 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.755 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.755 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:56.755 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.644201+0000", 2021-10-08T19:26:56.755 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2021-10-08T19:26:56.755 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.756 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.756 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:56.756 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.644209+0000", 2021-10-08T19:26:56.756 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7199999999999995e-06 2021-10-08T19:26:56.756 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.757 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.757 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:56.757 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.644224+0000", 2021-10-08T19:26:56.757 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.504e-05 2021-10-08T19:26:56.757 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.758 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.758 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:56.758 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.644231+0000", 2021-10-08T19:26:56.758 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3029999999999996e-06 2021-10-08T19:26:56.758 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.759 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.759 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:56.759 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.644284+0000", 2021-10-08T19:26:56.759 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3603999999999997e-05 2021-10-08T19:26:56.759 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.760 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.760 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:56.760 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.644442+0000", 2021-10-08T19:26:56.760 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015813200000000001 2021-10-08T19:26:56.760 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.761 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.761 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,6,7", 2021-10-08T19:26:56.761 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.644603+0000", 2021-10-08T19:26:56.761 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016012200000000001 2021-10-08T19:26:56.761 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.762 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.762 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:26:56.762 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.648558+0000", 2021-10-08T19:26:56.762 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0039558930000000003 2021-10-08T19:26:56.762 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.763 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.763 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:56.763 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.652465+0000", 2021-10-08T19:26:56.763 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0039062599999999999 2021-10-08T19:26:56.764 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.764 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.764 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:56.764 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.653597+0000", 2021-10-08T19:26:56.764 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011324169999999999 2021-10-08T19:26:56.765 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.765 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.765 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:56.765 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.754606+0000", 2021-10-08T19:26:56.765 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.10100933300000001 2021-10-08T19:26:56.766 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.766 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.766 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:26:56.766 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.754663+0000", 2021-10-08T19:26:56.766 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6833999999999998e-05 2021-10-08T19:26:56.767 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.767 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.767 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:56.767 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.755646+0000", 2021-10-08T19:26:56.767 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00098320000000000005 2021-10-08T19:26:56.768 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:56.768 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:56.768 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:56.768 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.768 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.769 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:117008 7.c 7:3363a241:::benchmark_data_smithi097_93198_object25188:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e146)", 2021-10-08T19:26:56.769 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:57.617126+0000", 2021-10-08T19:26:56.769 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 58.866824031999997, 2021-10-08T19:26:56.769 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.121379295, 2021-10-08T19:26:56.770 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:56.770 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:26:56.770 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:26:56.770 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:26:56.770 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:26:56.771 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 117008 2021-10-08T19:26:56.771 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.771 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:56.771 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.771 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:56.772 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.617126+0000", 2021-10-08T19:26:56.772 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:56.774 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.774 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.774 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:56.774 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.617126+0000", 2021-10-08T19:26:56.775 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:56.775 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.775 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.775 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:56.775 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.617123+0000", 2021-10-08T19:26:56.776 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2021-10-08T19:26:56.776 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.776 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.776 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:56.777 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.617133+0000", 2021-10-08T19:26:56.777 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0288e-05 2021-10-08T19:26:56.777 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.778 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.778 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:56.779 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.617151+0000", 2021-10-08T19:26:56.779 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8094999999999999e-05 2021-10-08T19:26:56.779 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.779 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.780 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:56.780 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.617160+0000", 2021-10-08T19:26:56.780 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4239999999999993e-06 2021-10-08T19:26:56.780 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.780 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.781 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:56.781 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.617215+0000", 2021-10-08T19:26:56.781 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4775000000000003e-05 2021-10-08T19:26:56.781 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.782 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.782 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:56.782 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.617328+0000", 2021-10-08T19:26:56.782 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011385199999999999 2021-10-08T19:26:56.782 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.783 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.783 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,6,7", 2021-10-08T19:26:56.783 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.617481+0000", 2021-10-08T19:26:56.783 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000152743 2021-10-08T19:26:56.784 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.784 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.784 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:26:56.784 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.620950+0000", 2021-10-08T19:26:56.784 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003468989 2021-10-08T19:26:56.785 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.785 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.785 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:56.785 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.627462+0000", 2021-10-08T19:26:56.785 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0065120559999999996 2021-10-08T19:26:56.786 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.786 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.786 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:56.786 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.627990+0000", 2021-10-08T19:26:56.787 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00052785199999999999 2021-10-08T19:26:56.787 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.787 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.788 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:56.788 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.737508+0000", 2021-10-08T19:26:56.788 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.109518013 2021-10-08T19:26:56.788 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.789 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.789 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:26:56.789 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.737568+0000", 2021-10-08T19:26:56.789 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9818999999999998e-05 2021-10-08T19:26:56.789 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.790 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.790 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:56.790 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.738505+0000", 2021-10-08T19:26:56.790 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00093716199999999996 2021-10-08T19:26:56.790 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:56.791 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:56.791 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:56.791 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.791 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.792 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:117013 7.c 7:3958ebe2:::benchmark_data_smithi097_93198_object25193:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e146)", 2021-10-08T19:26:56.792 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:57.618295+0000", 2021-10-08T19:26:56.792 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 58.865654851000002, 2021-10-08T19:26:56.792 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.124585449, 2021-10-08T19:26:56.792 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:56.793 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:26:56.793 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:26:56.793 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:26:56.793 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:26:56.793 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 117013 2021-10-08T19:26:56.794 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.794 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:56.794 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.794 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:56.795 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.618295+0000", 2021-10-08T19:26:56.795 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:56.795 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.795 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.795 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:56.796 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.618295+0000", 2021-10-08T19:26:56.796 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:56.796 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.797 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.797 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:56.797 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.618294+0000", 2021-10-08T19:26:56.798 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2021-10-08T19:26:56.798 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.798 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.799 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:56.800 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.618297+0000", 2021-10-08T19:26:56.800 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9890000000000001e-06 2021-10-08T19:26:56.800 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.800 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.801 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:56.801 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.618302+0000", 2021-10-08T19:26:56.801 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.899e-06 2021-10-08T19:26:56.801 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.801 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.802 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:56.802 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.618306+0000", 2021-10-08T19:26:56.802 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1590000000000003e-06 2021-10-08T19:26:56.802 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.803 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.803 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:56.803 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.622144+0000", 2021-10-08T19:26:56.803 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038377849999999998 2021-10-08T19:26:56.803 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.804 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.804 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:56.804 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.622310+0000", 2021-10-08T19:26:56.804 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016551700000000001 2021-10-08T19:26:56.804 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.805 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.805 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,6,7", 2021-10-08T19:26:56.805 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.622481+0000", 2021-10-08T19:26:56.805 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017150499999999999 2021-10-08T19:26:56.806 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.806 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.806 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:26:56.806 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.628002+0000", 2021-10-08T19:26:56.807 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.005521214 2021-10-08T19:26:56.807 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.807 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.807 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:56.808 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.630202+0000", 2021-10-08T19:26:56.808 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021990970000000001 2021-10-08T19:26:56.808 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.809 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.809 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:56.809 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.630618+0000", 2021-10-08T19:26:56.809 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00041630500000000001 2021-10-08T19:26:56.809 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.810 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.810 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:56.810 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.741921+0000", 2021-10-08T19:26:56.810 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.11130298299999999 2021-10-08T19:26:56.811 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.811 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.811 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:26:56.811 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.741978+0000", 2021-10-08T19:26:56.811 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7679000000000001e-05 2021-10-08T19:26:56.812 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.812 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.812 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:56.812 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.742880+0000", 2021-10-08T19:26:56.813 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00090192699999999996 2021-10-08T19:26:56.813 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:56.813 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:56.814 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:56.814 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.814 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.814 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:117023 7.c 7:34632384:::benchmark_data_smithi097_93198_object25203:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e147)", 2021-10-08T19:26:56.815 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:57.635872+0000", 2021-10-08T19:26:56.815 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 58.848077940000003, 2021-10-08T19:26:56.815 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.10940074800000001, 2021-10-08T19:26:56.815 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:56.815 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:26:56.816 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:26:56.816 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:26:56.816 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:26:56.816 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 117023 2021-10-08T19:26:56.817 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.817 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:56.817 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.817 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:56.817 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.635872+0000", 2021-10-08T19:26:56.818 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:56.818 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.818 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.818 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:56.818 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.635872+0000", 2021-10-08T19:26:56.819 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:56.819 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.819 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.819 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:56.820 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.635869+0000", 2021-10-08T19:26:56.820 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999967 2021-10-08T19:26:56.820 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.820 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.820 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:56.821 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.635879+0000", 2021-10-08T19:26:56.821 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0352e-05 2021-10-08T19:26:56.821 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.821 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.821 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:56.822 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.635897+0000", 2021-10-08T19:26:56.822 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8068999999999999e-05 2021-10-08T19:26:56.822 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.822 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.823 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:56.823 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.635905+0000", 2021-10-08T19:26:56.823 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3950000000000003e-06 2021-10-08T19:26:56.823 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.823 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.824 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:56.824 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.635962+0000", 2021-10-08T19:26:56.824 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7688000000000001e-05 2021-10-08T19:26:56.824 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.824 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.825 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:56.825 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.636136+0000", 2021-10-08T19:26:56.825 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000174067 2021-10-08T19:26:56.825 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.826 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.826 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,6,7", 2021-10-08T19:26:56.826 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.636288+0000", 2021-10-08T19:26:56.826 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000152075 2021-10-08T19:26:56.826 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.827 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.827 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:26:56.827 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.639512+0000", 2021-10-08T19:26:56.827 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032239439999999999 2021-10-08T19:26:56.827 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.828 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.828 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:56.828 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.644075+0000", 2021-10-08T19:26:56.828 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0045628750000000001 2021-10-08T19:26:56.828 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.829 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.829 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:56.829 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.644128+0000", 2021-10-08T19:26:56.829 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3115999999999998e-05 2021-10-08T19:26:56.830 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.830 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.830 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:56.830 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.744275+0000", 2021-10-08T19:26:56.830 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.100146364 2021-10-08T19:26:56.831 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.831 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.831 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:26:56.831 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.744334+0000", 2021-10-08T19:26:56.831 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8984999999999999e-05 2021-10-08T19:26:56.832 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.832 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.832 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:56.832 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.745273+0000", 2021-10-08T19:26:56.833 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00093895199999999995 2021-10-08T19:26:56.833 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:56.833 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:56.833 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:56.833 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.834 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.834 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:129433 7.c 7:33db8c26:::benchmark_data_smithi097_93198_object37613:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e149)", 2021-10-08T19:26:56.834 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:26:14.344163+0000", 2021-10-08T19:26:56.834 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 42.139786899000001, 2021-10-08T19:26:56.834 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.103029788, 2021-10-08T19:26:56.835 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:56.835 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:26:56.835 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:26:56.835 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:26:56.836 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:26:56.836 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 129433 2021-10-08T19:26:56.836 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.836 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:56.836 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.837 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:56.837 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:14.344163+0000", 2021-10-08T19:26:56.837 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:56.837 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.837 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.838 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:56.838 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:14.344163+0000", 2021-10-08T19:26:56.838 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:56.839 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.839 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.839 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:56.839 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:14.344161+0000", 2021-10-08T19:26:56.839 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:26:56.840 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.840 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.840 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:56.840 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:14.344166+0000", 2021-10-08T19:26:56.840 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4500000000000003e-06 2021-10-08T19:26:56.841 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.841 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.841 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:56.841 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:14.344174+0000", 2021-10-08T19:26:56.842 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4290000000000004e-06 2021-10-08T19:26:56.842 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.842 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.842 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:56.843 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:14.344180+0000", 2021-10-08T19:26:56.844 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6370000000000004e-06 2021-10-08T19:26:56.844 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.844 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.845 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:56.845 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:14.344235+0000", 2021-10-08T19:26:56.845 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5210000000000002e-05 2021-10-08T19:26:56.846 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.846 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.846 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:56.846 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:14.344333+0000", 2021-10-08T19:26:56.846 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.8673999999999997e-05 2021-10-08T19:26:56.847 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.847 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.847 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,6,7", 2021-10-08T19:26:56.847 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:14.344471+0000", 2021-10-08T19:26:56.848 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013785499999999999 2021-10-08T19:26:56.848 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.848 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.849 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:26:56.850 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:14.347465+0000", 2021-10-08T19:26:56.850 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029935600000000001 2021-10-08T19:26:56.850 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.850 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.850 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:56.851 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:14.349944+0000", 2021-10-08T19:26:56.851 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002479218 2021-10-08T19:26:56.851 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.851 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.852 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:56.852 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:14.349990+0000", 2021-10-08T19:26:56.852 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5816999999999999e-05 2021-10-08T19:26:56.852 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.852 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.853 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:56.853 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:14.446381+0000", 2021-10-08T19:26:56.853 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.096391276999999997 2021-10-08T19:26:56.853 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.853 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.854 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:26:56.854 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:14.446455+0000", 2021-10-08T19:26:56.854 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3478000000000004e-05 2021-10-08T19:26:56.854 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.855 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.855 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:56.855 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:14.447193+0000", 2021-10-08T19:26:56.855 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000738093 2021-10-08T19:26:56.855 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:56.856 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:56.856 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:56.856 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.856 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.856 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:158640 7.e 7:705eda0e:::benchmark_data_smithi097_93198_object66820:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158)", 2021-10-08T19:26:56.857 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:26:53.907516+0000", 2021-10-08T19:26:56.857 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 2.5764341650000002, 2021-10-08T19:26:56.857 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.115901639, 2021-10-08T19:26:56.857 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:56.858 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:26:56.858 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:26:56.858 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:26:56.858 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:26:56.858 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 158640 2021-10-08T19:26:56.859 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.859 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:56.859 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.859 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:56.859 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:53.907516+0000", 2021-10-08T19:26:56.860 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:56.860 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.860 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.860 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:56.860 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:53.907516+0000", 2021-10-08T19:26:56.861 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:56.861 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.861 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.861 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:56.862 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:53.907515+0000", 2021-10-08T19:26:56.862 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:26:56.862 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.862 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.862 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:56.863 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:53.907519+0000", 2021-10-08T19:26:56.863 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6129999999999997e-06 2021-10-08T19:26:56.863 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.863 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.863 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:56.864 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:53.907527+0000", 2021-10-08T19:26:56.864 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7680000000000008e-06 2021-10-08T19:26:56.864 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.864 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.865 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:56.865 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:53.907533+0000", 2021-10-08T19:26:56.865 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5439999999999998e-06 2021-10-08T19:26:56.865 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.865 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.866 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:56.866 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:53.907577+0000", 2021-10-08T19:26:56.866 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4567000000000002e-05 2021-10-08T19:26:56.866 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.866 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.867 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:56.867 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:53.907672+0000", 2021-10-08T19:26:56.867 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5169999999999999e-05 2021-10-08T19:26:56.868 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.868 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.868 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:26:56.868 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:53.907767+0000", 2021-10-08T19:26:56.869 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5175999999999998e-05 2021-10-08T19:26:56.869 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.869 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.869 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:56.869 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:54.004267+0000", 2021-10-08T19:26:56.870 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.096499101000000004 2021-10-08T19:26:56.870 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.870 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.870 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:26:56.870 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:54.004287+0000", 2021-10-08T19:26:56.871 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0599e-05 2021-10-08T19:26:56.871 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.871 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.871 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:56.872 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:54.023326+0000", 2021-10-08T19:26:56.872 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019038798999999999 2021-10-08T19:26:56.872 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.872 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.872 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:26:56.873 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:54.023376+0000", 2021-10-08T19:26:56.873 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0269999999999998e-05 2021-10-08T19:26:56.873 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.873 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.873 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:56.874 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:54.023417+0000", 2021-10-08T19:26:56.874 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1094999999999999e-05 2021-10-08T19:26:56.874 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:56.874 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:56.875 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:56.875 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.875 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.875 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:158641 7.c 7:3993f09c:::benchmark_data_smithi097_93198_object66821:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158)", 2021-10-08T19:26:56.875 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:26:53.910514+0000", 2021-10-08T19:26:56.876 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 2.5734360870000001, 2021-10-08T19:26:56.876 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.107113747, 2021-10-08T19:26:56.876 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:56.876 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:26:56.876 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:26:56.877 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:26:56.877 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:26:56.877 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 158641 2021-10-08T19:26:56.877 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.877 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:56.878 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.878 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:56.878 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:53.910514+0000", 2021-10-08T19:26:56.878 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:56.879 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.879 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.879 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:56.879 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:53.910514+0000", 2021-10-08T19:26:56.879 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:56.880 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.880 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.880 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:56.880 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:53.910512+0000", 2021-10-08T19:26:56.880 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:26:56.881 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.881 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.881 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:56.881 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:53.910518+0000", 2021-10-08T19:26:56.881 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6540000000000002e-06 2021-10-08T19:26:56.882 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.882 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.882 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:56.882 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:54.003948+0000", 2021-10-08T19:26:56.883 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.093429544000000003 2021-10-08T19:26:56.883 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.883 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.883 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:56.883 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:54.003956+0000", 2021-10-08T19:26:56.884 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7219999999999999e-06 2021-10-08T19:26:56.884 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.884 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.884 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:56.884 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:54.004967+0000", 2021-10-08T19:26:56.885 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010112039999999999 2021-10-08T19:26:56.885 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.885 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.885 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:56.886 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:54.005137+0000", 2021-10-08T19:26:56.886 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017009600000000001 2021-10-08T19:26:56.886 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.886 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.887 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,6,7", 2021-10-08T19:26:56.887 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:54.005295+0000", 2021-10-08T19:26:56.888 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015800100000000001 2021-10-08T19:26:56.888 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.888 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.888 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:56.888 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:54.012792+0000", 2021-10-08T19:26:56.889 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0074973110000000004 2021-10-08T19:26:56.889 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.889 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.889 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:56.890 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:54.015945+0000", 2021-10-08T19:26:56.890 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003152639 2021-10-08T19:26:56.890 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.890 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.891 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:56.891 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:54.015979+0000", 2021-10-08T19:26:56.891 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3976000000000001e-05 2021-10-08T19:26:56.891 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.891 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.892 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:26:56.892 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:54.017049+0000", 2021-10-08T19:26:56.892 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001070147 2021-10-08T19:26:56.893 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.893 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.894 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:26:56.894 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:54.017118+0000", 2021-10-08T19:26:56.894 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9178999999999996e-05 2021-10-08T19:26:56.894 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.895 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.895 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:56.895 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:54.017627+0000", 2021-10-08T19:26:56.895 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00050927399999999999 2021-10-08T19:26:56.895 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:56.896 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:56.896 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:56.896 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.896 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.897 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.24796.0:159671 7.3 e158/94 7:c69e4689:::benchmark_data_smithi097_93198_object67851:head v 158'10110, mlcod=158'10108)", 2021-10-08T19:26:56.897 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:26:55.196634+0000", 2021-10-08T19:26:56.897 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 1.2873162730000001, 2021-10-08T19:26:56.897 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.103383167, 2021-10-08T19:26:56.897 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:56.898 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:26:56.898 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:56.898 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.899 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:56.899 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.196634+0000", 2021-10-08T19:26:56.899 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:56.899 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.899 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.900 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:56.900 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.196634+0000", 2021-10-08T19:26:56.900 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:56.900 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.901 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.901 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:56.901 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.196632+0000", 2021-10-08T19:26:56.901 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:26:56.901 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.902 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.902 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:56.902 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.196641+0000", 2021-10-08T19:26:56.902 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2779999999999993e-06 2021-10-08T19:26:56.903 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.903 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.903 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:56.904 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.196651+0000", 2021-10-08T19:26:56.905 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0583e-05 2021-10-08T19:26:56.905 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.905 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.905 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:56.906 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.196658+0000", 2021-10-08T19:26:56.906 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2779999999999999e-06 2021-10-08T19:26:56.906 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.906 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.906 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:56.907 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.196702+0000", 2021-10-08T19:26:56.907 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4521999999999998e-05 2021-10-08T19:26:56.907 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.908 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.908 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:56.908 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.196724+0000", 2021-10-08T19:26:56.908 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2001000000000002e-05 2021-10-08T19:26:56.908 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.909 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.909 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:26:56.909 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.299982+0000", 2021-10-08T19:26:56.910 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.10325809499999999 2021-10-08T19:26:56.910 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.910 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.910 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:56.910 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.300017+0000", 2021-10-08T19:26:56.911 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4508000000000002e-05 2021-10-08T19:26:56.911 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:56.911 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:56.911 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:56.912 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.912 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.912 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:159676 7.e 7:74985da7:::benchmark_data_smithi097_93198_object67856:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158)", 2021-10-08T19:26:56.912 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:26:55.204112+0000", 2021-10-08T19:26:56.912 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 1.2798380489999999, 2021-10-08T19:26:56.913 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.10814876399999999, 2021-10-08T19:26:56.913 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:26:56.914 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:26:56.914 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:26:56.914 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:26:56.914 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:26:56.915 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 159676 2021-10-08T19:26:56.915 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.915 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:26:56.916 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.916 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:26:56.916 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.204112+0000", 2021-10-08T19:26:56.916 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:56.916 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.917 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.917 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:26:56.917 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.204112+0000", 2021-10-08T19:26:56.917 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:26:56.917 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.918 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.918 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:26:56.918 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.204110+0000", 2021-10-08T19:26:56.918 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:26:56.919 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.919 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.919 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:26:56.919 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.204117+0000", 2021-10-08T19:26:56.919 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6340000000000001e-06 2021-10-08T19:26:56.920 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.920 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.920 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:26:56.920 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.204129+0000", 2021-10-08T19:26:56.920 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1851000000000001e-05 2021-10-08T19:26:56.921 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.921 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.921 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:26:56.921 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.204136+0000", 2021-10-08T19:26:56.922 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7170000000000002e-06 2021-10-08T19:26:56.922 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.922 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.922 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:26:56.922 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.204177+0000", 2021-10-08T19:26:56.924 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1601999999999999e-05 2021-10-08T19:26:56.924 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.924 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.925 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:26:56.925 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.204253+0000", 2021-10-08T19:26:56.925 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6007999999999995e-05 2021-10-08T19:26:56.925 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.925 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.926 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:26:56.926 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.204337+0000", 2021-10-08T19:26:56.926 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3407999999999998e-05 2021-10-08T19:26:56.926 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.926 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.927 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:56.927 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.206699+0000", 2021-10-08T19:26:56.927 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0023617680000000002 2021-10-08T19:26:56.927 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.928 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.928 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:26:56.928 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.207753+0000", 2021-10-08T19:26:56.928 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010547410000000001 2021-10-08T19:26:56.928 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.929 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.929 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:26:56.929 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.312177+0000", 2021-10-08T19:26:56.930 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.10442370199999999 2021-10-08T19:26:56.930 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.930 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.931 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:26:56.931 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.312223+0000", 2021-10-08T19:26:56.931 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6147999999999999e-05 2021-10-08T19:26:56.931 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:26:56.931 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:26:56.932 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:26:56.932 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.312261+0000", 2021-10-08T19:26:56.932 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7398999999999999e-05 2021-10-08T19:26:56.932 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:56.932 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:56.933 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:56.933 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:26:56.933 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:26:56.933 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:26:56.934 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:56.935 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:26:56.935 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:26:56 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:26:56.936 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:56.937 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:26:57.038 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:26:57.081 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:57.147 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:26:57.149 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:57.150 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:26:57.251 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:26:57.329 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:57.761 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set noscrub 2021-10-08T19:26:58.031 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:26:58.039 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:58.040 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:26:58.041 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:57 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:26:58.041 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:57 smithi097 ceph-mon[41966]: pgmap v245: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 1.5 GiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 843 op/s; 8825/76179 objects degraded (11.585%); 1339/76179 objects misplaced (1.758%); 0 B/s, 36 objects/s recovering 2021-10-08T19:26:58.041 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:57 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:26:58.042 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:57 smithi097 ceph-mon[32687]: pgmap v245: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 1.5 GiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 843 op/s; 8825/76179 objects degraded (11.585%); 1339/76179 objects misplaced (1.758%); 0 B/s, 36 objects/s recovering 2021-10-08T19:26:58.142 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:26:58.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:57 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:26:58.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:57 smithi117 ceph-mon[34585]: pgmap v245: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 1.5 GiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 843 op/s; 8825/76179 objects degraded (11.585%); 1339/76179 objects misplaced (1.758%); 0 B/s, 36 objects/s recovering 2021-10-08T19:26:58.175 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:58.238 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:26:58.240 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:58.241 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:26:58.342 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:26:58.381 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:58.641 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2021-10-08T19:26:58.768 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:26:58.776 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:58.787 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:26:58.889 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:26:58.915 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:59.030 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:26:59.032 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:59.033 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:26:59.038 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:26:59.135 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:26:59.168 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:59.334 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:26:59.340 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:59.341 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:26:59.444 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:26:59.483 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:59.562 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:26:59.565 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:26:59.566 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:26:59.609 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:26:59.667 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:26:59.759 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:26:59.814 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:26:59.855 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:26:59.923 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:26:59.982 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:59 smithi097 ceph-mon[32687]: pgmap v246: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 1.5 GiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 553 op/s; 8768/74175 objects degraded (11.821%); 1339/74175 objects misplaced (1.805%); 0 B/s, 29 objects/s recovering 2021-10-08T19:26:59.983 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:26:59 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2906985292' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:26:59.983 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:59 smithi097 ceph-mon[41966]: pgmap v246: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 1.5 GiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 553 op/s; 8768/74175 objects degraded (11.821%); 1339/74175 objects misplaced (1.805%); 0 B/s, 29 objects/s recovering 2021-10-08T19:26:59.983 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:26:59 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2906985292' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:26:59.984 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:27:00.023 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:27:00.028 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:00.029 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:27:00.031 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:27:00.078 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:27:00.099 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:59 smithi117 ceph-mon[34585]: pgmap v246: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 1.5 GiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 553 op/s; 8768/74175 objects degraded (11.821%); 1339/74175 objects misplaced (1.805%); 0 B/s, 29 objects/s recovering 2021-10-08T19:27:00.099 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:26:59 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2906985292' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:27:00.131 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:27:00.141 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:27:00.166 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:00.179 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:27:00.205 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'false' 2021-10-08T19:27:00.205 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'false' 2021-10-08T19:27:00.206 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'false' 2021-10-08T19:27:00.206 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'false' 2021-10-08T19:27:00.206 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'false' 2021-10-08T19:27:00.207 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'false' 2021-10-08T19:27:00.208 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'false' 2021-10-08T19:27:00.208 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'false' 2021-10-08T19:27:00.323 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:27:00.326 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:00.327 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:27:00.431 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:27:00.526 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:00.717 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 7, 6] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2021-10-08T19:27:00.717 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2021-10-08T19:27:00.718 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2021-10-08T19:27:00.718 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph pg dump --format=json 2021-10-08T19:27:00.866 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:27:00.873 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:00.874 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:27:00.975 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:27:01.033 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:00 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:27:01.033 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:00 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:27:01.033 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:00 smithi097 ceph-mon[41966]: Health check update: Degraded data redundancy: 8768/74175 objects degraded (11.821%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:27:01.035 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:00 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:27:01.035 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:00 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:27:01.035 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:00 smithi097 ceph-mon[32687]: Health check update: Degraded data redundancy: 8768/74175 objects degraded (11.821%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:27:01.039 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:01.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:00 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:27:01.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:00 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:27:01.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:00 smithi117 ceph-mon[34585]: Health check update: Degraded data redundancy: 8768/74175 objects degraded (11.821%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:27:02.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:01 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:27:02.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:01 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:27:02.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:01 smithi117 ceph-mon[34585]: pgmap v247: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 1.3 GiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 928 op/s; 8710/65178 objects degraded (13.363%); 1281/65178 objects misplaced (1.965%); 0 B/s, 43 objects/s recovering 2021-10-08T19:27:02.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:01 smithi117 ceph-mon[34585]: osdmap e159: 8 total, 8 up, 8 in 2021-10-08T19:27:02.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:01 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:27:02.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:01 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:27:02.176 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:27:02.184 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:02.186 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:27:02.186 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:01 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:27:02.187 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:01 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:27:02.187 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:01 smithi097 ceph-mon[41966]: pgmap v247: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 1.3 GiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 928 op/s; 8710/65178 objects degraded (13.363%); 1281/65178 objects misplaced (1.965%); 0 B/s, 43 objects/s recovering 2021-10-08T19:27:02.187 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:01 smithi097 ceph-mon[41966]: osdmap e159: 8 total, 8 up, 8 in 2021-10-08T19:27:02.188 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:01 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:27:02.188 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:01 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:27:02.188 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:01 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:27:02.189 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:01 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:27:02.189 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:01 smithi097 ceph-mon[32687]: pgmap v247: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 1.3 GiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 928 op/s; 8710/65178 objects degraded (13.363%); 1281/65178 objects misplaced (1.965%); 0 B/s, 43 objects/s recovering 2021-10-08T19:27:02.189 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:01 smithi097 ceph-mon[32687]: osdmap e159: 8 total, 8 up, 8 in 2021-10-08T19:27:02.189 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:01 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:27:02.189 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:01 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:27:02.287 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:27:02.333 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:02.417 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:27:02.422 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:02.423 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:27:02.524 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:27:02.584 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:02.852 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:27:02 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:27:02] "GET /metrics HTTP/1.1" 200 155778 "" "Prometheus/2.18.1" 2021-10-08T19:27:02.852 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:02 smithi097 ceph-mon[32687]: osdmap e160: 8 total, 8 up, 8 in 2021-10-08T19:27:03.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:02 smithi117 ceph-mon[34585]: osdmap e160: 8 total, 8 up, 8 in 2021-10-08T19:27:03.219 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:02 smithi097 ceph-mon[41966]: osdmap e160: 8 total, 8 up, 8 in 2021-10-08T19:27:03.631 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:27:03.633 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:27:03.643 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:03.644 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:27:03.745 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:27:03.810 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:03.858 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:03 smithi097 ceph-mon[32687]: pgmap v250: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 1.3 GiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 458 op/s; 8710/65178 objects degraded (13.363%); 1281/65178 objects misplaced (1.965%); 0 B/s, 21 objects/s recovering 2021-10-08T19:27:03.860 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:27:03 smithi117 conmon[69189]: level=error ts=2021-10-08T19:27:03.505Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=2 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:27:03.860 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:03 smithi117 ceph-mon[34585]: pgmap v250: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 1.3 GiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 458 op/s; 8710/65178 objects degraded (13.363%); 1281/65178 objects misplaced (1.965%); 0 B/s, 21 objects/s recovering 2021-10-08T19:27:04.095 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:27:04.099 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:04.100 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:27:04.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:27:03 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:27:03] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:27:04.201 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:27:04.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:03 smithi097 ceph-mon[41966]: pgmap v250: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 1.3 GiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 458 op/s; 8710/65178 objects degraded (13.363%); 1281/65178 objects misplaced (1.965%); 0 B/s, 21 objects/s recovering 2021-10-08T19:27:04.276 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:04.534 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:27:04.545 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:04.546 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:27:04.648 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:27:04.676 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:04.739 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:27:04.742 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:04.742 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:27:04.833 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2021-10-08T19:27:04.833 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:27:04.844 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:27:04.877 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:04.905 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is set 2021-10-08T19:27:04.945 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:27:04.947 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:04 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:27:04.947 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:04 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:27:04.948 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:04 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3594252141' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:27:04.948 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:04.949 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:27:05.050 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:27:05.078 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:05.147 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:27:05.152 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:05.153 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:27:05.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:04 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:27:05.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:04 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:27:05.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:04 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3594252141' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:27:05.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:04 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:27:05.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:04 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:27:05.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:04 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3594252141' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:27:05.254 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:27:05.318 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:05.588 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2021-10-08T19:27:05.633 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:27:05 smithi097 conmon[33110]: 172.21.15.117 - - [08/Oct/2021:19:27:05] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:27:05.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:05 smithi097 ceph-mon[32687]: pgmap v251: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 1.1 GiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 908 op/s; 8592/54396 objects degraded (15.795%); 1223/54396 objects misplaced (2.248%); 0 B/s, 43 objects/s recovering 2021-10-08T19:27:05.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:05 smithi097 ceph-mon[32687]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:27:05.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:05 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3594252141' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:27:05.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:05 smithi097 ceph-mon[32687]: osdmap e161: 8 total, 8 up, 8 in 2021-10-08T19:27:05.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:05 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:27:05.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:05 smithi097 ceph-mon[32687]: Health check update: Degraded data redundancy: 8592/54396 objects degraded (15.795%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:27:05.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:05 smithi097 ceph-mon[32687]: osdmap e162: 8 total, 8 up, 8 in 2021-10-08T19:27:05.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:05 smithi097 ceph-mon[41966]: pgmap v251: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 1.1 GiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 908 op/s; 8592/54396 objects degraded (15.795%); 1223/54396 objects misplaced (2.248%); 0 B/s, 43 objects/s recovering 2021-10-08T19:27:05.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:05 smithi097 ceph-mon[41966]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:27:05.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:05 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3594252141' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:27:05.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:05 smithi097 ceph-mon[41966]: osdmap e161: 8 total, 8 up, 8 in 2021-10-08T19:27:05.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:05 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:27:05.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:05 smithi097 ceph-mon[41966]: Health check update: Degraded data redundancy: 8592/54396 objects degraded (15.795%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:27:05.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:05 smithi097 ceph-mon[41966]: osdmap e162: 8 total, 8 up, 8 in 2021-10-08T19:27:06.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:05 smithi117 ceph-mon[34585]: pgmap v251: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 1.1 GiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 908 op/s; 8592/54396 objects degraded (15.795%); 1223/54396 objects misplaced (2.248%); 0 B/s, 43 objects/s recovering 2021-10-08T19:27:06.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:05 smithi117 ceph-mon[34585]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:27:06.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:05 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3594252141' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:27:06.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:05 smithi117 ceph-mon[34585]: osdmap e161: 8 total, 8 up, 8 in 2021-10-08T19:27:06.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:05 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:27:06.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:05 smithi117 ceph-mon[34585]: Health check update: Degraded data redundancy: 8592/54396 objects degraded (15.795%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:27:06.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:05 smithi117 ceph-mon[34585]: osdmap e162: 8 total, 8 up, 8 in 2021-10-08T19:27:06.655 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:27:06 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:27:06.784 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2021-10-08T19:27:06.986 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:27:07.004 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:07.005 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:27:07.005 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:06 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:27:07.005 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:06 smithi097 ceph-mon[41966]: 172.21.15.117 - - [08/Oct/2021:19:27:05] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:27:07.006 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:06 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:27:07.006 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:06 smithi097 ceph-mon[32687]: 172.21.15.117 - - [08/Oct/2021:19:27:05] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:27:07.106 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:27:07.134 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:07.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:06 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:27:07.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:06 smithi117 ceph-mon[34585]: 172.21.15.117 - - [08/Oct/2021:19:27:05] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:27:07.198 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:27:07.200 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:07.201 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:27:07.302 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:27:07.328 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:07.376 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:27:07.377 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:07.378 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:27:07.479 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:27:07.506 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:07.536 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:27:07.563 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:27:07.566 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:07.566 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:27:07.653 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:27:07.668 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:27:07.702 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:07.765 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:27:07.768 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:07.770 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:27:07.871 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:27:07.897 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:07.953 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:27:07.955 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:07.956 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:27:08.057 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:27:08.125 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:08.152 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:07 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:27:08.152 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:07 smithi097 ceph-mon[41966]: pgmap v254: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 1.1 GiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 890 B/s rd, 0 B/s wr, 626 op/s; 8592/54396 objects degraded (15.795%); 1223/54396 objects misplaced (2.248%); 0 B/s, 30 objects/s recovering 2021-10-08T19:27:08.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:07 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:27:08.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:07 smithi117 ceph-mon[34585]: pgmap v254: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 1.1 GiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 890 B/s rd, 0 B/s wr, 626 op/s; 8592/54396 objects degraded (15.795%); 1223/54396 objects misplaced (2.248%); 0 B/s, 30 objects/s recovering 2021-10-08T19:27:08.156 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:07 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:27:08.156 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:07 smithi097 ceph-mon[32687]: pgmap v254: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 1.1 GiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 890 B/s rd, 0 B/s wr, 626 op/s; 8592/54396 objects degraded (15.795%); 1223/54396 objects misplaced (2.248%); 0 B/s, 30 objects/s recovering 2021-10-08T19:27:08.385 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:27:08.399 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:08.399 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:27:08.501 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:27:08.528 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:08.574 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:27:08.576 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:08.577 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:27:08.678 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:27:08.723 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set nodeep-scrub 2021-10-08T19:27:08.752 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:08.831 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:27:08.875 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2021-10-08T19:27:09.801 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:27:09.816 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:09.817 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:27:09.919 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:27:09.978 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:10.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:09 smithi097 ceph-mon[41966]: pgmap v255: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 1.1 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 633 op/s; 8534/52422 objects degraded (16.279%); 1223/52422 objects misplaced (2.333%); 0 B/s, 34 objects/s recovering 2021-10-08T19:27:10.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:09 smithi097 ceph-mon[41966]: from='client.35030 v1:172.21.15.97:0/2983443628' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:27:10.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:09 smithi097 ceph-mon[32687]: pgmap v255: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 1.1 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 633 op/s; 8534/52422 objects degraded (16.279%); 1223/52422 objects misplaced (2.333%); 0 B/s, 34 objects/s recovering 2021-10-08T19:27:10.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:09 smithi097 ceph-mon[32687]: from='client.35030 v1:172.21.15.97:0/2983443628' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:27:10.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:09 smithi117 ceph-mon[34585]: pgmap v255: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 1.1 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 633 op/s; 8534/52422 objects degraded (16.279%); 1223/52422 objects misplaced (2.333%); 0 B/s, 34 objects/s recovering 2021-10-08T19:27:10.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:09 smithi117 ceph-mon[34585]: from='client.35030 v1:172.21.15.97:0/2983443628' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:27:10.982 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:27:10.986 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":255,"stamp":"2021-10-08T19:27:08.557106+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1132927488,"num_objects":17474,"num_object_clones":0,"num_object_copies":52422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":8534,"num_objects_misplaced":1223,"num_objects_unfound":0,"num_objects_dirty":17474,"num_whiteouts":0,"num_read":1214,"num_read_kb":1061,"num_write":166963,"num_write_kb":5878746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5688,"num_bytes_recovered":285218110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":77371,"ondisk_log_size":77371,"up":504,"acting":500,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":511,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":4745956,"kb_used_data":4093988,"kb_used_omap":0,"kb_used_meta":651648,"kb_avail":745215260,"statfs":{"total":767960285184,"available":763100426240,"internally_reserved":0,"allocated":4192243712,"data_stored":4188876556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":667287552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,3,1,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-278659072,"num_objects":-4252,"num_object_clones":0,"num_object_copies":-12756,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-176,"num_objects_misplaced":-58,"num_objects_unfound":0,"num_objects_dirty":-4252,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4252,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":234,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.730113"},"pg_stats":[{"pgid":"5.9","version":"114'10","reported_seq":216,"reported_epoch":162,"state":"active+clean","last_fresh":"2021-10-08T19:27:05.563196+0000","last_change":"2021-10-08T19:24:25.116744+0000","last_active":"2021-10-08T19:27:05.563196+0000","last_peered":"2021-10-08T19:27:05.563196+0000","last_clean":"2021-10-08T19:27:05.563196+0000","last_became_active":"2021-10-08T19:24:25.096162+0000","last_became_peered":"2021-10-08T19:24:25.096162+0000","last_unstale":"2021-10-08T19:27:05.563196+0000","last_undegraded":"2021-10-08T19:27:05.563196+0000","last_fullsized":"2021-10-08T19:27:05.563196+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'8","last_scrub_stamp":"2021-10-08T19:22:51.065949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:51.065949+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020224639999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"87'22","reported_seq":201,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.886885+0000","last_change":"2021-10-08T19:24:25.118654+0000","last_active":"2021-10-08T19:27:04.886885+0000","last_peered":"2021-10-08T19:27:04.886885+0000","last_clean":"2021-10-08T19:27:04.886885+0000","last_became_active":"2021-10-08T19:24:25.088861+0000","last_became_peered":"2021-10-08T19:24:25.088861+0000","last_unstale":"2021-10-08T19:27:04.886885+0000","last_undegraded":"2021-10-08T19:27:04.886885+0000","last_fullsized":"2021-10-08T19:27:04.886885+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'22","last_scrub_stamp":"2021-10-08T19:24:20.355553+0000","last_deep_scrub":"87'22","last_deep_scrub_stamp":"2021-10-08T19:22:58.705632+0000","last_clean_scrub_stamp":"2021-10-08T19:24:20.355553+0000","log_size":22,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0022961499999999998,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":120,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.823550+0000","last_change":"2021-10-08T19:24:07.800878+0000","last_active":"2021-10-08T19:27:00.823550+0000","last_peered":"2021-10-08T19:27:00.823550+0000","last_clean":"2021-10-08T19:27:00.823550+0000","last_became_active":"2021-10-08T19:21:23.600352+0000","last_became_peered":"2021-10-08T19:21:23.600352+0000","last_unstale":"2021-10-08T19:27:00.823550+0000","last_undegraded":"2021-10-08T19:27:00.823550+0000","last_fullsized":"2021-10-08T19:27:00.823550+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:07.800787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:07.800787+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012798608,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":127,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.887933+0000","last_change":"2021-10-08T19:24:25.089736+0000","last_active":"2021-10-08T19:27:04.887933+0000","last_peered":"2021-10-08T19:27:04.887933+0000","last_clean":"2021-10-08T19:27:04.887933+0000","last_became_active":"2021-10-08T19:24:25.089002+0000","last_became_peered":"2021-10-08T19:24:25.089002+0000","last_unstale":"2021-10-08T19:27:04.887933+0000","last_undegraded":"2021-10-08T19:27:04.887933+0000","last_fullsized":"2021-10-08T19:27:04.887933+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:10.805052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:10.805052+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.00168849,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"160'10428","reported_seq":10515,"reported_epoch":160,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-10-08T19:27:03.671429+0000","last_change":"2021-10-08T19:24:26.874507+0000","last_active":"2021-10-08T19:27:03.671429+0000","last_peered":"2021-10-08T19:27:03.671429+0000","last_clean":"2021-10-08T19:24:23.992830+0000","last_became_active":"2021-10-08T19:24:26.866104+0000","last_became_peered":"2021-10-08T19:24:26.866104+0000","last_unstale":"2021-10-08T19:27:03.671429+0000","last_undegraded":"2021-10-08T19:24:26.186413+0000","last_fullsized":"2021-10-08T19:24:26.089542+0000","mapping_epoch":113,"log_start":"135'6005","ondisk_log_start":"135'6005","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":4423,"ondisk_log_size":4423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":73400320,"num_objects":1120,"num_object_clones":0,"num_object_copies":3360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3062,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1120,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10428,"num_write_kb":369536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5],"avail_no_missing":["1","2","5"],"object_location_counts":[{"shards":"1,5","objects":-1942}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":44,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.883210+0000","last_change":"2021-10-08T19:25:15.510798+0000","last_active":"2021-10-08T19:27:04.883210+0000","last_peered":"2021-10-08T19:27:04.883210+0000","last_clean":"2021-10-08T19:27:04.883210+0000","last_became_active":"2021-10-08T19:25:15.510457+0000","last_became_peered":"2021-10-08T19:25:15.510457+0000","last_unstale":"2021-10-08T19:27:04.883210+0000","last_undegraded":"2021-10-08T19:27:04.883210+0000","last_fullsized":"2021-10-08T19:27:04.883210+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:09.177525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:09.177525+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"69'9","reported_seq":128,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.809198+0000","last_change":"2021-10-08T19:22:36.590210+0000","last_active":"2021-10-08T19:27:00.809198+0000","last_peered":"2021-10-08T19:27:00.809198+0000","last_clean":"2021-10-08T19:27:00.809198+0000","last_became_active":"2021-10-08T19:21:25.610072+0000","last_became_peered":"2021-10-08T19:21:25.610072+0000","last_unstale":"2021-10-08T19:27:00.809198+0000","last_undegraded":"2021-10-08T19:27:00.809198+0000","last_fullsized":"2021-10-08T19:27:00.809198+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'9","last_scrub_stamp":"2021-10-08T19:22:36.590071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:36.590071+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0026030699999999999,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":116,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.821399+0000","last_change":"2021-10-08T19:23:11.176225+0000","last_active":"2021-10-08T19:27:00.821399+0000","last_peered":"2021-10-08T19:27:00.821399+0000","last_clean":"2021-10-08T19:27:00.821399+0000","last_became_active":"2021-10-08T19:21:23.607639+0000","last_became_peered":"2021-10-08T19:21:23.607639+0000","last_unstale":"2021-10-08T19:27:00.821399+0000","last_undegraded":"2021-10-08T19:27:00.821399+0000","last_fullsized":"2021-10-08T19:27:00.821399+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:11.176122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:11.176122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040114119999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":110,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.827522+0000","last_change":"2021-10-08T19:22:42.359224+0000","last_active":"2021-10-08T19:27:00.827522+0000","last_peered":"2021-10-08T19:27:00.827522+0000","last_clean":"2021-10-08T19:27:00.827522+0000","last_became_active":"2021-10-08T19:21:27.635310+0000","last_became_peered":"2021-10-08T19:21:27.635310+0000","last_unstale":"2021-10-08T19:27:00.827522+0000","last_undegraded":"2021-10-08T19:27:00.827522+0000","last_fullsized":"2021-10-08T19:27:00.827522+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:42.359130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:42.359130+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001847357,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":108,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.817394+0000","last_change":"2021-10-08T19:22:57.644734+0000","last_active":"2021-10-08T19:27:00.817394+0000","last_peered":"2021-10-08T19:27:00.817394+0000","last_clean":"2021-10-08T19:27:00.817394+0000","last_became_active":"2021-10-08T19:21:29.643022+0000","last_became_peered":"2021-10-08T19:21:29.643022+0000","last_unstale":"2021-10-08T19:27:00.817394+0000","last_undegraded":"2021-10-08T19:27:00.817394+0000","last_fullsized":"2021-10-08T19:27:00.817394+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:57.644627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:57.644627+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002174952,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"160'10263","reported_seq":10337,"reported_epoch":160,"state":"active+clean","last_fresh":"2021-10-08T19:27:03.559159+0000","last_change":"2021-10-08T19:23:44.804233+0000","last_active":"2021-10-08T19:27:03.559159+0000","last_peered":"2021-10-08T19:27:03.559159+0000","last_clean":"2021-10-08T19:27:03.559159+0000","last_became_active":"2021-10-08T19:23:44.803928+0000","last_became_peered":"2021-10-08T19:23:44.803928+0000","last_unstale":"2021-10-08T19:27:03.559159+0000","last_undegraded":"2021-10-08T19:27:03.559159+0000","last_fullsized":"2021-10-08T19:27:03.559159+0000","mapping_epoch":94,"log_start":"127'4700","ondisk_log_start":"127'4700","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":5563,"ondisk_log_size":5563,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":75038720,"num_objects":1145,"num_object_clones":0,"num_object_copies":3435,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1145,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10263,"num_write_kb":365056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4],"acting":[2,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"70'5","reported_seq":264,"reported_epoch":162,"state":"active+clean","last_fresh":"2021-10-08T19:27:07.392767+0000","last_change":"2021-10-08T19:24:25.638250+0000","last_active":"2021-10-08T19:27:07.392767+0000","last_peered":"2021-10-08T19:27:07.392767+0000","last_clean":"2021-10-08T19:27:07.392767+0000","last_became_active":"2021-10-08T19:24:25.103095+0000","last_became_peered":"2021-10-08T19:24:25.103095+0000","last_unstale":"2021-10-08T19:27:07.392767+0000","last_undegraded":"2021-10-08T19:27:07.392767+0000","last_fullsized":"2021-10-08T19:27:07.392767+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:24:16.396790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:16.396790+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0078447029999999997,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":169,"num_read_kb":169,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":389,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"69'19","reported_seq":79,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.881111+0000","last_change":"2021-10-08T19:24:25.121334+0000","last_active":"2021-10-08T19:27:04.881111+0000","last_peered":"2021-10-08T19:27:04.881111+0000","last_clean":"2021-10-08T19:27:04.881111+0000","last_became_active":"2021-10-08T19:24:25.094547+0000","last_became_peered":"2021-10-08T19:24:25.094547+0000","last_unstale":"2021-10-08T19:27:04.881111+0000","last_undegraded":"2021-10-08T19:27:04.881111+0000","last_fullsized":"2021-10-08T19:27:04.881111+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'19","last_scrub_stamp":"2021-10-08T19:22:39.356508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:39.356508+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":31,"num_read_kb":20,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":114,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.824705+0000","last_change":"2021-10-08T19:22:57.380012+0000","last_active":"2021-10-08T19:27:00.824705+0000","last_peered":"2021-10-08T19:27:00.824705+0000","last_clean":"2021-10-08T19:27:00.824705+0000","last_became_active":"2021-10-08T19:21:23.595919+0000","last_became_peered":"2021-10-08T19:21:23.595919+0000","last_unstale":"2021-10-08T19:27:00.824705+0000","last_undegraded":"2021-10-08T19:27:00.824705+0000","last_fullsized":"2021-10-08T19:27:00.824705+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:57.379935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:57.379935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034209349999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":110,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.823009+0000","last_change":"2021-10-08T19:23:09.419579+0000","last_active":"2021-10-08T19:27:00.823009+0000","last_peered":"2021-10-08T19:27:00.823009+0000","last_clean":"2021-10-08T19:27:00.823009+0000","last_became_active":"2021-10-08T19:21:27.638583+0000","last_became_peered":"2021-10-08T19:21:27.638583+0000","last_unstale":"2021-10-08T19:27:00.823009+0000","last_undegraded":"2021-10-08T19:27:00.823009+0000","last_fullsized":"2021-10-08T19:27:00.823009+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:09.419493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:09.419493+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003406498,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":110,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.881845+0000","last_change":"2021-10-08T19:23:03.272654+0000","last_active":"2021-10-08T19:27:04.881845+0000","last_peered":"2021-10-08T19:27:04.881845+0000","last_clean":"2021-10-08T19:27:04.881845+0000","last_became_active":"2021-10-08T19:21:29.648922+0000","last_became_peered":"2021-10-08T19:21:29.648922+0000","last_unstale":"2021-10-08T19:27:04.881845+0000","last_undegraded":"2021-10-08T19:27:04.881845+0000","last_fullsized":"2021-10-08T19:27:04.881845+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:03.272581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:03.272581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001525874,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"160'10418","reported_seq":10492,"reported_epoch":160,"state":"active+clean","last_fresh":"2021-10-08T19:27:03.676457+0000","last_change":"2021-10-08T19:23:44.815633+0000","last_active":"2021-10-08T19:27:03.676457+0000","last_peered":"2021-10-08T19:27:03.676457+0000","last_clean":"2021-10-08T19:27:03.676457+0000","last_became_active":"2021-10-08T19:23:44.815346+0000","last_became_peered":"2021-10-08T19:23:44.815346+0000","last_unstale":"2021-10-08T19:27:03.676457+0000","last_undegraded":"2021-10-08T19:27:03.676457+0000","last_fullsized":"2021-10-08T19:27:03.676457+0000","mapping_epoch":94,"log_start":"133'5480","ondisk_log_start":"133'5480","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":4938,"ondisk_log_size":4938,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":72613888,"num_objects":1108,"num_object_clones":0,"num_object_copies":3324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1108,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10418,"num_write_kb":368832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":39,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.882634+0000","last_change":"2021-10-08T19:25:15.503388+0000","last_active":"2021-10-08T19:27:04.882634+0000","last_peered":"2021-10-08T19:27:04.882634+0000","last_clean":"2021-10-08T19:27:04.882634+0000","last_became_active":"2021-10-08T19:25:15.503081+0000","last_became_peered":"2021-10-08T19:25:15.503081+0000","last_unstale":"2021-10-08T19:27:04.882634+0000","last_undegraded":"2021-10-08T19:27:04.882634+0000","last_fullsized":"2021-10-08T19:27:04.882634+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:17.379559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:17.379559+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0090469920000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"69'17","reported_seq":141,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.876448+0000","last_change":"2021-10-08T19:22:47.109498+0000","last_active":"2021-10-08T19:27:04.876448+0000","last_peered":"2021-10-08T19:27:04.876448+0000","last_clean":"2021-10-08T19:27:04.876448+0000","last_became_active":"2021-10-08T19:21:25.609086+0000","last_became_peered":"2021-10-08T19:21:25.609086+0000","last_unstale":"2021-10-08T19:27:04.876448+0000","last_undegraded":"2021-10-08T19:27:04.876448+0000","last_fullsized":"2021-10-08T19:27:04.876448+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'17","last_scrub_stamp":"2021-10-08T19:22:47.109407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:47.109407+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0025026100000000002,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"61'1","reported_seq":124,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.881171+0000","last_change":"2021-10-08T19:22:55.080106+0000","last_active":"2021-10-08T19:27:04.881171+0000","last_peered":"2021-10-08T19:27:04.881171+0000","last_clean":"2021-10-08T19:27:04.881171+0000","last_became_active":"2021-10-08T19:21:23.607064+0000","last_became_peered":"2021-10-08T19:21:23.607064+0000","last_unstale":"2021-10-08T19:27:04.881171+0000","last_undegraded":"2021-10-08T19:27:04.881171+0000","last_fullsized":"2021-10-08T19:27:04.881171+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'1","last_scrub_stamp":"2021-10-08T19:22:55.080028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:55.080028+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040037620000000001,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":116,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.821987+0000","last_change":"2021-10-08T19:23:36.055728+0000","last_active":"2021-10-08T19:27:00.821987+0000","last_peered":"2021-10-08T19:27:00.821987+0000","last_clean":"2021-10-08T19:27:00.821987+0000","last_became_active":"2021-10-08T19:21:27.636429+0000","last_became_peered":"2021-10-08T19:21:27.636429+0000","last_unstale":"2021-10-08T19:27:00.821987+0000","last_undegraded":"2021-10-08T19:27:00.821987+0000","last_fullsized":"2021-10-08T19:27:00.821987+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:36.055616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:36.055616+0000","last_clean_scrub_stamp":"2021-10-08T19:23:36.055616+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0022840669999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":108,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.823234+0000","last_change":"2021-10-08T19:23:10.377105+0000","last_active":"2021-10-08T19:27:00.823234+0000","last_peered":"2021-10-08T19:27:00.823234+0000","last_clean":"2021-10-08T19:27:00.823234+0000","last_became_active":"2021-10-08T19:21:29.646455+0000","last_became_peered":"2021-10-08T19:21:29.646455+0000","last_unstale":"2021-10-08T19:27:00.823234+0000","last_undegraded":"2021-10-08T19:27:00.823234+0000","last_fullsized":"2021-10-08T19:27:00.823234+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:10.377024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:10.377024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0035706969999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"160'10575","reported_seq":10649,"reported_epoch":160,"state":"active+clean","last_fresh":"2021-10-08T19:27:03.580560+0000","last_change":"2021-10-08T19:23:44.811875+0000","last_active":"2021-10-08T19:27:03.580560+0000","last_peered":"2021-10-08T19:27:03.580560+0000","last_clean":"2021-10-08T19:27:03.580560+0000","last_became_active":"2021-10-08T19:23:44.810666+0000","last_became_peered":"2021-10-08T19:23:44.810666+0000","last_unstale":"2021-10-08T19:27:03.580560+0000","last_undegraded":"2021-10-08T19:27:03.580560+0000","last_fullsized":"2021-10-08T19:27:03.580560+0000","mapping_epoch":94,"log_start":"128'4959","ondisk_log_start":"128'4959","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":5616,"ondisk_log_size":5616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":71892992,"num_objects":1097,"num_object_clones":0,"num_object_copies":3291,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1097,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10575,"num_write_kb":373504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":59,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.881353+0000","last_change":"2021-10-08T19:24:25.106422+0000","last_active":"2021-10-08T19:27:04.881353+0000","last_peered":"2021-10-08T19:27:04.881353+0000","last_clean":"2021-10-08T19:27:04.881353+0000","last_became_active":"2021-10-08T19:24:25.105702+0000","last_became_peered":"2021-10-08T19:24:25.105702+0000","last_unstale":"2021-10-08T19:27:04.881353+0000","last_undegraded":"2021-10-08T19:27:04.881353+0000","last_fullsized":"2021-10-08T19:27:04.881353+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:40.563247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.563247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.024890005999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"69'10","reported_seq":170,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.877161+0000","last_change":"2021-10-08T19:24:25.983761+0000","last_active":"2021-10-08T19:27:04.877161+0000","last_peered":"2021-10-08T19:27:04.877161+0000","last_clean":"2021-10-08T19:27:04.877161+0000","last_became_active":"2021-10-08T19:24:25.098048+0000","last_became_peered":"2021-10-08T19:24:25.098048+0000","last_unstale":"2021-10-08T19:27:04.877161+0000","last_undegraded":"2021-10-08T19:27:04.877161+0000","last_fullsized":"2021-10-08T19:27:04.877161+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'10","last_scrub_stamp":"2021-10-08T19:22:35.356292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:35.356292+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040689319999999999,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":120,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.821378+0000","last_change":"2021-10-08T19:24:15.233590+0000","last_active":"2021-10-08T19:27:00.821378+0000","last_peered":"2021-10-08T19:27:00.821378+0000","last_clean":"2021-10-08T19:27:00.821378+0000","last_became_active":"2021-10-08T19:21:23.603207+0000","last_became_peered":"2021-10-08T19:21:23.603207+0000","last_unstale":"2021-10-08T19:27:00.821378+0000","last_undegraded":"2021-10-08T19:27:00.821378+0000","last_fullsized":"2021-10-08T19:27:00.821378+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:15.233394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:15.233394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0046454499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"69'8","reported_seq":192,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:01.796135+0000","last_change":"2021-10-08T19:24:09.793029+0000","last_active":"2021-10-08T19:27:01.796135+0000","last_peered":"2021-10-08T19:27:01.796135+0000","last_clean":"2021-10-08T19:27:01.796135+0000","last_became_active":"2021-10-08T19:21:27.637930+0000","last_became_peered":"2021-10-08T19:21:27.637930+0000","last_unstale":"2021-10-08T19:27:01.796135+0000","last_undegraded":"2021-10-08T19:27:01.796135+0000","last_fullsized":"2021-10-08T19:27:01.796135+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'8","last_scrub_stamp":"2021-10-08T19:24:09.792928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:09.792928+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0052042049999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":115,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.876449+0000","last_change":"2021-10-08T19:24:19.303768+0000","last_active":"2021-10-08T19:27:04.876449+0000","last_peered":"2021-10-08T19:27:04.876449+0000","last_clean":"2021-10-08T19:27:04.876449+0000","last_became_active":"2021-10-08T19:21:29.640249+0000","last_became_peered":"2021-10-08T19:21:29.640249+0000","last_unstale":"2021-10-08T19:27:04.876449+0000","last_undegraded":"2021-10-08T19:27:04.876449+0000","last_fullsized":"2021-10-08T19:27:04.876449+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:19.303695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:24:19.303695+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0069500159999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"160'10290","reported_seq":10364,"reported_epoch":160,"state":"active+clean","last_fresh":"2021-10-08T19:27:03.711988+0000","last_change":"2021-10-08T19:23:44.812210+0000","last_active":"2021-10-08T19:27:03.711988+0000","last_peered":"2021-10-08T19:27:03.711988+0000","last_clean":"2021-10-08T19:27:03.711988+0000","last_became_active":"2021-10-08T19:23:44.810340+0000","last_became_peered":"2021-10-08T19:23:44.810340+0000","last_unstale":"2021-10-08T19:27:03.711988+0000","last_undegraded":"2021-10-08T19:27:03.711988+0000","last_fullsized":"2021-10-08T19:27:03.711988+0000","mapping_epoch":94,"log_start":"133'5401","ondisk_log_start":"133'5401","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":4889,"ondisk_log_size":4889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":72613888,"num_objects":1108,"num_object_clones":0,"num_object_copies":3324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1108,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10290,"num_write_kb":364736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":64,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.828586+0000","last_change":"2021-10-08T19:24:13.518853+0000","last_active":"2021-10-08T19:27:00.828586+0000","last_peered":"2021-10-08T19:27:00.828586+0000","last_clean":"2021-10-08T19:27:00.828586+0000","last_became_active":"2021-10-08T19:24:13.518601+0000","last_became_peered":"2021-10-08T19:24:13.518601+0000","last_unstale":"2021-10-08T19:27:00.828586+0000","last_undegraded":"2021-10-08T19:27:00.828586+0000","last_fullsized":"2021-10-08T19:27:00.828586+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:09.177525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:09.177525+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"69'15","reported_seq":137,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.820300+0000","last_change":"2021-10-08T19:22:56.213566+0000","last_active":"2021-10-08T19:27:00.820300+0000","last_peered":"2021-10-08T19:27:00.820300+0000","last_clean":"2021-10-08T19:27:00.820300+0000","last_became_active":"2021-10-08T19:21:25.617776+0000","last_became_peered":"2021-10-08T19:21:25.617776+0000","last_unstale":"2021-10-08T19:27:00.820300+0000","last_undegraded":"2021-10-08T19:27:00.820300+0000","last_fullsized":"2021-10-08T19:27:00.820300+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'15","last_scrub_stamp":"2021-10-08T19:22:56.213493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:56.213493+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039771219999999996,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":120,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.820791+0000","last_change":"2021-10-08T19:24:07.213134+0000","last_active":"2021-10-08T19:27:00.820791+0000","last_peered":"2021-10-08T19:27:00.820791+0000","last_clean":"2021-10-08T19:27:00.820791+0000","last_became_active":"2021-10-08T19:21:23.603264+0000","last_became_peered":"2021-10-08T19:21:23.603264+0000","last_unstale":"2021-10-08T19:27:00.820791+0000","last_undegraded":"2021-10-08T19:27:00.820791+0000","last_fullsized":"2021-10-08T19:27:00.820791+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:07.213008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:07.213008+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0079250429999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"88'9","reported_seq":192,"reported_epoch":162,"state":"active+clean","last_fresh":"2021-10-08T19:27:05.560965+0000","last_change":"2021-10-08T19:23:00.048324+0000","last_active":"2021-10-08T19:27:05.560965+0000","last_peered":"2021-10-08T19:27:05.560965+0000","last_clean":"2021-10-08T19:27:05.560965+0000","last_became_active":"2021-10-08T19:21:27.636432+0000","last_became_peered":"2021-10-08T19:21:27.636432+0000","last_unstale":"2021-10-08T19:27:05.560965+0000","last_undegraded":"2021-10-08T19:27:05.560965+0000","last_fullsized":"2021-10-08T19:27:05.560965+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'9","last_scrub_stamp":"2021-10-08T19:23:00.048245+0000","last_deep_scrub":"88'9","last_deep_scrub_stamp":"2021-10-08T19:23:00.048245+0000","last_clean_scrub_stamp":"2021-10-08T19:23:00.048245+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0031661179999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":115,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.887480+0000","last_change":"2021-10-08T19:24:11.330063+0000","last_active":"2021-10-08T19:27:04.887480+0000","last_peered":"2021-10-08T19:27:04.887480+0000","last_clean":"2021-10-08T19:27:04.887480+0000","last_became_active":"2021-10-08T19:21:29.639358+0000","last_became_peered":"2021-10-08T19:21:29.639358+0000","last_unstale":"2021-10-08T19:27:04.887480+0000","last_undegraded":"2021-10-08T19:27:04.887480+0000","last_fullsized":"2021-10-08T19:27:04.887480+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:11.329954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:24:11.329954+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.01088446,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"160'10218","reported_seq":13943,"reported_epoch":160,"state":"active+recovering+remapped","last_fresh":"2021-10-08T19:27:03.578050+0000","last_change":"2021-10-08T19:24:26.855973+0000","last_active":"2021-10-08T19:27:03.578050+0000","last_peered":"2021-10-08T19:27:03.578050+0000","last_clean":"2021-10-08T19:24:24.005251+0000","last_became_active":"2021-10-08T19:24:26.848578+0000","last_became_peered":"2021-10-08T19:24:26.848578+0000","last_unstale":"2021-10-08T19:27:03.578050+0000","last_undegraded":"2021-10-08T19:27:03.578050+0000","last_fullsized":"2021-10-08T19:27:03.578050+0000","mapping_epoch":113,"log_start":"127'4600","ondisk_log_start":"127'4600","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":5618,"ondisk_log_size":5618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":72089600,"num_objects":1100,"num_object_clones":0,"num_object_copies":3300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":1223,"num_objects_unfound":0,"num_objects_dirty":1100,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10218,"num_write_kb":362176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1823,"num_bytes_recovered":93978624,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[2,3,7],"avail_no_missing":["2","3","7"],"object_location_counts":[{"shards":"2,3,7","objects":-123}],"blocked_by":[],"up_primary":6,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"70'5","reported_seq":63,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.828075+0000","last_change":"2021-10-08T19:24:13.513690+0000","last_active":"2021-10-08T19:27:00.828075+0000","last_peered":"2021-10-08T19:27:00.828075+0000","last_clean":"2021-10-08T19:27:00.828075+0000","last_became_active":"2021-10-08T19:24:13.513289+0000","last_became_peered":"2021-10-08T19:24:13.513289+0000","last_unstale":"2021-10-08T19:27:00.828075+0000","last_undegraded":"2021-10-08T19:27:00.828075+0000","last_fullsized":"2021-10-08T19:27:00.828075+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:22:48.239721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:48.239721+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001618092,"stat_sum":{"num_bytes":97,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":31,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"69'11","reported_seq":174,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.876142+0000","last_change":"2021-10-08T19:24:25.123530+0000","last_active":"2021-10-08T19:27:04.876142+0000","last_peered":"2021-10-08T19:27:04.876142+0000","last_clean":"2021-10-08T19:27:04.876142+0000","last_became_active":"2021-10-08T19:24:25.097983+0000","last_became_peered":"2021-10-08T19:24:25.097983+0000","last_unstale":"2021-10-08T19:27:04.876142+0000","last_undegraded":"2021-10-08T19:27:04.876142+0000","last_fullsized":"2021-10-08T19:27:04.876142+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'11","last_scrub_stamp":"2021-10-08T19:23:01.988336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:01.988336+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0026768489999999998,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":122,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.882014+0000","last_change":"2021-10-08T19:24:14.537933+0000","last_active":"2021-10-08T19:27:04.882014+0000","last_peered":"2021-10-08T19:27:04.882014+0000","last_clean":"2021-10-08T19:27:04.882014+0000","last_became_active":"2021-10-08T19:21:23.606597+0000","last_became_peered":"2021-10-08T19:21:23.606597+0000","last_unstale":"2021-10-08T19:27:04.882014+0000","last_undegraded":"2021-10-08T19:27:04.882014+0000","last_fullsized":"2021-10-08T19:27:04.882014+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:14.537859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:14.537859+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.00235264,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":129,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.887693+0000","last_change":"2021-10-08T19:24:25.105582+0000","last_active":"2021-10-08T19:27:04.887693+0000","last_peered":"2021-10-08T19:27:04.887693+0000","last_clean":"2021-10-08T19:27:04.887693+0000","last_became_active":"2021-10-08T19:24:25.105244+0000","last_became_peered":"2021-10-08T19:24:25.105244+0000","last_unstale":"2021-10-08T19:27:04.887693+0000","last_undegraded":"2021-10-08T19:27:04.887693+0000","last_fullsized":"2021-10-08T19:27:04.887693+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:17.689312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:17.689312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0033939769999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":125,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.839222+0000","last_change":"2021-10-08T19:24:25.096748+0000","last_active":"2021-10-08T19:27:00.839222+0000","last_peered":"2021-10-08T19:27:00.839222+0000","last_clean":"2021-10-08T19:27:00.839222+0000","last_became_active":"2021-10-08T19:24:25.096415+0000","last_became_peered":"2021-10-08T19:24:25.096415+0000","last_unstale":"2021-10-08T19:27:00.839222+0000","last_undegraded":"2021-10-08T19:27:00.839222+0000","last_fullsized":"2021-10-08T19:27:00.839222+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:17.422176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:17.422176+0000","last_clean_scrub_stamp":"2021-10-08T19:23:17.422176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0036221249999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"160'10430","reported_seq":14164,"reported_epoch":160,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2021-10-08T19:27:03.643930+0000","last_change":"2021-10-08T19:25:42.089847+0000","last_active":"2021-10-08T19:27:03.643930+0000","last_peered":"2021-10-08T19:27:03.643930+0000","last_clean":"2021-10-08T19:24:24.154821+0000","last_became_active":"2021-10-08T19:24:26.860648+0000","last_became_peered":"2021-10-08T19:24:26.860648+0000","last_unstale":"2021-10-08T19:27:03.643930+0000","last_undegraded":"2021-10-08T19:25:42.036806+0000","last_fullsized":"2021-10-08T19:24:26.085882+0000","mapping_epoch":113,"log_start":"136'6023","ondisk_log_start":"136'6023","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":4407,"ondisk_log_size":4407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":71893016,"num_objects":1098,"num_object_clones":0,"num_object_copies":3294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1248,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1098,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10430,"num_write_kb":368833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1826,"num_bytes_recovered":94044160,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0],"acting":[1,0],"avail_no_missing":["1","0","3"],"object_location_counts":[{"shards":"0,1","objects":-150}],"blocked_by":[],"up_primary":6,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":66,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.875705+0000","last_change":"2021-10-08T19:24:13.506996+0000","last_active":"2021-10-08T19:27:04.875705+0000","last_peered":"2021-10-08T19:27:04.875705+0000","last_clean":"2021-10-08T19:27:04.875705+0000","last_became_active":"2021-10-08T19:24:13.506602+0000","last_became_peered":"2021-10-08T19:24:13.506602+0000","last_unstale":"2021-10-08T19:27:04.875705+0000","last_undegraded":"2021-10-08T19:27:04.875705+0000","last_fullsized":"2021-10-08T19:27:04.875705+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:09.177525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:09.177525+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"91'9","reported_seq":186,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:01.790309+0000","last_change":"2021-10-08T19:23:32.329551+0000","last_active":"2021-10-08T19:27:01.790309+0000","last_peered":"2021-10-08T19:27:01.790309+0000","last_clean":"2021-10-08T19:27:01.790309+0000","last_became_active":"2021-10-08T19:21:27.640694+0000","last_became_peered":"2021-10-08T19:21:27.640694+0000","last_unstale":"2021-10-08T19:27:01.790309+0000","last_undegraded":"2021-10-08T19:27:01.790309+0000","last_fullsized":"2021-10-08T19:27:01.790309+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'9","last_scrub_stamp":"2021-10-08T19:23:32.329475+0000","last_deep_scrub":"91'9","last_deep_scrub_stamp":"2021-10-08T19:23:32.329475+0000","last_clean_scrub_stamp":"2021-10-08T19:23:32.329475+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0045727859999999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"69'14","reported_seq":190,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.875927+0000","last_change":"2021-10-08T19:24:26.225004+0000","last_active":"2021-10-08T19:27:04.875927+0000","last_peered":"2021-10-08T19:27:04.875927+0000","last_clean":"2021-10-08T19:27:04.875927+0000","last_became_active":"2021-10-08T19:24:25.098743+0000","last_became_peered":"2021-10-08T19:24:25.098743+0000","last_unstale":"2021-10-08T19:27:04.875927+0000","last_undegraded":"2021-10-08T19:27:04.875927+0000","last_fullsized":"2021-10-08T19:27:04.875927+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'14","last_scrub_stamp":"2021-10-08T19:24:10.235796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:24:10.235796+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0042036319999999997,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":59,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.882390+0000","last_change":"2021-10-08T19:24:25.094838+0000","last_active":"2021-10-08T19:27:04.882390+0000","last_peered":"2021-10-08T19:27:04.882390+0000","last_clean":"2021-10-08T19:27:04.882390+0000","last_became_active":"2021-10-08T19:24:25.094364+0000","last_became_peered":"2021-10-08T19:24:25.094364+0000","last_unstale":"2021-10-08T19:27:04.882390+0000","last_undegraded":"2021-10-08T19:27:04.882390+0000","last_fullsized":"2021-10-08T19:27:04.882390+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:23.529696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:23.529696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":130,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.881479+0000","last_change":"2021-10-08T19:24:25.095155+0000","last_active":"2021-10-08T19:27:04.881479+0000","last_peered":"2021-10-08T19:27:04.881479+0000","last_clean":"2021-10-08T19:27:04.881479+0000","last_became_active":"2021-10-08T19:24:25.094848+0000","last_became_peered":"2021-10-08T19:24:25.094848+0000","last_unstale":"2021-10-08T19:27:04.881479+0000","last_undegraded":"2021-10-08T19:27:04.881479+0000","last_fullsized":"2021-10-08T19:27:04.881479+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:05.263508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:05.263508+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034369000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"160'10416","reported_seq":10487,"reported_epoch":160,"state":"active+clean","last_fresh":"2021-10-08T19:27:03.615251+0000","last_change":"2021-10-08T19:23:44.807321+0000","last_active":"2021-10-08T19:27:03.615251+0000","last_peered":"2021-10-08T19:27:03.615251+0000","last_clean":"2021-10-08T19:27:03.615251+0000","last_became_active":"2021-10-08T19:23:44.807072+0000","last_became_peered":"2021-10-08T19:23:44.807072+0000","last_unstale":"2021-10-08T19:27:03.615251+0000","last_undegraded":"2021-10-08T19:27:03.615251+0000","last_fullsized":"2021-10-08T19:27:03.615251+0000","mapping_epoch":94,"log_start":"137'6180","ondisk_log_start":"137'6180","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":4236,"ondisk_log_size":4236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":74973184,"num_objects":1144,"num_object_clones":0,"num_object_copies":3432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1144,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10416,"num_write_kb":369920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":71,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.815482+0000","last_change":"2021-10-08T19:25:14.582925+0000","last_active":"2021-10-08T19:27:00.815482+0000","last_peered":"2021-10-08T19:27:00.815482+0000","last_clean":"2021-10-08T19:27:00.815482+0000","last_became_active":"2021-10-08T19:25:14.582587+0000","last_became_peered":"2021-10-08T19:25:14.582587+0000","last_unstale":"2021-10-08T19:27:00.815482+0000","last_undegraded":"2021-10-08T19:27:00.815482+0000","last_fullsized":"2021-10-08T19:27:00.815482+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:40.563247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.563247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.024890005999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":117,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.876207+0000","last_change":"2021-10-08T19:24:15.302574+0000","last_active":"2021-10-08T19:27:04.876207+0000","last_peered":"2021-10-08T19:27:04.876207+0000","last_clean":"2021-10-08T19:27:04.876207+0000","last_became_active":"2021-10-08T19:21:27.637547+0000","last_became_peered":"2021-10-08T19:21:27.637547+0000","last_unstale":"2021-10-08T19:27:04.876207+0000","last_undegraded":"2021-10-08T19:27:04.876207+0000","last_fullsized":"2021-10-08T19:27:04.876207+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:15.302475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:15.302475+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0050588849999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"69'18","reported_seq":143,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.827903+0000","last_change":"2021-10-08T19:23:20.405609+0000","last_active":"2021-10-08T19:27:00.827903+0000","last_peered":"2021-10-08T19:27:00.827903+0000","last_clean":"2021-10-08T19:27:00.827903+0000","last_became_active":"2021-10-08T19:21:25.742909+0000","last_became_peered":"2021-10-08T19:21:25.742909+0000","last_unstale":"2021-10-08T19:27:00.827903+0000","last_undegraded":"2021-10-08T19:27:00.827903+0000","last_fullsized":"2021-10-08T19:27:00.827903+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'18","last_scrub_stamp":"2021-10-08T19:23:20.405525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:20.405525+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039753820000000004,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":132,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.819939+0000","last_change":"2021-10-08T19:24:25.099209+0000","last_active":"2021-10-08T19:27:00.819939+0000","last_peered":"2021-10-08T19:27:00.819939+0000","last_clean":"2021-10-08T19:27:00.819939+0000","last_became_active":"2021-10-08T19:24:25.098790+0000","last_became_peered":"2021-10-08T19:24:25.098790+0000","last_unstale":"2021-10-08T19:27:00.819939+0000","last_undegraded":"2021-10-08T19:27:00.819939+0000","last_fullsized":"2021-10-08T19:27:00.819939+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:41.186945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:41.186945+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0037557269999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":109,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.876275+0000","last_change":"2021-10-08T19:22:40.264230+0000","last_active":"2021-10-08T19:27:04.876275+0000","last_peered":"2021-10-08T19:27:04.876275+0000","last_clean":"2021-10-08T19:27:04.876275+0000","last_became_active":"2021-10-08T19:21:29.646491+0000","last_became_peered":"2021-10-08T19:21:29.646491+0000","last_unstale":"2021-10-08T19:27:04.876275+0000","last_undegraded":"2021-10-08T19:27:04.876275+0000","last_fullsized":"2021-10-08T19:27:04.876275+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:40.264110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.264110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003475845,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"160'10485","reported_seq":10558,"reported_epoch":160,"state":"active+clean","last_fresh":"2021-10-08T19:27:03.569554+0000","last_change":"2021-10-08T19:23:44.799701+0000","last_active":"2021-10-08T19:27:03.569554+0000","last_peered":"2021-10-08T19:27:03.569554+0000","last_clean":"2021-10-08T19:27:03.569554+0000","last_became_active":"2021-10-08T19:23:44.799526+0000","last_became_peered":"2021-10-08T19:23:44.799526+0000","last_unstale":"2021-10-08T19:27:03.569554+0000","last_undegraded":"2021-10-08T19:27:03.569554+0000","last_fullsized":"2021-10-08T19:27:03.569554+0000","mapping_epoch":94,"log_start":"137'6212","ondisk_log_start":"137'6212","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":4273,"ondisk_log_size":4273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":75956224,"num_objects":1159,"num_object_clones":0,"num_object_copies":3477,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1159,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10485,"num_write_kb":372608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4],"acting":[3,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":73,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.834854+0000","last_change":"2021-10-08T19:25:14.588222+0000","last_active":"2021-10-08T19:27:00.834854+0000","last_peered":"2021-10-08T19:27:00.834854+0000","last_clean":"2021-10-08T19:27:00.834854+0000","last_became_active":"2021-10-08T19:25:14.587901+0000","last_became_peered":"2021-10-08T19:25:14.587901+0000","last_unstale":"2021-10-08T19:27:00.834854+0000","last_undegraded":"2021-10-08T19:27:00.834854+0000","last_fullsized":"2021-10-08T19:27:00.834854+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:09.177525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:09.177525+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":59,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.881194+0000","last_change":"2021-10-08T19:24:25.095749+0000","last_active":"2021-10-08T19:27:04.881194+0000","last_peered":"2021-10-08T19:27:04.881194+0000","last_clean":"2021-10-08T19:27:04.881194+0000","last_became_active":"2021-10-08T19:24:25.095389+0000","last_became_peered":"2021-10-08T19:24:25.095389+0000","last_unstale":"2021-10-08T19:27:04.881194+0000","last_undegraded":"2021-10-08T19:27:04.881194+0000","last_fullsized":"2021-10-08T19:27:04.881194+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:42.399412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:42.399412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"69'19","reported_seq":154,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.808969+0000","last_change":"2021-10-08T19:24:08.149331+0000","last_active":"2021-10-08T19:27:00.808969+0000","last_peered":"2021-10-08T19:27:00.808969+0000","last_clean":"2021-10-08T19:27:00.808969+0000","last_became_active":"2021-10-08T19:21:25.741812+0000","last_became_peered":"2021-10-08T19:21:25.741812+0000","last_unstale":"2021-10-08T19:27:00.808969+0000","last_undegraded":"2021-10-08T19:27:00.808969+0000","last_fullsized":"2021-10-08T19:27:00.808969+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'19","last_scrub_stamp":"2021-10-08T19:24:08.149225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:24:08.149225+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0082661220000000007,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"61'1","reported_seq":129,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.882912+0000","last_change":"2021-10-08T19:24:17.582143+0000","last_active":"2021-10-08T19:27:04.882912+0000","last_peered":"2021-10-08T19:27:04.882912+0000","last_clean":"2021-10-08T19:27:04.882912+0000","last_became_active":"2021-10-08T19:21:23.604258+0000","last_became_peered":"2021-10-08T19:21:23.604258+0000","last_unstale":"2021-10-08T19:27:04.882912+0000","last_undegraded":"2021-10-08T19:27:04.882912+0000","last_fullsized":"2021-10-08T19:27:04.882912+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'1","last_scrub_stamp":"2021-10-08T19:24:17.582063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:17.582063+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0043026640000000003,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":126,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.820929+0000","last_change":"2021-10-08T19:24:25.094704+0000","last_active":"2021-10-08T19:27:00.820929+0000","last_peered":"2021-10-08T19:27:00.820929+0000","last_clean":"2021-10-08T19:27:00.820929+0000","last_became_active":"2021-10-08T19:24:25.092510+0000","last_became_peered":"2021-10-08T19:24:25.092510+0000","last_unstale":"2021-10-08T19:27:00.820929+0000","last_undegraded":"2021-10-08T19:27:00.820929+0000","last_fullsized":"2021-10-08T19:27:00.820929+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:06.155068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:06.155068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001436805,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"162'10397","reported_seq":10471,"reported_epoch":162,"state":"active+clean","last_fresh":"2021-10-08T19:27:08.449806+0000","last_change":"2021-10-08T19:23:44.808792+0000","last_active":"2021-10-08T19:27:08.449806+0000","last_peered":"2021-10-08T19:27:08.449806+0000","last_clean":"2021-10-08T19:27:08.449806+0000","last_became_active":"2021-10-08T19:23:44.808533+0000","last_became_peered":"2021-10-08T19:23:44.808533+0000","last_unstale":"2021-10-08T19:27:08.449806+0000","last_undegraded":"2021-10-08T19:27:08.449806+0000","last_fullsized":"2021-10-08T19:27:08.449806+0000","mapping_epoch":94,"log_start":"131'5232","ondisk_log_start":"131'5232","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":5165,"ondisk_log_size":5165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":57737216,"num_objects":881,"num_object_clones":0,"num_object_copies":2643,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":881,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10397,"num_write_kb":360896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.4","version":"70'5","reported_seq":308,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.821659+0000","last_change":"2021-10-08T19:25:14.596508+0000","last_active":"2021-10-08T19:27:00.821659+0000","last_peered":"2021-10-08T19:27:00.821659+0000","last_clean":"2021-10-08T19:27:00.821659+0000","last_became_active":"2021-10-08T19:25:14.596177+0000","last_became_peered":"2021-10-08T19:25:14.596177+0000","last_unstale":"2021-10-08T19:27:00.821659+0000","last_undegraded":"2021-10-08T19:27:00.821659+0000","last_fullsized":"2021-10-08T19:27:00.821659+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:22:48.239721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:48.239721+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001618092,"stat_sum":{"num_bytes":49,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":19,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":49,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":117,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.887933+0000","last_change":"2021-10-08T19:23:41.487724+0000","last_active":"2021-10-08T19:27:04.887933+0000","last_peered":"2021-10-08T19:27:04.887933+0000","last_clean":"2021-10-08T19:27:04.887933+0000","last_became_active":"2021-10-08T19:21:27.635800+0000","last_became_peered":"2021-10-08T19:21:27.635800+0000","last_unstale":"2021-10-08T19:27:04.887933+0000","last_undegraded":"2021-10-08T19:27:04.887933+0000","last_fullsized":"2021-10-08T19:27:04.887933+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:41.487627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:41.487627+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003650445,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"69'12","reported_seq":130,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.815600+0000","last_change":"2021-10-08T19:22:55.639993+0000","last_active":"2021-10-08T19:27:00.815600+0000","last_peered":"2021-10-08T19:27:00.815600+0000","last_clean":"2021-10-08T19:27:00.815600+0000","last_became_active":"2021-10-08T19:21:25.610233+0000","last_became_peered":"2021-10-08T19:21:25.610233+0000","last_unstale":"2021-10-08T19:27:00.815600+0000","last_undegraded":"2021-10-08T19:27:00.815600+0000","last_fullsized":"2021-10-08T19:27:00.815600+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'12","last_scrub_stamp":"2021-10-08T19:22:55.639881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:55.639881+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0032422169999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":81,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.825004+0000","last_change":"2021-10-08T19:24:04.888931+0000","last_active":"2021-10-08T19:27:00.825004+0000","last_peered":"2021-10-08T19:27:00.825004+0000","last_clean":"2021-10-08T19:27:00.825004+0000","last_became_active":"2021-10-08T19:23:44.813130+0000","last_became_peered":"2021-10-08T19:23:44.813130+0000","last_unstale":"2021-10-08T19:27:00.825004+0000","last_undegraded":"2021-10-08T19:27:00.825004+0000","last_fullsized":"2021-10-08T19:27:00.825004+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:04.888825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:32.922694+0000","last_clean_scrub_stamp":"2021-10-08T19:24:04.888825+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0052928530000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":138,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.809246+0000","last_change":"2021-10-08T19:25:14.571042+0000","last_active":"2021-10-08T19:27:00.809246+0000","last_peered":"2021-10-08T19:27:00.809246+0000","last_clean":"2021-10-08T19:27:00.809246+0000","last_became_active":"2021-10-08T19:25:14.570716+0000","last_became_peered":"2021-10-08T19:25:14.570716+0000","last_unstale":"2021-10-08T19:27:00.809246+0000","last_undegraded":"2021-10-08T19:27:00.809246+0000","last_fullsized":"2021-10-08T19:27:00.809246+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:09.177525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:09.177525+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0090469920000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":108,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.822061+0000","last_change":"2021-10-08T19:22:55.234981+0000","last_active":"2021-10-08T19:27:00.822061+0000","last_peered":"2021-10-08T19:27:00.822061+0000","last_clean":"2021-10-08T19:27:00.822061+0000","last_became_active":"2021-10-08T19:21:29.648784+0000","last_became_peered":"2021-10-08T19:21:29.648784+0000","last_unstale":"2021-10-08T19:27:00.822061+0000","last_undegraded":"2021-10-08T19:27:00.822061+0000","last_fullsized":"2021-10-08T19:27:00.822061+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:55.234909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:55.234909+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0014461070000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"162'10760","reported_seq":10836,"reported_epoch":162,"state":"active+clean","last_fresh":"2021-10-08T19:27:08.451475+0000","last_change":"2021-10-08T19:23:44.811375+0000","last_active":"2021-10-08T19:27:08.451475+0000","last_peered":"2021-10-08T19:27:08.451475+0000","last_clean":"2021-10-08T19:27:08.451475+0000","last_became_active":"2021-10-08T19:23:44.811097+0000","last_became_peered":"2021-10-08T19:23:44.811097+0000","last_unstale":"2021-10-08T19:27:08.451475+0000","last_undegraded":"2021-10-08T19:27:08.451475+0000","last_fullsized":"2021-10-08T19:27:08.451475+0000","mapping_epoch":94,"log_start":"140'6508","ondisk_log_start":"140'6508","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":4252,"ondisk_log_size":4252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":59244544,"num_objects":904,"num_object_clones":0,"num_object_copies":2712,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":904,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10760,"num_write_kb":373248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,0],"acting":[7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":112,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.884994+0000","last_change":"2021-10-08T19:23:02.267580+0000","last_active":"2021-10-08T19:27:04.884994+0000","last_peered":"2021-10-08T19:27:04.884994+0000","last_clean":"2021-10-08T19:27:04.884994+0000","last_became_active":"2021-10-08T19:21:27.636086+0000","last_became_peered":"2021-10-08T19:21:27.636086+0000","last_unstale":"2021-10-08T19:27:04.884994+0000","last_undegraded":"2021-10-08T19:27:04.884994+0000","last_fullsized":"2021-10-08T19:27:04.884994+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:02.267508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:02.267508+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034499700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"69'14","reported_seq":75,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.881151+0000","last_change":"2021-10-08T19:24:25.119727+0000","last_active":"2021-10-08T19:27:04.881151+0000","last_peered":"2021-10-08T19:27:04.881151+0000","last_clean":"2021-10-08T19:27:04.881151+0000","last_became_active":"2021-10-08T19:24:25.100384+0000","last_became_peered":"2021-10-08T19:24:25.100384+0000","last_unstale":"2021-10-08T19:27:04.881151+0000","last_undegraded":"2021-10-08T19:27:04.881151+0000","last_fullsized":"2021-10-08T19:27:04.881151+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'14","last_scrub_stamp":"2021-10-08T19:22:54.379349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:54.379349+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":24,"num_read_kb":14,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"90'130","reported_seq":419,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.881933+0000","last_change":"2021-10-08T19:24:28.151931+0000","last_active":"2021-10-08T19:27:04.881933+0000","last_peered":"2021-10-08T19:27:04.881933+0000","last_clean":"2021-10-08T19:27:04.881933+0000","last_became_active":"2021-10-08T19:24:28.151587+0000","last_became_peered":"2021-10-08T19:24:28.151587+0000","last_unstale":"2021-10-08T19:27:04.881933+0000","last_undegraded":"2021-10-08T19:27:04.881933+0000","last_fullsized":"2021-10-08T19:27:04.881933+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.284249+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0045617870000000003,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":115,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.887526+0000","last_change":"2021-10-08T19:23:22.620672+0000","last_active":"2021-10-08T19:27:04.887526+0000","last_peered":"2021-10-08T19:27:04.887526+0000","last_clean":"2021-10-08T19:27:04.887526+0000","last_became_active":"2021-10-08T19:21:23.599143+0000","last_became_peered":"2021-10-08T19:21:23.599143+0000","last_unstale":"2021-10-08T19:27:04.887526+0000","last_undegraded":"2021-10-08T19:27:04.887526+0000","last_fullsized":"2021-10-08T19:27:04.887526+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:22.620600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:22.620600+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003478133,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":149,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.828731+0000","last_change":"2021-10-08T19:25:14.565749+0000","last_active":"2021-10-08T19:27:00.828731+0000","last_peered":"2021-10-08T19:27:00.828731+0000","last_clean":"2021-10-08T19:27:00.828731+0000","last_became_active":"2021-10-08T19:25:14.565479+0000","last_became_peered":"2021-10-08T19:25:14.565479+0000","last_unstale":"2021-10-08T19:27:00.828731+0000","last_undegraded":"2021-10-08T19:27:00.828731+0000","last_fullsized":"2021-10-08T19:27:00.828731+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:40.563247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.563247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.024890005999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":109,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.888022+0000","last_change":"2021-10-08T19:23:14.763360+0000","last_active":"2021-10-08T19:27:04.888022+0000","last_peered":"2021-10-08T19:27:04.888022+0000","last_clean":"2021-10-08T19:27:04.888022+0000","last_became_active":"2021-10-08T19:21:29.646242+0000","last_became_peered":"2021-10-08T19:21:29.646242+0000","last_unstale":"2021-10-08T19:27:04.888022+0000","last_undegraded":"2021-10-08T19:27:04.888022+0000","last_fullsized":"2021-10-08T19:27:04.888022+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:14.763280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:14.763280+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034824790000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"160'10254","reported_seq":10328,"reported_epoch":160,"state":"active+clean","last_fresh":"2021-10-08T19:27:03.610225+0000","last_change":"2021-10-08T19:23:44.811881+0000","last_active":"2021-10-08T19:27:03.610225+0000","last_peered":"2021-10-08T19:27:03.610225+0000","last_clean":"2021-10-08T19:27:03.610225+0000","last_became_active":"2021-10-08T19:23:44.810317+0000","last_became_peered":"2021-10-08T19:23:44.810317+0000","last_unstale":"2021-10-08T19:27:03.610225+0000","last_undegraded":"2021-10-08T19:27:03.610225+0000","last_fullsized":"2021-10-08T19:27:03.610225+0000","mapping_epoch":94,"log_start":"133'5412","ondisk_log_start":"133'5412","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":4842,"ondisk_log_size":4842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":76152832,"num_objects":1162,"num_object_clones":0,"num_object_copies":3486,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1162,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10254,"num_write_kb":365312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":110,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.823715+0000","last_change":"2021-10-08T19:23:06.487842+0000","last_active":"2021-10-08T19:27:00.823715+0000","last_peered":"2021-10-08T19:27:00.823715+0000","last_clean":"2021-10-08T19:27:00.823715+0000","last_became_active":"2021-10-08T19:21:27.637875+0000","last_became_peered":"2021-10-08T19:21:27.637875+0000","last_unstale":"2021-10-08T19:27:00.823715+0000","last_undegraded":"2021-10-08T19:27:00.823715+0000","last_fullsized":"2021-10-08T19:27:00.823715+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:06.487723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:06.487723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034218619999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"69'13","reported_seq":145,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.820420+0000","last_change":"2021-10-08T19:24:08.192556+0000","last_active":"2021-10-08T19:27:00.820420+0000","last_peered":"2021-10-08T19:27:00.820420+0000","last_clean":"2021-10-08T19:27:00.820420+0000","last_became_active":"2021-10-08T19:21:25.608584+0000","last_became_peered":"2021-10-08T19:21:25.608584+0000","last_unstale":"2021-10-08T19:27:00.820420+0000","last_undegraded":"2021-10-08T19:27:00.820420+0000","last_fullsized":"2021-10-08T19:27:00.820420+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'13","last_scrub_stamp":"2021-10-08T19:24:08.192428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:24:08.192428+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.015716936000000001,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":120,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.823032+0000","last_change":"2021-10-08T19:24:21.997890+0000","last_active":"2021-10-08T19:27:00.823032+0000","last_peered":"2021-10-08T19:27:00.823032+0000","last_clean":"2021-10-08T19:27:00.823032+0000","last_became_active":"2021-10-08T19:21:23.602967+0000","last_became_peered":"2021-10-08T19:21:23.602967+0000","last_unstale":"2021-10-08T19:27:00.823032+0000","last_undegraded":"2021-10-08T19:27:00.823032+0000","last_fullsized":"2021-10-08T19:27:00.823032+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:21.997791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:21.997791+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0069284359999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"70'5","reported_seq":318,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.819423+0000","last_change":"2021-10-08T19:25:14.573914+0000","last_active":"2021-10-08T19:27:00.819423+0000","last_peered":"2021-10-08T19:27:00.819423+0000","last_clean":"2021-10-08T19:27:00.819423+0000","last_became_active":"2021-10-08T19:25:14.573525+0000","last_became_peered":"2021-10-08T19:25:14.573525+0000","last_unstale":"2021-10-08T19:27:00.819423+0000","last_undegraded":"2021-10-08T19:27:00.819423+0000","last_fullsized":"2021-10-08T19:27:00.819423+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:22:48.239721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:48.239721+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001618092,"stat_sum":{"num_bytes":48,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":48,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":128,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.882833+0000","last_change":"2021-10-08T19:24:25.096670+0000","last_active":"2021-10-08T19:27:04.882833+0000","last_peered":"2021-10-08T19:27:04.882833+0000","last_clean":"2021-10-08T19:27:04.882833+0000","last_became_active":"2021-10-08T19:24:25.095748+0000","last_became_peered":"2021-10-08T19:24:25.095748+0000","last_unstale":"2021-10-08T19:27:04.882833+0000","last_undegraded":"2021-10-08T19:27:04.882833+0000","last_fullsized":"2021-10-08T19:27:04.882833+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:01.215579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:01.215579+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001463748,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"160'10309","reported_seq":10381,"reported_epoch":160,"state":"active+clean","last_fresh":"2021-10-08T19:27:03.748860+0000","last_change":"2021-10-08T19:23:44.815167+0000","last_active":"2021-10-08T19:27:03.748860+0000","last_peered":"2021-10-08T19:27:03.748860+0000","last_clean":"2021-10-08T19:27:03.748860+0000","last_became_active":"2021-10-08T19:23:44.814856+0000","last_became_peered":"2021-10-08T19:23:44.814856+0000","last_unstale":"2021-10-08T19:27:03.748860+0000","last_undegraded":"2021-10-08T19:27:03.748860+0000","last_fullsized":"2021-10-08T19:27:03.748860+0000","mapping_epoch":94,"log_start":"133'5416","ondisk_log_start":"133'5416","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":4893,"ondisk_log_size":4893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":72155136,"num_objects":1101,"num_object_clones":0,"num_object_copies":3303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1101,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10309,"num_write_kb":365120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":110,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.819481+0000","last_change":"2021-10-08T19:23:03.639015+0000","last_active":"2021-10-08T19:27:00.819481+0000","last_peered":"2021-10-08T19:27:00.819481+0000","last_clean":"2021-10-08T19:27:00.819481+0000","last_became_active":"2021-10-08T19:21:27.636192+0000","last_became_peered":"2021-10-08T19:21:27.636192+0000","last_unstale":"2021-10-08T19:27:00.819481+0000","last_undegraded":"2021-10-08T19:27:00.819481+0000","last_fullsized":"2021-10-08T19:27:00.819481+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:03.638920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:03.638920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0016933230000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"69'28","reported_seq":234,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:01.785864+0000","last_change":"2021-10-08T19:24:18.179832+0000","last_active":"2021-10-08T19:27:01.785864+0000","last_peered":"2021-10-08T19:27:01.785864+0000","last_clean":"2021-10-08T19:27:01.785864+0000","last_became_active":"2021-10-08T19:21:25.613663+0000","last_became_peered":"2021-10-08T19:21:25.613663+0000","last_unstale":"2021-10-08T19:27:01.785864+0000","last_undegraded":"2021-10-08T19:27:01.785864+0000","last_fullsized":"2021-10-08T19:27:01.785864+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'28","last_scrub_stamp":"2021-10-08T19:24:18.179708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:24:18.179708+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0076258280000000003,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":133,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.888090+0000","last_change":"2021-10-08T19:24:25.089874+0000","last_active":"2021-10-08T19:27:04.888090+0000","last_peered":"2021-10-08T19:27:04.888090+0000","last_clean":"2021-10-08T19:27:04.888090+0000","last_became_active":"2021-10-08T19:24:25.089422+0000","last_became_peered":"2021-10-08T19:24:25.089422+0000","last_unstale":"2021-10-08T19:27:04.888090+0000","last_undegraded":"2021-10-08T19:27:04.888090+0000","last_fullsized":"2021-10-08T19:27:04.888090+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:01.746914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:01.746914+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001402506,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":107,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.831577+0000","last_change":"2021-10-08T19:23:25.378511+0000","last_active":"2021-10-08T19:27:00.831577+0000","last_peered":"2021-10-08T19:27:00.831577+0000","last_clean":"2021-10-08T19:27:00.831577+0000","last_became_active":"2021-10-08T19:21:29.647403+0000","last_became_peered":"2021-10-08T19:21:29.647403+0000","last_unstale":"2021-10-08T19:27:00.831577+0000","last_undegraded":"2021-10-08T19:27:00.831577+0000","last_fullsized":"2021-10-08T19:27:00.831577+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:25.378429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:25.378429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0050198400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"160'10217","reported_seq":10296,"reported_epoch":160,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-10-08T19:27:03.723886+0000","last_change":"2021-10-08T19:24:26.876521+0000","last_active":"2021-10-08T19:27:03.723886+0000","last_peered":"2021-10-08T19:27:03.723886+0000","last_clean":"2021-10-08T19:24:23.994230+0000","last_became_active":"2021-10-08T19:24:26.869772+0000","last_became_peered":"2021-10-08T19:24:26.869772+0000","last_unstale":"2021-10-08T19:27:03.723886+0000","last_undegraded":"2021-10-08T19:24:26.123494+0000","last_fullsized":"2021-10-08T19:24:26.101870+0000","mapping_epoch":113,"log_start":"133'5345","ondisk_log_start":"133'5345","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":4872,"ondisk_log_size":4872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":73334784,"num_objects":1119,"num_object_clones":0,"num_object_copies":3357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3052,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1119,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10217,"num_write_kb":362752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[0,3],"avail_no_missing":["0","1","3"],"object_location_counts":[{"shards":"0,3","objects":-1933}],"blocked_by":[],"up_primary":6,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":84,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.878440+0000","last_change":"2021-10-08T19:25:14.550996+0000","last_active":"2021-10-08T19:27:04.878440+0000","last_peered":"2021-10-08T19:27:04.878440+0000","last_clean":"2021-10-08T19:27:04.878440+0000","last_became_active":"2021-10-08T19:25:14.550690+0000","last_became_peered":"2021-10-08T19:25:14.550690+0000","last_unstale":"2021-10-08T19:27:04.878440+0000","last_undegraded":"2021-10-08T19:27:04.878440+0000","last_fullsized":"2021-10-08T19:27:04.878440+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:09.177525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:09.177525+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3","version":"114'10","reported_seq":219,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:01.791701+0000","last_change":"2021-10-08T19:24:25.551891+0000","last_active":"2021-10-08T19:27:01.791701+0000","last_peered":"2021-10-08T19:27:01.791701+0000","last_clean":"2021-10-08T19:27:01.791701+0000","last_became_active":"2021-10-08T19:24:25.106695+0000","last_became_peered":"2021-10-08T19:24:25.106695+0000","last_unstale":"2021-10-08T19:27:01.791701+0000","last_undegraded":"2021-10-08T19:27:01.791701+0000","last_fullsized":"2021-10-08T19:27:01.791701+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'9","last_scrub_stamp":"2021-10-08T19:24:04.193898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:04.193898+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0022019909999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"69'10","reported_seq":133,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.821585+0000","last_change":"2021-10-08T19:24:17.162629+0000","last_active":"2021-10-08T19:27:00.821585+0000","last_peered":"2021-10-08T19:27:00.821585+0000","last_clean":"2021-10-08T19:27:00.821585+0000","last_became_active":"2021-10-08T19:21:25.608581+0000","last_became_peered":"2021-10-08T19:21:25.608581+0000","last_unstale":"2021-10-08T19:27:00.821585+0000","last_undegraded":"2021-10-08T19:27:00.821585+0000","last_fullsized":"2021-10-08T19:27:00.821585+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'10","last_scrub_stamp":"2021-10-08T19:24:17.162525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:24:17.162525+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0071187819999999997,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":120,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.821862+0000","last_change":"2021-10-08T19:24:11.227195+0000","last_active":"2021-10-08T19:27:00.821862+0000","last_peered":"2021-10-08T19:27:00.821862+0000","last_clean":"2021-10-08T19:27:00.821862+0000","last_became_active":"2021-10-08T19:21:23.605441+0000","last_became_peered":"2021-10-08T19:21:23.605441+0000","last_unstale":"2021-10-08T19:27:00.821862+0000","last_undegraded":"2021-10-08T19:27:00.821862+0000","last_fullsized":"2021-10-08T19:27:00.821862+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:11.227079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:11.227079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014709302,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":108,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.807848+0000","last_change":"2021-10-08T19:22:46.569728+0000","last_active":"2021-10-08T19:27:00.807848+0000","last_peered":"2021-10-08T19:27:00.807848+0000","last_clean":"2021-10-08T19:27:00.807848+0000","last_became_active":"2021-10-08T19:21:29.649735+0000","last_became_peered":"2021-10-08T19:21:29.649735+0000","last_unstale":"2021-10-08T19:27:00.807848+0000","last_undegraded":"2021-10-08T19:27:00.807848+0000","last_fullsized":"2021-10-08T19:27:00.807848+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:46.569603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:46.569603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001693387,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"162'10513","reported_seq":14355,"reported_epoch":162,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2021-10-08T19:27:08.524474+0000","last_change":"2021-10-08T19:25:42.099559+0000","last_active":"2021-10-08T19:27:08.524474+0000","last_peered":"2021-10-08T19:27:08.524474+0000","last_clean":"2021-10-08T19:24:23.998781+0000","last_became_active":"2021-10-08T19:24:26.845215+0000","last_became_peered":"2021-10-08T19:24:26.845215+0000","last_unstale":"2021-10-08T19:27:08.524474+0000","last_undegraded":"2021-10-08T19:25:42.086581+0000","last_fullsized":"2021-10-08T19:24:26.076656+0000","mapping_epoch":113,"log_start":"137'6011","ondisk_log_start":"137'6011","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":4502,"ondisk_log_size":4502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":58392576,"num_objects":891,"num_object_clones":0,"num_object_copies":2673,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1163,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":891,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10513,"num_write_kb":364928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1881,"num_bytes_recovered":94109696,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3],"avail_no_missing":["4","1","3"],"object_location_counts":[{"shards":"3,4","objects":-272}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":79,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.887309+0000","last_change":"2021-10-08T19:25:14.562179+0000","last_active":"2021-10-08T19:27:04.887309+0000","last_peered":"2021-10-08T19:27:04.887309+0000","last_clean":"2021-10-08T19:27:04.887309+0000","last_became_active":"2021-10-08T19:25:14.561850+0000","last_became_peered":"2021-10-08T19:25:14.561850+0000","last_unstale":"2021-10-08T19:27:04.887309+0000","last_undegraded":"2021-10-08T19:27:04.887309+0000","last_fullsized":"2021-10-08T19:27:04.887309+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:17.379559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:17.379559+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0052805589999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":110,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.825331+0000","last_change":"2021-10-08T19:22:50.435623+0000","last_active":"2021-10-08T19:27:00.825331+0000","last_peered":"2021-10-08T19:27:00.825331+0000","last_clean":"2021-10-08T19:27:00.825331+0000","last_became_active":"2021-10-08T19:21:27.633878+0000","last_became_peered":"2021-10-08T19:21:27.633878+0000","last_unstale":"2021-10-08T19:27:00.825331+0000","last_undegraded":"2021-10-08T19:27:00.825331+0000","last_fullsized":"2021-10-08T19:27:00.825331+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:50.435552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:50.435552+0000","last_clean_scrub_stamp":"2021-10-08T19:22:50.435552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0012976140000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"69'12","reported_seq":136,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.876131+0000","last_change":"2021-10-08T19:22:57.003718+0000","last_active":"2021-10-08T19:27:04.876131+0000","last_peered":"2021-10-08T19:27:04.876131+0000","last_clean":"2021-10-08T19:27:04.876131+0000","last_became_active":"2021-10-08T19:21:25.609079+0000","last_became_peered":"2021-10-08T19:21:25.609079+0000","last_unstale":"2021-10-08T19:27:04.876131+0000","last_undegraded":"2021-10-08T19:27:04.876131+0000","last_fullsized":"2021-10-08T19:27:04.876131+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'12","last_scrub_stamp":"2021-10-08T19:22:57.003641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:57.003641+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0041017010000000001,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"61'2","reported_seq":131,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.876755+0000","last_change":"2021-10-08T19:23:07.991466+0000","last_active":"2021-10-08T19:27:04.876755+0000","last_peered":"2021-10-08T19:27:04.876755+0000","last_clean":"2021-10-08T19:27:04.876755+0000","last_became_active":"2021-10-08T19:21:23.603614+0000","last_became_peered":"2021-10-08T19:21:23.603614+0000","last_unstale":"2021-10-08T19:27:04.876755+0000","last_undegraded":"2021-10-08T19:27:04.876755+0000","last_fullsized":"2021-10-08T19:27:04.876755+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'2","last_scrub_stamp":"2021-10-08T19:23:07.991388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:07.991388+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001614983,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":107,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.828816+0000","last_change":"2021-10-08T19:24:12.484917+0000","last_active":"2021-10-08T19:27:00.828816+0000","last_peered":"2021-10-08T19:27:00.828816+0000","last_clean":"2021-10-08T19:27:00.828816+0000","last_became_active":"2021-10-08T19:21:29.647140+0000","last_became_peered":"2021-10-08T19:21:29.647140+0000","last_unstale":"2021-10-08T19:27:00.828816+0000","last_undegraded":"2021-10-08T19:27:00.828816+0000","last_fullsized":"2021-10-08T19:27:00.828816+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:12.484818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:24:12.484818+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0047233090000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"160'10384","reported_seq":10456,"reported_epoch":160,"state":"active+clean","last_fresh":"2021-10-08T19:27:03.605413+0000","last_change":"2021-10-08T19:23:44.808183+0000","last_active":"2021-10-08T19:27:03.605413+0000","last_peered":"2021-10-08T19:27:03.605413+0000","last_clean":"2021-10-08T19:27:03.605413+0000","last_became_active":"2021-10-08T19:23:44.807891+0000","last_became_peered":"2021-10-08T19:23:44.807891+0000","last_unstale":"2021-10-08T19:27:03.605413+0000","last_undegraded":"2021-10-08T19:27:03.605413+0000","last_fullsized":"2021-10-08T19:27:03.605413+0000","mapping_epoch":94,"log_start":"137'6146","ondisk_log_start":"137'6146","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:43.788499+0000","last_clean_scrub_stamp":"2021-10-08T19:23:43.788499+0000","log_size":4238,"ondisk_log_size":4238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":74842112,"num_objects":1142,"num_object_clones":0,"num_object_copies":3426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1142,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10384,"num_write_kb":368832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":39,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.883507+0000","last_change":"2021-10-08T19:25:15.504116+0000","last_active":"2021-10-08T19:27:04.883507+0000","last_peered":"2021-10-08T19:27:04.883507+0000","last_clean":"2021-10-08T19:27:04.883507+0000","last_became_active":"2021-10-08T19:25:15.503799+0000","last_became_peered":"2021-10-08T19:25:15.503799+0000","last_unstale":"2021-10-08T19:27:04.883507+0000","last_undegraded":"2021-10-08T19:27:04.883507+0000","last_fullsized":"2021-10-08T19:27:04.883507+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:40.563247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.563247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.024890005999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"69'9","reported_seq":128,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.815696+0000","last_change":"2021-10-08T19:23:00.644527+0000","last_active":"2021-10-08T19:27:00.815696+0000","last_peered":"2021-10-08T19:27:00.815696+0000","last_clean":"2021-10-08T19:27:00.815696+0000","last_became_active":"2021-10-08T19:21:25.743804+0000","last_became_peered":"2021-10-08T19:21:25.743804+0000","last_unstale":"2021-10-08T19:27:00.815696+0000","last_undegraded":"2021-10-08T19:27:00.815696+0000","last_fullsized":"2021-10-08T19:27:00.815696+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'9","last_scrub_stamp":"2021-10-08T19:23:00.644449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:00.644449+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0023246959999999998,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":120,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.825253+0000","last_change":"2021-10-08T19:23:36.618221+0000","last_active":"2021-10-08T19:27:00.825253+0000","last_peered":"2021-10-08T19:27:00.825253+0000","last_clean":"2021-10-08T19:27:00.825253+0000","last_became_active":"2021-10-08T19:21:23.598125+0000","last_became_peered":"2021-10-08T19:21:23.598125+0000","last_unstale":"2021-10-08T19:27:00.825253+0000","last_undegraded":"2021-10-08T19:27:00.825253+0000","last_fullsized":"2021-10-08T19:27:00.825253+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:36.618136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:36.618136+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0014720390000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":109,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.838278+0000","last_change":"2021-10-08T19:22:36.466178+0000","last_active":"2021-10-08T19:27:00.838278+0000","last_peered":"2021-10-08T19:27:00.838278+0000","last_clean":"2021-10-08T19:27:00.838278+0000","last_became_active":"2021-10-08T19:21:27.638112+0000","last_became_peered":"2021-10-08T19:21:27.638112+0000","last_unstale":"2021-10-08T19:27:00.838278+0000","last_undegraded":"2021-10-08T19:27:00.838278+0000","last_fullsized":"2021-10-08T19:27:00.838278+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:36.466077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:36.466077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0018534809999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":114,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.824578+0000","last_change":"2021-10-08T19:24:05.869865+0000","last_active":"2021-10-08T19:27:00.824578+0000","last_peered":"2021-10-08T19:27:00.824578+0000","last_clean":"2021-10-08T19:27:00.824578+0000","last_became_active":"2021-10-08T19:21:29.640674+0000","last_became_peered":"2021-10-08T19:21:29.640674+0000","last_unstale":"2021-10-08T19:27:00.824578+0000","last_undegraded":"2021-10-08T19:27:00.824578+0000","last_fullsized":"2021-10-08T19:27:00.824578+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:05.869774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:24:05.869774+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0041453820000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.880138+0000","last_change":"2021-10-08T19:25:15.501489+0000","last_active":"2021-10-08T19:27:04.880138+0000","last_peered":"2021-10-08T19:27:04.880138+0000","last_clean":"2021-10-08T19:27:04.880138+0000","last_became_active":"2021-10-08T19:25:15.501118+0000","last_became_peered":"2021-10-08T19:25:15.501118+0000","last_unstale":"2021-10-08T19:27:04.880138+0000","last_undegraded":"2021-10-08T19:27:04.880138+0000","last_fullsized":"2021-10-08T19:27:04.880138+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:09.177525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:09.177525+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0090469920000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"69'6","reported_seq":120,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.838202+0000","last_change":"2021-10-08T19:23:21.395469+0000","last_active":"2021-10-08T19:27:00.838202+0000","last_peered":"2021-10-08T19:27:00.838202+0000","last_clean":"2021-10-08T19:27:00.838202+0000","last_became_active":"2021-10-08T19:21:25.742631+0000","last_became_peered":"2021-10-08T19:21:25.742631+0000","last_unstale":"2021-10-08T19:27:00.838202+0000","last_undegraded":"2021-10-08T19:27:00.838202+0000","last_fullsized":"2021-10-08T19:27:00.838202+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'6","last_scrub_stamp":"2021-10-08T19:23:21.395390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:21.395390+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002416241,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":59,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.884085+0000","last_change":"2021-10-08T19:24:25.105291+0000","last_active":"2021-10-08T19:27:04.884085+0000","last_peered":"2021-10-08T19:27:04.884085+0000","last_clean":"2021-10-08T19:27:04.884085+0000","last_became_active":"2021-10-08T19:24:25.104551+0000","last_became_peered":"2021-10-08T19:24:25.104551+0000","last_unstale":"2021-10-08T19:27:04.884085+0000","last_undegraded":"2021-10-08T19:27:04.884085+0000","last_fullsized":"2021-10-08T19:27:04.884085+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:40.579610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:40.579610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":117,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.888289+0000","last_change":"2021-10-08T19:24:22.361236+0000","last_active":"2021-10-08T19:27:04.888289+0000","last_peered":"2021-10-08T19:27:04.888289+0000","last_clean":"2021-10-08T19:27:04.888289+0000","last_became_active":"2021-10-08T19:21:27.634443+0000","last_became_peered":"2021-10-08T19:21:27.634443+0000","last_unstale":"2021-10-08T19:27:04.888289+0000","last_undegraded":"2021-10-08T19:27:04.888289+0000","last_fullsized":"2021-10-08T19:27:04.888289+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:22.361166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:22.361166+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011785238,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":134,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.882557+0000","last_change":"2021-10-08T19:24:25.099693+0000","last_active":"2021-10-08T19:27:04.882557+0000","last_peered":"2021-10-08T19:27:04.882557+0000","last_clean":"2021-10-08T19:27:04.882557+0000","last_became_active":"2021-10-08T19:24:25.099371+0000","last_became_peered":"2021-10-08T19:24:25.099371+0000","last_unstale":"2021-10-08T19:27:04.882557+0000","last_undegraded":"2021-10-08T19:27:04.882557+0000","last_fullsized":"2021-10-08T19:27:04.882557+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:40.417858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:40.417858+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0014005230000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"70'5","reported_seq":294,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.880557+0000","last_change":"2021-10-08T19:25:15.495111+0000","last_active":"2021-10-08T19:27:04.880557+0000","last_peered":"2021-10-08T19:27:04.880557+0000","last_clean":"2021-10-08T19:27:04.880557+0000","last_became_active":"2021-10-08T19:25:15.494766+0000","last_became_peered":"2021-10-08T19:25:15.494766+0000","last_unstale":"2021-10-08T19:27:04.880557+0000","last_undegraded":"2021-10-08T19:27:04.880557+0000","last_fullsized":"2021-10-08T19:27:04.880557+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:22:48.239721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:48.239721+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001618092,"stat_sum":{"num_bytes":49,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":19,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":49,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"69'10","reported_seq":87,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.824476+0000","last_change":"2021-10-08T19:23:45.670593+0000","last_active":"2021-10-08T19:27:00.824476+0000","last_peered":"2021-10-08T19:27:00.824476+0000","last_clean":"2021-10-08T19:27:00.824476+0000","last_became_active":"2021-10-08T19:23:44.806124+0000","last_became_peered":"2021-10-08T19:23:44.806124+0000","last_unstale":"2021-10-08T19:27:00.824476+0000","last_undegraded":"2021-10-08T19:27:00.824476+0000","last_fullsized":"2021-10-08T19:27:00.824476+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'10","last_scrub_stamp":"2021-10-08T19:22:52.611060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:52.611060+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,7],"acting":[2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":121,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.888018+0000","last_change":"2021-10-08T19:24:23.338025+0000","last_active":"2021-10-08T19:27:04.888018+0000","last_peered":"2021-10-08T19:27:04.888018+0000","last_clean":"2021-10-08T19:27:04.888018+0000","last_became_active":"2021-10-08T19:21:23.603637+0000","last_became_peered":"2021-10-08T19:21:23.603637+0000","last_unstale":"2021-10-08T19:27:04.888018+0000","last_undegraded":"2021-10-08T19:27:04.888018+0000","last_fullsized":"2021-10-08T19:27:04.888018+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:23.337954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:23.337954+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0033141500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"69'8","reported_seq":194,"reported_epoch":162,"state":"active+clean","last_fresh":"2021-10-08T19:27:05.536373+0000","last_change":"2021-10-08T19:24:10.319907+0000","last_active":"2021-10-08T19:27:05.536373+0000","last_peered":"2021-10-08T19:27:05.536373+0000","last_clean":"2021-10-08T19:27:05.536373+0000","last_became_active":"2021-10-08T19:21:27.635924+0000","last_became_peered":"2021-10-08T19:21:27.635924+0000","last_unstale":"2021-10-08T19:27:05.536373+0000","last_undegraded":"2021-10-08T19:27:05.536373+0000","last_fullsized":"2021-10-08T19:27:05.536373+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'8","last_scrub_stamp":"2021-10-08T19:24:10.319809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:10.319809+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0087040810000000007,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":108,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.815552+0000","last_change":"2021-10-08T19:23:11.535748+0000","last_active":"2021-10-08T19:27:00.815552+0000","last_peered":"2021-10-08T19:27:00.815552+0000","last_clean":"2021-10-08T19:27:00.815552+0000","last_became_active":"2021-10-08T19:21:29.646331+0000","last_became_peered":"2021-10-08T19:21:29.646331+0000","last_unstale":"2021-10-08T19:27:00.815552+0000","last_undegraded":"2021-10-08T19:27:00.815552+0000","last_fullsized":"2021-10-08T19:27:00.815552+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:11.535641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:11.535641+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001740417,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.880970+0000","last_change":"2021-10-08T19:25:15.499116+0000","last_active":"2021-10-08T19:27:04.880970+0000","last_peered":"2021-10-08T19:27:04.880970+0000","last_clean":"2021-10-08T19:27:04.880970+0000","last_became_active":"2021-10-08T19:25:15.498770+0000","last_became_peered":"2021-10-08T19:25:15.498770+0000","last_unstale":"2021-10-08T19:27:04.880970+0000","last_undegraded":"2021-10-08T19:27:04.880970+0000","last_fullsized":"2021-10-08T19:27:04.880970+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:09.177525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:09.177525+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"69'9","reported_seq":135,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.887057+0000","last_change":"2021-10-08T19:24:04.286963+0000","last_active":"2021-10-08T19:27:04.887057+0000","last_peered":"2021-10-08T19:27:04.887057+0000","last_clean":"2021-10-08T19:27:04.887057+0000","last_became_active":"2021-10-08T19:21:25.741755+0000","last_became_peered":"2021-10-08T19:21:25.741755+0000","last_unstale":"2021-10-08T19:27:04.887057+0000","last_undegraded":"2021-10-08T19:27:04.887057+0000","last_fullsized":"2021-10-08T19:27:04.887057+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'9","last_scrub_stamp":"2021-10-08T19:24:04.286857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:24:04.286857+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0047281429999999998,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":120,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.809103+0000","last_change":"2021-10-08T19:23:27.367010+0000","last_active":"2021-10-08T19:27:00.809103+0000","last_peered":"2021-10-08T19:27:00.809103+0000","last_clean":"2021-10-08T19:27:00.809103+0000","last_became_active":"2021-10-08T19:21:23.606478+0000","last_became_peered":"2021-10-08T19:21:23.606478+0000","last_unstale":"2021-10-08T19:27:00.809103+0000","last_undegraded":"2021-10-08T19:27:00.809103+0000","last_fullsized":"2021-10-08T19:27:00.809103+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:27.366934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:27.366934+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0016199809999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"69'8","reported_seq":191,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:01.787997+0000","last_change":"2021-10-08T19:24:16.547591+0000","last_active":"2021-10-08T19:27:01.787997+0000","last_peered":"2021-10-08T19:27:01.787997+0000","last_clean":"2021-10-08T19:27:01.787997+0000","last_became_active":"2021-10-08T19:21:27.636440+0000","last_became_peered":"2021-10-08T19:21:27.636440+0000","last_unstale":"2021-10-08T19:27:01.787997+0000","last_undegraded":"2021-10-08T19:27:01.787997+0000","last_fullsized":"2021-10-08T19:27:01.787997+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'8","last_scrub_stamp":"2021-10-08T19:24:16.547475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:16.547475+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0084390609999999994,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":109,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.876929+0000","last_change":"2021-10-08T19:22:49.049456+0000","last_active":"2021-10-08T19:27:04.876929+0000","last_peered":"2021-10-08T19:27:04.876929+0000","last_clean":"2021-10-08T19:27:04.876929+0000","last_became_active":"2021-10-08T19:21:29.640302+0000","last_became_peered":"2021-10-08T19:21:29.640302+0000","last_unstale":"2021-10-08T19:27:04.876929+0000","last_undegraded":"2021-10-08T19:27:04.876929+0000","last_fullsized":"2021-10-08T19:27:04.876929+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:49.049379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:49.049379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.00162856,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":37,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.808441+0000","last_change":"2021-10-08T19:25:15.502340+0000","last_active":"2021-10-08T19:27:00.808441+0000","last_peered":"2021-10-08T19:27:00.808441+0000","last_clean":"2021-10-08T19:27:00.808441+0000","last_became_active":"2021-10-08T19:25:15.502018+0000","last_became_peered":"2021-10-08T19:25:15.502018+0000","last_unstale":"2021-10-08T19:27:00.808441+0000","last_undegraded":"2021-10-08T19:27:00.808441+0000","last_fullsized":"2021-10-08T19:27:00.808441+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:40.563247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.563247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.024890005999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":39,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.882358+0000","last_change":"2021-10-08T19:25:15.505142+0000","last_active":"2021-10-08T19:27:04.882358+0000","last_peered":"2021-10-08T19:27:04.882358+0000","last_clean":"2021-10-08T19:27:04.882358+0000","last_became_active":"2021-10-08T19:25:15.504778+0000","last_became_peered":"2021-10-08T19:25:15.504778+0000","last_unstale":"2021-10-08T19:27:04.882358+0000","last_undegraded":"2021-10-08T19:27:04.882358+0000","last_fullsized":"2021-10-08T19:27:04.882358+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:17.379559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:17.379559+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0090469920000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"87'13","reported_seq":170,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.821510+0000","last_change":"2021-10-08T19:24:25.114792+0000","last_active":"2021-10-08T19:27:00.821510+0000","last_peered":"2021-10-08T19:27:00.821510+0000","last_clean":"2021-10-08T19:27:00.821510+0000","last_became_active":"2021-10-08T19:24:25.091885+0000","last_became_peered":"2021-10-08T19:24:25.091885+0000","last_unstale":"2021-10-08T19:27:00.821510+0000","last_undegraded":"2021-10-08T19:27:00.821510+0000","last_fullsized":"2021-10-08T19:27:00.821510+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'13","last_scrub_stamp":"2021-10-08T19:22:53.263631+0000","last_deep_scrub":"87'13","last_deep_scrub_stamp":"2021-10-08T19:22:53.263631+0000","last_clean_scrub_stamp":"2021-10-08T19:22:53.263631+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0036954140000000002,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":59,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.883698+0000","last_change":"2021-10-08T19:24:25.105338+0000","last_active":"2021-10-08T19:27:04.883698+0000","last_peered":"2021-10-08T19:27:04.883698+0000","last_clean":"2021-10-08T19:27:04.883698+0000","last_became_active":"2021-10-08T19:24:25.105096+0000","last_became_peered":"2021-10-08T19:24:25.105096+0000","last_unstale":"2021-10-08T19:27:04.883698+0000","last_undegraded":"2021-10-08T19:27:04.883698+0000","last_fullsized":"2021-10-08T19:27:04.883698+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:52.408893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:52.408893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":109,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.828739+0000","last_change":"2021-10-08T19:23:28.367444+0000","last_active":"2021-10-08T19:27:00.828739+0000","last_peered":"2021-10-08T19:27:00.828739+0000","last_clean":"2021-10-08T19:27:00.828739+0000","last_became_active":"2021-10-08T19:21:27.637800+0000","last_became_peered":"2021-10-08T19:21:27.637800+0000","last_unstale":"2021-10-08T19:27:00.828739+0000","last_undegraded":"2021-10-08T19:27:00.828739+0000","last_fullsized":"2021-10-08T19:27:00.828739+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:28.367323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.367323+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034823359999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":108,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.807753+0000","last_change":"2021-10-08T19:23:02.605102+0000","last_active":"2021-10-08T19:27:00.807753+0000","last_peered":"2021-10-08T19:27:00.807753+0000","last_clean":"2021-10-08T19:27:00.807753+0000","last_became_active":"2021-10-08T19:21:29.641431+0000","last_became_peered":"2021-10-08T19:21:29.641431+0000","last_unstale":"2021-10-08T19:27:00.807753+0000","last_undegraded":"2021-10-08T19:27:00.807753+0000","last_fullsized":"2021-10-08T19:27:00.807753+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:02.605025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:02.605025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001265305,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"69'11","reported_seq":208,"reported_epoch":161,"state":"active+recovery_wait+degraded","last_fresh":"2021-10-08T19:27:04.878740+0000","last_change":"2021-10-08T19:24:47.503908+0000","last_active":"2021-10-08T19:27:04.878740+0000","last_peered":"2021-10-08T19:27:04.878740+0000","last_clean":"2021-10-08T19:24:40.461198+0000","last_became_active":"2021-10-08T19:24:47.503536+0000","last_became_peered":"2021-10-08T19:24:47.503536+0000","last_unstale":"2021-10-08T19:27:04.878740+0000","last_undegraded":"2021-10-08T19:24:47.488427+0000","last_fullsized":"2021-10-08T19:27:04.878740+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'11","last_scrub_stamp":"2021-10-08T19:24:04.177847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:24:04.177847+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0047576429999999998,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":["4","2","6"],"object_location_counts":[{"shards":"2,4,6","objects":5}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":114,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.821252+0000","last_change":"2021-10-08T19:23:02.242539+0000","last_active":"2021-10-08T19:27:00.821252+0000","last_peered":"2021-10-08T19:27:00.821252+0000","last_clean":"2021-10-08T19:27:00.821252+0000","last_became_active":"2021-10-08T19:21:23.607048+0000","last_became_peered":"2021-10-08T19:21:23.607048+0000","last_unstale":"2021-10-08T19:27:00.821252+0000","last_undegraded":"2021-10-08T19:27:00.821252+0000","last_fullsized":"2021-10-08T19:27:00.821252+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:02.242462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:02.242462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034031740000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":110,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.821654+0000","last_change":"2021-10-08T19:22:43.186757+0000","last_active":"2021-10-08T19:27:00.821654+0000","last_peered":"2021-10-08T19:27:00.821654+0000","last_clean":"2021-10-08T19:27:00.821654+0000","last_became_active":"2021-10-08T19:21:27.635623+0000","last_became_peered":"2021-10-08T19:21:27.635623+0000","last_unstale":"2021-10-08T19:27:00.821654+0000","last_undegraded":"2021-10-08T19:27:00.821654+0000","last_fullsized":"2021-10-08T19:27:00.821654+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:43.186684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:43.186684+0000","last_clean_scrub_stamp":"2021-10-08T19:22:43.186684+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0015123129999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":107,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.829429+0000","last_change":"2021-10-08T19:23:12.504222+0000","last_active":"2021-10-08T19:27:00.829429+0000","last_peered":"2021-10-08T19:27:00.829429+0000","last_clean":"2021-10-08T19:27:00.829429+0000","last_became_active":"2021-10-08T19:21:29.649225+0000","last_became_peered":"2021-10-08T19:21:29.649225+0000","last_unstale":"2021-10-08T19:27:00.829429+0000","last_undegraded":"2021-10-08T19:27:00.829429+0000","last_fullsized":"2021-10-08T19:27:00.829429+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:12.504136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:12.504136+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0038704550000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"70'5","reported_seq":39,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.877042+0000","last_change":"2021-10-08T19:25:15.496726+0000","last_active":"2021-10-08T19:27:04.877042+0000","last_peered":"2021-10-08T19:27:04.877042+0000","last_clean":"2021-10-08T19:27:04.877042+0000","last_became_active":"2021-10-08T19:25:15.496309+0000","last_became_peered":"2021-10-08T19:25:15.496309+0000","last_unstale":"2021-10-08T19:27:04.877042+0000","last_undegraded":"2021-10-08T19:27:04.877042+0000","last_fullsized":"2021-10-08T19:27:04.877042+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:22:48.239721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:48.239721+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001618092,"stat_sum":{"num_bytes":49,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":19,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":49,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.10","version":"69'4","reported_seq":147,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.827759+0000","last_change":"2021-10-08T19:24:25.622912+0000","last_active":"2021-10-08T19:27:00.827759+0000","last_peered":"2021-10-08T19:27:00.827759+0000","last_clean":"2021-10-08T19:27:00.827759+0000","last_became_active":"2021-10-08T19:24:25.097674+0000","last_became_peered":"2021-10-08T19:24:25.097674+0000","last_unstale":"2021-10-08T19:27:00.827759+0000","last_undegraded":"2021-10-08T19:27:00.827759+0000","last_fullsized":"2021-10-08T19:27:00.827759+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'4","last_scrub_stamp":"2021-10-08T19:22:34.447854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:34.447854+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040770490000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":139,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.888390+0000","last_change":"2021-10-08T19:24:25.094735+0000","last_active":"2021-10-08T19:27:04.888390+0000","last_peered":"2021-10-08T19:27:04.888390+0000","last_clean":"2021-10-08T19:27:04.888390+0000","last_became_active":"2021-10-08T19:24:25.094384+0000","last_became_peered":"2021-10-08T19:24:25.094384+0000","last_unstale":"2021-10-08T19:27:04.888390+0000","last_undegraded":"2021-10-08T19:27:04.888390+0000","last_fullsized":"2021-10-08T19:27:04.888390+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:21.346014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:13.716331+0000","last_clean_scrub_stamp":"2021-10-08T19:24:21.346014+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0086210910000000009,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":59,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.884226+0000","last_change":"2021-10-08T19:24:25.106499+0000","last_active":"2021-10-08T19:27:04.884226+0000","last_peered":"2021-10-08T19:27:04.884226+0000","last_clean":"2021-10-08T19:27:04.884226+0000","last_became_active":"2021-10-08T19:24:25.106186+0000","last_became_peered":"2021-10-08T19:24:25.106186+0000","last_unstale":"2021-10-08T19:27:04.884226+0000","last_undegraded":"2021-10-08T19:27:04.884226+0000","last_fullsized":"2021-10-08T19:27:04.884226+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:02.446394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:02.446394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":116,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.880146+0000","last_change":"2021-10-08T19:24:18.542192+0000","last_active":"2021-10-08T19:27:04.880146+0000","last_peered":"2021-10-08T19:27:04.880146+0000","last_clean":"2021-10-08T19:27:04.880146+0000","last_became_active":"2021-10-08T19:21:29.642835+0000","last_became_peered":"2021-10-08T19:21:29.642835+0000","last_unstale":"2021-10-08T19:27:04.880146+0000","last_undegraded":"2021-10-08T19:27:04.880146+0000","last_fullsized":"2021-10-08T19:27:04.880146+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:18.542124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:24:18.542124+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0051790259999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.890635+0000","last_change":"2021-10-08T19:25:15.504574+0000","last_active":"2021-10-08T19:27:04.890635+0000","last_peered":"2021-10-08T19:27:04.890635+0000","last_clean":"2021-10-08T19:27:04.890635+0000","last_became_active":"2021-10-08T19:25:15.504255+0000","last_became_peered":"2021-10-08T19:25:15.504255+0000","last_unstale":"2021-10-08T19:27:04.890635+0000","last_undegraded":"2021-10-08T19:27:04.890635+0000","last_fullsized":"2021-10-08T19:27:04.890635+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:40.563247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.563247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.024890005999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"69'11","reported_seq":172,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.829844+0000","last_change":"2021-10-08T19:24:25.550057+0000","last_active":"2021-10-08T19:27:00.829844+0000","last_peered":"2021-10-08T19:27:00.829844+0000","last_clean":"2021-10-08T19:27:00.829844+0000","last_became_active":"2021-10-08T19:24:25.097676+0000","last_became_peered":"2021-10-08T19:24:25.097676+0000","last_unstale":"2021-10-08T19:27:00.829844+0000","last_undegraded":"2021-10-08T19:27:00.829844+0000","last_fullsized":"2021-10-08T19:27:00.829844+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'11","last_scrub_stamp":"2021-10-08T19:23:38.388959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:38.388959+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039620519999999998,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":59,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.882244+0000","last_change":"2021-10-08T19:24:25.098448+0000","last_active":"2021-10-08T19:27:04.882244+0000","last_peered":"2021-10-08T19:27:04.882244+0000","last_clean":"2021-10-08T19:27:04.882244+0000","last_became_active":"2021-10-08T19:24:25.098128+0000","last_became_peered":"2021-10-08T19:24:25.098128+0000","last_unstale":"2021-10-08T19:27:04.882244+0000","last_undegraded":"2021-10-08T19:27:04.882244+0000","last_fullsized":"2021-10-08T19:27:04.882244+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:34.508558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:34.508558+0000","last_clean_scrub_stamp":"2021-10-08T19:23:34.508558+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":130,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.882201+0000","last_change":"2021-10-08T19:24:25.096183+0000","last_active":"2021-10-08T19:27:04.882201+0000","last_peered":"2021-10-08T19:27:04.882201+0000","last_clean":"2021-10-08T19:27:04.882201+0000","last_became_active":"2021-10-08T19:24:25.095490+0000","last_became_peered":"2021-10-08T19:24:25.095490+0000","last_unstale":"2021-10-08T19:27:04.882201+0000","last_undegraded":"2021-10-08T19:27:04.882201+0000","last_fullsized":"2021-10-08T19:27:04.882201+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:00.194892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:00.194892+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020373650000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":125,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.831725+0000","last_change":"2021-10-08T19:24:25.102165+0000","last_active":"2021-10-08T19:27:00.831725+0000","last_peered":"2021-10-08T19:27:00.831725+0000","last_clean":"2021-10-08T19:27:00.831725+0000","last_became_active":"2021-10-08T19:24:25.100477+0000","last_became_peered":"2021-10-08T19:24:25.100477+0000","last_unstale":"2021-10-08T19:27:00.831725+0000","last_undegraded":"2021-10-08T19:27:00.831725+0000","last_fullsized":"2021-10-08T19:27:00.831725+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:06.570853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:06.570853+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034079790000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"69'10","reported_seq":133,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.815840+0000","last_change":"2021-10-08T19:23:36.223620+0000","last_active":"2021-10-08T19:27:00.815840+0000","last_peered":"2021-10-08T19:27:00.815840+0000","last_clean":"2021-10-08T19:27:00.815840+0000","last_became_active":"2021-10-08T19:21:25.743519+0000","last_became_peered":"2021-10-08T19:21:25.743519+0000","last_unstale":"2021-10-08T19:27:00.815840+0000","last_undegraded":"2021-10-08T19:27:00.815840+0000","last_fullsized":"2021-10-08T19:27:00.815840+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'10","last_scrub_stamp":"2021-10-08T19:23:36.223545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:36.223545+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0023151259999999998,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":115,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.886797+0000","last_change":"2021-10-08T19:23:19.631788+0000","last_active":"2021-10-08T19:27:04.886797+0000","last_peered":"2021-10-08T19:27:04.886797+0000","last_clean":"2021-10-08T19:27:04.886797+0000","last_became_active":"2021-10-08T19:21:23.604530+0000","last_became_peered":"2021-10-08T19:21:23.604530+0000","last_unstale":"2021-10-08T19:27:04.886797+0000","last_undegraded":"2021-10-08T19:27:04.886797+0000","last_fullsized":"2021-10-08T19:27:04.886797+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:19.631715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:19.631715+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0013318340000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1f","version":"114'10","reported_seq":96,"reported_epoch":162,"state":"active+clean","last_fresh":"2021-10-08T19:27:05.553712+0000","last_change":"2021-10-08T19:24:25.122871+0000","last_active":"2021-10-08T19:27:05.553712+0000","last_peered":"2021-10-08T19:27:05.553712+0000","last_clean":"2021-10-08T19:27:05.553712+0000","last_became_active":"2021-10-08T19:24:25.105742+0000","last_became_peered":"2021-10-08T19:24:25.105742+0000","last_unstale":"2021-10-08T19:27:05.553712+0000","last_undegraded":"2021-10-08T19:27:05.553712+0000","last_fullsized":"2021-10-08T19:27:05.553712+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'9","last_scrub_stamp":"2021-10-08T19:24:07.171989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:07.171989+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"69'1","reported_seq":111,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.885088+0000","last_change":"2021-10-08T19:23:04.311491+0000","last_active":"2021-10-08T19:27:04.885088+0000","last_peered":"2021-10-08T19:27:04.885088+0000","last_clean":"2021-10-08T19:27:04.885088+0000","last_became_active":"2021-10-08T19:21:29.640296+0000","last_became_peered":"2021-10-08T19:21:29.640296+0000","last_unstale":"2021-10-08T19:27:04.885088+0000","last_undegraded":"2021-10-08T19:27:04.885088+0000","last_fullsized":"2021-10-08T19:27:04.885088+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2021-10-08T19:23:04.311406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:04.311406+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0041668299999999998,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"69'11","reported_seq":71,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.882626+0000","last_change":"2021-10-08T19:24:25.129616+0000","last_active":"2021-10-08T19:27:04.882626+0000","last_peered":"2021-10-08T19:27:04.882626+0000","last_clean":"2021-10-08T19:27:04.882626+0000","last_became_active":"2021-10-08T19:24:25.104985+0000","last_became_peered":"2021-10-08T19:24:25.104985+0000","last_unstale":"2021-10-08T19:27:04.882626+0000","last_undegraded":"2021-10-08T19:27:04.882626+0000","last_fullsized":"2021-10-08T19:27:04.882626+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'11","last_scrub_stamp":"2021-10-08T19:22:53.420199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:53.420199+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":131,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.829630+0000","last_change":"2021-10-08T19:24:25.098061+0000","last_active":"2021-10-08T19:27:00.829630+0000","last_peered":"2021-10-08T19:27:00.829630+0000","last_clean":"2021-10-08T19:27:00.829630+0000","last_became_active":"2021-10-08T19:24:25.097164+0000","last_became_peered":"2021-10-08T19:24:25.097164+0000","last_unstale":"2021-10-08T19:27:00.829630+0000","last_undegraded":"2021-10-08T19:27:00.829630+0000","last_fullsized":"2021-10-08T19:27:00.829630+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:11.535464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:11.535464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012302489999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":116,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.815881+0000","last_change":"2021-10-08T19:24:13.178473+0000","last_active":"2021-10-08T19:27:00.815881+0000","last_peered":"2021-10-08T19:27:00.815881+0000","last_clean":"2021-10-08T19:27:00.815881+0000","last_became_active":"2021-10-08T19:21:27.632648+0000","last_became_peered":"2021-10-08T19:21:27.632648+0000","last_unstale":"2021-10-08T19:27:00.815881+0000","last_undegraded":"2021-10-08T19:27:00.815881+0000","last_fullsized":"2021-10-08T19:27:00.815881+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:13.178370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:13.178370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0056659290000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"69'1","reported_seq":109,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.821057+0000","last_change":"2021-10-08T19:22:50.226593+0000","last_active":"2021-10-08T19:27:00.821057+0000","last_peered":"2021-10-08T19:27:00.821057+0000","last_clean":"2021-10-08T19:27:00.821057+0000","last_became_active":"2021-10-08T19:21:29.637392+0000","last_became_peered":"2021-10-08T19:21:29.637392+0000","last_unstale":"2021-10-08T19:27:00.821057+0000","last_undegraded":"2021-10-08T19:27:00.821057+0000","last_fullsized":"2021-10-08T19:27:00.821057+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2021-10-08T19:22:50.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:50.226504+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040000080000000002,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"69'15","reported_seq":162,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.824849+0000","last_change":"2021-10-08T19:22:52.474731+0000","last_active":"2021-10-08T19:27:00.824849+0000","last_peered":"2021-10-08T19:27:00.824849+0000","last_clean":"2021-10-08T19:27:00.824849+0000","last_became_active":"2021-10-08T19:22:44.005356+0000","last_became_peered":"2021-10-08T19:22:44.005356+0000","last_unstale":"2021-10-08T19:27:00.824849+0000","last_undegraded":"2021-10-08T19:27:00.824849+0000","last_fullsized":"2021-10-08T19:27:00.824849+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'15","last_scrub_stamp":"2021-10-08T19:22:52.474651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:52.474651+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040638499999999999,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":59,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.881274+0000","last_change":"2021-10-08T19:24:25.106611+0000","last_active":"2021-10-08T19:27:04.881274+0000","last_peered":"2021-10-08T19:27:04.881274+0000","last_clean":"2021-10-08T19:27:04.881274+0000","last_became_active":"2021-10-08T19:24:25.106119+0000","last_became_peered":"2021-10-08T19:24:25.106119+0000","last_unstale":"2021-10-08T19:27:04.881274+0000","last_undegraded":"2021-10-08T19:27:04.881274+0000","last_fullsized":"2021-10-08T19:27:04.881274+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:46.422866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:46.422866+0000","last_clean_scrub_stamp":"2021-10-08T19:22:46.422866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":110,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.821539+0000","last_change":"2021-10-08T19:23:10.148845+0000","last_active":"2021-10-08T19:27:00.821539+0000","last_peered":"2021-10-08T19:27:00.821539+0000","last_clean":"2021-10-08T19:27:00.821539+0000","last_became_active":"2021-10-08T19:21:27.636398+0000","last_became_peered":"2021-10-08T19:21:27.636398+0000","last_unstale":"2021-10-08T19:27:00.821539+0000","last_undegraded":"2021-10-08T19:27:00.821539+0000","last_fullsized":"2021-10-08T19:27:00.821539+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:10.148774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:10.148774+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034045170000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":127,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.876234+0000","last_change":"2021-10-08T19:24:25.098136+0000","last_active":"2021-10-08T19:27:04.876234+0000","last_peered":"2021-10-08T19:27:04.876234+0000","last_clean":"2021-10-08T19:27:04.876234+0000","last_became_active":"2021-10-08T19:24:25.097782+0000","last_became_peered":"2021-10-08T19:24:25.097782+0000","last_unstale":"2021-10-08T19:27:04.876234+0000","last_undegraded":"2021-10-08T19:27:04.876234+0000","last_fullsized":"2021-10-08T19:27:04.876234+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:56.020759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:56.020759+0000","last_clean_scrub_stamp":"2021-10-08T19:22:56.020759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001373478,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"69'12","reported_seq":134,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.828563+0000","last_change":"2021-10-08T19:23:10.562916+0000","last_active":"2021-10-08T19:27:00.828563+0000","last_peered":"2021-10-08T19:27:00.828563+0000","last_clean":"2021-10-08T19:27:00.828563+0000","last_became_active":"2021-10-08T19:21:25.612541+0000","last_became_peered":"2021-10-08T19:21:25.612541+0000","last_unstale":"2021-10-08T19:27:00.828563+0000","last_undegraded":"2021-10-08T19:27:00.828563+0000","last_fullsized":"2021-10-08T19:27:00.828563+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'12","last_scrub_stamp":"2021-10-08T19:23:10.562820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:10.562820+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040692890000000002,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":131,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.828664+0000","last_change":"2021-10-08T19:24:25.097146+0000","last_active":"2021-10-08T19:27:00.828664+0000","last_peered":"2021-10-08T19:27:00.828664+0000","last_clean":"2021-10-08T19:27:00.828664+0000","last_became_active":"2021-10-08T19:24:25.096570+0000","last_became_peered":"2021-10-08T19:24:25.096570+0000","last_unstale":"2021-10-08T19:27:00.828664+0000","last_undegraded":"2021-10-08T19:27:00.828664+0000","last_fullsized":"2021-10-08T19:27:00.828664+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:07.581653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:07.581653+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034956309999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":117,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.877227+0000","last_change":"2021-10-08T19:24:13.289692+0000","last_active":"2021-10-08T19:27:04.877227+0000","last_peered":"2021-10-08T19:27:04.877227+0000","last_clean":"2021-10-08T19:27:04.877227+0000","last_became_active":"2021-10-08T19:21:27.635242+0000","last_became_peered":"2021-10-08T19:21:27.635242+0000","last_unstale":"2021-10-08T19:27:04.877227+0000","last_undegraded":"2021-10-08T19:27:04.877227+0000","last_fullsized":"2021-10-08T19:27:04.877227+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:13.289586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:13.289586+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0093791299999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":125,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.838113+0000","last_change":"2021-10-08T19:24:25.096752+0000","last_active":"2021-10-08T19:27:00.838113+0000","last_peered":"2021-10-08T19:27:00.838113+0000","last_clean":"2021-10-08T19:27:00.838113+0000","last_became_active":"2021-10-08T19:24:25.096419+0000","last_became_peered":"2021-10-08T19:24:25.096419+0000","last_unstale":"2021-10-08T19:27:00.838113+0000","last_undegraded":"2021-10-08T19:27:00.838113+0000","last_fullsized":"2021-10-08T19:27:00.838113+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:38.544673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:38.544673+0000","last_clean_scrub_stamp":"2021-10-08T19:22:38.544673+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0019818940000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"69'9","reported_seq":129,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.875965+0000","last_change":"2021-10-08T19:23:19.997379+0000","last_active":"2021-10-08T19:27:04.875965+0000","last_peered":"2021-10-08T19:27:04.875965+0000","last_clean":"2021-10-08T19:27:04.875965+0000","last_became_active":"2021-10-08T19:21:25.608263+0000","last_became_peered":"2021-10-08T19:21:25.608263+0000","last_unstale":"2021-10-08T19:27:04.875965+0000","last_undegraded":"2021-10-08T19:27:04.875965+0000","last_fullsized":"2021-10-08T19:27:04.875965+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'9","last_scrub_stamp":"2021-10-08T19:23:19.997296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:19.997296+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040259689999999999,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":122,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.884898+0000","last_change":"2021-10-08T19:24:15.574426+0000","last_active":"2021-10-08T19:27:04.884898+0000","last_peered":"2021-10-08T19:27:04.884898+0000","last_clean":"2021-10-08T19:27:04.884898+0000","last_became_active":"2021-10-08T19:21:23.607785+0000","last_became_peered":"2021-10-08T19:21:23.607785+0000","last_unstale":"2021-10-08T19:27:04.884898+0000","last_undegraded":"2021-10-08T19:27:04.884898+0000","last_fullsized":"2021-10-08T19:27:04.884898+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:15.574344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:15.574344+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0085919499999999992,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":111,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.887444+0000","last_change":"2021-10-08T19:23:05.799433+0000","last_active":"2021-10-08T19:27:04.887444+0000","last_peered":"2021-10-08T19:27:04.887444+0000","last_clean":"2021-10-08T19:27:04.887444+0000","last_became_active":"2021-10-08T19:21:27.633979+0000","last_became_peered":"2021-10-08T19:21:27.633979+0000","last_unstale":"2021-10-08T19:27:04.887444+0000","last_undegraded":"2021-10-08T19:27:04.887444+0000","last_fullsized":"2021-10-08T19:27:04.887444+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:05.799361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:05.799361+0000","last_clean_scrub_stamp":"2021-10-08T19:23:05.799361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0036358100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":114,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.808288+0000","last_change":"2021-10-08T19:24:14.144555+0000","last_active":"2021-10-08T19:27:00.808288+0000","last_peered":"2021-10-08T19:27:00.808288+0000","last_clean":"2021-10-08T19:27:00.808288+0000","last_became_active":"2021-10-08T19:21:29.640978+0000","last_became_peered":"2021-10-08T19:21:29.640978+0000","last_unstale":"2021-10-08T19:27:00.808288+0000","last_undegraded":"2021-10-08T19:27:00.808288+0000","last_fullsized":"2021-10-08T19:27:00.808288+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:14.144450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:24:14.144450+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0032569320000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"69'5","reported_seq":123,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.878592+0000","last_change":"2021-10-08T19:23:17.993609+0000","last_active":"2021-10-08T19:27:04.878592+0000","last_peered":"2021-10-08T19:27:04.878592+0000","last_clean":"2021-10-08T19:27:04.878592+0000","last_became_active":"2021-10-08T19:21:25.609029+0000","last_became_peered":"2021-10-08T19:21:25.609029+0000","last_unstale":"2021-10-08T19:27:04.878592+0000","last_undegraded":"2021-10-08T19:27:04.878592+0000","last_fullsized":"2021-10-08T19:27:04.878592+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'5","last_scrub_stamp":"2021-10-08T19:23:17.993532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:17.993532+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040855580000000004,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":140,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.882705+0000","last_change":"2021-10-08T19:24:25.096540+0000","last_active":"2021-10-08T19:27:04.882705+0000","last_peered":"2021-10-08T19:27:04.882705+0000","last_clean":"2021-10-08T19:27:04.882705+0000","last_became_active":"2021-10-08T19:24:25.096225+0000","last_became_peered":"2021-10-08T19:24:25.096225+0000","last_unstale":"2021-10-08T19:27:04.882705+0000","last_undegraded":"2021-10-08T19:27:04.882705+0000","last_fullsized":"2021-10-08T19:27:04.882705+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:06.609550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:06.609550+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0037828580000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":118,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.881634+0000","last_change":"2021-10-08T19:24:20.517151+0000","last_active":"2021-10-08T19:27:04.881634+0000","last_peered":"2021-10-08T19:27:04.881634+0000","last_clean":"2021-10-08T19:27:04.881634+0000","last_became_active":"2021-10-08T19:21:27.637178+0000","last_became_peered":"2021-10-08T19:21:27.637178+0000","last_unstale":"2021-10-08T19:27:04.881634+0000","last_undegraded":"2021-10-08T19:27:04.881634+0000","last_fullsized":"2021-10-08T19:27:04.881634+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:20.517044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:20.517044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0053303969999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":109,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.886865+0000","last_change":"2021-10-08T19:23:23.659594+0000","last_active":"2021-10-08T19:27:04.886865+0000","last_peered":"2021-10-08T19:27:04.886865+0000","last_clean":"2021-10-08T19:27:04.886865+0000","last_became_active":"2021-10-08T19:21:29.649640+0000","last_became_peered":"2021-10-08T19:21:29.649640+0000","last_unstale":"2021-10-08T19:27:04.886865+0000","last_undegraded":"2021-10-08T19:27:04.886865+0000","last_fullsized":"2021-10-08T19:27:04.886865+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:23.659524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:23.659524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0013747169999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"88'13","reported_seq":197,"reported_epoch":161,"state":"active+recovery_wait+degraded","last_fresh":"2021-10-08T19:27:04.875954+0000","last_change":"2021-10-08T19:25:33.715801+0000","last_active":"2021-10-08T19:27:04.875954+0000","last_peered":"2021-10-08T19:27:04.875954+0000","last_clean":"2021-10-08T19:25:29.684638+0000","last_became_active":"2021-10-08T19:25:33.715297+0000","last_became_peered":"2021-10-08T19:25:33.715297+0000","last_unstale":"2021-10-08T19:27:04.875954+0000","last_undegraded":"2021-10-08T19:25:33.704184+0000","last_fullsized":"2021-10-08T19:27:04.875954+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'13","last_scrub_stamp":"2021-10-08T19:23:16.016646+0000","last_deep_scrub":"88'13","last_deep_scrub_stamp":"2021-10-08T19:23:16.016646+0000","last_clean_scrub_stamp":"2021-10-08T19:23:16.016646+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0052093469999999996,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":["4","2","6"],"object_location_counts":[{"shards":"2,4,6","objects":4}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":113,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.831503+0000","last_change":"2021-10-08T19:23:14.443220+0000","last_active":"2021-10-08T19:27:00.831503+0000","last_peered":"2021-10-08T19:27:00.831503+0000","last_clean":"2021-10-08T19:27:00.831503+0000","last_became_active":"2021-10-08T19:21:23.598272+0000","last_became_peered":"2021-10-08T19:21:23.598272+0000","last_unstale":"2021-10-08T19:27:00.831503+0000","last_undegraded":"2021-10-08T19:27:00.831503+0000","last_fullsized":"2021-10-08T19:27:00.831503+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:14.443147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:14.443147+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003489631,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":110,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.820858+0000","last_change":"2021-10-08T19:23:05.196328+0000","last_active":"2021-10-08T19:27:00.820858+0000","last_peered":"2021-10-08T19:27:00.820858+0000","last_clean":"2021-10-08T19:27:00.820858+0000","last_became_active":"2021-10-08T19:21:27.634883+0000","last_became_peered":"2021-10-08T19:21:27.634883+0000","last_unstale":"2021-10-08T19:27:00.820858+0000","last_undegraded":"2021-10-08T19:27:00.820858+0000","last_fullsized":"2021-10-08T19:27:00.820858+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:05.196252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:05.196252+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0016803230000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":109,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.875877+0000","last_change":"2021-10-08T19:22:50.032446+0000","last_active":"2021-10-08T19:27:04.875877+0000","last_peered":"2021-10-08T19:27:04.875877+0000","last_clean":"2021-10-08T19:27:04.875877+0000","last_became_active":"2021-10-08T19:21:29.639039+0000","last_became_peered":"2021-10-08T19:21:29.639039+0000","last_unstale":"2021-10-08T19:27:04.875877+0000","last_undegraded":"2021-10-08T19:27:04.875877+0000","last_fullsized":"2021-10-08T19:27:04.875877+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:50.032367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:50.032367+0000","last_clean_scrub_stamp":"2021-10-08T19:22:50.032367+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034102759999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"69'15","reported_seq":136,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.829918+0000","last_change":"2021-10-08T19:24:14.482657+0000","last_active":"2021-10-08T19:27:00.829918+0000","last_peered":"2021-10-08T19:27:00.829918+0000","last_clean":"2021-10-08T19:27:00.829918+0000","last_became_active":"2021-10-08T19:21:25.612873+0000","last_became_peered":"2021-10-08T19:21:25.612873+0000","last_unstale":"2021-10-08T19:27:00.829918+0000","last_undegraded":"2021-10-08T19:27:00.829918+0000","last_fullsized":"2021-10-08T19:27:00.829918+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'15","last_scrub_stamp":"2021-10-08T19:24:14.482511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:24:14.482511+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012310702999999999,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":114,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.817509+0000","last_change":"2021-10-08T19:22:54.671364+0000","last_active":"2021-10-08T19:27:00.817509+0000","last_peered":"2021-10-08T19:27:00.817509+0000","last_clean":"2021-10-08T19:27:00.817509+0000","last_became_active":"2021-10-08T19:21:23.603422+0000","last_became_peered":"2021-10-08T19:21:23.603422+0000","last_unstale":"2021-10-08T19:27:00.817509+0000","last_undegraded":"2021-10-08T19:27:00.817509+0000","last_fullsized":"2021-10-08T19:27:00.817509+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:54.671289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:54.671289+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001752221,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":135,"reported_epoch":161,"state":"active+clean","last_fresh":"2021-10-08T19:27:04.876553+0000","last_change":"2021-10-08T19:24:25.091115+0000","last_active":"2021-10-08T19:27:04.876553+0000","last_peered":"2021-10-08T19:27:04.876553+0000","last_clean":"2021-10-08T19:27:04.876553+0000","last_became_active":"2021-10-08T19:24:25.090759+0000","last_became_peered":"2021-10-08T19:24:25.090759+0000","last_unstale":"2021-10-08T19:27:04.876553+0000","last_undegraded":"2021-10-08T19:27:04.876553+0000","last_fullsized":"2021-10-08T19:27:04.876553+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:39.931718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:39.931718+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0036493649999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":125,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-10-08T19:27:00.828386+0000","last_change":"2021-10-08T19:24:25.101949+0000","last_active":"2021-10-08T19:27:00.828386+0000","last_peered":"2021-10-08T19:27:00.828386+0000","last_clean":"2021-10-08T19:27:00.828386+0000","last_became_active":"2021-10-08T19:24:25.097417+0000","last_became_peered":"2021-10-08T19:24:25.097417+0000","last_unstale":"2021-10-08T19:27:00.828386+0000","last_undegraded":"2021-10-08T19:27:00.828386+0000","last_fullsized":"2021-10-08T19:27:00.828386+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:33.411753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:33.411753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0038057030000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":1132331032,"num_objects":17279,"num_object_clones":0,"num_object_copies":51837,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":8525,"num_objects_misplaced":1223,"num_objects_unfound":0,"num_objects_dirty":17279,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":166357,"num_write_kb":5876289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5532,"num_bytes_recovered":282263552,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4130418688,"data_stored":4130406472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76727,"ondisk_log_size":76727,"up":48,"acting":44,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":3,"acting":3,"num_store_stats":4},{"poolid":3,"num_pg":23,"stat_sum":{"num_bytes":681,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":280,"num_read_kb":276,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":584,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":69,"acting":69,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":9,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":694,"num_read_kb":451,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":139,"num_bytes_recovered":2134,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":406,"ondisk_log_size":406,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":96,"acting":96,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201353,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":372164,"kb_used_data":307132,"kb_used_omap":0,"kb_used_meta":65024,"kb_avail":93372988,"statfs":{"total":95995035648,"available":95613939712,"internally_reserved":0,"allocated":314503168,"data_stored":314074546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":66584576},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:26:25 2021","interfaces":[{"interface":"back","average":{"1min":2.0070000000000001,"5min":1.444,"15min":0.79400000000000004},"min":{"1min":0.253,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":5.5259999999999998,"5min":32.366999999999997,"15min":32.366999999999997},"last":1.794},{"interface":"front","average":{"1min":3.5569999999999999,"5min":1.677,"15min":0.873},"min":{"1min":0.249,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":18.308,"5min":29.736000000000001,"15min":29.736000000000001},"last":3.617}]},{"osd":1,"last update":"Fri Oct 8 19:26:25 2021","interfaces":[{"interface":"back","average":{"1min":4.2350000000000003,"5min":1.7869999999999999,"15min":0.92600000000000005},"min":{"1min":0.28100000000000003,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":25.079999999999998,"5min":25.079999999999998,"15min":25.079999999999998},"last":3.1600000000000001},{"interface":"front","average":{"1min":1.7270000000000001,"5min":0.97699999999999998,"15min":0.66600000000000004},"min":{"1min":0.33400000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":7.907,"5min":7.907,"15min":7.907},"last":0.377}]},{"osd":2,"last update":"Fri Oct 8 19:26:25 2021","interfaces":[{"interface":"back","average":{"1min":2.8809999999999998,"5min":1.7529999999999999,"15min":0.91100000000000003},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":8.3900000000000006,"5min":27.018000000000001,"15min":27.018000000000001},"last":1.9630000000000001},{"interface":"front","average":{"1min":3.25,"5min":1.665,"15min":0.873},"min":{"1min":0.28499999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":22.367000000000001,"5min":27.113,"15min":27.113},"last":2.1480000000000001}]},{"osd":3,"last update":"Fri Oct 8 19:26:25 2021","interfaces":[{"interface":"back","average":{"1min":4.2729999999999997,"5min":1.7230000000000001,"15min":0.90200000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":24.763000000000002,"5min":27.010000000000002,"15min":27.010000000000002},"last":2.1680000000000001},{"interface":"front","average":{"1min":1.617,"5min":1.544,"15min":0.85299999999999998},"min":{"1min":0.373,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":4.367,"5min":27.263999999999999,"15min":27.263999999999999},"last":2.121}]},{"osd":4,"last update":"Fri Oct 8 19:26:25 2021","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.59899999999999998,"15min":0.51500000000000001},"min":{"1min":0.26100000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":3.5089999999999999,"5min":4.7990000000000004,"15min":4.7990000000000004},"last":1.849},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.56999999999999995,"15min":0.48899999999999999},"min":{"1min":0.32200000000000001,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":2.3090000000000002,"5min":4.0830000000000002,"15min":4.0830000000000002},"last":2.1840000000000002}]},{"osd":5,"last update":"Fri Oct 8 19:26:25 2021","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":0.67200000000000004,"15min":0.54100000000000004},"min":{"1min":0.28699999999999998,"5min":0.251,"15min":0.251},"max":{"1min":3.6059999999999999,"5min":4.649,"15min":4.649},"last":1.8979999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.56699999999999995,"15min":0.53000000000000003},"min":{"1min":0.33100000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":2.2650000000000001,"5min":4.5259999999999998,"15min":4.5259999999999998},"last":2.2069999999999999}]},{"osd":6,"last update":"Fri Oct 8 19:26:25 2021","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.64900000000000002,"15min":0.55400000000000005},"min":{"1min":0.34999999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":3.593,"5min":3.593,"15min":3.593},"last":0.40500000000000003},{"interface":"front","average":{"1min":1.0469999999999999,"5min":0.73899999999999999,"15min":0.623},"min":{"1min":0.34999999999999998,"5min":0.318,"15min":0.318},"max":{"1min":3.6640000000000001,"5min":4.7750000000000004,"15min":4.7750000000000004},"last":1.821}]}]},{"osd":6,"up_from":47,"seq":201863462989,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":375024,"kb_used_data":290792,"kb_used_omap":0,"kb_used_meta":84224,"kb_avail":93370128,"statfs":{"total":95995035648,"available":95611011072,"internally_reserved":0,"allocated":297771008,"data_stored":297361367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":86245376},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:27:06 2021","interfaces":[{"interface":"back","average":{"1min":3.133,"5min":1.4490000000000001,"15min":0.79500000000000004},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":21.783999999999999,"5min":21.783999999999999,"15min":21.783999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":3.2730000000000001,"5min":1.6180000000000001,"15min":0.87},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":19.823,"5min":19.823,"15min":19.823},"last":1.51}]},{"osd":1,"last update":"Fri Oct 8 19:27:06 2021","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.153,"15min":0.72199999999999998},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":6.1059999999999999,"5min":14.878,"15min":14.878},"last":0.40100000000000002},{"interface":"front","average":{"1min":1.198,"5min":1.1830000000000001,"15min":0.72399999999999998},"min":{"1min":0.29999999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":4.7539999999999996,"5min":14.779,"15min":14.779},"last":0.318}]},{"osd":2,"last update":"Fri Oct 8 19:27:06 2021","interfaces":[{"interface":"back","average":{"1min":2.2490000000000001,"5min":1.681,"15min":0.90900000000000003},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":10.590999999999999,"5min":19.084,"15min":19.084},"last":2.762},{"interface":"front","average":{"1min":2.0640000000000001,"5min":1.6910000000000001,"15min":0.89100000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":7.2539999999999996,"5min":16.670999999999999,"15min":16.670999999999999},"last":5.4420000000000002}]},{"osd":3,"last update":"Fri Oct 8 19:27:06 2021","interfaces":[{"interface":"back","average":{"1min":4.0110000000000001,"5min":1.772,"15min":0.91800000000000004},"min":{"1min":0.34300000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":21.670000000000002,"5min":21.670000000000002,"15min":21.670000000000002},"last":0.71099999999999997},{"interface":"front","average":{"1min":2.8010000000000002,"5min":1.506,"15min":0.83599999999999997},"min":{"1min":0.29599999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":22.254999999999999,"5min":22.254999999999999,"15min":22.254999999999999},"last":0.65700000000000003}]},{"osd":4,"last update":"Fri Oct 8 19:27:06 2021","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.51400000000000001,"15min":0.44600000000000001},"min":{"1min":0.28299999999999997,"5min":0.255,"15min":0.255},"max":{"1min":2.7469999999999999,"5min":2.7469999999999999,"15min":2.7469999999999999},"last":2.7469999999999999},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.61099999999999999,"15min":0.503},"min":{"1min":0.27000000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":6.1719999999999997,"5min":6.1719999999999997,"15min":6.1719999999999997},"last":0.433}]},{"osd":5,"last update":"Fri Oct 8 19:27:06 2021","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.58799999999999997,"15min":0.5},"min":{"1min":0.29499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.552,"5min":6.7949999999999999,"15min":6.7949999999999999},"last":1.552},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.63400000000000001,"15min":0.52400000000000002},"min":{"1min":0.29799999999999999,"5min":0.252,"15min":0.252},"max":{"1min":6.1479999999999997,"5min":6.1479999999999997,"15min":6.1479999999999997},"last":2.7749999999999999}]},{"osd":7,"last update":"Fri Oct 8 19:26:25 2021","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.59099999999999997,"15min":0.52700000000000002},"min":{"1min":0.32800000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":3.4300000000000002,"5min":3.4300000000000002,"15min":3.4300000000000002},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.64200000000000002,"15min":0.57599999999999996},"min":{"1min":0.36099999999999999,"5min":0.313,"15min":0.313},"max":{"1min":3.6379999999999999,"5min":3.6379999999999999,"15min":3.6379999999999999},"last":1.581}]}]},{"osd":1,"up_from":13,"seq":55834574943,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":908092,"kb_used_data":818932,"kb_used_omap":0,"kb_used_meta":89152,"kb_avail":92837060,"statfs":{"total":95995035648,"available":95065149440,"internally_reserved":0,"allocated":838586368,"data_stored":838150411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":91291648},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:26:35 2021","interfaces":[{"interface":"back","average":{"1min":2.9780000000000002,"5min":3.2549999999999999,"15min":1.3049999999999999},"min":{"1min":0.34000000000000002,"5min":0.184,"15min":0.184},"max":{"1min":6.5940000000000003,"5min":98.734999999999999,"15min":98.734999999999999},"last":9.2940000000000005},{"interface":"front","average":{"1min":5.7359999999999998,"5min":3.774,"15min":1.4990000000000001},"min":{"1min":0.35399999999999998,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":16.402999999999999,"5min":98.843999999999994,"15min":98.843999999999994},"last":15.890000000000001}]},{"osd":2,"last update":"Fri Oct 8 19:25:59 2021","interfaces":[{"interface":"back","average":{"1min":4.9500000000000002,"5min":2.4649999999999999,"15min":1.0880000000000001},"min":{"1min":0.28499999999999998,"5min":0.22,"15min":0.22},"max":{"1min":16.138000000000002,"5min":35.124000000000002,"15min":35.124000000000002},"last":9.2629999999999999},{"interface":"front","average":{"1min":3.742,"5min":2.0680000000000001,"15min":0.97099999999999997},"min":{"1min":0.27700000000000002,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":13.295,"5min":35.283000000000001,"15min":35.283000000000001},"last":15.847}]},{"osd":3,"last update":"Fri Oct 8 19:26:14 2021","interfaces":[{"interface":"back","average":{"1min":4.4340000000000002,"5min":2.4529999999999998,"15min":1.1319999999999999},"min":{"1min":0.53500000000000003,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":9.2870000000000008,"5min":34.575000000000003,"15min":34.575000000000003},"last":2.4300000000000002},{"interface":"front","average":{"1min":3.5899999999999999,"5min":2.226,"15min":1.05},"min":{"1min":0.35799999999999998,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":15.35,"5min":35.091000000000001,"15min":35.091000000000001},"last":3.895}]},{"osd":4,"last update":"Fri Oct 8 19:26:26 2021","interfaces":[{"interface":"back","average":{"1min":2.407,"5min":1.786,"15min":0.93799999999999994},"min":{"1min":0.39900000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":7.0839999999999996,"5min":16.872,"15min":16.872},"last":5.2300000000000004},{"interface":"front","average":{"1min":2.0270000000000001,"5min":1.139,"15min":0.73899999999999999},"min":{"1min":0.34799999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":6.117,"5min":7.3460000000000001,"15min":7.3460000000000001},"last":3.9430000000000001}]},{"osd":5,"last update":"Fri Oct 8 19:26:51 2021","interfaces":[{"interface":"back","average":{"1min":4.0529999999999999,"5min":1.7150000000000001,"15min":0.94799999999999995},"min":{"1min":0.40400000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":13.692,"5min":13.692,"15min":13.692},"last":1.954},{"interface":"front","average":{"1min":2.403,"5min":1.2769999999999999,"15min":0.79800000000000004},"min":{"1min":0.375,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":6.8520000000000003,"5min":7.3719999999999999,"15min":7.3719999999999999},"last":3.9670000000000001}]},{"osd":6,"last update":"Fri Oct 8 19:26:08 2021","interfaces":[{"interface":"back","average":{"1min":3.9660000000000002,"5min":1.7150000000000001,"15min":0.93100000000000005},"min":{"1min":0.61699999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":15.523,"5min":16.815999999999999,"15min":16.815999999999999},"last":5.258},{"interface":"front","average":{"1min":3.141,"5min":1.3129999999999999,"15min":0.88700000000000001},"min":{"1min":0.375,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":9.2859999999999996,"5min":9.2859999999999996,"15min":9.2859999999999996},"last":1.984}]},{"osd":7,"last update":"Fri Oct 8 19:26:26 2021","interfaces":[{"interface":"back","average":{"1min":3.581,"5min":1.732,"15min":0.95599999999999996},"min":{"1min":0.42999999999999999,"5min":0.312,"15min":0.312},"max":{"1min":23.721,"5min":23.721,"15min":23.721},"last":2.0030000000000001},{"interface":"front","average":{"1min":2.1190000000000002,"5min":1.1799999999999999,"15min":0.77700000000000002},"min":{"1min":0.42999999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":5.5599999999999996,"5min":7.4000000000000004,"15min":7.4000000000000004},"last":3.9969999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738466,"num_pgs":62,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":671212,"kb_used_data":578788,"kb_used_omap":0,"kb_used_meta":92288,"kb_avail":93073940,"statfs":{"total":95995035648,"available":95307714560,"internally_reserved":0,"allocated":592678912,"data_stored":592259632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":94502912},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 8 19:26:40 2021","interfaces":[{"interface":"back","average":{"1min":2.827,"5min":1.607,"15min":0.75700000000000001},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":10.547000000000001,"5min":10.547000000000001,"15min":10.547000000000001},"last":2.2650000000000001},{"interface":"front","average":{"1min":4.4800000000000004,"5min":2.1139999999999999,"15min":0.95399999999999996},"min":{"1min":0.29499999999999998,"5min":0.217,"15min":0.217},"max":{"1min":14.380000000000001,"5min":14.380000000000001,"15min":14.380000000000001},"last":2.3069999999999999}]},{"osd":2,"last update":"Fri Oct 8 19:27:03 2021","interfaces":[{"interface":"back","average":{"1min":5.3220000000000001,"5min":3.1120000000000001,"15min":1.3029999999999999},"min":{"1min":0.30099999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":14.307,"5min":62.390000000000001,"15min":62.390000000000001},"last":0.30099999999999999},{"interface":"front","average":{"1min":3.0499999999999998,"5min":2.7610000000000001,"15min":1.1870000000000001},"min":{"1min":0.30399999999999999,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":9.3849999999999998,"5min":62.718000000000004,"15min":62.718000000000004},"last":1.2929999999999999}]},{"osd":3,"last update":"Fri Oct 8 19:26:11 2021","interfaces":[{"interface":"back","average":{"1min":3.641,"5min":2.133,"15min":1.0429999999999999},"min":{"1min":0.36499999999999999,"5min":0.246,"15min":0.246},"max":{"1min":11.643000000000001,"5min":62.491,"15min":62.491},"last":2.0419999999999998},{"interface":"front","average":{"1min":3.1859999999999999,"5min":2.2519999999999998,"15min":1.0600000000000001},"min":{"1min":0.28399999999999997,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":10.199,"5min":62.673000000000002,"15min":62.673000000000002},"last":0.50700000000000001}]},{"osd":4,"last update":"Fri Oct 8 19:26:29 2021","interfaces":[{"interface":"back","average":{"1min":2.3849999999999998,"5min":1.4299999999999999,"15min":0.83999999999999997},"min":{"1min":0.29099999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":6.3040000000000003,"5min":10.444000000000001,"15min":10.444000000000001},"last":1.9379999999999999},{"interface":"front","average":{"1min":2.6709999999999998,"5min":1.478,"15min":0.88100000000000001},"min":{"1min":0.41099999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":10.505000000000001,"5min":11.294,"15min":11.294},"last":1.9510000000000001}]},{"osd":5,"last update":"Fri Oct 8 19:26:48 2021","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":1.3160000000000001,"15min":0.80800000000000005},"min":{"1min":0.33300000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":4.1109999999999998,"5min":15.56,"15min":15.56},"last":0.53900000000000003},{"interface":"front","average":{"1min":3.3769999999999998,"5min":1.7430000000000001,"15min":0.96099999999999997},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":9.9649999999999999,"5min":15.484999999999999,"15min":15.484999999999999},"last":2.1459999999999999}]},{"osd":6,"last update":"Fri Oct 8 19:26:05 2021","interfaces":[{"interface":"back","average":{"1min":2.5950000000000002,"5min":1.3149999999999999,"15min":0.82299999999999995},"min":{"1min":0.44800000000000001,"5min":0.377,"15min":0.377},"max":{"1min":11.118,"5min":11.231999999999999,"15min":11.231999999999999},"last":2.0110000000000001},{"interface":"front","average":{"1min":2.988,"5min":1.4079999999999999,"15min":0.84999999999999998},"min":{"1min":0.45700000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":7.3890000000000002,"5min":10.519,"15min":10.519},"last":0.56599999999999995}]},{"osd":7,"last update":"Fri Oct 8 19:26:22 2021","interfaces":[{"interface":"back","average":{"1min":2.7679999999999998,"5min":1.4339999999999999,"15min":0.85099999999999998},"min":{"1min":0.55700000000000005,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":10.006,"5min":10.006,"15min":10.006},"last":2.1789999999999998},{"interface":"front","average":{"1min":3.5750000000000002,"5min":1.8200000000000001,"15min":0.98999999999999999},"min":{"1min":0.47699999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":10.646000000000001,"5min":11.271000000000001,"15min":11.271000000000001},"last":1.988}]}]},{"osd":2,"up_from":18,"seq":77309411418,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":791380,"kb_used_data":712972,"kb_used_omap":0,"kb_used_meta":78400,"kb_avail":92953772,"statfs":{"total":95995035648,"available":95184662528,"internally_reserved":0,"allocated":730083328,"data_stored":729687673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":80281600},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:26:53 2021","interfaces":[{"interface":"back","average":{"1min":4.0800000000000001,"5min":3.137,"15min":1.2769999999999999},"min":{"1min":0.255,"5min":0.193,"15min":0.17699999999999999},"max":{"1min":14.430999999999999,"5min":61.670999999999999,"15min":61.670999999999999},"last":3.7629999999999999},{"interface":"front","average":{"1min":4.3899999999999997,"5min":3.1070000000000002,"15min":1.276},"min":{"1min":0.40799999999999997,"5min":0.189,"15min":0.189},"max":{"1min":13.532,"5min":65.284999999999997,"15min":65.284999999999997},"last":7.8920000000000003}]},{"osd":1,"last update":"Fri Oct 8 19:26:53 2021","interfaces":[{"interface":"back","average":{"1min":2.786,"5min":2.4049999999999998,"15min":1.0449999999999999},"min":{"1min":0.20999999999999999,"5min":0.192,"15min":0.192},"max":{"1min":8.0980000000000008,"5min":31.303999999999998,"15min":31.303999999999998},"last":3.2730000000000001},{"interface":"front","average":{"1min":4.7190000000000003,"5min":3.085,"15min":1.2889999999999999},"min":{"1min":0.25700000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":12.858000000000001,"5min":31.696999999999999,"15min":31.696999999999999},"last":0.27400000000000002}]},{"osd":3,"last update":"Fri Oct 8 19:26:08 2021","interfaces":[{"interface":"back","average":{"1min":7.399,"5min":2.4780000000000002,"15min":1.1279999999999999},"min":{"1min":0.42899999999999999,"5min":0.218,"15min":0.218},"max":{"1min":65.322999999999993,"5min":65.322999999999993,"15min":65.322999999999993},"last":3.1840000000000002},{"interface":"front","average":{"1min":6.1529999999999996,"5min":2.3039999999999998,"15min":1.048},"min":{"1min":0.33800000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":61.143000000000001,"5min":61.143000000000001,"15min":61.143000000000001},"last":3.8180000000000001}]},{"osd":4,"last update":"Fri Oct 8 19:26:25 2021","interfaces":[{"interface":"back","average":{"1min":2.0790000000000002,"5min":1.353,"15min":0.82099999999999995},"min":{"1min":0.29099999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":7.3419999999999996,"5min":8.0329999999999995,"15min":8.0329999999999995},"last":3.7410000000000001},{"interface":"front","average":{"1min":1.6539999999999999,"5min":1.6160000000000001,"15min":0.92500000000000004},"min":{"1min":0.33300000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":8.6750000000000007,"5min":15.143000000000001,"15min":15.143000000000001},"last":0.30299999999999999}]},{"osd":5,"last update":"Fri Oct 8 19:26:49 2021","interfaces":[{"interface":"back","average":{"1min":2.387,"5min":1.845,"15min":1.0009999999999999},"min":{"1min":0.39500000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":10.58,"5min":15.087999999999999,"15min":15.087999999999999},"last":0.32500000000000001},{"interface":"front","average":{"1min":1.9950000000000001,"5min":1.4470000000000001,"15min":0.873},"min":{"1min":0.38,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":6.976,"5min":14.558,"15min":14.558},"last":3.2370000000000001}]},{"osd":6,"last update":"Fri Oct 8 19:26:08 2021","interfaces":[{"interface":"back","average":{"1min":2.331,"5min":1.3360000000000001,"15min":0.82399999999999995},"min":{"1min":0.33100000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":7.0970000000000004,"5min":8.0050000000000008,"15min":8.0050000000000008},"last":3.8809999999999998},{"interface":"front","average":{"1min":3.2130000000000001,"5min":1.4390000000000001,"15min":0.873},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":12.673999999999999,"5min":12.673999999999999,"15min":12.673999999999999},"last":0.41899999999999998}]},{"osd":7,"last update":"Fri Oct 8 19:26:25 2021","interfaces":[{"interface":"back","average":{"1min":2.2869999999999999,"5min":1.5580000000000001,"15min":0.89800000000000002},"min":{"1min":0.38600000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":8.6799999999999997,"5min":9.3960000000000008,"15min":9.3960000000000008},"last":3.8519999999999999},{"interface":"front","average":{"1min":2.1949999999999998,"5min":1.407,"15min":0.872},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":9.4009999999999998,"5min":12.709,"15min":12.709},"last":0.44}]}]},{"osd":3,"up_from":24,"seq":103079215192,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":961588,"kb_used_data":849708,"kb_used_omap":0,"kb_used_meta":111744,"kb_avail":92783564,"statfs":{"total":95995035648,"available":95010369536,"internally_reserved":0,"allocated":870100992,"data_stored":869673469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":114425856},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:26:14 2021","interfaces":[{"interface":"back","average":{"1min":3.7229999999999999,"5min":2.8170000000000002,"15min":1.1739999999999999},"min":{"1min":0.17000000000000001,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":13.821,"5min":109.601,"15min":109.601},"last":0.22700000000000001},{"interface":"front","average":{"1min":4.3920000000000003,"5min":3.1379999999999999,"15min":1.3160000000000001},"min":{"1min":0.435,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":10.151,"5min":107.84,"15min":107.84},"last":5.8079999999999998}]},{"osd":1,"last update":"Fri Oct 8 19:26:14 2021","interfaces":[{"interface":"back","average":{"1min":3.7810000000000001,"5min":1.784,"15min":0.86899999999999999},"min":{"1min":0.33800000000000002,"5min":0.219,"15min":0.219},"max":{"1min":17.071999999999999,"5min":17.071999999999999,"15min":17.071999999999999},"last":11.702},{"interface":"front","average":{"1min":3.3839999999999999,"5min":1.6839999999999999,"15min":0.83799999999999997},"min":{"1min":0.32100000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":11.840999999999999,"5min":13.372999999999999,"15min":13.372999999999999},"last":1.1739999999999999}]},{"osd":2,"last update":"Fri Oct 8 19:26:14 2021","interfaces":[{"interface":"back","average":{"1min":4.0750000000000002,"5min":1.8540000000000001,"15min":0.91200000000000003},"min":{"1min":0.33400000000000002,"5min":0.246,"15min":0.246},"max":{"1min":11.858000000000001,"5min":13.333,"15min":13.333},"last":1.411},{"interface":"front","average":{"1min":3.2069999999999999,"5min":1.7,"15min":0.85299999999999998},"min":{"1min":0.50800000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":8.8059999999999992,"5min":14.898999999999999,"15min":14.898999999999999},"last":0.73999999999999999}]},{"osd":4,"last update":"Fri Oct 8 19:26:30 2021","interfaces":[{"interface":"back","average":{"1min":4.0179999999999998,"5min":1.6299999999999999,"15min":0.93400000000000005},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":18.064,"5min":18.064,"15min":18.064},"last":0.438},{"interface":"front","average":{"1min":1.7010000000000001,"5min":1.385,"15min":1.0009999999999999},"min":{"1min":0.378,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":7.4489999999999998,"5min":8.8680000000000003,"15min":8.8680000000000003},"last":5.75}]},{"osd":5,"last update":"Fri Oct 8 19:26:48 2021","interfaces":[{"interface":"back","average":{"1min":2.3180000000000001,"5min":1.5860000000000001,"15min":0.92200000000000004},"min":{"1min":0.32700000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":6.7409999999999997,"5min":13.186,"15min":13.186},"last":1.272},{"interface":"front","average":{"1min":3.4279999999999999,"5min":1.589,"15min":1.014},"min":{"1min":0.36499999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":8.0559999999999992,"5min":10.285,"15min":10.285},"last":0.46800000000000003}]},{"osd":6,"last update":"Fri Oct 8 19:26:06 2021","interfaces":[{"interface":"back","average":{"1min":3.2309999999999999,"5min":1.7829999999999999,"15min":1.7689999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":8.8130000000000006,"5min":21.538,"15min":21.538},"last":5.7130000000000001},{"interface":"front","average":{"1min":2.508,"5min":1.405,"15min":0.84599999999999997},"min":{"1min":0.40500000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":11.728999999999999,"5min":13.298,"15min":13.298},"last":1.254}]},{"osd":7,"last update":"Fri Oct 8 19:26:30 2021","interfaces":[{"interface":"back","average":{"1min":1.73,"5min":1.3660000000000001,"15min":0.85799999999999998},"min":{"1min":0.36899999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":7.4260000000000002,"5min":8.8350000000000009,"15min":8.8350000000000009},"last":5.7859999999999996},{"interface":"front","average":{"1min":1.9730000000000001,"5min":1.4650000000000001,"15min":0.90300000000000002},"min":{"1min":0.40500000000000003,"5min":0.376,"15min":0.376},"max":{"1min":6.2469999999999999,"5min":13.225,"15min":13.225},"last":1.234}]}]},{"osd":4,"up_from":30,"seq":128849018965,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":365192,"kb_used_data":299136,"kb_used_omap":0,"kb_used_meta":66048,"kb_avail":93379960,"statfs":{"total":95995035648,"available":95621079040,"internally_reserved":0,"allocated":306315264,"data_stored":305881866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":67633152},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:26:29 2021","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.752,"15min":0.93600000000000005},"min":{"1min":0.25900000000000001,"5min":0.25,"15min":0.25},"max":{"1min":4.8390000000000004,"5min":59.223999999999997,"15min":59.223999999999997},"last":4.5439999999999996},{"interface":"front","average":{"1min":2.2210000000000001,"5min":1.6830000000000001,"15min":0.91100000000000003},"min":{"1min":0.23899999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":10.052,"5min":58.667999999999999,"15min":58.667999999999999},"last":0.82299999999999995}]},{"osd":1,"last update":"Fri Oct 8 19:26:29 2021","interfaces":[{"interface":"back","average":{"1min":2.2799999999999998,"5min":1.415,"15min":0.81899999999999995},"min":{"1min":0.26500000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":9.5109999999999992,"5min":10.039,"15min":10.039},"last":5.0049999999999999},{"interface":"front","average":{"1min":1.716,"5min":1.01,"15min":0.67600000000000005},"min":{"1min":0.249,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":6.7000000000000002,"5min":6.7000000000000002,"15min":6.7000000000000002},"last":1.0189999999999999}]},{"osd":2,"last update":"Fri Oct 8 19:26:29 2021","interfaces":[{"interface":"back","average":{"1min":2.21,"5min":1.2390000000000001,"15min":0.75900000000000001},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":9.1140000000000008,"5min":9.1140000000000008,"15min":9.1140000000000008},"last":4.8860000000000001},{"interface":"front","average":{"1min":1.925,"5min":1.264,"15min":0.78000000000000003},"min":{"1min":0.314,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":6.2930000000000001,"5min":9.7309999999999999,"15min":9.7309999999999999},"last":1.0629999999999999}]},{"osd":3,"last update":"Fri Oct 8 19:26:29 2021","interfaces":[{"interface":"back","average":{"1min":3.669,"5min":2.2370000000000001,"15min":1.0940000000000001},"min":{"1min":0.33200000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":34.511000000000003,"5min":58.506999999999998,"15min":58.506999999999998},"last":0.80000000000000004},{"interface":"front","average":{"1min":1.8380000000000001,"5min":1.7350000000000001,"15min":0.93100000000000005},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":4.9260000000000002,"5min":58.521000000000001,"15min":58.521000000000001},"last":0.86899999999999999}]},{"osd":5,"last update":"Fri Oct 8 19:26:51 2021","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.59599999999999997,"15min":0.44800000000000001},"min":{"1min":0.27800000000000002,"5min":0.23899999999999999,"15min":0.222},"max":{"1min":4.7359999999999998,"5min":4.7359999999999998,"15min":4.7359999999999998},"last":0.308},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.54400000000000004,"15min":0.437},"min":{"1min":0.30099999999999999,"5min":0.245,"15min":0.245},"max":{"1min":1.6870000000000001,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":0.66400000000000003}]},{"osd":6,"last update":"Fri Oct 8 19:27:05 2021","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.65300000000000002,"15min":0.48499999999999999},"min":{"1min":0.26400000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":1.702,"5min":5.0460000000000003,"15min":5.0460000000000003},"last":0.64800000000000002},{"interface":"front","average":{"1min":1.2250000000000001,"5min":0.73099999999999998,"15min":0.52300000000000002},"min":{"1min":0.32800000000000001,"5min":0.30499999999999999,"15min":0.26100000000000001},"max":{"1min":4.8899999999999997,"5min":4.8899999999999997,"15min":4.8899999999999997},"last":4.1470000000000002}]},{"osd":7,"last update":"Fri Oct 8 19:26:24 2021","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.55000000000000004,"15min":0.50600000000000001},"min":{"1min":0.33300000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.88200000000000001,"5min":3.0379999999999998,"15min":3.0379999999999998},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.874,"5min":0.73599999999999999,"15min":0.57199999999999995},"min":{"1min":0.35099999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":3.4689999999999999,"5min":5.0209999999999999,"15min":5.0209999999999999},"last":4.5860000000000003}]}]},{"osd":5,"up_from":38,"seq":163208757327,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":301304,"kb_used_data":236528,"kb_used_omap":0,"kb_used_meta":64768,"kb_avail":93443848,"statfs":{"total":95995035648,"available":95686500352,"internally_reserved":0,"allocated":242204672,"data_stored":241787592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":66322432},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:26:47 2021","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.306,"15min":0.749},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":3.5390000000000001,"5min":22.966999999999999,"15min":22.966999999999999},"last":0.26600000000000001},{"interface":"front","average":{"1min":1.6599999999999999,"5min":1.038,"15min":0.65800000000000003},"min":{"1min":0.26400000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":4.8579999999999997,"5min":4.8579999999999997,"15min":4.8579999999999997},"last":0.251}]},{"osd":1,"last update":"Fri Oct 8 19:26:47 2021","interfaces":[{"interface":"back","average":{"1min":1.5760000000000001,"5min":1.1259999999999999,"15min":0.70999999999999996},"min":{"1min":0.26900000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":6.0800000000000001,"5min":8.9299999999999997,"15min":8.9299999999999997},"last":5.1390000000000002},{"interface":"front","average":{"1min":1.6180000000000001,"5min":1.1659999999999999,"15min":0.72899999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.25900000000000001},"max":{"1min":6.0700000000000003,"5min":8.9199999999999999,"15min":8.9199999999999999},"last":5.1269999999999998}]},{"osd":2,"last update":"Fri Oct 8 19:26:47 2021","interfaces":[{"interface":"back","average":{"1min":2.4020000000000001,"5min":1.929,"15min":0.95299999999999996},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":11.138999999999999,"5min":29.398,"15min":29.398},"last":0.34399999999999997},{"interface":"front","average":{"1min":1.893,"5min":2.0430000000000001,"15min":1.014},"min":{"1min":0.374,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":6.1790000000000003,"5min":29.387,"15min":29.387},"last":0.41699999999999998}]},{"osd":3,"last update":"Fri Oct 8 19:26:47 2021","interfaces":[{"interface":"back","average":{"1min":1.9359999999999999,"5min":1.474,"15min":0.81799999999999995},"min":{"1min":0.34399999999999997,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":9.6199999999999992,"5min":9.6199999999999992,"15min":9.6199999999999992},"last":6.2530000000000001},{"interface":"front","average":{"1min":3.125,"5min":1.488,"15min":0.82499999999999996},"min":{"1min":0.35999999999999999,"5min":0.313,"15min":0.313},"max":{"1min":21.504000000000001,"5min":21.504000000000001,"15min":21.504000000000001},"last":7.2640000000000002}]},{"osd":4,"last update":"Fri Oct 8 19:26:47 2021","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.61299999999999999,"15min":0.47599999999999998},"min":{"1min":0.27400000000000002,"5min":0.249,"15min":0.224},"max":{"1min":5.0780000000000003,"5min":5.0780000000000003,"15min":5.0780000000000003},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.63700000000000001,"15min":0.498},"min":{"1min":0.32200000000000001,"5min":0.28299999999999997,"15min":0.23799999999999999},"max":{"1min":3.9540000000000002,"5min":3.9540000000000002,"15min":3.9540000000000002},"last":0.32100000000000001}]},{"osd":6,"last update":"Fri Oct 8 19:27:06 2021","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.77100000000000002,"15min":0.55500000000000005},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":3.774,"5min":7.266,"15min":7.266},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.68000000000000005,"15min":0.55900000000000005},"min":{"1min":0.35499999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":2.9319999999999999,"5min":5.1580000000000004,"15min":5.1580000000000004},"last":0.374}]},{"osd":7,"last update":"Fri Oct 8 19:26:28 2021","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.63,"15min":0.54800000000000004},"min":{"1min":0.33600000000000002,"5min":0.309,"15min":0.309},"max":{"1min":3.899,"5min":3.899,"15min":3.899},"last":0.40400000000000003},{"interface":"front","average":{"1min":1.1539999999999999,"5min":0.70699999999999996,"15min":0.62},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":5.0279999999999996,"5min":5.0279999999999996,"15min":5.0279999999999996},"last":1.4690000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":2008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":581832704,"data_stored":581828632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":836308992,"data_stored":836304920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":717422592,"data_stored":717422592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":867368960,"data_stored":867368960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":298713088,"data_stored":298713088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":236584960,"data_stored":236584960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":294326272,"data_stored":294322200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":297861120,"data_stored":297861120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-10-08T19:27:10.999 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2021-10-08T19:27:11.000 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd pool set .mgr pg_num 11 2021-10-08T19:27:11.001 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:11.002 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:27:11.103 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:27:11.148 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:27:11.166 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:10 smithi097 ceph-mon[32687]: Health check update: Degraded data redundancy: 8534/52422 objects degraded (16.279%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:27:11.167 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:10 smithi097 ceph-mon[32687]: osdmap e163: 8 total, 8 up, 8 in 2021-10-08T19:27:11.167 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:10 smithi097 ceph-mon[41966]: Health check update: Degraded data redundancy: 8534/52422 objects degraded (16.279%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:27:11.167 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:10 smithi097 ceph-mon[41966]: osdmap e163: 8 total, 8 up, 8 in 2021-10-08T19:27:11.174 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:11.329 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:27:11.340 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:11.341 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:27:11.378 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:27:11.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:10 smithi117 ceph-mon[34585]: Health check update: Degraded data redundancy: 8534/52422 objects degraded (16.279%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:27:11.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:10 smithi117 ceph-mon[34585]: osdmap e163: 8 total, 8 up, 8 in 2021-10-08T19:27:11.432 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:27:11.443 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:27:11.457 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:27:11.468 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:11.510 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:27:11.521 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:27:11.523 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:11.524 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:27:11.553 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:27:11.591 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:27:11.600 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:27:11.600 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2021-10-08T19:27:11.601 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2021-10-08T19:27:11.601 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2021-10-08T19:27:11.601 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:27:11.625 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:27:11.625 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:27:11.666 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:27:11.671 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true' 2021-10-08T19:27:11.671 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true' 2021-10-08T19:27:11.672 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true' 2021-10-08T19:27:11.672 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true' 2021-10-08T19:27:11.672 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true' 2021-10-08T19:27:11.672 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true' 2021-10-08T19:27:11.672 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'true' 2021-10-08T19:27:11.673 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'true' 2021-10-08T19:27:11.708 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:12.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:11 smithi097 ceph-mon[41966]: pgmap v257: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 901 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 587 op/s; 8476/43824 objects degraded (19.341%); 1165/43824 objects misplaced (2.658%); 0 B/s, 28 objects/s recovering 2021-10-08T19:27:12.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:11 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3332044301' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:27:12.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:11 smithi097 ceph-mon[32687]: pgmap v257: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 901 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 587 op/s; 8476/43824 objects degraded (19.341%); 1165/43824 objects misplaced (2.658%); 0 B/s, 28 objects/s recovering 2021-10-08T19:27:12.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:11 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3332044301' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:27:12.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:11 smithi117 ceph-mon[34585]: pgmap v257: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 901 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 587 op/s; 8476/43824 objects degraded (19.341%); 1165/43824 objects misplaced (2.658%); 0 B/s, 28 objects/s recovering 2021-10-08T19:27:12.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:11 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3332044301' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:27:12.970 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:27:12 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:27:12] "GET /metrics HTTP/1.1" 200 155785 "" "Prometheus/2.18.1" 2021-10-08T19:27:13.256 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:27:13.261 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:13.262 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:27:13.363 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:27:13.419 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2021-10-08T19:27:13.464 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:14.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:27:13 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:27:13] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:27:14.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:13 smithi117 ceph-mon[34585]: pgmap v258: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 901 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 666 B/s rd, 0 B/s wr, 459 op/s; 8476/43824 objects degraded (19.341%); 1165/43824 objects misplaced (2.658%); 0 B/s, 22 objects/s recovering 2021-10-08T19:27:14.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:13 smithi097 ceph-mon[32687]: pgmap v258: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 901 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 666 B/s rd, 0 B/s wr, 459 op/s; 8476/43824 objects degraded (19.341%); 1165/43824 objects misplaced (2.658%); 0 B/s, 22 objects/s recovering 2021-10-08T19:27:14.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:13 smithi097 ceph-mon[41966]: pgmap v258: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 901 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 666 B/s rd, 0 B/s wr, 459 op/s; 8476/43824 objects degraded (19.341%); 1165/43824 objects misplaced (2.658%); 0 B/s, 22 objects/s recovering 2021-10-08T19:27:14.256 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:27:14.263 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:14.263 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:27:14.267 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:27:14.365 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:27:14.375 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:27:14.393 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:14.456 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:27:14.461 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:14.462 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:27:14.564 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:27:14.625 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:14.967 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:27:14.969 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:14.970 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:27:15.071 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:27:15.099 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:15.150 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:27:15.156 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:15.156 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:27:15.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:14 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:27:15.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:14 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:27:15.225 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:14 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:27:15.225 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:14 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:27:15.258 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:27:15.341 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:15.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:14 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:27:15.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:14 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:27:15.974 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2021-10-08T19:27:16.404 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:15 smithi117 ceph-mon[34585]: pgmap v259: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 679 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 785 op/s; 8359/33165 objects degraded (25.204%); 1106/33165 objects misplaced (3.335%); 0 B/s, 38 objects/s recovering 2021-10-08T19:27:16.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:15 smithi117 ceph-mon[34585]: osdmap e164: 8 total, 8 up, 8 in 2021-10-08T19:27:16.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:15 smithi117 ceph-mon[34585]: Health check update: Degraded data redundancy: 8359/33165 objects degraded (25.204%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:27:16.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:15 smithi117 ceph-mon[34585]: osdmap e165: 8 total, 8 up, 8 in 2021-10-08T19:27:16.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:15 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:27:16.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:15 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:27:16.407 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:27:16.415 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:16.416 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:15 smithi097 ceph-mon[41966]: pgmap v259: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 679 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 785 op/s; 8359/33165 objects degraded (25.204%); 1106/33165 objects misplaced (3.335%); 0 B/s, 38 objects/s recovering 2021-10-08T19:27:16.417 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:15 smithi097 ceph-mon[41966]: osdmap e164: 8 total, 8 up, 8 in 2021-10-08T19:27:16.417 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:15 smithi097 ceph-mon[41966]: Health check update: Degraded data redundancy: 8359/33165 objects degraded (25.204%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:27:16.418 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:15 smithi097 ceph-mon[41966]: osdmap e165: 8 total, 8 up, 8 in 2021-10-08T19:27:16.418 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:15 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:27:16.419 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:15 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:27:16.420 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:27:16.421 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:15 smithi097 ceph-mon[32687]: pgmap v259: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 679 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 785 op/s; 8359/33165 objects degraded (25.204%); 1106/33165 objects misplaced (3.335%); 0 B/s, 38 objects/s recovering 2021-10-08T19:27:16.421 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:15 smithi097 ceph-mon[32687]: osdmap e164: 8 total, 8 up, 8 in 2021-10-08T19:27:16.422 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:15 smithi097 ceph-mon[32687]: Health check update: Degraded data redundancy: 8359/33165 objects degraded (25.204%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:27:16.422 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:15 smithi097 ceph-mon[32687]: osdmap e165: 8 total, 8 up, 8 in 2021-10-08T19:27:16.423 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:15 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:27:16.423 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:15 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:27:16.522 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:27:16.580 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:16.655 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:27:16 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:27:16.718 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:27:16.722 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:16.723 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:27:16.824 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:27:16.851 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:16.912 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:27:16.914 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:16.915 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:27:17.016 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:27:17.075 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:17.399 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:27:17 smithi097 conmon[33110]: 172.21.15.97 - - [08/Oct/2021:19:27:17] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:27:17.475 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:27:17.483 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:17.484 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:27:17.541 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:27:17.586 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:27:17.627 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is set 2021-10-08T19:27:17.654 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:17 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:27:17.654 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:17 smithi097 ceph-mon[32687]: osdmap e166: 8 total, 8 up, 8 in 2021-10-08T19:27:17.655 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:17 smithi097 ceph-mon[32687]: pgmap v263: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 679 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 592 op/s; 8359/33165 objects degraded (25.204%); 1106/33165 objects misplaced (3.335%); 0 B/s, 29 objects/s recovering 2021-10-08T19:27:17.655 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:17 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2404486756' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:27:17.655 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:17 smithi097 ceph-mon[32687]: from='client.35039 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:27:17.655 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:17 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:27:17.656 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:17 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:27:17.656 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:17 smithi097 ceph-mon[41966]: osdmap e166: 8 total, 8 up, 8 in 2021-10-08T19:27:17.656 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:17 smithi097 ceph-mon[41966]: pgmap v263: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 679 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 592 op/s; 8359/33165 objects degraded (25.204%); 1106/33165 objects misplaced (3.335%); 0 B/s, 29 objects/s recovering 2021-10-08T19:27:17.657 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:17 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2404486756' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:27:17.657 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:17 smithi097 ceph-mon[41966]: from='client.35039 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:27:17.657 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:17 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:27:17.664 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:17.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:17 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:27:17.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:17 smithi117 ceph-mon[34585]: osdmap e166: 8 total, 8 up, 8 in 2021-10-08T19:27:17.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:17 smithi117 ceph-mon[34585]: pgmap v263: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 679 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 592 op/s; 8359/33165 objects degraded (25.204%); 1106/33165 objects misplaced (3.335%); 0 B/s, 29 objects/s recovering 2021-10-08T19:27:17.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:17 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2404486756' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:27:17.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:17 smithi117 ceph-mon[34585]: from='client.35039 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:27:17.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:17 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:27:18.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:18 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:27:18.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:18 smithi097 ceph-mon[32687]: 172.21.15.97 - - [08/Oct/2021:19:27:17] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:27:18.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:18 smithi097 ceph-mon[32687]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:27:18.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:18 smithi097 ceph-mon[32687]: from='client.35039 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:27:18.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:18 smithi097 ceph-mon[32687]: osdmap e167: 8 total, 8 up, 8 in 2021-10-08T19:27:18.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:18 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:27:18.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:18 smithi097 ceph-mon[41966]: 172.21.15.97 - - [08/Oct/2021:19:27:17] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:27:18.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:18 smithi097 ceph-mon[41966]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:27:18.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:18 smithi097 ceph-mon[41966]: from='client.35039 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:27:18.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:18 smithi097 ceph-mon[41966]: osdmap e167: 8 total, 8 up, 8 in 2021-10-08T19:27:18.887 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:27:18.901 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:18.901 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:27:18.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:18 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:27:18.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:18 smithi117 ceph-mon[34585]: 172.21.15.97 - - [08/Oct/2021:19:27:17] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:27:18.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:18 smithi117 ceph-mon[34585]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:27:18.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:18 smithi117 ceph-mon[34585]: from='client.35039 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:27:18.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:18 smithi117 ceph-mon[34585]: osdmap e167: 8 total, 8 up, 8 in 2021-10-08T19:27:19.002 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:27:19.059 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:19.213 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:27:19.218 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:19.219 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:27:19.264 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:27:19.264 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2021-10-08T19:27:19.265 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2021-10-08T19:27:19.265 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2021-10-08T19:27:19.265 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.265 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:35697 7.c 7:38456c0c:::benchmark_data_smithi097_93198_object35696:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106)", 2021-10-08T19:27:19.266 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:12.253514+0000", 2021-10-08T19:27:19.266 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 187.006810833, 2021-10-08T19:27:19.266 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.149840001, 2021-10-08T19:27:19.267 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:27:19.267 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:19.267 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:27:19.267 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:27:19.268 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:27:19.268 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 35697 2021-10-08T19:27:19.268 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.268 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:27:19.269 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.269 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:27:19.269 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.253514+0000", 2021-10-08T19:27:19.269 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:27:19.269 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.270 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.270 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:27:19.270 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.253514+0000", 2021-10-08T19:27:19.270 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:27:19.270 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.271 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.271 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:27:19.271 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.253513+0000", 2021-10-08T19:27:19.271 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:27:19.272 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.272 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.272 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:27:19.272 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.253542+0000", 2021-10-08T19:27:19.272 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8481999999999999e-05 2021-10-08T19:27:19.273 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.273 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.273 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:27:19.273 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.253550+0000", 2021-10-08T19:27:19.273 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1780000000000003e-06 2021-10-08T19:27:19.274 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.274 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.274 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:27:19.274 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.253555+0000", 2021-10-08T19:27:19.275 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.843e-06 2021-10-08T19:27:19.275 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.275 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.275 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:27:19.275 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.258211+0000", 2021-10-08T19:27:19.276 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0046566669999999998 2021-10-08T19:27:19.276 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.276 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.277 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:27:19.277 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.258329+0000", 2021-10-08T19:27:19.277 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011772100000000001 2021-10-08T19:27:19.277 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.277 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.278 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2,7", 2021-10-08T19:27:19.278 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.396732+0000", 2021-10-08T19:27:19.278 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.138402898 2021-10-08T19:27:19.278 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.279 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.279 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:19.279 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.398651+0000", 2021-10-08T19:27:19.279 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001919511 2021-10-08T19:27:19.280 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.280 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.280 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:27:19.280 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.402133+0000", 2021-10-08T19:27:19.280 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0034813169999999998 2021-10-08T19:27:19.281 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.281 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.281 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:19.281 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.403265+0000", 2021-10-08T19:27:19.282 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011324600000000001 2021-10-08T19:27:19.282 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.282 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.282 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:27:19.282 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.403318+0000", 2021-10-08T19:27:19.283 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2636999999999998e-05 2021-10-08T19:27:19.283 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.283 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.283 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:27:19.284 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.403354+0000", 2021-10-08T19:27:19.284 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6358e-05 2021-10-08T19:27:19.284 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:19.284 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:19.284 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:19.285 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.285 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.285 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:35698 7.3 7:ce511a02:::benchmark_data_smithi097_93198_object35697:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106)", 2021-10-08T19:27:19.285 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:12.258052+0000", 2021-10-08T19:27:19.285 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 187.002273339, 2021-10-08T19:27:19.286 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.14845515100000001, 2021-10-08T19:27:19.286 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:27:19.286 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:19.286 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:27:19.287 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:27:19.287 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:27:19.287 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 35698 2021-10-08T19:27:19.287 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.288 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:27:19.288 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.288 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:27:19.288 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.258052+0000", 2021-10-08T19:27:19.288 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:27:19.289 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.289 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.289 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:27:19.289 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.258052+0000", 2021-10-08T19:27:19.289 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:27:19.290 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.290 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.290 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:27:19.290 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.258050+0000", 2021-10-08T19:27:19.291 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:27:19.291 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.291 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.291 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:27:19.291 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.258107+0000", 2021-10-08T19:27:19.292 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7309000000000003e-05 2021-10-08T19:27:19.292 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.292 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.292 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:27:19.292 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.258120+0000", 2021-10-08T19:27:19.293 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2639e-05 2021-10-08T19:27:19.293 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.293 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.293 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:27:19.294 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.258127+0000", 2021-10-08T19:27:19.294 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3819999999999998e-06 2021-10-08T19:27:19.294 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.294 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.294 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:27:19.295 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.258212+0000", 2021-10-08T19:27:19.295 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5101999999999999e-05 2021-10-08T19:27:19.295 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.295 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.296 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:27:19.296 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.258316+0000", 2021-10-08T19:27:19.296 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000104085 2021-10-08T19:27:19.296 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.296 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.297 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2,4", 2021-10-08T19:27:19.297 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.396994+0000", 2021-10-08T19:27:19.297 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.13867813500000001 2021-10-08T19:27:19.297 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.298 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.298 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:19.298 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.400905+0000", 2021-10-08T19:27:19.298 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0039107899999999999 2021-10-08T19:27:19.299 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.299 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.299 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:27:19.299 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.400957+0000", 2021-10-08T19:27:19.299 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2169999999999997e-05 2021-10-08T19:27:19.300 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.300 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.300 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:19.300 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.406414+0000", 2021-10-08T19:27:19.301 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.005456397 2021-10-08T19:27:19.301 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.301 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.301 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:27:19.301 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.406469+0000", 2021-10-08T19:27:19.302 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5448999999999997e-05 2021-10-08T19:27:19.302 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.302 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.302 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:27:19.302 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.406507+0000", 2021-10-08T19:27:19.303 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7622e-05 2021-10-08T19:27:19.303 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:19.303 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:19.303 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:19.304 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.304 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.304 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:35700 7.3 7:ca400aa7:::benchmark_data_smithi097_93198_object35699:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106)", 2021-10-08T19:27:19.304 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:12.258147+0000", 2021-10-08T19:27:19.305 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 187.002177972, 2021-10-08T19:27:19.305 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.148477053, 2021-10-08T19:27:19.305 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:27:19.305 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:19.306 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:27:19.306 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:27:19.306 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:27:19.306 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 35700 2021-10-08T19:27:19.307 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.307 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:27:19.307 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.307 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:27:19.307 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.258147+0000", 2021-10-08T19:27:19.308 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:27:19.308 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.308 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.308 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:27:19.309 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.258147+0000", 2021-10-08T19:27:19.309 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:27:19.309 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.309 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.309 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:27:19.310 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.258146+0000", 2021-10-08T19:27:19.310 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:27:19.310 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.310 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.310 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:27:19.311 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.258170+0000", 2021-10-08T19:27:19.311 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4198000000000001e-05 2021-10-08T19:27:19.311 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.311 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.312 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:27:19.312 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.258178+0000", 2021-10-08T19:27:19.313 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.593e-06 2021-10-08T19:27:19.313 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.313 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.313 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:27:19.314 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.258183+0000", 2021-10-08T19:27:19.314 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0900000000000004e-06 2021-10-08T19:27:19.314 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.314 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.315 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:27:19.315 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.399233+0000", 2021-10-08T19:27:19.315 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.141049862 2021-10-08T19:27:19.315 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.316 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.316 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:27:19.316 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.399387+0000", 2021-10-08T19:27:19.316 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015389900000000001 2021-10-08T19:27:19.317 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.317 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.317 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2,4", 2021-10-08T19:27:19.317 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.399536+0000", 2021-10-08T19:27:19.318 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014961299999999999 2021-10-08T19:27:19.318 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.318 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.318 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:19.319 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.400950+0000", 2021-10-08T19:27:19.319 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0014142409999999999 2021-10-08T19:27:19.319 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.319 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.320 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:27:19.320 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.402523+0000", 2021-10-08T19:27:19.320 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0015724440000000001 2021-10-08T19:27:19.320 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.321 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.321 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:19.321 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.406542+0000", 2021-10-08T19:27:19.322 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0040186060000000001 2021-10-08T19:27:19.322 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.322 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.322 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:27:19.323 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.406586+0000", 2021-10-08T19:27:19.323 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4073000000000003e-05 2021-10-08T19:27:19.323 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.323 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.323 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:27:19.324 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.406624+0000", 2021-10-08T19:27:19.324 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8423999999999997e-05 2021-10-08T19:27:19.325 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:19.325 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:19.325 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:19.325 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.326 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.326 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:35701 7.a 7:5bd5e740:::benchmark_data_smithi097_93198_object35700:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106)", 2021-10-08T19:27:19.326 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:12.258423+0000", 2021-10-08T19:27:19.326 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 187.00190151800001, 2021-10-08T19:27:19.326 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.14922896199999999, 2021-10-08T19:27:19.327 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:27:19.327 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:19.327 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:27:19.327 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:27:19.328 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:27:19.328 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 35701 2021-10-08T19:27:19.328 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.329 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:27:19.329 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.329 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:27:19.329 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.258423+0000", 2021-10-08T19:27:19.329 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:27:19.330 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.330 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.330 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:27:19.330 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.258423+0000", 2021-10-08T19:27:19.331 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:27:19.331 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.331 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.331 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:27:19.332 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.258418+0000", 2021-10-08T19:27:19.332 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999948 2021-10-08T19:27:19.332 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.332 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.333 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:27:19.333 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.258445+0000", 2021-10-08T19:27:19.333 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7192999999999999e-05 2021-10-08T19:27:19.333 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.334 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.334 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:27:19.334 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.396635+0000", 2021-10-08T19:27:19.334 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.13818986999999999 2021-10-08T19:27:19.334 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.335 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.335 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:27:19.335 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.396649+0000", 2021-10-08T19:27:19.335 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.382e-05 2021-10-08T19:27:19.336 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.336 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.336 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:27:19.336 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.396711+0000", 2021-10-08T19:27:19.336 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1987000000000001e-05 2021-10-08T19:27:19.337 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.337 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.337 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:27:19.337 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.396858+0000", 2021-10-08T19:27:19.338 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014705 2021-10-08T19:27:19.338 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.338 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.338 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2,5", 2021-10-08T19:27:19.339 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.396995+0000", 2021-10-08T19:27:19.339 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013697000000000001 2021-10-08T19:27:19.339 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.339 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.340 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:19.340 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.400258+0000", 2021-10-08T19:27:19.340 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032632030000000001 2021-10-08T19:27:19.340 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.340 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.341 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:27:19.341 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.400806+0000", 2021-10-08T19:27:19.341 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00054806099999999997 2021-10-08T19:27:19.342 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.342 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.343 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:19.343 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.407559+0000", 2021-10-08T19:27:19.343 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0067530860000000002 2021-10-08T19:27:19.343 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.343 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.344 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:27:19.344 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.407613+0000", 2021-10-08T19:27:19.344 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3869999999999998e-05 2021-10-08T19:27:19.344 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.345 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.345 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:27:19.345 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.407652+0000", 2021-10-08T19:27:19.345 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9140999999999997e-05 2021-10-08T19:27:19.345 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:19.346 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:19.346 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:19.346 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.346 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.347 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.24796.0:35708 7.6 e106/94 7:6ac91e09:::benchmark_data_smithi097_93198_object35707:head v 106'2177, mlcod=106'2175)", 2021-10-08T19:27:19.347 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:12.264601+0000", 2021-10-08T19:27:19.347 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 186.99572374499999, 2021-10-08T19:27:19.347 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.135642611, 2021-10-08T19:27:19.347 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:27:19.348 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:19.348 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:27:19.348 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.348 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:27:19.348 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.264601+0000", 2021-10-08T19:27:19.349 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:27:19.349 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.349 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.349 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:27:19.350 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.264601+0000", 2021-10-08T19:27:19.350 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:27:19.350 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.350 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.351 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:27:19.351 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.264599+0000", 2021-10-08T19:27:19.352 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:27:19.352 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.353 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.353 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:27:19.355 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.264631+0000", 2021-10-08T19:27:19.355 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2209000000000003e-05 2021-10-08T19:27:19.355 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.356 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.356 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:27:19.356 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.396655+0000", 2021-10-08T19:27:19.356 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.13202387400000001 2021-10-08T19:27:19.356 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.357 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.357 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:27:19.357 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.396663+0000", 2021-10-08T19:27:19.358 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3669999999999999e-06 2021-10-08T19:27:19.358 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.358 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.358 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:27:19.358 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.396926+0000", 2021-10-08T19:27:19.359 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00026396600000000003 2021-10-08T19:27:19.359 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.359 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.359 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:27:19.360 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.396947+0000", 2021-10-08T19:27:19.360 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0594e-05 2021-10-08T19:27:19.360 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.360 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.360 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:27:19.361 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.400213+0000", 2021-10-08T19:27:19.362 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032656719999999998 2021-10-08T19:27:19.362 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.362 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.362 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:27:19.362 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.400244+0000", 2021-10-08T19:27:19.363 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1041000000000003e-05 2021-10-08T19:27:19.363 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:19.363 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:19.363 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:19.364 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.364 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.364 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.24796.0:35716 7.1 e106/94 7:8e2c561f:::benchmark_data_smithi097_93198_object35715:head v 106'2203, mlcod=106'2201)", 2021-10-08T19:27:19.364 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:12.268945+0000", 2021-10-08T19:27:19.364 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 186.99137971900001, 2021-10-08T19:27:19.365 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.13389158300000001, 2021-10-08T19:27:19.365 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:27:19.365 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:19.365 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:27:19.365 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.366 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:27:19.366 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.268945+0000", 2021-10-08T19:27:19.366 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:27:19.366 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.367 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.367 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:27:19.367 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.268945+0000", 2021-10-08T19:27:19.367 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:27:19.367 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.368 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.368 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:27:19.368 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.268943+0000", 2021-10-08T19:27:19.368 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:27:19.369 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.370 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.370 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:27:19.370 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.269050+0000", 2021-10-08T19:27:19.370 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010633600000000001 2021-10-08T19:27:19.371 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.371 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.372 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:27:19.372 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.396628+0000", 2021-10-08T19:27:19.372 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.12757862 2021-10-08T19:27:19.372 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.373 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.373 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:27:19.373 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.396645+0000", 2021-10-08T19:27:19.373 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7198999999999999e-05 2021-10-08T19:27:19.373 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.374 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.374 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:27:19.374 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.396785+0000", 2021-10-08T19:27:19.374 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013936299999999999 2021-10-08T19:27:19.375 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.375 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.375 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:27:19.375 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.396808+0000", 2021-10-08T19:27:19.375 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3575999999999999e-05 2021-10-08T19:27:19.376 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.376 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.376 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:27:19.376 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.402808+0000", 2021-10-08T19:27:19.376 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0059998589999999997 2021-10-08T19:27:19.378 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.378 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.378 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:27:19.379 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.402837+0000", 2021-10-08T19:27:19.379 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8600999999999999e-05 2021-10-08T19:27:19.379 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:19.379 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:19.380 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:19.380 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.380 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.380 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:86021 7.3 7:c211d7cd:::benchmark_data_smithi097_93198_object86020:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132)", 2021-10-08T19:27:19.381 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:15.291126+0000", 2021-10-08T19:27:19.381 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 123.96919939599999, 2021-10-08T19:27:19.381 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.15966846000000001, 2021-10-08T19:27:19.381 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:27:19.381 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:19.382 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:27:19.382 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:27:19.382 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:27:19.382 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 86021 2021-10-08T19:27:19.383 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.383 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:27:19.383 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.383 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:27:19.383 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.291126+0000", 2021-10-08T19:27:19.384 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:27:19.384 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.384 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.384 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:27:19.384 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.291126+0000", 2021-10-08T19:27:19.385 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:27:19.385 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.385 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.385 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:27:19.386 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.291122+0000", 2021-10-08T19:27:19.386 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999962 2021-10-08T19:27:19.386 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.386 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.386 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:27:19.387 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.291156+0000", 2021-10-08T19:27:19.387 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.447e-05 2021-10-08T19:27:19.387 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.387 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.387 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:27:19.388 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.291176+0000", 2021-10-08T19:27:19.388 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0051000000000002e-05 2021-10-08T19:27:19.388 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.388 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.388 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:27:19.389 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.291185+0000", 2021-10-08T19:27:19.389 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7190000000000007e-06 2021-10-08T19:27:19.389 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.389 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.390 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:27:19.390 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.291413+0000", 2021-10-08T19:27:19.390 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022830499999999999 2021-10-08T19:27:19.390 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.390 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.391 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:27:19.391 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.291510+0000", 2021-10-08T19:27:19.391 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.6119000000000006e-05 2021-10-08T19:27:19.391 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.392 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.392 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2,4", 2021-10-08T19:27:19.392 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.291604+0000", 2021-10-08T19:27:19.392 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4110999999999994e-05 2021-10-08T19:27:19.393 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.393 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.393 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:19.393 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.295799+0000", 2021-10-08T19:27:19.393 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0041954599999999998 2021-10-08T19:27:19.394 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.394 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.394 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:27:19.395 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.298928+0000", 2021-10-08T19:27:19.395 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031292170000000001 2021-10-08T19:27:19.395 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.395 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.395 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:19.396 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.450685+0000", 2021-10-08T19:27:19.396 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.15175618299999999 2021-10-08T19:27:19.396 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.396 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.396 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:27:19.397 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.450747+0000", 2021-10-08T19:27:19.397 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2269999999999998e-05 2021-10-08T19:27:19.397 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.397 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.397 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:27:19.398 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.450794+0000", 2021-10-08T19:27:19.398 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7207999999999999e-05 2021-10-08T19:27:19.398 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:19.398 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:19.399 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:19.399 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.399 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.399 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:86023 7.2 7:44f50a37:::benchmark_data_smithi097_93198_object86022:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132)", 2021-10-08T19:27:19.399 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:15.291203+0000", 2021-10-08T19:27:19.400 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 123.96912225, 2021-10-08T19:27:19.400 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.16327653, 2021-10-08T19:27:19.400 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:27:19.400 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:19.400 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:27:19.401 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:27:19.401 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:27:19.401 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 86023 2021-10-08T19:27:19.401 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.402 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:27:19.402 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.402 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:27:19.402 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.291203+0000", 2021-10-08T19:27:19.402 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:27:19.403 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.403 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.403 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:27:19.404 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.291203+0000", 2021-10-08T19:27:19.404 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:27:19.404 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.404 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.405 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:27:19.405 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.291202+0000", 2021-10-08T19:27:19.405 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:27:19.405 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.406 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.406 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:27:19.406 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.291227+0000", 2021-10-08T19:27:19.406 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5341e-05 2021-10-08T19:27:19.406 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.407 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.407 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:27:19.407 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.291234+0000", 2021-10-08T19:27:19.407 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3819999999999998e-06 2021-10-08T19:27:19.408 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.408 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.408 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:27:19.408 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.291239+0000", 2021-10-08T19:27:19.408 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9089999999999999e-06 2021-10-08T19:27:19.409 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.409 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.409 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:27:19.409 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.293178+0000", 2021-10-08T19:27:19.409 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0019387009999999999 2021-10-08T19:27:19.410 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.410 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.410 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:27:19.410 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.293300+0000", 2021-10-08T19:27:19.411 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000121562 2021-10-08T19:27:19.411 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.411 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.411 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,2", 2021-10-08T19:27:19.411 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.293437+0000", 2021-10-08T19:27:19.412 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000137148 2021-10-08T19:27:19.412 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.412 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.412 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:27:19.412 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.298948+0000", 2021-10-08T19:27:19.413 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0055109030000000002 2021-10-08T19:27:19.413 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.413 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.414 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:19.414 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.302773+0000", 2021-10-08T19:27:19.414 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038257650000000001 2021-10-08T19:27:19.414 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.414 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.415 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:19.415 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.454412+0000", 2021-10-08T19:27:19.415 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.15163875900000001 2021-10-08T19:27:19.415 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.415 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.416 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:27:19.416 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.454448+0000", 2021-10-08T19:27:19.416 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.587e-05 2021-10-08T19:27:19.416 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.416 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.417 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:27:19.417 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.454479+0000", 2021-10-08T19:27:19.417 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1192999999999998e-05 2021-10-08T19:27:19.417 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:19.418 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:19.418 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:19.418 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.418 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.418 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:86024 7.2 7:4e359619:::benchmark_data_smithi097_93198_object86023:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132)", 2021-10-08T19:27:19.419 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:15.291254+0000", 2021-10-08T19:27:19.419 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 123.96907090800001, 2021-10-08T19:27:19.419 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.16380112999999999, 2021-10-08T19:27:19.419 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:27:19.419 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:19.420 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:27:19.420 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:27:19.420 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:27:19.421 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 86024 2021-10-08T19:27:19.421 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.421 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:27:19.421 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.422 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:27:19.422 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.291254+0000", 2021-10-08T19:27:19.422 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:27:19.422 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.423 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.423 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:27:19.423 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.291254+0000", 2021-10-08T19:27:19.423 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:27:19.424 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.424 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.424 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:27:19.424 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.291253+0000", 2021-10-08T19:27:19.425 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2021-10-08T19:27:19.425 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.425 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.425 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:27:19.425 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.291278+0000", 2021-10-08T19:27:19.426 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4871999999999998e-05 2021-10-08T19:27:19.426 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.426 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.426 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:27:19.427 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.291285+0000", 2021-10-08T19:27:19.427 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7510000000000002e-06 2021-10-08T19:27:19.427 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.427 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.427 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:27:19.428 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.291290+0000", 2021-10-08T19:27:19.428 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7360000000000001e-06 2021-10-08T19:27:19.428 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.428 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.428 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:27:19.429 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.295721+0000", 2021-10-08T19:27:19.429 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0044308940000000003 2021-10-08T19:27:19.429 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.429 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.430 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:27:19.430 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.295848+0000", 2021-10-08T19:27:19.430 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012695499999999999 2021-10-08T19:27:19.430 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.430 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.431 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,2", 2021-10-08T19:27:19.431 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.296025+0000", 2021-10-08T19:27:19.431 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000177009 2021-10-08T19:27:19.432 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.432 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.432 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:27:19.432 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.299118+0000", 2021-10-08T19:27:19.432 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030937199999999999 2021-10-08T19:27:19.433 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.433 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.433 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:19.433 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.302925+0000", 2021-10-08T19:27:19.433 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038063760000000002 2021-10-08T19:27:19.434 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.434 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.434 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:19.434 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.454975+0000", 2021-10-08T19:27:19.435 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.15205036199999999 2021-10-08T19:27:19.435 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.435 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.435 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:27:19.435 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.455020+0000", 2021-10-08T19:27:19.436 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5429999999999997e-05 2021-10-08T19:27:19.436 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.436 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.436 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:27:19.436 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.455055+0000", 2021-10-08T19:27:19.437 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4693999999999997e-05 2021-10-08T19:27:19.437 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:19.437 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:19.437 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:19.438 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.438 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.438 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:86030 7.3 7:c00202ed:::benchmark_data_smithi097_93198_object86029:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132)", 2021-10-08T19:27:19.438 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:15.291294+0000", 2021-10-08T19:27:19.439 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 123.969030519, 2021-10-08T19:27:19.439 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.159625454, 2021-10-08T19:27:19.439 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:27:19.439 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:19.439 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:27:19.440 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:27:19.440 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:27:19.440 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 86030 2021-10-08T19:27:19.440 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.441 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:27:19.441 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.441 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:27:19.441 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.291294+0000", 2021-10-08T19:27:19.441 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:27:19.442 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.442 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.442 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:27:19.442 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.291294+0000", 2021-10-08T19:27:19.443 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:27:19.443 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.443 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.443 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:27:19.443 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.291294+0000", 2021-10-08T19:27:19.444 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2021-10-08T19:27:19.444 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.444 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.444 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:27:19.444 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.291316+0000", 2021-10-08T19:27:19.445 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2248000000000001e-05 2021-10-08T19:27:19.445 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.445 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.445 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:27:19.446 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.291322+0000", 2021-10-08T19:27:19.446 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0100000000000001e-06 2021-10-08T19:27:19.446 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.446 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.446 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:27:19.447 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.291326+0000", 2021-10-08T19:27:19.447 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3329999999999998e-06 2021-10-08T19:27:19.447 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.447 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.447 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:27:19.448 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.293869+0000", 2021-10-08T19:27:19.448 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0025425460000000001 2021-10-08T19:27:19.448 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.448 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.449 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:27:19.449 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.293944+0000", 2021-10-08T19:27:19.449 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4711999999999999e-05 2021-10-08T19:27:19.449 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.449 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.450 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2,4", 2021-10-08T19:27:19.450 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.294034+0000", 2021-10-08T19:27:19.450 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0619999999999996e-05 2021-10-08T19:27:19.450 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.450 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.451 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:19.451 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.296219+0000", 2021-10-08T19:27:19.451 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021851119999999999 2021-10-08T19:27:19.451 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.451 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.452 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:27:19.452 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.299104+0000", 2021-10-08T19:27:19.452 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028843150000000001 2021-10-08T19:27:19.452 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.453 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.453 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:19.453 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.450843+0000", 2021-10-08T19:27:19.453 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.15173894700000001 2021-10-08T19:27:19.453 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.454 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.454 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:27:19.454 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.450887+0000", 2021-10-08T19:27:19.454 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4706000000000002e-05 2021-10-08T19:27:19.454 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.455 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.455 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:27:19.456 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.450920+0000", 2021-10-08T19:27:19.457 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2558999999999998e-05 2021-10-08T19:27:19.457 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:19.457 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:19.457 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:19.457 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.458 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.458 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:86033 7.a 7:5245921a:::benchmark_data_smithi097_93198_object86032:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132)", 2021-10-08T19:27:19.458 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:15.299371+0000", 2021-10-08T19:27:19.458 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 123.960953797, 2021-10-08T19:27:19.459 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.15500295, 2021-10-08T19:27:19.459 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:27:19.459 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:19.459 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:27:19.459 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:27:19.460 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:27:19.460 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 86033 2021-10-08T19:27:19.460 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.460 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:27:19.460 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.461 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:27:19.461 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.299371+0000", 2021-10-08T19:27:19.461 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:27:19.461 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.462 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.462 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:27:19.462 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.299371+0000", 2021-10-08T19:27:19.462 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:27:19.462 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.463 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.463 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:27:19.463 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.299368+0000", 2021-10-08T19:27:19.463 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2021-10-08T19:27:19.464 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.464 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.464 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:27:19.464 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.299394+0000", 2021-10-08T19:27:19.464 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5902999999999999e-05 2021-10-08T19:27:19.465 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.465 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.465 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:27:19.465 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.299406+0000", 2021-10-08T19:27:19.465 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1894e-05 2021-10-08T19:27:19.466 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.466 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.466 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:27:19.466 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.299413+0000", 2021-10-08T19:27:19.466 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7920000000000004e-06 2021-10-08T19:27:19.467 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.467 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.467 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:27:19.467 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.299465+0000", 2021-10-08T19:27:19.468 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2284000000000003e-05 2021-10-08T19:27:19.468 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.468 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.468 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:27:19.468 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.299594+0000", 2021-10-08T19:27:19.469 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012857299999999999 2021-10-08T19:27:19.469 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.469 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.469 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2,5", 2021-10-08T19:27:19.469 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.299750+0000", 2021-10-08T19:27:19.470 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015653600000000001 2021-10-08T19:27:19.470 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.470 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.470 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:27:19.470 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.303260+0000", 2021-10-08T19:27:19.471 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0035099850000000002 2021-10-08T19:27:19.471 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.471 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.471 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:19.472 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.306581+0000", 2021-10-08T19:27:19.472 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00332081 2021-10-08T19:27:19.472 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.472 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.472 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:19.473 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.454290+0000", 2021-10-08T19:27:19.473 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.14770835500000001 2021-10-08T19:27:19.473 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.473 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.474 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:27:19.474 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.454337+0000", 2021-10-08T19:27:19.474 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7460999999999998e-05 2021-10-08T19:27:19.474 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.474 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.475 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:27:19.476 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.454374+0000", 2021-10-08T19:27:19.476 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7057000000000001e-05 2021-10-08T19:27:19.476 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:19.477 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:19.477 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:19.477 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.477 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.477 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:86037 7.a 7:56fb6352:::benchmark_data_smithi097_93198_object86036:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132)", 2021-10-08T19:27:19.478 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:15.304103+0000", 2021-10-08T19:27:19.478 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 123.956221973, 2021-10-08T19:27:19.478 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.150468827, 2021-10-08T19:27:19.479 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:27:19.479 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:19.479 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:27:19.479 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:27:19.480 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:27:19.480 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 86037 2021-10-08T19:27:19.480 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.480 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:27:19.481 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.481 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:27:19.481 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.304103+0000", 2021-10-08T19:27:19.481 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:27:19.481 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.482 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.482 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:27:19.482 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.304103+0000", 2021-10-08T19:27:19.482 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:27:19.483 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.483 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.483 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:27:19.483 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.304100+0000", 2021-10-08T19:27:19.483 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2021-10-08T19:27:19.484 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.484 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.484 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:27:19.484 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.304125+0000", 2021-10-08T19:27:19.484 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4470000000000001e-05 2021-10-08T19:27:19.485 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.485 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.486 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:27:19.486 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.304140+0000", 2021-10-08T19:27:19.486 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5617e-05 2021-10-08T19:27:19.486 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.486 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.487 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:27:19.487 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.304148+0000", 2021-10-08T19:27:19.487 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5429999999999996e-06 2021-10-08T19:27:19.487 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.488 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.488 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:27:19.488 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.304202+0000", 2021-10-08T19:27:19.488 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4620000000000002e-05 2021-10-08T19:27:19.488 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.489 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.489 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:27:19.489 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.304318+0000", 2021-10-08T19:27:19.489 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115118 2021-10-08T19:27:19.489 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.490 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.490 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2,5", 2021-10-08T19:27:19.490 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.304471+0000", 2021-10-08T19:27:19.490 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015348099999999999 2021-10-08T19:27:19.491 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.491 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.491 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:27:19.491 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.306747+0000", 2021-10-08T19:27:19.491 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0022762139999999999 2021-10-08T19:27:19.492 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.492 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.493 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:19.493 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.306786+0000", 2021-10-08T19:27:19.493 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8804999999999999e-05 2021-10-08T19:27:19.493 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.493 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.494 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:19.494 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.454509+0000", 2021-10-08T19:27:19.494 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.14772301900000001 2021-10-08T19:27:19.494 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.495 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.495 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:27:19.495 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.454542+0000", 2021-10-08T19:27:19.495 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3296000000000001e-05 2021-10-08T19:27:19.495 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.496 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.496 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:27:19.496 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.454572+0000", 2021-10-08T19:27:19.496 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9451999999999999e-05 2021-10-08T19:27:19.496 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:19.497 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:19.497 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:19.497 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.498 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.498 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:86045 7.a 7:59c7a7c7:::benchmark_data_smithi097_93198_object86044:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132)", 2021-10-08T19:27:19.498 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:15.307710+0000", 2021-10-08T19:27:19.498 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 123.952614657, 2021-10-08T19:27:19.498 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.147951795, 2021-10-08T19:27:19.499 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:27:19.499 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:19.499 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:27:19.499 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:27:19.500 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:27:19.500 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 86045 2021-10-08T19:27:19.500 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.500 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:27:19.500 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.501 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:27:19.501 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.307710+0000", 2021-10-08T19:27:19.501 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:27:19.501 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.501 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.502 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:27:19.502 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.307710+0000", 2021-10-08T19:27:19.503 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:27:19.503 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.503 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.504 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:27:19.504 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.307708+0000", 2021-10-08T19:27:19.504 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:27:19.504 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.505 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.505 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:27:19.505 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.307732+0000", 2021-10-08T19:27:19.505 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4315999999999999e-05 2021-10-08T19:27:19.506 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.506 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.506 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:27:19.506 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.307747+0000", 2021-10-08T19:27:19.506 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5252000000000001e-05 2021-10-08T19:27:19.507 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.507 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.507 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:27:19.507 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.307755+0000", 2021-10-08T19:27:19.508 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1319999999999996e-06 2021-10-08T19:27:19.508 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.508 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.508 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:27:19.508 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.307810+0000", 2021-10-08T19:27:19.509 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5300000000000002e-05 2021-10-08T19:27:19.509 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.509 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.509 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:27:19.509 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.307955+0000", 2021-10-08T19:27:19.510 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014524300000000001 2021-10-08T19:27:19.510 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.510 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.510 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2,5", 2021-10-08T19:27:19.510 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.308134+0000", 2021-10-08T19:27:19.511 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000178519 2021-10-08T19:27:19.511 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.511 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.511 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:27:19.512 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.310625+0000", 2021-10-08T19:27:19.512 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0024918119999999999 2021-10-08T19:27:19.512 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.512 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.512 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:19.513 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.312646+0000", 2021-10-08T19:27:19.513 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0020208209999999999 2021-10-08T19:27:19.513 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.513 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.513 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:19.514 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.455596+0000", 2021-10-08T19:27:19.514 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.142949785 2021-10-08T19:27:19.514 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.514 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.515 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:27:19.515 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.455628+0000", 2021-10-08T19:27:19.515 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.154e-05 2021-10-08T19:27:19.515 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.515 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.516 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:27:19.516 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.455662+0000", 2021-10-08T19:27:19.516 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4439e-05 2021-10-08T19:27:19.516 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:19.516 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:19.517 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:19.517 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.517 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.517 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:86047 7.2 7:4a2d1742:::benchmark_data_smithi097_93198_object86046:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132)", 2021-10-08T19:27:19.518 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:15.316173+0000", 2021-10-08T19:27:19.518 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 123.94415237600001, 2021-10-08T19:27:19.518 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.139609489, 2021-10-08T19:27:19.518 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:27:19.518 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:19.519 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:27:19.519 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:27:19.519 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:27:19.519 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 86047 2021-10-08T19:27:19.519 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.520 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:27:19.520 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.520 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:27:19.520 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.316173+0000", 2021-10-08T19:27:19.521 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:27:19.521 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.521 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.521 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:27:19.522 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.316173+0000", 2021-10-08T19:27:19.522 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:27:19.522 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.522 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.523 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:27:19.523 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.316170+0000", 2021-10-08T19:27:19.523 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:27:19.523 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.523 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.524 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:27:19.524 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.316207+0000", 2021-10-08T19:27:19.524 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7258000000000001e-05 2021-10-08T19:27:19.524 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.524 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.525 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:27:19.525 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.316223+0000", 2021-10-08T19:27:19.525 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5823000000000001e-05 2021-10-08T19:27:19.525 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.525 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.526 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:27:19.526 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.316230+0000", 2021-10-08T19:27:19.526 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0149999999999998e-06 2021-10-08T19:27:19.526 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.527 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.527 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:27:19.527 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.316296+0000", 2021-10-08T19:27:19.527 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6190000000000002e-05 2021-10-08T19:27:19.527 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.528 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.528 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:27:19.528 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.316455+0000", 2021-10-08T19:27:19.528 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015860099999999999 2021-10-08T19:27:19.528 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.529 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.529 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,2", 2021-10-08T19:27:19.529 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.316618+0000", 2021-10-08T19:27:19.529 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016277500000000001 2021-10-08T19:27:19.529 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.530 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.530 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:19.530 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.321221+0000", 2021-10-08T19:27:19.530 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0046030719999999997 2021-10-08T19:27:19.531 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.531 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.531 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:27:19.531 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.327743+0000", 2021-10-08T19:27:19.531 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0065217909999999999 2021-10-08T19:27:19.532 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.532 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.532 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:19.532 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.455697+0000", 2021-10-08T19:27:19.532 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.127954654 2021-10-08T19:27:19.533 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.533 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.533 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:27:19.533 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.455748+0000", 2021-10-08T19:27:19.533 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0532999999999999e-05 2021-10-08T19:27:19.534 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.534 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.534 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:27:19.534 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.455782+0000", 2021-10-08T19:27:19.535 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4258000000000003e-05 2021-10-08T19:27:19.535 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:19.535 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:19.535 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:19.535 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.536 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.536 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:114113 7.2 7:42f11afa:::benchmark_data_smithi097_93198_object22293:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e145)", 2021-10-08T19:27:19.536 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:53.644235+0000", 2021-10-08T19:27:19.536 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 85.616089474999995, 2021-10-08T19:27:19.537 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.127278953, 2021-10-08T19:27:19.537 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:27:19.537 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:19.537 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:27:19.537 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:27:19.538 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:27:19.538 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 114113 2021-10-08T19:27:19.538 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.538 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:27:19.538 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.539 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:27:19.539 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.644235+0000", 2021-10-08T19:27:19.539 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:27:19.539 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.540 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.540 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:27:19.540 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.644235+0000", 2021-10-08T19:27:19.540 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:27:19.540 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.541 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.541 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:27:19.541 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.644235+0000", 2021-10-08T19:27:19.541 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2021-10-08T19:27:19.541 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.542 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.542 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:27:19.542 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.644238+0000", 2021-10-08T19:27:19.542 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0740000000000001e-06 2021-10-08T19:27:19.543 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.543 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.543 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:27:19.543 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.644243+0000", 2021-10-08T19:27:19.543 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3499999999999996e-06 2021-10-08T19:27:19.544 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.544 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.544 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:27:19.544 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.644247+0000", 2021-10-08T19:27:19.544 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0130000000000004e-06 2021-10-08T19:27:19.545 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.545 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.545 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:27:19.545 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.654137+0000", 2021-10-08T19:27:19.545 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0098897059999999998 2021-10-08T19:27:19.546 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.546 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.546 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:27:19.546 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.754270+0000", 2021-10-08T19:27:19.547 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.100133473 2021-10-08T19:27:19.547 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.547 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.547 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,2", 2021-10-08T19:27:19.547 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.754413+0000", 2021-10-08T19:27:19.548 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000142795 2021-10-08T19:27:19.548 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.548 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.548 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:27:19.548 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.757483+0000", 2021-10-08T19:27:19.549 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030697480000000002 2021-10-08T19:27:19.549 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.549 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.549 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:19.549 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.766836+0000", 2021-10-08T19:27:19.550 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0093529939999999999 2021-10-08T19:27:19.550 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.550 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.550 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:19.551 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.771426+0000", 2021-10-08T19:27:19.551 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0045896060000000004 2021-10-08T19:27:19.551 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.551 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.551 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:27:19.552 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.771476+0000", 2021-10-08T19:27:19.552 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0467999999999999e-05 2021-10-08T19:27:19.552 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.552 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.552 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:27:19.553 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.771514+0000", 2021-10-08T19:27:19.553 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8353999999999999e-05 2021-10-08T19:27:19.553 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:19.553 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:19.553 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:19.554 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.554 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.554 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:114115 7.a 7:524bd2fb:::benchmark_data_smithi097_93198_object22295:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e145)", 2021-10-08T19:27:19.554 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:53.651254+0000", 2021-10-08T19:27:19.555 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 85.609070613, 2021-10-08T19:27:19.555 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.11913596, 2021-10-08T19:27:19.555 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:27:19.555 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:19.555 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:27:19.556 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:27:19.556 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:27:19.556 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 114115 2021-10-08T19:27:19.556 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.556 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:27:19.557 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.557 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:27:19.557 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.651254+0000", 2021-10-08T19:27:19.557 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:27:19.558 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.558 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.558 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:27:19.558 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.651254+0000", 2021-10-08T19:27:19.558 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:27:19.559 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.559 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.559 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:27:19.559 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.651252+0000", 2021-10-08T19:27:19.559 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:27:19.560 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.560 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.560 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:27:19.560 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.651261+0000", 2021-10-08T19:27:19.561 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8959999999999992e-06 2021-10-08T19:27:19.561 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.561 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.561 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:27:19.561 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.651272+0000", 2021-10-08T19:27:19.562 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1697e-05 2021-10-08T19:27:19.562 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.562 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.562 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:27:19.562 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.651279+0000", 2021-10-08T19:27:19.563 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2389999999999999e-06 2021-10-08T19:27:19.563 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.563 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.563 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:27:19.563 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.654153+0000", 2021-10-08T19:27:19.564 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028742519999999999 2021-10-08T19:27:19.564 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.564 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.564 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:27:19.565 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.754562+0000", 2021-10-08T19:27:19.565 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.100408926 2021-10-08T19:27:19.565 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.565 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.565 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2,5", 2021-10-08T19:27:19.566 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.754670+0000", 2021-10-08T19:27:19.566 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000108557 2021-10-08T19:27:19.566 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.566 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.566 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:27:19.567 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.757489+0000", 2021-10-08T19:27:19.567 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028183829999999998 2021-10-08T19:27:19.567 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.567 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.567 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:19.568 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.764351+0000", 2021-10-08T19:27:19.568 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.006862674 2021-10-08T19:27:19.568 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.568 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.568 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:19.569 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.770300+0000", 2021-10-08T19:27:19.569 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0059487289999999998 2021-10-08T19:27:19.569 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.569 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.570 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:27:19.570 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.770347+0000", 2021-10-08T19:27:19.570 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7030999999999997e-05 2021-10-08T19:27:19.570 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.570 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.571 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:27:19.571 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.770390+0000", 2021-10-08T19:27:19.571 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3152000000000003e-05 2021-10-08T19:27:19.571 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:19.571 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:19.572 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:19.572 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.572 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.572 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:114117 7.2 7:4eeb0bb6:::benchmark_data_smithi097_93198_object22297:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e145)", 2021-10-08T19:27:19.573 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:53.654482+0000", 2021-10-08T19:27:19.573 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 85.605842516999999, 2021-10-08T19:27:19.573 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.117136534, 2021-10-08T19:27:19.573 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:27:19.573 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:19.574 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:27:19.574 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:27:19.574 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:27:19.574 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 114117 2021-10-08T19:27:19.574 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.575 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:27:19.575 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.575 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:27:19.575 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.654482+0000", 2021-10-08T19:27:19.575 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:27:19.576 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.576 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.576 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:27:19.576 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.654482+0000", 2021-10-08T19:27:19.576 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:27:19.577 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.577 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.577 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:27:19.577 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.654481+0000", 2021-10-08T19:27:19.578 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2021-10-08T19:27:19.578 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.578 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.578 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:27:19.579 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.654487+0000", 2021-10-08T19:27:19.579 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8390000000000003e-06 2021-10-08T19:27:19.579 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.580 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.580 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:27:19.580 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.757652+0000", 2021-10-08T19:27:19.580 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.10316533999999999 2021-10-08T19:27:19.580 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.581 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.581 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:27:19.581 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.757664+0000", 2021-10-08T19:27:19.581 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2027e-05 2021-10-08T19:27:19.581 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.582 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.582 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:27:19.582 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.757777+0000", 2021-10-08T19:27:19.582 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011273 2021-10-08T19:27:19.582 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.583 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.583 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:27:19.583 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.757905+0000", 2021-10-08T19:27:19.583 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012825600000000001 2021-10-08T19:27:19.584 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.584 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.584 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,2", 2021-10-08T19:27:19.584 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.758027+0000", 2021-10-08T19:27:19.584 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012212 2021-10-08T19:27:19.585 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.585 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.585 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:27:19.585 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.760811+0000", 2021-10-08T19:27:19.585 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002783439 2021-10-08T19:27:19.586 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.586 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.586 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:19.586 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.770429+0000", 2021-10-08T19:27:19.586 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0096182620000000007 2021-10-08T19:27:19.587 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.587 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.587 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:19.587 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.771547+0000", 2021-10-08T19:27:19.588 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001118281 2021-10-08T19:27:19.588 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.588 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.588 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:27:19.588 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.771584+0000", 2021-10-08T19:27:19.589 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6387999999999998e-05 2021-10-08T19:27:19.589 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.589 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.589 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:27:19.589 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.771619+0000", 2021-10-08T19:27:19.590 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5352999999999998e-05 2021-10-08T19:27:19.590 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:19.590 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:19.590 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:19.590 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.591 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.591 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:117018 7.a 7:502d7854:::benchmark_data_smithi097_93198_object25198:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e146)", 2021-10-08T19:27:19.591 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:57.631569+0000", 2021-10-08T19:27:19.591 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 81.628756300999996, 2021-10-08T19:27:19.592 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.126480026, 2021-10-08T19:27:19.592 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:27:19.592 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:19.592 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:27:19.593 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:27:19.593 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:27:19.593 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 117018 2021-10-08T19:27:19.593 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.593 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:27:19.594 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.594 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:27:19.594 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.631569+0000", 2021-10-08T19:27:19.594 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:27:19.595 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.595 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.595 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:27:19.595 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.631569+0000", 2021-10-08T19:27:19.595 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:27:19.596 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.596 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.596 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:27:19.596 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.631566+0000", 2021-10-08T19:27:19.596 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:27:19.597 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.597 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.597 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:27:19.597 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.631575+0000", 2021-10-08T19:27:19.597 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5629999999999992e-06 2021-10-08T19:27:19.598 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.598 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.598 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:27:19.598 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.654958+0000", 2021-10-08T19:27:19.599 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.023383459999999998 2021-10-08T19:27:19.599 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.599 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.599 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:27:19.599 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.654968+0000", 2021-10-08T19:27:19.600 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.6199999999999994e-06 2021-10-08T19:27:19.600 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.600 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.600 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:27:19.600 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.655473+0000", 2021-10-08T19:27:19.601 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00050549299999999998 2021-10-08T19:27:19.601 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.601 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.601 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:27:19.601 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.655606+0000", 2021-10-08T19:27:19.602 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000132619 2021-10-08T19:27:19.602 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.602 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.602 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2,5", 2021-10-08T19:27:19.602 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.655734+0000", 2021-10-08T19:27:19.603 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012751900000000001 2021-10-08T19:27:19.603 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.603 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.603 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:19.604 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.740618+0000", 2021-10-08T19:27:19.604 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.084884732000000004 2021-10-08T19:27:19.604 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.604 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.605 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:27:19.605 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.741122+0000", 2021-10-08T19:27:19.605 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00050392000000000004 2021-10-08T19:27:19.606 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.606 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.606 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:19.606 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.757964+0000", 2021-10-08T19:27:19.606 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016841704999999998 2021-10-08T19:27:19.607 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.607 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.607 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:27:19.607 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.758013+0000", 2021-10-08T19:27:19.607 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8973e-05 2021-10-08T19:27:19.608 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.608 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.608 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:27:19.608 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.758049+0000", 2021-10-08T19:27:19.609 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5775999999999998e-05 2021-10-08T19:27:19.609 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:19.609 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:19.609 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:19.609 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.610 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.610 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:161984 7.3 7:c4b55545:::benchmark_data_smithi097_93198_object70164:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158)", 2021-10-08T19:27:19.610 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:26:58.337369+0000", 2021-10-08T19:27:19.610 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 20.922956436, 2021-10-08T19:27:19.610 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.20481112200000001, 2021-10-08T19:27:19.611 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:27:19.611 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:19.611 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:27:19.611 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:27:19.612 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:27:19.612 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 161984 2021-10-08T19:27:19.612 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.612 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:27:19.612 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.613 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:27:19.613 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.337369+0000", 2021-10-08T19:27:19.613 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:27:19.613 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.613 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.614 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:27:19.614 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.337369+0000", 2021-10-08T19:27:19.614 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:27:19.614 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.614 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.615 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:27:19.615 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.337368+0000", 2021-10-08T19:27:19.615 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:27:19.615 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.616 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.616 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:27:19.616 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.337371+0000", 2021-10-08T19:27:19.616 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.163e-06 2021-10-08T19:27:19.616 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.617 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.617 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:27:19.617 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.337377+0000", 2021-10-08T19:27:19.617 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6779999999999997e-06 2021-10-08T19:27:19.617 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.618 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.618 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:27:19.618 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.337381+0000", 2021-10-08T19:27:19.618 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2420000000000002e-06 2021-10-08T19:27:19.618 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.619 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.619 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:27:19.619 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.337429+0000", 2021-10-08T19:27:19.619 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7874999999999998e-05 2021-10-08T19:27:19.620 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.620 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.620 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:27:19.620 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.337541+0000", 2021-10-08T19:27:19.620 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000112013 2021-10-08T19:27:19.621 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.621 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.621 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2,4", 2021-10-08T19:27:19.621 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.337658+0000", 2021-10-08T19:27:19.621 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000116932 2021-10-08T19:27:19.622 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.622 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.622 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:27:19.622 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.341428+0000", 2021-10-08T19:27:19.622 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003770476 2021-10-08T19:27:19.623 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.623 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.623 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:19.623 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.351172+0000", 2021-10-08T19:27:19.624 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0097441660000000003 2021-10-08T19:27:19.624 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.624 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.624 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:19.624 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.542065+0000", 2021-10-08T19:27:19.625 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.19089245199999999 2021-10-08T19:27:19.625 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.625 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.625 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:27:19.625 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.542131+0000", 2021-10-08T19:27:19.626 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6227000000000001e-05 2021-10-08T19:27:19.626 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.626 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.626 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:27:19.626 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.542180+0000", 2021-10-08T19:27:19.627 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8640000000000002e-05 2021-10-08T19:27:19.627 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:19.627 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:19.627 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:19.627 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.628 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.628 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:161988 7.3 7:c51c43e3:::benchmark_data_smithi097_93198_object70168:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158)", 2021-10-08T19:27:19.628 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:26:58.346404+0000", 2021-10-08T19:27:19.628 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 20.913921203000001, 2021-10-08T19:27:19.629 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.19591282500000001, 2021-10-08T19:27:19.629 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:27:19.629 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:19.629 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:27:19.629 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:27:19.630 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:27:19.630 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 161988 2021-10-08T19:27:19.630 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.630 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:27:19.630 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.631 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:27:19.631 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.346404+0000", 2021-10-08T19:27:19.631 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:27:19.631 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.631 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.632 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:27:19.632 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.346404+0000", 2021-10-08T19:27:19.632 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:27:19.632 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.632 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.633 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:27:19.633 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.346402+0000", 2021-10-08T19:27:19.633 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:27:19.633 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.634 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.634 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:27:19.634 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.346409+0000", 2021-10-08T19:27:19.634 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1899999999999998e-06 2021-10-08T19:27:19.634 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.635 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.635 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:27:19.635 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.346423+0000", 2021-10-08T19:27:19.635 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4255e-05 2021-10-08T19:27:19.635 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.636 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.636 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:27:19.636 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.346430+0000", 2021-10-08T19:27:19.636 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.285e-06 2021-10-08T19:27:19.636 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.637 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.637 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:27:19.637 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.346479+0000", 2021-10-08T19:27:19.637 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9667999999999999e-05 2021-10-08T19:27:19.637 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.638 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.638 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:27:19.638 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.346624+0000", 2021-10-08T19:27:19.638 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014466699999999999 2021-10-08T19:27:19.639 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.639 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.639 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2,4", 2021-10-08T19:27:19.639 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.346783+0000", 2021-10-08T19:27:19.639 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015919600000000001 2021-10-08T19:27:19.640 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.640 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.640 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:19.640 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.351469+0000", 2021-10-08T19:27:19.640 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0046861799999999999 2021-10-08T19:27:19.641 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.641 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.641 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:27:19.641 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.352737+0000", 2021-10-08T19:27:19.641 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012680250000000001 2021-10-08T19:27:19.642 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.642 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.642 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:19.642 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.542229+0000", 2021-10-08T19:27:19.643 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.18949191400000001 2021-10-08T19:27:19.643 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.643 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.643 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:27:19.643 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.542279+0000", 2021-10-08T19:27:19.644 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9360999999999997e-05 2021-10-08T19:27:19.644 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:19.644 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:19.644 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:27:19.644 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.542317+0000", 2021-10-08T19:27:19.645 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7957999999999998e-05 2021-10-08T19:27:19.645 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:19.645 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:19.645 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:19.645 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:19.646 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:19.646 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:27:19.646 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:27:19.647 INFO:teuthology.orchestra.run.smithi097.stderr:set pool 1 pg_num to 11 2021-10-08T19:27:19.680 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:19.749 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:27:19.752 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:19.753 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:27:19.854 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:27:19.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:19 smithi117 ceph-mon[34585]: pgmap v265: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 636 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 175 op/s; 8301/31074 objects degraded (26.714%); 1106/31074 objects misplaced (3.559%); 0 B/s, 14 objects/s recovering 2021-10-08T19:27:19.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:19 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/4127283523' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "11"}]: dispatch 2021-10-08T19:27:19.906 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:19 smithi097 ceph-mon[32687]: pgmap v265: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 636 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 175 op/s; 8301/31074 objects degraded (26.714%); 1106/31074 objects misplaced (3.559%); 0 B/s, 14 objects/s recovering 2021-10-08T19:27:19.907 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:19 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/4127283523' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "11"}]: dispatch 2021-10-08T19:27:19.910 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:19 smithi097 ceph-mon[41966]: pgmap v265: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 636 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 175 op/s; 8301/31074 objects degraded (26.714%); 1106/31074 objects misplaced (3.559%); 0 B/s, 14 objects/s recovering 2021-10-08T19:27:19.910 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:19 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/4127283523' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "11"}]: dispatch 2021-10-08T19:27:19.911 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:20.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:20 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/4127283523' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "11"}]': finished 2021-10-08T19:27:20.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:20 smithi117 ceph-mon[34585]: osdmap e168: 8 total, 8 up, 8 in 2021-10-08T19:27:20.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:20 smithi117 ceph-mon[34585]: Health check update: Degraded data redundancy: 8301/31074 objects degraded (26.714%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:27:20.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:20 smithi117 ceph-mon[34585]: osdmap e169: 8 total, 8 up, 8 in 2021-10-08T19:27:20.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:20 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num_actual", "val": "11"}]: dispatch 2021-10-08T19:27:20.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:20 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/4127283523' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "11"}]': finished 2021-10-08T19:27:20.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:20 smithi097 ceph-mon[32687]: osdmap e168: 8 total, 8 up, 8 in 2021-10-08T19:27:20.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:20 smithi097 ceph-mon[32687]: Health check update: Degraded data redundancy: 8301/31074 objects degraded (26.714%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:27:20.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:20 smithi097 ceph-mon[32687]: osdmap e169: 8 total, 8 up, 8 in 2021-10-08T19:27:20.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:20 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num_actual", "val": "11"}]: dispatch 2021-10-08T19:27:20.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:20 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/4127283523' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "11"}]': finished 2021-10-08T19:27:20.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:20 smithi097 ceph-mon[41966]: osdmap e168: 8 total, 8 up, 8 in 2021-10-08T19:27:20.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:20 smithi097 ceph-mon[41966]: Health check update: Degraded data redundancy: 8301/31074 objects degraded (26.714%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:27:20.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:20 smithi097 ceph-mon[41966]: osdmap e169: 8 total, 8 up, 8 in 2021-10-08T19:27:20.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:20 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num_actual", "val": "11"}]: dispatch 2021-10-08T19:27:21.079 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset noscrub 2021-10-08T19:27:21.467 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:27:21.475 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:21.476 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:27:21.503 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2021-10-08T19:27:21.578 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:27:21.616 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:21.694 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:27:21.702 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:21.702 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:27:21.752 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:21 smithi097 ceph-mon[41966]: pgmap v268: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 449 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 920 op/s; 8243/22125 objects degraded (37.256%); 1048/22125 objects misplaced (4.737%); 0 B/s, 43 objects/s recovering 2021-10-08T19:27:21.753 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:21 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num_actual", "val": "11"}]': finished 2021-10-08T19:27:21.753 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:21 smithi097 ceph-mon[41966]: osdmap e170: 8 total, 8 up, 8 in 2021-10-08T19:27:21.753 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:21 smithi097 ceph-mon[32687]: pgmap v268: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 449 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 920 op/s; 8243/22125 objects degraded (37.256%); 1048/22125 objects misplaced (4.737%); 0 B/s, 43 objects/s recovering 2021-10-08T19:27:21.753 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:21 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num_actual", "val": "11"}]': finished 2021-10-08T19:27:21.754 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:21 smithi097 ceph-mon[32687]: osdmap e170: 8 total, 8 up, 8 in 2021-10-08T19:27:21.803 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:27:21.875 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:21.876 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:27:21.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:21 smithi117 ceph-mon[34585]: pgmap v268: 168 pgs: 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 449 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 920 op/s; 8243/22125 objects degraded (37.256%); 1048/22125 objects misplaced (4.737%); 0 B/s, 43 objects/s recovering 2021-10-08T19:27:21.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:21 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num_actual", "val": "11"}]': finished 2021-10-08T19:27:21.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:21 smithi117 ceph-mon[34585]: osdmap e170: 8 total, 8 up, 8 in 2021-10-08T19:27:21.920 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:27:21.983 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:27:21.999 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:22.000 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:27:22.089 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:27:22.101 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:27:22.131 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:27:22.146 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:22.161 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:27:22.200 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:27:22.217 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:27:22.219 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:22.222 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:27:22.235 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:27:22.276 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:27:22.316 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:27:22.322 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:27:22.355 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:22.371 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:27:22.389 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'false' 2021-10-08T19:27:22.389 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'false' 2021-10-08T19:27:22.390 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'false' 2021-10-08T19:27:22.390 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'false' 2021-10-08T19:27:22.390 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'false' 2021-10-08T19:27:22.390 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'false' 2021-10-08T19:27:22.390 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'false' 2021-10-08T19:27:22.391 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'false' 2021-10-08T19:27:22.425 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:27:22.428 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:22.428 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:27:22.530 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:27:22.564 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:22.748 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:27:22.754 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:22 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/713798202' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:27:22.754 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:22 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": ".mgr", "var": "pgp_num_actual", "val": "11"}]: dispatch 2021-10-08T19:27:22.754 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:22 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": ".mgr", "var": "pgp_num_actual", "val": "11"}]': finished 2021-10-08T19:27:22.755 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:22 smithi117 ceph-mon[34585]: osdmap e171: 8 total, 8 up, 8 in 2021-10-08T19:27:22.755 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:22.756 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:27:22.858 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:27:22.899 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:22.957 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:27:22.959 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:22.960 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:27:22.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:22 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/713798202' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:27:22.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:22 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": ".mgr", "var": "pgp_num_actual", "val": "11"}]: dispatch 2021-10-08T19:27:22.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:22 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": ".mgr", "var": "pgp_num_actual", "val": "11"}]': finished 2021-10-08T19:27:22.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:22 smithi097 ceph-mon[41966]: osdmap e171: 8 total, 8 up, 8 in 2021-10-08T19:27:22.971 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:27:22 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:27:22] "GET /metrics HTTP/1.1" 200 155785 "" "Prometheus/2.18.1" 2021-10-08T19:27:22.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:22 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/713798202' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:27:22.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:22 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": ".mgr", "var": "pgp_num_actual", "val": "11"}]: dispatch 2021-10-08T19:27:22.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:22 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": ".mgr", "var": "pgp_num_actual", "val": "11"}]': finished 2021-10-08T19:27:22.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:22 smithi097 ceph-mon[32687]: osdmap e171: 8 total, 8 up, 8 in 2021-10-08T19:27:23.061 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:27:23.099 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:23.152 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:27:23.154 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:23.155 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:27:23.256 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:27:23.319 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:23.653 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:27:23.661 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:23.662 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:27:23.763 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:27:23.828 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:23.905 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:27:23 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:27:23] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:27:23.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:23 smithi117 ceph-mon[34585]: pgmap v270: 178 pgs: 10 unknown, 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 449 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 740 op/s; 8243/22125 objects degraded (37.256%); 1048/22125 objects misplaced (4.737%); 0 B/s, 34 objects/s recovering 2021-10-08T19:27:23.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:23 smithi117 ceph-mon[34585]: osdmap e172: 8 total, 8 up, 8 in 2021-10-08T19:27:23.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:23 smithi097 ceph-mon[32687]: pgmap v270: 178 pgs: 10 unknown, 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 449 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 740 op/s; 8243/22125 objects degraded (37.256%); 1048/22125 objects misplaced (4.737%); 0 B/s, 34 objects/s recovering 2021-10-08T19:27:23.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:23 smithi097 ceph-mon[32687]: osdmap e172: 8 total, 8 up, 8 in 2021-10-08T19:27:23.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:23 smithi097 ceph-mon[41966]: pgmap v270: 178 pgs: 10 unknown, 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 449 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 740 op/s; 8243/22125 objects degraded (37.256%); 1048/22125 objects misplaced (4.737%); 0 B/s, 34 objects/s recovering 2021-10-08T19:27:23.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:23 smithi097 ceph-mon[41966]: osdmap e172: 8 total, 8 up, 8 in 2021-10-08T19:27:24.253 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:27:24.259 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:24.260 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:27:24.361 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:27:24.418 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:24.634 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:27:24.639 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:24.640 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:27:24.741 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:27:24.766 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:24.975 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:27:24.980 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:24.982 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:27:25.083 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:27:25.137 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:25.266 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:27:25.277 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:25.277 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:27:25.379 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:27:25.430 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:25.516 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:27:25.525 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:25.526 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:27:25.539 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2021-10-08T19:27:25.539 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:27:25.575 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is unset 2021-10-08T19:27:25.628 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:27:25.670 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:25.876 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:25 smithi117 ceph-mon[34585]: pgmap v273: 178 pgs: 6 remapped+peering, 4 peering, 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 213 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 940 op/s; 8127/10791 objects degraded (75.313%); 990/10791 objects misplaced (9.174%); 0 B/s, 42 objects/s recovering 2021-10-08T19:27:25.877 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:25 smithi117 ceph-mon[34585]: osdmap e173: 8 total, 8 up, 8 in 2021-10-08T19:27:25.877 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:25 smithi117 ceph-mon[34585]: Health check failed: Reduced data availability: 2 pgs inactive, 8 pgs peering (PG_AVAILABILITY) 2021-10-08T19:27:25.877 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:25 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3429854290' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:27:25.878 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:25 smithi117 ceph-mon[34585]: from='client.35048 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:27:25.878 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:25 smithi117 ceph-mon[34585]: Health check update: Degraded data redundancy: 8127/10791 objects degraded (75.313%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:27:25.878 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:25 smithi117 ceph-mon[34585]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:27:25.878 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:25 smithi117 ceph-mon[34585]: from='client.35048 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:27:25.879 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:25 smithi117 ceph-mon[34585]: osdmap e174: 8 total, 8 up, 8 in 2021-10-08T19:27:25.949 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:27:25.951 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:25.952 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:27:25.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:25 smithi097 ceph-mon[41966]: pgmap v273: 178 pgs: 6 remapped+peering, 4 peering, 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 213 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 940 op/s; 8127/10791 objects degraded (75.313%); 990/10791 objects misplaced (9.174%); 0 B/s, 42 objects/s recovering 2021-10-08T19:27:25.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:25 smithi097 ceph-mon[41966]: osdmap e173: 8 total, 8 up, 8 in 2021-10-08T19:27:25.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:25 smithi097 ceph-mon[41966]: Health check failed: Reduced data availability: 2 pgs inactive, 8 pgs peering (PG_AVAILABILITY) 2021-10-08T19:27:25.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:25 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3429854290' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:27:25.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:25 smithi097 ceph-mon[41966]: from='client.35048 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:27:25.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:25 smithi097 ceph-mon[41966]: Health check update: Degraded data redundancy: 8127/10791 objects degraded (75.313%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:27:25.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:25 smithi097 ceph-mon[41966]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:27:25.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:25 smithi097 ceph-mon[41966]: from='client.35048 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:27:25.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:25 smithi097 ceph-mon[41966]: osdmap e174: 8 total, 8 up, 8 in 2021-10-08T19:27:25.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:25 smithi097 ceph-mon[32687]: pgmap v273: 178 pgs: 6 remapped+peering, 4 peering, 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 213 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 940 op/s; 8127/10791 objects degraded (75.313%); 990/10791 objects misplaced (9.174%); 0 B/s, 42 objects/s recovering 2021-10-08T19:27:25.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:25 smithi097 ceph-mon[32687]: osdmap e173: 8 total, 8 up, 8 in 2021-10-08T19:27:25.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:25 smithi097 ceph-mon[32687]: Health check failed: Reduced data availability: 2 pgs inactive, 8 pgs peering (PG_AVAILABILITY) 2021-10-08T19:27:25.974 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:25 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3429854290' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:27:25.974 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:25 smithi097 ceph-mon[32687]: from='client.35048 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:27:25.974 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:25 smithi097 ceph-mon[32687]: Health check update: Degraded data redundancy: 8127/10791 objects degraded (75.313%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:27:25.974 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:25 smithi097 ceph-mon[32687]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:27:25.976 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:25 smithi097 ceph-mon[32687]: from='client.35048 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:27:25.976 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:25 smithi097 ceph-mon[32687]: osdmap e174: 8 total, 8 up, 8 in 2021-10-08T19:27:26.054 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:27:26.092 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:26.130 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2021-10-08T19:27:26.170 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:27:26.172 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:26.173 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:27:26.274 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:27:26.372 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 7, 6] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2021-10-08T19:27:26.372 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2021-10-08T19:27:26.373 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd dump -f json-pretty 2021-10-08T19:27:26.374 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:26.656 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:27:26 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:27:26.696 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:27:26.704 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:26.705 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:27:26.770 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2021-10-08T19:27:26.806 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:27:26.848 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:26.893 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:27:26.956 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:27:26.961 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:27:26.963 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:26.963 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:27:27.065 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:27:27.090 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:27.479 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:27:27.481 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:27.482 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:27:27.583 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:27:27.598 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:27:27.630 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:27.708 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:27:27.711 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:27.712 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:27:27.814 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:27:27.842 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:27 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:27:27.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:27 smithi117 ceph-mon[34585]: osdmap e175: 8 total, 8 up, 8 in 2021-10-08T19:27:27.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:27 smithi117 ceph-mon[34585]: pgmap v277: 178 pgs: 6 remapped+peering, 4 peering, 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 213 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 949 op/s; 8127/10791 objects degraded (75.313%); 990/10791 objects misplaced (9.174%); 0 B/s, 43 objects/s recovering 2021-10-08T19:27:27.855 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:27.890 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Removed 91817 objects 2021-10-08T19:27:27.891 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Clean up completed and total clean up time :124.584 2021-10-08T19:27:27.921 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:27:27.923 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:27.923 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:27:27.940 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:27 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:27:27.940 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:27 smithi097 ceph-mon[41966]: osdmap e175: 8 total, 8 up, 8 in 2021-10-08T19:27:27.941 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:27 smithi097 ceph-mon[41966]: pgmap v277: 178 pgs: 6 remapped+peering, 4 peering, 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 213 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 949 op/s; 8127/10791 objects degraded (75.313%); 990/10791 objects misplaced (9.174%); 0 B/s, 43 objects/s recovering 2021-10-08T19:27:27.941 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:27 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:27:27.941 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:27 smithi097 ceph-mon[32687]: osdmap e175: 8 total, 8 up, 8 in 2021-10-08T19:27:27.942 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:27 smithi097 ceph-mon[32687]: pgmap v277: 178 pgs: 6 remapped+peering, 4 peering, 161 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 213 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 949 op/s; 8127/10791 objects degraded (75.313%); 990/10791 objects misplaced (9.174%); 0 B/s, 43 objects/s recovering 2021-10-08T19:27:28.025 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:27:28.056 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:28.154 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:27:28.159 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:28.159 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:27:28.260 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:27:28.286 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:28.482 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:27:28.485 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:28.487 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:27:28.588 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:27:28.613 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:28.730 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset nodeep-scrub 2021-10-08T19:27:29.164 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:27:29.203 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:27:29.205 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:29.206 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:27:29.308 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:27:29.341 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:29.427 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:27:29.429 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:29.430 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:27:29.531 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:27:29.559 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:29.615 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:27:29.636 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:27:29.663 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:27:29.682 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:27:29.717 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:27:29.739 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:27:29.770 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:27:29.800 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:27:29.802 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true' 2021-10-08T19:27:29.802 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true' 2021-10-08T19:27:29.802 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true' 2021-10-08T19:27:29.802 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true' 2021-10-08T19:27:29.803 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true' 2021-10-08T19:27:29.803 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true' 2021-10-08T19:27:29.803 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'true' 2021-10-08T19:27:29.804 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'true' 2021-10-08T19:27:29.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:29 smithi117 ceph-mon[34585]: pgmap v278: 178 pgs: 3 remapped+peering, 168 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 172 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 35 KiB/s rd, 265 KiB/s wr, 796 op/s; 8069/8829 objects degraded (91.392%); 990/8829 objects misplaced (11.213%); 190 KiB/s, 35 objects/s recovering 2021-10-08T19:27:29.961 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:29 smithi097 ceph-mon[41966]: pgmap v278: 178 pgs: 3 remapped+peering, 168 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 172 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 35 KiB/s rd, 265 KiB/s wr, 796 op/s; 8069/8829 objects degraded (91.392%); 990/8829 objects misplaced (11.213%); 190 KiB/s, 35 objects/s recovering 2021-10-08T19:27:29.962 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:29 smithi097 ceph-mon[32687]: pgmap v278: 178 pgs: 3 remapped+peering, 168 active+clean, 2 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 172 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 35 KiB/s rd, 265 KiB/s wr, 796 op/s; 8069/8829 objects degraded (91.392%); 990/8829 objects misplaced (11.213%); 190 KiB/s, 35 objects/s recovering 2021-10-08T19:27:29.980 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:27:29.982 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:29.983 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:27:30.084 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:27:30.113 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:30.157 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:27:30.158 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:27:30.158 INFO:teuthology.orchestra.run.smithi097.stdout: "epoch": 175, 2021-10-08T19:27:30.158 INFO:teuthology.orchestra.run.smithi097.stdout: "fsid": "1d01f6d6-286c-11ec-8c25-001a4aab830c", 2021-10-08T19:27:30.159 INFO:teuthology.orchestra.run.smithi097.stdout: "created": "2021-10-08T19:16:25.258003+0000", 2021-10-08T19:27:30.159 INFO:teuthology.orchestra.run.smithi097.stdout: "modified": "2021-10-08T19:27:26.558253+0000", 2021-10-08T19:27:30.159 INFO:teuthology.orchestra.run.smithi097.stdout: "last_up_change": "2021-10-08T19:21:15.388758+0000", 2021-10-08T19:27:30.159 INFO:teuthology.orchestra.run.smithi097.stdout: "last_in_change": "2021-10-08T19:24:24.060804+0000", 2021-10-08T19:27:30.160 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-08T19:27:30.160 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_num": 5804032, 2021-10-08T19:27:30.160 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_set": [ 2021-10-08T19:27:30.160 INFO:teuthology.orchestra.run.smithi097.stdout: "nodeep-scrub", 2021-10-08T19:27:30.161 INFO:teuthology.orchestra.run.smithi097.stdout: "pglog_hardlimit", 2021-10-08T19:27:30.161 INFO:teuthology.orchestra.run.smithi097.stdout: "purged_snapdirs", 2021-10-08T19:27:30.161 INFO:teuthology.orchestra.run.smithi097.stdout: "recovery_deletes", 2021-10-08T19:27:30.161 INFO:teuthology.orchestra.run.smithi097.stdout: "sortbitwise" 2021-10-08T19:27:30.162 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:27:30.163 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_version": 18, 2021-10-08T19:27:30.163 INFO:teuthology.orchestra.run.smithi097.stdout: "full_ratio": 0.94999998807907104, 2021-10-08T19:27:30.163 INFO:teuthology.orchestra.run.smithi097.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-08T19:27:30.163 INFO:teuthology.orchestra.run.smithi097.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-08T19:27:30.164 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_snapshot": "", 2021-10-08T19:27:30.164 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_max": 7, 2021-10-08T19:27:30.164 INFO:teuthology.orchestra.run.smithi097.stdout: "max_osd": 8, 2021-10-08T19:27:30.164 INFO:teuthology.orchestra.run.smithi097.stdout: "require_min_compat_client": "luminous", 2021-10-08T19:27:30.164 INFO:teuthology.orchestra.run.smithi097.stdout: "min_compat_client": "luminous", 2021-10-08T19:27:30.165 INFO:teuthology.orchestra.run.smithi097.stdout: "require_osd_release": "quincy", 2021-10-08T19:27:30.165 INFO:teuthology.orchestra.run.smithi097.stdout: "pools": [ 2021-10-08T19:27:30.165 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.165 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 1, 2021-10-08T19:27:30.166 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": ".mgr", 2021-10-08T19:27:30.166 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:19:44.413311+0000", 2021-10-08T19:27:30.167 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:27:30.168 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:27:30.168 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:27:30.168 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:27:30.168 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:27:30.169 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:27:30.169 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:27:30.169 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:27:30.169 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:27:30.170 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:27:30.170 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:27:30.170 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:27:30.170 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 11, 2021-10-08T19:27:30.170 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 11, 2021-10-08T19:27:30.171 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 11, 2021-10-08T19:27:30.171 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 11, 2021-10-08T19:27:30.171 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 11, 2021-10-08T19:27:30.171 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:27:30.172 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:27:30.172 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:27:30.172 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:27:30.172 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:27:30.173 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:27:30.173 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:27:30.174 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.174 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "171", 2021-10-08T19:27:30.174 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:27:30.174 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:27:30.175 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "170", 2021-10-08T19:27:30.175 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:27:30.175 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:27:30.175 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:27:30.175 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:27:30.176 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:27:30.176 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:27:30.176 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:27:30.176 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:27:30.176 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:27:30.177 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:27:30.177 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:27:30.177 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:27:30.177 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:27:30.178 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:27:30.178 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:27:30.178 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:27:30.178 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:27:30.179 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:27:30.179 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:27:30.179 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:27:30.179 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:27:30.179 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:27:30.180 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:27:30.180 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.180 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:27:30.180 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:27:30.181 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:27:30.181 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:27:30.181 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:27:30.181 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:27:30.182 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:27:30.182 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:27:30.182 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:27:30.182 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:27:30.182 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:27:30.183 INFO:teuthology.orchestra.run.smithi097.stdout: "options": { 2021-10-08T19:27:30.183 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_min": 1 2021-10-08T19:27:30.183 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.183 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:27:30.183 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": {} 2021-10-08T19:27:30.184 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:30.184 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.184 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.184 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 2, 2021-10-08T19:27:30.185 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": ".rgw.root", 2021-10-08T19:27:30.185 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:21:21.940881+0000", 2021-10-08T19:27:30.185 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:27:30.185 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:27:30.185 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:27:30.186 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:27:30.186 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:27:30.186 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:27:30.186 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:27:30.187 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:27:30.187 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:27:30.187 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:27:30.187 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:27:30.187 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:27:30.188 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 32, 2021-10-08T19:27:30.188 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 32, 2021-10-08T19:27:30.188 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 32, 2021-10-08T19:27:30.188 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 32, 2021-10-08T19:27:30.188 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 32, 2021-10-08T19:27:30.189 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:27:30.189 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:27:30.189 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:27:30.189 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:27:30.190 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:27:30.190 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:27:30.190 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:27:30.190 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.191 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "62", 2021-10-08T19:27:30.191 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:27:30.191 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:27:30.191 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2021-10-08T19:27:30.191 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:27:30.192 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:27:30.192 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:27:30.192 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:27:30.192 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:27:30.192 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:27:30.193 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:27:30.193 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:27:30.193 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:27:30.193 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:27:30.194 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:27:30.194 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:27:30.194 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:27:30.194 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:27:30.194 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:27:30.195 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:27:30.195 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:27:30.195 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:27:30.195 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:27:30.196 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:27:30.196 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:27:30.196 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:27:30.196 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:27:30.196 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.197 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:27:30.197 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:27:30.197 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:27:30.197 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:27:30.197 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:27:30.198 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:27:30.198 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:27:30.198 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:27:30.198 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:27:30.199 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:27:30.199 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:27:30.200 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2021-10-08T19:27:30.200 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:27:30.200 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw": {} 2021-10-08T19:27:30.200 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:30.200 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.201 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.201 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 3, 2021-10-08T19:27:30.201 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "iscsi", 2021-10-08T19:27:30.201 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:21:22.536945+0000", 2021-10-08T19:27:30.202 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:27:30.202 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:27:30.202 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:27:30.202 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:27:30.202 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:27:30.203 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:27:30.203 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:27:30.203 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:27:30.203 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:27:30.204 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:27:30.204 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:27:30.204 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:27:30.204 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 23, 2021-10-08T19:27:30.204 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 23, 2021-10-08T19:27:30.205 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 23, 2021-10-08T19:27:30.205 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 23, 2021-10-08T19:27:30.205 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 23, 2021-10-08T19:27:30.205 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:27:30.205 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:27:30.206 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:27:30.206 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:27:30.206 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:27:30.206 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:27:30.207 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:27:30.207 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.207 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "132", 2021-10-08T19:27:30.207 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:27:30.207 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:27:30.208 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "131", 2021-10-08T19:27:30.208 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:27:30.208 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:27:30.208 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:27:30.209 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:27:30.209 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:27:30.209 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:27:30.209 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:27:30.209 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:27:30.210 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:27:30.210 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:27:30.210 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:27:30.210 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:27:30.210 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:27:30.211 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:27:30.211 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:27:30.211 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:27:30.211 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:27:30.212 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:27:30.212 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:27:30.212 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:27:30.212 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:27:30.212 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:27:30.213 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:27:30.213 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.213 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:27:30.213 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:27:30.214 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:27:30.214 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:27:30.214 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:27:30.214 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:27:30.215 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:27:30.215 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:27:30.215 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:27:30.215 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:27:30.216 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:27:30.216 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2021-10-08T19:27:30.216 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:27:30.216 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd": {} 2021-10-08T19:27:30.216 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:30.217 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.217 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.217 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 4, 2021-10-08T19:27:30.217 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "default.rgw.log", 2021-10-08T19:27:30.218 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:21:23.886328+0000", 2021-10-08T19:27:30.218 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:27:30.218 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:27:30.218 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:27:30.218 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:27:30.219 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:27:30.220 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:27:30.220 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:27:30.220 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:27:30.220 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:27:30.220 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:27:30.221 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:27:30.221 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:27:30.221 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 32, 2021-10-08T19:27:30.221 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 32, 2021-10-08T19:27:30.222 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 32, 2021-10-08T19:27:30.222 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 32, 2021-10-08T19:27:30.222 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 32, 2021-10-08T19:27:30.222 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:27:30.223 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:27:30.223 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:27:30.223 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:27:30.223 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:27:30.223 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:27:30.224 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:27:30.224 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.224 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "64", 2021-10-08T19:27:30.224 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:27:30.224 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:27:30.225 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2021-10-08T19:27:30.225 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:27:30.225 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:27:30.225 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:27:30.226 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:27:30.226 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:27:30.226 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:27:30.226 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:27:30.226 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:27:30.227 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:27:30.227 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:27:30.227 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:27:30.227 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:27:30.228 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:27:30.228 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:27:30.228 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:27:30.228 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:27:30.229 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:27:30.229 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:27:30.229 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:27:30.229 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:27:30.229 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:27:30.230 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:27:30.230 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:27:30.230 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.230 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:27:30.231 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:27:30.231 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:27:30.231 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:27:30.231 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:27:30.231 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:27:30.232 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:27:30.232 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:27:30.232 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:27:30.232 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:27:30.233 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:27:30.233 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2021-10-08T19:27:30.233 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:27:30.233 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw": {} 2021-10-08T19:27:30.233 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:30.234 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.234 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.234 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 5, 2021-10-08T19:27:30.234 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "default.rgw.control", 2021-10-08T19:27:30.234 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:21:25.865032+0000", 2021-10-08T19:27:30.235 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:27:30.235 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:27:30.235 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:27:30.235 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:27:30.236 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:27:30.236 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:27:30.236 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:27:30.236 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:27:30.236 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:27:30.237 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:27:30.237 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:27:30.237 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:27:30.237 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 32, 2021-10-08T19:27:30.237 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 32, 2021-10-08T19:27:30.238 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 32, 2021-10-08T19:27:30.238 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 32, 2021-10-08T19:27:30.238 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 32, 2021-10-08T19:27:30.238 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:27:30.239 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:27:30.239 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:27:30.239 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:27:30.239 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:27:30.239 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:27:30.240 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:27:30.240 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.240 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "66", 2021-10-08T19:27:30.240 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:27:30.240 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:27:30.241 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2021-10-08T19:27:30.241 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:27:30.241 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:27:30.241 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:27:30.242 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:27:30.242 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:27:30.242 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:27:30.242 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:27:30.242 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:27:30.243 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:27:30.243 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:27:30.243 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:27:30.243 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:27:30.244 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:27:30.244 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:27:30.244 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:27:30.244 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:27:30.244 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:27:30.245 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:27:30.245 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:27:30.245 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:27:30.245 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:27:30.245 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:27:30.246 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:27:30.246 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.246 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:27:30.246 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:27:30.247 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:27:30.247 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:27:30.247 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:27:30.247 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:27:30.247 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:27:30.248 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:27:30.251 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:27:30.252 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:27:30.252 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:27:30.252 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2021-10-08T19:27:30.253 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:27:30.253 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw": {} 2021-10-08T19:27:30.253 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:30.253 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.254 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.254 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 6, 2021-10-08T19:27:30.254 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "default.rgw.meta", 2021-10-08T19:27:30.254 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:21:27.940767+0000", 2021-10-08T19:27:30.255 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:27:30.255 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:27:30.255 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:27:30.255 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:27:30.255 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:27:30.256 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:27:30.256 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:27:30.256 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:27:30.256 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:27:30.257 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:27:30.257 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:27:30.257 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:27:30.257 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 32, 2021-10-08T19:27:30.257 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 32, 2021-10-08T19:27:30.258 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 32, 2021-10-08T19:27:30.258 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 32, 2021-10-08T19:27:30.258 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 32, 2021-10-08T19:27:30.258 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:27:30.259 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:27:30.259 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:27:30.259 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:27:30.259 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:27:30.260 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:27:30.260 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:27:30.260 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.260 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "69", 2021-10-08T19:27:30.260 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:27:30.261 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:27:30.261 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2021-10-08T19:27:30.261 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:27:30.261 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:27:30.262 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:27:30.262 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:27:30.262 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:27:30.262 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:27:30.263 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:27:30.263 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:27:30.263 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:27:30.263 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:27:30.263 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:27:30.264 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:27:30.264 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:27:30.264 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:27:30.264 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:27:30.265 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:27:30.265 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:27:30.265 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:27:30.265 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:27:30.266 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:27:30.266 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:27:30.266 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:27:30.266 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:27:30.267 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.267 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:27:30.267 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:27:30.267 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:27:30.267 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:27:30.268 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:27:30.268 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:27:30.268 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:27:30.268 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:27:30.269 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:27:30.269 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:27:30.269 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:27:30.270 INFO:teuthology.orchestra.run.smithi097.stdout: "options": { 2021-10-08T19:27:30.270 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_bias": 4, 2021-10-08T19:27:30.270 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_min": 8 2021-10-08T19:27:30.270 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.271 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:27:30.271 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw": {} 2021-10-08T19:27:30.271 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:30.272 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.272 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.272 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 7, 2021-10-08T19:27:30.272 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "unique_pool_0", 2021-10-08T19:27:30.273 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:23:43.485480+0000", 2021-10-08T19:27:30.273 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:27:30.273 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:27:30.273 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:27:30.274 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:27:30.274 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:27:30.274 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:27:30.274 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:27:30.274 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:27:30.275 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:27:30.275 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:27:30.275 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:27:30.275 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:27:30.276 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 16, 2021-10-08T19:27:30.276 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 16, 2021-10-08T19:27:30.276 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 16, 2021-10-08T19:27:30.276 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 16, 2021-10-08T19:27:30.276 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 16, 2021-10-08T19:27:30.277 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:27:30.277 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:27:30.277 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:27:30.277 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:27:30.277 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:27:30.278 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:27:30.278 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:27:30.278 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.278 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "98", 2021-10-08T19:27:30.279 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:27:30.279 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:27:30.279 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2021-10-08T19:27:30.279 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:27:30.279 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:27:30.280 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:27:30.280 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:27:30.280 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:27:30.280 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:27:30.281 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:27:30.281 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:27:30.281 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:27:30.281 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:27:30.281 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:27:30.282 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:27:30.282 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:27:30.282 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:27:30.282 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:27:30.282 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:27:30.283 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:27:30.283 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:27:30.283 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:27:30.283 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:27:30.284 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:27:30.284 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:27:30.284 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:27:30.284 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.284 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:27:30.285 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:27:30.285 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:27:30.285 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:27:30.285 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:27:30.286 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:27:30.286 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:27:30.286 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:27:30.286 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:27:30.286 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:27:30.287 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:27:30.287 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2021-10-08T19:27:30.287 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:27:30.287 INFO:teuthology.orchestra.run.smithi097.stdout: "rados": {} 2021-10-08T19:27:30.288 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:30.288 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:30.288 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:27:30.288 INFO:teuthology.orchestra.run.smithi097.stdout: "osds": [ 2021-10-08T19:27:30.288 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.289 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 0, 2021-10-08T19:27:30.289 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "9e64e714-a5d5-4fbb-ae2b-1df4bf14b8e0", 2021-10-08T19:27:30.289 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:27:30.289 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:27:30.289 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:27:30.290 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:27:30.290 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:27:30.290 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:27:30.290 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 8, 2021-10-08T19:27:30.291 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 173, 2021-10-08T19:27:30.291 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:27:30.291 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:27:30.291 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:27:30.291 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:30.292 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.292 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:30.292 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6801", 2021-10-08T19:27:30.292 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3354161282 2021-10-08T19:27:30.293 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:30.293 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:30.293 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.293 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:27:30.293 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:30.294 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.294 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:30.294 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6802", 2021-10-08T19:27:30.294 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3354161282 2021-10-08T19:27:30.295 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:30.295 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:30.295 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.295 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:27:30.295 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:30.296 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.296 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:30.296 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6804", 2021-10-08T19:27:30.296 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3354161282 2021-10-08T19:27:30.297 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:30.297 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:30.297 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.297 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:27:30.297 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:30.298 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.298 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:30.298 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6803", 2021-10-08T19:27:30.298 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3354161282 2021-10-08T19:27:30.299 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:30.299 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:30.299 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.299 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.97:6801/3354161282", 2021-10-08T19:27:30.299 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.97:6802/3354161282", 2021-10-08T19:27:30.300 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.97:6804/3354161282", 2021-10-08T19:27:30.300 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.97:6803/3354161282", 2021-10-08T19:27:30.300 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:27:30.300 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:27:30.301 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:27:30.301 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:30.301 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.301 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.301 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 1, 2021-10-08T19:27:30.302 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "32602a22-f263-4b62-a8d8-50fddfb73fa8", 2021-10-08T19:27:30.302 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:27:30.302 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:27:30.302 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:27:30.303 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:27:30.303 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:27:30.303 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:27:30.303 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 13, 2021-10-08T19:27:30.304 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 174, 2021-10-08T19:27:30.304 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:27:30.304 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:27:30.304 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:27:30.305 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:30.305 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.305 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:30.305 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6805", 2021-10-08T19:27:30.306 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 735799205 2021-10-08T19:27:30.306 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:30.306 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:30.307 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.307 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:27:30.307 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:30.307 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.308 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:30.308 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6806", 2021-10-08T19:27:30.308 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 735799205 2021-10-08T19:27:30.308 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:30.308 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:30.309 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.309 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:27:30.309 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:30.309 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.310 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:30.310 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6808", 2021-10-08T19:27:30.310 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 735799205 2021-10-08T19:27:30.310 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:30.310 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:30.311 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.311 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:27:30.311 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:30.311 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.312 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:30.312 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6807", 2021-10-08T19:27:30.312 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 735799205 2021-10-08T19:27:30.312 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:30.312 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:30.313 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.313 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.97:6805/735799205", 2021-10-08T19:27:30.313 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.97:6806/735799205", 2021-10-08T19:27:30.314 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.97:6808/735799205", 2021-10-08T19:27:30.314 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.97:6807/735799205", 2021-10-08T19:27:30.314 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:27:30.314 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:27:30.314 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:27:30.315 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:30.315 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.315 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.315 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 2, 2021-10-08T19:27:30.316 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "88e0e4a2-b4a3-4a00-8669-03c3d9b166c5", 2021-10-08T19:27:30.316 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:27:30.316 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:27:30.316 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:27:30.316 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:27:30.317 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:27:30.317 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:27:30.317 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 18, 2021-10-08T19:27:30.317 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 113, 2021-10-08T19:27:30.318 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:27:30.318 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:27:30.318 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:27:30.318 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:30.318 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.319 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:30.319 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6809", 2021-10-08T19:27:30.319 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2366482649 2021-10-08T19:27:30.319 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:30.320 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:30.320 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.320 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:27:30.320 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:30.320 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.321 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:30.321 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6810", 2021-10-08T19:27:30.321 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2366482649 2021-10-08T19:27:30.321 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:30.321 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:30.322 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.322 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:27:30.322 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:30.322 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.323 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:30.323 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6812", 2021-10-08T19:27:30.323 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2366482649 2021-10-08T19:27:30.323 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:30.323 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:30.324 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.324 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:27:30.324 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:30.324 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.325 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:30.325 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6811", 2021-10-08T19:27:30.325 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2366482649 2021-10-08T19:27:30.325 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:30.326 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:30.326 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.326 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.97:6809/2366482649", 2021-10-08T19:27:30.327 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.97:6810/2366482649", 2021-10-08T19:27:30.327 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.97:6812/2366482649", 2021-10-08T19:27:30.327 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.97:6811/2366482649", 2021-10-08T19:27:30.327 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:27:30.327 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:27:30.328 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:27:30.328 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:30.328 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.329 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.329 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 3, 2021-10-08T19:27:30.329 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "e689d708-b501-4526-a31a-1e598b74654d", 2021-10-08T19:27:30.329 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:27:30.330 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:27:30.330 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:27:30.330 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:27:30.330 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:27:30.331 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:27:30.331 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 24, 2021-10-08T19:27:30.331 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 171, 2021-10-08T19:27:30.331 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:27:30.332 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:27:30.332 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:27:30.332 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:30.332 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.333 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:30.333 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6813", 2021-10-08T19:27:30.333 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3191181122 2021-10-08T19:27:30.333 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:30.333 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:30.334 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.334 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:27:30.334 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:30.334 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.335 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:30.335 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6814", 2021-10-08T19:27:30.335 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3191181122 2021-10-08T19:27:30.335 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:30.335 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:30.336 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.336 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:27:30.336 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:30.336 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.337 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:30.337 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6816", 2021-10-08T19:27:30.337 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3191181122 2021-10-08T19:27:30.337 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:30.338 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:30.338 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.338 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:27:30.338 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:30.339 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.339 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:30.339 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6815", 2021-10-08T19:27:30.340 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3191181122 2021-10-08T19:27:30.340 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:30.340 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:30.340 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.341 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.97:6813/3191181122", 2021-10-08T19:27:30.341 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.97:6814/3191181122", 2021-10-08T19:27:30.341 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.97:6816/3191181122", 2021-10-08T19:27:30.341 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.97:6815/3191181122", 2021-10-08T19:27:30.342 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:27:30.342 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:27:30.342 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:27:30.342 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:30.342 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.343 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.343 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 4, 2021-10-08T19:27:30.343 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "67e4730a-be1c-4d88-9307-e3c2cf3ab2ef", 2021-10-08T19:27:30.343 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:27:30.343 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:27:30.344 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:27:30.344 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:27:30.344 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:27:30.344 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:27:30.345 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 30, 2021-10-08T19:27:30.345 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 174, 2021-10-08T19:27:30.345 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:27:30.345 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:27:30.345 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:27:30.346 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:30.346 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.346 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:30.346 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6800", 2021-10-08T19:27:30.347 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 106778208 2021-10-08T19:27:30.347 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:30.347 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:30.347 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.348 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:27:30.348 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:30.348 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.348 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:30.349 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6801", 2021-10-08T19:27:30.349 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 106778208 2021-10-08T19:27:30.349 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:30.349 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:30.349 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.350 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:27:30.350 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:30.350 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.351 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:30.351 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6803", 2021-10-08T19:27:30.351 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 106778208 2021-10-08T19:27:30.351 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:30.352 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:30.352 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.352 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:27:30.353 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:30.353 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.353 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:30.353 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6802", 2021-10-08T19:27:30.354 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 106778208 2021-10-08T19:27:30.354 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:30.354 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:30.355 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.355 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.117:6800/106778208", 2021-10-08T19:27:30.355 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.117:6801/106778208", 2021-10-08T19:27:30.355 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.117:6803/106778208", 2021-10-08T19:27:30.355 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.117:6802/106778208", 2021-10-08T19:27:30.356 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:27:30.356 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:27:30.356 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:27:30.356 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:30.357 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.357 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.357 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 5, 2021-10-08T19:27:30.357 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "f9fd3153-3e4e-4489-8927-a65641f05d42", 2021-10-08T19:27:30.357 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:27:30.358 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:27:30.358 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:27:30.358 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:27:30.359 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:27:30.360 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:27:30.360 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 38, 2021-10-08T19:27:30.361 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 174, 2021-10-08T19:27:30.362 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:27:30.362 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:27:30.362 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:27:30.363 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:30.363 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.363 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:30.363 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6804", 2021-10-08T19:27:30.363 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3199889891 2021-10-08T19:27:30.364 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:30.364 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:30.364 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.364 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:27:30.365 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:30.365 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.365 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:30.365 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6805", 2021-10-08T19:27:30.366 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3199889891 2021-10-08T19:27:30.366 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:30.366 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:30.366 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.366 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:27:30.367 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:30.367 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.367 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:30.367 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6807", 2021-10-08T19:27:30.368 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3199889891 2021-10-08T19:27:30.368 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:30.368 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:30.369 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.369 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:27:30.369 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:30.369 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.370 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:30.370 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6806", 2021-10-08T19:27:30.370 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3199889891 2021-10-08T19:27:30.370 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:30.371 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:30.371 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.371 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.117:6804/3199889891", 2021-10-08T19:27:30.371 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.117:6805/3199889891", 2021-10-08T19:27:30.372 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.117:6807/3199889891", 2021-10-08T19:27:30.372 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.117:6806/3199889891", 2021-10-08T19:27:30.372 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:27:30.372 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:27:30.373 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:27:30.373 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:30.373 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.373 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.374 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 6, 2021-10-08T19:27:30.374 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "84898f12-c37d-4eb6-8b71-5b86bfe16e7d", 2021-10-08T19:27:30.374 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:27:30.374 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:27:30.375 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:27:30.375 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:27:30.375 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:27:30.375 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:27:30.375 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 47, 2021-10-08T19:27:30.376 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 174, 2021-10-08T19:27:30.376 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:27:30.376 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:27:30.376 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:27:30.377 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:30.377 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.377 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:30.377 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6808", 2021-10-08T19:27:30.377 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2185843951 2021-10-08T19:27:30.378 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:30.378 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:30.378 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.378 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:27:30.379 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:30.379 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.379 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:30.379 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6809", 2021-10-08T19:27:30.379 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2185843951 2021-10-08T19:27:30.380 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:30.380 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:30.380 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.380 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:27:30.381 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:30.381 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.381 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:30.381 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6811", 2021-10-08T19:27:30.381 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2185843951 2021-10-08T19:27:30.382 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:30.382 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:30.382 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.382 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:27:30.383 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:30.383 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.383 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:30.383 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6810", 2021-10-08T19:27:30.384 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2185843951 2021-10-08T19:27:30.384 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:30.384 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:30.384 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.384 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.117:6808/2185843951", 2021-10-08T19:27:30.385 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.117:6809/2185843951", 2021-10-08T19:27:30.385 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.117:6811/2185843951", 2021-10-08T19:27:30.385 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.117:6810/2185843951", 2021-10-08T19:27:30.385 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:27:30.386 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:27:30.386 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:27:30.386 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:30.386 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.386 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.387 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 7, 2021-10-08T19:27:30.387 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "529af2ce-2ae9-41ed-8c8e-d133628cfd20", 2021-10-08T19:27:30.387 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:27:30.387 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:27:30.388 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:27:30.388 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:27:30.388 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:27:30.388 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:27:30.388 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 55, 2021-10-08T19:27:30.389 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 174, 2021-10-08T19:27:30.389 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:27:30.389 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:27:30.389 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:27:30.390 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:30.390 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.390 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:30.390 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6812", 2021-10-08T19:27:30.390 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2817683239 2021-10-08T19:27:30.391 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:30.391 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:30.391 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.391 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:27:30.392 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:30.392 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.392 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:30.392 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6813", 2021-10-08T19:27:30.393 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2817683239 2021-10-08T19:27:30.393 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:30.393 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:30.393 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.393 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:27:30.394 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:30.394 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.394 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:30.394 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6815", 2021-10-08T19:27:30.395 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2817683239 2021-10-08T19:27:30.395 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:30.395 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:30.395 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.395 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:27:30.396 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:30.396 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.396 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:30.396 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6814", 2021-10-08T19:27:30.397 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2817683239 2021-10-08T19:27:30.397 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:30.397 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:30.397 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.397 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.117:6812/2817683239", 2021-10-08T19:27:30.398 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.117:6813/2817683239", 2021-10-08T19:27:30.398 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.117:6815/2817683239", 2021-10-08T19:27:30.398 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.117:6814/2817683239", 2021-10-08T19:27:30.398 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:27:30.399 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:27:30.399 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:27:30.399 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:30.399 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:30.399 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:27:30.400 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_xinfo": [ 2021-10-08T19:27:30.400 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.400 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 0, 2021-10-08T19:27:30.400 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:27:30.401 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:27:30.401 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:27:30.401 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:27:30.401 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:27:30.401 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:27:00.020315+0000", 2021-10-08T19:27:30.402 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:27:30.402 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.402 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.402 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 1, 2021-10-08T19:27:30.403 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:27:30.403 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:27:30.403 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:27:30.403 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:27:30.404 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:27:30.404 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:27:03.975227+0000", 2021-10-08T19:27:30.404 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:27:30.404 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.404 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.405 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 2, 2021-10-08T19:27:30.405 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:27:30.405 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:27:30.405 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:27:30.406 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:27:30.406 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:27:30.406 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:26:52.444313+0000", 2021-10-08T19:27:30.406 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:27:30.406 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.407 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.407 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 3, 2021-10-08T19:27:30.407 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:27:30.407 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:27:30.407 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:27:30.408 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:27:30.408 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:27:30.408 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:27:00.853222+0000", 2021-10-08T19:27:30.408 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:27:30.409 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.409 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.409 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 4, 2021-10-08T19:27:30.409 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:27:30.409 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:27:30.410 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:27:30.410 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:27:30.410 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:27:30.410 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:26:59.839375+0000", 2021-10-08T19:27:30.411 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:27:30.411 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.411 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.411 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 5, 2021-10-08T19:27:30.411 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:27:30.412 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:27:30.412 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:27:30.412 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:27:30.412 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:27:30.413 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:26:32.959964+0000", 2021-10-08T19:27:30.413 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:27:30.413 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.413 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.413 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 6, 2021-10-08T19:27:30.414 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:27:30.414 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:27:30.414 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:27:30.414 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:27:30.415 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:27:30.415 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:27:15.875830+0000", 2021-10-08T19:27:30.415 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:27:30.415 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.415 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.416 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 7, 2021-10-08T19:27:30.416 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:27:30.416 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:27:30.416 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:27:30.417 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:27:30.417 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:27:30.417 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:27:14.154194+0000", 2021-10-08T19:27:30.417 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:27:30.417 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:30.418 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:27:30.418 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_upmap": [], 2021-10-08T19:27:30.418 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_upmap_items": [ 2021-10-08T19:27:30.418 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.419 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "2.0", 2021-10-08T19:27:30.419 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:27:30.419 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.419 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 7, 2021-10-08T19:27:30.419 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 2 2021-10-08T19:27:30.420 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:30.420 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:30.420 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.420 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.420 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "2.1a", 2021-10-08T19:27:30.421 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:27:30.421 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.421 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 7, 2021-10-08T19:27:30.421 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 2 2021-10-08T19:27:30.422 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:30.422 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:30.422 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.422 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.422 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "4.14", 2021-10-08T19:27:30.423 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:27:30.423 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.423 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 3, 2021-10-08T19:27:30.423 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 2 2021-10-08T19:27:30.424 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:30.424 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:30.424 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.424 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.424 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "4.1c", 2021-10-08T19:27:30.425 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:27:30.425 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.425 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 1, 2021-10-08T19:27:30.425 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 5 2021-10-08T19:27:30.425 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:30.426 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:30.426 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.426 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.426 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "5.19", 2021-10-08T19:27:30.427 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:27:30.427 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.427 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 5, 2021-10-08T19:27:30.427 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 7 2021-10-08T19:27:30.427 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:30.428 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:30.428 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:30.428 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:27:30.428 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_temp": [ 2021-10-08T19:27:30.428 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.429 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "1.4", 2021-10-08T19:27:30.429 INFO:teuthology.orchestra.run.smithi097.stdout: "osds": [ 2021-10-08T19:27:30.429 INFO:teuthology.orchestra.run.smithi097.stdout: 0, 2021-10-08T19:27:30.429 INFO:teuthology.orchestra.run.smithi097.stdout: 7 2021-10-08T19:27:30.430 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:30.430 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.430 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.430 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "1.8", 2021-10-08T19:27:30.431 INFO:teuthology.orchestra.run.smithi097.stdout: "osds": [ 2021-10-08T19:27:30.431 INFO:teuthology.orchestra.run.smithi097.stdout: 0, 2021-10-08T19:27:30.431 INFO:teuthology.orchestra.run.smithi097.stdout: 2 2021-10-08T19:27:30.431 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:30.431 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.432 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.432 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "7.1", 2021-10-08T19:27:30.432 INFO:teuthology.orchestra.run.smithi097.stdout: "osds": [ 2021-10-08T19:27:30.432 INFO:teuthology.orchestra.run.smithi097.stdout: 4, 2021-10-08T19:27:30.432 INFO:teuthology.orchestra.run.smithi097.stdout: 3 2021-10-08T19:27:30.433 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:30.433 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.433 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.433 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "7.7", 2021-10-08T19:27:30.434 INFO:teuthology.orchestra.run.smithi097.stdout: "osds": [ 2021-10-08T19:27:30.434 INFO:teuthology.orchestra.run.smithi097.stdout: 0, 2021-10-08T19:27:30.434 INFO:teuthology.orchestra.run.smithi097.stdout: 3 2021-10-08T19:27:30.434 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:30.434 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.435 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.435 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "7.b", 2021-10-08T19:27:30.435 INFO:teuthology.orchestra.run.smithi097.stdout: "osds": [ 2021-10-08T19:27:30.435 INFO:teuthology.orchestra.run.smithi097.stdout: 1, 2021-10-08T19:27:30.436 INFO:teuthology.orchestra.run.smithi097.stdout: 5 2021-10-08T19:27:30.436 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:30.436 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.436 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.436 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "7.c", 2021-10-08T19:27:30.437 INFO:teuthology.orchestra.run.smithi097.stdout: "osds": [ 2021-10-08T19:27:30.437 INFO:teuthology.orchestra.run.smithi097.stdout: 2, 2021-10-08T19:27:30.437 INFO:teuthology.orchestra.run.smithi097.stdout: 3, 2021-10-08T19:27:30.437 INFO:teuthology.orchestra.run.smithi097.stdout: 7 2021-10-08T19:27:30.437 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:30.438 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.438 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:30.438 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "7.d", 2021-10-08T19:27:30.438 INFO:teuthology.orchestra.run.smithi097.stdout: "osds": [ 2021-10-08T19:27:30.439 INFO:teuthology.orchestra.run.smithi097.stdout: 1, 2021-10-08T19:27:30.439 INFO:teuthology.orchestra.run.smithi097.stdout: 0 2021-10-08T19:27:30.439 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:30.439 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:30.439 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:27:30.440 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_temp": [], 2021-10-08T19:27:30.440 INFO:teuthology.orchestra.run.smithi097.stdout: "blocklist": { 2021-10-08T19:27:30.440 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/2600364788": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:27:30.440 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/4129083289": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:27:30.440 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/1443158975": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:27:30.441 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/2472640384": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:27:30.441 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/3196919488": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:27:30.441 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:6800/3195862546": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:27:30.441 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:6800/3931202434": "2021-10-09T19:17:10.051948+0000", 2021-10-08T19:27:30.442 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/2761595213": "2021-10-09T19:17:10.051948+0000", 2021-10-08T19:27:30.442 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/900681504": "2021-10-09T19:17:10.051948+0000", 2021-10-08T19:27:30.442 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/3932251406": "2021-10-09T19:17:10.051948+0000", 2021-10-08T19:27:30.442 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/398006785": "2021-10-09T19:16:48.651177+0000", 2021-10-08T19:27:30.442 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/1642570050": "2021-10-09T19:16:48.651177+0000", 2021-10-08T19:27:30.443 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/300178790": "2021-10-09T19:16:48.651177+0000", 2021-10-08T19:27:30.443 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:6800/845999767": "2021-10-09T19:16:48.651177+0000" 2021-10-08T19:27:30.443 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.443 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profiles": { 2021-10-08T19:27:30.444 INFO:teuthology.orchestra.run.smithi097.stdout: "default": { 2021-10-08T19:27:30.444 INFO:teuthology.orchestra.run.smithi097.stdout: "crush-failure-domain": "osd", 2021-10-08T19:27:30.444 INFO:teuthology.orchestra.run.smithi097.stdout: "k": "2", 2021-10-08T19:27:30.444 INFO:teuthology.orchestra.run.smithi097.stdout: "m": "1", 2021-10-08T19:27:30.445 INFO:teuthology.orchestra.run.smithi097.stdout: "plugin": "jerasure", 2021-10-08T19:27:30.445 INFO:teuthology.orchestra.run.smithi097.stdout: "technique": "reed_sol_van" 2021-10-08T19:27:30.445 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:30.445 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:30.445 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps_queue": [], 2021-10-08T19:27:30.446 INFO:teuthology.orchestra.run.smithi097.stdout: "new_removed_snaps": [], 2021-10-08T19:27:30.446 INFO:teuthology.orchestra.run.smithi097.stdout: "new_purged_snaps": [], 2021-10-08T19:27:30.446 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_node_flags": {}, 2021-10-08T19:27:30.446 INFO:teuthology.orchestra.run.smithi097.stdout: "device_class_flags": {}, 2021-10-08T19:27:30.447 INFO:teuthology.orchestra.run.smithi097.stdout: "stretch_mode": { 2021-10-08T19:27:30.447 INFO:teuthology.orchestra.run.smithi097.stdout: "stretch_mode_enabled": false, 2021-10-08T19:27:30.447 INFO:teuthology.orchestra.run.smithi097.stdout: "stretch_bucket_count": 0, 2021-10-08T19:27:30.447 INFO:teuthology.orchestra.run.smithi097.stdout: "degraded_stretch_mode": 0, 2021-10-08T19:27:30.448 INFO:teuthology.orchestra.run.smithi097.stdout: "recovering_stretch_mode": 0, 2021-10-08T19:27:30.448 INFO:teuthology.orchestra.run.smithi097.stdout: "stretch_mode_bucket": 0 2021-10-08T19:27:30.448 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:30.448 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:27:30.449 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:30.450 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:27:30.450 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:27:30.502 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:27:30.503 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2021-10-08T19:27:30.503 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2021-10-08T19:27:30.503 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2021-10-08T19:27:30.504 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:27:30.551 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:27:30.585 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:30.786 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:27:30.789 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:30 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3565246407' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:27:30.789 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:30 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1705503669' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2021-10-08T19:27:30.789 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:30 smithi117 ceph-mon[34585]: Health check update: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2021-10-08T19:27:30.790 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:30 smithi117 ceph-mon[34585]: Health check update: Degraded data redundancy: 8069/8829 objects degraded (91.392%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:27:30.790 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:30.791 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:27:30.892 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:27:30.914 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:30 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3565246407' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:27:30.914 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:30 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1705503669' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2021-10-08T19:27:30.914 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:30 smithi097 ceph-mon[41966]: Health check update: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2021-10-08T19:27:30.915 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:30 smithi097 ceph-mon[41966]: Health check update: Degraded data redundancy: 8069/8829 objects degraded (91.392%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:27:30.915 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:30 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3565246407' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:27:30.915 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:30 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1705503669' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2021-10-08T19:27:30.916 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:30 smithi097 ceph-mon[32687]: Health check update: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2021-10-08T19:27:30.916 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:30 smithi097 ceph-mon[32687]: Health check update: Degraded data redundancy: 8069/8829 objects degraded (91.392%), 6 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:27:30.916 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:30.964 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:27:30.966 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:30.967 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:27:31.068 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:27:31.092 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:31.385 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:27:31.388 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:31.388 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:27:31.390 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2021-10-08T19:27:31.490 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:27:31.517 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:31.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:31 smithi117 ceph-mon[34585]: pgmap v279: 178 pgs: 169 active+clean, 2 active+recovering+undersized+degraded+remapped, 4 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 582 KiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 567 op/s; 8013/585 objects degraded (1369.744%); 933/585 objects misplaced (159.487%); 0 B/s, 29 objects/s recovering 2021-10-08T19:27:31.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:31 smithi117 ceph-mon[34585]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2021-10-08T19:27:31.717 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:27:31.720 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:31.721 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:27:31.732 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:27:31.780 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:31 smithi097 ceph-mon[41966]: pgmap v279: 178 pgs: 169 active+clean, 2 active+recovering+undersized+degraded+remapped, 4 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 582 KiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 567 op/s; 8013/585 objects degraded (1369.744%); 933/585 objects misplaced (159.487%); 0 B/s, 29 objects/s recovering 2021-10-08T19:27:31.781 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:31 smithi097 ceph-mon[41966]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2021-10-08T19:27:31.782 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:31 smithi097 ceph-mon[32687]: pgmap v279: 178 pgs: 169 active+clean, 2 active+recovering+undersized+degraded+remapped, 4 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 582 KiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 567 op/s; 8013/585 objects degraded (1369.744%); 933/585 objects misplaced (159.487%); 0 B/s, 29 objects/s recovering 2021-10-08T19:27:31.782 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:31 smithi097 ceph-mon[32687]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2021-10-08T19:27:31.783 INFO:tasks.thrashosds.thrasher:j is {'epoch': 175, 'fsid': '1d01f6d6-286c-11ec-8c25-001a4aab830c', 'created': '2021-10-08T19:16:25.258003+0000', 'modified': '2021-10-08T19:27:26.558253+0000', 'last_up_change': '2021-10-08T19:21:15.388758+0000', 'last_in_change': '2021-10-08T19:24:24.060804+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 18, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 7, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'quincy', 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2021-10-08T19:19:44.413311+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 11, 'pg_placement_num': 11, 'pg_placement_num_target': 11, 'pg_num_target': 11, 'pg_num_pending': 11, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '171', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '170', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': '.rgw.root', 'create_time': '2021-10-08T19:21:21.940881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 3, 'pool_name': 'iscsi', 'create_time': '2021-10-08T19:21:22.536945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 23, 'pg_placement_num': 23, 'pg_placement_num_target': 23, 'pg_num_target': 23, 'pg_num_pending': 23, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '132', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '131', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 4, 'pool_name': 'default.rgw.log', 'create_time': '2021-10-08T19:21:23.886328+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 5, 'pool_name': 'default.rgw.control', 'create_time': '2021-10-08T19:21:25.865032+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 6, 'pool_name': 'default.rgw.meta', 'create_time': '2021-10-08T19:21:27.940767+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '69', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 8}, 'application_metadata': {'rgw': {}}}, {'pool': 7, 'pool_name': 'unique_pool_0', 'create_time': '2021-10-08T19:23:43.485480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '98', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}], 'osds': [{'osd': 0, 'uuid': '9e64e714-a5d5-4fbb-ae2b-1df4bf14b8e0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 173, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6801', 'nonce': 3354161282}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6802', 'nonce': 3354161282}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6804', 'nonce': 3354161282}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6803', 'nonce': 3354161282}]}, 'public_addr': '172.21.15.97:6801/3354161282', 'cluster_addr': '172.21.15.97:6802/3354161282', 'heartbeat_back_addr': '172.21.15.97:6804/3354161282', 'heartbeat_front_addr': '172.21.15.97:6803/3354161282', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '32602a22-f263-4b62-a8d8-50fddfb73fa8', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 174, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6805', 'nonce': 735799205}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6806', 'nonce': 735799205}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6808', 'nonce': 735799205}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6807', 'nonce': 735799205}]}, 'public_addr': '172.21.15.97:6805/735799205', 'cluster_addr': '172.21.15.97:6806/735799205', 'heartbeat_back_addr': '172.21.15.97:6808/735799205', 'heartbeat_front_addr': '172.21.15.97:6807/735799205', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '88e0e4a2-b4a3-4a00-8669-03c3d9b166c5', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 18, 'up_thru': 113, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6809', 'nonce': 2366482649}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6810', 'nonce': 2366482649}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6812', 'nonce': 2366482649}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6811', 'nonce': 2366482649}]}, 'public_addr': '172.21.15.97:6809/2366482649', 'cluster_addr': '172.21.15.97:6810/2366482649', 'heartbeat_back_addr': '172.21.15.97:6812/2366482649', 'heartbeat_front_addr': '172.21.15.97:6811/2366482649', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': 'e689d708-b501-4526-a31a-1e598b74654d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 24, 'up_thru': 171, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6813', 'nonce': 3191181122}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6814', 'nonce': 3191181122}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6816', 'nonce': 3191181122}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6815', 'nonce': 3191181122}]}, 'public_addr': '172.21.15.97:6813/3191181122', 'cluster_addr': '172.21.15.97:6814/3191181122', 'heartbeat_back_addr': '172.21.15.97:6816/3191181122', 'heartbeat_front_addr': '172.21.15.97:6815/3191181122', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '67e4730a-be1c-4d88-9307-e3c2cf3ab2ef', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 30, 'up_thru': 174, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6800', 'nonce': 106778208}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6801', 'nonce': 106778208}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6803', 'nonce': 106778208}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6802', 'nonce': 106778208}]}, 'public_addr': '172.21.15.117:6800/106778208', 'cluster_addr': '172.21.15.117:6801/106778208', 'heartbeat_back_addr': '172.21.15.117:6803/106778208', 'heartbeat_front_addr': '172.21.15.117:6802/106778208', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'f9fd3153-3e4e-4489-8927-a65641f05d42', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 38, 'up_thru': 174, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6804', 'nonce': 3199889891}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6805', 'nonce': 3199889891}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6807', 'nonce': 3199889891}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6806', 'nonce': 3199889891}]}, 'public_addr': '172.21.15.117:6804/3199889891', 'cluster_addr': '172.21.15.117:6805/3199889891', 'heartbeat_back_addr': '172.21.15.117:6807/3199889891', 'heartbeat_front_addr': '172.21.15.117:6806/3199889891', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '84898f12-c37d-4eb6-8b71-5b86bfe16e7d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 47, 'up_thru': 174, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6808', 'nonce': 2185843951}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6809', 'nonce': 2185843951}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6811', 'nonce': 2185843951}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6810', 'nonce': 2185843951}]}, 'public_addr': '172.21.15.117:6808/2185843951', 'cluster_addr': '172.21.15.117:6809/2185843951', 'heartbeat_back_addr': '172.21.15.117:6811/2185843951', 'heartbeat_front_addr': '172.21.15.117:6810/2185843951', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '529af2ce-2ae9-41ed-8c8e-d133628cfd20', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 55, 'up_thru': 174, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6812', 'nonce': 2817683239}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6813', 'nonce': 2817683239}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6815', 'nonce': 2817683239}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6814', 'nonce': 2817683239}]}, 'public_addr': '172.21.15.117:6812/2817683239', 'cluster_addr': '172.21.15.117:6813/2817683239', 'heartbeat_back_addr': '172.21.15.117:6815/2817683239', 'heartbeat_front_addr': '172.21.15.117:6814/2817683239', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:27:00.020315+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:27:03.975227+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:26:52.444313+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:27:00.853222+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:26:59.839375+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:26:32.959964+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:27:15.875830+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:27:14.154194+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [{'pgid': '2.0', 'mappings': [{'from': 7, 'to': 2}]}, {'pgid': '2.1a', 'mappings': [{'from': 7, 'to': 2}]}, {'pgid': '4.14', 'mappings': [{'from': 3, 'to': 2}]}, {'pgid': '4.1c', 'mappings': [{'from': 1, 'to': 5}]}, {'pgid': '5.19', 'mappings': [{'from': 5, 'to': 7}]}], 'pg_temp': [{'pgid': '1.4', 'osds': [0, 7]}, {'pgid': '1.8', 'osds': [0, 2]}, {'pgid': '7.1', 'osds': [4, 3]}, {'pgid': '7.7', 'osds': [0, 3]}, {'pgid': '7.b', 'osds': [1, 5]}, {'pgid': '7.c', 'osds': [2, 3, 7]}, {'pgid': '7.d', 'osds': [1, 0]}], 'primary_temp': [], 'blocklist': {'172.21.15.97:0/2600364788': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:0/4129083289': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:0/1443158975': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:0/2472640384': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:0/3196919488': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:6800/3195862546': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:6800/3931202434': '2021-10-09T19:17:10.051948+0000', '172.21.15.97:0/2761595213': '2021-10-09T19:17:10.051948+0000', '172.21.15.97:0/900681504': '2021-10-09T19:17:10.051948+0000', '172.21.15.97:0/3932251406': '2021-10-09T19:17:10.051948+0000', '172.21.15.97:0/398006785': '2021-10-09T19:16:48.651177+0000', '172.21.15.97:0/1642570050': '2021-10-09T19:16:48.651177+0000', '172.21.15.97:0/300178790': '2021-10-09T19:16:48.651177+0000', '172.21.15.97:6800/845999767': '2021-10-09T19:16:48.651177+0000'}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2021-10-08T19:27:31.784 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2021-10-08T19:27:31.823 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:27:31.848 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:31.897 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:27:31.899 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:31.899 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:27:32.000 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:27:32.027 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:32.073 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:27:32.077 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:32.078 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:27:32.179 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:27:32.207 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:32.310 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:27:32.314 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:32.314 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:27:32.405 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:27:32 smithi117 conmon[69189]: level=error ts=2021-10-08T19:27:32.314Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=1 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:27:32.416 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:27:32.440 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:32.490 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:27:32.492 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:32.493 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:27:32.594 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:27:32.598 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is unset 2021-10-08T19:27:32.619 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:32.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:32 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3199371131' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:27:32.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:32 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3199371131' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:27:32.721 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:27:32 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:27:32] "GET /metrics HTTP/1.1" 200 155865 "" "Prometheus/2.18.1" 2021-10-08T19:27:32.729 INFO:tasks.cephadm.ceph_manager.ceph:removing pool_name unique_pool_0 2021-10-08T19:27:32.730 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2021-10-08T19:27:32.772 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:27:32.775 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:32.775 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:27:32.877 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:27:32.901 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:32 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3199371131' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:27:32.903 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:33.107 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2021-10-08T19:27:33.186 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:27:33.188 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:33.189 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:27:33.229 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:27:33.289 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:27:33.314 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:33.413 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:27:33.415 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:33.416 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:27:33.518 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:27:33.545 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:33.695 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:27:33.700 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:33.700 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:27:33.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:33 smithi097 ceph-mon[41966]: pgmap v280: 178 pgs: 169 active+clean, 2 active+recovering+undersized+degraded+remapped, 4 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 582 KiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 641 B/s rd, 0 B/s wr, 427 op/s; 8013/585 objects degraded (1369.744%); 933/585 objects misplaced (159.487%); 0 B/s, 22 objects/s recovering 2021-10-08T19:27:33.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:33 smithi097 ceph-mon[41966]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:27:33.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:33 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3199371131' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:27:33.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:33 smithi097 ceph-mon[41966]: osdmap e176: 8 total, 8 up, 8 in 2021-10-08T19:27:33.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:33 smithi097 ceph-mon[32687]: pgmap v280: 178 pgs: 169 active+clean, 2 active+recovering+undersized+degraded+remapped, 4 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 582 KiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 641 B/s rd, 0 B/s wr, 427 op/s; 8013/585 objects degraded (1369.744%); 933/585 objects misplaced (159.487%); 0 B/s, 22 objects/s recovering 2021-10-08T19:27:33.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:33 smithi097 ceph-mon[32687]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:27:33.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:33 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3199371131' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:27:33.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:33 smithi097 ceph-mon[32687]: osdmap e176: 8 total, 8 up, 8 in 2021-10-08T19:27:33.788 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:27:33.795 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:33 smithi117 ceph-mon[34585]: pgmap v280: 178 pgs: 169 active+clean, 2 active+recovering+undersized+degraded+remapped, 4 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 582 KiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 641 B/s rd, 0 B/s wr, 427 op/s; 8013/585 objects degraded (1369.744%); 933/585 objects misplaced (159.487%); 0 B/s, 22 objects/s recovering 2021-10-08T19:27:33.796 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:33 smithi117 ceph-mon[34585]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:27:33.796 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:33 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3199371131' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:27:33.796 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:33 smithi117 ceph-mon[34585]: osdmap e176: 8 total, 8 up, 8 in 2021-10-08T19:27:33.802 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:27:33.834 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:33.979 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:27:33.981 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:33.982 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:27:34.027 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:27:34.027 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2021-10-08T19:27:34.028 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2021-10-08T19:27:34.028 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2021-10-08T19:27:34.029 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.029 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:31351 7.1 7:803eed4f:::benchmark_data_smithi097_93198_object31350:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2021-10-08T19:27:34.030 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:24:09.085708+0000", 2021-10-08T19:27:34.030 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 204.93676286499999, 2021-10-08T19:27:34.030 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.091722185999999997, 2021-10-08T19:27:34.030 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:27:34.031 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:34.031 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:27:34.031 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:27:34.031 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:27:34.031 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 31351 2021-10-08T19:27:34.032 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.032 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:27:34.032 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.032 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:27:34.033 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.085708+0000", 2021-10-08T19:27:34.033 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:34.033 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.034 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.034 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:27:34.034 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.085708+0000", 2021-10-08T19:27:34.034 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:34.035 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.035 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.035 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:27:34.035 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.085707+0000", 2021-10-08T19:27:34.036 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:27:34.036 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.036 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.036 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:27:34.037 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.085797+0000", 2021-10-08T19:27:34.037 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0183e-05 2021-10-08T19:27:34.037 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.037 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.038 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:27:34.038 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.085807+0000", 2021-10-08T19:27:34.038 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0045e-05 2021-10-08T19:27:34.038 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.039 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.039 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:27:34.039 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.085811+0000", 2021-10-08T19:27:34.039 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.3490000000000002e-06 2021-10-08T19:27:34.040 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.040 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.040 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:27:34.040 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.085853+0000", 2021-10-08T19:27:34.040 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1343e-05 2021-10-08T19:27:34.041 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.041 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.041 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:27:34.041 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.085997+0000", 2021-10-08T19:27:34.041 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014453900000000001 2021-10-08T19:27:34.042 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.042 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.042 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 1,3", 2021-10-08T19:27:34.042 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.086159+0000", 2021-10-08T19:27:34.043 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016215399999999999 2021-10-08T19:27:34.043 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.043 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.044 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:27:34.044 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.087414+0000", 2021-10-08T19:27:34.044 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001254551 2021-10-08T19:27:34.044 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.045 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.045 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:34.045 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.087568+0000", 2021-10-08T19:27:34.045 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015427099999999999 2021-10-08T19:27:34.045 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.046 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.046 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:34.046 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.177346+0000", 2021-10-08T19:27:34.046 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.089778122000000002 2021-10-08T19:27:34.048 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.048 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.048 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:27:34.049 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.177383+0000", 2021-10-08T19:27:34.050 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6227999999999999e-05 2021-10-08T19:27:34.050 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.051 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.051 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:27:34.052 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.177431+0000", 2021-10-08T19:27:34.052 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7889999999999997e-05 2021-10-08T19:27:34.053 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:34.053 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:27:34.054 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:34.054 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.055 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.055 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:32139 7.1 7:8e4329a1:::benchmark_data_smithi097_93198_object32138:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2021-10-08T19:27:34.056 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:24:09.661725+0000", 2021-10-08T19:27:34.056 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 204.360746111, 2021-10-08T19:27:34.057 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.096579021000000001, 2021-10-08T19:27:34.057 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:27:34.058 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:34.058 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:27:34.059 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:27:34.059 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:27:34.059 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 32139 2021-10-08T19:27:34.060 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.060 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:27:34.061 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.061 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:27:34.062 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.661725+0000", 2021-10-08T19:27:34.062 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:34.062 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.063 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.063 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:27:34.063 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.661725+0000", 2021-10-08T19:27:34.064 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:34.064 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.064 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.065 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:27:34.065 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.661724+0000", 2021-10-08T19:27:34.065 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:27:34.066 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.066 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.067 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:27:34.067 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.661781+0000", 2021-10-08T19:27:34.067 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7639000000000002e-05 2021-10-08T19:27:34.067 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.068 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.068 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:27:34.068 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.661792+0000", 2021-10-08T19:27:34.068 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0529e-05 2021-10-08T19:27:34.068 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.069 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.069 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:27:34.069 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.661797+0000", 2021-10-08T19:27:34.069 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9579999999999998e-06 2021-10-08T19:27:34.070 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.070 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.070 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:27:34.070 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.661839+0000", 2021-10-08T19:27:34.070 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2072e-05 2021-10-08T19:27:34.071 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.071 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.071 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:27:34.071 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.661939+0000", 2021-10-08T19:27:34.072 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000100263 2021-10-08T19:27:34.072 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.072 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.072 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 1,3", 2021-10-08T19:27:34.073 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.662039+0000", 2021-10-08T19:27:34.073 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9848999999999999e-05 2021-10-08T19:27:34.073 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.073 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.073 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:27:34.074 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.662967+0000", 2021-10-08T19:27:34.074 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00092829499999999999 2021-10-08T19:27:34.074 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.074 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.075 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:34.075 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.664733+0000", 2021-10-08T19:27:34.075 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001765656 2021-10-08T19:27:34.075 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.076 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.076 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:34.076 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.758236+0000", 2021-10-08T19:27:34.076 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.093502627000000005 2021-10-08T19:27:34.076 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.077 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.077 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:27:34.077 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.758279+0000", 2021-10-08T19:27:34.077 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2907000000000001e-05 2021-10-08T19:27:34.077 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.078 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.078 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:27:34.078 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.758304+0000", 2021-10-08T19:27:34.078 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.561e-05 2021-10-08T19:27:34.079 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:34.079 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:27:34.079 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:34.079 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.080 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.080 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:35716 7.1 7:8e2c561f:::benchmark_data_smithi097_93198_object35715:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106)", 2021-10-08T19:27:34.080 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:24:12.268638+0000", 2021-10-08T19:27:34.080 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 201.75383299999999, 2021-10-08T19:27:34.080 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.13454338800000001, 2021-10-08T19:27:34.081 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:27:34.081 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:34.081 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:27:34.081 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:27:34.081 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:27:34.082 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 35716 2021-10-08T19:27:34.082 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.082 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:27:34.083 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.083 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:27:34.083 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:12.268638+0000", 2021-10-08T19:27:34.084 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:34.084 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.085 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.085 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:27:34.086 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:12.268638+0000", 2021-10-08T19:27:34.086 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:34.087 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.087 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.087 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:27:34.088 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:12.268636+0000", 2021-10-08T19:27:34.088 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:27:34.089 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.089 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.090 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:27:34.090 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:12.268687+0000", 2021-10-08T19:27:34.091 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0484e-05 2021-10-08T19:27:34.091 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.091 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.092 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:27:34.092 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:12.268699+0000", 2021-10-08T19:27:34.093 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1719000000000001e-05 2021-10-08T19:27:34.093 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.094 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.094 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:27:34.095 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:12.268704+0000", 2021-10-08T19:27:34.095 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4639999999999997e-06 2021-10-08T19:27:34.096 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.096 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.097 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:27:34.097 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:12.268743+0000", 2021-10-08T19:27:34.097 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8729000000000001e-05 2021-10-08T19:27:34.098 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.098 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.099 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:27:34.099 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:12.268836+0000", 2021-10-08T19:27:34.100 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3214999999999994e-05 2021-10-08T19:27:34.100 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.100 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.101 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 1,3", 2021-10-08T19:27:34.101 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:12.268934+0000", 2021-10-08T19:27:34.102 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7851999999999998e-05 2021-10-08T19:27:34.102 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.103 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.104 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:27:34.104 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:12.269968+0000", 2021-10-08T19:27:34.104 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001034407 2021-10-08T19:27:34.105 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.105 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.105 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:34.105 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:12.270351+0000", 2021-10-08T19:27:34.106 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00038286899999999998 2021-10-08T19:27:34.106 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.106 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.106 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:34.107 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:12.403088+0000", 2021-10-08T19:27:34.107 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.132736671 2021-10-08T19:27:34.107 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.107 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.107 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:27:34.108 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:12.403144+0000", 2021-10-08T19:27:34.108 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5810999999999998e-05 2021-10-08T19:27:34.108 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.108 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.109 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:27:34.109 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:12.403182+0000", 2021-10-08T19:27:34.109 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8037999999999997e-05 2021-10-08T19:27:34.109 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:34.110 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:27:34.110 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:34.110 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.110 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.111 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:40766 7.1 7:85f5c7b7:::benchmark_data_smithi097_93198_object40765:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2021-10-08T19:27:34.111 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:24:16.432171+0000", 2021-10-08T19:27:34.111 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 197.59030043499999, 2021-10-08T19:27:34.112 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.107571416, 2021-10-08T19:27:34.112 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:27:34.112 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:34.112 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:27:34.113 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:27:34.113 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:27:34.113 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 40766 2021-10-08T19:27:34.113 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.113 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:27:34.114 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.114 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:27:34.114 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.432171+0000", 2021-10-08T19:27:34.114 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:34.115 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.115 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.115 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:27:34.115 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.432171+0000", 2021-10-08T19:27:34.115 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:34.116 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.116 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.116 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:27:34.116 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.432169+0000", 2021-10-08T19:27:34.117 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:27:34.117 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.117 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.117 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:27:34.117 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.432266+0000", 2021-10-08T19:27:34.118 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7022999999999996e-05 2021-10-08T19:27:34.118 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.118 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.118 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:27:34.119 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.432282+0000", 2021-10-08T19:27:34.119 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5789000000000001e-05 2021-10-08T19:27:34.119 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.119 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.120 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:27:34.120 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.432287+0000", 2021-10-08T19:27:34.120 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2900000000000002e-06 2021-10-08T19:27:34.120 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.121 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.121 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:27:34.121 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.432337+0000", 2021-10-08T19:27:34.121 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9429999999999999e-05 2021-10-08T19:27:34.121 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.122 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.122 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:27:34.122 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.432443+0000", 2021-10-08T19:27:34.122 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010613200000000001 2021-10-08T19:27:34.123 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.123 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.123 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 1,3", 2021-10-08T19:27:34.123 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.432546+0000", 2021-10-08T19:27:34.124 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000102989 2021-10-08T19:27:34.124 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.124 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.125 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:27:34.125 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.434341+0000", 2021-10-08T19:27:34.125 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001795622 2021-10-08T19:27:34.125 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.126 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.126 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:34.126 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.434898+0000", 2021-10-08T19:27:34.126 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000556925 2021-10-08T19:27:34.127 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.127 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.127 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:34.127 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.539661+0000", 2021-10-08T19:27:34.128 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.104763155 2021-10-08T19:27:34.128 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.128 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.128 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:27:34.129 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.539701+0000", 2021-10-08T19:27:34.129 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9249000000000003e-05 2021-10-08T19:27:34.129 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.129 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.130 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:27:34.130 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.539742+0000", 2021-10-08T19:27:34.130 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1561999999999999e-05 2021-10-08T19:27:34.130 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:34.130 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:27:34.131 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:34.131 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.131 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.131 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:52411 7.1 7:86acd6d8:::benchmark_data_smithi097_93198_object52410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117)", 2021-10-08T19:27:34.132 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:24:30.672134+0000", 2021-10-08T19:27:34.132 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 183.35033674499999, 2021-10-08T19:27:34.132 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.088977871, 2021-10-08T19:27:34.132 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:27:34.133 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:34.133 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:27:34.133 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:27:34.133 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:27:34.133 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 52411 2021-10-08T19:27:34.134 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.134 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:27:34.134 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.134 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:27:34.135 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.672134+0000", 2021-10-08T19:27:34.135 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:34.135 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.135 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.135 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:27:34.136 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.672134+0000", 2021-10-08T19:27:34.136 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:34.136 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.136 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.137 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:27:34.137 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.672132+0000", 2021-10-08T19:27:34.137 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:27:34.138 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.138 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.138 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:27:34.138 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.672185+0000", 2021-10-08T19:27:34.138 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.3332999999999999e-05 2021-10-08T19:27:34.139 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.139 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.139 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:27:34.139 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.672200+0000", 2021-10-08T19:27:34.140 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4072e-05 2021-10-08T19:27:34.140 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.140 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.141 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:27:34.141 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.672206+0000", 2021-10-08T19:27:34.141 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.993e-06 2021-10-08T19:27:34.141 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.141 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.142 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:27:34.142 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.672249+0000", 2021-10-08T19:27:34.142 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.3961000000000001e-05 2021-10-08T19:27:34.142 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.143 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.143 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:27:34.143 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.672379+0000", 2021-10-08T19:27:34.143 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012968999999999999 2021-10-08T19:27:34.144 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.144 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.144 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 3,6", 2021-10-08T19:27:34.145 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.672589+0000", 2021-10-08T19:27:34.145 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000210022 2021-10-08T19:27:34.145 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.145 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.146 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:27:34.146 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.674241+0000", 2021-10-08T19:27:34.146 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0016521929999999999 2021-10-08T19:27:34.147 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.147 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.147 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:34.147 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.676005+0000", 2021-10-08T19:27:34.147 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001763545 2021-10-08T19:27:34.148 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.148 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.148 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:34.149 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.759409+0000", 2021-10-08T19:27:34.149 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.083404108000000005 2021-10-08T19:27:34.149 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.149 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.149 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:27:34.150 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.759455+0000", 2021-10-08T19:27:34.150 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.6254000000000001e-05 2021-10-08T19:27:34.150 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.150 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.151 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:27:34.151 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.761112+0000", 2021-10-08T19:27:34.151 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001657057 2021-10-08T19:27:34.151 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:34.152 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:27:34.152 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:34.152 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.152 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.152 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:117006 7.1 7:89df6efd:::benchmark_data_smithi097_93198_object25186:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e146)", 2021-10-08T19:27:34.153 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:25:57.609765+0000", 2021-10-08T19:27:34.153 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 96.412706314000005, 2021-10-08T19:27:34.153 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.12628213299999999, 2021-10-08T19:27:34.153 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:27:34.153 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:34.154 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:27:34.154 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:27:34.154 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:27:34.155 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 117006 2021-10-08T19:27:34.155 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.155 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:27:34.155 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.156 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:27:34.156 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.609765+0000", 2021-10-08T19:27:34.156 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:34.156 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.156 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.157 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:27:34.157 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.609765+0000", 2021-10-08T19:27:34.157 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:34.157 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.158 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.158 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:27:34.158 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.609762+0000", 2021-10-08T19:27:34.158 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999971 2021-10-08T19:27:34.158 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.159 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.159 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:27:34.159 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.609770+0000", 2021-10-08T19:27:34.159 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3019999999999995e-06 2021-10-08T19:27:34.160 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.160 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.160 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:27:34.160 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.609786+0000", 2021-10-08T19:27:34.160 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5743000000000002e-05 2021-10-08T19:27:34.161 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.161 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.161 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:27:34.161 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.609793+0000", 2021-10-08T19:27:34.162 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.764e-06 2021-10-08T19:27:34.162 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.162 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.162 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:27:34.162 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.613988+0000", 2021-10-08T19:27:34.163 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004194723 2021-10-08T19:27:34.163 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.163 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.163 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2021-10-08T19:27:34.164 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.614080+0000", 2021-10-08T19:27:34.164 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.2621999999999995e-05 2021-10-08T19:27:34.164 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.164 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.165 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:27:34.165 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.619927+0000", 2021-10-08T19:27:34.165 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0058469389999999998 2021-10-08T19:27:34.165 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.166 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.166 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:27:34.166 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.620047+0000", 2021-10-08T19:27:34.166 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011939599999999999 2021-10-08T19:27:34.166 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.167 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.167 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 3,6", 2021-10-08T19:27:34.167 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.620238+0000", 2021-10-08T19:27:34.167 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00019126200000000001 2021-10-08T19:27:34.168 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.168 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.168 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:27:34.168 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.632525+0000", 2021-10-08T19:27:34.168 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012286728 2021-10-08T19:27:34.169 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.169 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.169 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:34.169 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.633274+0000", 2021-10-08T19:27:34.169 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00074901099999999995 2021-10-08T19:27:34.170 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.170 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.170 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:34.170 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.735394+0000", 2021-10-08T19:27:34.171 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.10211999099999999 2021-10-08T19:27:34.171 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.171 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.171 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:27:34.171 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.735429+0000", 2021-10-08T19:27:34.172 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.5151999999999998e-05 2021-10-08T19:27:34.172 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.172 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.173 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:27:34.173 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.736047+0000", 2021-10-08T19:27:34.174 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000618258 2021-10-08T19:27:34.174 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:34.174 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:27:34.174 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:34.175 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.175 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.175 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:117014 7.1 7:8f0e063d:::benchmark_data_smithi097_93198_object25194:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e146)", 2021-10-08T19:27:34.175 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:25:57.622073+0000", 2021-10-08T19:27:34.176 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 96.400398249999995, 2021-10-08T19:27:34.176 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.114659727, 2021-10-08T19:27:34.176 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:27:34.176 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:34.177 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:27:34.177 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:27:34.177 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:27:34.177 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 117014 2021-10-08T19:27:34.177 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.178 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:27:34.178 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.178 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:27:34.178 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.622073+0000", 2021-10-08T19:27:34.179 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:34.179 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.179 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.179 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:27:34.180 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.622073+0000", 2021-10-08T19:27:34.181 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:34.181 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.181 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.182 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:27:34.182 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.622071+0000", 2021-10-08T19:27:34.182 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:27:34.182 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.182 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.183 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:27:34.183 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.622078+0000", 2021-10-08T19:27:34.183 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7950000000000002e-06 2021-10-08T19:27:34.183 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.184 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.184 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:27:34.184 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.622089+0000", 2021-10-08T19:27:34.184 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0703000000000001e-05 2021-10-08T19:27:34.185 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.185 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.185 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:27:34.185 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.622095+0000", 2021-10-08T19:27:34.185 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7170000000000002e-06 2021-10-08T19:27:34.186 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.186 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.186 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:27:34.186 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.622630+0000", 2021-10-08T19:27:34.187 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00053484300000000002 2021-10-08T19:27:34.187 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.187 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.187 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:27:34.187 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.622768+0000", 2021-10-08T19:27:34.188 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013772799999999999 2021-10-08T19:27:34.188 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.188 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.188 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 3,6", 2021-10-08T19:27:34.188 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.622918+0000", 2021-10-08T19:27:34.189 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014995500000000001 2021-10-08T19:27:34.189 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.189 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.189 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:27:34.189 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.632535+0000", 2021-10-08T19:27:34.190 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0096170979999999993 2021-10-08T19:27:34.190 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.190 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.190 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:34.191 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.633309+0000", 2021-10-08T19:27:34.191 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00077388200000000004 2021-10-08T19:27:34.191 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.191 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.191 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:34.192 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.736104+0000", 2021-10-08T19:27:34.192 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.102794785 2021-10-08T19:27:34.192 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.192 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.192 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:27:34.193 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.736144+0000", 2021-10-08T19:27:34.193 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0638e-05 2021-10-08T19:27:34.193 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.194 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.195 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:27:34.195 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.736733+0000", 2021-10-08T19:27:34.195 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00058851599999999997 2021-10-08T19:27:34.195 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:34.195 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:27:34.196 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:34.196 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.197 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.197 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:117015 7.1 7:8e662d21:::benchmark_data_smithi097_93198_object25195:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e146)", 2021-10-08T19:27:34.198 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:25:57.622105+0000", 2021-10-08T19:27:34.198 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 96.400365957999995, 2021-10-08T19:27:34.198 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.123142053, 2021-10-08T19:27:34.198 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:27:34.199 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:34.199 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:27:34.199 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:27:34.199 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:27:34.200 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 117015 2021-10-08T19:27:34.200 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.200 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:27:34.200 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.200 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:27:34.201 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.622105+0000", 2021-10-08T19:27:34.201 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:34.201 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.201 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.202 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:27:34.202 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.622105+0000", 2021-10-08T19:27:34.202 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:34.202 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.202 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.203 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:27:34.203 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.622105+0000", 2021-10-08T19:27:34.203 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999995 2021-10-08T19:27:34.203 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.204 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.204 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:27:34.204 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.622108+0000", 2021-10-08T19:27:34.204 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.3950000000000001e-06 2021-10-08T19:27:34.204 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.205 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.205 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:27:34.205 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.622120+0000", 2021-10-08T19:27:34.205 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.166e-05 2021-10-08T19:27:34.206 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.206 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.206 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:27:34.207 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.622124+0000", 2021-10-08T19:27:34.208 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8579999999999999e-06 2021-10-08T19:27:34.208 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.208 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.208 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:27:34.209 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.625234+0000", 2021-10-08T19:27:34.209 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031095820000000001 2021-10-08T19:27:34.209 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.209 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.209 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:27:34.210 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.625394+0000", 2021-10-08T19:27:34.210 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016029600000000001 2021-10-08T19:27:34.210 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.210 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.211 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 3,6", 2021-10-08T19:27:34.211 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.625557+0000", 2021-10-08T19:27:34.211 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000163065 2021-10-08T19:27:34.211 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.211 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.212 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:27:34.212 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.632540+0000", 2021-10-08T19:27:34.212 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0069821589999999999 2021-10-08T19:27:34.212 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.212 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.213 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:34.213 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.634341+0000", 2021-10-08T19:27:34.213 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018017459999999999 2021-10-08T19:27:34.213 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.214 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.214 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:34.214 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.743952+0000", 2021-10-08T19:27:34.215 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.109610323 2021-10-08T19:27:34.215 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.215 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.215 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:27:34.216 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.744013+0000", 2021-10-08T19:27:34.216 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1184000000000002e-05 2021-10-08T19:27:34.217 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.217 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.217 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:27:34.218 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.745247+0000", 2021-10-08T19:27:34.218 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001234466 2021-10-08T19:27:34.218 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:34.219 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:27:34.219 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:34.219 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.219 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.220 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:129449 7.1 7:83497706:::benchmark_data_smithi097_93198_object37629:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e149)", 2021-10-08T19:27:34.220 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:26:14.364442+0000", 2021-10-08T19:27:34.220 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 79.658028970000004, 2021-10-08T19:27:34.220 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.083265418999999993, 2021-10-08T19:27:34.221 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:27:34.221 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:34.221 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:27:34.221 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:27:34.221 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:27:34.222 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 129449 2021-10-08T19:27:34.222 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.222 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:27:34.222 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.222 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:27:34.223 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:14.364442+0000", 2021-10-08T19:27:34.223 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:34.223 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.223 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.224 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:27:34.224 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:14.364442+0000", 2021-10-08T19:27:34.224 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:34.224 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.224 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.225 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:27:34.225 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:14.364440+0000", 2021-10-08T19:27:34.225 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:27:34.225 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.225 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.226 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:27:34.226 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:14.364448+0000", 2021-10-08T19:27:34.226 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.7179999999999996e-06 2021-10-08T19:27:34.226 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.227 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.227 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:27:34.227 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:14.364469+0000", 2021-10-08T19:27:34.227 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0964000000000001e-05 2021-10-08T19:27:34.227 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.228 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.228 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:27:34.228 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:14.364476+0000", 2021-10-08T19:27:34.228 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.7009999999999996e-06 2021-10-08T19:27:34.229 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.229 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.229 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:27:34.229 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:14.364527+0000", 2021-10-08T19:27:34.229 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0957e-05 2021-10-08T19:27:34.230 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.230 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.230 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:27:34.230 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:14.364678+0000", 2021-10-08T19:27:34.231 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015110699999999999 2021-10-08T19:27:34.231 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.231 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.231 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 3,6", 2021-10-08T19:27:34.231 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:14.364803+0000", 2021-10-08T19:27:34.232 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000124654 2021-10-08T19:27:34.232 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.232 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.232 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:27:34.233 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:14.366888+0000", 2021-10-08T19:27:34.233 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020847750000000001 2021-10-08T19:27:34.233 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.233 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.233 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:34.234 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:14.372024+0000", 2021-10-08T19:27:34.234 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00513643 2021-10-08T19:27:34.234 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.234 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.234 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:34.235 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:14.446452+0000", 2021-10-08T19:27:34.235 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.074427301000000001 2021-10-08T19:27:34.235 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.235 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.236 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:27:34.236 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:14.446521+0000", 2021-10-08T19:27:34.236 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.9688000000000001e-05 2021-10-08T19:27:34.236 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.236 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.237 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:27:34.237 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:14.447708+0000", 2021-10-08T19:27:34.237 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0011863609999999999 2021-10-08T19:27:34.237 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:34.237 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:27:34.238 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:34.238 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.238 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.238 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:133116 7.1 7:8a1b80a6:::benchmark_data_smithi097_93198_object41296:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e151)", 2021-10-08T19:27:34.238 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:26:19.405758+0000", 2021-10-08T19:27:34.239 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 74.616713156000003, 2021-10-08T19:27:34.239 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.088550870000000004, 2021-10-08T19:27:34.239 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:27:34.239 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:34.240 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:27:34.240 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:27:34.240 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:27:34.240 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 133116 2021-10-08T19:27:34.240 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.241 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:27:34.241 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.241 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:27:34.241 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.405758+0000", 2021-10-08T19:27:34.242 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:34.242 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.242 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.242 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:27:34.243 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.405758+0000", 2021-10-08T19:27:34.243 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:34.243 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.243 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.243 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:27:34.244 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.405756+0000", 2021-10-08T19:27:34.244 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:27:34.244 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.244 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.244 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:27:34.245 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.405763+0000", 2021-10-08T19:27:34.245 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7270000000000001e-06 2021-10-08T19:27:34.245 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.245 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.246 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:27:34.246 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.405776+0000", 2021-10-08T19:27:34.246 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3036e-05 2021-10-08T19:27:34.246 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.246 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.247 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:27:34.247 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.405785+0000", 2021-10-08T19:27:34.247 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.1959999999999997e-06 2021-10-08T19:27:34.247 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.247 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.248 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:27:34.248 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.406684+0000", 2021-10-08T19:27:34.248 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00089890599999999999 2021-10-08T19:27:34.248 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.249 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.249 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:27:34.249 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.406846+0000", 2021-10-08T19:27:34.249 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016195599999999999 2021-10-08T19:27:34.250 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.250 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.250 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 3,6", 2021-10-08T19:27:34.250 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.407013+0000", 2021-10-08T19:27:34.251 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016742600000000001 2021-10-08T19:27:34.251 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.251 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.251 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:27:34.251 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.411859+0000", 2021-10-08T19:27:34.252 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0048459239999999997 2021-10-08T19:27:34.252 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.252 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.252 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:34.253 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.413679+0000", 2021-10-08T19:27:34.253 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018200250000000001 2021-10-08T19:27:34.253 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.253 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.253 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:34.254 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.493528+0000", 2021-10-08T19:27:34.254 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.079849418000000005 2021-10-08T19:27:34.254 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.254 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.254 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:27:34.255 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.493574+0000", 2021-10-08T19:27:34.255 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5757000000000003e-05 2021-10-08T19:27:34.255 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.255 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.256 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:27:34.256 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.494309+0000", 2021-10-08T19:27:34.256 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000734719 2021-10-08T19:27:34.256 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:34.256 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:27:34.257 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:34.257 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.257 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.257 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:133117 7.1 7:84d1147c:::benchmark_data_smithi097_93198_object41297:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e151)", 2021-10-08T19:27:34.257 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:26:19.406084+0000", 2021-10-08T19:27:34.258 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 74.616387271999997, 2021-10-08T19:27:34.258 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.10585810800000001, 2021-10-08T19:27:34.258 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:27:34.258 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:34.259 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:27:34.259 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:27:34.259 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:27:34.259 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 133117 2021-10-08T19:27:34.259 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.260 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:27:34.260 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.260 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:27:34.260 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.406084+0000", 2021-10-08T19:27:34.260 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:34.261 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.261 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.261 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:27:34.261 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.406084+0000", 2021-10-08T19:27:34.262 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:34.262 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.262 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.262 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:27:34.262 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.406083+0000", 2021-10-08T19:27:34.263 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:27:34.263 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.263 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.263 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:27:34.264 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.406088+0000", 2021-10-08T19:27:34.264 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7659999999999998e-06 2021-10-08T19:27:34.264 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.264 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.264 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:27:34.265 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.406100+0000", 2021-10-08T19:27:34.265 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2036e-05 2021-10-08T19:27:34.265 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.265 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.265 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:27:34.266 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.406106+0000", 2021-10-08T19:27:34.266 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5119999999999997e-06 2021-10-08T19:27:34.266 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.266 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.267 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:27:34.267 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.409394+0000", 2021-10-08T19:27:34.267 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032877420000000002 2021-10-08T19:27:34.267 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.267 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.268 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:27:34.268 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.409607+0000", 2021-10-08T19:27:34.268 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00021351399999999999 2021-10-08T19:27:34.268 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.269 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.269 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 3,6", 2021-10-08T19:27:34.269 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.409807+0000", 2021-10-08T19:27:34.269 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00019952199999999999 2021-10-08T19:27:34.269 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.270 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.270 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:27:34.270 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.412493+0000", 2021-10-08T19:27:34.270 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002686646 2021-10-08T19:27:34.271 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.271 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.271 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:34.271 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.413731+0000", 2021-10-08T19:27:34.271 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012370549999999999 2021-10-08T19:27:34.272 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.272 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.272 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:34.272 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.510804+0000", 2021-10-08T19:27:34.273 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.097073004000000004 2021-10-08T19:27:34.273 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.273 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.273 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:27:34.273 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.510868+0000", 2021-10-08T19:27:34.274 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4945999999999998e-05 2021-10-08T19:27:34.274 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.274 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.274 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:27:34.274 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.511942+0000", 2021-10-08T19:27:34.275 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0010735569999999999 2021-10-08T19:27:34.275 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:34.275 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:27:34.275 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:34.276 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.276 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.276 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:159799 7.1 7:8e11ce8b:::benchmark_data_smithi097_93198_object67979:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158)", 2021-10-08T19:27:34.276 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:26:55.421208+0000", 2021-10-08T19:27:34.276 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 38.601263699999997, 2021-10-08T19:27:34.277 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.076604096999999996, 2021-10-08T19:27:34.277 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:27:34.277 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:34.277 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:27:34.277 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:27:34.278 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:27:34.278 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 159799 2021-10-08T19:27:34.278 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.278 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:27:34.279 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.279 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:27:34.279 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:55.421208+0000", 2021-10-08T19:27:34.279 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:34.279 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.280 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.280 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:27:34.280 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:55.421208+0000", 2021-10-08T19:27:34.280 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:34.281 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.281 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.281 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:27:34.281 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:55.421206+0000", 2021-10-08T19:27:34.281 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:27:34.282 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.282 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.282 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:27:34.282 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:55.421210+0000", 2021-10-08T19:27:34.283 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0960000000000003e-06 2021-10-08T19:27:34.283 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.283 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.283 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:27:34.283 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:55.421217+0000", 2021-10-08T19:27:34.284 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8569999999999997e-06 2021-10-08T19:27:34.284 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.284 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.284 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:27:34.284 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:55.421221+0000", 2021-10-08T19:27:34.285 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8489999999999999e-06 2021-10-08T19:27:34.285 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.285 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.285 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:27:34.286 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:55.422316+0000", 2021-10-08T19:27:34.286 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001094519 2021-10-08T19:27:34.286 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.286 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.286 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:27:34.287 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:55.422459+0000", 2021-10-08T19:27:34.287 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014296099999999999 2021-10-08T19:27:34.287 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.287 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.287 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 3,6", 2021-10-08T19:27:34.288 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:55.422637+0000", 2021-10-08T19:27:34.288 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017825299999999999 2021-10-08T19:27:34.288 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.288 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.289 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:27:34.289 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:55.424688+0000", 2021-10-08T19:27:34.289 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020512180000000001 2021-10-08T19:27:34.289 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.289 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.290 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:34.290 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:55.428938+0000", 2021-10-08T19:27:34.290 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042496770000000003 2021-10-08T19:27:34.290 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.291 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.291 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:34.291 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:55.497125+0000", 2021-10-08T19:27:34.291 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.068187684999999998 2021-10-08T19:27:34.292 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.292 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.292 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:27:34.292 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:55.497180+0000", 2021-10-08T19:27:34.292 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4070000000000002e-05 2021-10-08T19:27:34.293 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.293 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.293 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:27:34.293 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:55.497812+0000", 2021-10-08T19:27:34.293 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00063210899999999995 2021-10-08T19:27:34.294 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:34.294 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:27:34.294 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:34.294 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.295 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.295 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:161971 7.1 7:8fd2b586:::benchmark_data_smithi097_93198_object70151:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158)", 2021-10-08T19:27:34.295 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:26:58.326610+0000", 2021-10-08T19:27:34.295 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 35.695861487000002, 2021-10-08T19:27:34.296 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.21848095000000001, 2021-10-08T19:27:34.296 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:27:34.296 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:34.296 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:27:34.296 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:27:34.297 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:27:34.297 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 161971 2021-10-08T19:27:34.297 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.297 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:27:34.298 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.298 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:27:34.298 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.326610+0000", 2021-10-08T19:27:34.298 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:34.298 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.299 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.299 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:27:34.299 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.326610+0000", 2021-10-08T19:27:34.299 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:34.300 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.300 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.300 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:27:34.300 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.326607+0000", 2021-10-08T19:27:34.300 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:27:34.301 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.301 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.301 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:27:34.301 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.326616+0000", 2021-10-08T19:27:34.302 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.8999999999999995e-06 2021-10-08T19:27:34.302 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.302 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.302 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:27:34.303 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.326629+0000", 2021-10-08T19:27:34.303 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.279e-05 2021-10-08T19:27:34.303 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.303 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.303 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:27:34.304 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.326637+0000", 2021-10-08T19:27:34.304 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0590000000000003e-06 2021-10-08T19:27:34.304 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.304 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.304 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:27:34.305 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.326682+0000", 2021-10-08T19:27:34.305 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5385e-05 2021-10-08T19:27:34.305 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.305 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.305 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:27:34.306 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.326771+0000", 2021-10-08T19:27:34.306 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.8628000000000006e-05 2021-10-08T19:27:34.306 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.306 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.307 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 3,6", 2021-10-08T19:27:34.307 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.326886+0000", 2021-10-08T19:27:34.307 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000115016 2021-10-08T19:27:34.307 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.307 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.308 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:27:34.308 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.539537+0000", 2021-10-08T19:27:34.308 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.21265069 2021-10-08T19:27:34.308 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.309 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.309 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:34.309 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.539568+0000", 2021-10-08T19:27:34.309 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.1335999999999999e-05 2021-10-08T19:27:34.309 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.310 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.310 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:34.310 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.544333+0000", 2021-10-08T19:27:34.310 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0047652149999999997 2021-10-08T19:27:34.310 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.311 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.311 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:27:34.311 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.544392+0000", 2021-10-08T19:27:34.311 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.872e-05 2021-10-08T19:27:34.312 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.312 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.312 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:27:34.312 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.545091+0000", 2021-10-08T19:27:34.312 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00069866299999999998 2021-10-08T19:27:34.313 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:34.313 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:27:34.313 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:34.313 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.313 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.314 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.24796.0:161973 7.4 e158/94 7:2d96b882:::benchmark_data_smithi097_93198_object70153:head v 158'10064, mlcod=158'10062)", 2021-10-08T19:27:34.314 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:26:58.329972+0000", 2021-10-08T19:27:34.314 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 35.692499128000001, 2021-10-08T19:27:34.314 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.21382468800000001, 2021-10-08T19:27:34.315 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:27:34.315 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:34.315 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:27:34.315 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.316 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:27:34.316 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.329972+0000", 2021-10-08T19:27:34.316 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:34.316 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.316 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.317 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:27:34.317 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.329972+0000", 2021-10-08T19:27:34.317 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:34.317 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.318 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.318 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:27:34.318 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.329971+0000", 2021-10-08T19:27:34.319 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:27:34.319 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.319 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.319 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:27:34.319 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.329982+0000", 2021-10-08T19:27:34.320 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1072e-05 2021-10-08T19:27:34.320 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.320 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.320 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:27:34.320 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.537881+0000", 2021-10-08T19:27:34.321 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.20789914900000001 2021-10-08T19:27:34.321 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.321 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.321 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:27:34.321 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.537893+0000", 2021-10-08T19:27:34.322 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2051e-05 2021-10-08T19:27:34.322 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.322 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.322 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:27:34.323 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.537941+0000", 2021-10-08T19:27:34.323 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7973000000000003e-05 2021-10-08T19:27:34.323 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.323 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.323 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:27:34.324 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.537964+0000", 2021-10-08T19:27:34.324 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2889999999999999e-05 2021-10-08T19:27:34.324 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.324 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.324 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:27:34.325 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.543764+0000", 2021-10-08T19:27:34.325 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0058003359999999997 2021-10-08T19:27:34.325 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.325 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.326 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:27:34.326 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.543797+0000", 2021-10-08T19:27:34.326 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2527000000000002e-05 2021-10-08T19:27:34.326 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:34.326 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:27:34.327 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:34.327 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.327 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.327 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.24796.0:161975 7.8 e158/94 7:114b2586:::benchmark_data_smithi097_93198_object70155:head v 158'10036, mlcod=158'10034)", 2021-10-08T19:27:34.328 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:26:58.332795+0000", 2021-10-08T19:27:34.328 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 35.689676280999997, 2021-10-08T19:27:34.328 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.211518449, 2021-10-08T19:27:34.328 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:27:34.328 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:34.329 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:27:34.329 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.329 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:27:34.329 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.332795+0000", 2021-10-08T19:27:34.329 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:34.330 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.330 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.330 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:27:34.330 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.332795+0000", 2021-10-08T19:27:34.331 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:34.331 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.331 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.331 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:27:34.331 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.332793+0000", 2021-10-08T19:27:34.332 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:27:34.332 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.332 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.332 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:27:34.332 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.332802+0000", 2021-10-08T19:27:34.333 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.1850000000000004e-06 2021-10-08T19:27:34.333 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.333 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.333 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:27:34.333 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.537879+0000", 2021-10-08T19:27:34.334 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.20507779600000001 2021-10-08T19:27:34.334 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.334 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.334 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:27:34.335 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.537894+0000", 2021-10-08T19:27:34.335 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.413e-05 2021-10-08T19:27:34.335 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.335 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.335 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:27:34.336 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.537962+0000", 2021-10-08T19:27:34.336 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7983000000000003e-05 2021-10-08T19:27:34.336 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.336 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.337 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:27:34.337 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.537983+0000", 2021-10-08T19:27:34.337 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1392000000000001e-05 2021-10-08T19:27:34.337 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.337 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.338 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:27:34.338 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.544284+0000", 2021-10-08T19:27:34.338 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0063013740000000002 2021-10-08T19:27:34.338 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.338 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.339 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:27:34.339 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.544313+0000", 2021-10-08T19:27:34.339 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9030000000000002e-05 2021-10-08T19:27:34.339 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:34.340 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:27:34.340 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:34.340 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.340 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.340 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop_reply(client.24796.0:161971 7.1 e158/113 ondisk, result = 0)", 2021-10-08T19:27:34.341 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:26:58.333145+0000", 2021-10-08T19:27:34.341 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 35.689325824000001, 2021-10-08T19:27:34.341 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.206424358, 2021-10-08T19:27:34.341 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:27:34.341 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2021-10-08T19:27:34.342 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:27:34.342 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.342 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:27:34.342 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.333145+0000", 2021-10-08T19:27:34.343 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:34.343 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.343 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.343 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:27:34.343 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.333145+0000", 2021-10-08T19:27:34.344 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:34.344 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.344 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.344 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:27:34.344 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.333144+0000", 2021-10-08T19:27:34.345 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:27:34.345 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.345 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.345 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:27:34.346 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.333153+0000", 2021-10-08T19:27:34.346 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3329999999999997e-06 2021-10-08T19:27:34.346 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.346 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.346 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:27:34.347 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.537881+0000", 2021-10-08T19:27:34.347 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.204728403 2021-10-08T19:27:34.347 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.347 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.347 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:27:34.348 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.537894+0000", 2021-10-08T19:27:34.348 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2975e-05 2021-10-08T19:27:34.348 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.348 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.349 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:27:34.349 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.539558+0000", 2021-10-08T19:27:34.349 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0016645060000000001 2021-10-08T19:27:34.349 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.349 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.350 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:27:34.350 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.539564+0000", 2021-10-08T19:27:34.350 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1850000000000003e-06 2021-10-08T19:27:34.350 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.351 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.351 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:27:34.351 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.539570+0000", 2021-10-08T19:27:34.351 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1399999999999997e-06 2021-10-08T19:27:34.351 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:34.352 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:27:34.352 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:34.352 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.352 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.352 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:175100 7.1 7:83d767f0:::benchmark_data_smithi097_93198_object83280:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e166)", 2021-10-08T19:27:34.353 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:27:16.893050+0000", 2021-10-08T19:27:34.353 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 17.129421601000001, 2021-10-08T19:27:34.353 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.080844548000000002, 2021-10-08T19:27:34.353 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:27:34.353 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:34.354 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:27:34.354 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:27:34.354 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:27:34.354 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 175100 2021-10-08T19:27:34.355 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.355 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:27:34.355 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.355 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:27:34.355 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:16.893050+0000", 2021-10-08T19:27:34.356 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:34.356 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.356 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.356 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:27:34.356 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:16.893050+0000", 2021-10-08T19:27:34.357 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:34.357 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.357 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.357 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:27:34.358 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:16.893047+0000", 2021-10-08T19:27:34.358 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:27:34.358 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.358 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.358 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:27:34.359 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:16.893055+0000", 2021-10-08T19:27:34.359 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.537e-06 2021-10-08T19:27:34.359 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.359 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.360 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:27:34.360 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:16.893071+0000", 2021-10-08T19:27:34.360 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5863999999999999e-05 2021-10-08T19:27:34.360 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.360 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.361 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:27:34.361 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:16.893079+0000", 2021-10-08T19:27:34.361 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9959999999999993e-06 2021-10-08T19:27:34.361 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.361 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.362 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:27:34.362 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:16.893139+0000", 2021-10-08T19:27:34.362 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0838000000000003e-05 2021-10-08T19:27:34.362 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.363 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.363 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:27:34.363 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:16.893272+0000", 2021-10-08T19:27:34.363 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000132211 2021-10-08T19:27:34.363 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.364 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.364 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 3,6", 2021-10-08T19:27:34.364 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:16.893367+0000", 2021-10-08T19:27:34.364 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.5152e-05 2021-10-08T19:27:34.364 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.365 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.365 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:27:34.365 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:16.896146+0000", 2021-10-08T19:27:34.365 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002778717 2021-10-08T19:27:34.366 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.366 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.366 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:34.366 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:16.903281+0000", 2021-10-08T19:27:34.366 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0071352409999999996 2021-10-08T19:27:34.367 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.367 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.367 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:34.367 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:16.973574+0000", 2021-10-08T19:27:34.367 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.070293504000000007 2021-10-08T19:27:34.368 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.368 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.368 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:27:34.368 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:16.973616+0000", 2021-10-08T19:27:34.369 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1520999999999998e-05 2021-10-08T19:27:34.369 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.369 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.369 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:27:34.369 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:16.973894+0000", 2021-10-08T19:27:34.370 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00027839599999999998 2021-10-08T19:27:34.370 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:34.370 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:27:34.370 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:34.370 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.371 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.371 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:175103 7.1 7:8ad7f451:::benchmark_data_smithi097_93198_object83283:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e166)", 2021-10-08T19:27:34.371 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:27:16.893092+0000", 2021-10-08T19:27:34.371 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 17.129378864, 2021-10-08T19:27:34.372 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.086643936000000005, 2021-10-08T19:27:34.372 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:27:34.372 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:34.372 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:27:34.372 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:27:34.373 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:27:34.373 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 175103 2021-10-08T19:27:34.373 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.373 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:27:34.373 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.374 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:27:34.374 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:16.893092+0000", 2021-10-08T19:27:34.374 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:34.374 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.374 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.375 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:27:34.375 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:16.893092+0000", 2021-10-08T19:27:34.375 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:34.375 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.376 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.376 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:27:34.376 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:16.893091+0000", 2021-10-08T19:27:34.376 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:27:34.376 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.377 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.377 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:27:34.377 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:16.893095+0000", 2021-10-08T19:27:34.377 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9709999999999998e-06 2021-10-08T19:27:34.377 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.378 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.378 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:27:34.378 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:16.893112+0000", 2021-10-08T19:27:34.378 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6903999999999999e-05 2021-10-08T19:27:34.379 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.379 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.379 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:27:34.379 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:16.893117+0000", 2021-10-08T19:27:34.379 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0830000000000003e-06 2021-10-08T19:27:34.380 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.380 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.380 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:27:34.380 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:16.897555+0000", 2021-10-08T19:27:34.380 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044380180000000002 2021-10-08T19:27:34.381 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.381 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.381 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:27:34.381 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:16.897720+0000", 2021-10-08T19:27:34.381 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016487899999999999 2021-10-08T19:27:34.382 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.382 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.382 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 3,6", 2021-10-08T19:27:34.382 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:16.897881+0000", 2021-10-08T19:27:34.383 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016059700000000001 2021-10-08T19:27:34.383 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.383 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.383 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:27:34.383 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:16.900414+0000", 2021-10-08T19:27:34.384 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0025331139999999999 2021-10-08T19:27:34.384 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.384 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.384 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:34.384 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:16.906693+0000", 2021-10-08T19:27:34.385 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0062787679999999997 2021-10-08T19:27:34.385 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.385 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.385 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:34.386 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:16.979155+0000", 2021-10-08T19:27:34.386 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.072461764999999997 2021-10-08T19:27:34.386 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.386 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.386 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:27:34.387 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:16.979218+0000", 2021-10-08T19:27:34.387 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3555999999999999e-05 2021-10-08T19:27:34.387 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.387 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.387 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:27:34.388 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:16.979736+0000", 2021-10-08T19:27:34.388 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00051816500000000001 2021-10-08T19:27:34.388 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:34.388 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:27:34.389 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:34.389 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.389 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.389 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:178287 7.1 7:8c8ae0a0:::benchmark_data_smithi097_93198_object86467:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e169)", 2021-10-08T19:27:34.389 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:27:21.148369+0000", 2021-10-08T19:27:34.390 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 12.874102015, 2021-10-08T19:27:34.390 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.070970830999999998, 2021-10-08T19:27:34.390 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:27:34.390 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:34.391 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:27:34.391 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:27:34.391 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:27:34.391 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 178287 2021-10-08T19:27:34.392 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.392 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:27:34.392 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.392 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:27:34.392 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:21.148369+0000", 2021-10-08T19:27:34.393 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:34.393 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.393 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.393 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:27:34.393 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:21.148369+0000", 2021-10-08T19:27:34.394 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:34.394 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.394 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.394 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:27:34.395 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:21.148367+0000", 2021-10-08T19:27:34.395 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:27:34.395 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.395 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.395 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:27:34.396 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:21.148374+0000", 2021-10-08T19:27:34.396 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.7759999999999997e-06 2021-10-08T19:27:34.396 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.396 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.396 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:27:34.397 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:21.148387+0000", 2021-10-08T19:27:34.397 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2497000000000001e-05 2021-10-08T19:27:34.397 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.397 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.397 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:27:34.398 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:21.148393+0000", 2021-10-08T19:27:34.398 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3130000000000004e-06 2021-10-08T19:27:34.398 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.398 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.399 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:27:34.399 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:21.148443+0000", 2021-10-08T19:27:34.399 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9530000000000002e-05 2021-10-08T19:27:34.399 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.399 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.400 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:27:34.400 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:21.148598+0000", 2021-10-08T19:27:34.400 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000155377 2021-10-08T19:27:34.400 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.400 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.401 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 3,6", 2021-10-08T19:27:34.401 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:21.148749+0000", 2021-10-08T19:27:34.401 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015076299999999999 2021-10-08T19:27:34.401 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.402 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.402 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:34.402 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:21.153004+0000", 2021-10-08T19:27:34.402 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042554330000000003 2021-10-08T19:27:34.402 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.403 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.403 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:27:34.403 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:21.153010+0000", 2021-10-08T19:27:34.403 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0090000000000004e-06 2021-10-08T19:27:34.403 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.404 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.404 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:34.404 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:21.218762+0000", 2021-10-08T19:27:34.404 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.065751470000000006 2021-10-08T19:27:34.404 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.405 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.405 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:27:34.405 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:21.218805+0000", 2021-10-08T19:27:34.405 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.3046000000000001e-05 2021-10-08T19:27:34.406 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.406 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.406 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:27:34.406 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:21.219340+0000", 2021-10-08T19:27:34.406 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00053514299999999997 2021-10-08T19:27:34.407 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:34.407 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:27:34.407 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:34.407 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.407 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.408 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:178288 7.1 7:8ff3c585:::benchmark_data_smithi097_93198_object86468:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e169)", 2021-10-08T19:27:34.408 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:27:21.148405+0000", 2021-10-08T19:27:34.408 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 12.874066318000001, 2021-10-08T19:27:34.408 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.071311895, 2021-10-08T19:27:34.409 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:27:34.409 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:34.409 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:27:34.409 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:27:34.409 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:27:34.410 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 178288 2021-10-08T19:27:34.410 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.410 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:27:34.410 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.410 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:27:34.411 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:21.148405+0000", 2021-10-08T19:27:34.411 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:34.411 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.411 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.411 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:27:34.412 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:21.148405+0000", 2021-10-08T19:27:34.412 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:34.412 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.412 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.413 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:27:34.413 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:21.148404+0000", 2021-10-08T19:27:34.413 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999995 2021-10-08T19:27:34.413 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.413 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.414 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:27:34.414 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:21.148407+0000", 2021-10-08T19:27:34.414 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.1489999999999998e-06 2021-10-08T19:27:34.414 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.414 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.415 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:27:34.415 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:21.148412+0000", 2021-10-08T19:27:34.415 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0359999999999997e-06 2021-10-08T19:27:34.415 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.416 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.416 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:27:34.416 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:21.148416+0000", 2021-10-08T19:27:34.416 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8060000000000001e-06 2021-10-08T19:27:34.416 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.417 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.417 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:27:34.417 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:21.151121+0000", 2021-10-08T19:27:34.417 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002705135 2021-10-08T19:27:34.417 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.418 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.418 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:27:34.419 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:21.151272+0000", 2021-10-08T19:27:34.419 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015027199999999999 2021-10-08T19:27:34.419 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.419 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.419 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 3,6", 2021-10-08T19:27:34.420 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:21.151379+0000", 2021-10-08T19:27:34.420 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000107617 2021-10-08T19:27:34.420 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.420 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.421 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:27:34.421 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:21.153603+0000", 2021-10-08T19:27:34.421 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022241460000000002 2021-10-08T19:27:34.421 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.421 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.422 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:34.422 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:21.153746+0000", 2021-10-08T19:27:34.422 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000142671 2021-10-08T19:27:34.422 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.422 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.423 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:27:34.423 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:21.219393+0000", 2021-10-08T19:27:34.423 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.065647206999999999 2021-10-08T19:27:34.423 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.424 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.424 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:27:34.424 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:21.219436+0000", 2021-10-08T19:27:34.424 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2509000000000002e-05 2021-10-08T19:27:34.424 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:34.425 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:34.425 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:27:34.425 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:21.219717+0000", 2021-10-08T19:27:34.425 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00028101500000000002 2021-10-08T19:27:34.425 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:34.426 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:27:34.426 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:34.426 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:34.426 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:27:34.426 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:27:34.427 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:27:34.428 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:27:33 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:27:33] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:27:34.455 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:34.505 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:27:34.508 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:34.509 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:27:34.610 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:27:34.636 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:34.930 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:27:34.933 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:34.933 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:27:35.034 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:27:35.065 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:35.161 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:27:35.162 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:35.163 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:27:35.168 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2021-10-08T19:27:35.234 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set noscrub 2021-10-08T19:27:35.264 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:27:35.307 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:35.356 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:27:35.358 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:35.359 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:27:35.461 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:27:35.490 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:35.555 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'unique_pool_0' removed 2021-10-08T19:27:35.710 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:27:35.773 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:27:35.776 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:35.776 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:27:35.878 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:27:35.891 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:35 smithi097 ceph-mon[41966]: pgmap v282: 178 pgs: 169 active+clean, 2 active+recovering+undersized+degraded+remapped, 4 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 582 KiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 426 op/s; 7896/585 objects degraded (1349.744%); 875/585 objects misplaced (149.573%); 0 B/s, 43 objects/s recovering 2021-10-08T19:27:35.892 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:35 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/292721729' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]: dispatch 2021-10-08T19:27:35.892 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:35 smithi097 ceph-mon[41966]: from='client.25054 ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]: dispatch 2021-10-08T19:27:35.892 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:35 smithi097 ceph-mon[41966]: Health check update: Degraded data redundancy: 7896/585 objects degraded (1349.744%), 8 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:27:35.894 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:35 smithi097 ceph-mon[41966]: from='client.25054 ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]': finished 2021-10-08T19:27:35.894 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:35 smithi097 ceph-mon[41966]: osdmap e177: 8 total, 8 up, 8 in 2021-10-08T19:27:35.894 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:35 smithi097 ceph-mon[32687]: pgmap v282: 178 pgs: 169 active+clean, 2 active+recovering+undersized+degraded+remapped, 4 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 582 KiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 426 op/s; 7896/585 objects degraded (1349.744%); 875/585 objects misplaced (149.573%); 0 B/s, 43 objects/s recovering 2021-10-08T19:27:35.895 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:35 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/292721729' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]: dispatch 2021-10-08T19:27:35.895 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:35 smithi097 ceph-mon[32687]: from='client.25054 ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]: dispatch 2021-10-08T19:27:35.895 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:35 smithi097 ceph-mon[32687]: Health check update: Degraded data redundancy: 7896/585 objects degraded (1349.744%), 8 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:27:35.895 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:35 smithi097 ceph-mon[32687]: from='client.25054 ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]': finished 2021-10-08T19:27:35.896 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:35 smithi097 ceph-mon[32687]: osdmap e177: 8 total, 8 up, 8 in 2021-10-08T19:27:35.902 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:35.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:35 smithi117 ceph-mon[34585]: pgmap v282: 178 pgs: 169 active+clean, 2 active+recovering+undersized+degraded+remapped, 4 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+remapped, 2 active+recovery_wait+degraded; 582 KiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 426 op/s; 7896/585 objects degraded (1349.744%); 875/585 objects misplaced (149.573%); 0 B/s, 43 objects/s recovering 2021-10-08T19:27:35.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:35 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/292721729' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]: dispatch 2021-10-08T19:27:35.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:35 smithi117 ceph-mon[34585]: from='client.25054 ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]: dispatch 2021-10-08T19:27:35.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:35 smithi117 ceph-mon[34585]: Health check update: Degraded data redundancy: 7896/585 objects degraded (1349.744%), 8 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2021-10-08T19:27:35.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:35 smithi117 ceph-mon[34585]: from='client.25054 ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]': finished 2021-10-08T19:27:35.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:35 smithi117 ceph-mon[34585]: osdmap e177: 8 total, 8 up, 8 in 2021-10-08T19:27:36.287 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2021-10-08T19:27:36.289 INFO:tasks.radosbench:Beginning radosbench... 2021-10-08T19:27:36.290 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_1 2021-10-08T19:27:36.291 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd pool create unique_pool_1 16 2021-10-08T19:27:36.292 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:36.293 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:27:36.293 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:27:36.348 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:27:36.395 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:27:36.422 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:36.566 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:27:36.569 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:36.569 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:27:36.600 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:36 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:27:36.670 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:27:36.694 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:27:36 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:27:36.694 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:36 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:27:36.695 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:36 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:27:36.696 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:36 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:27:36.696 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:36 smithi117 ceph-mon[34585]: poll took 246298.579 ms: 1 events 2021-10-08T19:27:36.696 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:36 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:27:36.696 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:36 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:27:36.711 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:36.736 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:27:36.756 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:27:36.777 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:27:36.784 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 7, 6] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2021-10-08T19:27:36.785 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2021-10-08T19:27:36.786 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd dump -f json-pretty 2021-10-08T19:27:36.799 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:27:36.819 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:27:36.837 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:27:36.856 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:27:36.875 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:27:36.876 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'false' 2021-10-08T19:27:36.876 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'false' 2021-10-08T19:27:36.876 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'false' 2021-10-08T19:27:36.876 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'false' 2021-10-08T19:27:36.877 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'false' 2021-10-08T19:27:36.877 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'false' 2021-10-08T19:27:36.877 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'false' 2021-10-08T19:27:36.877 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'false' 2021-10-08T19:27:36.897 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:36 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:27:36.897 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:36 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:27:36.897 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:36 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:27:36.897 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:36 smithi097 ceph-mon[41966]: poll took 246298.579 ms: 1 events 2021-10-08T19:27:36.898 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:36 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:27:36.898 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:36 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:27:36.898 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:36 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:27:36.899 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:36 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:27:36.899 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:36 smithi097 ceph-mon[32687]: poll took 246298.579 ms: 1 events 2021-10-08T19:27:36.899 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:36 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:27:36.899 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:36 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:27:37.206 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:27:37.208 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:37.209 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:27:37.310 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:27:37.334 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:37.515 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:27:37.615 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:27:37 smithi097 conmon[33110]: 172.21.15.117 - - [08/Oct/2021:19:27:37] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:27:37.615 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:37 smithi117 ceph-mon[34585]: 2.1a scrub ok 2021-10-08T19:27:37.616 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:37 smithi117 ceph-mon[34585]: 2.c scrub ok 2021-10-08T19:27:37.617 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:37 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:27:37.617 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:37 smithi117 ceph-mon[34585]: 4.f scrub ok 2021-10-08T19:27:37.618 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:37 smithi117 ceph-mon[34585]: pgmap v284: 162 pgs: 158 active+clean, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovery_wait+degraded; 582 KiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 511 B/s rd, 0 op/s; 12/585 objects degraded (2.051%); 2/585 objects misplaced (0.342%) 2021-10-08T19:27:37.618 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:37 smithi117 ceph-mon[34585]: osdmap e178: 8 total, 8 up, 8 in 2021-10-08T19:27:37.618 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:37 smithi117 ceph-mon[34585]: 5.9 scrub ok 2021-10-08T19:27:37.619 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:37 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/525189558' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:27:37.619 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:37 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:27:37.943 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2021-10-08T19:27:37.943 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:27:37.955 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:37 smithi097 ceph-mon[41966]: 2.1a scrub ok 2021-10-08T19:27:37.955 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:37 smithi097 ceph-mon[41966]: 2.c scrub ok 2021-10-08T19:27:37.955 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:37 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:27:37.955 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:37 smithi097 ceph-mon[41966]: 4.f scrub ok 2021-10-08T19:27:37.956 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:37 smithi097 ceph-mon[41966]: pgmap v284: 162 pgs: 158 active+clean, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovery_wait+degraded; 582 KiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 511 B/s rd, 0 op/s; 12/585 objects degraded (2.051%); 2/585 objects misplaced (0.342%) 2021-10-08T19:27:37.956 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:37 smithi097 ceph-mon[41966]: osdmap e178: 8 total, 8 up, 8 in 2021-10-08T19:27:37.956 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:37 smithi097 ceph-mon[41966]: 5.9 scrub ok 2021-10-08T19:27:37.956 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:37 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/525189558' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:27:37.956 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:37 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:27:37.957 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:37 smithi097 ceph-mon[32687]: 2.1a scrub ok 2021-10-08T19:27:37.957 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:37 smithi097 ceph-mon[32687]: 2.c scrub ok 2021-10-08T19:27:37.957 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:37 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:27:37.958 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:37 smithi097 ceph-mon[32687]: 4.f scrub ok 2021-10-08T19:27:37.958 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:37 smithi097 ceph-mon[32687]: pgmap v284: 162 pgs: 158 active+clean, 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovery_wait+degraded; 582 KiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 511 B/s rd, 0 op/s; 12/585 objects degraded (2.051%); 2/585 objects misplaced (0.342%) 2021-10-08T19:27:37.958 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:37 smithi097 ceph-mon[32687]: osdmap e178: 8 total, 8 up, 8 in 2021-10-08T19:27:37.958 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:37 smithi097 ceph-mon[32687]: 5.9 scrub ok 2021-10-08T19:27:37.959 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:37 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/525189558' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:27:37.959 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:37 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:27:38.191 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:27:38.297 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:27:38.300 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:38.301 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:27:38.402 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:27:38.443 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:38.663 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2021-10-08T19:27:38.705 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:27:38.708 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:38.709 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:27:38.810 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:27:38.834 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:38 smithi097 ceph-mon[41966]: 6.1e deep-scrub ok 2021-10-08T19:27:38.834 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:38 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:27:38.835 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:38 smithi097 ceph-mon[41966]: 172.21.15.117 - - [08/Oct/2021:19:27:37] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:27:38.835 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:38 smithi097 ceph-mon[41966]: osdmap e179: 8 total, 8 up, 8 in 2021-10-08T19:27:38.835 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:38 smithi097 ceph-mon[41966]: 2.2 scrub ok 2021-10-08T19:27:38.835 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:38 smithi097 ceph-mon[32687]: 6.1e deep-scrub ok 2021-10-08T19:27:38.836 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:38 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:27:38.836 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:38 smithi097 ceph-mon[32687]: 172.21.15.117 - - [08/Oct/2021:19:27:37] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:27:38.836 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:38 smithi097 ceph-mon[32687]: osdmap e179: 8 total, 8 up, 8 in 2021-10-08T19:27:38.836 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:38 smithi097 ceph-mon[32687]: 2.2 scrub ok 2021-10-08T19:27:38.839 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:38.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:38 smithi117 ceph-mon[34585]: 6.1e deep-scrub ok 2021-10-08T19:27:38.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:38 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:27:38.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:38 smithi117 ceph-mon[34585]: 172.21.15.117 - - [08/Oct/2021:19:27:37] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:27:38.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:38 smithi117 ceph-mon[34585]: osdmap e179: 8 total, 8 up, 8 in 2021-10-08T19:27:38.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:38 smithi117 ceph-mon[34585]: 2.2 scrub ok 2021-10-08T19:27:38.930 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:27:39.631 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is set 2021-10-08T19:27:39.892 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:39 smithi097 ceph-mon[41966]: 4.10 scrub ok 2021-10-08T19:27:39.892 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:39 smithi097 ceph-mon[41966]: 5.a scrub ok 2021-10-08T19:27:39.893 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:39 smithi097 ceph-mon[41966]: 6.0 scrub ok 2021-10-08T19:27:39.893 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:39 smithi097 ceph-mon[41966]: pgmap v287: 162 pgs: 159 active+clean, 1 active+recovery_wait+undersized+degraded+remapped, 2 active+recovery_wait+degraded; 582 KiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s; 10/585 objects degraded (1.709%); 1/585 objects misplaced (0.171%) 2021-10-08T19:27:39.893 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:39 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1437961202' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:27:39.893 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:39 smithi097 ceph-mon[32687]: 4.10 scrub ok 2021-10-08T19:27:39.894 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:39 smithi097 ceph-mon[32687]: 5.a scrub ok 2021-10-08T19:27:39.894 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:39 smithi097 ceph-mon[32687]: 6.0 scrub ok 2021-10-08T19:27:39.894 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:39 smithi097 ceph-mon[32687]: pgmap v287: 162 pgs: 159 active+clean, 1 active+recovery_wait+undersized+degraded+remapped, 2 active+recovery_wait+degraded; 582 KiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s; 10/585 objects degraded (1.709%); 1/585 objects misplaced (0.171%) 2021-10-08T19:27:39.894 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:39 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1437961202' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:27:39.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:39 smithi117 ceph-mon[34585]: 4.10 scrub ok 2021-10-08T19:27:39.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:39 smithi117 ceph-mon[34585]: 5.a scrub ok 2021-10-08T19:27:39.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:39 smithi117 ceph-mon[34585]: 6.0 scrub ok 2021-10-08T19:27:39.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:39 smithi117 ceph-mon[34585]: pgmap v287: 162 pgs: 159 active+clean, 1 active+recovery_wait+undersized+degraded+remapped, 2 active+recovery_wait+degraded; 582 KiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s; 10/585 objects degraded (1.709%); 1/585 objects misplaced (0.171%) 2021-10-08T19:27:39.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:39 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1437961202' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:27:39.961 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2021-10-08T19:27:40.543 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:27:40.547 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:40.548 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:27:40.649 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:27:40.678 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:40.769 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2021-10-08T19:27:40.769 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:27:40.774 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:27:40.777 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:40.778 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:27:40.880 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:27:40.903 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:40 smithi097 ceph-mon[41966]: 6.1b scrub ok 2021-10-08T19:27:40.904 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:40 smithi097 ceph-mon[41966]: 6.8 deep-scrub ok 2021-10-08T19:27:40.904 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:40 smithi097 ceph-mon[41966]: 6.4 deep-scrub ok 2021-10-08T19:27:40.905 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:40 smithi097 ceph-mon[41966]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:27:40.905 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:40 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1437961202' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:27:40.905 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:40 smithi097 ceph-mon[41966]: osdmap e180: 8 total, 8 up, 8 in 2021-10-08T19:27:40.906 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:40 smithi097 ceph-mon[41966]: Health check update: Degraded data redundancy: 10/585 objects degraded (1.709%), 3 pgs degraded (PG_DEGRADED) 2021-10-08T19:27:40.906 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:40 smithi097 ceph-mon[41966]: osdmap e181: 8 total, 8 up, 8 in 2021-10-08T19:27:40.907 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:40 smithi097 ceph-mon[32687]: 6.1b scrub ok 2021-10-08T19:27:40.907 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:40 smithi097 ceph-mon[32687]: 6.8 deep-scrub ok 2021-10-08T19:27:40.907 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:40 smithi097 ceph-mon[32687]: 6.4 deep-scrub ok 2021-10-08T19:27:40.907 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:40 smithi097 ceph-mon[32687]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:27:40.908 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:40 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1437961202' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:27:40.908 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:40 smithi097 ceph-mon[32687]: osdmap e180: 8 total, 8 up, 8 in 2021-10-08T19:27:40.908 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:40 smithi097 ceph-mon[32687]: Health check update: Degraded data redundancy: 10/585 objects degraded (1.709%), 3 pgs degraded (PG_DEGRADED) 2021-10-08T19:27:40.909 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:40 smithi097 ceph-mon[32687]: osdmap e181: 8 total, 8 up, 8 in 2021-10-08T19:27:40.909 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:40.910 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:40 smithi117 ceph-mon[34585]: 6.1b scrub ok 2021-10-08T19:27:40.910 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:40 smithi117 ceph-mon[34585]: 6.8 deep-scrub ok 2021-10-08T19:27:40.910 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:40 smithi117 ceph-mon[34585]: 6.4 deep-scrub ok 2021-10-08T19:27:40.911 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:40 smithi117 ceph-mon[34585]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:27:40.911 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:40 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1437961202' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:27:40.911 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:40 smithi117 ceph-mon[34585]: osdmap e180: 8 total, 8 up, 8 in 2021-10-08T19:27:40.911 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:40 smithi117 ceph-mon[34585]: Health check update: Degraded data redundancy: 10/585 objects degraded (1.709%), 3 pgs degraded (PG_DEGRADED) 2021-10-08T19:27:40.912 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:40 smithi117 ceph-mon[34585]: osdmap e181: 8 total, 8 up, 8 in 2021-10-08T19:27:41.404 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2021-10-08T19:27:41.452 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:27:41.453 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:41.454 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:27:41.556 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:27:41.581 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:41.596 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:27:41.626 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:27:41.628 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:41.629 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:27:41.632 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:41 smithi097 ceph-mon[32687]: pgmap v290: 162 pgs: 162 active+clean; 582 KiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 144 KiB/s, 2 objects/s recovering 2021-10-08T19:27:41.633 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:41 smithi097 ceph-mon[32687]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 10/585 objects degraded (1.709%), 3 pgs degraded) 2021-10-08T19:27:41.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:41 smithi117 ceph-mon[34585]: pgmap v290: 162 pgs: 162 active+clean; 582 KiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 144 KiB/s, 2 objects/s recovering 2021-10-08T19:27:41.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:41 smithi117 ceph-mon[34585]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 10/585 objects degraded (1.709%), 3 pgs degraded) 2021-10-08T19:27:41.679 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:27:41.730 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:27:41.757 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:41.803 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:27:41.805 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:41.806 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:27:41.891 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:41 smithi097 ceph-mon[41966]: pgmap v290: 162 pgs: 162 active+clean; 582 KiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 144 KiB/s, 2 objects/s recovering 2021-10-08T19:27:41.892 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:41 smithi097 ceph-mon[41966]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 10/585 objects degraded (1.709%), 3 pgs degraded) 2021-10-08T19:27:41.912 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:27:41.938 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:41.982 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:27:41.984 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:41.985 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:27:42.087 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:27:42.121 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:42.341 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:27:42.341 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:27:42.341 INFO:teuthology.orchestra.run.smithi097.stdout: "epoch": 181, 2021-10-08T19:27:42.342 INFO:teuthology.orchestra.run.smithi097.stdout: "fsid": "1d01f6d6-286c-11ec-8c25-001a4aab830c", 2021-10-08T19:27:42.342 INFO:teuthology.orchestra.run.smithi097.stdout: "created": "2021-10-08T19:16:25.258003+0000", 2021-10-08T19:27:42.342 INFO:teuthology.orchestra.run.smithi097.stdout: "modified": "2021-10-08T19:27:40.544967+0000", 2021-10-08T19:27:42.343 INFO:teuthology.orchestra.run.smithi097.stdout: "last_up_change": "2021-10-08T19:21:15.388758+0000", 2021-10-08T19:27:42.343 INFO:teuthology.orchestra.run.smithi097.stdout: "last_in_change": "2021-10-08T19:24:24.060804+0000", 2021-10-08T19:27:42.343 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-08T19:27:42.343 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_num": 5801984, 2021-10-08T19:27:42.344 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_set": [ 2021-10-08T19:27:42.344 INFO:teuthology.orchestra.run.smithi097.stdout: "noscrub", 2021-10-08T19:27:42.344 INFO:teuthology.orchestra.run.smithi097.stdout: "pglog_hardlimit", 2021-10-08T19:27:42.344 INFO:teuthology.orchestra.run.smithi097.stdout: "purged_snapdirs", 2021-10-08T19:27:42.345 INFO:teuthology.orchestra.run.smithi097.stdout: "recovery_deletes", 2021-10-08T19:27:42.345 INFO:teuthology.orchestra.run.smithi097.stdout: "sortbitwise" 2021-10-08T19:27:42.345 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:27:42.345 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_version": 18, 2021-10-08T19:27:42.345 INFO:teuthology.orchestra.run.smithi097.stdout: "full_ratio": 0.94999998807907104, 2021-10-08T19:27:42.346 INFO:teuthology.orchestra.run.smithi097.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-08T19:27:42.346 INFO:teuthology.orchestra.run.smithi097.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-08T19:27:42.346 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_snapshot": "", 2021-10-08T19:27:42.346 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_max": 7, 2021-10-08T19:27:42.347 INFO:teuthology.orchestra.run.smithi097.stdout: "max_osd": 8, 2021-10-08T19:27:42.347 INFO:teuthology.orchestra.run.smithi097.stdout: "require_min_compat_client": "luminous", 2021-10-08T19:27:42.347 INFO:teuthology.orchestra.run.smithi097.stdout: "min_compat_client": "luminous", 2021-10-08T19:27:42.347 INFO:teuthology.orchestra.run.smithi097.stdout: "require_osd_release": "quincy", 2021-10-08T19:27:42.348 INFO:teuthology.orchestra.run.smithi097.stdout: "pools": [ 2021-10-08T19:27:42.348 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.348 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 1, 2021-10-08T19:27:42.348 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": ".mgr", 2021-10-08T19:27:42.348 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:19:44.413311+0000", 2021-10-08T19:27:42.349 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:27:42.349 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:27:42.349 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:27:42.349 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:27:42.349 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:27:42.350 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:27:42.350 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:27:42.350 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:27:42.351 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:27:42.351 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:27:42.351 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:27:42.351 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:27:42.352 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 11, 2021-10-08T19:27:42.352 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 11, 2021-10-08T19:27:42.352 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 11, 2021-10-08T19:27:42.352 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 11, 2021-10-08T19:27:42.353 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 11, 2021-10-08T19:27:42.353 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:27:42.353 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:27:42.353 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:27:42.354 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:27:42.354 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:27:42.354 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:27:42.354 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:27:42.354 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.355 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "171", 2021-10-08T19:27:42.355 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:27:42.355 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:27:42.355 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "170", 2021-10-08T19:27:42.356 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:27:42.356 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:27:42.356 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:27:42.356 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:27:42.356 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:27:42.357 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:27:42.357 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:27:42.357 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:27:42.357 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:27:42.357 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:27:42.358 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:27:42.358 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:27:42.358 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:27:42.358 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:27:42.359 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:27:42.359 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:27:42.359 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:27:42.359 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:27:42.360 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:27:42.360 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:27:42.360 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:27:42.360 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:27:42.361 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:27:42.361 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.361 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:27:42.361 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:27:42.362 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:27:42.362 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:27:42.362 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:27:42.362 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:27:42.362 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:27:42.363 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:27:42.363 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:27:42.363 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:27:42.363 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:27:42.363 INFO:teuthology.orchestra.run.smithi097.stdout: "options": { 2021-10-08T19:27:42.364 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_min": 1 2021-10-08T19:27:42.364 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.364 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:27:42.365 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": {} 2021-10-08T19:27:42.365 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:42.365 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.365 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.365 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 2, 2021-10-08T19:27:42.366 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": ".rgw.root", 2021-10-08T19:27:42.366 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:21:21.940881+0000", 2021-10-08T19:27:42.366 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:27:42.366 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:27:42.366 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:27:42.367 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:27:42.367 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:27:42.367 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:27:42.367 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:27:42.368 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:27:42.368 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:27:42.368 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:27:42.368 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:27:42.369 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:27:42.369 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 32, 2021-10-08T19:27:42.369 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 32, 2021-10-08T19:27:42.369 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 32, 2021-10-08T19:27:42.370 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 32, 2021-10-08T19:27:42.370 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 32, 2021-10-08T19:27:42.370 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:27:42.370 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:27:42.370 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:27:42.371 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:27:42.371 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:27:42.371 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:27:42.371 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:27:42.372 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.372 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "62", 2021-10-08T19:27:42.372 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:27:42.372 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:27:42.372 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2021-10-08T19:27:42.373 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:27:42.373 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:27:42.373 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:27:42.374 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:27:42.374 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:27:42.374 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:27:42.374 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:27:42.374 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:27:42.375 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:27:42.375 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:27:42.375 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:27:42.375 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:27:42.375 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:27:42.376 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:27:42.376 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:27:42.376 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:27:42.376 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:27:42.377 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:27:42.377 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:27:42.377 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:27:42.377 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:27:42.378 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:27:42.378 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:27:42.378 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.378 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:27:42.379 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:27:42.379 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:27:42.379 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:27:42.379 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:27:42.379 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:27:42.380 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:27:42.380 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:27:42.380 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:27:42.380 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:27:42.380 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:27:42.381 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2021-10-08T19:27:42.381 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:27:42.381 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw": {} 2021-10-08T19:27:42.381 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:42.382 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.382 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.382 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 3, 2021-10-08T19:27:42.382 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "iscsi", 2021-10-08T19:27:42.382 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:21:22.536945+0000", 2021-10-08T19:27:42.383 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:27:42.383 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:27:42.383 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:27:42.383 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:27:42.383 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:27:42.384 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:27:42.384 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:27:42.384 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:27:42.384 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:27:42.384 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:27:42.385 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:27:42.385 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:27:42.385 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 23, 2021-10-08T19:27:42.386 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 23, 2021-10-08T19:27:42.386 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 23, 2021-10-08T19:27:42.386 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 23, 2021-10-08T19:27:42.386 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 23, 2021-10-08T19:27:42.387 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:27:42.387 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:27:42.387 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:27:42.387 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:27:42.387 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:27:42.388 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:27:42.388 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:27:42.388 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.388 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "132", 2021-10-08T19:27:42.389 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:27:42.389 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:27:42.389 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "131", 2021-10-08T19:27:42.389 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:27:42.389 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:27:42.390 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:27:42.390 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:27:42.390 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:27:42.390 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:27:42.391 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:27:42.391 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:27:42.391 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:27:42.391 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:27:42.391 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:27:42.392 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:27:42.392 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:27:42.392 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:27:42.392 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:27:42.392 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:27:42.393 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:27:42.393 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:27:42.393 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:27:42.393 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:27:42.393 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:27:42.394 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:27:42.394 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:27:42.394 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.395 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:27:42.395 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:27:42.395 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:27:42.396 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:27:42.396 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:27:42.396 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:27:42.396 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:27:42.397 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:27:42.397 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:27:42.397 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:27:42.397 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:27:42.397 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2021-10-08T19:27:42.398 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:27:42.398 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd": {} 2021-10-08T19:27:42.398 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:42.398 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.398 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.399 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 4, 2021-10-08T19:27:42.399 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "default.rgw.log", 2021-10-08T19:27:42.399 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:21:23.886328+0000", 2021-10-08T19:27:42.399 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:27:42.399 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:27:42.400 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:27:42.400 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:27:42.401 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:27:42.402 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:27:42.402 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:27:42.402 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:27:42.403 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:27:42.404 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:27:42.404 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:27:42.404 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:27:42.405 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 32, 2021-10-08T19:27:42.405 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 32, 2021-10-08T19:27:42.406 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 32, 2021-10-08T19:27:42.406 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 32, 2021-10-08T19:27:42.406 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 32, 2021-10-08T19:27:42.407 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:27:42.407 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:27:42.407 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:27:42.407 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:27:42.408 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:27:42.408 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:27:42.408 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:27:42.408 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.409 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "64", 2021-10-08T19:27:42.409 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:27:42.409 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:27:42.409 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2021-10-08T19:27:42.410 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:27:42.410 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:27:42.410 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:27:42.410 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:27:42.411 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:27:42.411 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:27:42.411 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:27:42.411 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:27:42.412 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:27:42.412 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:27:42.412 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:27:42.412 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:27:42.413 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:27:42.413 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:27:42.413 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:27:42.413 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:27:42.414 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:27:42.414 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:27:42.414 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:27:42.414 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:27:42.414 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:27:42.415 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:27:42.415 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:27:42.415 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.415 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:27:42.415 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:27:42.416 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:27:42.416 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:27:42.416 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:27:42.416 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:27:42.417 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:27:42.417 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:27:42.418 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:27:42.418 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:27:42.419 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:27:42.419 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2021-10-08T19:27:42.419 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:27:42.420 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw": {} 2021-10-08T19:27:42.420 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:42.421 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.422 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.422 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 5, 2021-10-08T19:27:42.422 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "default.rgw.control", 2021-10-08T19:27:42.423 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:21:25.865032+0000", 2021-10-08T19:27:42.423 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:27:42.424 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:27:42.424 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:27:42.424 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:27:42.425 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:27:42.425 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:27:42.426 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:27:42.426 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:27:42.426 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:27:42.427 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:27:42.427 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:27:42.428 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:27:42.428 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 32, 2021-10-08T19:27:42.429 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 32, 2021-10-08T19:27:42.429 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 32, 2021-10-08T19:27:42.429 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 32, 2021-10-08T19:27:42.430 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 32, 2021-10-08T19:27:42.430 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:27:42.431 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:27:42.431 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:27:42.432 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:27:42.432 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:27:42.432 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:27:42.433 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:27:42.433 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.434 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "66", 2021-10-08T19:27:42.434 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:27:42.434 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:27:42.435 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2021-10-08T19:27:42.435 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:27:42.436 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:27:42.436 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:27:42.436 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:27:42.437 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:27:42.437 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:27:42.437 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:27:42.438 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:27:42.438 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:27:42.439 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:27:42.439 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:27:42.440 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:27:42.440 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:27:42.440 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:27:42.441 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:27:42.441 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:27:42.441 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:27:42.442 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:27:42.442 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:27:42.443 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:27:42.443 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:27:42.443 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:27:42.444 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:27:42.444 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.444 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:27:42.444 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:27:42.445 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:27:42.445 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:27:42.445 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:27:42.445 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:27:42.445 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:27:42.446 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:27:42.446 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:27:42.446 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:27:42.446 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:27:42.447 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2021-10-08T19:27:42.447 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:27:42.447 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw": {} 2021-10-08T19:27:42.447 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:42.447 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.448 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.448 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 6, 2021-10-08T19:27:42.448 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "default.rgw.meta", 2021-10-08T19:27:42.449 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:21:27.940767+0000", 2021-10-08T19:27:42.449 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:27:42.449 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:27:42.449 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:27:42.449 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:27:42.450 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:27:42.450 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:27:42.450 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:27:42.450 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:27:42.450 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:27:42.451 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:27:42.451 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:27:42.451 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:27:42.451 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 32, 2021-10-08T19:27:42.451 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 32, 2021-10-08T19:27:42.452 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 32, 2021-10-08T19:27:42.452 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 32, 2021-10-08T19:27:42.452 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 32, 2021-10-08T19:27:42.452 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:27:42.452 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:27:42.453 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:27:42.453 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:27:42.453 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:27:42.453 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:27:42.454 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:27:42.454 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.454 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "69", 2021-10-08T19:27:42.454 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:27:42.454 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:27:42.455 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2021-10-08T19:27:42.455 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:27:42.455 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:27:42.455 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:27:42.455 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:27:42.456 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:27:42.456 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:27:42.456 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:27:42.456 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:27:42.457 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:27:42.457 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:27:42.457 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:27:42.457 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:27:42.458 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:27:42.458 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:27:42.458 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:27:42.458 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:27:42.458 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:27:42.459 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:27:42.459 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:27:42.459 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:27:42.459 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:27:42.459 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:27:42.460 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:27:42.460 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.460 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:27:42.460 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:27:42.460 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:27:42.461 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:27:42.461 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:27:42.461 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:27:42.461 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:27:42.461 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:27:42.462 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:27:42.462 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:27:42.462 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:27:42.462 INFO:teuthology.orchestra.run.smithi097.stdout: "options": { 2021-10-08T19:27:42.462 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_bias": 4, 2021-10-08T19:27:42.463 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_min": 8 2021-10-08T19:27:42.463 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.463 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:27:42.463 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw": {} 2021-10-08T19:27:42.464 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:42.464 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:42.464 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:27:42.464 INFO:teuthology.orchestra.run.smithi097.stdout: "osds": [ 2021-10-08T19:27:42.464 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.465 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 0, 2021-10-08T19:27:42.465 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "9e64e714-a5d5-4fbb-ae2b-1df4bf14b8e0", 2021-10-08T19:27:42.465 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:27:42.465 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:27:42.466 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:27:42.466 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:27:42.466 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:27:42.466 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:27:42.467 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 8, 2021-10-08T19:27:42.467 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 177, 2021-10-08T19:27:42.467 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:27:42.467 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:27:42.467 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:27:42.468 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:42.468 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.468 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:42.468 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6801", 2021-10-08T19:27:42.468 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3354161282 2021-10-08T19:27:42.469 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:42.469 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:42.469 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.469 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:27:42.469 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:42.470 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.470 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:42.470 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6802", 2021-10-08T19:27:42.470 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3354161282 2021-10-08T19:27:42.470 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:42.471 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:42.471 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.471 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:27:42.471 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:42.471 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.472 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:42.472 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6804", 2021-10-08T19:27:42.472 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3354161282 2021-10-08T19:27:42.472 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:42.473 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:42.473 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.473 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:27:42.473 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:42.473 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.474 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:42.474 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6803", 2021-10-08T19:27:42.474 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3354161282 2021-10-08T19:27:42.474 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:42.475 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:42.475 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.475 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.97:6801/3354161282", 2021-10-08T19:27:42.475 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.97:6802/3354161282", 2021-10-08T19:27:42.476 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.97:6804/3354161282", 2021-10-08T19:27:42.476 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.97:6803/3354161282", 2021-10-08T19:27:42.476 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:27:42.476 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:27:42.476 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:27:42.477 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:42.477 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.477 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.477 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 1, 2021-10-08T19:27:42.477 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "32602a22-f263-4b62-a8d8-50fddfb73fa8", 2021-10-08T19:27:42.478 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:27:42.478 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:27:42.478 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:27:42.478 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:27:42.478 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:27:42.479 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:27:42.479 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 13, 2021-10-08T19:27:42.479 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 174, 2021-10-08T19:27:42.480 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:27:42.480 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:27:42.480 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:27:42.480 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:42.480 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.481 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:42.481 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6805", 2021-10-08T19:27:42.481 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 735799205 2021-10-08T19:27:42.481 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:42.481 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:42.482 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.482 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:27:42.482 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:42.482 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.483 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:42.483 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6806", 2021-10-08T19:27:42.483 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 735799205 2021-10-08T19:27:42.483 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:42.484 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:42.484 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.484 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:27:42.484 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:42.484 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.485 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:42.485 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6808", 2021-10-08T19:27:42.485 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 735799205 2021-10-08T19:27:42.485 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:42.485 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:42.486 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.486 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:27:42.486 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:42.486 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.486 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:42.487 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6807", 2021-10-08T19:27:42.487 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 735799205 2021-10-08T19:27:42.487 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:42.487 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:42.487 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.488 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.97:6805/735799205", 2021-10-08T19:27:42.488 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.97:6806/735799205", 2021-10-08T19:27:42.488 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.97:6808/735799205", 2021-10-08T19:27:42.488 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.97:6807/735799205", 2021-10-08T19:27:42.488 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:27:42.489 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:27:42.489 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:27:42.489 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:42.489 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.489 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.490 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 2, 2021-10-08T19:27:42.490 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "88e0e4a2-b4a3-4a00-8669-03c3d9b166c5", 2021-10-08T19:27:42.490 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:27:42.490 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:27:42.491 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:27:42.491 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:27:42.491 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:27:42.491 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:27:42.491 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 18, 2021-10-08T19:27:42.492 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 113, 2021-10-08T19:27:42.492 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:27:42.492 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:27:42.492 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:27:42.493 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:42.493 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.493 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:42.493 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6809", 2021-10-08T19:27:42.493 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2366482649 2021-10-08T19:27:42.494 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:42.494 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:42.494 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.494 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:27:42.495 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:42.495 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.495 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:42.495 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6810", 2021-10-08T19:27:42.495 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2366482649 2021-10-08T19:27:42.496 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:42.496 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:42.496 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.496 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:27:42.496 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:42.497 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.497 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:42.497 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6812", 2021-10-08T19:27:42.497 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2366482649 2021-10-08T19:27:42.497 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:42.498 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:42.498 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.498 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:27:42.498 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:42.498 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.499 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:42.499 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6811", 2021-10-08T19:27:42.499 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2366482649 2021-10-08T19:27:42.499 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:42.499 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:42.500 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.500 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.97:6809/2366482649", 2021-10-08T19:27:42.500 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.97:6810/2366482649", 2021-10-08T19:27:42.500 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.97:6812/2366482649", 2021-10-08T19:27:42.500 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.97:6811/2366482649", 2021-10-08T19:27:42.501 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:27:42.501 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:27:42.501 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:27:42.501 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:42.502 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.502 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.502 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 3, 2021-10-08T19:27:42.502 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "e689d708-b501-4526-a31a-1e598b74654d", 2021-10-08T19:27:42.503 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:27:42.503 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:27:42.503 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:27:42.503 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:27:42.503 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:27:42.504 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:27:42.504 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 24, 2021-10-08T19:27:42.504 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 178, 2021-10-08T19:27:42.504 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:27:42.504 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:27:42.505 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:27:42.505 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:42.505 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.505 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:42.505 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6813", 2021-10-08T19:27:42.506 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3191181122 2021-10-08T19:27:42.506 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:42.506 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:42.506 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.506 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:27:42.507 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:42.507 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.507 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:42.507 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6814", 2021-10-08T19:27:42.507 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3191181122 2021-10-08T19:27:42.508 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:42.508 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:42.508 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.508 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:27:42.508 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:42.509 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.509 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:42.509 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6816", 2021-10-08T19:27:42.509 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3191181122 2021-10-08T19:27:42.510 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:42.510 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:42.510 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.510 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:27:42.511 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:42.511 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.511 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:42.511 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6815", 2021-10-08T19:27:42.511 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3191181122 2021-10-08T19:27:42.512 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:42.512 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:42.512 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.512 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.97:6813/3191181122", 2021-10-08T19:27:42.512 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.97:6814/3191181122", 2021-10-08T19:27:42.513 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.97:6816/3191181122", 2021-10-08T19:27:42.513 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.97:6815/3191181122", 2021-10-08T19:27:42.513 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:27:42.513 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:27:42.513 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:27:42.514 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:42.514 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.514 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.515 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 4, 2021-10-08T19:27:42.515 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "67e4730a-be1c-4d88-9307-e3c2cf3ab2ef", 2021-10-08T19:27:42.515 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:27:42.515 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:27:42.515 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:27:42.516 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:27:42.516 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:27:42.516 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:27:42.516 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 30, 2021-10-08T19:27:42.517 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 174, 2021-10-08T19:27:42.517 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:27:42.517 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:27:42.517 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:27:42.517 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:42.518 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.518 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:42.518 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6800", 2021-10-08T19:27:42.519 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 106778208 2021-10-08T19:27:42.519 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:42.519 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:42.519 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.519 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:27:42.520 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:42.520 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.520 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:42.520 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6801", 2021-10-08T19:27:42.520 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 106778208 2021-10-08T19:27:42.521 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:42.521 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:42.521 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.521 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:27:42.521 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:42.522 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.522 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:42.522 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6803", 2021-10-08T19:27:42.522 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 106778208 2021-10-08T19:27:42.522 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:42.523 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:42.523 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.523 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:27:42.523 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:42.524 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.524 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:42.524 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6802", 2021-10-08T19:27:42.524 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 106778208 2021-10-08T19:27:42.524 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:42.525 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:42.525 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.525 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.117:6800/106778208", 2021-10-08T19:27:42.525 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.117:6801/106778208", 2021-10-08T19:27:42.525 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.117:6803/106778208", 2021-10-08T19:27:42.526 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.117:6802/106778208", 2021-10-08T19:27:42.526 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:27:42.526 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:27:42.526 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:27:42.526 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:42.527 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.527 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.527 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 5, 2021-10-08T19:27:42.528 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "f9fd3153-3e4e-4489-8927-a65641f05d42", 2021-10-08T19:27:42.528 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:27:42.528 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:27:42.528 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:27:42.528 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:27:42.529 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:27:42.529 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:27:42.529 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 38, 2021-10-08T19:27:42.529 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 178, 2021-10-08T19:27:42.529 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:27:42.530 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:27:42.530 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:27:42.530 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:42.530 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.530 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:42.531 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6804", 2021-10-08T19:27:42.531 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3199889891 2021-10-08T19:27:42.531 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:42.531 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:42.531 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.532 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:27:42.532 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:42.532 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.532 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:42.532 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6805", 2021-10-08T19:27:42.533 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3199889891 2021-10-08T19:27:42.533 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:42.533 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:42.533 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.533 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:27:42.534 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:42.534 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.534 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:42.534 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6807", 2021-10-08T19:27:42.534 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3199889891 2021-10-08T19:27:42.535 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:42.535 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:42.535 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.535 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:27:42.536 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:42.536 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.536 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:42.536 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6806", 2021-10-08T19:27:42.537 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3199889891 2021-10-08T19:27:42.537 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:42.537 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:42.537 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.538 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.117:6804/3199889891", 2021-10-08T19:27:42.538 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.117:6805/3199889891", 2021-10-08T19:27:42.538 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.117:6807/3199889891", 2021-10-08T19:27:42.538 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.117:6806/3199889891", 2021-10-08T19:27:42.538 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:27:42.539 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:27:42.539 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:27:42.539 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:42.539 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.540 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.540 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 6, 2021-10-08T19:27:42.540 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "84898f12-c37d-4eb6-8b71-5b86bfe16e7d", 2021-10-08T19:27:42.540 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:27:42.540 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:27:42.541 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:27:42.541 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:27:42.541 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:27:42.541 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:27:42.541 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 47, 2021-10-08T19:27:42.542 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 174, 2021-10-08T19:27:42.542 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:27:42.542 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:27:42.542 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:27:42.542 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:42.543 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.543 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:42.543 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6808", 2021-10-08T19:27:42.543 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2185843951 2021-10-08T19:27:42.544 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:42.544 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:42.544 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.544 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:27:42.544 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:42.545 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.545 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:42.545 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6809", 2021-10-08T19:27:42.545 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2185843951 2021-10-08T19:27:42.546 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:42.546 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:42.546 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.546 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:27:42.547 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:42.547 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.547 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:42.547 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6811", 2021-10-08T19:27:42.547 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2185843951 2021-10-08T19:27:42.548 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:42.548 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:42.548 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.549 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:27:42.549 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:42.549 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.549 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:42.549 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6810", 2021-10-08T19:27:42.550 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2185843951 2021-10-08T19:27:42.550 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:42.550 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:42.550 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.551 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.117:6808/2185843951", 2021-10-08T19:27:42.551 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.117:6809/2185843951", 2021-10-08T19:27:42.551 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.117:6811/2185843951", 2021-10-08T19:27:42.551 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.117:6810/2185843951", 2021-10-08T19:27:42.551 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:27:42.552 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:27:42.552 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:27:42.552 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:42.552 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.552 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.553 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 7, 2021-10-08T19:27:42.553 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "529af2ce-2ae9-41ed-8c8e-d133628cfd20", 2021-10-08T19:27:42.553 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:27:42.553 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:27:42.554 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:27:42.554 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:27:42.554 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:27:42.554 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:27:42.555 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 55, 2021-10-08T19:27:42.555 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 174, 2021-10-08T19:27:42.555 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:27:42.555 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:27:42.556 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:27:42.556 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:42.556 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.556 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:42.556 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6812", 2021-10-08T19:27:42.557 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2817683239 2021-10-08T19:27:42.557 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:42.557 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:42.557 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.557 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:27:42.558 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:42.558 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.558 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:42.558 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6813", 2021-10-08T19:27:42.558 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2817683239 2021-10-08T19:27:42.559 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:42.559 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:42.559 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.559 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:27:42.560 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:42.560 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.560 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:42.560 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6815", 2021-10-08T19:27:42.560 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2817683239 2021-10-08T19:27:42.561 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:42.561 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:42.561 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.561 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:27:42.561 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:27:42.562 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.562 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:27:42.562 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6814", 2021-10-08T19:27:42.562 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2817683239 2021-10-08T19:27:42.563 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:42.563 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:42.563 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.563 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.117:6812/2817683239", 2021-10-08T19:27:42.564 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.117:6813/2817683239", 2021-10-08T19:27:42.564 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.117:6815/2817683239", 2021-10-08T19:27:42.564 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.117:6814/2817683239", 2021-10-08T19:27:42.564 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:27:42.564 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:27:42.565 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:27:42.565 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:42.565 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:42.565 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:27:42.565 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_xinfo": [ 2021-10-08T19:27:42.566 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.566 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 0, 2021-10-08T19:27:42.566 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:27:42.566 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:27:42.567 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:27:42.567 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:27:42.567 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:27:42.567 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:27:00.020315+0000", 2021-10-08T19:27:42.567 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:27:42.568 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.568 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.568 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 1, 2021-10-08T19:27:42.568 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:27:42.568 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:27:42.569 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:27:42.569 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:27:42.569 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:27:42.569 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:27:03.975227+0000", 2021-10-08T19:27:42.569 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:27:42.570 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.570 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.570 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 2, 2021-10-08T19:27:42.570 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:27:42.570 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:27:42.571 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:27:42.571 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:27:42.571 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:27:42.571 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:26:52.444313+0000", 2021-10-08T19:27:42.572 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:27:42.572 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.572 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.572 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 3, 2021-10-08T19:27:42.573 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:27:42.573 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:27:42.573 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:27:42.573 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:27:42.573 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:27:42.574 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:27:00.853222+0000", 2021-10-08T19:27:42.574 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:27:42.574 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.574 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.574 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 4, 2021-10-08T19:27:42.575 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:27:42.575 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:27:42.575 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:27:42.575 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:27:42.575 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:27:42.576 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:26:59.839375+0000", 2021-10-08T19:27:42.576 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:27:42.576 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.576 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.576 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 5, 2021-10-08T19:27:42.577 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:27:42.577 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:27:42.577 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:27:42.577 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:27:42.578 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:27:42.578 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:26:32.959964+0000", 2021-10-08T19:27:42.578 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:27:42.578 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.578 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.579 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 6, 2021-10-08T19:27:42.579 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:27:42.579 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:27:42.579 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:27:42.579 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:27:42.580 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:27:42.580 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:27:15.875830+0000", 2021-10-08T19:27:42.580 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:27:42.581 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.581 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.581 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 7, 2021-10-08T19:27:42.581 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:27:42.581 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:27:42.582 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:27:42.582 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:27:42.582 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:27:42.582 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:27:14.154194+0000", 2021-10-08T19:27:42.582 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:27:42.583 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:42.583 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:27:42.583 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_upmap": [], 2021-10-08T19:27:42.583 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_upmap_items": [ 2021-10-08T19:27:42.583 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.584 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "2.0", 2021-10-08T19:27:42.584 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:27:42.584 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.584 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 7, 2021-10-08T19:27:42.584 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 2 2021-10-08T19:27:42.585 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:42.585 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:42.585 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.585 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.586 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "2.1a", 2021-10-08T19:27:42.586 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:27:42.586 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.586 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 7, 2021-10-08T19:27:42.586 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 2 2021-10-08T19:27:42.587 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:42.587 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:42.587 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.587 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.587 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "4.14", 2021-10-08T19:27:42.588 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:27:42.588 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.588 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 3, 2021-10-08T19:27:42.588 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 2 2021-10-08T19:27:42.589 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:42.589 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:42.589 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.589 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.590 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "4.1c", 2021-10-08T19:27:42.590 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:27:42.590 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.590 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 1, 2021-10-08T19:27:42.590 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 5 2021-10-08T19:27:42.591 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:42.591 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:42.591 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.591 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.591 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "5.19", 2021-10-08T19:27:42.592 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:27:42.592 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:27:42.592 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 5, 2021-10-08T19:27:42.592 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 7 2021-10-08T19:27:42.592 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:42.593 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:27:42.593 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:42.593 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:27:42.593 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_temp": [], 2021-10-08T19:27:42.593 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_temp": [], 2021-10-08T19:27:42.594 INFO:teuthology.orchestra.run.smithi097.stdout: "blocklist": { 2021-10-08T19:27:42.594 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/2600364788": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:27:42.594 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/4129083289": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:27:42.594 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/1443158975": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:27:42.595 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/2472640384": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:27:42.595 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/3196919488": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:27:42.595 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:6800/3195862546": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:27:42.595 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:6800/3931202434": "2021-10-09T19:17:10.051948+0000", 2021-10-08T19:27:42.595 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/2761595213": "2021-10-09T19:17:10.051948+0000", 2021-10-08T19:27:42.596 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/900681504": "2021-10-09T19:17:10.051948+0000", 2021-10-08T19:27:42.596 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/3932251406": "2021-10-09T19:17:10.051948+0000", 2021-10-08T19:27:42.596 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/398006785": "2021-10-09T19:16:48.651177+0000", 2021-10-08T19:27:42.596 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/1642570050": "2021-10-09T19:16:48.651177+0000", 2021-10-08T19:27:42.596 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/300178790": "2021-10-09T19:16:48.651177+0000", 2021-10-08T19:27:42.597 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:6800/845999767": "2021-10-09T19:16:48.651177+0000" 2021-10-08T19:27:42.597 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.597 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profiles": { 2021-10-08T19:27:42.597 INFO:teuthology.orchestra.run.smithi097.stdout: "default": { 2021-10-08T19:27:42.598 INFO:teuthology.orchestra.run.smithi097.stdout: "crush-failure-domain": "osd", 2021-10-08T19:27:42.598 INFO:teuthology.orchestra.run.smithi097.stdout: "k": "2", 2021-10-08T19:27:42.598 INFO:teuthology.orchestra.run.smithi097.stdout: "m": "1", 2021-10-08T19:27:42.598 INFO:teuthology.orchestra.run.smithi097.stdout: "plugin": "jerasure", 2021-10-08T19:27:42.599 INFO:teuthology.orchestra.run.smithi097.stdout: "technique": "reed_sol_van" 2021-10-08T19:27:42.599 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:42.599 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:27:42.599 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps_queue": [], 2021-10-08T19:27:42.599 INFO:teuthology.orchestra.run.smithi097.stdout: "new_removed_snaps": [], 2021-10-08T19:27:42.600 INFO:teuthology.orchestra.run.smithi097.stdout: "new_purged_snaps": [], 2021-10-08T19:27:42.600 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_node_flags": {}, 2021-10-08T19:27:42.600 INFO:teuthology.orchestra.run.smithi097.stdout: "device_class_flags": {}, 2021-10-08T19:27:42.600 INFO:teuthology.orchestra.run.smithi097.stdout: "stretch_mode": { 2021-10-08T19:27:42.600 INFO:teuthology.orchestra.run.smithi097.stdout: "stretch_mode_enabled": false, 2021-10-08T19:27:42.601 INFO:teuthology.orchestra.run.smithi097.stdout: "stretch_bucket_count": 0, 2021-10-08T19:27:42.601 INFO:teuthology.orchestra.run.smithi097.stdout: "degraded_stretch_mode": 0, 2021-10-08T19:27:42.601 INFO:teuthology.orchestra.run.smithi097.stdout: "recovering_stretch_mode": 0, 2021-10-08T19:27:42.601 INFO:teuthology.orchestra.run.smithi097.stdout: "stretch_mode_bucket": 0 2021-10-08T19:27:42.601 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:27:42.602 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:27:42.603 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:42.603 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:27:42.604 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:27:42.650 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'unique_pool_1' created 2021-10-08T19:27:42.705 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:27:42.731 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:42.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:42 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3523279842' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_1", "pg_num": 16}]: dispatch 2021-10-08T19:27:42.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:42 smithi117 ceph-mon[34585]: from='client.25072 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_1", "pg_num": 16}]: dispatch 2021-10-08T19:27:42.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:42 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2906908325' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2021-10-08T19:27:42.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:42 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:27:42.970 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:27:42 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:27:42] "GET /metrics HTTP/1.1" 200 154439 "" "Prometheus/2.18.1" 2021-10-08T19:27:42.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:42 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3523279842' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_1", "pg_num": 16}]: dispatch 2021-10-08T19:27:42.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:42 smithi097 ceph-mon[41966]: from='client.25072 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_1", "pg_num": 16}]: dispatch 2021-10-08T19:27:42.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:42 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2906908325' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2021-10-08T19:27:42.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:42 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:27:42.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:42 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3523279842' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_1", "pg_num": 16}]: dispatch 2021-10-08T19:27:42.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:42 smithi097 ceph-mon[32687]: from='client.25072 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_1", "pg_num": 16}]: dispatch 2021-10-08T19:27:42.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:42 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2906908325' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2021-10-08T19:27:42.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:42 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:27:43.040 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:27:43.042 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:43.043 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:27:43.144 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:27:43.174 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:43.500 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2021-10-08T19:27:43.501 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:27:43.566 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set nodeep-scrub 2021-10-08T19:27:43.610 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:27:43.612 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:43.612 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:27:43.637 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:43 smithi117 ceph-mon[34585]: pgmap v291: 162 pgs: 162 active+clean; 582 KiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 857 B/s rd, 0 op/s; 97 KiB/s, 1 objects/s recovering 2021-10-08T19:27:43.637 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:27:43 smithi117 conmon[69189]: level=error ts=2021-10-08T19:27:43.504Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=2 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:27:43.713 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:27:43.739 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:43.905 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:27:43 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:27:43] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:27:43.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:43 smithi117 ceph-mon[34585]: from='client.25072 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_1", "pg_num": 16}]': finished 2021-10-08T19:27:43.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:43 smithi117 ceph-mon[34585]: osdmap e182: 8 total, 8 up, 8 in 2021-10-08T19:27:43.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:27:43.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:43 smithi097 ceph-mon[32687]: pgmap v291: 162 pgs: 162 active+clean; 582 KiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 857 B/s rd, 0 op/s; 97 KiB/s, 1 objects/s recovering 2021-10-08T19:27:43.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:43 smithi097 ceph-mon[32687]: from='client.25072 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_1", "pg_num": 16}]': finished 2021-10-08T19:27:43.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:43 smithi097 ceph-mon[32687]: osdmap e182: 8 total, 8 up, 8 in 2021-10-08T19:27:43.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:27:43.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:43 smithi097 ceph-mon[41966]: pgmap v291: 162 pgs: 162 active+clean; 582 KiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 857 B/s rd, 0 op/s; 97 KiB/s, 1 objects/s recovering 2021-10-08T19:27:43.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:43 smithi097 ceph-mon[41966]: from='client.25072 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_1", "pg_num": 16}]': finished 2021-10-08T19:27:43.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:43 smithi097 ceph-mon[41966]: osdmap e182: 8 total, 8 up, 8 in 2021-10-08T19:27:43.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:27:44.163 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd pool application enable unique_pool_1 rados --yes-i-really-mean-it || true 2021-10-08T19:27:44.202 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:27:44.205 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:44.207 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:27:44.268 INFO:tasks.thrashosds.thrasher:j is {'epoch': 181, 'fsid': '1d01f6d6-286c-11ec-8c25-001a4aab830c', 'created': '2021-10-08T19:16:25.258003+0000', 'modified': '2021-10-08T19:27:40.544967+0000', 'last_up_change': '2021-10-08T19:21:15.388758+0000', 'last_in_change': '2021-10-08T19:24:24.060804+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 18, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 7, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'quincy', 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2021-10-08T19:19:44.413311+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 11, 'pg_placement_num': 11, 'pg_placement_num_target': 11, 'pg_num_target': 11, 'pg_num_pending': 11, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '171', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '170', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': '.rgw.root', 'create_time': '2021-10-08T19:21:21.940881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 3, 'pool_name': 'iscsi', 'create_time': '2021-10-08T19:21:22.536945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 23, 'pg_placement_num': 23, 'pg_placement_num_target': 23, 'pg_num_target': 23, 'pg_num_pending': 23, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '132', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '131', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 4, 'pool_name': 'default.rgw.log', 'create_time': '2021-10-08T19:21:23.886328+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 5, 'pool_name': 'default.rgw.control', 'create_time': '2021-10-08T19:21:25.865032+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 6, 'pool_name': 'default.rgw.meta', 'create_time': '2021-10-08T19:21:27.940767+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '69', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 8}, 'application_metadata': {'rgw': {}}}], 'osds': [{'osd': 0, 'uuid': '9e64e714-a5d5-4fbb-ae2b-1df4bf14b8e0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 177, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6801', 'nonce': 3354161282}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6802', 'nonce': 3354161282}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6804', 'nonce': 3354161282}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6803', 'nonce': 3354161282}]}, 'public_addr': '172.21.15.97:6801/3354161282', 'cluster_addr': '172.21.15.97:6802/3354161282', 'heartbeat_back_addr': '172.21.15.97:6804/3354161282', 'heartbeat_front_addr': '172.21.15.97:6803/3354161282', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '32602a22-f263-4b62-a8d8-50fddfb73fa8', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 174, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6805', 'nonce': 735799205}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6806', 'nonce': 735799205}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6808', 'nonce': 735799205}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6807', 'nonce': 735799205}]}, 'public_addr': '172.21.15.97:6805/735799205', 'cluster_addr': '172.21.15.97:6806/735799205', 'heartbeat_back_addr': '172.21.15.97:6808/735799205', 'heartbeat_front_addr': '172.21.15.97:6807/735799205', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '88e0e4a2-b4a3-4a00-8669-03c3d9b166c5', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 18, 'up_thru': 113, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6809', 'nonce': 2366482649}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6810', 'nonce': 2366482649}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6812', 'nonce': 2366482649}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6811', 'nonce': 2366482649}]}, 'public_addr': '172.21.15.97:6809/2366482649', 'cluster_addr': '172.21.15.97:6810/2366482649', 'heartbeat_back_addr': '172.21.15.97:6812/2366482649', 'heartbeat_front_addr': '172.21.15.97:6811/2366482649', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': 'e689d708-b501-4526-a31a-1e598b74654d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 24, 'up_thru': 178, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6813', 'nonce': 3191181122}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6814', 'nonce': 3191181122}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6816', 'nonce': 3191181122}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6815', 'nonce': 3191181122}]}, 'public_addr': '172.21.15.97:6813/3191181122', 'cluster_addr': '172.21.15.97:6814/3191181122', 'heartbeat_back_addr': '172.21.15.97:6816/3191181122', 'heartbeat_front_addr': '172.21.15.97:6815/3191181122', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '67e4730a-be1c-4d88-9307-e3c2cf3ab2ef', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 30, 'up_thru': 174, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6800', 'nonce': 106778208}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6801', 'nonce': 106778208}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6803', 'nonce': 106778208}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6802', 'nonce': 106778208}]}, 'public_addr': '172.21.15.117:6800/106778208', 'cluster_addr': '172.21.15.117:6801/106778208', 'heartbeat_back_addr': '172.21.15.117:6803/106778208', 'heartbeat_front_addr': '172.21.15.117:6802/106778208', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'f9fd3153-3e4e-4489-8927-a65641f05d42', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 38, 'up_thru': 178, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6804', 'nonce': 3199889891}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6805', 'nonce': 3199889891}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6807', 'nonce': 3199889891}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6806', 'nonce': 3199889891}]}, 'public_addr': '172.21.15.117:6804/3199889891', 'cluster_addr': '172.21.15.117:6805/3199889891', 'heartbeat_back_addr': '172.21.15.117:6807/3199889891', 'heartbeat_front_addr': '172.21.15.117:6806/3199889891', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '84898f12-c37d-4eb6-8b71-5b86bfe16e7d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 47, 'up_thru': 174, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6808', 'nonce': 2185843951}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6809', 'nonce': 2185843951}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6811', 'nonce': 2185843951}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6810', 'nonce': 2185843951}]}, 'public_addr': '172.21.15.117:6808/2185843951', 'cluster_addr': '172.21.15.117:6809/2185843951', 'heartbeat_back_addr': '172.21.15.117:6811/2185843951', 'heartbeat_front_addr': '172.21.15.117:6810/2185843951', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '529af2ce-2ae9-41ed-8c8e-d133628cfd20', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 55, 'up_thru': 174, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6812', 'nonce': 2817683239}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6813', 'nonce': 2817683239}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6815', 'nonce': 2817683239}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6814', 'nonce': 2817683239}]}, 'public_addr': '172.21.15.117:6812/2817683239', 'cluster_addr': '172.21.15.117:6813/2817683239', 'heartbeat_back_addr': '172.21.15.117:6815/2817683239', 'heartbeat_front_addr': '172.21.15.117:6814/2817683239', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:27:00.020315+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:27:03.975227+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:26:52.444313+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:27:00.853222+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:26:59.839375+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:26:32.959964+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:27:15.875830+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:27:14.154194+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [{'pgid': '2.0', 'mappings': [{'from': 7, 'to': 2}]}, {'pgid': '2.1a', 'mappings': [{'from': 7, 'to': 2}]}, {'pgid': '4.14', 'mappings': [{'from': 3, 'to': 2}]}, {'pgid': '4.1c', 'mappings': [{'from': 1, 'to': 5}]}, {'pgid': '5.19', 'mappings': [{'from': 5, 'to': 7}]}], 'pg_temp': [], 'primary_temp': [], 'blocklist': {'172.21.15.97:0/2600364788': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:0/4129083289': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:0/1443158975': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:0/2472640384': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:0/3196919488': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:6800/3195862546': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:6800/3931202434': '2021-10-09T19:17:10.051948+0000', '172.21.15.97:0/2761595213': '2021-10-09T19:17:10.051948+0000', '172.21.15.97:0/900681504': '2021-10-09T19:17:10.051948+0000', '172.21.15.97:0/3932251406': '2021-10-09T19:17:10.051948+0000', '172.21.15.97:0/398006785': '2021-10-09T19:16:48.651177+0000', '172.21.15.97:0/1642570050': '2021-10-09T19:16:48.651177+0000', '172.21.15.97:0/300178790': '2021-10-09T19:16:48.651177+0000', '172.21.15.97:6800/845999767': '2021-10-09T19:16:48.651177+0000'}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2021-10-08T19:27:44.269 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph pg dump --format=json 2021-10-08T19:27:44.296 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2021-10-08T19:27:44.308 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:27:44.340 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:44.391 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:27:44.392 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:27:44.395 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:44.396 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:27:44.497 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:27:44.522 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:44.572 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:44.574 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:27:44.575 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:27:44.623 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:27:44.676 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:27:44.699 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:44.745 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:27:44.746 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:44.747 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:27:44.848 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:27:44.877 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:44 smithi097 ceph-mon[41966]: osdmap e183: 8 total, 8 up, 8 in 2021-10-08T19:27:44.878 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:44 smithi097 ceph-mon[32687]: osdmap e183: 8 total, 8 up, 8 in 2021-10-08T19:27:44.879 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:44.880 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:44 smithi117 ceph-mon[34585]: osdmap e183: 8 total, 8 up, 8 in 2021-10-08T19:27:44.893 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:27:44.921 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:27:44.936 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:27:44.941 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:44.942 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:27:44.943 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:27:44.966 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:27:44.984 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:27:45.005 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:27:45.023 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:27:45.041 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:27:45.043 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true' 2021-10-08T19:27:45.043 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true' 2021-10-08T19:27:45.043 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true' 2021-10-08T19:27:45.044 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true' 2021-10-08T19:27:45.044 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true' 2021-10-08T19:27:45.045 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true' 2021-10-08T19:27:45.045 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'true' 2021-10-08T19:27:45.045 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'true' 2021-10-08T19:27:45.046 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:27:45.075 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:45.204 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:27:45.205 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:27:45.321 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:27:45.324 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:45.326 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:27:45.428 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:27:45.453 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:45.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:45 smithi097 ceph-mon[32687]: pgmap v294: 178 pgs: 6 creating+peering, 172 active+clean; 582 KiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2021-10-08T19:27:45.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:45 smithi097 ceph-mon[32687]: osdmap e184: 8 total, 8 up, 8 in 2021-10-08T19:27:45.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:45 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2215276650' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:27:45.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:45 smithi097 ceph-mon[32687]: osdmap e185: 8 total, 8 up, 8 in 2021-10-08T19:27:45.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:45 smithi097 ceph-mon[41966]: pgmap v294: 178 pgs: 6 creating+peering, 172 active+clean; 582 KiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2021-10-08T19:27:45.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:45 smithi097 ceph-mon[41966]: osdmap e184: 8 total, 8 up, 8 in 2021-10-08T19:27:45.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:45 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2215276650' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:27:45.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:45 smithi097 ceph-mon[41966]: osdmap e185: 8 total, 8 up, 8 in 2021-10-08T19:27:45.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:45 smithi117 ceph-mon[34585]: pgmap v294: 178 pgs: 6 creating+peering, 172 active+clean; 582 KiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2021-10-08T19:27:45.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:45 smithi117 ceph-mon[34585]: osdmap e184: 8 total, 8 up, 8 in 2021-10-08T19:27:45.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:45 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2215276650' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:27:45.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:45 smithi117 ceph-mon[34585]: osdmap e185: 8 total, 8 up, 8 in 2021-10-08T19:27:46.409 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:27:46.409 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2021-10-08T19:27:46.410 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2021-10-08T19:27:46.410 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:27:46.448 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:27:46.451 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:46.452 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:27:46.553 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:27:46.579 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:46.679 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:27:46.687 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:46.688 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:27:46.789 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:27:46.822 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:46.905 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:27:46 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:27:47.154 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2021-10-08T19:27:47.183 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:27:47.185 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:47.186 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:27:47.288 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:27:47.316 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:47.423 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:27:47.659 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:47 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:27:47.660 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:47 smithi097 ceph-mon[32687]: pgmap v297: 178 pgs: 6 creating+peering, 172 active+clean; 582 KiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:47.660 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:47 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3742012410' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:27:47.660 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:47 smithi097 ceph-mon[32687]: from='client.25087 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:27:47.661 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is set 2021-10-08T19:27:47.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:47 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:27:47.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:47 smithi117 ceph-mon[34585]: pgmap v297: 178 pgs: 6 creating+peering, 172 active+clean; 582 KiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:47.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:47 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3742012410' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:27:47.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:47 smithi117 ceph-mon[34585]: from='client.25087 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:27:47.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:47 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:27:47.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:47 smithi097 ceph-mon[41966]: pgmap v297: 178 pgs: 6 creating+peering, 172 active+clean; 582 KiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:47.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:47 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3742012410' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:27:47.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:47 smithi097 ceph-mon[41966]: from='client.25087 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:27:48.140 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:27:48.143 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:48.143 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:27:48.244 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:27:48.270 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:48.312 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:27:48.315 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:48.317 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:27:48.419 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:27:48.443 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:48.452 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2021-10-08T19:27:48.537 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:27:48.540 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:48.541 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:27:48.642 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:27:48.671 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:48.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:48 smithi097 ceph-mon[32687]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:27:48.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:48 smithi097 ceph-mon[32687]: from='client.25087 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:27:48.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:48 smithi097 ceph-mon[32687]: osdmap e186: 8 total, 8 up, 8 in 2021-10-08T19:27:48.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:48 smithi097 ceph-mon[41966]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:27:48.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:48 smithi097 ceph-mon[41966]: from='client.25087 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:27:48.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:48 smithi097 ceph-mon[41966]: osdmap e186: 8 total, 8 up, 8 in 2021-10-08T19:27:48.895 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:27:48.899 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:48.899 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:27:48.941 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:48 smithi117 ceph-mon[34585]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:27:48.941 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:48 smithi117 ceph-mon[34585]: from='client.25087 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:27:48.941 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:48 smithi117 ceph-mon[34585]: osdmap e186: 8 total, 8 up, 8 in 2021-10-08T19:27:49.000 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:27:49.025 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:49.120 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:27:49.123 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:49.124 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:27:49.155 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:27:49.155 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2021-10-08T19:27:49.155 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2021-10-08T19:27:49.156 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2021-10-08T19:27:49.156 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:27:49.225 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:27:49.227 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:27:49.249 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:49.290 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:27:49.294 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2021-10-08T19:27:49.393 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:27:49.396 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:49.396 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:27:49.498 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:27:49.522 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:49.564 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:27:49.566 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:49.567 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:27:49.668 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:27:49.672 INFO:teuthology.orchestra.run.smithi097.stderr:enabled application 'rados' on pool 'unique_pool_1' 2021-10-08T19:27:49.691 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:49.901 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:49 smithi117 ceph-mon[34585]: pgmap v299: 178 pgs: 178 active+clean; 582 KiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2021-10-08T19:27:49.901 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:49 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/832028493' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_1", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:49.902 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2021-10-08T19:27:49.919 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:27:49.922 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:49.922 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:27:49.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:49 smithi097 ceph-mon[41966]: pgmap v299: 178 pgs: 178 active+clean; 582 KiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2021-10-08T19:27:49.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:49 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/832028493' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_1", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:49.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:49 smithi097 ceph-mon[32687]: pgmap v299: 178 pgs: 178 active+clean; 582 KiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2021-10-08T19:27:49.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:49 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/832028493' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_1", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:50.023 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:27:50.049 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:50.092 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:27:50.094 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:50.095 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:27:50.191 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:27:50.197 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:27:50.220 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:50.303 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:27:50.305 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:50.305 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:27:50.406 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:27:50.431 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:50.478 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:27:50.480 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:50.481 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:27:50.582 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:27:50.605 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:50.635 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":299,"stamp":"2021-10-08T19:27:48.574514+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596456,"num_objects":195,"num_object_clones":0,"num_object_copies":585,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":195,"num_whiteouts":0,"num_read":1253,"num_read_kb":1100,"num_write":606,"num_write_kb":2457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":2793769,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1944,"ondisk_log_size":1944,"up":534,"acting":534,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":519,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":1447372,"kb_used_data":732492,"kb_used_omap":0,"kb_used_meta":714816,"kb_avail":748513844,"statfs":{"total":767960285184,"available":766478176256,"internally_reserved":0,"allocated":750071808,"data_stored":745724738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":731971584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.931483"},"pg_stats":[{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:46.088161+0000","last_change":"2021-10-08T19:27:43.651844+0000","last_active":"2021-10-08T19:27:46.088161+0000","last_peered":"2021-10-08T19:27:46.088161+0000","last_clean":"2021-10-08T19:27:46.088161+0000","last_became_active":"2021-10-08T19:27:43.651599+0000","last_became_peered":"2021-10-08T19:27:43.651599+0000","last_unstale":"2021-10-08T19:27:46.088161+0000","last_undegraded":"2021-10-08T19:27:46.088161+0000","last_fullsized":"2021-10-08T19:27:46.088161+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_clean_scrub_stamp":"2021-10-08T19:27:42.631354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,2],"acting":[5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"114'10","reported_seq":254,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:46.794871+0000","last_change":"2021-10-08T19:27:36.614081+0000","last_active":"2021-10-08T19:27:46.794871+0000","last_peered":"2021-10-08T19:27:46.794871+0000","last_clean":"2021-10-08T19:27:46.794871+0000","last_became_active":"2021-10-08T19:24:25.096162+0000","last_became_peered":"2021-10-08T19:24:25.096162+0000","last_unstale":"2021-10-08T19:27:46.794871+0000","last_undegraded":"2021-10-08T19:27:46.794871+0000","last_fullsized":"2021-10-08T19:27:46.794871+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'10","last_scrub_stamp":"2021-10-08T19:27:36.614016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:27:36.614016+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040334050000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"87'22","reported_seq":225,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:46.087802+0000","last_change":"2021-10-08T19:24:25.118654+0000","last_active":"2021-10-08T19:27:46.087802+0000","last_peered":"2021-10-08T19:27:46.087802+0000","last_clean":"2021-10-08T19:27:46.087802+0000","last_became_active":"2021-10-08T19:24:25.088861+0000","last_became_peered":"2021-10-08T19:24:25.088861+0000","last_unstale":"2021-10-08T19:27:46.087802+0000","last_undegraded":"2021-10-08T19:27:46.087802+0000","last_fullsized":"2021-10-08T19:27:46.087802+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'22","last_scrub_stamp":"2021-10-08T19:24:20.355553+0000","last_deep_scrub":"87'22","last_deep_scrub_stamp":"2021-10-08T19:22:58.705632+0000","last_clean_scrub_stamp":"2021-10-08T19:24:20.355553+0000","log_size":22,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0022961499999999998,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":143,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.640866+0000","last_change":"2021-10-08T19:24:07.800878+0000","last_active":"2021-10-08T19:27:42.640866+0000","last_peered":"2021-10-08T19:27:42.640866+0000","last_clean":"2021-10-08T19:27:42.640866+0000","last_became_active":"2021-10-08T19:21:23.600352+0000","last_became_peered":"2021-10-08T19:21:23.600352+0000","last_unstale":"2021-10-08T19:27:42.640866+0000","last_undegraded":"2021-10-08T19:27:42.640866+0000","last_fullsized":"2021-10-08T19:27:42.640866+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:07.800787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:07.800787+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012798608,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":151,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:46.087994+0000","last_change":"2021-10-08T19:24:25.089736+0000","last_active":"2021-10-08T19:27:46.087994+0000","last_peered":"2021-10-08T19:27:46.087994+0000","last_clean":"2021-10-08T19:27:46.087994+0000","last_became_active":"2021-10-08T19:24:25.089002+0000","last_became_peered":"2021-10-08T19:24:25.089002+0000","last_unstale":"2021-10-08T19:27:46.087994+0000","last_undegraded":"2021-10-08T19:27:46.087994+0000","last_fullsized":"2021-10-08T19:27:46.087994+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:10.805052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:10.805052+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.00168849,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":68,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:45.655676+0000","last_change":"2021-10-08T19:25:15.510798+0000","last_active":"2021-10-08T19:27:45.655676+0000","last_peered":"2021-10-08T19:27:45.655676+0000","last_clean":"2021-10-08T19:27:45.655676+0000","last_became_active":"2021-10-08T19:25:15.510457+0000","last_became_peered":"2021-10-08T19:25:15.510457+0000","last_unstale":"2021-10-08T19:27:45.655676+0000","last_undegraded":"2021-10-08T19:27:45.655676+0000","last_fullsized":"2021-10-08T19:27:45.655676+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:09.177525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:09.177525+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2021-10-08T19:27:43.660164+0000","last_change":"2021-10-08T19:27:43.660164+0000","last_active":"2021-10-08T19:27:43.660164+0000","last_peered":"2021-10-08T19:27:43.660164+0000","last_clean":"2021-10-08T19:27:43.660164+0000","last_became_active":"2021-10-08T19:27:43.659840+0000","last_became_peered":"2021-10-08T19:27:43.659840+0000","last_unstale":"2021-10-08T19:27:43.660164+0000","last_undegraded":"2021-10-08T19:27:43.660164+0000","last_fullsized":"2021-10-08T19:27:43.660164+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_clean_scrub_stamp":"2021-10-08T19:27:42.631354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,6],"acting":[1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"69'9","reported_seq":151,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.647044+0000","last_change":"2021-10-08T19:22:36.590210+0000","last_active":"2021-10-08T19:27:42.647044+0000","last_peered":"2021-10-08T19:27:42.647044+0000","last_clean":"2021-10-08T19:27:42.647044+0000","last_became_active":"2021-10-08T19:21:25.610072+0000","last_became_peered":"2021-10-08T19:21:25.610072+0000","last_unstale":"2021-10-08T19:27:42.647044+0000","last_undegraded":"2021-10-08T19:27:42.647044+0000","last_fullsized":"2021-10-08T19:27:42.647044+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'9","last_scrub_stamp":"2021-10-08T19:22:36.590071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:36.590071+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0026030699999999999,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":139,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.646418+0000","last_change":"2021-10-08T19:23:11.176225+0000","last_active":"2021-10-08T19:27:42.646418+0000","last_peered":"2021-10-08T19:27:42.646418+0000","last_clean":"2021-10-08T19:27:42.646418+0000","last_became_active":"2021-10-08T19:21:23.607639+0000","last_became_peered":"2021-10-08T19:21:23.607639+0000","last_unstale":"2021-10-08T19:27:42.646418+0000","last_undegraded":"2021-10-08T19:27:42.646418+0000","last_fullsized":"2021-10-08T19:27:42.646418+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:11.176122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:11.176122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040114119999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":139,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.641462+0000","last_change":"2021-10-08T19:27:38.324454+0000","last_active":"2021-10-08T19:27:42.641462+0000","last_peered":"2021-10-08T19:27:42.641462+0000","last_clean":"2021-10-08T19:27:42.641462+0000","last_became_active":"2021-10-08T19:21:27.635310+0000","last_became_peered":"2021-10-08T19:21:27.635310+0000","last_unstale":"2021-10-08T19:27:42.641462+0000","last_undegraded":"2021-10-08T19:27:42.641462+0000","last_fullsized":"2021-10-08T19:27:42.641462+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:38.324368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:27:38.324368+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0015013699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":131,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.645947+0000","last_change":"2021-10-08T19:22:57.644734+0000","last_active":"2021-10-08T19:27:42.645947+0000","last_peered":"2021-10-08T19:27:42.645947+0000","last_clean":"2021-10-08T19:27:42.645947+0000","last_became_active":"2021-10-08T19:21:29.643022+0000","last_became_peered":"2021-10-08T19:21:29.643022+0000","last_unstale":"2021-10-08T19:27:42.645947+0000","last_undegraded":"2021-10-08T19:27:42.645947+0000","last_fullsized":"2021-10-08T19:27:42.645947+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:57.644627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:57.644627+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002174952,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"70'5","reported_seq":328,"reported_epoch":186,"state":"active+clean","last_fresh":"2021-10-08T19:27:48.048901+0000","last_change":"2021-10-08T19:24:25.638250+0000","last_active":"2021-10-08T19:27:48.048901+0000","last_peered":"2021-10-08T19:27:48.048901+0000","last_clean":"2021-10-08T19:27:48.048901+0000","last_became_active":"2021-10-08T19:24:25.103095+0000","last_became_peered":"2021-10-08T19:24:25.103095+0000","last_unstale":"2021-10-08T19:27:48.048901+0000","last_undegraded":"2021-10-08T19:27:48.048901+0000","last_fullsized":"2021-10-08T19:27:48.048901+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:24:16.396790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:16.396790+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0078447029999999997,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":209,"num_read_kb":209,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":389,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2021-10-08T19:27:43.728156+0000","last_change":"2021-10-08T19:27:43.728156+0000","last_active":"2021-10-08T19:27:43.728156+0000","last_peered":"2021-10-08T19:27:43.728156+0000","last_clean":"2021-10-08T19:27:43.728156+0000","last_became_active":"2021-10-08T19:27:43.727841+0000","last_became_peered":"2021-10-08T19:27:43.727841+0000","last_unstale":"2021-10-08T19:27:43.728156+0000","last_undegraded":"2021-10-08T19:27:43.728156+0000","last_fullsized":"2021-10-08T19:27:43.728156+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_clean_scrub_stamp":"2021-10-08T19:27:42.631354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"69'19","reported_seq":103,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:46.626147+0000","last_change":"2021-10-08T19:24:25.121334+0000","last_active":"2021-10-08T19:27:46.626147+0000","last_peered":"2021-10-08T19:27:46.626147+0000","last_clean":"2021-10-08T19:27:46.626147+0000","last_became_active":"2021-10-08T19:24:25.094547+0000","last_became_peered":"2021-10-08T19:24:25.094547+0000","last_unstale":"2021-10-08T19:27:46.626147+0000","last_undegraded":"2021-10-08T19:27:46.626147+0000","last_fullsized":"2021-10-08T19:27:46.626147+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'19","last_scrub_stamp":"2021-10-08T19:22:39.356508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:39.356508+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":31,"num_read_kb":20,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":143,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.641076+0000","last_change":"2021-10-08T19:27:36.314598+0000","last_active":"2021-10-08T19:27:42.641076+0000","last_peered":"2021-10-08T19:27:42.641076+0000","last_clean":"2021-10-08T19:27:42.641076+0000","last_became_active":"2021-10-08T19:21:23.595919+0000","last_became_peered":"2021-10-08T19:21:23.595919+0000","last_unstale":"2021-10-08T19:27:42.641076+0000","last_undegraded":"2021-10-08T19:27:42.641076+0000","last_fullsized":"2021-10-08T19:27:42.641076+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:36.314494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:27:36.314494+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034123560000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":133,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.641071+0000","last_change":"2021-10-08T19:23:09.419579+0000","last_active":"2021-10-08T19:27:42.641071+0000","last_peered":"2021-10-08T19:27:42.641071+0000","last_clean":"2021-10-08T19:27:42.641071+0000","last_became_active":"2021-10-08T19:21:27.638583+0000","last_became_peered":"2021-10-08T19:21:27.638583+0000","last_unstale":"2021-10-08T19:27:42.641071+0000","last_undegraded":"2021-10-08T19:27:42.641071+0000","last_fullsized":"2021-10-08T19:27:42.641071+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:09.419493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:09.419493+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003406498,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":140,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:45.654816+0000","last_change":"2021-10-08T19:27:39.528797+0000","last_active":"2021-10-08T19:27:45.654816+0000","last_peered":"2021-10-08T19:27:45.654816+0000","last_clean":"2021-10-08T19:27:45.654816+0000","last_became_active":"2021-10-08T19:21:29.648922+0000","last_became_peered":"2021-10-08T19:21:29.648922+0000","last_unstale":"2021-10-08T19:27:45.654816+0000","last_undegraded":"2021-10-08T19:27:45.654816+0000","last_fullsized":"2021-10-08T19:27:45.654816+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:39.528699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:39.528699+0000","last_clean_scrub_stamp":"2021-10-08T19:27:39.528699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001737499,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":63,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:45.655471+0000","last_change":"2021-10-08T19:25:15.503388+0000","last_active":"2021-10-08T19:27:45.655471+0000","last_peered":"2021-10-08T19:27:45.655471+0000","last_clean":"2021-10-08T19:27:45.655471+0000","last_became_active":"2021-10-08T19:25:15.503081+0000","last_became_peered":"2021-10-08T19:25:15.503081+0000","last_unstale":"2021-10-08T19:27:45.655471+0000","last_undegraded":"2021-10-08T19:27:45.655471+0000","last_fullsized":"2021-10-08T19:27:45.655471+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:17.379559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:17.379559+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0090469920000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2021-10-08T19:27:43.661122+0000","last_change":"2021-10-08T19:27:43.661122+0000","last_active":"2021-10-08T19:27:43.661122+0000","last_peered":"2021-10-08T19:27:43.661122+0000","last_clean":"2021-10-08T19:27:43.661122+0000","last_became_active":"2021-10-08T19:27:43.660843+0000","last_became_peered":"2021-10-08T19:27:43.660843+0000","last_unstale":"2021-10-08T19:27:43.661122+0000","last_undegraded":"2021-10-08T19:27:43.661122+0000","last_fullsized":"2021-10-08T19:27:43.661122+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_clean_scrub_stamp":"2021-10-08T19:27:42.631354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.8","version":"90'130","reported_seq":317,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:46.087559+0000","last_change":"2021-10-08T19:27:37.611695+0000","last_active":"2021-10-08T19:27:46.087559+0000","last_peered":"2021-10-08T19:27:46.087559+0000","last_clean":"2021-10-08T19:27:46.087559+0000","last_became_active":"2021-10-08T19:27:37.611248+0000","last_became_peered":"2021-10-08T19:27:37.611248+0000","last_unstale":"2021-10-08T19:27:46.087559+0000","last_undegraded":"2021-10-08T19:27:46.087559+0000","last_fullsized":"2021-10-08T19:27:46.087559+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.284249+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020087920000000001,"stat_sum":{"num_bytes":53670,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":28,"num_write":16,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":423697,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"69'17","reported_seq":165,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:45.550477+0000","last_change":"2021-10-08T19:22:47.109498+0000","last_active":"2021-10-08T19:27:45.550477+0000","last_peered":"2021-10-08T19:27:45.550477+0000","last_clean":"2021-10-08T19:27:45.550477+0000","last_became_active":"2021-10-08T19:21:25.609086+0000","last_became_peered":"2021-10-08T19:21:25.609086+0000","last_unstale":"2021-10-08T19:27:45.550477+0000","last_undegraded":"2021-10-08T19:27:45.550477+0000","last_fullsized":"2021-10-08T19:27:45.550477+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'17","last_scrub_stamp":"2021-10-08T19:22:47.109407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:47.109407+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0025026100000000002,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"61'1","reported_seq":148,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:45.655362+0000","last_change":"2021-10-08T19:22:55.080106+0000","last_active":"2021-10-08T19:27:45.655362+0000","last_peered":"2021-10-08T19:27:45.655362+0000","last_clean":"2021-10-08T19:27:45.655362+0000","last_became_active":"2021-10-08T19:21:23.607064+0000","last_became_peered":"2021-10-08T19:21:23.607064+0000","last_unstale":"2021-10-08T19:27:45.655362+0000","last_undegraded":"2021-10-08T19:27:45.655362+0000","last_fullsized":"2021-10-08T19:27:45.655362+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'1","last_scrub_stamp":"2021-10-08T19:22:55.080028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:55.080028+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040037620000000001,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":139,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.646617+0000","last_change":"2021-10-08T19:23:36.055728+0000","last_active":"2021-10-08T19:27:42.646617+0000","last_peered":"2021-10-08T19:27:42.646617+0000","last_clean":"2021-10-08T19:27:42.646617+0000","last_became_active":"2021-10-08T19:21:27.636429+0000","last_became_peered":"2021-10-08T19:21:27.636429+0000","last_unstale":"2021-10-08T19:27:42.646617+0000","last_undegraded":"2021-10-08T19:27:42.646617+0000","last_fullsized":"2021-10-08T19:27:42.646617+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:36.055616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:36.055616+0000","last_clean_scrub_stamp":"2021-10-08T19:23:36.055616+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0022840669999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":131,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.640736+0000","last_change":"2021-10-08T19:23:10.377105+0000","last_active":"2021-10-08T19:27:42.640736+0000","last_peered":"2021-10-08T19:27:42.640736+0000","last_clean":"2021-10-08T19:27:42.640736+0000","last_became_active":"2021-10-08T19:21:29.646455+0000","last_became_peered":"2021-10-08T19:21:29.646455+0000","last_unstale":"2021-10-08T19:27:42.640736+0000","last_undegraded":"2021-10-08T19:27:42.640736+0000","last_fullsized":"2021-10-08T19:27:42.640736+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:10.377024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:10.377024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0035706969999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":83,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:46.626311+0000","last_change":"2021-10-08T19:24:25.106422+0000","last_active":"2021-10-08T19:27:46.626311+0000","last_peered":"2021-10-08T19:27:46.626311+0000","last_clean":"2021-10-08T19:27:46.626311+0000","last_became_active":"2021-10-08T19:24:25.105702+0000","last_became_peered":"2021-10-08T19:24:25.105702+0000","last_unstale":"2021-10-08T19:27:46.626311+0000","last_undegraded":"2021-10-08T19:27:46.626311+0000","last_fullsized":"2021-10-08T19:27:46.626311+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:40.563247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.563247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.024890005999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2021-10-08T19:27:43.655752+0000","last_change":"2021-10-08T19:27:43.655752+0000","last_active":"2021-10-08T19:27:43.655752+0000","last_peered":"2021-10-08T19:27:43.655752+0000","last_clean":"2021-10-08T19:27:43.655752+0000","last_became_active":"2021-10-08T19:27:43.655453+0000","last_became_peered":"2021-10-08T19:27:43.655453+0000","last_unstale":"2021-10-08T19:27:43.655752+0000","last_undegraded":"2021-10-08T19:27:43.655752+0000","last_fullsized":"2021-10-08T19:27:43.655752+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_clean_scrub_stamp":"2021-10-08T19:27:42.631354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.9","version":"90'130","reported_seq":460,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:45.654823+0000","last_change":"2021-10-08T19:27:26.586458+0000","last_active":"2021-10-08T19:27:45.654823+0000","last_peered":"2021-10-08T19:27:45.654823+0000","last_clean":"2021-10-08T19:27:45.654823+0000","last_became_active":"2021-10-08T19:27:26.586201+0000","last_became_peered":"2021-10-08T19:27:26.586201+0000","last_unstale":"2021-10-08T19:27:45.654823+0000","last_undegraded":"2021-10-08T19:27:45.654823+0000","last_fullsized":"2021-10-08T19:27:45.654823+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.284249+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0045617870000000003,"stat_sum":{"num_bytes":53670,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":28,"num_write":16,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":268349,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"69'10","reported_seq":194,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:45.550272+0000","last_change":"2021-10-08T19:24:25.983761+0000","last_active":"2021-10-08T19:27:45.550272+0000","last_peered":"2021-10-08T19:27:45.550272+0000","last_clean":"2021-10-08T19:27:45.550272+0000","last_became_active":"2021-10-08T19:24:25.098048+0000","last_became_peered":"2021-10-08T19:24:25.098048+0000","last_unstale":"2021-10-08T19:27:45.550272+0000","last_undegraded":"2021-10-08T19:27:45.550272+0000","last_fullsized":"2021-10-08T19:27:45.550272+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'10","last_scrub_stamp":"2021-10-08T19:22:35.356292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:35.356292+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040689319999999999,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":143,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.647029+0000","last_change":"2021-10-08T19:24:15.233590+0000","last_active":"2021-10-08T19:27:42.647029+0000","last_peered":"2021-10-08T19:27:42.647029+0000","last_clean":"2021-10-08T19:27:42.647029+0000","last_became_active":"2021-10-08T19:21:23.603207+0000","last_became_peered":"2021-10-08T19:21:23.603207+0000","last_unstale":"2021-10-08T19:27:42.647029+0000","last_undegraded":"2021-10-08T19:27:42.647029+0000","last_fullsized":"2021-10-08T19:27:42.647029+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:15.233394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:15.233394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0046454499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"69'8","reported_seq":223,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.641301+0000","last_change":"2021-10-08T19:24:09.793029+0000","last_active":"2021-10-08T19:27:42.641301+0000","last_peered":"2021-10-08T19:27:42.641301+0000","last_clean":"2021-10-08T19:27:42.641301+0000","last_became_active":"2021-10-08T19:21:27.637930+0000","last_became_peered":"2021-10-08T19:21:27.637930+0000","last_unstale":"2021-10-08T19:27:42.641301+0000","last_undegraded":"2021-10-08T19:27:42.641301+0000","last_fullsized":"2021-10-08T19:27:42.641301+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'8","last_scrub_stamp":"2021-10-08T19:24:09.792928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:09.792928+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0052042049999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":139,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:45.551565+0000","last_change":"2021-10-08T19:24:19.303768+0000","last_active":"2021-10-08T19:27:45.551565+0000","last_peered":"2021-10-08T19:27:45.551565+0000","last_clean":"2021-10-08T19:27:45.551565+0000","last_became_active":"2021-10-08T19:21:29.640249+0000","last_became_peered":"2021-10-08T19:21:29.640249+0000","last_unstale":"2021-10-08T19:27:45.551565+0000","last_undegraded":"2021-10-08T19:27:45.551565+0000","last_fullsized":"2021-10-08T19:27:45.551565+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:19.303695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:24:19.303695+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0069500159999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":87,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.643501+0000","last_change":"2021-10-08T19:24:13.518853+0000","last_active":"2021-10-08T19:27:42.643501+0000","last_peered":"2021-10-08T19:27:42.643501+0000","last_clean":"2021-10-08T19:27:42.643501+0000","last_became_active":"2021-10-08T19:24:13.518601+0000","last_became_peered":"2021-10-08T19:24:13.518601+0000","last_unstale":"2021-10-08T19:27:42.643501+0000","last_undegraded":"2021-10-08T19:27:42.643501+0000","last_fullsized":"2021-10-08T19:27:42.643501+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:09.177525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:09.177525+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2021-10-08T19:27:43.656463+0000","last_change":"2021-10-08T19:27:43.656463+0000","last_active":"2021-10-08T19:27:43.656463+0000","last_peered":"2021-10-08T19:27:43.656463+0000","last_clean":"2021-10-08T19:27:43.656463+0000","last_became_active":"2021-10-08T19:27:43.655769+0000","last_became_peered":"2021-10-08T19:27:43.655769+0000","last_unstale":"2021-10-08T19:27:43.656463+0000","last_undegraded":"2021-10-08T19:27:43.656463+0000","last_fullsized":"2021-10-08T19:27:43.656463+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_clean_scrub_stamp":"2021-10-08T19:27:42.631354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.a","version":"90'130","reported_seq":322,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:46.087919+0000","last_change":"2021-10-08T19:27:26.591508+0000","last_active":"2021-10-08T19:27:46.087919+0000","last_peered":"2021-10-08T19:27:46.087919+0000","last_clean":"2021-10-08T19:27:46.087919+0000","last_became_active":"2021-10-08T19:27:26.591129+0000","last_became_peered":"2021-10-08T19:27:26.591129+0000","last_unstale":"2021-10-08T19:27:46.087919+0000","last_undegraded":"2021-10-08T19:27:46.087919+0000","last_fullsized":"2021-10-08T19:27:46.087919+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.284249+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020087920000000001,"stat_sum":{"num_bytes":53669,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":27,"num_write":16,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":161009,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.f","version":"69'15","reported_seq":166,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.647597+0000","last_change":"2021-10-08T19:27:36.564397+0000","last_active":"2021-10-08T19:27:42.647597+0000","last_peered":"2021-10-08T19:27:42.647597+0000","last_clean":"2021-10-08T19:27:42.647597+0000","last_became_active":"2021-10-08T19:21:25.617776+0000","last_became_peered":"2021-10-08T19:21:25.617776+0000","last_unstale":"2021-10-08T19:27:42.647597+0000","last_undegraded":"2021-10-08T19:27:42.647597+0000","last_fullsized":"2021-10-08T19:27:42.647597+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'15","last_scrub_stamp":"2021-10-08T19:27:36.564311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:27:36.564311+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040472809999999998,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":143,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.645688+0000","last_change":"2021-10-08T19:24:07.213134+0000","last_active":"2021-10-08T19:27:42.645688+0000","last_peered":"2021-10-08T19:27:42.645688+0000","last_clean":"2021-10-08T19:27:42.645688+0000","last_became_active":"2021-10-08T19:21:23.603264+0000","last_became_peered":"2021-10-08T19:21:23.603264+0000","last_unstale":"2021-10-08T19:27:42.645688+0000","last_undegraded":"2021-10-08T19:27:42.645688+0000","last_fullsized":"2021-10-08T19:27:42.645688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:07.213008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:07.213008+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0079250429999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"88'9","reported_seq":224,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:46.794905+0000","last_change":"2021-10-08T19:23:00.048324+0000","last_active":"2021-10-08T19:27:46.794905+0000","last_peered":"2021-10-08T19:27:46.794905+0000","last_clean":"2021-10-08T19:27:46.794905+0000","last_became_active":"2021-10-08T19:21:27.636432+0000","last_became_peered":"2021-10-08T19:21:27.636432+0000","last_unstale":"2021-10-08T19:27:46.794905+0000","last_undegraded":"2021-10-08T19:27:46.794905+0000","last_fullsized":"2021-10-08T19:27:46.794905+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'9","last_scrub_stamp":"2021-10-08T19:23:00.048245+0000","last_deep_scrub":"88'9","last_deep_scrub_stamp":"2021-10-08T19:23:00.048245+0000","last_clean_scrub_stamp":"2021-10-08T19:23:00.048245+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0031661179999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":139,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:46.088652+0000","last_change":"2021-10-08T19:24:11.330063+0000","last_active":"2021-10-08T19:27:46.088652+0000","last_peered":"2021-10-08T19:27:46.088652+0000","last_clean":"2021-10-08T19:27:46.088652+0000","last_became_active":"2021-10-08T19:21:29.639358+0000","last_became_peered":"2021-10-08T19:21:29.639358+0000","last_unstale":"2021-10-08T19:27:46.088652+0000","last_undegraded":"2021-10-08T19:27:46.088652+0000","last_fullsized":"2021-10-08T19:27:46.088652+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:11.329954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:24:11.329954+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.01088446,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.8","version":"70'5","reported_seq":86,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.641530+0000","last_change":"2021-10-08T19:24:13.513690+0000","last_active":"2021-10-08T19:27:42.641530+0000","last_peered":"2021-10-08T19:27:42.641530+0000","last_clean":"2021-10-08T19:27:42.641530+0000","last_became_active":"2021-10-08T19:24:13.513289+0000","last_became_peered":"2021-10-08T19:24:13.513289+0000","last_unstale":"2021-10-08T19:27:42.641530+0000","last_undegraded":"2021-10-08T19:27:42.641530+0000","last_fullsized":"2021-10-08T19:27:42.641530+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:22:48.239721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:48.239721+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001618092,"stat_sum":{"num_bytes":97,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":31,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:45.549868+0000","last_change":"2021-10-08T19:27:43.651956+0000","last_active":"2021-10-08T19:27:45.549868+0000","last_peered":"2021-10-08T19:27:45.549868+0000","last_clean":"2021-10-08T19:27:45.549868+0000","last_became_active":"2021-10-08T19:27:43.651635+0000","last_became_peered":"2021-10-08T19:27:43.651635+0000","last_unstale":"2021-10-08T19:27:45.549868+0000","last_undegraded":"2021-10-08T19:27:45.549868+0000","last_fullsized":"2021-10-08T19:27:45.549868+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_clean_scrub_stamp":"2021-10-08T19:27:42.631354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5],"acting":[4,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"69'11","reported_seq":198,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:45.550316+0000","last_change":"2021-10-08T19:24:25.123530+0000","last_active":"2021-10-08T19:27:45.550316+0000","last_peered":"2021-10-08T19:27:45.550316+0000","last_clean":"2021-10-08T19:27:45.550316+0000","last_became_active":"2021-10-08T19:24:25.097983+0000","last_became_peered":"2021-10-08T19:24:25.097983+0000","last_unstale":"2021-10-08T19:27:45.550316+0000","last_undegraded":"2021-10-08T19:27:45.550316+0000","last_fullsized":"2021-10-08T19:27:45.550316+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'11","last_scrub_stamp":"2021-10-08T19:23:01.988336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:01.988336+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0026768489999999998,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":146,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:45.654909+0000","last_change":"2021-10-08T19:24:14.537933+0000","last_active":"2021-10-08T19:27:45.654909+0000","last_peered":"2021-10-08T19:27:45.654909+0000","last_clean":"2021-10-08T19:27:45.654909+0000","last_became_active":"2021-10-08T19:21:23.606597+0000","last_became_peered":"2021-10-08T19:21:23.606597+0000","last_unstale":"2021-10-08T19:27:45.654909+0000","last_undegraded":"2021-10-08T19:27:45.654909+0000","last_fullsized":"2021-10-08T19:27:45.654909+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:14.537859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:14.537859+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.00235264,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":153,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:46.088622+0000","last_change":"2021-10-08T19:24:25.105582+0000","last_active":"2021-10-08T19:27:46.088622+0000","last_peered":"2021-10-08T19:27:46.088622+0000","last_clean":"2021-10-08T19:27:46.088622+0000","last_became_active":"2021-10-08T19:24:25.105244+0000","last_became_peered":"2021-10-08T19:24:25.105244+0000","last_unstale":"2021-10-08T19:27:46.088622+0000","last_undegraded":"2021-10-08T19:27:46.088622+0000","last_fullsized":"2021-10-08T19:27:46.088622+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:17.689312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:17.689312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0033939769999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":148,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.643588+0000","last_change":"2021-10-08T19:24:25.096748+0000","last_active":"2021-10-08T19:27:42.643588+0000","last_peered":"2021-10-08T19:27:42.643588+0000","last_clean":"2021-10-08T19:27:42.643588+0000","last_became_active":"2021-10-08T19:24:25.096415+0000","last_became_peered":"2021-10-08T19:24:25.096415+0000","last_unstale":"2021-10-08T19:27:42.643588+0000","last_undegraded":"2021-10-08T19:27:42.643588+0000","last_fullsized":"2021-10-08T19:27:42.643588+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:17.422176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:17.422176+0000","last_clean_scrub_stamp":"2021-10-08T19:23:17.422176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0036221249999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":90,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:45.549703+0000","last_change":"2021-10-08T19:24:13.506996+0000","last_active":"2021-10-08T19:27:45.549703+0000","last_peered":"2021-10-08T19:27:45.549703+0000","last_clean":"2021-10-08T19:27:45.549703+0000","last_became_active":"2021-10-08T19:24:13.506602+0000","last_became_peered":"2021-10-08T19:24:13.506602+0000","last_unstale":"2021-10-08T19:27:45.549703+0000","last_undegraded":"2021-10-08T19:27:45.549703+0000","last_fullsized":"2021-10-08T19:27:45.549703+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:09.177525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:09.177525+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:46.088242+0000","last_change":"2021-10-08T19:27:43.726852+0000","last_active":"2021-10-08T19:27:46.088242+0000","last_peered":"2021-10-08T19:27:46.088242+0000","last_clean":"2021-10-08T19:27:46.088242+0000","last_became_active":"2021-10-08T19:27:43.726506+0000","last_became_peered":"2021-10-08T19:27:43.726506+0000","last_unstale":"2021-10-08T19:27:46.088242+0000","last_undegraded":"2021-10-08T19:27:46.088242+0000","last_fullsized":"2021-10-08T19:27:46.088242+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_clean_scrub_stamp":"2021-10-08T19:27:42.631354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.4","version":"90'130","reported_seq":315,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.643673+0000","last_change":"2021-10-08T19:27:37.613110+0000","last_active":"2021-10-08T19:27:42.643673+0000","last_peered":"2021-10-08T19:27:42.643673+0000","last_clean":"2021-10-08T19:27:42.643673+0000","last_became_active":"2021-10-08T19:27:37.612736+0000","last_became_peered":"2021-10-08T19:27:37.612736+0000","last_unstale":"2021-10-08T19:27:42.643673+0000","last_undegraded":"2021-10-08T19:27:42.643673+0000","last_fullsized":"2021-10-08T19:27:42.643673+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.284249+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020087920000000001,"stat_sum":{"num_bytes":53670,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":28,"num_write":16,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":488690,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"91'9","reported_seq":217,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.641381+0000","last_change":"2021-10-08T19:23:32.329551+0000","last_active":"2021-10-08T19:27:42.641381+0000","last_peered":"2021-10-08T19:27:42.641381+0000","last_clean":"2021-10-08T19:27:42.641381+0000","last_became_active":"2021-10-08T19:21:27.640694+0000","last_became_peered":"2021-10-08T19:21:27.640694+0000","last_unstale":"2021-10-08T19:27:42.641381+0000","last_undegraded":"2021-10-08T19:27:42.641381+0000","last_fullsized":"2021-10-08T19:27:42.641381+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'9","last_scrub_stamp":"2021-10-08T19:23:32.329475+0000","last_deep_scrub":"91'9","last_deep_scrub_stamp":"2021-10-08T19:23:32.329475+0000","last_clean_scrub_stamp":"2021-10-08T19:23:32.329475+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0045727859999999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"69'14","reported_seq":214,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:45.549869+0000","last_change":"2021-10-08T19:24:26.225004+0000","last_active":"2021-10-08T19:27:45.549869+0000","last_peered":"2021-10-08T19:27:45.549869+0000","last_clean":"2021-10-08T19:27:45.549869+0000","last_became_active":"2021-10-08T19:24:25.098743+0000","last_became_peered":"2021-10-08T19:24:25.098743+0000","last_unstale":"2021-10-08T19:27:45.549869+0000","last_undegraded":"2021-10-08T19:27:45.549869+0000","last_fullsized":"2021-10-08T19:27:45.549869+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'14","last_scrub_stamp":"2021-10-08T19:24:10.235796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:24:10.235796+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0042036319999999997,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":83,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:46.626647+0000","last_change":"2021-10-08T19:24:25.094838+0000","last_active":"2021-10-08T19:27:46.626647+0000","last_peered":"2021-10-08T19:27:46.626647+0000","last_clean":"2021-10-08T19:27:46.626647+0000","last_became_active":"2021-10-08T19:24:25.094364+0000","last_became_peered":"2021-10-08T19:24:25.094364+0000","last_unstale":"2021-10-08T19:27:46.626647+0000","last_undegraded":"2021-10-08T19:27:46.626647+0000","last_fullsized":"2021-10-08T19:27:46.626647+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:23.529696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:23.529696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":154,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:45.655524+0000","last_change":"2021-10-08T19:24:25.095155+0000","last_active":"2021-10-08T19:27:45.655524+0000","last_peered":"2021-10-08T19:27:45.655524+0000","last_clean":"2021-10-08T19:27:45.655524+0000","last_became_active":"2021-10-08T19:24:25.094848+0000","last_became_peered":"2021-10-08T19:24:25.094848+0000","last_unstale":"2021-10-08T19:27:45.655524+0000","last_undegraded":"2021-10-08T19:27:45.655524+0000","last_fullsized":"2021-10-08T19:27:45.655524+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:05.263508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:05.263508+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034369000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":94,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.647073+0000","last_change":"2021-10-08T19:25:14.582925+0000","last_active":"2021-10-08T19:27:42.647073+0000","last_peered":"2021-10-08T19:27:42.647073+0000","last_clean":"2021-10-08T19:27:42.647073+0000","last_became_active":"2021-10-08T19:25:14.582587+0000","last_became_peered":"2021-10-08T19:25:14.582587+0000","last_unstale":"2021-10-08T19:27:42.647073+0000","last_undegraded":"2021-10-08T19:27:42.647073+0000","last_fullsized":"2021-10-08T19:27:42.647073+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:40.563247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.563247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.024890005999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2021-10-08T19:27:43.728516+0000","last_change":"2021-10-08T19:27:43.728516+0000","last_active":"2021-10-08T19:27:43.728516+0000","last_peered":"2021-10-08T19:27:43.728516+0000","last_clean":"2021-10-08T19:27:43.728516+0000","last_became_active":"2021-10-08T19:27:43.727954+0000","last_became_peered":"2021-10-08T19:27:43.727954+0000","last_unstale":"2021-10-08T19:27:43.728516+0000","last_undegraded":"2021-10-08T19:27:43.728516+0000","last_fullsized":"2021-10-08T19:27:43.728516+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_clean_scrub_stamp":"2021-10-08T19:27:42.631354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"90'130","reported_seq":322,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:45.550158+0000","last_change":"2021-10-08T19:27:26.591042+0000","last_active":"2021-10-08T19:27:45.550158+0000","last_peered":"2021-10-08T19:27:45.550158+0000","last_clean":"2021-10-08T19:27:45.550158+0000","last_became_active":"2021-10-08T19:27:26.590651+0000","last_became_peered":"2021-10-08T19:27:26.590651+0000","last_unstale":"2021-10-08T19:27:45.550158+0000","last_undegraded":"2021-10-08T19:27:45.550158+0000","last_fullsized":"2021-10-08T19:27:45.550158+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.284249+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020087920000000001,"stat_sum":{"num_bytes":53670,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":28,"num_write":16,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":161010,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":141,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:45.550016+0000","last_change":"2021-10-08T19:24:15.302574+0000","last_active":"2021-10-08T19:27:45.550016+0000","last_peered":"2021-10-08T19:27:45.550016+0000","last_clean":"2021-10-08T19:27:45.550016+0000","last_became_active":"2021-10-08T19:21:27.637547+0000","last_became_peered":"2021-10-08T19:21:27.637547+0000","last_unstale":"2021-10-08T19:27:45.550016+0000","last_undegraded":"2021-10-08T19:27:45.550016+0000","last_fullsized":"2021-10-08T19:27:45.550016+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:15.302475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:15.302475+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0050588849999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"69'18","reported_seq":166,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.641289+0000","last_change":"2021-10-08T19:23:20.405609+0000","last_active":"2021-10-08T19:27:42.641289+0000","last_peered":"2021-10-08T19:27:42.641289+0000","last_clean":"2021-10-08T19:27:42.641289+0000","last_became_active":"2021-10-08T19:21:25.742909+0000","last_became_peered":"2021-10-08T19:21:25.742909+0000","last_unstale":"2021-10-08T19:27:42.641289+0000","last_undegraded":"2021-10-08T19:27:42.641289+0000","last_fullsized":"2021-10-08T19:27:42.641289+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'18","last_scrub_stamp":"2021-10-08T19:23:20.405525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:20.405525+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039753820000000004,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":155,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.645949+0000","last_change":"2021-10-08T19:24:25.099209+0000","last_active":"2021-10-08T19:27:42.645949+0000","last_peered":"2021-10-08T19:27:42.645949+0000","last_clean":"2021-10-08T19:27:42.645949+0000","last_became_active":"2021-10-08T19:24:25.098790+0000","last_became_peered":"2021-10-08T19:24:25.098790+0000","last_unstale":"2021-10-08T19:27:42.645949+0000","last_undegraded":"2021-10-08T19:27:42.645949+0000","last_fullsized":"2021-10-08T19:27:42.645949+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:41.186945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:41.186945+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0037557269999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":133,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:45.550266+0000","last_change":"2021-10-08T19:22:40.264230+0000","last_active":"2021-10-08T19:27:45.550266+0000","last_peered":"2021-10-08T19:27:45.550266+0000","last_clean":"2021-10-08T19:27:45.550266+0000","last_became_active":"2021-10-08T19:21:29.646491+0000","last_became_peered":"2021-10-08T19:21:29.646491+0000","last_unstale":"2021-10-08T19:27:45.550266+0000","last_undegraded":"2021-10-08T19:27:45.550266+0000","last_fullsized":"2021-10-08T19:27:45.550266+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:40.264110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.264110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003475845,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":96,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.644385+0000","last_change":"2021-10-08T19:25:14.588222+0000","last_active":"2021-10-08T19:27:42.644385+0000","last_peered":"2021-10-08T19:27:42.644385+0000","last_clean":"2021-10-08T19:27:42.644385+0000","last_became_active":"2021-10-08T19:25:14.587901+0000","last_became_peered":"2021-10-08T19:25:14.587901+0000","last_unstale":"2021-10-08T19:27:42.644385+0000","last_undegraded":"2021-10-08T19:27:42.644385+0000","last_fullsized":"2021-10-08T19:27:42.644385+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:09.177525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:09.177525+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2021-10-08T19:27:43.657865+0000","last_change":"2021-10-08T19:27:43.657865+0000","last_active":"2021-10-08T19:27:43.657865+0000","last_peered":"2021-10-08T19:27:43.657865+0000","last_clean":"2021-10-08T19:27:43.657865+0000","last_became_active":"2021-10-08T19:27:43.657579+0000","last_became_peered":"2021-10-08T19:27:43.657579+0000","last_unstale":"2021-10-08T19:27:43.657865+0000","last_undegraded":"2021-10-08T19:27:43.657865+0000","last_fullsized":"2021-10-08T19:27:43.657865+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_clean_scrub_stamp":"2021-10-08T19:27:42.631354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"90'130","reported_seq":384,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:46.626476+0000","last_change":"2021-10-08T19:27:26.590758+0000","last_active":"2021-10-08T19:27:46.626476+0000","last_peered":"2021-10-08T19:27:46.626476+0000","last_clean":"2021-10-08T19:27:46.626476+0000","last_became_active":"2021-10-08T19:27:26.590363+0000","last_became_peered":"2021-10-08T19:27:26.590363+0000","last_unstale":"2021-10-08T19:27:46.626476+0000","last_undegraded":"2021-10-08T19:27:46.626476+0000","last_fullsized":"2021-10-08T19:27:46.626476+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.284249+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0045617870000000003,"stat_sum":{"num_bytes":53670,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":28,"num_write":16,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":214679,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":83,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:46.626184+0000","last_change":"2021-10-08T19:24:25.095749+0000","last_active":"2021-10-08T19:27:46.626184+0000","last_peered":"2021-10-08T19:27:46.626184+0000","last_clean":"2021-10-08T19:27:46.626184+0000","last_became_active":"2021-10-08T19:24:25.095389+0000","last_became_peered":"2021-10-08T19:24:25.095389+0000","last_unstale":"2021-10-08T19:27:46.626184+0000","last_undegraded":"2021-10-08T19:27:46.626184+0000","last_fullsized":"2021-10-08T19:27:46.626184+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:42.399412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:42.399412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"69'19","reported_seq":177,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.646838+0000","last_change":"2021-10-08T19:24:08.149331+0000","last_active":"2021-10-08T19:27:42.646838+0000","last_peered":"2021-10-08T19:27:42.646838+0000","last_clean":"2021-10-08T19:27:42.646838+0000","last_became_active":"2021-10-08T19:21:25.741812+0000","last_became_peered":"2021-10-08T19:21:25.741812+0000","last_unstale":"2021-10-08T19:27:42.646838+0000","last_undegraded":"2021-10-08T19:27:42.646838+0000","last_fullsized":"2021-10-08T19:27:42.646838+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'19","last_scrub_stamp":"2021-10-08T19:24:08.149225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:24:08.149225+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0082661220000000007,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"61'1","reported_seq":153,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:45.655646+0000","last_change":"2021-10-08T19:24:17.582143+0000","last_active":"2021-10-08T19:27:45.655646+0000","last_peered":"2021-10-08T19:27:45.655646+0000","last_clean":"2021-10-08T19:27:45.655646+0000","last_became_active":"2021-10-08T19:21:23.604258+0000","last_became_peered":"2021-10-08T19:21:23.604258+0000","last_unstale":"2021-10-08T19:27:45.655646+0000","last_undegraded":"2021-10-08T19:27:45.655646+0000","last_fullsized":"2021-10-08T19:27:45.655646+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'1","last_scrub_stamp":"2021-10-08T19:24:17.582063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:17.582063+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0043026640000000003,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":149,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.645852+0000","last_change":"2021-10-08T19:24:25.094704+0000","last_active":"2021-10-08T19:27:42.645852+0000","last_peered":"2021-10-08T19:27:42.645852+0000","last_clean":"2021-10-08T19:27:42.645852+0000","last_became_active":"2021-10-08T19:24:25.092510+0000","last_became_peered":"2021-10-08T19:24:25.092510+0000","last_unstale":"2021-10-08T19:27:42.645852+0000","last_undegraded":"2021-10-08T19:27:42.645852+0000","last_fullsized":"2021-10-08T19:27:42.645852+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:06.155068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:06.155068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001436805,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"70'5","reported_seq":331,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.646314+0000","last_change":"2021-10-08T19:25:14.596508+0000","last_active":"2021-10-08T19:27:42.646314+0000","last_peered":"2021-10-08T19:27:42.646314+0000","last_clean":"2021-10-08T19:27:42.646314+0000","last_became_active":"2021-10-08T19:25:14.596177+0000","last_became_peered":"2021-10-08T19:25:14.596177+0000","last_unstale":"2021-10-08T19:27:42.646314+0000","last_undegraded":"2021-10-08T19:27:42.646314+0000","last_fullsized":"2021-10-08T19:27:42.646314+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:22:48.239721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:48.239721+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001618092,"stat_sum":{"num_bytes":49,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":19,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":49,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2021-10-08T19:27:43.658053+0000","last_change":"2021-10-08T19:27:43.658053+0000","last_active":"2021-10-08T19:27:43.658053+0000","last_peered":"2021-10-08T19:27:43.658053+0000","last_clean":"2021-10-08T19:27:43.658053+0000","last_became_active":"2021-10-08T19:27:43.657764+0000","last_became_peered":"2021-10-08T19:27:43.657764+0000","last_unstale":"2021-10-08T19:27:43.658053+0000","last_undegraded":"2021-10-08T19:27:43.658053+0000","last_fullsized":"2021-10-08T19:27:43.658053+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_clean_scrub_stamp":"2021-10-08T19:27:42.631354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"90'130","reported_seq":319,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.646244+0000","last_change":"2021-10-08T19:27:26.589761+0000","last_active":"2021-10-08T19:27:42.646244+0000","last_peered":"2021-10-08T19:27:42.646244+0000","last_clean":"2021-10-08T19:27:42.646244+0000","last_became_active":"2021-10-08T19:27:26.589352+0000","last_became_peered":"2021-10-08T19:27:26.589352+0000","last_unstale":"2021-10-08T19:27:42.646244+0000","last_undegraded":"2021-10-08T19:27:42.646244+0000","last_fullsized":"2021-10-08T19:27:42.646244+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.284249+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020087920000000001,"stat_sum":{"num_bytes":53670,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":28,"num_write":17,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":161010,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":141,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:46.088723+0000","last_change":"2021-10-08T19:23:41.487724+0000","last_active":"2021-10-08T19:27:46.088723+0000","last_peered":"2021-10-08T19:27:46.088723+0000","last_clean":"2021-10-08T19:27:46.088723+0000","last_became_active":"2021-10-08T19:21:27.635800+0000","last_became_peered":"2021-10-08T19:21:27.635800+0000","last_unstale":"2021-10-08T19:27:46.088723+0000","last_undegraded":"2021-10-08T19:27:46.088723+0000","last_fullsized":"2021-10-08T19:27:46.088723+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:41.487627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:41.487627+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003650445,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"69'12","reported_seq":153,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.647251+0000","last_change":"2021-10-08T19:22:55.639993+0000","last_active":"2021-10-08T19:27:42.647251+0000","last_peered":"2021-10-08T19:27:42.647251+0000","last_clean":"2021-10-08T19:27:42.647251+0000","last_became_active":"2021-10-08T19:21:25.610233+0000","last_became_peered":"2021-10-08T19:21:25.610233+0000","last_unstale":"2021-10-08T19:27:42.647251+0000","last_undegraded":"2021-10-08T19:27:42.647251+0000","last_fullsized":"2021-10-08T19:27:42.647251+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'12","last_scrub_stamp":"2021-10-08T19:22:55.639881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:55.639881+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0032422169999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":104,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.640503+0000","last_change":"2021-10-08T19:24:04.888931+0000","last_active":"2021-10-08T19:27:42.640503+0000","last_peered":"2021-10-08T19:27:42.640503+0000","last_clean":"2021-10-08T19:27:42.640503+0000","last_became_active":"2021-10-08T19:23:44.813130+0000","last_became_peered":"2021-10-08T19:23:44.813130+0000","last_unstale":"2021-10-08T19:27:42.640503+0000","last_undegraded":"2021-10-08T19:27:42.640503+0000","last_fullsized":"2021-10-08T19:27:42.640503+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:04.888825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:32.922694+0000","last_clean_scrub_stamp":"2021-10-08T19:24:04.888825+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0052928530000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":161,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.645556+0000","last_change":"2021-10-08T19:25:14.571042+0000","last_active":"2021-10-08T19:27:42.645556+0000","last_peered":"2021-10-08T19:27:42.645556+0000","last_clean":"2021-10-08T19:27:42.645556+0000","last_became_active":"2021-10-08T19:25:14.570716+0000","last_became_peered":"2021-10-08T19:25:14.570716+0000","last_unstale":"2021-10-08T19:27:42.645556+0000","last_undegraded":"2021-10-08T19:27:42.645556+0000","last_fullsized":"2021-10-08T19:27:42.645556+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:09.177525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:09.177525+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0090469920000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":137,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.646665+0000","last_change":"2021-10-08T19:27:39.543107+0000","last_active":"2021-10-08T19:27:42.646665+0000","last_peered":"2021-10-08T19:27:42.646665+0000","last_clean":"2021-10-08T19:27:42.646665+0000","last_became_active":"2021-10-08T19:21:29.648784+0000","last_became_peered":"2021-10-08T19:21:29.648784+0000","last_unstale":"2021-10-08T19:27:42.646665+0000","last_undegraded":"2021-10-08T19:27:42.646665+0000","last_fullsized":"2021-10-08T19:27:42.646665+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:39.543005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:39.543005+0000","last_clean_scrub_stamp":"2021-10-08T19:27:39.543005+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001590338,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:46.625818+0000","last_change":"2021-10-08T19:27:43.655434+0000","last_active":"2021-10-08T19:27:46.625818+0000","last_peered":"2021-10-08T19:27:46.625818+0000","last_clean":"2021-10-08T19:27:46.625818+0000","last_became_active":"2021-10-08T19:27:43.655172+0000","last_became_peered":"2021-10-08T19:27:43.655172+0000","last_unstale":"2021-10-08T19:27:46.625818+0000","last_undegraded":"2021-10-08T19:27:46.625818+0000","last_fullsized":"2021-10-08T19:27:46.625818+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_clean_scrub_stamp":"2021-10-08T19:27:42.631354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":136,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:45.655324+0000","last_change":"2021-10-08T19:23:02.267580+0000","last_active":"2021-10-08T19:27:45.655324+0000","last_peered":"2021-10-08T19:27:45.655324+0000","last_clean":"2021-10-08T19:27:45.655324+0000","last_became_active":"2021-10-08T19:21:27.636086+0000","last_became_peered":"2021-10-08T19:21:27.636086+0000","last_unstale":"2021-10-08T19:27:45.655324+0000","last_undegraded":"2021-10-08T19:27:45.655324+0000","last_fullsized":"2021-10-08T19:27:45.655324+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:02.267508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:02.267508+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034499700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"69'14","reported_seq":99,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:46.626416+0000","last_change":"2021-10-08T19:24:25.119727+0000","last_active":"2021-10-08T19:27:46.626416+0000","last_peered":"2021-10-08T19:27:46.626416+0000","last_clean":"2021-10-08T19:27:46.626416+0000","last_became_active":"2021-10-08T19:24:25.100384+0000","last_became_peered":"2021-10-08T19:24:25.100384+0000","last_unstale":"2021-10-08T19:27:46.626416+0000","last_undegraded":"2021-10-08T19:27:46.626416+0000","last_fullsized":"2021-10-08T19:27:46.626416+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'14","last_scrub_stamp":"2021-10-08T19:22:54.379349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:54.379349+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":24,"num_read_kb":14,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"90'130","reported_seq":453,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:45.654882+0000","last_change":"2021-10-08T19:27:22.607667+0000","last_active":"2021-10-08T19:27:45.654882+0000","last_peered":"2021-10-08T19:27:45.654882+0000","last_clean":"2021-10-08T19:27:45.654882+0000","last_became_active":"2021-10-08T19:27:22.607289+0000","last_became_peered":"2021-10-08T19:27:22.607289+0000","last_unstale":"2021-10-08T19:27:45.654882+0000","last_undegraded":"2021-10-08T19:27:45.654882+0000","last_fullsized":"2021-10-08T19:27:45.654882+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.284249+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0045617870000000003,"stat_sum":{"num_bytes":53669,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":27,"num_write":16,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":268349,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":139,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:46.088204+0000","last_change":"2021-10-08T19:23:22.620672+0000","last_active":"2021-10-08T19:27:46.088204+0000","last_peered":"2021-10-08T19:27:46.088204+0000","last_clean":"2021-10-08T19:27:46.088204+0000","last_became_active":"2021-10-08T19:21:23.599143+0000","last_became_peered":"2021-10-08T19:21:23.599143+0000","last_unstale":"2021-10-08T19:27:46.088204+0000","last_undegraded":"2021-10-08T19:27:46.088204+0000","last_fullsized":"2021-10-08T19:27:46.088204+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:22.620600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:22.620600+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003478133,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":172,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.642194+0000","last_change":"2021-10-08T19:25:14.565749+0000","last_active":"2021-10-08T19:27:42.642194+0000","last_peered":"2021-10-08T19:27:42.642194+0000","last_clean":"2021-10-08T19:27:42.642194+0000","last_became_active":"2021-10-08T19:25:14.565479+0000","last_became_peered":"2021-10-08T19:25:14.565479+0000","last_unstale":"2021-10-08T19:27:42.642194+0000","last_undegraded":"2021-10-08T19:27:42.642194+0000","last_fullsized":"2021-10-08T19:27:42.642194+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:40.563247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.563247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.024890005999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":133,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:46.087647+0000","last_change":"2021-10-08T19:23:14.763360+0000","last_active":"2021-10-08T19:27:46.087647+0000","last_peered":"2021-10-08T19:27:46.087647+0000","last_clean":"2021-10-08T19:27:46.087647+0000","last_became_active":"2021-10-08T19:21:29.646242+0000","last_became_peered":"2021-10-08T19:21:29.646242+0000","last_unstale":"2021-10-08T19:27:46.087647+0000","last_undegraded":"2021-10-08T19:27:46.087647+0000","last_fullsized":"2021-10-08T19:27:46.087647+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:14.763280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:14.763280+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034824790000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2021-10-08T19:27:43.656594+0000","last_change":"2021-10-08T19:27:43.656594+0000","last_active":"2021-10-08T19:27:43.656594+0000","last_peered":"2021-10-08T19:27:43.656594+0000","last_clean":"2021-10-08T19:27:43.656594+0000","last_became_active":"2021-10-08T19:27:43.656294+0000","last_became_peered":"2021-10-08T19:27:43.656294+0000","last_unstale":"2021-10-08T19:27:43.656594+0000","last_undegraded":"2021-10-08T19:27:43.656594+0000","last_fullsized":"2021-10-08T19:27:43.656594+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_clean_scrub_stamp":"2021-10-08T19:27:42.631354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"90'130","reported_seq":461,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:45.655159+0000","last_change":"2021-10-08T19:27:26.591674+0000","last_active":"2021-10-08T19:27:45.655159+0000","last_peered":"2021-10-08T19:27:45.655159+0000","last_clean":"2021-10-08T19:27:45.655159+0000","last_became_active":"2021-10-08T19:27:26.591250+0000","last_became_peered":"2021-10-08T19:27:26.591250+0000","last_unstale":"2021-10-08T19:27:45.655159+0000","last_undegraded":"2021-10-08T19:27:45.655159+0000","last_fullsized":"2021-10-08T19:27:45.655159+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.284249+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0045617870000000003,"stat_sum":{"num_bytes":53670,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":28,"num_write":17,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":268349,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":133,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.641047+0000","last_change":"2021-10-08T19:23:06.487842+0000","last_active":"2021-10-08T19:27:42.641047+0000","last_peered":"2021-10-08T19:27:42.641047+0000","last_clean":"2021-10-08T19:27:42.641047+0000","last_became_active":"2021-10-08T19:21:27.637875+0000","last_became_peered":"2021-10-08T19:21:27.637875+0000","last_unstale":"2021-10-08T19:27:42.641047+0000","last_undegraded":"2021-10-08T19:27:42.641047+0000","last_fullsized":"2021-10-08T19:27:42.641047+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:06.487723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:06.487723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034218619999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"69'13","reported_seq":168,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.647743+0000","last_change":"2021-10-08T19:24:08.192556+0000","last_active":"2021-10-08T19:27:42.647743+0000","last_peered":"2021-10-08T19:27:42.647743+0000","last_clean":"2021-10-08T19:27:42.647743+0000","last_became_active":"2021-10-08T19:21:25.608584+0000","last_became_peered":"2021-10-08T19:21:25.608584+0000","last_unstale":"2021-10-08T19:27:42.647743+0000","last_undegraded":"2021-10-08T19:27:42.647743+0000","last_fullsized":"2021-10-08T19:27:42.647743+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'13","last_scrub_stamp":"2021-10-08T19:24:08.192428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:24:08.192428+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.015716936000000001,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":143,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.641489+0000","last_change":"2021-10-08T19:24:21.997890+0000","last_active":"2021-10-08T19:27:42.641489+0000","last_peered":"2021-10-08T19:27:42.641489+0000","last_clean":"2021-10-08T19:27:42.641489+0000","last_became_active":"2021-10-08T19:21:23.602967+0000","last_became_peered":"2021-10-08T19:21:23.602967+0000","last_unstale":"2021-10-08T19:27:42.641489+0000","last_undegraded":"2021-10-08T19:27:42.641489+0000","last_fullsized":"2021-10-08T19:27:42.641489+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:21.997791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:21.997791+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0069284359999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"70'5","reported_seq":341,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.644867+0000","last_change":"2021-10-08T19:25:14.573914+0000","last_active":"2021-10-08T19:27:42.644867+0000","last_peered":"2021-10-08T19:27:42.644867+0000","last_clean":"2021-10-08T19:27:42.644867+0000","last_became_active":"2021-10-08T19:25:14.573525+0000","last_became_peered":"2021-10-08T19:25:14.573525+0000","last_unstale":"2021-10-08T19:27:42.644867+0000","last_undegraded":"2021-10-08T19:27:42.644867+0000","last_fullsized":"2021-10-08T19:27:42.644867+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:22:48.239721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:48.239721+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001618092,"stat_sum":{"num_bytes":48,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":48,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":152,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:45.655626+0000","last_change":"2021-10-08T19:24:25.096670+0000","last_active":"2021-10-08T19:27:45.655626+0000","last_peered":"2021-10-08T19:27:45.655626+0000","last_clean":"2021-10-08T19:27:45.655626+0000","last_became_active":"2021-10-08T19:24:25.095748+0000","last_became_peered":"2021-10-08T19:24:25.095748+0000","last_unstale":"2021-10-08T19:27:45.655626+0000","last_undegraded":"2021-10-08T19:27:45.655626+0000","last_fullsized":"2021-10-08T19:27:45.655626+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:01.215579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:01.215579+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001463748,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:46.087781+0000","last_change":"2021-10-08T19:27:43.727224+0000","last_active":"2021-10-08T19:27:46.087781+0000","last_peered":"2021-10-08T19:27:46.087781+0000","last_clean":"2021-10-08T19:27:46.087781+0000","last_became_active":"2021-10-08T19:27:43.726942+0000","last_became_peered":"2021-10-08T19:27:43.726942+0000","last_unstale":"2021-10-08T19:27:46.087781+0000","last_undegraded":"2021-10-08T19:27:46.087781+0000","last_fullsized":"2021-10-08T19:27:46.087781+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_clean_scrub_stamp":"2021-10-08T19:27:42.631354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"90'130","reported_seq":321,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:46.087981+0000","last_change":"2021-10-08T19:27:26.592352+0000","last_active":"2021-10-08T19:27:46.087981+0000","last_peered":"2021-10-08T19:27:46.087981+0000","last_clean":"2021-10-08T19:27:46.087981+0000","last_became_active":"2021-10-08T19:27:26.591993+0000","last_became_peered":"2021-10-08T19:27:26.591993+0000","last_unstale":"2021-10-08T19:27:46.087981+0000","last_undegraded":"2021-10-08T19:27:46.087981+0000","last_fullsized":"2021-10-08T19:27:46.087981+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.284249+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020087920000000001,"stat_sum":{"num_bytes":53670,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":28,"num_write":17,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":161010,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,2],"acting":[5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":133,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.648157+0000","last_change":"2021-10-08T19:23:03.639015+0000","last_active":"2021-10-08T19:27:42.648157+0000","last_peered":"2021-10-08T19:27:42.648157+0000","last_clean":"2021-10-08T19:27:42.648157+0000","last_became_active":"2021-10-08T19:21:27.636192+0000","last_became_peered":"2021-10-08T19:21:27.636192+0000","last_unstale":"2021-10-08T19:27:42.648157+0000","last_undegraded":"2021-10-08T19:27:42.648157+0000","last_fullsized":"2021-10-08T19:27:42.648157+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:03.638920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:03.638920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0016933230000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"69'28","reported_seq":265,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.646410+0000","last_change":"2021-10-08T19:24:18.179832+0000","last_active":"2021-10-08T19:27:42.646410+0000","last_peered":"2021-10-08T19:27:42.646410+0000","last_clean":"2021-10-08T19:27:42.646410+0000","last_became_active":"2021-10-08T19:21:25.613663+0000","last_became_peered":"2021-10-08T19:21:25.613663+0000","last_unstale":"2021-10-08T19:27:42.646410+0000","last_undegraded":"2021-10-08T19:27:42.646410+0000","last_fullsized":"2021-10-08T19:27:42.646410+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'28","last_scrub_stamp":"2021-10-08T19:24:18.179708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:24:18.179708+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0076258280000000003,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":163,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:46.088076+0000","last_change":"2021-10-08T19:27:38.072739+0000","last_active":"2021-10-08T19:27:46.088076+0000","last_peered":"2021-10-08T19:27:46.088076+0000","last_clean":"2021-10-08T19:27:46.088076+0000","last_became_active":"2021-10-08T19:24:25.089422+0000","last_became_peered":"2021-10-08T19:24:25.089422+0000","last_unstale":"2021-10-08T19:27:46.088076+0000","last_undegraded":"2021-10-08T19:27:46.088076+0000","last_fullsized":"2021-10-08T19:27:46.088076+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:38.072667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:27:38.072667+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0013248769999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":130,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.645010+0000","last_change":"2021-10-08T19:23:25.378511+0000","last_active":"2021-10-08T19:27:42.645010+0000","last_peered":"2021-10-08T19:27:42.645010+0000","last_clean":"2021-10-08T19:27:42.645010+0000","last_became_active":"2021-10-08T19:21:29.647403+0000","last_became_peered":"2021-10-08T19:21:29.647403+0000","last_unstale":"2021-10-08T19:27:42.645010+0000","last_undegraded":"2021-10-08T19:27:42.645010+0000","last_fullsized":"2021-10-08T19:27:42.645010+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:25.378429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:25.378429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0050198400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":108,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:45.550512+0000","last_change":"2021-10-08T19:25:14.550996+0000","last_active":"2021-10-08T19:27:45.550512+0000","last_peered":"2021-10-08T19:27:45.550512+0000","last_clean":"2021-10-08T19:27:45.550512+0000","last_became_active":"2021-10-08T19:25:14.550690+0000","last_became_peered":"2021-10-08T19:25:14.550690+0000","last_unstale":"2021-10-08T19:27:45.550512+0000","last_undegraded":"2021-10-08T19:27:45.550512+0000","last_fullsized":"2021-10-08T19:27:45.550512+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:09.177525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:09.177525+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2021-10-08T19:27:43.660274+0000","last_change":"2021-10-08T19:27:43.660274+0000","last_active":"2021-10-08T19:27:43.660274+0000","last_peered":"2021-10-08T19:27:43.660274+0000","last_clean":"2021-10-08T19:27:43.660274+0000","last_became_active":"2021-10-08T19:27:43.659455+0000","last_became_peered":"2021-10-08T19:27:43.659455+0000","last_unstale":"2021-10-08T19:27:43.660274+0000","last_undegraded":"2021-10-08T19:27:43.660274+0000","last_fullsized":"2021-10-08T19:27:43.660274+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_clean_scrub_stamp":"2021-10-08T19:27:42.631354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"90'130","reported_seq":384,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:46.626503+0000","last_change":"2021-10-08T19:27:26.598625+0000","last_active":"2021-10-08T19:27:46.626503+0000","last_peered":"2021-10-08T19:27:46.626503+0000","last_clean":"2021-10-08T19:27:46.626503+0000","last_became_active":"2021-10-08T19:27:26.598245+0000","last_became_peered":"2021-10-08T19:27:26.598245+0000","last_unstale":"2021-10-08T19:27:46.626503+0000","last_undegraded":"2021-10-08T19:27:46.626503+0000","last_fullsized":"2021-10-08T19:27:46.626503+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.284249+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0045617870000000003,"stat_sum":{"num_bytes":53670,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":28,"num_write":16,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":214679,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"114'10","reported_seq":250,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.647135+0000","last_change":"2021-10-08T19:24:25.551891+0000","last_active":"2021-10-08T19:27:42.647135+0000","last_peered":"2021-10-08T19:27:42.647135+0000","last_clean":"2021-10-08T19:27:42.647135+0000","last_became_active":"2021-10-08T19:24:25.106695+0000","last_became_peered":"2021-10-08T19:24:25.106695+0000","last_unstale":"2021-10-08T19:27:42.647135+0000","last_undegraded":"2021-10-08T19:27:42.647135+0000","last_fullsized":"2021-10-08T19:27:42.647135+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'9","last_scrub_stamp":"2021-10-08T19:24:04.193898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:04.193898+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0022019909999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"69'10","reported_seq":156,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.647148+0000","last_change":"2021-10-08T19:24:17.162629+0000","last_active":"2021-10-08T19:27:42.647148+0000","last_peered":"2021-10-08T19:27:42.647148+0000","last_clean":"2021-10-08T19:27:42.647148+0000","last_became_active":"2021-10-08T19:21:25.608581+0000","last_became_peered":"2021-10-08T19:21:25.608581+0000","last_unstale":"2021-10-08T19:27:42.647148+0000","last_undegraded":"2021-10-08T19:27:42.647148+0000","last_fullsized":"2021-10-08T19:27:42.647148+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'10","last_scrub_stamp":"2021-10-08T19:24:17.162525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:24:17.162525+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0071187819999999997,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":143,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.646491+0000","last_change":"2021-10-08T19:24:11.227195+0000","last_active":"2021-10-08T19:27:42.646491+0000","last_peered":"2021-10-08T19:27:42.646491+0000","last_clean":"2021-10-08T19:27:42.646491+0000","last_became_active":"2021-10-08T19:21:23.605441+0000","last_became_peered":"2021-10-08T19:21:23.605441+0000","last_unstale":"2021-10-08T19:27:42.646491+0000","last_undegraded":"2021-10-08T19:27:42.646491+0000","last_fullsized":"2021-10-08T19:27:42.646491+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:11.227079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:11.227079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014709302,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":137,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.647308+0000","last_change":"2021-10-08T19:27:38.333212+0000","last_active":"2021-10-08T19:27:42.647308+0000","last_peered":"2021-10-08T19:27:42.647308+0000","last_clean":"2021-10-08T19:27:42.647308+0000","last_became_active":"2021-10-08T19:21:29.649735+0000","last_became_peered":"2021-10-08T19:21:29.649735+0000","last_unstale":"2021-10-08T19:27:42.647308+0000","last_undegraded":"2021-10-08T19:27:42.647308+0000","last_fullsized":"2021-10-08T19:27:42.647308+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:38.333135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:27:38.333135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.006947773,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":103,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:46.088531+0000","last_change":"2021-10-08T19:25:14.562179+0000","last_active":"2021-10-08T19:27:46.088531+0000","last_peered":"2021-10-08T19:27:46.088531+0000","last_clean":"2021-10-08T19:27:46.088531+0000","last_became_active":"2021-10-08T19:25:14.561850+0000","last_became_peered":"2021-10-08T19:25:14.561850+0000","last_unstale":"2021-10-08T19:27:46.088531+0000","last_undegraded":"2021-10-08T19:27:46.088531+0000","last_fullsized":"2021-10-08T19:27:46.088531+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:17.379559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:17.379559+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0052805589999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:46.626287+0000","last_change":"2021-10-08T19:27:43.728370+0000","last_active":"2021-10-08T19:27:46.626287+0000","last_peered":"2021-10-08T19:27:46.626287+0000","last_clean":"2021-10-08T19:27:46.626287+0000","last_became_active":"2021-10-08T19:27:43.728067+0000","last_became_peered":"2021-10-08T19:27:43.728067+0000","last_unstale":"2021-10-08T19:27:46.626287+0000","last_undegraded":"2021-10-08T19:27:46.626287+0000","last_fullsized":"2021-10-08T19:27:46.626287+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_clean_scrub_stamp":"2021-10-08T19:27:42.631354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":133,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.640738+0000","last_change":"2021-10-08T19:22:50.435623+0000","last_active":"2021-10-08T19:27:42.640738+0000","last_peered":"2021-10-08T19:27:42.640738+0000","last_clean":"2021-10-08T19:27:42.640738+0000","last_became_active":"2021-10-08T19:21:27.633878+0000","last_became_peered":"2021-10-08T19:21:27.633878+0000","last_unstale":"2021-10-08T19:27:42.640738+0000","last_undegraded":"2021-10-08T19:27:42.640738+0000","last_fullsized":"2021-10-08T19:27:42.640738+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:50.435552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:50.435552+0000","last_clean_scrub_stamp":"2021-10-08T19:22:50.435552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0012976140000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"69'12","reported_seq":160,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:45.549968+0000","last_change":"2021-10-08T19:22:57.003718+0000","last_active":"2021-10-08T19:27:45.549968+0000","last_peered":"2021-10-08T19:27:45.549968+0000","last_clean":"2021-10-08T19:27:45.549968+0000","last_became_active":"2021-10-08T19:21:25.609079+0000","last_became_peered":"2021-10-08T19:21:25.609079+0000","last_unstale":"2021-10-08T19:27:45.549968+0000","last_undegraded":"2021-10-08T19:27:45.549968+0000","last_fullsized":"2021-10-08T19:27:45.549968+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'12","last_scrub_stamp":"2021-10-08T19:22:57.003641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:57.003641+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0041017010000000001,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"61'2","reported_seq":155,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:45.551632+0000","last_change":"2021-10-08T19:23:07.991466+0000","last_active":"2021-10-08T19:27:45.551632+0000","last_peered":"2021-10-08T19:27:45.551632+0000","last_clean":"2021-10-08T19:27:45.551632+0000","last_became_active":"2021-10-08T19:21:23.603614+0000","last_became_peered":"2021-10-08T19:21:23.603614+0000","last_unstale":"2021-10-08T19:27:45.551632+0000","last_undegraded":"2021-10-08T19:27:45.551632+0000","last_fullsized":"2021-10-08T19:27:45.551632+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'2","last_scrub_stamp":"2021-10-08T19:23:07.991388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:07.991388+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001614983,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":130,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.643736+0000","last_change":"2021-10-08T19:24:12.484917+0000","last_active":"2021-10-08T19:27:42.643736+0000","last_peered":"2021-10-08T19:27:42.643736+0000","last_clean":"2021-10-08T19:27:42.643736+0000","last_became_active":"2021-10-08T19:21:29.647140+0000","last_became_peered":"2021-10-08T19:21:29.647140+0000","last_unstale":"2021-10-08T19:27:42.643736+0000","last_undegraded":"2021-10-08T19:27:42.643736+0000","last_fullsized":"2021-10-08T19:27:42.643736+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:12.484818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:24:12.484818+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0047233090000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":63,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:45.655398+0000","last_change":"2021-10-08T19:25:15.504116+0000","last_active":"2021-10-08T19:27:45.655398+0000","last_peered":"2021-10-08T19:27:45.655398+0000","last_clean":"2021-10-08T19:27:45.655398+0000","last_became_active":"2021-10-08T19:25:15.503799+0000","last_became_peered":"2021-10-08T19:25:15.503799+0000","last_unstale":"2021-10-08T19:27:45.655398+0000","last_undegraded":"2021-10-08T19:27:45.655398+0000","last_fullsized":"2021-10-08T19:27:45.655398+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:40.563247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.563247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.024890005999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"69'9","reported_seq":151,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.647333+0000","last_change":"2021-10-08T19:23:00.644527+0000","last_active":"2021-10-08T19:27:42.647333+0000","last_peered":"2021-10-08T19:27:42.647333+0000","last_clean":"2021-10-08T19:27:42.647333+0000","last_became_active":"2021-10-08T19:21:25.743804+0000","last_became_peered":"2021-10-08T19:21:25.743804+0000","last_unstale":"2021-10-08T19:27:42.647333+0000","last_undegraded":"2021-10-08T19:27:42.647333+0000","last_fullsized":"2021-10-08T19:27:42.647333+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'9","last_scrub_stamp":"2021-10-08T19:23:00.644449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:00.644449+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0023246959999999998,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":143,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.640652+0000","last_change":"2021-10-08T19:23:36.618221+0000","last_active":"2021-10-08T19:27:42.640652+0000","last_peered":"2021-10-08T19:27:42.640652+0000","last_clean":"2021-10-08T19:27:42.640652+0000","last_became_active":"2021-10-08T19:21:23.598125+0000","last_became_peered":"2021-10-08T19:21:23.598125+0000","last_unstale":"2021-10-08T19:27:42.640652+0000","last_undegraded":"2021-10-08T19:27:42.640652+0000","last_fullsized":"2021-10-08T19:27:42.640652+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:36.618136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:36.618136+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0014720390000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":132,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.644577+0000","last_change":"2021-10-08T19:22:36.466178+0000","last_active":"2021-10-08T19:27:42.644577+0000","last_peered":"2021-10-08T19:27:42.644577+0000","last_clean":"2021-10-08T19:27:42.644577+0000","last_became_active":"2021-10-08T19:21:27.638112+0000","last_became_peered":"2021-10-08T19:21:27.638112+0000","last_unstale":"2021-10-08T19:27:42.644577+0000","last_undegraded":"2021-10-08T19:27:42.644577+0000","last_fullsized":"2021-10-08T19:27:42.644577+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:36.466077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:22:36.466077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0018534809999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":137,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.640841+0000","last_change":"2021-10-08T19:24:05.869865+0000","last_active":"2021-10-08T19:27:42.640841+0000","last_peered":"2021-10-08T19:27:42.640841+0000","last_clean":"2021-10-08T19:27:42.640841+0000","last_became_active":"2021-10-08T19:21:29.640674+0000","last_became_peered":"2021-10-08T19:21:29.640674+0000","last_unstale":"2021-10-08T19:27:42.640841+0000","last_undegraded":"2021-10-08T19:27:42.640841+0000","last_fullsized":"2021-10-08T19:27:42.640841+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:05.869774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:24:05.869774+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0041453820000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":63,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:45.654851+0000","last_change":"2021-10-08T19:25:15.501489+0000","last_active":"2021-10-08T19:27:45.654851+0000","last_peered":"2021-10-08T19:27:45.654851+0000","last_clean":"2021-10-08T19:27:45.654851+0000","last_became_active":"2021-10-08T19:25:15.501118+0000","last_became_peered":"2021-10-08T19:25:15.501118+0000","last_unstale":"2021-10-08T19:27:45.654851+0000","last_undegraded":"2021-10-08T19:27:45.654851+0000","last_fullsized":"2021-10-08T19:27:45.654851+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:09.177525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:09.177525+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0090469920000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"69'6","reported_seq":143,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.644539+0000","last_change":"2021-10-08T19:23:21.395469+0000","last_active":"2021-10-08T19:27:42.644539+0000","last_peered":"2021-10-08T19:27:42.644539+0000","last_clean":"2021-10-08T19:27:42.644539+0000","last_became_active":"2021-10-08T19:21:25.742631+0000","last_became_peered":"2021-10-08T19:21:25.742631+0000","last_unstale":"2021-10-08T19:27:42.644539+0000","last_undegraded":"2021-10-08T19:27:42.644539+0000","last_fullsized":"2021-10-08T19:27:42.644539+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'6","last_scrub_stamp":"2021-10-08T19:23:21.395390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:21.395390+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002416241,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":83,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:46.626042+0000","last_change":"2021-10-08T19:24:25.105291+0000","last_active":"2021-10-08T19:27:46.626042+0000","last_peered":"2021-10-08T19:27:46.626042+0000","last_clean":"2021-10-08T19:27:46.626042+0000","last_became_active":"2021-10-08T19:24:25.104551+0000","last_became_peered":"2021-10-08T19:24:25.104551+0000","last_unstale":"2021-10-08T19:27:46.626042+0000","last_undegraded":"2021-10-08T19:27:46.626042+0000","last_fullsized":"2021-10-08T19:27:46.626042+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:40.579610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:40.579610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":141,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:46.088396+0000","last_change":"2021-10-08T19:24:22.361236+0000","last_active":"2021-10-08T19:27:46.088396+0000","last_peered":"2021-10-08T19:27:46.088396+0000","last_clean":"2021-10-08T19:27:46.088396+0000","last_became_active":"2021-10-08T19:21:27.634443+0000","last_became_peered":"2021-10-08T19:21:27.634443+0000","last_unstale":"2021-10-08T19:27:46.088396+0000","last_undegraded":"2021-10-08T19:27:46.088396+0000","last_fullsized":"2021-10-08T19:27:46.088396+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:22.361166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:22.361166+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011785238,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":158,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:45.655442+0000","last_change":"2021-10-08T19:24:25.099693+0000","last_active":"2021-10-08T19:27:45.655442+0000","last_peered":"2021-10-08T19:27:45.655442+0000","last_clean":"2021-10-08T19:27:45.655442+0000","last_became_active":"2021-10-08T19:24:25.099371+0000","last_became_peered":"2021-10-08T19:24:25.099371+0000","last_unstale":"2021-10-08T19:27:45.655442+0000","last_undegraded":"2021-10-08T19:27:45.655442+0000","last_fullsized":"2021-10-08T19:27:45.655442+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:40.417858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:40.417858+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0014005230000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"70'5","reported_seq":318,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:46.625844+0000","last_change":"2021-10-08T19:25:15.495111+0000","last_active":"2021-10-08T19:27:46.625844+0000","last_peered":"2021-10-08T19:27:46.625844+0000","last_clean":"2021-10-08T19:27:46.625844+0000","last_became_active":"2021-10-08T19:25:15.494766+0000","last_became_peered":"2021-10-08T19:25:15.494766+0000","last_unstale":"2021-10-08T19:27:46.625844+0000","last_undegraded":"2021-10-08T19:27:46.625844+0000","last_fullsized":"2021-10-08T19:27:46.625844+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:22:48.239721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:48.239721+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001618092,"stat_sum":{"num_bytes":49,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":19,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":49,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"69'10","reported_seq":110,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.640686+0000","last_change":"2021-10-08T19:23:45.670593+0000","last_active":"2021-10-08T19:27:42.640686+0000","last_peered":"2021-10-08T19:27:42.640686+0000","last_clean":"2021-10-08T19:27:42.640686+0000","last_became_active":"2021-10-08T19:23:44.806124+0000","last_became_peered":"2021-10-08T19:23:44.806124+0000","last_unstale":"2021-10-08T19:27:42.640686+0000","last_undegraded":"2021-10-08T19:27:42.640686+0000","last_fullsized":"2021-10-08T19:27:42.640686+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'10","last_scrub_stamp":"2021-10-08T19:22:52.611060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:52.611060+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,7],"acting":[2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":145,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:46.088044+0000","last_change":"2021-10-08T19:24:23.338025+0000","last_active":"2021-10-08T19:27:46.088044+0000","last_peered":"2021-10-08T19:27:46.088044+0000","last_clean":"2021-10-08T19:27:46.088044+0000","last_became_active":"2021-10-08T19:21:23.603637+0000","last_became_peered":"2021-10-08T19:21:23.603637+0000","last_unstale":"2021-10-08T19:27:46.088044+0000","last_undegraded":"2021-10-08T19:27:46.088044+0000","last_fullsized":"2021-10-08T19:27:46.088044+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:23.337954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:23.337954+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0033141500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"69'8","reported_seq":226,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:46.794906+0000","last_change":"2021-10-08T19:24:10.319907+0000","last_active":"2021-10-08T19:27:46.794906+0000","last_peered":"2021-10-08T19:27:46.794906+0000","last_clean":"2021-10-08T19:27:46.794906+0000","last_became_active":"2021-10-08T19:21:27.635924+0000","last_became_peered":"2021-10-08T19:21:27.635924+0000","last_unstale":"2021-10-08T19:27:46.794906+0000","last_undegraded":"2021-10-08T19:27:46.794906+0000","last_fullsized":"2021-10-08T19:27:46.794906+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'8","last_scrub_stamp":"2021-10-08T19:24:10.319809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:10.319809+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0087040810000000007,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":131,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.647173+0000","last_change":"2021-10-08T19:23:11.535748+0000","last_active":"2021-10-08T19:27:42.647173+0000","last_peered":"2021-10-08T19:27:42.647173+0000","last_clean":"2021-10-08T19:27:42.647173+0000","last_became_active":"2021-10-08T19:21:29.646331+0000","last_became_peered":"2021-10-08T19:21:29.646331+0000","last_unstale":"2021-10-08T19:27:42.647173+0000","last_undegraded":"2021-10-08T19:27:42.647173+0000","last_fullsized":"2021-10-08T19:27:42.647173+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:11.535641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:11.535641+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001740417,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":63,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:45.655047+0000","last_change":"2021-10-08T19:25:15.499116+0000","last_active":"2021-10-08T19:27:45.655047+0000","last_peered":"2021-10-08T19:27:45.655047+0000","last_clean":"2021-10-08T19:27:45.655047+0000","last_became_active":"2021-10-08T19:25:15.498770+0000","last_became_peered":"2021-10-08T19:25:15.498770+0000","last_unstale":"2021-10-08T19:27:45.655047+0000","last_undegraded":"2021-10-08T19:27:45.655047+0000","last_fullsized":"2021-10-08T19:27:45.655047+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:09.177525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:09.177525+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"69'9","reported_seq":159,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:46.088342+0000","last_change":"2021-10-08T19:24:04.286963+0000","last_active":"2021-10-08T19:27:46.088342+0000","last_peered":"2021-10-08T19:27:46.088342+0000","last_clean":"2021-10-08T19:27:46.088342+0000","last_became_active":"2021-10-08T19:21:25.741755+0000","last_became_peered":"2021-10-08T19:21:25.741755+0000","last_unstale":"2021-10-08T19:27:46.088342+0000","last_undegraded":"2021-10-08T19:27:46.088342+0000","last_fullsized":"2021-10-08T19:27:46.088342+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'9","last_scrub_stamp":"2021-10-08T19:24:04.286857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:24:04.286857+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0047281429999999998,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":143,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.646967+0000","last_change":"2021-10-08T19:23:27.367010+0000","last_active":"2021-10-08T19:27:42.646967+0000","last_peered":"2021-10-08T19:27:42.646967+0000","last_clean":"2021-10-08T19:27:42.646967+0000","last_became_active":"2021-10-08T19:21:23.606478+0000","last_became_peered":"2021-10-08T19:21:23.606478+0000","last_unstale":"2021-10-08T19:27:42.646967+0000","last_undegraded":"2021-10-08T19:27:42.646967+0000","last_fullsized":"2021-10-08T19:27:42.646967+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:27.366934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:27.366934+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0016199809999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"69'8","reported_seq":222,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.643995+0000","last_change":"2021-10-08T19:24:16.547591+0000","last_active":"2021-10-08T19:27:42.643995+0000","last_peered":"2021-10-08T19:27:42.643995+0000","last_clean":"2021-10-08T19:27:42.643995+0000","last_became_active":"2021-10-08T19:21:27.636440+0000","last_became_peered":"2021-10-08T19:21:27.636440+0000","last_unstale":"2021-10-08T19:27:42.643995+0000","last_undegraded":"2021-10-08T19:27:42.643995+0000","last_fullsized":"2021-10-08T19:27:42.643995+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'8","last_scrub_stamp":"2021-10-08T19:24:16.547475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:16.547475+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0084390609999999994,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":133,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:45.551774+0000","last_change":"2021-10-08T19:22:49.049456+0000","last_active":"2021-10-08T19:27:45.551774+0000","last_peered":"2021-10-08T19:27:45.551774+0000","last_clean":"2021-10-08T19:27:45.551774+0000","last_became_active":"2021-10-08T19:21:29.640302+0000","last_became_peered":"2021-10-08T19:21:29.640302+0000","last_unstale":"2021-10-08T19:27:45.551774+0000","last_undegraded":"2021-10-08T19:27:45.551774+0000","last_fullsized":"2021-10-08T19:27:45.551774+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:49.049379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:49.049379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.00162856,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":60,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.646103+0000","last_change":"2021-10-08T19:25:15.502340+0000","last_active":"2021-10-08T19:27:42.646103+0000","last_peered":"2021-10-08T19:27:42.646103+0000","last_clean":"2021-10-08T19:27:42.646103+0000","last_became_active":"2021-10-08T19:25:15.502018+0000","last_became_peered":"2021-10-08T19:25:15.502018+0000","last_unstale":"2021-10-08T19:27:42.646103+0000","last_undegraded":"2021-10-08T19:27:42.646103+0000","last_fullsized":"2021-10-08T19:27:42.646103+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:40.563247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.563247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.024890005999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":63,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:45.655352+0000","last_change":"2021-10-08T19:25:15.505142+0000","last_active":"2021-10-08T19:27:45.655352+0000","last_peered":"2021-10-08T19:27:45.655352+0000","last_clean":"2021-10-08T19:27:45.655352+0000","last_became_active":"2021-10-08T19:25:15.504778+0000","last_became_peered":"2021-10-08T19:25:15.504778+0000","last_unstale":"2021-10-08T19:27:45.655352+0000","last_undegraded":"2021-10-08T19:27:45.655352+0000","last_fullsized":"2021-10-08T19:27:45.655352+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:17.379559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:17.379559+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0090469920000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"87'13","reported_seq":193,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.647077+0000","last_change":"2021-10-08T19:24:25.114792+0000","last_active":"2021-10-08T19:27:42.647077+0000","last_peered":"2021-10-08T19:27:42.647077+0000","last_clean":"2021-10-08T19:27:42.647077+0000","last_became_active":"2021-10-08T19:24:25.091885+0000","last_became_peered":"2021-10-08T19:24:25.091885+0000","last_unstale":"2021-10-08T19:27:42.647077+0000","last_undegraded":"2021-10-08T19:27:42.647077+0000","last_fullsized":"2021-10-08T19:27:42.647077+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'13","last_scrub_stamp":"2021-10-08T19:22:53.263631+0000","last_deep_scrub":"87'13","last_deep_scrub_stamp":"2021-10-08T19:22:53.263631+0000","last_clean_scrub_stamp":"2021-10-08T19:22:53.263631+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0036954140000000002,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":83,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:46.626219+0000","last_change":"2021-10-08T19:24:25.105338+0000","last_active":"2021-10-08T19:27:46.626219+0000","last_peered":"2021-10-08T19:27:46.626219+0000","last_clean":"2021-10-08T19:27:46.626219+0000","last_became_active":"2021-10-08T19:24:25.105096+0000","last_became_peered":"2021-10-08T19:24:25.105096+0000","last_unstale":"2021-10-08T19:27:46.626219+0000","last_undegraded":"2021-10-08T19:27:46.626219+0000","last_fullsized":"2021-10-08T19:27:46.626219+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:52.408893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:52.408893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":132,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.643650+0000","last_change":"2021-10-08T19:23:28.367444+0000","last_active":"2021-10-08T19:27:42.643650+0000","last_peered":"2021-10-08T19:27:42.643650+0000","last_clean":"2021-10-08T19:27:42.643650+0000","last_became_active":"2021-10-08T19:21:27.637800+0000","last_became_peered":"2021-10-08T19:21:27.637800+0000","last_unstale":"2021-10-08T19:27:42.643650+0000","last_undegraded":"2021-10-08T19:27:42.643650+0000","last_fullsized":"2021-10-08T19:27:42.643650+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:28.367323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.367323+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034823359999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":131,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.647233+0000","last_change":"2021-10-08T19:23:02.605102+0000","last_active":"2021-10-08T19:27:42.647233+0000","last_peered":"2021-10-08T19:27:42.647233+0000","last_clean":"2021-10-08T19:27:42.647233+0000","last_became_active":"2021-10-08T19:21:29.641431+0000","last_became_peered":"2021-10-08T19:21:29.641431+0000","last_unstale":"2021-10-08T19:27:42.647233+0000","last_undegraded":"2021-10-08T19:27:42.647233+0000","last_fullsized":"2021-10-08T19:27:42.647233+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:02.605025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:02.605025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001265305,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"69'11","reported_seq":246,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:45.550470+0000","last_change":"2021-10-08T19:27:36.131430+0000","last_active":"2021-10-08T19:27:45.550470+0000","last_peered":"2021-10-08T19:27:45.550470+0000","last_clean":"2021-10-08T19:27:45.550470+0000","last_became_active":"2021-10-08T19:24:47.503536+0000","last_became_peered":"2021-10-08T19:24:47.503536+0000","last_unstale":"2021-10-08T19:27:45.550470+0000","last_undegraded":"2021-10-08T19:27:45.550470+0000","last_fullsized":"2021-10-08T19:27:45.550470+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'11","last_scrub_stamp":"2021-10-08T19:24:04.177847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:24:04.177847+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0047576429999999998,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":137,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.646287+0000","last_change":"2021-10-08T19:23:02.242539+0000","last_active":"2021-10-08T19:27:42.646287+0000","last_peered":"2021-10-08T19:27:42.646287+0000","last_clean":"2021-10-08T19:27:42.646287+0000","last_became_active":"2021-10-08T19:21:23.607048+0000","last_became_peered":"2021-10-08T19:21:23.607048+0000","last_unstale":"2021-10-08T19:27:42.646287+0000","last_undegraded":"2021-10-08T19:27:42.646287+0000","last_fullsized":"2021-10-08T19:27:42.646287+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:02.242462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:02.242462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034031740000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":133,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.647223+0000","last_change":"2021-10-08T19:22:43.186757+0000","last_active":"2021-10-08T19:27:42.647223+0000","last_peered":"2021-10-08T19:27:42.647223+0000","last_clean":"2021-10-08T19:27:42.647223+0000","last_became_active":"2021-10-08T19:21:27.635623+0000","last_became_peered":"2021-10-08T19:21:27.635623+0000","last_unstale":"2021-10-08T19:27:42.647223+0000","last_undegraded":"2021-10-08T19:27:42.647223+0000","last_fullsized":"2021-10-08T19:27:42.647223+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:43.186684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:43.186684+0000","last_clean_scrub_stamp":"2021-10-08T19:22:43.186684+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0015123129999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":130,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.641397+0000","last_change":"2021-10-08T19:23:12.504222+0000","last_active":"2021-10-08T19:27:42.641397+0000","last_peered":"2021-10-08T19:27:42.641397+0000","last_clean":"2021-10-08T19:27:42.641397+0000","last_became_active":"2021-10-08T19:21:29.649225+0000","last_became_peered":"2021-10-08T19:21:29.649225+0000","last_unstale":"2021-10-08T19:27:42.641397+0000","last_undegraded":"2021-10-08T19:27:42.641397+0000","last_fullsized":"2021-10-08T19:27:42.641397+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:12.504136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:12.504136+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0038704550000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"70'5","reported_seq":63,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:45.550128+0000","last_change":"2021-10-08T19:25:15.496726+0000","last_active":"2021-10-08T19:27:45.550128+0000","last_peered":"2021-10-08T19:27:45.550128+0000","last_clean":"2021-10-08T19:27:45.550128+0000","last_became_active":"2021-10-08T19:25:15.496309+0000","last_became_peered":"2021-10-08T19:25:15.496309+0000","last_unstale":"2021-10-08T19:27:45.550128+0000","last_undegraded":"2021-10-08T19:27:45.550128+0000","last_fullsized":"2021-10-08T19:27:45.550128+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:22:48.239721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:48.239721+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001618092,"stat_sum":{"num_bytes":49,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":19,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":49,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.10","version":"69'4","reported_seq":176,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.641139+0000","last_change":"2021-10-08T19:27:38.084210+0000","last_active":"2021-10-08T19:27:42.641139+0000","last_peered":"2021-10-08T19:27:42.641139+0000","last_clean":"2021-10-08T19:27:42.641139+0000","last_became_active":"2021-10-08T19:24:25.097674+0000","last_became_peered":"2021-10-08T19:24:25.097674+0000","last_unstale":"2021-10-08T19:27:42.641139+0000","last_undegraded":"2021-10-08T19:27:42.641139+0000","last_fullsized":"2021-10-08T19:27:42.641139+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'4","last_scrub_stamp":"2021-10-08T19:27:38.084136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:27:38.084136+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040040570000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":163,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:46.088606+0000","last_change":"2021-10-08T19:24:25.094735+0000","last_active":"2021-10-08T19:27:46.088606+0000","last_peered":"2021-10-08T19:27:46.088606+0000","last_clean":"2021-10-08T19:27:46.088606+0000","last_became_active":"2021-10-08T19:24:25.094384+0000","last_became_peered":"2021-10-08T19:24:25.094384+0000","last_unstale":"2021-10-08T19:27:46.088606+0000","last_undegraded":"2021-10-08T19:27:46.088606+0000","last_fullsized":"2021-10-08T19:27:46.088606+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:21.346014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:13.716331+0000","last_clean_scrub_stamp":"2021-10-08T19:24:21.346014+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0086210910000000009,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":83,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:46.626184+0000","last_change":"2021-10-08T19:24:25.106499+0000","last_active":"2021-10-08T19:27:46.626184+0000","last_peered":"2021-10-08T19:27:46.626184+0000","last_clean":"2021-10-08T19:27:46.626184+0000","last_became_active":"2021-10-08T19:24:25.106186+0000","last_became_peered":"2021-10-08T19:24:25.106186+0000","last_unstale":"2021-10-08T19:27:46.626184+0000","last_undegraded":"2021-10-08T19:27:46.626184+0000","last_fullsized":"2021-10-08T19:27:46.626184+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:02.446394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:02.446394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":140,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:45.655253+0000","last_change":"2021-10-08T19:24:18.542192+0000","last_active":"2021-10-08T19:27:45.655253+0000","last_peered":"2021-10-08T19:27:45.655253+0000","last_clean":"2021-10-08T19:27:45.655253+0000","last_became_active":"2021-10-08T19:21:29.642835+0000","last_became_peered":"2021-10-08T19:21:29.642835+0000","last_unstale":"2021-10-08T19:27:45.655253+0000","last_undegraded":"2021-10-08T19:27:45.655253+0000","last_fullsized":"2021-10-08T19:27:45.655253+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:18.542124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:24:18.542124+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0051790259999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":63,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:46.088315+0000","last_change":"2021-10-08T19:25:15.504574+0000","last_active":"2021-10-08T19:27:46.088315+0000","last_peered":"2021-10-08T19:27:46.088315+0000","last_clean":"2021-10-08T19:27:46.088315+0000","last_became_active":"2021-10-08T19:25:15.504255+0000","last_became_peered":"2021-10-08T19:25:15.504255+0000","last_unstale":"2021-10-08T19:27:46.088315+0000","last_undegraded":"2021-10-08T19:27:46.088315+0000","last_fullsized":"2021-10-08T19:27:46.088315+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:40.563247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.563247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.024890005999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"69'11","reported_seq":195,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.641647+0000","last_change":"2021-10-08T19:24:25.550057+0000","last_active":"2021-10-08T19:27:42.641647+0000","last_peered":"2021-10-08T19:27:42.641647+0000","last_clean":"2021-10-08T19:27:42.641647+0000","last_became_active":"2021-10-08T19:24:25.097676+0000","last_became_peered":"2021-10-08T19:24:25.097676+0000","last_unstale":"2021-10-08T19:27:42.641647+0000","last_undegraded":"2021-10-08T19:27:42.641647+0000","last_fullsized":"2021-10-08T19:27:42.641647+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'11","last_scrub_stamp":"2021-10-08T19:23:38.388959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:38.388959+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039620519999999998,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":83,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:46.626603+0000","last_change":"2021-10-08T19:24:25.098448+0000","last_active":"2021-10-08T19:27:46.626603+0000","last_peered":"2021-10-08T19:27:46.626603+0000","last_clean":"2021-10-08T19:27:46.626603+0000","last_became_active":"2021-10-08T19:24:25.098128+0000","last_became_peered":"2021-10-08T19:24:25.098128+0000","last_unstale":"2021-10-08T19:27:46.626603+0000","last_undegraded":"2021-10-08T19:27:46.626603+0000","last_fullsized":"2021-10-08T19:27:46.626603+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:34.508558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:34.508558+0000","last_clean_scrub_stamp":"2021-10-08T19:23:34.508558+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":154,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:45.655036+0000","last_change":"2021-10-08T19:24:25.096183+0000","last_active":"2021-10-08T19:27:45.655036+0000","last_peered":"2021-10-08T19:27:45.655036+0000","last_clean":"2021-10-08T19:27:45.655036+0000","last_became_active":"2021-10-08T19:24:25.095490+0000","last_became_peered":"2021-10-08T19:24:25.095490+0000","last_unstale":"2021-10-08T19:27:45.655036+0000","last_undegraded":"2021-10-08T19:27:45.655036+0000","last_fullsized":"2021-10-08T19:27:45.655036+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:00.194892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:00.194892+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020373650000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":148,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.643816+0000","last_change":"2021-10-08T19:24:25.102165+0000","last_active":"2021-10-08T19:27:42.643816+0000","last_peered":"2021-10-08T19:27:42.643816+0000","last_clean":"2021-10-08T19:27:42.643816+0000","last_became_active":"2021-10-08T19:24:25.100477+0000","last_became_peered":"2021-10-08T19:24:25.100477+0000","last_unstale":"2021-10-08T19:27:42.643816+0000","last_undegraded":"2021-10-08T19:27:42.643816+0000","last_fullsized":"2021-10-08T19:27:42.643816+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:06.570853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:06.570853+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034079790000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"69'10","reported_seq":156,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.647547+0000","last_change":"2021-10-08T19:23:36.223620+0000","last_active":"2021-10-08T19:27:42.647547+0000","last_peered":"2021-10-08T19:27:42.647547+0000","last_clean":"2021-10-08T19:27:42.647547+0000","last_became_active":"2021-10-08T19:21:25.743519+0000","last_became_peered":"2021-10-08T19:21:25.743519+0000","last_unstale":"2021-10-08T19:27:42.647547+0000","last_undegraded":"2021-10-08T19:27:42.647547+0000","last_fullsized":"2021-10-08T19:27:42.647547+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'10","last_scrub_stamp":"2021-10-08T19:23:36.223545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:36.223545+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0023151259999999998,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":139,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:46.087931+0000","last_change":"2021-10-08T19:23:19.631788+0000","last_active":"2021-10-08T19:27:46.087931+0000","last_peered":"2021-10-08T19:27:46.087931+0000","last_clean":"2021-10-08T19:27:46.087931+0000","last_became_active":"2021-10-08T19:21:23.604530+0000","last_became_peered":"2021-10-08T19:21:23.604530+0000","last_unstale":"2021-10-08T19:27:46.087931+0000","last_undegraded":"2021-10-08T19:27:46.087931+0000","last_fullsized":"2021-10-08T19:27:46.087931+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:19.631715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:19.631715+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0013318340000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1f","version":"114'10","reported_seq":128,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:46.795125+0000","last_change":"2021-10-08T19:24:25.122871+0000","last_active":"2021-10-08T19:27:46.795125+0000","last_peered":"2021-10-08T19:27:46.795125+0000","last_clean":"2021-10-08T19:27:46.795125+0000","last_became_active":"2021-10-08T19:24:25.105742+0000","last_became_peered":"2021-10-08T19:24:25.105742+0000","last_unstale":"2021-10-08T19:27:46.795125+0000","last_undegraded":"2021-10-08T19:27:46.795125+0000","last_fullsized":"2021-10-08T19:27:46.795125+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'9","last_scrub_stamp":"2021-10-08T19:24:07.171989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:07.171989+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"69'1","reported_seq":135,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:45.654712+0000","last_change":"2021-10-08T19:23:04.311491+0000","last_active":"2021-10-08T19:27:45.654712+0000","last_peered":"2021-10-08T19:27:45.654712+0000","last_clean":"2021-10-08T19:27:45.654712+0000","last_became_active":"2021-10-08T19:21:29.640296+0000","last_became_peered":"2021-10-08T19:21:29.640296+0000","last_unstale":"2021-10-08T19:27:45.654712+0000","last_undegraded":"2021-10-08T19:27:45.654712+0000","last_fullsized":"2021-10-08T19:27:45.654712+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2021-10-08T19:23:04.311406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:04.311406+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0041668299999999998,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"69'11","reported_seq":95,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:46.626703+0000","last_change":"2021-10-08T19:24:25.129616+0000","last_active":"2021-10-08T19:27:46.626703+0000","last_peered":"2021-10-08T19:27:46.626703+0000","last_clean":"2021-10-08T19:27:46.626703+0000","last_became_active":"2021-10-08T19:24:25.104985+0000","last_became_peered":"2021-10-08T19:24:25.104985+0000","last_unstale":"2021-10-08T19:27:46.626703+0000","last_undegraded":"2021-10-08T19:27:46.626703+0000","last_fullsized":"2021-10-08T19:27:46.626703+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'11","last_scrub_stamp":"2021-10-08T19:22:53.420199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:53.420199+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":154,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.641514+0000","last_change":"2021-10-08T19:24:25.098061+0000","last_active":"2021-10-08T19:27:42.641514+0000","last_peered":"2021-10-08T19:27:42.641514+0000","last_clean":"2021-10-08T19:27:42.641514+0000","last_became_active":"2021-10-08T19:24:25.097164+0000","last_became_peered":"2021-10-08T19:24:25.097164+0000","last_unstale":"2021-10-08T19:27:42.641514+0000","last_undegraded":"2021-10-08T19:27:42.641514+0000","last_fullsized":"2021-10-08T19:27:42.641514+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:11.535464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:11.535464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012302489999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":139,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.647563+0000","last_change":"2021-10-08T19:24:13.178473+0000","last_active":"2021-10-08T19:27:42.647563+0000","last_peered":"2021-10-08T19:27:42.647563+0000","last_clean":"2021-10-08T19:27:42.647563+0000","last_became_active":"2021-10-08T19:21:27.632648+0000","last_became_peered":"2021-10-08T19:21:27.632648+0000","last_unstale":"2021-10-08T19:27:42.647563+0000","last_undegraded":"2021-10-08T19:27:42.647563+0000","last_fullsized":"2021-10-08T19:27:42.647563+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:13.178370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:13.178370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0056659290000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"69'1","reported_seq":132,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.646077+0000","last_change":"2021-10-08T19:22:50.226593+0000","last_active":"2021-10-08T19:27:42.646077+0000","last_peered":"2021-10-08T19:27:42.646077+0000","last_clean":"2021-10-08T19:27:42.646077+0000","last_became_active":"2021-10-08T19:21:29.637392+0000","last_became_peered":"2021-10-08T19:21:29.637392+0000","last_unstale":"2021-10-08T19:27:42.646077+0000","last_undegraded":"2021-10-08T19:27:42.646077+0000","last_fullsized":"2021-10-08T19:27:42.646077+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2021-10-08T19:22:50.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:50.226504+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040000080000000002,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"69'15","reported_seq":185,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.641738+0000","last_change":"2021-10-08T19:22:52.474731+0000","last_active":"2021-10-08T19:27:42.641738+0000","last_peered":"2021-10-08T19:27:42.641738+0000","last_clean":"2021-10-08T19:27:42.641738+0000","last_became_active":"2021-10-08T19:22:44.005356+0000","last_became_peered":"2021-10-08T19:22:44.005356+0000","last_unstale":"2021-10-08T19:27:42.641738+0000","last_undegraded":"2021-10-08T19:27:42.641738+0000","last_fullsized":"2021-10-08T19:27:42.641738+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'15","last_scrub_stamp":"2021-10-08T19:22:52.474651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:52.474651+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040638499999999999,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":89,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:46.626237+0000","last_change":"2021-10-08T19:27:36.279020+0000","last_active":"2021-10-08T19:27:46.626237+0000","last_peered":"2021-10-08T19:27:46.626237+0000","last_clean":"2021-10-08T19:27:46.626237+0000","last_became_active":"2021-10-08T19:24:25.106119+0000","last_became_peered":"2021-10-08T19:24:25.106119+0000","last_unstale":"2021-10-08T19:27:46.626237+0000","last_undegraded":"2021-10-08T19:27:46.626237+0000","last_fullsized":"2021-10-08T19:27:46.626237+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:36.278905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:46.422866+0000","last_clean_scrub_stamp":"2021-10-08T19:27:36.278905+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0017473320000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":133,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.646558+0000","last_change":"2021-10-08T19:23:10.148845+0000","last_active":"2021-10-08T19:27:42.646558+0000","last_peered":"2021-10-08T19:27:42.646558+0000","last_clean":"2021-10-08T19:27:42.646558+0000","last_became_active":"2021-10-08T19:21:27.636398+0000","last_became_peered":"2021-10-08T19:21:27.636398+0000","last_unstale":"2021-10-08T19:27:42.646558+0000","last_undegraded":"2021-10-08T19:27:42.646558+0000","last_fullsized":"2021-10-08T19:27:42.646558+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:10.148774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:10.148774+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034045170000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":157,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:45.551457+0000","last_change":"2021-10-08T19:27:37.219578+0000","last_active":"2021-10-08T19:27:45.551457+0000","last_peered":"2021-10-08T19:27:45.551457+0000","last_clean":"2021-10-08T19:27:45.551457+0000","last_became_active":"2021-10-08T19:24:25.097782+0000","last_became_peered":"2021-10-08T19:24:25.097782+0000","last_unstale":"2021-10-08T19:27:45.551457+0000","last_undegraded":"2021-10-08T19:27:45.551457+0000","last_fullsized":"2021-10-08T19:27:45.551457+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:37.219503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:37.219503+0000","last_clean_scrub_stamp":"2021-10-08T19:27:37.219503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0015176320000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"69'12","reported_seq":157,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.644206+0000","last_change":"2021-10-08T19:23:10.562916+0000","last_active":"2021-10-08T19:27:42.644206+0000","last_peered":"2021-10-08T19:27:42.644206+0000","last_clean":"2021-10-08T19:27:42.644206+0000","last_became_active":"2021-10-08T19:21:25.612541+0000","last_became_peered":"2021-10-08T19:21:25.612541+0000","last_unstale":"2021-10-08T19:27:42.644206+0000","last_undegraded":"2021-10-08T19:27:42.644206+0000","last_fullsized":"2021-10-08T19:27:42.644206+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'12","last_scrub_stamp":"2021-10-08T19:23:10.562820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:10.562820+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040692890000000002,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":154,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.643573+0000","last_change":"2021-10-08T19:24:25.097146+0000","last_active":"2021-10-08T19:27:42.643573+0000","last_peered":"2021-10-08T19:27:42.643573+0000","last_clean":"2021-10-08T19:27:42.643573+0000","last_became_active":"2021-10-08T19:24:25.096570+0000","last_became_peered":"2021-10-08T19:24:25.096570+0000","last_unstale":"2021-10-08T19:27:42.643573+0000","last_undegraded":"2021-10-08T19:27:42.643573+0000","last_fullsized":"2021-10-08T19:27:42.643573+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:07.581653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:07.581653+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034956309999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":141,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:45.550362+0000","last_change":"2021-10-08T19:24:13.289692+0000","last_active":"2021-10-08T19:27:45.550362+0000","last_peered":"2021-10-08T19:27:45.550362+0000","last_clean":"2021-10-08T19:27:45.550362+0000","last_became_active":"2021-10-08T19:21:27.635242+0000","last_became_peered":"2021-10-08T19:21:27.635242+0000","last_unstale":"2021-10-08T19:27:45.550362+0000","last_undegraded":"2021-10-08T19:27:45.550362+0000","last_fullsized":"2021-10-08T19:27:45.550362+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:13.289586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:13.289586+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0093791299999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":148,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.644483+0000","last_change":"2021-10-08T19:24:25.096752+0000","last_active":"2021-10-08T19:27:42.644483+0000","last_peered":"2021-10-08T19:27:42.644483+0000","last_clean":"2021-10-08T19:27:42.644483+0000","last_became_active":"2021-10-08T19:24:25.096419+0000","last_became_peered":"2021-10-08T19:24:25.096419+0000","last_unstale":"2021-10-08T19:27:42.644483+0000","last_undegraded":"2021-10-08T19:27:42.644483+0000","last_fullsized":"2021-10-08T19:27:42.644483+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:38.544673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:38.544673+0000","last_clean_scrub_stamp":"2021-10-08T19:22:38.544673+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0019818940000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"69'9","reported_seq":153,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:45.550036+0000","last_change":"2021-10-08T19:23:19.997379+0000","last_active":"2021-10-08T19:27:45.550036+0000","last_peered":"2021-10-08T19:27:45.550036+0000","last_clean":"2021-10-08T19:27:45.550036+0000","last_became_active":"2021-10-08T19:21:25.608263+0000","last_became_peered":"2021-10-08T19:21:25.608263+0000","last_unstale":"2021-10-08T19:27:45.550036+0000","last_undegraded":"2021-10-08T19:27:45.550036+0000","last_fullsized":"2021-10-08T19:27:45.550036+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'9","last_scrub_stamp":"2021-10-08T19:23:19.997296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:19.997296+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040259689999999999,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":146,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:45.655229+0000","last_change":"2021-10-08T19:24:15.574426+0000","last_active":"2021-10-08T19:27:45.655229+0000","last_peered":"2021-10-08T19:27:45.655229+0000","last_clean":"2021-10-08T19:27:45.655229+0000","last_became_active":"2021-10-08T19:21:23.607785+0000","last_became_peered":"2021-10-08T19:21:23.607785+0000","last_unstale":"2021-10-08T19:27:45.655229+0000","last_undegraded":"2021-10-08T19:27:45.655229+0000","last_fullsized":"2021-10-08T19:27:45.655229+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:15.574344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:15.574344+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0085919499999999992,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":135,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:46.088151+0000","last_change":"2021-10-08T19:23:05.799433+0000","last_active":"2021-10-08T19:27:46.088151+0000","last_peered":"2021-10-08T19:27:46.088151+0000","last_clean":"2021-10-08T19:27:46.088151+0000","last_became_active":"2021-10-08T19:21:27.633979+0000","last_became_peered":"2021-10-08T19:21:27.633979+0000","last_unstale":"2021-10-08T19:27:46.088151+0000","last_undegraded":"2021-10-08T19:27:46.088151+0000","last_fullsized":"2021-10-08T19:27:46.088151+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:05.799361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:05.799361+0000","last_clean_scrub_stamp":"2021-10-08T19:23:05.799361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0036358100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":137,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.647711+0000","last_change":"2021-10-08T19:24:14.144555+0000","last_active":"2021-10-08T19:27:42.647711+0000","last_peered":"2021-10-08T19:27:42.647711+0000","last_clean":"2021-10-08T19:27:42.647711+0000","last_became_active":"2021-10-08T19:21:29.640978+0000","last_became_peered":"2021-10-08T19:21:29.640978+0000","last_unstale":"2021-10-08T19:27:42.647711+0000","last_undegraded":"2021-10-08T19:27:42.647711+0000","last_fullsized":"2021-10-08T19:27:42.647711+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:14.144450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:24:14.144450+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0032569320000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"69'5","reported_seq":147,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:45.550592+0000","last_change":"2021-10-08T19:23:17.993609+0000","last_active":"2021-10-08T19:27:45.550592+0000","last_peered":"2021-10-08T19:27:45.550592+0000","last_clean":"2021-10-08T19:27:45.550592+0000","last_became_active":"2021-10-08T19:21:25.609029+0000","last_became_peered":"2021-10-08T19:21:25.609029+0000","last_unstale":"2021-10-08T19:27:45.550592+0000","last_undegraded":"2021-10-08T19:27:45.550592+0000","last_fullsized":"2021-10-08T19:27:45.550592+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'5","last_scrub_stamp":"2021-10-08T19:23:17.993532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:17.993532+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040855580000000004,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":164,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:45.655532+0000","last_change":"2021-10-08T19:24:25.096540+0000","last_active":"2021-10-08T19:27:45.655532+0000","last_peered":"2021-10-08T19:27:45.655532+0000","last_clean":"2021-10-08T19:27:45.655532+0000","last_became_active":"2021-10-08T19:24:25.096225+0000","last_became_peered":"2021-10-08T19:24:25.096225+0000","last_unstale":"2021-10-08T19:27:45.655532+0000","last_undegraded":"2021-10-08T19:27:45.655532+0000","last_fullsized":"2021-10-08T19:27:45.655532+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:06.609550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:06.609550+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0037828580000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":142,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:45.654993+0000","last_change":"2021-10-08T19:24:20.517151+0000","last_active":"2021-10-08T19:27:45.654993+0000","last_peered":"2021-10-08T19:27:45.654993+0000","last_clean":"2021-10-08T19:27:45.654993+0000","last_became_active":"2021-10-08T19:21:27.637178+0000","last_became_peered":"2021-10-08T19:21:27.637178+0000","last_unstale":"2021-10-08T19:27:45.654993+0000","last_undegraded":"2021-10-08T19:27:45.654993+0000","last_fullsized":"2021-10-08T19:27:45.654993+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:20.517044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:20.517044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0053303969999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":133,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:46.087558+0000","last_change":"2021-10-08T19:23:23.659594+0000","last_active":"2021-10-08T19:27:46.087558+0000","last_peered":"2021-10-08T19:27:46.087558+0000","last_clean":"2021-10-08T19:27:46.087558+0000","last_became_active":"2021-10-08T19:21:29.649640+0000","last_became_peered":"2021-10-08T19:21:29.649640+0000","last_unstale":"2021-10-08T19:27:46.087558+0000","last_undegraded":"2021-10-08T19:27:46.087558+0000","last_fullsized":"2021-10-08T19:27:46.087558+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:23.659524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:23.659524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0013747169999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"88'13","reported_seq":233,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:45.549655+0000","last_change":"2021-10-08T19:27:36.045601+0000","last_active":"2021-10-08T19:27:45.549655+0000","last_peered":"2021-10-08T19:27:45.549655+0000","last_clean":"2021-10-08T19:27:45.549655+0000","last_became_active":"2021-10-08T19:25:33.715297+0000","last_became_peered":"2021-10-08T19:25:33.715297+0000","last_unstale":"2021-10-08T19:27:45.549655+0000","last_undegraded":"2021-10-08T19:27:45.549655+0000","last_fullsized":"2021-10-08T19:27:45.549655+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'13","last_scrub_stamp":"2021-10-08T19:23:16.016646+0000","last_deep_scrub":"88'13","last_deep_scrub_stamp":"2021-10-08T19:23:16.016646+0000","last_clean_scrub_stamp":"2021-10-08T19:23:16.016646+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0052093469999999996,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":136,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.644961+0000","last_change":"2021-10-08T19:23:14.443220+0000","last_active":"2021-10-08T19:27:42.644961+0000","last_peered":"2021-10-08T19:27:42.644961+0000","last_clean":"2021-10-08T19:27:42.644961+0000","last_became_active":"2021-10-08T19:21:23.598272+0000","last_became_peered":"2021-10-08T19:21:23.598272+0000","last_unstale":"2021-10-08T19:27:42.644961+0000","last_undegraded":"2021-10-08T19:27:42.644961+0000","last_fullsized":"2021-10-08T19:27:42.644961+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:14.443147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:14.443147+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003489631,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":133,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.645767+0000","last_change":"2021-10-08T19:23:05.196328+0000","last_active":"2021-10-08T19:27:42.645767+0000","last_peered":"2021-10-08T19:27:42.645767+0000","last_clean":"2021-10-08T19:27:42.645767+0000","last_became_active":"2021-10-08T19:21:27.634883+0000","last_became_peered":"2021-10-08T19:21:27.634883+0000","last_unstale":"2021-10-08T19:27:42.645767+0000","last_undegraded":"2021-10-08T19:27:42.645767+0000","last_fullsized":"2021-10-08T19:27:42.645767+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:05.196252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:05.196252+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0016803230000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":133,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:45.550027+0000","last_change":"2021-10-08T19:22:50.032446+0000","last_active":"2021-10-08T19:27:45.550027+0000","last_peered":"2021-10-08T19:27:45.550027+0000","last_clean":"2021-10-08T19:27:45.550027+0000","last_became_active":"2021-10-08T19:21:29.639039+0000","last_became_peered":"2021-10-08T19:21:29.639039+0000","last_unstale":"2021-10-08T19:27:45.550027+0000","last_undegraded":"2021-10-08T19:27:45.550027+0000","last_fullsized":"2021-10-08T19:27:45.550027+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:50.032367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:50.032367+0000","last_clean_scrub_stamp":"2021-10-08T19:22:50.032367+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034102759999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"69'15","reported_seq":159,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.641698+0000","last_change":"2021-10-08T19:24:14.482657+0000","last_active":"2021-10-08T19:27:42.641698+0000","last_peered":"2021-10-08T19:27:42.641698+0000","last_clean":"2021-10-08T19:27:42.641698+0000","last_became_active":"2021-10-08T19:21:25.612873+0000","last_became_peered":"2021-10-08T19:21:25.612873+0000","last_unstale":"2021-10-08T19:27:42.641698+0000","last_undegraded":"2021-10-08T19:27:42.641698+0000","last_fullsized":"2021-10-08T19:27:42.641698+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'15","last_scrub_stamp":"2021-10-08T19:24:14.482511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:24:14.482511+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012310702999999999,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":137,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.646787+0000","last_change":"2021-10-08T19:22:54.671364+0000","last_active":"2021-10-08T19:27:42.646787+0000","last_peered":"2021-10-08T19:27:42.646787+0000","last_clean":"2021-10-08T19:27:42.646787+0000","last_became_active":"2021-10-08T19:21:23.603422+0000","last_became_peered":"2021-10-08T19:21:23.603422+0000","last_unstale":"2021-10-08T19:27:42.646787+0000","last_undegraded":"2021-10-08T19:27:42.646787+0000","last_fullsized":"2021-10-08T19:27:42.646787+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:54.671289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:54.671289+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001752221,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":159,"reported_epoch":185,"state":"active+clean","last_fresh":"2021-10-08T19:27:45.549745+0000","last_change":"2021-10-08T19:24:25.091115+0000","last_active":"2021-10-08T19:27:45.549745+0000","last_peered":"2021-10-08T19:27:45.549745+0000","last_clean":"2021-10-08T19:27:45.549745+0000","last_became_active":"2021-10-08T19:24:25.090759+0000","last_became_peered":"2021-10-08T19:24:25.090759+0000","last_unstale":"2021-10-08T19:27:45.549745+0000","last_undegraded":"2021-10-08T19:27:45.549745+0000","last_fullsized":"2021-10-08T19:27:45.549745+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:39.931718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:39.931718+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0036493649999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":154,"reported_epoch":182,"state":"active+clean","last_fresh":"2021-10-08T19:27:42.642928+0000","last_change":"2021-10-08T19:27:39.133530+0000","last_active":"2021-10-08T19:27:42.642928+0000","last_peered":"2021-10-08T19:27:42.642928+0000","last_clean":"2021-10-08T19:27:42.642928+0000","last_became_active":"2021-10-08T19:24:25.097417+0000","last_became_peered":"2021-10-08T19:24:25.097417+0000","last_unstale":"2021-10-08T19:27:42.642928+0000","last_undegraded":"2021-10-08T19:27:42.642928+0000","last_fullsized":"2021-10-08T19:27:42.642928+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:39.133448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:27:39.133448+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.018021757999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":48,"acting":48,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":11,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2790831,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1430,"ondisk_log_size":1430,"up":33,"acting":33,"num_store_stats":8},{"poolid":3,"num_pg":23,"stat_sum":{"num_bytes":681,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":320,"num_read_kb":316,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":584,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":69,"acting":69,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":694,"num_read_kb":451,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":148,"num_bytes_recovered":2354,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":406,"ondisk_log_size":406,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":96,"acting":96,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201361,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":75864,"kb_used_data":1488,"kb_used_omap":0,"kb_used_meta":74368,"kb_avail":93669288,"statfs":{"total":95995035648,"available":95917350912,"internally_reserved":0,"allocated":1523712,"data_stored":973947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":76152832},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:27:25 2021","interfaces":[{"interface":"back","average":{"1min":1.8500000000000001,"5min":1.7210000000000001,"15min":0.88600000000000001},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":8.6280000000000001,"5min":32.366999999999997,"15min":32.366999999999997},"last":0.33900000000000002},{"interface":"front","average":{"1min":2.2200000000000002,"5min":2.0259999999999998,"15min":0.98999999999999999},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":6.7930000000000001,"5min":29.736000000000001,"15min":29.736000000000001},"last":0.23699999999999999}]},{"osd":1,"last update":"Fri Oct 8 19:27:25 2021","interfaces":[{"interface":"back","average":{"1min":1.6319999999999999,"5min":2.0139999999999998,"15min":1.002},"min":{"1min":0.23400000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":3.3740000000000001,"5min":25.079999999999998,"15min":25.079999999999998},"last":0.25900000000000001},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.1299999999999999,"15min":0.71699999999999997},"min":{"1min":0.29699999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":3.6600000000000001,"5min":7.907,"15min":7.907},"last":0.36399999999999999}]},{"osd":2,"last update":"Fri Oct 8 19:27:25 2021","interfaces":[{"interface":"back","average":{"1min":2.157,"5min":2.0859999999999999,"15min":1.022},"min":{"1min":0.26700000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":7.8170000000000002,"5min":27.018000000000001,"15min":27.018000000000001},"last":0.40300000000000002},{"interface":"front","average":{"1min":1.9770000000000001,"5min":1.9650000000000001,"15min":0.97299999999999998},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":6.2279999999999998,"5min":27.113,"15min":27.113},"last":0.38800000000000001}]},{"osd":3,"last update":"Fri Oct 8 19:27:25 2021","interfaces":[{"interface":"back","average":{"1min":3.1219999999999999,"5min":2.2490000000000001,"15min":1.077},"min":{"1min":0.32300000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":16.853000000000002,"5min":27.010000000000002,"15min":27.010000000000002},"last":0.42099999999999999},{"interface":"front","average":{"1min":3.1779999999999999,"5min":2.0779999999999998,"15min":1.0309999999999999},"min":{"1min":0.38100000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":10.709,"5min":27.263999999999999,"15min":27.263999999999999},"last":0.40999999999999998}]},{"osd":4,"last update":"Fri Oct 8 19:27:25 2021","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":0.74099999999999999,"15min":0.56299999999999994},"min":{"1min":0.315,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":3.8399999999999999,"5min":4.7990000000000004,"15min":4.7990000000000004},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.60999999999999999,"15min":0.502},"min":{"1min":0.29699999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":2.1840000000000002,"5min":4.0830000000000002,"15min":4.0830000000000002},"last":0.35199999999999998}]},{"osd":5,"last update":"Fri Oct 8 19:27:25 2021","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.77600000000000002,"15min":0.57599999999999996},"min":{"1min":0.39000000000000001,"5min":0.251,"15min":0.251},"max":{"1min":2.4249999999999998,"5min":4.649,"15min":4.649},"last":0.378},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.57599999999999996,"15min":0.53300000000000003},"min":{"1min":0.34799999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":2.2069999999999999,"5min":4.5259999999999998,"15min":4.5259999999999998},"last":0.31}]},{"osd":6,"last update":"Fri Oct 8 19:27:25 2021","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":0.78600000000000003,"15min":0.59999999999999998},"min":{"1min":0.34300000000000003,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":3.9430000000000001,"5min":3.9430000000000001,"15min":3.9430000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":1.157,"5min":0.85699999999999998,"15min":0.66200000000000003},"min":{"1min":0.42499999999999999,"5min":0.318,"15min":0.318},"max":{"1min":2.5,"5min":4.7750000000000004,"15min":4.7750000000000004},"last":0.46300000000000002}]}]},{"osd":6,"up_from":47,"seq":201863462997,"num_pgs":61,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":90188,"kb_used_data":1156,"kb_used_omap":0,"kb_used_meta":89024,"kb_avail":93654964,"statfs":{"total":95995035648,"available":95902683136,"internally_reserved":0,"allocated":1183744,"data_stored":651598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":91160576},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:27:06 2021","interfaces":[{"interface":"back","average":{"1min":3.133,"5min":1.4490000000000001,"15min":0.79500000000000004},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":21.783999999999999,"5min":21.783999999999999,"15min":21.783999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":3.2730000000000001,"5min":1.6180000000000001,"15min":0.87},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":19.823,"5min":19.823,"15min":19.823},"last":0.377}]},{"osd":1,"last update":"Fri Oct 8 19:27:06 2021","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.153,"15min":0.72199999999999998},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":6.1059999999999999,"5min":14.878,"15min":14.878},"last":0.45800000000000002},{"interface":"front","average":{"1min":1.198,"5min":1.1830000000000001,"15min":0.72399999999999998},"min":{"1min":0.29999999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":4.7539999999999996,"5min":14.779,"15min":14.779},"last":0.33400000000000002}]},{"osd":2,"last update":"Fri Oct 8 19:27:06 2021","interfaces":[{"interface":"back","average":{"1min":2.2490000000000001,"5min":1.681,"15min":0.90900000000000003},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":10.590999999999999,"5min":19.084,"15min":19.084},"last":0.40899999999999997},{"interface":"front","average":{"1min":2.0640000000000001,"5min":1.6910000000000001,"15min":0.89100000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":7.2539999999999996,"5min":16.670999999999999,"15min":16.670999999999999},"last":0.435}]},{"osd":3,"last update":"Fri Oct 8 19:27:06 2021","interfaces":[{"interface":"back","average":{"1min":4.0110000000000001,"5min":1.772,"15min":0.91800000000000004},"min":{"1min":0.34300000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":21.670000000000002,"5min":21.670000000000002,"15min":21.670000000000002},"last":0.42499999999999999},{"interface":"front","average":{"1min":2.8010000000000002,"5min":1.506,"15min":0.83599999999999997},"min":{"1min":0.29599999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":22.254999999999999,"5min":22.254999999999999,"15min":22.254999999999999},"last":0.47899999999999998}]},{"osd":4,"last update":"Fri Oct 8 19:27:06 2021","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.51400000000000001,"15min":0.44600000000000001},"min":{"1min":0.28299999999999997,"5min":0.255,"15min":0.255},"max":{"1min":2.7469999999999999,"5min":2.7469999999999999,"15min":2.7469999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.61099999999999999,"15min":0.503},"min":{"1min":0.27000000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":6.1719999999999997,"5min":6.1719999999999997,"15min":6.1719999999999997},"last":0.57499999999999996}]},{"osd":5,"last update":"Fri Oct 8 19:27:06 2021","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.58799999999999997,"15min":0.5},"min":{"1min":0.29499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.552,"5min":6.7949999999999999,"15min":6.7949999999999999},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.63400000000000001,"15min":0.52400000000000002},"min":{"1min":0.29799999999999999,"5min":0.252,"15min":0.252},"max":{"1min":6.1479999999999997,"5min":6.1479999999999997,"15min":6.1479999999999997},"last":0.51800000000000002}]},{"osd":7,"last update":"Fri Oct 8 19:27:28 2021","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.59099999999999997,"15min":0.52700000000000002},"min":{"1min":0.34699999999999998,"5min":0.32500000000000001,"15min":0.32000000000000001},"max":{"1min":1.379,"5min":3.4300000000000002,"15min":3.4300000000000002},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.71099999999999997,"15min":0.59899999999999998},"min":{"1min":0.35199999999999998,"5min":0.313,"15min":0.313},"max":{"1min":5.476,"5min":5.476,"15min":5.476},"last":0.49399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574951,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":444876,"kb_used_data":360708,"kb_used_omap":0,"kb_used_meta":84160,"kb_avail":93300276,"statfs":{"total":95995035648,"available":95539482624,"internally_reserved":0,"allocated":369364992,"data_stored":368805873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":86179840},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:27:40 2021","interfaces":[{"interface":"back","average":{"1min":4.5730000000000004,"5min":4.1040000000000001,"15min":1.5880000000000001},"min":{"1min":0.24299999999999999,"5min":0.20399999999999999,"15min":0.184},"max":{"1min":29.294,"5min":98.734999999999999,"15min":98.734999999999999},"last":0.32200000000000001},{"interface":"front","average":{"1min":5.298,"5min":4.766,"15min":1.829},"min":{"1min":0.34499999999999997,"5min":0.218,"15min":0.20599999999999999},"max":{"1min":34.880000000000003,"5min":98.843999999999994,"15min":98.843999999999994},"last":0.309}]},{"osd":2,"last update":"Fri Oct 8 19:27:03 2021","interfaces":[{"interface":"back","average":{"1min":4.2850000000000001,"5min":3.2440000000000002,"15min":1.347},"min":{"1min":0.252,"5min":0.22,"15min":0.22},"max":{"1min":19.173999999999999,"5min":35.124000000000002,"15min":35.124000000000002},"last":0.39400000000000002},{"interface":"front","average":{"1min":6.2480000000000002,"5min":3.2349999999999999,"15min":1.359},"min":{"1min":0.33300000000000002,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":17.998000000000001,"5min":35.283000000000001,"15min":35.283000000000001},"last":0.42399999999999999}]},{"osd":3,"last update":"Fri Oct 8 19:27:16 2021","interfaces":[{"interface":"back","average":{"1min":4.2190000000000003,"5min":3.2170000000000001,"15min":1.3819999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":13.801,"5min":34.575000000000003,"15min":34.575000000000003},"last":0.34200000000000003},{"interface":"front","average":{"1min":2.3370000000000002,"5min":2.613,"15min":1.175},"min":{"1min":0.46700000000000003,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":6.9009999999999998,"5min":35.091000000000001,"15min":35.091000000000001},"last":0.41499999999999998}]},{"osd":4,"last update":"Fri Oct 8 19:27:29 2021","interfaces":[{"interface":"back","average":{"1min":2.363,"5min":2.157,"15min":1.0609999999999999},"min":{"1min":0.435,"5min":0.317,"15min":0.29499999999999998},"max":{"1min":6.0990000000000002,"5min":16.872,"15min":16.872},"last":0.44},{"interface":"front","average":{"1min":1.5900000000000001,"5min":1.351,"15min":0.80900000000000005},"min":{"1min":0.30099999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":4.7869999999999999,"5min":7.3460000000000001,"15min":7.3460000000000001},"last":0.47599999999999998}]},{"osd":5,"last update":"Fri Oct 8 19:26:51 2021","interfaces":[{"interface":"back","average":{"1min":4.0529999999999999,"5min":1.7150000000000001,"15min":0.94799999999999995},"min":{"1min":0.40400000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":13.692,"5min":13.692,"15min":13.692},"last":0.53800000000000003},{"interface":"front","average":{"1min":2.403,"5min":1.2769999999999999,"15min":0.79800000000000004},"min":{"1min":0.375,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":6.8520000000000003,"5min":7.3719999999999999,"15min":7.3719999999999999},"last":0.52900000000000003}]},{"osd":6,"last update":"Fri Oct 8 19:27:10 2021","interfaces":[{"interface":"back","average":{"1min":2.3180000000000001,"5min":2.0710000000000002,"15min":1.0489999999999999},"min":{"1min":0.40400000000000003,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":5.258,"5min":16.815999999999999,"15min":16.815999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":3.6309999999999998,"5min":1.905,"15min":1.0840000000000001},"min":{"1min":0.47999999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":13.773,"5min":13.773,"15min":13.773},"last":0.502}]},{"osd":7,"last update":"Fri Oct 8 19:27:29 2021","interfaces":[{"interface":"back","average":{"1min":2.6520000000000001,"5min":2.149,"15min":1.095},"min":{"1min":0.442,"5min":0.312,"15min":0.312},"max":{"1min":13.246,"5min":23.721,"15min":23.721},"last":0.55500000000000005},{"interface":"front","average":{"1min":1.7649999999999999,"5min":1.4179999999999999,"15min":0.85599999999999998},"min":{"1min":0.35399999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":4.8170000000000002,"5min":7.4000000000000004,"15min":7.4000000000000004},"last":0.54900000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738474,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":106928,"kb_used_data":1128,"kb_used_omap":0,"kb_used_meta":105792,"kb_avail":93638224,"statfs":{"total":95995035648,"available":95885541376,"internally_reserved":0,"allocated":1155072,"data_stored":624154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":108331008},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 8 19:27:41 2021","interfaces":[{"interface":"back","average":{"1min":4.0590000000000002,"5min":2.359,"15min":1.006},"min":{"1min":0.24199999999999999,"5min":0.192,"15min":0.192},"max":{"1min":22.466000000000001,"5min":22.466000000000001,"15min":22.466000000000001},"last":0.216},{"interface":"front","average":{"1min":2.5339999999999998,"5min":2.5499999999999998,"15min":1.099},"min":{"1min":0.28299999999999997,"5min":0.217,"15min":0.217},"max":{"1min":15.041,"5min":15.041,"15min":15.041},"last":0.34000000000000002}]},{"osd":2,"last update":"Fri Oct 8 19:27:03 2021","interfaces":[{"interface":"back","average":{"1min":5.3220000000000001,"5min":3.1120000000000001,"15min":1.3029999999999999},"min":{"1min":0.30099999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":14.307,"5min":62.390000000000001,"15min":62.390000000000001},"last":0.29099999999999998},{"interface":"front","average":{"1min":3.0499999999999998,"5min":2.7610000000000001,"15min":1.1870000000000001},"min":{"1min":0.30399999999999999,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":9.3849999999999998,"5min":62.718000000000004,"15min":62.718000000000004},"last":0.32800000000000001}]},{"osd":3,"last update":"Fri Oct 8 19:27:16 2021","interfaces":[{"interface":"back","average":{"1min":4.8479999999999999,"5min":3.0209999999999999,"15min":1.333},"min":{"1min":0.34499999999999997,"5min":0.246,"15min":0.246},"max":{"1min":15.090999999999999,"5min":62.491,"15min":62.491},"last":0.252},{"interface":"front","average":{"1min":1.974,"5min":2.5680000000000001,"15min":1.161},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":9.4290000000000003,"5min":62.673000000000002,"15min":62.673000000000002},"last":0.26600000000000001}]},{"osd":4,"last update":"Fri Oct 8 19:27:31 2021","interfaces":[{"interface":"back","average":{"1min":2.6000000000000001,"5min":1.8460000000000001,"15min":0.97699999999999998},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":7.8650000000000002,"5min":10.444000000000001,"15min":10.444000000000001},"last":0.39400000000000002},{"interface":"front","average":{"1min":2.6760000000000002,"5min":1.9079999999999999,"15min":1.02},"min":{"1min":0.35999999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":11.823,"5min":11.823,"15min":11.823},"last":0.45600000000000002}]},{"osd":5,"last update":"Fri Oct 8 19:26:48 2021","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":1.3160000000000001,"15min":0.80800000000000005},"min":{"1min":0.33300000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":4.1109999999999998,"5min":15.56,"15min":15.56},"last":0.379},{"interface":"front","average":{"1min":3.3769999999999998,"5min":1.7430000000000001,"15min":0.96099999999999997},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":9.9649999999999999,"5min":15.484999999999999,"15min":15.484999999999999},"last":0.443}]},{"osd":6,"last update":"Fri Oct 8 19:27:09 2021","interfaces":[{"interface":"back","average":{"1min":3.6219999999999999,"5min":1.9239999999999999,"15min":1.026},"min":{"1min":0.39700000000000002,"5min":0.377,"15min":0.377},"max":{"1min":11.869,"5min":11.869,"15min":11.869},"last":0.53500000000000003},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.5740000000000001,"15min":0.90500000000000003},"min":{"1min":0.29899999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":4.1390000000000002,"5min":10.519,"15min":10.519},"last":0.41799999999999998}]},{"osd":7,"last update":"Fri Oct 8 19:27:26 2021","interfaces":[{"interface":"back","average":{"1min":3.169,"5min":1.9550000000000001,"15min":1.0249999999999999},"min":{"1min":0.39400000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":7.8280000000000003,"5min":10.006,"15min":10.006},"last":0.47799999999999998},{"interface":"front","average":{"1min":3.0059999999999998,"5min":2.306,"15min":1.1519999999999999},"min":{"1min":0.441,"5min":0.40799999999999997,"15min":0.40100000000000002},"max":{"1min":11.898999999999999,"5min":11.898999999999999,"15min":11.898999999999999},"last":0.51500000000000001}]}]},{"osd":2,"up_from":18,"seq":77309411426,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":280668,"kb_used_data":182036,"kb_used_omap":0,"kb_used_meta":98624,"kb_avail":93464484,"statfs":{"total":95995035648,"available":95707631616,"internally_reserved":0,"allocated":186404864,"data_stored":185894367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":100990976},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:26:53 2021","interfaces":[{"interface":"back","average":{"1min":4.0800000000000001,"5min":3.137,"15min":1.2769999999999999},"min":{"1min":0.255,"5min":0.193,"15min":0.17699999999999999},"max":{"1min":14.430999999999999,"5min":61.670999999999999,"15min":61.670999999999999},"last":0.252},{"interface":"front","average":{"1min":4.3899999999999997,"5min":3.1070000000000002,"15min":1.276},"min":{"1min":0.40799999999999997,"5min":0.189,"15min":0.189},"max":{"1min":13.532,"5min":65.284999999999997,"15min":65.284999999999997},"last":0.30499999999999999}]},{"osd":1,"last update":"Fri Oct 8 19:26:53 2021","interfaces":[{"interface":"back","average":{"1min":2.786,"5min":2.4049999999999998,"15min":1.0449999999999999},"min":{"1min":0.20999999999999999,"5min":0.192,"15min":0.192},"max":{"1min":8.0980000000000008,"5min":31.303999999999998,"15min":31.303999999999998},"last":0.29299999999999998},{"interface":"front","average":{"1min":4.7190000000000003,"5min":3.085,"15min":1.2889999999999999},"min":{"1min":0.25700000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":12.858000000000001,"5min":31.696999999999999,"15min":31.696999999999999},"last":0.374}]},{"osd":3,"last update":"Fri Oct 8 19:27:08 2021","interfaces":[{"interface":"back","average":{"1min":5.7400000000000002,"5min":3.5470000000000002,"15min":1.48},"min":{"1min":0.32200000000000001,"5min":0.255,"15min":0.218},"max":{"1min":17.734000000000002,"5min":65.322999999999993,"15min":65.322999999999993},"last":0.33800000000000002},{"interface":"front","average":{"1min":4.3200000000000003,"5min":3.0859999999999999,"15min":1.3080000000000001},"min":{"1min":0.40000000000000002,"5min":0.248,"15min":0.24399999999999999},"max":{"1min":14.209,"5min":61.143000000000001,"15min":61.143000000000001},"last":0.46999999999999997}]},{"osd":4,"last update":"Fri Oct 8 19:27:26 2021","interfaces":[{"interface":"back","average":{"1min":2.9100000000000001,"5min":1.833,"15min":0.97799999999999998},"min":{"1min":0.36799999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":14.122999999999999,"5min":14.122999999999999,"15min":14.122999999999999},"last":0.42099999999999999},{"interface":"front","average":{"1min":2.9870000000000001,"5min":2.1040000000000001,"15min":1.085},"min":{"1min":0.30299999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":10.609999999999999,"5min":15.143000000000001,"15min":15.143000000000001},"last":0.433}]},{"osd":5,"last update":"Fri Oct 8 19:26:49 2021","interfaces":[{"interface":"back","average":{"1min":2.387,"5min":1.845,"15min":1.0009999999999999},"min":{"1min":0.39500000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":10.58,"5min":15.087999999999999,"15min":15.087999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":1.9950000000000001,"5min":1.4470000000000001,"15min":0.873},"min":{"1min":0.38,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":6.976,"5min":14.558,"15min":14.558},"last":0.45200000000000001}]},{"osd":6,"last update":"Fri Oct 8 19:27:08 2021","interfaces":[{"interface":"back","average":{"1min":2.823,"5min":1.7869999999999999,"15min":0.97499999999999998},"min":{"1min":0.38400000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":14.162000000000001,"5min":14.162000000000001,"15min":14.162000000000001},"last":0.38700000000000001},{"interface":"front","average":{"1min":2.722,"5min":1.865,"15min":1.0149999999999999},"min":{"1min":0.38900000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":14.529999999999999,"5min":14.529999999999999,"15min":14.529999999999999},"last":0.48499999999999999}]},{"osd":7,"last update":"Fri Oct 8 19:27:26 2021","interfaces":[{"interface":"back","average":{"1min":3.0219999999999998,"5min":2.0489999999999999,"15min":1.0609999999999999},"min":{"1min":0.42699999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":14.185,"5min":14.185,"15min":14.185},"last":0.51600000000000001},{"interface":"front","average":{"1min":3.1640000000000001,"5min":1.9179999999999999,"15min":1.042},"min":{"1min":0.434,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":14.497999999999999,"5min":14.497999999999999,"15min":14.497999999999999},"last":0.505}]}]},{"osd":3,"up_from":24,"seq":103079215200,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":301636,"kb_used_data":183036,"kb_used_omap":0,"kb_used_meta":118592,"kb_avail":93443516,"statfs":{"total":95995035648,"available":95686160384,"internally_reserved":0,"allocated":187428864,"data_stored":186878527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":121438208},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:27:17 2021","interfaces":[{"interface":"back","average":{"1min":3.2440000000000002,"5min":3.3900000000000001,"15min":1.367},"min":{"1min":0.17899999999999999,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":11.833,"5min":109.601,"15min":109.601},"last":0.23100000000000001},{"interface":"front","average":{"1min":3.3580000000000001,"5min":3.7389999999999999,"15min":1.512},"min":{"1min":0.23000000000000001,"5min":0.217,"15min":0.19800000000000001},"max":{"1min":10.366,"5min":107.84,"15min":107.84},"last":0.36299999999999999}]},{"osd":1,"last update":"Fri Oct 8 19:27:17 2021","interfaces":[{"interface":"back","average":{"1min":3.6659999999999999,"5min":2.4460000000000002,"15min":1.0860000000000001},"min":{"1min":0.25800000000000001,"5min":0.219,"15min":0.219},"max":{"1min":20.335999999999999,"5min":20.335999999999999,"15min":20.335999999999999},"last":0.33200000000000002},{"interface":"front","average":{"1min":3.544,"5min":2.3220000000000001,"15min":1.046},"min":{"1min":0.34200000000000003,"5min":0.219,"15min":0.21199999999999999},"max":{"1min":12.315,"5min":13.372999999999999,"15min":13.372999999999999},"last":0.41699999999999998}]},{"osd":2,"last update":"Fri Oct 8 19:27:17 2021","interfaces":[{"interface":"back","average":{"1min":6.1609999999999996,"5min":3.0110000000000001,"15min":1.2929999999999999},"min":{"1min":0.44,"5min":0.246,"15min":0.246},"max":{"1min":32.277000000000001,"5min":32.277000000000001,"15min":32.277000000000001},"last":0.34399999999999997},{"interface":"front","average":{"1min":2.903,"5min":2.1949999999999998,"15min":1.018},"min":{"1min":0.377,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":8.9290000000000003,"5min":14.898999999999999,"15min":14.898999999999999},"last":0.38800000000000001}]},{"osd":4,"last update":"Fri Oct 8 19:27:30 2021","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.7569999999999999,"15min":0.97599999999999998},"min":{"1min":0.33400000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":7.0659999999999998,"5min":18.064,"15min":18.064},"last":0.45800000000000002},{"interface":"front","average":{"1min":2.6589999999999998,"5min":1.804,"15min":1.125},"min":{"1min":0.32600000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":18.692,"5min":18.692,"15min":18.692},"last":0.60799999999999998}]},{"osd":5,"last update":"Fri Oct 8 19:26:48 2021","interfaces":[{"interface":"back","average":{"1min":2.3180000000000001,"5min":1.5860000000000001,"15min":0.92200000000000004},"min":{"1min":0.32700000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":6.7409999999999997,"5min":13.186,"15min":13.186},"last":0.497},{"interface":"front","average":{"1min":3.4279999999999999,"5min":1.589,"15min":1.014},"min":{"1min":0.36499999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":8.0559999999999992,"5min":10.285,"15min":10.285},"last":0.56699999999999995}]},{"osd":6,"last update":"Fri Oct 8 19:27:07 2021","interfaces":[{"interface":"back","average":{"1min":2.5910000000000002,"5min":1.9490000000000001,"15min":1.8240000000000001},"min":{"1min":0.34999999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":17.512,"5min":17.512,"15min":21.538},"last":0.64900000000000002},{"interface":"front","average":{"1min":1.994,"5min":1.6910000000000001,"15min":0.94099999999999995},"min":{"1min":0.38200000000000001,"5min":0.36899999999999999,"15min":0.35499999999999998},"max":{"1min":6.798,"5min":13.298,"15min":13.298},"last":0.57599999999999996}]},{"osd":7,"last update":"Fri Oct 8 19:27:30 2021","interfaces":[{"interface":"back","average":{"1min":1.827,"5min":1.6100000000000001,"15min":0.93999999999999995},"min":{"1min":0.37,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":6.9560000000000004,"5min":8.8350000000000009,"15min":8.8350000000000009},"last":0.67700000000000005},{"interface":"front","average":{"1min":2.5979999999999999,"5min":1.8600000000000001,"15min":1.0349999999999999},"min":{"1min":0.41999999999999998,"5min":0.376,"15min":0.376},"max":{"1min":7.774,"5min":13.225,"15min":13.225},"last":0.55000000000000004}]}]},{"osd":4,"up_from":30,"seq":128849018973,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":80556,"kb_used_data":1188,"kb_used_omap":0,"kb_used_meta":79360,"kb_avail":93664596,"statfs":{"total":95995035648,"available":95912546304,"internally_reserved":0,"allocated":1216512,"data_stored":652985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":81264640},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:27:30 2021","interfaces":[{"interface":"back","average":{"1min":2.653,"5min":2.1859999999999999,"15min":1.0780000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":21.225999999999999,"5min":59.223999999999997,"15min":59.223999999999997},"last":0.42199999999999999},{"interface":"front","average":{"1min":2.895,"5min":2.161,"15min":1.069},"min":{"1min":0.23699999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":21.648,"5min":58.667999999999999,"15min":58.667999999999999},"last":0.73999999999999999}]},{"osd":1,"last update":"Fri Oct 8 19:27:30 2021","interfaces":[{"interface":"back","average":{"1min":2.8220000000000001,"5min":1.8839999999999999,"15min":0.97199999999999998},"min":{"1min":0.25700000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":26.634,"5min":26.634,"15min":26.634},"last":0.49199999999999999},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.179,"15min":0.72799999999999998},"min":{"1min":0.27200000000000002,"5min":0.246,"15min":0.24099999999999999},"max":{"1min":4.8300000000000001,"5min":6.7000000000000002,"15min":6.7000000000000002},"last":0.51100000000000001}]},{"osd":2,"last update":"Fri Oct 8 19:27:30 2021","interfaces":[{"interface":"back","average":{"1min":3.4460000000000002,"5min":1.8340000000000001,"15min":0.95399999999999996},"min":{"1min":0.38800000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":21.257000000000001,"5min":21.257000000000001,"15min":21.257000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":2.907,"5min":1.7470000000000001,"15min":0.93799999999999994},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":21.600000000000001,"5min":21.600000000000001,"15min":21.600000000000001},"last":0.53100000000000003}]},{"osd":3,"last update":"Fri Oct 8 19:27:30 2021","interfaces":[{"interface":"back","average":{"1min":3.0009999999999999,"5min":2.7429999999999999,"15min":1.2589999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":21.672999999999998,"5min":58.506999999999998,"15min":58.506999999999998},"last":0.68200000000000005},{"interface":"front","average":{"1min":1.6559999999999999,"5min":1.9670000000000001,"15min":1.006},"min":{"1min":0.36799999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":7.1660000000000004,"5min":58.521000000000001,"15min":58.521000000000001},"last":0.56100000000000005}]},{"osd":5,"last update":"Fri Oct 8 19:26:51 2021","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.59599999999999997,"15min":0.44800000000000001},"min":{"1min":0.27800000000000002,"5min":0.23899999999999999,"15min":0.222},"max":{"1min":4.7359999999999998,"5min":4.7359999999999998,"15min":4.7359999999999998},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.54400000000000004,"15min":0.437},"min":{"1min":0.30099999999999999,"5min":0.245,"15min":0.245},"max":{"1min":1.6870000000000001,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":0.66900000000000004}]},{"osd":6,"last update":"Fri Oct 8 19:27:05 2021","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.65300000000000002,"15min":0.48499999999999999},"min":{"1min":0.26400000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":1.702,"5min":5.0460000000000003,"15min":5.0460000000000003},"last":0.46100000000000002},{"interface":"front","average":{"1min":1.2250000000000001,"5min":0.73099999999999998,"15min":0.52300000000000002},"min":{"1min":0.32800000000000001,"5min":0.30499999999999999,"15min":0.26100000000000001},"max":{"1min":4.8899999999999997,"5min":4.8899999999999997,"15min":4.8899999999999997},"last":0.70899999999999996}]},{"osd":7,"last update":"Fri Oct 8 19:27:29 2021","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.59599999999999997,"15min":0.52100000000000002},"min":{"1min":0.32300000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":4.0060000000000002,"5min":4.0060000000000002,"15min":4.0060000000000002},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.81200000000000006,"15min":0.59799999999999998},"min":{"1min":0.33000000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":4.5860000000000003,"5min":5.0209999999999999,"15min":5.0209999999999999},"last":0.621}]}]},{"osd":5,"up_from":38,"seq":163208757335,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":66656,"kb_used_data":1752,"kb_used_omap":0,"kb_used_meta":64896,"kb_avail":93678496,"statfs":{"total":95995035648,"available":95926779904,"internally_reserved":0,"allocated":1794048,"data_stored":1243287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":66453504},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:26:47 2021","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.306,"15min":0.749},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":3.5390000000000001,"5min":22.966999999999999,"15min":22.966999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":1.6599999999999999,"5min":1.038,"15min":0.65800000000000003},"min":{"1min":0.26400000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":4.8579999999999997,"5min":4.8579999999999997,"15min":4.8579999999999997},"last":0.47499999999999998}]},{"osd":1,"last update":"Fri Oct 8 19:26:47 2021","interfaces":[{"interface":"back","average":{"1min":1.5760000000000001,"5min":1.1259999999999999,"15min":0.70999999999999996},"min":{"1min":0.26900000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":6.0800000000000001,"5min":8.9299999999999997,"15min":8.9299999999999997},"last":0.498},{"interface":"front","average":{"1min":1.6180000000000001,"5min":1.1659999999999999,"15min":0.72899999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.25900000000000001},"max":{"1min":6.0700000000000003,"5min":8.9199999999999999,"15min":8.9199999999999999},"last":0.46400000000000002}]},{"osd":2,"last update":"Fri Oct 8 19:26:47 2021","interfaces":[{"interface":"back","average":{"1min":2.4020000000000001,"5min":1.929,"15min":0.95299999999999996},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":11.138999999999999,"5min":29.398,"15min":29.398},"last":0.48699999999999999},{"interface":"front","average":{"1min":1.893,"5min":2.0430000000000001,"15min":1.014},"min":{"1min":0.374,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":6.1790000000000003,"5min":29.387,"15min":29.387},"last":0.47999999999999998}]},{"osd":3,"last update":"Fri Oct 8 19:26:47 2021","interfaces":[{"interface":"back","average":{"1min":1.9359999999999999,"5min":1.474,"15min":0.81799999999999995},"min":{"1min":0.34399999999999997,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":9.6199999999999992,"5min":9.6199999999999992,"15min":9.6199999999999992},"last":0.45500000000000002},{"interface":"front","average":{"1min":3.125,"5min":1.488,"15min":0.82499999999999996},"min":{"1min":0.35999999999999999,"5min":0.313,"15min":0.313},"max":{"1min":21.504000000000001,"5min":21.504000000000001,"15min":21.504000000000001},"last":0.52200000000000002}]},{"osd":4,"last update":"Fri Oct 8 19:26:47 2021","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.61299999999999999,"15min":0.47599999999999998},"min":{"1min":0.27400000000000002,"5min":0.249,"15min":0.224},"max":{"1min":5.0780000000000003,"5min":5.0780000000000003,"15min":5.0780000000000003},"last":0.372},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.63700000000000001,"15min":0.498},"min":{"1min":0.32200000000000001,"5min":0.28299999999999997,"15min":0.23799999999999999},"max":{"1min":3.9540000000000002,"5min":3.9540000000000002,"15min":3.9540000000000002},"last":0.41399999999999998}]},{"osd":6,"last update":"Fri Oct 8 19:27:06 2021","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.77100000000000002,"15min":0.55500000000000005},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":3.774,"5min":7.266,"15min":7.266},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.68000000000000005,"15min":0.55900000000000005},"min":{"1min":0.35499999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":2.9319999999999999,"5min":5.1580000000000004,"15min":5.1580000000000004},"last":0.38500000000000001}]},{"osd":7,"last update":"Fri Oct 8 19:27:31 2021","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.68200000000000005,"15min":0.56499999999999995},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":2.516,"5min":3.899,"15min":3.899},"last":0.44},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.76800000000000002,"15min":0.64000000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":3.7400000000000002,"5min":5.0279999999999996,"15min":5.0279999999999996},"last":0.42999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":266240,"data_stored":262688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":327680,"data_stored":327680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-10-08T19:27:50.646 INFO:tasks.thrashosds.thrasher:Setting 5.1d to [6, 1, 7, 4, 2, 3] 2021-10-08T19:27:50.647 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '5.1d', '6', '1', '7', '4', '2', '3'] 2021-10-08T19:27:50.647 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd pg-upmap-items 5.1d 6 1 7 4 2 3 2021-10-08T19:27:50.648 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:27:50.649 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:50.650 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:27:50.751 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:27:50.774 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:50 smithi097 ceph-mon[32687]: from='client.35114 v1:172.21.15.97:0/438531558' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:27:50.774 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:50 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/832028493' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_1", "app": "rados", "yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:50.775 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:50 smithi097 ceph-mon[32687]: osdmap e187: 8 total, 8 up, 8 in 2021-10-08T19:27:50.775 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:50 smithi097 ceph-mon[41966]: from='client.35114 v1:172.21.15.97:0/438531558' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:27:50.775 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:50 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/832028493' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_1", "app": "rados", "yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:50.776 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:50 smithi097 ceph-mon[41966]: osdmap e187: 8 total, 8 up, 8 in 2021-10-08T19:27:50.778 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:50.779 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:50 smithi117 ceph-mon[34585]: from='client.35114 v1:172.21.15.97:0/438531558' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:27:50.780 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:50 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/832028493' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_1", "app": "rados", "yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:50.780 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:50 smithi117 ceph-mon[34585]: osdmap e187: 8 total, 8 up, 8 in 2021-10-08T19:27:50.932 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:27:50.935 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:50.935 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:27:51.036 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:27:51.061 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:51.103 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset noscrub 2021-10-08T19:27:51.104 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:27:51.105 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:51.106 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:27:51.208 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:27:51.231 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:51.482 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:27:51.515 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:27:51.518 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:51.518 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:27:51.600 DEBUG:teuthology.orchestra.run.smithi097:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_1 bench 90 write' 2021-10-08T19:27:51.603 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2021-10-08T19:27:51.603 INFO:teuthology.orchestra.run:waiting for 3000 2021-10-08T19:27:51.620 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:27:51.646 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:51.651 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:hints = 1 2021-10-08T19:27:51.651 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2021-10-08T19:27:51.652 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Object prefix: benchmark_data_smithi097_144160 2021-10-08T19:27:51.652 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2021-10-08T19:27:51.652 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 0 0 0 0 0 0 - 0 2021-10-08T19:27:51.779 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:51 smithi117 ceph-mon[34585]: pgmap v301: 178 pgs: 178 active+clean; 582 KiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 863 B/s rd, 0 op/s 2021-10-08T19:27:51.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:51 smithi097 ceph-mon[41966]: pgmap v301: 178 pgs: 178 active+clean; 582 KiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 863 B/s rd, 0 op/s 2021-10-08T19:27:51.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:51 smithi097 ceph-mon[32687]: pgmap v301: 178 pgs: 178 active+clean; 582 KiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 863 B/s rd, 0 op/s 2021-10-08T19:27:52.115 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:27:52.116 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2021-10-08T19:27:52.116 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2021-10-08T19:27:52.116 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2021-10-08T19:27:52.116 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.117 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.24796.0:54255 7.7 e117/113 7:e2736b21:::benchmark_data_smithi097_93198_object54254:head v 117'3373, mlcod=0'0)", 2021-10-08T19:27:52.117 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:24:32.775912+0000", 2021-10-08T19:27:52.117 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 199.33647513099999, 2021-10-08T19:27:52.117 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.022201235, 2021-10-08T19:27:52.118 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:27:52.118 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:52.118 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:27:52.118 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.119 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:27:52.119 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:32.775912+0000", 2021-10-08T19:27:52.119 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:52.119 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.119 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.120 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:27:52.120 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:32.775912+0000", 2021-10-08T19:27:52.120 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:52.120 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.120 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.121 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:27:52.121 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:32.775910+0000", 2021-10-08T19:27:52.121 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:27:52.121 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.122 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.122 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:27:52.122 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:32.775953+0000", 2021-10-08T19:27:52.122 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.3034999999999997e-05 2021-10-08T19:27:52.123 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.123 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.123 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:27:52.123 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:32.775969+0000", 2021-10-08T19:27:52.124 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6867e-05 2021-10-08T19:27:52.124 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.124 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.124 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:27:52.124 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:32.775977+0000", 2021-10-08T19:27:52.125 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1430000000000001e-06 2021-10-08T19:27:52.125 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.125 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.126 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:27:52.126 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:32.782053+0000", 2021-10-08T19:27:52.126 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0060765020000000001 2021-10-08T19:27:52.126 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.126 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.127 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:27:52.127 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:32.782077+0000", 2021-10-08T19:27:52.127 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4314000000000001e-05 2021-10-08T19:27:52.127 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.128 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.128 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:27:52.128 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:32.798077+0000", 2021-10-08T19:27:52.128 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015999093999999998 2021-10-08T19:27:52.128 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.129 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.129 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:27:52.129 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:32.798113+0000", 2021-10-08T19:27:52.129 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6449999999999998e-05 2021-10-08T19:27:52.130 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:52.130 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:27:52.130 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:52.130 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.130 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.131 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDPGPush(7.d 121/113 [PushOp(7:b39ed270:::benchmark_data_smithi097_93198_object2856:head, version: 99'171, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(7:b39ed270:::benchmark_data_smithi097_93198_object2856:head@99'171, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2021-10-08T19:27:52.131 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:24:41.584062+0000", 2021-10-08T19:27:52.131 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 190.528325274, 2021-10-08T19:27:52.131 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024286617999999999, 2021-10-08T19:27:52.132 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:27:52.132 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2021-10-08T19:27:52.132 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:27:52.132 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.133 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:27:52.133 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:41.584062+0000", 2021-10-08T19:27:52.133 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:52.134 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.134 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.134 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:27:52.134 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:41.584062+0000", 2021-10-08T19:27:52.135 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:52.135 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.136 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.136 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:27:52.136 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:41.584060+0000", 2021-10-08T19:27:52.136 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:27:52.136 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.137 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.137 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:27:52.137 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:41.606669+0000", 2021-10-08T19:27:52.137 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.022608539 2021-10-08T19:27:52.138 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.138 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.138 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:27:52.138 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:41.606690+0000", 2021-10-08T19:27:52.138 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1061e-05 2021-10-08T19:27:52.139 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.139 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.139 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:27:52.139 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:41.606700+0000", 2021-10-08T19:27:52.140 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0444e-05 2021-10-08T19:27:52.140 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.140 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.141 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:27:52.141 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:41.606797+0000", 2021-10-08T19:27:52.141 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6458000000000004e-05 2021-10-08T19:27:52.141 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.141 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.142 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:27:52.142 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:41.606806+0000", 2021-10-08T19:27:52.142 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3419999999999997e-06 2021-10-08T19:27:52.142 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.143 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.143 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:27:52.143 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:41.608348+0000", 2021-10-08T19:27:52.143 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0015423290000000001 2021-10-08T19:27:52.143 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:52.144 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:27:52.144 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:52.144 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.144 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.145 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.24796.0:74043 7.b e127/113 7:d7d1f795:::benchmark_data_smithi097_93198_object74042:head v 127'4666, mlcod=0'0)", 2021-10-08T19:27:52.145 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:24:58.122392+0000", 2021-10-08T19:27:52.145 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 173.98999505699999, 2021-10-08T19:27:52.145 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.034343422999999998, 2021-10-08T19:27:52.146 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:27:52.146 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:52.146 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:27:52.146 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.147 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:27:52.147 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.122392+0000", 2021-10-08T19:27:52.147 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:52.147 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.148 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.148 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:27:52.148 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.122392+0000", 2021-10-08T19:27:52.148 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:52.148 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.149 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.149 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:27:52.149 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.122390+0000", 2021-10-08T19:27:52.149 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:27:52.150 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.150 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.150 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:27:52.150 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.122439+0000", 2021-10-08T19:27:52.150 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9119999999999997e-05 2021-10-08T19:27:52.151 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.151 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.151 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:27:52.151 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.122454+0000", 2021-10-08T19:27:52.152 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4956999999999999e-05 2021-10-08T19:27:52.152 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.152 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.152 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:27:52.152 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.122471+0000", 2021-10-08T19:27:52.153 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7472000000000001e-05 2021-10-08T19:27:52.153 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.153 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.153 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:27:52.153 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.122535+0000", 2021-10-08T19:27:52.154 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3266e-05 2021-10-08T19:27:52.154 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.154 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.154 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:27:52.154 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.122565+0000", 2021-10-08T19:27:52.155 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.0173000000000001e-05 2021-10-08T19:27:52.155 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.155 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.155 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:27:52.156 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.156690+0000", 2021-10-08T19:27:52.156 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.034125569000000001 2021-10-08T19:27:52.156 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.157 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.157 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:27:52.157 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.156735+0000", 2021-10-08T19:27:52.157 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4959000000000001e-05 2021-10-08T19:27:52.158 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:52.158 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:27:52.158 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:52.158 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.159 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.159 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.24796.0:74047 7.b e127/113 7:d55a3c85:::benchmark_data_smithi097_93198_object74046:head v 127'4667, mlcod=0'0)", 2021-10-08T19:27:52.159 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:24:58.122498+0000", 2021-10-08T19:27:52.160 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 173.989889089, 2021-10-08T19:27:52.160 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.034262069999999999, 2021-10-08T19:27:52.160 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:27:52.161 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:52.161 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:27:52.161 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.161 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:27:52.162 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.122498+0000", 2021-10-08T19:27:52.162 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:52.162 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.162 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.162 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:27:52.163 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.122498+0000", 2021-10-08T19:27:52.163 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:52.163 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.163 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.164 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:27:52.164 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.122497+0000", 2021-10-08T19:27:52.164 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:27:52.164 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.164 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.165 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:27:52.165 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.122547+0000", 2021-10-08T19:27:52.165 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9495e-05 2021-10-08T19:27:52.165 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.166 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.166 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:27:52.166 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.122553+0000", 2021-10-08T19:27:52.166 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4590000000000003e-06 2021-10-08T19:27:52.166 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.167 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.167 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:27:52.167 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.122558+0000", 2021-10-08T19:27:52.167 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2000000000000002e-06 2021-10-08T19:27:52.168 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.168 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.168 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:27:52.168 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.126762+0000", 2021-10-08T19:27:52.168 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042036729999999998 2021-10-08T19:27:52.169 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.169 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.169 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:27:52.169 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.126791+0000", 2021-10-08T19:27:52.170 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8668000000000001e-05 2021-10-08T19:27:52.170 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.170 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.170 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:27:52.170 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.156740+0000", 2021-10-08T19:27:52.171 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.029949818999999999 2021-10-08T19:27:52.171 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.171 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.171 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:27:52.172 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.156760+0000", 2021-10-08T19:27:52.172 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9521000000000002e-05 2021-10-08T19:27:52.172 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:52.172 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:27:52.172 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:52.173 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.173 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.173 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.24796.0:74048 7.b e127/113 7:df948758:::benchmark_data_smithi097_93198_object74047:head v 127'4668, mlcod=0'0)", 2021-10-08T19:27:52.173 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:24:58.122566+0000", 2021-10-08T19:27:52.173 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 173.98982124099999, 2021-10-08T19:27:52.174 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.034211536000000001, 2021-10-08T19:27:52.174 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:27:52.174 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:52.174 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:27:52.175 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.175 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:27:52.175 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.122566+0000", 2021-10-08T19:27:52.175 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:52.175 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.176 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.176 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:27:52.176 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.122566+0000", 2021-10-08T19:27:52.176 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:52.177 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.177 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.177 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:27:52.177 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.122565+0000", 2021-10-08T19:27:52.177 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999995 2021-10-08T19:27:52.178 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.178 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.178 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:27:52.178 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.122594+0000", 2021-10-08T19:27:52.179 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8524e-05 2021-10-08T19:27:52.179 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.179 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.179 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:27:52.179 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.122601+0000", 2021-10-08T19:27:52.180 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.7810000000000005e-06 2021-10-08T19:27:52.180 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.180 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.180 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:27:52.181 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.122605+0000", 2021-10-08T19:27:52.181 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.704e-06 2021-10-08T19:27:52.181 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.181 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.181 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:27:52.182 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.132443+0000", 2021-10-08T19:27:52.182 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0098380459999999996 2021-10-08T19:27:52.182 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.182 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.183 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:27:52.183 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.132480+0000", 2021-10-08T19:27:52.183 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6508999999999999e-05 2021-10-08T19:27:52.183 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.183 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.184 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:27:52.184 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.156763+0000", 2021-10-08T19:27:52.184 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024282965 2021-10-08T19:27:52.184 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.184 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.185 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:27:52.185 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.156777+0000", 2021-10-08T19:27:52.185 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4591e-05 2021-10-08T19:27:52.185 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:52.186 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:27:52.186 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:52.186 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.186 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.186 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.24796.0:74049 7.7 e127/113 7:e4e21bd9:::benchmark_data_smithi097_93198_object74048:head v 127'4553, mlcod=0'0)", 2021-10-08T19:27:52.187 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:24:58.126357+0000", 2021-10-08T19:27:52.187 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 173.986029704, 2021-10-08T19:27:52.187 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025566160000000001, 2021-10-08T19:27:52.187 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:27:52.188 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:52.188 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:27:52.188 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.188 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:27:52.189 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.126357+0000", 2021-10-08T19:27:52.189 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:52.189 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.189 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.189 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:27:52.190 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.126357+0000", 2021-10-08T19:27:52.190 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:52.190 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.190 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.191 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:27:52.191 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.126355+0000", 2021-10-08T19:27:52.191 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:27:52.191 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.192 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.192 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:27:52.192 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.126418+0000", 2021-10-08T19:27:52.192 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3208999999999997e-05 2021-10-08T19:27:52.192 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.193 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.193 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:27:52.193 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.126442+0000", 2021-10-08T19:27:52.193 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4428999999999999e-05 2021-10-08T19:27:52.193 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.194 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.194 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:27:52.194 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.126453+0000", 2021-10-08T19:27:52.194 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0597e-05 2021-10-08T19:27:52.194 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.195 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.195 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:27:52.195 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.126580+0000", 2021-10-08T19:27:52.195 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000126585 2021-10-08T19:27:52.195 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.196 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.196 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:27:52.196 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.126604+0000", 2021-10-08T19:27:52.196 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4601e-05 2021-10-08T19:27:52.197 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.197 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.197 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:27:52.197 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.151878+0000", 2021-10-08T19:27:52.197 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025274181 2021-10-08T19:27:52.198 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.198 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.198 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:27:52.198 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.151923+0000", 2021-10-08T19:27:52.199 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4872e-05 2021-10-08T19:27:52.199 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:52.199 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:27:52.199 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:52.200 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.200 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.200 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.24796.0:74050 7.7 e127/113 7:ebbf5bd4:::benchmark_data_smithi097_93198_object74049:head v 127'4554, mlcod=0'0)", 2021-10-08T19:27:52.200 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:24:58.126480+0000", 2021-10-08T19:27:52.200 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 173.985906551, 2021-10-08T19:27:52.201 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025464667999999999, 2021-10-08T19:27:52.201 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:27:52.201 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:52.201 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:27:52.202 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.202 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:27:52.202 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.126480+0000", 2021-10-08T19:27:52.203 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:52.203 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.203 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.203 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:27:52.203 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.126480+0000", 2021-10-08T19:27:52.204 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:52.204 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.204 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.204 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:27:52.204 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.126479+0000", 2021-10-08T19:27:52.205 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:27:52.205 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.205 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.205 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:27:52.206 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.126515+0000", 2021-10-08T19:27:52.206 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.5769000000000003e-05 2021-10-08T19:27:52.206 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.206 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.206 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:27:52.207 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.126523+0000", 2021-10-08T19:27:52.207 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3270000000000003e-06 2021-10-08T19:27:52.207 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.207 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.207 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:27:52.208 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.126527+0000", 2021-10-08T19:27:52.208 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.493e-06 2021-10-08T19:27:52.208 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.208 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.208 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:27:52.209 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.134475+0000", 2021-10-08T19:27:52.209 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0079475359999999998 2021-10-08T19:27:52.209 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.209 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.209 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:27:52.210 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.134505+0000", 2021-10-08T19:27:52.210 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.0821000000000002e-05 2021-10-08T19:27:52.210 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.210 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.211 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:27:52.211 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.151928+0000", 2021-10-08T19:27:52.211 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017422296 2021-10-08T19:27:52.211 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.211 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.212 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:27:52.212 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.151945+0000", 2021-10-08T19:27:52.212 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7292e-05 2021-10-08T19:27:52.212 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:52.212 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:27:52.213 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:52.213 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.213 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.213 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.24796.0:74053 7.b e127/113 7:d23bcc00:::benchmark_data_smithi097_93198_object74052:head v 127'4669, mlcod=0'0)", 2021-10-08T19:27:52.213 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:24:58.127733+0000", 2021-10-08T19:27:52.214 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 173.98465341599999, 2021-10-08T19:27:52.214 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.029060559999999999, 2021-10-08T19:27:52.214 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:27:52.214 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:52.214 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:27:52.215 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.215 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:27:52.215 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.127733+0000", 2021-10-08T19:27:52.215 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:52.216 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.216 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.216 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:27:52.216 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.127733+0000", 2021-10-08T19:27:52.216 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:52.217 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.217 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.217 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:27:52.217 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.127732+0000", 2021-10-08T19:27:52.218 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:27:52.218 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.218 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.218 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:27:52.218 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.127780+0000", 2021-10-08T19:27:52.219 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8437999999999999e-05 2021-10-08T19:27:52.219 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.219 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.219 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:27:52.220 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.127796+0000", 2021-10-08T19:27:52.220 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5540999999999999e-05 2021-10-08T19:27:52.220 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.220 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.220 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:27:52.221 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.127802+0000", 2021-10-08T19:27:52.221 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7730000000000002e-06 2021-10-08T19:27:52.221 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.221 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.221 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:27:52.222 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.137566+0000", 2021-10-08T19:27:52.222 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097634899999999997 2021-10-08T19:27:52.222 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.222 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.223 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:27:52.223 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.137589+0000", 2021-10-08T19:27:52.223 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3470000000000001e-05 2021-10-08T19:27:52.223 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.224 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.224 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:27:52.224 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.156779+0000", 2021-10-08T19:27:52.224 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019189741 2021-10-08T19:27:52.224 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.225 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.225 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:27:52.225 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.156794+0000", 2021-10-08T19:27:52.225 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4829e-05 2021-10-08T19:27:52.225 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:52.226 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:27:52.226 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:52.226 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.226 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.227 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.24796.0:74058 7.b e127/113 7:d0ebe182:::benchmark_data_smithi097_93198_object74057:head v 127'4670, mlcod=0'0)", 2021-10-08T19:27:52.227 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:24:58.132389+0000", 2021-10-08T19:27:52.227 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 173.979997408, 2021-10-08T19:27:52.227 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024421282999999998, 2021-10-08T19:27:52.227 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:27:52.228 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:52.228 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:27:52.228 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.228 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:27:52.229 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.132389+0000", 2021-10-08T19:27:52.229 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:52.229 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.229 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.229 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:27:52.230 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.132389+0000", 2021-10-08T19:27:52.230 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:52.230 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.230 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.231 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:27:52.231 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.132383+0000", 2021-10-08T19:27:52.231 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999933 2021-10-08T19:27:52.231 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.231 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.232 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:27:52.232 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.132435+0000", 2021-10-08T19:27:52.232 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2559000000000003e-05 2021-10-08T19:27:52.232 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.233 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.233 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:27:52.233 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.132447+0000", 2021-10-08T19:27:52.233 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1601e-05 2021-10-08T19:27:52.233 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.234 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.234 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:27:52.234 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.132455+0000", 2021-10-08T19:27:52.234 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6070000000000002e-06 2021-10-08T19:27:52.235 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.235 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.235 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:27:52.235 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.145280+0000", 2021-10-08T19:27:52.235 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012825968 2021-10-08T19:27:52.236 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.236 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.236 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:27:52.236 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.145311+0000", 2021-10-08T19:27:52.237 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.0260000000000002e-05 2021-10-08T19:27:52.237 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.237 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.237 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:27:52.237 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.156796+0000", 2021-10-08T19:27:52.238 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011485165 2021-10-08T19:27:52.238 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.238 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.238 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:27:52.239 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:58.156811+0000", 2021-10-08T19:27:52.239 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4837e-05 2021-10-08T19:27:52.239 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:52.239 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:27:52.239 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:52.240 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.240 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.240 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.24796.0:90410 7.b e135/113 7:db1871c2:::benchmark_data_smithi097_93198_object90409:head v 135'5688, mlcod=0'0)", 2021-10-08T19:27:52.240 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:25:21.347505+0000", 2021-10-08T19:27:52.241 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 150.76488178400001, 2021-10-08T19:27:52.241 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.022062904000000001, 2021-10-08T19:27:52.241 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:27:52.241 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:52.241 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:27:52.242 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.242 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:27:52.242 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:21.347505+0000", 2021-10-08T19:27:52.242 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:52.242 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.243 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.243 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:27:52.243 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:21.347505+0000", 2021-10-08T19:27:52.243 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:52.244 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.244 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.244 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:27:52.244 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:21.347503+0000", 2021-10-08T19:27:52.245 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:27:52.245 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.245 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.245 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:27:52.246 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:21.347539+0000", 2021-10-08T19:27:52.246 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6177999999999998e-05 2021-10-08T19:27:52.246 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.246 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.247 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:27:52.247 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:21.347560+0000", 2021-10-08T19:27:52.247 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0593000000000001e-05 2021-10-08T19:27:52.247 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.247 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.248 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:27:52.248 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:21.347580+0000", 2021-10-08T19:27:52.248 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0537e-05 2021-10-08T19:27:52.248 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.248 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.249 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:27:52.249 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:21.349923+0000", 2021-10-08T19:27:52.249 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0023431200000000002 2021-10-08T19:27:52.249 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.250 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.250 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:27:52.250 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:21.350293+0000", 2021-10-08T19:27:52.250 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00036932000000000002 2021-10-08T19:27:52.250 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.251 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.251 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:27:52.251 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:21.369529+0000", 2021-10-08T19:27:52.251 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019236601999999998 2021-10-08T19:27:52.251 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.252 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.252 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:27:52.252 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:21.369568+0000", 2021-10-08T19:27:52.252 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8668999999999999e-05 2021-10-08T19:27:52.253 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:52.253 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:27:52.253 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:52.253 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.253 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.254 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.24796.0:101074 7.b e139/113 7:dfb065fe:::benchmark_data_smithi097_93198_object9254:head v 139'6346, mlcod=0'0)", 2021-10-08T19:27:52.254 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:25:35.739020+0000", 2021-10-08T19:27:52.254 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 136.37336696700001, 2021-10-08T19:27:52.254 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026592529, 2021-10-08T19:27:52.254 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:27:52.255 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:52.255 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:27:52.255 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.255 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:27:52.255 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:35.739020+0000", 2021-10-08T19:27:52.256 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:52.256 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.256 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.256 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:27:52.257 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:35.739020+0000", 2021-10-08T19:27:52.257 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:52.257 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.257 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.257 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:27:52.258 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:35.739018+0000", 2021-10-08T19:27:52.258 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:27:52.258 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.258 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.259 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:27:52.259 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:35.739029+0000", 2021-10-08T19:27:52.259 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0433e-05 2021-10-08T19:27:52.259 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.259 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.260 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:27:52.260 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:35.739044+0000", 2021-10-08T19:27:52.260 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5227e-05 2021-10-08T19:27:52.260 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.261 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.261 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:27:52.261 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:35.739051+0000", 2021-10-08T19:27:52.261 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.9739999999999996e-06 2021-10-08T19:27:52.261 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.262 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.262 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:27:52.262 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:35.739103+0000", 2021-10-08T19:27:52.262 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2333000000000002e-05 2021-10-08T19:27:52.262 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.263 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.263 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:27:52.263 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:35.739137+0000", 2021-10-08T19:27:52.263 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.3869999999999999e-05 2021-10-08T19:27:52.264 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.264 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.264 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:27:52.264 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:35.765554+0000", 2021-10-08T19:27:52.264 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026417077000000001 2021-10-08T19:27:52.265 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.265 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.265 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:27:52.265 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:35.765612+0000", 2021-10-08T19:27:52.265 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8273000000000003e-05 2021-10-08T19:27:52.266 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:52.266 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:27:52.266 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:52.266 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.266 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.267 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.24796.0:103678 7.b e141/113 7:d3673ed4:::benchmark_data_smithi097_93198_object11858:head v 141'6543, mlcod=0'0)", 2021-10-08T19:27:52.267 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:25:39.164275+0000", 2021-10-08T19:27:52.267 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 132.94811136499999, 2021-10-08T19:27:52.267 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.022926808, 2021-10-08T19:27:52.268 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:27:52.268 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:52.268 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:27:52.268 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.268 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:27:52.269 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:39.164275+0000", 2021-10-08T19:27:52.269 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:52.269 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.269 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.269 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:27:52.270 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:39.164275+0000", 2021-10-08T19:27:52.270 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:52.270 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.270 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.271 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:27:52.271 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:39.164275+0000", 2021-10-08T19:27:52.271 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999995 2021-10-08T19:27:52.271 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.271 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.272 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:27:52.272 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:39.164282+0000", 2021-10-08T19:27:52.272 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0119999999999999e-06 2021-10-08T19:27:52.272 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.272 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.273 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:27:52.273 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:39.164287+0000", 2021-10-08T19:27:52.273 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4290000000000003e-06 2021-10-08T19:27:52.273 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.273 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.274 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:27:52.274 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:39.164290+0000", 2021-10-08T19:27:52.274 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.1750000000000001e-06 2021-10-08T19:27:52.274 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.275 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.275 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:27:52.275 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:39.174237+0000", 2021-10-08T19:27:52.275 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099475120000000004 2021-10-08T19:27:52.275 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.276 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.276 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:27:52.276 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:39.174265+0000", 2021-10-08T19:27:52.276 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7830999999999998e-05 2021-10-08T19:27:52.276 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.277 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.277 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:27:52.277 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:39.187173+0000", 2021-10-08T19:27:52.277 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012907843 2021-10-08T19:27:52.277 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.278 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.278 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:27:52.278 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:39.187202+0000", 2021-10-08T19:27:52.278 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9312e-05 2021-10-08T19:27:52.279 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:52.279 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:27:52.279 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:52.279 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.279 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.280 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.24796.0:111305 7.1 e144/113 7:890faa7f:::benchmark_data_smithi097_93198_object19485:head v 144'6911, mlcod=99'544)", 2021-10-08T19:27:52.280 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:25:49.816529+0000", 2021-10-08T19:27:52.280 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 122.29585752600001, 2021-10-08T19:27:52.280 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025538590999999999, 2021-10-08T19:27:52.280 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:27:52.281 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:52.281 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:27:52.281 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.281 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:27:52.281 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:49.816529+0000", 2021-10-08T19:27:52.282 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:52.282 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.282 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.282 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:27:52.283 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:49.816529+0000", 2021-10-08T19:27:52.283 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:52.283 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.283 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.283 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:27:52.284 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:49.816527+0000", 2021-10-08T19:27:52.284 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999971 2021-10-08T19:27:52.284 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.284 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.284 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:27:52.285 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:49.816539+0000", 2021-10-08T19:27:52.285 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2852e-05 2021-10-08T19:27:52.285 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.285 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.285 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:27:52.286 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:49.816559+0000", 2021-10-08T19:27:52.286 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.98e-05 2021-10-08T19:27:52.286 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.286 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.287 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:27:52.287 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:49.816567+0000", 2021-10-08T19:27:52.287 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.401e-06 2021-10-08T19:27:52.287 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.287 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.288 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:27:52.288 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:49.816612+0000", 2021-10-08T19:27:52.288 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4999000000000001e-05 2021-10-08T19:27:52.288 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.288 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.289 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:27:52.289 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:49.816635+0000", 2021-10-08T19:27:52.289 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3794e-05 2021-10-08T19:27:52.289 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.290 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.290 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:27:52.290 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:49.842032+0000", 2021-10-08T19:27:52.290 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025396734000000001 2021-10-08T19:27:52.291 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.291 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.291 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:27:52.291 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:49.842068+0000", 2021-10-08T19:27:52.291 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.5815000000000002e-05 2021-10-08T19:27:52.292 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:52.292 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:27:52.292 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:52.292 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.292 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.293 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.24796.0:111309 7.1 e144/113 7:8d682c8e:::benchmark_data_smithi097_93198_object19489:head v 144'6912, mlcod=99'544)", 2021-10-08T19:27:52.293 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:25:49.822253+0000", 2021-10-08T19:27:52.293 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 122.29013428, 2021-10-08T19:27:52.293 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.027741508000000002, 2021-10-08T19:27:52.294 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:27:52.294 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:52.294 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:27:52.294 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.294 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:27:52.295 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:49.822253+0000", 2021-10-08T19:27:52.295 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:52.295 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.295 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.296 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:27:52.296 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:49.822253+0000", 2021-10-08T19:27:52.296 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:52.296 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.296 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.297 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:27:52.297 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:49.822251+0000", 2021-10-08T19:27:52.297 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:27:52.297 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.298 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.298 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:27:52.298 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:49.822264+0000", 2021-10-08T19:27:52.298 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3386e-05 2021-10-08T19:27:52.299 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.299 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.299 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:27:52.299 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:49.822285+0000", 2021-10-08T19:27:52.299 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0460000000000001e-05 2021-10-08T19:27:52.300 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.300 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.300 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:27:52.300 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:49.822302+0000", 2021-10-08T19:27:52.300 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7609999999999999e-05 2021-10-08T19:27:52.301 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.301 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.301 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:27:52.301 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:49.838283+0000", 2021-10-08T19:27:52.302 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015980699000000001 2021-10-08T19:27:52.302 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.302 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.302 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:27:52.302 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:49.838307+0000", 2021-10-08T19:27:52.303 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3921e-05 2021-10-08T19:27:52.303 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.303 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.303 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:27:52.304 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:49.849851+0000", 2021-10-08T19:27:52.304 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011544400999999999 2021-10-08T19:27:52.304 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.304 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.304 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:27:52.305 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:49.849994+0000", 2021-10-08T19:27:52.305 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014264099999999999 2021-10-08T19:27:52.305 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:52.305 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:27:52.306 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:52.306 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.306 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.306 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.24796.0:116139 7.1 e145/113 7:846de5f5:::benchmark_data_smithi097_93198_object24319:head v 145'7215, mlcod=99'544)", 2021-10-08T19:27:52.306 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:25:56.517167+0000", 2021-10-08T19:27:52.307 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 115.595220008, 2021-10-08T19:27:52.307 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.022624699000000002, 2021-10-08T19:27:52.307 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:27:52.307 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:52.307 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:27:52.308 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.308 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:27:52.308 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:56.517167+0000", 2021-10-08T19:27:52.308 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:52.309 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.309 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.309 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:27:52.309 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:56.517167+0000", 2021-10-08T19:27:52.309 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:52.310 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.310 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.310 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:27:52.310 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:56.517164+0000", 2021-10-08T19:27:52.310 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:27:52.311 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.311 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.311 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:27:52.311 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:56.517178+0000", 2021-10-08T19:27:52.312 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4185000000000001e-05 2021-10-08T19:27:52.312 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.312 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.312 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:27:52.312 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:56.517198+0000", 2021-10-08T19:27:52.313 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9686000000000001e-05 2021-10-08T19:27:52.313 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.313 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.313 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:27:52.314 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:56.517207+0000", 2021-10-08T19:27:52.314 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.1290000000000002e-06 2021-10-08T19:27:52.314 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.314 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.314 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:27:52.315 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:56.517272+0000", 2021-10-08T19:27:52.315 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4681e-05 2021-10-08T19:27:52.315 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.315 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.315 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:27:52.316 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:56.517291+0000", 2021-10-08T19:27:52.316 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8907e-05 2021-10-08T19:27:52.316 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.316 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.317 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:27:52.317 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:56.539766+0000", 2021-10-08T19:27:52.317 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.022474958999999999 2021-10-08T19:27:52.317 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.317 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.318 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:27:52.318 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:56.539792+0000", 2021-10-08T19:27:52.318 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5729e-05 2021-10-08T19:27:52.318 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:52.318 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:27:52.319 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:52.319 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.319 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.319 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.24796.0:116142 7.d e145/113 7:b1f7fa45:::benchmark_data_smithi097_93198_object24322:head v 145'7327, mlcod=99'464)", 2021-10-08T19:27:52.320 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:25:56.517206+0000", 2021-10-08T19:27:52.320 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 115.595181035, 2021-10-08T19:27:52.320 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.028705933999999999, 2021-10-08T19:27:52.320 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:27:52.320 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:52.321 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:27:52.321 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.321 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:27:52.321 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:56.517206+0000", 2021-10-08T19:27:52.322 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:52.322 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.322 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.322 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:27:52.322 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:56.517206+0000", 2021-10-08T19:27:52.323 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:52.323 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.323 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.323 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:27:52.323 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:56.517204+0000", 2021-10-08T19:27:52.324 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:27:52.324 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.324 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.324 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:27:52.324 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:56.517218+0000", 2021-10-08T19:27:52.325 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.379e-05 2021-10-08T19:27:52.325 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.325 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.325 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:27:52.326 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:56.517231+0000", 2021-10-08T19:27:52.326 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2873e-05 2021-10-08T19:27:52.326 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.326 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.326 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:27:52.327 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:56.517237+0000", 2021-10-08T19:27:52.327 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.144e-06 2021-10-08T19:27:52.327 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.327 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.327 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:27:52.328 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:56.517297+0000", 2021-10-08T19:27:52.328 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9901000000000001e-05 2021-10-08T19:27:52.328 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.328 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.328 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:27:52.329 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:56.517322+0000", 2021-10-08T19:27:52.329 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5204000000000001e-05 2021-10-08T19:27:52.329 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.329 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.330 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:27:52.330 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:56.545855+0000", 2021-10-08T19:27:52.330 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.028532716999999999 2021-10-08T19:27:52.330 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.330 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.331 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:27:52.331 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:56.545912+0000", 2021-10-08T19:27:52.331 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7058999999999997e-05 2021-10-08T19:27:52.331 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:52.331 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:27:52.332 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:52.332 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.332 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.332 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.24796.0:116133 7.7 e145/113 7:e44cf61a:::benchmark_data_smithi097_93198_object24313:head v 145'7169, mlcod=0'0)", 2021-10-08T19:27:52.332 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:25:56.517672+0000", 2021-10-08T19:27:52.333 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 115.594714752, 2021-10-08T19:27:52.333 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.022058359999999999, 2021-10-08T19:27:52.333 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:27:52.333 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:52.334 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:27:52.334 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.334 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:27:52.334 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:56.517672+0000", 2021-10-08T19:27:52.334 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:52.335 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.335 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.335 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:27:52.335 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:56.517672+0000", 2021-10-08T19:27:52.335 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:52.336 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.336 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.336 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:27:52.336 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:56.517671+0000", 2021-10-08T19:27:52.336 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:27:52.337 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.337 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.337 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:27:52.337 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:56.517680+0000", 2021-10-08T19:27:52.338 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9730000000000003e-06 2021-10-08T19:27:52.338 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.338 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.338 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:27:52.338 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:56.517695+0000", 2021-10-08T19:27:52.339 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5458999999999999e-05 2021-10-08T19:27:52.339 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.339 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.339 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:27:52.339 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:56.517701+0000", 2021-10-08T19:27:52.340 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0750000000000003e-06 2021-10-08T19:27:52.340 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.340 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.340 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:27:52.341 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:56.517775+0000", 2021-10-08T19:27:52.341 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3570000000000002e-05 2021-10-08T19:27:52.341 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.341 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.341 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:27:52.342 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:56.517819+0000", 2021-10-08T19:27:52.342 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4727000000000001e-05 2021-10-08T19:27:52.342 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.342 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.343 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:27:52.343 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:56.539692+0000", 2021-10-08T19:27:52.343 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.021872503000000001 2021-10-08T19:27:52.343 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.343 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.344 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:27:52.344 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:56.539730+0000", 2021-10-08T19:27:52.344 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8571000000000001e-05 2021-10-08T19:27:52.344 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:52.344 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:27:52.345 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:52.345 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.345 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.345 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.24796.0:116154 7.c e145/113 7:3bcd1d90:::benchmark_data_smithi097_93198_object24334:head v 145'7146, mlcod=99'860)", 2021-10-08T19:27:52.346 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:25:56.542209+0000", 2021-10-08T19:27:52.346 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 115.57017748299999, 2021-10-08T19:27:52.346 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.022161087999999999, 2021-10-08T19:27:52.346 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:27:52.346 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:52.347 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:27:52.347 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.347 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:27:52.347 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:56.542209+0000", 2021-10-08T19:27:52.348 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:52.348 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.348 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.348 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:27:52.348 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:56.542209+0000", 2021-10-08T19:27:52.349 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:52.349 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.349 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.349 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:27:52.349 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:56.542205+0000", 2021-10-08T19:27:52.350 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999952 2021-10-08T19:27:52.350 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.350 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.350 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:27:52.350 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:56.542219+0000", 2021-10-08T19:27:52.351 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4823e-05 2021-10-08T19:27:52.351 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.351 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.351 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:27:52.352 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:56.542234+0000", 2021-10-08T19:27:52.352 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4949999999999999e-05 2021-10-08T19:27:52.352 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.352 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.352 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:27:52.353 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:56.542242+0000", 2021-10-08T19:27:52.353 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1149999999999996e-06 2021-10-08T19:27:52.353 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.353 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.353 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:27:52.354 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:56.542304+0000", 2021-10-08T19:27:52.354 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2589999999999995e-05 2021-10-08T19:27:52.354 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.354 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.354 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:27:52.355 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:56.542329+0000", 2021-10-08T19:27:52.355 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5160999999999998e-05 2021-10-08T19:27:52.355 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.355 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.356 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:27:52.356 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:56.564333+0000", 2021-10-08T19:27:52.356 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.022003416000000001 2021-10-08T19:27:52.356 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.356 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.357 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:27:52.357 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:56.564370+0000", 2021-10-08T19:27:52.357 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7778000000000003e-05 2021-10-08T19:27:52.357 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:52.357 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:27:52.358 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:52.358 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.358 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.358 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.24796.0:143137 7.b e153/113 7:dacb72dc:::benchmark_data_smithi097_93198_object51317:head v 153'8968, mlcod=0'0)", 2021-10-08T19:27:52.358 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:26:33.095394+0000", 2021-10-08T19:27:52.359 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 79.016993318000004, 2021-10-08T19:27:52.359 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.022029265999999999, 2021-10-08T19:27:52.359 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:27:52.359 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:52.360 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:27:52.360 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.360 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:27:52.360 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:33.095394+0000", 2021-10-08T19:27:52.360 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:52.361 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.361 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.361 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:27:52.361 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:33.095394+0000", 2021-10-08T19:27:52.361 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:52.362 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.362 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.362 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:27:52.362 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:33.095392+0000", 2021-10-08T19:27:52.362 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:27:52.363 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.363 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.363 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:27:52.363 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:33.095400+0000", 2021-10-08T19:27:52.364 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0800000000000006e-06 2021-10-08T19:27:52.364 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.364 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.364 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:27:52.364 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:33.095413+0000", 2021-10-08T19:27:52.365 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3081999999999999e-05 2021-10-08T19:27:52.365 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.365 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.365 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:27:52.365 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:33.095420+0000", 2021-10-08T19:27:52.366 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7789999999999998e-06 2021-10-08T19:27:52.366 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.366 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.366 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:27:52.366 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:33.105651+0000", 2021-10-08T19:27:52.367 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010230550999999999 2021-10-08T19:27:52.367 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.367 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.367 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:27:52.368 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:33.105674+0000", 2021-10-08T19:27:52.368 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3448e-05 2021-10-08T19:27:52.368 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.368 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.368 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:27:52.369 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:33.117399+0000", 2021-10-08T19:27:52.369 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011724709 2021-10-08T19:27:52.369 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.369 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.370 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:27:52.370 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:33.117423+0000", 2021-10-08T19:27:52.370 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4108999999999999e-05 2021-10-08T19:27:52.370 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:52.371 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:27:52.371 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:52.371 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.371 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.371 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.24796.0:178566 7.7 e170/113 7:e924a5a2:::benchmark_data_smithi097_93198_object86746:head v 170'11012, mlcod=0'0)", 2021-10-08T19:27:52.372 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:27:21.604702+0000", 2021-10-08T19:27:52.372 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 30.507684492999999, 2021-10-08T19:27:52.372 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026180392, 2021-10-08T19:27:52.372 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:27:52.373 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:27:52.373 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:27:52.373 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.373 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:27:52.373 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:21.604702+0000", 2021-10-08T19:27:52.374 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:52.374 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.374 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.374 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:27:52.375 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:21.604702+0000", 2021-10-08T19:27:52.375 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:27:52.375 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.375 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.375 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:27:52.376 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:21.604702+0000", 2021-10-08T19:27:52.376 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999995 2021-10-08T19:27:52.376 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.376 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.376 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:27:52.377 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:21.604710+0000", 2021-10-08T19:27:52.377 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.7200000000000006e-06 2021-10-08T19:27:52.377 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.377 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.378 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:27:52.378 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:21.604719+0000", 2021-10-08T19:27:52.378 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.1749999999999994e-06 2021-10-08T19:27:52.378 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.378 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.379 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:27:52.379 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:21.604725+0000", 2021-10-08T19:27:52.379 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5520000000000001e-06 2021-10-08T19:27:52.379 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.379 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.380 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:27:52.380 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:21.604772+0000", 2021-10-08T19:27:52.380 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.6412000000000002e-05 2021-10-08T19:27:52.380 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.381 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.381 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:27:52.381 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:21.604796+0000", 2021-10-08T19:27:52.381 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4226000000000001e-05 2021-10-08T19:27:52.381 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.382 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.382 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:27:52.382 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:21.630828+0000", 2021-10-08T19:27:52.382 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026031470000000001 2021-10-08T19:27:52.382 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:27:52.383 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:27:52.383 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:27:52.383 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:21.630883+0000", 2021-10-08T19:27:52.383 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5182000000000001e-05 2021-10-08T19:27:52.384 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:52.384 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:27:52.384 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:52.384 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:27:52.384 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:27:52.385 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:27:52.446 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:27:52.451 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:52.451 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:27:52.552 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:27:52.619 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:52.650 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:27:52.651 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:27:52 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:27:52] "GET /metrics HTTP/1.1" 200 154439 "" "Prometheus/2.18.1" 2021-10-08T19:27:52.652 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 1 16 3252 3236 202.041 202.25 0.0036149 0.00492017 2021-10-08T19:27:52.953 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:27:52.956 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:52.957 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:27:53.058 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:27:53.099 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:53.220 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:27:52 smithi097 conmon[33110]: 172.21.15.97 - - [08/Oct/2021:19:27:52] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:27:53.267 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:27:53.272 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:53.274 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:27:53.286 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2021-10-08T19:27:53.375 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:27:53.417 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:53.510 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:27:53.513 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:53.513 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:27:53.614 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:27:53.652 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 2 15 6479 6464 201.887 201.75 0.00609145 0.00494531 2021-10-08T19:27:53.659 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:53.739 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:27:53.743 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:53.744 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:27:53.770 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:27:53.846 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:27:53.885 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:53.905 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:27:53 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:27:53] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:27:54.115 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:27:54.119 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:54.119 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:27:54.142 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:27:54.143 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:27:54.143 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:27:54.163 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:27:54.198 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:27:54.219 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:53 smithi097 ceph-mon[32687]: pgmap v302: 178 pgs: 178 active+clean; 582 KiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 728 B/s rd, 0 op/s 2021-10-08T19:27:54.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:53 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:27:54.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:53 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:27:54.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:53 smithi097 ceph-mon[32687]: 172.21.15.97 - - [08/Oct/2021:19:27:52] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:27:54.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:53 smithi097 ceph-mon[41966]: pgmap v302: 178 pgs: 178 active+clean; 582 KiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 728 B/s rd, 0 op/s 2021-10-08T19:27:54.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:53 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:27:54.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:53 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:27:54.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:53 smithi097 ceph-mon[41966]: 172.21.15.97 - - [08/Oct/2021:19:27:52] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:27:54.222 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:27:54.223 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:27:54.241 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:27:54.248 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:54.264 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:27:54.265 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'false' 2021-10-08T19:27:54.266 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'false' 2021-10-08T19:27:54.266 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'false' 2021-10-08T19:27:54.266 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'false' 2021-10-08T19:27:54.267 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'false' 2021-10-08T19:27:54.267 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'false' 2021-10-08T19:27:54.267 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'false' 2021-10-08T19:27:54.267 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'false' 2021-10-08T19:27:54.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:53 smithi117 ceph-mon[34585]: pgmap v302: 178 pgs: 178 active+clean; 582 KiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 728 B/s rd, 0 op/s 2021-10-08T19:27:54.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:53 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:27:54.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:53 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:27:54.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:53 smithi117 ceph-mon[34585]: 172.21.15.97 - - [08/Oct/2021:19:27:52] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:27:54.653 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 3 16 9332 9316 193.986 178.25 0.00733239 0.00514813 2021-10-08T19:27:54.879 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:27:54.888 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:54.889 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:27:54.991 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:27:55.035 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:55.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:54 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/646060137' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:27:55.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:54 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/646060137' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:27:55.409 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:54 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/646060137' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:27:55.606 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:27:55.608 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:55.609 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:27:55.657 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 4 16 11693 11677 182.379 147.562 0.00129774 0.00538219 2021-10-08T19:27:55.712 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:27:55.755 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:55.821 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:55.824 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:27:55.825 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:27:55.927 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:27:55.982 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:56.119 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:27:56.124 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:56.124 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:27:56.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:55 smithi117 ceph-mon[34585]: pgmap v303: 178 pgs: 178 active+clean; 404 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 50 MiB/s wr, 807 op/s 2021-10-08T19:27:56.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:55 smithi097 ceph-mon[32687]: pgmap v303: 178 pgs: 178 active+clean; 404 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 50 MiB/s wr, 807 op/s 2021-10-08T19:27:56.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:55 smithi097 ceph-mon[41966]: pgmap v303: 178 pgs: 178 active+clean; 404 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 50 MiB/s wr, 807 op/s 2021-10-08T19:27:56.226 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:27:56.267 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:56.332 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:27:56.335 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:56.336 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:27:56.437 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:27:56.490 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:56.641 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:27:56.644 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:56.645 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:27:56.653 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 5 16 13918 13902 173.71 139.062 0.00211535 0.00574711 2021-10-08T19:27:56.655 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:27:56 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:27:56.745 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2021-10-08T19:27:56.745 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:27:56.746 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:27:56.784 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:56.857 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:27:56.860 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:56.861 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:27:56.963 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:27:57.009 INFO:teuthology.orchestra.run.smithi097.stderr:set 5.1d pg_upmap_items mapping to [6->1,7->4,2->3] 2021-10-08T19:27:57.009 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:57.096 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:27:57.104 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:57.104 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:27:57.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:56 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:27:57.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:56 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:27:57.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:56 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1174373606' entity='client.admin' cmd=[{"prefix": "osd pg-upmap-items", "pgid": "5.1d", "id": [6, 1, 7, 4, 2, 3]}]: dispatch 2021-10-08T19:27:57.205 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:27:57.244 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:56 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:27:57.244 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:56 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:27:57.244 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:56 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1174373606' entity='client.admin' cmd=[{"prefix": "osd pg-upmap-items", "pgid": "5.1d", "id": [6, 1, 7, 4, 2, 3]}]: dispatch 2021-10-08T19:27:57.245 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:56 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:27:57.245 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:56 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:27:57.245 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:56 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1174373606' entity='client.admin' cmd=[{"prefix": "osd pg-upmap-items", "pgid": "5.1d", "id": [6, 1, 7, 4, 2, 3]}]: dispatch 2021-10-08T19:27:57.247 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:57.653 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 6 16 16496 16480 171.611 161.125 0.00524918 0.00582042 2021-10-08T19:27:57.936 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:27:57.938 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:57.939 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:27:57.947 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2021-10-08T19:27:58.041 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:27:58.089 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:58.149 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2021-10-08T19:27:58.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:57 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:27:58.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:57 smithi097 ceph-mon[41966]: pgmap v304: 178 pgs: 178 active+clean; 404 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 45 MiB/s wr, 724 op/s 2021-10-08T19:27:58.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:57 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1174373606' entity='client.admin' cmd='[{"prefix": "osd pg-upmap-items", "pgid": "5.1d", "id": [6, 1, 7, 4, 2, 3]}]': finished 2021-10-08T19:27:58.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:57 smithi097 ceph-mon[41966]: osdmap e188: 8 total, 8 up, 8 in 2021-10-08T19:27:58.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:57 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:27:58.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:57 smithi097 ceph-mon[32687]: pgmap v304: 178 pgs: 178 active+clean; 404 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 45 MiB/s wr, 724 op/s 2021-10-08T19:27:58.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:57 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1174373606' entity='client.admin' cmd='[{"prefix": "osd pg-upmap-items", "pgid": "5.1d", "id": [6, 1, 7, 4, 2, 3]}]': finished 2021-10-08T19:27:58.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:57 smithi097 ceph-mon[32687]: osdmap e188: 8 total, 8 up, 8 in 2021-10-08T19:27:58.287 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:57 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:27:58.288 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:57 smithi117 ceph-mon[34585]: pgmap v304: 178 pgs: 178 active+clean; 404 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 45 MiB/s wr, 724 op/s 2021-10-08T19:27:58.288 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:57 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1174373606' entity='client.admin' cmd='[{"prefix": "osd pg-upmap-items", "pgid": "5.1d", "id": [6, 1, 7, 4, 2, 3]}]': finished 2021-10-08T19:27:58.289 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:57 smithi117 ceph-mon[34585]: osdmap e188: 8 total, 8 up, 8 in 2021-10-08T19:27:58.466 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:27:58.469 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:58.470 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:27:58.572 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:27:58.610 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:58.653 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 7 16 18727 18711 167.014 139.438 0.00800622 0.00598232 2021-10-08T19:27:58.708 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:27:58.755 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:27:58.762 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:58.763 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:27:58.864 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:27:58.904 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:27:58.904 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:58.971 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:27:58.974 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:58.975 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:27:59.076 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:27:59.140 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:59.249 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:27:59.252 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:59.253 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:27:59.354 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:27:59.378 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:59.418 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:27:59.420 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:59.421 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:27:59.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:59 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:27:59.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:27:59 smithi097 ceph-mon[32687]: pgmap v306: 178 pgs: 178 active+clean; 698 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 1.1 KiB/s rd, 78 MiB/s wr, 1.25k op/s 2021-10-08T19:27:59.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:59 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:27:59.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:27:59 smithi097 ceph-mon[41966]: pgmap v306: 178 pgs: 178 active+clean; 698 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 1.1 KiB/s rd, 78 MiB/s wr, 1.25k op/s 2021-10-08T19:27:59.522 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:27:59.554 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:59.617 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:27:59.620 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:59.620 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:27:59.621 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:59 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:27:59.621 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:27:59 smithi117 ceph-mon[34585]: pgmap v306: 178 pgs: 178 active+clean; 698 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 1.1 KiB/s rd, 78 MiB/s wr, 1.25k op/s 2021-10-08T19:27:59.655 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 8 16 20354 20338 158.819 101.688 0.00724642 0.00629001 2021-10-08T19:27:59.722 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:27:59.773 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:27:59.866 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:27:59.872 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:27:59.873 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:27:59.974 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:28:00.018 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:00.100 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:28:00.105 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:00.106 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:28:00.207 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:28:00.242 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:00.327 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:28:00.332 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:00.333 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:28:00.346 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is unset 2021-10-08T19:28:00.434 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:28:00.483 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:00.655 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 9 15 22559 22544 156.491 137.875 0.00726593 0.00638404 2021-10-08T19:28:00.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:00 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:28:00.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:00 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:28:00.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:00 smithi117 ceph-mon[34585]: osdmap e189: 8 total, 8 up, 8 in 2021-10-08T19:28:00.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:00 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/704298185' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:28:00.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:00 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:28:00.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:00 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:28:00.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:00 smithi097 ceph-mon[41966]: osdmap e189: 8 total, 8 up, 8 in 2021-10-08T19:28:00.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:00 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/704298185' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:28:00.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:00 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:28:00.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:00 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:28:00.724 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:00 smithi097 ceph-mon[32687]: osdmap e189: 8 total, 8 up, 8 in 2021-10-08T19:28:00.724 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:00 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/704298185' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:28:00.762 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:28:00.765 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:00.766 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:28:00.867 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:28:00.901 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:01.605 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:28:01.609 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:01.610 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:28:01.610 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:01 smithi097 ceph-mon[32687]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:28:01.611 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:01 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/704298185' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:28:01.611 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:01 smithi097 ceph-mon[32687]: osdmap e190: 8 total, 8 up, 8 in 2021-10-08T19:28:01.611 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:01 smithi097 ceph-mon[32687]: osdmap e191: 8 total, 8 up, 8 in 2021-10-08T19:28:01.611 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:01 smithi097 ceph-mon[32687]: 4.c scrub ok 2021-10-08T19:28:01.611 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:01 smithi097 ceph-mon[32687]: pgmap v310: 178 pgs: 178 active+clean; 1.1 GiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 1.2 KiB/s rd, 191 MiB/s wr, 3.06k op/s 2021-10-08T19:28:01.612 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:01 smithi097 ceph-mon[32687]: 5.12 scrub ok 2021-10-08T19:28:01.612 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:01 smithi097 ceph-mon[41966]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:28:01.612 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:01 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/704298185' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:28:01.613 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:01 smithi097 ceph-mon[41966]: osdmap e190: 8 total, 8 up, 8 in 2021-10-08T19:28:01.613 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:01 smithi097 ceph-mon[41966]: osdmap e191: 8 total, 8 up, 8 in 2021-10-08T19:28:01.613 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:01 smithi097 ceph-mon[41966]: 4.c scrub ok 2021-10-08T19:28:01.613 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:01 smithi097 ceph-mon[41966]: pgmap v310: 178 pgs: 178 active+clean; 1.1 GiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 1.2 KiB/s rd, 191 MiB/s wr, 3.06k op/s 2021-10-08T19:28:01.613 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:01 smithi097 ceph-mon[41966]: 5.12 scrub ok 2021-10-08T19:28:01.655 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 10 16 24775 24759 154.685 138.438 0.00879752 0.00645839 2021-10-08T19:28:01.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:01 smithi117 ceph-mon[34585]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:28:01.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:01 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/704298185' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:28:01.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:01 smithi117 ceph-mon[34585]: osdmap e190: 8 total, 8 up, 8 in 2021-10-08T19:28:01.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:01 smithi117 ceph-mon[34585]: osdmap e191: 8 total, 8 up, 8 in 2021-10-08T19:28:01.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:01 smithi117 ceph-mon[34585]: 4.c scrub ok 2021-10-08T19:28:01.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:01 smithi117 ceph-mon[34585]: pgmap v310: 178 pgs: 178 active+clean; 1.1 GiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 1.2 KiB/s rd, 191 MiB/s wr, 3.06k op/s 2021-10-08T19:28:01.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:01 smithi117 ceph-mon[34585]: 5.12 scrub ok 2021-10-08T19:28:01.711 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:28:01.747 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:02.044 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:28:02.048 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:02.050 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:28:02.152 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:28:02.213 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:02.243 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:28:02.281 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:28:02.305 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:28:02.310 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:02.311 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:28:02.319 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:28:02.349 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:28:02.382 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:28:02.412 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:28:02.415 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:28:02.450 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:02.456 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:28:02.498 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:28:02.505 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true' 2021-10-08T19:28:02.505 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true' 2021-10-08T19:28:02.505 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true' 2021-10-08T19:28:02.506 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true' 2021-10-08T19:28:02.506 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true' 2021-10-08T19:28:02.506 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true' 2021-10-08T19:28:02.506 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'true' 2021-10-08T19:28:02.507 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'true' 2021-10-08T19:28:02.655 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 11 16 26829 26813 152.293 128.375 0.0080152 0.00656272 2021-10-08T19:28:02.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:02 smithi117 ceph-mon[34585]: 4.a scrub ok 2021-10-08T19:28:02.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:02 smithi117 ceph-mon[34585]: 6.3 scrub ok 2021-10-08T19:28:02.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:02 smithi117 ceph-mon[34585]: 5.e scrub ok 2021-10-08T19:28:02.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:02 smithi117 ceph-mon[34585]: 6.7 scrub ok 2021-10-08T19:28:02.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:02 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2496146517' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:28:02.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:02 smithi097 ceph-mon[41966]: 4.a scrub ok 2021-10-08T19:28:02.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:02 smithi097 ceph-mon[41966]: 6.3 scrub ok 2021-10-08T19:28:02.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:02 smithi097 ceph-mon[41966]: 5.e scrub ok 2021-10-08T19:28:02.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:02 smithi097 ceph-mon[41966]: 6.7 scrub ok 2021-10-08T19:28:02.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:02 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2496146517' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:28:02.975 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:28:02 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:28:02] "GET /metrics HTTP/1.1" 200 155550 "" "Prometheus/2.18.1" 2021-10-08T19:28:02.976 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:02 smithi097 ceph-mon[32687]: 4.a scrub ok 2021-10-08T19:28:02.976 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:02 smithi097 ceph-mon[32687]: 6.3 scrub ok 2021-10-08T19:28:02.977 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:02 smithi097 ceph-mon[32687]: 5.e scrub ok 2021-10-08T19:28:02.977 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:02 smithi097 ceph-mon[32687]: 6.7 scrub ok 2021-10-08T19:28:02.978 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:02 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2496146517' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:28:03.367 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:28:03.372 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:03.372 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:28:03.473 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:28:03.501 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:03.559 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 7, 6] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2021-10-08T19:28:03.559 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2021-10-08T19:28:03.560 INFO:tasks.thrashosds.thrasher:inject_pause on 5 2021-10-08T19:28:03.560 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2021-10-08T19:28:03.560 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2021-10-08T19:28:03.561 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.5 config set filestore_inject_stall 3 2021-10-08T19:28:03.569 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:28:03.569 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2021-10-08T19:28:03.570 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2021-10-08T19:28:03.570 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2021-10-08T19:28:03.570 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:28:03.611 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:28:03.616 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:03.617 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:28:03.656 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 12 16 28767 28751 149.687 121.125 0.00841541 0.00667429 2021-10-08T19:28:03.712 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset nodeep-scrub 2021-10-08T19:28:03.717 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:28:03.758 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:03.861 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:28:03.871 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:03.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:03 smithi117 ceph-mon[34585]: 6.1f scrub ok 2021-10-08T19:28:03.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:03 smithi117 ceph-mon[34585]: 4.1f scrub ok 2021-10-08T19:28:03.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:03 smithi117 ceph-mon[34585]: pgmap v311: 178 pgs: 178 active+clean; 1.1 GiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 916 B/s rd, 137 MiB/s wr, 2.19k op/s 2021-10-08T19:28:03.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:03 smithi117 ceph-mon[34585]: 4.d scrub ok 2021-10-08T19:28:03.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:03 smithi117 ceph-mon[34585]: 5.19 scrub ok 2021-10-08T19:28:03.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:03 smithi117 ceph-mon[34585]: 2.3 scrub ok 2021-10-08T19:28:03.874 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:28:03.937 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:03 smithi097 ceph-mon[41966]: 6.1f scrub ok 2021-10-08T19:28:03.937 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:03 smithi097 ceph-mon[41966]: 4.1f scrub ok 2021-10-08T19:28:03.938 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:03 smithi097 ceph-mon[41966]: pgmap v311: 178 pgs: 178 active+clean; 1.1 GiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 916 B/s rd, 137 MiB/s wr, 2.19k op/s 2021-10-08T19:28:03.938 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:03 smithi097 ceph-mon[41966]: 4.d scrub ok 2021-10-08T19:28:03.938 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:03 smithi097 ceph-mon[41966]: 5.19 scrub ok 2021-10-08T19:28:03.938 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:03 smithi097 ceph-mon[41966]: 2.3 scrub ok 2021-10-08T19:28:03.939 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:03 smithi097 ceph-mon[32687]: 6.1f scrub ok 2021-10-08T19:28:03.939 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:03 smithi097 ceph-mon[32687]: 4.1f scrub ok 2021-10-08T19:28:03.940 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:03 smithi097 ceph-mon[32687]: pgmap v311: 178 pgs: 178 active+clean; 1.1 GiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 916 B/s rd, 137 MiB/s wr, 2.19k op/s 2021-10-08T19:28:03.940 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:03 smithi097 ceph-mon[32687]: 4.d scrub ok 2021-10-08T19:28:03.940 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:03 smithi097 ceph-mon[32687]: 5.19 scrub ok 2021-10-08T19:28:03.941 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:03 smithi097 ceph-mon[32687]: 2.3 scrub ok 2021-10-08T19:28:03.976 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:28:04.043 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:04.134 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:28:04.141 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:04.142 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:28:04.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:28:03 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:28:03] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:28:04.222 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:28:04.243 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:28:04.288 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:04.364 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:28:04.370 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:04.371 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:28:04.472 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:28:04.517 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:04.656 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 13 16 30593 30577 146.952 114.125 0.0103256 0.00679847 2021-10-08T19:28:04.766 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:28:04.769 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:28:04.775 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:04 smithi117 ceph-mon[34585]: 4.14 scrub ok 2021-10-08T19:28:04.776 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:04 smithi117 ceph-mon[34585]: 5.17 scrub ok 2021-10-08T19:28:04.777 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:04 smithi117 ceph-mon[34585]: 5.4 scrub ok 2021-10-08T19:28:04.777 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:04.778 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:28:04.779 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2021-10-08T19:28:04.880 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:28:04.925 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:04.946 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:04 smithi097 ceph-mon[41966]: 4.14 scrub ok 2021-10-08T19:28:04.946 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:04 smithi097 ceph-mon[41966]: 5.17 scrub ok 2021-10-08T19:28:04.946 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:04 smithi097 ceph-mon[41966]: 5.4 scrub ok 2021-10-08T19:28:04.947 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:04 smithi097 ceph-mon[32687]: 4.14 scrub ok 2021-10-08T19:28:04.947 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:04 smithi097 ceph-mon[32687]: 5.17 scrub ok 2021-10-08T19:28:04.947 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:04 smithi097 ceph-mon[32687]: 5.4 scrub ok 2021-10-08T19:28:04.993 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:28:04.999 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:04.999 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:28:05.100 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:28:05.145 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:05.224 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:28:05.228 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:05.229 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:28:05.330 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:28:05.370 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:05.455 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:28:05.460 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:05.461 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:28:05.563 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:28:05.601 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:05.625 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:28:05.656 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 14 16 32307 32291 144.107 107.125 0.0118803 0.00693352 2021-10-08T19:28:05.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:05 smithi117 ceph-mon[34585]: 5.2 scrub ok 2021-10-08T19:28:05.957 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:05 smithi117 ceph-mon[34585]: pgmap v312: 178 pgs: 178 active+clean; 1.8 GiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 852 B/s rd, 183 MiB/s wr, 2.94k op/s 2021-10-08T19:28:05.958 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:05 smithi117 ceph-mon[34585]: 6.1 scrub ok 2021-10-08T19:28:05.958 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:05 smithi117 ceph-mon[34585]: 5.1b scrub ok 2021-10-08T19:28:05.959 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2021-10-08T19:28:05.969 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:05 smithi097 ceph-mon[41966]: 5.2 scrub ok 2021-10-08T19:28:05.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:05 smithi097 ceph-mon[41966]: pgmap v312: 178 pgs: 178 active+clean; 1.8 GiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 852 B/s rd, 183 MiB/s wr, 2.94k op/s 2021-10-08T19:28:05.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:05 smithi097 ceph-mon[41966]: 6.1 scrub ok 2021-10-08T19:28:05.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:05 smithi097 ceph-mon[41966]: 5.1b scrub ok 2021-10-08T19:28:05.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:05 smithi097 ceph-mon[32687]: 5.2 scrub ok 2021-10-08T19:28:05.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:05 smithi097 ceph-mon[32687]: pgmap v312: 178 pgs: 178 active+clean; 1.8 GiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 852 B/s rd, 183 MiB/s wr, 2.94k op/s 2021-10-08T19:28:05.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:05 smithi097 ceph-mon[32687]: 6.1 scrub ok 2021-10-08T19:28:05.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:05 smithi097 ceph-mon[32687]: 5.1b scrub ok 2021-10-08T19:28:06.126 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:28:06.132 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:06.134 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:28:06.234 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:28:06.279 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:06.382 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:28:06.387 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:06.388 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:28:06.489 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:28:06.534 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:06.563 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:28:06.656 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 15 16 34024 34008 141.654 107.312 0.0476637 0.00703951 2021-10-08T19:28:06.720 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:28:06.724 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:06.725 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:28:06.826 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:28:06.865 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:06 smithi097 ceph-mon[41966]: 3.b scrub ok 2021-10-08T19:28:06.865 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:06 smithi097 ceph-mon[41966]: 2.b scrub ok 2021-10-08T19:28:06.866 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:06 smithi097 ceph-mon[32687]: 3.b scrub ok 2021-10-08T19:28:06.866 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:06 smithi097 ceph-mon[32687]: 2.b scrub ok 2021-10-08T19:28:06.871 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:06.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:06 smithi117 ceph-mon[34585]: 3.b scrub ok 2021-10-08T19:28:06.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:06 smithi117 ceph-mon[34585]: 2.b scrub ok 2021-10-08T19:28:06.906 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:28:06 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:28:07.006 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:28:07.012 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:07.013 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:28:07.114 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:28:07.160 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:07.287 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:28:07.299 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:07.300 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:28:07.401 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:28:07.442 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:07.656 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 16 16 35577 35561 138.867 97.0625 0.00936171 0.00719441 2021-10-08T19:28:07.698 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is unset 2021-10-08T19:28:07.715 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:28:07.721 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:07.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:07 smithi097 ceph-mon[32687]: 5.8 scrub ok 2021-10-08T19:28:07.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:07 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:28:07.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:07 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:28:07.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:07 smithi097 ceph-mon[32687]: 5.11 scrub ok 2021-10-08T19:28:07.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:07 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:28:07.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:07 smithi097 ceph-mon[32687]: pgmap v313: 178 pgs: 178 active+clean; 1.8 GiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 705 B/s rd, 87 MiB/s wr, 1.39k op/s 2021-10-08T19:28:07.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:07 smithi097 ceph-mon[32687]: osdmap e192: 8 total, 8 up, 8 in 2021-10-08T19:28:07.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:07 smithi097 ceph-mon[32687]: 6.1d scrub ok 2021-10-08T19:28:07.724 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:07 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2710925447' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:28:07.724 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:07 smithi097 ceph-mon[32687]: from='client.35153 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:28:07.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:07 smithi097 ceph-mon[41966]: 5.8 scrub ok 2021-10-08T19:28:07.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:07 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:28:07.725 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:07 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:28:07.725 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:07 smithi097 ceph-mon[41966]: 5.11 scrub ok 2021-10-08T19:28:07.725 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:07 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:28:07.725 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:07 smithi097 ceph-mon[41966]: pgmap v313: 178 pgs: 178 active+clean; 1.8 GiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 705 B/s rd, 87 MiB/s wr, 1.39k op/s 2021-10-08T19:28:07.726 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:07 smithi097 ceph-mon[41966]: osdmap e192: 8 total, 8 up, 8 in 2021-10-08T19:28:07.726 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:07 smithi097 ceph-mon[41966]: 6.1d scrub ok 2021-10-08T19:28:07.726 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:07 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2710925447' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:28:07.726 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:07 smithi097 ceph-mon[41966]: from='client.35153 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:28:07.727 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:28:07.828 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:28:07.852 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:07.861 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:28:07.862 INFO:teuthology.orchestra.run.smithi117.stdout: "success": "filestore_inject_stall = '3' (not observed, change may require restart) " 2021-10-08T19:28:07.862 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:28:07.870 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:07 smithi117 ceph-mon[34585]: 5.8 scrub ok 2021-10-08T19:28:07.871 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:07 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:28:07.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:07 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:28:07.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:07 smithi117 ceph-mon[34585]: 5.11 scrub ok 2021-10-08T19:28:07.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:07 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:28:07.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:07 smithi117 ceph-mon[34585]: pgmap v313: 178 pgs: 178 active+clean; 1.8 GiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 705 B/s rd, 87 MiB/s wr, 1.39k op/s 2021-10-08T19:28:07.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:07 smithi117 ceph-mon[34585]: osdmap e192: 8 total, 8 up, 8 in 2021-10-08T19:28:07.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:07 smithi117 ceph-mon[34585]: 6.1d scrub ok 2021-10-08T19:28:07.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:07 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2710925447' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:28:07.875 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:07 smithi117 ceph-mon[34585]: from='client.35153 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:28:07.941 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:28:07.946 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:07.947 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:28:08.048 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:28:08.096 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:08.254 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:28:08.258 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:08.259 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:28:08.360 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:28:08.390 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:08.657 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 17 16 37019 37003 135.99 90.125 0.0068883 0.00734777 2021-10-08T19:28:08.665 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:08 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:28:08.665 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:08 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:28:08.666 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:08 smithi097 ceph-mon[32687]: 4.b scrub ok 2021-10-08T19:28:08.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:08 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:28:08.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:08 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:28:08.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:08 smithi097 ceph-mon[41966]: 4.b scrub ok 2021-10-08T19:28:08.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:08 smithi097 ceph-mon[41966]: 6.1c scrub ok 2021-10-08T19:28:08.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:08 smithi097 ceph-mon[41966]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:28:08.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:08 smithi097 ceph-mon[41966]: Cluster is now healthy 2021-10-08T19:28:08.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:08 smithi097 ceph-mon[41966]: from='client.35153 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:28:08.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:08 smithi097 ceph-mon[41966]: osdmap e193: 8 total, 8 up, 8 in 2021-10-08T19:28:08.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:08 smithi097 ceph-mon[41966]: 2.6 deep-scrub ok 2021-10-08T19:28:08.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:08 smithi097 ceph-mon[32687]: 6.1c scrub ok 2021-10-08T19:28:08.974 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:08 smithi097 ceph-mon[32687]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:28:08.974 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:08 smithi097 ceph-mon[32687]: Cluster is now healthy 2021-10-08T19:28:08.974 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:08 smithi097 ceph-mon[32687]: from='client.35153 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:28:08.974 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:08 smithi097 ceph-mon[32687]: osdmap e193: 8 total, 8 up, 8 in 2021-10-08T19:28:08.975 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:08 smithi097 ceph-mon[32687]: 2.6 deep-scrub ok 2021-10-08T19:28:09.056 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:28:09.061 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:09.062 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:28:09.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:08 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:28:09.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:08 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:28:09.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:08 smithi117 ceph-mon[34585]: 4.b scrub ok 2021-10-08T19:28:09.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:08 smithi117 ceph-mon[34585]: 6.1c scrub ok 2021-10-08T19:28:09.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:08 smithi117 ceph-mon[34585]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:28:09.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:08 smithi117 ceph-mon[34585]: Cluster is now healthy 2021-10-08T19:28:09.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:08 smithi117 ceph-mon[34585]: from='client.35153 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:28:09.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:08 smithi117 ceph-mon[34585]: osdmap e193: 8 total, 8 up, 8 in 2021-10-08T19:28:09.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:08 smithi117 ceph-mon[34585]: 2.6 deep-scrub ok 2021-10-08T19:28:09.163 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:28:09.216 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:09.658 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:28:09.659 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 18 16 38746 38730 134.419 107.938 0.00940411 0.00743517 2021-10-08T19:28:09.665 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:09.665 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:28:09.767 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:28:09.828 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:09.927 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:09 smithi097 ceph-mon[32687]: 3.8 scrub ok 2021-10-08T19:28:09.927 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:09 smithi097 ceph-mon[32687]: pgmap v316: 178 pgs: 178 active+clean; 1.9 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 1.1 KiB/s rd, 102 MiB/s wr, 1.64k op/s 2021-10-08T19:28:09.927 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:09 smithi097 ceph-mon[32687]: 4.e scrub ok 2021-10-08T19:28:09.928 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:09 smithi097 ceph-mon[32687]: 6.a deep-scrub ok 2021-10-08T19:28:09.928 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:09 smithi097 ceph-mon[41966]: 3.8 scrub ok 2021-10-08T19:28:09.928 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:09 smithi097 ceph-mon[41966]: pgmap v316: 178 pgs: 178 active+clean; 1.9 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 1.1 KiB/s rd, 102 MiB/s wr, 1.64k op/s 2021-10-08T19:28:09.929 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:09 smithi097 ceph-mon[41966]: 4.e scrub ok 2021-10-08T19:28:09.929 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:09 smithi097 ceph-mon[41966]: 6.a deep-scrub ok 2021-10-08T19:28:09.935 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:28:09.939 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:09 smithi117 ceph-mon[34585]: 3.8 scrub ok 2021-10-08T19:28:09.939 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:09 smithi117 ceph-mon[34585]: pgmap v316: 178 pgs: 178 active+clean; 1.9 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 1.1 KiB/s rd, 102 MiB/s wr, 1.64k op/s 2021-10-08T19:28:09.940 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:09 smithi117 ceph-mon[34585]: 4.e scrub ok 2021-10-08T19:28:09.940 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:09 smithi117 ceph-mon[34585]: 6.a deep-scrub ok 2021-10-08T19:28:09.940 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:09.941 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:28:10.042 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:28:10.093 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:10.183 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:28:10.199 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:10.199 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:28:10.216 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:28:10.249 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:28:10.284 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:28:10.301 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:28:10.321 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:28:10.361 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:10.362 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:28:10.397 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:28:10.426 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:28:10.462 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:28:10.464 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'false' 2021-10-08T19:28:10.464 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'false' 2021-10-08T19:28:10.464 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'false' 2021-10-08T19:28:10.465 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'false' 2021-10-08T19:28:10.465 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'false' 2021-10-08T19:28:10.465 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'false' 2021-10-08T19:28:10.465 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'false' 2021-10-08T19:28:10.465 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'false' 2021-10-08T19:28:10.590 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:28:10.593 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:10.594 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:28:10.659 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 19 16 40268 40252 132.352 95.125 0.00412037 0.00755197 2021-10-08T19:28:10.687 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2021-10-08T19:28:10.688 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:28:10.695 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:28:10.740 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:10.812 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:28:10.818 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:10 smithi097 ceph-mon[41966]: 2.14 scrub ok 2021-10-08T19:28:10.818 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:10 smithi097 ceph-mon[41966]: 6.9 scrub ok 2021-10-08T19:28:10.819 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:10 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/569392822' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:28:10.819 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:10 smithi097 ceph-mon[41966]: 6.11 scrub ok 2021-10-08T19:28:10.819 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:10.820 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:28:10.821 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:10 smithi097 ceph-mon[32687]: 2.14 scrub ok 2021-10-08T19:28:10.821 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:10 smithi097 ceph-mon[32687]: 6.9 scrub ok 2021-10-08T19:28:10.821 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:10 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/569392822' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:28:10.822 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:10 smithi097 ceph-mon[32687]: 6.11 scrub ok 2021-10-08T19:28:10.921 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:28:10.958 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:10 smithi117 ceph-mon[34585]: 2.14 scrub ok 2021-10-08T19:28:10.958 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:10 smithi117 ceph-mon[34585]: 6.9 scrub ok 2021-10-08T19:28:10.959 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:10 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/569392822' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:28:10.959 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:10 smithi117 ceph-mon[34585]: 6.11 scrub ok 2021-10-08T19:28:10.964 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:11.659 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:2021-10-08T19:28:11.659655+0000 min lat: 0.00104309 max lat: 0.244683 avg lat: 0.00767635 2021-10-08T19:28:11.660 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2021-10-08T19:28:11.660 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 20 16 41692 41676 130.184 89 0.00848073 0.00767635 2021-10-08T19:28:11.749 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:28:11.752 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:11.752 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:28:11.773 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set noscrub 2021-10-08T19:28:11.854 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:28:11.896 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2021-10-08T19:28:11.916 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:11.937 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:11 smithi097 ceph-mon[41966]: pgmap v317: 178 pgs: 178 active+clean; 2.3 GiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 143 MiB/s wr, 2.29k op/s 2021-10-08T19:28:11.937 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:11 smithi097 ceph-mon[41966]: 5.1d scrub ok 2021-10-08T19:28:11.937 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:11 smithi097 ceph-mon[32687]: pgmap v317: 178 pgs: 178 active+clean; 2.3 GiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 143 MiB/s wr, 2.29k op/s 2021-10-08T19:28:11.938 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:11 smithi097 ceph-mon[32687]: 5.1d scrub ok 2021-10-08T19:28:12.138 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:28:12.143 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:12.144 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:11 smithi117 ceph-mon[34585]: pgmap v317: 178 pgs: 178 active+clean; 2.3 GiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 143 MiB/s wr, 2.29k op/s 2021-10-08T19:28:12.144 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:11 smithi117 ceph-mon[34585]: 5.1d scrub ok 2021-10-08T19:28:12.145 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:28:12.246 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:28:12.287 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:28:12.296 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:12.395 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:28:12.478 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:28:12.484 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:12.485 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:28:12.587 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:28:12.642 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:12.659 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 21 16 43115 43099 128.22 88.9375 0.023646 0.00779132 2021-10-08T19:28:12.792 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:28:12.798 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:12.799 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:28:12.834 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:12 smithi097 ceph-mon[41966]: 5.10 deep-scrub ok 2021-10-08T19:28:12.834 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:12 smithi097 ceph-mon[41966]: 5.f scrub ok 2021-10-08T19:28:12.835 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:12 smithi097 ceph-mon[32687]: 5.10 deep-scrub ok 2021-10-08T19:28:12.835 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:12 smithi097 ceph-mon[32687]: 5.f scrub ok 2021-10-08T19:28:12.835 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:28:12 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:28:12] "GET /metrics HTTP/1.1" 200 155603 "" "Prometheus/2.18.1" 2021-10-08T19:28:12.900 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:28:12.949 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:13.029 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:28:13.035 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:12 smithi117 ceph-mon[34585]: 5.10 deep-scrub ok 2021-10-08T19:28:13.036 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:12 smithi117 ceph-mon[34585]: 5.f scrub ok 2021-10-08T19:28:13.036 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:13.037 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:28:13.138 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:28:13.178 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:13.357 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:28:13.365 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:13.366 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:28:13.468 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:28:13.514 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:13.594 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2021-10-08T19:28:13.655 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:28:13 smithi117 conmon[69189]: level=error ts=2021-10-08T19:28:13.504Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=2 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:28:13.659 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 22 16 44546 44530 126.457 89.4375 0.00511207 0.00790248 2021-10-08T19:28:13.753 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:28:13.758 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:13.759 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:28:13.860 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:28:13.905 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:13.974 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:13 smithi097 ceph-mon[32687]: 4.5 scrub ok 2021-10-08T19:28:13.974 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:13 smithi097 ceph-mon[32687]: pgmap v318: 178 pgs: 178 active+clean; 2.3 GiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 64 MiB/s wr, 1.03k op/s 2021-10-08T19:28:13.975 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:13 smithi097 ceph-mon[41966]: 4.5 scrub ok 2021-10-08T19:28:13.975 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:13 smithi097 ceph-mon[41966]: pgmap v318: 178 pgs: 178 active+clean; 2.3 GiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 64 MiB/s wr, 1.03k op/s 2021-10-08T19:28:14.156 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:28:13 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:28:13] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:28:14.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:13 smithi117 ceph-mon[34585]: 4.5 scrub ok 2021-10-08T19:28:14.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:13 smithi117 ceph-mon[34585]: pgmap v318: 178 pgs: 178 active+clean; 2.3 GiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 64 MiB/s wr, 1.03k op/s 2021-10-08T19:28:14.177 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:28:14.181 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:14.182 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:28:14.283 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:28:14.316 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:14.388 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:28:14.394 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:14.394 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:28:14.495 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:28:14.536 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:14.602 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:28:14.606 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:14.607 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:28:14.662 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 23 16 46091 46075 125.157 96.5625 0.0098146 0.00798509 2021-10-08T19:28:14.709 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:28:14.710 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:28:14 smithi097 conmon[33110]: 172.21.15.117 - - [08/Oct/2021:19:28:14] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:28:14.710 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:14 smithi097 ceph-mon[32687]: 4.1c scrub ok 2021-10-08T19:28:14.711 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:14 smithi097 ceph-mon[32687]: 2.1b scrub ok 2021-10-08T19:28:14.711 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:14 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:28:14.751 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:14.836 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:28:14.839 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:14 smithi117 ceph-mon[34585]: 4.1c scrub ok 2021-10-08T19:28:14.839 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:14 smithi117 ceph-mon[34585]: 2.1b scrub ok 2021-10-08T19:28:14.840 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:14 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:28:14.840 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 7, 6] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2021-10-08T19:28:14.840 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2021-10-08T19:28:14.841 INFO:tasks.thrashosds.thrasher:Removing osd 1, in_osds are: [0, 1, 2, 3, 4, 5, 7, 6] 2021-10-08T19:28:14.841 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd out 1 2021-10-08T19:28:14.842 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:14.844 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:28:14.944 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:28:14.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:14 smithi097 ceph-mon[41966]: 4.1c scrub ok 2021-10-08T19:28:14.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:14 smithi097 ceph-mon[41966]: 2.1b scrub ok 2021-10-08T19:28:14.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:14 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:28:14.976 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:15.045 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:28:15.050 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:15.051 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:28:15.152 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:28:15.184 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:15.249 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:28:15.255 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:15.256 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:28:15.357 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:28:15.408 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:15.570 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:28:15.574 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:15.575 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:28:15.660 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 24 15 47436 47421 123.448 84.125 0.0205993 0.00809409 2021-10-08T19:28:15.677 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:28:15.709 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:15.719 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:15 smithi097 ceph-mon[32687]: 5.b scrub ok 2021-10-08T19:28:15.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:15 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:28:15.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:15 smithi097 ceph-mon[32687]: 172.21.15.117 - - [08/Oct/2021:19:28:14] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:28:15.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:15 smithi097 ceph-mon[32687]: 6.5 scrub ok 2021-10-08T19:28:15.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:15 smithi097 ceph-mon[32687]: 3.a scrub ok 2021-10-08T19:28:15.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:15 smithi097 ceph-mon[32687]: pgmap v319: 178 pgs: 178 active+clean; 2.7 GiB data, 9.3 GiB used, 706 GiB / 715 GiB avail; 123 MiB/s wr, 1.96k op/s 2021-10-08T19:28:15.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:15 smithi097 ceph-mon[32687]: 6.19 scrub ok 2021-10-08T19:28:15.765 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:28:15.768 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:15.769 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:28:15.870 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:28:15.931 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:15.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:15 smithi097 ceph-mon[41966]: 5.b scrub ok 2021-10-08T19:28:15.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:15 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:28:15.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:15 smithi097 ceph-mon[41966]: 172.21.15.117 - - [08/Oct/2021:19:28:14] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:28:15.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:15 smithi097 ceph-mon[41966]: 6.5 scrub ok 2021-10-08T19:28:15.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:15 smithi097 ceph-mon[41966]: 3.a scrub ok 2021-10-08T19:28:15.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:15 smithi097 ceph-mon[41966]: pgmap v319: 178 pgs: 178 active+clean; 2.7 GiB data, 9.3 GiB used, 706 GiB / 715 GiB avail; 123 MiB/s wr, 1.96k op/s 2021-10-08T19:28:15.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:15 smithi097 ceph-mon[41966]: 6.19 scrub ok 2021-10-08T19:28:16.031 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:28:16.039 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:28:16.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:15 smithi117 ceph-mon[34585]: 5.b scrub ok 2021-10-08T19:28:16.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:15 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:28:16.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:15 smithi117 ceph-mon[34585]: 172.21.15.117 - - [08/Oct/2021:19:28:14] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:28:16.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:15 smithi117 ceph-mon[34585]: 6.5 scrub ok 2021-10-08T19:28:16.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:15 smithi117 ceph-mon[34585]: 3.a scrub ok 2021-10-08T19:28:16.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:15 smithi117 ceph-mon[34585]: pgmap v319: 178 pgs: 178 active+clean; 2.7 GiB data, 9.3 GiB used, 706 GiB / 715 GiB avail; 123 MiB/s wr, 1.96k op/s 2021-10-08T19:28:16.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:15 smithi117 ceph-mon[34585]: 6.19 scrub ok 2021-10-08T19:28:16.158 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:28:16.164 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:16.165 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:28:16.266 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:28:16.284 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2021-10-08T19:28:16.285 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:28:16.326 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:16.662 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 25 16 48718 48702 121.702 80.0625 0.0107436 0.00821226 2021-10-08T19:28:16.731 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:28:16 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:28:16.771 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is set 2021-10-08T19:28:17.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:16 smithi117 ceph-mon[34585]: 2.17 scrub ok 2021-10-08T19:28:17.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:16 smithi117 ceph-mon[34585]: 6.15 scrub ok 2021-10-08T19:28:17.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:16 smithi117 ceph-mon[34585]: 2.1f deep-scrub ok 2021-10-08T19:28:17.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:16 smithi117 ceph-mon[34585]: 6.2 scrub ok 2021-10-08T19:28:17.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:16 smithi117 ceph-mon[34585]: 2.18 scrub ok 2021-10-08T19:28:17.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:16 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1041230180' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:28:17.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:16 smithi097 ceph-mon[41966]: 2.17 scrub ok 2021-10-08T19:28:17.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:16 smithi097 ceph-mon[41966]: 6.15 scrub ok 2021-10-08T19:28:17.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:16 smithi097 ceph-mon[41966]: 2.1f deep-scrub ok 2021-10-08T19:28:17.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:16 smithi097 ceph-mon[41966]: 6.2 scrub ok 2021-10-08T19:28:17.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:16 smithi097 ceph-mon[41966]: 2.18 scrub ok 2021-10-08T19:28:17.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:16 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1041230180' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:28:17.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:16 smithi097 ceph-mon[32687]: 2.17 scrub ok 2021-10-08T19:28:17.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:16 smithi097 ceph-mon[32687]: 6.15 scrub ok 2021-10-08T19:28:17.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:16 smithi097 ceph-mon[32687]: 2.1f deep-scrub ok 2021-10-08T19:28:17.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:16 smithi097 ceph-mon[32687]: 6.2 scrub ok 2021-10-08T19:28:17.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:16 smithi097 ceph-mon[32687]: 2.18 scrub ok 2021-10-08T19:28:17.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:16 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1041230180' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:28:17.383 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:28:17.388 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:17.389 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:28:17.490 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:28:17.531 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:17.662 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 26 16 50242 50226 120.685 95.25 0.0153334 0.00828152 2021-10-08T19:28:18.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:17 smithi117 ceph-mon[34585]: 6.f scrub ok 2021-10-08T19:28:18.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:17 smithi117 ceph-mon[34585]: 2.11 deep-scrub ok 2021-10-08T19:28:18.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:17 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:28:18.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:17 smithi117 ceph-mon[34585]: 3.13 scrub ok 2021-10-08T19:28:18.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:17 smithi117 ceph-mon[34585]: pgmap v320: 178 pgs: 178 active+clean; 2.7 GiB data, 9.3 GiB used, 706 GiB / 715 GiB avail; 99 MiB/s wr, 1.58k op/s 2021-10-08T19:28:18.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:17 smithi117 ceph-mon[34585]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:28:18.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:17 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1041230180' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:28:18.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:17 smithi117 ceph-mon[34585]: osdmap e194: 8 total, 8 up, 8 in 2021-10-08T19:28:18.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:17 smithi097 ceph-mon[41966]: 6.f scrub ok 2021-10-08T19:28:18.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:17 smithi097 ceph-mon[41966]: 2.11 deep-scrub ok 2021-10-08T19:28:18.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:17 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:28:18.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:17 smithi097 ceph-mon[41966]: 3.13 scrub ok 2021-10-08T19:28:18.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:17 smithi097 ceph-mon[41966]: pgmap v320: 178 pgs: 178 active+clean; 2.7 GiB data, 9.3 GiB used, 706 GiB / 715 GiB avail; 99 MiB/s wr, 1.58k op/s 2021-10-08T19:28:18.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:17 smithi097 ceph-mon[41966]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:28:18.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:17 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1041230180' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:28:18.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:17 smithi097 ceph-mon[41966]: osdmap e194: 8 total, 8 up, 8 in 2021-10-08T19:28:18.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:17 smithi097 ceph-mon[32687]: 6.f scrub ok 2021-10-08T19:28:18.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:17 smithi097 ceph-mon[32687]: 2.11 deep-scrub ok 2021-10-08T19:28:18.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:17 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:28:18.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:17 smithi097 ceph-mon[32687]: 3.13 scrub ok 2021-10-08T19:28:18.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:17 smithi097 ceph-mon[32687]: pgmap v320: 178 pgs: 178 active+clean; 2.7 GiB data, 9.3 GiB used, 706 GiB / 715 GiB avail; 99 MiB/s wr, 1.58k op/s 2021-10-08T19:28:18.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:17 smithi097 ceph-mon[32687]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:28:18.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:17 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1041230180' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:28:18.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:17 smithi097 ceph-mon[32687]: osdmap e194: 8 total, 8 up, 8 in 2021-10-08T19:28:18.663 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 27 16 51647 51631 119.465 87.8125 0.00213579 0.00834089 2021-10-08T19:28:18.755 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:28:18.766 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:18.767 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:28:18.868 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:28:18.923 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:19.057 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2021-10-08T19:28:19.098 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:28:19.100 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:19.101 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:28:19.202 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:28:19.361 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:19.663 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 28 16 52792 52776 117.754 71.5625 0.0064586 0.00848698 2021-10-08T19:28:19.967 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:28:19.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:19 smithi097 ceph-mon[32687]: pgmap v322: 178 pgs: 178 active+clean; 2.9 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 96 MiB/s wr, 1.54k op/s 2021-10-08T19:28:19.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:19 smithi097 ceph-mon[41966]: pgmap v322: 178 pgs: 178 active+clean; 2.9 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 96 MiB/s wr, 1.54k op/s 2021-10-08T19:28:19.972 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:19.973 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:28:20.074 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:28:20.124 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:20.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:19 smithi117 ceph-mon[34585]: pgmap v322: 178 pgs: 178 active+clean; 2.9 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 96 MiB/s wr, 1.54k op/s 2021-10-08T19:28:20.665 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 29 16 54237 54221 116.802 90.3125 0.0107051 0.00855611 2021-10-08T19:28:20.964 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set nodeep-scrub 2021-10-08T19:28:21.138 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:28:21.142 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:21.143 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:28:21.244 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:28:21.275 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:21.331 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:28:21.335 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:21.336 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:28:21.438 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:28:21.486 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:28:21.535 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:21.665 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 30 16 55424 55408 115.378 74.1875 0.0070762 0.00866247 2021-10-08T19:28:21.792 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:21 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:28:21.793 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:21 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:28:21.793 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:21 smithi097 ceph-mon[41966]: osdmap e195: 8 total, 8 up, 8 in 2021-10-08T19:28:21.793 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:21 smithi097 ceph-mon[41966]: pgmap v324: 178 pgs: 178 active+clean; 3.2 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 1.2 KiB/s rd, 114 MiB/s wr, 1.83k op/s 2021-10-08T19:28:21.794 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:21 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:28:21.794 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:21 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:28:21.794 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:21 smithi097 ceph-mon[32687]: osdmap e195: 8 total, 8 up, 8 in 2021-10-08T19:28:21.794 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:21 smithi097 ceph-mon[32687]: pgmap v324: 178 pgs: 178 active+clean; 3.2 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 1.2 KiB/s rd, 114 MiB/s wr, 1.83k op/s 2021-10-08T19:28:21.896 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:28:21.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:21 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:28:21.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:21 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:28:21.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:21 smithi117 ceph-mon[34585]: osdmap e195: 8 total, 8 up, 8 in 2021-10-08T19:28:21.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:21 smithi117 ceph-mon[34585]: pgmap v324: 178 pgs: 178 active+clean; 3.2 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 1.2 KiB/s rd, 114 MiB/s wr, 1.83k op/s 2021-10-08T19:28:21.910 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:21.911 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:28:22.014 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:28:22.078 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:22.590 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:28:22 smithi117 conmon[69189]: level=error ts=2021-10-08T19:28:22.314Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=1 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:28:22.590 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:22 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/301692323' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["1"]}]: dispatch 2021-10-08T19:28:22.591 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:22 smithi117 ceph-mon[34585]: Client client.admin marked osd.1 out, while it was still marked up 2021-10-08T19:28:22.666 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 31 16 56489 56473 113.804 66.5625 0.00288427 0.00877234 2021-10-08T19:28:22.915 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:28:22 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:28:22] "GET /metrics HTTP/1.1" 200 155603 "" "Prometheus/2.18.1" 2021-10-08T19:28:22.915 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:22 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/301692323' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["1"]}]: dispatch 2021-10-08T19:28:22.915 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:22 smithi097 ceph-mon[41966]: Client client.admin marked osd.1 out, while it was still marked up 2021-10-08T19:28:22.916 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:22 smithi097 conmon[32664]: 2021-10-08T19:28:22.479+0000 7f605f9d6700 -1 mon.a@0(leader).osd e195 definitely_dead 0 2021-10-08T19:28:22.916 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:22 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/301692323' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["1"]}]: dispatch 2021-10-08T19:28:22.916 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:22 smithi097 ceph-mon[32687]: Client client.admin marked osd.1 out, while it was still marked up 2021-10-08T19:28:22.919 INFO:teuthology.orchestra.run.smithi097.stderr:marked out osd.1. 2021-10-08T19:28:22.921 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:28:23.317 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:28:23.321 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:23.321 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:28:23.423 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:28:23.448 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:23.628 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:28:23.628 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:28:23.629 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:28:23.629 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:28:23.629 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:28:23.630 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:28:23.630 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:28:23.630 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:28:23.630 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true' 2021-10-08T19:28:23.631 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true' 2021-10-08T19:28:23.631 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true' 2021-10-08T19:28:23.631 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true' 2021-10-08T19:28:23.631 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true' 2021-10-08T19:28:23.632 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true' 2021-10-08T19:28:23.632 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'true' 2021-10-08T19:28:23.632 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'true' 2021-10-08T19:28:23.666 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 32 16 56489 56473 110.249 0 - 0.00877234 2021-10-08T19:28:23.867 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:23 smithi117 ceph-mon[34585]: pgmap v325: 178 pgs: 178 active+clean; 3.2 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 639 B/s rd, 56 MiB/s wr, 895 op/s 2021-10-08T19:28:23.867 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:23 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/301692323' entity='client.admin' cmd='[{"prefix": "osd out", "ids": ["1"]}]': finished 2021-10-08T19:28:23.868 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:23 smithi117 ceph-mon[34585]: osdmap e196: 8 total, 8 up, 7 in 2021-10-08T19:28:23.868 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:23 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2263974296' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:28:23.955 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:28:23.957 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:23 smithi097 ceph-mon[41966]: pgmap v325: 178 pgs: 178 active+clean; 3.2 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 639 B/s rd, 56 MiB/s wr, 895 op/s 2021-10-08T19:28:23.957 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:23 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/301692323' entity='client.admin' cmd='[{"prefix": "osd out", "ids": ["1"]}]': finished 2021-10-08T19:28:23.958 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:23 smithi097 ceph-mon[41966]: osdmap e196: 8 total, 8 up, 7 in 2021-10-08T19:28:23.958 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:23 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2263974296' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:28:23.958 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:23 smithi097 ceph-mon[32687]: pgmap v325: 178 pgs: 178 active+clean; 3.2 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 639 B/s rd, 56 MiB/s wr, 895 op/s 2021-10-08T19:28:23.959 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:23 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/301692323' entity='client.admin' cmd='[{"prefix": "osd out", "ids": ["1"]}]': finished 2021-10-08T19:28:23.959 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:23 smithi097 ceph-mon[32687]: osdmap e196: 8 total, 8 up, 7 in 2021-10-08T19:28:23.959 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:23 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2263974296' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:28:23.960 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:23.960 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:28:24.062 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:28:24.084 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:24.130 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:28:24.131 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:28:23 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:28:23] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:28:24.132 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:24.133 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:28:24.234 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:28:24.257 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:24.299 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:28:24.301 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:24.302 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:28:24.404 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:28:24.428 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:24.666 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 33 16 56489 56473 106.909 0 - 0.00877234 2021-10-08T19:28:24.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:24 smithi097 ceph-mon[32687]: osdmap e197: 8 total, 8 up, 7 in 2021-10-08T19:28:24.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:24 smithi097 ceph-mon[41966]: osdmap e197: 8 total, 8 up, 7 in 2021-10-08T19:28:24.788 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:28:24.801 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:24.802 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:28:24.904 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:28:24.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:24 smithi117 ceph-mon[34585]: osdmap e197: 8 total, 8 up, 7 in 2021-10-08T19:28:24.929 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:24.979 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:28:24.981 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:24.982 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:28:25.086 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:28:25.133 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:25.637 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:28:25.650 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:25.651 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:28:25.667 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 34 16 56861 56845 104.446 7.75 0.0130733 0.0095675 2021-10-08T19:28:25.677 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:28:25.677 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2021-10-08T19:28:25.677 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2021-10-08T19:28:25.678 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2021-10-08T19:28:25.678 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:28:25.752 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:28:25.789 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:25.852 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:28:25.856 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:25.857 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:28:25.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:25 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:28:25.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:25 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:28:25.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:25 smithi117 ceph-mon[34585]: pgmap v328: 178 pgs: 6 remapped+peering, 3 active+recovering, 3 active+recovery_wait+degraded, 2 active+recovering+degraded, 39 peering, 125 active+clean; 3.4 GiB data, 9.8 GiB used, 616 GiB / 626 GiB avail; 97 MiB/s wr, 1.55k op/s; 12/170016 objects degraded (0.007%); 25/170016 objects misplaced (0.015%); 8.7 KiB/s, 0 objects/s recovering 2021-10-08T19:28:25.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:25 smithi117 ceph-mon[34585]: Health check failed: Reduced data availability: 12 pgs inactive, 15 pgs peering (PG_AVAILABILITY) 2021-10-08T19:28:25.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:25 smithi117 ceph-mon[34585]: Health check failed: Degraded data redundancy: 12/170016 objects degraded (0.007%), 5 pgs degraded (PG_DEGRADED) 2021-10-08T19:28:25.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:25 smithi117 ceph-mon[34585]: osdmap e198: 8 total, 8 up, 7 in 2021-10-08T19:28:25.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:25 smithi117 ceph-mon[34585]: osdmap e199: 8 total, 8 up, 7 in 2021-10-08T19:28:25.958 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:28:25.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:25 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:28:25.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:25 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:28:25.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:25 smithi097 ceph-mon[41966]: pgmap v328: 178 pgs: 6 remapped+peering, 3 active+recovering, 3 active+recovery_wait+degraded, 2 active+recovering+degraded, 39 peering, 125 active+clean; 3.4 GiB data, 9.8 GiB used, 616 GiB / 626 GiB avail; 97 MiB/s wr, 1.55k op/s; 12/170016 objects degraded (0.007%); 25/170016 objects misplaced (0.015%); 8.7 KiB/s, 0 objects/s recovering 2021-10-08T19:28:25.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:25 smithi097 ceph-mon[41966]: Health check failed: Reduced data availability: 12 pgs inactive, 15 pgs peering (PG_AVAILABILITY) 2021-10-08T19:28:25.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:25 smithi097 ceph-mon[41966]: Health check failed: Degraded data redundancy: 12/170016 objects degraded (0.007%), 5 pgs degraded (PG_DEGRADED) 2021-10-08T19:28:25.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:25 smithi097 ceph-mon[41966]: osdmap e198: 8 total, 8 up, 7 in 2021-10-08T19:28:25.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:25 smithi097 ceph-mon[41966]: osdmap e199: 8 total, 8 up, 7 in 2021-10-08T19:28:25.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:25 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:28:25.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:25 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:28:25.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:25 smithi097 ceph-mon[32687]: pgmap v328: 178 pgs: 6 remapped+peering, 3 active+recovering, 3 active+recovery_wait+degraded, 2 active+recovering+degraded, 39 peering, 125 active+clean; 3.4 GiB data, 9.8 GiB used, 616 GiB / 626 GiB avail; 97 MiB/s wr, 1.55k op/s; 12/170016 objects degraded (0.007%); 25/170016 objects misplaced (0.015%); 8.7 KiB/s, 0 objects/s recovering 2021-10-08T19:28:25.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:25 smithi097 ceph-mon[32687]: Health check failed: Reduced data availability: 12 pgs inactive, 15 pgs peering (PG_AVAILABILITY) 2021-10-08T19:28:25.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:25 smithi097 ceph-mon[32687]: Health check failed: Degraded data redundancy: 12/170016 objects degraded (0.007%), 5 pgs degraded (PG_DEGRADED) 2021-10-08T19:28:25.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:25 smithi097 ceph-mon[32687]: osdmap e198: 8 total, 8 up, 7 in 2021-10-08T19:28:25.974 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:25 smithi097 ceph-mon[32687]: osdmap e199: 8 total, 8 up, 7 in 2021-10-08T19:28:25.992 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:26.060 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:28:26.063 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:26.064 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:28:26.165 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:28:26.244 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:26.671 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 35 16 57652 57636 102.873 49.4375 0.0302025 0.00971454 2021-10-08T19:28:26.846 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2021-10-08T19:28:26.906 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:28:26 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:28:27.670 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 36 16 58442 58426 101.382 49.375 0.00814159 0.00985803 2021-10-08T19:28:27.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:27 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:28:27.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:27 smithi117 ceph-mon[34585]: osdmap e200: 8 total, 8 up, 7 in 2021-10-08T19:28:27.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:27 smithi117 ceph-mon[34585]: pgmap v332: 178 pgs: 6 remapped+peering, 3 active+recovering, 3 active+recovery_wait+degraded, 2 active+recovering+degraded, 39 peering, 125 active+clean; 3.4 GiB data, 9.8 GiB used, 616 GiB / 626 GiB avail; 75 MiB/s wr, 1.21k op/s; 12/170016 objects degraded (0.007%); 25/170016 objects misplaced (0.015%); 13 KiB/s, 0 objects/s recovering 2021-10-08T19:28:27.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:27 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:28:27.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:27 smithi097 ceph-mon[32687]: osdmap e200: 8 total, 8 up, 7 in 2021-10-08T19:28:27.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:27 smithi097 ceph-mon[32687]: pgmap v332: 178 pgs: 6 remapped+peering, 3 active+recovering, 3 active+recovery_wait+degraded, 2 active+recovering+degraded, 39 peering, 125 active+clean; 3.4 GiB data, 9.8 GiB used, 616 GiB / 626 GiB avail; 75 MiB/s wr, 1.21k op/s; 12/170016 objects degraded (0.007%); 25/170016 objects misplaced (0.015%); 13 KiB/s, 0 objects/s recovering 2021-10-08T19:28:27.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:27 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:28:27.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:27 smithi097 ceph-mon[41966]: osdmap e200: 8 total, 8 up, 7 in 2021-10-08T19:28:27.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:27 smithi097 ceph-mon[41966]: pgmap v332: 178 pgs: 6 remapped+peering, 3 active+recovering, 3 active+recovery_wait+degraded, 2 active+recovering+degraded, 39 peering, 125 active+clean; 3.4 GiB data, 9.8 GiB used, 616 GiB / 626 GiB avail; 75 MiB/s wr, 1.21k op/s; 12/170016 objects degraded (0.007%); 25/170016 objects misplaced (0.015%); 13 KiB/s, 0 objects/s recovering 2021-10-08T19:28:28.159 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:28:28.172 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:28.173 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:28:28.275 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:28:28.305 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:28.367 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:28.368 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:28:28.368 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:28:28.384 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2021-10-08T19:28:28.400 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:28:28.469 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:28:28.500 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:28.551 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:28:28.555 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:28.555 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:28:28.656 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:28:28.673 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 37 16 59090 59074 99.7333 40.5 0.0412135 0.0100176 2021-10-08T19:28:28.796 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:28.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:28 smithi117 ceph-mon[34585]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 12 pgs inactive, 15 pgs peering) 2021-10-08T19:28:28.966 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:28:28.971 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:28.972 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:28:29.073 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:28:29.101 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:29.155 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:28:29.159 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:29.159 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:28:29.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:28 smithi097 ceph-mon[41966]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 12 pgs inactive, 15 pgs peering) 2021-10-08T19:28:29.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:28 smithi097 ceph-mon[32687]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 12 pgs inactive, 15 pgs peering) 2021-10-08T19:28:29.261 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:28:29.289 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:29.344 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:28:29.347 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:29.348 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:28:29.372 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:28:29.449 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:28:29.533 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:29.595 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 3, 4, 5, 7, 6] out_osds: [1] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2021-10-08T19:28:29.596 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2021-10-08T19:28:29.596 INFO:tasks.thrashosds.thrasher:Adding osd 1 2021-10-08T19:28:29.597 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd in 1 2021-10-08T19:28:29.620 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:28:29.623 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:29.624 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:28:29.673 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 38 16 59657 59641 98.0405 35.4375 0.0290053 0.0101914 2021-10-08T19:28:29.726 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:28:29.776 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:29.808 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is set 2021-10-08T19:28:29.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:29 smithi097 ceph-mon[32687]: pgmap v333: 178 pgs: 1 active+recovering+undersized+remapped, 6 remapped+peering, 3 active+recovering, 3 active+recovery_wait+degraded, 2 active+recovering+degraded, 163 active+clean; 3.5 GiB data, 10 GiB used, 616 GiB / 626 GiB avail; 47 MiB/s wr, 758 op/s; 12/173238 objects degraded (0.007%); 3583/173238 objects misplaced (2.068%); 539 KiB/s, 21 objects/s recovering 2021-10-08T19:28:29.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:29 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1062479623' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:28:29.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:29 smithi097 ceph-mon[41966]: pgmap v333: 178 pgs: 1 active+recovering+undersized+remapped, 6 remapped+peering, 3 active+recovering, 3 active+recovery_wait+degraded, 2 active+recovering+degraded, 163 active+clean; 3.5 GiB data, 10 GiB used, 616 GiB / 626 GiB avail; 47 MiB/s wr, 758 op/s; 12/173238 objects degraded (0.007%); 3583/173238 objects misplaced (2.068%); 539 KiB/s, 21 objects/s recovering 2021-10-08T19:28:29.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:29 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1062479623' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:28:30.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:29 smithi117 ceph-mon[34585]: pgmap v333: 178 pgs: 1 active+recovering+undersized+remapped, 6 remapped+peering, 3 active+recovering, 3 active+recovery_wait+degraded, 2 active+recovering+degraded, 163 active+clean; 3.5 GiB data, 10 GiB used, 616 GiB / 626 GiB avail; 47 MiB/s wr, 758 op/s; 12/173238 objects degraded (0.007%); 3583/173238 objects misplaced (2.068%); 539 KiB/s, 21 objects/s recovering 2021-10-08T19:28:30.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:29 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1062479623' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:28:30.673 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 39 16 60362 60346 96.6557 44.0625 0.0281004 0.0103397 2021-10-08T19:28:31.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:30 smithi117 ceph-mon[34585]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:28:31.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:30 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1062479623' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:28:31.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:30 smithi117 ceph-mon[34585]: osdmap e201: 8 total, 8 up, 7 in 2021-10-08T19:28:31.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:30 smithi117 ceph-mon[34585]: Health check update: Degraded data redundancy: 12/173238 objects degraded (0.007%), 5 pgs degraded (PG_DEGRADED) 2021-10-08T19:28:31.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:30 smithi097 ceph-mon[41966]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:28:31.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:30 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1062479623' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:28:31.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:30 smithi097 ceph-mon[41966]: osdmap e201: 8 total, 8 up, 7 in 2021-10-08T19:28:31.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:30 smithi097 ceph-mon[41966]: Health check update: Degraded data redundancy: 12/173238 objects degraded (0.007%), 5 pgs degraded (PG_DEGRADED) 2021-10-08T19:28:31.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:30 smithi097 ceph-mon[32687]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:28:31.225 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:30 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1062479623' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:28:31.225 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:30 smithi097 ceph-mon[32687]: osdmap e201: 8 total, 8 up, 7 in 2021-10-08T19:28:31.226 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:30 smithi097 ceph-mon[32687]: Health check update: Degraded data redundancy: 12/173238 objects degraded (0.007%), 5 pgs degraded (PG_DEGRADED) 2021-10-08T19:28:31.530 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:28:31.535 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:31.536 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:28:31.637 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:28:31.673 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:2021-10-08T19:28:31.672814+0000 min lat: 0.00104309 max lat: 2.50582 avg lat: 0.0104654 2021-10-08T19:28:31.673 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2021-10-08T19:28:31.673 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 40 15 61160 61145 95.4881 49.9375 0.0128601 0.0104654 2021-10-08T19:28:31.692 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:31.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:31 smithi097 ceph-mon[41966]: pgmap v335: 178 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 5 active+recovering+undersized+remapped, 171 active+clean; 3.6 GiB data, 10 GiB used, 616 GiB / 626 GiB avail; 855 B/s rd, 27 MiB/s wr, 433 op/s; 7058/177792 objects degraded (3.970%); 17276/177792 objects misplaced (9.717%); 4.3 MiB/s, 85 objects/s recovering 2021-10-08T19:28:31.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:31 smithi097 ceph-mon[32687]: pgmap v335: 178 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 5 active+recovering+undersized+remapped, 171 active+clean; 3.6 GiB data, 10 GiB used, 616 GiB / 626 GiB avail; 855 B/s rd, 27 MiB/s wr, 433 op/s; 7058/177792 objects degraded (3.970%); 17276/177792 objects misplaced (9.717%); 4.3 MiB/s, 85 objects/s recovering 2021-10-08T19:28:32.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:31 smithi117 ceph-mon[34585]: pgmap v335: 178 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 5 active+recovering+undersized+remapped, 171 active+clean; 3.6 GiB data, 10 GiB used, 616 GiB / 626 GiB avail; 855 B/s rd, 27 MiB/s wr, 433 op/s; 7058/177792 objects degraded (3.970%); 17276/177792 objects misplaced (9.717%); 4.3 MiB/s, 85 objects/s recovering 2021-10-08T19:28:32.223 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:28:32.229 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:32.230 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:28:32.331 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:28:32.387 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:32.471 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:28:32.642 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:28:32.647 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:32.647 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:28:32.680 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 41 16 61848 61832 94.1903 42.9375 0.00937549 0.0106075 2021-10-08T19:28:32.749 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:28:32.768 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:28:32 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:28:32] "GET /metrics HTTP/1.1" 200 156032 "" "Prometheus/2.18.1" 2021-10-08T19:28:32.774 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:32.824 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:28:32.828 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:32.829 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:28:32.930 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:28:32.954 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:33.014 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:28:33.021 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:33.022 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:28:33.124 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:28:33.149 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:33.177 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:28:33.204 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:28:33.206 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:33.207 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:28:33.227 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:28:33.269 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:28:33.306 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:28:33.308 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:28:33.338 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:28:33.375 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:28:33.387 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:33.412 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:28:33.457 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:28:33.472 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'false' 2021-10-08T19:28:33.472 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'false' 2021-10-08T19:28:33.472 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'false' 2021-10-08T19:28:33.473 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'false' 2021-10-08T19:28:33.473 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'false' 2021-10-08T19:28:33.473 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'false' 2021-10-08T19:28:33.473 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'false' 2021-10-08T19:28:33.473 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'false' 2021-10-08T19:28:33.681 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 42 16 62434 62418 92.8205 36.625 0.0167803 0.0107675 2021-10-08T19:28:33.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:33 smithi097 ceph-mon[41966]: pgmap v336: 178 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 5 active+recovering+undersized+remapped, 171 active+clean; 3.6 GiB data, 10 GiB used, 616 GiB / 626 GiB avail; 729 B/s rd, 23 MiB/s wr, 369 op/s; 7058/177792 objects degraded (3.970%); 17276/177792 objects misplaced (9.717%); 3.7 MiB/s, 72 objects/s recovering 2021-10-08T19:28:33.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:33 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1952782703' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:28:33.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:33 smithi097 ceph-mon[32687]: pgmap v336: 178 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 5 active+recovering+undersized+remapped, 171 active+clean; 3.6 GiB data, 10 GiB used, 616 GiB / 626 GiB avail; 729 B/s rd, 23 MiB/s wr, 369 op/s; 7058/177792 objects degraded (3.970%); 17276/177792 objects misplaced (9.717%); 3.7 MiB/s, 72 objects/s recovering 2021-10-08T19:28:33.974 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:33 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1952782703' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:28:34.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:28:33 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:28:33] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:28:34.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:33 smithi117 ceph-mon[34585]: pgmap v336: 178 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 5 active+recovering+undersized+remapped, 171 active+clean; 3.6 GiB data, 10 GiB used, 616 GiB / 626 GiB avail; 729 B/s rd, 23 MiB/s wr, 369 op/s; 7058/177792 objects degraded (3.970%); 17276/177792 objects misplaced (9.717%); 3.7 MiB/s, 72 objects/s recovering 2021-10-08T19:28:34.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:33 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1952782703' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:28:34.534 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset noscrub 2021-10-08T19:28:34.683 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 43 16 63181 63165 91.7476 46.6875 0.0230508 0.0108931 2021-10-08T19:28:35.090 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:28:35.101 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:35.102 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:28:35.203 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:28:35.241 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:35.680 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 44 16 63908 63892 90.6956 45.4375 0.00488026 0.0110126 2021-10-08T19:28:35.880 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:28:35.886 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:35.887 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:28:35.988 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:28:36.019 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:35 smithi097 ceph-mon[41966]: pgmap v337: 178 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 5 active+recovering+undersized+remapped, 171 active+clean; 3.8 GiB data, 11 GiB used, 615 GiB / 626 GiB avail; 1.2 KiB/s rd, 46 MiB/s wr, 741 op/s; 7058/187824 objects degraded (3.758%); 16753/187824 objects misplaced (8.920%); 7.3 MiB/s, 129 objects/s recovering 2021-10-08T19:28:36.020 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:35 smithi097 ceph-mon[41966]: Health check update: Degraded data redundancy: 7058/187824 objects degraded (3.758%), 2 pgs degraded (PG_DEGRADED) 2021-10-08T19:28:36.020 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:35 smithi097 ceph-mon[32687]: pgmap v337: 178 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 5 active+recovering+undersized+remapped, 171 active+clean; 3.8 GiB data, 11 GiB used, 615 GiB / 626 GiB avail; 1.2 KiB/s rd, 46 MiB/s wr, 741 op/s; 7058/187824 objects degraded (3.758%); 16753/187824 objects misplaced (8.920%); 7.3 MiB/s, 129 objects/s recovering 2021-10-08T19:28:36.021 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:35 smithi097 ceph-mon[32687]: Health check update: Degraded data redundancy: 7058/187824 objects degraded (3.758%), 2 pgs degraded (PG_DEGRADED) 2021-10-08T19:28:36.023 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:36.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:35 smithi117 ceph-mon[34585]: pgmap v337: 178 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 5 active+recovering+undersized+remapped, 171 active+clean; 3.8 GiB data, 11 GiB used, 615 GiB / 626 GiB avail; 1.2 KiB/s rd, 46 MiB/s wr, 741 op/s; 7058/187824 objects degraded (3.758%); 16753/187824 objects misplaced (8.920%); 7.3 MiB/s, 129 objects/s recovering 2021-10-08T19:28:36.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:35 smithi117 ceph-mon[34585]: Health check update: Degraded data redundancy: 7058/187824 objects degraded (3.758%), 2 pgs degraded (PG_DEGRADED) 2021-10-08T19:28:36.681 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 45 16 64526 64510 89.5387 38.625 0.0110749 0.0111618 2021-10-08T19:28:36.783 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:28:36 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:28:36.783 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:36 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:28:36.784 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:36 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:28:36.784 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:36 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:28:36.993 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:28:37.005 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:37.006 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:28:37.070 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:28:37.107 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:28:37.119 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:36 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:28:37.120 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:36 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:28:37.120 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:36 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:28:37.120 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:36 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:28:37.121 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:36 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:28:37.121 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:36 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:28:37.138 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:37.301 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:28:37.306 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:37.307 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:28:37.408 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:28:37.476 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:37.681 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 46 16 65191 65175 88.496 41.5625 0.0228443 0.0112908 2021-10-08T19:28:37.884 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:28:37.892 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:37.893 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:28:37.896 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2021-10-08T19:28:37.896 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:28:37.995 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:28:38.097 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:38.357 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:38 smithi117 ceph-mon[34585]: poll took 60030.858 ms: 1 events 2021-10-08T19:28:38.357 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:38 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:28:38.357 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:38 smithi117 ceph-mon[34585]: pgmap v338: 178 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 5 active+recovering+undersized+remapped, 171 active+clean; 3.8 GiB data, 11 GiB used, 615 GiB / 626 GiB avail; 1022 B/s rd, 37 MiB/s wr, 593 op/s; 7058/187824 objects degraded (3.758%); 16753/187824 objects misplaced (8.920%); 5.9 MiB/s, 103 objects/s recovering 2021-10-08T19:28:38.358 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:38 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:28:38.358 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:38 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:28:38.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:38 smithi097 ceph-mon[32687]: poll took 60030.858 ms: 1 events 2021-10-08T19:28:38.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:38 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:28:38.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:38 smithi097 ceph-mon[32687]: pgmap v338: 178 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 5 active+recovering+undersized+remapped, 171 active+clean; 3.8 GiB data, 11 GiB used, 615 GiB / 626 GiB avail; 1022 B/s rd, 37 MiB/s wr, 593 op/s; 7058/187824 objects degraded (3.758%); 16753/187824 objects misplaced (8.920%); 5.9 MiB/s, 103 objects/s recovering 2021-10-08T19:28:38.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:38 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:28:38.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:38 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:28:38.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:38 smithi097 conmon[32664]: 2021-10-08T19:28:38.266+0000 7f605f9d6700 -1 mon.a@0(leader).osd e201 definitely_dead 0 2021-10-08T19:28:38.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:38 smithi097 ceph-mon[41966]: poll took 60030.858 ms: 1 events 2021-10-08T19:28:38.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:38 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:28:38.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:38 smithi097 ceph-mon[41966]: pgmap v338: 178 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 5 active+recovering+undersized+remapped, 171 active+clean; 3.8 GiB data, 11 GiB used, 615 GiB / 626 GiB avail; 1022 B/s rd, 37 MiB/s wr, 593 op/s; 7058/187824 objects degraded (3.758%); 16753/187824 objects misplaced (8.920%); 5.9 MiB/s, 103 objects/s recovering 2021-10-08T19:28:38.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:38 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:28:38.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:38 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:28:38.682 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 47 16 65841 65825 87.4779 40.625 0.00808443 0.0114238 2021-10-08T19:28:38.733 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:28:38.738 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:38.738 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:28:38.839 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:28:38.901 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:39.091 INFO:teuthology.orchestra.run.smithi097.stderr:marked in osd.1. 2021-10-08T19:28:39.092 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:39 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2914066373' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["1"]}]: dispatch 2021-10-08T19:28:39.092 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:39 smithi097 ceph-mon[32687]: from='client.35192 ' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["1"]}]: dispatch 2021-10-08T19:28:39.093 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:39 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:28:39.122 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2021-10-08T19:28:39.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:39 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2914066373' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["1"]}]: dispatch 2021-10-08T19:28:39.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:39 smithi117 ceph-mon[34585]: from='client.35192 ' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["1"]}]: dispatch 2021-10-08T19:28:39.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:39 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:28:39.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:39 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2914066373' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["1"]}]: dispatch 2021-10-08T19:28:39.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:39 smithi097 ceph-mon[41966]: from='client.35192 ' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["1"]}]: dispatch 2021-10-08T19:28:39.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:39 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:28:39.681 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 48 16 66179 66163 86.0962 21.125 0.0059242 0.0114736 2021-10-08T19:28:40.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:40 smithi117 ceph-mon[34585]: pgmap v339: 178 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 5 active+recovering+undersized+remapped, 171 active+clean; 3.9 GiB data, 11 GiB used, 615 GiB / 626 GiB avail; 1023 B/s rd, 40 MiB/s wr, 637 op/s; 7058/192360 objects degraded (3.669%); 16695/192360 objects misplaced (8.679%); 6.0 MiB/s, 99 objects/s recovering 2021-10-08T19:28:40.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:40 smithi117 ceph-mon[34585]: from='client.35192 ' entity='client.admin' cmd='[{"prefix": "osd in", "ids": ["1"]}]': finished 2021-10-08T19:28:40.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:40 smithi117 ceph-mon[34585]: osdmap e202: 8 total, 8 up, 8 in 2021-10-08T19:28:40.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:40 smithi117 ceph-mon[34585]: osdmap e203: 8 total, 8 up, 8 in 2021-10-08T19:28:40.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:40 smithi097 ceph-mon[32687]: pgmap v339: 178 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 5 active+recovering+undersized+remapped, 171 active+clean; 3.9 GiB data, 11 GiB used, 615 GiB / 626 GiB avail; 1023 B/s rd, 40 MiB/s wr, 637 op/s; 7058/192360 objects degraded (3.669%); 16695/192360 objects misplaced (8.679%); 6.0 MiB/s, 99 objects/s recovering 2021-10-08T19:28:40.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:40 smithi097 ceph-mon[32687]: from='client.35192 ' entity='client.admin' cmd='[{"prefix": "osd in", "ids": ["1"]}]': finished 2021-10-08T19:28:40.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:40 smithi097 ceph-mon[32687]: osdmap e202: 8 total, 8 up, 8 in 2021-10-08T19:28:40.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:40 smithi097 ceph-mon[32687]: osdmap e203: 8 total, 8 up, 8 in 2021-10-08T19:28:40.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:40 smithi097 ceph-mon[41966]: pgmap v339: 178 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 5 active+recovering+undersized+remapped, 171 active+clean; 3.9 GiB data, 11 GiB used, 615 GiB / 626 GiB avail; 1023 B/s rd, 40 MiB/s wr, 637 op/s; 7058/192360 objects degraded (3.669%); 16695/192360 objects misplaced (8.679%); 6.0 MiB/s, 99 objects/s recovering 2021-10-08T19:28:40.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:40 smithi097 ceph-mon[41966]: from='client.35192 ' entity='client.admin' cmd='[{"prefix": "osd in", "ids": ["1"]}]': finished 2021-10-08T19:28:40.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:40 smithi097 ceph-mon[41966]: osdmap e202: 8 total, 8 up, 8 in 2021-10-08T19:28:40.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:40 smithi097 ceph-mon[41966]: osdmap e203: 8 total, 8 up, 8 in 2021-10-08T19:28:40.682 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 49 16 66595 66579 84.8692 26 0.0119104 0.0117772 2021-10-08T19:28:40.899 INFO:tasks.thrashosds.thrasher:Added osd 1 2021-10-08T19:28:41.007 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:28:41.020 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:41.021 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:28:41.087 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2021-10-08T19:28:41.122 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:28:41.150 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:41 smithi097 ceph-mon[41966]: Health check update: Degraded data redundancy: 7058/192360 objects degraded (3.669%), 2 pgs degraded (PG_DEGRADED) 2021-10-08T19:28:41.150 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:41 smithi097 ceph-mon[41966]: osdmap e204: 8 total, 8 up, 8 in 2021-10-08T19:28:41.152 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:41 smithi097 ceph-mon[32687]: Health check update: Degraded data redundancy: 7058/192360 objects degraded (3.669%), 2 pgs degraded (PG_DEGRADED) 2021-10-08T19:28:41.152 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:41 smithi097 ceph-mon[32687]: osdmap e204: 8 total, 8 up, 8 in 2021-10-08T19:28:41.166 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:41.167 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:28:41.231 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:28:41.234 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:41.236 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:28:41.337 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:28:41.363 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:41 smithi117 ceph-mon[34585]: Health check update: Degraded data redundancy: 7058/192360 objects degraded (3.669%), 2 pgs degraded (PG_DEGRADED) 2021-10-08T19:28:41.364 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:41 smithi117 ceph-mon[34585]: osdmap e204: 8 total, 8 up, 8 in 2021-10-08T19:28:41.366 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:41.432 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:28:41.436 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:41.436 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:28:41.538 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:28:41.601 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:41.682 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 50 16 67357 67341 84.1245 47.625 0.012961 0.01188 2021-10-08T19:28:41.749 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:28:41.759 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:41.760 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:28:41.861 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:28:41.927 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:42.126 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:28:42.133 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:42.134 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:28:42.214 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:42 smithi097 ceph-mon[41966]: pgmap v342: 178 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 5 active+recovering+undersized+remapped, 171 active+clean; 4.0 GiB data, 11 GiB used, 614 GiB / 626 GiB avail; 1.2 KiB/s rd, 53 MiB/s wr, 845 op/s; 7058/198078 objects degraded (3.563%); 16204/198078 objects misplaced (8.181%); 8.4 MiB/s, 133 objects/s recovering 2021-10-08T19:28:42.215 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:42 smithi097 ceph-mon[32687]: pgmap v342: 178 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 5 active+recovering+undersized+remapped, 171 active+clean; 4.0 GiB data, 11 GiB used, 614 GiB / 626 GiB avail; 1.2 KiB/s rd, 53 MiB/s wr, 845 op/s; 7058/198078 objects degraded (3.563%); 16204/198078 objects misplaced (8.181%); 8.4 MiB/s, 133 objects/s recovering 2021-10-08T19:28:42.235 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:28:42.238 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:28:42.307 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:42.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:42 smithi117 ceph-mon[34585]: pgmap v342: 178 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 5 active+recovering+undersized+remapped, 171 active+clean; 4.0 GiB data, 11 GiB used, 614 GiB / 626 GiB avail; 1.2 KiB/s rd, 53 MiB/s wr, 845 op/s; 7058/198078 objects degraded (3.563%); 16204/198078 objects misplaced (8.181%); 8.4 MiB/s, 133 objects/s recovering 2021-10-08T19:28:42.406 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:28:42 smithi117 conmon[69189]: level=error ts=2021-10-08T19:28:42.314Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=1 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:28:42.463 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:28:42.469 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:42.470 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:28:42.560 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:28:42 smithi097 conmon[33110]: 172.21.15.97 - - [08/Oct/2021:19:28:42] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:28:42.572 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:28:42.627 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:42.683 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 51 16 68109 68093 83.3956 47 0.0153106 0.0119848 2021-10-08T19:28:42.694 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:28:42.698 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:42.699 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:28:42.801 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:28:42.852 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:28:42 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:28:42] "GET /metrics HTTP/1.1" 200 155843 "" "Prometheus/2.18.1" 2021-10-08T19:28:42.861 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:42.944 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:28:42.950 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:42.951 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:28:43.052 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:28:43.093 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:43.185 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is unset 2021-10-08T19:28:43.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:43 smithi117 ceph-mon[34585]: osdmap e205: 8 total, 8 up, 8 in 2021-10-08T19:28:43.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:43 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:28:43.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:43 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:28:43.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:28:43.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:43 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:28:43.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:43 smithi117 ceph-mon[34585]: 172.21.15.97 - - [08/Oct/2021:19:28:42] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:28:43.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:43 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3923822759' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:28:43.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:28:43.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:43 smithi117 ceph-mon[34585]: pgmap v345: 178 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 5 active+recovering+undersized+remapped, 171 active+clean; 4.0 GiB data, 11 GiB used, 614 GiB / 626 GiB avail; 30 MiB/s wr, 476 op/s; 7058/198078 objects degraded (3.563%); 16204/198078 objects misplaced (8.181%); 7.7 MiB/s, 122 objects/s recovering 2021-10-08T19:28:43.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:28:43.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:43 smithi097 ceph-mon[32687]: osdmap e205: 8 total, 8 up, 8 in 2021-10-08T19:28:43.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:43 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:28:43.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:43 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:28:43.474 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:28:43.474 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:43 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:28:43.474 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:43 smithi097 ceph-mon[32687]: 172.21.15.97 - - [08/Oct/2021:19:28:42] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:28:43.475 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:43 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3923822759' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:28:43.475 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:28:43.475 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:43 smithi097 ceph-mon[32687]: pgmap v345: 178 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 5 active+recovering+undersized+remapped, 171 active+clean; 4.0 GiB data, 11 GiB used, 614 GiB / 626 GiB avail; 30 MiB/s wr, 476 op/s; 7058/198078 objects degraded (3.563%); 16204/198078 objects misplaced (8.181%); 7.7 MiB/s, 122 objects/s recovering 2021-10-08T19:28:43.475 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:28:43.476 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:43 smithi097 ceph-mon[41966]: osdmap e205: 8 total, 8 up, 8 in 2021-10-08T19:28:43.476 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:43 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:28:43.476 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:43 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:28:43.477 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:28:43.477 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:43 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:28:43.477 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:43 smithi097 ceph-mon[41966]: 172.21.15.97 - - [08/Oct/2021:19:28:42] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:28:43.477 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:43 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3923822759' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:28:43.478 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:28:43.478 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:43 smithi097 ceph-mon[41966]: pgmap v345: 178 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 5 active+recovering+undersized+remapped, 171 active+clean; 4.0 GiB data, 11 GiB used, 614 GiB / 626 GiB avail; 30 MiB/s wr, 476 op/s; 7058/198078 objects degraded (3.563%); 16204/198078 objects misplaced (8.181%); 7.7 MiB/s, 122 objects/s recovering 2021-10-08T19:28:43.478 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:28:43.684 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 52 16 69071 69055 82.9468 60.125 0.0199798 0.0120507 2021-10-08T19:28:44.148 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:28:43 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:28:43] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:28:44.149 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:44 smithi117 ceph-mon[34585]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:28:44.149 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:44 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3923822759' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:28:44.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:44 smithi117 ceph-mon[34585]: osdmap e206: 8 total, 8 up, 8 in 2021-10-08T19:28:44.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:44 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:28:44.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:44 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:28:44.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:44 smithi117 ceph-mon[34585]: 172.21.15.117 - - [08/Oct/2021:19:28:43] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:28:44.152 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:44 smithi097 ceph-mon[32687]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:28:44.152 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:44 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3923822759' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:28:44.152 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:44 smithi097 ceph-mon[32687]: osdmap e206: 8 total, 8 up, 8 in 2021-10-08T19:28:44.153 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:44 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:28:44.153 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:44 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:28:44.153 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:44 smithi097 ceph-mon[32687]: 172.21.15.117 - - [08/Oct/2021:19:28:43] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:28:44.153 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:28:43 smithi097 conmon[33110]: 172.21.15.117 - - [08/Oct/2021:19:28:43] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:28:44.154 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:44 smithi097 ceph-mon[41966]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:28:44.154 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:44 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3923822759' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:28:44.154 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:44 smithi097 ceph-mon[41966]: osdmap e206: 8 total, 8 up, 8 in 2021-10-08T19:28:44.155 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:44 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:28:44.155 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:44 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:28:44.155 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:44 smithi097 ceph-mon[41966]: 172.21.15.117 - - [08/Oct/2021:19:28:43] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:28:44.269 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:28:44.276 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:44.277 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:28:44.378 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:28:44.414 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:44.491 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:28:44.493 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:44.494 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:28:44.596 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:28:44.628 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:44.684 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 53 16 70163 70147 82.6691 68.25 0.00776806 0.0120915 2021-10-08T19:28:44.709 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:28:44.717 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:44.718 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:28:44.820 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:28:44.871 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:44.936 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:28:44.939 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:44.940 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:28:45.042 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:28:45.080 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:45.277 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:28:45.281 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:45.282 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:28:45.383 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:28:45.423 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:45.498 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:28:45.503 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:45.504 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:28:45.605 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:28:45.635 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:45.685 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 54 16 71073 71057 82.1914 56.875 0.00979718 0.0121623 2021-10-08T19:28:45.701 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:28:45.709 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:45.710 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:28:45.811 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:28:45.850 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:45.899 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 3, 4, 5, 7, 6, 1] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2021-10-08T19:28:45.900 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2021-10-08T19:28:45.900 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd dump -f json-pretty 2021-10-08T19:28:45.910 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:28:45.912 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:45.913 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:28:46.014 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:28:46.042 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:45 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:28:46.043 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:45 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:28:46.044 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:45 smithi117 ceph-mon[34585]: pgmap v347: 178 pgs: 5 active+recovery_wait+degraded, 4 active+recovery_wait+undersized+degraded+remapped, 3 active+recovering+undersized+remapped, 166 active+clean; 4.2 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1.1 KiB/s rd, 44 MiB/s wr, 712 op/s; 2375/207735 objects degraded (1.143%); 1442/207735 objects misplaced (0.694%); 6.2 MiB/s, 115 objects/s recovering 2021-10-08T19:28:46.044 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:45 smithi117 ceph-mon[34585]: osdmap e207: 8 total, 8 up, 8 in 2021-10-08T19:28:46.044 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:45 smithi117 ceph-mon[34585]: Health check update: Degraded data redundancy: 2375/207735 objects degraded (1.143%), 9 pgs degraded (PG_DEGRADED) 2021-10-08T19:28:46.045 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:46.114 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:28:46.118 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:46.119 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:28:46.221 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:28:46.225 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:45 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:28:46.225 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:45 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:28:46.225 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:45 smithi097 ceph-mon[32687]: pgmap v347: 178 pgs: 5 active+recovery_wait+degraded, 4 active+recovery_wait+undersized+degraded+remapped, 3 active+recovering+undersized+remapped, 166 active+clean; 4.2 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1.1 KiB/s rd, 44 MiB/s wr, 712 op/s; 2375/207735 objects degraded (1.143%); 1442/207735 objects misplaced (0.694%); 6.2 MiB/s, 115 objects/s recovering 2021-10-08T19:28:46.225 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:45 smithi097 ceph-mon[32687]: osdmap e207: 8 total, 8 up, 8 in 2021-10-08T19:28:46.226 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:45 smithi097 ceph-mon[32687]: Health check update: Degraded data redundancy: 2375/207735 objects degraded (1.143%), 9 pgs degraded (PG_DEGRADED) 2021-10-08T19:28:46.226 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:45 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:28:46.226 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:45 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:28:46.227 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:45 smithi097 ceph-mon[41966]: pgmap v347: 178 pgs: 5 active+recovery_wait+degraded, 4 active+recovery_wait+undersized+degraded+remapped, 3 active+recovering+undersized+remapped, 166 active+clean; 4.2 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1.1 KiB/s rd, 44 MiB/s wr, 712 op/s; 2375/207735 objects degraded (1.143%); 1442/207735 objects misplaced (0.694%); 6.2 MiB/s, 115 objects/s recovering 2021-10-08T19:28:46.227 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:45 smithi097 ceph-mon[41966]: osdmap e207: 8 total, 8 up, 8 in 2021-10-08T19:28:46.227 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:45 smithi097 ceph-mon[41966]: Health check update: Degraded data redundancy: 2375/207735 objects degraded (1.143%), 9 pgs degraded (PG_DEGRADED) 2021-10-08T19:28:46.259 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:46.313 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:28:46.318 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:46.319 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:28:46.365 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:28:46.420 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:28:46.421 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:28:46.487 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:28:46.510 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:46.528 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:28:46.550 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:28:46.569 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:28:46.603 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:28:46.621 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:28:46.622 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2021-10-08T19:28:46.622 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2021-10-08T19:28:46.622 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:28:46.636 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:28:46.641 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:28:46.645 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:46.646 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:28:46.655 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:28:46 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:28:46.682 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:28:46.684 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 55 16 71945 71929 81.6881 54.5 0.0172493 0.0122369 2021-10-08T19:28:46.691 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true' 2021-10-08T19:28:46.692 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true' 2021-10-08T19:28:46.692 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true' 2021-10-08T19:28:46.692 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true' 2021-10-08T19:28:46.692 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true' 2021-10-08T19:28:46.693 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true' 2021-10-08T19:28:46.693 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'true' 2021-10-08T19:28:46.693 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'true' 2021-10-08T19:28:46.747 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:28:46.780 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:46.862 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:28:46.867 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:46.868 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:28:46.935 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:46 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1464675001' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:28:46.969 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:28:47.009 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:47.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:46 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1464675001' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:28:47.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:46 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1464675001' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:28:47.685 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 56 16 73007 72991 81.4147 66.375 0.0119683 0.0122774 2021-10-08T19:28:47.849 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2021-10-08T19:28:48.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:47 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:28:48.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:47 smithi097 ceph-mon[41966]: pgmap v349: 178 pgs: 5 active+recovery_wait+degraded, 4 active+recovery_wait+undersized+degraded+remapped, 3 active+recovering+undersized+remapped, 166 active+clean; 4.2 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 926 B/s rd, 36 MiB/s wr, 583 op/s; 2375/207735 objects degraded (1.143%); 1442/207735 objects misplaced (0.694%); 5.1 MiB/s, 94 objects/s recovering 2021-10-08T19:28:48.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:47 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:28:48.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:47 smithi097 ceph-mon[32687]: pgmap v349: 178 pgs: 5 active+recovery_wait+degraded, 4 active+recovery_wait+undersized+degraded+remapped, 3 active+recovering+undersized+remapped, 166 active+clean; 4.2 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 926 B/s rd, 36 MiB/s wr, 583 op/s; 2375/207735 objects degraded (1.143%); 1442/207735 objects misplaced (0.694%); 5.1 MiB/s, 94 objects/s recovering 2021-10-08T19:28:48.228 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset nodeep-scrub 2021-10-08T19:28:48.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:47 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:28:48.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:47 smithi117 ceph-mon[34585]: pgmap v349: 178 pgs: 5 active+recovery_wait+degraded, 4 active+recovery_wait+undersized+degraded+remapped, 3 active+recovering+undersized+remapped, 166 active+clean; 4.2 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 926 B/s rd, 36 MiB/s wr, 583 op/s; 2375/207735 objects degraded (1.143%); 1442/207735 objects misplaced (0.694%); 5.1 MiB/s, 94 objects/s recovering 2021-10-08T19:28:48.483 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:28:48.488 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:48.488 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:28:48.589 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:28:48.618 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:48.644 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:28:48.685 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 57 16 73552 73536 80.5843 34.0625 0.00301837 0.0122897 2021-10-08T19:28:48.706 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:28:48.727 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:28:48.730 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:48.731 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:28:48.832 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:28:48.858 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:48.908 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:28:48.912 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:48.913 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:28:49.014 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:28:49.040 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:49.089 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:28:49.091 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:49.092 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:28:49.194 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:28:49.214 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:48 smithi117 ceph-mon[34585]: osdmap e208: 8 total, 8 up, 8 in 2021-10-08T19:28:49.215 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:48 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:28:49.216 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:49.219 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:48 smithi097 ceph-mon[41966]: osdmap e208: 8 total, 8 up, 8 in 2021-10-08T19:28:49.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:48 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:28:49.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:48 smithi097 ceph-mon[32687]: osdmap e208: 8 total, 8 up, 8 in 2021-10-08T19:28:49.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:48 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:28:49.262 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:28:49.264 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:49.264 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:28:49.365 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:28:49.388 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:49.436 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:28:49.438 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:49.438 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:28:49.539 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:28:49.560 INFO:journalctl@ceph.osd.7.smithi117.stdout:Oct 08 19:28:49 smithi117 conmon[54364]: 2021-10-08T19:28:49.357+0000 7ff38c045700 -1 osd.7 pg_epoch: 209 pg[2.1d( empty local-lis/les=112/113 n=0 ec=60/60 lis/c=112/112 les/c/f=113/113/0 sis=112) [7,6,0] r=0 lpr=112 crt=0'0 mlcod 0'0 active+clean] scrubber pg(2.1d) handle_scrub_reserve_grant: received unsolicited reservation grant from osd 0 (0x55a629ecbe40) 2021-10-08T19:28:49.562 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:49.604 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:28:49.606 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:49.607 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:28:49.685 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 58 16 73552 73536 79.1956 0 - 0.0122897 2021-10-08T19:28:49.708 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:28:49.739 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:49.854 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:28:49.857 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:49.858 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:28:49.959 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:28:49.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:49 smithi097 ceph-mon[41966]: pgmap v351: 178 pgs: 1 active+recovery_wait+degraded, 4 active+recovery_wait+undersized+degraded+remapped, 3 active+recovering+undersized+remapped, 170 active+clean; 4.3 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1.7 KiB/s rd, 55 MiB/s wr, 876 op/s; 2357/213825 objects degraded (1.102%); 1383/213825 objects misplaced (0.647%); 5.3 MiB/s, 99 objects/s recovering 2021-10-08T19:28:49.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:49 smithi097 ceph-mon[41966]: osdmap e209: 8 total, 8 up, 8 in 2021-10-08T19:28:49.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:49 smithi097 ceph-mon[32687]: pgmap v351: 178 pgs: 1 active+recovery_wait+degraded, 4 active+recovery_wait+undersized+degraded+remapped, 3 active+recovering+undersized+remapped, 170 active+clean; 4.3 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1.7 KiB/s rd, 55 MiB/s wr, 876 op/s; 2357/213825 objects degraded (1.102%); 1383/213825 objects misplaced (0.647%); 5.3 MiB/s, 99 objects/s recovering 2021-10-08T19:28:49.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:49 smithi097 ceph-mon[32687]: osdmap e209: 8 total, 8 up, 8 in 2021-10-08T19:28:50.010 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:50.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:49 smithi117 ceph-mon[34585]: pgmap v351: 178 pgs: 1 active+recovery_wait+degraded, 4 active+recovery_wait+undersized+degraded+remapped, 3 active+recovering+undersized+remapped, 170 active+clean; 4.3 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1.7 KiB/s rd, 55 MiB/s wr, 876 op/s; 2357/213825 objects degraded (1.102%); 1383/213825 objects misplaced (0.647%); 5.3 MiB/s, 99 objects/s recovering 2021-10-08T19:28:50.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:49 smithi117 ceph-mon[34585]: osdmap e209: 8 total, 8 up, 8 in 2021-10-08T19:28:50.430 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:28:50.430 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:28:50.431 INFO:teuthology.orchestra.run.smithi097.stdout: "epoch": 210, 2021-10-08T19:28:50.431 INFO:teuthology.orchestra.run.smithi097.stdout: "fsid": "1d01f6d6-286c-11ec-8c25-001a4aab830c", 2021-10-08T19:28:50.431 INFO:teuthology.orchestra.run.smithi097.stdout: "created": "2021-10-08T19:16:25.258003+0000", 2021-10-08T19:28:50.431 INFO:teuthology.orchestra.run.smithi097.stdout: "modified": "2021-10-08T19:28:49.957863+0000", 2021-10-08T19:28:50.432 INFO:teuthology.orchestra.run.smithi097.stdout: "last_up_change": "2021-10-08T19:21:15.388758+0000", 2021-10-08T19:28:50.432 INFO:teuthology.orchestra.run.smithi097.stdout: "last_in_change": "2021-10-08T19:28:39.063019+0000", 2021-10-08T19:28:50.432 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-08T19:28:50.433 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_num": 5804032, 2021-10-08T19:28:50.433 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_set": [ 2021-10-08T19:28:50.433 INFO:teuthology.orchestra.run.smithi097.stdout: "nodeep-scrub", 2021-10-08T19:28:50.433 INFO:teuthology.orchestra.run.smithi097.stdout: "pglog_hardlimit", 2021-10-08T19:28:50.434 INFO:teuthology.orchestra.run.smithi097.stdout: "purged_snapdirs", 2021-10-08T19:28:50.434 INFO:teuthology.orchestra.run.smithi097.stdout: "recovery_deletes", 2021-10-08T19:28:50.434 INFO:teuthology.orchestra.run.smithi097.stdout: "sortbitwise" 2021-10-08T19:28:50.434 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:28:50.435 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_version": 18, 2021-10-08T19:28:50.435 INFO:teuthology.orchestra.run.smithi097.stdout: "full_ratio": 0.94999998807907104, 2021-10-08T19:28:50.435 INFO:teuthology.orchestra.run.smithi097.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-08T19:28:50.435 INFO:teuthology.orchestra.run.smithi097.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-08T19:28:50.436 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_snapshot": "", 2021-10-08T19:28:50.436 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_max": 8, 2021-10-08T19:28:50.436 INFO:teuthology.orchestra.run.smithi097.stdout: "max_osd": 8, 2021-10-08T19:28:50.437 INFO:teuthology.orchestra.run.smithi097.stdout: "require_min_compat_client": "luminous", 2021-10-08T19:28:50.437 INFO:teuthology.orchestra.run.smithi097.stdout: "min_compat_client": "luminous", 2021-10-08T19:28:50.437 INFO:teuthology.orchestra.run.smithi097.stdout: "require_osd_release": "quincy", 2021-10-08T19:28:50.438 INFO:teuthology.orchestra.run.smithi097.stdout: "pools": [ 2021-10-08T19:28:50.438 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.439 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 1, 2021-10-08T19:28:50.439 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": ".mgr", 2021-10-08T19:28:50.439 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:19:44.413311+0000", 2021-10-08T19:28:50.439 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:28:50.440 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:28:50.440 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:28:50.441 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:28:50.441 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:28:50.441 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:28:50.442 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:28:50.442 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:28:50.442 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:28:50.442 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:28:50.443 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:28:50.443 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:28:50.443 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 11, 2021-10-08T19:28:50.443 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 11, 2021-10-08T19:28:50.444 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 11, 2021-10-08T19:28:50.444 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 11, 2021-10-08T19:28:50.444 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 11, 2021-10-08T19:28:50.444 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:28:50.444 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:28:50.445 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:28:50.445 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:28:50.445 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:28:50.445 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:28:50.446 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:28:50.446 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.446 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "171", 2021-10-08T19:28:50.446 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:28:50.446 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:28:50.447 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "170", 2021-10-08T19:28:50.447 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:28:50.447 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:28:50.447 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:28:50.447 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:28:50.448 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:28:50.448 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:28:50.448 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:28:50.448 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:28:50.449 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:28:50.449 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:28:50.449 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:28:50.449 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:28:50.450 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:28:50.450 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:28:50.450 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:28:50.451 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:28:50.451 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:28:50.451 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:28:50.452 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:28:50.452 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:28:50.452 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:28:50.452 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:28:50.452 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:28:50.453 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.453 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:28:50.453 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:28:50.454 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:28:50.454 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:28:50.454 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:28:50.454 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:28:50.455 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:28:50.455 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:28:50.455 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:28:50.455 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:28:50.455 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:28:50.456 INFO:teuthology.orchestra.run.smithi097.stdout: "options": { 2021-10-08T19:28:50.456 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_min": 1 2021-10-08T19:28:50.456 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.456 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:28:50.457 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": {} 2021-10-08T19:28:50.457 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:28:50.457 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.457 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.458 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 2, 2021-10-08T19:28:50.458 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": ".rgw.root", 2021-10-08T19:28:50.458 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:21:21.940881+0000", 2021-10-08T19:28:50.458 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:28:50.458 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:28:50.459 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:28:50.459 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:28:50.459 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:28:50.459 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:28:50.460 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:28:50.460 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:28:50.460 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:28:50.461 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:28:50.461 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:28:50.461 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:28:50.462 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 32, 2021-10-08T19:28:50.462 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 32, 2021-10-08T19:28:50.462 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 32, 2021-10-08T19:28:50.462 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 32, 2021-10-08T19:28:50.462 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 32, 2021-10-08T19:28:50.463 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:28:50.463 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:28:50.463 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:28:50.463 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:28:50.464 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:28:50.464 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:28:50.464 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:28:50.464 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.464 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "62", 2021-10-08T19:28:50.465 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:28:50.465 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:28:50.465 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2021-10-08T19:28:50.465 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:28:50.466 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:28:50.466 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:28:50.466 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:28:50.466 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:28:50.466 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:28:50.467 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:28:50.467 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:28:50.467 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:28:50.467 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:28:50.468 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:28:50.468 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:28:50.468 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:28:50.468 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:28:50.468 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:28:50.469 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:28:50.469 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:28:50.469 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:28:50.469 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:28:50.469 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:28:50.470 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:28:50.470 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:28:50.470 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:28:50.471 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.471 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:28:50.471 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:28:50.471 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:28:50.472 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:28:50.472 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:28:50.472 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:28:50.473 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:28:50.473 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:28:50.474 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:28:50.474 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:28:50.475 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:28:50.475 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2021-10-08T19:28:50.475 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:28:50.476 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw": {} 2021-10-08T19:28:50.476 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:28:50.477 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.477 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.477 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 3, 2021-10-08T19:28:50.478 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "iscsi", 2021-10-08T19:28:50.478 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:21:22.536945+0000", 2021-10-08T19:28:50.478 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:28:50.478 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:28:50.479 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:28:50.479 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:28:50.479 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:28:50.479 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:28:50.480 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:28:50.480 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:28:50.480 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:28:50.480 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:28:50.481 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:28:50.481 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:28:50.481 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 23, 2021-10-08T19:28:50.482 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 23, 2021-10-08T19:28:50.482 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 23, 2021-10-08T19:28:50.482 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 23, 2021-10-08T19:28:50.482 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 23, 2021-10-08T19:28:50.483 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:28:50.483 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:28:50.483 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:28:50.483 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:28:50.484 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:28:50.484 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:28:50.484 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:28:50.484 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.484 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "132", 2021-10-08T19:28:50.485 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:28:50.485 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:28:50.485 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "131", 2021-10-08T19:28:50.485 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:28:50.486 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:28:50.486 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:28:50.486 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:28:50.486 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:28:50.487 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:28:50.487 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:28:50.487 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:28:50.487 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:28:50.488 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:28:50.488 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:28:50.488 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:28:50.489 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:28:50.489 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:28:50.490 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:28:50.490 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:28:50.491 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:28:50.491 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:28:50.492 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:28:50.492 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:28:50.493 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:28:50.493 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:28:50.493 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:28:50.494 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.494 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:28:50.495 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:28:50.495 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:28:50.496 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:28:50.496 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:28:50.496 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:28:50.497 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:28:50.497 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:28:50.498 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:28:50.498 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:28:50.498 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:28:50.499 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2021-10-08T19:28:50.499 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:28:50.500 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd": {} 2021-10-08T19:28:50.500 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:28:50.500 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.501 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.501 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 4, 2021-10-08T19:28:50.502 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "default.rgw.log", 2021-10-08T19:28:50.502 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:21:23.886328+0000", 2021-10-08T19:28:50.502 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:28:50.503 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:28:50.503 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:28:50.504 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:28:50.504 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:28:50.504 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:28:50.505 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:28:50.505 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:28:50.506 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:28:50.506 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:28:50.506 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:28:50.507 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:28:50.507 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 32, 2021-10-08T19:28:50.507 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 32, 2021-10-08T19:28:50.508 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 32, 2021-10-08T19:28:50.508 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 32, 2021-10-08T19:28:50.509 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 32, 2021-10-08T19:28:50.509 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:28:50.509 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:28:50.510 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:28:50.510 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:28:50.511 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:28:50.511 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:28:50.511 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:28:50.512 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.513 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "64", 2021-10-08T19:28:50.513 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:28:50.513 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:28:50.514 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2021-10-08T19:28:50.514 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:28:50.515 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:28:50.515 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:28:50.515 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:28:50.516 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:28:50.516 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:28:50.516 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:28:50.517 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:28:50.517 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:28:50.517 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:28:50.518 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:28:50.518 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:28:50.519 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:28:50.519 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:28:50.519 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:28:50.520 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:28:50.520 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:28:50.521 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:28:50.521 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:28:50.522 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:28:50.522 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:28:50.522 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:28:50.523 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:28:50.523 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.524 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:28:50.524 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:28:50.525 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:28:50.525 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:28:50.526 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:28:50.526 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:28:50.526 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:28:50.527 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:28:50.527 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:28:50.528 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:28:50.528 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:28:50.529 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2021-10-08T19:28:50.529 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:28:50.530 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw": {} 2021-10-08T19:28:50.530 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:28:50.530 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.531 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.531 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 5, 2021-10-08T19:28:50.532 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "default.rgw.control", 2021-10-08T19:28:50.532 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:21:25.865032+0000", 2021-10-08T19:28:50.533 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:28:50.533 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:28:50.534 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:28:50.534 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:28:50.534 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:28:50.535 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:28:50.535 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:28:50.535 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:28:50.536 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:28:50.536 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:28:50.536 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:28:50.536 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:28:50.536 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 32, 2021-10-08T19:28:50.537 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 32, 2021-10-08T19:28:50.537 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 32, 2021-10-08T19:28:50.537 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 32, 2021-10-08T19:28:50.537 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 32, 2021-10-08T19:28:50.538 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:28:50.538 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:28:50.538 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:28:50.538 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:28:50.539 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:28:50.539 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:28:50.539 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:28:50.539 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.539 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "66", 2021-10-08T19:28:50.540 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:28:50.540 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:28:50.540 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2021-10-08T19:28:50.540 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:28:50.540 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:28:50.541 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:28:50.541 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:28:50.541 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:28:50.541 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:28:50.542 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:28:50.542 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:28:50.542 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:28:50.542 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:28:50.542 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:28:50.543 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:28:50.543 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:28:50.543 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:28:50.543 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:28:50.543 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:28:50.544 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:28:50.544 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:28:50.544 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:28:50.544 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:28:50.545 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:28:50.545 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:28:50.545 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:28:50.545 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.545 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:28:50.546 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:28:50.546 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:28:50.546 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:28:50.546 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:28:50.546 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:28:50.547 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:28:50.547 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:28:50.547 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:28:50.547 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:28:50.548 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:28:50.548 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2021-10-08T19:28:50.548 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:28:50.548 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw": {} 2021-10-08T19:28:50.548 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:28:50.549 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.549 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.549 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 6, 2021-10-08T19:28:50.549 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "default.rgw.meta", 2021-10-08T19:28:50.549 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:21:27.940767+0000", 2021-10-08T19:28:50.550 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:28:50.550 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:28:50.550 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:28:50.550 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:28:50.551 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:28:50.551 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:28:50.551 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:28:50.551 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:28:50.551 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:28:50.552 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:28:50.552 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:28:50.552 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:28:50.552 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 32, 2021-10-08T19:28:50.553 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 32, 2021-10-08T19:28:50.553 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 32, 2021-10-08T19:28:50.553 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 32, 2021-10-08T19:28:50.553 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 32, 2021-10-08T19:28:50.553 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:28:50.554 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:28:50.554 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:28:50.554 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:28:50.554 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:28:50.554 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:28:50.555 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:28:50.555 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.555 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "69", 2021-10-08T19:28:50.555 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:28:50.556 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:28:50.556 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2021-10-08T19:28:50.556 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:28:50.556 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:28:50.556 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:28:50.557 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:28:50.557 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:28:50.557 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:28:50.557 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:28:50.558 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:28:50.558 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:28:50.558 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:28:50.558 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:28:50.558 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:28:50.559 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:28:50.559 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:28:50.559 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:28:50.559 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:28:50.560 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:28:50.560 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:28:50.560 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:28:50.560 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:28:50.560 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:28:50.561 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:28:50.561 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:28:50.561 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.561 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:28:50.561 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:28:50.562 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:28:50.562 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:28:50.562 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:28:50.562 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:28:50.563 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:28:50.563 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:28:50.563 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:28:50.563 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:28:50.563 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:28:50.564 INFO:teuthology.orchestra.run.smithi097.stdout: "options": { 2021-10-08T19:28:50.564 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_bias": 4, 2021-10-08T19:28:50.564 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_min": 8 2021-10-08T19:28:50.564 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.565 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:28:50.565 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw": {} 2021-10-08T19:28:50.565 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:28:50.565 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.565 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.566 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 8, 2021-10-08T19:28:50.566 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "unique_pool_1", 2021-10-08T19:28:50.566 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:27:42.154204+0000", 2021-10-08T19:28:50.566 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:28:50.566 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:28:50.567 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:28:50.567 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:28:50.567 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:28:50.567 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:28:50.568 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:28:50.568 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:28:50.568 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:28:50.568 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:28:50.568 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:28:50.569 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:28:50.569 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 16, 2021-10-08T19:28:50.569 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 16, 2021-10-08T19:28:50.569 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 16, 2021-10-08T19:28:50.570 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 16, 2021-10-08T19:28:50.570 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 16, 2021-10-08T19:28:50.570 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:28:50.570 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:28:50.570 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:28:50.571 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:28:50.571 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:28:50.571 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:28:50.571 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:28:50.571 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.572 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "187", 2021-10-08T19:28:50.572 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:28:50.572 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:28:50.572 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2021-10-08T19:28:50.572 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:28:50.573 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:28:50.573 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:28:50.573 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:28:50.573 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:28:50.574 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:28:50.574 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:28:50.574 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:28:50.574 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:28:50.574 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:28:50.575 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:28:50.575 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:28:50.575 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:28:50.575 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:28:50.575 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:28:50.576 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:28:50.576 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:28:50.576 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:28:50.576 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:28:50.577 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:28:50.577 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:28:50.577 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:28:50.577 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:28:50.577 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.578 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:28:50.578 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:28:50.578 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:28:50.578 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:28:50.578 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:28:50.579 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:28:50.579 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:28:50.579 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:28:50.579 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:28:50.580 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:28:50.580 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:28:50.580 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2021-10-08T19:28:50.580 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:28:50.580 INFO:teuthology.orchestra.run.smithi097.stdout: "rados": {} 2021-10-08T19:28:50.581 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:28:50.581 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:28:50.581 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:28:50.581 INFO:teuthology.orchestra.run.smithi097.stdout: "osds": [ 2021-10-08T19:28:50.581 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.582 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 0, 2021-10-08T19:28:50.582 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "9e64e714-a5d5-4fbb-ae2b-1df4bf14b8e0", 2021-10-08T19:28:50.582 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:28:50.582 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:28:50.583 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:28:50.583 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:28:50.583 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:28:50.583 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:28:50.583 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 8, 2021-10-08T19:28:50.584 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 207, 2021-10-08T19:28:50.584 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:28:50.584 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:28:50.584 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:28:50.585 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:28:50.585 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.585 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:28:50.585 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6801", 2021-10-08T19:28:50.585 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3354161282 2021-10-08T19:28:50.586 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:28:50.586 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:28:50.586 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.586 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:28:50.586 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:28:50.587 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.587 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:28:50.587 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6802", 2021-10-08T19:28:50.587 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3354161282 2021-10-08T19:28:50.587 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:28:50.588 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:28:50.588 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.588 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:28:50.588 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:28:50.589 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.589 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:28:50.589 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6804", 2021-10-08T19:28:50.589 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3354161282 2021-10-08T19:28:50.589 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:28:50.590 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:28:50.590 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.590 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:28:50.590 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:28:50.590 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.591 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:28:50.591 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6803", 2021-10-08T19:28:50.591 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3354161282 2021-10-08T19:28:50.591 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:28:50.591 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:28:50.592 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.592 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.97:6801/3354161282", 2021-10-08T19:28:50.592 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.97:6802/3354161282", 2021-10-08T19:28:50.592 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.97:6804/3354161282", 2021-10-08T19:28:50.593 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.97:6803/3354161282", 2021-10-08T19:28:50.593 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:28:50.593 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:28:50.593 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:28:50.593 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:28:50.594 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.594 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.594 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 1, 2021-10-08T19:28:50.594 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "32602a22-f263-4b62-a8d8-50fddfb73fa8", 2021-10-08T19:28:50.594 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:28:50.595 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:28:50.595 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:28:50.595 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:28:50.595 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:28:50.596 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:28:50.596 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 13, 2021-10-08T19:28:50.596 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 209, 2021-10-08T19:28:50.596 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:28:50.596 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:28:50.597 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:28:50.597 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:28:50.597 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.597 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:28:50.597 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6805", 2021-10-08T19:28:50.598 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 735799205 2021-10-08T19:28:50.598 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:28:50.598 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:28:50.598 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.598 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:28:50.599 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:28:50.599 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.599 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:28:50.599 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6806", 2021-10-08T19:28:50.600 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 735799205 2021-10-08T19:28:50.600 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:28:50.600 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:28:50.600 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.600 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:28:50.601 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:28:50.601 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.601 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:28:50.601 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6808", 2021-10-08T19:28:50.601 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 735799205 2021-10-08T19:28:50.602 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:28:50.602 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:28:50.602 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.602 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:28:50.603 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:28:50.603 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.603 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:28:50.603 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6807", 2021-10-08T19:28:50.603 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 735799205 2021-10-08T19:28:50.604 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:28:50.604 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:28:50.604 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.604 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.97:6805/735799205", 2021-10-08T19:28:50.604 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.97:6806/735799205", 2021-10-08T19:28:50.605 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.97:6808/735799205", 2021-10-08T19:28:50.605 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.97:6807/735799205", 2021-10-08T19:28:50.605 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:28:50.605 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:28:50.605 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:28:50.606 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:28:50.606 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.606 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.606 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 2, 2021-10-08T19:28:50.607 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "88e0e4a2-b4a3-4a00-8669-03c3d9b166c5", 2021-10-08T19:28:50.607 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:28:50.607 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:28:50.607 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:28:50.607 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:28:50.608 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:28:50.608 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:28:50.608 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 18, 2021-10-08T19:28:50.608 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 208, 2021-10-08T19:28:50.608 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:28:50.609 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:28:50.609 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:28:50.609 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:28:50.609 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.609 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:28:50.610 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6809", 2021-10-08T19:28:50.610 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2366482649 2021-10-08T19:28:50.610 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:28:50.610 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:28:50.611 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.611 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:28:50.611 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:28:50.611 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.611 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:28:50.612 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6810", 2021-10-08T19:28:50.612 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2366482649 2021-10-08T19:28:50.612 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:28:50.612 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:28:50.613 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.613 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:28:50.613 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:28:50.613 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.613 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:28:50.614 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6812", 2021-10-08T19:28:50.614 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2366482649 2021-10-08T19:28:50.614 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:28:50.614 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:28:50.614 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.615 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:28:50.615 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:28:50.615 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.615 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:28:50.616 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6811", 2021-10-08T19:28:50.616 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2366482649 2021-10-08T19:28:50.616 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:28:50.616 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:28:50.616 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.617 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.97:6809/2366482649", 2021-10-08T19:28:50.617 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.97:6810/2366482649", 2021-10-08T19:28:50.617 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.97:6812/2366482649", 2021-10-08T19:28:50.617 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.97:6811/2366482649", 2021-10-08T19:28:50.617 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:28:50.618 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:28:50.618 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:28:50.618 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:28:50.618 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.618 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.619 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 3, 2021-10-08T19:28:50.619 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "e689d708-b501-4526-a31a-1e598b74654d", 2021-10-08T19:28:50.619 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:28:50.619 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:28:50.620 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:28:50.620 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:28:50.620 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:28:50.620 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:28:50.620 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 24, 2021-10-08T19:28:50.621 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 202, 2021-10-08T19:28:50.621 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:28:50.621 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:28:50.621 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:28:50.621 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:28:50.622 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.622 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:28:50.622 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6813", 2021-10-08T19:28:50.622 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3191181122 2021-10-08T19:28:50.623 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:28:50.623 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:28:50.623 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.623 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:28:50.623 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:28:50.624 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.624 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:28:50.624 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6814", 2021-10-08T19:28:50.624 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3191181122 2021-10-08T19:28:50.624 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:28:50.625 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:28:50.625 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.625 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:28:50.625 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:28:50.626 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.626 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:28:50.626 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6816", 2021-10-08T19:28:50.626 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3191181122 2021-10-08T19:28:50.626 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:28:50.627 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:28:50.627 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.627 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:28:50.627 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:28:50.627 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.628 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:28:50.628 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6815", 2021-10-08T19:28:50.628 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3191181122 2021-10-08T19:28:50.628 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:28:50.629 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:28:50.629 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.629 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.97:6813/3191181122", 2021-10-08T19:28:50.629 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.97:6814/3191181122", 2021-10-08T19:28:50.629 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.97:6816/3191181122", 2021-10-08T19:28:50.630 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.97:6815/3191181122", 2021-10-08T19:28:50.630 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:28:50.630 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:28:50.630 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:28:50.630 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:28:50.631 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.631 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.631 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 4, 2021-10-08T19:28:50.631 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "67e4730a-be1c-4d88-9307-e3c2cf3ab2ef", 2021-10-08T19:28:50.632 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:28:50.632 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:28:50.632 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:28:50.632 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:28:50.632 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:28:50.633 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:28:50.633 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 30, 2021-10-08T19:28:50.633 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 204, 2021-10-08T19:28:50.633 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:28:50.633 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:28:50.634 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:28:50.634 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:28:50.634 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.634 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:28:50.634 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6800", 2021-10-08T19:28:50.635 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 106778208 2021-10-08T19:28:50.635 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:28:50.635 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:28:50.635 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.636 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:28:50.636 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:28:50.636 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.636 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:28:50.636 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6801", 2021-10-08T19:28:50.637 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 106778208 2021-10-08T19:28:50.637 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:28:50.637 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:28:50.637 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.637 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:28:50.638 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:28:50.638 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.638 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:28:50.638 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6803", 2021-10-08T19:28:50.639 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 106778208 2021-10-08T19:28:50.639 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:28:50.639 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:28:50.639 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.639 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:28:50.640 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:28:50.640 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.640 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:28:50.640 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6802", 2021-10-08T19:28:50.640 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 106778208 2021-10-08T19:28:50.641 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:28:50.641 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:28:50.641 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.641 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.117:6800/106778208", 2021-10-08T19:28:50.642 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.117:6801/106778208", 2021-10-08T19:28:50.642 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.117:6803/106778208", 2021-10-08T19:28:50.642 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.117:6802/106778208", 2021-10-08T19:28:50.642 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:28:50.642 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:28:50.643 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:28:50.643 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:28:50.643 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.643 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.643 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 5, 2021-10-08T19:28:50.644 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "f9fd3153-3e4e-4489-8927-a65641f05d42", 2021-10-08T19:28:50.644 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:28:50.644 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:28:50.644 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:28:50.644 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:28:50.645 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:28:50.645 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:28:50.645 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 38, 2021-10-08T19:28:50.645 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 202, 2021-10-08T19:28:50.646 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:28:50.646 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:28:50.646 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:28:50.646 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:28:50.646 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.647 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:28:50.647 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6804", 2021-10-08T19:28:50.647 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3199889891 2021-10-08T19:28:50.647 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:28:50.647 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:28:50.648 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.648 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:28:50.648 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:28:50.648 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.648 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:28:50.649 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6805", 2021-10-08T19:28:50.649 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3199889891 2021-10-08T19:28:50.649 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:28:50.649 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:28:50.649 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.650 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:28:50.650 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:28:50.650 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.650 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:28:50.651 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6807", 2021-10-08T19:28:50.651 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3199889891 2021-10-08T19:28:50.651 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:28:50.651 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:28:50.651 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.652 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:28:50.652 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:28:50.652 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.652 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:28:50.652 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6806", 2021-10-08T19:28:50.653 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3199889891 2021-10-08T19:28:50.653 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:28:50.653 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:28:50.653 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.654 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.117:6804/3199889891", 2021-10-08T19:28:50.654 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.117:6805/3199889891", 2021-10-08T19:28:50.654 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.117:6807/3199889891", 2021-10-08T19:28:50.654 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.117:6806/3199889891", 2021-10-08T19:28:50.654 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:28:50.655 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:28:50.655 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:28:50.655 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:28:50.655 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.655 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.656 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 6, 2021-10-08T19:28:50.656 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "84898f12-c37d-4eb6-8b71-5b86bfe16e7d", 2021-10-08T19:28:50.656 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:28:50.656 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:28:50.657 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:28:50.657 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:28:50.657 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:28:50.657 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:28:50.657 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 47, 2021-10-08T19:28:50.658 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 202, 2021-10-08T19:28:50.658 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:28:50.658 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:28:50.658 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:28:50.658 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:28:50.659 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.659 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:28:50.659 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6808", 2021-10-08T19:28:50.659 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2185843951 2021-10-08T19:28:50.660 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:28:50.660 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:28:50.660 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.660 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:28:50.660 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:28:50.661 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.661 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:28:50.661 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6809", 2021-10-08T19:28:50.661 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2185843951 2021-10-08T19:28:50.662 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:28:50.662 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:28:50.662 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.662 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:28:50.662 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:28:50.663 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.663 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:28:50.663 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6811", 2021-10-08T19:28:50.663 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2185843951 2021-10-08T19:28:50.663 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:28:50.664 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:28:50.664 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.664 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:28:50.664 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:28:50.665 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.665 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:28:50.665 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6810", 2021-10-08T19:28:50.665 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2185843951 2021-10-08T19:28:50.665 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:28:50.666 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:28:50.666 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.666 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.117:6808/2185843951", 2021-10-08T19:28:50.666 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.117:6809/2185843951", 2021-10-08T19:28:50.666 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.117:6811/2185843951", 2021-10-08T19:28:50.667 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.117:6810/2185843951", 2021-10-08T19:28:50.667 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:28:50.667 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:28:50.667 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:28:50.667 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:28:50.668 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.668 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.668 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 7, 2021-10-08T19:28:50.668 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "529af2ce-2ae9-41ed-8c8e-d133628cfd20", 2021-10-08T19:28:50.669 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:28:50.669 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:28:50.669 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:28:50.669 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:28:50.669 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:28:50.670 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:28:50.670 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 55, 2021-10-08T19:28:50.670 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 202, 2021-10-08T19:28:50.670 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:28:50.670 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:28:50.671 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:28:50.671 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:28:50.671 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.671 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:28:50.672 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6812", 2021-10-08T19:28:50.672 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2817683239 2021-10-08T19:28:50.672 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:28:50.672 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:28:50.672 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.673 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:28:50.673 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:28:50.673 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.673 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:28:50.673 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6813", 2021-10-08T19:28:50.674 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2817683239 2021-10-08T19:28:50.674 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:28:50.674 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:28:50.674 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.675 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:28:50.675 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:28:50.675 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.675 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:28:50.675 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6815", 2021-10-08T19:28:50.676 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2817683239 2021-10-08T19:28:50.676 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:28:50.676 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:28:50.676 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.676 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:28:50.677 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:28:50.677 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.677 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:28:50.677 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6814", 2021-10-08T19:28:50.678 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2817683239 2021-10-08T19:28:50.678 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:28:50.678 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:28:50.678 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.678 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.117:6812/2817683239", 2021-10-08T19:28:50.679 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.117:6813/2817683239", 2021-10-08T19:28:50.679 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.117:6815/2817683239", 2021-10-08T19:28:50.679 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.117:6814/2817683239", 2021-10-08T19:28:50.679 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:28:50.679 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:28:50.680 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:28:50.680 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:28:50.680 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:28:50.680 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:28:50.681 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_xinfo": [ 2021-10-08T19:28:50.681 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.681 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 0, 2021-10-08T19:28:50.681 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:28:50.681 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:28:50.682 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:28:50.682 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:28:50.682 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:28:50.682 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:28:19.943929+0000", 2021-10-08T19:28:50.682 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:28:50.683 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.683 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.683 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 1, 2021-10-08T19:28:50.683 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:28:50.683 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:28:50.684 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:28:50.684 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:28:50.684 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:28:50.684 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:28:24.404876+0000", 2021-10-08T19:28:50.685 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:28:50.685 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.685 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.685 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 2, 2021-10-08T19:28:50.685 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:28:50.686 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:28:50.686 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:28:50.686 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:28:50.686 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:28:50.686 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:27:56.606479+0000", 2021-10-08T19:28:50.687 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:28:50.687 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.687 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.687 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 3, 2021-10-08T19:28:50.688 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:28:50.688 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:28:50.688 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:28:50.688 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:28:50.688 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:28:50.689 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:28:07.083742+0000", 2021-10-08T19:28:50.689 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:28:50.689 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.689 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.689 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 4, 2021-10-08T19:28:50.690 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:28:50.690 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:28:50.690 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:28:50.690 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:28:50.691 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:28:50.691 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:28:06.186074+0000", 2021-10-08T19:28:50.691 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:28:50.691 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.691 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.692 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 5, 2021-10-08T19:28:50.692 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:28:50.692 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:28:50.692 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:28:50.693 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:28:50.693 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:28:50.693 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:27:59.001132+0000", 2021-10-08T19:28:50.693 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:28:50.693 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.694 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.694 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 6, 2021-10-08T19:28:50.694 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:28:50.694 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:28:50.695 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:28:50.695 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:28:50.695 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:28:50.695 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:28:44.030698+0000", 2021-10-08T19:28:50.695 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:28:50.696 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.696 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.696 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 7, 2021-10-08T19:28:50.696 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:28:50.696 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:28:50.697 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:28:50.697 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:28:50.697 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:28:50.697 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:28:42.173203+0000", 2021-10-08T19:28:50.697 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:28:50.698 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:28:50.698 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:28:50.698 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_upmap": [], 2021-10-08T19:28:50.698 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_upmap_items": [ 2021-10-08T19:28:50.699 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.699 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "2.0", 2021-10-08T19:28:50.699 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:28:50.699 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.699 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 7, 2021-10-08T19:28:50.700 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 2 2021-10-08T19:28:50.700 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:28:50.700 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:28:50.700 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.700 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.701 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "2.1a", 2021-10-08T19:28:50.701 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:28:50.701 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.701 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 7, 2021-10-08T19:28:50.701 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 2 2021-10-08T19:28:50.702 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:28:50.702 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:28:50.702 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.702 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.703 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "4.14", 2021-10-08T19:28:50.703 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:28:50.703 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.703 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 3, 2021-10-08T19:28:50.703 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 2 2021-10-08T19:28:50.704 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:28:50.704 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:28:50.704 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.704 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.705 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "5.19", 2021-10-08T19:28:50.705 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:28:50.705 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.705 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 5, 2021-10-08T19:28:50.705 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 7 2021-10-08T19:28:50.706 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:28:50.706 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:28:50.706 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:28:50.706 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:28:50.706 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_temp": [ 2021-10-08T19:28:50.707 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.707 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "8.0", 2021-10-08T19:28:50.707 INFO:teuthology.orchestra.run.smithi097.stdout: "osds": [ 2021-10-08T19:28:50.707 INFO:teuthology.orchestra.run.smithi097.stdout: 3, 2021-10-08T19:28:50.707 INFO:teuthology.orchestra.run.smithi097.stdout: 5 2021-10-08T19:28:50.708 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:28:50.708 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.708 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.708 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "8.3", 2021-10-08T19:28:50.709 INFO:teuthology.orchestra.run.smithi097.stdout: "osds": [ 2021-10-08T19:28:50.709 INFO:teuthology.orchestra.run.smithi097.stdout: 5, 2021-10-08T19:28:50.709 INFO:teuthology.orchestra.run.smithi097.stdout: 6 2021-10-08T19:28:50.709 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:28:50.709 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.710 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.710 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "8.7", 2021-10-08T19:28:50.710 INFO:teuthology.orchestra.run.smithi097.stdout: "osds": [ 2021-10-08T19:28:50.710 INFO:teuthology.orchestra.run.smithi097.stdout: 3, 2021-10-08T19:28:50.710 INFO:teuthology.orchestra.run.smithi097.stdout: 6 2021-10-08T19:28:50.711 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:28:50.711 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.711 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.711 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "8.b", 2021-10-08T19:28:50.712 INFO:teuthology.orchestra.run.smithi097.stdout: "osds": [ 2021-10-08T19:28:50.712 INFO:teuthology.orchestra.run.smithi097.stdout: 3, 2021-10-08T19:28:50.712 INFO:teuthology.orchestra.run.smithi097.stdout: 4 2021-10-08T19:28:50.712 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:28:50.712 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.713 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:28:50.713 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "8.f", 2021-10-08T19:28:50.713 INFO:teuthology.orchestra.run.smithi097.stdout: "osds": [ 2021-10-08T19:28:50.713 INFO:teuthology.orchestra.run.smithi097.stdout: 3, 2021-10-08T19:28:50.713 INFO:teuthology.orchestra.run.smithi097.stdout: 2 2021-10-08T19:28:50.714 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:28:50.714 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:28:50.714 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:28:50.714 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_temp": [], 2021-10-08T19:28:50.715 INFO:teuthology.orchestra.run.smithi097.stdout: "blocklist": { 2021-10-08T19:28:50.715 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/2600364788": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:28:50.715 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/4129083289": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:28:50.715 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/1443158975": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:28:50.715 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/2472640384": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:28:50.716 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/3196919488": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:28:50.716 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:6800/3195862546": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:28:50.716 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:6800/3931202434": "2021-10-09T19:17:10.051948+0000", 2021-10-08T19:28:50.716 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/2761595213": "2021-10-09T19:17:10.051948+0000", 2021-10-08T19:28:50.716 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/900681504": "2021-10-09T19:17:10.051948+0000", 2021-10-08T19:28:50.717 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/3932251406": "2021-10-09T19:17:10.051948+0000", 2021-10-08T19:28:50.717 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/398006785": "2021-10-09T19:16:48.651177+0000", 2021-10-08T19:28:50.717 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/1642570050": "2021-10-09T19:16:48.651177+0000", 2021-10-08T19:28:50.717 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/300178790": "2021-10-09T19:16:48.651177+0000", 2021-10-08T19:28:50.717 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:6800/845999767": "2021-10-09T19:16:48.651177+0000" 2021-10-08T19:28:50.718 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.718 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profiles": { 2021-10-08T19:28:50.718 INFO:teuthology.orchestra.run.smithi097.stdout: "default": { 2021-10-08T19:28:50.718 INFO:teuthology.orchestra.run.smithi097.stdout: "crush-failure-domain": "osd", 2021-10-08T19:28:50.719 INFO:teuthology.orchestra.run.smithi097.stdout: "k": "2", 2021-10-08T19:28:50.719 INFO:teuthology.orchestra.run.smithi097.stdout: "m": "1", 2021-10-08T19:28:50.719 INFO:teuthology.orchestra.run.smithi097.stdout: "plugin": "jerasure", 2021-10-08T19:28:50.719 INFO:teuthology.orchestra.run.smithi097.stdout: "technique": "reed_sol_van" 2021-10-08T19:28:50.719 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:28:50.720 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:28:50.720 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps_queue": [], 2021-10-08T19:28:50.720 INFO:teuthology.orchestra.run.smithi097.stdout: "new_removed_snaps": [], 2021-10-08T19:28:50.720 INFO:teuthology.orchestra.run.smithi097.stdout: "new_purged_snaps": [], 2021-10-08T19:28:50.720 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_node_flags": {}, 2021-10-08T19:28:50.721 INFO:teuthology.orchestra.run.smithi097.stdout: "device_class_flags": {}, 2021-10-08T19:28:50.721 INFO:teuthology.orchestra.run.smithi097.stdout: "stretch_mode": { 2021-10-08T19:28:50.721 INFO:teuthology.orchestra.run.smithi097.stdout: "stretch_mode_enabled": false, 2021-10-08T19:28:50.721 INFO:teuthology.orchestra.run.smithi097.stdout: "stretch_bucket_count": 0, 2021-10-08T19:28:50.722 INFO:teuthology.orchestra.run.smithi097.stdout: "degraded_stretch_mode": 0, 2021-10-08T19:28:50.722 INFO:teuthology.orchestra.run.smithi097.stdout: "recovering_stretch_mode": 0, 2021-10-08T19:28:50.722 INFO:teuthology.orchestra.run.smithi097.stdout: "stretch_mode_bucket": 0 2021-10-08T19:28:50.722 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:28:50.722 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:28:50.723 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2021-10-08T19:28:50.724 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 59 16 73552 73536 77.8539 0 - 0.0122897 2021-10-08T19:28:50.724 INFO:journalctl@ceph.osd.0.smithi097.stdout:Oct 08 19:28:50 smithi097 conmon[47373]: 2021-10-08T19:28:50.290+0000 7f833178a700 -1 osd.0 pg_epoch: 210 pg[5.5( empty local-lis/les=202/203 n=0 ec=64/64 lis/c=202/202 les/c/f=203/203/0 sis=202) [0,1,4] r=0 lpr=202 crt=0'0 mlcod 0'0 active+clean] scrubber pg(5.5) handle_scrub_reserve_grant: received unsolicited reservation grant from osd 4 (0x55cbf8e689a0) 2021-10-08T19:28:51.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:50 smithi117 ceph-mon[34585]: osdmap e210: 8 total, 8 up, 8 in 2021-10-08T19:28:51.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:50 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1650991161' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2021-10-08T19:28:51.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:50 smithi117 ceph-mon[34585]: Health check update: Degraded data redundancy: 2357/213825 objects degraded (1.102%), 5 pgs degraded (PG_DEGRADED) 2021-10-08T19:28:51.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:50 smithi117 ceph-mon[34585]: osdmap e211: 8 total, 8 up, 8 in 2021-10-08T19:28:51.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:50 smithi097 ceph-mon[41966]: osdmap e210: 8 total, 8 up, 8 in 2021-10-08T19:28:51.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:50 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1650991161' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2021-10-08T19:28:51.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:50 smithi097 ceph-mon[41966]: Health check update: Degraded data redundancy: 2357/213825 objects degraded (1.102%), 5 pgs degraded (PG_DEGRADED) 2021-10-08T19:28:51.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:50 smithi097 ceph-mon[41966]: osdmap e211: 8 total, 8 up, 8 in 2021-10-08T19:28:51.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:50 smithi097 ceph-mon[32687]: osdmap e210: 8 total, 8 up, 8 in 2021-10-08T19:28:51.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:50 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1650991161' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2021-10-08T19:28:51.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:50 smithi097 ceph-mon[32687]: Health check update: Degraded data redundancy: 2357/213825 objects degraded (1.102%), 5 pgs degraded (PG_DEGRADED) 2021-10-08T19:28:51.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:50 smithi097 ceph-mon[32687]: osdmap e211: 8 total, 8 up, 8 in 2021-10-08T19:28:51.685 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:2021-10-08T19:28:51.685198+0000 min lat: 0.00104309 max lat: 2.50582 avg lat: 0.0122897 2021-10-08T19:28:51.685 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2021-10-08T19:28:51.686 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 60 16 73552 73536 76.557 0 - 0.0122897 2021-10-08T19:28:51.875 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:28:51.876 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:51.876 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:28:51.978 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:28:51.983 INFO:tasks.thrashosds.thrasher:j is {'epoch': 210, 'fsid': '1d01f6d6-286c-11ec-8c25-001a4aab830c', 'created': '2021-10-08T19:16:25.258003+0000', 'modified': '2021-10-08T19:28:49.957863+0000', 'last_up_change': '2021-10-08T19:21:15.388758+0000', 'last_in_change': '2021-10-08T19:28:39.063019+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 18, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 8, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'quincy', 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2021-10-08T19:19:44.413311+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 11, 'pg_placement_num': 11, 'pg_placement_num_target': 11, 'pg_num_target': 11, 'pg_num_pending': 11, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '171', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '170', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': '.rgw.root', 'create_time': '2021-10-08T19:21:21.940881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 3, 'pool_name': 'iscsi', 'create_time': '2021-10-08T19:21:22.536945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 23, 'pg_placement_num': 23, 'pg_placement_num_target': 23, 'pg_num_target': 23, 'pg_num_pending': 23, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '132', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '131', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 4, 'pool_name': 'default.rgw.log', 'create_time': '2021-10-08T19:21:23.886328+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 5, 'pool_name': 'default.rgw.control', 'create_time': '2021-10-08T19:21:25.865032+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 6, 'pool_name': 'default.rgw.meta', 'create_time': '2021-10-08T19:21:27.940767+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '69', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 8}, 'application_metadata': {'rgw': {}}}, {'pool': 8, 'pool_name': 'unique_pool_1', 'create_time': '2021-10-08T19:27:42.154204+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '187', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}], 'osds': [{'osd': 0, 'uuid': '9e64e714-a5d5-4fbb-ae2b-1df4bf14b8e0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 207, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6801', 'nonce': 3354161282}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6802', 'nonce': 3354161282}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6804', 'nonce': 3354161282}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6803', 'nonce': 3354161282}]}, 'public_addr': '172.21.15.97:6801/3354161282', 'cluster_addr': '172.21.15.97:6802/3354161282', 'heartbeat_back_addr': '172.21.15.97:6804/3354161282', 'heartbeat_front_addr': '172.21.15.97:6803/3354161282', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '32602a22-f263-4b62-a8d8-50fddfb73fa8', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 209, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6805', 'nonce': 735799205}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6806', 'nonce': 735799205}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6808', 'nonce': 735799205}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6807', 'nonce': 735799205}]}, 'public_addr': '172.21.15.97:6805/735799205', 'cluster_addr': '172.21.15.97:6806/735799205', 'heartbeat_back_addr': '172.21.15.97:6808/735799205', 'heartbeat_front_addr': '172.21.15.97:6807/735799205', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '88e0e4a2-b4a3-4a00-8669-03c3d9b166c5', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 18, 'up_thru': 208, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6809', 'nonce': 2366482649}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6810', 'nonce': 2366482649}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6812', 'nonce': 2366482649}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6811', 'nonce': 2366482649}]}, 'public_addr': '172.21.15.97:6809/2366482649', 'cluster_addr': '172.21.15.97:6810/2366482649', 'heartbeat_back_addr': '172.21.15.97:6812/2366482649', 'heartbeat_front_addr': '172.21.15.97:6811/2366482649', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': 'e689d708-b501-4526-a31a-1e598b74654d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 24, 'up_thru': 202, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6813', 'nonce': 3191181122}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6814', 'nonce': 3191181122}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6816', 'nonce': 3191181122}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6815', 'nonce': 3191181122}]}, 'public_addr': '172.21.15.97:6813/3191181122', 'cluster_addr': '172.21.15.97:6814/3191181122', 'heartbeat_back_addr': '172.21.15.97:6816/3191181122', 'heartbeat_front_addr': '172.21.15.97:6815/3191181122', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '67e4730a-be1c-4d88-9307-e3c2cf3ab2ef', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 30, 'up_thru': 204, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6800', 'nonce': 106778208}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6801', 'nonce': 106778208}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6803', 'nonce': 106778208}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6802', 'nonce': 106778208}]}, 'public_addr': '172.21.15.117:6800/106778208', 'cluster_addr': '172.21.15.117:6801/106778208', 'heartbeat_back_addr': '172.21.15.117:6803/106778208', 'heartbeat_front_addr': '172.21.15.117:6802/106778208', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'f9fd3153-3e4e-4489-8927-a65641f05d42', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 38, 'up_thru': 202, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6804', 'nonce': 3199889891}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6805', 'nonce': 3199889891}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6807', 'nonce': 3199889891}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6806', 'nonce': 3199889891}]}, 'public_addr': '172.21.15.117:6804/3199889891', 'cluster_addr': '172.21.15.117:6805/3199889891', 'heartbeat_back_addr': '172.21.15.117:6807/3199889891', 'heartbeat_front_addr': '172.21.15.117:6806/3199889891', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '84898f12-c37d-4eb6-8b71-5b86bfe16e7d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 47, 'up_thru': 202, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6808', 'nonce': 2185843951}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6809', 'nonce': 2185843951}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6811', 'nonce': 2185843951}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6810', 'nonce': 2185843951}]}, 'public_addr': '172.21.15.117:6808/2185843951', 'cluster_addr': '172.21.15.117:6809/2185843951', 'heartbeat_back_addr': '172.21.15.117:6811/2185843951', 'heartbeat_front_addr': '172.21.15.117:6810/2185843951', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '529af2ce-2ae9-41ed-8c8e-d133628cfd20', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 55, 'up_thru': 202, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6812', 'nonce': 2817683239}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6813', 'nonce': 2817683239}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6815', 'nonce': 2817683239}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6814', 'nonce': 2817683239}]}, 'public_addr': '172.21.15.117:6812/2817683239', 'cluster_addr': '172.21.15.117:6813/2817683239', 'heartbeat_back_addr': '172.21.15.117:6815/2817683239', 'heartbeat_front_addr': '172.21.15.117:6814/2817683239', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:28:19.943929+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:28:24.404876+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:27:56.606479+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:28:07.083742+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:28:06.186074+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:27:59.001132+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:28:44.030698+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:28:42.173203+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [{'pgid': '2.0', 'mappings': [{'from': 7, 'to': 2}]}, {'pgid': '2.1a', 'mappings': [{'from': 7, 'to': 2}]}, {'pgid': '4.14', 'mappings': [{'from': 3, 'to': 2}]}, {'pgid': '5.19', 'mappings': [{'from': 5, 'to': 7}]}], 'pg_temp': [{'pgid': '8.0', 'osds': [3, 5]}, {'pgid': '8.3', 'osds': [5, 6]}, {'pgid': '8.7', 'osds': [3, 6]}, {'pgid': '8.b', 'osds': [3, 4]}, {'pgid': '8.f', 'osds': [3, 2]}], 'primary_temp': [], 'blocklist': {'172.21.15.97:0/2600364788': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:0/4129083289': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:0/1443158975': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:0/2472640384': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:0/3196919488': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:6800/3195862546': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:6800/3931202434': '2021-10-09T19:17:10.051948+0000', '172.21.15.97:0/2761595213': '2021-10-09T19:17:10.051948+0000', '172.21.15.97:0/900681504': '2021-10-09T19:17:10.051948+0000', '172.21.15.97:0/3932251406': '2021-10-09T19:17:10.051948+0000', '172.21.15.97:0/398006785': '2021-10-09T19:16:48.651177+0000', '172.21.15.97:0/1642570050': '2021-10-09T19:16:48.651177+0000', '172.21.15.97:0/300178790': '2021-10-09T19:16:48.651177+0000', '172.21.15.97:6800/845999767': '2021-10-09T19:16:48.651177+0000'}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2021-10-08T19:28:51.984 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph pg dump --format=json 2021-10-08T19:28:52.001 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:52.043 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:28:52.046 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:52.047 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:28:52.149 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:28:52.172 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:51 smithi097 ceph-mon[32687]: pgmap v355: 178 pgs: 1 peering, 1 active+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 3 active+recovering+undersized+remapped, 171 active+clean; 4.5 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 70 MiB/s wr, 1.12k op/s; 1180/221193 objects degraded (0.533%); 1653/221193 objects misplaced (0.747%); 15 MiB/s, 245 objects/s recovering 2021-10-08T19:28:52.172 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:51 smithi097 ceph-mon[32687]: osdmap e212: 8 total, 8 up, 8 in 2021-10-08T19:28:52.172 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:51 smithi097 ceph-mon[41966]: pgmap v355: 178 pgs: 1 peering, 1 active+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 3 active+recovering+undersized+remapped, 171 active+clean; 4.5 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 70 MiB/s wr, 1.12k op/s; 1180/221193 objects degraded (0.533%); 1653/221193 objects misplaced (0.747%); 15 MiB/s, 245 objects/s recovering 2021-10-08T19:28:52.173 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:51 smithi097 ceph-mon[41966]: osdmap e212: 8 total, 8 up, 8 in 2021-10-08T19:28:52.175 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:52.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:51 smithi117 ceph-mon[34585]: pgmap v355: 178 pgs: 1 peering, 1 active+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 3 active+recovering+undersized+remapped, 171 active+clean; 4.5 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 70 MiB/s wr, 1.12k op/s; 1180/221193 objects degraded (0.533%); 1653/221193 objects misplaced (0.747%); 15 MiB/s, 245 objects/s recovering 2021-10-08T19:28:52.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:51 smithi117 ceph-mon[34585]: osdmap e212: 8 total, 8 up, 8 in 2021-10-08T19:28:52.436 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:28:52.438 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:52.439 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:28:52.527 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:28:52.540 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:28:52.563 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:52.588 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:28:52.606 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:28:52.608 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:52.609 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:28:52.685 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 61 16 73552 73536 75.3025 0 - 0.0122897 2021-10-08T19:28:52.696 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:28:52 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:28:52] "GET /metrics HTTP/1.1" 200 155843 "" "Prometheus/2.18.1" 2021-10-08T19:28:52.710 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:28:52.738 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:52.945 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:28:52.946 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2021-10-08T19:28:52.946 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2021-10-08T19:28:52.946 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2021-10-08T19:28:52.946 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:28:52.952 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:28:52.956 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:52.957 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:28:53.058 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:28:53.089 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:53.471 INFO:journalctl@ceph.osd.0.smithi097.stdout:Oct 08 19:28:53 smithi097 conmon[47373]: 2021-10-08T19:28:53.276+0000 7f8334f91700 -1 osd.0 pg_epoch: 213 pg[4.16( v 69'9 (0'0,69'9] local-lis/les=62/63 n=4 ec=62/62 lis/c=62/62 les/c/f=63/63/0 sis=62) [0,3,7] r=0 lpr=62 crt=69'9 lcod 69'8 mlcod 69'8 active+clean] scrubber pg(4.16) handle_scrub_reserve_grant: received unsolicited reservation grant from osd 7 (0x55cbf7e6cdc0) 2021-10-08T19:28:53.599 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:28:53.603 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:53.604 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:28:53.685 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 62 16 73552 73536 74.0885 0 - 0.0122897 2021-10-08T19:28:53.705 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:28:53.730 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:53.867 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:53 smithi117 ceph-mon[34585]: osdmap e213: 8 total, 8 up, 8 in 2021-10-08T19:28:53.868 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:53 smithi117 ceph-mon[34585]: pgmap v358: 178 pgs: 1 peering, 1 active+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 3 active+recovering+undersized+remapped, 171 active+clean; 4.5 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1180/221193 objects degraded (0.533%); 1653/221193 objects misplaced (0.747%) 2021-10-08T19:28:53.869 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:28:53 smithi117 conmon[69189]: level=error ts=2021-10-08T19:28:53.504Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=2 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:28:53.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:53 smithi097 ceph-mon[32687]: osdmap e213: 8 total, 8 up, 8 in 2021-10-08T19:28:53.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:53 smithi097 ceph-mon[32687]: pgmap v358: 178 pgs: 1 peering, 1 active+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 3 active+recovering+undersized+remapped, 171 active+clean; 4.5 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1180/221193 objects degraded (0.533%); 1653/221193 objects misplaced (0.747%) 2021-10-08T19:28:53.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:53 smithi097 ceph-mon[41966]: osdmap e213: 8 total, 8 up, 8 in 2021-10-08T19:28:53.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:53 smithi097 ceph-mon[41966]: pgmap v358: 178 pgs: 1 peering, 1 active+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 3 active+recovering+undersized+remapped, 171 active+clean; 4.5 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1180/221193 objects degraded (0.533%); 1653/221193 objects misplaced (0.747%) 2021-10-08T19:28:54.025 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:28:54.028 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:54.028 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:28:54.129 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:28:54.155 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:54.156 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:28:53 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:28:53] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:28:54.614 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is unset 2021-10-08T19:28:54.657 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:28:54.659 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:54.660 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:28:54.686 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 63 16 73552 73536 72.913 0 - 0.0122897 2021-10-08T19:28:54.762 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:28:54.787 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:54.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:54 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/29609035' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:28:54.955 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:54 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/29609035' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:28:54.956 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:54 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/29609035' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:28:54.957 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2021-10-08T19:28:55.644 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:28:55.646 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:55.647 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:28:55.685 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 64 16 73552 73536 71.7743 0 - 0.0122897 2021-10-08T19:28:55.748 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:28:55.806 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:55.875 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:28:55.878 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:55.879 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:28:55.880 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:55 smithi097 ceph-mon[32687]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:28:55.880 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:55 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/29609035' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:28:55.880 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:55 smithi097 ceph-mon[32687]: osdmap e214: 8 total, 8 up, 8 in 2021-10-08T19:28:55.880 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:55 smithi097 ceph-mon[32687]: pgmap v360: 178 pgs: 3 active+clean+wait, 3 active+recovering+undersized+remapped, 172 active+clean; 4.5 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 1615/221193 objects misplaced (0.730%); 19 MiB/s, 301 objects/s recovering 2021-10-08T19:28:55.881 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:55 smithi097 ceph-mon[32687]: Health check update: Degraded data redundancy: 1180/221193 objects degraded (0.533%), 2 pgs degraded (PG_DEGRADED) 2021-10-08T19:28:55.881 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:55 smithi097 ceph-mon[32687]: osdmap e215: 8 total, 8 up, 8 in 2021-10-08T19:28:55.881 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:55 smithi097 ceph-mon[41966]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:28:55.882 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:55 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/29609035' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:28:55.882 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:55 smithi097 ceph-mon[41966]: osdmap e214: 8 total, 8 up, 8 in 2021-10-08T19:28:55.883 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:55 smithi097 ceph-mon[41966]: pgmap v360: 178 pgs: 3 active+clean+wait, 3 active+recovering+undersized+remapped, 172 active+clean; 4.5 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 1615/221193 objects misplaced (0.730%); 19 MiB/s, 301 objects/s recovering 2021-10-08T19:28:55.883 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:55 smithi097 ceph-mon[41966]: Health check update: Degraded data redundancy: 1180/221193 objects degraded (0.533%), 2 pgs degraded (PG_DEGRADED) 2021-10-08T19:28:55.883 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:55 smithi097 ceph-mon[41966]: osdmap e215: 8 total, 8 up, 8 in 2021-10-08T19:28:55.898 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:28:55.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:55 smithi117 ceph-mon[34585]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:28:55.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:55 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/29609035' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:28:55.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:55 smithi117 ceph-mon[34585]: osdmap e214: 8 total, 8 up, 8 in 2021-10-08T19:28:55.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:55 smithi117 ceph-mon[34585]: pgmap v360: 178 pgs: 3 active+clean+wait, 3 active+recovering+undersized+remapped, 172 active+clean; 4.5 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 1615/221193 objects misplaced (0.730%); 19 MiB/s, 301 objects/s recovering 2021-10-08T19:28:55.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:55 smithi117 ceph-mon[34585]: Health check update: Degraded data redundancy: 1180/221193 objects degraded (0.533%), 2 pgs degraded (PG_DEGRADED) 2021-10-08T19:28:55.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:55 smithi117 ceph-mon[34585]: osdmap e215: 8 total, 8 up, 8 in 2021-10-08T19:28:55.981 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:28:56.009 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:56.255 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:28:56.263 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:56.264 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:28:56.365 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:28:56.389 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:56.436 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:28:56.438 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:56.438 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:28:56.456 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:28:56.477 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2021-10-08T19:28:56.540 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:28:56.563 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:56.600 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:56 smithi097 ceph-mon[32687]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1180/221193 objects degraded (0.533%), 2 pgs degraded) 2021-10-08T19:28:56.600 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:56 smithi097 ceph-mon[32687]: Cluster is now healthy 2021-10-08T19:28:56.601 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:56 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1930035975' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:28:56.605 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:28:56.607 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:56.608 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:28:56.619 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:28:56.638 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:28:56.655 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:28:56 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:28:56.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:56 smithi117 ceph-mon[34585]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1180/221193 objects degraded (0.533%), 2 pgs degraded) 2021-10-08T19:28:56.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:56 smithi117 ceph-mon[34585]: Cluster is now healthy 2021-10-08T19:28:56.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:56 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1930035975' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:28:56.658 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:28:56.676 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:28:56.686 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 65 16 73621 73605 70.7369 0.539062 0.00338067 0.0140427 2021-10-08T19:28:56.698 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:28:56.710 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:28:56.721 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:28:56.732 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:56.734 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:28:56.753 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:28:56.754 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'false' 2021-10-08T19:28:56.754 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'false' 2021-10-08T19:28:56.754 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'false' 2021-10-08T19:28:56.754 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'false' 2021-10-08T19:28:56.755 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'false' 2021-10-08T19:28:56.755 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'false' 2021-10-08T19:28:56.755 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'false' 2021-10-08T19:28:56.755 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'false' 2021-10-08T19:28:56.774 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:28:56.776 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:56.777 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:28:56.878 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:28:56.901 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:56 smithi097 ceph-mon[41966]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1180/221193 objects degraded (0.533%), 2 pgs degraded) 2021-10-08T19:28:56.902 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:56 smithi097 ceph-mon[41966]: Cluster is now healthy 2021-10-08T19:28:56.902 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:56 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1930035975' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:28:56.904 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:57.617 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":361,"stamp":"2021-10-08T19:28:55.577449+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4819851655,"num_objects":73731,"num_object_clones":0,"num_object_copies":221193,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":1615,"num_objects_unfound":0,"num_objects_dirty":73731,"num_whiteouts":0,"num_read":1243,"num_read_kb":1091,"num_write":74141,"num_write_kb":4708761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4476,"num_bytes_recovered":272609523,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":70686,"ondisk_log_size":70686,"up":534,"acting":531,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":545,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":15551352,"kb_used_data":14562680,"kb_used_omap":0,"kb_used_meta":988608,"kb_avail":734409864,"statfs":{"total":767960285184,"available":752035700736,"internally_reserved":0,"allocated":14912184320,"data_stored":14906630924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1012334592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,16],"upper_bound":8192},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1180,"num_objects_misplaced":-38,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1218,"num_bytes_recovered":79822848,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.968585"},"pg_stats":[{"pgid":"8.4","version":"208'4479","reported_seq":4518,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.622975+0000","last_change":"2021-10-08T19:27:43.651844+0000","last_active":"2021-10-08T19:28:51.622975+0000","last_peered":"2021-10-08T19:28:51.622975+0000","last_clean":"2021-10-08T19:28:51.622975+0000","last_became_active":"2021-10-08T19:27:43.651599+0000","last_became_peered":"2021-10-08T19:27:43.651599+0000","last_unstale":"2021-10-08T19:28:51.622975+0000","last_undegraded":"2021-10-08T19:28:51.622975+0000","last_fullsized":"2021-10-08T19:28:51.622975+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_clean_scrub_stamp":"2021-10-08T19:27:42.631354+0000","log_size":4479,"ondisk_log_size":4479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":293535744,"num_objects":4479,"num_object_clones":0,"num_object_copies":13437,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4479,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4479,"num_write_kb":286656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,2],"acting":[5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"114'10","reported_seq":294,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.808904+0000","last_change":"2021-10-08T19:27:36.614081+0000","last_active":"2021-10-08T19:28:51.808904+0000","last_peered":"2021-10-08T19:28:51.808904+0000","last_clean":"2021-10-08T19:28:51.808904+0000","last_became_active":"2021-10-08T19:24:25.096162+0000","last_became_peered":"2021-10-08T19:24:25.096162+0000","last_unstale":"2021-10-08T19:28:51.808904+0000","last_undegraded":"2021-10-08T19:28:51.808904+0000","last_fullsized":"2021-10-08T19:28:51.808904+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'10","last_scrub_stamp":"2021-10-08T19:27:36.614016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:27:36.614016+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040334050000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"87'22","reported_seq":252,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.622529+0000","last_change":"2021-10-08T19:24:25.118654+0000","last_active":"2021-10-08T19:28:51.622529+0000","last_peered":"2021-10-08T19:28:51.622529+0000","last_clean":"2021-10-08T19:28:51.622529+0000","last_became_active":"2021-10-08T19:24:25.088861+0000","last_became_peered":"2021-10-08T19:24:25.088861+0000","last_unstale":"2021-10-08T19:28:51.622529+0000","last_undegraded":"2021-10-08T19:28:51.622529+0000","last_fullsized":"2021-10-08T19:28:51.622529+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'22","last_scrub_stamp":"2021-10-08T19:24:20.355553+0000","last_deep_scrub":"87'22","last_deep_scrub_stamp":"2021-10-08T19:22:58.705632+0000","last_clean_scrub_stamp":"2021-10-08T19:24:20.355553+0000","log_size":22,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0022961499999999998,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":173,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.591392+0000","last_change":"2021-10-08T19:24:07.800878+0000","last_active":"2021-10-08T19:28:51.591392+0000","last_peered":"2021-10-08T19:28:51.591392+0000","last_clean":"2021-10-08T19:28:51.591392+0000","last_became_active":"2021-10-08T19:21:23.600352+0000","last_became_peered":"2021-10-08T19:21:23.600352+0000","last_unstale":"2021-10-08T19:28:51.591392+0000","last_undegraded":"2021-10-08T19:28:51.591392+0000","last_fullsized":"2021-10-08T19:28:51.591392+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:07.800787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:07.800787+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012798608,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":184,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.622901+0000","last_change":"2021-10-08T19:28:08.936871+0000","last_active":"2021-10-08T19:28:51.622901+0000","last_peered":"2021-10-08T19:28:51.622901+0000","last_clean":"2021-10-08T19:28:51.622901+0000","last_became_active":"2021-10-08T19:24:25.089002+0000","last_became_peered":"2021-10-08T19:24:25.089002+0000","last_unstale":"2021-10-08T19:28:51.622901+0000","last_undegraded":"2021-10-08T19:28:51.622901+0000","last_fullsized":"2021-10-08T19:28:51.622901+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:08.936801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:08.936801+0000","last_clean_scrub_stamp":"2021-10-08T19:28:08.936801+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0082775899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":97,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.587101+0000","last_change":"2021-10-08T19:28:45.407695+0000","last_active":"2021-10-08T19:28:51.587101+0000","last_peered":"2021-10-08T19:28:51.587101+0000","last_clean":"2021-10-08T19:28:51.587101+0000","last_became_active":"2021-10-08T19:25:15.510457+0000","last_became_peered":"2021-10-08T19:25:15.510457+0000","last_unstale":"2021-10-08T19:28:51.587101+0000","last_undegraded":"2021-10-08T19:28:51.587101+0000","last_fullsized":"2021-10-08T19:28:51.587101+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:09.177525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:09.177525+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.7","version":"208'4634","reported_seq":4695,"reported_epoch":213,"state":"active+clean+wait","last_fresh":"2021-10-08T19:28:52.612781+0000","last_change":"2021-10-08T19:28:52.612781+0000","last_active":"2021-10-08T19:28:52.612781+0000","last_peered":"2021-10-08T19:28:52.612781+0000","last_clean":"2021-10-08T19:28:52.612781+0000","last_became_active":"2021-10-08T19:28:52.609240+0000","last_became_peered":"2021-10-08T19:28:52.609240+0000","last_unstale":"2021-10-08T19:28:52.612781+0000","last_undegraded":"2021-10-08T19:28:52.612781+0000","last_fullsized":"2021-10-08T19:28:52.612781+0000","mapping_epoch":212,"log_start":"187'900","ondisk_log_start":"187'900","created":182,"last_epoch_clean":213,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_clean_scrub_stamp":"2021-10-08T19:27:42.631354+0000","log_size":3734,"ondisk_log_size":3734,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":303693824,"num_objects":4634,"num_object_clones":0,"num_object_copies":13902,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4634,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4634,"num_write_kb":296576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":571,"num_bytes_recovered":37421056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,6],"acting":[1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"69'9","reported_seq":225,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:52.120663+0000","last_change":"2021-10-08T19:28:41.711583+0000","last_active":"2021-10-08T19:28:52.120663+0000","last_peered":"2021-10-08T19:28:52.120663+0000","last_clean":"2021-10-08T19:28:52.120663+0000","last_became_active":"2021-10-08T19:28:40.159729+0000","last_became_peered":"2021-10-08T19:28:40.159729+0000","last_unstale":"2021-10-08T19:28:52.120663+0000","last_undegraded":"2021-10-08T19:28:52.120663+0000","last_fullsized":"2021-10-08T19:28:52.120663+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'9","last_scrub_stamp":"2021-10-08T19:28:07.450546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:28:07.450546+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0061746960000000004,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":20,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.595700+0000","last_change":"2021-10-08T19:28:40.147531+0000","last_active":"2021-10-08T19:28:51.595700+0000","last_peered":"2021-10-08T19:28:51.595700+0000","last_clean":"2021-10-08T19:28:51.595700+0000","last_became_active":"2021-10-08T19:28:40.145835+0000","last_became_peered":"2021-10-08T19:28:40.145835+0000","last_unstale":"2021-10-08T19:28:51.595700+0000","last_undegraded":"2021-10-08T19:28:51.595700+0000","last_fullsized":"2021-10-08T19:28:51.595700+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:11.176122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:11.176122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":169,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.590170+0000","last_change":"2021-10-08T19:27:38.324454+0000","last_active":"2021-10-08T19:28:51.590170+0000","last_peered":"2021-10-08T19:28:51.590170+0000","last_clean":"2021-10-08T19:28:51.590170+0000","last_became_active":"2021-10-08T19:21:27.635310+0000","last_became_peered":"2021-10-08T19:21:27.635310+0000","last_unstale":"2021-10-08T19:28:51.590170+0000","last_undegraded":"2021-10-08T19:28:51.590170+0000","last_fullsized":"2021-10-08T19:28:51.590170+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:38.324368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:27:38.324368+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0015013699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":167,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:52.120173+0000","last_change":"2021-10-08T19:28:09.465717+0000","last_active":"2021-10-08T19:28:52.120173+0000","last_peered":"2021-10-08T19:28:52.120173+0000","last_clean":"2021-10-08T19:28:52.120173+0000","last_became_active":"2021-10-08T19:21:29.643022+0000","last_became_peered":"2021-10-08T19:21:29.643022+0000","last_unstale":"2021-10-08T19:28:52.120173+0000","last_undegraded":"2021-10-08T19:28:52.120173+0000","last_fullsized":"2021-10-08T19:28:52.120173+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:09.465640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:28:09.465640+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.040018977999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"70'5","reported_seq":419,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:52.544778+0000","last_change":"2021-10-08T19:24:25.638250+0000","last_active":"2021-10-08T19:28:52.544778+0000","last_peered":"2021-10-08T19:28:52.544778+0000","last_clean":"2021-10-08T19:28:52.544778+0000","last_became_active":"2021-10-08T19:24:25.103095+0000","last_became_peered":"2021-10-08T19:24:25.103095+0000","last_unstale":"2021-10-08T19:28:52.544778+0000","last_undegraded":"2021-10-08T19:28:52.544778+0000","last_fullsized":"2021-10-08T19:28:52.544778+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:24:16.396790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:16.396790+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0078447029999999997,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":273,"num_read_kb":273,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":389,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"208'4647","reported_seq":4686,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:52.121327+0000","last_change":"2021-10-08T19:27:43.728156+0000","last_active":"2021-10-08T19:28:52.121327+0000","last_peered":"2021-10-08T19:28:52.121327+0000","last_clean":"2021-10-08T19:28:52.121327+0000","last_became_active":"2021-10-08T19:27:43.727841+0000","last_became_peered":"2021-10-08T19:27:43.727841+0000","last_unstale":"2021-10-08T19:28:52.121327+0000","last_undegraded":"2021-10-08T19:28:52.121327+0000","last_fullsized":"2021-10-08T19:28:52.121327+0000","mapping_epoch":182,"log_start":"187'100","ondisk_log_start":"187'100","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_clean_scrub_stamp":"2021-10-08T19:27:42.631354+0000","log_size":4547,"ondisk_log_size":4547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":304545792,"num_objects":4647,"num_object_clones":0,"num_object_copies":13941,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4647,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4647,"num_write_kb":297408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"69'19","reported_seq":197,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.594702+0000","last_change":"2021-10-08T19:28:47.843610+0000","last_active":"2021-10-08T19:28:51.594702+0000","last_peered":"2021-10-08T19:28:51.594702+0000","last_clean":"2021-10-08T19:28:51.594702+0000","last_became_active":"2021-10-08T19:28:40.101648+0000","last_became_peered":"2021-10-08T19:28:40.101648+0000","last_unstale":"2021-10-08T19:28:51.594702+0000","last_undegraded":"2021-10-08T19:28:51.594702+0000","last_fullsized":"2021-10-08T19:28:51.594702+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'19","last_scrub_stamp":"2021-10-08T19:28:01.296918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:28:01.296918+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039349349999999996,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":31,"num_read_kb":20,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":173,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.591306+0000","last_change":"2021-10-08T19:27:36.314598+0000","last_active":"2021-10-08T19:28:51.591306+0000","last_peered":"2021-10-08T19:28:51.591306+0000","last_clean":"2021-10-08T19:28:51.591306+0000","last_became_active":"2021-10-08T19:21:23.595919+0000","last_became_peered":"2021-10-08T19:21:23.595919+0000","last_unstale":"2021-10-08T19:28:51.591306+0000","last_undegraded":"2021-10-08T19:28:51.591306+0000","last_fullsized":"2021-10-08T19:28:51.591306+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:36.314494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:27:36.314494+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034123560000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":169,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.592021+0000","last_change":"2021-10-08T19:28:14.025270+0000","last_active":"2021-10-08T19:28:51.592021+0000","last_peered":"2021-10-08T19:28:51.592021+0000","last_clean":"2021-10-08T19:28:51.592021+0000","last_became_active":"2021-10-08T19:21:27.638583+0000","last_became_peered":"2021-10-08T19:21:27.638583+0000","last_unstale":"2021-10-08T19:28:51.592021+0000","last_undegraded":"2021-10-08T19:28:51.592021+0000","last_fullsized":"2021-10-08T19:28:51.592021+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:14.025158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:28:14.025158+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0071289430000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":167,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.585947+0000","last_change":"2021-10-08T19:27:39.528797+0000","last_active":"2021-10-08T19:28:51.585947+0000","last_peered":"2021-10-08T19:28:51.585947+0000","last_clean":"2021-10-08T19:28:51.585947+0000","last_became_active":"2021-10-08T19:21:29.648922+0000","last_became_peered":"2021-10-08T19:21:29.648922+0000","last_unstale":"2021-10-08T19:28:51.585947+0000","last_undegraded":"2021-10-08T19:28:51.585947+0000","last_fullsized":"2021-10-08T19:28:51.585947+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:39.528699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:39.528699+0000","last_clean_scrub_stamp":"2021-10-08T19:27:39.528699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001737499,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":92,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.587176+0000","last_change":"2021-10-08T19:28:48.336654+0000","last_active":"2021-10-08T19:28:51.587176+0000","last_peered":"2021-10-08T19:28:51.587176+0000","last_clean":"2021-10-08T19:28:51.587176+0000","last_became_active":"2021-10-08T19:25:15.503081+0000","last_became_peered":"2021-10-08T19:25:15.503081+0000","last_unstale":"2021-10-08T19:28:51.587176+0000","last_undegraded":"2021-10-08T19:28:51.587176+0000","last_fullsized":"2021-10-08T19:28:51.587176+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:17.379559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:17.379559+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0090469920000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"207'4627","reported_seq":7197,"reported_epoch":212,"state":"active+clean+wait","last_fresh":"2021-10-08T19:28:51.592197+0000","last_change":"2021-10-08T19:28:48.971699+0000","last_active":"2021-10-08T19:28:51.592197+0000","last_peered":"2021-10-08T19:28:51.592197+0000","last_clean":"2021-10-08T19:28:51.592197+0000","last_became_active":"2021-10-08T19:28:48.966958+0000","last_became_peered":"2021-10-08T19:28:48.966958+0000","last_unstale":"2021-10-08T19:28:51.592197+0000","last_undegraded":"2021-10-08T19:28:51.592197+0000","last_fullsized":"2021-10-08T19:28:51.592197+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_clean_scrub_stamp":"2021-10-08T19:27:42.631354+0000","log_size":4627,"ondisk_log_size":4627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":303235072,"num_objects":4627,"num_object_clones":0,"num_object_copies":13881,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4627,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4627,"num_write_kb":296128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1252,"num_bytes_recovered":82051072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.8","version":"90'130","reported_seq":344,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.622646+0000","last_change":"2021-10-08T19:27:37.611695+0000","last_active":"2021-10-08T19:28:51.622646+0000","last_peered":"2021-10-08T19:28:51.622646+0000","last_clean":"2021-10-08T19:28:51.622646+0000","last_became_active":"2021-10-08T19:27:37.611248+0000","last_became_peered":"2021-10-08T19:27:37.611248+0000","last_unstale":"2021-10-08T19:28:51.622646+0000","last_undegraded":"2021-10-08T19:28:51.622646+0000","last_fullsized":"2021-10-08T19:28:51.622646+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.284249+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020087920000000001,"stat_sum":{"num_bytes":53670,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":28,"num_write":16,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":423697,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"69'17","reported_seq":252,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.592785+0000","last_change":"2021-10-08T19:28:40.209057+0000","last_active":"2021-10-08T19:28:51.592785+0000","last_peered":"2021-10-08T19:28:51.592785+0000","last_clean":"2021-10-08T19:28:51.592785+0000","last_became_active":"2021-10-08T19:28:40.099618+0000","last_became_peered":"2021-10-08T19:28:40.099618+0000","last_unstale":"2021-10-08T19:28:51.592785+0000","last_undegraded":"2021-10-08T19:28:51.592785+0000","last_fullsized":"2021-10-08T19:28:51.592785+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'17","last_scrub_stamp":"2021-10-08T19:28:02.599959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:28:02.599959+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0066589689999999998,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"61'1","reported_seq":181,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.586598+0000","last_change":"2021-10-08T19:28:05.469192+0000","last_active":"2021-10-08T19:28:51.586598+0000","last_peered":"2021-10-08T19:28:51.586598+0000","last_clean":"2021-10-08T19:28:51.586598+0000","last_became_active":"2021-10-08T19:21:23.607064+0000","last_became_peered":"2021-10-08T19:21:23.607064+0000","last_unstale":"2021-10-08T19:28:51.586598+0000","last_undegraded":"2021-10-08T19:28:51.586598+0000","last_fullsized":"2021-10-08T19:28:51.586598+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'1","last_scrub_stamp":"2021-10-08T19:28:05.469109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:28:05.469109+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013719907,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":20,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.595540+0000","last_change":"2021-10-08T19:28:40.152780+0000","last_active":"2021-10-08T19:28:51.595540+0000","last_peered":"2021-10-08T19:28:51.595540+0000","last_clean":"2021-10-08T19:28:51.595540+0000","last_became_active":"2021-10-08T19:28:40.152478+0000","last_became_peered":"2021-10-08T19:28:40.152478+0000","last_unstale":"2021-10-08T19:28:51.595540+0000","last_undegraded":"2021-10-08T19:28:51.595540+0000","last_fullsized":"2021-10-08T19:28:51.595540+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:36.055616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:36.055616+0000","last_clean_scrub_stamp":"2021-10-08T19:23:36.055616+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":167,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.592666+0000","last_change":"2021-10-08T19:28:16.132553+0000","last_active":"2021-10-08T19:28:51.592666+0000","last_peered":"2021-10-08T19:28:51.592666+0000","last_clean":"2021-10-08T19:28:51.592666+0000","last_became_active":"2021-10-08T19:21:29.646455+0000","last_became_peered":"2021-10-08T19:21:29.646455+0000","last_unstale":"2021-10-08T19:28:51.592666+0000","last_undegraded":"2021-10-08T19:28:51.592666+0000","last_fullsized":"2021-10-08T19:28:51.592666+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:16.132417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:28:16.132417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.058377659999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":134,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.594976+0000","last_change":"2021-10-08T19:28:40.102453+0000","last_active":"2021-10-08T19:28:51.594976+0000","last_peered":"2021-10-08T19:28:51.594976+0000","last_clean":"2021-10-08T19:28:51.594976+0000","last_became_active":"2021-10-08T19:28:40.101504+0000","last_became_peered":"2021-10-08T19:28:40.101504+0000","last_unstale":"2021-10-08T19:28:51.594976+0000","last_undegraded":"2021-10-08T19:28:51.594976+0000","last_fullsized":"2021-10-08T19:28:51.594976+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:14.495972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:28:14.495972+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0033138379999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.0","version":"208'4635","reported_seq":5090,"reported_epoch":213,"state":"active+recovering+undersized+remapped","last_fresh":"2021-10-08T19:28:53.678414+0000","last_change":"2021-10-08T19:28:50.792117+0000","last_active":"2021-10-08T19:28:53.678414+0000","last_peered":"2021-10-08T19:28:53.678414+0000","last_clean":"2021-10-08T19:28:22.614034+0000","last_became_active":"2021-10-08T19:28:40.244570+0000","last_became_peered":"2021-10-08T19:28:40.244570+0000","last_unstale":"2021-10-08T19:28:53.678414+0000","last_undegraded":"2021-10-08T19:28:53.678414+0000","last_fullsized":"2021-10-08T19:28:40.097104+0000","mapping_epoch":202,"log_start":"188'900","ondisk_log_start":"188'900","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_clean_scrub_stamp":"2021-10-08T19:27:42.631354+0000","log_size":3735,"ondisk_log_size":3735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":303759360,"num_objects":4635,"num_object_clones":0,"num_object_copies":13905,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":565,"num_objects_unfound":0,"num_objects_dirty":4635,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4635,"num_write_kb":296640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":13041664,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5],"avail_no_missing":["3","5"],"object_location_counts":[{"shards":"3,4,5","objects":565},{"shards":"3,5","objects":4070}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.9","version":"90'130","reported_seq":487,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.585973+0000","last_change":"2021-10-08T19:27:26.586458+0000","last_active":"2021-10-08T19:28:51.585973+0000","last_peered":"2021-10-08T19:28:51.585973+0000","last_clean":"2021-10-08T19:28:51.585973+0000","last_became_active":"2021-10-08T19:27:26.586201+0000","last_became_peered":"2021-10-08T19:27:26.586201+0000","last_unstale":"2021-10-08T19:28:51.585973+0000","last_undegraded":"2021-10-08T19:28:51.585973+0000","last_fullsized":"2021-10-08T19:28:51.585973+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.284249+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0045617870000000003,"stat_sum":{"num_bytes":53670,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":28,"num_write":16,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":268349,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"69'10","reported_seq":227,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.592588+0000","last_change":"2021-10-08T19:28:00.572309+0000","last_active":"2021-10-08T19:28:51.592588+0000","last_peered":"2021-10-08T19:28:51.592588+0000","last_clean":"2021-10-08T19:28:51.592588+0000","last_became_active":"2021-10-08T19:24:25.098048+0000","last_became_peered":"2021-10-08T19:24:25.098048+0000","last_unstale":"2021-10-08T19:28:51.592588+0000","last_undegraded":"2021-10-08T19:28:51.592588+0000","last_fullsized":"2021-10-08T19:28:51.592588+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'10","last_scrub_stamp":"2021-10-08T19:28:00.572215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:28:00.572215+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011508064,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":20,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.592680+0000","last_change":"2021-10-08T19:28:40.146609+0000","last_active":"2021-10-08T19:28:51.592680+0000","last_peered":"2021-10-08T19:28:51.592680+0000","last_clean":"2021-10-08T19:28:51.592680+0000","last_became_active":"2021-10-08T19:28:40.141793+0000","last_became_peered":"2021-10-08T19:28:40.141793+0000","last_unstale":"2021-10-08T19:28:51.592680+0000","last_undegraded":"2021-10-08T19:28:51.592680+0000","last_fullsized":"2021-10-08T19:28:51.592680+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:15.233394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:15.233394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"69'8","reported_seq":267,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.808596+0000","last_change":"2021-10-08T19:24:09.793029+0000","last_active":"2021-10-08T19:28:51.808596+0000","last_peered":"2021-10-08T19:28:51.808596+0000","last_clean":"2021-10-08T19:28:51.808596+0000","last_became_active":"2021-10-08T19:21:27.637930+0000","last_became_peered":"2021-10-08T19:21:27.637930+0000","last_unstale":"2021-10-08T19:28:51.808596+0000","last_undegraded":"2021-10-08T19:28:51.808596+0000","last_fullsized":"2021-10-08T19:28:51.808596+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'8","last_scrub_stamp":"2021-10-08T19:24:09.792928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:09.792928+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0052042049999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":184,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.592886+0000","last_change":"2021-10-08T19:28:40.100538+0000","last_active":"2021-10-08T19:28:51.592886+0000","last_peered":"2021-10-08T19:28:51.592886+0000","last_clean":"2021-10-08T19:28:51.592886+0000","last_became_active":"2021-10-08T19:28:40.100213+0000","last_became_peered":"2021-10-08T19:28:40.100213+0000","last_unstale":"2021-10-08T19:28:51.592886+0000","last_undegraded":"2021-10-08T19:28:51.592886+0000","last_fullsized":"2021-10-08T19:28:51.592886+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:19.303695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:24:19.303695+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0069500159999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":123,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.587406+0000","last_change":"2021-10-08T19:28:05.180565+0000","last_active":"2021-10-08T19:28:51.587406+0000","last_peered":"2021-10-08T19:28:51.587406+0000","last_clean":"2021-10-08T19:28:51.587406+0000","last_became_active":"2021-10-08T19:24:13.518601+0000","last_became_peered":"2021-10-08T19:24:13.518601+0000","last_unstale":"2021-10-08T19:28:51.587406+0000","last_undegraded":"2021-10-08T19:28:51.587406+0000","last_fullsized":"2021-10-08T19:28:51.587406+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:05.180500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:28:05.180500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012201953,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"208'4703","reported_seq":5358,"reported_epoch":213,"state":"active+recovering+undersized+remapped","last_fresh":"2021-10-08T19:28:53.429623+0000","last_change":"2021-10-08T19:28:41.846009+0000","last_active":"2021-10-08T19:28:53.429623+0000","last_peered":"2021-10-08T19:28:53.429623+0000","last_clean":"2021-10-08T19:28:22.574898+0000","last_became_active":"2021-10-08T19:28:40.168782+0000","last_became_peered":"2021-10-08T19:28:40.168782+0000","last_unstale":"2021-10-08T19:28:53.429623+0000","last_undegraded":"2021-10-08T19:28:53.429623+0000","last_fullsized":"2021-10-08T19:28:40.079602+0000","mapping_epoch":202,"log_start":"187'200","ondisk_log_start":"187'200","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_clean_scrub_stamp":"2021-10-08T19:27:42.631354+0000","log_size":4503,"ondisk_log_size":4503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":308215808,"num_objects":4703,"num_object_clones":0,"num_object_copies":14109,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":506,"num_objects_unfound":0,"num_objects_dirty":4703,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4703,"num_write_kb":300992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":301,"num_bytes_recovered":19726336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[5,6],"avail_no_missing":["5","6"],"object_location_counts":[{"shards":"2,5,6","objects":506},{"shards":"5,6","objects":4197}],"blocked_by":[],"up_primary":1,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.a","version":"90'130","reported_seq":349,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.622812+0000","last_change":"2021-10-08T19:27:26.591508+0000","last_active":"2021-10-08T19:28:51.622812+0000","last_peered":"2021-10-08T19:28:51.622812+0000","last_clean":"2021-10-08T19:28:51.622812+0000","last_became_active":"2021-10-08T19:27:26.591129+0000","last_became_peered":"2021-10-08T19:27:26.591129+0000","last_unstale":"2021-10-08T19:28:51.622812+0000","last_undegraded":"2021-10-08T19:28:51.622812+0000","last_fullsized":"2021-10-08T19:28:51.622812+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.284249+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020087920000000001,"stat_sum":{"num_bytes":53669,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":27,"num_write":16,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":161009,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.f","version":"69'15","reported_seq":36,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.596340+0000","last_change":"2021-10-08T19:28:42.296085+0000","last_active":"2021-10-08T19:28:51.596340+0000","last_peered":"2021-10-08T19:28:51.596340+0000","last_clean":"2021-10-08T19:28:51.596340+0000","last_became_active":"2021-10-08T19:28:40.192361+0000","last_became_peered":"2021-10-08T19:28:40.192361+0000","last_unstale":"2021-10-08T19:28:51.596340+0000","last_undegraded":"2021-10-08T19:28:51.596340+0000","last_fullsized":"2021-10-08T19:28:51.596340+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'15","last_scrub_stamp":"2021-10-08T19:27:36.564311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:27:36.564311+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":20,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.591992+0000","last_change":"2021-10-08T19:28:40.145444+0000","last_active":"2021-10-08T19:28:51.591992+0000","last_peered":"2021-10-08T19:28:51.591992+0000","last_clean":"2021-10-08T19:28:51.591992+0000","last_became_active":"2021-10-08T19:28:40.140240+0000","last_became_peered":"2021-10-08T19:28:40.140240+0000","last_unstale":"2021-10-08T19:28:51.591992+0000","last_undegraded":"2021-10-08T19:28:51.591992+0000","last_fullsized":"2021-10-08T19:28:51.591992+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:07.213008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:07.213008+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"88'9","reported_seq":270,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.809008+0000","last_change":"2021-10-08T19:28:01.592286+0000","last_active":"2021-10-08T19:28:51.809008+0000","last_peered":"2021-10-08T19:28:51.809008+0000","last_clean":"2021-10-08T19:28:51.809008+0000","last_became_active":"2021-10-08T19:21:27.636432+0000","last_became_peered":"2021-10-08T19:21:27.636432+0000","last_unstale":"2021-10-08T19:28:51.809008+0000","last_undegraded":"2021-10-08T19:28:51.809008+0000","last_fullsized":"2021-10-08T19:28:51.809008+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'9","last_scrub_stamp":"2021-10-08T19:28:01.592208+0000","last_deep_scrub":"88'9","last_deep_scrub_stamp":"2021-10-08T19:23:00.048245+0000","last_clean_scrub_stamp":"2021-10-08T19:28:01.592208+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0051143930000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":184,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.623402+0000","last_change":"2021-10-08T19:28:40.138482+0000","last_active":"2021-10-08T19:28:51.623402+0000","last_peered":"2021-10-08T19:28:51.623402+0000","last_clean":"2021-10-08T19:28:51.623402+0000","last_became_active":"2021-10-08T19:28:40.137966+0000","last_became_peered":"2021-10-08T19:28:40.137966+0000","last_unstale":"2021-10-08T19:28:51.623402+0000","last_undegraded":"2021-10-08T19:28:51.623402+0000","last_fullsized":"2021-10-08T19:28:51.623402+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:11.329954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:24:11.329954+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.01088446,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.8","version":"70'5","reported_seq":140,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.587709+0000","last_change":"2021-10-08T19:28:40.155680+0000","last_active":"2021-10-08T19:28:51.587709+0000","last_peered":"2021-10-08T19:28:51.587709+0000","last_clean":"2021-10-08T19:28:51.587709+0000","last_became_active":"2021-10-08T19:28:40.155322+0000","last_became_peered":"2021-10-08T19:28:40.155322+0000","last_unstale":"2021-10-08T19:28:51.587709+0000","last_undegraded":"2021-10-08T19:28:51.587709+0000","last_fullsized":"2021-10-08T19:28:51.587709+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:28:08.162564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:28:08.162564+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.039687264,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.2","version":"208'4580","reported_seq":4619,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.591753+0000","last_change":"2021-10-08T19:27:43.651956+0000","last_active":"2021-10-08T19:28:51.591753+0000","last_peered":"2021-10-08T19:28:51.591753+0000","last_clean":"2021-10-08T19:28:51.591753+0000","last_became_active":"2021-10-08T19:27:43.651635+0000","last_became_peered":"2021-10-08T19:27:43.651635+0000","last_unstale":"2021-10-08T19:28:51.591753+0000","last_undegraded":"2021-10-08T19:28:51.591753+0000","last_fullsized":"2021-10-08T19:28:51.591753+0000","mapping_epoch":182,"log_start":"187'700","ondisk_log_start":"187'700","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_clean_scrub_stamp":"2021-10-08T19:27:42.631354+0000","log_size":3880,"ondisk_log_size":3880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":300154880,"num_objects":4580,"num_object_clones":0,"num_object_copies":13740,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4580,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4580,"num_write_kb":293120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5],"acting":[4,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"69'11","reported_seq":273,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.592727+0000","last_change":"2021-10-08T19:28:47.806441+0000","last_active":"2021-10-08T19:28:51.592727+0000","last_peered":"2021-10-08T19:28:51.592727+0000","last_clean":"2021-10-08T19:28:51.592727+0000","last_became_active":"2021-10-08T19:28:40.100427+0000","last_became_peered":"2021-10-08T19:28:40.100427+0000","last_unstale":"2021-10-08T19:28:51.592727+0000","last_undegraded":"2021-10-08T19:28:51.592727+0000","last_fullsized":"2021-10-08T19:28:51.592727+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'11","last_scrub_stamp":"2021-10-08T19:28:08.680153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:28:08.680153+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0066172430000000001,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":193,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.586037+0000","last_change":"2021-10-08T19:28:51.370052+0000","last_active":"2021-10-08T19:28:51.586037+0000","last_peered":"2021-10-08T19:28:51.586037+0000","last_clean":"2021-10-08T19:28:51.586037+0000","last_became_active":"2021-10-08T19:28:40.100691+0000","last_became_peered":"2021-10-08T19:28:40.100691+0000","last_unstale":"2021-10-08T19:28:51.586037+0000","last_undegraded":"2021-10-08T19:28:51.586037+0000","last_fullsized":"2021-10-08T19:28:51.586037+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:14.537859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:14.537859+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.00235264,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":186,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.623446+0000","last_change":"2021-10-08T19:28:11.939647+0000","last_active":"2021-10-08T19:28:51.623446+0000","last_peered":"2021-10-08T19:28:51.623446+0000","last_clean":"2021-10-08T19:28:51.623446+0000","last_became_active":"2021-10-08T19:24:25.105244+0000","last_became_peered":"2021-10-08T19:24:25.105244+0000","last_unstale":"2021-10-08T19:28:51.623446+0000","last_undegraded":"2021-10-08T19:28:51.623446+0000","last_fullsized":"2021-10-08T19:28:51.623446+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:11.939557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:28:11.939557+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.005546044,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":178,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.586951+0000","last_change":"2021-10-08T19:24:25.096748+0000","last_active":"2021-10-08T19:28:51.586951+0000","last_peered":"2021-10-08T19:28:51.586951+0000","last_clean":"2021-10-08T19:28:51.586951+0000","last_became_active":"2021-10-08T19:24:25.096415+0000","last_became_peered":"2021-10-08T19:24:25.096415+0000","last_unstale":"2021-10-08T19:28:51.586951+0000","last_undegraded":"2021-10-08T19:28:51.586951+0000","last_fullsized":"2021-10-08T19:28:51.586951+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:17.422176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:17.422176+0000","last_clean_scrub_stamp":"2021-10-08T19:23:17.422176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0036221249999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":117,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.591591+0000","last_change":"2021-10-08T19:24:13.506996+0000","last_active":"2021-10-08T19:28:51.591591+0000","last_peered":"2021-10-08T19:28:51.591591+0000","last_clean":"2021-10-08T19:28:51.591591+0000","last_became_active":"2021-10-08T19:24:13.506602+0000","last_became_peered":"2021-10-08T19:24:13.506602+0000","last_unstale":"2021-10-08T19:28:51.591591+0000","last_undegraded":"2021-10-08T19:28:51.591591+0000","last_fullsized":"2021-10-08T19:28:51.591591+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:09.177525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:09.177525+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"208'4572","reported_seq":4611,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.623088+0000","last_change":"2021-10-08T19:27:43.726852+0000","last_active":"2021-10-08T19:28:51.623088+0000","last_peered":"2021-10-08T19:28:51.623088+0000","last_clean":"2021-10-08T19:28:51.623088+0000","last_became_active":"2021-10-08T19:27:43.726506+0000","last_became_peered":"2021-10-08T19:27:43.726506+0000","last_unstale":"2021-10-08T19:28:51.623088+0000","last_undegraded":"2021-10-08T19:28:51.623088+0000","last_fullsized":"2021-10-08T19:28:51.623088+0000","mapping_epoch":182,"log_start":"187'100","ondisk_log_start":"187'100","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_clean_scrub_stamp":"2021-10-08T19:27:42.631354+0000","log_size":4472,"ondisk_log_size":4472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":299630592,"num_objects":4572,"num_object_clones":0,"num_object_copies":13716,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4572,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4572,"num_write_kb":292608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.4","version":"90'130","reported_seq":345,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.587022+0000","last_change":"2021-10-08T19:27:37.613110+0000","last_active":"2021-10-08T19:28:51.587022+0000","last_peered":"2021-10-08T19:28:51.587022+0000","last_clean":"2021-10-08T19:28:51.587022+0000","last_became_active":"2021-10-08T19:27:37.612736+0000","last_became_peered":"2021-10-08T19:27:37.612736+0000","last_unstale":"2021-10-08T19:28:51.587022+0000","last_undegraded":"2021-10-08T19:28:51.587022+0000","last_fullsized":"2021-10-08T19:28:51.587022+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.284249+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020087920000000001,"stat_sum":{"num_bytes":53670,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":28,"num_write":16,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":488690,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"203'11","reported_seq":288,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.808702+0000","last_change":"2021-10-08T19:28:41.686868+0000","last_active":"2021-10-08T19:28:51.808702+0000","last_peered":"2021-10-08T19:28:51.808702+0000","last_clean":"2021-10-08T19:28:51.808702+0000","last_became_active":"2021-10-08T19:28:40.155791+0000","last_became_peered":"2021-10-08T19:28:40.155791+0000","last_unstale":"2021-10-08T19:28:51.808702+0000","last_undegraded":"2021-10-08T19:28:51.808702+0000","last_fullsized":"2021-10-08T19:28:51.808702+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'9","last_scrub_stamp":"2021-10-08T19:23:32.329475+0000","last_deep_scrub":"91'9","last_deep_scrub_stamp":"2021-10-08T19:23:32.329475+0000","last_clean_scrub_stamp":"2021-10-08T19:23:32.329475+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0045727859999999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"69'14","reported_seq":241,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.591724+0000","last_change":"2021-10-08T19:24:26.225004+0000","last_active":"2021-10-08T19:28:51.591724+0000","last_peered":"2021-10-08T19:28:51.591724+0000","last_clean":"2021-10-08T19:28:51.591724+0000","last_became_active":"2021-10-08T19:24:25.098743+0000","last_became_peered":"2021-10-08T19:24:25.098743+0000","last_unstale":"2021-10-08T19:28:51.591724+0000","last_undegraded":"2021-10-08T19:28:51.591724+0000","last_fullsized":"2021-10-08T19:28:51.591724+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'14","last_scrub_stamp":"2021-10-08T19:24:10.235796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:24:10.235796+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0042036319999999997,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":110,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.595035+0000","last_change":"2021-10-08T19:24:25.094838+0000","last_active":"2021-10-08T19:28:51.595035+0000","last_peered":"2021-10-08T19:28:51.595035+0000","last_clean":"2021-10-08T19:28:51.595035+0000","last_became_active":"2021-10-08T19:24:25.094364+0000","last_became_peered":"2021-10-08T19:24:25.094364+0000","last_unstale":"2021-10-08T19:28:51.595035+0000","last_undegraded":"2021-10-08T19:28:51.595035+0000","last_fullsized":"2021-10-08T19:28:51.595035+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:23.529696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:23.529696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":187,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.586749+0000","last_change":"2021-10-08T19:28:01.468726+0000","last_active":"2021-10-08T19:28:51.586749+0000","last_peered":"2021-10-08T19:28:51.586749+0000","last_clean":"2021-10-08T19:28:51.586749+0000","last_became_active":"2021-10-08T19:24:25.094848+0000","last_became_peered":"2021-10-08T19:24:25.094848+0000","last_unstale":"2021-10-08T19:28:51.586749+0000","last_undegraded":"2021-10-08T19:28:51.586749+0000","last_fullsized":"2021-10-08T19:28:51.586749+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:01.468644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:28:01.468644+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.030033254999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":142,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:52.121440+0000","last_change":"2021-10-08T19:28:40.133427+0000","last_active":"2021-10-08T19:28:52.121440+0000","last_peered":"2021-10-08T19:28:52.121440+0000","last_clean":"2021-10-08T19:28:52.121440+0000","last_became_active":"2021-10-08T19:28:40.132751+0000","last_became_peered":"2021-10-08T19:28:40.132751+0000","last_unstale":"2021-10-08T19:28:52.121440+0000","last_undegraded":"2021-10-08T19:28:52.121440+0000","last_fullsized":"2021-10-08T19:28:52.121440+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:40.563247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.563247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.024890005999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"208'4676","reported_seq":4715,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:52.120941+0000","last_change":"2021-10-08T19:27:43.728516+0000","last_active":"2021-10-08T19:28:52.120941+0000","last_peered":"2021-10-08T19:28:52.120941+0000","last_clean":"2021-10-08T19:28:52.120941+0000","last_became_active":"2021-10-08T19:27:43.727954+0000","last_became_peered":"2021-10-08T19:27:43.727954+0000","last_unstale":"2021-10-08T19:28:52.120941+0000","last_undegraded":"2021-10-08T19:28:52.120941+0000","last_fullsized":"2021-10-08T19:28:52.120941+0000","mapping_epoch":182,"log_start":"187'100","ondisk_log_start":"187'100","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_clean_scrub_stamp":"2021-10-08T19:27:42.631354+0000","log_size":4576,"ondisk_log_size":4576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":306446336,"num_objects":4676,"num_object_clones":0,"num_object_copies":14028,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4676,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4676,"num_write_kb":299264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"90'130","reported_seq":349,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.592555+0000","last_change":"2021-10-08T19:27:26.591042+0000","last_active":"2021-10-08T19:28:51.592555+0000","last_peered":"2021-10-08T19:28:51.592555+0000","last_clean":"2021-10-08T19:28:51.592555+0000","last_became_active":"2021-10-08T19:27:26.590651+0000","last_became_peered":"2021-10-08T19:27:26.590651+0000","last_unstale":"2021-10-08T19:28:51.592555+0000","last_undegraded":"2021-10-08T19:28:51.592555+0000","last_fullsized":"2021-10-08T19:28:51.592555+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.284249+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020087920000000001,"stat_sum":{"num_bytes":53670,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":28,"num_write":16,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":161010,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":168,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.591895+0000","last_change":"2021-10-08T19:24:15.302574+0000","last_active":"2021-10-08T19:28:51.591895+0000","last_peered":"2021-10-08T19:28:51.591895+0000","last_clean":"2021-10-08T19:28:51.591895+0000","last_became_active":"2021-10-08T19:21:27.637547+0000","last_became_peered":"2021-10-08T19:21:27.637547+0000","last_unstale":"2021-10-08T19:28:51.591895+0000","last_undegraded":"2021-10-08T19:28:51.591895+0000","last_fullsized":"2021-10-08T19:28:51.591895+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:15.302475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:15.302475+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0050588849999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"69'18","reported_seq":196,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.587537+0000","last_change":"2021-10-08T19:23:20.405609+0000","last_active":"2021-10-08T19:28:51.587537+0000","last_peered":"2021-10-08T19:28:51.587537+0000","last_clean":"2021-10-08T19:28:51.587537+0000","last_became_active":"2021-10-08T19:21:25.742909+0000","last_became_peered":"2021-10-08T19:21:25.742909+0000","last_unstale":"2021-10-08T19:28:51.587537+0000","last_undegraded":"2021-10-08T19:28:51.587537+0000","last_fullsized":"2021-10-08T19:28:51.587537+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'18","last_scrub_stamp":"2021-10-08T19:23:20.405525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:20.405525+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039753820000000004,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.596187+0000","last_change":"2021-10-08T19:28:40.146228+0000","last_active":"2021-10-08T19:28:51.596187+0000","last_peered":"2021-10-08T19:28:51.596187+0000","last_clean":"2021-10-08T19:28:51.596187+0000","last_became_active":"2021-10-08T19:28:40.141714+0000","last_became_peered":"2021-10-08T19:28:40.141714+0000","last_unstale":"2021-10-08T19:28:51.596187+0000","last_undegraded":"2021-10-08T19:28:51.596187+0000","last_fullsized":"2021-10-08T19:28:51.596187+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:07.710367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:07.710367+0000","last_clean_scrub_stamp":"2021-10-08T19:28:07.710367+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0037557269999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":166,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.592088+0000","last_change":"2021-10-08T19:28:15.793288+0000","last_active":"2021-10-08T19:28:51.592088+0000","last_peered":"2021-10-08T19:28:51.592088+0000","last_clean":"2021-10-08T19:28:51.592088+0000","last_became_active":"2021-10-08T19:21:29.646491+0000","last_became_peered":"2021-10-08T19:21:29.646491+0000","last_unstale":"2021-10-08T19:28:51.592088+0000","last_undegraded":"2021-10-08T19:28:51.592088+0000","last_fullsized":"2021-10-08T19:28:51.592088+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:15.793206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:28:15.793206+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0049324570000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":126,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.590525+0000","last_change":"2021-10-08T19:25:14.588222+0000","last_active":"2021-10-08T19:28:51.590525+0000","last_peered":"2021-10-08T19:28:51.590525+0000","last_clean":"2021-10-08T19:28:51.590525+0000","last_became_active":"2021-10-08T19:25:14.587901+0000","last_became_peered":"2021-10-08T19:25:14.587901+0000","last_unstale":"2021-10-08T19:28:51.590525+0000","last_undegraded":"2021-10-08T19:28:51.590525+0000","last_fullsized":"2021-10-08T19:28:51.590525+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:09.177525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:09.177525+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.f","version":"208'4535","reported_seq":5808,"reported_epoch":213,"state":"active+clean","last_fresh":"2021-10-08T19:28:52.613103+0000","last_change":"2021-10-08T19:28:52.613103+0000","last_active":"2021-10-08T19:28:52.613103+0000","last_peered":"2021-10-08T19:28:52.613103+0000","last_clean":"2021-10-08T19:28:52.613103+0000","last_became_active":"2021-10-08T19:28:52.608885+0000","last_became_peered":"2021-10-08T19:28:52.608885+0000","last_unstale":"2021-10-08T19:28:52.613103+0000","last_undegraded":"2021-10-08T19:28:52.613103+0000","last_fullsized":"2021-10-08T19:28:52.613103+0000","mapping_epoch":212,"log_start":"187'800","ondisk_log_start":"187'800","created":182,"last_epoch_clean":213,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_clean_scrub_stamp":"2021-10-08T19:27:42.631354+0000","log_size":3735,"ondisk_log_size":3735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":297205760,"num_objects":4535,"num_object_clones":0,"num_object_copies":13605,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4535,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4535,"num_write_kb":290240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":604,"num_bytes_recovered":39583744,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"90'130","reported_seq":411,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.595287+0000","last_change":"2021-10-08T19:27:26.590758+0000","last_active":"2021-10-08T19:28:51.595287+0000","last_peered":"2021-10-08T19:28:51.595287+0000","last_clean":"2021-10-08T19:28:51.595287+0000","last_became_active":"2021-10-08T19:27:26.590363+0000","last_became_peered":"2021-10-08T19:27:26.590363+0000","last_unstale":"2021-10-08T19:28:51.595287+0000","last_undegraded":"2021-10-08T19:28:51.595287+0000","last_fullsized":"2021-10-08T19:28:51.595287+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.284249+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0045617870000000003,"stat_sum":{"num_bytes":53670,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":28,"num_write":16,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":214679,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":116,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.594974+0000","last_change":"2021-10-08T19:28:04.346251+0000","last_active":"2021-10-08T19:28:51.594974+0000","last_peered":"2021-10-08T19:28:51.594974+0000","last_clean":"2021-10-08T19:28:51.594974+0000","last_became_active":"2021-10-08T19:24:25.095389+0000","last_became_peered":"2021-10-08T19:24:25.095389+0000","last_unstale":"2021-10-08T19:28:51.594974+0000","last_undegraded":"2021-10-08T19:28:51.594974+0000","last_fullsized":"2021-10-08T19:28:51.594974+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:04.346151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:28:04.346151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010868312999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"69'19","reported_seq":207,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:52.120501+0000","last_change":"2021-10-08T19:24:08.149331+0000","last_active":"2021-10-08T19:28:52.120501+0000","last_peered":"2021-10-08T19:28:52.120501+0000","last_clean":"2021-10-08T19:28:52.120501+0000","last_became_active":"2021-10-08T19:21:25.741812+0000","last_became_peered":"2021-10-08T19:21:25.741812+0000","last_unstale":"2021-10-08T19:28:52.120501+0000","last_undegraded":"2021-10-08T19:28:52.120501+0000","last_fullsized":"2021-10-08T19:28:52.120501+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'19","last_scrub_stamp":"2021-10-08T19:24:08.149225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:24:08.149225+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0082661220000000007,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"61'1","reported_seq":180,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.587340+0000","last_change":"2021-10-08T19:24:17.582143+0000","last_active":"2021-10-08T19:28:51.587340+0000","last_peered":"2021-10-08T19:28:51.587340+0000","last_clean":"2021-10-08T19:28:51.587340+0000","last_became_active":"2021-10-08T19:21:23.604258+0000","last_became_peered":"2021-10-08T19:21:23.604258+0000","last_unstale":"2021-10-08T19:28:51.587340+0000","last_undegraded":"2021-10-08T19:28:51.587340+0000","last_fullsized":"2021-10-08T19:28:51.587340+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'1","last_scrub_stamp":"2021-10-08T19:24:17.582063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:17.582063+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0043026640000000003,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":20,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.591789+0000","last_change":"2021-10-08T19:28:40.146183+0000","last_active":"2021-10-08T19:28:51.591789+0000","last_peered":"2021-10-08T19:28:51.591789+0000","last_clean":"2021-10-08T19:28:51.591789+0000","last_became_active":"2021-10-08T19:28:40.140876+0000","last_became_peered":"2021-10-08T19:28:40.140876+0000","last_unstale":"2021-10-08T19:28:51.591789+0000","last_undegraded":"2021-10-08T19:28:51.591789+0000","last_fullsized":"2021-10-08T19:28:51.591789+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:04.724061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:28:04.724061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001436805,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"70'5","reported_seq":20,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.595458+0000","last_change":"2021-10-08T19:28:40.151654+0000","last_active":"2021-10-08T19:28:51.595458+0000","last_peered":"2021-10-08T19:28:51.595458+0000","last_clean":"2021-10-08T19:28:51.595458+0000","last_became_active":"2021-10-08T19:28:40.150503+0000","last_became_peered":"2021-10-08T19:28:40.150503+0000","last_unstale":"2021-10-08T19:28:51.595458+0000","last_undegraded":"2021-10-08T19:28:51.595458+0000","last_fullsized":"2021-10-08T19:28:51.595458+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:22:48.239721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:48.239721+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":49,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.a","version":"208'4577","reported_seq":6422,"reported_epoch":212,"state":"active+clean+wait","last_fresh":"2021-10-08T19:28:51.592739+0000","last_change":"2021-10-08T19:28:49.992259+0000","last_active":"2021-10-08T19:28:51.592739+0000","last_peered":"2021-10-08T19:28:51.592739+0000","last_clean":"2021-10-08T19:28:51.592739+0000","last_became_active":"2021-10-08T19:28:49.987637+0000","last_became_peered":"2021-10-08T19:28:49.987637+0000","last_unstale":"2021-10-08T19:28:51.592739+0000","last_undegraded":"2021-10-08T19:28:51.592739+0000","last_fullsized":"2021-10-08T19:28:51.592739+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_clean_scrub_stamp":"2021-10-08T19:27:42.631354+0000","log_size":4577,"ondisk_log_size":4577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":299958272,"num_objects":4577,"num_object_clones":0,"num_object_copies":13731,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4577,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4577,"num_write_kb":292928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":993,"num_bytes_recovered":65077248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"90'130","reported_seq":321,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.595398+0000","last_change":"2021-10-08T19:28:43.178684+0000","last_active":"2021-10-08T19:28:51.595398+0000","last_peered":"2021-10-08T19:28:51.595398+0000","last_clean":"2021-10-08T19:28:51.595398+0000","last_became_active":"2021-10-08T19:28:43.178371+0000","last_became_peered":"2021-10-08T19:28:43.178371+0000","last_unstale":"2021-10-08T19:28:51.595398+0000","last_undegraded":"2021-10-08T19:28:51.595398+0000","last_fullsized":"2021-10-08T19:28:51.595398+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.284249+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020087920000000001,"stat_sum":{"num_bytes":53670,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":28,"num_write":17,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":161010,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":186,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.623490+0000","last_change":"2021-10-08T19:28:40.138302+0000","last_active":"2021-10-08T19:28:51.623490+0000","last_peered":"2021-10-08T19:28:51.623490+0000","last_clean":"2021-10-08T19:28:51.623490+0000","last_became_active":"2021-10-08T19:28:40.138010+0000","last_became_peered":"2021-10-08T19:28:40.138010+0000","last_unstale":"2021-10-08T19:28:51.623490+0000","last_undegraded":"2021-10-08T19:28:51.623490+0000","last_fullsized":"2021-10-08T19:28:51.623490+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:41.487627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:41.487627+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003650445,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"69'12","reported_seq":231,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:52.121528+0000","last_change":"2021-10-08T19:28:48.358081+0000","last_active":"2021-10-08T19:28:52.121528+0000","last_peered":"2021-10-08T19:28:52.121528+0000","last_clean":"2021-10-08T19:28:52.121528+0000","last_became_active":"2021-10-08T19:28:40.133150+0000","last_became_peered":"2021-10-08T19:28:40.133150+0000","last_unstale":"2021-10-08T19:28:52.121528+0000","last_undegraded":"2021-10-08T19:28:52.121528+0000","last_fullsized":"2021-10-08T19:28:52.121528+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'12","last_scrub_stamp":"2021-10-08T19:22:55.639881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:55.639881+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0032422169999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":152,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.588446+0000","last_change":"2021-10-08T19:28:40.142498+0000","last_active":"2021-10-08T19:28:51.588446+0000","last_peered":"2021-10-08T19:28:51.588446+0000","last_clean":"2021-10-08T19:28:51.588446+0000","last_became_active":"2021-10-08T19:28:40.140231+0000","last_became_peered":"2021-10-08T19:28:40.140231+0000","last_unstale":"2021-10-08T19:28:51.588446+0000","last_undegraded":"2021-10-08T19:28:51.588446+0000","last_fullsized":"2021-10-08T19:28:51.588446+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:04.888825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:32.922694+0000","last_clean_scrub_stamp":"2021-10-08T19:24:04.888825+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0052928530000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":191,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:52.120013+0000","last_change":"2021-10-08T19:25:14.571042+0000","last_active":"2021-10-08T19:28:52.120013+0000","last_peered":"2021-10-08T19:28:52.120013+0000","last_clean":"2021-10-08T19:28:52.120013+0000","last_became_active":"2021-10-08T19:25:14.570716+0000","last_became_peered":"2021-10-08T19:25:14.570716+0000","last_unstale":"2021-10-08T19:28:52.120013+0000","last_undegraded":"2021-10-08T19:28:52.120013+0000","last_fullsized":"2021-10-08T19:28:52.120013+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:09.177525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:09.177525+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0090469920000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":20,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.595288+0000","last_change":"2021-10-08T19:28:40.151801+0000","last_active":"2021-10-08T19:28:51.595288+0000","last_peered":"2021-10-08T19:28:51.595288+0000","last_clean":"2021-10-08T19:28:51.595288+0000","last_became_active":"2021-10-08T19:28:40.150915+0000","last_became_peered":"2021-10-08T19:28:40.150915+0000","last_unstale":"2021-10-08T19:28:51.595288+0000","last_undegraded":"2021-10-08T19:28:51.595288+0000","last_fullsized":"2021-10-08T19:28:51.595288+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:39.543005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:39.543005+0000","last_clean_scrub_stamp":"2021-10-08T19:27:39.543005+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"208'4499","reported_seq":4538,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.594272+0000","last_change":"2021-10-08T19:27:43.655434+0000","last_active":"2021-10-08T19:28:51.594272+0000","last_peered":"2021-10-08T19:28:51.594272+0000","last_clean":"2021-10-08T19:28:51.594272+0000","last_became_active":"2021-10-08T19:27:43.655172+0000","last_became_peered":"2021-10-08T19:27:43.655172+0000","last_unstale":"2021-10-08T19:28:51.594272+0000","last_undegraded":"2021-10-08T19:28:51.594272+0000","last_fullsized":"2021-10-08T19:28:51.594272+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_clean_scrub_stamp":"2021-10-08T19:27:42.631354+0000","log_size":4499,"ondisk_log_size":4499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":294846464,"num_objects":4499,"num_object_clones":0,"num_object_copies":13497,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4499,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4499,"num_write_kb":287936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":169,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.586868+0000","last_change":"2021-10-08T19:28:03.456643+0000","last_active":"2021-10-08T19:28:51.586868+0000","last_peered":"2021-10-08T19:28:51.586868+0000","last_clean":"2021-10-08T19:28:51.586868+0000","last_became_active":"2021-10-08T19:21:27.636086+0000","last_became_peered":"2021-10-08T19:21:27.636086+0000","last_unstale":"2021-10-08T19:28:51.586868+0000","last_undegraded":"2021-10-08T19:28:51.586868+0000","last_fullsized":"2021-10-08T19:28:51.586868+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:03.456570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:28:03.456570+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0035030170000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"69'14","reported_seq":132,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.595121+0000","last_change":"2021-10-08T19:28:12.445917+0000","last_active":"2021-10-08T19:28:51.595121+0000","last_peered":"2021-10-08T19:28:51.595121+0000","last_clean":"2021-10-08T19:28:51.595121+0000","last_became_active":"2021-10-08T19:24:25.100384+0000","last_became_peered":"2021-10-08T19:24:25.100384+0000","last_unstale":"2021-10-08T19:28:51.595121+0000","last_undegraded":"2021-10-08T19:28:51.595121+0000","last_fullsized":"2021-10-08T19:28:51.595121+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'14","last_scrub_stamp":"2021-10-08T19:28:12.445838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:28:12.445838+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0022764790000000001,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":24,"num_read_kb":14,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"90'130","reported_seq":480,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.585983+0000","last_change":"2021-10-08T19:27:22.607667+0000","last_active":"2021-10-08T19:28:51.585983+0000","last_peered":"2021-10-08T19:28:51.585983+0000","last_clean":"2021-10-08T19:28:51.585983+0000","last_became_active":"2021-10-08T19:27:22.607289+0000","last_became_peered":"2021-10-08T19:27:22.607289+0000","last_unstale":"2021-10-08T19:28:51.585983+0000","last_undegraded":"2021-10-08T19:28:51.585983+0000","last_fullsized":"2021-10-08T19:28:51.585983+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.284249+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0045617870000000003,"stat_sum":{"num_bytes":53669,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":27,"num_write":16,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":268349,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":172,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.622305+0000","last_change":"2021-10-08T19:28:02.942168+0000","last_active":"2021-10-08T19:28:51.622305+0000","last_peered":"2021-10-08T19:28:51.622305+0000","last_clean":"2021-10-08T19:28:51.622305+0000","last_became_active":"2021-10-08T19:21:23.599143+0000","last_became_peered":"2021-10-08T19:21:23.599143+0000","last_unstale":"2021-10-08T19:28:51.622305+0000","last_undegraded":"2021-10-08T19:28:51.622305+0000","last_fullsized":"2021-10-08T19:28:51.622305+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:02.942080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:28:02.942080+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0056165080000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":202,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.587273+0000","last_change":"2021-10-08T19:25:14.565749+0000","last_active":"2021-10-08T19:28:51.587273+0000","last_peered":"2021-10-08T19:28:51.587273+0000","last_clean":"2021-10-08T19:28:51.587273+0000","last_became_active":"2021-10-08T19:25:14.565479+0000","last_became_peered":"2021-10-08T19:25:14.565479+0000","last_unstale":"2021-10-08T19:28:51.587273+0000","last_undegraded":"2021-10-08T19:28:51.587273+0000","last_fullsized":"2021-10-08T19:28:51.587273+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:40.563247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.563247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.024890005999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":166,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.623514+0000","last_change":"2021-10-08T19:28:01.982447+0000","last_active":"2021-10-08T19:28:51.623514+0000","last_peered":"2021-10-08T19:28:51.623514+0000","last_clean":"2021-10-08T19:28:51.623514+0000","last_became_active":"2021-10-08T19:21:29.646242+0000","last_became_peered":"2021-10-08T19:21:29.646242+0000","last_unstale":"2021-10-08T19:28:51.623514+0000","last_undegraded":"2021-10-08T19:28:51.623514+0000","last_fullsized":"2021-10-08T19:28:51.623514+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:01.982319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:28:01.982319+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.023009359,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"208'4449","reported_seq":4900,"reported_epoch":213,"state":"active+recovering+undersized+remapped","last_fresh":"2021-10-08T19:28:53.680284+0000","last_change":"2021-10-08T19:28:50.731477+0000","last_active":"2021-10-08T19:28:53.680284+0000","last_peered":"2021-10-08T19:28:53.680284+0000","last_clean":"2021-10-08T19:28:22.610650+0000","last_became_active":"2021-10-08T19:28:40.234440+0000","last_became_peered":"2021-10-08T19:28:40.234440+0000","last_unstale":"2021-10-08T19:28:53.680284+0000","last_undegraded":"2021-10-08T19:28:53.680284+0000","last_fullsized":"2021-10-08T19:28:40.079170+0000","mapping_epoch":202,"log_start":"187'700","ondisk_log_start":"187'700","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_clean_scrub_stamp":"2021-10-08T19:27:42.631354+0000","log_size":3749,"ondisk_log_size":3749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":291569664,"num_objects":4449,"num_object_clones":0,"num_object_copies":13347,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":544,"num_objects_unfound":0,"num_objects_dirty":4449,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4449,"num_write_kb":284736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":12910592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4],"avail_no_missing":["3","4"],"object_location_counts":[{"shards":"2,3,4","objects":544},{"shards":"3,4","objects":3905}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"90'130","reported_seq":488,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.586392+0000","last_change":"2021-10-08T19:27:26.591674+0000","last_active":"2021-10-08T19:28:51.586392+0000","last_peered":"2021-10-08T19:28:51.586392+0000","last_clean":"2021-10-08T19:28:51.586392+0000","last_became_active":"2021-10-08T19:27:26.591250+0000","last_became_peered":"2021-10-08T19:27:26.591250+0000","last_unstale":"2021-10-08T19:28:51.586392+0000","last_undegraded":"2021-10-08T19:28:51.586392+0000","last_fullsized":"2021-10-08T19:28:51.586392+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.284249+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0045617870000000003,"stat_sum":{"num_bytes":53670,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":28,"num_write":17,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":268349,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":165,"reported_epoch":213,"state":"active+clean","last_fresh":"2021-10-08T19:28:53.238177+0000","last_change":"2021-10-08T19:28:53.238807+0000","last_active":"2021-10-08T19:28:53.238177+0000","last_peered":"2021-10-08T19:28:53.238177+0000","last_clean":"2021-10-08T19:28:53.238177+0000","last_became_active":"2021-10-08T19:21:27.637875+0000","last_became_peered":"2021-10-08T19:21:27.637875+0000","last_unstale":"2021-10-08T19:28:53.238177+0000","last_undegraded":"2021-10-08T19:28:53.238177+0000","last_fullsized":"2021-10-08T19:28:53.238177+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:06.487723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:06.487723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034218619999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"69'13","reported_seq":32,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.596446+0000","last_change":"2021-10-08T19:28:41.950802+0000","last_active":"2021-10-08T19:28:51.596446+0000","last_peered":"2021-10-08T19:28:51.596446+0000","last_clean":"2021-10-08T19:28:51.596446+0000","last_became_active":"2021-10-08T19:28:40.192932+0000","last_became_peered":"2021-10-08T19:28:40.192932+0000","last_unstale":"2021-10-08T19:28:51.596446+0000","last_undegraded":"2021-10-08T19:28:51.596446+0000","last_fullsized":"2021-10-08T19:28:51.596446+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'13","last_scrub_stamp":"2021-10-08T19:24:08.192428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:24:08.192428+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":18,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":173,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.588927+0000","last_change":"2021-10-08T19:24:21.997890+0000","last_active":"2021-10-08T19:28:51.588927+0000","last_peered":"2021-10-08T19:28:51.588927+0000","last_clean":"2021-10-08T19:28:51.588927+0000","last_became_active":"2021-10-08T19:21:23.602967+0000","last_became_peered":"2021-10-08T19:21:23.602967+0000","last_unstale":"2021-10-08T19:28:51.588927+0000","last_undegraded":"2021-10-08T19:28:51.588927+0000","last_fullsized":"2021-10-08T19:28:51.588927+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:21.997791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:21.997791+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0069284359999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"70'5","reported_seq":20,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.592255+0000","last_change":"2021-10-08T19:28:40.152388+0000","last_active":"2021-10-08T19:28:51.592255+0000","last_peered":"2021-10-08T19:28:51.592255+0000","last_clean":"2021-10-08T19:28:51.592255+0000","last_became_active":"2021-10-08T19:28:40.148054+0000","last_became_peered":"2021-10-08T19:28:40.148054+0000","last_unstale":"2021-10-08T19:28:51.592255+0000","last_undegraded":"2021-10-08T19:28:51.592255+0000","last_fullsized":"2021-10-08T19:28:51.592255+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:22:48.239721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:48.239721+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":48,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":185,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.587297+0000","last_change":"2021-10-08T19:28:14.485376+0000","last_active":"2021-10-08T19:28:51.587297+0000","last_peered":"2021-10-08T19:28:51.587297+0000","last_clean":"2021-10-08T19:28:51.587297+0000","last_became_active":"2021-10-08T19:24:25.095748+0000","last_became_peered":"2021-10-08T19:24:25.095748+0000","last_unstale":"2021-10-08T19:28:51.587297+0000","last_undegraded":"2021-10-08T19:28:51.587297+0000","last_fullsized":"2021-10-08T19:28:51.587297+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:14.485264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:28:14.485264+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.016729131000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.8","version":"208'4704","reported_seq":4743,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.622475+0000","last_change":"2021-10-08T19:27:43.727224+0000","last_active":"2021-10-08T19:28:51.622475+0000","last_peered":"2021-10-08T19:28:51.622475+0000","last_clean":"2021-10-08T19:28:51.622475+0000","last_became_active":"2021-10-08T19:27:43.726942+0000","last_became_peered":"2021-10-08T19:27:43.726942+0000","last_unstale":"2021-10-08T19:28:51.622475+0000","last_undegraded":"2021-10-08T19:28:51.622475+0000","last_fullsized":"2021-10-08T19:28:51.622475+0000","mapping_epoch":182,"log_start":"187'200","ondisk_log_start":"187'200","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_clean_scrub_stamp":"2021-10-08T19:27:42.631354+0000","log_size":4504,"ondisk_log_size":4504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":308281344,"num_objects":4704,"num_object_clones":0,"num_object_copies":14112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4704,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4704,"num_write_kb":301056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"90'130","reported_seq":348,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.622580+0000","last_change":"2021-10-08T19:27:26.592352+0000","last_active":"2021-10-08T19:28:51.622580+0000","last_peered":"2021-10-08T19:28:51.622580+0000","last_clean":"2021-10-08T19:28:51.622580+0000","last_became_active":"2021-10-08T19:27:26.591993+0000","last_became_peered":"2021-10-08T19:27:26.591993+0000","last_unstale":"2021-10-08T19:28:51.622580+0000","last_undegraded":"2021-10-08T19:28:51.622580+0000","last_fullsized":"2021-10-08T19:28:51.622580+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.284249+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020087920000000001,"stat_sum":{"num_bytes":53670,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":28,"num_write":17,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":161010,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,2],"acting":[5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":183,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:52.121075+0000","last_change":"2021-10-08T19:28:50.291476+0000","last_active":"2021-10-08T19:28:52.121075+0000","last_peered":"2021-10-08T19:28:52.121075+0000","last_clean":"2021-10-08T19:28:52.121075+0000","last_became_active":"2021-10-08T19:28:40.133414+0000","last_became_peered":"2021-10-08T19:28:40.133414+0000","last_unstale":"2021-10-08T19:28:52.121075+0000","last_undegraded":"2021-10-08T19:28:52.121075+0000","last_fullsized":"2021-10-08T19:28:52.121075+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:03.638920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:03.638920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0016933230000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"203'30","reported_seq":46,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.808638+0000","last_change":"2021-10-08T19:28:40.225194+0000","last_active":"2021-10-08T19:28:51.808638+0000","last_peered":"2021-10-08T19:28:51.808638+0000","last_clean":"2021-10-08T19:28:51.808638+0000","last_became_active":"2021-10-08T19:28:40.129026+0000","last_became_peered":"2021-10-08T19:28:40.129026+0000","last_unstale":"2021-10-08T19:28:51.808638+0000","last_undegraded":"2021-10-08T19:28:51.808638+0000","last_fullsized":"2021-10-08T19:28:51.808638+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'28","last_scrub_stamp":"2021-10-08T19:24:18.179708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:24:18.179708+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":47,"num_read_kb":32,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":208,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.622895+0000","last_change":"2021-10-08T19:28:40.138241+0000","last_active":"2021-10-08T19:28:51.622895+0000","last_peered":"2021-10-08T19:28:51.622895+0000","last_clean":"2021-10-08T19:28:51.622895+0000","last_became_active":"2021-10-08T19:28:40.137919+0000","last_became_peered":"2021-10-08T19:28:40.137919+0000","last_unstale":"2021-10-08T19:28:51.622895+0000","last_undegraded":"2021-10-08T19:28:51.622895+0000","last_fullsized":"2021-10-08T19:28:51.622895+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:38.072667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:27:38.072667+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0013248769999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":160,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.587444+0000","last_change":"2021-10-08T19:23:25.378511+0000","last_active":"2021-10-08T19:28:51.587444+0000","last_peered":"2021-10-08T19:28:51.587444+0000","last_clean":"2021-10-08T19:28:51.587444+0000","last_became_active":"2021-10-08T19:21:29.647403+0000","last_became_peered":"2021-10-08T19:21:29.647403+0000","last_unstale":"2021-10-08T19:28:51.587444+0000","last_undegraded":"2021-10-08T19:28:51.587444+0000","last_fullsized":"2021-10-08T19:28:51.587444+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:25.378429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:25.378429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0050198400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":135,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.592258+0000","last_change":"2021-10-08T19:25:14.550996+0000","last_active":"2021-10-08T19:28:51.592258+0000","last_peered":"2021-10-08T19:28:51.592258+0000","last_clean":"2021-10-08T19:28:51.592258+0000","last_became_active":"2021-10-08T19:25:14.550690+0000","last_became_peered":"2021-10-08T19:25:14.550690+0000","last_unstale":"2021-10-08T19:28:51.592258+0000","last_undegraded":"2021-10-08T19:28:51.592258+0000","last_fullsized":"2021-10-08T19:28:51.592258+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:09.177525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:09.177525+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"208'4663","reported_seq":4702,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:52.121243+0000","last_change":"2021-10-08T19:27:43.660274+0000","last_active":"2021-10-08T19:28:52.121243+0000","last_peered":"2021-10-08T19:28:52.121243+0000","last_clean":"2021-10-08T19:28:52.121243+0000","last_became_active":"2021-10-08T19:27:43.659455+0000","last_became_peered":"2021-10-08T19:27:43.659455+0000","last_unstale":"2021-10-08T19:28:52.121243+0000","last_undegraded":"2021-10-08T19:28:52.121243+0000","last_fullsized":"2021-10-08T19:28:52.121243+0000","mapping_epoch":182,"log_start":"187'100","ondisk_log_start":"187'100","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_clean_scrub_stamp":"2021-10-08T19:27:42.631354+0000","log_size":4563,"ondisk_log_size":4563,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":305594368,"num_objects":4663,"num_object_clones":0,"num_object_copies":13989,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4663,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4663,"num_write_kb":298432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"90'130","reported_seq":411,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.594946+0000","last_change":"2021-10-08T19:27:26.598625+0000","last_active":"2021-10-08T19:28:51.594946+0000","last_peered":"2021-10-08T19:28:51.594946+0000","last_clean":"2021-10-08T19:28:51.594946+0000","last_became_active":"2021-10-08T19:27:26.598245+0000","last_became_peered":"2021-10-08T19:27:26.598245+0000","last_unstale":"2021-10-08T19:28:51.594946+0000","last_undegraded":"2021-10-08T19:28:51.594946+0000","last_fullsized":"2021-10-08T19:28:51.594946+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.284249+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0045617870000000003,"stat_sum":{"num_bytes":53670,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":28,"num_write":16,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":214679,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"114'10","reported_seq":294,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:52.120757+0000","last_change":"2021-10-08T19:24:25.551891+0000","last_active":"2021-10-08T19:28:52.120757+0000","last_peered":"2021-10-08T19:28:52.120757+0000","last_clean":"2021-10-08T19:28:52.120757+0000","last_became_active":"2021-10-08T19:24:25.106695+0000","last_became_peered":"2021-10-08T19:24:25.106695+0000","last_unstale":"2021-10-08T19:28:52.120757+0000","last_undegraded":"2021-10-08T19:28:52.120757+0000","last_fullsized":"2021-10-08T19:28:52.120757+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'9","last_scrub_stamp":"2021-10-08T19:24:04.193898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:04.193898+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0022019909999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"69'10","reported_seq":32,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.592596+0000","last_change":"2021-10-08T19:28:40.212123+0000","last_active":"2021-10-08T19:28:51.592596+0000","last_peered":"2021-10-08T19:28:51.592596+0000","last_clean":"2021-10-08T19:28:51.592596+0000","last_became_active":"2021-10-08T19:28:40.145524+0000","last_became_peered":"2021-10-08T19:28:40.145524+0000","last_unstale":"2021-10-08T19:28:51.592596+0000","last_undegraded":"2021-10-08T19:28:51.592596+0000","last_fullsized":"2021-10-08T19:28:51.592596+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'10","last_scrub_stamp":"2021-10-08T19:24:17.162525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:24:17.162525+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.595357+0000","last_change":"2021-10-08T19:28:40.151489+0000","last_active":"2021-10-08T19:28:51.595357+0000","last_peered":"2021-10-08T19:28:51.595357+0000","last_clean":"2021-10-08T19:28:51.595357+0000","last_became_active":"2021-10-08T19:28:40.141737+0000","last_became_peered":"2021-10-08T19:28:40.141737+0000","last_unstale":"2021-10-08T19:28:51.595357+0000","last_undegraded":"2021-10-08T19:28:51.595357+0000","last_fullsized":"2021-10-08T19:28:51.595357+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:11.227079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:11.227079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":167,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:52.119223+0000","last_change":"2021-10-08T19:27:38.333212+0000","last_active":"2021-10-08T19:28:52.119223+0000","last_peered":"2021-10-08T19:28:52.119223+0000","last_clean":"2021-10-08T19:28:52.119223+0000","last_became_active":"2021-10-08T19:21:29.649735+0000","last_became_peered":"2021-10-08T19:21:29.649735+0000","last_unstale":"2021-10-08T19:28:52.119223+0000","last_undegraded":"2021-10-08T19:28:52.119223+0000","last_fullsized":"2021-10-08T19:28:52.119223+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:38.333135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:27:38.333135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.006947773,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":130,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.623213+0000","last_change":"2021-10-08T19:25:14.562179+0000","last_active":"2021-10-08T19:28:51.623213+0000","last_peered":"2021-10-08T19:28:51.623213+0000","last_clean":"2021-10-08T19:28:51.623213+0000","last_became_active":"2021-10-08T19:25:14.561850+0000","last_became_peered":"2021-10-08T19:25:14.561850+0000","last_unstale":"2021-10-08T19:28:51.623213+0000","last_undegraded":"2021-10-08T19:28:51.623213+0000","last_fullsized":"2021-10-08T19:28:51.623213+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:17.379559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:17.379559+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0052805589999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.5","version":"208'4556","reported_seq":4595,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.594992+0000","last_change":"2021-10-08T19:27:43.728370+0000","last_active":"2021-10-08T19:28:51.594992+0000","last_peered":"2021-10-08T19:28:51.594992+0000","last_clean":"2021-10-08T19:28:51.594992+0000","last_became_active":"2021-10-08T19:27:43.728067+0000","last_became_peered":"2021-10-08T19:27:43.728067+0000","last_unstale":"2021-10-08T19:28:51.594992+0000","last_undegraded":"2021-10-08T19:28:51.594992+0000","last_fullsized":"2021-10-08T19:28:51.594992+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_clean_scrub_stamp":"2021-10-08T19:27:42.631354+0000","log_size":4556,"ondisk_log_size":4556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":298582016,"num_objects":4556,"num_object_clones":0,"num_object_copies":13668,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4556,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4556,"num_write_kb":291584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":187,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.588647+0000","last_change":"2021-10-08T19:28:40.140272+0000","last_active":"2021-10-08T19:28:51.588647+0000","last_peered":"2021-10-08T19:28:51.588647+0000","last_clean":"2021-10-08T19:28:51.588647+0000","last_became_active":"2021-10-08T19:28:40.138726+0000","last_became_peered":"2021-10-08T19:28:40.138726+0000","last_unstale":"2021-10-08T19:28:51.588647+0000","last_undegraded":"2021-10-08T19:28:51.588647+0000","last_fullsized":"2021-10-08T19:28:51.588647+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:06.071819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:50.435552+0000","last_clean_scrub_stamp":"2021-10-08T19:28:06.071819+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0076036530000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"69'12","reported_seq":229,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.591838+0000","last_change":"2021-10-08T19:28:48.277300+0000","last_active":"2021-10-08T19:28:51.591838+0000","last_peered":"2021-10-08T19:28:51.591838+0000","last_clean":"2021-10-08T19:28:51.591838+0000","last_became_active":"2021-10-08T19:28:40.103392+0000","last_became_peered":"2021-10-08T19:28:40.103392+0000","last_unstale":"2021-10-08T19:28:51.591838+0000","last_undegraded":"2021-10-08T19:28:51.591838+0000","last_fullsized":"2021-10-08T19:28:51.591838+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'12","last_scrub_stamp":"2021-10-08T19:22:57.003641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:57.003641+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0041017010000000001,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"61'2","reported_seq":182,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.592978+0000","last_change":"2021-10-08T19:23:07.991466+0000","last_active":"2021-10-08T19:28:51.592978+0000","last_peered":"2021-10-08T19:28:51.592978+0000","last_clean":"2021-10-08T19:28:51.592978+0000","last_became_active":"2021-10-08T19:21:23.603614+0000","last_became_peered":"2021-10-08T19:21:23.603614+0000","last_unstale":"2021-10-08T19:28:51.592978+0000","last_undegraded":"2021-10-08T19:28:51.592978+0000","last_fullsized":"2021-10-08T19:28:51.592978+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'2","last_scrub_stamp":"2021-10-08T19:23:07.991388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:07.991388+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001614983,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":178,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.587658+0000","last_change":"2021-10-08T19:28:40.169260+0000","last_active":"2021-10-08T19:28:51.587658+0000","last_peered":"2021-10-08T19:28:51.587658+0000","last_clean":"2021-10-08T19:28:51.587658+0000","last_became_active":"2021-10-08T19:28:40.168753+0000","last_became_peered":"2021-10-08T19:28:40.168753+0000","last_unstale":"2021-10-08T19:28:51.587658+0000","last_undegraded":"2021-10-08T19:28:51.587658+0000","last_fullsized":"2021-10-08T19:28:51.587658+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:12.484818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:24:12.484818+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0047233090000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":108,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.586869+0000","last_change":"2021-10-08T19:28:40.101079+0000","last_active":"2021-10-08T19:28:51.586869+0000","last_peered":"2021-10-08T19:28:51.586869+0000","last_clean":"2021-10-08T19:28:51.586869+0000","last_became_active":"2021-10-08T19:28:40.100770+0000","last_became_peered":"2021-10-08T19:28:40.100770+0000","last_unstale":"2021-10-08T19:28:51.586869+0000","last_undegraded":"2021-10-08T19:28:51.586869+0000","last_fullsized":"2021-10-08T19:28:51.586869+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:40.563247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.563247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.024890005999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"69'9","reported_seq":183,"reported_epoch":213,"state":"active+clean","last_fresh":"2021-10-08T19:28:53.277054+0000","last_change":"2021-10-08T19:28:53.277504+0000","last_active":"2021-10-08T19:28:53.277054+0000","last_peered":"2021-10-08T19:28:53.277054+0000","last_clean":"2021-10-08T19:28:53.277054+0000","last_became_active":"2021-10-08T19:21:25.743804+0000","last_became_peered":"2021-10-08T19:21:25.743804+0000","last_unstale":"2021-10-08T19:28:53.277054+0000","last_undegraded":"2021-10-08T19:28:53.277054+0000","last_fullsized":"2021-10-08T19:28:53.277054+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'9","last_scrub_stamp":"2021-10-08T19:23:00.644449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:00.644449+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0023246959999999998,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":191,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.588566+0000","last_change":"2021-10-08T19:28:40.140468+0000","last_active":"2021-10-08T19:28:51.588566+0000","last_peered":"2021-10-08T19:28:51.588566+0000","last_clean":"2021-10-08T19:28:51.588566+0000","last_became_active":"2021-10-08T19:28:40.139234+0000","last_became_peered":"2021-10-08T19:28:40.139234+0000","last_unstale":"2021-10-08T19:28:51.588566+0000","last_undegraded":"2021-10-08T19:28:51.588566+0000","last_fullsized":"2021-10-08T19:28:51.588566+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:36.618136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:36.618136+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0014720390000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":186,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.590676+0000","last_change":"2021-10-08T19:28:40.239134+0000","last_active":"2021-10-08T19:28:51.590676+0000","last_peered":"2021-10-08T19:28:51.590676+0000","last_clean":"2021-10-08T19:28:51.590676+0000","last_became_active":"2021-10-08T19:28:40.232321+0000","last_became_peered":"2021-10-08T19:28:40.232321+0000","last_unstale":"2021-10-08T19:28:51.590676+0000","last_undegraded":"2021-10-08T19:28:51.590676+0000","last_fullsized":"2021-10-08T19:28:51.590676+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:03.149594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:28:03.149594+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011094171,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":167,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.591029+0000","last_change":"2021-10-08T19:24:05.869865+0000","last_active":"2021-10-08T19:28:51.591029+0000","last_peered":"2021-10-08T19:28:51.591029+0000","last_clean":"2021-10-08T19:28:51.591029+0000","last_became_active":"2021-10-08T19:21:29.640674+0000","last_became_peered":"2021-10-08T19:21:29.640674+0000","last_unstale":"2021-10-08T19:28:51.591029+0000","last_undegraded":"2021-10-08T19:28:51.591029+0000","last_fullsized":"2021-10-08T19:28:51.591029+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:05.869774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:24:05.869774+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0041453820000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":92,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.585956+0000","last_change":"2021-10-08T19:28:46.389722+0000","last_active":"2021-10-08T19:28:51.585956+0000","last_peered":"2021-10-08T19:28:51.585956+0000","last_clean":"2021-10-08T19:28:51.585956+0000","last_became_active":"2021-10-08T19:25:15.501118+0000","last_became_peered":"2021-10-08T19:25:15.501118+0000","last_unstale":"2021-10-08T19:28:51.585956+0000","last_undegraded":"2021-10-08T19:28:51.585956+0000","last_fullsized":"2021-10-08T19:28:51.585956+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:09.177525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:09.177525+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0090469920000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"69'6","reported_seq":207,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.590663+0000","last_change":"2021-10-08T19:28:48.456149+0000","last_active":"2021-10-08T19:28:51.590663+0000","last_peered":"2021-10-08T19:28:51.590663+0000","last_clean":"2021-10-08T19:28:51.590663+0000","last_became_active":"2021-10-08T19:28:40.232755+0000","last_became_peered":"2021-10-08T19:28:40.232755+0000","last_unstale":"2021-10-08T19:28:51.590663+0000","last_undegraded":"2021-10-08T19:28:51.590663+0000","last_fullsized":"2021-10-08T19:28:51.590663+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'6","last_scrub_stamp":"2021-10-08T19:23:21.395390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:21.395390+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002416241,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":134,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.594543+0000","last_change":"2021-10-08T19:28:40.102224+0000","last_active":"2021-10-08T19:28:51.594543+0000","last_peered":"2021-10-08T19:28:51.594543+0000","last_clean":"2021-10-08T19:28:51.594543+0000","last_became_active":"2021-10-08T19:28:40.101898+0000","last_became_peered":"2021-10-08T19:28:40.101898+0000","last_unstale":"2021-10-08T19:28:51.594543+0000","last_undegraded":"2021-10-08T19:28:51.594543+0000","last_fullsized":"2021-10-08T19:28:51.594543+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:16.444582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:16.444582+0000","last_clean_scrub_stamp":"2021-10-08T19:28:16.444582+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0044375919999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":186,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.623228+0000","last_change":"2021-10-08T19:28:40.104418+0000","last_active":"2021-10-08T19:28:51.623228+0000","last_peered":"2021-10-08T19:28:51.623228+0000","last_clean":"2021-10-08T19:28:51.623228+0000","last_became_active":"2021-10-08T19:28:40.103708+0000","last_became_peered":"2021-10-08T19:28:40.103708+0000","last_unstale":"2021-10-08T19:28:51.623228+0000","last_undegraded":"2021-10-08T19:28:51.623228+0000","last_fullsized":"2021-10-08T19:28:51.623228+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:22.361166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:22.361166+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011785238,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":191,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.587132+0000","last_change":"2021-10-08T19:28:15.480476+0000","last_active":"2021-10-08T19:28:51.587132+0000","last_peered":"2021-10-08T19:28:51.587132+0000","last_clean":"2021-10-08T19:28:51.587132+0000","last_became_active":"2021-10-08T19:24:25.099371+0000","last_became_peered":"2021-10-08T19:24:25.099371+0000","last_unstale":"2021-10-08T19:28:51.587132+0000","last_undegraded":"2021-10-08T19:28:51.587132+0000","last_fullsized":"2021-10-08T19:28:51.587132+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:15.480374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:28:15.480374+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0076754220000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"70'5","reported_seq":345,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.594169+0000","last_change":"2021-10-08T19:25:15.495111+0000","last_active":"2021-10-08T19:28:51.594169+0000","last_peered":"2021-10-08T19:28:51.594169+0000","last_clean":"2021-10-08T19:28:51.594169+0000","last_became_active":"2021-10-08T19:25:15.494766+0000","last_became_peered":"2021-10-08T19:25:15.494766+0000","last_unstale":"2021-10-08T19:28:51.594169+0000","last_undegraded":"2021-10-08T19:28:51.594169+0000","last_fullsized":"2021-10-08T19:28:51.594169+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:22:48.239721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:48.239721+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001618092,"stat_sum":{"num_bytes":49,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":19,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":49,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"69'10","reported_seq":161,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.590873+0000","last_change":"2021-10-08T19:28:41.377933+0000","last_active":"2021-10-08T19:28:51.590873+0000","last_peered":"2021-10-08T19:28:51.590873+0000","last_clean":"2021-10-08T19:28:51.590873+0000","last_became_active":"2021-10-08T19:28:40.139826+0000","last_became_peered":"2021-10-08T19:28:40.139826+0000","last_unstale":"2021-10-08T19:28:51.590873+0000","last_undegraded":"2021-10-08T19:28:51.590873+0000","last_fullsized":"2021-10-08T19:28:51.590873+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'10","last_scrub_stamp":"2021-10-08T19:28:03.073833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:28:03.073833+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0061927040000000003,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,7],"acting":[2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":172,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.622292+0000","last_change":"2021-10-08T19:24:23.338025+0000","last_active":"2021-10-08T19:28:51.622292+0000","last_peered":"2021-10-08T19:28:51.622292+0000","last_clean":"2021-10-08T19:28:51.622292+0000","last_became_active":"2021-10-08T19:21:23.603637+0000","last_became_peered":"2021-10-08T19:21:23.603637+0000","last_unstale":"2021-10-08T19:28:51.622292+0000","last_undegraded":"2021-10-08T19:28:51.622292+0000","last_fullsized":"2021-10-08T19:28:51.622292+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:23.337954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:23.337954+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0033141500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"203'10","reported_seq":293,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.808646+0000","last_change":"2021-10-08T19:28:40.246331+0000","last_active":"2021-10-08T19:28:51.808646+0000","last_peered":"2021-10-08T19:28:51.808646+0000","last_clean":"2021-10-08T19:28:51.808646+0000","last_became_active":"2021-10-08T19:28:40.138031+0000","last_became_peered":"2021-10-08T19:28:40.138031+0000","last_unstale":"2021-10-08T19:28:51.808646+0000","last_undegraded":"2021-10-08T19:28:51.808646+0000","last_fullsized":"2021-10-08T19:28:51.808646+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'8","last_scrub_stamp":"2021-10-08T19:24:10.319809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:10.319809+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0087040810000000007,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":161,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:52.121483+0000","last_change":"2021-10-08T19:23:11.535748+0000","last_active":"2021-10-08T19:28:52.121483+0000","last_peered":"2021-10-08T19:28:52.121483+0000","last_clean":"2021-10-08T19:28:52.121483+0000","last_became_active":"2021-10-08T19:21:29.646331+0000","last_became_peered":"2021-10-08T19:21:29.646331+0000","last_unstale":"2021-10-08T19:28:52.121483+0000","last_undegraded":"2021-10-08T19:28:52.121483+0000","last_fullsized":"2021-10-08T19:28:52.121483+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:11.535641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:11.535641+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001740417,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":96,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.586281+0000","last_change":"2021-10-08T19:28:16.470287+0000","last_active":"2021-10-08T19:28:51.586281+0000","last_peered":"2021-10-08T19:28:51.586281+0000","last_clean":"2021-10-08T19:28:51.586281+0000","last_became_active":"2021-10-08T19:25:15.498770+0000","last_became_peered":"2021-10-08T19:25:15.498770+0000","last_unstale":"2021-10-08T19:28:51.586281+0000","last_undegraded":"2021-10-08T19:28:51.586281+0000","last_fullsized":"2021-10-08T19:28:51.586281+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:16.470205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:28:16.470205+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0078687189999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"69'9","reported_seq":186,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.623162+0000","last_change":"2021-10-08T19:24:04.286963+0000","last_active":"2021-10-08T19:28:51.623162+0000","last_peered":"2021-10-08T19:28:51.623162+0000","last_clean":"2021-10-08T19:28:51.623162+0000","last_became_active":"2021-10-08T19:21:25.741755+0000","last_became_peered":"2021-10-08T19:21:25.741755+0000","last_unstale":"2021-10-08T19:28:51.623162+0000","last_undegraded":"2021-10-08T19:28:51.623162+0000","last_fullsized":"2021-10-08T19:28:51.623162+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'9","last_scrub_stamp":"2021-10-08T19:24:04.286857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:24:04.286857+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0047281429999999998,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":173,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:52.118998+0000","last_change":"2021-10-08T19:23:27.367010+0000","last_active":"2021-10-08T19:28:52.118998+0000","last_peered":"2021-10-08T19:28:52.118998+0000","last_clean":"2021-10-08T19:28:52.118998+0000","last_became_active":"2021-10-08T19:21:23.606478+0000","last_became_peered":"2021-10-08T19:21:23.606478+0000","last_unstale":"2021-10-08T19:28:52.118998+0000","last_undegraded":"2021-10-08T19:28:52.118998+0000","last_fullsized":"2021-10-08T19:28:52.118998+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:27.366934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:27.366934+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0016199809999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"69'8","reported_seq":266,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.808600+0000","last_change":"2021-10-08T19:24:16.547591+0000","last_active":"2021-10-08T19:28:51.808600+0000","last_peered":"2021-10-08T19:28:51.808600+0000","last_clean":"2021-10-08T19:28:51.808600+0000","last_became_active":"2021-10-08T19:21:27.636440+0000","last_became_peered":"2021-10-08T19:21:27.636440+0000","last_unstale":"2021-10-08T19:28:51.808600+0000","last_undegraded":"2021-10-08T19:28:51.808600+0000","last_fullsized":"2021-10-08T19:28:51.808600+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'8","last_scrub_stamp":"2021-10-08T19:24:16.547475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:16.547475+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0084390609999999994,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":160,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.593122+0000","last_change":"2021-10-08T19:22:49.049456+0000","last_active":"2021-10-08T19:28:51.593122+0000","last_peered":"2021-10-08T19:28:51.593122+0000","last_clean":"2021-10-08T19:28:51.593122+0000","last_became_active":"2021-10-08T19:21:29.640302+0000","last_became_peered":"2021-10-08T19:21:29.640302+0000","last_unstale":"2021-10-08T19:28:51.593122+0000","last_undegraded":"2021-10-08T19:28:51.593122+0000","last_fullsized":"2021-10-08T19:28:51.593122+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:49.049379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:49.049379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.00162856,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":90,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:52.120258+0000","last_change":"2021-10-08T19:25:15.502340+0000","last_active":"2021-10-08T19:28:52.120258+0000","last_peered":"2021-10-08T19:28:52.120258+0000","last_clean":"2021-10-08T19:28:52.120258+0000","last_became_active":"2021-10-08T19:25:15.502018+0000","last_became_peered":"2021-10-08T19:25:15.502018+0000","last_unstale":"2021-10-08T19:28:52.120258+0000","last_undegraded":"2021-10-08T19:28:52.120258+0000","last_fullsized":"2021-10-08T19:28:52.120258+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:40.563247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.563247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.024890005999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":92,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.587079+0000","last_change":"2021-10-08T19:28:47.348777+0000","last_active":"2021-10-08T19:28:51.587079+0000","last_peered":"2021-10-08T19:28:51.587079+0000","last_clean":"2021-10-08T19:28:51.587079+0000","last_became_active":"2021-10-08T19:25:15.504778+0000","last_became_peered":"2021-10-08T19:25:15.504778+0000","last_unstale":"2021-10-08T19:28:51.587079+0000","last_undegraded":"2021-10-08T19:28:51.587079+0000","last_fullsized":"2021-10-08T19:28:51.587079+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:17.379559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:17.379559+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0090469920000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"87'13","reported_seq":30,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.592439+0000","last_change":"2021-10-08T19:28:40.216943+0000","last_active":"2021-10-08T19:28:51.592439+0000","last_peered":"2021-10-08T19:28:51.592439+0000","last_clean":"2021-10-08T19:28:51.592439+0000","last_became_active":"2021-10-08T19:28:40.144845+0000","last_became_peered":"2021-10-08T19:28:40.144845+0000","last_unstale":"2021-10-08T19:28:51.592439+0000","last_undegraded":"2021-10-08T19:28:51.592439+0000","last_fullsized":"2021-10-08T19:28:51.592439+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'13","last_scrub_stamp":"2021-10-08T19:22:53.263631+0000","last_deep_scrub":"87'13","last_deep_scrub_stamp":"2021-10-08T19:22:53.263631+0000","last_clean_scrub_stamp":"2021-10-08T19:22:53.263631+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0036954140000000002,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":116,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.594812+0000","last_change":"2021-10-08T19:28:09.389916+0000","last_active":"2021-10-08T19:28:51.594812+0000","last_peered":"2021-10-08T19:28:51.594812+0000","last_clean":"2021-10-08T19:28:51.594812+0000","last_became_active":"2021-10-08T19:24:25.105096+0000","last_became_peered":"2021-10-08T19:24:25.105096+0000","last_unstale":"2021-10-08T19:28:51.594812+0000","last_undegraded":"2021-10-08T19:28:51.594812+0000","last_fullsized":"2021-10-08T19:28:51.594812+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:09.389812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:28:09.389812+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0046254870000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":180,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.587578+0000","last_change":"2021-10-08T19:28:40.169064+0000","last_active":"2021-10-08T19:28:51.587578+0000","last_peered":"2021-10-08T19:28:51.587578+0000","last_clean":"2021-10-08T19:28:51.587578+0000","last_became_active":"2021-10-08T19:28:40.168321+0000","last_became_peered":"2021-10-08T19:28:40.168321+0000","last_unstale":"2021-10-08T19:28:51.587578+0000","last_undegraded":"2021-10-08T19:28:51.587578+0000","last_fullsized":"2021-10-08T19:28:51.587578+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:28.367323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.367323+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034823359999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":181,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:52.326538+0000","last_change":"2021-10-08T19:28:52.326538+0000","last_active":"2021-10-08T19:28:52.326538+0000","last_peered":"2021-10-08T19:28:52.326538+0000","last_clean":"2021-10-08T19:28:52.326538+0000","last_became_active":"2021-10-08T19:28:40.133744+0000","last_became_peered":"2021-10-08T19:28:40.133744+0000","last_unstale":"2021-10-08T19:28:52.326538+0000","last_undegraded":"2021-10-08T19:28:52.326538+0000","last_fullsized":"2021-10-08T19:28:52.326538+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:02.605025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:02.605025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001265305,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"69'11","reported_seq":315,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.592182+0000","last_change":"2021-10-08T19:28:41.685298+0000","last_active":"2021-10-08T19:28:51.592182+0000","last_peered":"2021-10-08T19:28:51.592182+0000","last_clean":"2021-10-08T19:28:51.592182+0000","last_became_active":"2021-10-08T19:28:40.100196+0000","last_became_peered":"2021-10-08T19:28:40.100196+0000","last_unstale":"2021-10-08T19:28:51.592182+0000","last_undegraded":"2021-10-08T19:28:51.592182+0000","last_fullsized":"2021-10-08T19:28:51.592182+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'11","last_scrub_stamp":"2021-10-08T19:24:04.177847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:24:04.177847+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0047576429999999998,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":20,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.595775+0000","last_change":"2021-10-08T19:28:40.147869+0000","last_active":"2021-10-08T19:28:51.595775+0000","last_peered":"2021-10-08T19:28:51.595775+0000","last_clean":"2021-10-08T19:28:51.595775+0000","last_became_active":"2021-10-08T19:28:40.146673+0000","last_became_peered":"2021-10-08T19:28:40.146673+0000","last_unstale":"2021-10-08T19:28:51.595775+0000","last_undegraded":"2021-10-08T19:28:51.595775+0000","last_fullsized":"2021-10-08T19:28:51.595775+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:02.242462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:02.242462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":20,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.592593+0000","last_change":"2021-10-08T19:28:40.147113+0000","last_active":"2021-10-08T19:28:51.592593+0000","last_peered":"2021-10-08T19:28:51.592593+0000","last_clean":"2021-10-08T19:28:51.592593+0000","last_became_active":"2021-10-08T19:28:40.145983+0000","last_became_peered":"2021-10-08T19:28:40.145983+0000","last_unstale":"2021-10-08T19:28:51.592593+0000","last_undegraded":"2021-10-08T19:28:51.592593+0000","last_fullsized":"2021-10-08T19:28:51.592593+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:00.640354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:43.186684+0000","last_clean_scrub_stamp":"2021-10-08T19:28:00.640354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":166,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.586561+0000","last_change":"2021-10-08T19:28:10.199798+0000","last_active":"2021-10-08T19:28:51.586561+0000","last_peered":"2021-10-08T19:28:51.586561+0000","last_clean":"2021-10-08T19:28:51.586561+0000","last_became_active":"2021-10-08T19:21:29.649225+0000","last_became_peered":"2021-10-08T19:21:29.649225+0000","last_unstale":"2021-10-08T19:28:51.586561+0000","last_undegraded":"2021-10-08T19:28:51.586561+0000","last_fullsized":"2021-10-08T19:28:51.586561+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:10.199698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:28:10.199698+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.01642865,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"70'5","reported_seq":90,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.592498+0000","last_change":"2021-10-08T19:25:15.496726+0000","last_active":"2021-10-08T19:28:51.592498+0000","last_peered":"2021-10-08T19:28:51.592498+0000","last_clean":"2021-10-08T19:28:51.592498+0000","last_became_active":"2021-10-08T19:25:15.496309+0000","last_became_peered":"2021-10-08T19:25:15.496309+0000","last_unstale":"2021-10-08T19:28:51.592498+0000","last_undegraded":"2021-10-08T19:28:51.592498+0000","last_fullsized":"2021-10-08T19:28:51.592498+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:22:48.239721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:48.239721+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001618092,"stat_sum":{"num_bytes":49,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":19,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":49,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.10","version":"69'4","reported_seq":236,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.587274+0000","last_change":"2021-10-08T19:28:41.945340+0000","last_active":"2021-10-08T19:28:51.587274+0000","last_peered":"2021-10-08T19:28:51.587274+0000","last_clean":"2021-10-08T19:28:51.587274+0000","last_became_active":"2021-10-08T19:28:40.160138+0000","last_became_peered":"2021-10-08T19:28:40.160138+0000","last_unstale":"2021-10-08T19:28:51.587274+0000","last_undegraded":"2021-10-08T19:28:51.587274+0000","last_fullsized":"2021-10-08T19:28:51.587274+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'4","last_scrub_stamp":"2021-10-08T19:27:38.084136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:27:38.084136+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040040570000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":190,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.623405+0000","last_change":"2021-10-08T19:24:25.094735+0000","last_active":"2021-10-08T19:28:51.623405+0000","last_peered":"2021-10-08T19:28:51.623405+0000","last_clean":"2021-10-08T19:28:51.623405+0000","last_became_active":"2021-10-08T19:24:25.094384+0000","last_became_peered":"2021-10-08T19:24:25.094384+0000","last_unstale":"2021-10-08T19:28:51.623405+0000","last_undegraded":"2021-10-08T19:28:51.623405+0000","last_fullsized":"2021-10-08T19:28:51.623405+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:21.346014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:13.716331+0000","last_clean_scrub_stamp":"2021-10-08T19:24:21.346014+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0086210910000000009,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":116,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.594535+0000","last_change":"2021-10-08T19:28:06.373378+0000","last_active":"2021-10-08T19:28:51.594535+0000","last_peered":"2021-10-08T19:28:51.594535+0000","last_clean":"2021-10-08T19:28:51.594535+0000","last_became_active":"2021-10-08T19:24:25.106186+0000","last_became_peered":"2021-10-08T19:24:25.106186+0000","last_unstale":"2021-10-08T19:28:51.594535+0000","last_undegraded":"2021-10-08T19:28:51.594535+0000","last_fullsized":"2021-10-08T19:28:51.594535+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:06.373281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:28:06.373281+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001680923,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":169,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:52.327288+0000","last_change":"2021-10-08T19:28:52.327288+0000","last_active":"2021-10-08T19:28:52.327288+0000","last_peered":"2021-10-08T19:28:52.327288+0000","last_clean":"2021-10-08T19:28:52.327288+0000","last_became_active":"2021-10-08T19:21:29.642835+0000","last_became_peered":"2021-10-08T19:21:29.642835+0000","last_unstale":"2021-10-08T19:28:52.327288+0000","last_undegraded":"2021-10-08T19:28:52.327288+0000","last_fullsized":"2021-10-08T19:28:52.327288+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:18.542124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:24:18.542124+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0051790259999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":108,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.623176+0000","last_change":"2021-10-08T19:28:40.099565+0000","last_active":"2021-10-08T19:28:51.623176+0000","last_peered":"2021-10-08T19:28:51.623176+0000","last_clean":"2021-10-08T19:28:51.623176+0000","last_became_active":"2021-10-08T19:28:40.099215+0000","last_became_peered":"2021-10-08T19:28:40.099215+0000","last_unstale":"2021-10-08T19:28:51.623176+0000","last_undegraded":"2021-10-08T19:28:51.623176+0000","last_fullsized":"2021-10-08T19:28:51.623176+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:40.563247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.563247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.024890005999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"69'11","reported_seq":225,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.586951+0000","last_change":"2021-10-08T19:24:25.550057+0000","last_active":"2021-10-08T19:28:51.586951+0000","last_peered":"2021-10-08T19:28:51.586951+0000","last_clean":"2021-10-08T19:28:51.586951+0000","last_became_active":"2021-10-08T19:24:25.097676+0000","last_became_peered":"2021-10-08T19:24:25.097676+0000","last_unstale":"2021-10-08T19:28:51.586951+0000","last_undegraded":"2021-10-08T19:28:51.586951+0000","last_fullsized":"2021-10-08T19:28:51.586951+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'11","last_scrub_stamp":"2021-10-08T19:23:38.388959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:38.388959+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039620519999999998,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":116,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.595328+0000","last_change":"2021-10-08T19:28:15.451285+0000","last_active":"2021-10-08T19:28:51.595328+0000","last_peered":"2021-10-08T19:28:51.595328+0000","last_clean":"2021-10-08T19:28:51.595328+0000","last_became_active":"2021-10-08T19:24:25.098128+0000","last_became_peered":"2021-10-08T19:24:25.098128+0000","last_unstale":"2021-10-08T19:28:51.595328+0000","last_undegraded":"2021-10-08T19:28:51.595328+0000","last_fullsized":"2021-10-08T19:28:51.595328+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:15.451208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:34.508558+0000","last_clean_scrub_stamp":"2021-10-08T19:28:15.451208+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.005925647,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":187,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.586191+0000","last_change":"2021-10-08T19:28:11.383850+0000","last_active":"2021-10-08T19:28:51.586191+0000","last_peered":"2021-10-08T19:28:51.586191+0000","last_clean":"2021-10-08T19:28:51.586191+0000","last_became_active":"2021-10-08T19:24:25.095490+0000","last_became_peered":"2021-10-08T19:24:25.095490+0000","last_unstale":"2021-10-08T19:28:51.586191+0000","last_undegraded":"2021-10-08T19:28:51.586191+0000","last_fullsized":"2021-10-08T19:28:51.586191+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:11.383779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:11.383779+0000","last_clean_scrub_stamp":"2021-10-08T19:28:11.383779+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001362776,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":178,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.587722+0000","last_change":"2021-10-08T19:24:25.102165+0000","last_active":"2021-10-08T19:28:51.587722+0000","last_peered":"2021-10-08T19:28:51.587722+0000","last_clean":"2021-10-08T19:28:51.587722+0000","last_became_active":"2021-10-08T19:24:25.100477+0000","last_became_peered":"2021-10-08T19:24:25.100477+0000","last_unstale":"2021-10-08T19:28:51.587722+0000","last_undegraded":"2021-10-08T19:28:51.587722+0000","last_fullsized":"2021-10-08T19:28:51.587722+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:06.570853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:06.570853+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034079790000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"69'10","reported_seq":186,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:52.121652+0000","last_change":"2021-10-08T19:23:36.223620+0000","last_active":"2021-10-08T19:28:52.121652+0000","last_peered":"2021-10-08T19:28:52.121652+0000","last_clean":"2021-10-08T19:28:52.121652+0000","last_became_active":"2021-10-08T19:21:25.743519+0000","last_became_peered":"2021-10-08T19:21:25.743519+0000","last_unstale":"2021-10-08T19:28:52.121652+0000","last_undegraded":"2021-10-08T19:28:52.121652+0000","last_fullsized":"2021-10-08T19:28:52.121652+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'10","last_scrub_stamp":"2021-10-08T19:23:36.223545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:36.223545+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0023151259999999998,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":172,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.622276+0000","last_change":"2021-10-08T19:28:15.902997+0000","last_active":"2021-10-08T19:28:51.622276+0000","last_peered":"2021-10-08T19:28:51.622276+0000","last_clean":"2021-10-08T19:28:51.622276+0000","last_became_active":"2021-10-08T19:21:23.604530+0000","last_became_peered":"2021-10-08T19:21:23.604530+0000","last_unstale":"2021-10-08T19:28:51.622276+0000","last_undegraded":"2021-10-08T19:28:51.622276+0000","last_fullsized":"2021-10-08T19:28:51.622276+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:15.902892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:28:15.902892+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0029135179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1f","version":"114'10","reported_seq":168,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.808946+0000","last_change":"2021-10-08T19:24:25.122871+0000","last_active":"2021-10-08T19:28:51.808946+0000","last_peered":"2021-10-08T19:28:51.808946+0000","last_clean":"2021-10-08T19:28:51.808946+0000","last_became_active":"2021-10-08T19:24:25.105742+0000","last_became_peered":"2021-10-08T19:24:25.105742+0000","last_unstale":"2021-10-08T19:28:51.808946+0000","last_undegraded":"2021-10-08T19:28:51.808946+0000","last_fullsized":"2021-10-08T19:28:51.808946+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'9","last_scrub_stamp":"2021-10-08T19:24:07.171989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:07.171989+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"69'1","reported_seq":168,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.586911+0000","last_change":"2021-10-08T19:28:07.472350+0000","last_active":"2021-10-08T19:28:51.586911+0000","last_peered":"2021-10-08T19:28:51.586911+0000","last_clean":"2021-10-08T19:28:51.586911+0000","last_became_active":"2021-10-08T19:21:29.640296+0000","last_became_peered":"2021-10-08T19:21:29.640296+0000","last_unstale":"2021-10-08T19:28:51.586911+0000","last_undegraded":"2021-10-08T19:28:51.586911+0000","last_fullsized":"2021-10-08T19:28:51.586911+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2021-10-08T19:28:07.472230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:28:07.472230+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0056776029999999998,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"69'11","reported_seq":170,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.595257+0000","last_change":"2021-10-08T19:28:41.809089+0000","last_active":"2021-10-08T19:28:51.595257+0000","last_peered":"2021-10-08T19:28:51.595257+0000","last_clean":"2021-10-08T19:28:51.595257+0000","last_became_active":"2021-10-08T19:28:40.126425+0000","last_became_peered":"2021-10-08T19:28:40.126425+0000","last_unstale":"2021-10-08T19:28:51.595257+0000","last_undegraded":"2021-10-08T19:28:51.595257+0000","last_fullsized":"2021-10-08T19:28:51.595257+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'11","last_scrub_stamp":"2021-10-08T19:28:02.320591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:28:02.320591+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010992586,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":184,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.586723+0000","last_change":"2021-10-08T19:24:25.098061+0000","last_active":"2021-10-08T19:28:51.586723+0000","last_peered":"2021-10-08T19:28:51.586723+0000","last_clean":"2021-10-08T19:28:51.586723+0000","last_became_active":"2021-10-08T19:24:25.097164+0000","last_became_peered":"2021-10-08T19:24:25.097164+0000","last_unstale":"2021-10-08T19:28:51.586723+0000","last_undegraded":"2021-10-08T19:28:51.586723+0000","last_fullsized":"2021-10-08T19:28:51.586723+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:11.535464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:11.535464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012302489999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":169,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:52.121691+0000","last_change":"2021-10-08T19:24:13.178473+0000","last_active":"2021-10-08T19:28:52.121691+0000","last_peered":"2021-10-08T19:28:52.121691+0000","last_clean":"2021-10-08T19:28:52.121691+0000","last_became_active":"2021-10-08T19:21:27.632648+0000","last_became_peered":"2021-10-08T19:21:27.632648+0000","last_unstale":"2021-10-08T19:28:52.121691+0000","last_undegraded":"2021-10-08T19:28:52.121691+0000","last_fullsized":"2021-10-08T19:28:52.121691+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:13.178370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:13.178370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0056659290000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"69'1","reported_seq":24,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.595860+0000","last_change":"2021-10-08T19:28:40.385176+0000","last_active":"2021-10-08T19:28:51.595860+0000","last_peered":"2021-10-08T19:28:51.595860+0000","last_clean":"2021-10-08T19:28:51.595860+0000","last_became_active":"2021-10-08T19:28:40.146302+0000","last_became_peered":"2021-10-08T19:28:40.146302+0000","last_unstale":"2021-10-08T19:28:51.595860+0000","last_undegraded":"2021-10-08T19:28:51.595860+0000","last_fullsized":"2021-10-08T19:28:51.595860+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2021-10-08T19:28:06.691075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:28:06.691075+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"69'15","reported_seq":271,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.591567+0000","last_change":"2021-10-08T19:28:41.119119+0000","last_active":"2021-10-08T19:28:51.591567+0000","last_peered":"2021-10-08T19:28:51.591567+0000","last_clean":"2021-10-08T19:28:51.591567+0000","last_became_active":"2021-10-08T19:28:40.139564+0000","last_became_peered":"2021-10-08T19:28:40.139564+0000","last_unstale":"2021-10-08T19:28:51.591567+0000","last_undegraded":"2021-10-08T19:28:51.591567+0000","last_fullsized":"2021-10-08T19:28:51.591567+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'15","last_scrub_stamp":"2021-10-08T19:28:12.991370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:28:12.991370+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0082369120000000007,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":116,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.594876+0000","last_change":"2021-10-08T19:27:36.279020+0000","last_active":"2021-10-08T19:28:51.594876+0000","last_peered":"2021-10-08T19:28:51.594876+0000","last_clean":"2021-10-08T19:28:51.594876+0000","last_became_active":"2021-10-08T19:24:25.106119+0000","last_became_peered":"2021-10-08T19:24:25.106119+0000","last_unstale":"2021-10-08T19:28:51.594876+0000","last_undegraded":"2021-10-08T19:28:51.594876+0000","last_fullsized":"2021-10-08T19:28:51.594876+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:36.278905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:46.422866+0000","last_clean_scrub_stamp":"2021-10-08T19:27:36.278905+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0017473320000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":20,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.595938+0000","last_change":"2021-10-08T19:28:40.148340+0000","last_active":"2021-10-08T19:28:51.595938+0000","last_peered":"2021-10-08T19:28:51.595938+0000","last_clean":"2021-10-08T19:28:51.595938+0000","last_became_active":"2021-10-08T19:28:40.148009+0000","last_became_peered":"2021-10-08T19:28:40.148009+0000","last_unstale":"2021-10-08T19:28:51.595938+0000","last_undegraded":"2021-10-08T19:28:51.595938+0000","last_fullsized":"2021-10-08T19:28:51.595938+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:10.658350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:28:10.658350+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":184,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.592727+0000","last_change":"2021-10-08T19:27:37.219578+0000","last_active":"2021-10-08T19:28:51.592727+0000","last_peered":"2021-10-08T19:28:51.592727+0000","last_clean":"2021-10-08T19:28:51.592727+0000","last_became_active":"2021-10-08T19:24:25.097782+0000","last_became_peered":"2021-10-08T19:24:25.097782+0000","last_unstale":"2021-10-08T19:28:51.592727+0000","last_undegraded":"2021-10-08T19:28:51.592727+0000","last_fullsized":"2021-10-08T19:28:51.592727+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:37.219503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:37.219503+0000","last_clean_scrub_stamp":"2021-10-08T19:27:37.219503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0015176320000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"69'12","reported_seq":229,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.587644+0000","last_change":"2021-10-08T19:28:41.780470+0000","last_active":"2021-10-08T19:28:51.587644+0000","last_peered":"2021-10-08T19:28:51.587644+0000","last_clean":"2021-10-08T19:28:51.587644+0000","last_became_active":"2021-10-08T19:28:40.141668+0000","last_became_peered":"2021-10-08T19:28:40.141668+0000","last_unstale":"2021-10-08T19:28:51.587644+0000","last_undegraded":"2021-10-08T19:28:51.587644+0000","last_fullsized":"2021-10-08T19:28:51.587644+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'12","last_scrub_stamp":"2021-10-08T19:23:10.562820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:10.562820+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040692890000000002,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":190,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.587494+0000","last_change":"2021-10-08T19:28:14.247829+0000","last_active":"2021-10-08T19:28:51.587494+0000","last_peered":"2021-10-08T19:28:51.587494+0000","last_clean":"2021-10-08T19:28:51.587494+0000","last_became_active":"2021-10-08T19:24:25.096570+0000","last_became_peered":"2021-10-08T19:24:25.096570+0000","last_unstale":"2021-10-08T19:28:51.587494+0000","last_undegraded":"2021-10-08T19:28:51.587494+0000","last_fullsized":"2021-10-08T19:28:51.587494+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:14.247730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:28:14.247730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0076080999999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":168,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.592677+0000","last_change":"2021-10-08T19:24:13.289692+0000","last_active":"2021-10-08T19:28:51.592677+0000","last_peered":"2021-10-08T19:28:51.592677+0000","last_clean":"2021-10-08T19:28:51.592677+0000","last_became_active":"2021-10-08T19:21:27.635242+0000","last_became_peered":"2021-10-08T19:21:27.635242+0000","last_unstale":"2021-10-08T19:28:51.592677+0000","last_undegraded":"2021-10-08T19:28:51.592677+0000","last_fullsized":"2021-10-08T19:28:51.592677+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:13.289586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:13.289586+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0093791299999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":184,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.590605+0000","last_change":"2021-10-08T19:28:02.166595+0000","last_active":"2021-10-08T19:28:51.590605+0000","last_peered":"2021-10-08T19:28:51.590605+0000","last_clean":"2021-10-08T19:28:51.590605+0000","last_became_active":"2021-10-08T19:24:25.096419+0000","last_became_peered":"2021-10-08T19:24:25.096419+0000","last_unstale":"2021-10-08T19:28:51.590605+0000","last_undegraded":"2021-10-08T19:28:51.590605+0000","last_fullsized":"2021-10-08T19:28:51.590605+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:02.166534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:38.544673+0000","last_clean_scrub_stamp":"2021-10-08T19:28:02.166534+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.049118451,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"69'9","reported_seq":180,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.591920+0000","last_change":"2021-10-08T19:23:19.997379+0000","last_active":"2021-10-08T19:28:51.591920+0000","last_peered":"2021-10-08T19:28:51.591920+0000","last_clean":"2021-10-08T19:28:51.591920+0000","last_became_active":"2021-10-08T19:21:25.608263+0000","last_became_peered":"2021-10-08T19:21:25.608263+0000","last_unstale":"2021-10-08T19:28:51.591920+0000","last_undegraded":"2021-10-08T19:28:51.591920+0000","last_fullsized":"2021-10-08T19:28:51.591920+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'9","last_scrub_stamp":"2021-10-08T19:23:19.997296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:19.997296+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040259689999999999,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":173,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.586752+0000","last_change":"2021-10-08T19:24:15.574426+0000","last_active":"2021-10-08T19:28:51.586752+0000","last_peered":"2021-10-08T19:28:51.586752+0000","last_clean":"2021-10-08T19:28:51.586752+0000","last_became_active":"2021-10-08T19:21:23.607785+0000","last_became_peered":"2021-10-08T19:21:23.607785+0000","last_unstale":"2021-10-08T19:28:51.586752+0000","last_undegraded":"2021-10-08T19:28:51.586752+0000","last_fullsized":"2021-10-08T19:28:51.586752+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:15.574344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:15.574344+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0085919499999999992,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":168,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.622910+0000","last_change":"2021-10-08T19:28:04.929950+0000","last_active":"2021-10-08T19:28:51.622910+0000","last_peered":"2021-10-08T19:28:51.622910+0000","last_clean":"2021-10-08T19:28:51.622910+0000","last_became_active":"2021-10-08T19:21:27.633979+0000","last_became_peered":"2021-10-08T19:21:27.633979+0000","last_unstale":"2021-10-08T19:28:51.622910+0000","last_undegraded":"2021-10-08T19:28:51.622910+0000","last_fullsized":"2021-10-08T19:28:51.622910+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:04.929862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:05.799361+0000","last_clean_scrub_stamp":"2021-10-08T19:28:04.929862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.015926389999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":185,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:52.119565+0000","last_change":"2021-10-08T19:28:40.159565+0000","last_active":"2021-10-08T19:28:52.119565+0000","last_peered":"2021-10-08T19:28:52.119565+0000","last_clean":"2021-10-08T19:28:52.119565+0000","last_became_active":"2021-10-08T19:28:40.159162+0000","last_became_peered":"2021-10-08T19:28:40.159162+0000","last_unstale":"2021-10-08T19:28:52.119565+0000","last_undegraded":"2021-10-08T19:28:52.119565+0000","last_fullsized":"2021-10-08T19:28:52.119565+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:14.144450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:24:14.144450+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0032569320000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"69'5","reported_seq":204,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.592427+0000","last_change":"2021-10-08T19:28:48.449880+0000","last_active":"2021-10-08T19:28:51.592427+0000","last_peered":"2021-10-08T19:28:51.592427+0000","last_clean":"2021-10-08T19:28:51.592427+0000","last_became_active":"2021-10-08T19:28:40.121800+0000","last_became_peered":"2021-10-08T19:28:40.121800+0000","last_unstale":"2021-10-08T19:28:51.592427+0000","last_undegraded":"2021-10-08T19:28:51.592427+0000","last_fullsized":"2021-10-08T19:28:51.592427+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'5","last_scrub_stamp":"2021-10-08T19:23:17.993532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:17.993532+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040855580000000004,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":193,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.587220+0000","last_change":"2021-10-08T19:28:49.358095+0000","last_active":"2021-10-08T19:28:51.587220+0000","last_peered":"2021-10-08T19:28:51.587220+0000","last_clean":"2021-10-08T19:28:51.587220+0000","last_became_active":"2021-10-08T19:24:25.096225+0000","last_became_peered":"2021-10-08T19:24:25.096225+0000","last_unstale":"2021-10-08T19:28:51.587220+0000","last_undegraded":"2021-10-08T19:28:51.587220+0000","last_fullsized":"2021-10-08T19:28:51.587220+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:06.609550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:06.609550+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0037828580000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":189,"reported_epoch":213,"state":"active+clean","last_fresh":"2021-10-08T19:28:53.367239+0000","last_change":"2021-10-08T19:28:53.367884+0000","last_active":"2021-10-08T19:28:53.367239+0000","last_peered":"2021-10-08T19:28:53.367239+0000","last_clean":"2021-10-08T19:28:53.367239+0000","last_became_active":"2021-10-08T19:28:40.101187+0000","last_became_peered":"2021-10-08T19:28:40.101187+0000","last_unstale":"2021-10-08T19:28:53.367239+0000","last_undegraded":"2021-10-08T19:28:53.367239+0000","last_fullsized":"2021-10-08T19:28:53.367239+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:20.517044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:20.517044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0053303969999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":184,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.622669+0000","last_change":"2021-10-08T19:28:40.099916+0000","last_active":"2021-10-08T19:28:51.622669+0000","last_peered":"2021-10-08T19:28:51.622669+0000","last_clean":"2021-10-08T19:28:51.622669+0000","last_became_active":"2021-10-08T19:28:40.099557+0000","last_became_peered":"2021-10-08T19:28:40.099557+0000","last_unstale":"2021-10-08T19:28:51.622669+0000","last_undegraded":"2021-10-08T19:28:51.622669+0000","last_fullsized":"2021-10-08T19:28:51.622669+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:14.882819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:28:14.882819+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.020979794,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"88'13","reported_seq":298,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.591535+0000","last_change":"2021-10-08T19:28:40.563266+0000","last_active":"2021-10-08T19:28:51.591535+0000","last_peered":"2021-10-08T19:28:51.591535+0000","last_clean":"2021-10-08T19:28:51.591535+0000","last_became_active":"2021-10-08T19:28:40.099770+0000","last_became_peered":"2021-10-08T19:28:40.099770+0000","last_unstale":"2021-10-08T19:28:51.591535+0000","last_undegraded":"2021-10-08T19:28:51.591535+0000","last_fullsized":"2021-10-08T19:28:51.591535+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'13","last_scrub_stamp":"2021-10-08T19:23:16.016646+0000","last_deep_scrub":"88'13","last_deep_scrub_stamp":"2021-10-08T19:23:16.016646+0000","last_clean_scrub_stamp":"2021-10-08T19:23:16.016646+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0052093469999999996,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":166,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.587393+0000","last_change":"2021-10-08T19:23:14.443220+0000","last_active":"2021-10-08T19:28:51.587393+0000","last_peered":"2021-10-08T19:28:51.587393+0000","last_clean":"2021-10-08T19:28:51.587393+0000","last_became_active":"2021-10-08T19:21:23.598272+0000","last_became_peered":"2021-10-08T19:21:23.598272+0000","last_unstale":"2021-10-08T19:28:51.587393+0000","last_undegraded":"2021-10-08T19:28:51.587393+0000","last_fullsized":"2021-10-08T19:28:51.587393+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:14.443147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:14.443147+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003489631,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":20,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.592076+0000","last_change":"2021-10-08T19:28:40.146371+0000","last_active":"2021-10-08T19:28:51.592076+0000","last_peered":"2021-10-08T19:28:51.592076+0000","last_clean":"2021-10-08T19:28:51.592076+0000","last_became_active":"2021-10-08T19:28:40.145868+0000","last_became_peered":"2021-10-08T19:28:40.145868+0000","last_unstale":"2021-10-08T19:28:51.592076+0000","last_undegraded":"2021-10-08T19:28:51.592076+0000","last_fullsized":"2021-10-08T19:28:51.592076+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:02.663022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:28:02.663022+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":178,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.591864+0000","last_change":"2021-10-08T19:28:40.099875+0000","last_active":"2021-10-08T19:28:51.591864+0000","last_peered":"2021-10-08T19:28:51.591864+0000","last_clean":"2021-10-08T19:28:51.591864+0000","last_became_active":"2021-10-08T19:28:40.099543+0000","last_became_peered":"2021-10-08T19:28:40.099543+0000","last_unstale":"2021-10-08T19:28:51.591864+0000","last_undegraded":"2021-10-08T19:28:51.591864+0000","last_fullsized":"2021-10-08T19:28:51.591864+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:50.032367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:50.032367+0000","last_clean_scrub_stamp":"2021-10-08T19:22:50.032367+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034102759999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"69'15","reported_seq":189,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.587022+0000","last_change":"2021-10-08T19:24:14.482657+0000","last_active":"2021-10-08T19:28:51.587022+0000","last_peered":"2021-10-08T19:28:51.587022+0000","last_clean":"2021-10-08T19:28:51.587022+0000","last_became_active":"2021-10-08T19:21:25.612873+0000","last_became_peered":"2021-10-08T19:21:25.612873+0000","last_unstale":"2021-10-08T19:28:51.587022+0000","last_undegraded":"2021-10-08T19:28:51.587022+0000","last_fullsized":"2021-10-08T19:28:51.587022+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'15","last_scrub_stamp":"2021-10-08T19:24:14.482511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:24:14.482511+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012310702999999999,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":173,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:52.119730+0000","last_change":"2021-10-08T19:28:15.535918+0000","last_active":"2021-10-08T19:28:52.119730+0000","last_peered":"2021-10-08T19:28:52.119730+0000","last_clean":"2021-10-08T19:28:52.119730+0000","last_became_active":"2021-10-08T19:21:23.603422+0000","last_became_peered":"2021-10-08T19:21:23.603422+0000","last_unstale":"2021-10-08T19:28:52.119730+0000","last_undegraded":"2021-10-08T19:28:52.119730+0000","last_fullsized":"2021-10-08T19:28:52.119730+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:15.535842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:15.535842+0000","last_clean_scrub_stamp":"2021-10-08T19:28:15.535842+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014121440000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":204,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.591700+0000","last_change":"2021-10-08T19:28:40.100133+0000","last_active":"2021-10-08T19:28:51.591700+0000","last_peered":"2021-10-08T19:28:51.591700+0000","last_clean":"2021-10-08T19:28:51.591700+0000","last_became_active":"2021-10-08T19:28:40.099286+0000","last_became_peered":"2021-10-08T19:28:40.099286+0000","last_unstale":"2021-10-08T19:28:51.591700+0000","last_undegraded":"2021-10-08T19:28:51.591700+0000","last_fullsized":"2021-10-08T19:28:51.591700+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:39.931718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:39.931718+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0036493649999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":184,"reported_epoch":212,"state":"active+clean","last_fresh":"2021-10-08T19:28:51.587201+0000","last_change":"2021-10-08T19:27:39.133530+0000","last_active":"2021-10-08T19:28:51.587201+0000","last_peered":"2021-10-08T19:28:51.587201+0000","last_clean":"2021-10-08T19:28:51.587201+0000","last_became_active":"2021-10-08T19:24:25.097417+0000","last_became_peered":"2021-10-08T19:24:25.097417+0000","last_unstale":"2021-10-08T19:28:51.587201+0000","last_undegraded":"2021-10-08T19:28:51.587201+0000","last_fullsized":"2021-10-08T19:28:51.587201+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:39.133448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:27:39.133448+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.018021757999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":4819255296,"num_objects":73536,"num_object_clones":0,"num_object_copies":220608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":1615,"num_objects_unfound":0,"num_objects_dirty":73536,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73536,"num_write_kb":4706304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4117,"num_bytes_recovered":269811712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":14706278400,"data_stored":14706278400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":68736,"ondisk_log_size":68736,"up":48,"acting":45,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":11,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2790831,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1430,"ondisk_log_size":1430,"up":33,"acting":33,"num_store_stats":8},{"poolid":3,"num_pg":23,"stat_sum":{"num_bytes":584,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":314,"num_read_kb":311,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":487,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":69,"acting":69,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":690,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":337,"num_bytes_recovered":6480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":408,"ondisk_log_size":408,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":96,"acting":96,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201374,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1582632,"kb_used_data":1483744,"kb_used_omap":0,"kb_used_meta":98880,"kb_avail":92162520,"statfs":{"total":95995035648,"available":94374420480,"internally_reserved":0,"allocated":1519353856,"data_stored":1518659226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":101253120},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:28:25 2021","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":1.802,"15min":0.91000000000000003},"min":{"1min":0.252,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":2.5630000000000002,"5min":32.366999999999997,"15min":32.366999999999997},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":2.0579999999999998,"15min":1.006},"min":{"1min":0.23699999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":1.861,"5min":29.736000000000001,"15min":29.736000000000001},"last":0.46899999999999997}]},{"osd":1,"last update":"Fri Oct 8 19:28:25 2021","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":2.0790000000000002,"15min":1.0189999999999999},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":2.706,"5min":25.079999999999998,"15min":25.079999999999998},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.77600000000000002,"5min":1.1699999999999999,"15min":0.73499999999999999},"min":{"1min":0.33000000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":2.8260000000000001,"5min":7.907,"15min":7.907},"last":0.48999999999999999}]},{"osd":2,"last update":"Fri Oct 8 19:28:25 2021","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":2.1899999999999999,"15min":1.0549999999999999},"min":{"1min":0.26800000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":4.4420000000000002,"5min":27.018000000000001,"15min":27.018000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.78600000000000003,"5min":2.0339999999999998,"15min":0.99299999999999999},"min":{"1min":0.34599999999999997,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":2.827,"5min":27.113,"15min":27.113},"last":0.52500000000000002}]},{"osd":3,"last update":"Fri Oct 8 19:28:25 2021","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":2.3439999999999999,"15min":1.1060000000000001},"min":{"1min":0.32900000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":3.0859999999999999,"5min":27.010000000000002,"15min":27.010000000000002},"last":6.6150000000000002},{"interface":"front","average":{"1min":0.97699999999999998,"5min":2.1499999999999999,"15min":1.0620000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":6.1500000000000004,"5min":27.263999999999999,"15min":27.263999999999999},"last":6.6539999999999999}]},{"osd":4,"last update":"Fri Oct 8 19:28:25 2021","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.79700000000000004,"15min":0.57899999999999996},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":2.5299999999999998,"5min":4.7990000000000004,"15min":4.7990000000000004},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.66400000000000003,"15min":0.52100000000000002},"min":{"1min":0.28299999999999997,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":2.3109999999999999,"5min":4.0830000000000002,"15min":4.0830000000000002},"last":0.29799999999999999}]},{"osd":5,"last update":"Fri Oct 8 19:28:25 2021","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.84799999999999998,"15min":0.59899999999999998},"min":{"1min":0.309,"5min":0.27700000000000002,"15min":0.251},"max":{"1min":3.0190000000000001,"5min":4.649,"15min":4.649},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.60599999999999998,"15min":0.54100000000000004},"min":{"1min":0.31,"5min":0.29199999999999998,"15min":0.28699999999999998},"max":{"1min":2.5390000000000001,"5min":4.5259999999999998,"15min":4.5259999999999998},"last":0.26100000000000001}]},{"osd":6,"last update":"Fri Oct 8 19:28:25 2021","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.83899999999999997,"15min":0.626},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":2.5179999999999998,"5min":3.9430000000000001,"15min":3.9430000000000001},"last":0.27900000000000003},{"interface":"front","average":{"1min":1.012,"5min":0.94699999999999995,"15min":0.69199999999999995},"min":{"1min":0.378,"5min":0.318,"15min":0.318},"max":{"1min":4.125,"5min":4.7750000000000004,"15min":4.7750000000000004},"last":0.35099999999999998}]}]},{"osd":6,"up_from":47,"seq":201863463010,"num_pgs":61,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1590672,"kb_used_data":1475976,"kb_used_omap":0,"kb_used_meta":114688,"kb_avail":92154480,"statfs":{"total":95995035648,"available":94366187520,"internally_reserved":0,"allocated":1511399424,"data_stored":1510727847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":117440512},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:28:08 2021","interfaces":[{"interface":"back","average":{"1min":2.524,"5min":1.871,"15min":0.93200000000000005},"min":{"1min":0.23300000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":28.382999999999999,"5min":28.382999999999999,"15min":28.382999999999999},"last":0.247},{"interface":"front","average":{"1min":2.266,"5min":1.9810000000000001,"15min":0.98799999999999999},"min":{"1min":0.309,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":29.225999999999999,"5min":29.225999999999999,"15min":29.225999999999999},"last":0.47199999999999998}]},{"osd":1,"last update":"Fri Oct 8 19:28:08 2021","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":1.248,"15min":0.751},"min":{"1min":0.30599999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":5,"5min":14.878,"15min":14.878},"last":0.32000000000000001},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.3200000000000001,"15min":0.76900000000000002},"min":{"1min":0.30399999999999999,"5min":0.29999999999999999,"15min":0.26400000000000001},"max":{"1min":4.9900000000000002,"5min":14.779,"15min":14.779},"last":0.28299999999999997}]},{"osd":2,"last update":"Fri Oct 8 19:28:08 2021","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.845,"15min":0.96099999999999997},"min":{"1min":0.26700000000000002,"5min":0.251,"15min":0.251},"max":{"1min":6.0780000000000003,"5min":19.084,"15min":19.084},"last":0.311},{"interface":"front","average":{"1min":1.018,"5min":1.8029999999999999,"15min":0.92600000000000005},"min":{"1min":0.35999999999999999,"5min":0.245,"15min":0.245},"max":{"1min":5.1680000000000001,"5min":16.670999999999999,"15min":16.670999999999999},"last":0.41199999999999998}]},{"osd":3,"last update":"Fri Oct 8 19:28:08 2021","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":1.8420000000000001,"15min":0.93799999999999994},"min":{"1min":0.31,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":2.3500000000000001,"5min":21.670000000000002,"15min":21.670000000000002},"last":0.40400000000000003},{"interface":"front","average":{"1min":1.03,"5min":1.6120000000000001,"15min":0.871},"min":{"1min":0.377,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":5.0720000000000001,"5min":22.254999999999999,"15min":22.254999999999999},"last":0.33900000000000002}]},{"osd":4,"last update":"Fri Oct 8 19:28:08 2021","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54200000000000004,"15min":0.45500000000000002},"min":{"1min":0.29599999999999999,"5min":0.255,"15min":0.255},"max":{"1min":1.6899999999999999,"5min":2.7469999999999999,"15min":2.7469999999999999},"last":0.37},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.63200000000000001,"15min":0.50800000000000001},"min":{"1min":0.35099999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.196,"5min":6.1719999999999997,"15min":6.1719999999999997},"last":0.35699999999999998}]},{"osd":5,"last update":"Fri Oct 8 19:28:08 2021","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.59099999999999997,"15min":0.5},"min":{"1min":0.29899999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.82099999999999995,"5min":6.7949999999999999,"15min":6.7949999999999999},"last":0.435},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.67300000000000004,"15min":0.53600000000000003},"min":{"1min":0.318,"5min":0.29799999999999999,"15min":0.252},"max":{"1min":2.512,"5min":6.1479999999999997,"15min":6.1479999999999997},"last":0.42799999999999999}]},{"osd":7,"last update":"Fri Oct 8 19:28:29 2021","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.66100000000000003,"15min":0.54900000000000004},"min":{"1min":0.36199999999999999,"5min":0.32800000000000001,"15min":0.32000000000000001},"max":{"1min":2.5950000000000002,"5min":3.4300000000000002,"15min":3.4300000000000002},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.76000000000000001,"15min":0.61199999999999999},"min":{"1min":0.33100000000000002,"5min":0.313,"15min":0.313},"max":{"1min":2.8690000000000002,"5min":5.476,"15min":5.476},"last":0.53800000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574965,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2174020,"kb_used_data":2046908,"kb_used_omap":0,"kb_used_meta":127104,"kb_avail":91571132,"statfs":{"total":95995035648,"available":93768839168,"internally_reserved":0,"allocated":2096033792,"data_stored":2095309895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":130154496},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,16],"upper_bound":8192},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:28:40 2021","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":4.2779999999999996,"15min":1.6439999999999999},"min":{"1min":0.217,"5min":0.20399999999999999,"15min":0.184},"max":{"1min":7.335,"5min":98.734999999999999,"15min":98.734999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":1.8520000000000001,"5min":5.0709999999999997,"15min":1.9279999999999999},"min":{"1min":0.30199999999999999,"5min":0.23100000000000001,"15min":0.20599999999999999},"max":{"1min":8.5389999999999997,"5min":98.843999999999994,"15min":98.843999999999994},"last":0.36199999999999999}]},{"osd":2,"last update":"Fri Oct 8 19:28:04 2021","interfaces":[{"interface":"back","average":{"1min":1.673,"5min":3.512,"15min":1.4319999999999999},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":10.208,"5min":35.124000000000002,"15min":35.124000000000002},"last":0.63300000000000001},{"interface":"front","average":{"1min":2.6480000000000001,"5min":3.6720000000000002,"15min":1.508},"min":{"1min":0.27600000000000002,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":13.125999999999999,"5min":35.283000000000001,"15min":35.283000000000001},"last":0.67000000000000004}]},{"osd":3,"last update":"Fri Oct 8 19:28:16 2021","interfaces":[{"interface":"back","average":{"1min":1.6080000000000001,"5min":3.4630000000000001,"15min":1.458},"min":{"1min":0.34200000000000003,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":6.476,"5min":34.575000000000003,"15min":34.575000000000003},"last":0.59599999999999997},{"interface":"front","average":{"1min":1.4079999999999999,"5min":2.823,"15min":1.238},"min":{"1min":0.32800000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":7.2999999999999998,"5min":35.091000000000001,"15min":35.091000000000001},"last":0.58399999999999996}]},{"osd":4,"last update":"Fri Oct 8 19:28:30 2021","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":2.246,"15min":1.089},"min":{"1min":0.36499999999999999,"5min":0.317,"15min":0.29499999999999998},"max":{"1min":3.7589999999999999,"5min":16.872,"15min":16.872},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":1.359,"15min":0.80800000000000005},"min":{"1min":0.30399999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.85299999999999998,"5min":7.3460000000000001,"15min":7.3460000000000001},"last":0.68700000000000006}]},{"osd":5,"last update":"Fri Oct 8 19:27:52 2021","interfaces":[{"interface":"back","average":{"1min":2.0880000000000001,"5min":2.032,"15min":1.05},"min":{"1min":0.433,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":13.154,"5min":13.692,"15min":13.692},"last":0.70399999999999996},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.4059999999999999,"15min":0.83999999999999997},"min":{"1min":0.33200000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":4.2279999999999998,"5min":7.3719999999999999,"15min":7.3719999999999999},"last":0.72399999999999998}]},{"osd":6,"last update":"Fri Oct 8 19:28:12 2021","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":2.1890000000000001,"15min":1.087},"min":{"1min":0.33100000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":6.1369999999999996,"5min":16.815999999999999,"15min":16.815999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":1.865,"5min":2.1739999999999999,"15min":1.163},"min":{"1min":0.502,"5min":0.33800000000000002,"15min":0.28399999999999997},"max":{"1min":8.4000000000000004,"5min":13.773,"15min":13.773},"last":0.75800000000000001}]},{"osd":7,"last update":"Fri Oct 8 19:28:30 2021","interfaces":[{"interface":"back","average":{"1min":1.7350000000000001,"5min":2.3889999999999998,"15min":1.173},"min":{"1min":0.47699999999999998,"5min":0.312,"15min":0.312},"max":{"1min":8.4849999999999994,"5min":23.721,"15min":23.721},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.58199999999999996,"5min":1.4319999999999999,"15min":0.85699999999999998},"min":{"1min":0.374,"5min":0.34999999999999998,"15min":0.34300000000000003},"max":{"1min":0.874,"5min":7.4000000000000004,"15min":7.4000000000000004},"last":0.79100000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738488,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1913636,"kb_used_data":1773788,"kb_used_omap":0,"kb_used_meta":139840,"kb_avail":91831516,"statfs":{"total":95995035648,"available":94035472384,"internally_reserved":0,"allocated":1816358912,"data_stored":1815667202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":143196160},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 8 19:28:41 2021","interfaces":[{"interface":"back","average":{"1min":1.661,"5min":2.6349999999999998,"15min":1.0940000000000001},"min":{"1min":0.214,"5min":0.192,"15min":0.192},"max":{"1min":11.420999999999999,"5min":22.466000000000001,"15min":22.466000000000001},"last":0.318},{"interface":"front","average":{"1min":1.1639999999999999,"5min":2.7109999999999999,"15min":1.1519999999999999},"min":{"1min":0.23999999999999999,"5min":0.217,"15min":0.217},"max":{"1min":7.4169999999999998,"5min":15.041,"15min":15.041},"last":0.40899999999999997}]},{"osd":2,"last update":"Fri Oct 8 19:28:03 2021","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":3.2629999999999999,"15min":1.349},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22700000000000001},"max":{"1min":7.5780000000000003,"5min":62.390000000000001,"15min":62.390000000000001},"last":0.255},{"interface":"front","average":{"1min":1.411,"5min":2.9729999999999999,"15min":1.254},"min":{"1min":0.218,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":7.2089999999999996,"5min":62.718000000000004,"15min":62.718000000000004},"last":1.0649999999999999}]},{"osd":3,"last update":"Fri Oct 8 19:28:18 2021","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":3.1349999999999998,"15min":1.3620000000000001},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":3.1280000000000001,"5min":62.491,"15min":62.491},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.91400000000000003,"5min":2.6800000000000002,"15min":1.1910000000000001},"min":{"1min":0.26600000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":7.2450000000000001,"5min":62.673000000000002,"15min":62.673000000000002},"last":1.0980000000000001}]},{"osd":4,"last update":"Fri Oct 8 19:28:33 2021","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":2.0369999999999999,"15min":1.0389999999999999},"min":{"1min":0.38400000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":11.395,"5min":11.395,"15min":11.395},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":1.9419999999999999,"15min":1.0289999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":3.1640000000000001,"5min":11.823,"15min":11.823},"last":0.44600000000000001}]},{"osd":5,"last update":"Fri Oct 8 19:28:52 2021","interfaces":[{"interface":"back","average":{"1min":1.3779999999999999,"5min":1.5589999999999999,"15min":0.88500000000000001},"min":{"1min":0.308,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":6.6399999999999997,"5min":15.56,"15min":15.56},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.7430000000000001,"5min":2.2429999999999999,"15min":1.1220000000000001},"min":{"1min":0.40500000000000003,"5min":0.318,"15min":0.318},"max":{"1min":11.369,"5min":15.484999999999999,"15min":15.484999999999999},"last":0.54700000000000004}]},{"osd":6,"last update":"Fri Oct 8 19:28:13 2021","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":2.0750000000000002,"15min":1.0780000000000001},"min":{"1min":0.39200000000000002,"5min":0.377,"15min":0.377},"max":{"1min":8.5250000000000004,"5min":11.869,"15min":11.869},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.75900000000000001,"5min":1.611,"15min":0.91700000000000004},"min":{"1min":0.36799999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":2.2480000000000002,"5min":10.519,"15min":10.519},"last":1.143}]},{"osd":7,"last update":"Fri Oct 8 19:28:27 2021","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":2.1389999999999998,"15min":1.0860000000000001},"min":{"1min":0.40300000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":11.326000000000001,"5min":11.326000000000001,"15min":11.326000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.86899999999999999,"5min":2.363,"15min":1.171},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":3.21,"5min":11.898999999999999,"15min":11.898999999999999},"last":0.498}]}]},{"osd":2,"up_from":18,"seq":77309411440,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2073168,"kb_used_data":1938696,"kb_used_omap":0,"kb_used_meta":134464,"kb_avail":91671984,"statfs":{"total":95995035648,"available":93872111616,"internally_reserved":0,"allocated":1985224704,"data_stored":1984553415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":137691136},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:27:54 2021","interfaces":[{"interface":"back","average":{"1min":2.5390000000000001,"5min":3.5819999999999999,"15min":1.423},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.17699999999999999},"max":{"1min":14.712,"5min":61.670999999999999,"15min":61.670999999999999},"last":0.29399999999999998},{"interface":"front","average":{"1min":2.2050000000000001,"5min":3.4740000000000002,"15min":1.399},"min":{"1min":0.22600000000000001,"5min":0.189,"15min":0.189},"max":{"1min":12.321,"5min":65.284999999999997,"15min":65.284999999999997},"last":0.79700000000000004}]},{"osd":1,"last update":"Fri Oct 8 19:27:54 2021","interfaces":[{"interface":"back","average":{"1min":3.254,"5min":2.988,"15min":1.2370000000000001},"min":{"1min":0.26200000000000001,"5min":0.192,"15min":0.192},"max":{"1min":14.685,"5min":31.303999999999998,"15min":31.303999999999998},"last":0.23499999999999999},{"interface":"front","average":{"1min":1.494,"5min":3.29,"15min":1.363},"min":{"1min":0.27400000000000002,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":8.3130000000000006,"5min":31.696999999999999,"15min":31.696999999999999},"last":1.0089999999999999}]},{"osd":3,"last update":"Fri Oct 8 19:28:09 2021","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":3.673,"15min":1.5149999999999999},"min":{"1min":0.25600000000000001,"5min":0.255,"15min":0.218},"max":{"1min":3.5499999999999998,"5min":65.322999999999993,"15min":65.322999999999993},"last":1.264},{"interface":"front","average":{"1min":1.143,"5min":3.246,"15min":1.3560000000000001},"min":{"1min":0.27300000000000002,"5min":0.254,"15min":0.24399999999999999},"max":{"1min":8.4190000000000005,"5min":61.143000000000001,"15min":61.143000000000001},"last":0.36299999999999999}]},{"osd":4,"last update":"Fri Oct 8 19:28:29 2021","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.972,"15min":1.0189999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":6.6529999999999996,"5min":14.122999999999999,"15min":14.122999999999999},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.95899999999999996,"5min":2.1899999999999999,"15min":1.111},"min":{"1min":0.29999999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":3.625,"5min":15.143000000000001,"15min":15.143000000000001},"last":0.84599999999999997}]},{"osd":5,"last update":"Fri Oct 8 19:27:53 2021","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.994,"15min":1.048},"min":{"1min":0.32500000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":8.2910000000000004,"5min":15.087999999999999,"15min":15.087999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":2.5630000000000002,"5min":1.8520000000000001,"15min":1.0049999999999999},"min":{"1min":0.316,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":14.553000000000001,"5min":14.558,"15min":14.558},"last":0.53200000000000003}]},{"osd":6,"last update":"Fri Oct 8 19:28:09 2021","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.913,"15min":1.0129999999999999},"min":{"1min":0.38700000000000001,"5min":0.33100000000000002,"15min":0.30199999999999999},"max":{"1min":4.6580000000000004,"5min":14.162000000000001,"15min":14.162000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.91500000000000004,"5min":1.9419999999999999,"15min":1.0369999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":4.5839999999999996,"5min":14.529999999999999,"15min":14.529999999999999},"last":0.55400000000000005}]},{"osd":7,"last update":"Fri Oct 8 19:28:29 2021","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":2.157,"15min":1.093},"min":{"1min":0.40100000000000002,"5min":0.38600000000000001,"15min":0.31900000000000001},"max":{"1min":5.2130000000000001,"5min":14.185,"15min":14.185},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.7609999999999999,"5min":2.1640000000000001,"15min":1.1200000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":16.702999999999999,"5min":16.702999999999999,"15min":16.702999999999999},"last":0.57899999999999996}]}]},{"osd":3,"up_from":24,"seq":103079215214,"num_pgs":74,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2033592,"kb_used_data":1875440,"kb_used_omap":0,"kb_used_meta":158144,"kb_avail":91711560,"statfs":{"total":95995035648,"available":93912637440,"internally_reserved":0,"allocated":1920450560,"data_stored":1919739431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":161939456},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:28:20 2021","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":3.4689999999999999,"15min":1.3899999999999999},"min":{"1min":0.17100000000000001,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":5.5599999999999996,"5min":109.601,"15min":109.601},"last":0.32900000000000001},{"interface":"front","average":{"1min":1.528,"5min":3.9750000000000001,"15min":1.587},"min":{"1min":0.22700000000000001,"5min":0.217,"15min":0.19800000000000001},"max":{"1min":7.3479999999999999,"5min":107.84,"15min":107.84},"last":0.36399999999999999}]},{"osd":1,"last update":"Fri Oct 8 19:28:20 2021","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":2.5840000000000001,"15min":1.129},"min":{"1min":0.246,"5min":0.23699999999999999,"15min":0.219},"max":{"1min":6.3319999999999999,"5min":20.335999999999999,"15min":20.335999999999999},"last":0.41699999999999998},{"interface":"front","average":{"1min":1.9179999999999999,"5min":2.6339999999999999,"15min":1.147},"min":{"1min":0.26200000000000001,"5min":0.23200000000000001,"15min":0.21199999999999999},"max":{"1min":8.5589999999999993,"5min":13.372999999999999,"15min":13.372999999999999},"last":0.39000000000000001}]},{"osd":2,"last update":"Fri Oct 8 19:28:20 2021","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":3.2400000000000002,"15min":1.3660000000000001},"min":{"1min":0.27600000000000002,"5min":0.246,"15min":0.246},"max":{"1min":7.0940000000000003,"5min":32.277000000000001,"15min":32.277000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.80600000000000005,"5min":2.274,"15min":1.0429999999999999},"min":{"1min":0.28599999999999998,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":3.024,"5min":14.898999999999999,"15min":14.898999999999999},"last":0.38100000000000001}]},{"osd":4,"last update":"Fri Oct 8 19:28:31 2021","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.881,"15min":1.008},"min":{"1min":0.33100000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":7.2949999999999999,"5min":18.064,"15min":18.064},"last":0.44700000000000001},{"interface":"front","average":{"1min":1.121,"5min":1.9299999999999999,"15min":1.145},"min":{"1min":0.34899999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":6.2380000000000004,"5min":18.692,"15min":18.692},"last":0.61499999999999999}]},{"osd":5,"last update":"Fri Oct 8 19:28:52 2021","interfaces":[{"interface":"back","average":{"1min":1.855,"5min":2.0329999999999999,"15min":1.0660000000000001},"min":{"1min":0.373,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":8.5660000000000007,"5min":13.186,"15min":13.186},"last":0.629},{"interface":"front","average":{"1min":1.625,"5min":1.913,"15min":1.093},"min":{"1min":0.32400000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":7.3410000000000002,"5min":10.285,"15min":10.285},"last":0.40500000000000003}]},{"osd":6,"last update":"Fri Oct 8 19:28:07 2021","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":2.0659999999999998,"15min":1.782},"min":{"1min":0.40999999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":6.9169999999999998,"5min":17.512,"15min":21.538},"last":0.65900000000000003},{"interface":"front","average":{"1min":1.46,"5min":1.8819999999999999,"15min":1.0009999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.35499999999999998},"max":{"1min":7.7519999999999998,"5min":13.298,"15min":13.298},"last":0.66900000000000004}]},{"osd":7,"last update":"Fri Oct 8 19:28:31 2021","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.7649999999999999,"15min":0.98699999999999999},"min":{"1min":0.38100000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":6.306,"5min":8.8350000000000009,"15min":8.8350000000000009},"last":0.68999999999999995},{"interface":"front","average":{"1min":1.6599999999999999,"5min":2.0899999999999999,"15min":1.1040000000000001},"min":{"1min":0.45000000000000001,"5min":0.376,"15min":0.376},"max":{"1min":8.6099999999999994,"5min":13.225,"15min":13.225},"last":0.69799999999999995}]}]},{"osd":4,"up_from":30,"seq":128849018986,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1647664,"kb_used_data":1541672,"kb_used_omap":0,"kb_used_meta":105984,"kb_avail":92097488,"statfs":{"total":95995035648,"available":94307827712,"internally_reserved":0,"allocated":1578672128,"data_stored":1577969170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":108527616},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:28:30 2021","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":2.238,"15min":1.0880000000000001},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":2.9140000000000001,"5min":59.223999999999997,"15min":59.223999999999997},"last":0.27900000000000003},{"interface":"front","average":{"1min":1.0309999999999999,"5min":2.2770000000000001,"15min":1.103},"min":{"1min":0.251,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":4.0709999999999997,"5min":58.667999999999999,"15min":58.667999999999999},"last":0.46600000000000003}]},{"osd":1,"last update":"Fri Oct 8 19:28:30 2021","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":2.0190000000000001,"15min":1.012},"min":{"1min":0.24299999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":4.4699999999999998,"5min":26.634,"15min":26.634},"last":0.36599999999999999},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.3109999999999999,"15min":0.76700000000000002},"min":{"1min":0.26400000000000001,"5min":0.246,"15min":0.24099999999999999},"max":{"1min":3.71,"5min":6.7000000000000002,"15min":6.7000000000000002},"last":0.38400000000000001}]},{"osd":2,"last update":"Fri Oct 8 19:28:30 2021","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":1.8999999999999999,"15min":0.96999999999999997},"min":{"1min":0.27100000000000002,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":2.4710000000000001,"5min":21.257000000000001,"15min":21.257000000000001},"last":0.32600000000000001},{"interface":"front","average":{"1min":1.23,"5min":1.8999999999999999,"15min":0.98399999999999999},"min":{"1min":0.30399999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":4.7009999999999996,"5min":21.600000000000001,"15min":21.600000000000001},"last":0.51800000000000002}]},{"osd":3,"last update":"Fri Oct 8 19:28:30 2021","interfaces":[{"interface":"back","average":{"1min":1.992,"5min":3.0499999999999998,"15min":1.357},"min":{"1min":0.33000000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":18.853000000000002,"5min":58.506999999999998,"15min":58.506999999999998},"last":0.53400000000000003},{"interface":"front","average":{"1min":1.123,"5min":2.0950000000000002,"15min":1.046},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":4.6280000000000001,"5min":58.521000000000001,"15min":58.521000000000001},"last":0.40000000000000002}]},{"osd":5,"last update":"Fri Oct 8 19:27:53 2021","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.59599999999999997,"15min":0.45200000000000001},"min":{"1min":0.27100000000000002,"5min":0.23899999999999999,"15min":0.222},"max":{"1min":1.1619999999999999,"5min":4.7359999999999998,"15min":4.7359999999999998},"last":0.436},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.59399999999999997,"15min":0.45700000000000002},"min":{"1min":0.28499999999999998,"5min":0.245,"15min":0.245},"max":{"1min":4.0549999999999997,"5min":4.0549999999999997,"15min":4.0549999999999997},"last":0.35599999999999998}]},{"osd":6,"last update":"Fri Oct 8 19:28:09 2021","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.747,"15min":0.52000000000000002},"min":{"1min":0.30199999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":3.9980000000000002,"5min":5.0460000000000003,"15min":5.0460000000000003},"last":0.496},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.81999999999999995,"15min":0.55600000000000005},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":4.4939999999999998,"5min":4.8899999999999997,"15min":4.8899999999999997},"last":0.48799999999999999}]},{"osd":7,"last update":"Fri Oct 8 19:28:30 2021","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.63400000000000001,"15min":0.53200000000000003},"min":{"1min":0.308,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.73,"5min":4.0060000000000002,"15min":4.0060000000000002},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.88900000000000001,"15min":0.624},"min":{"1min":0.35299999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":3.964,"5min":5.0209999999999999,"15min":5.0209999999999999},"last":0.63400000000000001}]}]},{"osd":5,"up_from":38,"seq":163208757348,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2535968,"kb_used_data":2426456,"kb_used_omap":0,"kb_used_meta":109504,"kb_avail":91209184,"statfs":{"total":95995035648,"available":93398204416,"internally_reserved":0,"allocated":2484690944,"data_stored":2484004738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":112132096},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:28:49 2021","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":1.2949999999999999,"15min":0.81899999999999995},"min":{"1min":0.223,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":3.8940000000000001,"5min":5.899,"15min":22.966999999999999},"last":0.39000000000000001},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.454,"15min":0.79300000000000004},"min":{"1min":0.27600000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":4.5359999999999996,"5min":5.4969999999999999,"15min":5.4969999999999999},"last":0.40400000000000003}]},{"osd":1,"last update":"Fri Oct 8 19:28:49 2021","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":1.6759999999999999,"15min":0.88400000000000001},"min":{"1min":0.33500000000000002,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":3.1120000000000001,"5min":18.064,"15min":18.064},"last":0.437},{"interface":"front","average":{"1min":0.71499999999999997,"5min":1.641,"15min":0.878},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.25900000000000001},"max":{"1min":2.6509999999999998,"5min":18.074000000000002,"15min":18.074000000000002},"last":0.33200000000000002}]},{"osd":2,"last update":"Fri Oct 8 19:28:49 2021","interfaces":[{"interface":"back","average":{"1min":1.8160000000000001,"5min":2.3759999999999999,"15min":1.1739999999999999},"min":{"1min":0.30599999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":6.1079999999999997,"5min":29.398,"15min":29.398},"last":0.30599999999999999},{"interface":"front","average":{"1min":1.0049999999999999,"5min":2.2999999999999998,"15min":1.169},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":2.6920000000000002,"5min":29.387,"15min":29.387},"last":0.41799999999999998}]},{"osd":3,"last update":"Fri Oct 8 19:28:49 2021","interfaces":[{"interface":"back","average":{"1min":1.954,"5min":2.1349999999999998,"15min":1.032},"min":{"1min":0.34100000000000003,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":12.356,"5min":12.356,"15min":12.356},"last":0.34100000000000003},{"interface":"front","average":{"1min":2.137,"5min":2.133,"15min":1.034},"min":{"1min":0.38600000000000001,"5min":0.32000000000000001,"15min":0.313},"max":{"1min":8.4009999999999998,"5min":21.504000000000001,"15min":21.504000000000001},"last":0.48199999999999998}]},{"osd":4,"last update":"Fri Oct 8 19:28:49 2021","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.748,"15min":0.52100000000000002},"min":{"1min":0.254,"5min":0.249,"15min":0.224},"max":{"1min":2.673,"5min":5.0780000000000003,"15min":5.0780000000000003},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.69199999999999995,"15min":0.52300000000000002},"min":{"1min":0.30399999999999999,"5min":0.28299999999999997,"15min":0.23799999999999999},"max":{"1min":1.968,"5min":3.9540000000000002,"15min":3.9540000000000002},"last":0.496}]},{"osd":6,"last update":"Fri Oct 8 19:28:07 2021","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.82199999999999995,"15min":0.57099999999999995},"min":{"1min":0.32200000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":2.4550000000000001,"5min":7.266,"15min":7.266},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.73699999999999999,"15min":0.57699999999999996},"min":{"1min":0.314,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":3.6560000000000001,"5min":5.1580000000000004,"15min":5.1580000000000004},"last":0.44500000000000001}]},{"osd":7,"last update":"Fri Oct 8 19:28:33 2021","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.78100000000000003,"15min":0.59599999999999997},"min":{"1min":0.34100000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":3.0899999999999999,"5min":3.899,"15min":3.899},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.86799999999999999,"15min":0.66700000000000004},"min":{"1min":0.34699999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":3.7570000000000001,"5min":5.0279999999999996,"15min":5.0279999999999996},"last":0.51000000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":266240,"data_stored":262688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":327680,"data_stored":327680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":2338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1814822912,"data_stored":1814822912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2001993728,"data_stored":2001993728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1934098432,"data_stored":1934098432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1870266368,"data_stored":1870266368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1577123840,"data_stored":1577123840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":2480603136,"data_stored":2480603136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1509883904,"data_stored":1509883904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1517486080,"data_stored":1517486080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-10-08T19:28:57.636 INFO:tasks.thrashosds.thrasher:Setting 1.6 to [2, 0, 4] 2021-10-08T19:28:57.636 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '1.6', '2', '0', '4'] 2021-10-08T19:28:57.637 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd pg-upmap 1.6 2 0 4 2021-10-08T19:28:57.655 INFO:journalctl@ceph.osd.7.smithi117.stdout:Oct 08 19:28:57 smithi117 conmon[54364]: 2021-10-08T19:28:57.375+0000 7ff38803d700 -1 osd.7 pg_epoch: 215 pg[2.5( v 61'1 (0'0,61'1] local-lis/les=60/61 n=1 ec=60/60 lis/c=60/60 les/c/f=61/61/0 sis=60) [7,0,4] r=0 lpr=60 crt=61'1 lcod 0'0 mlcod 0'0 active+clean] scrubber pg(2.5) handle_scrub_reserve_grant: received unsolicited reservation grant from osd 0 (0x55a626f478c0) 2021-10-08T19:28:57.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:57 smithi117 ceph-mon[34585]: from='client.35216 v1:172.21.15.97:0/241501273' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:28:57.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:57 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:28:57.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:57 smithi117 ceph-mon[34585]: pgmap v362: 178 pgs: 3 active+clean+wait, 3 active+recovering+undersized+remapped, 172 active+clean; 4.5 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1018 B/s rd, 0 op/s; 1615/221193 objects misplaced (0.730%); 15 MiB/s, 242 objects/s recovering 2021-10-08T19:28:57.685 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 66 16 73621 73605 69.6655 0 - 0.0140427 2021-10-08T19:28:57.743 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set noscrub 2021-10-08T19:28:57.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:57 smithi097 ceph-mon[41966]: from='client.35216 v1:172.21.15.97:0/241501273' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:28:57.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:57 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:28:57.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:57 smithi097 ceph-mon[41966]: pgmap v362: 178 pgs: 3 active+clean+wait, 3 active+recovering+undersized+remapped, 172 active+clean; 4.5 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1018 B/s rd, 0 op/s; 1615/221193 objects misplaced (0.730%); 15 MiB/s, 242 objects/s recovering 2021-10-08T19:28:57.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:57 smithi097 ceph-mon[32687]: from='client.35216 v1:172.21.15.97:0/241501273' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:28:57.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:57 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:28:57.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:57 smithi097 ceph-mon[32687]: pgmap v362: 178 pgs: 3 active+clean+wait, 3 active+recovering+undersized+remapped, 172 active+clean; 4.5 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1018 B/s rd, 0 op/s; 1615/221193 objects misplaced (0.730%); 15 MiB/s, 242 objects/s recovering 2021-10-08T19:28:58.208 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:28:58.211 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:58.212 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:28:58.314 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:28:58.339 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:58.350 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:28:58.445 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:28:58.449 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:58.451 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:28:58.470 INFO:journalctl@ceph.osd.2.smithi097.stdout:Oct 08 19:28:58 smithi097 conmon[55904]: 2021-10-08T19:28:58.274+0000 7f599d651700 -1 osd.2 pg_epoch: 215 pg[2.10( empty local-lis/les=202/203 n=0 ec=60/60 lis/c=202/202 les/c/f=203/203/0 sis=202) [2,1,0] r=0 lpr=202 crt=0'0 mlcod 0'0 active+clean TIME_FOR_DEEP] scrubber pg(2.10) handle_scrub_reserve_grant: received unsolicited reservation grant from osd 0 (0x5622273bedc0) 2021-10-08T19:28:58.553 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:28:58.579 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:58.592 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:28:58.686 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 67 16 73621 73605 68.6262 0 - 0.0140427 2021-10-08T19:28:58.688 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:28:58.689 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2021-10-08T19:28:58.690 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:28:58.693 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:58.694 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:28:58.795 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:28:58.818 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:58.860 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:28:58.863 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:58.863 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:28:58.964 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:28:58.988 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:59.028 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:28:59.030 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:59.031 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:28:59.132 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:28:59.157 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:59.569 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2021-10-08T19:28:59.657 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:28:59.660 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:59.661 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:28:59.686 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 68 16 73621 73605 67.6174 0 - 0.0140427 2021-10-08T19:28:59.762 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:28:59.783 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:59 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:28:59.784 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:28:59 smithi117 ceph-mon[34585]: pgmap v363: 178 pgs: 3 active+clean+wait, 3 active+recovering+undersized+remapped, 172 active+clean; 4.5 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.7 KiB/s rd, 255 KiB/s wr, 5 op/s; 1557/221265 objects misplaced (0.704%); 13 MiB/s, 211 objects/s recovering 2021-10-08T19:28:59.786 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:59.828 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:28:59.830 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:28:59.830 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:28:59.932 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:28:59.954 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:28:59.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:59 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:28:59.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:28:59 smithi097 ceph-mon[41966]: pgmap v363: 178 pgs: 3 active+clean+wait, 3 active+recovering+undersized+remapped, 172 active+clean; 4.5 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.7 KiB/s rd, 255 KiB/s wr, 5 op/s; 1557/221265 objects misplaced (0.704%); 13 MiB/s, 211 objects/s recovering 2021-10-08T19:28:59.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:59 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:28:59.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:28:59 smithi097 ceph-mon[32687]: pgmap v363: 178 pgs: 3 active+clean+wait, 3 active+recovering+undersized+remapped, 172 active+clean; 4.5 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.7 KiB/s rd, 255 KiB/s wr, 5 op/s; 1557/221265 objects misplaced (0.704%); 13 MiB/s, 211 objects/s recovering 2021-10-08T19:28:59.998 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:29:00.000 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:00.000 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:29:00.101 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:29:00.124 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:00.169 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:29:00.171 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:00.172 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:29:00.272 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:29:00.295 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:00.296 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2021-10-08T19:29:00.338 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:29:00.340 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:00.340 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:29:00.441 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:29:00.475 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:00.686 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 69 16 73621 73605 66.6378 0 - 0.0140427 2021-10-08T19:29:00.886 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:29:00.888 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:00.889 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:29:00.990 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:29:01.019 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:01.026 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:29:01.128 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:29:01.133 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:29:01.147 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:01.148 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:29:01.249 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:29:01.275 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:01.452 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:29:01.455 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:01.455 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:29:01.556 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:29:01.578 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:01.622 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:29:01.624 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:01.624 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:29:01.686 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 70 16 73621 73605 65.6862 0 - 0.0140427 2021-10-08T19:29:01.714 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:01 smithi097 ceph-mon[32687]: pgmap v364: 178 pgs: 2 active+clean+wait, 3 active+recovering+undersized+remapped, 173 active+clean; 4.5 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 552 KiB/s wr, 9 op/s; 1441/221400 objects misplaced (0.651%); 11 MiB/s, 173 objects/s recovering 2021-10-08T19:29:01.714 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:01 smithi097 ceph-mon[41966]: pgmap v364: 178 pgs: 2 active+clean+wait, 3 active+recovering+undersized+remapped, 173 active+clean; 4.5 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 552 KiB/s wr, 9 op/s; 1441/221400 objects misplaced (0.651%); 11 MiB/s, 173 objects/s recovering 2021-10-08T19:29:01.725 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:29:01.747 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:01.789 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:29:01.791 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:01.792 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:29:01.893 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:29:01.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:01 smithi117 ceph-mon[34585]: pgmap v364: 178 pgs: 2 active+clean+wait, 3 active+recovering+undersized+remapped, 173 active+clean; 4.5 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 552 KiB/s wr, 9 op/s; 1441/221400 objects misplaced (0.651%); 11 MiB/s, 173 objects/s recovering 2021-10-08T19:29:01.915 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:01.957 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:29:01.959 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:01.960 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:29:02.061 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:29:02.086 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:02.237 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:29:02.239 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:02.240 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:29:02.341 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:29:02.364 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:02.406 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:29:02.409 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:02.410 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:29:02.511 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:29:02.538 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:02.614 INFO:teuthology.orchestra.run.smithi097.stderr:set 1.6 pg_upmap mapping to [2,0,4] 2021-10-08T19:29:02.617 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is set 2021-10-08T19:29:02.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:02 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3292950823' entity='client.admin' cmd=[{"prefix": "osd pg-upmap", "pgid": "1.6", "id": [2, 0, 4]}]: dispatch 2021-10-08T19:29:02.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:02 smithi117 ceph-mon[34585]: from='client.35228 ' entity='client.admin' cmd=[{"prefix": "osd pg-upmap", "pgid": "1.6", "id": [2, 0, 4]}]: dispatch 2021-10-08T19:29:02.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:02 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/168562878' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:29:02.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:02 smithi117 ceph-mon[34585]: from='client.35234 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:29:02.686 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 71 16 73621 73605 64.7615 0 - 0.0140427 2021-10-08T19:29:02.970 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:29:02 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:29:02] "GET /metrics HTTP/1.1" 200 155819 "" "Prometheus/2.18.1" 2021-10-08T19:29:02.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:02 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3292950823' entity='client.admin' cmd=[{"prefix": "osd pg-upmap", "pgid": "1.6", "id": [2, 0, 4]}]: dispatch 2021-10-08T19:29:02.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:02 smithi097 ceph-mon[41966]: from='client.35228 ' entity='client.admin' cmd=[{"prefix": "osd pg-upmap", "pgid": "1.6", "id": [2, 0, 4]}]: dispatch 2021-10-08T19:29:02.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:02 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/168562878' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:29:02.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:02 smithi097 ceph-mon[41966]: from='client.35234 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:29:02.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:02 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3292950823' entity='client.admin' cmd=[{"prefix": "osd pg-upmap", "pgid": "1.6", "id": [2, 0, 4]}]: dispatch 2021-10-08T19:29:02.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:02 smithi097 ceph-mon[32687]: from='client.35228 ' entity='client.admin' cmd=[{"prefix": "osd pg-upmap", "pgid": "1.6", "id": [2, 0, 4]}]: dispatch 2021-10-08T19:29:02.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:02 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/168562878' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:29:02.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:02 smithi097 ceph-mon[32687]: from='client.35234 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:29:03.393 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:29:03.395 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:03.396 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:29:03.497 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:29:03.519 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:03.562 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:29:03.564 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:03.564 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:29:03.665 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:29:03.686 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 72 16 73621 73605 63.8624 0 - 0.0140427 2021-10-08T19:29:03.688 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:03.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:03 smithi097 ceph-mon[41966]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:29:03.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:03 smithi097 ceph-mon[41966]: from='client.35228 ' entity='client.admin' cmd='[{"prefix": "osd pg-upmap", "pgid": "1.6", "id": [2, 0, 4]}]': finished 2021-10-08T19:29:03.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:03 smithi097 ceph-mon[41966]: from='client.35234 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:29:03.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:03 smithi097 ceph-mon[41966]: osdmap e216: 8 total, 8 up, 8 in 2021-10-08T19:29:03.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:03 smithi097 ceph-mon[41966]: pgmap v366: 178 pgs: 2 active+clean+wait, 3 active+recovering+undersized+remapped, 173 active+clean; 4.5 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 639 B/s rd, 552 KiB/s wr, 9 op/s; 1441/221400 objects misplaced (0.651%); 1.4 MiB/s, 21 objects/s recovering 2021-10-08T19:29:03.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:03 smithi097 ceph-mon[32687]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:29:03.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:03 smithi097 ceph-mon[32687]: from='client.35228 ' entity='client.admin' cmd='[{"prefix": "osd pg-upmap", "pgid": "1.6", "id": [2, 0, 4]}]': finished 2021-10-08T19:29:03.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:03 smithi097 ceph-mon[32687]: from='client.35234 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:29:03.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:03 smithi097 ceph-mon[32687]: osdmap e216: 8 total, 8 up, 8 in 2021-10-08T19:29:03.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:03 smithi097 ceph-mon[32687]: pgmap v366: 178 pgs: 2 active+clean+wait, 3 active+recovering+undersized+remapped, 173 active+clean; 4.5 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 639 B/s rd, 552 KiB/s wr, 9 op/s; 1441/221400 objects misplaced (0.651%); 1.4 MiB/s, 21 objects/s recovering 2021-10-08T19:29:03.731 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:29:03.733 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:03.733 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:29:03.834 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:29:03.860 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:03.867 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:03 smithi117 ceph-mon[34585]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:29:03.867 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:03 smithi117 ceph-mon[34585]: from='client.35228 ' entity='client.admin' cmd='[{"prefix": "osd pg-upmap", "pgid": "1.6", "id": [2, 0, 4]}]': finished 2021-10-08T19:29:03.868 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:03 smithi117 ceph-mon[34585]: from='client.35234 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:29:03.868 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:03 smithi117 ceph-mon[34585]: osdmap e216: 8 total, 8 up, 8 in 2021-10-08T19:29:03.868 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:03 smithi117 ceph-mon[34585]: pgmap v366: 178 pgs: 2 active+clean+wait, 3 active+recovering+undersized+remapped, 173 active+clean; 4.5 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 639 B/s rd, 552 KiB/s wr, 9 op/s; 1441/221400 objects misplaced (0.651%); 1.4 MiB/s, 21 objects/s recovering 2021-10-08T19:29:04.133 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:29:03 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:29:03] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:29:04.242 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:29:04.248 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:04.249 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:29:04.350 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:29:04.407 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:04.566 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:29:04.578 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:04.579 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:29:04.680 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:29:04.686 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 73 16 74049 74033 63.3542 3.34375 0.0189941 0.015778 2021-10-08T19:29:04.723 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:04.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:04 smithi117 ceph-mon[34585]: osdmap e217: 8 total, 8 up, 8 in 2021-10-08T19:29:04.940 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:04 smithi097 ceph-mon[32687]: osdmap e217: 8 total, 8 up, 8 in 2021-10-08T19:29:04.941 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:04 smithi097 ceph-mon[41966]: osdmap e217: 8 total, 8 up, 8 in 2021-10-08T19:29:04.951 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2021-10-08T19:29:04.951 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:29:04.995 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:29:05.006 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:05.007 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:29:05.108 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:29:05.145 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:05.147 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:29:05.193 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:29:05.210 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:29:05.213 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:05.214 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:29:05.257 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:29:05.306 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:29:05.315 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:29:05.341 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:29:05.344 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:05.378 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:29:05.414 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:29:05.419 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:05.420 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:29:05.427 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:29:05.459 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:29:05.475 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true' 2021-10-08T19:29:05.475 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true' 2021-10-08T19:29:05.475 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true' 2021-10-08T19:29:05.475 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true' 2021-10-08T19:29:05.476 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true' 2021-10-08T19:29:05.477 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true' 2021-10-08T19:29:05.478 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'true' 2021-10-08T19:29:05.478 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'true' 2021-10-08T19:29:05.521 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:29:05.596 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:05.689 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 74 16 74930 74914 63.2407 55.0625 0.0166302 0.0158081 2021-10-08T19:29:05.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:05 smithi117 ceph-mon[34585]: pgmap v368: 178 pgs: 1 remapped+peering, 2 active+clean+wait, 3 active+recovering+undersized+remapped, 172 active+clean; 4.5 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 552 KiB/s wr, 9 op/s; 1267/221400 objects misplaced (0.572%); 2.7 MiB/s, 43 objects/s recovering 2021-10-08T19:29:05.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:05 smithi117 ceph-mon[34585]: osdmap e218: 8 total, 8 up, 8 in 2021-10-08T19:29:05.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:05 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/816728634' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:29:05.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:05 smithi117 ceph-mon[34585]: osdmap e219: 8 total, 8 up, 8 in 2021-10-08T19:29:05.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:05 smithi117 ceph-mon[34585]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2021-10-08T19:29:05.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:05 smithi097 ceph-mon[41966]: pgmap v368: 178 pgs: 1 remapped+peering, 2 active+clean+wait, 3 active+recovering+undersized+remapped, 172 active+clean; 4.5 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 552 KiB/s wr, 9 op/s; 1267/221400 objects misplaced (0.572%); 2.7 MiB/s, 43 objects/s recovering 2021-10-08T19:29:05.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:05 smithi097 ceph-mon[41966]: osdmap e218: 8 total, 8 up, 8 in 2021-10-08T19:29:05.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:05 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/816728634' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:29:05.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:05 smithi097 ceph-mon[41966]: osdmap e219: 8 total, 8 up, 8 in 2021-10-08T19:29:05.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:05 smithi097 ceph-mon[41966]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2021-10-08T19:29:05.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:05 smithi097 ceph-mon[32687]: pgmap v368: 178 pgs: 1 remapped+peering, 2 active+clean+wait, 3 active+recovering+undersized+remapped, 172 active+clean; 4.5 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 552 KiB/s wr, 9 op/s; 1267/221400 objects misplaced (0.572%); 2.7 MiB/s, 43 objects/s recovering 2021-10-08T19:29:05.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:05 smithi097 ceph-mon[32687]: osdmap e218: 8 total, 8 up, 8 in 2021-10-08T19:29:05.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:05 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/816728634' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:29:05.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:05 smithi097 ceph-mon[32687]: osdmap e219: 8 total, 8 up, 8 in 2021-10-08T19:29:05.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:05 smithi097 ceph-mon[32687]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2021-10-08T19:29:06.038 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2021-10-08T19:29:06.242 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set nodeep-scrub 2021-10-08T19:29:06.691 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 75 15 75888 75873 63.1949 59.9375 0.0123125 0.0158186 2021-10-08T19:29:06.906 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:29:06 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:29:07.287 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:29:07.291 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:07.292 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:29:07.393 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:29:07.430 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:29:07.457 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:07.545 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:29:07.624 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:07 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:29:07.625 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:07 smithi117 ceph-mon[34585]: osdmap e220: 8 total, 8 up, 8 in 2021-10-08T19:29:07.627 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:07 smithi117 ceph-mon[34585]: pgmap v372: 178 pgs: 1 remapped+peering, 2 active+clean+wait, 3 active+recovering+undersized+remapped, 172 active+clean; 4.5 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 1267/221400 objects misplaced (0.572%); 2.7 MiB/s, 43 objects/s recovering 2021-10-08T19:29:07.630 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:07.632 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:29:07.633 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:29:07.693 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 76 16 76737 76721 63.0592 53 0.00536015 0.015854 2021-10-08T19:29:07.735 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:29:07.789 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:07.867 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:29:07.873 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:07.874 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:29:07.911 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:07 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:29:07.912 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:07 smithi097 ceph-mon[41966]: osdmap e220: 8 total, 8 up, 8 in 2021-10-08T19:29:07.912 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:07 smithi097 ceph-mon[41966]: pgmap v372: 178 pgs: 1 remapped+peering, 2 active+clean+wait, 3 active+recovering+undersized+remapped, 172 active+clean; 4.5 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 1267/221400 objects misplaced (0.572%); 2.7 MiB/s, 43 objects/s recovering 2021-10-08T19:29:07.913 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:07 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:29:07.914 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:07 smithi097 ceph-mon[32687]: osdmap e220: 8 total, 8 up, 8 in 2021-10-08T19:29:07.914 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:07 smithi097 ceph-mon[32687]: pgmap v372: 178 pgs: 1 remapped+peering, 2 active+clean+wait, 3 active+recovering+undersized+remapped, 172 active+clean; 4.5 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 1267/221400 objects misplaced (0.572%); 2.7 MiB/s, 43 objects/s recovering 2021-10-08T19:29:07.976 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:29:08.033 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:08.153 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:29:08.157 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:08.158 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:29:08.260 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:29:08.291 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:08.347 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:29:08.350 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:08.350 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:29:08.451 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:29:08.482 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:08.551 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:29:08.555 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:08.555 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:29:08.657 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:29:08.693 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 77 16 77542 77526 62.8937 50.3125 0.0151355 0.015894 2021-10-08T19:29:08.694 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:08.752 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:29:08.760 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:08.761 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:29:08.862 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:29:08.893 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:09.231 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:29:09.236 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:09.237 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:29:09.281 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 3, 4, 5, 7, 6, 1] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2021-10-08T19:29:09.282 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2021-10-08T19:29:09.282 INFO:tasks.thrashosds.thrasher:Shrinking pool unique_pool_1 2021-10-08T19:29:09.283 INFO:tasks.cephadm.ceph_manager.ceph:contract_pool unique_pool_1 by 10 min 8 2021-10-08T19:29:09.284 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph pg dump --format=json 2021-10-08T19:29:09.338 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:29:09.389 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2021-10-08T19:29:09.401 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:09.697 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 78 16 78398 78382 62.771 53.5 0.0151693 0.0159264 2021-10-08T19:29:09.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:09 smithi097 ceph-mon[41966]: pgmap v373: 178 pgs: 1 remapped+peering, 2 active+clean+wait, 3 active+recovering+undersized+remapped, 172 active+clean; 4.6 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1022 B/s rd, 20 MiB/s wr, 328 op/s; 1209/226317 objects misplaced (0.534%); 2.2 MiB/s, 34 objects/s recovering 2021-10-08T19:29:09.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:09 smithi097 ceph-mon[32687]: pgmap v373: 178 pgs: 1 remapped+peering, 2 active+clean+wait, 3 active+recovering+undersized+remapped, 172 active+clean; 4.6 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1022 B/s rd, 20 MiB/s wr, 328 op/s; 1209/226317 objects misplaced (0.534%); 2.2 MiB/s, 34 objects/s recovering 2021-10-08T19:29:10.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:09 smithi117 ceph-mon[34585]: pgmap v373: 178 pgs: 1 remapped+peering, 2 active+clean+wait, 3 active+recovering+undersized+remapped, 172 active+clean; 4.6 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1022 B/s rd, 20 MiB/s wr, 328 op/s; 1209/226317 objects misplaced (0.534%); 2.2 MiB/s, 34 objects/s recovering 2021-10-08T19:29:10.658 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:29:10.663 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:10.663 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:29:10.696 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 79 16 79371 79355 62.7454 60.8125 0.0108417 0.0159324 2021-10-08T19:29:10.765 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:29:10.797 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:10.887 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:29:10.892 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:10.893 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:29:10.994 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:29:11.036 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:11.078 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:29:11.084 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:29:11.110 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:29:11.115 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:11.116 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:29:11.217 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:29:11.284 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:11.455 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:29:11.460 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:11.461 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:29:11.562 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:29:11.616 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:11.700 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:2021-10-08T19:29:11.699714+0000 min lat: 0.00104309 max lat: 8.25637 avg lat: 0.0159756 2021-10-08T19:29:11.700 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2021-10-08T19:29:11.701 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 80 16 80158 80142 62.5732 49.1875 0.035872 0.0159756 2021-10-08T19:29:11.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:11 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:29:11.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:11 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:29:11.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:11 smithi097 ceph-mon[32687]: osdmap e221: 8 total, 8 up, 8 in 2021-10-08T19:29:11.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:11 smithi097 ceph-mon[32687]: pgmap v375: 178 pgs: 3 active+recovering+undersized+remapped, 175 active+clean; 4.7 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 853 B/s rd, 41 MiB/s wr, 654 op/s; 1093/233163 objects misplaced (0.469%); 1.8 MiB/s, 28 objects/s recovering 2021-10-08T19:29:11.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:11 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:29:11.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:11 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:29:11.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:11 smithi097 ceph-mon[41966]: osdmap e221: 8 total, 8 up, 8 in 2021-10-08T19:29:11.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:11 smithi097 ceph-mon[41966]: pgmap v375: 178 pgs: 3 active+recovering+undersized+remapped, 175 active+clean; 4.7 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 853 B/s rd, 41 MiB/s wr, 654 op/s; 1093/233163 objects misplaced (0.469%); 1.8 MiB/s, 28 objects/s recovering 2021-10-08T19:29:11.831 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:29:11.841 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:11.842 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:29:11.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:11 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:29:11.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:11 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:29:11.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:11 smithi117 ceph-mon[34585]: osdmap e221: 8 total, 8 up, 8 in 2021-10-08T19:29:11.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:11 smithi117 ceph-mon[34585]: pgmap v375: 178 pgs: 3 active+recovering+undersized+remapped, 175 active+clean; 4.7 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 853 B/s rd, 41 MiB/s wr, 654 op/s; 1093/233163 objects misplaced (0.469%); 1.8 MiB/s, 28 objects/s recovering 2021-10-08T19:29:11.943 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:29:11.982 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:12.055 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:29:12.056 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:12.057 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:29:12.158 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:29:12.235 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:12.248 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:29:12.248 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2021-10-08T19:29:12.248 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2021-10-08T19:29:12.248 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2021-10-08T19:29:12.249 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:29:12.630 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is set 2021-10-08T19:29:12.700 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 81 16 80905 80889 62.3771 46.6875 0.0118377 0.0160248 2021-10-08T19:29:12.867 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:29:12.871 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:12.872 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:29:12.873 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:29:12 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:29:12] "GET /metrics HTTP/1.1" 200 155780 "" "Prometheus/2.18.1" 2021-10-08T19:29:12.873 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:12 smithi097 ceph-mon[41966]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2021-10-08T19:29:12.874 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:12 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/4266953259' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:29:12.874 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:12 smithi097 ceph-mon[32687]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2021-10-08T19:29:12.875 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:12 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/4266953259' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:29:12.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:12 smithi117 ceph-mon[34585]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2021-10-08T19:29:12.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:12 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/4266953259' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:29:12.973 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:29:13.024 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:13.166 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:29:13.170 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:13.171 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:29:13.272 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:29:13.316 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:13.404 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:29:13.408 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:13.409 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:29:13.510 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:29:13.574 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:13.668 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:29:13.675 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:13.676 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:29:13.700 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 82 16 81837 81821 62.3266 58.25 0.0237279 0.0160397 2021-10-08T19:29:13.778 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:29:13.819 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:13.868 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:13 smithi117 ceph-mon[34585]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:29:13.869 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:13 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/4266953259' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:29:13.869 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:13 smithi117 ceph-mon[34585]: osdmap e222: 8 total, 8 up, 8 in 2021-10-08T19:29:13.869 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:13 smithi117 ceph-mon[34585]: pgmap v377: 178 pgs: 3 active+recovering+undersized+remapped, 175 active+clean; 4.7 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 850 B/s rd, 41 MiB/s wr, 652 op/s; 1093/233163 objects misplaced (0.469%); 1.8 MiB/s, 28 objects/s recovering 2021-10-08T19:29:13.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:13 smithi097 ceph-mon[32687]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:29:13.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:13 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/4266953259' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:29:13.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:13 smithi097 ceph-mon[32687]: osdmap e222: 8 total, 8 up, 8 in 2021-10-08T19:29:13.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:13 smithi097 ceph-mon[32687]: pgmap v377: 178 pgs: 3 active+recovering+undersized+remapped, 175 active+clean; 4.7 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 850 B/s rd, 41 MiB/s wr, 652 op/s; 1093/233163 objects misplaced (0.469%); 1.8 MiB/s, 28 objects/s recovering 2021-10-08T19:29:13.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:13 smithi097 ceph-mon[41966]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:29:13.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:13 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/4266953259' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:29:13.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:13 smithi097 ceph-mon[41966]: osdmap e222: 8 total, 8 up, 8 in 2021-10-08T19:29:13.975 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:13 smithi097 ceph-mon[41966]: pgmap v377: 178 pgs: 3 active+recovering+undersized+remapped, 175 active+clean; 4.7 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 850 B/s rd, 41 MiB/s wr, 652 op/s; 1093/233163 objects misplaced (0.469%); 1.8 MiB/s, 28 objects/s recovering 2021-10-08T19:29:14.062 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:29:14.063 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:14.064 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:29:14.157 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:29:13 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:29:13] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:29:14.166 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:29:14.199 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:14.243 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:29:14.248 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:14.250 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:29:14.351 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:29:14.401 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:14.471 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:29:14 smithi097 conmon[33110]: 172.21.15.117 - - [08/Oct/2021:19:29:14] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:29:14.700 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 83 16 82839 82823 62.3301 62.625 0.0115805 0.0160385 2021-10-08T19:29:14.776 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2021-10-08T19:29:14.894 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:29:14.899 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:14.899 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:29:15.000 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:29:15.044 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:15.110 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:29:15.112 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:15.113 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:29:15.165 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:15 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:29:15.166 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:15 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:29:15.166 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:15 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:29:15.167 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:15 smithi097 ceph-mon[32687]: 172.21.15.117 - - [08/Oct/2021:19:29:14] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:29:15.167 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:15 smithi097 ceph-mon[32687]: pgmap v378: 178 pgs: 3 active+recovering+undersized+remapped, 175 active+clean; 5.0 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.2 KiB/s rd, 64 MiB/s wr, 1.02k op/s; 917/246000 objects misplaced (0.373%); 2.7 MiB/s, 43 objects/s recovering 2021-10-08T19:29:15.214 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:29:15.247 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:15.306 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:29:15.311 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:15 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:29:15.312 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:15 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:29:15.312 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:15 smithi117 ceph-mon[34585]: 172.21.15.117 - - [08/Oct/2021:19:29:14] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:29:15.312 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:15 smithi117 ceph-mon[34585]: pgmap v378: 178 pgs: 3 active+recovering+undersized+remapped, 175 active+clean; 5.0 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.2 KiB/s rd, 64 MiB/s wr, 1.02k op/s; 917/246000 objects misplaced (0.373%); 2.7 MiB/s, 43 objects/s recovering 2021-10-08T19:29:15.313 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:15.314 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:29:15.416 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:29:15.469 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:15 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:29:15.469 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:15 smithi097 ceph-mon[41966]: 172.21.15.117 - - [08/Oct/2021:19:29:14] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:29:15.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:15 smithi097 ceph-mon[41966]: pgmap v378: 178 pgs: 3 active+recovering+undersized+remapped, 175 active+clean; 5.0 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.2 KiB/s rd, 64 MiB/s wr, 1.02k op/s; 917/246000 objects misplaced (0.373%); 2.7 MiB/s, 43 objects/s recovering 2021-10-08T19:29:15.478 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:15.605 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:29:15.702 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 84 16 83696 83680 62.2258 53.5625 0.0109572 0.016065 2021-10-08T19:29:15.776 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:29:15.784 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:15.785 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:29:15.886 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:29:15.938 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:16.106 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:29:16.112 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:16.114 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:29:16.215 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:29:16.230 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:29:16.301 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:16.301 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:29:16.359 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:29:16.411 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:29:16.418 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:16.419 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:29:16.428 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:29:16.447 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:29:16.463 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:29:16.477 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2021-10-08T19:29:16.507 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:29:16.520 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:29:16.548 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:16.553 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:29:16.594 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:29:16.607 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:29:16.609 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'false' 2021-10-08T19:29:16.609 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'false' 2021-10-08T19:29:16.610 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'false' 2021-10-08T19:29:16.610 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'false' 2021-10-08T19:29:16.610 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'false' 2021-10-08T19:29:16.610 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'false' 2021-10-08T19:29:16.610 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'false' 2021-10-08T19:29:16.611 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'false' 2021-10-08T19:29:16.611 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:16.612 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:29:16.651 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:16 smithi097 ceph-mon[32687]: osdmap e223: 8 total, 8 up, 8 in 2021-10-08T19:29:16.652 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:16 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3304488928' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:29:16.653 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:16 smithi097 ceph-mon[41966]: osdmap e223: 8 total, 8 up, 8 in 2021-10-08T19:29:16.653 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:16 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3304488928' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:29:16.703 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 85 16 84436 84420 62.0366 46.25 0.0302638 0.0161146 2021-10-08T19:29:16.714 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:29:16.746 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:16.805 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:29:16.807 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:29:16 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:29:16.808 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:16 smithi117 ceph-mon[34585]: osdmap e223: 8 total, 8 up, 8 in 2021-10-08T19:29:16.808 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:16 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3304488928' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:29:16.809 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:16.810 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:29:16.911 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:29:16.954 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:17.589 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset noscrub 2021-10-08T19:29:17.702 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 86 16 85357 85341 61.9845 57.5625 0.0169586 0.016128 2021-10-08T19:29:17.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:17 smithi117 ceph-mon[34585]: from='client.35243 v1:172.21.15.97:0/4253459325' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:29:17.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:17 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:29:17.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:17 smithi117 ceph-mon[34585]: pgmap v380: 178 pgs: 3 active+recovering+undersized+remapped, 175 active+clean; 5.0 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 848 B/s rd, 44 MiB/s wr, 709 op/s; 917/246000 objects misplaced (0.373%); 1.8 MiB/s, 29 objects/s recovering 2021-10-08T19:29:17.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:17 smithi097 ceph-mon[41966]: from='client.35243 v1:172.21.15.97:0/4253459325' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:29:17.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:17 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:29:17.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:17 smithi097 ceph-mon[41966]: pgmap v380: 178 pgs: 3 active+recovering+undersized+remapped, 175 active+clean; 5.0 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 848 B/s rd, 44 MiB/s wr, 709 op/s; 917/246000 objects misplaced (0.373%); 1.8 MiB/s, 29 objects/s recovering 2021-10-08T19:29:17.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:17 smithi097 ceph-mon[32687]: from='client.35243 v1:172.21.15.97:0/4253459325' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:29:17.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:17 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:29:17.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:17 smithi097 ceph-mon[32687]: pgmap v380: 178 pgs: 3 active+recovering+undersized+remapped, 175 active+clean; 5.0 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 848 B/s rd, 44 MiB/s wr, 709 op/s; 917/246000 objects misplaced (0.373%); 1.8 MiB/s, 29 objects/s recovering 2021-10-08T19:29:18.093 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":379,"stamp":"2021-10-08T19:29:15.590528+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5361768839,"num_objects":82000,"num_object_clones":0,"num_object_copies":246000,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":917,"num_objects_unfound":0,"num_objects_dirty":82000,"num_whiteouts":0,"num_read":1263,"num_read_kb":1111,"num_write":82410,"num_write_kb":5237977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5174,"num_bytes_recovered":318299981,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":73983,"ondisk_log_size":73983,"up":534,"acting":531,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":545,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":16815116,"kb_used_data":15792972,"kb_used_omap":0,"kb_used_meta":1022080,"kb_avail":733146100,"statfs":{"total":767960285184,"available":750741606400,"internally_reserved":0,"allocated":16172003328,"data_stored":16166072758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1046609920},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,2,2,9,7,3],"upper_bound":64},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":429981696,"num_objects":6561,"num_object_clones":0,"num_object_copies":19683,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-292,"num_objects_unfound":0,"num_objects_dirty":6561,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6561,"num_write_kb":419904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":292,"num_bytes_recovered":19136512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.976613"},"pg_stats":[{"pgid":"8.4","version":"222'4967","reported_seq":5015,"reported_epoch":222,"state":"active+clean","last_fresh":"2021-10-08T19:29:13.432519+0000","last_change":"2021-10-08T19:27:43.651844+0000","last_active":"2021-10-08T19:29:13.432519+0000","last_peered":"2021-10-08T19:29:13.432519+0000","last_clean":"2021-10-08T19:29:13.432519+0000","last_became_active":"2021-10-08T19:27:43.651599+0000","last_became_peered":"2021-10-08T19:27:43.651599+0000","last_unstale":"2021-10-08T19:29:13.432519+0000","last_undegraded":"2021-10-08T19:29:13.432519+0000","last_fullsized":"2021-10-08T19:29:13.432519+0000","mapping_epoch":182,"log_start":"187'400","ondisk_log_start":"187'400","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_clean_scrub_stamp":"2021-10-08T19:27:42.631354+0000","log_size":4567,"ondisk_log_size":4567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":325517312,"num_objects":4967,"num_object_clones":0,"num_object_copies":14901,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4967,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4967,"num_write_kb":317888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,2],"acting":[5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"114'10","reported_seq":307,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:11.813989+0000","last_change":"2021-10-08T19:27:36.614081+0000","last_active":"2021-10-08T19:29:11.813989+0000","last_peered":"2021-10-08T19:29:11.813989+0000","last_clean":"2021-10-08T19:29:11.813989+0000","last_became_active":"2021-10-08T19:24:25.096162+0000","last_became_peered":"2021-10-08T19:24:25.096162+0000","last_unstale":"2021-10-08T19:29:11.813989+0000","last_undegraded":"2021-10-08T19:29:11.813989+0000","last_fullsized":"2021-10-08T19:29:11.813989+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'10","last_scrub_stamp":"2021-10-08T19:27:36.614016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:27:36.614016+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040334050000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"87'22","reported_seq":261,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.603438+0000","last_change":"2021-10-08T19:24:25.118654+0000","last_active":"2021-10-08T19:29:10.603438+0000","last_peered":"2021-10-08T19:29:10.603438+0000","last_clean":"2021-10-08T19:29:10.603438+0000","last_became_active":"2021-10-08T19:24:25.088861+0000","last_became_peered":"2021-10-08T19:24:25.088861+0000","last_unstale":"2021-10-08T19:29:10.603438+0000","last_undegraded":"2021-10-08T19:29:10.603438+0000","last_fullsized":"2021-10-08T19:29:10.603438+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'22","last_scrub_stamp":"2021-10-08T19:24:20.355553+0000","last_deep_scrub":"87'22","last_deep_scrub_stamp":"2021-10-08T19:22:58.705632+0000","last_clean_scrub_stamp":"2021-10-08T19:24:20.355553+0000","log_size":22,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0022961499999999998,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":184,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.596770+0000","last_change":"2021-10-08T19:29:02.266657+0000","last_active":"2021-10-08T19:29:10.596770+0000","last_peered":"2021-10-08T19:29:10.596770+0000","last_clean":"2021-10-08T19:29:10.596770+0000","last_became_active":"2021-10-08T19:21:23.600352+0000","last_became_peered":"2021-10-08T19:21:23.600352+0000","last_unstale":"2021-10-08T19:29:10.596770+0000","last_undegraded":"2021-10-08T19:29:10.596770+0000","last_fullsized":"2021-10-08T19:29:10.596770+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:07.800787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:07.800787+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012798608,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":193,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.607092+0000","last_change":"2021-10-08T19:28:08.936871+0000","last_active":"2021-10-08T19:29:10.607092+0000","last_peered":"2021-10-08T19:29:10.607092+0000","last_clean":"2021-10-08T19:29:10.607092+0000","last_became_active":"2021-10-08T19:24:25.089002+0000","last_became_peered":"2021-10-08T19:24:25.089002+0000","last_unstale":"2021-10-08T19:29:10.607092+0000","last_undegraded":"2021-10-08T19:29:10.607092+0000","last_fullsized":"2021-10-08T19:29:10.607092+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:08.936801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:08.936801+0000","last_clean_scrub_stamp":"2021-10-08T19:28:08.936801+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0082775899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":106,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.610832+0000","last_change":"2021-10-08T19:28:45.407695+0000","last_active":"2021-10-08T19:29:10.610832+0000","last_peered":"2021-10-08T19:29:10.610832+0000","last_clean":"2021-10-08T19:29:10.610832+0000","last_became_active":"2021-10-08T19:25:15.510457+0000","last_became_peered":"2021-10-08T19:25:15.510457+0000","last_unstale":"2021-10-08T19:29:10.610832+0000","last_undegraded":"2021-10-08T19:29:10.610832+0000","last_fullsized":"2021-10-08T19:29:10.610832+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:09.177525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:09.177525+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.7","version":"222'5151","reported_seq":5222,"reported_epoch":222,"state":"active+clean","last_fresh":"2021-10-08T19:29:13.717390+0000","last_change":"2021-10-08T19:29:04.236820+0000","last_active":"2021-10-08T19:29:13.717390+0000","last_peered":"2021-10-08T19:29:13.717390+0000","last_clean":"2021-10-08T19:29:13.717390+0000","last_became_active":"2021-10-08T19:28:52.609240+0000","last_became_peered":"2021-10-08T19:28:52.609240+0000","last_unstale":"2021-10-08T19:29:13.717390+0000","last_undegraded":"2021-10-08T19:29:13.717390+0000","last_fullsized":"2021-10-08T19:29:13.717390+0000","mapping_epoch":212,"log_start":"187'900","ondisk_log_start":"187'900","created":182,"last_epoch_clean":213,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_clean_scrub_stamp":"2021-10-08T19:27:42.631354+0000","log_size":4251,"ondisk_log_size":4251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":337575936,"num_objects":5151,"num_object_clones":0,"num_object_copies":15453,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5151,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5151,"num_write_kb":329664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":571,"num_bytes_recovered":37421056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,6],"acting":[1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"69'9","reported_seq":234,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.603194+0000","last_change":"2021-10-08T19:28:41.711583+0000","last_active":"2021-10-08T19:29:10.603194+0000","last_peered":"2021-10-08T19:29:10.603194+0000","last_clean":"2021-10-08T19:29:10.603194+0000","last_became_active":"2021-10-08T19:28:40.159729+0000","last_became_peered":"2021-10-08T19:28:40.159729+0000","last_unstale":"2021-10-08T19:29:10.603194+0000","last_undegraded":"2021-10-08T19:29:10.603194+0000","last_fullsized":"2021-10-08T19:29:10.603194+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'9","last_scrub_stamp":"2021-10-08T19:28:07.450546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:28:07.450546+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0061746960000000004,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":29,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.594862+0000","last_change":"2021-10-08T19:28:40.147531+0000","last_active":"2021-10-08T19:29:10.594862+0000","last_peered":"2021-10-08T19:29:10.594862+0000","last_clean":"2021-10-08T19:29:10.594862+0000","last_became_active":"2021-10-08T19:28:40.145835+0000","last_became_peered":"2021-10-08T19:28:40.145835+0000","last_unstale":"2021-10-08T19:29:10.594862+0000","last_undegraded":"2021-10-08T19:29:10.594862+0000","last_fullsized":"2021-10-08T19:29:10.594862+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:11.176122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:11.176122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":178,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.593341+0000","last_change":"2021-10-08T19:27:38.324454+0000","last_active":"2021-10-08T19:29:10.593341+0000","last_peered":"2021-10-08T19:29:10.593341+0000","last_clean":"2021-10-08T19:29:10.593341+0000","last_became_active":"2021-10-08T19:21:27.635310+0000","last_became_peered":"2021-10-08T19:21:27.635310+0000","last_unstale":"2021-10-08T19:29:10.593341+0000","last_undegraded":"2021-10-08T19:29:10.593341+0000","last_fullsized":"2021-10-08T19:29:10.593341+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:38.324368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:27:38.324368+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0015013699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":176,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.602100+0000","last_change":"2021-10-08T19:28:09.465717+0000","last_active":"2021-10-08T19:29:10.602100+0000","last_peered":"2021-10-08T19:29:10.602100+0000","last_clean":"2021-10-08T19:29:10.602100+0000","last_became_active":"2021-10-08T19:21:29.643022+0000","last_became_peered":"2021-10-08T19:21:29.643022+0000","last_unstale":"2021-10-08T19:29:10.602100+0000","last_undegraded":"2021-10-08T19:29:10.602100+0000","last_fullsized":"2021-10-08T19:29:10.602100+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:09.465640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:28:09.465640+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.040018977999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"70'5","reported_seq":448,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:12.574822+0000","last_change":"2021-10-08T19:24:25.638250+0000","last_active":"2021-10-08T19:29:12.574822+0000","last_peered":"2021-10-08T19:29:12.574822+0000","last_clean":"2021-10-08T19:29:12.574822+0000","last_became_active":"2021-10-08T19:24:25.103095+0000","last_became_peered":"2021-10-08T19:24:25.103095+0000","last_unstale":"2021-10-08T19:29:12.574822+0000","last_undegraded":"2021-10-08T19:29:12.574822+0000","last_fullsized":"2021-10-08T19:29:12.574822+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:24:16.396790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:16.396790+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0078447029999999997,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":293,"num_read_kb":293,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":389,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"222'5212","reported_seq":5260,"reported_epoch":222,"state":"active+clean","last_fresh":"2021-10-08T19:29:13.846152+0000","last_change":"2021-10-08T19:27:43.728156+0000","last_active":"2021-10-08T19:29:13.846152+0000","last_peered":"2021-10-08T19:29:13.846152+0000","last_clean":"2021-10-08T19:29:13.846152+0000","last_became_active":"2021-10-08T19:27:43.727841+0000","last_became_peered":"2021-10-08T19:27:43.727841+0000","last_unstale":"2021-10-08T19:29:13.846152+0000","last_undegraded":"2021-10-08T19:29:13.846152+0000","last_fullsized":"2021-10-08T19:29:13.846152+0000","mapping_epoch":182,"log_start":"187'400","ondisk_log_start":"187'400","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_clean_scrub_stamp":"2021-10-08T19:27:42.631354+0000","log_size":4812,"ondisk_log_size":4812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":341573632,"num_objects":5212,"num_object_clones":0,"num_object_copies":15636,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5212,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5212,"num_write_kb":333568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"69'19","reported_seq":206,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.601058+0000","last_change":"2021-10-08T19:28:47.843610+0000","last_active":"2021-10-08T19:29:10.601058+0000","last_peered":"2021-10-08T19:29:10.601058+0000","last_clean":"2021-10-08T19:29:10.601058+0000","last_became_active":"2021-10-08T19:28:40.101648+0000","last_became_peered":"2021-10-08T19:28:40.101648+0000","last_unstale":"2021-10-08T19:29:10.601058+0000","last_undegraded":"2021-10-08T19:29:10.601058+0000","last_fullsized":"2021-10-08T19:29:10.601058+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'19","last_scrub_stamp":"2021-10-08T19:28:01.296918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:28:01.296918+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039349349999999996,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":31,"num_read_kb":20,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":182,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.593671+0000","last_change":"2021-10-08T19:27:36.314598+0000","last_active":"2021-10-08T19:29:10.593671+0000","last_peered":"2021-10-08T19:29:10.593671+0000","last_clean":"2021-10-08T19:29:10.593671+0000","last_became_active":"2021-10-08T19:21:23.595919+0000","last_became_peered":"2021-10-08T19:21:23.595919+0000","last_unstale":"2021-10-08T19:29:10.593671+0000","last_undegraded":"2021-10-08T19:29:10.593671+0000","last_fullsized":"2021-10-08T19:29:10.593671+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:36.314494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:27:36.314494+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034123560000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":178,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.594397+0000","last_change":"2021-10-08T19:28:14.025270+0000","last_active":"2021-10-08T19:29:10.594397+0000","last_peered":"2021-10-08T19:29:10.594397+0000","last_clean":"2021-10-08T19:29:10.594397+0000","last_became_active":"2021-10-08T19:21:27.638583+0000","last_became_peered":"2021-10-08T19:21:27.638583+0000","last_unstale":"2021-10-08T19:29:10.594397+0000","last_undegraded":"2021-10-08T19:29:10.594397+0000","last_fullsized":"2021-10-08T19:29:10.594397+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:14.025158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:28:14.025158+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0071289430000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":176,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.609777+0000","last_change":"2021-10-08T19:27:39.528797+0000","last_active":"2021-10-08T19:29:10.609777+0000","last_peered":"2021-10-08T19:29:10.609777+0000","last_clean":"2021-10-08T19:29:10.609777+0000","last_became_active":"2021-10-08T19:21:29.648922+0000","last_became_peered":"2021-10-08T19:21:29.648922+0000","last_unstale":"2021-10-08T19:29:10.609777+0000","last_undegraded":"2021-10-08T19:29:10.609777+0000","last_fullsized":"2021-10-08T19:29:10.609777+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:39.528699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:39.528699+0000","last_clean_scrub_stamp":"2021-10-08T19:27:39.528699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001737499,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":101,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.612536+0000","last_change":"2021-10-08T19:28:48.336654+0000","last_active":"2021-10-08T19:29:10.612536+0000","last_peered":"2021-10-08T19:29:10.612536+0000","last_clean":"2021-10-08T19:29:10.612536+0000","last_became_active":"2021-10-08T19:25:15.503081+0000","last_became_peered":"2021-10-08T19:25:15.503081+0000","last_unstale":"2021-10-08T19:29:10.612536+0000","last_undegraded":"2021-10-08T19:29:10.612536+0000","last_fullsized":"2021-10-08T19:29:10.612536+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:17.379559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:17.379559+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0090469920000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"222'5183","reported_seq":7763,"reported_epoch":222,"state":"active+clean","last_fresh":"2021-10-08T19:29:13.761430+0000","last_change":"2021-10-08T19:28:56.191478+0000","last_active":"2021-10-08T19:29:13.761430+0000","last_peered":"2021-10-08T19:29:13.761430+0000","last_clean":"2021-10-08T19:29:13.761430+0000","last_became_active":"2021-10-08T19:28:48.966958+0000","last_became_peered":"2021-10-08T19:28:48.966958+0000","last_unstale":"2021-10-08T19:29:13.761430+0000","last_undegraded":"2021-10-08T19:29:13.761430+0000","last_fullsized":"2021-10-08T19:29:13.761430+0000","mapping_epoch":208,"log_start":"188'961","ondisk_log_start":"188'961","created":182,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_clean_scrub_stamp":"2021-10-08T19:27:42.631354+0000","log_size":4222,"ondisk_log_size":4222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":339673088,"num_objects":5183,"num_object_clones":0,"num_object_copies":15549,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5183,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5183,"num_write_kb":331712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1252,"num_bytes_recovered":82051072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.8","version":"90'130","reported_seq":353,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.603766+0000","last_change":"2021-10-08T19:27:37.611695+0000","last_active":"2021-10-08T19:29:10.603766+0000","last_peered":"2021-10-08T19:29:10.603766+0000","last_clean":"2021-10-08T19:29:10.603766+0000","last_became_active":"2021-10-08T19:27:37.611248+0000","last_became_peered":"2021-10-08T19:27:37.611248+0000","last_unstale":"2021-10-08T19:29:10.603766+0000","last_undegraded":"2021-10-08T19:29:10.603766+0000","last_fullsized":"2021-10-08T19:29:10.603766+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.284249+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020087920000000001,"stat_sum":{"num_bytes":53670,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":28,"num_write":16,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":423697,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"69'17","reported_seq":261,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.588210+0000","last_change":"2021-10-08T19:28:40.209057+0000","last_active":"2021-10-08T19:29:10.588210+0000","last_peered":"2021-10-08T19:29:10.588210+0000","last_clean":"2021-10-08T19:29:10.588210+0000","last_became_active":"2021-10-08T19:28:40.099618+0000","last_became_peered":"2021-10-08T19:28:40.099618+0000","last_unstale":"2021-10-08T19:29:10.588210+0000","last_undegraded":"2021-10-08T19:29:10.588210+0000","last_fullsized":"2021-10-08T19:29:10.588210+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'17","last_scrub_stamp":"2021-10-08T19:28:02.599959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:28:02.599959+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0066589689999999998,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"61'1","reported_seq":190,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.610829+0000","last_change":"2021-10-08T19:28:05.469192+0000","last_active":"2021-10-08T19:29:10.610829+0000","last_peered":"2021-10-08T19:29:10.610829+0000","last_clean":"2021-10-08T19:29:10.610829+0000","last_became_active":"2021-10-08T19:21:23.607064+0000","last_became_peered":"2021-10-08T19:21:23.607064+0000","last_unstale":"2021-10-08T19:29:10.610829+0000","last_undegraded":"2021-10-08T19:29:10.610829+0000","last_fullsized":"2021-10-08T19:29:10.610829+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'1","last_scrub_stamp":"2021-10-08T19:28:05.469109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:28:05.469109+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013719907,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.594228+0000","last_change":"2021-10-08T19:28:40.152780+0000","last_active":"2021-10-08T19:29:10.594228+0000","last_peered":"2021-10-08T19:29:10.594228+0000","last_clean":"2021-10-08T19:29:10.594228+0000","last_became_active":"2021-10-08T19:28:40.152478+0000","last_became_peered":"2021-10-08T19:28:40.152478+0000","last_unstale":"2021-10-08T19:29:10.594228+0000","last_undegraded":"2021-10-08T19:29:10.594228+0000","last_fullsized":"2021-10-08T19:29:10.594228+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:36.055616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:36.055616+0000","last_clean_scrub_stamp":"2021-10-08T19:23:36.055616+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":176,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.596180+0000","last_change":"2021-10-08T19:28:16.132553+0000","last_active":"2021-10-08T19:29:10.596180+0000","last_peered":"2021-10-08T19:29:10.596180+0000","last_clean":"2021-10-08T19:29:10.596180+0000","last_became_active":"2021-10-08T19:21:29.646455+0000","last_became_peered":"2021-10-08T19:21:29.646455+0000","last_unstale":"2021-10-08T19:29:10.596180+0000","last_undegraded":"2021-10-08T19:29:10.596180+0000","last_fullsized":"2021-10-08T19:29:10.596180+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:16.132417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:28:16.132417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.058377659999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":143,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.601284+0000","last_change":"2021-10-08T19:28:40.102453+0000","last_active":"2021-10-08T19:29:10.601284+0000","last_peered":"2021-10-08T19:29:10.601284+0000","last_clean":"2021-10-08T19:29:10.601284+0000","last_became_active":"2021-10-08T19:28:40.101504+0000","last_became_peered":"2021-10-08T19:28:40.101504+0000","last_unstale":"2021-10-08T19:29:10.601284+0000","last_undegraded":"2021-10-08T19:29:10.601284+0000","last_fullsized":"2021-10-08T19:29:10.601284+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:14.495972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:28:14.495972+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0033138379999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.0","version":"222'5171","reported_seq":6101,"reported_epoch":222,"state":"active+recovering+undersized+remapped","last_fresh":"2021-10-08T19:29:13.757563+0000","last_change":"2021-10-08T19:28:50.792117+0000","last_active":"2021-10-08T19:29:13.757563+0000","last_peered":"2021-10-08T19:29:13.757563+0000","last_clean":"2021-10-08T19:28:22.614034+0000","last_became_active":"2021-10-08T19:28:40.244570+0000","last_became_peered":"2021-10-08T19:28:40.244570+0000","last_unstale":"2021-10-08T19:29:13.757563+0000","last_undegraded":"2021-10-08T19:29:13.757563+0000","last_fullsized":"2021-10-08T19:28:40.097104+0000","mapping_epoch":202,"log_start":"188'1000","ondisk_log_start":"188'1000","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_clean_scrub_stamp":"2021-10-08T19:27:42.631354+0000","log_size":4171,"ondisk_log_size":4171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":338886656,"num_objects":5171,"num_object_clones":0,"num_object_copies":15513,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":332,"num_objects_unfound":0,"num_objects_dirty":5171,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5171,"num_write_kb":330944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":432,"num_bytes_recovered":28311552,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5],"avail_no_missing":["3","5"],"object_location_counts":[{"shards":"3,4,5","objects":332},{"shards":"3,5","objects":4839}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.9","version":"90'130","reported_seq":496,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.608739+0000","last_change":"2021-10-08T19:27:26.586458+0000","last_active":"2021-10-08T19:29:10.608739+0000","last_peered":"2021-10-08T19:29:10.608739+0000","last_clean":"2021-10-08T19:29:10.608739+0000","last_became_active":"2021-10-08T19:27:26.586201+0000","last_became_peered":"2021-10-08T19:27:26.586201+0000","last_unstale":"2021-10-08T19:29:10.608739+0000","last_undegraded":"2021-10-08T19:29:10.608739+0000","last_fullsized":"2021-10-08T19:29:10.608739+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.284249+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0045617870000000003,"stat_sum":{"num_bytes":53670,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":28,"num_write":16,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":268349,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"69'10","reported_seq":236,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.590114+0000","last_change":"2021-10-08T19:28:00.572309+0000","last_active":"2021-10-08T19:29:10.590114+0000","last_peered":"2021-10-08T19:29:10.590114+0000","last_clean":"2021-10-08T19:29:10.590114+0000","last_became_active":"2021-10-08T19:24:25.098048+0000","last_became_peered":"2021-10-08T19:24:25.098048+0000","last_unstale":"2021-10-08T19:29:10.590114+0000","last_undegraded":"2021-10-08T19:29:10.590114+0000","last_fullsized":"2021-10-08T19:29:10.590114+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'10","last_scrub_stamp":"2021-10-08T19:28:00.572215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:28:00.572215+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011508064,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":29,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.596180+0000","last_change":"2021-10-08T19:28:40.146609+0000","last_active":"2021-10-08T19:29:10.596180+0000","last_peered":"2021-10-08T19:29:10.596180+0000","last_clean":"2021-10-08T19:29:10.596180+0000","last_became_active":"2021-10-08T19:28:40.141793+0000","last_became_peered":"2021-10-08T19:28:40.141793+0000","last_unstale":"2021-10-08T19:29:10.596180+0000","last_undegraded":"2021-10-08T19:29:10.596180+0000","last_fullsized":"2021-10-08T19:29:10.596180+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:15.233394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:15.233394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"69'8","reported_seq":280,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:11.812733+0000","last_change":"2021-10-08T19:24:09.793029+0000","last_active":"2021-10-08T19:29:11.812733+0000","last_peered":"2021-10-08T19:29:11.812733+0000","last_clean":"2021-10-08T19:29:11.812733+0000","last_became_active":"2021-10-08T19:21:27.637930+0000","last_became_peered":"2021-10-08T19:21:27.637930+0000","last_unstale":"2021-10-08T19:29:11.812733+0000","last_undegraded":"2021-10-08T19:29:11.812733+0000","last_fullsized":"2021-10-08T19:29:11.812733+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'8","last_scrub_stamp":"2021-10-08T19:24:09.792928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:09.792928+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0052042049999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":193,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.589071+0000","last_change":"2021-10-08T19:28:40.100538+0000","last_active":"2021-10-08T19:29:10.589071+0000","last_peered":"2021-10-08T19:29:10.589071+0000","last_clean":"2021-10-08T19:29:10.589071+0000","last_became_active":"2021-10-08T19:28:40.100213+0000","last_became_peered":"2021-10-08T19:28:40.100213+0000","last_unstale":"2021-10-08T19:29:10.589071+0000","last_undegraded":"2021-10-08T19:29:10.589071+0000","last_fullsized":"2021-10-08T19:29:10.589071+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:19.303695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:24:19.303695+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0069500159999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":132,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.623994+0000","last_change":"2021-10-08T19:28:05.180565+0000","last_active":"2021-10-08T19:29:10.623994+0000","last_peered":"2021-10-08T19:29:10.623994+0000","last_clean":"2021-10-08T19:29:10.623994+0000","last_became_active":"2021-10-08T19:24:13.518601+0000","last_became_peered":"2021-10-08T19:24:13.518601+0000","last_unstale":"2021-10-08T19:29:10.623994+0000","last_undegraded":"2021-10-08T19:29:10.623994+0000","last_fullsized":"2021-10-08T19:29:10.623994+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:05.180500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:28:05.180500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012201953,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"222'5144","reported_seq":6274,"reported_epoch":222,"state":"active+recovering+undersized+remapped","last_fresh":"2021-10-08T19:29:13.458871+0000","last_change":"2021-10-08T19:28:41.846009+0000","last_active":"2021-10-08T19:29:13.458871+0000","last_peered":"2021-10-08T19:29:13.458871+0000","last_clean":"2021-10-08T19:28:22.574898+0000","last_became_active":"2021-10-08T19:28:40.168782+0000","last_became_peered":"2021-10-08T19:28:40.168782+0000","last_unstale":"2021-10-08T19:29:13.458871+0000","last_undegraded":"2021-10-08T19:29:13.458871+0000","last_fullsized":"2021-10-08T19:28:40.079602+0000","mapping_epoch":202,"log_start":"187'600","ondisk_log_start":"187'600","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_clean_scrub_stamp":"2021-10-08T19:27:42.631354+0000","log_size":4544,"ondisk_log_size":4544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":337117184,"num_objects":5144,"num_object_clones":0,"num_object_copies":15432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":273,"num_objects_unfound":0,"num_objects_dirty":5144,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5144,"num_write_kb":329216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":534,"num_bytes_recovered":34996224,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[5,6],"avail_no_missing":["5","6"],"object_location_counts":[{"shards":"2,5,6","objects":273},{"shards":"5,6","objects":4871}],"blocked_by":[],"up_primary":1,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.a","version":"90'130","reported_seq":358,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.604712+0000","last_change":"2021-10-08T19:27:26.591508+0000","last_active":"2021-10-08T19:29:10.604712+0000","last_peered":"2021-10-08T19:29:10.604712+0000","last_clean":"2021-10-08T19:29:10.604712+0000","last_became_active":"2021-10-08T19:27:26.591129+0000","last_became_peered":"2021-10-08T19:27:26.591129+0000","last_unstale":"2021-10-08T19:29:10.604712+0000","last_undegraded":"2021-10-08T19:29:10.604712+0000","last_fullsized":"2021-10-08T19:29:10.604712+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.284249+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020087920000000001,"stat_sum":{"num_bytes":53669,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":27,"num_write":16,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":161009,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.f","version":"69'15","reported_seq":45,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.595315+0000","last_change":"2021-10-08T19:28:42.296085+0000","last_active":"2021-10-08T19:29:10.595315+0000","last_peered":"2021-10-08T19:29:10.595315+0000","last_clean":"2021-10-08T19:29:10.595315+0000","last_became_active":"2021-10-08T19:28:40.192361+0000","last_became_peered":"2021-10-08T19:28:40.192361+0000","last_unstale":"2021-10-08T19:29:10.595315+0000","last_undegraded":"2021-10-08T19:29:10.595315+0000","last_fullsized":"2021-10-08T19:29:10.595315+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'15","last_scrub_stamp":"2021-10-08T19:27:36.564311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:27:36.564311+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":29,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.599626+0000","last_change":"2021-10-08T19:28:40.145444+0000","last_active":"2021-10-08T19:29:10.599626+0000","last_peered":"2021-10-08T19:29:10.599626+0000","last_clean":"2021-10-08T19:29:10.599626+0000","last_became_active":"2021-10-08T19:28:40.140240+0000","last_became_peered":"2021-10-08T19:28:40.140240+0000","last_unstale":"2021-10-08T19:29:10.599626+0000","last_undegraded":"2021-10-08T19:29:10.599626+0000","last_fullsized":"2021-10-08T19:29:10.599626+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:07.213008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:07.213008+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"88'9","reported_seq":283,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:11.811577+0000","last_change":"2021-10-08T19:28:01.592286+0000","last_active":"2021-10-08T19:29:11.811577+0000","last_peered":"2021-10-08T19:29:11.811577+0000","last_clean":"2021-10-08T19:29:11.811577+0000","last_became_active":"2021-10-08T19:21:27.636432+0000","last_became_peered":"2021-10-08T19:21:27.636432+0000","last_unstale":"2021-10-08T19:29:11.811577+0000","last_undegraded":"2021-10-08T19:29:11.811577+0000","last_fullsized":"2021-10-08T19:29:11.811577+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'9","last_scrub_stamp":"2021-10-08T19:28:01.592208+0000","last_deep_scrub":"88'9","last_deep_scrub_stamp":"2021-10-08T19:23:00.048245+0000","last_clean_scrub_stamp":"2021-10-08T19:28:01.592208+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0051143930000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":193,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.604847+0000","last_change":"2021-10-08T19:28:40.138482+0000","last_active":"2021-10-08T19:29:10.604847+0000","last_peered":"2021-10-08T19:29:10.604847+0000","last_clean":"2021-10-08T19:29:10.604847+0000","last_became_active":"2021-10-08T19:28:40.137966+0000","last_became_peered":"2021-10-08T19:28:40.137966+0000","last_unstale":"2021-10-08T19:29:10.604847+0000","last_undegraded":"2021-10-08T19:29:10.604847+0000","last_fullsized":"2021-10-08T19:29:10.604847+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:11.329954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:24:11.329954+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.01088446,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.8","version":"70'5","reported_seq":149,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.623804+0000","last_change":"2021-10-08T19:28:40.155680+0000","last_active":"2021-10-08T19:29:10.623804+0000","last_peered":"2021-10-08T19:29:10.623804+0000","last_clean":"2021-10-08T19:29:10.623804+0000","last_became_active":"2021-10-08T19:28:40.155322+0000","last_became_peered":"2021-10-08T19:28:40.155322+0000","last_unstale":"2021-10-08T19:29:10.623804+0000","last_undegraded":"2021-10-08T19:29:10.623804+0000","last_fullsized":"2021-10-08T19:29:10.623804+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:28:08.162564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:28:08.162564+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.039687264,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.2","version":"222'5091","reported_seq":5139,"reported_epoch":222,"state":"active+clean","last_fresh":"2021-10-08T19:29:13.550666+0000","last_change":"2021-10-08T19:27:43.651956+0000","last_active":"2021-10-08T19:29:13.550666+0000","last_peered":"2021-10-08T19:29:13.550666+0000","last_clean":"2021-10-08T19:29:13.550666+0000","last_became_active":"2021-10-08T19:27:43.651635+0000","last_became_peered":"2021-10-08T19:27:43.651635+0000","last_unstale":"2021-10-08T19:29:13.550666+0000","last_undegraded":"2021-10-08T19:29:13.550666+0000","last_fullsized":"2021-10-08T19:29:13.550666+0000","mapping_epoch":182,"log_start":"188'1000","ondisk_log_start":"188'1000","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_clean_scrub_stamp":"2021-10-08T19:27:42.631354+0000","log_size":4091,"ondisk_log_size":4091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":333643776,"num_objects":5091,"num_object_clones":0,"num_object_copies":15273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5091,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5091,"num_write_kb":325824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5],"acting":[4,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"69'11","reported_seq":282,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.588699+0000","last_change":"2021-10-08T19:28:47.806441+0000","last_active":"2021-10-08T19:29:10.588699+0000","last_peered":"2021-10-08T19:29:10.588699+0000","last_clean":"2021-10-08T19:29:10.588699+0000","last_became_active":"2021-10-08T19:28:40.100427+0000","last_became_peered":"2021-10-08T19:28:40.100427+0000","last_unstale":"2021-10-08T19:29:10.588699+0000","last_undegraded":"2021-10-08T19:29:10.588699+0000","last_fullsized":"2021-10-08T19:29:10.588699+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'11","last_scrub_stamp":"2021-10-08T19:28:08.680153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:28:08.680153+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0066172430000000001,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":202,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.609866+0000","last_change":"2021-10-08T19:28:51.370052+0000","last_active":"2021-10-08T19:29:10.609866+0000","last_peered":"2021-10-08T19:29:10.609866+0000","last_clean":"2021-10-08T19:29:10.609866+0000","last_became_active":"2021-10-08T19:28:40.100691+0000","last_became_peered":"2021-10-08T19:28:40.100691+0000","last_unstale":"2021-10-08T19:29:10.609866+0000","last_undegraded":"2021-10-08T19:29:10.609866+0000","last_fullsized":"2021-10-08T19:29:10.609866+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:14.537859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:14.537859+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.00235264,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":195,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.603767+0000","last_change":"2021-10-08T19:28:11.939647+0000","last_active":"2021-10-08T19:29:10.603767+0000","last_peered":"2021-10-08T19:29:10.603767+0000","last_clean":"2021-10-08T19:29:10.603767+0000","last_became_active":"2021-10-08T19:24:25.105244+0000","last_became_peered":"2021-10-08T19:24:25.105244+0000","last_unstale":"2021-10-08T19:29:10.603767+0000","last_undegraded":"2021-10-08T19:29:10.603767+0000","last_fullsized":"2021-10-08T19:29:10.603767+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:11.939557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:28:11.939557+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.005546044,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":187,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.624561+0000","last_change":"2021-10-08T19:24:25.096748+0000","last_active":"2021-10-08T19:29:10.624561+0000","last_peered":"2021-10-08T19:29:10.624561+0000","last_clean":"2021-10-08T19:29:10.624561+0000","last_became_active":"2021-10-08T19:24:25.096415+0000","last_became_peered":"2021-10-08T19:24:25.096415+0000","last_unstale":"2021-10-08T19:29:10.624561+0000","last_undegraded":"2021-10-08T19:29:10.624561+0000","last_fullsized":"2021-10-08T19:29:10.624561+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:17.422176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:17.422176+0000","last_clean_scrub_stamp":"2021-10-08T19:23:17.422176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0036221249999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":126,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.588191+0000","last_change":"2021-10-08T19:24:13.506996+0000","last_active":"2021-10-08T19:29:10.588191+0000","last_peered":"2021-10-08T19:29:10.588191+0000","last_clean":"2021-10-08T19:29:10.588191+0000","last_became_active":"2021-10-08T19:24:13.506602+0000","last_became_peered":"2021-10-08T19:24:13.506602+0000","last_unstale":"2021-10-08T19:29:10.588191+0000","last_undegraded":"2021-10-08T19:29:10.588191+0000","last_fullsized":"2021-10-08T19:29:10.588191+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:09.177525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:09.177525+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"222'5074","reported_seq":5122,"reported_epoch":222,"state":"active+clean","last_fresh":"2021-10-08T19:29:13.458064+0000","last_change":"2021-10-08T19:27:43.726852+0000","last_active":"2021-10-08T19:29:13.458064+0000","last_peered":"2021-10-08T19:29:13.458064+0000","last_clean":"2021-10-08T19:29:13.458064+0000","last_became_active":"2021-10-08T19:27:43.726506+0000","last_became_peered":"2021-10-08T19:27:43.726506+0000","last_unstale":"2021-10-08T19:29:13.458064+0000","last_undegraded":"2021-10-08T19:29:13.458064+0000","last_fullsized":"2021-10-08T19:29:13.458064+0000","mapping_epoch":182,"log_start":"187'500","ondisk_log_start":"187'500","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_clean_scrub_stamp":"2021-10-08T19:27:42.631354+0000","log_size":4574,"ondisk_log_size":4574,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":332529664,"num_objects":5074,"num_object_clones":0,"num_object_copies":15222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5074,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5074,"num_write_kb":324736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.4","version":"90'130","reported_seq":354,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.624641+0000","last_change":"2021-10-08T19:27:37.613110+0000","last_active":"2021-10-08T19:29:10.624641+0000","last_peered":"2021-10-08T19:29:10.624641+0000","last_clean":"2021-10-08T19:29:10.624641+0000","last_became_active":"2021-10-08T19:27:37.612736+0000","last_became_peered":"2021-10-08T19:27:37.612736+0000","last_unstale":"2021-10-08T19:29:10.624641+0000","last_undegraded":"2021-10-08T19:29:10.624641+0000","last_fullsized":"2021-10-08T19:29:10.624641+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.284249+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020087920000000001,"stat_sum":{"num_bytes":53670,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":28,"num_write":16,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":488690,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"203'11","reported_seq":301,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:11.812065+0000","last_change":"2021-10-08T19:28:41.686868+0000","last_active":"2021-10-08T19:29:11.812065+0000","last_peered":"2021-10-08T19:29:11.812065+0000","last_clean":"2021-10-08T19:29:11.812065+0000","last_became_active":"2021-10-08T19:28:40.155791+0000","last_became_peered":"2021-10-08T19:28:40.155791+0000","last_unstale":"2021-10-08T19:29:11.812065+0000","last_undegraded":"2021-10-08T19:29:11.812065+0000","last_fullsized":"2021-10-08T19:29:11.812065+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'9","last_scrub_stamp":"2021-10-08T19:23:32.329475+0000","last_deep_scrub":"91'9","last_deep_scrub_stamp":"2021-10-08T19:23:32.329475+0000","last_clean_scrub_stamp":"2021-10-08T19:23:32.329475+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0045727859999999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"69'14","reported_seq":250,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.588373+0000","last_change":"2021-10-08T19:24:26.225004+0000","last_active":"2021-10-08T19:29:10.588373+0000","last_peered":"2021-10-08T19:29:10.588373+0000","last_clean":"2021-10-08T19:29:10.588373+0000","last_became_active":"2021-10-08T19:24:25.098743+0000","last_became_peered":"2021-10-08T19:24:25.098743+0000","last_unstale":"2021-10-08T19:29:10.588373+0000","last_undegraded":"2021-10-08T19:29:10.588373+0000","last_fullsized":"2021-10-08T19:29:10.588373+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'14","last_scrub_stamp":"2021-10-08T19:24:10.235796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:24:10.235796+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0042036319999999997,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":119,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.602773+0000","last_change":"2021-10-08T19:24:25.094838+0000","last_active":"2021-10-08T19:29:10.602773+0000","last_peered":"2021-10-08T19:29:10.602773+0000","last_clean":"2021-10-08T19:29:10.602773+0000","last_became_active":"2021-10-08T19:24:25.094364+0000","last_became_peered":"2021-10-08T19:24:25.094364+0000","last_unstale":"2021-10-08T19:29:10.602773+0000","last_undegraded":"2021-10-08T19:29:10.602773+0000","last_fullsized":"2021-10-08T19:29:10.602773+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:23.529696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:23.529696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":196,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.611145+0000","last_change":"2021-10-08T19:28:01.468726+0000","last_active":"2021-10-08T19:29:10.611145+0000","last_peered":"2021-10-08T19:29:10.611145+0000","last_clean":"2021-10-08T19:29:10.611145+0000","last_became_active":"2021-10-08T19:24:25.094848+0000","last_became_peered":"2021-10-08T19:24:25.094848+0000","last_unstale":"2021-10-08T19:29:10.611145+0000","last_undegraded":"2021-10-08T19:29:10.611145+0000","last_fullsized":"2021-10-08T19:29:10.611145+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:01.468644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:28:01.468644+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.030033254999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":151,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.607181+0000","last_change":"2021-10-08T19:28:40.133427+0000","last_active":"2021-10-08T19:29:10.607181+0000","last_peered":"2021-10-08T19:29:10.607181+0000","last_clean":"2021-10-08T19:29:10.607181+0000","last_became_active":"2021-10-08T19:28:40.132751+0000","last_became_peered":"2021-10-08T19:28:40.132751+0000","last_unstale":"2021-10-08T19:29:10.607181+0000","last_undegraded":"2021-10-08T19:29:10.607181+0000","last_fullsized":"2021-10-08T19:29:10.607181+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:40.563247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.563247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.024890005999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"222'5207","reported_seq":5255,"reported_epoch":222,"state":"active+clean","last_fresh":"2021-10-08T19:29:13.868400+0000","last_change":"2021-10-08T19:27:43.728516+0000","last_active":"2021-10-08T19:29:13.868400+0000","last_peered":"2021-10-08T19:29:13.868400+0000","last_clean":"2021-10-08T19:29:13.868400+0000","last_became_active":"2021-10-08T19:27:43.727954+0000","last_became_peered":"2021-10-08T19:27:43.727954+0000","last_unstale":"2021-10-08T19:29:13.868400+0000","last_undegraded":"2021-10-08T19:29:13.868400+0000","last_fullsized":"2021-10-08T19:29:13.868400+0000","mapping_epoch":182,"log_start":"187'400","ondisk_log_start":"187'400","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_clean_scrub_stamp":"2021-10-08T19:27:42.631354+0000","log_size":4807,"ondisk_log_size":4807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":341245952,"num_objects":5207,"num_object_clones":0,"num_object_copies":15621,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5207,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5207,"num_write_kb":333248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"90'130","reported_seq":358,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.587902+0000","last_change":"2021-10-08T19:27:26.591042+0000","last_active":"2021-10-08T19:29:10.587902+0000","last_peered":"2021-10-08T19:29:10.587902+0000","last_clean":"2021-10-08T19:29:10.587902+0000","last_became_active":"2021-10-08T19:27:26.590651+0000","last_became_peered":"2021-10-08T19:27:26.590651+0000","last_unstale":"2021-10-08T19:29:10.587902+0000","last_undegraded":"2021-10-08T19:29:10.587902+0000","last_fullsized":"2021-10-08T19:29:10.587902+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.284249+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020087920000000001,"stat_sum":{"num_bytes":53670,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":28,"num_write":16,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":161010,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":177,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.588553+0000","last_change":"2021-10-08T19:24:15.302574+0000","last_active":"2021-10-08T19:29:10.588553+0000","last_peered":"2021-10-08T19:29:10.588553+0000","last_clean":"2021-10-08T19:29:10.588553+0000","last_became_active":"2021-10-08T19:21:27.637547+0000","last_became_peered":"2021-10-08T19:21:27.637547+0000","last_unstale":"2021-10-08T19:29:10.588553+0000","last_undegraded":"2021-10-08T19:29:10.588553+0000","last_fullsized":"2021-10-08T19:29:10.588553+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:15.302475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:15.302475+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0050588849999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"69'18","reported_seq":205,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.624363+0000","last_change":"2021-10-08T19:23:20.405609+0000","last_active":"2021-10-08T19:29:10.624363+0000","last_peered":"2021-10-08T19:29:10.624363+0000","last_clean":"2021-10-08T19:29:10.624363+0000","last_became_active":"2021-10-08T19:21:25.742909+0000","last_became_peered":"2021-10-08T19:21:25.742909+0000","last_unstale":"2021-10-08T19:29:10.624363+0000","last_undegraded":"2021-10-08T19:29:10.624363+0000","last_fullsized":"2021-10-08T19:29:10.624363+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'18","last_scrub_stamp":"2021-10-08T19:23:20.405525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:20.405525+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039753820000000004,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.595516+0000","last_change":"2021-10-08T19:28:40.146228+0000","last_active":"2021-10-08T19:29:10.595516+0000","last_peered":"2021-10-08T19:29:10.595516+0000","last_clean":"2021-10-08T19:29:10.595516+0000","last_became_active":"2021-10-08T19:28:40.141714+0000","last_became_peered":"2021-10-08T19:28:40.141714+0000","last_unstale":"2021-10-08T19:29:10.595516+0000","last_undegraded":"2021-10-08T19:29:10.595516+0000","last_fullsized":"2021-10-08T19:29:10.595516+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:07.710367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:07.710367+0000","last_clean_scrub_stamp":"2021-10-08T19:28:07.710367+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0037557269999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":175,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.590982+0000","last_change":"2021-10-08T19:28:15.793288+0000","last_active":"2021-10-08T19:29:10.590982+0000","last_peered":"2021-10-08T19:29:10.590982+0000","last_clean":"2021-10-08T19:29:10.590982+0000","last_became_active":"2021-10-08T19:21:29.646491+0000","last_became_peered":"2021-10-08T19:21:29.646491+0000","last_unstale":"2021-10-08T19:29:10.590982+0000","last_undegraded":"2021-10-08T19:29:10.590982+0000","last_fullsized":"2021-10-08T19:29:10.590982+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:15.793206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:28:15.793206+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0049324570000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":135,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.627926+0000","last_change":"2021-10-08T19:25:14.588222+0000","last_active":"2021-10-08T19:29:10.627926+0000","last_peered":"2021-10-08T19:29:10.627926+0000","last_clean":"2021-10-08T19:29:10.627926+0000","last_became_active":"2021-10-08T19:25:14.587901+0000","last_became_peered":"2021-10-08T19:25:14.587901+0000","last_unstale":"2021-10-08T19:29:10.627926+0000","last_undegraded":"2021-10-08T19:29:10.627926+0000","last_fullsized":"2021-10-08T19:29:10.627926+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:09.177525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:09.177525+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.f","version":"222'5075","reported_seq":6357,"reported_epoch":222,"state":"active+clean","last_fresh":"2021-10-08T19:29:13.730513+0000","last_change":"2021-10-08T19:28:52.613103+0000","last_active":"2021-10-08T19:29:13.730513+0000","last_peered":"2021-10-08T19:29:13.730513+0000","last_clean":"2021-10-08T19:29:13.730513+0000","last_became_active":"2021-10-08T19:28:52.608885+0000","last_became_peered":"2021-10-08T19:28:52.608885+0000","last_unstale":"2021-10-08T19:29:13.730513+0000","last_undegraded":"2021-10-08T19:29:13.730513+0000","last_fullsized":"2021-10-08T19:29:13.730513+0000","mapping_epoch":212,"log_start":"188'900","ondisk_log_start":"188'900","created":182,"last_epoch_clean":213,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_clean_scrub_stamp":"2021-10-08T19:27:42.631354+0000","log_size":4175,"ondisk_log_size":4175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":332595200,"num_objects":5075,"num_object_clones":0,"num_object_copies":15225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5075,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5075,"num_write_kb":324800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":604,"num_bytes_recovered":39583744,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"90'130","reported_seq":311,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.596587+0000","last_change":"2021-10-08T19:29:06.631624+0000","last_active":"2021-10-08T19:29:10.596587+0000","last_peered":"2021-10-08T19:29:10.596587+0000","last_clean":"2021-10-08T19:29:10.596587+0000","last_became_active":"2021-10-08T19:29:06.630873+0000","last_became_peered":"2021-10-08T19:29:06.630873+0000","last_unstale":"2021-10-08T19:29:10.596587+0000","last_undegraded":"2021-10-08T19:29:10.596587+0000","last_fullsized":"2021-10-08T19:29:10.596587+0000","mapping_epoch":219,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":220,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.284249+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020087920000000001,"stat_sum":{"num_bytes":53670,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":28,"num_write":16,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":161009,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4],"acting":[2,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":125,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.601136+0000","last_change":"2021-10-08T19:28:04.346251+0000","last_active":"2021-10-08T19:29:10.601136+0000","last_peered":"2021-10-08T19:29:10.601136+0000","last_clean":"2021-10-08T19:29:10.601136+0000","last_became_active":"2021-10-08T19:24:25.095389+0000","last_became_peered":"2021-10-08T19:24:25.095389+0000","last_unstale":"2021-10-08T19:29:10.601136+0000","last_undegraded":"2021-10-08T19:29:10.601136+0000","last_fullsized":"2021-10-08T19:29:10.601136+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:04.346151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:28:04.346151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010868312999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"69'19","reported_seq":216,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.602999+0000","last_change":"2021-10-08T19:24:08.149331+0000","last_active":"2021-10-08T19:29:10.602999+0000","last_peered":"2021-10-08T19:29:10.602999+0000","last_clean":"2021-10-08T19:29:10.602999+0000","last_became_active":"2021-10-08T19:21:25.741812+0000","last_became_peered":"2021-10-08T19:21:25.741812+0000","last_unstale":"2021-10-08T19:29:10.602999+0000","last_undegraded":"2021-10-08T19:29:10.602999+0000","last_fullsized":"2021-10-08T19:29:10.602999+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'19","last_scrub_stamp":"2021-10-08T19:24:08.149225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:24:08.149225+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0082661220000000007,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"61'1","reported_seq":191,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.612680+0000","last_change":"2021-10-08T19:28:57.376270+0000","last_active":"2021-10-08T19:29:10.612680+0000","last_peered":"2021-10-08T19:29:10.612680+0000","last_clean":"2021-10-08T19:29:10.612680+0000","last_became_active":"2021-10-08T19:21:23.604258+0000","last_became_peered":"2021-10-08T19:21:23.604258+0000","last_unstale":"2021-10-08T19:29:10.612680+0000","last_undegraded":"2021-10-08T19:29:10.612680+0000","last_fullsized":"2021-10-08T19:29:10.612680+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'1","last_scrub_stamp":"2021-10-08T19:24:17.582063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:17.582063+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0043026640000000003,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":29,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.599483+0000","last_change":"2021-10-08T19:28:40.146183+0000","last_active":"2021-10-08T19:29:10.599483+0000","last_peered":"2021-10-08T19:29:10.599483+0000","last_clean":"2021-10-08T19:29:10.599483+0000","last_became_active":"2021-10-08T19:28:40.140876+0000","last_became_peered":"2021-10-08T19:28:40.140876+0000","last_unstale":"2021-10-08T19:29:10.599483+0000","last_undegraded":"2021-10-08T19:29:10.599483+0000","last_fullsized":"2021-10-08T19:29:10.599483+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:04.724061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:28:04.724061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001436805,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"70'5","reported_seq":29,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.594370+0000","last_change":"2021-10-08T19:28:40.151654+0000","last_active":"2021-10-08T19:29:10.594370+0000","last_peered":"2021-10-08T19:29:10.594370+0000","last_clean":"2021-10-08T19:29:10.594370+0000","last_became_active":"2021-10-08T19:28:40.150503+0000","last_became_peered":"2021-10-08T19:28:40.150503+0000","last_unstale":"2021-10-08T19:29:10.594370+0000","last_undegraded":"2021-10-08T19:29:10.594370+0000","last_fullsized":"2021-10-08T19:29:10.594370+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:22:48.239721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:48.239721+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":49,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.a","version":"222'5098","reported_seq":6953,"reported_epoch":222,"state":"active+clean","last_fresh":"2021-10-08T19:29:13.747760+0000","last_change":"2021-10-08T19:29:04.192151+0000","last_active":"2021-10-08T19:29:13.747760+0000","last_peered":"2021-10-08T19:29:13.747760+0000","last_clean":"2021-10-08T19:29:13.747760+0000","last_became_active":"2021-10-08T19:28:49.987637+0000","last_became_peered":"2021-10-08T19:28:49.987637+0000","last_unstale":"2021-10-08T19:29:13.747760+0000","last_undegraded":"2021-10-08T19:29:13.747760+0000","last_fullsized":"2021-10-08T19:29:13.747760+0000","mapping_epoch":209,"log_start":"187'911","ondisk_log_start":"187'911","created":182,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_clean_scrub_stamp":"2021-10-08T19:27:42.631354+0000","log_size":4187,"ondisk_log_size":4187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":334102528,"num_objects":5098,"num_object_clones":0,"num_object_copies":15294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5098,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5098,"num_write_kb":326272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":993,"num_bytes_recovered":65077248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"90'130","reported_seq":330,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.598239+0000","last_change":"2021-10-08T19:28:43.178684+0000","last_active":"2021-10-08T19:29:10.598239+0000","last_peered":"2021-10-08T19:29:10.598239+0000","last_clean":"2021-10-08T19:29:10.598239+0000","last_became_active":"2021-10-08T19:28:43.178371+0000","last_became_peered":"2021-10-08T19:28:43.178371+0000","last_unstale":"2021-10-08T19:29:10.598239+0000","last_undegraded":"2021-10-08T19:29:10.598239+0000","last_fullsized":"2021-10-08T19:29:10.598239+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.284249+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020087920000000001,"stat_sum":{"num_bytes":53670,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":28,"num_write":17,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":161010,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":195,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.603896+0000","last_change":"2021-10-08T19:28:40.138302+0000","last_active":"2021-10-08T19:29:10.603896+0000","last_peered":"2021-10-08T19:29:10.603896+0000","last_clean":"2021-10-08T19:29:10.603896+0000","last_became_active":"2021-10-08T19:28:40.138010+0000","last_became_peered":"2021-10-08T19:28:40.138010+0000","last_unstale":"2021-10-08T19:29:10.603896+0000","last_undegraded":"2021-10-08T19:29:10.603896+0000","last_fullsized":"2021-10-08T19:29:10.603896+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:41.487627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:41.487627+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003650445,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"69'12","reported_seq":240,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.607374+0000","last_change":"2021-10-08T19:28:48.358081+0000","last_active":"2021-10-08T19:29:10.607374+0000","last_peered":"2021-10-08T19:29:10.607374+0000","last_clean":"2021-10-08T19:29:10.607374+0000","last_became_active":"2021-10-08T19:28:40.133150+0000","last_became_peered":"2021-10-08T19:28:40.133150+0000","last_unstale":"2021-10-08T19:29:10.607374+0000","last_undegraded":"2021-10-08T19:29:10.607374+0000","last_fullsized":"2021-10-08T19:29:10.607374+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'12","last_scrub_stamp":"2021-10-08T19:22:55.639881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:55.639881+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0032422169999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":163,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.592668+0000","last_change":"2021-10-08T19:29:01.300197+0000","last_active":"2021-10-08T19:29:10.592668+0000","last_peered":"2021-10-08T19:29:10.592668+0000","last_clean":"2021-10-08T19:29:10.592668+0000","last_became_active":"2021-10-08T19:28:40.140231+0000","last_became_peered":"2021-10-08T19:28:40.140231+0000","last_unstale":"2021-10-08T19:29:10.592668+0000","last_undegraded":"2021-10-08T19:29:10.592668+0000","last_fullsized":"2021-10-08T19:29:10.592668+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:04.888825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:32.922694+0000","last_clean_scrub_stamp":"2021-10-08T19:24:04.888825+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0052928530000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":200,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.601784+0000","last_change":"2021-10-08T19:25:14.571042+0000","last_active":"2021-10-08T19:29:10.601784+0000","last_peered":"2021-10-08T19:29:10.601784+0000","last_clean":"2021-10-08T19:29:10.601784+0000","last_became_active":"2021-10-08T19:25:14.570716+0000","last_became_peered":"2021-10-08T19:25:14.570716+0000","last_unstale":"2021-10-08T19:29:10.601784+0000","last_undegraded":"2021-10-08T19:29:10.601784+0000","last_fullsized":"2021-10-08T19:29:10.601784+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:09.177525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:09.177525+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0090469920000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":29,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.594061+0000","last_change":"2021-10-08T19:28:40.151801+0000","last_active":"2021-10-08T19:29:10.594061+0000","last_peered":"2021-10-08T19:29:10.594061+0000","last_clean":"2021-10-08T19:29:10.594061+0000","last_became_active":"2021-10-08T19:28:40.150915+0000","last_became_peered":"2021-10-08T19:28:40.150915+0000","last_unstale":"2021-10-08T19:29:10.594061+0000","last_undegraded":"2021-10-08T19:29:10.594061+0000","last_fullsized":"2021-10-08T19:29:10.594061+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:39.543005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:39.543005+0000","last_clean_scrub_stamp":"2021-10-08T19:27:39.543005+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"222'5035","reported_seq":5083,"reported_epoch":222,"state":"active+clean","last_fresh":"2021-10-08T19:29:13.507737+0000","last_change":"2021-10-08T19:27:43.655434+0000","last_active":"2021-10-08T19:29:13.507737+0000","last_peered":"2021-10-08T19:29:13.507737+0000","last_clean":"2021-10-08T19:29:13.507737+0000","last_became_active":"2021-10-08T19:27:43.655172+0000","last_became_peered":"2021-10-08T19:27:43.655172+0000","last_unstale":"2021-10-08T19:29:13.507737+0000","last_undegraded":"2021-10-08T19:29:13.507737+0000","last_fullsized":"2021-10-08T19:29:13.507737+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_clean_scrub_stamp":"2021-10-08T19:27:42.631354+0000","log_size":5035,"ondisk_log_size":5035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":329973760,"num_objects":5035,"num_object_clones":0,"num_object_copies":15105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5035,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5035,"num_write_kb":322240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":178,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.612135+0000","last_change":"2021-10-08T19:28:03.456643+0000","last_active":"2021-10-08T19:29:10.612135+0000","last_peered":"2021-10-08T19:29:10.612135+0000","last_clean":"2021-10-08T19:29:10.612135+0000","last_became_active":"2021-10-08T19:21:27.636086+0000","last_became_peered":"2021-10-08T19:21:27.636086+0000","last_unstale":"2021-10-08T19:29:10.612135+0000","last_undegraded":"2021-10-08T19:29:10.612135+0000","last_fullsized":"2021-10-08T19:29:10.612135+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:03.456570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:28:03.456570+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0035030170000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"69'14","reported_seq":141,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.603285+0000","last_change":"2021-10-08T19:28:12.445917+0000","last_active":"2021-10-08T19:29:10.603285+0000","last_peered":"2021-10-08T19:29:10.603285+0000","last_clean":"2021-10-08T19:29:10.603285+0000","last_became_active":"2021-10-08T19:24:25.100384+0000","last_became_peered":"2021-10-08T19:24:25.100384+0000","last_unstale":"2021-10-08T19:29:10.603285+0000","last_undegraded":"2021-10-08T19:29:10.603285+0000","last_fullsized":"2021-10-08T19:29:10.603285+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'14","last_scrub_stamp":"2021-10-08T19:28:12.445838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:28:12.445838+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0022764790000000001,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":24,"num_read_kb":14,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"90'130","reported_seq":489,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.609823+0000","last_change":"2021-10-08T19:27:22.607667+0000","last_active":"2021-10-08T19:29:10.609823+0000","last_peered":"2021-10-08T19:29:10.609823+0000","last_clean":"2021-10-08T19:29:10.609823+0000","last_became_active":"2021-10-08T19:27:22.607289+0000","last_became_peered":"2021-10-08T19:27:22.607289+0000","last_unstale":"2021-10-08T19:29:10.609823+0000","last_undegraded":"2021-10-08T19:29:10.609823+0000","last_fullsized":"2021-10-08T19:29:10.609823+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.284249+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0045617870000000003,"stat_sum":{"num_bytes":53669,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":27,"num_write":16,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":268349,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":181,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.603524+0000","last_change":"2021-10-08T19:28:02.942168+0000","last_active":"2021-10-08T19:29:10.603524+0000","last_peered":"2021-10-08T19:29:10.603524+0000","last_clean":"2021-10-08T19:29:10.603524+0000","last_became_active":"2021-10-08T19:21:23.599143+0000","last_became_peered":"2021-10-08T19:21:23.599143+0000","last_unstale":"2021-10-08T19:29:10.603524+0000","last_undegraded":"2021-10-08T19:29:10.603524+0000","last_fullsized":"2021-10-08T19:29:10.603524+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:02.942080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:28:02.942080+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0056165080000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":211,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.623647+0000","last_change":"2021-10-08T19:25:14.565749+0000","last_active":"2021-10-08T19:29:10.623647+0000","last_peered":"2021-10-08T19:29:10.623647+0000","last_clean":"2021-10-08T19:29:10.623647+0000","last_became_active":"2021-10-08T19:25:14.565479+0000","last_became_peered":"2021-10-08T19:25:14.565479+0000","last_unstale":"2021-10-08T19:29:10.623647+0000","last_undegraded":"2021-10-08T19:29:10.623647+0000","last_fullsized":"2021-10-08T19:29:10.623647+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:40.563247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.563247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.024890005999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":175,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.603970+0000","last_change":"2021-10-08T19:28:01.982447+0000","last_active":"2021-10-08T19:29:10.603970+0000","last_peered":"2021-10-08T19:29:10.603970+0000","last_clean":"2021-10-08T19:29:10.603970+0000","last_became_active":"2021-10-08T19:21:29.646242+0000","last_became_peered":"2021-10-08T19:21:29.646242+0000","last_unstale":"2021-10-08T19:29:10.603970+0000","last_undegraded":"2021-10-08T19:29:10.603970+0000","last_fullsized":"2021-10-08T19:29:10.603970+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:01.982319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:28:01.982319+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.023009359,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"222'4952","reported_seq":5876,"reported_epoch":222,"state":"active+recovering+undersized+remapped","last_fresh":"2021-10-08T19:29:13.622006+0000","last_change":"2021-10-08T19:28:50.731477+0000","last_active":"2021-10-08T19:29:13.622006+0000","last_peered":"2021-10-08T19:29:13.622006+0000","last_clean":"2021-10-08T19:28:22.610650+0000","last_became_active":"2021-10-08T19:28:40.234440+0000","last_became_peered":"2021-10-08T19:28:40.234440+0000","last_unstale":"2021-10-08T19:29:13.622006+0000","last_undegraded":"2021-10-08T19:29:13.622006+0000","last_fullsized":"2021-10-08T19:28:40.079170+0000","mapping_epoch":202,"log_start":"187'800","ondisk_log_start":"187'800","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_clean_scrub_stamp":"2021-10-08T19:27:42.631354+0000","log_size":4152,"ondisk_log_size":4152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":324534272,"num_objects":4952,"num_object_clones":0,"num_object_copies":14856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":312,"num_objects_unfound":0,"num_objects_dirty":4952,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4952,"num_write_kb":316928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":429,"num_bytes_recovered":28114944,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4],"avail_no_missing":["3","4"],"object_location_counts":[{"shards":"2,3,4","objects":312},{"shards":"3,4","objects":4640}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"90'130","reported_seq":497,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.608503+0000","last_change":"2021-10-08T19:27:26.591674+0000","last_active":"2021-10-08T19:29:10.608503+0000","last_peered":"2021-10-08T19:29:10.608503+0000","last_clean":"2021-10-08T19:29:10.608503+0000","last_became_active":"2021-10-08T19:27:26.591250+0000","last_became_peered":"2021-10-08T19:27:26.591250+0000","last_unstale":"2021-10-08T19:29:10.608503+0000","last_undegraded":"2021-10-08T19:29:10.608503+0000","last_fullsized":"2021-10-08T19:29:10.608503+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.284249+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0045617870000000003,"stat_sum":{"num_bytes":53670,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":28,"num_write":17,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":268349,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":174,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.596952+0000","last_change":"2021-10-08T19:28:53.238807+0000","last_active":"2021-10-08T19:29:10.596952+0000","last_peered":"2021-10-08T19:29:10.596952+0000","last_clean":"2021-10-08T19:29:10.596952+0000","last_became_active":"2021-10-08T19:21:27.637875+0000","last_became_peered":"2021-10-08T19:21:27.637875+0000","last_unstale":"2021-10-08T19:29:10.596952+0000","last_undegraded":"2021-10-08T19:29:10.596952+0000","last_fullsized":"2021-10-08T19:29:10.596952+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:06.487723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:06.487723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034218619999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"69'13","reported_seq":41,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.595519+0000","last_change":"2021-10-08T19:28:41.950802+0000","last_active":"2021-10-08T19:29:10.595519+0000","last_peered":"2021-10-08T19:29:10.595519+0000","last_clean":"2021-10-08T19:29:10.595519+0000","last_became_active":"2021-10-08T19:28:40.192932+0000","last_became_peered":"2021-10-08T19:28:40.192932+0000","last_unstale":"2021-10-08T19:29:10.595519+0000","last_undegraded":"2021-10-08T19:29:10.595519+0000","last_fullsized":"2021-10-08T19:29:10.595519+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'13","last_scrub_stamp":"2021-10-08T19:24:08.192428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:24:08.192428+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":18,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":182,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.592647+0000","last_change":"2021-10-08T19:24:21.997890+0000","last_active":"2021-10-08T19:29:10.592647+0000","last_peered":"2021-10-08T19:29:10.592647+0000","last_clean":"2021-10-08T19:29:10.592647+0000","last_became_active":"2021-10-08T19:21:23.602967+0000","last_became_peered":"2021-10-08T19:21:23.602967+0000","last_unstale":"2021-10-08T19:29:10.592647+0000","last_undegraded":"2021-10-08T19:29:10.592647+0000","last_fullsized":"2021-10-08T19:29:10.592647+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:21.997791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:21.997791+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0069284359999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"70'5","reported_seq":29,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.595129+0000","last_change":"2021-10-08T19:28:40.152388+0000","last_active":"2021-10-08T19:29:10.595129+0000","last_peered":"2021-10-08T19:29:10.595129+0000","last_clean":"2021-10-08T19:29:10.595129+0000","last_became_active":"2021-10-08T19:28:40.148054+0000","last_became_peered":"2021-10-08T19:28:40.148054+0000","last_unstale":"2021-10-08T19:29:10.595129+0000","last_undegraded":"2021-10-08T19:29:10.595129+0000","last_fullsized":"2021-10-08T19:29:10.595129+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:22:48.239721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:48.239721+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":48,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":194,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.612621+0000","last_change":"2021-10-08T19:28:14.485376+0000","last_active":"2021-10-08T19:29:10.612621+0000","last_peered":"2021-10-08T19:29:10.612621+0000","last_clean":"2021-10-08T19:29:10.612621+0000","last_became_active":"2021-10-08T19:24:25.095748+0000","last_became_peered":"2021-10-08T19:24:25.095748+0000","last_unstale":"2021-10-08T19:29:10.612621+0000","last_undegraded":"2021-10-08T19:29:10.612621+0000","last_fullsized":"2021-10-08T19:29:10.612621+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:14.485264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:28:14.485264+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.016729131000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.8","version":"222'5230","reported_seq":5278,"reported_epoch":222,"state":"active+clean","last_fresh":"2021-10-08T19:29:13.456256+0000","last_change":"2021-10-08T19:27:43.727224+0000","last_active":"2021-10-08T19:29:13.456256+0000","last_peered":"2021-10-08T19:29:13.456256+0000","last_clean":"2021-10-08T19:29:13.456256+0000","last_became_active":"2021-10-08T19:27:43.726942+0000","last_became_peered":"2021-10-08T19:27:43.726942+0000","last_unstale":"2021-10-08T19:29:13.456256+0000","last_undegraded":"2021-10-08T19:29:13.456256+0000","last_fullsized":"2021-10-08T19:29:13.456256+0000","mapping_epoch":182,"log_start":"187'700","ondisk_log_start":"187'700","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_clean_scrub_stamp":"2021-10-08T19:27:42.631354+0000","log_size":4530,"ondisk_log_size":4530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":342753280,"num_objects":5230,"num_object_clones":0,"num_object_copies":15690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5230,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5230,"num_write_kb":334720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"90'130","reported_seq":357,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.602664+0000","last_change":"2021-10-08T19:27:26.592352+0000","last_active":"2021-10-08T19:29:10.602664+0000","last_peered":"2021-10-08T19:29:10.602664+0000","last_clean":"2021-10-08T19:29:10.602664+0000","last_became_active":"2021-10-08T19:27:26.591993+0000","last_became_peered":"2021-10-08T19:27:26.591993+0000","last_unstale":"2021-10-08T19:29:10.602664+0000","last_undegraded":"2021-10-08T19:29:10.602664+0000","last_fullsized":"2021-10-08T19:29:10.602664+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.284249+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020087920000000001,"stat_sum":{"num_bytes":53670,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":28,"num_write":17,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":161010,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,2],"acting":[5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":192,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.604203+0000","last_change":"2021-10-08T19:28:50.291476+0000","last_active":"2021-10-08T19:29:10.604203+0000","last_peered":"2021-10-08T19:29:10.604203+0000","last_clean":"2021-10-08T19:29:10.604203+0000","last_became_active":"2021-10-08T19:28:40.133414+0000","last_became_peered":"2021-10-08T19:28:40.133414+0000","last_unstale":"2021-10-08T19:29:10.604203+0000","last_undegraded":"2021-10-08T19:29:10.604203+0000","last_fullsized":"2021-10-08T19:29:10.604203+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:03.638920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:03.638920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0016933230000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"203'30","reported_seq":59,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:11.813076+0000","last_change":"2021-10-08T19:28:40.225194+0000","last_active":"2021-10-08T19:29:11.813076+0000","last_peered":"2021-10-08T19:29:11.813076+0000","last_clean":"2021-10-08T19:29:11.813076+0000","last_became_active":"2021-10-08T19:28:40.129026+0000","last_became_peered":"2021-10-08T19:28:40.129026+0000","last_unstale":"2021-10-08T19:29:11.813076+0000","last_undegraded":"2021-10-08T19:29:11.813076+0000","last_fullsized":"2021-10-08T19:29:11.813076+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'28","last_scrub_stamp":"2021-10-08T19:24:18.179708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:24:18.179708+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":47,"num_read_kb":32,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":217,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.607263+0000","last_change":"2021-10-08T19:28:40.138241+0000","last_active":"2021-10-08T19:29:10.607263+0000","last_peered":"2021-10-08T19:29:10.607263+0000","last_clean":"2021-10-08T19:29:10.607263+0000","last_became_active":"2021-10-08T19:28:40.137919+0000","last_became_peered":"2021-10-08T19:28:40.137919+0000","last_unstale":"2021-10-08T19:29:10.607263+0000","last_undegraded":"2021-10-08T19:29:10.607263+0000","last_fullsized":"2021-10-08T19:29:10.607263+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:38.072667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:27:38.072667+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0013248769999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":169,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.624659+0000","last_change":"2021-10-08T19:23:25.378511+0000","last_active":"2021-10-08T19:29:10.624659+0000","last_peered":"2021-10-08T19:29:10.624659+0000","last_clean":"2021-10-08T19:29:10.624659+0000","last_became_active":"2021-10-08T19:21:29.647403+0000","last_became_peered":"2021-10-08T19:21:29.647403+0000","last_unstale":"2021-10-08T19:29:10.624659+0000","last_undegraded":"2021-10-08T19:29:10.624659+0000","last_fullsized":"2021-10-08T19:29:10.624659+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:25.378429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:25.378429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0050198400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":144,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.589587+0000","last_change":"2021-10-08T19:25:14.550996+0000","last_active":"2021-10-08T19:29:10.589587+0000","last_peered":"2021-10-08T19:29:10.589587+0000","last_clean":"2021-10-08T19:29:10.589587+0000","last_became_active":"2021-10-08T19:25:14.550690+0000","last_became_peered":"2021-10-08T19:25:14.550690+0000","last_unstale":"2021-10-08T19:29:10.589587+0000","last_undegraded":"2021-10-08T19:29:10.589587+0000","last_fullsized":"2021-10-08T19:29:10.589587+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:09.177525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:09.177525+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"222'5161","reported_seq":5209,"reported_epoch":222,"state":"active+clean","last_fresh":"2021-10-08T19:29:13.770628+0000","last_change":"2021-10-08T19:27:43.660274+0000","last_active":"2021-10-08T19:29:13.770628+0000","last_peered":"2021-10-08T19:29:13.770628+0000","last_clean":"2021-10-08T19:29:13.770628+0000","last_became_active":"2021-10-08T19:27:43.659455+0000","last_became_peered":"2021-10-08T19:27:43.659455+0000","last_unstale":"2021-10-08T19:29:13.770628+0000","last_undegraded":"2021-10-08T19:29:13.770628+0000","last_fullsized":"2021-10-08T19:29:13.770628+0000","mapping_epoch":182,"log_start":"187'300","ondisk_log_start":"187'300","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_clean_scrub_stamp":"2021-10-08T19:27:42.631354+0000","log_size":4861,"ondisk_log_size":4861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":338231296,"num_objects":5161,"num_object_clones":0,"num_object_copies":15483,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5161,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5161,"num_write_kb":330304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"90'130","reported_seq":420,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.602543+0000","last_change":"2021-10-08T19:27:26.598625+0000","last_active":"2021-10-08T19:29:10.602543+0000","last_peered":"2021-10-08T19:29:10.602543+0000","last_clean":"2021-10-08T19:29:10.602543+0000","last_became_active":"2021-10-08T19:27:26.598245+0000","last_became_peered":"2021-10-08T19:27:26.598245+0000","last_unstale":"2021-10-08T19:29:10.602543+0000","last_undegraded":"2021-10-08T19:29:10.602543+0000","last_fullsized":"2021-10-08T19:29:10.602543+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.284249+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0045617870000000003,"stat_sum":{"num_bytes":53670,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":28,"num_write":16,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":214679,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"114'10","reported_seq":307,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:11.815735+0000","last_change":"2021-10-08T19:24:25.551891+0000","last_active":"2021-10-08T19:29:11.815735+0000","last_peered":"2021-10-08T19:29:11.815735+0000","last_clean":"2021-10-08T19:29:11.815735+0000","last_became_active":"2021-10-08T19:24:25.106695+0000","last_became_peered":"2021-10-08T19:24:25.106695+0000","last_unstale":"2021-10-08T19:29:11.815735+0000","last_undegraded":"2021-10-08T19:29:11.815735+0000","last_fullsized":"2021-10-08T19:29:11.815735+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'9","last_scrub_stamp":"2021-10-08T19:24:04.193898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:04.193898+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0022019909999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"69'10","reported_seq":41,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.596044+0000","last_change":"2021-10-08T19:28:40.212123+0000","last_active":"2021-10-08T19:29:10.596044+0000","last_peered":"2021-10-08T19:29:10.596044+0000","last_clean":"2021-10-08T19:29:10.596044+0000","last_became_active":"2021-10-08T19:28:40.145524+0000","last_became_peered":"2021-10-08T19:28:40.145524+0000","last_unstale":"2021-10-08T19:29:10.596044+0000","last_undegraded":"2021-10-08T19:29:10.596044+0000","last_fullsized":"2021-10-08T19:29:10.596044+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'10","last_scrub_stamp":"2021-10-08T19:24:17.162525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:24:17.162525+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.594151+0000","last_change":"2021-10-08T19:28:40.151489+0000","last_active":"2021-10-08T19:29:10.594151+0000","last_peered":"2021-10-08T19:29:10.594151+0000","last_clean":"2021-10-08T19:29:10.594151+0000","last_became_active":"2021-10-08T19:28:40.141737+0000","last_became_peered":"2021-10-08T19:28:40.141737+0000","last_unstale":"2021-10-08T19:29:10.594151+0000","last_undegraded":"2021-10-08T19:29:10.594151+0000","last_fullsized":"2021-10-08T19:29:10.594151+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:11.227079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:11.227079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":176,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.602246+0000","last_change":"2021-10-08T19:27:38.333212+0000","last_active":"2021-10-08T19:29:10.602246+0000","last_peered":"2021-10-08T19:29:10.602246+0000","last_clean":"2021-10-08T19:29:10.602246+0000","last_became_active":"2021-10-08T19:21:29.649735+0000","last_became_peered":"2021-10-08T19:21:29.649735+0000","last_unstale":"2021-10-08T19:29:10.602246+0000","last_undegraded":"2021-10-08T19:29:10.602246+0000","last_fullsized":"2021-10-08T19:29:10.602246+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:38.333135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:27:38.333135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.006947773,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":139,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.604578+0000","last_change":"2021-10-08T19:25:14.562179+0000","last_active":"2021-10-08T19:29:10.604578+0000","last_peered":"2021-10-08T19:29:10.604578+0000","last_clean":"2021-10-08T19:29:10.604578+0000","last_became_active":"2021-10-08T19:25:14.561850+0000","last_became_peered":"2021-10-08T19:25:14.561850+0000","last_unstale":"2021-10-08T19:29:10.604578+0000","last_undegraded":"2021-10-08T19:29:10.604578+0000","last_fullsized":"2021-10-08T19:29:10.604578+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:17.379559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:17.379559+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0052805589999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.5","version":"222'5054","reported_seq":5102,"reported_epoch":222,"state":"active+clean","last_fresh":"2021-10-08T19:29:13.506372+0000","last_change":"2021-10-08T19:27:43.728370+0000","last_active":"2021-10-08T19:29:13.506372+0000","last_peered":"2021-10-08T19:29:13.506372+0000","last_clean":"2021-10-08T19:29:13.506372+0000","last_became_active":"2021-10-08T19:27:43.728067+0000","last_became_peered":"2021-10-08T19:27:43.728067+0000","last_unstale":"2021-10-08T19:29:13.506372+0000","last_undegraded":"2021-10-08T19:29:13.506372+0000","last_fullsized":"2021-10-08T19:29:13.506372+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:42.631354+0000","last_clean_scrub_stamp":"2021-10-08T19:27:42.631354+0000","log_size":5054,"ondisk_log_size":5054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":331218944,"num_objects":5054,"num_object_clones":0,"num_object_copies":15162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5054,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5054,"num_write_kb":323456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":196,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.592496+0000","last_change":"2021-10-08T19:28:40.140272+0000","last_active":"2021-10-08T19:29:10.592496+0000","last_peered":"2021-10-08T19:29:10.592496+0000","last_clean":"2021-10-08T19:29:10.592496+0000","last_became_active":"2021-10-08T19:28:40.138726+0000","last_became_peered":"2021-10-08T19:28:40.138726+0000","last_unstale":"2021-10-08T19:29:10.592496+0000","last_undegraded":"2021-10-08T19:29:10.592496+0000","last_fullsized":"2021-10-08T19:29:10.592496+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:06.071819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:50.435552+0000","last_clean_scrub_stamp":"2021-10-08T19:28:06.071819+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0076036530000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"69'12","reported_seq":238,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.588538+0000","last_change":"2021-10-08T19:28:48.277300+0000","last_active":"2021-10-08T19:29:10.588538+0000","last_peered":"2021-10-08T19:29:10.588538+0000","last_clean":"2021-10-08T19:29:10.588538+0000","last_became_active":"2021-10-08T19:28:40.103392+0000","last_became_peered":"2021-10-08T19:28:40.103392+0000","last_unstale":"2021-10-08T19:29:10.588538+0000","last_undegraded":"2021-10-08T19:29:10.588538+0000","last_fullsized":"2021-10-08T19:29:10.588538+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'12","last_scrub_stamp":"2021-10-08T19:22:57.003641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:22:57.003641+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0041017010000000001,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"61'2","reported_seq":191,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.588753+0000","last_change":"2021-10-08T19:23:07.991466+0000","last_active":"2021-10-08T19:29:10.588753+0000","last_peered":"2021-10-08T19:29:10.588753+0000","last_clean":"2021-10-08T19:29:10.588753+0000","last_became_active":"2021-10-08T19:21:23.603614+0000","last_became_peered":"2021-10-08T19:21:23.603614+0000","last_unstale":"2021-10-08T19:29:10.588753+0000","last_undegraded":"2021-10-08T19:29:10.588753+0000","last_fullsized":"2021-10-08T19:29:10.588753+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'2","last_scrub_stamp":"2021-10-08T19:23:07.991388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:07.991388+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001614983,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":187,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.624227+0000","last_change":"2021-10-08T19:28:40.169260+0000","last_active":"2021-10-08T19:29:10.624227+0000","last_peered":"2021-10-08T19:29:10.624227+0000","last_clean":"2021-10-08T19:29:10.624227+0000","last_became_active":"2021-10-08T19:28:40.168753+0000","last_became_peered":"2021-10-08T19:28:40.168753+0000","last_unstale":"2021-10-08T19:29:10.624227+0000","last_undegraded":"2021-10-08T19:29:10.624227+0000","last_fullsized":"2021-10-08T19:29:10.624227+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:12.484818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:24:12.484818+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0047233090000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":117,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.614242+0000","last_change":"2021-10-08T19:28:40.101079+0000","last_active":"2021-10-08T19:29:10.614242+0000","last_peered":"2021-10-08T19:29:10.614242+0000","last_clean":"2021-10-08T19:29:10.614242+0000","last_became_active":"2021-10-08T19:28:40.100770+0000","last_became_peered":"2021-10-08T19:28:40.100770+0000","last_unstale":"2021-10-08T19:29:10.614242+0000","last_undegraded":"2021-10-08T19:29:10.614242+0000","last_fullsized":"2021-10-08T19:29:10.614242+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:40.563247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.563247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.024890005999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"69'9","reported_seq":192,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.607464+0000","last_change":"2021-10-08T19:28:53.277504+0000","last_active":"2021-10-08T19:29:10.607464+0000","last_peered":"2021-10-08T19:29:10.607464+0000","last_clean":"2021-10-08T19:29:10.607464+0000","last_became_active":"2021-10-08T19:21:25.743804+0000","last_became_peered":"2021-10-08T19:21:25.743804+0000","last_unstale":"2021-10-08T19:29:10.607464+0000","last_undegraded":"2021-10-08T19:29:10.607464+0000","last_fullsized":"2021-10-08T19:29:10.607464+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'9","last_scrub_stamp":"2021-10-08T19:23:00.644449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:00.644449+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0023246959999999998,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":202,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.592423+0000","last_change":"2021-10-08T19:28:58.273715+0000","last_active":"2021-10-08T19:29:10.592423+0000","last_peered":"2021-10-08T19:29:10.592423+0000","last_clean":"2021-10-08T19:29:10.592423+0000","last_became_active":"2021-10-08T19:28:40.139234+0000","last_became_peered":"2021-10-08T19:28:40.139234+0000","last_unstale":"2021-10-08T19:29:10.592423+0000","last_undegraded":"2021-10-08T19:29:10.592423+0000","last_fullsized":"2021-10-08T19:29:10.592423+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:36.618136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:36.618136+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0014720390000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":195,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.628205+0000","last_change":"2021-10-08T19:28:40.239134+0000","last_active":"2021-10-08T19:29:10.628205+0000","last_peered":"2021-10-08T19:29:10.628205+0000","last_clean":"2021-10-08T19:29:10.628205+0000","last_became_active":"2021-10-08T19:28:40.232321+0000","last_became_peered":"2021-10-08T19:28:40.232321+0000","last_unstale":"2021-10-08T19:29:10.628205+0000","last_undegraded":"2021-10-08T19:29:10.628205+0000","last_fullsized":"2021-10-08T19:29:10.628205+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:03.149594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:28:03.149594+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011094171,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":176,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.593432+0000","last_change":"2021-10-08T19:24:05.869865+0000","last_active":"2021-10-08T19:29:10.593432+0000","last_peered":"2021-10-08T19:29:10.593432+0000","last_clean":"2021-10-08T19:29:10.593432+0000","last_became_active":"2021-10-08T19:21:29.640674+0000","last_became_peered":"2021-10-08T19:21:29.640674+0000","last_unstale":"2021-10-08T19:29:10.593432+0000","last_undegraded":"2021-10-08T19:29:10.593432+0000","last_fullsized":"2021-10-08T19:29:10.593432+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:05.869774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:24:05.869774+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0041453820000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":101,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.610171+0000","last_change":"2021-10-08T19:28:46.389722+0000","last_active":"2021-10-08T19:29:10.610171+0000","last_peered":"2021-10-08T19:29:10.610171+0000","last_clean":"2021-10-08T19:29:10.610171+0000","last_became_active":"2021-10-08T19:25:15.501118+0000","last_became_peered":"2021-10-08T19:25:15.501118+0000","last_unstale":"2021-10-08T19:29:10.610171+0000","last_undegraded":"2021-10-08T19:29:10.610171+0000","last_fullsized":"2021-10-08T19:29:10.610171+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:09.177525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:09.177525+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0090469920000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"69'6","reported_seq":216,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.628122+0000","last_change":"2021-10-08T19:28:48.456149+0000","last_active":"2021-10-08T19:29:10.628122+0000","last_peered":"2021-10-08T19:29:10.628122+0000","last_clean":"2021-10-08T19:29:10.628122+0000","last_became_active":"2021-10-08T19:28:40.232755+0000","last_became_peered":"2021-10-08T19:28:40.232755+0000","last_unstale":"2021-10-08T19:29:10.628122+0000","last_undegraded":"2021-10-08T19:29:10.628122+0000","last_fullsized":"2021-10-08T19:29:10.628122+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'6","last_scrub_stamp":"2021-10-08T19:23:21.395390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:21.395390+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002416241,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":143,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.601553+0000","last_change":"2021-10-08T19:28:40.102224+0000","last_active":"2021-10-08T19:29:10.601553+0000","last_peered":"2021-10-08T19:29:10.601553+0000","last_clean":"2021-10-08T19:29:10.601553+0000","last_became_active":"2021-10-08T19:28:40.101898+0000","last_became_peered":"2021-10-08T19:28:40.101898+0000","last_unstale":"2021-10-08T19:29:10.601553+0000","last_undegraded":"2021-10-08T19:29:10.601553+0000","last_fullsized":"2021-10-08T19:29:10.601553+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:16.444582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:16.444582+0000","last_clean_scrub_stamp":"2021-10-08T19:28:16.444582+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0044375919999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":195,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.603130+0000","last_change":"2021-10-08T19:28:40.104418+0000","last_active":"2021-10-08T19:29:10.603130+0000","last_peered":"2021-10-08T19:29:10.603130+0000","last_clean":"2021-10-08T19:29:10.603130+0000","last_became_active":"2021-10-08T19:28:40.103708+0000","last_became_peered":"2021-10-08T19:28:40.103708+0000","last_unstale":"2021-10-08T19:29:10.603130+0000","last_undegraded":"2021-10-08T19:29:10.603130+0000","last_fullsized":"2021-10-08T19:29:10.603130+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:22.361166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:22.361166+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011785238,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":200,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.612451+0000","last_change":"2021-10-08T19:28:15.480476+0000","last_active":"2021-10-08T19:29:10.612451+0000","last_peered":"2021-10-08T19:29:10.612451+0000","last_clean":"2021-10-08T19:29:10.612451+0000","last_became_active":"2021-10-08T19:24:25.099371+0000","last_became_peered":"2021-10-08T19:24:25.099371+0000","last_unstale":"2021-10-08T19:29:10.612451+0000","last_undegraded":"2021-10-08T19:29:10.612451+0000","last_fullsized":"2021-10-08T19:29:10.612451+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:15.480374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:28:15.480374+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0076754220000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"70'5","reported_seq":354,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.600327+0000","last_change":"2021-10-08T19:25:15.495111+0000","last_active":"2021-10-08T19:29:10.600327+0000","last_peered":"2021-10-08T19:29:10.600327+0000","last_clean":"2021-10-08T19:29:10.600327+0000","last_became_active":"2021-10-08T19:25:15.494766+0000","last_became_peered":"2021-10-08T19:25:15.494766+0000","last_unstale":"2021-10-08T19:29:10.600327+0000","last_undegraded":"2021-10-08T19:29:10.600327+0000","last_fullsized":"2021-10-08T19:29:10.600327+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:22:48.239721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:48.239721+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001618092,"stat_sum":{"num_bytes":49,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":19,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":49,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"69'10","reported_seq":170,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.593276+0000","last_change":"2021-10-08T19:28:41.377933+0000","last_active":"2021-10-08T19:29:10.593276+0000","last_peered":"2021-10-08T19:29:10.593276+0000","last_clean":"2021-10-08T19:29:10.593276+0000","last_became_active":"2021-10-08T19:28:40.139826+0000","last_became_peered":"2021-10-08T19:28:40.139826+0000","last_unstale":"2021-10-08T19:29:10.593276+0000","last_undegraded":"2021-10-08T19:29:10.593276+0000","last_fullsized":"2021-10-08T19:29:10.593276+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'10","last_scrub_stamp":"2021-10-08T19:28:03.073833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:28:03.073833+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0061927040000000003,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,7],"acting":[2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":181,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.607195+0000","last_change":"2021-10-08T19:24:23.338025+0000","last_active":"2021-10-08T19:29:10.607195+0000","last_peered":"2021-10-08T19:29:10.607195+0000","last_clean":"2021-10-08T19:29:10.607195+0000","last_became_active":"2021-10-08T19:21:23.603637+0000","last_became_peered":"2021-10-08T19:21:23.603637+0000","last_unstale":"2021-10-08T19:29:10.607195+0000","last_undegraded":"2021-10-08T19:29:10.607195+0000","last_fullsized":"2021-10-08T19:29:10.607195+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:23.337954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:23.337954+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0033141500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"203'10","reported_seq":306,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:11.813627+0000","last_change":"2021-10-08T19:28:40.246331+0000","last_active":"2021-10-08T19:29:11.813627+0000","last_peered":"2021-10-08T19:29:11.813627+0000","last_clean":"2021-10-08T19:29:11.813627+0000","last_became_active":"2021-10-08T19:28:40.138031+0000","last_became_peered":"2021-10-08T19:28:40.138031+0000","last_unstale":"2021-10-08T19:29:11.813627+0000","last_undegraded":"2021-10-08T19:29:11.813627+0000","last_fullsized":"2021-10-08T19:29:11.813627+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'8","last_scrub_stamp":"2021-10-08T19:24:10.319809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:10.319809+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0087040810000000007,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":172,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.607285+0000","last_change":"2021-10-08T19:28:59.285035+0000","last_active":"2021-10-08T19:29:10.607285+0000","last_peered":"2021-10-08T19:29:10.607285+0000","last_clean":"2021-10-08T19:29:10.607285+0000","last_became_active":"2021-10-08T19:21:29.646331+0000","last_became_peered":"2021-10-08T19:21:29.646331+0000","last_unstale":"2021-10-08T19:29:10.607285+0000","last_undegraded":"2021-10-08T19:29:10.607285+0000","last_fullsized":"2021-10-08T19:29:10.607285+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:11.535641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:11.535641+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001740417,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":105,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.610619+0000","last_change":"2021-10-08T19:28:16.470287+0000","last_active":"2021-10-08T19:29:10.610619+0000","last_peered":"2021-10-08T19:29:10.610619+0000","last_clean":"2021-10-08T19:29:10.610619+0000","last_became_active":"2021-10-08T19:25:15.498770+0000","last_became_peered":"2021-10-08T19:25:15.498770+0000","last_unstale":"2021-10-08T19:29:10.610619+0000","last_undegraded":"2021-10-08T19:29:10.610619+0000","last_fullsized":"2021-10-08T19:29:10.610619+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:16.470205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:28:16.470205+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0078687189999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"69'9","reported_seq":195,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.604501+0000","last_change":"2021-10-08T19:24:04.286963+0000","last_active":"2021-10-08T19:29:10.604501+0000","last_peered":"2021-10-08T19:29:10.604501+0000","last_clean":"2021-10-08T19:29:10.604501+0000","last_became_active":"2021-10-08T19:21:25.741755+0000","last_became_peered":"2021-10-08T19:21:25.741755+0000","last_unstale":"2021-10-08T19:29:10.604501+0000","last_undegraded":"2021-10-08T19:29:10.604501+0000","last_fullsized":"2021-10-08T19:29:10.604501+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'9","last_scrub_stamp":"2021-10-08T19:24:04.286857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:24:04.286857+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0047281429999999998,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":184,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.603119+0000","last_change":"2021-10-08T19:28:55.257500+0000","last_active":"2021-10-08T19:29:10.603119+0000","last_peered":"2021-10-08T19:29:10.603119+0000","last_clean":"2021-10-08T19:29:10.603119+0000","last_became_active":"2021-10-08T19:21:23.606478+0000","last_became_peered":"2021-10-08T19:21:23.606478+0000","last_unstale":"2021-10-08T19:29:10.603119+0000","last_undegraded":"2021-10-08T19:29:10.603119+0000","last_fullsized":"2021-10-08T19:29:10.603119+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:27.366934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:27.366934+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0016199809999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"69'8","reported_seq":279,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:11.812325+0000","last_change":"2021-10-08T19:24:16.547591+0000","last_active":"2021-10-08T19:29:11.812325+0000","last_peered":"2021-10-08T19:29:11.812325+0000","last_clean":"2021-10-08T19:29:11.812325+0000","last_became_active":"2021-10-08T19:21:27.636440+0000","last_became_peered":"2021-10-08T19:21:27.636440+0000","last_unstale":"2021-10-08T19:29:11.812325+0000","last_undegraded":"2021-10-08T19:29:11.812325+0000","last_fullsized":"2021-10-08T19:29:11.812325+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'8","last_scrub_stamp":"2021-10-08T19:24:16.547475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:16.547475+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0084390609999999994,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":169,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.588949+0000","last_change":"2021-10-08T19:22:49.049456+0000","last_active":"2021-10-08T19:29:10.588949+0000","last_peered":"2021-10-08T19:29:10.588949+0000","last_clean":"2021-10-08T19:29:10.588949+0000","last_became_active":"2021-10-08T19:21:29.640302+0000","last_became_peered":"2021-10-08T19:21:29.640302+0000","last_unstale":"2021-10-08T19:29:10.588949+0000","last_undegraded":"2021-10-08T19:29:10.588949+0000","last_fullsized":"2021-10-08T19:29:10.588949+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:49.049379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:22:49.049379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.00162856,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":99,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.603750+0000","last_change":"2021-10-08T19:25:15.502340+0000","last_active":"2021-10-08T19:29:10.603750+0000","last_peered":"2021-10-08T19:29:10.603750+0000","last_clean":"2021-10-08T19:29:10.603750+0000","last_became_active":"2021-10-08T19:25:15.502018+0000","last_became_peered":"2021-10-08T19:25:15.502018+0000","last_unstale":"2021-10-08T19:29:10.603750+0000","last_undegraded":"2021-10-08T19:29:10.603750+0000","last_fullsized":"2021-10-08T19:29:10.603750+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:40.563247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.563247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.024890005999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":101,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.612406+0000","last_change":"2021-10-08T19:28:47.348777+0000","last_active":"2021-10-08T19:29:10.612406+0000","last_peered":"2021-10-08T19:29:10.612406+0000","last_clean":"2021-10-08T19:29:10.612406+0000","last_became_active":"2021-10-08T19:25:15.504778+0000","last_became_peered":"2021-10-08T19:25:15.504778+0000","last_unstale":"2021-10-08T19:29:10.612406+0000","last_undegraded":"2021-10-08T19:29:10.612406+0000","last_fullsized":"2021-10-08T19:29:10.612406+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:17.379559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:17.379559+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0090469920000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"87'13","reported_seq":39,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.595769+0000","last_change":"2021-10-08T19:28:40.216943+0000","last_active":"2021-10-08T19:29:10.595769+0000","last_peered":"2021-10-08T19:29:10.595769+0000","last_clean":"2021-10-08T19:29:10.595769+0000","last_became_active":"2021-10-08T19:28:40.144845+0000","last_became_peered":"2021-10-08T19:28:40.144845+0000","last_unstale":"2021-10-08T19:29:10.595769+0000","last_undegraded":"2021-10-08T19:29:10.595769+0000","last_fullsized":"2021-10-08T19:29:10.595769+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'13","last_scrub_stamp":"2021-10-08T19:22:53.263631+0000","last_deep_scrub":"87'13","last_deep_scrub_stamp":"2021-10-08T19:22:53.263631+0000","last_clean_scrub_stamp":"2021-10-08T19:22:53.263631+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0036954140000000002,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":125,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.600482+0000","last_change":"2021-10-08T19:28:09.389916+0000","last_active":"2021-10-08T19:29:10.600482+0000","last_peered":"2021-10-08T19:29:10.600482+0000","last_clean":"2021-10-08T19:29:10.600482+0000","last_became_active":"2021-10-08T19:24:25.105096+0000","last_became_peered":"2021-10-08T19:24:25.105096+0000","last_unstale":"2021-10-08T19:29:10.600482+0000","last_undegraded":"2021-10-08T19:29:10.600482+0000","last_fullsized":"2021-10-08T19:29:10.600482+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:09.389812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:28:09.389812+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0046254870000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":189,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.624150+0000","last_change":"2021-10-08T19:28:40.169064+0000","last_active":"2021-10-08T19:29:10.624150+0000","last_peered":"2021-10-08T19:29:10.624150+0000","last_clean":"2021-10-08T19:29:10.624150+0000","last_became_active":"2021-10-08T19:28:40.168321+0000","last_became_peered":"2021-10-08T19:28:40.168321+0000","last_unstale":"2021-10-08T19:29:10.624150+0000","last_undegraded":"2021-10-08T19:29:10.624150+0000","last_fullsized":"2021-10-08T19:29:10.624150+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:28.367323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.367323+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034823359999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":190,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.602172+0000","last_change":"2021-10-08T19:28:52.326538+0000","last_active":"2021-10-08T19:29:10.602172+0000","last_peered":"2021-10-08T19:29:10.602172+0000","last_clean":"2021-10-08T19:29:10.602172+0000","last_became_active":"2021-10-08T19:28:40.133744+0000","last_became_peered":"2021-10-08T19:28:40.133744+0000","last_unstale":"2021-10-08T19:29:10.602172+0000","last_undegraded":"2021-10-08T19:29:10.602172+0000","last_fullsized":"2021-10-08T19:29:10.602172+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:02.605025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:02.605025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001265305,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"69'11","reported_seq":324,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.589570+0000","last_change":"2021-10-08T19:28:41.685298+0000","last_active":"2021-10-08T19:29:10.589570+0000","last_peered":"2021-10-08T19:29:10.589570+0000","last_clean":"2021-10-08T19:29:10.589570+0000","last_became_active":"2021-10-08T19:28:40.100196+0000","last_became_peered":"2021-10-08T19:28:40.100196+0000","last_unstale":"2021-10-08T19:29:10.589570+0000","last_undegraded":"2021-10-08T19:29:10.589570+0000","last_fullsized":"2021-10-08T19:29:10.589570+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'11","last_scrub_stamp":"2021-10-08T19:24:04.177847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:24:04.177847+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0047576429999999998,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":29,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.594936+0000","last_change":"2021-10-08T19:28:40.147869+0000","last_active":"2021-10-08T19:29:10.594936+0000","last_peered":"2021-10-08T19:29:10.594936+0000","last_clean":"2021-10-08T19:29:10.594936+0000","last_became_active":"2021-10-08T19:28:40.146673+0000","last_became_peered":"2021-10-08T19:28:40.146673+0000","last_unstale":"2021-10-08T19:29:10.594936+0000","last_undegraded":"2021-10-08T19:29:10.594936+0000","last_fullsized":"2021-10-08T19:29:10.594936+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:02.242462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:02.242462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.595948+0000","last_change":"2021-10-08T19:28:40.147113+0000","last_active":"2021-10-08T19:29:10.595948+0000","last_peered":"2021-10-08T19:29:10.595948+0000","last_clean":"2021-10-08T19:29:10.595948+0000","last_became_active":"2021-10-08T19:28:40.145983+0000","last_became_peered":"2021-10-08T19:28:40.145983+0000","last_unstale":"2021-10-08T19:29:10.595948+0000","last_undegraded":"2021-10-08T19:29:10.595948+0000","last_fullsized":"2021-10-08T19:29:10.595948+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:00.640354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:43.186684+0000","last_clean_scrub_stamp":"2021-10-08T19:28:00.640354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":175,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.622821+0000","last_change":"2021-10-08T19:28:10.199798+0000","last_active":"2021-10-08T19:29:10.622821+0000","last_peered":"2021-10-08T19:29:10.622821+0000","last_clean":"2021-10-08T19:29:10.622821+0000","last_became_active":"2021-10-08T19:21:29.649225+0000","last_became_peered":"2021-10-08T19:21:29.649225+0000","last_unstale":"2021-10-08T19:29:10.622821+0000","last_undegraded":"2021-10-08T19:29:10.622821+0000","last_fullsized":"2021-10-08T19:29:10.622821+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:10.199698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:28:10.199698+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.01642865,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"70'5","reported_seq":99,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.589966+0000","last_change":"2021-10-08T19:25:15.496726+0000","last_active":"2021-10-08T19:29:10.589966+0000","last_peered":"2021-10-08T19:29:10.589966+0000","last_clean":"2021-10-08T19:29:10.589966+0000","last_became_active":"2021-10-08T19:25:15.496309+0000","last_became_peered":"2021-10-08T19:25:15.496309+0000","last_unstale":"2021-10-08T19:29:10.589966+0000","last_undegraded":"2021-10-08T19:29:10.589966+0000","last_fullsized":"2021-10-08T19:29:10.589966+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:22:48.239721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:48.239721+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001618092,"stat_sum":{"num_bytes":49,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":19,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":49,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.10","version":"69'4","reported_seq":245,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.623436+0000","last_change":"2021-10-08T19:28:41.945340+0000","last_active":"2021-10-08T19:29:10.623436+0000","last_peered":"2021-10-08T19:29:10.623436+0000","last_clean":"2021-10-08T19:29:10.623436+0000","last_became_active":"2021-10-08T19:28:40.160138+0000","last_became_peered":"2021-10-08T19:28:40.160138+0000","last_unstale":"2021-10-08T19:29:10.623436+0000","last_undegraded":"2021-10-08T19:29:10.623436+0000","last_fullsized":"2021-10-08T19:29:10.623436+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'4","last_scrub_stamp":"2021-10-08T19:27:38.084136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:27:38.084136+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040040570000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":199,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.603313+0000","last_change":"2021-10-08T19:24:25.094735+0000","last_active":"2021-10-08T19:29:10.603313+0000","last_peered":"2021-10-08T19:29:10.603313+0000","last_clean":"2021-10-08T19:29:10.603313+0000","last_became_active":"2021-10-08T19:24:25.094384+0000","last_became_peered":"2021-10-08T19:24:25.094384+0000","last_unstale":"2021-10-08T19:29:10.603313+0000","last_undegraded":"2021-10-08T19:29:10.603313+0000","last_fullsized":"2021-10-08T19:29:10.603313+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:21.346014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:13.716331+0000","last_clean_scrub_stamp":"2021-10-08T19:24:21.346014+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0086210910000000009,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":125,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.601631+0000","last_change":"2021-10-08T19:28:06.373378+0000","last_active":"2021-10-08T19:29:10.601631+0000","last_peered":"2021-10-08T19:29:10.601631+0000","last_clean":"2021-10-08T19:29:10.601631+0000","last_became_active":"2021-10-08T19:24:25.106186+0000","last_became_peered":"2021-10-08T19:24:25.106186+0000","last_unstale":"2021-10-08T19:29:10.601631+0000","last_undegraded":"2021-10-08T19:29:10.601631+0000","last_fullsized":"2021-10-08T19:29:10.601631+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:06.373281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:28:06.373281+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001680923,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":178,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.611595+0000","last_change":"2021-10-08T19:28:52.327288+0000","last_active":"2021-10-08T19:29:10.611595+0000","last_peered":"2021-10-08T19:29:10.611595+0000","last_clean":"2021-10-08T19:29:10.611595+0000","last_became_active":"2021-10-08T19:21:29.642835+0000","last_became_peered":"2021-10-08T19:21:29.642835+0000","last_unstale":"2021-10-08T19:29:10.611595+0000","last_undegraded":"2021-10-08T19:29:10.611595+0000","last_fullsized":"2021-10-08T19:29:10.611595+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:18.542124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:24:18.542124+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0051790259999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":117,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.603054+0000","last_change":"2021-10-08T19:28:40.099565+0000","last_active":"2021-10-08T19:29:10.603054+0000","last_peered":"2021-10-08T19:29:10.603054+0000","last_clean":"2021-10-08T19:29:10.603054+0000","last_became_active":"2021-10-08T19:28:40.099215+0000","last_became_peered":"2021-10-08T19:28:40.099215+0000","last_unstale":"2021-10-08T19:29:10.603054+0000","last_undegraded":"2021-10-08T19:29:10.603054+0000","last_fullsized":"2021-10-08T19:29:10.603054+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:40.563247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.563247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.024890005999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"69'11","reported_seq":234,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.623231+0000","last_change":"2021-10-08T19:24:25.550057+0000","last_active":"2021-10-08T19:29:10.623231+0000","last_peered":"2021-10-08T19:29:10.623231+0000","last_clean":"2021-10-08T19:29:10.623231+0000","last_became_active":"2021-10-08T19:24:25.097676+0000","last_became_peered":"2021-10-08T19:24:25.097676+0000","last_unstale":"2021-10-08T19:29:10.623231+0000","last_undegraded":"2021-10-08T19:29:10.623231+0000","last_fullsized":"2021-10-08T19:29:10.623231+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'11","last_scrub_stamp":"2021-10-08T19:23:38.388959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:38.388959+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039620519999999998,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":125,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.602694+0000","last_change":"2021-10-08T19:28:15.451285+0000","last_active":"2021-10-08T19:29:10.602694+0000","last_peered":"2021-10-08T19:29:10.602694+0000","last_clean":"2021-10-08T19:29:10.602694+0000","last_became_active":"2021-10-08T19:24:25.098128+0000","last_became_peered":"2021-10-08T19:24:25.098128+0000","last_unstale":"2021-10-08T19:29:10.602694+0000","last_undegraded":"2021-10-08T19:29:10.602694+0000","last_fullsized":"2021-10-08T19:29:10.602694+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:15.451208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:34.508558+0000","last_clean_scrub_stamp":"2021-10-08T19:28:15.451208+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.005925647,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":196,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.609998+0000","last_change":"2021-10-08T19:28:11.383850+0000","last_active":"2021-10-08T19:29:10.609998+0000","last_peered":"2021-10-08T19:29:10.609998+0000","last_clean":"2021-10-08T19:29:10.609998+0000","last_became_active":"2021-10-08T19:24:25.095490+0000","last_became_peered":"2021-10-08T19:24:25.095490+0000","last_unstale":"2021-10-08T19:29:10.609998+0000","last_undegraded":"2021-10-08T19:29:10.609998+0000","last_fullsized":"2021-10-08T19:29:10.609998+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:11.383779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:11.383779+0000","last_clean_scrub_stamp":"2021-10-08T19:28:11.383779+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001362776,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":187,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.624326+0000","last_change":"2021-10-08T19:24:25.102165+0000","last_active":"2021-10-08T19:29:10.624326+0000","last_peered":"2021-10-08T19:29:10.624326+0000","last_clean":"2021-10-08T19:29:10.624326+0000","last_became_active":"2021-10-08T19:24:25.100477+0000","last_became_peered":"2021-10-08T19:24:25.100477+0000","last_unstale":"2021-10-08T19:29:10.624326+0000","last_undegraded":"2021-10-08T19:29:10.624326+0000","last_fullsized":"2021-10-08T19:29:10.624326+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:06.570853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:23:06.570853+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034079790000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"69'10","reported_seq":195,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.607675+0000","last_change":"2021-10-08T19:23:36.223620+0000","last_active":"2021-10-08T19:29:10.607675+0000","last_peered":"2021-10-08T19:29:10.607675+0000","last_clean":"2021-10-08T19:29:10.607675+0000","last_became_active":"2021-10-08T19:21:25.743519+0000","last_became_peered":"2021-10-08T19:21:25.743519+0000","last_unstale":"2021-10-08T19:29:10.607675+0000","last_undegraded":"2021-10-08T19:29:10.607675+0000","last_fullsized":"2021-10-08T19:29:10.607675+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'10","last_scrub_stamp":"2021-10-08T19:23:36.223545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:36.223545+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0023151259999999998,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":181,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.603677+0000","last_change":"2021-10-08T19:28:15.902997+0000","last_active":"2021-10-08T19:29:10.603677+0000","last_peered":"2021-10-08T19:29:10.603677+0000","last_clean":"2021-10-08T19:29:10.603677+0000","last_became_active":"2021-10-08T19:21:23.604530+0000","last_became_peered":"2021-10-08T19:21:23.604530+0000","last_unstale":"2021-10-08T19:29:10.603677+0000","last_undegraded":"2021-10-08T19:29:10.603677+0000","last_fullsized":"2021-10-08T19:29:10.603677+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:15.902892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:28:15.902892+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0029135179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1f","version":"114'10","reported_seq":181,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:11.811613+0000","last_change":"2021-10-08T19:24:25.122871+0000","last_active":"2021-10-08T19:29:11.811613+0000","last_peered":"2021-10-08T19:29:11.811613+0000","last_clean":"2021-10-08T19:29:11.811613+0000","last_became_active":"2021-10-08T19:24:25.105742+0000","last_became_peered":"2021-10-08T19:24:25.105742+0000","last_unstale":"2021-10-08T19:29:11.811613+0000","last_undegraded":"2021-10-08T19:29:11.811613+0000","last_fullsized":"2021-10-08T19:29:11.811613+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'9","last_scrub_stamp":"2021-10-08T19:24:07.171989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:07.171989+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"69'1","reported_seq":177,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.612259+0000","last_change":"2021-10-08T19:28:07.472350+0000","last_active":"2021-10-08T19:29:10.612259+0000","last_peered":"2021-10-08T19:29:10.612259+0000","last_clean":"2021-10-08T19:29:10.612259+0000","last_became_active":"2021-10-08T19:21:29.640296+0000","last_became_peered":"2021-10-08T19:21:29.640296+0000","last_unstale":"2021-10-08T19:29:10.612259+0000","last_undegraded":"2021-10-08T19:29:10.612259+0000","last_fullsized":"2021-10-08T19:29:10.612259+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2021-10-08T19:28:07.472230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:28:07.472230+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0056776029999999998,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"69'11","reported_seq":179,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.602935+0000","last_change":"2021-10-08T19:28:41.809089+0000","last_active":"2021-10-08T19:29:10.602935+0000","last_peered":"2021-10-08T19:29:10.602935+0000","last_clean":"2021-10-08T19:29:10.602935+0000","last_became_active":"2021-10-08T19:28:40.126425+0000","last_became_peered":"2021-10-08T19:28:40.126425+0000","last_unstale":"2021-10-08T19:29:10.602935+0000","last_undegraded":"2021-10-08T19:29:10.602935+0000","last_fullsized":"2021-10-08T19:29:10.602935+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'11","last_scrub_stamp":"2021-10-08T19:28:02.320591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:28:02.320591+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010992586,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":193,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.623000+0000","last_change":"2021-10-08T19:24:25.098061+0000","last_active":"2021-10-08T19:29:10.623000+0000","last_peered":"2021-10-08T19:29:10.623000+0000","last_clean":"2021-10-08T19:29:10.623000+0000","last_became_active":"2021-10-08T19:24:25.097164+0000","last_became_peered":"2021-10-08T19:24:25.097164+0000","last_unstale":"2021-10-08T19:29:10.623000+0000","last_undegraded":"2021-10-08T19:29:10.623000+0000","last_fullsized":"2021-10-08T19:29:10.623000+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:11.535464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:11.535464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012302489999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":178,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.607755+0000","last_change":"2021-10-08T19:24:13.178473+0000","last_active":"2021-10-08T19:29:10.607755+0000","last_peered":"2021-10-08T19:29:10.607755+0000","last_clean":"2021-10-08T19:29:10.607755+0000","last_became_active":"2021-10-08T19:21:27.632648+0000","last_became_peered":"2021-10-08T19:21:27.632648+0000","last_unstale":"2021-10-08T19:29:10.607755+0000","last_undegraded":"2021-10-08T19:29:10.607755+0000","last_fullsized":"2021-10-08T19:29:10.607755+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:13.178370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:13.178370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0056659290000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"69'1","reported_seq":33,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.595018+0000","last_change":"2021-10-08T19:28:40.385176+0000","last_active":"2021-10-08T19:29:10.595018+0000","last_peered":"2021-10-08T19:29:10.595018+0000","last_clean":"2021-10-08T19:29:10.595018+0000","last_became_active":"2021-10-08T19:28:40.146302+0000","last_became_peered":"2021-10-08T19:28:40.146302+0000","last_unstale":"2021-10-08T19:29:10.595018+0000","last_undegraded":"2021-10-08T19:29:10.595018+0000","last_fullsized":"2021-10-08T19:29:10.595018+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2021-10-08T19:28:06.691075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:28:06.691075+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"69'15","reported_seq":280,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.593953+0000","last_change":"2021-10-08T19:28:41.119119+0000","last_active":"2021-10-08T19:29:10.593953+0000","last_peered":"2021-10-08T19:29:10.593953+0000","last_clean":"2021-10-08T19:29:10.593953+0000","last_became_active":"2021-10-08T19:28:40.139564+0000","last_became_peered":"2021-10-08T19:28:40.139564+0000","last_unstale":"2021-10-08T19:29:10.593953+0000","last_undegraded":"2021-10-08T19:29:10.593953+0000","last_fullsized":"2021-10-08T19:29:10.593953+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'15","last_scrub_stamp":"2021-10-08T19:28:12.991370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:28:12.991370+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0082369120000000007,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":125,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.601210+0000","last_change":"2021-10-08T19:27:36.279020+0000","last_active":"2021-10-08T19:29:10.601210+0000","last_peered":"2021-10-08T19:29:10.601210+0000","last_clean":"2021-10-08T19:29:10.601210+0000","last_became_active":"2021-10-08T19:24:25.106119+0000","last_became_peered":"2021-10-08T19:24:25.106119+0000","last_unstale":"2021-10-08T19:29:10.601210+0000","last_undegraded":"2021-10-08T19:29:10.601210+0000","last_fullsized":"2021-10-08T19:29:10.601210+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:36.278905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:46.422866+0000","last_clean_scrub_stamp":"2021-10-08T19:27:36.278905+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0017473320000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.595100+0000","last_change":"2021-10-08T19:28:40.148340+0000","last_active":"2021-10-08T19:29:10.595100+0000","last_peered":"2021-10-08T19:29:10.595100+0000","last_clean":"2021-10-08T19:29:10.595100+0000","last_became_active":"2021-10-08T19:28:40.148009+0000","last_became_peered":"2021-10-08T19:28:40.148009+0000","last_unstale":"2021-10-08T19:29:10.595100+0000","last_undegraded":"2021-10-08T19:29:10.595100+0000","last_fullsized":"2021-10-08T19:29:10.595100+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:10.658350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:28:10.658350+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":193,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.588853+0000","last_change":"2021-10-08T19:27:37.219578+0000","last_active":"2021-10-08T19:29:10.588853+0000","last_peered":"2021-10-08T19:29:10.588853+0000","last_clean":"2021-10-08T19:29:10.588853+0000","last_became_active":"2021-10-08T19:24:25.097782+0000","last_became_peered":"2021-10-08T19:24:25.097782+0000","last_unstale":"2021-10-08T19:29:10.588853+0000","last_undegraded":"2021-10-08T19:29:10.588853+0000","last_fullsized":"2021-10-08T19:29:10.588853+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:37.219503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:37.219503+0000","last_clean_scrub_stamp":"2021-10-08T19:27:37.219503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0015176320000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"69'12","reported_seq":238,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.623970+0000","last_change":"2021-10-08T19:28:41.780470+0000","last_active":"2021-10-08T19:29:10.623970+0000","last_peered":"2021-10-08T19:29:10.623970+0000","last_clean":"2021-10-08T19:29:10.623970+0000","last_became_active":"2021-10-08T19:28:40.141668+0000","last_became_peered":"2021-10-08T19:28:40.141668+0000","last_unstale":"2021-10-08T19:29:10.623970+0000","last_undegraded":"2021-10-08T19:29:10.623970+0000","last_fullsized":"2021-10-08T19:29:10.623970+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'12","last_scrub_stamp":"2021-10-08T19:23:10.562820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:10.562820+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040692890000000002,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":199,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.624071+0000","last_change":"2021-10-08T19:28:14.247829+0000","last_active":"2021-10-08T19:29:10.624071+0000","last_peered":"2021-10-08T19:29:10.624071+0000","last_clean":"2021-10-08T19:29:10.624071+0000","last_became_active":"2021-10-08T19:24:25.096570+0000","last_became_peered":"2021-10-08T19:24:25.096570+0000","last_unstale":"2021-10-08T19:29:10.624071+0000","last_undegraded":"2021-10-08T19:29:10.624071+0000","last_fullsized":"2021-10-08T19:29:10.624071+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:14.247730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:28:14.247730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0076080999999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":177,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.590256+0000","last_change":"2021-10-08T19:24:13.289692+0000","last_active":"2021-10-08T19:29:10.590256+0000","last_peered":"2021-10-08T19:29:10.590256+0000","last_clean":"2021-10-08T19:29:10.590256+0000","last_became_active":"2021-10-08T19:21:27.635242+0000","last_became_peered":"2021-10-08T19:21:27.635242+0000","last_unstale":"2021-10-08T19:29:10.590256+0000","last_undegraded":"2021-10-08T19:29:10.590256+0000","last_fullsized":"2021-10-08T19:29:10.590256+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:13.289586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:13.289586+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0093791299999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":193,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.628022+0000","last_change":"2021-10-08T19:28:02.166595+0000","last_active":"2021-10-08T19:29:10.628022+0000","last_peered":"2021-10-08T19:29:10.628022+0000","last_clean":"2021-10-08T19:29:10.628022+0000","last_became_active":"2021-10-08T19:24:25.096419+0000","last_became_peered":"2021-10-08T19:24:25.096419+0000","last_unstale":"2021-10-08T19:29:10.628022+0000","last_undegraded":"2021-10-08T19:29:10.628022+0000","last_fullsized":"2021-10-08T19:29:10.628022+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:02.166534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:38.544673+0000","last_clean_scrub_stamp":"2021-10-08T19:28:02.166534+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.049118451,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"69'9","reported_seq":189,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.590683+0000","last_change":"2021-10-08T19:23:19.997379+0000","last_active":"2021-10-08T19:29:10.590683+0000","last_peered":"2021-10-08T19:29:10.590683+0000","last_clean":"2021-10-08T19:29:10.590683+0000","last_became_active":"2021-10-08T19:21:25.608263+0000","last_became_peered":"2021-10-08T19:21:25.608263+0000","last_unstale":"2021-10-08T19:29:10.590683+0000","last_undegraded":"2021-10-08T19:29:10.590683+0000","last_fullsized":"2021-10-08T19:29:10.590683+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'9","last_scrub_stamp":"2021-10-08T19:23:19.997296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:19.997296+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040259689999999999,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":184,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.611936+0000","last_change":"2021-10-08T19:28:59.369707+0000","last_active":"2021-10-08T19:29:10.611936+0000","last_peered":"2021-10-08T19:29:10.611936+0000","last_clean":"2021-10-08T19:29:10.611936+0000","last_became_active":"2021-10-08T19:21:23.607785+0000","last_became_peered":"2021-10-08T19:21:23.607785+0000","last_unstale":"2021-10-08T19:29:10.611936+0000","last_undegraded":"2021-10-08T19:29:10.611936+0000","last_fullsized":"2021-10-08T19:29:10.611936+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:15.574344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:15.574344+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0085919499999999992,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":177,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.603435+0000","last_change":"2021-10-08T19:28:04.929950+0000","last_active":"2021-10-08T19:29:10.603435+0000","last_peered":"2021-10-08T19:29:10.603435+0000","last_clean":"2021-10-08T19:29:10.603435+0000","last_became_active":"2021-10-08T19:21:27.633979+0000","last_became_peered":"2021-10-08T19:21:27.633979+0000","last_unstale":"2021-10-08T19:29:10.603435+0000","last_undegraded":"2021-10-08T19:29:10.603435+0000","last_fullsized":"2021-10-08T19:29:10.603435+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:04.929862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:05.799361+0000","last_clean_scrub_stamp":"2021-10-08T19:28:04.929862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.015926389999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":194,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.602632+0000","last_change":"2021-10-08T19:28:40.159565+0000","last_active":"2021-10-08T19:29:10.602632+0000","last_peered":"2021-10-08T19:29:10.602632+0000","last_clean":"2021-10-08T19:29:10.602632+0000","last_became_active":"2021-10-08T19:28:40.159162+0000","last_became_peered":"2021-10-08T19:28:40.159162+0000","last_unstale":"2021-10-08T19:29:10.602632+0000","last_undegraded":"2021-10-08T19:29:10.602632+0000","last_fullsized":"2021-10-08T19:29:10.602632+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:14.144450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:24:14.144450+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0032569320000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"69'5","reported_seq":213,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.589678+0000","last_change":"2021-10-08T19:28:48.449880+0000","last_active":"2021-10-08T19:29:10.589678+0000","last_peered":"2021-10-08T19:29:10.589678+0000","last_clean":"2021-10-08T19:29:10.589678+0000","last_became_active":"2021-10-08T19:28:40.121800+0000","last_became_peered":"2021-10-08T19:28:40.121800+0000","last_unstale":"2021-10-08T19:29:10.589678+0000","last_undegraded":"2021-10-08T19:29:10.589678+0000","last_fullsized":"2021-10-08T19:29:10.589678+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'5","last_scrub_stamp":"2021-10-08T19:23:17.993532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:23:17.993532+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040855580000000004,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":202,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.612545+0000","last_change":"2021-10-08T19:28:49.358095+0000","last_active":"2021-10-08T19:29:10.612545+0000","last_peered":"2021-10-08T19:29:10.612545+0000","last_clean":"2021-10-08T19:29:10.612545+0000","last_became_active":"2021-10-08T19:24:25.096225+0000","last_became_peered":"2021-10-08T19:24:25.096225+0000","last_unstale":"2021-10-08T19:29:10.612545+0000","last_undegraded":"2021-10-08T19:29:10.612545+0000","last_fullsized":"2021-10-08T19:29:10.612545+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:06.609550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:06.609550+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0037828580000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":198,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.611406+0000","last_change":"2021-10-08T19:28:53.367884+0000","last_active":"2021-10-08T19:29:10.611406+0000","last_peered":"2021-10-08T19:29:10.611406+0000","last_clean":"2021-10-08T19:29:10.611406+0000","last_became_active":"2021-10-08T19:28:40.101187+0000","last_became_peered":"2021-10-08T19:28:40.101187+0000","last_unstale":"2021-10-08T19:29:10.611406+0000","last_undegraded":"2021-10-08T19:29:10.611406+0000","last_fullsized":"2021-10-08T19:29:10.611406+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:20.517044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:20.517044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0053303969999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":193,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.603016+0000","last_change":"2021-10-08T19:28:40.099916+0000","last_active":"2021-10-08T19:29:10.603016+0000","last_peered":"2021-10-08T19:29:10.603016+0000","last_clean":"2021-10-08T19:29:10.603016+0000","last_became_active":"2021-10-08T19:28:40.099557+0000","last_became_peered":"2021-10-08T19:28:40.099557+0000","last_unstale":"2021-10-08T19:29:10.603016+0000","last_undegraded":"2021-10-08T19:29:10.603016+0000","last_fullsized":"2021-10-08T19:29:10.603016+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:14.882819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:28:14.882819+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.020979794,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"88'13","reported_seq":307,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.586942+0000","last_change":"2021-10-08T19:28:40.563266+0000","last_active":"2021-10-08T19:29:10.586942+0000","last_peered":"2021-10-08T19:29:10.586942+0000","last_clean":"2021-10-08T19:29:10.586942+0000","last_became_active":"2021-10-08T19:28:40.099770+0000","last_became_peered":"2021-10-08T19:28:40.099770+0000","last_unstale":"2021-10-08T19:29:10.586942+0000","last_undegraded":"2021-10-08T19:29:10.586942+0000","last_fullsized":"2021-10-08T19:29:10.586942+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'13","last_scrub_stamp":"2021-10-08T19:23:16.016646+0000","last_deep_scrub":"88'13","last_deep_scrub_stamp":"2021-10-08T19:23:16.016646+0000","last_clean_scrub_stamp":"2021-10-08T19:23:16.016646+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0052093469999999996,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":175,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.624584+0000","last_change":"2021-10-08T19:23:14.443220+0000","last_active":"2021-10-08T19:29:10.624584+0000","last_peered":"2021-10-08T19:29:10.624584+0000","last_clean":"2021-10-08T19:29:10.624584+0000","last_became_active":"2021-10-08T19:21:23.598272+0000","last_became_peered":"2021-10-08T19:21:23.598272+0000","last_unstale":"2021-10-08T19:29:10.624584+0000","last_undegraded":"2021-10-08T19:29:10.624584+0000","last_fullsized":"2021-10-08T19:29:10.624584+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:14.443147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:23:14.443147+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003489631,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":29,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.599669+0000","last_change":"2021-10-08T19:28:40.146371+0000","last_active":"2021-10-08T19:29:10.599669+0000","last_peered":"2021-10-08T19:29:10.599669+0000","last_clean":"2021-10-08T19:29:10.599669+0000","last_became_active":"2021-10-08T19:28:40.145868+0000","last_became_peered":"2021-10-08T19:28:40.145868+0000","last_unstale":"2021-10-08T19:29:10.599669+0000","last_undegraded":"2021-10-08T19:29:10.599669+0000","last_fullsized":"2021-10-08T19:29:10.599669+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:02.663022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:28:02.663022+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":187,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.590604+0000","last_change":"2021-10-08T19:28:40.099875+0000","last_active":"2021-10-08T19:29:10.590604+0000","last_peered":"2021-10-08T19:29:10.590604+0000","last_clean":"2021-10-08T19:29:10.590604+0000","last_became_active":"2021-10-08T19:28:40.099543+0000","last_became_peered":"2021-10-08T19:28:40.099543+0000","last_unstale":"2021-10-08T19:29:10.590604+0000","last_undegraded":"2021-10-08T19:29:10.590604+0000","last_fullsized":"2021-10-08T19:29:10.590604+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:50.032367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:50.032367+0000","last_clean_scrub_stamp":"2021-10-08T19:22:50.032367+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034102759999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"69'15","reported_seq":198,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.623314+0000","last_change":"2021-10-08T19:24:14.482657+0000","last_active":"2021-10-08T19:29:10.623314+0000","last_peered":"2021-10-08T19:29:10.623314+0000","last_clean":"2021-10-08T19:29:10.623314+0000","last_became_active":"2021-10-08T19:21:25.612873+0000","last_became_peered":"2021-10-08T19:21:25.612873+0000","last_unstale":"2021-10-08T19:29:10.623314+0000","last_undegraded":"2021-10-08T19:29:10.623314+0000","last_fullsized":"2021-10-08T19:29:10.623314+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'15","last_scrub_stamp":"2021-10-08T19:24:14.482511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:24:14.482511+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012310702999999999,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":182,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.604403+0000","last_change":"2021-10-08T19:28:15.535918+0000","last_active":"2021-10-08T19:29:10.604403+0000","last_peered":"2021-10-08T19:29:10.604403+0000","last_clean":"2021-10-08T19:29:10.604403+0000","last_became_active":"2021-10-08T19:21:23.603422+0000","last_became_peered":"2021-10-08T19:21:23.603422+0000","last_unstale":"2021-10-08T19:29:10.604403+0000","last_undegraded":"2021-10-08T19:29:10.604403+0000","last_fullsized":"2021-10-08T19:29:10.604403+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:15.535842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:15.535842+0000","last_clean_scrub_stamp":"2021-10-08T19:28:15.535842+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014121440000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":213,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.587705+0000","last_change":"2021-10-08T19:28:40.100133+0000","last_active":"2021-10-08T19:29:10.587705+0000","last_peered":"2021-10-08T19:29:10.587705+0000","last_clean":"2021-10-08T19:29:10.587705+0000","last_became_active":"2021-10-08T19:28:40.099286+0000","last_became_peered":"2021-10-08T19:28:40.099286+0000","last_unstale":"2021-10-08T19:29:10.587705+0000","last_undegraded":"2021-10-08T19:29:10.587705+0000","last_fullsized":"2021-10-08T19:29:10.587705+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:39.931718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:23:39.931718+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0036493649999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":193,"reported_epoch":221,"state":"active+clean","last_fresh":"2021-10-08T19:29:10.623769+0000","last_change":"2021-10-08T19:27:39.133530+0000","last_active":"2021-10-08T19:29:10.623769+0000","last_peered":"2021-10-08T19:29:10.623769+0000","last_clean":"2021-10-08T19:29:10.623769+0000","last_became_active":"2021-10-08T19:24:25.097417+0000","last_became_peered":"2021-10-08T19:24:25.097417+0000","last_unstale":"2021-10-08T19:29:10.623769+0000","last_undegraded":"2021-10-08T19:29:10.623769+0000","last_fullsized":"2021-10-08T19:29:10.623769+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:39.133448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:27:39.133448+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.018021757999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":5361172480,"num_objects":81805,"num_object_clones":0,"num_object_copies":245415,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":917,"num_objects_unfound":0,"num_objects_dirty":81805,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81805,"num_write_kb":5235520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4815,"num_bytes_recovered":315555840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16224813056,"data_stored":16224813056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72033,"ondisk_log_size":72033,"up":48,"acting":45,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":11,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2737161,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1430,"ondisk_log_size":1430,"up":33,"acting":33,"num_store_stats":8},{"poolid":3,"num_pg":23,"stat_sum":{"num_bytes":584,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":334,"num_read_kb":331,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":487,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":69,"acting":69,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":690,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":337,"num_bytes_recovered":6480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":408,"ondisk_log_size":408,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":96,"acting":96,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201378,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1741204,"kb_used_data":1643660,"kb_used_omap":0,"kb_used_meta":97536,"kb_avail":92003948,"statfs":{"total":95995035648,"available":94212042752,"internally_reserved":0,"allocated":1683107840,"data_stored":1682365397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":99876864},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:28:25 2021","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":1.802,"15min":0.91000000000000003},"min":{"1min":0.252,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":2.5630000000000002,"5min":32.366999999999997,"15min":32.366999999999997},"last":2.8580000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":2.0579999999999998,"15min":1.006},"min":{"1min":0.23699999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":1.861,"5min":29.736000000000001,"15min":29.736000000000001},"last":3.1070000000000002}]},{"osd":1,"last update":"Fri Oct 8 19:28:25 2021","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":2.0790000000000002,"15min":1.0189999999999999},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":2.706,"5min":25.079999999999998,"15min":25.079999999999998},"last":2.9350000000000001},{"interface":"front","average":{"1min":0.77600000000000002,"5min":1.1699999999999999,"15min":0.73499999999999999},"min":{"1min":0.33000000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":2.8260000000000001,"5min":7.907,"15min":7.907},"last":1.621}]},{"osd":2,"last update":"Fri Oct 8 19:28:25 2021","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":2.1899999999999999,"15min":1.0549999999999999},"min":{"1min":0.26800000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":4.4420000000000002,"5min":27.018000000000001,"15min":27.018000000000001},"last":2.8780000000000001},{"interface":"front","average":{"1min":0.78600000000000003,"5min":2.0339999999999998,"15min":0.99299999999999999},"min":{"1min":0.34599999999999997,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":2.827,"5min":27.113,"15min":27.113},"last":3.0939999999999999}]},{"osd":3,"last update":"Fri Oct 8 19:28:25 2021","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":2.3439999999999999,"15min":1.1060000000000001},"min":{"1min":0.32900000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":3.0859999999999999,"5min":27.010000000000002,"15min":27.010000000000002},"last":8.9329999999999998},{"interface":"front","average":{"1min":0.97699999999999998,"5min":2.1499999999999999,"15min":1.0620000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":6.1500000000000004,"5min":27.263999999999999,"15min":27.263999999999999},"last":1.6919999999999999}]},{"osd":4,"last update":"Fri Oct 8 19:28:25 2021","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.79700000000000004,"15min":0.57899999999999996},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":2.5299999999999998,"5min":4.7990000000000004,"15min":4.7990000000000004},"last":2.9020000000000001},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.66400000000000003,"15min":0.52100000000000002},"min":{"1min":0.28299999999999997,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":2.3109999999999999,"5min":4.0830000000000002,"15min":4.0830000000000002},"last":1.5469999999999999}]},{"osd":5,"last update":"Fri Oct 8 19:28:25 2021","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.84799999999999998,"15min":0.59899999999999998},"min":{"1min":0.309,"5min":0.27700000000000002,"15min":0.251},"max":{"1min":3.0190000000000001,"5min":4.649,"15min":4.649},"last":3.5089999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.60599999999999998,"15min":0.54100000000000004},"min":{"1min":0.31,"5min":0.29199999999999998,"15min":0.28699999999999998},"max":{"1min":2.5390000000000001,"5min":4.5259999999999998,"15min":4.5259999999999998},"last":1.5189999999999999}]},{"osd":6,"last update":"Fri Oct 8 19:28:25 2021","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.83899999999999997,"15min":0.626},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":2.5179999999999998,"5min":3.9430000000000001,"15min":3.9430000000000001},"last":1.49},{"interface":"front","average":{"1min":1.012,"5min":0.94699999999999995,"15min":0.69199999999999995},"min":{"1min":0.378,"5min":0.318,"15min":0.318},"max":{"1min":4.125,"5min":4.7750000000000004,"15min":4.7750000000000004},"last":3.1509999999999998}]}]},{"osd":6,"up_from":47,"seq":201863463014,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1743868,"kb_used_data":1622388,"kb_used_omap":0,"kb_used_meta":121472,"kb_avail":92001284,"statfs":{"total":95995035648,"available":94209314816,"internally_reserved":0,"allocated":1661325312,"data_stored":1660605922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":124387328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:29:08 2021","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":2.0190000000000001,"15min":0.97899999999999998},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":5.5830000000000002,"5min":28.382999999999999,"15min":28.382999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":4.6420000000000003,"5min":2.7999999999999998,"15min":1.264},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":69.477000000000004,"5min":69.477000000000004,"15min":69.477000000000004},"last":1.399}]},{"osd":1,"last update":"Fri Oct 8 19:29:08 2021","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":1.3009999999999999,"15min":0.77100000000000002},"min":{"1min":0.23400000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":3.5800000000000001,"5min":14.878,"15min":14.878},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.95099999999999996,"5min":1.3959999999999999,"15min":0.80000000000000004},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26400000000000001},"max":{"1min":4.9909999999999997,"5min":14.779,"15min":14.779},"last":0.47299999999999998}]},{"osd":2,"last update":"Fri Oct 8 19:29:08 2021","interfaces":[{"interface":"back","average":{"1min":5.0899999999999999,"5min":2.754,"15min":1.2649999999999999},"min":{"1min":0.28799999999999998,"5min":0.251,"15min":0.251},"max":{"1min":69.322999999999993,"5min":69.322999999999993,"15min":69.322999999999993},"last":0.38800000000000001},{"interface":"front","average":{"1min":5.3730000000000002,"5min":2.7370000000000001,"15min":1.252},"min":{"1min":0.28000000000000003,"5min":0.245,"15min":0.245},"max":{"1min":69.418999999999997,"5min":69.418999999999997,"15min":69.418999999999997},"last":11.161}]},{"osd":3,"last update":"Fri Oct 8 19:29:08 2021","interfaces":[{"interface":"back","average":{"1min":1.6990000000000001,"5min":2.0699999999999998,"15min":1.0189999999999999},"min":{"1min":0.29599999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":5.7590000000000003,"5min":21.670000000000002,"15min":21.670000000000002},"last":0.503},{"interface":"front","average":{"1min":1.5049999999999999,"5min":1.8,"15min":0.93799999999999994},"min":{"1min":0.31,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":7.8319999999999999,"5min":22.254999999999999,"15min":22.254999999999999},"last":1.0940000000000001}]},{"osd":4,"last update":"Fri Oct 8 19:29:08 2021","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.57699999999999996,"15min":0.46899999999999997},"min":{"1min":0.31,"5min":0.26900000000000002,"15min":0.255},"max":{"1min":2.6259999999999999,"5min":2.7469999999999999,"15min":2.7469999999999999},"last":1.4350000000000001},{"interface":"front","average":{"1min":4.6280000000000001,"5min":1.468,"15min":0.78700000000000003},"min":{"1min":0.34100000000000003,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":69.593999999999994,"5min":69.593999999999994,"15min":69.593999999999994},"last":0.379}]},{"osd":5,"last update":"Fri Oct 8 19:29:08 2021","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.65300000000000002,"15min":0.52100000000000002},"min":{"1min":0.34200000000000003,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":2.7589999999999999,"5min":6.7949999999999999,"15min":6.7949999999999999},"last":1.462},{"interface":"front","average":{"1min":4.6390000000000002,"5min":1.5049999999999999,"15min":0.81399999999999995},"min":{"1min":0.33900000000000002,"5min":0.29799999999999999,"15min":0.252},"max":{"1min":69.561000000000007,"5min":69.561000000000007,"15min":69.561000000000007},"last":0.54300000000000004}]},{"osd":7,"last update":"Fri Oct 8 19:28:29 2021","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.66100000000000003,"15min":0.54900000000000004},"min":{"1min":0.36199999999999999,"5min":0.32800000000000001,"15min":0.32000000000000001},"max":{"1min":2.5950000000000002,"5min":3.4300000000000002,"15min":3.4300000000000002},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.76000000000000001,"15min":0.61199999999999999},"min":{"1min":0.33100000000000002,"5min":0.313,"15min":0.313},"max":{"1min":2.8690000000000002,"5min":5.476,"15min":5.476},"last":1.4830000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574969,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2370736,"kb_used_data":2237736,"kb_used_omap":0,"kb_used_meta":132992,"kb_avail":91374416,"statfs":{"total":95995035648,"available":93567401984,"internally_reserved":0,"allocated":2291441664,"data_stored":2290669954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":136183808},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,1,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:28:40 2021","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":4.2779999999999996,"15min":1.6439999999999999},"min":{"1min":0.217,"5min":0.20399999999999999,"15min":0.184},"max":{"1min":7.335,"5min":98.734999999999999,"15min":98.734999999999999},"last":1.04},{"interface":"front","average":{"1min":1.8520000000000001,"5min":5.0709999999999997,"15min":1.9279999999999999},"min":{"1min":0.30199999999999999,"5min":0.23100000000000001,"15min":0.20599999999999999},"max":{"1min":8.5389999999999997,"5min":98.843999999999994,"15min":98.843999999999994},"last":2.4889999999999999}]},{"osd":2,"last update":"Fri Oct 8 19:29:05 2021","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":3.641,"15min":1.472},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":4.1159999999999997,"5min":35.124000000000002,"15min":35.124000000000002},"last":0.47899999999999998},{"interface":"front","average":{"1min":2.1949999999999998,"5min":4.0389999999999997,"15min":1.6259999999999999},"min":{"1min":0.25,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":7.181,"5min":35.283000000000001,"15min":35.283000000000001},"last":2.3439999999999999}]},{"osd":3,"last update":"Fri Oct 8 19:28:16 2021","interfaces":[{"interface":"back","average":{"1min":1.6080000000000001,"5min":3.4630000000000001,"15min":1.458},"min":{"1min":0.34200000000000003,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":6.476,"5min":34.575000000000003,"15min":34.575000000000003},"last":2.8500000000000001},{"interface":"front","average":{"1min":1.4079999999999999,"5min":2.823,"15min":1.238},"min":{"1min":0.32800000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":7.2999999999999998,"5min":35.091000000000001,"15min":35.091000000000001},"last":2.8319999999999999}]},{"osd":4,"last update":"Fri Oct 8 19:28:30 2021","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":2.246,"15min":1.089},"min":{"1min":0.36499999999999999,"5min":0.317,"15min":0.29499999999999998},"max":{"1min":3.7589999999999999,"5min":16.872,"15min":16.872},"last":1.972},{"interface":"front","average":{"1min":0.52200000000000002,"5min":1.359,"15min":0.80800000000000005},"min":{"1min":0.30399999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.85299999999999998,"5min":7.3460000000000001,"15min":7.3460000000000001},"last":0.41999999999999998}]},{"osd":5,"last update":"Fri Oct 8 19:28:56 2021","interfaces":[{"interface":"back","average":{"1min":1.8240000000000001,"5min":2.2959999999999998,"15min":1.1339999999999999},"min":{"1min":0.34799999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":8.5099999999999998,"5min":13.692,"15min":13.692},"last":2.419},{"interface":"front","average":{"1min":0.73999999999999999,"5min":1.4550000000000001,"15min":0.85199999999999998},"min":{"1min":0.33400000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":2.0699999999999998,"5min":7.3719999999999999,"15min":7.3719999999999999},"last":0.55100000000000005}]},{"osd":6,"last update":"Fri Oct 8 19:29:12 2021","interfaces":[{"interface":"back","average":{"1min":1.778,"5min":2.4430000000000001,"15min":1.1699999999999999},"min":{"1min":0.41799999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":5.2519999999999998,"5min":16.815999999999999,"15min":16.815999999999999},"last":2.012},{"interface":"front","average":{"1min":1.4730000000000001,"5min":2.339,"15min":1.2170000000000001},"min":{"1min":0.36699999999999999,"5min":0.33800000000000002,"15min":0.28399999999999997},"max":{"1min":8.6449999999999996,"5min":13.773,"15min":13.773},"last":2.4470000000000001}]},{"osd":7,"last update":"Fri Oct 8 19:28:30 2021","interfaces":[{"interface":"back","average":{"1min":1.7350000000000001,"5min":2.3889999999999998,"15min":1.173},"min":{"1min":0.47699999999999998,"5min":0.312,"15min":0.312},"max":{"1min":8.4849999999999994,"5min":23.721,"15min":23.721},"last":2.3889999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":1.4319999999999999,"15min":0.85699999999999998},"min":{"1min":0.374,"5min":0.34999999999999998,"15min":0.34300000000000003},"max":{"1min":0.874,"5min":7.4000000000000004,"15min":7.4000000000000004},"last":0.45400000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738492,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2111952,"kb_used_data":1968776,"kb_used_omap":0,"kb_used_meta":143168,"kb_avail":91633200,"statfs":{"total":95995035648,"available":93832396800,"internally_reserved":0,"allocated":2016026624,"data_stored":2015287101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":146604032},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 8 19:28:41 2021","interfaces":[{"interface":"back","average":{"1min":1.661,"5min":2.6349999999999998,"15min":1.0940000000000001},"min":{"1min":0.214,"5min":0.192,"15min":0.192},"max":{"1min":11.420999999999999,"5min":22.466000000000001,"15min":22.466000000000001},"last":0.24399999999999999},{"interface":"front","average":{"1min":1.1639999999999999,"5min":2.7109999999999999,"15min":1.1519999999999999},"min":{"1min":0.23999999999999999,"5min":0.217,"15min":0.217},"max":{"1min":7.4169999999999998,"5min":15.041,"15min":15.041},"last":3.2709999999999999}]},{"osd":2,"last update":"Fri Oct 8 19:29:03 2021","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":2.8980000000000001,"15min":1.4059999999999999},"min":{"1min":0.24299999999999999,"5min":0.22800000000000001,"15min":0.22700000000000001},"max":{"1min":5.9989999999999997,"5min":14.814,"15min":62.390000000000001},"last":5.2999999999999998},{"interface":"front","average":{"1min":1.379,"5min":2.6179999999999999,"15min":1.319},"min":{"1min":0.25700000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":8.0619999999999994,"5min":13.407999999999999,"15min":62.718000000000004},"last":3.3239999999999998}]},{"osd":3,"last update":"Fri Oct 8 19:28:18 2021","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":3.1349999999999998,"15min":1.3620000000000001},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":3.1280000000000001,"5min":62.491,"15min":62.491},"last":5.6609999999999996},{"interface":"front","average":{"1min":0.91400000000000003,"5min":2.6800000000000002,"15min":1.1910000000000001},"min":{"1min":0.26600000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":7.2450000000000001,"5min":62.673000000000002,"15min":62.673000000000002},"last":2.677}]},{"osd":4,"last update":"Fri Oct 8 19:28:33 2021","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":2.0369999999999999,"15min":1.0389999999999999},"min":{"1min":0.38400000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":11.395,"5min":11.395,"15min":11.395},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":1.9419999999999999,"15min":1.0289999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":3.1640000000000001,"5min":11.823,"15min":11.823},"last":3.363}]},{"osd":5,"last update":"Fri Oct 8 19:28:52 2021","interfaces":[{"interface":"back","average":{"1min":1.3779999999999999,"5min":1.5589999999999999,"15min":0.88500000000000001},"min":{"1min":0.308,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":6.6399999999999997,"5min":15.56,"15min":15.56},"last":2.7069999999999999},{"interface":"front","average":{"1min":1.7430000000000001,"5min":2.2429999999999999,"15min":1.1220000000000001},"min":{"1min":0.40500000000000003,"5min":0.318,"15min":0.318},"max":{"1min":11.369,"5min":15.484999999999999,"15min":15.484999999999999},"last":0.38300000000000001}]},{"osd":6,"last update":"Fri Oct 8 19:28:13 2021","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":2.0750000000000002,"15min":1.0780000000000001},"min":{"1min":0.39200000000000002,"5min":0.377,"15min":0.377},"max":{"1min":8.5250000000000004,"5min":11.869,"15min":11.869},"last":3.3460000000000001},{"interface":"front","average":{"1min":0.75900000000000001,"5min":1.611,"15min":0.91700000000000004},"min":{"1min":0.36799999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":2.2480000000000002,"5min":10.519,"15min":10.519},"last":4.4180000000000001}]},{"osd":7,"last update":"Fri Oct 8 19:28:27 2021","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":2.1389999999999998,"15min":1.0860000000000001},"min":{"1min":0.40300000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":11.326000000000001,"5min":11.326000000000001,"15min":11.326000000000001},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.86899999999999999,"5min":2.363,"15min":1.171},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":3.21,"5min":11.898999999999999,"15min":11.898999999999999},"last":3.9369999999999998}]}]},{"osd":2,"up_from":18,"seq":77309411444,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2192956,"kb_used_data":2054964,"kb_used_omap":0,"kb_used_meta":137984,"kb_avail":91552196,"statfs":{"total":95995035648,"available":93749448704,"internally_reserved":0,"allocated":2104283136,"data_stored":2103564034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":141295616},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,0,0,3],"upper_bound":64},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:28:58 2021","interfaces":[{"interface":"back","average":{"1min":1.5780000000000001,"5min":3.8300000000000001,"15min":1.5049999999999999},"min":{"1min":0.223,"5min":0.20699999999999999,"15min":0.17699999999999999},"max":{"1min":4.2370000000000001,"5min":61.670999999999999,"15min":61.670999999999999},"last":0.249},{"interface":"front","average":{"1min":1.8200000000000001,"5min":3.766,"15min":1.496},"min":{"1min":0.245,"5min":0.189,"15min":0.189},"max":{"1min":5.5190000000000001,"5min":65.284999999999997,"15min":65.284999999999997},"last":0.61199999999999999}]},{"osd":1,"last update":"Fri Oct 8 19:28:58 2021","interfaces":[{"interface":"back","average":{"1min":1.5409999999999999,"5min":3.1800000000000002,"15min":1.3160000000000001},"min":{"1min":0.23499999999999999,"5min":0.192,"15min":0.192},"max":{"1min":4.2080000000000002,"5min":31.303999999999998,"15min":31.303999999999998},"last":2.8439999999999999},{"interface":"front","average":{"1min":1.135,"5min":3.4409999999999998,"15min":1.4119999999999999},"min":{"1min":0.25600000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":3.8039999999999998,"5min":31.696999999999999,"15min":31.696999999999999},"last":0.50900000000000001}]},{"osd":3,"last update":"Fri Oct 8 19:29:10 2021","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":3.7719999999999998,"15min":1.573},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.218},"max":{"1min":3.9710000000000001,"5min":65.322999999999993,"15min":65.322999999999993},"last":0.68600000000000005},{"interface":"front","average":{"1min":2.3079999999999998,"5min":3.5369999999999999,"15min":1.482},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":12.148,"5min":61.143000000000001,"15min":61.143000000000001},"last":0.64500000000000002}]},{"osd":4,"last update":"Fri Oct 8 19:28:29 2021","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.972,"15min":1.0189999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":6.6529999999999996,"5min":14.122999999999999,"15min":14.122999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.95899999999999996,"5min":2.1899999999999999,"15min":1.111},"min":{"1min":0.29999999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":3.625,"5min":15.143000000000001,"15min":15.143000000000001},"last":0.63900000000000001}]},{"osd":5,"last update":"Fri Oct 8 19:28:54 2021","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":2.1280000000000001,"15min":1.0880000000000001},"min":{"1min":0.34100000000000003,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":3.6819999999999999,"5min":15.087999999999999,"15min":15.087999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":2.2789999999999999,"5min":2.1920000000000002,"15min":1.1180000000000001},"min":{"1min":0.34300000000000003,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":16.643000000000001,"5min":16.643000000000001,"15min":16.643000000000001},"last":0.59899999999999998}]},{"osd":6,"last update":"Fri Oct 8 19:29:10 2021","interfaces":[{"interface":"back","average":{"1min":2.0390000000000001,"5min":2.1299999999999999,"15min":1.111},"min":{"1min":0.35799999999999998,"5min":0.33100000000000002,"15min":0.30199999999999999},"max":{"1min":11.971,"5min":14.162000000000001,"15min":14.162000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":2.298,"5min":2.258,"15min":1.151},"min":{"1min":0.38300000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":16.68,"5min":16.68,"15min":16.68},"last":0.52800000000000002}]},{"osd":7,"last update":"Fri Oct 8 19:28:29 2021","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":2.157,"15min":1.093},"min":{"1min":0.40100000000000002,"5min":0.38600000000000001,"15min":0.31900000000000001},"max":{"1min":5.2130000000000001,"5min":14.185,"15min":14.185},"last":0.47799999999999998},{"interface":"front","average":{"1min":1.7609999999999999,"5min":2.1640000000000001,"15min":1.1200000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":16.702999999999999,"5min":16.702999999999999,"15min":16.702999999999999},"last":0.57199999999999995}]}]},{"osd":3,"up_from":24,"seq":103079215218,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2153572,"kb_used_data":1987548,"kb_used_omap":0,"kb_used_meta":166016,"kb_avail":91591580,"statfs":{"total":95995035648,"available":93789777920,"internally_reserved":0,"allocated":2035249152,"data_stored":2034490210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":170000384},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,5,5],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:28:20 2021","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":3.4689999999999999,"15min":1.3899999999999999},"min":{"1min":0.17100000000000001,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":5.5599999999999996,"5min":109.601,"15min":109.601},"last":5.6100000000000003},{"interface":"front","average":{"1min":1.528,"5min":3.9750000000000001,"15min":1.587},"min":{"1min":0.22700000000000001,"5min":0.217,"15min":0.19800000000000001},"max":{"1min":7.3479999999999999,"5min":107.84,"15min":107.84},"last":0.374}]},{"osd":1,"last update":"Fri Oct 8 19:28:20 2021","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":2.5840000000000001,"15min":1.129},"min":{"1min":0.246,"5min":0.23699999999999999,"15min":0.219},"max":{"1min":6.3319999999999999,"5min":20.335999999999999,"15min":20.335999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":1.9179999999999999,"5min":2.6339999999999999,"15min":1.147},"min":{"1min":0.26200000000000001,"5min":0.23200000000000001,"15min":0.21199999999999999},"max":{"1min":8.5589999999999993,"5min":13.372999999999999,"15min":13.372999999999999},"last":0.39400000000000002}]},{"osd":2,"last update":"Fri Oct 8 19:28:20 2021","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":3.2400000000000002,"15min":1.3660000000000001},"min":{"1min":0.27600000000000002,"5min":0.246,"15min":0.246},"max":{"1min":7.0940000000000003,"5min":32.277000000000001,"15min":32.277000000000001},"last":0.435},{"interface":"front","average":{"1min":0.80600000000000005,"5min":2.274,"15min":1.0429999999999999},"min":{"1min":0.28599999999999998,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":3.024,"5min":14.898999999999999,"15min":14.898999999999999},"last":5.407}]},{"osd":4,"last update":"Fri Oct 8 19:28:31 2021","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.881,"15min":1.008},"min":{"1min":0.33100000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":7.2949999999999999,"5min":18.064,"15min":18.064},"last":4.6870000000000003},{"interface":"front","average":{"1min":1.121,"5min":1.9299999999999999,"15min":1.145},"min":{"1min":0.34899999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":6.2380000000000004,"5min":18.692,"15min":18.692},"last":0.44900000000000001}]},{"osd":5,"last update":"Fri Oct 8 19:28:52 2021","interfaces":[{"interface":"back","average":{"1min":1.855,"5min":2.0329999999999999,"15min":1.0660000000000001},"min":{"1min":0.373,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":8.5660000000000007,"5min":13.186,"15min":13.186},"last":2.0710000000000002},{"interface":"front","average":{"1min":1.625,"5min":1.913,"15min":1.093},"min":{"1min":0.32400000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":7.3410000000000002,"5min":10.285,"15min":10.285},"last":5.4420000000000002}]},{"osd":6,"last update":"Fri Oct 8 19:29:11 2021","interfaces":[{"interface":"back","average":{"1min":2.6549999999999998,"5min":2.4460000000000002,"15min":1.8420000000000001},"min":{"1min":0.33200000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":10.727,"5min":17.512,"15min":21.538},"last":0.40799999999999997},{"interface":"front","average":{"1min":2.0609999999999999,"5min":2.1240000000000001,"15min":1.1000000000000001},"min":{"1min":0.379,"5min":0.36299999999999999,"15min":0.35499999999999998},"max":{"1min":8.6379999999999999,"5min":13.298,"15min":13.298},"last":0.45600000000000002}]},{"osd":7,"last update":"Fri Oct 8 19:28:31 2021","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.7649999999999999,"15min":0.98699999999999999},"min":{"1min":0.38100000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":6.306,"5min":8.8350000000000009,"15min":8.8350000000000009},"last":0.42999999999999999},{"interface":"front","average":{"1min":1.6599999999999999,"5min":2.0899999999999999,"15min":1.1040000000000001},"min":{"1min":0.45000000000000001,"5min":0.376,"15min":0.376},"max":{"1min":8.6099999999999994,"5min":13.225,"15min":13.225},"last":0.47999999999999998}]}]},{"osd":4,"up_from":30,"seq":128849018990,"num_pgs":74,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1770652,"kb_used_data":1661652,"kb_used_omap":0,"kb_used_meta":108992,"kb_avail":91974500,"statfs":{"total":95995035648,"available":94181888000,"internally_reserved":0,"allocated":1701531648,"data_stored":1700780877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":111607808},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:28:30 2021","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":2.238,"15min":1.0880000000000001},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":2.9140000000000001,"5min":59.223999999999997,"15min":59.223999999999997},"last":6.3369999999999997},{"interface":"front","average":{"1min":1.0309999999999999,"5min":2.2770000000000001,"15min":1.103},"min":{"1min":0.251,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":4.0709999999999997,"5min":58.667999999999999,"15min":58.667999999999999},"last":0.314}]},{"osd":1,"last update":"Fri Oct 8 19:28:30 2021","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":2.0190000000000001,"15min":1.012},"min":{"1min":0.24299999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":4.4699999999999998,"5min":26.634,"15min":26.634},"last":0.23300000000000001},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.3109999999999999,"15min":0.76700000000000002},"min":{"1min":0.26400000000000001,"5min":0.246,"15min":0.24099999999999999},"max":{"1min":3.71,"5min":6.7000000000000002,"15min":6.7000000000000002},"last":2.5840000000000001}]},{"osd":2,"last update":"Fri Oct 8 19:28:30 2021","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":1.8999999999999999,"15min":0.96999999999999997},"min":{"1min":0.27100000000000002,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":2.4710000000000001,"5min":21.257000000000001,"15min":21.257000000000001},"last":0.44600000000000001},{"interface":"front","average":{"1min":1.23,"5min":1.8999999999999999,"15min":0.98399999999999999},"min":{"1min":0.30399999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":4.7009999999999996,"5min":21.600000000000001,"15min":21.600000000000001},"last":0.59899999999999998}]},{"osd":3,"last update":"Fri Oct 8 19:28:30 2021","interfaces":[{"interface":"back","average":{"1min":1.992,"5min":3.0499999999999998,"15min":1.357},"min":{"1min":0.33000000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":18.853000000000002,"5min":58.506999999999998,"15min":58.506999999999998},"last":0.36199999999999999},{"interface":"front","average":{"1min":1.123,"5min":2.0950000000000002,"15min":1.046},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":4.6280000000000001,"5min":58.521000000000001,"15min":58.521000000000001},"last":9.6300000000000008}]},{"osd":5,"last update":"Fri Oct 8 19:28:59 2021","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.69799999999999995,"15min":0.48699999999999999},"min":{"1min":0.248,"5min":0.23899999999999999,"15min":0.222},"max":{"1min":4.431,"5min":4.7359999999999998,"15min":4.7359999999999998},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.66900000000000004,"15min":0.48599999999999999},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":5.4640000000000004,"5min":5.4640000000000004,"15min":5.4640000000000004},"last":0.90800000000000003}]},{"osd":6,"last update":"Fri Oct 8 19:29:11 2021","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.81999999999999995,"15min":0.54900000000000004},"min":{"1min":0.32100000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":4.5869999999999997,"5min":5.0460000000000003,"15min":5.0460000000000003},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.85099999999999998,"15min":0.57199999999999995},"min":{"1min":0.28000000000000003,"5min":0.247,"15min":0.247},"max":{"1min":2.052,"5min":4.8899999999999997,"15min":4.8899999999999997},"last":0.39000000000000001}]},{"osd":7,"last update":"Fri Oct 8 19:28:30 2021","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.63400000000000001,"15min":0.53200000000000003},"min":{"1min":0.308,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.73,"5min":4.0060000000000002,"15min":4.0060000000000002},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.88900000000000001,"15min":0.624},"min":{"1min":0.35299999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":3.964,"5min":5.0209999999999999,"15min":5.0209999999999999},"last":0.45700000000000002}]}]},{"osd":5,"up_from":38,"seq":163208757352,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2730176,"kb_used_data":2616248,"kb_used_omap":0,"kb_used_meta":113920,"kb_avail":91014976,"statfs":{"total":95995035648,"available":93199335424,"internally_reserved":0,"allocated":2679037952,"data_stored":2678309263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":116654080},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:28:49 2021","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":1.2949999999999999,"15min":0.81899999999999995},"min":{"1min":0.223,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":3.8940000000000001,"5min":5.899,"15min":22.966999999999999},"last":0.30399999999999999},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.454,"15min":0.79300000000000004},"min":{"1min":0.27600000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":4.5359999999999996,"5min":5.4969999999999999,"15min":5.4969999999999999},"last":2.4609999999999999}]},{"osd":1,"last update":"Fri Oct 8 19:28:49 2021","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":1.6759999999999999,"15min":0.88400000000000001},"min":{"1min":0.33500000000000002,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":3.1120000000000001,"5min":18.064,"15min":18.064},"last":1.0589999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":1.641,"15min":0.878},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.25900000000000001},"max":{"1min":2.6509999999999998,"5min":18.074000000000002,"15min":18.074000000000002},"last":2.0270000000000001}]},{"osd":2,"last update":"Fri Oct 8 19:28:49 2021","interfaces":[{"interface":"back","average":{"1min":1.8160000000000001,"5min":2.3759999999999999,"15min":1.1739999999999999},"min":{"1min":0.30599999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":6.1079999999999997,"5min":29.398,"15min":29.398},"last":0.32900000000000001},{"interface":"front","average":{"1min":1.0049999999999999,"5min":2.2999999999999998,"15min":1.169},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":2.6920000000000002,"5min":29.387,"15min":29.387},"last":2.0459999999999998}]},{"osd":3,"last update":"Fri Oct 8 19:28:49 2021","interfaces":[{"interface":"back","average":{"1min":1.954,"5min":2.1349999999999998,"15min":1.032},"min":{"1min":0.34100000000000003,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":12.356,"5min":12.356,"15min":12.356},"last":0.38600000000000001},{"interface":"front","average":{"1min":2.137,"5min":2.133,"15min":1.034},"min":{"1min":0.38600000000000001,"5min":0.32000000000000001,"15min":0.313},"max":{"1min":8.4009999999999998,"5min":21.504000000000001,"15min":21.504000000000001},"last":1.0349999999999999}]},{"osd":4,"last update":"Fri Oct 8 19:28:49 2021","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.748,"15min":0.52100000000000002},"min":{"1min":0.254,"5min":0.249,"15min":0.224},"max":{"1min":2.673,"5min":5.0780000000000003,"15min":5.0780000000000003},"last":1.9730000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.69199999999999995,"15min":0.52300000000000002},"min":{"1min":0.30399999999999999,"5min":0.28299999999999997,"15min":0.23799999999999999},"max":{"1min":1.968,"5min":3.9540000000000002,"15min":3.9540000000000002},"last":0.442}]},{"osd":6,"last update":"Fri Oct 8 19:29:08 2021","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.86799999999999999,"15min":0.58799999999999997},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":3.5760000000000001,"5min":7.266,"15min":7.266},"last":2.0019999999999998},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.78900000000000003,"15min":0.59499999999999997},"min":{"1min":0.33800000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":2.375,"5min":5.1580000000000004,"15min":5.1580000000000004},"last":0.46400000000000002}]},{"osd":7,"last update":"Fri Oct 8 19:28:33 2021","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.78100000000000003,"15min":0.59599999999999997},"min":{"1min":0.34100000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":3.0899999999999999,"5min":3.899,"15min":3.899},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.86799999999999999,"15min":0.66700000000000004},"min":{"1min":0.34699999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":3.7570000000000001,"5min":5.0279999999999996,"15min":5.0279999999999996},"last":2.911}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":266240,"data_stored":262688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":327680,"data_stored":327680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":2338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2027880448,"data_stored":2027880448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2285961216,"data_stored":2285961216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2104360960,"data_stored":2104360960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2038497280,"data_stored":2038497280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1703149568,"data_stored":1703149568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":2704015360,"data_stored":2704015360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1675493376,"data_stored":1675493376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1685454848,"data_stored":1685454848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-10-08T19:29:18.105 INFO:tasks.cephadm.ceph_manager.ceph:would drop below min_pgs, proj 6, currently 16 2021-10-08T19:29:18.702 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 87 15 86271 86256 61.9293 57.1875 0.018512 0.0161429 2021-10-08T19:29:18.723 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:29:18.730 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:18.731 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:29:18.834 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:29:18.867 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:29:18.868 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:18.933 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:29:18.935 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:18.936 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:29:19.038 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:29:19.083 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:19.427 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:29:19.453 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:19.453 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:29:19.556 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:29:19.628 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:19.702 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 88 16 87082 87066 61.8009 50.625 0.0371309 0.0161743 2021-10-08T19:29:19.754 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:29:19.757 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:19.758 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:29:19.790 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2021-10-08T19:29:19.790 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:29:19.859 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:29:19.915 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:19 smithi097 ceph-mon[32687]: pgmap v381: 178 pgs: 3 active+recovering+undersized+remapped, 175 active+clean; 5.1 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.2 KiB/s rd, 49 MiB/s wr, 780 op/s; 859/251874 objects misplaced (0.341%); 1.8 MiB/s, 29 objects/s recovering 2021-10-08T19:29:19.916 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:19 smithi097 ceph-mon[41966]: pgmap v381: 178 pgs: 3 active+recovering+undersized+remapped, 175 active+clean; 5.1 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.2 KiB/s rd, 49 MiB/s wr, 780 op/s; 859/251874 objects misplaced (0.341%); 1.8 MiB/s, 29 objects/s recovering 2021-10-08T19:29:19.921 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:20.065 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:29:20.080 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:20.081 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:29:20.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:19 smithi117 ceph-mon[34585]: pgmap v381: 178 pgs: 3 active+recovering+undersized+remapped, 175 active+clean; 5.1 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.2 KiB/s rd, 49 MiB/s wr, 780 op/s; 859/251874 objects misplaced (0.341%); 1.8 MiB/s, 29 objects/s recovering 2021-10-08T19:29:20.181 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:29:20.228 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:20.304 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:29:20.310 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:20.310 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:29:20.411 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:29:20.451 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:20.493 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:29:20.495 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:20.495 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:29:20.596 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:29:20.641 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:20.702 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 89 16 87904 87888 61.6838 51.375 0.009878 0.0162064 2021-10-08T19:29:20.749 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:29:20.752 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:20.753 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:29:20.768 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2021-10-08T19:29:20.854 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:29:20.925 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:21.402 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2021-10-08T19:29:21.500 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:29:21.511 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:21.512 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:29:21.589 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:29:21.614 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:29:21.643 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:21.689 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:29:21.692 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:21.693 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:29:21.702 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Total time run: 90.0152 2021-10-08T19:29:21.703 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Total writes made: 88737 2021-10-08T19:29:21.703 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Write size: 65536 2021-10-08T19:29:21.703 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Object size: 65536 2021-10-08T19:29:21.703 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Bandwidth (MB/sec): 61.6125 2021-10-08T19:29:21.703 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Stddev Bandwidth: 48.1647 2021-10-08T19:29:21.704 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Max bandwidth (MB/sec): 202.25 2021-10-08T19:29:21.704 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Min bandwidth (MB/sec): 0 2021-10-08T19:29:21.704 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Average IOPS: 985 2021-10-08T19:29:21.704 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Stddev IOPS: 770.651 2021-10-08T19:29:21.704 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Max IOPS: 3236 2021-10-08T19:29:21.705 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Min IOPS: 0 2021-10-08T19:29:21.705 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Average Latency(s): 0.0162253 2021-10-08T19:29:21.705 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Stddev Latency(s): 0.15662 2021-10-08T19:29:21.705 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Max latency(s): 8.25637 2021-10-08T19:29:21.706 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Min latency(s): 0.00104309 2021-10-08T19:29:21.707 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Cleaning up (deleting benchmark objects) 2021-10-08T19:29:21.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:21 smithi097 ceph-mon[41966]: pgmap v382: 178 pgs: 3 active+recovering+undersized+remapped, 175 active+clean; 5.3 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.2 KiB/s rd, 68 MiB/s wr, 1.09k op/s; 742/259269 objects misplaced (0.286%); 2.7 MiB/s, 43 objects/s recovering 2021-10-08T19:29:21.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:21 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:29:21.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:21 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:29:21.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:21 smithi097 ceph-mon[32687]: pgmap v382: 178 pgs: 3 active+recovering+undersized+remapped, 175 active+clean; 5.3 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.2 KiB/s rd, 68 MiB/s wr, 1.09k op/s; 742/259269 objects misplaced (0.286%); 2.7 MiB/s, 43 objects/s recovering 2021-10-08T19:29:21.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:21 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:29:21.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:21 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:29:21.794 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:29:21.828 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:21.880 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:29:21.883 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:21 smithi117 ceph-mon[34585]: pgmap v382: 178 pgs: 3 active+recovering+undersized+remapped, 175 active+clean; 5.3 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.2 KiB/s rd, 68 MiB/s wr, 1.09k op/s; 742/259269 objects misplaced (0.286%); 2.7 MiB/s, 43 objects/s recovering 2021-10-08T19:29:21.883 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:21 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:29:21.883 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:21 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:29:21.884 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:21.885 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:29:21.986 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:29:22.015 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:22.082 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:29:22.084 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:22.085 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:29:22.186 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:29:22.223 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:22.288 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:29:22.294 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:22.295 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:29:22.396 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:29:22.482 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:22.568 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:29:22.574 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:22.575 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:29:22.625 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:22 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:29:22.626 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:22 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:29:22.626 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:22 smithi117 ceph-mon[34585]: osdmap e224: 8 total, 8 up, 8 in 2021-10-08T19:29:22.626 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:22 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/547557952' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:29:22.660 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is unset 2021-10-08T19:29:22.676 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:29:22.710 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:22.721 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:29:22 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:29:22] "GET /metrics HTTP/1.1" 200 155780 "" "Prometheus/2.18.1" 2021-10-08T19:29:22.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:22 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:29:22.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:22 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:29:22.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:22 smithi097 ceph-mon[41966]: osdmap e224: 8 total, 8 up, 8 in 2021-10-08T19:29:22.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:22 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/547557952' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:29:22.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:22 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:29:22.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:22 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:29:22.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:22 smithi097 ceph-mon[32687]: osdmap e224: 8 total, 8 up, 8 in 2021-10-08T19:29:22.724 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:22 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/547557952' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:29:22.779 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:29:22.785 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:22.786 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:29:22.851 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:29:22.887 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:29:22.919 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:22.982 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:29:22.985 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:22.986 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:29:23.087 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:29:23.106 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 3, 4, 5, 7, 6, 1] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2021-10-08T19:29:23.106 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2021-10-08T19:29:23.107 INFO:tasks.thrashosds.thrasher:Removing osd 3, in_osds are: [0, 2, 3, 4, 5, 7, 6, 1] 2021-10-08T19:29:23.107 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd out 3 2021-10-08T19:29:23.117 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:23.179 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:29:23.183 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:23.184 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:29:23.285 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:29:23.336 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:23.508 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:29:23 smithi117 conmon[69189]: level=error ts=2021-10-08T19:29:23.507Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=2 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:29:23.867 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:23 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:29:23.867 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:23 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:29:23.868 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:23 smithi117 ceph-mon[34585]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:29:23.868 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:23 smithi117 ceph-mon[34585]: pgmap v384: 178 pgs: 3 active+recovering+undersized+remapped, 175 active+clean; 5.3 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 639 B/s rd, 35 MiB/s wr, 553 op/s; 742/259269 objects misplaced (0.286%); 1.4 MiB/s, 21 objects/s recovering 2021-10-08T19:29:23.868 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:23 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/547557952' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:29:23.868 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:23 smithi117 ceph-mon[34585]: osdmap e225: 8 total, 8 up, 8 in 2021-10-08T19:29:23.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:23 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:29:23.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:23 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:29:23.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:23 smithi097 ceph-mon[32687]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:29:23.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:23 smithi097 ceph-mon[32687]: pgmap v384: 178 pgs: 3 active+recovering+undersized+remapped, 175 active+clean; 5.3 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 639 B/s rd, 35 MiB/s wr, 553 op/s; 742/259269 objects misplaced (0.286%); 1.4 MiB/s, 21 objects/s recovering 2021-10-08T19:29:23.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:23 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/547557952' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:29:23.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:23 smithi097 ceph-mon[32687]: osdmap e225: 8 total, 8 up, 8 in 2021-10-08T19:29:23.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:23 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:29:23.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:23 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:29:23.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:23 smithi097 ceph-mon[41966]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:29:23.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:23 smithi097 ceph-mon[41966]: pgmap v384: 178 pgs: 3 active+recovering+undersized+remapped, 175 active+clean; 5.3 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 639 B/s rd, 35 MiB/s wr, 553 op/s; 742/259269 objects misplaced (0.286%); 1.4 MiB/s, 21 objects/s recovering 2021-10-08T19:29:23.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:23 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/547557952' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:29:23.975 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:23 smithi097 ceph-mon[41966]: osdmap e225: 8 total, 8 up, 8 in 2021-10-08T19:29:24.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:29:23 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:29:23] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:29:24.278 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:29:24.283 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:24.285 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:29:24.386 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:29:24.427 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:24.497 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:29:24.499 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:24.500 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:29:24.573 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:29:24.601 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:29:24.637 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:24.637 INFO:journalctl@ceph.osd.0.smithi097.stdout:Oct 08 19:29:24 smithi097 conmon[47373]: 2021-10-08T19:29:24.388+0000 7f8334f91700 -1 osd.0 pg_epoch: 225 pg[4.6( v 69'12 (0'0,69'12] local-lis/les=202/203 n=6 ec=62/62 lis/c=202/202 les/c/f=203/203/0 sis=202) [0,1,2] r=0 lpr=202 crt=69'12 lcod 69'11 mlcod 0'0 active+clean] scrubber pg(4.6) handle_scrub_reserve_grant: received unsolicited reservation grant from osd 2 (0x55cbf8d64840) 2021-10-08T19:29:24.698 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:29:24.699 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:24 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:29:24.700 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:24 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:29:24.700 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:24.701 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:29:24.802 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:29:24.848 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:24.899 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:24 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:29:24.900 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:24 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:29:24.900 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:24 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:29:24.900 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:24 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:29:24.901 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:29:24 smithi097 conmon[33110]: 172.21.15.97 - - [08/Oct/2021:19:29:24] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:29:24.909 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:29:24.913 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:24.914 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:29:25.015 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:29:25.069 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:25.463 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:29:25.463 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:29:25.463 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:29:25.487 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:29:25.522 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:29:25.555 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:29:25.596 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:29:25.632 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:29:25.654 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true' 2021-10-08T19:29:25.655 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true' 2021-10-08T19:29:25.655 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true' 2021-10-08T19:29:25.656 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true' 2021-10-08T19:29:25.656 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true' 2021-10-08T19:29:25.656 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true' 2021-10-08T19:29:25.656 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'true' 2021-10-08T19:29:25.656 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'true' 2021-10-08T19:29:25.657 INFO:journalctl@ceph.osd.7.smithi117.stdout:Oct 08 19:29:25 smithi117 conmon[54364]: 2021-10-08T19:29:25.298+0000 7ff38703b700 -1 osd.7 pg_epoch: 226 pg[3.f( empty local-lis/les=132/133 n=0 ec=131/60 lis/c=132/132 les/c/f=133/133/0 sis=132) [7,4,0] r=0 lpr=132 crt=0'0 mlcod 0'0 active+clean] scrubber pg(3.f) handle_scrub_reserve_grant: received unsolicited reservation grant from osd 0 (0x55a623ebe000) 2021-10-08T19:29:25.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:25 smithi097 ceph-mon[41966]: pgmap v386: 178 pgs: 3 active+recovering+undersized+remapped, 175 active+clean; 5.3 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.4 KiB/s rd, 54 MiB/s wr, 1.07k op/s; 568/261882 objects misplaced (0.217%); 2.7 MiB/s, 43 objects/s recovering 2021-10-08T19:29:25.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:25 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:29:25.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:25 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:29:25.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:25 smithi097 ceph-mon[41966]: 172.21.15.97 - - [08/Oct/2021:19:29:24] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:29:25.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:25 smithi097 ceph-mon[41966]: osdmap e226: 8 total, 8 up, 8 in 2021-10-08T19:29:25.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:25 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/109566080' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:29:25.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:25 smithi097 ceph-mon[41966]: osdmap e227: 8 total, 8 up, 8 in 2021-10-08T19:29:25.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:25 smithi097 ceph-mon[32687]: pgmap v386: 178 pgs: 3 active+recovering+undersized+remapped, 175 active+clean; 5.3 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.4 KiB/s rd, 54 MiB/s wr, 1.07k op/s; 568/261882 objects misplaced (0.217%); 2.7 MiB/s, 43 objects/s recovering 2021-10-08T19:29:25.974 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:25 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:29:25.974 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:25 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:29:25.974 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:25 smithi097 ceph-mon[32687]: 172.21.15.97 - - [08/Oct/2021:19:29:24] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:29:25.974 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:25 smithi097 ceph-mon[32687]: osdmap e226: 8 total, 8 up, 8 in 2021-10-08T19:29:25.975 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:25 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/109566080' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:29:25.975 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:25 smithi097 ceph-mon[32687]: osdmap e227: 8 total, 8 up, 8 in 2021-10-08T19:29:26.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:25 smithi117 ceph-mon[34585]: pgmap v386: 178 pgs: 3 active+recovering+undersized+remapped, 175 active+clean; 5.3 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.4 KiB/s rd, 54 MiB/s wr, 1.07k op/s; 568/261882 objects misplaced (0.217%); 2.7 MiB/s, 43 objects/s recovering 2021-10-08T19:29:26.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:25 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:29:26.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:25 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:29:26.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:25 smithi117 ceph-mon[34585]: 172.21.15.97 - - [08/Oct/2021:19:29:24] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:29:26.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:25 smithi117 ceph-mon[34585]: osdmap e226: 8 total, 8 up, 8 in 2021-10-08T19:29:26.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:25 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/109566080' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:29:26.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:25 smithi117 ceph-mon[34585]: osdmap e227: 8 total, 8 up, 8 in 2021-10-08T19:29:26.386 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset nodeep-scrub 2021-10-08T19:29:26.455 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:29:26.464 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:26.465 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:29:26.566 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:29:26.609 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:26.905 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:29:26 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:29:27.464 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:29:27.472 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:27.472 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:29:27.574 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:29:27.586 INFO:journalctl@ceph.osd.2.smithi097.stdout:Oct 08 19:29:27 smithi097 conmon[55904]: 2021-10-08T19:29:27.327+0000 7f5999649700 -1 osd.2 pg_epoch: 227 pg[2.0( empty local-lis/les=202/203 n=0 ec=60/60 lis/c=202/202 les/c/f=203/203/0 sis=202) [2,1,0] r=0 lpr=202 crt=0'0 mlcod 0'0 active+clean] scrubber pg(2.0) handle_scrub_reserve_grant: received unsolicited reservation grant from osd 0 (0x56222784bce0) 2021-10-08T19:29:27.608 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:27.664 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:29:27.672 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:27.673 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:29:27.734 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:29:27.774 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:29:27.827 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:27.860 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:27 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:29:27.860 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:27 smithi097 ceph-mon[32687]: pgmap v389: 178 pgs: 3 active+recovering+undersized+remapped, 175 active+clean; 5.3 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.2 KiB/s rd, 31 MiB/s wr, 831 op/s; 568/261882 objects misplaced (0.217%); 2.2 MiB/s, 34 objects/s recovering 2021-10-08T19:29:27.862 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:27 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:29:27.862 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:27 smithi097 ceph-mon[41966]: pgmap v389: 178 pgs: 3 active+recovering+undersized+remapped, 175 active+clean; 5.3 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.2 KiB/s rd, 31 MiB/s wr, 831 op/s; 568/261882 objects misplaced (0.217%); 2.2 MiB/s, 34 objects/s recovering 2021-10-08T19:29:27.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:27 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:29:27.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:27 smithi117 ceph-mon[34585]: pgmap v389: 178 pgs: 3 active+recovering+undersized+remapped, 175 active+clean; 5.3 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.2 KiB/s rd, 31 MiB/s wr, 831 op/s; 568/261882 objects misplaced (0.217%); 2.2 MiB/s, 34 objects/s recovering 2021-10-08T19:29:27.993 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:29:27.997 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:27.998 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:29:28.099 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:29:28.164 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:28.291 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:29:28.292 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2021-10-08T19:29:28.292 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.292 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:94503 8.f 8:f8517c56:::benchmark_data_smithi097_144160_object5763:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e227)", 2021-10-08T19:29:28.292 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:28.252477+0000", 2021-10-08T19:29:28.293 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.024896940999999999, 2021-10-08T19:29:28.293 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.024941479999999999, 2021-10-08T19:29:28.293 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:29:28.293 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2021-10-08T19:29:28.294 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:29:28.294 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:29:28.294 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:29:28.294 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 94503 2021-10-08T19:29:28.294 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.295 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:29:28.295 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.295 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:29:28.295 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.252477+0000", 2021-10-08T19:29:28.296 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:29:28.296 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.296 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.296 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:29:28.297 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.252477+0000", 2021-10-08T19:29:28.297 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:29:28.297 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.297 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.297 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:29:28.298 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.252476+0000", 2021-10-08T19:29:28.298 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:29:28.298 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.298 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.299 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:29:28.299 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.252479+0000", 2021-10-08T19:29:28.299 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.569e-06 2021-10-08T19:29:28.299 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.299 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.300 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:29:28.300 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.252485+0000", 2021-10-08T19:29:28.300 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.908e-06 2021-10-08T19:29:28.300 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.300 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.301 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:29:28.301 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.252490+0000", 2021-10-08T19:29:28.301 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5120000000000002e-06 2021-10-08T19:29:28.301 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.302 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.302 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:29:28.302 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.252515+0000", 2021-10-08T19:29:28.302 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5099000000000001e-05 2021-10-08T19:29:28.302 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.303 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.303 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:29:28.303 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.252632+0000", 2021-10-08T19:29:28.303 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011712 2021-10-08T19:29:28.304 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.304 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.304 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,2", 2021-10-08T19:29:28.304 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.252772+0000", 2021-10-08T19:29:28.305 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000139779 2021-10-08T19:29:28.305 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.305 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.305 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:29:28.305 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.262283+0000", 2021-10-08T19:29:28.306 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0095117580000000004 2021-10-08T19:29:28.306 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.306 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.306 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:29:28.307 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.275187+0000", 2021-10-08T19:29:28.307 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012904097 2021-10-08T19:29:28.307 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:28.307 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:29:28.307 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:28.308 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.308 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.308 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:94507 8.0 8:04185926:::benchmark_data_smithi097_144160_object5767:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e227)", 2021-10-08T19:29:28.308 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:28.252499+0000", 2021-10-08T19:29:28.309 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.024874856000000001, 2021-10-08T19:29:28.309 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.025019023000000001, 2021-10-08T19:29:28.309 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:29:28.309 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2021-10-08T19:29:28.309 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:29:28.310 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:29:28.310 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:29:28.310 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 94507 2021-10-08T19:29:28.310 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.311 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:29:28.311 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.311 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:29:28.311 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.252499+0000", 2021-10-08T19:29:28.312 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:29:28.312 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.312 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.312 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:29:28.312 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.252499+0000", 2021-10-08T19:29:28.313 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:29:28.313 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.313 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.313 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:29:28.314 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.252498+0000", 2021-10-08T19:29:28.314 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2021-10-08T19:29:28.314 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.314 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.314 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:29:28.315 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.252501+0000", 2021-10-08T19:29:28.315 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.247e-06 2021-10-08T19:29:28.315 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.315 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.316 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:29:28.316 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.252514+0000", 2021-10-08T19:29:28.316 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2384999999999999e-05 2021-10-08T19:29:28.316 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.316 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.317 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:29:28.317 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.252519+0000", 2021-10-08T19:29:28.317 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9840000000000001e-06 2021-10-08T19:29:28.317 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.318 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.318 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:29:28.318 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.257305+0000", 2021-10-08T19:29:28.318 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0047862740000000001 2021-10-08T19:29:28.318 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.319 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.319 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:29:28.319 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.257458+0000", 2021-10-08T19:29:28.319 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015354799999999999 2021-10-08T19:29:28.320 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.320 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.320 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,5", 2021-10-08T19:29:28.320 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.257610+0000", 2021-10-08T19:29:28.321 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015187100000000001 2021-10-08T19:29:28.321 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.321 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.321 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:29:28.321 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.262656+0000", 2021-10-08T19:29:28.322 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0050453649999999996 2021-10-08T19:29:28.322 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.322 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.322 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:29:28.323 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.262686+0000", 2021-10-08T19:29:28.323 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9946000000000001e-05 2021-10-08T19:29:28.323 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:28.323 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:29:28.323 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:28.324 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.324 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.324 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:94508 8.f 8:f1433068:::benchmark_data_smithi097_144160_object5768:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e227)", 2021-10-08T19:29:28.324 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:28.252525+0000", 2021-10-08T19:29:28.325 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.024848127000000001, 2021-10-08T19:29:28.325 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.025086450999999999, 2021-10-08T19:29:28.325 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:29:28.325 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2021-10-08T19:29:28.325 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:29:28.326 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:29:28.326 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:29:28.326 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 94508 2021-10-08T19:29:28.326 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.327 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:29:28.327 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.327 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:29:28.327 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.252525+0000", 2021-10-08T19:29:28.327 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:29:28.328 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.328 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.328 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:29:28.328 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.252525+0000", 2021-10-08T19:29:28.329 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:29:28.329 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.329 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.329 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:29:28.329 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.252525+0000", 2021-10-08T19:29:28.330 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:29:28.330 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.330 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.330 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:29:28.331 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.252528+0000", 2021-10-08T19:29:28.331 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3340000000000002e-06 2021-10-08T19:29:28.331 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.331 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.331 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:29:28.332 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.252534+0000", 2021-10-08T19:29:28.332 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8130000000000001e-06 2021-10-08T19:29:28.332 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.332 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.333 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:29:28.333 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.252538+0000", 2021-10-08T19:29:28.333 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3100000000000002e-06 2021-10-08T19:29:28.333 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.333 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.334 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:29:28.334 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.256048+0000", 2021-10-08T19:29:28.334 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0035099390000000001 2021-10-08T19:29:28.334 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.335 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.335 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:29:28.335 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.256187+0000", 2021-10-08T19:29:28.335 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000138553 2021-10-08T19:29:28.336 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.336 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.336 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,2", 2021-10-08T19:29:28.336 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.256314+0000", 2021-10-08T19:29:28.336 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000127711 2021-10-08T19:29:28.337 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.337 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.337 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:29:28.337 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.262291+0000", 2021-10-08T19:29:28.337 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0059770370000000001 2021-10-08T19:29:28.338 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:28.338 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:29:28.338 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:28.338 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.339 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.339 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:94512 8.f 8:f97246fa:::benchmark_data_smithi097_144160_object5772:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e227)", 2021-10-08T19:29:28.339 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:28.259354+0000", 2021-10-08T19:29:28.339 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.018019490999999999, 2021-10-08T19:29:28.339 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.018348291999999999, 2021-10-08T19:29:28.340 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:29:28.340 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2021-10-08T19:29:28.340 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:29:28.340 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:29:28.341 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:29:28.341 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 94512 2021-10-08T19:29:28.341 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.341 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:29:28.341 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.342 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:29:28.342 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.259354+0000", 2021-10-08T19:29:28.342 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:29:28.342 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.343 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.343 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:29:28.343 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.259354+0000", 2021-10-08T19:29:28.343 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:29:28.343 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.344 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.344 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:29:28.344 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.259351+0000", 2021-10-08T19:29:28.344 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2021-10-08T19:29:28.344 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.345 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.345 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:29:28.345 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.259359+0000", 2021-10-08T19:29:28.345 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8210000000000002e-06 2021-10-08T19:29:28.346 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.346 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.346 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:29:28.346 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.259373+0000", 2021-10-08T19:29:28.346 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3828e-05 2021-10-08T19:29:28.347 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.347 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.347 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:29:28.347 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.259379+0000", 2021-10-08T19:29:28.348 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3210000000000001e-06 2021-10-08T19:29:28.348 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.348 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.348 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:29:28.348 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.259491+0000", 2021-10-08T19:29:28.349 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011142299999999999 2021-10-08T19:29:28.349 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.349 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.349 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:29:28.350 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.259615+0000", 2021-10-08T19:29:28.350 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012437799999999999 2021-10-08T19:29:28.350 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.350 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.350 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,2", 2021-10-08T19:29:28.351 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.259741+0000", 2021-10-08T19:29:28.351 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012576800000000001 2021-10-08T19:29:28.351 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.351 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.352 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:29:28.352 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.262601+0000", 2021-10-08T19:29:28.352 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002859678 2021-10-08T19:29:28.352 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:28.352 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:29:28.353 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:28.353 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.353 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.353 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:94516 8.0 8:0fe83a71:::benchmark_data_smithi097_144160_object5776:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e227)", 2021-10-08T19:29:28.354 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:28.263604+0000", 2021-10-08T19:29:28.354 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.013769593, 2021-10-08T19:29:28.354 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.014187485999999999, 2021-10-08T19:29:28.354 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:29:28.354 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2021-10-08T19:29:28.355 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:29:28.355 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:29:28.355 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:29:28.355 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 94516 2021-10-08T19:29:28.356 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.356 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:29:28.356 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.356 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:29:28.356 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.263604+0000", 2021-10-08T19:29:28.357 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:29:28.357 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.357 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.357 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:29:28.358 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.263604+0000", 2021-10-08T19:29:28.358 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:29:28.358 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.358 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.358 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:29:28.359 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.263601+0000", 2021-10-08T19:29:28.359 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2021-10-08T19:29:28.359 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.359 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.360 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:29:28.360 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.263610+0000", 2021-10-08T19:29:28.360 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5329999999999994e-06 2021-10-08T19:29:28.360 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.360 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.361 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:29:28.361 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.263623+0000", 2021-10-08T19:29:28.361 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2856e-05 2021-10-08T19:29:28.361 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.361 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.362 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:29:28.362 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.263630+0000", 2021-10-08T19:29:28.362 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6669999999999996e-06 2021-10-08T19:29:28.362 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.363 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.363 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:29:28.363 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.266337+0000", 2021-10-08T19:29:28.363 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0027062420000000002 2021-10-08T19:29:28.363 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.364 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.364 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:29:28.364 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.266479+0000", 2021-10-08T19:29:28.364 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000141998 2021-10-08T19:29:28.365 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.365 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.365 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,5", 2021-10-08T19:29:28.365 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.266628+0000", 2021-10-08T19:29:28.365 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014977299999999999 2021-10-08T19:29:28.366 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.366 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.366 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:29:28.366 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.271831+0000", 2021-10-08T19:29:28.367 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0052027719999999996 2021-10-08T19:29:28.367 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.367 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.367 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:29:28.367 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.274430+0000", 2021-10-08T19:29:28.368 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0025989479999999998 2021-10-08T19:29:28.368 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:28.368 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:29:28.368 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:28.369 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.369 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.369 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:94517 8.b 8:d84d78ba:::benchmark_data_smithi097_144160_object5777:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e227)", 2021-10-08T19:29:28.369 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:28.263700+0000", 2021-10-08T19:29:28.369 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.013673859999999999, 2021-10-08T19:29:28.370 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.014179017, 2021-10-08T19:29:28.370 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:29:28.370 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2021-10-08T19:29:28.370 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:29:28.371 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:29:28.371 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:29:28.371 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 94517 2021-10-08T19:29:28.371 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.371 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:29:28.372 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.372 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:29:28.372 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.263700+0000", 2021-10-08T19:29:28.372 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:29:28.373 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.373 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.373 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:29:28.373 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.263700+0000", 2021-10-08T19:29:28.373 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:29:28.374 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.374 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.374 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:29:28.374 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.263698+0000", 2021-10-08T19:29:28.374 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:29:28.375 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.375 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.375 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:29:28.375 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.263714+0000", 2021-10-08T19:29:28.376 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6135000000000001e-05 2021-10-08T19:29:28.376 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.376 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.376 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:29:28.376 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.263726+0000", 2021-10-08T19:29:28.377 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1841000000000001e-05 2021-10-08T19:29:28.377 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.377 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.377 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:29:28.378 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.263732+0000", 2021-10-08T19:29:28.378 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6209999999999998e-06 2021-10-08T19:29:28.378 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.378 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.379 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:29:28.379 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.263778+0000", 2021-10-08T19:29:28.379 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5219999999999997e-05 2021-10-08T19:29:28.379 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.379 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.380 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:29:28.380 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.263893+0000", 2021-10-08T19:29:28.380 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115704 2021-10-08T19:29:28.380 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.381 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.381 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:29:28.381 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.263994+0000", 2021-10-08T19:29:28.381 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000100414 2021-10-08T19:29:28.381 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.382 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.382 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:29:28.382 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.274376+0000", 2021-10-08T19:29:28.382 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010382634999999999 2021-10-08T19:29:28.383 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:28.383 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:29:28.383 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:28.383 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.383 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.384 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop_reply(client.15147.0:94503 8.f e227/212)", 2021-10-08T19:29:28.384 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:28.277479+0000", 2021-10-08T19:29:28.384 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4294967295.9998946, 2021-10-08T19:29:28.384 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00048023199999999998, 2021-10-08T19:29:28.384 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:29:28.385 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "queued for pg", 2021-10-08T19:29:28.385 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:29:28.385 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.385 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:29:28.386 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.277479+0000", 2021-10-08T19:29:28.386 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:29:28.386 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.386 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.386 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:29:28.387 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.277479+0000", 2021-10-08T19:29:28.387 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:29:28.387 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.387 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.388 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:29:28.388 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.277478+0000", 2021-10-08T19:29:28.388 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2021-10-08T19:29:28.388 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.388 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.389 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:29:28.389 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.277485+0000", 2021-10-08T19:29:28.389 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0870000000000001e-06 2021-10-08T19:29:28.389 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.389 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.390 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:29:28.390 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.277499+0000", 2021-10-08T19:29:28.390 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.434e-05 2021-10-08T19:29:28.390 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.391 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.391 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:29:28.391 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.277506+0000", 2021-10-08T19:29:28.391 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.46e-06 2021-10-08T19:29:28.392 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:28.392 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:29:28.392 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:28.392 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.392 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.393 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop_reply(client.15147.0:94507 8.0 e227/202 ondisk, result = 0)", 2021-10-08T19:29:28.393 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:28.277517+0000", 2021-10-08T19:29:28.393 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4294967295.9998565, 2021-10-08T19:29:28.393 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00048608199999999999, 2021-10-08T19:29:28.393 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:29:28.394 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2021-10-08T19:29:28.394 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:29:28.394 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.394 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:29:28.395 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.277517+0000", 2021-10-08T19:29:28.395 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:29:28.395 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.395 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.395 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:29:28.396 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.277517+0000", 2021-10-08T19:29:28.396 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:29:28.396 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.396 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.397 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:29:28.397 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.277516+0000", 2021-10-08T19:29:28.397 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2021-10-08T19:29:28.397 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.397 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.398 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:29:28.398 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.277520+0000", 2021-10-08T19:29:28.398 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3720000000000001e-06 2021-10-08T19:29:28.398 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.399 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.399 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:29:28.399 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.277525+0000", 2021-10-08T19:29:28.399 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6269999999999997e-06 2021-10-08T19:29:28.399 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.400 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.400 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:29:28.400 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.277529+0000", 2021-10-08T19:29:28.400 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0659999999999997e-06 2021-10-08T19:29:28.400 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.401 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.401 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:29:28.401 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.277710+0000", 2021-10-08T19:29:28.401 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000180521 2021-10-08T19:29:28.402 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.402 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.402 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:29:28.402 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.277721+0000", 2021-10-08T19:29:28.403 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0873000000000001e-05 2021-10-08T19:29:28.403 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:28.403 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:29:28.403 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:28.403 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.404 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.404 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "MOSDPGPushReply(8.0 227/202 [PushReplyOp(8:0b94a148:::benchmark_data_smithi097_144160_object63539:head)])", 2021-10-08T19:29:28.404 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:28.277539+0000", 2021-10-08T19:29:28.404 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4294967295.9998345, 2021-10-08T19:29:28.405 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00052475099999999995, 2021-10-08T19:29:28.405 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:29:28.405 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "queued for pg", 2021-10-08T19:29:28.405 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:29:28.405 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.406 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:29:28.406 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.277539+0000", 2021-10-08T19:29:28.406 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:29:28.406 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.407 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.407 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:29:28.407 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.277539+0000", 2021-10-08T19:29:28.407 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:29:28.407 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.408 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.408 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:29:28.408 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.277539+0000", 2021-10-08T19:29:28.408 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2021-10-08T19:29:28.409 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.409 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.409 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:29:28.409 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.277543+0000", 2021-10-08T19:29:28.409 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2749999999999997e-06 2021-10-08T19:29:28.410 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.410 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.410 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:29:28.410 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.277550+0000", 2021-10-08T19:29:28.410 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8090000000000004e-06 2021-10-08T19:29:28.411 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.411 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.411 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:29:28.411 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.277554+0000", 2021-10-08T19:29:28.412 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6990000000000002e-06 2021-10-08T19:29:28.412 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:28.412 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:29:28.412 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:28.412 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.413 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.413 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:94518 8.b 8:daf5add5:::benchmark_data_smithi097_144160_object5778:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e227)", 2021-10-08T19:29:28.413 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:28.277584+0000", 2021-10-08T19:29:28.413 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4294967295.9997897, 2021-10-08T19:29:28.414 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00057336500000000005, 2021-10-08T19:29:28.414 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:29:28.414 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2021-10-08T19:29:28.414 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:29:28.414 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:29:28.415 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:29:28.415 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 94518 2021-10-08T19:29:28.415 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.415 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:29:28.415 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.416 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:29:28.416 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.277584+0000", 2021-10-08T19:29:28.416 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:29:28.416 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.417 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.417 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:29:28.417 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.277584+0000", 2021-10-08T19:29:28.417 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:29:28.417 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.418 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.418 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:29:28.418 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.277582+0000", 2021-10-08T19:29:28.418 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:29:28.418 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.419 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.419 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:29:28.419 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.277588+0000", 2021-10-08T19:29:28.419 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8699999999999997e-06 2021-10-08T19:29:28.420 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.420 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.420 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:29:28.420 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.277596+0000", 2021-10-08T19:29:28.420 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1559999999999995e-06 2021-10-08T19:29:28.421 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.421 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.421 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:29:28.421 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.277601+0000", 2021-10-08T19:29:28.422 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1150000000000002e-06 2021-10-08T19:29:28.422 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.422 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.422 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:29:28.422 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.277652+0000", 2021-10-08T19:29:28.423 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.134e-05 2021-10-08T19:29:28.423 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.423 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.423 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:29:28.423 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.277784+0000", 2021-10-08T19:29:28.424 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013117399999999999 2021-10-08T19:29:28.424 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.424 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.424 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:29:28.425 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.277913+0000", 2021-10-08T19:29:28.425 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000129231 2021-10-08T19:29:28.425 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:28.425 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:29:28.425 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:28.426 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.426 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.426 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:94523 8.f 8.25617dbf (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e227)", 2021-10-08T19:29:28.426 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:28.277614+0000", 2021-10-08T19:29:28.426 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4294967295.9997592, 2021-10-08T19:29:28.427 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00062955699999999999, 2021-10-08T19:29:28.427 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:29:28.427 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "queued for pg", 2021-10-08T19:29:28.427 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:29:28.428 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:29:28.428 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:29:28.428 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 94523 2021-10-08T19:29:28.428 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.428 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:29:28.429 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.429 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:29:28.429 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.277614+0000", 2021-10-08T19:29:28.429 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:29:28.429 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.430 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.430 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:29:28.430 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.277614+0000", 2021-10-08T19:29:28.430 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:29:28.431 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.431 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.431 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:29:28.431 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.277614+0000", 2021-10-08T19:29:28.431 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:29:28.432 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.432 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.432 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:29:28.432 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.277617+0000", 2021-10-08T19:29:28.432 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1329999999999999e-06 2021-10-08T19:29:28.433 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.433 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.433 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:29:28.433 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.277623+0000", 2021-10-08T19:29:28.434 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4760000000000003e-06 2021-10-08T19:29:28.434 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.434 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.434 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:29:28.434 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.277628+0000", 2021-10-08T19:29:28.435 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3200000000000001e-06 2021-10-08T19:29:28.435 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:28.435 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:29:28.435 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:28.435 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.436 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.436 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:94525 8.f 8.767ee51f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e227)", 2021-10-08T19:29:28.436 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:28.277632+0000", 2021-10-08T19:29:28.436 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4294967295.9997416, 2021-10-08T19:29:28.437 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000676871, 2021-10-08T19:29:28.437 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:29:28.437 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "queued for pg", 2021-10-08T19:29:28.437 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:29:28.437 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:29:28.438 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:29:28.438 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 94525 2021-10-08T19:29:28.438 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.438 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:29:28.439 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.439 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:29:28.439 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.277632+0000", 2021-10-08T19:29:28.439 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:29:28.439 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.440 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.440 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:29:28.440 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.277632+0000", 2021-10-08T19:29:28.440 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:29:28.441 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.441 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.441 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:29:28.441 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.277631+0000", 2021-10-08T19:29:28.441 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2021-10-08T19:29:28.442 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.442 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.442 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:29:28.442 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.277634+0000", 2021-10-08T19:29:28.442 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.469e-06 2021-10-08T19:29:28.443 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.443 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.443 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:29:28.443 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.277639+0000", 2021-10-08T19:29:28.444 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1630000000000004e-06 2021-10-08T19:29:28.444 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:28.444 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:28.444 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:29:28.444 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:28.277643+0000", 2021-10-08T19:29:28.445 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9759999999999997e-06 2021-10-08T19:29:28.445 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:28.445 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:29:28.445 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:28.446 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:28.446 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:29:28.446 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 12 2021-10-08T19:29:28.446 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:29:28.447 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:28.448 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:29:28.448 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:29:28.449 INFO:journalctl@ceph.osd.2.smithi097.stdout:Oct 08 19:29:28 smithi097 conmon[55904]: 2021-10-08T19:29:28.387+0000 7f5996643700 -1 osd.2 pg_epoch: 227 pg[2.e( empty local-lis/les=60/61 n=0 ec=60/60 lis/c=60/60 les/c/f=61/61/0 sis=60) [2,3,7] r=0 lpr=60 crt=0'0 mlcod 0'0 active+clean] scrubber pg(2.e) handle_scrub_reserve_grant: received unsolicited reservation grant from osd 7 (0x56222718a9a0) 2021-10-08T19:29:28.550 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:29:28.578 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:28.649 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:29:28.653 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:28.654 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:29:28.755 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:29:28.822 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:29.042 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:28 smithi097 conmon[32664]: 2021-10-08T19:29:28.734+0000 7f605f9d6700 -1 mon.a@0(leader).osd e227 definitely_dead 0 2021-10-08T19:29:29.263 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:29:29.268 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:29.269 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:29:29.370 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:29:29.414 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:29.466 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2021-10-08T19:29:29.495 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:29:29.500 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:29.501 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:29:29.586 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2021-10-08T19:29:29.602 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:29:29.631 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:29.688 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:29:29.694 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:29 smithi117 ceph-mon[34585]: pgmap v390: 178 pgs: 3 active+recovering+undersized+remapped, 175 active+clean; 5.2 GiB data, 17 GiB used, 699 GiB / 715 GiB avail; 1.8 KiB/s rd, 26 MiB/s wr, 1.02k op/s; 511/256059 objects misplaced (0.200%); 2.4 MiB/s, 38 objects/s recovering 2021-10-08T19:29:29.694 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:29 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2002560625' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["3"]}]: dispatch 2021-10-08T19:29:29.694 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:29 smithi117 ceph-mon[34585]: from='client.35264 ' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["3"]}]: dispatch 2021-10-08T19:29:29.694 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:29 smithi117 ceph-mon[34585]: Client client.admin marked osd.3 out, while it was still marked up 2021-10-08T19:29:29.695 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:29.696 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:29:29.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:29 smithi097 ceph-mon[41966]: pgmap v390: 178 pgs: 3 active+recovering+undersized+remapped, 175 active+clean; 5.2 GiB data, 17 GiB used, 699 GiB / 715 GiB avail; 1.8 KiB/s rd, 26 MiB/s wr, 1.02k op/s; 511/256059 objects misplaced (0.200%); 2.4 MiB/s, 38 objects/s recovering 2021-10-08T19:29:29.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:29 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2002560625' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["3"]}]: dispatch 2021-10-08T19:29:29.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:29 smithi097 ceph-mon[41966]: from='client.35264 ' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["3"]}]: dispatch 2021-10-08T19:29:29.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:29 smithi097 ceph-mon[41966]: Client client.admin marked osd.3 out, while it was still marked up 2021-10-08T19:29:29.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:29 smithi097 ceph-mon[32687]: pgmap v390: 178 pgs: 3 active+recovering+undersized+remapped, 175 active+clean; 5.2 GiB data, 17 GiB used, 699 GiB / 715 GiB avail; 1.8 KiB/s rd, 26 MiB/s wr, 1.02k op/s; 511/256059 objects misplaced (0.200%); 2.4 MiB/s, 38 objects/s recovering 2021-10-08T19:29:29.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:29 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2002560625' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["3"]}]: dispatch 2021-10-08T19:29:29.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:29 smithi097 ceph-mon[32687]: from='client.35264 ' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["3"]}]: dispatch 2021-10-08T19:29:29.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:29 smithi097 ceph-mon[32687]: Client client.admin marked osd.3 out, while it was still marked up 2021-10-08T19:29:29.726 INFO:teuthology.orchestra.run.smithi097.stderr:marked out osd.3. 2021-10-08T19:29:29.797 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:29:29.822 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:29.866 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:29:29.868 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:29.868 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:29:29.970 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:29:29.992 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:30.035 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:29:30.037 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:30.038 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:29:30.140 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:29:30.163 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:30.207 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:29:30.209 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:30.210 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:29:30.311 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:29:30.333 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:30.375 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:29:30.378 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:30.378 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:29:30.479 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:29:30.508 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:30.722 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:29:30.787 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:29:30.913 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:29:30.915 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:30 smithi097 ceph-mon[41966]: from='client.35264 ' entity='client.admin' cmd='[{"prefix": "osd out", "ids": ["3"]}]': finished 2021-10-08T19:29:30.915 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:30 smithi097 ceph-mon[41966]: osdmap e228: 8 total, 8 up, 7 in 2021-10-08T19:29:30.916 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:30 smithi097 ceph-mon[41966]: osdmap e229: 8 total, 8 up, 7 in 2021-10-08T19:29:30.916 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:30.917 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:29:30.918 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:30 smithi097 ceph-mon[32687]: from='client.35264 ' entity='client.admin' cmd='[{"prefix": "osd out", "ids": ["3"]}]': finished 2021-10-08T19:29:30.918 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:30 smithi097 ceph-mon[32687]: osdmap e228: 8 total, 8 up, 7 in 2021-10-08T19:29:30.918 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:30 smithi097 ceph-mon[32687]: osdmap e229: 8 total, 8 up, 7 in 2021-10-08T19:29:31.018 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:29:31.039 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:30 smithi117 ceph-mon[34585]: from='client.35264 ' entity='client.admin' cmd='[{"prefix": "osd out", "ids": ["3"]}]': finished 2021-10-08T19:29:31.040 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:30 smithi117 ceph-mon[34585]: osdmap e228: 8 total, 8 up, 7 in 2021-10-08T19:29:31.040 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:30 smithi117 ceph-mon[34585]: osdmap e229: 8 total, 8 up, 7 in 2021-10-08T19:29:31.042 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:31.089 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:29:31.092 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:31.093 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:29:31.194 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:29:31.217 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:31.259 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:29:31.261 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:31.262 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:29:31.363 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:29:31.393 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:31.437 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:29:31.440 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:31.440 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:29:31.541 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:29:31.565 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:31.629 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is unset 2021-10-08T19:29:31.880 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:31 smithi097 ceph-mon[41966]: 5.1e scrub ok 2021-10-08T19:29:31.881 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:31 smithi097 ceph-mon[41966]: pgmap v393: 178 pgs: 3 active+recovering+undersized+remapped, 175 active+clean; 5.0 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 857 B/s rd, 0 B/s wr, 748 op/s; 395/248478 objects misplaced (0.159%); 1.8 MiB/s, 28 objects/s recovering 2021-10-08T19:29:31.881 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:31 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2871708889' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:29:31.881 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:31 smithi097 ceph-mon[41966]: from='client.35270 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:29:31.881 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:31 smithi097 ceph-mon[41966]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:29:31.882 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:31 smithi097 ceph-mon[41966]: Cluster is now healthy 2021-10-08T19:29:31.883 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:31 smithi097 ceph-mon[41966]: from='client.35270 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:29:31.883 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:31 smithi097 ceph-mon[41966]: osdmap e230: 8 total, 8 up, 7 in 2021-10-08T19:29:31.883 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:31 smithi097 ceph-mon[32687]: 5.1e scrub ok 2021-10-08T19:29:31.884 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:31 smithi097 ceph-mon[32687]: pgmap v393: 178 pgs: 3 active+recovering+undersized+remapped, 175 active+clean; 5.0 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 857 B/s rd, 0 B/s wr, 748 op/s; 395/248478 objects misplaced (0.159%); 1.8 MiB/s, 28 objects/s recovering 2021-10-08T19:29:31.884 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:31 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2871708889' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:29:31.884 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:31 smithi097 ceph-mon[32687]: from='client.35270 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:29:31.884 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:31 smithi097 ceph-mon[32687]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:29:31.885 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:31 smithi097 ceph-mon[32687]: Cluster is now healthy 2021-10-08T19:29:31.885 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:31 smithi097 ceph-mon[32687]: from='client.35270 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:29:31.885 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:31 smithi097 ceph-mon[32687]: osdmap e230: 8 total, 8 up, 7 in 2021-10-08T19:29:32.088 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:29:32.094 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:32.095 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:29:32.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:31 smithi117 ceph-mon[34585]: 5.1e scrub ok 2021-10-08T19:29:32.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:31 smithi117 ceph-mon[34585]: pgmap v393: 178 pgs: 3 active+recovering+undersized+remapped, 175 active+clean; 5.0 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 857 B/s rd, 0 B/s wr, 748 op/s; 395/248478 objects misplaced (0.159%); 1.8 MiB/s, 28 objects/s recovering 2021-10-08T19:29:32.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:31 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2871708889' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:29:32.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:31 smithi117 ceph-mon[34585]: from='client.35270 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:29:32.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:31 smithi117 ceph-mon[34585]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:29:32.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:31 smithi117 ceph-mon[34585]: Cluster is now healthy 2021-10-08T19:29:32.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:31 smithi117 ceph-mon[34585]: from='client.35270 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:29:32.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:31 smithi117 ceph-mon[34585]: osdmap e230: 8 total, 8 up, 7 in 2021-10-08T19:29:32.196 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:29:32.223 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:32.656 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:29:32 smithi117 conmon[69189]: level=error ts=2021-10-08T19:29:32.314Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=1 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:29:32.970 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:29:32 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:29:32] "GET /metrics HTTP/1.1" 200 155805 "" "Prometheus/2.18.1" 2021-10-08T19:29:32.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:32 smithi097 ceph-mon[41966]: 8.f starting backfill to osd.4 from (0'0,0'0] MAX to 227'5929 2021-10-08T19:29:32.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:32 smithi097 ceph-mon[41966]: 8.7 starting backfill to osd.2 from (0'0,0'0] MAX to 227'6052 2021-10-08T19:29:32.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:32 smithi097 ceph-mon[41966]: 8.c starting backfill to osd.5 from (0'0,0'0] MAX to 227'6068 2021-10-08T19:29:32.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:32 smithi097 ceph-mon[41966]: 8.8 starting backfill to osd.0 from (0'0,0'0] MAX to 227'6112 2021-10-08T19:29:32.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:32 smithi097 ceph-mon[41966]: osdmap e231: 8 total, 8 up, 7 in 2021-10-08T19:29:32.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:32 smithi097 ceph-mon[32687]: 8.f starting backfill to osd.4 from (0'0,0'0] MAX to 227'5929 2021-10-08T19:29:32.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:32 smithi097 ceph-mon[32687]: 8.7 starting backfill to osd.2 from (0'0,0'0] MAX to 227'6052 2021-10-08T19:29:32.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:32 smithi097 ceph-mon[32687]: 8.c starting backfill to osd.5 from (0'0,0'0] MAX to 227'6068 2021-10-08T19:29:32.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:32 smithi097 ceph-mon[32687]: 8.8 starting backfill to osd.0 from (0'0,0'0] MAX to 227'6112 2021-10-08T19:29:32.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:32 smithi097 ceph-mon[32687]: osdmap e231: 8 total, 8 up, 7 in 2021-10-08T19:29:33.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:32 smithi117 ceph-mon[34585]: 8.f starting backfill to osd.4 from (0'0,0'0] MAX to 227'5929 2021-10-08T19:29:33.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:32 smithi117 ceph-mon[34585]: 8.7 starting backfill to osd.2 from (0'0,0'0] MAX to 227'6052 2021-10-08T19:29:33.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:32 smithi117 ceph-mon[34585]: 8.c starting backfill to osd.5 from (0'0,0'0] MAX to 227'6068 2021-10-08T19:29:33.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:32 smithi117 ceph-mon[34585]: 8.8 starting backfill to osd.0 from (0'0,0'0] MAX to 227'6112 2021-10-08T19:29:33.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:32 smithi117 ceph-mon[34585]: osdmap e231: 8 total, 8 up, 7 in 2021-10-08T19:29:33.477 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:29:33.480 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:33.481 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:29:33.582 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:29:33.610 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:33.671 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:29:33.676 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:33.677 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:29:33.778 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:29:33.807 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:33.853 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:29:33.857 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:33.857 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:29:33.867 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:33 smithi117 ceph-mon[34585]: pgmap v396: 178 pgs: 3 active+recovering+undersized+remapped, 175 active+clean; 5.0 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 0 B/s wr, 631 op/s; 395/248478 objects misplaced (0.159%); 1.8 MiB/s, 28 objects/s recovering 2021-10-08T19:29:33.868 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:33 smithi117 ceph-mon[34585]: osdmap e232: 8 total, 8 up, 7 in 2021-10-08T19:29:33.899 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:29:33.899 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2021-10-08T19:29:33.900 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2021-10-08T19:29:33.900 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2021-10-08T19:29:33.900 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:29:33.919 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:33 smithi097 ceph-mon[41966]: pgmap v396: 178 pgs: 3 active+recovering+undersized+remapped, 175 active+clean; 5.0 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 0 B/s wr, 631 op/s; 395/248478 objects misplaced (0.159%); 1.8 MiB/s, 28 objects/s recovering 2021-10-08T19:29:33.919 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:33 smithi097 ceph-mon[41966]: osdmap e232: 8 total, 8 up, 7 in 2021-10-08T19:29:33.919 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:33 smithi097 ceph-mon[32687]: pgmap v396: 178 pgs: 3 active+recovering+undersized+remapped, 175 active+clean; 5.0 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 0 B/s wr, 631 op/s; 395/248478 objects misplaced (0.159%); 1.8 MiB/s, 28 objects/s recovering 2021-10-08T19:29:33.920 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:33 smithi097 ceph-mon[32687]: osdmap e232: 8 total, 8 up, 7 in 2021-10-08T19:29:33.958 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:29:33.984 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:34.035 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:29:34.037 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:34.038 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:29:34.139 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:29:34.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:29:33 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:29:33] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:29:34.166 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:34.218 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:29:34.221 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:34.222 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:29:34.323 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:29:34.348 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:34.511 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:29:34.511 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:29:34.520 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:29:34.539 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:29:34.698 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2021-10-08T19:29:34.699 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:29:34.702 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:34.703 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:29:34.725 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:34 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/422829947' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:29:34.803 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:29:34.827 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:34.881 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:29:34.884 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:34.884 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:29:34.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:34 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/422829947' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:29:34.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:34 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/422829947' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:29:34.986 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:29:35.007 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:29:35.013 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:35.061 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:29:35.065 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:35.066 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:29:35.166 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:29:35.190 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:35.245 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:29:35.247 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:35.248 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:29:35.312 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set noscrub 2021-10-08T19:29:35.350 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:29:35.379 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:35.423 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:29:35.426 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:35.427 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:29:35.528 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:29:35.559 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:35.745 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 4, 5, 7, 6, 1] out_osds: [3] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2021-10-08T19:29:35.746 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2021-10-08T19:29:35.746 INFO:tasks.thrashosds.thrasher:Adding osd 3 2021-10-08T19:29:35.746 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd in 3 2021-10-08T19:29:35.868 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:29:35.870 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:35 smithi097 ceph-mon[32687]: pgmap v398: 178 pgs: 2 active+remapped+backfilling, 2 active+remapped+backfill_toofull, 1 active+recovering+undersized+degraded+remapped, 4 peering, 2 active+recovering+undersized+remapped, 167 active+clean; 5.0 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 0 B/s wr, 279 op/s; 16/245094 objects degraded (0.007%); 25200/245094 objects misplaced (10.282%); 3.4 MiB/s, 63 objects/s recovering 2021-10-08T19:29:35.871 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:35 smithi097 ceph-mon[32687]: Health check failed: Low space hindering backfill (add storage if this doesn't resolve itself): 2 pgs backfill_toofull (PG_BACKFILL_FULL) 2021-10-08T19:29:35.871 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:35 smithi097 ceph-mon[32687]: Health check failed: Degraded data redundancy: 16/245094 objects degraded (0.007%), 1 pg degraded (PG_DEGRADED) 2021-10-08T19:29:35.871 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:35 smithi097 ceph-mon[32687]: osdmap e233: 8 total, 8 up, 7 in 2021-10-08T19:29:35.872 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:35 smithi097 ceph-mon[41966]: pgmap v398: 178 pgs: 2 active+remapped+backfilling, 2 active+remapped+backfill_toofull, 1 active+recovering+undersized+degraded+remapped, 4 peering, 2 active+recovering+undersized+remapped, 167 active+clean; 5.0 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 0 B/s wr, 279 op/s; 16/245094 objects degraded (0.007%); 25200/245094 objects misplaced (10.282%); 3.4 MiB/s, 63 objects/s recovering 2021-10-08T19:29:35.872 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:35 smithi097 ceph-mon[41966]: Health check failed: Low space hindering backfill (add storage if this doesn't resolve itself): 2 pgs backfill_toofull (PG_BACKFILL_FULL) 2021-10-08T19:29:35.872 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:35 smithi097 ceph-mon[41966]: Health check failed: Degraded data redundancy: 16/245094 objects degraded (0.007%), 1 pg degraded (PG_DEGRADED) 2021-10-08T19:29:35.872 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:35 smithi097 ceph-mon[41966]: osdmap e233: 8 total, 8 up, 7 in 2021-10-08T19:29:35.873 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:35.874 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:29:35.975 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:29:35.997 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:36.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:35 smithi117 ceph-mon[34585]: pgmap v398: 178 pgs: 2 active+remapped+backfilling, 2 active+remapped+backfill_toofull, 1 active+recovering+undersized+degraded+remapped, 4 peering, 2 active+recovering+undersized+remapped, 167 active+clean; 5.0 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 0 B/s wr, 279 op/s; 16/245094 objects degraded (0.007%); 25200/245094 objects misplaced (10.282%); 3.4 MiB/s, 63 objects/s recovering 2021-10-08T19:29:36.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:35 smithi117 ceph-mon[34585]: Health check failed: Low space hindering backfill (add storage if this doesn't resolve itself): 2 pgs backfill_toofull (PG_BACKFILL_FULL) 2021-10-08T19:29:36.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:35 smithi117 ceph-mon[34585]: Health check failed: Degraded data redundancy: 16/245094 objects degraded (0.007%), 1 pg degraded (PG_DEGRADED) 2021-10-08T19:29:36.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:35 smithi117 ceph-mon[34585]: osdmap e233: 8 total, 8 up, 7 in 2021-10-08T19:29:36.203 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:29:36.205 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:36.206 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:29:36.267 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:29:36.308 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:29:36.318 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:29:36.335 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:36.385 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:29:36.390 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:36.391 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:29:36.492 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:29:36.517 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:36.573 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:29:36.576 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:36.577 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:29:36.655 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:29:36 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:29:36.678 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:29:36.704 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:36.769 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2021-10-08T19:29:36.769 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:29:37.059 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:29:37.062 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:37.063 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:29:37.164 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:29:37.187 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:37.236 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:29:37.238 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:37.239 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:29:37.340 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:29:37.366 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:37.413 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:29:37.416 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:37.417 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:29:37.518 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:29:37.541 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:37.586 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:29:37.588 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:37.589 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:29:37.690 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:29:37.714 INFO:journalctl@ceph.osd.0.smithi097.stdout:Oct 08 19:29:37 smithi097 conmon[47373]: 2021-10-08T19:29:37.435+0000 7f8336794700 -1 osd.0 pg_epoch: 233 pg[6.13( empty local-lis/les=228/229 n=0 ec=66/66 lis/c=228/228 les/c/f=229/229/0 sis=228) [0,6,2] r=0 lpr=228 crt=0'0 mlcod 0'0 active+clean] scrubber pg(6.13) handle_scrub_reserve_grant: received unsolicited reservation grant from osd 6 (0x55cbf8c3e6e0) 2021-10-08T19:29:37.717 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:37.819 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:29:37.822 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:37.823 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:29:37.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:37 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:29:37.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:37 smithi117 ceph-mon[34585]: pgmap v400: 178 pgs: 2 active+remapped+backfilling, 2 active+remapped+backfill_toofull, 1 active+recovering+undersized+degraded+remapped, 4 peering, 2 active+recovering+undersized+remapped, 167 active+clean; 5.0 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 0 B/s wr, 224 op/s; 16/245094 objects degraded (0.007%); 25200/245094 objects misplaced (10.282%); 2.7 MiB/s, 50 objects/s recovering 2021-10-08T19:29:37.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:37 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:29:37.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:37 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:29:37.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:37 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:29:37.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:37 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:29:37.924 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:29:37.946 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:37.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:37 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:29:37.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:37 smithi097 ceph-mon[41966]: pgmap v400: 178 pgs: 2 active+remapped+backfilling, 2 active+remapped+backfill_toofull, 1 active+recovering+undersized+degraded+remapped, 4 peering, 2 active+recovering+undersized+remapped, 167 active+clean; 5.0 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 0 B/s wr, 224 op/s; 16/245094 objects degraded (0.007%); 25200/245094 objects misplaced (10.282%); 2.7 MiB/s, 50 objects/s recovering 2021-10-08T19:29:37.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:37 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:29:37.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:37 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:29:37.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:37 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:29:37.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:37 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:29:37.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:37 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:29:37.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:37 smithi097 ceph-mon[32687]: pgmap v400: 178 pgs: 2 active+remapped+backfilling, 2 active+remapped+backfill_toofull, 1 active+recovering+undersized+degraded+remapped, 4 peering, 2 active+recovering+undersized+remapped, 167 active+clean; 5.0 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 0 B/s wr, 224 op/s; 16/245094 objects degraded (0.007%); 25200/245094 objects misplaced (10.282%); 2.7 MiB/s, 50 objects/s recovering 2021-10-08T19:29:37.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:37 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:29:37.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:37 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:29:37.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:37 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:29:37.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:37 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:29:38.310 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2021-10-08T19:29:38.344 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:29:38.346 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:38.347 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:29:38.448 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:29:38.472 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:38.620 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:29:38.622 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:38.623 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:29:38.724 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:29:38.752 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:38.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:38 smithi097 ceph-mon[41966]: osdmap e234: 8 total, 8 up, 7 in 2021-10-08T19:29:38.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:38 smithi097 ceph-mon[32687]: osdmap e234: 8 total, 8 up, 7 in 2021-10-08T19:29:39.149 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:29:39.152 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:39.153 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:29:39.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:38 smithi117 ceph-mon[34585]: osdmap e234: 8 total, 8 up, 7 in 2021-10-08T19:29:39.254 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:29:39.281 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:39.350 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:29:39.352 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:39.353 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:29:39.447 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:39 smithi097 conmon[32664]: 2021-10-08T19:29:39.177+0000 7f605f9d6700 -1 mon.a@0(leader).osd e235 definitely_dead 0 2021-10-08T19:29:39.454 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:29:39.478 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:39.775 INFO:teuthology.orchestra.run.smithi097.stderr:marked in osd.3. 2021-10-08T19:29:39.942 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:29:39.944 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:39.944 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:29:40.024 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:29:40.046 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:29:40.078 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:39 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:29:40.078 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:39 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:29:40.078 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:39 smithi097 ceph-mon[41966]: pgmap v402: 178 pgs: 1 active+recovering+undersized+degraded+remapped, 2 active+remapped+backfilling, 2 active+remapped+backfill_toofull, 2 active+recovering+undersized+remapped, 171 active+clean; 5.0 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 188 op/s; 16/245094 objects degraded (0.007%); 24870/245094 objects misplaced (10.147%); 5.7 MiB/s, 97 objects/s recovering 2021-10-08T19:29:40.079 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:39 smithi097 ceph-mon[41966]: osdmap e235: 8 total, 8 up, 7 in 2021-10-08T19:29:40.079 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:39 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3545295951' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["3"]}]: dispatch 2021-10-08T19:29:40.079 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:39 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:29:40.079 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:39 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:29:40.080 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:39 smithi097 ceph-mon[32687]: pgmap v402: 178 pgs: 1 active+recovering+undersized+degraded+remapped, 2 active+remapped+backfilling, 2 active+remapped+backfill_toofull, 2 active+recovering+undersized+remapped, 171 active+clean; 5.0 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 188 op/s; 16/245094 objects degraded (0.007%); 24870/245094 objects misplaced (10.147%); 5.7 MiB/s, 97 objects/s recovering 2021-10-08T19:29:40.080 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:39 smithi097 ceph-mon[32687]: osdmap e235: 8 total, 8 up, 7 in 2021-10-08T19:29:40.080 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:39 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3545295951' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["3"]}]: dispatch 2021-10-08T19:29:40.081 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:40.124 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:29:40.126 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:40.126 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:29:40.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:39 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:29:40.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:39 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:29:40.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:39 smithi117 ceph-mon[34585]: pgmap v402: 178 pgs: 1 active+recovering+undersized+degraded+remapped, 2 active+remapped+backfilling, 2 active+remapped+backfill_toofull, 2 active+recovering+undersized+remapped, 171 active+clean; 5.0 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 188 op/s; 16/245094 objects degraded (0.007%); 24870/245094 objects misplaced (10.147%); 5.7 MiB/s, 97 objects/s recovering 2021-10-08T19:29:40.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:39 smithi117 ceph-mon[34585]: osdmap e235: 8 total, 8 up, 7 in 2021-10-08T19:29:40.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:39 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3545295951' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["3"]}]: dispatch 2021-10-08T19:29:40.227 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:29:40.251 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:40.454 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:29:40.457 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:40.458 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:29:40.464 INFO:tasks.thrashosds.thrasher:Added osd 3 2021-10-08T19:29:40.558 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:29:40.594 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:40.622 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is set 2021-10-08T19:29:40.679 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:29:40.684 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:40.685 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:29:40.786 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:29:40.815 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:40 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3545295951' entity='client.admin' cmd='[{"prefix": "osd in", "ids": ["3"]}]': finished 2021-10-08T19:29:40.815 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:40 smithi117 ceph-mon[34585]: osdmap e236: 8 total, 8 up, 8 in 2021-10-08T19:29:40.816 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:40 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3930168236' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:29:40.816 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:40 smithi117 ceph-mon[34585]: 4.12 scrub ok 2021-10-08T19:29:40.816 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:40 smithi117 ceph-mon[34585]: 5.7 scrub ok 2021-10-08T19:29:40.816 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:40 smithi117 ceph-mon[34585]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:29:40.817 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:40 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3930168236' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:29:40.817 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:40 smithi117 ceph-mon[34585]: osdmap e237: 8 total, 8 up, 8 in 2021-10-08T19:29:40.817 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:41.173 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:29:41.176 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:41.177 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:29:41.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:40 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3545295951' entity='client.admin' cmd='[{"prefix": "osd in", "ids": ["3"]}]': finished 2021-10-08T19:29:41.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:40 smithi097 ceph-mon[41966]: osdmap e236: 8 total, 8 up, 8 in 2021-10-08T19:29:41.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:40 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3930168236' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:29:41.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:40 smithi097 ceph-mon[41966]: 4.12 scrub ok 2021-10-08T19:29:41.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:40 smithi097 ceph-mon[41966]: 5.7 scrub ok 2021-10-08T19:29:41.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:40 smithi097 ceph-mon[41966]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:29:41.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:40 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3930168236' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:29:41.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:40 smithi097 ceph-mon[41966]: osdmap e237: 8 total, 8 up, 8 in 2021-10-08T19:29:41.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:40 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3545295951' entity='client.admin' cmd='[{"prefix": "osd in", "ids": ["3"]}]': finished 2021-10-08T19:29:41.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:40 smithi097 ceph-mon[32687]: osdmap e236: 8 total, 8 up, 8 in 2021-10-08T19:29:41.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:40 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3930168236' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:29:41.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:40 smithi097 ceph-mon[32687]: 4.12 scrub ok 2021-10-08T19:29:41.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:40 smithi097 ceph-mon[32687]: 5.7 scrub ok 2021-10-08T19:29:41.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:40 smithi097 ceph-mon[32687]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:29:41.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:40 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3930168236' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:29:41.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:40 smithi097 ceph-mon[32687]: osdmap e237: 8 total, 8 up, 8 in 2021-10-08T19:29:41.277 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:29:41.308 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:41.361 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:29:41.363 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:41.364 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:29:41.466 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:29:41.495 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:42.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:41 smithi117 ceph-mon[34585]: 2.1d deep-scrub ok 2021-10-08T19:29:42.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:41 smithi117 ceph-mon[34585]: 4.3 scrub ok 2021-10-08T19:29:42.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:41 smithi117 ceph-mon[34585]: pgmap v406: 178 pgs: 1 active+clean+wait, 1 active+recovering+undersized+degraded+remapped, 2 active+remapped+backfilling, 2 active+remapped+backfill_toofull, 1 active+recovering+undersized+remapped, 171 active+clean; 5.0 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 1.2 KiB/s rd, 1 op/s; 16/245094 objects degraded (0.007%); 24713/245094 objects misplaced (10.083%); 7.6 MiB/s, 121 objects/s recovering 2021-10-08T19:29:42.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:41 smithi117 ceph-mon[34585]: Health check update: Degraded data redundancy: 16/245094 objects degraded (0.007%), 1 pg degraded, 1 pg undersized (PG_DEGRADED) 2021-10-08T19:29:42.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:41 smithi117 ceph-mon[34585]: osdmap e238: 8 total, 8 up, 8 in 2021-10-08T19:29:42.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:41 smithi097 ceph-mon[41966]: 2.1d deep-scrub ok 2021-10-08T19:29:42.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:41 smithi097 ceph-mon[41966]: 4.3 scrub ok 2021-10-08T19:29:42.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:41 smithi097 ceph-mon[41966]: pgmap v406: 178 pgs: 1 active+clean+wait, 1 active+recovering+undersized+degraded+remapped, 2 active+remapped+backfilling, 2 active+remapped+backfill_toofull, 1 active+recovering+undersized+remapped, 171 active+clean; 5.0 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 1.2 KiB/s rd, 1 op/s; 16/245094 objects degraded (0.007%); 24713/245094 objects misplaced (10.083%); 7.6 MiB/s, 121 objects/s recovering 2021-10-08T19:29:42.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:41 smithi097 ceph-mon[41966]: Health check update: Degraded data redundancy: 16/245094 objects degraded (0.007%), 1 pg degraded, 1 pg undersized (PG_DEGRADED) 2021-10-08T19:29:42.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:41 smithi097 ceph-mon[41966]: osdmap e238: 8 total, 8 up, 8 in 2021-10-08T19:29:42.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:41 smithi097 ceph-mon[32687]: 2.1d deep-scrub ok 2021-10-08T19:29:42.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:41 smithi097 ceph-mon[32687]: 4.3 scrub ok 2021-10-08T19:29:42.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:41 smithi097 ceph-mon[32687]: pgmap v406: 178 pgs: 1 active+clean+wait, 1 active+recovering+undersized+degraded+remapped, 2 active+remapped+backfilling, 2 active+remapped+backfill_toofull, 1 active+recovering+undersized+remapped, 171 active+clean; 5.0 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 1.2 KiB/s rd, 1 op/s; 16/245094 objects degraded (0.007%); 24713/245094 objects misplaced (10.083%); 7.6 MiB/s, 121 objects/s recovering 2021-10-08T19:29:42.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:41 smithi097 ceph-mon[32687]: Health check update: Degraded data redundancy: 16/245094 objects degraded (0.007%), 1 pg degraded, 1 pg undersized (PG_DEGRADED) 2021-10-08T19:29:42.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:41 smithi097 ceph-mon[32687]: osdmap e238: 8 total, 8 up, 8 in 2021-10-08T19:29:42.705 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:29:42.707 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:42.708 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:29:42.809 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:29:42.836 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:42.938 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:29:42.944 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:42.944 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:29:42.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:42 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:29:42.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:42 smithi097 ceph-mon[41966]: osdmap e239: 8 total, 8 up, 8 in 2021-10-08T19:29:42.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:42 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:29:42.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:42 smithi097 ceph-mon[32687]: osdmap e239: 8 total, 8 up, 8 in 2021-10-08T19:29:42.971 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:29:42 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:29:42] "GET /metrics HTTP/1.1" 200 155958 "" "Prometheus/2.18.1" 2021-10-08T19:29:43.000 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:42 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:29:43.000 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:42 smithi117 ceph-mon[34585]: osdmap e239: 8 total, 8 up, 8 in 2021-10-08T19:29:43.046 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:29:43.070 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:43.112 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:29:43.114 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:43.115 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:29:43.211 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:29:43.211 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2021-10-08T19:29:43.212 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.212 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:95958 8.b 8.a748255b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e230)", 2021-10-08T19:29:43.212 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:29:31.895007+0000", 2021-10-08T19:29:43.212 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 11.314118031, 2021-10-08T19:29:43.213 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 11.314140405, 2021-10-08T19:29:43.213 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:29:43.213 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "queued for pg", 2021-10-08T19:29:43.213 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:29:43.214 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:29:43.214 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:29:43.214 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 95958 2021-10-08T19:29:43.214 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.215 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:29:43.215 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.215 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:29:43.215 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:31.895007+0000", 2021-10-08T19:29:43.216 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:29:43.216 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.216 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.216 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:29:43.217 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:31.895007+0000", 2021-10-08T19:29:43.217 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:29:43.217 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.217 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.217 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:29:43.218 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:31.895005+0000", 2021-10-08T19:29:43.218 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999971 2021-10-08T19:29:43.218 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.218 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.219 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:29:43.219 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:31.895013+0000", 2021-10-08T19:29:43.219 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4810000000000006e-06 2021-10-08T19:29:43.219 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.220 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.220 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:29:43.220 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:31.895026+0000", 2021-10-08T19:29:43.220 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2599000000000001e-05 2021-10-08T19:29:43.220 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.221 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.221 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:29:43.221 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:31.895032+0000", 2021-10-08T19:29:43.221 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8129999999999998e-06 2021-10-08T19:29:43.222 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:29:43.222 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:29:43.222 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:29:43.222 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.223 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.223 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:96035 8.b 8.221b2dab (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e230)", 2021-10-08T19:29:43.223 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:29:32.051713+0000", 2021-10-08T19:29:43.223 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 11.157411845, 2021-10-08T19:29:43.224 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 11.157476782, 2021-10-08T19:29:43.224 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:29:43.224 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "queued for pg", 2021-10-08T19:29:43.224 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:29:43.224 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:29:43.225 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:29:43.225 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 96035 2021-10-08T19:29:43.225 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.225 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:29:43.226 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.226 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:29:43.226 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:32.051713+0000", 2021-10-08T19:29:43.226 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:29:43.226 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.227 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.227 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:29:43.227 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:32.051713+0000", 2021-10-08T19:29:43.227 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:29:43.228 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.228 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.228 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:29:43.228 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:32.051711+0000", 2021-10-08T19:29:43.229 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:29:43.229 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.229 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.229 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:29:43.229 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:32.051718+0000", 2021-10-08T19:29:43.230 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1269999999999997e-06 2021-10-08T19:29:43.230 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.230 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.230 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:29:43.231 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:32.051730+0000", 2021-10-08T19:29:43.231 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2051e-05 2021-10-08T19:29:43.231 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.231 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.231 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:29:43.232 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:32.051736+0000", 2021-10-08T19:29:43.232 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4500000000000003e-06 2021-10-08T19:29:43.232 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:29:43.232 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:29:43.233 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:29:43.233 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.233 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.233 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:96129 8.b 8.a9b4ba1b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e230)", 2021-10-08T19:29:43.233 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:29:32.297393+0000", 2021-10-08T19:29:43.234 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 10.911732733000001, 2021-10-08T19:29:43.234 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 10.911831532000001, 2021-10-08T19:29:43.234 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:29:43.234 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "queued for pg", 2021-10-08T19:29:43.235 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:29:43.235 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:29:43.235 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:29:43.235 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 96129 2021-10-08T19:29:43.235 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.236 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:29:43.236 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.236 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:29:43.236 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:32.297393+0000", 2021-10-08T19:29:43.237 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:29:43.237 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.237 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.237 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:29:43.238 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:32.297393+0000", 2021-10-08T19:29:43.238 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:29:43.238 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.238 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.238 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:29:43.239 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:32.297390+0000", 2021-10-08T19:29:43.239 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999971 2021-10-08T19:29:43.239 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.239 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.240 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:29:43.240 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:32.297399+0000", 2021-10-08T19:29:43.240 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.1889999999999996e-06 2021-10-08T19:29:43.240 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.241 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.241 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:29:43.241 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:32.297412+0000", 2021-10-08T19:29:43.241 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2618e-05 2021-10-08T19:29:43.241 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.242 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.242 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:29:43.242 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:32.297418+0000", 2021-10-08T19:29:43.242 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8020000000000003e-06 2021-10-08T19:29:43.243 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:29:43.243 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:29:43.243 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:29:43.243 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.244 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.244 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:96133 8.b 8.c379659b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e230)", 2021-10-08T19:29:43.244 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:29:32.308946+0000", 2021-10-08T19:29:43.244 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 10.900179744999999, 2021-10-08T19:29:43.244 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 10.900311866999999, 2021-10-08T19:29:43.245 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:29:43.245 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "queued for pg", 2021-10-08T19:29:43.245 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:29:43.245 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:29:43.246 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:29:43.246 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 96133 2021-10-08T19:29:43.246 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.246 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:29:43.246 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.247 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:29:43.247 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:32.308946+0000", 2021-10-08T19:29:43.247 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:29:43.247 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.248 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.248 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:29:43.248 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:32.308946+0000", 2021-10-08T19:29:43.248 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:29:43.248 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.249 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.249 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:29:43.249 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:32.308943+0000", 2021-10-08T19:29:43.249 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:29:43.250 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.250 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.250 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:29:43.250 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:32.308953+0000", 2021-10-08T19:29:43.251 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3680000000000008e-06 2021-10-08T19:29:43.251 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.251 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.251 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:29:43.251 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:32.308964+0000", 2021-10-08T19:29:43.252 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1863e-05 2021-10-08T19:29:43.252 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.252 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.252 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:29:43.253 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:32.308970+0000", 2021-10-08T19:29:43.253 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.327e-06 2021-10-08T19:29:43.253 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:29:43.253 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:29:43.254 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:29:43.254 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.254 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.254 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:95933 8.b 8.b4a276eb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e230)", 2021-10-08T19:29:43.254 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:29:31.733157+0000", 2021-10-08T19:29:43.255 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 11.47596837, 2021-10-08T19:29:43.255 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 11.476132356000001, 2021-10-08T19:29:43.255 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:29:43.255 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "queued for pg", 2021-10-08T19:29:43.256 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:29:43.256 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:29:43.256 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:29:43.256 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 95933 2021-10-08T19:29:43.257 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.257 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:29:43.257 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.257 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:29:43.257 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:31.733157+0000", 2021-10-08T19:29:43.258 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:29:43.258 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.258 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.258 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:29:43.259 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:31.733157+0000", 2021-10-08T19:29:43.259 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:29:43.259 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.259 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.260 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:29:43.260 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:31.733154+0000", 2021-10-08T19:29:43.260 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999967 2021-10-08T19:29:43.260 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.261 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.261 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:29:43.261 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:31.733165+0000", 2021-10-08T19:29:43.261 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0975000000000001e-05 2021-10-08T19:29:43.262 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.262 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.262 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:29:43.262 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:31.733182+0000", 2021-10-08T19:29:43.262 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7496999999999999e-05 2021-10-08T19:29:43.263 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.263 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.263 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:29:43.263 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:31.733191+0000", 2021-10-08T19:29:43.264 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3569999999999998e-06 2021-10-08T19:29:43.264 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:29:43.264 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:29:43.264 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:29:43.264 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.265 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.265 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:95935 8.b 8.a6ad14db (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e230)", 2021-10-08T19:29:43.265 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:29:31.745426+0000", 2021-10-08T19:29:43.265 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 11.463699119999999, 2021-10-08T19:29:43.266 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 11.463896384, 2021-10-08T19:29:43.266 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:29:43.266 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "queued for pg", 2021-10-08T19:29:43.266 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:29:43.266 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:29:43.267 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:29:43.267 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 95935 2021-10-08T19:29:43.267 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.267 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:29:43.268 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.268 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:29:43.268 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:31.745426+0000", 2021-10-08T19:29:43.268 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:29:43.268 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.269 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.269 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:29:43.269 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:31.745426+0000", 2021-10-08T19:29:43.269 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:29:43.270 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.270 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.270 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:29:43.270 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:31.745424+0000", 2021-10-08T19:29:43.271 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:29:43.271 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.271 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.271 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:29:43.271 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:31.745432+0000", 2021-10-08T19:29:43.272 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4069999999999993e-06 2021-10-08T19:29:43.272 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.272 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.272 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:29:43.273 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:31.745446+0000", 2021-10-08T19:29:43.273 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3754000000000001e-05 2021-10-08T19:29:43.273 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.273 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.273 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:29:43.274 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:31.745452+0000", 2021-10-08T19:29:43.274 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2160000000000003e-06 2021-10-08T19:29:43.274 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:29:43.274 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:29:43.275 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:29:43.275 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.275 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.275 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:95938 8.b 8.dcd09f5b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e230)", 2021-10-08T19:29:43.275 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:29:31.747407+0000", 2021-10-08T19:29:43.276 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 11.461718456, 2021-10-08T19:29:43.276 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 11.461947602, 2021-10-08T19:29:43.276 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:29:43.276 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "queued for pg", 2021-10-08T19:29:43.277 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:29:43.277 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:29:43.277 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:29:43.277 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 95938 2021-10-08T19:29:43.277 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.278 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:29:43.278 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.278 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:29:43.278 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:31.747407+0000", 2021-10-08T19:29:43.279 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:29:43.279 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.279 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.279 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:29:43.280 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:31.747407+0000", 2021-10-08T19:29:43.280 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:29:43.280 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.280 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.280 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:29:43.281 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:31.747405+0000", 2021-10-08T19:29:43.281 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:29:43.281 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.281 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.282 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:29:43.282 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:31.747412+0000", 2021-10-08T19:29:43.282 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0319999999999998e-06 2021-10-08T19:29:43.282 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.283 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.283 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:29:43.283 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:31.747427+0000", 2021-10-08T19:29:43.283 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5277e-05 2021-10-08T19:29:43.283 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.284 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.284 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:29:43.284 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:31.747436+0000", 2021-10-08T19:29:43.285 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3799999999999994e-06 2021-10-08T19:29:43.285 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:29:43.285 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:29:43.286 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:29:43.286 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.286 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.286 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:95872 8.b 8.e1f2aceb (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e229)", 2021-10-08T19:29:43.287 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:29:30.610521+0000", 2021-10-08T19:29:43.287 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 12.598604014999999, 2021-10-08T19:29:43.287 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 12.598865420999999, 2021-10-08T19:29:43.287 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:29:43.288 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "delayed", 2021-10-08T19:29:43.288 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:29:43.288 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:29:43.288 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:29:43.288 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 95872 2021-10-08T19:29:43.289 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.289 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:29:43.289 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.289 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:29:43.290 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:30.610521+0000", 2021-10-08T19:29:43.290 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:29:43.290 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.290 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.290 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:29:43.291 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:30.610521+0000", 2021-10-08T19:29:43.291 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:29:43.291 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.291 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.292 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:29:43.292 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:30.610519+0000", 2021-10-08T19:29:43.292 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:29:43.292 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.292 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.293 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:29:43.293 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:30.610530+0000", 2021-10-08T19:29:43.293 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1637000000000001e-05 2021-10-08T19:29:43.293 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.294 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.294 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:29:43.294 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:30.610543+0000", 2021-10-08T19:29:43.294 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2449000000000001e-05 2021-10-08T19:29:43.295 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.295 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.295 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:29:43.295 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:30.610551+0000", 2021-10-08T19:29:43.295 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.1380000000000007e-06 2021-10-08T19:29:43.296 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.296 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.296 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:29:43.296 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:30.610652+0000", 2021-10-08T19:29:43.297 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000101203 2021-10-08T19:29:43.297 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.297 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.297 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for peered", 2021-10-08T19:29:43.297 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:30.610673+0000", 2021-10-08T19:29:43.298 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0661000000000001e-05 2021-10-08T19:29:43.298 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:29:43.298 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:29:43.298 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:29:43.299 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.299 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.299 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:95883 8.b 8.122e9bcb (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e229)", 2021-10-08T19:29:43.299 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:29:30.610572+0000", 2021-10-08T19:29:43.300 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 12.598552966, 2021-10-08T19:29:43.300 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 12.598853784999999, 2021-10-08T19:29:43.300 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:29:43.300 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "delayed", 2021-10-08T19:29:43.300 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:29:43.301 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:29:43.301 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:29:43.301 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 95883 2021-10-08T19:29:43.301 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.302 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:29:43.302 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.302 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:29:43.302 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:30.610572+0000", 2021-10-08T19:29:43.303 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:29:43.303 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.303 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.303 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:29:43.304 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:30.610572+0000", 2021-10-08T19:29:43.304 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:29:43.304 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.304 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.304 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:29:43.305 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:30.610571+0000", 2021-10-08T19:29:43.305 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:29:43.305 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.305 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.306 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:29:43.306 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:30.610576+0000", 2021-10-08T19:29:43.306 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2679999999999996e-06 2021-10-08T19:29:43.306 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.306 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.307 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:29:43.307 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:30.610593+0000", 2021-10-08T19:29:43.307 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7058000000000002e-05 2021-10-08T19:29:43.307 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.308 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.308 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:29:43.308 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:30.610598+0000", 2021-10-08T19:29:43.308 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2089999999999996e-06 2021-10-08T19:29:43.309 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.309 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.309 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:29:43.309 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:30.610708+0000", 2021-10-08T19:29:43.309 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000110214 2021-10-08T19:29:43.310 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.310 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.310 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for peered", 2021-10-08T19:29:43.310 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:30.610715+0000", 2021-10-08T19:29:43.311 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.55e-06 2021-10-08T19:29:43.311 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:29:43.311 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:29:43.311 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:29:43.312 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.312 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.312 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:95989 8.b 8.23442c7b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e230)", 2021-10-08T19:29:43.312 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:29:31.968350+0000", 2021-10-08T19:29:43.312 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 11.240774986, 2021-10-08T19:29:43.313 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 11.241126408, 2021-10-08T19:29:43.313 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:29:43.313 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "queued for pg", 2021-10-08T19:29:43.313 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:29:43.313 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:29:43.314 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:29:43.314 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 95989 2021-10-08T19:29:43.314 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.314 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:29:43.315 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.315 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:29:43.315 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:31.968350+0000", 2021-10-08T19:29:43.315 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:29:43.316 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.316 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.316 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:29:43.316 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:31.968350+0000", 2021-10-08T19:29:43.316 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:29:43.317 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.317 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.317 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:29:43.317 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:31.968349+0000", 2021-10-08T19:29:43.318 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:29:43.318 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.318 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.318 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:29:43.319 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:31.968354+0000", 2021-10-08T19:29:43.319 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7749999999999998e-06 2021-10-08T19:29:43.319 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.319 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.319 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:29:43.320 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:31.968367+0000", 2021-10-08T19:29:43.320 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2466000000000001e-05 2021-10-08T19:29:43.320 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.320 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.321 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:29:43.321 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:31.968373+0000", 2021-10-08T19:29:43.321 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3899999999999998e-06 2021-10-08T19:29:43.321 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:29:43.321 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:29:43.322 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:29:43.322 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.322 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.322 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:95888 8.b 8.38224a5b (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e229)", 2021-10-08T19:29:43.323 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:29:30.610620+0000", 2021-10-08T19:29:43.323 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 12.598504812, 2021-10-08T19:29:43.323 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 12.598888987, 2021-10-08T19:29:43.323 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:29:43.324 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "delayed", 2021-10-08T19:29:43.324 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:29:43.324 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:29:43.324 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:29:43.324 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 95888 2021-10-08T19:29:43.325 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.325 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:29:43.325 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.325 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:29:43.326 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:30.610620+0000", 2021-10-08T19:29:43.326 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:29:43.326 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.326 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.326 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:29:43.327 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:30.610620+0000", 2021-10-08T19:29:43.327 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:29:43.327 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.327 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.328 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:29:43.328 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:30.610619+0000", 2021-10-08T19:29:43.328 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:29:43.328 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.328 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.329 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:29:43.329 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:30.610625+0000", 2021-10-08T19:29:43.329 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3910000000000003e-06 2021-10-08T19:29:43.329 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.329 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.330 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:29:43.330 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:30.610639+0000", 2021-10-08T19:29:43.330 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3749e-05 2021-10-08T19:29:43.330 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.331 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.331 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:29:43.331 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:30.610646+0000", 2021-10-08T19:29:43.331 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3130000000000001e-06 2021-10-08T19:29:43.331 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.332 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.332 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:29:43.332 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:30.610743+0000", 2021-10-08T19:29:43.332 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7188000000000005e-05 2021-10-08T19:29:43.332 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.333 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.333 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for peered", 2021-10-08T19:29:43.333 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:30.610750+0000", 2021-10-08T19:29:43.333 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7669999999999998e-06 2021-10-08T19:29:43.334 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:29:43.334 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:29:43.334 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:29:43.334 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.334 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.335 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:96072 8.b 8.72f6a62b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e230)", 2021-10-08T19:29:43.335 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:29:32.128379+0000", 2021-10-08T19:29:43.335 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 11.080746111, 2021-10-08T19:29:43.335 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 11.081167797000001, 2021-10-08T19:29:43.335 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:29:43.336 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "queued for pg", 2021-10-08T19:29:43.336 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:29:43.336 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:29:43.336 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:29:43.337 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 96072 2021-10-08T19:29:43.337 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.337 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:29:43.337 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.337 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:29:43.338 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:32.128379+0000", 2021-10-08T19:29:43.338 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:29:43.338 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.338 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.339 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:29:43.339 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:32.128379+0000", 2021-10-08T19:29:43.339 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:29:43.339 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.339 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.340 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:29:43.340 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:32.128377+0000", 2021-10-08T19:29:43.340 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:29:43.340 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.341 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.341 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:29:43.341 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:32.128385+0000", 2021-10-08T19:29:43.341 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.7540000000000006e-06 2021-10-08T19:29:43.341 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.342 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.342 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:29:43.342 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:32.128396+0000", 2021-10-08T19:29:43.342 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1319e-05 2021-10-08T19:29:43.343 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.343 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.343 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:29:43.343 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:32.128403+0000", 2021-10-08T19:29:43.343 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8900000000000001e-06 2021-10-08T19:29:43.344 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:29:43.344 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:29:43.344 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:29:43.344 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.345 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.345 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:95904 8.b 8.ab2455db (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e229)", 2021-10-08T19:29:43.345 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:29:30.610652+0000", 2021-10-08T19:29:43.345 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 12.598473092000001, 2021-10-08T19:29:43.346 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 12.598926574, 2021-10-08T19:29:43.346 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:29:43.346 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "delayed", 2021-10-08T19:29:43.346 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:29:43.346 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:29:43.347 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:29:43.347 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 95904 2021-10-08T19:29:43.347 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.347 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:29:43.348 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.348 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:29:43.348 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:30.610652+0000", 2021-10-08T19:29:43.348 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:29:43.348 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.349 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.349 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:29:43.349 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:30.610652+0000", 2021-10-08T19:29:43.349 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:29:43.350 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.350 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.350 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:29:43.350 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:30.610651+0000", 2021-10-08T19:29:43.351 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:29:43.351 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.351 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.351 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:29:43.351 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:30.610655+0000", 2021-10-08T19:29:43.352 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4829999999999999e-06 2021-10-08T19:29:43.352 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.352 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.352 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:29:43.353 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:30.610668+0000", 2021-10-08T19:29:43.353 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3553000000000001e-05 2021-10-08T19:29:43.353 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.353 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.354 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:29:43.354 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:30.610673+0000", 2021-10-08T19:29:43.354 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5050000000000001e-06 2021-10-08T19:29:43.354 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.354 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.355 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:29:43.355 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:30.610858+0000", 2021-10-08T19:29:43.355 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00018558299999999999 2021-10-08T19:29:43.355 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.356 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.356 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for peered", 2021-10-08T19:29:43.356 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:30.610865+0000", 2021-10-08T19:29:43.356 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.9870000000000002e-06 2021-10-08T19:29:43.356 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:29:43.357 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:29:43.357 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:29:43.357 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.357 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.358 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:95913 8.b 8.79fb57fb (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e229)", 2021-10-08T19:29:43.358 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:29:30.610678+0000", 2021-10-08T19:29:43.358 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 12.598447653000001, 2021-10-08T19:29:43.358 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 12.598939283, 2021-10-08T19:29:43.358 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:29:43.359 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "delayed", 2021-10-08T19:29:43.359 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:29:43.359 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:29:43.359 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:29:43.360 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 95913 2021-10-08T19:29:43.360 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.360 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:29:43.360 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.360 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:29:43.361 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:30.610678+0000", 2021-10-08T19:29:43.361 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:29:43.361 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.361 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.361 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:29:43.362 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:30.610678+0000", 2021-10-08T19:29:43.362 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:29:43.362 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.362 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.363 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:29:43.363 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:30.610677+0000", 2021-10-08T19:29:43.363 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999995 2021-10-08T19:29:43.363 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.364 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.364 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:29:43.364 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:30.610680+0000", 2021-10-08T19:29:43.364 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.3409999999999999e-06 2021-10-08T19:29:43.364 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.365 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.365 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:29:43.365 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:30.610686+0000", 2021-10-08T19:29:43.365 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.558e-06 2021-10-08T19:29:43.366 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.366 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.366 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:29:43.366 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:30.610690+0000", 2021-10-08T19:29:43.366 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7270000000000001e-06 2021-10-08T19:29:43.367 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.367 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.367 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:29:43.367 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:30.610888+0000", 2021-10-08T19:29:43.368 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000198469 2021-10-08T19:29:43.368 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.368 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.368 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for peered", 2021-10-08T19:29:43.368 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:30.610896+0000", 2021-10-08T19:29:43.369 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5170000000000002e-06 2021-10-08T19:29:43.369 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:29:43.369 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:29:43.369 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:29:43.370 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.370 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.370 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:96000 8.b 8.24f1558b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e230)", 2021-10-08T19:29:43.370 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:29:31.983232+0000", 2021-10-08T19:29:43.370 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 11.225893580999999, 2021-10-08T19:29:43.371 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 11.226423403, 2021-10-08T19:29:43.371 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:29:43.371 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "queued for pg", 2021-10-08T19:29:43.371 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:29:43.372 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:29:43.372 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:29:43.372 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 96000 2021-10-08T19:29:43.372 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.373 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:29:43.373 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.373 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:29:43.373 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:31.983232+0000", 2021-10-08T19:29:43.373 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:29:43.374 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.374 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.374 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:29:43.374 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:31.983232+0000", 2021-10-08T19:29:43.375 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:29:43.375 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.375 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.375 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:29:43.376 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:31.983229+0000", 2021-10-08T19:29:43.376 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:29:43.376 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.376 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.376 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:29:43.377 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:31.983237+0000", 2021-10-08T19:29:43.377 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.1429999999999998e-06 2021-10-08T19:29:43.377 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.377 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.378 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:29:43.378 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:31.983250+0000", 2021-10-08T19:29:43.378 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2636999999999999e-05 2021-10-08T19:29:43.378 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.378 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.379 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:29:43.379 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:31.983258+0000", 2021-10-08T19:29:43.379 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.7610000000000007e-06 2021-10-08T19:29:43.379 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:29:43.380 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:29:43.380 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:29:43.380 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.380 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.380 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:96002 8.b 8.8634358b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e230)", 2021-10-08T19:29:43.381 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:29:31.984190+0000", 2021-10-08T19:29:43.381 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 11.224935539000001, 2021-10-08T19:29:43.381 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 11.225496850000001, 2021-10-08T19:29:43.381 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:29:43.382 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "queued for pg", 2021-10-08T19:29:43.382 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:29:43.382 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:29:43.382 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:29:43.382 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 96002 2021-10-08T19:29:43.383 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.383 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:29:43.383 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.383 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:29:43.384 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:31.984190+0000", 2021-10-08T19:29:43.384 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:29:43.384 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.384 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.385 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:29:43.385 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:31.984190+0000", 2021-10-08T19:29:43.385 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:29:43.385 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.385 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.386 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:29:43.386 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:31.984188+0000", 2021-10-08T19:29:43.386 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:29:43.386 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.387 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.387 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:29:43.387 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:31.984195+0000", 2021-10-08T19:29:43.387 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1829999999999997e-06 2021-10-08T19:29:43.387 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.388 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.388 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:29:43.388 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:31.984206+0000", 2021-10-08T19:29:43.388 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0552e-05 2021-10-08T19:29:43.389 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:43.389 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:43.389 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:29:43.389 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:31.984212+0000", 2021-10-08T19:29:43.389 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1510000000000001e-06 2021-10-08T19:29:43.390 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:29:43.390 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:29:43.390 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:29:43.390 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:29:43.391 INFO:teuthology.orchestra.run.smithi117.stdout: ], 2021-10-08T19:29:43.391 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 16 2021-10-08T19:29:43.391 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:29:43.392 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:29:43.392 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set nodeep-scrub 2021-10-08T19:29:43.416 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:43.461 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:29:43.465 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:43.465 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:29:43.566 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:29:43.594 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:43.686 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:29:43.868 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:43 smithi117 ceph-mon[34585]: pgmap v409: 178 pgs: 1 active+clean+wait, 1 active+recovering+undersized+degraded+remapped, 2 active+remapped+backfilling, 2 active+remapped+backfill_toofull, 1 active+recovering+undersized+remapped, 171 active+clean; 5.0 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 16/245094 objects degraded (0.007%); 24713/245094 objects misplaced (10.083%); 1.6 MiB/s, 25 objects/s recovering 2021-10-08T19:29:43.869 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:29:43.869 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:43 smithi117 ceph-mon[34585]: osdmap e240: 8 total, 8 up, 8 in 2021-10-08T19:29:43.938 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:29:43.941 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:43.942 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:29:44.004 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:43 smithi097 ceph-mon[41966]: pgmap v409: 178 pgs: 1 active+clean+wait, 1 active+recovering+undersized+degraded+remapped, 2 active+remapped+backfilling, 2 active+remapped+backfill_toofull, 1 active+recovering+undersized+remapped, 171 active+clean; 5.0 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 16/245094 objects degraded (0.007%); 24713/245094 objects misplaced (10.083%); 1.6 MiB/s, 25 objects/s recovering 2021-10-08T19:29:44.005 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:29:44.005 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:43 smithi097 ceph-mon[41966]: osdmap e240: 8 total, 8 up, 8 in 2021-10-08T19:29:44.005 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:43 smithi097 ceph-mon[32687]: pgmap v409: 178 pgs: 1 active+clean+wait, 1 active+recovering+undersized+degraded+remapped, 2 active+remapped+backfilling, 2 active+remapped+backfill_toofull, 1 active+recovering+undersized+remapped, 171 active+clean; 5.0 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 16/245094 objects degraded (0.007%); 24713/245094 objects misplaced (10.083%); 1.6 MiB/s, 25 objects/s recovering 2021-10-08T19:29:44.006 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:29:44.006 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:43 smithi097 ceph-mon[32687]: osdmap e240: 8 total, 8 up, 8 in 2021-10-08T19:29:44.043 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:29:44.070 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:44.072 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2021-10-08T19:29:44.114 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:29:44.116 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:44.116 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:29:44.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:29:43 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:29:43] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:29:44.217 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:29:44.243 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:44.298 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:29:44.302 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:44.303 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:29:44.404 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:29:44.430 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:44.459 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:29:44.479 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:29:44.498 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:29:44.517 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:29:44.518 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'false' 2021-10-08T19:29:44.518 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'false' 2021-10-08T19:29:44.518 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'false' 2021-10-08T19:29:44.519 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'false' 2021-10-08T19:29:44.519 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'false' 2021-10-08T19:29:44.519 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'false' 2021-10-08T19:29:44.519 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'false' 2021-10-08T19:29:44.519 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'false' 2021-10-08T19:29:44.529 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:29:44.531 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:44.532 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:29:44.533 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:29:44.634 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:29:44.662 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:44.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:44 smithi097 ceph-mon[32687]: Health check cleared: PG_BACKFILL_FULL (was: Low space hindering backfill (add storage if this doesn't resolve itself): 2 pgs backfill_toofull) 2021-10-08T19:29:44.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:44 smithi097 ceph-mon[32687]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 16/245094 objects degraded (0.007%), 1 pg degraded, 1 pg undersized) 2021-10-08T19:29:44.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:44 smithi097 ceph-mon[32687]: osdmap e241: 8 total, 8 up, 8 in 2021-10-08T19:29:44.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:44 smithi097 ceph-mon[41966]: Health check cleared: PG_BACKFILL_FULL (was: Low space hindering backfill (add storage if this doesn't resolve itself): 2 pgs backfill_toofull) 2021-10-08T19:29:44.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:44 smithi097 ceph-mon[41966]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 16/245094 objects degraded (0.007%), 1 pg degraded, 1 pg undersized) 2021-10-08T19:29:44.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:44 smithi097 ceph-mon[41966]: osdmap e241: 8 total, 8 up, 8 in 2021-10-08T19:29:45.119 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:29:45.122 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:45.123 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:29:45.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:44 smithi117 ceph-mon[34585]: Health check cleared: PG_BACKFILL_FULL (was: Low space hindering backfill (add storage if this doesn't resolve itself): 2 pgs backfill_toofull) 2021-10-08T19:29:45.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:44 smithi117 ceph-mon[34585]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 16/245094 objects degraded (0.007%), 1 pg degraded, 1 pg undersized) 2021-10-08T19:29:45.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:44 smithi117 ceph-mon[34585]: osdmap e241: 8 total, 8 up, 8 in 2021-10-08T19:29:45.224 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:29:45.248 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:45.465 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 4, 5, 7, 6, 1, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2021-10-08T19:29:45.467 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2021-10-08T19:29:45.467 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd dump -f json-pretty 2021-10-08T19:29:45.763 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:29:45.773 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:45.774 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:29:45.875 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:29:45.929 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:46.035 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:29:46.043 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:45 smithi097 ceph-mon[32687]: pgmap v411: 178 pgs: 1 remapped+peering, 1 active+clean+wait, 1 active+recovering, 6 peering, 169 active+clean; 5.0 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 37 op/s 2021-10-08T19:29:46.044 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:45 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:29:46.044 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:45 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:29:46.044 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:45 smithi097 ceph-mon[32687]: osdmap e242: 8 total, 8 up, 8 in 2021-10-08T19:29:46.045 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:45 smithi097 ceph-mon[41966]: pgmap v411: 178 pgs: 1 remapped+peering, 1 active+clean+wait, 1 active+recovering, 6 peering, 169 active+clean; 5.0 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 37 op/s 2021-10-08T19:29:46.045 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:45 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:29:46.045 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:45 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:29:46.045 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:45 smithi097 ceph-mon[41966]: osdmap e242: 8 total, 8 up, 8 in 2021-10-08T19:29:46.046 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:46.047 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:29:46.148 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:29:46.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:45 smithi117 ceph-mon[34585]: pgmap v411: 178 pgs: 1 remapped+peering, 1 active+clean+wait, 1 active+recovering, 6 peering, 169 active+clean; 5.0 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 37 op/s 2021-10-08T19:29:46.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:45 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:29:46.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:45 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:29:46.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:45 smithi117 ceph-mon[34585]: osdmap e242: 8 total, 8 up, 8 in 2021-10-08T19:29:46.171 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:29:46.179 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:46.452 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:29:46.455 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:46.455 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:29:46.557 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:29:46.585 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:46.808 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:29:46 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:29:46.822 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is set 2021-10-08T19:29:46.844 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:46 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1225078493' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:29:46.845 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:46 smithi097 ceph-mon[41966]: from='client.25267 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:29:46.845 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:46 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1225078493' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:29:46.845 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:46 smithi097 ceph-mon[32687]: from='client.25267 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:29:47.067 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2021-10-08T19:29:47.068 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:29:47.089 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:46 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1225078493' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:29:47.090 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:46 smithi117 ceph-mon[34585]: from='client.25267 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:29:47.670 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:29:47.673 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:47.674 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:29:47.776 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:29:47.805 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:47.809 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:47 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:29:47.862 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2021-10-08T19:29:48.000 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:29:48.002 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:48.003 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:29:48.004 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2021-10-08T19:29:48.067 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:47 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:29:48.067 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:47 smithi117 ceph-mon[34585]: pgmap v414: 178 pgs: 1 remapped+peering, 1 active+clean+wait, 1 active+recovering, 6 peering, 169 active+clean; 5.0 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 37 op/s 2021-10-08T19:29:48.068 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:47 smithi117 ceph-mon[34585]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:29:48.068 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:47 smithi117 ceph-mon[34585]: from='client.25267 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:29:48.068 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:47 smithi117 ceph-mon[34585]: osdmap e243: 8 total, 8 up, 8 in 2021-10-08T19:29:48.104 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:29:48.128 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:48.187 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:29:48.189 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:48.190 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:29:48.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:47 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:29:48.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:47 smithi097 ceph-mon[41966]: pgmap v414: 178 pgs: 1 remapped+peering, 1 active+clean+wait, 1 active+recovering, 6 peering, 169 active+clean; 5.0 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 37 op/s 2021-10-08T19:29:48.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:47 smithi097 ceph-mon[41966]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:29:48.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:47 smithi097 ceph-mon[41966]: from='client.25267 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:29:48.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:47 smithi097 ceph-mon[41966]: osdmap e243: 8 total, 8 up, 8 in 2021-10-08T19:29:48.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:47 smithi097 ceph-mon[32687]: pgmap v414: 178 pgs: 1 remapped+peering, 1 active+clean+wait, 1 active+recovering, 6 peering, 169 active+clean; 5.0 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 37 op/s 2021-10-08T19:29:48.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:47 smithi097 ceph-mon[32687]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:29:48.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:47 smithi097 ceph-mon[32687]: from='client.25267 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:29:48.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:47 smithi097 ceph-mon[32687]: osdmap e243: 8 total, 8 up, 8 in 2021-10-08T19:29:48.291 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:29:48.316 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:48.444 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:29:48.597 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:29:48.600 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:48.600 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:29:48.701 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:29:48.710 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:29:48.734 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:48.843 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:29:48.846 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:48.847 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:29:48.948 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:29:48.983 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:49.025 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:29:49.028 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:49.028 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:29:49.129 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:29:49.156 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:49.604 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset noscrub 2021-10-08T19:29:49.686 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:29:49.689 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:49.691 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:29:49.793 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:29:49.826 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:49.834 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:29:49.834 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:29:49.835 INFO:teuthology.orchestra.run.smithi097.stdout: "epoch": 243, 2021-10-08T19:29:49.835 INFO:teuthology.orchestra.run.smithi097.stdout: "fsid": "1d01f6d6-286c-11ec-8c25-001a4aab830c", 2021-10-08T19:29:49.835 INFO:teuthology.orchestra.run.smithi097.stdout: "created": "2021-10-08T19:16:25.258003+0000", 2021-10-08T19:29:49.836 INFO:teuthology.orchestra.run.smithi097.stdout: "modified": "2021-10-08T19:29:46.806111+0000", 2021-10-08T19:29:49.836 INFO:teuthology.orchestra.run.smithi097.stdout: "last_up_change": "2021-10-08T19:21:15.388758+0000", 2021-10-08T19:29:49.837 INFO:teuthology.orchestra.run.smithi097.stdout: "last_in_change": "2021-10-08T19:29:39.736986+0000", 2021-10-08T19:29:49.837 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-08T19:29:49.838 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_num": 5806080, 2021-10-08T19:29:49.838 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_set": [ 2021-10-08T19:29:49.839 INFO:teuthology.orchestra.run.smithi097.stdout: "nodeep-scrub", 2021-10-08T19:29:49.839 INFO:teuthology.orchestra.run.smithi097.stdout: "noscrub", 2021-10-08T19:29:49.840 INFO:teuthology.orchestra.run.smithi097.stdout: "pglog_hardlimit", 2021-10-08T19:29:49.840 INFO:teuthology.orchestra.run.smithi097.stdout: "purged_snapdirs", 2021-10-08T19:29:49.840 INFO:teuthology.orchestra.run.smithi097.stdout: "recovery_deletes", 2021-10-08T19:29:49.841 INFO:teuthology.orchestra.run.smithi097.stdout: "sortbitwise" 2021-10-08T19:29:49.841 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:29:49.842 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_version": 18, 2021-10-08T19:29:49.842 INFO:teuthology.orchestra.run.smithi097.stdout: "full_ratio": 0.94999998807907104, 2021-10-08T19:29:49.843 INFO:teuthology.orchestra.run.smithi097.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-08T19:29:49.843 INFO:teuthology.orchestra.run.smithi097.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-08T19:29:49.843 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_snapshot": "", 2021-10-08T19:29:49.844 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_max": 8, 2021-10-08T19:29:49.844 INFO:teuthology.orchestra.run.smithi097.stdout: "max_osd": 8, 2021-10-08T19:29:49.845 INFO:teuthology.orchestra.run.smithi097.stdout: "require_min_compat_client": "luminous", 2021-10-08T19:29:49.845 INFO:teuthology.orchestra.run.smithi097.stdout: "min_compat_client": "luminous", 2021-10-08T19:29:49.846 INFO:teuthology.orchestra.run.smithi097.stdout: "require_osd_release": "quincy", 2021-10-08T19:29:49.846 INFO:teuthology.orchestra.run.smithi097.stdout: "pools": [ 2021-10-08T19:29:49.847 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:49.847 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 1, 2021-10-08T19:29:49.848 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": ".mgr", 2021-10-08T19:29:49.848 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:19:44.413311+0000", 2021-10-08T19:29:49.849 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:29:49.849 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:29:49.849 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:29:49.850 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:29:49.850 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:29:49.851 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:29:49.851 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:29:49.852 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:29:49.852 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:29:49.852 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:29:49.853 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:29:49.853 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:29:49.854 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 11, 2021-10-08T19:29:49.854 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 11, 2021-10-08T19:29:49.855 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 11, 2021-10-08T19:29:49.855 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 11, 2021-10-08T19:29:49.855 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 11, 2021-10-08T19:29:49.856 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:29:49.856 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:29:49.857 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:29:49.857 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:29:49.857 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:29:49.858 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:29:49.858 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:29:49.859 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:49.859 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "171", 2021-10-08T19:29:49.860 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:29:49.860 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:29:49.860 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "170", 2021-10-08T19:29:49.861 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:29:49.861 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:29:49.861 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:29:49.861 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:29:49.861 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:29:49.862 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:29:49.862 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:29:49.862 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:29:49.862 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:29:49.863 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:29:49.863 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:29:49.863 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:29:49.863 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:29:49.863 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:29:49.864 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:29:49.864 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:29:49.864 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:29:49.864 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:29:49.864 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:29:49.865 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:29:49.865 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:29:49.865 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:29:49.865 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:29:49.866 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:49.866 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:29:49.866 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:29:49.866 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:29:49.866 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:29:49.867 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:29:49.867 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:29:49.867 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:29:49.867 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:29:49.867 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:29:49.868 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:29:49.868 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:29:49.868 INFO:teuthology.orchestra.run.smithi097.stdout: "options": { 2021-10-08T19:29:49.868 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_min": 1 2021-10-08T19:29:49.869 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:49.869 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:29:49.869 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": {} 2021-10-08T19:29:49.869 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:49.869 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:49.870 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:49.870 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 2, 2021-10-08T19:29:49.870 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": ".rgw.root", 2021-10-08T19:29:49.870 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:21:21.940881+0000", 2021-10-08T19:29:49.870 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:29:49.871 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:29:49.871 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:29:49.871 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:29:49.872 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:29:49.872 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:29:49.872 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:29:49.872 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:29:49.872 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:29:49.873 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:29:49.873 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:29:49.873 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:29:49.873 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 32, 2021-10-08T19:29:49.873 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 32, 2021-10-08T19:29:49.874 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 32, 2021-10-08T19:29:49.874 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 32, 2021-10-08T19:29:49.874 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 32, 2021-10-08T19:29:49.874 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:29:49.875 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:29:49.875 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:29:49.875 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:29:49.875 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:29:49.875 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:29:49.876 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:29:49.876 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:49.876 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "62", 2021-10-08T19:29:49.876 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:29:49.877 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:29:49.877 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2021-10-08T19:29:49.877 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:29:49.877 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:29:49.878 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:29:49.878 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:29:49.878 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:29:49.878 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:29:49.879 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:29:49.879 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:29:49.879 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:29:49.879 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:29:49.879 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:29:49.880 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:29:49.880 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:29:49.880 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:29:49.880 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:29:49.880 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:29:49.881 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:29:49.881 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:29:49.881 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:29:49.881 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:29:49.881 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:29:49.882 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:29:49.882 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:29:49.882 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:49.882 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:29:49.883 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:29:49.883 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:29:49.883 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:29:49.883 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:29:49.883 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:29:49.884 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:29:49.884 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:29:49.884 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:29:49.884 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:29:49.884 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:29:49.885 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2021-10-08T19:29:49.885 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:29:49.885 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw": {} 2021-10-08T19:29:49.885 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:49.886 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:49.886 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:49.886 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 3, 2021-10-08T19:29:49.886 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "iscsi", 2021-10-08T19:29:49.887 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:21:22.536945+0000", 2021-10-08T19:29:49.887 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:29:49.887 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:29:49.887 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:29:49.887 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:29:49.888 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:29:49.888 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:29:49.888 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:29:49.888 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:29:49.889 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:29:49.889 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:29:49.889 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:29:49.889 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:29:49.889 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 23, 2021-10-08T19:29:49.890 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 23, 2021-10-08T19:29:49.890 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 23, 2021-10-08T19:29:49.890 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 23, 2021-10-08T19:29:49.890 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 23, 2021-10-08T19:29:49.890 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:29:49.891 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:29:49.891 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:29:49.891 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:29:49.891 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:29:49.892 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:29:49.892 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:29:49.892 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:49.892 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "132", 2021-10-08T19:29:49.892 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:29:49.893 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:29:49.893 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "131", 2021-10-08T19:29:49.893 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:29:49.893 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:29:49.893 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:29:49.894 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:29:49.894 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:29:49.894 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:29:49.894 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:29:49.895 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:29:49.895 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:29:49.895 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:29:49.895 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:29:49.895 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:29:49.896 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:29:49.896 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:29:49.896 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:29:49.896 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:29:49.896 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:29:49.897 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:29:49.897 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:29:49.897 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:29:49.897 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:29:49.897 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:29:49.898 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:29:49.898 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:49.898 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:29:49.898 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:29:49.899 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:29:49.899 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:29:49.899 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:29:49.899 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:29:49.899 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:29:49.900 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:29:49.900 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:29:49.900 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:29:49.900 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:29:49.900 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2021-10-08T19:29:49.901 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:29:49.901 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd": {} 2021-10-08T19:29:49.901 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:49.901 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:49.901 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:49.902 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 4, 2021-10-08T19:29:49.902 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "default.rgw.log", 2021-10-08T19:29:49.902 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:21:23.886328+0000", 2021-10-08T19:29:49.902 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:29:49.903 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:29:49.903 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:29:49.903 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:29:49.903 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:29:49.903 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:29:49.904 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:29:49.904 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:29:49.904 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:29:49.904 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:29:49.904 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:29:49.905 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:29:49.905 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 32, 2021-10-08T19:29:49.905 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 32, 2021-10-08T19:29:49.905 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 32, 2021-10-08T19:29:49.905 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 32, 2021-10-08T19:29:49.906 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 32, 2021-10-08T19:29:49.906 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:29:49.906 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:29:49.906 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:29:49.907 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:29:49.907 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:29:49.907 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:29:49.907 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:29:49.907 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:49.908 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "64", 2021-10-08T19:29:49.908 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:29:49.908 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:29:49.908 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2021-10-08T19:29:49.908 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:29:49.909 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:29:49.909 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:29:49.909 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:29:49.909 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:29:49.909 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:29:49.910 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:29:49.910 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:29:49.910 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:29:49.910 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:29:49.911 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:29:49.911 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:29:49.911 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:29:49.911 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:29:49.911 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:29:49.912 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:29:49.912 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:29:49.912 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:29:49.912 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:29:49.912 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:29:49.913 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:29:49.913 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:29:49.913 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:29:49.913 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:49.913 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:29:49.914 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:29:49.914 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:29:49.914 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:29:49.914 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:29:49.915 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:29:49.915 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:29:49.915 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:29:49.915 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:29:49.915 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:29:49.916 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:29:49.916 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2021-10-08T19:29:49.916 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:29:49.916 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw": {} 2021-10-08T19:29:49.916 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:49.917 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:49.917 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:49.917 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 5, 2021-10-08T19:29:49.917 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "default.rgw.control", 2021-10-08T19:29:49.917 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:21:25.865032+0000", 2021-10-08T19:29:49.918 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:29:49.918 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:29:49.918 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:29:49.918 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:29:49.919 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:29:49.919 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:29:49.919 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:29:49.919 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:29:49.919 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:29:49.920 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:29:49.920 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:29:49.920 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:29:49.920 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 32, 2021-10-08T19:29:49.920 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 32, 2021-10-08T19:29:49.921 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 32, 2021-10-08T19:29:49.921 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 32, 2021-10-08T19:29:49.921 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 32, 2021-10-08T19:29:49.921 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:29:49.922 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:29:49.922 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:29:49.922 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:29:49.922 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:29:49.922 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:29:49.923 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:29:49.923 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:49.923 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "66", 2021-10-08T19:29:49.923 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:29:49.923 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:29:49.924 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2021-10-08T19:29:49.924 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:29:49.924 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:29:49.924 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:29:49.924 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:29:49.925 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:29:49.925 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:29:49.925 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:29:49.925 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:29:49.926 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:29:49.926 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:29:49.926 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:29:49.926 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:29:49.926 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:29:49.927 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:29:49.927 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:29:49.927 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:29:49.927 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:29:49.927 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:29:49.928 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:29:49.928 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:29:49.928 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:29:49.928 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:29:49.928 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:29:49.929 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:49.929 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:29:49.929 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:29:49.929 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:29:49.930 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:29:49.930 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:29:49.930 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:29:49.930 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:29:49.930 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:29:49.931 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:29:49.931 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:29:49.931 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:29:49.931 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2021-10-08T19:29:49.932 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:29:49.932 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw": {} 2021-10-08T19:29:49.932 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:49.932 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:49.932 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:49.933 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 6, 2021-10-08T19:29:49.933 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "default.rgw.meta", 2021-10-08T19:29:49.933 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:21:27.940767+0000", 2021-10-08T19:29:49.933 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:29:49.933 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:29:49.934 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:29:49.934 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:29:49.934 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:29:49.934 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:29:49.935 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:29:49.935 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:29:49.935 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:29:49.935 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:29:49.935 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:29:49.936 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:29:49.936 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 32, 2021-10-08T19:29:49.936 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 32, 2021-10-08T19:29:49.936 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 32, 2021-10-08T19:29:49.936 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 32, 2021-10-08T19:29:49.937 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 32, 2021-10-08T19:29:49.937 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:29:49.937 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:29:49.937 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:29:49.937 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:29:49.938 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:29:49.938 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:29:49.938 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:29:49.938 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:49.939 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "69", 2021-10-08T19:29:49.939 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:29:49.939 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:29:49.939 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2021-10-08T19:29:49.939 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:29:49.940 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:29:49.940 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:29:49.940 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:29:49.940 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:29:49.940 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:29:49.941 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:29:49.941 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:29:49.941 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:29:49.941 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:29:49.942 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:29:49.942 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:29:49.942 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:29:49.942 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:29:49.942 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:29:49.943 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:29:49.943 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:29:49.943 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:29:49.943 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:29:49.943 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:29:49.944 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:29:49.944 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:29:49.944 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:29:49.944 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:49.945 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:29:49.945 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:29:49.945 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:29:49.945 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:29:49.945 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:29:49.946 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:29:49.946 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:29:49.946 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:29:49.946 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:29:49.947 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:29:49.947 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:29:49.947 INFO:teuthology.orchestra.run.smithi097.stdout: "options": { 2021-10-08T19:29:49.947 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_bias": 4, 2021-10-08T19:29:49.948 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_min": 8 2021-10-08T19:29:49.948 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:49.948 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:29:49.948 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw": {} 2021-10-08T19:29:49.948 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:49.949 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:49.949 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:49.949 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 8, 2021-10-08T19:29:49.949 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "unique_pool_1", 2021-10-08T19:29:49.949 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:27:42.154204+0000", 2021-10-08T19:29:49.950 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:29:49.950 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:29:49.950 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:29:49.950 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:29:49.951 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:29:49.951 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:29:49.951 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:29:49.951 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:29:49.951 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:29:49.952 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:29:49.952 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:29:49.952 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:29:49.952 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 16, 2021-10-08T19:29:49.952 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 16, 2021-10-08T19:29:49.953 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 16, 2021-10-08T19:29:49.953 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 16, 2021-10-08T19:29:49.953 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 16, 2021-10-08T19:29:49.953 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:29:49.953 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:29:49.954 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:29:49.954 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:29:49.954 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:29:49.954 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:29:49.955 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:29:49.955 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:49.955 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "187", 2021-10-08T19:29:49.955 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:29:49.955 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:29:49.956 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2021-10-08T19:29:49.956 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:29:49.956 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:29:49.956 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:29:49.957 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:29:49.957 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:29:49.957 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:29:49.957 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:29:49.957 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:29:49.958 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:29:49.958 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:29:49.958 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:29:49.958 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:29:49.958 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:29:49.959 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:29:49.959 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:29:49.959 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:29:49.959 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:29:49.959 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:29:49.960 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:29:49.960 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:29:49.960 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:29:49.960 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:29:49.960 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:29:49.961 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:49.961 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:29:49.961 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:29:49.961 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:29:49.962 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:29:49.962 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:29:49.962 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:29:49.962 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:29:49.962 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:29:49.963 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:29:49.963 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:29:49.964 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:29:49.964 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2021-10-08T19:29:49.964 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:29:49.964 INFO:teuthology.orchestra.run.smithi097.stdout: "rados": {} 2021-10-08T19:29:49.964 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:49.965 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:49.965 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:29:49.965 INFO:teuthology.orchestra.run.smithi097.stdout: "osds": [ 2021-10-08T19:29:49.965 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:49.965 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 0, 2021-10-08T19:29:49.966 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "9e64e714-a5d5-4fbb-ae2b-1df4bf14b8e0", 2021-10-08T19:29:49.966 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:29:49.966 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:29:49.966 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:29:49.967 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:29:49.967 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:29:49.967 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:29:49.967 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 8, 2021-10-08T19:29:49.967 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 237, 2021-10-08T19:29:49.968 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:29:49.968 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:29:49.968 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:29:49.968 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:29:49.968 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:49.969 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:29:49.969 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6801", 2021-10-08T19:29:49.969 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3354161282 2021-10-08T19:29:49.969 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:49.969 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:29:49.970 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:49.970 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:29:49.970 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:29:49.970 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:49.971 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:29:49.971 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6802", 2021-10-08T19:29:49.971 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3354161282 2021-10-08T19:29:49.971 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:49.972 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:29:49.972 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:49.972 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:29:49.972 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:29:49.973 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:49.973 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:29:49.973 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6804", 2021-10-08T19:29:49.973 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3354161282 2021-10-08T19:29:49.973 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:49.974 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:29:49.974 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:49.974 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:29:49.974 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:29:49.974 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:49.975 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:29:49.975 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6803", 2021-10-08T19:29:49.975 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3354161282 2021-10-08T19:29:49.975 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:49.976 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:29:49.976 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:49.976 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.97:6801/3354161282", 2021-10-08T19:29:49.976 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.97:6802/3354161282", 2021-10-08T19:29:49.976 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.97:6804/3354161282", 2021-10-08T19:29:49.977 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.97:6803/3354161282", 2021-10-08T19:29:49.977 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:29:49.977 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:29:49.978 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:29:49.978 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:29:49.978 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:49.978 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:49.978 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 1, 2021-10-08T19:29:49.979 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "32602a22-f263-4b62-a8d8-50fddfb73fa8", 2021-10-08T19:29:49.979 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:29:49.979 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:29:49.979 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:29:49.980 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:29:49.980 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:29:49.980 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:29:49.980 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 13, 2021-10-08T19:29:49.980 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 237, 2021-10-08T19:29:49.981 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:29:49.981 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:29:49.981 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:29:49.981 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:29:49.981 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:49.982 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:29:49.982 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6805", 2021-10-08T19:29:49.982 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 735799205 2021-10-08T19:29:49.982 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:49.983 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:29:49.983 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:49.983 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:29:49.983 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:29:49.983 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:49.984 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:29:49.984 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6806", 2021-10-08T19:29:49.984 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 735799205 2021-10-08T19:29:49.984 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:49.984 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:29:49.985 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:49.985 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:29:49.985 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:29:49.985 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:49.985 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:29:49.986 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6808", 2021-10-08T19:29:49.986 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 735799205 2021-10-08T19:29:49.986 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:49.986 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:29:49.987 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:49.987 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:29:49.987 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:29:49.987 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:49.987 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:29:49.988 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6807", 2021-10-08T19:29:49.988 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 735799205 2021-10-08T19:29:49.988 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:49.988 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:29:49.988 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:49.989 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.97:6805/735799205", 2021-10-08T19:29:49.989 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.97:6806/735799205", 2021-10-08T19:29:49.989 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.97:6808/735799205", 2021-10-08T19:29:49.989 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.97:6807/735799205", 2021-10-08T19:29:49.989 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:29:49.990 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:29:49.990 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:29:49.990 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:29:49.990 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:49.991 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:49.991 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 2, 2021-10-08T19:29:49.991 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "88e0e4a2-b4a3-4a00-8669-03c3d9b166c5", 2021-10-08T19:29:49.991 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:29:49.991 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:29:49.992 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:29:49.992 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:29:49.992 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:29:49.992 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:29:49.992 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 18, 2021-10-08T19:29:49.993 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 236, 2021-10-08T19:29:49.993 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:29:49.993 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:29:49.993 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:29:49.993 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:29:49.994 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:49.994 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:29:49.994 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6809", 2021-10-08T19:29:49.994 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2366482649 2021-10-08T19:29:49.995 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:49.995 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:29:49.995 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:49.995 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:29:49.995 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:29:49.996 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:49.996 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:29:49.996 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6810", 2021-10-08T19:29:49.996 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2366482649 2021-10-08T19:29:49.996 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:49.997 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:29:49.997 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:49.997 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:29:49.997 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:29:49.997 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:49.998 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:29:49.998 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6812", 2021-10-08T19:29:49.998 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2366482649 2021-10-08T19:29:49.998 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:49.999 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:29:49.999 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:49.999 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:29:49.999 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:29:49.999 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:50.000 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:29:50.000 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6811", 2021-10-08T19:29:50.000 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2366482649 2021-10-08T19:29:50.000 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:50.000 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:29:50.001 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:50.001 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.97:6809/2366482649", 2021-10-08T19:29:50.001 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.97:6810/2366482649", 2021-10-08T19:29:50.001 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.97:6812/2366482649", 2021-10-08T19:29:50.001 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.97:6811/2366482649", 2021-10-08T19:29:50.002 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:29:50.002 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:29:50.002 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:29:50.002 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:29:50.003 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:50.003 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:50.003 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 3, 2021-10-08T19:29:50.003 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "e689d708-b501-4526-a31a-1e598b74654d", 2021-10-08T19:29:50.003 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:29:50.004 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:29:50.004 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:29:50.004 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:29:50.004 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:29:50.005 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:29:50.005 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 24, 2021-10-08T19:29:50.005 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 241, 2021-10-08T19:29:50.005 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:29:50.005 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:29:50.006 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:29:50.006 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:29:50.006 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:50.006 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:29:50.006 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6813", 2021-10-08T19:29:50.007 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3191181122 2021-10-08T19:29:50.007 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:50.007 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:29:50.007 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:50.007 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:29:50.008 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:29:50.008 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:50.008 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:29:50.008 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6814", 2021-10-08T19:29:50.008 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3191181122 2021-10-08T19:29:50.009 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:50.009 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:29:50.009 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:50.009 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:29:50.009 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:29:50.010 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:50.010 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:29:50.010 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6816", 2021-10-08T19:29:50.010 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3191181122 2021-10-08T19:29:50.011 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:50.011 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:29:50.011 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:50.011 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:29:50.011 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:29:50.012 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:50.012 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:29:50.012 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6815", 2021-10-08T19:29:50.012 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3191181122 2021-10-08T19:29:50.012 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:50.013 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:29:50.013 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:50.013 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.97:6813/3191181122", 2021-10-08T19:29:50.013 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.97:6814/3191181122", 2021-10-08T19:29:50.013 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.97:6816/3191181122", 2021-10-08T19:29:50.014 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.97:6815/3191181122", 2021-10-08T19:29:50.014 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:29:50.014 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:29:50.014 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:29:50.015 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:29:50.015 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:50.015 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:50.015 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 4, 2021-10-08T19:29:50.015 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "67e4730a-be1c-4d88-9307-e3c2cf3ab2ef", 2021-10-08T19:29:50.016 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:29:50.016 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:29:50.016 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:29:50.016 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:29:50.016 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:29:50.017 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:29:50.017 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 30, 2021-10-08T19:29:50.017 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 240, 2021-10-08T19:29:50.017 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:29:50.017 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:29:50.018 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:29:50.018 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:29:50.018 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:50.018 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:29:50.019 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6800", 2021-10-08T19:29:50.019 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 106778208 2021-10-08T19:29:50.019 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:50.019 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:29:50.019 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:50.020 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:29:50.020 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:29:50.020 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:50.020 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:29:50.020 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6801", 2021-10-08T19:29:50.021 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 106778208 2021-10-08T19:29:50.021 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:50.021 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:29:50.021 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:50.021 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:29:50.022 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:29:50.022 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:50.022 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:29:50.022 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6803", 2021-10-08T19:29:50.023 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 106778208 2021-10-08T19:29:50.023 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:50.023 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:29:50.023 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:50.023 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:29:50.024 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:29:50.024 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:50.024 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:29:50.024 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6802", 2021-10-08T19:29:50.024 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 106778208 2021-10-08T19:29:50.025 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:50.025 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:29:50.025 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:50.025 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.117:6800/106778208", 2021-10-08T19:29:50.025 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.117:6801/106778208", 2021-10-08T19:29:50.026 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.117:6803/106778208", 2021-10-08T19:29:50.026 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.117:6802/106778208", 2021-10-08T19:29:50.026 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:29:50.026 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:29:50.027 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:29:50.027 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:29:50.027 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:50.027 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:50.027 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 5, 2021-10-08T19:29:50.028 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "f9fd3153-3e4e-4489-8927-a65641f05d42", 2021-10-08T19:29:50.028 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:29:50.028 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:29:50.028 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:29:50.028 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:29:50.029 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:29:50.029 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:29:50.029 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 38, 2021-10-08T19:29:50.029 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 239, 2021-10-08T19:29:50.030 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:29:50.030 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:29:50.030 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:29:50.030 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:29:50.030 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:50.031 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:29:50.031 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6804", 2021-10-08T19:29:50.031 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3199889891 2021-10-08T19:29:50.031 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:50.031 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:29:50.032 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:50.032 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:29:50.032 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:29:50.032 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:50.033 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:29:50.033 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6805", 2021-10-08T19:29:50.033 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3199889891 2021-10-08T19:29:50.033 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:50.033 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:29:50.034 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:50.034 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:29:50.034 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:29:50.034 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:50.034 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:29:50.035 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6807", 2021-10-08T19:29:50.035 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3199889891 2021-10-08T19:29:50.035 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:50.035 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:29:50.035 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:50.036 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:29:50.036 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:29:50.036 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:50.036 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:29:50.036 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6806", 2021-10-08T19:29:50.037 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3199889891 2021-10-08T19:29:50.037 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:50.037 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:29:50.037 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:50.038 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.117:6804/3199889891", 2021-10-08T19:29:50.038 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.117:6805/3199889891", 2021-10-08T19:29:50.038 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.117:6807/3199889891", 2021-10-08T19:29:50.038 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.117:6806/3199889891", 2021-10-08T19:29:50.038 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:29:50.039 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:29:50.039 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:29:50.039 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:29:50.039 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:50.039 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:50.040 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 6, 2021-10-08T19:29:50.040 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "84898f12-c37d-4eb6-8b71-5b86bfe16e7d", 2021-10-08T19:29:50.040 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:29:50.040 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:29:50.040 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:29:50.041 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:29:50.041 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:29:50.041 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:29:50.041 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 47, 2021-10-08T19:29:50.041 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 239, 2021-10-08T19:29:50.042 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:29:50.042 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:29:50.042 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:29:50.042 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:29:50.043 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:50.043 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:29:50.043 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6808", 2021-10-08T19:29:50.043 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2185843951 2021-10-08T19:29:50.043 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:50.044 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:29:50.044 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:50.044 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:29:50.044 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:29:50.045 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:50.045 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:29:50.045 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6809", 2021-10-08T19:29:50.045 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2185843951 2021-10-08T19:29:50.045 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:50.046 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:29:50.046 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:50.046 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:29:50.046 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:29:50.047 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:50.047 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:29:50.047 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6811", 2021-10-08T19:29:50.047 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2185843951 2021-10-08T19:29:50.047 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:50.048 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:29:50.048 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:50.048 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:29:50.048 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:29:50.048 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:50.049 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:29:50.049 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6810", 2021-10-08T19:29:50.049 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2185843951 2021-10-08T19:29:50.049 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:50.050 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:29:50.050 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:50.050 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.117:6808/2185843951", 2021-10-08T19:29:50.050 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.117:6809/2185843951", 2021-10-08T19:29:50.050 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.117:6811/2185843951", 2021-10-08T19:29:50.051 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.117:6810/2185843951", 2021-10-08T19:29:50.051 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:29:50.051 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:29:50.051 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:29:50.051 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:29:50.052 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:50.052 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:50.052 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 7, 2021-10-08T19:29:50.052 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "529af2ce-2ae9-41ed-8c8e-d133628cfd20", 2021-10-08T19:29:50.052 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:29:50.053 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:29:50.053 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:29:50.053 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:29:50.053 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:29:50.054 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:29:50.054 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 55, 2021-10-08T19:29:50.054 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 239, 2021-10-08T19:29:50.054 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:29:50.054 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:29:50.055 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:29:50.055 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:29:50.055 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:50.055 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:29:50.055 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6812", 2021-10-08T19:29:50.056 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2817683239 2021-10-08T19:29:50.056 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:50.056 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:29:50.056 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:50.056 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:29:50.057 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:29:50.057 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:50.057 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:29:50.057 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6813", 2021-10-08T19:29:50.057 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2817683239 2021-10-08T19:29:50.058 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:50.058 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:29:50.058 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:50.058 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:29:50.059 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:29:50.059 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:50.059 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:29:50.059 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6815", 2021-10-08T19:29:50.059 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2817683239 2021-10-08T19:29:50.060 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:50.060 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:29:50.060 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:50.060 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:29:50.060 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:29:50.061 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:50.061 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:29:50.061 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6814", 2021-10-08T19:29:50.061 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2817683239 2021-10-08T19:29:50.061 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:50.062 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:29:50.062 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:50.062 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.117:6812/2817683239", 2021-10-08T19:29:50.062 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.117:6813/2817683239", 2021-10-08T19:29:50.063 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.117:6815/2817683239", 2021-10-08T19:29:50.063 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.117:6814/2817683239", 2021-10-08T19:29:50.063 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:29:50.063 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:29:50.063 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:29:50.064 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:29:50.064 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:50.064 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:29:50.064 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_xinfo": [ 2021-10-08T19:29:50.064 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:50.065 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 0, 2021-10-08T19:29:50.065 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:29:50.065 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:29:50.065 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:29:50.065 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:29:50.066 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:29:50.066 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:29:23.900805+0000", 2021-10-08T19:29:50.066 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:29:50.066 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:50.066 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:50.067 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 1, 2021-10-08T19:29:50.067 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:29:50.067 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:29:50.067 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:29:50.067 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:29:50.068 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:29:50.068 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:29:38.452104+0000", 2021-10-08T19:29:50.068 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:29:50.068 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:50.069 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:50.069 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 2, 2021-10-08T19:29:50.069 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:29:50.069 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:29:50.069 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:29:50.070 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:29:50.070 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:29:50.070 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:29:10.019793+0000", 2021-10-08T19:29:50.070 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:29:50.070 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:50.071 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:50.071 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 3, 2021-10-08T19:29:50.071 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:29:50.071 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:29:50.071 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:29:50.072 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:29:50.072 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:29:50.072 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:29:21.888228+0000", 2021-10-08T19:29:50.072 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:29:50.073 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:50.073 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:50.073 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 4, 2021-10-08T19:29:50.073 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:29:50.073 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:29:50.074 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:29:50.074 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:29:50.074 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:29:50.074 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:29:21.391571+0000", 2021-10-08T19:29:50.074 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:29:50.075 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:50.075 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:50.075 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 5, 2021-10-08T19:29:50.075 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:29:50.075 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:29:50.076 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:29:50.076 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:29:50.076 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:29:50.076 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:29:20.636064+0000", 2021-10-08T19:29:50.077 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:29:50.077 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:50.077 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:50.077 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 6, 2021-10-08T19:29:50.077 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:29:50.078 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:29:50.078 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:29:50.078 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:29:50.078 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:29:50.078 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:28:44.030698+0000", 2021-10-08T19:29:50.079 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:29:50.079 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:50.079 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:50.079 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 7, 2021-10-08T19:29:50.080 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:29:50.080 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:29:50.080 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:29:50.080 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:29:50.080 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:29:50.081 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:29:44.916953+0000", 2021-10-08T19:29:50.081 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:29:50.081 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:50.081 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:29:50.081 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_upmap": [ 2021-10-08T19:29:50.082 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:50.082 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "1.6", 2021-10-08T19:29:50.082 INFO:teuthology.orchestra.run.smithi097.stdout: "osds": [ 2021-10-08T19:29:50.082 INFO:teuthology.orchestra.run.smithi097.stdout: 2, 2021-10-08T19:29:50.082 INFO:teuthology.orchestra.run.smithi097.stdout: 0, 2021-10-08T19:29:50.083 INFO:teuthology.orchestra.run.smithi097.stdout: 4 2021-10-08T19:29:50.083 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:29:50.083 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:50.083 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:29:50.083 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_upmap_items": [ 2021-10-08T19:29:50.084 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:50.084 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "2.0", 2021-10-08T19:29:50.084 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:29:50.084 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:50.085 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 7, 2021-10-08T19:29:50.085 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 2 2021-10-08T19:29:50.085 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:50.085 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:29:50.085 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:50.086 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:50.086 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "2.1a", 2021-10-08T19:29:50.086 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:29:50.086 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:50.086 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 7, 2021-10-08T19:29:50.087 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 2 2021-10-08T19:29:50.087 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:50.087 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:29:50.087 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:50.087 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:50.088 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "5.19", 2021-10-08T19:29:50.088 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:29:50.088 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:50.088 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 5, 2021-10-08T19:29:50.088 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 7 2021-10-08T19:29:50.089 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:50.089 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:29:50.089 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:50.089 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:29:50.090 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_temp": [ 2021-10-08T19:29:50.090 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:29:50.090 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "8.b", 2021-10-08T19:29:50.090 INFO:teuthology.orchestra.run.smithi097.stdout: "osds": [ 2021-10-08T19:29:50.090 INFO:teuthology.orchestra.run.smithi097.stdout: 3, 2021-10-08T19:29:50.091 INFO:teuthology.orchestra.run.smithi097.stdout: 4 2021-10-08T19:29:50.091 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:29:50.091 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:50.091 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:29:50.091 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_temp": [], 2021-10-08T19:29:50.092 INFO:teuthology.orchestra.run.smithi097.stdout: "blocklist": { 2021-10-08T19:29:50.092 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/2600364788": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:29:50.092 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/4129083289": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:29:50.092 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/1443158975": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:29:50.092 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/2472640384": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:29:50.093 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/3196919488": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:29:50.093 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:6800/3195862546": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:29:50.093 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:6800/3931202434": "2021-10-09T19:17:10.051948+0000", 2021-10-08T19:29:50.093 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/2761595213": "2021-10-09T19:17:10.051948+0000", 2021-10-08T19:29:50.096 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/900681504": "2021-10-09T19:17:10.051948+0000", 2021-10-08T19:29:50.096 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/3932251406": "2021-10-09T19:17:10.051948+0000", 2021-10-08T19:29:50.097 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/398006785": "2021-10-09T19:16:48.651177+0000", 2021-10-08T19:29:50.097 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/1642570050": "2021-10-09T19:16:48.651177+0000", 2021-10-08T19:29:50.097 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/300178790": "2021-10-09T19:16:48.651177+0000", 2021-10-08T19:29:50.097 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:6800/845999767": "2021-10-09T19:16:48.651177+0000" 2021-10-08T19:29:50.097 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:50.098 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profiles": { 2021-10-08T19:29:50.098 INFO:teuthology.orchestra.run.smithi097.stdout: "default": { 2021-10-08T19:29:50.098 INFO:teuthology.orchestra.run.smithi097.stdout: "crush-failure-domain": "osd", 2021-10-08T19:29:50.098 INFO:teuthology.orchestra.run.smithi097.stdout: "k": "2", 2021-10-08T19:29:50.098 INFO:teuthology.orchestra.run.smithi097.stdout: "m": "1", 2021-10-08T19:29:50.099 INFO:teuthology.orchestra.run.smithi097.stdout: "plugin": "jerasure", 2021-10-08T19:29:50.099 INFO:teuthology.orchestra.run.smithi097.stdout: "technique": "reed_sol_van" 2021-10-08T19:29:50.099 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:50.099 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:29:50.100 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps_queue": [], 2021-10-08T19:29:50.100 INFO:teuthology.orchestra.run.smithi097.stdout: "new_removed_snaps": [], 2021-10-08T19:29:50.100 INFO:teuthology.orchestra.run.smithi097.stdout: "new_purged_snaps": [], 2021-10-08T19:29:50.100 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_node_flags": {}, 2021-10-08T19:29:50.100 INFO:teuthology.orchestra.run.smithi097.stdout: "device_class_flags": {}, 2021-10-08T19:29:50.101 INFO:teuthology.orchestra.run.smithi097.stdout: "stretch_mode": { 2021-10-08T19:29:50.101 INFO:teuthology.orchestra.run.smithi097.stdout: "stretch_mode_enabled": false, 2021-10-08T19:29:50.101 INFO:teuthology.orchestra.run.smithi097.stdout: "stretch_bucket_count": 0, 2021-10-08T19:29:50.101 INFO:teuthology.orchestra.run.smithi097.stdout: "degraded_stretch_mode": 0, 2021-10-08T19:29:50.101 INFO:teuthology.orchestra.run.smithi097.stdout: "recovering_stretch_mode": 0, 2021-10-08T19:29:50.102 INFO:teuthology.orchestra.run.smithi097.stdout: "stretch_mode_bucket": 0 2021-10-08T19:29:50.102 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:29:50.102 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:29:50.103 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:49 smithi097 ceph-mon[41966]: pgmap v416: 178 pgs: 1 remapped+peering, 1 active+clean+wait, 1 active+recovering, 3 peering, 172 active+clean; 5.0 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 49 op/s 2021-10-08T19:29:50.103 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:49 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:29:50.104 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:49 smithi097 ceph-mon[32687]: pgmap v416: 178 pgs: 1 remapped+peering, 1 active+clean+wait, 1 active+recovering, 3 peering, 172 active+clean; 5.0 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 49 op/s 2021-10-08T19:29:50.104 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:49 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:29:50.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:49 smithi117 ceph-mon[34585]: pgmap v416: 178 pgs: 1 remapped+peering, 1 active+clean+wait, 1 active+recovering, 3 peering, 172 active+clean; 5.0 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 49 op/s 2021-10-08T19:29:50.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:49 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:29:50.214 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:29:49 smithi097 conmon[33110]: 172.21.15.117 - - [08/Oct/2021:19:29:49] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:29:50.573 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2021-10-08T19:29:50.573 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:29:50.578 INFO:tasks.thrashosds.thrasher:j is {'epoch': 243, 'fsid': '1d01f6d6-286c-11ec-8c25-001a4aab830c', 'created': '2021-10-08T19:16:25.258003+0000', 'modified': '2021-10-08T19:29:46.806111+0000', 'last_up_change': '2021-10-08T19:21:15.388758+0000', 'last_in_change': '2021-10-08T19:29:39.736986+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 18, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 8, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'quincy', 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2021-10-08T19:19:44.413311+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 11, 'pg_placement_num': 11, 'pg_placement_num_target': 11, 'pg_num_target': 11, 'pg_num_pending': 11, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '171', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '170', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': '.rgw.root', 'create_time': '2021-10-08T19:21:21.940881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 3, 'pool_name': 'iscsi', 'create_time': '2021-10-08T19:21:22.536945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 23, 'pg_placement_num': 23, 'pg_placement_num_target': 23, 'pg_num_target': 23, 'pg_num_pending': 23, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '132', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '131', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 4, 'pool_name': 'default.rgw.log', 'create_time': '2021-10-08T19:21:23.886328+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 5, 'pool_name': 'default.rgw.control', 'create_time': '2021-10-08T19:21:25.865032+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 6, 'pool_name': 'default.rgw.meta', 'create_time': '2021-10-08T19:21:27.940767+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '69', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 8}, 'application_metadata': {'rgw': {}}}, {'pool': 8, 'pool_name': 'unique_pool_1', 'create_time': '2021-10-08T19:27:42.154204+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '187', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}], 'osds': [{'osd': 0, 'uuid': '9e64e714-a5d5-4fbb-ae2b-1df4bf14b8e0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 237, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6801', 'nonce': 3354161282}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6802', 'nonce': 3354161282}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6804', 'nonce': 3354161282}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6803', 'nonce': 3354161282}]}, 'public_addr': '172.21.15.97:6801/3354161282', 'cluster_addr': '172.21.15.97:6802/3354161282', 'heartbeat_back_addr': '172.21.15.97:6804/3354161282', 'heartbeat_front_addr': '172.21.15.97:6803/3354161282', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '32602a22-f263-4b62-a8d8-50fddfb73fa8', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 237, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6805', 'nonce': 735799205}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6806', 'nonce': 735799205}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6808', 'nonce': 735799205}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6807', 'nonce': 735799205}]}, 'public_addr': '172.21.15.97:6805/735799205', 'cluster_addr': '172.21.15.97:6806/735799205', 'heartbeat_back_addr': '172.21.15.97:6808/735799205', 'heartbeat_front_addr': '172.21.15.97:6807/735799205', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '88e0e4a2-b4a3-4a00-8669-03c3d9b166c5', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 18, 'up_thru': 236, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6809', 'nonce': 2366482649}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6810', 'nonce': 2366482649}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6812', 'nonce': 2366482649}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6811', 'nonce': 2366482649}]}, 'public_addr': '172.21.15.97:6809/2366482649', 'cluster_addr': '172.21.15.97:6810/2366482649', 'heartbeat_back_addr': '172.21.15.97:6812/2366482649', 'heartbeat_front_addr': '172.21.15.97:6811/2366482649', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': 'e689d708-b501-4526-a31a-1e598b74654d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 24, 'up_thru': 241, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6813', 'nonce': 3191181122}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6814', 'nonce': 3191181122}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6816', 'nonce': 3191181122}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6815', 'nonce': 3191181122}]}, 'public_addr': '172.21.15.97:6813/3191181122', 'cluster_addr': '172.21.15.97:6814/3191181122', 'heartbeat_back_addr': '172.21.15.97:6816/3191181122', 'heartbeat_front_addr': '172.21.15.97:6815/3191181122', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '67e4730a-be1c-4d88-9307-e3c2cf3ab2ef', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 30, 'up_thru': 240, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6800', 'nonce': 106778208}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6801', 'nonce': 106778208}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6803', 'nonce': 106778208}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6802', 'nonce': 106778208}]}, 'public_addr': '172.21.15.117:6800/106778208', 'cluster_addr': '172.21.15.117:6801/106778208', 'heartbeat_back_addr': '172.21.15.117:6803/106778208', 'heartbeat_front_addr': '172.21.15.117:6802/106778208', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'f9fd3153-3e4e-4489-8927-a65641f05d42', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 38, 'up_thru': 239, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6804', 'nonce': 3199889891}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6805', 'nonce': 3199889891}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6807', 'nonce': 3199889891}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6806', 'nonce': 3199889891}]}, 'public_addr': '172.21.15.117:6804/3199889891', 'cluster_addr': '172.21.15.117:6805/3199889891', 'heartbeat_back_addr': '172.21.15.117:6807/3199889891', 'heartbeat_front_addr': '172.21.15.117:6806/3199889891', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '84898f12-c37d-4eb6-8b71-5b86bfe16e7d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 47, 'up_thru': 239, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6808', 'nonce': 2185843951}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6809', 'nonce': 2185843951}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6811', 'nonce': 2185843951}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6810', 'nonce': 2185843951}]}, 'public_addr': '172.21.15.117:6808/2185843951', 'cluster_addr': '172.21.15.117:6809/2185843951', 'heartbeat_back_addr': '172.21.15.117:6811/2185843951', 'heartbeat_front_addr': '172.21.15.117:6810/2185843951', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '529af2ce-2ae9-41ed-8c8e-d133628cfd20', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 55, 'up_thru': 239, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6812', 'nonce': 2817683239}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6813', 'nonce': 2817683239}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6815', 'nonce': 2817683239}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6814', 'nonce': 2817683239}]}, 'public_addr': '172.21.15.117:6812/2817683239', 'cluster_addr': '172.21.15.117:6813/2817683239', 'heartbeat_back_addr': '172.21.15.117:6815/2817683239', 'heartbeat_front_addr': '172.21.15.117:6814/2817683239', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:29:23.900805+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:29:38.452104+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:29:10.019793+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:29:21.888228+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:29:21.391571+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:29:20.636064+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:28:44.030698+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:29:44.916953+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '1.6', 'osds': [2, 0, 4]}], 'pg_upmap_items': [{'pgid': '2.0', 'mappings': [{'from': 7, 'to': 2}]}, {'pgid': '2.1a', 'mappings': [{'from': 7, 'to': 2}]}, {'pgid': '5.19', 'mappings': [{'from': 5, 'to': 7}]}], 'pg_temp': [{'pgid': '8.b', 'osds': [3, 4]}], 'primary_temp': [], 'blocklist': {'172.21.15.97:0/2600364788': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:0/4129083289': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:0/1443158975': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:0/2472640384': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:0/3196919488': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:6800/3195862546': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:6800/3931202434': '2021-10-09T19:17:10.051948+0000', '172.21.15.97:0/2761595213': '2021-10-09T19:17:10.051948+0000', '172.21.15.97:0/900681504': '2021-10-09T19:17:10.051948+0000', '172.21.15.97:0/3932251406': '2021-10-09T19:17:10.051948+0000', '172.21.15.97:0/398006785': '2021-10-09T19:16:48.651177+0000', '172.21.15.97:0/1642570050': '2021-10-09T19:16:48.651177+0000', '172.21.15.97:0/300178790': '2021-10-09T19:16:48.651177+0000', '172.21.15.97:6800/845999767': '2021-10-09T19:16:48.651177+0000'}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2021-10-08T19:29:50.578 INFO:tasks.thrashosds.thrasher:Clearing pg_upmap on 1.6 2021-10-08T19:29:50.579 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd rm-pg-upmap 1.6 2021-10-08T19:29:50.637 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:29:50.639 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:50.640 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:29:50.741 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:29:50.769 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:50.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:50 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2409386019' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2021-10-08T19:29:50.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:50 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:29:50.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:50 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:29:50.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:50 smithi097 ceph-mon[32687]: 172.21.15.117 - - [08/Oct/2021:19:29:49] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:29:50.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:50 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2409386019' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2021-10-08T19:29:50.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:50 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:29:50.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:50 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:29:50.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:50 smithi097 ceph-mon[41966]: 172.21.15.117 - - [08/Oct/2021:19:29:49] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:29:51.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:50 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2409386019' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2021-10-08T19:29:51.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:50 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:29:51.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:50 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:29:51.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:50 smithi117 ceph-mon[34585]: 172.21.15.117 - - [08/Oct/2021:19:29:49] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:29:51.282 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2021-10-08T19:29:51.286 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:29:51.426 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:29:51.429 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:51.430 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:29:51.532 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:29:51.552 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:29:51.571 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:51.672 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:29:51.675 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:51.675 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:29:51.777 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:29:51.801 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:51.848 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:29:51.850 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:51.851 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:29:51.952 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:29:51.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:51 smithi097 ceph-mon[41966]: pgmap v417: 178 pgs: 1 active+recovering+undersized+remapped, 1 active+clean+wait, 176 active+clean; 4.9 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 50 op/s; 94/243768 objects misplaced (0.039%); 352 KiB/s, 7 objects/s recovering 2021-10-08T19:29:51.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:51 smithi097 ceph-mon[32687]: pgmap v417: 178 pgs: 1 active+recovering+undersized+remapped, 1 active+clean+wait, 176 active+clean; 4.9 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 50 op/s; 94/243768 objects misplaced (0.039%); 352 KiB/s, 7 objects/s recovering 2021-10-08T19:29:51.974 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:51 smithi117 ceph-mon[34585]: pgmap v417: 178 pgs: 1 active+recovering+undersized+remapped, 1 active+clean+wait, 176 active+clean; 4.9 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 50 op/s; 94/243768 objects misplaced (0.039%); 352 KiB/s, 7 objects/s recovering 2021-10-08T19:29:51.977 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:52.025 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:29:52.027 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:52.027 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:29:52.041 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:29:52.047 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:29:52.075 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:29:52.097 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:29:52.118 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:29:52.128 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:29:52.137 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:29:52.157 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:52.158 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:29:52.182 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:29:52.214 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:29:52.219 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true' 2021-10-08T19:29:52.220 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true' 2021-10-08T19:29:52.220 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true' 2021-10-08T19:29:52.220 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true' 2021-10-08T19:29:52.220 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true' 2021-10-08T19:29:52.221 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true' 2021-10-08T19:29:52.221 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'true' 2021-10-08T19:29:52.221 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'true' 2021-10-08T19:29:52.655 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:29:52 smithi117 conmon[69189]: level=error ts=2021-10-08T19:29:52.314Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=1 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:29:52.819 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:29:52.825 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:52.826 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:29:52.927 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:29:52.969 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:52.969 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:52 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2898737361' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:29:52.970 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:29:52 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:29:52] "GET /metrics HTTP/1.1" 200 155958 "" "Prometheus/2.18.1" 2021-10-08T19:29:52.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:52 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2898737361' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:29:53.034 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:29:53.035 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:52 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2898737361' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:29:53.036 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:53.037 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:29:53.139 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:29:53.179 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:53.267 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:29:53.273 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:53.274 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:29:53.375 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:29:53.439 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:53.505 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:29:53.505 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2021-10-08T19:29:53.506 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:53.506 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.15147.0:97838 8.9 e243/182 8:94ce7133:::benchmark_data_smithi097_144160_object9098:head v 243'6072, mlcod=243'6070)", 2021-10-08T19:29:53.506 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:29:53.503325+0000", 2021-10-08T19:29:53.506 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.00088362399999999995, 2021-10-08T19:29:53.507 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00090438599999999997, 2021-10-08T19:29:53.507 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:29:53.507 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2021-10-08T19:29:53.507 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:29:53.508 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:53.508 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:29:53.508 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:53.503325+0000", 2021-10-08T19:29:53.508 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:29:53.508 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:53.509 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:53.509 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:29:53.509 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:53.503325+0000", 2021-10-08T19:29:53.509 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:29:53.510 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:53.510 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:53.510 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:29:53.510 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:53.503324+0000", 2021-10-08T19:29:53.511 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:29:53.511 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:53.511 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:53.511 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:29:53.512 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:53.503332+0000", 2021-10-08T19:29:53.512 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.106e-06 2021-10-08T19:29:53.512 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:53.512 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:53.513 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:29:53.513 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:53.503343+0000", 2021-10-08T19:29:53.514 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0711e-05 2021-10-08T19:29:53.514 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:53.514 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:53.514 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:29:53.515 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:53.503349+0000", 2021-10-08T19:29:53.515 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8499999999999999e-06 2021-10-08T19:29:53.515 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:53.515 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:53.515 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:29:53.516 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:53.503403+0000", 2021-10-08T19:29:53.516 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4129999999999998e-05 2021-10-08T19:29:53.516 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:29:53.516 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:29:53.516 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:29:53.517 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:53.503427+0000", 2021-10-08T19:29:53.517 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4017999999999999e-05 2021-10-08T19:29:53.517 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:29:53.518 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:29:53.518 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:29:53.518 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:29:53.518 INFO:teuthology.orchestra.run.smithi117.stdout: ], 2021-10-08T19:29:53.518 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 1 2021-10-08T19:29:53.519 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:29:53.575 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:29:53.580 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:53.581 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:29:53.682 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:29:53.746 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:53.840 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:29:53.849 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:53.850 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:29:53.868 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:53 smithi117 ceph-mon[34585]: pgmap v418: 178 pgs: 1 active+recovering+undersized+remapped, 1 active+clean+wait, 176 active+clean; 4.9 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 649 B/s rd, 0 B/s wr, 38 op/s; 94/243768 objects misplaced (0.039%); 268 KiB/s, 5 objects/s recovering 2021-10-08T19:29:53.951 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:29:54.007 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:53 smithi097 ceph-mon[32687]: pgmap v418: 178 pgs: 1 active+recovering+undersized+remapped, 1 active+clean+wait, 176 active+clean; 4.9 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 649 B/s rd, 0 B/s wr, 38 op/s; 94/243768 objects misplaced (0.039%); 268 KiB/s, 5 objects/s recovering 2021-10-08T19:29:54.008 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:53 smithi097 ceph-mon[41966]: pgmap v418: 178 pgs: 1 active+recovering+undersized+remapped, 1 active+clean+wait, 176 active+clean; 4.9 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 649 B/s rd, 0 B/s wr, 38 op/s; 94/243768 objects misplaced (0.039%); 268 KiB/s, 5 objects/s recovering 2021-10-08T19:29:54.017 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:54.156 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:29:53 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:29:53] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:29:54.223 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:29:54.229 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:54.231 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:29:54.332 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:29:54.370 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:54.503 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:29:54.507 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2021-10-08T19:29:54.509 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:54.510 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:29:54.611 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:29:54.663 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:54.787 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is unset 2021-10-08T19:29:54.943 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:29:54.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:54 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2302347085' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:29:54.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:54 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2302347085' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:29:55.034 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:29:55.040 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:55.040 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:29:55.141 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:29:55.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:54 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2302347085' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:29:55.180 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:55.315 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:29:55.318 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:55.319 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:29:55.420 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:29:55.466 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:55.576 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2021-10-08T19:29:55.894 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:29:55.905 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:55.906 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:29:55.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:55 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:29:55.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:55 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:29:55.908 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:55 smithi117 ceph-mon[34585]: pgmap v419: 178 pgs: 1 active+recovering+undersized+remapped, 177 active+clean; 4.8 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 219 op/s; 36/238845 objects misplaced (0.015%); 656 KiB/s, 11 objects/s recovering 2021-10-08T19:29:55.908 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:55 smithi117 ceph-mon[34585]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:29:55.908 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:55 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2302347085' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:29:55.908 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:55 smithi117 ceph-mon[34585]: osdmap e244: 8 total, 8 up, 8 in 2021-10-08T19:29:56.007 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:29:56.063 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:55 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:29:56.064 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:55 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:29:56.064 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:55 smithi097 ceph-mon[32687]: pgmap v419: 178 pgs: 1 active+recovering+undersized+remapped, 177 active+clean; 4.8 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 219 op/s; 36/238845 objects misplaced (0.015%); 656 KiB/s, 11 objects/s recovering 2021-10-08T19:29:56.065 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:55 smithi097 ceph-mon[32687]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:29:56.065 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:55 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2302347085' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:29:56.066 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:55 smithi097 ceph-mon[32687]: osdmap e244: 8 total, 8 up, 8 in 2021-10-08T19:29:56.067 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:55 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:29:56.067 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:55 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:29:56.070 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:55 smithi097 ceph-mon[41966]: pgmap v419: 178 pgs: 1 active+recovering+undersized+remapped, 177 active+clean; 4.8 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 219 op/s; 36/238845 objects misplaced (0.015%); 656 KiB/s, 11 objects/s recovering 2021-10-08T19:29:56.070 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:55 smithi097 ceph-mon[41966]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:29:56.070 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:55 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2302347085' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:29:56.071 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:55 smithi097 ceph-mon[41966]: osdmap e244: 8 total, 8 up, 8 in 2021-10-08T19:29:56.076 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:56.176 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:29:56.181 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:56.182 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:29:56.236 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:29:56.283 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:29:56.374 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:56.509 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:29:56.513 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:56.513 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:29:56.614 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:29:56.668 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:56.755 INFO:journalctl@ceph.osd.5.smithi117.stdout:Oct 08 19:29:56 smithi117 conmon[46504]: 2021-10-08T19:29:56.488+0000 7f7bf5f5c700 -1 osd.5 pg_epoch: 244 pg[6.d( empty local-lis/les=202/203 n=0 ec=66/66 lis/c=202/202 les/c/f=203/203/0 sis=202) [5,1,0] r=0 lpr=202 crt=0'0 mlcod 0'0 active+clean] scrubber pg(6.d) handle_scrub_reserve_grant: received unsolicited reservation grant from osd 0 (0x56152d3ebb80) 2021-10-08T19:29:56.756 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:56 smithi117 ceph-mon[34585]: 3.10 scrub ok 2021-10-08T19:29:56.756 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:56 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3230724292' entity='client.admin' cmd=[{"prefix": "osd rm-pg-upmap", "pgid": "1.6"}]: dispatch 2021-10-08T19:29:56.756 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:56 smithi117 ceph-mon[34585]: from='client.25288 ' entity='client.admin' cmd=[{"prefix": "osd rm-pg-upmap", "pgid": "1.6"}]: dispatch 2021-10-08T19:29:56.757 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:29:56 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:29:56.770 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:29:56.779 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:56.780 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:29:56.780 INFO:teuthology.orchestra.run.smithi097.stderr:clear 1.6 pg_upmap mapping 2021-10-08T19:29:56.881 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:29:56.936 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:56.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:56 smithi097 ceph-mon[41966]: 3.10 scrub ok 2021-10-08T19:29:56.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:56 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3230724292' entity='client.admin' cmd=[{"prefix": "osd rm-pg-upmap", "pgid": "1.6"}]: dispatch 2021-10-08T19:29:56.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:56 smithi097 ceph-mon[41966]: from='client.25288 ' entity='client.admin' cmd=[{"prefix": "osd rm-pg-upmap", "pgid": "1.6"}]: dispatch 2021-10-08T19:29:56.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:56 smithi097 ceph-mon[32687]: 3.10 scrub ok 2021-10-08T19:29:56.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:56 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3230724292' entity='client.admin' cmd=[{"prefix": "osd rm-pg-upmap", "pgid": "1.6"}]: dispatch 2021-10-08T19:29:56.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:56 smithi097 ceph-mon[32687]: from='client.25288 ' entity='client.admin' cmd=[{"prefix": "osd rm-pg-upmap", "pgid": "1.6"}]: dispatch 2021-10-08T19:29:57.057 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:29:57.060 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:57.061 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:29:57.162 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:29:57.209 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:57.291 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:29:57.300 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:29:57.300 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2021-10-08T19:29:57.302 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2021-10-08T19:29:57.302 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2021-10-08T19:29:57.302 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:29:57.303 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:57.304 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:29:57.406 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:29:57.451 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:57.620 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:29:57.627 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:57.627 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:29:57.728 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:29:57.766 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset nodeep-scrub 2021-10-08T19:29:57.770 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:57.834 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:29:57.837 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:57.837 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:29:57.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:57 smithi117 ceph-mon[34585]: 5.6 scrub ok 2021-10-08T19:29:57.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:57 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:29:57.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:57 smithi117 ceph-mon[34585]: pgmap v421: 178 pgs: 1 active+recovering+undersized+remapped, 177 active+clean; 4.8 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 198 op/s; 36/238845 objects misplaced (0.015%); 593 KiB/s, 10 objects/s recovering 2021-10-08T19:29:57.908 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:57 smithi117 ceph-mon[34585]: from='client.25288 ' entity='client.admin' cmd='[{"prefix": "osd rm-pg-upmap", "pgid": "1.6"}]': finished 2021-10-08T19:29:57.909 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:57 smithi117 ceph-mon[34585]: osdmap e245: 8 total, 8 up, 8 in 2021-10-08T19:29:57.939 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:29:57.968 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:58.020 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:29:58.023 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:58.025 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:29:58.126 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:29:58.149 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:58.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:57 smithi097 ceph-mon[32687]: 5.6 scrub ok 2021-10-08T19:29:58.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:57 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:29:58.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:57 smithi097 ceph-mon[32687]: pgmap v421: 178 pgs: 1 active+recovering+undersized+remapped, 177 active+clean; 4.8 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 198 op/s; 36/238845 objects misplaced (0.015%); 593 KiB/s, 10 objects/s recovering 2021-10-08T19:29:58.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:57 smithi097 ceph-mon[32687]: from='client.25288 ' entity='client.admin' cmd='[{"prefix": "osd rm-pg-upmap", "pgid": "1.6"}]': finished 2021-10-08T19:29:58.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:57 smithi097 ceph-mon[32687]: osdmap e245: 8 total, 8 up, 8 in 2021-10-08T19:29:58.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:57 smithi097 ceph-mon[41966]: 5.6 scrub ok 2021-10-08T19:29:58.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:57 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:29:58.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:57 smithi097 ceph-mon[41966]: pgmap v421: 178 pgs: 1 active+recovering+undersized+remapped, 177 active+clean; 4.8 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 198 op/s; 36/238845 objects misplaced (0.015%); 593 KiB/s, 10 objects/s recovering 2021-10-08T19:29:58.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:57 smithi097 ceph-mon[41966]: from='client.25288 ' entity='client.admin' cmd='[{"prefix": "osd rm-pg-upmap", "pgid": "1.6"}]': finished 2021-10-08T19:29:58.225 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:57 smithi097 ceph-mon[41966]: osdmap e245: 8 total, 8 up, 8 in 2021-10-08T19:29:58.389 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2021-10-08T19:29:58.408 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:29:58.410 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:58.411 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:29:58.513 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:29:58.539 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:58.673 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:29:58.788 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:58 smithi097 ceph-mon[32687]: 4.1d scrub ok 2021-10-08T19:29:58.789 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:58 smithi097 ceph-mon[32687]: 2.7 scrub ok 2021-10-08T19:29:58.789 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:58 smithi097 ceph-mon[41966]: 4.1d scrub ok 2021-10-08T19:29:58.789 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:58 smithi097 ceph-mon[41966]: 2.7 scrub ok 2021-10-08T19:29:58.790 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:58 smithi097 ceph-mon[41966]: osdmap e246: 8 total, 8 up, 8 in 2021-10-08T19:29:58.790 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:58 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:29:58.867 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:29:58.871 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:58.874 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:29:58.976 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:29:59.000 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:59.042 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:29:59.044 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:59.045 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:29:59.045 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:58 smithi117 ceph-mon[34585]: 4.1d scrub ok 2021-10-08T19:29:59.046 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:58 smithi117 ceph-mon[34585]: 2.7 scrub ok 2021-10-08T19:29:59.046 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:58 smithi117 ceph-mon[34585]: osdmap e246: 8 total, 8 up, 8 in 2021-10-08T19:29:59.046 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:58 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:29:59.147 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:29:59.210 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:58 smithi097 ceph-mon[32687]: osdmap e246: 8 total, 8 up, 8 in 2021-10-08T19:29:59.210 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:58 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:29:59.217 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:59.319 INFO:journalctl@ceph.osd.7.smithi117.stdout:Oct 08 19:29:59 smithi117 conmon[54364]: 2021-10-08T19:29:59.173+0000 7ff38703b700 -1 osd.7 pg_epoch: 247 pg[3.f( empty local-lis/les=132/133 n=0 ec=131/60 lis/c=132/132 les/c/f=133/133/0 sis=132) [7,4,0] r=0 lpr=132 crt=0'0 mlcod 0'0 active+clean] scrubber pg(3.f) handle_scrub_reserve_grant: received unsolicited reservation grant from osd 0 (0x55a626300840) 2021-10-08T19:29:59.320 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:29:59.326 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:59.327 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:29:59.364 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:29:59.428 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:29:59.495 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:59.584 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:29:59.589 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:59.590 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:29:59.691 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:29:59.708 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:29:59.727 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:59.744 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:29:59.760 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:29:59 smithi097 conmon[33110]: 172.21.15.97 - - [08/Oct/2021:19:29:59] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:29:59.782 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:29:59.786 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:29:59.787 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:29:59.788 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:29:59.841 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:29:59.878 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:29:59.888 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:29:59.912 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:29:59.955 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:29:59.959 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:29:59.991 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:30:00.006 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'false' 2021-10-08T19:30:00.006 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'false' 2021-10-08T19:30:00.007 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'false' 2021-10-08T19:30:00.007 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'false' 2021-10-08T19:30:00.007 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'false' 2021-10-08T19:30:00.007 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'false' 2021-10-08T19:30:00.007 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'false' 2021-10-08T19:30:00.008 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'false' 2021-10-08T19:30:00.022 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:59 smithi097 ceph-mon[41966]: 2.10 scrub ok 2021-10-08T19:30:00.022 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:59 smithi097 ceph-mon[41966]: 5.1f scrub ok 2021-10-08T19:30:00.023 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:59 smithi097 ceph-mon[41966]: pgmap v424: 178 pgs: 1 active+recovering+undersized+remapped, 177 active+clean; 4.8 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 0 B/s wr, 528 op/s; 36/234255 objects misplaced (0.015%); 618 KiB/s, 9 objects/s recovering 2021-10-08T19:30:00.023 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:59 smithi097 ceph-mon[41966]: osdmap e247: 8 total, 8 up, 8 in 2021-10-08T19:30:00.023 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:59 smithi097 ceph-mon[41966]: 5.15 scrub ok 2021-10-08T19:30:00.024 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:59 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:30:00.024 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:29:59 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1375417316' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:30:00.024 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:59 smithi097 ceph-mon[32687]: 2.10 scrub ok 2021-10-08T19:30:00.025 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:59 smithi097 ceph-mon[32687]: 5.1f scrub ok 2021-10-08T19:30:00.025 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:59 smithi097 ceph-mon[32687]: pgmap v424: 178 pgs: 1 active+recovering+undersized+remapped, 177 active+clean; 4.8 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 0 B/s wr, 528 op/s; 36/234255 objects misplaced (0.015%); 618 KiB/s, 9 objects/s recovering 2021-10-08T19:30:00.025 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:59 smithi097 ceph-mon[32687]: osdmap e247: 8 total, 8 up, 8 in 2021-10-08T19:30:00.025 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:59 smithi097 ceph-mon[32687]: 5.15 scrub ok 2021-10-08T19:30:00.026 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:59 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:30:00.026 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:29:59 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1375417316' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:30:00.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:59 smithi117 ceph-mon[34585]: 2.10 scrub ok 2021-10-08T19:30:00.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:59 smithi117 ceph-mon[34585]: 5.1f scrub ok 2021-10-08T19:30:00.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:59 smithi117 ceph-mon[34585]: pgmap v424: 178 pgs: 1 active+recovering+undersized+remapped, 177 active+clean; 4.8 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 0 B/s wr, 528 op/s; 36/234255 objects misplaced (0.015%); 618 KiB/s, 9 objects/s recovering 2021-10-08T19:30:00.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:59 smithi117 ceph-mon[34585]: osdmap e247: 8 total, 8 up, 8 in 2021-10-08T19:30:00.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:59 smithi117 ceph-mon[34585]: 5.15 scrub ok 2021-10-08T19:30:00.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:59 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:30:00.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:29:59 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1375417316' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:30:00.184 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:30:00.193 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:00.194 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:30:00.295 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:30:00.351 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:00.811 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:00 smithi117 ceph-mon[34585]: 2.0 scrub ok 2021-10-08T19:30:00.811 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:00 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:30:00.812 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:00 smithi117 ceph-mon[34585]: 172.21.15.97 - - [08/Oct/2021:19:29:59] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:30:00.812 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:00 smithi117 ceph-mon[34585]: osdmap e248: 8 total, 8 up, 8 in 2021-10-08T19:30:00.813 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:00 smithi117 ceph-mon[34585]: Health detail: HEALTH_WARN nodeep-scrub flag(s) set 2021-10-08T19:30:00.813 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:00 smithi117 ceph-mon[34585]: [WRN] OSDMAP_FLAGS: nodeep-scrub flag(s) set 2021-10-08T19:30:00.813 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:00 smithi117 ceph-mon[34585]: osdmap e249: 8 total, 8 up, 8 in 2021-10-08T19:30:00.836 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:30:00.842 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2021-10-08T19:30:00.842 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:30:00.845 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:00.846 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:30:00.947 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:30:00.992 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:01.215 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:00 smithi097 ceph-mon[41966]: 2.0 scrub ok 2021-10-08T19:30:01.215 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:00 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:30:01.215 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:00 smithi097 ceph-mon[41966]: 172.21.15.97 - - [08/Oct/2021:19:29:59] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:30:01.216 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:00 smithi097 ceph-mon[41966]: osdmap e248: 8 total, 8 up, 8 in 2021-10-08T19:30:01.216 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:00 smithi097 ceph-mon[41966]: Health detail: HEALTH_WARN nodeep-scrub flag(s) set 2021-10-08T19:30:01.216 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:00 smithi097 ceph-mon[41966]: [WRN] OSDMAP_FLAGS: nodeep-scrub flag(s) set 2021-10-08T19:30:01.216 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:00 smithi097 ceph-mon[41966]: osdmap e249: 8 total, 8 up, 8 in 2021-10-08T19:30:01.217 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:00 smithi097 ceph-mon[32687]: 2.0 scrub ok 2021-10-08T19:30:01.217 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:00 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:30:01.217 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:00 smithi097 ceph-mon[32687]: 172.21.15.97 - - [08/Oct/2021:19:29:59] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:30:01.217 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:00 smithi097 ceph-mon[32687]: osdmap e248: 8 total, 8 up, 8 in 2021-10-08T19:30:01.218 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:00 smithi097 ceph-mon[32687]: Health detail: HEALTH_WARN nodeep-scrub flag(s) set 2021-10-08T19:30:01.218 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:00 smithi097 ceph-mon[32687]: [WRN] OSDMAP_FLAGS: nodeep-scrub flag(s) set 2021-10-08T19:30:01.218 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:00 smithi097 ceph-mon[32687]: osdmap e249: 8 total, 8 up, 8 in 2021-10-08T19:30:01.278 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:30:01.284 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:01.284 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:30:01.385 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:30:01.432 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:01.503 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:30:01.511 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:01.512 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:30:01.613 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:30:01.664 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:01.815 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:01 smithi097 ceph-mon[32687]: 6.c scrub ok 2021-10-08T19:30:01.815 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:01 smithi097 ceph-mon[32687]: 2.f scrub ok 2021-10-08T19:30:01.816 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:01 smithi097 ceph-mon[32687]: pgmap v428: 178 pgs: 1 activating, 1 activating+undersized+remapped, 176 active+clean; 4.6 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 0 B/s wr, 1.17k op/s; 2/225186 objects degraded (0.001%); 594 KiB/s, 9 objects/s recovering 2021-10-08T19:30:01.816 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:01 smithi097 ceph-mon[41966]: 6.c scrub ok 2021-10-08T19:30:01.817 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:01 smithi097 ceph-mon[41966]: 2.f scrub ok 2021-10-08T19:30:01.817 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:01 smithi097 ceph-mon[41966]: pgmap v428: 178 pgs: 1 activating, 1 activating+undersized+remapped, 176 active+clean; 4.6 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 0 B/s wr, 1.17k op/s; 2/225186 objects degraded (0.001%); 594 KiB/s, 9 objects/s recovering 2021-10-08T19:30:01.864 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:30:01.870 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:01.871 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:30:01.877 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2021-10-08T19:30:01.952 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:01 smithi117 ceph-mon[34585]: 6.c scrub ok 2021-10-08T19:30:01.953 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:01 smithi117 ceph-mon[34585]: 2.f scrub ok 2021-10-08T19:30:01.953 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:01 smithi117 ceph-mon[34585]: pgmap v428: 178 pgs: 1 activating, 1 activating+undersized+remapped, 176 active+clean; 4.6 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 0 B/s wr, 1.17k op/s; 2/225186 objects degraded (0.001%); 594 KiB/s, 9 objects/s recovering 2021-10-08T19:30:01.973 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:30:02.018 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:02.160 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:30:02.166 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:02.167 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:30:02.268 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:30:02.315 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:30:02.316 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:02.403 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:30:02.408 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:02.409 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:30:02.510 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:30:02.552 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:02.643 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:30:02.651 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:02.653 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:30:02.720 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:30:02 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:30:02] "GET /metrics HTTP/1.1" 200 155811 "" "Prometheus/2.18.1" 2021-10-08T19:30:02.753 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:30:02.794 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:02.863 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is unset 2021-10-08T19:30:02.895 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:30:02.899 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:02.899 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:30:03.000 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:30:03.042 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:03.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:02 smithi117 ceph-mon[34585]: 4.8 scrub ok 2021-10-08T19:30:03.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:02 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2584808523' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:30:03.216 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2021-10-08T19:30:03.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:02 smithi097 ceph-mon[32687]: 4.8 scrub ok 2021-10-08T19:30:03.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:02 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2584808523' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:30:03.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:02 smithi097 ceph-mon[41966]: 4.8 scrub ok 2021-10-08T19:30:03.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:02 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2584808523' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:30:03.239 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:30:03.244 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:03.245 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:30:03.346 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:30:03.395 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:03.501 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:30:03.505 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:03.506 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:30:03.607 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:30:03.652 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:03.833 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:03 smithi117 ceph-mon[34585]: 3.9 scrub ok 2021-10-08T19:30:03.834 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:03 smithi117 ceph-mon[34585]: 4.6 scrub ok 2021-10-08T19:30:03.834 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:03 smithi117 ceph-mon[34585]: pgmap v429: 178 pgs: 1 activating, 1 activating+undersized+remapped, 176 active+clean; 4.6 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 0 B/s wr, 937 op/s; 2/225186 objects degraded (0.001%); 474 KiB/s, 7 objects/s recovering 2021-10-08T19:30:03.834 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:03 smithi117 ceph-mon[34585]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:30:03.834 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:03 smithi117 ceph-mon[34585]: Cluster is now healthy 2021-10-08T19:30:03.835 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:03 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2584808523' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:30:03.835 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:03 smithi117 ceph-mon[34585]: osdmap e250: 8 total, 8 up, 8 in 2021-10-08T19:30:03.835 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:03 smithi117 ceph-mon[34585]: 4.15 scrub ok 2021-10-08T19:30:03.836 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:30:03 smithi117 conmon[69189]: level=error ts=2021-10-08T19:30:03.504Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=2 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:30:03.876 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 4, 5, 7, 6, 1, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2021-10-08T19:30:03.877 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2021-10-08T19:30:03.878 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2021-10-08T19:30:03.878 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd test-reweight-by-utilization 1000 3.0 2021-10-08T19:30:03.946 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:03 smithi097 ceph-mon[32687]: 3.9 scrub ok 2021-10-08T19:30:03.947 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:03 smithi097 ceph-mon[32687]: 4.6 scrub ok 2021-10-08T19:30:03.947 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:03 smithi097 ceph-mon[32687]: pgmap v429: 178 pgs: 1 activating, 1 activating+undersized+remapped, 176 active+clean; 4.6 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 0 B/s wr, 937 op/s; 2/225186 objects degraded (0.001%); 474 KiB/s, 7 objects/s recovering 2021-10-08T19:30:03.947 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:03 smithi097 ceph-mon[32687]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:30:03.947 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:03 smithi097 ceph-mon[32687]: Cluster is now healthy 2021-10-08T19:30:03.948 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:03 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2584808523' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:30:03.948 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:03 smithi097 ceph-mon[32687]: osdmap e250: 8 total, 8 up, 8 in 2021-10-08T19:30:03.948 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:03 smithi097 ceph-mon[32687]: 4.15 scrub ok 2021-10-08T19:30:03.949 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:03 smithi097 ceph-mon[41966]: 3.9 scrub ok 2021-10-08T19:30:03.949 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:03 smithi097 ceph-mon[41966]: 4.6 scrub ok 2021-10-08T19:30:03.950 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:03 smithi097 ceph-mon[41966]: pgmap v429: 178 pgs: 1 activating, 1 activating+undersized+remapped, 176 active+clean; 4.6 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 0 B/s wr, 937 op/s; 2/225186 objects degraded (0.001%); 474 KiB/s, 7 objects/s recovering 2021-10-08T19:30:03.950 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:03 smithi097 ceph-mon[41966]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:30:03.950 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:03 smithi097 ceph-mon[41966]: Cluster is now healthy 2021-10-08T19:30:03.951 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:03 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2584808523' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:30:03.951 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:03 smithi097 ceph-mon[41966]: osdmap e250: 8 total, 8 up, 8 in 2021-10-08T19:30:03.951 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:03 smithi097 ceph-mon[41966]: 4.15 scrub ok 2021-10-08T19:30:03.951 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:30:03.954 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:30:03.958 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:03.959 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:30:04.061 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:30:04.094 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:30:03 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:30:03] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:30:04.102 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:04.184 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:30:04.187 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:04.188 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:30:04.290 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:30:04.340 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:04.422 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:30:04.428 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:04.429 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:30:04.531 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:30:04.579 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:04.663 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:30:04.668 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:04.669 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:30:04.754 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:30:04.771 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:30:04.794 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2021-10-08T19:30:04.795 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:30:04.839 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:04.923 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:30:04.928 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:04.929 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:30:05.032 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:30:05.082 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:04 smithi097 ceph-mon[41966]: 5.5 scrub ok 2021-10-08T19:30:05.083 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:04 smithi097 ceph-mon[32687]: 5.5 scrub ok 2021-10-08T19:30:05.084 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:05.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:04 smithi117 ceph-mon[34585]: 5.5 scrub ok 2021-10-08T19:30:05.701 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:30:05.708 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:05.708 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:30:05.810 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:30:05.862 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:05.864 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2021-10-08T19:30:05.947 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set noscrub 2021-10-08T19:30:05.960 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:05 smithi097 ceph-mon[41966]: 5.d deep-scrub ok 2021-10-08T19:30:05.960 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:05 smithi097 ceph-mon[41966]: 6.17 scrub ok 2021-10-08T19:30:05.960 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:05 smithi097 ceph-mon[41966]: pgmap v431: 178 pgs: 178 active+clean; 4.2 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 875 B/s rd, 0 B/s wr, 1.45k op/s; 394 KiB/s, 6 objects/s recovering 2021-10-08T19:30:05.961 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:05 smithi097 ceph-mon[41966]: 2.d scrub ok 2021-10-08T19:30:05.961 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:05 smithi097 ceph-mon[41966]: osdmap e251: 8 total, 8 up, 8 in 2021-10-08T19:30:05.962 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:05 smithi097 ceph-mon[32687]: 5.d deep-scrub ok 2021-10-08T19:30:05.962 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:05 smithi097 ceph-mon[32687]: 6.17 scrub ok 2021-10-08T19:30:05.962 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:05 smithi097 ceph-mon[32687]: pgmap v431: 178 pgs: 178 active+clean; 4.2 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 875 B/s rd, 0 B/s wr, 1.45k op/s; 394 KiB/s, 6 objects/s recovering 2021-10-08T19:30:05.962 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:05 smithi097 ceph-mon[32687]: 2.d scrub ok 2021-10-08T19:30:05.963 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:05 smithi097 ceph-mon[32687]: osdmap e251: 8 total, 8 up, 8 in 2021-10-08T19:30:06.001 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:30:06.006 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:06.007 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:30:06.108 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:30:06.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:05 smithi117 ceph-mon[34585]: 5.d deep-scrub ok 2021-10-08T19:30:06.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:05 smithi117 ceph-mon[34585]: 6.17 scrub ok 2021-10-08T19:30:06.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:05 smithi117 ceph-mon[34585]: pgmap v431: 178 pgs: 178 active+clean; 4.2 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 875 B/s rd, 0 B/s wr, 1.45k op/s; 394 KiB/s, 6 objects/s recovering 2021-10-08T19:30:06.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:05 smithi117 ceph-mon[34585]: 2.d scrub ok 2021-10-08T19:30:06.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:05 smithi117 ceph-mon[34585]: osdmap e251: 8 total, 8 up, 8 in 2021-10-08T19:30:06.167 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:06.242 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:30:06.275 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:30:06.283 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:06.284 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:30:06.386 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:30:06.424 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:06.548 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:30:06.554 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:06.555 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:30:06.602 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:30:06.632 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:30:06.634 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:30:06.656 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:30:06.678 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:30:06.700 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:30:06 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:30:06.705 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:06.719 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:30:06.758 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:30:06.785 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:30:06.787 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:06.788 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:30:06.790 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:30:06.832 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:30:06.863 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:30:06.864 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:06 smithi097 ceph-mon[32687]: 6.13 scrub ok 2021-10-08T19:30:06.864 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:06 smithi097 ceph-mon[32687]: 6.10 scrub ok 2021-10-08T19:30:06.864 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:06 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2559052339' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:30:06.875 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true' 2021-10-08T19:30:06.875 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true' 2021-10-08T19:30:06.876 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true' 2021-10-08T19:30:06.876 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true' 2021-10-08T19:30:06.876 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true' 2021-10-08T19:30:06.876 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true' 2021-10-08T19:30:06.876 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'true' 2021-10-08T19:30:06.877 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'true' 2021-10-08T19:30:06.890 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:30:06.935 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:07.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:06 smithi117 ceph-mon[34585]: 6.13 scrub ok 2021-10-08T19:30:07.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:06 smithi117 ceph-mon[34585]: 6.10 scrub ok 2021-10-08T19:30:07.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:06 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2559052339' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:30:07.206 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:30:07.211 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:07.212 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:30:07.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:06 smithi097 ceph-mon[41966]: 6.13 scrub ok 2021-10-08T19:30:07.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:06 smithi097 ceph-mon[41966]: 6.10 scrub ok 2021-10-08T19:30:07.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:06 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2559052339' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:30:07.312 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:30:07.365 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:07.463 INFO:journalctl@ceph.osd.4.smithi117.stdout:Oct 08 19:30:07 smithi117 conmon[42287]: 2021-10-08T19:30:07.450+0000 7f7e86a07700 -1 osd.4 pg_epoch: 251 pg[6.1a( empty local-lis/les=202/203 n=0 ec=66/66 lis/c=202/202 les/c/f=203/203/0 sis=202) [4,5,1] r=0 lpr=202 crt=0'0 mlcod 0'0 active+clean] scrubber pg(6.1a) handle_scrub_reserve_grant: received unsolicited reservation grant from osd 1 (0x556c3fd63e40) 2021-10-08T19:30:07.867 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:07 smithi117 ceph-mon[34585]: 2.1e scrub ok 2021-10-08T19:30:07.867 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:07 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:30:07.868 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:07 smithi117 ceph-mon[34585]: pgmap v433: 178 pgs: 178 active+clean; 4.2 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 850 B/s rd, 0 B/s wr, 905 op/s; 0 B/s, 0 objects/s recovering 2021-10-08T19:30:08.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:07 smithi097 ceph-mon[32687]: 2.1e scrub ok 2021-10-08T19:30:08.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:07 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:30:08.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:07 smithi097 ceph-mon[32687]: pgmap v433: 178 pgs: 178 active+clean; 4.2 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 850 B/s rd, 0 B/s wr, 905 op/s; 0 B/s, 0 objects/s recovering 2021-10-08T19:30:08.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:07 smithi097 ceph-mon[41966]: 2.1e scrub ok 2021-10-08T19:30:08.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:07 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:30:08.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:07 smithi097 ceph-mon[41966]: pgmap v433: 178 pgs: 178 active+clean; 4.2 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 850 B/s rd, 0 B/s wr, 905 op/s; 0 B/s, 0 objects/s recovering 2021-10-08T19:30:08.352 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:30:08.353 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:08.354 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:30:08.455 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:30:08.507 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:08.738 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:30:08.743 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:08.744 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:30:08.761 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:30:08.761 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2021-10-08T19:30:08.761 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2021-10-08T19:30:08.761 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2021-10-08T19:30:08.762 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:30:08.846 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:30:08.898 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:09.249 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:30:09.256 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:09.257 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:30:09.358 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:30:09.404 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:09.470 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:30:09.473 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:09.473 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:30:09.574 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:30:09.612 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:09.664 INFO:teuthology.orchestra.run.smithi097.stdout:moved 0 / 534 (0%) 2021-10-08T19:30:09.667 INFO:teuthology.orchestra.run.smithi097.stdout:avg 66.75 2021-10-08T19:30:09.667 INFO:teuthology.orchestra.run.smithi097.stdout:stddev 6.74073 -> 6.74073 (expected baseline 7.6424) 2021-10-08T19:30:09.668 INFO:teuthology.orchestra.run.smithi097.stdout:min osd.2 with 54 -> 54 pgs (0.808989 -> 0.808989 * mean) 2021-10-08T19:30:09.668 INFO:teuthology.orchestra.run.smithi097.stdout:max osd.7 with 76 -> 76 pgs (1.13858 -> 1.13858 * mean) 2021-10-08T19:30:09.669 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:30:09.669 INFO:teuthology.orchestra.run.smithi097.stdout:oload 1000 2021-10-08T19:30:09.670 INFO:teuthology.orchestra.run.smithi097.stdout:max_change 3 2021-10-08T19:30:09.671 INFO:teuthology.orchestra.run.smithi097.stdout:max_change_osds 4 2021-10-08T19:30:09.671 INFO:teuthology.orchestra.run.smithi097.stdout:average_utilization 0.0190 2021-10-08T19:30:09.672 INFO:teuthology.orchestra.run.smithi097.stdout:overload_utilization 0.1895 2021-10-08T19:30:09.673 INFO:teuthology.orchestra.run.smithi097.stderr:no change 2021-10-08T19:30:09.869 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:30:09.876 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:09.878 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:30:09.910 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2021-10-08T19:30:09.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:09 smithi097 ceph-mon[41966]: 8.9 scrub ok 2021-10-08T19:30:09.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:09 smithi097 ceph-mon[41966]: 3.11 scrub ok 2021-10-08T19:30:09.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:09 smithi097 ceph-mon[41966]: 4.9 scrub ok 2021-10-08T19:30:09.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:09 smithi097 ceph-mon[41966]: 4.16 scrub ok 2021-10-08T19:30:09.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:09 smithi097 ceph-mon[41966]: pgmap v434: 178 pgs: 178 active+clean; 4.1 GiB data, 14 GiB used, 702 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 894 op/s; 0 B/s, 0 objects/s recovering 2021-10-08T19:30:09.975 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:09 smithi097 ceph-mon[41966]: 5.c deep-scrub ok 2021-10-08T19:30:09.975 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:09 smithi097 ceph-mon[32687]: 8.9 scrub ok 2021-10-08T19:30:09.976 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:09 smithi097 ceph-mon[32687]: 3.11 scrub ok 2021-10-08T19:30:09.976 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:09 smithi097 ceph-mon[32687]: 4.9 scrub ok 2021-10-08T19:30:09.977 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:09 smithi097 ceph-mon[32687]: 4.16 scrub ok 2021-10-08T19:30:09.977 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:09 smithi097 ceph-mon[32687]: pgmap v434: 178 pgs: 178 active+clean; 4.1 GiB data, 14 GiB used, 702 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 894 op/s; 0 B/s, 0 objects/s recovering 2021-10-08T19:30:09.977 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:09 smithi097 ceph-mon[32687]: 5.c deep-scrub ok 2021-10-08T19:30:09.980 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:30:10.043 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:10.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:09 smithi117 ceph-mon[34585]: 8.9 scrub ok 2021-10-08T19:30:10.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:09 smithi117 ceph-mon[34585]: 3.11 scrub ok 2021-10-08T19:30:10.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:09 smithi117 ceph-mon[34585]: 4.9 scrub ok 2021-10-08T19:30:10.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:09 smithi117 ceph-mon[34585]: 4.16 scrub ok 2021-10-08T19:30:10.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:09 smithi117 ceph-mon[34585]: pgmap v434: 178 pgs: 178 active+clean; 4.1 GiB data, 14 GiB used, 702 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 894 op/s; 0 B/s, 0 objects/s recovering 2021-10-08T19:30:10.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:09 smithi117 ceph-mon[34585]: 5.c deep-scrub ok 2021-10-08T19:30:10.248 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:30:10.259 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:10.261 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:30:10.361 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:30:10.404 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:10.471 INFO:journalctl@ceph.osd.2.smithi097.stdout:Oct 08 19:30:10 smithi097 conmon[55904]: 2021-10-08T19:30:10.162+0000 7f5998e48700 -1 osd.2 pg_epoch: 251 pg[2.1( empty local-lis/les=236/237 n=0 ec=60/60 lis/c=236/236 les/c/f=237/237/0 sis=236) [2,3,0] r=0 lpr=236 crt=0'0 mlcod 0'0 active+clean] scrubber pg(2.1) handle_scrub_reserve_grant: received unsolicited reservation grant from osd 0 (0x56222ab41760) 2021-10-08T19:30:10.654 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2021-10-08T19:30:10.692 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:30:10.805 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:30:10.810 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:10.811 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:30:10.912 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:30:10.925 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2021-10-08T19:30:10.926 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd test-reweight-by-utilization 110 1.0 2021-10-08T19:30:10.945 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:10 smithi117 ceph-mon[34585]: 3.d scrub ok 2021-10-08T19:30:10.945 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:10 smithi117 ceph-mon[34585]: 6.16 scrub ok 2021-10-08T19:30:10.945 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:10 smithi117 ceph-mon[34585]: from='client.25303 v1:172.21.15.97:0/3477016044' entity='client.admin' cmd=[{"prefix": "osd test-reweight-by-utilization", "oload": 1000, "max_change": 3.0, "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:30:10.946 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:10 smithi117 ceph-mon[34585]: 2.4 scrub ok 2021-10-08T19:30:10.948 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:10.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:10 smithi097 ceph-mon[41966]: 3.d scrub ok 2021-10-08T19:30:10.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:10 smithi097 ceph-mon[41966]: 6.16 scrub ok 2021-10-08T19:30:10.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:10 smithi097 ceph-mon[41966]: from='client.25303 v1:172.21.15.97:0/3477016044' entity='client.admin' cmd=[{"prefix": "osd test-reweight-by-utilization", "oload": 1000, "max_change": 3.0, "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:30:10.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:10 smithi097 ceph-mon[41966]: 2.4 scrub ok 2021-10-08T19:30:10.975 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:10 smithi097 ceph-mon[32687]: 3.d scrub ok 2021-10-08T19:30:10.975 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:10 smithi097 ceph-mon[32687]: 6.16 scrub ok 2021-10-08T19:30:10.975 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:10 smithi097 ceph-mon[32687]: from='client.25303 v1:172.21.15.97:0/3477016044' entity='client.admin' cmd=[{"prefix": "osd test-reweight-by-utilization", "oload": 1000, "max_change": 3.0, "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:30:10.976 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:10 smithi097 ceph-mon[32687]: 2.4 scrub ok 2021-10-08T19:30:11.309 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:30:11.492 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:30:11.679 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:30:11.681 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:11.682 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:30:11.783 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:30:11.840 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:11.909 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:11 smithi097 ceph-mon[32687]: 4.17 scrub ok 2021-10-08T19:30:11.910 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:11 smithi097 ceph-mon[32687]: 3.c scrub ok 2021-10-08T19:30:11.910 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:11 smithi097 ceph-mon[32687]: pgmap v435: 178 pgs: 178 active+clean; 3.9 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.37k op/s; 0 B/s, 0 objects/s recovering 2021-10-08T19:30:11.910 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:11 smithi097 ceph-mon[32687]: 2.9 deep-scrub ok 2021-10-08T19:30:11.910 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:11 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1687151575' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:30:11.911 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:11 smithi097 ceph-mon[32687]: from='client.25309 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:30:11.911 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:11 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:30:11.911 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:11 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:30:11.912 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:11 smithi097 ceph-mon[41966]: 4.17 scrub ok 2021-10-08T19:30:11.912 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:11 smithi097 ceph-mon[41966]: 3.c scrub ok 2021-10-08T19:30:11.912 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:11 smithi097 ceph-mon[41966]: pgmap v435: 178 pgs: 178 active+clean; 3.9 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.37k op/s; 0 B/s, 0 objects/s recovering 2021-10-08T19:30:11.913 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:11 smithi097 ceph-mon[41966]: 2.9 deep-scrub ok 2021-10-08T19:30:11.913 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:11 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1687151575' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:30:11.913 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:11 smithi097 ceph-mon[41966]: from='client.25309 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:30:11.913 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:11 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:30:11.913 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:11 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:30:11.937 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:30:11.948 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:11 smithi117 ceph-mon[34585]: 4.17 scrub ok 2021-10-08T19:30:11.949 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:11 smithi117 ceph-mon[34585]: 3.c scrub ok 2021-10-08T19:30:11.949 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:11 smithi117 ceph-mon[34585]: pgmap v435: 178 pgs: 178 active+clean; 3.9 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.37k op/s; 0 B/s, 0 objects/s recovering 2021-10-08T19:30:11.949 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:11 smithi117 ceph-mon[34585]: 2.9 deep-scrub ok 2021-10-08T19:30:11.949 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:11 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1687151575' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:30:11.950 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:11 smithi117 ceph-mon[34585]: from='client.25309 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:30:11.950 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:11 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:30:11.950 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:11 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:30:11.962 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:11.963 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:30:12.063 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:30:12.132 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:12.626 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is set 2021-10-08T19:30:12.970 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:30:12 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:30:12] "GET /metrics HTTP/1.1" 200 155704 "" "Prometheus/2.18.1" 2021-10-08T19:30:12.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:12 smithi097 ceph-mon[32687]: 2.8 scrub ok 2021-10-08T19:30:12.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:12 smithi097 ceph-mon[32687]: 4.0 scrub ok 2021-10-08T19:30:12.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:12 smithi097 ceph-mon[32687]: 2.13 scrub ok 2021-10-08T19:30:12.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:12 smithi097 ceph-mon[32687]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:30:12.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:12 smithi097 ceph-mon[32687]: from='client.25309 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:30:12.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:12 smithi097 ceph-mon[32687]: osdmap e252: 8 total, 8 up, 8 in 2021-10-08T19:30:12.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:12 smithi097 ceph-mon[41966]: 2.8 scrub ok 2021-10-08T19:30:12.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:12 smithi097 ceph-mon[41966]: 4.0 scrub ok 2021-10-08T19:30:12.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:12 smithi097 ceph-mon[41966]: 2.13 scrub ok 2021-10-08T19:30:12.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:12 smithi097 ceph-mon[41966]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:30:12.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:12 smithi097 ceph-mon[41966]: from='client.25309 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:30:12.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:12 smithi097 ceph-mon[41966]: osdmap e252: 8 total, 8 up, 8 in 2021-10-08T19:30:13.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:12 smithi117 ceph-mon[34585]: 2.8 scrub ok 2021-10-08T19:30:13.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:12 smithi117 ceph-mon[34585]: 4.0 scrub ok 2021-10-08T19:30:13.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:12 smithi117 ceph-mon[34585]: 2.13 scrub ok 2021-10-08T19:30:13.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:12 smithi117 ceph-mon[34585]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:30:13.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:12 smithi117 ceph-mon[34585]: from='client.25309 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:30:13.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:12 smithi117 ceph-mon[34585]: osdmap e252: 8 total, 8 up, 8 in 2021-10-08T19:30:13.432 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:30:13.436 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:13.437 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:30:13.538 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:30:13.577 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:14.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:13 smithi117 ceph-mon[34585]: 6.12 scrub ok 2021-10-08T19:30:14.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:13 smithi117 ceph-mon[34585]: pgmap v437: 178 pgs: 178 active+clean; 3.9 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 691 op/s 2021-10-08T19:30:14.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:13 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:30:14.160 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:30:13 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:30:13] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:30:14.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:13 smithi097 ceph-mon[41966]: 6.12 scrub ok 2021-10-08T19:30:14.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:13 smithi097 ceph-mon[41966]: pgmap v437: 178 pgs: 178 active+clean; 3.9 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 691 op/s 2021-10-08T19:30:14.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:13 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:30:14.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:13 smithi097 ceph-mon[32687]: 6.12 scrub ok 2021-10-08T19:30:14.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:13 smithi097 ceph-mon[32687]: pgmap v437: 178 pgs: 178 active+clean; 3.9 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 691 op/s 2021-10-08T19:30:14.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:13 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:30:14.243 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:30:14.247 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:14.248 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:30:14.349 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:30:14.395 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:14.624 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:30:14.627 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:14.628 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:30:14.729 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:30:14.776 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:14.879 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:30:14.886 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:14.887 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:30:14.989 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:30:15.036 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:15.181 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:30:15.181 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2021-10-08T19:30:15.181 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2021-10-08T19:30:15.181 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2021-10-08T19:30:15.182 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.182 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:28530 8.9 8:91053ae4:::benchmark_data_smithi097_144160_object28529:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e191)", 2021-10-08T19:30:15.182 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:28:03.434104+0000", 2021-10-08T19:30:15.182 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 131.74147448100001, 2021-10-08T19:30:15.183 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.091794022000000003, 2021-10-08T19:30:15.183 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:30:15.183 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:30:15.183 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:30:15.183 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:30:15.184 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:30:15.184 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 28530 2021-10-08T19:30:15.184 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.184 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:30:15.185 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.185 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:30:15.185 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:03.434104+0000", 2021-10-08T19:30:15.185 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:15.185 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.186 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.186 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:30:15.186 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:03.434104+0000", 2021-10-08T19:30:15.186 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:15.187 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.187 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.187 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:30:15.187 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:03.434101+0000", 2021-10-08T19:30:15.187 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999971 2021-10-08T19:30:15.188 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.188 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.188 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:30:15.188 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:03.434145+0000", 2021-10-08T19:30:15.188 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.3671000000000003e-05 2021-10-08T19:30:15.189 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.189 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.189 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:30:15.189 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:03.434162+0000", 2021-10-08T19:30:15.190 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7223000000000001e-05 2021-10-08T19:30:15.190 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.190 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.190 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:30:15.190 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:03.434170+0000", 2021-10-08T19:30:15.191 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.1459999999999996e-06 2021-10-08T19:30:15.191 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.191 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.191 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:30:15.192 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:03.434216+0000", 2021-10-08T19:30:15.192 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.6001000000000002e-05 2021-10-08T19:30:15.192 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.192 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.192 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:30:15.193 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:03.434325+0000", 2021-10-08T19:30:15.193 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000109108 2021-10-08T19:30:15.193 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.193 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.193 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:30:15.194 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:03.434438+0000", 2021-10-08T19:30:15.194 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112397 2021-10-08T19:30:15.194 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.194 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.195 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:30:15.195 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:03.436350+0000", 2021-10-08T19:30:15.195 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0019127230000000001 2021-10-08T19:30:15.195 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.195 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.196 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:15.196 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:03.436393+0000", 2021-10-08T19:30:15.196 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2852999999999998e-05 2021-10-08T19:30:15.196 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.196 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.197 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:15.197 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:03.525797+0000", 2021-10-08T19:30:15.197 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.089403860000000002 2021-10-08T19:30:15.197 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.198 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.198 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:30:15.198 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:03.525855+0000", 2021-10-08T19:30:15.198 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8359000000000001e-05 2021-10-08T19:30:15.198 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.199 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.199 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:30:15.199 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:03.525898+0000", 2021-10-08T19:30:15.199 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2589999999999997e-05 2021-10-08T19:30:15.199 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:15.200 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:30:15.200 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:15.200 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.200 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.201 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:28531 8.9 8:90af759c:::benchmark_data_smithi097_144160_object28530:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e191)", 2021-10-08T19:30:15.201 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:28:03.434186+0000", 2021-10-08T19:30:15.201 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 131.74139230599999, 2021-10-08T19:30:15.201 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.091896620999999998, 2021-10-08T19:30:15.201 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:30:15.202 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:30:15.202 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:30:15.202 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:30:15.202 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:30:15.203 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 28531 2021-10-08T19:30:15.203 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.203 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:30:15.203 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.203 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:30:15.204 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:03.434186+0000", 2021-10-08T19:30:15.204 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:15.204 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.204 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.205 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:30:15.205 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:03.434186+0000", 2021-10-08T19:30:15.205 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:15.205 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.205 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.206 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:30:15.206 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:03.434185+0000", 2021-10-08T19:30:15.206 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:30:15.206 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.207 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.207 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:30:15.207 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:03.434257+0000", 2021-10-08T19:30:15.207 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2179000000000001e-05 2021-10-08T19:30:15.207 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.208 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.208 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:30:15.208 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:03.434268+0000", 2021-10-08T19:30:15.208 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0497e-05 2021-10-08T19:30:15.208 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.209 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.209 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:30:15.209 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:03.434274+0000", 2021-10-08T19:30:15.209 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9490000000000001e-06 2021-10-08T19:30:15.209 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.210 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.210 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:30:15.210 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:03.435327+0000", 2021-10-08T19:30:15.210 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0010534730000000001 2021-10-08T19:30:15.211 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.211 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.211 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:30:15.211 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:03.435477+0000", 2021-10-08T19:30:15.211 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014972799999999999 2021-10-08T19:30:15.212 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.212 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.212 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:30:15.212 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:03.435575+0000", 2021-10-08T19:30:15.213 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8615000000000004e-05 2021-10-08T19:30:15.213 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.213 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.213 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:30:15.213 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:03.436519+0000", 2021-10-08T19:30:15.214 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00094376200000000001 2021-10-08T19:30:15.214 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.214 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.214 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:15.214 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:03.436707+0000", 2021-10-08T19:30:15.215 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00018771099999999999 2021-10-08T19:30:15.215 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.215 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.215 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:15.216 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:03.525990+0000", 2021-10-08T19:30:15.216 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.089283690999999998 2021-10-08T19:30:15.216 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.216 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.216 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:30:15.217 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:03.526041+0000", 2021-10-08T19:30:15.217 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0912000000000003e-05 2021-10-08T19:30:15.217 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.217 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.217 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:30:15.218 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:03.526083+0000", 2021-10-08T19:30:15.218 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1273999999999998e-05 2021-10-08T19:30:15.218 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:15.218 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:30:15.219 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:15.219 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.219 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.219 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:28535 8.9 8:9c41100e:::benchmark_data_smithi097_144160_object28534:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e191)", 2021-10-08T19:30:15.219 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:28:03.438040+0000", 2021-10-08T19:30:15.220 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 131.73753799900001, 2021-10-08T19:30:15.220 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.089141665999999994, 2021-10-08T19:30:15.220 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:30:15.220 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:30:15.220 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:30:15.221 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:30:15.221 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:30:15.221 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 28535 2021-10-08T19:30:15.221 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.222 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:30:15.222 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.222 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:30:15.222 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:03.438040+0000", 2021-10-08T19:30:15.223 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:15.223 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.223 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.223 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:30:15.223 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:03.438040+0000", 2021-10-08T19:30:15.224 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:15.224 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.224 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.224 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:30:15.224 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:03.438038+0000", 2021-10-08T19:30:15.225 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:30:15.225 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.225 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.225 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:30:15.225 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:03.438094+0000", 2021-10-08T19:30:15.226 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6005000000000003e-05 2021-10-08T19:30:15.226 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.226 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.226 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:30:15.227 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:03.438106+0000", 2021-10-08T19:30:15.227 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1885000000000001e-05 2021-10-08T19:30:15.227 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.227 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.227 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:30:15.228 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:03.438113+0000", 2021-10-08T19:30:15.228 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.9299999999999997e-06 2021-10-08T19:30:15.228 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.228 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.228 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:30:15.229 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:03.438154+0000", 2021-10-08T19:30:15.229 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1085999999999999e-05 2021-10-08T19:30:15.229 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.229 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.229 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:30:15.230 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:03.438251+0000", 2021-10-08T19:30:15.230 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6916000000000005e-05 2021-10-08T19:30:15.230 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.230 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.231 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:30:15.231 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:03.438349+0000", 2021-10-08T19:30:15.231 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8036999999999997e-05 2021-10-08T19:30:15.231 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.231 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.232 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:30:15.232 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:03.439280+0000", 2021-10-08T19:30:15.232 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00093096699999999999 2021-10-08T19:30:15.232 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.232 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.233 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:15.233 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:03.439475+0000", 2021-10-08T19:30:15.233 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000194766 2021-10-08T19:30:15.233 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.234 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.234 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:15.234 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:03.527096+0000", 2021-10-08T19:30:15.234 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.087620649999999994 2021-10-08T19:30:15.234 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.235 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.235 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:30:15.235 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:03.527144+0000", 2021-10-08T19:30:15.235 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8832999999999998e-05 2021-10-08T19:30:15.236 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.236 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.236 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:30:15.236 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:03.527182+0000", 2021-10-08T19:30:15.236 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7588e-05 2021-10-08T19:30:15.237 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:15.237 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:30:15.237 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:15.237 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.237 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.238 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:36283 8.9 8:964d7656:::benchmark_data_smithi097_144160_object36282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e193)", 2021-10-08T19:30:15.238 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:28:08.102926+0000", 2021-10-08T19:30:15.238 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 127.07265232899999, 2021-10-08T19:30:15.238 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.05999736, 2021-10-08T19:30:15.239 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:30:15.239 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:30:15.239 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:30:15.239 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:30:15.239 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:30:15.240 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 36283 2021-10-08T19:30:15.240 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.240 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:30:15.240 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.240 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:30:15.241 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:08.102926+0000", 2021-10-08T19:30:15.241 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:15.241 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.241 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.242 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:30:15.242 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:08.102926+0000", 2021-10-08T19:30:15.242 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:15.242 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.242 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.243 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:30:15.243 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:08.102925+0000", 2021-10-08T19:30:15.243 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:30:15.243 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.244 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.244 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:30:15.244 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:08.102970+0000", 2021-10-08T19:30:15.244 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4830000000000003e-05 2021-10-08T19:30:15.244 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.245 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.245 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:30:15.245 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:08.102976+0000", 2021-10-08T19:30:15.245 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5080000000000002e-06 2021-10-08T19:30:15.245 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.246 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.246 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:30:15.246 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:08.102981+0000", 2021-10-08T19:30:15.246 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.741e-06 2021-10-08T19:30:15.246 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.247 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.247 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:30:15.247 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:08.104444+0000", 2021-10-08T19:30:15.247 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0014629619999999999 2021-10-08T19:30:15.248 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.248 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.248 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:30:15.248 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:08.104578+0000", 2021-10-08T19:30:15.248 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013438499999999999 2021-10-08T19:30:15.249 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.249 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.249 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:30:15.249 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:08.104723+0000", 2021-10-08T19:30:15.249 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014417 2021-10-08T19:30:15.250 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.250 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.250 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:30:15.250 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:08.106068+0000", 2021-10-08T19:30:15.251 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013449060000000001 2021-10-08T19:30:15.251 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.251 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.251 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:15.251 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:08.106529+0000", 2021-10-08T19:30:15.252 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00046178099999999998 2021-10-08T19:30:15.252 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.252 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.252 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:15.252 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:08.162828+0000", 2021-10-08T19:30:15.253 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.056299043999999999 2021-10-08T19:30:15.253 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.253 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.253 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:30:15.254 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:08.162884+0000", 2021-10-08T19:30:15.254 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5492999999999999e-05 2021-10-08T19:30:15.254 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.254 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.254 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:30:15.255 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:08.162923+0000", 2021-10-08T19:30:15.255 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9560000000000001e-05 2021-10-08T19:30:15.255 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:15.255 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:30:15.255 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:15.256 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.256 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.256 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:38203 8.5 8:a1146feb:::benchmark_data_smithi097_144160_object38202:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e193)", 2021-10-08T19:30:15.256 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:28:09.292537+0000", 2021-10-08T19:30:15.257 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 125.8830416, 2021-10-08T19:30:15.257 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.073254019000000004, 2021-10-08T19:30:15.257 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:30:15.257 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:30:15.257 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:30:15.258 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:30:15.258 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:30:15.258 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 38203 2021-10-08T19:30:15.258 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.258 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:30:15.259 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.259 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:30:15.259 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:09.292537+0000", 2021-10-08T19:30:15.259 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:15.259 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.260 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.260 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:30:15.260 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:09.292537+0000", 2021-10-08T19:30:15.260 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:15.261 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.261 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.261 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:30:15.261 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:09.292534+0000", 2021-10-08T19:30:15.261 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999971 2021-10-08T19:30:15.262 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.262 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.262 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:30:15.262 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:09.292587+0000", 2021-10-08T19:30:15.263 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2679000000000002e-05 2021-10-08T19:30:15.263 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.263 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.263 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:30:15.263 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:09.292596+0000", 2021-10-08T19:30:15.264 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3740000000000004e-06 2021-10-08T19:30:15.264 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.264 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.264 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:30:15.265 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:09.292604+0000", 2021-10-08T19:30:15.265 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4789999999999996e-06 2021-10-08T19:30:15.265 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.265 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.265 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:30:15.266 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:09.292645+0000", 2021-10-08T19:30:15.266 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0812000000000002e-05 2021-10-08T19:30:15.266 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.266 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.267 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:30:15.267 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:09.292754+0000", 2021-10-08T19:30:15.267 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000108415 2021-10-08T19:30:15.267 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.267 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.268 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 4,7", 2021-10-08T19:30:15.268 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:09.292884+0000", 2021-10-08T19:30:15.268 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013054000000000001 2021-10-08T19:30:15.268 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.268 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.269 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:30:15.269 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:09.294316+0000", 2021-10-08T19:30:15.269 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0014316299999999999 2021-10-08T19:30:15.269 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.269 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.270 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:15.270 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:09.294968+0000", 2021-10-08T19:30:15.270 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00065207999999999998 2021-10-08T19:30:15.270 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.271 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.271 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:15.271 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:09.365688+0000", 2021-10-08T19:30:15.271 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.070720058000000002 2021-10-08T19:30:15.271 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.272 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.272 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:30:15.272 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:09.365748+0000", 2021-10-08T19:30:15.272 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9654999999999997e-05 2021-10-08T19:30:15.272 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.273 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.273 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:30:15.273 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:09.365791+0000", 2021-10-08T19:30:15.273 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.3121999999999998e-05 2021-10-08T19:30:15.274 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:15.274 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:30:15.274 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:15.274 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.274 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.275 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:38205 8.9 8:9b1fa154:::benchmark_data_smithi097_144160_object38204:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e193)", 2021-10-08T19:30:15.275 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:28:09.292620+0000", 2021-10-08T19:30:15.275 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 125.882958055, 2021-10-08T19:30:15.275 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.073681877000000007, 2021-10-08T19:30:15.276 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:30:15.276 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:30:15.276 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:30:15.276 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:30:15.276 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:30:15.277 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 38205 2021-10-08T19:30:15.277 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.277 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:30:15.277 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.277 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:30:15.278 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:09.292620+0000", 2021-10-08T19:30:15.278 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:15.278 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.278 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.279 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:30:15.279 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:09.292620+0000", 2021-10-08T19:30:15.279 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:15.279 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.279 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.280 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:30:15.280 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:09.292619+0000", 2021-10-08T19:30:15.280 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:30:15.280 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.280 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.281 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:30:15.281 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:09.292694+0000", 2021-10-08T19:30:15.281 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5131999999999998e-05 2021-10-08T19:30:15.281 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.282 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.282 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:30:15.282 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:09.292702+0000", 2021-10-08T19:30:15.282 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8490000000000006e-06 2021-10-08T19:30:15.282 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.283 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.283 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:30:15.283 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:09.292707+0000", 2021-10-08T19:30:15.283 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8319999999999996e-06 2021-10-08T19:30:15.283 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.284 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.284 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:30:15.284 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:09.292766+0000", 2021-10-08T19:30:15.284 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8649e-05 2021-10-08T19:30:15.285 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.285 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.285 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:30:15.285 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:09.292849+0000", 2021-10-08T19:30:15.285 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3146000000000007e-05 2021-10-08T19:30:15.286 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.286 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.286 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:30:15.286 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:09.292943+0000", 2021-10-08T19:30:15.286 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.4660999999999994e-05 2021-10-08T19:30:15.287 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.287 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.287 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:30:15.287 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:09.294451+0000", 2021-10-08T19:30:15.287 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001507329 2021-10-08T19:30:15.288 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.288 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.288 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:15.288 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:09.297094+0000", 2021-10-08T19:30:15.289 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0026432719999999999 2021-10-08T19:30:15.289 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.289 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.289 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:15.289 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:09.366226+0000", 2021-10-08T19:30:15.290 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.069131729000000003 2021-10-08T19:30:15.290 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.290 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.290 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:30:15.290 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:09.366268+0000", 2021-10-08T19:30:15.291 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2077999999999999e-05 2021-10-08T19:30:15.291 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.291 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.291 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:30:15.292 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:09.366302+0000", 2021-10-08T19:30:15.292 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4341999999999997e-05 2021-10-08T19:30:15.292 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:15.292 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:30:15.292 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:15.293 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.293 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.293 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.15147.0:38210 8.3 e193/182 8:c0977127:::benchmark_data_smithi097_144160_object38209:head v 193'2473, mlcod=193'2471)", 2021-10-08T19:30:15.293 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:28:09.296597+0000", 2021-10-08T19:30:15.293 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 125.878981568, 2021-10-08T19:30:15.294 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.069012181000000006, 2021-10-08T19:30:15.294 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:30:15.294 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:30:15.294 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:30:15.295 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.295 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:30:15.295 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:09.296597+0000", 2021-10-08T19:30:15.295 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:15.295 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.296 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.296 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:30:15.296 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:09.296597+0000", 2021-10-08T19:30:15.296 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:15.297 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.297 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.297 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:30:15.297 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:09.296595+0000", 2021-10-08T19:30:15.297 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:30:15.298 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.298 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.298 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:30:15.299 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:09.296699+0000", 2021-10-08T19:30:15.299 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000104113 2021-10-08T19:30:15.299 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.299 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.300 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:30:15.300 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:09.296706+0000", 2021-10-08T19:30:15.300 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.9589999999999998e-06 2021-10-08T19:30:15.300 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.300 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.301 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:30:15.301 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:09.296711+0000", 2021-10-08T19:30:15.301 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.181e-06 2021-10-08T19:30:15.301 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.301 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.302 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:30:15.302 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:09.296757+0000", 2021-10-08T19:30:15.302 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.6134000000000002e-05 2021-10-08T19:30:15.302 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.303 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.303 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:30:15.303 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:09.296778+0000", 2021-10-08T19:30:15.303 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0409000000000001e-05 2021-10-08T19:30:15.303 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.304 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.304 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:30:15.304 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:09.365564+0000", 2021-10-08T19:30:15.304 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.068785765999999998 2021-10-08T19:30:15.304 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.305 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.305 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:30:15.305 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:09.365609+0000", 2021-10-08T19:30:15.305 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5393999999999999e-05 2021-10-08T19:30:15.306 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:15.306 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:30:15.306 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:15.306 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.306 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.307 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:59127 8.9 8:92dd395d:::benchmark_data_smithi097_144160_object59126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e200)", 2021-10-08T19:30:15.307 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:28:28.735290+0000", 2021-10-08T19:30:15.307 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 106.44028867199999, 2021-10-08T19:30:15.307 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.060774935000000002, 2021-10-08T19:30:15.307 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:30:15.308 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:30:15.308 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:30:15.308 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:30:15.308 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:30:15.309 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 59127 2021-10-08T19:30:15.309 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.309 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:30:15.309 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.309 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:30:15.310 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:28.735290+0000", 2021-10-08T19:30:15.310 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:15.310 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.310 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.310 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:30:15.311 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:28.735290+0000", 2021-10-08T19:30:15.311 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:15.311 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.311 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.312 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:30:15.312 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:28.735287+0000", 2021-10-08T19:30:15.312 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:30:15.312 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.312 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.313 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:30:15.313 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:28.735356+0000", 2021-10-08T19:30:15.313 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8777999999999998e-05 2021-10-08T19:30:15.313 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.313 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.314 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:30:15.314 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:28.735374+0000", 2021-10-08T19:30:15.314 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7425e-05 2021-10-08T19:30:15.314 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.315 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.315 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:30:15.315 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:28.735381+0000", 2021-10-08T19:30:15.315 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3030000000000002e-06 2021-10-08T19:30:15.315 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.316 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.316 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:30:15.316 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:28.735434+0000", 2021-10-08T19:30:15.316 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2867000000000001e-05 2021-10-08T19:30:15.316 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.317 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.317 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:30:15.317 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:28.735590+0000", 2021-10-08T19:30:15.317 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000155821 2021-10-08T19:30:15.318 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.318 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.318 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:30:15.318 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:28.735770+0000", 2021-10-08T19:30:15.318 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00018012599999999999 2021-10-08T19:30:15.319 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.319 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.319 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:30:15.319 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:28.738037+0000", 2021-10-08T19:30:15.320 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002267561 2021-10-08T19:30:15.320 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.320 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.320 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:15.320 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:28.738175+0000", 2021-10-08T19:30:15.321 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013783 2021-10-08T19:30:15.321 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.321 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.321 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:15.321 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:28.795952+0000", 2021-10-08T19:30:15.322 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.057776936000000001 2021-10-08T19:30:15.322 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.322 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.322 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:30:15.323 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:28.796014+0000", 2021-10-08T19:30:15.323 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2116e-05 2021-10-08T19:30:15.323 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.323 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.323 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:30:15.324 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:28.796065+0000", 2021-10-08T19:30:15.324 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0507999999999998e-05 2021-10-08T19:30:15.324 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:15.324 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:30:15.325 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:15.325 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.325 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.325 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:59305 8.9 8:979b1568:::benchmark_data_smithi097_144160_object59304:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e200)", 2021-10-08T19:30:15.325 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:28:29.087550+0000", 2021-10-08T19:30:15.326 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 106.088028002, 2021-10-08T19:30:15.326 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.061446832, 2021-10-08T19:30:15.326 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:30:15.326 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:30:15.327 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:30:15.327 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:30:15.327 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:30:15.327 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 59305 2021-10-08T19:30:15.327 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.328 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:30:15.328 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.328 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:30:15.328 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:29.087550+0000", 2021-10-08T19:30:15.328 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:15.329 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.329 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.329 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:30:15.329 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:29.087550+0000", 2021-10-08T19:30:15.329 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:15.330 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.330 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.330 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:30:15.330 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:29.087549+0000", 2021-10-08T19:30:15.331 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:30:15.331 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.331 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.331 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:30:15.331 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:29.087583+0000", 2021-10-08T19:30:15.332 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.3593999999999997e-05 2021-10-08T19:30:15.332 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.332 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.332 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:30:15.332 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:29.087597+0000", 2021-10-08T19:30:15.333 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4457999999999999e-05 2021-10-08T19:30:15.333 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.333 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.333 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:30:15.334 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:29.087602+0000", 2021-10-08T19:30:15.334 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7210000000000002e-06 2021-10-08T19:30:15.334 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.334 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.334 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:30:15.335 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:29.090036+0000", 2021-10-08T19:30:15.335 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024341749999999998 2021-10-08T19:30:15.335 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.335 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.335 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:30:15.336 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:29.090135+0000", 2021-10-08T19:30:15.336 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8165999999999995e-05 2021-10-08T19:30:15.336 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.336 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.337 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:30:15.337 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:29.090255+0000", 2021-10-08T19:30:15.337 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000120903 2021-10-08T19:30:15.337 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.337 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.338 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:15.338 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:29.094881+0000", 2021-10-08T19:30:15.338 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046259509999999997 2021-10-08T19:30:15.338 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.338 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.339 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:30:15.339 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:29.094916+0000", 2021-10-08T19:30:15.339 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4304999999999998e-05 2021-10-08T19:30:15.339 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.340 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.340 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:15.340 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:29.148876+0000", 2021-10-08T19:30:15.340 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.053960355000000002 2021-10-08T19:30:15.340 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.341 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.341 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:30:15.341 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:29.148945+0000", 2021-10-08T19:30:15.341 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.9079999999999996e-05 2021-10-08T19:30:15.341 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.342 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.342 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:30:15.342 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:29.148997+0000", 2021-10-08T19:30:15.342 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2065999999999999e-05 2021-10-08T19:30:15.343 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:15.343 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:30:15.343 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:15.343 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.343 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.344 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:59706 8.9 8:9c2bf312:::benchmark_data_smithi097_144160_object59705:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e200)", 2021-10-08T19:30:15.344 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:28:29.753491+0000", 2021-10-08T19:30:15.344 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 105.422087218, 2021-10-08T19:30:15.344 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.067117563000000005, 2021-10-08T19:30:15.344 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:30:15.345 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:30:15.345 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:30:15.345 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:30:15.345 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:30:15.346 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 59706 2021-10-08T19:30:15.346 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.346 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:30:15.346 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.346 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:30:15.347 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:29.753491+0000", 2021-10-08T19:30:15.347 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:15.347 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.347 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.347 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:30:15.348 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:29.753491+0000", 2021-10-08T19:30:15.348 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:15.348 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.348 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.349 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:30:15.349 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:29.753489+0000", 2021-10-08T19:30:15.349 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:30:15.349 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.349 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.350 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:30:15.350 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:29.753520+0000", 2021-10-08T19:30:15.350 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.1129e-05 2021-10-08T19:30:15.350 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.350 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.351 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:30:15.351 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:29.753534+0000", 2021-10-08T19:30:15.351 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3856000000000001e-05 2021-10-08T19:30:15.351 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.352 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.352 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:30:15.352 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:29.753539+0000", 2021-10-08T19:30:15.352 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.3510000000000001e-06 2021-10-08T19:30:15.352 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.353 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.353 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:30:15.353 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:29.753578+0000", 2021-10-08T19:30:15.353 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9270000000000002e-05 2021-10-08T19:30:15.353 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.354 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.354 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:30:15.354 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:29.753687+0000", 2021-10-08T19:30:15.354 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010901299999999999 2021-10-08T19:30:15.355 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.355 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.355 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:30:15.355 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:29.753788+0000", 2021-10-08T19:30:15.355 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000101036 2021-10-08T19:30:15.356 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.357 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.358 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:30:15.358 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:29.755509+0000", 2021-10-08T19:30:15.358 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001720545 2021-10-08T19:30:15.358 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.359 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.359 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:15.359 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:29.756249+0000", 2021-10-08T19:30:15.359 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00074029200000000003 2021-10-08T19:30:15.359 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.360 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.360 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:15.360 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:29.820546+0000", 2021-10-08T19:30:15.360 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.064296987 2021-10-08T19:30:15.361 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.361 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.361 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:30:15.361 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:29.820583+0000", 2021-10-08T19:30:15.362 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6786000000000003e-05 2021-10-08T19:30:15.362 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.362 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.362 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:30:15.362 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:29.820609+0000", 2021-10-08T19:30:15.363 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5746999999999999e-05 2021-10-08T19:30:15.363 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:15.363 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:30:15.363 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:15.364 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.364 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.364 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:61221 8.9 8:95a038f3:::benchmark_data_smithi097_144160_object61220:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e201)", 2021-10-08T19:30:15.364 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:28:31.754030+0000", 2021-10-08T19:30:15.365 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 103.42154873600001, 2021-10-08T19:30:15.365 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.068539994000000007, 2021-10-08T19:30:15.365 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:30:15.365 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:30:15.366 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:30:15.366 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:30:15.366 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:30:15.366 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 61221 2021-10-08T19:30:15.367 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.367 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:30:15.368 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.368 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:30:15.368 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:31.754030+0000", 2021-10-08T19:30:15.368 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:15.369 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.369 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.369 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:30:15.369 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:31.754030+0000", 2021-10-08T19:30:15.370 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:15.370 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.370 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.370 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:30:15.371 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:31.754028+0000", 2021-10-08T19:30:15.371 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:30:15.371 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.372 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.372 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:30:15.372 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:31.754086+0000", 2021-10-08T19:30:15.372 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8458999999999997e-05 2021-10-08T19:30:15.373 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.373 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.373 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:30:15.373 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:31.754100+0000", 2021-10-08T19:30:15.374 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3652000000000001e-05 2021-10-08T19:30:15.374 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.374 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.375 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:30:15.375 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:31.754106+0000", 2021-10-08T19:30:15.375 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1469999999999998e-06 2021-10-08T19:30:15.375 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.376 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.376 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:30:15.376 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:31.754162+0000", 2021-10-08T19:30:15.376 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6690000000000001e-05 2021-10-08T19:30:15.376 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.377 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.377 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:30:15.377 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:31.754299+0000", 2021-10-08T19:30:15.377 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013635000000000001 2021-10-08T19:30:15.378 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.378 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.378 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:30:15.378 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:31.754493+0000", 2021-10-08T19:30:15.379 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00019446599999999999 2021-10-08T19:30:15.379 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.379 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.380 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:30:15.380 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:31.759912+0000", 2021-10-08T19:30:15.380 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054188400000000003 2021-10-08T19:30:15.380 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.380 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.381 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:15.381 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:31.762919+0000", 2021-10-08T19:30:15.381 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0030068019999999998 2021-10-08T19:30:15.381 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.382 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.382 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:15.382 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:31.822472+0000", 2021-10-08T19:30:15.382 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.059553177999999998 2021-10-08T19:30:15.382 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.383 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.383 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:30:15.383 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:31.822529+0000", 2021-10-08T19:30:15.383 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6725000000000003e-05 2021-10-08T19:30:15.384 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.384 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.384 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:30:15.384 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:31.822570+0000", 2021-10-08T19:30:15.384 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0806999999999997e-05 2021-10-08T19:30:15.385 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:15.385 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:30:15.385 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:15.385 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.385 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.386 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:62081 8.9 8:9e328c73:::benchmark_data_smithi097_144160_object62080:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e201)", 2021-10-08T19:30:15.386 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:28:33.112645+0000", 2021-10-08T19:30:15.386 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 102.062933117, 2021-10-08T19:30:15.386 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.061104748, 2021-10-08T19:30:15.387 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:30:15.387 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:30:15.387 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:30:15.387 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:30:15.387 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:30:15.388 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 62081 2021-10-08T19:30:15.388 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.388 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:30:15.388 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.389 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:30:15.389 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:33.112645+0000", 2021-10-08T19:30:15.389 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:15.389 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.389 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.390 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:30:15.390 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:33.112645+0000", 2021-10-08T19:30:15.390 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:15.390 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.391 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.391 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:30:15.391 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:33.112643+0000", 2021-10-08T19:30:15.392 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:30:15.392 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.392 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.392 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:30:15.393 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:33.112711+0000", 2021-10-08T19:30:15.393 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8518999999999999e-05 2021-10-08T19:30:15.393 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.393 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.394 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:30:15.394 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:33.112727+0000", 2021-10-08T19:30:15.394 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5685e-05 2021-10-08T19:30:15.394 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.394 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.395 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:30:15.395 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:33.112734+0000", 2021-10-08T19:30:15.395 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7730000000000002e-06 2021-10-08T19:30:15.395 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.395 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.396 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:30:15.396 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:33.112800+0000", 2021-10-08T19:30:15.396 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6488000000000004e-05 2021-10-08T19:30:15.396 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.397 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.397 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:30:15.397 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:33.112897+0000", 2021-10-08T19:30:15.397 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6452000000000004e-05 2021-10-08T19:30:15.397 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.398 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.398 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:30:15.398 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:33.112995+0000", 2021-10-08T19:30:15.398 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7876999999999998e-05 2021-10-08T19:30:15.398 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.399 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.399 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:30:15.399 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:33.114889+0000", 2021-10-08T19:30:15.399 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018946200000000001 2021-10-08T19:30:15.400 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.400 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.400 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:15.400 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:33.116628+0000", 2021-10-08T19:30:15.401 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001738931 2021-10-08T19:30:15.401 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.401 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.401 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:15.401 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:33.173629+0000", 2021-10-08T19:30:15.402 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.057000749000000003 2021-10-08T19:30:15.402 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.402 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.402 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:30:15.402 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:33.173698+0000", 2021-10-08T19:30:15.403 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.9194000000000002e-05 2021-10-08T19:30:15.403 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.403 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.403 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:30:15.404 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:33.173750+0000", 2021-10-08T19:30:15.404 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1759999999999999e-05 2021-10-08T19:30:15.404 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:15.404 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:30:15.404 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:15.405 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.405 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.405 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:76329 8.9 8:98f91a30:::benchmark_data_smithi097_144160_object76328:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e220)", 2021-10-08T19:30:15.405 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:29:07.149535+0000", 2021-10-08T19:30:15.405 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 68.026043142999995, 2021-10-08T19:30:15.406 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.074999461000000003, 2021-10-08T19:30:15.406 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:30:15.406 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:30:15.406 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:30:15.407 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:30:15.407 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:30:15.407 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 76329 2021-10-08T19:30:15.407 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.407 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:30:15.408 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.408 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:30:15.408 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:07.149535+0000", 2021-10-08T19:30:15.408 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:15.409 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.409 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.409 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:30:15.409 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:07.149535+0000", 2021-10-08T19:30:15.409 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:15.410 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.410 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.410 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:30:15.411 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:07.149534+0000", 2021-10-08T19:30:15.411 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:30:15.411 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.411 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.411 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:30:15.412 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:07.149586+0000", 2021-10-08T19:30:15.412 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2775999999999998e-05 2021-10-08T19:30:15.412 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.412 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.412 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:30:15.413 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:07.149597+0000", 2021-10-08T19:30:15.413 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.099e-05 2021-10-08T19:30:15.413 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.413 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.414 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:30:15.414 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:07.149602+0000", 2021-10-08T19:30:15.414 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1900000000000003e-06 2021-10-08T19:30:15.414 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.414 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.415 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:30:15.415 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:07.149638+0000", 2021-10-08T19:30:15.415 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.5475000000000002e-05 2021-10-08T19:30:15.415 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.416 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.416 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:30:15.416 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:07.149732+0000", 2021-10-08T19:30:15.416 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3715999999999995e-05 2021-10-08T19:30:15.416 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.417 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.417 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:30:15.417 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:07.149852+0000", 2021-10-08T19:30:15.417 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012048 2021-10-08T19:30:15.417 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.418 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.418 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:30:15.418 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:07.152485+0000", 2021-10-08T19:30:15.418 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0026333210000000001 2021-10-08T19:30:15.419 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.419 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.419 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:15.419 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:07.152914+0000", 2021-10-08T19:30:15.419 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000428823 2021-10-08T19:30:15.420 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.420 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.420 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:15.420 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:07.224430+0000", 2021-10-08T19:30:15.420 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.071515908000000003 2021-10-08T19:30:15.421 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.421 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.421 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:30:15.421 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:07.224495+0000", 2021-10-08T19:30:15.422 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4681e-05 2021-10-08T19:30:15.422 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.422 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.422 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:30:15.422 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:07.224535+0000", 2021-10-08T19:30:15.423 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9821999999999999e-05 2021-10-08T19:30:15.423 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:15.423 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:30:15.423 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:15.424 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.424 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.424 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:78313 8.9 8:97659de5:::benchmark_data_smithi097_144160_object78312:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e220)", 2021-10-08T19:30:15.424 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:29:09.575153+0000", 2021-10-08T19:30:15.424 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 65.600425016000003, 2021-10-08T19:30:15.425 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.059688640000000001, 2021-10-08T19:30:15.425 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:30:15.425 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:30:15.425 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:30:15.426 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:30:15.426 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:30:15.426 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 78313 2021-10-08T19:30:15.426 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.426 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:30:15.427 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.427 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:30:15.427 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:09.575153+0000", 2021-10-08T19:30:15.427 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:15.428 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.428 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.428 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:30:15.428 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:09.575153+0000", 2021-10-08T19:30:15.428 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:15.429 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.429 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.429 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:30:15.429 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:09.575152+0000", 2021-10-08T19:30:15.429 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:30:15.430 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.430 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.430 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:30:15.430 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:09.575190+0000", 2021-10-08T19:30:15.431 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7697999999999997e-05 2021-10-08T19:30:15.431 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.431 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.431 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:30:15.431 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:09.575198+0000", 2021-10-08T19:30:15.432 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6249999999999998e-06 2021-10-08T19:30:15.432 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.432 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.432 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:30:15.433 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:09.575203+0000", 2021-10-08T19:30:15.433 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0459999999999996e-06 2021-10-08T19:30:15.433 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.433 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.433 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:30:15.434 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:09.578275+0000", 2021-10-08T19:30:15.434 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0030719380000000002 2021-10-08T19:30:15.434 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.434 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.435 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:30:15.435 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:09.578428+0000", 2021-10-08T19:30:15.435 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000153017 2021-10-08T19:30:15.435 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.435 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.436 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:30:15.436 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:09.578569+0000", 2021-10-08T19:30:15.436 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000140963 2021-10-08T19:30:15.436 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.437 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.437 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:30:15.437 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:09.581449+0000", 2021-10-08T19:30:15.437 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028805699999999998 2021-10-08T19:30:15.437 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.438 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.438 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:15.438 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:09.583110+0000", 2021-10-08T19:30:15.438 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0016605540000000001 2021-10-08T19:30:15.438 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.439 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.439 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:15.439 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:09.634741+0000", 2021-10-08T19:30:15.439 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.051630988000000003 2021-10-08T19:30:15.440 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.440 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.440 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:30:15.440 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:09.634797+0000", 2021-10-08T19:30:15.441 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5823999999999999e-05 2021-10-08T19:30:15.441 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.441 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.441 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:30:15.442 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:09.634842+0000", 2021-10-08T19:30:15.442 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5388e-05 2021-10-08T19:30:15.442 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:15.442 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:30:15.442 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:15.443 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.443 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.443 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:80232 8.9 8:901f2616:::benchmark_data_smithi097_144160_object80231:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e221)", 2021-10-08T19:30:15.443 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:29:11.827388+0000", 2021-10-08T19:30:15.444 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 63.348190336999998, 2021-10-08T19:30:15.444 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.064570506, 2021-10-08T19:30:15.444 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:30:15.444 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:30:15.444 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:30:15.445 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:30:15.445 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:30:15.445 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 80232 2021-10-08T19:30:15.445 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.445 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:30:15.446 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.446 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:30:15.446 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:11.827388+0000", 2021-10-08T19:30:15.446 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:15.447 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.447 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.447 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:30:15.447 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:11.827388+0000", 2021-10-08T19:30:15.447 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:15.448 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.448 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.448 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:30:15.448 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:11.827387+0000", 2021-10-08T19:30:15.449 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:30:15.449 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.449 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.449 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:30:15.449 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:11.827436+0000", 2021-10-08T19:30:15.450 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9249000000000002e-05 2021-10-08T19:30:15.450 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.450 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.450 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:30:15.451 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:11.827445+0000", 2021-10-08T19:30:15.451 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.4190000000000008e-06 2021-10-08T19:30:15.451 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.451 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.451 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:30:15.452 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:11.827449+0000", 2021-10-08T19:30:15.452 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2880000000000003e-06 2021-10-08T19:30:15.452 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.452 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.452 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:30:15.453 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:11.827580+0000", 2021-10-08T19:30:15.453 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000130896 2021-10-08T19:30:15.453 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.453 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.454 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:30:15.454 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:11.827668+0000", 2021-10-08T19:30:15.454 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.7600000000000002e-05 2021-10-08T19:30:15.454 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.454 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.455 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:30:15.455 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:11.827759+0000", 2021-10-08T19:30:15.455 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.1440000000000005e-05 2021-10-08T19:30:15.455 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.456 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.456 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:30:15.456 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:11.829638+0000", 2021-10-08T19:30:15.456 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018784660000000001 2021-10-08T19:30:15.456 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.457 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.457 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:15.457 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:11.830010+0000", 2021-10-08T19:30:15.457 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000371894 2021-10-08T19:30:15.457 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.458 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.458 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:15.458 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:11.891865+0000", 2021-10-08T19:30:15.458 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.061855180000000003 2021-10-08T19:30:15.459 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.459 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.459 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:30:15.459 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:11.891921+0000", 2021-10-08T19:30:15.459 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5859999999999997e-05 2021-10-08T19:30:15.460 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.460 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.460 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:30:15.460 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:11.891959+0000", 2021-10-08T19:30:15.461 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7731000000000002e-05 2021-10-08T19:30:15.461 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:15.461 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:30:15.461 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:15.461 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.462 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.462 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:93116 8.9 8:95290974:::benchmark_data_smithi097_144160_object4376:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e227)", 2021-10-08T19:30:15.462 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:29:26.684928+0000", 2021-10-08T19:30:15.462 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 48.490650842999997, 2021-10-08T19:30:15.462 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.109489305, 2021-10-08T19:30:15.463 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:30:15.463 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:30:15.463 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:30:15.463 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:30:15.464 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:30:15.464 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 93116 2021-10-08T19:30:15.464 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.464 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:30:15.464 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.465 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:30:15.465 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:26.684928+0000", 2021-10-08T19:30:15.465 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:15.465 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.465 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.466 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:30:15.466 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:26.684928+0000", 2021-10-08T19:30:15.466 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:15.466 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.467 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.467 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:30:15.467 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:26.684925+0000", 2021-10-08T19:30:15.467 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:30:15.468 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.468 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.468 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:30:15.468 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:26.684933+0000", 2021-10-08T19:30:15.468 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4019999999999996e-06 2021-10-08T19:30:15.469 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.469 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.469 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:30:15.469 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:26.684947+0000", 2021-10-08T19:30:15.469 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4714e-05 2021-10-08T19:30:15.470 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.470 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.470 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:30:15.470 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:26.684954+0000", 2021-10-08T19:30:15.471 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3239999999999999e-06 2021-10-08T19:30:15.471 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.471 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.471 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:30:15.471 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:26.684998+0000", 2021-10-08T19:30:15.472 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4245000000000001e-05 2021-10-08T19:30:15.472 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.472 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.473 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:30:15.473 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:26.685117+0000", 2021-10-08T19:30:15.473 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000119104 2021-10-08T19:30:15.473 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.474 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.474 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:30:15.474 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:26.685240+0000", 2021-10-08T19:30:15.474 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000122972 2021-10-08T19:30:15.475 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.475 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.475 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:30:15.475 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:26.687923+0000", 2021-10-08T19:30:15.475 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0026833709999999999 2021-10-08T19:30:15.476 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.476 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.476 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:15.476 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:26.690339+0000", 2021-10-08T19:30:15.476 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024153769999999998 2021-10-08T19:30:15.477 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.477 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.477 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:15.477 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:26.794323+0000", 2021-10-08T19:30:15.478 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.103984364 2021-10-08T19:30:15.478 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.478 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.478 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:30:15.478 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:26.794378+0000", 2021-10-08T19:30:15.479 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5050000000000003e-05 2021-10-08T19:30:15.479 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.479 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.479 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:30:15.480 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:26.794417+0000", 2021-10-08T19:30:15.480 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8748999999999998e-05 2021-10-08T19:30:15.480 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:15.480 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:30:15.481 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:15.481 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.481 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.481 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:96588 8.9 8:9f90c7e9:::benchmark_data_smithi097_144160_object7848:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e243)", 2021-10-08T19:30:15.481 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:29:52.337368+0000", 2021-10-08T19:30:15.482 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 22.838210062000002, 2021-10-08T19:30:15.482 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.097078523, 2021-10-08T19:30:15.482 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:30:15.482 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:30:15.483 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:30:15.483 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:30:15.483 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:30:15.483 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 96588 2021-10-08T19:30:15.483 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.484 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:30:15.484 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.484 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:30:15.484 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:52.337368+0000", 2021-10-08T19:30:15.484 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:15.485 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.485 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.485 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:30:15.485 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:52.337368+0000", 2021-10-08T19:30:15.486 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:15.486 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.486 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.486 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:30:15.486 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:52.337367+0000", 2021-10-08T19:30:15.487 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:30:15.487 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.487 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.487 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:30:15.487 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:52.337372+0000", 2021-10-08T19:30:15.488 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.04e-06 2021-10-08T19:30:15.488 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.488 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.488 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:30:15.489 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:52.337379+0000", 2021-10-08T19:30:15.489 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7490000000000001e-06 2021-10-08T19:30:15.489 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.489 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.489 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:30:15.490 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:52.337384+0000", 2021-10-08T19:30:15.490 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.237e-06 2021-10-08T19:30:15.490 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.490 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.490 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:30:15.491 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:52.337434+0000", 2021-10-08T19:30:15.491 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9552999999999998e-05 2021-10-08T19:30:15.491 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.491 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.491 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:30:15.492 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:52.337567+0000", 2021-10-08T19:30:15.492 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013311400000000001 2021-10-08T19:30:15.492 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.493 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.493 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:30:15.493 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:52.337691+0000", 2021-10-08T19:30:15.493 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012433 2021-10-08T19:30:15.493 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.494 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.494 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:30:15.494 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:52.340181+0000", 2021-10-08T19:30:15.494 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024894990000000001 2021-10-08T19:30:15.495 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.495 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.495 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:15.495 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:52.340608+0000", 2021-10-08T19:30:15.495 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00042770200000000002 2021-10-08T19:30:15.496 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.496 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.496 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:15.496 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:52.434342+0000", 2021-10-08T19:30:15.497 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.093733398999999995 2021-10-08T19:30:15.497 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.497 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.497 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:30:15.497 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:52.434402+0000", 2021-10-08T19:30:15.498 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0322000000000003e-05 2021-10-08T19:30:15.498 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.498 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.498 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:30:15.498 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:52.434447+0000", 2021-10-08T19:30:15.499 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4798e-05 2021-10-08T19:30:15.499 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:15.499 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:30:15.499 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:15.500 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.500 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.500 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:111714 8.9 8:9c7a0c07:::benchmark_data_smithi097_144160_object22974:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e251)", 2021-10-08T19:30:15.500 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:30:07.218878+0000", 2021-10-08T19:30:15.500 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 7.9567003759999997, 2021-10-08T19:30:15.501 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.060240636, 2021-10-08T19:30:15.501 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:30:15.501 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:30:15.501 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:30:15.501 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:30:15.502 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:30:15.502 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 111714 2021-10-08T19:30:15.502 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.502 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:30:15.503 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.503 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:30:15.503 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:07.218878+0000", 2021-10-08T19:30:15.503 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:15.503 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.504 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.504 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:30:15.504 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:07.218878+0000", 2021-10-08T19:30:15.504 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:15.505 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.505 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.505 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:30:15.505 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:07.218876+0000", 2021-10-08T19:30:15.505 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:30:15.506 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.506 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.506 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:30:15.506 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:07.218882+0000", 2021-10-08T19:30:15.506 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5940000000000001e-06 2021-10-08T19:30:15.507 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.507 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.507 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:30:15.507 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:07.218891+0000", 2021-10-08T19:30:15.508 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6300000000000004e-06 2021-10-08T19:30:15.508 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.508 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.508 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:30:15.508 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:07.218895+0000", 2021-10-08T19:30:15.509 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4959999999999998e-06 2021-10-08T19:30:15.509 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.509 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.509 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:30:15.509 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:07.218928+0000", 2021-10-08T19:30:15.510 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2607999999999997e-05 2021-10-08T19:30:15.510 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.510 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.510 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:30:15.510 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:07.219025+0000", 2021-10-08T19:30:15.511 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7738000000000005e-05 2021-10-08T19:30:15.511 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.511 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.511 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:30:15.512 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:07.219149+0000", 2021-10-08T19:30:15.512 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012365400000000001 2021-10-08T19:30:15.512 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.512 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.512 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:30:15.513 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:07.221917+0000", 2021-10-08T19:30:15.513 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002767725 2021-10-08T19:30:15.513 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.513 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.513 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:15.514 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:07.222115+0000", 2021-10-08T19:30:15.514 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000198629 2021-10-08T19:30:15.514 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.514 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.515 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:15.515 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:07.279018+0000", 2021-10-08T19:30:15.515 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.056902899 2021-10-08T19:30:15.515 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.515 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.516 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:30:15.516 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:07.279071+0000", 2021-10-08T19:30:15.516 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2154999999999998e-05 2021-10-08T19:30:15.516 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.516 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.517 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:30:15.517 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:07.279119+0000", 2021-10-08T19:30:15.517 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8097999999999999e-05 2021-10-08T19:30:15.517 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:15.518 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:30:15.518 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:15.518 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.518 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.518 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:119576 8.9 8:934be9c8:::benchmark_data_smithi097_144160_object30836:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e252)", 2021-10-08T19:30:15.519 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:30:14.047000+0000", 2021-10-08T19:30:15.519 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 1.128578404, 2021-10-08T19:30:15.519 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.108299453, 2021-10-08T19:30:15.519 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:30:15.520 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:30:15.520 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:30:15.520 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:30:15.520 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:30:15.520 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 119576 2021-10-08T19:30:15.521 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.521 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:30:15.521 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.521 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:30:15.521 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:14.047000+0000", 2021-10-08T19:30:15.522 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:15.522 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.522 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.522 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:30:15.523 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:14.047000+0000", 2021-10-08T19:30:15.523 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:15.523 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.523 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.523 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:30:15.524 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:14.046998+0000", 2021-10-08T19:30:15.524 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:30:15.524 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.524 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.525 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:30:15.525 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:14.047005+0000", 2021-10-08T19:30:15.525 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1910000000000003e-06 2021-10-08T19:30:15.525 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.525 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.526 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:30:15.526 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:14.047023+0000", 2021-10-08T19:30:15.526 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.802e-05 2021-10-08T19:30:15.526 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.527 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.527 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:30:15.527 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:14.047030+0000", 2021-10-08T19:30:15.527 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4059999999999999e-06 2021-10-08T19:30:15.527 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.528 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.528 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:30:15.528 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:14.047073+0000", 2021-10-08T19:30:15.528 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2178000000000002e-05 2021-10-08T19:30:15.528 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.529 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.529 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:30:15.529 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:14.047194+0000", 2021-10-08T19:30:15.529 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012154000000000001 2021-10-08T19:30:15.530 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.530 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.530 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:30:15.530 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:14.047305+0000", 2021-10-08T19:30:15.531 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011118 2021-10-08T19:30:15.531 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.531 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.531 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:30:15.532 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:14.049858+0000", 2021-10-08T19:30:15.532 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0025522190000000001 2021-10-08T19:30:15.532 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.532 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.532 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:15.533 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:14.052075+0000", 2021-10-08T19:30:15.533 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022171769999999999 2021-10-08T19:30:15.533 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.533 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.533 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:15.534 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:14.155208+0000", 2021-10-08T19:30:15.534 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.10313312500000001 2021-10-08T19:30:15.534 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.534 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.535 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:30:15.535 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:14.155259+0000", 2021-10-08T19:30:15.535 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0909000000000003e-05 2021-10-08T19:30:15.535 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.535 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.536 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:30:15.536 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:14.155299+0000", 2021-10-08T19:30:15.536 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0683000000000003e-05 2021-10-08T19:30:15.536 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:15.536 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:30:15.537 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:15.537 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.537 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.537 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:119595 8.9 8:9bb576c1:::benchmark_data_smithi097_144160_object30855:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e252)", 2021-10-08T19:30:15.538 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:30:14.061188+0000", 2021-10-08T19:30:15.538 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 1.114390698, 2021-10-08T19:30:15.538 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.095925595000000002, 2021-10-08T19:30:15.538 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:30:15.538 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:30:15.539 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:30:15.539 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:30:15.539 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:30:15.539 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 119595 2021-10-08T19:30:15.539 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.540 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:30:15.540 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.540 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:30:15.540 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:14.061188+0000", 2021-10-08T19:30:15.541 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:15.541 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.541 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.541 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:30:15.541 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:14.061188+0000", 2021-10-08T19:30:15.542 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:15.542 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.542 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.542 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:30:15.543 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:14.061186+0000", 2021-10-08T19:30:15.543 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:30:15.543 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.543 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.543 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:30:15.544 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:14.061192+0000", 2021-10-08T19:30:15.544 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1249999999999998e-06 2021-10-08T19:30:15.544 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.544 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.544 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:30:15.545 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:14.061203+0000", 2021-10-08T19:30:15.545 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1224e-05 2021-10-08T19:30:15.545 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.545 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.545 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:30:15.546 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:14.061208+0000", 2021-10-08T19:30:15.546 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1109999999999999e-06 2021-10-08T19:30:15.546 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.546 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.547 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:30:15.547 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:14.061248+0000", 2021-10-08T19:30:15.547 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0065999999999999e-05 2021-10-08T19:30:15.547 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.547 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.548 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:30:15.548 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:14.061356+0000", 2021-10-08T19:30:15.548 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010747999999999999 2021-10-08T19:30:15.548 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.549 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.549 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:30:15.549 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:14.061441+0000", 2021-10-08T19:30:15.549 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4776000000000003e-05 2021-10-08T19:30:15.549 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.550 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.550 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:30:15.550 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:14.063415+0000", 2021-10-08T19:30:15.550 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001974539 2021-10-08T19:30:15.551 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.551 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.551 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:15.551 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:14.063806+0000", 2021-10-08T19:30:15.551 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00039060000000000001 2021-10-08T19:30:15.552 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.552 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.552 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:15.552 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:14.157023+0000", 2021-10-08T19:30:15.553 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.093217031000000006 2021-10-08T19:30:15.553 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.553 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.553 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:30:15.553 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:14.157076+0000", 2021-10-08T19:30:15.554 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.3140000000000003e-05 2021-10-08T19:30:15.554 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:15.554 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:15.554 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:30:15.554 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:14.157113+0000", 2021-10-08T19:30:15.555 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7413000000000002e-05 2021-10-08T19:30:15.555 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:15.555 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:30:15.555 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:15.556 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:15.556 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:30:15.556 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:30:15.558 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:15.559 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:30:15.559 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:30:15.560 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:30:15.560 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:30:15.560 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:30:15.560 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:30:15.561 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:30:15.561 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:30:15.561 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:30:15.561 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:30:15.562 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'false' 2021-10-08T19:30:15.562 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'false' 2021-10-08T19:30:15.562 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'false' 2021-10-08T19:30:15.562 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'false' 2021-10-08T19:30:15.563 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'false' 2021-10-08T19:30:15.563 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'false' 2021-10-08T19:30:15.563 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'false' 2021-10-08T19:30:15.563 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'false' 2021-10-08T19:30:15.663 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:30:15.716 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:15.826 INFO:teuthology.orchestra.run.smithi097.stdout:moved 22 / 534 (4.11985%) 2021-10-08T19:30:15.827 INFO:teuthology.orchestra.run.smithi097.stdout:avg 66.75 2021-10-08T19:30:15.827 INFO:teuthology.orchestra.run.smithi097.stdout:stddev 6.74073 -> 8.68548 (expected baseline 7.6424) 2021-10-08T19:30:15.827 INFO:teuthology.orchestra.run.smithi097.stdout:min osd.2 with 54 -> 60 pgs (0.808989 -> 0.898876 * mean) 2021-10-08T19:30:15.827 INFO:teuthology.orchestra.run.smithi097.stdout:max osd.7 with 76 -> 79 pgs (1.13858 -> 1.18352 * mean) 2021-10-08T19:30:15.828 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:30:15.828 INFO:teuthology.orchestra.run.smithi097.stdout:oload 110 2021-10-08T19:30:15.828 INFO:teuthology.orchestra.run.smithi097.stdout:max_change 1 2021-10-08T19:30:15.828 INFO:teuthology.orchestra.run.smithi097.stdout:max_change_osds 4 2021-10-08T19:30:15.828 INFO:teuthology.orchestra.run.smithi097.stdout:average_utilization 0.0166 2021-10-08T19:30:15.829 INFO:teuthology.orchestra.run.smithi097.stdout:overload_utilization 0.0183 2021-10-08T19:30:15.829 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5 weight 1.0000 -> 0.7711 2021-10-08T19:30:15.829 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1 weight 1.0000 -> 0.8670 2021-10-08T19:30:15.830 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:30:15 smithi097 conmon[33110]: 2021-10-08T19:30:15.824+0000 7f26c6999700 -1 mgr.server reply reply (2) No such file or directory no change 2021-10-08T19:30:15.830 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:30:15.832 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:15.833 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:30:15.834 INFO:teuthology.orchestra.run.smithi097.stderr:no change 2021-10-08T19:30:15.934 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:30:15.976 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:16.059 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:30:16.068 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:16.069 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:30:16.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:15 smithi117 ceph-mon[34585]: pgmap v438: 178 pgs: 178 active+clean; 3.6 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.24k op/s 2021-10-08T19:30:16.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:15 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2035605448' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:30:16.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:15 smithi117 ceph-mon[34585]: osdmap e253: 8 total, 8 up, 8 in 2021-10-08T19:30:16.170 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:30:16.192 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2021-10-08T19:30:16.198 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:15 smithi097 ceph-mon[32687]: pgmap v438: 178 pgs: 178 active+clean; 3.6 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.24k op/s 2021-10-08T19:30:16.198 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:15 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2035605448' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:30:16.199 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:15 smithi097 ceph-mon[32687]: osdmap e253: 8 total, 8 up, 8 in 2021-10-08T19:30:16.199 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:15 smithi097 ceph-mon[41966]: pgmap v438: 178 pgs: 178 active+clean; 3.6 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.24k op/s 2021-10-08T19:30:16.199 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:15 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2035605448' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:30:16.199 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:15 smithi097 ceph-mon[41966]: osdmap e253: 8 total, 8 up, 8 in 2021-10-08T19:30:16.205 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:16.497 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set nodeep-scrub 2021-10-08T19:30:16.676 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:30:16.903 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:30:16 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:30:16.905 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:16 smithi097 ceph-mon[32687]: from='client.25318 v1:172.21.15.97:0/2400355789' entity='client.admin' cmd=[{"prefix": "osd test-reweight-by-utilization", "oload": 110, "max_change": 1.0, "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:30:16.966 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:30:16.972 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:16.973 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:30:17.074 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:30:17.146 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:17.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:16 smithi117 ceph-mon[34585]: from='client.25318 v1:172.21.15.97:0/2400355789' entity='client.admin' cmd=[{"prefix": "osd test-reweight-by-utilization", "oload": 110, "max_change": 1.0, "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:30:17.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:16 smithi097 ceph-mon[41966]: from='client.25318 v1:172.21.15.97:0/2400355789' entity='client.admin' cmd=[{"prefix": "osd test-reweight-by-utilization", "oload": 110, "max_change": 1.0, "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:30:17.241 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:30:17.245 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:17.246 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:30:17.309 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2021-10-08T19:30:17.310 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd test-reweight-by-utilization 110 1.0 2021-10-08T19:30:17.346 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:30:17.353 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:30:17.398 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:17.484 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:30:17.486 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:17.487 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:30:17.589 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:30:17.659 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:17.766 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:30:17.776 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:17.776 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:30:17.878 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:30:17.933 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:18.126 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:30:18.141 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:30:18.150 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:18.151 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:30:18.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:17 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:30:18.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:17 smithi097 ceph-mon[41966]: pgmap v440: 178 pgs: 178 active+clean; 3.6 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 1.18k op/s 2021-10-08T19:30:18.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:17 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:30:18.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:17 smithi097 ceph-mon[32687]: pgmap v440: 178 pgs: 178 active+clean; 3.6 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 1.18k op/s 2021-10-08T19:30:18.252 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:30:18.285 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:17 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:30:18.285 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:17 smithi117 ceph-mon[34585]: pgmap v440: 178 pgs: 178 active+clean; 3.6 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 1.18k op/s 2021-10-08T19:30:18.290 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:18.789 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:30:18.793 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:18.794 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:30:18.895 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:30:18.939 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:19.025 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:30:19.032 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:19.033 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:30:19.134 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:30:19.178 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:19.256 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2021-10-08T19:30:19.465 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:30:19.470 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:19.471 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:30:19.572 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:30:19.645 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:19.677 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2021-10-08T19:30:19.677 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:30:19.942 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:30:19.998 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:30:20.008 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:20.009 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:30:20.110 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:30:20.163 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:19 smithi097 ceph-mon[32687]: pgmap v441: 178 pgs: 178 active+clean; 3.5 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 914 op/s 2021-10-08T19:30:20.164 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:19 smithi097 ceph-mon[41966]: pgmap v441: 178 pgs: 178 active+clean; 3.5 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 914 op/s 2021-10-08T19:30:20.182 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:20.254 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:30:20.259 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:20.261 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:30:20.362 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:30:20.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:19 smithi117 ceph-mon[34585]: pgmap v441: 178 pgs: 178 active+clean; 3.5 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 914 op/s 2021-10-08T19:30:20.409 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:20.821 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:30:20.823 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:20.824 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:30:20.853 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2021-10-08T19:30:20.925 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:30:20.945 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is set 2021-10-08T19:30:20.997 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:21.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:20 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1241146961' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:30:21.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:20 smithi117 ceph-mon[34585]: from='client.25324 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:30:21.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:20 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1241146961' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:30:21.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:20 smithi097 ceph-mon[41966]: from='client.25324 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:30:21.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:20 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1241146961' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:30:21.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:20 smithi097 ceph-mon[32687]: from='client.25324 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:30:21.344 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:30:21.639 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:30:21.649 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:21.649 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:30:21.751 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:30:21.799 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:22.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:21 smithi117 ceph-mon[34585]: pgmap v442: 178 pgs: 178 active+clean; 3.2 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.39k op/s 2021-10-08T19:30:22.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:21 smithi117 ceph-mon[34585]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:30:22.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:21 smithi117 ceph-mon[34585]: from='client.25324 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:30:22.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:21 smithi117 ceph-mon[34585]: osdmap e254: 8 total, 8 up, 8 in 2021-10-08T19:30:22.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:21 smithi097 ceph-mon[41966]: pgmap v442: 178 pgs: 178 active+clean; 3.2 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.39k op/s 2021-10-08T19:30:22.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:21 smithi097 ceph-mon[41966]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:30:22.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:21 smithi097 ceph-mon[41966]: from='client.25324 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:30:22.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:21 smithi097 ceph-mon[41966]: osdmap e254: 8 total, 8 up, 8 in 2021-10-08T19:30:22.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:21 smithi097 ceph-mon[32687]: pgmap v442: 178 pgs: 178 active+clean; 3.2 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.39k op/s 2021-10-08T19:30:22.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:21 smithi097 ceph-mon[32687]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:30:22.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:21 smithi097 ceph-mon[32687]: from='client.25324 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:30:22.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:21 smithi097 ceph-mon[32687]: osdmap e254: 8 total, 8 up, 8 in 2021-10-08T19:30:22.325 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:30:22.329 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:22.330 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:30:22.431 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:30:22.454 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:22.921 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:30:22 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:30:22] "GET /metrics HTTP/1.1" 200 155704 "" "Prometheus/2.18.1" 2021-10-08T19:30:23.029 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:30:23.033 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:23.033 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:30:23.134 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:30:23.170 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:23.244 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:30:23.249 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:23.250 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:30:23.351 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:30:23.385 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:23.587 INFO:teuthology.orchestra.run.smithi097.stdout:moved 24 / 534 (4.49438%) 2021-10-08T19:30:23.587 INFO:teuthology.orchestra.run.smithi097.stdout:avg 66.75 2021-10-08T19:30:23.589 INFO:teuthology.orchestra.run.smithi097.stdout:stddev 6.74073 -> 8.95475 (expected baseline 7.6424) 2021-10-08T19:30:23.589 INFO:teuthology.orchestra.run.smithi097.stdout:min osd.2 with 54 -> 61 pgs (0.808989 -> 0.913858 * mean) 2021-10-08T19:30:23.589 INFO:teuthology.orchestra.run.smithi097.stdout:max osd.7 with 76 -> 79 pgs (1.13858 -> 1.18352 * mean) 2021-10-08T19:30:23.590 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:30:23.590 INFO:teuthology.orchestra.run.smithi097.stdout:oload 110 2021-10-08T19:30:23.590 INFO:teuthology.orchestra.run.smithi097.stdout:max_change 1 2021-10-08T19:30:23.590 INFO:teuthology.orchestra.run.smithi097.stdout:max_change_osds 4 2021-10-08T19:30:23.591 INFO:teuthology.orchestra.run.smithi097.stdout:average_utilization 0.0152 2021-10-08T19:30:23.591 INFO:teuthology.orchestra.run.smithi097.stdout:overload_utilization 0.0168 2021-10-08T19:30:23.591 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5 weight 1.0000 -> 0.7683 2021-10-08T19:30:23.591 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1 weight 1.0000 -> 0.8654 2021-10-08T19:30:23.592 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:30:23.596 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:23.597 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:30:23.627 INFO:teuthology.orchestra.run.smithi097.stderr:no change 2021-10-08T19:30:23.647 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:30:23 smithi097 conmon[33110]: 2021-10-08T19:30:23.582+0000 7f26c6999700 -1 mgr.server reply reply (2) No such file or directory no change 2021-10-08T19:30:23.698 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:30:23.752 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:23.872 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:30:23 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:30:23] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:30:23.907 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:30:23.911 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:23.912 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:30:24.013 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:30:24.069 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:24.144 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:23 smithi117 ceph-mon[34585]: pgmap v444: 178 pgs: 178 active+clean; 3.2 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 686 op/s 2021-10-08T19:30:24.144 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:23 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:30:24.220 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:30:23 smithi097 conmon[33110]: 172.21.15.117 - - [08/Oct/2021:19:30:23] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:30:24.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:23 smithi097 ceph-mon[32687]: pgmap v444: 178 pgs: 178 active+clean; 3.2 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 686 op/s 2021-10-08T19:30:24.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:23 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:30:24.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:23 smithi097 ceph-mon[41966]: pgmap v444: 178 pgs: 178 active+clean; 3.2 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 686 op/s 2021-10-08T19:30:24.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:23 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:30:24.270 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:30:24.273 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:24.274 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:30:24.324 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2021-10-08T19:30:24.325 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:30:24.375 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:30:24.424 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:24.990 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset noscrub 2021-10-08T19:30:25.198 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:30:25.209 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:25.210 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:30:25.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:24 smithi097 ceph-mon[32687]: from='client.35345 v1:172.21.15.97:0/1382084861' entity='client.admin' cmd=[{"prefix": "osd test-reweight-by-utilization", "oload": 110, "max_change": 1.0, "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:30:25.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:24 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:30:25.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:24 smithi097 ceph-mon[32687]: 172.21.15.117 - - [08/Oct/2021:19:30:23] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:30:25.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:24 smithi097 ceph-mon[41966]: from='client.35345 v1:172.21.15.97:0/1382084861' entity='client.admin' cmd=[{"prefix": "osd test-reweight-by-utilization", "oload": 110, "max_change": 1.0, "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:30:25.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:24 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:30:25.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:24 smithi097 ceph-mon[41966]: 172.21.15.117 - - [08/Oct/2021:19:30:23] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:30:25.311 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:30:25.331 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2021-10-08T19:30:25.332 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:24 smithi117 ceph-mon[34585]: from='client.35345 v1:172.21.15.97:0/1382084861' entity='client.admin' cmd=[{"prefix": "osd test-reweight-by-utilization", "oload": 110, "max_change": 1.0, "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:30:25.332 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:24 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:30:25.332 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:24 smithi117 ceph-mon[34585]: 172.21.15.117 - - [08/Oct/2021:19:30:23] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:30:25.376 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:25.737 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:30:25.920 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '110', 'type': 'reweight-by-utilization'} 2021-10-08T19:30:25.922 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd reweight-by-utilization 110 3.0 2021-10-08T19:30:26.063 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:30:26.066 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:26.066 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:30:26.168 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:30:26.210 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:25 smithi097 ceph-mon[32687]: pgmap v445: 178 pgs: 178 active+clean; 2.9 GiB data, 9.9 GiB used, 705 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.17k op/s 2021-10-08T19:30:26.210 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:25 smithi097 ceph-mon[32687]: osdmap e255: 8 total, 8 up, 8 in 2021-10-08T19:30:26.211 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:25 smithi097 ceph-mon[41966]: pgmap v445: 178 pgs: 178 active+clean; 2.9 GiB data, 9.9 GiB used, 705 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.17k op/s 2021-10-08T19:30:26.211 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:25 smithi097 ceph-mon[41966]: osdmap e255: 8 total, 8 up, 8 in 2021-10-08T19:30:26.222 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:26.362 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:30:26.371 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:26.371 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:30:26.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:25 smithi117 ceph-mon[34585]: pgmap v445: 178 pgs: 178 active+clean; 2.9 GiB data, 9.9 GiB used, 705 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.17k op/s 2021-10-08T19:30:26.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:25 smithi117 ceph-mon[34585]: osdmap e255: 8 total, 8 up, 8 in 2021-10-08T19:30:26.472 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:30:26.527 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:30:26.532 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:26.593 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:30:26.650 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:30:26.654 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:26.655 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:30:26.698 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:30:26.731 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:30:26.757 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:30:26.775 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:30:26.815 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:26.818 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:30:26.858 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:30:26.906 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:30:26 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:30:26.910 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:30:26.927 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:30:26.934 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:26.935 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:30:26.940 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:30:26.982 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:30:26.985 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true' 2021-10-08T19:30:26.985 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true' 2021-10-08T19:30:26.986 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true' 2021-10-08T19:30:26.986 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true' 2021-10-08T19:30:26.986 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true' 2021-10-08T19:30:26.986 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true' 2021-10-08T19:30:26.987 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'true' 2021-10-08T19:30:26.987 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'true' 2021-10-08T19:30:27.036 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:30:27.085 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:27 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2694412195' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:30:27.086 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:27 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2694412195' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:30:27.100 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:27.290 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:30:27.304 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:27.306 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:30:27.407 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:30:27.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:27 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2694412195' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:30:27.458 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:28.013 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:28 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:30:28.014 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:28 smithi097 ceph-mon[32687]: pgmap v447: 178 pgs: 178 active+clean; 2.9 GiB data, 9.9 GiB used, 705 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 1.11k op/s 2021-10-08T19:30:28.086 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:30:28.086 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2021-10-08T19:30:28.087 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2021-10-08T19:30:28.087 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2021-10-08T19:30:28.087 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.087 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:31352 7.5 7:a02b2bf0:::benchmark_data_smithi097_93198_object31351:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2021-10-08T19:30:28.088 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:24:09.085832+0000", 2021-10-08T19:30:28.088 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 378.99579956299999, 2021-10-08T19:30:28.088 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.086979116999999995, 2021-10-08T19:30:28.089 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:30:28.090 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:30:28.090 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:30:28.091 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:30:28.091 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:30:28.091 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 31352 2021-10-08T19:30:28.092 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.092 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:30:28.093 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.094 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:30:28.095 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.085832+0000", 2021-10-08T19:30:28.095 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:28.095 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.096 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.096 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:30:28.097 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.085832+0000", 2021-10-08T19:30:28.097 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:28.097 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.098 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.098 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:30:28.098 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.085830+0000", 2021-10-08T19:30:28.099 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:30:28.099 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.100 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.100 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:30:28.101 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.085944+0000", 2021-10-08T19:30:28.101 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011460599999999999 2021-10-08T19:30:28.101 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.102 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.102 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:30:28.103 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.085973+0000", 2021-10-08T19:30:28.103 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8651000000000001e-05 2021-10-08T19:30:28.104 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.105 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.105 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:30:28.105 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.085990+0000", 2021-10-08T19:30:28.106 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7169000000000001e-05 2021-10-08T19:30:28.106 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.106 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.107 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:30:28.107 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.086047+0000", 2021-10-08T19:30:28.108 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6753999999999999e-05 2021-10-08T19:30:28.108 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.108 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.108 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:30:28.108 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.086178+0000", 2021-10-08T19:30:28.109 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013164200000000001 2021-10-08T19:30:28.109 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.109 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.110 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:30:28.110 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.086306+0000", 2021-10-08T19:30:28.110 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012786899999999999 2021-10-08T19:30:28.110 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.111 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.111 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:30:28.111 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.087375+0000", 2021-10-08T19:30:28.111 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0010691190000000001 2021-10-08T19:30:28.111 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.112 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.112 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:28.112 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.087881+0000", 2021-10-08T19:30:28.112 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00050536500000000002 2021-10-08T19:30:28.113 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.113 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.113 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:28.113 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.172748+0000", 2021-10-08T19:30:28.113 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.084866971999999999 2021-10-08T19:30:28.114 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.114 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.115 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:30:28.115 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.172786+0000", 2021-10-08T19:30:28.115 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.803e-05 2021-10-08T19:30:28.115 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.115 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.116 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:30:28.116 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:09.172811+0000", 2021-10-08T19:30:28.116 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5463999999999999e-05 2021-10-08T19:30:28.116 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:28.117 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:30:28.117 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:28.117 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.117 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.117 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:40657 7.5 7:ad4ba151:::benchmark_data_smithi097_93198_object40656:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2021-10-08T19:30:28.118 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:24:16.254937+0000", 2021-10-08T19:30:28.118 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 371.82669479499998, 2021-10-08T19:30:28.118 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.12607659500000001, 2021-10-08T19:30:28.118 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:30:28.119 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:30:28.119 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:30:28.119 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:30:28.120 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:30:28.120 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 40657 2021-10-08T19:30:28.120 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.121 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:30:28.121 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.121 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:30:28.122 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.254937+0000", 2021-10-08T19:30:28.122 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:28.122 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.122 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.123 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:30:28.123 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.254937+0000", 2021-10-08T19:30:28.123 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:28.123 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.124 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.124 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:30:28.124 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.254935+0000", 2021-10-08T19:30:28.124 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:30:28.125 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.125 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.125 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:30:28.126 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.254984+0000", 2021-10-08T19:30:28.126 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9069000000000001e-05 2021-10-08T19:30:28.126 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.126 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.126 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:30:28.127 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.254996+0000", 2021-10-08T19:30:28.127 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1719000000000001e-05 2021-10-08T19:30:28.127 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.127 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.128 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:30:28.128 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.255002+0000", 2021-10-08T19:30:28.128 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8390000000000003e-06 2021-10-08T19:30:28.128 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.128 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.129 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:30:28.129 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.255050+0000", 2021-10-08T19:30:28.129 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7791999999999999e-05 2021-10-08T19:30:28.129 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.129 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.130 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:30:28.130 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.255182+0000", 2021-10-08T19:30:28.130 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013253599999999999 2021-10-08T19:30:28.130 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.131 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.131 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:30:28.131 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.255333+0000", 2021-10-08T19:30:28.131 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015041100000000001 2021-10-08T19:30:28.131 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.132 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.132 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:30:28.132 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.256605+0000", 2021-10-08T19:30:28.132 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012727019999999999 2021-10-08T19:30:28.133 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.133 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.133 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:28.133 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.258652+0000", 2021-10-08T19:30:28.133 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020462869999999999 2021-10-08T19:30:28.134 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.134 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.134 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:28.134 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.380931+0000", 2021-10-08T19:30:28.135 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.12227929899999999 2021-10-08T19:30:28.136 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.136 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.137 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:30:28.137 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.380974+0000", 2021-10-08T19:30:28.137 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.3145000000000001e-05 2021-10-08T19:30:28.137 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.138 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.138 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:30:28.138 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.381013+0000", 2021-10-08T19:30:28.138 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9397000000000002e-05 2021-10-08T19:30:28.138 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:28.139 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:30:28.140 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:28.140 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.140 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.140 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:40672 7.5 7:a33797a0:::benchmark_data_smithi097_93198_object40671:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2021-10-08T19:30:28.141 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:24:16.261093+0000", 2021-10-08T19:30:28.141 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 371.82053850599999, 2021-10-08T19:30:28.141 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.12001854200000001, 2021-10-08T19:30:28.141 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:30:28.142 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:30:28.142 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:30:28.142 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:30:28.142 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:30:28.143 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 40672 2021-10-08T19:30:28.143 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.143 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:30:28.143 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.143 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:30:28.144 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.261093+0000", 2021-10-08T19:30:28.144 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:28.144 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.144 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.145 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:30:28.145 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.261093+0000", 2021-10-08T19:30:28.145 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:28.145 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.146 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.146 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:30:28.146 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.261091+0000", 2021-10-08T19:30:28.146 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:30:28.147 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.147 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.147 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:30:28.148 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.261133+0000", 2021-10-08T19:30:28.148 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1736000000000002e-05 2021-10-08T19:30:28.148 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.148 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.149 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:30:28.149 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.261146+0000", 2021-10-08T19:30:28.149 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3066e-05 2021-10-08T19:30:28.149 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.149 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.150 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:30:28.150 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.261151+0000", 2021-10-08T19:30:28.150 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0490000000000003e-06 2021-10-08T19:30:28.150 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.151 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.151 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:30:28.151 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.261207+0000", 2021-10-08T19:30:28.151 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5693999999999999e-05 2021-10-08T19:30:28.151 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.152 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.152 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:30:28.152 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.261362+0000", 2021-10-08T19:30:28.152 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015503700000000001 2021-10-08T19:30:28.152 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.153 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.153 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:30:28.153 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.261527+0000", 2021-10-08T19:30:28.153 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016535599999999999 2021-10-08T19:30:28.154 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.154 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.154 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:30:28.154 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.262785+0000", 2021-10-08T19:30:28.154 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012574280000000001 2021-10-08T19:30:28.155 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.155 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.155 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:28.155 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.264813+0000", 2021-10-08T19:30:28.156 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020283580000000001 2021-10-08T19:30:28.156 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.156 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.156 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:28.156 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.381056+0000", 2021-10-08T19:30:28.157 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.116243267 2021-10-08T19:30:28.157 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.157 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.157 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:30:28.157 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.381087+0000", 2021-10-08T19:30:28.158 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.1038000000000003e-05 2021-10-08T19:30:28.158 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.158 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.158 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:30:28.159 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:16.381112+0000", 2021-10-08T19:30:28.159 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4349e-05 2021-10-08T19:30:28.159 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:28.159 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:30:28.159 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:28.160 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.160 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.160 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:41393 7.5 7:a29811ee:::benchmark_data_smithi097_93198_object41392:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2021-10-08T19:30:28.160 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:24:17.045990+0000", 2021-10-08T19:30:28.161 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 371.03564128800002, 2021-10-08T19:30:28.161 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.087913859999999996, 2021-10-08T19:30:28.161 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:30:28.161 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:30:28.161 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:30:28.162 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:30:28.162 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:30:28.162 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 41393 2021-10-08T19:30:28.162 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.162 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:30:28.163 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.163 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:30:28.163 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:17.045990+0000", 2021-10-08T19:30:28.163 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:28.164 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.164 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.164 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:30:28.164 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:17.045990+0000", 2021-10-08T19:30:28.164 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:28.165 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.165 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.165 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:30:28.165 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:17.045988+0000", 2021-10-08T19:30:28.166 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:30:28.166 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.166 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.166 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:30:28.166 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:17.046023+0000", 2021-10-08T19:30:28.167 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.5271999999999997e-05 2021-10-08T19:30:28.167 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.167 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.167 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:30:28.168 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:17.046037+0000", 2021-10-08T19:30:28.168 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3463e-05 2021-10-08T19:30:28.168 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.168 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.168 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:30:28.169 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:17.046042+0000", 2021-10-08T19:30:28.169 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5600000000000001e-06 2021-10-08T19:30:28.169 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.170 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.170 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:30:28.170 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:17.046083+0000", 2021-10-08T19:30:28.170 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0451000000000003e-05 2021-10-08T19:30:28.171 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.171 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.171 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:30:28.171 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:17.046184+0000", 2021-10-08T19:30:28.171 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000101007 2021-10-08T19:30:28.172 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.172 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.172 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:30:28.172 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:17.046291+0000", 2021-10-08T19:30:28.173 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000107191 2021-10-08T19:30:28.173 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.173 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.173 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:30:28.173 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:17.047496+0000", 2021-10-08T19:30:28.174 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012048860000000001 2021-10-08T19:30:28.174 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.174 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.174 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:28.174 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:17.047963+0000", 2021-10-08T19:30:28.175 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00046678300000000002 2021-10-08T19:30:28.175 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.175 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.175 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:28.176 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:17.133816+0000", 2021-10-08T19:30:28.176 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.085853177000000003 2021-10-08T19:30:28.176 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.176 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.176 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:30:28.177 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:17.133857+0000", 2021-10-08T19:30:28.177 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1493999999999999e-05 2021-10-08T19:30:28.177 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.177 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.177 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:30:28.178 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:17.133904+0000", 2021-10-08T19:30:28.178 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.6675000000000003e-05 2021-10-08T19:30:28.178 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:28.178 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:30:28.179 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:28.179 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.179 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.179 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:52231 7.5 7:adbd2332:::benchmark_data_smithi097_93198_object52230:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117)", 2021-10-08T19:30:28.179 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:24:30.422618+0000", 2021-10-08T19:30:28.180 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 357.65901349699999, 2021-10-08T19:30:28.180 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.089976930999999996, 2021-10-08T19:30:28.180 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:30:28.180 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:30:28.180 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:30:28.181 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:30:28.181 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:30:28.181 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 52231 2021-10-08T19:30:28.181 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.182 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:30:28.182 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.182 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:30:28.182 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.422618+0000", 2021-10-08T19:30:28.182 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:28.183 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.183 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.183 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:30:28.183 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.422618+0000", 2021-10-08T19:30:28.183 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:28.184 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.184 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.184 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:30:28.184 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.422616+0000", 2021-10-08T19:30:28.185 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:30:28.185 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.185 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.185 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:30:28.185 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.422663+0000", 2021-10-08T19:30:28.186 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.6702000000000001e-05 2021-10-08T19:30:28.186 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.186 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.186 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:30:28.187 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.422679+0000", 2021-10-08T19:30:28.187 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5860999999999999e-05 2021-10-08T19:30:28.187 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.187 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.187 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:30:28.188 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.422685+0000", 2021-10-08T19:30:28.188 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8689999999999998e-06 2021-10-08T19:30:28.188 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.188 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.189 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:30:28.189 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.422729+0000", 2021-10-08T19:30:28.189 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4070999999999999e-05 2021-10-08T19:30:28.189 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.189 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.190 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:30:28.190 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.422839+0000", 2021-10-08T19:30:28.190 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000109143 2021-10-08T19:30:28.190 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.190 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.191 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:30:28.191 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.422945+0000", 2021-10-08T19:30:28.191 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010658999999999999 2021-10-08T19:30:28.191 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.191 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.192 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:30:28.192 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.424392+0000", 2021-10-08T19:30:28.192 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0014467219999999999 2021-10-08T19:30:28.192 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.193 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.193 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:28.193 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.425025+0000", 2021-10-08T19:30:28.193 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00063323800000000005 2021-10-08T19:30:28.193 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.194 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.194 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:28.194 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.512496+0000", 2021-10-08T19:30:28.194 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.087470520999999996 2021-10-08T19:30:28.194 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.195 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.195 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:30:28.195 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.512551+0000", 2021-10-08T19:30:28.195 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5158000000000003e-05 2021-10-08T19:30:28.196 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.196 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.196 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:30:28.196 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:30.512595+0000", 2021-10-08T19:30:28.196 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4184999999999998e-05 2021-10-08T19:30:28.197 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:28.197 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:30:28.197 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:28.197 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.197 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.198 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:55971 7.5 7:aa4e7fa8:::benchmark_data_smithi097_93198_object55970:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118)", 2021-10-08T19:30:28.198 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:24:34.896460+0000", 2021-10-08T19:30:28.198 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 353.18517140400002, 2021-10-08T19:30:28.198 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.085766951999999994, 2021-10-08T19:30:28.199 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:30:28.199 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:30:28.199 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:30:28.199 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:30:28.199 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:30:28.200 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 55971 2021-10-08T19:30:28.200 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.200 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:30:28.200 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.200 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:30:28.201 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:34.896460+0000", 2021-10-08T19:30:28.201 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:28.201 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.201 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.202 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:30:28.202 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:34.896460+0000", 2021-10-08T19:30:28.202 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:28.202 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.202 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.203 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:30:28.203 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:34.896458+0000", 2021-10-08T19:30:28.203 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:30:28.203 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.205 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.205 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:30:28.205 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:34.896506+0000", 2021-10-08T19:30:28.206 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.761e-05 2021-10-08T19:30:28.206 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.206 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.206 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:30:28.207 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:34.896520+0000", 2021-10-08T19:30:28.207 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4129e-05 2021-10-08T19:30:28.207 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.209 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.210 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:30:28.210 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:34.896528+0000", 2021-10-08T19:30:28.210 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9659999999999996e-06 2021-10-08T19:30:28.210 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.211 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.211 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:30:28.211 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:34.896588+0000", 2021-10-08T19:30:28.211 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0693000000000003e-05 2021-10-08T19:30:28.212 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.212 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.212 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:30:28.212 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:34.896763+0000", 2021-10-08T19:30:28.213 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017436099999999999 2021-10-08T19:30:28.213 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.213 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.213 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:30:28.214 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:34.896962+0000", 2021-10-08T19:30:28.214 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000199378 2021-10-08T19:30:28.214 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.214 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.215 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:30:28.215 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:34.898963+0000", 2021-10-08T19:30:28.215 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020009120000000001 2021-10-08T19:30:28.215 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.215 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.216 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:28.216 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:34.901588+0000", 2021-10-08T19:30:28.216 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0026246020000000002 2021-10-08T19:30:28.216 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.217 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.217 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:28.217 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:34.982151+0000", 2021-10-08T19:30:28.217 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.080562913 2021-10-08T19:30:28.218 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.218 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.219 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:30:28.219 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:34.982202+0000", 2021-10-08T19:30:28.219 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1242000000000002e-05 2021-10-08T19:30:28.219 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.220 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.220 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:30:28.220 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:34.982227+0000", 2021-10-08T19:30:28.221 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5272000000000001e-05 2021-10-08T19:30:28.221 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:28.221 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:30:28.221 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:28.221 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.222 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.222 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:58808 7.5 7:a1085e60:::benchmark_data_smithi097_93198_object58807:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2021-10-08T19:30:28.222 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:24:38.371815+0000", 2021-10-08T19:30:28.222 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 349.70981676000002, 2021-10-08T19:30:28.223 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.20002783099999999, 2021-10-08T19:30:28.223 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:30:28.223 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:30:28.223 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:30:28.224 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:30:28.224 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:30:28.224 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 58808 2021-10-08T19:30:28.224 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.225 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:30:28.225 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.226 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:30:28.226 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.371815+0000", 2021-10-08T19:30:28.226 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:28.226 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.227 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.227 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:30:28.227 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.371815+0000", 2021-10-08T19:30:28.227 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:28.228 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.228 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.229 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:30:28.229 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.371813+0000", 2021-10-08T19:30:28.229 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:30:28.230 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.230 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.230 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:30:28.231 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.371875+0000", 2021-10-08T19:30:28.231 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2535999999999999e-05 2021-10-08T19:30:28.231 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.231 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.232 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:30:28.232 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.371892+0000", 2021-10-08T19:30:28.232 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6572999999999999e-05 2021-10-08T19:30:28.232 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.233 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.233 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:30:28.233 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.371898+0000", 2021-10-08T19:30:28.233 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8889999999999999e-06 2021-10-08T19:30:28.234 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.234 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.234 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:30:28.234 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.371942+0000", 2021-10-08T19:30:28.234 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4478999999999999e-05 2021-10-08T19:30:28.235 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.235 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.235 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:30:28.236 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.372100+0000", 2021-10-08T19:30:28.236 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000157773 2021-10-08T19:30:28.236 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.236 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.237 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:30:28.237 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.372269+0000", 2021-10-08T19:30:28.237 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016882600000000001 2021-10-08T19:30:28.237 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.238 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.238 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:30:28.238 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.373814+0000", 2021-10-08T19:30:28.239 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0015447289999999999 2021-10-08T19:30:28.239 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.240 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.240 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:28.240 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.374394+0000", 2021-10-08T19:30:28.240 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00058025700000000004 2021-10-08T19:30:28.240 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.241 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.241 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:28.241 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.571758+0000", 2021-10-08T19:30:28.241 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.197364067 2021-10-08T19:30:28.242 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.242 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.242 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:30:28.242 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.571800+0000", 2021-10-08T19:30:28.242 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2485999999999999e-05 2021-10-08T19:30:28.243 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.243 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.243 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:30:28.243 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.571843+0000", 2021-10-08T19:30:28.244 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2262000000000003e-05 2021-10-08T19:30:28.244 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:28.244 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:30:28.244 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:28.244 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.245 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.245 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:58811 7.5 7:a85e4a63:::benchmark_data_smithi097_93198_object58810:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2021-10-08T19:30:28.245 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:24:38.380261+0000", 2021-10-08T19:30:28.245 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 349.70137046799999, 2021-10-08T19:30:28.246 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.19467627000000001, 2021-10-08T19:30:28.246 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:30:28.246 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:30:28.246 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:30:28.246 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:30:28.247 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:30:28.247 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 58811 2021-10-08T19:30:28.247 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.247 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:30:28.248 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.248 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:30:28.248 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.380261+0000", 2021-10-08T19:30:28.248 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:28.249 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.249 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.249 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:30:28.250 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.380261+0000", 2021-10-08T19:30:28.250 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:28.250 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.251 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.251 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:30:28.251 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.380259+0000", 2021-10-08T19:30:28.251 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:30:28.252 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.252 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.252 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:30:28.252 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.380321+0000", 2021-10-08T19:30:28.253 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1908000000000004e-05 2021-10-08T19:30:28.253 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.253 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.253 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:30:28.253 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.380337+0000", 2021-10-08T19:30:28.254 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6356000000000001e-05 2021-10-08T19:30:28.254 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.254 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.254 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:30:28.254 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.380345+0000", 2021-10-08T19:30:28.255 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6830000000000008e-06 2021-10-08T19:30:28.255 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.255 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.255 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:30:28.256 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.380401+0000", 2021-10-08T19:30:28.256 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6042999999999999e-05 2021-10-08T19:30:28.256 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.256 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.257 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:30:28.257 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.380549+0000", 2021-10-08T19:30:28.258 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014829399999999999 2021-10-08T19:30:28.258 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.258 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.258 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:30:28.261 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.380726+0000", 2021-10-08T19:30:28.262 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000177422 2021-10-08T19:30:28.262 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.262 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.262 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:30:28.263 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.384478+0000", 2021-10-08T19:30:28.263 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0037511739999999999 2021-10-08T19:30:28.263 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.263 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.264 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:28.264 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.386648+0000", 2021-10-08T19:30:28.264 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021706590000000001 2021-10-08T19:30:28.264 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.264 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.265 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:28.265 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.574827+0000", 2021-10-08T19:30:28.265 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.18817901300000001 2021-10-08T19:30:28.265 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.266 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.266 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:30:28.266 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.574888+0000", 2021-10-08T19:30:28.266 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1078e-05 2021-10-08T19:30:28.266 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.267 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.267 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:30:28.267 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.574937+0000", 2021-10-08T19:30:28.267 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9100000000000001e-05 2021-10-08T19:30:28.268 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:28.268 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:30:28.268 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:28.269 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.269 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.269 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:58812 7.5 7:ace934bc:::benchmark_data_smithi097_93198_object58811:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2021-10-08T19:30:28.270 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:24:38.380358+0000", 2021-10-08T19:30:28.270 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 349.70127369199997, 2021-10-08T19:30:28.271 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.19472503899999999, 2021-10-08T19:30:28.272 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:30:28.272 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:30:28.272 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:30:28.273 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:30:28.273 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:30:28.273 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 58812 2021-10-08T19:30:28.273 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.274 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:30:28.274 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.274 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:30:28.274 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.380358+0000", 2021-10-08T19:30:28.274 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:28.275 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.275 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.275 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:30:28.275 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.380358+0000", 2021-10-08T19:30:28.276 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:28.276 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.276 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.276 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:30:28.276 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.380357+0000", 2021-10-08T19:30:28.277 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:30:28.277 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.277 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.277 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:30:28.277 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.380395+0000", 2021-10-08T19:30:28.278 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7836000000000002e-05 2021-10-08T19:30:28.278 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.278 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.279 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:30:28.279 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.380403+0000", 2021-10-08T19:30:28.279 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9810000000000003e-06 2021-10-08T19:30:28.280 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.280 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.280 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:30:28.280 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.380408+0000", 2021-10-08T19:30:28.281 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.237e-06 2021-10-08T19:30:28.281 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.281 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.282 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:30:28.282 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.382453+0000", 2021-10-08T19:30:28.282 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020453910000000001 2021-10-08T19:30:28.282 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.283 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.283 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:30:28.283 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.382629+0000", 2021-10-08T19:30:28.283 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017584799999999999 2021-10-08T19:30:28.283 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.284 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.284 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:30:28.284 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.382793+0000", 2021-10-08T19:30:28.284 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000163859 2021-10-08T19:30:28.285 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.285 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.285 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:28.285 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.386787+0000", 2021-10-08T19:30:28.285 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0039934790000000003 2021-10-08T19:30:28.286 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.286 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.286 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:30:28.286 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.387500+0000", 2021-10-08T19:30:28.287 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00071292899999999995 2021-10-08T19:30:28.287 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.287 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.287 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:28.287 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.574989+0000", 2021-10-08T19:30:28.288 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.18748959400000001 2021-10-08T19:30:28.288 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.288 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.288 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:30:28.288 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.575044+0000", 2021-10-08T19:30:28.289 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5183999999999999e-05 2021-10-08T19:30:28.289 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.289 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.289 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:30:28.290 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.575083+0000", 2021-10-08T19:30:28.290 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8649000000000002e-05 2021-10-08T19:30:28.290 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:28.290 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:30:28.290 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:28.291 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.291 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.291 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:58838 7.5 7:a978e539:::benchmark_data_smithi097_93198_object58837:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2021-10-08T19:30:28.291 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:24:38.418842+0000", 2021-10-08T19:30:28.292 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 349.66278932, 2021-10-08T19:30:28.292 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.15687025600000001, 2021-10-08T19:30:28.292 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:30:28.293 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:30:28.293 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:30:28.293 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:30:28.294 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:30:28.294 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 58838 2021-10-08T19:30:28.294 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.294 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:30:28.295 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.296 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:30:28.296 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.418842+0000", 2021-10-08T19:30:28.296 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:28.296 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.297 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.297 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:30:28.297 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.418842+0000", 2021-10-08T19:30:28.297 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:28.298 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.298 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.298 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:30:28.298 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.418839+0000", 2021-10-08T19:30:28.298 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999971 2021-10-08T19:30:28.299 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.299 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.299 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:30:28.299 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.418877+0000", 2021-10-08T19:30:28.300 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8019000000000003e-05 2021-10-08T19:30:28.300 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.300 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.300 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:30:28.300 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.418894+0000", 2021-10-08T19:30:28.301 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6755000000000001e-05 2021-10-08T19:30:28.301 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.301 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.302 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:30:28.302 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.418900+0000", 2021-10-08T19:30:28.302 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2910000000000004e-06 2021-10-08T19:30:28.302 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.302 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.303 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:30:28.303 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.418951+0000", 2021-10-08T19:30:28.303 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0330000000000001e-05 2021-10-08T19:30:28.303 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.303 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.304 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:30:28.304 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.419072+0000", 2021-10-08T19:30:28.304 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000121651 2021-10-08T19:30:28.304 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.305 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.305 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:30:28.305 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.419199+0000", 2021-10-08T19:30:28.305 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000126525 2021-10-08T19:30:28.305 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.306 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.306 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:30:28.306 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.420787+0000", 2021-10-08T19:30:28.306 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0015883309999999999 2021-10-08T19:30:28.306 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.307 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.307 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:28.307 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.421139+0000", 2021-10-08T19:30:28.307 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00035210500000000002 2021-10-08T19:30:28.308 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.308 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.308 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:28.308 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.575628+0000", 2021-10-08T19:30:28.308 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.15448861 2021-10-08T19:30:28.309 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.309 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.309 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:30:28.309 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.575675+0000", 2021-10-08T19:30:28.310 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7304e-05 2021-10-08T19:30:28.310 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.310 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.310 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:30:28.310 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.575713+0000", 2021-10-08T19:30:28.311 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7273e-05 2021-10-08T19:30:28.311 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:28.311 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:30:28.311 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:28.311 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.312 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.312 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:88736 7.5 7:aae723de:::benchmark_data_smithi097_93198_object88735:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134)", 2021-10-08T19:30:28.312 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:25:18.992357+0000", 2021-10-08T19:30:28.312 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 309.089274628, 2021-10-08T19:30:28.313 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.070934536000000006, 2021-10-08T19:30:28.313 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:30:28.313 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:30:28.313 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:30:28.313 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:30:28.314 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:30:28.314 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 88736 2021-10-08T19:30:28.314 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.314 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:30:28.314 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.315 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:30:28.315 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:18.992357+0000", 2021-10-08T19:30:28.315 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:28.315 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.316 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.316 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:30:28.316 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:18.992357+0000", 2021-10-08T19:30:28.316 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:28.317 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.317 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.317 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:30:28.317 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:18.992355+0000", 2021-10-08T19:30:28.317 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:30:28.318 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.318 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.318 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:30:28.318 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:18.992411+0000", 2021-10-08T19:30:28.319 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6070999999999999e-05 2021-10-08T19:30:28.319 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.319 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.319 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:30:28.319 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:18.992424+0000", 2021-10-08T19:30:28.320 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3084e-05 2021-10-08T19:30:28.320 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.320 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.320 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:30:28.320 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:18.992431+0000", 2021-10-08T19:30:28.321 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.9299999999999997e-06 2021-10-08T19:30:28.321 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.321 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.321 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:30:28.322 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:18.992473+0000", 2021-10-08T19:30:28.322 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2058999999999998e-05 2021-10-08T19:30:28.322 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.322 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.322 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:30:28.323 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:18.992581+0000", 2021-10-08T19:30:28.323 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010795500000000001 2021-10-08T19:30:28.323 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.323 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.324 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:30:28.324 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:18.992686+0000", 2021-10-08T19:30:28.324 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010554500000000001 2021-10-08T19:30:28.324 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.324 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.325 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:30:28.325 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:18.994457+0000", 2021-10-08T19:30:28.325 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0017707300000000001 2021-10-08T19:30:28.325 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.325 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.326 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:28.326 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:19.004536+0000", 2021-10-08T19:30:28.326 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010078897999999999 2021-10-08T19:30:28.326 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.327 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.327 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:28.327 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:19.060237+0000", 2021-10-08T19:30:28.327 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.055700772000000003 2021-10-08T19:30:28.328 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.328 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.329 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:30:28.329 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:19.063241+0000", 2021-10-08T19:30:28.329 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0030042549999999999 2021-10-08T19:30:28.330 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.330 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.330 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:30:28.330 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:19.063291+0000", 2021-10-08T19:30:28.331 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0485000000000002e-05 2021-10-08T19:30:28.331 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:28.331 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:30:28.332 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:28.332 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.332 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.332 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:117916 7.5 7:a3d66b7e:::benchmark_data_smithi097_93198_object26096:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e147)", 2021-10-08T19:30:28.333 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:25:58.909401+0000", 2021-10-08T19:30:28.333 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 269.17223080700001, 2021-10-08T19:30:28.333 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.070517505999999994, 2021-10-08T19:30:28.333 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:30:28.333 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:30:28.334 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:30:28.334 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:30:28.334 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:30:28.334 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 117916 2021-10-08T19:30:28.334 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.335 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:30:28.335 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.335 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:30:28.335 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:58.909401+0000", 2021-10-08T19:30:28.336 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:28.336 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.336 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.336 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:30:28.336 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:58.909401+0000", 2021-10-08T19:30:28.337 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:28.337 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.337 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.337 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:30:28.338 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:58.909399+0000", 2021-10-08T19:30:28.338 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:30:28.338 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.338 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.338 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:30:28.339 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:58.909406+0000", 2021-10-08T19:30:28.339 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.79e-06 2021-10-08T19:30:28.339 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.339 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.339 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:30:28.340 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:58.909422+0000", 2021-10-08T19:30:28.340 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5218999999999999e-05 2021-10-08T19:30:28.340 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.340 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.341 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:30:28.341 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:58.909428+0000", 2021-10-08T19:30:28.341 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4010000000000002e-06 2021-10-08T19:30:28.341 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.341 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.342 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:30:28.342 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:58.909481+0000", 2021-10-08T19:30:28.342 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2939000000000003e-05 2021-10-08T19:30:28.342 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.342 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.343 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:30:28.343 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:58.909589+0000", 2021-10-08T19:30:28.343 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000107766 2021-10-08T19:30:28.343 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.344 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.344 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:30:28.344 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:58.909674+0000", 2021-10-08T19:30:28.344 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5241000000000006e-05 2021-10-08T19:30:28.344 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.345 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.345 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:30:28.345 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:58.911770+0000", 2021-10-08T19:30:28.345 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002096503 2021-10-08T19:30:28.345 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.346 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.346 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:28.346 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:58.919200+0000", 2021-10-08T19:30:28.346 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00743 2021-10-08T19:30:28.347 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.347 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.347 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:28.347 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:58.979824+0000", 2021-10-08T19:30:28.347 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.060623921999999997 2021-10-08T19:30:28.348 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.348 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.348 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:30:28.348 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:58.979878+0000", 2021-10-08T19:30:28.348 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.3539999999999999e-05 2021-10-08T19:30:28.349 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.349 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.349 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:30:28.349 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:58.979918+0000", 2021-10-08T19:30:28.349 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0404999999999997e-05 2021-10-08T19:30:28.350 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:28.350 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:30:28.350 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:28.350 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.351 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.351 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:130321 7.5 7:a509308d:::benchmark_data_smithi097_93198_object38501:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e150)", 2021-10-08T19:30:28.351 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:26:15.487116+0000", 2021-10-08T19:30:28.351 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 252.59451510700001, 2021-10-08T19:30:28.352 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.078859609999999997, 2021-10-08T19:30:28.352 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:30:28.352 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:30:28.352 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:30:28.352 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:30:28.353 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:30:28.353 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 130321 2021-10-08T19:30:28.353 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.353 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:30:28.353 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.354 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:30:28.354 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:15.487116+0000", 2021-10-08T19:30:28.354 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:28.354 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.355 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.355 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:30:28.355 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:15.487116+0000", 2021-10-08T19:30:28.355 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:28.355 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.356 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.356 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:30:28.356 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:15.487114+0000", 2021-10-08T19:30:28.356 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999971 2021-10-08T19:30:28.356 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.357 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.357 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:30:28.357 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:15.487122+0000", 2021-10-08T19:30:28.357 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4109999999999996e-06 2021-10-08T19:30:28.357 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.358 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.358 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:30:28.358 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:15.487135+0000", 2021-10-08T19:30:28.358 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3188e-05 2021-10-08T19:30:28.359 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.359 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.359 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:30:28.359 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:15.487143+0000", 2021-10-08T19:30:28.359 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5089999999999996e-06 2021-10-08T19:30:28.360 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.360 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.360 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:30:28.360 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:15.487187+0000", 2021-10-08T19:30:28.360 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.3891999999999999e-05 2021-10-08T19:30:28.361 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.361 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.361 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:30:28.361 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:15.487300+0000", 2021-10-08T19:30:28.362 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112823 2021-10-08T19:30:28.362 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.362 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.363 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:30:28.363 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:15.487388+0000", 2021-10-08T19:30:28.363 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.8049999999999999e-05 2021-10-08T19:30:28.363 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.363 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.364 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:30:28.364 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:15.491150+0000", 2021-10-08T19:30:28.364 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0037624920000000001 2021-10-08T19:30:28.364 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.364 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.365 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:28.365 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:15.494412+0000", 2021-10-08T19:30:28.365 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003261651 2021-10-08T19:30:28.365 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.366 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.366 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:28.366 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:15.565893+0000", 2021-10-08T19:30:28.366 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.071481437999999994 2021-10-08T19:30:28.366 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.367 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.367 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:30:28.367 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:15.565933+0000", 2021-10-08T19:30:28.367 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9604999999999998e-05 2021-10-08T19:30:28.368 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.368 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.368 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:30:28.368 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:15.565976+0000", 2021-10-08T19:30:28.368 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.3269999999999997e-05 2021-10-08T19:30:28.369 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:28.369 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:30:28.369 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:28.369 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.369 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.370 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:130326 7.5 7:a55d5f25:::benchmark_data_smithi097_93198_object38506:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e150)", 2021-10-08T19:30:28.370 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:26:15.488487+0000", 2021-10-08T19:30:28.370 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 252.59314436700001, 2021-10-08T19:30:28.370 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.085591460999999994, 2021-10-08T19:30:28.371 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:30:28.371 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:30:28.371 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:30:28.371 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:30:28.372 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:30:28.372 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 130326 2021-10-08T19:30:28.372 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.372 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:30:28.372 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.373 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:30:28.373 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:15.488487+0000", 2021-10-08T19:30:28.373 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:28.373 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.373 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.374 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:30:28.374 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:15.488487+0000", 2021-10-08T19:30:28.374 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:28.374 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.375 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.375 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:30:28.375 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:15.488485+0000", 2021-10-08T19:30:28.375 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:30:28.375 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.376 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.376 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:30:28.376 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:15.488493+0000", 2021-10-08T19:30:28.376 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1890000000000001e-06 2021-10-08T19:30:28.377 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.378 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.378 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:30:28.378 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:15.488508+0000", 2021-10-08T19:30:28.378 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4944e-05 2021-10-08T19:30:28.379 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.379 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.379 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:30:28.379 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:15.488515+0000", 2021-10-08T19:30:28.379 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5569999999999998e-06 2021-10-08T19:30:28.380 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.380 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.380 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:30:28.382 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:15.489073+0000", 2021-10-08T19:30:28.382 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00055753300000000003 2021-10-08T19:30:28.383 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.383 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.384 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:30:28.384 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:15.489209+0000", 2021-10-08T19:30:28.384 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000135931 2021-10-08T19:30:28.385 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.385 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.386 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:30:28.388 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:15.489339+0000", 2021-10-08T19:30:28.388 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000130507 2021-10-08T19:30:28.389 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.390 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.391 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:30:28.391 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:15.491276+0000", 2021-10-08T19:30:28.392 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0019364479999999999 2021-10-08T19:30:28.393 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.393 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.395 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:28.395 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:15.494443+0000", 2021-10-08T19:30:28.395 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031673769999999999 2021-10-08T19:30:28.395 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.396 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.396 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:28.396 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:15.573981+0000", 2021-10-08T19:30:28.396 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.079538406000000006 2021-10-08T19:30:28.397 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.397 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.397 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:30:28.401 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:15.574040+0000", 2021-10-08T19:30:28.401 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8996999999999998e-05 2021-10-08T19:30:28.402 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.402 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.402 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:30:28.403 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:15.574079+0000", 2021-10-08T19:30:28.403 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8305e-05 2021-10-08T19:30:28.403 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:28.403 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:30:28.404 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:28.404 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.404 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.404 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:132952 7.5 7:a762aa2c:::benchmark_data_smithi097_93198_object41132:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e151)", 2021-10-08T19:30:28.405 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:26:19.148734+0000", 2021-10-08T19:30:28.405 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 248.93289778600001, 2021-10-08T19:30:28.405 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.083981281000000005, 2021-10-08T19:30:28.405 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:30:28.406 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:30:28.406 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:30:28.406 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:30:28.406 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:30:28.407 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 132952 2021-10-08T19:30:28.407 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.407 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:30:28.408 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.408 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:30:28.408 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.148734+0000", 2021-10-08T19:30:28.408 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:28.409 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.409 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.409 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:30:28.409 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.148734+0000", 2021-10-08T19:30:28.410 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:28.410 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.410 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.410 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:30:28.411 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.148731+0000", 2021-10-08T19:30:28.411 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:30:28.411 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.411 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.412 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:30:28.412 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.148740+0000", 2021-10-08T19:30:28.412 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9940000000000006e-06 2021-10-08T19:30:28.412 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.413 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.413 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:30:28.413 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.148754+0000", 2021-10-08T19:30:28.413 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4100000000000001e-05 2021-10-08T19:30:28.414 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.414 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.414 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:30:28.414 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.148761+0000", 2021-10-08T19:30:28.415 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8090000000000004e-06 2021-10-08T19:30:28.415 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.415 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.415 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:30:28.415 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.148811+0000", 2021-10-08T19:30:28.416 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9311000000000003e-05 2021-10-08T19:30:28.416 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.416 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.416 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:30:28.417 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.148943+0000", 2021-10-08T19:30:28.417 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013244799999999999 2021-10-08T19:30:28.417 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.417 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.417 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:30:28.418 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.149071+0000", 2021-10-08T19:30:28.418 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012831100000000001 2021-10-08T19:30:28.418 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.418 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.419 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:30:28.419 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.152727+0000", 2021-10-08T19:30:28.419 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036551679999999999 2021-10-08T19:30:28.419 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.419 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.420 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:28.420 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.165046+0000", 2021-10-08T19:30:28.420 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012319237 2021-10-08T19:30:28.420 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.421 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.421 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:28.421 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.232645+0000", 2021-10-08T19:30:28.421 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.067599593999999999 2021-10-08T19:30:28.421 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.422 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.422 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:30:28.422 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.232685+0000", 2021-10-08T19:30:28.422 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9509999999999999e-05 2021-10-08T19:30:28.423 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.423 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.423 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:30:28.423 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.232715+0000", 2021-10-08T19:30:28.424 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.021e-05 2021-10-08T19:30:28.424 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:28.424 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:30:28.424 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:28.424 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.425 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.425 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:132955 7.5 7:a302f95d:::benchmark_data_smithi097_93198_object41135:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e151)", 2021-10-08T19:30:28.425 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:26:19.158307+0000", 2021-10-08T19:30:28.425 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 248.92332443800001, 2021-10-08T19:30:28.426 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.084329352999999996, 2021-10-08T19:30:28.426 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:30:28.426 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:30:28.426 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:30:28.426 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:30:28.427 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:30:28.427 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 132955 2021-10-08T19:30:28.427 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.427 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:30:28.428 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.428 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:30:28.428 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.158307+0000", 2021-10-08T19:30:28.428 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:28.429 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.429 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.429 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:30:28.430 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.158307+0000", 2021-10-08T19:30:28.430 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:28.430 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.431 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.431 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:30:28.431 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.158305+0000", 2021-10-08T19:30:28.431 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:30:28.431 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.432 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.432 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:30:28.432 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.158313+0000", 2021-10-08T19:30:28.432 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.1759999999999993e-06 2021-10-08T19:30:28.433 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.433 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.434 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:30:28.434 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.158327+0000", 2021-10-08T19:30:28.435 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4255e-05 2021-10-08T19:30:28.435 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.435 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.435 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:30:28.436 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.158334+0000", 2021-10-08T19:30:28.436 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7050000000000002e-06 2021-10-08T19:30:28.436 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.436 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.437 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:30:28.437 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.158375+0000", 2021-10-08T19:30:28.438 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0493e-05 2021-10-08T19:30:28.438 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.439 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.439 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:30:28.439 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.158484+0000", 2021-10-08T19:30:28.440 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010995 2021-10-08T19:30:28.440 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.440 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.440 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:30:28.441 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.158567+0000", 2021-10-08T19:30:28.441 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2236000000000003e-05 2021-10-08T19:30:28.441 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.441 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.442 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:30:28.442 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.160412+0000", 2021-10-08T19:30:28.442 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018449289999999999 2021-10-08T19:30:28.442 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.442 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.443 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:28.443 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.165204+0000", 2021-10-08T19:30:28.443 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0047919520000000004 2021-10-08T19:30:28.443 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.443 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.444 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:28.444 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.242538+0000", 2021-10-08T19:30:28.444 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.077334358000000006 2021-10-08T19:30:28.446 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.447 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.447 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:30:28.447 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.242595+0000", 2021-10-08T19:30:28.448 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7510000000000003e-05 2021-10-08T19:30:28.448 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.449 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.449 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:30:28.450 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.242637+0000", 2021-10-08T19:30:28.450 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1057999999999999e-05 2021-10-08T19:30:28.450 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:28.450 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:30:28.451 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:28.451 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.451 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.451 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:171843 7.5 7:a61be0e5:::benchmark_data_smithi097_93198_object80023:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163)", 2021-10-08T19:30:28.451 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:27:12.436086+0000", 2021-10-08T19:30:28.452 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 195.64554569800001, 2021-10-08T19:30:28.452 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.105123305, 2021-10-08T19:30:28.452 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:30:28.452 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:30:28.453 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:30:28.453 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:30:28.453 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:30:28.453 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 171843 2021-10-08T19:30:28.453 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.454 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:30:28.454 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.454 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:30:28.454 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:12.436086+0000", 2021-10-08T19:30:28.455 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:28.455 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.455 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.455 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:30:28.455 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:12.436086+0000", 2021-10-08T19:30:28.456 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:28.456 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.456 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.456 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:30:28.457 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:12.436084+0000", 2021-10-08T19:30:28.457 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:30:28.457 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.457 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.457 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:30:28.458 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:12.436092+0000", 2021-10-08T19:30:28.458 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6279999999999994e-06 2021-10-08T19:30:28.458 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.459 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.459 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:30:28.459 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:12.436107+0000", 2021-10-08T19:30:28.459 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5121e-05 2021-10-08T19:30:28.460 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.460 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.460 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:30:28.460 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:12.436114+0000", 2021-10-08T19:30:28.461 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2759999999999997e-06 2021-10-08T19:30:28.461 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.461 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.461 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:30:28.461 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:12.436155+0000", 2021-10-08T19:30:28.465 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1012e-05 2021-10-08T19:30:28.465 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.465 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.465 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:30:28.466 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:12.436257+0000", 2021-10-08T19:30:28.466 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000101939 2021-10-08T19:30:28.466 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.467 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.467 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:30:28.467 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:12.436349+0000", 2021-10-08T19:30:28.467 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.2230000000000003e-05 2021-10-08T19:30:28.467 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.468 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.468 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:30:28.468 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:12.438395+0000", 2021-10-08T19:30:28.469 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020461210000000001 2021-10-08T19:30:28.469 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.469 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.469 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:28.470 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:12.438562+0000", 2021-10-08T19:30:28.470 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000167586 2021-10-08T19:30:28.470 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.470 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.470 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:28.471 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:12.541134+0000", 2021-10-08T19:30:28.471 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.10257169200000001 2021-10-08T19:30:28.471 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.471 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.472 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:30:28.472 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:12.541170+0000", 2021-10-08T19:30:28.472 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.5630000000000003e-05 2021-10-08T19:30:28.472 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.472 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.473 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:30:28.473 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:12.541209+0000", 2021-10-08T19:30:28.473 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9400000000000002e-05 2021-10-08T19:30:28.473 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:28.474 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:30:28.474 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:28.474 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.474 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.475 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:177480 7.5 7:a346bfc5:::benchmark_data_smithi097_93198_object85660:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e168)", 2021-10-08T19:30:28.475 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:27:20.114466+0000", 2021-10-08T19:30:28.475 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 187.96716561100001, 2021-10-08T19:30:28.475 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.071927657000000006, 2021-10-08T19:30:28.476 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:30:28.476 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:30:28.476 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:30:28.476 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:30:28.476 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:30:28.477 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 177480 2021-10-08T19:30:28.478 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.478 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:30:28.478 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.479 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:30:28.479 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:20.114466+0000", 2021-10-08T19:30:28.479 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:28.479 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.480 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.480 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:30:28.480 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:20.114466+0000", 2021-10-08T19:30:28.480 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:28.481 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.481 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.481 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:30:28.481 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:20.114460+0000", 2021-10-08T19:30:28.482 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999938 2021-10-08T19:30:28.482 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.482 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.482 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:30:28.483 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:20.114472+0000", 2021-10-08T19:30:28.483 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1958e-05 2021-10-08T19:30:28.483 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.484 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.484 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:30:28.484 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:20.114487+0000", 2021-10-08T19:30:28.484 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5821e-05 2021-10-08T19:30:28.485 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.485 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.485 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:30:28.486 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:20.114494+0000", 2021-10-08T19:30:28.486 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8240000000000002e-06 2021-10-08T19:30:28.486 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.487 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.487 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:30:28.487 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:20.114546+0000", 2021-10-08T19:30:28.488 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1484999999999999e-05 2021-10-08T19:30:28.488 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.488 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.488 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:30:28.489 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:20.114648+0000", 2021-10-08T19:30:28.489 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000102122 2021-10-08T19:30:28.489 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.489 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.489 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:30:28.490 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:20.114769+0000", 2021-10-08T19:30:28.490 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000121487 2021-10-08T19:30:28.490 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.490 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.491 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:30:28.491 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:20.116574+0000", 2021-10-08T19:30:28.491 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018043790000000001 2021-10-08T19:30:28.491 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.492 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.492 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:28.492 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:20.178028+0000", 2021-10-08T19:30:28.492 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.061454071999999998 2021-10-08T19:30:28.493 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.493 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.493 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:28.493 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:20.186297+0000", 2021-10-08T19:30:28.494 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0082690539999999996 2021-10-08T19:30:28.494 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.494 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.494 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:30:28.495 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:20.186351+0000", 2021-10-08T19:30:28.495 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4444000000000003e-05 2021-10-08T19:30:28.495 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.497 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.498 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:30:28.498 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:20.186394+0000", 2021-10-08T19:30:28.499 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2379000000000002e-05 2021-10-08T19:30:28.499 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:28.500 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:30:28.500 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:28.500 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.501 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.501 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:178140 7.5 7:a1b64fd5:::benchmark_data_smithi097_93198_object86320:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e169)", 2021-10-08T19:30:28.501 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:27:20.922384+0000", 2021-10-08T19:30:28.501 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 187.15924735600001, 2021-10-08T19:30:28.501 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.073897813000000007, 2021-10-08T19:30:28.502 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:30:28.502 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:30:28.502 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:30:28.502 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:30:28.503 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:30:28.503 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 178140 2021-10-08T19:30:28.503 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.503 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:30:28.503 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.504 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:30:28.504 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:20.922384+0000", 2021-10-08T19:30:28.504 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:28.504 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.505 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.505 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:30:28.505 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:20.922384+0000", 2021-10-08T19:30:28.505 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:28.506 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.506 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.506 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:30:28.506 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:20.922382+0000", 2021-10-08T19:30:28.506 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:30:28.507 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.507 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.507 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:30:28.507 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:20.922391+0000", 2021-10-08T19:30:28.508 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.7940000000000008e-06 2021-10-08T19:30:28.508 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.508 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.508 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:30:28.508 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:20.922407+0000", 2021-10-08T19:30:28.509 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6449000000000001e-05 2021-10-08T19:30:28.509 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.509 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.509 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:30:28.510 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:20.922414+0000", 2021-10-08T19:30:28.510 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1439999999999997e-06 2021-10-08T19:30:28.510 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.510 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.511 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:30:28.511 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:20.922471+0000", 2021-10-08T19:30:28.511 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6619000000000001e-05 2021-10-08T19:30:28.511 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.511 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.512 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:30:28.512 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:20.922608+0000", 2021-10-08T19:30:28.512 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013688400000000001 2021-10-08T19:30:28.512 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.513 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.513 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:30:28.513 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:20.922743+0000", 2021-10-08T19:30:28.513 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000135711 2021-10-08T19:30:28.513 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.514 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.514 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:30:28.514 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:20.924640+0000", 2021-10-08T19:30:28.514 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018971680000000001 2021-10-08T19:30:28.515 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.515 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.515 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:28.515 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:20.924853+0000", 2021-10-08T19:30:28.515 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00021213499999999999 2021-10-08T19:30:28.516 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.516 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.516 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:28.516 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:20.996213+0000", 2021-10-08T19:30:28.517 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.071360741000000005 2021-10-08T19:30:28.517 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.517 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.517 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:30:28.518 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:20.996253+0000", 2021-10-08T19:30:28.518 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9752000000000002e-05 2021-10-08T19:30:28.518 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.518 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.519 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:30:28.519 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:20.996282+0000", 2021-10-08T19:30:28.519 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8935999999999999e-05 2021-10-08T19:30:28.519 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:28.520 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:30:28.520 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:28.520 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.520 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.520 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:178298 7.5 7:ae74bb5e:::benchmark_data_smithi097_93198_object86478:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e169)", 2021-10-08T19:30:28.521 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:27:21.157208+0000", 2021-10-08T19:30:28.521 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 186.92442379900001, 2021-10-08T19:30:28.521 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.068774796999999999, 2021-10-08T19:30:28.522 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:30:28.522 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:30:28.522 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:30:28.522 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:30:28.522 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:30:28.523 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 178298 2021-10-08T19:30:28.523 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.523 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:30:28.523 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.523 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:30:28.524 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:21.157208+0000", 2021-10-08T19:30:28.524 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:28.524 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.524 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.525 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:30:28.525 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:21.157208+0000", 2021-10-08T19:30:28.525 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:30:28.526 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.526 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.527 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:30:28.527 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:21.157206+0000", 2021-10-08T19:30:28.527 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:30:28.528 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.528 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.528 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:30:28.528 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:21.157212+0000", 2021-10-08T19:30:28.528 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7760000000000003e-06 2021-10-08T19:30:28.529 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.529 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.529 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:30:28.529 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:21.157227+0000", 2021-10-08T19:30:28.530 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5284000000000001e-05 2021-10-08T19:30:28.530 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.530 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.530 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:30:28.530 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:21.157233+0000", 2021-10-08T19:30:28.531 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6160000000000001e-06 2021-10-08T19:30:28.531 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.531 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.531 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:30:28.532 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:21.157525+0000", 2021-10-08T19:30:28.532 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00029184399999999998 2021-10-08T19:30:28.532 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.533 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.533 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:30:28.533 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:21.157654+0000", 2021-10-08T19:30:28.534 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012898900000000001 2021-10-08T19:30:28.535 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.536 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.536 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:30:28.537 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:21.157732+0000", 2021-10-08T19:30:28.537 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8240999999999998e-05 2021-10-08T19:30:28.537 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.538 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.539 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:30:28.539 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:21.159561+0000", 2021-10-08T19:30:28.540 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001829654 2021-10-08T19:30:28.540 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.540 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.541 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:28.542 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:21.162874+0000", 2021-10-08T19:30:28.543 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0033121909999999999 2021-10-08T19:30:28.543 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.543 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.544 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:28.544 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:21.225890+0000", 2021-10-08T19:30:28.544 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.063015997000000004 2021-10-08T19:30:28.544 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.545 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.545 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:30:28.545 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:21.225929+0000", 2021-10-08T19:30:28.545 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9094999999999998e-05 2021-10-08T19:30:28.545 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:30:28.546 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:30:28.546 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:30:28.546 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:27:21.225983+0000", 2021-10-08T19:30:28.546 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.3838000000000002e-05 2021-10-08T19:30:28.547 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:28.547 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:30:28.547 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:28.547 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:30:28.547 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:30:28.548 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:30:28.549 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:28.549 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:28 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:30:28.550 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:28 smithi117 ceph-mon[34585]: pgmap v447: 178 pgs: 178 active+clean; 2.9 GiB data, 9.9 GiB used, 705 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 1.11k op/s 2021-10-08T19:30:28.551 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:30:28.551 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:30:28.552 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:28 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:30:28.553 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:28 smithi097 ceph-mon[41966]: pgmap v447: 178 pgs: 178 active+clean; 2.9 GiB data, 9.9 GiB used, 705 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 1.11k op/s 2021-10-08T19:30:28.652 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:30:28.710 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:29.085 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2021-10-08T19:30:30.006 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:30:30.016 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:30.017 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:30:30.118 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:30:30.174 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:30.197 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:30:30.282 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:30:30.288 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:30.289 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:30:30.290 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:30 smithi097 ceph-mon[41966]: pgmap v448: 178 pgs: 178 active+clean; 2.8 GiB data, 9.6 GiB used, 706 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 841 op/s 2021-10-08T19:30:30.292 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:30 smithi097 ceph-mon[32687]: pgmap v448: 178 pgs: 178 active+clean; 2.8 GiB data, 9.6 GiB used, 706 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 841 op/s 2021-10-08T19:30:30.391 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:30:30.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:30 smithi117 ceph-mon[34585]: pgmap v448: 178 pgs: 178 active+clean; 2.8 GiB data, 9.6 GiB used, 706 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 841 op/s 2021-10-08T19:30:30.460 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:30.553 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2021-10-08T19:30:30.733 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:30:30.738 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:30.739 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:30:30.840 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:30:30.869 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:30.928 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:30:30.930 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:30.931 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:30:31.033 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:30:31.062 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:31.114 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:30:31.117 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:31.118 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:30:31.220 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:30:31.281 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:31.354 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:30:31.524 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:30:31.531 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:31.532 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:30:31.633 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:30:31.669 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:31.675 INFO:teuthology.orchestra.run.smithi097.stdout:moved 22 / 534 (4.11985%) 2021-10-08T19:30:31.676 INFO:teuthology.orchestra.run.smithi097.stdout:avg 66.75 2021-10-08T19:30:31.676 INFO:teuthology.orchestra.run.smithi097.stdout:stddev 6.74073 -> 8.68548 (expected baseline 7.6424) 2021-10-08T19:30:31.676 INFO:teuthology.orchestra.run.smithi097.stdout:min osd.2 with 54 -> 60 pgs (0.808989 -> 0.898876 * mean) 2021-10-08T19:30:31.676 INFO:teuthology.orchestra.run.smithi097.stdout:max osd.7 with 76 -> 79 pgs (1.13858 -> 1.18352 * mean) 2021-10-08T19:30:31.677 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:30:31.677 INFO:teuthology.orchestra.run.smithi097.stdout:oload 110 2021-10-08T19:30:31.677 INFO:teuthology.orchestra.run.smithi097.stdout:max_change 3 2021-10-08T19:30:31.677 INFO:teuthology.orchestra.run.smithi097.stdout:max_change_osds 4 2021-10-08T19:30:31.677 INFO:teuthology.orchestra.run.smithi097.stdout:average_utilization 0.0126 2021-10-08T19:30:31.678 INFO:teuthology.orchestra.run.smithi097.stdout:overload_utilization 0.0139 2021-10-08T19:30:31.678 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5 weight 1.0000 -> 0.7784 2021-10-08T19:30:31.678 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1 weight 1.0000 -> 0.8663 2021-10-08T19:30:31.696 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is unset 2021-10-08T19:30:31.738 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:30:31.743 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:31.743 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:30:31.844 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:30:31.867 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:31 smithi117 ceph-mon[34585]: pgmap v449: 178 pgs: 178 active+clean; 2.6 GiB data, 9.0 GiB used, 706 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1.06k op/s 2021-10-08T19:30:31.867 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:31 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/4077087304' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:30:31.867 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:31 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd reweightn", "weights": "{'1':'56774','5':'51015'}"}]: dispatch 2021-10-08T19:30:31.868 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:31.909 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:30:31.911 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:31.912 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:30:31.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:31 smithi097 ceph-mon[41966]: pgmap v449: 178 pgs: 178 active+clean; 2.6 GiB data, 9.0 GiB used, 706 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1.06k op/s 2021-10-08T19:30:31.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:31 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/4077087304' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:30:31.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:31 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd reweightn", "weights": "{'1':'56774','5':'51015'}"}]: dispatch 2021-10-08T19:30:31.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:31 smithi097 ceph-mon[32687]: pgmap v449: 178 pgs: 178 active+clean; 2.6 GiB data, 9.0 GiB used, 706 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1.06k op/s 2021-10-08T19:30:31.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:31 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/4077087304' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:30:31.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:31 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd reweightn", "weights": "{'1':'56774','5':'51015'}"}]: dispatch 2021-10-08T19:30:32.013 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:30:32.037 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:32.078 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:30:32.080 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:32.081 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:30:32.182 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:30:32.208 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:32.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:32 smithi097 ceph-mon[41966]: from='client.15399 v1:172.21.15.97:0/3912112449' entity='client.admin' cmd=[{"prefix": "osd reweight-by-utilization", "oload": 110, "max_change": 3.0, "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:30:32.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:32 smithi097 ceph-mon[41966]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:30:32.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:32 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/4077087304' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:30:32.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:32 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd reweightn", "weights": "{'1':'56774','5':'51015'}"}]': finished 2021-10-08T19:30:32.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:32 smithi097 ceph-mon[41966]: osdmap e256: 8 total, 8 up, 8 in 2021-10-08T19:30:32.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:32 smithi097 ceph-mon[41966]: 2.15 scrub ok 2021-10-08T19:30:32.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:32 smithi097 ceph-mon[32687]: from='client.15399 v1:172.21.15.97:0/3912112449' entity='client.admin' cmd=[{"prefix": "osd reweight-by-utilization", "oload": 110, "max_change": 3.0, "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:30:32.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:32 smithi097 ceph-mon[32687]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:30:32.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:32 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/4077087304' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:30:32.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:32 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd reweightn", "weights": "{'1':'56774','5':'51015'}"}]': finished 2021-10-08T19:30:32.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:32 smithi097 ceph-mon[32687]: osdmap e256: 8 total, 8 up, 8 in 2021-10-08T19:30:32.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:32 smithi097 ceph-mon[32687]: 2.15 scrub ok 2021-10-08T19:30:32.973 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:30:32 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:30:32] "GET /metrics HTTP/1.1" 200 155711 "" "Prometheus/2.18.1" 2021-10-08T19:30:33.129 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:30:33.132 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:33.132 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:30:33.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:32 smithi117 ceph-mon[34585]: from='client.15399 v1:172.21.15.97:0/3912112449' entity='client.admin' cmd=[{"prefix": "osd reweight-by-utilization", "oload": 110, "max_change": 3.0, "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:30:33.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:32 smithi117 ceph-mon[34585]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:30:33.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:32 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/4077087304' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:30:33.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:32 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd reweightn", "weights": "{'1':'56774','5':'51015'}"}]': finished 2021-10-08T19:30:33.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:32 smithi117 ceph-mon[34585]: osdmap e256: 8 total, 8 up, 8 in 2021-10-08T19:30:33.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:32 smithi117 ceph-mon[34585]: 2.15 scrub ok 2021-10-08T19:30:33.233 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:30:33.258 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:33.393 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2021-10-08T19:30:33.393 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd test-reweight-by-utilization 110 1.0 2021-10-08T19:30:33.532 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:30:33.534 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:33.535 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:30:33.636 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:30:33.666 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:33.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:33 smithi117 ceph-mon[34585]: 5.13 scrub ok 2021-10-08T19:30:33.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:33 smithi117 ceph-mon[34585]: 6.1a scrub ok 2021-10-08T19:30:33.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:33 smithi117 ceph-mon[34585]: 6.d scrub ok 2021-10-08T19:30:33.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:33 smithi117 ceph-mon[34585]: pgmap v451: 178 pgs: 178 active+clean; 2.6 GiB data, 9.0 GiB used, 706 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 656 op/s 2021-10-08T19:30:33.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:33 smithi117 ceph-mon[34585]: osdmap e257: 8 total, 8 up, 8 in 2021-10-08T19:30:33.874 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:30:33.874 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:30:33 smithi117 conmon[69189]: level=error ts=2021-10-08T19:30:33.504Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=2 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:30:33.878 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:33.879 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:30:33.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:33 smithi097 ceph-mon[32687]: 5.13 scrub ok 2021-10-08T19:30:33.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:33 smithi097 ceph-mon[32687]: 6.1a scrub ok 2021-10-08T19:30:33.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:33 smithi097 ceph-mon[32687]: 6.d scrub ok 2021-10-08T19:30:33.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:33 smithi097 ceph-mon[32687]: pgmap v451: 178 pgs: 178 active+clean; 2.6 GiB data, 9.0 GiB used, 706 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 656 op/s 2021-10-08T19:30:33.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:33 smithi097 ceph-mon[32687]: osdmap e257: 8 total, 8 up, 8 in 2021-10-08T19:30:33.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:33 smithi097 ceph-mon[41966]: 5.13 scrub ok 2021-10-08T19:30:33.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:33 smithi097 ceph-mon[41966]: 6.1a scrub ok 2021-10-08T19:30:33.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:33 smithi097 ceph-mon[41966]: 6.d scrub ok 2021-10-08T19:30:33.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:33 smithi097 ceph-mon[41966]: pgmap v451: 178 pgs: 178 active+clean; 2.6 GiB data, 9.0 GiB used, 706 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 656 op/s 2021-10-08T19:30:33.975 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:33 smithi097 ceph-mon[41966]: osdmap e257: 8 total, 8 up, 8 in 2021-10-08T19:30:33.981 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:30:33.988 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:30:33.988 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2021-10-08T19:30:33.989 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:33.989 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.15147.0:138011 8.1 e258/208 8:82e98352:::benchmark_data_smithi097_144160_object49271:head v 258'8692, mlcod=258'8690)", 2021-10-08T19:30:33.989 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:30:33.984885+0000", 2021-10-08T19:30:33.989 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0013811470000000001, 2021-10-08T19:30:33.990 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001418592, 2021-10-08T19:30:33.990 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:30:33.990 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2021-10-08T19:30:33.990 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:30:33.990 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:33.991 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:30:33.991 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.984885+0000", 2021-10-08T19:30:33.991 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:30:33.991 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:33.992 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:33.992 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:30:33.992 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.984885+0000", 2021-10-08T19:30:33.992 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:30:33.992 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:33.993 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:33.993 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:30:33.993 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.984883+0000", 2021-10-08T19:30:33.993 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:30:33.993 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:33.994 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:33.994 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:30:33.994 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.984895+0000", 2021-10-08T19:30:33.994 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2248e-05 2021-10-08T19:30:33.995 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:33.995 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:33.995 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:30:33.995 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.984913+0000", 2021-10-08T19:30:33.995 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8329999999999999e-05 2021-10-08T19:30:33.996 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:33.996 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:33.996 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:30:33.996 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.984920+0000", 2021-10-08T19:30:33.996 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3529999999999997e-06 2021-10-08T19:30:33.997 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:33.997 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:33.997 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:30:33.997 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.985022+0000", 2021-10-08T19:30:33.997 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010103999999999999 2021-10-08T19:30:33.998 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:33.998 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:33.999 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:30:33.999 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.985046+0000", 2021-10-08T19:30:33.999 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4584e-05 2021-10-08T19:30:33.999 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:30:34.000 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:30:34.000 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:30:34.000 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:30:34.000 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:30:34.001 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 1 2021-10-08T19:30:34.001 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:30:34.011 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:34.079 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:30:34.083 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:30:34.087 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:34.088 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:30:34.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:30:33 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:30:33] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:30:34.189 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:30:34.241 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:34.679 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:30:34.682 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:34.683 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:30:34.784 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:30:34.827 INFO:journalctl@ceph.osd.0.smithi097.stdout:Oct 08 19:30:34 smithi097 conmon[47373]: 2021-10-08T19:30:34.543+0000 7f8334f91700 -1 osd.0 pg_epoch: 258 pg[4.1e( v 69'10 (0'0,69'10] local-lis/les=236/237 n=5 ec=62/62 lis/c=236/236 les/c/f=237/237/0 sis=236) [0,7,3] r=0 lpr=236 crt=69'10 lcod 69'9 mlcod 0'0 active+clean] scrubber pg(4.1e) handle_scrub_reserve_grant: received unsolicited reservation grant from osd 7 (0x55cbf8aca160) 2021-10-08T19:30:34.827 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:34 smithi097 ceph-mon[32687]: 4.7 scrub ok 2021-10-08T19:30:34.828 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:34 smithi097 ceph-mon[32687]: 8.b starting backfill to osd.2 from (0'0,0'0] MAX to 255'8357 2021-10-08T19:30:34.828 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:34 smithi097 ceph-mon[32687]: osdmap e258: 8 total, 8 up, 8 in 2021-10-08T19:30:34.828 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:34 smithi097 ceph-mon[32687]: 8.3 starting backfill to osd.2 from (0'0,0'0] MAX to 255'8694 2021-10-08T19:30:34.828 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:34 smithi097 ceph-mon[32687]: 8.9 starting backfill to osd.3 from (0'0,0'0] MAX to 255'8524 2021-10-08T19:30:34.829 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:34 smithi097 ceph-mon[32687]: 8.a starting backfill to osd.3 from (0'0,0'0] MAX to 255'8594 2021-10-08T19:30:34.829 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:34 smithi097 ceph-mon[41966]: 4.7 scrub ok 2021-10-08T19:30:34.829 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:34 smithi097 ceph-mon[41966]: 8.b starting backfill to osd.2 from (0'0,0'0] MAX to 255'8357 2021-10-08T19:30:34.830 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:34 smithi097 ceph-mon[41966]: osdmap e258: 8 total, 8 up, 8 in 2021-10-08T19:30:34.830 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:34 smithi097 ceph-mon[41966]: 8.3 starting backfill to osd.2 from (0'0,0'0] MAX to 255'8694 2021-10-08T19:30:34.830 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:34 smithi097 ceph-mon[41966]: 8.9 starting backfill to osd.3 from (0'0,0'0] MAX to 255'8524 2021-10-08T19:30:34.830 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:34 smithi097 ceph-mon[41966]: 8.a starting backfill to osd.3 from (0'0,0'0] MAX to 255'8594 2021-10-08T19:30:34.832 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:35.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:34 smithi117 ceph-mon[34585]: 4.7 scrub ok 2021-10-08T19:30:35.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:34 smithi117 ceph-mon[34585]: 8.b starting backfill to osd.2 from (0'0,0'0] MAX to 255'8357 2021-10-08T19:30:35.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:34 smithi117 ceph-mon[34585]: osdmap e258: 8 total, 8 up, 8 in 2021-10-08T19:30:35.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:34 smithi117 ceph-mon[34585]: 8.3 starting backfill to osd.2 from (0'0,0'0] MAX to 255'8694 2021-10-08T19:30:35.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:34 smithi117 ceph-mon[34585]: 8.9 starting backfill to osd.3 from (0'0,0'0] MAX to 255'8524 2021-10-08T19:30:35.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:34 smithi117 ceph-mon[34585]: 8.a starting backfill to osd.3 from (0'0,0'0] MAX to 255'8594 2021-10-08T19:30:35.308 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:30:35.318 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:35.319 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:30:35.420 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:30:35.425 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset nodeep-scrub 2021-10-08T19:30:35.452 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:35.661 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2021-10-08T19:30:35.686 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:30:35.690 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:35.690 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:30:35.791 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:30:35.822 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:35.880 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:30:35.883 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:35.884 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:30:35.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:35 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:30:35.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:35 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:30:35.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:35 smithi097 ceph-mon[41966]: 3.f scrub ok 2021-10-08T19:30:35.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:35 smithi097 ceph-mon[41966]: pgmap v454: 178 pgs: 1 active+degraded+remapped, 1 active+remapped+backfill_wait, 1 active+undersized+remapped, 2 remapped+peering, 173 active+clean; 2.4 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 681 B/s rd, 0 B/s wr, 1.09k op/s; 1/119169 objects degraded (0.001%); 4851/119169 objects misplaced (4.071%); 0 B/s, 1 objects/s recovering 2021-10-08T19:30:35.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:35 smithi097 ceph-mon[41966]: Health check failed: Degraded data redundancy: 1/119169 objects degraded (0.001%), 1 pg degraded (PG_DEGRADED) 2021-10-08T19:30:35.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:35 smithi097 ceph-mon[41966]: osdmap e259: 8 total, 8 up, 8 in 2021-10-08T19:30:35.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:35 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:30:35.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:35 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:30:35.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:35 smithi097 ceph-mon[32687]: 3.f scrub ok 2021-10-08T19:30:35.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:35 smithi097 ceph-mon[32687]: pgmap v454: 178 pgs: 1 active+degraded+remapped, 1 active+remapped+backfill_wait, 1 active+undersized+remapped, 2 remapped+peering, 173 active+clean; 2.4 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 681 B/s rd, 0 B/s wr, 1.09k op/s; 1/119169 objects degraded (0.001%); 4851/119169 objects misplaced (4.071%); 0 B/s, 1 objects/s recovering 2021-10-08T19:30:35.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:35 smithi097 ceph-mon[32687]: Health check failed: Degraded data redundancy: 1/119169 objects degraded (0.001%), 1 pg degraded (PG_DEGRADED) 2021-10-08T19:30:35.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:35 smithi097 ceph-mon[32687]: osdmap e259: 8 total, 8 up, 8 in 2021-10-08T19:30:35.985 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:30:36.008 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:35 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:30:36.008 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:35 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:30:36.008 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:35 smithi117 ceph-mon[34585]: 3.f scrub ok 2021-10-08T19:30:36.008 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:35 smithi117 ceph-mon[34585]: pgmap v454: 178 pgs: 1 active+degraded+remapped, 1 active+remapped+backfill_wait, 1 active+undersized+remapped, 2 remapped+peering, 173 active+clean; 2.4 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 681 B/s rd, 0 B/s wr, 1.09k op/s; 1/119169 objects degraded (0.001%); 4851/119169 objects misplaced (4.071%); 0 B/s, 1 objects/s recovering 2021-10-08T19:30:36.009 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:35 smithi117 ceph-mon[34585]: Health check failed: Degraded data redundancy: 1/119169 objects degraded (0.001%), 1 pg degraded (PG_DEGRADED) 2021-10-08T19:30:36.009 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:35 smithi117 ceph-mon[34585]: osdmap e259: 8 total, 8 up, 8 in 2021-10-08T19:30:36.013 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:36.068 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:30:36.075 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:36.076 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:30:36.177 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:30:36.204 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:36.265 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:30:36.268 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:36.269 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:30:36.370 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:30:36.416 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:36.481 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:30:36.483 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:36.484 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:30:36.548 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:30:36.581 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:30:36.586 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:30:36.617 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:30:36.621 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:36.657 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:30:36.681 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:30:36.688 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:36.689 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:30:36.701 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:30:36.741 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:30:36.785 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:30:36.790 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:30:36.828 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:30:36.848 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:36.853 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'false' 2021-10-08T19:30:36.854 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'false' 2021-10-08T19:30:36.854 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'false' 2021-10-08T19:30:36.854 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'false' 2021-10-08T19:30:36.854 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'false' 2021-10-08T19:30:36.855 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'false' 2021-10-08T19:30:36.855 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'false' 2021-10-08T19:30:36.855 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'false' 2021-10-08T19:30:36.905 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:30:36 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:30:36.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:36 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:30:36.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:36 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:30:36.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:36 smithi117 ceph-mon[34585]: osdmap e260: 8 total, 8 up, 8 in 2021-10-08T19:30:36.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:36 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1457023836' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:30:37.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:36 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:30:37.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:36 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:30:37.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:36 smithi097 ceph-mon[41966]: osdmap e260: 8 total, 8 up, 8 in 2021-10-08T19:30:37.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:36 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1457023836' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:30:37.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:36 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:30:37.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:36 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:30:37.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:36 smithi097 ceph-mon[32687]: osdmap e260: 8 total, 8 up, 8 in 2021-10-08T19:30:37.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:36 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1457023836' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:30:37.580 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:30:37.581 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:37.582 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:30:37.683 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:30:37.732 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:37.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:37 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:30:37.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:37 smithi097 ceph-mon[41966]: pgmap v457: 178 pgs: 1 active+degraded+remapped, 1 active+remapped+backfill_wait, 1 active+undersized+remapped, 2 remapped+peering, 173 active+clean; 2.4 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 1022 B/s rd, 0 B/s wr, 731 op/s; 1/119169 objects degraded (0.001%); 4851/119169 objects misplaced (4.071%); 0 B/s, 1 objects/s recovering 2021-10-08T19:30:37.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:37 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:30:37.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:37 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:30:37.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:37 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:30:37.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:37 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:30:37.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:37 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:30:37.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:37 smithi097 ceph-mon[32687]: pgmap v457: 178 pgs: 1 active+degraded+remapped, 1 active+remapped+backfill_wait, 1 active+undersized+remapped, 2 remapped+peering, 173 active+clean; 2.4 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 1022 B/s rd, 0 B/s wr, 731 op/s; 1/119169 objects degraded (0.001%); 4851/119169 objects misplaced (4.071%); 0 B/s, 1 objects/s recovering 2021-10-08T19:30:37.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:37 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:30:37.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:37 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:30:37.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:37 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:30:37.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:37 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:30:38.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:37 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:30:38.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:37 smithi117 ceph-mon[34585]: pgmap v457: 178 pgs: 1 active+degraded+remapped, 1 active+remapped+backfill_wait, 1 active+undersized+remapped, 2 remapped+peering, 173 active+clean; 2.4 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 1022 B/s rd, 0 B/s wr, 731 op/s; 1/119169 objects degraded (0.001%); 4851/119169 objects misplaced (4.071%); 0 B/s, 1 objects/s recovering 2021-10-08T19:30:38.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:37 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:30:38.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:37 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:30:38.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:37 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:30:38.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:37 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:30:38.319 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:30:38.325 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:38.326 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:30:38.352 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:30:38.404 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:30:38.427 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:30:38.485 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:38.938 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:30:38.965 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:38.966 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:30:39.068 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:30:39.135 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:39.440 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:30:39.449 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:39.451 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:30:39.452 INFO:teuthology.orchestra.run.smithi097.stdout:moved 20 / 534 (3.74532%) 2021-10-08T19:30:39.452 INFO:teuthology.orchestra.run.smithi097.stdout:avg 66.75 2021-10-08T19:30:39.453 INFO:teuthology.orchestra.run.smithi097.stdout:stddev 8.68548 -> 13.2736 (expected baseline 7.6424) 2021-10-08T19:30:39.454 INFO:teuthology.orchestra.run.smithi097.stdout:min osd.5 with 54 -> 39 pgs (0.808989 -> 0.58427 * mean) 2021-10-08T19:30:39.454 INFO:teuthology.orchestra.run.smithi097.stdout:max osd.3 with 79 -> 82 pgs (1.18352 -> 1.22846 * mean) 2021-10-08T19:30:39.454 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:30:39.455 INFO:teuthology.orchestra.run.smithi097.stdout:oload 110 2021-10-08T19:30:39.456 INFO:teuthology.orchestra.run.smithi097.stdout:max_change 1 2021-10-08T19:30:39.456 INFO:teuthology.orchestra.run.smithi097.stdout:max_change_osds 4 2021-10-08T19:30:39.456 INFO:teuthology.orchestra.run.smithi097.stdout:average_utilization 0.0113 2021-10-08T19:30:39.456 INFO:teuthology.orchestra.run.smithi097.stdout:overload_utilization 0.0125 2021-10-08T19:30:39.457 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5 weight 0.7784 -> 0.6456 2021-10-08T19:30:39.457 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1 weight 0.8663 -> 0.7271 2021-10-08T19:30:39.484 INFO:teuthology.orchestra.run.smithi097.stderr:no change 2021-10-08T19:30:39.552 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:30:39.607 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:39.721 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:30:39 smithi097 conmon[33110]: 2021-10-08T19:30:39.448+0000 7f26c6999700 -1 mgr.server reply reply (2) No such file or directory no change 2021-10-08T19:30:39.757 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:30:39 smithi097 conmon[33110]: 172.21.15.97 - - [08/Oct/2021:19:30:39] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:30:40.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:39 smithi117 ceph-mon[34585]: pgmap v458: 178 pgs: 2 active+remapped+backfilling, 1 active+degraded+remapped, 1 active+remapped+backfill_wait, 1 active+undersized+remapped, 173 active+clean; 2.3 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 747 op/s; 1/114537 objects degraded (0.001%); 8611/114537 objects misplaced (7.518%); 6.6 MiB/s, 108 objects/s recovering 2021-10-08T19:30:40.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:39 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:30:40.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:39 smithi097 ceph-mon[32687]: pgmap v458: 178 pgs: 2 active+remapped+backfilling, 1 active+degraded+remapped, 1 active+remapped+backfill_wait, 1 active+undersized+remapped, 173 active+clean; 2.3 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 747 op/s; 1/114537 objects degraded (0.001%); 8611/114537 objects misplaced (7.518%); 6.6 MiB/s, 108 objects/s recovering 2021-10-08T19:30:40.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:39 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:30:40.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:39 smithi097 ceph-mon[41966]: pgmap v458: 178 pgs: 2 active+remapped+backfilling, 1 active+degraded+remapped, 1 active+remapped+backfill_wait, 1 active+undersized+remapped, 173 active+clean; 2.3 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 747 op/s; 1/114537 objects degraded (0.001%); 8611/114537 objects misplaced (7.518%); 6.6 MiB/s, 108 objects/s recovering 2021-10-08T19:30:40.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:39 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:30:40.339 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2021-10-08T19:30:40.720 INFO:journalctl@ceph.osd.0.smithi097.stdout:Oct 08 19:30:40 smithi097 conmon[47373]: 2021-10-08T19:30:40.383+0000 7f8335f93700 -1 osd.0 pg_epoch: 260 pg[8.c( v 260'9106 (206'4415,260'9106] local-lis/les=237/238 n=2080 ec=182/182 lis/c=237/237 les/c/f=238/238/0 sis=237) [0,3,7] r=0 lpr=237 crt=260'9106 lcod 260'9105 mlcod 260'9105 active+clean] scrubber pg(8.c) handle_scrub_reserve_grant: received unsolicited reservation grant from osd 7 (0x55cbf8f1f760) 2021-10-08T19:30:40.759 INFO:journalctl@ceph.osd.4.smithi117.stdout:Oct 08 19:30:40 smithi117 conmon[42287]: 2021-10-08T19:30:40.410+0000 7f7e86a07700 -1 osd.4 pg_epoch: 260 pg[4.1a( v 69'9 (0'0,69'9] local-lis/les=236/237 n=4 ec=62/62 lis/c=236/236 les/c/f=237/237/0 sis=236) [4,3,0] r=0 lpr=236 crt=69'9 lcod 69'8 mlcod 0'0 active+clean] scrubber pg(4.1a) handle_scrub_reserve_grant: received unsolicited reservation grant from osd 0 (0x556c4c7062c0) 2021-10-08T19:30:40.820 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:30:40.831 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:40.832 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:30:40.933 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:30:41.003 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:41.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:40 smithi117 ceph-mon[34585]: from='client.35372 v1:172.21.15.97:0/1950210788' entity='client.admin' cmd=[{"prefix": "osd test-reweight-by-utilization", "oload": 110, "max_change": 1.0, "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:30:41.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:40 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:30:41.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:40 smithi117 ceph-mon[34585]: 172.21.15.97 - - [08/Oct/2021:19:30:39] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:30:41.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:40 smithi117 ceph-mon[34585]: Health check update: Degraded data redundancy: 1/114537 objects degraded (0.001%), 1 pg degraded (PG_DEGRADED) 2021-10-08T19:30:41.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:40 smithi117 ceph-mon[34585]: osdmap e261: 8 total, 8 up, 8 in 2021-10-08T19:30:41.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:40 smithi097 ceph-mon[41966]: from='client.35372 v1:172.21.15.97:0/1950210788' entity='client.admin' cmd=[{"prefix": "osd test-reweight-by-utilization", "oload": 110, "max_change": 1.0, "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:30:41.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:40 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:30:41.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:40 smithi097 ceph-mon[41966]: 172.21.15.97 - - [08/Oct/2021:19:30:39] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:30:41.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:40 smithi097 ceph-mon[41966]: Health check update: Degraded data redundancy: 1/114537 objects degraded (0.001%), 1 pg degraded (PG_DEGRADED) 2021-10-08T19:30:41.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:40 smithi097 ceph-mon[41966]: osdmap e261: 8 total, 8 up, 8 in 2021-10-08T19:30:41.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:40 smithi097 ceph-mon[32687]: from='client.35372 v1:172.21.15.97:0/1950210788' entity='client.admin' cmd=[{"prefix": "osd test-reweight-by-utilization", "oload": 110, "max_change": 1.0, "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:30:41.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:40 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:30:41.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:40 smithi097 ceph-mon[32687]: 172.21.15.97 - - [08/Oct/2021:19:30:39] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:30:41.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:40 smithi097 ceph-mon[32687]: Health check update: Degraded data redundancy: 1/114537 objects degraded (0.001%), 1 pg degraded (PG_DEGRADED) 2021-10-08T19:30:41.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:40 smithi097 ceph-mon[32687]: osdmap e261: 8 total, 8 up, 8 in 2021-10-08T19:30:42.054 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:30:42.059 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:42.060 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:30:42.060 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:41 smithi097 ceph-mon[41966]: pgmap v460: 178 pgs: 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 174 active+clean; 2.1 GiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 745 op/s; 7652/105762 objects misplaced (7.235%); 11 MiB/s, 172 objects/s recovering 2021-10-08T19:30:42.060 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:41 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:30:42.061 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:41 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:30:42.061 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:41 smithi097 ceph-mon[41966]: Health check failed: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull (PG_BACKFILL_FULL) 2021-10-08T19:30:42.061 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:41 smithi097 ceph-mon[41966]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/114537 objects degraded (0.001%), 1 pg degraded) 2021-10-08T19:30:42.061 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:41 smithi097 ceph-mon[41966]: osdmap e262: 8 total, 8 up, 8 in 2021-10-08T19:30:42.062 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:41 smithi097 ceph-mon[32687]: pgmap v460: 178 pgs: 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 174 active+clean; 2.1 GiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 745 op/s; 7652/105762 objects misplaced (7.235%); 11 MiB/s, 172 objects/s recovering 2021-10-08T19:30:42.062 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:41 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:30:42.062 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:41 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:30:42.062 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:41 smithi097 ceph-mon[32687]: Health check failed: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull (PG_BACKFILL_FULL) 2021-10-08T19:30:42.063 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:41 smithi097 ceph-mon[32687]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/114537 objects degraded (0.001%), 1 pg degraded) 2021-10-08T19:30:42.063 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:41 smithi097 ceph-mon[32687]: osdmap e262: 8 total, 8 up, 8 in 2021-10-08T19:30:42.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:41 smithi117 ceph-mon[34585]: pgmap v460: 178 pgs: 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 174 active+clean; 2.1 GiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 745 op/s; 7652/105762 objects misplaced (7.235%); 11 MiB/s, 172 objects/s recovering 2021-10-08T19:30:42.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:41 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:30:42.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:41 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:30:42.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:41 smithi117 ceph-mon[34585]: Health check failed: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull (PG_BACKFILL_FULL) 2021-10-08T19:30:42.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:41 smithi117 ceph-mon[34585]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/114537 objects degraded (0.001%), 1 pg degraded) 2021-10-08T19:30:42.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:41 smithi117 ceph-mon[34585]: osdmap e262: 8 total, 8 up, 8 in 2021-10-08T19:30:42.161 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:30:42.194 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:42.204 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:30:42.266 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:30:42.274 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:42.274 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:30:42.376 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:30:42.438 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:42.650 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:30:42 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:30:42] "GET /metrics HTTP/1.1" 200 155903 "" "Prometheus/2.18.1" 2021-10-08T19:30:42.657 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:30:42 smithi117 conmon[69189]: level=error ts=2021-10-08T19:30:42.314Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=1 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:30:42.770 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:30:42.781 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:42.782 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:30:42.883 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:30:42.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:42 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:30:42.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:42 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:30:42.991 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:43.078 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2021-10-08T19:30:43.078 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:30:43.136 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:30:43.144 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:43.145 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:30:43.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:42 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:30:43.246 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:30:43.292 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:43.820 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is unset 2021-10-08T19:30:43.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:43 smithi097 ceph-mon[41966]: pgmap v462: 178 pgs: 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 174 active+clean; 2.1 GiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 738 B/s rd, 0 B/s wr, 645 op/s; 7652/105762 objects misplaced (7.235%); 9.3 MiB/s, 149 objects/s recovering 2021-10-08T19:30:43.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:30:43.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:43 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2365746576' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:30:43.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:43 smithi097 ceph-mon[41966]: from='client.35378 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:30:43.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:43 smithi097 ceph-mon[32687]: pgmap v462: 178 pgs: 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 174 active+clean; 2.1 GiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 738 B/s rd, 0 B/s wr, 645 op/s; 7652/105762 objects misplaced (7.235%); 9.3 MiB/s, 149 objects/s recovering 2021-10-08T19:30:43.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:30:43.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:43 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2365746576' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:30:43.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:43 smithi097 ceph-mon[32687]: from='client.35378 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:30:44.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:43 smithi117 ceph-mon[34585]: pgmap v462: 178 pgs: 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 174 active+clean; 2.1 GiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 738 B/s rd, 0 B/s wr, 645 op/s; 7652/105762 objects misplaced (7.235%); 9.3 MiB/s, 149 objects/s recovering 2021-10-08T19:30:44.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:30:44.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:43 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2365746576' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:30:44.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:43 smithi117 ceph-mon[34585]: from='client.35378 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:30:44.157 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:30:43 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:30:43] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:30:44.953 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:30:44.957 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:44.958 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:30:45.059 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:30:45.078 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:44 smithi117 ceph-mon[34585]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:30:45.079 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:44 smithi117 ceph-mon[34585]: from='client.35378 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:30:45.079 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:44 smithi117 ceph-mon[34585]: osdmap e263: 8 total, 8 up, 8 in 2021-10-08T19:30:45.100 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:45.176 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:44 smithi097 ceph-mon[32687]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:30:45.176 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:44 smithi097 ceph-mon[32687]: from='client.35378 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:30:45.177 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:44 smithi097 ceph-mon[32687]: osdmap e263: 8 total, 8 up, 8 in 2021-10-08T19:30:45.177 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:44 smithi097 ceph-mon[41966]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:30:45.177 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:44 smithi097 ceph-mon[41966]: from='client.35378 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:30:45.178 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:44 smithi097 ceph-mon[41966]: osdmap e263: 8 total, 8 up, 8 in 2021-10-08T19:30:45.179 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2021-10-08T19:30:45.183 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:30:45.188 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:45.189 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:30:45.290 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:30:45.318 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:45.402 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:30:45.406 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:45.407 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:30:45.508 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:30:45.555 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:45.818 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:45 smithi117 ceph-mon[34585]: 2.5 scrub ok 2021-10-08T19:30:45.819 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:45 smithi117 ceph-mon[34585]: pgmap v464: 178 pgs: 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 174 active+clean; 1.9 GiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 1.27k op/s; 5658/91752 objects misplaced (6.167%); 15 MiB/s, 245 objects/s recovering 2021-10-08T19:30:45.841 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:30:45.847 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:45.848 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:30:45.949 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:30:46.008 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:30:46.010 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:46.110 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:45 smithi097 ceph-mon[41966]: 2.5 scrub ok 2021-10-08T19:30:46.111 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:45 smithi097 ceph-mon[41966]: pgmap v464: 178 pgs: 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 174 active+clean; 1.9 GiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 1.27k op/s; 5658/91752 objects misplaced (6.167%); 15 MiB/s, 245 objects/s recovering 2021-10-08T19:30:46.111 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:45 smithi097 ceph-mon[32687]: 2.5 scrub ok 2021-10-08T19:30:46.111 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:45 smithi097 ceph-mon[32687]: pgmap v464: 178 pgs: 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 174 active+clean; 1.9 GiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 1.27k op/s; 5658/91752 objects misplaced (6.167%); 15 MiB/s, 245 objects/s recovering 2021-10-08T19:30:46.113 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:30:46.125 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:46.126 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:30:46.227 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:30:46.262 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:46.343 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:30:46.347 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:46.348 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:30:46.450 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:30:46.482 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:30:46.531 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:46.545 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:30:46.590 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:30:46.624 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:30:46.628 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:46.629 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:30:46.632 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:30:46.669 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:30:46.711 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:30:46.729 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:30:46.752 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:30:46.779 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:46.794 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:30:46.807 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true' 2021-10-08T19:30:46.807 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true' 2021-10-08T19:30:46.808 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true' 2021-10-08T19:30:46.808 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true' 2021-10-08T19:30:46.808 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true' 2021-10-08T19:30:46.808 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true' 2021-10-08T19:30:46.808 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'true' 2021-10-08T19:30:46.809 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'true' 2021-10-08T19:30:46.853 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:30:46.858 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:46.859 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:30:46.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:46 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/4126994108' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:30:46.906 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:30:46 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:30:46.960 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:30:47.018 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:47.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:46 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/4126994108' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:30:47.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:46 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/4126994108' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:30:47.247 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 4, 5, 7, 6, 1, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2021-10-08T19:30:47.247 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd reweight 0 1 2021-10-08T19:30:47.270 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:30:47.275 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:47.276 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:30:47.378 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:30:47.414 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:47.481 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:30:47.485 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:47.486 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:30:47.587 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:30:47.609 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:47.685 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:30:47.691 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:47.692 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:30:47.793 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:30:47.834 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:48.016 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set noscrub 2021-10-08T19:30:48.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:47 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:30:48.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:47 smithi117 ceph-mon[34585]: pgmap v465: 178 pgs: 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 174 active+clean; 1.9 GiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 848 B/s rd, 0 B/s wr, 774 op/s; 5658/91752 objects misplaced (6.167%); 11 MiB/s, 179 objects/s recovering 2021-10-08T19:30:48.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:47 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:30:48.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:47 smithi097 ceph-mon[32687]: pgmap v465: 178 pgs: 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 174 active+clean; 1.9 GiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 848 B/s rd, 0 B/s wr, 774 op/s; 5658/91752 objects misplaced (6.167%); 11 MiB/s, 179 objects/s recovering 2021-10-08T19:30:48.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:47 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:30:48.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:47 smithi097 ceph-mon[41966]: pgmap v465: 178 pgs: 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 174 active+clean; 1.9 GiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 848 B/s rd, 0 B/s wr, 774 op/s; 5658/91752 objects misplaced (6.167%); 11 MiB/s, 179 objects/s recovering 2021-10-08T19:30:48.404 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:30:48.407 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:48.408 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:30:48.509 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:30:48.562 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:48.704 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:30:48.712 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:48.713 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:30:48.789 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:30:48.814 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:30:48.841 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:30:48.862 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:48 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:30:48.862 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:48 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:30:48.862 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:48 smithi117 ceph-mon[34585]: osdmap e264: 8 total, 8 up, 8 in 2021-10-08T19:30:48.871 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:48.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:48 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:30:48.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:48 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:30:48.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:48 smithi097 ceph-mon[32687]: osdmap e264: 8 total, 8 up, 8 in 2021-10-08T19:30:48.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:48 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:30:48.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:48 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:30:48.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:48 smithi097 ceph-mon[41966]: osdmap e264: 8 total, 8 up, 8 in 2021-10-08T19:30:49.134 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:30:49.138 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:49.139 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:30:49.241 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:30:49.281 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:49.508 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:30:49.514 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:49.515 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:30:49.616 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:30:49.668 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:49.764 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:30:49.772 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:49.772 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:30:49.874 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:30:49.933 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:50.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:49 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:30:50.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:49 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:30:50.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:49 smithi117 ceph-mon[34585]: pgmap v467: 178 pgs: 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 174 active+clean; 1.7 GiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 920 op/s; 4641/86400 objects misplaced (5.372%); 15 MiB/s, 246 objects/s recovering 2021-10-08T19:30:50.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:49 smithi117 ceph-mon[34585]: osdmap e265: 8 total, 8 up, 8 in 2021-10-08T19:30:50.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:49 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:30:50.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:49 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:30:50.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:49 smithi097 ceph-mon[32687]: pgmap v467: 178 pgs: 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 174 active+clean; 1.7 GiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 920 op/s; 4641/86400 objects misplaced (5.372%); 15 MiB/s, 246 objects/s recovering 2021-10-08T19:30:50.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:49 smithi097 ceph-mon[32687]: osdmap e265: 8 total, 8 up, 8 in 2021-10-08T19:30:50.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:49 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:30:50.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:49 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:30:50.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:49 smithi097 ceph-mon[41966]: pgmap v467: 178 pgs: 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 174 active+clean; 1.7 GiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 920 op/s; 4641/86400 objects misplaced (5.372%); 15 MiB/s, 246 objects/s recovering 2021-10-08T19:30:50.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:49 smithi097 ceph-mon[41966]: osdmap e265: 8 total, 8 up, 8 in 2021-10-08T19:30:50.712 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2021-10-08T19:30:51.562 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:30:51.562 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2021-10-08T19:30:51.563 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2021-10-08T19:30:51.563 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2021-10-08T19:30:51.563 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.563 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:35708 7.6 7:6ac91e09:::benchmark_data_smithi097_93198_object35707:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106)", 2021-10-08T19:30:51.564 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:12.260446+0000", 2021-10-08T19:30:51.564 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 398.28105281000001, 2021-10-08T19:30:51.564 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.141301706, 2021-10-08T19:30:51.564 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:30:51.564 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:30:51.565 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:30:51.565 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:30:51.565 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:30:51.565 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 35708 2021-10-08T19:30:51.565 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.566 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:30:51.566 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.566 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:30:51.566 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.260446+0000", 2021-10-08T19:30:51.566 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:30:51.567 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.567 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.567 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:30:51.567 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.260446+0000", 2021-10-08T19:30:51.568 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:30:51.568 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.568 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.568 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:30:51.568 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.260444+0000", 2021-10-08T19:30:51.569 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:30:51.569 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.569 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.569 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:30:51.569 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.260478+0000", 2021-10-08T19:30:51.570 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4270000000000002e-05 2021-10-08T19:30:51.570 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.570 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.571 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:30:51.572 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.260491+0000", 2021-10-08T19:30:51.572 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2977e-05 2021-10-08T19:30:51.572 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.572 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.573 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:30:51.573 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.260498+0000", 2021-10-08T19:30:51.573 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.764e-06 2021-10-08T19:30:51.573 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.573 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.574 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:30:51.574 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.260540+0000", 2021-10-08T19:30:51.574 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1520000000000002e-05 2021-10-08T19:30:51.574 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.575 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.575 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:30:51.575 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.260663+0000", 2021-10-08T19:30:51.575 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012287600000000001 2021-10-08T19:30:51.575 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.576 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.577 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,7", 2021-10-08T19:30:51.577 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.260802+0000", 2021-10-08T19:30:51.577 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013916699999999999 2021-10-08T19:30:51.578 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.578 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.578 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:30:51.578 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.263853+0000", 2021-10-08T19:30:51.579 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030514489999999999 2021-10-08T19:30:51.579 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.579 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.579 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:51.579 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.264169+0000", 2021-10-08T19:30:51.580 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031615300000000001 2021-10-08T19:30:51.580 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.580 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.580 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:51.581 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.401662+0000", 2021-10-08T19:30:51.581 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.13749296 2021-10-08T19:30:51.581 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.581 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.581 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:30:51.582 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.401711+0000", 2021-10-08T19:30:51.582 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8871e-05 2021-10-08T19:30:51.582 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.582 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.583 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:30:51.583 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.401748+0000", 2021-10-08T19:30:51.583 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6979e-05 2021-10-08T19:30:51.583 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:30:51.583 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:30:51.584 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:30:51.584 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.584 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.584 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:35713 7.6 7:640478e8:::benchmark_data_smithi097_93198_object35712:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106)", 2021-10-08T19:30:51.584 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:12.264903+0000", 2021-10-08T19:30:51.585 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 398.276596536, 2021-10-08T19:30:51.585 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.13701453799999999, 2021-10-08T19:30:51.585 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:30:51.585 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:30:51.586 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:30:51.586 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:30:51.586 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:30:51.586 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 35713 2021-10-08T19:30:51.586 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.587 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:30:51.587 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.587 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:30:51.587 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.264903+0000", 2021-10-08T19:30:51.588 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:30:51.588 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.588 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.588 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:30:51.588 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.264903+0000", 2021-10-08T19:30:51.589 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:30:51.589 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.589 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.589 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:30:51.590 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.264900+0000", 2021-10-08T19:30:51.590 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:30:51.590 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.590 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.591 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:30:51.591 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.264927+0000", 2021-10-08T19:30:51.591 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6295000000000002e-05 2021-10-08T19:30:51.591 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.591 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.592 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:30:51.592 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.264941+0000", 2021-10-08T19:30:51.592 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3959e-05 2021-10-08T19:30:51.592 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.592 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.593 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:30:51.593 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.264948+0000", 2021-10-08T19:30:51.593 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1790000000000002e-06 2021-10-08T19:30:51.593 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.594 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.594 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:30:51.594 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.265003+0000", 2021-10-08T19:30:51.594 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4846000000000003e-05 2021-10-08T19:30:51.595 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.595 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.595 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:30:51.595 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.265136+0000", 2021-10-08T19:30:51.595 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013353799999999999 2021-10-08T19:30:51.596 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.596 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.596 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,7", 2021-10-08T19:30:51.596 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.265239+0000", 2021-10-08T19:30:51.596 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000102397 2021-10-08T19:30:51.597 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.597 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.597 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:51.597 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.266455+0000", 2021-10-08T19:30:51.597 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001215998 2021-10-08T19:30:51.598 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.598 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.598 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:30:51.598 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.267180+0000", 2021-10-08T19:30:51.599 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00072546500000000001 2021-10-08T19:30:51.599 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.599 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.599 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:51.599 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.401838+0000", 2021-10-08T19:30:51.600 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.13465750600000001 2021-10-08T19:30:51.600 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.600 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.600 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:30:51.600 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.401883+0000", 2021-10-08T19:30:51.601 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5837000000000002e-05 2021-10-08T19:30:51.601 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.601 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.601 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:30:51.602 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:12.401917+0000", 2021-10-08T19:30:51.602 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.383e-05 2021-10-08T19:30:51.602 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:30:51.602 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:30:51.602 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:30:51.603 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.603 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.603 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:58798 7.4 7:25a383b0:::benchmark_data_smithi097_93198_object58797:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2021-10-08T19:30:51.603 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:38.366201+0000", 2021-10-08T19:30:51.604 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 372.17529826600003, 2021-10-08T19:30:51.604 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.199486627, 2021-10-08T19:30:51.604 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:30:51.604 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:30:51.604 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:30:51.605 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:30:51.605 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:30:51.605 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 58798 2021-10-08T19:30:51.605 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.606 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:30:51.606 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.606 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:30:51.606 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366201+0000", 2021-10-08T19:30:51.606 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:30:51.607 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.607 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.607 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:30:51.607 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366201+0000", 2021-10-08T19:30:51.607 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:30:51.608 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.608 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.608 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:30:51.608 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366199+0000", 2021-10-08T19:30:51.609 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:30:51.609 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.609 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.609 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:30:51.609 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366227+0000", 2021-10-08T19:30:51.610 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8860000000000002e-05 2021-10-08T19:30:51.610 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.610 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.610 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:30:51.610 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366240+0000", 2021-10-08T19:30:51.611 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2388000000000001e-05 2021-10-08T19:30:51.611 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.611 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.611 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:30:51.612 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366246+0000", 2021-10-08T19:30:51.612 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3339999999999998e-06 2021-10-08T19:30:51.612 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.612 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.612 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:30:51.613 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366332+0000", 2021-10-08T19:30:51.613 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6215e-05 2021-10-08T19:30:51.613 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.613 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.613 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:30:51.614 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366501+0000", 2021-10-08T19:30:51.614 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000168875 2021-10-08T19:30:51.614 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.614 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.615 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:30:51.615 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366701+0000", 2021-10-08T19:30:51.615 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000199774 2021-10-08T19:30:51.616 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.616 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.616 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:30:51.616 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.371460+0000", 2021-10-08T19:30:51.617 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0047593369999999998 2021-10-08T19:30:51.617 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.617 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.617 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:51.617 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.371901+0000", 2021-10-08T19:30:51.618 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00044059200000000001 2021-10-08T19:30:51.618 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.618 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.618 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:51.619 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.565596+0000", 2021-10-08T19:30:51.619 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.19369520900000001 2021-10-08T19:30:51.619 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.619 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.619 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:30:51.620 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.565648+0000", 2021-10-08T19:30:51.620 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1826999999999997e-05 2021-10-08T19:30:51.620 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.620 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.621 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:30:51.621 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.565688+0000", 2021-10-08T19:30:51.621 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9666999999999998e-05 2021-10-08T19:30:51.621 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:30:51.621 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:30:51.622 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:30:51.622 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.622 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.622 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:58799 7.7 7:e1b8d674:::benchmark_data_smithi097_93198_object58798:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2021-10-08T19:30:51.623 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:38.366257+0000", 2021-10-08T19:30:51.623 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 372.17524178100001, 2021-10-08T19:30:51.623 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.20128591500000001, 2021-10-08T19:30:51.623 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:30:51.624 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:30:51.624 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:30:51.624 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:30:51.624 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:30:51.625 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 58799 2021-10-08T19:30:51.625 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.625 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:30:51.625 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.625 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:30:51.626 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366257+0000", 2021-10-08T19:30:51.626 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:30:51.626 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.626 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.626 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:30:51.627 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366257+0000", 2021-10-08T19:30:51.627 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:30:51.627 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.627 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.628 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:30:51.628 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366257+0000", 2021-10-08T19:30:51.628 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:30:51.628 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.628 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.629 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:30:51.629 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366284+0000", 2021-10-08T19:30:51.629 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7379999999999999e-05 2021-10-08T19:30:51.629 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.630 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.630 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:30:51.630 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366291+0000", 2021-10-08T19:30:51.630 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8789999999999997e-06 2021-10-08T19:30:51.630 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.631 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.631 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:30:51.631 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366295+0000", 2021-10-08T19:30:51.631 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4159999999999997e-06 2021-10-08T19:30:51.632 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.632 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.632 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:30:51.632 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366372+0000", 2021-10-08T19:30:51.632 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6862999999999999e-05 2021-10-08T19:30:51.633 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.633 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.633 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:30:51.633 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366506+0000", 2021-10-08T19:30:51.633 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000133516 2021-10-08T19:30:51.634 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.634 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.634 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,6", 2021-10-08T19:30:51.634 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366701+0000", 2021-10-08T19:30:51.634 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000195248 2021-10-08T19:30:51.635 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.635 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.635 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:30:51.636 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.371268+0000", 2021-10-08T19:30:51.636 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.004567181 2021-10-08T19:30:51.636 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.636 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.637 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:51.637 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.371985+0000", 2021-10-08T19:30:51.637 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00071697000000000004 2021-10-08T19:30:51.637 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.638 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.638 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:51.638 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.565393+0000", 2021-10-08T19:30:51.638 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.193408149 2021-10-08T19:30:51.638 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.639 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.639 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:30:51.639 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.565453+0000", 2021-10-08T19:30:51.639 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0132e-05 2021-10-08T19:30:51.640 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.640 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.640 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:30:51.640 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.567543+0000", 2021-10-08T19:30:51.641 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0020899759999999999 2021-10-08T19:30:51.641 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:30:51.641 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:30:51.641 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:30:51.641 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.642 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.642 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:58800 7.4 7:24212c9b:::benchmark_data_smithi097_93198_object58799:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2021-10-08T19:30:51.642 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:38.366306+0000", 2021-10-08T19:30:51.642 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 372.17519356600002, 2021-10-08T19:30:51.643 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.19999181099999999, 2021-10-08T19:30:51.643 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:30:51.643 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:30:51.643 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:30:51.643 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:30:51.644 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:30:51.644 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 58800 2021-10-08T19:30:51.644 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.645 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:30:51.645 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.645 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:30:51.646 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366306+0000", 2021-10-08T19:30:51.646 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:30:51.646 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.646 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.646 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:30:51.647 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366306+0000", 2021-10-08T19:30:51.647 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:30:51.647 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.647 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.648 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:30:51.648 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366305+0000", 2021-10-08T19:30:51.648 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:30:51.648 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.648 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.649 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:30:51.649 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366333+0000", 2021-10-08T19:30:51.649 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7841e-05 2021-10-08T19:30:51.649 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.649 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.650 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:30:51.650 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366339+0000", 2021-10-08T19:30:51.650 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5910000000000001e-06 2021-10-08T19:30:51.650 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.651 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.651 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:30:51.651 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366344+0000", 2021-10-08T19:30:51.651 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1270000000000002e-06 2021-10-08T19:30:51.651 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.652 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.652 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:30:51.652 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.368776+0000", 2021-10-08T19:30:51.652 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0024312790000000002 2021-10-08T19:30:51.653 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.653 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.653 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:30:51.653 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.368900+0000", 2021-10-08T19:30:51.653 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012395900000000001 2021-10-08T19:30:51.654 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.654 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.654 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:30:51.654 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.368996+0000", 2021-10-08T19:30:51.655 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5937e-05 2021-10-08T19:30:51.655 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.655 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.655 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:30:51.655 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.371464+0000", 2021-10-08T19:30:51.656 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0024682150000000002 2021-10-08T19:30:51.656 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.656 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.656 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:51.656 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.565723+0000", 2021-10-08T19:30:51.657 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.19425885700000001 2021-10-08T19:30:51.657 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.657 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.657 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:51.657 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.565750+0000", 2021-10-08T19:30:51.658 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7707000000000001e-05 2021-10-08T19:30:51.658 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.658 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.658 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:30:51.659 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.565794+0000", 2021-10-08T19:30:51.659 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3130000000000002e-05 2021-10-08T19:30:51.659 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.659 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.659 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:30:51.660 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.566297+0000", 2021-10-08T19:30:51.660 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00050392299999999998 2021-10-08T19:30:51.660 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:30:51.660 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:30:51.660 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:30:51.661 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.661 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.661 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:58803 7.6 7:6c3d8546:::benchmark_data_smithi097_93198_object58802:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2021-10-08T19:30:51.661 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:38.366503+0000", 2021-10-08T19:30:51.661 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 372.17499588999999, 2021-10-08T19:30:51.662 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.199032767, 2021-10-08T19:30:51.662 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:30:51.662 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:30:51.662 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:30:51.663 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:30:51.663 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:30:51.663 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 58803 2021-10-08T19:30:51.663 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.663 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:30:51.664 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.664 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:30:51.664 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366503+0000", 2021-10-08T19:30:51.664 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:30:51.665 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.665 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.665 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:30:51.665 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366503+0000", 2021-10-08T19:30:51.665 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:30:51.666 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.666 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.666 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:30:51.666 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366502+0000", 2021-10-08T19:30:51.666 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:30:51.667 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.667 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.667 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:30:51.667 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366525+0000", 2021-10-08T19:30:51.668 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2897000000000001e-05 2021-10-08T19:30:51.668 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.668 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.668 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:30:51.668 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366536+0000", 2021-10-08T19:30:51.669 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0555e-05 2021-10-08T19:30:51.669 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.669 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.669 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:30:51.669 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366542+0000", 2021-10-08T19:30:51.670 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0209999999999996e-06 2021-10-08T19:30:51.670 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.670 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.670 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:30:51.670 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366581+0000", 2021-10-08T19:30:51.671 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9663999999999998e-05 2021-10-08T19:30:51.671 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.671 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.671 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:30:51.672 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366684+0000", 2021-10-08T19:30:51.672 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000103062 2021-10-08T19:30:51.672 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.672 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.672 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,7", 2021-10-08T19:30:51.673 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.366804+0000", 2021-10-08T19:30:51.673 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119678 2021-10-08T19:30:51.673 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.673 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.673 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:30:51.674 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.371438+0000", 2021-10-08T19:30:51.674 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0046337799999999997 2021-10-08T19:30:51.674 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.674 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.674 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:51.675 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.371728+0000", 2021-10-08T19:30:51.675 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00028967000000000001 2021-10-08T19:30:51.675 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.675 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.676 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:51.676 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.565451+0000", 2021-10-08T19:30:51.676 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.19372335500000001 2021-10-08T19:30:51.676 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.677 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.677 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:30:51.677 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.565497+0000", 2021-10-08T19:30:51.677 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6140000000000002e-05 2021-10-08T19:30:51.677 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.678 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.678 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:30:51.678 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.565536+0000", 2021-10-08T19:30:51.678 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9057999999999998e-05 2021-10-08T19:30:51.678 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:30:51.679 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:30:51.679 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:30:51.679 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.679 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.679 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop_reply(client.24796.0:58799 7.7 e120/113 ondisk, result = 0)", 2021-10-08T19:30:51.680 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:38.371986+0000", 2021-10-08T19:30:51.680 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 372.16951294199998, 2021-10-08T19:30:51.680 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.19556357799999999, 2021-10-08T19:30:51.680 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:30:51.680 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2021-10-08T19:30:51.681 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:30:51.681 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.681 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:30:51.681 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.371986+0000", 2021-10-08T19:30:51.682 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:30:51.682 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.682 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.682 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:30:51.682 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.371986+0000", 2021-10-08T19:30:51.683 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:30:51.683 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.683 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.683 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:30:51.683 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.371985+0000", 2021-10-08T19:30:51.684 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:30:51.684 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.684 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.684 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:30:51.684 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.371989+0000", 2021-10-08T19:30:51.685 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.326e-06 2021-10-08T19:30:51.685 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.685 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.685 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:30:51.685 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.565300+0000", 2021-10-08T19:30:51.686 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.19331092499999999 2021-10-08T19:30:51.686 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.686 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.686 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:30:51.687 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.565308+0000", 2021-10-08T19:30:51.687 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.439e-06 2021-10-08T19:30:51.687 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.687 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.687 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:30:51.688 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.565374+0000", 2021-10-08T19:30:51.688 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5622000000000003e-05 2021-10-08T19:30:51.688 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.688 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.689 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:30:51.689 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.565385+0000", 2021-10-08T19:30:51.689 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1272e-05 2021-10-08T19:30:51.689 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.690 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.690 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:30:51.690 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.567550+0000", 2021-10-08T19:30:51.690 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021648269999999998 2021-10-08T19:30:51.691 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:30:51.691 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:30:51.691 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:30:51.691 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.691 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.692 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.24796.0:58808 7.5 e120/94 7:a1085e60:::benchmark_data_smithi097_93198_object58807:head v 120'3752, mlcod=120'3750)", 2021-10-08T19:30:51.692 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:38.372268+0000", 2021-10-08T19:30:51.692 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 372.16923129499997, 2021-10-08T19:30:51.692 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.19919004200000001, 2021-10-08T19:30:51.692 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:30:51.693 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:30:51.693 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:30:51.693 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.693 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:30:51.693 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.372268+0000", 2021-10-08T19:30:51.694 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:30:51.694 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.694 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.694 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:30:51.694 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.372268+0000", 2021-10-08T19:30:51.695 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:30:51.695 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.695 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.695 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:30:51.696 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.372261+0000", 2021-10-08T19:30:51.696 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999928 2021-10-08T19:30:51.696 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.696 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.696 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:30:51.697 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.372386+0000", 2021-10-08T19:30:51.697 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000124898 2021-10-08T19:30:51.697 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.697 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.697 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:30:51.698 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.565295+0000", 2021-10-08T19:30:51.698 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.19290932 2021-10-08T19:30:51.698 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.698 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.698 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:30:51.699 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.565304+0000", 2021-10-08T19:30:51.699 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8680000000000005e-06 2021-10-08T19:30:51.699 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.699 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.699 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:30:51.700 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.565359+0000", 2021-10-08T19:30:51.700 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5398000000000001e-05 2021-10-08T19:30:51.700 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.700 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.701 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:30:51.701 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.565384+0000", 2021-10-08T19:30:51.701 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5082000000000001e-05 2021-10-08T19:30:51.701 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.702 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.702 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:30:51.702 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.571422+0000", 2021-10-08T19:30:51.702 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0060370750000000003 2021-10-08T19:30:51.702 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.703 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.703 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:30:51.703 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.571458+0000", 2021-10-08T19:30:51.703 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6412000000000003e-05 2021-10-08T19:30:51.703 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:30:51.704 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:30:51.704 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:30:51.704 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.704 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.705 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop_reply(client.24796.0:58798 7.4 e120/94 ondisk, result = 0)", 2021-10-08T19:30:51.705 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:38.373910+0000", 2021-10-08T19:30:51.705 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 372.16758927199999, 2021-10-08T19:30:51.705 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.19178235399999999, 2021-10-08T19:30:51.705 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:30:51.706 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2021-10-08T19:30:51.706 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:30:51.706 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.706 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:30:51.707 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.373910+0000", 2021-10-08T19:30:51.707 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:30:51.707 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.707 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.707 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:30:51.708 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.373910+0000", 2021-10-08T19:30:51.708 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:30:51.708 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.708 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.708 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:30:51.709 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.373909+0000", 2021-10-08T19:30:51.709 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2021-10-08T19:30:51.709 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.709 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.710 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:30:51.710 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.373914+0000", 2021-10-08T19:30:51.710 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4750000000000001e-06 2021-10-08T19:30:51.710 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.710 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.711 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:30:51.711 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.565255+0000", 2021-10-08T19:30:51.711 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.19134111600000001 2021-10-08T19:30:51.711 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.712 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.712 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:30:51.712 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.565298+0000", 2021-10-08T19:30:51.712 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2929999999999997e-05 2021-10-08T19:30:51.713 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.713 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.713 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:30:51.713 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.565580+0000", 2021-10-08T19:30:51.713 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00028223400000000002 2021-10-08T19:30:51.714 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.714 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.714 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:30:51.714 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.565589+0000", 2021-10-08T19:30:51.715 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5150000000000006e-06 2021-10-08T19:30:51.715 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.715 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.715 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:30:51.715 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:38.565692+0000", 2021-10-08T19:30:51.716 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010337500000000001 2021-10-08T19:30:51.716 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:30:51.716 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:30:51.716 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:30:51.716 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.717 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.717 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:161973 7.4 7:2d96b882:::benchmark_data_smithi097_93198_object70153:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158)", 2021-10-08T19:30:51.717 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:26:58.326199+0000", 2021-10-08T19:30:51.717 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 232.215300716, 2021-10-08T19:30:51.717 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.21778922100000001, 2021-10-08T19:30:51.718 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:30:51.718 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:30:51.718 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:30:51.718 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:30:51.719 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:30:51.719 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 161973 2021-10-08T19:30:51.719 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.719 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:30:51.719 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.720 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:30:51.720 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.326199+0000", 2021-10-08T19:30:51.720 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:30:51.720 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.720 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.721 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:30:51.721 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.326199+0000", 2021-10-08T19:30:51.721 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:30:51.721 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.721 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.722 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:30:51.722 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.326197+0000", 2021-10-08T19:30:51.722 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:30:51.722 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.723 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.723 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:30:51.723 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.326203+0000", 2021-10-08T19:30:51.723 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1809999999999998e-06 2021-10-08T19:30:51.723 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.724 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.724 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:30:51.724 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.326214+0000", 2021-10-08T19:30:51.724 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1503e-05 2021-10-08T19:30:51.725 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.725 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.725 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:30:51.725 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.326221+0000", 2021-10-08T19:30:51.725 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3620000000000002e-06 2021-10-08T19:30:51.726 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.726 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.726 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:30:51.726 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.326275+0000", 2021-10-08T19:30:51.726 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4481999999999998e-05 2021-10-08T19:30:51.727 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.727 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.727 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:30:51.727 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.326383+0000", 2021-10-08T19:30:51.727 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010808599999999999 2021-10-08T19:30:51.728 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.728 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.728 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:30:51.728 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.326491+0000", 2021-10-08T19:30:51.729 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000108179 2021-10-08T19:30:51.729 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.729 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.729 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:51.729 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.332151+0000", 2021-10-08T19:30:51.730 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0056596270000000004 2021-10-08T19:30:51.730 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.730 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.730 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:30:51.730 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.333565+0000", 2021-10-08T19:30:51.731 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0014136470000000001 2021-10-08T19:30:51.731 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.731 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.731 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:51.732 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.543895+0000", 2021-10-08T19:30:51.732 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.21033058700000001 2021-10-08T19:30:51.732 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.732 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.732 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:30:51.733 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.543948+0000", 2021-10-08T19:30:51.733 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3049e-05 2021-10-08T19:30:51.733 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.733 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.733 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:30:51.734 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.543988+0000", 2021-10-08T19:30:51.734 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9496000000000003e-05 2021-10-08T19:30:51.734 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:30:51.734 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:30:51.734 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:30:51.735 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.735 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.735 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:161980 7.9 7:9db1918e:::benchmark_data_smithi097_93198_object70160:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158)", 2021-10-08T19:30:51.735 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:26:58.335982+0000", 2021-10-08T19:30:51.735 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 232.20551675900001, 2021-10-08T19:30:51.736 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.21682858699999999, 2021-10-08T19:30:51.736 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:30:51.736 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:30:51.736 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:30:51.737 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:30:51.737 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:30:51.737 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 161980 2021-10-08T19:30:51.738 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.738 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:30:51.738 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.738 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:30:51.738 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.335982+0000", 2021-10-08T19:30:51.739 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:30:51.739 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.739 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.739 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:30:51.739 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.335982+0000", 2021-10-08T19:30:51.740 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:30:51.740 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.740 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.740 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:30:51.740 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.335982+0000", 2021-10-08T19:30:51.741 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:30:51.741 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.741 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.741 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:30:51.742 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.335986+0000", 2021-10-08T19:30:51.742 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9890000000000003e-06 2021-10-08T19:30:51.742 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.742 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.742 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:30:51.743 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.335994+0000", 2021-10-08T19:30:51.743 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2369999999999992e-06 2021-10-08T19:30:51.743 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.743 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.743 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:30:51.744 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.335998+0000", 2021-10-08T19:30:51.744 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4819999999999996e-06 2021-10-08T19:30:51.744 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.744 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.745 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:30:51.745 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.336082+0000", 2021-10-08T19:30:51.745 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4211999999999999e-05 2021-10-08T19:30:51.745 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.745 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.746 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:30:51.746 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.336229+0000", 2021-10-08T19:30:51.746 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014613300000000001 2021-10-08T19:30:51.746 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.746 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.747 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:30:51.747 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.336358+0000", 2021-10-08T19:30:51.747 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000128892 2021-10-08T19:30:51.747 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.747 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.748 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:51.748 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.341692+0000", 2021-10-08T19:30:51.748 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0053348989999999997 2021-10-08T19:30:51.748 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.748 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.749 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:30:51.749 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.342367+0000", 2021-10-08T19:30:51.749 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00067464900000000004 2021-10-08T19:30:51.749 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.750 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.750 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:51.750 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.552730+0000", 2021-10-08T19:30:51.750 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.21036318100000001 2021-10-08T19:30:51.750 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.751 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.751 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:30:51.751 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.552775+0000", 2021-10-08T19:30:51.751 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4768000000000002e-05 2021-10-08T19:30:51.752 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.752 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.752 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:30:51.752 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.552811+0000", 2021-10-08T19:30:51.752 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6044999999999998e-05 2021-10-08T19:30:51.753 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:30:51.753 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:30:51.753 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:30:51.753 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.753 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.754 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:161985 7.4 7:226c67e6:::benchmark_data_smithi097_93198_object70165:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158)", 2021-10-08T19:30:51.754 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:26:58.341548+0000", 2021-10-08T19:30:51.754 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 232.199951212, 2021-10-08T19:30:51.754 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.20250479900000001, 2021-10-08T19:30:51.754 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:30:51.755 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:30:51.755 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:30:51.755 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:30:51.755 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:30:51.755 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 161985 2021-10-08T19:30:51.756 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.756 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:30:51.756 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.756 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:30:51.757 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.341548+0000", 2021-10-08T19:30:51.757 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:30:51.757 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.757 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.757 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:30:51.758 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.341548+0000", 2021-10-08T19:30:51.758 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:30:51.758 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.758 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.758 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:30:51.759 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.341546+0000", 2021-10-08T19:30:51.759 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:30:51.759 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.759 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.759 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:30:51.760 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.341552+0000", 2021-10-08T19:30:51.760 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1700000000000002e-06 2021-10-08T19:30:51.760 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.760 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.761 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:30:51.761 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.341561+0000", 2021-10-08T19:30:51.761 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.3149999999999998e-06 2021-10-08T19:30:51.761 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.761 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.762 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:30:51.762 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.341568+0000", 2021-10-08T19:30:51.762 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5300000000000002e-06 2021-10-08T19:30:51.762 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.763 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.763 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:30:51.763 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.341755+0000", 2021-10-08T19:30:51.763 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00018718900000000001 2021-10-08T19:30:51.763 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.764 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.764 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:30:51.764 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.341879+0000", 2021-10-08T19:30:51.764 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012378399999999999 2021-10-08T19:30:51.764 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.765 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.765 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:30:51.765 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.342009+0000", 2021-10-08T19:30:51.765 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013071900000000001 2021-10-08T19:30:51.765 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.766 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.766 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:30:51.766 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.346624+0000", 2021-10-08T19:30:51.766 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0046141940000000003 2021-10-08T19:30:51.766 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.767 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.767 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:51.767 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.347710+0000", 2021-10-08T19:30:51.767 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010865930000000001 2021-10-08T19:30:51.768 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.768 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.768 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:51.768 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.544012+0000", 2021-10-08T19:30:51.768 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.19630222899999999 2021-10-08T19:30:51.769 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.769 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.769 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:30:51.769 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.544034+0000", 2021-10-08T19:30:51.769 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1889e-05 2021-10-08T19:30:51.770 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.770 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.770 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:30:51.770 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.544053+0000", 2021-10-08T19:30:51.771 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8434e-05 2021-10-08T19:30:51.771 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:30:51.771 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:30:51.771 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:30:51.772 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.772 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.772 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:162001 7.4 7:2e64aea9:::benchmark_data_smithi097_93198_object70181:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158)", 2021-10-08T19:30:51.772 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:26:58.364398+0000", 2021-10-08T19:30:51.773 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 232.17710084999999, 2021-10-08T19:30:51.773 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.179738852, 2021-10-08T19:30:51.773 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:30:51.774 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:30:51.774 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:30:51.774 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:30:51.774 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:30:51.775 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 162001 2021-10-08T19:30:51.775 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.775 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:30:51.775 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.776 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:30:51.776 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.364398+0000", 2021-10-08T19:30:51.776 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:30:51.776 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.776 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.777 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:30:51.777 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.364398+0000", 2021-10-08T19:30:51.777 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:30:51.777 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.777 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.778 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:30:51.778 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.364396+0000", 2021-10-08T19:30:51.778 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:30:51.778 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.779 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.779 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:30:51.779 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.364404+0000", 2021-10-08T19:30:51.779 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5339999999999999e-06 2021-10-08T19:30:51.779 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.780 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.780 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:30:51.780 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.364418+0000", 2021-10-08T19:30:51.780 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3981999999999999e-05 2021-10-08T19:30:51.781 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.781 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.781 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:30:51.781 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.364425+0000", 2021-10-08T19:30:51.781 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9349999999999997e-06 2021-10-08T19:30:51.782 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.782 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.782 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:30:51.782 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.367210+0000", 2021-10-08T19:30:51.782 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0027843989999999999 2021-10-08T19:30:51.783 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.783 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.783 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:30:51.783 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.367346+0000", 2021-10-08T19:30:51.783 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013590400000000001 2021-10-08T19:30:51.784 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.784 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.784 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:30:51.784 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.367483+0000", 2021-10-08T19:30:51.784 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000137248 2021-10-08T19:30:51.785 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.785 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.785 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:30:51.786 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.370476+0000", 2021-10-08T19:30:51.786 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029933270000000001 2021-10-08T19:30:51.786 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.786 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.786 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:51.787 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.373469+0000", 2021-10-08T19:30:51.787 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029926459999999998 2021-10-08T19:30:51.787 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.787 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.788 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:51.788 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.544071+0000", 2021-10-08T19:30:51.788 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.170602163 2021-10-08T19:30:51.788 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.788 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.789 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:30:51.789 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.544103+0000", 2021-10-08T19:30:51.789 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2533999999999997e-05 2021-10-08T19:30:51.789 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.789 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.790 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:30:51.790 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.544137+0000", 2021-10-08T19:30:51.790 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3757000000000002e-05 2021-10-08T19:30:51.790 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:30:51.791 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:30:51.791 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:30:51.791 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.791 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.791 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:162004 7.9 7:997b1e32:::benchmark_data_smithi097_93198_object70184:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158)", 2021-10-08T19:30:51.792 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:26:58.374192+0000", 2021-10-08T19:30:51.792 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 232.167307515, 2021-10-08T19:30:51.792 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.179180532, 2021-10-08T19:30:51.792 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:30:51.792 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:30:51.793 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:30:51.793 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:30:51.793 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:30:51.793 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 162004 2021-10-08T19:30:51.794 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.794 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:30:51.794 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.794 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:30:51.794 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.374192+0000", 2021-10-08T19:30:51.795 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:30:51.795 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.795 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.795 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:30:51.795 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.374192+0000", 2021-10-08T19:30:51.796 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:30:51.796 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.796 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.796 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:30:51.797 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.374189+0000", 2021-10-08T19:30:51.797 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:30:51.797 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.797 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.797 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:30:51.798 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.374197+0000", 2021-10-08T19:30:51.798 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.9959999999999993e-06 2021-10-08T19:30:51.798 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.798 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.799 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:30:51.799 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.374214+0000", 2021-10-08T19:30:51.799 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6602000000000001e-05 2021-10-08T19:30:51.799 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.799 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.800 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:30:51.800 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.374221+0000", 2021-10-08T19:30:51.800 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8090000000000004e-06 2021-10-08T19:30:51.800 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.801 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.801 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:30:51.801 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.374269+0000", 2021-10-08T19:30:51.801 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8052e-05 2021-10-08T19:30:51.801 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.802 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.802 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:30:51.802 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.374390+0000", 2021-10-08T19:30:51.802 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000121067 2021-10-08T19:30:51.803 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.803 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.803 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:30:51.803 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.374515+0000", 2021-10-08T19:30:51.803 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000125007 2021-10-08T19:30:51.804 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.804 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.804 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:51.804 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.378085+0000", 2021-10-08T19:30:51.804 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0035697390000000002 2021-10-08T19:30:51.805 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.805 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.805 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:30:51.805 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.381180+0000", 2021-10-08T19:30:51.805 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030952570000000001 2021-10-08T19:30:51.806 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.806 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.806 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:51.806 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.553292+0000", 2021-10-08T19:30:51.806 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.17211222300000001 2021-10-08T19:30:51.807 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.807 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.807 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:30:51.807 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.553337+0000", 2021-10-08T19:30:51.808 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4719000000000003e-05 2021-10-08T19:30:51.808 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.808 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.808 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:30:51.808 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.553372+0000", 2021-10-08T19:30:51.809 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5419000000000001e-05 2021-10-08T19:30:51.809 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:30:51.809 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:30:51.809 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:30:51.809 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.810 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.810 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:162010 7.9 7:9e6d2cdb:::benchmark_data_smithi097_93198_object70190:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158)", 2021-10-08T19:30:51.810 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:26:58.381914+0000", 2021-10-08T19:30:51.810 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 232.15958526599999, 2021-10-08T19:30:51.811 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.171612248, 2021-10-08T19:30:51.811 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:30:51.811 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:30:51.811 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:30:51.812 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:30:51.812 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:30:51.812 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 162010 2021-10-08T19:30:51.812 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.812 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:30:51.813 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.813 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:30:51.813 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.381914+0000", 2021-10-08T19:30:51.813 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:30:51.813 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.814 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.814 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:30:51.814 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.381914+0000", 2021-10-08T19:30:51.814 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:30:51.815 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.815 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.815 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:30:51.815 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.381912+0000", 2021-10-08T19:30:51.815 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:30:51.816 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.816 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.816 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:30:51.816 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.381919+0000", 2021-10-08T19:30:51.817 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6189999999999996e-06 2021-10-08T19:30:51.817 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.817 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.817 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:30:51.817 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.381931+0000", 2021-10-08T19:30:51.818 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1938e-05 2021-10-08T19:30:51.818 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.818 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.818 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:30:51.818 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.381938+0000", 2021-10-08T19:30:51.819 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0539999999999997e-06 2021-10-08T19:30:51.819 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.819 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.819 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:30:51.819 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.381989+0000", 2021-10-08T19:30:51.820 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1708e-05 2021-10-08T19:30:51.820 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.820 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.820 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:30:51.820 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.382149+0000", 2021-10-08T19:30:51.821 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015935499999999999 2021-10-08T19:30:51.821 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.821 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.821 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:30:51.821 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.382296+0000", 2021-10-08T19:30:51.822 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000146945 2021-10-08T19:30:51.822 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.822 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.822 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:51.823 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.386168+0000", 2021-10-08T19:30:51.823 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038718289999999998 2021-10-08T19:30:51.823 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.823 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.824 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:30:51.824 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.389471+0000", 2021-10-08T19:30:51.824 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033030009999999999 2021-10-08T19:30:51.824 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.824 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.825 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:51.825 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.553454+0000", 2021-10-08T19:30:51.825 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.163983345 2021-10-08T19:30:51.825 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.825 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.826 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:30:51.826 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.553493+0000", 2021-10-08T19:30:51.826 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8921000000000002e-05 2021-10-08T19:30:51.826 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.827 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.827 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:30:51.827 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.553526+0000", 2021-10-08T19:30:51.827 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3432000000000001e-05 2021-10-08T19:30:51.827 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:30:51.828 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:30:51.828 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:30:51.828 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.828 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.828 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:162011 7.9 7:9ad7ada8:::benchmark_data_smithi097_93198_object70191:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158)", 2021-10-08T19:30:51.829 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:26:58.385988+0000", 2021-10-08T19:30:51.829 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 232.15551101, 2021-10-08T19:30:51.829 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.170430832, 2021-10-08T19:30:51.829 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:30:51.829 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:30:51.830 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:30:51.830 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:30:51.830 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:30:51.830 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 162011 2021-10-08T19:30:51.831 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.831 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:30:51.831 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.831 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:30:51.831 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.385988+0000", 2021-10-08T19:30:51.832 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:30:51.832 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.832 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.832 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:30:51.832 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.385988+0000", 2021-10-08T19:30:51.833 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:30:51.833 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.833 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.833 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:30:51.833 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.385986+0000", 2021-10-08T19:30:51.834 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:30:51.834 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.834 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.834 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:30:51.835 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.385995+0000", 2021-10-08T19:30:51.835 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.1190000000000003e-06 2021-10-08T19:30:51.835 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.835 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.835 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:30:51.836 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.386012+0000", 2021-10-08T19:30:51.836 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6677999999999999e-05 2021-10-08T19:30:51.836 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.836 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.837 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:30:51.837 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.386019+0000", 2021-10-08T19:30:51.837 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5020000000000003e-06 2021-10-08T19:30:51.837 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.838 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.838 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:30:51.838 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.386190+0000", 2021-10-08T19:30:51.838 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017105000000000001 2021-10-08T19:30:51.838 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.839 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.839 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:30:51.839 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.386346+0000", 2021-10-08T19:30:51.839 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015542400000000001 2021-10-08T19:30:51.840 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.840 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.840 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:30:51.840 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.386498+0000", 2021-10-08T19:30:51.840 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000152239 2021-10-08T19:30:51.841 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.841 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.841 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:51.841 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.389429+0000", 2021-10-08T19:30:51.842 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029315080000000002 2021-10-08T19:30:51.842 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.842 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.842 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:30:51.842 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.389519+0000", 2021-10-08T19:30:51.843 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9259999999999996e-05 2021-10-08T19:30:51.843 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.843 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.843 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:51.843 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.556337+0000", 2021-10-08T19:30:51.844 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.16681812900000001 2021-10-08T19:30:51.844 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.844 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.844 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:30:51.845 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.556380+0000", 2021-10-08T19:30:51.845 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3615000000000002e-05 2021-10-08T19:30:51.845 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.845 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.845 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:30:51.846 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.556419+0000", 2021-10-08T19:30:51.846 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8756e-05 2021-10-08T19:30:51.846 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:30:51.846 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:30:51.847 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:30:51.847 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.847 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.847 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:95878 8.c 8:3e268961:::benchmark_data_smithi097_144160_object7138:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e227)", 2021-10-08T19:30:51.847 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:29.708862+0000", 2021-10-08T19:30:51.848 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 80.832636980999993, 2021-10-08T19:30:51.848 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0215476309999998, 2021-10-08T19:30:51.848 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:30:51.848 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "reached pg", 2021-10-08T19:30:51.849 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:30:51.849 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:30:51.849 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:30:51.849 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 95878 2021-10-08T19:30:51.849 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.850 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:30:51.850 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.850 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:30:51.850 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.708862+0000", 2021-10-08T19:30:51.850 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:30:51.851 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.851 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.851 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:30:51.851 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.708862+0000", 2021-10-08T19:30:51.852 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:30:51.852 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.852 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.852 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:30:51.852 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.708860+0000", 2021-10-08T19:30:51.853 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:30:51.853 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.853 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.853 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:30:51.853 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.708867+0000", 2021-10-08T19:30:51.854 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3989999999999998e-06 2021-10-08T19:30:51.854 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.854 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.854 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:30:51.855 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.708879+0000", 2021-10-08T19:30:51.855 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1596999999999999e-05 2021-10-08T19:30:51.855 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.855 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.855 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:30:51.856 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.708886+0000", 2021-10-08T19:30:51.856 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6329999999999999e-06 2021-10-08T19:30:51.856 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.856 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.857 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:30:51.857 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.709040+0000", 2021-10-08T19:30:51.857 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000154165 2021-10-08T19:30:51.857 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.857 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.858 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:30:51.858 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.709175+0000", 2021-10-08T19:30:51.858 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013537799999999999 2021-10-08T19:30:51.858 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.859 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.859 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,7", 2021-10-08T19:30:51.859 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.709298+0000", 2021-10-08T19:30:51.859 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012234999999999999 2021-10-08T19:30:51.859 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.860 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.860 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:30:51.860 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.714212+0000", 2021-10-08T19:30:51.860 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0049148669999999998 2021-10-08T19:30:51.860 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.861 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.861 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:51.861 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.719125+0000", 2021-10-08T19:30:51.861 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0049129270000000001 2021-10-08T19:30:51.861 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.862 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.862 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:30:51.862 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.776199+0000", 2021-10-08T19:30:51.862 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.057073696 2021-10-08T19:30:51.863 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.863 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.863 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:30:51.863 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.776205+0000", 2021-10-08T19:30:51.863 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3600000000000001e-06 2021-10-08T19:30:51.864 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.864 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.864 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:30:51.864 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:30.603441+0000", 2021-10-08T19:30:51.864 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.82723589799999997 2021-10-08T19:30:51.865 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.865 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.865 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:30:51.865 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:30.603450+0000", 2021-10-08T19:30:51.866 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9970000000000004e-06 2021-10-08T19:30:51.866 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.866 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.866 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:30:51.866 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.711819+0000", 2021-10-08T19:30:51.867 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.108368746 2021-10-08T19:30:51.867 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.867 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.867 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for missing object", 2021-10-08T19:30:51.867 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.711960+0000", 2021-10-08T19:30:51.868 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000140827 2021-10-08T19:30:51.868 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.868 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.868 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:30:51.868 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.730339+0000", 2021-10-08T19:30:51.869 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.018379296 2021-10-08T19:30:51.869 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.869 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.869 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:30:51.869 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.730410+0000", 2021-10-08T19:30:51.870 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0765000000000004e-05 2021-10-08T19:30:51.870 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:30:51.870 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:30:51.870 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:30:51.871 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.871 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.871 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:95908 8.c 8:369db9f4:::benchmark_data_smithi097_144160_object7168:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e228)", 2021-10-08T19:30:51.871 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:29.787345+0000", 2021-10-08T19:30:51.872 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 80.754154650000004, 2021-10-08T19:30:51.872 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.94171282, 2021-10-08T19:30:51.872 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:30:51.872 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:30:51.872 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:30:51.873 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:30:51.873 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:30:51.873 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 95908 2021-10-08T19:30:51.873 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.873 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:30:51.874 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.874 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:30:51.874 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.787345+0000", 2021-10-08T19:30:51.874 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:30:51.875 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.875 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.875 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:30:51.875 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.787345+0000", 2021-10-08T19:30:51.875 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:30:51.876 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.876 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.876 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:30:51.876 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.787342+0000", 2021-10-08T19:30:51.877 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:30:51.877 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.877 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.877 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:30:51.877 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.787350+0000", 2021-10-08T19:30:51.878 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.909e-06 2021-10-08T19:30:51.878 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.878 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.878 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:30:51.879 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.787365+0000", 2021-10-08T19:30:51.879 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5223e-05 2021-10-08T19:30:51.879 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.879 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.879 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:30:51.880 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.787372+0000", 2021-10-08T19:30:51.880 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0010000000000004e-06 2021-10-08T19:30:51.880 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.880 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.880 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:30:51.881 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.787418+0000", 2021-10-08T19:30:51.881 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5334000000000003e-05 2021-10-08T19:30:51.881 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.881 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.882 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:30:51.882 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.787425+0000", 2021-10-08T19:30:51.882 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.255e-06 2021-10-08T19:30:51.882 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.882 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.883 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:30:51.883 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:30.603471+0000", 2021-10-08T19:30:51.883 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.81604612899999995 2021-10-08T19:30:51.883 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.884 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.884 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:30:51.884 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:30.603477+0000", 2021-10-08T19:30:51.884 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5500000000000002e-06 2021-10-08T19:30:51.884 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.885 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.885 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:30:51.885 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.712237+0000", 2021-10-08T19:30:51.885 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1087600710000001 2021-10-08T19:30:51.885 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.886 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.886 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:30:51.886 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.712323+0000", 2021-10-08T19:30:51.886 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6013999999999993e-05 2021-10-08T19:30:51.887 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.887 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.887 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,5,7", 2021-10-08T19:30:51.887 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.712639+0000", 2021-10-08T19:30:51.887 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031625499999999999 2021-10-08T19:30:51.888 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.888 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.888 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:30:51.888 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.719902+0000", 2021-10-08T19:30:51.888 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0072627710000000003 2021-10-08T19:30:51.889 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.889 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.889 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:51.889 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.720064+0000", 2021-10-08T19:30:51.889 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016218999999999999 2021-10-08T19:30:51.890 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.890 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.890 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:51.890 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.722758+0000", 2021-10-08T19:30:51.891 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00269367 2021-10-08T19:30:51.891 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.891 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.891 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:51.891 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.728832+0000", 2021-10-08T19:30:51.892 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0060743510000000004 2021-10-08T19:30:51.892 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.892 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.892 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:30:51.892 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.728900+0000", 2021-10-08T19:30:51.893 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7603999999999999e-05 2021-10-08T19:30:51.893 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.893 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.893 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:30:51.893 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.729057+0000", 2021-10-08T19:30:51.894 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000157708 2021-10-08T19:30:51.894 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:30:51.894 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:30:51.894 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:30:51.894 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.895 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.895 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:95914 8.c 8:36c7e6f1:::benchmark_data_smithi097_144160_object7174:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e228)", 2021-10-08T19:30:51.895 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:29.793186+0000", 2021-10-08T19:30:51.895 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 80.748313413999995, 2021-10-08T19:30:51.896 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.936144155, 2021-10-08T19:30:51.896 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:30:51.896 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:30:51.896 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:30:51.897 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:30:51.897 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:30:51.897 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 95914 2021-10-08T19:30:51.897 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.897 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:30:51.898 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.898 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:30:51.898 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.793186+0000", 2021-10-08T19:30:51.898 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:30:51.898 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.899 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.899 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:30:51.899 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.793186+0000", 2021-10-08T19:30:51.899 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:30:51.899 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.900 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.900 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:30:51.900 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.793184+0000", 2021-10-08T19:30:51.900 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:30:51.901 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.901 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.901 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:30:51.901 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.793190+0000", 2021-10-08T19:30:51.901 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.674e-06 2021-10-08T19:30:51.902 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.902 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.902 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:30:51.902 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.793205+0000", 2021-10-08T19:30:51.902 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4525999999999999e-05 2021-10-08T19:30:51.903 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.903 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.903 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:30:51.903 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.793213+0000", 2021-10-08T19:30:51.903 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4549999999999995e-06 2021-10-08T19:30:51.904 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.904 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.904 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:30:51.904 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.793263+0000", 2021-10-08T19:30:51.904 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.003e-05 2021-10-08T19:30:51.905 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.905 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.905 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:30:51.905 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.793272+0000", 2021-10-08T19:30:51.906 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.602e-06 2021-10-08T19:30:51.906 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.906 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.906 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:30:51.906 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:30.603493+0000", 2021-10-08T19:30:51.907 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.81022135200000001 2021-10-08T19:30:51.907 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.907 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.907 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:30:51.908 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:30.603499+0000", 2021-10-08T19:30:51.908 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7610000000000004e-06 2021-10-08T19:30:51.908 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.908 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.908 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:30:51.909 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.716324+0000", 2021-10-08T19:30:51.909 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.112824788 2021-10-08T19:30:51.909 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.909 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.910 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:30:51.910 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.716431+0000", 2021-10-08T19:30:51.910 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010764000000000001 2021-10-08T19:30:51.910 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.910 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.911 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,5,7", 2021-10-08T19:30:51.911 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.716514+0000", 2021-10-08T19:30:51.911 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2886999999999994e-05 2021-10-08T19:30:51.911 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.912 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.912 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:51.912 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.720153+0000", 2021-10-08T19:30:51.912 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0036386349999999999 2021-10-08T19:30:51.912 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.913 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.913 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:30:51.913 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.722770+0000", 2021-10-08T19:30:51.913 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002616878 2021-10-08T19:30:51.913 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.914 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.914 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:51.914 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.727179+0000", 2021-10-08T19:30:51.914 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0044094709999999999 2021-10-08T19:30:51.915 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.915 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.915 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:51.915 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.729124+0000", 2021-10-08T19:30:51.915 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0019448969999999999 2021-10-08T19:30:51.916 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.916 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.916 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:30:51.916 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.729190+0000", 2021-10-08T19:30:51.916 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5302000000000006e-05 2021-10-08T19:30:51.917 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.917 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.917 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:30:51.917 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.729330+0000", 2021-10-08T19:30:51.918 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000140464 2021-10-08T19:30:51.918 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:30:51.918 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:30:51.918 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:30:51.918 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.919 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.919 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:95923 8.c 8:34256d31:::benchmark_data_smithi097_144160_object7183:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e228)", 2021-10-08T19:30:51.919 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:29.812115+0000", 2021-10-08T19:30:51.919 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 80.729384551999999, 2021-10-08T19:30:51.920 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9176770869999999, 2021-10-08T19:30:51.920 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:30:51.920 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:30:51.920 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:30:51.920 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:30:51.921 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:30:51.921 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 95923 2021-10-08T19:30:51.921 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.921 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:30:51.922 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.922 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:30:51.922 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.812115+0000", 2021-10-08T19:30:51.922 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:30:51.922 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.923 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.923 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:30:51.923 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.812115+0000", 2021-10-08T19:30:51.923 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:30:51.923 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.924 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.924 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:30:51.924 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.812112+0000", 2021-10-08T19:30:51.924 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:30:51.924 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.925 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.925 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:30:51.925 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.812120+0000", 2021-10-08T19:30:51.925 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1450000000000008e-06 2021-10-08T19:30:51.926 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.926 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.926 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:30:51.926 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.812136+0000", 2021-10-08T19:30:51.926 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5447999999999998e-05 2021-10-08T19:30:51.927 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.927 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.927 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:30:51.927 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.812142+0000", 2021-10-08T19:30:51.927 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4969999999999998e-06 2021-10-08T19:30:51.928 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.928 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.928 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:30:51.928 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.812185+0000", 2021-10-08T19:30:51.928 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2920999999999998e-05 2021-10-08T19:30:51.929 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.929 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.929 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:30:51.929 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.812192+0000", 2021-10-08T19:30:51.929 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.703e-06 2021-10-08T19:30:51.930 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.930 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.930 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:30:51.930 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:30.603516+0000", 2021-10-08T19:30:51.931 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.79132443600000002 2021-10-08T19:30:51.931 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.931 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.931 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:30:51.931 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:30.603522+0000", 2021-10-08T19:30:51.932 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.755e-06 2021-10-08T19:30:51.932 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.932 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.932 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:30:51.933 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.717936+0000", 2021-10-08T19:30:51.933 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1144141670000001 2021-10-08T19:30:51.933 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.933 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.933 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:30:51.934 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.718079+0000", 2021-10-08T19:30:51.934 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000143146 2021-10-08T19:30:51.934 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.934 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.935 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,5,7", 2021-10-08T19:30:51.935 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.718167+0000", 2021-10-08T19:30:51.935 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7744000000000006e-05 2021-10-08T19:30:51.935 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.935 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.936 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:51.936 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.722739+0000", 2021-10-08T19:30:51.936 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.004571777 2021-10-08T19:30:51.936 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.936 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.937 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:30:51.937 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.722774+0000", 2021-10-08T19:30:51.937 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4669999999999998e-05 2021-10-08T19:30:51.937 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.938 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.938 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:51.938 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.727236+0000", 2021-10-08T19:30:51.938 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0044624249999999999 2021-10-08T19:30:51.938 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.939 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.939 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:30:51.939 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.729619+0000", 2021-10-08T19:30:51.940 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0023831740000000001 2021-10-08T19:30:51.940 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.940 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.940 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:30:51.941 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.729681+0000", 2021-10-08T19:30:51.941 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1555000000000003e-05 2021-10-08T19:30:51.941 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:30:51.941 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:30:51.941 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:30:51.942 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.729792+0000", 2021-10-08T19:30:51.942 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000110925 2021-10-08T19:30:51.942 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:30:51.942 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:30:51.942 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:30:51.943 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:30:51.943 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:30:51.943 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:30:51.944 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:51 smithi117 ceph-mon[34585]: osdmap e266: 8 total, 8 up, 8 in 2021-10-08T19:30:51.944 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:51 smithi117 ceph-mon[34585]: pgmap v470: 178 pgs: 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 174 active+clean; 1.6 GiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 790 op/s; 3732/77526 objects misplaced (4.814%); 12 MiB/s, 188 objects/s recovering 2021-10-08T19:30:51.945 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:51.945 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:30:51.946 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:30:51.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:51 smithi097 ceph-mon[32687]: osdmap e266: 8 total, 8 up, 8 in 2021-10-08T19:30:51.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:51 smithi097 ceph-mon[32687]: pgmap v470: 178 pgs: 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 174 active+clean; 1.6 GiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 790 op/s; 3732/77526 objects misplaced (4.814%); 12 MiB/s, 188 objects/s recovering 2021-10-08T19:30:51.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:51 smithi097 ceph-mon[41966]: osdmap e266: 8 total, 8 up, 8 in 2021-10-08T19:30:51.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:51 smithi097 ceph-mon[41966]: pgmap v470: 178 pgs: 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 174 active+clean; 1.6 GiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 790 op/s; 3732/77526 objects misplaced (4.814%); 12 MiB/s, 188 objects/s recovering 2021-10-08T19:30:52.035 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:30:52.047 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:30:52.073 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:52.695 INFO:journalctl@ceph.osd.1.smithi097.stdout:Oct 08 19:30:52 smithi097 conmon[51607]: 2021-10-08T19:30:52.411+0000 7f6f2002b700 -1 osd.1 pg_epoch: 267 pg[2.a( empty local-lis/les=236/237 n=0 ec=60/60 lis/c=236/236 les/c/f=237/237/0 sis=236) [1,3,7] r=0 lpr=236 crt=0'0 mlcod 0'0 active+clean] scrubber pg(2.a) handle_scrub_reserve_grant: received unsolicited reservation grant from osd 7 (0x561524065080) 2021-10-08T19:30:52.695 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:52 smithi097 ceph-mon[32687]: 3.14 scrub ok 2021-10-08T19:30:52.696 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:52 smithi097 ceph-mon[32687]: 6.6 scrub ok 2021-10-08T19:30:52.696 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:52 smithi097 ceph-mon[32687]: osdmap e267: 8 total, 8 up, 8 in 2021-10-08T19:30:52.696 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:52 smithi097 ceph-mon[32687]: 4.a scrub ok 2021-10-08T19:30:52.697 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:52 smithi097 ceph-mon[41966]: 3.14 scrub ok 2021-10-08T19:30:52.697 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:52 smithi097 ceph-mon[41966]: 6.6 scrub ok 2021-10-08T19:30:52.697 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:52 smithi097 ceph-mon[41966]: osdmap e267: 8 total, 8 up, 8 in 2021-10-08T19:30:52.697 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:52 smithi097 ceph-mon[41966]: 4.a scrub ok 2021-10-08T19:30:52.698 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:30:52 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:30:52] "GET /metrics HTTP/1.1" 200 155903 "" "Prometheus/2.18.1" 2021-10-08T19:30:52.736 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2021-10-08T19:30:52.927 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:30:52.947 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:52.948 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:30:53.049 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:30:53.121 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:53.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:52 smithi117 ceph-mon[34585]: 3.14 scrub ok 2021-10-08T19:30:53.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:52 smithi117 ceph-mon[34585]: 6.6 scrub ok 2021-10-08T19:30:53.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:52 smithi117 ceph-mon[34585]: osdmap e267: 8 total, 8 up, 8 in 2021-10-08T19:30:53.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:52 smithi117 ceph-mon[34585]: 4.a scrub ok 2021-10-08T19:30:53.443 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:30:53.444 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:30:53.449 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:53.450 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:30:53.551 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:30:53.597 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:53.686 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:30:53.687 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.0 to 1 (10000) 2021-10-08T19:30:53.694 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:53.695 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:30:53.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:53 smithi097 ceph-mon[32687]: 1.0 scrub ok 2021-10-08T19:30:53.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:53 smithi097 ceph-mon[32687]: osdmap e268: 8 total, 8 up, 8 in 2021-10-08T19:30:53.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:53 smithi097 ceph-mon[32687]: pgmap v473: 178 pgs: 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 174 active+clean; 1.6 GiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 0 B/s wr, 739 op/s; 3732/77526 objects misplaced (4.814%); 7.5 MiB/s, 120 objects/s recovering 2021-10-08T19:30:53.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:53 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/4212057555' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2021-10-08T19:30:53.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:53 smithi097 ceph-mon[41966]: 1.0 scrub ok 2021-10-08T19:30:53.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:53 smithi097 ceph-mon[41966]: osdmap e268: 8 total, 8 up, 8 in 2021-10-08T19:30:53.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:53 smithi097 ceph-mon[41966]: pgmap v473: 178 pgs: 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 174 active+clean; 1.6 GiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 0 B/s wr, 739 op/s; 3732/77526 objects misplaced (4.814%); 7.5 MiB/s, 120 objects/s recovering 2021-10-08T19:30:53.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:53 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/4212057555' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2021-10-08T19:30:53.796 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:30:53.837 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:53.869 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:53 smithi117 ceph-mon[34585]: 1.0 scrub ok 2021-10-08T19:30:53.870 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:53 smithi117 ceph-mon[34585]: osdmap e268: 8 total, 8 up, 8 in 2021-10-08T19:30:53.870 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:53 smithi117 ceph-mon[34585]: pgmap v473: 178 pgs: 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 174 active+clean; 1.6 GiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 0 B/s wr, 739 op/s; 3732/77526 objects misplaced (4.814%); 7.5 MiB/s, 120 objects/s recovering 2021-10-08T19:30:53.870 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:53 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/4212057555' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2021-10-08T19:30:53.935 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:30:53.942 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:53.943 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:30:54.044 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:30:54.098 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:54.157 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:30:53 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:30:53] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:30:54.288 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:30:54.297 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:54.298 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:30:54.400 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:30:54.449 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:54.524 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:30:54.527 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:54.527 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:30:54.629 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:30:54.655 INFO:journalctl@ceph.osd.4.smithi117.stdout:Oct 08 19:30:54 smithi117 conmon[42287]: 2021-10-08T19:30:54.384+0000 7f7e8aa0f700 -1 osd.4 pg_epoch: 269 pg[4.2( v 69'10 (0'0,69'10] local-lis/les=256/257 n=5 ec=62/62 lis/c=256/256 les/c/f=257/257/0 sis=256) [4,0,2] r=0 lpr=256 crt=69'10 lcod 69'9 mlcod 69'9 active+clean] scrubber pg(4.2) handle_scrub_reserve_grant: received unsolicited reservation grant from osd 0 (0x556c3fd5c000) 2021-10-08T19:30:54.668 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:54.686 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is set 2021-10-08T19:30:54.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:54 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/4212057555' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2021-10-08T19:30:54.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:54 smithi097 ceph-mon[32687]: osdmap e269: 8 total, 8 up, 8 in 2021-10-08T19:30:54.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:54 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/4172591182' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:30:54.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:54 smithi097 ceph-mon[32687]: from='client.25366 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:30:54.972 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:30:54 smithi097 conmon[33110]: 172.21.15.117 - - [08/Oct/2021:19:30:54] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:30:54.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:54 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/4212057555' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2021-10-08T19:30:54.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:54 smithi097 ceph-mon[41966]: osdmap e269: 8 total, 8 up, 8 in 2021-10-08T19:30:54.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:54 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/4172591182' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:30:54.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:54 smithi097 ceph-mon[41966]: from='client.25366 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:30:55.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:54 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/4212057555' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2021-10-08T19:30:55.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:54 smithi117 ceph-mon[34585]: osdmap e269: 8 total, 8 up, 8 in 2021-10-08T19:30:55.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:54 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/4172591182' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:30:55.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:54 smithi117 ceph-mon[34585]: from='client.25366 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:30:55.490 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:30:55.494 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:55.494 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:30:55.596 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:30:55.656 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:55.761 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd reweight 2 1 2021-10-08T19:30:55.762 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:55 smithi097 ceph-mon[41966]: pgmap v475: 178 pgs: 1 active+remapped+backfill_toofull, 1 active+remapped+backfilling, 176 active+clean; 1.4 GiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 0 B/s wr, 752 op/s; 2547/68361 objects misplaced (3.726%); 12 MiB/s, 193 objects/s recovering 2021-10-08T19:30:55.762 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:55 smithi097 ceph-mon[41966]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:30:55.763 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:55 smithi097 ceph-mon[41966]: from='client.25366 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:30:55.763 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:55 smithi097 ceph-mon[41966]: osdmap e270: 8 total, 8 up, 8 in 2021-10-08T19:30:55.763 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:55 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:30:55.763 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:55 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:30:55.764 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:55 smithi097 ceph-mon[41966]: 172.21.15.117 - - [08/Oct/2021:19:30:54] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:30:55.764 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:55 smithi097 ceph-mon[41966]: osdmap e271: 8 total, 8 up, 8 in 2021-10-08T19:30:55.764 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:55 smithi097 ceph-mon[32687]: pgmap v475: 178 pgs: 1 active+remapped+backfill_toofull, 1 active+remapped+backfilling, 176 active+clean; 1.4 GiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 0 B/s wr, 752 op/s; 2547/68361 objects misplaced (3.726%); 12 MiB/s, 193 objects/s recovering 2021-10-08T19:30:55.765 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:55 smithi097 ceph-mon[32687]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:30:55.765 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:55 smithi097 ceph-mon[32687]: from='client.25366 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:30:55.765 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:55 smithi097 ceph-mon[32687]: osdmap e270: 8 total, 8 up, 8 in 2021-10-08T19:30:55.765 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:55 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:30:55.765 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:55 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:30:55.766 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:55 smithi097 ceph-mon[32687]: 172.21.15.117 - - [08/Oct/2021:19:30:54] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:30:55.766 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:55 smithi097 ceph-mon[32687]: osdmap e271: 8 total, 8 up, 8 in 2021-10-08T19:30:55.916 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:30:55.924 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:55.925 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:30:56.026 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:30:56.084 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:56.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:55 smithi117 ceph-mon[34585]: pgmap v475: 178 pgs: 1 active+remapped+backfill_toofull, 1 active+remapped+backfilling, 176 active+clean; 1.4 GiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 0 B/s wr, 752 op/s; 2547/68361 objects misplaced (3.726%); 12 MiB/s, 193 objects/s recovering 2021-10-08T19:30:56.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:55 smithi117 ceph-mon[34585]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:30:56.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:55 smithi117 ceph-mon[34585]: from='client.25366 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:30:56.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:55 smithi117 ceph-mon[34585]: osdmap e270: 8 total, 8 up, 8 in 2021-10-08T19:30:56.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:55 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:30:56.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:55 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:30:56.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:55 smithi117 ceph-mon[34585]: 172.21.15.117 - - [08/Oct/2021:19:30:54] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:30:56.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:55 smithi117 ceph-mon[34585]: osdmap e271: 8 total, 8 up, 8 in 2021-10-08T19:30:56.246 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:30:56.258 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:56.259 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:30:56.360 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:30:56.397 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:56.432 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:30:56.469 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:30:56.472 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:56.474 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:30:56.477 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:30:56.521 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:30:56.550 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:30:56.576 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:30:56.582 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:30:56.606 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:56.609 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:30:56.638 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:30:56.675 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:30:56.675 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:30:56.679 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:56.680 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:30:56.689 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'false' 2021-10-08T19:30:56.690 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'false' 2021-10-08T19:30:56.690 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'false' 2021-10-08T19:30:56.691 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'false' 2021-10-08T19:30:56.691 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'false' 2021-10-08T19:30:56.691 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'false' 2021-10-08T19:30:56.691 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'false' 2021-10-08T19:30:56.692 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'false' 2021-10-08T19:30:56.782 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:30:56.817 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:56.906 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:30:56 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:30:56.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:56 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1630215503' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:30:56.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:56 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1630215503' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:30:56.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:56 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1630215503' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:30:57.538 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:30:57.542 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:57.543 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:30:57.644 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:30:57.681 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:57.760 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:30:57.764 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:57.765 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:30:57.860 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:30:57.866 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:30:57.903 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:57 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:30:57.903 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:57 smithi097 ceph-mon[32687]: pgmap v478: 178 pgs: 1 active+remapped+backfill_toofull, 1 active+remapped+backfilling, 176 active+clean; 1.4 GiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 0 B/s wr, 756 op/s; 2547/68361 objects misplaced (3.726%); 12 MiB/s, 194 objects/s recovering 2021-10-08T19:30:57.904 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:57 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:30:57.904 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:57 smithi097 ceph-mon[41966]: pgmap v478: 178 pgs: 1 active+remapped+backfill_toofull, 1 active+remapped+backfilling, 176 active+clean; 1.4 GiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 0 B/s wr, 756 op/s; 2547/68361 objects misplaced (3.726%); 12 MiB/s, 194 objects/s recovering 2021-10-08T19:30:57.948 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:58.111 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:30:58.122 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:58.123 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:30:58.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:57 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:30:58.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:57 smithi117 ceph-mon[34585]: pgmap v478: 178 pgs: 1 active+remapped+backfill_toofull, 1 active+remapped+backfilling, 176 active+clean; 1.4 GiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 0 B/s wr, 756 op/s; 2547/68361 objects misplaced (3.726%); 12 MiB/s, 194 objects/s recovering 2021-10-08T19:30:58.223 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:30:58.256 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:58.285 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set nodeep-scrub 2021-10-08T19:30:58.331 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:30:58.332 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:58.333 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:30:58.388 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2021-10-08T19:30:58.389 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:30:58.434 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:30:58.503 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:58.665 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:30:58.673 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:58.674 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:30:58.775 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:30:58.823 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:59.503 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2021-10-08T19:30:59.622 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:30:59.626 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:30:59.627 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:30:59.728 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:30:59.767 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:30:59 smithi097 ceph-mon[32687]: pgmap v479: 178 pgs: 1 active+remapped+backfilling, 1 active+remapped+backfill_toofull, 176 active+clean; 1.3 GiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 0 B/s wr, 828 op/s; 2214/62559 objects misplaced (3.539%); 8.7 MiB/s, 139 objects/s recovering 2021-10-08T19:30:59.767 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:30:59 smithi097 ceph-mon[41966]: pgmap v479: 178 pgs: 1 active+remapped+backfilling, 1 active+remapped+backfill_toofull, 176 active+clean; 1.3 GiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 0 B/s wr, 828 op/s; 2214/62559 objects misplaced (3.539%); 8.7 MiB/s, 139 objects/s recovering 2021-10-08T19:30:59.780 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:30:59.902 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2021-10-08T19:31:00.102 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:31:00.106 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:00.107 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:31:00.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:30:59 smithi117 ceph-mon[34585]: pgmap v479: 178 pgs: 1 active+remapped+backfilling, 1 active+remapped+backfill_toofull, 176 active+clean; 1.3 GiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 0 B/s wr, 828 op/s; 2214/62559 objects misplaced (3.539%); 8.7 MiB/s, 139 objects/s recovering 2021-10-08T19:31:00.208 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:31:00.234 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:31:00.251 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:31:00.302 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:00.443 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:00.443 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:31:00.444 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:31:00.545 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:31:00.605 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:00.950 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:00 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:31:00.950 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:00 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:31:00.951 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:00 smithi097 ceph-mon[41966]: osdmap e272: 8 total, 8 up, 8 in 2021-10-08T19:31:00.951 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:00 smithi097 ceph-mon[41966]: osdmap e273: 8 total, 8 up, 8 in 2021-10-08T19:31:00.952 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:00 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:31:00.952 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:00 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:31:00.952 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:00 smithi097 ceph-mon[32687]: osdmap e272: 8 total, 8 up, 8 in 2021-10-08T19:31:00.953 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:00 smithi097 ceph-mon[32687]: osdmap e273: 8 total, 8 up, 8 in 2021-10-08T19:31:01.092 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:31:01.131 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:31:01.138 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:01.139 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:31:01.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:00 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:31:01.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:00 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:31:01.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:00 smithi117 ceph-mon[34585]: osdmap e272: 8 total, 8 up, 8 in 2021-10-08T19:31:01.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:00 smithi117 ceph-mon[34585]: osdmap e273: 8 total, 8 up, 8 in 2021-10-08T19:31:01.241 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:31:01.268 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:01.330 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:31:01.334 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:01.335 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:31:01.436 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:31:01.475 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:01.556 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:31:01.559 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:01.560 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:31:01.661 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:31:01.684 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:01.758 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.2 to 1 (10000) 2021-10-08T19:31:01.761 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:31:01.768 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:01.768 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:31:01.869 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:31:01.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:01 smithi117 ceph-mon[34585]: pgmap v482: 178 pgs: 1 active+remapped+backfill_toofull, 1 active+remapped+backfilling, 176 active+clean; 1.1 GiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 854 B/s rd, 0 B/s wr, 839 op/s; 1921/53295 objects misplaced (3.604%); 620 KiB/s, 9 objects/s recovering 2021-10-08T19:31:01.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:01 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3261450712' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2021-10-08T19:31:01.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:01 smithi117 ceph-mon[34585]: from='client.25375 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2021-10-08T19:31:01.926 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:01.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:01 smithi097 ceph-mon[32687]: pgmap v482: 178 pgs: 1 active+remapped+backfill_toofull, 1 active+remapped+backfilling, 176 active+clean; 1.1 GiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 854 B/s rd, 0 B/s wr, 839 op/s; 1921/53295 objects misplaced (3.604%); 620 KiB/s, 9 objects/s recovering 2021-10-08T19:31:01.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:01 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3261450712' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2021-10-08T19:31:01.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:01 smithi097 ceph-mon[32687]: from='client.25375 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2021-10-08T19:31:01.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:01 smithi097 ceph-mon[41966]: pgmap v482: 178 pgs: 1 active+remapped+backfill_toofull, 1 active+remapped+backfilling, 176 active+clean; 1.1 GiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 854 B/s rd, 0 B/s wr, 839 op/s; 1921/53295 objects misplaced (3.604%); 620 KiB/s, 9 objects/s recovering 2021-10-08T19:31:01.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:01 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3261450712' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2021-10-08T19:31:01.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:01 smithi097 ceph-mon[41966]: from='client.25375 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2021-10-08T19:31:02.655 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:31:02 smithi117 conmon[69189]: level=error ts=2021-10-08T19:31:02.315Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=1 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:31:02.950 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:31:02.954 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:31:02 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:31:02] "GET /metrics HTTP/1.1" 200 155907 "" "Prometheus/2.18.1" 2021-10-08T19:31:02.955 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:02.956 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:31:02.956 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:02 smithi097 ceph-mon[32687]: from='client.25375 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2021-10-08T19:31:02.956 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:02 smithi097 ceph-mon[32687]: osdmap e274: 8 total, 8 up, 8 in 2021-10-08T19:31:02.957 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:02 smithi097 ceph-mon[41966]: from='client.25375 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2021-10-08T19:31:02.957 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:02 smithi097 ceph-mon[41966]: osdmap e274: 8 total, 8 up, 8 in 2021-10-08T19:31:03.057 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:31:03.124 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:03.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:02 smithi117 ceph-mon[34585]: from='client.25375 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2021-10-08T19:31:03.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:02 smithi117 ceph-mon[34585]: osdmap e274: 8 total, 8 up, 8 in 2021-10-08T19:31:03.814 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:31:03.819 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:03.819 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:31:03.921 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:31:03.983 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:04.071 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:03 smithi097 ceph-mon[32687]: pgmap v484: 178 pgs: 1 active+remapped+backfill_toofull, 1 active+remapped+backfilling, 176 active+clean; 1.1 GiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 837 op/s; 1921/53295 objects misplaced (3.604%); 618 KiB/s, 9 objects/s recovering 2021-10-08T19:31:04.071 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:03 smithi097 ceph-mon[41966]: pgmap v484: 178 pgs: 1 active+remapped+backfill_toofull, 1 active+remapped+backfilling, 176 active+clean; 1.1 GiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 837 op/s; 1921/53295 objects misplaced (3.604%); 618 KiB/s, 9 objects/s recovering 2021-10-08T19:31:04.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:31:03 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:31:03] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:31:04.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:03 smithi117 ceph-mon[34585]: pgmap v484: 178 pgs: 1 active+remapped+backfill_toofull, 1 active+remapped+backfilling, 176 active+clean; 1.1 GiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 837 op/s; 1921/53295 objects misplaced (3.604%); 618 KiB/s, 9 objects/s recovering 2021-10-08T19:31:04.655 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd reweight 4 1 2021-10-08T19:31:04.895 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:04 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:31:04.896 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:04 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:31:04.896 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:04 smithi097 ceph-mon[32687]: osdmap e275: 8 total, 8 up, 8 in 2021-10-08T19:31:04.897 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:04 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:31:04.898 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:04 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:31:04.898 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:04 smithi097 ceph-mon[41966]: osdmap e275: 8 total, 8 up, 8 in 2021-10-08T19:31:05.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:04 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:31:05.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:04 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:31:05.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:04 smithi117 ceph-mon[34585]: osdmap e275: 8 total, 8 up, 8 in 2021-10-08T19:31:05.327 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2021-10-08T19:31:05.327 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:31:05.329 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:31:05.335 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:05.335 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:31:05.437 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:31:05.470 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:05.548 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:31:05.551 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:05.551 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:31:05.652 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:31:05.679 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:05.751 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:31:05.753 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:05.754 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:31:05.855 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:31:05.900 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:05.972 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:31:05.975 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:05.976 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:31:06.077 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:31:06.104 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:05 smithi097 ceph-mon[32687]: pgmap v486: 178 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfilling, 176 active+clean; 800 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 964 op/s; 1355/38955 objects misplaced (3.478%); 748 KiB/s, 11 objects/s recovering 2021-10-08T19:31:06.105 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:05 smithi097 ceph-mon[41966]: pgmap v486: 178 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfilling, 176 active+clean; 800 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 964 op/s; 1355/38955 objects misplaced (3.478%); 748 KiB/s, 11 objects/s recovering 2021-10-08T19:31:06.141 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:06.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:05 smithi117 ceph-mon[34585]: pgmap v486: 178 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfilling, 176 active+clean; 800 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 964 op/s; 1355/38955 objects misplaced (3.478%); 748 KiB/s, 11 objects/s recovering 2021-10-08T19:31:06.887 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:31:06.894 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:06.895 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:31:06.996 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:31:07.030 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:31:06 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:31:07.032 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:07.095 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:31:07.099 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:07.100 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:31:07.169 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:31:07.201 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:31:07.218 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2021-10-08T19:31:07.287 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:07.859 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is set 2021-10-08T19:31:07.931 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:31:07.931 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:31:07.931 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:31:07.944 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:31:07.958 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:31:07.963 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:07.964 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:31:07.993 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:31:08.033 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:31:08.065 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:31:08.069 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:31:08.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:07 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:31:08.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:07 smithi117 ceph-mon[34585]: pgmap v487: 178 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfilling, 176 active+clean; 800 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 849 B/s rd, 0 B/s wr, 793 op/s; 1355/38955 objects misplaced (3.478%); 616 KiB/s, 9 objects/s recovering 2021-10-08T19:31:08.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:07 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3676097450' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:31:08.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:07 smithi117 ceph-mon[34585]: from='client.35402 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:31:08.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:07 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3190498277' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:31:08.098 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:08.108 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:31:08.123 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true' 2021-10-08T19:31:08.123 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true' 2021-10-08T19:31:08.123 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true' 2021-10-08T19:31:08.124 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true' 2021-10-08T19:31:08.125 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true' 2021-10-08T19:31:08.125 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true' 2021-10-08T19:31:08.125 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'true' 2021-10-08T19:31:08.126 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'true' 2021-10-08T19:31:08.149 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:07 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:31:08.150 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:07 smithi097 ceph-mon[32687]: pgmap v487: 178 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfilling, 176 active+clean; 800 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 849 B/s rd, 0 B/s wr, 793 op/s; 1355/38955 objects misplaced (3.478%); 616 KiB/s, 9 objects/s recovering 2021-10-08T19:31:08.150 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:07 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3676097450' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:31:08.150 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:07 smithi097 ceph-mon[32687]: from='client.35402 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:31:08.150 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:07 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3190498277' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:31:08.151 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:07 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:31:08.152 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:07 smithi097 ceph-mon[41966]: pgmap v487: 178 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfilling, 176 active+clean; 800 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 849 B/s rd, 0 B/s wr, 793 op/s; 1355/38955 objects misplaced (3.478%); 616 KiB/s, 9 objects/s recovering 2021-10-08T19:31:08.152 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:07 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3676097450' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:31:08.152 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:07 smithi097 ceph-mon[41966]: from='client.35402 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:31:08.152 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:07 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3190498277' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:31:08.169 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:31:08.174 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:08.175 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:31:08.277 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:31:08.307 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:08.386 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:31:08.393 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:08.394 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:31:08.496 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:31:08.538 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:09.149 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:31:09.152 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:08 smithi097 ceph-mon[41966]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:31:09.153 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:08 smithi097 ceph-mon[41966]: from='client.35402 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:31:09.153 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:08 smithi097 ceph-mon[41966]: osdmap e276: 8 total, 8 up, 8 in 2021-10-08T19:31:09.153 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:08 smithi097 ceph-mon[32687]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:31:09.154 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:08 smithi097 ceph-mon[32687]: from='client.35402 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:31:09.154 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:08 smithi097 ceph-mon[32687]: osdmap e276: 8 total, 8 up, 8 in 2021-10-08T19:31:09.154 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:09.156 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:31:09.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:08 smithi117 ceph-mon[34585]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:31:09.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:08 smithi117 ceph-mon[34585]: from='client.35402 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:31:09.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:08 smithi117 ceph-mon[34585]: osdmap e276: 8 total, 8 up, 8 in 2021-10-08T19:31:09.257 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:31:09.287 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:09.350 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:31:09.352 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:09.353 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:31:09.454 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:31:09.492 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:09.555 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:31:09.559 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:09.560 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:31:09.661 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:31:09.722 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:09.861 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:09 smithi117 ceph-mon[34585]: pgmap v489: 178 pgs: 1 active+remapped+backfilling, 1 active+remapped+backfill_wait+backfill_toofull, 176 active+clean; 699 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 922 op/s; 1130/34128 objects misplaced (3.311%); 1.0 MiB/s, 16 objects/s recovering 2021-10-08T19:31:09.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:09 smithi097 ceph-mon[32687]: pgmap v489: 178 pgs: 1 active+remapped+backfilling, 1 active+remapped+backfill_wait+backfill_toofull, 176 active+clean; 699 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 922 op/s; 1130/34128 objects misplaced (3.311%); 1.0 MiB/s, 16 objects/s recovering 2021-10-08T19:31:09.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:09 smithi097 ceph-mon[41966]: pgmap v489: 178 pgs: 1 active+remapped+backfilling, 1 active+remapped+backfill_wait+backfill_toofull, 176 active+clean; 699 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 922 op/s; 1130/34128 objects misplaced (3.311%); 1.0 MiB/s, 16 objects/s recovering 2021-10-08T19:31:10.235 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:31:10.241 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:10.242 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:31:10.343 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:31:10.394 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:10.522 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:31:10.529 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:10.530 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:31:10.632 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:31:10.695 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:10.818 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:31:10.833 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:31:10.845 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:10.846 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:31:10.947 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:31:10.998 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:11.291 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset noscrub 2021-10-08T19:31:11.351 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:31:11.359 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:11.361 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:31:11.463 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:31:11.495 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:11.548 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:31:11.552 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:11.553 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:31:11.654 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:31:11.684 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:11.735 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:31:11.739 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:11.740 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:31:11.841 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:31:11.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:11 smithi117 ceph-mon[34585]: osdmap e277: 8 total, 8 up, 8 in 2021-10-08T19:31:11.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:11 smithi117 ceph-mon[34585]: pgmap v491: 178 pgs: 2 active+remapped+backfilling, 176 active+clean; 528 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 742 B/s rd, 0 B/s wr, 1.06k op/s; 818/25926 objects misplaced (3.155%); 1.1 MiB/s, 16 objects/s recovering 2021-10-08T19:31:11.875 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:11.937 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:31:11.941 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:11.942 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:31:11.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:11 smithi097 ceph-mon[41966]: osdmap e277: 8 total, 8 up, 8 in 2021-10-08T19:31:11.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:11 smithi097 ceph-mon[41966]: pgmap v491: 178 pgs: 2 active+remapped+backfilling, 176 active+clean; 528 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 742 B/s rd, 0 B/s wr, 1.06k op/s; 818/25926 objects misplaced (3.155%); 1.1 MiB/s, 16 objects/s recovering 2021-10-08T19:31:11.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:11 smithi097 ceph-mon[32687]: osdmap e277: 8 total, 8 up, 8 in 2021-10-08T19:31:11.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:11 smithi097 ceph-mon[32687]: pgmap v491: 178 pgs: 2 active+remapped+backfilling, 176 active+clean; 528 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 742 B/s rd, 0 B/s wr, 1.06k op/s; 818/25926 objects misplaced (3.155%); 1.1 MiB/s, 16 objects/s recovering 2021-10-08T19:31:12.044 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:31:12.079 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:12.083 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2021-10-08T19:31:12.138 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:31:12.144 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:12.144 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:31:12.246 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:31:12.273 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:12.345 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:31:12.347 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:12.348 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:31:12.449 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:31:12.478 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:12.549 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:31:12.552 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:12.553 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:31:12.654 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:31:12.690 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:12.692 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.4 to 1 (10000) 2021-10-08T19:31:12.756 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:31:12.758 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:12.759 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:31:12.760 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:12 smithi117 ceph-mon[34585]: Health check cleared: PG_BACKFILL_FULL (was: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull) 2021-10-08T19:31:12.760 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:12 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3609924365' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2021-10-08T19:31:12.860 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:31:12.903 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:12 smithi097 ceph-mon[32687]: Health check cleared: PG_BACKFILL_FULL (was: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull) 2021-10-08T19:31:12.903 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:12 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3609924365' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2021-10-08T19:31:12.903 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:12 smithi097 ceph-mon[41966]: Health check cleared: PG_BACKFILL_FULL (was: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull) 2021-10-08T19:31:12.904 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:12 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3609924365' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2021-10-08T19:31:12.904 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:31:12 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:31:12] "GET /metrics HTTP/1.1" 200 155845 "" "Prometheus/2.18.1" 2021-10-08T19:31:12.905 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:13.555 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:31:13.560 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:13.561 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:31:13.649 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:31:13.662 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:31:13.690 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd reweight 5 1 2021-10-08T19:31:13.705 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:31:13.740 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:13.867 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:31:13 smithi117 conmon[69189]: level=error ts=2021-10-08T19:31:13.504Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=2 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:31:13.868 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:13 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3609924365' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]': finished 2021-10-08T19:31:13.868 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:13 smithi117 ceph-mon[34585]: osdmap e278: 8 total, 8 up, 8 in 2021-10-08T19:31:13.868 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:13 smithi117 ceph-mon[34585]: pgmap v493: 178 pgs: 2 active+remapped+backfilling, 176 active+clean; 528 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 724 op/s; 818/25926 objects misplaced (3.155%); 1.2 MiB/s, 19 objects/s recovering 2021-10-08T19:31:13.900 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:13 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3609924365' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]': finished 2021-10-08T19:31:13.900 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:13 smithi097 ceph-mon[32687]: osdmap e278: 8 total, 8 up, 8 in 2021-10-08T19:31:13.901 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:13 smithi097 ceph-mon[32687]: pgmap v493: 178 pgs: 2 active+remapped+backfilling, 176 active+clean; 528 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 724 op/s; 818/25926 objects misplaced (3.155%); 1.2 MiB/s, 19 objects/s recovering 2021-10-08T19:31:13.901 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:13 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3609924365' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]': finished 2021-10-08T19:31:13.901 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:13 smithi097 ceph-mon[41966]: osdmap e278: 8 total, 8 up, 8 in 2021-10-08T19:31:13.902 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:13 smithi097 ceph-mon[41966]: pgmap v493: 178 pgs: 2 active+remapped+backfilling, 176 active+clean; 528 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 724 op/s; 818/25926 objects misplaced (3.155%); 1.2 MiB/s, 19 objects/s recovering 2021-10-08T19:31:13.935 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:31:13.942 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:13.943 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:31:14.044 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:31:14.072 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:14.125 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:31:14.127 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:31:13 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:31:13] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:31:14.128 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:14.129 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:31:14.230 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:31:14.308 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:14.336 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:31:14.336 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2021-10-08T19:31:14.336 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2021-10-08T19:31:14.337 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2021-10-08T19:31:14.337 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.337 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:73275 8.1 8:89fa6f07:::benchmark_data_smithi097_144160_object73274:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e208)", 2021-10-08T19:31:14.337 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:28:47.966982+0000", 2021-10-08T19:31:14.337 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 146.354573182, 2021-10-08T19:31:14.338 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2505157219999994, 2021-10-08T19:31:14.338 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:14.338 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:31:14.338 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:31:14.339 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:31:14.339 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:31:14.339 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 73275 2021-10-08T19:31:14.339 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.339 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:14.340 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.340 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:14.340 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:47.966982+0000", 2021-10-08T19:31:14.340 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:14.340 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.341 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.341 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:14.341 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:47.966982+0000", 2021-10-08T19:31:14.341 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:14.341 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.342 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.342 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:14.342 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:47.966979+0000", 2021-10-08T19:31:14.342 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2021-10-08T19:31:14.343 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.343 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.343 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:14.343 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:47.967008+0000", 2021-10-08T19:31:14.343 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9158000000000001e-05 2021-10-08T19:31:14.344 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.344 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.344 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:14.344 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:47.967458+0000", 2021-10-08T19:31:14.345 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00044973399999999997 2021-10-08T19:31:14.345 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.345 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.345 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:14.345 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:47.967470+0000", 2021-10-08T19:31:14.346 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2388000000000001e-05 2021-10-08T19:31:14.346 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.346 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.346 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.347 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:47.969494+0000", 2021-10-08T19:31:14.347 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0020236820000000002 2021-10-08T19:31:14.347 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.347 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.347 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:31:14.348 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:47.969505+0000", 2021-10-08T19:31:14.348 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0984e-05 2021-10-08T19:31:14.348 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.348 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.348 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.349 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.971329+0000", 2021-10-08T19:31:14.349 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.001823742 2021-10-08T19:31:14.349 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.349 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.349 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for readable", 2021-10-08T19:31:14.350 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.971371+0000", 2021-10-08T19:31:14.350 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2126000000000003e-05 2021-10-08T19:31:14.350 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.350 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.351 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.351 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.191871+0000", 2021-10-08T19:31:14.351 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2204998939999996 2021-10-08T19:31:14.351 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.351 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.352 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:14.352 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.192038+0000", 2021-10-08T19:31:14.352 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000167121 2021-10-08T19:31:14.352 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.352 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.353 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:31:14.353 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.192543+0000", 2021-10-08T19:31:14.353 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00050460200000000005 2021-10-08T19:31:14.353 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.353 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.354 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:31:14.354 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.209630+0000", 2021-10-08T19:31:14.354 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.017087327999999999 2021-10-08T19:31:14.354 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.354 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.355 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:14.355 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.212104+0000", 2021-10-08T19:31:14.355 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002473804 2021-10-08T19:31:14.355 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.355 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.356 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:14.356 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.217392+0000", 2021-10-08T19:31:14.356 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0052880749999999997 2021-10-08T19:31:14.356 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.356 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.357 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:31:14.357 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.217450+0000", 2021-10-08T19:31:14.357 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7849000000000001e-05 2021-10-08T19:31:14.357 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.357 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.358 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:14.358 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.217498+0000", 2021-10-08T19:31:14.358 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8006000000000001e-05 2021-10-08T19:31:14.358 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:14.359 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:14.359 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:14.359 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.359 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.360 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:73306 8.1 8:895a36b8:::benchmark_data_smithi097_144160_object73305:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e208)", 2021-10-08T19:31:14.360 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:28:48.008298+0000", 2021-10-08T19:31:14.360 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 146.31325747400001, 2021-10-08T19:31:14.360 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.209374854, 2021-10-08T19:31:14.361 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:14.361 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:31:14.361 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:31:14.361 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:31:14.362 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:31:14.362 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 73306 2021-10-08T19:31:14.362 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.362 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:14.362 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.363 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:14.363 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.008298+0000", 2021-10-08T19:31:14.363 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:14.364 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.364 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.364 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:14.364 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.008298+0000", 2021-10-08T19:31:14.365 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:14.365 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.365 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.365 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:14.366 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.008295+0000", 2021-10-08T19:31:14.366 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:31:14.366 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.366 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.366 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:14.367 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.008327+0000", 2021-10-08T19:31:14.367 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1297000000000002e-05 2021-10-08T19:31:14.367 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.367 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.368 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:14.368 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.008339+0000", 2021-10-08T19:31:14.368 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2251e-05 2021-10-08T19:31:14.368 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.369 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.369 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:14.369 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.008346+0000", 2021-10-08T19:31:14.369 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8129999999999998e-06 2021-10-08T19:31:14.369 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.370 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.370 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.370 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.010759+0000", 2021-10-08T19:31:14.370 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0024132619999999998 2021-10-08T19:31:14.371 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.371 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.371 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:31:14.371 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.010769+0000", 2021-10-08T19:31:14.371 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0434999999999999e-05 2021-10-08T19:31:14.372 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.372 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.372 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.372 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.971792+0000", 2021-10-08T19:31:14.373 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.96102217199999995 2021-10-08T19:31:14.373 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.373 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.373 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for readable", 2021-10-08T19:31:14.373 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.971822+0000", 2021-10-08T19:31:14.374 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0269000000000001e-05 2021-10-08T19:31:14.374 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.374 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.374 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.375 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.199122+0000", 2021-10-08T19:31:14.375 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2272997339999998 2021-10-08T19:31:14.375 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.375 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.376 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:14.376 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.199260+0000", 2021-10-08T19:31:14.376 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013880699999999999 2021-10-08T19:31:14.376 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.376 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.377 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:31:14.377 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.199451+0000", 2021-10-08T19:31:14.377 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019037200000000001 2021-10-08T19:31:14.377 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.378 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.378 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:31:14.378 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.209636+0000", 2021-10-08T19:31:14.378 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010185550999999999 2021-10-08T19:31:14.378 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.379 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.379 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:14.379 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.212149+0000", 2021-10-08T19:31:14.379 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002513089 2021-10-08T19:31:14.380 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.380 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.380 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:14.380 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.217584+0000", 2021-10-08T19:31:14.381 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.005434454 2021-10-08T19:31:14.381 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.381 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.381 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:31:14.381 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.217632+0000", 2021-10-08T19:31:14.382 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8517999999999999e-05 2021-10-08T19:31:14.382 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.382 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.382 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:14.383 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.217672+0000", 2021-10-08T19:31:14.383 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0000999999999999e-05 2021-10-08T19:31:14.383 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:14.383 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:14.383 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:14.384 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.384 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.384 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:73333 8.1 8:88236ba2:::benchmark_data_smithi097_144160_object73332:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e208)", 2021-10-08T19:31:14.384 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:28:48.033882+0000", 2021-10-08T19:31:14.384 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 146.287672724, 2021-10-08T19:31:14.385 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1888886579999998, 2021-10-08T19:31:14.385 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:14.385 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:31:14.385 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:31:14.386 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:31:14.386 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:31:14.386 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 73333 2021-10-08T19:31:14.386 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.387 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:14.387 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.387 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:14.387 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.033882+0000", 2021-10-08T19:31:14.388 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:14.388 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.388 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.388 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:14.388 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.033882+0000", 2021-10-08T19:31:14.389 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:14.389 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.389 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.389 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:14.389 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.033880+0000", 2021-10-08T19:31:14.390 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:31:14.390 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.390 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.390 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:14.391 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.033911+0000", 2021-10-08T19:31:14.391 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1207000000000001e-05 2021-10-08T19:31:14.391 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.391 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.392 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:14.392 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.033924+0000", 2021-10-08T19:31:14.392 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2765999999999999e-05 2021-10-08T19:31:14.392 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.392 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.393 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:14.393 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.033931+0000", 2021-10-08T19:31:14.393 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2790000000000001e-06 2021-10-08T19:31:14.393 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.394 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.394 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.394 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.034000+0000", 2021-10-08T19:31:14.394 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8910000000000003e-05 2021-10-08T19:31:14.394 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.395 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.395 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:31:14.395 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.034019+0000", 2021-10-08T19:31:14.395 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8651000000000002e-05 2021-10-08T19:31:14.396 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.396 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.396 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.396 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.971844+0000", 2021-10-08T19:31:14.397 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.93782492799999995 2021-10-08T19:31:14.397 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.397 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.397 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for readable", 2021-10-08T19:31:14.397 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.971870+0000", 2021-10-08T19:31:14.398 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5979999999999999e-05 2021-10-08T19:31:14.398 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.398 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.398 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.399 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.201956+0000", 2021-10-08T19:31:14.399 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2300861599999999 2021-10-08T19:31:14.399 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.399 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.399 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:14.400 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.202106+0000", 2021-10-08T19:31:14.400 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015006399999999999 2021-10-08T19:31:14.400 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.400 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.401 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:31:14.401 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.202284+0000", 2021-10-08T19:31:14.401 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000178376 2021-10-08T19:31:14.401 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.401 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.402 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:31:14.402 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.209642+0000", 2021-10-08T19:31:14.402 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0073577699999999996 2021-10-08T19:31:14.402 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.403 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.403 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:14.403 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.212185+0000", 2021-10-08T19:31:14.403 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0025432950000000001 2021-10-08T19:31:14.403 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.404 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.404 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:14.404 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.222661+0000", 2021-10-08T19:31:14.404 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010475976 2021-10-08T19:31:14.405 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.405 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.405 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:31:14.405 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.222725+0000", 2021-10-08T19:31:14.405 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3981999999999998e-05 2021-10-08T19:31:14.406 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.406 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.406 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:14.406 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.222771+0000", 2021-10-08T19:31:14.407 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5735000000000002e-05 2021-10-08T19:31:14.407 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:14.407 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:14.407 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:14.407 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.408 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.408 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:73350 8.1 8:854a3685:::benchmark_data_smithi097_144160_object73349:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e208)", 2021-10-08T19:31:14.408 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:28:48.048175+0000", 2021-10-08T19:31:14.408 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 146.27337977299999, 2021-10-08T19:31:14.409 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1748325860000008, 2021-10-08T19:31:14.409 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:14.409 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:31:14.409 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:31:14.410 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:31:14.410 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:31:14.410 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 73350 2021-10-08T19:31:14.410 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.411 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:14.411 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.411 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:14.411 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.048175+0000", 2021-10-08T19:31:14.411 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:14.412 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.412 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.412 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:14.412 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.048175+0000", 2021-10-08T19:31:14.413 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:14.413 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.413 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.413 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:14.413 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.048172+0000", 2021-10-08T19:31:14.414 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2021-10-08T19:31:14.414 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.414 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.414 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:14.415 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.048200+0000", 2021-10-08T19:31:14.415 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7370999999999999e-05 2021-10-08T19:31:14.415 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.415 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.416 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:14.416 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.048211+0000", 2021-10-08T19:31:14.416 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0936e-05 2021-10-08T19:31:14.416 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.416 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.417 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:14.417 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.048216+0000", 2021-10-08T19:31:14.417 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5169999999999999e-06 2021-10-08T19:31:14.417 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.418 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.418 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.418 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.048269+0000", 2021-10-08T19:31:14.418 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3291000000000002e-05 2021-10-08T19:31:14.419 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.419 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.419 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:31:14.419 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.048296+0000", 2021-10-08T19:31:14.419 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6451000000000001e-05 2021-10-08T19:31:14.420 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.420 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.420 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.420 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.971892+0000", 2021-10-08T19:31:14.420 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.92359580399999996 2021-10-08T19:31:14.421 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.421 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.421 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for readable", 2021-10-08T19:31:14.421 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.971918+0000", 2021-10-08T19:31:14.421 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5751000000000001e-05 2021-10-08T19:31:14.422 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.422 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.422 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.422 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.204609+0000", 2021-10-08T19:31:14.423 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2326916399999996 2021-10-08T19:31:14.423 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.423 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.423 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:14.423 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.204739+0000", 2021-10-08T19:31:14.424 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013032300000000001 2021-10-08T19:31:14.424 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.424 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.424 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:31:14.425 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.204915+0000", 2021-10-08T19:31:14.425 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000175398 2021-10-08T19:31:14.425 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.425 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.425 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:14.426 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.212255+0000", 2021-10-08T19:31:14.426 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0073401270000000001 2021-10-08T19:31:14.426 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.426 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.427 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:31:14.427 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.212266+0000", 2021-10-08T19:31:14.427 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0679000000000001e-05 2021-10-08T19:31:14.427 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.427 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.428 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:14.428 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.222904+0000", 2021-10-08T19:31:14.428 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010638633 2021-10-08T19:31:14.428 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.429 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.429 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:31:14.429 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.222963+0000", 2021-10-08T19:31:14.429 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8671999999999997e-05 2021-10-08T19:31:14.430 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.430 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.430 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:14.430 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.223008+0000", 2021-10-08T19:31:14.430 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4917999999999999e-05 2021-10-08T19:31:14.431 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:14.431 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:14.431 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:14.431 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.432 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.432 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:73374 8.1 8:8d5b61ba:::benchmark_data_smithi097_144160_object73373:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e208)", 2021-10-08T19:31:14.432 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:28:48.073270+0000", 2021-10-08T19:31:14.432 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 146.24828526799999, 2021-10-08T19:31:14.432 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1499620719999992, 2021-10-08T19:31:14.433 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:14.433 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:31:14.433 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:31:14.433 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:31:14.434 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:31:14.434 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 73374 2021-10-08T19:31:14.434 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.434 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:14.435 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.435 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:14.435 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.073270+0000", 2021-10-08T19:31:14.435 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:14.435 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.436 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.436 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:14.436 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.073270+0000", 2021-10-08T19:31:14.436 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:14.437 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.437 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.437 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:14.437 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.073267+0000", 2021-10-08T19:31:14.437 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:31:14.438 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.438 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.438 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:14.438 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.073296+0000", 2021-10-08T19:31:14.439 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8462e-05 2021-10-08T19:31:14.439 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.439 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.439 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:14.439 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.073312+0000", 2021-10-08T19:31:14.440 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6441000000000001e-05 2021-10-08T19:31:14.440 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.440 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.440 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:14.441 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.073319+0000", 2021-10-08T19:31:14.441 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6959999999999999e-06 2021-10-08T19:31:14.441 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.441 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.441 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.442 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.073412+0000", 2021-10-08T19:31:14.442 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.344e-05 2021-10-08T19:31:14.442 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.442 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.443 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:31:14.443 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.073423+0000", 2021-10-08T19:31:14.443 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0499999999999999e-05 2021-10-08T19:31:14.443 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.443 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.444 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.444 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.971938+0000", 2021-10-08T19:31:14.444 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.89851482100000002 2021-10-08T19:31:14.444 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.445 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.445 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for readable", 2021-10-08T19:31:14.445 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.971968+0000", 2021-10-08T19:31:14.445 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0593999999999999e-05 2021-10-08T19:31:14.445 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.446 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.446 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.446 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.207315+0000", 2021-10-08T19:31:14.446 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.235346356 2021-10-08T19:31:14.447 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.447 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.447 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:14.447 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.207430+0000", 2021-10-08T19:31:14.447 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115017 2021-10-08T19:31:14.448 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.448 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.448 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:31:14.448 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.207595+0000", 2021-10-08T19:31:14.449 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016508500000000001 2021-10-08T19:31:14.449 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.449 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.449 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:31:14.449 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.212274+0000", 2021-10-08T19:31:14.450 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0046793149999999999 2021-10-08T19:31:14.450 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.450 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.450 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:14.451 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.217347+0000", 2021-10-08T19:31:14.451 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0050730030000000004 2021-10-08T19:31:14.451 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.451 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.451 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:14.452 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.223066+0000", 2021-10-08T19:31:14.452 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0057194480000000002 2021-10-08T19:31:14.452 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.452 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.452 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:31:14.453 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.223183+0000", 2021-10-08T19:31:14.453 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000116257 2021-10-08T19:31:14.453 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.453 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.453 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:14.454 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.223232+0000", 2021-10-08T19:31:14.454 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9156000000000002e-05 2021-10-08T19:31:14.454 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:14.454 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:14.455 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:14.455 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.455 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.455 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:73386 8.1 8:8137ab80:::benchmark_data_smithi097_144160_object73385:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e208)", 2021-10-08T19:31:14.455 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:28:48.084509+0000", 2021-10-08T19:31:14.456 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 146.237046351, 2021-10-08T19:31:14.456 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1389014260000003, 2021-10-08T19:31:14.456 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:14.456 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:31:14.457 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:31:14.457 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:31:14.457 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:31:14.457 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 73386 2021-10-08T19:31:14.458 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.458 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:14.458 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.458 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:14.459 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.084509+0000", 2021-10-08T19:31:14.459 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:14.459 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.459 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.459 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:14.460 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.084509+0000", 2021-10-08T19:31:14.460 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:14.460 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.460 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.460 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:14.461 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.084506+0000", 2021-10-08T19:31:14.461 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:31:14.461 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.461 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.462 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:14.462 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.084532+0000", 2021-10-08T19:31:14.462 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6106e-05 2021-10-08T19:31:14.462 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.463 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.463 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:14.463 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.084550+0000", 2021-10-08T19:31:14.463 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7223000000000001e-05 2021-10-08T19:31:14.463 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.464 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.464 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:14.464 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.084558+0000", 2021-10-08T19:31:14.464 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0129999999999993e-06 2021-10-08T19:31:14.464 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.465 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.465 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.465 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.084617+0000", 2021-10-08T19:31:14.465 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9667999999999999e-05 2021-10-08T19:31:14.466 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.466 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.466 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:31:14.466 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.084627+0000", 2021-10-08T19:31:14.467 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0059e-05 2021-10-08T19:31:14.467 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.467 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.467 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.468 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.971988+0000", 2021-10-08T19:31:14.468 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.88736098200000002 2021-10-08T19:31:14.468 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.468 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.469 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for readable", 2021-10-08T19:31:14.469 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.972017+0000", 2021-10-08T19:31:14.469 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8685999999999999e-05 2021-10-08T19:31:14.469 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.469 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.470 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.470 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.209681+0000", 2021-10-08T19:31:14.470 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2376634419999997 2021-10-08T19:31:14.470 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.471 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.471 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:14.471 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.209781+0000", 2021-10-08T19:31:14.471 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000100389 2021-10-08T19:31:14.472 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.472 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.472 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:31:14.472 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.209938+0000", 2021-10-08T19:31:14.472 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015746600000000001 2021-10-08T19:31:14.473 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.473 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.473 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:31:14.473 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.217304+0000", 2021-10-08T19:31:14.473 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0073657230000000002 2021-10-08T19:31:14.474 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.474 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.474 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:14.474 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.217543+0000", 2021-10-08T19:31:14.475 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000238767 2021-10-08T19:31:14.475 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.475 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.475 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:14.475 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.223315+0000", 2021-10-08T19:31:14.476 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0057719060000000003 2021-10-08T19:31:14.476 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.476 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.476 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:31:14.476 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.223366+0000", 2021-10-08T19:31:14.477 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1341000000000002e-05 2021-10-08T19:31:14.477 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.477 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.477 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:14.477 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.223410+0000", 2021-10-08T19:31:14.478 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3998000000000001e-05 2021-10-08T19:31:14.478 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:14.478 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:14.478 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:14.479 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.479 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.479 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:73424 8.1 8:8e924db9:::benchmark_data_smithi097_144160_object73423:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e208)", 2021-10-08T19:31:14.480 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:28:48.130717+0000", 2021-10-08T19:31:14.480 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 146.19083809899999, 2021-10-08T19:31:14.480 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0928319900000005, 2021-10-08T19:31:14.480 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:14.480 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:31:14.481 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:31:14.481 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:31:14.481 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:31:14.481 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 73424 2021-10-08T19:31:14.482 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.482 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:14.482 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.482 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:14.483 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.130717+0000", 2021-10-08T19:31:14.483 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:14.483 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.483 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.483 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:14.484 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.130717+0000", 2021-10-08T19:31:14.484 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:14.484 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.484 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.484 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:14.485 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.130714+0000", 2021-10-08T19:31:14.485 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2021-10-08T19:31:14.485 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.485 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.485 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:14.486 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.130739+0000", 2021-10-08T19:31:14.486 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4613e-05 2021-10-08T19:31:14.486 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.486 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.487 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:14.487 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.130752+0000", 2021-10-08T19:31:14.487 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3569e-05 2021-10-08T19:31:14.487 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.487 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.488 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:14.488 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.130760+0000", 2021-10-08T19:31:14.488 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5569999999999998e-06 2021-10-08T19:31:14.488 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.489 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.489 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.489 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.130812+0000", 2021-10-08T19:31:14.489 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2166000000000002e-05 2021-10-08T19:31:14.489 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.490 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.490 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:31:14.490 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.130822+0000", 2021-10-08T19:31:14.490 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0444e-05 2021-10-08T19:31:14.491 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.491 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.491 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.491 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.972039+0000", 2021-10-08T19:31:14.492 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.84121698700000003 2021-10-08T19:31:14.492 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.492 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.492 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for readable", 2021-10-08T19:31:14.492 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.972066+0000", 2021-10-08T19:31:14.493 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6469e-05 2021-10-08T19:31:14.493 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.493 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.493 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.494 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.212318+0000", 2021-10-08T19:31:14.494 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2402524540000002 2021-10-08T19:31:14.494 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.494 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.495 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:14.495 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.212465+0000", 2021-10-08T19:31:14.495 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014612499999999999 2021-10-08T19:31:14.495 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.495 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.496 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:31:14.496 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.212641+0000", 2021-10-08T19:31:14.496 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000176365 2021-10-08T19:31:14.496 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.497 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.497 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:31:14.497 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.217354+0000", 2021-10-08T19:31:14.497 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0047135450000000004 2021-10-08T19:31:14.497 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.498 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.498 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:14.498 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.217716+0000", 2021-10-08T19:31:14.498 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000361238 2021-10-08T19:31:14.499 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.499 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.499 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:14.499 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.223452+0000", 2021-10-08T19:31:14.500 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0057360559999999998 2021-10-08T19:31:14.500 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.500 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.500 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:31:14.500 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.223503+0000", 2021-10-08T19:31:14.501 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0924000000000002e-05 2021-10-08T19:31:14.501 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.501 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.501 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:14.502 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.223549+0000", 2021-10-08T19:31:14.502 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6338999999999998e-05 2021-10-08T19:31:14.502 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:14.502 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:14.503 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:14.503 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.503 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.503 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:73437 8.1 8:8b9e3e08:::benchmark_data_smithi097_144160_object73436:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e208)", 2021-10-08T19:31:14.504 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:28:48.144924+0000", 2021-10-08T19:31:14.504 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 146.17663119400001, 2021-10-08T19:31:14.504 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0787779369999999, 2021-10-08T19:31:14.504 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:14.504 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:31:14.505 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:31:14.505 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:31:14.505 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:31:14.505 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 73437 2021-10-08T19:31:14.506 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.506 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:14.506 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.506 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:14.507 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.144924+0000", 2021-10-08T19:31:14.507 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:14.507 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.507 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.507 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:14.508 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.144924+0000", 2021-10-08T19:31:14.508 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:14.508 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.508 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.509 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:14.509 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.144921+0000", 2021-10-08T19:31:14.509 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2021-10-08T19:31:14.509 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.510 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.510 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:14.510 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.144973+0000", 2021-10-08T19:31:14.510 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2448000000000003e-05 2021-10-08T19:31:14.510 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.511 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.511 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:14.511 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.144986+0000", 2021-10-08T19:31:14.512 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2618e-05 2021-10-08T19:31:14.512 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.512 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.512 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:14.513 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.144993+0000", 2021-10-08T19:31:14.513 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8449999999999997e-06 2021-10-08T19:31:14.513 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.513 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.514 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.514 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.145034+0000", 2021-10-08T19:31:14.514 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1152999999999997e-05 2021-10-08T19:31:14.514 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.514 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.515 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:31:14.515 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.145041+0000", 2021-10-08T19:31:14.515 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1439999999999997e-06 2021-10-08T19:31:14.515 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.516 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.516 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.516 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.972087+0000", 2021-10-08T19:31:14.516 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.82704628099999999 2021-10-08T19:31:14.516 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.517 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.517 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for readable", 2021-10-08T19:31:14.517 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.972123+0000", 2021-10-08T19:31:14.517 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5272999999999999e-05 2021-10-08T19:31:14.518 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.518 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.518 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.518 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.214915+0000", 2021-10-08T19:31:14.519 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2427925399999999 2021-10-08T19:31:14.519 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.519 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.519 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:14.520 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.215043+0000", 2021-10-08T19:31:14.520 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000127603 2021-10-08T19:31:14.520 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.520 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.520 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:31:14.521 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.215227+0000", 2021-10-08T19:31:14.521 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000183807 2021-10-08T19:31:14.521 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.521 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.522 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:31:14.522 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.217550+0000", 2021-10-08T19:31:14.522 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00232322 2021-10-08T19:31:14.522 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.522 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.523 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:14.523 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.222597+0000", 2021-10-08T19:31:14.523 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0050469269999999997 2021-10-08T19:31:14.523 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.524 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.524 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:14.524 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.223599+0000", 2021-10-08T19:31:14.524 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001002251 2021-10-08T19:31:14.524 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.525 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.525 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:31:14.525 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.223652+0000", 2021-10-08T19:31:14.525 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2967000000000003e-05 2021-10-08T19:31:14.526 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.526 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.526 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:14.526 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.223702+0000", 2021-10-08T19:31:14.527 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9839999999999997e-05 2021-10-08T19:31:14.527 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:14.527 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:14.527 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:14.527 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.528 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.528 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:73459 8.1 8:80fc3f9b:::benchmark_data_smithi097_144160_object73458:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e208)", 2021-10-08T19:31:14.528 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:28:48.173197+0000", 2021-10-08T19:31:14.528 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 146.148358355, 2021-10-08T19:31:14.529 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0506631469999999, 2021-10-08T19:31:14.529 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:14.529 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:31:14.529 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:31:14.529 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:31:14.530 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:31:14.530 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 73459 2021-10-08T19:31:14.530 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.530 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:14.531 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.531 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:14.531 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.173197+0000", 2021-10-08T19:31:14.531 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:14.531 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.532 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.532 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:14.532 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.173197+0000", 2021-10-08T19:31:14.532 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:14.532 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.533 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.533 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:14.533 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.173194+0000", 2021-10-08T19:31:14.533 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:31:14.534 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.534 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.534 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:14.534 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.173244+0000", 2021-10-08T19:31:14.534 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9483e-05 2021-10-08T19:31:14.535 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.535 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.535 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:14.535 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.173260+0000", 2021-10-08T19:31:14.536 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6578999999999998e-05 2021-10-08T19:31:14.536 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.536 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.536 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:14.536 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.173268+0000", 2021-10-08T19:31:14.537 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4590000000000001e-06 2021-10-08T19:31:14.537 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.537 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.537 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.537 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.173327+0000", 2021-10-08T19:31:14.538 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9518000000000002e-05 2021-10-08T19:31:14.538 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.538 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.538 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:31:14.539 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.173338+0000", 2021-10-08T19:31:14.539 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1144999999999999e-05 2021-10-08T19:31:14.539 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.539 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.539 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.540 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.972143+0000", 2021-10-08T19:31:14.540 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.79880444799999994 2021-10-08T19:31:14.540 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.540 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.540 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for readable", 2021-10-08T19:31:14.541 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.972169+0000", 2021-10-08T19:31:14.541 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6316999999999999e-05 2021-10-08T19:31:14.541 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.541 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.541 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.542 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.217749+0000", 2021-10-08T19:31:14.542 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2455802719999998 2021-10-08T19:31:14.542 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.542 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.543 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:14.543 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.217869+0000", 2021-10-08T19:31:14.543 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119535 2021-10-08T19:31:14.543 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.543 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.544 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:31:14.544 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.218041+0000", 2021-10-08T19:31:14.544 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017240800000000001 2021-10-08T19:31:14.544 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.545 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.545 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:31:14.545 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.222786+0000", 2021-10-08T19:31:14.545 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0047445330000000004 2021-10-08T19:31:14.545 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.546 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.546 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:14.546 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.222846+0000", 2021-10-08T19:31:14.546 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9587999999999999e-05 2021-10-08T19:31:14.547 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.547 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.547 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:14.547 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.223741+0000", 2021-10-08T19:31:14.547 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00089562400000000003 2021-10-08T19:31:14.548 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.548 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.548 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:31:14.549 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.223813+0000", 2021-10-08T19:31:14.549 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1542e-05 2021-10-08T19:31:14.549 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.549 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.550 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:14.550 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.223860+0000", 2021-10-08T19:31:14.550 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7153000000000001e-05 2021-10-08T19:31:14.550 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:14.550 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:14.551 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:14.551 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.551 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.551 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:73493 8.1 8:8aa4135b:::benchmark_data_smithi097_144160_object73492:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e208)", 2021-10-08T19:31:14.552 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:28:48.209399+0000", 2021-10-08T19:31:14.552 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 146.11215654599999, 2021-10-08T19:31:14.552 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0145988500000005, 2021-10-08T19:31:14.552 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:14.553 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:31:14.553 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:31:14.553 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:31:14.553 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:31:14.554 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 73493 2021-10-08T19:31:14.554 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.554 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:14.554 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.554 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:14.555 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.209399+0000", 2021-10-08T19:31:14.555 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:14.555 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.555 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.556 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:14.556 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.209399+0000", 2021-10-08T19:31:14.556 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:14.556 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.557 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.557 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:14.557 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.209396+0000", 2021-10-08T19:31:14.557 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2021-10-08T19:31:14.557 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.558 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.558 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:14.558 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.209421+0000", 2021-10-08T19:31:14.558 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5494e-05 2021-10-08T19:31:14.559 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.559 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.559 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:14.559 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.209437+0000", 2021-10-08T19:31:14.559 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5841999999999998e-05 2021-10-08T19:31:14.560 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.560 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.560 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:14.560 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.209444+0000", 2021-10-08T19:31:14.561 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.187e-06 2021-10-08T19:31:14.561 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.561 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.561 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.562 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.211618+0000", 2021-10-08T19:31:14.562 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021735750000000001 2021-10-08T19:31:14.562 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.562 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.562 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:31:14.563 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.211630+0000", 2021-10-08T19:31:14.563 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1909000000000001e-05 2021-10-08T19:31:14.563 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.563 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.564 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.564 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.972189+0000", 2021-10-08T19:31:14.564 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.76055948399999995 2021-10-08T19:31:14.564 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.564 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.565 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for readable", 2021-10-08T19:31:14.565 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.972219+0000", 2021-10-08T19:31:14.565 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9390000000000002e-05 2021-10-08T19:31:14.565 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.566 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.566 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.566 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.220189+0000", 2021-10-08T19:31:14.566 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2479707830000004 2021-10-08T19:31:14.566 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.567 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.567 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:14.567 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.220316+0000", 2021-10-08T19:31:14.567 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012622999999999999 2021-10-08T19:31:14.568 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.568 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.568 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:31:14.568 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.220488+0000", 2021-10-08T19:31:14.568 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000171991 2021-10-08T19:31:14.569 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.569 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.569 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:31:14.569 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.223026+0000", 2021-10-08T19:31:14.570 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002538003 2021-10-08T19:31:14.570 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.570 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.570 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:14.571 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.223280+0000", 2021-10-08T19:31:14.571 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00025402500000000001 2021-10-08T19:31:14.571 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.571 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.571 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:14.572 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.223910+0000", 2021-10-08T19:31:14.572 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00063042100000000004 2021-10-08T19:31:14.572 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.572 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.572 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:31:14.573 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.223957+0000", 2021-10-08T19:31:14.573 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6814999999999998e-05 2021-10-08T19:31:14.573 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.573 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.574 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:14.574 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.223997+0000", 2021-10-08T19:31:14.574 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0568999999999997e-05 2021-10-08T19:31:14.574 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:14.574 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:14.575 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:14.575 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.575 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.575 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:73503 8.1 8:8ed958bb:::benchmark_data_smithi097_144160_object73502:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e208)", 2021-10-08T19:31:14.576 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:28:48.225494+0000", 2021-10-08T19:31:14.576 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 146.09606064100001, 2021-10-08T19:31:14.576 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0164567620000007, 2021-10-08T19:31:14.576 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:14.576 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:31:14.577 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:31:14.577 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:31:14.577 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:31:14.577 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 73503 2021-10-08T19:31:14.577 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.578 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:14.578 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.578 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:14.578 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.225494+0000", 2021-10-08T19:31:14.579 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:14.579 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.579 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.579 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:14.579 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.225494+0000", 2021-10-08T19:31:14.580 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:14.580 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.580 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.580 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:14.581 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.225492+0000", 2021-10-08T19:31:14.581 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:31:14.581 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.581 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.581 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:14.582 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.225520+0000", 2021-10-08T19:31:14.582 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8296000000000001e-05 2021-10-08T19:31:14.582 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.582 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.583 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:14.583 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.225536+0000", 2021-10-08T19:31:14.583 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5951999999999999e-05 2021-10-08T19:31:14.583 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.584 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.584 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:14.584 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.225544+0000", 2021-10-08T19:31:14.584 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6769999999999995e-06 2021-10-08T19:31:14.584 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.585 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.585 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.585 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.225593+0000", 2021-10-08T19:31:14.585 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9713000000000003e-05 2021-10-08T19:31:14.586 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.586 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.586 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:31:14.586 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.225604+0000", 2021-10-08T19:31:14.586 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0994e-05 2021-10-08T19:31:14.587 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.587 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.587 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.587 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.972240+0000", 2021-10-08T19:31:14.588 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.74663569399999996 2021-10-08T19:31:14.588 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.588 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.588 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for readable", 2021-10-08T19:31:14.588 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.972270+0000", 2021-10-08T19:31:14.589 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9702000000000001e-05 2021-10-08T19:31:14.589 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.589 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.589 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.590 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.224039+0000", 2021-10-08T19:31:14.590 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2517693479999998 2021-10-08T19:31:14.590 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.590 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.590 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:14.591 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.224188+0000", 2021-10-08T19:31:14.591 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000148484 2021-10-08T19:31:14.591 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.591 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.592 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:31:14.592 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.224381+0000", 2021-10-08T19:31:14.592 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019333299999999999 2021-10-08T19:31:14.592 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.592 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.593 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:14.593 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.241712+0000", 2021-10-08T19:31:14.593 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.017330785000000001 2021-10-08T19:31:14.593 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.594 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.594 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:14.594 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.241733+0000", 2021-10-08T19:31:14.594 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1189999999999999e-05 2021-10-08T19:31:14.594 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.595 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.595 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:31:14.595 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.241853+0000", 2021-10-08T19:31:14.595 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000120291 2021-10-08T19:31:14.596 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.596 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.596 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:31:14.596 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.241907+0000", 2021-10-08T19:31:14.596 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4184000000000002e-05 2021-10-08T19:31:14.597 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.597 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.597 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:14.597 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.241951+0000", 2021-10-08T19:31:14.598 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3727999999999999e-05 2021-10-08T19:31:14.598 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:14.598 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:14.598 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:14.598 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.599 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.599 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:73506 8.1 8:834b0d8a:::benchmark_data_smithi097_144160_object73505:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e208)", 2021-10-08T19:31:14.599 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:28:48.226088+0000", 2021-10-08T19:31:14.599 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 146.095467423, 2021-10-08T19:31:14.600 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0227127159999991, 2021-10-08T19:31:14.600 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:14.600 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:31:14.600 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:31:14.600 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:31:14.601 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:31:14.601 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 73506 2021-10-08T19:31:14.601 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.601 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:14.602 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.602 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:14.602 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.226088+0000", 2021-10-08T19:31:14.602 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:14.603 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.603 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.603 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:14.603 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.226088+0000", 2021-10-08T19:31:14.603 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:14.604 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.604 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.604 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:14.604 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.226086+0000", 2021-10-08T19:31:14.604 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2021-10-08T19:31:14.605 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.605 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.605 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:14.605 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.226121+0000", 2021-10-08T19:31:14.606 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4876999999999998e-05 2021-10-08T19:31:14.606 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.606 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.606 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:14.606 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.226132+0000", 2021-10-08T19:31:14.607 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0958000000000001e-05 2021-10-08T19:31:14.607 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.607 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.607 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:14.608 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.226138+0000", 2021-10-08T19:31:14.608 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3099999999999997e-06 2021-10-08T19:31:14.608 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.608 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.608 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.609 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.226195+0000", 2021-10-08T19:31:14.609 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6918e-05 2021-10-08T19:31:14.609 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.609 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.610 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:31:14.610 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.226206+0000", 2021-10-08T19:31:14.610 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0786e-05 2021-10-08T19:31:14.610 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.610 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.611 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.611 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.972292+0000", 2021-10-08T19:31:14.611 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.746085581 2021-10-08T19:31:14.611 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.612 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.612 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for readable", 2021-10-08T19:31:14.612 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.972320+0000", 2021-10-08T19:31:14.612 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8387000000000001e-05 2021-10-08T19:31:14.612 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.613 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.613 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.613 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.226739+0000", 2021-10-08T19:31:14.613 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2544193620000001 2021-10-08T19:31:14.614 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.614 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.614 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:14.614 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.226868+0000", 2021-10-08T19:31:14.614 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000128718 2021-10-08T19:31:14.615 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.615 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.615 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:31:14.615 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.227065+0000", 2021-10-08T19:31:14.615 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019734599999999999 2021-10-08T19:31:14.616 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.616 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.616 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:14.616 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.241752+0000", 2021-10-08T19:31:14.617 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.014686930000000001 2021-10-08T19:31:14.617 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.617 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.617 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:31:14.617 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.241958+0000", 2021-10-08T19:31:14.618 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00020532600000000001 2021-10-08T19:31:14.618 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.618 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.618 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:14.619 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.248702+0000", 2021-10-08T19:31:14.619 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0067438970000000004 2021-10-08T19:31:14.619 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.619 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.619 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:31:14.620 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.248758+0000", 2021-10-08T19:31:14.620 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5980000000000003e-05 2021-10-08T19:31:14.620 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.620 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.620 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:14.621 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.248800+0000", 2021-10-08T19:31:14.621 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2865999999999999e-05 2021-10-08T19:31:14.621 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:14.621 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:14.622 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:14.622 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.622 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.622 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:73515 8.1 8:85071a0d:::benchmark_data_smithi097_144160_object73514:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e208)", 2021-10-08T19:31:14.622 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:28:48.237082+0000", 2021-10-08T19:31:14.623 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 146.084473481, 2021-10-08T19:31:14.623 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0118306809999993, 2021-10-08T19:31:14.623 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:14.623 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:31:14.624 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:31:14.624 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:31:14.624 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:31:14.624 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 73515 2021-10-08T19:31:14.624 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.625 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:14.625 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.625 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:14.625 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.237082+0000", 2021-10-08T19:31:14.625 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:14.626 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.626 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.626 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:14.626 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.237082+0000", 2021-10-08T19:31:14.627 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:14.627 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.627 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.627 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:14.627 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.237079+0000", 2021-10-08T19:31:14.628 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:31:14.628 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.628 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.628 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:14.628 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.237111+0000", 2021-10-08T19:31:14.629 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1313999999999999e-05 2021-10-08T19:31:14.629 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.629 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.629 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:14.630 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.237126+0000", 2021-10-08T19:31:14.630 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5684000000000001e-05 2021-10-08T19:31:14.630 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.630 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.630 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:14.631 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.237134+0000", 2021-10-08T19:31:14.631 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8350000000000004e-06 2021-10-08T19:31:14.631 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.631 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.632 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.632 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.237191+0000", 2021-10-08T19:31:14.632 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6390000000000001e-05 2021-10-08T19:31:14.632 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.632 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.633 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:31:14.633 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.237202+0000", 2021-10-08T19:31:14.633 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1265e-05 2021-10-08T19:31:14.633 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.633 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.634 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.634 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.972343+0000", 2021-10-08T19:31:14.634 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.73514136799999996 2021-10-08T19:31:14.634 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.635 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.635 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for readable", 2021-10-08T19:31:14.635 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.972373+0000", 2021-10-08T19:31:14.635 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0137999999999998e-05 2021-10-08T19:31:14.635 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.636 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.636 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.636 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.229315+0000", 2021-10-08T19:31:14.636 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2569420009999996 2021-10-08T19:31:14.637 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.637 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.637 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:14.637 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.229524+0000", 2021-10-08T19:31:14.637 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000209039 2021-10-08T19:31:14.638 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.638 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.638 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:31:14.638 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.229702+0000", 2021-10-08T19:31:14.639 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017795500000000001 2021-10-08T19:31:14.639 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.639 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.639 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:14.640 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.241842+0000", 2021-10-08T19:31:14.640 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012139199 2021-10-08T19:31:14.640 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.640 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.640 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:31:14.641 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.241961+0000", 2021-10-08T19:31:14.641 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119314 2021-10-08T19:31:14.641 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.641 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.642 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:14.642 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.248836+0000", 2021-10-08T19:31:14.642 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0068755209999999999 2021-10-08T19:31:14.642 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.643 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.643 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:31:14.643 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.248876+0000", 2021-10-08T19:31:14.643 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9331e-05 2021-10-08T19:31:14.644 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.644 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.644 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:14.644 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.248912+0000", 2021-10-08T19:31:14.645 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6565e-05 2021-10-08T19:31:14.645 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:14.645 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:14.645 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:14.645 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.646 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.646 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:73526 8.1 8:894ab48c:::benchmark_data_smithi097_144160_object73525:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e208)", 2021-10-08T19:31:14.646 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:28:48.253529+0000", 2021-10-08T19:31:14.646 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 146.0680256, 2021-10-08T19:31:14.647 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.9983281320000001, 2021-10-08T19:31:14.647 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:14.647 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:31:14.647 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:31:14.647 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:31:14.648 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:31:14.648 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 73526 2021-10-08T19:31:14.648 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.648 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:14.649 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.649 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:14.649 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.253529+0000", 2021-10-08T19:31:14.649 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:14.649 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.650 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.650 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:14.650 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.253529+0000", 2021-10-08T19:31:14.650 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:14.651 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.651 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.651 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:14.651 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.253527+0000", 2021-10-08T19:31:14.651 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:31:14.652 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.652 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.652 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:14.652 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.253584+0000", 2021-10-08T19:31:14.652 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7321999999999998e-05 2021-10-08T19:31:14.653 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.653 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.653 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:14.653 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.253601+0000", 2021-10-08T19:31:14.654 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6806000000000001e-05 2021-10-08T19:31:14.654 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.654 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.654 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:14.655 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.253609+0000", 2021-10-08T19:31:14.655 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6920000000000002e-06 2021-10-08T19:31:14.655 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.655 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.655 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.656 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.253668+0000", 2021-10-08T19:31:14.656 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8767000000000002e-05 2021-10-08T19:31:14.656 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.656 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.657 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:31:14.657 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.253678+0000", 2021-10-08T19:31:14.657 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0321e-05 2021-10-08T19:31:14.657 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.657 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.658 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.658 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.972394+0000", 2021-10-08T19:31:14.658 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.718715565 2021-10-08T19:31:14.658 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.658 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.659 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for readable", 2021-10-08T19:31:14.659 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.972425+0000", 2021-10-08T19:31:14.659 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1086e-05 2021-10-08T19:31:14.659 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.659 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.660 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.660 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.231771+0000", 2021-10-08T19:31:14.660 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2593458379999998 2021-10-08T19:31:14.660 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.661 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.661 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:14.661 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.231889+0000", 2021-10-08T19:31:14.661 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011863599999999999 2021-10-08T19:31:14.661 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.662 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.662 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:31:14.662 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.232050+0000", 2021-10-08T19:31:14.662 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000160946 2021-10-08T19:31:14.662 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.663 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.663 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:31:14.663 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.242659+0000", 2021-10-08T19:31:14.663 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010608826999999999 2021-10-08T19:31:14.663 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.664 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.664 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:14.664 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.248946+0000", 2021-10-08T19:31:14.664 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0062872570000000001 2021-10-08T19:31:14.665 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.665 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.665 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:14.665 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.251757+0000", 2021-10-08T19:31:14.665 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028104940000000002 2021-10-08T19:31:14.666 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.666 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.666 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:31:14.666 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.251813+0000", 2021-10-08T19:31:14.666 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6793999999999999e-05 2021-10-08T19:31:14.667 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.667 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.667 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:14.667 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.251858+0000", 2021-10-08T19:31:14.668 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4144999999999998e-05 2021-10-08T19:31:14.668 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:14.668 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:14.668 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:14.668 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.669 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.669 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:73531 8.1 8:838e74b9:::benchmark_data_smithi097_144160_object73530:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e208)", 2021-10-08T19:31:14.669 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:28:48.263045+0000", 2021-10-08T19:31:14.669 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 146.058510493, 2021-10-08T19:31:14.669 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.9956922910000001, 2021-10-08T19:31:14.670 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:14.670 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:31:14.670 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:31:14.670 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:31:14.671 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:31:14.672 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 73531 2021-10-08T19:31:14.672 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.672 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:14.672 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.673 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:14.673 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.263045+0000", 2021-10-08T19:31:14.673 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:14.673 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.674 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.674 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:14.674 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.263045+0000", 2021-10-08T19:31:14.674 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:14.674 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.675 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.675 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:14.675 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.263042+0000", 2021-10-08T19:31:14.675 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2021-10-08T19:31:14.676 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.676 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.676 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:14.676 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.263105+0000", 2021-10-08T19:31:14.676 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3717e-05 2021-10-08T19:31:14.677 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.677 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.677 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:14.677 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.263118+0000", 2021-10-08T19:31:14.678 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2211999999999999e-05 2021-10-08T19:31:14.678 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.678 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.678 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:14.678 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.263125+0000", 2021-10-08T19:31:14.679 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3440000000000003e-06 2021-10-08T19:31:14.679 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.679 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.679 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.680 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.263190+0000", 2021-10-08T19:31:14.680 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4729999999999999e-05 2021-10-08T19:31:14.680 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.680 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.681 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:31:14.681 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.263202+0000", 2021-10-08T19:31:14.681 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2337999999999999e-05 2021-10-08T19:31:14.681 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.682 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.682 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.682 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.972445+0000", 2021-10-08T19:31:14.682 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.70924335400000005 2021-10-08T19:31:14.682 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.683 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.683 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for readable", 2021-10-08T19:31:14.683 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.972476+0000", 2021-10-08T19:31:14.683 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0936999999999999e-05 2021-10-08T19:31:14.684 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.684 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.684 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.684 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.234284+0000", 2021-10-08T19:31:14.685 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2618073860000001 2021-10-08T19:31:14.685 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.685 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.685 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:14.686 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.234399+0000", 2021-10-08T19:31:14.686 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000114945 2021-10-08T19:31:14.686 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.686 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.686 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:31:14.687 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.234551+0000", 2021-10-08T19:31:14.687 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000152705 2021-10-08T19:31:14.687 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.687 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.688 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:31:14.688 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.242819+0000", 2021-10-08T19:31:14.688 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0082671419999999999 2021-10-08T19:31:14.688 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.688 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.689 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:14.689 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.252007+0000", 2021-10-08T19:31:14.689 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0091881629999999992 2021-10-08T19:31:14.689 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.689 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.690 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:14.690 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.258634+0000", 2021-10-08T19:31:14.690 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0066275429999999996 2021-10-08T19:31:14.690 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.691 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.691 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:31:14.691 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.258692+0000", 2021-10-08T19:31:14.691 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7448000000000003e-05 2021-10-08T19:31:14.691 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.692 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.692 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:14.692 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.258737+0000", 2021-10-08T19:31:14.692 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5151999999999997e-05 2021-10-08T19:31:14.693 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:14.693 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:14.693 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:14.693 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.694 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.694 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:73552 8.1 8:846186fd:::benchmark_data_smithi097_144160_object73551:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e208)", 2021-10-08T19:31:14.694 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:28:48.333502+0000", 2021-10-08T19:31:14.694 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 145.98805296200001, 2021-10-08T19:31:14.694 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.9253566009999998, 2021-10-08T19:31:14.695 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:14.695 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:31:14.695 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:31:14.695 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:31:14.696 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:31:14.696 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 73552 2021-10-08T19:31:14.696 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.696 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:14.697 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.697 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:14.697 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.333502+0000", 2021-10-08T19:31:14.697 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:14.697 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.698 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.698 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:14.698 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.333502+0000", 2021-10-08T19:31:14.698 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:14.699 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.699 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.699 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:14.699 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.333499+0000", 2021-10-08T19:31:14.699 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2021-10-08T19:31:14.700 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.700 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.700 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:14.700 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.333551+0000", 2021-10-08T19:31:14.701 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1662000000000001e-05 2021-10-08T19:31:14.701 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.701 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.701 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:14.701 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.333567+0000", 2021-10-08T19:31:14.702 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5372000000000001e-05 2021-10-08T19:31:14.702 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.702 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.702 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:14.703 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.333573+0000", 2021-10-08T19:31:14.703 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3960000000000003e-06 2021-10-08T19:31:14.703 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.703 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.704 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.704 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.333621+0000", 2021-10-08T19:31:14.704 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8152999999999998e-05 2021-10-08T19:31:14.704 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.704 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.705 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:31:14.705 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.333630+0000", 2021-10-08T19:31:14.705 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.3279999999999995e-06 2021-10-08T19:31:14.705 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.705 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.706 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.706 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.972500+0000", 2021-10-08T19:31:14.706 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.63886973700000005 2021-10-08T19:31:14.706 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.707 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.707 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for readable", 2021-10-08T19:31:14.707 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.972531+0000", 2021-10-08T19:31:14.707 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1198999999999997e-05 2021-10-08T19:31:14.707 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.708 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.708 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.708 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.237087+0000", 2021-10-08T19:31:14.708 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2645553239999998 2021-10-08T19:31:14.708 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.709 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.709 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:14.709 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.237233+0000", 2021-10-08T19:31:14.709 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014594900000000001 2021-10-08T19:31:14.710 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.710 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.710 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:31:14.710 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.237423+0000", 2021-10-08T19:31:14.710 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00018993300000000001 2021-10-08T19:31:14.711 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.711 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.711 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:31:14.711 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.242827+0000", 2021-10-08T19:31:14.712 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0054044130000000003 2021-10-08T19:31:14.712 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.712 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.712 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:14.712 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.252036+0000", 2021-10-08T19:31:14.713 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0092086909999999998 2021-10-08T19:31:14.713 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.713 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.713 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:14.714 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.258774+0000", 2021-10-08T19:31:14.714 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0067388739999999997 2021-10-08T19:31:14.714 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.714 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.714 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:31:14.715 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.258817+0000", 2021-10-08T19:31:14.715 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2134e-05 2021-10-08T19:31:14.715 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.715 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.716 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:14.716 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.258859+0000", 2021-10-08T19:31:14.716 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2088000000000001e-05 2021-10-08T19:31:14.716 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:14.716 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:14.717 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:14.717 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.717 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.717 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:95876 8.7 8:ed483f67:::benchmark_data_smithi097_144160_object7136:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e227)", 2021-10-08T19:31:14.718 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:29.710830+0000", 2021-10-08T19:31:14.718 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 104.61072551300001, 2021-10-08T19:31:14.718 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.979034229, 2021-10-08T19:31:14.718 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:14.719 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:31:14.719 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:31:14.719 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:31:14.719 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:31:14.719 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 95876 2021-10-08T19:31:14.720 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.720 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:14.720 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.720 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:14.720 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.710830+0000", 2021-10-08T19:31:14.721 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:14.721 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.721 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.721 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:14.722 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.710830+0000", 2021-10-08T19:31:14.722 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:14.722 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.722 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.722 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:14.723 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.710829+0000", 2021-10-08T19:31:14.723 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2021-10-08T19:31:14.723 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.723 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.724 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:14.724 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.710832+0000", 2021-10-08T19:31:14.724 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.92e-06 2021-10-08T19:31:14.724 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.724 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.725 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:14.725 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.710837+0000", 2021-10-08T19:31:14.725 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7690000000000004e-06 2021-10-08T19:31:14.725 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.726 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.726 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:14.726 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.710840+0000", 2021-10-08T19:31:14.726 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7910000000000002e-06 2021-10-08T19:31:14.726 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.727 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.727 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.727 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.723411+0000", 2021-10-08T19:31:14.727 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012570375 2021-10-08T19:31:14.727 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.728 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.728 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:31:14.728 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.723419+0000", 2021-10-08T19:31:14.728 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8159999999999994e-06 2021-10-08T19:31:14.729 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.729 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.729 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.729 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:30.607520+0000", 2021-10-08T19:31:14.729 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.88410164899999999 2021-10-08T19:31:14.730 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.730 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.730 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:31:14.730 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:30.607530+0000", 2021-10-08T19:31:14.731 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0020000000000001e-05 2021-10-08T19:31:14.731 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.731 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.731 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.731 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.677368+0000", 2021-10-08T19:31:14.732 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.069837903 2021-10-08T19:31:14.732 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.732 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.732 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:14.732 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.677501+0000", 2021-10-08T19:31:14.733 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013285200000000001 2021-10-08T19:31:14.733 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.733 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.733 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2,3,6", 2021-10-08T19:31:14.734 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.677840+0000", 2021-10-08T19:31:14.734 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00033849599999999998 2021-10-08T19:31:14.734 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.734 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.734 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:14.735 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.684574+0000", 2021-10-08T19:31:14.735 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0067339519999999996 2021-10-08T19:31:14.735 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.735 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.736 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:14.736 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.689716+0000", 2021-10-08T19:31:14.736 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0051427740000000001 2021-10-08T19:31:14.736 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.736 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.737 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:14.737 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.689743+0000", 2021-10-08T19:31:14.737 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6888000000000001e-05 2021-10-08T19:31:14.737 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.738 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.738 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:31:14.738 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.689748+0000", 2021-10-08T19:31:14.738 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1479999999999997e-06 2021-10-08T19:31:14.738 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.739 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.739 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:31:14.739 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.689793+0000", 2021-10-08T19:31:14.739 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5124999999999999e-05 2021-10-08T19:31:14.739 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.740 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.740 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:14.740 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.689864+0000", 2021-10-08T19:31:14.740 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0307000000000003e-05 2021-10-08T19:31:14.741 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:14.741 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:14.741 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:14.741 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.741 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.742 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:137829 8.a 8:5bb01cef:::benchmark_data_smithi097_144160_object49089:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e255)", 2021-10-08T19:31:14.742 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:30:31.670983+0000", 2021-10-08T19:31:14.742 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 42.650571906000003, 2021-10-08T19:31:14.742 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1752541220000001, 2021-10-08T19:31:14.743 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:14.743 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "reached pg", 2021-10-08T19:31:14.743 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:31:14.743 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:31:14.743 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:31:14.744 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 137829 2021-10-08T19:31:14.744 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.744 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:14.744 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.745 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:14.745 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.670983+0000", 2021-10-08T19:31:14.745 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:14.745 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.745 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.746 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:14.746 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.670983+0000", 2021-10-08T19:31:14.746 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:14.746 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.746 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.747 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:14.747 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.670982+0000", 2021-10-08T19:31:14.747 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:31:14.747 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.748 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.748 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:14.748 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.670986+0000", 2021-10-08T19:31:14.748 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6490000000000001e-06 2021-10-08T19:31:14.748 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.749 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.749 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:14.749 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.670992+0000", 2021-10-08T19:31:14.749 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5809999999999996e-06 2021-10-08T19:31:14.749 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.750 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.750 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:14.750 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.670996+0000", 2021-10-08T19:31:14.750 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2490000000000003e-06 2021-10-08T19:31:14.751 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.751 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.751 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.751 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.671117+0000", 2021-10-08T19:31:14.751 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000121508 2021-10-08T19:31:14.752 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.752 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.752 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:14.752 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.671262+0000", 2021-10-08T19:31:14.753 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014427999999999999 2021-10-08T19:31:14.753 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.753 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.753 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2,5", 2021-10-08T19:31:14.754 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.671404+0000", 2021-10-08T19:31:14.754 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014233200000000001 2021-10-08T19:31:14.754 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.754 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.755 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:14.755 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.685662+0000", 2021-10-08T19:31:14.755 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.014258239000000001 2021-10-08T19:31:14.755 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.755 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.756 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.756 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.699603+0000", 2021-10-08T19:31:14.756 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013941011 2021-10-08T19:31:14.756 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.757 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.757 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:31:14.757 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.699611+0000", 2021-10-08T19:31:14.757 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6799999999999993e-06 2021-10-08T19:31:14.758 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.758 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.758 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.759 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:32.679865+0000", 2021-10-08T19:31:14.759 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.98025384999999998 2021-10-08T19:31:14.759 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.759 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.760 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:31:14.760 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:32.679874+0000", 2021-10-08T19:31:14.760 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9199999999999993e-06 2021-10-08T19:31:14.760 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.760 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.761 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.761 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.834263+0000", 2021-10-08T19:31:14.761 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1543893329999999 2021-10-08T19:31:14.761 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.762 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.762 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for missing object", 2021-10-08T19:31:14.762 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.834418+0000", 2021-10-08T19:31:14.762 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015502199999999999 2021-10-08T19:31:14.762 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.763 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.763 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.763 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.846158+0000", 2021-10-08T19:31:14.763 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011740357 2021-10-08T19:31:14.763 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.764 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.764 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:14.768 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.846237+0000", 2021-10-08T19:31:14.768 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8860000000000001e-05 2021-10-08T19:31:14.768 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:14.769 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:14.769 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:14.769 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.769 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.770 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:137883 8.a 8:5b9b623f:::benchmark_data_smithi097_144160_object49143:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e256)", 2021-10-08T19:31:14.770 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:30:31.734959+0000", 2021-10-08T19:31:14.770 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 42.586596503999999, 2021-10-08T19:31:14.770 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.110620108, 2021-10-08T19:31:14.770 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:14.771 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:31:14.771 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:31:14.771 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:31:14.771 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:31:14.772 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 137883 2021-10-08T19:31:14.772 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.772 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:14.772 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.773 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:14.773 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.734959+0000", 2021-10-08T19:31:14.773 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:14.773 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.773 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.774 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:14.774 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.734959+0000", 2021-10-08T19:31:14.774 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:14.774 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.775 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.775 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:14.775 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.734956+0000", 2021-10-08T19:31:14.775 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2021-10-08T19:31:14.776 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.776 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.776 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:14.776 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.734965+0000", 2021-10-08T19:31:14.776 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.3989999999999993e-06 2021-10-08T19:31:14.777 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.777 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.777 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:14.777 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.734981+0000", 2021-10-08T19:31:14.778 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5645999999999999e-05 2021-10-08T19:31:14.778 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.778 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.778 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:14.779 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.734989+0000", 2021-10-08T19:31:14.779 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.9100000000000005e-06 2021-10-08T19:31:14.779 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.779 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.780 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.780 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.735032+0000", 2021-10-08T19:31:14.780 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2794999999999999e-05 2021-10-08T19:31:14.780 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.780 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.781 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:31:14.781 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.735038+0000", 2021-10-08T19:31:14.781 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5989999999999998e-06 2021-10-08T19:31:14.781 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.782 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.782 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.782 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:32.679900+0000", 2021-10-08T19:31:14.782 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.94486208100000002 2021-10-08T19:31:14.783 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.783 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.783 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:31:14.783 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:32.679906+0000", 2021-10-08T19:31:14.783 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1029999999999998e-06 2021-10-08T19:31:14.784 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.784 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.784 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.784 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.834719+0000", 2021-10-08T19:31:14.784 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.154812773 2021-10-08T19:31:14.785 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.785 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.785 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:14.785 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.834815+0000", 2021-10-08T19:31:14.786 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5756999999999998e-05 2021-10-08T19:31:14.786 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.786 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.786 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2,3,5", 2021-10-08T19:31:14.786 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.834917+0000", 2021-10-08T19:31:14.787 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000101747 2021-10-08T19:31:14.787 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.787 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.787 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:31:14.787 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.838984+0000", 2021-10-08T19:31:14.788 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0040676139999999998 2021-10-08T19:31:14.788 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.788 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.788 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:14.789 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.843891+0000", 2021-10-08T19:31:14.789 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0049068590000000004 2021-10-08T19:31:14.789 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.789 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.789 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:14.790 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.845112+0000", 2021-10-08T19:31:14.790 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012211520000000001 2021-10-08T19:31:14.790 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.790 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.791 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:14.791 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.845373+0000", 2021-10-08T19:31:14.791 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00026047599999999999 2021-10-08T19:31:14.791 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.791 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.792 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:31:14.792 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.845439+0000", 2021-10-08T19:31:14.792 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6371000000000005e-05 2021-10-08T19:31:14.792 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.792 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.793 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:14.793 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.845579+0000", 2021-10-08T19:31:14.793 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013954700000000001 2021-10-08T19:31:14.793 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:14.794 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:14.794 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:14.794 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.794 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.794 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:137899 8.a 8:576e2e59:::benchmark_data_smithi097_144160_object49159:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e256)", 2021-10-08T19:31:14.795 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:30:31.755542+0000", 2021-10-08T19:31:14.795 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 42.566013122000001, 2021-10-08T19:31:14.795 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0905790579999999, 2021-10-08T19:31:14.795 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:14.796 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:31:14.796 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:31:14.796 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:31:14.796 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:31:14.797 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 137899 2021-10-08T19:31:14.797 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.797 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:14.797 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.797 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:14.798 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.755542+0000", 2021-10-08T19:31:14.798 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:14.798 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.798 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.798 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:14.799 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.755542+0000", 2021-10-08T19:31:14.799 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:14.799 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.799 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.800 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:14.800 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.755540+0000", 2021-10-08T19:31:14.800 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:31:14.800 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.800 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.801 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:14.801 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.755547+0000", 2021-10-08T19:31:14.801 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.567e-06 2021-10-08T19:31:14.801 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.801 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.802 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:14.802 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.755557+0000", 2021-10-08T19:31:14.802 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.6739999999999992e-06 2021-10-08T19:31:14.802 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.803 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.803 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:14.803 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.755561+0000", 2021-10-08T19:31:14.803 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7520000000000004e-06 2021-10-08T19:31:14.803 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.804 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.804 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.804 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.755611+0000", 2021-10-08T19:31:14.804 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9812999999999999e-05 2021-10-08T19:31:14.805 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.805 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.805 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:31:14.805 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.755617+0000", 2021-10-08T19:31:14.805 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8710000000000002e-06 2021-10-08T19:31:14.806 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.806 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.806 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.806 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:32.679928+0000", 2021-10-08T19:31:14.807 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.92431098199999995 2021-10-08T19:31:14.807 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.807 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.807 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:31:14.807 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:32.679931+0000", 2021-10-08T19:31:14.808 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5360000000000001e-06 2021-10-08T19:31:14.808 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.808 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.808 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:14.809 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.836873+0000", 2021-10-08T19:31:14.809 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.156941091 2021-10-08T19:31:14.809 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.809 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.809 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:14.810 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.837005+0000", 2021-10-08T19:31:14.810 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000132309 2021-10-08T19:31:14.810 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.810 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.811 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2,3,5", 2021-10-08T19:31:14.811 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.837148+0000", 2021-10-08T19:31:14.811 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014335699999999999 2021-10-08T19:31:14.811 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.811 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.812 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:31:14.812 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.839046+0000", 2021-10-08T19:31:14.812 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001897934 2021-10-08T19:31:14.812 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.812 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.813 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:14.813 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.843924+0000", 2021-10-08T19:31:14.813 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.004877808 2021-10-08T19:31:14.813 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.814 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.814 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:14.814 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.845338+0000", 2021-10-08T19:31:14.814 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0014141900000000001 2021-10-08T19:31:14.814 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.815 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.815 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:14.815 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.845936+0000", 2021-10-08T19:31:14.815 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00059748699999999995 2021-10-08T19:31:14.815 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.816 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.816 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:31:14.816 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.845997+0000", 2021-10-08T19:31:14.816 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1303999999999994e-05 2021-10-08T19:31:14.817 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:14.817 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:14.817 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:14.817 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.846121+0000", 2021-10-08T19:31:14.817 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000124067 2021-10-08T19:31:14.818 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:14.818 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:14.818 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:14.818 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:14.819 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:14.819 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:31:15.020 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:31:15.435 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:31:15.441 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:15.442 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:31:15.544 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:31:15.589 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:15.690 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2021-10-08T19:31:15.860 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:31:15.862 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:15 smithi117 ceph-mon[34585]: pgmap v494: 178 pgs: 2 active+remapped+backfilling, 176 active+clean; 253 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1.28k op/s; 320/12681 objects misplaced (2.523%); 2.1 MiB/s, 33 objects/s recovering 2021-10-08T19:31:15.862 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:15 smithi117 ceph-mon[34585]: osdmap e279: 8 total, 8 up, 8 in 2021-10-08T19:31:15.863 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:15.864 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:31:15.966 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:31:15.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:15 smithi097 ceph-mon[32687]: pgmap v494: 178 pgs: 2 active+remapped+backfilling, 176 active+clean; 253 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1.28k op/s; 320/12681 objects misplaced (2.523%); 2.1 MiB/s, 33 objects/s recovering 2021-10-08T19:31:15.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:15 smithi097 ceph-mon[32687]: osdmap e279: 8 total, 8 up, 8 in 2021-10-08T19:31:15.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:15 smithi097 ceph-mon[41966]: pgmap v494: 178 pgs: 2 active+remapped+backfilling, 176 active+clean; 253 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1.28k op/s; 320/12681 objects misplaced (2.523%); 2.1 MiB/s, 33 objects/s recovering 2021-10-08T19:31:15.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:15 smithi097 ceph-mon[41966]: osdmap e279: 8 total, 8 up, 8 in 2021-10-08T19:31:15.991 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:16.946 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:31:16.954 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:16.955 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:31:17.056 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:31:17.078 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:31:17.079 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:31:16 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:31:17.083 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:17.143 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:31:17.146 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:17.147 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:31:17.249 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:31:17.280 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:17.339 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:31:17.348 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:17.349 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:31:17.449 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:31:17.507 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:17.893 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:31:17.973 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:31:18.019 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:31:18.060 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:31:18.093 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:31:18.131 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:31:18.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:17 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:31:18.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:17 smithi117 ceph-mon[34585]: pgmap v496: 178 pgs: 2 active+remapped+backfilling, 176 active+clean; 253 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 847 B/s rd, 0 B/s wr, 732 op/s; 320/12681 objects misplaced (2.523%); 1.2 MiB/s, 19 objects/s recovering 2021-10-08T19:31:18.162 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:31:18.199 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:31:18.201 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:31:18.206 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:18.208 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:31:18.208 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:17 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:31:18.208 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:17 smithi097 ceph-mon[41966]: pgmap v496: 178 pgs: 2 active+remapped+backfilling, 176 active+clean; 253 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 847 B/s rd, 0 B/s wr, 732 op/s; 320/12681 objects misplaced (2.523%); 1.2 MiB/s, 19 objects/s recovering 2021-10-08T19:31:18.209 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:17 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:31:18.209 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:17 smithi097 ceph-mon[32687]: pgmap v496: 178 pgs: 2 active+remapped+backfilling, 176 active+clean; 253 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 847 B/s rd, 0 B/s wr, 732 op/s; 320/12681 objects misplaced (2.523%); 1.2 MiB/s, 19 objects/s recovering 2021-10-08T19:31:18.217 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'false' 2021-10-08T19:31:18.217 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'false' 2021-10-08T19:31:18.218 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'false' 2021-10-08T19:31:18.218 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'false' 2021-10-08T19:31:18.218 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'false' 2021-10-08T19:31:18.218 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'false' 2021-10-08T19:31:18.219 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'false' 2021-10-08T19:31:18.219 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'false' 2021-10-08T19:31:18.309 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:31:18.335 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:18.406 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:31:18.408 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:18.409 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:31:18.510 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:31:18.568 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:18.746 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Removed 88737 objects 2021-10-08T19:31:18.747 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Clean up completed and total clean up time :117.038 2021-10-08T19:31:18.762 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is unset 2021-10-08T19:31:18.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:18 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2062340279' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:31:18.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:18 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3633122282' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:31:18.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:18 smithi097 ceph-mon[41966]: from='client.35417 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:31:18.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:18 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2062340279' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:31:18.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:18 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3633122282' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:31:18.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:18 smithi097 ceph-mon[32687]: from='client.35417 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:31:19.053 INFO:tasks.cephadm.ceph_manager.ceph:removing pool_name unique_pool_1 2021-10-08T19:31:19.054 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd pool rm unique_pool_1 unique_pool_1 --yes-i-really-really-mean-it 2021-10-08T19:31:19.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:18 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2062340279' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:31:19.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:18 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3633122282' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:31:19.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:18 smithi117 ceph-mon[34585]: from='client.35417 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:31:19.866 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:31:19.868 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:19.868 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:31:19.970 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:31:19.997 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:20.042 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:31:20.043 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:19 smithi117 ceph-mon[34585]: pgmap v497: 178 pgs: 1 active+clean+remapped, 1 active+remapped+backfilling, 176 active+clean; 161 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 736 op/s; 198/8271 objects misplaced (2.394%); 1.3 MiB/s, 21 objects/s recovering 2021-10-08T19:31:20.043 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:19 smithi117 ceph-mon[34585]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:31:20.044 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:19 smithi117 ceph-mon[34585]: from='client.35417 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:31:20.044 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:19 smithi117 ceph-mon[34585]: osdmap e280: 8 total, 8 up, 8 in 2021-10-08T19:31:20.044 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:19 smithi117 ceph-mon[34585]: 2.a scrub ok 2021-10-08T19:31:20.045 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:20.046 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:31:20.147 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:31:20.171 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:20.213 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:31:20.215 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:20.216 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:31:20.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:19 smithi097 ceph-mon[32687]: pgmap v497: 178 pgs: 1 active+clean+remapped, 1 active+remapped+backfilling, 176 active+clean; 161 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 736 op/s; 198/8271 objects misplaced (2.394%); 1.3 MiB/s, 21 objects/s recovering 2021-10-08T19:31:20.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:19 smithi097 ceph-mon[32687]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:31:20.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:19 smithi097 ceph-mon[32687]: from='client.35417 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:31:20.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:19 smithi097 ceph-mon[32687]: osdmap e280: 8 total, 8 up, 8 in 2021-10-08T19:31:20.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:19 smithi097 ceph-mon[32687]: 2.a scrub ok 2021-10-08T19:31:20.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:19 smithi097 ceph-mon[41966]: pgmap v497: 178 pgs: 1 active+clean+remapped, 1 active+remapped+backfilling, 176 active+clean; 161 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 736 op/s; 198/8271 objects misplaced (2.394%); 1.3 MiB/s, 21 objects/s recovering 2021-10-08T19:31:20.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:19 smithi097 ceph-mon[41966]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:31:20.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:19 smithi097 ceph-mon[41966]: from='client.35417 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:31:20.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:19 smithi097 ceph-mon[41966]: osdmap e280: 8 total, 8 up, 8 in 2021-10-08T19:31:20.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:19 smithi097 ceph-mon[41966]: 2.a scrub ok 2021-10-08T19:31:20.319 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:31:20.342 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:20.535 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:31:20.537 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:20.538 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:31:20.639 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:31:20.665 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:20.822 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:31:20.833 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:31:20.837 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:20.838 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:31:20.939 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:31:20.963 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:20 smithi097 ceph-mon[41966]: 2.1 scrub ok 2021-10-08T19:31:20.963 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:20 smithi097 ceph-mon[41966]: osdmap e281: 8 total, 8 up, 8 in 2021-10-08T19:31:20.964 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:20 smithi097 ceph-mon[32687]: 2.1 scrub ok 2021-10-08T19:31:20.965 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:20 smithi097 ceph-mon[32687]: osdmap e281: 8 total, 8 up, 8 in 2021-10-08T19:31:20.966 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:21.067 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:31:21.075 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:21.076 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:31:21.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:20 smithi117 ceph-mon[34585]: 2.1 scrub ok 2021-10-08T19:31:21.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:20 smithi117 ceph-mon[34585]: osdmap e281: 8 total, 8 up, 8 in 2021-10-08T19:31:21.178 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:31:21.204 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:21.251 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2021-10-08T19:31:21.251 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:31:21.252 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:31:21.254 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:21.255 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:31:21.356 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:31:21.388 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:21.787 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.5 to 1 (10000) 2021-10-08T19:31:22.082 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:21 smithi097 ceph-mon[41966]: 2.e scrub ok 2021-10-08T19:31:22.083 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:21 smithi097 ceph-mon[41966]: pgmap v500: 178 pgs: 2 active+clean+remapped, 176 active+clean; 5.5 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 659 op/s; 1.1 MiB/s, 17 objects/s recovering 2021-10-08T19:31:22.083 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:21 smithi097 ceph-mon[41966]: osdmap e282: 8 total, 8 up, 8 in 2021-10-08T19:31:22.083 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:21 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2077109377' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2021-10-08T19:31:22.084 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:21 smithi097 ceph-mon[32687]: 2.e scrub ok 2021-10-08T19:31:22.084 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:21 smithi097 ceph-mon[32687]: pgmap v500: 178 pgs: 2 active+clean+remapped, 176 active+clean; 5.5 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 659 op/s; 1.1 MiB/s, 17 objects/s recovering 2021-10-08T19:31:22.084 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:21 smithi097 ceph-mon[32687]: osdmap e282: 8 total, 8 up, 8 in 2021-10-08T19:31:22.085 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:21 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2077109377' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2021-10-08T19:31:22.125 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2021-10-08T19:31:22.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:21 smithi117 ceph-mon[34585]: 2.e scrub ok 2021-10-08T19:31:22.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:21 smithi117 ceph-mon[34585]: pgmap v500: 178 pgs: 2 active+clean+remapped, 176 active+clean; 5.5 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 659 op/s; 1.1 MiB/s, 17 objects/s recovering 2021-10-08T19:31:22.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:21 smithi117 ceph-mon[34585]: osdmap e282: 8 total, 8 up, 8 in 2021-10-08T19:31:22.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:21 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2077109377' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2021-10-08T19:31:22.262 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2021-10-08T19:31:22.399 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:31:22.401 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:22.402 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:31:22.504 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:31:22.528 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:22.655 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:31:22 smithi117 conmon[69189]: level=error ts=2021-10-08T19:31:22.314Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=1 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:31:22.720 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:31:22 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:31:22] "GET /metrics HTTP/1.1" 200 155845 "" "Prometheus/2.18.1" 2021-10-08T19:31:22.721 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:31:22.723 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:22.724 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:31:22.825 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:31:22.839 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset nodeep-scrub 2021-10-08T19:31:22.849 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:22.916 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:31:22.919 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:22.920 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:31:23.022 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:31:23.047 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:22 smithi117 ceph-mon[34585]: 5.1a scrub ok 2021-10-08T19:31:23.047 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:22 smithi117 ceph-mon[34585]: 5.0 scrub ok 2021-10-08T19:31:23.047 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:22 smithi117 ceph-mon[34585]: 8.5 scrub ok 2021-10-08T19:31:23.048 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:22 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2077109377' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]': finished 2021-10-08T19:31:23.049 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:22 smithi117 ceph-mon[34585]: osdmap e283: 8 total, 8 up, 8 in 2021-10-08T19:31:23.049 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:22 smithi117 ceph-mon[34585]: osdmap e284: 8 total, 8 up, 8 in 2021-10-08T19:31:23.050 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:23.098 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:31:23.100 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:23.101 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:31:23.202 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:31:23.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:22 smithi097 ceph-mon[41966]: 5.1a scrub ok 2021-10-08T19:31:23.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:22 smithi097 ceph-mon[41966]: 5.0 scrub ok 2021-10-08T19:31:23.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:22 smithi097 ceph-mon[41966]: 8.5 scrub ok 2021-10-08T19:31:23.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:22 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2077109377' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]': finished 2021-10-08T19:31:23.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:22 smithi097 ceph-mon[41966]: osdmap e283: 8 total, 8 up, 8 in 2021-10-08T19:31:23.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:22 smithi097 ceph-mon[41966]: osdmap e284: 8 total, 8 up, 8 in 2021-10-08T19:31:23.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:22 smithi097 ceph-mon[32687]: 5.1a scrub ok 2021-10-08T19:31:23.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:22 smithi097 ceph-mon[32687]: 5.0 scrub ok 2021-10-08T19:31:23.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:22 smithi097 ceph-mon[32687]: 8.5 scrub ok 2021-10-08T19:31:23.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:22 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2077109377' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]': finished 2021-10-08T19:31:23.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:22 smithi097 ceph-mon[32687]: osdmap e283: 8 total, 8 up, 8 in 2021-10-08T19:31:23.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:22 smithi097 ceph-mon[32687]: osdmap e284: 8 total, 8 up, 8 in 2021-10-08T19:31:23.226 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:23.777 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd reweight 7 1 2021-10-08T19:31:23.801 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:31:23.822 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:31:23.825 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:23.826 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:31:23.902 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:31:23.927 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:31:23.961 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:23 smithi097 ceph-mon[32687]: 4.18 scrub ok 2021-10-08T19:31:23.962 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:23 smithi097 ceph-mon[32687]: 5.a scrub ok 2021-10-08T19:31:23.963 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:23 smithi097 ceph-mon[32687]: 4.4 scrub ok 2021-10-08T19:31:23.964 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:23 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:31:23.964 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:23 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:31:23.964 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:23 smithi097 ceph-mon[32687]: pgmap v503: 178 pgs: 2 active+clean+remapped, 176 active+clean; 5.5 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 0 B/s wr, 620 op/s; 864 KiB/s, 13 objects/s recovering 2021-10-08T19:31:23.965 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:23 smithi097 ceph-mon[32687]: osdmap e285: 8 total, 8 up, 8 in 2021-10-08T19:31:23.966 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:23 smithi097 ceph-mon[41966]: 4.18 scrub ok 2021-10-08T19:31:23.966 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:23 smithi097 ceph-mon[41966]: 5.a scrub ok 2021-10-08T19:31:23.967 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:23 smithi097 ceph-mon[41966]: 4.4 scrub ok 2021-10-08T19:31:23.967 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:23 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:31:23.967 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:23 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:31:23.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:23 smithi097 ceph-mon[41966]: pgmap v503: 178 pgs: 2 active+clean+remapped, 176 active+clean; 5.5 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 0 B/s wr, 620 op/s; 864 KiB/s, 13 objects/s recovering 2021-10-08T19:31:23.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:23 smithi097 ceph-mon[41966]: osdmap e285: 8 total, 8 up, 8 in 2021-10-08T19:31:23.970 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:23.981 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:31:24.156 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:31:23 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:31:23] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:31:24.160 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:23 smithi117 ceph-mon[34585]: 4.18 scrub ok 2021-10-08T19:31:24.160 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:23 smithi117 ceph-mon[34585]: 5.a scrub ok 2021-10-08T19:31:24.160 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:23 smithi117 ceph-mon[34585]: 4.4 scrub ok 2021-10-08T19:31:24.160 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:23 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:31:24.161 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:23 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:31:24.161 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:23 smithi117 ceph-mon[34585]: pgmap v503: 178 pgs: 2 active+clean+remapped, 176 active+clean; 5.5 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 0 B/s wr, 620 op/s; 864 KiB/s, 13 objects/s recovering 2021-10-08T19:31:24.161 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:23 smithi117 ceph-mon[34585]: osdmap e285: 8 total, 8 up, 8 in 2021-10-08T19:31:24.226 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:31:24.228 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:24.229 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:31:24.330 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:31:24.358 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:24.514 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:31:24 smithi097 conmon[33110]: 172.21.15.97 - - [08/Oct/2021:19:31:24] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:31:24.606 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:31:24.609 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:24.610 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:31:24.711 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:31:24.737 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:24.781 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:31:24.783 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:24.783 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:31:24.809 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'unique_pool_1' removed 2021-10-08T19:31:24.885 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:31:24.910 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:24.954 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:31:24.959 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:24.960 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:31:25.062 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:31:25.088 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:31:24 smithi097 conmon[33110]: 172.21.15.117 - - [08/Oct/2021:19:31:24] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:31:25.089 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:24 smithi097 ceph-mon[32687]: 4.11 scrub ok 2021-10-08T19:31:25.089 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:24 smithi097 ceph-mon[32687]: 8.a starting backfill to osd.5 from (220'4738,266'9578] MIN to 279'11016 2021-10-08T19:31:25.090 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:24 smithi097 ceph-mon[32687]: 8.9 starting backfill to osd.5 from (219'4637,265'9423] MIN to 279'10978 2021-10-08T19:31:25.090 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:24 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3322317199' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_1", "pool2": "unique_pool_1", "yes_i_really_really_mean_it": true}]: dispatch 2021-10-08T19:31:25.090 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:24 smithi097 ceph-mon[32687]: from='client.25408 ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_1", "pool2": "unique_pool_1", "yes_i_really_really_mean_it": true}]: dispatch 2021-10-08T19:31:25.090 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:24 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:31:25.090 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:24 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:31:25.091 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:24 smithi097 ceph-mon[41966]: 4.11 scrub ok 2021-10-08T19:31:25.091 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:24 smithi097 ceph-mon[41966]: 8.a starting backfill to osd.5 from (220'4738,266'9578] MIN to 279'11016 2021-10-08T19:31:25.091 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:24 smithi097 ceph-mon[41966]: 8.9 starting backfill to osd.5 from (219'4637,265'9423] MIN to 279'10978 2021-10-08T19:31:25.092 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:24 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3322317199' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_1", "pool2": "unique_pool_1", "yes_i_really_really_mean_it": true}]: dispatch 2021-10-08T19:31:25.092 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:24 smithi097 ceph-mon[41966]: from='client.25408 ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_1", "pool2": "unique_pool_1", "yes_i_really_really_mean_it": true}]: dispatch 2021-10-08T19:31:25.092 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:24 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:31:25.092 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:24 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:31:25.093 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:25.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:24 smithi117 ceph-mon[34585]: 4.11 scrub ok 2021-10-08T19:31:25.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:24 smithi117 ceph-mon[34585]: 8.a starting backfill to osd.5 from (220'4738,266'9578] MIN to 279'11016 2021-10-08T19:31:25.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:24 smithi117 ceph-mon[34585]: 8.9 starting backfill to osd.5 from (219'4637,265'9423] MIN to 279'10978 2021-10-08T19:31:25.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:24 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3322317199' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_1", "pool2": "unique_pool_1", "yes_i_really_really_mean_it": true}]: dispatch 2021-10-08T19:31:25.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:24 smithi117 ceph-mon[34585]: from='client.25408 ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_1", "pool2": "unique_pool_1", "yes_i_really_really_mean_it": true}]: dispatch 2021-10-08T19:31:25.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:24 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:31:25.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:24 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:31:25.538 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:31:25.540 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:25.541 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:31:25.642 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:31:25.676 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:26.071 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:31:26.072 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:25 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:31:26.072 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:25 smithi097 ceph-mon[41966]: 172.21.15.97 - - [08/Oct/2021:19:31:24] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:31:26.073 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:25 smithi097 ceph-mon[41966]: 2.19 scrub ok 2021-10-08T19:31:26.073 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:25 smithi097 ceph-mon[41966]: pgmap v506: 178 pgs: 1 active+remapped+backfill_wait, 1 activating+undersized+degraded+remapped, 1 remapped+peering, 175 active+clean; 530 KiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 21 op/s; 1/582 objects degraded (0.172%); 27 B/s, 0 objects/s recovering 2021-10-08T19:31:26.073 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:25 smithi097 ceph-mon[41966]: 2.1a scrub ok 2021-10-08T19:31:26.074 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:25 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:31:26.074 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:25 smithi097 ceph-mon[41966]: 172.21.15.117 - - [08/Oct/2021:19:31:24] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:31:26.074 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:25 smithi097 ceph-mon[41966]: from='client.25408 ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_1", "pool2": "unique_pool_1", "yes_i_really_really_mean_it": true}]': finished 2021-10-08T19:31:26.074 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:25 smithi097 ceph-mon[41966]: osdmap e286: 8 total, 8 up, 8 in 2021-10-08T19:31:26.074 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:25 smithi097 ceph-mon[41966]: Health check failed: Degraded data redundancy: 1/582 objects degraded (0.172%), 1 pg degraded (PG_DEGRADED) 2021-10-08T19:31:26.075 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:25 smithi097 ceph-mon[41966]: osdmap e287: 8 total, 8 up, 8 in 2021-10-08T19:31:26.075 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:25 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:31:26.075 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:25 smithi097 ceph-mon[32687]: 172.21.15.97 - - [08/Oct/2021:19:31:24] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:31:26.076 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:25 smithi097 ceph-mon[32687]: 2.19 scrub ok 2021-10-08T19:31:26.077 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:25 smithi097 ceph-mon[32687]: pgmap v506: 178 pgs: 1 active+remapped+backfill_wait, 1 activating+undersized+degraded+remapped, 1 remapped+peering, 175 active+clean; 530 KiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 21 op/s; 1/582 objects degraded (0.172%); 27 B/s, 0 objects/s recovering 2021-10-08T19:31:26.077 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:25 smithi097 ceph-mon[32687]: 2.1a scrub ok 2021-10-08T19:31:26.078 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:25 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:31:26.078 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:25 smithi097 ceph-mon[32687]: 172.21.15.117 - - [08/Oct/2021:19:31:24] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:31:26.078 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:25 smithi097 ceph-mon[32687]: from='client.25408 ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_1", "pool2": "unique_pool_1", "yes_i_really_really_mean_it": true}]': finished 2021-10-08T19:31:26.078 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:25 smithi097 ceph-mon[32687]: osdmap e286: 8 total, 8 up, 8 in 2021-10-08T19:31:26.079 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:25 smithi097 ceph-mon[32687]: Health check failed: Degraded data redundancy: 1/582 objects degraded (0.172%), 1 pg degraded (PG_DEGRADED) 2021-10-08T19:31:26.079 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:25 smithi097 ceph-mon[32687]: osdmap e287: 8 total, 8 up, 8 in 2021-10-08T19:31:26.080 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:26.080 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:31:26.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:25 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:31:26.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:25 smithi117 ceph-mon[34585]: 172.21.15.97 - - [08/Oct/2021:19:31:24] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:31:26.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:25 smithi117 ceph-mon[34585]: 2.19 scrub ok 2021-10-08T19:31:26.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:25 smithi117 ceph-mon[34585]: pgmap v506: 178 pgs: 1 active+remapped+backfill_wait, 1 activating+undersized+degraded+remapped, 1 remapped+peering, 175 active+clean; 530 KiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 21 op/s; 1/582 objects degraded (0.172%); 27 B/s, 0 objects/s recovering 2021-10-08T19:31:26.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:25 smithi117 ceph-mon[34585]: 2.1a scrub ok 2021-10-08T19:31:26.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:25 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:31:26.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:25 smithi117 ceph-mon[34585]: 172.21.15.117 - - [08/Oct/2021:19:31:24] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:31:26.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:25 smithi117 ceph-mon[34585]: from='client.25408 ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_1", "pool2": "unique_pool_1", "yes_i_really_really_mean_it": true}]': finished 2021-10-08T19:31:26.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:25 smithi117 ceph-mon[34585]: osdmap e286: 8 total, 8 up, 8 in 2021-10-08T19:31:26.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:25 smithi117 ceph-mon[34585]: Health check failed: Degraded data redundancy: 1/582 objects degraded (0.172%), 1 pg degraded (PG_DEGRADED) 2021-10-08T19:31:26.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:25 smithi117 ceph-mon[34585]: osdmap e287: 8 total, 8 up, 8 in 2021-10-08T19:31:26.181 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:31:26.213 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:26.263 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:31:26.264 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:26.265 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:31:26.366 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:31:26.392 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:26.651 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:31:27.098 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:31:27.101 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:26 smithi097 ceph-mon[41966]: 2.1c scrub ok 2021-10-08T19:31:27.102 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:26 smithi097 ceph-mon[41966]: 2.c scrub ok 2021-10-08T19:31:27.103 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:26 smithi097 ceph-mon[41966]: 4.2 scrub ok 2021-10-08T19:31:27.103 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:26 smithi097 ceph-mon[41966]: 3.4 scrub ok 2021-10-08T19:31:27.104 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:27.105 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:31:27.106 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:26 smithi097 ceph-mon[32687]: 2.1c scrub ok 2021-10-08T19:31:27.107 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:26 smithi097 ceph-mon[32687]: 2.c scrub ok 2021-10-08T19:31:27.107 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:26 smithi097 ceph-mon[32687]: 4.2 scrub ok 2021-10-08T19:31:27.108 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:26 smithi097 ceph-mon[32687]: 3.4 scrub ok 2021-10-08T19:31:27.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:26 smithi117 ceph-mon[34585]: 2.1c scrub ok 2021-10-08T19:31:27.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:26 smithi117 ceph-mon[34585]: 2.c scrub ok 2021-10-08T19:31:27.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:26 smithi117 ceph-mon[34585]: 4.2 scrub ok 2021-10-08T19:31:27.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:26 smithi117 ceph-mon[34585]: 3.4 scrub ok 2021-10-08T19:31:27.157 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:31:26 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:31:27.165 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2021-10-08T19:31:27.167 INFO:tasks.radosbench:Beginning radosbench... 2021-10-08T19:31:27.167 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_2 2021-10-08T19:31:27.168 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd pool create unique_pool_2 16 2021-10-08T19:31:27.207 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:31:27.235 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:27.285 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:31:27.287 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:27.288 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:31:27.326 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2021-10-08T19:31:27.326 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:31:27.390 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:31:27.415 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:27.458 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:31:27.460 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:27.461 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:31:27.562 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:31:27.586 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:27.628 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:31:27.630 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:27.635 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:31:27.736 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:31:27.760 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:27.800 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:31:27.802 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:27.803 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:31:27.904 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:31:27.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:27 smithi117 ceph-mon[34585]: 1.2 scrub ok 2021-10-08T19:31:27.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:27 smithi117 ceph-mon[34585]: 5.11 scrub ok 2021-10-08T19:31:27.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:27 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:31:27.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:27 smithi117 ceph-mon[34585]: pgmap v509: 162 pgs: 1 activating+undersized+degraded+remapped, 161 active+clean; 530 KiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 1/582 objects degraded (0.172%) 2021-10-08T19:31:27.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:27 smithi117 ceph-mon[34585]: 4.1b scrub ok 2021-10-08T19:31:27.968 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:28.009 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:31:28.011 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:28.012 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:31:28.113 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:31:28.137 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:27 smithi097 ceph-mon[41966]: 1.2 scrub ok 2021-10-08T19:31:28.137 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:27 smithi097 ceph-mon[41966]: 5.11 scrub ok 2021-10-08T19:31:28.138 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:27 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:31:28.138 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:27 smithi097 ceph-mon[41966]: pgmap v509: 162 pgs: 1 activating+undersized+degraded+remapped, 161 active+clean; 530 KiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 1/582 objects degraded (0.172%) 2021-10-08T19:31:28.138 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:27 smithi097 ceph-mon[41966]: 4.1b scrub ok 2021-10-08T19:31:28.139 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:27 smithi097 ceph-mon[32687]: 1.2 scrub ok 2021-10-08T19:31:28.139 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:27 smithi097 ceph-mon[32687]: 5.11 scrub ok 2021-10-08T19:31:28.139 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:27 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:31:28.139 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:27 smithi097 ceph-mon[32687]: pgmap v509: 162 pgs: 1 activating+undersized+degraded+remapped, 161 active+clean; 530 KiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 1/582 objects degraded (0.172%) 2021-10-08T19:31:28.140 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:27 smithi097 ceph-mon[32687]: 4.1b scrub ok 2021-10-08T19:31:28.141 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:28.289 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2021-10-08T19:31:28.289 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:31:28.292 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:28.293 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:31:28.384 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:31:28.394 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:31:28.420 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:28.580 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:31:28.583 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:28.583 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:31:28.635 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:31:28.653 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:31:28.674 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:31:28.684 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:31:28.701 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:31:28.710 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:28.725 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:31:28.747 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:31:28.758 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:31:28.760 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:28.761 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:31:28.764 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:31:28.782 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:31:28.783 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true' 2021-10-08T19:31:28.784 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true' 2021-10-08T19:31:28.784 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true' 2021-10-08T19:31:28.784 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true' 2021-10-08T19:31:28.784 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true' 2021-10-08T19:31:28.784 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true' 2021-10-08T19:31:28.785 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'true' 2021-10-08T19:31:28.785 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'true' 2021-10-08T19:31:28.833 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is unset 2021-10-08T19:31:28.843 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:31:28.862 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:31:28.886 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:28.927 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:31:28.930 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:28.931 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:31:28.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:28 smithi097 ceph-mon[41966]: 5.8 scrub ok 2021-10-08T19:31:28.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:28 smithi097 ceph-mon[41966]: 2.16 scrub ok 2021-10-08T19:31:28.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:28 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/75370954' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:31:28.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:28 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/4226453467' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:31:28.974 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:28 smithi097 ceph-mon[32687]: 5.8 scrub ok 2021-10-08T19:31:28.974 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:28 smithi097 ceph-mon[32687]: 2.16 scrub ok 2021-10-08T19:31:28.975 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:28 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/75370954' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:31:28.975 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:28 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/4226453467' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:31:29.032 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:31:29.059 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:29.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:28 smithi117 ceph-mon[34585]: 5.8 scrub ok 2021-10-08T19:31:29.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:28 smithi117 ceph-mon[34585]: 2.16 scrub ok 2021-10-08T19:31:29.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:28 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/75370954' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:31:29.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:28 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/4226453467' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:31:30.056 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:31:30.058 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:30.058 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:31:30.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:29 smithi117 ceph-mon[34585]: 5.14 scrub ok 2021-10-08T19:31:30.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:29 smithi117 ceph-mon[34585]: pgmap v510: 162 pgs: 162 active+clean; 477 KiB data, 1.3 GiB used, 714 GiB / 715 GiB avail 2021-10-08T19:31:30.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:29 smithi117 ceph-mon[34585]: 5.2 scrub ok 2021-10-08T19:31:30.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:29 smithi117 ceph-mon[34585]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/582 objects degraded (0.172%), 1 pg degraded) 2021-10-08T19:31:30.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:29 smithi117 ceph-mon[34585]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:31:30.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:29 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/75370954' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:31:30.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:29 smithi117 ceph-mon[34585]: osdmap e288: 8 total, 8 up, 8 in 2021-10-08T19:31:30.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:29 smithi117 ceph-mon[34585]: 5.16 scrub ok 2021-10-08T19:31:30.160 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:29 smithi117 ceph-mon[34585]: 1.3 scrub ok 2021-10-08T19:31:30.160 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:31:30.189 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:30.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:29 smithi097 ceph-mon[32687]: 5.14 scrub ok 2021-10-08T19:31:30.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:29 smithi097 ceph-mon[32687]: pgmap v510: 162 pgs: 162 active+clean; 477 KiB data, 1.3 GiB used, 714 GiB / 715 GiB avail 2021-10-08T19:31:30.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:29 smithi097 ceph-mon[32687]: 5.2 scrub ok 2021-10-08T19:31:30.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:29 smithi097 ceph-mon[32687]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/582 objects degraded (0.172%), 1 pg degraded) 2021-10-08T19:31:30.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:29 smithi097 ceph-mon[32687]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:31:30.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:29 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/75370954' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:31:30.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:29 smithi097 ceph-mon[32687]: osdmap e288: 8 total, 8 up, 8 in 2021-10-08T19:31:30.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:29 smithi097 ceph-mon[32687]: 5.16 scrub ok 2021-10-08T19:31:30.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:29 smithi097 ceph-mon[32687]: 1.3 scrub ok 2021-10-08T19:31:30.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:29 smithi097 ceph-mon[41966]: 5.14 scrub ok 2021-10-08T19:31:30.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:29 smithi097 ceph-mon[41966]: pgmap v510: 162 pgs: 162 active+clean; 477 KiB data, 1.3 GiB used, 714 GiB / 715 GiB avail 2021-10-08T19:31:30.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:29 smithi097 ceph-mon[41966]: 5.2 scrub ok 2021-10-08T19:31:30.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:29 smithi097 ceph-mon[41966]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/582 objects degraded (0.172%), 1 pg degraded) 2021-10-08T19:31:30.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:29 smithi097 ceph-mon[41966]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:31:30.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:29 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/75370954' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:31:30.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:29 smithi097 ceph-mon[41966]: osdmap e288: 8 total, 8 up, 8 in 2021-10-08T19:31:30.225 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:29 smithi097 ceph-mon[41966]: 5.16 scrub ok 2021-10-08T19:31:30.225 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:29 smithi097 ceph-mon[41966]: 1.3 scrub ok 2021-10-08T19:31:30.245 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:30.247 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:31:30.247 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:31:30.348 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:31:30.373 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:31.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:30 smithi117 ceph-mon[34585]: 3.e scrub ok 2021-10-08T19:31:31.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:30 smithi117 ceph-mon[34585]: 6.b scrub ok 2021-10-08T19:31:31.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:30 smithi117 ceph-mon[34585]: 4.1a scrub ok 2021-10-08T19:31:31.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:30 smithi117 ceph-mon[34585]: 4.f scrub ok 2021-10-08T19:31:31.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:30 smithi117 ceph-mon[34585]: osdmap e289: 8 total, 8 up, 8 in 2021-10-08T19:31:31.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:30 smithi097 ceph-mon[32687]: 3.e scrub ok 2021-10-08T19:31:31.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:30 smithi097 ceph-mon[32687]: 6.b scrub ok 2021-10-08T19:31:31.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:30 smithi097 ceph-mon[32687]: 4.1a scrub ok 2021-10-08T19:31:31.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:30 smithi097 ceph-mon[32687]: 4.f scrub ok 2021-10-08T19:31:31.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:30 smithi097 ceph-mon[32687]: osdmap e289: 8 total, 8 up, 8 in 2021-10-08T19:31:31.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:30 smithi097 ceph-mon[41966]: 3.e scrub ok 2021-10-08T19:31:31.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:30 smithi097 ceph-mon[41966]: 6.b scrub ok 2021-10-08T19:31:31.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:30 smithi097 ceph-mon[41966]: 4.1a scrub ok 2021-10-08T19:31:31.225 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:30 smithi097 ceph-mon[41966]: 4.f scrub ok 2021-10-08T19:31:31.225 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:30 smithi097 ceph-mon[41966]: osdmap e289: 8 total, 8 up, 8 in 2021-10-08T19:31:31.270 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:31:31.273 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:31.273 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:31:31.375 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:31:31.403 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:31.452 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:31:31.454 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:31.455 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:31:31.556 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:31:31.579 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:31.623 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:31:31.625 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:31.625 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:31:31.727 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:31:31.753 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:31.814 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:31:31.817 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:31.817 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:31:31.890 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:31 smithi097 ceph-mon[32687]: pgmap v513: 162 pgs: 162 active+clean; 477 KiB data, 1.3 GiB used, 714 GiB / 715 GiB avail 2021-10-08T19:31:31.891 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:31 smithi097 ceph-mon[32687]: 2.12 scrub ok 2021-10-08T19:31:31.891 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:31 smithi097 ceph-mon[32687]: 5.18 deep-scrub ok 2021-10-08T19:31:31.892 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:31 smithi097 ceph-mon[41966]: pgmap v513: 162 pgs: 162 active+clean; 477 KiB data, 1.3 GiB used, 714 GiB / 715 GiB avail 2021-10-08T19:31:31.892 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:31 smithi097 ceph-mon[41966]: 2.12 scrub ok 2021-10-08T19:31:31.893 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:31 smithi097 ceph-mon[41966]: 5.18 deep-scrub ok 2021-10-08T19:31:31.919 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:31:31.943 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:31.989 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:31:31.991 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:31.992 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:31:32.023 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set noscrub 2021-10-08T19:31:32.093 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:31:32.120 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:32.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:31 smithi117 ceph-mon[34585]: pgmap v513: 162 pgs: 162 active+clean; 477 KiB data, 1.3 GiB used, 714 GiB / 715 GiB avail 2021-10-08T19:31:32.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:31 smithi117 ceph-mon[34585]: 2.12 scrub ok 2021-10-08T19:31:32.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:31 smithi117 ceph-mon[34585]: 5.18 deep-scrub ok 2021-10-08T19:31:32.172 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:31:32.175 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:32.175 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:31:32.246 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:31:32.246 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2021-10-08T19:31:32.247 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2021-10-08T19:31:32.247 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2021-10-08T19:31:32.247 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.247 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:40670 7.e 7:79f4d2b7:::benchmark_data_smithi097_93198_object40669:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2021-10-08T19:31:32.247 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:16.257106+0000", 2021-10-08T19:31:32.248 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 435.985462654, 2021-10-08T19:31:32.248 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.123129141, 2021-10-08T19:31:32.248 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:32.249 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:31:32.249 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:31:32.249 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:31:32.250 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:31:32.250 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 40670 2021-10-08T19:31:32.250 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.250 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:32.251 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.251 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:32.251 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.257106+0000", 2021-10-08T19:31:32.251 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:32.251 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.252 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.252 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:32.252 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.257106+0000", 2021-10-08T19:31:32.252 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:32.253 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.253 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.253 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:32.253 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.257104+0000", 2021-10-08T19:31:32.253 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:31:32.254 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.254 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.254 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:32.254 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.257130+0000", 2021-10-08T19:31:32.255 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5962e-05 2021-10-08T19:31:32.255 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.255 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.255 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:32.255 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.257144+0000", 2021-10-08T19:31:32.256 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.45e-05 2021-10-08T19:31:32.256 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.256 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.256 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:32.257 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.257152+0000", 2021-10-08T19:31:32.257 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7179999999999996e-06 2021-10-08T19:31:32.257 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.257 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.257 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:32.258 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.257212+0000", 2021-10-08T19:31:32.258 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.982e-05 2021-10-08T19:31:32.258 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.258 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.259 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:32.259 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.257339+0000", 2021-10-08T19:31:32.259 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012701100000000001 2021-10-08T19:31:32.259 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.260 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.260 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:31:32.260 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.257483+0000", 2021-10-08T19:31:32.260 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014382500000000001 2021-10-08T19:31:32.261 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.261 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.261 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:32.261 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.258908+0000", 2021-10-08T19:31:32.262 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0014255209999999999 2021-10-08T19:31:32.262 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.262 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.262 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:31:32.263 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.259885+0000", 2021-10-08T19:31:32.263 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00097671600000000009 2021-10-08T19:31:32.263 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.263 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.263 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:32.264 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.380148+0000", 2021-10-08T19:31:32.264 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.12026337600000001 2021-10-08T19:31:32.264 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.264 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.264 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:31:32.265 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.380200+0000", 2021-10-08T19:31:32.265 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1218999999999999e-05 2021-10-08T19:31:32.265 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.265 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.266 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:32.266 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.380235+0000", 2021-10-08T19:31:32.266 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5683999999999999e-05 2021-10-08T19:31:32.267 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:32.267 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:32.267 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:32.267 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.268 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.268 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "MOSDPGPushReply(7.c 132/113 [PushReplyOp(7:369c504f:::benchmark_data_smithi097_93198_object8982:head)])", 2021-10-08T19:31:32.268 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:15.297632+0000", 2021-10-08T19:31:32.268 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 376.94493639699999, 2021-10-08T19:31:32.269 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.14698830299999999, 2021-10-08T19:31:32.269 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:32.269 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "reached pg", 2021-10-08T19:31:32.269 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:32.269 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.270 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:32.270 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.297632+0000", 2021-10-08T19:31:32.270 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:32.271 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.271 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.271 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:32.271 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.297632+0000", 2021-10-08T19:31:32.272 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:32.272 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.272 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.272 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:32.272 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.297630+0000", 2021-10-08T19:31:32.273 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:31:32.273 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.273 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.273 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:32.274 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.297642+0000", 2021-10-08T19:31:32.274 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2211e-05 2021-10-08T19:31:32.275 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.276 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.276 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:32.277 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.297659+0000", 2021-10-08T19:31:32.277 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6351999999999999e-05 2021-10-08T19:31:32.277 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.278 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.279 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:32.279 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.297668+0000", 2021-10-08T19:31:32.279 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0489999999999993e-06 2021-10-08T19:31:32.279 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.280 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.280 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:32.280 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.297746+0000", 2021-10-08T19:31:32.281 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8319999999999996e-05 2021-10-08T19:31:32.281 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.281 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.281 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:32.282 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.444621+0000", 2021-10-08T19:31:32.282 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.14687476299999999 2021-10-08T19:31:32.282 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:32.282 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:32.283 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:32.283 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.283 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.283 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.24796.0:86021 7.3 e132/94 7:c211d7cd:::benchmark_data_smithi097_93198_object86020:head v 132'5454, mlcod=132'5452)", 2021-10-08T19:31:32.284 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:15.298120+0000", 2021-10-08T19:31:32.284 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 376.94444846599998, 2021-10-08T19:31:32.284 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.15232842299999999, 2021-10-08T19:31:32.284 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:32.285 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:31:32.285 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:32.285 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.285 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:32.285 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.298120+0000", 2021-10-08T19:31:32.286 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:32.286 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.286 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.286 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:32.287 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.298120+0000", 2021-10-08T19:31:32.287 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:32.287 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.287 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.287 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:32.288 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.298119+0000", 2021-10-08T19:31:32.288 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:31:32.288 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.289 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.289 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:32.289 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.298150+0000", 2021-10-08T19:31:32.289 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1010999999999998e-05 2021-10-08T19:31:32.289 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.290 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.290 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:32.290 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.298161+0000", 2021-10-08T19:31:32.290 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1646e-05 2021-10-08T19:31:32.291 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.291 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.291 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:32.291 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.298168+0000", 2021-10-08T19:31:32.292 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7839999999999998e-06 2021-10-08T19:31:32.292 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.292 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.292 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:32.292 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.298249+0000", 2021-10-08T19:31:32.293 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0531999999999994e-05 2021-10-08T19:31:32.293 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.293 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.293 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:32.293 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.443678+0000", 2021-10-08T19:31:32.294 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.145429118 2021-10-08T19:31:32.294 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.294 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.294 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:31:32.295 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.450421+0000", 2021-10-08T19:31:32.295 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0067429200000000003 2021-10-08T19:31:32.295 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.295 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.295 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:32.296 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.450449+0000", 2021-10-08T19:31:32.296 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8218e-05 2021-10-08T19:31:32.296 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:32.296 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:32.297 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:32.297 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.297 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.297 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.24796.0:86023 7.2 e132/94 7:44f50a37:::benchmark_data_smithi097_93198_object86022:head v 132'5410, mlcod=132'5408)", 2021-10-08T19:31:32.297 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:15.298181+0000", 2021-10-08T19:31:32.298 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 376.94438800500001, 2021-10-08T19:31:32.298 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.153767984, 2021-10-08T19:31:32.298 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:32.299 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:31:32.299 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:32.299 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.299 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:32.300 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.298181+0000", 2021-10-08T19:31:32.300 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:32.300 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.300 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.301 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:32.301 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.298181+0000", 2021-10-08T19:31:32.301 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:32.301 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.301 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.302 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:32.302 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.298180+0000", 2021-10-08T19:31:32.302 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2021-10-08T19:31:32.302 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.303 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.303 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:32.303 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.298204+0000", 2021-10-08T19:31:32.303 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3807000000000001e-05 2021-10-08T19:31:32.303 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.304 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.304 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:32.304 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.298210+0000", 2021-10-08T19:31:32.304 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5230000000000003e-06 2021-10-08T19:31:32.304 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.305 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.305 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:32.305 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.298214+0000", 2021-10-08T19:31:32.305 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1060000000000002e-06 2021-10-08T19:31:32.305 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.306 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.306 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:32.306 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.443716+0000", 2021-10-08T19:31:32.306 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.14550266100000001 2021-10-08T19:31:32.307 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.307 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.307 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:32.307 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.443740+0000", 2021-10-08T19:31:32.307 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3581999999999999e-05 2021-10-08T19:31:32.308 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.308 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.308 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:31:32.308 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.451911+0000", 2021-10-08T19:31:32.309 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0081709320000000005 2021-10-08T19:31:32.309 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.309 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.310 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:32.310 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.451949+0000", 2021-10-08T19:31:32.310 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7891e-05 2021-10-08T19:31:32.310 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:32.311 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:32.311 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:32.311 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.311 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.311 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.24796.0:86030 7.3 e132/94 7:c00202ed:::benchmark_data_smithi097_93198_object86029:head v 132'5455, mlcod=132'5452)", 2021-10-08T19:31:32.312 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:15.298226+0000", 2021-10-08T19:31:32.312 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 376.94434321400001, 2021-10-08T19:31:32.312 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.15224360100000001, 2021-10-08T19:31:32.312 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:32.313 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:31:32.313 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:32.313 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.313 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:32.313 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.298226+0000", 2021-10-08T19:31:32.314 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:32.314 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.314 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.314 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:32.314 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.298226+0000", 2021-10-08T19:31:32.315 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:32.315 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.315 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.315 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:32.316 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.298225+0000", 2021-10-08T19:31:32.316 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2021-10-08T19:31:32.316 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.316 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.316 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:32.317 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.298257+0000", 2021-10-08T19:31:32.317 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2042000000000003e-05 2021-10-08T19:31:32.317 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.318 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.318 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:32.318 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.443685+0000", 2021-10-08T19:31:32.318 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.14542758 2021-10-08T19:31:32.319 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.319 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.319 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:32.319 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.443696+0000", 2021-10-08T19:31:32.320 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1708e-05 2021-10-08T19:31:32.320 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.320 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.320 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:32.320 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.445731+0000", 2021-10-08T19:31:32.321 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0020341389999999999 2021-10-08T19:31:32.321 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.321 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.321 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:32.321 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.445755+0000", 2021-10-08T19:31:32.322 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.472e-05 2021-10-08T19:31:32.322 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.322 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.322 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:31:32.323 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.450453+0000", 2021-10-08T19:31:32.323 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0046977950000000003 2021-10-08T19:31:32.323 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.323 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.323 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:32.324 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.450469+0000", 2021-10-08T19:31:32.324 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6155e-05 2021-10-08T19:31:32.324 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:32.324 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:32.324 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:32.325 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.325 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.325 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:111955 7.e 7:784c34e9:::benchmark_data_smithi097_93198_object20135:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e145)", 2021-10-08T19:31:32.325 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:50.620080+0000", 2021-10-08T19:31:32.326 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 341.622488772, 2021-10-08T19:31:32.326 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.113722382, 2021-10-08T19:31:32.326 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:32.326 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:31:32.326 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:31:32.327 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:31:32.327 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:31:32.327 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 111955 2021-10-08T19:31:32.328 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.328 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:32.328 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.328 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:32.329 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.620080+0000", 2021-10-08T19:31:32.329 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:32.329 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.329 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.329 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:32.330 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.620080+0000", 2021-10-08T19:31:32.330 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:32.330 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.330 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.331 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:32.331 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.620078+0000", 2021-10-08T19:31:32.331 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:31:32.331 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.331 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.332 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:32.332 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.620086+0000", 2021-10-08T19:31:32.332 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3529999999999995e-06 2021-10-08T19:31:32.332 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.333 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.333 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:32.333 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.620121+0000", 2021-10-08T19:31:32.333 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5071999999999999e-05 2021-10-08T19:31:32.333 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.334 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.334 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:32.334 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.620129+0000", 2021-10-08T19:31:32.334 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6249999999999998e-06 2021-10-08T19:31:32.334 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.335 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.335 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:32.335 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.620249+0000", 2021-10-08T19:31:32.335 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000120047 2021-10-08T19:31:32.335 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.336 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.336 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:32.336 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.620495+0000", 2021-10-08T19:31:32.336 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024642799999999998 2021-10-08T19:31:32.337 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.337 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.337 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:31:32.337 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.620591+0000", 2021-10-08T19:31:32.338 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.6405999999999998e-05 2021-10-08T19:31:32.338 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.338 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.338 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:31:32.339 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.627176+0000", 2021-10-08T19:31:32.339 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.006584917 2021-10-08T19:31:32.339 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.339 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.339 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:32.340 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.633380+0000", 2021-10-08T19:31:32.340 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.006203615 2021-10-08T19:31:32.340 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.340 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.340 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:32.341 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.733712+0000", 2021-10-08T19:31:32.341 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.10033193999999999 2021-10-08T19:31:32.341 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.341 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.342 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:31:32.342 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.733763+0000", 2021-10-08T19:31:32.342 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0933000000000002e-05 2021-10-08T19:31:32.342 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.342 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.343 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:32.343 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.733802+0000", 2021-10-08T19:31:32.343 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9616999999999997e-05 2021-10-08T19:31:32.343 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:32.343 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:32.344 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:32.344 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.344 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.344 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:111961 7.e 7:732b47e9:::benchmark_data_smithi097_93198_object20141:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e145)", 2021-10-08T19:31:32.345 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:50.620207+0000", 2021-10-08T19:31:32.345 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 341.62236150400003, 2021-10-08T19:31:32.345 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.124760158, 2021-10-08T19:31:32.345 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:32.345 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:31:32.346 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:31:32.346 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:31:32.346 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:31:32.346 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 111961 2021-10-08T19:31:32.346 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.347 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:32.347 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.347 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:32.347 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.620207+0000", 2021-10-08T19:31:32.348 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:32.348 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.348 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.348 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:32.348 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.620207+0000", 2021-10-08T19:31:32.349 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:32.349 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.349 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.349 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:32.349 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.620207+0000", 2021-10-08T19:31:32.350 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2021-10-08T19:31:32.350 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.350 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.350 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:32.351 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.620210+0000", 2021-10-08T19:31:32.351 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8370000000000001e-06 2021-10-08T19:31:32.351 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.351 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.351 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:32.352 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.620215+0000", 2021-10-08T19:31:32.352 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.276e-06 2021-10-08T19:31:32.352 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.352 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.352 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:32.353 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.620390+0000", 2021-10-08T19:31:32.353 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017530200000000001 2021-10-08T19:31:32.353 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.353 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.353 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:32.354 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.623533+0000", 2021-10-08T19:31:32.354 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003142841 2021-10-08T19:31:32.354 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.354 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.354 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:32.355 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.623648+0000", 2021-10-08T19:31:32.355 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115207 2021-10-08T19:31:32.355 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.355 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.355 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:31:32.356 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.623768+0000", 2021-10-08T19:31:32.356 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119951 2021-10-08T19:31:32.356 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.356 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.356 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:31:32.357 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.635539+0000", 2021-10-08T19:31:32.357 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.01177105 2021-10-08T19:31:32.357 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.357 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.358 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:32.358 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.638723+0000", 2021-10-08T19:31:32.358 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031842709999999998 2021-10-08T19:31:32.358 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.358 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.359 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:32.359 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.744878+0000", 2021-10-08T19:31:32.359 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.106154761 2021-10-08T19:31:32.359 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.359 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.360 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:31:32.360 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.744929+0000", 2021-10-08T19:31:32.360 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0464000000000003e-05 2021-10-08T19:31:32.360 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.360 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.361 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:32.361 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.744968+0000", 2021-10-08T19:31:32.361 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8846e-05 2021-10-08T19:31:32.361 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:32.361 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:32.362 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:32.362 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.362 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.362 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:111963 7.e 7:73b4f7a7:::benchmark_data_smithi097_93198_object20143:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e145)", 2021-10-08T19:31:32.363 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:50.623389+0000", 2021-10-08T19:31:32.363 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 341.61917969199999, 2021-10-08T19:31:32.363 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.12169155500000001, 2021-10-08T19:31:32.363 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:32.363 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:31:32.364 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:31:32.364 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:31:32.364 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:31:32.364 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 111963 2021-10-08T19:31:32.364 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.365 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:32.365 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.365 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:32.365 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.623389+0000", 2021-10-08T19:31:32.365 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:32.366 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.366 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.366 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:32.366 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.623389+0000", 2021-10-08T19:31:32.366 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:32.367 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.367 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.367 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:32.367 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.623387+0000", 2021-10-08T19:31:32.367 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:31:32.368 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.368 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.368 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:32.368 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.623395+0000", 2021-10-08T19:31:32.369 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1540000000000002e-06 2021-10-08T19:31:32.369 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.369 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.369 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:32.370 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.623411+0000", 2021-10-08T19:31:32.370 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6189999999999999e-05 2021-10-08T19:31:32.370 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.370 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.370 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:32.371 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.623418+0000", 2021-10-08T19:31:32.371 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1760000000000004e-06 2021-10-08T19:31:32.371 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.371 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.371 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:32.372 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.627361+0000", 2021-10-08T19:31:32.372 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0039422620000000002 2021-10-08T19:31:32.372 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.372 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.373 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:32.373 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.627471+0000", 2021-10-08T19:31:32.373 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000110739 2021-10-08T19:31:32.373 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.373 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.374 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:31:32.374 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.627591+0000", 2021-10-08T19:31:32.374 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011943999999999999 2021-10-08T19:31:32.374 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.374 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.375 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:31:32.375 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.635546+0000", 2021-10-08T19:31:32.375 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0079551589999999998 2021-10-08T19:31:32.375 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.376 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.376 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:32.376 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.638753+0000", 2021-10-08T19:31:32.376 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003206548 2021-10-08T19:31:32.377 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.377 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.377 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:32.377 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.745011+0000", 2021-10-08T19:31:32.377 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.106258413 2021-10-08T19:31:32.378 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.378 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.378 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:31:32.378 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.745047+0000", 2021-10-08T19:31:32.379 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6412000000000003e-05 2021-10-08T19:31:32.379 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.379 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.379 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:32.379 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.745081+0000", 2021-10-08T19:31:32.380 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3312999999999998e-05 2021-10-08T19:31:32.380 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:32.380 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:32.380 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:32.380 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.381 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.381 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:114107 7.c 7:3ff35dbd:::benchmark_data_smithi097_93198_object22287:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e145)", 2021-10-08T19:31:32.381 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:53.644203+0000", 2021-10-08T19:31:32.381 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 338.598365586, 2021-10-08T19:31:32.382 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.111443187, 2021-10-08T19:31:32.382 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:32.382 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:31:32.382 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:31:32.382 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:31:32.383 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:31:32.383 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 114107 2021-10-08T19:31:32.383 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.383 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:32.383 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.384 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:32.384 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.644203+0000", 2021-10-08T19:31:32.384 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:32.384 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.384 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.385 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:32.385 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.644203+0000", 2021-10-08T19:31:32.385 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:32.385 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.385 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.386 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:32.386 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.644201+0000", 2021-10-08T19:31:32.386 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2021-10-08T19:31:32.386 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.387 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.387 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:32.387 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.644209+0000", 2021-10-08T19:31:32.387 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7199999999999995e-06 2021-10-08T19:31:32.388 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.388 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.388 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:32.389 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.644224+0000", 2021-10-08T19:31:32.389 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.504e-05 2021-10-08T19:31:32.389 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.389 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.389 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:32.390 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.644231+0000", 2021-10-08T19:31:32.390 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3029999999999996e-06 2021-10-08T19:31:32.390 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.390 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.391 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:32.391 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.644284+0000", 2021-10-08T19:31:32.391 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3603999999999997e-05 2021-10-08T19:31:32.391 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.392 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.392 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:32.392 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.644442+0000", 2021-10-08T19:31:32.392 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015813200000000001 2021-10-08T19:31:32.392 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.393 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.393 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,6,7", 2021-10-08T19:31:32.393 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.644603+0000", 2021-10-08T19:31:32.393 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016012200000000001 2021-10-08T19:31:32.394 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.394 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.394 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:31:32.394 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.648558+0000", 2021-10-08T19:31:32.394 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0039558930000000003 2021-10-08T19:31:32.395 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.395 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.395 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:32.395 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.652465+0000", 2021-10-08T19:31:32.395 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0039062599999999999 2021-10-08T19:31:32.396 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.396 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.396 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:32.396 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.653597+0000", 2021-10-08T19:31:32.397 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011324169999999999 2021-10-08T19:31:32.397 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.397 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.397 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:32.397 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.754606+0000", 2021-10-08T19:31:32.398 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.10100933300000001 2021-10-08T19:31:32.398 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.398 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.398 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:31:32.398 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.754663+0000", 2021-10-08T19:31:32.399 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6833999999999998e-05 2021-10-08T19:31:32.399 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.399 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.399 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:32.399 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.755646+0000", 2021-10-08T19:31:32.400 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00098320000000000005 2021-10-08T19:31:32.400 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:32.400 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:32.400 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:32.401 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.401 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.401 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:117008 7.c 7:3363a241:::benchmark_data_smithi097_93198_object25188:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e146)", 2021-10-08T19:31:32.401 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:57.617126+0000", 2021-10-08T19:31:32.401 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 334.62544308999998, 2021-10-08T19:31:32.402 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.121379295, 2021-10-08T19:31:32.402 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:32.402 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:31:32.402 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:31:32.402 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:31:32.403 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:31:32.403 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 117008 2021-10-08T19:31:32.403 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.403 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:32.403 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.404 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:32.404 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.617126+0000", 2021-10-08T19:31:32.404 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:32.404 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.405 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.405 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:32.405 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.617126+0000", 2021-10-08T19:31:32.405 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:32.405 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.406 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.406 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:32.406 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.617123+0000", 2021-10-08T19:31:32.407 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2021-10-08T19:31:32.407 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.407 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.407 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:32.408 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.617133+0000", 2021-10-08T19:31:32.408 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0288e-05 2021-10-08T19:31:32.408 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.408 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.408 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:32.409 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.617151+0000", 2021-10-08T19:31:32.409 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8094999999999999e-05 2021-10-08T19:31:32.409 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.409 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.409 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:32.410 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.617160+0000", 2021-10-08T19:31:32.410 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4239999999999993e-06 2021-10-08T19:31:32.410 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.410 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.410 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:32.411 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.617215+0000", 2021-10-08T19:31:32.411 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4775000000000003e-05 2021-10-08T19:31:32.411 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.411 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.412 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:32.412 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.617328+0000", 2021-10-08T19:31:32.412 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011385199999999999 2021-10-08T19:31:32.412 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.412 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.413 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,6,7", 2021-10-08T19:31:32.413 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.617481+0000", 2021-10-08T19:31:32.413 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000152743 2021-10-08T19:31:32.413 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.413 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.414 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:31:32.414 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.620950+0000", 2021-10-08T19:31:32.414 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003468989 2021-10-08T19:31:32.414 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.414 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.415 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:32.415 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.627462+0000", 2021-10-08T19:31:32.415 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0065120559999999996 2021-10-08T19:31:32.415 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.416 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.416 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:32.416 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.627990+0000", 2021-10-08T19:31:32.417 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00052785199999999999 2021-10-08T19:31:32.417 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.417 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.417 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:32.417 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.737508+0000", 2021-10-08T19:31:32.418 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.109518013 2021-10-08T19:31:32.418 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.418 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.418 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:31:32.418 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.737568+0000", 2021-10-08T19:31:32.419 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9818999999999998e-05 2021-10-08T19:31:32.419 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.419 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.419 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:32.419 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.738505+0000", 2021-10-08T19:31:32.420 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00093716199999999996 2021-10-08T19:31:32.420 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:32.420 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:32.420 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:32.421 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.421 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.421 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:117013 7.c 7:3958ebe2:::benchmark_data_smithi097_93198_object25193:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e146)", 2021-10-08T19:31:32.421 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:57.618295+0000", 2021-10-08T19:31:32.421 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 334.62427390900001, 2021-10-08T19:31:32.422 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.124585449, 2021-10-08T19:31:32.422 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:32.422 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:31:32.422 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:31:32.422 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:31:32.423 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:31:32.423 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 117013 2021-10-08T19:31:32.423 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.423 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:32.424 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.424 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:32.424 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.618295+0000", 2021-10-08T19:31:32.424 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:32.424 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.425 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.425 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:32.425 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.618295+0000", 2021-10-08T19:31:32.425 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:32.425 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.426 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.426 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:32.426 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.618294+0000", 2021-10-08T19:31:32.426 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2021-10-08T19:31:32.426 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.427 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.427 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:32.427 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.618297+0000", 2021-10-08T19:31:32.427 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9890000000000001e-06 2021-10-08T19:31:32.427 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.428 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.428 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:32.428 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.618302+0000", 2021-10-08T19:31:32.428 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.899e-06 2021-10-08T19:31:32.428 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.429 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.429 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:32.429 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.618306+0000", 2021-10-08T19:31:32.429 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1590000000000003e-06 2021-10-08T19:31:32.429 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.430 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.430 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:32.430 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.622144+0000", 2021-10-08T19:31:32.430 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038377849999999998 2021-10-08T19:31:32.431 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.431 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.431 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:32.431 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.622310+0000", 2021-10-08T19:31:32.431 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016551700000000001 2021-10-08T19:31:32.432 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.432 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.432 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,6,7", 2021-10-08T19:31:32.432 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.622481+0000", 2021-10-08T19:31:32.432 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017150499999999999 2021-10-08T19:31:32.433 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.433 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.433 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:31:32.433 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.628002+0000", 2021-10-08T19:31:32.433 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.005521214 2021-10-08T19:31:32.434 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.434 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.434 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:32.434 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.630202+0000", 2021-10-08T19:31:32.434 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021990970000000001 2021-10-08T19:31:32.435 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.435 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.435 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:32.435 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.630618+0000", 2021-10-08T19:31:32.436 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00041630500000000001 2021-10-08T19:31:32.436 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.436 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.436 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:32.436 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.741921+0000", 2021-10-08T19:31:32.437 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.11130298299999999 2021-10-08T19:31:32.437 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.437 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.437 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:31:32.437 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.741978+0000", 2021-10-08T19:31:32.438 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7679000000000001e-05 2021-10-08T19:31:32.438 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.438 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.438 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:32.438 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.742880+0000", 2021-10-08T19:31:32.439 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00090192699999999996 2021-10-08T19:31:32.439 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:32.439 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:32.439 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:32.439 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.440 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.440 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:117023 7.c 7:34632384:::benchmark_data_smithi097_93198_object25203:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e147)", 2021-10-08T19:31:32.440 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:57.635872+0000", 2021-10-08T19:31:32.440 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 334.60669699800002, 2021-10-08T19:31:32.440 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.10940074800000001, 2021-10-08T19:31:32.441 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:32.441 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:31:32.441 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:31:32.441 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:31:32.442 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:31:32.442 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 117023 2021-10-08T19:31:32.442 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.442 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:32.442 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.443 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:32.443 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.635872+0000", 2021-10-08T19:31:32.443 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:32.443 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.443 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.444 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:32.444 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.635872+0000", 2021-10-08T19:31:32.444 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:32.444 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.444 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.445 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:32.445 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.635869+0000", 2021-10-08T19:31:32.445 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999967 2021-10-08T19:31:32.445 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.446 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.446 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:32.446 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.635879+0000", 2021-10-08T19:31:32.446 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0352e-05 2021-10-08T19:31:32.446 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.447 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.447 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:32.447 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.635897+0000", 2021-10-08T19:31:32.447 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8068999999999999e-05 2021-10-08T19:31:32.447 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.448 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.448 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:32.448 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.635905+0000", 2021-10-08T19:31:32.448 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3950000000000003e-06 2021-10-08T19:31:32.448 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.449 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.449 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:32.449 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.635962+0000", 2021-10-08T19:31:32.449 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7688000000000001e-05 2021-10-08T19:31:32.449 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.450 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.450 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:32.450 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.636136+0000", 2021-10-08T19:31:32.450 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000174067 2021-10-08T19:31:32.450 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.451 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.451 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,6,7", 2021-10-08T19:31:32.451 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.636288+0000", 2021-10-08T19:31:32.451 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000152075 2021-10-08T19:31:32.452 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.452 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.452 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:31:32.452 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.639512+0000", 2021-10-08T19:31:32.452 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032239439999999999 2021-10-08T19:31:32.453 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.453 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.453 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:32.453 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.644075+0000", 2021-10-08T19:31:32.453 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0045628750000000001 2021-10-08T19:31:32.454 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.454 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.454 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:32.454 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.644128+0000", 2021-10-08T19:31:32.454 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3115999999999998e-05 2021-10-08T19:31:32.455 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.455 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.455 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:32.455 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.744275+0000", 2021-10-08T19:31:32.455 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.100146364 2021-10-08T19:31:32.456 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.456 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.456 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:31:32.456 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.744334+0000", 2021-10-08T19:31:32.456 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8984999999999999e-05 2021-10-08T19:31:32.457 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.457 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.457 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:32.457 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.745273+0000", 2021-10-08T19:31:32.457 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00093895199999999995 2021-10-08T19:31:32.458 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:32.458 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:32.458 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:32.458 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.459 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.459 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:158640 7.e 7:705eda0e:::benchmark_data_smithi097_93198_object66820:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158)", 2021-10-08T19:31:32.459 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:26:53.907516+0000", 2021-10-08T19:31:32.459 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 278.33505322299999, 2021-10-08T19:31:32.459 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.115901639, 2021-10-08T19:31:32.460 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:32.460 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:31:32.460 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:31:32.460 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:31:32.460 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:31:32.461 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 158640 2021-10-08T19:31:32.461 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.461 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:32.461 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.461 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:32.462 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:53.907516+0000", 2021-10-08T19:31:32.462 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:32.462 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.462 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.462 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:32.463 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:53.907516+0000", 2021-10-08T19:31:32.463 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:32.463 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.463 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.464 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:32.464 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:53.907515+0000", 2021-10-08T19:31:32.464 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:31:32.464 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.464 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.465 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:32.465 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:53.907519+0000", 2021-10-08T19:31:32.465 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6129999999999997e-06 2021-10-08T19:31:32.465 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.465 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.466 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:32.466 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:53.907527+0000", 2021-10-08T19:31:32.466 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7680000000000008e-06 2021-10-08T19:31:32.466 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.466 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.467 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:32.467 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:53.907533+0000", 2021-10-08T19:31:32.467 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5439999999999998e-06 2021-10-08T19:31:32.467 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.467 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.468 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:32.468 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:53.907577+0000", 2021-10-08T19:31:32.468 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4567000000000002e-05 2021-10-08T19:31:32.468 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.468 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.469 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:32.469 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:53.907672+0000", 2021-10-08T19:31:32.469 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5169999999999999e-05 2021-10-08T19:31:32.469 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.470 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.470 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:31:32.470 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:53.907767+0000", 2021-10-08T19:31:32.470 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5175999999999998e-05 2021-10-08T19:31:32.470 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.471 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.471 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:32.471 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:54.004267+0000", 2021-10-08T19:31:32.471 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.096499101000000004 2021-10-08T19:31:32.471 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.472 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.472 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:31:32.472 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:54.004287+0000", 2021-10-08T19:31:32.472 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0599e-05 2021-10-08T19:31:32.472 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.473 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.473 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:32.473 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:54.023326+0000", 2021-10-08T19:31:32.473 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019038798999999999 2021-10-08T19:31:32.473 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.474 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.474 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:31:32.474 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:54.023376+0000", 2021-10-08T19:31:32.474 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0269999999999998e-05 2021-10-08T19:31:32.475 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.475 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.475 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:32.475 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:54.023417+0000", 2021-10-08T19:31:32.475 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1094999999999999e-05 2021-10-08T19:31:32.476 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:32.476 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:32.476 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:32.476 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.476 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.477 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:159676 7.e 7:74985da7:::benchmark_data_smithi097_93198_object67856:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158)", 2021-10-08T19:31:32.477 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:26:55.204112+0000", 2021-10-08T19:31:32.477 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 277.038457107, 2021-10-08T19:31:32.477 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.10814876399999999, 2021-10-08T19:31:32.477 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:32.478 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:31:32.478 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:31:32.478 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:31:32.478 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:31:32.478 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 159676 2021-10-08T19:31:32.479 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.479 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:32.479 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.479 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:32.479 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.204112+0000", 2021-10-08T19:31:32.480 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:32.480 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.480 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.480 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:32.481 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.204112+0000", 2021-10-08T19:31:32.481 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:32.481 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.481 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.481 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:32.482 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.204110+0000", 2021-10-08T19:31:32.482 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:31:32.482 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.482 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.482 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:32.483 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.204117+0000", 2021-10-08T19:31:32.483 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6340000000000001e-06 2021-10-08T19:31:32.483 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.483 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.483 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:32.484 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.204129+0000", 2021-10-08T19:31:32.484 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1851000000000001e-05 2021-10-08T19:31:32.484 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.484 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.484 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:32.485 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.204136+0000", 2021-10-08T19:31:32.485 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7170000000000002e-06 2021-10-08T19:31:32.485 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.485 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.485 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:32.486 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.204177+0000", 2021-10-08T19:31:32.486 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1601999999999999e-05 2021-10-08T19:31:32.486 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.486 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.487 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:32.487 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.204253+0000", 2021-10-08T19:31:32.487 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6007999999999995e-05 2021-10-08T19:31:32.487 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.487 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.488 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:31:32.488 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.204337+0000", 2021-10-08T19:31:32.488 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3407999999999998e-05 2021-10-08T19:31:32.488 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.488 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.489 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:32.489 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.206699+0000", 2021-10-08T19:31:32.489 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0023617680000000002 2021-10-08T19:31:32.489 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.489 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.490 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:31:32.490 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.207753+0000", 2021-10-08T19:31:32.490 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010547410000000001 2021-10-08T19:31:32.490 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.491 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.491 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:32.491 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.312177+0000", 2021-10-08T19:31:32.491 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.10442370199999999 2021-10-08T19:31:32.491 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.492 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.492 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:31:32.492 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.312223+0000", 2021-10-08T19:31:32.492 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6147999999999999e-05 2021-10-08T19:31:32.492 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.493 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.493 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:32.493 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.312261+0000", 2021-10-08T19:31:32.493 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7398999999999999e-05 2021-10-08T19:31:32.493 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:32.494 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:32.494 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:32.494 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.494 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.495 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:161975 7.8 7:114b2586:::benchmark_data_smithi097_93198_object70155:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158)", 2021-10-08T19:31:32.495 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:26:58.330662+0000", 2021-10-08T19:31:32.495 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 273.91190677100002, 2021-10-08T19:31:32.496 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.21377785099999999, 2021-10-08T19:31:32.496 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:32.496 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:31:32.496 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:31:32.497 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:31:32.497 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:31:32.497 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 161975 2021-10-08T19:31:32.497 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.497 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:32.498 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.498 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:32.498 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.330662+0000", 2021-10-08T19:31:32.498 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:32.498 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.499 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.499 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:32.499 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.330662+0000", 2021-10-08T19:31:32.499 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:32.500 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.500 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.500 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:32.500 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.330660+0000", 2021-10-08T19:31:32.500 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:31:32.501 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.501 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.501 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:32.501 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.330667+0000", 2021-10-08T19:31:32.501 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0280000000000003e-06 2021-10-08T19:31:32.502 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.502 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.502 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:32.502 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.330677+0000", 2021-10-08T19:31:32.503 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0149000000000001e-05 2021-10-08T19:31:32.503 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.503 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.503 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:32.503 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.330683+0000", 2021-10-08T19:31:32.504 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7649999999999999e-06 2021-10-08T19:31:32.504 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.504 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.504 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:32.505 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.330722+0000", 2021-10-08T19:31:32.505 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8717999999999998e-05 2021-10-08T19:31:32.505 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.506 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.506 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:32.506 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.330831+0000", 2021-10-08T19:31:32.506 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000108887 2021-10-08T19:31:32.507 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.507 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.507 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4,7", 2021-10-08T19:31:32.507 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.330939+0000", 2021-10-08T19:31:32.508 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000108608 2021-10-08T19:31:32.508 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.508 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.508 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:32.508 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.335977+0000", 2021-10-08T19:31:32.509 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0050375250000000002 2021-10-08T19:31:32.509 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.509 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.509 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:31:32.510 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.335997+0000", 2021-10-08T19:31:32.510 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0086999999999999e-05 2021-10-08T19:31:32.510 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.510 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.510 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:32.511 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.544379+0000", 2021-10-08T19:31:32.511 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.208382345 2021-10-08T19:31:32.511 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.511 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.512 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:31:32.512 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.544415+0000", 2021-10-08T19:31:32.512 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5704999999999998e-05 2021-10-08T19:31:32.512 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.512 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.513 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:32.513 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.544440+0000", 2021-10-08T19:31:32.513 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5032e-05 2021-10-08T19:31:32.513 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:32.513 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:32.514 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:32.514 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.514 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.515 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:161982 7.8 7:17dd4ca8:::benchmark_data_smithi097_93198_object70162:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158)", 2021-10-08T19:31:32.515 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:26:58.338172+0000", 2021-10-08T19:31:32.515 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 273.904397018, 2021-10-08T19:31:32.515 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.20636200499999999, 2021-10-08T19:31:32.516 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:32.516 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:31:32.516 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:31:32.517 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:31:32.517 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:31:32.517 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 161982 2021-10-08T19:31:32.517 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.517 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:32.518 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.518 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:32.518 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.338172+0000", 2021-10-08T19:31:32.518 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:32.518 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.519 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.519 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:32.519 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.338172+0000", 2021-10-08T19:31:32.519 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:32.520 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.520 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.520 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:32.520 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.338169+0000", 2021-10-08T19:31:32.520 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:31:32.521 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.521 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.521 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:32.521 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.338178+0000", 2021-10-08T19:31:32.521 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1089999999999998e-06 2021-10-08T19:31:32.522 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.522 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.522 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:32.522 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.338189+0000", 2021-10-08T19:31:32.523 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.167e-05 2021-10-08T19:31:32.523 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.523 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.523 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:32.523 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.338196+0000", 2021-10-08T19:31:32.524 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7880000000000001e-06 2021-10-08T19:31:32.524 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.524 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.524 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:32.525 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.338239+0000", 2021-10-08T19:31:32.525 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3055e-05 2021-10-08T19:31:32.525 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.525 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.526 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:32.526 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.338355+0000", 2021-10-08T19:31:32.526 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000116012 2021-10-08T19:31:32.527 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.527 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.527 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4,7", 2021-10-08T19:31:32.527 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.338478+0000", 2021-10-08T19:31:32.527 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012258399999999999 2021-10-08T19:31:32.528 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.528 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.528 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:31:32.528 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.341678+0000", 2021-10-08T19:31:32.529 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031999760000000002 2021-10-08T19:31:32.529 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.529 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.529 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:32.529 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.345366+0000", 2021-10-08T19:31:32.530 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003688654 2021-10-08T19:31:32.530 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.530 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.530 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:32.531 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.544479+0000", 2021-10-08T19:31:32.531 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.19911299299999999 2021-10-08T19:31:32.531 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.531 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.531 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:31:32.532 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.544513+0000", 2021-10-08T19:31:32.532 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4167e-05 2021-10-08T19:31:32.532 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.532 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.533 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:32.533 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.544534+0000", 2021-10-08T19:31:32.533 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0406000000000001e-05 2021-10-08T19:31:32.533 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:32.533 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:32.534 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:32.534 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.534 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.534 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:162006 7.8 7:18e88623:::benchmark_data_smithi097_93198_object70186:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158)", 2021-10-08T19:31:32.535 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:26:58.374366+0000", 2021-10-08T19:31:32.535 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 273.868202516, 2021-10-08T19:31:32.535 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.17491137500000001, 2021-10-08T19:31:32.535 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:32.536 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:31:32.536 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:31:32.536 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:31:32.537 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:31:32.537 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 162006 2021-10-08T19:31:32.537 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.537 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:32.537 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.538 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:32.538 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.374366+0000", 2021-10-08T19:31:32.538 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:32.538 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.538 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.539 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:32.539 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.374366+0000", 2021-10-08T19:31:32.539 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:32.539 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.539 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.540 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:32.540 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.374364+0000", 2021-10-08T19:31:32.540 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:31:32.540 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.541 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.541 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:32.541 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.374372+0000", 2021-10-08T19:31:32.541 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4200000000000001e-06 2021-10-08T19:31:32.541 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.542 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.542 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:32.542 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.374387+0000", 2021-10-08T19:31:32.542 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5359999999999999e-05 2021-10-08T19:31:32.542 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.543 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.543 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:32.543 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.374395+0000", 2021-10-08T19:31:32.543 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4719999999999998e-06 2021-10-08T19:31:32.543 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.544 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.544 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:32.544 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.374451+0000", 2021-10-08T19:31:32.544 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5791000000000002e-05 2021-10-08T19:31:32.545 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.545 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.545 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:32.545 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.374539+0000", 2021-10-08T19:31:32.546 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8510999999999993e-05 2021-10-08T19:31:32.546 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.546 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.547 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4,7", 2021-10-08T19:31:32.547 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.374659+0000", 2021-10-08T19:31:32.547 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119647 2021-10-08T19:31:32.547 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.547 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.548 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:31:32.548 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.377838+0000", 2021-10-08T19:31:32.548 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003178817 2021-10-08T19:31:32.548 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.548 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.549 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:32.549 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.378153+0000", 2021-10-08T19:31:32.549 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031545800000000001 2021-10-08T19:31:32.550 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.550 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.550 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:32.550 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.549177+0000", 2021-10-08T19:31:32.550 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.171024236 2021-10-08T19:31:32.551 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.551 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.551 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:31:32.551 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.549233+0000", 2021-10-08T19:31:32.552 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5806000000000001e-05 2021-10-08T19:31:32.552 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.552 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.552 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:32.552 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.549278+0000", 2021-10-08T19:31:32.553 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4728000000000003e-05 2021-10-08T19:31:32.553 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:32.553 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:32.553 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:32.553 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.554 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.554 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:162015 7.8 7:13e56b01:::benchmark_data_smithi097_93198_object70195:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158)", 2021-10-08T19:31:32.554 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:26:58.403700+0000", 2021-10-08T19:31:32.554 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 273.83886882500002, 2021-10-08T19:31:32.555 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.145692814, 2021-10-08T19:31:32.555 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:32.555 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:31:32.555 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:31:32.556 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:31:32.556 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:31:32.556 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 162015 2021-10-08T19:31:32.557 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.557 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:32.557 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.557 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:32.557 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.403700+0000", 2021-10-08T19:31:32.558 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:32.558 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.558 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.558 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:32.558 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.403700+0000", 2021-10-08T19:31:32.559 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:32.559 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.559 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.559 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:32.560 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.403697+0000", 2021-10-08T19:31:32.560 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2021-10-08T19:31:32.560 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.560 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.560 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:32.561 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.403708+0000", 2021-10-08T19:31:32.561 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0558e-05 2021-10-08T19:31:32.561 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.561 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.561 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:32.562 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.403728+0000", 2021-10-08T19:31:32.562 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0367e-05 2021-10-08T19:31:32.562 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.562 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.562 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:32.563 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.403736+0000", 2021-10-08T19:31:32.563 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2460000000000003e-06 2021-10-08T19:31:32.563 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.563 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.564 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:32.564 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.403791+0000", 2021-10-08T19:31:32.564 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4670999999999999e-05 2021-10-08T19:31:32.564 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.565 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.565 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:32.565 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.403937+0000", 2021-10-08T19:31:32.566 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014544300000000001 2021-10-08T19:31:32.566 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.566 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.566 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4,7", 2021-10-08T19:31:32.566 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.404069+0000", 2021-10-08T19:31:32.567 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000132082 2021-10-08T19:31:32.567 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.567 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.567 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:32.568 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.406592+0000", 2021-10-08T19:31:32.568 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00252375 2021-10-08T19:31:32.568 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.568 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.568 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:31:32.569 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.406657+0000", 2021-10-08T19:31:32.569 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4361000000000003e-05 2021-10-08T19:31:32.569 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.569 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.569 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:32.570 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.549322+0000", 2021-10-08T19:31:32.570 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.14266500200000001 2021-10-08T19:31:32.570 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.570 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.570 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:31:32.571 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.549367+0000", 2021-10-08T19:31:32.571 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4883999999999999e-05 2021-10-08T19:31:32.571 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.571 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.571 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:32.572 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.549393+0000", 2021-10-08T19:31:32.572 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6273000000000001e-05 2021-10-08T19:31:32.572 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:32.572 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:32.572 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:32.573 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.573 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.573 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "MOSDPGPushReply(4.1c 197/196 [PushReplyOp(4:3d9e841d:::obj_delete_at_hint.0000000041:head)])", 2021-10-08T19:31:32.573 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:28:24.395953+0000", 2021-10-08T19:31:32.574 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 187.84661607300001, 2021-10-08T19:31:32.574 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.11790047100000001, 2021-10-08T19:31:32.574 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:32.574 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "reached pg", 2021-10-08T19:31:32.575 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:32.575 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.575 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:32.575 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:24.395953+0000", 2021-10-08T19:31:32.576 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:32.576 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.576 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.576 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:32.577 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:24.395953+0000", 2021-10-08T19:31:32.577 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:32.577 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.577 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.577 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:32.578 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:24.395951+0000", 2021-10-08T19:31:32.578 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2021-10-08T19:31:32.578 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.578 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.579 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:32.579 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:24.395959+0000", 2021-10-08T19:31:32.579 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4789999999999999e-06 2021-10-08T19:31:32.579 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.579 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.580 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:32.580 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:24.395970+0000", 2021-10-08T19:31:32.580 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1021e-05 2021-10-08T19:31:32.580 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.580 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.581 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:32.581 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:24.395975+0000", 2021-10-08T19:31:32.581 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9370000000000003e-06 2021-10-08T19:31:32.581 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.581 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.582 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:32.582 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:24.513707+0000", 2021-10-08T19:31:32.582 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.11773249700000001 2021-10-08T19:31:32.582 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.582 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.583 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:32.583 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:24.513853+0000", 2021-10-08T19:31:32.583 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000146069 2021-10-08T19:31:32.583 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:32.583 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:32.584 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:32.584 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.584 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.584 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:95896 8.f 8:f4157ae7:::benchmark_data_smithi097_144160_object7156:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e228)", 2021-10-08T19:31:32.585 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:29.766663+0000", 2021-10-08T19:31:32.585 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 122.475905646, 2021-10-08T19:31:32.585 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9412932270000001, 2021-10-08T19:31:32.586 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:32.586 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:31:32.586 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:31:32.586 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:31:32.587 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:31:32.587 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 95896 2021-10-08T19:31:32.587 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.587 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:32.587 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.588 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:32.588 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.766663+0000", 2021-10-08T19:31:32.588 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:32.588 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.589 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.589 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:32.589 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.766663+0000", 2021-10-08T19:31:32.589 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:32.589 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.590 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.590 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:32.590 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.766662+0000", 2021-10-08T19:31:32.590 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2021-10-08T19:31:32.591 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.591 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.591 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:32.591 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.766667+0000", 2021-10-08T19:31:32.591 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7809999999999996e-06 2021-10-08T19:31:32.592 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.592 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.592 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:32.592 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.766673+0000", 2021-10-08T19:31:32.592 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1419999999999998e-06 2021-10-08T19:31:32.593 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.593 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.593 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:32.593 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.766678+0000", 2021-10-08T19:31:32.594 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5090000000000001e-06 2021-10-08T19:31:32.594 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.594 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.594 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:32.595 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.766728+0000", 2021-10-08T19:31:32.595 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9429999999999999e-05 2021-10-08T19:31:32.595 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.595 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.596 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:31:32.596 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.766737+0000", 2021-10-08T19:31:32.596 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8829999999999995e-06 2021-10-08T19:31:32.596 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.597 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.597 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:32.597 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:30.600075+0000", 2021-10-08T19:31:32.597 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.833338095 2021-10-08T19:31:32.597 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.598 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.598 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:31:32.598 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:30.600085+0000", 2021-10-08T19:31:32.598 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0237999999999999e-05 2021-10-08T19:31:32.598 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.599 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.599 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:32.599 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.703691+0000", 2021-10-08T19:31:32.599 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.103606206 2021-10-08T19:31:32.599 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.600 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.600 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:32.600 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.703858+0000", 2021-10-08T19:31:32.600 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000166284 2021-10-08T19:31:32.601 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.601 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.601 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,3,4", 2021-10-08T19:31:32.601 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.704051+0000", 2021-10-08T19:31:32.601 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019300200000000001 2021-10-08T19:31:32.602 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.602 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.602 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:31:32.602 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.706431+0000", 2021-10-08T19:31:32.602 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002380521 2021-10-08T19:31:32.603 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.603 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.603 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:32.603 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.706718+0000", 2021-10-08T19:31:32.604 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00028731500000000001 2021-10-08T19:31:32.604 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.604 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.604 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:32.605 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.706931+0000", 2021-10-08T19:31:32.605 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000212358 2021-10-08T19:31:32.605 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.606 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.606 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:32.606 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.707782+0000", 2021-10-08T19:31:32.606 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00085145800000000003 2021-10-08T19:31:32.606 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.607 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.607 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:31:32.607 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.707841+0000", 2021-10-08T19:31:32.607 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9330999999999998e-05 2021-10-08T19:31:32.607 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:32.608 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:32.608 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:32.608 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.707956+0000", 2021-10-08T19:31:32.608 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011496499999999999 2021-10-08T19:31:32.609 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:32.609 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:32.609 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:32.609 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:32.609 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:32.610 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:31:32.610 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:31:32.635 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:32.678 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:31:32.680 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:32.681 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:31:32.782 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:31:32.806 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:32.839 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'unique_pool_2' created 2021-10-08T19:31:32.841 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.7 to 1 (10000) 2021-10-08T19:31:32.855 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:31:32.857 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:32.858 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:31:32.959 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:31:32.970 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:31:32 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:31:32] "GET /metrics HTTP/1.1" 200 154773 "" "Prometheus/2.18.1" 2021-10-08T19:31:32.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:32 smithi097 ceph-mon[41966]: 4.1e scrub ok 2021-10-08T19:31:32.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:32 smithi097 ceph-mon[41966]: 4.19 scrub ok 2021-10-08T19:31:32.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:32 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/4224767119' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2021-10-08T19:31:32.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:32 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3818994991' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_2", "pg_num": 16}]: dispatch 2021-10-08T19:31:32.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:32 smithi097 ceph-mon[32687]: 4.1e scrub ok 2021-10-08T19:31:32.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:32 smithi097 ceph-mon[32687]: 4.19 scrub ok 2021-10-08T19:31:32.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:32 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/4224767119' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2021-10-08T19:31:32.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:32 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3818994991' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_2", "pg_num": 16}]: dispatch 2021-10-08T19:31:32.985 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:32.994 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2021-10-08T19:31:33.125 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:31:33.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:32 smithi117 ceph-mon[34585]: 4.1e scrub ok 2021-10-08T19:31:33.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:32 smithi117 ceph-mon[34585]: 4.19 scrub ok 2021-10-08T19:31:33.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:32 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/4224767119' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2021-10-08T19:31:33.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:32 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3818994991' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_2", "pg_num": 16}]: dispatch 2021-10-08T19:31:33.583 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:31:33.586 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:33.587 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:31:33.597 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2021-10-08T19:31:33.688 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:31:33.712 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:34.156 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:31:33 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:31:33] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:31:34.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:33 smithi117 ceph-mon[34585]: 6.1b scrub ok 2021-10-08T19:31:34.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:33 smithi117 ceph-mon[34585]: pgmap v514: 162 pgs: 162 active+clean; 477 KiB data, 1.3 GiB used, 714 GiB / 715 GiB avail 2021-10-08T19:31:34.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:33 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/4224767119' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]': finished 2021-10-08T19:31:34.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:33 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3818994991' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_2", "pg_num": 16}]': finished 2021-10-08T19:31:34.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:33 smithi117 ceph-mon[34585]: osdmap e290: 8 total, 8 up, 8 in 2021-10-08T19:31:34.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:33 smithi117 ceph-mon[34585]: 3.3 scrub ok 2021-10-08T19:31:34.166 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:33 smithi097 ceph-mon[41966]: 6.1b scrub ok 2021-10-08T19:31:34.166 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:33 smithi097 ceph-mon[41966]: pgmap v514: 162 pgs: 162 active+clean; 477 KiB data, 1.3 GiB used, 714 GiB / 715 GiB avail 2021-10-08T19:31:34.166 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:33 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/4224767119' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]': finished 2021-10-08T19:31:34.166 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:33 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3818994991' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_2", "pg_num": 16}]': finished 2021-10-08T19:31:34.167 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:33 smithi097 ceph-mon[41966]: osdmap e290: 8 total, 8 up, 8 in 2021-10-08T19:31:34.167 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:33 smithi097 ceph-mon[41966]: 3.3 scrub ok 2021-10-08T19:31:34.167 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:33 smithi097 ceph-mon[32687]: 6.1b scrub ok 2021-10-08T19:31:34.168 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:33 smithi097 ceph-mon[32687]: pgmap v514: 162 pgs: 162 active+clean; 477 KiB data, 1.3 GiB used, 714 GiB / 715 GiB avail 2021-10-08T19:31:34.168 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:33 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/4224767119' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]': finished 2021-10-08T19:31:34.168 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:33 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3818994991' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_2", "pg_num": 16}]': finished 2021-10-08T19:31:34.168 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:33 smithi097 ceph-mon[32687]: osdmap e290: 8 total, 8 up, 8 in 2021-10-08T19:31:34.168 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:33 smithi097 ceph-mon[32687]: 3.3 scrub ok 2021-10-08T19:31:34.169 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd pool application enable unique_pool_2 rados --yes-i-really-mean-it || true 2021-10-08T19:31:34.309 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:31:34.312 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:34.313 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:31:34.336 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd reweight 6 1 2021-10-08T19:31:34.414 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:31:34.441 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:34.491 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:31:34.493 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:34.494 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:31:34.595 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:31:34.595 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:31:34.596 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:31:34.620 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:34.663 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:31:34.665 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:34.666 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:31:34.768 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:31:34.791 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:34.833 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:31:34.834 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:34.835 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:31:34.936 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:31:34.959 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:35.001 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:31:35.003 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:35.004 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:31:35.105 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:31:35.126 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:34 smithi117 ceph-mon[34585]: 6.8 scrub ok 2021-10-08T19:31:35.126 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:34 smithi117 ceph-mon[34585]: 4.1c scrub ok 2021-10-08T19:31:35.127 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:34 smithi117 ceph-mon[34585]: 2.17 scrub ok 2021-10-08T19:31:35.127 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:34 smithi117 ceph-mon[34585]: 1.1 scrub ok 2021-10-08T19:31:35.127 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:34 smithi117 ceph-mon[34585]: osdmap e291: 8 total, 8 up, 8 in 2021-10-08T19:31:35.128 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:35.172 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:31:35.174 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:35.174 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:31:35.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:34 smithi097 ceph-mon[32687]: 6.8 scrub ok 2021-10-08T19:31:35.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:34 smithi097 ceph-mon[32687]: 4.1c scrub ok 2021-10-08T19:31:35.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:34 smithi097 ceph-mon[32687]: 2.17 scrub ok 2021-10-08T19:31:35.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:34 smithi097 ceph-mon[32687]: 1.1 scrub ok 2021-10-08T19:31:35.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:34 smithi097 ceph-mon[32687]: osdmap e291: 8 total, 8 up, 8 in 2021-10-08T19:31:35.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:34 smithi097 ceph-mon[41966]: 6.8 scrub ok 2021-10-08T19:31:35.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:34 smithi097 ceph-mon[41966]: 4.1c scrub ok 2021-10-08T19:31:35.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:34 smithi097 ceph-mon[41966]: 2.17 scrub ok 2021-10-08T19:31:35.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:34 smithi097 ceph-mon[41966]: 1.1 scrub ok 2021-10-08T19:31:35.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:34 smithi097 ceph-mon[41966]: osdmap e291: 8 total, 8 up, 8 in 2021-10-08T19:31:35.276 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:31:35.300 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:35.351 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:31:35.352 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:31:35.516 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:31:35.522 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:35.523 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:31:35.624 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:31:35.651 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:35.695 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:31:35.697 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:35.698 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:31:35.799 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:31:35.823 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:35.865 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:31:35.867 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:35.868 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:31:35.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:35 smithi117 ceph-mon[34585]: 5.9 scrub ok 2021-10-08T19:31:35.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:35 smithi117 ceph-mon[34585]: 6.f scrub ok 2021-10-08T19:31:35.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:35 smithi117 ceph-mon[34585]: pgmap v517: 178 pgs: 3 creating+activating, 7 creating+peering, 168 active+clean; 425 KiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 69 KiB/s rd, 0 B/s wr, 116 op/s 2021-10-08T19:31:35.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:35 smithi117 ceph-mon[34585]: osdmap e292: 8 total, 8 up, 8 in 2021-10-08T19:31:35.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:35 smithi117 ceph-mon[34585]: osdmap e293: 8 total, 8 up, 8 in 2021-10-08T19:31:35.969 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:31:35.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:35 smithi097 ceph-mon[41966]: 5.9 scrub ok 2021-10-08T19:31:35.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:35 smithi097 ceph-mon[41966]: 6.f scrub ok 2021-10-08T19:31:35.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:35 smithi097 ceph-mon[41966]: pgmap v517: 178 pgs: 3 creating+activating, 7 creating+peering, 168 active+clean; 425 KiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 69 KiB/s rd, 0 B/s wr, 116 op/s 2021-10-08T19:31:35.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:35 smithi097 ceph-mon[41966]: osdmap e292: 8 total, 8 up, 8 in 2021-10-08T19:31:35.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:35 smithi097 ceph-mon[41966]: osdmap e293: 8 total, 8 up, 8 in 2021-10-08T19:31:35.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:35 smithi097 ceph-mon[32687]: 5.9 scrub ok 2021-10-08T19:31:35.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:35 smithi097 ceph-mon[32687]: 6.f scrub ok 2021-10-08T19:31:35.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:35 smithi097 ceph-mon[32687]: pgmap v517: 178 pgs: 3 creating+activating, 7 creating+peering, 168 active+clean; 425 KiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 69 KiB/s rd, 0 B/s wr, 116 op/s 2021-10-08T19:31:35.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:35 smithi097 ceph-mon[32687]: osdmap e292: 8 total, 8 up, 8 in 2021-10-08T19:31:35.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:35 smithi097 ceph-mon[32687]: osdmap e293: 8 total, 8 up, 8 in 2021-10-08T19:31:35.999 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:36.352 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:31:36.354 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:36.355 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:31:36.456 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:31:36.481 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:36.865 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is set 2021-10-08T19:31:37.156 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:31:36 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:31:37.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:36 smithi117 ceph-mon[34585]: 4.1f scrub ok 2021-10-08T19:31:37.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:36 smithi117 ceph-mon[34585]: 1.a scrub ok 2021-10-08T19:31:37.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:36 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3903751274' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:31:37.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:36 smithi117 ceph-mon[34585]: from='client.25438 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:31:37.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:36 smithi097 ceph-mon[41966]: 4.1f scrub ok 2021-10-08T19:31:37.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:36 smithi097 ceph-mon[41966]: 1.a scrub ok 2021-10-08T19:31:37.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:36 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3903751274' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:31:37.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:36 smithi097 ceph-mon[41966]: from='client.25438 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:31:37.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:36 smithi097 ceph-mon[32687]: 4.1f scrub ok 2021-10-08T19:31:37.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:36 smithi097 ceph-mon[32687]: 1.a scrub ok 2021-10-08T19:31:37.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:36 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3903751274' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:31:37.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:36 smithi097 ceph-mon[32687]: from='client.25438 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:31:37.473 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:31:37.475 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:37.476 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:31:37.577 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:31:37.603 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:37.703 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:31:37.705 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:37.707 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:31:37.808 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:31:37.836 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:37.859 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:37 smithi097 ceph-mon[32687]: 4.13 scrub ok 2021-10-08T19:31:37.859 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:37 smithi097 ceph-mon[32687]: 6.1c scrub ok 2021-10-08T19:31:37.859 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:37 smithi097 ceph-mon[32687]: 5.3 scrub ok 2021-10-08T19:31:37.859 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:37 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:31:37.860 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:37 smithi097 ceph-mon[32687]: pgmap v520: 178 pgs: 3 creating+activating, 7 creating+peering, 168 active+clean; 425 KiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 101 KiB/s rd, 0 B/s wr, 170 op/s 2021-10-08T19:31:37.885 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:31:37.888 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:37.888 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:31:37.990 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:31:38.015 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:38.058 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:31:38.061 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:38.062 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:31:38.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:37 smithi117 ceph-mon[34585]: 4.13 scrub ok 2021-10-08T19:31:38.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:37 smithi117 ceph-mon[34585]: 6.1c scrub ok 2021-10-08T19:31:38.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:37 smithi117 ceph-mon[34585]: 5.3 scrub ok 2021-10-08T19:31:38.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:37 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:31:38.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:37 smithi117 ceph-mon[34585]: pgmap v520: 178 pgs: 3 creating+activating, 7 creating+peering, 168 active+clean; 425 KiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 101 KiB/s rd, 0 B/s wr, 170 op/s 2021-10-08T19:31:38.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:37 smithi117 ceph-mon[34585]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:31:38.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:37 smithi117 ceph-mon[34585]: from='client.25438 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:31:38.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:37 smithi117 ceph-mon[34585]: osdmap e294: 8 total, 8 up, 8 in 2021-10-08T19:31:38.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:37 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:31:38.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:37 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:31:38.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:37 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:31:38.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:37 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:31:38.163 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:31:38.187 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:38.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:37 smithi097 ceph-mon[32687]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:31:38.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:37 smithi097 ceph-mon[32687]: from='client.25438 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:31:38.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:37 smithi097 ceph-mon[32687]: osdmap e294: 8 total, 8 up, 8 in 2021-10-08T19:31:38.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:37 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:31:38.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:37 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:31:38.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:37 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:31:38.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:37 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:31:38.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:37 smithi097 ceph-mon[41966]: 4.13 scrub ok 2021-10-08T19:31:38.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:37 smithi097 ceph-mon[41966]: 6.1c scrub ok 2021-10-08T19:31:38.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:37 smithi097 ceph-mon[41966]: 5.3 scrub ok 2021-10-08T19:31:38.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:37 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:31:38.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:37 smithi097 ceph-mon[41966]: pgmap v520: 178 pgs: 3 creating+activating, 7 creating+peering, 168 active+clean; 425 KiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 101 KiB/s rd, 0 B/s wr, 170 op/s 2021-10-08T19:31:38.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:37 smithi097 ceph-mon[41966]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:31:38.225 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:37 smithi097 ceph-mon[41966]: from='client.25438 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:31:38.225 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:37 smithi097 ceph-mon[41966]: osdmap e294: 8 total, 8 up, 8 in 2021-10-08T19:31:38.225 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:37 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:31:38.226 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:37 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:31:38.226 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:37 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:31:38.226 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:37 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:31:38.229 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:31:38.231 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:38.232 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:31:38.336 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:31:38.361 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:38.707 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:31:38.710 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:38.711 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:31:38.812 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:31:38.831 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:31:38.832 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2021-10-08T19:31:38.832 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2021-10-08T19:31:38.832 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:31:38.836 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:38.881 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:31:38.883 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:38.884 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:31:38.985 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:31:39.013 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:39.077 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:31:39.094 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:31:39.114 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:31:39.131 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:31:39.151 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:31:39.168 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:31:39.187 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:31:39.205 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:31:39.206 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'false' 2021-10-08T19:31:39.206 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'false' 2021-10-08T19:31:39.206 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'false' 2021-10-08T19:31:39.207 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'false' 2021-10-08T19:31:39.207 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'false' 2021-10-08T19:31:39.208 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'false' 2021-10-08T19:31:39.208 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'false' 2021-10-08T19:31:39.208 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'false' 2021-10-08T19:31:39.686 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set nodeep-scrub 2021-10-08T19:31:39.861 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:31:39.864 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:39.864 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:31:39.966 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:31:39.990 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:40.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:39 smithi117 ceph-mon[34585]: pgmap v522: 178 pgs: 3 creating+activating, 175 active+clean; 320 KiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 46 KiB/s rd, 0 B/s wr, 81 op/s 2021-10-08T19:31:40.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:39 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/244081161' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:31:40.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:39 smithi097 ceph-mon[32687]: pgmap v522: 178 pgs: 3 creating+activating, 175 active+clean; 320 KiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 46 KiB/s rd, 0 B/s wr, 81 op/s 2021-10-08T19:31:40.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:39 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/244081161' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:31:40.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:39 smithi097 ceph-mon[41966]: pgmap v522: 178 pgs: 3 creating+activating, 175 active+clean; 320 KiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 46 KiB/s rd, 0 B/s wr, 81 op/s 2021-10-08T19:31:40.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:39 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/244081161' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:31:40.248 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2021-10-08T19:31:40.337 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:31:40.339 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:40.340 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:31:40.441 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:31:40.471 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:40.520 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:31:40.522 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:40.523 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:31:40.624 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:31:40.651 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:40.654 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.6 to 1 (10000) 2021-10-08T19:31:40.697 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:31:40.699 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:40.700 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:31:40.801 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:31:40.827 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:40.933 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:40 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3812873724' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2021-10-08T19:31:40.933 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:40 smithi097 ceph-mon[41966]: from='client.25450 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2021-10-08T19:31:40.934 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:40 smithi097 ceph-mon[41966]: from='client.25450 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]': finished 2021-10-08T19:31:40.934 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:40 smithi097 ceph-mon[41966]: osdmap e295: 8 total, 8 up, 8 in 2021-10-08T19:31:40.934 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:40 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3812873724' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2021-10-08T19:31:40.935 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:40 smithi097 ceph-mon[32687]: from='client.25450 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2021-10-08T19:31:40.935 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:40 smithi097 ceph-mon[32687]: from='client.25450 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]': finished 2021-10-08T19:31:40.935 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:40 smithi097 ceph-mon[32687]: osdmap e295: 8 total, 8 up, 8 in 2021-10-08T19:31:41.073 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:31:41.075 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:41.076 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:31:41.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:40 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3812873724' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2021-10-08T19:31:41.194 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:40 smithi117 ceph-mon[34585]: from='client.25450 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2021-10-08T19:31:41.194 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:40 smithi117 ceph-mon[34585]: from='client.25450 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]': finished 2021-10-08T19:31:41.194 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:40 smithi117 ceph-mon[34585]: osdmap e295: 8 total, 8 up, 8 in 2021-10-08T19:31:41.195 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:31:41.220 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:41.536 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:31:41.553 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd reweight 1 1 2021-10-08T19:31:41.558 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:31:41.560 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:41.561 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:31:41.582 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:31:41.662 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:31:41.690 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:41.787 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:31:41.790 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:41.791 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:31:41.875 INFO:teuthology.orchestra.run.smithi097.stderr:enabled application 'rados' on pool 'unique_pool_2' 2021-10-08T19:31:41.892 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:31:41.921 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:41.968 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:31:41.971 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:41.974 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:31:42.075 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:31:42.098 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:41 smithi097 ceph-mon[41966]: pgmap v524: 178 pgs: 178 active+clean; 320 KiB data, 1.3 GiB used, 714 GiB / 715 GiB avail 2021-10-08T19:31:42.098 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:41 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/4225632985' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_2", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:42.098 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:41 smithi097 ceph-mon[41966]: from='client.25456 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_2", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:42.099 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:41 smithi097 ceph-mon[32687]: pgmap v524: 178 pgs: 178 active+clean; 320 KiB data, 1.3 GiB used, 714 GiB / 715 GiB avail 2021-10-08T19:31:42.099 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:41 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/4225632985' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_2", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:42.099 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:41 smithi097 ceph-mon[32687]: from='client.25456 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_2", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:42.100 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:42.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:41 smithi117 ceph-mon[34585]: pgmap v524: 178 pgs: 178 active+clean; 320 KiB data, 1.3 GiB used, 714 GiB / 715 GiB avail 2021-10-08T19:31:42.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:41 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/4225632985' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_2", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:42.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:41 smithi117 ceph-mon[34585]: from='client.25456 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_2", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:42.783 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:31:42.785 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:42.785 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:31:42.886 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:31:42.908 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:31:42 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:31:42] "GET /metrics HTTP/1.1" 200 155702 "" "Prometheus/2.18.1" 2021-10-08T19:31:42.909 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:42 smithi097 ceph-mon[41966]: from='client.25456 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_2", "app": "rados", "yes_i_really_mean_it": true}]': finished 2021-10-08T19:31:42.909 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:42 smithi097 ceph-mon[41966]: osdmap e296: 8 total, 8 up, 8 in 2021-10-08T19:31:42.909 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:42 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:31:42.909 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:42 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:31:42.910 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:42 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:31:42.910 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:42 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:31:42.910 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:42 smithi097 ceph-mon[32687]: from='client.25456 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_2", "app": "rados", "yes_i_really_mean_it": true}]': finished 2021-10-08T19:31:42.911 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:42 smithi097 ceph-mon[32687]: osdmap e296: 8 total, 8 up, 8 in 2021-10-08T19:31:42.911 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:42 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:31:42.911 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:42 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:31:42.911 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:42 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:31:42.911 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:42 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:31:42.912 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:42.978 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2021-10-08T19:31:43.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:42 smithi117 ceph-mon[34585]: from='client.25456 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_2", "app": "rados", "yes_i_really_mean_it": true}]': finished 2021-10-08T19:31:43.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:42 smithi117 ceph-mon[34585]: osdmap e296: 8 total, 8 up, 8 in 2021-10-08T19:31:43.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:42 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:31:43.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:42 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:31:43.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:42 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:31:43.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:42 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:31:43.273 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:31:43.340 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:31:43.343 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:43.343 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:31:43.444 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:31:43.474 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:43.523 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:31:43.524 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:43.525 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:31:43.627 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:31:43.653 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:43.697 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:31:43.699 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:43.700 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:31:43.779 DEBUG:teuthology.orchestra.run.smithi097:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_2 bench 90 write' 2021-10-08T19:31:43.782 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2021-10-08T19:31:43.783 INFO:teuthology.orchestra.run:waiting for 3000 2021-10-08T19:31:43.801 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:31:43.822 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:31:43 smithi117 conmon[69189]: level=error ts=2021-10-08T19:31:43.504Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=2 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:31:43.824 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:43.825 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:hints = 1 2021-10-08T19:31:43.825 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2021-10-08T19:31:43.826 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Object prefix: benchmark_data_smithi097_196985 2021-10-08T19:31:43.826 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2021-10-08T19:31:43.826 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 0 0 0 0 0 0 - 0 2021-10-08T19:31:43.905 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:31:43.909 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:43.910 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:31:44.011 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:31:44.059 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:44.101 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:31:44.156 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:31:43 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:31:43] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:31:44.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:43 smithi117 ceph-mon[34585]: pgmap v526: 178 pgs: 178 active+clean; 320 KiB data, 1.3 GiB used, 714 GiB / 715 GiB avail 2021-10-08T19:31:44.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:43 smithi117 ceph-mon[34585]: osdmap e297: 8 total, 8 up, 8 in 2021-10-08T19:31:44.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [3, 5]}]: dispatch 2021-10-08T19:31:44.183 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:43 smithi097 ceph-mon[32687]: pgmap v526: 178 pgs: 178 active+clean; 320 KiB data, 1.3 GiB used, 714 GiB / 715 GiB avail 2021-10-08T19:31:44.184 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:43 smithi097 ceph-mon[32687]: osdmap e297: 8 total, 8 up, 8 in 2021-10-08T19:31:44.184 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [3, 5]}]: dispatch 2021-10-08T19:31:44.184 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:43 smithi097 ceph-mon[41966]: pgmap v526: 178 pgs: 178 active+clean; 320 KiB data, 1.3 GiB used, 714 GiB / 715 GiB avail 2021-10-08T19:31:44.184 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:43 smithi097 ceph-mon[41966]: osdmap e297: 8 total, 8 up, 8 in 2021-10-08T19:31:44.185 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [3, 5]}]: dispatch 2021-10-08T19:31:44.200 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:31:44.209 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:44.210 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:31:44.311 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:31:44.357 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:44.652 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:31:44.667 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:44.668 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:31:44.770 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:31:44.825 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 1 16 2707 2691 168.178 168.188 0.00447728 0.00593483 2021-10-08T19:31:44.834 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:45.139 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:44 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [3, 5]}]': finished 2021-10-08T19:31:45.139 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:44 smithi097 ceph-mon[41966]: osdmap e298: 8 total, 8 up, 8 in 2021-10-08T19:31:45.140 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:44 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [3, 5]}]': finished 2021-10-08T19:31:45.140 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:44 smithi097 ceph-mon[32687]: osdmap e298: 8 total, 8 up, 8 in 2021-10-08T19:31:45.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:44 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [3, 5]}]': finished 2021-10-08T19:31:45.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:44 smithi117 ceph-mon[34585]: osdmap e298: 8 total, 8 up, 8 in 2021-10-08T19:31:45.174 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2021-10-08T19:31:45.174 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:31:45.827 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 2 16 5641 5625 175.767 183.375 0.00350713 0.0056774 2021-10-08T19:31:45.923 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is set 2021-10-08T19:31:46.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:45 smithi097 ceph-mon[32687]: pgmap v529: 178 pgs: 1 peering, 177 active+clean; 20 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 MiB/s wr, 80 op/s 2021-10-08T19:31:46.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:45 smithi097 ceph-mon[32687]: osdmap e299: 8 total, 8 up, 8 in 2021-10-08T19:31:46.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:45 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3903158467' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:31:46.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:45 smithi097 ceph-mon[32687]: from='client.35489 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:31:46.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:45 smithi097 ceph-mon[41966]: pgmap v529: 178 pgs: 1 peering, 177 active+clean; 20 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 MiB/s wr, 80 op/s 2021-10-08T19:31:46.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:45 smithi097 ceph-mon[41966]: osdmap e299: 8 total, 8 up, 8 in 2021-10-08T19:31:46.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:45 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3903158467' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:31:46.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:45 smithi097 ceph-mon[41966]: from='client.35489 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:31:46.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:45 smithi117 ceph-mon[34585]: pgmap v529: 178 pgs: 1 peering, 177 active+clean; 20 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 MiB/s wr, 80 op/s 2021-10-08T19:31:46.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:45 smithi117 ceph-mon[34585]: osdmap e299: 8 total, 8 up, 8 in 2021-10-08T19:31:46.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:45 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3903158467' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:31:46.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:45 smithi117 ceph-mon[34585]: from='client.35489 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:31:46.826 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 3 16 8736 8720 181.652 193.438 0.00470187 0.00549653 2021-10-08T19:31:47.156 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:31:46 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:31:47.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:46 smithi117 ceph-mon[34585]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:31:47.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:46 smithi117 ceph-mon[34585]: from='client.35489 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:31:47.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:46 smithi117 ceph-mon[34585]: osdmap e300: 8 total, 8 up, 8 in 2021-10-08T19:31:47.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:46 smithi097 ceph-mon[41966]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:31:47.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:46 smithi097 ceph-mon[41966]: from='client.35489 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:31:47.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:46 smithi097 ceph-mon[41966]: osdmap e300: 8 total, 8 up, 8 in 2021-10-08T19:31:47.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:46 smithi097 ceph-mon[32687]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:31:47.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:46 smithi097 ceph-mon[32687]: from='client.35489 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:31:47.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:46 smithi097 ceph-mon[32687]: osdmap e300: 8 total, 8 up, 8 in 2021-10-08T19:31:47.626 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2021-10-08T19:31:47.825 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 4 16 11153 11137 174.001 151.062 0.00259748 0.00573797 2021-10-08T19:31:48.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:47 smithi097 ceph-mon[41966]: pgmap v532: 178 pgs: 1 peering, 177 active+clean; 20 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 MiB/s wr, 81 op/s 2021-10-08T19:31:48.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:47 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:31:48.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:47 smithi097 ceph-mon[32687]: pgmap v532: 178 pgs: 1 peering, 177 active+clean; 20 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 MiB/s wr, 81 op/s 2021-10-08T19:31:48.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:47 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:31:48.227 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:31:48.230 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:48.233 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:31:48.334 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:31:48.377 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:48.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:47 smithi117 ceph-mon[34585]: pgmap v532: 178 pgs: 1 peering, 177 active+clean; 20 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 MiB/s wr, 81 op/s 2021-10-08T19:31:48.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:47 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:31:48.826 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 5 16 14000 13984 174.778 177.938 0.00509178 0.00571669 2021-10-08T19:31:49.200 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:31:49.204 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:49.205 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:31:49.306 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:31:49.367 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:49.507 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:31:49.827 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 6 15 16448 16433 171.156 153.062 0.00472032 0.00583476 2021-10-08T19:31:50.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:49 smithi097 ceph-mon[41966]: pgmap v533: 178 pgs: 1 peering, 177 active+clean; 376 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 65 MiB/s wr, 1.03k op/s 2021-10-08T19:31:50.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:49 smithi097 ceph-mon[32687]: pgmap v533: 178 pgs: 1 peering, 177 active+clean; 376 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 65 MiB/s wr, 1.03k op/s 2021-10-08T19:31:50.261 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:31:50.265 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:50.266 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:31:50.367 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:31:50.411 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:49 smithi117 ceph-mon[34585]: pgmap v533: 178 pgs: 1 peering, 177 active+clean; 376 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 65 MiB/s wr, 1.03k op/s 2021-10-08T19:31:50.416 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:50.600 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:31:50.605 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:50.605 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:31:50.681 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.1 to 1 (10000) 2021-10-08T19:31:50.706 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:31:50.746 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:50.798 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:31:50.805 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:50.806 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:31:50.827 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 7 16 17694 17678 157.821 77.8125 0.00184854 0.00625089 2021-10-08T19:31:50.906 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:31:50.931 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:50.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:50 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/963046033' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2021-10-08T19:31:50.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:50 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/963046033' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2021-10-08T19:31:50.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:50 smithi097 ceph-mon[41966]: osdmap e301: 8 total, 8 up, 8 in 2021-10-08T19:31:50.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:50 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/963046033' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2021-10-08T19:31:50.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:50 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/963046033' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2021-10-08T19:31:50.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:50 smithi097 ceph-mon[32687]: osdmap e301: 8 total, 8 up, 8 in 2021-10-08T19:31:50.979 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:31:50.981 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:50.982 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:31:50.991 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:31:51.009 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:31:51.026 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:31:51.044 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:31:51.063 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:31:51.082 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:31:51.083 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:31:51.100 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:31:51.105 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:50 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/963046033' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2021-10-08T19:31:51.106 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:50 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/963046033' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2021-10-08T19:31:51.106 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:50 smithi117 ceph-mon[34585]: osdmap e301: 8 total, 8 up, 8 in 2021-10-08T19:31:51.108 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:51.118 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:31:51.119 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true' 2021-10-08T19:31:51.119 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true' 2021-10-08T19:31:51.120 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true' 2021-10-08T19:31:51.120 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true' 2021-10-08T19:31:51.120 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true' 2021-10-08T19:31:51.120 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true' 2021-10-08T19:31:51.121 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'true' 2021-10-08T19:31:51.121 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'true' 2021-10-08T19:31:51.201 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:31:51.221 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:51.222 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:31:51.250 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset noscrub 2021-10-08T19:31:51.324 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:31:51.351 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:51.826 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 8 16 17695 17679 138.102 0.0625 0.00191216 0.00625064 2021-10-08T19:31:52.140 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd reweight 3 1 2021-10-08T19:31:52.203 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:51 smithi097 ceph-mon[41966]: pgmap v535: 178 pgs: 178 active+clean; 865 MiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 853 B/s rd, 141 MiB/s wr, 2.25k op/s; 18 B/s, 0 objects/s recovering 2021-10-08T19:31:52.203 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:51 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1313634104' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:31:52.204 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:51 smithi097 ceph-mon[41966]: osdmap e302: 8 total, 8 up, 8 in 2021-10-08T19:31:52.204 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:51 smithi097 ceph-mon[32687]: pgmap v535: 178 pgs: 178 active+clean; 865 MiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 853 B/s rd, 141 MiB/s wr, 2.25k op/s; 18 B/s, 0 objects/s recovering 2021-10-08T19:31:52.204 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:51 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1313634104' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:31:52.204 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:51 smithi097 ceph-mon[32687]: osdmap e302: 8 total, 8 up, 8 in 2021-10-08T19:31:52.302 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:31:52.304 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:52.305 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:31:52.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:51 smithi117 ceph-mon[34585]: pgmap v535: 178 pgs: 178 active+clean; 865 MiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 853 B/s rd, 141 MiB/s wr, 2.25k op/s; 18 B/s, 0 objects/s recovering 2021-10-08T19:31:52.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:51 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1313634104' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:31:52.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:51 smithi117 ceph-mon[34585]: osdmap e302: 8 total, 8 up, 8 in 2021-10-08T19:31:52.407 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:31:52.435 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:52.494 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:31:52.496 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:52.497 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:31:52.599 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:31:52.623 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:52.826 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 9 16 17695 17679 122.758 0 - 0.00625064 2021-10-08T19:31:52.970 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:31:52 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:31:52] "GET /metrics HTTP/1.1" 200 155702 "" "Prometheus/2.18.1" 2021-10-08T19:31:52.997 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:31:53.008 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:31:53.012 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:53.013 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:31:53.040 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:31:53.114 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:31:53.140 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:53.234 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:31:53.235 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:53.236 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:31:53.337 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:31:53.369 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:53.826 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 10 16 17840 17824 111.389 4.53125 0.00488879 0.00897067 2021-10-08T19:31:53.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:53 smithi097 ceph-mon[32687]: osdmap e303: 8 total, 8 up, 8 in 2021-10-08T19:31:53.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:53 smithi097 ceph-mon[32687]: pgmap v538: 178 pgs: 178 active+clean; 865 MiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 853 B/s rd, 141 MiB/s wr, 2.25k op/s; 18 B/s, 0 objects/s recovering 2021-10-08T19:31:53.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:53 smithi097 ceph-mon[41966]: osdmap e303: 8 total, 8 up, 8 in 2021-10-08T19:31:53.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:53 smithi097 ceph-mon[41966]: pgmap v538: 178 pgs: 178 active+clean; 865 MiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 853 B/s rd, 141 MiB/s wr, 2.25k op/s; 18 B/s, 0 objects/s recovering 2021-10-08T19:31:54.156 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:31:53 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:31:53] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:31:54.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:53 smithi117 ceph-mon[34585]: osdmap e303: 8 total, 8 up, 8 in 2021-10-08T19:31:54.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:53 smithi117 ceph-mon[34585]: pgmap v538: 178 pgs: 178 active+clean; 865 MiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 853 B/s rd, 141 MiB/s wr, 2.25k op/s; 18 B/s, 0 objects/s recovering 2021-10-08T19:31:54.181 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:31:54.184 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:54.185 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:31:54.286 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:31:54.340 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:54.474 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2021-10-08T19:31:54.721 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:31:54 smithi097 conmon[33110]: 172.21.15.117 - - [08/Oct/2021:19:31:54] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:31:54.826 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 11 16 19853 19837 112.699 125.812 0.00924107 0.00886788 2021-10-08T19:31:55.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:55 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:31:55.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:55 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:31:55.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:55 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:31:55.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:55 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:31:55.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:55 smithi097 ceph-mon[32687]: 172.21.15.117 - - [08/Oct/2021:19:31:54] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:31:55.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:55 smithi097 ceph-mon[32687]: osdmap e304: 8 total, 8 up, 8 in 2021-10-08T19:31:55.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:55 smithi097 ceph-mon[32687]: pgmap v540: 178 pgs: 1 activating+undersized+degraded+remapped, 177 active+clean; 1.1 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 506 B/s rd, 64 MiB/s wr, 1.02k op/s; 1088/54498 objects degraded (1.996%); 163 B/s, 6 objects/s recovering 2021-10-08T19:31:55.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:55 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:31:55.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:55 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:31:55.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:55 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:31:55.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:55 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:31:55.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:55 smithi097 ceph-mon[41966]: 172.21.15.117 - - [08/Oct/2021:19:31:54] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:31:55.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:55 smithi097 ceph-mon[41966]: osdmap e304: 8 total, 8 up, 8 in 2021-10-08T19:31:55.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:55 smithi097 ceph-mon[41966]: pgmap v540: 178 pgs: 1 activating+undersized+degraded+remapped, 177 active+clean; 1.1 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 506 B/s rd, 64 MiB/s wr, 1.02k op/s; 1088/54498 objects degraded (1.996%); 163 B/s, 6 objects/s recovering 2021-10-08T19:31:55.827 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 12 16 22046 22030 114.72 137.062 0.00599218 0.00871003 2021-10-08T19:31:55.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:55 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:31:55.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:55 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:31:55.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:55 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:31:55.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:55 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:31:55.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:55 smithi117 ceph-mon[34585]: 172.21.15.117 - - [08/Oct/2021:19:31:54] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:31:55.908 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:55 smithi117 ceph-mon[34585]: osdmap e304: 8 total, 8 up, 8 in 2021-10-08T19:31:55.908 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:55 smithi117 ceph-mon[34585]: pgmap v540: 178 pgs: 1 activating+undersized+degraded+remapped, 177 active+clean; 1.1 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 506 B/s rd, 64 MiB/s wr, 1.02k op/s; 1088/54498 objects degraded (1.996%); 163 B/s, 6 objects/s recovering 2021-10-08T19:31:55.986 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:31:55.987 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2021-10-08T19:31:55.987 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2021-10-08T19:31:55.987 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2021-10-08T19:31:55.987 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:55.987 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:95872 8.b 8:d7354f87:::benchmark_data_smithi097_144160_object7132:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e227)", 2021-10-08T19:31:55.988 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:29.708779+0000", 2021-10-08T19:31:55.990 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 146.259159377, 2021-10-08T19:31:55.990 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.89992862399999995, 2021-10-08T19:31:55.991 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:55.991 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "reached pg", 2021-10-08T19:31:55.991 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:31:55.991 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:31:55.992 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:31:55.992 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 95872 2021-10-08T19:31:55.992 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:55.992 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:55.992 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:55.993 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:55.993 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.708779+0000", 2021-10-08T19:31:55.994 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:55.994 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:55.994 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:55.994 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:55.995 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.708779+0000", 2021-10-08T19:31:55.995 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:55.995 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:55.995 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:55.995 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:55.996 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.708776+0000", 2021-10-08T19:31:55.996 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:31:55.997 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:55.998 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:55.998 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:55.998 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.708785+0000", 2021-10-08T19:31:55.998 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8009999999999993e-06 2021-10-08T19:31:55.998 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:55.999 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:55.999 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:55.999 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.708798+0000", 2021-10-08T19:31:55.999 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3314e-05 2021-10-08T19:31:56.000 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.000 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.000 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:56.001 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.708806+0000", 2021-10-08T19:31:56.001 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2649999999999999e-06 2021-10-08T19:31:56.001 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.001 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.002 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:56.002 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.708849+0000", 2021-10-08T19:31:56.002 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3662000000000003e-05 2021-10-08T19:31:56.002 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.003 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.003 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:56.003 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.708983+0000", 2021-10-08T19:31:56.004 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013373000000000001 2021-10-08T19:31:56.005 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.005 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.005 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:31:56.006 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.709165+0000", 2021-10-08T19:31:56.006 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000182251 2021-10-08T19:31:56.006 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.006 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.006 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:31:56.007 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.715936+0000", 2021-10-08T19:31:56.007 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0067701259999999996 2021-10-08T19:31:56.007 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.007 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.008 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:56.008 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.756486+0000", 2021-10-08T19:31:56.008 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.040550707999999998 2021-10-08T19:31:56.008 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.008 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.009 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:31:56.009 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.756496+0000", 2021-10-08T19:31:56.009 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.6369999999999994e-06 2021-10-08T19:31:56.009 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.010 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.010 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:56.010 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:30.608695+0000", 2021-10-08T19:31:56.010 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.852199182 2021-10-08T19:31:56.010 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.011 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.011 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:56.011 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:30.608707+0000", 2021-10-08T19:31:56.011 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2306999999999999e-05 2021-10-08T19:31:56.011 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:56.012 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:56.012 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:56.012 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.013 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.013 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:95883 8.b 8:d3d97448:::benchmark_data_smithi097_144160_object7143:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e227)", 2021-10-08T19:31:56.013 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:29.719356+0000", 2021-10-08T19:31:56.014 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 146.248581927, 2021-10-08T19:31:56.014 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.88939190199999996, 2021-10-08T19:31:56.014 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:56.014 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "reached pg", 2021-10-08T19:31:56.015 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:31:56.015 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:31:56.015 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:31:56.016 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 95883 2021-10-08T19:31:56.016 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.016 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:56.016 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.017 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:56.017 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.719356+0000", 2021-10-08T19:31:56.017 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:56.017 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.018 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.018 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:56.018 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.719356+0000", 2021-10-08T19:31:56.018 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:56.019 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.019 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.019 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:56.019 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.719354+0000", 2021-10-08T19:31:56.019 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:31:56.020 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.020 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.020 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:56.020 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.719364+0000", 2021-10-08T19:31:56.020 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0005e-05 2021-10-08T19:31:56.021 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.021 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.021 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:56.021 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.719377+0000", 2021-10-08T19:31:56.021 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2465e-05 2021-10-08T19:31:56.022 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.022 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.022 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:56.022 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.719382+0000", 2021-10-08T19:31:56.023 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5639999999999996e-06 2021-10-08T19:31:56.023 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.023 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.024 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:56.024 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.719842+0000", 2021-10-08T19:31:56.024 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00045944900000000001 2021-10-08T19:31:56.024 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.024 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.025 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:56.025 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.720009+0000", 2021-10-08T19:31:56.025 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000167047 2021-10-08T19:31:56.026 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.026 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.026 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:31:56.026 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.720188+0000", 2021-10-08T19:31:56.026 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017916399999999999 2021-10-08T19:31:56.027 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.027 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.027 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:31:56.027 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.722699+0000", 2021-10-08T19:31:56.028 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0025115189999999998 2021-10-08T19:31:56.028 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.028 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.028 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:56.028 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.756524+0000", 2021-10-08T19:31:56.029 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.033824119 2021-10-08T19:31:56.029 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.029 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.029 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:31:56.029 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.756531+0000", 2021-10-08T19:31:56.030 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.661e-06 2021-10-08T19:31:56.030 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.030 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.030 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:56.031 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:30.608739+0000", 2021-10-08T19:31:56.031 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.85220770999999995 2021-10-08T19:31:56.031 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.031 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.031 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:56.032 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:30.608748+0000", 2021-10-08T19:31:56.032 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.1940000000000004e-06 2021-10-08T19:31:56.032 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:56.032 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:56.032 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:56.033 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.033 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.033 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:102327 8.b 8:d96333ad:::benchmark_data_smithi097_144160_object13587:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e245)", 2021-10-08T19:31:56.034 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:57.776586+0000", 2021-10-08T19:31:56.034 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 118.191351822, 2021-10-08T19:31:56.034 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.313372897, 2021-10-08T19:31:56.034 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:56.035 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "reached pg", 2021-10-08T19:31:56.035 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:31:56.035 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:31:56.036 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:31:56.036 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 102327 2021-10-08T19:31:56.036 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.036 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:56.036 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.037 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:56.037 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.776586+0000", 2021-10-08T19:31:56.037 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:56.037 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.038 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.038 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:56.038 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.776586+0000", 2021-10-08T19:31:56.038 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:56.038 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.039 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.039 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:56.039 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.776584+0000", 2021-10-08T19:31:56.039 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:31:56.039 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.040 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.040 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:56.040 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.776592+0000", 2021-10-08T19:31:56.040 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3229999999999998e-06 2021-10-08T19:31:56.040 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.041 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.041 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:56.041 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.776604+0000", 2021-10-08T19:31:56.041 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2075999999999999e-05 2021-10-08T19:31:56.042 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.042 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.042 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:56.042 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.776612+0000", 2021-10-08T19:31:56.042 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.182e-06 2021-10-08T19:31:56.043 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.043 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.043 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:56.044 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.776666+0000", 2021-10-08T19:31:56.044 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4580000000000003e-05 2021-10-08T19:31:56.044 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.044 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.044 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:56.045 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.776804+0000", 2021-10-08T19:31:56.045 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000137732 2021-10-08T19:31:56.045 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.045 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.046 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:31:56.046 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.776946+0000", 2021-10-08T19:31:56.046 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000141865 2021-10-08T19:31:56.047 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.047 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.047 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:56.047 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.784549+0000", 2021-10-08T19:31:56.047 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.007603004 2021-10-08T19:31:56.048 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.048 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.048 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:31:56.048 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.784555+0000", 2021-10-08T19:31:56.048 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.63e-06 2021-10-08T19:31:56.049 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.049 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.049 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:56.049 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.064145+0000", 2021-10-08T19:31:56.049 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.27958945 2021-10-08T19:31:56.050 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.050 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.050 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for missing object", 2021-10-08T19:31:56.050 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.064320+0000", 2021-10-08T19:31:56.051 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017478799999999999 2021-10-08T19:31:56.051 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.051 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.051 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:56.051 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.089870+0000", 2021-10-08T19:31:56.052 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.025550007999999999 2021-10-08T19:31:56.052 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.052 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.052 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:56.052 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.089959+0000", 2021-10-08T19:31:56.053 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9622000000000004e-05 2021-10-08T19:31:56.053 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:56.053 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:56.053 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:56.053 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.054 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.054 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:102343 8.b 8:d1ed84a2:::benchmark_data_smithi097_144160_object13603:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e246)", 2021-10-08T19:31:56.055 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:57.786622+0000", 2021-10-08T19:31:56.055 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 118.18131654, 2021-10-08T19:31:56.055 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3035327460000001, 2021-10-08T19:31:56.055 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:56.055 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:31:56.056 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:31:56.056 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:31:56.056 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:31:56.057 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 102343 2021-10-08T19:31:56.057 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.057 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:56.057 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.058 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:56.058 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.786622+0000", 2021-10-08T19:31:56.058 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:56.058 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.058 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.059 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:56.059 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.786622+0000", 2021-10-08T19:31:56.059 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:56.059 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.060 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.060 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:56.060 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.786619+0000", 2021-10-08T19:31:56.060 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:31:56.060 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.061 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.061 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:56.061 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.786627+0000", 2021-10-08T19:31:56.061 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2370000000000003e-06 2021-10-08T19:31:56.061 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.062 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.062 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:56.062 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.786640+0000", 2021-10-08T19:31:56.062 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3638000000000001e-05 2021-10-08T19:31:56.063 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.063 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.063 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:56.063 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.786647+0000", 2021-10-08T19:31:56.063 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.336e-06 2021-10-08T19:31:56.064 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.064 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.064 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:56.065 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.786694+0000", 2021-10-08T19:31:56.065 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7061999999999998e-05 2021-10-08T19:31:56.065 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.065 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.065 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:31:56.066 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.786702+0000", 2021-10-08T19:31:56.066 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.9759999999999995e-06 2021-10-08T19:31:56.066 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.067 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.067 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:56.067 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.064372+0000", 2021-10-08T19:31:56.067 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2776700810000001 2021-10-08T19:31:56.068 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.068 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.068 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:56.068 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.064483+0000", 2021-10-08T19:31:56.068 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000111037 2021-10-08T19:31:56.069 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.069 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.069 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:31:56.069 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.064576+0000", 2021-10-08T19:31:56.069 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.3629999999999996e-05 2021-10-08T19:31:56.070 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.070 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.070 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:31:56.070 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.073145+0000", 2021-10-08T19:31:56.071 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0085683519999999996 2021-10-08T19:31:56.071 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.071 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.071 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:56.071 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.089994+0000", 2021-10-08T19:31:56.072 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016849113999999998 2021-10-08T19:31:56.072 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.072 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.072 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:56.072 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.090049+0000", 2021-10-08T19:31:56.073 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4925e-05 2021-10-08T19:31:56.073 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.073 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.073 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:31:56.073 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.090087+0000", 2021-10-08T19:31:56.074 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8114000000000001e-05 2021-10-08T19:31:56.074 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.074 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.075 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:56.075 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.090154+0000", 2021-10-08T19:31:56.075 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7436999999999998e-05 2021-10-08T19:31:56.075 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:56.076 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:56.076 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:56.076 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.076 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.076 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:102361 8.b 8:d358b36d:::benchmark_data_smithi097_144160_object13621:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e246)", 2021-10-08T19:31:56.077 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:57.803469+0000", 2021-10-08T19:31:56.077 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 118.164468881, 2021-10-08T19:31:56.077 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2869686300000001, 2021-10-08T19:31:56.078 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:56.078 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:31:56.078 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:31:56.078 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:31:56.079 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:31:56.079 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 102361 2021-10-08T19:31:56.079 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.079 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:56.079 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.080 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:56.080 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.803469+0000", 2021-10-08T19:31:56.080 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:56.080 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.080 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.081 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:56.081 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.803469+0000", 2021-10-08T19:31:56.081 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:56.081 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.082 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.082 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:56.082 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.803466+0000", 2021-10-08T19:31:56.082 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2021-10-08T19:31:56.082 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.083 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.083 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:56.083 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.803475+0000", 2021-10-08T19:31:56.083 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4840000000000004e-06 2021-10-08T19:31:56.084 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.084 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.084 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:56.084 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.803489+0000", 2021-10-08T19:31:56.085 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4278e-05 2021-10-08T19:31:56.085 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.085 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.086 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:56.086 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.803495+0000", 2021-10-08T19:31:56.086 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6010000000000002e-06 2021-10-08T19:31:56.086 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.087 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.087 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:56.088 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.803548+0000", 2021-10-08T19:31:56.088 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2964999999999999e-05 2021-10-08T19:31:56.089 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.089 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.089 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:31:56.089 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.803560+0000", 2021-10-08T19:31:56.089 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1783000000000001e-05 2021-10-08T19:31:56.090 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.090 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.090 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:56.090 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.066723+0000", 2021-10-08T19:31:56.091 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2631632740000001 2021-10-08T19:31:56.091 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.091 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.091 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:56.091 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.066846+0000", 2021-10-08T19:31:56.092 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012360800000000001 2021-10-08T19:31:56.092 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.092 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.092 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:31:56.092 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.066947+0000", 2021-10-08T19:31:56.093 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010030300000000001 2021-10-08T19:31:56.093 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.093 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.093 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:31:56.093 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.073155+0000", 2021-10-08T19:31:56.094 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.006208369 2021-10-08T19:31:56.094 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.094 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.094 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:56.095 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.090022+0000", 2021-10-08T19:31:56.095 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016866467 2021-10-08T19:31:56.095 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.096 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.096 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:56.096 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.090239+0000", 2021-10-08T19:31:56.096 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021783300000000001 2021-10-08T19:31:56.096 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.097 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.097 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:31:56.097 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.090302+0000", 2021-10-08T19:31:56.098 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2689999999999998e-05 2021-10-08T19:31:56.098 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.098 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.099 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:56.099 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.090438+0000", 2021-10-08T19:31:56.100 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013576199999999999 2021-10-08T19:31:56.100 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:56.101 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:56.101 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:56.102 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.102 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.102 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:102370 8.b 8:d6039b15:::benchmark_data_smithi097_144160_object13630:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e246)", 2021-10-08T19:31:56.103 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:57.811310+0000", 2021-10-08T19:31:56.103 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 118.15662849, 2021-10-08T19:31:56.104 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.279322471, 2021-10-08T19:31:56.104 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:56.105 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:31:56.105 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:31:56.105 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:31:56.106 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:31:56.106 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 102370 2021-10-08T19:31:56.107 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.107 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:56.108 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.108 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:56.108 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.811310+0000", 2021-10-08T19:31:56.109 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:56.109 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.110 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.110 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:56.111 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.811310+0000", 2021-10-08T19:31:56.111 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:56.111 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.112 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.112 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:56.113 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.811307+0000", 2021-10-08T19:31:56.113 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2021-10-08T19:31:56.113 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.113 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.114 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:56.114 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.811316+0000", 2021-10-08T19:31:56.114 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0089999999999996e-06 2021-10-08T19:31:56.114 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.115 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.115 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:56.115 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.811330+0000", 2021-10-08T19:31:56.115 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4246999999999999e-05 2021-10-08T19:31:56.115 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.116 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.116 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:56.116 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.811337+0000", 2021-10-08T19:31:56.116 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0620000000000003e-06 2021-10-08T19:31:56.117 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.117 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.117 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:56.117 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.811393+0000", 2021-10-08T19:31:56.117 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5599000000000001e-05 2021-10-08T19:31:56.118 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.118 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.118 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:31:56.118 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.811402+0000", 2021-10-08T19:31:56.119 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4190000000000008e-06 2021-10-08T19:31:56.119 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.119 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.119 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:56.119 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.068209+0000", 2021-10-08T19:31:56.120 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2568067969999999 2021-10-08T19:31:56.120 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.120 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.120 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:56.121 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.068351+0000", 2021-10-08T19:31:56.121 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014235800000000001 2021-10-08T19:31:56.121 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.121 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.122 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:31:56.122 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.068521+0000", 2021-10-08T19:31:56.122 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016929400000000001 2021-10-08T19:31:56.122 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.123 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.123 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:31:56.123 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.076535+0000", 2021-10-08T19:31:56.123 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.008014284 2021-10-08T19:31:56.123 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.124 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.124 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:56.124 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.090183+0000", 2021-10-08T19:31:56.124 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013648118000000001 2021-10-08T19:31:56.124 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.125 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.125 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:56.125 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.090500+0000", 2021-10-08T19:31:56.125 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031644699999999997 2021-10-08T19:31:56.126 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.126 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.126 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:31:56.126 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.090537+0000", 2021-10-08T19:31:56.127 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7335000000000001e-05 2021-10-08T19:31:56.127 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.127 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.127 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:56.127 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.090632+0000", 2021-10-08T19:31:56.128 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5163999999999999e-05 2021-10-08T19:31:56.128 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:56.128 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:56.128 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:56.129 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.129 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.129 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:102371 8.b 8:d2cae905:::benchmark_data_smithi097_144160_object13631:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e246)", 2021-10-08T19:31:56.129 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:57.812258+0000", 2021-10-08T19:31:56.130 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 118.15568050500001, 2021-10-08T19:31:56.130 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2786662559999999, 2021-10-08T19:31:56.130 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:56.130 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:31:56.130 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:31:56.131 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:31:56.131 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:31:56.131 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 102371 2021-10-08T19:31:56.131 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.132 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:56.132 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.132 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:56.132 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.812258+0000", 2021-10-08T19:31:56.132 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:56.133 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.133 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.133 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:56.133 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.812258+0000", 2021-10-08T19:31:56.134 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:56.134 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.134 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.134 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:56.135 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.812255+0000", 2021-10-08T19:31:56.135 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:31:56.135 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.135 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.135 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:56.136 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.812263+0000", 2021-10-08T19:31:56.136 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8310000000000001e-06 2021-10-08T19:31:56.136 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.137 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.137 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:56.137 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.812274+0000", 2021-10-08T19:31:56.137 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1038e-05 2021-10-08T19:31:56.137 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.138 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.138 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:56.138 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.812281+0000", 2021-10-08T19:31:56.138 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9410000000000001e-06 2021-10-08T19:31:56.138 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.139 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.139 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:56.139 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.812328+0000", 2021-10-08T19:31:56.139 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7534999999999998e-05 2021-10-08T19:31:56.140 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.140 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.140 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:31:56.140 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.812337+0000", 2021-10-08T19:31:56.140 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0690000000000002e-06 2021-10-08T19:31:56.141 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.141 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.141 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:56.141 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.070249+0000", 2021-10-08T19:31:56.141 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2579120420000001 2021-10-08T19:31:56.142 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.142 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.142 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:56.142 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.070324+0000", 2021-10-08T19:31:56.143 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5723999999999995e-05 2021-10-08T19:31:56.143 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.143 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.143 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:31:56.143 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.070397+0000", 2021-10-08T19:31:56.144 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2696999999999999e-05 2021-10-08T19:31:56.144 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.144 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.144 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:31:56.145 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.076545+0000", 2021-10-08T19:31:56.145 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0061481239999999996 2021-10-08T19:31:56.145 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.145 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.146 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:56.146 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.090685+0000", 2021-10-08T19:31:56.146 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.014139413 2021-10-08T19:31:56.146 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.146 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.147 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:56.147 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.090755+0000", 2021-10-08T19:31:56.147 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9966000000000001e-05 2021-10-08T19:31:56.147 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.148 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.148 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:31:56.148 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.090808+0000", 2021-10-08T19:31:56.148 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3483999999999998e-05 2021-10-08T19:31:56.148 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.149 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.149 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:56.149 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.090924+0000", 2021-10-08T19:31:56.149 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115852 2021-10-08T19:31:56.150 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:56.150 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:56.150 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:56.151 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.151 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.152 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:102408 8.b 8:d5c85811:::benchmark_data_smithi097_144160_object13668:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e246)", 2021-10-08T19:31:56.152 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:57.849095+0000", 2021-10-08T19:31:56.153 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 118.11884332699999, 2021-10-08T19:31:56.153 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.242117699, 2021-10-08T19:31:56.153 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:56.153 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:31:56.154 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:31:56.154 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:31:56.154 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:31:56.154 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 102408 2021-10-08T19:31:56.155 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.155 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:56.156 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.156 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:56.156 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.849095+0000", 2021-10-08T19:31:56.157 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:56.157 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.158 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.158 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:56.158 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.849095+0000", 2021-10-08T19:31:56.158 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:56.159 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.159 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.159 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:56.159 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.849092+0000", 2021-10-08T19:31:56.159 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2021-10-08T19:31:56.160 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.160 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.160 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:56.160 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.849101+0000", 2021-10-08T19:31:56.160 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2150000000000007e-06 2021-10-08T19:31:56.161 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.161 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.161 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:56.161 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.849119+0000", 2021-10-08T19:31:56.162 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7762999999999999e-05 2021-10-08T19:31:56.162 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.162 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.162 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:56.162 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.849127+0000", 2021-10-08T19:31:56.163 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0339999999999997e-06 2021-10-08T19:31:56.163 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.163 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.163 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:56.163 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.849213+0000", 2021-10-08T19:31:56.164 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5550999999999995e-05 2021-10-08T19:31:56.164 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.164 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.164 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:31:56.165 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.849225+0000", 2021-10-08T19:31:56.165 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2784e-05 2021-10-08T19:31:56.165 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.165 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.165 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:56.166 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.071521+0000", 2021-10-08T19:31:56.166 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.222295881 2021-10-08T19:31:56.166 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.166 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.167 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:56.167 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.071592+0000", 2021-10-08T19:31:56.167 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0618999999999996e-05 2021-10-08T19:31:56.167 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.168 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.168 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:31:56.168 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.071704+0000", 2021-10-08T19:31:56.169 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000111947 2021-10-08T19:31:56.169 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.169 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.169 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:31:56.170 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.079462+0000", 2021-10-08T19:31:56.170 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0077579880000000004 2021-10-08T19:31:56.170 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.170 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.171 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:56.171 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.090992+0000", 2021-10-08T19:31:56.171 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011530228999999999 2021-10-08T19:31:56.171 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.173 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.173 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:56.173 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.091047+0000", 2021-10-08T19:31:56.173 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5003999999999997e-05 2021-10-08T19:31:56.174 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.174 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.174 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:31:56.174 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.091101+0000", 2021-10-08T19:31:56.174 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3915999999999997e-05 2021-10-08T19:31:56.175 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.175 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.175 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:56.175 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.091212+0000", 2021-10-08T19:31:56.176 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000111482 2021-10-08T19:31:56.176 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:56.176 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:56.176 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:56.176 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.177 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.177 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:102461 8.b 8:d92641bf:::benchmark_data_smithi097_144160_object13721:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e246)", 2021-10-08T19:31:56.177 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:57.896261+0000", 2021-10-08T19:31:56.177 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 118.07167665199999, 2021-10-08T19:31:56.177 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.19521414, 2021-10-08T19:31:56.178 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:56.179 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:31:56.182 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:31:56.182 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:31:56.183 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:31:56.183 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 102461 2021-10-08T19:31:56.184 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.185 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:56.185 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.185 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:56.186 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.896261+0000", 2021-10-08T19:31:56.186 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:56.186 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.186 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.187 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:56.187 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.896261+0000", 2021-10-08T19:31:56.187 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:56.187 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.188 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.188 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:56.188 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.896259+0000", 2021-10-08T19:31:56.188 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2021-10-08T19:31:56.188 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.189 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.189 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:56.189 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.896269+0000", 2021-10-08T19:31:56.190 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0076e-05 2021-10-08T19:31:56.190 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.190 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.190 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:56.191 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.896287+0000", 2021-10-08T19:31:56.191 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8287999999999998e-05 2021-10-08T19:31:56.191 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.191 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.191 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:56.192 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.896294+0000", 2021-10-08T19:31:56.192 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1080000000000004e-06 2021-10-08T19:31:56.192 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.192 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.193 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:56.193 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.898501+0000", 2021-10-08T19:31:56.193 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0022066809999999998 2021-10-08T19:31:56.193 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.193 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.194 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:31:56.194 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.898513+0000", 2021-10-08T19:31:56.194 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2515e-05 2021-10-08T19:31:56.194 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.194 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.195 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:56.195 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.073204+0000", 2021-10-08T19:31:56.196 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1746909130000001 2021-10-08T19:31:56.196 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.196 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.196 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:56.197 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.073334+0000", 2021-10-08T19:31:56.197 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012976599999999999 2021-10-08T19:31:56.198 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.198 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.198 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:31:56.198 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.073472+0000", 2021-10-08T19:31:56.198 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013843899999999999 2021-10-08T19:31:56.199 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.199 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.200 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:31:56.200 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.079467+0000", 2021-10-08T19:31:56.200 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0059946419999999997 2021-10-08T19:31:56.201 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.201 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.201 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:56.202 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.091278+0000", 2021-10-08T19:31:56.202 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011810835 2021-10-08T19:31:56.202 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.203 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.203 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:56.203 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.091321+0000", 2021-10-08T19:31:56.204 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2846999999999998e-05 2021-10-08T19:31:56.204 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.204 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.204 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:31:56.204 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.091367+0000", 2021-10-08T19:31:56.205 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6230000000000003e-05 2021-10-08T19:31:56.205 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.205 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.205 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:56.206 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.091476+0000", 2021-10-08T19:31:56.206 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000108612 2021-10-08T19:31:56.206 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:56.206 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:56.207 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:56.207 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.207 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.207 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:102466 8.b 8:d1830078:::benchmark_data_smithi097_144160_object13726:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e246)", 2021-10-08T19:31:56.208 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:57.901226+0000", 2021-10-08T19:31:56.208 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 118.06671200700001, 2021-10-08T19:31:56.209 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1905235759999999, 2021-10-08T19:31:56.209 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:56.209 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:31:56.210 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:31:56.210 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:31:56.211 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:31:56.211 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 102466 2021-10-08T19:31:56.211 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.212 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:56.212 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.212 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:56.213 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.901226+0000", 2021-10-08T19:31:56.213 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:56.213 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.214 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.214 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:56.215 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.901226+0000", 2021-10-08T19:31:56.215 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:56.215 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.216 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.216 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:56.216 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.901224+0000", 2021-10-08T19:31:56.217 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:31:56.217 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.217 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.218 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:56.218 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.901234+0000", 2021-10-08T19:31:56.219 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0096e-05 2021-10-08T19:31:56.219 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.219 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.219 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:56.220 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.901251+0000", 2021-10-08T19:31:56.220 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7295999999999998e-05 2021-10-08T19:31:56.220 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.220 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.220 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:56.221 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.901258+0000", 2021-10-08T19:31:56.221 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.537e-06 2021-10-08T19:31:56.222 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.222 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.222 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:56.223 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.901316+0000", 2021-10-08T19:31:56.223 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7095999999999997e-05 2021-10-08T19:31:56.223 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.223 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.223 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:31:56.224 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.901324+0000", 2021-10-08T19:31:56.224 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7120000000000006e-06 2021-10-08T19:31:56.224 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.224 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.225 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:56.225 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.074960+0000", 2021-10-08T19:31:56.225 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.173635974 2021-10-08T19:31:56.225 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.225 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.226 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:56.226 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.075044+0000", 2021-10-08T19:31:56.226 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3827999999999998e-05 2021-10-08T19:31:56.226 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.227 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.227 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:31:56.227 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.075129+0000", 2021-10-08T19:31:56.227 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5067000000000004e-05 2021-10-08T19:31:56.228 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.228 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.228 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:31:56.229 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.082429+0000", 2021-10-08T19:31:56.229 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0072995530000000003 2021-10-08T19:31:56.230 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.230 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.231 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:56.231 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.091536+0000", 2021-10-08T19:31:56.232 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0091073170000000002 2021-10-08T19:31:56.232 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.233 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.233 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:56.233 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.091592+0000", 2021-10-08T19:31:56.234 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6023999999999998e-05 2021-10-08T19:31:56.234 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.234 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.235 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:31:56.235 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.091641+0000", 2021-10-08T19:31:56.235 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9060000000000001e-05 2021-10-08T19:31:56.235 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.235 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.236 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:56.236 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.091750+0000", 2021-10-08T19:31:56.236 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010856199999999999 2021-10-08T19:31:56.237 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:56.237 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:56.237 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:56.237 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.237 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.238 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:102476 8.b 8:d4797e70:::benchmark_data_smithi097_144160_object13736:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e246)", 2021-10-08T19:31:56.238 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:57.905825+0000", 2021-10-08T19:31:56.238 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 118.062112763, 2021-10-08T19:31:56.238 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1861595030000001, 2021-10-08T19:31:56.239 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:56.239 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:31:56.239 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:31:56.239 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:31:56.239 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:31:56.240 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 102476 2021-10-08T19:31:56.240 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.240 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:56.240 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.240 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:56.241 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.905825+0000", 2021-10-08T19:31:56.241 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:56.241 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.241 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.241 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:56.242 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.905825+0000", 2021-10-08T19:31:56.242 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:56.242 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.242 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.243 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:56.243 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.905825+0000", 2021-10-08T19:31:56.243 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2021-10-08T19:31:56.243 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.244 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.244 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:56.244 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.905828+0000", 2021-10-08T19:31:56.244 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2270000000000002e-06 2021-10-08T19:31:56.245 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.245 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.245 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:56.245 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.905833+0000", 2021-10-08T19:31:56.246 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7079999999999996e-06 2021-10-08T19:31:56.246 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.246 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.246 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:56.247 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.905837+0000", 2021-10-08T19:31:56.247 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0419999999999996e-06 2021-10-08T19:31:56.247 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.247 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.247 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:56.248 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.905899+0000", 2021-10-08T19:31:56.248 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2711000000000003e-05 2021-10-08T19:31:56.248 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.248 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.248 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:31:56.249 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.905907+0000", 2021-10-08T19:31:56.249 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.157e-06 2021-10-08T19:31:56.249 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.250 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.250 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:56.250 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.076593+0000", 2021-10-08T19:31:56.250 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.170685502 2021-10-08T19:31:56.251 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.251 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.251 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:56.251 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.076721+0000", 2021-10-08T19:31:56.251 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012835900000000001 2021-10-08T19:31:56.252 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.252 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.252 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:31:56.252 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.076856+0000", 2021-10-08T19:31:56.253 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000134812 2021-10-08T19:31:56.253 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.254 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.254 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:31:56.254 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.082433+0000", 2021-10-08T19:31:56.255 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0055767919999999997 2021-10-08T19:31:56.255 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.256 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.256 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:56.257 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.091797+0000", 2021-10-08T19:31:56.257 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0093636450000000003 2021-10-08T19:31:56.257 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.258 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.258 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:56.259 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.091831+0000", 2021-10-08T19:31:56.259 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4465999999999998e-05 2021-10-08T19:31:56.260 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.260 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.261 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:31:56.261 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.091876+0000", 2021-10-08T19:31:56.262 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4512999999999999e-05 2021-10-08T19:31:56.262 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.263 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.263 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:56.263 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.091985+0000", 2021-10-08T19:31:56.264 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000109276 2021-10-08T19:31:56.264 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:56.265 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:56.265 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:56.266 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.266 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.266 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:102477 8.b 8:de0ad642:::benchmark_data_smithi097_144160_object13737:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e246)", 2021-10-08T19:31:56.267 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:57.907234+0000", 2021-10-08T19:31:56.267 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 118.0607042, 2021-10-08T19:31:56.268 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.184993988, 2021-10-08T19:31:56.268 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:56.269 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:31:56.269 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:31:56.269 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:31:56.270 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:31:56.271 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 102477 2021-10-08T19:31:56.271 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.271 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:56.272 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.273 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:56.273 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.907234+0000", 2021-10-08T19:31:56.273 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:56.274 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.274 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.275 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:56.275 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.907234+0000", 2021-10-08T19:31:56.276 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:56.276 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.277 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.277 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:56.278 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.907233+0000", 2021-10-08T19:31:56.278 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2021-10-08T19:31:56.278 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.279 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.279 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:56.280 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.907238+0000", 2021-10-08T19:31:56.280 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.04e-06 2021-10-08T19:31:56.281 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.281 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.281 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:56.282 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.907246+0000", 2021-10-08T19:31:56.283 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.9389999999999997e-06 2021-10-08T19:31:56.283 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.283 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.284 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:56.285 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.907251+0000", 2021-10-08T19:31:56.285 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.899e-06 2021-10-08T19:31:56.286 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.286 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.286 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:56.287 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.907298+0000", 2021-10-08T19:31:56.287 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7314999999999997e-05 2021-10-08T19:31:56.287 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.287 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.288 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:31:56.288 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.907304+0000", 2021-10-08T19:31:56.288 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7060000000000001e-06 2021-10-08T19:31:56.289 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.289 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.290 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:56.290 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.078324+0000", 2021-10-08T19:31:56.290 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1710208529999999 2021-10-08T19:31:56.290 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.291 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.291 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:56.291 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.078409+0000", 2021-10-08T19:31:56.292 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4567000000000005e-05 2021-10-08T19:31:56.292 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.292 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.293 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:31:56.293 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.078487+0000", 2021-10-08T19:31:56.293 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7886999999999995e-05 2021-10-08T19:31:56.294 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.294 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.295 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:31:56.295 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.085283+0000", 2021-10-08T19:31:56.296 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0067957410000000001 2021-10-08T19:31:56.296 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.296 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.297 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:56.297 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.092027+0000", 2021-10-08T19:31:56.297 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0067447239999999997 2021-10-08T19:31:56.298 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.298 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.298 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:56.298 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.092062+0000", 2021-10-08T19:31:56.299 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4635000000000003e-05 2021-10-08T19:31:56.299 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.300 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.301 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:31:56.301 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.092118+0000", 2021-10-08T19:31:56.302 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6450000000000003e-05 2021-10-08T19:31:56.302 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.302 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.303 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:56.303 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.092228+0000", 2021-10-08T19:31:56.303 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000109441 2021-10-08T19:31:56.303 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:56.304 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:56.304 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:56.304 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.304 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.305 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:102500 8.b 8:daf9ef34:::benchmark_data_smithi097_144160_object13760:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e246)", 2021-10-08T19:31:56.305 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:57.928825+0000", 2021-10-08T19:31:56.305 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 118.039113528, 2021-10-08T19:31:56.305 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.163637928, 2021-10-08T19:31:56.306 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:56.306 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:31:56.306 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:31:56.306 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:31:56.306 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:31:56.307 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 102500 2021-10-08T19:31:56.307 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.307 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:56.307 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.308 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:56.308 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.928825+0000", 2021-10-08T19:31:56.308 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:56.308 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.308 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.309 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:56.309 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.928825+0000", 2021-10-08T19:31:56.309 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:56.309 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.309 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.310 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:56.310 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.928823+0000", 2021-10-08T19:31:56.310 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:31:56.311 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.311 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.311 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:56.311 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.928829+0000", 2021-10-08T19:31:56.311 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2469999999999997e-06 2021-10-08T19:31:56.312 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.312 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.312 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:56.312 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.928841+0000", 2021-10-08T19:31:56.312 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1908e-05 2021-10-08T19:31:56.313 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.313 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.313 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:56.313 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.928848+0000", 2021-10-08T19:31:56.313 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.17e-06 2021-10-08T19:31:56.314 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.314 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.314 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:56.314 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.928904+0000", 2021-10-08T19:31:56.315 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5634000000000003e-05 2021-10-08T19:31:56.315 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.315 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.315 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:31:56.315 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.928913+0000", 2021-10-08T19:31:56.316 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.7550000000000006e-06 2021-10-08T19:31:56.316 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.316 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.316 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:56.316 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.079508+0000", 2021-10-08T19:31:56.317 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1505944669999999 2021-10-08T19:31:56.317 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.317 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.317 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:56.317 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.079635+0000", 2021-10-08T19:31:56.318 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012720599999999999 2021-10-08T19:31:56.318 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.318 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.318 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:31:56.319 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.079789+0000", 2021-10-08T19:31:56.319 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000154136 2021-10-08T19:31:56.319 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.319 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.319 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:31:56.320 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.085287+0000", 2021-10-08T19:31:56.320 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0054975060000000001 2021-10-08T19:31:56.320 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.320 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.320 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:56.321 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.092269+0000", 2021-10-08T19:31:56.321 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0069826239999999998 2021-10-08T19:31:56.321 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.321 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.322 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:56.322 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.092304+0000", 2021-10-08T19:31:56.322 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4981999999999998e-05 2021-10-08T19:31:56.322 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.322 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.323 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:31:56.323 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.092351+0000", 2021-10-08T19:31:56.323 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7095000000000002e-05 2021-10-08T19:31:56.323 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.324 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.324 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:56.324 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.092463+0000", 2021-10-08T19:31:56.324 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011102799999999999 2021-10-08T19:31:56.324 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:56.325 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:56.325 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:56.325 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.325 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.325 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:102519 8.b 8:d179cc81:::benchmark_data_smithi097_144160_object13779:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e246)", 2021-10-08T19:31:56.326 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:57.947553+0000", 2021-10-08T19:31:56.326 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 118.020385172, 2021-10-08T19:31:56.326 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1451397700000001, 2021-10-08T19:31:56.326 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:56.327 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:31:56.327 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:31:56.327 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:31:56.327 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:31:56.327 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 102519 2021-10-08T19:31:56.328 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.328 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:56.328 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.328 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:56.328 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.947553+0000", 2021-10-08T19:31:56.329 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:56.329 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.329 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.329 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:56.329 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.947553+0000", 2021-10-08T19:31:56.330 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:56.330 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.330 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.330 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:56.331 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.947550+0000", 2021-10-08T19:31:56.331 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2021-10-08T19:31:56.331 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.331 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.331 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:56.332 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.947560+0000", 2021-10-08T19:31:56.332 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.662e-06 2021-10-08T19:31:56.332 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.332 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.332 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:56.333 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.947576+0000", 2021-10-08T19:31:56.333 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6583999999999999e-05 2021-10-08T19:31:56.333 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.333 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.333 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:56.334 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.947583+0000", 2021-10-08T19:31:56.334 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9469999999999997e-06 2021-10-08T19:31:56.334 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.334 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.335 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:56.335 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.947647+0000", 2021-10-08T19:31:56.335 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3819999999999995e-05 2021-10-08T19:31:56.335 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.335 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.336 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:31:56.336 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.947657+0000", 2021-10-08T19:31:56.336 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.9520000000000006e-06 2021-10-08T19:31:56.336 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.336 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.337 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:56.337 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.081284+0000", 2021-10-08T19:31:56.337 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1336265889999999 2021-10-08T19:31:56.337 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.337 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.338 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:56.338 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.081360+0000", 2021-10-08T19:31:56.338 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6329999999999996e-05 2021-10-08T19:31:56.338 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.338 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.339 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:31:56.339 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.081446+0000", 2021-10-08T19:31:56.339 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5445999999999995e-05 2021-10-08T19:31:56.339 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.340 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.340 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:31:56.340 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.089270+0000", 2021-10-08T19:31:56.340 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0078239350000000006 2021-10-08T19:31:56.340 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.341 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.341 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:56.341 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.092502+0000", 2021-10-08T19:31:56.341 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032323769999999998 2021-10-08T19:31:56.341 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.342 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.342 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:56.342 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.092538+0000", 2021-10-08T19:31:56.342 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6174000000000003e-05 2021-10-08T19:31:56.343 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.343 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.343 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:31:56.343 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.092584+0000", 2021-10-08T19:31:56.343 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5661999999999998e-05 2021-10-08T19:31:56.344 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.344 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.344 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:56.344 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.092693+0000", 2021-10-08T19:31:56.344 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010898799999999999 2021-10-08T19:31:56.345 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:56.345 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:56.345 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:56.345 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.346 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.346 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:102556 8.b 8:db9c81ba:::benchmark_data_smithi097_144160_object13816:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e246)", 2021-10-08T19:31:56.346 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:57.990196+0000", 2021-10-08T19:31:56.346 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 117.977741708, 2021-10-08T19:31:56.346 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1027266650000001, 2021-10-08T19:31:56.347 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:56.347 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:31:56.347 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:31:56.347 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:31:56.347 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:31:56.348 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 102556 2021-10-08T19:31:56.348 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.348 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:56.348 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.349 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:56.349 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.990196+0000", 2021-10-08T19:31:56.349 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:56.349 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.349 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.350 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:56.350 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.990196+0000", 2021-10-08T19:31:56.350 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:56.350 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.350 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.351 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:56.351 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.990195+0000", 2021-10-08T19:31:56.351 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:31:56.351 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.352 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.352 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:56.352 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.990201+0000", 2021-10-08T19:31:56.352 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8939999999999998e-06 2021-10-08T19:31:56.352 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.353 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.353 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:56.353 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.990212+0000", 2021-10-08T19:31:56.353 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1318000000000001e-05 2021-10-08T19:31:56.353 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.354 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.354 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:56.354 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.990217+0000", 2021-10-08T19:31:56.354 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9590000000000003e-06 2021-10-08T19:31:56.354 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.355 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.355 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:56.355 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.990271+0000", 2021-10-08T19:31:56.355 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4546999999999998e-05 2021-10-08T19:31:56.356 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.356 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.356 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:31:56.357 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.990282+0000", 2021-10-08T19:31:56.357 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0720000000000001e-05 2021-10-08T19:31:56.357 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.357 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.358 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:56.358 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.082457+0000", 2021-10-08T19:31:56.358 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0921749110000001 2021-10-08T19:31:56.358 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.359 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.359 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:56.359 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.082574+0000", 2021-10-08T19:31:56.359 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000116808 2021-10-08T19:31:56.360 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.360 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.360 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:31:56.360 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.082708+0000", 2021-10-08T19:31:56.361 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000134614 2021-10-08T19:31:56.361 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.361 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.361 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:31:56.362 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.089281+0000", 2021-10-08T19:31:56.362 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0065724579999999998 2021-10-08T19:31:56.362 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.362 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.362 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:56.363 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.092733+0000", 2021-10-08T19:31:56.363 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0034523129999999998 2021-10-08T19:31:56.363 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.364 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.364 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:56.364 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.092771+0000", 2021-10-08T19:31:56.364 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7381e-05 2021-10-08T19:31:56.365 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.365 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.365 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:31:56.365 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.092816+0000", 2021-10-08T19:31:56.365 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5867e-05 2021-10-08T19:31:56.366 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.366 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.366 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:56.366 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.092923+0000", 2021-10-08T19:31:56.367 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0001066 2021-10-08T19:31:56.367 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:56.367 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:56.367 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:56.368 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.368 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.368 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:102559 8.b 8:d2754e32:::benchmark_data_smithi097_144160_object13819:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e246)", 2021-10-08T19:31:56.368 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:57.992106+0000", 2021-10-08T19:31:56.369 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 117.97583220200001, 2021-10-08T19:31:56.369 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1010586449999999, 2021-10-08T19:31:56.369 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:56.369 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:31:56.369 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:31:56.370 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:31:56.370 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:31:56.370 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 102559 2021-10-08T19:31:56.370 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.371 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:56.371 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.371 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:56.371 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.992106+0000", 2021-10-08T19:31:56.372 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:56.372 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.372 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.372 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:56.372 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.992106+0000", 2021-10-08T19:31:56.373 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:56.373 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.373 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.373 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:56.373 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.992104+0000", 2021-10-08T19:31:56.374 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2021-10-08T19:31:56.374 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.374 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.374 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:56.374 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.992111+0000", 2021-10-08T19:31:56.375 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.528e-06 2021-10-08T19:31:56.375 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.375 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.375 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:56.376 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.992123+0000", 2021-10-08T19:31:56.376 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2384e-05 2021-10-08T19:31:56.376 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.376 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.376 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:56.377 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.992130+0000", 2021-10-08T19:31:56.377 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3280000000000002e-06 2021-10-08T19:31:56.377 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.377 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.378 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:56.378 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.992182+0000", 2021-10-08T19:31:56.378 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2157000000000002e-05 2021-10-08T19:31:56.378 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.379 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.379 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:31:56.379 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.992191+0000", 2021-10-08T19:31:56.379 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.6209999999999999e-06 2021-10-08T19:31:56.379 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.380 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.380 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:56.380 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.084213+0000", 2021-10-08T19:31:56.380 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.092022096 2021-10-08T19:31:56.380 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.381 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.381 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:56.381 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.084284+0000", 2021-10-08T19:31:56.381 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1037000000000004e-05 2021-10-08T19:31:56.381 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.382 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.382 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:31:56.382 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.084357+0000", 2021-10-08T19:31:56.382 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2349999999999997e-05 2021-10-08T19:31:56.382 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.383 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.383 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:31:56.383 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.089408+0000", 2021-10-08T19:31:56.383 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0050516809999999997 2021-10-08T19:31:56.384 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.384 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.384 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:56.384 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.092964+0000", 2021-10-08T19:31:56.384 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0035552100000000001 2021-10-08T19:31:56.385 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.385 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.385 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:56.385 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.092999+0000", 2021-10-08T19:31:56.385 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5065999999999999e-05 2021-10-08T19:31:56.386 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.386 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.386 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:31:56.386 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.093046+0000", 2021-10-08T19:31:56.387 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7052999999999998e-05 2021-10-08T19:31:56.387 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.387 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.387 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:56.387 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.093165+0000", 2021-10-08T19:31:56.388 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011874 2021-10-08T19:31:56.388 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:56.388 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:56.388 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:56.388 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.389 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.389 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:102574 8.b 8:db3e2131:::benchmark_data_smithi097_144160_object13834:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e246)", 2021-10-08T19:31:56.389 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:58.017553+0000", 2021-10-08T19:31:56.389 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 117.950385512, 2021-10-08T19:31:56.390 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0758380169999999, 2021-10-08T19:31:56.390 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:56.390 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:31:56.390 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:31:56.390 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:31:56.391 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:31:56.391 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 102574 2021-10-08T19:31:56.391 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.391 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:56.391 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.392 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:56.392 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:58.017553+0000", 2021-10-08T19:31:56.392 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:56.392 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.393 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.393 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:56.393 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:58.017553+0000", 2021-10-08T19:31:56.393 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:56.393 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.394 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.394 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:56.394 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:58.017551+0000", 2021-10-08T19:31:56.394 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:31:56.394 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.395 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.395 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:56.395 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:58.017557+0000", 2021-10-08T19:31:56.395 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7839999999999998e-06 2021-10-08T19:31:56.395 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.396 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.396 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:56.396 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:58.017569+0000", 2021-10-08T19:31:56.396 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1382999999999999e-05 2021-10-08T19:31:56.397 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.397 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.397 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:56.397 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:58.017574+0000", 2021-10-08T19:31:56.397 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2889999999999997e-06 2021-10-08T19:31:56.398 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.398 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.398 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:56.398 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:58.017618+0000", 2021-10-08T19:31:56.399 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3401e-05 2021-10-08T19:31:56.399 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.399 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.399 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:31:56.399 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:58.017624+0000", 2021-10-08T19:31:56.400 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1310000000000003e-06 2021-10-08T19:31:56.400 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.400 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.400 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:56.400 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.085313+0000", 2021-10-08T19:31:56.401 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0676896259999999 2021-10-08T19:31:56.401 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.401 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.401 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:56.402 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.085443+0000", 2021-10-08T19:31:56.402 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013005300000000001 2021-10-08T19:31:56.402 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.402 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.402 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:31:56.403 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.085587+0000", 2021-10-08T19:31:56.403 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014407499999999999 2021-10-08T19:31:56.403 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.403 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.404 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:31:56.404 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.089418+0000", 2021-10-08T19:31:56.404 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038308050000000001 2021-10-08T19:31:56.404 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.405 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.405 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:56.405 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.093205+0000", 2021-10-08T19:31:56.405 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0037872510000000002 2021-10-08T19:31:56.406 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.406 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.406 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:56.406 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.093240+0000", 2021-10-08T19:31:56.406 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5015000000000003e-05 2021-10-08T19:31:56.407 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.407 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.407 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:31:56.407 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.093286+0000", 2021-10-08T19:31:56.408 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5104e-05 2021-10-08T19:31:56.408 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.408 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.408 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:56.408 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.093391+0000", 2021-10-08T19:31:56.409 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000105028 2021-10-08T19:31:56.409 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:56.409 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:56.410 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:56.410 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.410 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.410 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:102602 8.b 8:dacd0c67:::benchmark_data_smithi097_144160_object13862:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e246)", 2021-10-08T19:31:56.410 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:58.097142+0000", 2021-10-08T19:31:56.411 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 117.870796462, 2021-10-08T19:31:56.411 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.99654567599999999, 2021-10-08T19:31:56.411 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:56.411 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:31:56.411 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:31:56.412 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:31:56.412 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:31:56.412 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 102602 2021-10-08T19:31:56.412 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.413 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:56.413 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.413 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:56.413 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:58.097142+0000", 2021-10-08T19:31:56.413 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:56.414 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.414 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.414 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:56.414 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:58.097142+0000", 2021-10-08T19:31:56.414 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:56.415 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.415 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.415 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:56.415 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:58.097140+0000", 2021-10-08T19:31:56.415 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:31:56.416 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.416 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.416 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:56.416 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:58.097146+0000", 2021-10-08T19:31:56.417 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6150000000000002e-06 2021-10-08T19:31:56.417 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.417 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.417 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:56.417 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:58.097157+0000", 2021-10-08T19:31:56.418 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0821e-05 2021-10-08T19:31:56.418 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.418 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.418 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:56.418 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:58.097162+0000", 2021-10-08T19:31:56.419 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3900000000000001e-06 2021-10-08T19:31:56.419 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.419 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.419 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:56.420 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:58.097205+0000", 2021-10-08T19:31:56.420 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2239e-05 2021-10-08T19:31:56.420 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.420 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.420 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:31:56.421 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:58.097211+0000", 2021-10-08T19:31:56.421 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9499999999999998e-06 2021-10-08T19:31:56.421 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.421 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.421 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:56.422 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.087044+0000", 2021-10-08T19:31:56.422 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.98983380499999996 2021-10-08T19:31:56.422 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.422 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.422 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:56.423 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.087126+0000", 2021-10-08T19:31:56.423 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1479999999999999e-05 2021-10-08T19:31:56.423 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.423 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.423 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:31:56.424 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.087300+0000", 2021-10-08T19:31:56.424 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000174303 2021-10-08T19:31:56.424 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.424 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.425 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:31:56.425 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.089956+0000", 2021-10-08T19:31:56.425 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002655831 2021-10-08T19:31:56.425 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.425 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.426 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:56.426 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.093431+0000", 2021-10-08T19:31:56.426 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0034749030000000001 2021-10-08T19:31:56.426 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.426 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.427 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:56.427 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.093536+0000", 2021-10-08T19:31:56.427 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010552099999999999 2021-10-08T19:31:56.427 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.427 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.428 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:31:56.428 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.093585+0000", 2021-10-08T19:31:56.428 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8813000000000002e-05 2021-10-08T19:31:56.428 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.428 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.429 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:56.429 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.093687+0000", 2021-10-08T19:31:56.429 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000102042 2021-10-08T19:31:56.429 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:56.430 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:56.430 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:56.430 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.430 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.430 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:137845 8.b 8:d9013f90:::benchmark_data_smithi097_144160_object49105:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e256)", 2021-10-08T19:31:56.431 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:30:31.700795+0000", 2021-10-08T19:31:56.431 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 84.267142621999994, 2021-10-08T19:31:56.431 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.199398951, 2021-10-08T19:31:56.431 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:56.432 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:31:56.432 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:31:56.432 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:31:56.432 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:31:56.432 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 137845 2021-10-08T19:31:56.433 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.433 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:56.433 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.433 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:56.433 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.700795+0000", 2021-10-08T19:31:56.434 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:56.434 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.434 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.434 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:56.435 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.700795+0000", 2021-10-08T19:31:56.435 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:56.435 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.435 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.435 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:56.436 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.700795+0000", 2021-10-08T19:31:56.436 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:31:56.436 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.436 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.436 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:56.437 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.700798+0000", 2021-10-08T19:31:56.437 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8550000000000002e-06 2021-10-08T19:31:56.437 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.437 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.437 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:56.438 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.700802+0000", 2021-10-08T19:31:56.438 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6029999999999998e-06 2021-10-08T19:31:56.438 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.438 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.438 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:56.439 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.700806+0000", 2021-10-08T19:31:56.439 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.473e-06 2021-10-08T19:31:56.439 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.439 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.439 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:56.440 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.700840+0000", 2021-10-08T19:31:56.440 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3855e-05 2021-10-08T19:31:56.440 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.440 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.440 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:31:56.441 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.700847+0000", 2021-10-08T19:31:56.441 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7190000000000001e-06 2021-10-08T19:31:56.441 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.441 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.442 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:56.442 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:32.679303+0000", 2021-10-08T19:31:56.442 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.97845542299999999 2021-10-08T19:31:56.442 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.442 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.443 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:31:56.443 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:32.679313+0000", 2021-10-08T19:31:56.443 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0040999999999999e-05 2021-10-08T19:31:56.443 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.443 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.444 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:56.444 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.850376+0000", 2021-10-08T19:31:56.444 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1710636700000001 2021-10-08T19:31:56.444 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.444 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.445 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:56.445 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.850541+0000", 2021-10-08T19:31:56.445 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016506600000000001 2021-10-08T19:31:56.445 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.446 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.446 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,2,4", 2021-10-08T19:31:56.446 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.850978+0000", 2021-10-08T19:31:56.446 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00043636400000000001 2021-10-08T19:31:56.446 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.447 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.447 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:56.447 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.858001+0000", 2021-10-08T19:31:56.447 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0070231 2021-10-08T19:31:56.447 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.448 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.448 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:56.448 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.858148+0000", 2021-10-08T19:31:56.448 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014706499999999999 2021-10-08T19:31:56.448 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.449 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.449 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:31:56.449 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.862354+0000", 2021-10-08T19:31:56.449 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.004206319 2021-10-08T19:31:56.450 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.450 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.450 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:56.450 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.897983+0000", 2021-10-08T19:31:56.450 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.035628430000000003 2021-10-08T19:31:56.451 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.451 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.451 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:31:56.451 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.898043+0000", 2021-10-08T19:31:56.451 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0485000000000001e-05 2021-10-08T19:31:56.452 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.452 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.452 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:56.452 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.900194+0000", 2021-10-08T19:31:56.453 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021512329999999998 2021-10-08T19:31:56.453 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:56.453 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:56.453 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:56.453 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.454 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.454 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:137877 8.b 8:d0f459fb:::benchmark_data_smithi097_144160_object49137:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e256)", 2021-10-08T19:31:56.454 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:30:31.731950+0000", 2021-10-08T19:31:56.454 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 84.235987891999997, 2021-10-08T19:31:56.454 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1684614529999999, 2021-10-08T19:31:56.455 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:31:56.455 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:31:56.455 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:31:56.455 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:31:56.456 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:31:56.456 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 137877 2021-10-08T19:31:56.456 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.456 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:31:56.457 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.457 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:31:56.457 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.731950+0000", 2021-10-08T19:31:56.457 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:56.457 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.458 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.458 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:31:56.458 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.731950+0000", 2021-10-08T19:31:56.458 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:31:56.459 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.459 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.459 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:31:56.459 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.731948+0000", 2021-10-08T19:31:56.459 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:31:56.460 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.460 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.460 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:31:56.460 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.731954+0000", 2021-10-08T19:31:56.461 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.037e-06 2021-10-08T19:31:56.461 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.461 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.461 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:31:56.462 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.731963+0000", 2021-10-08T19:31:56.462 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.602e-06 2021-10-08T19:31:56.462 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.462 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.462 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:31:56.463 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.731968+0000", 2021-10-08T19:31:56.463 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6890000000000003e-06 2021-10-08T19:31:56.463 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.463 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.463 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:56.464 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.732005+0000", 2021-10-08T19:31:56.464 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7527999999999997e-05 2021-10-08T19:31:56.464 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.464 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.464 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:31:56.465 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.732011+0000", 2021-10-08T19:31:56.465 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9449999999999998e-06 2021-10-08T19:31:56.465 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.465 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.465 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:56.466 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:32.680646+0000", 2021-10-08T19:31:56.466 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.94863507499999999 2021-10-08T19:31:56.466 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.466 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.467 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:31:56.467 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:32.680654+0000", 2021-10-08T19:31:56.467 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8120000000000008e-06 2021-10-08T19:31:56.467 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.467 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.468 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:31:56.468 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.855389+0000", 2021-10-08T19:31:56.468 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1747352 2021-10-08T19:31:56.468 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.468 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.469 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:31:56.469 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.855513+0000", 2021-10-08T19:31:56.469 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012417799999999999 2021-10-08T19:31:56.469 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.469 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.470 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,2,4", 2021-10-08T19:31:56.470 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.855651+0000", 2021-10-08T19:31:56.470 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000137317 2021-10-08T19:31:56.470 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.471 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.471 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:56.471 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.860016+0000", 2021-10-08T19:31:56.471 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0043655860000000003 2021-10-08T19:31:56.471 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.472 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.472 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:31:56.472 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.862362+0000", 2021-10-08T19:31:56.472 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0023462370000000001 2021-10-08T19:31:56.472 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.473 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.473 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:56.473 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.876380+0000", 2021-10-08T19:31:56.473 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.014017514 2021-10-08T19:31:56.473 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.474 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.474 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:31:56.474 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.900242+0000", 2021-10-08T19:31:56.474 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.023861835000000001 2021-10-08T19:31:56.475 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.475 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.475 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:31:56.475 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.900298+0000", 2021-10-08T19:31:56.475 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6548999999999997e-05 2021-10-08T19:31:56.476 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:31:56.476 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:31:56.476 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:31:56.476 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.900412+0000", 2021-10-08T19:31:56.477 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000113278 2021-10-08T19:31:56.477 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:56.477 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:56.477 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:56.477 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:31:56.478 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:31:56.478 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:31:56.827 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 13 16 24192 24176 116.211 134.125 0.00397087 0.00859829 2021-10-08T19:31:56.907 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:31:56 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:31:56.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:56 smithi117 ceph-mon[34585]: osdmap e305: 8 total, 8 up, 8 in 2021-10-08T19:31:56.908 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:56 smithi117 ceph-mon[34585]: Health check failed: Degraded data redundancy: 1088/54498 objects degraded (1.996%), 1 pg degraded (PG_DEGRADED) 2021-10-08T19:31:56.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:56 smithi097 ceph-mon[41966]: osdmap e305: 8 total, 8 up, 8 in 2021-10-08T19:31:56.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:56 smithi097 ceph-mon[41966]: Health check failed: Degraded data redundancy: 1088/54498 objects degraded (1.996%), 1 pg degraded (PG_DEGRADED) 2021-10-08T19:31:56.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:56 smithi097 ceph-mon[32687]: osdmap e305: 8 total, 8 up, 8 in 2021-10-08T19:31:56.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:56 smithi097 ceph-mon[32687]: Health check failed: Degraded data redundancy: 1088/54498 objects degraded (1.996%), 1 pg degraded (PG_DEGRADED) 2021-10-08T19:31:57.011 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:31:57.015 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:57.016 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:31:57.117 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:31:57.157 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:57.240 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:31:57.245 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:57.246 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:31:57.347 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:31:57.394 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:57.550 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2021-10-08T19:31:57.658 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:31:57.680 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:57 smithi097 ceph-mon[32687]: pgmap v542: 178 pgs: 1 activating+undersized+degraded+remapped, 177 active+clean; 1.1 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 407 B/s rd, 52 MiB/s wr, 824 op/s; 1088/54498 objects degraded (1.996%); 131 B/s, 5 objects/s recovering 2021-10-08T19:31:57.681 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:57 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:31:57.787 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:57.787 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:31:57.788 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:31:57.828 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 14 16 25984 25968 115.9 112 0.00710878 0.00861843 2021-10-08T19:31:57.888 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:31:57.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:57 smithi117 ceph-mon[34585]: pgmap v542: 178 pgs: 1 activating+undersized+degraded+remapped, 177 active+clean; 1.1 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 407 B/s rd, 52 MiB/s wr, 824 op/s; 1088/54498 objects degraded (1.996%); 131 B/s, 5 objects/s recovering 2021-10-08T19:31:57.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:57 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:31:57.922 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:57.942 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:31:57.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:57 smithi097 ceph-mon[41966]: pgmap v542: 178 pgs: 1 activating+undersized+degraded+remapped, 177 active+clean; 1.1 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 407 B/s rd, 52 MiB/s wr, 824 op/s; 1088/54498 objects degraded (1.996%); 131 B/s, 5 objects/s recovering 2021-10-08T19:31:57.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:57 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:31:58.008 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:31:58.012 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:58.013 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:31:58.114 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:31:58.214 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:58.467 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:31:58.477 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:58.478 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:31:58.579 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:31:58.629 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:58.702 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.3 to 1 (10000) 2021-10-08T19:31:58.706 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is unset 2021-10-08T19:31:58.734 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:58 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3447740998' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2021-10-08T19:31:58.734 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:58 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1553719842' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:31:58.734 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:58 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3447740998' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2021-10-08T19:31:58.735 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:58 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1553719842' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:31:58.783 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:31:58.789 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:58.790 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:31:58.830 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 15 15 27423 27408 114.166 90 0.00725661 0.00875347 2021-10-08T19:31:58.892 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:31:58.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:58 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3447740998' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2021-10-08T19:31:58.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:58 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1553719842' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:31:58.935 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:59.030 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:31:59.030 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:31:59.031 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:31:59.132 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:31:59.189 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:31:59.830 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 16 16 29509 29493 115.174 130.312 0.0069772 0.00867674 2021-10-08T19:31:59.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:59 smithi097 ceph-mon[32687]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:31:59.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:59 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3447740998' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2021-10-08T19:31:59.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:59 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1553719842' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:31:59.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:59 smithi097 ceph-mon[32687]: osdmap e306: 8 total, 8 up, 8 in 2021-10-08T19:31:59.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:31:59 smithi097 ceph-mon[32687]: pgmap v544: 178 pgs: 1 active+recovering+undersized+degraded+remapped, 177 active+clean; 1.3 GiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 85 MiB/s wr, 1.36k op/s; 1/66543 objects degraded (0.002%); 542/66543 objects misplaced (0.815%); 5.7 MiB/s, 95 objects/s recovering 2021-10-08T19:31:59.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:59 smithi097 ceph-mon[41966]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:31:59.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:59 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3447740998' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2021-10-08T19:31:59.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:59 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1553719842' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:31:59.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:59 smithi097 ceph-mon[41966]: osdmap e306: 8 total, 8 up, 8 in 2021-10-08T19:31:59.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:31:59 smithi097 ceph-mon[41966]: pgmap v544: 178 pgs: 1 active+recovering+undersized+degraded+remapped, 177 active+clean; 1.3 GiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 85 MiB/s wr, 1.36k op/s; 1/66543 objects degraded (0.002%); 542/66543 objects misplaced (0.815%); 5.7 MiB/s, 95 objects/s recovering 2021-10-08T19:31:59.973 INFO:journalctl@ceph.osd.2.smithi097.stdout:Oct 08 19:31:59 smithi097 conmon[55904]: 2021-10-08T19:31:59.492+0000 7f5997645700 -1 osd.2 pg_epoch: 306 pg[6.14( empty local-lis/les=66/67 n=0 ec=66/66 lis/c=66/66 les/c/f=67/67/0 sis=66) [2,4,7] r=0 lpr=66 crt=0'0 mlcod 0'0 active+clean] scrubber pg(6.14) handle_scrub_reserve_grant: received unsolicited reservation grant from osd 4 (0x5622277bec60) 2021-10-08T19:32:00.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:59 smithi117 ceph-mon[34585]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:32:00.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:59 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3447740998' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2021-10-08T19:32:00.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:59 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1553719842' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:32:00.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:59 smithi117 ceph-mon[34585]: osdmap e306: 8 total, 8 up, 8 in 2021-10-08T19:32:00.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:31:59 smithi117 ceph-mon[34585]: pgmap v544: 178 pgs: 1 active+recovering+undersized+degraded+remapped, 177 active+clean; 1.3 GiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 85 MiB/s wr, 1.36k op/s; 1/66543 objects degraded (0.002%); 542/66543 objects misplaced (0.815%); 5.7 MiB/s, 95 objects/s recovering 2021-10-08T19:32:00.432 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:32:00.436 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:00.437 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:32:00.538 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:32:00.578 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:00.641 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:32:00.642 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:00.642 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:32:00.744 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:32:00.781 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:00.830 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 17 16 31060 31044 114.096 96.9375 0.0114358 0.00875891 2021-10-08T19:32:00.871 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:32:00.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:00 smithi117 ceph-mon[34585]: 5.1c scrub ok 2021-10-08T19:32:00.875 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:00 smithi117 ceph-mon[34585]: osdmap e307: 8 total, 8 up, 8 in 2021-10-08T19:32:00.877 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:00.878 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:32:00.976 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:00 smithi097 ceph-mon[32687]: 5.1c scrub ok 2021-10-08T19:32:00.976 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:00 smithi097 ceph-mon[32687]: osdmap e307: 8 total, 8 up, 8 in 2021-10-08T19:32:00.977 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:00 smithi097 ceph-mon[41966]: 5.1c scrub ok 2021-10-08T19:32:00.977 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:00 smithi097 ceph-mon[41966]: osdmap e307: 8 total, 8 up, 8 in 2021-10-08T19:32:00.979 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:32:01.017 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:01.093 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:32:01.097 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:01.098 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:32:01.199 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:32:01.205 INFO:tasks.cephadm.ceph_manager.ceph:waiting for recovery to complete 2021-10-08T19:32:01.206 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph pg dump --format=json 2021-10-08T19:32:01.261 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:01.383 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:32:01.394 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:01.398 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:32:01.499 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:32:01.538 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:01.736 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:32:01.743 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:01.744 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:32:01.828 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:32:01.841 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 18 16 32690 32674 113.403 101.875 0.0119776 0.00881109 2021-10-08T19:32:01.844 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:32:01.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:01 smithi117 ceph-mon[34585]: pgmap v546: 178 pgs: 1 active+recovering+undersized+degraded+remapped, 177 active+clean; 1.7 GiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 98 MiB/s wr, 1.57k op/s; 1/82680 objects degraded (0.001%); 542/82680 objects misplaced (0.656%); 5.7 MiB/s, 90 objects/s recovering 2021-10-08T19:32:01.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:01 smithi117 ceph-mon[34585]: Health check update: Degraded data redundancy: 1/82680 objects degraded (0.001%), 1 pg degraded (PG_DEGRADED) 2021-10-08T19:32:01.919 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:01 smithi097 ceph-mon[41966]: pgmap v546: 178 pgs: 1 active+recovering+undersized+degraded+remapped, 177 active+clean; 1.7 GiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 98 MiB/s wr, 1.57k op/s; 1/82680 objects degraded (0.001%); 542/82680 objects misplaced (0.656%); 5.7 MiB/s, 90 objects/s recovering 2021-10-08T19:32:01.920 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:01 smithi097 ceph-mon[41966]: Health check update: Degraded data redundancy: 1/82680 objects degraded (0.001%), 1 pg degraded (PG_DEGRADED) 2021-10-08T19:32:01.926 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:01 smithi097 ceph-mon[32687]: pgmap v546: 178 pgs: 1 active+recovering+undersized+degraded+remapped, 177 active+clean; 1.7 GiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 98 MiB/s wr, 1.57k op/s; 1/82680 objects degraded (0.001%); 542/82680 objects misplaced (0.656%); 5.7 MiB/s, 90 objects/s recovering 2021-10-08T19:32:01.926 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:01 smithi097 ceph-mon[32687]: Health check update: Degraded data redundancy: 1/82680 objects degraded (0.001%), 1 pg degraded (PG_DEGRADED) 2021-10-08T19:32:01.927 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:01.959 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:32:01.996 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:32:02.034 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:32:02.067 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:32:02.068 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:32:02.072 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:02.073 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:32:02.108 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:32:02.140 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:32:02.175 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:32:02.177 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:32:02.213 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:32:02.214 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'false' 2021-10-08T19:32:02.215 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'false' 2021-10-08T19:32:02.215 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'false' 2021-10-08T19:32:02.215 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'false' 2021-10-08T19:32:02.216 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'false' 2021-10-08T19:32:02.216 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'false' 2021-10-08T19:32:02.216 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'false' 2021-10-08T19:32:02.216 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'false' 2021-10-08T19:32:02.223 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:02.287 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:32:02.290 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:02.290 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:32:02.350 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2021-10-08T19:32:02.350 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:32:02.393 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:32:02.447 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:02.628 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:32:02.631 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:02.632 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:32:02.733 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:32:02.781 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:02.834 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 19 16 34209 34193 112.431 94.9375 0.0050632 0.00886988 2021-10-08T19:32:02.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:02 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1411445975' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:32:02.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:02 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1411445975' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:32:02.971 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:32:02 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:32:02] "GET /metrics HTTP/1.1" 200 155907 "" "Prometheus/2.18.1" 2021-10-08T19:32:02.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:02 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1411445975' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:32:03.282 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset nodeep-scrub 2021-10-08T19:32:03.573 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:32:03.576 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:03.577 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:32:03.611 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2021-10-08T19:32:03.679 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:32:03.703 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:03.834 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:2021-10-08T19:32:03.833099+0000 min lat: 0.00118067 max lat: 3.10418 avg lat: 0.00928459 2021-10-08T19:32:03.835 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2021-10-08T19:32:03.835 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 20 16 34470 34454 107.625 16.3125 0.00866817 0.00928459 2021-10-08T19:32:03.871 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:03 smithi117 ceph-mon[34585]: 4.1 scrub ok 2021-10-08T19:32:03.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:03 smithi117 ceph-mon[34585]: pgmap v547: 178 pgs: 1 active+recovering+undersized+degraded+remapped, 177 active+clean; 1.7 GiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 726 B/s rd, 83 MiB/s wr, 1.33k op/s; 1/82680 objects degraded (0.001%); 542/82680 objects misplaced (0.656%); 4.8 MiB/s, 77 objects/s recovering 2021-10-08T19:32:03.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:03 smithi117 ceph-mon[34585]: osdmap e308: 8 total, 8 up, 8 in 2021-10-08T19:32:03.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:03 smithi097 ceph-mon[41966]: 4.1 scrub ok 2021-10-08T19:32:03.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:03 smithi097 ceph-mon[41966]: pgmap v547: 178 pgs: 1 active+recovering+undersized+degraded+remapped, 177 active+clean; 1.7 GiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 726 B/s rd, 83 MiB/s wr, 1.33k op/s; 1/82680 objects degraded (0.001%); 542/82680 objects misplaced (0.656%); 4.8 MiB/s, 77 objects/s recovering 2021-10-08T19:32:03.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:03 smithi097 ceph-mon[41966]: osdmap e308: 8 total, 8 up, 8 in 2021-10-08T19:32:03.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:03 smithi097 ceph-mon[32687]: 4.1 scrub ok 2021-10-08T19:32:03.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:03 smithi097 ceph-mon[32687]: pgmap v547: 178 pgs: 1 active+recovering+undersized+degraded+remapped, 177 active+clean; 1.7 GiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 726 B/s rd, 83 MiB/s wr, 1.33k op/s; 1/82680 objects degraded (0.001%); 542/82680 objects misplaced (0.656%); 4.8 MiB/s, 77 objects/s recovering 2021-10-08T19:32:03.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:03 smithi097 ceph-mon[32687]: osdmap e308: 8 total, 8 up, 8 in 2021-10-08T19:32:03.981 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:32:04.137 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:32:04.145 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:04.145 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:32:04.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:32:03 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:32:03] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:32:04.167 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:32:04.246 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:32:04.308 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:04.465 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:32:04.472 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:04.473 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:32:04.574 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:32:04.628 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:04.735 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:32:04.747 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:04.748 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:32:04.833 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 21 16 35981 35965 106.997 94.4375 0.0219662 0.00934117 2021-10-08T19:32:04.849 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:32:04.926 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:05.025 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:04 smithi097 ceph-mon[32687]: 3.6 scrub ok 2021-10-08T19:32:05.026 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:04 smithi097 ceph-mon[32687]: osdmap e309: 8 total, 8 up, 8 in 2021-10-08T19:32:05.026 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:04 smithi097 ceph-mon[41966]: 3.6 scrub ok 2021-10-08T19:32:05.027 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:04 smithi097 ceph-mon[41966]: osdmap e309: 8 total, 8 up, 8 in 2021-10-08T19:32:05.075 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:32:05.079 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:05.080 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:32:05.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:04 smithi117 ceph-mon[34585]: 3.6 scrub ok 2021-10-08T19:32:05.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:04 smithi117 ceph-mon[34585]: osdmap e309: 8 total, 8 up, 8 in 2021-10-08T19:32:05.181 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:32:05.219 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:05.282 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:32:05.285 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:05.286 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:32:05.319 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:32:05.323 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2021-10-08T19:32:05.387 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:32:05.439 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:05.835 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 22 16 37432 37416 106.256 90.6875 0.00971075 0.00940653 2021-10-08T19:32:06.015 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:05 smithi117 ceph-mon[34585]: 3.0 scrub ok 2021-10-08T19:32:06.016 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:05 smithi117 ceph-mon[34585]: pgmap v550: 178 pgs: 1 peering, 177 active+clean; 2.1 GiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 852 B/s rd, 131 MiB/s wr, 2.09k op/s; 5.7 MiB/s, 90 objects/s recovering 2021-10-08T19:32:06.016 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:05 smithi117 ceph-mon[34585]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/82680 objects degraded (0.001%), 1 pg degraded) 2021-10-08T19:32:06.017 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:05 smithi117 ceph-mon[34585]: 2.14 scrub ok 2021-10-08T19:32:06.085 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2021-10-08T19:32:06.131 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:05 smithi097 ceph-mon[32687]: 3.0 scrub ok 2021-10-08T19:32:06.132 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:05 smithi097 ceph-mon[32687]: pgmap v550: 178 pgs: 1 peering, 177 active+clean; 2.1 GiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 852 B/s rd, 131 MiB/s wr, 2.09k op/s; 5.7 MiB/s, 90 objects/s recovering 2021-10-08T19:32:06.132 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:05 smithi097 ceph-mon[32687]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/82680 objects degraded (0.001%), 1 pg degraded) 2021-10-08T19:32:06.132 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:05 smithi097 ceph-mon[32687]: 2.14 scrub ok 2021-10-08T19:32:06.137 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:05 smithi097 ceph-mon[41966]: 3.0 scrub ok 2021-10-08T19:32:06.137 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:05 smithi097 ceph-mon[41966]: pgmap v550: 178 pgs: 1 peering, 177 active+clean; 2.1 GiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 852 B/s rd, 131 MiB/s wr, 2.09k op/s; 5.7 MiB/s, 90 objects/s recovering 2021-10-08T19:32:06.138 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:05 smithi097 ceph-mon[41966]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/82680 objects degraded (0.001%), 1 pg degraded) 2021-10-08T19:32:06.138 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:05 smithi097 ceph-mon[41966]: 2.14 scrub ok 2021-10-08T19:32:06.304 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:32:06.312 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:06.314 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:32:06.314 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2021-10-08T19:32:06.315 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:32:06.414 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:32:06.447 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:06.835 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 23 16 39042 39026 106.007 100.625 0.00865416 0.00942766 2021-10-08T19:32:06.972 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":550,"stamp":"2021-10-08T19:32:04.697134+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2263941304,"num_objects":34732,"num_object_clones":0,"num_object_copies":104196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34732,"num_whiteouts":0,"num_read":1715,"num_read_kb":1526,"num_write":35346,"num_write_kb":2211918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1616,"num_bytes_recovered":73622866,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36783,"ondisk_log_size":36783,"up":534,"acting":534,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":535,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":8053228,"kb_used_data":6667884,"kb_used_omap":0,"kb_used_meta":1385280,"kb_avail":741907988,"statfs":{"total":767960285184,"available":759713779712,"internally_reserved":0,"allocated":6827913216,"data_stored":6821968310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1418526720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,3],"upper_bound":8},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":822542336,"num_objects":12551,"num_object_clones":0,"num_object_copies":37653,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1,"num_objects_misplaced":-542,"num_objects_unfound":0,"num_objects_dirty":12551,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":12551,"num_write_kb":803264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":543,"num_bytes_recovered":35586048,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.004028"},"pg_stats":[{"pgid":"9.5","version":"309'2122","reported_seq":2149,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.971743+0000","last_change":"2021-10-08T19:31:33.860522+0000","last_active":"2021-10-08T19:32:03.971743+0000","last_peered":"2021-10-08T19:32:03.971743+0000","last_clean":"2021-10-08T19:32:03.971743+0000","last_became_active":"2021-10-08T19:31:33.860267+0000","last_became_peered":"2021-10-08T19:31:33.860267+0000","last_unstale":"2021-10-08T19:32:03.971743+0000","last_undegraded":"2021-10-08T19:32:03.971743+0000","last_fullsized":"2021-10-08T19:32:03.971743+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.825378+0000","log_size":2122,"ondisk_log_size":2122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":139067392,"num_objects":2122,"num_object_clones":0,"num_object_copies":6366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2122,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2122,"num_write_kb":135808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"114'10","reported_seq":433,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:01.848166+0000","last_change":"2021-10-08T19:31:34.407386+0000","last_active":"2021-10-08T19:32:01.848166+0000","last_peered":"2021-10-08T19:32:01.848166+0000","last_clean":"2021-10-08T19:32:01.848166+0000","last_became_active":"2021-10-08T19:24:25.096162+0000","last_became_peered":"2021-10-08T19:24:25.096162+0000","last_unstale":"2021-10-08T19:32:01.848166+0000","last_undegraded":"2021-10-08T19:32:01.848166+0000","last_fullsized":"2021-10-08T19:32:01.848166+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'10","last_scrub_stamp":"2021-10-08T19:31:34.407260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:31:34.407260+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0056601849999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"289'34","reported_seq":68,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:00.660620+0000","last_change":"2021-10-08T19:31:22.799079+0000","last_active":"2021-10-08T19:32:00.660620+0000","last_peered":"2021-10-08T19:32:00.660620+0000","last_clean":"2021-10-08T19:32:00.660620+0000","last_became_active":"2021-10-08T19:31:22.787271+0000","last_became_peered":"2021-10-08T19:31:22.787271+0000","last_unstale":"2021-10-08T19:32:00.660620+0000","last_undegraded":"2021-10-08T19:32:00.660620+0000","last_fullsized":"2021-10-08T19:32:00.660620+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'22","last_scrub_stamp":"2021-10-08T19:30:02.395784+0000","last_deep_scrub":"87'22","last_deep_scrub_stamp":"2021-10-08T19:22:58.705632+0000","last_clean_scrub_stamp":"2021-10-08T19:30:02.395784+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":297,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.735901+0000","last_change":"2021-10-08T19:31:20.447763+0000","last_active":"2021-10-08T19:32:02.735901+0000","last_peered":"2021-10-08T19:32:02.735901+0000","last_clean":"2021-10-08T19:32:02.735901+0000","last_became_active":"2021-10-08T19:29:40.632678+0000","last_became_peered":"2021-10-08T19:29:40.632678+0000","last_unstale":"2021-10-08T19:32:02.735901+0000","last_undegraded":"2021-10-08T19:32:02.735901+0000","last_fullsized":"2021-10-08T19:32:02.735901+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:20.447692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:31:20.447692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034280880000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":279,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:00.660810+0000","last_change":"2021-10-08T19:28:08.936871+0000","last_active":"2021-10-08T19:32:00.660810+0000","last_peered":"2021-10-08T19:32:00.660810+0000","last_clean":"2021-10-08T19:32:00.660810+0000","last_became_active":"2021-10-08T19:24:25.089002+0000","last_became_peered":"2021-10-08T19:24:25.089002+0000","last_unstale":"2021-10-08T19:32:00.660810+0000","last_undegraded":"2021-10-08T19:32:00.660810+0000","last_fullsized":"2021-10-08T19:32:00.660810+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:08.936801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:08.936801+0000","last_clean_scrub_stamp":"2021-10-08T19:28:08.936801+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0082775899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":202,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:00.660709+0000","last_change":"2021-10-08T19:30:34.099689+0000","last_active":"2021-10-08T19:32:00.660709+0000","last_peered":"2021-10-08T19:32:00.660709+0000","last_clean":"2021-10-08T19:32:00.660709+0000","last_became_active":"2021-10-08T19:25:15.510457+0000","last_became_peered":"2021-10-08T19:25:15.510457+0000","last_unstale":"2021-10-08T19:32:00.660709+0000","last_undegraded":"2021-10-08T19:32:00.660709+0000","last_fullsized":"2021-10-08T19:32:00.660709+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:30:34.099590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:30:34.099590+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010301708,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"308'2137","reported_seq":2163,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.955606+0000","last_change":"2021-10-08T19:31:33.858962+0000","last_active":"2021-10-08T19:32:02.955606+0000","last_peered":"2021-10-08T19:32:02.955606+0000","last_clean":"2021-10-08T19:32:02.955606+0000","last_became_active":"2021-10-08T19:31:33.858616+0000","last_became_peered":"2021-10-08T19:31:33.858616+0000","last_unstale":"2021-10-08T19:32:02.955606+0000","last_undegraded":"2021-10-08T19:32:02.955606+0000","last_fullsized":"2021-10-08T19:32:02.955606+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.825378+0000","log_size":2137,"ondisk_log_size":2137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":140050432,"num_objects":2137,"num_object_clones":0,"num_object_copies":6411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2137,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2137,"num_write_kb":136768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,1],"acting":[5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"289'15","reported_seq":330,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.743275+0000","last_change":"2021-10-08T19:28:41.711583+0000","last_active":"2021-10-08T19:32:02.743275+0000","last_peered":"2021-10-08T19:32:02.743275+0000","last_clean":"2021-10-08T19:32:02.743275+0000","last_became_active":"2021-10-08T19:28:40.159729+0000","last_became_peered":"2021-10-08T19:28:40.159729+0000","last_unstale":"2021-10-08T19:32:02.743275+0000","last_undegraded":"2021-10-08T19:32:02.743275+0000","last_fullsized":"2021-10-08T19:32:02.743275+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'9","last_scrub_stamp":"2021-10-08T19:28:07.450546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:28:07.450546+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0061746960000000004,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":139,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.742768+0000","last_change":"2021-10-08T19:30:05.020296+0000","last_active":"2021-10-08T19:32:02.742768+0000","last_peered":"2021-10-08T19:32:02.742768+0000","last_clean":"2021-10-08T19:32:02.742768+0000","last_became_active":"2021-10-08T19:29:40.624977+0000","last_became_peered":"2021-10-08T19:29:40.624977+0000","last_unstale":"2021-10-08T19:32:02.742768+0000","last_undegraded":"2021-10-08T19:32:02.742768+0000","last_fullsized":"2021-10-08T19:32:02.742768+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:30:05.020191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:30:05.020191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014132903,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":289,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.735266+0000","last_change":"2021-10-08T19:31:22.493389+0000","last_active":"2021-10-08T19:32:02.735266+0000","last_peered":"2021-10-08T19:32:02.735266+0000","last_clean":"2021-10-08T19:32:02.735266+0000","last_became_active":"2021-10-08T19:29:40.629422+0000","last_became_peered":"2021-10-08T19:29:40.629422+0000","last_unstale":"2021-10-08T19:32:02.735266+0000","last_undegraded":"2021-10-08T19:32:02.735266+0000","last_fullsized":"2021-10-08T19:32:02.735266+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:22.493317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:31:22.493317+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001455409,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":263,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.738146+0000","last_change":"2021-10-08T19:28:09.465717+0000","last_active":"2021-10-08T19:32:02.738146+0000","last_peered":"2021-10-08T19:32:02.738146+0000","last_clean":"2021-10-08T19:32:02.738146+0000","last_became_active":"2021-10-08T19:21:29.643022+0000","last_became_peered":"2021-10-08T19:21:29.643022+0000","last_unstale":"2021-10-08T19:32:02.738146+0000","last_undegraded":"2021-10-08T19:32:02.738146+0000","last_fullsized":"2021-10-08T19:32:02.738146+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:09.465640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:28:09.465640+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.040018977999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"70'5","reported_seq":736,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.740401+0000","last_change":"2021-10-08T19:30:10.566357+0000","last_active":"2021-10-08T19:32:02.740401+0000","last_peered":"2021-10-08T19:32:02.740401+0000","last_clean":"2021-10-08T19:32:02.740401+0000","last_became_active":"2021-10-08T19:29:40.630821+0000","last_became_peered":"2021-10-08T19:29:40.630821+0000","last_unstale":"2021-10-08T19:32:02.740401+0000","last_undegraded":"2021-10-08T19:32:02.740401+0000","last_fullsized":"2021-10-08T19:32:02.740401+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:30:10.566251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:30:10.566251+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0093751019999999997,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":461,"num_read_kb":461,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1167,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.7","version":"308'2078","reported_seq":2104,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.959779+0000","last_change":"2021-10-08T19:31:33.859765+0000","last_active":"2021-10-08T19:32:02.959779+0000","last_peered":"2021-10-08T19:32:02.959779+0000","last_clean":"2021-10-08T19:32:02.959779+0000","last_became_active":"2021-10-08T19:31:33.859470+0000","last_became_peered":"2021-10-08T19:31:33.859470+0000","last_unstale":"2021-10-08T19:32:02.959779+0000","last_undegraded":"2021-10-08T19:32:02.959779+0000","last_fullsized":"2021-10-08T19:32:02.959779+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.825378+0000","log_size":2078,"ondisk_log_size":2078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":136183808,"num_objects":2078,"num_object_clones":0,"num_object_copies":6234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2078,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2078,"num_write_kb":132992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"289'35","reported_seq":321,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:00.666776+0000","last_change":"2021-10-08T19:30:51.708220+0000","last_active":"2021-10-08T19:32:00.666776+0000","last_peered":"2021-10-08T19:32:00.666776+0000","last_clean":"2021-10-08T19:32:00.666776+0000","last_became_active":"2021-10-08T19:28:40.101648+0000","last_became_peered":"2021-10-08T19:28:40.101648+0000","last_unstale":"2021-10-08T19:32:00.666776+0000","last_undegraded":"2021-10-08T19:32:00.666776+0000","last_fullsized":"2021-10-08T19:32:00.666776+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'19","last_scrub_stamp":"2021-10-08T19:30:51.708148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:30:51.708148+0000","log_size":35,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011269507999999999,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":55,"num_read_kb":44,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":275,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.735648+0000","last_change":"2021-10-08T19:31:25.413760+0000","last_active":"2021-10-08T19:32:02.735648+0000","last_peered":"2021-10-08T19:32:02.735648+0000","last_clean":"2021-10-08T19:32:02.735648+0000","last_became_active":"2021-10-08T19:21:23.595919+0000","last_became_peered":"2021-10-08T19:21:23.595919+0000","last_unstale":"2021-10-08T19:32:02.735648+0000","last_undegraded":"2021-10-08T19:32:02.735648+0000","last_fullsized":"2021-10-08T19:32:02.735648+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:25.412652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:31:25.412652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0041148390000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":283,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.734989+0000","last_change":"2021-10-08T19:31:22.784063+0000","last_active":"2021-10-08T19:32:02.734989+0000","last_peered":"2021-10-08T19:32:02.734989+0000","last_clean":"2021-10-08T19:32:02.734989+0000","last_became_active":"2021-10-08T19:31:22.783725+0000","last_became_peered":"2021-10-08T19:31:22.783725+0000","last_unstale":"2021-10-08T19:32:02.734989+0000","last_undegraded":"2021-10-08T19:32:02.734989+0000","last_fullsized":"2021-10-08T19:32:02.734989+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:14.025158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:28:14.025158+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0071289430000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":286,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:00.660058+0000","last_change":"2021-10-08T19:31:33.368701+0000","last_active":"2021-10-08T19:32:00.660058+0000","last_peered":"2021-10-08T19:32:00.660058+0000","last_clean":"2021-10-08T19:32:00.660058+0000","last_became_active":"2021-10-08T19:29:40.638354+0000","last_became_peered":"2021-10-08T19:29:40.638354+0000","last_unstale":"2021-10-08T19:32:00.660058+0000","last_undegraded":"2021-10-08T19:32:00.660058+0000","last_fullsized":"2021-10-08T19:32:00.660058+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:33.368627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:39.528699+0000","last_clean_scrub_stamp":"2021-10-08T19:31:33.368627+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0018418429999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":213,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:00.661572+0000","last_change":"2021-10-08T19:31:22.785932+0000","last_active":"2021-10-08T19:32:00.661572+0000","last_peered":"2021-10-08T19:32:00.661572+0000","last_clean":"2021-10-08T19:32:00.661572+0000","last_became_active":"2021-10-08T19:31:22.785590+0000","last_became_peered":"2021-10-08T19:31:22.785590+0000","last_unstale":"2021-10-08T19:32:00.661572+0000","last_undegraded":"2021-10-08T19:32:00.661572+0000","last_fullsized":"2021-10-08T19:32:00.661572+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:30:09.007285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:30:09.007285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0035985000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.0","version":"309'2207","reported_seq":2233,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.950216+0000","last_change":"2021-10-08T19:31:34.405279+0000","last_active":"2021-10-08T19:32:03.950216+0000","last_peered":"2021-10-08T19:32:03.950216+0000","last_clean":"2021-10-08T19:32:03.950216+0000","last_became_active":"2021-10-08T19:31:34.404922+0000","last_became_peered":"2021-10-08T19:31:34.404922+0000","last_unstale":"2021-10-08T19:32:03.950216+0000","last_undegraded":"2021-10-08T19:32:03.950216+0000","last_fullsized":"2021-10-08T19:32:03.950216+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.825378+0000","log_size":2207,"ondisk_log_size":2207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":144637952,"num_objects":2207,"num_object_clones":0,"num_object_copies":6621,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2207,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2207,"num_write_kb":141248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.8","version":"90'130","reported_seq":382,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:00.661892+0000","last_change":"2021-10-08T19:31:25.647883+0000","last_active":"2021-10-08T19:32:00.661892+0000","last_peered":"2021-10-08T19:32:00.661892+0000","last_clean":"2021-10-08T19:32:00.661892+0000","last_became_active":"2021-10-08T19:31:25.647505+0000","last_became_peered":"2021-10-08T19:31:25.647505+0000","last_unstale":"2021-10-08T19:32:00.661892+0000","last_undegraded":"2021-10-08T19:32:00.661892+0000","last_fullsized":"2021-10-08T19:32:00.661892+0000","mapping_epoch":286,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":287,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.284249+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020087920000000001,"stat_sum":{"num_bytes":53670,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":28,"num_write":16,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":686385,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"289'31","reported_seq":369,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.737922+0000","last_change":"2021-10-08T19:28:40.209057+0000","last_active":"2021-10-08T19:32:02.737922+0000","last_peered":"2021-10-08T19:32:02.737922+0000","last_clean":"2021-10-08T19:32:02.737922+0000","last_became_active":"2021-10-08T19:28:40.099618+0000","last_became_peered":"2021-10-08T19:28:40.099618+0000","last_unstale":"2021-10-08T19:32:02.737922+0000","last_undegraded":"2021-10-08T19:32:02.737922+0000","last_fullsized":"2021-10-08T19:32:02.737922+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'17","last_scrub_stamp":"2021-10-08T19:28:02.599959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:28:02.599959+0000","log_size":31,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0066589689999999998,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":50,"num_read_kb":40,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"61'1","reported_seq":276,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:00.661745+0000","last_change":"2021-10-08T19:28:05.469192+0000","last_active":"2021-10-08T19:32:00.661745+0000","last_peered":"2021-10-08T19:32:00.661745+0000","last_clean":"2021-10-08T19:32:00.661745+0000","last_became_active":"2021-10-08T19:21:23.607064+0000","last_became_peered":"2021-10-08T19:21:23.607064+0000","last_unstale":"2021-10-08T19:32:00.661745+0000","last_undegraded":"2021-10-08T19:32:00.661745+0000","last_fullsized":"2021-10-08T19:32:00.661745+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'1","last_scrub_stamp":"2021-10-08T19:28:05.469109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:28:05.469109+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013719907,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":121,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.741852+0000","last_change":"2021-10-08T19:30:09.081744+0000","last_active":"2021-10-08T19:32:02.741852+0000","last_peered":"2021-10-08T19:32:02.741852+0000","last_clean":"2021-10-08T19:32:02.741852+0000","last_became_active":"2021-10-08T19:28:40.152478+0000","last_became_peered":"2021-10-08T19:28:40.152478+0000","last_unstale":"2021-10-08T19:32:02.741852+0000","last_undegraded":"2021-10-08T19:32:02.741852+0000","last_fullsized":"2021-10-08T19:32:02.741852+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:30:09.081635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:30:09.081635+0000","last_clean_scrub_stamp":"2021-10-08T19:30:09.081635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013186959,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":287,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.736280+0000","last_change":"2021-10-08T19:31:34.486619+0000","last_active":"2021-10-08T19:32:02.736280+0000","last_peered":"2021-10-08T19:32:02.736280+0000","last_clean":"2021-10-08T19:32:02.736280+0000","last_became_active":"2021-10-08T19:29:40.629424+0000","last_became_peered":"2021-10-08T19:29:40.629424+0000","last_unstale":"2021-10-08T19:32:02.736280+0000","last_undegraded":"2021-10-08T19:32:02.736280+0000","last_fullsized":"2021-10-08T19:32:02.736280+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:34.486475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:31:34.486475+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.064897938000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":246,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:00.666942+0000","last_change":"2021-10-08T19:31:51.677159+0000","last_active":"2021-10-08T19:32:00.666942+0000","last_peered":"2021-10-08T19:32:00.666942+0000","last_clean":"2021-10-08T19:32:00.666942+0000","last_became_active":"2021-10-08T19:31:51.676829+0000","last_became_peered":"2021-10-08T19:31:51.676829+0000","last_unstale":"2021-10-08T19:32:00.666942+0000","last_undegraded":"2021-10-08T19:32:00.666942+0000","last_fullsized":"2021-10-08T19:32:00.666942+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:14.495972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:28:14.495972+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0033138379999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"309'2139","reported_seq":2166,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.970877+0000","last_change":"2021-10-08T19:31:34.405282+0000","last_active":"2021-10-08T19:32:03.970877+0000","last_peered":"2021-10-08T19:32:03.970877+0000","last_clean":"2021-10-08T19:32:03.970877+0000","last_became_active":"2021-10-08T19:31:34.404950+0000","last_became_peered":"2021-10-08T19:31:34.404950+0000","last_unstale":"2021-10-08T19:32:03.970877+0000","last_undegraded":"2021-10-08T19:32:03.970877+0000","last_fullsized":"2021-10-08T19:32:03.970877+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.825378+0000","log_size":2139,"ondisk_log_size":2139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":140181504,"num_objects":2139,"num_object_clones":0,"num_object_copies":6417,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2139,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2139,"num_write_kb":136896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.9","version":"90'130","reported_seq":616,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:00.661814+0000","last_change":"2021-10-08T19:29:43.635142+0000","last_active":"2021-10-08T19:32:00.661814+0000","last_peered":"2021-10-08T19:32:00.661814+0000","last_clean":"2021-10-08T19:32:00.661814+0000","last_became_active":"2021-10-08T19:29:43.634789+0000","last_became_peered":"2021-10-08T19:29:43.634789+0000","last_unstale":"2021-10-08T19:32:00.661814+0000","last_undegraded":"2021-10-08T19:32:00.661814+0000","last_fullsized":"2021-10-08T19:32:00.661814+0000","mapping_epoch":239,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.284249+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0045617870000000003,"stat_sum":{"num_bytes":53670,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":28,"num_write":16,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":268349,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"289'20","reported_seq":380,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.737234+0000","last_change":"2021-10-08T19:29:41.080904+0000","last_active":"2021-10-08T19:32:02.737234+0000","last_peered":"2021-10-08T19:32:02.737234+0000","last_clean":"2021-10-08T19:32:02.737234+0000","last_became_active":"2021-10-08T19:29:40.631807+0000","last_became_peered":"2021-10-08T19:29:40.631807+0000","last_unstale":"2021-10-08T19:32:02.737234+0000","last_undegraded":"2021-10-08T19:32:02.737234+0000","last_fullsized":"2021-10-08T19:32:02.737234+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'10","last_scrub_stamp":"2021-10-08T19:28:00.572215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:28:00.572215+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011508064,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":141,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.741759+0000","last_change":"2021-10-08T19:31:19.445145+0000","last_active":"2021-10-08T19:32:02.741759+0000","last_peered":"2021-10-08T19:32:02.741759+0000","last_clean":"2021-10-08T19:32:02.741759+0000","last_became_active":"2021-10-08T19:29:40.638988+0000","last_became_peered":"2021-10-08T19:29:40.638988+0000","last_unstale":"2021-10-08T19:32:02.741759+0000","last_undegraded":"2021-10-08T19:32:02.741759+0000","last_fullsized":"2021-10-08T19:32:02.741759+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:19.445067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:31:19.445067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0014240679999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"250'9","reported_seq":408,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.735193+0000","last_change":"2021-10-08T19:30:04.239264+0000","last_active":"2021-10-08T19:32:02.735193+0000","last_peered":"2021-10-08T19:32:02.735193+0000","last_clean":"2021-10-08T19:32:02.735193+0000","last_became_active":"2021-10-08T19:21:27.637930+0000","last_became_peered":"2021-10-08T19:21:27.637930+0000","last_unstale":"2021-10-08T19:32:02.735193+0000","last_undegraded":"2021-10-08T19:32:02.735193+0000","last_fullsized":"2021-10-08T19:32:02.735193+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'9","last_scrub_stamp":"2021-10-08T19:30:04.239189+0000","last_deep_scrub":"250'9","last_deep_scrub_stamp":"2021-10-08T19:30:04.239189+0000","last_clean_scrub_stamp":"2021-10-08T19:30:04.239189+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014559136,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":280,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.737646+0000","last_change":"2021-10-08T19:28:40.100538+0000","last_active":"2021-10-08T19:32:02.737646+0000","last_peered":"2021-10-08T19:32:02.737646+0000","last_clean":"2021-10-08T19:32:02.737646+0000","last_became_active":"2021-10-08T19:28:40.100213+0000","last_became_peered":"2021-10-08T19:28:40.100213+0000","last_unstale":"2021-10-08T19:32:02.737646+0000","last_undegraded":"2021-10-08T19:32:02.737646+0000","last_fullsized":"2021-10-08T19:32:02.737646+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:19.303695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:24:19.303695+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0069500159999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":82,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.743321+0000","last_change":"2021-10-08T19:29:44.443830+0000","last_active":"2021-10-08T19:32:02.743321+0000","last_peered":"2021-10-08T19:32:02.743321+0000","last_clean":"2021-10-08T19:32:02.743321+0000","last_became_active":"2021-10-08T19:29:44.443507+0000","last_became_peered":"2021-10-08T19:29:44.443507+0000","last_unstale":"2021-10-08T19:32:02.743321+0000","last_undegraded":"2021-10-08T19:32:02.743321+0000","last_fullsized":"2021-10-08T19:32:02.743321+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:05.180500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:28:05.180500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"309'2170","reported_seq":2197,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.937355+0000","last_change":"2021-10-08T19:31:33.858496+0000","last_active":"2021-10-08T19:32:03.937355+0000","last_peered":"2021-10-08T19:32:03.937355+0000","last_clean":"2021-10-08T19:32:03.937355+0000","last_became_active":"2021-10-08T19:31:33.858205+0000","last_became_peered":"2021-10-08T19:31:33.858205+0000","last_unstale":"2021-10-08T19:32:03.937355+0000","last_undegraded":"2021-10-08T19:32:03.937355+0000","last_fullsized":"2021-10-08T19:32:03.937355+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.825378+0000","log_size":2170,"ondisk_log_size":2170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":142213120,"num_objects":2170,"num_object_clones":0,"num_object_copies":6510,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2170,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2170,"num_write_kb":138880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.a","version":"90'130","reported_seq":450,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:00.660704+0000","last_change":"2021-10-08T19:31:35.822183+0000","last_active":"2021-10-08T19:32:00.660704+0000","last_peered":"2021-10-08T19:32:00.660704+0000","last_clean":"2021-10-08T19:32:00.660704+0000","last_became_active":"2021-10-08T19:27:26.591129+0000","last_became_peered":"2021-10-08T19:27:26.591129+0000","last_unstale":"2021-10-08T19:32:00.660704+0000","last_undegraded":"2021-10-08T19:32:00.660704+0000","last_fullsized":"2021-10-08T19:32:00.660704+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:31:35.822084+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:31:35.822084+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0016817410000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.f","version":"289'27","reported_seq":205,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.742277+0000","last_change":"2021-10-08T19:31:30.379641+0000","last_active":"2021-10-08T19:32:02.742277+0000","last_peered":"2021-10-08T19:32:02.742277+0000","last_clean":"2021-10-08T19:32:02.742277+0000","last_became_active":"2021-10-08T19:29:40.639877+0000","last_became_peered":"2021-10-08T19:29:40.639877+0000","last_unstale":"2021-10-08T19:32:02.742277+0000","last_undegraded":"2021-10-08T19:32:02.742277+0000","last_fullsized":"2021-10-08T19:32:02.742277+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'15","last_scrub_stamp":"2021-10-08T19:31:30.379547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:31:30.379547+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039949520000000004,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":139,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.741009+0000","last_change":"2021-10-08T19:30:11.103026+0000","last_active":"2021-10-08T19:32:02.741009+0000","last_peered":"2021-10-08T19:32:02.741009+0000","last_clean":"2021-10-08T19:32:02.741009+0000","last_became_active":"2021-10-08T19:29:40.631290+0000","last_became_peered":"2021-10-08T19:29:40.631290+0000","last_unstale":"2021-10-08T19:32:02.741009+0000","last_undegraded":"2021-10-08T19:32:02.741009+0000","last_fullsized":"2021-10-08T19:32:02.741009+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:30:11.102934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:30:11.102934+0000","last_clean_scrub_stamp":"2021-10-08T19:30:11.102934+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.020040438000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"88'9","reported_seq":404,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.737565+0000","last_change":"2021-10-08T19:28:01.592286+0000","last_active":"2021-10-08T19:32:02.737565+0000","last_peered":"2021-10-08T19:32:02.737565+0000","last_clean":"2021-10-08T19:32:02.737565+0000","last_became_active":"2021-10-08T19:21:27.636432+0000","last_became_peered":"2021-10-08T19:21:27.636432+0000","last_unstale":"2021-10-08T19:32:02.737565+0000","last_undegraded":"2021-10-08T19:32:02.737565+0000","last_fullsized":"2021-10-08T19:32:02.737565+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'9","last_scrub_stamp":"2021-10-08T19:28:01.592208+0000","last_deep_scrub":"88'9","last_deep_scrub_stamp":"2021-10-08T19:23:00.048245+0000","last_clean_scrub_stamp":"2021-10-08T19:28:01.592208+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0051143930000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":287,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:00.661417+0000","last_change":"2021-10-08T19:30:32.621917+0000","last_active":"2021-10-08T19:32:00.661417+0000","last_peered":"2021-10-08T19:32:00.661417+0000","last_clean":"2021-10-08T19:32:00.661417+0000","last_became_active":"2021-10-08T19:28:40.137966+0000","last_became_peered":"2021-10-08T19:28:40.137966+0000","last_unstale":"2021-10-08T19:32:00.661417+0000","last_undegraded":"2021-10-08T19:32:00.661417+0000","last_fullsized":"2021-10-08T19:32:00.661417+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:30:32.621835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:30:32.621835+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.01635269,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.8","version":"70'5","reported_seq":82,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.740639+0000","last_change":"2021-10-08T19:29:40.641255+0000","last_active":"2021-10-08T19:32:02.740639+0000","last_peered":"2021-10-08T19:32:02.740639+0000","last_clean":"2021-10-08T19:32:02.740639+0000","last_became_active":"2021-10-08T19:29:40.639786+0000","last_became_peered":"2021-10-08T19:29:40.639786+0000","last_unstale":"2021-10-08T19:32:02.740639+0000","last_undegraded":"2021-10-08T19:32:02.740639+0000","last_fullsized":"2021-10-08T19:32:02.740639+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:28:08.162564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:28:08.162564+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.039687264,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3","version":"308'2154","reported_seq":2180,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.923573+0000","last_change":"2021-10-08T19:31:33.862720+0000","last_active":"2021-10-08T19:32:02.923573+0000","last_peered":"2021-10-08T19:32:02.923573+0000","last_clean":"2021-10-08T19:32:02.923573+0000","last_became_active":"2021-10-08T19:31:33.861869+0000","last_became_peered":"2021-10-08T19:31:33.861869+0000","last_unstale":"2021-10-08T19:32:02.923573+0000","last_undegraded":"2021-10-08T19:32:02.923573+0000","last_fullsized":"2021-10-08T19:32:02.923573+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.825378+0000","log_size":2154,"ondisk_log_size":2154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":141164544,"num_objects":2154,"num_object_clones":0,"num_object_copies":6462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2154,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2154,"num_write_kb":137856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"289'19","reported_seq":444,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.737270+0000","last_change":"2021-10-08T19:31:51.686731+0000","last_active":"2021-10-08T19:32:02.737270+0000","last_peered":"2021-10-08T19:32:02.737270+0000","last_clean":"2021-10-08T19:32:02.737270+0000","last_became_active":"2021-10-08T19:31:51.677509+0000","last_became_peered":"2021-10-08T19:31:51.677509+0000","last_unstale":"2021-10-08T19:32:02.737270+0000","last_undegraded":"2021-10-08T19:32:02.737270+0000","last_fullsized":"2021-10-08T19:32:02.737270+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'11","last_scrub_stamp":"2021-10-08T19:28:08.680153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:28:08.680153+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0066172430000000001,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":770,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":294,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:00.660234+0000","last_change":"2021-10-08T19:30:11.036131+0000","last_active":"2021-10-08T19:32:00.660234+0000","last_peered":"2021-10-08T19:32:00.660234+0000","last_clean":"2021-10-08T19:32:00.660234+0000","last_became_active":"2021-10-08T19:28:40.100691+0000","last_became_peered":"2021-10-08T19:28:40.100691+0000","last_unstale":"2021-10-08T19:32:00.660234+0000","last_undegraded":"2021-10-08T19:32:00.660234+0000","last_fullsized":"2021-10-08T19:32:00.660234+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:30:11.036056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:30:11.036056+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0045723780000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":281,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:00.661197+0000","last_change":"2021-10-08T19:28:11.939647+0000","last_active":"2021-10-08T19:32:00.661197+0000","last_peered":"2021-10-08T19:32:00.661197+0000","last_clean":"2021-10-08T19:32:00.661197+0000","last_became_active":"2021-10-08T19:24:25.105244+0000","last_became_peered":"2021-10-08T19:24:25.105244+0000","last_unstale":"2021-10-08T19:32:00.661197+0000","last_undegraded":"2021-10-08T19:32:00.661197+0000","last_fullsized":"2021-10-08T19:32:00.661197+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:11.939557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:28:11.939557+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.005546044,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":88,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.745704+0000","last_change":"2021-10-08T19:30:00.182902+0000","last_active":"2021-10-08T19:32:02.745704+0000","last_peered":"2021-10-08T19:32:02.745704+0000","last_clean":"2021-10-08T19:32:02.745704+0000","last_became_active":"2021-10-08T19:29:40.638099+0000","last_became_peered":"2021-10-08T19:29:40.638099+0000","last_unstale":"2021-10-08T19:32:02.745704+0000","last_undegraded":"2021-10-08T19:32:02.745704+0000","last_fullsized":"2021-10-08T19:32:02.745704+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:30:00.182809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:17.422176+0000","last_clean_scrub_stamp":"2021-10-08T19:30:00.182809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0084241090000000008,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":219,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.735306+0000","last_change":"2021-10-08T19:30:02.409684+0000","last_active":"2021-10-08T19:32:02.735306+0000","last_peered":"2021-10-08T19:32:02.735306+0000","last_clean":"2021-10-08T19:32:02.735306+0000","last_became_active":"2021-10-08T19:24:13.506602+0000","last_became_peered":"2021-10-08T19:24:13.506602+0000","last_unstale":"2021-10-08T19:32:02.735306+0000","last_undegraded":"2021-10-08T19:32:02.735306+0000","last_fullsized":"2021-10-08T19:32:02.735306+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:30:02.409605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:30:02.409605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013592109,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.c","version":"309'2211","reported_seq":2238,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.971224+0000","last_change":"2021-10-08T19:31:33.861894+0000","last_active":"2021-10-08T19:32:03.971224+0000","last_peered":"2021-10-08T19:32:03.971224+0000","last_clean":"2021-10-08T19:32:03.971224+0000","last_became_active":"2021-10-08T19:31:33.861544+0000","last_became_peered":"2021-10-08T19:31:33.861544+0000","last_unstale":"2021-10-08T19:32:03.971224+0000","last_undegraded":"2021-10-08T19:32:03.971224+0000","last_fullsized":"2021-10-08T19:32:03.971224+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.825378+0000","log_size":2211,"ondisk_log_size":2211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":144900096,"num_objects":2211,"num_object_clones":0,"num_object_copies":6633,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2211,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2211,"num_write_kb":141504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"90'130","reported_seq":412,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.745691+0000","last_change":"2021-10-08T19:29:43.637064+0000","last_active":"2021-10-08T19:32:02.745691+0000","last_peered":"2021-10-08T19:32:02.745691+0000","last_clean":"2021-10-08T19:32:02.745691+0000","last_became_active":"2021-10-08T19:29:43.636733+0000","last_became_peered":"2021-10-08T19:29:43.636733+0000","last_unstale":"2021-10-08T19:32:02.745691+0000","last_undegraded":"2021-10-08T19:32:02.745691+0000","last_fullsized":"2021-10-08T19:32:02.745691+0000","mapping_epoch":239,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.284249+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020087920000000001,"stat_sum":{"num_bytes":53670,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":28,"num_write":16,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":816370,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"238'13","reported_seq":123,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.740564+0000","last_change":"2021-10-08T19:31:21.473012+0000","last_active":"2021-10-08T19:32:02.740564+0000","last_peered":"2021-10-08T19:32:02.740564+0000","last_clean":"2021-10-08T19:32:02.740564+0000","last_became_active":"2021-10-08T19:29:40.640248+0000","last_became_peered":"2021-10-08T19:29:40.640248+0000","last_unstale":"2021-10-08T19:32:02.740564+0000","last_undegraded":"2021-10-08T19:32:02.740564+0000","last_fullsized":"2021-10-08T19:32:02.740564+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"238'13","last_scrub_stamp":"2021-10-08T19:31:21.472930+0000","last_deep_scrub":"91'9","last_deep_scrub_stamp":"2021-10-08T19:23:32.329475+0000","last_clean_scrub_stamp":"2021-10-08T19:31:21.472930+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040000679999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"289'28","reported_seq":364,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.735486+0000","last_change":"2021-10-08T19:32:02.490565+0000","last_active":"2021-10-08T19:32:02.735486+0000","last_peered":"2021-10-08T19:32:02.735486+0000","last_clean":"2021-10-08T19:32:02.735486+0000","last_became_active":"2021-10-08T19:24:25.098743+0000","last_became_peered":"2021-10-08T19:24:25.098743+0000","last_unstale":"2021-10-08T19:32:02.735486+0000","last_undegraded":"2021-10-08T19:32:02.735486+0000","last_fullsized":"2021-10-08T19:32:02.735486+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'28","last_scrub_stamp":"2021-10-08T19:32:02.490435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:32:02.490435+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.005683698,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":42,"num_read_kb":35,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":210,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:00.667816+0000","last_change":"2021-10-08T19:29:57.443163+0000","last_active":"2021-10-08T19:32:00.667816+0000","last_peered":"2021-10-08T19:32:00.667816+0000","last_clean":"2021-10-08T19:32:00.667816+0000","last_became_active":"2021-10-08T19:24:25.094364+0000","last_became_peered":"2021-10-08T19:24:25.094364+0000","last_unstale":"2021-10-08T19:32:00.667816+0000","last_undegraded":"2021-10-08T19:32:00.667816+0000","last_fullsized":"2021-10-08T19:32:00.667816+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:29:57.443059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:29:57.443059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.004499304,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":282,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:00.661975+0000","last_change":"2021-10-08T19:28:01.468726+0000","last_active":"2021-10-08T19:32:00.661975+0000","last_peered":"2021-10-08T19:32:00.661975+0000","last_clean":"2021-10-08T19:32:00.661975+0000","last_became_active":"2021-10-08T19:24:25.094848+0000","last_became_peered":"2021-10-08T19:24:25.094848+0000","last_unstale":"2021-10-08T19:32:00.661975+0000","last_undegraded":"2021-10-08T19:32:00.661975+0000","last_fullsized":"2021-10-08T19:32:00.661975+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:01.468644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:28:01.468644+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.030033254999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":246,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.275132+0000","last_change":"2021-10-08T19:32:03.275025+0000","last_active":"2021-10-08T19:32:03.275132+0000","last_peered":"2021-10-08T19:32:03.275132+0000","last_clean":"2021-10-08T19:32:03.275132+0000","last_became_active":"2021-10-08T19:28:40.132751+0000","last_became_peered":"2021-10-08T19:28:40.132751+0000","last_unstale":"2021-10-08T19:32:03.275132+0000","last_undegraded":"2021-10-08T19:32:03.275132+0000","last_fullsized":"2021-10-08T19:32:03.275132+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:03.274966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:03.274966+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001658084,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.d","version":"307'2153","reported_seq":4362,"reported_epoch":308,"state":"peering","last_fresh":"2021-10-08T19:32:02.740974+0000","last_change":"2021-10-08T19:32:02.741814+0000","last_active":"2021-10-08T19:32:02.740974+0000","last_peered":"2021-10-08T19:32:02.739948+0000","last_clean":"2021-10-08T19:31:50.651329+0000","last_became_active":"2021-10-08T19:31:53.754731+0000","last_became_peered":"2021-10-08T19:31:53.754731+0000","last_unstale":"2021-10-08T19:32:02.740974+0000","last_undegraded":"2021-10-08T19:32:02.740974+0000","last_fullsized":"2021-10-08T19:32:02.740974+0000","mapping_epoch":308,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.825378+0000","log_size":2153,"ondisk_log_size":2153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":141099008,"num_objects":2153,"num_object_clones":0,"num_object_copies":6459,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2153,"num_write_kb":137792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1088,"num_bytes_recovered":71303168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5],"acting":[7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,4,5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.5","version":"90'130","reported_seq":445,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.737484+0000","last_change":"2021-10-08T19:27:26.591042+0000","last_active":"2021-10-08T19:32:02.737484+0000","last_peered":"2021-10-08T19:32:02.737484+0000","last_clean":"2021-10-08T19:32:02.737484+0000","last_became_active":"2021-10-08T19:27:26.590651+0000","last_became_peered":"2021-10-08T19:27:26.590651+0000","last_unstale":"2021-10-08T19:32:02.737484+0000","last_undegraded":"2021-10-08T19:32:02.737484+0000","last_fullsized":"2021-10-08T19:32:02.737484+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.284249+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020087920000000001,"stat_sum":{"num_bytes":53670,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":28,"num_write":16,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":161010,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":282,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.735727+0000","last_change":"2021-10-08T19:29:40.639874+0000","last_active":"2021-10-08T19:32:02.735727+0000","last_peered":"2021-10-08T19:32:02.735727+0000","last_clean":"2021-10-08T19:32:02.735727+0000","last_became_active":"2021-10-08T19:29:40.639405+0000","last_became_peered":"2021-10-08T19:29:40.639405+0000","last_unstale":"2021-10-08T19:32:02.735727+0000","last_undegraded":"2021-10-08T19:32:02.735727+0000","last_fullsized":"2021-10-08T19:32:02.735727+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:15.302475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:24:15.302475+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0050588849999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"289'30","reported_seq":124,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.740485+0000","last_change":"2021-10-08T19:30:11.192496+0000","last_active":"2021-10-08T19:32:02.740485+0000","last_peered":"2021-10-08T19:32:02.740485+0000","last_clean":"2021-10-08T19:32:02.740485+0000","last_became_active":"2021-10-08T19:29:40.635007+0000","last_became_peered":"2021-10-08T19:29:40.635007+0000","last_unstale":"2021-10-08T19:32:02.740485+0000","last_undegraded":"2021-10-08T19:32:02.740485+0000","last_fullsized":"2021-10-08T19:32:02.740485+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'18","last_scrub_stamp":"2021-10-08T19:30:11.192395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:30:11.192395+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0092167559999999996,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":51,"num_read_kb":39,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":115,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.742367+0000","last_change":"2021-10-08T19:28:40.146228+0000","last_active":"2021-10-08T19:32:02.742367+0000","last_peered":"2021-10-08T19:32:02.742367+0000","last_clean":"2021-10-08T19:32:02.742367+0000","last_became_active":"2021-10-08T19:28:40.141714+0000","last_became_peered":"2021-10-08T19:28:40.141714+0000","last_unstale":"2021-10-08T19:32:02.742367+0000","last_undegraded":"2021-10-08T19:32:02.742367+0000","last_fullsized":"2021-10-08T19:32:02.742367+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:07.710367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:07.710367+0000","last_clean_scrub_stamp":"2021-10-08T19:28:07.710367+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0037557269999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":280,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.736316+0000","last_change":"2021-10-08T19:29:40.638605+0000","last_active":"2021-10-08T19:32:02.736316+0000","last_peered":"2021-10-08T19:32:02.736316+0000","last_clean":"2021-10-08T19:32:02.736316+0000","last_became_active":"2021-10-08T19:29:40.638253+0000","last_became_peered":"2021-10-08T19:29:40.638253+0000","last_unstale":"2021-10-08T19:32:02.736316+0000","last_undegraded":"2021-10-08T19:32:02.736316+0000","last_fullsized":"2021-10-08T19:32:02.736316+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:15.793206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:28:15.793206+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0049324570000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":82,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.745323+0000","last_change":"2021-10-08T19:29:40.634877+0000","last_active":"2021-10-08T19:32:02.745323+0000","last_peered":"2021-10-08T19:32:02.745323+0000","last_clean":"2021-10-08T19:32:02.745323+0000","last_became_active":"2021-10-08T19:29:40.634579+0000","last_became_peered":"2021-10-08T19:29:40.634579+0000","last_unstale":"2021-10-08T19:32:02.745323+0000","last_undegraded":"2021-10-08T19:32:02.745323+0000","last_fullsized":"2021-10-08T19:32:02.745323+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:09.177525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:09.177525+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"308'2122","reported_seq":2148,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.952736+0000","last_change":"2021-10-08T19:31:33.862007+0000","last_active":"2021-10-08T19:32:02.952736+0000","last_peered":"2021-10-08T19:32:02.952736+0000","last_clean":"2021-10-08T19:32:02.952736+0000","last_became_active":"2021-10-08T19:31:33.861748+0000","last_became_peered":"2021-10-08T19:31:33.861748+0000","last_unstale":"2021-10-08T19:32:02.952736+0000","last_undegraded":"2021-10-08T19:32:02.952736+0000","last_fullsized":"2021-10-08T19:32:02.952736+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.825378+0000","log_size":2122,"ondisk_log_size":2122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":139067392,"num_objects":2122,"num_object_clones":0,"num_object_copies":6366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2122,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2122,"num_write_kb":135808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.6","version":"90'130","reported_seq":377,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:00.667632+0000","last_change":"2021-10-08T19:30:00.644195+0000","last_active":"2021-10-08T19:32:00.667632+0000","last_peered":"2021-10-08T19:32:00.667632+0000","last_clean":"2021-10-08T19:32:00.667632+0000","last_became_active":"2021-10-08T19:30:00.643797+0000","last_became_peered":"2021-10-08T19:30:00.643797+0000","last_unstale":"2021-10-08T19:32:00.667632+0000","last_undegraded":"2021-10-08T19:32:00.667632+0000","last_fullsized":"2021-10-08T19:32:00.667632+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.284249+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020087920000000001,"stat_sum":{"num_bytes":53670,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":28,"num_write":16,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":161009,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":216,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:00.666867+0000","last_change":"2021-10-08T19:31:28.726444+0000","last_active":"2021-10-08T19:32:00.666867+0000","last_peered":"2021-10-08T19:32:00.666867+0000","last_clean":"2021-10-08T19:32:00.666867+0000","last_became_active":"2021-10-08T19:24:25.095389+0000","last_became_peered":"2021-10-08T19:24:25.095389+0000","last_unstale":"2021-10-08T19:32:00.666867+0000","last_undegraded":"2021-10-08T19:32:00.666867+0000","last_fullsized":"2021-10-08T19:32:00.666867+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:28.726330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:31:28.726330+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0019009680000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"289'29","reported_seq":324,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.743034+0000","last_change":"2021-10-08T19:29:40.416206+0000","last_active":"2021-10-08T19:32:02.743034+0000","last_peered":"2021-10-08T19:32:02.743034+0000","last_clean":"2021-10-08T19:32:02.743034+0000","last_became_active":"2021-10-08T19:21:25.741812+0000","last_became_peered":"2021-10-08T19:21:25.741812+0000","last_unstale":"2021-10-08T19:32:02.743034+0000","last_undegraded":"2021-10-08T19:32:02.743034+0000","last_fullsized":"2021-10-08T19:32:02.743034+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'19","last_scrub_stamp":"2021-10-08T19:29:40.416129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:29:40.416129+0000","log_size":29,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0026786840000000002,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":54,"num_read_kb":40,"num_write":32,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"61'1","reported_seq":283,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:00.662035+0000","last_change":"2021-10-08T19:30:44.230204+0000","last_active":"2021-10-08T19:32:00.662035+0000","last_peered":"2021-10-08T19:32:00.662035+0000","last_clean":"2021-10-08T19:32:00.662035+0000","last_became_active":"2021-10-08T19:21:23.604258+0000","last_became_peered":"2021-10-08T19:21:23.604258+0000","last_unstale":"2021-10-08T19:32:00.662035+0000","last_undegraded":"2021-10-08T19:32:00.662035+0000","last_fullsized":"2021-10-08T19:32:00.662035+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'1","last_scrub_stamp":"2021-10-08T19:30:44.230093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:30:44.230093+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011089468999999999,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":115,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.740827+0000","last_change":"2021-10-08T19:28:40.146183+0000","last_active":"2021-10-08T19:32:02.740827+0000","last_peered":"2021-10-08T19:32:02.740827+0000","last_clean":"2021-10-08T19:32:02.740827+0000","last_became_active":"2021-10-08T19:28:40.140876+0000","last_became_peered":"2021-10-08T19:28:40.140876+0000","last_unstale":"2021-10-08T19:32:02.740827+0000","last_undegraded":"2021-10-08T19:32:02.740827+0000","last_fullsized":"2021-10-08T19:32:02.740827+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:04.724061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:28:04.724061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001436805,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"70'5","reported_seq":121,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.741934+0000","last_change":"2021-10-08T19:31:26.405590+0000","last_active":"2021-10-08T19:32:02.741934+0000","last_peered":"2021-10-08T19:32:02.741934+0000","last_clean":"2021-10-08T19:32:02.741934+0000","last_became_active":"2021-10-08T19:28:40.150503+0000","last_became_peered":"2021-10-08T19:28:40.150503+0000","last_unstale":"2021-10-08T19:32:02.741934+0000","last_undegraded":"2021-10-08T19:32:02.741934+0000","last_fullsized":"2021-10-08T19:32:02.741934+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:31:26.405520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:31:26.405520+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001959166,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"309'2204","reported_seq":2231,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.992568+0000","last_change":"2021-10-08T19:31:34.405930+0000","last_active":"2021-10-08T19:32:03.992568+0000","last_peered":"2021-10-08T19:32:03.992568+0000","last_clean":"2021-10-08T19:32:03.992568+0000","last_became_active":"2021-10-08T19:31:34.405616+0000","last_became_peered":"2021-10-08T19:31:34.405616+0000","last_unstale":"2021-10-08T19:32:03.992568+0000","last_undegraded":"2021-10-08T19:32:03.992568+0000","last_fullsized":"2021-10-08T19:32:03.992568+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.825378+0000","log_size":2204,"ondisk_log_size":2204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":144441344,"num_objects":2204,"num_object_clones":0,"num_object_copies":6612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2204,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2204,"num_write_kb":141056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"90'130","reported_seq":422,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.741223+0000","last_change":"2021-10-08T19:31:29.337770+0000","last_active":"2021-10-08T19:32:02.741223+0000","last_peered":"2021-10-08T19:32:02.741223+0000","last_clean":"2021-10-08T19:32:02.741223+0000","last_became_active":"2021-10-08T19:28:43.178371+0000","last_became_peered":"2021-10-08T19:28:43.178371+0000","last_unstale":"2021-10-08T19:32:02.741223+0000","last_undegraded":"2021-10-08T19:32:02.741223+0000","last_fullsized":"2021-10-08T19:32:02.741223+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:31:29.337697+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:31:29.337697+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0017211990000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":34,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:00.660938+0000","last_change":"2021-10-08T19:31:22.784081+0000","last_active":"2021-10-08T19:32:00.660938+0000","last_peered":"2021-10-08T19:32:00.660938+0000","last_clean":"2021-10-08T19:32:00.660938+0000","last_became_active":"2021-10-08T19:31:22.783759+0000","last_became_peered":"2021-10-08T19:31:22.783759+0000","last_unstale":"2021-10-08T19:32:00.660938+0000","last_undegraded":"2021-10-08T19:32:00.660938+0000","last_fullsized":"2021-10-08T19:32:00.660938+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:29:40.453424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:29:40.453424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003650445,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"289'24","reported_seq":353,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.742986+0000","last_change":"2021-10-08T19:30:02.503634+0000","last_active":"2021-10-08T19:32:02.742986+0000","last_peered":"2021-10-08T19:32:02.742986+0000","last_clean":"2021-10-08T19:32:02.742986+0000","last_became_active":"2021-10-08T19:28:40.133150+0000","last_became_peered":"2021-10-08T19:28:40.133150+0000","last_unstale":"2021-10-08T19:32:02.742986+0000","last_undegraded":"2021-10-08T19:32:02.742986+0000","last_fullsized":"2021-10-08T19:32:02.742986+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'12","last_scrub_stamp":"2021-10-08T19:30:02.503527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:30:02.503527+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0071868260000000003,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":30,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":258,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.736544+0000","last_change":"2021-10-08T19:29:59.237265+0000","last_active":"2021-10-08T19:32:02.736544+0000","last_peered":"2021-10-08T19:32:02.736544+0000","last_clean":"2021-10-08T19:32:02.736544+0000","last_became_active":"2021-10-08T19:28:40.140231+0000","last_became_peered":"2021-10-08T19:28:40.140231+0000","last_unstale":"2021-10-08T19:32:02.736544+0000","last_undegraded":"2021-10-08T19:32:02.736544+0000","last_fullsized":"2021-10-08T19:32:02.736544+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:29:59.237160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:32.922694+0000","last_clean_scrub_stamp":"2021-10-08T19:29:59.237160+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0056451139999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":305,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.737916+0000","last_change":"2021-10-08T19:29:40.632278+0000","last_active":"2021-10-08T19:32:02.737916+0000","last_peered":"2021-10-08T19:32:02.737916+0000","last_clean":"2021-10-08T19:32:02.737916+0000","last_became_active":"2021-10-08T19:29:40.632010+0000","last_became_peered":"2021-10-08T19:29:40.632010+0000","last_unstale":"2021-10-08T19:32:02.737916+0000","last_undegraded":"2021-10-08T19:32:02.737916+0000","last_fullsized":"2021-10-08T19:32:02.737916+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:09.177525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:09.177525+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0090469920000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":17,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.741712+0000","last_change":"2021-10-08T19:31:51.674145+0000","last_active":"2021-10-08T19:32:02.741712+0000","last_peered":"2021-10-08T19:32:02.741712+0000","last_clean":"2021-10-08T19:32:02.741712+0000","last_became_active":"2021-10-08T19:31:51.673821+0000","last_became_peered":"2021-10-08T19:31:51.673821+0000","last_unstale":"2021-10-08T19:32:02.741712+0000","last_undegraded":"2021-10-08T19:32:02.741712+0000","last_fullsized":"2021-10-08T19:32:02.741712+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:39.543005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:39.543005+0000","last_clean_scrub_stamp":"2021-10-08T19:27:39.543005+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"309'2243","reported_seq":2270,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.967053+0000","last_change":"2021-10-08T19:31:33.860786+0000","last_active":"2021-10-08T19:32:03.967053+0000","last_peered":"2021-10-08T19:32:03.967053+0000","last_clean":"2021-10-08T19:32:03.967053+0000","last_became_active":"2021-10-08T19:31:33.860551+0000","last_became_peered":"2021-10-08T19:31:33.860551+0000","last_unstale":"2021-10-08T19:32:03.967053+0000","last_undegraded":"2021-10-08T19:32:03.967053+0000","last_fullsized":"2021-10-08T19:32:03.967053+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.825378+0000","log_size":2243,"ondisk_log_size":2243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":146997248,"num_objects":2243,"num_object_clones":0,"num_object_copies":6729,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2243,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2243,"num_write_kb":143552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":264,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:00.661163+0000","last_change":"2021-10-08T19:28:03.456643+0000","last_active":"2021-10-08T19:32:00.661163+0000","last_peered":"2021-10-08T19:32:00.661163+0000","last_clean":"2021-10-08T19:32:00.661163+0000","last_became_active":"2021-10-08T19:21:27.636086+0000","last_became_peered":"2021-10-08T19:21:27.636086+0000","last_unstale":"2021-10-08T19:32:00.661163+0000","last_undegraded":"2021-10-08T19:32:00.661163+0000","last_fullsized":"2021-10-08T19:32:00.661163+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:03.456570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:28:03.456570+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0035030170000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"289'26","reported_seq":244,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:00.667216+0000","last_change":"2021-10-08T19:28:12.445917+0000","last_active":"2021-10-08T19:32:00.667216+0000","last_peered":"2021-10-08T19:32:00.667216+0000","last_clean":"2021-10-08T19:32:00.667216+0000","last_became_active":"2021-10-08T19:24:25.100384+0000","last_became_peered":"2021-10-08T19:24:25.100384+0000","last_unstale":"2021-10-08T19:32:00.667216+0000","last_undegraded":"2021-10-08T19:32:00.667216+0000","last_fullsized":"2021-10-08T19:32:00.667216+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'14","last_scrub_stamp":"2021-10-08T19:28:12.445838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:28:12.445838+0000","log_size":26,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0022764790000000001,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":42,"num_read_kb":32,"num_write":25,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"90'130","reported_seq":581,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:00.660151+0000","last_change":"2021-10-08T19:30:52.391052+0000","last_active":"2021-10-08T19:32:00.660151+0000","last_peered":"2021-10-08T19:32:00.660151+0000","last_clean":"2021-10-08T19:32:00.660151+0000","last_became_active":"2021-10-08T19:27:22.607289+0000","last_became_peered":"2021-10-08T19:27:22.607289+0000","last_unstale":"2021-10-08T19:32:00.660151+0000","last_undegraded":"2021-10-08T19:32:00.660151+0000","last_fullsized":"2021-10-08T19:32:00.660151+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:30:52.390639+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:30:52.390639+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020197779999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":267,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:00.660715+0000","last_change":"2021-10-08T19:28:02.942168+0000","last_active":"2021-10-08T19:32:00.660715+0000","last_peered":"2021-10-08T19:32:00.660715+0000","last_clean":"2021-10-08T19:32:00.660715+0000","last_became_active":"2021-10-08T19:21:23.599143+0000","last_became_peered":"2021-10-08T19:21:23.599143+0000","last_unstale":"2021-10-08T19:32:00.660715+0000","last_undegraded":"2021-10-08T19:32:00.660715+0000","last_fullsized":"2021-10-08T19:32:00.660715+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:02.942080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:28:02.942080+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0056165080000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":82,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.742314+0000","last_change":"2021-10-08T19:29:40.639152+0000","last_active":"2021-10-08T19:32:02.742314+0000","last_peered":"2021-10-08T19:32:02.742314+0000","last_clean":"2021-10-08T19:32:02.742314+0000","last_became_active":"2021-10-08T19:29:40.638774+0000","last_became_peered":"2021-10-08T19:29:40.638774+0000","last_unstale":"2021-10-08T19:32:02.742314+0000","last_undegraded":"2021-10-08T19:32:02.742314+0000","last_fullsized":"2021-10-08T19:32:02.742314+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:40.563247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.563247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.024890005999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":279,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:00.661342+0000","last_change":"2021-10-08T19:29:40.627740+0000","last_active":"2021-10-08T19:32:00.661342+0000","last_peered":"2021-10-08T19:32:00.661342+0000","last_clean":"2021-10-08T19:32:00.661342+0000","last_became_active":"2021-10-08T19:29:40.627256+0000","last_became_peered":"2021-10-08T19:29:40.627256+0000","last_unstale":"2021-10-08T19:32:00.661342+0000","last_undegraded":"2021-10-08T19:32:00.661342+0000","last_fullsized":"2021-10-08T19:32:00.661342+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:01.982319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:28:01.982319+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.023009359,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"308'2105","reported_seq":2131,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.970295+0000","last_change":"2021-10-08T19:31:33.859399+0000","last_active":"2021-10-08T19:32:02.970295+0000","last_peered":"2021-10-08T19:32:02.970295+0000","last_clean":"2021-10-08T19:32:02.970295+0000","last_became_active":"2021-10-08T19:31:33.859047+0000","last_became_peered":"2021-10-08T19:31:33.859047+0000","last_unstale":"2021-10-08T19:32:02.970295+0000","last_undegraded":"2021-10-08T19:32:02.970295+0000","last_fullsized":"2021-10-08T19:32:02.970295+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.825378+0000","log_size":2105,"ondisk_log_size":2105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":137953280,"num_objects":2105,"num_object_clones":0,"num_object_copies":6315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2105,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2105,"num_write_kb":134720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"90'130","reported_seq":589,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:00.660182+0000","last_change":"2021-10-08T19:31:26.361738+0000","last_active":"2021-10-08T19:32:00.660182+0000","last_peered":"2021-10-08T19:32:00.660182+0000","last_clean":"2021-10-08T19:32:00.660182+0000","last_became_active":"2021-10-08T19:27:26.591250+0000","last_became_peered":"2021-10-08T19:27:26.591250+0000","last_unstale":"2021-10-08T19:32:00.660182+0000","last_undegraded":"2021-10-08T19:32:00.660182+0000","last_fullsized":"2021-10-08T19:32:00.660182+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:31:26.361659+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:31:26.361659+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0035258939999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":269,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.736016+0000","last_change":"2021-10-08T19:29:56.350839+0000","last_active":"2021-10-08T19:32:02.736016+0000","last_peered":"2021-10-08T19:32:02.736016+0000","last_clean":"2021-10-08T19:32:02.736016+0000","last_became_active":"2021-10-08T19:21:27.637875+0000","last_became_peered":"2021-10-08T19:21:27.637875+0000","last_unstale":"2021-10-08T19:32:02.736016+0000","last_undegraded":"2021-10-08T19:32:02.736016+0000","last_fullsized":"2021-10-08T19:32:02.736016+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:29:56.350687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:29:56.350687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0076571440000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"289'17","reported_seq":29,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.742046+0000","last_change":"2021-10-08T19:31:52.537974+0000","last_active":"2021-10-08T19:32:02.742046+0000","last_peered":"2021-10-08T19:32:02.742046+0000","last_clean":"2021-10-08T19:32:02.742046+0000","last_became_active":"2021-10-08T19:31:51.674965+0000","last_became_peered":"2021-10-08T19:31:51.674965+0000","last_unstale":"2021-10-08T19:32:02.742046+0000","last_undegraded":"2021-10-08T19:32:02.742046+0000","last_fullsized":"2021-10-08T19:32:02.742046+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'13","last_scrub_stamp":"2021-10-08T19:30:33.631279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:30:33.631279+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0041179349999999997,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":23,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":990,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":295,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.735179+0000","last_change":"2021-10-08T19:31:19.482604+0000","last_active":"2021-10-08T19:32:02.735179+0000","last_peered":"2021-10-08T19:32:02.735179+0000","last_clean":"2021-10-08T19:32:02.735179+0000","last_became_active":"2021-10-08T19:29:40.619746+0000","last_became_peered":"2021-10-08T19:29:40.619746+0000","last_unstale":"2021-10-08T19:32:02.735179+0000","last_undegraded":"2021-10-08T19:32:02.735179+0000","last_fullsized":"2021-10-08T19:32:02.735179+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:19.482493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:31:19.482493+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001842977,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"70'5","reported_seq":117,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.741042+0000","last_change":"2021-10-08T19:31:23.522286+0000","last_active":"2021-10-08T19:32:02.741042+0000","last_peered":"2021-10-08T19:32:02.741042+0000","last_clean":"2021-10-08T19:32:02.741042+0000","last_became_active":"2021-10-08T19:28:40.148054+0000","last_became_peered":"2021-10-08T19:28:40.148054+0000","last_unstale":"2021-10-08T19:32:02.741042+0000","last_undegraded":"2021-10-08T19:32:02.741042+0000","last_fullsized":"2021-10-08T19:32:02.741042+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:22:48.239721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:48.239721+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":48,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":298,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:00.661984+0000","last_change":"2021-10-08T19:29:40.653276+0000","last_active":"2021-10-08T19:32:00.661984+0000","last_peered":"2021-10-08T19:32:00.661984+0000","last_clean":"2021-10-08T19:32:00.661984+0000","last_became_active":"2021-10-08T19:29:40.652528+0000","last_became_peered":"2021-10-08T19:29:40.652528+0000","last_unstale":"2021-10-08T19:32:00.661984+0000","last_undegraded":"2021-10-08T19:32:00.661984+0000","last_fullsized":"2021-10-08T19:32:00.661984+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:14.485264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:28:14.485264+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.016729131000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.9","version":"309'2167","reported_seq":2194,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.944928+0000","last_change":"2021-10-08T19:31:33.859282+0000","last_active":"2021-10-08T19:32:03.944928+0000","last_peered":"2021-10-08T19:32:03.944928+0000","last_clean":"2021-10-08T19:32:03.944928+0000","last_became_active":"2021-10-08T19:31:33.858961+0000","last_became_peered":"2021-10-08T19:31:33.858961+0000","last_unstale":"2021-10-08T19:32:03.944928+0000","last_undegraded":"2021-10-08T19:32:03.944928+0000","last_fullsized":"2021-10-08T19:32:03.944928+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.825378+0000","log_size":2167,"ondisk_log_size":2167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":142016512,"num_objects":2167,"num_object_clones":0,"num_object_copies":6501,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2167,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2167,"num_write_kb":138688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,5],"acting":[0,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"90'130","reported_seq":449,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:00.659650+0000","last_change":"2021-10-08T19:31:33.806970+0000","last_active":"2021-10-08T19:32:00.659650+0000","last_peered":"2021-10-08T19:32:00.659650+0000","last_clean":"2021-10-08T19:32:00.659650+0000","last_became_active":"2021-10-08T19:27:26.591993+0000","last_became_peered":"2021-10-08T19:27:26.591993+0000","last_unstale":"2021-10-08T19:32:00.659650+0000","last_undegraded":"2021-10-08T19:32:00.659650+0000","last_fullsized":"2021-10-08T19:32:00.659650+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:31:33.806885+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:31:33.806885+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.00183936,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,2],"acting":[5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":287,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.744073+0000","last_change":"2021-10-08T19:30:03.509440+0000","last_active":"2021-10-08T19:32:02.744073+0000","last_peered":"2021-10-08T19:32:02.744073+0000","last_clean":"2021-10-08T19:32:02.744073+0000","last_became_active":"2021-10-08T19:28:40.133414+0000","last_became_peered":"2021-10-08T19:28:40.133414+0000","last_unstale":"2021-10-08T19:32:02.744073+0000","last_undegraded":"2021-10-08T19:32:02.744073+0000","last_fullsized":"2021-10-08T19:32:02.744073+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:30:03.509345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:30:03.509345+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0030963750000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"289'44","reported_seq":265,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.741981+0000","last_change":"2021-10-08T19:31:22.538332+0000","last_active":"2021-10-08T19:32:02.741981+0000","last_peered":"2021-10-08T19:32:02.741981+0000","last_clean":"2021-10-08T19:32:02.741981+0000","last_became_active":"2021-10-08T19:29:40.626138+0000","last_became_peered":"2021-10-08T19:29:40.626138+0000","last_unstale":"2021-10-08T19:32:02.741981+0000","last_undegraded":"2021-10-08T19:32:02.741981+0000","last_fullsized":"2021-10-08T19:32:02.741981+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"238'32","last_scrub_stamp":"2021-10-08T19:31:22.538245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:31:22.538245+0000","log_size":44,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0029466359999999999,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":65,"num_read_kb":50,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":1432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":303,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:00.660895+0000","last_change":"2021-10-08T19:28:40.138241+0000","last_active":"2021-10-08T19:32:00.660895+0000","last_peered":"2021-10-08T19:32:00.660895+0000","last_clean":"2021-10-08T19:32:00.660895+0000","last_became_active":"2021-10-08T19:28:40.137919+0000","last_became_peered":"2021-10-08T19:28:40.137919+0000","last_unstale":"2021-10-08T19:32:00.660895+0000","last_undegraded":"2021-10-08T19:32:00.660895+0000","last_fullsized":"2021-10-08T19:32:00.660895+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:38.072667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:27:38.072667+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0013248769999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":88,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.742613+0000","last_change":"2021-10-08T19:30:51.432994+0000","last_active":"2021-10-08T19:32:02.742613+0000","last_peered":"2021-10-08T19:32:02.742613+0000","last_clean":"2021-10-08T19:32:02.742613+0000","last_became_active":"2021-10-08T19:29:40.637371+0000","last_became_peered":"2021-10-08T19:29:40.637371+0000","last_unstale":"2021-10-08T19:32:02.742613+0000","last_undegraded":"2021-10-08T19:32:02.742613+0000","last_fullsized":"2021-10-08T19:32:02.742613+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:30:51.432925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:30:51.432925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0033942310000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":230,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.736557+0000","last_change":"2021-10-08T19:31:33.176707+0000","last_active":"2021-10-08T19:32:02.736557+0000","last_peered":"2021-10-08T19:32:02.736557+0000","last_clean":"2021-10-08T19:32:02.736557+0000","last_became_active":"2021-10-08T19:25:14.550690+0000","last_became_peered":"2021-10-08T19:25:14.550690+0000","last_unstale":"2021-10-08T19:32:02.736557+0000","last_undegraded":"2021-10-08T19:32:02.736557+0000","last_fullsized":"2021-10-08T19:32:02.736557+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:33.176641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:31:33.176641+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003389562,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.f","version":"308'2151","reported_seq":2177,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.889336+0000","last_change":"2021-10-08T19:31:33.859774+0000","last_active":"2021-10-08T19:32:02.889336+0000","last_peered":"2021-10-08T19:32:02.889336+0000","last_clean":"2021-10-08T19:32:02.889336+0000","last_became_active":"2021-10-08T19:31:33.859443+0000","last_became_peered":"2021-10-08T19:31:33.859443+0000","last_unstale":"2021-10-08T19:32:02.889336+0000","last_undegraded":"2021-10-08T19:32:02.889336+0000","last_fullsized":"2021-10-08T19:32:02.889336+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.825378+0000","log_size":2151,"ondisk_log_size":2151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":140967936,"num_objects":2151,"num_object_clones":0,"num_object_copies":6453,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2151,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2151,"num_write_kb":137664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"90'130","reported_seq":539,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:00.667661+0000","last_change":"2021-10-08T19:29:43.637236+0000","last_active":"2021-10-08T19:32:00.667661+0000","last_peered":"2021-10-08T19:32:00.667661+0000","last_clean":"2021-10-08T19:32:00.667661+0000","last_became_active":"2021-10-08T19:29:43.636820+0000","last_became_peered":"2021-10-08T19:29:43.636820+0000","last_unstale":"2021-10-08T19:32:00.667661+0000","last_undegraded":"2021-10-08T19:32:00.667661+0000","last_fullsized":"2021-10-08T19:32:00.667661+0000","mapping_epoch":239,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.284249+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0045617870000000003,"stat_sum":{"num_bytes":53670,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":28,"num_write":16,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":214679,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"114'10","reported_seq":436,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.743368+0000","last_change":"2021-10-08T19:31:36.352904+0000","last_active":"2021-10-08T19:32:02.743368+0000","last_peered":"2021-10-08T19:32:02.743368+0000","last_clean":"2021-10-08T19:32:02.743368+0000","last_became_active":"2021-10-08T19:24:25.106695+0000","last_became_peered":"2021-10-08T19:24:25.106695+0000","last_unstale":"2021-10-08T19:32:02.743368+0000","last_undegraded":"2021-10-08T19:32:02.743368+0000","last_fullsized":"2021-10-08T19:32:02.743368+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'10","last_scrub_stamp":"2021-10-08T19:31:36.352823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:31:36.352823+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002738304,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"289'20","reported_seq":29,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.741505+0000","last_change":"2021-10-08T19:31:51.685841+0000","last_active":"2021-10-08T19:32:02.741505+0000","last_peered":"2021-10-08T19:32:02.741505+0000","last_clean":"2021-10-08T19:32:02.741505+0000","last_became_active":"2021-10-08T19:31:51.675569+0000","last_became_peered":"2021-10-08T19:31:51.675569+0000","last_unstale":"2021-10-08T19:32:02.741505+0000","last_undegraded":"2021-10-08T19:32:02.741505+0000","last_fullsized":"2021-10-08T19:32:02.741505+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'10","last_scrub_stamp":"2021-10-08T19:31:25.918199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:31:25.918199+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0047431189999999996,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":23,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":121,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.741810+0000","last_change":"2021-10-08T19:30:10.100186+0000","last_active":"2021-10-08T19:32:02.741810+0000","last_peered":"2021-10-08T19:32:02.741810+0000","last_clean":"2021-10-08T19:32:02.741810+0000","last_became_active":"2021-10-08T19:28:40.141737+0000","last_became_peered":"2021-10-08T19:28:40.141737+0000","last_unstale":"2021-10-08T19:32:02.741810+0000","last_undegraded":"2021-10-08T19:32:02.741810+0000","last_fullsized":"2021-10-08T19:32:02.741810+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:30:10.100078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:30:10.100078+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.016761485,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":283,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.737411+0000","last_change":"2021-10-08T19:30:42.371033+0000","last_active":"2021-10-08T19:32:02.737411+0000","last_peered":"2021-10-08T19:32:02.737411+0000","last_clean":"2021-10-08T19:32:02.737411+0000","last_became_active":"2021-10-08T19:29:40.643614+0000","last_became_peered":"2021-10-08T19:29:40.643614+0000","last_unstale":"2021-10-08T19:32:02.737411+0000","last_undegraded":"2021-10-08T19:32:02.737411+0000","last_fullsized":"2021-10-08T19:32:02.737411+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:38.333135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:27:38.333135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.006947773,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":243,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:00.661212+0000","last_change":"2021-10-08T19:29:40.627400+0000","last_active":"2021-10-08T19:32:00.661212+0000","last_peered":"2021-10-08T19:32:00.661212+0000","last_clean":"2021-10-08T19:32:00.661212+0000","last_became_active":"2021-10-08T19:29:40.626998+0000","last_became_peered":"2021-10-08T19:29:40.626998+0000","last_unstale":"2021-10-08T19:32:00.661212+0000","last_undegraded":"2021-10-08T19:32:00.661212+0000","last_fullsized":"2021-10-08T19:32:00.661212+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:17.379559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:17.379559+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0052805589999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.4","version":"309'2177","reported_seq":2203,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.965043+0000","last_change":"2021-10-08T19:31:33.861845+0000","last_active":"2021-10-08T19:32:03.965043+0000","last_peered":"2021-10-08T19:32:03.965043+0000","last_clean":"2021-10-08T19:32:03.965043+0000","last_became_active":"2021-10-08T19:31:33.861531+0000","last_became_peered":"2021-10-08T19:31:33.861531+0000","last_unstale":"2021-10-08T19:32:03.965043+0000","last_undegraded":"2021-10-08T19:32:03.965043+0000","last_fullsized":"2021-10-08T19:32:03.965043+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.825378+0000","log_size":2177,"ondisk_log_size":2177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":142671872,"num_objects":2177,"num_object_clones":0,"num_object_copies":6531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2177,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2177,"num_write_kb":139328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":289,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.736757+0000","last_change":"2021-10-08T19:31:27.419619+0000","last_active":"2021-10-08T19:32:02.736757+0000","last_peered":"2021-10-08T19:32:02.736757+0000","last_clean":"2021-10-08T19:32:02.736757+0000","last_became_active":"2021-10-08T19:28:40.138726+0000","last_became_peered":"2021-10-08T19:28:40.138726+0000","last_unstale":"2021-10-08T19:32:02.736757+0000","last_undegraded":"2021-10-08T19:32:02.736757+0000","last_fullsized":"2021-10-08T19:32:02.736757+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:27.419545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:50.435552+0000","last_clean_scrub_stamp":"2021-10-08T19:31:27.419545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001436466,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"289'18","reported_seq":382,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.735659+0000","last_change":"2021-10-08T19:30:08.410079+0000","last_active":"2021-10-08T19:32:02.735659+0000","last_peered":"2021-10-08T19:32:02.735659+0000","last_clean":"2021-10-08T19:32:02.735659+0000","last_became_active":"2021-10-08T19:29:40.638957+0000","last_became_peered":"2021-10-08T19:29:40.638957+0000","last_unstale":"2021-10-08T19:32:02.735659+0000","last_undegraded":"2021-10-08T19:32:02.735659+0000","last_fullsized":"2021-10-08T19:32:02.735659+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'12","last_scrub_stamp":"2021-10-08T19:30:08.409964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:30:08.409964+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.007590439,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":25,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"61'2","reported_seq":284,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.738306+0000","last_change":"2021-10-08T19:30:00.378019+0000","last_active":"2021-10-08T19:32:02.738306+0000","last_peered":"2021-10-08T19:32:02.738306+0000","last_clean":"2021-10-08T19:32:02.738306+0000","last_became_active":"2021-10-08T19:21:23.603614+0000","last_became_peered":"2021-10-08T19:21:23.603614+0000","last_unstale":"2021-10-08T19:32:02.738306+0000","last_undegraded":"2021-10-08T19:32:02.738306+0000","last_fullsized":"2021-10-08T19:32:02.738306+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'2","last_scrub_stamp":"2021-10-08T19:30:00.377909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:30:00.377909+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.006990802,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":88,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.743188+0000","last_change":"2021-10-08T19:31:29.506433+0000","last_active":"2021-10-08T19:32:02.743188+0000","last_peered":"2021-10-08T19:32:02.743188+0000","last_clean":"2021-10-08T19:32:02.743188+0000","last_became_active":"2021-10-08T19:29:40.645211+0000","last_became_peered":"2021-10-08T19:29:40.645211+0000","last_unstale":"2021-10-08T19:32:02.743188+0000","last_undegraded":"2021-10-08T19:32:02.743188+0000","last_fullsized":"2021-10-08T19:32:02.743188+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:29.506331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:31:29.506331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.042894232999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":209,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:00.660634+0000","last_change":"2021-10-08T19:31:29.399846+0000","last_active":"2021-10-08T19:32:00.660634+0000","last_peered":"2021-10-08T19:32:00.660634+0000","last_clean":"2021-10-08T19:32:00.660634+0000","last_became_active":"2021-10-08T19:28:40.100770+0000","last_became_peered":"2021-10-08T19:28:40.100770+0000","last_unstale":"2021-10-08T19:32:00.660634+0000","last_undegraded":"2021-10-08T19:32:00.660634+0000","last_fullsized":"2021-10-08T19:32:00.660634+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:29.399771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:31:29.399771+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001424972,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"289'15","reported_seq":336,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.743068+0000","last_change":"2021-10-08T19:30:08.617709+0000","last_active":"2021-10-08T19:32:02.743068+0000","last_peered":"2021-10-08T19:32:02.743068+0000","last_clean":"2021-10-08T19:32:02.743068+0000","last_became_active":"2021-10-08T19:29:40.644354+0000","last_became_peered":"2021-10-08T19:29:40.644354+0000","last_unstale":"2021-10-08T19:32:02.743068+0000","last_undegraded":"2021-10-08T19:32:02.743068+0000","last_fullsized":"2021-10-08T19:32:02.743068+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'9","last_scrub_stamp":"2021-10-08T19:30:08.617590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:30:08.617590+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012646054,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":297,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.736682+0000","last_change":"2021-10-08T19:29:58.278063+0000","last_active":"2021-10-08T19:32:02.736682+0000","last_peered":"2021-10-08T19:32:02.736682+0000","last_clean":"2021-10-08T19:32:02.736682+0000","last_became_active":"2021-10-08T19:28:40.139234+0000","last_became_peered":"2021-10-08T19:28:40.139234+0000","last_unstale":"2021-10-08T19:32:02.736682+0000","last_undegraded":"2021-10-08T19:32:02.736682+0000","last_fullsized":"2021-10-08T19:32:02.736682+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:29:58.277981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:29:58.277981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001389567,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":82,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.745565+0000","last_change":"2021-10-08T19:29:40.645526+0000","last_active":"2021-10-08T19:32:02.745565+0000","last_peered":"2021-10-08T19:32:02.745565+0000","last_clean":"2021-10-08T19:32:02.745565+0000","last_became_active":"2021-10-08T19:29:40.645111+0000","last_became_peered":"2021-10-08T19:29:40.645111+0000","last_unstale":"2021-10-08T19:32:02.745565+0000","last_undegraded":"2021-10-08T19:32:02.745565+0000","last_fullsized":"2021-10-08T19:32:02.745565+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:03.149594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:28:03.149594+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011094171,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":267,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.735442+0000","last_change":"2021-10-08T19:31:59.493049+0000","last_active":"2021-10-08T19:32:02.735442+0000","last_peered":"2021-10-08T19:32:02.735442+0000","last_clean":"2021-10-08T19:32:02.735442+0000","last_became_active":"2021-10-08T19:21:29.640674+0000","last_became_peered":"2021-10-08T19:21:29.640674+0000","last_unstale":"2021-10-08T19:32:02.735442+0000","last_undegraded":"2021-10-08T19:32:02.735442+0000","last_fullsized":"2021-10-08T19:32:02.735442+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:05.869774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:24:05.869774+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0041453820000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":195,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:00.661849+0000","last_change":"2021-10-08T19:30:08.014575+0000","last_active":"2021-10-08T19:32:00.661849+0000","last_peered":"2021-10-08T19:32:00.661849+0000","last_clean":"2021-10-08T19:32:00.661849+0000","last_became_active":"2021-10-08T19:25:15.501118+0000","last_became_peered":"2021-10-08T19:25:15.501118+0000","last_unstale":"2021-10-08T19:32:00.661849+0000","last_undegraded":"2021-10-08T19:32:00.661849+0000","last_fullsized":"2021-10-08T19:32:00.661849+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:30:08.014477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:30:08.014477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0025301999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"289'12","reported_seq":105,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.745415+0000","last_change":"2021-10-08T19:30:10.167940+0000","last_active":"2021-10-08T19:32:02.745415+0000","last_peered":"2021-10-08T19:32:02.745415+0000","last_clean":"2021-10-08T19:32:02.745415+0000","last_became_active":"2021-10-08T19:29:40.644657+0000","last_became_peered":"2021-10-08T19:29:40.644657+0000","last_unstale":"2021-10-08T19:32:02.745415+0000","last_undegraded":"2021-10-08T19:32:02.745415+0000","last_fullsized":"2021-10-08T19:32:02.745415+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'6","last_scrub_stamp":"2021-10-08T19:30:10.167848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:30:10.167848+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0085589310000000005,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":18,"num_read_kb":15,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":228,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:00.666911+0000","last_change":"2021-10-08T19:28:40.102224+0000","last_active":"2021-10-08T19:32:00.666911+0000","last_peered":"2021-10-08T19:32:00.666911+0000","last_clean":"2021-10-08T19:32:00.666911+0000","last_became_active":"2021-10-08T19:28:40.101898+0000","last_became_peered":"2021-10-08T19:28:40.101898+0000","last_unstale":"2021-10-08T19:32:00.666911+0000","last_undegraded":"2021-10-08T19:32:00.666911+0000","last_fullsized":"2021-10-08T19:32:00.666911+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:16.444582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:16.444582+0000","last_clean_scrub_stamp":"2021-10-08T19:28:16.444582+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0044375919999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":305,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:00.660186+0000","last_change":"2021-10-08T19:31:28.844816+0000","last_active":"2021-10-08T19:32:00.660186+0000","last_peered":"2021-10-08T19:32:00.660186+0000","last_clean":"2021-10-08T19:32:00.660186+0000","last_became_active":"2021-10-08T19:29:40.626950+0000","last_became_peered":"2021-10-08T19:29:40.626950+0000","last_unstale":"2021-10-08T19:32:00.660186+0000","last_undegraded":"2021-10-08T19:32:00.660186+0000","last_fullsized":"2021-10-08T19:32:00.660186+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:28.844749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:31:28.844749+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034600469999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":286,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:00.661493+0000","last_change":"2021-10-08T19:28:15.480476+0000","last_active":"2021-10-08T19:32:00.661493+0000","last_peered":"2021-10-08T19:32:00.661493+0000","last_clean":"2021-10-08T19:32:00.661493+0000","last_became_active":"2021-10-08T19:24:25.099371+0000","last_became_peered":"2021-10-08T19:24:25.099371+0000","last_unstale":"2021-10-08T19:32:00.661493+0000","last_undegraded":"2021-10-08T19:32:00.661493+0000","last_fullsized":"2021-10-08T19:32:00.661493+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:15.480374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:28:15.480374+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0076754220000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"70'5","reported_seq":463,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:00.666557+0000","last_change":"2021-10-08T19:31:22.785527+0000","last_active":"2021-10-08T19:32:00.666557+0000","last_peered":"2021-10-08T19:32:00.666557+0000","last_clean":"2021-10-08T19:32:00.666557+0000","last_became_active":"2021-10-08T19:31:22.785193+0000","last_became_peered":"2021-10-08T19:31:22.785193+0000","last_unstale":"2021-10-08T19:32:00.666557+0000","last_undegraded":"2021-10-08T19:32:00.666557+0000","last_fullsized":"2021-10-08T19:32:00.666557+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":5,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:29:55.412427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:29:55.412427+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0052984640000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"289'20","reported_seq":151,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.745544+0000","last_change":"2021-10-08T19:31:52.109105+0000","last_active":"2021-10-08T19:32:02.745544+0000","last_peered":"2021-10-08T19:32:02.745544+0000","last_clean":"2021-10-08T19:32:02.745544+0000","last_became_active":"2021-10-08T19:31:51.677055+0000","last_became_peered":"2021-10-08T19:31:51.677055+0000","last_unstale":"2021-10-08T19:32:02.745544+0000","last_undegraded":"2021-10-08T19:32:02.745544+0000","last_fullsized":"2021-10-08T19:32:02.745544+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'10","last_scrub_stamp":"2021-10-08T19:28:03.073833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:28:03.073833+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0061927040000000003,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":291,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:00.660855+0000","last_change":"2021-10-08T19:31:30.802257+0000","last_active":"2021-10-08T19:32:00.660855+0000","last_peered":"2021-10-08T19:32:00.660855+0000","last_clean":"2021-10-08T19:32:00.660855+0000","last_became_active":"2021-10-08T19:29:40.631331+0000","last_became_peered":"2021-10-08T19:29:40.631331+0000","last_unstale":"2021-10-08T19:32:00.660855+0000","last_undegraded":"2021-10-08T19:32:00.660855+0000","last_fullsized":"2021-10-08T19:32:00.660855+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:30.802102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:31:30.802102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0025761069999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"203'10","reported_seq":432,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:01.847749+0000","last_change":"2021-10-08T19:29:59.469071+0000","last_active":"2021-10-08T19:32:01.847749+0000","last_peered":"2021-10-08T19:32:01.847749+0000","last_clean":"2021-10-08T19:32:01.847749+0000","last_became_active":"2021-10-08T19:28:40.138031+0000","last_became_peered":"2021-10-08T19:28:40.138031+0000","last_unstale":"2021-10-08T19:32:01.847749+0000","last_undegraded":"2021-10-08T19:32:01.847749+0000","last_fullsized":"2021-10-08T19:32:01.847749+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"203'10","last_scrub_stamp":"2021-10-08T19:29:59.468960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:29:59.468960+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0085427560000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":283,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.742898+0000","last_change":"2021-10-08T19:30:09.616674+0000","last_active":"2021-10-08T19:32:02.742898+0000","last_peered":"2021-10-08T19:32:02.742898+0000","last_clean":"2021-10-08T19:32:02.742898+0000","last_became_active":"2021-10-08T19:29:40.644819+0000","last_became_peered":"2021-10-08T19:29:40.644819+0000","last_unstale":"2021-10-08T19:32:02.742898+0000","last_undegraded":"2021-10-08T19:32:02.742898+0000","last_fullsized":"2021-10-08T19:32:02.742898+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:30:09.616582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:30:09.616582+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.027759294,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":191,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:00.661529+0000","last_change":"2021-10-08T19:28:16.470287+0000","last_active":"2021-10-08T19:32:00.661529+0000","last_peered":"2021-10-08T19:32:00.661529+0000","last_clean":"2021-10-08T19:32:00.661529+0000","last_became_active":"2021-10-08T19:25:15.498770+0000","last_became_peered":"2021-10-08T19:25:15.498770+0000","last_unstale":"2021-10-08T19:32:00.661529+0000","last_undegraded":"2021-10-08T19:32:00.661529+0000","last_fullsized":"2021-10-08T19:32:00.661529+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:16.470205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:28:16.470205+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0078687189999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"289'15","reported_seq":53,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:00.661170+0000","last_change":"2021-10-08T19:31:23.478333+0000","last_active":"2021-10-08T19:32:00.661170+0000","last_peered":"2021-10-08T19:32:00.661170+0000","last_clean":"2021-10-08T19:32:00.661170+0000","last_became_active":"2021-10-08T19:31:22.786860+0000","last_became_peered":"2021-10-08T19:31:22.786860+0000","last_unstale":"2021-10-08T19:32:00.661170+0000","last_undegraded":"2021-10-08T19:32:00.661170+0000","last_fullsized":"2021-10-08T19:32:00.661170+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'9","last_scrub_stamp":"2021-10-08T19:30:03.413860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:30:03.413860+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0047281429999999998,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":297,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.743184+0000","last_change":"2021-10-08T19:30:11.526475+0000","last_active":"2021-10-08T19:32:02.743184+0000","last_peered":"2021-10-08T19:32:02.743184+0000","last_clean":"2021-10-08T19:32:02.743184+0000","last_became_active":"2021-10-08T19:29:44.439397+0000","last_became_peered":"2021-10-08T19:29:44.439397+0000","last_unstale":"2021-10-08T19:32:02.743184+0000","last_undegraded":"2021-10-08T19:32:02.743184+0000","last_fullsized":"2021-10-08T19:32:02.743184+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:30:11.526373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:30:11.526373+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0041020379999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"238'10","reported_seq":121,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.745512+0000","last_change":"2021-10-08T19:31:28.463646+0000","last_active":"2021-10-08T19:32:02.745512+0000","last_peered":"2021-10-08T19:32:02.745512+0000","last_clean":"2021-10-08T19:32:02.745512+0000","last_became_active":"2021-10-08T19:29:40.637650+0000","last_became_peered":"2021-10-08T19:29:40.637650+0000","last_unstale":"2021-10-08T19:32:02.745512+0000","last_undegraded":"2021-10-08T19:32:02.745512+0000","last_fullsized":"2021-10-08T19:32:02.745512+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"238'10","last_scrub_stamp":"2021-10-08T19:31:28.463544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:31:28.463544+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040229419999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":262,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.738628+0000","last_change":"2021-10-08T19:30:04.435933+0000","last_active":"2021-10-08T19:32:02.738628+0000","last_peered":"2021-10-08T19:32:02.738628+0000","last_clean":"2021-10-08T19:32:02.738628+0000","last_became_active":"2021-10-08T19:21:29.640302+0000","last_became_peered":"2021-10-08T19:21:29.640302+0000","last_unstale":"2021-10-08T19:32:02.738628+0000","last_undegraded":"2021-10-08T19:32:02.738628+0000","last_fullsized":"2021-10-08T19:32:02.738628+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:30:04.435814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:30:04.435814+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.035423228000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":204,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.737616+0000","last_change":"2021-10-08T19:29:40.631719+0000","last_active":"2021-10-08T19:32:02.737616+0000","last_peered":"2021-10-08T19:32:02.737616+0000","last_clean":"2021-10-08T19:32:02.737616+0000","last_became_active":"2021-10-08T19:29:40.631374+0000","last_became_peered":"2021-10-08T19:29:40.631374+0000","last_unstale":"2021-10-08T19:32:02.737616+0000","last_undegraded":"2021-10-08T19:32:02.737616+0000","last_fullsized":"2021-10-08T19:32:02.737616+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:40.563247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.563247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.024890005999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":207,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:00.661430+0000","last_change":"2021-10-08T19:29:40.653447+0000","last_active":"2021-10-08T19:32:00.661430+0000","last_peered":"2021-10-08T19:32:00.661430+0000","last_clean":"2021-10-08T19:32:00.661430+0000","last_became_active":"2021-10-08T19:29:40.652966+0000","last_became_peered":"2021-10-08T19:29:40.652966+0000","last_unstale":"2021-10-08T19:32:00.661430+0000","last_undegraded":"2021-10-08T19:32:00.661430+0000","last_fullsized":"2021-10-08T19:32:00.661430+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:17.379559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:17.379559+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0090469920000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"289'19","reported_seq":27,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.741232+0000","last_change":"2021-10-08T19:31:51.688430+0000","last_active":"2021-10-08T19:32:02.741232+0000","last_peered":"2021-10-08T19:32:02.741232+0000","last_clean":"2021-10-08T19:32:02.741232+0000","last_became_active":"2021-10-08T19:31:51.676961+0000","last_became_peered":"2021-10-08T19:31:51.676961+0000","last_unstale":"2021-10-08T19:32:02.741232+0000","last_undegraded":"2021-10-08T19:32:02.741232+0000","last_fullsized":"2021-10-08T19:32:02.741232+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'13","last_scrub_stamp":"2021-10-08T19:29:40.212476+0000","last_deep_scrub":"87'13","last_deep_scrub_stamp":"2021-10-08T19:22:53.263631+0000","last_clean_scrub_stamp":"2021-10-08T19:29:40.212476+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0036954140000000002,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":246,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:00.666797+0000","last_change":"2021-10-08T19:31:22.787014+0000","last_active":"2021-10-08T19:32:00.666797+0000","last_peered":"2021-10-08T19:32:00.666797+0000","last_clean":"2021-10-08T19:32:00.666797+0000","last_became_active":"2021-10-08T19:31:22.786651+0000","last_became_peered":"2021-10-08T19:31:22.786651+0000","last_unstale":"2021-10-08T19:32:00.666797+0000","last_undegraded":"2021-10-08T19:32:00.666797+0000","last_fullsized":"2021-10-08T19:32:00.666797+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:09.389812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:28:09.389812+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0046254870000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":88,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.744821+0000","last_change":"2021-10-08T19:30:32.411026+0000","last_active":"2021-10-08T19:32:02.744821+0000","last_peered":"2021-10-08T19:32:02.744821+0000","last_clean":"2021-10-08T19:32:02.744821+0000","last_became_active":"2021-10-08T19:29:40.644770+0000","last_became_peered":"2021-10-08T19:29:40.644770+0000","last_unstale":"2021-10-08T19:32:02.744821+0000","last_undegraded":"2021-10-08T19:32:02.744821+0000","last_fullsized":"2021-10-08T19:32:02.744821+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:30:32.410928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:30:32.410928+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003423953,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":285,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.737308+0000","last_change":"2021-10-08T19:30:05.545791+0000","last_active":"2021-10-08T19:32:02.737308+0000","last_peered":"2021-10-08T19:32:02.737308+0000","last_clean":"2021-10-08T19:32:02.737308+0000","last_became_active":"2021-10-08T19:28:40.133744+0000","last_became_peered":"2021-10-08T19:28:40.133744+0000","last_unstale":"2021-10-08T19:32:02.737308+0000","last_undegraded":"2021-10-08T19:32:02.737308+0000","last_fullsized":"2021-10-08T19:32:02.737308+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:30:05.545680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:30:05.545680+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014834386999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"289'19","reported_seq":422,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.736490+0000","last_change":"2021-10-08T19:31:36.253886+0000","last_active":"2021-10-08T19:32:02.736490+0000","last_peered":"2021-10-08T19:32:02.736490+0000","last_clean":"2021-10-08T19:32:02.736490+0000","last_became_active":"2021-10-08T19:28:40.100196+0000","last_became_peered":"2021-10-08T19:28:40.100196+0000","last_unstale":"2021-10-08T19:32:02.736490+0000","last_undegraded":"2021-10-08T19:32:02.736490+0000","last_fullsized":"2021-10-08T19:32:02.736490+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:31:36.253813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:31:36.253813+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039657879999999996,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":123,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.742827+0000","last_change":"2021-10-08T19:30:32.260526+0000","last_active":"2021-10-08T19:32:02.742827+0000","last_peered":"2021-10-08T19:32:02.742827+0000","last_clean":"2021-10-08T19:32:02.742827+0000","last_became_active":"2021-10-08T19:28:40.146673+0000","last_became_peered":"2021-10-08T19:28:40.146673+0000","last_unstale":"2021-10-08T19:32:02.742827+0000","last_undegraded":"2021-10-08T19:32:02.742827+0000","last_fullsized":"2021-10-08T19:32:02.742827+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:30:32.260440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:30:32.260440+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034384390000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":133,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.741573+0000","last_change":"2021-10-08T19:29:40.639305+0000","last_active":"2021-10-08T19:32:02.741573+0000","last_peered":"2021-10-08T19:32:02.741573+0000","last_clean":"2021-10-08T19:32:02.741573+0000","last_became_active":"2021-10-08T19:29:40.638536+0000","last_became_peered":"2021-10-08T19:29:40.638536+0000","last_unstale":"2021-10-08T19:32:02.741573+0000","last_undegraded":"2021-10-08T19:32:02.741573+0000","last_fullsized":"2021-10-08T19:32:02.741573+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:00.640354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:43.186684+0000","last_clean_scrub_stamp":"2021-10-08T19:28:00.640354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":82,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.744386+0000","last_change":"2021-10-08T19:29:40.634604+0000","last_active":"2021-10-08T19:32:02.744386+0000","last_peered":"2021-10-08T19:32:02.744386+0000","last_clean":"2021-10-08T19:32:02.744386+0000","last_became_active":"2021-10-08T19:29:40.634300+0000","last_became_peered":"2021-10-08T19:29:40.634300+0000","last_unstale":"2021-10-08T19:32:02.744386+0000","last_undegraded":"2021-10-08T19:32:02.744386+0000","last_fullsized":"2021-10-08T19:32:02.744386+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:10.199698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:28:10.199698+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"70'5","reported_seq":192,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.737374+0000","last_change":"2021-10-08T19:30:51.369762+0000","last_active":"2021-10-08T19:32:02.737374+0000","last_peered":"2021-10-08T19:32:02.737374+0000","last_clean":"2021-10-08T19:32:02.737374+0000","last_became_active":"2021-10-08T19:25:15.496309+0000","last_became_peered":"2021-10-08T19:25:15.496309+0000","last_unstale":"2021-10-08T19:32:02.737374+0000","last_undegraded":"2021-10-08T19:32:02.737374+0000","last_fullsized":"2021-10-08T19:32:02.737374+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:30:51.369695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:30:51.369695+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034182739999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.10","version":"289'8","reported_seq":96,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.740712+0000","last_change":"2021-10-08T19:32:00.371046+0000","last_active":"2021-10-08T19:32:02.740712+0000","last_peered":"2021-10-08T19:32:02.740712+0000","last_clean":"2021-10-08T19:32:02.740712+0000","last_became_active":"2021-10-08T19:29:40.646031+0000","last_became_peered":"2021-10-08T19:29:40.646031+0000","last_unstale":"2021-10-08T19:32:02.740712+0000","last_undegraded":"2021-10-08T19:32:02.740712+0000","last_fullsized":"2021-10-08T19:32:02.740712+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'4","last_scrub_stamp":"2021-10-08T19:27:38.084136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:27:38.084136+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040040570000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":291,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:00.660379+0000","last_change":"2021-10-08T19:31:27.832981+0000","last_active":"2021-10-08T19:32:00.660379+0000","last_peered":"2021-10-08T19:32:00.660379+0000","last_clean":"2021-10-08T19:32:00.660379+0000","last_became_active":"2021-10-08T19:24:25.094384+0000","last_became_peered":"2021-10-08T19:24:25.094384+0000","last_unstale":"2021-10-08T19:32:00.660379+0000","last_undegraded":"2021-10-08T19:32:00.660379+0000","last_fullsized":"2021-10-08T19:32:00.660379+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:27.832886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:13.716331+0000","last_clean_scrub_stamp":"2021-10-08T19:31:27.832886+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034204959999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":219,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:00.666979+0000","last_change":"2021-10-08T19:31:26.648140+0000","last_active":"2021-10-08T19:32:00.666979+0000","last_peered":"2021-10-08T19:32:00.666979+0000","last_clean":"2021-10-08T19:32:00.666979+0000","last_became_active":"2021-10-08T19:24:25.106186+0000","last_became_peered":"2021-10-08T19:24:25.106186+0000","last_unstale":"2021-10-08T19:32:00.666979+0000","last_undegraded":"2021-10-08T19:32:00.666979+0000","last_fullsized":"2021-10-08T19:32:00.666979+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:26.648030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:31:26.648030+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001771297,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":270,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:00.660267+0000","last_change":"2021-10-08T19:30:12.068716+0000","last_active":"2021-10-08T19:32:00.660267+0000","last_peered":"2021-10-08T19:32:00.660267+0000","last_clean":"2021-10-08T19:32:00.660267+0000","last_became_active":"2021-10-08T19:21:29.642835+0000","last_became_peered":"2021-10-08T19:21:29.642835+0000","last_unstale":"2021-10-08T19:32:00.660267+0000","last_undegraded":"2021-10-08T19:32:00.660267+0000","last_fullsized":"2021-10-08T19:32:00.660267+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:30:12.068596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:30:12.068596+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0051914689999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":203,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:00.660115+0000","last_change":"2021-10-08T19:28:40.099565+0000","last_active":"2021-10-08T19:32:00.660115+0000","last_peered":"2021-10-08T19:32:00.660115+0000","last_clean":"2021-10-08T19:32:00.660115+0000","last_became_active":"2021-10-08T19:28:40.099215+0000","last_became_peered":"2021-10-08T19:28:40.099215+0000","last_unstale":"2021-10-08T19:32:00.660115+0000","last_undegraded":"2021-10-08T19:32:00.660115+0000","last_fullsized":"2021-10-08T19:32:00.660115+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:40.563247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.563247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.024890005999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"289'19","reported_seq":112,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.744403+0000","last_change":"2021-10-08T19:31:23.525281+0000","last_active":"2021-10-08T19:32:02.744403+0000","last_peered":"2021-10-08T19:32:02.744403+0000","last_clean":"2021-10-08T19:32:02.744403+0000","last_became_active":"2021-10-08T19:29:40.640914+0000","last_became_peered":"2021-10-08T19:29:40.640914+0000","last_unstale":"2021-10-08T19:32:02.744403+0000","last_undegraded":"2021-10-08T19:32:02.744403+0000","last_fullsized":"2021-10-08T19:32:02.744403+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'11","last_scrub_stamp":"2021-10-08T19:31:23.525209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:31:23.525209+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039841909999999998,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":216,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:00.667744+0000","last_change":"2021-10-08T19:31:33.790422+0000","last_active":"2021-10-08T19:32:00.667744+0000","last_peered":"2021-10-08T19:32:00.667744+0000","last_clean":"2021-10-08T19:32:00.667744+0000","last_became_active":"2021-10-08T19:24:25.098128+0000","last_became_peered":"2021-10-08T19:24:25.098128+0000","last_unstale":"2021-10-08T19:32:00.667744+0000","last_undegraded":"2021-10-08T19:32:00.667744+0000","last_fullsized":"2021-10-08T19:32:00.667744+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:33.790341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:34.508558+0000","last_clean_scrub_stamp":"2021-10-08T19:31:33.790341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0017527389999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":282,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:00.660478+0000","last_change":"2021-10-08T19:28:11.383850+0000","last_active":"2021-10-08T19:32:00.660478+0000","last_peered":"2021-10-08T19:32:00.660478+0000","last_clean":"2021-10-08T19:32:00.660478+0000","last_became_active":"2021-10-08T19:24:25.095490+0000","last_became_peered":"2021-10-08T19:24:25.095490+0000","last_unstale":"2021-10-08T19:32:00.660478+0000","last_undegraded":"2021-10-08T19:32:00.660478+0000","last_fullsized":"2021-10-08T19:32:00.660478+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:11.383779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:11.383779+0000","last_clean_scrub_stamp":"2021-10-08T19:28:11.383779+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001362776,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":88,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.743458+0000","last_change":"2021-10-08T19:30:05.170118+0000","last_active":"2021-10-08T19:32:02.743458+0000","last_peered":"2021-10-08T19:32:02.743458+0000","last_clean":"2021-10-08T19:32:02.743458+0000","last_became_active":"2021-10-08T19:29:40.639358+0000","last_became_peered":"2021-10-08T19:29:40.639358+0000","last_unstale":"2021-10-08T19:32:02.743458+0000","last_undegraded":"2021-10-08T19:32:02.743458+0000","last_fullsized":"2021-10-08T19:32:02.743458+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:30:05.170003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:30:05.170003+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.031854517999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"289'20","reported_seq":347,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.743261+0000","last_change":"2021-10-08T19:31:31.440537+0000","last_active":"2021-10-08T19:32:02.743261+0000","last_peered":"2021-10-08T19:32:02.743261+0000","last_clean":"2021-10-08T19:32:02.743261+0000","last_became_active":"2021-10-08T19:29:40.636448+0000","last_became_peered":"2021-10-08T19:29:40.636448+0000","last_unstale":"2021-10-08T19:32:02.743261+0000","last_undegraded":"2021-10-08T19:32:02.743261+0000","last_fullsized":"2021-10-08T19:32:02.743261+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'10","last_scrub_stamp":"2021-10-08T19:31:31.440458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:31:31.440458+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0022868239999999998,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":267,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:00.661951+0000","last_change":"2021-10-08T19:28:15.902997+0000","last_active":"2021-10-08T19:32:00.661951+0000","last_peered":"2021-10-08T19:32:00.661951+0000","last_clean":"2021-10-08T19:32:00.661951+0000","last_became_active":"2021-10-08T19:21:23.604530+0000","last_became_peered":"2021-10-08T19:21:23.604530+0000","last_unstale":"2021-10-08T19:32:00.661951+0000","last_undegraded":"2021-10-08T19:32:00.661951+0000","last_fullsized":"2021-10-08T19:32:00.661951+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:15.902892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:28:15.902892+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0029135179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1f","version":"114'10","reported_seq":306,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:01.848546+0000","last_change":"2021-10-08T19:29:58.479868+0000","last_active":"2021-10-08T19:32:01.848546+0000","last_peered":"2021-10-08T19:32:01.848546+0000","last_clean":"2021-10-08T19:32:01.848546+0000","last_became_active":"2021-10-08T19:24:25.105742+0000","last_became_peered":"2021-10-08T19:24:25.105742+0000","last_unstale":"2021-10-08T19:32:01.848546+0000","last_undegraded":"2021-10-08T19:32:01.848546+0000","last_fullsized":"2021-10-08T19:32:01.848546+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'10","last_scrub_stamp":"2021-10-08T19:29:58.479782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:29:58.479782+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0016138999999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"69'1","reported_seq":269,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:00.661312+0000","last_change":"2021-10-08T19:31:36.328498+0000","last_active":"2021-10-08T19:32:00.661312+0000","last_peered":"2021-10-08T19:32:00.661312+0000","last_clean":"2021-10-08T19:32:00.661312+0000","last_became_active":"2021-10-08T19:21:29.640296+0000","last_became_peered":"2021-10-08T19:21:29.640296+0000","last_unstale":"2021-10-08T19:32:00.661312+0000","last_undegraded":"2021-10-08T19:32:00.661312+0000","last_fullsized":"2021-10-08T19:32:00.661312+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2021-10-08T19:31:36.328401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:31:36.328401+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040870780000000001,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"289'19","reported_seq":282,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:00.668038+0000","last_change":"2021-10-08T19:31:35.715486+0000","last_active":"2021-10-08T19:32:00.668038+0000","last_peered":"2021-10-08T19:32:00.668038+0000","last_clean":"2021-10-08T19:32:00.668038+0000","last_became_active":"2021-10-08T19:28:40.126425+0000","last_became_peered":"2021-10-08T19:28:40.126425+0000","last_unstale":"2021-10-08T19:32:00.668038+0000","last_undegraded":"2021-10-08T19:32:00.668038+0000","last_fullsized":"2021-10-08T19:32:00.668038+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:31:35.715402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:31:35.715402+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003242928,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":88,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.744314+0000","last_change":"2021-10-08T19:31:24.567662+0000","last_active":"2021-10-08T19:32:02.744314+0000","last_peered":"2021-10-08T19:32:02.744314+0000","last_clean":"2021-10-08T19:32:02.744314+0000","last_became_active":"2021-10-08T19:29:40.640952+0000","last_became_peered":"2021-10-08T19:29:40.640952+0000","last_unstale":"2021-10-08T19:32:02.744314+0000","last_undegraded":"2021-10-08T19:32:02.744314+0000","last_fullsized":"2021-10-08T19:32:02.744314+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:24.567564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:31:24.567564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0052812129999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":271,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.743336+0000","last_change":"2021-10-08T19:29:30.474880+0000","last_active":"2021-10-08T19:32:02.743336+0000","last_peered":"2021-10-08T19:32:02.743336+0000","last_clean":"2021-10-08T19:32:02.743336+0000","last_became_active":"2021-10-08T19:21:27.632648+0000","last_became_peered":"2021-10-08T19:21:27.632648+0000","last_unstale":"2021-10-08T19:32:02.743336+0000","last_undegraded":"2021-10-08T19:32:02.743336+0000","last_fullsized":"2021-10-08T19:32:02.743336+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:29:30.474810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:29:30.474810+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0013849260000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"69'1","reported_seq":119,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.742875+0000","last_change":"2021-10-08T19:28:40.385176+0000","last_active":"2021-10-08T19:32:02.742875+0000","last_peered":"2021-10-08T19:32:02.742875+0000","last_clean":"2021-10-08T19:32:02.742875+0000","last_became_active":"2021-10-08T19:28:40.146302+0000","last_became_peered":"2021-10-08T19:28:40.146302+0000","last_unstale":"2021-10-08T19:32:02.742875+0000","last_undegraded":"2021-10-08T19:32:02.742875+0000","last_fullsized":"2021-10-08T19:32:02.742875+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2021-10-08T19:28:06.691075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:28:06.691075+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"289'27","reported_seq":441,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.735866+0000","last_change":"2021-10-08T19:31:33.421958+0000","last_active":"2021-10-08T19:32:02.735866+0000","last_peered":"2021-10-08T19:32:02.735866+0000","last_clean":"2021-10-08T19:32:02.735866+0000","last_became_active":"2021-10-08T19:29:40.629461+0000","last_became_peered":"2021-10-08T19:29:40.629461+0000","last_unstale":"2021-10-08T19:32:02.735866+0000","last_undegraded":"2021-10-08T19:32:02.735866+0000","last_fullsized":"2021-10-08T19:32:02.735866+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'27","last_scrub_stamp":"2021-10-08T19:31:33.421881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:31:33.421881+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039796650000000003,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":550,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":218,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:00.666919+0000","last_change":"2021-10-08T19:31:24.705440+0000","last_active":"2021-10-08T19:32:00.666919+0000","last_peered":"2021-10-08T19:32:00.666919+0000","last_clean":"2021-10-08T19:32:00.666919+0000","last_became_active":"2021-10-08T19:24:25.106119+0000","last_became_peered":"2021-10-08T19:24:25.106119+0000","last_unstale":"2021-10-08T19:32:00.666919+0000","last_undegraded":"2021-10-08T19:32:00.666919+0000","last_fullsized":"2021-10-08T19:32:00.666919+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:24.705315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:46.422866+0000","last_clean_scrub_stamp":"2021-10-08T19:31:24.705315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0014361210000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":115,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.742919+0000","last_change":"2021-10-08T19:28:40.148340+0000","last_active":"2021-10-08T19:32:02.742919+0000","last_peered":"2021-10-08T19:32:02.742919+0000","last_clean":"2021-10-08T19:32:02.742919+0000","last_became_active":"2021-10-08T19:28:40.148009+0000","last_became_peered":"2021-10-08T19:28:40.148009+0000","last_unstale":"2021-10-08T19:32:02.742919+0000","last_undegraded":"2021-10-08T19:32:02.742919+0000","last_fullsized":"2021-10-08T19:32:02.742919+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:10.658350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:28:10.658350+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":280,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.737423+0000","last_change":"2021-10-08T19:27:37.219578+0000","last_active":"2021-10-08T19:32:02.737423+0000","last_peered":"2021-10-08T19:32:02.737423+0000","last_clean":"2021-10-08T19:32:02.737423+0000","last_became_active":"2021-10-08T19:24:25.097782+0000","last_became_peered":"2021-10-08T19:24:25.097782+0000","last_unstale":"2021-10-08T19:32:02.737423+0000","last_undegraded":"2021-10-08T19:32:02.737423+0000","last_fullsized":"2021-10-08T19:32:02.737423+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:37.219503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:37.219503+0000","last_clean_scrub_stamp":"2021-10-08T19:27:37.219503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0015176320000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"289'18","reported_seq":109,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.745494+0000","last_change":"2021-10-08T19:29:57.179038+0000","last_active":"2021-10-08T19:32:02.745494+0000","last_peered":"2021-10-08T19:32:02.745494+0000","last_clean":"2021-10-08T19:32:02.745494+0000","last_became_active":"2021-10-08T19:29:40.645144+0000","last_became_peered":"2021-10-08T19:29:40.645144+0000","last_unstale":"2021-10-08T19:32:02.745494+0000","last_undegraded":"2021-10-08T19:32:02.745494+0000","last_fullsized":"2021-10-08T19:32:02.745494+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'12","last_scrub_stamp":"2021-10-08T19:29:57.178925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:29:57.178925+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0088169310000000001,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":25,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":82,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.743262+0000","last_change":"2021-10-08T19:29:44.444198+0000","last_active":"2021-10-08T19:32:02.743262+0000","last_peered":"2021-10-08T19:32:02.743262+0000","last_clean":"2021-10-08T19:32:02.743262+0000","last_became_active":"2021-10-08T19:29:44.443807+0000","last_became_peered":"2021-10-08T19:29:44.443807+0000","last_unstale":"2021-10-08T19:32:02.743262+0000","last_undegraded":"2021-10-08T19:32:02.743262+0000","last_fullsized":"2021-10-08T19:32:02.743262+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:14.247730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:28:14.247730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034956309999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":288,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.737140+0000","last_change":"2021-10-08T19:31:59.409211+0000","last_active":"2021-10-08T19:32:02.737140+0000","last_peered":"2021-10-08T19:32:02.737140+0000","last_clean":"2021-10-08T19:32:02.737140+0000","last_became_active":"2021-10-08T19:29:40.638352+0000","last_became_peered":"2021-10-08T19:29:40.638352+0000","last_unstale":"2021-10-08T19:32:02.737140+0000","last_undegraded":"2021-10-08T19:32:02.737140+0000","last_fullsized":"2021-10-08T19:32:02.737140+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:59.409131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:31:59.409131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0098736889999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":100,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.745654+0000","last_change":"2021-10-08T19:31:22.789442+0000","last_active":"2021-10-08T19:32:02.745654+0000","last_peered":"2021-10-08T19:32:02.745654+0000","last_clean":"2021-10-08T19:32:02.745654+0000","last_became_active":"2021-10-08T19:31:22.788455+0000","last_became_peered":"2021-10-08T19:31:22.788455+0000","last_unstale":"2021-10-08T19:32:02.745654+0000","last_undegraded":"2021-10-08T19:32:02.745654+0000","last_fullsized":"2021-10-08T19:32:02.745654+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:02.166534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:38.544673+0000","last_clean_scrub_stamp":"2021-10-08T19:28:02.166534+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0019818940000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"289'15","reported_seq":331,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.736095+0000","last_change":"2021-10-08T19:31:30.213636+0000","last_active":"2021-10-08T19:32:02.736095+0000","last_peered":"2021-10-08T19:32:02.736095+0000","last_clean":"2021-10-08T19:32:02.736095+0000","last_became_active":"2021-10-08T19:29:40.631689+0000","last_became_peered":"2021-10-08T19:29:40.631689+0000","last_unstale":"2021-10-08T19:32:02.736095+0000","last_undegraded":"2021-10-08T19:32:02.736095+0000","last_fullsized":"2021-10-08T19:32:02.736095+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'9","last_scrub_stamp":"2021-10-08T19:31:30.213519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:31:30.213519+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040346849999999997,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":278,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:00.660932+0000","last_change":"2021-10-08T19:31:25.393602+0000","last_active":"2021-10-08T19:32:00.660932+0000","last_peered":"2021-10-08T19:32:00.660932+0000","last_clean":"2021-10-08T19:32:00.660932+0000","last_became_active":"2021-10-08T19:21:23.607785+0000","last_became_peered":"2021-10-08T19:21:23.607785+0000","last_unstale":"2021-10-08T19:32:00.660932+0000","last_undegraded":"2021-10-08T19:32:00.660932+0000","last_fullsized":"2021-10-08T19:32:00.660932+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:25.393517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:31:25.393517+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.00347643,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":263,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:00.660636+0000","last_change":"2021-10-08T19:28:04.929950+0000","last_active":"2021-10-08T19:32:00.660636+0000","last_peered":"2021-10-08T19:32:00.660636+0000","last_clean":"2021-10-08T19:32:00.660636+0000","last_became_active":"2021-10-08T19:21:27.633979+0000","last_became_peered":"2021-10-08T19:21:27.633979+0000","last_unstale":"2021-10-08T19:32:00.660636+0000","last_undegraded":"2021-10-08T19:32:00.660636+0000","last_fullsized":"2021-10-08T19:32:00.660636+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:04.929862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:05.799361+0000","last_clean_scrub_stamp":"2021-10-08T19:28:04.929862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.015926389999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":285,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.737913+0000","last_change":"2021-10-08T19:31:59.265005+0000","last_active":"2021-10-08T19:32:02.737913+0000","last_peered":"2021-10-08T19:32:02.737913+0000","last_clean":"2021-10-08T19:32:02.737913+0000","last_became_active":"2021-10-08T19:28:40.159162+0000","last_became_peered":"2021-10-08T19:28:40.159162+0000","last_unstale":"2021-10-08T19:32:02.737913+0000","last_undegraded":"2021-10-08T19:32:02.737913+0000","last_fullsized":"2021-10-08T19:32:02.737913+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:14.144450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:24:14.144450+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0032569320000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"289'7","reported_seq":362,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.736676+0000","last_change":"2021-10-08T19:31:51.851585+0000","last_active":"2021-10-08T19:32:02.736676+0000","last_peered":"2021-10-08T19:32:02.736676+0000","last_clean":"2021-10-08T19:32:02.736676+0000","last_became_active":"2021-10-08T19:31:51.675189+0000","last_became_peered":"2021-10-08T19:31:51.675189+0000","last_unstale":"2021-10-08T19:32:02.736676+0000","last_undegraded":"2021-10-08T19:32:02.736676+0000","last_fullsized":"2021-10-08T19:32:02.736676+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'5","last_scrub_stamp":"2021-10-08T19:31:27.199641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:31:27.199641+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0055097490000000004,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":10,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":294,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:00.661649+0000","last_change":"2021-10-08T19:29:40.244832+0000","last_active":"2021-10-08T19:32:00.661649+0000","last_peered":"2021-10-08T19:32:00.661649+0000","last_clean":"2021-10-08T19:32:00.661649+0000","last_became_active":"2021-10-08T19:24:25.096225+0000","last_became_peered":"2021-10-08T19:24:25.096225+0000","last_unstale":"2021-10-08T19:32:00.661649+0000","last_undegraded":"2021-10-08T19:32:00.661649+0000","last_fullsized":"2021-10-08T19:32:00.661649+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:29:40.244757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:29:40.244757+0000","last_clean_scrub_stamp":"2021-10-08T19:29:40.244757+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0014831639999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":292,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:00.659956+0000","last_change":"2021-10-08T19:31:21.361484+0000","last_active":"2021-10-08T19:32:00.659956+0000","last_peered":"2021-10-08T19:32:00.659956+0000","last_clean":"2021-10-08T19:32:00.659956+0000","last_became_active":"2021-10-08T19:28:40.101187+0000","last_became_peered":"2021-10-08T19:28:40.101187+0000","last_unstale":"2021-10-08T19:32:00.659956+0000","last_undegraded":"2021-10-08T19:32:00.659956+0000","last_fullsized":"2021-10-08T19:32:00.659956+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:21.361407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:31:21.361407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003551378,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":297,"reported_epoch":307,"state":"active+clean","last_fresh":"2021-10-08T19:32:00.659864+0000","last_change":"2021-10-08T19:29:40.633278+0000","last_active":"2021-10-08T19:32:00.659864+0000","last_peered":"2021-10-08T19:32:00.659864+0000","last_clean":"2021-10-08T19:32:00.659864+0000","last_became_active":"2021-10-08T19:29:40.632965+0000","last_became_peered":"2021-10-08T19:29:40.632965+0000","last_unstale":"2021-10-08T19:32:00.659864+0000","last_undegraded":"2021-10-08T19:32:00.659864+0000","last_fullsized":"2021-10-08T19:32:00.659864+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:14.882819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:28:14.882819+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.020979794,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"289'19","reported_seq":411,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.734871+0000","last_change":"2021-10-08T19:31:22.251853+0000","last_active":"2021-10-08T19:32:02.734871+0000","last_peered":"2021-10-08T19:32:02.734871+0000","last_clean":"2021-10-08T19:32:02.734871+0000","last_became_active":"2021-10-08T19:28:40.099770+0000","last_became_peered":"2021-10-08T19:28:40.099770+0000","last_unstale":"2021-10-08T19:32:02.734871+0000","last_undegraded":"2021-10-08T19:32:02.734871+0000","last_fullsized":"2021-10-08T19:32:02.734871+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'13","last_scrub_stamp":"2021-10-08T19:31:22.251742+0000","last_deep_scrub":"88'13","last_deep_scrub_stamp":"2021-10-08T19:23:16.016646+0000","last_clean_scrub_stamp":"2021-10-08T19:31:22.251742+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039856270000000003,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":88,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.742532+0000","last_change":"2021-10-08T19:30:06.157170+0000","last_active":"2021-10-08T19:32:02.742532+0000","last_peered":"2021-10-08T19:32:02.742532+0000","last_clean":"2021-10-08T19:32:02.742532+0000","last_became_active":"2021-10-08T19:29:40.627394+0000","last_became_peered":"2021-10-08T19:29:40.627394+0000","last_unstale":"2021-10-08T19:32:02.742532+0000","last_undegraded":"2021-10-08T19:32:02.742532+0000","last_fullsized":"2021-10-08T19:32:02.742532+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:30:06.157078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:30:06.157078+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.016769394,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":115,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.741081+0000","last_change":"2021-10-08T19:28:40.146371+0000","last_active":"2021-10-08T19:32:02.741081+0000","last_peered":"2021-10-08T19:32:02.741081+0000","last_clean":"2021-10-08T19:32:02.741081+0000","last_became_active":"2021-10-08T19:28:40.145868+0000","last_became_peered":"2021-10-08T19:28:40.145868+0000","last_unstale":"2021-10-08T19:32:02.741081+0000","last_undegraded":"2021-10-08T19:32:02.741081+0000","last_fullsized":"2021-10-08T19:32:02.741081+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:02.663022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:28:02.663022+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":282,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.736010+0000","last_change":"2021-10-08T19:30:32.528582+0000","last_active":"2021-10-08T19:32:02.736010+0000","last_peered":"2021-10-08T19:32:02.736010+0000","last_clean":"2021-10-08T19:32:02.736010+0000","last_became_active":"2021-10-08T19:28:40.099543+0000","last_became_peered":"2021-10-08T19:28:40.099543+0000","last_unstale":"2021-10-08T19:32:02.736010+0000","last_undegraded":"2021-10-08T19:32:02.736010+0000","last_fullsized":"2021-10-08T19:32:02.736010+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:30:32.528510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:50.032367+0000","last_clean_scrub_stamp":"2021-10-08T19:30:32.528510+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0078699960000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"289'27","reported_seq":122,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.744306+0000","last_change":"2021-10-08T19:31:31.454233+0000","last_active":"2021-10-08T19:32:02.744306+0000","last_peered":"2021-10-08T19:32:02.744306+0000","last_clean":"2021-10-08T19:32:02.744306+0000","last_became_active":"2021-10-08T19:29:40.631002+0000","last_became_peered":"2021-10-08T19:29:40.631002+0000","last_unstale":"2021-10-08T19:32:02.744306+0000","last_undegraded":"2021-10-08T19:32:02.744306+0000","last_fullsized":"2021-10-08T19:32:02.744306+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'15","last_scrub_stamp":"2021-10-08T19:31:31.454160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:31:31.454160+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0041423509999999998,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":269,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.743597+0000","last_change":"2021-10-08T19:28:15.535918+0000","last_active":"2021-10-08T19:32:02.743597+0000","last_peered":"2021-10-08T19:32:02.743597+0000","last_clean":"2021-10-08T19:32:02.743597+0000","last_became_active":"2021-10-08T19:21:23.603422+0000","last_became_peered":"2021-10-08T19:21:23.603422+0000","last_unstale":"2021-10-08T19:32:02.743597+0000","last_undegraded":"2021-10-08T19:32:02.743597+0000","last_fullsized":"2021-10-08T19:32:02.743597+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:15.535842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:15.535842+0000","last_clean_scrub_stamp":"2021-10-08T19:28:15.535842+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014121440000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":308,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.735161+0000","last_change":"2021-10-08T19:31:31.176254+0000","last_active":"2021-10-08T19:32:02.735161+0000","last_peered":"2021-10-08T19:32:02.735161+0000","last_clean":"2021-10-08T19:32:02.735161+0000","last_became_active":"2021-10-08T19:28:40.099286+0000","last_became_peered":"2021-10-08T19:28:40.099286+0000","last_unstale":"2021-10-08T19:32:02.735161+0000","last_undegraded":"2021-10-08T19:32:02.735161+0000","last_fullsized":"2021-10-08T19:32:02.735161+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:31.176160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:31.176160+0000","last_clean_scrub_stamp":"2021-10-08T19:31:31.176160+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0046843739999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":88,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.743393+0000","last_change":"2021-10-08T19:31:32.458220+0000","last_active":"2021-10-08T19:32:02.743393+0000","last_peered":"2021-10-08T19:32:02.743393+0000","last_clean":"2021-10-08T19:32:02.743393+0000","last_became_active":"2021-10-08T19:29:40.638221+0000","last_became_peered":"2021-10-08T19:29:40.638221+0000","last_unstale":"2021-10-08T19:32:02.743393+0000","last_undegraded":"2021-10-08T19:32:02.743393+0000","last_fullsized":"2021-10-08T19:32:02.743393+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.458082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.458082+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.045433947000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":2263613440,"num_objects":34540,"num_object_clones":0,"num_object_copies":103620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34540,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34540,"num_write_kb":2210560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1088,"num_bytes_recovered":71303168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6868697088,"data_stored":6868697088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34540,"ondisk_log_size":34540,"up":48,"acting":48,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":11,"stat_sum":{"num_bytes":322020,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":168,"num_write":96,"num_write_kb":1318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":2307802,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1430,"ondisk_log_size":1430,"up":33,"acting":33,"num_store_stats":8},{"poolid":3,"num_pg":23,"stat_sum":{"num_bytes":437,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":461,"num_read_kb":461,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1167,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":69,"acting":69,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1113,"num_read_kb":870,"num_write":703,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":505,"num_bytes_recovered":10716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":696,"ondisk_log_size":696,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81,"ondisk_log_size":81,"up":96,"acting":96,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201412,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1371072,"kb_used_data":1228728,"kb_used_omap":0,"kb_used_meta":142336,"kb_avail":92374080,"statfs":{"total":95995035648,"available":94591057920,"internally_reserved":0,"allocated":1258217472,"data_stored":1257473222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":145752064},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:31:30 2021","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.5629999999999999,"15min":1.159},"min":{"1min":0.20899999999999999,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":5.2910000000000004,"5min":26.065000000000001,"15min":32.366999999999997},"last":0.36899999999999999},{"interface":"front","average":{"1min":2.0710000000000002,"5min":1.6619999999999999,"15min":1.27},"min":{"1min":0.26100000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":7.0380000000000003,"5min":25.75,"15min":29.736000000000001},"last":0.41899999999999998}]},{"osd":1,"last update":"Fri Oct 8 19:31:30 2021","interfaces":[{"interface":"back","average":{"1min":2.7669999999999999,"5min":1.865,"15min":1.3819999999999999},"min":{"1min":0.222,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":17.452999999999999,"5min":26.044,"15min":26.044},"last":0.501},{"interface":"front","average":{"1min":2.7999999999999998,"5min":2.1139999999999999,"15min":1.2010000000000001},"min":{"1min":0.32200000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":18.053000000000001,"5min":28.119,"15min":28.119},"last":0.47299999999999998}]},{"osd":2,"last update":"Fri Oct 8 19:31:30 2021","interfaces":[{"interface":"back","average":{"1min":2.137,"5min":1.659,"15min":1.3009999999999999},"min":{"1min":0.31,"5min":0.26300000000000001,"15min":0.26100000000000001},"max":{"1min":7.524,"5min":7.8170000000000002,"15min":27.018000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":2.1920000000000002,"5min":1.48,"15min":1.2070000000000001},"min":{"1min":0.33400000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":8.2870000000000008,"5min":8.2870000000000008,"15min":27.113},"last":0.48399999999999999}]},{"osd":3,"last update":"Fri Oct 8 19:31:30 2021","interfaces":[{"interface":"back","average":{"1min":2.4700000000000002,"5min":2.0619999999999998,"15min":1.4259999999999999},"min":{"1min":0.35299999999999998,"5min":0.29999999999999999,"15min":0.29399999999999998},"max":{"1min":13.605,"5min":16.853000000000002,"15min":27.010000000000002},"last":0.52800000000000002},{"interface":"front","average":{"1min":2.1960000000000002,"5min":2.016,"15min":1.3560000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":8.9489999999999998,"5min":10.709,"15min":27.263999999999999},"last":0.53900000000000003}]},{"osd":4,"last update":"Fri Oct 8 19:31:30 2021","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":0.97799999999999998,"15min":0.68300000000000005},"min":{"1min":0.249,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":7.4610000000000003,"5min":7.4610000000000003,"15min":7.4610000000000003},"last":0.55300000000000005},{"interface":"front","average":{"1min":1.0229999999999999,"5min":0.85799999999999998,"15min":0.625},"min":{"1min":0.30599999999999999,"5min":0.28299999999999997,"15min":0.27500000000000002},"max":{"1min":4.9820000000000002,"5min":6.9320000000000004,"15min":6.9320000000000004},"last":0.438}]},{"osd":5,"last update":"Fri Oct 8 19:31:30 2021","interfaces":[{"interface":"back","average":{"1min":1.5629999999999999,"5min":1.1599999999999999,"15min":0.76900000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.251},"max":{"1min":9.9280000000000008,"5min":9.9280000000000008,"15min":9.9280000000000008},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.98299999999999998,"15min":0.68700000000000006},"min":{"1min":0.34100000000000003,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":3.484,"5min":18.655000000000001,"15min":18.655000000000001},"last":0.56399999999999995}]},{"osd":6,"last update":"Fri Oct 8 19:31:30 2021","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.099,"15min":0.752},"min":{"1min":0.30399999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":6.9989999999999997,"5min":6.9989999999999997,"15min":6.9989999999999997},"last":0.60999999999999999},{"interface":"front","average":{"1min":1.304,"5min":1.079,"15min":0.79400000000000004},"min":{"1min":0.39300000000000002,"5min":0.35099999999999998,"15min":0.318},"max":{"1min":7.742,"5min":7.742,"15min":7.742},"last":0.60199999999999998}]}]},{"osd":6,"up_from":47,"seq":201863463048,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":561756,"kb_used_data":410964,"kb_used_omap":0,"kb_used_meta":150784,"kb_avail":93183396,"statfs":{"total":95995035648,"available":95419797504,"internally_reserved":0,"allocated":420827136,"data_stored":420111389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":154402816},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:31:10 2021","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.796,"15min":1.0600000000000001},"min":{"1min":0.25900000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":3.3959999999999999,"5min":28.382999999999999,"15min":28.382999999999999},"last":0.34200000000000003},{"interface":"front","average":{"1min":1.345,"5min":2.7360000000000002,"15min":1.4319999999999999},"min":{"1min":0.25900000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":4.8840000000000003,"5min":69.477000000000004,"15min":69.477000000000004},"last":0.36399999999999999}]},{"osd":1,"last update":"Fri Oct 8 19:31:10 2021","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":1.0569999999999999,"15min":0.84799999999999998},"min":{"1min":0.245,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":4.5380000000000003,"5min":6.1059999999999999,"15min":14.878},"last":1.462},{"interface":"front","average":{"1min":1.806,"5min":1.298,"15min":0.94499999999999995},"min":{"1min":0.29699999999999999,"5min":0.26900000000000002,"15min":0.26400000000000001},"max":{"1min":5.7380000000000004,"5min":7.4189999999999996,"15min":14.779},"last":1.661}]},{"osd":2,"last update":"Fri Oct 8 19:31:10 2021","interfaces":[{"interface":"back","average":{"1min":1.7509999999999999,"5min":2.266,"15min":1.375},"min":{"1min":0.28699999999999998,"5min":0.251,"15min":0.251},"max":{"1min":5.7009999999999996,"5min":69.322999999999993,"15min":69.322999999999993},"last":0.44800000000000001},{"interface":"front","average":{"1min":1.2969999999999999,"5min":2.4849999999999999,"15min":1.4510000000000001},"min":{"1min":0.33700000000000002,"5min":0.245,"15min":0.245},"max":{"1min":4.1040000000000001,"5min":69.418999999999997,"15min":69.418999999999997},"last":0.42299999999999999}]},{"osd":3,"last update":"Fri Oct 8 19:31:10 2021","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":1.899,"15min":1.1519999999999999},"min":{"1min":0.307,"5min":0.29599999999999999,"15min":0.27900000000000003},"max":{"1min":4.4359999999999999,"5min":21.670000000000002,"15min":21.670000000000002},"last":1.1759999999999999},{"interface":"front","average":{"1min":2.0409999999999999,"5min":1.655,"15min":1.0669999999999999},"min":{"1min":0.38,"5min":0.29599999999999999,"15min":0.28000000000000003},"max":{"1min":5.4649999999999999,"5min":22.254999999999999,"15min":22.254999999999999},"last":0.40999999999999998}]},{"osd":4,"last update":"Fri Oct 8 19:31:10 2021","interfaces":[{"interface":"back","average":{"1min":1.609,"5min":1.0669999999999999,"15min":0.65900000000000003},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":9.4939999999999998,"5min":24.516999999999999,"15min":24.516999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.569,"15min":0.85599999999999998},"min":{"1min":0.27500000000000002,"5min":0.27000000000000002,"15min":0.26100000000000001},"max":{"1min":9.6890000000000001,"5min":69.593999999999994,"15min":69.593999999999994},"last":0.43099999999999999}]},{"osd":5,"last update":"Fri Oct 8 19:31:10 2021","interfaces":[{"interface":"back","average":{"1min":1.5369999999999999,"5min":0.996,"15min":0.67700000000000005},"min":{"1min":0.33000000000000002,"5min":0.29499999999999998,"15min":0.28499999999999998},"max":{"1min":9.5670000000000002,"5min":15.678000000000001,"15min":15.678000000000001},"last":0.497},{"interface":"front","average":{"1min":1.351,"5min":1.782,"15min":0.93000000000000005},"min":{"1min":0.312,"5min":0.29799999999999999,"15min":0.252},"max":{"1min":6.5140000000000002,"5min":69.561000000000007,"15min":69.561000000000007},"last":0.46899999999999997}]},{"osd":7,"last update":"Fri Oct 8 19:31:33 2021","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":0.89600000000000002,"15min":0.66000000000000003},"min":{"1min":0.29599999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":5.5019999999999998,"5min":5.5019999999999998,"15min":5.5019999999999998},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.198,"15min":0.79500000000000004},"min":{"1min":0.35899999999999999,"5min":0.33100000000000002,"15min":0.313},"max":{"1min":4.1260000000000003,"5min":15.962,"15min":15.962},"last":0.52500000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575003,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1439388,"kb_used_data":1236820,"kb_used_omap":0,"kb_used_meta":202560,"kb_avail":92305764,"statfs":{"total":95995035648,"available":94521102336,"internally_reserved":0,"allocated":1266503680,"data_stored":1265730163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":207421440},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:31:50 2021","interfaces":[{"interface":"back","average":{"1min":7.8179999999999996,"5min":4.7519999999999998,"15min":2.7799999999999998},"min":{"1min":0.22800000000000001,"5min":0.19600000000000001,"15min":0.184},"max":{"1min":102.352,"5min":126.256,"15min":126.256},"last":3.024},{"interface":"front","average":{"1min":6.7190000000000003,"5min":4.6609999999999996,"15min":2.9340000000000002},"min":{"1min":0.24099999999999999,"5min":0.182,"15min":0.182},"max":{"1min":102.462,"5min":126.176,"15min":126.176},"last":1.036}]},{"osd":2,"last update":"Fri Oct 8 19:31:07 2021","interfaces":[{"interface":"back","average":{"1min":2.0960000000000001,"5min":2.0489999999999999,"15min":1.6379999999999999},"min":{"1min":0.21299999999999999,"5min":0.192,"15min":0.192},"max":{"1min":7.8860000000000001,"5min":19.173999999999999,"15min":35.124000000000002},"last":2.012},{"interface":"front","average":{"1min":2.633,"5min":3.2330000000000001,"15min":1.9079999999999999},"min":{"1min":0.33000000000000002,"5min":0.23400000000000001,"15min":0.22700000000000001},"max":{"1min":13.994,"5min":17.998000000000001,"15min":35.283000000000001},"last":1.0960000000000001}]},{"osd":3,"last update":"Fri Oct 8 19:31:27 2021","interfaces":[{"interface":"back","average":{"1min":9.4990000000000006,"5min":3.956,"15min":2.294},"min":{"1min":0.32400000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":105.836,"5min":105.836,"15min":105.836},"last":1.0700000000000001},{"interface":"front","average":{"1min":9.8680000000000003,"5min":3.7480000000000002,"15min":2.145},"min":{"1min":0.26200000000000001,"5min":0.23899999999999999,"15min":0.23599999999999999},"max":{"1min":106.12,"5min":106.12,"15min":106.12},"last":2.7040000000000002}]},{"osd":4,"last update":"Fri Oct 8 19:31:36 2021","interfaces":[{"interface":"back","average":{"1min":7.2839999999999998,"5min":2.677,"15min":1.659},"min":{"1min":0.34899999999999998,"5min":0.307,"15min":0.29499999999999998},"max":{"1min":103.538,"5min":103.538,"15min":103.538},"last":1.974},{"interface":"front","average":{"1min":7.3840000000000003,"5min":2.4780000000000002,"15min":1.385},"min":{"1min":0.27100000000000002,"5min":0.254,"15min":0.254},"max":{"1min":102.67100000000001,"5min":102.67100000000001,"15min":102.67100000000001},"last":2.0699999999999998}]},{"osd":5,"last update":"Fri Oct 8 19:32:02 2021","interfaces":[{"interface":"back","average":{"1min":6.6109999999999998,"5min":2.8879999999999999,"15min":1.7230000000000001},"min":{"1min":0.40400000000000003,"5min":0.33200000000000002,"15min":0.29899999999999999},"max":{"1min":102.717,"5min":102.717,"15min":102.717},"last":1.139},{"interface":"front","average":{"1min":6.7720000000000002,"5min":2.4039999999999999,"15min":1.413},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.29999999999999999},"max":{"1min":102.617,"5min":102.617,"15min":102.617},"last":2.1040000000000001}]},{"osd":6,"last update":"Fri Oct 8 19:31:17 2021","interfaces":[{"interface":"back","average":{"1min":7.4880000000000004,"5min":2.8780000000000001,"15min":1.7110000000000001},"min":{"1min":0.377,"5min":0.33100000000000002,"15min":0.26700000000000002},"max":{"1min":103.73,"5min":103.73,"15min":103.73},"last":1.9350000000000001},{"interface":"front","average":{"1min":7.3789999999999996,"5min":3.327,"15min":1.7709999999999999},"min":{"1min":0.47499999999999998,"5min":0.36699999999999999,"15min":0.28399999999999997},"max":{"1min":102.753,"5min":102.753,"15min":102.753},"last":1.1599999999999999}]},{"osd":7,"last update":"Fri Oct 8 19:31:36 2021","interfaces":[{"interface":"back","average":{"1min":7.4029999999999996,"5min":3.077,"15min":1.7929999999999999},"min":{"1min":0.50900000000000001,"5min":0.36399999999999999,"15min":0.312},"max":{"1min":102.773,"5min":102.773,"15min":102.773},"last":1.1180000000000001},{"interface":"front","average":{"1min":7.4660000000000002,"5min":2.5550000000000002,"15min":1.4370000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":102.63800000000001,"5min":102.63800000000001,"15min":102.63800000000001},"last":2.133}]}]},{"osd":0,"up_from":8,"seq":34359738526,"num_pgs":61,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":729212,"kb_used_data":554676,"kb_used_omap":0,"kb_used_meta":174528,"kb_avail":93015940,"statfs":{"total":95995035648,"available":95248322560,"internally_reserved":0,"allocated":567988224,"data_stored":567246894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":178716672},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 8 19:31:45 2021","interfaces":[{"interface":"back","average":{"1min":6.125,"5min":3.5510000000000002,"15min":1.831},"min":{"1min":0.20699999999999999,"5min":0.19400000000000001,"15min":0.192},"max":{"1min":91.954999999999998,"5min":91.954999999999998,"15min":91.954999999999998},"last":0.64400000000000002},{"interface":"front","average":{"1min":5.9020000000000001,"5min":2.8719999999999999,"15min":1.7889999999999999},"min":{"1min":0.22600000000000001,"5min":0.219,"15min":0.217},"max":{"1min":91.046000000000006,"5min":91.046000000000006,"15min":91.046000000000006},"last":0.76700000000000002}]},{"osd":2,"last update":"Fri Oct 8 19:31:07 2021","interfaces":[{"interface":"back","average":{"1min":1.8819999999999999,"5min":2.444,"15min":1.657},"min":{"1min":0.24199999999999999,"5min":0.22800000000000001,"15min":0.22700000000000001},"max":{"1min":8.8800000000000008,"5min":14.307,"15min":62.390000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.9870000000000001,"15min":1.5389999999999999},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.19500000000000001},"max":{"1min":7.7809999999999997,"5min":10.121,"15min":62.718000000000004},"last":0.442}]},{"osd":3,"last update":"Fri Oct 8 19:31:31 2021","interfaces":[{"interface":"back","average":{"1min":2.8380000000000001,"5min":2.718,"15min":1.7829999999999999},"min":{"1min":0.28399999999999997,"5min":0.217,"15min":0.217},"max":{"1min":14.551,"5min":15.090999999999999,"15min":62.491},"last":1.72},{"interface":"front","average":{"1min":2.9510000000000001,"5min":2.2109999999999999,"15min":1.643},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":22.016999999999999,"5min":22.016999999999999,"15min":62.673000000000002},"last":2.9780000000000002}]},{"osd":4,"last update":"Fri Oct 8 19:31:45 2021","interfaces":[{"interface":"back","average":{"1min":2.4689999999999999,"5min":2.0750000000000002,"15min":1.3500000000000001},"min":{"1min":0.25800000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":16.805,"5min":16.805,"15min":16.805},"last":0.61099999999999999},{"interface":"front","average":{"1min":1.073,"5min":1.3939999999999999,"15min":1.151},"min":{"1min":0.38800000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":5.1239999999999997,"5min":11.823,"15min":11.823},"last":0.65600000000000003}]},{"osd":5,"last update":"Fri Oct 8 19:32:00 2021","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.298,"15min":1.056},"min":{"1min":0.36599999999999999,"5min":0.27600000000000002,"15min":0.24099999999999999},"max":{"1min":8.6530000000000005,"5min":8.6530000000000005,"15min":15.56},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.605,"15min":1.306},"min":{"1min":0.40799999999999997,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":5.5,"5min":11.619999999999999,"15min":15.484999999999999},"last":0.67000000000000004}]},{"osd":6,"last update":"Fri Oct 8 19:31:17 2021","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.732,"15min":1.208},"min":{"1min":0.36599999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":5.6280000000000001,"5min":11.869,"15min":11.869},"last":0.70199999999999996},{"interface":"front","average":{"1min":1.931,"5min":1.4710000000000001,"15min":1.1499999999999999},"min":{"1min":0.32000000000000001,"5min":0.29899999999999999,"15min":0.27500000000000002},"max":{"1min":8.609,"5min":8.609,"15min":10.519},"last":0.496}]},{"osd":7,"last update":"Fri Oct 8 19:31:31 2021","interfaces":[{"interface":"back","average":{"1min":2.3479999999999999,"5min":2.0840000000000001,"15min":1.359},"min":{"1min":0.45100000000000001,"5min":0.38300000000000001,"15min":0.35399999999999998},"max":{"1min":7.4470000000000001,"5min":11.669,"15min":11.669},"last":0.69099999999999995},{"interface":"front","average":{"1min":1.4490000000000001,"5min":1.746,"15min":1.3799999999999999},"min":{"1min":0.41599999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":5.657,"5min":11.898999999999999,"15min":11.898999999999999},"last":1.0760000000000001}]}]},{"osd":2,"up_from":18,"seq":77309411478,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":598248,"kb_used_data":415584,"kb_used_omap":0,"kb_used_meta":182656,"kb_avail":93146904,"statfs":{"total":95995035648,"available":95382429696,"internally_reserved":0,"allocated":425558016,"data_stored":424837107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":187039744},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:31:01 2021","interfaces":[{"interface":"back","average":{"1min":5.3049999999999997,"5min":2.9550000000000001,"15min":1.8979999999999999},"min":{"1min":0.222,"5min":0.20699999999999999,"15min":0.17699999999999999},"max":{"1min":60.990000000000002,"5min":60.990000000000002,"15min":61.670999999999999},"last":2.2509999999999999},{"interface":"front","average":{"1min":5.0759999999999996,"5min":2.9849999999999999,"15min":1.883},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":60.850999999999999,"5min":60.850999999999999,"15min":65.284999999999997},"last":3.609}]},{"osd":1,"last update":"Fri Oct 8 19:31:01 2021","interfaces":[{"interface":"back","average":{"1min":4.5369999999999999,"5min":2.702,"15min":1.663},"min":{"1min":0.215,"5min":0.20999999999999999,"15min":0.192},"max":{"1min":60.960000000000001,"5min":60.960000000000001,"15min":60.960000000000001},"last":3.8570000000000002},{"interface":"front","average":{"1min":5.1970000000000001,"5min":2.9420000000000002,"15min":1.851},"min":{"1min":0.26200000000000001,"5min":0.25600000000000001,"15min":0.21299999999999999},"max":{"1min":60.878999999999998,"5min":60.878999999999998,"15min":60.878999999999998},"last":3.8919999999999999}]},{"osd":3,"last update":"Fri Oct 8 19:31:12 2021","interfaces":[{"interface":"back","average":{"1min":2.286,"5min":2.5670000000000002,"15min":1.8320000000000001},"min":{"1min":0.224,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":5.2469999999999999,"5min":17.734000000000002,"15min":65.322999999999993},"last":4.1230000000000002},{"interface":"front","average":{"1min":3.085,"5min":2.8100000000000001,"15min":1.845},"min":{"1min":0.23599999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":11.613,"5min":24.809999999999999,"15min":61.143000000000001},"last":1.202}]},{"osd":4,"last update":"Fri Oct 8 19:31:33 2021","interfaces":[{"interface":"back","average":{"1min":1.7110000000000001,"5min":1.9410000000000001,"15min":1.2829999999999999},"min":{"1min":0.34200000000000003,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":5.0149999999999997,"5min":24.657,"15min":24.657},"last":1.113},{"interface":"front","average":{"1min":1.917,"5min":1.7310000000000001,"15min":1.3089999999999999},"min":{"1min":0.28299999999999997,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":5.6100000000000003,"5min":10.609999999999999,"15min":15.143000000000001},"last":3.5699999999999998}]},{"osd":5,"last update":"Fri Oct 8 19:31:01 2021","interfaces":[{"interface":"back","average":{"1min":1.718,"5min":1.579,"15min":1.214},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":8.3569999999999993,"5min":10.58,"15min":15.087999999999999},"last":3.6389999999999998},{"interface":"front","average":{"1min":2.9740000000000002,"5min":2.1379999999999999,"15min":1.2969999999999999},"min":{"1min":0.35099999999999998,"5min":0.315,"15min":0.27600000000000002},"max":{"1min":26.094000000000001,"5min":26.094000000000001,"15min":26.094000000000001},"last":0.46999999999999997}]},{"osd":6,"last update":"Fri Oct 8 19:31:12 2021","interfaces":[{"interface":"back","average":{"1min":1.9419999999999999,"5min":1.8759999999999999,"15min":1.26},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":7.7779999999999996,"5min":14.162000000000001,"15min":14.162000000000001},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.847,"5min":1.774,"15min":1.268},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":10.92,"5min":16.68,"15min":16.68},"last":0.498}]},{"osd":7,"last update":"Fri Oct 8 19:31:33 2021","interfaces":[{"interface":"back","average":{"1min":1.665,"5min":1.8640000000000001,"15min":1.3300000000000001},"min":{"1min":0.35399999999999998,"5min":0.32700000000000001,"15min":0.31900000000000001},"max":{"1min":5.3159999999999998,"5min":14.185,"15min":14.185},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.756,"5min":1.901,"15min":1.304},"min":{"1min":0.39600000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":10.898,"5min":16.702999999999999,"15min":16.702999999999999},"last":2.2130000000000001}]}]},{"osd":3,"up_from":24,"seq":103079215252,"num_pgs":75,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1327312,"kb_used_data":1103560,"kb_used_omap":0,"kb_used_meta":223744,"kb_avail":92417840,"statfs":{"total":95995035648,"available":94635868160,"internally_reserved":0,"allocated":1130045440,"data_stored":1129284691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":229113856},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:31:24 2021","interfaces":[{"interface":"back","average":{"1min":3.8450000000000002,"5min":2.5289999999999999,"15min":1.899},"min":{"1min":0.22600000000000001,"5min":0.17100000000000001,"15min":0.17000000000000001},"max":{"1min":9.5830000000000002,"5min":17.553999999999998,"15min":109.601},"last":0.22},{"interface":"front","average":{"1min":3.7080000000000002,"5min":2.4950000000000001,"15min":2.0129999999999999},"min":{"1min":0.30399999999999999,"5min":0.223,"15min":0.19800000000000001},"max":{"1min":12.696999999999999,"5min":12.696999999999999,"15min":107.84},"last":0.65100000000000002}]},{"osd":1,"last update":"Fri Oct 8 19:31:24 2021","interfaces":[{"interface":"back","average":{"1min":2.839,"5min":2.2309999999999999,"15min":1.476},"min":{"1min":0.24299999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":12.651999999999999,"5min":20.335999999999999,"15min":20.335999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.726,"5min":2.3199999999999998,"15min":1.4730000000000001},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":5.9539999999999997,"5min":13.912000000000001,"15min":13.912000000000001},"last":0.67900000000000005}]},{"osd":2,"last update":"Fri Oct 8 19:31:24 2021","interfaces":[{"interface":"back","average":{"1min":2.3119999999999998,"5min":2.6880000000000002,"15min":1.661},"min":{"1min":0.251,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":7.6890000000000001,"5min":32.277000000000001,"15min":32.277000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":3.0179999999999998,"5min":2.0790000000000002,"15min":1.403},"min":{"1min":0.28899999999999998,"5min":0.27800000000000002,"15min":0.22700000000000001},"max":{"1min":7.8529999999999998,"5min":8.9290000000000003,"15min":14.898999999999999},"last":0.40899999999999997}]},{"osd":4,"last update":"Fri Oct 8 19:31:35 2021","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.4390000000000001,"15min":1.2190000000000001},"min":{"1min":0.35799999999999998,"5min":0.26600000000000001,"15min":0.25600000000000001},"max":{"1min":4.0540000000000003,"5min":7.9349999999999996,"15min":18.064},"last":0.46500000000000002},{"interface":"front","average":{"1min":1.7609999999999999,"5min":2.2490000000000001,"15min":1.4810000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":10.632,"5min":18.692,"15min":18.692},"last":0.84399999999999997}]},{"osd":5,"last update":"Fri Oct 8 19:31:56 2021","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.5209999999999999,"15min":1.232},"min":{"1min":0.39500000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":2.9380000000000002,"5min":8.5660000000000007,"15min":13.186},"last":0.76200000000000001},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.5509999999999999,"15min":1.2889999999999999},"min":{"1min":0.34100000000000003,"5min":0.32400000000000001,"15min":0.28100000000000003},"max":{"1min":7.1200000000000001,"5min":7.7919999999999998,"15min":10.285},"last":0.436}]},{"osd":6,"last update":"Fri Oct 8 19:31:12 2021","interfaces":[{"interface":"back","average":{"1min":2.9780000000000002,"5min":2.105,"15min":1.883},"min":{"1min":0.29999999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":10.606999999999999,"5min":17.512,"15min":21.538},"last":0.82199999999999995},{"interface":"front","average":{"1min":2,"5min":1.889,"15min":1.2869999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":5.3680000000000003,"5min":13.067,"15min":13.298},"last":0.81100000000000005}]},{"osd":7,"last update":"Fri Oct 8 19:31:35 2021","interfaces":[{"interface":"back","average":{"1min":1.829,"5min":1.9590000000000001,"15min":1.3100000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":10.656000000000001,"5min":10.696999999999999,"15min":10.696999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":1.153,"5min":1.7529999999999999,"15min":1.28},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":4.181,"5min":8.6099999999999994,"15min":13.225},"last":0.78800000000000003}]}]},{"osd":4,"up_from":30,"seq":128849019022,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":618888,"kb_used_data":484608,"kb_used_omap":0,"kb_used_meta":134272,"kb_avail":93126264,"statfs":{"total":95995035648,"available":95361294336,"internally_reserved":0,"allocated":496238592,"data_stored":495486014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":137494528},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:31:37 2021","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":2.383,"15min":1.5549999999999999},"min":{"1min":0.22,"5min":0.185,"15min":0.185},"max":{"1min":3.347,"5min":82.109999999999999,"15min":82.109999999999999},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.879,"5min":2.323,"15min":1.51},"min":{"1min":0.25900000000000001,"5min":0.23000000000000001,"15min":0.20399999999999999},"max":{"1min":2.444,"5min":82.025999999999996,"15min":82.025999999999996},"last":0.27800000000000002}]},{"osd":1,"last update":"Fri Oct 8 19:31:37 2021","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.877,"15min":1.2709999999999999},"min":{"1min":0.26100000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":4.9009999999999998,"5min":41.033000000000001,"15min":41.033000000000001},"last":1.0780000000000001},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.7170000000000001,"15min":1.0780000000000001},"min":{"1min":0.35399999999999998,"5min":0.251,"15min":0.24099999999999999},"max":{"1min":2.8079999999999998,"5min":41.396999999999998,"15min":41.396999999999998},"last":0.90200000000000002}]},{"osd":2,"last update":"Fri Oct 8 19:31:37 2021","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.597,"15min":1.1180000000000001},"min":{"1min":0.29799999999999999,"5min":0.26800000000000002,"15min":0.23499999999999999},"max":{"1min":7.2080000000000002,"5min":21.257000000000001,"15min":21.257000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.637,"15min":1.1459999999999999},"min":{"1min":0.38700000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":4.8719999999999999,"5min":21.600000000000001,"15min":21.600000000000001},"last":0.53500000000000003}]},{"osd":3,"last update":"Fri Oct 8 19:31:37 2021","interfaces":[{"interface":"back","average":{"1min":1.694,"5min":2.448,"15min":1.736},"min":{"1min":0.36499999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":6.2300000000000004,"5min":40.026000000000003,"15min":58.506999999999998},"last":4.0759999999999996},{"interface":"front","average":{"1min":1.8460000000000001,"5min":2.1560000000000001,"15min":1.4730000000000001},"min":{"1min":0.33100000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":7.016,"5min":41.316000000000003,"15min":58.521000000000001},"last":0.60699999999999998}]},{"osd":5,"last update":"Fri Oct 8 19:32:01 2021","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.76600000000000001,"15min":0.57899999999999996},"min":{"1min":0.30199999999999999,"5min":0.247,"15min":0.222},"max":{"1min":7.101,"5min":7.101,"15min":7.101},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.76200000000000001,"15min":0.56299999999999994},"min":{"1min":0.32600000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.73899999999999999,"5min":8.1319999999999997,"15min":8.1319999999999997},"last":0.32600000000000001}]},{"osd":6,"last update":"Fri Oct 8 19:31:16 2021","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.80800000000000005,"15min":0.61399999999999999},"min":{"1min":0.318,"5min":0.26400000000000001,"15min":0.23599999999999999},"max":{"1min":2.306,"5min":6.7300000000000004,"15min":6.7300000000000004},"last":0.39900000000000002},{"interface":"front","average":{"1min":1.0509999999999999,"5min":0.91000000000000003,"15min":0.63300000000000001},"min":{"1min":0.307,"5min":0.247,"15min":0.247},"max":{"1min":7.0720000000000001,"5min":7.0720000000000001,"15min":7.0720000000000001},"last":0.51400000000000001}]},{"osd":7,"last update":"Fri Oct 8 19:31:37 2021","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.77700000000000002,"15min":0.60299999999999998},"min":{"1min":0.34100000000000003,"5min":0.29099999999999998,"15min":0.26400000000000001},"max":{"1min":2.1070000000000002,"5min":5.6719999999999997,"15min":5.6719999999999997},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.86699999999999999,"15min":0.69799999999999995},"min":{"1min":0.41599999999999998,"5min":0.30499999999999999,"15min":0.29699999999999999},"max":{"1min":2.0659999999999998,"5min":6.3959999999999999,"15min":6.3959999999999999},"last":0.436}]}]},{"osd":5,"up_from":38,"seq":163208757386,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1407352,"kb_used_data":1232944,"kb_used_omap":0,"kb_used_meta":174400,"kb_avail":92337800,"statfs":{"total":95995035648,"available":94553907200,"internally_reserved":0,"allocated":1262534656,"data_stored":1261798830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":178585600},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:31:55 2021","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.3720000000000001,"15min":1.05},"min":{"1min":0.24299999999999999,"5min":0.222,"15min":0.20599999999999999},"max":{"1min":7.968,"5min":24.597000000000001,"15min":24.597000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":1.155,"5min":1.5269999999999999,"15min":1.0109999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":3.4279999999999999,"5min":24.510999999999999,"15min":24.510999999999999},"last":0.55400000000000005}]},{"osd":1,"last update":"Fri Oct 8 19:31:55 2021","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":1.8440000000000001,"15min":1.157},"min":{"1min":0.28299999999999997,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":3.456,"5min":25.545000000000002,"15min":25.545000000000002},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.96099999999999997,"5min":1.7110000000000001,"15min":1.129},"min":{"1min":0.27200000000000002,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":2.238,"5min":25.556000000000001,"15min":25.556000000000001},"last":0.36199999999999999}]},{"osd":2,"last update":"Fri Oct 8 19:31:55 2021","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":1.504,"15min":1.2989999999999999},"min":{"1min":0.27000000000000002,"5min":0.25800000000000001,"15min":0.25700000000000001},"max":{"1min":2.2480000000000002,"5min":16.632999999999999,"15min":29.398},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.90100000000000002,"5min":1.393,"15min":1.3120000000000001},"min":{"1min":0.33400000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":2.6869999999999998,"5min":12.565,"15min":29.387},"last":0.33400000000000002}]},{"osd":3,"last update":"Fri Oct 8 19:31:55 2021","interfaces":[{"interface":"back","average":{"1min":1.7789999999999999,"5min":1.7350000000000001,"15min":1.2330000000000001},"min":{"1min":0.28899999999999998,"5min":0.28499999999999998,"15min":0.26200000000000001},"max":{"1min":11.685,"5min":12.356,"15min":12.356},"last":0.51000000000000001},{"interface":"front","average":{"1min":1.5249999999999999,"5min":2.1640000000000001,"15min":1.3819999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":8.9199999999999999,"5min":13.366,"15min":21.504000000000001},"last":0.624}]},{"osd":4,"last update":"Fri Oct 8 19:31:55 2021","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.72199999999999998,"15min":0.58099999999999996},"min":{"1min":0.26100000000000001,"5min":0.254,"15min":0.224},"max":{"1min":2.6899999999999999,"5min":4.3869999999999996,"15min":5.0780000000000003},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.69299999999999995,"15min":0.58599999999999997},"min":{"1min":0.27100000000000002,"5min":0.25900000000000001,"15min":0.23799999999999999},"max":{"1min":2.7570000000000001,"5min":6.1539999999999999,"15min":6.1539999999999999},"last":0.73399999999999999}]},{"osd":6,"last update":"Fri Oct 8 19:31:11 2021","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":0.82299999999999995,"15min":0.66000000000000003},"min":{"1min":0.30399999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":5.6840000000000002,"5min":5.6840000000000002,"15min":7.266},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.78100000000000003,"15min":0.64000000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29099999999999998},"max":{"1min":6.194,"5min":6.194,"15min":6.194},"last":0.64000000000000001}]},{"osd":7,"last update":"Fri Oct 8 19:31:35 2021","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.85799999999999998,"15min":0.66500000000000004},"min":{"1min":0.35499999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":3.4820000000000002,"5min":5.6120000000000001,"15min":5.6120000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":1.429,"5min":0.99399999999999999,"15min":0.75900000000000001},"min":{"1min":0.35999999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":7.6749999999999998,"5min":7.6749999999999998,"15min":7.6749999999999998},"last":1.4950000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":266240,"data_stored":262688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":327680,"data_stored":327680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":2338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":572653568,"data_stored":572653568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1281228800,"data_stored":1281228800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":425000960,"data_stored":425000960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1140391936,"data_stored":1140391936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":507117568,"data_stored":507117568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1262616576,"data_stored":1262616576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":423428096,"data_stored":423428096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1256259584,"data_stored":1256259584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-10-08T19:32:06.986 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph pg dump --format=json 2021-10-08T19:32:07.034 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:32:07.039 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:06 smithi097 ceph-mon[41966]: from='client.35522 v1:172.21.15.97:0/923613721' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:32:07.039 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:06 smithi097 ceph-mon[41966]: 5.17 scrub ok 2021-10-08T19:32:07.039 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:06 smithi097 ceph-mon[41966]: 6.e scrub ok 2021-10-08T19:32:07.040 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:06 smithi097 ceph-mon[41966]: 2.11 scrub ok 2021-10-08T19:32:07.040 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:06 smithi097 ceph-mon[41966]: 3.16 scrub ok 2021-10-08T19:32:07.041 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:07.041 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:32:07.043 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:06 smithi097 ceph-mon[32687]: from='client.35522 v1:172.21.15.97:0/923613721' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:32:07.043 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:06 smithi097 ceph-mon[32687]: 5.17 scrub ok 2021-10-08T19:32:07.043 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:06 smithi097 ceph-mon[32687]: 6.e scrub ok 2021-10-08T19:32:07.044 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:06 smithi097 ceph-mon[32687]: 2.11 scrub ok 2021-10-08T19:32:07.044 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:06 smithi097 ceph-mon[32687]: 3.16 scrub ok 2021-10-08T19:32:07.143 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:32:07.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:06 smithi117 ceph-mon[34585]: from='client.35522 v1:172.21.15.97:0/923613721' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:32:07.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:06 smithi117 ceph-mon[34585]: 5.17 scrub ok 2021-10-08T19:32:07.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:06 smithi117 ceph-mon[34585]: 6.e scrub ok 2021-10-08T19:32:07.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:06 smithi117 ceph-mon[34585]: 2.11 scrub ok 2021-10-08T19:32:07.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:06 smithi117 ceph-mon[34585]: 3.16 scrub ok 2021-10-08T19:32:07.158 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:32:06 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:32:07.203 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:07.328 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:32:07.388 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:32:07.397 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:07.398 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:32:07.426 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2021-10-08T19:32:07.499 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:32:07.546 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:07.636 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:32:07.638 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:07.638 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:32:07.739 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:32:07.800 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:07.824 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:32:07.835 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 24 16 40434 40418 105.214 87 0.00827783 0.00949577 2021-10-08T19:32:07.835 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:32:07.928 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:07 smithi097 ceph-mon[32687]: 5.b scrub ok 2021-10-08T19:32:07.929 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:07 smithi097 ceph-mon[32687]: pgmap v551: 178 pgs: 1 peering, 177 active+clean; 2.1 GiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 846 B/s rd, 74 MiB/s wr, 1.19k op/s; 5.6 MiB/s, 89 objects/s recovering 2021-10-08T19:32:07.929 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:07 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:32:07.929 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:07 smithi097 ceph-mon[32687]: 2.2 scrub ok 2021-10-08T19:32:07.930 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:07 smithi097 ceph-mon[41966]: 5.b scrub ok 2021-10-08T19:32:07.930 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:07 smithi097 ceph-mon[41966]: pgmap v551: 178 pgs: 1 peering, 177 active+clean; 2.1 GiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 846 B/s rd, 74 MiB/s wr, 1.19k op/s; 5.6 MiB/s, 89 objects/s recovering 2021-10-08T19:32:07.930 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:07 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:32:07.930 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:07 smithi097 ceph-mon[41966]: 2.2 scrub ok 2021-10-08T19:32:08.076 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:32:08.082 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:08.083 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:32:08.135 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:07 smithi117 ceph-mon[34585]: 5.b scrub ok 2021-10-08T19:32:08.135 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:07 smithi117 ceph-mon[34585]: pgmap v551: 178 pgs: 1 peering, 177 active+clean; 2.1 GiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 846 B/s rd, 74 MiB/s wr, 1.19k op/s; 5.6 MiB/s, 89 objects/s recovering 2021-10-08T19:32:08.135 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:07 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:32:08.136 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:07 smithi117 ceph-mon[34585]: 2.2 scrub ok 2021-10-08T19:32:08.183 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:32:08.264 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:08.610 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:32:08.615 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:08.616 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:32:08.718 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:32:08.774 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:08.789 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:08 smithi117 ceph-mon[34585]: 6.0 scrub ok 2021-10-08T19:32:08.789 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:08 smithi117 ceph-mon[34585]: 5.d scrub ok 2021-10-08T19:32:08.790 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:08 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:32:08.790 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:08 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:32:08.790 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:08 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1599044808' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:32:08.790 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:08 smithi117 ceph-mon[34585]: from='client.25498 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:32:08.819 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is unset 2021-10-08T19:32:08.835 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 25 16 41740 41724 104.27 81.625 0.0111114 0.00958494 2021-10-08T19:32:08.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:08 smithi097 ceph-mon[32687]: 6.0 scrub ok 2021-10-08T19:32:08.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:08 smithi097 ceph-mon[32687]: 5.d scrub ok 2021-10-08T19:32:08.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:08 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:32:08.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:08 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:32:08.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:08 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1599044808' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:32:08.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:08 smithi097 ceph-mon[32687]: from='client.25498 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:32:08.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:08 smithi097 ceph-mon[41966]: 6.0 scrub ok 2021-10-08T19:32:08.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:08 smithi097 ceph-mon[41966]: 5.d scrub ok 2021-10-08T19:32:08.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:08 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:32:08.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:08 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:32:08.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:08 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1599044808' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:32:08.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:08 smithi097 ceph-mon[41966]: from='client.25498 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:32:09.835 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 26 16 43085 43069 103.493 84.0625 0.0173953 0.00965763 2021-10-08T19:32:10.063 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:09 smithi117 ceph-mon[34585]: 3.13 scrub ok 2021-10-08T19:32:10.065 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:09 smithi117 ceph-mon[34585]: 4.b scrub ok 2021-10-08T19:32:10.065 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:09 smithi117 ceph-mon[34585]: 5.1 scrub ok 2021-10-08T19:32:10.065 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:09 smithi117 ceph-mon[34585]: pgmap v552: 178 pgs: 178 active+clean; 2.3 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 80 MiB/s wr, 1.28k op/s; 4.2 MiB/s, 67 objects/s recovering 2021-10-08T19:32:10.065 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:09 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:32:10.066 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:09 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:32:10.066 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:09 smithi117 ceph-mon[34585]: 6.4 scrub ok 2021-10-08T19:32:10.066 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:09 smithi117 ceph-mon[34585]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:32:10.067 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:09 smithi117 ceph-mon[34585]: Cluster is now healthy 2021-10-08T19:32:10.067 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:09 smithi117 ceph-mon[34585]: from='client.25498 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:32:10.067 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:09 smithi117 ceph-mon[34585]: osdmap e310: 8 total, 8 up, 8 in 2021-10-08T19:32:10.067 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:09 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:32:10.068 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:09 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:32:10.068 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:09 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:32:10.068 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:09 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:32:10.221 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:32:09 smithi097 conmon[33110]: 172.21.15.97 - - [08/Oct/2021:19:32:09] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:32:10.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:09 smithi097 ceph-mon[32687]: 3.13 scrub ok 2021-10-08T19:32:10.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:09 smithi097 ceph-mon[32687]: 4.b scrub ok 2021-10-08T19:32:10.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:09 smithi097 ceph-mon[32687]: 5.1 scrub ok 2021-10-08T19:32:10.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:09 smithi097 ceph-mon[32687]: pgmap v552: 178 pgs: 178 active+clean; 2.3 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 80 MiB/s wr, 1.28k op/s; 4.2 MiB/s, 67 objects/s recovering 2021-10-08T19:32:10.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:09 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:32:10.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:09 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:32:10.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:09 smithi097 ceph-mon[32687]: 6.4 scrub ok 2021-10-08T19:32:10.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:09 smithi097 ceph-mon[32687]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:32:10.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:09 smithi097 ceph-mon[32687]: Cluster is now healthy 2021-10-08T19:32:10.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:09 smithi097 ceph-mon[32687]: from='client.25498 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:32:10.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:09 smithi097 ceph-mon[32687]: osdmap e310: 8 total, 8 up, 8 in 2021-10-08T19:32:10.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:09 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:32:10.225 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:09 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:32:10.225 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:09 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:32:10.225 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:09 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:32:10.225 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:09 smithi097 ceph-mon[41966]: 3.13 scrub ok 2021-10-08T19:32:10.226 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:09 smithi097 ceph-mon[41966]: 4.b scrub ok 2021-10-08T19:32:10.226 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:09 smithi097 ceph-mon[41966]: 5.1 scrub ok 2021-10-08T19:32:10.226 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:09 smithi097 ceph-mon[41966]: pgmap v552: 178 pgs: 178 active+clean; 2.3 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 80 MiB/s wr, 1.28k op/s; 4.2 MiB/s, 67 objects/s recovering 2021-10-08T19:32:10.226 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:09 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:32:10.226 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:09 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:32:10.227 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:09 smithi097 ceph-mon[41966]: 6.4 scrub ok 2021-10-08T19:32:10.227 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:09 smithi097 ceph-mon[41966]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:32:10.227 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:09 smithi097 ceph-mon[41966]: Cluster is now healthy 2021-10-08T19:32:10.228 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:09 smithi097 ceph-mon[41966]: from='client.25498 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:32:10.228 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:09 smithi097 ceph-mon[41966]: osdmap e310: 8 total, 8 up, 8 in 2021-10-08T19:32:10.228 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:09 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:32:10.228 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:09 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:32:10.228 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:09 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:32:10.229 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:09 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:32:10.304 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2021-10-08T19:32:10.304 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:32:10.836 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 27 16 44692 44676 103.376 100.438 0.00530379 0.00966773 2021-10-08T19:32:10.973 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:32:10.982 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:10.983 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:32:10.984 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:10 smithi097 ceph-mon[41966]: 5.19 scrub ok 2021-10-08T19:32:10.984 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:10 smithi097 ceph-mon[41966]: osdmap e311: 8 total, 8 up, 8 in 2021-10-08T19:32:10.984 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:10 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:32:10.984 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:10 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:32:10.985 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:10 smithi097 ceph-mon[41966]: 172.21.15.97 - - [08/Oct/2021:19:32:09] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:32:10.985 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:10 smithi097 ceph-mon[32687]: 5.19 scrub ok 2021-10-08T19:32:10.985 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:10 smithi097 ceph-mon[32687]: osdmap e311: 8 total, 8 up, 8 in 2021-10-08T19:32:10.985 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:10 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:32:10.986 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:10 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:32:10.986 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:10 smithi097 ceph-mon[32687]: 172.21.15.97 - - [08/Oct/2021:19:32:09] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:32:11.084 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:32:11.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:10 smithi117 ceph-mon[34585]: 5.19 scrub ok 2021-10-08T19:32:11.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:10 smithi117 ceph-mon[34585]: osdmap e311: 8 total, 8 up, 8 in 2021-10-08T19:32:11.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:10 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:32:11.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:10 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:32:11.124 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:10 smithi117 ceph-mon[34585]: 172.21.15.97 - - [08/Oct/2021:19:32:09] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:32:11.128 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:11.431 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2021-10-08T19:32:11.444 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:32:11.447 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:11.449 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:32:11.551 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:32:11.610 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:11.733 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:32:11.738 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:11.739 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:32:11.840 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:32:11.843 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 28 16 46303 46287 103.264 100.688 0.00841049 0.0096794 2021-10-08T19:32:11.884 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:11.885 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:32:11.952 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:32:11.957 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:11.958 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:32:12.058 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:32:12.060 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:32:12.090 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:11 smithi117 ceph-mon[34585]: 5.4 scrub ok 2021-10-08T19:32:12.091 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:11 smithi117 ceph-mon[34585]: pgmap v555: 178 pgs: 178 active+clean; 2.5 GiB data, 8.9 GiB used, 706 GiB / 715 GiB avail; 735 B/s rd, 100 MiB/s wr, 1.59k op/s 2021-10-08T19:32:12.091 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:11 smithi117 ceph-mon[34585]: 5.1d scrub ok 2021-10-08T19:32:12.093 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:12.106 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:32:12.146 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:32:12.241 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:11 smithi097 ceph-mon[41966]: 5.4 scrub ok 2021-10-08T19:32:12.241 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:11 smithi097 ceph-mon[41966]: pgmap v555: 178 pgs: 178 active+clean; 2.5 GiB data, 8.9 GiB used, 706 GiB / 715 GiB avail; 735 B/s rd, 100 MiB/s wr, 1.59k op/s 2021-10-08T19:32:12.241 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:11 smithi097 ceph-mon[41966]: 5.1d scrub ok 2021-10-08T19:32:12.242 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:11 smithi097 ceph-mon[32687]: 5.4 scrub ok 2021-10-08T19:32:12.243 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:11 smithi097 ceph-mon[32687]: pgmap v555: 178 pgs: 178 active+clean; 2.5 GiB data, 8.9 GiB used, 706 GiB / 715 GiB avail; 735 B/s rd, 100 MiB/s wr, 1.59k op/s 2021-10-08T19:32:12.243 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:11 smithi097 ceph-mon[32687]: 5.1d scrub ok 2021-10-08T19:32:12.243 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:12.244 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:32:12.244 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:32:12.245 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:32:12.245 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:32:12.250 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:32:12.283 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:32:12.320 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:32:12.326 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true' 2021-10-08T19:32:12.326 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true' 2021-10-08T19:32:12.327 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true' 2021-10-08T19:32:12.327 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true' 2021-10-08T19:32:12.327 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true' 2021-10-08T19:32:12.327 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true' 2021-10-08T19:32:12.327 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'true' 2021-10-08T19:32:12.328 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'true' 2021-10-08T19:32:12.347 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:32:12.405 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:12.406 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:32:12 smithi117 conmon[69189]: level=error ts=2021-10-08T19:32:12.314Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=2 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:32:12.558 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:32:12.564 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:12.565 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:32:12.666 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:32:12.691 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:12.724 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set noscrub 2021-10-08T19:32:12.749 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:32:12.761 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2021-10-08T19:32:12.821 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:32:12.824 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:12.825 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:32:12.831 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:12 smithi097 ceph-mon[32687]: 4.5 scrub ok 2021-10-08T19:32:12.832 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:12 smithi097 ceph-mon[32687]: 5.1b scrub ok 2021-10-08T19:32:12.832 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:32:12 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:32:12] "GET /metrics HTTP/1.1" 200 155764 "" "Prometheus/2.18.1" 2021-10-08T19:32:12.840 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 29 16 47548 47532 102.386 77.8125 0.00961851 0.00976185 2021-10-08T19:32:12.926 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:32:12.964 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:13.046 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:32:13.049 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:13.050 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:32:13.151 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:32:13.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:12 smithi117 ceph-mon[34585]: 4.5 scrub ok 2021-10-08T19:32:13.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:12 smithi117 ceph-mon[34585]: 5.1b scrub ok 2021-10-08T19:32:13.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:12 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3162484579' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:32:13.196 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:12 smithi097 ceph-mon[41966]: 4.5 scrub ok 2021-10-08T19:32:13.196 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:12 smithi097 ceph-mon[41966]: 5.1b scrub ok 2021-10-08T19:32:13.196 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:12 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3162484579' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:32:13.197 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:12 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3162484579' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:32:13.208 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:13.841 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 30 16 48980 48964 101.955 89.5 0.0126175 0.00980251 2021-10-08T19:32:13.844 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:32:13.849 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:13.850 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:32:13.952 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:32:13.980 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:32:14.015 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:14.024 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":556,"stamp":"2021-10-08T19:32:12.703152+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2730885256,"num_objects":41857,"num_object_clones":0,"num_object_copies":125571,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41857,"num_whiteouts":0,"num_read":1720,"num_read_kb":1531,"num_write":42471,"num_write_kb":2667918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1616,"num_bytes_recovered":73622866,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43908,"ondisk_log_size":43908,"up":534,"acting":534,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":535,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":9352216,"kb_used_data":7941848,"kb_used_omap":0,"kb_used_meta":1410304,"kb_avail":740609000,"statfs":{"total":767960285184,"available":758383616000,"internally_reserved":0,"allocated":8132452352,"data_stored":8126458228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1444151296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":466943952,"num_objects":7125,"num_object_clones":0,"num_object_copies":21375,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7125,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":7125,"num_write_kb":456000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.006017"},"pg_stats":[{"pgid":"9.5","version":"310'2583","reported_seq":2610,"reported_epoch":310,"state":"active+clean","last_fresh":"2021-10-08T19:32:08.990969+0000","last_change":"2021-10-08T19:31:33.860522+0000","last_active":"2021-10-08T19:32:08.990969+0000","last_peered":"2021-10-08T19:32:08.990969+0000","last_clean":"2021-10-08T19:32:08.990969+0000","last_became_active":"2021-10-08T19:31:33.860267+0000","last_became_peered":"2021-10-08T19:31:33.860267+0000","last_unstale":"2021-10-08T19:32:08.990969+0000","last_undegraded":"2021-10-08T19:32:08.990969+0000","last_fullsized":"2021-10-08T19:32:08.990969+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.825378+0000","log_size":2583,"ondisk_log_size":2583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":169279488,"num_objects":2583,"num_object_clones":0,"num_object_copies":7749,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2583,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2583,"num_write_kb":165312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"114'10","reported_seq":435,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.743078+0000","last_change":"2021-10-08T19:31:34.407386+0000","last_active":"2021-10-08T19:32:03.743078+0000","last_peered":"2021-10-08T19:32:03.743078+0000","last_clean":"2021-10-08T19:32:03.743078+0000","last_became_active":"2021-10-08T19:24:25.096162+0000","last_became_peered":"2021-10-08T19:24:25.096162+0000","last_unstale":"2021-10-08T19:32:03.743078+0000","last_undegraded":"2021-10-08T19:32:03.743078+0000","last_fullsized":"2021-10-08T19:32:03.743078+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'10","last_scrub_stamp":"2021-10-08T19:31:34.407260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:31:34.407260+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0056601849999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"289'34","reported_seq":69,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.740332+0000","last_change":"2021-10-08T19:31:22.799079+0000","last_active":"2021-10-08T19:32:02.740332+0000","last_peered":"2021-10-08T19:32:02.740332+0000","last_clean":"2021-10-08T19:32:02.740332+0000","last_became_active":"2021-10-08T19:31:22.787271+0000","last_became_peered":"2021-10-08T19:31:22.787271+0000","last_unstale":"2021-10-08T19:32:02.740332+0000","last_undegraded":"2021-10-08T19:32:02.740332+0000","last_fullsized":"2021-10-08T19:32:02.740332+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'22","last_scrub_stamp":"2021-10-08T19:30:02.395784+0000","last_deep_scrub":"87'22","last_deep_scrub_stamp":"2021-10-08T19:22:58.705632+0000","last_clean_scrub_stamp":"2021-10-08T19:30:02.395784+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":298,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.744415+0000","last_change":"2021-10-08T19:31:20.447763+0000","last_active":"2021-10-08T19:32:03.744415+0000","last_peered":"2021-10-08T19:32:03.744415+0000","last_clean":"2021-10-08T19:32:03.744415+0000","last_became_active":"2021-10-08T19:29:40.632678+0000","last_became_peered":"2021-10-08T19:29:40.632678+0000","last_unstale":"2021-10-08T19:32:03.744415+0000","last_undegraded":"2021-10-08T19:32:03.744415+0000","last_fullsized":"2021-10-08T19:32:03.744415+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:20.447692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:31:20.447692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034280880000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":280,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.740429+0000","last_change":"2021-10-08T19:28:08.936871+0000","last_active":"2021-10-08T19:32:02.740429+0000","last_peered":"2021-10-08T19:32:02.740429+0000","last_clean":"2021-10-08T19:32:02.740429+0000","last_became_active":"2021-10-08T19:24:25.089002+0000","last_became_peered":"2021-10-08T19:24:25.089002+0000","last_unstale":"2021-10-08T19:32:02.740429+0000","last_undegraded":"2021-10-08T19:32:02.740429+0000","last_fullsized":"2021-10-08T19:32:02.740429+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:08.936801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:08.936801+0000","last_clean_scrub_stamp":"2021-10-08T19:28:08.936801+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0082775899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":203,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.744090+0000","last_change":"2021-10-08T19:30:34.099689+0000","last_active":"2021-10-08T19:32:02.744090+0000","last_peered":"2021-10-08T19:32:02.744090+0000","last_clean":"2021-10-08T19:32:02.744090+0000","last_became_active":"2021-10-08T19:25:15.510457+0000","last_became_peered":"2021-10-08T19:25:15.510457+0000","last_unstale":"2021-10-08T19:32:02.744090+0000","last_undegraded":"2021-10-08T19:32:02.744090+0000","last_fullsized":"2021-10-08T19:32:02.744090+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:30:34.099590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:30:34.099590+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010301708,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"309'2555","reported_seq":2582,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:08.507948+0000","last_change":"2021-10-08T19:31:33.858962+0000","last_active":"2021-10-08T19:32:08.507948+0000","last_peered":"2021-10-08T19:32:08.507948+0000","last_clean":"2021-10-08T19:32:08.507948+0000","last_became_active":"2021-10-08T19:31:33.858616+0000","last_became_peered":"2021-10-08T19:31:33.858616+0000","last_unstale":"2021-10-08T19:32:08.507948+0000","last_undegraded":"2021-10-08T19:32:08.507948+0000","last_fullsized":"2021-10-08T19:32:08.507948+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.825378+0000","log_size":2555,"ondisk_log_size":2555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":167444480,"num_objects":2555,"num_object_clones":0,"num_object_copies":7665,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2555,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2555,"num_write_kb":163520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,1],"acting":[5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"289'15","reported_seq":337,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:08.330967+0000","last_change":"2021-10-08T19:32:08.330872+0000","last_active":"2021-10-08T19:32:08.330967+0000","last_peered":"2021-10-08T19:32:08.330967+0000","last_clean":"2021-10-08T19:32:08.330967+0000","last_became_active":"2021-10-08T19:28:40.159729+0000","last_became_peered":"2021-10-08T19:28:40.159729+0000","last_unstale":"2021-10-08T19:32:08.330967+0000","last_undegraded":"2021-10-08T19:32:08.330967+0000","last_fullsized":"2021-10-08T19:32:08.330967+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'15","last_scrub_stamp":"2021-10-08T19:32:08.330768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:32:08.330768+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.024575211,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":140,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.747648+0000","last_change":"2021-10-08T19:30:05.020296+0000","last_active":"2021-10-08T19:32:03.747648+0000","last_peered":"2021-10-08T19:32:03.747648+0000","last_clean":"2021-10-08T19:32:03.747648+0000","last_became_active":"2021-10-08T19:29:40.624977+0000","last_became_peered":"2021-10-08T19:29:40.624977+0000","last_unstale":"2021-10-08T19:32:03.747648+0000","last_undegraded":"2021-10-08T19:32:03.747648+0000","last_fullsized":"2021-10-08T19:32:03.747648+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:30:05.020191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:30:05.020191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014132903,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":290,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.744652+0000","last_change":"2021-10-08T19:31:22.493389+0000","last_active":"2021-10-08T19:32:03.744652+0000","last_peered":"2021-10-08T19:32:03.744652+0000","last_clean":"2021-10-08T19:32:03.744652+0000","last_became_active":"2021-10-08T19:29:40.629422+0000","last_became_peered":"2021-10-08T19:29:40.629422+0000","last_unstale":"2021-10-08T19:32:03.744652+0000","last_undegraded":"2021-10-08T19:32:03.744652+0000","last_fullsized":"2021-10-08T19:32:03.744652+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:22.493317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:31:22.493317+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001455409,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":264,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.746443+0000","last_change":"2021-10-08T19:28:09.465717+0000","last_active":"2021-10-08T19:32:03.746443+0000","last_peered":"2021-10-08T19:32:03.746443+0000","last_clean":"2021-10-08T19:32:03.746443+0000","last_became_active":"2021-10-08T19:21:29.643022+0000","last_became_peered":"2021-10-08T19:21:29.643022+0000","last_unstale":"2021-10-08T19:32:03.746443+0000","last_undegraded":"2021-10-08T19:32:03.746443+0000","last_fullsized":"2021-10-08T19:32:03.746443+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:09.465640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:28:09.465640+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.040018977999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"70'5","reported_seq":742,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:07.007765+0000","last_change":"2021-10-08T19:30:10.566357+0000","last_active":"2021-10-08T19:32:07.007765+0000","last_peered":"2021-10-08T19:32:07.007765+0000","last_clean":"2021-10-08T19:32:07.007765+0000","last_became_active":"2021-10-08T19:29:40.630821+0000","last_became_peered":"2021-10-08T19:29:40.630821+0000","last_unstale":"2021-10-08T19:32:07.007765+0000","last_undegraded":"2021-10-08T19:32:07.007765+0000","last_fullsized":"2021-10-08T19:32:07.007765+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:30:10.566251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:30:10.566251+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0093751019999999997,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":466,"num_read_kb":466,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1167,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.7","version":"309'2527","reported_seq":2554,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:08.498749+0000","last_change":"2021-10-08T19:31:33.859765+0000","last_active":"2021-10-08T19:32:08.498749+0000","last_peered":"2021-10-08T19:32:08.498749+0000","last_clean":"2021-10-08T19:32:08.498749+0000","last_became_active":"2021-10-08T19:31:33.859470+0000","last_became_peered":"2021-10-08T19:31:33.859470+0000","last_unstale":"2021-10-08T19:32:08.498749+0000","last_undegraded":"2021-10-08T19:32:08.498749+0000","last_fullsized":"2021-10-08T19:32:08.498749+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.825378+0000","log_size":2527,"ondisk_log_size":2527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":165609472,"num_objects":2527,"num_object_clones":0,"num_object_copies":7581,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2527,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2527,"num_write_kb":161728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"289'35","reported_seq":322,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.746808+0000","last_change":"2021-10-08T19:30:51.708220+0000","last_active":"2021-10-08T19:32:02.746808+0000","last_peered":"2021-10-08T19:32:02.746808+0000","last_clean":"2021-10-08T19:32:02.746808+0000","last_became_active":"2021-10-08T19:28:40.101648+0000","last_became_peered":"2021-10-08T19:28:40.101648+0000","last_unstale":"2021-10-08T19:32:02.746808+0000","last_undegraded":"2021-10-08T19:32:02.746808+0000","last_fullsized":"2021-10-08T19:32:02.746808+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'19","last_scrub_stamp":"2021-10-08T19:30:51.708148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:30:51.708148+0000","log_size":35,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011269507999999999,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":55,"num_read_kb":44,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":276,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.744152+0000","last_change":"2021-10-08T19:31:25.413760+0000","last_active":"2021-10-08T19:32:03.744152+0000","last_peered":"2021-10-08T19:32:03.744152+0000","last_clean":"2021-10-08T19:32:03.744152+0000","last_became_active":"2021-10-08T19:21:23.595919+0000","last_became_peered":"2021-10-08T19:21:23.595919+0000","last_unstale":"2021-10-08T19:32:03.744152+0000","last_undegraded":"2021-10-08T19:32:03.744152+0000","last_fullsized":"2021-10-08T19:32:03.744152+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:25.412652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:31:25.412652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0041148390000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":290,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:06.505719+0000","last_change":"2021-10-08T19:32:06.505248+0000","last_active":"2021-10-08T19:32:06.505719+0000","last_peered":"2021-10-08T19:32:06.505719+0000","last_clean":"2021-10-08T19:32:06.505719+0000","last_became_active":"2021-10-08T19:31:22.783725+0000","last_became_peered":"2021-10-08T19:31:22.783725+0000","last_unstale":"2021-10-08T19:32:06.505719+0000","last_undegraded":"2021-10-08T19:32:06.505719+0000","last_fullsized":"2021-10-08T19:32:06.505719+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:06.505167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:32:06.505167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034864760000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":287,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.738543+0000","last_change":"2021-10-08T19:31:33.368701+0000","last_active":"2021-10-08T19:32:02.738543+0000","last_peered":"2021-10-08T19:32:02.738543+0000","last_clean":"2021-10-08T19:32:02.738543+0000","last_became_active":"2021-10-08T19:29:40.638354+0000","last_became_peered":"2021-10-08T19:29:40.638354+0000","last_unstale":"2021-10-08T19:32:02.738543+0000","last_undegraded":"2021-10-08T19:32:02.738543+0000","last_fullsized":"2021-10-08T19:32:02.738543+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:33.368627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:39.528699+0000","last_clean_scrub_stamp":"2021-10-08T19:31:33.368627+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0018418429999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":214,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.742109+0000","last_change":"2021-10-08T19:31:22.785932+0000","last_active":"2021-10-08T19:32:02.742109+0000","last_peered":"2021-10-08T19:32:02.742109+0000","last_clean":"2021-10-08T19:32:02.742109+0000","last_became_active":"2021-10-08T19:31:22.785590+0000","last_became_peered":"2021-10-08T19:31:22.785590+0000","last_unstale":"2021-10-08T19:32:02.742109+0000","last_undegraded":"2021-10-08T19:32:02.742109+0000","last_fullsized":"2021-10-08T19:32:02.742109+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:30:09.007285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:30:09.007285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0035985000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.0","version":"310'2651","reported_seq":2678,"reported_epoch":310,"state":"active+clean","last_fresh":"2021-10-08T19:32:08.977913+0000","last_change":"2021-10-08T19:31:34.405279+0000","last_active":"2021-10-08T19:32:08.977913+0000","last_peered":"2021-10-08T19:32:08.977913+0000","last_clean":"2021-10-08T19:32:08.977913+0000","last_became_active":"2021-10-08T19:31:34.404922+0000","last_became_peered":"2021-10-08T19:31:34.404922+0000","last_unstale":"2021-10-08T19:32:08.977913+0000","last_undegraded":"2021-10-08T19:32:08.977913+0000","last_fullsized":"2021-10-08T19:32:08.977913+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.825378+0000","log_size":2651,"ondisk_log_size":2651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":173735936,"num_objects":2651,"num_object_clones":0,"num_object_copies":7953,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2651,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2651,"num_write_kb":169664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.8","version":"90'130","reported_seq":383,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.742819+0000","last_change":"2021-10-08T19:31:25.647883+0000","last_active":"2021-10-08T19:32:02.742819+0000","last_peered":"2021-10-08T19:32:02.742819+0000","last_clean":"2021-10-08T19:32:02.742819+0000","last_became_active":"2021-10-08T19:31:25.647505+0000","last_became_peered":"2021-10-08T19:31:25.647505+0000","last_unstale":"2021-10-08T19:32:02.742819+0000","last_undegraded":"2021-10-08T19:32:02.742819+0000","last_fullsized":"2021-10-08T19:32:02.742819+0000","mapping_epoch":286,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":287,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.284249+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020087920000000001,"stat_sum":{"num_bytes":53670,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":28,"num_write":16,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":686385,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"289'31","reported_seq":370,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.758111+0000","last_change":"2021-10-08T19:28:40.209057+0000","last_active":"2021-10-08T19:32:03.758111+0000","last_peered":"2021-10-08T19:32:03.758111+0000","last_clean":"2021-10-08T19:32:03.758111+0000","last_became_active":"2021-10-08T19:28:40.099618+0000","last_became_peered":"2021-10-08T19:28:40.099618+0000","last_unstale":"2021-10-08T19:32:03.758111+0000","last_undegraded":"2021-10-08T19:32:03.758111+0000","last_fullsized":"2021-10-08T19:32:03.758111+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'17","last_scrub_stamp":"2021-10-08T19:28:02.599959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:28:02.599959+0000","log_size":31,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0066589689999999998,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":50,"num_read_kb":40,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"61'1","reported_seq":277,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.742844+0000","last_change":"2021-10-08T19:28:05.469192+0000","last_active":"2021-10-08T19:32:02.742844+0000","last_peered":"2021-10-08T19:32:02.742844+0000","last_clean":"2021-10-08T19:32:02.742844+0000","last_became_active":"2021-10-08T19:21:23.607064+0000","last_became_peered":"2021-10-08T19:21:23.607064+0000","last_unstale":"2021-10-08T19:32:02.742844+0000","last_undegraded":"2021-10-08T19:32:02.742844+0000","last_fullsized":"2021-10-08T19:32:02.742844+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'1","last_scrub_stamp":"2021-10-08T19:28:05.469109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:28:05.469109+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013719907,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":122,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.747420+0000","last_change":"2021-10-08T19:30:09.081744+0000","last_active":"2021-10-08T19:32:03.747420+0000","last_peered":"2021-10-08T19:32:03.747420+0000","last_clean":"2021-10-08T19:32:03.747420+0000","last_became_active":"2021-10-08T19:28:40.152478+0000","last_became_peered":"2021-10-08T19:28:40.152478+0000","last_unstale":"2021-10-08T19:32:03.747420+0000","last_undegraded":"2021-10-08T19:32:03.747420+0000","last_fullsized":"2021-10-08T19:32:03.747420+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:30:09.081635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:30:09.081635+0000","last_clean_scrub_stamp":"2021-10-08T19:30:09.081635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013186959,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":288,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.744116+0000","last_change":"2021-10-08T19:31:34.486619+0000","last_active":"2021-10-08T19:32:03.744116+0000","last_peered":"2021-10-08T19:32:03.744116+0000","last_clean":"2021-10-08T19:32:03.744116+0000","last_became_active":"2021-10-08T19:29:40.629424+0000","last_became_peered":"2021-10-08T19:29:40.629424+0000","last_unstale":"2021-10-08T19:32:03.744116+0000","last_undegraded":"2021-10-08T19:32:03.744116+0000","last_fullsized":"2021-10-08T19:32:03.744116+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:34.486475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:31:34.486475+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.064897938000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":247,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.746963+0000","last_change":"2021-10-08T19:31:51.677159+0000","last_active":"2021-10-08T19:32:02.746963+0000","last_peered":"2021-10-08T19:32:02.746963+0000","last_clean":"2021-10-08T19:32:02.746963+0000","last_became_active":"2021-10-08T19:31:51.676829+0000","last_became_peered":"2021-10-08T19:31:51.676829+0000","last_unstale":"2021-10-08T19:32:02.746963+0000","last_undegraded":"2021-10-08T19:32:02.746963+0000","last_fullsized":"2021-10-08T19:32:02.746963+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:14.495972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:28:14.495972+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0033138379999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"310'2589","reported_seq":2617,"reported_epoch":310,"state":"active+clean","last_fresh":"2021-10-08T19:32:08.970755+0000","last_change":"2021-10-08T19:31:34.405282+0000","last_active":"2021-10-08T19:32:08.970755+0000","last_peered":"2021-10-08T19:32:08.970755+0000","last_clean":"2021-10-08T19:32:08.970755+0000","last_became_active":"2021-10-08T19:31:34.404950+0000","last_became_peered":"2021-10-08T19:31:34.404950+0000","last_unstale":"2021-10-08T19:32:08.970755+0000","last_undegraded":"2021-10-08T19:32:08.970755+0000","last_fullsized":"2021-10-08T19:32:08.970755+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.825378+0000","log_size":2589,"ondisk_log_size":2589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":169672704,"num_objects":2589,"num_object_clones":0,"num_object_copies":7767,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2589,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2589,"num_write_kb":165696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.9","version":"90'130","reported_seq":617,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.739237+0000","last_change":"2021-10-08T19:29:43.635142+0000","last_active":"2021-10-08T19:32:02.739237+0000","last_peered":"2021-10-08T19:32:02.739237+0000","last_clean":"2021-10-08T19:32:02.739237+0000","last_became_active":"2021-10-08T19:29:43.634789+0000","last_became_peered":"2021-10-08T19:29:43.634789+0000","last_unstale":"2021-10-08T19:32:02.739237+0000","last_undegraded":"2021-10-08T19:32:02.739237+0000","last_fullsized":"2021-10-08T19:32:02.739237+0000","mapping_epoch":239,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.284249+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0045617870000000003,"stat_sum":{"num_bytes":53670,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":28,"num_write":16,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":268349,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"289'20","reported_seq":381,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.757516+0000","last_change":"2021-10-08T19:29:41.080904+0000","last_active":"2021-10-08T19:32:03.757516+0000","last_peered":"2021-10-08T19:32:03.757516+0000","last_clean":"2021-10-08T19:32:03.757516+0000","last_became_active":"2021-10-08T19:29:40.631807+0000","last_became_peered":"2021-10-08T19:29:40.631807+0000","last_unstale":"2021-10-08T19:32:03.757516+0000","last_undegraded":"2021-10-08T19:32:03.757516+0000","last_fullsized":"2021-10-08T19:32:03.757516+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'10","last_scrub_stamp":"2021-10-08T19:28:00.572215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:28:00.572215+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011508064,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":142,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.746253+0000","last_change":"2021-10-08T19:31:19.445145+0000","last_active":"2021-10-08T19:32:03.746253+0000","last_peered":"2021-10-08T19:32:03.746253+0000","last_clean":"2021-10-08T19:32:03.746253+0000","last_became_active":"2021-10-08T19:29:40.638988+0000","last_became_peered":"2021-10-08T19:29:40.638988+0000","last_unstale":"2021-10-08T19:32:03.746253+0000","last_undegraded":"2021-10-08T19:32:03.746253+0000","last_fullsized":"2021-10-08T19:32:03.746253+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:19.445067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:31:19.445067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0014240679999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"250'9","reported_seq":416,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:07.491044+0000","last_change":"2021-10-08T19:32:07.490663+0000","last_active":"2021-10-08T19:32:07.491044+0000","last_peered":"2021-10-08T19:32:07.491044+0000","last_clean":"2021-10-08T19:32:07.491044+0000","last_became_active":"2021-10-08T19:21:27.637930+0000","last_became_peered":"2021-10-08T19:21:27.637930+0000","last_unstale":"2021-10-08T19:32:07.491044+0000","last_undegraded":"2021-10-08T19:32:07.491044+0000","last_fullsized":"2021-10-08T19:32:07.491044+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'9","last_scrub_stamp":"2021-10-08T19:32:07.490536+0000","last_deep_scrub":"250'9","last_deep_scrub_stamp":"2021-10-08T19:30:04.239189+0000","last_clean_scrub_stamp":"2021-10-08T19:32:07.490536+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0085166219999999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":287,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:05.558560+0000","last_change":"2021-10-08T19:32:05.558417+0000","last_active":"2021-10-08T19:32:05.558560+0000","last_peered":"2021-10-08T19:32:05.558560+0000","last_clean":"2021-10-08T19:32:05.558560+0000","last_became_active":"2021-10-08T19:28:40.100213+0000","last_became_peered":"2021-10-08T19:28:40.100213+0000","last_unstale":"2021-10-08T19:32:05.558560+0000","last_undegraded":"2021-10-08T19:32:05.558560+0000","last_fullsized":"2021-10-08T19:32:05.558560+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:05.558296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:32:05.558296+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.018815749,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":83,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.752949+0000","last_change":"2021-10-08T19:29:44.443830+0000","last_active":"2021-10-08T19:32:03.752949+0000","last_peered":"2021-10-08T19:32:03.752949+0000","last_clean":"2021-10-08T19:32:03.752949+0000","last_became_active":"2021-10-08T19:29:44.443507+0000","last_became_peered":"2021-10-08T19:29:44.443507+0000","last_unstale":"2021-10-08T19:32:03.752949+0000","last_undegraded":"2021-10-08T19:32:03.752949+0000","last_fullsized":"2021-10-08T19:32:03.752949+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:05.180500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:28:05.180500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"310'2619","reported_seq":2647,"reported_epoch":310,"state":"active+clean","last_fresh":"2021-10-08T19:32:08.976099+0000","last_change":"2021-10-08T19:31:33.858496+0000","last_active":"2021-10-08T19:32:08.976099+0000","last_peered":"2021-10-08T19:32:08.976099+0000","last_clean":"2021-10-08T19:32:08.976099+0000","last_became_active":"2021-10-08T19:31:33.858205+0000","last_became_peered":"2021-10-08T19:31:33.858205+0000","last_unstale":"2021-10-08T19:32:08.976099+0000","last_undegraded":"2021-10-08T19:32:08.976099+0000","last_fullsized":"2021-10-08T19:32:08.976099+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.825378+0000","log_size":2619,"ondisk_log_size":2619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":171638784,"num_objects":2619,"num_object_clones":0,"num_object_copies":7857,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2619,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2619,"num_write_kb":167616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.a","version":"90'130","reported_seq":451,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.740288+0000","last_change":"2021-10-08T19:31:35.822183+0000","last_active":"2021-10-08T19:32:02.740288+0000","last_peered":"2021-10-08T19:32:02.740288+0000","last_clean":"2021-10-08T19:32:02.740288+0000","last_became_active":"2021-10-08T19:27:26.591129+0000","last_became_peered":"2021-10-08T19:27:26.591129+0000","last_unstale":"2021-10-08T19:32:02.740288+0000","last_undegraded":"2021-10-08T19:32:02.740288+0000","last_fullsized":"2021-10-08T19:32:02.740288+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:31:35.822084+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:31:35.822084+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0016817410000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.f","version":"289'27","reported_seq":206,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.747771+0000","last_change":"2021-10-08T19:31:30.379641+0000","last_active":"2021-10-08T19:32:03.747771+0000","last_peered":"2021-10-08T19:32:03.747771+0000","last_clean":"2021-10-08T19:32:03.747771+0000","last_became_active":"2021-10-08T19:29:40.639877+0000","last_became_peered":"2021-10-08T19:29:40.639877+0000","last_unstale":"2021-10-08T19:32:03.747771+0000","last_undegraded":"2021-10-08T19:32:03.747771+0000","last_fullsized":"2021-10-08T19:32:03.747771+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'15","last_scrub_stamp":"2021-10-08T19:31:30.379547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:31:30.379547+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039949520000000004,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":140,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.745725+0000","last_change":"2021-10-08T19:30:11.103026+0000","last_active":"2021-10-08T19:32:03.745725+0000","last_peered":"2021-10-08T19:32:03.745725+0000","last_clean":"2021-10-08T19:32:03.745725+0000","last_became_active":"2021-10-08T19:29:40.631290+0000","last_became_peered":"2021-10-08T19:29:40.631290+0000","last_unstale":"2021-10-08T19:32:03.745725+0000","last_undegraded":"2021-10-08T19:32:03.745725+0000","last_fullsized":"2021-10-08T19:32:03.745725+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:30:11.102934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:30:11.102934+0000","last_clean_scrub_stamp":"2021-10-08T19:30:11.102934+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.020040438000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"88'9","reported_seq":406,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:06.849490+0000","last_change":"2021-10-08T19:28:01.592286+0000","last_active":"2021-10-08T19:32:06.849490+0000","last_peered":"2021-10-08T19:32:06.849490+0000","last_clean":"2021-10-08T19:32:06.849490+0000","last_became_active":"2021-10-08T19:21:27.636432+0000","last_became_peered":"2021-10-08T19:21:27.636432+0000","last_unstale":"2021-10-08T19:32:06.849490+0000","last_undegraded":"2021-10-08T19:32:06.849490+0000","last_fullsized":"2021-10-08T19:32:06.849490+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'9","last_scrub_stamp":"2021-10-08T19:28:01.592208+0000","last_deep_scrub":"88'9","last_deep_scrub_stamp":"2021-10-08T19:23:00.048245+0000","last_clean_scrub_stamp":"2021-10-08T19:28:01.592208+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0051143930000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":288,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.741657+0000","last_change":"2021-10-08T19:30:32.621917+0000","last_active":"2021-10-08T19:32:02.741657+0000","last_peered":"2021-10-08T19:32:02.741657+0000","last_clean":"2021-10-08T19:32:02.741657+0000","last_became_active":"2021-10-08T19:28:40.137966+0000","last_became_peered":"2021-10-08T19:28:40.137966+0000","last_unstale":"2021-10-08T19:32:02.741657+0000","last_undegraded":"2021-10-08T19:32:02.741657+0000","last_fullsized":"2021-10-08T19:32:02.741657+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:30:32.621835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:30:32.621835+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.01635269,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.8","version":"70'5","reported_seq":83,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.751925+0000","last_change":"2021-10-08T19:29:40.641255+0000","last_active":"2021-10-08T19:32:03.751925+0000","last_peered":"2021-10-08T19:32:03.751925+0000","last_clean":"2021-10-08T19:32:03.751925+0000","last_became_active":"2021-10-08T19:29:40.639786+0000","last_became_peered":"2021-10-08T19:29:40.639786+0000","last_unstale":"2021-10-08T19:32:03.751925+0000","last_undegraded":"2021-10-08T19:32:03.751925+0000","last_fullsized":"2021-10-08T19:32:03.751925+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:28:08.162564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:28:08.162564+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.039687264,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3","version":"309'2594","reported_seq":2621,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:08.489455+0000","last_change":"2021-10-08T19:31:33.862720+0000","last_active":"2021-10-08T19:32:08.489455+0000","last_peered":"2021-10-08T19:32:08.489455+0000","last_clean":"2021-10-08T19:32:08.489455+0000","last_became_active":"2021-10-08T19:31:33.861869+0000","last_became_peered":"2021-10-08T19:31:33.861869+0000","last_unstale":"2021-10-08T19:32:08.489455+0000","last_undegraded":"2021-10-08T19:32:08.489455+0000","last_fullsized":"2021-10-08T19:32:08.489455+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.825378+0000","log_size":2594,"ondisk_log_size":2594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":170000384,"num_objects":2594,"num_object_clones":0,"num_object_copies":7782,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2594,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2594,"num_write_kb":166016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"289'19","reported_seq":445,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.757824+0000","last_change":"2021-10-08T19:31:51.686731+0000","last_active":"2021-10-08T19:32:03.757824+0000","last_peered":"2021-10-08T19:32:03.757824+0000","last_clean":"2021-10-08T19:32:03.757824+0000","last_became_active":"2021-10-08T19:31:51.677509+0000","last_became_peered":"2021-10-08T19:31:51.677509+0000","last_unstale":"2021-10-08T19:32:03.757824+0000","last_undegraded":"2021-10-08T19:32:03.757824+0000","last_fullsized":"2021-10-08T19:32:03.757824+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'11","last_scrub_stamp":"2021-10-08T19:28:08.680153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:28:08.680153+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0066172430000000001,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":770,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":295,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.738688+0000","last_change":"2021-10-08T19:30:11.036131+0000","last_active":"2021-10-08T19:32:02.738688+0000","last_peered":"2021-10-08T19:32:02.738688+0000","last_clean":"2021-10-08T19:32:02.738688+0000","last_became_active":"2021-10-08T19:28:40.100691+0000","last_became_peered":"2021-10-08T19:28:40.100691+0000","last_unstale":"2021-10-08T19:32:02.738688+0000","last_undegraded":"2021-10-08T19:32:02.738688+0000","last_fullsized":"2021-10-08T19:32:02.738688+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:30:11.036056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:30:11.036056+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0045723780000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":282,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.742593+0000","last_change":"2021-10-08T19:28:11.939647+0000","last_active":"2021-10-08T19:32:02.742593+0000","last_peered":"2021-10-08T19:32:02.742593+0000","last_clean":"2021-10-08T19:32:02.742593+0000","last_became_active":"2021-10-08T19:24:25.105244+0000","last_became_peered":"2021-10-08T19:24:25.105244+0000","last_unstale":"2021-10-08T19:32:02.742593+0000","last_undegraded":"2021-10-08T19:32:02.742593+0000","last_fullsized":"2021-10-08T19:32:02.742593+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:11.939557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:28:11.939557+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.005546044,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":89,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.754336+0000","last_change":"2021-10-08T19:30:00.182902+0000","last_active":"2021-10-08T19:32:03.754336+0000","last_peered":"2021-10-08T19:32:03.754336+0000","last_clean":"2021-10-08T19:32:03.754336+0000","last_became_active":"2021-10-08T19:29:40.638099+0000","last_became_peered":"2021-10-08T19:29:40.638099+0000","last_unstale":"2021-10-08T19:32:03.754336+0000","last_undegraded":"2021-10-08T19:32:03.754336+0000","last_fullsized":"2021-10-08T19:32:03.754336+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:30:00.182809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:17.422176+0000","last_clean_scrub_stamp":"2021-10-08T19:30:00.182809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0084241090000000008,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":220,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.757012+0000","last_change":"2021-10-08T19:30:02.409684+0000","last_active":"2021-10-08T19:32:03.757012+0000","last_peered":"2021-10-08T19:32:03.757012+0000","last_clean":"2021-10-08T19:32:03.757012+0000","last_became_active":"2021-10-08T19:24:13.506602+0000","last_became_peered":"2021-10-08T19:24:13.506602+0000","last_unstale":"2021-10-08T19:32:03.757012+0000","last_undegraded":"2021-10-08T19:32:03.757012+0000","last_fullsized":"2021-10-08T19:32:03.757012+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:30:02.409605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:30:02.409605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013592109,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.c","version":"310'2649","reported_seq":2677,"reported_epoch":310,"state":"active+clean","last_fresh":"2021-10-08T19:32:08.966414+0000","last_change":"2021-10-08T19:31:33.861894+0000","last_active":"2021-10-08T19:32:08.966414+0000","last_peered":"2021-10-08T19:32:08.966414+0000","last_clean":"2021-10-08T19:32:08.966414+0000","last_became_active":"2021-10-08T19:31:33.861544+0000","last_became_peered":"2021-10-08T19:31:33.861544+0000","last_unstale":"2021-10-08T19:32:08.966414+0000","last_undegraded":"2021-10-08T19:32:08.966414+0000","last_fullsized":"2021-10-08T19:32:08.966414+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.825378+0000","log_size":2649,"ondisk_log_size":2649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":173604864,"num_objects":2649,"num_object_clones":0,"num_object_copies":7947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2649,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2649,"num_write_kb":169536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"90'130","reported_seq":413,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.754247+0000","last_change":"2021-10-08T19:29:43.637064+0000","last_active":"2021-10-08T19:32:03.754247+0000","last_peered":"2021-10-08T19:32:03.754247+0000","last_clean":"2021-10-08T19:32:03.754247+0000","last_became_active":"2021-10-08T19:29:43.636733+0000","last_became_peered":"2021-10-08T19:29:43.636733+0000","last_unstale":"2021-10-08T19:32:03.754247+0000","last_undegraded":"2021-10-08T19:32:03.754247+0000","last_fullsized":"2021-10-08T19:32:03.754247+0000","mapping_epoch":239,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.284249+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020087920000000001,"stat_sum":{"num_bytes":53670,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":28,"num_write":16,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":816370,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"238'13","reported_seq":125,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:06.849086+0000","last_change":"2021-10-08T19:31:21.473012+0000","last_active":"2021-10-08T19:32:06.849086+0000","last_peered":"2021-10-08T19:32:06.849086+0000","last_clean":"2021-10-08T19:32:06.849086+0000","last_became_active":"2021-10-08T19:29:40.640248+0000","last_became_peered":"2021-10-08T19:29:40.640248+0000","last_unstale":"2021-10-08T19:32:06.849086+0000","last_undegraded":"2021-10-08T19:32:06.849086+0000","last_fullsized":"2021-10-08T19:32:06.849086+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"238'13","last_scrub_stamp":"2021-10-08T19:31:21.472930+0000","last_deep_scrub":"91'9","last_deep_scrub_stamp":"2021-10-08T19:23:32.329475+0000","last_clean_scrub_stamp":"2021-10-08T19:31:21.472930+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040000679999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"289'28","reported_seq":365,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.757230+0000","last_change":"2021-10-08T19:32:02.490565+0000","last_active":"2021-10-08T19:32:03.757230+0000","last_peered":"2021-10-08T19:32:03.757230+0000","last_clean":"2021-10-08T19:32:03.757230+0000","last_became_active":"2021-10-08T19:24:25.098743+0000","last_became_peered":"2021-10-08T19:24:25.098743+0000","last_unstale":"2021-10-08T19:32:03.757230+0000","last_undegraded":"2021-10-08T19:32:03.757230+0000","last_fullsized":"2021-10-08T19:32:03.757230+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'28","last_scrub_stamp":"2021-10-08T19:32:02.490435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:32:02.490435+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.005683698,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":42,"num_read_kb":35,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":211,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.747583+0000","last_change":"2021-10-08T19:29:57.443163+0000","last_active":"2021-10-08T19:32:02.747583+0000","last_peered":"2021-10-08T19:32:02.747583+0000","last_clean":"2021-10-08T19:32:02.747583+0000","last_became_active":"2021-10-08T19:24:25.094364+0000","last_became_peered":"2021-10-08T19:24:25.094364+0000","last_unstale":"2021-10-08T19:32:02.747583+0000","last_undegraded":"2021-10-08T19:32:02.747583+0000","last_fullsized":"2021-10-08T19:32:02.747583+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:29:57.443059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:29:57.443059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.004499304,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":283,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.742926+0000","last_change":"2021-10-08T19:28:01.468726+0000","last_active":"2021-10-08T19:32:02.742926+0000","last_peered":"2021-10-08T19:32:02.742926+0000","last_clean":"2021-10-08T19:32:02.742926+0000","last_became_active":"2021-10-08T19:24:25.094848+0000","last_became_peered":"2021-10-08T19:24:25.094848+0000","last_unstale":"2021-10-08T19:32:02.742926+0000","last_undegraded":"2021-10-08T19:32:02.742926+0000","last_fullsized":"2021-10-08T19:32:02.742926+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:01.468644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:28:01.468644+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.030033254999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":247,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.746072+0000","last_change":"2021-10-08T19:32:03.275025+0000","last_active":"2021-10-08T19:32:03.746072+0000","last_peered":"2021-10-08T19:32:03.746072+0000","last_clean":"2021-10-08T19:32:03.746072+0000","last_became_active":"2021-10-08T19:28:40.132751+0000","last_became_peered":"2021-10-08T19:28:40.132751+0000","last_unstale":"2021-10-08T19:32:03.746072+0000","last_undegraded":"2021-10-08T19:32:03.746072+0000","last_fullsized":"2021-10-08T19:32:03.746072+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:03.274966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:03.274966+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001658084,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.d","version":"309'2624","reported_seq":4842,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:08.492603+0000","last_change":"2021-10-08T19:32:03.749570+0000","last_active":"2021-10-08T19:32:08.492603+0000","last_peered":"2021-10-08T19:32:08.492603+0000","last_clean":"2021-10-08T19:32:08.492603+0000","last_became_active":"2021-10-08T19:32:03.747395+0000","last_became_peered":"2021-10-08T19:32:03.747395+0000","last_unstale":"2021-10-08T19:32:08.492603+0000","last_undegraded":"2021-10-08T19:32:08.492603+0000","last_fullsized":"2021-10-08T19:32:08.492603+0000","mapping_epoch":308,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":309,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.825378+0000","log_size":2624,"ondisk_log_size":2624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":171966464,"num_objects":2624,"num_object_clones":0,"num_object_copies":7872,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2624,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2624,"num_write_kb":167936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1088,"num_bytes_recovered":71303168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5],"acting":[7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.5","version":"90'130","reported_seq":446,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.757673+0000","last_change":"2021-10-08T19:27:26.591042+0000","last_active":"2021-10-08T19:32:03.757673+0000","last_peered":"2021-10-08T19:32:03.757673+0000","last_clean":"2021-10-08T19:32:03.757673+0000","last_became_active":"2021-10-08T19:27:26.590651+0000","last_became_peered":"2021-10-08T19:27:26.590651+0000","last_unstale":"2021-10-08T19:32:03.757673+0000","last_undegraded":"2021-10-08T19:32:03.757673+0000","last_fullsized":"2021-10-08T19:32:03.757673+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.284249+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020087920000000001,"stat_sum":{"num_bytes":53670,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":28,"num_write":16,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":161010,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":289,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:08.581994+0000","last_change":"2021-10-08T19:32:08.581599+0000","last_active":"2021-10-08T19:32:08.581994+0000","last_peered":"2021-10-08T19:32:08.581994+0000","last_clean":"2021-10-08T19:32:08.581994+0000","last_became_active":"2021-10-08T19:29:40.639405+0000","last_became_peered":"2021-10-08T19:29:40.639405+0000","last_unstale":"2021-10-08T19:32:08.581994+0000","last_undegraded":"2021-10-08T19:32:08.581994+0000","last_fullsized":"2021-10-08T19:32:08.581994+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:08.581479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:32:08.581479+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012079604000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"289'30","reported_seq":125,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.751837+0000","last_change":"2021-10-08T19:30:11.192496+0000","last_active":"2021-10-08T19:32:03.751837+0000","last_peered":"2021-10-08T19:32:03.751837+0000","last_clean":"2021-10-08T19:32:03.751837+0000","last_became_active":"2021-10-08T19:29:40.635007+0000","last_became_peered":"2021-10-08T19:29:40.635007+0000","last_unstale":"2021-10-08T19:32:03.751837+0000","last_undegraded":"2021-10-08T19:32:03.751837+0000","last_fullsized":"2021-10-08T19:32:03.751837+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'18","last_scrub_stamp":"2021-10-08T19:30:11.192395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:30:11.192395+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0092167559999999996,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":51,"num_read_kb":39,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":116,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.747875+0000","last_change":"2021-10-08T19:28:40.146228+0000","last_active":"2021-10-08T19:32:03.747875+0000","last_peered":"2021-10-08T19:32:03.747875+0000","last_clean":"2021-10-08T19:32:03.747875+0000","last_became_active":"2021-10-08T19:28:40.141714+0000","last_became_peered":"2021-10-08T19:28:40.141714+0000","last_unstale":"2021-10-08T19:32:03.747875+0000","last_undegraded":"2021-10-08T19:32:03.747875+0000","last_fullsized":"2021-10-08T19:32:03.747875+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:07.710367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:07.710367+0000","last_clean_scrub_stamp":"2021-10-08T19:28:07.710367+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0037557269999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":281,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.758601+0000","last_change":"2021-10-08T19:29:40.638605+0000","last_active":"2021-10-08T19:32:03.758601+0000","last_peered":"2021-10-08T19:32:03.758601+0000","last_clean":"2021-10-08T19:32:03.758601+0000","last_became_active":"2021-10-08T19:29:40.638253+0000","last_became_peered":"2021-10-08T19:29:40.638253+0000","last_unstale":"2021-10-08T19:32:03.758601+0000","last_undegraded":"2021-10-08T19:32:03.758601+0000","last_fullsized":"2021-10-08T19:32:03.758601+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:15.793206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:28:15.793206+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0049324570000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":83,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.754003+0000","last_change":"2021-10-08T19:29:40.634877+0000","last_active":"2021-10-08T19:32:03.754003+0000","last_peered":"2021-10-08T19:32:03.754003+0000","last_clean":"2021-10-08T19:32:03.754003+0000","last_became_active":"2021-10-08T19:29:40.634579+0000","last_became_peered":"2021-10-08T19:29:40.634579+0000","last_unstale":"2021-10-08T19:32:03.754003+0000","last_undegraded":"2021-10-08T19:32:03.754003+0000","last_fullsized":"2021-10-08T19:32:03.754003+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:09.177525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:09.177525+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"309'2531","reported_seq":2558,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:08.449820+0000","last_change":"2021-10-08T19:31:33.862007+0000","last_active":"2021-10-08T19:32:08.449820+0000","last_peered":"2021-10-08T19:32:08.449820+0000","last_clean":"2021-10-08T19:32:08.449820+0000","last_became_active":"2021-10-08T19:31:33.861748+0000","last_became_peered":"2021-10-08T19:31:33.861748+0000","last_unstale":"2021-10-08T19:32:08.449820+0000","last_undegraded":"2021-10-08T19:32:08.449820+0000","last_fullsized":"2021-10-08T19:32:08.449820+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.825378+0000","log_size":2531,"ondisk_log_size":2531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":165871616,"num_objects":2531,"num_object_clones":0,"num_object_copies":7593,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2531,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2531,"num_write_kb":161984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.6","version":"90'130","reported_seq":378,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.747509+0000","last_change":"2021-10-08T19:30:00.644195+0000","last_active":"2021-10-08T19:32:02.747509+0000","last_peered":"2021-10-08T19:32:02.747509+0000","last_clean":"2021-10-08T19:32:02.747509+0000","last_became_active":"2021-10-08T19:30:00.643797+0000","last_became_peered":"2021-10-08T19:30:00.643797+0000","last_unstale":"2021-10-08T19:32:02.747509+0000","last_undegraded":"2021-10-08T19:32:02.747509+0000","last_fullsized":"2021-10-08T19:32:02.747509+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.284249+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020087920000000001,"stat_sum":{"num_bytes":53670,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":28,"num_write":16,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":161009,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":217,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.746877+0000","last_change":"2021-10-08T19:31:28.726444+0000","last_active":"2021-10-08T19:32:02.746877+0000","last_peered":"2021-10-08T19:32:02.746877+0000","last_clean":"2021-10-08T19:32:02.746877+0000","last_became_active":"2021-10-08T19:24:25.095389+0000","last_became_peered":"2021-10-08T19:24:25.095389+0000","last_unstale":"2021-10-08T19:32:02.746877+0000","last_undegraded":"2021-10-08T19:32:02.746877+0000","last_fullsized":"2021-10-08T19:32:02.746877+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:28.726330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:31:28.726330+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0019009680000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"289'29","reported_seq":325,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.746739+0000","last_change":"2021-10-08T19:29:40.416206+0000","last_active":"2021-10-08T19:32:03.746739+0000","last_peered":"2021-10-08T19:32:03.746739+0000","last_clean":"2021-10-08T19:32:03.746739+0000","last_became_active":"2021-10-08T19:21:25.741812+0000","last_became_peered":"2021-10-08T19:21:25.741812+0000","last_unstale":"2021-10-08T19:32:03.746739+0000","last_undegraded":"2021-10-08T19:32:03.746739+0000","last_fullsized":"2021-10-08T19:32:03.746739+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'19","last_scrub_stamp":"2021-10-08T19:29:40.416129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:29:40.416129+0000","log_size":29,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0026786840000000002,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":54,"num_read_kb":40,"num_write":32,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"61'1","reported_seq":284,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.742268+0000","last_change":"2021-10-08T19:30:44.230204+0000","last_active":"2021-10-08T19:32:02.742268+0000","last_peered":"2021-10-08T19:32:02.742268+0000","last_clean":"2021-10-08T19:32:02.742268+0000","last_became_active":"2021-10-08T19:21:23.604258+0000","last_became_peered":"2021-10-08T19:21:23.604258+0000","last_unstale":"2021-10-08T19:32:02.742268+0000","last_undegraded":"2021-10-08T19:32:02.742268+0000","last_fullsized":"2021-10-08T19:32:02.742268+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'1","last_scrub_stamp":"2021-10-08T19:30:44.230093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:30:44.230093+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011089468999999999,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":116,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.745591+0000","last_change":"2021-10-08T19:28:40.146183+0000","last_active":"2021-10-08T19:32:03.745591+0000","last_peered":"2021-10-08T19:32:03.745591+0000","last_clean":"2021-10-08T19:32:03.745591+0000","last_became_active":"2021-10-08T19:28:40.140876+0000","last_became_peered":"2021-10-08T19:28:40.140876+0000","last_unstale":"2021-10-08T19:32:03.745591+0000","last_undegraded":"2021-10-08T19:32:03.745591+0000","last_fullsized":"2021-10-08T19:32:03.745591+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:04.724061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:28:04.724061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001436805,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"70'5","reported_seq":122,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.747510+0000","last_change":"2021-10-08T19:31:26.405590+0000","last_active":"2021-10-08T19:32:03.747510+0000","last_peered":"2021-10-08T19:32:03.747510+0000","last_clean":"2021-10-08T19:32:03.747510+0000","last_became_active":"2021-10-08T19:28:40.150503+0000","last_became_peered":"2021-10-08T19:28:40.150503+0000","last_unstale":"2021-10-08T19:32:03.747510+0000","last_undegraded":"2021-10-08T19:32:03.747510+0000","last_fullsized":"2021-10-08T19:32:03.747510+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:31:26.405520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:31:26.405520+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001959166,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"310'2635","reported_seq":2663,"reported_epoch":310,"state":"active+clean","last_fresh":"2021-10-08T19:32:08.958808+0000","last_change":"2021-10-08T19:31:34.405930+0000","last_active":"2021-10-08T19:32:08.958808+0000","last_peered":"2021-10-08T19:32:08.958808+0000","last_clean":"2021-10-08T19:32:08.958808+0000","last_became_active":"2021-10-08T19:31:34.405616+0000","last_became_peered":"2021-10-08T19:31:34.405616+0000","last_unstale":"2021-10-08T19:32:08.958808+0000","last_undegraded":"2021-10-08T19:32:08.958808+0000","last_fullsized":"2021-10-08T19:32:08.958808+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.825378+0000","log_size":2635,"ondisk_log_size":2635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":172687360,"num_objects":2635,"num_object_clones":0,"num_object_copies":7905,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2635,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2635,"num_write_kb":168640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"90'130","reported_seq":423,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.747469+0000","last_change":"2021-10-08T19:31:29.337770+0000","last_active":"2021-10-08T19:32:03.747469+0000","last_peered":"2021-10-08T19:32:03.747469+0000","last_clean":"2021-10-08T19:32:03.747469+0000","last_became_active":"2021-10-08T19:28:43.178371+0000","last_became_peered":"2021-10-08T19:28:43.178371+0000","last_unstale":"2021-10-08T19:32:03.747469+0000","last_undegraded":"2021-10-08T19:32:03.747469+0000","last_fullsized":"2021-10-08T19:32:03.747469+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:31:29.337697+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:31:29.337697+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0017211990000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":35,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.742307+0000","last_change":"2021-10-08T19:31:22.784081+0000","last_active":"2021-10-08T19:32:02.742307+0000","last_peered":"2021-10-08T19:32:02.742307+0000","last_clean":"2021-10-08T19:32:02.742307+0000","last_became_active":"2021-10-08T19:31:22.783759+0000","last_became_peered":"2021-10-08T19:31:22.783759+0000","last_unstale":"2021-10-08T19:32:02.742307+0000","last_undegraded":"2021-10-08T19:32:02.742307+0000","last_fullsized":"2021-10-08T19:32:02.742307+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:29:40.453424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:29:40.453424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003650445,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"289'24","reported_seq":354,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.746250+0000","last_change":"2021-10-08T19:30:02.503634+0000","last_active":"2021-10-08T19:32:03.746250+0000","last_peered":"2021-10-08T19:32:03.746250+0000","last_clean":"2021-10-08T19:32:03.746250+0000","last_became_active":"2021-10-08T19:28:40.133150+0000","last_became_peered":"2021-10-08T19:28:40.133150+0000","last_unstale":"2021-10-08T19:32:03.746250+0000","last_undegraded":"2021-10-08T19:32:03.746250+0000","last_fullsized":"2021-10-08T19:32:03.746250+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'12","last_scrub_stamp":"2021-10-08T19:30:02.503527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:30:02.503527+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0071868260000000003,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":30,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":259,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.743448+0000","last_change":"2021-10-08T19:29:59.237265+0000","last_active":"2021-10-08T19:32:03.743448+0000","last_peered":"2021-10-08T19:32:03.743448+0000","last_clean":"2021-10-08T19:32:03.743448+0000","last_became_active":"2021-10-08T19:28:40.140231+0000","last_became_peered":"2021-10-08T19:28:40.140231+0000","last_unstale":"2021-10-08T19:32:03.743448+0000","last_undegraded":"2021-10-08T19:32:03.743448+0000","last_fullsized":"2021-10-08T19:32:03.743448+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:29:59.237160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:32.922694+0000","last_clean_scrub_stamp":"2021-10-08T19:29:59.237160+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0056451139999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":306,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.746211+0000","last_change":"2021-10-08T19:29:40.632278+0000","last_active":"2021-10-08T19:32:03.746211+0000","last_peered":"2021-10-08T19:32:03.746211+0000","last_clean":"2021-10-08T19:32:03.746211+0000","last_became_active":"2021-10-08T19:29:40.632010+0000","last_became_peered":"2021-10-08T19:29:40.632010+0000","last_unstale":"2021-10-08T19:32:03.746211+0000","last_undegraded":"2021-10-08T19:32:03.746211+0000","last_fullsized":"2021-10-08T19:32:03.746211+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:09.177525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:09.177525+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0090469920000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":24,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:08.737016+0000","last_change":"2021-10-08T19:32:08.736891+0000","last_active":"2021-10-08T19:32:08.737016+0000","last_peered":"2021-10-08T19:32:08.737016+0000","last_clean":"2021-10-08T19:32:08.737016+0000","last_became_active":"2021-10-08T19:31:51.673821+0000","last_became_peered":"2021-10-08T19:31:51.673821+0000","last_unstale":"2021-10-08T19:32:08.737016+0000","last_undegraded":"2021-10-08T19:32:08.737016+0000","last_fullsized":"2021-10-08T19:32:08.737016+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:08.736799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:39.543005+0000","last_clean_scrub_stamp":"2021-10-08T19:32:08.736799+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0075233870000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"310'2691","reported_seq":2719,"reported_epoch":310,"state":"active+clean","last_fresh":"2021-10-08T19:32:08.968002+0000","last_change":"2021-10-08T19:31:33.860786+0000","last_active":"2021-10-08T19:32:08.968002+0000","last_peered":"2021-10-08T19:32:08.968002+0000","last_clean":"2021-10-08T19:32:08.968002+0000","last_became_active":"2021-10-08T19:31:33.860551+0000","last_became_peered":"2021-10-08T19:31:33.860551+0000","last_unstale":"2021-10-08T19:32:08.968002+0000","last_undegraded":"2021-10-08T19:32:08.968002+0000","last_fullsized":"2021-10-08T19:32:08.968002+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.825378+0000","log_size":2691,"ondisk_log_size":2691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":176357376,"num_objects":2691,"num_object_clones":0,"num_object_copies":8073,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2691,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2691,"num_write_kb":172224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":265,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.741707+0000","last_change":"2021-10-08T19:28:03.456643+0000","last_active":"2021-10-08T19:32:02.741707+0000","last_peered":"2021-10-08T19:32:02.741707+0000","last_clean":"2021-10-08T19:32:02.741707+0000","last_became_active":"2021-10-08T19:21:27.636086+0000","last_became_peered":"2021-10-08T19:21:27.636086+0000","last_unstale":"2021-10-08T19:32:02.741707+0000","last_undegraded":"2021-10-08T19:32:02.741707+0000","last_fullsized":"2021-10-08T19:32:02.741707+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:03.456570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:28:03.456570+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0035030170000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"289'26","reported_seq":245,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.747371+0000","last_change":"2021-10-08T19:28:12.445917+0000","last_active":"2021-10-08T19:32:02.747371+0000","last_peered":"2021-10-08T19:32:02.747371+0000","last_clean":"2021-10-08T19:32:02.747371+0000","last_became_active":"2021-10-08T19:24:25.100384+0000","last_became_peered":"2021-10-08T19:24:25.100384+0000","last_unstale":"2021-10-08T19:32:02.747371+0000","last_undegraded":"2021-10-08T19:32:02.747371+0000","last_fullsized":"2021-10-08T19:32:02.747371+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'14","last_scrub_stamp":"2021-10-08T19:28:12.445838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:28:12.445838+0000","log_size":26,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0022764790000000001,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":42,"num_read_kb":32,"num_write":25,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"90'130","reported_seq":582,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.738614+0000","last_change":"2021-10-08T19:30:52.391052+0000","last_active":"2021-10-08T19:32:02.738614+0000","last_peered":"2021-10-08T19:32:02.738614+0000","last_clean":"2021-10-08T19:32:02.738614+0000","last_became_active":"2021-10-08T19:27:22.607289+0000","last_became_peered":"2021-10-08T19:27:22.607289+0000","last_unstale":"2021-10-08T19:32:02.738614+0000","last_undegraded":"2021-10-08T19:32:02.738614+0000","last_fullsized":"2021-10-08T19:32:02.738614+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:30:52.390639+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:30:52.390639+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020197779999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":268,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.741032+0000","last_change":"2021-10-08T19:28:02.942168+0000","last_active":"2021-10-08T19:32:02.741032+0000","last_peered":"2021-10-08T19:32:02.741032+0000","last_clean":"2021-10-08T19:32:02.741032+0000","last_became_active":"2021-10-08T19:21:23.599143+0000","last_became_peered":"2021-10-08T19:21:23.599143+0000","last_unstale":"2021-10-08T19:32:02.741032+0000","last_undegraded":"2021-10-08T19:32:02.741032+0000","last_fullsized":"2021-10-08T19:32:02.741032+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:02.942080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:28:02.942080+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0056165080000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":83,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.753873+0000","last_change":"2021-10-08T19:29:40.639152+0000","last_active":"2021-10-08T19:32:03.753873+0000","last_peered":"2021-10-08T19:32:03.753873+0000","last_clean":"2021-10-08T19:32:03.753873+0000","last_became_active":"2021-10-08T19:29:40.638774+0000","last_became_peered":"2021-10-08T19:29:40.638774+0000","last_unstale":"2021-10-08T19:32:03.753873+0000","last_undegraded":"2021-10-08T19:32:03.753873+0000","last_fullsized":"2021-10-08T19:32:03.753873+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:40.563247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.563247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.024890005999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":280,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.742729+0000","last_change":"2021-10-08T19:29:40.627740+0000","last_active":"2021-10-08T19:32:02.742729+0000","last_peered":"2021-10-08T19:32:02.742729+0000","last_clean":"2021-10-08T19:32:02.742729+0000","last_became_active":"2021-10-08T19:29:40.627256+0000","last_became_peered":"2021-10-08T19:29:40.627256+0000","last_unstale":"2021-10-08T19:32:02.742729+0000","last_undegraded":"2021-10-08T19:32:02.742729+0000","last_fullsized":"2021-10-08T19:32:02.742729+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:01.982319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:28:01.982319+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.023009359,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"309'2560","reported_seq":2587,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:08.488094+0000","last_change":"2021-10-08T19:31:33.859399+0000","last_active":"2021-10-08T19:32:08.488094+0000","last_peered":"2021-10-08T19:32:08.488094+0000","last_clean":"2021-10-08T19:32:08.488094+0000","last_became_active":"2021-10-08T19:31:33.859047+0000","last_became_peered":"2021-10-08T19:31:33.859047+0000","last_unstale":"2021-10-08T19:32:08.488094+0000","last_undegraded":"2021-10-08T19:32:08.488094+0000","last_fullsized":"2021-10-08T19:32:08.488094+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.825378+0000","log_size":2560,"ondisk_log_size":2560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":167772160,"num_objects":2560,"num_object_clones":0,"num_object_copies":7680,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2560,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2560,"num_write_kb":163840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"90'130","reported_seq":590,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.739569+0000","last_change":"2021-10-08T19:31:26.361738+0000","last_active":"2021-10-08T19:32:02.739569+0000","last_peered":"2021-10-08T19:32:02.739569+0000","last_clean":"2021-10-08T19:32:02.739569+0000","last_became_active":"2021-10-08T19:27:26.591250+0000","last_became_peered":"2021-10-08T19:27:26.591250+0000","last_unstale":"2021-10-08T19:32:02.739569+0000","last_undegraded":"2021-10-08T19:32:02.739569+0000","last_fullsized":"2021-10-08T19:32:02.739569+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:31:26.361659+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:31:26.361659+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0035258939999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":270,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.744549+0000","last_change":"2021-10-08T19:29:56.350839+0000","last_active":"2021-10-08T19:32:03.744549+0000","last_peered":"2021-10-08T19:32:03.744549+0000","last_clean":"2021-10-08T19:32:03.744549+0000","last_became_active":"2021-10-08T19:21:27.637875+0000","last_became_peered":"2021-10-08T19:21:27.637875+0000","last_unstale":"2021-10-08T19:32:03.744549+0000","last_undegraded":"2021-10-08T19:32:03.744549+0000","last_fullsized":"2021-10-08T19:32:03.744549+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:29:56.350687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:29:56.350687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0076571440000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"289'17","reported_seq":30,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.747494+0000","last_change":"2021-10-08T19:31:52.537974+0000","last_active":"2021-10-08T19:32:03.747494+0000","last_peered":"2021-10-08T19:32:03.747494+0000","last_clean":"2021-10-08T19:32:03.747494+0000","last_became_active":"2021-10-08T19:31:51.674965+0000","last_became_peered":"2021-10-08T19:31:51.674965+0000","last_unstale":"2021-10-08T19:32:03.747494+0000","last_undegraded":"2021-10-08T19:32:03.747494+0000","last_fullsized":"2021-10-08T19:32:03.747494+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'13","last_scrub_stamp":"2021-10-08T19:30:33.631279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:30:33.631279+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0041179349999999997,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":23,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":990,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":296,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.743826+0000","last_change":"2021-10-08T19:31:19.482604+0000","last_active":"2021-10-08T19:32:03.743826+0000","last_peered":"2021-10-08T19:32:03.743826+0000","last_clean":"2021-10-08T19:32:03.743826+0000","last_became_active":"2021-10-08T19:29:40.619746+0000","last_became_peered":"2021-10-08T19:29:40.619746+0000","last_unstale":"2021-10-08T19:32:03.743826+0000","last_undegraded":"2021-10-08T19:32:03.743826+0000","last_fullsized":"2021-10-08T19:32:03.743826+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:19.482493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:31:19.482493+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001842977,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"70'5","reported_seq":124,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:04.661153+0000","last_change":"2021-10-08T19:32:04.660969+0000","last_active":"2021-10-08T19:32:04.661153+0000","last_peered":"2021-10-08T19:32:04.661153+0000","last_clean":"2021-10-08T19:32:04.661153+0000","last_became_active":"2021-10-08T19:28:40.148054+0000","last_became_peered":"2021-10-08T19:28:40.148054+0000","last_unstale":"2021-10-08T19:32:04.661153+0000","last_undegraded":"2021-10-08T19:32:04.661153+0000","last_fullsized":"2021-10-08T19:32:04.661153+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:32:04.660831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:04.660831+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0066506270000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":299,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.742224+0000","last_change":"2021-10-08T19:29:40.653276+0000","last_active":"2021-10-08T19:32:02.742224+0000","last_peered":"2021-10-08T19:32:02.742224+0000","last_clean":"2021-10-08T19:32:02.742224+0000","last_became_active":"2021-10-08T19:29:40.652528+0000","last_became_peered":"2021-10-08T19:29:40.652528+0000","last_unstale":"2021-10-08T19:32:02.742224+0000","last_undegraded":"2021-10-08T19:32:02.742224+0000","last_fullsized":"2021-10-08T19:32:02.742224+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:14.485264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:28:14.485264+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.016729131000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.9","version":"310'2624","reported_seq":2652,"reported_epoch":310,"state":"active+clean","last_fresh":"2021-10-08T19:32:08.979541+0000","last_change":"2021-10-08T19:31:33.859282+0000","last_active":"2021-10-08T19:32:08.979541+0000","last_peered":"2021-10-08T19:32:08.979541+0000","last_clean":"2021-10-08T19:32:08.979541+0000","last_became_active":"2021-10-08T19:31:33.858961+0000","last_became_peered":"2021-10-08T19:31:33.858961+0000","last_unstale":"2021-10-08T19:32:08.979541+0000","last_undegraded":"2021-10-08T19:32:08.979541+0000","last_fullsized":"2021-10-08T19:32:08.979541+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.825378+0000","log_size":2624,"ondisk_log_size":2624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":171966464,"num_objects":2624,"num_object_clones":0,"num_object_copies":7872,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2624,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2624,"num_write_kb":167936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,5],"acting":[0,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"90'130","reported_seq":450,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.742961+0000","last_change":"2021-10-08T19:31:33.806970+0000","last_active":"2021-10-08T19:32:02.742961+0000","last_peered":"2021-10-08T19:32:02.742961+0000","last_clean":"2021-10-08T19:32:02.742961+0000","last_became_active":"2021-10-08T19:27:26.591993+0000","last_became_peered":"2021-10-08T19:27:26.591993+0000","last_unstale":"2021-10-08T19:32:02.742961+0000","last_undegraded":"2021-10-08T19:32:02.742961+0000","last_fullsized":"2021-10-08T19:32:02.742961+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:31:33.806885+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:31:33.806885+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.00183936,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,2],"acting":[5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":288,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.746516+0000","last_change":"2021-10-08T19:30:03.509440+0000","last_active":"2021-10-08T19:32:03.746516+0000","last_peered":"2021-10-08T19:32:03.746516+0000","last_clean":"2021-10-08T19:32:03.746516+0000","last_became_active":"2021-10-08T19:28:40.133414+0000","last_became_peered":"2021-10-08T19:28:40.133414+0000","last_unstale":"2021-10-08T19:32:03.746516+0000","last_undegraded":"2021-10-08T19:32:03.746516+0000","last_fullsized":"2021-10-08T19:32:03.746516+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:30:03.509345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:30:03.509345+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0030963750000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"289'44","reported_seq":267,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:06.849495+0000","last_change":"2021-10-08T19:31:22.538332+0000","last_active":"2021-10-08T19:32:06.849495+0000","last_peered":"2021-10-08T19:32:06.849495+0000","last_clean":"2021-10-08T19:32:06.849495+0000","last_became_active":"2021-10-08T19:29:40.626138+0000","last_became_peered":"2021-10-08T19:29:40.626138+0000","last_unstale":"2021-10-08T19:32:06.849495+0000","last_undegraded":"2021-10-08T19:32:06.849495+0000","last_fullsized":"2021-10-08T19:32:06.849495+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"238'32","last_scrub_stamp":"2021-10-08T19:31:22.538245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:31:22.538245+0000","log_size":44,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0029466359999999999,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":65,"num_read_kb":50,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":1432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":310,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:06.793417+0000","last_change":"2021-10-08T19:32:06.793381+0000","last_active":"2021-10-08T19:32:06.793417+0000","last_peered":"2021-10-08T19:32:06.793417+0000","last_clean":"2021-10-08T19:32:06.793417+0000","last_became_active":"2021-10-08T19:28:40.137919+0000","last_became_peered":"2021-10-08T19:28:40.137919+0000","last_unstale":"2021-10-08T19:32:06.793417+0000","last_undegraded":"2021-10-08T19:32:06.793417+0000","last_fullsized":"2021-10-08T19:32:06.793417+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:06.793283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:06.793283+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0046514379999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":89,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.753784+0000","last_change":"2021-10-08T19:30:51.432994+0000","last_active":"2021-10-08T19:32:03.753784+0000","last_peered":"2021-10-08T19:32:03.753784+0000","last_clean":"2021-10-08T19:32:03.753784+0000","last_became_active":"2021-10-08T19:29:40.637371+0000","last_became_peered":"2021-10-08T19:29:40.637371+0000","last_unstale":"2021-10-08T19:32:03.753784+0000","last_undegraded":"2021-10-08T19:32:03.753784+0000","last_fullsized":"2021-10-08T19:32:03.753784+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:30:51.432925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:30:51.432925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0033942310000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":231,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.757617+0000","last_change":"2021-10-08T19:31:33.176707+0000","last_active":"2021-10-08T19:32:03.757617+0000","last_peered":"2021-10-08T19:32:03.757617+0000","last_clean":"2021-10-08T19:32:03.757617+0000","last_became_active":"2021-10-08T19:25:14.550690+0000","last_became_peered":"2021-10-08T19:25:14.550690+0000","last_unstale":"2021-10-08T19:32:03.757617+0000","last_undegraded":"2021-10-08T19:32:03.757617+0000","last_fullsized":"2021-10-08T19:32:03.757617+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:33.176641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:31:33.176641+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003389562,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.f","version":"309'2597","reported_seq":2624,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:08.500823+0000","last_change":"2021-10-08T19:31:33.859774+0000","last_active":"2021-10-08T19:32:08.500823+0000","last_peered":"2021-10-08T19:32:08.500823+0000","last_clean":"2021-10-08T19:32:08.500823+0000","last_became_active":"2021-10-08T19:31:33.859443+0000","last_became_peered":"2021-10-08T19:31:33.859443+0000","last_unstale":"2021-10-08T19:32:08.500823+0000","last_undegraded":"2021-10-08T19:32:08.500823+0000","last_fullsized":"2021-10-08T19:32:08.500823+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.825378+0000","log_size":2597,"ondisk_log_size":2597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":170196992,"num_objects":2597,"num_object_clones":0,"num_object_copies":7791,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2597,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2597,"num_write_kb":166208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"90'130","reported_seq":540,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.747499+0000","last_change":"2021-10-08T19:29:43.637236+0000","last_active":"2021-10-08T19:32:02.747499+0000","last_peered":"2021-10-08T19:32:02.747499+0000","last_clean":"2021-10-08T19:32:02.747499+0000","last_became_active":"2021-10-08T19:29:43.636820+0000","last_became_peered":"2021-10-08T19:29:43.636820+0000","last_unstale":"2021-10-08T19:32:02.747499+0000","last_undegraded":"2021-10-08T19:32:02.747499+0000","last_fullsized":"2021-10-08T19:32:02.747499+0000","mapping_epoch":239,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.284249+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0045617870000000003,"stat_sum":{"num_bytes":53670,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":28,"num_write":16,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":214679,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"114'10","reported_seq":438,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:06.848799+0000","last_change":"2021-10-08T19:31:36.352904+0000","last_active":"2021-10-08T19:32:06.848799+0000","last_peered":"2021-10-08T19:32:06.848799+0000","last_clean":"2021-10-08T19:32:06.848799+0000","last_became_active":"2021-10-08T19:24:25.106695+0000","last_became_peered":"2021-10-08T19:24:25.106695+0000","last_unstale":"2021-10-08T19:32:06.848799+0000","last_undegraded":"2021-10-08T19:32:06.848799+0000","last_fullsized":"2021-10-08T19:32:06.848799+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'10","last_scrub_stamp":"2021-10-08T19:31:36.352823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:31:36.352823+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002738304,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"289'20","reported_seq":30,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.746057+0000","last_change":"2021-10-08T19:31:51.685841+0000","last_active":"2021-10-08T19:32:03.746057+0000","last_peered":"2021-10-08T19:32:03.746057+0000","last_clean":"2021-10-08T19:32:03.746057+0000","last_became_active":"2021-10-08T19:31:51.675569+0000","last_became_peered":"2021-10-08T19:31:51.675569+0000","last_unstale":"2021-10-08T19:32:03.746057+0000","last_undegraded":"2021-10-08T19:32:03.746057+0000","last_fullsized":"2021-10-08T19:32:03.746057+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'10","last_scrub_stamp":"2021-10-08T19:31:25.918199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:31:25.918199+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0047431189999999996,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":23,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":122,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.747396+0000","last_change":"2021-10-08T19:30:10.100186+0000","last_active":"2021-10-08T19:32:03.747396+0000","last_peered":"2021-10-08T19:32:03.747396+0000","last_clean":"2021-10-08T19:32:03.747396+0000","last_became_active":"2021-10-08T19:28:40.141737+0000","last_became_peered":"2021-10-08T19:28:40.141737+0000","last_unstale":"2021-10-08T19:32:03.747396+0000","last_undegraded":"2021-10-08T19:32:03.747396+0000","last_fullsized":"2021-10-08T19:32:03.747396+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:30:10.100078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:30:10.100078+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.016761485,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":290,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:07.288304+0000","last_change":"2021-10-08T19:32:07.288180+0000","last_active":"2021-10-08T19:32:07.288304+0000","last_peered":"2021-10-08T19:32:07.288304+0000","last_clean":"2021-10-08T19:32:07.288304+0000","last_became_active":"2021-10-08T19:29:40.643614+0000","last_became_peered":"2021-10-08T19:29:40.643614+0000","last_unstale":"2021-10-08T19:32:07.288304+0000","last_undegraded":"2021-10-08T19:32:07.288304+0000","last_fullsized":"2021-10-08T19:32:07.288304+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:07.288067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:32:07.288067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.022486899000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":244,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.741356+0000","last_change":"2021-10-08T19:29:40.627400+0000","last_active":"2021-10-08T19:32:02.741356+0000","last_peered":"2021-10-08T19:32:02.741356+0000","last_clean":"2021-10-08T19:32:02.741356+0000","last_became_active":"2021-10-08T19:29:40.626998+0000","last_became_peered":"2021-10-08T19:29:40.626998+0000","last_unstale":"2021-10-08T19:32:02.741356+0000","last_undegraded":"2021-10-08T19:32:02.741356+0000","last_fullsized":"2021-10-08T19:32:02.741356+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:17.379559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:17.379559+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0052805589999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.4","version":"310'2636","reported_seq":2663,"reported_epoch":310,"state":"active+clean","last_fresh":"2021-10-08T19:32:08.965848+0000","last_change":"2021-10-08T19:31:33.861845+0000","last_active":"2021-10-08T19:32:08.965848+0000","last_peered":"2021-10-08T19:32:08.965848+0000","last_clean":"2021-10-08T19:32:08.965848+0000","last_became_active":"2021-10-08T19:31:33.861531+0000","last_became_peered":"2021-10-08T19:31:33.861531+0000","last_unstale":"2021-10-08T19:32:08.965848+0000","last_undegraded":"2021-10-08T19:32:08.965848+0000","last_fullsized":"2021-10-08T19:32:08.965848+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.825378+0000","log_size":2636,"ondisk_log_size":2636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":172752896,"num_objects":2636,"num_object_clones":0,"num_object_copies":7908,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2636,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2636,"num_write_kb":168704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":290,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.743545+0000","last_change":"2021-10-08T19:31:27.419619+0000","last_active":"2021-10-08T19:32:03.743545+0000","last_peered":"2021-10-08T19:32:03.743545+0000","last_clean":"2021-10-08T19:32:03.743545+0000","last_became_active":"2021-10-08T19:28:40.138726+0000","last_became_peered":"2021-10-08T19:28:40.138726+0000","last_unstale":"2021-10-08T19:32:03.743545+0000","last_undegraded":"2021-10-08T19:32:03.743545+0000","last_fullsized":"2021-10-08T19:32:03.743545+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:27.419545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:50.435552+0000","last_clean_scrub_stamp":"2021-10-08T19:31:27.419545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001436466,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"289'18","reported_seq":383,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.757444+0000","last_change":"2021-10-08T19:30:08.410079+0000","last_active":"2021-10-08T19:32:03.757444+0000","last_peered":"2021-10-08T19:32:03.757444+0000","last_clean":"2021-10-08T19:32:03.757444+0000","last_became_active":"2021-10-08T19:29:40.638957+0000","last_became_peered":"2021-10-08T19:29:40.638957+0000","last_unstale":"2021-10-08T19:32:03.757444+0000","last_undegraded":"2021-10-08T19:32:03.757444+0000","last_fullsized":"2021-10-08T19:32:03.757444+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'12","last_scrub_stamp":"2021-10-08T19:30:08.409964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:30:08.409964+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.007590439,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":25,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"61'2","reported_seq":285,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.757871+0000","last_change":"2021-10-08T19:30:00.378019+0000","last_active":"2021-10-08T19:32:03.757871+0000","last_peered":"2021-10-08T19:32:03.757871+0000","last_clean":"2021-10-08T19:32:03.757871+0000","last_became_active":"2021-10-08T19:21:23.603614+0000","last_became_peered":"2021-10-08T19:21:23.603614+0000","last_unstale":"2021-10-08T19:32:03.757871+0000","last_undegraded":"2021-10-08T19:32:03.757871+0000","last_fullsized":"2021-10-08T19:32:03.757871+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'2","last_scrub_stamp":"2021-10-08T19:30:00.377909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:30:00.377909+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.006990802,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":89,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.752812+0000","last_change":"2021-10-08T19:31:29.506433+0000","last_active":"2021-10-08T19:32:03.752812+0000","last_peered":"2021-10-08T19:32:03.752812+0000","last_clean":"2021-10-08T19:32:03.752812+0000","last_became_active":"2021-10-08T19:29:40.645211+0000","last_became_peered":"2021-10-08T19:29:40.645211+0000","last_unstale":"2021-10-08T19:32:03.752812+0000","last_undegraded":"2021-10-08T19:32:03.752812+0000","last_fullsized":"2021-10-08T19:32:03.752812+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:29.506331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:31:29.506331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.042894232999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":210,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.739944+0000","last_change":"2021-10-08T19:31:29.399846+0000","last_active":"2021-10-08T19:32:02.739944+0000","last_peered":"2021-10-08T19:32:02.739944+0000","last_clean":"2021-10-08T19:32:02.739944+0000","last_became_active":"2021-10-08T19:28:40.100770+0000","last_became_peered":"2021-10-08T19:28:40.100770+0000","last_unstale":"2021-10-08T19:32:02.739944+0000","last_undegraded":"2021-10-08T19:32:02.739944+0000","last_fullsized":"2021-10-08T19:32:02.739944+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:29.399771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:31:29.399771+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001424972,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"289'15","reported_seq":337,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.746333+0000","last_change":"2021-10-08T19:30:08.617709+0000","last_active":"2021-10-08T19:32:03.746333+0000","last_peered":"2021-10-08T19:32:03.746333+0000","last_clean":"2021-10-08T19:32:03.746333+0000","last_became_active":"2021-10-08T19:29:40.644354+0000","last_became_peered":"2021-10-08T19:29:40.644354+0000","last_unstale":"2021-10-08T19:32:03.746333+0000","last_undegraded":"2021-10-08T19:32:03.746333+0000","last_fullsized":"2021-10-08T19:32:03.746333+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'9","last_scrub_stamp":"2021-10-08T19:30:08.617590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:30:08.617590+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012646054,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":298,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.743544+0000","last_change":"2021-10-08T19:29:58.278063+0000","last_active":"2021-10-08T19:32:03.743544+0000","last_peered":"2021-10-08T19:32:03.743544+0000","last_clean":"2021-10-08T19:32:03.743544+0000","last_became_active":"2021-10-08T19:28:40.139234+0000","last_became_peered":"2021-10-08T19:28:40.139234+0000","last_unstale":"2021-10-08T19:32:03.743544+0000","last_undegraded":"2021-10-08T19:32:03.743544+0000","last_fullsized":"2021-10-08T19:32:03.743544+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:29:58.277981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:29:58.277981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001389567,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":89,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:05.472854+0000","last_change":"2021-10-08T19:32:05.472718+0000","last_active":"2021-10-08T19:32:05.472854+0000","last_peered":"2021-10-08T19:32:05.472854+0000","last_clean":"2021-10-08T19:32:05.472854+0000","last_became_active":"2021-10-08T19:29:40.645111+0000","last_became_peered":"2021-10-08T19:29:40.645111+0000","last_unstale":"2021-10-08T19:32:05.472854+0000","last_undegraded":"2021-10-08T19:32:05.472854+0000","last_fullsized":"2021-10-08T19:32:05.472854+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:05.472621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:32:05.472621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0050247119999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":268,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.743907+0000","last_change":"2021-10-08T19:31:59.493049+0000","last_active":"2021-10-08T19:32:03.743907+0000","last_peered":"2021-10-08T19:32:03.743907+0000","last_clean":"2021-10-08T19:32:03.743907+0000","last_became_active":"2021-10-08T19:21:29.640674+0000","last_became_peered":"2021-10-08T19:21:29.640674+0000","last_unstale":"2021-10-08T19:32:03.743907+0000","last_undegraded":"2021-10-08T19:32:03.743907+0000","last_fullsized":"2021-10-08T19:32:03.743907+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:05.869774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:24:05.869774+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0041453820000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":196,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.739203+0000","last_change":"2021-10-08T19:30:08.014575+0000","last_active":"2021-10-08T19:32:02.739203+0000","last_peered":"2021-10-08T19:32:02.739203+0000","last_clean":"2021-10-08T19:32:02.739203+0000","last_became_active":"2021-10-08T19:25:15.501118+0000","last_became_peered":"2021-10-08T19:25:15.501118+0000","last_unstale":"2021-10-08T19:32:02.739203+0000","last_undegraded":"2021-10-08T19:32:02.739203+0000","last_fullsized":"2021-10-08T19:32:02.739203+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:30:08.014477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:30:08.014477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0025301999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"289'12","reported_seq":106,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.754020+0000","last_change":"2021-10-08T19:30:10.167940+0000","last_active":"2021-10-08T19:32:03.754020+0000","last_peered":"2021-10-08T19:32:03.754020+0000","last_clean":"2021-10-08T19:32:03.754020+0000","last_became_active":"2021-10-08T19:29:40.644657+0000","last_became_peered":"2021-10-08T19:29:40.644657+0000","last_unstale":"2021-10-08T19:32:03.754020+0000","last_undegraded":"2021-10-08T19:32:03.754020+0000","last_fullsized":"2021-10-08T19:32:03.754020+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'6","last_scrub_stamp":"2021-10-08T19:30:10.167848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:30:10.167848+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0085589310000000005,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":18,"num_read_kb":15,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":235,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:05.789637+0000","last_change":"2021-10-08T19:32:05.789604+0000","last_active":"2021-10-08T19:32:05.789637+0000","last_peered":"2021-10-08T19:32:05.789637+0000","last_clean":"2021-10-08T19:32:05.789637+0000","last_became_active":"2021-10-08T19:28:40.101898+0000","last_became_peered":"2021-10-08T19:28:40.101898+0000","last_unstale":"2021-10-08T19:32:05.789637+0000","last_undegraded":"2021-10-08T19:32:05.789637+0000","last_fullsized":"2021-10-08T19:32:05.789637+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:05.789528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:16.444582+0000","last_clean_scrub_stamp":"2021-10-08T19:32:05.789528+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.086089719999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":306,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.742108+0000","last_change":"2021-10-08T19:31:28.844816+0000","last_active":"2021-10-08T19:32:02.742108+0000","last_peered":"2021-10-08T19:32:02.742108+0000","last_clean":"2021-10-08T19:32:02.742108+0000","last_became_active":"2021-10-08T19:29:40.626950+0000","last_became_peered":"2021-10-08T19:29:40.626950+0000","last_unstale":"2021-10-08T19:32:02.742108+0000","last_undegraded":"2021-10-08T19:32:02.742108+0000","last_fullsized":"2021-10-08T19:32:02.742108+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:28.844749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:31:28.844749+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034600469999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":287,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.742067+0000","last_change":"2021-10-08T19:28:15.480476+0000","last_active":"2021-10-08T19:32:02.742067+0000","last_peered":"2021-10-08T19:32:02.742067+0000","last_clean":"2021-10-08T19:32:02.742067+0000","last_became_active":"2021-10-08T19:24:25.099371+0000","last_became_peered":"2021-10-08T19:24:25.099371+0000","last_unstale":"2021-10-08T19:32:02.742067+0000","last_undegraded":"2021-10-08T19:32:02.742067+0000","last_fullsized":"2021-10-08T19:32:02.742067+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:15.480374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:28:15.480374+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0076754220000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"70'5","reported_seq":464,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.746384+0000","last_change":"2021-10-08T19:31:22.785527+0000","last_active":"2021-10-08T19:32:02.746384+0000","last_peered":"2021-10-08T19:32:02.746384+0000","last_clean":"2021-10-08T19:32:02.746384+0000","last_became_active":"2021-10-08T19:31:22.785193+0000","last_became_peered":"2021-10-08T19:31:22.785193+0000","last_unstale":"2021-10-08T19:32:02.746384+0000","last_undegraded":"2021-10-08T19:32:02.746384+0000","last_fullsized":"2021-10-08T19:32:02.746384+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":5,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:29:55.412427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:29:55.412427+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0052984640000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"289'20","reported_seq":154,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:07.489926+0000","last_change":"2021-10-08T19:32:07.489926+0000","last_active":"2021-10-08T19:32:07.489926+0000","last_peered":"2021-10-08T19:32:07.489926+0000","last_clean":"2021-10-08T19:32:07.489926+0000","last_became_active":"2021-10-08T19:31:51.677055+0000","last_became_peered":"2021-10-08T19:31:51.677055+0000","last_unstale":"2021-10-08T19:32:07.489926+0000","last_undegraded":"2021-10-08T19:32:07.489926+0000","last_fullsized":"2021-10-08T19:32:07.489926+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'10","last_scrub_stamp":"2021-10-08T19:28:03.073833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:28:03.073833+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0061927040000000003,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":292,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.740509+0000","last_change":"2021-10-08T19:31:30.802257+0000","last_active":"2021-10-08T19:32:02.740509+0000","last_peered":"2021-10-08T19:32:02.740509+0000","last_clean":"2021-10-08T19:32:02.740509+0000","last_became_active":"2021-10-08T19:29:40.631331+0000","last_became_peered":"2021-10-08T19:29:40.631331+0000","last_unstale":"2021-10-08T19:32:02.740509+0000","last_undegraded":"2021-10-08T19:32:02.740509+0000","last_fullsized":"2021-10-08T19:32:02.740509+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:30.802102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:31:30.802102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0025761069999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"203'10","reported_seq":434,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.741400+0000","last_change":"2021-10-08T19:29:59.469071+0000","last_active":"2021-10-08T19:32:03.741400+0000","last_peered":"2021-10-08T19:32:03.741400+0000","last_clean":"2021-10-08T19:32:03.741400+0000","last_became_active":"2021-10-08T19:28:40.138031+0000","last_became_peered":"2021-10-08T19:28:40.138031+0000","last_unstale":"2021-10-08T19:32:03.741400+0000","last_undegraded":"2021-10-08T19:32:03.741400+0000","last_fullsized":"2021-10-08T19:32:03.741400+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"203'10","last_scrub_stamp":"2021-10-08T19:29:59.468960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:29:59.468960+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0085427560000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":284,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.746166+0000","last_change":"2021-10-08T19:30:09.616674+0000","last_active":"2021-10-08T19:32:03.746166+0000","last_peered":"2021-10-08T19:32:03.746166+0000","last_clean":"2021-10-08T19:32:03.746166+0000","last_became_active":"2021-10-08T19:29:40.644819+0000","last_became_peered":"2021-10-08T19:29:40.644819+0000","last_unstale":"2021-10-08T19:32:03.746166+0000","last_undegraded":"2021-10-08T19:32:03.746166+0000","last_fullsized":"2021-10-08T19:32:03.746166+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:30:09.616582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:30:09.616582+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.027759294,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":198,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:08.301011+0000","last_change":"2021-10-08T19:32:08.300983+0000","last_active":"2021-10-08T19:32:08.301011+0000","last_peered":"2021-10-08T19:32:08.301011+0000","last_clean":"2021-10-08T19:32:08.301011+0000","last_became_active":"2021-10-08T19:25:15.498770+0000","last_became_peered":"2021-10-08T19:25:15.498770+0000","last_unstale":"2021-10-08T19:32:08.301011+0000","last_undegraded":"2021-10-08T19:32:08.301011+0000","last_fullsized":"2021-10-08T19:32:08.301011+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:08.300907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:08.300907+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.00342115,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"289'15","reported_seq":54,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.741338+0000","last_change":"2021-10-08T19:31:23.478333+0000","last_active":"2021-10-08T19:32:02.741338+0000","last_peered":"2021-10-08T19:32:02.741338+0000","last_clean":"2021-10-08T19:32:02.741338+0000","last_became_active":"2021-10-08T19:31:22.786860+0000","last_became_peered":"2021-10-08T19:31:22.786860+0000","last_unstale":"2021-10-08T19:32:02.741338+0000","last_undegraded":"2021-10-08T19:32:02.741338+0000","last_fullsized":"2021-10-08T19:32:02.741338+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'9","last_scrub_stamp":"2021-10-08T19:30:03.413860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:30:03.413860+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0047281429999999998,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":298,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.746726+0000","last_change":"2021-10-08T19:30:11.526475+0000","last_active":"2021-10-08T19:32:03.746726+0000","last_peered":"2021-10-08T19:32:03.746726+0000","last_clean":"2021-10-08T19:32:03.746726+0000","last_became_active":"2021-10-08T19:29:44.439397+0000","last_became_peered":"2021-10-08T19:29:44.439397+0000","last_unstale":"2021-10-08T19:32:03.746726+0000","last_undegraded":"2021-10-08T19:32:03.746726+0000","last_fullsized":"2021-10-08T19:32:03.746726+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:30:11.526373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:30:11.526373+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0041020379999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"238'10","reported_seq":123,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:06.848855+0000","last_change":"2021-10-08T19:31:28.463646+0000","last_active":"2021-10-08T19:32:06.848855+0000","last_peered":"2021-10-08T19:32:06.848855+0000","last_clean":"2021-10-08T19:32:06.848855+0000","last_became_active":"2021-10-08T19:29:40.637650+0000","last_became_peered":"2021-10-08T19:29:40.637650+0000","last_unstale":"2021-10-08T19:32:06.848855+0000","last_undegraded":"2021-10-08T19:32:06.848855+0000","last_fullsized":"2021-10-08T19:32:06.848855+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"238'10","last_scrub_stamp":"2021-10-08T19:31:28.463544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:31:28.463544+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040229419999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":263,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.758167+0000","last_change":"2021-10-08T19:30:04.435933+0000","last_active":"2021-10-08T19:32:03.758167+0000","last_peered":"2021-10-08T19:32:03.758167+0000","last_clean":"2021-10-08T19:32:03.758167+0000","last_became_active":"2021-10-08T19:21:29.640302+0000","last_became_peered":"2021-10-08T19:21:29.640302+0000","last_unstale":"2021-10-08T19:32:03.758167+0000","last_undegraded":"2021-10-08T19:32:03.758167+0000","last_fullsized":"2021-10-08T19:32:03.758167+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:30:04.435814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:30:04.435814+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.035423228000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":205,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.745984+0000","last_change":"2021-10-08T19:29:40.631719+0000","last_active":"2021-10-08T19:32:03.745984+0000","last_peered":"2021-10-08T19:32:03.745984+0000","last_clean":"2021-10-08T19:32:03.745984+0000","last_became_active":"2021-10-08T19:29:40.631374+0000","last_became_peered":"2021-10-08T19:29:40.631374+0000","last_unstale":"2021-10-08T19:32:03.745984+0000","last_undegraded":"2021-10-08T19:32:03.745984+0000","last_fullsized":"2021-10-08T19:32:03.745984+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:22:40.563247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:22:40.563247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.024890005999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":208,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.742019+0000","last_change":"2021-10-08T19:29:40.653447+0000","last_active":"2021-10-08T19:32:02.742019+0000","last_peered":"2021-10-08T19:32:02.742019+0000","last_clean":"2021-10-08T19:32:02.742019+0000","last_became_active":"2021-10-08T19:29:40.652966+0000","last_became_peered":"2021-10-08T19:29:40.652966+0000","last_unstale":"2021-10-08T19:32:02.742019+0000","last_undegraded":"2021-10-08T19:32:02.742019+0000","last_fullsized":"2021-10-08T19:32:02.742019+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:17.379559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:24:17.379559+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0090469920000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"289'19","reported_seq":28,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.745713+0000","last_change":"2021-10-08T19:31:51.688430+0000","last_active":"2021-10-08T19:32:03.745713+0000","last_peered":"2021-10-08T19:32:03.745713+0000","last_clean":"2021-10-08T19:32:03.745713+0000","last_became_active":"2021-10-08T19:31:51.676961+0000","last_became_peered":"2021-10-08T19:31:51.676961+0000","last_unstale":"2021-10-08T19:32:03.745713+0000","last_undegraded":"2021-10-08T19:32:03.745713+0000","last_fullsized":"2021-10-08T19:32:03.745713+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'13","last_scrub_stamp":"2021-10-08T19:29:40.212476+0000","last_deep_scrub":"87'13","last_deep_scrub_stamp":"2021-10-08T19:22:53.263631+0000","last_clean_scrub_stamp":"2021-10-08T19:29:40.212476+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0036954140000000002,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":253,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:04.744159+0000","last_change":"2021-10-08T19:32:04.744119+0000","last_active":"2021-10-08T19:32:04.744159+0000","last_peered":"2021-10-08T19:32:04.744159+0000","last_clean":"2021-10-08T19:32:04.744159+0000","last_became_active":"2021-10-08T19:31:22.786651+0000","last_became_peered":"2021-10-08T19:31:22.786651+0000","last_unstale":"2021-10-08T19:32:04.744159+0000","last_undegraded":"2021-10-08T19:32:04.744159+0000","last_fullsized":"2021-10-08T19:32:04.744159+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:04.744009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:04.744009+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0094285879999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":89,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.752742+0000","last_change":"2021-10-08T19:30:32.411026+0000","last_active":"2021-10-08T19:32:03.752742+0000","last_peered":"2021-10-08T19:32:03.752742+0000","last_clean":"2021-10-08T19:32:03.752742+0000","last_became_active":"2021-10-08T19:29:40.644770+0000","last_became_peered":"2021-10-08T19:29:40.644770+0000","last_unstale":"2021-10-08T19:32:03.752742+0000","last_undegraded":"2021-10-08T19:32:03.752742+0000","last_fullsized":"2021-10-08T19:32:03.752742+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:30:32.410928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:30:32.410928+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003423953,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":286,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.745336+0000","last_change":"2021-10-08T19:30:05.545791+0000","last_active":"2021-10-08T19:32:03.745336+0000","last_peered":"2021-10-08T19:32:03.745336+0000","last_clean":"2021-10-08T19:32:03.745336+0000","last_became_active":"2021-10-08T19:28:40.133744+0000","last_became_peered":"2021-10-08T19:28:40.133744+0000","last_unstale":"2021-10-08T19:32:03.745336+0000","last_undegraded":"2021-10-08T19:32:03.745336+0000","last_fullsized":"2021-10-08T19:32:03.745336+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:30:05.545680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:30:05.545680+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014834386999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"289'19","reported_seq":423,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.757562+0000","last_change":"2021-10-08T19:31:36.253886+0000","last_active":"2021-10-08T19:32:03.757562+0000","last_peered":"2021-10-08T19:32:03.757562+0000","last_clean":"2021-10-08T19:32:03.757562+0000","last_became_active":"2021-10-08T19:28:40.100196+0000","last_became_peered":"2021-10-08T19:28:40.100196+0000","last_unstale":"2021-10-08T19:32:03.757562+0000","last_undegraded":"2021-10-08T19:32:03.757562+0000","last_fullsized":"2021-10-08T19:32:03.757562+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:31:36.253813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:31:36.253813+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039657879999999996,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":124,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.747683+0000","last_change":"2021-10-08T19:30:32.260526+0000","last_active":"2021-10-08T19:32:03.747683+0000","last_peered":"2021-10-08T19:32:03.747683+0000","last_clean":"2021-10-08T19:32:03.747683+0000","last_became_active":"2021-10-08T19:28:40.146673+0000","last_became_peered":"2021-10-08T19:28:40.146673+0000","last_unstale":"2021-10-08T19:32:03.747683+0000","last_undegraded":"2021-10-08T19:32:03.747683+0000","last_fullsized":"2021-10-08T19:32:03.747683+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:30:32.260440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:30:32.260440+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034384390000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":134,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.746129+0000","last_change":"2021-10-08T19:29:40.639305+0000","last_active":"2021-10-08T19:32:03.746129+0000","last_peered":"2021-10-08T19:32:03.746129+0000","last_clean":"2021-10-08T19:32:03.746129+0000","last_became_active":"2021-10-08T19:29:40.638536+0000","last_became_peered":"2021-10-08T19:29:40.638536+0000","last_unstale":"2021-10-08T19:32:03.746129+0000","last_undegraded":"2021-10-08T19:32:03.746129+0000","last_fullsized":"2021-10-08T19:32:03.746129+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:00.640354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:43.186684+0000","last_clean_scrub_stamp":"2021-10-08T19:28:00.640354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":83,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.752369+0000","last_change":"2021-10-08T19:29:40.634604+0000","last_active":"2021-10-08T19:32:03.752369+0000","last_peered":"2021-10-08T19:32:03.752369+0000","last_clean":"2021-10-08T19:32:03.752369+0000","last_became_active":"2021-10-08T19:29:40.634300+0000","last_became_peered":"2021-10-08T19:29:40.634300+0000","last_unstale":"2021-10-08T19:32:03.752369+0000","last_undegraded":"2021-10-08T19:32:03.752369+0000","last_fullsized":"2021-10-08T19:32:03.752369+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:10.199698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:28:10.199698+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"70'5","reported_seq":193,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.757656+0000","last_change":"2021-10-08T19:30:51.369762+0000","last_active":"2021-10-08T19:32:03.757656+0000","last_peered":"2021-10-08T19:32:03.757656+0000","last_clean":"2021-10-08T19:32:03.757656+0000","last_became_active":"2021-10-08T19:25:15.496309+0000","last_became_peered":"2021-10-08T19:25:15.496309+0000","last_unstale":"2021-10-08T19:32:03.757656+0000","last_undegraded":"2021-10-08T19:32:03.757656+0000","last_fullsized":"2021-10-08T19:32:03.757656+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:30:51.369695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:30:51.369695+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034182739999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.10","version":"289'8","reported_seq":97,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.751951+0000","last_change":"2021-10-08T19:32:00.371046+0000","last_active":"2021-10-08T19:32:03.751951+0000","last_peered":"2021-10-08T19:32:03.751951+0000","last_clean":"2021-10-08T19:32:03.751951+0000","last_became_active":"2021-10-08T19:29:40.646031+0000","last_became_peered":"2021-10-08T19:29:40.646031+0000","last_unstale":"2021-10-08T19:32:03.751951+0000","last_undegraded":"2021-10-08T19:32:03.751951+0000","last_fullsized":"2021-10-08T19:32:03.751951+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'4","last_scrub_stamp":"2021-10-08T19:27:38.084136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:27:38.084136+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040040570000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":292,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.742212+0000","last_change":"2021-10-08T19:31:27.832981+0000","last_active":"2021-10-08T19:32:02.742212+0000","last_peered":"2021-10-08T19:32:02.742212+0000","last_clean":"2021-10-08T19:32:02.742212+0000","last_became_active":"2021-10-08T19:24:25.094384+0000","last_became_peered":"2021-10-08T19:24:25.094384+0000","last_unstale":"2021-10-08T19:32:02.742212+0000","last_undegraded":"2021-10-08T19:32:02.742212+0000","last_fullsized":"2021-10-08T19:32:02.742212+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:27.832886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:13.716331+0000","last_clean_scrub_stamp":"2021-10-08T19:31:27.832886+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034204959999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":220,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.746781+0000","last_change":"2021-10-08T19:31:26.648140+0000","last_active":"2021-10-08T19:32:02.746781+0000","last_peered":"2021-10-08T19:32:02.746781+0000","last_clean":"2021-10-08T19:32:02.746781+0000","last_became_active":"2021-10-08T19:24:25.106186+0000","last_became_peered":"2021-10-08T19:24:25.106186+0000","last_unstale":"2021-10-08T19:32:02.746781+0000","last_undegraded":"2021-10-08T19:32:02.746781+0000","last_fullsized":"2021-10-08T19:32:02.746781+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:26.648030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:31:26.648030+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001771297,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":271,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.739582+0000","last_change":"2021-10-08T19:30:12.068716+0000","last_active":"2021-10-08T19:32:02.739582+0000","last_peered":"2021-10-08T19:32:02.739582+0000","last_clean":"2021-10-08T19:32:02.739582+0000","last_became_active":"2021-10-08T19:21:29.642835+0000","last_became_peered":"2021-10-08T19:21:29.642835+0000","last_unstale":"2021-10-08T19:32:02.739582+0000","last_undegraded":"2021-10-08T19:32:02.739582+0000","last_fullsized":"2021-10-08T19:32:02.739582+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:30:12.068596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:30:12.068596+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0051914689999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":210,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:05.845540+0000","last_change":"2021-10-08T19:32:05.845506+0000","last_active":"2021-10-08T19:32:05.845540+0000","last_peered":"2021-10-08T19:32:05.845540+0000","last_clean":"2021-10-08T19:32:05.845540+0000","last_became_active":"2021-10-08T19:28:40.099215+0000","last_became_peered":"2021-10-08T19:28:40.099215+0000","last_unstale":"2021-10-08T19:32:05.845540+0000","last_undegraded":"2021-10-08T19:32:05.845540+0000","last_fullsized":"2021-10-08T19:32:05.845540+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:05.845412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:05.845412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.00772998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"289'19","reported_seq":113,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.752298+0000","last_change":"2021-10-08T19:31:23.525281+0000","last_active":"2021-10-08T19:32:03.752298+0000","last_peered":"2021-10-08T19:32:03.752298+0000","last_clean":"2021-10-08T19:32:03.752298+0000","last_became_active":"2021-10-08T19:29:40.640914+0000","last_became_peered":"2021-10-08T19:29:40.640914+0000","last_unstale":"2021-10-08T19:32:03.752298+0000","last_undegraded":"2021-10-08T19:32:03.752298+0000","last_fullsized":"2021-10-08T19:32:03.752298+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'11","last_scrub_stamp":"2021-10-08T19:31:23.525209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:31:23.525209+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039841909999999998,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":217,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.747552+0000","last_change":"2021-10-08T19:31:33.790422+0000","last_active":"2021-10-08T19:32:02.747552+0000","last_peered":"2021-10-08T19:32:02.747552+0000","last_clean":"2021-10-08T19:32:02.747552+0000","last_became_active":"2021-10-08T19:24:25.098128+0000","last_became_peered":"2021-10-08T19:24:25.098128+0000","last_unstale":"2021-10-08T19:32:02.747552+0000","last_undegraded":"2021-10-08T19:32:02.747552+0000","last_fullsized":"2021-10-08T19:32:02.747552+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:33.790341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:34.508558+0000","last_clean_scrub_stamp":"2021-10-08T19:31:33.790341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0017527389999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":283,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.738798+0000","last_change":"2021-10-08T19:28:11.383850+0000","last_active":"2021-10-08T19:32:02.738798+0000","last_peered":"2021-10-08T19:32:02.738798+0000","last_clean":"2021-10-08T19:32:02.738798+0000","last_became_active":"2021-10-08T19:24:25.095490+0000","last_became_peered":"2021-10-08T19:24:25.095490+0000","last_unstale":"2021-10-08T19:32:02.738798+0000","last_undegraded":"2021-10-08T19:32:02.738798+0000","last_fullsized":"2021-10-08T19:32:02.738798+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:11.383779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:11.383779+0000","last_clean_scrub_stamp":"2021-10-08T19:28:11.383779+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001362776,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":89,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.753101+0000","last_change":"2021-10-08T19:30:05.170118+0000","last_active":"2021-10-08T19:32:03.753101+0000","last_peered":"2021-10-08T19:32:03.753101+0000","last_clean":"2021-10-08T19:32:03.753101+0000","last_became_active":"2021-10-08T19:29:40.639358+0000","last_became_peered":"2021-10-08T19:29:40.639358+0000","last_unstale":"2021-10-08T19:32:03.753101+0000","last_undegraded":"2021-10-08T19:32:03.753101+0000","last_fullsized":"2021-10-08T19:32:03.753101+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:30:05.170003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:30:05.170003+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.031854517999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"289'20","reported_seq":348,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.746442+0000","last_change":"2021-10-08T19:31:31.440537+0000","last_active":"2021-10-08T19:32:03.746442+0000","last_peered":"2021-10-08T19:32:03.746442+0000","last_clean":"2021-10-08T19:32:03.746442+0000","last_became_active":"2021-10-08T19:29:40.636448+0000","last_became_peered":"2021-10-08T19:29:40.636448+0000","last_unstale":"2021-10-08T19:32:03.746442+0000","last_undegraded":"2021-10-08T19:32:03.746442+0000","last_fullsized":"2021-10-08T19:32:03.746442+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'10","last_scrub_stamp":"2021-10-08T19:31:31.440458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:31:31.440458+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0022868239999999998,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":268,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.742897+0000","last_change":"2021-10-08T19:28:15.902997+0000","last_active":"2021-10-08T19:32:02.742897+0000","last_peered":"2021-10-08T19:32:02.742897+0000","last_clean":"2021-10-08T19:32:02.742897+0000","last_became_active":"2021-10-08T19:21:23.604530+0000","last_became_peered":"2021-10-08T19:21:23.604530+0000","last_unstale":"2021-10-08T19:32:02.742897+0000","last_undegraded":"2021-10-08T19:32:02.742897+0000","last_fullsized":"2021-10-08T19:32:02.742897+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:15.902892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:28:15.902892+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0029135179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1f","version":"114'10","reported_seq":308,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.754615+0000","last_change":"2021-10-08T19:29:58.479868+0000","last_active":"2021-10-08T19:32:03.754615+0000","last_peered":"2021-10-08T19:32:03.754615+0000","last_clean":"2021-10-08T19:32:03.754615+0000","last_became_active":"2021-10-08T19:24:25.105742+0000","last_became_peered":"2021-10-08T19:24:25.105742+0000","last_unstale":"2021-10-08T19:32:03.754615+0000","last_undegraded":"2021-10-08T19:32:03.754615+0000","last_fullsized":"2021-10-08T19:32:03.754615+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'10","last_scrub_stamp":"2021-10-08T19:29:58.479782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:29:58.479782+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0016138999999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"69'1","reported_seq":270,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.741838+0000","last_change":"2021-10-08T19:31:36.328498+0000","last_active":"2021-10-08T19:32:02.741838+0000","last_peered":"2021-10-08T19:32:02.741838+0000","last_clean":"2021-10-08T19:32:02.741838+0000","last_became_active":"2021-10-08T19:21:29.640296+0000","last_became_peered":"2021-10-08T19:21:29.640296+0000","last_unstale":"2021-10-08T19:32:02.741838+0000","last_undegraded":"2021-10-08T19:32:02.741838+0000","last_fullsized":"2021-10-08T19:32:02.741838+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2021-10-08T19:31:36.328401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:31:36.328401+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040870780000000001,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"289'19","reported_seq":283,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.747651+0000","last_change":"2021-10-08T19:31:35.715486+0000","last_active":"2021-10-08T19:32:02.747651+0000","last_peered":"2021-10-08T19:32:02.747651+0000","last_clean":"2021-10-08T19:32:02.747651+0000","last_became_active":"2021-10-08T19:28:40.126425+0000","last_became_peered":"2021-10-08T19:28:40.126425+0000","last_unstale":"2021-10-08T19:32:02.747651+0000","last_undegraded":"2021-10-08T19:32:02.747651+0000","last_fullsized":"2021-10-08T19:32:02.747651+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:31:35.715402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:31:35.715402+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003242928,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":89,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.752110+0000","last_change":"2021-10-08T19:31:24.567662+0000","last_active":"2021-10-08T19:32:03.752110+0000","last_peered":"2021-10-08T19:32:03.752110+0000","last_clean":"2021-10-08T19:32:03.752110+0000","last_became_active":"2021-10-08T19:29:40.640952+0000","last_became_peered":"2021-10-08T19:29:40.640952+0000","last_unstale":"2021-10-08T19:32:03.752110+0000","last_undegraded":"2021-10-08T19:32:03.752110+0000","last_fullsized":"2021-10-08T19:32:03.752110+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:24.567564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:31:24.567564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0052812129999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":272,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.746484+0000","last_change":"2021-10-08T19:29:30.474880+0000","last_active":"2021-10-08T19:32:03.746484+0000","last_peered":"2021-10-08T19:32:03.746484+0000","last_clean":"2021-10-08T19:32:03.746484+0000","last_became_active":"2021-10-08T19:21:27.632648+0000","last_became_peered":"2021-10-08T19:21:27.632648+0000","last_unstale":"2021-10-08T19:32:03.746484+0000","last_undegraded":"2021-10-08T19:32:03.746484+0000","last_fullsized":"2021-10-08T19:32:03.746484+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:29:30.474810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:29:30.474810+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0013849260000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"69'1","reported_seq":120,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.747717+0000","last_change":"2021-10-08T19:28:40.385176+0000","last_active":"2021-10-08T19:32:03.747717+0000","last_peered":"2021-10-08T19:32:03.747717+0000","last_clean":"2021-10-08T19:32:03.747717+0000","last_became_active":"2021-10-08T19:28:40.146302+0000","last_became_peered":"2021-10-08T19:28:40.146302+0000","last_unstale":"2021-10-08T19:32:03.747717+0000","last_undegraded":"2021-10-08T19:32:03.747717+0000","last_fullsized":"2021-10-08T19:32:03.747717+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2021-10-08T19:28:06.691075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:28:06.691075+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"289'27","reported_seq":442,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.744366+0000","last_change":"2021-10-08T19:31:33.421958+0000","last_active":"2021-10-08T19:32:03.744366+0000","last_peered":"2021-10-08T19:32:03.744366+0000","last_clean":"2021-10-08T19:32:03.744366+0000","last_became_active":"2021-10-08T19:29:40.629461+0000","last_became_peered":"2021-10-08T19:29:40.629461+0000","last_unstale":"2021-10-08T19:32:03.744366+0000","last_undegraded":"2021-10-08T19:32:03.744366+0000","last_fullsized":"2021-10-08T19:32:03.744366+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'27","last_scrub_stamp":"2021-10-08T19:31:33.421881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:31:33.421881+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039796650000000003,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":550,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":219,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.746920+0000","last_change":"2021-10-08T19:31:24.705440+0000","last_active":"2021-10-08T19:32:02.746920+0000","last_peered":"2021-10-08T19:32:02.746920+0000","last_clean":"2021-10-08T19:32:02.746920+0000","last_became_active":"2021-10-08T19:24:25.106119+0000","last_became_peered":"2021-10-08T19:24:25.106119+0000","last_unstale":"2021-10-08T19:32:02.746920+0000","last_undegraded":"2021-10-08T19:32:02.746920+0000","last_fullsized":"2021-10-08T19:32:02.746920+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:24.705315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:46.422866+0000","last_clean_scrub_stamp":"2021-10-08T19:31:24.705315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0014361210000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":116,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.747733+0000","last_change":"2021-10-08T19:28:40.148340+0000","last_active":"2021-10-08T19:32:03.747733+0000","last_peered":"2021-10-08T19:32:03.747733+0000","last_clean":"2021-10-08T19:32:03.747733+0000","last_became_active":"2021-10-08T19:28:40.148009+0000","last_became_peered":"2021-10-08T19:28:40.148009+0000","last_unstale":"2021-10-08T19:32:03.747733+0000","last_undegraded":"2021-10-08T19:32:03.747733+0000","last_fullsized":"2021-10-08T19:32:03.747733+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:10.658350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:28:10.658350+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":281,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.757965+0000","last_change":"2021-10-08T19:27:37.219578+0000","last_active":"2021-10-08T19:32:03.757965+0000","last_peered":"2021-10-08T19:32:03.757965+0000","last_clean":"2021-10-08T19:32:03.757965+0000","last_became_active":"2021-10-08T19:24:25.097782+0000","last_became_peered":"2021-10-08T19:24:25.097782+0000","last_unstale":"2021-10-08T19:32:03.757965+0000","last_undegraded":"2021-10-08T19:32:03.757965+0000","last_fullsized":"2021-10-08T19:32:03.757965+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:27:37.219503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:37.219503+0000","last_clean_scrub_stamp":"2021-10-08T19:27:37.219503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0015176320000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"289'18","reported_seq":110,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.753357+0000","last_change":"2021-10-08T19:29:57.179038+0000","last_active":"2021-10-08T19:32:03.753357+0000","last_peered":"2021-10-08T19:32:03.753357+0000","last_clean":"2021-10-08T19:32:03.753357+0000","last_became_active":"2021-10-08T19:29:40.645144+0000","last_became_peered":"2021-10-08T19:29:40.645144+0000","last_unstale":"2021-10-08T19:32:03.753357+0000","last_undegraded":"2021-10-08T19:32:03.753357+0000","last_fullsized":"2021-10-08T19:32:03.753357+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'12","last_scrub_stamp":"2021-10-08T19:29:57.178925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:29:57.178925+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0088169310000000001,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":25,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":83,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.752883+0000","last_change":"2021-10-08T19:29:44.444198+0000","last_active":"2021-10-08T19:32:03.752883+0000","last_peered":"2021-10-08T19:32:03.752883+0000","last_clean":"2021-10-08T19:32:03.752883+0000","last_became_active":"2021-10-08T19:29:44.443807+0000","last_became_peered":"2021-10-08T19:29:44.443807+0000","last_unstale":"2021-10-08T19:32:03.752883+0000","last_undegraded":"2021-10-08T19:32:03.752883+0000","last_fullsized":"2021-10-08T19:32:03.752883+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:14.247730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:28:14.247730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034956309999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":289,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.757369+0000","last_change":"2021-10-08T19:31:59.409211+0000","last_active":"2021-10-08T19:32:03.757369+0000","last_peered":"2021-10-08T19:32:03.757369+0000","last_clean":"2021-10-08T19:32:03.757369+0000","last_became_active":"2021-10-08T19:29:40.638352+0000","last_became_peered":"2021-10-08T19:29:40.638352+0000","last_unstale":"2021-10-08T19:32:03.757369+0000","last_undegraded":"2021-10-08T19:32:03.757369+0000","last_fullsized":"2021-10-08T19:32:03.757369+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:59.409131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:31:59.409131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0098736889999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":101,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.754155+0000","last_change":"2021-10-08T19:31:22.789442+0000","last_active":"2021-10-08T19:32:03.754155+0000","last_peered":"2021-10-08T19:32:03.754155+0000","last_clean":"2021-10-08T19:32:03.754155+0000","last_became_active":"2021-10-08T19:31:22.788455+0000","last_became_peered":"2021-10-08T19:31:22.788455+0000","last_unstale":"2021-10-08T19:32:03.754155+0000","last_undegraded":"2021-10-08T19:32:03.754155+0000","last_fullsized":"2021-10-08T19:32:03.754155+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:02.166534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:38.544673+0000","last_clean_scrub_stamp":"2021-10-08T19:28:02.166534+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0019818940000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"289'15","reported_seq":332,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.758422+0000","last_change":"2021-10-08T19:31:30.213636+0000","last_active":"2021-10-08T19:32:03.758422+0000","last_peered":"2021-10-08T19:32:03.758422+0000","last_clean":"2021-10-08T19:32:03.758422+0000","last_became_active":"2021-10-08T19:29:40.631689+0000","last_became_peered":"2021-10-08T19:29:40.631689+0000","last_unstale":"2021-10-08T19:32:03.758422+0000","last_undegraded":"2021-10-08T19:32:03.758422+0000","last_fullsized":"2021-10-08T19:32:03.758422+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'9","last_scrub_stamp":"2021-10-08T19:31:30.213519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:31:30.213519+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040346849999999997,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":279,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.741535+0000","last_change":"2021-10-08T19:31:25.393602+0000","last_active":"2021-10-08T19:32:02.741535+0000","last_peered":"2021-10-08T19:32:02.741535+0000","last_clean":"2021-10-08T19:32:02.741535+0000","last_became_active":"2021-10-08T19:21:23.607785+0000","last_became_peered":"2021-10-08T19:21:23.607785+0000","last_unstale":"2021-10-08T19:32:02.741535+0000","last_undegraded":"2021-10-08T19:32:02.741535+0000","last_fullsized":"2021-10-08T19:32:02.741535+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:25.393517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:31:25.393517+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.00347643,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":264,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.740963+0000","last_change":"2021-10-08T19:28:04.929950+0000","last_active":"2021-10-08T19:32:02.740963+0000","last_peered":"2021-10-08T19:32:02.740963+0000","last_clean":"2021-10-08T19:32:02.740963+0000","last_became_active":"2021-10-08T19:21:27.633979+0000","last_became_peered":"2021-10-08T19:21:27.633979+0000","last_unstale":"2021-10-08T19:32:02.740963+0000","last_undegraded":"2021-10-08T19:32:02.740963+0000","last_fullsized":"2021-10-08T19:32:02.740963+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:04.929862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:05.799361+0000","last_clean_scrub_stamp":"2021-10-08T19:28:04.929862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.015926389999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":286,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.745694+0000","last_change":"2021-10-08T19:31:59.265005+0000","last_active":"2021-10-08T19:32:03.745694+0000","last_peered":"2021-10-08T19:32:03.745694+0000","last_clean":"2021-10-08T19:32:03.745694+0000","last_became_active":"2021-10-08T19:28:40.159162+0000","last_became_peered":"2021-10-08T19:28:40.159162+0000","last_unstale":"2021-10-08T19:32:03.745694+0000","last_undegraded":"2021-10-08T19:32:03.745694+0000","last_fullsized":"2021-10-08T19:32:03.745694+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:14.144450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:24:14.144450+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0032569320000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"289'7","reported_seq":363,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.758633+0000","last_change":"2021-10-08T19:31:51.851585+0000","last_active":"2021-10-08T19:32:03.758633+0000","last_peered":"2021-10-08T19:32:03.758633+0000","last_clean":"2021-10-08T19:32:03.758633+0000","last_became_active":"2021-10-08T19:31:51.675189+0000","last_became_peered":"2021-10-08T19:31:51.675189+0000","last_unstale":"2021-10-08T19:32:03.758633+0000","last_undegraded":"2021-10-08T19:32:03.758633+0000","last_fullsized":"2021-10-08T19:32:03.758633+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'5","last_scrub_stamp":"2021-10-08T19:31:27.199641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:31:27.199641+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0055097490000000004,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":10,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":295,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.742149+0000","last_change":"2021-10-08T19:29:40.244832+0000","last_active":"2021-10-08T19:32:02.742149+0000","last_peered":"2021-10-08T19:32:02.742149+0000","last_clean":"2021-10-08T19:32:02.742149+0000","last_became_active":"2021-10-08T19:24:25.096225+0000","last_became_peered":"2021-10-08T19:24:25.096225+0000","last_unstale":"2021-10-08T19:32:02.742149+0000","last_undegraded":"2021-10-08T19:32:02.742149+0000","last_fullsized":"2021-10-08T19:32:02.742149+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:29:40.244757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:29:40.244757+0000","last_clean_scrub_stamp":"2021-10-08T19:29:40.244757+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0014831639999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":293,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.739428+0000","last_change":"2021-10-08T19:31:21.361484+0000","last_active":"2021-10-08T19:32:02.739428+0000","last_peered":"2021-10-08T19:32:02.739428+0000","last_clean":"2021-10-08T19:32:02.739428+0000","last_became_active":"2021-10-08T19:28:40.101187+0000","last_became_peered":"2021-10-08T19:28:40.101187+0000","last_unstale":"2021-10-08T19:32:02.739428+0000","last_undegraded":"2021-10-08T19:32:02.739428+0000","last_fullsized":"2021-10-08T19:32:02.739428+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:21.361407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:31:21.361407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003551378,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":298,"reported_epoch":308,"state":"active+clean","last_fresh":"2021-10-08T19:32:02.740548+0000","last_change":"2021-10-08T19:29:40.633278+0000","last_active":"2021-10-08T19:32:02.740548+0000","last_peered":"2021-10-08T19:32:02.740548+0000","last_clean":"2021-10-08T19:32:02.740548+0000","last_became_active":"2021-10-08T19:29:40.632965+0000","last_became_peered":"2021-10-08T19:29:40.632965+0000","last_unstale":"2021-10-08T19:32:02.740548+0000","last_undegraded":"2021-10-08T19:32:02.740548+0000","last_fullsized":"2021-10-08T19:32:02.740548+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:14.882819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:28:14.882819+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.020979794,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"289'19","reported_seq":412,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.756624+0000","last_change":"2021-10-08T19:31:22.251853+0000","last_active":"2021-10-08T19:32:03.756624+0000","last_peered":"2021-10-08T19:32:03.756624+0000","last_clean":"2021-10-08T19:32:03.756624+0000","last_became_active":"2021-10-08T19:28:40.099770+0000","last_became_peered":"2021-10-08T19:28:40.099770+0000","last_unstale":"2021-10-08T19:32:03.756624+0000","last_undegraded":"2021-10-08T19:32:03.756624+0000","last_fullsized":"2021-10-08T19:32:03.756624+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'13","last_scrub_stamp":"2021-10-08T19:31:22.251742+0000","last_deep_scrub":"88'13","last_deep_scrub_stamp":"2021-10-08T19:23:16.016646+0000","last_clean_scrub_stamp":"2021-10-08T19:31:22.251742+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039856270000000003,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":89,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.753703+0000","last_change":"2021-10-08T19:30:06.157170+0000","last_active":"2021-10-08T19:32:03.753703+0000","last_peered":"2021-10-08T19:32:03.753703+0000","last_clean":"2021-10-08T19:32:03.753703+0000","last_became_active":"2021-10-08T19:29:40.627394+0000","last_became_peered":"2021-10-08T19:29:40.627394+0000","last_unstale":"2021-10-08T19:32:03.753703+0000","last_undegraded":"2021-10-08T19:32:03.753703+0000","last_fullsized":"2021-10-08T19:32:03.753703+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:30:06.157078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:30:06.157078+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.016769394,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":116,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.745868+0000","last_change":"2021-10-08T19:28:40.146371+0000","last_active":"2021-10-08T19:32:03.745868+0000","last_peered":"2021-10-08T19:32:03.745868+0000","last_clean":"2021-10-08T19:32:03.745868+0000","last_became_active":"2021-10-08T19:28:40.145868+0000","last_became_peered":"2021-10-08T19:28:40.145868+0000","last_unstale":"2021-10-08T19:32:03.745868+0000","last_undegraded":"2021-10-08T19:32:03.745868+0000","last_fullsized":"2021-10-08T19:32:03.745868+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:02.663022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:28:02.663022+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":283,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.758392+0000","last_change":"2021-10-08T19:30:32.528582+0000","last_active":"2021-10-08T19:32:03.758392+0000","last_peered":"2021-10-08T19:32:03.758392+0000","last_clean":"2021-10-08T19:32:03.758392+0000","last_became_active":"2021-10-08T19:28:40.099543+0000","last_became_peered":"2021-10-08T19:28:40.099543+0000","last_unstale":"2021-10-08T19:32:03.758392+0000","last_undegraded":"2021-10-08T19:32:03.758392+0000","last_fullsized":"2021-10-08T19:32:03.758392+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:30:32.528510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:50.032367+0000","last_clean_scrub_stamp":"2021-10-08T19:30:32.528510+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0078699960000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"289'27","reported_seq":123,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.752183+0000","last_change":"2021-10-08T19:31:31.454233+0000","last_active":"2021-10-08T19:32:03.752183+0000","last_peered":"2021-10-08T19:32:03.752183+0000","last_clean":"2021-10-08T19:32:03.752183+0000","last_became_active":"2021-10-08T19:29:40.631002+0000","last_became_peered":"2021-10-08T19:29:40.631002+0000","last_unstale":"2021-10-08T19:32:03.752183+0000","last_undegraded":"2021-10-08T19:32:03.752183+0000","last_fullsized":"2021-10-08T19:32:03.752183+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'15","last_scrub_stamp":"2021-10-08T19:31:31.454160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:31:31.454160+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0041423509999999998,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":270,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.746238+0000","last_change":"2021-10-08T19:28:15.535918+0000","last_active":"2021-10-08T19:32:03.746238+0000","last_peered":"2021-10-08T19:32:03.746238+0000","last_clean":"2021-10-08T19:32:03.746238+0000","last_became_active":"2021-10-08T19:21:23.603422+0000","last_became_peered":"2021-10-08T19:21:23.603422+0000","last_unstale":"2021-10-08T19:32:03.746238+0000","last_undegraded":"2021-10-08T19:32:03.746238+0000","last_fullsized":"2021-10-08T19:32:03.746238+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:28:15.535842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:15.535842+0000","last_clean_scrub_stamp":"2021-10-08T19:28:15.535842+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014121440000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":309,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.756871+0000","last_change":"2021-10-08T19:31:31.176254+0000","last_active":"2021-10-08T19:32:03.756871+0000","last_peered":"2021-10-08T19:32:03.756871+0000","last_clean":"2021-10-08T19:32:03.756871+0000","last_became_active":"2021-10-08T19:28:40.099286+0000","last_became_peered":"2021-10-08T19:28:40.099286+0000","last_unstale":"2021-10-08T19:32:03.756871+0000","last_undegraded":"2021-10-08T19:32:03.756871+0000","last_fullsized":"2021-10-08T19:32:03.756871+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:31.176160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:31.176160+0000","last_clean_scrub_stamp":"2021-10-08T19:31:31.176160+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0046843739999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":89,"reported_epoch":309,"state":"active+clean","last_fresh":"2021-10-08T19:32:03.753017+0000","last_change":"2021-10-08T19:31:32.458220+0000","last_active":"2021-10-08T19:32:03.753017+0000","last_peered":"2021-10-08T19:32:03.753017+0000","last_clean":"2021-10-08T19:32:03.753017+0000","last_became_active":"2021-10-08T19:29:40.638221+0000","last_became_peered":"2021-10-08T19:29:40.638221+0000","last_unstale":"2021-10-08T19:32:03.753017+0000","last_undegraded":"2021-10-08T19:32:03.753017+0000","last_fullsized":"2021-10-08T19:32:03.753017+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.458082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.458082+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.045433947000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":2730557440,"num_objects":41665,"num_object_clones":0,"num_object_copies":124995,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41665,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41665,"num_write_kb":2666560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1088,"num_bytes_recovered":71303168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8256552960,"data_stored":8256552960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41665,"ondisk_log_size":41665,"up":48,"acting":48,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":11,"stat_sum":{"num_bytes":322020,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":168,"num_write":96,"num_write_kb":1318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":2307802,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1430,"ondisk_log_size":1430,"up":33,"acting":33,"num_store_stats":8},{"poolid":3,"num_pg":23,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":466,"num_read_kb":466,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1167,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":69,"acting":69,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1113,"num_read_kb":870,"num_write":703,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":505,"num_bytes_recovered":10716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":696,"ondisk_log_size":696,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81,"ondisk_log_size":81,"up":96,"acting":96,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201413,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1611788,"kb_used_data":1469636,"kb_used_omap":0,"kb_used_meta":142144,"kb_avail":92133364,"statfs":{"total":95995035648,"available":94344564736,"internally_reserved":0,"allocated":1504907264,"data_stored":1504157543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":145555456},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:31:30 2021","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.5629999999999999,"15min":1.159},"min":{"1min":0.20899999999999999,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":5.2910000000000004,"5min":26.065000000000001,"15min":32.366999999999997},"last":1.806},{"interface":"front","average":{"1min":2.0710000000000002,"5min":1.6619999999999999,"15min":1.27},"min":{"1min":0.26100000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":7.0380000000000003,"5min":25.75,"15min":29.736000000000001},"last":0.72399999999999998}]},{"osd":1,"last update":"Fri Oct 8 19:31:30 2021","interfaces":[{"interface":"back","average":{"1min":2.7669999999999999,"5min":1.865,"15min":1.3819999999999999},"min":{"1min":0.222,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":17.452999999999999,"5min":26.044,"15min":26.044},"last":1.6259999999999999},{"interface":"front","average":{"1min":2.7999999999999998,"5min":2.1139999999999999,"15min":1.2010000000000001},"min":{"1min":0.32200000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":18.053000000000001,"5min":28.119,"15min":28.119},"last":0.878}]},{"osd":2,"last update":"Fri Oct 8 19:31:30 2021","interfaces":[{"interface":"back","average":{"1min":2.137,"5min":1.659,"15min":1.3009999999999999},"min":{"1min":0.31,"5min":0.26300000000000001,"15min":0.26100000000000001},"max":{"1min":7.524,"5min":7.8170000000000002,"15min":27.018000000000001},"last":2.7839999999999998},{"interface":"front","average":{"1min":2.1920000000000002,"5min":1.48,"15min":1.2070000000000001},"min":{"1min":0.33400000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":8.2870000000000008,"5min":8.2870000000000008,"15min":27.113},"last":1.5409999999999999}]},{"osd":3,"last update":"Fri Oct 8 19:31:30 2021","interfaces":[{"interface":"back","average":{"1min":2.4700000000000002,"5min":2.0619999999999998,"15min":1.4259999999999999},"min":{"1min":0.35299999999999998,"5min":0.29999999999999999,"15min":0.29399999999999998},"max":{"1min":13.605,"5min":16.853000000000002,"15min":27.010000000000002},"last":0.628},{"interface":"front","average":{"1min":2.1960000000000002,"5min":2.016,"15min":1.3560000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":8.9489999999999998,"5min":10.709,"15min":27.263999999999999},"last":2.7130000000000001}]},{"osd":4,"last update":"Fri Oct 8 19:31:30 2021","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":0.97799999999999998,"15min":0.68300000000000005},"min":{"1min":0.249,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":7.4610000000000003,"5min":7.4610000000000003,"15min":7.4610000000000003},"last":0.23899999999999999},{"interface":"front","average":{"1min":1.0229999999999999,"5min":0.85799999999999998,"15min":0.625},"min":{"1min":0.30599999999999999,"5min":0.28299999999999997,"15min":0.27500000000000002},"max":{"1min":4.9820000000000002,"5min":6.9320000000000004,"15min":6.9320000000000004},"last":0.435}]},{"osd":5,"last update":"Fri Oct 8 19:31:30 2021","interfaces":[{"interface":"back","average":{"1min":1.5629999999999999,"5min":1.1599999999999999,"15min":0.76900000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.251},"max":{"1min":9.9280000000000008,"5min":9.9280000000000008,"15min":9.9280000000000008},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.98299999999999998,"15min":0.68700000000000006},"min":{"1min":0.34100000000000003,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":3.484,"5min":18.655000000000001,"15min":18.655000000000001},"last":0.46600000000000003}]},{"osd":6,"last update":"Fri Oct 8 19:31:30 2021","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.099,"15min":0.752},"min":{"1min":0.30399999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":6.9989999999999997,"5min":6.9989999999999997,"15min":6.9989999999999997},"last":0.57399999999999995},{"interface":"front","average":{"1min":1.304,"5min":1.079,"15min":0.79400000000000004},"min":{"1min":0.39300000000000002,"5min":0.35099999999999998,"15min":0.318},"max":{"1min":7.742,"5min":7.742,"15min":7.742},"last":0.32100000000000001}]}]},{"osd":6,"up_from":47,"seq":201863463049,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":640436,"kb_used_data":484332,"kb_used_omap":0,"kb_used_meta":156096,"kb_avail":93104716,"statfs":{"total":95995035648,"available":95339229184,"internally_reserved":0,"allocated":495955968,"data_stored":495229300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":159842304},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:31:10 2021","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.796,"15min":1.0600000000000001},"min":{"1min":0.25900000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":3.3959999999999999,"5min":28.382999999999999,"15min":28.382999999999999},"last":1.0209999999999999},{"interface":"front","average":{"1min":1.345,"5min":2.7360000000000002,"15min":1.4319999999999999},"min":{"1min":0.25900000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":4.8840000000000003,"5min":69.477000000000004,"15min":69.477000000000004},"last":2.5979999999999999}]},{"osd":1,"last update":"Fri Oct 8 19:31:10 2021","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":1.0569999999999999,"15min":0.84799999999999998},"min":{"1min":0.245,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":4.5380000000000003,"5min":6.1059999999999999,"15min":14.878},"last":1.7050000000000001},{"interface":"front","average":{"1min":1.806,"5min":1.298,"15min":0.94499999999999995},"min":{"1min":0.29699999999999999,"5min":0.26900000000000002,"15min":0.26400000000000001},"max":{"1min":5.7380000000000004,"5min":7.4189999999999996,"15min":14.779},"last":1.339}]},{"osd":2,"last update":"Fri Oct 8 19:31:10 2021","interfaces":[{"interface":"back","average":{"1min":1.7509999999999999,"5min":2.266,"15min":1.375},"min":{"1min":0.28699999999999998,"5min":0.251,"15min":0.251},"max":{"1min":5.7009999999999996,"5min":69.322999999999993,"15min":69.322999999999993},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.2969999999999999,"5min":2.4849999999999999,"15min":1.4510000000000001},"min":{"1min":0.33700000000000002,"5min":0.245,"15min":0.245},"max":{"1min":4.1040000000000001,"5min":69.418999999999997,"15min":69.418999999999997},"last":2.621}]},{"osd":3,"last update":"Fri Oct 8 19:31:10 2021","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":1.899,"15min":1.1519999999999999},"min":{"1min":0.307,"5min":0.29599999999999999,"15min":0.27900000000000003},"max":{"1min":4.4359999999999999,"5min":21.670000000000002,"15min":21.670000000000002},"last":1.7410000000000001},{"interface":"front","average":{"1min":2.0409999999999999,"5min":1.655,"15min":1.0669999999999999},"min":{"1min":0.38,"5min":0.29599999999999999,"15min":0.28000000000000003},"max":{"1min":5.4649999999999999,"5min":22.254999999999999,"15min":22.254999999999999},"last":1.048}]},{"osd":4,"last update":"Fri Oct 8 19:31:10 2021","interfaces":[{"interface":"back","average":{"1min":1.609,"5min":1.0669999999999999,"15min":0.65900000000000003},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":9.4939999999999998,"5min":24.516999999999999,"15min":24.516999999999999},"last":2.6509999999999998},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.569,"15min":0.85599999999999998},"min":{"1min":0.27500000000000002,"5min":0.27000000000000002,"15min":0.26100000000000001},"max":{"1min":9.6890000000000001,"5min":69.593999999999994,"15min":69.593999999999994},"last":1.774}]},{"osd":5,"last update":"Fri Oct 8 19:31:10 2021","interfaces":[{"interface":"back","average":{"1min":1.5369999999999999,"5min":0.996,"15min":0.67700000000000005},"min":{"1min":0.33000000000000002,"5min":0.29499999999999998,"15min":0.28499999999999998},"max":{"1min":9.5670000000000002,"5min":15.678000000000001,"15min":15.678000000000001},"last":3.4780000000000002},{"interface":"front","average":{"1min":1.351,"5min":1.782,"15min":0.93000000000000005},"min":{"1min":0.312,"5min":0.29799999999999999,"15min":0.252},"max":{"1min":6.5140000000000002,"5min":69.561000000000007,"15min":69.561000000000007},"last":4.7220000000000004}]},{"osd":7,"last update":"Fri Oct 8 19:31:33 2021","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":0.89600000000000002,"15min":0.66000000000000003},"min":{"1min":0.29599999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":5.5019999999999998,"5min":5.5019999999999998,"15min":5.5019999999999998},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.198,"15min":0.79500000000000004},"min":{"1min":0.35899999999999999,"5min":0.33100000000000002,"15min":0.313},"max":{"1min":4.1260000000000003,"5min":15.962,"15min":15.962},"last":2.637}]}]},{"osd":1,"up_from":13,"seq":55834575004,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1706152,"kb_used_data":1499296,"kb_used_omap":0,"kb_used_meta":206848,"kb_avail":92039000,"statfs":{"total":95995035648,"available":94247936000,"internally_reserved":0,"allocated":1535279104,"data_stored":1534500116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":211812352},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:31:50 2021","interfaces":[{"interface":"back","average":{"1min":7.8179999999999996,"5min":4.7519999999999998,"15min":2.7799999999999998},"min":{"1min":0.22800000000000001,"5min":0.19600000000000001,"15min":0.184},"max":{"1min":102.352,"5min":126.256,"15min":126.256},"last":1.294},{"interface":"front","average":{"1min":6.7190000000000003,"5min":4.6609999999999996,"15min":2.9340000000000002},"min":{"1min":0.24099999999999999,"5min":0.182,"15min":0.182},"max":{"1min":102.462,"5min":126.176,"15min":126.176},"last":2.3580000000000001}]},{"osd":2,"last update":"Fri Oct 8 19:32:08 2021","interfaces":[{"interface":"back","average":{"1min":7.0990000000000002,"5min":2.6120000000000001,"15min":2.0840000000000001},"min":{"1min":0.28399999999999997,"5min":0.192,"15min":0.192},"max":{"1min":102.395,"5min":102.395,"15min":102.395},"last":3.2170000000000001},{"interface":"front","average":{"1min":7.0350000000000001,"5min":3.3900000000000001,"15min":2.3490000000000002},"min":{"1min":0.29499999999999998,"5min":0.23400000000000001,"15min":0.22700000000000001},"max":{"1min":102.50700000000001,"5min":102.50700000000001,"15min":102.50700000000001},"last":3.0310000000000001}]},{"osd":3,"last update":"Fri Oct 8 19:31:27 2021","interfaces":[{"interface":"back","average":{"1min":9.4990000000000006,"5min":3.956,"15min":2.294},"min":{"1min":0.32400000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":105.836,"5min":105.836,"15min":105.836},"last":3.2370000000000001},{"interface":"front","average":{"1min":9.8680000000000003,"5min":3.7480000000000002,"15min":2.145},"min":{"1min":0.26200000000000001,"5min":0.23899999999999999,"15min":0.23599999999999999},"max":{"1min":106.12,"5min":106.12,"15min":106.12},"last":1.2649999999999999}]},{"osd":4,"last update":"Fri Oct 8 19:31:36 2021","interfaces":[{"interface":"back","average":{"1min":7.2839999999999998,"5min":2.677,"15min":1.659},"min":{"1min":0.34899999999999998,"5min":0.307,"15min":0.29499999999999998},"max":{"1min":103.538,"5min":103.538,"15min":103.538},"last":1.0700000000000001},{"interface":"front","average":{"1min":7.3840000000000003,"5min":2.4780000000000002,"15min":1.385},"min":{"1min":0.27100000000000002,"5min":0.254,"15min":0.254},"max":{"1min":102.67100000000001,"5min":102.67100000000001,"15min":102.67100000000001},"last":0.93700000000000006}]},{"osd":5,"last update":"Fri Oct 8 19:32:02 2021","interfaces":[{"interface":"back","average":{"1min":6.6109999999999998,"5min":2.8879999999999999,"15min":1.7230000000000001},"min":{"1min":0.40400000000000003,"5min":0.33200000000000002,"15min":0.29899999999999999},"max":{"1min":102.717,"5min":102.717,"15min":102.717},"last":2.3220000000000001},{"interface":"front","average":{"1min":6.7720000000000002,"5min":2.4039999999999999,"15min":1.413},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.29999999999999999},"max":{"1min":102.617,"5min":102.617,"15min":102.617},"last":0.96699999999999997}]},{"osd":6,"last update":"Fri Oct 8 19:31:17 2021","interfaces":[{"interface":"back","average":{"1min":7.4880000000000004,"5min":2.8780000000000001,"15min":1.7110000000000001},"min":{"1min":0.377,"5min":0.33100000000000002,"15min":0.26700000000000002},"max":{"1min":103.73,"5min":103.73,"15min":103.73},"last":1.099},{"interface":"front","average":{"1min":7.3789999999999996,"5min":3.327,"15min":1.7709999999999999},"min":{"1min":0.47499999999999998,"5min":0.36699999999999999,"15min":0.28399999999999997},"max":{"1min":102.753,"5min":102.753,"15min":102.753},"last":2.7730000000000001}]},{"osd":7,"last update":"Fri Oct 8 19:31:36 2021","interfaces":[{"interface":"back","average":{"1min":7.4029999999999996,"5min":3.077,"15min":1.7929999999999999},"min":{"1min":0.50900000000000001,"5min":0.36399999999999999,"15min":0.312},"max":{"1min":102.773,"5min":102.773,"15min":102.773},"last":2.5219999999999998},{"interface":"front","average":{"1min":7.4660000000000002,"5min":2.5550000000000002,"15min":1.4370000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":102.63800000000001,"5min":102.63800000000001,"15min":102.63800000000001},"last":1.028}]}]},{"osd":0,"up_from":8,"seq":34359738527,"num_pgs":61,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":834760,"kb_used_data":658496,"kb_used_omap":0,"kb_used_meta":176256,"kb_avail":92910392,"statfs":{"total":95995035648,"available":95140241408,"internally_reserved":0,"allocated":674299904,"data_stored":673553103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":180486144},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 8 19:31:45 2021","interfaces":[{"interface":"back","average":{"1min":6.125,"5min":3.5510000000000002,"15min":1.831},"min":{"1min":0.20699999999999999,"5min":0.19400000000000001,"15min":0.192},"max":{"1min":91.954999999999998,"5min":91.954999999999998,"15min":91.954999999999998},"last":1.573},{"interface":"front","average":{"1min":5.9020000000000001,"5min":2.8719999999999999,"15min":1.7889999999999999},"min":{"1min":0.22600000000000001,"5min":0.219,"15min":0.217},"max":{"1min":91.046000000000006,"5min":91.046000000000006,"15min":91.046000000000006},"last":1.5389999999999999}]},{"osd":2,"last update":"Fri Oct 8 19:31:07 2021","interfaces":[{"interface":"back","average":{"1min":1.8819999999999999,"5min":2.444,"15min":1.657},"min":{"1min":0.24199999999999999,"5min":0.22800000000000001,"15min":0.22700000000000001},"max":{"1min":8.8800000000000008,"5min":14.307,"15min":62.390000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.9870000000000001,"15min":1.5389999999999999},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.19500000000000001},"max":{"1min":7.7809999999999997,"5min":10.121,"15min":62.718000000000004},"last":1.47}]},{"osd":3,"last update":"Fri Oct 8 19:31:31 2021","interfaces":[{"interface":"back","average":{"1min":2.8380000000000001,"5min":2.718,"15min":1.7829999999999999},"min":{"1min":0.28399999999999997,"5min":0.217,"15min":0.217},"max":{"1min":14.551,"5min":15.090999999999999,"15min":62.491},"last":1.052},{"interface":"front","average":{"1min":2.9510000000000001,"5min":2.2109999999999999,"15min":1.643},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":22.016999999999999,"5min":22.016999999999999,"15min":62.673000000000002},"last":0.29899999999999999}]},{"osd":4,"last update":"Fri Oct 8 19:31:45 2021","interfaces":[{"interface":"back","average":{"1min":2.4689999999999999,"5min":2.0750000000000002,"15min":1.3500000000000001},"min":{"1min":0.25800000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":16.805,"5min":16.805,"15min":16.805},"last":1.6020000000000001},{"interface":"front","average":{"1min":1.073,"5min":1.3939999999999999,"15min":1.151},"min":{"1min":0.38800000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":5.1239999999999997,"5min":11.823,"15min":11.823},"last":1.0109999999999999}]},{"osd":5,"last update":"Fri Oct 8 19:32:00 2021","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.298,"15min":1.056},"min":{"1min":0.36599999999999999,"5min":0.27600000000000002,"15min":0.24099999999999999},"max":{"1min":8.6530000000000005,"5min":8.6530000000000005,"15min":15.56},"last":0.32100000000000001},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.605,"15min":1.306},"min":{"1min":0.40799999999999997,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":5.5,"5min":11.619999999999999,"15min":15.484999999999999},"last":3.423}]},{"osd":6,"last update":"Fri Oct 8 19:31:17 2021","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.732,"15min":1.208},"min":{"1min":0.36599999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":5.6280000000000001,"5min":11.869,"15min":11.869},"last":2.8679999999999999},{"interface":"front","average":{"1min":1.931,"5min":1.4710000000000001,"15min":1.1499999999999999},"min":{"1min":0.32000000000000001,"5min":0.29899999999999999,"15min":0.27500000000000002},"max":{"1min":8.609,"5min":8.609,"15min":10.519},"last":3.0499999999999998}]},{"osd":7,"last update":"Fri Oct 8 19:31:31 2021","interfaces":[{"interface":"back","average":{"1min":2.3479999999999999,"5min":2.0840000000000001,"15min":1.359},"min":{"1min":0.45100000000000001,"5min":0.38300000000000001,"15min":0.35399999999999998},"max":{"1min":7.4470000000000001,"5min":11.669,"15min":11.669},"last":3.3879999999999999},{"interface":"front","average":{"1min":1.4490000000000001,"5min":1.746,"15min":1.3799999999999999},"min":{"1min":0.41599999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":5.657,"5min":11.898999999999999,"15min":11.898999999999999},"last":4.7199999999999998}]}]},{"osd":2,"up_from":18,"seq":77309411479,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":675508,"kb_used_data":495660,"kb_used_omap":0,"kb_used_meta":179840,"kb_avail":93069644,"statfs":{"total":95995035648,"available":95303315456,"internally_reserved":0,"allocated":507555840,"data_stored":506829460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":184156160},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:32:04 2021","interfaces":[{"interface":"back","average":{"1min":2.004,"5min":2.54,"15min":2.008},"min":{"1min":0.215,"5min":0.20699999999999999,"15min":0.17699999999999999},"max":{"1min":17.491,"5min":60.990000000000002,"15min":61.670999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":1.6970000000000001,"5min":2.4460000000000002,"15min":1.972},"min":{"1min":0.216,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":5.6349999999999998,"5min":60.850999999999999,"15min":65.284999999999997},"last":0.26000000000000001}]},{"osd":1,"last update":"Fri Oct 8 19:32:04 2021","interfaces":[{"interface":"back","average":{"1min":2.0609999999999999,"5min":2.5569999999999999,"15min":1.776},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.192},"max":{"1min":22.245999999999999,"5min":60.960000000000001,"15min":60.960000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":1.96,"5min":2.3900000000000001,"15min":1.956},"min":{"1min":0.307,"5min":0.25600000000000001,"15min":0.21299999999999999},"max":{"1min":5.657,"5min":60.878999999999998,"15min":60.878999999999998},"last":3.1560000000000001}]},{"osd":3,"last update":"Fri Oct 8 19:31:12 2021","interfaces":[{"interface":"back","average":{"1min":2.286,"5min":2.5670000000000002,"15min":1.8320000000000001},"min":{"1min":0.224,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":5.2469999999999999,"5min":17.734000000000002,"15min":65.322999999999993},"last":0.44},{"interface":"front","average":{"1min":3.085,"5min":2.8100000000000001,"15min":1.845},"min":{"1min":0.23599999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":11.613,"5min":24.809999999999999,"15min":61.143000000000001},"last":1.3340000000000001}]},{"osd":4,"last update":"Fri Oct 8 19:31:33 2021","interfaces":[{"interface":"back","average":{"1min":1.7110000000000001,"5min":1.9410000000000001,"15min":1.2829999999999999},"min":{"1min":0.34200000000000003,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":5.0149999999999997,"5min":24.657,"15min":24.657},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.917,"5min":1.7310000000000001,"15min":1.3089999999999999},"min":{"1min":0.28299999999999997,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":5.6100000000000003,"5min":10.609999999999999,"15min":15.143000000000001},"last":0.497}]},{"osd":5,"last update":"Fri Oct 8 19:32:04 2021","interfaces":[{"interface":"back","average":{"1min":1.47,"5min":1.3959999999999999,"15min":1.2729999999999999},"min":{"1min":0.315,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":5.5750000000000002,"5min":8.6240000000000006,"15min":15.087999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":1.3200000000000001,"5min":2.0030000000000001,"15min":1.3460000000000001},"min":{"1min":0.32000000000000001,"5min":0.315,"15min":0.27600000000000002},"max":{"1min":10.862,"5min":26.094000000000001,"15min":26.094000000000001},"last":0.55200000000000005}]},{"osd":6,"last update":"Fri Oct 8 19:31:12 2021","interfaces":[{"interface":"back","average":{"1min":1.9419999999999999,"5min":1.8759999999999999,"15min":1.26},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":7.7779999999999996,"5min":14.162000000000001,"15min":14.162000000000001},"last":0.42399999999999999},{"interface":"front","average":{"1min":1.847,"5min":1.774,"15min":1.268},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":10.92,"5min":16.68,"15min":16.68},"last":0.53600000000000003}]},{"osd":7,"last update":"Fri Oct 8 19:31:33 2021","interfaces":[{"interface":"back","average":{"1min":1.665,"5min":1.8640000000000001,"15min":1.3300000000000001},"min":{"1min":0.35399999999999998,"5min":0.32700000000000001,"15min":0.31900000000000001},"max":{"1min":5.3159999999999998,"5min":14.185,"15min":14.185},"last":0.46100000000000002},{"interface":"front","average":{"1min":1.756,"5min":1.901,"15min":1.304},"min":{"1min":0.39600000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":10.898,"5min":16.702999999999999,"15min":16.702999999999999},"last":0.94599999999999995}]}]},{"osd":3,"up_from":24,"seq":103079215253,"num_pgs":75,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1545948,"kb_used_data":1322772,"kb_used_omap":0,"kb_used_meta":223168,"kb_avail":92199204,"statfs":{"total":95995035648,"available":94411984896,"internally_reserved":0,"allocated":1354518528,"data_stored":1353752308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":228524032},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:31:24 2021","interfaces":[{"interface":"back","average":{"1min":3.8450000000000002,"5min":2.5289999999999999,"15min":1.899},"min":{"1min":0.22600000000000001,"5min":0.17100000000000001,"15min":0.17000000000000001},"max":{"1min":9.5830000000000002,"5min":17.553999999999998,"15min":109.601},"last":1.29},{"interface":"front","average":{"1min":3.7080000000000002,"5min":2.4950000000000001,"15min":2.0129999999999999},"min":{"1min":0.30399999999999999,"5min":0.223,"15min":0.19800000000000001},"max":{"1min":12.696999999999999,"5min":12.696999999999999,"15min":107.84},"last":2.3290000000000002}]},{"osd":1,"last update":"Fri Oct 8 19:31:24 2021","interfaces":[{"interface":"back","average":{"1min":2.839,"5min":2.2309999999999999,"15min":1.476},"min":{"1min":0.24299999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":12.651999999999999,"5min":20.335999999999999,"15min":20.335999999999999},"last":5.7060000000000004},{"interface":"front","average":{"1min":1.726,"5min":2.3199999999999998,"15min":1.4730000000000001},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":5.9539999999999997,"5min":13.912000000000001,"15min":13.912000000000001},"last":8.1590000000000007}]},{"osd":2,"last update":"Fri Oct 8 19:31:24 2021","interfaces":[{"interface":"back","average":{"1min":2.3119999999999998,"5min":2.6880000000000002,"15min":1.661},"min":{"1min":0.251,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":7.6890000000000001,"5min":32.277000000000001,"15min":32.277000000000001},"last":1.1419999999999999},{"interface":"front","average":{"1min":3.0179999999999998,"5min":2.0790000000000002,"15min":1.403},"min":{"1min":0.28899999999999998,"5min":0.27800000000000002,"15min":0.22700000000000001},"max":{"1min":7.8529999999999998,"5min":8.9290000000000003,"15min":14.898999999999999},"last":7.9249999999999998}]},{"osd":4,"last update":"Fri Oct 8 19:31:35 2021","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.4390000000000001,"15min":1.2190000000000001},"min":{"1min":0.35799999999999998,"5min":0.26600000000000001,"15min":0.25600000000000001},"max":{"1min":4.0540000000000003,"5min":7.9349999999999996,"15min":18.064},"last":0.373},{"interface":"front","average":{"1min":1.7609999999999999,"5min":2.2490000000000001,"15min":1.4810000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":10.632,"5min":18.692,"15min":18.692},"last":1.204}]},{"osd":5,"last update":"Fri Oct 8 19:31:56 2021","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.5209999999999999,"15min":1.232},"min":{"1min":0.39500000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":2.9380000000000002,"5min":8.5660000000000007,"15min":13.186},"last":1.036},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.5509999999999999,"15min":1.2889999999999999},"min":{"1min":0.34100000000000003,"5min":0.32400000000000001,"15min":0.28100000000000003},"max":{"1min":7.1200000000000001,"5min":7.7919999999999998,"15min":10.285},"last":0.40200000000000002}]},{"osd":6,"last update":"Fri Oct 8 19:31:12 2021","interfaces":[{"interface":"back","average":{"1min":2.9780000000000002,"5min":2.105,"15min":1.883},"min":{"1min":0.29999999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":10.606999999999999,"5min":17.512,"15min":21.538},"last":1.2370000000000001},{"interface":"front","average":{"1min":2,"5min":1.889,"15min":1.2869999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":5.3680000000000003,"5min":13.067,"15min":13.298},"last":1.0900000000000001}]},{"osd":7,"last update":"Fri Oct 8 19:31:35 2021","interfaces":[{"interface":"back","average":{"1min":1.829,"5min":1.9590000000000001,"15min":1.3100000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":10.656000000000001,"5min":10.696999999999999,"15min":10.696999999999999},"last":1.179},{"interface":"front","average":{"1min":1.153,"5min":1.7529999999999999,"15min":1.28},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":4.181,"5min":8.6099999999999994,"15min":13.225},"last":1.1160000000000001}]}]},{"osd":4,"up_from":30,"seq":128849019023,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":700116,"kb_used_data":556300,"kb_used_omap":0,"kb_used_meta":143808,"kb_avail":93045036,"statfs":{"total":95995035648,"available":95278116864,"internally_reserved":0,"allocated":569651200,"data_stored":568893151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":147259392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:31:37 2021","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":2.383,"15min":1.5549999999999999},"min":{"1min":0.22,"5min":0.185,"15min":0.185},"max":{"1min":3.347,"5min":82.109999999999999,"15min":82.109999999999999},"last":3.8759999999999999},{"interface":"front","average":{"1min":0.879,"5min":2.323,"15min":1.51},"min":{"1min":0.25900000000000001,"5min":0.23000000000000001,"15min":0.20399999999999999},"max":{"1min":2.444,"5min":82.025999999999996,"15min":82.025999999999996},"last":2.5539999999999998}]},{"osd":1,"last update":"Fri Oct 8 19:31:37 2021","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.877,"15min":1.2709999999999999},"min":{"1min":0.26100000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":4.9009999999999998,"5min":41.033000000000001,"15min":41.033000000000001},"last":3.98},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.7170000000000001,"15min":1.0780000000000001},"min":{"1min":0.35399999999999998,"5min":0.251,"15min":0.24099999999999999},"max":{"1min":2.8079999999999998,"5min":41.396999999999998,"15min":41.396999999999998},"last":2.3740000000000001}]},{"osd":2,"last update":"Fri Oct 8 19:31:37 2021","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.597,"15min":1.1180000000000001},"min":{"1min":0.29799999999999999,"5min":0.26800000000000002,"15min":0.23499999999999999},"max":{"1min":7.2080000000000002,"5min":21.257000000000001,"15min":21.257000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.637,"15min":1.1459999999999999},"min":{"1min":0.38700000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":4.8719999999999999,"5min":21.600000000000001,"15min":21.600000000000001},"last":0.83899999999999997}]},{"osd":3,"last update":"Fri Oct 8 19:31:37 2021","interfaces":[{"interface":"back","average":{"1min":1.694,"5min":2.448,"15min":1.736},"min":{"1min":0.36499999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":6.2300000000000004,"5min":40.026000000000003,"15min":58.506999999999998},"last":2.3599999999999999},{"interface":"front","average":{"1min":1.8460000000000001,"5min":2.1560000000000001,"15min":1.4730000000000001},"min":{"1min":0.33100000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":7.016,"5min":41.316000000000003,"15min":58.521000000000001},"last":2.198}]},{"osd":5,"last update":"Fri Oct 8 19:32:01 2021","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.76600000000000001,"15min":0.57899999999999996},"min":{"1min":0.30199999999999999,"5min":0.247,"15min":0.222},"max":{"1min":7.101,"5min":7.101,"15min":7.101},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.76200000000000001,"15min":0.56299999999999994},"min":{"1min":0.32600000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.73899999999999999,"5min":8.1319999999999997,"15min":8.1319999999999997},"last":0.32500000000000001}]},{"osd":6,"last update":"Fri Oct 8 19:31:16 2021","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.80800000000000005,"15min":0.61399999999999999},"min":{"1min":0.318,"5min":0.26400000000000001,"15min":0.23599999999999999},"max":{"1min":2.306,"5min":6.7300000000000004,"15min":6.7300000000000004},"last":0.42499999999999999},{"interface":"front","average":{"1min":1.0509999999999999,"5min":0.91000000000000003,"15min":0.63300000000000001},"min":{"1min":0.307,"5min":0.247,"15min":0.247},"max":{"1min":7.0720000000000001,"5min":7.0720000000000001,"15min":7.0720000000000001},"last":0.48599999999999999}]},{"osd":7,"last update":"Fri Oct 8 19:31:37 2021","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.77700000000000002,"15min":0.60299999999999998},"min":{"1min":0.34100000000000003,"5min":0.29099999999999998,"15min":0.26400000000000001},"max":{"1min":2.1070000000000002,"5min":5.6719999999999997,"15min":5.6719999999999997},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.86699999999999999,"15min":0.69799999999999995},"min":{"1min":0.41599999999999998,"5min":0.30499999999999999,"15min":0.29699999999999999},"max":{"1min":2.0659999999999998,"5min":6.3959999999999999,"15min":6.3959999999999999},"last":0.46200000000000002}]}]},{"osd":5,"up_from":38,"seq":163208757387,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1637508,"kb_used_data":1455356,"kb_used_omap":0,"kb_used_meta":182144,"kb_avail":92107644,"statfs":{"total":95995035648,"available":94318227456,"internally_reserved":0,"allocated":1490284544,"data_stored":1489543247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":186515456},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:31:55 2021","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.3720000000000001,"15min":1.05},"min":{"1min":0.24299999999999999,"5min":0.222,"15min":0.20599999999999999},"max":{"1min":7.968,"5min":24.597000000000001,"15min":24.597000000000001},"last":0.372},{"interface":"front","average":{"1min":1.155,"5min":1.5269999999999999,"15min":1.0109999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":3.4279999999999999,"5min":24.510999999999999,"15min":24.510999999999999},"last":0.248}]},{"osd":1,"last update":"Fri Oct 8 19:31:55 2021","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":1.8440000000000001,"15min":1.157},"min":{"1min":0.28299999999999997,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":3.456,"5min":25.545000000000002,"15min":25.545000000000002},"last":1.8919999999999999},{"interface":"front","average":{"1min":0.96099999999999997,"5min":1.7110000000000001,"15min":1.129},"min":{"1min":0.27200000000000002,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":2.238,"5min":25.556000000000001,"15min":25.556000000000001},"last":3.238}]},{"osd":2,"last update":"Fri Oct 8 19:31:55 2021","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":1.504,"15min":1.2989999999999999},"min":{"1min":0.27000000000000002,"5min":0.25800000000000001,"15min":0.25700000000000001},"max":{"1min":2.2480000000000002,"5min":16.632999999999999,"15min":29.398},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.90100000000000002,"5min":1.393,"15min":1.3120000000000001},"min":{"1min":0.33400000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":2.6869999999999998,"5min":12.565,"15min":29.387},"last":0.82899999999999996}]},{"osd":3,"last update":"Fri Oct 8 19:31:55 2021","interfaces":[{"interface":"back","average":{"1min":1.7789999999999999,"5min":1.7350000000000001,"15min":1.2330000000000001},"min":{"1min":0.28899999999999998,"5min":0.28499999999999998,"15min":0.26200000000000001},"max":{"1min":11.685,"5min":12.356,"15min":12.356},"last":0.317},{"interface":"front","average":{"1min":1.5249999999999999,"5min":2.1640000000000001,"15min":1.3819999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":8.9199999999999999,"5min":13.366,"15min":21.504000000000001},"last":0.44500000000000001}]},{"osd":4,"last update":"Fri Oct 8 19:31:55 2021","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.72199999999999998,"15min":0.58099999999999996},"min":{"1min":0.26100000000000001,"5min":0.254,"15min":0.224},"max":{"1min":2.6899999999999999,"5min":4.3869999999999996,"15min":5.0780000000000003},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.69299999999999995,"15min":0.58599999999999997},"min":{"1min":0.27100000000000002,"5min":0.25900000000000001,"15min":0.23799999999999999},"max":{"1min":2.7570000000000001,"5min":6.1539999999999999,"15min":6.1539999999999999},"last":0.35699999999999998}]},{"osd":6,"last update":"Fri Oct 8 19:31:11 2021","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":0.82299999999999995,"15min":0.66000000000000003},"min":{"1min":0.30399999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":5.6840000000000002,"5min":5.6840000000000002,"15min":7.266},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.78100000000000003,"15min":0.64000000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29099999999999998},"max":{"1min":6.194,"5min":6.194,"15min":6.194},"last":0.45400000000000001}]},{"osd":7,"last update":"Fri Oct 8 19:31:35 2021","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.85799999999999998,"15min":0.66500000000000004},"min":{"1min":0.35499999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":3.4820000000000002,"5min":5.6120000000000001,"15min":5.6120000000000001},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.429,"5min":0.99399999999999999,"15min":0.75900000000000001},"min":{"1min":0.35999999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":7.6749999999999998,"5min":7.6749999999999998,"15min":7.6749999999999998},"last":1.232}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":266240,"data_stored":262688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":327680,"data_stored":327680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":2338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":690946048,"data_stored":690946048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1550057472,"data_stored":1550057472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":512098304,"data_stored":512098304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1379926016,"data_stored":1379926016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":580190208,"data_stored":580190208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1520959488,"data_stored":1520959488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":508231680,"data_stored":508231680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1514143744,"data_stored":1514143744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-10-08T19:32:14.036 INFO:tasks.cephadm.ceph_manager.ceph:recovered! 2021-10-08T19:32:14.036 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2021-10-08T19:32:14.037 INFO:tasks.thrashosds.thrasher:Setting osd 0 primary_affinity to 1.000000 2021-10-08T19:32:14.037 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd primary-affinity 0 1 2021-10-08T19:32:14.104 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:13 smithi097 ceph-mon[32687]: 6.1f deep-scrub ok 2021-10-08T19:32:14.105 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:13 smithi097 ceph-mon[32687]: pgmap v556: 178 pgs: 178 active+clean; 2.5 GiB data, 8.9 GiB used, 706 GiB / 715 GiB avail; 639 B/s rd, 56 MiB/s wr, 890 op/s 2021-10-08T19:32:14.105 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:13 smithi097 ceph-mon[32687]: from='client.25510 v1:172.21.15.97:0/3953175555' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:32:14.105 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:13 smithi097 ceph-mon[32687]: 3.a scrub ok 2021-10-08T19:32:14.106 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:13 smithi097 ceph-mon[41966]: 6.1f deep-scrub ok 2021-10-08T19:32:14.106 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:13 smithi097 ceph-mon[41966]: pgmap v556: 178 pgs: 178 active+clean; 2.5 GiB data, 8.9 GiB used, 706 GiB / 715 GiB avail; 639 B/s rd, 56 MiB/s wr, 890 op/s 2021-10-08T19:32:14.107 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:13 smithi097 ceph-mon[41966]: from='client.25510 v1:172.21.15.97:0/3953175555' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:32:14.107 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:13 smithi097 ceph-mon[41966]: 3.a scrub ok 2021-10-08T19:32:14.107 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:32:14.117 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:14.118 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:32:14.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:13 smithi117 ceph-mon[34585]: 6.1f deep-scrub ok 2021-10-08T19:32:14.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:13 smithi117 ceph-mon[34585]: pgmap v556: 178 pgs: 178 active+clean; 2.5 GiB data, 8.9 GiB used, 706 GiB / 715 GiB avail; 639 B/s rd, 56 MiB/s wr, 890 op/s 2021-10-08T19:32:14.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:13 smithi117 ceph-mon[34585]: from='client.25510 v1:172.21.15.97:0/3953175555' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:32:14.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:13 smithi117 ceph-mon[34585]: 3.a scrub ok 2021-10-08T19:32:14.158 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:32:13 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:32:13] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:32:14.220 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:32:14.261 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:32:14.262 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2021-10-08T19:32:14.262 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:14.262 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.25465.0:49531 9.6 9:693d2606:::benchmark_data_smithi097_196985_object49530:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e311)", 2021-10-08T19:32:14.262 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:32:14.253379+0000", 2021-10-08T19:32:14.262 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.0071523619999999998, 2021-10-08T19:32:14.263 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0071780949999999998, 2021-10-08T19:32:14.263 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:32:14.263 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "waiting for sub ops", 2021-10-08T19:32:14.263 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:32:14.264 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.25465", 2021-10-08T19:32:14.264 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:32:14.264 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 49531 2021-10-08T19:32:14.264 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:14.264 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:32:14.265 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:14.265 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:32:14.265 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:14.253379+0000", 2021-10-08T19:32:14.265 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:14.265 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:14.266 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:14.266 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:32:14.266 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:14.253379+0000", 2021-10-08T19:32:14.266 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:14.266 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:14.267 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:14.267 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:32:14.267 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:14.253377+0000", 2021-10-08T19:32:14.267 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:32:14.268 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:14.268 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:14.268 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:32:14.268 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:14.253536+0000", 2021-10-08T19:32:14.268 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015827899999999999 2021-10-08T19:32:14.269 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:14.269 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:14.269 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:32:14.270 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:14.253547+0000", 2021-10-08T19:32:14.270 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1601e-05 2021-10-08T19:32:14.271 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:14.271 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:14.271 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:32:14.271 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:14.253554+0000", 2021-10-08T19:32:14.272 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1319999999999996e-06 2021-10-08T19:32:14.272 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:14.272 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:14.273 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:14.273 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:14.253602+0000", 2021-10-08T19:32:14.273 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7386000000000003e-05 2021-10-08T19:32:14.273 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:14.274 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:14.274 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:32:14.274 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:14.253842+0000", 2021-10-08T19:32:14.274 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00024041399999999999 2021-10-08T19:32:14.274 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:14.275 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:14.275 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 1,2", 2021-10-08T19:32:14.275 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:14.253974+0000", 2021-10-08T19:32:14.275 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013187 2021-10-08T19:32:14.276 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:14.276 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:14.276 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:32:14.276 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:14.256732+0000", 2021-10-08T19:32:14.276 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027584049999999998 2021-10-08T19:32:14.277 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:14.277 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:14.277 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:14.277 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:14.258265+0000", 2021-10-08T19:32:14.277 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001532989 2021-10-08T19:32:14.278 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:14.278 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:32:14.278 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:14.278 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:14.279 INFO:teuthology.orchestra.run.smithi117.stdout: ], 2021-10-08T19:32:14.279 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 1 2021-10-08T19:32:14.279 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:32:14.279 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:14.320 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:32:14.322 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:14.323 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:32:14.424 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:32:14.481 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:14.572 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:32:14.576 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:14.577 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:32:14.678 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:32:14.711 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:32:14.718 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:14.841 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 31 16 50269 50253 101.265 80.5625 0.00630919 0.00986931 2021-10-08T19:32:14.843 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:14 smithi097 ceph-mon[32687]: 2.1b deep-scrub ok 2021-10-08T19:32:14.846 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:14 smithi097 ceph-mon[41966]: 2.1b deep-scrub ok 2021-10-08T19:32:15.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:14 smithi117 ceph-mon[34585]: 2.1b deep-scrub ok 2021-10-08T19:32:15.262 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:32:15.263 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:15.264 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:32:15.365 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:32:15.403 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2021-10-08T19:32:15.414 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:15.702 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:32:15.704 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:15.705 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:32:15.807 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:32:15.841 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 32 16 51460 51444 100.427 74.4375 0.0278444 0.00995125 2021-10-08T19:32:15.849 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:15.851 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:15 smithi117 ceph-mon[34585]: 2.1f scrub ok 2021-10-08T19:32:15.852 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:15 smithi117 ceph-mon[34585]: 1.5 deep-scrub ok 2021-10-08T19:32:15.852 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:15 smithi117 ceph-mon[34585]: pgmap v557: 178 pgs: 178 active+clean; 3.0 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 1.2 KiB/s rd, 112 MiB/s wr, 1.79k op/s 2021-10-08T19:32:15.852 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:15 smithi117 ceph-mon[34585]: 1.7 scrub ok 2021-10-08T19:32:15.931 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:32:15.934 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:15.935 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:32:15.964 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2021-10-08T19:32:15.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:15 smithi097 ceph-mon[32687]: 2.1f scrub ok 2021-10-08T19:32:15.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:15 smithi097 ceph-mon[32687]: 1.5 deep-scrub ok 2021-10-08T19:32:15.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:15 smithi097 ceph-mon[32687]: pgmap v557: 178 pgs: 178 active+clean; 3.0 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 1.2 KiB/s rd, 112 MiB/s wr, 1.79k op/s 2021-10-08T19:32:15.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:15 smithi097 ceph-mon[32687]: 1.7 scrub ok 2021-10-08T19:32:15.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:15 smithi097 ceph-mon[41966]: 2.1f scrub ok 2021-10-08T19:32:15.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:15 smithi097 ceph-mon[41966]: 1.5 deep-scrub ok 2021-10-08T19:32:15.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:15 smithi097 ceph-mon[41966]: pgmap v557: 178 pgs: 178 active+clean; 3.0 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 1.2 KiB/s rd, 112 MiB/s wr, 1.79k op/s 2021-10-08T19:32:15.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:15 smithi097 ceph-mon[41966]: 1.7 scrub ok 2021-10-08T19:32:16.010 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:32:16.036 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:32:16.115 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:16.260 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:32:16.270 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:16.271 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:32:16.372 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:32:16.419 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:16.715 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:32:16.719 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:16.720 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:32:16.822 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:32:16.842 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 33 16 52632 52616 99.6037 73.25 0.0118857 0.0100349 2021-10-08T19:32:16.865 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:16.895 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is set 2021-10-08T19:32:16.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:16 smithi097 ceph-mon[41966]: 6.3 scrub ok 2021-10-08T19:32:16.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:16 smithi097 ceph-mon[41966]: 2.10 scrub ok 2021-10-08T19:32:16.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:16 smithi097 ceph-mon[41966]: 6.11 scrub ok 2021-10-08T19:32:16.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:16 smithi097 ceph-mon[41966]: 6.7 deep-scrub ok 2021-10-08T19:32:16.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:16 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2574097316' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:32:16.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:16 smithi097 ceph-mon[41966]: from='client.25513 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:32:16.974 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:16 smithi097 ceph-mon[32687]: 6.3 scrub ok 2021-10-08T19:32:16.974 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:16 smithi097 ceph-mon[32687]: 2.10 scrub ok 2021-10-08T19:32:16.975 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:16 smithi097 ceph-mon[32687]: 6.11 scrub ok 2021-10-08T19:32:16.976 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:16 smithi097 ceph-mon[32687]: 6.7 deep-scrub ok 2021-10-08T19:32:16.976 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:16 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2574097316' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:32:16.976 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:16 smithi097 ceph-mon[32687]: from='client.25513 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:32:17.106 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:32:17.109 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:17.110 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:32:17.111 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:32:16 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:32:17.111 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:16 smithi117 ceph-mon[34585]: 6.3 scrub ok 2021-10-08T19:32:17.111 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:16 smithi117 ceph-mon[34585]: 2.10 scrub ok 2021-10-08T19:32:17.112 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:16 smithi117 ceph-mon[34585]: 6.11 scrub ok 2021-10-08T19:32:17.112 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:16 smithi117 ceph-mon[34585]: 6.7 deep-scrub ok 2021-10-08T19:32:17.112 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:16 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2574097316' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:32:17.113 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:16 smithi117 ceph-mon[34585]: from='client.25513 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:32:17.211 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:32:17.289 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:17.383 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:32:17.387 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:17.388 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:32:17.490 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:32:17.527 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:17.841 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 34 16 53931 53915 99.062 81.1875 0.00757592 0.0100898 2021-10-08T19:32:17.869 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:17 smithi097 ceph-mon[32687]: pgmap v558: 178 pgs: 178 active+clean; 3.0 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 639 B/s rd, 88 MiB/s wr, 1.41k op/s 2021-10-08T19:32:17.869 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:17 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:32:17.870 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:17 smithi097 ceph-mon[32687]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:32:17.870 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:17 smithi097 ceph-mon[32687]: from='client.25513 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:32:17.870 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:17 smithi097 ceph-mon[32687]: osdmap e312: 8 total, 8 up, 8 in 2021-10-08T19:32:18.077 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:32:18.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:17 smithi117 ceph-mon[34585]: pgmap v558: 178 pgs: 178 active+clean; 3.0 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 639 B/s rd, 88 MiB/s wr, 1.41k op/s 2021-10-08T19:32:18.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:17 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:32:18.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:17 smithi117 ceph-mon[34585]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:32:18.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:17 smithi117 ceph-mon[34585]: from='client.25513 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:32:18.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:17 smithi117 ceph-mon[34585]: osdmap e312: 8 total, 8 up, 8 in 2021-10-08T19:32:18.167 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:17 smithi097 ceph-mon[41966]: pgmap v558: 178 pgs: 178 active+clean; 3.0 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 639 B/s rd, 88 MiB/s wr, 1.41k op/s 2021-10-08T19:32:18.168 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:17 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:32:18.168 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:17 smithi097 ceph-mon[41966]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:32:18.168 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:17 smithi097 ceph-mon[41966]: from='client.25513 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:32:18.169 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:17 smithi097 ceph-mon[41966]: osdmap e312: 8 total, 8 up, 8 in 2021-10-08T19:32:18.197 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:32:18.207 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:18.208 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:32:18.309 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:32:18.361 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:18.454 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:32:18.457 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:18.457 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:32:18.558 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:32:18.619 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:18.813 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:32:18.823 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:18.825 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:32:18.841 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 35 16 55204 55188 98.5049 79.5625 0.0164066 0.010146 2021-10-08T19:32:18.926 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:32:18.981 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:19.093 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:32:19.098 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:19.099 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:32:19.201 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:32:19.258 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:19.363 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:32:19.366 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:19.367 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:32:19.469 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:32:19.513 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:19.841 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 36 16 56578 56562 98.154 85.875 0.00475817 0.0101823 2021-10-08T19:32:19.890 INFO:teuthology.orchestra.run.smithi097.stderr:set osd.0 primary-affinity to 1 (8655362) 2021-10-08T19:32:19.975 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:32:19.978 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:19.979 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:32:20.080 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:32:20.121 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:20.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:19 smithi117 ceph-mon[34585]: pgmap v560: 178 pgs: 178 active+clean; 3.2 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 70 MiB/s wr, 1.12k op/s 2021-10-08T19:32:20.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:19 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1653424059' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 0, "weight": 1.0}]: dispatch 2021-10-08T19:32:20.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:19 smithi117 ceph-mon[34585]: from='client.35537 ' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 0, "weight": 1.0}]: dispatch 2021-10-08T19:32:20.171 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set nodeep-scrub 2021-10-08T19:32:20.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:19 smithi097 ceph-mon[32687]: pgmap v560: 178 pgs: 178 active+clean; 3.2 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 70 MiB/s wr, 1.12k op/s 2021-10-08T19:32:20.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:19 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1653424059' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 0, "weight": 1.0}]: dispatch 2021-10-08T19:32:20.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:19 smithi097 ceph-mon[32687]: from='client.35537 ' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 0, "weight": 1.0}]: dispatch 2021-10-08T19:32:20.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:19 smithi097 ceph-mon[41966]: pgmap v560: 178 pgs: 178 active+clean; 3.2 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 70 MiB/s wr, 1.12k op/s 2021-10-08T19:32:20.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:19 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1653424059' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 0, "weight": 1.0}]: dispatch 2021-10-08T19:32:20.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:19 smithi097 ceph-mon[41966]: from='client.35537 ' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 0, "weight": 1.0}]: dispatch 2021-10-08T19:32:20.646 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:32:20.646 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2021-10-08T19:32:20.647 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2021-10-08T19:32:20.647 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2021-10-08T19:32:20.647 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:32:20.841 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 37 16 57829 57813 97.6144 78.1875 0.0128518 0.0102391 2021-10-08T19:32:20.942 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:32:20.951 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:20.952 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:32:21.054 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:32:21.092 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:32:21.110 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:20 smithi117 ceph-mon[34585]: from='client.35537 ' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 0, "weight": 1.0}]': finished 2021-10-08T19:32:21.110 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:20 smithi117 ceph-mon[34585]: osdmap e313: 8 total, 8 up, 8 in 2021-10-08T19:32:21.119 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:21.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:20 smithi097 ceph-mon[32687]: from='client.35537 ' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 0, "weight": 1.0}]': finished 2021-10-08T19:32:21.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:20 smithi097 ceph-mon[32687]: osdmap e313: 8 total, 8 up, 8 in 2021-10-08T19:32:21.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:20 smithi097 ceph-mon[41966]: from='client.35537 ' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 0, "weight": 1.0}]': finished 2021-10-08T19:32:21.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:20 smithi097 ceph-mon[41966]: osdmap e313: 8 total, 8 up, 8 in 2021-10-08T19:32:21.255 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:32:21.282 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:32:21.317 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:32:21.353 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:32:21.394 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:32:21.438 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:32:21.480 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:32:21.514 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:32:21.521 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'false' 2021-10-08T19:32:21.522 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'false' 2021-10-08T19:32:21.522 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'false' 2021-10-08T19:32:21.523 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'false' 2021-10-08T19:32:21.523 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'false' 2021-10-08T19:32:21.523 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'false' 2021-10-08T19:32:21.523 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'false' 2021-10-08T19:32:21.523 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'false' 2021-10-08T19:32:21.708 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:32:21.711 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:21.712 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:32:21.813 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:32:21.841 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 38 16 59052 59036 97.0571 76.4375 0.0095542 0.0102975 2021-10-08T19:32:21.843 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2021-10-08T19:32:21.858 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:22.082 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:32:22.086 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:21 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:32:22.086 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:21 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:32:22.087 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:21 smithi117 ceph-mon[34585]: pgmap v562: 178 pgs: 178 active+clean; 3.4 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 105 MiB/s wr, 1.68k op/s 2021-10-08T19:32:22.087 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:21 smithi117 ceph-mon[34585]: osdmap e314: 8 total, 8 up, 8 in 2021-10-08T19:32:22.087 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:21 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2118433844' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:32:22.088 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:22.089 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:32:22.190 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:32:22.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:21 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:32:22.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:21 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:32:22.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:21 smithi097 ceph-mon[32687]: pgmap v562: 178 pgs: 178 active+clean; 3.4 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 105 MiB/s wr, 1.68k op/s 2021-10-08T19:32:22.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:21 smithi097 ceph-mon[32687]: osdmap e314: 8 total, 8 up, 8 in 2021-10-08T19:32:22.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:21 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2118433844' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:32:22.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:21 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:32:22.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:21 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:32:22.225 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:21 smithi097 ceph-mon[41966]: pgmap v562: 178 pgs: 178 active+clean; 3.4 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 105 MiB/s wr, 1.68k op/s 2021-10-08T19:32:22.225 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:21 smithi097 ceph-mon[41966]: osdmap e314: 8 total, 8 up, 8 in 2021-10-08T19:32:22.225 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:21 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2118433844' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:32:22.241 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:22.476 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:32:22.479 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:22.479 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:32:22.512 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:32:22.582 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:32:22.613 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:22.841 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 39 16 60263 60247 96.5092 75.6875 0.00859034 0.0103559 2021-10-08T19:32:22.970 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:32:22 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:32:22] "GET /metrics HTTP/1.1" 200 155764 "" "Prometheus/2.18.1" 2021-10-08T19:32:23.071 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:32:23.076 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:23.078 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:32:23.179 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:32:23.221 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:23.300 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:32:23.304 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:23.304 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:32:23.405 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:32:23.454 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:23.607 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:32:23.612 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:23.613 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:32:23.714 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:32:23.768 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:23.842 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:2021-10-08T19:32:23.841453+0000 min lat: 0.00118067 max lat: 3.10418 avg lat: 0.0104253 2021-10-08T19:32:23.842 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2021-10-08T19:32:23.842 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 40 16 61400 61384 95.8731 71.0625 0.00610146 0.0104253 2021-10-08T19:32:23.849 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:32:23.853 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:23.854 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:32:23.870 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:32:23 smithi117 conmon[69189]: level=error ts=2021-10-08T19:32:23.505Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=2 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:32:23.871 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:32:23 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:32:23] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:32:23.956 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:32:24.008 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:24.083 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:32:24.092 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:24.093 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:32:24.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:23 smithi117 ceph-mon[34585]: pgmap v564: 178 pgs: 178 active+clean; 3.4 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 65 MiB/s wr, 1.03k op/s 2021-10-08T19:32:24.195 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:32:24.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:23 smithi097 ceph-mon[32687]: pgmap v564: 178 pgs: 178 active+clean; 3.4 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 65 MiB/s wr, 1.03k op/s 2021-10-08T19:32:24.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:23 smithi097 ceph-mon[41966]: pgmap v564: 178 pgs: 178 active+clean; 3.4 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 65 MiB/s wr, 1.03k op/s 2021-10-08T19:32:24.263 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:24.706 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:32:24.712 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:24.713 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:32:24.814 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:32:24.842 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 41 16 62707 62691 95.527 81.6875 0.0170014 0.0104634 2021-10-08T19:32:24.868 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:24.942 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is set 2021-10-08T19:32:25.019 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:24 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3412892199' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:32:25.019 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:24 smithi117 ceph-mon[34585]: from='client.25528 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:32:25.056 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:32:25.059 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:25.060 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:32:25.110 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2021-10-08T19:32:25.161 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:32:25.206 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:25.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:24 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3412892199' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:32:25.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:24 smithi097 ceph-mon[32687]: from='client.25528 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:32:25.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:24 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3412892199' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:32:25.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:24 smithi097 ceph-mon[41966]: from='client.25528 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:32:25.348 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:32:25.356 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:25.357 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:32:25.427 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2021-10-08T19:32:25.427 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:32:25.458 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:32:25.509 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:25.842 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 42 16 63934 63918 95.0784 76.6875 0.0110284 0.0105127 2021-10-08T19:32:25.933 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:25 smithi097 ceph-mon[32687]: pgmap v565: 178 pgs: 178 active+clean; 3.7 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 99 MiB/s wr, 1.58k op/s 2021-10-08T19:32:25.934 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:25 smithi097 ceph-mon[32687]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:32:25.934 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:25 smithi097 ceph-mon[32687]: from='client.25528 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:32:25.934 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:25 smithi097 ceph-mon[32687]: osdmap e315: 8 total, 8 up, 8 in 2021-10-08T19:32:25.954 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 4, 5, 7, 6, 1, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2021-10-08T19:32:25.954 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2021-10-08T19:32:25.955 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2021-10-08T19:32:25.955 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd test-reweight-by-utilization 110 0.05 2021-10-08T19:32:26.128 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:32:26.135 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:26.136 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:32:26.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:25 smithi097 ceph-mon[41966]: pgmap v565: 178 pgs: 178 active+clean; 3.7 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 99 MiB/s wr, 1.58k op/s 2021-10-08T19:32:26.225 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:25 smithi097 ceph-mon[41966]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:32:26.225 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:25 smithi097 ceph-mon[41966]: from='client.25528 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:32:26.225 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:25 smithi097 ceph-mon[41966]: osdmap e315: 8 total, 8 up, 8 in 2021-10-08T19:32:26.237 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:32:26.263 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:32:26.313 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:26.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:25 smithi117 ceph-mon[34585]: pgmap v565: 178 pgs: 178 active+clean; 3.7 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 99 MiB/s wr, 1.58k op/s 2021-10-08T19:32:26.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:25 smithi117 ceph-mon[34585]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:32:26.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:25 smithi117 ceph-mon[34585]: from='client.25528 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:32:26.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:25 smithi117 ceph-mon[34585]: osdmap e315: 8 total, 8 up, 8 in 2021-10-08T19:32:26.408 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:32:26.416 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:26.417 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:32:26.488 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:32:26.518 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:32:26.571 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:26.696 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:32:26.701 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:26.702 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:32:26.744 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2021-10-08T19:32:26.802 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:32:26.842 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 43 16 65060 65044 94.504 70.375 0.0233944 0.0105766 2021-10-08T19:32:26.843 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:27.059 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:32:27.061 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:32:26 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:32:27.063 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:27.064 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:32:27.165 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:32:27.218 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:27.303 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:32:27.309 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:27.310 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:32:27.401 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:32:27.411 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:32:27.461 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:27.812 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:32:27.821 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:27.822 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:32:27.842 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 44 16 66169 66153 93.9315 69.3125 0.0136205 0.010641 2021-10-08T19:32:27.924 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:32:27.970 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:28.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:27 smithi117 ceph-mon[34585]: pgmap v567: 178 pgs: 178 active+clean; 3.7 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 749 B/s rd, 57 MiB/s wr, 907 op/s 2021-10-08T19:32:28.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:27 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:32:28.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:27 smithi097 ceph-mon[32687]: pgmap v567: 178 pgs: 178 active+clean; 3.7 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 749 B/s rd, 57 MiB/s wr, 907 op/s 2021-10-08T19:32:28.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:27 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:32:28.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:27 smithi097 ceph-mon[41966]: pgmap v567: 178 pgs: 178 active+clean; 3.7 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 749 B/s rd, 57 MiB/s wr, 907 op/s 2021-10-08T19:32:28.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:27 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:32:28.232 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset noscrub 2021-10-08T19:32:28.603 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:32:28.608 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:28.609 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:32:28.710 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:32:28.747 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:28.808 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:32:28.842 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 45 16 67256 67240 93.3539 67.9375 0.0071056 0.010707 2021-10-08T19:32:29.339 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:32:29.359 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:32:29.399 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:32:29.438 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:32:29.446 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:32:29.450 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:29.451 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:32:29.496 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:32:29.550 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:32:29.552 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:32:29.588 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:32:29.593 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:29.619 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:32:29.620 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true' 2021-10-08T19:32:29.620 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true' 2021-10-08T19:32:29.621 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true' 2021-10-08T19:32:29.621 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true' 2021-10-08T19:32:29.621 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true' 2021-10-08T19:32:29.622 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true' 2021-10-08T19:32:29.622 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'true' 2021-10-08T19:32:29.623 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'true' 2021-10-08T19:32:29.647 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:32:29 smithi097 conmon[33110]: 172.21.15.117 - - [08/Oct/2021:19:32:29] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:32:29.672 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:32:29.675 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:29.675 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:32:29.776 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:32:29.813 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:29.845 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 46 16 68308 68292 92.7515 65.75 0.0248206 0.010775 2021-10-08T19:32:29.882 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:32:29.887 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:29.888 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:32:29.915 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:32:29 smithi097 conmon[33110]: 2021-10-08T19:32:29.913+0000 7f26c6999700 -1 mgr.server reply reply (4) Interrupted system call no change 2021-10-08T19:32:29.916 INFO:teuthology.orchestra.run.smithi097.stdout:moved 16 / 534 (2.99625%) 2021-10-08T19:32:29.916 INFO:teuthology.orchestra.run.smithi097.stdout:avg 66.75 2021-10-08T19:32:29.916 INFO:teuthology.orchestra.run.smithi097.stdout:stddev 8.78564 -> 8.43727 (expected baseline 7.6424) 2021-10-08T19:32:29.917 INFO:teuthology.orchestra.run.smithi097.stdout:min osd.2 with 51 -> 52 pgs (0.764045 -> 0.779026 * mean) 2021-10-08T19:32:29.917 INFO:teuthology.orchestra.run.smithi097.stdout:max osd.7 with 80 -> 80 pgs (1.1985 -> 1.1985 * mean) 2021-10-08T19:32:29.917 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:32:29.917 INFO:teuthology.orchestra.run.smithi097.stdout:oload 110 2021-10-08T19:32:29.918 INFO:teuthology.orchestra.run.smithi097.stdout:max_change 0.05 2021-10-08T19:32:29.918 INFO:teuthology.orchestra.run.smithi097.stdout:max_change_osds 4 2021-10-08T19:32:29.918 INFO:teuthology.orchestra.run.smithi097.stdout:average_utilization 0.0182 2021-10-08T19:32:29.918 INFO:teuthology.orchestra.run.smithi097.stdout:overload_utilization 0.0201 2021-10-08T19:32:29.919 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5 weight 1.0000 -> 0.9500 2021-10-08T19:32:29.919 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7 weight 1.0000 -> 0.9500 2021-10-08T19:32:29.919 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1 weight 1.0000 -> 0.9500 2021-10-08T19:32:29.920 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3 weight 1.0000 -> 0.9500 2021-10-08T19:32:29.925 INFO:teuthology.orchestra.run.smithi097.stderr:no change 2021-10-08T19:32:29.988 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:32:30.038 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:30.140 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:32:30.143 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:30.144 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:32:30.145 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:29 smithi117 ceph-mon[34585]: pgmap v568: 178 pgs: 178 active+clean; 3.9 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1.2 KiB/s rd, 68 MiB/s wr, 1.09k op/s 2021-10-08T19:32:30.145 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:29 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1010869712' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:32:30.146 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:29 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:32:30.196 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:32:30.197 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2021-10-08T19:32:30.197 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2021-10-08T19:32:30.197 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:32:30.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:29 smithi097 ceph-mon[32687]: pgmap v568: 178 pgs: 178 active+clean; 3.9 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1.2 KiB/s rd, 68 MiB/s wr, 1.09k op/s 2021-10-08T19:32:30.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:29 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1010869712' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:32:30.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:29 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:32:30.225 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:29 smithi097 ceph-mon[41966]: pgmap v568: 178 pgs: 178 active+clean; 3.9 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1.2 KiB/s rd, 68 MiB/s wr, 1.09k op/s 2021-10-08T19:32:30.225 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:29 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1010869712' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:32:30.225 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:29 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:32:30.246 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:32:30.303 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:30.844 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 47 16 69384 69368 92.2076 67.25 0.00808817 0.0108399 2021-10-08T19:32:31.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:30 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:32:31.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:30 smithi097 ceph-mon[41966]: 172.21.15.117 - - [08/Oct/2021:19:32:29] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:32:31.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:30 smithi097 ceph-mon[41966]: from='client.15585 v1:172.21.15.97:0/413680127' entity='client.admin' cmd=[{"prefix": "osd test-reweight-by-utilization", "oload": 110, "max_change": 0.05, "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:32:31.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:30 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:32:31.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:30 smithi097 ceph-mon[32687]: 172.21.15.117 - - [08/Oct/2021:19:32:29] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:32:31.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:30 smithi097 ceph-mon[32687]: from='client.15585 v1:172.21.15.97:0/413680127' entity='client.admin' cmd=[{"prefix": "osd test-reweight-by-utilization", "oload": 110, "max_change": 0.05, "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:32:31.270 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2021-10-08T19:32:31.270 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:30 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:32:31.271 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:30 smithi117 ceph-mon[34585]: 172.21.15.117 - - [08/Oct/2021:19:32:29] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:32:31.271 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:30 smithi117 ceph-mon[34585]: from='client.15585 v1:172.21.15.97:0/413680127' entity='client.admin' cmd=[{"prefix": "osd test-reweight-by-utilization", "oload": 110, "max_change": 0.05, "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:32:31.714 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:32:31.844 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 48 16 70587 70571 91.853 75.1875 0.0132084 0.0108821 2021-10-08T19:32:32.096 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:32:32.102 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:32.103 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:32:32.124 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2021-10-08T19:32:32.125 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd test-reweight-by-utilization 1000 0.05 2021-10-08T19:32:32.204 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:32:32.227 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:31 smithi097 ceph-mon[32687]: pgmap v569: 178 pgs: 178 active+clean; 4.1 GiB data, 14 GiB used, 702 GiB / 715 GiB avail; 1.0 KiB/s rd, 77 MiB/s wr, 1.23k op/s 2021-10-08T19:32:32.227 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:31 smithi097 ceph-mon[41966]: pgmap v569: 178 pgs: 178 active+clean; 4.1 GiB data, 14 GiB used, 702 GiB / 715 GiB avail; 1.0 KiB/s rd, 77 MiB/s wr, 1.23k op/s 2021-10-08T19:32:32.284 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:32.317 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:31 smithi117 ceph-mon[34585]: pgmap v569: 178 pgs: 178 active+clean; 4.1 GiB data, 14 GiB used, 702 GiB / 715 GiB avail; 1.0 KiB/s rd, 77 MiB/s wr, 1.23k op/s 2021-10-08T19:32:32.511 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:32:32.515 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:32.516 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:32:32.617 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:32:32.651 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:32:32 smithi117 conmon[69189]: level=error ts=2021-10-08T19:32:32.314Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=1 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:32:32.656 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:32.729 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:32:32.732 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:32.734 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:32:32.836 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:32:32.856 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 49 16 71600 71584 91.2706 63.3125 0.00285583 0.0109478 2021-10-08T19:32:32.908 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:32.970 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:32:32 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:32:32] "GET /metrics HTTP/1.1" 200 155791 "" "Prometheus/2.18.1" 2021-10-08T19:32:32.980 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:32:32.983 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:32.984 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:32:33.089 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:32:33.138 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:33.401 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:32:33.410 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:33.411 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:32:33.455 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:32:33.511 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:32:33.583 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:33.663 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:32:33.668 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:33.669 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:32:33.770 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:32:33.824 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:33.849 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 50 15 72797 72782 90.9427 74.875 0.00961182 0.0109898 2021-10-08T19:32:33.934 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:32:33.942 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:33.943 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:32:34.019 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is unset 2021-10-08T19:32:34.044 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:32:34.084 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:34.132 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:32:34.133 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2021-10-08T19:32:34.133 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2021-10-08T19:32:34.133 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2021-10-08T19:32:34.133 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:32:34.157 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:32:33 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:32:33] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:32:34.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:34 smithi117 ceph-mon[34585]: pgmap v570: 178 pgs: 178 active+clean; 4.1 GiB data, 14 GiB used, 702 GiB / 715 GiB avail; 1022 B/s rd, 75 MiB/s wr, 1.20k op/s 2021-10-08T19:32:34.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:34 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2789670982' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:32:34.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:34 smithi117 ceph-mon[34585]: from='client.35558 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:32:34.159 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:32:34.161 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:34.162 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:32:34.173 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2021-10-08T19:32:34.218 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:34 smithi097 ceph-mon[41966]: pgmap v570: 178 pgs: 178 active+clean; 4.1 GiB data, 14 GiB used, 702 GiB / 715 GiB avail; 1022 B/s rd, 75 MiB/s wr, 1.20k op/s 2021-10-08T19:32:34.218 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:34 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2789670982' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:32:34.219 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:34 smithi097 ceph-mon[41966]: from='client.35558 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:32:34.219 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:34 smithi097 ceph-mon[32687]: pgmap v570: 178 pgs: 178 active+clean; 4.1 GiB data, 14 GiB used, 702 GiB / 715 GiB avail; 1022 B/s rd, 75 MiB/s wr, 1.20k op/s 2021-10-08T19:32:34.219 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:34 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2789670982' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:32:34.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:34 smithi097 ceph-mon[32687]: from='client.35558 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:32:34.263 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:32:34.342 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:34.731 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:32:34.734 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:34.734 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:32:34.835 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:32:34.844 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 51 16 73670 73654 90.2278 54.5 0.0105385 0.0110777 2021-10-08T19:32:34.898 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:35.136 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2021-10-08T19:32:35.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:35 smithi097 ceph-mon[41966]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:32:35.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:35 smithi097 ceph-mon[41966]: from='client.35558 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:32:35.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:35 smithi097 ceph-mon[41966]: osdmap e316: 8 total, 8 up, 8 in 2021-10-08T19:32:35.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:35 smithi097 ceph-mon[41966]: 2.b scrub ok 2021-10-08T19:32:35.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:35 smithi097 ceph-mon[41966]: 6.1 scrub ok 2021-10-08T19:32:35.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:35 smithi097 ceph-mon[41966]: 1.6 scrub ok 2021-10-08T19:32:35.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:35 smithi097 ceph-mon[32687]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:32:35.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:35 smithi097 ceph-mon[32687]: from='client.35558 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:32:35.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:35 smithi097 ceph-mon[32687]: osdmap e316: 8 total, 8 up, 8 in 2021-10-08T19:32:35.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:35 smithi097 ceph-mon[32687]: 2.b scrub ok 2021-10-08T19:32:35.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:35 smithi097 ceph-mon[32687]: 6.1 scrub ok 2021-10-08T19:32:35.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:35 smithi097 ceph-mon[32687]: 1.6 scrub ok 2021-10-08T19:32:35.409 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:35 smithi117 ceph-mon[34585]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:32:35.409 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:35 smithi117 ceph-mon[34585]: from='client.35558 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:32:35.409 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:35 smithi117 ceph-mon[34585]: osdmap e316: 8 total, 8 up, 8 in 2021-10-08T19:32:35.410 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:35 smithi117 ceph-mon[34585]: 2.b scrub ok 2021-10-08T19:32:35.410 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:35 smithi117 ceph-mon[34585]: 6.1 scrub ok 2021-10-08T19:32:35.410 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:35 smithi117 ceph-mon[34585]: 1.6 scrub ok 2021-10-08T19:32:35.568 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:32:35.846 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 52 16 74703 74687 89.7316 64.5625 0.00770351 0.0111395 2021-10-08T19:32:36.150 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:32:36.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:36 smithi117 ceph-mon[34585]: 4.10 scrub ok 2021-10-08T19:32:36.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:36 smithi117 ceph-mon[34585]: pgmap v572: 178 pgs: 178 active+clean; 4.4 GiB data, 15 GiB used, 701 GiB / 715 GiB avail; 1.0 KiB/s rd, 73 MiB/s wr, 1.16k op/s 2021-10-08T19:32:36.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:36 smithi117 ceph-mon[34585]: 5.10 scrub ok 2021-10-08T19:32:36.157 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:36.157 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:32:36.259 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:32:36.291 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:36 smithi097 ceph-mon[41966]: 4.10 scrub ok 2021-10-08T19:32:36.291 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:36 smithi097 ceph-mon[41966]: pgmap v572: 178 pgs: 178 active+clean; 4.4 GiB data, 15 GiB used, 701 GiB / 715 GiB avail; 1.0 KiB/s rd, 73 MiB/s wr, 1.16k op/s 2021-10-08T19:32:36.292 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:36 smithi097 ceph-mon[41966]: 5.10 scrub ok 2021-10-08T19:32:36.292 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:36 smithi097 ceph-mon[32687]: 4.10 scrub ok 2021-10-08T19:32:36.293 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:36 smithi097 ceph-mon[32687]: pgmap v572: 178 pgs: 178 active+clean; 4.4 GiB data, 15 GiB used, 701 GiB / 715 GiB avail; 1.0 KiB/s rd, 73 MiB/s wr, 1.16k op/s 2021-10-08T19:32:36.293 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:36 smithi097 ceph-mon[32687]: 5.10 scrub ok 2021-10-08T19:32:36.295 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:36.731 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:32:36.735 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:36.737 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:32:36.802 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:32:36.839 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:32:36.846 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 53 16 75855 75839 89.3971 72 0.0211006 0.0111804 2021-10-08T19:32:36.882 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:36.950 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:32:36.954 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:36.955 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:32:37.037 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:32:36 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:32:37.037 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:37 smithi117 ceph-mon[34585]: 4.d scrub ok 2021-10-08T19:32:37.038 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:37 smithi117 ceph-mon[34585]: 6.14 scrub ok 2021-10-08T19:32:37.038 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:37 smithi117 ceph-mon[34585]: 2.7 scrub ok 2021-10-08T19:32:37.056 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:32:37.095 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:37.279 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:37 smithi097 ceph-mon[32687]: 4.d scrub ok 2021-10-08T19:32:37.280 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:37 smithi097 ceph-mon[32687]: 6.14 scrub ok 2021-10-08T19:32:37.280 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:37 smithi097 ceph-mon[32687]: 2.7 scrub ok 2021-10-08T19:32:37.281 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:37 smithi097 ceph-mon[41966]: 4.d scrub ok 2021-10-08T19:32:37.281 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:37 smithi097 ceph-mon[41966]: 6.14 scrub ok 2021-10-08T19:32:37.282 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:37 smithi097 ceph-mon[41966]: 2.7 scrub ok 2021-10-08T19:32:37.389 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:32:37.395 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:37.396 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:32:37.497 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:32:37.528 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:37.629 INFO:teuthology.orchestra.run.smithi097.stdout:moved 0 / 534 (0%) 2021-10-08T19:32:37.629 INFO:teuthology.orchestra.run.smithi097.stdout:avg 66.75 2021-10-08T19:32:37.629 INFO:teuthology.orchestra.run.smithi097.stdout:stddev 8.78564 -> 8.78564 (expected baseline 7.6424) 2021-10-08T19:32:37.630 INFO:teuthology.orchestra.run.smithi097.stdout:min osd.2 with 51 -> 51 pgs (0.764045 -> 0.764045 * mean) 2021-10-08T19:32:37.630 INFO:teuthology.orchestra.run.smithi097.stdout:max osd.7 with 80 -> 80 pgs (1.1985 -> 1.1985 * mean) 2021-10-08T19:32:37.631 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:32:37.631 INFO:teuthology.orchestra.run.smithi097.stdout:oload 1000 2021-10-08T19:32:37.631 INFO:teuthology.orchestra.run.smithi097.stdout:max_change 0.05 2021-10-08T19:32:37.631 INFO:teuthology.orchestra.run.smithi097.stdout:max_change_osds 4 2021-10-08T19:32:37.632 INFO:teuthology.orchestra.run.smithi097.stdout:average_utilization 0.0205 2021-10-08T19:32:37.632 INFO:teuthology.orchestra.run.smithi097.stdout:overload_utilization 0.2048 2021-10-08T19:32:37.643 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:32:37.644 INFO:teuthology.orchestra.run.smithi097.stderr:no change 2021-10-08T19:32:37.651 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:37.652 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:32:37.753 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:32:37.832 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:37.847 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 54 16 76867 76851 88.9115 63.25 0.02554 0.0112412 2021-10-08T19:32:37.922 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:32:37.923 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2021-10-08T19:32:37.923 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2021-10-08T19:32:37.923 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2021-10-08T19:32:37.924 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.924 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:137826 8.9 8:9aba77ae:::benchmark_data_smithi097_144160_object49086:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e255)", 2021-10-08T19:32:37.924 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:30:31.671622+0000", 2021-10-08T19:32:37.924 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 126.244954862, 2021-10-08T19:32:37.925 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.166700311, 2021-10-08T19:32:37.925 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:32:37.925 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2021-10-08T19:32:37.925 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:32:37.925 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:32:37.926 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:32:37.926 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 137826 2021-10-08T19:32:37.926 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:37.926 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:32:37.927 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.927 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:32:37.927 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.671622+0000", 2021-10-08T19:32:37.927 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:37.928 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:37.928 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.928 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:32:37.928 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.671622+0000", 2021-10-08T19:32:37.928 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:37.929 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:37.929 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.929 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:32:37.929 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.671620+0000", 2021-10-08T19:32:37.930 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:32:37.931 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:37.931 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.931 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:32:37.931 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.671628+0000", 2021-10-08T19:32:37.932 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.1310000000000006e-06 2021-10-08T19:32:37.932 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:37.932 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.932 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:32:37.933 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.671640+0000", 2021-10-08T19:32:37.933 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2164000000000001e-05 2021-10-08T19:32:37.933 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:37.933 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.933 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:32:37.934 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.671647+0000", 2021-10-08T19:32:37.934 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8159999999999996e-06 2021-10-08T19:32:37.934 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:37.934 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.935 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:37.935 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.671725+0000", 2021-10-08T19:32:37.935 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8860000000000001e-05 2021-10-08T19:32:37.935 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:37.936 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.936 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:32:37.936 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.671871+0000", 2021-10-08T19:32:37.936 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014539500000000001 2021-10-08T19:32:37.937 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:37.937 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.937 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:32:37.937 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.672016+0000", 2021-10-08T19:32:37.937 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014515799999999999 2021-10-08T19:32:37.938 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:37.938 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.938 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:32:37.938 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.678831+0000", 2021-10-08T19:32:37.939 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0068148089999999998 2021-10-08T19:32:37.939 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:37.939 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.939 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:37.940 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.691132+0000", 2021-10-08T19:32:37.940 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012300963999999999 2021-10-08T19:32:37.940 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:37.940 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.941 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for peered", 2021-10-08T19:32:37.942 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.691139+0000", 2021-10-08T19:32:37.942 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0049999999999998e-06 2021-10-08T19:32:37.942 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:37.943 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.943 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:37.943 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:32.677752+0000", 2021-10-08T19:32:37.943 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.986613517 2021-10-08T19:32:37.944 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:37.944 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.944 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for peered", 2021-10-08T19:32:37.944 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:32.677762+0000", 2021-10-08T19:32:37.944 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9399999999999997e-06 2021-10-08T19:32:37.945 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:37.945 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.945 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:37.945 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.820420+0000", 2021-10-08T19:32:37.946 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1426576310000001 2021-10-08T19:32:37.946 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:37.946 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.946 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for missing object", 2021-10-08T19:32:37.947 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.820516+0000", 2021-10-08T19:32:37.947 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6328000000000003e-05 2021-10-08T19:32:37.947 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:37.947 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.947 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:37.948 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.838200+0000", 2021-10-08T19:32:37.948 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017683616999999999 2021-10-08T19:32:37.948 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:37.948 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.949 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:32:37.949 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.838322+0000", 2021-10-08T19:32:37.949 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000122378 2021-10-08T19:32:37.949 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:37.950 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:32:37.950 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:37.950 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:37.950 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.951 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:137840 8.9 8:9a45754b:::benchmark_data_smithi097_144160_object49100:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e256)", 2021-10-08T19:32:37.951 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:30:31.700515+0000", 2021-10-08T19:32:37.951 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 126.216061697, 2021-10-08T19:32:37.951 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1395049070000001, 2021-10-08T19:32:37.952 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:32:37.952 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:32:37.952 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:32:37.952 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:32:37.952 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:32:37.953 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 137840 2021-10-08T19:32:37.953 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:37.953 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:32:37.953 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.954 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:32:37.954 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.700515+0000", 2021-10-08T19:32:37.954 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:37.954 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:37.955 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.955 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:32:37.955 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.700515+0000", 2021-10-08T19:32:37.955 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:37.955 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:37.956 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.956 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:32:37.956 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.700513+0000", 2021-10-08T19:32:37.956 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:32:37.957 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:37.957 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.957 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:32:37.957 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.700520+0000", 2021-10-08T19:32:37.957 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.9940000000000003e-06 2021-10-08T19:32:37.958 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:37.958 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.958 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:32:37.958 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.700531+0000", 2021-10-08T19:32:37.959 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1068e-05 2021-10-08T19:32:37.959 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:37.959 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.959 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:32:37.959 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.700538+0000", 2021-10-08T19:32:37.960 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.131e-06 2021-10-08T19:32:37.960 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:37.960 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.960 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:37.961 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.700578+0000", 2021-10-08T19:32:37.961 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9786000000000002e-05 2021-10-08T19:32:37.961 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:37.961 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.961 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for peered", 2021-10-08T19:32:37.962 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.700584+0000", 2021-10-08T19:32:37.962 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1190000000000002e-06 2021-10-08T19:32:37.962 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:37.962 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.962 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:37.963 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:32.677784+0000", 2021-10-08T19:32:37.963 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.97719966199999997 2021-10-08T19:32:37.963 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:37.963 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.964 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for peered", 2021-10-08T19:32:37.964 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:32.677790+0000", 2021-10-08T19:32:37.964 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9510000000000003e-06 2021-10-08T19:32:37.964 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:37.965 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.965 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:37.965 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.820745+0000", 2021-10-08T19:32:37.966 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1429549269999999 2021-10-08T19:32:37.966 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:37.966 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.967 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:32:37.967 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.820836+0000", 2021-10-08T19:32:37.967 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.1749000000000005e-05 2021-10-08T19:32:37.967 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:37.968 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.968 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,3,5", 2021-10-08T19:32:37.968 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.821174+0000", 2021-10-08T19:32:37.968 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00033794899999999999 2021-10-08T19:32:37.968 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:37.969 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.969 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:32:37.969 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.828109+0000", 2021-10-08T19:32:37.970 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0069349219999999996 2021-10-08T19:32:37.970 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:37.970 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.970 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:37.971 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.828171+0000", 2021-10-08T19:32:37.971 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1371000000000006e-05 2021-10-08T19:32:37.971 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:37.972 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.972 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:37.972 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.838452+0000", 2021-10-08T19:32:37.972 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010281327999999999 2021-10-08T19:32:37.973 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:37.973 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.973 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:37.973 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.839817+0000", 2021-10-08T19:32:37.973 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013653199999999999 2021-10-08T19:32:37.974 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:37.974 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.974 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:32:37.974 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.839875+0000", 2021-10-08T19:32:37.974 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7399999999999999e-05 2021-10-08T19:32:37.975 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:37.975 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.975 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:32:37.975 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.840020+0000", 2021-10-08T19:32:37.976 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014520700000000001 2021-10-08T19:32:37.976 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:37.976 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:32:37.976 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:37.976 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:37.977 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.977 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:137857 8.9 8:93f36960:::benchmark_data_smithi097_144160_object49117:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e256)", 2021-10-08T19:32:37.977 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:30:31.713065+0000", 2021-10-08T19:32:37.977 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 126.20351150099999, 2021-10-08T19:32:37.977 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1272139019999998, 2021-10-08T19:32:37.978 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:32:37.978 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:32:37.978 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:32:37.978 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:32:37.978 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:32:37.979 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 137857 2021-10-08T19:32:37.979 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:37.979 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:32:37.979 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.979 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:32:37.980 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.713065+0000", 2021-10-08T19:32:37.980 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:37.980 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:37.980 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.981 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:32:37.981 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.713065+0000", 2021-10-08T19:32:37.981 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:37.981 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:37.982 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.982 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:32:37.982 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.713062+0000", 2021-10-08T19:32:37.983 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999971 2021-10-08T19:32:37.983 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:37.983 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.983 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:32:37.983 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.713072+0000", 2021-10-08T19:32:37.984 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.1740000000000006e-06 2021-10-08T19:32:37.984 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:37.984 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.984 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:32:37.985 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.713090+0000", 2021-10-08T19:32:37.985 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8770000000000002e-05 2021-10-08T19:32:37.985 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:37.985 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.986 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:32:37.986 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.713098+0000", 2021-10-08T19:32:37.986 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6760000000000007e-06 2021-10-08T19:32:37.986 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:37.986 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.987 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:37.987 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.713154+0000", 2021-10-08T19:32:37.987 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5893000000000002e-05 2021-10-08T19:32:37.987 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:37.987 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.988 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for peered", 2021-10-08T19:32:37.988 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.713165+0000", 2021-10-08T19:32:37.988 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1269e-05 2021-10-08T19:32:37.988 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:37.988 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.989 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:37.989 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:32.677808+0000", 2021-10-08T19:32:37.989 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.964642314 2021-10-08T19:32:37.989 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:37.990 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.990 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for peered", 2021-10-08T19:32:37.990 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:32.677813+0000", 2021-10-08T19:32:37.990 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.755e-06 2021-10-08T19:32:37.991 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:37.991 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.991 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:37.992 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.823829+0000", 2021-10-08T19:32:37.992 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1460159540000001 2021-10-08T19:32:37.992 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:37.992 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.993 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:32:37.993 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.823919+0000", 2021-10-08T19:32:37.993 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9611999999999995e-05 2021-10-08T19:32:37.993 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:37.993 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.994 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,3,5", 2021-10-08T19:32:37.994 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.824006+0000", 2021-10-08T19:32:37.994 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.7213999999999995e-05 2021-10-08T19:32:37.994 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:37.994 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.995 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:37.995 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.828209+0000", 2021-10-08T19:32:37.995 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004203137 2021-10-08T19:32:37.995 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:37.995 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.996 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:32:37.996 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.828217+0000", 2021-10-08T19:32:37.996 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2039999999999997e-06 2021-10-08T19:32:37.996 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:37.996 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.997 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:37.997 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.838525+0000", 2021-10-08T19:32:37.997 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010307363999999999 2021-10-08T19:32:37.997 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:37.997 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.998 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:37.998 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.840093+0000", 2021-10-08T19:32:37.998 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0015684710000000001 2021-10-08T19:32:37.998 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:37.999 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:37.999 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:32:37.999 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.840152+0000", 2021-10-08T19:32:37.999 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9191000000000003e-05 2021-10-08T19:32:37.999 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.000 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.000 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:32:38.000 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.840279+0000", 2021-10-08T19:32:38.000 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012667700000000001 2021-10-08T19:32:38.001 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:38.001 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:32:38.001 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:38.001 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.002 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.002 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:137858 8.9 8:9dbdeebe:::benchmark_data_smithi097_144160_object49118:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e256)", 2021-10-08T19:32:38.002 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:30:31.713112+0000", 2021-10-08T19:32:38.002 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 126.203465096, 2021-10-08T19:32:38.003 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1326835399999999, 2021-10-08T19:32:38.003 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:32:38.003 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:32:38.003 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:32:38.003 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:32:38.004 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:32:38.004 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 137858 2021-10-08T19:32:38.004 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.004 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:32:38.005 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.005 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:32:38.005 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.713112+0000", 2021-10-08T19:32:38.005 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:38.005 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.006 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.006 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:32:38.006 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.713112+0000", 2021-10-08T19:32:38.006 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:38.006 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.007 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.007 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:32:38.007 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.713111+0000", 2021-10-08T19:32:38.007 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:32:38.007 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.008 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.008 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:32:38.008 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.713115+0000", 2021-10-08T19:32:38.008 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0409999999999999e-06 2021-10-08T19:32:38.009 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.009 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.009 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:32:38.009 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.713129+0000", 2021-10-08T19:32:38.009 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4307999999999999e-05 2021-10-08T19:32:38.010 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.010 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.010 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:32:38.010 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.713282+0000", 2021-10-08T19:32:38.011 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000153239 2021-10-08T19:32:38.011 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.011 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.011 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:38.012 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.713333+0000", 2021-10-08T19:32:38.012 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0828999999999997e-05 2021-10-08T19:32:38.012 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.013 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.013 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for peered", 2021-10-08T19:32:38.013 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.713341+0000", 2021-10-08T19:32:38.013 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2449999999999998e-06 2021-10-08T19:32:38.013 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.014 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.014 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:38.014 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:32.677830+0000", 2021-10-08T19:32:38.014 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.96448898999999999 2021-10-08T19:32:38.015 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.015 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.015 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for peered", 2021-10-08T19:32:38.015 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:32.677836+0000", 2021-10-08T19:32:38.015 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6720000000000001e-06 2021-10-08T19:32:38.016 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.016 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.016 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:38.016 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.825817+0000", 2021-10-08T19:32:38.016 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1479806450000001 2021-10-08T19:32:38.017 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.017 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.017 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:32:38.017 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.825971+0000", 2021-10-08T19:32:38.017 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015410599999999999 2021-10-08T19:32:38.018 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.018 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.018 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,3,5", 2021-10-08T19:32:38.018 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.826139+0000", 2021-10-08T19:32:38.019 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016776700000000001 2021-10-08T19:32:38.019 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.019 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.019 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:38.019 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.828257+0000", 2021-10-08T19:32:38.020 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021187889999999998 2021-10-08T19:32:38.020 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.020 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.020 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:32:38.021 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.829840+0000", 2021-10-08T19:32:38.021 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001583026 2021-10-08T19:32:38.021 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.021 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.022 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:38.022 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.838577+0000", 2021-10-08T19:32:38.022 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0087363790000000007 2021-10-08T19:32:38.022 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.023 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.023 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:38.023 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.845641+0000", 2021-10-08T19:32:38.023 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0070641860000000001 2021-10-08T19:32:38.024 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.024 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.024 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:32:38.024 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.845689+0000", 2021-10-08T19:32:38.024 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8282000000000003e-05 2021-10-08T19:32:38.025 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.025 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.025 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:32:38.025 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.845795+0000", 2021-10-08T19:32:38.025 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000105902 2021-10-08T19:32:38.026 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:38.026 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:32:38.026 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:38.026 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.026 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.027 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:137902 8.9 8:915a9f96:::benchmark_data_smithi097_144160_object49162:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e256)", 2021-10-08T19:32:38.027 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:30:31.762130+0000", 2021-10-08T19:32:38.027 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 126.154446857, 2021-10-08T19:32:38.027 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0839035209999999, 2021-10-08T19:32:38.028 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:32:38.028 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:32:38.028 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:32:38.028 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:32:38.028 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:32:38.029 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 137902 2021-10-08T19:32:38.029 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.029 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:32:38.029 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.029 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:32:38.030 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.762130+0000", 2021-10-08T19:32:38.030 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:38.030 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.031 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.031 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:32:38.031 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.762130+0000", 2021-10-08T19:32:38.031 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:38.032 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.032 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.032 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:32:38.032 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.762128+0000", 2021-10-08T19:32:38.032 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:32:38.033 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.033 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.033 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:32:38.033 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.762134+0000", 2021-10-08T19:32:38.034 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3879999999999997e-06 2021-10-08T19:32:38.034 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.034 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.034 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:32:38.034 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.762146+0000", 2021-10-08T19:32:38.035 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1518999999999999e-05 2021-10-08T19:32:38.035 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.035 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.035 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:32:38.036 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.762150+0000", 2021-10-08T19:32:38.036 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.6090000000000003e-06 2021-10-08T19:32:38.036 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.036 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.036 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:38.037 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.762189+0000", 2021-10-08T19:32:38.037 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8754000000000002e-05 2021-10-08T19:32:38.037 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.037 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.037 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for peered", 2021-10-08T19:32:38.038 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.762196+0000", 2021-10-08T19:32:38.038 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5409999999999997e-06 2021-10-08T19:32:38.038 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.038 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.038 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:38.039 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:32.677853+0000", 2021-10-08T19:32:38.039 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.91565775999999999 2021-10-08T19:32:38.039 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.039 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.040 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for peered", 2021-10-08T19:32:38.040 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:32.677859+0000", 2021-10-08T19:32:38.040 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6470000000000003e-06 2021-10-08T19:32:38.041 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.041 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.041 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:38.041 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.828282+0000", 2021-10-08T19:32:38.042 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1504229800000001 2021-10-08T19:32:38.042 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.042 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.042 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:32:38.042 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.828366+0000", 2021-10-08T19:32:38.043 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4053000000000003e-05 2021-10-08T19:32:38.043 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.043 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.043 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,3,5", 2021-10-08T19:32:38.043 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.828456+0000", 2021-10-08T19:32:38.044 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9507999999999998e-05 2021-10-08T19:32:38.044 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.044 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.044 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:38.045 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.831393+0000", 2021-10-08T19:32:38.045 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0029371039999999998 2021-10-08T19:32:38.045 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.045 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.045 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:32:38.046 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.831416+0000", 2021-10-08T19:32:38.046 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3218999999999999e-05 2021-10-08T19:32:38.046 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.046 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.046 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:38.047 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.838633+0000", 2021-10-08T19:32:38.047 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0072170960000000001 2021-10-08T19:32:38.047 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.047 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.048 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:38.048 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.845847+0000", 2021-10-08T19:32:38.048 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0072138139999999998 2021-10-08T19:32:38.048 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.049 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.049 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:32:38.049 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.845898+0000", 2021-10-08T19:32:38.049 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0714999999999998e-05 2021-10-08T19:32:38.050 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.050 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.050 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:32:38.051 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.846033+0000", 2021-10-08T19:32:38.051 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013580600000000001 2021-10-08T19:32:38.051 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:38.051 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:32:38.052 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:38.052 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.052 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.052 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:137906 8.9 8:9b87594c:::benchmark_data_smithi097_144160_object49166:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e256)", 2021-10-08T19:32:38.053 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:30:31.770274+0000", 2021-10-08T19:32:38.053 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 126.146302582, 2021-10-08T19:32:38.053 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.082185452, 2021-10-08T19:32:38.053 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:32:38.053 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:32:38.054 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:32:38.054 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:32:38.054 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:32:38.054 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 137906 2021-10-08T19:32:38.054 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.055 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:32:38.055 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.055 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:32:38.055 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.770274+0000", 2021-10-08T19:32:38.056 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:38.056 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.056 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.056 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:32:38.056 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.770274+0000", 2021-10-08T19:32:38.057 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:38.057 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.057 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.057 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:32:38.057 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.770271+0000", 2021-10-08T19:32:38.058 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999967 2021-10-08T19:32:38.058 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.058 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.058 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:32:38.058 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.770284+0000", 2021-10-08T19:32:38.059 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3769e-05 2021-10-08T19:32:38.059 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.059 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.060 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:32:38.060 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.770317+0000", 2021-10-08T19:32:38.060 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2137000000000001e-05 2021-10-08T19:32:38.060 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.061 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.061 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:32:38.061 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.770330+0000", 2021-10-08T19:32:38.061 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3852999999999999e-05 2021-10-08T19:32:38.062 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.062 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.062 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:38.062 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.770453+0000", 2021-10-08T19:32:38.063 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000122514 2021-10-08T19:32:38.063 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.063 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.063 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for peered", 2021-10-08T19:32:38.063 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.770490+0000", 2021-10-08T19:32:38.064 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7045000000000002e-05 2021-10-08T19:32:38.064 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.064 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.064 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:38.065 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:32.677877+0000", 2021-10-08T19:32:38.065 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.90738696399999996 2021-10-08T19:32:38.065 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.065 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.065 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for peered", 2021-10-08T19:32:38.066 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:32.677883+0000", 2021-10-08T19:32:38.066 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6219999999999997e-06 2021-10-08T19:32:38.066 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.066 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.066 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:38.067 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.829875+0000", 2021-10-08T19:32:38.067 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.151992699 2021-10-08T19:32:38.067 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.067 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.068 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:32:38.068 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.830011+0000", 2021-10-08T19:32:38.068 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013545699999999999 2021-10-08T19:32:38.068 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.068 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.069 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,3,5", 2021-10-08T19:32:38.069 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.830169+0000", 2021-10-08T19:32:38.069 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015829599999999999 2021-10-08T19:32:38.069 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.070 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.070 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:32:38.070 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.831517+0000", 2021-10-08T19:32:38.071 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001348349 2021-10-08T19:32:38.071 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.071 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.071 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:38.072 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.831796+0000", 2021-10-08T19:32:38.072 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00027892800000000001 2021-10-08T19:32:38.072 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.072 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.072 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:38.073 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.838701+0000", 2021-10-08T19:32:38.073 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0069042729999999998 2021-10-08T19:32:38.073 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.073 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.073 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:38.074 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.852281+0000", 2021-10-08T19:32:38.074 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013580539000000001 2021-10-08T19:32:38.074 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.074 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.075 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:32:38.075 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.852339+0000", 2021-10-08T19:32:38.075 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7491999999999998e-05 2021-10-08T19:32:38.075 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.075 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.076 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:32:38.076 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.852460+0000", 2021-10-08T19:32:38.076 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000120975 2021-10-08T19:32:38.076 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:38.077 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:32:38.077 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:38.077 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.077 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.077 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:153473 8.9 8:941ef2fd:::benchmark_data_smithi097_144160_object64733:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e265)", 2021-10-08T19:32:38.078 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:30:50.613472+0000", 2021-10-08T19:32:38.078 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 107.303104836, 2021-10-08T19:32:38.078 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0813083269999999, 2021-10-08T19:32:38.078 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:32:38.079 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2021-10-08T19:32:38.079 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:32:38.079 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:32:38.079 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:32:38.080 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 153473 2021-10-08T19:32:38.080 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.080 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:32:38.081 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.081 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:32:38.081 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.613472+0000", 2021-10-08T19:32:38.081 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:38.081 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.082 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.082 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:32:38.082 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.613472+0000", 2021-10-08T19:32:38.082 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:38.083 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.083 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.083 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:32:38.083 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.613471+0000", 2021-10-08T19:32:38.083 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:32:38.084 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.084 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.084 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:32:38.084 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.613478+0000", 2021-10-08T19:32:38.085 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3030000000000002e-06 2021-10-08T19:32:38.085 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.085 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.085 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:32:38.085 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.613484+0000", 2021-10-08T19:32:38.086 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4840000000000001e-06 2021-10-08T19:32:38.086 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.086 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.086 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:32:38.086 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.613490+0000", 2021-10-08T19:32:38.087 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7440000000000004e-06 2021-10-08T19:32:38.087 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.087 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.087 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:38.087 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.619719+0000", 2021-10-08T19:32:38.088 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0062289679999999997 2021-10-08T19:32:38.088 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.088 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.088 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:32:38.089 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.619859+0000", 2021-10-08T19:32:38.089 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013937800000000001 2021-10-08T19:32:38.089 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.089 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.090 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,3,5", 2021-10-08T19:32:38.090 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.619985+0000", 2021-10-08T19:32:38.090 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012626099999999999 2021-10-08T19:32:38.090 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.091 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.091 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:32:38.091 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.623056+0000", 2021-10-08T19:32:38.091 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0030707260000000002 2021-10-08T19:32:38.092 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.092 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.092 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:38.092 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.626524+0000", 2021-10-08T19:32:38.093 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003468006 2021-10-08T19:32:38.093 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.093 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.093 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:38.093 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.627006+0000", 2021-10-08T19:32:38.094 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00048212400000000001 2021-10-08T19:32:38.094 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.094 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.094 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:38.095 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.644146+0000", 2021-10-08T19:32:38.095 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017140407999999999 2021-10-08T19:32:38.095 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.095 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.096 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for peered", 2021-10-08T19:32:38.096 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.644151+0000", 2021-10-08T19:32:38.096 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5560000000000001e-06 2021-10-08T19:32:38.096 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.096 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.097 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:38.097 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.694696+0000", 2021-10-08T19:32:38.097 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.050545721 2021-10-08T19:32:38.097 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.097 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.098 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:32:38.098 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.694780+0000", 2021-10-08T19:32:38.098 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3871999999999999e-05 2021-10-08T19:32:38.098 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:38.098 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:32:38.099 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:38.099 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.099 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.099 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:153500 8.9 8:96f9f00a:::benchmark_data_smithi097_144160_object64760:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e266)", 2021-10-08T19:32:38.100 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:30:50.643453+0000", 2021-10-08T19:32:38.100 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 107.27312377, 2021-10-08T19:32:38.100 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.064962492, 2021-10-08T19:32:38.101 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:32:38.101 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:32:38.101 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:32:38.101 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:32:38.102 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:32:38.102 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 153500 2021-10-08T19:32:38.102 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.102 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:32:38.102 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.103 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:32:38.103 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.643453+0000", 2021-10-08T19:32:38.103 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:38.103 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.104 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.104 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:32:38.104 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.643453+0000", 2021-10-08T19:32:38.104 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:38.104 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.105 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.105 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:32:38.105 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.643452+0000", 2021-10-08T19:32:38.105 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999995 2021-10-08T19:32:38.105 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.106 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.106 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:32:38.106 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.643455+0000", 2021-10-08T19:32:38.106 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.1549999999999999e-06 2021-10-08T19:32:38.106 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.107 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.107 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:32:38.107 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.643466+0000", 2021-10-08T19:32:38.107 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0659000000000001e-05 2021-10-08T19:32:38.108 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.108 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.108 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:32:38.108 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.643471+0000", 2021-10-08T19:32:38.108 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4769999999999997e-06 2021-10-08T19:32:38.109 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.109 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.109 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:38.109 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.644161+0000", 2021-10-08T19:32:38.110 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00069033899999999999 2021-10-08T19:32:38.110 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.110 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.111 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for peered", 2021-10-08T19:32:38.111 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.644164+0000", 2021-10-08T19:32:38.111 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.112e-06 2021-10-08T19:32:38.111 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.112 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.112 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:38.112 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.695214+0000", 2021-10-08T19:32:38.112 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.05104953 2021-10-08T19:32:38.112 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.113 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.113 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:32:38.113 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.695318+0000", 2021-10-08T19:32:38.113 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000104101 2021-10-08T19:32:38.113 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.114 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.114 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,3", 2021-10-08T19:32:38.114 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.695455+0000", 2021-10-08T19:32:38.114 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013753300000000001 2021-10-08T19:32:38.115 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.115 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.115 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:38.115 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.703887+0000", 2021-10-08T19:32:38.115 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0084321459999999997 2021-10-08T19:32:38.116 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.116 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.116 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:32:38.116 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.708199+0000", 2021-10-08T19:32:38.117 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0043118820000000004 2021-10-08T19:32:38.117 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.117 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.117 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:38.117 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.708314+0000", 2021-10-08T19:32:38.118 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000114537 2021-10-08T19:32:38.118 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.118 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.118 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:32:38.118 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.708370+0000", 2021-10-08T19:32:38.119 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5906999999999999e-05 2021-10-08T19:32:38.119 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.119 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.120 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:32:38.120 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.708415+0000", 2021-10-08T19:32:38.120 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5773999999999999e-05 2021-10-08T19:32:38.120 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:38.121 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:32:38.121 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:38.121 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.121 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.122 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:153508 8.9 8:9acac7e6:::benchmark_data_smithi097_144160_object64768:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e266)", 2021-10-08T19:32:38.122 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:30:50.654476+0000", 2021-10-08T19:32:38.122 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 107.26210068, 2021-10-08T19:32:38.122 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.05408868, 2021-10-08T19:32:38.122 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:32:38.123 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:32:38.123 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:32:38.123 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:32:38.123 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:32:38.124 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 153508 2021-10-08T19:32:38.124 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.124 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:32:38.124 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.124 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:32:38.125 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.654476+0000", 2021-10-08T19:32:38.125 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:38.125 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.125 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.125 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:32:38.126 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.654476+0000", 2021-10-08T19:32:38.126 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:38.126 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.126 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.126 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:32:38.127 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.654474+0000", 2021-10-08T19:32:38.127 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:32:38.127 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.127 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.127 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:32:38.128 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.654483+0000", 2021-10-08T19:32:38.128 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.8529999999999998e-06 2021-10-08T19:32:38.128 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.128 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.129 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:32:38.129 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.654502+0000", 2021-10-08T19:32:38.129 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9105000000000001e-05 2021-10-08T19:32:38.129 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.129 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.130 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:32:38.130 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.654510+0000", 2021-10-08T19:32:38.130 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9340000000000006e-06 2021-10-08T19:32:38.131 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.131 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.131 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:38.131 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.654583+0000", 2021-10-08T19:32:38.132 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2928000000000004e-05 2021-10-08T19:32:38.132 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.132 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.132 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for peered", 2021-10-08T19:32:38.132 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.654592+0000", 2021-10-08T19:32:38.133 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9539999999999993e-06 2021-10-08T19:32:38.133 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.133 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.133 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:38.133 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.697949+0000", 2021-10-08T19:32:38.134 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0433576710000001 2021-10-08T19:32:38.134 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.134 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.134 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:32:38.134 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.698079+0000", 2021-10-08T19:32:38.135 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012980199999999999 2021-10-08T19:32:38.135 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.135 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.135 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,3", 2021-10-08T19:32:38.136 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.698472+0000", 2021-10-08T19:32:38.136 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00039300799999999997 2021-10-08T19:32:38.136 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.136 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.136 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:32:38.137 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.708207+0000", 2021-10-08T19:32:38.137 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097354090000000004 2021-10-08T19:32:38.137 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.137 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.137 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:38.138 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.708265+0000", 2021-10-08T19:32:38.138 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7618999999999998e-05 2021-10-08T19:32:38.138 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.138 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.138 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:38.139 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.708515+0000", 2021-10-08T19:32:38.139 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00024970299999999999 2021-10-08T19:32:38.139 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.139 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.140 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:32:38.140 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.708543+0000", 2021-10-08T19:32:38.140 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.817e-05 2021-10-08T19:32:38.140 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.141 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.141 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:32:38.141 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.708565+0000", 2021-10-08T19:32:38.141 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1806000000000001e-05 2021-10-08T19:32:38.142 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:38.142 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:32:38.142 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:38.142 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.143 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.143 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:153511 8.9 8:9cbdb6f5:::benchmark_data_smithi097_144160_object64771:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e266)", 2021-10-08T19:32:38.143 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:30:50.662390+0000", 2021-10-08T19:32:38.143 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 107.254186644, 2021-10-08T19:32:38.143 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.05116802, 2021-10-08T19:32:38.144 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:32:38.144 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:32:38.144 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:32:38.144 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:32:38.144 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:32:38.145 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 153511 2021-10-08T19:32:38.145 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.145 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:32:38.145 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.145 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:32:38.146 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.662390+0000", 2021-10-08T19:32:38.146 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:38.146 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.146 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.146 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:32:38.147 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.662390+0000", 2021-10-08T19:32:38.147 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:38.147 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.147 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.147 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:32:38.148 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.662388+0000", 2021-10-08T19:32:38.148 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:32:38.148 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.148 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.148 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:32:38.149 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.662395+0000", 2021-10-08T19:32:38.149 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3660000000000003e-06 2021-10-08T19:32:38.149 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.149 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.150 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:32:38.150 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.662406+0000", 2021-10-08T19:32:38.150 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0567999999999999e-05 2021-10-08T19:32:38.151 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.151 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.151 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:32:38.151 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.662410+0000", 2021-10-08T19:32:38.152 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7149999999999997e-06 2021-10-08T19:32:38.152 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.152 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.152 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:38.152 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.662476+0000", 2021-10-08T19:32:38.153 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5372999999999999e-05 2021-10-08T19:32:38.153 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.153 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.154 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for peered", 2021-10-08T19:32:38.154 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.662485+0000", 2021-10-08T19:32:38.154 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.4669999999999993e-06 2021-10-08T19:32:38.154 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.154 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.155 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:38.155 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.701789+0000", 2021-10-08T19:32:38.155 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.039303243 2021-10-08T19:32:38.155 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.156 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.156 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:32:38.156 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.701925+0000", 2021-10-08T19:32:38.156 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000136525 2021-10-08T19:32:38.156 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.157 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.157 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,3", 2021-10-08T19:32:38.157 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.702056+0000", 2021-10-08T19:32:38.157 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000130679 2021-10-08T19:32:38.157 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.158 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.158 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:32:38.158 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.708215+0000", 2021-10-08T19:32:38.158 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0061597049999999997 2021-10-08T19:32:38.159 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.159 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.159 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:38.159 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.708475+0000", 2021-10-08T19:32:38.160 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00025967500000000001 2021-10-08T19:32:38.160 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.160 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.160 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:38.161 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.713448+0000", 2021-10-08T19:32:38.161 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049727920000000002 2021-10-08T19:32:38.161 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.162 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.162 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:32:38.162 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.713514+0000", 2021-10-08T19:32:38.162 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6526999999999995e-05 2021-10-08T19:32:38.162 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.163 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.163 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:32:38.163 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.713558+0000", 2021-10-08T19:32:38.163 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.3686000000000002e-05 2021-10-08T19:32:38.163 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:38.164 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:32:38.164 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:38.164 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.164 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.165 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:153513 8.9 8:9fdef309:::benchmark_data_smithi097_144160_object64773:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e266)", 2021-10-08T19:32:38.165 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:30:50.662421+0000", 2021-10-08T19:32:38.165 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 107.254155459, 2021-10-08T19:32:38.165 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.051246388, 2021-10-08T19:32:38.165 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:32:38.166 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:32:38.166 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:32:38.166 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:32:38.166 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:32:38.167 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 153513 2021-10-08T19:32:38.167 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.167 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:32:38.167 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.167 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:32:38.168 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.662421+0000", 2021-10-08T19:32:38.168 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:38.168 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.168 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.169 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:32:38.169 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.662421+0000", 2021-10-08T19:32:38.169 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:38.169 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.169 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.170 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:32:38.170 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.662421+0000", 2021-10-08T19:32:38.170 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999995 2021-10-08T19:32:38.171 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.171 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.171 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:32:38.171 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.662423+0000", 2021-10-08T19:32:38.172 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6860000000000002e-06 2021-10-08T19:32:38.172 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.172 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.172 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:32:38.173 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.662431+0000", 2021-10-08T19:32:38.173 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1210000000000001e-06 2021-10-08T19:32:38.173 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.173 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.173 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:32:38.174 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.662434+0000", 2021-10-08T19:32:38.174 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4359999999999998e-06 2021-10-08T19:32:38.174 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.174 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.175 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:38.175 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.664720+0000", 2021-10-08T19:32:38.175 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022865020000000002 2021-10-08T19:32:38.175 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.175 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.176 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for peered", 2021-10-08T19:32:38.176 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.664731+0000", 2021-10-08T19:32:38.176 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.061e-05 2021-10-08T19:32:38.176 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.177 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.177 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:38.177 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.703943+0000", 2021-10-08T19:32:38.177 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0392120279999999 2021-10-08T19:32:38.177 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.178 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.178 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:32:38.178 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.704060+0000", 2021-10-08T19:32:38.178 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000117377 2021-10-08T19:32:38.179 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.179 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.179 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,3", 2021-10-08T19:32:38.179 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.704193+0000", 2021-10-08T19:32:38.180 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013231899999999999 2021-10-08T19:32:38.180 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.180 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.180 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:32:38.181 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.708429+0000", 2021-10-08T19:32:38.181 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042360189999999997 2021-10-08T19:32:38.181 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.181 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.182 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:38.182 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.713589+0000", 2021-10-08T19:32:38.182 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0051600439999999999 2021-10-08T19:32:38.182 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.183 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.183 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:38.183 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.713615+0000", 2021-10-08T19:32:38.183 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6267000000000001e-05 2021-10-08T19:32:38.184 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.184 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.184 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:32:38.184 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.713644+0000", 2021-10-08T19:32:38.184 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8617000000000001e-05 2021-10-08T19:32:38.185 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.185 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.185 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:32:38.185 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.713668+0000", 2021-10-08T19:32:38.186 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3955e-05 2021-10-08T19:32:38.186 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:38.186 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:32:38.186 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:38.186 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.187 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.187 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:153519 8.9 8:99337a2d:::benchmark_data_smithi097_144160_object64779:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e266)", 2021-10-08T19:32:38.187 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:30:50.669907+0000", 2021-10-08T19:32:38.187 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 107.24666927600001, 2021-10-08T19:32:38.188 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0438780379999999, 2021-10-08T19:32:38.188 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:32:38.188 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:32:38.188 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:32:38.188 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:32:38.189 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:32:38.189 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 153519 2021-10-08T19:32:38.189 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.189 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:32:38.189 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.190 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:32:38.190 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.669907+0000", 2021-10-08T19:32:38.190 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:38.191 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.191 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.191 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:32:38.191 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.669907+0000", 2021-10-08T19:32:38.192 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:38.192 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.192 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.192 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:32:38.192 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.669905+0000", 2021-10-08T19:32:38.193 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:32:38.193 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.193 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.193 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:32:38.194 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.669913+0000", 2021-10-08T19:32:38.194 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.52e-06 2021-10-08T19:32:38.194 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.194 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.194 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:32:38.195 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.669929+0000", 2021-10-08T19:32:38.195 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6251000000000001e-05 2021-10-08T19:32:38.195 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.195 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.196 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:32:38.196 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.669936+0000", 2021-10-08T19:32:38.196 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1770000000000001e-06 2021-10-08T19:32:38.196 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.196 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.197 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:38.197 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.669992+0000", 2021-10-08T19:32:38.197 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6073000000000003e-05 2021-10-08T19:32:38.197 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.197 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.198 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for peered", 2021-10-08T19:32:38.198 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.669999+0000", 2021-10-08T19:32:38.198 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7950000000000002e-06 2021-10-08T19:32:38.198 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.198 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.199 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:38.199 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.706094+0000", 2021-10-08T19:32:38.199 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.036095169 2021-10-08T19:32:38.199 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.200 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.200 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:32:38.200 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.706209+0000", 2021-10-08T19:32:38.200 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011464 2021-10-08T19:32:38.201 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.201 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.201 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,3", 2021-10-08T19:32:38.201 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.706336+0000", 2021-10-08T19:32:38.202 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000127124 2021-10-08T19:32:38.202 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.202 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.202 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:32:38.203 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.713677+0000", 2021-10-08T19:32:38.203 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0073407059999999998 2021-10-08T19:32:38.203 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.203 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.203 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:38.204 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.713713+0000", 2021-10-08T19:32:38.204 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6211000000000003e-05 2021-10-08T19:32:38.204 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.204 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.204 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:38.205 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.713739+0000", 2021-10-08T19:32:38.205 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5721999999999999e-05 2021-10-08T19:32:38.205 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.205 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.205 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:32:38.206 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.713762+0000", 2021-10-08T19:32:38.206 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3311000000000001e-05 2021-10-08T19:32:38.206 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.206 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.207 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:32:38.207 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.713786+0000", 2021-10-08T19:32:38.207 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3538999999999999e-05 2021-10-08T19:32:38.207 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:38.207 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:32:38.208 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:38.208 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.208 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.208 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:153521 8.9 8:946ba086:::benchmark_data_smithi097_144160_object64781:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e266)", 2021-10-08T19:32:38.208 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:30:50.669949+0000", 2021-10-08T19:32:38.209 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 107.246627496, 2021-10-08T19:32:38.209 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.043931052, 2021-10-08T19:32:38.209 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:32:38.209 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:32:38.210 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:32:38.210 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:32:38.210 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:32:38.210 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 153521 2021-10-08T19:32:38.211 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.211 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:32:38.211 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.211 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:32:38.212 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.669949+0000", 2021-10-08T19:32:38.212 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:38.212 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.212 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.213 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:32:38.213 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.669949+0000", 2021-10-08T19:32:38.213 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:38.213 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.213 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.214 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:32:38.214 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.669948+0000", 2021-10-08T19:32:38.214 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:32:38.214 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.214 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.215 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:32:38.215 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.669953+0000", 2021-10-08T19:32:38.215 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2819999999999998e-06 2021-10-08T19:32:38.215 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.216 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.216 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:32:38.216 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.669961+0000", 2021-10-08T19:32:38.216 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0209999999999999e-06 2021-10-08T19:32:38.216 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.217 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.217 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:32:38.217 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.669964+0000", 2021-10-08T19:32:38.217 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.1329999999999999e-06 2021-10-08T19:32:38.217 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.218 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.218 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:38.218 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.670011+0000", 2021-10-08T19:32:38.218 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.6943000000000001e-05 2021-10-08T19:32:38.218 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.219 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.219 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for peered", 2021-10-08T19:32:38.219 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.670014+0000", 2021-10-08T19:32:38.219 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9000000000000002e-06 2021-10-08T19:32:38.220 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.220 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.220 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:38.220 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.708600+0000", 2021-10-08T19:32:38.221 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0385866319999999 2021-10-08T19:32:38.221 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.221 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.221 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:32:38.222 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.708705+0000", 2021-10-08T19:32:38.222 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000104691 2021-10-08T19:32:38.222 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.222 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.223 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,3", 2021-10-08T19:32:38.223 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.708810+0000", 2021-10-08T19:32:38.223 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010542 2021-10-08T19:32:38.223 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.223 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.224 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:32:38.224 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.713682+0000", 2021-10-08T19:32:38.224 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0048714609999999997 2021-10-08T19:32:38.224 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.224 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.225 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:38.225 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.713813+0000", 2021-10-08T19:32:38.225 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000131187 2021-10-08T19:32:38.225 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.225 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.226 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:38.226 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.713837+0000", 2021-10-08T19:32:38.226 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4355e-05 2021-10-08T19:32:38.226 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.227 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.227 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:32:38.227 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.713859+0000", 2021-10-08T19:32:38.227 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1838e-05 2021-10-08T19:32:38.227 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.228 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.228 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:32:38.228 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.713880+0000", 2021-10-08T19:32:38.228 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1090999999999998e-05 2021-10-08T19:32:38.228 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:38.229 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:32:38.229 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:38.229 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.229 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.230 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:153543 8.9 8:95c1d208:::benchmark_data_smithi097_144160_object64803:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e266)", 2021-10-08T19:32:38.230 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:30:50.691241+0000", 2021-10-08T19:32:38.230 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 107.225336203, 2021-10-08T19:32:38.231 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.022748386, 2021-10-08T19:32:38.231 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:32:38.231 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:32:38.231 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:32:38.232 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:32:38.232 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:32:38.232 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 153543 2021-10-08T19:32:38.232 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.233 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:32:38.233 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.233 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:32:38.233 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.691241+0000", 2021-10-08T19:32:38.234 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:38.234 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.234 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.234 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:32:38.234 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.691241+0000", 2021-10-08T19:32:38.235 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:38.235 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.235 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.235 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:32:38.236 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.691238+0000", 2021-10-08T19:32:38.236 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:32:38.236 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.236 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.237 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:32:38.237 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.691246+0000", 2021-10-08T19:32:38.237 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.525e-06 2021-10-08T19:32:38.237 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.237 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.238 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:32:38.238 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.691260+0000", 2021-10-08T19:32:38.238 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3709999999999999e-05 2021-10-08T19:32:38.238 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.238 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.239 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:32:38.239 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.691267+0000", 2021-10-08T19:32:38.239 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1439999999999997e-06 2021-10-08T19:32:38.239 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.240 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.240 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:38.240 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.691321+0000", 2021-10-08T19:32:38.240 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.3891000000000003e-05 2021-10-08T19:32:38.241 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.241 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.241 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for peered", 2021-10-08T19:32:38.241 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.691329+0000", 2021-10-08T19:32:38.242 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6920000000000008e-06 2021-10-08T19:32:38.242 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.242 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.242 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:38.243 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.711139+0000", 2021-10-08T19:32:38.243 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.019809602 2021-10-08T19:32:38.243 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.243 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.243 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:32:38.244 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.711266+0000", 2021-10-08T19:32:38.244 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012736600000000001 2021-10-08T19:32:38.244 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.244 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.244 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,3", 2021-10-08T19:32:38.245 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.711401+0000", 2021-10-08T19:32:38.245 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013464999999999999 2021-10-08T19:32:38.245 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.245 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.245 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:32:38.246 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.713687+0000", 2021-10-08T19:32:38.246 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022856840000000001 2021-10-08T19:32:38.246 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.246 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.247 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:38.247 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.713921+0000", 2021-10-08T19:32:38.247 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00023449500000000001 2021-10-08T19:32:38.247 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.247 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.248 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:38.248 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.713949+0000", 2021-10-08T19:32:38.248 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.758e-05 2021-10-08T19:32:38.248 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.249 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.249 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:32:38.249 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.713969+0000", 2021-10-08T19:32:38.249 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0438e-05 2021-10-08T19:32:38.250 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.250 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.250 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:32:38.250 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.713989+0000", 2021-10-08T19:32:38.251 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9879999999999999e-05 2021-10-08T19:32:38.251 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:38.251 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:32:38.251 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:38.252 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.252 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.252 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:153591 8.9 8:9d18c1f1:::benchmark_data_smithi097_144160_object64851:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e266)", 2021-10-08T19:32:38.252 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:30:50.745318+0000", 2021-10-08T19:32:38.253 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 107.171258787, 2021-10-08T19:32:38.253 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.99413427799999998, 2021-10-08T19:32:38.253 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:32:38.253 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:32:38.253 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:32:38.254 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:32:38.254 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:32:38.254 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 153591 2021-10-08T19:32:38.254 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.255 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:32:38.255 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.255 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:32:38.255 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.745318+0000", 2021-10-08T19:32:38.255 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:38.256 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.256 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.256 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:32:38.256 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.745318+0000", 2021-10-08T19:32:38.257 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:38.257 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.257 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.257 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:32:38.257 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.745315+0000", 2021-10-08T19:32:38.258 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999971 2021-10-08T19:32:38.258 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.258 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.258 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:32:38.259 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.745325+0000", 2021-10-08T19:32:38.259 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.73e-06 2021-10-08T19:32:38.259 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.259 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.260 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:32:38.260 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.745342+0000", 2021-10-08T19:32:38.260 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7523000000000001e-05 2021-10-08T19:32:38.261 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.261 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.261 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:32:38.261 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.745351+0000", 2021-10-08T19:32:38.262 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3829999999999992e-06 2021-10-08T19:32:38.262 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.262 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.262 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:38.263 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.745399+0000", 2021-10-08T19:32:38.263 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8653000000000003e-05 2021-10-08T19:32:38.263 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.263 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.263 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for peered", 2021-10-08T19:32:38.264 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.745413+0000", 2021-10-08T19:32:38.264 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3635000000000001e-05 2021-10-08T19:32:38.264 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.264 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.265 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:38.265 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.714013+0000", 2021-10-08T19:32:38.265 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.96859971499999997 2021-10-08T19:32:38.265 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.265 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.266 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:32:38.266 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.714086+0000", 2021-10-08T19:32:38.266 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.381e-05 2021-10-08T19:32:38.266 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.267 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.267 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,3", 2021-10-08T19:32:38.267 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.714200+0000", 2021-10-08T19:32:38.267 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000114004 2021-10-08T19:32:38.267 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.268 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.268 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:38.268 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.733258+0000", 2021-10-08T19:32:38.268 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019057582999999999 2021-10-08T19:32:38.268 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.269 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.269 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:38.269 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.733324+0000", 2021-10-08T19:32:38.270 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6223000000000006e-05 2021-10-08T19:32:38.270 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.270 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.270 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:32:38.271 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.739345+0000", 2021-10-08T19:32:38.271 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0060205709999999997 2021-10-08T19:32:38.271 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.271 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.272 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:32:38.272 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.739405+0000", 2021-10-08T19:32:38.272 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0142000000000001e-05 2021-10-08T19:32:38.272 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.272 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.273 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:32:38.273 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.739452+0000", 2021-10-08T19:32:38.273 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7287000000000003e-05 2021-10-08T19:32:38.273 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:38.273 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:32:38.274 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:38.274 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.274 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.274 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:153629 8.9 8:9bdfca0d:::benchmark_data_smithi097_144160_object64889:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e266)", 2021-10-08T19:32:38.275 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:30:50.802768+0000", 2021-10-08T19:32:38.275 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 107.113809207, 2021-10-08T19:32:38.275 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.93678050800000001, 2021-10-08T19:32:38.275 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:32:38.275 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:32:38.276 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:32:38.276 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:32:38.276 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:32:38.276 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 153629 2021-10-08T19:32:38.276 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.277 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:32:38.277 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.277 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:32:38.277 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.802768+0000", 2021-10-08T19:32:38.277 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:38.278 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.278 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.278 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:32:38.278 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.802768+0000", 2021-10-08T19:32:38.278 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:38.279 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.279 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.279 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:32:38.280 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.802765+0000", 2021-10-08T19:32:38.280 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999971 2021-10-08T19:32:38.280 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.280 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.281 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:32:38.281 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.802775+0000", 2021-10-08T19:32:38.281 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0040999999999999e-05 2021-10-08T19:32:38.281 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.281 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.282 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:32:38.282 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.802793+0000", 2021-10-08T19:32:38.282 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7649e-05 2021-10-08T19:32:38.282 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.283 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.283 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:32:38.283 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.802799+0000", 2021-10-08T19:32:38.283 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5409999999999997e-06 2021-10-08T19:32:38.283 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.284 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.284 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:38.284 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.802837+0000", 2021-10-08T19:32:38.284 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7972999999999997e-05 2021-10-08T19:32:38.284 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.285 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.285 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for peered", 2021-10-08T19:32:38.285 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.802844+0000", 2021-10-08T19:32:38.285 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0079999999999996e-06 2021-10-08T19:32:38.285 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.286 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.286 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:38.286 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.716490+0000", 2021-10-08T19:32:38.286 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.91364543300000001 2021-10-08T19:32:38.286 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.287 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.287 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:32:38.287 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.716620+0000", 2021-10-08T19:32:38.287 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013011199999999999 2021-10-08T19:32:38.288 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.288 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.288 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,3", 2021-10-08T19:32:38.288 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.716738+0000", 2021-10-08T19:32:38.288 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000118454 2021-10-08T19:32:38.289 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.289 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.289 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:38.289 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.733293+0000", 2021-10-08T19:32:38.290 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016554698 2021-10-08T19:32:38.290 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.290 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.290 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:38.291 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.733396+0000", 2021-10-08T19:32:38.291 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103231 2021-10-08T19:32:38.291 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.291 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.292 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:32:38.292 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.739473+0000", 2021-10-08T19:32:38.292 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0060773210000000001 2021-10-08T19:32:38.292 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.292 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.293 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:32:38.293 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.739512+0000", 2021-10-08T19:32:38.293 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8807999999999998e-05 2021-10-08T19:32:38.293 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.293 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.294 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:32:38.294 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.739548+0000", 2021-10-08T19:32:38.294 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.5902000000000003e-05 2021-10-08T19:32:38.294 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:38.295 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:32:38.295 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:38.295 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.295 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.295 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:153648 8.9 8:93d8c490:::benchmark_data_smithi097_144160_object64908:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e266)", 2021-10-08T19:32:38.296 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:30:50.827951+0000", 2021-10-08T19:32:38.296 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 107.08862540200001, 2021-10-08T19:32:38.296 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.91168046999999997, 2021-10-08T19:32:38.296 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:32:38.296 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:32:38.297 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:32:38.297 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:32:38.297 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:32:38.297 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 153648 2021-10-08T19:32:38.297 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.298 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:32:38.298 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.298 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:32:38.298 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.827951+0000", 2021-10-08T19:32:38.299 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:38.299 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.299 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.300 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:32:38.300 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.827951+0000", 2021-10-08T19:32:38.300 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:38.300 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.301 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.301 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:32:38.301 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.827949+0000", 2021-10-08T19:32:38.301 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:32:38.301 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.302 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.302 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:32:38.302 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.827957+0000", 2021-10-08T19:32:38.302 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0469999999999994e-06 2021-10-08T19:32:38.302 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.303 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.303 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:32:38.303 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.827972+0000", 2021-10-08T19:32:38.303 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4276e-05 2021-10-08T19:32:38.303 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.304 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.304 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:32:38.304 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.827979+0000", 2021-10-08T19:32:38.304 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1609999999999997e-06 2021-10-08T19:32:38.304 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.305 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.305 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:38.305 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.828038+0000", 2021-10-08T19:32:38.305 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9636999999999998e-05 2021-10-08T19:32:38.306 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.306 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.306 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for peered", 2021-10-08T19:32:38.306 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.828048+0000", 2021-10-08T19:32:38.306 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.893e-06 2021-10-08T19:32:38.307 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.307 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.307 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:38.307 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.718864+0000", 2021-10-08T19:32:38.307 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.89081596900000004 2021-10-08T19:32:38.308 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.308 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.308 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:32:38.308 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.718947+0000", 2021-10-08T19:32:38.309 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2168000000000003e-05 2021-10-08T19:32:38.309 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.309 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.309 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,3", 2021-10-08T19:32:38.310 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.719021+0000", 2021-10-08T19:32:38.310 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.428e-05 2021-10-08T19:32:38.310 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.310 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.311 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:38.311 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.733357+0000", 2021-10-08T19:32:38.311 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014336385 2021-10-08T19:32:38.311 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.312 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.312 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:38.312 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.733480+0000", 2021-10-08T19:32:38.312 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000122736 2021-10-08T19:32:38.312 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.313 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.313 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:32:38.313 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.739557+0000", 2021-10-08T19:32:38.313 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00607743 2021-10-08T19:32:38.314 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.314 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.314 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:32:38.314 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.739596+0000", 2021-10-08T19:32:38.315 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8164000000000003e-05 2021-10-08T19:32:38.315 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.315 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.315 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:32:38.315 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.739632+0000", 2021-10-08T19:32:38.316 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6329999999999999e-05 2021-10-08T19:32:38.316 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:38.316 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:32:38.316 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:38.317 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.317 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.317 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:153649 8.9 8:98a9f9c0:::benchmark_data_smithi097_144160_object64909:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e266)", 2021-10-08T19:32:38.317 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:30:50.827990+0000", 2021-10-08T19:32:38.317 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 107.088586341, 2021-10-08T19:32:38.318 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.91172655800000002, 2021-10-08T19:32:38.318 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:32:38.318 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:32:38.318 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:32:38.319 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:32:38.319 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:32:38.319 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 153649 2021-10-08T19:32:38.319 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.320 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:32:38.320 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.320 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:32:38.321 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.827990+0000", 2021-10-08T19:32:38.321 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:38.321 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.321 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.322 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:32:38.322 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.827990+0000", 2021-10-08T19:32:38.322 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:38.322 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.322 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.323 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:32:38.323 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.827990+0000", 2021-10-08T19:32:38.323 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:32:38.323 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.323 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.324 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:32:38.324 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.827994+0000", 2021-10-08T19:32:38.324 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.844e-06 2021-10-08T19:32:38.324 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.324 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.325 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:32:38.325 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.828002+0000", 2021-10-08T19:32:38.325 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2810000000000008e-06 2021-10-08T19:32:38.325 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.325 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.326 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:32:38.326 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.828006+0000", 2021-10-08T19:32:38.326 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.6430000000000003e-06 2021-10-08T19:32:38.326 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.327 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.327 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:38.327 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.828083+0000", 2021-10-08T19:32:38.327 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6148000000000003e-05 2021-10-08T19:32:38.327 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.328 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.328 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for peered", 2021-10-08T19:32:38.328 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.828092+0000", 2021-10-08T19:32:38.328 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8169999999999994e-06 2021-10-08T19:32:38.328 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.329 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.329 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:38.329 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.720747+0000", 2021-10-08T19:32:38.329 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.89265469600000003 2021-10-08T19:32:38.330 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.330 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.330 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:32:38.330 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.720870+0000", 2021-10-08T19:32:38.331 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000122843 2021-10-08T19:32:38.331 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.331 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.331 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,3", 2021-10-08T19:32:38.332 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.720980+0000", 2021-10-08T19:32:38.332 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000110103 2021-10-08T19:32:38.332 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.332 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.332 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:38.333 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.733432+0000", 2021-10-08T19:32:38.333 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01245199 2021-10-08T19:32:38.333 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.333 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.334 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:38.334 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.733544+0000", 2021-10-08T19:32:38.334 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112243 2021-10-08T19:32:38.334 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.334 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.335 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:32:38.335 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.739643+0000", 2021-10-08T19:32:38.335 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0060982429999999997 2021-10-08T19:32:38.335 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.335 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.336 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:32:38.336 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.739682+0000", 2021-10-08T19:32:38.336 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9759999999999999e-05 2021-10-08T19:32:38.336 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.337 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.337 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:32:38.337 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.739717+0000", 2021-10-08T19:32:38.337 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4709999999999998e-05 2021-10-08T19:32:38.337 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:38.338 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:32:38.338 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:38.338 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.338 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.339 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:153657 8.9 8:9d6618f9:::benchmark_data_smithi097_144160_object64917:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e266)", 2021-10-08T19:32:38.339 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:30:50.839226+0000", 2021-10-08T19:32:38.339 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 107.07735055099999, 2021-10-08T19:32:38.340 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.90057461699999997, 2021-10-08T19:32:38.340 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:32:38.340 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:32:38.340 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:32:38.341 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:32:38.341 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:32:38.341 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 153657 2021-10-08T19:32:38.341 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.341 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:32:38.342 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.342 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:32:38.342 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.839226+0000", 2021-10-08T19:32:38.342 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:38.342 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.343 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.343 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:32:38.343 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.839226+0000", 2021-10-08T19:32:38.343 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:38.344 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.344 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.344 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:32:38.344 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.839224+0000", 2021-10-08T19:32:38.344 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:32:38.345 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.345 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.345 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:32:38.345 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.839232+0000", 2021-10-08T19:32:38.345 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9400000000000002e-06 2021-10-08T19:32:38.346 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.346 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.346 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:32:38.346 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.839248+0000", 2021-10-08T19:32:38.347 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6282000000000001e-05 2021-10-08T19:32:38.347 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.347 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.347 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:32:38.347 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.839256+0000", 2021-10-08T19:32:38.348 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8879999999999997e-06 2021-10-08T19:32:38.348 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.348 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.348 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:38.349 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.839305+0000", 2021-10-08T19:32:38.349 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8931999999999998e-05 2021-10-08T19:32:38.349 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.349 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.350 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for peered", 2021-10-08T19:32:38.350 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.839311+0000", 2021-10-08T19:32:38.350 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5139999999999998e-06 2021-10-08T19:32:38.350 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.351 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.351 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:38.351 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.723229+0000", 2021-10-08T19:32:38.351 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.883917277 2021-10-08T19:32:38.351 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.352 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.352 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:32:38.352 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.723326+0000", 2021-10-08T19:32:38.352 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7447000000000004e-05 2021-10-08T19:32:38.352 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.353 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.353 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,3", 2021-10-08T19:32:38.353 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.723434+0000", 2021-10-08T19:32:38.353 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010813499999999999 2021-10-08T19:32:38.354 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.354 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.354 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:38.354 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.733511+0000", 2021-10-08T19:32:38.354 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010076754 2021-10-08T19:32:38.355 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.355 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.355 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:38.355 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.733617+0000", 2021-10-08T19:32:38.355 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010569 2021-10-08T19:32:38.356 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.356 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.356 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:32:38.356 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.739728+0000", 2021-10-08T19:32:38.356 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0061108589999999997 2021-10-08T19:32:38.357 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.357 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.357 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:32:38.357 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.739766+0000", 2021-10-08T19:32:38.358 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8075999999999999e-05 2021-10-08T19:32:38.358 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.358 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.358 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:32:38.359 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.739801+0000", 2021-10-08T19:32:38.359 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.5222999999999998e-05 2021-10-08T19:32:38.359 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:38.359 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:32:38.360 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:38.360 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.360 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.361 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:153683 8.9 8:911724a8:::benchmark_data_smithi097_144160_object64943:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e266)", 2021-10-08T19:32:38.361 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:30:50.880164+0000", 2021-10-08T19:32:38.361 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 107.036412744, 2021-10-08T19:32:38.361 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.859722188, 2021-10-08T19:32:38.361 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:32:38.362 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:32:38.362 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:32:38.362 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:32:38.362 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:32:38.362 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 153683 2021-10-08T19:32:38.363 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.363 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:32:38.363 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.363 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:32:38.364 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.880164+0000", 2021-10-08T19:32:38.364 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:38.364 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.364 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.364 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:32:38.365 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.880164+0000", 2021-10-08T19:32:38.365 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:38.365 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.365 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.365 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:32:38.366 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.880162+0000", 2021-10-08T19:32:38.366 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:32:38.366 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.366 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.367 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:32:38.367 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.880171+0000", 2021-10-08T19:32:38.367 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.2799999999999992e-06 2021-10-08T19:32:38.367 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.367 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.368 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:32:38.368 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.880187+0000", 2021-10-08T19:32:38.368 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6427999999999999e-05 2021-10-08T19:32:38.368 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.368 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.369 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:32:38.369 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.880195+0000", 2021-10-08T19:32:38.369 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4050000000000003e-06 2021-10-08T19:32:38.370 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.370 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.370 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:38.370 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.880238+0000", 2021-10-08T19:32:38.371 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.3414000000000001e-05 2021-10-08T19:32:38.371 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.371 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.371 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for peered", 2021-10-08T19:32:38.372 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.880247+0000", 2021-10-08T19:32:38.372 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6570000000000003e-06 2021-10-08T19:32:38.372 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.372 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.373 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:38.373 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.725736+0000", 2021-10-08T19:32:38.373 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.84548944599999998 2021-10-08T19:32:38.373 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.374 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.374 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:32:38.374 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.725839+0000", 2021-10-08T19:32:38.374 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103015 2021-10-08T19:32:38.375 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.375 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.375 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,3", 2021-10-08T19:32:38.375 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.725953+0000", 2021-10-08T19:32:38.376 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000113774 2021-10-08T19:32:38.376 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.376 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.376 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:38.377 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.733583+0000", 2021-10-08T19:32:38.377 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0076303719999999998 2021-10-08T19:32:38.377 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.377 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.377 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:38.378 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.733681+0000", 2021-10-08T19:32:38.378 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7734999999999999e-05 2021-10-08T19:32:38.378 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.379 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.379 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:32:38.379 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.739812+0000", 2021-10-08T19:32:38.379 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0061307749999999998 2021-10-08T19:32:38.380 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.380 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.380 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:32:38.380 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.739851+0000", 2021-10-08T19:32:38.381 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8742999999999998e-05 2021-10-08T19:32:38.381 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:38.381 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:38.381 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:32:38.382 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.739886+0000", 2021-10-08T19:32:38.382 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.5618999999999999e-05 2021-10-08T19:32:38.382 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:38.382 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:32:38.383 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:38.383 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:38.383 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:32:38.383 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:32:38.384 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:38.385 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:32:38.385 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:32:38.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:38 smithi117 ceph-mon[34585]: pgmap v573: 178 pgs: 178 active+clean; 4.4 GiB data, 15 GiB used, 701 GiB / 715 GiB avail; 1022 B/s rd, 71 MiB/s wr, 1.14k op/s 2021-10-08T19:32:38.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:38 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:32:38.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:38 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:32:38.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:38 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:32:38.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:38 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:32:38.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:38 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:32:38.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:38 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:32:38.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:38 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:32:38.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:38 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:32:38.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:38 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:32:38.409 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:38 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:32:38.409 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:38 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:32:38.409 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:38 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:32:38.409 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:38 smithi117 ceph-mon[34585]: Adjusting osd_memory_target on smithi117 to 3013M 2021-10-08T19:32:38.410 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:38 smithi117 ceph-mon[34585]: Adjusting osd_memory_target on smithi097 to 3013M 2021-10-08T19:32:38.410 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:38 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:32:38.410 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:38 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:32:38.411 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:38 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:32:38.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:38 smithi097 ceph-mon[32687]: pgmap v573: 178 pgs: 178 active+clean; 4.4 GiB data, 15 GiB used, 701 GiB / 715 GiB avail; 1022 B/s rd, 71 MiB/s wr, 1.14k op/s 2021-10-08T19:32:38.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:38 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:32:38.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:38 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:32:38.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:38 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:32:38.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:38 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:32:38.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:38 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:32:38.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:38 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:32:38.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:38 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:32:38.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:38 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:32:38.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:38 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:32:38.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:38 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:32:38.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:38 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:32:38.474 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:38 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:32:38.475 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:38 smithi097 ceph-mon[32687]: Adjusting osd_memory_target on smithi117 to 3013M 2021-10-08T19:32:38.476 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:38 smithi097 ceph-mon[32687]: Adjusting osd_memory_target on smithi097 to 3013M 2021-10-08T19:32:38.476 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:38 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:32:38.477 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:38 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:32:38.477 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:38 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:32:38.478 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:38 smithi097 ceph-mon[41966]: pgmap v573: 178 pgs: 178 active+clean; 4.4 GiB data, 15 GiB used, 701 GiB / 715 GiB avail; 1022 B/s rd, 71 MiB/s wr, 1.14k op/s 2021-10-08T19:32:38.478 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:38 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:32:38.479 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:38 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:32:38.479 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:38 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:32:38.479 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:38 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:32:38.480 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:38 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:32:38.480 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:38 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:32:38.481 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:38 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:32:38.481 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:38 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:32:38.481 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:38 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:32:38.482 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:38 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:32:38.482 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:38 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:32:38.483 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:38 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:32:38.483 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:38 smithi097 ceph-mon[41966]: Adjusting osd_memory_target on smithi117 to 3013M 2021-10-08T19:32:38.483 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:38 smithi097 ceph-mon[41966]: Adjusting osd_memory_target on smithi097 to 3013M 2021-10-08T19:32:38.484 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:38 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:32:38.484 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:38 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:32:38.485 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:38 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:32:38.486 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:32:38.511 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:38.684 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset nodeep-scrub 2021-10-08T19:32:38.851 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 55 16 77869 77853 88.4317 62.625 0.0185963 0.0113027 2021-10-08T19:32:38.997 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2021-10-08T19:32:39.237 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:32:39.243 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:39.244 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:32:39.345 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:32:39.392 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:39 smithi117 ceph-mon[34585]: from='client.15591 v1:172.21.15.97:0/4175060575' entity='client.admin' cmd=[{"prefix": "osd test-reweight-by-utilization", "oload": 1000, "max_change": 0.05, "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:32:39.393 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:39 smithi117 ceph-mon[34585]: 6.15 scrub ok 2021-10-08T19:32:39.393 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:39 smithi117 ceph-mon[34585]: 5.12 scrub ok 2021-10-08T19:32:39.393 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:39 smithi117 ceph-mon[34585]: 2.0 scrub ok 2021-10-08T19:32:39.394 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:39 smithi117 ceph-mon[34585]: 5.1f scrub ok 2021-10-08T19:32:39.401 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:39.452 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:32:39.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:39 smithi097 ceph-mon[41966]: from='client.15591 v1:172.21.15.97:0/4175060575' entity='client.admin' cmd=[{"prefix": "osd test-reweight-by-utilization", "oload": 1000, "max_change": 0.05, "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:32:39.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:39 smithi097 ceph-mon[41966]: 6.15 scrub ok 2021-10-08T19:32:39.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:39 smithi097 ceph-mon[41966]: 5.12 scrub ok 2021-10-08T19:32:39.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:39 smithi097 ceph-mon[41966]: 2.0 scrub ok 2021-10-08T19:32:39.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:39 smithi097 ceph-mon[41966]: 5.1f scrub ok 2021-10-08T19:32:39.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:39 smithi097 ceph-mon[32687]: from='client.15591 v1:172.21.15.97:0/4175060575' entity='client.admin' cmd=[{"prefix": "osd test-reweight-by-utilization", "oload": 1000, "max_change": 0.05, "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:32:39.474 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:39 smithi097 ceph-mon[32687]: 6.15 scrub ok 2021-10-08T19:32:39.474 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:39 smithi097 ceph-mon[32687]: 5.12 scrub ok 2021-10-08T19:32:39.475 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:39 smithi097 ceph-mon[32687]: 2.0 scrub ok 2021-10-08T19:32:39.475 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:39 smithi097 ceph-mon[32687]: 5.1f scrub ok 2021-10-08T19:32:39.483 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:32:39.487 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:39.487 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:32:39.588 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:32:39.645 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:39.658 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2021-10-08T19:32:39.659 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd test-reweight-by-utilization 110 1.0 2021-10-08T19:32:39.676 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:32:39.750 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:32:39.758 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:39.759 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:32:39.852 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 56 16 78950 78934 88.0533 67.5625 0.0215051 0.0113514 2021-10-08T19:32:39.863 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:32:39.954 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:40.216 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:32:40.223 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:40.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:40 smithi097 ceph-mon[32687]: pgmap v574: 178 pgs: 178 active+clean; 4.6 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 70 MiB/s wr, 1.11k op/s 2021-10-08T19:32:40.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:40 smithi097 ceph-mon[32687]: 4.14 scrub ok 2021-10-08T19:32:40.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:40 smithi097 ceph-mon[32687]: 5.6 scrub ok 2021-10-08T19:32:40.225 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:40 smithi097 ceph-mon[41966]: pgmap v574: 178 pgs: 178 active+clean; 4.6 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 70 MiB/s wr, 1.11k op/s 2021-10-08T19:32:40.225 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:40 smithi097 ceph-mon[41966]: 4.14 scrub ok 2021-10-08T19:32:40.225 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:40 smithi097 ceph-mon[41966]: 5.6 scrub ok 2021-10-08T19:32:40.226 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:32:40.307 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:32:40.328 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:32:40.350 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:32:40.389 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:32:40.394 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:40.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:40 smithi117 ceph-mon[34585]: pgmap v574: 178 pgs: 178 active+clean; 4.6 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 70 MiB/s wr, 1.11k op/s 2021-10-08T19:32:40.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:40 smithi117 ceph-mon[34585]: 4.14 scrub ok 2021-10-08T19:32:40.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:40 smithi117 ceph-mon[34585]: 5.6 scrub ok 2021-10-08T19:32:40.426 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:32:40.463 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:32:40.489 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:32:40.501 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:40.502 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:32:40.502 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:32:40.540 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:32:40.581 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:32:40.592 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'false' 2021-10-08T19:32:40.592 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'false' 2021-10-08T19:32:40.593 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'false' 2021-10-08T19:32:40.593 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'false' 2021-10-08T19:32:40.593 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'false' 2021-10-08T19:32:40.593 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'false' 2021-10-08T19:32:40.593 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'false' 2021-10-08T19:32:40.594 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'false' 2021-10-08T19:32:40.603 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:32:40.658 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:40.852 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 57 16 79878 79862 87.5262 58 0.011826 0.0114202 2021-10-08T19:32:40.858 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:32:41.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:41 smithi117 ceph-mon[34585]: 3.8 scrub ok 2021-10-08T19:32:41.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:41 smithi117 ceph-mon[34585]: 3.15 scrub ok 2021-10-08T19:32:41.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:41 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3939911393' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:32:41.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:41 smithi117 ceph-mon[34585]: 3.10 scrub ok 2021-10-08T19:32:41.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:41 smithi097 ceph-mon[41966]: 3.8 scrub ok 2021-10-08T19:32:41.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:41 smithi097 ceph-mon[41966]: 3.15 scrub ok 2021-10-08T19:32:41.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:41 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3939911393' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:32:41.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:41 smithi097 ceph-mon[41966]: 3.10 scrub ok 2021-10-08T19:32:41.474 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:41 smithi097 ceph-mon[32687]: 3.8 scrub ok 2021-10-08T19:32:41.474 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:41 smithi097 ceph-mon[32687]: 3.15 scrub ok 2021-10-08T19:32:41.474 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:41 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3939911393' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:32:41.475 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:41 smithi097 ceph-mon[32687]: 3.10 scrub ok 2021-10-08T19:32:41.852 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 58 16 81070 81054 87.3016 74.5 0.0120024 0.0114505 2021-10-08T19:32:41.862 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2021-10-08T19:32:41.863 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:32:42.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:42 smithi117 ceph-mon[34585]: 6.1e scrub ok 2021-10-08T19:32:42.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:42 smithi117 ceph-mon[34585]: pgmap v575: 178 pgs: 178 active+clean; 4.8 GiB data, 16 GiB used, 700 GiB / 715 GiB avail; 66 MiB/s wr, 1.06k op/s 2021-10-08T19:32:42.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:42 smithi117 ceph-mon[34585]: 3.2 scrub ok 2021-10-08T19:32:42.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:42 smithi117 ceph-mon[34585]: 6.a scrub ok 2021-10-08T19:32:42.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:42 smithi117 ceph-mon[34585]: 2.e scrub ok 2021-10-08T19:32:42.160 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:32:42.164 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:42.165 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:32:42.266 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:32:42.314 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:42.398 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:32:42.402 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:42.403 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:32:42.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:42 smithi097 ceph-mon[41966]: 6.1e scrub ok 2021-10-08T19:32:42.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:42 smithi097 ceph-mon[41966]: pgmap v575: 178 pgs: 178 active+clean; 4.8 GiB data, 16 GiB used, 700 GiB / 715 GiB avail; 66 MiB/s wr, 1.06k op/s 2021-10-08T19:32:42.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:42 smithi097 ceph-mon[41966]: 3.2 scrub ok 2021-10-08T19:32:42.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:42 smithi097 ceph-mon[41966]: 6.a scrub ok 2021-10-08T19:32:42.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:42 smithi097 ceph-mon[41966]: 2.e scrub ok 2021-10-08T19:32:42.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:42 smithi097 ceph-mon[32687]: 6.1e scrub ok 2021-10-08T19:32:42.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:42 smithi097 ceph-mon[32687]: pgmap v575: 178 pgs: 178 active+clean; 4.8 GiB data, 16 GiB used, 700 GiB / 715 GiB avail; 66 MiB/s wr, 1.06k op/s 2021-10-08T19:32:42.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:42 smithi097 ceph-mon[32687]: 3.2 scrub ok 2021-10-08T19:32:42.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:42 smithi097 ceph-mon[32687]: 6.a scrub ok 2021-10-08T19:32:42.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:42 smithi097 ceph-mon[32687]: 2.e scrub ok 2021-10-08T19:32:42.504 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:32:42.533 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:42.743 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:32:42 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:32:42] "GET /metrics HTTP/1.1" 200 155793 "" "Prometheus/2.18.1" 2021-10-08T19:32:42.797 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:32:42.800 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:42.801 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:32:42.853 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 59 16 82168 82152 86.9843 68.625 0.00966382 0.011491 2021-10-08T19:32:42.886 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2021-10-08T19:32:42.902 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:32:42.967 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:43.107 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:43 smithi117 ceph-mon[34585]: 3.7 scrub ok 2021-10-08T19:32:43.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:43 smithi117 ceph-mon[34585]: 6.5 scrub ok 2021-10-08T19:32:43.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:32:43.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:43 smithi117 ceph-mon[34585]: 2.6 scrub ok 2021-10-08T19:32:43.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:43 smithi117 ceph-mon[34585]: 4.a scrub ok 2021-10-08T19:32:43.160 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:32:43.161 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:43 smithi097 ceph-mon[32687]: 3.7 scrub ok 2021-10-08T19:32:43.161 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:43 smithi097 ceph-mon[32687]: 6.5 scrub ok 2021-10-08T19:32:43.161 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:32:43.162 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:43 smithi097 ceph-mon[32687]: 2.6 scrub ok 2021-10-08T19:32:43.162 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:43 smithi097 ceph-mon[32687]: 4.a scrub ok 2021-10-08T19:32:43.163 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:32:43.163 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:43 smithi097 ceph-mon[41966]: 3.7 scrub ok 2021-10-08T19:32:43.164 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:43 smithi097 ceph-mon[41966]: 6.5 scrub ok 2021-10-08T19:32:43.164 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:32:43.164 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:43 smithi097 ceph-mon[41966]: 2.6 scrub ok 2021-10-08T19:32:43.165 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:43 smithi097 ceph-mon[41966]: 4.a scrub ok 2021-10-08T19:32:43.165 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:32:43.283 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:32:43.326 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:32:43.328 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:43.329 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:32:43.429 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:32:43.473 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:43.617 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:32:43.622 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:43.623 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:32:43.724 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:32:43.768 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:43.853 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:2021-10-08T19:32:43.853004+0000 min lat: 0.00118067 max lat: 3.10418 avg lat: 0.0115335 2021-10-08T19:32:43.853 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2021-10-08T19:32:43.854 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 60 16 83260 83244 86.6721 68.25 0.0182467 0.0115335 2021-10-08T19:32:44.030 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:32:44.035 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:44.036 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:32:44.138 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:32:44.145 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is unset 2021-10-08T19:32:44.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:44 smithi117 ceph-mon[34585]: pgmap v576: 178 pgs: 178 active+clean; 4.8 GiB data, 16 GiB used, 700 GiB / 715 GiB avail; 66 MiB/s wr, 1.06k op/s 2021-10-08T19:32:44.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:44 smithi117 ceph-mon[34585]: 2.3 scrub ok 2021-10-08T19:32:44.160 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:44 smithi117 ceph-mon[34585]: 6.18 scrub ok 2021-10-08T19:32:44.160 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:44 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2812091188' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:32:44.160 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:44 smithi117 ceph-mon[34585]: 6.1d scrub ok 2021-10-08T19:32:44.160 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:44 smithi117 ceph-mon[34585]: 2.1a scrub ok 2021-10-08T19:32:44.160 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:44 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-10-08T19:32:44.161 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:44 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-10-08T19:32:44.161 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:44 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-10-08T19:32:44.161 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:32:43 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:32:43] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:32:44.190 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:44.331 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2021-10-08T19:32:44.382 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:44 smithi097 ceph-mon[32687]: pgmap v576: 178 pgs: 178 active+clean; 4.8 GiB data, 16 GiB used, 700 GiB / 715 GiB avail; 66 MiB/s wr, 1.06k op/s 2021-10-08T19:32:44.383 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:44 smithi097 ceph-mon[32687]: 2.3 scrub ok 2021-10-08T19:32:44.383 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:44 smithi097 ceph-mon[32687]: 6.18 scrub ok 2021-10-08T19:32:44.383 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:44 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2812091188' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:32:44.383 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:44 smithi097 ceph-mon[32687]: 6.1d scrub ok 2021-10-08T19:32:44.384 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:44 smithi097 ceph-mon[32687]: 2.1a scrub ok 2021-10-08T19:32:44.384 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:44 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-10-08T19:32:44.385 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:44 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-10-08T19:32:44.385 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:44 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-10-08T19:32:44.386 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:44 smithi097 ceph-mon[41966]: pgmap v576: 178 pgs: 178 active+clean; 4.8 GiB data, 16 GiB used, 700 GiB / 715 GiB avail; 66 MiB/s wr, 1.06k op/s 2021-10-08T19:32:44.386 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:44 smithi097 ceph-mon[41966]: 2.3 scrub ok 2021-10-08T19:32:44.386 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:44 smithi097 ceph-mon[41966]: 6.18 scrub ok 2021-10-08T19:32:44.386 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:44 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2812091188' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:32:44.387 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:44 smithi097 ceph-mon[41966]: 6.1d scrub ok 2021-10-08T19:32:44.387 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:44 smithi097 ceph-mon[41966]: 2.1a scrub ok 2021-10-08T19:32:44.387 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:44 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-10-08T19:32:44.387 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:44 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-10-08T19:32:44.388 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:44 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-10-08T19:32:44.694 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:32:44.699 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:44.700 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:32:44.802 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:32:44.851 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:44.853 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 61 16 84340 84324 86.3578 67.5 0.00645824 0.0115751 2021-10-08T19:32:45.098 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:32:45.106 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:45.107 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:32:45.209 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:32:45.265 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:45.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:45 smithi117 ceph-mon[34585]: 4.c scrub ok 2021-10-08T19:32:45.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:45 smithi117 ceph-mon[34585]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:32:45.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:45 smithi117 ceph-mon[34585]: Cluster is now healthy 2021-10-08T19:32:45.409 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:45 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2812091188' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:32:45.409 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:45 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]': finished 2021-10-08T19:32:45.409 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:45 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]': finished 2021-10-08T19:32:45.409 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:45 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]': finished 2021-10-08T19:32:45.410 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:45 smithi117 ceph-mon[34585]: osdmap e317: 8 total, 8 up, 8 in 2021-10-08T19:32:45.410 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:45 smithi117 ceph-mon[34585]: 2.c scrub ok 2021-10-08T19:32:45.426 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:45 smithi097 ceph-mon[41966]: 4.c scrub ok 2021-10-08T19:32:45.427 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:45 smithi097 ceph-mon[41966]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:32:45.427 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:45 smithi097 ceph-mon[41966]: Cluster is now healthy 2021-10-08T19:32:45.427 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:45 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2812091188' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:32:45.427 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:45 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]': finished 2021-10-08T19:32:45.428 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:45 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]': finished 2021-10-08T19:32:45.428 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:45 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]': finished 2021-10-08T19:32:45.428 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:45 smithi097 ceph-mon[41966]: osdmap e317: 8 total, 8 up, 8 in 2021-10-08T19:32:45.428 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:45 smithi097 ceph-mon[41966]: 2.c scrub ok 2021-10-08T19:32:45.429 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:45 smithi097 ceph-mon[32687]: 4.c scrub ok 2021-10-08T19:32:45.429 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:45 smithi097 ceph-mon[32687]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:32:45.430 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:45 smithi097 ceph-mon[32687]: Cluster is now healthy 2021-10-08T19:32:45.430 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:45 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2812091188' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:32:45.430 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:45 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]': finished 2021-10-08T19:32:45.430 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:45 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]': finished 2021-10-08T19:32:45.431 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:45 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]': finished 2021-10-08T19:32:45.431 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:45 smithi097 ceph-mon[32687]: osdmap e317: 8 total, 8 up, 8 in 2021-10-08T19:32:45.431 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:45 smithi097 ceph-mon[32687]: 2.c scrub ok 2021-10-08T19:32:45.485 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:32:45.486 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:45.492 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:32:45.594 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:32:45.658 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:45.659 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2021-10-08T19:32:45.659 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:32:45.679 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:32:45.855 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 62 16 85311 85295 85.9425 60.6875 0.0114891 0.0116304 2021-10-08T19:32:45.865 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:32:45.870 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:45.871 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:32:45.973 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:32:46.015 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:46.059 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:32:46.061 INFO:teuthology.orchestra.run.smithi097.stdout:moved 85 / 534 (15.9176%) 2021-10-08T19:32:46.062 INFO:teuthology.orchestra.run.smithi097.stdout:avg 66.75 2021-10-08T19:32:46.062 INFO:teuthology.orchestra.run.smithi097.stdout:stddev 8.1968 -> 8.21203 (expected baseline 7.6424) 2021-10-08T19:32:46.062 INFO:teuthology.orchestra.run.smithi097.stdout:min osd.2 with 53 -> 69 pgs (0.794007 -> 1.03371 * mean) 2021-10-08T19:32:46.062 INFO:teuthology.orchestra.run.smithi097.stdout:max osd.7 with 80 -> 55 pgs (1.1985 -> 0.82397 * mean) 2021-10-08T19:32:46.062 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:32:46.063 INFO:teuthology.orchestra.run.smithi097.stdout:oload 110 2021-10-08T19:32:46.063 INFO:teuthology.orchestra.run.smithi097.stdout:max_change 1 2021-10-08T19:32:46.063 INFO:teuthology.orchestra.run.smithi097.stdout:max_change_osds 4 2021-10-08T19:32:46.063 INFO:teuthology.orchestra.run.smithi097.stdout:average_utilization 0.0232 2021-10-08T19:32:46.064 INFO:teuthology.orchestra.run.smithi097.stdout:overload_utilization 0.0256 2021-10-08T19:32:46.064 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1 weight 1.0000 -> 0.6758 2021-10-08T19:32:46.064 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5 weight 1.0000 -> 0.6901 2021-10-08T19:32:46.064 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7 weight 1.0000 -> 0.6973 2021-10-08T19:32:46.064 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3 weight 1.0000 -> 0.7453 2021-10-08T19:32:46.066 INFO:teuthology.orchestra.run.smithi097.stderr:no change 2021-10-08T19:32:46.068 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:46.068 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:32:46.127 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:32:46 smithi097 conmon[33110]: 2021-10-08T19:32:46.059+0000 7f26c6999700 -1 mgr.server reply reply (4) Interrupted system call no change 2021-10-08T19:32:46.170 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:32:46.207 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:46.271 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:32:46.274 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:46.275 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:32:46.276 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:46 smithi117 ceph-mon[34585]: 5.e scrub ok 2021-10-08T19:32:46.276 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:46 smithi117 ceph-mon[34585]: pgmap v578: 178 pgs: 178 active+clean; 5.1 GiB data, 17 GiB used, 699 GiB / 715 GiB avail; 66 MiB/s wr, 1.05k op/s 2021-10-08T19:32:46.276 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:46 smithi117 ceph-mon[34585]: 2.18 scrub ok 2021-10-08T19:32:46.276 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:46 smithi117 ceph-mon[34585]: 6.9 scrub ok 2021-10-08T19:32:46.277 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:46 smithi117 ceph-mon[34585]: 1.9 scrub ok 2021-10-08T19:32:46.277 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:46 smithi117 ceph-mon[34585]: osdmap e318: 8 total, 8 up, 8 in 2021-10-08T19:32:46.376 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:32:46.427 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:46 smithi097 ceph-mon[32687]: 5.e scrub ok 2021-10-08T19:32:46.427 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:46 smithi097 ceph-mon[32687]: pgmap v578: 178 pgs: 178 active+clean; 5.1 GiB data, 17 GiB used, 699 GiB / 715 GiB avail; 66 MiB/s wr, 1.05k op/s 2021-10-08T19:32:46.427 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:46 smithi097 ceph-mon[32687]: 2.18 scrub ok 2021-10-08T19:32:46.428 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:46 smithi097 ceph-mon[32687]: 6.9 scrub ok 2021-10-08T19:32:46.428 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:46 smithi097 ceph-mon[32687]: 1.9 scrub ok 2021-10-08T19:32:46.428 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:46 smithi097 ceph-mon[32687]: osdmap e318: 8 total, 8 up, 8 in 2021-10-08T19:32:46.429 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:46 smithi097 ceph-mon[41966]: 5.e scrub ok 2021-10-08T19:32:46.429 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:46 smithi097 ceph-mon[41966]: pgmap v578: 178 pgs: 178 active+clean; 5.1 GiB data, 17 GiB used, 699 GiB / 715 GiB avail; 66 MiB/s wr, 1.05k op/s 2021-10-08T19:32:46.429 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:46 smithi097 ceph-mon[41966]: 2.18 scrub ok 2021-10-08T19:32:46.429 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:46 smithi097 ceph-mon[41966]: 6.9 scrub ok 2021-10-08T19:32:46.430 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:46 smithi097 ceph-mon[41966]: 1.9 scrub ok 2021-10-08T19:32:46.430 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:46 smithi097 ceph-mon[41966]: osdmap e318: 8 total, 8 up, 8 in 2021-10-08T19:32:46.431 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:46.685 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2021-10-08T19:32:46.854 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 63 16 86329 86313 85.5882 63.625 0.0126775 0.0116794 2021-10-08T19:32:47.114 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:32:47.157 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:32:46 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:32:47.170 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:47 smithi097 ceph-mon[32687]: from='client.35573 v1:172.21.15.97:0/1109113' entity='client.admin' cmd=[{"prefix": "osd test-reweight-by-utilization", "oload": 110, "max_change": 1.0, "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:32:47.170 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:47 smithi097 ceph-mon[32687]: 2.1d scrub ok 2021-10-08T19:32:47.171 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:47 smithi097 ceph-mon[32687]: 4.12 deep-scrub ok 2021-10-08T19:32:47.171 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:47 smithi097 ceph-mon[32687]: 1.4 scrub ok 2021-10-08T19:32:47.171 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:47 smithi097 ceph-mon[41966]: from='client.35573 v1:172.21.15.97:0/1109113' entity='client.admin' cmd=[{"prefix": "osd test-reweight-by-utilization", "oload": 110, "max_change": 1.0, "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:32:47.171 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:47 smithi097 ceph-mon[41966]: 2.1d scrub ok 2021-10-08T19:32:47.172 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:47 smithi097 ceph-mon[41966]: 4.12 deep-scrub ok 2021-10-08T19:32:47.172 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:47 smithi097 ceph-mon[41966]: 1.4 scrub ok 2021-10-08T19:32:47.216 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:32:47.219 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:47.219 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:32:47.321 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:32:47.370 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '1000', 'type': 'reweight-by-utilization'} 2021-10-08T19:32:47.371 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd reweight-by-utilization 1000 0.05 2021-10-08T19:32:47.376 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:47.448 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:47 smithi117 ceph-mon[34585]: from='client.35573 v1:172.21.15.97:0/1109113' entity='client.admin' cmd=[{"prefix": "osd test-reweight-by-utilization", "oload": 110, "max_change": 1.0, "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:32:47.448 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:47 smithi117 ceph-mon[34585]: 2.1d scrub ok 2021-10-08T19:32:47.449 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:47 smithi117 ceph-mon[34585]: 4.12 deep-scrub ok 2021-10-08T19:32:47.450 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:47 smithi117 ceph-mon[34585]: 1.4 scrub ok 2021-10-08T19:32:47.493 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set noscrub 2021-10-08T19:32:47.576 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:32:47.595 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:47.596 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:32:47.697 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:32:47.759 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:47.856 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 64 16 87433 87417 85.3264 69 0.0262533 0.0117153 2021-10-08T19:32:47.971 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:32:47 smithi097 conmon[33110]: 172.21.15.97 - - [08/Oct/2021:19:32:47] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:32:48.078 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:32:48.087 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:48.088 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:32:48.189 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:32:48.230 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:32:48.245 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:48.285 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:32:48.458 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:32:48.461 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:48.462 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:32:48.463 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:48 smithi097 ceph-mon[41966]: pgmap v580: 178 pgs: 178 active+clean; 5.1 GiB data, 17 GiB used, 699 GiB / 715 GiB avail; 639 B/s rd, 64 MiB/s wr, 1.02k op/s 2021-10-08T19:32:48.464 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:48 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:32:48.464 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:48 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:32:48.465 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:48 smithi097 ceph-mon[32687]: pgmap v580: 178 pgs: 178 active+clean; 5.1 GiB data, 17 GiB used, 699 GiB / 715 GiB avail; 639 B/s rd, 64 MiB/s wr, 1.02k op/s 2021-10-08T19:32:48.465 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:48 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:32:48.465 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:48 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:32:48.563 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:32:48.599 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:48 smithi117 ceph-mon[34585]: pgmap v580: 178 pgs: 178 active+clean; 5.1 GiB data, 17 GiB used, 699 GiB / 715 GiB avail; 639 B/s rd, 64 MiB/s wr, 1.02k op/s 2021-10-08T19:32:48.600 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:48 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:32:48.600 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:48 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:32:48.605 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:48.827 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:32:48.831 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:48.832 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:32:48.857 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 65 16 88516 88500 85.055 67.6875 0.0121889 0.0117521 2021-10-08T19:32:48.933 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:32:49.000 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:49.032 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:32:49.082 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:32:49.126 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:32:49.162 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:32:49.217 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:32:49.236 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:32:49.266 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:32:49.298 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:49 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:32:49.299 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:49 smithi097 ceph-mon[41966]: 172.21.15.97 - - [08/Oct/2021:19:32:47] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:32:49.299 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:49 smithi097 ceph-mon[41966]: 3.12 scrub ok 2021-10-08T19:32:49.299 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:49 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1399907829' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:32:49.300 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:49 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:32:49.300 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:49 smithi097 ceph-mon[32687]: 172.21.15.97 - - [08/Oct/2021:19:32:47] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:32:49.300 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:49 smithi097 ceph-mon[32687]: 3.12 scrub ok 2021-10-08T19:32:49.300 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:49 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1399907829' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:32:49.306 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:32:49.328 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true' 2021-10-08T19:32:49.328 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true' 2021-10-08T19:32:49.329 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true' 2021-10-08T19:32:49.329 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true' 2021-10-08T19:32:49.329 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true' 2021-10-08T19:32:49.329 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true' 2021-10-08T19:32:49.330 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'true' 2021-10-08T19:32:49.330 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'true' 2021-10-08T19:32:49.553 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:32:49.553 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2021-10-08T19:32:49.553 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2021-10-08T19:32:49.554 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2021-10-08T19:32:49.554 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.554 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:58808 7.5 7:a1085e60:::benchmark_data_smithi097_93198_object58807:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2021-10-08T19:32:49.554 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:24:38.371815+0000", 2021-10-08T19:32:49.555 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 491.16535935000002, 2021-10-08T19:32:49.555 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.20002783099999999, 2021-10-08T19:32:49.555 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:32:49.555 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:32:49.555 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:32:49.556 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:32:49.556 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:32:49.556 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 58808 2021-10-08T19:32:49.556 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.556 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:32:49.557 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.557 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:32:49.557 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.371815+0000", 2021-10-08T19:32:49.557 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:49.558 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.558 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.558 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:32:49.558 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.371815+0000", 2021-10-08T19:32:49.558 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:49.559 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.559 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.559 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:32:49.559 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.371813+0000", 2021-10-08T19:32:49.560 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:32:49.560 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.560 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.560 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:32:49.560 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.371875+0000", 2021-10-08T19:32:49.561 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2535999999999999e-05 2021-10-08T19:32:49.561 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.561 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.562 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:32:49.562 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.371892+0000", 2021-10-08T19:32:49.562 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6572999999999999e-05 2021-10-08T19:32:49.562 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.562 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.563 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:32:49.563 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.371898+0000", 2021-10-08T19:32:49.563 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8889999999999999e-06 2021-10-08T19:32:49.563 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.564 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.564 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:49.564 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.371942+0000", 2021-10-08T19:32:49.564 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4478999999999999e-05 2021-10-08T19:32:49.564 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.565 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.565 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:32:49.565 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.372100+0000", 2021-10-08T19:32:49.565 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000157773 2021-10-08T19:32:49.565 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.566 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.566 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:32:49.566 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.372269+0000", 2021-10-08T19:32:49.566 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016882600000000001 2021-10-08T19:32:49.567 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.567 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.567 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:32:49.567 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.373814+0000", 2021-10-08T19:32:49.567 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0015447289999999999 2021-10-08T19:32:49.568 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.568 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.568 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:49.568 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.374394+0000", 2021-10-08T19:32:49.568 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00058025700000000004 2021-10-08T19:32:49.570 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.571 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.571 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:49.571 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.571758+0000", 2021-10-08T19:32:49.572 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.197364067 2021-10-08T19:32:49.572 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.572 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.572 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:32:49.572 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.571800+0000", 2021-10-08T19:32:49.573 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2485999999999999e-05 2021-10-08T19:32:49.573 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.573 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.574 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:32:49.574 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.571843+0000", 2021-10-08T19:32:49.574 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2262000000000003e-05 2021-10-08T19:32:49.575 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:49.575 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:32:49.575 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:49.575 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.575 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.576 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:58811 7.5 7:a85e4a63:::benchmark_data_smithi097_93198_object58810:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2021-10-08T19:32:49.576 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:24:38.380261+0000", 2021-10-08T19:32:49.576 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 491.15691305799999, 2021-10-08T19:32:49.576 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.19467627000000001, 2021-10-08T19:32:49.576 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:32:49.577 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:32:49.577 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:32:49.577 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:32:49.577 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:32:49.578 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 58811 2021-10-08T19:32:49.578 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.578 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:32:49.578 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.578 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:32:49.579 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.380261+0000", 2021-10-08T19:32:49.579 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:49.579 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.579 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.580 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:32:49.580 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.380261+0000", 2021-10-08T19:32:49.580 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:49.580 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.580 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.581 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:32:49.581 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.380259+0000", 2021-10-08T19:32:49.581 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:32:49.581 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.582 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.582 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:32:49.582 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.380321+0000", 2021-10-08T19:32:49.583 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1908000000000004e-05 2021-10-08T19:32:49.583 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.583 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.584 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:32:49.584 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.380337+0000", 2021-10-08T19:32:49.584 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6356000000000001e-05 2021-10-08T19:32:49.585 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.585 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.585 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:32:49.585 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.380345+0000", 2021-10-08T19:32:49.585 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6830000000000008e-06 2021-10-08T19:32:49.586 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.586 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.586 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:49.586 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.380401+0000", 2021-10-08T19:32:49.587 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6042999999999999e-05 2021-10-08T19:32:49.587 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.587 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.587 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:32:49.587 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.380549+0000", 2021-10-08T19:32:49.588 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014829399999999999 2021-10-08T19:32:49.588 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.588 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.588 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:32:49.589 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.380726+0000", 2021-10-08T19:32:49.589 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000177422 2021-10-08T19:32:49.589 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.589 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.589 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:32:49.590 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.384478+0000", 2021-10-08T19:32:49.590 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0037511739999999999 2021-10-08T19:32:49.591 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.591 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.592 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:49.592 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.386648+0000", 2021-10-08T19:32:49.593 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021706590000000001 2021-10-08T19:32:49.593 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.593 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.593 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:49.593 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.574827+0000", 2021-10-08T19:32:49.594 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.18817901300000001 2021-10-08T19:32:49.594 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.594 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.594 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:32:49.595 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.574888+0000", 2021-10-08T19:32:49.595 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1078e-05 2021-10-08T19:32:49.595 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.595 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.595 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:32:49.596 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.574937+0000", 2021-10-08T19:32:49.596 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9100000000000001e-05 2021-10-08T19:32:49.596 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:49.596 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:32:49.596 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:49.597 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.597 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.597 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:58812 7.5 7:ace934bc:::benchmark_data_smithi097_93198_object58811:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2021-10-08T19:32:49.597 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:24:38.380358+0000", 2021-10-08T19:32:49.598 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 491.15681628200002, 2021-10-08T19:32:49.598 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.19472503899999999, 2021-10-08T19:32:49.598 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:32:49.598 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:32:49.598 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:32:49.599 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:32:49.599 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:32:49.599 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 58812 2021-10-08T19:32:49.599 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.600 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:32:49.600 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.600 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:32:49.600 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.380358+0000", 2021-10-08T19:32:49.600 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:49.601 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.601 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.601 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:32:49.601 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.380358+0000", 2021-10-08T19:32:49.601 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:49.602 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.602 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.602 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:32:49.602 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.380357+0000", 2021-10-08T19:32:49.603 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:32:49.603 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.603 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.603 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:32:49.603 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.380395+0000", 2021-10-08T19:32:49.604 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7836000000000002e-05 2021-10-08T19:32:49.604 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.604 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.604 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:32:49.604 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.380403+0000", 2021-10-08T19:32:49.605 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9810000000000003e-06 2021-10-08T19:32:49.605 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.605 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.605 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:32:49.606 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.380408+0000", 2021-10-08T19:32:49.606 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.237e-06 2021-10-08T19:32:49.606 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.606 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.606 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:49.607 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.382453+0000", 2021-10-08T19:32:49.607 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020453910000000001 2021-10-08T19:32:49.607 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.607 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.607 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:32:49.608 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.382629+0000", 2021-10-08T19:32:49.608 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017584799999999999 2021-10-08T19:32:49.608 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.608 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.609 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:32:49.609 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.382793+0000", 2021-10-08T19:32:49.609 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000163859 2021-10-08T19:32:49.609 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.609 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.610 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:49.610 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.386787+0000", 2021-10-08T19:32:49.610 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0039934790000000003 2021-10-08T19:32:49.610 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.610 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.611 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:32:49.611 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.387500+0000", 2021-10-08T19:32:49.611 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00071292899999999995 2021-10-08T19:32:49.611 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.612 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.612 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:49.612 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.574989+0000", 2021-10-08T19:32:49.612 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.18748959400000001 2021-10-08T19:32:49.612 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.613 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.613 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:32:49.613 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.575044+0000", 2021-10-08T19:32:49.613 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5183999999999999e-05 2021-10-08T19:32:49.613 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.614 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.614 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:32:49.614 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.575083+0000", 2021-10-08T19:32:49.614 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8649000000000002e-05 2021-10-08T19:32:49.615 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:49.615 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:32:49.615 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:49.615 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.615 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.616 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:58838 7.5 7:a978e539:::benchmark_data_smithi097_93198_object58837:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2021-10-08T19:32:49.616 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:24:38.418842+0000", 2021-10-08T19:32:49.616 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 491.11833190999999, 2021-10-08T19:32:49.616 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.15687025600000001, 2021-10-08T19:32:49.616 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:32:49.617 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:32:49.617 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:32:49.617 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:32:49.617 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:32:49.617 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 58838 2021-10-08T19:32:49.618 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.618 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:32:49.618 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.618 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:32:49.619 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.418842+0000", 2021-10-08T19:32:49.619 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:49.619 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.619 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.619 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:32:49.620 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.418842+0000", 2021-10-08T19:32:49.620 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:49.620 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.620 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.620 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:32:49.621 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.418839+0000", 2021-10-08T19:32:49.621 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999971 2021-10-08T19:32:49.621 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.621 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.622 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:32:49.622 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.418877+0000", 2021-10-08T19:32:49.622 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8019000000000003e-05 2021-10-08T19:32:49.622 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.622 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.623 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:32:49.623 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.418894+0000", 2021-10-08T19:32:49.623 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6755000000000001e-05 2021-10-08T19:32:49.623 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.623 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.624 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:32:49.624 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.418900+0000", 2021-10-08T19:32:49.624 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2910000000000004e-06 2021-10-08T19:32:49.624 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.624 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.625 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:49.625 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.418951+0000", 2021-10-08T19:32:49.625 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0330000000000001e-05 2021-10-08T19:32:49.625 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.626 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.626 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:32:49.626 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.419072+0000", 2021-10-08T19:32:49.626 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000121651 2021-10-08T19:32:49.626 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.627 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.627 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:32:49.627 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.419199+0000", 2021-10-08T19:32:49.627 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000126525 2021-10-08T19:32:49.627 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.628 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.628 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:32:49.628 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.420787+0000", 2021-10-08T19:32:49.628 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0015883309999999999 2021-10-08T19:32:49.629 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.629 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.629 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:49.629 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.421139+0000", 2021-10-08T19:32:49.629 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00035210500000000002 2021-10-08T19:32:49.630 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.630 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.630 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:49.630 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.575628+0000", 2021-10-08T19:32:49.631 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.15448861 2021-10-08T19:32:49.631 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.631 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.631 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:32:49.631 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.575675+0000", 2021-10-08T19:32:49.632 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7304e-05 2021-10-08T19:32:49.632 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.632 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.632 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:32:49.632 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:24:38.575713+0000", 2021-10-08T19:32:49.633 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7273e-05 2021-10-08T19:32:49.633 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:49.633 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:32:49.633 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:49.633 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.634 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.634 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.25465.0:50756 9.3 9:cf42c892:::benchmark_data_smithi097_196985_object50755:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e311)", 2021-10-08T19:32:49.634 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:32:15.147588+0000", 2021-10-08T19:32:49.634 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 34.389586671000004, 2021-10-08T19:32:49.635 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.18313448800000001, 2021-10-08T19:32:49.635 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:32:49.635 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:32:49.635 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:32:49.635 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.25465", 2021-10-08T19:32:49.636 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:32:49.636 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 50756 2021-10-08T19:32:49.636 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.636 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:32:49.637 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.637 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:32:49.637 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:15.147588+0000", 2021-10-08T19:32:49.637 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:49.637 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.638 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.638 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:32:49.638 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:15.147588+0000", 2021-10-08T19:32:49.638 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:49.638 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.639 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.639 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:32:49.639 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:15.147587+0000", 2021-10-08T19:32:49.639 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:32:49.640 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.640 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.640 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:32:49.640 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:15.147615+0000", 2021-10-08T19:32:49.640 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8030000000000001e-05 2021-10-08T19:32:49.641 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.641 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.641 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:32:49.641 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:15.147621+0000", 2021-10-08T19:32:49.641 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9399999999999999e-06 2021-10-08T19:32:49.642 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.642 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.642 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:32:49.642 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:15.147625+0000", 2021-10-08T19:32:49.643 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2359999999999998e-06 2021-10-08T19:32:49.643 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.643 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.643 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:49.643 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:15.147679+0000", 2021-10-08T19:32:49.644 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4271999999999998e-05 2021-10-08T19:32:49.644 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.644 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.644 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:32:49.644 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:15.147801+0000", 2021-10-08T19:32:49.645 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000121947 2021-10-08T19:32:49.645 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.645 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.645 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 1,3", 2021-10-08T19:32:49.646 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:15.147941+0000", 2021-10-08T19:32:49.646 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013947100000000001 2021-10-08T19:32:49.646 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.646 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.646 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:32:49.647 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:15.152447+0000", 2021-10-08T19:32:49.647 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0045064459999999999 2021-10-08T19:32:49.647 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.647 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.648 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:49.648 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:15.152700+0000", 2021-10-08T19:32:49.648 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00025262700000000001 2021-10-08T19:32:49.648 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.648 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.649 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:49.649 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:15.330627+0000", 2021-10-08T19:32:49.649 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.17792706699999999 2021-10-08T19:32:49.649 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.649 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.650 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:32:49.650 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:15.330681+0000", 2021-10-08T19:32:49.650 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4188999999999999e-05 2021-10-08T19:32:49.650 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.651 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.651 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:32:49.651 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:15.330722+0000", 2021-10-08T19:32:49.651 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.108e-05 2021-10-08T19:32:49.651 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:49.652 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:32:49.652 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:49.652 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.652 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.652 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:73540 9.c e316/290 9:37527347:::benchmark_data_smithi097_196985_object73539:head v 316'4579, mlcod=316'4576)", 2021-10-08T19:32:49.653 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:32:34.611260+0000", 2021-10-08T19:32:49.653 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 14.925913768000001, 2021-10-08T19:32:49.653 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.149101384, 2021-10-08T19:32:49.653 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:32:49.654 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:32:49.654 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:32:49.654 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.654 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:32:49.654 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:34.611260+0000", 2021-10-08T19:32:49.655 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:49.655 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.655 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.655 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:32:49.655 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:34.611260+0000", 2021-10-08T19:32:49.656 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:49.656 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.656 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.656 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:32:49.656 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:34.611259+0000", 2021-10-08T19:32:49.657 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:32:49.657 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.657 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.657 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:32:49.658 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:34.611292+0000", 2021-10-08T19:32:49.658 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.3139000000000002e-05 2021-10-08T19:32:49.658 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.658 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.658 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:32:49.659 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:34.611302+0000", 2021-10-08T19:32:49.659 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.1840000000000005e-06 2021-10-08T19:32:49.659 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.659 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.659 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:32:49.660 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:34.611307+0000", 2021-10-08T19:32:49.660 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2560000000000002e-06 2021-10-08T19:32:49.660 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.661 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.661 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:49.661 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:34.611341+0000", 2021-10-08T19:32:49.661 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.3835999999999999e-05 2021-10-08T19:32:49.661 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.662 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.662 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:32:49.662 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:34.611354+0000", 2021-10-08T19:32:49.662 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2814e-05 2021-10-08T19:32:49.663 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.663 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.663 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:32:49.663 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:34.760330+0000", 2021-10-08T19:32:49.663 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.14897600699999999 2021-10-08T19:32:49.664 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.664 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.664 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:32:49.664 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:34.760362+0000", 2021-10-08T19:32:49.664 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2268999999999999e-05 2021-10-08T19:32:49.665 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:49.665 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:32:49.665 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:49.665 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.666 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.666 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:73541 9.1 e316/290 9:87c5da45:::benchmark_data_smithi097_196985_object73540:head v 316'4559, mlcod=316'4557)", 2021-10-08T19:32:49.666 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:32:34.611318+0000", 2021-10-08T19:32:49.666 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 14.925856574999999, 2021-10-08T19:32:49.666 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.14759176399999999, 2021-10-08T19:32:49.667 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:32:49.667 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:32:49.667 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:32:49.667 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.667 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:32:49.668 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:34.611318+0000", 2021-10-08T19:32:49.668 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:49.668 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.668 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.669 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:32:49.669 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:34.611318+0000", 2021-10-08T19:32:49.669 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:49.669 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.669 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.670 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:32:49.670 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:34.611317+0000", 2021-10-08T19:32:49.670 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999995 2021-10-08T19:32:49.670 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.670 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.671 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:32:49.671 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:34.611405+0000", 2021-10-08T19:32:49.671 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.8370999999999998e-05 2021-10-08T19:32:49.671 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.672 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.672 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:32:49.672 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:34.611414+0000", 2021-10-08T19:32:49.672 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3329999999999997e-06 2021-10-08T19:32:49.672 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.673 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.673 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:32:49.673 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:34.611418+0000", 2021-10-08T19:32:49.673 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1629999999999998e-06 2021-10-08T19:32:49.673 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.674 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.674 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:49.674 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:34.611505+0000", 2021-10-08T19:32:49.674 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.7059999999999997e-05 2021-10-08T19:32:49.675 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.675 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.675 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:32:49.675 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:34.611536+0000", 2021-10-08T19:32:49.675 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.1155000000000002e-05 2021-10-08T19:32:49.676 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.676 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.676 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:32:49.676 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:34.758885+0000", 2021-10-08T19:32:49.676 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.14734844699999999 2021-10-08T19:32:49.677 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.677 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.677 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:32:49.677 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:34.758909+0000", 2021-10-08T19:32:49.677 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4834999999999999e-05 2021-10-08T19:32:49.678 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:49.678 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:32:49.678 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:49.678 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.679 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.679 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.25465.0:73543 9.e 9:78085ff2:::benchmark_data_smithi097_196985_object73542:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e316)", 2021-10-08T19:32:49.679 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:32:34.611444+0000", 2021-10-08T19:32:49.679 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 14.925729937, 2021-10-08T19:32:49.679 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.15158128300000001, 2021-10-08T19:32:49.680 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:32:49.680 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:32:49.680 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:32:49.680 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.25465", 2021-10-08T19:32:49.681 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:32:49.681 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 73543 2021-10-08T19:32:49.681 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.681 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:32:49.681 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.682 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:32:49.682 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:34.611444+0000", 2021-10-08T19:32:49.682 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:49.682 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.682 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.683 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:32:49.683 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:34.611444+0000", 2021-10-08T19:32:49.683 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:49.683 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.684 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.684 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:32:49.684 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:34.611443+0000", 2021-10-08T19:32:49.684 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:32:49.684 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.685 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.685 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:32:49.685 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:34.611533+0000", 2021-10-08T19:32:49.685 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0298999999999997e-05 2021-10-08T19:32:49.685 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.686 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.686 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:32:49.686 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:34.611543+0000", 2021-10-08T19:32:49.686 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6630000000000005e-06 2021-10-08T19:32:49.687 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.687 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.687 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:32:49.687 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:34.611549+0000", 2021-10-08T19:32:49.687 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3060000000000003e-06 2021-10-08T19:32:49.688 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.688 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.688 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:49.688 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:34.611609+0000", 2021-10-08T19:32:49.688 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9859999999999999e-05 2021-10-08T19:32:49.689 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.689 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.689 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:32:49.689 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:34.611736+0000", 2021-10-08T19:32:49.689 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012758800000000001 2021-10-08T19:32:49.690 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.690 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.690 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:32:49.690 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:34.756133+0000", 2021-10-08T19:32:49.691 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.14439639000000001 2021-10-08T19:32:49.691 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.691 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.691 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:32:49.691 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:34.762836+0000", 2021-10-08T19:32:49.692 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0067034540000000002 2021-10-08T19:32:49.692 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.692 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.692 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:49.692 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:34.762873+0000", 2021-10-08T19:32:49.693 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6810999999999997e-05 2021-10-08T19:32:49.693 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.693 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.693 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:49.694 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:34.762938+0000", 2021-10-08T19:32:49.694 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4937999999999994e-05 2021-10-08T19:32:49.694 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.694 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.694 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:32:49.695 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:34.762987+0000", 2021-10-08T19:32:49.695 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8798999999999998e-05 2021-10-08T19:32:49.695 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.695 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.695 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:32:49.696 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:34.763026+0000", 2021-10-08T19:32:49.696 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8815e-05 2021-10-08T19:32:49.696 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:49.696 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:32:49.697 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:49.697 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.697 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.697 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.25465.0:73544 9.3 9:c54a0636:::benchmark_data_smithi097_196985_object73543:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e316)", 2021-10-08T19:32:49.697 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:32:34.611569+0000", 2021-10-08T19:32:49.698 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 14.925605608, 2021-10-08T19:32:49.698 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.15035357699999999, 2021-10-08T19:32:49.698 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:32:49.698 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:32:49.698 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:32:49.699 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.25465", 2021-10-08T19:32:49.699 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:32:49.699 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 73544 2021-10-08T19:32:49.699 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.700 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:32:49.700 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.700 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:32:49.700 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:34.611569+0000", 2021-10-08T19:32:49.700 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:49.701 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.701 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.701 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:32:49.701 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:34.611569+0000", 2021-10-08T19:32:49.701 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:49.702 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.702 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.702 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:32:49.702 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:34.611561+0000", 2021-10-08T19:32:49.703 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999919 2021-10-08T19:32:49.703 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.703 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.703 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:32:49.703 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:34.611600+0000", 2021-10-08T19:32:49.704 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9647999999999997e-05 2021-10-08T19:32:49.704 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.704 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.704 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:32:49.704 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:34.611607+0000", 2021-10-08T19:32:49.705 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6789999999999999e-06 2021-10-08T19:32:49.705 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.705 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.705 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:32:49.706 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:34.611612+0000", 2021-10-08T19:32:49.706 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9609999999999996e-06 2021-10-08T19:32:49.706 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.706 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.706 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:49.707 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:34.611656+0000", 2021-10-08T19:32:49.707 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4489e-05 2021-10-08T19:32:49.707 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.707 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.707 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:32:49.708 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:34.611773+0000", 2021-10-08T19:32:49.708 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000116482 2021-10-08T19:32:49.708 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.708 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.709 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 1,3", 2021-10-08T19:32:49.709 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:34.756158+0000", 2021-10-08T19:32:49.709 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.14438527900000001 2021-10-08T19:32:49.709 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.710 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.710 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:49.710 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:34.761726+0000", 2021-10-08T19:32:49.710 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0055679500000000003 2021-10-08T19:32:49.711 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.711 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.711 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:49.711 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:34.761837+0000", 2021-10-08T19:32:49.711 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011105800000000001 2021-10-08T19:32:49.712 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.712 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.712 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:32:49.712 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:34.761845+0000", 2021-10-08T19:32:49.713 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8509999999999999e-06 2021-10-08T19:32:49.713 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.713 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.713 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:32:49.713 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:34.761886+0000", 2021-10-08T19:32:49.714 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1097000000000003e-05 2021-10-08T19:32:49.714 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.714 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.714 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:32:49.714 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:34.761922+0000", 2021-10-08T19:32:49.715 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.5951999999999997e-05 2021-10-08T19:32:49.715 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:49.715 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:32:49.715 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:49.716 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.716 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.716 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:77499 9.5 e316/290 9:ac4969c9:::benchmark_data_smithi097_196985_object77498:head v 316'4760, mlcod=316'4757)", 2021-10-08T19:32:49.716 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:32:38.370431+0000", 2021-10-08T19:32:49.716 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 11.166743305000001, 2021-10-08T19:32:49.717 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.21244118000000001, 2021-10-08T19:32:49.717 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:32:49.717 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:32:49.717 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:32:49.717 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.718 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:32:49.718 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370431+0000", 2021-10-08T19:32:49.718 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:49.718 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.718 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.719 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:32:49.719 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370431+0000", 2021-10-08T19:32:49.719 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:49.719 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.720 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.720 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:32:49.720 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370430+0000", 2021-10-08T19:32:49.720 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:32:49.720 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.721 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.721 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:32:49.721 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370481+0000", 2021-10-08T19:32:49.721 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1430000000000001e-05 2021-10-08T19:32:49.722 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.722 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.722 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:32:49.722 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370492+0000", 2021-10-08T19:32:49.722 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0755e-05 2021-10-08T19:32:49.723 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.723 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.723 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:32:49.723 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370498+0000", 2021-10-08T19:32:49.723 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4869999999999999e-06 2021-10-08T19:32:49.724 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.724 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.724 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:49.724 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370541+0000", 2021-10-08T19:32:49.724 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2460999999999999e-05 2021-10-08T19:32:49.725 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.725 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.725 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:32:49.725 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370559+0000", 2021-10-08T19:32:49.726 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8150000000000001e-05 2021-10-08T19:32:49.726 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.726 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.726 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:32:49.726 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.582843+0000", 2021-10-08T19:32:49.727 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.21228397099999999 2021-10-08T19:32:49.727 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.727 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.727 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:32:49.727 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.582872+0000", 2021-10-08T19:32:49.728 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9221e-05 2021-10-08T19:32:49.728 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:49.728 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:32:49.728 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:49.729 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.729 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.729 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:77507 9.c e316/290 9:3c2e9901:::benchmark_data_smithi097_196985_object77506:head v 316'4807, mlcod=316'4804)", 2021-10-08T19:32:49.729 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:32:38.370481+0000", 2021-10-08T19:32:49.729 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 11.166693557, 2021-10-08T19:32:49.730 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.210201309, 2021-10-08T19:32:49.730 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:32:49.730 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:32:49.730 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:32:49.730 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.731 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:32:49.731 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370481+0000", 2021-10-08T19:32:49.731 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:49.731 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.732 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.732 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:32:49.732 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370481+0000", 2021-10-08T19:32:49.732 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:49.732 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.733 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.733 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:32:49.733 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370480+0000", 2021-10-08T19:32:49.733 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999995 2021-10-08T19:32:49.733 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.734 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.734 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:32:49.734 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370508+0000", 2021-10-08T19:32:49.734 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7653000000000001e-05 2021-10-08T19:32:49.735 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.735 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.735 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:32:49.735 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370514+0000", 2021-10-08T19:32:49.735 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1920000000000002e-06 2021-10-08T19:32:49.736 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.736 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.736 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:32:49.736 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370519+0000", 2021-10-08T19:32:49.736 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.113e-06 2021-10-08T19:32:49.737 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.737 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.737 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:49.737 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370630+0000", 2021-10-08T19:32:49.737 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000110925 2021-10-08T19:32:49.738 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.738 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.738 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:32:49.738 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370649+0000", 2021-10-08T19:32:49.739 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9063999999999999e-05 2021-10-08T19:32:49.739 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.739 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.739 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:32:49.739 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.377750+0000", 2021-10-08T19:32:49.740 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0071006710000000002 2021-10-08T19:32:49.740 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.740 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.740 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:32:49.741 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580682+0000", 2021-10-08T19:32:49.741 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.202932268 2021-10-08T19:32:49.741 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:49.741 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:32:49.741 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:49.742 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.742 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.742 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:77503 9.5 e316/290 9:a86a20e3:::benchmark_data_smithi097_196985_object77502:head v 316'4761, mlcod=316'4758)", 2021-10-08T19:32:49.742 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:32:38.372458+0000", 2021-10-08T19:32:49.742 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 11.164716424, 2021-10-08T19:32:49.743 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.210430539, 2021-10-08T19:32:49.743 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:32:49.743 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:32:49.743 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:32:49.743 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.744 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:32:49.744 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.372458+0000", 2021-10-08T19:32:49.744 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:49.744 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.745 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.745 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:32:49.745 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.372458+0000", 2021-10-08T19:32:49.745 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:49.745 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.746 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.746 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:32:49.746 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.372457+0000", 2021-10-08T19:32:49.746 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:32:49.746 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.747 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.747 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:32:49.747 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.372492+0000", 2021-10-08T19:32:49.747 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.5354000000000001e-05 2021-10-08T19:32:49.747 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.748 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.748 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:32:49.748 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.372502+0000", 2021-10-08T19:32:49.748 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8810000000000008e-06 2021-10-08T19:32:49.749 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.749 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.749 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:32:49.749 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.372508+0000", 2021-10-08T19:32:49.749 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3069999999999999e-06 2021-10-08T19:32:49.750 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.750 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.750 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:49.750 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.372792+0000", 2021-10-08T19:32:49.750 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00028411499999999999 2021-10-08T19:32:49.751 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.751 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.751 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:32:49.751 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.372804+0000", 2021-10-08T19:32:49.751 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2058e-05 2021-10-08T19:32:49.752 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.752 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.752 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:32:49.752 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.582875+0000", 2021-10-08T19:32:49.753 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.210070701 2021-10-08T19:32:49.753 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.753 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.753 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:32:49.753 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.582888+0000", 2021-10-08T19:32:49.754 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3345e-05 2021-10-08T19:32:49.754 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:49.754 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:32:49.754 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:49.754 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.755 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.755 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:77509 9.5 e316/290 9:a04d875b:::benchmark_data_smithi097_196985_object77508:head v 316'4762, mlcod=316'4758)", 2021-10-08T19:32:49.755 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:32:38.373454+0000", 2021-10-08T19:32:49.755 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 11.163720229999999, 2021-10-08T19:32:49.755 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.20948882399999999, 2021-10-08T19:32:49.756 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:32:49.756 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:32:49.756 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:32:49.756 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.757 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:32:49.757 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.373454+0000", 2021-10-08T19:32:49.757 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:49.757 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.757 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.758 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:32:49.758 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.373454+0000", 2021-10-08T19:32:49.758 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:49.758 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.758 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.759 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:32:49.759 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.373453+0000", 2021-10-08T19:32:49.759 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:32:49.759 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.759 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.760 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:32:49.760 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.373614+0000", 2021-10-08T19:32:49.760 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016036300000000001 2021-10-08T19:32:49.760 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.761 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.761 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:32:49.761 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.373627+0000", 2021-10-08T19:32:49.761 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3759e-05 2021-10-08T19:32:49.761 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.762 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.762 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:32:49.762 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.373631+0000", 2021-10-08T19:32:49.762 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.019e-06 2021-10-08T19:32:49.762 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.763 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.763 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:49.763 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.375396+0000", 2021-10-08T19:32:49.763 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0017641810000000001 2021-10-08T19:32:49.764 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.764 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.764 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:32:49.764 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.375414+0000", 2021-10-08T19:32:49.764 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8949000000000001e-05 2021-10-08T19:32:49.765 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.765 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.765 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:32:49.765 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.582929+0000", 2021-10-08T19:32:49.765 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.20751492799999999 2021-10-08T19:32:49.766 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.766 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.766 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:32:49.766 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.582943+0000", 2021-10-08T19:32:49.767 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3382e-05 2021-10-08T19:32:49.767 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:49.767 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:32:49.767 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:49.767 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.768 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.768 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:77510 9.c e316/290 9:3e9f4d30:::benchmark_data_smithi097_196985_object77509:head v 316'4808, mlcod=316'4804)", 2021-10-08T19:32:49.768 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:32:38.373489+0000", 2021-10-08T19:32:49.768 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 11.163684870000001, 2021-10-08T19:32:49.768 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.20722019899999999, 2021-10-08T19:32:49.769 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:32:49.769 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:32:49.769 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:32:49.769 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.770 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:32:49.770 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.373489+0000", 2021-10-08T19:32:49.770 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:49.770 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.770 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.771 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:32:49.771 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.373489+0000", 2021-10-08T19:32:49.771 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:49.771 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.772 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.772 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:32:49.772 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.373489+0000", 2021-10-08T19:32:49.772 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:32:49.772 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.773 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.773 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:32:49.773 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.373614+0000", 2021-10-08T19:32:49.773 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012516400000000001 2021-10-08T19:32:49.773 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.774 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.774 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:32:49.774 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.373624+0000", 2021-10-08T19:32:49.774 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0078000000000001e-05 2021-10-08T19:32:49.774 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.775 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.775 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:32:49.775 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.373630+0000", 2021-10-08T19:32:49.775 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9349999999999999e-06 2021-10-08T19:32:49.776 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.776 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.776 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:49.776 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.373791+0000", 2021-10-08T19:32:49.776 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016118299999999999 2021-10-08T19:32:49.777 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.777 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.777 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:32:49.777 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.373808+0000", 2021-10-08T19:32:49.777 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7280999999999999e-05 2021-10-08T19:32:49.778 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.778 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.778 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:32:49.778 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580687+0000", 2021-10-08T19:32:49.779 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.20687856399999999 2021-10-08T19:32:49.779 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.779 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.779 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:32:49.779 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580710+0000", 2021-10-08T19:32:49.780 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2738000000000002e-05 2021-10-08T19:32:49.780 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:49.780 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:32:49.780 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:49.780 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.781 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.781 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.25465.0:77517 9.d 9:b7278e79:::benchmark_data_smithi097_196985_object77516:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e316)", 2021-10-08T19:32:49.781 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:32:38.375271+0000", 2021-10-08T19:32:49.781 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 11.161902883, 2021-10-08T19:32:49.781 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.214728957, 2021-10-08T19:32:49.782 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:32:49.782 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:32:49.782 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:32:49.782 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.25465", 2021-10-08T19:32:49.783 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:32:49.783 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 77517 2021-10-08T19:32:49.783 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.783 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:32:49.783 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.784 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:32:49.784 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.375271+0000", 2021-10-08T19:32:49.784 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:49.784 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.785 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.785 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:32:49.785 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.375271+0000", 2021-10-08T19:32:49.785 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:49.785 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.786 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.786 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:32:49.786 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.375269+0000", 2021-10-08T19:32:49.786 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:32:49.786 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.787 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.787 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:32:49.787 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.375303+0000", 2021-10-08T19:32:49.787 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.3868999999999997e-05 2021-10-08T19:32:49.787 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.788 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.788 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:32:49.788 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.375315+0000", 2021-10-08T19:32:49.788 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1728e-05 2021-10-08T19:32:49.789 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.789 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.789 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:32:49.789 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.375321+0000", 2021-10-08T19:32:49.789 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7499999999999997e-06 2021-10-08T19:32:49.790 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.790 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.790 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:49.790 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.377409+0000", 2021-10-08T19:32:49.790 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020878939999999999 2021-10-08T19:32:49.791 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.791 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.791 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:32:49.791 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.377528+0000", 2021-10-08T19:32:49.792 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000118972 2021-10-08T19:32:49.792 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.792 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.792 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 1,5", 2021-10-08T19:32:49.792 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.377696+0000", 2021-10-08T19:32:49.793 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016830600000000001 2021-10-08T19:32:49.793 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.793 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.793 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:49.793 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.582927+0000", 2021-10-08T19:32:49.794 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.205230724 2021-10-08T19:32:49.794 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.794 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.794 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:49.794 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.584639+0000", 2021-10-08T19:32:49.795 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001711808 2021-10-08T19:32:49.795 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.795 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.795 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:32:49.796 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.589921+0000", 2021-10-08T19:32:49.796 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0052821830000000002 2021-10-08T19:32:49.796 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.796 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.796 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:32:49.797 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.589964+0000", 2021-10-08T19:32:49.797 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.3319000000000003e-05 2021-10-08T19:32:49.797 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.797 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.798 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:32:49.798 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.590000+0000", 2021-10-08T19:32:49.798 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.5793000000000001e-05 2021-10-08T19:32:49.798 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:49.799 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:32:49.799 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:49.799 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.799 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.800 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:77518 9.9 e316/290 9:9bd075f7:::benchmark_data_smithi097_196985_object77517:head v 316'4852, mlcod=316'4850)", 2021-10-08T19:32:49.800 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:32:38.376302+0000", 2021-10-08T19:32:49.800 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 11.160872037000001, 2021-10-08T19:32:49.800 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.20439987900000001, 2021-10-08T19:32:49.800 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:32:49.801 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:32:49.801 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:32:49.801 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.801 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:32:49.801 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.376302+0000", 2021-10-08T19:32:49.802 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:49.802 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.802 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.802 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:32:49.803 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.376302+0000", 2021-10-08T19:32:49.803 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:49.803 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.803 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.803 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:32:49.804 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.376299+0000", 2021-10-08T19:32:49.804 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999967 2021-10-08T19:32:49.804 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.804 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.804 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:32:49.805 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.376325+0000", 2021-10-08T19:32:49.805 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6188000000000001e-05 2021-10-08T19:32:49.805 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.805 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.806 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:32:49.806 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.376333+0000", 2021-10-08T19:32:49.806 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9160000000000001e-06 2021-10-08T19:32:49.806 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.806 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.807 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:32:49.807 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.376337+0000", 2021-10-08T19:32:49.807 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1930000000000003e-06 2021-10-08T19:32:49.807 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.807 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.808 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:49.808 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.376378+0000", 2021-10-08T19:32:49.808 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0917999999999997e-05 2021-10-08T19:32:49.808 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.808 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.809 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:32:49.809 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.376398+0000", 2021-10-08T19:32:49.809 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9882999999999999e-05 2021-10-08T19:32:49.809 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.810 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.810 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:32:49.810 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580668+0000", 2021-10-08T19:32:49.810 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.204270813 2021-10-08T19:32:49.810 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.811 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.811 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:32:49.811 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580702+0000", 2021-10-08T19:32:49.811 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.3528000000000002e-05 2021-10-08T19:32:49.811 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:49.812 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:32:49.812 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:49.812 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.812 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.813 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:77511 9.1 e316/290 9:84400f31:::benchmark_data_smithi097_196985_object77510:head v 316'4798, mlcod=316'4795)", 2021-10-08T19:32:49.813 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:32:38.377524+0000", 2021-10-08T19:32:49.813 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 11.159650473999999, 2021-10-08T19:32:49.813 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.20320565800000001, 2021-10-08T19:32:49.813 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:32:49.814 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:32:49.814 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:32:49.814 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.814 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:32:49.815 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.377524+0000", 2021-10-08T19:32:49.815 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:49.815 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.815 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.815 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:32:49.816 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.377524+0000", 2021-10-08T19:32:49.816 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:49.816 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.816 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.816 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:32:49.817 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.377523+0000", 2021-10-08T19:32:49.817 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999995 2021-10-08T19:32:49.817 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.817 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.817 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:32:49.818 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.377552+0000", 2021-10-08T19:32:49.818 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9136e-05 2021-10-08T19:32:49.818 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.818 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.819 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:32:49.819 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.377558+0000", 2021-10-08T19:32:49.819 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.959e-06 2021-10-08T19:32:49.819 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.819 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.820 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:32:49.820 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.377562+0000", 2021-10-08T19:32:49.820 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0090000000000001e-06 2021-10-08T19:32:49.820 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.820 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.821 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:49.821 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.377638+0000", 2021-10-08T19:32:49.821 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5498000000000001e-05 2021-10-08T19:32:49.821 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.822 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.822 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:32:49.822 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.377656+0000", 2021-10-08T19:32:49.822 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8423999999999998e-05 2021-10-08T19:32:49.822 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.823 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.823 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:32:49.823 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580708+0000", 2021-10-08T19:32:49.823 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.20305161199999999 2021-10-08T19:32:49.823 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.824 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.824 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:32:49.824 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580729+0000", 2021-10-08T19:32:49.824 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1585000000000001e-05 2021-10-08T19:32:49.825 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:49.825 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:32:49.825 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:49.825 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.825 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.826 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:77514 9.1 e316/290 9:8c08759a:::benchmark_data_smithi097_196985_object77513:head v 316'4799, mlcod=316'4796)", 2021-10-08T19:32:49.826 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:32:38.380203+0000", 2021-10-08T19:32:49.826 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 11.156970939000001, 2021-10-08T19:32:49.826 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.20752410600000001, 2021-10-08T19:32:49.826 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:32:49.827 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:32:49.827 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:32:49.827 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.827 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:32:49.828 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.380203+0000", 2021-10-08T19:32:49.828 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:49.828 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.828 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.828 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:32:49.829 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.380203+0000", 2021-10-08T19:32:49.829 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:49.829 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.829 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.829 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:32:49.830 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.380202+0000", 2021-10-08T19:32:49.830 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:32:49.830 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.830 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.830 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:32:49.831 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.380266+0000", 2021-10-08T19:32:49.831 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4292e-05 2021-10-08T19:32:49.831 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.831 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.832 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:32:49.832 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580625+0000", 2021-10-08T19:32:49.832 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.20035874300000001 2021-10-08T19:32:49.832 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.832 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.833 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:32:49.833 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580647+0000", 2021-10-08T19:32:49.833 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1883e-05 2021-10-08T19:32:49.833 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.833 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.834 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:49.834 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580750+0000", 2021-10-08T19:32:49.834 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000102703 2021-10-08T19:32:49.834 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.834 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.835 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:32:49.835 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580766+0000", 2021-10-08T19:32:49.835 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6155e-05 2021-10-08T19:32:49.835 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.836 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.836 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:32:49.836 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.587680+0000", 2021-10-08T19:32:49.836 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0069146219999999996 2021-10-08T19:32:49.836 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.837 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.837 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:32:49.837 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.587727+0000", 2021-10-08T19:32:49.837 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7018000000000003e-05 2021-10-08T19:32:49.837 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:49.838 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:32:49.838 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:49.838 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.838 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.839 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop_reply(client.25465.0:77517 9.d e316/308 ondisk, result = 0)", 2021-10-08T19:32:49.839 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:32:38.380417+0000", 2021-10-08T19:32:49.839 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 11.156756881, 2021-10-08T19:32:49.839 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.202527015, 2021-10-08T19:32:49.839 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:32:49.840 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2021-10-08T19:32:49.840 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:32:49.840 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.840 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:32:49.840 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.380417+0000", 2021-10-08T19:32:49.841 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:49.841 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.841 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.841 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:32:49.841 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.380417+0000", 2021-10-08T19:32:49.842 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:49.842 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.842 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.842 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:32:49.843 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.380416+0000", 2021-10-08T19:32:49.843 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:32:49.843 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.843 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.843 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:32:49.844 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.380422+0000", 2021-10-08T19:32:49.844 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5339999999999999e-06 2021-10-08T19:32:49.844 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.844 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.844 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:32:49.845 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580587+0000", 2021-10-08T19:32:49.845 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.200164861 2021-10-08T19:32:49.845 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.845 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.846 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:32:49.846 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580618+0000", 2021-10-08T19:32:49.846 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.1516000000000001e-05 2021-10-08T19:32:49.846 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.847 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.847 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:49.847 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.582913+0000", 2021-10-08T19:32:49.847 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022951719999999998 2021-10-08T19:32:49.848 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.848 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.848 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:32:49.848 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.582920+0000", 2021-10-08T19:32:49.848 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1300000000000003e-06 2021-10-08T19:32:49.849 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.849 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.849 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:32:49.849 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.582944+0000", 2021-10-08T19:32:49.849 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3972e-05 2021-10-08T19:32:49.850 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:49.850 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:32:49.850 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:49.850 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.851 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.851 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:77532 9.9 e316/290 9:9ff58f88:::benchmark_data_smithi097_196985_object77531:head v 316'4853, mlcod=316'4850)", 2021-10-08T19:32:49.851 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:32:38.395624+0000", 2021-10-08T19:32:49.851 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 11.141549823, 2021-10-08T19:32:49.851 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.192136736, 2021-10-08T19:32:49.852 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:32:49.852 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:32:49.852 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:32:49.852 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.852 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:32:49.853 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.395624+0000", 2021-10-08T19:32:49.853 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:49.853 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.853 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.854 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:32:49.854 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.395624+0000", 2021-10-08T19:32:49.854 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:32:49.854 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.854 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.855 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:32:49.855 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.395622+0000", 2021-10-08T19:32:49.855 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:32:49.855 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.855 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.856 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:32:49.856 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.395684+0000", 2021-10-08T19:32:49.856 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1247000000000005e-05 2021-10-08T19:32:49.856 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.856 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.857 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:32:49.857 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580588+0000", 2021-10-08T19:32:49.857 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.18490478199999999 2021-10-08T19:32:49.857 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.858 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.858 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:32:49.858 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580644+0000", 2021-10-08T19:32:49.858 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5415999999999999e-05 2021-10-08T19:32:49.858 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.859 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.859 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:32:49.859 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580726+0000", 2021-10-08T19:32:49.859 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2120999999999995e-05 2021-10-08T19:32:49.859 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.860 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.860 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:32:49.860 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580747+0000", 2021-10-08T19:32:49.860 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0856000000000002e-05 2021-10-08T19:32:49.861 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.861 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.861 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:32:49.861 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.587731+0000", 2021-10-08T19:32:49.861 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0069841850000000004 2021-10-08T19:32:49.862 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:32:49.862 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:32:49.862 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:32:49.862 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.587761+0000", 2021-10-08T19:32:49.862 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.0134999999999999e-05 2021-10-08T19:32:49.863 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:49.863 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:32:49.863 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:49.863 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:32:49.863 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:32:49.864 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:32:49.864 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 66 16 89567 89551 84.7616 65.6875 0.0149797 0.0117935 2021-10-08T19:32:49.865 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:49 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:32:49.865 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:49 smithi117 ceph-mon[34585]: 172.21.15.97 - - [08/Oct/2021:19:32:47] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:32:49.865 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:49 smithi117 ceph-mon[34585]: 3.12 scrub ok 2021-10-08T19:32:49.866 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:49 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1399907829' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:32:50.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:50 smithi097 ceph-mon[32687]: 4.e scrub ok 2021-10-08T19:32:50.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:50 smithi097 ceph-mon[32687]: pgmap v581: 178 pgs: 178 active+clean; 5.2 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 60 MiB/s wr, 961 op/s 2021-10-08T19:32:50.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:50 smithi097 ceph-mon[32687]: 6.19 scrub ok 2021-10-08T19:32:50.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:50 smithi097 ceph-mon[32687]: 2.d scrub ok 2021-10-08T19:32:50.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:50 smithi097 ceph-mon[32687]: 5.11 scrub ok 2021-10-08T19:32:50.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:50 smithi097 ceph-mon[41966]: 4.e scrub ok 2021-10-08T19:32:50.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:50 smithi097 ceph-mon[41966]: pgmap v581: 178 pgs: 178 active+clean; 5.2 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 60 MiB/s wr, 961 op/s 2021-10-08T19:32:50.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:50 smithi097 ceph-mon[41966]: 6.19 scrub ok 2021-10-08T19:32:50.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:50 smithi097 ceph-mon[41966]: 2.d scrub ok 2021-10-08T19:32:50.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:50 smithi097 ceph-mon[41966]: 5.11 scrub ok 2021-10-08T19:32:50.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:50 smithi117 ceph-mon[34585]: 4.e scrub ok 2021-10-08T19:32:50.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:50 smithi117 ceph-mon[34585]: pgmap v581: 178 pgs: 178 active+clean; 5.2 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 60 MiB/s wr, 961 op/s 2021-10-08T19:32:50.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:50 smithi117 ceph-mon[34585]: 6.19 scrub ok 2021-10-08T19:32:50.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:50 smithi117 ceph-mon[34585]: 2.d scrub ok 2021-10-08T19:32:50.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:50 smithi117 ceph-mon[34585]: 5.11 scrub ok 2021-10-08T19:32:50.858 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 67 16 90716 90700 84.5683 71.8125 0.0143776 0.0118203 2021-10-08T19:32:51.058 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:32:51.062 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:51.062 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:32:51.163 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:32:51.196 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:51.451 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:51 smithi117 ceph-mon[34585]: 6.2 scrub ok 2021-10-08T19:32:51.452 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:51 smithi117 ceph-mon[34585]: 3.5 scrub ok 2021-10-08T19:32:51.452 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:51 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:32:51.452 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:51 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:32:51.452 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:51 smithi117 ceph-mon[34585]: 3.1 scrub ok 2021-10-08T19:32:51.454 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2021-10-08T19:32:51.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:51 smithi097 ceph-mon[41966]: 6.2 scrub ok 2021-10-08T19:32:51.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:51 smithi097 ceph-mon[41966]: 3.5 scrub ok 2021-10-08T19:32:51.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:51 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:32:51.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:51 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:32:51.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:51 smithi097 ceph-mon[41966]: 3.1 scrub ok 2021-10-08T19:32:51.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:51 smithi097 ceph-mon[32687]: 6.2 scrub ok 2021-10-08T19:32:51.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:51 smithi097 ceph-mon[32687]: 3.5 scrub ok 2021-10-08T19:32:51.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:51 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:32:51.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:51 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:32:51.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:51 smithi097 ceph-mon[32687]: 3.1 scrub ok 2021-10-08T19:32:51.548 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:32:51.551 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:51.552 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:32:51.653 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:32:51.696 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:51.760 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:32:51.766 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:51.767 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:32:51.857 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 68 16 91754 91738 84.2787 64.875 0.0316226 0.0118601 2021-10-08T19:32:51.868 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:32:51.912 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:51.991 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:32:51.997 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:51.998 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:32:52.100 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:32:52.113 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:32:52.227 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:52.396 INFO:teuthology.orchestra.run.smithi097.stdout:moved 0 / 534 (0%) 2021-10-08T19:32:52.396 INFO:teuthology.orchestra.run.smithi097.stdout:avg 66.75 2021-10-08T19:32:52.397 INFO:teuthology.orchestra.run.smithi097.stdout:stddev 8.1968 -> 8.1968 (expected baseline 7.6424) 2021-10-08T19:32:52.397 INFO:teuthology.orchestra.run.smithi097.stdout:min osd.2 with 53 -> 53 pgs (0.794007 -> 0.794007 * mean) 2021-10-08T19:32:52.398 INFO:teuthology.orchestra.run.smithi097.stdout:max osd.7 with 80 -> 80 pgs (1.1985 -> 1.1985 * mean) 2021-10-08T19:32:52.398 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:32:52.398 INFO:teuthology.orchestra.run.smithi097.stdout:oload 1000 2021-10-08T19:32:52.399 INFO:teuthology.orchestra.run.smithi097.stdout:max_change 0.05 2021-10-08T19:32:52.399 INFO:teuthology.orchestra.run.smithi097.stdout:max_change_osds 4 2021-10-08T19:32:52.400 INFO:teuthology.orchestra.run.smithi097.stdout:average_utilization 0.0247 2021-10-08T19:32:52.400 INFO:teuthology.orchestra.run.smithi097.stdout:overload_utilization 0.2468 2021-10-08T19:32:52.405 INFO:teuthology.orchestra.run.smithi097.stderr:no change 2021-10-08T19:32:52.421 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:32:52.430 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:52.431 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:32:52.480 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:52 smithi097 ceph-mon[41966]: 2.f scrub ok 2021-10-08T19:32:52.481 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:52 smithi097 ceph-mon[41966]: pgmap v582: 178 pgs: 178 active+clean; 5.4 GiB data, 18 GiB used, 698 GiB / 715 GiB avail; 83 MiB/s wr, 1.32k op/s; 0 B/s, 1 objects/s recovering 2021-10-08T19:32:52.481 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:52 smithi097 ceph-mon[41966]: osdmap e319: 8 total, 8 up, 8 in 2021-10-08T19:32:52.481 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:52 smithi097 ceph-mon[32687]: 2.f scrub ok 2021-10-08T19:32:52.481 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:52 smithi097 ceph-mon[32687]: pgmap v582: 178 pgs: 178 active+clean; 5.4 GiB data, 18 GiB used, 698 GiB / 715 GiB avail; 83 MiB/s wr, 1.32k op/s; 0 B/s, 1 objects/s recovering 2021-10-08T19:32:52.482 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:52 smithi097 ceph-mon[32687]: osdmap e319: 8 total, 8 up, 8 in 2021-10-08T19:32:52.533 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:32:52.588 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:52.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:52 smithi117 ceph-mon[34585]: 2.f scrub ok 2021-10-08T19:32:52.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:52 smithi117 ceph-mon[34585]: pgmap v582: 178 pgs: 178 active+clean; 5.4 GiB data, 18 GiB used, 698 GiB / 715 GiB avail; 83 MiB/s wr, 1.32k op/s; 0 B/s, 1 objects/s recovering 2021-10-08T19:32:52.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:52 smithi117 ceph-mon[34585]: osdmap e319: 8 total, 8 up, 8 in 2021-10-08T19:32:52.688 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:32:52.699 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:52.700 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:32:52.801 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:32:52.840 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:52.857 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 69 16 92708 92692 83.9214 59.625 0.0116318 0.0119108 2021-10-08T19:32:52.971 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:32:52 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:32:52] "GET /metrics HTTP/1.1" 200 155793 "" "Prometheus/2.18.1" 2021-10-08T19:32:53.064 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:32:53.068 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:53.069 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:32:53.170 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:32:53.213 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:53.274 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is set 2021-10-08T19:32:53.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:53 smithi097 ceph-mon[41966]: 3.9 scrub ok 2021-10-08T19:32:53.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:53 smithi097 ceph-mon[41966]: 2.4 scrub ok 2021-10-08T19:32:53.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:53 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1837707504' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:32:53.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:53 smithi097 ceph-mon[41966]: 5.2 scrub ok 2021-10-08T19:32:53.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:53 smithi097 ceph-mon[41966]: 3.11 scrub ok 2021-10-08T19:32:53.474 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:53 smithi097 ceph-mon[32687]: 3.9 scrub ok 2021-10-08T19:32:53.474 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:53 smithi097 ceph-mon[32687]: 2.4 scrub ok 2021-10-08T19:32:53.474 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:53 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1837707504' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:32:53.474 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:53 smithi097 ceph-mon[32687]: 5.2 scrub ok 2021-10-08T19:32:53.475 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:53 smithi097 ceph-mon[32687]: 3.11 scrub ok 2021-10-08T19:32:53.497 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2021-10-08T19:32:53.507 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:53 smithi117 ceph-mon[34585]: 3.9 scrub ok 2021-10-08T19:32:53.507 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:53 smithi117 ceph-mon[34585]: 2.4 scrub ok 2021-10-08T19:32:53.507 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:53 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1837707504' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:32:53.507 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:53 smithi117 ceph-mon[34585]: 5.2 scrub ok 2021-10-08T19:32:53.508 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:53 smithi117 ceph-mon[34585]: 3.11 scrub ok 2021-10-08T19:32:53.508 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:32:53 smithi117 conmon[69189]: level=error ts=2021-10-08T19:32:53.504Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=2 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:32:53.651 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '1000', 'type': 'reweight-by-utilization'} 2021-10-08T19:32:53.653 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd reweight-by-utilization 1000 1.0 2021-10-08T19:32:53.857 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 70 16 93726 93710 83.6312 63.625 0.0221075 0.011952 2021-10-08T19:32:53.867 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:32:53.873 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:53.874 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:32:53.975 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:32:54.027 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:54.123 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:32:54.128 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:32:53 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:32:53] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:32:54.129 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:54.130 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:32:54.232 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:32:54.273 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:54.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:54 smithi117 ceph-mon[34585]: from='client.35582 v1:172.21.15.97:0/1673528230' entity='client.admin' cmd=[{"prefix": "osd reweight-by-utilization", "oload": 1000, "max_change": 0.05, "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:32:54.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:54 smithi117 ceph-mon[34585]: pgmap v584: 178 pgs: 178 active+clean; 5.4 GiB data, 18 GiB used, 698 GiB / 715 GiB avail; 41 MiB/s wr, 652 op/s; 0 B/s, 1 objects/s recovering 2021-10-08T19:32:54.409 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:54 smithi117 ceph-mon[34585]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:32:54.409 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:54 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1837707504' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:32:54.409 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:54 smithi117 ceph-mon[34585]: osdmap e320: 8 total, 8 up, 8 in 2021-10-08T19:32:54.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:54 smithi097 ceph-mon[41966]: from='client.35582 v1:172.21.15.97:0/1673528230' entity='client.admin' cmd=[{"prefix": "osd reweight-by-utilization", "oload": 1000, "max_change": 0.05, "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:32:54.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:54 smithi097 ceph-mon[41966]: pgmap v584: 178 pgs: 178 active+clean; 5.4 GiB data, 18 GiB used, 698 GiB / 715 GiB avail; 41 MiB/s wr, 652 op/s; 0 B/s, 1 objects/s recovering 2021-10-08T19:32:54.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:54 smithi097 ceph-mon[41966]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:32:54.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:54 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1837707504' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:32:54.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:54 smithi097 ceph-mon[41966]: osdmap e320: 8 total, 8 up, 8 in 2021-10-08T19:32:54.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:54 smithi097 ceph-mon[32687]: from='client.35582 v1:172.21.15.97:0/1673528230' entity='client.admin' cmd=[{"prefix": "osd reweight-by-utilization", "oload": 1000, "max_change": 0.05, "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:32:54.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:54 smithi097 ceph-mon[32687]: pgmap v584: 178 pgs: 178 active+clean; 5.4 GiB data, 18 GiB used, 698 GiB / 715 GiB avail; 41 MiB/s wr, 652 op/s; 0 B/s, 1 objects/s recovering 2021-10-08T19:32:54.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:54 smithi097 ceph-mon[32687]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:32:54.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:54 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1837707504' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:32:54.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:54 smithi097 ceph-mon[32687]: osdmap e320: 8 total, 8 up, 8 in 2021-10-08T19:32:54.859 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 71 16 94817 94801 83.4137 68.1875 0.0164317 0.0119836 2021-10-08T19:32:54.913 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:32:54.918 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:54.919 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:32:54.923 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:32:54.977 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:32:55.021 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:32:55.068 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:55.159 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:32:55.164 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:55.165 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:32:55.267 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:32:55.306 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:55.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:55 smithi117 ceph-mon[34585]: pgmap v586: 178 pgs: 178 active+clean; 5.7 GiB data, 19 GiB used, 697 GiB / 715 GiB avail; 82 MiB/s wr, 1.30k op/s; 0 B/s, 1 objects/s recovering 2021-10-08T19:32:55.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:55 smithi097 ceph-mon[41966]: pgmap v586: 178 pgs: 178 active+clean; 5.7 GiB data, 19 GiB used, 697 GiB / 715 GiB avail; 82 MiB/s wr, 1.30k op/s; 0 B/s, 1 objects/s recovering 2021-10-08T19:32:55.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:55 smithi097 ceph-mon[32687]: pgmap v586: 178 pgs: 178 active+clean; 5.7 GiB data, 19 GiB used, 697 GiB / 715 GiB avail; 82 MiB/s wr, 1.30k op/s; 0 B/s, 1 objects/s recovering 2021-10-08T19:32:55.598 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:32:55.601 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:55.602 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:32:55.625 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:32:55.625 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2021-10-08T19:32:55.625 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:32:55.626 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.25465.0:95584 9.9 9:9aad2a7a:::benchmark_data_smithi097_196985_object95583:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e320)", 2021-10-08T19:32:55.626 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:32:55.610466+0000", 2021-10-08T19:32:55.627 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.002787061, 2021-10-08T19:32:55.627 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028228540000000001, 2021-10-08T19:32:55.627 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:32:55.627 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2021-10-08T19:32:55.627 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:32:55.628 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.25465", 2021-10-08T19:32:55.628 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:32:55.628 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 95584 2021-10-08T19:32:55.628 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:32:55.629 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:32:55.629 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:32:55.629 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:32:55.629 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:55.610466+0000", 2021-10-08T19:32:55.629 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:32:55.630 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:32:55.630 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:32:55.630 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:32:55.630 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:55.610466+0000", 2021-10-08T19:32:55.631 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:32:55.631 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:32:55.631 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:32:55.631 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:32:55.631 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:55.610464+0000", 2021-10-08T19:32:55.632 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:32:55.632 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:32:55.632 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:32:55.633 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:32:55.634 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:55.610488+0000", 2021-10-08T19:32:55.634 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3853e-05 2021-10-08T19:32:55.634 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:32:55.634 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:32:55.635 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:32:55.635 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:55.610503+0000", 2021-10-08T19:32:55.635 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5233e-05 2021-10-08T19:32:55.635 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:32:55.636 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:32:55.636 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:32:55.636 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:55.610510+0000", 2021-10-08T19:32:55.636 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7769999999999997e-06 2021-10-08T19:32:55.636 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:32:55.637 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:32:55.637 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:32:55.637 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:55.610619+0000", 2021-10-08T19:32:55.637 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010895000000000001 2021-10-08T19:32:55.638 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:32:55.638 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:32:55.638 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:32:55.638 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:55.610753+0000", 2021-10-08T19:32:55.638 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000134127 2021-10-08T19:32:55.639 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:32:55.639 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:32:55.639 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5,7", 2021-10-08T19:32:55.639 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:55.610913+0000", 2021-10-08T19:32:55.640 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000160631 2021-10-08T19:32:55.640 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:32:55.640 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:32:55.640 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:32:55.640 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:32:55.641 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:32:55.641 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.25465.0:95585 9.9 9.1eaacb19 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e320)", 2021-10-08T19:32:55.641 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:32:55.610521+0000", 2021-10-08T19:32:55.641 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0027325520000000001, 2021-10-08T19:32:55.642 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028494029999999999, 2021-10-08T19:32:55.642 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:32:55.642 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "queued for pg", 2021-10-08T19:32:55.643 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:32:55.643 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.25465", 2021-10-08T19:32:55.643 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:32:55.643 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 95585 2021-10-08T19:32:55.644 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:32:55.644 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:32:55.644 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:32:55.644 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:32:55.644 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:55.610521+0000", 2021-10-08T19:32:55.645 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:32:55.645 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:32:55.645 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:32:55.645 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:32:55.646 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:55.610521+0000", 2021-10-08T19:32:55.646 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:32:55.646 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:32:55.646 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:32:55.647 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:32:55.647 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:55.610520+0000", 2021-10-08T19:32:55.647 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:32:55.647 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:32:55.648 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:32:55.648 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:32:55.648 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:55.610538+0000", 2021-10-08T19:32:55.648 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8644e-05 2021-10-08T19:32:55.648 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:32:55.649 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:32:55.649 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:32:55.649 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:55.610548+0000", 2021-10-08T19:32:55.650 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5650000000000007e-06 2021-10-08T19:32:55.650 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:32:55.650 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:32:55.651 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:32:55.651 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:55.610553+0000", 2021-10-08T19:32:55.651 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6779999999999999e-06 2021-10-08T19:32:55.651 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:32:55.652 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:32:55.652 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:32:55.652 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:32:55.652 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:32:55.653 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.25465.0:95586 9.9 9.3fe7a979 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e320)", 2021-10-08T19:32:55.653 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:32:55.610557+0000", 2021-10-08T19:32:55.654 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0026964229999999999, 2021-10-08T19:32:55.654 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028678990000000001, 2021-10-08T19:32:55.654 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:32:55.654 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "queued for pg", 2021-10-08T19:32:55.655 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:32:55.655 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.25465", 2021-10-08T19:32:55.655 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:32:55.655 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 95586 2021-10-08T19:32:55.655 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:32:55.656 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:32:55.656 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:32:55.656 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:32:55.656 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:55.610557+0000", 2021-10-08T19:32:55.657 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:32:55.657 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:32:55.657 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:32:55.657 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:32:55.657 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:55.610557+0000", 2021-10-08T19:32:55.658 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:32:55.658 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:32:55.658 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:32:55.658 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:32:55.658 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:55.610556+0000", 2021-10-08T19:32:55.659 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2021-10-08T19:32:55.659 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:32:55.659 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:32:55.659 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:32:55.660 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:55.610575+0000", 2021-10-08T19:32:55.660 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8479999999999999e-05 2021-10-08T19:32:55.660 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:32:55.660 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:32:55.661 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:32:55.661 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:55.610580+0000", 2021-10-08T19:32:55.661 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6590000000000004e-06 2021-10-08T19:32:55.661 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:32:55.662 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:32:55.662 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:32:55.662 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:55.610585+0000", 2021-10-08T19:32:55.662 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7469999999999996e-06 2021-10-08T19:32:55.663 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:32:55.663 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:32:55.663 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:32:55.664 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:32:55.664 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:32:55.664 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.25465.0:95573 9.9 9:9e39e086:::benchmark_data_smithi097_196985_object95572:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e320)", 2021-10-08T19:32:55.664 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:32:55.600194+0000", 2021-10-08T19:32:55.665 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.013059284000000001, 2021-10-08T19:32:55.665 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013289916000000001, 2021-10-08T19:32:55.665 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:32:55.665 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2021-10-08T19:32:55.666 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:32:55.666 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.25465", 2021-10-08T19:32:55.666 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:32:55.666 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 95573 2021-10-08T19:32:55.666 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:32:55.667 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:32:55.667 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:32:55.667 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:32:55.667 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:55.600194+0000", 2021-10-08T19:32:55.668 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:32:55.668 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:32:55.668 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:32:55.668 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:32:55.669 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:55.600194+0000", 2021-10-08T19:32:55.669 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:32:55.669 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:32:55.669 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:32:55.669 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:32:55.670 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:55.600192+0000", 2021-10-08T19:32:55.670 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:32:55.670 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:32:55.670 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:32:55.671 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:32:55.671 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:55.600222+0000", 2021-10-08T19:32:55.671 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0797999999999999e-05 2021-10-08T19:32:55.671 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:32:55.672 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:32:55.672 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:32:55.672 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:55.600235+0000", 2021-10-08T19:32:55.672 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2876e-05 2021-10-08T19:32:55.673 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:32:55.673 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:32:55.673 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:32:55.674 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:55.600243+0000", 2021-10-08T19:32:55.674 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2559999999999996e-06 2021-10-08T19:32:55.674 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:32:55.674 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:32:55.674 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:32:55.675 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:55.604274+0000", 2021-10-08T19:32:55.675 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0040312789999999996 2021-10-08T19:32:55.675 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:32:55.675 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:32:55.676 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:32:55.676 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:55.604385+0000", 2021-10-08T19:32:55.676 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011108900000000001 2021-10-08T19:32:55.676 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:32:55.676 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:32:55.677 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5,7", 2021-10-08T19:32:55.677 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:55.604535+0000", 2021-10-08T19:32:55.677 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000149732 2021-10-08T19:32:55.677 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:32:55.678 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:32:55.678 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:32:55.678 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:55.608241+0000", 2021-10-08T19:32:55.678 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003705931 2021-10-08T19:32:55.678 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:32:55.679 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:32:55.679 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:32:55.679 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:55.610232+0000", 2021-10-08T19:32:55.679 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0019913050000000001 2021-10-08T19:32:55.680 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:32:55.680 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:32:55.680 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:32:55.680 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:32:55.681 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:32:55.681 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 4 2021-10-08T19:32:55.681 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:32:55.703 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:32:55.741 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:55.859 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 72 16 95810 95794 83.1172 62.0625 0.0108671 0.0120268 2021-10-08T19:32:55.905 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:32:55.907 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:55.908 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:32:56.009 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:32:56.053 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:56.589 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:32:56.595 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:56.596 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:32:56.697 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:32:56.744 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:56.822 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2021-10-08T19:32:56.835 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:32:56.843 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:56.844 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:32:56.857 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 73 16 96977 96961 82.9777 72.9375 0.014574 0.0120467 2021-10-08T19:32:56.916 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set nodeep-scrub 2021-10-08T19:32:56.945 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:32:57.032 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:57.156 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:32:56 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:32:57.619 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:32:57.624 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:57.625 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:32:57.726 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:32:57.766 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:57.843 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:32:57.851 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:57.852 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:32:57.857 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 74 16 98061 98045 82.7719 67.75 0.0171483 0.0120767 2021-10-08T19:32:57.953 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:32:57.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:57 smithi097 ceph-mon[32687]: pgmap v587: 178 pgs: 178 active+clean; 5.7 GiB data, 19 GiB used, 697 GiB / 715 GiB avail; 64 MiB/s wr, 1.02k op/s; 0 B/s, 1 objects/s recovering 2021-10-08T19:32:57.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:57 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:32:57.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:57 smithi097 ceph-mon[41966]: pgmap v587: 178 pgs: 178 active+clean; 5.7 GiB data, 19 GiB used, 697 GiB / 715 GiB avail; 64 MiB/s wr, 1.02k op/s; 0 B/s, 1 objects/s recovering 2021-10-08T19:32:57.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:57 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:32:57.996 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:58.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:57 smithi117 ceph-mon[34585]: pgmap v587: 178 pgs: 178 active+clean; 5.7 GiB data, 19 GiB used, 697 GiB / 715 GiB avail; 64 MiB/s wr, 1.02k op/s; 0 B/s, 1 objects/s recovering 2021-10-08T19:32:58.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:57 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:32:58.258 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:32:58.262 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:58.264 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:32:58.366 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:32:58.428 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:58.449 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:32:58.536 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:32:58.590 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:32:58.596 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:58.597 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:32:58.699 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:32:58.735 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:58.858 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 75 16 99185 99169 82.6049 70.25 0.0117485 0.0121008 2021-10-08T19:32:58.902 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:32:58.943 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:32:58.961 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:32:58.965 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:58.966 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:32:58.983 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:32:59.039 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:32:59.067 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:32:59.085 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:32:59.100 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:59.131 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:32:59.168 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:32:59.180 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:32:59.187 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:59.188 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:32:59.209 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:32:59.209 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'false' 2021-10-08T19:32:59.210 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'false' 2021-10-08T19:32:59.210 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'false' 2021-10-08T19:32:59.210 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'false' 2021-10-08T19:32:59.210 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'false' 2021-10-08T19:32:59.211 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'false' 2021-10-08T19:32:59.211 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'false' 2021-10-08T19:32:59.211 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'false' 2021-10-08T19:32:59.247 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:32:59 smithi097 conmon[33110]: 172.21.15.117 - - [08/Oct/2021:19:32:59] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:32:59.291 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:32:59.318 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:59.377 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:32:59.381 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:59.382 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:32:59.483 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:32:59.525 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:59.600 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:32:59.605 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:59.606 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:32:59.707 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:32:59.709 INFO:teuthology.orchestra.run.smithi097.stdout:moved 0 / 534 (0%) 2021-10-08T19:32:59.709 INFO:teuthology.orchestra.run.smithi097.stdout:avg 66.75 2021-10-08T19:32:59.709 INFO:teuthology.orchestra.run.smithi097.stdout:stddev 8.1968 -> 8.1968 (expected baseline 7.6424) 2021-10-08T19:32:59.709 INFO:teuthology.orchestra.run.smithi097.stdout:min osd.2 with 53 -> 53 pgs (0.794007 -> 0.794007 * mean) 2021-10-08T19:32:59.710 INFO:teuthology.orchestra.run.smithi097.stdout:max osd.7 with 80 -> 80 pgs (1.1985 -> 1.1985 * mean) 2021-10-08T19:32:59.710 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:32:59.710 INFO:teuthology.orchestra.run.smithi097.stdout:oload 1000 2021-10-08T19:32:59.710 INFO:teuthology.orchestra.run.smithi097.stdout:max_change 1 2021-10-08T19:32:59.711 INFO:teuthology.orchestra.run.smithi097.stdout:max_change_osds 4 2021-10-08T19:32:59.711 INFO:teuthology.orchestra.run.smithi097.stdout:average_utilization 0.0266 2021-10-08T19:32:59.711 INFO:teuthology.orchestra.run.smithi097.stdout:overload_utilization 0.2657 2021-10-08T19:32:59.711 INFO:teuthology.orchestra.run.smithi097.stderr:no change 2021-10-08T19:32:59.750 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:32:59.841 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:32:59.850 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:32:59.850 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:32:59.858 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 76 16 100135 100119 82.2993 59.375 0.00689732 0.0121465 2021-10-08T19:32:59.952 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:32:59.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:59 smithi097 ceph-mon[32687]: pgmap v588: 178 pgs: 178 active+clean; 5.9 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.2 KiB/s rd, 60 MiB/s wr, 955 op/s 2021-10-08T19:32:59.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:59 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1370051650' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:32:59.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:59 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:32:59.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:59 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:32:59.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:32:59 smithi097 ceph-mon[32687]: 172.21.15.117 - - [08/Oct/2021:19:32:59] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:32:59.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:59 smithi097 ceph-mon[41966]: pgmap v588: 178 pgs: 178 active+clean; 5.9 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.2 KiB/s rd, 60 MiB/s wr, 955 op/s 2021-10-08T19:32:59.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:59 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1370051650' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:32:59.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:59 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:32:59.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:59 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:32:59.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:32:59 smithi097 ceph-mon[41966]: 172.21.15.117 - - [08/Oct/2021:19:32:59] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:33:00.010 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:00.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:59 smithi117 ceph-mon[34585]: pgmap v588: 178 pgs: 178 active+clean; 5.9 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.2 KiB/s rd, 60 MiB/s wr, 955 op/s 2021-10-08T19:33:00.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:59 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1370051650' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:33:00.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:59 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:33:00.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:59 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:33:00.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:32:59 smithi117 ceph-mon[34585]: 172.21.15.117 - - [08/Oct/2021:19:32:59] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:33:00.462 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:33:00.466 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:00.467 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:33:00.569 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:33:00.606 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:00.687 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:33:00.692 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:00.693 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:33:00.794 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:33:00.835 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:00.858 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 77 16 101357 101341 82.2223 76.375 0.00952698 0.0121575 2021-10-08T19:33:00.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:00 smithi117 ceph-mon[34585]: from='client.35591 v1:172.21.15.97:0/1429856560' entity='client.admin' cmd=[{"prefix": "osd reweight-by-utilization", "oload": 1000, "max_change": 1.0, "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:33:01.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:00 smithi097 ceph-mon[41966]: from='client.35591 v1:172.21.15.97:0/1429856560' entity='client.admin' cmd=[{"prefix": "osd reweight-by-utilization", "oload": 1000, "max_change": 1.0, "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:33:01.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:00 smithi097 ceph-mon[32687]: from='client.35591 v1:172.21.15.97:0/1429856560' entity='client.admin' cmd=[{"prefix": "osd reweight-by-utilization", "oload": 1000, "max_change": 1.0, "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:33:01.450 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:33:01.454 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:01.455 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:33:01.556 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:33:01.609 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:01.858 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 78 15 102544 102529 82.1198 74.25 0.010955 0.012173 2021-10-08T19:33:02.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:01 smithi117 ceph-mon[34585]: pgmap v589: 178 pgs: 178 active+clean; 6.1 GiB data, 20 GiB used, 696 GiB / 715 GiB avail; 1.1 KiB/s rd, 74 MiB/s wr, 1.18k op/s 2021-10-08T19:33:02.197 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:01 smithi097 ceph-mon[32687]: pgmap v589: 178 pgs: 178 active+clean; 6.1 GiB data, 20 GiB used, 696 GiB / 715 GiB avail; 1.1 KiB/s rd, 74 MiB/s wr, 1.18k op/s 2021-10-08T19:33:02.198 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:01 smithi097 ceph-mon[41966]: pgmap v589: 178 pgs: 178 active+clean; 6.1 GiB data, 20 GiB used, 696 GiB / 715 GiB avail; 1.1 KiB/s rd, 74 MiB/s wr, 1.18k op/s 2021-10-08T19:33:02.354 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:33:02.358 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:02.359 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:33:02.458 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2021-10-08T19:33:02.460 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:33:02.490 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:02.550 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:33:02.553 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:02.554 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:33:02.655 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:33:02.715 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:02.858 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 79 16 103636 103620 81.9434 68.1875 0.0103235 0.0121989 2021-10-08T19:33:02.954 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:33:02.956 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:33:02 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:33:02] "GET /metrics HTTP/1.1" 200 155785 "" "Prometheus/2.18.1" 2021-10-08T19:33:02.960 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:02.961 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:33:02.971 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2021-10-08T19:33:02.972 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:33:03.062 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:33:03.102 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:03.181 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:33:03.185 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:03.186 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:33:03.287 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:33:03.323 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:03.387 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:33:03.390 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:03.391 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:33:03.492 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:33:03.530 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:03.625 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:33:03.635 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:03.636 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:33:03.738 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:33:03.813 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:03.860 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:2021-10-08T19:33:03.858288+0000 min lat: 0.00118067 max lat: 3.10418 avg lat: 0.0122199 2021-10-08T19:33:03.862 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2021-10-08T19:33:03.863 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 80 16 104766 104750 81.8019 70.625 0.0119969 0.0122199 2021-10-08T19:33:03.870 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is set 2021-10-08T19:33:03.891 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:33:03.898 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:03.899 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:33:04.006 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:33:04.049 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:33:04.055 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:04.092 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2021-10-08T19:33:04.094 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:03 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:33:04.095 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:03 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:33:04.095 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:03 smithi097 ceph-mon[32687]: pgmap v590: 178 pgs: 178 active+clean; 6.1 GiB data, 20 GiB used, 696 GiB / 715 GiB avail; 1023 B/s rd, 67 MiB/s wr, 1.07k op/s 2021-10-08T19:33:04.096 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:03 smithi097 ceph-mon[32687]: osdmap e321: 8 total, 8 up, 8 in 2021-10-08T19:33:04.096 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:03 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3596082332' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:33:04.096 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:03 smithi097 ceph-mon[32687]: from='client.25582 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:33:04.097 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:03 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:33:04.097 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:03 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:33:04.097 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:03 smithi097 ceph-mon[41966]: pgmap v590: 178 pgs: 178 active+clean; 6.1 GiB data, 20 GiB used, 696 GiB / 715 GiB avail; 1023 B/s rd, 67 MiB/s wr, 1.07k op/s 2021-10-08T19:33:04.098 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:03 smithi097 ceph-mon[41966]: osdmap e321: 8 total, 8 up, 8 in 2021-10-08T19:33:04.098 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:03 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3596082332' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:33:04.099 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:03 smithi097 ceph-mon[41966]: from='client.25582 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:33:04.125 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:33:04.129 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:04.130 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:33:04.131 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:33:03 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:33:03] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:33:04.131 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:03 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:33:04.133 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:03 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:33:04.133 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:03 smithi117 ceph-mon[34585]: pgmap v590: 178 pgs: 178 active+clean; 6.1 GiB data, 20 GiB used, 696 GiB / 715 GiB avail; 1023 B/s rd, 67 MiB/s wr, 1.07k op/s 2021-10-08T19:33:04.134 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:03 smithi117 ceph-mon[34585]: osdmap e321: 8 total, 8 up, 8 in 2021-10-08T19:33:04.134 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:03 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3596082332' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:33:04.134 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:03 smithi117 ceph-mon[34585]: from='client.25582 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:33:04.232 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:33:04.265 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:04.336 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:33:04.340 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:04.341 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:33:04.442 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:33:04.483 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:04.564 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:33:04.571 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:04.572 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:33:04.673 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:33:04.711 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:04.806 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:33:04.811 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:04.812 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:33:04.859 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 81 16 105927 105911 81.6878 72.5625 0.0252375 0.0122372 2021-10-08T19:33:04.912 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:33:04.949 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:33:04.988 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:05.082 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:33:05.087 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:04 smithi097 ceph-mon[41966]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:33:05.087 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:04 smithi097 ceph-mon[41966]: from='client.25582 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:33:05.087 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:04 smithi097 ceph-mon[41966]: osdmap e322: 8 total, 8 up, 8 in 2021-10-08T19:33:05.096 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:04 smithi097 ceph-mon[32687]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:33:05.097 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:04 smithi097 ceph-mon[32687]: from='client.25582 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:33:05.097 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:04 smithi097 ceph-mon[32687]: osdmap e322: 8 total, 8 up, 8 in 2021-10-08T19:33:05.098 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:05.098 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:33:05.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:04 smithi117 ceph-mon[34585]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:33:05.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:04 smithi117 ceph-mon[34585]: from='client.25582 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:33:05.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:04 smithi117 ceph-mon[34585]: osdmap e322: 8 total, 8 up, 8 in 2021-10-08T19:33:05.202 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:33:05.232 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:05.316 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:33:05.321 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:05.322 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:33:05.424 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:33:05.463 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:05.535 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:33:05.539 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:05.540 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:33:05.641 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:33:05.679 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:05.751 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:33:05.755 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:05.756 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:33:05.842 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:05 smithi117 ceph-mon[34585]: pgmap v593: 178 pgs: 178 active+clean; 6.4 GiB data, 21 GiB used, 695 GiB / 715 GiB avail; 1.2 KiB/s rd, 86 MiB/s wr, 1.38k op/s 2021-10-08T19:33:05.858 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:33:05.860 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 82 16 107000 106984 81.5088 67.0625 0.00722032 0.0122636 2021-10-08T19:33:05.910 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:06.092 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:33:06.099 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:05 smithi097 ceph-mon[41966]: pgmap v593: 178 pgs: 178 active+clean; 6.4 GiB data, 21 GiB used, 695 GiB / 715 GiB avail; 1.2 KiB/s rd, 86 MiB/s wr, 1.38k op/s 2021-10-08T19:33:06.100 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:05 smithi097 ceph-mon[32687]: pgmap v593: 178 pgs: 178 active+clean; 6.4 GiB data, 21 GiB used, 695 GiB / 715 GiB avail; 1.2 KiB/s rd, 86 MiB/s wr, 1.38k op/s 2021-10-08T19:33:06.101 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:06.101 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:33:06.204 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:33:06.253 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:06.565 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:33:06.572 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:06.573 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:33:06.674 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:33:06.708 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:06.777 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:33:06.782 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:06.783 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:33:06.861 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 83 16 108230 108214 81.451 76.875 0.0125591 0.0122731 2021-10-08T19:33:06.884 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:33:06.925 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:06.958 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset noscrub 2021-10-08T19:33:07.155 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:33:06 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:33:07.198 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 4, 5, 7, 6, 1, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2021-10-08T19:33:07.199 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd reweight 0 1 2021-10-08T19:33:07.348 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:33:07.364 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:07.365 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:33:07.466 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:33:07.505 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:07.573 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:33:07.577 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:07.578 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:33:07.679 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:33:07.694 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:33:07.706 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:07.780 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:33:07.785 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:07.786 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:33:07.867 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 84 16 109193 109177 81.1956 60.1875 0.0134669 0.0123115 2021-10-08T19:33:07.888 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:33:07.940 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:07 smithi097 ceph-mon[41966]: pgmap v594: 178 pgs: 178 active+clean; 6.4 GiB data, 21 GiB used, 695 GiB / 715 GiB avail; 639 B/s rd, 67 MiB/s wr, 1.08k op/s 2021-10-08T19:33:07.940 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:07 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:33:07.941 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:07 smithi097 ceph-mon[32687]: pgmap v594: 178 pgs: 178 active+clean; 6.4 GiB data, 21 GiB used, 695 GiB / 715 GiB avail; 639 B/s rd, 67 MiB/s wr, 1.08k op/s 2021-10-08T19:33:07.941 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:07 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:33:07.967 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:08.048 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2021-10-08T19:33:08.048 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:33:08.055 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:33:08.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:07 smithi117 ceph-mon[34585]: pgmap v594: 178 pgs: 178 active+clean; 6.4 GiB data, 21 GiB used, 695 GiB / 715 GiB avail; 639 B/s rd, 67 MiB/s wr, 1.08k op/s 2021-10-08T19:33:08.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:07 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:33:08.864 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 85 15 110327 110312 81.0748 70.9375 0.0204895 0.0123289 2021-10-08T19:33:09.073 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:33:09.080 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:09.081 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:33:09.156 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:33:09.156 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:33:09.156 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:33:09.157 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:33:09.182 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:33:09.184 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:33:09.210 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:09.227 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:33:09.275 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:33:09.282 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:33:09.287 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:09.288 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:33:09.313 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:33:09.315 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true' 2021-10-08T19:33:09.316 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true' 2021-10-08T19:33:09.316 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true' 2021-10-08T19:33:09.316 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true' 2021-10-08T19:33:09.317 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true' 2021-10-08T19:33:09.317 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true' 2021-10-08T19:33:09.317 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'true' 2021-10-08T19:33:09.317 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'true' 2021-10-08T19:33:09.389 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:33:09.397 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2021-10-08T19:33:09.417 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:09.475 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:33:09.479 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:09.480 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:33:09.581 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:33:09.675 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:09.858 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:09 smithi117 ceph-mon[34585]: pgmap v595: 178 pgs: 178 active+clean; 6.5 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 1.2 KiB/s rd, 63 MiB/s wr, 1.01k op/s 2021-10-08T19:33:09.858 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:09 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3401517016' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:33:09.865 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 86 16 111312 111296 80.8462 61.5 0.01557 0.012365 2021-10-08T19:33:09.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:09 smithi097 ceph-mon[32687]: pgmap v595: 178 pgs: 178 active+clean; 6.5 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 1.2 KiB/s rd, 63 MiB/s wr, 1.01k op/s 2021-10-08T19:33:09.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:09 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3401517016' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:33:09.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:09 smithi097 ceph-mon[41966]: pgmap v595: 178 pgs: 178 active+clean; 6.5 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 1.2 KiB/s rd, 63 MiB/s wr, 1.01k op/s 2021-10-08T19:33:09.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:09 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3401517016' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:33:10.358 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:33:10.372 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:10.373 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:33:10.474 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:33:10.504 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:10.570 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:33:10.573 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:10.573 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:33:10.674 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:33:10.706 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:10.775 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:33:10.779 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:10.780 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:33:10.865 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 87 16 112428 112412 80.7186 69.75 0.0100763 0.0123843 2021-10-08T19:33:10.882 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:33:10.941 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:11.867 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 88 16 113655 113639 80.6709 76.6875 0.0243047 0.0123915 2021-10-08T19:33:11.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:11 smithi097 ceph-mon[32687]: pgmap v596: 178 pgs: 178 active+clean; 6.7 GiB data, 22 GiB used, 694 GiB / 715 GiB avail; 1.2 KiB/s rd, 87 MiB/s wr, 1.39k op/s 2021-10-08T19:33:11.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:11 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:33:11.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:11 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:33:11.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:11 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:33:11.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:11 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:33:11.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:11 smithi097 ceph-mon[41966]: pgmap v596: 178 pgs: 178 active+clean; 6.7 GiB data, 22 GiB used, 694 GiB / 715 GiB avail; 1.2 KiB/s rd, 87 MiB/s wr, 1.39k op/s 2021-10-08T19:33:11.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:11 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:33:11.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:11 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:33:11.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:11 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:33:11.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:11 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:33:12.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:11 smithi117 ceph-mon[34585]: pgmap v596: 178 pgs: 178 active+clean; 6.7 GiB data, 22 GiB used, 694 GiB / 715 GiB avail; 1.2 KiB/s rd, 87 MiB/s wr, 1.39k op/s 2021-10-08T19:33:12.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:11 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:33:12.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:11 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:33:12.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:11 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:33:12.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:11 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:33:12.527 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:33:12.548 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2021-10-08T19:33:12.564 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:33:12.569 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:12.570 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:33:12.671 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:33:12.726 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:12.870 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 89 16 114799 114783 80.5667 71.5 0.0174812 0.0124074 2021-10-08T19:33:12.970 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:33:12 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:33:12] "GET /metrics HTTP/1.1" 200 155799 "" "Prometheus/2.18.1" 2021-10-08T19:33:12.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:12 smithi097 ceph-mon[41966]: osdmap e323: 8 total, 8 up, 8 in 2021-10-08T19:33:12.974 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:12 smithi097 ceph-mon[32687]: osdmap e323: 8 total, 8 up, 8 in 2021-10-08T19:33:13.044 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:33:13.052 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:13.053 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:33:13.155 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:33:13.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:12 smithi117 ceph-mon[34585]: osdmap e323: 8 total, 8 up, 8 in 2021-10-08T19:33:13.188 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:13.248 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:33:13.254 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:13.255 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:33:13.356 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:33:13.392 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:13.454 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:33:13.458 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:13.459 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:33:13.560 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:33:13.630 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:13.778 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:33:13.853 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:33:13.854 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:13.855 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:33:13.869 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Total time run: 90.0209 2021-10-08T19:33:13.870 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Total writes made: 115688 2021-10-08T19:33:13.870 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Write size: 65536 2021-10-08T19:33:13.870 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Object size: 65536 2021-10-08T19:33:13.870 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Bandwidth (MB/sec): 80.3202 2021-10-08T19:33:13.871 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Stddev Bandwidth: 33.2383 2021-10-08T19:33:13.871 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Max bandwidth (MB/sec): 193.438 2021-10-08T19:33:13.871 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Min bandwidth (MB/sec): 0 2021-10-08T19:33:13.871 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Average IOPS: 1285 2021-10-08T19:33:13.872 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Stddev IOPS: 531.825 2021-10-08T19:33:13.872 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Max IOPS: 3095 2021-10-08T19:33:13.872 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Min IOPS: 0 2021-10-08T19:33:13.872 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Average Latency(s): 0.0124456 2021-10-08T19:33:13.872 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Stddev Latency(s): 0.0385027 2021-10-08T19:33:13.873 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Max latency(s): 3.10418 2021-10-08T19:33:13.873 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Min latency(s): 0.00118067 2021-10-08T19:33:13.873 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:13 smithi097 ceph-mon[32687]: pgmap v598: 178 pgs: 178 active+clean; 6.7 GiB data, 22 GiB used, 694 GiB / 715 GiB avail; 575 B/s rd, 61 MiB/s wr, 979 op/s 2021-10-08T19:33:13.874 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:13 smithi097 ceph-mon[41966]: pgmap v598: 178 pgs: 178 active+clean; 6.7 GiB data, 22 GiB used, 694 GiB / 715 GiB avail; 575 B/s rd, 61 MiB/s wr, 979 op/s 2021-10-08T19:33:13.874 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Cleaning up (deleting benchmark objects) 2021-10-08T19:33:13.956 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:33:14.014 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:14.156 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:33:13 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:33:13] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:33:14.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:13 smithi117 ceph-mon[34585]: pgmap v598: 178 pgs: 178 active+clean; 6.7 GiB data, 22 GiB used, 694 GiB / 715 GiB avail; 575 B/s rd, 61 MiB/s wr, 979 op/s 2021-10-08T19:33:14.409 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:33:14.413 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:14.414 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:33:14.515 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:33:14.538 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:14.585 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:33:14.590 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:14.590 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:33:14.692 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:33:14.715 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:14.765 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.0 to 1 (10000) 2021-10-08T19:33:14.766 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is unset 2021-10-08T19:33:14.772 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:33:14.775 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:14.776 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:33:14.877 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:33:14.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:14 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2143279776' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:33:14.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:14 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1001678020' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2021-10-08T19:33:14.920 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:14.995 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:33:15.000 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:15.000 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:33:15.102 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:33:15.142 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:15.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:14 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2143279776' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:33:15.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:14 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1001678020' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2021-10-08T19:33:15.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:14 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2143279776' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:33:15.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:14 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1001678020' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2021-10-08T19:33:15.234 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:33:15.237 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:15.238 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:33:15.339 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:33:15.381 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:15.470 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:33:15.475 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:15.475 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:33:15.576 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:33:15.626 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:15.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:15 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:33:15.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:15 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:33:15.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:15 smithi097 ceph-mon[41966]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:33:15.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:15 smithi097 ceph-mon[41966]: pgmap v599: 178 pgs: 178 active+clean; 7.0 GiB data, 23 GiB used, 693 GiB / 715 GiB avail; 1023 B/s rd, 68 MiB/s wr, 1.10k op/s 2021-10-08T19:33:15.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:15 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2143279776' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:33:15.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:15 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1001678020' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2021-10-08T19:33:15.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:15 smithi097 ceph-mon[41966]: osdmap e324: 8 total, 8 up, 8 in 2021-10-08T19:33:15.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:15 smithi097 ceph-mon[41966]: 2.17 scrub ok 2021-10-08T19:33:15.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:15 smithi097 ceph-mon[41966]: 3.d scrub ok 2021-10-08T19:33:15.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:15 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:33:15.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:15 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:33:15.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:15 smithi097 ceph-mon[32687]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:33:15.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:15 smithi097 ceph-mon[32687]: pgmap v599: 178 pgs: 178 active+clean; 7.0 GiB data, 23 GiB used, 693 GiB / 715 GiB avail; 1023 B/s rd, 68 MiB/s wr, 1.10k op/s 2021-10-08T19:33:15.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:15 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2143279776' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:33:15.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:15 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1001678020' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2021-10-08T19:33:15.974 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:15 smithi097 ceph-mon[32687]: osdmap e324: 8 total, 8 up, 8 in 2021-10-08T19:33:15.974 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:15 smithi097 ceph-mon[32687]: 2.17 scrub ok 2021-10-08T19:33:15.974 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:15 smithi097 ceph-mon[32687]: 3.d scrub ok 2021-10-08T19:33:16.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:15 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:33:16.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:15 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:33:16.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:15 smithi117 ceph-mon[34585]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:33:16.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:15 smithi117 ceph-mon[34585]: pgmap v599: 178 pgs: 178 active+clean; 7.0 GiB data, 23 GiB used, 693 GiB / 715 GiB avail; 1023 B/s rd, 68 MiB/s wr, 1.10k op/s 2021-10-08T19:33:16.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:15 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2143279776' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:33:16.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:15 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1001678020' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2021-10-08T19:33:16.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:15 smithi117 ceph-mon[34585]: osdmap e324: 8 total, 8 up, 8 in 2021-10-08T19:33:16.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:15 smithi117 ceph-mon[34585]: 2.17 scrub ok 2021-10-08T19:33:16.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:15 smithi117 ceph-mon[34585]: 3.d scrub ok 2021-10-08T19:33:16.973 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd reweight 2 1 2021-10-08T19:33:17.010 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:16 smithi097 ceph-mon[32687]: 6.17 scrub ok 2021-10-08T19:33:17.010 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:16 smithi097 ceph-mon[41966]: 6.17 scrub ok 2021-10-08T19:33:17.155 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:33:16 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:33:17.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:16 smithi117 ceph-mon[34585]: 6.17 scrub ok 2021-10-08T19:33:17.296 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:33:17.304 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:17.305 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:33:17.406 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:33:17.434 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:17.466 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:33:17.466 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2021-10-08T19:33:17.467 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.467 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.25465.0:119644 9.0 9:06231821:::benchmark_data_smithi097_196985_object3953:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e324)", 2021-10-08T19:33:17.467 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:33:17.453080+0000", 2021-10-08T19:33:17.468 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0084604550000000004, 2021-10-08T19:33:17.468 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.008490615, 2021-10-08T19:33:17.468 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:33:17.468 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2021-10-08T19:33:17.469 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:33:17.469 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.25465", 2021-10-08T19:33:17.469 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:33:17.469 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 119644 2021-10-08T19:33:17.469 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.470 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:33:17.470 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.470 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:33:17.470 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.453080+0000", 2021-10-08T19:33:17.471 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:17.471 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.471 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.471 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:33:17.472 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.453080+0000", 2021-10-08T19:33:17.472 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:17.472 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.472 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.472 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:33:17.473 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.453078+0000", 2021-10-08T19:33:17.473 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:33:17.474 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.474 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.474 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:33:17.475 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.453086+0000", 2021-10-08T19:33:17.475 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7909999999999993e-06 2021-10-08T19:33:17.475 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.475 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.476 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:33:17.476 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.453113+0000", 2021-10-08T19:33:17.476 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7053e-05 2021-10-08T19:33:17.476 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.476 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.477 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:33:17.477 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.453125+0000", 2021-10-08T19:33:17.477 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1873e-05 2021-10-08T19:33:17.478 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.478 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.478 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:17.479 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.453235+0000", 2021-10-08T19:33:17.479 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010918500000000001 2021-10-08T19:33:17.479 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.479 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.479 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:33:17.480 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.453352+0000", 2021-10-08T19:33:17.480 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011798000000000001 2021-10-08T19:33:17.480 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.480 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.481 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2,6", 2021-10-08T19:33:17.481 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.453467+0000", 2021-10-08T19:33:17.481 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000114002 2021-10-08T19:33:17.481 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.482 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.482 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:17.482 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.458900+0000", 2021-10-08T19:33:17.482 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0054334700000000001 2021-10-08T19:33:17.483 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.483 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.483 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:33:17.483 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.458908+0000", 2021-10-08T19:33:17.483 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7340000000000008e-06 2021-10-08T19:33:17.484 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.484 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.484 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:17.484 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.461570+0000", 2021-10-08T19:33:17.485 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026620250000000002 2021-10-08T19:33:17.485 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:17.485 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:33:17.486 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:17.486 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.486 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.486 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.25465.0:119647 9.0 9:0512ee39:::benchmark_data_smithi097_196985_object3956:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e324)", 2021-10-08T19:33:17.486 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:33:17.453148+0000", 2021-10-08T19:33:17.487 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0083928049999999997, 2021-10-08T19:33:17.487 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0087822190000000008, 2021-10-08T19:33:17.487 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:33:17.487 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2021-10-08T19:33:17.488 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:33:17.488 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.25465", 2021-10-08T19:33:17.488 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:33:17.488 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 119647 2021-10-08T19:33:17.488 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.489 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:33:17.489 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.489 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:33:17.489 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.453148+0000", 2021-10-08T19:33:17.490 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:17.490 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.490 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.490 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:33:17.490 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.453148+0000", 2021-10-08T19:33:17.491 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:17.491 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.491 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.491 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:33:17.492 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.453147+0000", 2021-10-08T19:33:17.492 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:33:17.492 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.492 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.493 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:33:17.493 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.453151+0000", 2021-10-08T19:33:17.493 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3630000000000004e-06 2021-10-08T19:33:17.494 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.494 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.494 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:33:17.494 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.453157+0000", 2021-10-08T19:33:17.494 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7479999999999999e-06 2021-10-08T19:33:17.495 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.495 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.495 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:33:17.495 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.453161+0000", 2021-10-08T19:33:17.495 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.963e-06 2021-10-08T19:33:17.496 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.496 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.496 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:17.496 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.455794+0000", 2021-10-08T19:33:17.497 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026334330000000001 2021-10-08T19:33:17.497 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.497 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.497 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:33:17.497 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.455909+0000", 2021-10-08T19:33:17.498 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000114788 2021-10-08T19:33:17.498 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.498 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.498 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2,6", 2021-10-08T19:33:17.499 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.456025+0000", 2021-10-08T19:33:17.499 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000116094 2021-10-08T19:33:17.499 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:17.499 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:33:17.500 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:17.500 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.500 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.500 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.25465.0:119648 9.a e324/290 9:5e028e38:::benchmark_data_smithi097_196985_object3957:head v 324'7481, mlcod=324'7479)", 2021-10-08T19:33:17.501 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:33:17.455261+0000", 2021-10-08T19:33:17.501 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0062793240000000002, 2021-10-08T19:33:17.501 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0067481310000000001, 2021-10-08T19:33:17.501 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:33:17.502 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2021-10-08T19:33:17.502 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:33:17.502 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.502 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:33:17.503 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.455261+0000", 2021-10-08T19:33:17.503 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:17.503 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.504 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.504 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:33:17.504 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.455261+0000", 2021-10-08T19:33:17.504 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:17.504 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.505 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.505 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:33:17.505 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.455260+0000", 2021-10-08T19:33:17.505 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2021-10-08T19:33:17.506 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.506 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.506 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:33:17.506 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.455268+0000", 2021-10-08T19:33:17.506 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8890000000000002e-06 2021-10-08T19:33:17.507 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.507 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.507 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:33:17.507 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.455279+0000", 2021-10-08T19:33:17.507 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0637e-05 2021-10-08T19:33:17.508 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.508 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.508 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:33:17.508 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.455285+0000", 2021-10-08T19:33:17.509 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0839999999999997e-06 2021-10-08T19:33:17.509 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.509 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.509 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:17.509 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.455318+0000", 2021-10-08T19:33:17.510 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3779000000000003e-05 2021-10-08T19:33:17.510 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.510 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.510 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:33:17.511 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.455333+0000", 2021-10-08T19:33:17.511 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4735999999999999e-05 2021-10-08T19:33:17.511 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:17.511 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:33:17.511 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:17.512 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.512 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.512 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.25465.0:119652 9.f e324/290 9:f535a37b:::benchmark_data_smithi097_196985_object3961:head v 324'7510, mlcod=324'7508)", 2021-10-08T19:33:17.513 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:33:17.457541+0000", 2021-10-08T19:33:17.513 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0039999170000000004, 2021-10-08T19:33:17.513 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0045306180000000001, 2021-10-08T19:33:17.513 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:33:17.514 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2021-10-08T19:33:17.514 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:33:17.514 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.514 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:33:17.515 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.457541+0000", 2021-10-08T19:33:17.515 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:17.515 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.515 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.515 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:33:17.516 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.457541+0000", 2021-10-08T19:33:17.516 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:17.516 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.516 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.517 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:33:17.517 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.457540+0000", 2021-10-08T19:33:17.517 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:33:17.517 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.518 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.518 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:33:17.518 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.457556+0000", 2021-10-08T19:33:17.518 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5733999999999999e-05 2021-10-08T19:33:17.518 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.519 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.519 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:33:17.519 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.457563+0000", 2021-10-08T19:33:17.519 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9600000000000003e-06 2021-10-08T19:33:17.520 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.520 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.520 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:33:17.520 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.457567+0000", 2021-10-08T19:33:17.521 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4920000000000004e-06 2021-10-08T19:33:17.521 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.521 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.521 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:17.521 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.457603+0000", 2021-10-08T19:33:17.522 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6436999999999997e-05 2021-10-08T19:33:17.522 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.522 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.522 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:33:17.522 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.457616+0000", 2021-10-08T19:33:17.523 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2862e-05 2021-10-08T19:33:17.523 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:17.523 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:33:17.523 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:17.523 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.524 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.524 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.25465.0:119650 9.4 9:2df47d15:::benchmark_data_smithi097_196985_object3959:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e324)", 2021-10-08T19:33:17.524 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:33:17.458699+0000", 2021-10-08T19:33:17.524 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.002841957, 2021-10-08T19:33:17.525 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0034457590000000001, 2021-10-08T19:33:17.525 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:33:17.525 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2021-10-08T19:33:17.525 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:33:17.525 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.25465", 2021-10-08T19:33:17.526 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:33:17.526 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 119650 2021-10-08T19:33:17.526 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.526 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:33:17.526 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.527 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:33:17.527 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.458699+0000", 2021-10-08T19:33:17.527 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:17.527 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.528 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.528 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:33:17.528 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.458699+0000", 2021-10-08T19:33:17.528 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:17.528 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.529 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.529 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:33:17.529 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.458696+0000", 2021-10-08T19:33:17.529 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:33:17.529 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.530 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.530 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:33:17.530 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.458703+0000", 2021-10-08T19:33:17.530 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4869999999999996e-06 2021-10-08T19:33:17.531 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.531 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.531 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:33:17.531 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.458714+0000", 2021-10-08T19:33:17.531 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0268000000000001e-05 2021-10-08T19:33:17.532 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.532 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.532 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:33:17.532 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.458719+0000", 2021-10-08T19:33:17.533 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5940000000000001e-06 2021-10-08T19:33:17.533 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.533 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.533 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:17.534 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.458762+0000", 2021-10-08T19:33:17.534 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2746e-05 2021-10-08T19:33:17.534 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.534 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.535 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:33:17.535 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.458891+0000", 2021-10-08T19:33:17.535 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012853800000000001 2021-10-08T19:33:17.535 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.535 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.536 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,4", 2021-10-08T19:33:17.536 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.459010+0000", 2021-10-08T19:33:17.536 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119522 2021-10-08T19:33:17.536 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:17.536 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:33:17.537 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:17.537 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.537 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.537 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.25465.0:119651 9.0 9:0594af0e:::benchmark_data_smithi097_196985_object3960:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e324)", 2021-10-08T19:33:17.538 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:33:17.458732+0000", 2021-10-08T19:33:17.538 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0028089790000000001, 2021-10-08T19:33:17.538 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003485541, 2021-10-08T19:33:17.538 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:33:17.538 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2021-10-08T19:33:17.539 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:33:17.539 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.25465", 2021-10-08T19:33:17.539 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:33:17.539 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 119651 2021-10-08T19:33:17.540 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.540 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:33:17.540 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.540 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:33:17.540 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.458732+0000", 2021-10-08T19:33:17.541 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:17.541 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.541 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.541 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:33:17.541 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.458732+0000", 2021-10-08T19:33:17.542 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:17.542 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.542 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.542 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:33:17.542 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.458731+0000", 2021-10-08T19:33:17.543 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2021-10-08T19:33:17.543 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.543 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.543 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:33:17.543 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.458734+0000", 2021-10-08T19:33:17.544 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8140000000000001e-06 2021-10-08T19:33:17.544 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.544 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.544 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:33:17.544 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.458738+0000", 2021-10-08T19:33:17.545 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5499999999999996e-06 2021-10-08T19:33:17.545 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.545 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.545 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:33:17.545 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.458742+0000", 2021-10-08T19:33:17.546 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7170000000000002e-06 2021-10-08T19:33:17.546 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.546 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.546 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:17.547 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.458932+0000", 2021-10-08T19:33:17.547 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000189996 2021-10-08T19:33:17.547 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.547 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.547 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:33:17.548 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.459036+0000", 2021-10-08T19:33:17.548 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000104196 2021-10-08T19:33:17.548 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.548 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.548 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2,6", 2021-10-08T19:33:17.549 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.459153+0000", 2021-10-08T19:33:17.549 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000117003 2021-10-08T19:33:17.549 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:17.549 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:33:17.550 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:17.550 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.550 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.550 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.25465.0:119656 9.4 9:219dd56b:::benchmark_data_smithi097_196985_object3965:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e324)", 2021-10-08T19:33:17.550 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:33:17.458758+0000", 2021-10-08T19:33:17.551 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0027827490000000002, 2021-10-08T19:33:17.551 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003531274, 2021-10-08T19:33:17.551 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:33:17.551 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2021-10-08T19:33:17.551 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:33:17.552 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.25465", 2021-10-08T19:33:17.552 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:33:17.552 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 119656 2021-10-08T19:33:17.552 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.553 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:33:17.553 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.553 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:33:17.553 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.458758+0000", 2021-10-08T19:33:17.553 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:17.554 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.554 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.554 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:33:17.554 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.458758+0000", 2021-10-08T19:33:17.554 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:17.555 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.555 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.555 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:33:17.555 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.458757+0000", 2021-10-08T19:33:17.556 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2021-10-08T19:33:17.556 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.556 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.556 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:33:17.556 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.458760+0000", 2021-10-08T19:33:17.557 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0170000000000001e-06 2021-10-08T19:33:17.557 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.557 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.557 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:33:17.558 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.458765+0000", 2021-10-08T19:33:17.558 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2089999999999996e-06 2021-10-08T19:33:17.558 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.558 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.558 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:33:17.559 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.458769+0000", 2021-10-08T19:33:17.559 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6440000000000002e-06 2021-10-08T19:33:17.559 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.559 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.560 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:17.560 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.461334+0000", 2021-10-08T19:33:17.560 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0025645020000000002 2021-10-08T19:33:17.560 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.560 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.561 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:33:17.561 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.461449+0000", 2021-10-08T19:33:17.561 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115952 2021-10-08T19:33:17.561 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.561 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.562 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,4", 2021-10-08T19:33:17.562 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.461568+0000", 2021-10-08T19:33:17.562 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011875900000000001 2021-10-08T19:33:17.562 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:17.563 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:33:17.563 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:17.563 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.563 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.563 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.25465.0:119654 9.f e324/290 9:f5ce9469:::benchmark_data_smithi097_196985_object3963:head v 324'7511, mlcod=324'7508)", 2021-10-08T19:33:17.564 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:33:17.461337+0000", 2021-10-08T19:33:17.564 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.000203804, 2021-10-08T19:33:17.564 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010264009999999999, 2021-10-08T19:33:17.564 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:33:17.564 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2021-10-08T19:33:17.565 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:33:17.565 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.565 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:33:17.565 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.461337+0000", 2021-10-08T19:33:17.565 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:17.566 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.566 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.566 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:33:17.566 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.461337+0000", 2021-10-08T19:33:17.567 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:17.567 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.567 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.567 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:33:17.567 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.461335+0000", 2021-10-08T19:33:17.568 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2021-10-08T19:33:17.568 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.568 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.568 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:33:17.568 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.461344+0000", 2021-10-08T19:33:17.569 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3720000000000005e-06 2021-10-08T19:33:17.569 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.569 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.569 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:33:17.569 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.461352+0000", 2021-10-08T19:33:17.570 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4819999999999994e-06 2021-10-08T19:33:17.570 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.570 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.570 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:33:17.570 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.461358+0000", 2021-10-08T19:33:17.571 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4099999999999999e-06 2021-10-08T19:33:17.571 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.571 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.571 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:17.572 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.461429+0000", 2021-10-08T19:33:17.572 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1279000000000007e-05 2021-10-08T19:33:17.572 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:17.572 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:17.572 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:33:17.573 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:33:17.461446+0000", 2021-10-08T19:33:17.573 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7604e-05 2021-10-08T19:33:17.573 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:17.573 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:33:17.573 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:17.574 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:17.574 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:33:17.574 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 8 2021-10-08T19:33:17.574 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:33:17.575 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:17.576 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:33:17.576 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:33:17.677 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:33:17.717 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:17.782 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:33:17.783 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:17.784 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:33:17.886 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:33:17.951 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:18.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:17 smithi117 ceph-mon[34585]: pgmap v601: 178 pgs: 178 active+clean; 7.0 GiB data, 23 GiB used, 693 GiB / 715 GiB avail; 639 B/s rd, 65 MiB/s wr, 1.06k op/s 2021-10-08T19:33:18.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:17 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:33:18.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:17 smithi117 ceph-mon[34585]: 5.f scrub ok 2021-10-08T19:33:18.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:17 smithi097 ceph-mon[41966]: pgmap v601: 178 pgs: 178 active+clean; 7.0 GiB data, 23 GiB used, 693 GiB / 715 GiB avail; 639 B/s rd, 65 MiB/s wr, 1.06k op/s 2021-10-08T19:33:18.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:17 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:33:18.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:17 smithi097 ceph-mon[41966]: 5.f scrub ok 2021-10-08T19:33:18.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:17 smithi097 ceph-mon[32687]: pgmap v601: 178 pgs: 178 active+clean; 7.0 GiB data, 23 GiB used, 693 GiB / 715 GiB avail; 639 B/s rd, 65 MiB/s wr, 1.06k op/s 2021-10-08T19:33:18.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:17 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:33:18.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:17 smithi097 ceph-mon[32687]: 5.f scrub ok 2021-10-08T19:33:18.477 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:33:18.480 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:18.481 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:33:18.582 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:33:18.623 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:18.698 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:33:18.700 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:18.701 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:33:18.802 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:33:18.845 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:18.865 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset nodeep-scrub 2021-10-08T19:33:18.920 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:33:18.922 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:18.923 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:33:19.024 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:33:19.044 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:33:19.097 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2021-10-08T19:33:19.144 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:19.377 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:33:19.389 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:19.390 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:33:19.492 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:33:19.529 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:19.606 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:33:19.609 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:19.610 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:33:19.711 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:33:19.747 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:19.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:19 smithi117 ceph-mon[34585]: 5.8 scrub ok 2021-10-08T19:33:19.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:19 smithi117 ceph-mon[34585]: pgmap v602: 178 pgs: 178 active+clean; 6.9 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1.4 KiB/s rd, 42 MiB/s wr, 967 op/s 2021-10-08T19:33:19.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:19 smithi117 ceph-mon[34585]: 3.b scrub ok 2021-10-08T19:33:19.908 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:19 smithi117 ceph-mon[34585]: 6.12 scrub ok 2021-10-08T19:33:19.908 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:19 smithi117 ceph-mon[34585]: 5.1e scrub ok 2021-10-08T19:33:19.908 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:19 smithi117 ceph-mon[34585]: 4.9 scrub ok 2021-10-08T19:33:19.925 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:33:19.934 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:19.934 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:33:19.945 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:33:19.974 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:33:20.010 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:33:20.036 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:33:20.049 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:33:20.079 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:33:20.084 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:19 smithi097 ceph-mon[32687]: 5.8 scrub ok 2021-10-08T19:33:20.085 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:19 smithi097 ceph-mon[32687]: pgmap v602: 178 pgs: 178 active+clean; 6.9 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1.4 KiB/s rd, 42 MiB/s wr, 967 op/s 2021-10-08T19:33:20.085 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:19 smithi097 ceph-mon[32687]: 3.b scrub ok 2021-10-08T19:33:20.085 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:19 smithi097 ceph-mon[32687]: 6.12 scrub ok 2021-10-08T19:33:20.085 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:19 smithi097 ceph-mon[32687]: 5.1e scrub ok 2021-10-08T19:33:20.086 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:19 smithi097 ceph-mon[32687]: 4.9 scrub ok 2021-10-08T19:33:20.088 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:19 smithi097 ceph-mon[41966]: 5.8 scrub ok 2021-10-08T19:33:20.088 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:19 smithi097 ceph-mon[41966]: pgmap v602: 178 pgs: 178 active+clean; 6.9 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1.4 KiB/s rd, 42 MiB/s wr, 967 op/s 2021-10-08T19:33:20.089 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:19 smithi097 ceph-mon[41966]: 3.b scrub ok 2021-10-08T19:33:20.089 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:19 smithi097 ceph-mon[41966]: 6.12 scrub ok 2021-10-08T19:33:20.089 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:19 smithi097 ceph-mon[41966]: 5.1e scrub ok 2021-10-08T19:33:20.089 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:19 smithi097 ceph-mon[41966]: 4.9 scrub ok 2021-10-08T19:33:20.103 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:33:20.104 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:20.146 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:33:20.193 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:33:20.228 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:33:20.231 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'false' 2021-10-08T19:33:20.231 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'false' 2021-10-08T19:33:20.231 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'false' 2021-10-08T19:33:20.231 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'false' 2021-10-08T19:33:20.232 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'false' 2021-10-08T19:33:20.232 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'false' 2021-10-08T19:33:20.232 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'false' 2021-10-08T19:33:20.232 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'false' 2021-10-08T19:33:20.374 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:33:20.381 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:20.382 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:33:20.484 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:33:20.529 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:20.609 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:33:20.614 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:20.615 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:33:20.716 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:33:20.777 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:21.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:20 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/905019565' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:33:21.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:20 smithi117 ceph-mon[34585]: 4.1f scrub ok 2021-10-08T19:33:21.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:20 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/905019565' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:33:21.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:20 smithi097 ceph-mon[41966]: 4.1f scrub ok 2021-10-08T19:33:21.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:20 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/905019565' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:33:21.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:20 smithi097 ceph-mon[32687]: 4.1f scrub ok 2021-10-08T19:33:21.667 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:33:21.671 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:21.671 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:33:21.776 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:33:21.820 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:33:21.828 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:21.901 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:33:21.907 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:21.908 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:33:21.958 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:21 smithi097 ceph-mon[32687]: pgmap v603: 178 pgs: 178 active+clean; 6.7 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1.2 KiB/s rd, 37 MiB/s wr, 1.21k op/s 2021-10-08T19:33:21.958 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:21 smithi097 ceph-mon[32687]: 2.14 scrub ok 2021-10-08T19:33:21.958 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:21 smithi097 ceph-mon[32687]: 4.3 scrub ok 2021-10-08T19:33:21.959 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:21 smithi097 ceph-mon[41966]: pgmap v603: 178 pgs: 178 active+clean; 6.7 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1.2 KiB/s rd, 37 MiB/s wr, 1.21k op/s 2021-10-08T19:33:21.959 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:21 smithi097 ceph-mon[41966]: 2.14 scrub ok 2021-10-08T19:33:21.959 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:21 smithi097 ceph-mon[41966]: 4.3 scrub ok 2021-10-08T19:33:22.009 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:33:22.058 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:22.111 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:21 smithi117 ceph-mon[34585]: pgmap v603: 178 pgs: 178 active+clean; 6.7 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1.2 KiB/s rd, 37 MiB/s wr, 1.21k op/s 2021-10-08T19:33:22.111 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:21 smithi117 ceph-mon[34585]: 2.14 scrub ok 2021-10-08T19:33:22.111 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:21 smithi117 ceph-mon[34585]: 4.3 scrub ok 2021-10-08T19:33:22.171 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:33:22.183 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:22.186 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:33:22.287 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:33:22.355 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:22.406 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:33:22 smithi117 conmon[69189]: level=error ts=2021-10-08T19:33:22.314Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=2 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:33:22.603 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:33:22.627 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:22.629 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:33:22.731 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:33:22.769 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:22.846 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:33:22.852 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:22.853 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:33:22.955 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:33:22.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:22 smithi097 ceph-mon[32687]: 2.1 scrub ok 2021-10-08T19:33:22.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:22 smithi097 ceph-mon[32687]: 5.7 scrub ok 2021-10-08T19:33:22.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:22 smithi097 ceph-mon[32687]: 6.c scrub ok 2021-10-08T19:33:22.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:22 smithi097 ceph-mon[32687]: 6.10 scrub ok 2021-10-08T19:33:22.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:22 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:33:22.974 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:22 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:33:22.975 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:33:22 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:33:22] "GET /metrics HTTP/1.1" 200 155799 "" "Prometheus/2.18.1" 2021-10-08T19:33:22.977 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:22 smithi097 ceph-mon[41966]: 2.1 scrub ok 2021-10-08T19:33:22.978 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:22 smithi097 ceph-mon[41966]: 5.7 scrub ok 2021-10-08T19:33:22.978 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:22 smithi097 ceph-mon[41966]: 6.c scrub ok 2021-10-08T19:33:22.978 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:22 smithi097 ceph-mon[41966]: 6.10 scrub ok 2021-10-08T19:33:22.979 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:22 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:33:22.979 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:22 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:33:23.019 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:23.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:22 smithi117 ceph-mon[34585]: 2.1 scrub ok 2021-10-08T19:33:23.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:22 smithi117 ceph-mon[34585]: 5.7 scrub ok 2021-10-08T19:33:23.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:22 smithi117 ceph-mon[34585]: 6.c scrub ok 2021-10-08T19:33:23.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:22 smithi117 ceph-mon[34585]: 6.10 scrub ok 2021-10-08T19:33:23.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:22 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:33:23.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:22 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:33:23.714 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:33:23.723 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:23.724 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:33:23.825 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:33:23.860 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.2 to 1 (10000) 2021-10-08T19:33:23.881 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:23.893 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2021-10-08T19:33:24.157 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:33:23 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:33:23] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:33:24.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:23 smithi117 ceph-mon[34585]: pgmap v604: 178 pgs: 178 active+clean; 6.7 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1.1 KiB/s rd, 34 MiB/s wr, 1.09k op/s 2021-10-08T19:33:24.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:23 smithi117 ceph-mon[34585]: osdmap e325: 8 total, 8 up, 8 in 2021-10-08T19:33:24.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:23 smithi117 ceph-mon[34585]: 2.8 scrub ok 2021-10-08T19:33:24.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:23 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3225162769' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2021-10-08T19:33:24.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:23 smithi117 ceph-mon[34585]: from='client.35627 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2021-10-08T19:33:24.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:23 smithi117 ceph-mon[34585]: 4.6 scrub ok 2021-10-08T19:33:24.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:23 smithi117 ceph-mon[34585]: 2.9 scrub ok 2021-10-08T19:33:24.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:23 smithi117 ceph-mon[34585]: 4.8 scrub ok 2021-10-08T19:33:24.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:23 smithi097 ceph-mon[41966]: pgmap v604: 178 pgs: 178 active+clean; 6.7 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1.1 KiB/s rd, 34 MiB/s wr, 1.09k op/s 2021-10-08T19:33:24.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:23 smithi097 ceph-mon[41966]: osdmap e325: 8 total, 8 up, 8 in 2021-10-08T19:33:24.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:23 smithi097 ceph-mon[41966]: 2.8 scrub ok 2021-10-08T19:33:24.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:23 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3225162769' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2021-10-08T19:33:24.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:23 smithi097 ceph-mon[41966]: from='client.35627 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2021-10-08T19:33:24.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:23 smithi097 ceph-mon[41966]: 4.6 scrub ok 2021-10-08T19:33:24.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:23 smithi097 ceph-mon[41966]: 2.9 scrub ok 2021-10-08T19:33:24.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:23 smithi097 ceph-mon[41966]: 4.8 scrub ok 2021-10-08T19:33:24.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:23 smithi097 ceph-mon[32687]: pgmap v604: 178 pgs: 178 active+clean; 6.7 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1.1 KiB/s rd, 34 MiB/s wr, 1.09k op/s 2021-10-08T19:33:24.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:23 smithi097 ceph-mon[32687]: osdmap e325: 8 total, 8 up, 8 in 2021-10-08T19:33:24.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:23 smithi097 ceph-mon[32687]: 2.8 scrub ok 2021-10-08T19:33:24.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:23 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3225162769' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2021-10-08T19:33:24.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:23 smithi097 ceph-mon[32687]: from='client.35627 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2021-10-08T19:33:24.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:23 smithi097 ceph-mon[32687]: 4.6 scrub ok 2021-10-08T19:33:24.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:23 smithi097 ceph-mon[32687]: 2.9 scrub ok 2021-10-08T19:33:24.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:23 smithi097 ceph-mon[32687]: 4.8 scrub ok 2021-10-08T19:33:24.460 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:33:24.466 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:24.467 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:33:24.569 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:33:24.627 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:25.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:24 smithi117 ceph-mon[34585]: from='client.35627 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2021-10-08T19:33:25.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:24 smithi117 ceph-mon[34585]: osdmap e326: 8 total, 8 up, 8 in 2021-10-08T19:33:25.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:24 smithi117 ceph-mon[34585]: 4.17 scrub ok 2021-10-08T19:33:25.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:24 smithi117 ceph-mon[34585]: 4.7 scrub ok 2021-10-08T19:33:25.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:24 smithi097 ceph-mon[41966]: from='client.35627 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2021-10-08T19:33:25.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:24 smithi097 ceph-mon[41966]: osdmap e326: 8 total, 8 up, 8 in 2021-10-08T19:33:25.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:24 smithi097 ceph-mon[41966]: 4.17 scrub ok 2021-10-08T19:33:25.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:24 smithi097 ceph-mon[41966]: 4.7 scrub ok 2021-10-08T19:33:25.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:24 smithi097 ceph-mon[32687]: from='client.35627 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2021-10-08T19:33:25.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:24 smithi097 ceph-mon[32687]: osdmap e326: 8 total, 8 up, 8 in 2021-10-08T19:33:25.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:24 smithi097 ceph-mon[32687]: 4.17 scrub ok 2021-10-08T19:33:25.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:24 smithi097 ceph-mon[32687]: 4.7 scrub ok 2021-10-08T19:33:25.527 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd reweight 4 1 2021-10-08T19:33:25.549 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:33:25.668 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:33:25.674 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:25.675 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:33:25.776 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:33:25.823 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:25.898 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is unset 2021-10-08T19:33:25.898 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:33:25.904 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:25.904 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:33:26.005 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:33:26.027 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2021-10-08T19:33:26.028 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:33:26.073 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:26.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:25 smithi117 ceph-mon[34585]: pgmap v607: 178 pgs: 178 active+clean; 6.4 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 1.4 KiB/s rd, 848 KiB/s wr, 1.37k op/s 2021-10-08T19:33:26.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:25 smithi117 ceph-mon[34585]: 4.5 scrub ok 2021-10-08T19:33:26.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:25 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1221345822' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:33:26.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:25 smithi117 ceph-mon[34585]: from='client.25615 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:33:26.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:25 smithi097 ceph-mon[41966]: pgmap v607: 178 pgs: 178 active+clean; 6.4 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 1.4 KiB/s rd, 848 KiB/s wr, 1.37k op/s 2021-10-08T19:33:26.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:25 smithi097 ceph-mon[41966]: 4.5 scrub ok 2021-10-08T19:33:26.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:25 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1221345822' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:33:26.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:25 smithi097 ceph-mon[41966]: from='client.25615 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:33:26.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:25 smithi097 ceph-mon[32687]: pgmap v607: 178 pgs: 178 active+clean; 6.4 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 1.4 KiB/s rd, 848 KiB/s wr, 1.37k op/s 2021-10-08T19:33:26.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:25 smithi097 ceph-mon[32687]: 4.5 scrub ok 2021-10-08T19:33:26.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:25 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1221345822' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:33:26.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:25 smithi097 ceph-mon[32687]: from='client.25615 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:33:26.279 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:33:26.290 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:26.291 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:33:26.392 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:33:26.446 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:27.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:26 smithi117 ceph-mon[34585]: 4.f scrub ok 2021-10-08T19:33:27.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:26 smithi117 ceph-mon[34585]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:33:27.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:26 smithi117 ceph-mon[34585]: Cluster is now healthy 2021-10-08T19:33:27.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:26 smithi117 ceph-mon[34585]: from='client.25615 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:33:27.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:26 smithi117 ceph-mon[34585]: osdmap e327: 8 total, 8 up, 8 in 2021-10-08T19:33:27.157 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:33:26 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:33:27.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:26 smithi097 ceph-mon[32687]: 4.f scrub ok 2021-10-08T19:33:27.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:26 smithi097 ceph-mon[32687]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:33:27.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:26 smithi097 ceph-mon[32687]: Cluster is now healthy 2021-10-08T19:33:27.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:26 smithi097 ceph-mon[32687]: from='client.25615 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:33:27.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:26 smithi097 ceph-mon[32687]: osdmap e327: 8 total, 8 up, 8 in 2021-10-08T19:33:27.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:26 smithi097 ceph-mon[41966]: 4.f scrub ok 2021-10-08T19:33:27.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:26 smithi097 ceph-mon[41966]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:33:27.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:26 smithi097 ceph-mon[41966]: Cluster is now healthy 2021-10-08T19:33:27.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:26 smithi097 ceph-mon[41966]: from='client.25615 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:33:27.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:26 smithi097 ceph-mon[41966]: osdmap e327: 8 total, 8 up, 8 in 2021-10-08T19:33:27.393 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:33:27.399 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:27.400 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:33:27.502 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:33:27.517 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2021-10-08T19:33:27.553 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:28.171 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:27 smithi097 ceph-mon[32687]: pgmap v609: 178 pgs: 178 active+clean; 6.4 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 912 op/s 2021-10-08T19:33:28.171 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:27 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:33:28.172 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:27 smithi097 ceph-mon[32687]: 4.1d scrub ok 2021-10-08T19:33:28.172 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:27 smithi097 ceph-mon[32687]: 5.5 scrub ok 2021-10-08T19:33:28.172 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:27 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:33:28.172 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:27 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:33:28.173 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:27 smithi097 ceph-mon[41966]: pgmap v609: 178 pgs: 178 active+clean; 6.4 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 912 op/s 2021-10-08T19:33:28.173 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:27 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:33:28.173 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:27 smithi097 ceph-mon[41966]: 4.1d scrub ok 2021-10-08T19:33:28.173 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:27 smithi097 ceph-mon[41966]: 5.5 scrub ok 2021-10-08T19:33:28.174 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:27 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:33:28.174 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:27 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:33:28.275 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:33:28.277 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:28.278 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:33:28.379 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:33:28.395 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:33:28.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:27 smithi117 ceph-mon[34585]: pgmap v609: 178 pgs: 178 active+clean; 6.4 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 912 op/s 2021-10-08T19:33:28.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:27 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:33:28.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:27 smithi117 ceph-mon[34585]: 4.1d scrub ok 2021-10-08T19:33:28.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:27 smithi117 ceph-mon[34585]: 5.5 scrub ok 2021-10-08T19:33:28.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:27 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:33:28.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:27 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:33:28.418 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:28.429 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:33:28.473 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:33:28 smithi097 conmon[33110]: 172.21.15.117 - - [08/Oct/2021:19:33:28] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:33:28.486 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:33:28.489 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:28.490 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:33:28.595 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:33:28.631 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:28.695 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:33:28.701 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:28.703 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:33:28.805 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:33:28.864 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:29.035 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:33:29.044 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:29.045 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:33:29.128 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:28 smithi097 ceph-mon[41966]: 6.1a scrub ok 2021-10-08T19:33:29.129 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:28 smithi097 ceph-mon[41966]: osdmap e328: 8 total, 8 up, 8 in 2021-10-08T19:33:29.129 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:28 smithi097 ceph-mon[41966]: 3.f deep-scrub ok 2021-10-08T19:33:29.129 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:28 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:33:29.130 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:28 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:33:29.130 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:28 smithi097 ceph-mon[41966]: 172.21.15.117 - - [08/Oct/2021:19:33:28] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:33:29.131 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:28 smithi097 ceph-mon[41966]: 5.c scrub ok 2021-10-08T19:33:29.132 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:28 smithi097 ceph-mon[32687]: 6.1a scrub ok 2021-10-08T19:33:29.132 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:28 smithi097 ceph-mon[32687]: osdmap e328: 8 total, 8 up, 8 in 2021-10-08T19:33:29.133 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:28 smithi097 ceph-mon[32687]: 3.f deep-scrub ok 2021-10-08T19:33:29.133 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:28 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:33:29.134 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:28 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:33:29.134 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:28 smithi097 ceph-mon[32687]: 172.21.15.117 - - [08/Oct/2021:19:33:28] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:33:29.134 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:28 smithi097 ceph-mon[32687]: 5.c scrub ok 2021-10-08T19:33:29.146 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:33:29.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:28 smithi117 ceph-mon[34585]: 6.1a scrub ok 2021-10-08T19:33:29.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:28 smithi117 ceph-mon[34585]: osdmap e328: 8 total, 8 up, 8 in 2021-10-08T19:33:29.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:28 smithi117 ceph-mon[34585]: 3.f deep-scrub ok 2021-10-08T19:33:29.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:28 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:33:29.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:28 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:33:29.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:28 smithi117 ceph-mon[34585]: 172.21.15.117 - - [08/Oct/2021:19:33:28] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:33:29.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:28 smithi117 ceph-mon[34585]: 5.c scrub ok 2021-10-08T19:33:29.180 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:29.233 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:33:29.234 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:29.235 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:33:29.336 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:33:29.353 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:33:29.402 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:29.403 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:33:29.455 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:33:29.494 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:33:29.547 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:33:29.567 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:33:29.575 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:29.576 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:33:29.599 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:33:29.635 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:33:29.636 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set noscrub 2021-10-08T19:33:29.677 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:33:29.677 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:33:29.681 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true' 2021-10-08T19:33:29.682 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true' 2021-10-08T19:33:29.683 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true' 2021-10-08T19:33:29.683 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true' 2021-10-08T19:33:29.683 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true' 2021-10-08T19:33:29.683 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true' 2021-10-08T19:33:29.684 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'true' 2021-10-08T19:33:29.684 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'true' 2021-10-08T19:33:29.714 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:29.772 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:33:29.776 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:29.777 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:33:29.879 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:33:29.912 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:29.990 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:33:29.992 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:29.993 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:33:30.095 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:33:30.141 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:30.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:30 smithi117 ceph-mon[34585]: pgmap v611: 178 pgs: 178 active+clean; 6.2 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 1.35k op/s 2021-10-08T19:33:30.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:30 smithi117 ceph-mon[34585]: 6.16 scrub ok 2021-10-08T19:33:30.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:30 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/4252025343' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:33:30.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:30 smithi117 ceph-mon[34585]: 2.15 scrub ok 2021-10-08T19:33:30.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:30 smithi097 ceph-mon[32687]: pgmap v611: 178 pgs: 178 active+clean; 6.2 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 1.35k op/s 2021-10-08T19:33:30.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:30 smithi097 ceph-mon[32687]: 6.16 scrub ok 2021-10-08T19:33:30.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:30 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/4252025343' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:33:30.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:30 smithi097 ceph-mon[32687]: 2.15 scrub ok 2021-10-08T19:33:30.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:30 smithi097 ceph-mon[41966]: pgmap v611: 178 pgs: 178 active+clean; 6.2 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 1.35k op/s 2021-10-08T19:33:30.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:30 smithi097 ceph-mon[41966]: 6.16 scrub ok 2021-10-08T19:33:30.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:30 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/4252025343' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:33:30.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:30 smithi097 ceph-mon[41966]: 2.15 scrub ok 2021-10-08T19:33:31.134 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:33:31.139 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:31.140 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:33:31.241 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:33:31.285 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:31.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:31 smithi097 ceph-mon[32687]: 2.5 deep-scrub ok 2021-10-08T19:33:31.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:31 smithi097 ceph-mon[32687]: 4.1c scrub ok 2021-10-08T19:33:31.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:31 smithi097 ceph-mon[32687]: 4.15 scrub ok 2021-10-08T19:33:31.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:31 smithi097 ceph-mon[32687]: 6.13 scrub ok 2021-10-08T19:33:31.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:31 smithi097 ceph-mon[41966]: 2.5 deep-scrub ok 2021-10-08T19:33:31.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:31 smithi097 ceph-mon[41966]: 4.1c scrub ok 2021-10-08T19:33:31.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:31 smithi097 ceph-mon[41966]: 4.15 scrub ok 2021-10-08T19:33:31.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:31 smithi097 ceph-mon[41966]: 6.13 scrub ok 2021-10-08T19:33:31.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:31 smithi117 ceph-mon[34585]: 2.5 deep-scrub ok 2021-10-08T19:33:31.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:31 smithi117 ceph-mon[34585]: 4.1c scrub ok 2021-10-08T19:33:31.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:31 smithi117 ceph-mon[34585]: 4.15 scrub ok 2021-10-08T19:33:31.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:31 smithi117 ceph-mon[34585]: 6.13 scrub ok 2021-10-08T19:33:31.832 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:33:31.839 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:31.840 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:33:31.941 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:33:31.987 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:32.182 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:32 smithi097 ceph-mon[32687]: pgmap v612: 178 pgs: 1 active+clean+scrubbing, 177 active+clean; 6.0 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 742 B/s rd, 0 B/s wr, 1.27k op/s 2021-10-08T19:33:32.182 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:32 smithi097 ceph-mon[32687]: 5.a scrub ok 2021-10-08T19:33:32.183 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:32 smithi097 ceph-mon[32687]: 3.a scrub ok 2021-10-08T19:33:32.277 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:33:32.280 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:32.281 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:33:32.382 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:33:32.406 INFO:journalctl@ceph.osd.7.smithi117.stdout:Oct 08 19:33:32 smithi117 conmon[54364]: 2021-10-08T19:33:32.025+0000 7ff38a842700 -1 osd.7 pg_epoch: 328 pg[1.0( v 90'130 (0'0,90'130] local-lis/les=170/171 n=0 ec=19/19 lis/c=170/170 les/c/f=171/171/0 sis=170) [7,0,6] r=0 lpr=170 crt=90'130 lcod 90'129 mlcod 0'0 active+clean] scrubber pg(1.0) handle_scrub_reserve_grant: received unsolicited reservation grant from osd 6 (0x55a623ebe9a0) 2021-10-08T19:33:32.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:32 smithi117 ceph-mon[34585]: pgmap v612: 178 pgs: 1 active+clean+scrubbing, 177 active+clean; 6.0 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 742 B/s rd, 0 B/s wr, 1.27k op/s 2021-10-08T19:33:32.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:32 smithi117 ceph-mon[34585]: 5.a scrub ok 2021-10-08T19:33:32.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:32 smithi117 ceph-mon[34585]: 3.a scrub ok 2021-10-08T19:33:32.416 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:33:32.464 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:32 smithi097 ceph-mon[41966]: pgmap v612: 178 pgs: 1 active+clean+scrubbing, 177 active+clean; 6.0 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 742 B/s rd, 0 B/s wr, 1.27k op/s 2021-10-08T19:33:32.466 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:32 smithi097 ceph-mon[41966]: 5.a scrub ok 2021-10-08T19:33:32.467 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:32 smithi097 ceph-mon[41966]: 3.a scrub ok 2021-10-08T19:33:32.473 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:32.598 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:33:32.600 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:32.601 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:33:32.702 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:33:32.720 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:33:32 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:33:32] "GET /metrics HTTP/1.1" 200 155802 "" "Prometheus/2.18.1" 2021-10-08T19:33:32.727 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:32.797 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:33:32.800 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:32.800 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:33:32.884 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:33:32.885 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2021-10-08T19:33:32.885 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2021-10-08T19:33:32.885 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2021-10-08T19:33:32.886 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.886 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:73275 8.1 8:89fa6f07:::benchmark_data_smithi097_144160_object73274:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e208)", 2021-10-08T19:33:32.886 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:28:47.966982+0000", 2021-10-08T19:33:32.886 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 284.911872598, 2021-10-08T19:33:32.887 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2505157219999994, 2021-10-08T19:33:32.887 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:33:32.887 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:33:32.887 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:33:32.887 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:33:32.888 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:33:32.888 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 73275 2021-10-08T19:33:32.888 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.889 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:33:32.889 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.889 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:33:32.889 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:47.966982+0000", 2021-10-08T19:33:32.889 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:32.890 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.890 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.892 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:33:32.892 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:47.966982+0000", 2021-10-08T19:33:32.892 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:32.892 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.893 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.893 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:33:32.893 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:47.966979+0000", 2021-10-08T19:33:32.893 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2021-10-08T19:33:32.893 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.894 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.894 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:33:32.895 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:47.967008+0000", 2021-10-08T19:33:32.895 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9158000000000001e-05 2021-10-08T19:33:32.895 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.895 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.896 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:33:32.896 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:47.967458+0000", 2021-10-08T19:33:32.896 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00044973399999999997 2021-10-08T19:33:32.896 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.897 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.897 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:33:32.897 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:47.967470+0000", 2021-10-08T19:33:32.897 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2388000000000001e-05 2021-10-08T19:33:32.897 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.898 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.898 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:32.898 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:47.969494+0000", 2021-10-08T19:33:32.898 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0020236820000000002 2021-10-08T19:33:32.899 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.899 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.900 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:33:32.900 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:47.969505+0000", 2021-10-08T19:33:32.900 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0984e-05 2021-10-08T19:33:32.901 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.901 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.901 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:32.902 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.971329+0000", 2021-10-08T19:33:32.902 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.001823742 2021-10-08T19:33:32.902 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.902 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.903 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for readable", 2021-10-08T19:33:32.903 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.971371+0000", 2021-10-08T19:33:32.903 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2126000000000003e-05 2021-10-08T19:33:32.903 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.904 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.904 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:32.904 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.191871+0000", 2021-10-08T19:33:32.905 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2204998939999996 2021-10-08T19:33:32.905 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.905 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.905 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:33:32.906 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.192038+0000", 2021-10-08T19:33:32.906 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000167121 2021-10-08T19:33:32.906 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.907 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.907 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:33:32.907 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.192543+0000", 2021-10-08T19:33:32.908 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00050460200000000005 2021-10-08T19:33:32.908 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.908 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.908 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:33:32.909 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.209630+0000", 2021-10-08T19:33:32.909 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.017087327999999999 2021-10-08T19:33:32.909 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.909 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.909 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:32.910 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.212104+0000", 2021-10-08T19:33:32.910 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002473804 2021-10-08T19:33:32.910 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.910 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.911 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:32.911 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.217392+0000", 2021-10-08T19:33:32.911 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0052880749999999997 2021-10-08T19:33:32.912 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.912 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.912 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:33:32.912 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.217450+0000", 2021-10-08T19:33:32.912 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7849000000000001e-05 2021-10-08T19:33:32.913 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.913 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.913 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:33:32.914 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.217498+0000", 2021-10-08T19:33:32.914 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8006000000000001e-05 2021-10-08T19:33:32.914 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:32.914 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:33:32.915 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:32.915 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.915 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.915 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:73306 8.1 8:895a36b8:::benchmark_data_smithi097_144160_object73305:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e208)", 2021-10-08T19:33:32.915 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:28:48.008298+0000", 2021-10-08T19:33:32.916 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 284.87055688999999, 2021-10-08T19:33:32.916 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.209374854, 2021-10-08T19:33:32.916 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:33:32.916 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:33:32.917 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:33:32.917 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:33:32.917 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:33:32.918 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 73306 2021-10-08T19:33:32.918 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.918 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:33:32.918 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.919 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:33:32.919 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.008298+0000", 2021-10-08T19:33:32.919 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:32.919 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.919 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.920 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:33:32.920 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.008298+0000", 2021-10-08T19:33:32.920 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:32.920 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.920 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.921 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:33:32.921 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.008295+0000", 2021-10-08T19:33:32.921 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:33:32.921 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.922 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.922 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:33:32.922 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.008327+0000", 2021-10-08T19:33:32.922 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1297000000000002e-05 2021-10-08T19:33:32.923 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.923 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.923 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:33:32.923 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.008339+0000", 2021-10-08T19:33:32.923 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2251e-05 2021-10-08T19:33:32.924 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.924 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.925 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:33:32.925 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.008346+0000", 2021-10-08T19:33:32.925 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8129999999999998e-06 2021-10-08T19:33:32.925 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.925 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.926 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:32.926 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.010759+0000", 2021-10-08T19:33:32.926 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0024132619999999998 2021-10-08T19:33:32.926 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.927 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.927 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:33:32.927 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.010769+0000", 2021-10-08T19:33:32.928 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0434999999999999e-05 2021-10-08T19:33:32.928 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.928 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.928 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:32.929 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.971792+0000", 2021-10-08T19:33:32.929 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.96102217199999995 2021-10-08T19:33:32.929 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.930 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.930 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for readable", 2021-10-08T19:33:32.930 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.971822+0000", 2021-10-08T19:33:32.931 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0269000000000001e-05 2021-10-08T19:33:32.931 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.931 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.931 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:32.931 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.199122+0000", 2021-10-08T19:33:32.932 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2272997339999998 2021-10-08T19:33:32.932 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.932 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.932 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:33:32.932 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.199260+0000", 2021-10-08T19:33:32.933 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013880699999999999 2021-10-08T19:33:32.933 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.933 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.933 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:33:32.934 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.199451+0000", 2021-10-08T19:33:32.934 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019037200000000001 2021-10-08T19:33:32.934 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.935 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.935 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:33:32.935 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.209636+0000", 2021-10-08T19:33:32.935 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010185550999999999 2021-10-08T19:33:32.936 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.936 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.936 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:32.936 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.212149+0000", 2021-10-08T19:33:32.936 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002513089 2021-10-08T19:33:32.937 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.937 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.937 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:32.937 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.217584+0000", 2021-10-08T19:33:32.938 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.005434454 2021-10-08T19:33:32.938 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.939 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.939 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:33:32.939 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.217632+0000", 2021-10-08T19:33:32.939 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8517999999999999e-05 2021-10-08T19:33:32.940 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.940 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.940 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:33:32.940 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.217672+0000", 2021-10-08T19:33:32.940 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0000999999999999e-05 2021-10-08T19:33:32.941 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:32.941 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:33:32.941 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:32.942 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.942 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.942 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:73333 8.1 8:88236ba2:::benchmark_data_smithi097_144160_object73332:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e208)", 2021-10-08T19:33:32.943 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:28:48.033882+0000", 2021-10-08T19:33:32.943 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 284.84497213999998, 2021-10-08T19:33:32.943 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1888886579999998, 2021-10-08T19:33:32.943 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:33:32.944 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:33:32.944 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:33:32.944 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:33:32.944 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:33:32.944 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 73333 2021-10-08T19:33:32.945 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.945 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:33:32.945 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.945 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:33:32.945 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.033882+0000", 2021-10-08T19:33:32.946 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:32.946 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.946 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.946 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:33:32.947 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.033882+0000", 2021-10-08T19:33:32.947 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:32.947 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.947 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.947 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:33:32.948 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.033880+0000", 2021-10-08T19:33:32.948 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:33:32.948 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.948 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.949 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:33:32.949 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.033911+0000", 2021-10-08T19:33:32.949 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1207000000000001e-05 2021-10-08T19:33:32.949 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.950 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.950 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:33:32.950 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.033924+0000", 2021-10-08T19:33:32.950 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2765999999999999e-05 2021-10-08T19:33:32.950 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.951 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.951 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:33:32.951 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.033931+0000", 2021-10-08T19:33:32.951 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2790000000000001e-06 2021-10-08T19:33:32.951 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.952 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.952 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:32.952 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.034000+0000", 2021-10-08T19:33:32.952 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8910000000000003e-05 2021-10-08T19:33:32.953 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.953 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.953 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:33:32.953 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.034019+0000", 2021-10-08T19:33:32.953 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8651000000000002e-05 2021-10-08T19:33:32.954 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.954 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.954 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:32.954 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.971844+0000", 2021-10-08T19:33:32.955 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.93782492799999995 2021-10-08T19:33:32.955 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.955 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.955 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for readable", 2021-10-08T19:33:32.955 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.971870+0000", 2021-10-08T19:33:32.956 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5979999999999999e-05 2021-10-08T19:33:32.956 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.956 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.956 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:32.956 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.201956+0000", 2021-10-08T19:33:32.957 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2300861599999999 2021-10-08T19:33:32.957 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.957 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.957 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:33:32.958 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.202106+0000", 2021-10-08T19:33:32.958 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015006399999999999 2021-10-08T19:33:32.958 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.958 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.958 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:33:32.959 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.202284+0000", 2021-10-08T19:33:32.959 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000178376 2021-10-08T19:33:32.959 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.959 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.959 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:33:32.960 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.209642+0000", 2021-10-08T19:33:32.960 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0073577699999999996 2021-10-08T19:33:32.960 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.960 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.961 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:32.961 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.212185+0000", 2021-10-08T19:33:32.961 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0025432950000000001 2021-10-08T19:33:32.961 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.961 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.962 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:32.962 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.222661+0000", 2021-10-08T19:33:32.962 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010475976 2021-10-08T19:33:32.962 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.963 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.963 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:33:32.963 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.222725+0000", 2021-10-08T19:33:32.963 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3981999999999998e-05 2021-10-08T19:33:32.963 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.964 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.964 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:33:32.964 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.222771+0000", 2021-10-08T19:33:32.964 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5735000000000002e-05 2021-10-08T19:33:32.964 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:32.965 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:33:32.965 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:32.965 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.965 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.965 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:73350 8.1 8:854a3685:::benchmark_data_smithi097_144160_object73349:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e208)", 2021-10-08T19:33:32.966 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:28:48.048175+0000", 2021-10-08T19:33:32.966 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 284.83067918900002, 2021-10-08T19:33:32.966 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1748325860000008, 2021-10-08T19:33:32.966 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:33:32.967 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:33:32.967 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:33:32.967 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:33:32.967 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:33:32.967 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 73350 2021-10-08T19:33:32.968 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.968 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:33:32.968 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.968 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:33:32.969 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.048175+0000", 2021-10-08T19:33:32.969 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:32.969 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.969 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.969 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:33:32.970 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.048175+0000", 2021-10-08T19:33:32.970 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:32.970 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.970 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.970 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:33:32.971 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.048172+0000", 2021-10-08T19:33:32.971 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2021-10-08T19:33:32.971 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.971 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.972 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:33:32.972 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.048200+0000", 2021-10-08T19:33:32.972 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7370999999999999e-05 2021-10-08T19:33:32.972 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.972 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.973 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:33:32.973 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.048211+0000", 2021-10-08T19:33:32.973 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0936e-05 2021-10-08T19:33:32.973 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.973 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.974 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:33:32.974 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.048216+0000", 2021-10-08T19:33:32.974 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5169999999999999e-06 2021-10-08T19:33:32.974 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.974 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.975 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:32.975 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.048269+0000", 2021-10-08T19:33:32.975 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3291000000000002e-05 2021-10-08T19:33:32.975 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.976 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.976 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:33:32.976 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.048296+0000", 2021-10-08T19:33:32.976 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6451000000000001e-05 2021-10-08T19:33:32.976 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.977 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.977 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:32.977 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.971892+0000", 2021-10-08T19:33:32.977 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.92359580399999996 2021-10-08T19:33:32.978 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.978 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.978 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for readable", 2021-10-08T19:33:32.978 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.971918+0000", 2021-10-08T19:33:32.978 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5751000000000001e-05 2021-10-08T19:33:32.979 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.979 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.979 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:32.979 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.204609+0000", 2021-10-08T19:33:32.979 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2326916399999996 2021-10-08T19:33:32.980 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.980 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.980 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:33:32.980 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.204739+0000", 2021-10-08T19:33:32.980 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013032300000000001 2021-10-08T19:33:32.981 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.981 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.981 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:33:32.981 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.204915+0000", 2021-10-08T19:33:32.982 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000175398 2021-10-08T19:33:32.982 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.982 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.982 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:32.982 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.212255+0000", 2021-10-08T19:33:32.983 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0073401270000000001 2021-10-08T19:33:32.983 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.983 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.983 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:33:32.983 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.212266+0000", 2021-10-08T19:33:32.984 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0679000000000001e-05 2021-10-08T19:33:32.984 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.984 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.984 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:32.985 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.222904+0000", 2021-10-08T19:33:32.985 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010638633 2021-10-08T19:33:32.985 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.985 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.985 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:33:32.986 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.222963+0000", 2021-10-08T19:33:32.986 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8671999999999997e-05 2021-10-08T19:33:32.986 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.986 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.986 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:33:32.987 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.223008+0000", 2021-10-08T19:33:32.987 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4917999999999999e-05 2021-10-08T19:33:32.987 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:32.987 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:33:32.987 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:32.988 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.988 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.988 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:73374 8.1 8:8d5b61ba:::benchmark_data_smithi097_144160_object73373:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e208)", 2021-10-08T19:33:32.988 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:28:48.073270+0000", 2021-10-08T19:33:32.989 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 284.805584684, 2021-10-08T19:33:32.989 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1499620719999992, 2021-10-08T19:33:32.989 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:33:32.989 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:33:32.989 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:33:32.990 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:33:32.990 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:33:32.990 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 73374 2021-10-08T19:33:32.990 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.990 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:33:32.991 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.991 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:33:32.991 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.073270+0000", 2021-10-08T19:33:32.991 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:32.992 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.992 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.992 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:33:32.992 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.073270+0000", 2021-10-08T19:33:32.992 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:32.993 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.993 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.993 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:33:32.993 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.073267+0000", 2021-10-08T19:33:32.993 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:33:32.994 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.994 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.994 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:33:32.994 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.073296+0000", 2021-10-08T19:33:32.995 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8462e-05 2021-10-08T19:33:32.995 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.995 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.995 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:33:32.995 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.073312+0000", 2021-10-08T19:33:32.996 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6441000000000001e-05 2021-10-08T19:33:32.996 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.996 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.996 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:33:32.996 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.073319+0000", 2021-10-08T19:33:32.997 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6959999999999999e-06 2021-10-08T19:33:32.997 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.997 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.997 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:32.997 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.073412+0000", 2021-10-08T19:33:32.998 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.344e-05 2021-10-08T19:33:32.998 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.998 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.998 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:33:32.999 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.073423+0000", 2021-10-08T19:33:32.999 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0499999999999999e-05 2021-10-08T19:33:32.999 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:32.999 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:32.999 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:33.000 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.971938+0000", 2021-10-08T19:33:33.000 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.89851482100000002 2021-10-08T19:33:33.000 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.000 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.000 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for readable", 2021-10-08T19:33:33.001 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.971968+0000", 2021-10-08T19:33:33.001 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0593999999999999e-05 2021-10-08T19:33:33.001 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.001 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.002 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:33.002 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.207315+0000", 2021-10-08T19:33:33.002 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.235346356 2021-10-08T19:33:33.002 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.002 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.003 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:33:33.003 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.207430+0000", 2021-10-08T19:33:33.003 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115017 2021-10-08T19:33:33.003 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.003 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.004 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:33:33.004 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.207595+0000", 2021-10-08T19:33:33.004 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016508500000000001 2021-10-08T19:33:33.004 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.005 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.005 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:33:33.005 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.212274+0000", 2021-10-08T19:33:33.005 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0046793149999999999 2021-10-08T19:33:33.005 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.006 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.006 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:33.006 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.217347+0000", 2021-10-08T19:33:33.006 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0050730030000000004 2021-10-08T19:33:33.006 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.007 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.007 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:33.007 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.223066+0000", 2021-10-08T19:33:33.008 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0057194480000000002 2021-10-08T19:33:33.008 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.008 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.008 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:33:33.009 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.223183+0000", 2021-10-08T19:33:33.009 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000116257 2021-10-08T19:33:33.009 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.009 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.009 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:33:33.010 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.223232+0000", 2021-10-08T19:33:33.010 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9156000000000002e-05 2021-10-08T19:33:33.010 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:33.010 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:33:33.010 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:33.011 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.011 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.011 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:73386 8.1 8:8137ab80:::benchmark_data_smithi097_144160_object73385:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e208)", 2021-10-08T19:33:33.011 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:28:48.084509+0000", 2021-10-08T19:33:33.012 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 284.79434576699998, 2021-10-08T19:33:33.012 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1389014260000003, 2021-10-08T19:33:33.012 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:33:33.012 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:33:33.013 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:33:33.013 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:33:33.013 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:33:33.013 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 73386 2021-10-08T19:33:33.014 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.014 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:33:33.014 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.014 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:33:33.015 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.084509+0000", 2021-10-08T19:33:33.015 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:33.015 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.015 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.016 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:33:33.016 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.084509+0000", 2021-10-08T19:33:33.016 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:33.016 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.017 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.017 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:33:33.017 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.084506+0000", 2021-10-08T19:33:33.018 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:33:33.018 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.019 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.019 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:33:33.020 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.084532+0000", 2021-10-08T19:33:33.020 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6106e-05 2021-10-08T19:33:33.020 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.020 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.021 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:33:33.021 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.084550+0000", 2021-10-08T19:33:33.021 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7223000000000001e-05 2021-10-08T19:33:33.022 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.022 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.022 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:33:33.022 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.084558+0000", 2021-10-08T19:33:33.022 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0129999999999993e-06 2021-10-08T19:33:33.023 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.023 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.023 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:33.023 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.084617+0000", 2021-10-08T19:33:33.024 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9667999999999999e-05 2021-10-08T19:33:33.024 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.024 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.024 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:33:33.024 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.084627+0000", 2021-10-08T19:33:33.025 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0059e-05 2021-10-08T19:33:33.025 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.025 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.025 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:33.026 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.971988+0000", 2021-10-08T19:33:33.026 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.88736098200000002 2021-10-08T19:33:33.026 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.026 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.028 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for readable", 2021-10-08T19:33:33.028 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.972017+0000", 2021-10-08T19:33:33.028 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8685999999999999e-05 2021-10-08T19:33:33.028 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.029 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.029 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:33.029 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.209681+0000", 2021-10-08T19:33:33.029 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2376634419999997 2021-10-08T19:33:33.030 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.030 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.030 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:33:33.030 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.209781+0000", 2021-10-08T19:33:33.030 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000100389 2021-10-08T19:33:33.031 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.031 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.031 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:33:33.031 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.209938+0000", 2021-10-08T19:33:33.031 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015746600000000001 2021-10-08T19:33:33.032 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.032 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.032 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:33:33.032 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.217304+0000", 2021-10-08T19:33:33.033 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0073657230000000002 2021-10-08T19:33:33.033 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.033 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.033 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:33.034 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.217543+0000", 2021-10-08T19:33:33.034 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000238767 2021-10-08T19:33:33.034 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.034 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.034 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:33.035 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.223315+0000", 2021-10-08T19:33:33.035 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0057719060000000003 2021-10-08T19:33:33.035 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.035 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.036 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:33:33.036 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.223366+0000", 2021-10-08T19:33:33.036 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1341000000000002e-05 2021-10-08T19:33:33.036 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.036 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.037 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:33:33.037 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.223410+0000", 2021-10-08T19:33:33.037 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3998000000000001e-05 2021-10-08T19:33:33.037 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:33.037 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:33:33.038 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:33.038 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.038 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.038 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:73424 8.1 8:8e924db9:::benchmark_data_smithi097_144160_object73423:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e208)", 2021-10-08T19:33:33.039 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:28:48.130717+0000", 2021-10-08T19:33:33.039 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 284.748137515, 2021-10-08T19:33:33.039 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0928319900000005, 2021-10-08T19:33:33.039 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:33:33.039 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:33:33.040 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:33:33.040 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:33:33.040 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:33:33.040 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 73424 2021-10-08T19:33:33.040 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.041 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:33:33.041 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.041 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:33:33.041 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.130717+0000", 2021-10-08T19:33:33.042 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:33.042 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.042 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.042 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:33:33.043 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.130717+0000", 2021-10-08T19:33:33.044 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:33.044 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.044 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.044 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:33:33.045 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.130714+0000", 2021-10-08T19:33:33.045 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2021-10-08T19:33:33.045 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.045 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.046 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:33:33.046 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.130739+0000", 2021-10-08T19:33:33.046 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4613e-05 2021-10-08T19:33:33.046 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.047 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.047 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:33:33.047 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.130752+0000", 2021-10-08T19:33:33.047 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3569e-05 2021-10-08T19:33:33.047 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.048 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.048 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:33:33.048 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.130760+0000", 2021-10-08T19:33:33.048 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5569999999999998e-06 2021-10-08T19:33:33.049 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.049 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.049 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:33.049 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.130812+0000", 2021-10-08T19:33:33.049 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2166000000000002e-05 2021-10-08T19:33:33.050 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.050 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.050 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:33:33.050 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.130822+0000", 2021-10-08T19:33:33.050 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0444e-05 2021-10-08T19:33:33.051 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.051 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.051 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:33.051 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.972039+0000", 2021-10-08T19:33:33.052 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.84121698700000003 2021-10-08T19:33:33.052 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.052 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.052 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for readable", 2021-10-08T19:33:33.052 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.972066+0000", 2021-10-08T19:33:33.053 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6469e-05 2021-10-08T19:33:33.053 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.053 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.053 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:33.053 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.212318+0000", 2021-10-08T19:33:33.054 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2402524540000002 2021-10-08T19:33:33.054 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.054 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.055 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:33:33.055 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.212465+0000", 2021-10-08T19:33:33.056 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014612499999999999 2021-10-08T19:33:33.056 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.056 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.056 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:33:33.057 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.212641+0000", 2021-10-08T19:33:33.057 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000176365 2021-10-08T19:33:33.057 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.058 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.058 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:33:33.058 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.217354+0000", 2021-10-08T19:33:33.058 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0047135450000000004 2021-10-08T19:33:33.058 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.059 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.059 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:33.059 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.217716+0000", 2021-10-08T19:33:33.059 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000361238 2021-10-08T19:33:33.060 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.060 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.060 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:33.061 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.223452+0000", 2021-10-08T19:33:33.061 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0057360559999999998 2021-10-08T19:33:33.061 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.061 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.062 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:33:33.062 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.223503+0000", 2021-10-08T19:33:33.062 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0924000000000002e-05 2021-10-08T19:33:33.062 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.062 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.063 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:33:33.063 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.223549+0000", 2021-10-08T19:33:33.063 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6338999999999998e-05 2021-10-08T19:33:33.064 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:33.064 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:33:33.064 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:33.064 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.064 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.065 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:73437 8.1 8:8b9e3e08:::benchmark_data_smithi097_144160_object73436:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e208)", 2021-10-08T19:33:33.065 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:28:48.144924+0000", 2021-10-08T19:33:33.065 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 284.73393061000002, 2021-10-08T19:33:33.065 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0787779369999999, 2021-10-08T19:33:33.066 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:33:33.066 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:33:33.066 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:33:33.066 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:33:33.066 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:33:33.067 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 73437 2021-10-08T19:33:33.067 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.067 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:33:33.067 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.067 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:33:33.068 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.144924+0000", 2021-10-08T19:33:33.068 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:33.068 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.068 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.069 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:33:33.069 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.144924+0000", 2021-10-08T19:33:33.069 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:33.069 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.070 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.070 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:33:33.070 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.144921+0000", 2021-10-08T19:33:33.070 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2021-10-08T19:33:33.070 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.071 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.071 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:33:33.071 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.144973+0000", 2021-10-08T19:33:33.071 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2448000000000003e-05 2021-10-08T19:33:33.072 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.072 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.072 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:33:33.072 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.144986+0000", 2021-10-08T19:33:33.073 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2618e-05 2021-10-08T19:33:33.074 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.074 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.074 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:33:33.074 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.144993+0000", 2021-10-08T19:33:33.075 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8449999999999997e-06 2021-10-08T19:33:33.075 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.075 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.075 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:33.076 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.145034+0000", 2021-10-08T19:33:33.076 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1152999999999997e-05 2021-10-08T19:33:33.076 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.076 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.077 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:33:33.077 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.145041+0000", 2021-10-08T19:33:33.077 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1439999999999997e-06 2021-10-08T19:33:33.077 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.077 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.078 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:33.078 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.972087+0000", 2021-10-08T19:33:33.078 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.82704628099999999 2021-10-08T19:33:33.078 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.078 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.079 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for readable", 2021-10-08T19:33:33.079 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.972123+0000", 2021-10-08T19:33:33.079 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5272999999999999e-05 2021-10-08T19:33:33.079 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.080 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.080 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:33.080 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.214915+0000", 2021-10-08T19:33:33.080 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2427925399999999 2021-10-08T19:33:33.080 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.081 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.081 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:33:33.081 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.215043+0000", 2021-10-08T19:33:33.081 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000127603 2021-10-08T19:33:33.081 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.082 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.082 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:33:33.082 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.215227+0000", 2021-10-08T19:33:33.082 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000183807 2021-10-08T19:33:33.082 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.083 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.083 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:33:33.083 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.217550+0000", 2021-10-08T19:33:33.083 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00232322 2021-10-08T19:33:33.084 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.084 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.084 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:33.084 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.222597+0000", 2021-10-08T19:33:33.084 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0050469269999999997 2021-10-08T19:33:33.085 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.085 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.085 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:33.085 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.223599+0000", 2021-10-08T19:33:33.085 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001002251 2021-10-08T19:33:33.086 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.086 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.086 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:33:33.086 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.223652+0000", 2021-10-08T19:33:33.087 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2967000000000003e-05 2021-10-08T19:33:33.087 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.087 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.087 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:33:33.087 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.223702+0000", 2021-10-08T19:33:33.088 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9839999999999997e-05 2021-10-08T19:33:33.088 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:33.089 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:33:33.089 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:33.089 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.089 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.089 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:73459 8.1 8:80fc3f9b:::benchmark_data_smithi097_144160_object73458:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e208)", 2021-10-08T19:33:33.090 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:28:48.173197+0000", 2021-10-08T19:33:33.090 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 284.70565777100001, 2021-10-08T19:33:33.090 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0506631469999999, 2021-10-08T19:33:33.090 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:33:33.091 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:33:33.091 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:33:33.091 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:33:33.091 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:33:33.091 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 73459 2021-10-08T19:33:33.092 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.092 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:33:33.092 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.092 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:33:33.093 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.173197+0000", 2021-10-08T19:33:33.093 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:33.093 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.093 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.093 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:33:33.094 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.173197+0000", 2021-10-08T19:33:33.094 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:33.094 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.094 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.095 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:33:33.095 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.173194+0000", 2021-10-08T19:33:33.095 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:33:33.095 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.095 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.096 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:33:33.096 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.173244+0000", 2021-10-08T19:33:33.096 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9483e-05 2021-10-08T19:33:33.096 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.096 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.097 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:33:33.097 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.173260+0000", 2021-10-08T19:33:33.097 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6578999999999998e-05 2021-10-08T19:33:33.097 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.097 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.098 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:33:33.098 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.173268+0000", 2021-10-08T19:33:33.098 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4590000000000001e-06 2021-10-08T19:33:33.098 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.099 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.099 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:33.099 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.173327+0000", 2021-10-08T19:33:33.099 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9518000000000002e-05 2021-10-08T19:33:33.099 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.100 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.100 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:33:33.100 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.173338+0000", 2021-10-08T19:33:33.100 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1144999999999999e-05 2021-10-08T19:33:33.100 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.101 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.101 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:33.101 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.972143+0000", 2021-10-08T19:33:33.101 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.79880444799999994 2021-10-08T19:33:33.102 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.102 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.102 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for readable", 2021-10-08T19:33:33.102 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.972169+0000", 2021-10-08T19:33:33.102 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6316999999999999e-05 2021-10-08T19:33:33.103 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.103 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.103 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:33.103 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.217749+0000", 2021-10-08T19:33:33.103 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2455802719999998 2021-10-08T19:33:33.104 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.104 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.104 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:33:33.104 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.217869+0000", 2021-10-08T19:33:33.104 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119535 2021-10-08T19:33:33.105 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.105 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.105 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:33:33.105 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.218041+0000", 2021-10-08T19:33:33.106 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017240800000000001 2021-10-08T19:33:33.106 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.106 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.106 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:33:33.107 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.222786+0000", 2021-10-08T19:33:33.107 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0047445330000000004 2021-10-08T19:33:33.107 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.107 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.107 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:33.108 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.222846+0000", 2021-10-08T19:33:33.108 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9587999999999999e-05 2021-10-08T19:33:33.108 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.108 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.109 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:33.109 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.223741+0000", 2021-10-08T19:33:33.109 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00089562400000000003 2021-10-08T19:33:33.109 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.109 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.110 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:33:33.110 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.223813+0000", 2021-10-08T19:33:33.110 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1542e-05 2021-10-08T19:33:33.110 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.110 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.111 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:33:33.111 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.223860+0000", 2021-10-08T19:33:33.111 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7153000000000001e-05 2021-10-08T19:33:33.111 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:33.112 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:33:33.112 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:33.112 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.112 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.112 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:73493 8.1 8:8aa4135b:::benchmark_data_smithi097_144160_object73492:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e208)", 2021-10-08T19:33:33.113 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:28:48.209399+0000", 2021-10-08T19:33:33.113 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 284.66945596199997, 2021-10-08T19:33:33.113 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0145988500000005, 2021-10-08T19:33:33.113 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:33:33.114 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:33:33.114 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:33:33.114 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:33:33.114 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:33:33.114 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 73493 2021-10-08T19:33:33.115 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.115 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:33:33.115 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.115 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:33:33.116 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.209399+0000", 2021-10-08T19:33:33.116 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:33.116 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.116 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.116 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:33:33.117 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.209399+0000", 2021-10-08T19:33:33.117 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:33.117 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.117 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.117 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:33:33.118 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.209396+0000", 2021-10-08T19:33:33.118 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2021-10-08T19:33:33.118 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.118 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.118 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:33:33.119 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.209421+0000", 2021-10-08T19:33:33.119 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5494e-05 2021-10-08T19:33:33.119 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.119 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.120 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:33:33.120 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.209437+0000", 2021-10-08T19:33:33.120 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5841999999999998e-05 2021-10-08T19:33:33.120 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.120 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.121 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:33:33.121 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.209444+0000", 2021-10-08T19:33:33.121 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.187e-06 2021-10-08T19:33:33.121 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.121 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.122 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:33.122 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.211618+0000", 2021-10-08T19:33:33.122 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021735750000000001 2021-10-08T19:33:33.122 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.122 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.123 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:33:33.123 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.211630+0000", 2021-10-08T19:33:33.123 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1909000000000001e-05 2021-10-08T19:33:33.123 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.124 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.124 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:33.124 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.972189+0000", 2021-10-08T19:33:33.124 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.76055948399999995 2021-10-08T19:33:33.124 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.125 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.125 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for readable", 2021-10-08T19:33:33.125 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.972219+0000", 2021-10-08T19:33:33.125 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9390000000000002e-05 2021-10-08T19:33:33.125 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.126 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.126 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:33.126 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.220189+0000", 2021-10-08T19:33:33.126 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2479707830000004 2021-10-08T19:33:33.126 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.127 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.127 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:33:33.127 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.220316+0000", 2021-10-08T19:33:33.127 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012622999999999999 2021-10-08T19:33:33.127 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.128 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.128 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:33:33.128 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.220488+0000", 2021-10-08T19:33:33.128 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000171991 2021-10-08T19:33:33.129 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.129 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.129 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:33:33.129 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.223026+0000", 2021-10-08T19:33:33.129 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002538003 2021-10-08T19:33:33.130 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.130 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.130 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:33.130 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.223280+0000", 2021-10-08T19:33:33.130 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00025402500000000001 2021-10-08T19:33:33.131 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.131 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.131 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:33.131 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.223910+0000", 2021-10-08T19:33:33.131 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00063042100000000004 2021-10-08T19:33:33.132 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.132 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.132 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:33:33.132 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.223957+0000", 2021-10-08T19:33:33.132 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6814999999999998e-05 2021-10-08T19:33:33.133 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.133 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.133 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:33:33.133 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.223997+0000", 2021-10-08T19:33:33.133 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0568999999999997e-05 2021-10-08T19:33:33.134 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:33.134 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:33:33.134 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:33.134 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.135 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.135 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:73503 8.1 8:8ed958bb:::benchmark_data_smithi097_144160_object73502:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e208)", 2021-10-08T19:33:33.135 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:28:48.225494+0000", 2021-10-08T19:33:33.135 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 284.65336005699999, 2021-10-08T19:33:33.135 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0164567620000007, 2021-10-08T19:33:33.136 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:33:33.136 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:33:33.136 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:33:33.136 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:33:33.136 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:33:33.137 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 73503 2021-10-08T19:33:33.137 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.137 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:33:33.137 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.137 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:33:33.138 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.225494+0000", 2021-10-08T19:33:33.138 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:33.138 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.138 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.139 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:33:33.139 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.225494+0000", 2021-10-08T19:33:33.139 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:33.139 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.139 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.140 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:33:33.140 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.225492+0000", 2021-10-08T19:33:33.140 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:33:33.140 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.140 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.141 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:33:33.141 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.225520+0000", 2021-10-08T19:33:33.141 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8296000000000001e-05 2021-10-08T19:33:33.141 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.141 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.142 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:33:33.142 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.225536+0000", 2021-10-08T19:33:33.142 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5951999999999999e-05 2021-10-08T19:33:33.142 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.142 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.143 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:33:33.143 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.225544+0000", 2021-10-08T19:33:33.143 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6769999999999995e-06 2021-10-08T19:33:33.143 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.143 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.144 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:33.144 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.225593+0000", 2021-10-08T19:33:33.144 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9713000000000003e-05 2021-10-08T19:33:33.144 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.145 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.145 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:33:33.145 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.225604+0000", 2021-10-08T19:33:33.145 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0994e-05 2021-10-08T19:33:33.145 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.146 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.146 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:33.146 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.972240+0000", 2021-10-08T19:33:33.146 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.74663569399999996 2021-10-08T19:33:33.146 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.147 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.147 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for readable", 2021-10-08T19:33:33.147 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.972270+0000", 2021-10-08T19:33:33.147 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9702000000000001e-05 2021-10-08T19:33:33.147 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.148 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.148 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:33.148 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.224039+0000", 2021-10-08T19:33:33.148 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2517693479999998 2021-10-08T19:33:33.149 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.149 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.149 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:33:33.149 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.224188+0000", 2021-10-08T19:33:33.149 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000148484 2021-10-08T19:33:33.150 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.150 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.150 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:33:33.150 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.224381+0000", 2021-10-08T19:33:33.150 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019333299999999999 2021-10-08T19:33:33.151 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.151 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.151 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:33.151 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.241712+0000", 2021-10-08T19:33:33.151 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.017330785000000001 2021-10-08T19:33:33.152 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.152 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.152 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:33.152 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.241733+0000", 2021-10-08T19:33:33.152 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1189999999999999e-05 2021-10-08T19:33:33.153 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.153 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.153 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:33:33.153 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.241853+0000", 2021-10-08T19:33:33.153 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000120291 2021-10-08T19:33:33.154 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.154 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.154 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:33:33.154 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.241907+0000", 2021-10-08T19:33:33.155 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4184000000000002e-05 2021-10-08T19:33:33.155 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.155 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.155 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:33:33.155 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.241951+0000", 2021-10-08T19:33:33.156 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3727999999999999e-05 2021-10-08T19:33:33.156 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:33.156 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:33:33.156 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:33.156 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.157 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.157 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:73506 8.1 8:834b0d8a:::benchmark_data_smithi097_144160_object73505:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e208)", 2021-10-08T19:33:33.157 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:28:48.226088+0000", 2021-10-08T19:33:33.157 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 284.65276683899998, 2021-10-08T19:33:33.157 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0227127159999991, 2021-10-08T19:33:33.158 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:33:33.158 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:33:33.158 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:33:33.158 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:33:33.159 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:33:33.159 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 73506 2021-10-08T19:33:33.159 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.159 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:33:33.159 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.160 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:33:33.160 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.226088+0000", 2021-10-08T19:33:33.160 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:33.160 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.160 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.161 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:33:33.161 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.226088+0000", 2021-10-08T19:33:33.161 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:33.161 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.161 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.162 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:33:33.162 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.226086+0000", 2021-10-08T19:33:33.162 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2021-10-08T19:33:33.162 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.162 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.163 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:33:33.163 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.226121+0000", 2021-10-08T19:33:33.163 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4876999999999998e-05 2021-10-08T19:33:33.163 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.164 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.164 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:33:33.164 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.226132+0000", 2021-10-08T19:33:33.164 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0958000000000001e-05 2021-10-08T19:33:33.164 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.165 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.165 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:33:33.165 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.226138+0000", 2021-10-08T19:33:33.165 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3099999999999997e-06 2021-10-08T19:33:33.165 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.166 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.166 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:33.166 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.226195+0000", 2021-10-08T19:33:33.166 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6918e-05 2021-10-08T19:33:33.166 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.167 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.167 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:33:33.167 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.226206+0000", 2021-10-08T19:33:33.167 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0786e-05 2021-10-08T19:33:33.167 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.168 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.168 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:33.168 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.972292+0000", 2021-10-08T19:33:33.168 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.746085581 2021-10-08T19:33:33.168 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.169 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.169 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for readable", 2021-10-08T19:33:33.169 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.972320+0000", 2021-10-08T19:33:33.169 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8387000000000001e-05 2021-10-08T19:33:33.169 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.170 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.170 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:33.170 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.226739+0000", 2021-10-08T19:33:33.170 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2544193620000001 2021-10-08T19:33:33.171 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.171 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.171 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:33:33.171 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.226868+0000", 2021-10-08T19:33:33.171 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000128718 2021-10-08T19:33:33.172 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.172 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.172 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:33:33.172 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.227065+0000", 2021-10-08T19:33:33.172 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019734599999999999 2021-10-08T19:33:33.173 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.173 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.173 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:33.173 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.241752+0000", 2021-10-08T19:33:33.173 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.014686930000000001 2021-10-08T19:33:33.174 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.174 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.174 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:33:33.174 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.241958+0000", 2021-10-08T19:33:33.174 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00020532600000000001 2021-10-08T19:33:33.175 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.175 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.175 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:33.176 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.248702+0000", 2021-10-08T19:33:33.176 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0067438970000000004 2021-10-08T19:33:33.176 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.176 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.176 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:33:33.177 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.248758+0000", 2021-10-08T19:33:33.177 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5980000000000003e-05 2021-10-08T19:33:33.177 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.177 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.177 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:33:33.178 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.248800+0000", 2021-10-08T19:33:33.178 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2865999999999999e-05 2021-10-08T19:33:33.178 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:33.178 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:33:33.178 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:33.179 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.179 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.179 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:73515 8.1 8:85071a0d:::benchmark_data_smithi097_144160_object73514:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e208)", 2021-10-08T19:33:33.179 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:28:48.237082+0000", 2021-10-08T19:33:33.180 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 284.64177289700001, 2021-10-08T19:33:33.180 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0118306809999993, 2021-10-08T19:33:33.180 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:33:33.180 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:33:33.180 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:33:33.181 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:33:33.181 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:33:33.181 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 73515 2021-10-08T19:33:33.181 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.181 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:33:33.182 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.182 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:33:33.182 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.237082+0000", 2021-10-08T19:33:33.182 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:33.182 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.183 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.183 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:33:33.183 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.237082+0000", 2021-10-08T19:33:33.183 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:33.183 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.184 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.184 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:33:33.184 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.237079+0000", 2021-10-08T19:33:33.184 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:33:33.184 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.185 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.185 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:33:33.185 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.237111+0000", 2021-10-08T19:33:33.185 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1313999999999999e-05 2021-10-08T19:33:33.186 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.186 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.186 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:33:33.186 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.237126+0000", 2021-10-08T19:33:33.186 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5684000000000001e-05 2021-10-08T19:33:33.187 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.187 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.187 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:33:33.187 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.237134+0000", 2021-10-08T19:33:33.187 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8350000000000004e-06 2021-10-08T19:33:33.188 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.188 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.188 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:33.189 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.237191+0000", 2021-10-08T19:33:33.189 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6390000000000001e-05 2021-10-08T19:33:33.189 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.189 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.190 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:33:33.190 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.237202+0000", 2021-10-08T19:33:33.190 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1265e-05 2021-10-08T19:33:33.190 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.191 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.191 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:33.191 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.972343+0000", 2021-10-08T19:33:33.191 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.73514136799999996 2021-10-08T19:33:33.191 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.192 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.192 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for readable", 2021-10-08T19:33:33.192 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.972373+0000", 2021-10-08T19:33:33.192 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0137999999999998e-05 2021-10-08T19:33:33.192 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.193 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.193 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:33.193 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.229315+0000", 2021-10-08T19:33:33.193 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2569420009999996 2021-10-08T19:33:33.193 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.194 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.194 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:33:33.194 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.229524+0000", 2021-10-08T19:33:33.194 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000209039 2021-10-08T19:33:33.194 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.195 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.195 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:33:33.195 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.229702+0000", 2021-10-08T19:33:33.195 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017795500000000001 2021-10-08T19:33:33.196 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.196 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.196 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:33.196 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.241842+0000", 2021-10-08T19:33:33.196 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012139199 2021-10-08T19:33:33.197 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.197 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.197 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:33:33.197 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.241961+0000", 2021-10-08T19:33:33.197 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119314 2021-10-08T19:33:33.198 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.198 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.198 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:33.198 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.248836+0000", 2021-10-08T19:33:33.198 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0068755209999999999 2021-10-08T19:33:33.199 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.199 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.199 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:33:33.199 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.248876+0000", 2021-10-08T19:33:33.199 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9331e-05 2021-10-08T19:33:33.200 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.200 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.200 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:33:33.200 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.248912+0000", 2021-10-08T19:33:33.201 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6565e-05 2021-10-08T19:33:33.201 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:33.201 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:33:33.201 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:33.201 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.202 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.202 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:73526 8.1 8:894ab48c:::benchmark_data_smithi097_144160_object73525:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e208)", 2021-10-08T19:33:33.202 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:28:48.253529+0000", 2021-10-08T19:33:33.202 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 284.62532501599998, 2021-10-08T19:33:33.202 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.9983281320000001, 2021-10-08T19:33:33.203 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:33:33.203 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:33:33.203 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:33:33.203 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:33:33.204 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:33:33.204 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 73526 2021-10-08T19:33:33.204 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.204 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:33:33.204 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.205 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:33:33.205 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.253529+0000", 2021-10-08T19:33:33.205 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:33.205 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.206 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.206 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:33:33.206 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.253529+0000", 2021-10-08T19:33:33.206 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:33.206 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.207 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.207 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:33:33.207 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.253527+0000", 2021-10-08T19:33:33.207 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:33:33.207 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.208 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.208 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:33:33.208 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.253584+0000", 2021-10-08T19:33:33.208 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7321999999999998e-05 2021-10-08T19:33:33.208 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.209 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.209 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:33:33.209 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.253601+0000", 2021-10-08T19:33:33.209 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6806000000000001e-05 2021-10-08T19:33:33.209 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.210 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.210 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:33:33.210 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.253609+0000", 2021-10-08T19:33:33.210 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6920000000000002e-06 2021-10-08T19:33:33.210 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.211 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.211 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:33.211 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.253668+0000", 2021-10-08T19:33:33.211 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8767000000000002e-05 2021-10-08T19:33:33.212 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.212 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.212 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:33:33.212 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.253678+0000", 2021-10-08T19:33:33.212 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0321e-05 2021-10-08T19:33:33.213 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.213 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.213 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:33.213 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.972394+0000", 2021-10-08T19:33:33.213 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.718715565 2021-10-08T19:33:33.214 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.214 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.215 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for readable", 2021-10-08T19:33:33.215 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.972425+0000", 2021-10-08T19:33:33.215 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1086e-05 2021-10-08T19:33:33.216 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.216 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.216 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:33.216 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.231771+0000", 2021-10-08T19:33:33.217 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2593458379999998 2021-10-08T19:33:33.217 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.217 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.217 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:33:33.217 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.231889+0000", 2021-10-08T19:33:33.218 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011863599999999999 2021-10-08T19:33:33.218 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.218 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.218 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:33:33.219 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.232050+0000", 2021-10-08T19:33:33.219 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000160946 2021-10-08T19:33:33.219 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.219 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.219 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:33:33.220 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.242659+0000", 2021-10-08T19:33:33.220 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010608826999999999 2021-10-08T19:33:33.220 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.220 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.221 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:33.221 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.248946+0000", 2021-10-08T19:33:33.221 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0062872570000000001 2021-10-08T19:33:33.221 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.221 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.222 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:33.222 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.251757+0000", 2021-10-08T19:33:33.222 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028104940000000002 2021-10-08T19:33:33.222 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.223 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.223 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:33:33.223 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.251813+0000", 2021-10-08T19:33:33.223 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6793999999999999e-05 2021-10-08T19:33:33.223 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.224 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.224 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:33:33.224 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.251858+0000", 2021-10-08T19:33:33.224 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4144999999999998e-05 2021-10-08T19:33:33.225 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:33.225 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:33:33.225 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:33.225 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.225 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.226 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:73531 8.1 8:838e74b9:::benchmark_data_smithi097_144160_object73530:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e208)", 2021-10-08T19:33:33.226 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:28:48.263045+0000", 2021-10-08T19:33:33.226 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 284.61580990900001, 2021-10-08T19:33:33.226 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.9956922910000001, 2021-10-08T19:33:33.227 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:33:33.227 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:33:33.227 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:33:33.227 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:33:33.227 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:33:33.228 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 73531 2021-10-08T19:33:33.228 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.228 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:33:33.228 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.229 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:33:33.229 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.263045+0000", 2021-10-08T19:33:33.229 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:33.229 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.229 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.230 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:33:33.230 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.263045+0000", 2021-10-08T19:33:33.230 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:33.230 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.231 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.231 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:33:33.231 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.263042+0000", 2021-10-08T19:33:33.231 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2021-10-08T19:33:33.231 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.232 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.232 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:33:33.232 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.263105+0000", 2021-10-08T19:33:33.232 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3717e-05 2021-10-08T19:33:33.233 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.233 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.233 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:33:33.233 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.263118+0000", 2021-10-08T19:33:33.233 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2211999999999999e-05 2021-10-08T19:33:33.234 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.234 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.234 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:33:33.234 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.263125+0000", 2021-10-08T19:33:33.235 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3440000000000003e-06 2021-10-08T19:33:33.235 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.235 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.235 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:33.235 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.263190+0000", 2021-10-08T19:33:33.236 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4729999999999999e-05 2021-10-08T19:33:33.236 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.236 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.236 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:33:33.236 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.263202+0000", 2021-10-08T19:33:33.237 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2337999999999999e-05 2021-10-08T19:33:33.237 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.237 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.237 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:33.238 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.972445+0000", 2021-10-08T19:33:33.238 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.70924335400000005 2021-10-08T19:33:33.238 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.238 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.238 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for readable", 2021-10-08T19:33:33.239 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.972476+0000", 2021-10-08T19:33:33.239 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0936999999999999e-05 2021-10-08T19:33:33.239 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.239 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.240 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:33.240 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.234284+0000", 2021-10-08T19:33:33.240 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2618073860000001 2021-10-08T19:33:33.240 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.241 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.241 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:33:33.241 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.234399+0000", 2021-10-08T19:33:33.241 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000114945 2021-10-08T19:33:33.242 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.242 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.242 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:33:33.242 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.234551+0000", 2021-10-08T19:33:33.242 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000152705 2021-10-08T19:33:33.243 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.243 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.243 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:33:33.243 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.242819+0000", 2021-10-08T19:33:33.243 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0082671419999999999 2021-10-08T19:33:33.244 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.244 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.244 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:33.244 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.252007+0000", 2021-10-08T19:33:33.245 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0091881629999999992 2021-10-08T19:33:33.245 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.245 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.245 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:33.245 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.258634+0000", 2021-10-08T19:33:33.246 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0066275429999999996 2021-10-08T19:33:33.246 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.246 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.246 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:33:33.246 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.258692+0000", 2021-10-08T19:33:33.247 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7448000000000003e-05 2021-10-08T19:33:33.247 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.247 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.247 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:33:33.248 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.258737+0000", 2021-10-08T19:33:33.248 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5151999999999997e-05 2021-10-08T19:33:33.248 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:33.248 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:33:33.248 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:33.249 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.249 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.249 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:73552 8.1 8:846186fd:::benchmark_data_smithi097_144160_object73551:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e208)", 2021-10-08T19:33:33.249 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:28:48.333502+0000", 2021-10-08T19:33:33.249 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 284.54535237800002, 2021-10-08T19:33:33.250 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.9253566009999998, 2021-10-08T19:33:33.250 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:33:33.250 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:33:33.250 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:33:33.251 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:33:33.251 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:33:33.251 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 73552 2021-10-08T19:33:33.251 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.251 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:33:33.252 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.252 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:33:33.252 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.333502+0000", 2021-10-08T19:33:33.252 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:33.253 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.253 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.253 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:33:33.253 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.333502+0000", 2021-10-08T19:33:33.253 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:33.254 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.254 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.254 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:33:33.254 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.333499+0000", 2021-10-08T19:33:33.255 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2021-10-08T19:33:33.255 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.255 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.255 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:33:33.255 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.333551+0000", 2021-10-08T19:33:33.256 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1662000000000001e-05 2021-10-08T19:33:33.256 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.256 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.256 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:33:33.257 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.333567+0000", 2021-10-08T19:33:33.257 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5372000000000001e-05 2021-10-08T19:33:33.257 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.257 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.258 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:33:33.258 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.333573+0000", 2021-10-08T19:33:33.258 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3960000000000003e-06 2021-10-08T19:33:33.258 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.258 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.259 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:33.259 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.333621+0000", 2021-10-08T19:33:33.259 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8152999999999998e-05 2021-10-08T19:33:33.259 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.260 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.260 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:33:33.260 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.333630+0000", 2021-10-08T19:33:33.260 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.3279999999999995e-06 2021-10-08T19:33:33.261 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.261 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.261 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:33.261 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.972500+0000", 2021-10-08T19:33:33.262 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.63886973700000005 2021-10-08T19:33:33.262 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.262 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.262 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for readable", 2021-10-08T19:33:33.262 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:48.972531+0000", 2021-10-08T19:33:33.263 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1198999999999997e-05 2021-10-08T19:33:33.263 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.263 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.263 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:33.264 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.237087+0000", 2021-10-08T19:33:33.264 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2645553239999998 2021-10-08T19:33:33.264 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.264 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.265 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:33:33.265 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.237233+0000", 2021-10-08T19:33:33.265 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014594900000000001 2021-10-08T19:33:33.265 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.265 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.266 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,2", 2021-10-08T19:33:33.266 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.237423+0000", 2021-10-08T19:33:33.266 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00018993300000000001 2021-10-08T19:33:33.266 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.267 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.267 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:33:33.267 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.242827+0000", 2021-10-08T19:33:33.267 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0054044130000000003 2021-10-08T19:33:33.268 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.268 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.268 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:33.268 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.252036+0000", 2021-10-08T19:33:33.268 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0092086909999999998 2021-10-08T19:33:33.269 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.269 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.269 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:33.269 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.258774+0000", 2021-10-08T19:33:33.270 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0067388739999999997 2021-10-08T19:33:33.270 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.270 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.270 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:33:33.271 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.258817+0000", 2021-10-08T19:33:33.271 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2134e-05 2021-10-08T19:33:33.271 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.271 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.271 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:33:33.272 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:56.258859+0000", 2021-10-08T19:33:33.272 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2088000000000001e-05 2021-10-08T19:33:33.272 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:33.272 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:33:33.273 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:33.273 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.273 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.273 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:95876 8.7 8:ed483f67:::benchmark_data_smithi097_144160_object7136:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e227)", 2021-10-08T19:33:33.273 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:29.710830+0000", 2021-10-08T19:33:33.274 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 243.16802492900001, 2021-10-08T19:33:33.274 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.979034229, 2021-10-08T19:33:33.274 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:33:33.274 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:33:33.274 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:33:33.275 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:33:33.275 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:33:33.275 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 95876 2021-10-08T19:33:33.275 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.276 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:33:33.276 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.276 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:33:33.276 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.710830+0000", 2021-10-08T19:33:33.276 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:33.277 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.277 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.277 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:33:33.277 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.710830+0000", 2021-10-08T19:33:33.277 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:33.278 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.278 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.278 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:33:33.278 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.710829+0000", 2021-10-08T19:33:33.279 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2021-10-08T19:33:33.279 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.279 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.279 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:33:33.279 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.710832+0000", 2021-10-08T19:33:33.280 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.92e-06 2021-10-08T19:33:33.280 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.280 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.280 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:33:33.281 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.710837+0000", 2021-10-08T19:33:33.281 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7690000000000004e-06 2021-10-08T19:33:33.281 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.281 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.281 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:33:33.282 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.710840+0000", 2021-10-08T19:33:33.282 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7910000000000002e-06 2021-10-08T19:33:33.282 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.282 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.282 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:33.283 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.723411+0000", 2021-10-08T19:33:33.283 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012570375 2021-10-08T19:33:33.283 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.283 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.284 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:33:33.284 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.723419+0000", 2021-10-08T19:33:33.284 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8159999999999994e-06 2021-10-08T19:33:33.284 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.284 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.285 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:33.285 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:30.607520+0000", 2021-10-08T19:33:33.285 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.88410164899999999 2021-10-08T19:33:33.285 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.285 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.286 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:33:33.286 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:30.607530+0000", 2021-10-08T19:33:33.286 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0020000000000001e-05 2021-10-08T19:33:33.286 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.287 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.287 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:33.287 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.677368+0000", 2021-10-08T19:33:33.287 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.069837903 2021-10-08T19:33:33.287 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.288 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.288 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:33:33.288 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.677501+0000", 2021-10-08T19:33:33.288 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013285200000000001 2021-10-08T19:33:33.289 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.289 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.289 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2,3,6", 2021-10-08T19:33:33.289 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.677840+0000", 2021-10-08T19:33:33.289 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00033849599999999998 2021-10-08T19:33:33.290 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.290 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.290 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:33.290 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.684574+0000", 2021-10-08T19:33:33.290 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0067339519999999996 2021-10-08T19:33:33.291 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.291 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.291 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:33.291 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.689716+0000", 2021-10-08T19:33:33.292 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0051427740000000001 2021-10-08T19:33:33.292 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.292 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.292 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:33.292 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.689743+0000", 2021-10-08T19:33:33.293 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6888000000000001e-05 2021-10-08T19:33:33.293 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.293 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.293 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:33:33.294 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.689748+0000", 2021-10-08T19:33:33.294 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1479999999999997e-06 2021-10-08T19:33:33.294 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.294 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.294 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:33:33.295 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.689793+0000", 2021-10-08T19:33:33.295 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5124999999999999e-05 2021-10-08T19:33:33.295 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.295 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.295 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:33:33.296 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.689864+0000", 2021-10-08T19:33:33.296 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0307000000000003e-05 2021-10-08T19:33:33.296 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:33.296 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:33:33.297 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:33.297 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.297 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.297 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:137829 8.a 8:5bb01cef:::benchmark_data_smithi097_144160_object49089:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e255)", 2021-10-08T19:33:33.297 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:30:31.670983+0000", 2021-10-08T19:33:33.298 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 181.20787132199999, 2021-10-08T19:33:33.298 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1752541220000001, 2021-10-08T19:33:33.298 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:33:33.298 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "reached pg", 2021-10-08T19:33:33.298 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:33:33.299 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:33:33.299 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:33:33.299 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 137829 2021-10-08T19:33:33.299 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.300 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:33:33.300 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.300 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:33:33.300 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.670983+0000", 2021-10-08T19:33:33.300 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:33.301 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.301 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.301 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:33:33.301 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.670983+0000", 2021-10-08T19:33:33.302 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:33.302 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.302 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.302 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:33:33.302 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.670982+0000", 2021-10-08T19:33:33.303 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:33:33.303 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.303 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.303 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:33:33.303 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.670986+0000", 2021-10-08T19:33:33.304 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6490000000000001e-06 2021-10-08T19:33:33.304 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.304 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.304 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:33:33.305 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.670992+0000", 2021-10-08T19:33:33.305 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5809999999999996e-06 2021-10-08T19:33:33.305 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.305 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.305 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:33:33.306 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.670996+0000", 2021-10-08T19:33:33.306 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2490000000000003e-06 2021-10-08T19:33:33.306 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.306 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.307 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:33.307 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.671117+0000", 2021-10-08T19:33:33.307 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000121508 2021-10-08T19:33:33.307 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.307 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.308 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:33:33.308 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.671262+0000", 2021-10-08T19:33:33.308 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014427999999999999 2021-10-08T19:33:33.308 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.308 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.309 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2,5", 2021-10-08T19:33:33.309 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.671404+0000", 2021-10-08T19:33:33.309 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014233200000000001 2021-10-08T19:33:33.309 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.310 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.310 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:33.310 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.685662+0000", 2021-10-08T19:33:33.310 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.014258239000000001 2021-10-08T19:33:33.310 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.311 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.311 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:33.311 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.699603+0000", 2021-10-08T19:33:33.311 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013941011 2021-10-08T19:33:33.312 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.312 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.312 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:33:33.312 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.699611+0000", 2021-10-08T19:33:33.312 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6799999999999993e-06 2021-10-08T19:33:33.313 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.313 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.313 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:33.313 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:32.679865+0000", 2021-10-08T19:33:33.314 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.98025384999999998 2021-10-08T19:33:33.314 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.314 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.314 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:33:33.314 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:32.679874+0000", 2021-10-08T19:33:33.315 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9199999999999993e-06 2021-10-08T19:33:33.315 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.315 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.315 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:33.315 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.834263+0000", 2021-10-08T19:33:33.316 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1543893329999999 2021-10-08T19:33:33.316 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.316 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.317 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for missing object", 2021-10-08T19:33:33.317 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.834418+0000", 2021-10-08T19:33:33.317 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015502199999999999 2021-10-08T19:33:33.318 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.318 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.318 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:33.318 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.846158+0000", 2021-10-08T19:33:33.319 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011740357 2021-10-08T19:33:33.319 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.319 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.320 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:33:33.320 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.846237+0000", 2021-10-08T19:33:33.320 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8860000000000001e-05 2021-10-08T19:33:33.321 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:33.321 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:33:33.321 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:33.322 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.322 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.322 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:137883 8.a 8:5b9b623f:::benchmark_data_smithi097_144160_object49143:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e256)", 2021-10-08T19:33:33.322 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:30:31.734959+0000", 2021-10-08T19:33:33.323 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 181.14389592000001, 2021-10-08T19:33:33.323 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.110620108, 2021-10-08T19:33:33.323 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:33:33.324 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:33:33.324 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:33:33.325 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:33:33.325 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:33:33.325 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 137883 2021-10-08T19:33:33.325 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.325 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:33:33.326 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.326 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:33:33.326 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.734959+0000", 2021-10-08T19:33:33.326 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:33.327 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.327 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.327 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:33:33.328 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.734959+0000", 2021-10-08T19:33:33.328 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:33.328 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.329 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.329 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:33:33.329 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.734956+0000", 2021-10-08T19:33:33.330 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2021-10-08T19:33:33.330 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.330 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.331 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:33:33.331 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.734965+0000", 2021-10-08T19:33:33.331 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.3989999999999993e-06 2021-10-08T19:33:33.332 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.332 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.332 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:33:33.333 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.734981+0000", 2021-10-08T19:33:33.333 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5645999999999999e-05 2021-10-08T19:33:33.334 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.334 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.334 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:33:33.335 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.734989+0000", 2021-10-08T19:33:33.335 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.9100000000000005e-06 2021-10-08T19:33:33.335 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.336 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.336 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:33.336 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.735032+0000", 2021-10-08T19:33:33.337 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2794999999999999e-05 2021-10-08T19:33:33.337 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.337 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.338 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:33:33.338 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.735038+0000", 2021-10-08T19:33:33.339 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5989999999999998e-06 2021-10-08T19:33:33.339 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.339 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.340 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:33.340 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:32.679900+0000", 2021-10-08T19:33:33.340 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.94486208100000002 2021-10-08T19:33:33.341 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.341 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.341 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:33:33.342 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:32.679906+0000", 2021-10-08T19:33:33.342 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1029999999999998e-06 2021-10-08T19:33:33.343 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.343 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.344 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:33.344 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.834719+0000", 2021-10-08T19:33:33.344 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.154812773 2021-10-08T19:33:33.345 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.345 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.346 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:33:33.346 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.834815+0000", 2021-10-08T19:33:33.347 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5756999999999998e-05 2021-10-08T19:33:33.347 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.347 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.348 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2,3,5", 2021-10-08T19:33:33.348 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.834917+0000", 2021-10-08T19:33:33.349 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000101747 2021-10-08T19:33:33.349 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.350 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.350 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:33:33.350 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.838984+0000", 2021-10-08T19:33:33.351 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0040676139999999998 2021-10-08T19:33:33.351 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.352 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.352 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:33.352 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.843891+0000", 2021-10-08T19:33:33.353 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0049068590000000004 2021-10-08T19:33:33.353 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.354 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.354 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:33.354 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.845112+0000", 2021-10-08T19:33:33.355 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012211520000000001 2021-10-08T19:33:33.355 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.356 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.356 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:33.356 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.845373+0000", 2021-10-08T19:33:33.357 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00026047599999999999 2021-10-08T19:33:33.357 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.358 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.358 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:33:33.358 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.845439+0000", 2021-10-08T19:33:33.359 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6371000000000005e-05 2021-10-08T19:33:33.359 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.360 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.360 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:33:33.360 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.845579+0000", 2021-10-08T19:33:33.361 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013954700000000001 2021-10-08T19:33:33.361 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:33.362 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:33:33.362 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:33.362 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.363 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.363 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:137899 8.a 8:576e2e59:::benchmark_data_smithi097_144160_object49159:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e256)", 2021-10-08T19:33:33.364 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:30:31.755542+0000", 2021-10-08T19:33:33.364 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 181.12331253799999, 2021-10-08T19:33:33.364 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0905790579999999, 2021-10-08T19:33:33.365 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:33:33.365 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:33:33.365 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:33:33.366 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:33:33.366 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:33:33.367 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 137899 2021-10-08T19:33:33.367 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.367 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:33:33.368 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.368 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:33:33.369 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.755542+0000", 2021-10-08T19:33:33.369 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:33.370 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.370 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.370 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:33:33.371 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.755542+0000", 2021-10-08T19:33:33.371 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:33.372 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.372 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.373 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:33:33.373 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.755540+0000", 2021-10-08T19:33:33.373 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:33:33.373 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.374 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.374 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:33:33.374 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.755547+0000", 2021-10-08T19:33:33.375 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.567e-06 2021-10-08T19:33:33.375 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.375 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.375 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:33:33.376 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.755557+0000", 2021-10-08T19:33:33.376 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.6739999999999992e-06 2021-10-08T19:33:33.376 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.376 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.377 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:33:33.377 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.755561+0000", 2021-10-08T19:33:33.377 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7520000000000004e-06 2021-10-08T19:33:33.377 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.378 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.378 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:33.378 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.755611+0000", 2021-10-08T19:33:33.378 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9812999999999999e-05 2021-10-08T19:33:33.378 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.379 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.379 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:33:33.379 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.755617+0000", 2021-10-08T19:33:33.379 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8710000000000002e-06 2021-10-08T19:33:33.379 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.380 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.380 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:33.380 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:32.679928+0000", 2021-10-08T19:33:33.380 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.92431098199999995 2021-10-08T19:33:33.381 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.381 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.381 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:33:33.381 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:32.679931+0000", 2021-10-08T19:33:33.381 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5360000000000001e-06 2021-10-08T19:33:33.382 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.382 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.382 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:33.382 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.836873+0000", 2021-10-08T19:33:33.382 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.156941091 2021-10-08T19:33:33.383 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.383 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.383 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:33:33.383 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.837005+0000", 2021-10-08T19:33:33.384 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000132309 2021-10-08T19:33:33.384 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.384 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.384 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2,3,5", 2021-10-08T19:33:33.384 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.837148+0000", 2021-10-08T19:33:33.385 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014335699999999999 2021-10-08T19:33:33.385 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.385 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.385 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:33:33.385 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.839046+0000", 2021-10-08T19:33:33.386 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001897934 2021-10-08T19:33:33.386 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.386 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.386 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:33.387 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.843924+0000", 2021-10-08T19:33:33.387 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.004877808 2021-10-08T19:33:33.387 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.387 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.387 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:33.388 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.845338+0000", 2021-10-08T19:33:33.388 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0014141900000000001 2021-10-08T19:33:33.388 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.388 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.389 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:33.389 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.845936+0000", 2021-10-08T19:33:33.389 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00059748699999999995 2021-10-08T19:33:33.389 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.390 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.390 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:33:33.390 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.845997+0000", 2021-10-08T19:33:33.390 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1303999999999994e-05 2021-10-08T19:33:33.390 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:33.391 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:33.391 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:33:33.391 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.846121+0000", 2021-10-08T19:33:33.391 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000124067 2021-10-08T19:33:33.391 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:33.392 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:33:33.392 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:33.392 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:33.392 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:33:33.392 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:33:33.393 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:33:33.394 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:33 smithi097 ceph-mon[32687]: 2.13 scrub ok 2021-10-08T19:33:33.417 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:33.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:33 smithi097 ceph-mon[32687]: 2.a scrub ok 2021-10-08T19:33:33.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:33 smithi097 ceph-mon[32687]: 5.15 deep-scrub ok 2021-10-08T19:33:33.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:33 smithi097 ceph-mon[41966]: 2.13 scrub ok 2021-10-08T19:33:33.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:33 smithi097 ceph-mon[41966]: 2.a scrub ok 2021-10-08T19:33:33.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:33 smithi097 ceph-mon[41966]: 5.15 deep-scrub ok 2021-10-08T19:33:33.476 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:33:33.483 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:33.484 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:33:33.484 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:33 smithi117 ceph-mon[34585]: 2.13 scrub ok 2021-10-08T19:33:33.485 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:33 smithi117 ceph-mon[34585]: 2.a scrub ok 2021-10-08T19:33:33.485 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:33 smithi117 ceph-mon[34585]: 5.15 deep-scrub ok 2021-10-08T19:33:33.516 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2021-10-08T19:33:33.585 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:33:33.609 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:33.871 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:33:33 smithi117 conmon[69189]: level=error ts=2021-10-08T19:33:33.505Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=2 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:33:34.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:33:33 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:33:33] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:33:34.228 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:33:34.239 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:34.240 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:33:34.341 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:33:34.384 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:34.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:34 smithi097 ceph-mon[32687]: pgmap v613: 178 pgs: 1 active+clean+scrubbing, 177 active+clean; 6.0 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 707 op/s 2021-10-08T19:33:34.474 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:34 smithi097 ceph-mon[32687]: 4.16 scrub ok 2021-10-08T19:33:34.474 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:34 smithi097 ceph-mon[41966]: pgmap v613: 178 pgs: 1 active+clean+scrubbing, 177 active+clean; 6.0 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 707 op/s 2021-10-08T19:33:34.474 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:34 smithi097 ceph-mon[41966]: 4.16 scrub ok 2021-10-08T19:33:34.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:34 smithi117 ceph-mon[34585]: pgmap v613: 178 pgs: 1 active+clean+scrubbing, 177 active+clean; 6.0 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 707 op/s 2021-10-08T19:33:34.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:34 smithi117 ceph-mon[34585]: 4.16 scrub ok 2021-10-08T19:33:35.198 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2021-10-08T19:33:35.287 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:33:35.291 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:35.293 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:33:35.365 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:33:35.397 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:33:35.470 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:33:35 smithi097 conmon[33110]: 172.21.15.97 - - [08/Oct/2021:19:33:35] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:33:35.505 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:35.601 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:33:35.604 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:35.605 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:33:35.707 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:33:35.745 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:35.810 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:33:35.816 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:35.817 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:33:35.918 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:33:35.925 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:33:35.993 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:36.097 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:33:36.121 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:36.122 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:33:36.142 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.4 to 1 (10000) 2021-10-08T19:33:36.223 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:33:36.289 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:36 smithi097 ceph-mon[32687]: pgmap v614: 178 pgs: 178 active+clean; 5.7 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.27k op/s 2021-10-08T19:33:36.290 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:36 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:33:36.290 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:36 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:33:36.290 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:36 smithi097 ceph-mon[32687]: 172.21.15.97 - - [08/Oct/2021:19:33:35] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:33:36.291 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:36 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/475049929' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2021-10-08T19:33:36.291 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:36 smithi097 ceph-mon[41966]: pgmap v614: 178 pgs: 178 active+clean; 5.7 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.27k op/s 2021-10-08T19:33:36.291 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:36 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:33:36.291 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:36 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:33:36.292 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:36 smithi097 ceph-mon[41966]: 172.21.15.97 - - [08/Oct/2021:19:33:35] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:33:36.292 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:36 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/475049929' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2021-10-08T19:33:36.338 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:36.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:36 smithi117 ceph-mon[34585]: pgmap v614: 178 pgs: 178 active+clean; 5.7 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.27k op/s 2021-10-08T19:33:36.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:36 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:33:36.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:36 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:33:36.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:36 smithi117 ceph-mon[34585]: 172.21.15.97 - - [08/Oct/2021:19:33:35] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:33:36.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:36 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/475049929' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2021-10-08T19:33:37.132 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:33:36 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:33:37.132 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:37 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/475049929' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]': finished 2021-10-08T19:33:37.132 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:37 smithi117 ceph-mon[34585]: osdmap e329: 8 total, 8 up, 8 in 2021-10-08T19:33:37.133 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:37 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3966515285' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:33:37.133 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:37 smithi117 ceph-mon[34585]: from='client.35645 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:33:37.153 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:33:37.161 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:37.162 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:33:37.167 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is set 2021-10-08T19:33:37.263 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:33:37.305 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:37.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:37 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/475049929' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]': finished 2021-10-08T19:33:37.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:37 smithi097 ceph-mon[41966]: osdmap e329: 8 total, 8 up, 8 in 2021-10-08T19:33:37.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:37 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3966515285' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:33:37.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:37 smithi097 ceph-mon[41966]: from='client.35645 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:33:37.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:37 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/475049929' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]': finished 2021-10-08T19:33:37.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:37 smithi097 ceph-mon[32687]: osdmap e329: 8 total, 8 up, 8 in 2021-10-08T19:33:37.474 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:37 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3966515285' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:33:37.474 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:37 smithi097 ceph-mon[32687]: from='client.35645 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:33:38.120 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:33:38.123 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:38.124 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:33:38.225 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:33:38.260 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:38.334 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:33:38.338 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:38.339 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:33:38.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:38 smithi117 ceph-mon[34585]: pgmap v616: 178 pgs: 178 active+clean; 5.7 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.28k op/s 2021-10-08T19:33:38.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:38 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:33:38.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:38 smithi117 ceph-mon[34585]: 9.5 scrub ok 2021-10-08T19:33:38.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:38 smithi117 ceph-mon[34585]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:33:38.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:38 smithi117 ceph-mon[34585]: from='client.35645 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:33:38.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:38 smithi117 ceph-mon[34585]: osdmap e330: 8 total, 8 up, 8 in 2021-10-08T19:33:38.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:38 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:33:38.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:38 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:33:38.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:38 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:33:38.409 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:38 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:33:38.441 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:33:38.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:38 smithi097 ceph-mon[32687]: pgmap v616: 178 pgs: 178 active+clean; 5.7 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.28k op/s 2021-10-08T19:33:38.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:38 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:33:38.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:38 smithi097 ceph-mon[32687]: 9.5 scrub ok 2021-10-08T19:33:38.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:38 smithi097 ceph-mon[32687]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:33:38.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:38 smithi097 ceph-mon[32687]: from='client.35645 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:33:38.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:38 smithi097 ceph-mon[32687]: osdmap e330: 8 total, 8 up, 8 in 2021-10-08T19:33:38.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:38 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:33:38.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:38 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:33:38.474 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:38 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:33:38.474 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:38 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:33:38.474 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:38 smithi097 ceph-mon[41966]: pgmap v616: 178 pgs: 178 active+clean; 5.7 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.28k op/s 2021-10-08T19:33:38.475 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:38 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:33:38.475 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:38 smithi097 ceph-mon[41966]: 9.5 scrub ok 2021-10-08T19:33:38.475 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:38 smithi097 ceph-mon[41966]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:33:38.475 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:38 smithi097 ceph-mon[41966]: from='client.35645 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:33:38.476 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:38 smithi097 ceph-mon[41966]: osdmap e330: 8 total, 8 up, 8 in 2021-10-08T19:33:38.476 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:38 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:33:38.476 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:38 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:33:38.476 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:38 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:33:38.476 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:38 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:33:38.483 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:38.572 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:33:38.578 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:38.579 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:33:38.681 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:33:38.733 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:38.820 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:33:38.826 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:38.827 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:33:38.928 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:33:38.969 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:39.060 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:33:39.067 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:39.068 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:33:39.169 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:33:39.208 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:39.284 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:33:39.292 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:39.293 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:33:39.394 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:33:39.418 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd reweight 5 1 2021-10-08T19:33:39.444 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:39.908 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:33:39.925 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:39.926 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:33:40.028 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:33:40.052 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:33:40.081 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:40.197 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:33:40.204 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:40.205 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:33:40.308 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:33:40.351 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:40 smithi097 ceph-mon[41966]: pgmap v618: 178 pgs: 178 active+clean; 5.6 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 978 op/s 2021-10-08T19:33:40.352 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:40 smithi097 ceph-mon[32687]: pgmap v618: 178 pgs: 178 active+clean; 5.6 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 978 op/s 2021-10-08T19:33:40.358 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:40.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:40 smithi117 ceph-mon[34585]: pgmap v618: 178 pgs: 178 active+clean; 5.6 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 978 op/s 2021-10-08T19:33:40.530 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:33:40.534 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:33:40.535 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:40.536 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:33:40.578 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:33:40.607 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:33:40.637 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:33:40.663 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:33:40.684 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:40.707 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:33:40.754 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:33:40.785 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:33:40.822 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:33:40.835 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'false' 2021-10-08T19:33:40.836 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'false' 2021-10-08T19:33:40.836 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'false' 2021-10-08T19:33:40.837 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'false' 2021-10-08T19:33:40.837 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'false' 2021-10-08T19:33:40.837 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'false' 2021-10-08T19:33:40.838 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'false' 2021-10-08T19:33:40.838 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'false' 2021-10-08T19:33:40.854 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:33:40.859 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:40.860 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:33:40.910 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2021-10-08T19:33:40.911 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:33:40.961 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:33:40.993 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:41.069 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:33:41.075 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:41.076 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:33:41.177 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:33:41.215 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:41 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/410984770' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:33:41.216 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:41 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/410984770' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:33:41.221 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:41.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:41 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/410984770' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:33:41.802 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set nodeep-scrub 2021-10-08T19:33:42.146 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:42 smithi097 ceph-mon[32687]: pgmap v619: 178 pgs: 178 active+clean; 5.4 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.35k op/s 2021-10-08T19:33:42.406 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:33:42 smithi117 conmon[69189]: level=error ts=2021-10-08T19:33:42.318Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=1 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:33:42.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:42 smithi117 ceph-mon[34585]: pgmap v619: 178 pgs: 178 active+clean; 5.4 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.35k op/s 2021-10-08T19:33:42.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:42 smithi097 ceph-mon[41966]: pgmap v619: 178 pgs: 178 active+clean; 5.4 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.35k op/s 2021-10-08T19:33:42.635 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2021-10-08T19:33:42.730 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:33:42.736 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:42.737 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:33:42.838 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:33:42.893 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:33:42 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:33:42] "GET /metrics HTTP/1.1" 200 155804 "" "Prometheus/2.18.1" 2021-10-08T19:33:42.901 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:43.056 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:33:43.065 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:43.066 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:33:43.159 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:33:43.160 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:33:43.168 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:33:43.207 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:43.273 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:33:43.276 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:43.276 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:33:43.377 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:33:43.411 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:33:43.412 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:33:43.416 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:43.589 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:33:43.607 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:33:43.626 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:33:43.627 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:43.628 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:33:43.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:33:43.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:33:43.728 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:33:43.770 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:43.854 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:33:43.857 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:43.858 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:33:43.960 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:33:43.991 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:44.071 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:33:44.071 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:33:43 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:33:43] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:33:44.072 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:44.073 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:33:44.174 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:33:44.202 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:44.273 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:33:44.277 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:44.278 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:33:44.379 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:33:44.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:44 smithi117 ceph-mon[34585]: pgmap v620: 178 pgs: 178 active+clean; 5.4 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 645 op/s 2021-10-08T19:33:44.425 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:44 smithi097 ceph-mon[41966]: pgmap v620: 178 pgs: 178 active+clean; 5.4 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 645 op/s 2021-10-08T19:33:44.426 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:44 smithi097 ceph-mon[32687]: pgmap v620: 178 pgs: 178 active+clean; 5.4 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 645 op/s 2021-10-08T19:33:44.430 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:44.523 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:33:44.529 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:44.530 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:33:44.605 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2021-10-08T19:33:44.630 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:33:44.744 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:45.183 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:45 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2120264963' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2021-10-08T19:33:45.184 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:45 smithi097 ceph-mon[32687]: from='client.25630 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2021-10-08T19:33:45.205 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.5 to 1 (10000) 2021-10-08T19:33:45.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:45 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2120264963' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2021-10-08T19:33:45.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:45 smithi097 ceph-mon[41966]: from='client.25630 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2021-10-08T19:33:45.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:45 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2120264963' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2021-10-08T19:33:45.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:45 smithi117 ceph-mon[34585]: from='client.25630 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2021-10-08T19:33:46.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:46 smithi097 ceph-mon[32687]: pgmap v621: 178 pgs: 178 active+clean; 5.0 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.29k op/s 2021-10-08T19:33:46.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:46 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:33:46.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:46 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:33:46.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:46 smithi097 ceph-mon[32687]: from='client.25630 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]': finished 2021-10-08T19:33:46.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:46 smithi097 ceph-mon[32687]: osdmap e331: 8 total, 8 up, 8 in 2021-10-08T19:33:46.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:46 smithi097 ceph-mon[41966]: pgmap v621: 178 pgs: 178 active+clean; 5.0 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.29k op/s 2021-10-08T19:33:46.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:46 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:33:46.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:46 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:33:46.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:46 smithi097 ceph-mon[41966]: from='client.25630 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]': finished 2021-10-08T19:33:46.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:46 smithi097 ceph-mon[41966]: osdmap e331: 8 total, 8 up, 8 in 2021-10-08T19:33:46.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:46 smithi117 ceph-mon[34585]: pgmap v621: 178 pgs: 178 active+clean; 5.0 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.29k op/s 2021-10-08T19:33:46.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:46 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:33:46.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:46 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:33:46.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:46 smithi117 ceph-mon[34585]: from='client.25630 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]': finished 2021-10-08T19:33:46.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:46 smithi117 ceph-mon[34585]: osdmap e331: 8 total, 8 up, 8 in 2021-10-08T19:33:46.998 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:33:47.004 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:47.005 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:33:47.086 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:33:47.105 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd reweight 7 1 2021-10-08T19:33:47.106 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:33:47.137 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:33:46 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:33:47.138 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:47.208 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:33:47.214 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:47.214 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:33:47.315 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:33:47.385 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:47.730 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:33:47.736 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:47.738 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:33:47.754 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2021-10-08T19:33:47.754 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:33:47.840 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:33:47.941 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:48.028 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:33:48.040 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:48.041 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:33:48.143 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:33:48.205 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:48.241 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is set 2021-10-08T19:33:48.284 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:33:48.288 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:48.289 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:33:48.390 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:33:48.430 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:48.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:48 smithi097 ceph-mon[32687]: pgmap v623: 178 pgs: 178 active+clean; 5.0 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1.16k op/s 2021-10-08T19:33:48.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:48 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:33:48.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:48 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/67824738' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:33:48.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:48 smithi097 ceph-mon[32687]: from='client.25636 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:33:48.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:48 smithi097 ceph-mon[41966]: pgmap v623: 178 pgs: 178 active+clean; 5.0 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1.16k op/s 2021-10-08T19:33:48.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:48 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:33:48.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:48 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/67824738' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:33:48.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:48 smithi097 ceph-mon[41966]: from='client.25636 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:33:48.500 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:48 smithi117 ceph-mon[34585]: pgmap v623: 178 pgs: 178 active+clean; 5.0 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1.16k op/s 2021-10-08T19:33:48.500 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:48 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:33:48.500 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:48 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/67824738' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:33:48.501 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:48 smithi117 ceph-mon[34585]: from='client.25636 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:33:48.523 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:33:48.530 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:48.531 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:33:48.633 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:33:48.679 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:49.460 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2021-10-08T19:33:49.461 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:49 smithi097 ceph-mon[32687]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:33:49.461 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:49 smithi097 ceph-mon[32687]: from='client.25636 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:33:49.462 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:49 smithi097 ceph-mon[32687]: osdmap e332: 8 total, 8 up, 8 in 2021-10-08T19:33:49.462 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:49 smithi097 ceph-mon[41966]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:33:49.462 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:49 smithi097 ceph-mon[41966]: from='client.25636 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:33:49.463 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:49 smithi097 ceph-mon[41966]: osdmap e332: 8 total, 8 up, 8 in 2021-10-08T19:33:49.644 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:33:49.648 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:49.649 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:33:49.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:49 smithi117 ceph-mon[34585]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:33:49.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:49 smithi117 ceph-mon[34585]: from='client.25636 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:33:49.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:49 smithi117 ceph-mon[34585]: osdmap e332: 8 total, 8 up, 8 in 2021-10-08T19:33:49.750 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:33:49.797 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:50.110 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:33:50.288 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:33:50.293 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:50.294 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:33:50.395 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:33:50.409 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:33:50.451 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:50.554 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:33:50.557 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:50 smithi097 ceph-mon[41966]: pgmap v625: 178 pgs: 178 active+clean; 4.9 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.07k op/s 2021-10-08T19:33:50.557 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:50 smithi097 ceph-mon[32687]: pgmap v625: 178 pgs: 178 active+clean; 4.9 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.07k op/s 2021-10-08T19:33:50.559 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:50.560 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:33:50.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:50 smithi117 ceph-mon[34585]: pgmap v625: 178 pgs: 178 active+clean; 4.9 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.07k op/s 2021-10-08T19:33:50.660 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:33:50.735 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:51.024 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:33:51.030 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:51.031 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:33:51.037 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:33:51.077 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:33:51.107 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:33:51.131 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:33:51.155 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:33:51.194 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:33:51.195 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:51.235 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:33:51.277 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:33:51.308 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:33:51.331 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true' 2021-10-08T19:33:51.332 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true' 2021-10-08T19:33:51.332 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true' 2021-10-08T19:33:51.332 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true' 2021-10-08T19:33:51.332 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true' 2021-10-08T19:33:51.332 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true' 2021-10-08T19:33:51.333 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'true' 2021-10-08T19:33:51.333 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'true' 2021-10-08T19:33:51.348 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:33:51.354 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:51.355 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:33:51.456 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:33:51.500 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:51.585 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:33:51.588 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:51.588 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:33:51.690 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:33:51.742 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:51.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:51 smithi117 ceph-mon[34585]: pgmap v626: 178 pgs: 178 active+clean; 4.7 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.47k op/s 2021-10-08T19:33:51.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:51 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3283488761' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:33:52.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:51 smithi097 ceph-mon[32687]: pgmap v626: 178 pgs: 178 active+clean; 4.7 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.47k op/s 2021-10-08T19:33:52.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:51 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3283488761' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:33:52.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:51 smithi097 ceph-mon[41966]: pgmap v626: 178 pgs: 178 active+clean; 4.7 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.47k op/s 2021-10-08T19:33:52.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:51 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3283488761' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:33:52.378 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset noscrub 2021-10-08T19:33:52.720 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:33:52 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:33:52] "GET /metrics HTTP/1.1" 200 155804 "" "Prometheus/2.18.1" 2021-10-08T19:33:53.161 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:33:53.165 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:53.166 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:33:53.267 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:33:53.305 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:53.381 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:33:53.385 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:53.386 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:33:53.488 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:33:53.513 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:53.823 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:53 smithi097 ceph-mon[41966]: pgmap v627: 178 pgs: 178 active+clean; 4.7 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 720 op/s 2021-10-08T19:33:54.070 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:33:54.076 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:54.077 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:33:54.078 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:53 smithi097 ceph-mon[32687]: pgmap v627: 178 pgs: 178 active+clean; 4.7 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 720 op/s 2021-10-08T19:33:54.157 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:33:53 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:33:53] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:33:54.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:53 smithi117 ceph-mon[34585]: pgmap v627: 178 pgs: 178 active+clean; 4.7 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 720 op/s 2021-10-08T19:33:54.179 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:33:54.223 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:54.309 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:33:54.339 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:54.340 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:33:54.341 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:33:54.442 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:33:54.502 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:54.684 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:33:54.684 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2021-10-08T19:33:54.684 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2021-10-08T19:33:54.685 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2021-10-08T19:33:54.685 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.685 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:40670 7.e 7:79f4d2b7:::benchmark_data_smithi097_93198_object40669:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2021-10-08T19:33:54.685 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:24:16.257106+0000", 2021-10-08T19:33:54.685 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 578.42097697099996, 2021-10-08T19:33:54.686 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.123129141, 2021-10-08T19:33:54.686 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:33:54.686 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:33:54.686 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:33:54.687 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:33:54.687 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:33:54.687 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 40670 2021-10-08T19:33:54.687 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.687 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:33:54.688 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.688 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:33:54.688 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.257106+0000", 2021-10-08T19:33:54.688 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:54.688 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.689 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.689 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:33:54.689 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.257106+0000", 2021-10-08T19:33:54.689 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:54.689 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.690 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.690 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:33:54.690 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.257104+0000", 2021-10-08T19:33:54.690 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:33:54.691 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.691 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.691 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:33:54.691 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.257130+0000", 2021-10-08T19:33:54.691 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5962e-05 2021-10-08T19:33:54.692 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.692 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.692 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:33:54.692 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.257144+0000", 2021-10-08T19:33:54.693 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.45e-05 2021-10-08T19:33:54.693 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.693 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.693 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:33:54.693 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.257152+0000", 2021-10-08T19:33:54.694 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7179999999999996e-06 2021-10-08T19:33:54.694 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.694 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.694 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:54.694 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.257212+0000", 2021-10-08T19:33:54.695 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.982e-05 2021-10-08T19:33:54.695 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.695 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.695 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:33:54.695 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.257339+0000", 2021-10-08T19:33:54.696 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012701100000000001 2021-10-08T19:33:54.696 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.696 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.696 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:33:54.696 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.257483+0000", 2021-10-08T19:33:54.697 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014382500000000001 2021-10-08T19:33:54.697 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.697 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.697 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:54.698 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.258908+0000", 2021-10-08T19:33:54.698 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0014255209999999999 2021-10-08T19:33:54.698 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.698 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.698 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:33:54.699 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.259885+0000", 2021-10-08T19:33:54.699 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00097671600000000009 2021-10-08T19:33:54.699 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.699 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.700 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:54.700 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.380148+0000", 2021-10-08T19:33:54.700 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.12026337600000001 2021-10-08T19:33:54.700 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.701 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.701 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:33:54.701 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.380200+0000", 2021-10-08T19:33:54.701 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1218999999999999e-05 2021-10-08T19:33:54.701 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.702 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.702 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:33:54.702 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:24:16.380235+0000", 2021-10-08T19:33:54.702 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5683999999999999e-05 2021-10-08T19:33:54.702 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:54.703 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:33:54.703 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:54.703 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.703 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.704 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "MOSDPGPushReply(7.c 132/113 [PushReplyOp(7:369c504f:::benchmark_data_smithi097_93198_object8982:head)])", 2021-10-08T19:33:54.704 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:15.297632+0000", 2021-10-08T19:33:54.704 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 519.38045071399995, 2021-10-08T19:33:54.704 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.14698830299999999, 2021-10-08T19:33:54.704 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:33:54.705 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "reached pg", 2021-10-08T19:33:54.705 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:33:54.705 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.705 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:33:54.705 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.297632+0000", 2021-10-08T19:33:54.706 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:54.706 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.706 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.706 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:33:54.706 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.297632+0000", 2021-10-08T19:33:54.707 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:54.707 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.707 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.707 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:33:54.708 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.297630+0000", 2021-10-08T19:33:54.708 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:33:54.708 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.708 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.708 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:33:54.709 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.297642+0000", 2021-10-08T19:33:54.709 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2211e-05 2021-10-08T19:33:54.709 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.709 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.709 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:33:54.710 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.297659+0000", 2021-10-08T19:33:54.710 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6351999999999999e-05 2021-10-08T19:33:54.710 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.710 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.710 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:33:54.711 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.297668+0000", 2021-10-08T19:33:54.711 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0489999999999993e-06 2021-10-08T19:33:54.711 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.711 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.712 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:54.712 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.297746+0000", 2021-10-08T19:33:54.712 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8319999999999996e-05 2021-10-08T19:33:54.712 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.712 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.713 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:33:54.713 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.444621+0000", 2021-10-08T19:33:54.713 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.14687476299999999 2021-10-08T19:33:54.713 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:54.713 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:33:54.714 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:54.714 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.714 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.714 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.24796.0:86021 7.3 e132/94 7:c211d7cd:::benchmark_data_smithi097_93198_object86020:head v 132'5454, mlcod=132'5452)", 2021-10-08T19:33:54.714 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:15.298120+0000", 2021-10-08T19:33:54.715 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 519.379962783, 2021-10-08T19:33:54.715 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.15232842299999999, 2021-10-08T19:33:54.715 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:33:54.715 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:33:54.715 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:33:54.716 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.716 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:33:54.716 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.298120+0000", 2021-10-08T19:33:54.716 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:54.717 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.717 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.717 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:33:54.717 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.298120+0000", 2021-10-08T19:33:54.717 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:54.718 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.718 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.718 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:33:54.718 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.298119+0000", 2021-10-08T19:33:54.718 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:33:54.719 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.719 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.719 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:33:54.719 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.298150+0000", 2021-10-08T19:33:54.719 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1010999999999998e-05 2021-10-08T19:33:54.720 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.723 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.723 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:33:54.723 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.298161+0000", 2021-10-08T19:33:54.723 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1646e-05 2021-10-08T19:33:54.724 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.724 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.724 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:33:54.724 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.298168+0000", 2021-10-08T19:33:54.725 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7839999999999998e-06 2021-10-08T19:33:54.725 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.725 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.725 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:54.725 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.298249+0000", 2021-10-08T19:33:54.726 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0531999999999994e-05 2021-10-08T19:33:54.726 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.726 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.726 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:33:54.727 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.443678+0000", 2021-10-08T19:33:54.727 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.145429118 2021-10-08T19:33:54.727 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.727 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.727 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:33:54.728 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.450421+0000", 2021-10-08T19:33:54.728 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0067429200000000003 2021-10-08T19:33:54.728 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.728 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.729 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:33:54.729 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.450449+0000", 2021-10-08T19:33:54.729 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8218e-05 2021-10-08T19:33:54.729 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:54.729 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:33:54.730 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:54.730 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.730 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.731 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.24796.0:86023 7.2 e132/94 7:44f50a37:::benchmark_data_smithi097_93198_object86022:head v 132'5410, mlcod=132'5408)", 2021-10-08T19:33:54.731 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:15.298181+0000", 2021-10-08T19:33:54.731 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 519.37990232200002, 2021-10-08T19:33:54.732 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.153767984, 2021-10-08T19:33:54.732 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:33:54.732 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:33:54.732 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:33:54.733 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.733 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:33:54.733 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.298181+0000", 2021-10-08T19:33:54.733 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:54.733 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.734 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.734 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:33:54.734 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.298181+0000", 2021-10-08T19:33:54.734 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:54.734 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.735 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.735 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:33:54.735 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.298180+0000", 2021-10-08T19:33:54.735 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2021-10-08T19:33:54.736 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.736 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.736 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:33:54.736 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.298204+0000", 2021-10-08T19:33:54.736 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3807000000000001e-05 2021-10-08T19:33:54.737 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.737 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.737 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:33:54.737 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.298210+0000", 2021-10-08T19:33:54.737 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5230000000000003e-06 2021-10-08T19:33:54.738 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.738 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.738 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:33:54.738 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.298214+0000", 2021-10-08T19:33:54.739 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1060000000000002e-06 2021-10-08T19:33:54.739 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.739 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.739 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:54.739 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.443716+0000", 2021-10-08T19:33:54.740 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.14550266100000001 2021-10-08T19:33:54.740 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.740 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.741 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:33:54.741 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.443740+0000", 2021-10-08T19:33:54.741 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3581999999999999e-05 2021-10-08T19:33:54.741 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.741 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.742 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:33:54.742 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.451911+0000", 2021-10-08T19:33:54.742 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0081709320000000005 2021-10-08T19:33:54.742 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.743 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.743 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:33:54.743 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.451949+0000", 2021-10-08T19:33:54.743 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7891e-05 2021-10-08T19:33:54.744 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:54.744 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:33:54.744 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:54.744 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.745 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.745 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.24796.0:86030 7.3 e132/94 7:c00202ed:::benchmark_data_smithi097_93198_object86029:head v 132'5455, mlcod=132'5452)", 2021-10-08T19:33:54.745 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:15.298226+0000", 2021-10-08T19:33:54.745 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 519.37985753099997, 2021-10-08T19:33:54.745 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.15224360100000001, 2021-10-08T19:33:54.746 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:33:54.746 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:33:54.746 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:33:54.746 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.747 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:33:54.747 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.298226+0000", 2021-10-08T19:33:54.747 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:54.747 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.747 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.748 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:33:54.748 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.298226+0000", 2021-10-08T19:33:54.748 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:54.748 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.748 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.749 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:33:54.749 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.298225+0000", 2021-10-08T19:33:54.749 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2021-10-08T19:33:54.749 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.750 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.750 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:33:54.750 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.298257+0000", 2021-10-08T19:33:54.750 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2042000000000003e-05 2021-10-08T19:33:54.750 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.751 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.751 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:33:54.751 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.443685+0000", 2021-10-08T19:33:54.751 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.14542758 2021-10-08T19:33:54.751 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.752 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.752 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:33:54.752 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.443696+0000", 2021-10-08T19:33:54.753 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1708e-05 2021-10-08T19:33:54.753 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.753 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.753 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:54.753 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.445731+0000", 2021-10-08T19:33:54.754 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0020341389999999999 2021-10-08T19:33:54.754 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.754 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.754 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:33:54.755 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.445755+0000", 2021-10-08T19:33:54.755 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.472e-05 2021-10-08T19:33:54.755 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.755 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.755 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:33:54.756 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.450453+0000", 2021-10-08T19:33:54.756 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0046977950000000003 2021-10-08T19:33:54.756 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.756 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.757 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:33:54.757 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:15.450469+0000", 2021-10-08T19:33:54.758 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6155e-05 2021-10-08T19:33:54.758 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:54.758 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:33:54.758 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:54.758 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.759 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.759 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:111955 7.e 7:784c34e9:::benchmark_data_smithi097_93198_object20135:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e145)", 2021-10-08T19:33:54.759 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:50.620080+0000", 2021-10-08T19:33:54.760 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 484.05800308900001, 2021-10-08T19:33:54.760 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.113722382, 2021-10-08T19:33:54.760 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:33:54.760 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:33:54.760 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:33:54.761 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:33:54.761 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:33:54.761 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 111955 2021-10-08T19:33:54.761 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.762 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:33:54.762 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.762 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:33:54.762 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.620080+0000", 2021-10-08T19:33:54.763 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:54.763 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.763 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.763 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:33:54.764 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.620080+0000", 2021-10-08T19:33:54.764 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:54.764 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.764 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.764 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:33:54.765 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.620078+0000", 2021-10-08T19:33:54.765 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:33:54.765 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.765 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.765 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:33:54.766 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.620086+0000", 2021-10-08T19:33:54.766 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3529999999999995e-06 2021-10-08T19:33:54.766 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.766 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.767 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:33:54.767 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.620121+0000", 2021-10-08T19:33:54.767 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5071999999999999e-05 2021-10-08T19:33:54.767 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.767 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.768 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:33:54.768 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.620129+0000", 2021-10-08T19:33:54.768 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6249999999999998e-06 2021-10-08T19:33:54.768 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.768 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.769 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:54.769 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.620249+0000", 2021-10-08T19:33:54.769 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000120047 2021-10-08T19:33:54.769 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.770 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.770 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:33:54.770 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.620495+0000", 2021-10-08T19:33:54.770 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024642799999999998 2021-10-08T19:33:54.770 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.771 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.771 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:33:54.771 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.620591+0000", 2021-10-08T19:33:54.771 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.6405999999999998e-05 2021-10-08T19:33:54.771 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.772 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.772 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:33:54.772 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.627176+0000", 2021-10-08T19:33:54.772 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.006584917 2021-10-08T19:33:54.773 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.773 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.773 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:54.773 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.633380+0000", 2021-10-08T19:33:54.773 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.006203615 2021-10-08T19:33:54.774 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.774 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.774 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:54.774 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.733712+0000", 2021-10-08T19:33:54.775 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.10033193999999999 2021-10-08T19:33:54.775 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.775 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.775 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:33:54.775 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.733763+0000", 2021-10-08T19:33:54.776 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0933000000000002e-05 2021-10-08T19:33:54.776 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.776 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.776 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:33:54.777 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.733802+0000", 2021-10-08T19:33:54.777 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9616999999999997e-05 2021-10-08T19:33:54.777 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:54.777 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:33:54.777 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:54.778 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.778 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.778 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:111961 7.e 7:732b47e9:::benchmark_data_smithi097_93198_object20141:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e145)", 2021-10-08T19:33:54.778 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:50.620207+0000", 2021-10-08T19:33:54.778 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 484.05787582099998, 2021-10-08T19:33:54.779 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.124760158, 2021-10-08T19:33:54.779 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:33:54.779 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:33:54.779 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:33:54.780 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:33:54.780 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:33:54.780 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 111961 2021-10-08T19:33:54.780 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.780 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:33:54.781 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.781 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:33:54.781 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.620207+0000", 2021-10-08T19:33:54.781 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:54.781 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.782 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.782 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:33:54.782 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.620207+0000", 2021-10-08T19:33:54.782 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:54.783 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.783 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.783 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:33:54.783 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.620207+0000", 2021-10-08T19:33:54.783 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2021-10-08T19:33:54.784 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.784 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.784 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:33:54.784 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.620210+0000", 2021-10-08T19:33:54.784 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8370000000000001e-06 2021-10-08T19:33:54.785 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.785 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.785 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:33:54.785 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.620215+0000", 2021-10-08T19:33:54.785 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.276e-06 2021-10-08T19:33:54.786 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.786 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.786 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:33:54.786 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.620390+0000", 2021-10-08T19:33:54.787 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017530200000000001 2021-10-08T19:33:54.787 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.787 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.787 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:54.787 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.623533+0000", 2021-10-08T19:33:54.788 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003142841 2021-10-08T19:33:54.788 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.788 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.788 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:33:54.789 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.623648+0000", 2021-10-08T19:33:54.789 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115207 2021-10-08T19:33:54.789 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.789 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.790 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:33:54.790 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.623768+0000", 2021-10-08T19:33:54.790 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119951 2021-10-08T19:33:54.790 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.791 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.791 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:33:54.791 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.635539+0000", 2021-10-08T19:33:54.791 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.01177105 2021-10-08T19:33:54.792 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.792 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.792 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:54.792 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.638723+0000", 2021-10-08T19:33:54.793 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031842709999999998 2021-10-08T19:33:54.793 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.793 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.793 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:54.793 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.744878+0000", 2021-10-08T19:33:54.794 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.106154761 2021-10-08T19:33:54.794 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.794 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.794 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:33:54.794 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.744929+0000", 2021-10-08T19:33:54.795 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0464000000000003e-05 2021-10-08T19:33:54.795 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.795 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.795 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:33:54.796 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.744968+0000", 2021-10-08T19:33:54.796 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8846e-05 2021-10-08T19:33:54.796 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:54.796 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:33:54.796 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:54.797 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.797 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.797 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:111963 7.e 7:73b4f7a7:::benchmark_data_smithi097_93198_object20143:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e145)", 2021-10-08T19:33:54.797 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:50.623389+0000", 2021-10-08T19:33:54.797 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 484.054694009, 2021-10-08T19:33:54.798 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.12169155500000001, 2021-10-08T19:33:54.798 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:33:54.798 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:33:54.798 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:33:54.799 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:33:54.799 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:33:54.799 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 111963 2021-10-08T19:33:54.799 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.799 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:33:54.800 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.800 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:33:54.800 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.623389+0000", 2021-10-08T19:33:54.800 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:54.800 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.801 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.801 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:33:54.801 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.623389+0000", 2021-10-08T19:33:54.802 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:54.803 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.803 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.803 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:33:54.803 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.623387+0000", 2021-10-08T19:33:54.803 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:33:54.804 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.804 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.804 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:33:54.805 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.623395+0000", 2021-10-08T19:33:54.805 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1540000000000002e-06 2021-10-08T19:33:54.805 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.806 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.806 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:33:54.806 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.623411+0000", 2021-10-08T19:33:54.806 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6189999999999999e-05 2021-10-08T19:33:54.807 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.807 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.807 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:33:54.808 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.623418+0000", 2021-10-08T19:33:54.808 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1760000000000004e-06 2021-10-08T19:33:54.808 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.808 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.809 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:54.809 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.627361+0000", 2021-10-08T19:33:54.809 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0039422620000000002 2021-10-08T19:33:54.809 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.809 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.810 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:33:54.810 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.627471+0000", 2021-10-08T19:33:54.810 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000110739 2021-10-08T19:33:54.811 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.811 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.812 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:33:54.812 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.627591+0000", 2021-10-08T19:33:54.812 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011943999999999999 2021-10-08T19:33:54.812 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.813 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.813 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:33:54.813 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.635546+0000", 2021-10-08T19:33:54.813 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0079551589999999998 2021-10-08T19:33:54.813 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.814 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.814 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:54.814 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.638753+0000", 2021-10-08T19:33:54.814 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003206548 2021-10-08T19:33:54.815 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.815 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.815 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:54.815 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.745011+0000", 2021-10-08T19:33:54.816 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.106258413 2021-10-08T19:33:54.816 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.816 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.816 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:33:54.817 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.745047+0000", 2021-10-08T19:33:54.817 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6412000000000003e-05 2021-10-08T19:33:54.817 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.818 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.818 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:33:54.818 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:50.745081+0000", 2021-10-08T19:33:54.818 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3312999999999998e-05 2021-10-08T19:33:54.818 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:54.819 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:33:54.819 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:54.819 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.819 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.820 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:114107 7.c 7:3ff35dbd:::benchmark_data_smithi097_93198_object22287:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e145)", 2021-10-08T19:33:54.820 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:53.644203+0000", 2021-10-08T19:33:54.820 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 481.03387990300001, 2021-10-08T19:33:54.820 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.111443187, 2021-10-08T19:33:54.820 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:33:54.821 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:33:54.821 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:33:54.821 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:33:54.821 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:33:54.821 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 114107 2021-10-08T19:33:54.822 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.822 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:33:54.822 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.823 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:33:54.823 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.644203+0000", 2021-10-08T19:33:54.823 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:54.823 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.823 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.824 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:33:54.824 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.644203+0000", 2021-10-08T19:33:54.824 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:54.824 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.825 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.825 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:33:54.825 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.644201+0000", 2021-10-08T19:33:54.825 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2021-10-08T19:33:54.825 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.826 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.826 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:33:54.826 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.644209+0000", 2021-10-08T19:33:54.826 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7199999999999995e-06 2021-10-08T19:33:54.827 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.827 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.827 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:33:54.828 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.644224+0000", 2021-10-08T19:33:54.828 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.504e-05 2021-10-08T19:33:54.828 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.828 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.828 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:33:54.829 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.644231+0000", 2021-10-08T19:33:54.829 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3029999999999996e-06 2021-10-08T19:33:54.829 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.829 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.830 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:54.830 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.644284+0000", 2021-10-08T19:33:54.830 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3603999999999997e-05 2021-10-08T19:33:54.830 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.831 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.831 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:33:54.831 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.644442+0000", 2021-10-08T19:33:54.831 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015813200000000001 2021-10-08T19:33:54.832 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.832 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.832 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,6,7", 2021-10-08T19:33:54.832 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.644603+0000", 2021-10-08T19:33:54.832 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016012200000000001 2021-10-08T19:33:54.833 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.833 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.833 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:33:54.833 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.648558+0000", 2021-10-08T19:33:54.834 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0039558930000000003 2021-10-08T19:33:54.834 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.834 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.834 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:54.834 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.652465+0000", 2021-10-08T19:33:54.835 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0039062599999999999 2021-10-08T19:33:54.835 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.835 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.836 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:54.836 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.653597+0000", 2021-10-08T19:33:54.836 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011324169999999999 2021-10-08T19:33:54.836 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.837 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.837 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:54.837 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.754606+0000", 2021-10-08T19:33:54.837 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.10100933300000001 2021-10-08T19:33:54.838 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.838 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.838 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:33:54.838 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.754663+0000", 2021-10-08T19:33:54.838 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6833999999999998e-05 2021-10-08T19:33:54.839 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.839 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.839 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:33:54.840 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:53.755646+0000", 2021-10-08T19:33:54.840 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00098320000000000005 2021-10-08T19:33:54.840 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:54.840 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:33:54.841 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:54.841 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.841 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.841 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:117008 7.c 7:3363a241:::benchmark_data_smithi097_93198_object25188:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e146)", 2021-10-08T19:33:54.841 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:57.617126+0000", 2021-10-08T19:33:54.842 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 477.06095740699999, 2021-10-08T19:33:54.842 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.121379295, 2021-10-08T19:33:54.842 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:33:54.842 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:33:54.843 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:33:54.843 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:33:54.843 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:33:54.843 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 117008 2021-10-08T19:33:54.844 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.844 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:33:54.844 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.844 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:33:54.845 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.617126+0000", 2021-10-08T19:33:54.845 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:54.845 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.845 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.846 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:33:54.846 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.617126+0000", 2021-10-08T19:33:54.846 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:54.847 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.847 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.847 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:33:54.847 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.617123+0000", 2021-10-08T19:33:54.848 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2021-10-08T19:33:54.848 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.848 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.848 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:33:54.849 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.617133+0000", 2021-10-08T19:33:54.849 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0288e-05 2021-10-08T19:33:54.849 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.849 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.849 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:33:54.850 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.617151+0000", 2021-10-08T19:33:54.850 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8094999999999999e-05 2021-10-08T19:33:54.850 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.850 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.851 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:33:54.851 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.617160+0000", 2021-10-08T19:33:54.851 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4239999999999993e-06 2021-10-08T19:33:54.851 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.852 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.852 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:54.852 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.617215+0000", 2021-10-08T19:33:54.852 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4775000000000003e-05 2021-10-08T19:33:54.852 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.853 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.853 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:33:54.853 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.617328+0000", 2021-10-08T19:33:54.853 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011385199999999999 2021-10-08T19:33:54.853 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.854 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.854 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,6,7", 2021-10-08T19:33:54.854 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.617481+0000", 2021-10-08T19:33:54.854 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000152743 2021-10-08T19:33:54.855 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.855 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.855 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:33:54.855 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.620950+0000", 2021-10-08T19:33:54.856 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003468989 2021-10-08T19:33:54.856 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.856 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.857 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:54.857 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.627462+0000", 2021-10-08T19:33:54.857 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0065120559999999996 2021-10-08T19:33:54.857 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.857 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.858 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:54.858 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.627990+0000", 2021-10-08T19:33:54.858 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00052785199999999999 2021-10-08T19:33:54.858 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.859 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.859 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:54.859 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.737508+0000", 2021-10-08T19:33:54.859 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.109518013 2021-10-08T19:33:54.860 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.860 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.860 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:33:54.860 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.737568+0000", 2021-10-08T19:33:54.861 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9818999999999998e-05 2021-10-08T19:33:54.861 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.861 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.861 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:33:54.861 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.738505+0000", 2021-10-08T19:33:54.862 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00093716199999999996 2021-10-08T19:33:54.862 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:54.862 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:33:54.862 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:54.863 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.863 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.863 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:117013 7.c 7:3958ebe2:::benchmark_data_smithi097_93198_object25193:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e146)", 2021-10-08T19:33:54.863 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:57.618295+0000", 2021-10-08T19:33:54.864 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 477.05978822600002, 2021-10-08T19:33:54.864 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.124585449, 2021-10-08T19:33:54.864 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:33:54.864 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:33:54.865 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:33:54.865 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:33:54.865 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:33:54.866 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 117013 2021-10-08T19:33:54.866 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.866 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:33:54.866 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.867 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:33:54.867 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.618295+0000", 2021-10-08T19:33:54.867 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:54.867 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.867 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.868 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:33:54.868 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.618295+0000", 2021-10-08T19:33:54.868 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:54.868 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.868 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.869 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:33:54.869 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.618294+0000", 2021-10-08T19:33:54.869 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2021-10-08T19:33:54.869 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.870 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.870 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:33:54.870 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.618297+0000", 2021-10-08T19:33:54.870 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9890000000000001e-06 2021-10-08T19:33:54.870 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.871 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.871 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:33:54.871 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.618302+0000", 2021-10-08T19:33:54.871 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.899e-06 2021-10-08T19:33:54.871 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.872 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.872 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:33:54.872 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.618306+0000", 2021-10-08T19:33:54.872 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1590000000000003e-06 2021-10-08T19:33:54.873 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.873 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.873 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:54.873 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.622144+0000", 2021-10-08T19:33:54.873 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038377849999999998 2021-10-08T19:33:54.874 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.874 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.874 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:33:54.875 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.622310+0000", 2021-10-08T19:33:54.875 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016551700000000001 2021-10-08T19:33:54.875 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.875 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.876 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,6,7", 2021-10-08T19:33:54.876 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.622481+0000", 2021-10-08T19:33:54.876 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017150499999999999 2021-10-08T19:33:54.876 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.876 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.877 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:33:54.877 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.628002+0000", 2021-10-08T19:33:54.877 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.005521214 2021-10-08T19:33:54.877 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.878 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.878 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:54.878 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.630202+0000", 2021-10-08T19:33:54.878 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021990970000000001 2021-10-08T19:33:54.878 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.879 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.879 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:54.879 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.630618+0000", 2021-10-08T19:33:54.879 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00041630500000000001 2021-10-08T19:33:54.879 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.880 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.880 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:54.880 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.741921+0000", 2021-10-08T19:33:54.880 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.11130298299999999 2021-10-08T19:33:54.880 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.881 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.881 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:33:54.881 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.741978+0000", 2021-10-08T19:33:54.881 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7679000000000001e-05 2021-10-08T19:33:54.881 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.882 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.882 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:33:54.882 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.742880+0000", 2021-10-08T19:33:54.882 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00090192699999999996 2021-10-08T19:33:54.883 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:54.883 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:33:54.883 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:54.883 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.884 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.884 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:117023 7.c 7:34632384:::benchmark_data_smithi097_93198_object25203:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e147)", 2021-10-08T19:33:54.884 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:25:57.635872+0000", 2021-10-08T19:33:54.884 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 477.04221131499997, 2021-10-08T19:33:54.885 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.10940074800000001, 2021-10-08T19:33:54.885 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:33:54.885 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:33:54.885 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:33:54.886 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:33:54.886 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:33:54.886 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 117023 2021-10-08T19:33:54.886 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.887 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:33:54.887 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.887 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:33:54.887 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.635872+0000", 2021-10-08T19:33:54.887 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:54.888 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.888 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.888 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:33:54.888 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.635872+0000", 2021-10-08T19:33:54.888 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:54.889 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.889 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.889 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:33:54.889 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.635869+0000", 2021-10-08T19:33:54.889 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999967 2021-10-08T19:33:54.890 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.890 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.890 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:33:54.890 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.635879+0000", 2021-10-08T19:33:54.891 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0352e-05 2021-10-08T19:33:54.891 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.891 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.891 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:33:54.891 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.635897+0000", 2021-10-08T19:33:54.892 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8068999999999999e-05 2021-10-08T19:33:54.892 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.892 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.892 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:33:54.892 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.635905+0000", 2021-10-08T19:33:54.893 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3950000000000003e-06 2021-10-08T19:33:54.893 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.893 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.894 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:54.894 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.635962+0000", 2021-10-08T19:33:54.894 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7688000000000001e-05 2021-10-08T19:33:54.894 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.895 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.895 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:33:54.895 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.636136+0000", 2021-10-08T19:33:54.895 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000174067 2021-10-08T19:33:54.895 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.896 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.896 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,6,7", 2021-10-08T19:33:54.896 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.636288+0000", 2021-10-08T19:33:54.896 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000152075 2021-10-08T19:33:54.896 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.897 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.897 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:33:54.897 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.639512+0000", 2021-10-08T19:33:54.897 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032239439999999999 2021-10-08T19:33:54.897 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.898 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.898 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:54.898 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.644075+0000", 2021-10-08T19:33:54.898 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0045628750000000001 2021-10-08T19:33:54.899 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.899 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.899 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:54.899 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.644128+0000", 2021-10-08T19:33:54.899 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3115999999999998e-05 2021-10-08T19:33:54.900 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.900 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.900 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:54.900 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.744275+0000", 2021-10-08T19:33:54.900 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.100146364 2021-10-08T19:33:54.901 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.901 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.901 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:33:54.901 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.744334+0000", 2021-10-08T19:33:54.902 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8984999999999999e-05 2021-10-08T19:33:54.902 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.902 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.902 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:33:54.903 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:25:57.745273+0000", 2021-10-08T19:33:54.903 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00093895199999999995 2021-10-08T19:33:54.903 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:54.903 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:33:54.904 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:54.904 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.904 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.904 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:158640 7.e 7:705eda0e:::benchmark_data_smithi097_93198_object66820:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158)", 2021-10-08T19:33:54.905 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:26:53.907516+0000", 2021-10-08T19:33:54.905 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 420.77056754, 2021-10-08T19:33:54.905 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.115901639, 2021-10-08T19:33:54.906 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:33:54.906 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:33:54.906 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:33:54.906 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:33:54.906 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:33:54.907 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 158640 2021-10-08T19:33:54.907 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.907 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:33:54.907 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.908 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:33:54.908 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:53.907516+0000", 2021-10-08T19:33:54.908 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:54.908 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.908 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.909 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:33:54.909 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:53.907516+0000", 2021-10-08T19:33:54.909 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:54.909 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.910 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.910 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:33:54.910 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:53.907515+0000", 2021-10-08T19:33:54.910 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:33:54.911 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.911 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.911 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:33:54.911 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:53.907519+0000", 2021-10-08T19:33:54.911 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6129999999999997e-06 2021-10-08T19:33:54.912 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.912 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.912 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:33:54.913 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:53.907527+0000", 2021-10-08T19:33:54.913 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7680000000000008e-06 2021-10-08T19:33:54.913 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.913 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.914 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:33:54.914 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:53.907533+0000", 2021-10-08T19:33:54.914 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5439999999999998e-06 2021-10-08T19:33:54.914 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.915 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.915 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:54.915 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:53.907577+0000", 2021-10-08T19:33:54.915 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4567000000000002e-05 2021-10-08T19:33:54.915 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.916 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.916 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:33:54.916 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:53.907672+0000", 2021-10-08T19:33:54.916 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5169999999999999e-05 2021-10-08T19:33:54.917 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.917 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.917 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:33:54.917 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:53.907767+0000", 2021-10-08T19:33:54.918 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5175999999999998e-05 2021-10-08T19:33:54.918 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.918 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.918 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:54.918 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:54.004267+0000", 2021-10-08T19:33:54.919 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.096499101000000004 2021-10-08T19:33:54.919 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.919 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.919 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:33:54.920 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:54.004287+0000", 2021-10-08T19:33:54.920 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0599e-05 2021-10-08T19:33:54.920 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.920 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.920 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:54.921 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:54.023326+0000", 2021-10-08T19:33:54.921 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019038798999999999 2021-10-08T19:33:54.921 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.921 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.922 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:33:54.922 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:54.023376+0000", 2021-10-08T19:33:54.922 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0269999999999998e-05 2021-10-08T19:33:54.922 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.923 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.923 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:33:54.923 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:54.023417+0000", 2021-10-08T19:33:54.923 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1094999999999999e-05 2021-10-08T19:33:54.924 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:54.924 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:33:54.924 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:54.924 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.925 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.925 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:159676 7.e 7:74985da7:::benchmark_data_smithi097_93198_object67856:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158)", 2021-10-08T19:33:54.925 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:26:55.204112+0000", 2021-10-08T19:33:54.925 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 419.47397142400001, 2021-10-08T19:33:54.926 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.10814876399999999, 2021-10-08T19:33:54.926 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:33:54.926 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:33:54.926 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:33:54.927 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:33:54.927 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:33:54.927 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 159676 2021-10-08T19:33:54.927 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.928 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:33:54.928 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.928 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:33:54.928 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.204112+0000", 2021-10-08T19:33:54.928 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:54.929 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.929 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.929 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:33:54.929 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.204112+0000", 2021-10-08T19:33:54.929 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:54.930 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.930 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.930 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:33:54.930 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.204110+0000", 2021-10-08T19:33:54.931 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:33:54.931 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.931 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.931 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:33:54.932 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.204117+0000", 2021-10-08T19:33:54.932 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6340000000000001e-06 2021-10-08T19:33:54.932 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.933 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.933 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:33:54.933 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.204129+0000", 2021-10-08T19:33:54.934 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1851000000000001e-05 2021-10-08T19:33:54.934 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.934 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.934 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:33:54.934 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.204136+0000", 2021-10-08T19:33:54.935 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7170000000000002e-06 2021-10-08T19:33:54.935 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.935 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.935 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:54.935 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.204177+0000", 2021-10-08T19:33:54.936 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1601999999999999e-05 2021-10-08T19:33:54.936 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.936 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.936 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:33:54.937 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.204253+0000", 2021-10-08T19:33:54.937 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6007999999999995e-05 2021-10-08T19:33:54.937 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.937 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.937 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:33:54.938 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.204337+0000", 2021-10-08T19:33:54.938 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3407999999999998e-05 2021-10-08T19:33:54.938 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.938 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.938 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:54.939 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.206699+0000", 2021-10-08T19:33:54.939 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0023617680000000002 2021-10-08T19:33:54.939 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.939 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.940 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:33:54.940 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.207753+0000", 2021-10-08T19:33:54.940 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010547410000000001 2021-10-08T19:33:54.940 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.940 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.941 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:54.941 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.312177+0000", 2021-10-08T19:33:54.941 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.10442370199999999 2021-10-08T19:33:54.941 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.942 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.942 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:33:54.942 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.312223+0000", 2021-10-08T19:33:54.942 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6147999999999999e-05 2021-10-08T19:33:54.943 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.943 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.943 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:33:54.943 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.312261+0000", 2021-10-08T19:33:54.944 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7398999999999999e-05 2021-10-08T19:33:54.944 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:54.944 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:33:54.944 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:54.945 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.945 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.945 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:161975 7.8 7:114b2586:::benchmark_data_smithi097_93198_object70155:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158)", 2021-10-08T19:33:54.945 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:26:58.330662+0000", 2021-10-08T19:33:54.945 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 416.34742108799998, 2021-10-08T19:33:54.946 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.21377785099999999, 2021-10-08T19:33:54.946 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:33:54.946 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:33:54.946 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:33:54.947 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:33:54.947 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:33:54.947 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 161975 2021-10-08T19:33:54.947 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.947 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:33:54.948 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.948 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:33:54.948 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.330662+0000", 2021-10-08T19:33:54.948 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:54.948 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.949 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.949 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:33:54.949 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.330662+0000", 2021-10-08T19:33:54.949 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:54.950 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.950 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.950 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:33:54.950 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.330660+0000", 2021-10-08T19:33:54.950 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:33:54.951 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.951 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.951 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:33:54.952 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.330667+0000", 2021-10-08T19:33:54.952 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0280000000000003e-06 2021-10-08T19:33:54.952 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.952 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.953 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:33:54.953 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.330677+0000", 2021-10-08T19:33:54.953 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0149000000000001e-05 2021-10-08T19:33:54.953 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.953 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.954 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:33:54.954 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.330683+0000", 2021-10-08T19:33:54.954 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7649999999999999e-06 2021-10-08T19:33:54.954 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.955 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.955 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:54.955 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.330722+0000", 2021-10-08T19:33:54.955 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8717999999999998e-05 2021-10-08T19:33:54.955 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.956 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.956 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:33:54.956 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.330831+0000", 2021-10-08T19:33:54.956 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000108887 2021-10-08T19:33:54.956 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.957 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.957 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4,7", 2021-10-08T19:33:54.957 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.330939+0000", 2021-10-08T19:33:54.957 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000108608 2021-10-08T19:33:54.958 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.958 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.958 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:54.958 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.335977+0000", 2021-10-08T19:33:54.958 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0050375250000000002 2021-10-08T19:33:54.959 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.959 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.959 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:33:54.959 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.335997+0000", 2021-10-08T19:33:54.959 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0086999999999999e-05 2021-10-08T19:33:54.960 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.960 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.960 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:54.960 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.544379+0000", 2021-10-08T19:33:54.961 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.208382345 2021-10-08T19:33:54.961 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.961 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.961 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:33:54.962 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.544415+0000", 2021-10-08T19:33:54.962 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5704999999999998e-05 2021-10-08T19:33:54.962 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.962 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.963 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:33:54.963 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.544440+0000", 2021-10-08T19:33:54.963 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5032e-05 2021-10-08T19:33:54.963 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:54.964 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:33:54.964 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:54.964 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.964 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.964 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:161982 7.8 7:17dd4ca8:::benchmark_data_smithi097_93198_object70162:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158)", 2021-10-08T19:33:54.965 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:26:58.338172+0000", 2021-10-08T19:33:54.965 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 416.33991133500001, 2021-10-08T19:33:54.965 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.20636200499999999, 2021-10-08T19:33:54.965 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:33:54.965 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:33:54.966 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:33:54.966 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:33:54.966 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:33:54.966 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 161982 2021-10-08T19:33:54.967 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.967 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:33:54.967 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.967 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:33:54.967 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.338172+0000", 2021-10-08T19:33:54.968 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:54.968 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.968 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.968 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:33:54.968 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.338172+0000", 2021-10-08T19:33:54.969 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:54.969 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.969 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.969 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:33:54.970 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.338169+0000", 2021-10-08T19:33:54.970 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:33:54.970 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.970 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.970 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:33:54.971 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.338178+0000", 2021-10-08T19:33:54.971 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1089999999999998e-06 2021-10-08T19:33:54.971 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.971 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.972 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:33:54.972 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.338189+0000", 2021-10-08T19:33:54.972 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.167e-05 2021-10-08T19:33:54.973 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.973 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.973 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:33:54.973 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.338196+0000", 2021-10-08T19:33:54.973 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7880000000000001e-06 2021-10-08T19:33:54.974 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.974 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.974 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:54.974 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.338239+0000", 2021-10-08T19:33:54.974 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3055e-05 2021-10-08T19:33:54.975 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.975 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.975 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:33:54.975 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.338355+0000", 2021-10-08T19:33:54.976 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000116012 2021-10-08T19:33:54.976 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.976 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.976 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4,7", 2021-10-08T19:33:54.977 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.338478+0000", 2021-10-08T19:33:54.977 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012258399999999999 2021-10-08T19:33:54.977 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.977 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.978 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:33:54.978 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.341678+0000", 2021-10-08T19:33:54.978 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031999760000000002 2021-10-08T19:33:54.978 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.978 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.979 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:54.979 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.345366+0000", 2021-10-08T19:33:54.979 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003688654 2021-10-08T19:33:54.979 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.979 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.980 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:54.980 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.544479+0000", 2021-10-08T19:33:54.980 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.19911299299999999 2021-10-08T19:33:54.980 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.981 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.981 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:33:54.981 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.544513+0000", 2021-10-08T19:33:54.981 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4167e-05 2021-10-08T19:33:54.982 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.982 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.982 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:33:54.983 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.544534+0000", 2021-10-08T19:33:54.983 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0406000000000001e-05 2021-10-08T19:33:54.983 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:54.983 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:33:54.983 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:54.984 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.984 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.984 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:162006 7.8 7:18e88623:::benchmark_data_smithi097_93198_object70186:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158)", 2021-10-08T19:33:54.984 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:26:58.374366+0000", 2021-10-08T19:33:54.984 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 416.30371683300001, 2021-10-08T19:33:54.985 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.17491137500000001, 2021-10-08T19:33:54.985 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:33:54.985 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:33:54.985 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:33:54.985 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:33:54.986 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:33:54.986 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 162006 2021-10-08T19:33:54.986 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.986 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:33:54.987 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.987 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:33:54.987 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.374366+0000", 2021-10-08T19:33:54.987 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:54.987 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.988 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.988 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:33:54.988 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.374366+0000", 2021-10-08T19:33:54.988 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:54.989 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.989 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.989 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:33:54.989 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.374364+0000", 2021-10-08T19:33:54.990 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:33:54.990 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.990 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.990 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:33:54.991 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.374372+0000", 2021-10-08T19:33:54.991 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4200000000000001e-06 2021-10-08T19:33:54.991 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.991 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.992 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:33:54.992 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.374387+0000", 2021-10-08T19:33:54.992 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5359999999999999e-05 2021-10-08T19:33:54.992 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.993 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.993 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:33:54.993 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.374395+0000", 2021-10-08T19:33:54.993 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4719999999999998e-06 2021-10-08T19:33:54.993 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.994 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.994 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:54.994 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.374451+0000", 2021-10-08T19:33:54.994 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5791000000000002e-05 2021-10-08T19:33:54.995 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.995 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.995 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:33:54.995 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.374539+0000", 2021-10-08T19:33:54.996 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8510999999999993e-05 2021-10-08T19:33:54.996 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.996 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.996 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4,7", 2021-10-08T19:33:54.996 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.374659+0000", 2021-10-08T19:33:54.997 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119647 2021-10-08T19:33:54.997 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.997 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.997 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:33:54.998 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.377838+0000", 2021-10-08T19:33:54.998 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003178817 2021-10-08T19:33:54.998 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.998 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:54.999 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:54.999 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.378153+0000", 2021-10-08T19:33:54.999 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031545800000000001 2021-10-08T19:33:54.999 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:54.999 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:55.000 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:55.000 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.549177+0000", 2021-10-08T19:33:55.000 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.171024236 2021-10-08T19:33:55.001 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:55.001 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:55.001 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:33:55.001 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.549233+0000", 2021-10-08T19:33:55.002 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5806000000000001e-05 2021-10-08T19:33:55.002 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:55.002 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:55.002 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:33:55.002 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.549278+0000", 2021-10-08T19:33:55.003 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4728000000000003e-05 2021-10-08T19:33:55.003 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:55.003 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:33:55.003 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:55.003 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:55.004 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:55.004 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:162015 7.8 7:13e56b01:::benchmark_data_smithi097_93198_object70195:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158)", 2021-10-08T19:33:55.004 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:26:58.403700+0000", 2021-10-08T19:33:55.004 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 416.27438314199998, 2021-10-08T19:33:55.005 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.145692814, 2021-10-08T19:33:55.005 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:33:55.005 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:33:55.005 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:33:55.006 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:33:55.006 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:33:55.006 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 162015 2021-10-08T19:33:55.006 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:55.007 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:33:55.007 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:55.008 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:33:55.008 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.403700+0000", 2021-10-08T19:33:55.008 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:55.009 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:55.009 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:55.009 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:33:55.009 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.403700+0000", 2021-10-08T19:33:55.010 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:55.010 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:55.010 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:55.010 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:33:55.010 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.403697+0000", 2021-10-08T19:33:55.011 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2021-10-08T19:33:55.011 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:55.011 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:55.011 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:33:55.012 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.403708+0000", 2021-10-08T19:33:55.012 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0558e-05 2021-10-08T19:33:55.012 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:55.012 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:55.013 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:33:55.013 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.403728+0000", 2021-10-08T19:33:55.013 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0367e-05 2021-10-08T19:33:55.013 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:55.014 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:55.014 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:33:55.014 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.403736+0000", 2021-10-08T19:33:55.014 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2460000000000003e-06 2021-10-08T19:33:55.015 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:55.015 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:55.015 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:55.015 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.403791+0000", 2021-10-08T19:33:55.015 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4670999999999999e-05 2021-10-08T19:33:55.016 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:55.016 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:55.016 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:33:55.016 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.403937+0000", 2021-10-08T19:33:55.016 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014544300000000001 2021-10-08T19:33:55.017 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:55.017 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:55.017 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4,7", 2021-10-08T19:33:55.017 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.404069+0000", 2021-10-08T19:33:55.017 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000132082 2021-10-08T19:33:55.018 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:55.018 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:55.018 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:55.018 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.406592+0000", 2021-10-08T19:33:55.019 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00252375 2021-10-08T19:33:55.019 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:55.019 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:55.019 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:33:55.019 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.406657+0000", 2021-10-08T19:33:55.020 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4361000000000003e-05 2021-10-08T19:33:55.020 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:55.020 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:55.020 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:55.020 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.549322+0000", 2021-10-08T19:33:55.021 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.14266500200000001 2021-10-08T19:33:55.021 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:55.021 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:55.021 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:33:55.021 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.549367+0000", 2021-10-08T19:33:55.022 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4883999999999999e-05 2021-10-08T19:33:55.022 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:55.022 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:55.022 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:33:55.023 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.549393+0000", 2021-10-08T19:33:55.023 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6273000000000001e-05 2021-10-08T19:33:55.023 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:55.023 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:33:55.023 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:55.024 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:55.024 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:55.024 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "MOSDPGPushReply(4.1c 197/196 [PushReplyOp(4:3d9e841d:::obj_delete_at_hint.0000000041:head)])", 2021-10-08T19:33:55.024 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:28:24.395953+0000", 2021-10-08T19:33:55.025 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 330.28213039000002, 2021-10-08T19:33:55.025 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.11790047100000001, 2021-10-08T19:33:55.025 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:33:55.025 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "reached pg", 2021-10-08T19:33:55.025 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:33:55.026 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:55.026 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:33:55.026 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:24.395953+0000", 2021-10-08T19:33:55.026 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:55.026 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:55.027 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:55.027 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:33:55.028 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:24.395953+0000", 2021-10-08T19:33:55.028 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:55.029 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:55.029 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:55.029 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:33:55.029 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:24.395951+0000", 2021-10-08T19:33:55.029 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2021-10-08T19:33:55.030 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:55.030 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:55.030 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:33:55.030 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:24.395959+0000", 2021-10-08T19:33:55.030 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4789999999999999e-06 2021-10-08T19:33:55.031 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:55.031 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:55.031 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:33:55.031 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:24.395970+0000", 2021-10-08T19:33:55.031 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1021e-05 2021-10-08T19:33:55.032 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:55.032 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:55.032 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:33:55.032 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:24.395975+0000", 2021-10-08T19:33:55.033 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9370000000000003e-06 2021-10-08T19:33:55.033 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:55.033 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:55.033 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:55.033 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:24.513707+0000", 2021-10-08T19:33:55.034 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.11773249700000001 2021-10-08T19:33:55.034 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:55.034 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:55.034 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:33:55.035 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:24.513853+0000", 2021-10-08T19:33:55.035 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000146069 2021-10-08T19:33:55.035 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:55.035 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:33:55.035 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:55.036 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:55.036 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:55.036 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:95896 8.f 8:f4157ae7:::benchmark_data_smithi097_144160_object7156:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e228)", 2021-10-08T19:33:55.036 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:29.766663+0000", 2021-10-08T19:33:55.036 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 264.91141996300001, 2021-10-08T19:33:55.037 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9412932270000001, 2021-10-08T19:33:55.037 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:33:55.037 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:33:55.037 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:33:55.038 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:33:55.038 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:33:55.038 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 95896 2021-10-08T19:33:55.038 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:55.039 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:33:55.039 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:55.039 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:33:55.039 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.766663+0000", 2021-10-08T19:33:55.039 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:55.040 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:55.040 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:55.040 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:33:55.041 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.766663+0000", 2021-10-08T19:33:55.041 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:33:55.041 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:55.041 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:55.041 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:33:55.042 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.766662+0000", 2021-10-08T19:33:55.042 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2021-10-08T19:33:55.042 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:55.042 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:55.042 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:33:55.043 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.766667+0000", 2021-10-08T19:33:55.043 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7809999999999996e-06 2021-10-08T19:33:55.043 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:55.043 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:55.043 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:33:55.044 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.766673+0000", 2021-10-08T19:33:55.044 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1419999999999998e-06 2021-10-08T19:33:55.044 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:55.045 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:55.045 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:33:55.045 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.766678+0000", 2021-10-08T19:33:55.045 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5090000000000001e-06 2021-10-08T19:33:55.046 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:55.046 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:55.046 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:55.046 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.766728+0000", 2021-10-08T19:33:55.047 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9429999999999999e-05 2021-10-08T19:33:55.047 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:55.048 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:55.048 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:33:55.048 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.766737+0000", 2021-10-08T19:33:55.048 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8829999999999995e-06 2021-10-08T19:33:55.049 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:55.049 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:55.049 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:55.049 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:30.600075+0000", 2021-10-08T19:33:55.049 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.833338095 2021-10-08T19:33:55.050 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:55.050 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:55.050 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:33:55.050 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:30.600085+0000", 2021-10-08T19:33:55.050 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0237999999999999e-05 2021-10-08T19:33:55.051 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:55.051 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:55.051 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:33:55.051 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.703691+0000", 2021-10-08T19:33:55.051 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.103606206 2021-10-08T19:33:55.052 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:55.052 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:55.052 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:33:55.053 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.703858+0000", 2021-10-08T19:33:55.053 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000166284 2021-10-08T19:33:55.053 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:55.053 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:55.053 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,3,4", 2021-10-08T19:33:55.054 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.704051+0000", 2021-10-08T19:33:55.054 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019300200000000001 2021-10-08T19:33:55.054 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:55.054 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:55.055 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:33:55.055 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.706431+0000", 2021-10-08T19:33:55.055 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002380521 2021-10-08T19:33:55.055 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:55.056 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:55.056 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:55.056 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.706718+0000", 2021-10-08T19:33:55.056 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00028731500000000001 2021-10-08T19:33:55.057 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:55.057 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:55.057 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:55.057 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.706931+0000", 2021-10-08T19:33:55.057 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000212358 2021-10-08T19:33:55.058 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:55.058 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:55.058 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:33:55.058 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.707782+0000", 2021-10-08T19:33:55.059 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00085145800000000003 2021-10-08T19:33:55.059 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:55.059 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:55.059 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:33:55.059 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.707841+0000", 2021-10-08T19:33:55.060 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9330999999999998e-05 2021-10-08T19:33:55.060 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:33:55.060 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:33:55.060 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:33:55.060 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.707956+0000", 2021-10-08T19:33:55.061 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011496499999999999 2021-10-08T19:33:55.061 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:55.061 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:33:55.061 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:55.061 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:33:55.062 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:33:55.062 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:33:55.063 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:55.064 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:33:55.064 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:33:55.065 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.7 to 1 (10000) 2021-10-08T19:33:55.065 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:54 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3324119761' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2021-10-08T19:33:55.065 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:54 smithi097 ceph-mon[41966]: from='client.25645 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2021-10-08T19:33:55.066 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:54 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3324119761' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2021-10-08T19:33:55.066 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:54 smithi097 ceph-mon[32687]: from='client.25645 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2021-10-08T19:33:55.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:54 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3324119761' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2021-10-08T19:33:55.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:54 smithi117 ceph-mon[34585]: from='client.25645 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2021-10-08T19:33:55.166 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:33:55.207 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:55.280 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:33:55.282 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:55.283 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:33:55.384 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:33:55.440 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:56.101 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:33:56.104 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:56.105 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:33:56.106 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:55 smithi097 ceph-mon[32687]: pgmap v628: 178 pgs: 178 active+clean; 4.3 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1.21k op/s 2021-10-08T19:33:56.106 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:55 smithi097 ceph-mon[32687]: from='client.25645 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]': finished 2021-10-08T19:33:56.107 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:55 smithi097 ceph-mon[32687]: osdmap e333: 8 total, 8 up, 8 in 2021-10-08T19:33:56.107 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:55 smithi097 ceph-mon[41966]: pgmap v628: 178 pgs: 178 active+clean; 4.3 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1.21k op/s 2021-10-08T19:33:56.107 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:55 smithi097 ceph-mon[41966]: from='client.25645 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]': finished 2021-10-08T19:33:56.107 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:55 smithi097 ceph-mon[41966]: osdmap e333: 8 total, 8 up, 8 in 2021-10-08T19:33:56.142 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2021-10-08T19:33:56.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:55 smithi117 ceph-mon[34585]: pgmap v628: 178 pgs: 178 active+clean; 4.3 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1.21k op/s 2021-10-08T19:33:56.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:55 smithi117 ceph-mon[34585]: from='client.25645 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]': finished 2021-10-08T19:33:56.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:55 smithi117 ceph-mon[34585]: osdmap e333: 8 total, 8 up, 8 in 2021-10-08T19:33:56.174 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2021-10-08T19:33:56.207 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:33:56.245 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:56.382 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:33:56.397 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:56.399 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:33:56.501 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:33:56.550 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:56.679 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:33:56.683 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:56.683 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:33:56.785 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:33:56.829 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:57.156 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:33:56 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:33:57.476 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd reweight 6 1 2021-10-08T19:33:57.636 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:33:57.645 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:57.646 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:33:57.747 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:33:57.790 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:57.873 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:33:57.878 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:57.879 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:33:57.980 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:33:58.013 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:58.015 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:57 smithi097 ceph-mon[32687]: pgmap v630: 178 pgs: 178 active+clean; 4.3 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.35k op/s 2021-10-08T19:33:58.016 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:57 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:33:58.016 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:57 smithi097 ceph-mon[41966]: pgmap v630: 178 pgs: 178 active+clean; 4.3 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.35k op/s 2021-10-08T19:33:58.016 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:57 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:33:58.131 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:33:58.133 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:57 smithi117 ceph-mon[34585]: pgmap v630: 178 pgs: 178 active+clean; 4.3 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.35k op/s 2021-10-08T19:33:58.133 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:57 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:33:58.134 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:58.134 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:33:58.235 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:33:58.278 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:33:58.280 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:33:58.288 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:33:58.303 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:58.460 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:33:58.468 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:58.470 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:33:58.571 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:33:58.607 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:58.892 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is unset 2021-10-08T19:33:59.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:58 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/4120414316' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:33:59.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:58 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/4120414316' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:33:59.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:58 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/4120414316' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:33:59.354 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:33:59.363 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:59.363 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:33:59.465 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:33:59.507 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:59.599 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:33:59.602 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:59.602 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:33:59.703 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:33:59.754 INFO:journalctl@ceph.osd.5.smithi117.stdout:Oct 08 19:33:59 smithi117 conmon[46504]: 2021-10-08T19:33:59.612+0000 7f7bfc769700 -1 osd.5 pg_epoch: 334 pg[1.8( v 90'130 (0'0,90'130] local-lis/les=286/287 n=0 ec=170/19 lis/c=286/286 les/c/f=287/287/0 sis=286) [5,2,3] r=0 lpr=286 crt=90'130 mlcod 0'0 active+clean] scrubber pg(1.8) handle_scrub_reserve_grant: received unsolicited reservation grant from osd 2 (0x561531e02160) 2021-10-08T19:33:59.755 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:33:59.822 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:33:59.824 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:33:59.825 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:33:59.927 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:33:59.964 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:00.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:59 smithi117 ceph-mon[34585]: pgmap v631: 178 pgs: 178 active+clean; 4.2 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.15k op/s 2021-10-08T19:34:00.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:59 smithi117 ceph-mon[34585]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:34:00.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:59 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/4120414316' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:34:00.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:33:59 smithi117 ceph-mon[34585]: osdmap e334: 8 total, 8 up, 8 in 2021-10-08T19:34:00.202 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:34:00.205 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:00.206 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:34:00.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:59 smithi097 ceph-mon[41966]: pgmap v631: 178 pgs: 178 active+clean; 4.2 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.15k op/s 2021-10-08T19:34:00.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:59 smithi097 ceph-mon[41966]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:34:00.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:59 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/4120414316' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:34:00.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:33:59 smithi097 ceph-mon[41966]: osdmap e334: 8 total, 8 up, 8 in 2021-10-08T19:34:00.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:59 smithi097 ceph-mon[32687]: pgmap v631: 178 pgs: 178 active+clean; 4.2 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.15k op/s 2021-10-08T19:34:00.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:59 smithi097 ceph-mon[32687]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:34:00.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:59 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/4120414316' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:34:00.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:33:59 smithi097 ceph-mon[32687]: osdmap e334: 8 total, 8 up, 8 in 2021-10-08T19:34:00.307 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:34:00.351 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:00.602 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:34:00.607 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:00.608 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:34:00.709 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:34:00.827 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:01.151 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:00 smithi097 ceph-mon[41966]: 2.11 scrub ok 2021-10-08T19:34:01.152 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:00 smithi097 ceph-mon[41966]: 1.0 scrub ok 2021-10-08T19:34:01.153 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:34:01 smithi097 conmon[33110]: 172.21.15.117 - - [08/Oct/2021:19:34:01] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:34:01.154 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:00 smithi097 ceph-mon[32687]: 2.11 scrub ok 2021-10-08T19:34:01.154 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:00 smithi097 ceph-mon[32687]: 1.0 scrub ok 2021-10-08T19:34:01.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:00 smithi117 ceph-mon[34585]: 2.11 scrub ok 2021-10-08T19:34:01.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:00 smithi117 ceph-mon[34585]: 1.0 scrub ok 2021-10-08T19:34:02.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:02 smithi117 ceph-mon[34585]: pgmap v633: 178 pgs: 178 active+clean; 4.0 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.42k op/s 2021-10-08T19:34:02.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:02 smithi117 ceph-mon[34585]: 9.4 scrub ok 2021-10-08T19:34:02.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:02 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:34:02.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:02 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:34:02.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:02 smithi117 ceph-mon[34585]: 172.21.15.117 - - [08/Oct/2021:19:34:01] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:34:02.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:02 smithi117 ceph-mon[34585]: 1.7 scrub ok 2021-10-08T19:34:02.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:02 smithi097 ceph-mon[32687]: pgmap v633: 178 pgs: 178 active+clean; 4.0 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.42k op/s 2021-10-08T19:34:02.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:02 smithi097 ceph-mon[32687]: 9.4 scrub ok 2021-10-08T19:34:02.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:02 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:34:02.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:02 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:34:02.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:02 smithi097 ceph-mon[32687]: 172.21.15.117 - - [08/Oct/2021:19:34:01] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:34:02.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:02 smithi097 ceph-mon[32687]: 1.7 scrub ok 2021-10-08T19:34:02.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:02 smithi097 ceph-mon[41966]: pgmap v633: 178 pgs: 178 active+clean; 4.0 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.42k op/s 2021-10-08T19:34:02.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:02 smithi097 ceph-mon[41966]: 9.4 scrub ok 2021-10-08T19:34:02.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:02 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:34:02.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:02 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:34:02.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:02 smithi097 ceph-mon[41966]: 172.21.15.117 - - [08/Oct/2021:19:34:01] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:34:02.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:02 smithi097 ceph-mon[41966]: 1.7 scrub ok 2021-10-08T19:34:02.736 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset nodeep-scrub 2021-10-08T19:34:02.905 INFO:journalctl@ceph.osd.5.smithi117.stdout:Oct 08 19:34:02 smithi117 conmon[46504]: 2021-10-08T19:34:02.606+0000 7f7bf9f64700 -1 osd.5 pg_epoch: 334 pg[6.d( empty local-lis/les=202/203 n=0 ec=66/66 lis/c=202/202 les/c/f=203/203/0 sis=202) [5,1,0] r=0 lpr=202 crt=0'0 mlcod 0'0 active+clean] scrubber pg(6.d) handle_scrub_reserve_grant: received unsolicited reservation grant from osd 0 (0x56152ea7db80) 2021-10-08T19:34:02.970 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:34:02 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:34:02] "GET /metrics HTTP/1.1" 200 155802 "" "Prometheus/2.18.1" 2021-10-08T19:34:03.869 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:34:03 smithi117 conmon[69189]: level=error ts=2021-10-08T19:34:03.505Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=2 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:34:03.900 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:34:03.903 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:03.904 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:34:04.005 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:34:04.042 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:04.106 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:34:04.108 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:04.108 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:34:04.157 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:34:03 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:34:03] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:34:04.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:04 smithi117 ceph-mon[34585]: pgmap v634: 178 pgs: 178 active+clean; 4.0 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 692 op/s 2021-10-08T19:34:04.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:04 smithi117 ceph-mon[34585]: 9.0 scrub ok 2021-10-08T19:34:04.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:04 smithi117 ceph-mon[34585]: 3.14 scrub ok 2021-10-08T19:34:04.210 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:34:04.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:04 smithi097 ceph-mon[41966]: pgmap v634: 178 pgs: 178 active+clean; 4.0 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 692 op/s 2021-10-08T19:34:04.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:04 smithi097 ceph-mon[41966]: 9.0 scrub ok 2021-10-08T19:34:04.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:04 smithi097 ceph-mon[41966]: 3.14 scrub ok 2021-10-08T19:34:04.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:04 smithi097 ceph-mon[32687]: pgmap v634: 178 pgs: 178 active+clean; 4.0 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 692 op/s 2021-10-08T19:34:04.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:04 smithi097 ceph-mon[32687]: 9.0 scrub ok 2021-10-08T19:34:04.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:04 smithi097 ceph-mon[32687]: 3.14 scrub ok 2021-10-08T19:34:04.254 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:04.768 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:34:04.780 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:04.781 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:34:04.816 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:34:04.882 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:34:04.936 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:05.061 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:34:05.063 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:05.063 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:34:05.164 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:34:05.200 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:05.284 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:34:05.287 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:05.288 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:34:05.389 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:34:05.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:05 smithi117 ceph-mon[34585]: 5.16 scrub ok 2021-10-08T19:34:05.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:05 smithi117 ceph-mon[34585]: 5.3 scrub ok 2021-10-08T19:34:05.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:05 smithi117 ceph-mon[34585]: 3.3 scrub ok 2021-10-08T19:34:05.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:05 smithi117 ceph-mon[34585]: 2.1e scrub ok 2021-10-08T19:34:05.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:05 smithi117 ceph-mon[34585]: 4.4 scrub ok 2021-10-08T19:34:05.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:05 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:34:05.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:05 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:34:05.421 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:05.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:05 smithi097 ceph-mon[32687]: 5.16 scrub ok 2021-10-08T19:34:05.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:05 smithi097 ceph-mon[32687]: 5.3 scrub ok 2021-10-08T19:34:05.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:05 smithi097 ceph-mon[32687]: 3.3 scrub ok 2021-10-08T19:34:05.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:05 smithi097 ceph-mon[32687]: 2.1e scrub ok 2021-10-08T19:34:05.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:05 smithi097 ceph-mon[32687]: 4.4 scrub ok 2021-10-08T19:34:05.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:05 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:34:05.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:05 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:34:05.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:05 smithi097 ceph-mon[41966]: 5.16 scrub ok 2021-10-08T19:34:05.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:05 smithi097 ceph-mon[41966]: 5.3 scrub ok 2021-10-08T19:34:05.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:05 smithi097 ceph-mon[41966]: 3.3 scrub ok 2021-10-08T19:34:05.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:05 smithi097 ceph-mon[41966]: 2.1e scrub ok 2021-10-08T19:34:05.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:05 smithi097 ceph-mon[41966]: 4.4 scrub ok 2021-10-08T19:34:05.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:05 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:34:05.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:05 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:34:05.487 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:34:05.492 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:05.493 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:34:05.594 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:34:05.656 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:05.708 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:34:05.710 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:05.711 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:34:05.813 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:34:05.857 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:05.922 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:34:05.924 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:05.925 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:34:06.020 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:34:06.026 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:34:06.049 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:34:06.049 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2021-10-08T19:34:06.050 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:06.050 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.25465.0:174191 9.2 9:451092e3:::benchmark_data_smithi097_196985_object58500:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e335)", 2021-10-08T19:34:06.050 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:34:06.034162+0000", 2021-10-08T19:34:06.050 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.011695404, 2021-10-08T19:34:06.051 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011728957, 2021-10-08T19:34:06.051 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:34:06.051 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2021-10-08T19:34:06.051 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:34:06.051 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.25465", 2021-10-08T19:34:06.052 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:34:06.052 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 174191 2021-10-08T19:34:06.053 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:06.053 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:34:06.053 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:06.053 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:34:06.053 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:06.034162+0000", 2021-10-08T19:34:06.054 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:34:06.054 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:06.054 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:06.054 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:34:06.055 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:06.034162+0000", 2021-10-08T19:34:06.055 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:34:06.055 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:06.055 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:06.055 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:34:06.056 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:06.034160+0000", 2021-10-08T19:34:06.056 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:34:06.056 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:06.056 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:06.057 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:34:06.057 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:06.034168+0000", 2021-10-08T19:34:06.057 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6889999999999993e-06 2021-10-08T19:34:06.057 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:06.057 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:06.058 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:34:06.058 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:06.034184+0000", 2021-10-08T19:34:06.058 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5931999999999999e-05 2021-10-08T19:34:06.058 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:06.058 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:06.059 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:34:06.059 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:06.034191+0000", 2021-10-08T19:34:06.059 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8909999999999998e-06 2021-10-08T19:34:06.059 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:06.059 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:06.060 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:34:06.060 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:06.034240+0000", 2021-10-08T19:34:06.060 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9125000000000001e-05 2021-10-08T19:34:06.060 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:06.061 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:06.061 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:34:06.061 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:06.034352+0000", 2021-10-08T19:34:06.061 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000111575 2021-10-08T19:34:06.061 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:06.062 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:06.062 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,2", 2021-10-08T19:34:06.062 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:06.034464+0000", 2021-10-08T19:34:06.062 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000111896 2021-10-08T19:34:06.063 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:06.063 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:06.063 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:34:06.064 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:06.036896+0000", 2021-10-08T19:34:06.064 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0024323410000000002 2021-10-08T19:34:06.064 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:06.064 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:06.064 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:06.065 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:06.039317+0000", 2021-10-08T19:34:06.065 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0024208139999999999 2021-10-08T19:34:06.065 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:34:06.065 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:34:06.065 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:34:06.066 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:06.066 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:06.066 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.25465.0:174200 9.2 9:49c71549:::benchmark_data_smithi097_196985_object58509:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e335)", 2021-10-08T19:34:06.066 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:34:06.045485+0000", 2021-10-08T19:34:06.066 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.00037187, 2021-10-08T19:34:06.067 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00051824100000000001, 2021-10-08T19:34:06.067 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:34:06.067 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2021-10-08T19:34:06.067 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:34:06.068 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.25465", 2021-10-08T19:34:06.068 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:34:06.068 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 174200 2021-10-08T19:34:06.068 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:06.068 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:34:06.069 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:06.069 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:34:06.069 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:06.045485+0000", 2021-10-08T19:34:06.070 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:34:06.070 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:06.070 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:06.070 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:34:06.070 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:06.045485+0000", 2021-10-08T19:34:06.071 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:34:06.071 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:06.071 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:06.071 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:34:06.072 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:06.045483+0000", 2021-10-08T19:34:06.072 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2021-10-08T19:34:06.072 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:06.072 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:06.072 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:34:06.073 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:06.045492+0000", 2021-10-08T19:34:06.073 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0110000000000006e-06 2021-10-08T19:34:06.073 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:06.074 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:06.074 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:34:06.074 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:06.045509+0000", 2021-10-08T19:34:06.074 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7099999999999999e-05 2021-10-08T19:34:06.074 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:06.075 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:06.075 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:34:06.075 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:06.045517+0000", 2021-10-08T19:34:06.075 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.96e-06 2021-10-08T19:34:06.076 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:06.076 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:06.076 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:34:06.076 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:06.045574+0000", 2021-10-08T19:34:06.076 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7194000000000002e-05 2021-10-08T19:34:06.077 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:06.077 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:06.077 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:34:06.077 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:06.045698+0000", 2021-10-08T19:34:06.077 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012402499999999999 2021-10-08T19:34:06.078 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:06.078 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:06.078 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,2", 2021-10-08T19:34:06.078 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:06.045811+0000", 2021-10-08T19:34:06.079 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000113466 2021-10-08T19:34:06.079 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:34:06.079 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:34:06.079 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:34:06.079 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:34:06.080 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:34:06.080 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 2 2021-10-08T19:34:06.080 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:34:06.081 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:06.081 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:34:06.097 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:34:06.127 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:34:06.128 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:06.129 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:34:06.139 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:34:06.176 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:34:06.219 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:34:06.229 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:34:06.271 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:06.279 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:34:06.328 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:34:06.329 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:34:06.332 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'false' 2021-10-08T19:34:06.332 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'false' 2021-10-08T19:34:06.332 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'false' 2021-10-08T19:34:06.333 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'false' 2021-10-08T19:34:06.333 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'false' 2021-10-08T19:34:06.333 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'false' 2021-10-08T19:34:06.334 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'false' 2021-10-08T19:34:06.334 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'false' 2021-10-08T19:34:06.335 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:06.336 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:34:06.336 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:06 smithi117 ceph-mon[34585]: pgmap v635: 178 pgs: 1 active+clean+scrubbing, 177 active+clean; 3.6 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1.12k op/s 2021-10-08T19:34:06.336 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:06 smithi117 ceph-mon[34585]: osdmap e335: 8 total, 8 up, 8 in 2021-10-08T19:34:06.337 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:06 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2964363566' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2021-10-08T19:34:06.337 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:06 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3733092783' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:34:06.369 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:06 smithi097 ceph-mon[41966]: pgmap v635: 178 pgs: 1 active+clean+scrubbing, 177 active+clean; 3.6 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1.12k op/s 2021-10-08T19:34:06.370 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:06 smithi097 ceph-mon[41966]: osdmap e335: 8 total, 8 up, 8 in 2021-10-08T19:34:06.370 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:06 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2964363566' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2021-10-08T19:34:06.371 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:06 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3733092783' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:34:06.371 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:06 smithi097 ceph-mon[32687]: pgmap v635: 178 pgs: 1 active+clean+scrubbing, 177 active+clean; 3.6 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1.12k op/s 2021-10-08T19:34:06.371 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:06 smithi097 ceph-mon[32687]: osdmap e335: 8 total, 8 up, 8 in 2021-10-08T19:34:06.372 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:06 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2964363566' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2021-10-08T19:34:06.372 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:06 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3733092783' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:34:06.437 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:34:06.468 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:06.726 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.6 to 1 (10000) 2021-10-08T19:34:07.052 INFO:journalctl@ceph.osd.3.smithi097.stdout:Oct 08 19:34:07 smithi097 conmon[59546]: 2021-10-08T19:34:07.049+0000 7fac98014700 -1 osd.3 pg_epoch: 336 pg[5.13( empty local-lis/les=236/237 n=0 ec=64/64 lis/c=236/236 les/c/f=237/237/0 sis=236) [3,0,1] r=0 lpr=236 crt=0'0 mlcod 0'0 active+clean] scrubber pg(5.13) handle_scrub_reserve_grant: received unsolicited reservation grant from osd 1 (0x563cb61211e0) 2021-10-08T19:34:07.113 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:34:06 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:34:07.114 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:07 smithi117 ceph-mon[34585]: 1.2 scrub ok 2021-10-08T19:34:07.114 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:07 smithi117 ceph-mon[34585]: 4.0 scrub ok 2021-10-08T19:34:07.115 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:07 smithi117 ceph-mon[34585]: 6.f scrub ok 2021-10-08T19:34:07.115 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:07 smithi117 ceph-mon[34585]: 3.4 scrub ok 2021-10-08T19:34:07.118 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:07 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2964363566' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]': finished 2021-10-08T19:34:07.118 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:07 smithi117 ceph-mon[34585]: osdmap e336: 8 total, 8 up, 8 in 2021-10-08T19:34:07.406 INFO:journalctl@ceph.osd.6.smithi117.stdout:Oct 08 19:34:07 smithi117 conmon[50186]: 2021-10-08T19:34:07.252+0000 7f0faeebc700 -1 osd.6 pg_epoch: 336 pg[1.6( v 90'130 (0'0,90'130] local-lis/les=248/249 n=0 ec=170/19 lis/c=248/248 les/c/f=249/249/0 sis=248) [6,0,3] r=0 lpr=248 crt=90'130 lcod 0'0 mlcod 0'0 active+clean] scrubber pg(1.6) handle_scrub_reserve_grant: received unsolicited reservation grant from osd 3 (0x55b6f3552c60) 2021-10-08T19:34:07.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:07 smithi097 ceph-mon[41966]: 1.2 scrub ok 2021-10-08T19:34:07.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:07 smithi097 ceph-mon[41966]: 4.0 scrub ok 2021-10-08T19:34:07.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:07 smithi097 ceph-mon[41966]: 6.f scrub ok 2021-10-08T19:34:07.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:07 smithi097 ceph-mon[41966]: 3.4 scrub ok 2021-10-08T19:34:07.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:07 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2964363566' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]': finished 2021-10-08T19:34:07.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:07 smithi097 ceph-mon[41966]: osdmap e336: 8 total, 8 up, 8 in 2021-10-08T19:34:07.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:07 smithi097 ceph-mon[32687]: 1.2 scrub ok 2021-10-08T19:34:07.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:07 smithi097 ceph-mon[32687]: 4.0 scrub ok 2021-10-08T19:34:07.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:07 smithi097 ceph-mon[32687]: 6.f scrub ok 2021-10-08T19:34:07.474 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:07 smithi097 ceph-mon[32687]: 3.4 scrub ok 2021-10-08T19:34:07.474 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:07 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2964363566' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]': finished 2021-10-08T19:34:07.475 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:07 smithi097 ceph-mon[32687]: osdmap e336: 8 total, 8 up, 8 in 2021-10-08T19:34:08.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:08 smithi117 ceph-mon[34585]: pgmap v638: 178 pgs: 1 active+clean+scrubbing, 177 active+clean; 3.6 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 648 B/s rd, 0 B/s wr, 1.10k op/s 2021-10-08T19:34:08.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:08 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:34:08.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:08 smithi097 ceph-mon[41966]: pgmap v638: 178 pgs: 1 active+clean+scrubbing, 177 active+clean; 3.6 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 648 B/s rd, 0 B/s wr, 1.10k op/s 2021-10-08T19:34:08.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:08 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:34:08.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:08 smithi097 ceph-mon[32687]: pgmap v638: 178 pgs: 1 active+clean+scrubbing, 177 active+clean; 3.6 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 648 B/s rd, 0 B/s wr, 1.10k op/s 2021-10-08T19:34:08.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:08 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:34:09.051 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:34:09.057 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:09.058 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:34:09.158 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:34:09.218 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:09.349 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:09 smithi097 ceph-mon[32687]: 9.9 scrub ok 2021-10-08T19:34:09.349 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:09 smithi097 ceph-mon[32687]: 5.18 scrub ok 2021-10-08T19:34:09.349 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:09 smithi097 ceph-mon[41966]: 9.9 scrub ok 2021-10-08T19:34:09.350 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:09 smithi097 ceph-mon[41966]: 5.18 scrub ok 2021-10-08T19:34:09.351 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd reweight 1 1 2021-10-08T19:34:09.405 INFO:journalctl@ceph.osd.6.smithi117.stdout:Oct 08 19:34:09 smithi117 conmon[50186]: 2021-10-08T19:34:09.252+0000 7f0fb1ec2700 -1 osd.6 pg_epoch: 336 pg[3.10( v 70'5 (0'0,70'5] local-lis/les=283/284 n=0 ec=131/60 lis/c=283/283 les/c/f=284/284/0 sis=283) [6,0,5] r=0 lpr=283 crt=70'5 lcod 0'0 mlcod 0'0 active+clean] scrubber pg(3.10) handle_scrub_reserve_grant: received unsolicited reservation grant from osd 0 (0x55b6ffebeb00) 2021-10-08T19:34:09.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:09 smithi117 ceph-mon[34585]: 9.9 scrub ok 2021-10-08T19:34:09.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:09 smithi117 ceph-mon[34585]: 5.18 scrub ok 2021-10-08T19:34:09.552 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2021-10-08T19:34:09.558 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:34:09.566 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:09.567 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:34:09.669 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:34:09.705 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:09.764 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:34:09.766 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:09.767 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:34:09.868 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:34:09.902 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:09.976 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:34:09.982 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:09.983 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:34:10.007 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:34:10.084 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:34:10.153 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:34:10.155 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:10.268 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:34:10.277 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:10.279 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:34:10.381 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:34:10.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:10 smithi117 ceph-mon[34585]: pgmap v639: 178 pgs: 1 active+clean+scrubbing, 177 active+clean; 3.5 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.01k op/s 2021-10-08T19:34:10.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:10 smithi117 ceph-mon[34585]: 4.1a scrub ok 2021-10-08T19:34:10.411 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:10.443 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:10 smithi097 ceph-mon[32687]: pgmap v639: 178 pgs: 1 active+clean+scrubbing, 177 active+clean; 3.5 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.01k op/s 2021-10-08T19:34:10.443 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:10 smithi097 ceph-mon[32687]: 4.1a scrub ok 2021-10-08T19:34:10.444 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:10 smithi097 ceph-mon[41966]: pgmap v639: 178 pgs: 1 active+clean+scrubbing, 177 active+clean; 3.5 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.01k op/s 2021-10-08T19:34:10.444 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:10 smithi097 ceph-mon[41966]: 4.1a scrub ok 2021-10-08T19:34:10.444 INFO:journalctl@ceph.osd.2.smithi097.stdout:Oct 08 19:34:10 smithi097 conmon[55904]: 2021-10-08T19:34:10.145+0000 7f5996e44700 -1 osd.2 pg_epoch: 336 pg[5.d( v 250'9 (0'0,250'9] local-lis/les=64/65 n=1 ec=64/64 lis/c=64/64 les/c/f=65/65/0 sis=64) [2,7,5] r=0 lpr=64 crt=250'9 lcod 69'8 mlcod 69'8 active+clean] scrubber pg(5.d) handle_scrub_reserve_grant: received unsolicited reservation grant from osd 7 (0x562226e3e000) 2021-10-08T19:34:10.468 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:34:10.472 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:10.473 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:34:10.574 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:34:10.603 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:10.671 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:34:10.674 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:10.674 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:34:10.776 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:34:10.850 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:11.185 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is unset 2021-10-08T19:34:11.243 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:34:11.252 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:11.253 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:34:11.354 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:34:11.396 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:11.466 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:34:11.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:11 smithi097 ceph-mon[32687]: 9.a scrub ok 2021-10-08T19:34:11.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:11 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/558788240' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:34:11.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:11 smithi097 ceph-mon[32687]: from='client.25657 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:34:11.474 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:11 smithi097 ceph-mon[41966]: 9.a scrub ok 2021-10-08T19:34:11.474 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:11 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/558788240' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:34:11.474 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:11 smithi097 ceph-mon[41966]: from='client.25657 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:34:11.475 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:11.476 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:34:11.478 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:11 smithi117 ceph-mon[34585]: 9.a scrub ok 2021-10-08T19:34:11.478 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:11 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/558788240' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:34:11.479 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:11 smithi117 ceph-mon[34585]: from='client.25657 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:34:11.503 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2021-10-08T19:34:11.579 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:34:11.665 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:12.478 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:12 smithi097 ceph-mon[32687]: pgmap v640: 178 pgs: 1 active+clean+scrubbing, 177 active+clean; 3.3 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.39k op/s 2021-10-08T19:34:12.478 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:12 smithi097 ceph-mon[32687]: 9.b scrub ok 2021-10-08T19:34:12.481 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:12 smithi097 ceph-mon[32687]: 4.13 scrub ok 2021-10-08T19:34:12.482 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:12 smithi097 ceph-mon[32687]: 2.10 scrub ok 2021-10-08T19:34:12.482 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:12 smithi097 ceph-mon[32687]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:34:12.483 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:12 smithi097 ceph-mon[32687]: Cluster is now healthy 2021-10-08T19:34:12.483 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:12 smithi097 ceph-mon[32687]: from='client.25657 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:34:12.484 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:12 smithi097 ceph-mon[32687]: osdmap e337: 8 total, 8 up, 8 in 2021-10-08T19:34:12.484 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:12 smithi097 ceph-mon[32687]: 1.a scrub ok 2021-10-08T19:34:12.484 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:12 smithi097 ceph-mon[41966]: pgmap v640: 178 pgs: 1 active+clean+scrubbing, 177 active+clean; 3.3 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.39k op/s 2021-10-08T19:34:12.485 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:12 smithi097 ceph-mon[41966]: 9.b scrub ok 2021-10-08T19:34:12.485 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:12 smithi097 ceph-mon[41966]: 4.13 scrub ok 2021-10-08T19:34:12.485 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:12 smithi097 ceph-mon[41966]: 2.10 scrub ok 2021-10-08T19:34:12.485 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:12 smithi097 ceph-mon[41966]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:34:12.485 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:12 smithi097 ceph-mon[41966]: Cluster is now healthy 2021-10-08T19:34:12.486 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:12 smithi097 ceph-mon[41966]: from='client.25657 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:34:12.486 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:12 smithi097 ceph-mon[41966]: osdmap e337: 8 total, 8 up, 8 in 2021-10-08T19:34:12.486 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:12 smithi097 ceph-mon[41966]: 1.a scrub ok 2021-10-08T19:34:12.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:12 smithi117 ceph-mon[34585]: pgmap v640: 178 pgs: 1 active+clean+scrubbing, 177 active+clean; 3.3 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.39k op/s 2021-10-08T19:34:12.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:12 smithi117 ceph-mon[34585]: 9.b scrub ok 2021-10-08T19:34:12.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:12 smithi117 ceph-mon[34585]: 4.13 scrub ok 2021-10-08T19:34:12.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:12 smithi117 ceph-mon[34585]: 2.10 scrub ok 2021-10-08T19:34:12.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:12 smithi117 ceph-mon[34585]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:34:12.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:12 smithi117 ceph-mon[34585]: Cluster is now healthy 2021-10-08T19:34:12.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:12 smithi117 ceph-mon[34585]: from='client.25657 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:34:12.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:12 smithi117 ceph-mon[34585]: osdmap e337: 8 total, 8 up, 8 in 2021-10-08T19:34:12.659 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:12 smithi117 ceph-mon[34585]: 1.a scrub ok 2021-10-08T19:34:12.974 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:34:12 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:34:12] "GET /metrics HTTP/1.1" 200 155844 "" "Prometheus/2.18.1" 2021-10-08T19:34:13.256 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:34:13.260 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:13.262 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:34:13.364 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:34:13.425 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:13.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:13 smithi097 ceph-mon[41966]: 5.1a deep-scrub ok 2021-10-08T19:34:13.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:13 smithi097 ceph-mon[41966]: 4.1e scrub ok 2021-10-08T19:34:13.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:13 smithi097 ceph-mon[32687]: 5.1a deep-scrub ok 2021-10-08T19:34:13.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:13 smithi097 ceph-mon[32687]: 4.1e scrub ok 2021-10-08T19:34:13.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:13 smithi117 ceph-mon[34585]: 5.1a deep-scrub ok 2021-10-08T19:34:13.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:13 smithi117 ceph-mon[34585]: 4.1e scrub ok 2021-10-08T19:34:14.156 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:34:13 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:34:13] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:34:14.375 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:34:14.385 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:34:14.389 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:14.389 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:34:14.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:14 smithi097 ceph-mon[32687]: pgmap v642: 178 pgs: 1 active+clean+scrubbing, 177 active+clean; 3.3 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 667 B/s rd, 0 B/s wr, 716 op/s 2021-10-08T19:34:14.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:14 smithi097 ceph-mon[32687]: 2.19 scrub ok 2021-10-08T19:34:14.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:14 smithi097 ceph-mon[32687]: 1.3 deep-scrub ok 2021-10-08T19:34:14.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:14 smithi097 ceph-mon[41966]: pgmap v642: 178 pgs: 1 active+clean+scrubbing, 177 active+clean; 3.3 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 667 B/s rd, 0 B/s wr, 716 op/s 2021-10-08T19:34:14.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:14 smithi097 ceph-mon[41966]: 2.19 scrub ok 2021-10-08T19:34:14.474 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:14 smithi097 ceph-mon[41966]: 1.3 deep-scrub ok 2021-10-08T19:34:14.491 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:34:14.548 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:14.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:14 smithi117 ceph-mon[34585]: pgmap v642: 178 pgs: 1 active+clean+scrubbing, 177 active+clean; 3.3 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 667 B/s rd, 0 B/s wr, 716 op/s 2021-10-08T19:34:14.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:14 smithi117 ceph-mon[34585]: 2.19 scrub ok 2021-10-08T19:34:14.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:14 smithi117 ceph-mon[34585]: 1.3 deep-scrub ok 2021-10-08T19:34:14.708 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2021-10-08T19:34:14.709 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:34:14.787 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:34:14.794 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:14.795 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:34:14.896 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:34:14.922 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:14.984 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:34:14.992 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:14.993 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:34:15.094 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:34:15.125 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:15.185 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:34:15.191 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:15.192 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:34:15.210 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:15 smithi097 ceph-mon[32687]: 9.e scrub ok 2021-10-08T19:34:15.210 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:15 smithi097 ceph-mon[32687]: 4.b deep-scrub ok 2021-10-08T19:34:15.210 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:15 smithi097 ceph-mon[32687]: 5.14 scrub ok 2021-10-08T19:34:15.211 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:15 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/981324038' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2021-10-08T19:34:15.211 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:15 smithi097 ceph-mon[32687]: from='client.25660 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2021-10-08T19:34:15.220 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.1 to 1 (10000) 2021-10-08T19:34:15.293 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:34:15.320 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:15.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:15 smithi097 ceph-mon[41966]: 9.e scrub ok 2021-10-08T19:34:15.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:15 smithi097 ceph-mon[41966]: 4.b deep-scrub ok 2021-10-08T19:34:15.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:15 smithi097 ceph-mon[41966]: 5.14 scrub ok 2021-10-08T19:34:15.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:15 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/981324038' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2021-10-08T19:34:15.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:15 smithi097 ceph-mon[41966]: from='client.25660 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2021-10-08T19:34:15.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:15 smithi117 ceph-mon[34585]: 9.e scrub ok 2021-10-08T19:34:15.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:15 smithi117 ceph-mon[34585]: 4.b deep-scrub ok 2021-10-08T19:34:15.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:15 smithi117 ceph-mon[34585]: 5.14 scrub ok 2021-10-08T19:34:15.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:15 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/981324038' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2021-10-08T19:34:15.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:15 smithi117 ceph-mon[34585]: from='client.25660 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2021-10-08T19:34:16.288 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:16 smithi097 ceph-mon[41966]: 5.9 scrub ok 2021-10-08T19:34:16.289 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:16 smithi097 ceph-mon[41966]: pgmap v643: 178 pgs: 1 active+clean+scrubbing, 177 active+clean; 3.0 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.34k op/s 2021-10-08T19:34:16.289 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:16 smithi097 ceph-mon[41966]: 4.1b scrub ok 2021-10-08T19:34:16.289 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:16 smithi097 ceph-mon[41966]: from='client.25660 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2021-10-08T19:34:16.290 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:16 smithi097 ceph-mon[41966]: osdmap e338: 8 total, 8 up, 8 in 2021-10-08T19:34:16.290 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:16 smithi097 ceph-mon[32687]: 5.9 scrub ok 2021-10-08T19:34:16.291 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:16 smithi097 ceph-mon[32687]: pgmap v643: 178 pgs: 1 active+clean+scrubbing, 177 active+clean; 3.0 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.34k op/s 2021-10-08T19:34:16.291 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:16 smithi097 ceph-mon[32687]: 4.1b scrub ok 2021-10-08T19:34:16.291 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:16 smithi097 ceph-mon[32687]: from='client.25660 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2021-10-08T19:34:16.291 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:16 smithi097 ceph-mon[32687]: osdmap e338: 8 total, 8 up, 8 in 2021-10-08T19:34:16.292 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2021-10-08T19:34:16.297 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set noscrub 2021-10-08T19:34:16.392 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:34:16.396 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:16.397 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:34:16.498 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:34:16.617 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:16.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:16 smithi117 ceph-mon[34585]: 5.9 scrub ok 2021-10-08T19:34:16.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:16 smithi117 ceph-mon[34585]: pgmap v643: 178 pgs: 1 active+clean+scrubbing, 177 active+clean; 3.0 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.34k op/s 2021-10-08T19:34:16.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:16 smithi117 ceph-mon[34585]: 4.1b scrub ok 2021-10-08T19:34:16.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:16 smithi117 ceph-mon[34585]: from='client.25660 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2021-10-08T19:34:16.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:16 smithi117 ceph-mon[34585]: osdmap e338: 8 total, 8 up, 8 in 2021-10-08T19:34:16.970 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:34:16 smithi097 conmon[33110]: 172.21.15.97 - - [08/Oct/2021:19:34:16] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:34:17.158 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:34:16 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:34:17.205 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:34:17.208 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:17.209 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:34:17.310 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:34:17.344 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:17.410 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:34:17.414 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:17.416 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:34:17.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:17 smithi097 ceph-mon[41966]: 2.1c scrub ok 2021-10-08T19:34:17.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:17 smithi097 ceph-mon[41966]: 6.0 deep-scrub ok 2021-10-08T19:34:17.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:17 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:34:17.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:17 smithi097 ceph-mon[41966]: 4.2 scrub ok 2021-10-08T19:34:17.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:17 smithi097 ceph-mon[32687]: 2.1c scrub ok 2021-10-08T19:34:17.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:17 smithi097 ceph-mon[32687]: 6.0 deep-scrub ok 2021-10-08T19:34:17.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:17 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:34:17.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:17 smithi097 ceph-mon[32687]: 4.2 scrub ok 2021-10-08T19:34:17.517 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:34:17.557 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:17.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:17 smithi117 ceph-mon[34585]: 2.1c scrub ok 2021-10-08T19:34:17.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:17 smithi117 ceph-mon[34585]: 6.0 deep-scrub ok 2021-10-08T19:34:17.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:17 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:34:17.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:17 smithi117 ceph-mon[34585]: 4.2 scrub ok 2021-10-08T19:34:17.843 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd reweight 3 1 2021-10-08T19:34:18.001 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:34:18.019 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:18.020 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:34:18.056 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:34:18.102 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:34:18.121 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:34:18.201 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:18.308 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:34:18.315 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:18.316 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:34:18.417 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:34:18.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:18 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:34:18.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:18 smithi097 ceph-mon[41966]: 172.21.15.97 - - [08/Oct/2021:19:34:16] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:34:18.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:18 smithi097 ceph-mon[41966]: pgmap v645: 178 pgs: 1 active+clean+scrubbing, 177 active+clean; 3.0 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 1.04k op/s 2021-10-08T19:34:18.474 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:18 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:34:18.474 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:18 smithi097 ceph-mon[41966]: 5.b scrub ok 2021-10-08T19:34:18.474 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:18 smithi097 ceph-mon[41966]: 4.a scrub ok 2021-10-08T19:34:18.475 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:18 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:34:18.475 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:18 smithi097 ceph-mon[32687]: 172.21.15.97 - - [08/Oct/2021:19:34:16] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:34:18.475 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:18 smithi097 ceph-mon[32687]: pgmap v645: 178 pgs: 1 active+clean+scrubbing, 177 active+clean; 3.0 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 1.04k op/s 2021-10-08T19:34:18.475 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:18 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:34:18.475 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:18 smithi097 ceph-mon[32687]: 5.b scrub ok 2021-10-08T19:34:18.476 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:18 smithi097 ceph-mon[32687]: 4.a scrub ok 2021-10-08T19:34:18.491 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:18.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:18 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:34:18.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:18 smithi117 ceph-mon[34585]: 172.21.15.97 - - [08/Oct/2021:19:34:16] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:34:18.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:18 smithi117 ceph-mon[34585]: pgmap v645: 178 pgs: 1 active+clean+scrubbing, 177 active+clean; 3.0 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 1.04k op/s 2021-10-08T19:34:18.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:18 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:34:18.659 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:18 smithi117 ceph-mon[34585]: 5.b scrub ok 2021-10-08T19:34:18.659 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:18 smithi117 ceph-mon[34585]: 4.a scrub ok 2021-10-08T19:34:18.708 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:34:18.716 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:18.718 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:34:18.819 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:34:18.863 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:18.927 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:34:18.933 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:18.935 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:34:18.977 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:34:19.037 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:34:19.075 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:19.161 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:34:19.165 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:19.166 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:34:19.268 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:34:19.304 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:19.388 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:34:19.390 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:19.391 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:34:19.492 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:34:19.526 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:19 smithi097 ceph-mon[41966]: 5.11 deep-scrub ok 2021-10-08T19:34:19.526 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:19 smithi097 ceph-mon[41966]: 3.0 deep-scrub ok 2021-10-08T19:34:19.527 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:19 smithi097 ceph-mon[32687]: 5.11 deep-scrub ok 2021-10-08T19:34:19.527 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:19 smithi097 ceph-mon[32687]: 3.0 deep-scrub ok 2021-10-08T19:34:19.527 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:19.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:19 smithi117 ceph-mon[34585]: 5.11 deep-scrub ok 2021-10-08T19:34:19.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:19 smithi117 ceph-mon[34585]: 3.0 deep-scrub ok 2021-10-08T19:34:19.726 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:34:19.726 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:34:19.727 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:34:19.727 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:34:19.727 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:34:19.760 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:34:19.798 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:34:19.840 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:34:19.844 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true' 2021-10-08T19:34:19.847 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true' 2021-10-08T19:34:19.848 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true' 2021-10-08T19:34:19.848 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true' 2021-10-08T19:34:19.848 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true' 2021-10-08T19:34:19.848 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true' 2021-10-08T19:34:19.849 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'true' 2021-10-08T19:34:19.849 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'true' 2021-10-08T19:34:20.051 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:34:20.055 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:20.056 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:34:20.159 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:34:20.196 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:20.280 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:34:20.284 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:20.285 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:34:20.386 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:34:20.439 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:20.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:20 smithi117 ceph-mon[34585]: pgmap v646: 178 pgs: 1 active+clean+scrubbing, 177 active+clean; 2.8 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 969 op/s 2021-10-08T19:34:20.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:20 smithi117 ceph-mon[34585]: 2.c scrub ok 2021-10-08T19:34:20.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:20 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/941768070' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:34:20.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:20 smithi097 ceph-mon[32687]: pgmap v646: 178 pgs: 1 active+clean+scrubbing, 177 active+clean; 2.8 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 969 op/s 2021-10-08T19:34:20.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:20 smithi097 ceph-mon[32687]: 2.c scrub ok 2021-10-08T19:34:20.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:20 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/941768070' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:34:20.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:20 smithi097 ceph-mon[41966]: pgmap v646: 178 pgs: 1 active+clean+scrubbing, 177 active+clean; 2.8 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 969 op/s 2021-10-08T19:34:20.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:20 smithi097 ceph-mon[41966]: 2.c scrub ok 2021-10-08T19:34:20.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:20 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/941768070' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:34:21.618 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:34:21.620 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:21.621 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:34:21.723 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:34:21.761 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:21.779 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:21 smithi097 ceph-mon[41966]: 5.6 deep-scrub ok 2021-10-08T19:34:21.780 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:21 smithi097 ceph-mon[41966]: 6.8 scrub ok 2021-10-08T19:34:21.780 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:21 smithi097 ceph-mon[41966]: pgmap v647: 178 pgs: 178 active+clean; 2.6 GiB data, 9.8 GiB used, 705 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1.13k op/s 2021-10-08T19:34:21.782 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:21 smithi097 ceph-mon[32687]: 5.6 deep-scrub ok 2021-10-08T19:34:21.782 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:21 smithi097 ceph-mon[32687]: 6.8 scrub ok 2021-10-08T19:34:21.782 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:21 smithi097 ceph-mon[32687]: pgmap v647: 178 pgs: 178 active+clean; 2.6 GiB data, 9.8 GiB used, 705 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1.13k op/s 2021-10-08T19:34:22.044 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:21 smithi117 ceph-mon[34585]: 5.6 deep-scrub ok 2021-10-08T19:34:22.045 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:21 smithi117 ceph-mon[34585]: 6.8 scrub ok 2021-10-08T19:34:22.045 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:21 smithi117 ceph-mon[34585]: pgmap v647: 178 pgs: 178 active+clean; 2.6 GiB data, 9.8 GiB used, 705 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1.13k op/s 2021-10-08T19:34:22.380 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:34:22.382 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:22.383 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:34:22.484 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:34:22.518 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:22.651 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:34:22 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:34:22] "GET /metrics HTTP/1.1" 200 155844 "" "Prometheus/2.18.1" 2021-10-08T19:34:22.768 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is set 2021-10-08T19:34:22.779 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:34:22.779 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2021-10-08T19:34:22.780 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2021-10-08T19:34:22.780 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2021-10-08T19:34:22.780 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.780 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:95872 8.b 8:d7354f87:::benchmark_data_smithi097_144160_object7132:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e227)", 2021-10-08T19:34:22.780 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:29.708779+0000", 2021-10-08T19:34:22.781 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 293.06305004000001, 2021-10-08T19:34:22.781 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.89992862399999995, 2021-10-08T19:34:22.781 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:34:22.782 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "reached pg", 2021-10-08T19:34:22.782 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:34:22.782 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:34:22.783 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:34:22.783 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 95872 2021-10-08T19:34:22.783 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.784 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:34:22.784 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.784 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:34:22.785 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.708779+0000", 2021-10-08T19:34:22.785 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:34:22.785 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.785 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.786 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:34:22.786 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.708779+0000", 2021-10-08T19:34:22.786 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:34:22.786 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.787 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.787 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:34:22.787 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.708776+0000", 2021-10-08T19:34:22.787 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:34:22.788 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.788 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.788 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:34:22.788 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.708785+0000", 2021-10-08T19:34:22.788 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8009999999999993e-06 2021-10-08T19:34:22.789 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.789 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.789 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:34:22.789 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.708798+0000", 2021-10-08T19:34:22.790 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3314e-05 2021-10-08T19:34:22.790 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.790 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.790 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:34:22.791 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.708806+0000", 2021-10-08T19:34:22.791 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2649999999999999e-06 2021-10-08T19:34:22.791 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.791 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.792 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:34:22.792 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.708849+0000", 2021-10-08T19:34:22.792 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3662000000000003e-05 2021-10-08T19:34:22.793 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.793 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.793 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:34:22.793 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.708983+0000", 2021-10-08T19:34:22.794 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013373000000000001 2021-10-08T19:34:22.794 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.794 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.794 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:34:22.794 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.709165+0000", 2021-10-08T19:34:22.795 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000182251 2021-10-08T19:34:22.795 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.795 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.795 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:34:22.796 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.715936+0000", 2021-10-08T19:34:22.796 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0067701259999999996 2021-10-08T19:34:22.796 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.796 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.796 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:34:22.797 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.756486+0000", 2021-10-08T19:34:22.797 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.040550707999999998 2021-10-08T19:34:22.797 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.797 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.797 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:34:22.798 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.756496+0000", 2021-10-08T19:34:22.798 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.6369999999999994e-06 2021-10-08T19:34:22.798 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.798 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.799 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:34:22.799 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:30.608695+0000", 2021-10-08T19:34:22.799 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.852199182 2021-10-08T19:34:22.799 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.800 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.800 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:34:22.800 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:30.608707+0000", 2021-10-08T19:34:22.800 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2306999999999999e-05 2021-10-08T19:34:22.800 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:34:22.801 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:34:22.801 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:34:22.801 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.801 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.802 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:95883 8.b 8:d3d97448:::benchmark_data_smithi097_144160_object7143:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e227)", 2021-10-08T19:34:22.802 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:29.719356+0000", 2021-10-08T19:34:22.803 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 293.05247258999998, 2021-10-08T19:34:22.803 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.88939190199999996, 2021-10-08T19:34:22.804 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:34:22.805 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "reached pg", 2021-10-08T19:34:22.806 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:34:22.806 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:34:22.807 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:34:22.807 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 95883 2021-10-08T19:34:22.808 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.808 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:34:22.808 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.809 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:34:22.809 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.719356+0000", 2021-10-08T19:34:22.810 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:34:22.810 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.811 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.811 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:34:22.811 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.719356+0000", 2021-10-08T19:34:22.812 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:34:22.812 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.813 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.814 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:34:22.814 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.719354+0000", 2021-10-08T19:34:22.815 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:34:22.816 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.816 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.817 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:34:22.817 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.719364+0000", 2021-10-08T19:34:22.818 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0005e-05 2021-10-08T19:34:22.818 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.819 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.819 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:34:22.820 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.719377+0000", 2021-10-08T19:34:22.820 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2465e-05 2021-10-08T19:34:22.820 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.821 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.821 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:34:22.822 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.719382+0000", 2021-10-08T19:34:22.822 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5639999999999996e-06 2021-10-08T19:34:22.823 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.823 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.824 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:34:22.824 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.719842+0000", 2021-10-08T19:34:22.825 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00045944900000000001 2021-10-08T19:34:22.825 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.826 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.826 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:34:22.826 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.720009+0000", 2021-10-08T19:34:22.827 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000167047 2021-10-08T19:34:22.827 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.827 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.828 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:34:22.828 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.720188+0000", 2021-10-08T19:34:22.828 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017916399999999999 2021-10-08T19:34:22.828 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.828 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.829 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:34:22.829 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.722699+0000", 2021-10-08T19:34:22.829 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0025115189999999998 2021-10-08T19:34:22.829 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.829 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.830 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:34:22.830 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.756524+0000", 2021-10-08T19:34:22.830 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.033824119 2021-10-08T19:34:22.831 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.831 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.831 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:34:22.831 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.756531+0000", 2021-10-08T19:34:22.832 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.661e-06 2021-10-08T19:34:22.832 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.832 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.832 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:34:22.832 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:30.608739+0000", 2021-10-08T19:34:22.833 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.85220770999999995 2021-10-08T19:34:22.833 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.833 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.833 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:34:22.834 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:30.608748+0000", 2021-10-08T19:34:22.834 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.1940000000000004e-06 2021-10-08T19:34:22.834 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:34:22.835 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:34:22.835 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:34:22.835 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.835 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.835 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:102327 8.b 8:d96333ad:::benchmark_data_smithi097_144160_object13587:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e245)", 2021-10-08T19:34:22.836 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:57.776586+0000", 2021-10-08T19:34:22.836 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 264.99524248500001, 2021-10-08T19:34:22.836 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.313372897, 2021-10-08T19:34:22.837 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:34:22.837 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "reached pg", 2021-10-08T19:34:22.837 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:34:22.837 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:34:22.838 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:34:22.838 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 102327 2021-10-08T19:34:22.838 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.838 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:34:22.838 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.839 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:34:22.839 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.776586+0000", 2021-10-08T19:34:22.839 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:34:22.839 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.840 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.840 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:34:22.840 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.776586+0000", 2021-10-08T19:34:22.840 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:34:22.840 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.841 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.841 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:34:22.841 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.776584+0000", 2021-10-08T19:34:22.841 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:34:22.842 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.842 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.842 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:34:22.842 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.776592+0000", 2021-10-08T19:34:22.842 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3229999999999998e-06 2021-10-08T19:34:22.843 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.843 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.843 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:34:22.843 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.776604+0000", 2021-10-08T19:34:22.844 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2075999999999999e-05 2021-10-08T19:34:22.844 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.844 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.844 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:34:22.844 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.776612+0000", 2021-10-08T19:34:22.845 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.182e-06 2021-10-08T19:34:22.845 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.845 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.846 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:34:22.846 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.776666+0000", 2021-10-08T19:34:22.846 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4580000000000003e-05 2021-10-08T19:34:22.846 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.846 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.847 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:34:22.847 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.776804+0000", 2021-10-08T19:34:22.847 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000137732 2021-10-08T19:34:22.847 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.848 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.848 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:34:22.848 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.776946+0000", 2021-10-08T19:34:22.848 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000141865 2021-10-08T19:34:22.848 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.849 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.849 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:34:22.849 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.784549+0000", 2021-10-08T19:34:22.849 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.007603004 2021-10-08T19:34:22.849 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.850 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.850 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:34:22.850 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.784555+0000", 2021-10-08T19:34:22.851 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.63e-06 2021-10-08T19:34:22.851 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.851 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.851 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:34:22.852 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.064145+0000", 2021-10-08T19:34:22.852 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.27958945 2021-10-08T19:34:22.852 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.852 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.853 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for missing object", 2021-10-08T19:34:22.853 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.064320+0000", 2021-10-08T19:34:22.853 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017478799999999999 2021-10-08T19:34:22.853 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.853 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.854 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:34:22.854 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.089870+0000", 2021-10-08T19:34:22.854 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.025550007999999999 2021-10-08T19:34:22.854 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.854 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.855 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:34:22.855 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.089959+0000", 2021-10-08T19:34:22.855 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9622000000000004e-05 2021-10-08T19:34:22.855 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:34:22.855 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:34:22.856 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:34:22.856 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.856 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.856 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:102343 8.b 8:d1ed84a2:::benchmark_data_smithi097_144160_object13603:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e246)", 2021-10-08T19:34:22.857 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:57.786622+0000", 2021-10-08T19:34:22.857 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 264.98520720300002, 2021-10-08T19:34:22.857 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3035327460000001, 2021-10-08T19:34:22.857 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:34:22.857 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:34:22.858 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:34:22.858 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:34:22.858 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:34:22.858 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 102343 2021-10-08T19:34:22.858 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.859 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:34:22.859 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.859 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:34:22.859 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.786622+0000", 2021-10-08T19:34:22.860 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:34:22.860 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.860 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.860 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:34:22.861 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.786622+0000", 2021-10-08T19:34:22.861 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:34:22.861 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.861 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.862 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:34:22.862 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.786619+0000", 2021-10-08T19:34:22.862 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:34:22.862 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.862 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.863 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:34:22.863 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.786627+0000", 2021-10-08T19:34:22.863 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2370000000000003e-06 2021-10-08T19:34:22.863 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.864 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.864 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:34:22.864 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.786640+0000", 2021-10-08T19:34:22.864 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3638000000000001e-05 2021-10-08T19:34:22.864 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.865 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.865 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:34:22.865 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.786647+0000", 2021-10-08T19:34:22.865 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.336e-06 2021-10-08T19:34:22.865 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.866 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.866 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:34:22.866 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.786694+0000", 2021-10-08T19:34:22.866 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7061999999999998e-05 2021-10-08T19:34:22.867 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.867 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.867 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:34:22.867 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.786702+0000", 2021-10-08T19:34:22.867 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.9759999999999995e-06 2021-10-08T19:34:22.868 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.868 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.868 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:34:22.868 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.064372+0000", 2021-10-08T19:34:22.868 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2776700810000001 2021-10-08T19:34:22.869 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.869 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.869 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:34:22.869 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.064483+0000", 2021-10-08T19:34:22.870 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000111037 2021-10-08T19:34:22.870 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.870 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.870 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:34:22.870 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.064576+0000", 2021-10-08T19:34:22.871 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.3629999999999996e-05 2021-10-08T19:34:22.871 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.871 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.871 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:34:22.871 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.073145+0000", 2021-10-08T19:34:22.872 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0085683519999999996 2021-10-08T19:34:22.872 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.872 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.872 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:22.873 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.089994+0000", 2021-10-08T19:34:22.873 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016849113999999998 2021-10-08T19:34:22.873 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.873 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.874 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:22.874 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.090049+0000", 2021-10-08T19:34:22.874 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4925e-05 2021-10-08T19:34:22.874 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.874 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.875 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:34:22.875 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.090087+0000", 2021-10-08T19:34:22.875 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8114000000000001e-05 2021-10-08T19:34:22.875 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.875 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.876 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:34:22.876 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.090154+0000", 2021-10-08T19:34:22.876 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7436999999999998e-05 2021-10-08T19:34:22.876 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:34:22.877 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:34:22.877 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:34:22.877 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.877 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.877 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:102361 8.b 8:d358b36d:::benchmark_data_smithi097_144160_object13621:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e246)", 2021-10-08T19:34:22.878 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:57.803469+0000", 2021-10-08T19:34:22.878 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 264.96835954400001, 2021-10-08T19:34:22.878 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2869686300000001, 2021-10-08T19:34:22.878 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:34:22.878 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:34:22.879 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:34:22.879 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:34:22.879 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:34:22.879 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 102361 2021-10-08T19:34:22.880 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.880 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:34:22.880 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.880 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:34:22.880 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.803469+0000", 2021-10-08T19:34:22.881 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:34:22.881 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.881 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.881 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:34:22.882 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.803469+0000", 2021-10-08T19:34:22.882 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:34:22.882 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.882 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.882 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:34:22.883 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.803466+0000", 2021-10-08T19:34:22.883 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2021-10-08T19:34:22.883 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.884 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.884 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:34:22.884 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.803475+0000", 2021-10-08T19:34:22.884 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4840000000000004e-06 2021-10-08T19:34:22.884 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.885 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.885 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:34:22.885 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.803489+0000", 2021-10-08T19:34:22.886 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4278e-05 2021-10-08T19:34:22.886 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.886 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.886 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:34:22.886 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.803495+0000", 2021-10-08T19:34:22.887 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6010000000000002e-06 2021-10-08T19:34:22.887 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.887 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.887 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:34:22.888 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.803548+0000", 2021-10-08T19:34:22.888 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2964999999999999e-05 2021-10-08T19:34:22.888 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.888 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.888 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:34:22.889 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.803560+0000", 2021-10-08T19:34:22.889 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1783000000000001e-05 2021-10-08T19:34:22.889 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.889 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.889 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:34:22.890 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.066723+0000", 2021-10-08T19:34:22.890 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2631632740000001 2021-10-08T19:34:22.890 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.890 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.891 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:34:22.891 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.066846+0000", 2021-10-08T19:34:22.891 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012360800000000001 2021-10-08T19:34:22.891 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.891 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.892 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:34:22.892 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.066947+0000", 2021-10-08T19:34:22.892 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010030300000000001 2021-10-08T19:34:22.892 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.892 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.893 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:34:22.893 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.073155+0000", 2021-10-08T19:34:22.893 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.006208369 2021-10-08T19:34:22.893 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.894 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.894 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:22.894 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.090022+0000", 2021-10-08T19:34:22.894 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016866467 2021-10-08T19:34:22.894 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.895 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.895 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:22.895 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.090239+0000", 2021-10-08T19:34:22.895 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021783300000000001 2021-10-08T19:34:22.896 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.896 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.896 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:34:22.896 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.090302+0000", 2021-10-08T19:34:22.896 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2689999999999998e-05 2021-10-08T19:34:22.897 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.897 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.897 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:34:22.897 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.090438+0000", 2021-10-08T19:34:22.897 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013576199999999999 2021-10-08T19:34:22.898 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:34:22.898 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:34:22.898 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:34:22.898 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.899 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.899 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:102370 8.b 8:d6039b15:::benchmark_data_smithi097_144160_object13630:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e246)", 2021-10-08T19:34:22.899 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:57.811310+0000", 2021-10-08T19:34:22.899 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 264.96051915300001, 2021-10-08T19:34:22.899 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.279322471, 2021-10-08T19:34:22.900 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:34:22.900 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:34:22.900 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:34:22.900 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:34:22.900 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:34:22.901 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 102370 2021-10-08T19:34:22.901 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.901 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:34:22.901 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.901 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:34:22.902 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.811310+0000", 2021-10-08T19:34:22.902 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:34:22.902 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.902 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.903 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:34:22.903 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.811310+0000", 2021-10-08T19:34:22.903 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:34:22.903 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.903 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.904 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:34:22.904 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.811307+0000", 2021-10-08T19:34:22.904 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2021-10-08T19:34:22.904 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.904 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.905 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:34:22.905 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.811316+0000", 2021-10-08T19:34:22.905 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0089999999999996e-06 2021-10-08T19:34:22.905 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.905 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.906 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:34:22.906 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.811330+0000", 2021-10-08T19:34:22.906 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4246999999999999e-05 2021-10-08T19:34:22.906 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.907 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.907 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:34:22.907 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.811337+0000", 2021-10-08T19:34:22.907 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0620000000000003e-06 2021-10-08T19:34:22.907 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.908 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.908 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:34:22.908 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.811393+0000", 2021-10-08T19:34:22.908 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5599000000000001e-05 2021-10-08T19:34:22.908 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.909 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.909 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:34:22.909 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.811402+0000", 2021-10-08T19:34:22.909 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4190000000000008e-06 2021-10-08T19:34:22.910 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.910 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.910 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:34:22.910 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.068209+0000", 2021-10-08T19:34:22.910 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2568067969999999 2021-10-08T19:34:22.911 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.911 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.911 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:34:22.911 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.068351+0000", 2021-10-08T19:34:22.911 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014235800000000001 2021-10-08T19:34:22.912 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.912 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.912 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:34:22.912 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.068521+0000", 2021-10-08T19:34:22.912 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016929400000000001 2021-10-08T19:34:22.913 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.913 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.913 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:34:22.913 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.076535+0000", 2021-10-08T19:34:22.914 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.008014284 2021-10-08T19:34:22.914 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.914 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.914 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:22.914 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.090183+0000", 2021-10-08T19:34:22.915 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013648118000000001 2021-10-08T19:34:22.915 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.915 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.915 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:22.915 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.090500+0000", 2021-10-08T19:34:22.916 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031644699999999997 2021-10-08T19:34:22.916 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.916 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.916 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:34:22.916 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.090537+0000", 2021-10-08T19:34:22.917 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7335000000000001e-05 2021-10-08T19:34:22.917 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.917 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.917 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:34:22.918 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.090632+0000", 2021-10-08T19:34:22.918 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5163999999999999e-05 2021-10-08T19:34:22.918 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:34:22.918 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:34:22.918 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:34:22.919 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.919 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.919 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:102371 8.b 8:d2cae905:::benchmark_data_smithi097_144160_object13631:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e246)", 2021-10-08T19:34:22.919 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:57.812258+0000", 2021-10-08T19:34:22.919 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 264.95957116800002, 2021-10-08T19:34:22.920 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2786662559999999, 2021-10-08T19:34:22.920 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:34:22.920 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:34:22.920 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:34:22.920 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:34:22.921 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:34:22.921 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 102371 2021-10-08T19:34:22.921 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.921 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:34:22.922 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.922 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:34:22.922 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.812258+0000", 2021-10-08T19:34:22.922 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:34:22.922 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.923 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.923 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:34:22.923 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.812258+0000", 2021-10-08T19:34:22.923 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:34:22.924 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.924 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.924 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:34:22.924 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.812255+0000", 2021-10-08T19:34:22.925 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:34:22.925 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.925 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.925 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:34:22.925 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.812263+0000", 2021-10-08T19:34:22.926 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8310000000000001e-06 2021-10-08T19:34:22.926 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.926 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.926 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:34:22.926 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.812274+0000", 2021-10-08T19:34:22.927 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1038e-05 2021-10-08T19:34:22.927 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.927 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.927 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:34:22.927 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.812281+0000", 2021-10-08T19:34:22.928 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9410000000000001e-06 2021-10-08T19:34:22.928 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.928 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.928 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:34:22.929 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.812328+0000", 2021-10-08T19:34:22.929 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7534999999999998e-05 2021-10-08T19:34:22.929 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.929 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.929 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:34:22.930 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.812337+0000", 2021-10-08T19:34:22.930 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0690000000000002e-06 2021-10-08T19:34:22.930 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.930 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.930 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:34:22.931 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.070249+0000", 2021-10-08T19:34:22.931 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2579120420000001 2021-10-08T19:34:22.931 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.931 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.931 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:34:22.932 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.070324+0000", 2021-10-08T19:34:22.932 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5723999999999995e-05 2021-10-08T19:34:22.932 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.932 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.933 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:34:22.933 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.070397+0000", 2021-10-08T19:34:22.933 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2696999999999999e-05 2021-10-08T19:34:22.933 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.933 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.934 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:34:22.934 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.076545+0000", 2021-10-08T19:34:22.934 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0061481239999999996 2021-10-08T19:34:22.934 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.934 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.935 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:22.935 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.090685+0000", 2021-10-08T19:34:22.935 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.014139413 2021-10-08T19:34:22.935 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.935 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.936 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:22.936 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.090755+0000", 2021-10-08T19:34:22.936 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9966000000000001e-05 2021-10-08T19:34:22.936 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.937 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.937 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:34:22.937 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.090808+0000", 2021-10-08T19:34:22.937 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3483999999999998e-05 2021-10-08T19:34:22.937 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.938 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.938 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:34:22.938 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.090924+0000", 2021-10-08T19:34:22.938 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115852 2021-10-08T19:34:22.938 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:34:22.939 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:34:22.939 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:34:22.939 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.939 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.939 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:102408 8.b 8:d5c85811:::benchmark_data_smithi097_144160_object13668:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e246)", 2021-10-08T19:34:22.940 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:57.849095+0000", 2021-10-08T19:34:22.940 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 264.92273398999998, 2021-10-08T19:34:22.940 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.242117699, 2021-10-08T19:34:22.940 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:34:22.941 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:34:22.941 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:34:22.941 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:34:22.941 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:34:22.942 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 102408 2021-10-08T19:34:22.942 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.942 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:34:22.942 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.943 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:34:22.943 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.849095+0000", 2021-10-08T19:34:22.943 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:34:22.943 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.944 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.944 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:34:22.944 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.849095+0000", 2021-10-08T19:34:22.945 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:34:22.945 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.945 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.945 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:34:22.946 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.849092+0000", 2021-10-08T19:34:22.946 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2021-10-08T19:34:22.946 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.946 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.947 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:34:22.947 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.849101+0000", 2021-10-08T19:34:22.947 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2150000000000007e-06 2021-10-08T19:34:22.947 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.947 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.948 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:34:22.948 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.849119+0000", 2021-10-08T19:34:22.948 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7762999999999999e-05 2021-10-08T19:34:22.948 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.949 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.949 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:34:22.949 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.849127+0000", 2021-10-08T19:34:22.949 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0339999999999997e-06 2021-10-08T19:34:22.950 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.950 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.950 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:34:22.950 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.849213+0000", 2021-10-08T19:34:22.951 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5550999999999995e-05 2021-10-08T19:34:22.951 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.951 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.951 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:34:22.951 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.849225+0000", 2021-10-08T19:34:22.952 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2784e-05 2021-10-08T19:34:22.952 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.952 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.952 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:34:22.952 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.071521+0000", 2021-10-08T19:34:22.953 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.222295881 2021-10-08T19:34:22.953 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.953 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.953 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:34:22.954 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.071592+0000", 2021-10-08T19:34:22.954 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0618999999999996e-05 2021-10-08T19:34:22.954 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.954 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.955 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:34:22.955 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.071704+0000", 2021-10-08T19:34:22.955 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000111947 2021-10-08T19:34:22.955 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.956 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.956 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:34:22.956 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.079462+0000", 2021-10-08T19:34:22.957 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0077579880000000004 2021-10-08T19:34:22.957 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.957 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.957 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:22.958 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.090992+0000", 2021-10-08T19:34:22.958 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011530228999999999 2021-10-08T19:34:22.958 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.958 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.959 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:22.959 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.091047+0000", 2021-10-08T19:34:22.959 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5003999999999997e-05 2021-10-08T19:34:22.959 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.960 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.960 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:34:22.960 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.091101+0000", 2021-10-08T19:34:22.960 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3915999999999997e-05 2021-10-08T19:34:22.960 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.961 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.961 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:34:22.961 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.091212+0000", 2021-10-08T19:34:22.961 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000111482 2021-10-08T19:34:22.962 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:34:22.962 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:34:22.962 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:34:22.962 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.963 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.963 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:102461 8.b 8:d92641bf:::benchmark_data_smithi097_144160_object13721:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e246)", 2021-10-08T19:34:22.963 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:57.896261+0000", 2021-10-08T19:34:22.963 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 264.87556731500001, 2021-10-08T19:34:22.964 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.19521414, 2021-10-08T19:34:22.964 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:34:22.965 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:34:22.965 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:34:22.965 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:34:22.966 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:34:22.966 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 102461 2021-10-08T19:34:22.966 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.966 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:34:22.967 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.967 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:34:22.967 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.896261+0000", 2021-10-08T19:34:22.969 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:34:22.969 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.969 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.969 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:34:22.970 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.896261+0000", 2021-10-08T19:34:22.970 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:34:22.970 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.970 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.970 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:34:22.971 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.896259+0000", 2021-10-08T19:34:22.971 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2021-10-08T19:34:22.971 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.971 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.971 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:34:22.972 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.896269+0000", 2021-10-08T19:34:22.972 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0076e-05 2021-10-08T19:34:22.972 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.972 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.973 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:34:22.973 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.896287+0000", 2021-10-08T19:34:22.973 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8287999999999998e-05 2021-10-08T19:34:22.973 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.973 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.974 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:34:22.974 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.896294+0000", 2021-10-08T19:34:22.974 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1080000000000004e-06 2021-10-08T19:34:22.974 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.974 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.975 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:34:22.975 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.898501+0000", 2021-10-08T19:34:22.975 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0022066809999999998 2021-10-08T19:34:22.975 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.976 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.976 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:34:22.976 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.898513+0000", 2021-10-08T19:34:22.976 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2515e-05 2021-10-08T19:34:22.976 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.977 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.977 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:34:22.977 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.073204+0000", 2021-10-08T19:34:22.977 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1746909130000001 2021-10-08T19:34:22.977 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.978 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.978 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:34:22.978 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.073334+0000", 2021-10-08T19:34:22.978 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012976599999999999 2021-10-08T19:34:22.978 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.979 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.979 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:34:22.979 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.073472+0000", 2021-10-08T19:34:22.979 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013843899999999999 2021-10-08T19:34:22.980 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.980 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.980 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:34:22.980 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.079467+0000", 2021-10-08T19:34:22.980 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0059946419999999997 2021-10-08T19:34:22.981 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.981 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.981 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:22.981 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.091278+0000", 2021-10-08T19:34:22.981 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011810835 2021-10-08T19:34:22.982 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.982 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.982 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:22.982 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.091321+0000", 2021-10-08T19:34:22.983 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2846999999999998e-05 2021-10-08T19:34:22.983 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.983 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.983 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:34:22.983 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.091367+0000", 2021-10-08T19:34:22.984 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6230000000000003e-05 2021-10-08T19:34:22.984 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.984 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.984 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:34:22.984 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.091476+0000", 2021-10-08T19:34:22.985 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000108612 2021-10-08T19:34:22.985 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:34:22.985 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:34:22.985 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:34:22.985 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.986 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.986 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:102466 8.b 8:d1830078:::benchmark_data_smithi097_144160_object13726:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e246)", 2021-10-08T19:34:22.986 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:57.901226+0000", 2021-10-08T19:34:22.986 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 264.87060266999998, 2021-10-08T19:34:22.987 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1905235759999999, 2021-10-08T19:34:22.987 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:34:22.987 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:34:22.987 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:34:22.987 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:34:22.988 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:34:22.988 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 102466 2021-10-08T19:34:22.988 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.988 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:34:22.989 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.989 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:34:22.989 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.901226+0000", 2021-10-08T19:34:22.989 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:34:22.990 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.990 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.990 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:34:22.990 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.901226+0000", 2021-10-08T19:34:22.990 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:34:22.991 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.991 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.991 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:34:22.991 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.901224+0000", 2021-10-08T19:34:22.992 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:34:22.992 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.992 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.992 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:34:22.993 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.901234+0000", 2021-10-08T19:34:22.993 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0096e-05 2021-10-08T19:34:22.993 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.993 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.993 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:34:22.994 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.901251+0000", 2021-10-08T19:34:22.994 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7295999999999998e-05 2021-10-08T19:34:22.994 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.994 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.995 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:34:22.995 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.901258+0000", 2021-10-08T19:34:22.995 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.537e-06 2021-10-08T19:34:22.995 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.995 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.996 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:34:22.996 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.901316+0000", 2021-10-08T19:34:22.996 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7095999999999997e-05 2021-10-08T19:34:22.996 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.996 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.997 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:34:22.997 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.901324+0000", 2021-10-08T19:34:22.997 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7120000000000006e-06 2021-10-08T19:34:22.997 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.997 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.998 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:34:22.998 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.074960+0000", 2021-10-08T19:34:22.998 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.173635974 2021-10-08T19:34:22.998 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:22.999 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:22.999 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:34:22.999 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.075044+0000", 2021-10-08T19:34:22.999 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3827999999999998e-05 2021-10-08T19:34:22.999 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.000 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.000 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:34:23.000 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.075129+0000", 2021-10-08T19:34:23.000 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5067000000000004e-05 2021-10-08T19:34:23.000 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.001 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.001 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:34:23.001 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.082429+0000", 2021-10-08T19:34:23.001 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0072995530000000003 2021-10-08T19:34:23.002 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.002 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.002 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:23.002 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.091536+0000", 2021-10-08T19:34:23.002 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0091073170000000002 2021-10-08T19:34:23.003 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.003 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.003 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:23.003 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.091592+0000", 2021-10-08T19:34:23.003 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6023999999999998e-05 2021-10-08T19:34:23.004 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.004 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.004 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:34:23.004 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.091641+0000", 2021-10-08T19:34:23.004 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9060000000000001e-05 2021-10-08T19:34:23.005 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.005 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.005 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:34:23.005 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.091750+0000", 2021-10-08T19:34:23.005 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010856199999999999 2021-10-08T19:34:23.006 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:34:23.006 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:34:23.006 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:34:23.006 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.007 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.007 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:102476 8.b 8:d4797e70:::benchmark_data_smithi097_144160_object13736:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e246)", 2021-10-08T19:34:23.007 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:57.905825+0000", 2021-10-08T19:34:23.007 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 264.86600342600002, 2021-10-08T19:34:23.007 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1861595030000001, 2021-10-08T19:34:23.008 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:34:23.008 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:34:23.008 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:34:23.008 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:34:23.008 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:34:23.009 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 102476 2021-10-08T19:34:23.009 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.009 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:34:23.009 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.010 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:34:23.010 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.905825+0000", 2021-10-08T19:34:23.010 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:34:23.010 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.010 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.011 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:34:23.011 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.905825+0000", 2021-10-08T19:34:23.011 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:34:23.011 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.011 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.012 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:34:23.012 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.905825+0000", 2021-10-08T19:34:23.012 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2021-10-08T19:34:23.012 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.012 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.013 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:34:23.013 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.905828+0000", 2021-10-08T19:34:23.013 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2270000000000002e-06 2021-10-08T19:34:23.013 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.014 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.014 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:34:23.014 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.905833+0000", 2021-10-08T19:34:23.014 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7079999999999996e-06 2021-10-08T19:34:23.014 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.015 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.015 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:34:23.015 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.905837+0000", 2021-10-08T19:34:23.015 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0419999999999996e-06 2021-10-08T19:34:23.016 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.016 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.016 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:34:23.016 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.905899+0000", 2021-10-08T19:34:23.017 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2711000000000003e-05 2021-10-08T19:34:23.017 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.017 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.017 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:34:23.017 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.905907+0000", 2021-10-08T19:34:23.018 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.157e-06 2021-10-08T19:34:23.018 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.018 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.018 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:34:23.018 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.076593+0000", 2021-10-08T19:34:23.019 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.170685502 2021-10-08T19:34:23.019 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.019 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.019 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:34:23.020 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.076721+0000", 2021-10-08T19:34:23.020 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012835900000000001 2021-10-08T19:34:23.020 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.020 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.020 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:34:23.021 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.076856+0000", 2021-10-08T19:34:23.021 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000134812 2021-10-08T19:34:23.021 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.021 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.021 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:34:23.022 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.082433+0000", 2021-10-08T19:34:23.022 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0055767919999999997 2021-10-08T19:34:23.022 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.022 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.023 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:23.023 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.091797+0000", 2021-10-08T19:34:23.023 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0093636450000000003 2021-10-08T19:34:23.023 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.023 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.024 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:23.024 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.091831+0000", 2021-10-08T19:34:23.024 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4465999999999998e-05 2021-10-08T19:34:23.024 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.024 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.025 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:34:23.025 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.091876+0000", 2021-10-08T19:34:23.025 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4512999999999999e-05 2021-10-08T19:34:23.025 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.025 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.026 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:34:23.026 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.091985+0000", 2021-10-08T19:34:23.026 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000109276 2021-10-08T19:34:23.026 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:34:23.027 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:34:23.027 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:34:23.027 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.027 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.027 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:102477 8.b 8:de0ad642:::benchmark_data_smithi097_144160_object13737:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e246)", 2021-10-08T19:34:23.028 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:57.907234+0000", 2021-10-08T19:34:23.028 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 264.86459486299998, 2021-10-08T19:34:23.028 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.184993988, 2021-10-08T19:34:23.028 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:34:23.028 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:34:23.029 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:34:23.029 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:34:23.029 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:34:23.029 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 102477 2021-10-08T19:34:23.029 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.030 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:34:23.030 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.030 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:34:23.030 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.907234+0000", 2021-10-08T19:34:23.031 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:34:23.031 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.031 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.031 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:34:23.031 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.907234+0000", 2021-10-08T19:34:23.032 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:34:23.032 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.032 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.032 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:34:23.033 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.907233+0000", 2021-10-08T19:34:23.033 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2021-10-08T19:34:23.033 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.033 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.034 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:34:23.034 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.907238+0000", 2021-10-08T19:34:23.034 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.04e-06 2021-10-08T19:34:23.034 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.035 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.035 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:34:23.036 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.907246+0000", 2021-10-08T19:34:23.036 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.9389999999999997e-06 2021-10-08T19:34:23.037 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.037 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.037 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:34:23.037 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.907251+0000", 2021-10-08T19:34:23.037 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.899e-06 2021-10-08T19:34:23.038 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.038 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.038 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:34:23.039 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.907298+0000", 2021-10-08T19:34:23.039 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7314999999999997e-05 2021-10-08T19:34:23.039 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.039 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.040 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:34:23.040 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.907304+0000", 2021-10-08T19:34:23.041 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7060000000000001e-06 2021-10-08T19:34:23.041 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.041 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.041 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:34:23.042 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.078324+0000", 2021-10-08T19:34:23.042 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1710208529999999 2021-10-08T19:34:23.042 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.042 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.042 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:34:23.043 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.078409+0000", 2021-10-08T19:34:23.043 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4567000000000005e-05 2021-10-08T19:34:23.043 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.043 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.044 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:34:23.044 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.078487+0000", 2021-10-08T19:34:23.044 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7886999999999995e-05 2021-10-08T19:34:23.044 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.044 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.045 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:34:23.045 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.085283+0000", 2021-10-08T19:34:23.045 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0067957410000000001 2021-10-08T19:34:23.045 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.046 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.046 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:23.047 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.092027+0000", 2021-10-08T19:34:23.047 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0067447239999999997 2021-10-08T19:34:23.047 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.047 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.047 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:23.048 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.092062+0000", 2021-10-08T19:34:23.048 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4635000000000003e-05 2021-10-08T19:34:23.048 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.049 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.050 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:34:23.050 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.092118+0000", 2021-10-08T19:34:23.050 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6450000000000003e-05 2021-10-08T19:34:23.051 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.051 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.051 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:34:23.052 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.092228+0000", 2021-10-08T19:34:23.052 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000109441 2021-10-08T19:34:23.052 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:34:23.052 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:34:23.052 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:34:23.053 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.053 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.053 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:102500 8.b 8:daf9ef34:::benchmark_data_smithi097_144160_object13760:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e246)", 2021-10-08T19:34:23.053 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:57.928825+0000", 2021-10-08T19:34:23.054 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 264.84300419099998, 2021-10-08T19:34:23.054 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.163637928, 2021-10-08T19:34:23.054 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:34:23.054 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:34:23.055 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:34:23.055 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:34:23.055 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:34:23.056 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 102500 2021-10-08T19:34:23.056 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.056 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:34:23.056 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.057 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:34:23.057 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.928825+0000", 2021-10-08T19:34:23.057 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:34:23.057 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.058 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.058 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:34:23.059 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.928825+0000", 2021-10-08T19:34:23.059 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:34:23.059 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.059 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.060 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:34:23.060 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.928823+0000", 2021-10-08T19:34:23.060 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:34:23.060 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.061 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.061 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:34:23.061 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.928829+0000", 2021-10-08T19:34:23.061 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2469999999999997e-06 2021-10-08T19:34:23.062 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.062 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.063 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:34:23.063 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.928841+0000", 2021-10-08T19:34:23.063 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1908e-05 2021-10-08T19:34:23.063 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.063 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.064 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:34:23.064 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.928848+0000", 2021-10-08T19:34:23.064 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.17e-06 2021-10-08T19:34:23.064 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.065 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.065 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:34:23.065 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.928904+0000", 2021-10-08T19:34:23.065 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5634000000000003e-05 2021-10-08T19:34:23.066 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.066 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.066 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:34:23.066 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.928913+0000", 2021-10-08T19:34:23.067 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.7550000000000006e-06 2021-10-08T19:34:23.067 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.067 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.068 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:34:23.068 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.079508+0000", 2021-10-08T19:34:23.068 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1505944669999999 2021-10-08T19:34:23.069 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.069 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.070 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:34:23.070 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.079635+0000", 2021-10-08T19:34:23.071 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012720599999999999 2021-10-08T19:34:23.071 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.071 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.072 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:34:23.072 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.079789+0000", 2021-10-08T19:34:23.073 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000154136 2021-10-08T19:34:23.073 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.073 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.074 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:34:23.074 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.085287+0000", 2021-10-08T19:34:23.075 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0054975060000000001 2021-10-08T19:34:23.075 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.076 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.076 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:23.076 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.092269+0000", 2021-10-08T19:34:23.077 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0069826239999999998 2021-10-08T19:34:23.077 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.078 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.078 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:23.079 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.092304+0000", 2021-10-08T19:34:23.079 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4981999999999998e-05 2021-10-08T19:34:23.079 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.080 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.080 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:34:23.081 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.092351+0000", 2021-10-08T19:34:23.081 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7095000000000002e-05 2021-10-08T19:34:23.082 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.082 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.083 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:34:23.083 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.092463+0000", 2021-10-08T19:34:23.083 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011102799999999999 2021-10-08T19:34:23.084 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:34:23.084 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:34:23.085 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:34:23.085 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.086 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.086 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:102519 8.b 8:d179cc81:::benchmark_data_smithi097_144160_object13779:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e246)", 2021-10-08T19:34:23.087 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:57.947553+0000", 2021-10-08T19:34:23.087 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 264.82427583499998, 2021-10-08T19:34:23.087 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1451397700000001, 2021-10-08T19:34:23.088 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:34:23.088 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:34:23.089 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:34:23.089 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:34:23.090 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:34:23.090 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 102519 2021-10-08T19:34:23.091 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.091 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:34:23.091 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.092 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:34:23.092 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.947553+0000", 2021-10-08T19:34:23.092 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:34:23.093 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.093 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.093 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:34:23.094 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.947553+0000", 2021-10-08T19:34:23.094 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:34:23.094 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.095 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.095 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:34:23.095 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.947550+0000", 2021-10-08T19:34:23.095 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2021-10-08T19:34:23.096 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.096 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.096 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:34:23.097 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.947560+0000", 2021-10-08T19:34:23.097 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.662e-06 2021-10-08T19:34:23.098 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.098 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.099 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:34:23.099 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.947576+0000", 2021-10-08T19:34:23.099 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6583999999999999e-05 2021-10-08T19:34:23.100 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.100 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.101 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:34:23.101 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.947583+0000", 2021-10-08T19:34:23.102 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9469999999999997e-06 2021-10-08T19:34:23.104 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.104 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.104 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:34:23.105 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.947647+0000", 2021-10-08T19:34:23.105 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3819999999999995e-05 2021-10-08T19:34:23.106 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.106 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.107 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:34:23.107 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.947657+0000", 2021-10-08T19:34:23.108 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.9520000000000006e-06 2021-10-08T19:34:23.108 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.108 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.109 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:34:23.109 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.081284+0000", 2021-10-08T19:34:23.109 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1336265889999999 2021-10-08T19:34:23.110 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.110 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.110 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:34:23.111 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.081360+0000", 2021-10-08T19:34:23.111 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6329999999999996e-05 2021-10-08T19:34:23.111 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.112 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.112 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:34:23.112 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.081446+0000", 2021-10-08T19:34:23.113 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5445999999999995e-05 2021-10-08T19:34:23.113 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.114 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.114 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:34:23.114 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.089270+0000", 2021-10-08T19:34:23.114 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0078239350000000006 2021-10-08T19:34:23.115 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.115 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.115 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:23.116 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.092502+0000", 2021-10-08T19:34:23.116 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032323769999999998 2021-10-08T19:34:23.117 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.117 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.117 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:23.118 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.092538+0000", 2021-10-08T19:34:23.118 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6174000000000003e-05 2021-10-08T19:34:23.118 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.119 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.119 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:34:23.120 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.092584+0000", 2021-10-08T19:34:23.120 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5661999999999998e-05 2021-10-08T19:34:23.121 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.121 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.121 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:34:23.122 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.092693+0000", 2021-10-08T19:34:23.122 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010898799999999999 2021-10-08T19:34:23.123 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:34:23.123 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:34:23.123 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:34:23.124 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.124 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.124 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:102556 8.b 8:db9c81ba:::benchmark_data_smithi097_144160_object13816:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e246)", 2021-10-08T19:34:23.125 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:57.990196+0000", 2021-10-08T19:34:23.125 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 264.781632371, 2021-10-08T19:34:23.126 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1027266650000001, 2021-10-08T19:34:23.126 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:34:23.126 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:34:23.127 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:34:23.127 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:34:23.127 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:34:23.127 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 102556 2021-10-08T19:34:23.128 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.128 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:34:23.128 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.128 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:34:23.128 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.990196+0000", 2021-10-08T19:34:23.129 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:34:23.129 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.129 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.129 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:34:23.129 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.990196+0000", 2021-10-08T19:34:23.130 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:34:23.130 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.130 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.130 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:34:23.131 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.990195+0000", 2021-10-08T19:34:23.131 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:34:23.131 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.131 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.131 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:34:23.132 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.990201+0000", 2021-10-08T19:34:23.132 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8939999999999998e-06 2021-10-08T19:34:23.132 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.132 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.133 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:34:23.133 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.990212+0000", 2021-10-08T19:34:23.133 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1318000000000001e-05 2021-10-08T19:34:23.133 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.133 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.134 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:34:23.134 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.990217+0000", 2021-10-08T19:34:23.134 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9590000000000003e-06 2021-10-08T19:34:23.134 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.134 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.135 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:34:23.135 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.990271+0000", 2021-10-08T19:34:23.135 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4546999999999998e-05 2021-10-08T19:34:23.135 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.136 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.136 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:34:23.136 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.990282+0000", 2021-10-08T19:34:23.136 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0720000000000001e-05 2021-10-08T19:34:23.136 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.137 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.137 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:34:23.137 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.082457+0000", 2021-10-08T19:34:23.137 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0921749110000001 2021-10-08T19:34:23.137 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.138 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.138 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:34:23.138 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.082574+0000", 2021-10-08T19:34:23.138 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000116808 2021-10-08T19:34:23.139 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.139 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.139 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:34:23.139 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.082708+0000", 2021-10-08T19:34:23.139 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000134614 2021-10-08T19:34:23.140 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.140 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.140 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:34:23.140 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.089281+0000", 2021-10-08T19:34:23.140 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0065724579999999998 2021-10-08T19:34:23.141 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.141 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.141 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:23.141 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.092733+0000", 2021-10-08T19:34:23.142 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0034523129999999998 2021-10-08T19:34:23.142 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.142 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.142 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:23.142 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.092771+0000", 2021-10-08T19:34:23.143 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7381e-05 2021-10-08T19:34:23.143 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.143 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.143 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:34:23.143 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.092816+0000", 2021-10-08T19:34:23.144 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5867e-05 2021-10-08T19:34:23.144 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.144 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.144 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:34:23.145 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.092923+0000", 2021-10-08T19:34:23.145 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0001066 2021-10-08T19:34:23.145 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:34:23.145 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:34:23.145 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:34:23.146 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.146 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.146 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:102559 8.b 8:d2754e32:::benchmark_data_smithi097_144160_object13819:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e246)", 2021-10-08T19:34:23.146 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:57.992106+0000", 2021-10-08T19:34:23.147 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 264.779722865, 2021-10-08T19:34:23.147 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1010586449999999, 2021-10-08T19:34:23.147 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:34:23.147 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:34:23.148 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:34:23.148 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:34:23.148 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:34:23.148 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 102559 2021-10-08T19:34:23.149 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.149 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:34:23.149 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.149 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:34:23.149 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.992106+0000", 2021-10-08T19:34:23.150 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:34:23.150 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.150 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.150 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:34:23.151 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.992106+0000", 2021-10-08T19:34:23.151 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:34:23.151 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.151 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.151 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:34:23.152 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.992104+0000", 2021-10-08T19:34:23.152 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2021-10-08T19:34:23.152 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.152 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.153 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:34:23.153 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.992111+0000", 2021-10-08T19:34:23.153 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.528e-06 2021-10-08T19:34:23.153 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.153 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.154 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:34:23.154 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.992123+0000", 2021-10-08T19:34:23.154 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2384e-05 2021-10-08T19:34:23.154 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.154 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.155 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:34:23.155 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.992130+0000", 2021-10-08T19:34:23.155 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3280000000000002e-06 2021-10-08T19:34:23.155 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.156 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.156 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:34:23.156 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.992182+0000", 2021-10-08T19:34:23.156 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2157000000000002e-05 2021-10-08T19:34:23.156 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.157 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.157 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:34:23.157 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.992191+0000", 2021-10-08T19:34:23.157 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.6209999999999999e-06 2021-10-08T19:34:23.157 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.158 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.158 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:34:23.158 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.084213+0000", 2021-10-08T19:34:23.159 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.092022096 2021-10-08T19:34:23.159 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.159 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.166 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:34:23.166 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.084284+0000", 2021-10-08T19:34:23.166 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1037000000000004e-05 2021-10-08T19:34:23.166 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.167 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.167 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:34:23.167 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.084357+0000", 2021-10-08T19:34:23.167 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2349999999999997e-05 2021-10-08T19:34:23.167 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.168 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.168 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:34:23.168 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.089408+0000", 2021-10-08T19:34:23.168 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0050516809999999997 2021-10-08T19:34:23.168 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.169 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.169 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:23.169 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.092964+0000", 2021-10-08T19:34:23.169 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0035552100000000001 2021-10-08T19:34:23.170 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.170 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.170 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:23.173 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.092999+0000", 2021-10-08T19:34:23.173 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5065999999999999e-05 2021-10-08T19:34:23.173 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.173 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.174 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:34:23.174 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.093046+0000", 2021-10-08T19:34:23.174 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7052999999999998e-05 2021-10-08T19:34:23.174 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.175 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.175 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:34:23.175 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.093165+0000", 2021-10-08T19:34:23.175 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011874 2021-10-08T19:34:23.175 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:34:23.176 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:34:23.176 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:34:23.176 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.176 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.177 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:102574 8.b 8:db3e2131:::benchmark_data_smithi097_144160_object13834:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e246)", 2021-10-08T19:34:23.177 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:58.017553+0000", 2021-10-08T19:34:23.177 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 264.75427617499997, 2021-10-08T19:34:23.177 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0758380169999999, 2021-10-08T19:34:23.177 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:34:23.178 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:34:23.178 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:34:23.178 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:34:23.178 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:34:23.179 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 102574 2021-10-08T19:34:23.179 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.179 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:34:23.179 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.180 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:34:23.180 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:58.017553+0000", 2021-10-08T19:34:23.180 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:34:23.180 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.181 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.181 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:34:23.181 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:58.017553+0000", 2021-10-08T19:34:23.181 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:34:23.181 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.182 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.182 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:34:23.182 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:58.017551+0000", 2021-10-08T19:34:23.182 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:34:23.183 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.183 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.183 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:34:23.183 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:58.017557+0000", 2021-10-08T19:34:23.183 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7839999999999998e-06 2021-10-08T19:34:23.184 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.184 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.184 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:34:23.184 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:58.017569+0000", 2021-10-08T19:34:23.185 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1382999999999999e-05 2021-10-08T19:34:23.185 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.185 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.186 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:34:23.186 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:58.017574+0000", 2021-10-08T19:34:23.186 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2889999999999997e-06 2021-10-08T19:34:23.186 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.186 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.187 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:34:23.187 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:58.017618+0000", 2021-10-08T19:34:23.187 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3401e-05 2021-10-08T19:34:23.187 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.187 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.188 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:34:23.188 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:58.017624+0000", 2021-10-08T19:34:23.188 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1310000000000003e-06 2021-10-08T19:34:23.188 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.189 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.189 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:34:23.189 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.085313+0000", 2021-10-08T19:34:23.189 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0676896259999999 2021-10-08T19:34:23.189 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.190 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.190 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:34:23.190 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.085443+0000", 2021-10-08T19:34:23.190 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013005300000000001 2021-10-08T19:34:23.191 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.191 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.191 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:34:23.191 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.085587+0000", 2021-10-08T19:34:23.191 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014407499999999999 2021-10-08T19:34:23.192 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.192 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.192 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:34:23.192 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.089418+0000", 2021-10-08T19:34:23.192 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038308050000000001 2021-10-08T19:34:23.193 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.193 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.193 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:23.193 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.093205+0000", 2021-10-08T19:34:23.194 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0037872510000000002 2021-10-08T19:34:23.194 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.194 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.194 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:23.194 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.093240+0000", 2021-10-08T19:34:23.195 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5015000000000003e-05 2021-10-08T19:34:23.195 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.195 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.195 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:34:23.195 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.093286+0000", 2021-10-08T19:34:23.196 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5104e-05 2021-10-08T19:34:23.196 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.196 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.196 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:34:23.197 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.093391+0000", 2021-10-08T19:34:23.197 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000105028 2021-10-08T19:34:23.197 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:34:23.197 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:34:23.197 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:34:23.198 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.198 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.198 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:102602 8.b 8:dacd0c67:::benchmark_data_smithi097_144160_object13862:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e246)", 2021-10-08T19:34:23.198 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:58.097142+0000", 2021-10-08T19:34:23.198 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 264.67468712499999, 2021-10-08T19:34:23.199 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.99654567599999999, 2021-10-08T19:34:23.199 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:34:23.199 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:34:23.199 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:34:23.200 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:34:23.200 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:34:23.200 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 102602 2021-10-08T19:34:23.201 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.202 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:34:23.202 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.202 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:34:23.202 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:58.097142+0000", 2021-10-08T19:34:23.203 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:34:23.203 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.203 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.203 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:34:23.204 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:58.097142+0000", 2021-10-08T19:34:23.204 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:34:23.204 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.204 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.205 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:34:23.205 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:58.097140+0000", 2021-10-08T19:34:23.205 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:34:23.205 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.206 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.206 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:34:23.206 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:58.097146+0000", 2021-10-08T19:34:23.207 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6150000000000002e-06 2021-10-08T19:34:23.207 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.207 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.207 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:34:23.207 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:58.097157+0000", 2021-10-08T19:34:23.208 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0821e-05 2021-10-08T19:34:23.208 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.208 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.209 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:34:23.209 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:58.097162+0000", 2021-10-08T19:34:23.209 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3900000000000001e-06 2021-10-08T19:34:23.209 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.210 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.210 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:34:23.210 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:58.097205+0000", 2021-10-08T19:34:23.210 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2239e-05 2021-10-08T19:34:23.211 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.211 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.211 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:34:23.211 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:58.097211+0000", 2021-10-08T19:34:23.212 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9499999999999998e-06 2021-10-08T19:34:23.212 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.212 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.212 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:34:23.213 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.087044+0000", 2021-10-08T19:34:23.213 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.98983380499999996 2021-10-08T19:34:23.213 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.213 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.213 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:34:23.214 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.087126+0000", 2021-10-08T19:34:23.214 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1479999999999999e-05 2021-10-08T19:34:23.214 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.214 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.215 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:34:23.215 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.087300+0000", 2021-10-08T19:34:23.215 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000174303 2021-10-08T19:34:23.215 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.215 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.216 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:34:23.216 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.089956+0000", 2021-10-08T19:34:23.216 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002655831 2021-10-08T19:34:23.216 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.217 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.217 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:23.217 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.093431+0000", 2021-10-08T19:34:23.217 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0034749030000000001 2021-10-08T19:34:23.217 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.218 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.218 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:23.218 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.093536+0000", 2021-10-08T19:34:23.218 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010552099999999999 2021-10-08T19:34:23.219 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.219 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.219 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:34:23.220 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.093585+0000", 2021-10-08T19:34:23.220 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8813000000000002e-05 2021-10-08T19:34:23.221 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.221 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.221 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:34:23.222 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.093687+0000", 2021-10-08T19:34:23.222 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000102042 2021-10-08T19:34:23.222 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:34:23.222 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:34:23.223 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:34:23.223 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.223 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.224 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:137845 8.b 8:d9013f90:::benchmark_data_smithi097_144160_object49105:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e256)", 2021-10-08T19:34:23.224 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:30:31.700795+0000", 2021-10-08T19:34:23.224 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 231.071033285, 2021-10-08T19:34:23.225 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.199398951, 2021-10-08T19:34:23.225 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:34:23.225 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:34:23.225 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:34:23.226 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:34:23.226 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:34:23.226 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 137845 2021-10-08T19:34:23.226 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.226 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:34:23.227 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.227 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:34:23.227 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.700795+0000", 2021-10-08T19:34:23.228 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:34:23.228 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.228 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.228 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:34:23.229 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.700795+0000", 2021-10-08T19:34:23.229 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:34:23.230 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.230 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.230 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:34:23.230 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.700795+0000", 2021-10-08T19:34:23.231 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:34:23.231 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.231 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.231 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:34:23.231 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.700798+0000", 2021-10-08T19:34:23.233 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8550000000000002e-06 2021-10-08T19:34:23.233 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.233 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.234 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:34:23.234 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.700802+0000", 2021-10-08T19:34:23.234 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6029999999999998e-06 2021-10-08T19:34:23.234 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.235 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.235 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:34:23.235 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.700806+0000", 2021-10-08T19:34:23.235 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.473e-06 2021-10-08T19:34:23.235 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.236 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.236 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:34:23.236 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.700840+0000", 2021-10-08T19:34:23.236 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3855e-05 2021-10-08T19:34:23.237 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.237 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.237 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:34:23.237 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.700847+0000", 2021-10-08T19:34:23.238 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7190000000000001e-06 2021-10-08T19:34:23.238 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.238 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.238 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:34:23.239 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:32.679303+0000", 2021-10-08T19:34:23.239 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.97845542299999999 2021-10-08T19:34:23.239 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.239 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.239 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:34:23.240 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:32.679313+0000", 2021-10-08T19:34:23.240 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0040999999999999e-05 2021-10-08T19:34:23.240 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.240 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.241 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:34:23.241 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.850376+0000", 2021-10-08T19:34:23.241 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1710636700000001 2021-10-08T19:34:23.241 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.241 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.242 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:34:23.242 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.850541+0000", 2021-10-08T19:34:23.242 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016506600000000001 2021-10-08T19:34:23.242 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.243 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.243 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,2,4", 2021-10-08T19:34:23.243 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.850978+0000", 2021-10-08T19:34:23.243 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00043636400000000001 2021-10-08T19:34:23.243 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.244 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.244 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:23.244 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.858001+0000", 2021-10-08T19:34:23.244 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0070231 2021-10-08T19:34:23.245 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.245 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.245 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:23.245 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.858148+0000", 2021-10-08T19:34:23.245 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014706499999999999 2021-10-08T19:34:23.246 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.246 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.246 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:34:23.246 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.862354+0000", 2021-10-08T19:34:23.247 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.004206319 2021-10-08T19:34:23.247 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.247 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.247 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:23.247 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.897983+0000", 2021-10-08T19:34:23.248 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.035628430000000003 2021-10-08T19:34:23.248 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.248 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.248 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:34:23.248 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.898043+0000", 2021-10-08T19:34:23.249 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0485000000000001e-05 2021-10-08T19:34:23.249 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.249 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.249 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:34:23.250 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.900194+0000", 2021-10-08T19:34:23.250 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021512329999999998 2021-10-08T19:34:23.250 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:34:23.250 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:34:23.250 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:34:23.251 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.251 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.251 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:137877 8.b 8:d0f459fb:::benchmark_data_smithi097_144160_object49137:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e256)", 2021-10-08T19:34:23.251 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:30:31.731950+0000", 2021-10-08T19:34:23.252 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 231.039878555, 2021-10-08T19:34:23.252 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1684614529999999, 2021-10-08T19:34:23.252 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:34:23.252 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:34:23.252 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:34:23.253 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:34:23.253 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:34:23.253 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 137877 2021-10-08T19:34:23.253 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.253 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:34:23.254 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.254 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:34:23.254 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.731950+0000", 2021-10-08T19:34:23.254 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:34:23.255 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.255 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.255 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:34:23.255 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.731950+0000", 2021-10-08T19:34:23.255 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:34:23.256 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.256 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.256 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:34:23.256 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.731948+0000", 2021-10-08T19:34:23.256 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:34:23.257 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.257 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.257 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:34:23.257 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.731954+0000", 2021-10-08T19:34:23.258 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.037e-06 2021-10-08T19:34:23.258 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.258 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.258 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:34:23.258 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.731963+0000", 2021-10-08T19:34:23.259 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.602e-06 2021-10-08T19:34:23.259 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.259 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.259 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:34:23.259 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.731968+0000", 2021-10-08T19:34:23.260 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6890000000000003e-06 2021-10-08T19:34:23.260 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.260 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.260 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:34:23.261 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.732005+0000", 2021-10-08T19:34:23.261 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7527999999999997e-05 2021-10-08T19:34:23.261 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.261 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.261 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:34:23.262 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.732011+0000", 2021-10-08T19:34:23.262 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9449999999999998e-06 2021-10-08T19:34:23.262 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.263 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.263 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:34:23.263 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:32.680646+0000", 2021-10-08T19:34:23.263 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.94863507499999999 2021-10-08T19:34:23.264 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.264 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.264 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:34:23.264 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:32.680654+0000", 2021-10-08T19:34:23.264 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8120000000000008e-06 2021-10-08T19:34:23.265 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.265 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.265 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:34:23.265 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.855389+0000", 2021-10-08T19:34:23.266 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1747352 2021-10-08T19:34:23.266 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.266 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.266 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:34:23.266 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.855513+0000", 2021-10-08T19:34:23.267 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012417799999999999 2021-10-08T19:34:23.267 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.267 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.267 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,2,4", 2021-10-08T19:34:23.267 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.855651+0000", 2021-10-08T19:34:23.268 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000137317 2021-10-08T19:34:23.268 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.268 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.268 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:23.269 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.860016+0000", 2021-10-08T19:34:23.269 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0043655860000000003 2021-10-08T19:34:23.269 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.269 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.269 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:34:23.270 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.862362+0000", 2021-10-08T19:34:23.270 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0023462370000000001 2021-10-08T19:34:23.270 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.270 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.271 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:23.271 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.876380+0000", 2021-10-08T19:34:23.271 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.014017514 2021-10-08T19:34:23.271 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.271 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.272 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:23.272 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.900242+0000", 2021-10-08T19:34:23.272 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.023861835000000001 2021-10-08T19:34:23.272 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.273 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.273 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:34:23.273 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.900298+0000", 2021-10-08T19:34:23.273 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6548999999999997e-05 2021-10-08T19:34:23.273 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:34:23.274 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:34:23.274 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:34:23.274 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.900412+0000", 2021-10-08T19:34:23.274 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000113278 2021-10-08T19:34:23.274 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:34:23.275 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:34:23.275 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:34:23.275 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:34:23.275 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:34:23.276 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:34:23.277 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:22 smithi117 ceph-mon[34585]: 6.4 deep-scrub ok 2021-10-08T19:34:23.277 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:22 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3239757146' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:34:23.277 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:22 smithi097 ceph-mon[32687]: 6.4 deep-scrub ok 2021-10-08T19:34:23.277 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:22 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3239757146' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:34:23.278 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:22 smithi097 ceph-mon[41966]: 6.4 deep-scrub ok 2021-10-08T19:34:23.278 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:22 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3239757146' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:34:23.515 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2021-10-08T19:34:23.602 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:34:23.606 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:23.606 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:34:23.707 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:34:23.733 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:23.869 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:23 smithi117 ceph-mon[34585]: 2.1a scrub ok 2021-10-08T19:34:23.869 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:23 smithi117 ceph-mon[34585]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:34:23.869 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:23 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3239757146' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:34:23.869 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:23 smithi117 ceph-mon[34585]: osdmap e339: 8 total, 8 up, 8 in 2021-10-08T19:34:23.870 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:23 smithi117 ceph-mon[34585]: pgmap v649: 178 pgs: 178 active+clean; 2.6 GiB data, 9.8 GiB used, 705 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 689 op/s 2021-10-08T19:34:23.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:23 smithi097 ceph-mon[41966]: 2.1a scrub ok 2021-10-08T19:34:23.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:23 smithi097 ceph-mon[41966]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:34:23.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:23 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3239757146' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:34:23.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:23 smithi097 ceph-mon[41966]: osdmap e339: 8 total, 8 up, 8 in 2021-10-08T19:34:23.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:23 smithi097 ceph-mon[41966]: pgmap v649: 178 pgs: 178 active+clean; 2.6 GiB data, 9.8 GiB used, 705 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 689 op/s 2021-10-08T19:34:23.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:23 smithi097 ceph-mon[32687]: 2.1a scrub ok 2021-10-08T19:34:23.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:23 smithi097 ceph-mon[32687]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:34:23.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:23 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3239757146' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:34:23.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:23 smithi097 ceph-mon[32687]: osdmap e339: 8 total, 8 up, 8 in 2021-10-08T19:34:23.974 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:23 smithi097 ceph-mon[32687]: pgmap v649: 178 pgs: 178 active+clean; 2.6 GiB data, 9.8 GiB used, 705 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 689 op/s 2021-10-08T19:34:24.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:34:23 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:34:23] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:34:24.623 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2021-10-08T19:34:24.730 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:34:24.734 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:24.735 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:34:24.836 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:34:24.879 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:24 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:34:24.880 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:24 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:34:24.882 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:24 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:34:24.882 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:24 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:34:24.889 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:34:24.894 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:25.035 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:34:25.039 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:25.040 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:34:25.141 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:34:25.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:24 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:34:25.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:24 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:34:25.185 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:25.303 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:34:25.306 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:25.307 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:34:25.408 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:34:25.474 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:25.597 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:34:25.600 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:25.601 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:34:25.702 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:34:25.739 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:25.828 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.3 to 1 (10000) 2021-10-08T19:34:26.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:25 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:34:26.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:25 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:34:26.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:25 smithi117 ceph-mon[34585]: osdmap e340: 8 total, 8 up, 8 in 2021-10-08T19:34:26.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:25 smithi117 ceph-mon[34585]: pgmap v651: 178 pgs: 178 active+clean; 2.3 GiB data, 8.7 GiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.42k op/s 2021-10-08T19:34:26.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:25 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/646718419' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2021-10-08T19:34:26.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:25 smithi117 ceph-mon[34585]: from='client.25678 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2021-10-08T19:34:26.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:25 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:34:26.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:25 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:34:26.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:25 smithi097 ceph-mon[32687]: osdmap e340: 8 total, 8 up, 8 in 2021-10-08T19:34:26.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:25 smithi097 ceph-mon[32687]: pgmap v651: 178 pgs: 178 active+clean; 2.3 GiB data, 8.7 GiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.42k op/s 2021-10-08T19:34:26.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:25 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/646718419' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2021-10-08T19:34:26.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:25 smithi097 ceph-mon[32687]: from='client.25678 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2021-10-08T19:34:26.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:25 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:34:26.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:25 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:34:26.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:25 smithi097 ceph-mon[41966]: osdmap e340: 8 total, 8 up, 8 in 2021-10-08T19:34:26.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:25 smithi097 ceph-mon[41966]: pgmap v651: 178 pgs: 178 active+clean; 2.3 GiB data, 8.7 GiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.42k op/s 2021-10-08T19:34:26.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:25 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/646718419' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2021-10-08T19:34:26.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:25 smithi097 ceph-mon[41966]: from='client.25678 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2021-10-08T19:34:26.891 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set nodeep-scrub 2021-10-08T19:34:26.995 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:34:26.997 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:26.998 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:34:27.102 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:34:27.142 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:26 smithi117 ceph-mon[34585]: from='client.25678 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2021-10-08T19:34:27.142 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:26 smithi117 ceph-mon[34585]: osdmap e341: 8 total, 8 up, 8 in 2021-10-08T19:34:27.143 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:34:26 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:34:27.145 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:34:27.153 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:27.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:26 smithi097 ceph-mon[41966]: from='client.25678 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2021-10-08T19:34:27.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:26 smithi097 ceph-mon[41966]: osdmap e341: 8 total, 8 up, 8 in 2021-10-08T19:34:27.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:26 smithi097 ceph-mon[32687]: from='client.25678 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2021-10-08T19:34:27.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:26 smithi097 ceph-mon[32687]: osdmap e341: 8 total, 8 up, 8 in 2021-10-08T19:34:27.285 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:34:27.291 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:27.291 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:34:27.393 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:34:27.449 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:27.456 INFO:tasks.cephadm.ceph_manager.ceph:waiting for recovery to complete 2021-10-08T19:34:27.456 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph pg dump --format=json 2021-10-08T19:34:27.519 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:34:27.557 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:34:27.561 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:27.562 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:34:27.663 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:34:27.719 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:27.825 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:34:27.837 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:27.838 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:34:27.939 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:34:27.973 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:28.131 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:34:28.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:27 smithi117 ceph-mon[34585]: pgmap v653: 178 pgs: 178 active+clean; 2.3 GiB data, 8.7 GiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 977 op/s 2021-10-08T19:34:28.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:27 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:34:28.161 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:34:28.192 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:34:28.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:27 smithi097 ceph-mon[41966]: pgmap v653: 178 pgs: 178 active+clean; 2.3 GiB data, 8.7 GiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 977 op/s 2021-10-08T19:34:28.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:27 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:34:28.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:27 smithi097 ceph-mon[32687]: pgmap v653: 178 pgs: 178 active+clean; 2.3 GiB data, 8.7 GiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 977 op/s 2021-10-08T19:34:28.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:27 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:34:28.232 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:34:28.265 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:34:28.266 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:34:28.269 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:28.270 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:34:28.305 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:34:28.343 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:34:28.371 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:34:28.391 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:34:28.395 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'false' 2021-10-08T19:34:28.395 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'false' 2021-10-08T19:34:28.396 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'false' 2021-10-08T19:34:28.396 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'false' 2021-10-08T19:34:28.396 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'false' 2021-10-08T19:34:28.396 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'false' 2021-10-08T19:34:28.397 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'false' 2021-10-08T19:34:28.397 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'false' 2021-10-08T19:34:28.420 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:28.459 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:34:29.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:28 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2887102789' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:34:29.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:28 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2887102789' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:34:29.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:28 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2887102789' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:34:29.508 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:34:29.519 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:29.520 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:34:29.621 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:34:29.645 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:29.829 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:29 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:34:29.829 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:29 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:34:29.829 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:29 smithi097 ceph-mon[32687]: pgmap v654: 178 pgs: 178 active+clean; 2.1 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 1.37k op/s 2021-10-08T19:34:29.829 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:29 smithi097 ceph-mon[32687]: osdmap e342: 8 total, 8 up, 8 in 2021-10-08T19:34:30.026 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:30.027 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:34:30.027 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:34:30.115 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:29 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:34:30.116 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:29 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:34:30.116 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:29 smithi117 ceph-mon[34585]: pgmap v654: 178 pgs: 178 active+clean; 2.1 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 1.37k op/s 2021-10-08T19:34:30.116 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:29 smithi117 ceph-mon[34585]: osdmap e342: 8 total, 8 up, 8 in 2021-10-08T19:34:30.128 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:34:30.133 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:29 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:34:30.133 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:29 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:34:30.133 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:29 smithi097 ceph-mon[41966]: pgmap v654: 178 pgs: 178 active+clean; 2.1 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 1.37k op/s 2021-10-08T19:34:30.134 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:29 smithi097 ceph-mon[41966]: osdmap e342: 8 total, 8 up, 8 in 2021-10-08T19:34:30.183 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:30.277 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:34:30.298 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:30.299 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:34:30.401 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:34:30.459 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2021-10-08T19:34:30.460 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:34:30.460 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:30.694 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:34:30.697 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:30.697 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:34:30.798 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:34:30.844 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:30.935 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:34:30.937 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:30.937 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:34:31.039 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:34:31.077 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:31.326 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:34:31.330 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:31.330 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:34:31.432 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:34:31.436 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2021-10-08T19:34:31.471 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:31.575 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:34:31.579 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:31.580 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:34:31.681 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:34:31.741 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:31.769 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is set 2021-10-08T19:34:31.832 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:34:31.835 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:31.836 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:34:31.937 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:34:31.974 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:32.108 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:34:32.117 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:31 smithi117 ceph-mon[34585]: pgmap v656: 178 pgs: 178 active+clean; 2.0 GiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 902 op/s 2021-10-08T19:34:32.118 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:31 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1890611512' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:34:32.118 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:32.119 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:34:32.136 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2021-10-08T19:34:32.151 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:34:32.175 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:31 smithi097 ceph-mon[41966]: pgmap v656: 178 pgs: 178 active+clean; 2.0 GiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 902 op/s 2021-10-08T19:34:32.176 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:31 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1890611512' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:34:32.176 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:31 smithi097 ceph-mon[32687]: pgmap v656: 178 pgs: 178 active+clean; 2.0 GiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 902 op/s 2021-10-08T19:34:32.177 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:31 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1890611512' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:34:32.220 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:34:32.279 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:32.406 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:34:32 smithi117 conmon[69189]: level=error ts=2021-10-08T19:34:32.314Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=2 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:34:32.712 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:34:32.717 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2021-10-08T19:34:32.863 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:34:32.867 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:32.868 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:34:32.969 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:34:32.970 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:34:32 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:34:32] "GET /metrics HTTP/1.1" 200 155814 "" "Prometheus/2.18.1" 2021-10-08T19:34:32.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:32 smithi097 ceph-mon[41966]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:34:32.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:32 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1890611512' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:34:32.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:32 smithi097 ceph-mon[41966]: osdmap e343: 8 total, 8 up, 8 in 2021-10-08T19:34:32.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:32 smithi097 ceph-mon[32687]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:34:32.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:32 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1890611512' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:34:32.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:32 smithi097 ceph-mon[32687]: osdmap e343: 8 total, 8 up, 8 in 2021-10-08T19:34:33.023 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:33.107 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:34:33.110 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:33.111 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:34:33.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:32 smithi117 ceph-mon[34585]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:34:33.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:32 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1890611512' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:34:33.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:32 smithi117 ceph-mon[34585]: osdmap e343: 8 total, 8 up, 8 in 2021-10-08T19:34:33.212 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:34:33.257 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:33.540 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":657,"stamp":"2021-10-08T19:34:31.746963+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2096818274,"num_objects":32183,"num_object_clones":0,"num_object_copies":96549,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32183,"num_whiteouts":0,"num_read":1766,"num_read_kb":1532,"num_write":200114,"num_write_kb":7404292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1624,"num_bytes_recovered":72001559,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71398,"ondisk_log_size":71398,"up":534,"acting":534,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":534,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":8077416,"kb_used_data":6263144,"kb_used_omap":0,"kb_used_meta":1814016,"kb_avail":741883800,"statfs":{"total":767960285184,"available":759689011200,"internally_reserved":0,"allocated":6413459456,"data_stored":6410226338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1857552384},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,2,6,1,1,2,4,0,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-354877440,"num_objects":-5415,"num_object_clones":0,"num_object_copies":-16245,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-5415,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5415,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.969198"},"pg_stats":[{"pgid":"9.5","version":"342'12335","reported_seq":12401,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:29.075295+0000","last_change":"2021-10-08T19:33:36.880651+0000","last_active":"2021-10-08T19:34:29.075295+0000","last_peered":"2021-10-08T19:34:29.075295+0000","last_clean":"2021-10-08T19:34:29.075295+0000","last_became_active":"2021-10-08T19:31:33.860267+0000","last_became_peered":"2021-10-08T19:31:33.860267+0000","last_unstale":"2021-10-08T19:34:29.075295+0000","last_undegraded":"2021-10-08T19:34:29.075295+0000","last_fullsized":"2021-10-08T19:34:29.075295+0000","mapping_epoch":290,"log_start":"324'7400","ondisk_log_start":"324'7400","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"329'8650","last_scrub_stamp":"2021-10-08T19:33:36.880554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:33:36.880554+0000","log_size":4935,"ondisk_log_size":4935,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":1.859313738,"stat_sum":{"num_bytes":130744320,"num_objects":1995,"num_object_clones":0,"num_object_copies":5985,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1995,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12335,"num_write_kb":458560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"114'10","reported_seq":501,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.794018+0000","last_change":"2021-10-08T19:34:14.586366+0000","last_active":"2021-10-08T19:34:25.794018+0000","last_peered":"2021-10-08T19:34:25.794018+0000","last_clean":"2021-10-08T19:34:25.794018+0000","last_became_active":"2021-10-08T19:24:25.096162+0000","last_became_peered":"2021-10-08T19:24:25.096162+0000","last_unstale":"2021-10-08T19:34:25.794018+0000","last_undegraded":"2021-10-08T19:34:25.794018+0000","last_fullsized":"2021-10-08T19:34:25.794018+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'10","last_scrub_stamp":"2021-10-08T19:34:14.586030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:34:14.586030+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034352250000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"289'34","reported_seq":107,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.778204+0000","last_change":"2021-10-08T19:33:23.562208+0000","last_active":"2021-10-08T19:34:24.778204+0000","last_peered":"2021-10-08T19:34:24.778204+0000","last_clean":"2021-10-08T19:34:24.778204+0000","last_became_active":"2021-10-08T19:31:22.787271+0000","last_became_peered":"2021-10-08T19:31:22.787271+0000","last_unstale":"2021-10-08T19:34:24.778204+0000","last_undegraded":"2021-10-08T19:34:24.778204+0000","last_fullsized":"2021-10-08T19:34:24.778204+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'34","last_scrub_stamp":"2021-10-08T19:33:23.562083+0000","last_deep_scrub":"87'22","last_deep_scrub_stamp":"2021-10-08T19:22:58.705632+0000","last_clean_scrub_stamp":"2021-10-08T19:33:23.562083+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011294012000000001,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":335,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.776418+0000","last_change":"2021-10-08T19:32:41.520904+0000","last_active":"2021-10-08T19:34:24.776418+0000","last_peered":"2021-10-08T19:34:24.776418+0000","last_clean":"2021-10-08T19:34:24.776418+0000","last_became_active":"2021-10-08T19:29:40.632678+0000","last_became_peered":"2021-10-08T19:29:40.632678+0000","last_unstale":"2021-10-08T19:34:24.776418+0000","last_undegraded":"2021-10-08T19:34:24.776418+0000","last_fullsized":"2021-10-08T19:34:24.776418+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:41.520808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:41.520808+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0086535729999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":318,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.778410+0000","last_change":"2021-10-08T19:32:40.772624+0000","last_active":"2021-10-08T19:34:24.778410+0000","last_peered":"2021-10-08T19:34:24.778410+0000","last_clean":"2021-10-08T19:34:24.778410+0000","last_became_active":"2021-10-08T19:24:25.089002+0000","last_became_peered":"2021-10-08T19:24:25.089002+0000","last_unstale":"2021-10-08T19:34:24.778410+0000","last_undegraded":"2021-10-08T19:34:24.778410+0000","last_fullsized":"2021-10-08T19:34:24.778410+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:40.772524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:08.936801+0000","last_clean_scrub_stamp":"2021-10-08T19:32:40.772524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013535126999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":241,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.781855+0000","last_change":"2021-10-08T19:33:28.036369+0000","last_active":"2021-10-08T19:34:24.781855+0000","last_peered":"2021-10-08T19:34:24.781855+0000","last_clean":"2021-10-08T19:34:24.781855+0000","last_became_active":"2021-10-08T19:25:15.510457+0000","last_became_peered":"2021-10-08T19:25:15.510457+0000","last_unstale":"2021-10-08T19:34:24.781855+0000","last_undegraded":"2021-10-08T19:34:24.781855+0000","last_fullsized":"2021-10-08T19:34:24.781855+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:28.036266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:33:28.036266+0000","last_clean_scrub_stamp":"2021-10-08T19:33:28.036266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0045241719999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"341'12603","reported_seq":12662,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.555699+0000","last_change":"2021-10-08T19:31:33.858962+0000","last_active":"2021-10-08T19:34:28.555699+0000","last_peered":"2021-10-08T19:34:28.555699+0000","last_clean":"2021-10-08T19:34:28.555699+0000","last_became_active":"2021-10-08T19:31:33.858616+0000","last_became_peered":"2021-10-08T19:31:33.858616+0000","last_unstale":"2021-10-08T19:34:28.555699+0000","last_undegraded":"2021-10-08T19:34:28.555699+0000","last_fullsized":"2021-10-08T19:34:28.555699+0000","mapping_epoch":290,"log_start":"326'8100","ondisk_log_start":"326'8100","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.825378+0000","log_size":4503,"ondisk_log_size":4503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":131137536,"num_objects":2001,"num_object_clones":0,"num_object_copies":6003,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2001,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12603,"num_write_kb":467328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,1],"acting":[5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"337'19","reported_seq":379,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.800796+0000","last_change":"2021-10-08T19:34:14.040366+0000","last_active":"2021-10-08T19:34:25.800796+0000","last_peered":"2021-10-08T19:34:25.800796+0000","last_clean":"2021-10-08T19:34:25.800796+0000","last_became_active":"2021-10-08T19:28:40.159729+0000","last_became_peered":"2021-10-08T19:28:40.159729+0000","last_unstale":"2021-10-08T19:34:25.800796+0000","last_undegraded":"2021-10-08T19:34:25.800796+0000","last_fullsized":"2021-10-08T19:34:25.800796+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"337'19","last_scrub_stamp":"2021-10-08T19:34:14.040249+0000","last_deep_scrub":"337'19","last_deep_scrub_stamp":"2021-10-08T19:34:14.040249+0000","last_clean_scrub_stamp":"2021-10-08T19:34:14.040249+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.068085647999999999,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":178,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.803777+0000","last_change":"2021-10-08T19:32:49.595885+0000","last_active":"2021-10-08T19:34:25.803777+0000","last_peered":"2021-10-08T19:34:25.803777+0000","last_clean":"2021-10-08T19:34:25.803777+0000","last_became_active":"2021-10-08T19:29:40.624977+0000","last_became_peered":"2021-10-08T19:29:40.624977+0000","last_unstale":"2021-10-08T19:34:25.803777+0000","last_undegraded":"2021-10-08T19:34:25.803777+0000","last_fullsized":"2021-10-08T19:34:25.803777+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:49.595787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:49.595787+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0093433409999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":327,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.776286+0000","last_change":"2021-10-08T19:33:31.442700+0000","last_active":"2021-10-08T19:34:24.776286+0000","last_peered":"2021-10-08T19:34:24.776286+0000","last_clean":"2021-10-08T19:34:24.776286+0000","last_became_active":"2021-10-08T19:29:40.629422+0000","last_became_peered":"2021-10-08T19:29:40.629422+0000","last_unstale":"2021-10-08T19:34:24.776286+0000","last_undegraded":"2021-10-08T19:34:24.776286+0000","last_fullsized":"2021-10-08T19:34:24.776286+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:31.442595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:33:31.442595+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0061671119999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":304,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.802949+0000","last_change":"2021-10-08T19:32:45.121184+0000","last_active":"2021-10-08T19:34:25.802949+0000","last_peered":"2021-10-08T19:34:25.802949+0000","last_clean":"2021-10-08T19:34:25.802949+0000","last_became_active":"2021-10-08T19:21:29.643022+0000","last_became_peered":"2021-10-08T19:21:29.643022+0000","last_unstale":"2021-10-08T19:34:25.802949+0000","last_undegraded":"2021-10-08T19:34:25.802949+0000","last_fullsized":"2021-10-08T19:34:25.802949+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:45.121072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:32:45.121072+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.057771428999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"70'5","reported_seq":916,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:27.360404+0000","last_change":"2021-10-08T19:34:01.651995+0000","last_active":"2021-10-08T19:34:27.360404+0000","last_peered":"2021-10-08T19:34:27.360404+0000","last_clean":"2021-10-08T19:34:27.360404+0000","last_became_active":"2021-10-08T19:29:40.630821+0000","last_became_peered":"2021-10-08T19:29:40.630821+0000","last_unstale":"2021-10-08T19:34:27.360404+0000","last_undegraded":"2021-10-08T19:34:27.360404+0000","last_fullsized":"2021-10-08T19:34:27.360404+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:30:10.566251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:30:10.566251+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0093751019999999997,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":606,"num_read_kb":606,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1167,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.7","version":"341'12314","reported_seq":12373,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.586606+0000","last_change":"2021-10-08T19:31:33.859765+0000","last_active":"2021-10-08T19:34:28.586606+0000","last_peered":"2021-10-08T19:34:28.586606+0000","last_clean":"2021-10-08T19:34:28.586606+0000","last_became_active":"2021-10-08T19:31:33.859470+0000","last_became_peered":"2021-10-08T19:31:33.859470+0000","last_unstale":"2021-10-08T19:34:28.586606+0000","last_undegraded":"2021-10-08T19:34:28.586606+0000","last_fullsized":"2021-10-08T19:34:28.586606+0000","mapping_epoch":290,"log_start":"326'7843","ondisk_log_start":"326'7843","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.825378+0000","log_size":4471,"ondisk_log_size":4471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":130678784,"num_objects":1994,"num_object_clones":0,"num_object_copies":5982,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1994,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12314,"num_write_kb":457856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"289'35","reported_seq":366,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.779754+0000","last_change":"2021-10-08T19:34:17.416086+0000","last_active":"2021-10-08T19:34:24.779754+0000","last_peered":"2021-10-08T19:34:24.779754+0000","last_clean":"2021-10-08T19:34:24.779754+0000","last_became_active":"2021-10-08T19:28:40.101648+0000","last_became_peered":"2021-10-08T19:28:40.101648+0000","last_unstale":"2021-10-08T19:34:24.779754+0000","last_undegraded":"2021-10-08T19:34:24.779754+0000","last_fullsized":"2021-10-08T19:34:24.779754+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'35","last_scrub_stamp":"2021-10-08T19:34:17.415983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:34:17.415983+0000","log_size":35,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0070104399999999997,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":55,"num_read_kb":44,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":319,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.776795+0000","last_change":"2021-10-08T19:34:19.118563+0000","last_active":"2021-10-08T19:34:24.776795+0000","last_peered":"2021-10-08T19:34:24.776795+0000","last_clean":"2021-10-08T19:34:24.776795+0000","last_became_active":"2021-10-08T19:21:23.595919+0000","last_became_peered":"2021-10-08T19:21:23.595919+0000","last_unstale":"2021-10-08T19:34:24.776795+0000","last_undegraded":"2021-10-08T19:34:24.776795+0000","last_fullsized":"2021-10-08T19:34:24.776795+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:19.118460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:19.118460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0038562129999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":327,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.776328+0000","last_change":"2021-10-08T19:34:17.109330+0000","last_active":"2021-10-08T19:34:24.776328+0000","last_peered":"2021-10-08T19:34:24.776328+0000","last_clean":"2021-10-08T19:34:24.776328+0000","last_became_active":"2021-10-08T19:31:22.783725+0000","last_became_peered":"2021-10-08T19:31:22.783725+0000","last_unstale":"2021-10-08T19:34:24.776328+0000","last_undegraded":"2021-10-08T19:34:24.776328+0000","last_fullsized":"2021-10-08T19:34:24.776328+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:17.109225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:34:17.109225+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0087778820000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":325,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.777002+0000","last_change":"2021-10-08T19:34:20.691431+0000","last_active":"2021-10-08T19:34:24.777002+0000","last_peered":"2021-10-08T19:34:24.777002+0000","last_clean":"2021-10-08T19:34:24.777002+0000","last_became_active":"2021-10-08T19:29:40.638354+0000","last_became_peered":"2021-10-08T19:29:40.638354+0000","last_unstale":"2021-10-08T19:34:24.777002+0000","last_undegraded":"2021-10-08T19:34:24.777002+0000","last_fullsized":"2021-10-08T19:34:24.777002+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:20.691312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:39.528699+0000","last_clean_scrub_stamp":"2021-10-08T19:34:20.691312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0054161239999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":252,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.782726+0000","last_change":"2021-10-08T19:33:15.014419+0000","last_active":"2021-10-08T19:34:24.782726+0000","last_peered":"2021-10-08T19:34:24.782726+0000","last_clean":"2021-10-08T19:34:24.782726+0000","last_became_active":"2021-10-08T19:31:22.785590+0000","last_became_peered":"2021-10-08T19:31:22.785590+0000","last_unstale":"2021-10-08T19:34:24.782726+0000","last_undegraded":"2021-10-08T19:34:24.782726+0000","last_fullsized":"2021-10-08T19:34:24.782726+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:15.014302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:33:15.014302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0066500459999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.0","version":"342'12590","reported_seq":12655,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:29.096708+0000","last_change":"2021-10-08T19:34:02.943797+0000","last_active":"2021-10-08T19:34:29.096708+0000","last_peered":"2021-10-08T19:34:29.096708+0000","last_clean":"2021-10-08T19:34:29.096708+0000","last_became_active":"2021-10-08T19:31:34.404922+0000","last_became_peered":"2021-10-08T19:31:34.404922+0000","last_unstale":"2021-10-08T19:34:29.096708+0000","last_undegraded":"2021-10-08T19:34:29.096708+0000","last_fullsized":"2021-10-08T19:34:29.096708+0000","mapping_epoch":290,"log_start":"327'8200","ondisk_log_start":"327'8200","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"334'10784","last_scrub_stamp":"2021-10-08T19:34:02.943715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:34:02.943715+0000","log_size":4390,"ondisk_log_size":4390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":1.5732822230000001,"stat_sum":{"num_bytes":132513792,"num_objects":2022,"num_object_clones":0,"num_object_copies":6066,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2022,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12590,"num_write_kb":467584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.8","version":"90'130","reported_seq":417,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.778291+0000","last_change":"2021-10-08T19:33:59.611856+0000","last_active":"2021-10-08T19:34:24.778291+0000","last_peered":"2021-10-08T19:34:24.778291+0000","last_clean":"2021-10-08T19:34:24.778291+0000","last_became_active":"2021-10-08T19:31:25.647505+0000","last_became_peered":"2021-10-08T19:31:25.647505+0000","last_unstale":"2021-10-08T19:34:24.778291+0000","last_undegraded":"2021-10-08T19:34:24.778291+0000","last_fullsized":"2021-10-08T19:34:24.778291+0000","mapping_epoch":286,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":287,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.284249+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020087920000000001,"stat_sum":{"num_bytes":53670,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":28,"num_write":16,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":686385,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"289'31","reported_seq":408,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.787904+0000","last_change":"2021-10-08T19:32:35.520408+0000","last_active":"2021-10-08T19:34:25.787904+0000","last_peered":"2021-10-08T19:34:25.787904+0000","last_clean":"2021-10-08T19:34:25.787904+0000","last_became_active":"2021-10-08T19:28:40.099618+0000","last_became_peered":"2021-10-08T19:28:40.099618+0000","last_unstale":"2021-10-08T19:34:25.787904+0000","last_undegraded":"2021-10-08T19:34:25.787904+0000","last_fullsized":"2021-10-08T19:34:25.787904+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'31","last_scrub_stamp":"2021-10-08T19:32:35.520292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:32:35.520292+0000","log_size":31,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0063783820000000001,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":50,"num_read_kb":40,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"61'1","reported_seq":315,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.781765+0000","last_change":"2021-10-08T19:32:34.124480+0000","last_active":"2021-10-08T19:34:24.781765+0000","last_peered":"2021-10-08T19:34:24.781765+0000","last_clean":"2021-10-08T19:34:24.781765+0000","last_became_active":"2021-10-08T19:21:23.607064+0000","last_became_peered":"2021-10-08T19:21:23.607064+0000","last_unstale":"2021-10-08T19:34:24.781765+0000","last_undegraded":"2021-10-08T19:34:24.781765+0000","last_fullsized":"2021-10-08T19:34:24.781765+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'1","last_scrub_stamp":"2021-10-08T19:32:34.124360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:34.124360+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013485919000000001,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":160,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.803863+0000","last_change":"2021-10-08T19:33:28.473187+0000","last_active":"2021-10-08T19:34:25.803863+0000","last_peered":"2021-10-08T19:34:25.803863+0000","last_clean":"2021-10-08T19:34:25.803863+0000","last_became_active":"2021-10-08T19:28:40.152478+0000","last_became_peered":"2021-10-08T19:28:40.152478+0000","last_unstale":"2021-10-08T19:34:25.803863+0000","last_undegraded":"2021-10-08T19:34:25.803863+0000","last_fullsized":"2021-10-08T19:34:25.803863+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:28.473061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:30:09.081635+0000","last_clean_scrub_stamp":"2021-10-08T19:33:28.473061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.015238223,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":327,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.777627+0000","last_change":"2021-10-08T19:34:06.289528+0000","last_active":"2021-10-08T19:34:24.777627+0000","last_peered":"2021-10-08T19:34:24.777627+0000","last_clean":"2021-10-08T19:34:24.777627+0000","last_became_active":"2021-10-08T19:29:40.629424+0000","last_became_peered":"2021-10-08T19:29:40.629424+0000","last_unstale":"2021-10-08T19:34:24.777627+0000","last_undegraded":"2021-10-08T19:34:24.777627+0000","last_fullsized":"2021-10-08T19:34:24.777627+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:06.289410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:34:06.289410+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.125790019,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":291,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.781130+0000","last_change":"2021-10-08T19:33:31.895971+0000","last_active":"2021-10-08T19:34:24.781130+0000","last_peered":"2021-10-08T19:34:24.781130+0000","last_clean":"2021-10-08T19:34:24.781130+0000","last_became_active":"2021-10-08T19:31:51.676829+0000","last_became_peered":"2021-10-08T19:31:51.676829+0000","last_unstale":"2021-10-08T19:34:24.781130+0000","last_undegraded":"2021-10-08T19:34:24.781130+0000","last_fullsized":"2021-10-08T19:34:24.781130+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:31.895862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:33:31.895862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0071960000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"342'12375","reported_seq":12435,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:29.063252+0000","last_change":"2021-10-08T19:31:34.405282+0000","last_active":"2021-10-08T19:34:29.063252+0000","last_peered":"2021-10-08T19:34:29.063252+0000","last_clean":"2021-10-08T19:34:29.063252+0000","last_became_active":"2021-10-08T19:31:34.404950+0000","last_became_peered":"2021-10-08T19:31:34.404950+0000","last_unstale":"2021-10-08T19:34:29.063252+0000","last_undegraded":"2021-10-08T19:34:29.063252+0000","last_fullsized":"2021-10-08T19:34:29.063252+0000","mapping_epoch":290,"log_start":"328'8300","ondisk_log_start":"328'8300","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.825378+0000","log_size":4075,"ondisk_log_size":4075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":129302528,"num_objects":1973,"num_object_clones":0,"num_object_copies":5919,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1973,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12375,"num_write_kb":459136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.9","version":"90'130","reported_seq":655,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.783677+0000","last_change":"2021-10-08T19:32:45.137224+0000","last_active":"2021-10-08T19:34:24.783677+0000","last_peered":"2021-10-08T19:34:24.783677+0000","last_clean":"2021-10-08T19:34:24.783677+0000","last_became_active":"2021-10-08T19:29:43.634789+0000","last_became_peered":"2021-10-08T19:29:43.634789+0000","last_unstale":"2021-10-08T19:34:24.783677+0000","last_undegraded":"2021-10-08T19:34:24.783677+0000","last_fullsized":"2021-10-08T19:34:24.783677+0000","mapping_epoch":239,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:32:45.137128+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:32:45.137128+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0066909819999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"289'20","reported_seq":419,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.787556+0000","last_change":"2021-10-08T19:32:43.431315+0000","last_active":"2021-10-08T19:34:25.787556+0000","last_peered":"2021-10-08T19:34:25.787556+0000","last_clean":"2021-10-08T19:34:25.787556+0000","last_became_active":"2021-10-08T19:29:40.631807+0000","last_became_peered":"2021-10-08T19:29:40.631807+0000","last_unstale":"2021-10-08T19:34:25.787556+0000","last_undegraded":"2021-10-08T19:34:25.787556+0000","last_fullsized":"2021-10-08T19:34:25.787556+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'20","last_scrub_stamp":"2021-10-08T19:32:43.431197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:32:43.431197+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0057648359999999997,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":180,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.804850+0000","last_change":"2021-10-08T19:33:32.394260+0000","last_active":"2021-10-08T19:34:25.804850+0000","last_peered":"2021-10-08T19:34:25.804850+0000","last_clean":"2021-10-08T19:34:25.804850+0000","last_became_active":"2021-10-08T19:29:40.638988+0000","last_became_peered":"2021-10-08T19:29:40.638988+0000","last_unstale":"2021-10-08T19:34:25.804850+0000","last_undegraded":"2021-10-08T19:34:25.804850+0000","last_fullsized":"2021-10-08T19:34:25.804850+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:32.394149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:33:32.394149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011814760000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"250'9","reported_seq":477,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.803887+0000","last_change":"2021-10-08T19:34:10.138016+0000","last_active":"2021-10-08T19:34:25.803887+0000","last_peered":"2021-10-08T19:34:25.803887+0000","last_clean":"2021-10-08T19:34:25.803887+0000","last_became_active":"2021-10-08T19:21:27.637930+0000","last_became_peered":"2021-10-08T19:21:27.637930+0000","last_unstale":"2021-10-08T19:34:25.803887+0000","last_undegraded":"2021-10-08T19:34:25.803887+0000","last_fullsized":"2021-10-08T19:34:25.803887+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'9","last_scrub_stamp":"2021-10-08T19:32:07.490536+0000","last_deep_scrub":"250'9","last_deep_scrub_stamp":"2021-10-08T19:30:04.239189+0000","last_clean_scrub_stamp":"2021-10-08T19:32:07.490536+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0085166219999999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":319,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.788123+0000","last_change":"2021-10-08T19:32:05.558417+0000","last_active":"2021-10-08T19:34:25.788123+0000","last_peered":"2021-10-08T19:34:25.788123+0000","last_clean":"2021-10-08T19:34:25.788123+0000","last_became_active":"2021-10-08T19:28:40.100213+0000","last_became_peered":"2021-10-08T19:28:40.100213+0000","last_unstale":"2021-10-08T19:34:25.788123+0000","last_undegraded":"2021-10-08T19:34:25.788123+0000","last_fullsized":"2021-10-08T19:34:25.788123+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:05.558296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:32:05.558296+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.018815749,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":121,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.807605+0000","last_change":"2021-10-08T19:33:18.913013+0000","last_active":"2021-10-08T19:34:25.807605+0000","last_peered":"2021-10-08T19:34:25.807605+0000","last_clean":"2021-10-08T19:34:25.807605+0000","last_became_active":"2021-10-08T19:29:44.443507+0000","last_became_peered":"2021-10-08T19:29:44.443507+0000","last_unstale":"2021-10-08T19:34:25.807605+0000","last_undegraded":"2021-10-08T19:34:25.807605+0000","last_fullsized":"2021-10-08T19:34:25.807605+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:18.912952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:33:18.912952+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0091031900000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"342'12422","reported_seq":12482,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:29.020111+0000","last_change":"2021-10-08T19:31:33.858496+0000","last_active":"2021-10-08T19:34:29.020111+0000","last_peered":"2021-10-08T19:34:29.020111+0000","last_clean":"2021-10-08T19:34:29.020111+0000","last_became_active":"2021-10-08T19:31:33.858205+0000","last_became_peered":"2021-10-08T19:31:33.858205+0000","last_unstale":"2021-10-08T19:34:29.020111+0000","last_undegraded":"2021-10-08T19:34:29.020111+0000","last_fullsized":"2021-10-08T19:34:29.020111+0000","mapping_epoch":290,"log_start":"328'8400","ondisk_log_start":"328'8400","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.825378+0000","log_size":4022,"ondisk_log_size":4022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":127533056,"num_objects":1946,"num_object_clones":0,"num_object_copies":5838,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1946,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12422,"num_write_kb":459776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.a","version":"90'130","reported_seq":489,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.778268+0000","last_change":"2021-10-08T19:34:11.489040+0000","last_active":"2021-10-08T19:34:24.778268+0000","last_peered":"2021-10-08T19:34:24.778268+0000","last_clean":"2021-10-08T19:34:24.778268+0000","last_became_active":"2021-10-08T19:27:26.591129+0000","last_became_peered":"2021-10-08T19:27:26.591129+0000","last_unstale":"2021-10-08T19:34:24.778268+0000","last_undegraded":"2021-10-08T19:34:24.778268+0000","last_fullsized":"2021-10-08T19:34:24.778268+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:34:11.488938+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:34:11.488938+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0022431069999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.f","version":"289'27","reported_seq":55,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.777445+0000","last_change":"2021-10-08T19:33:25.352000+0000","last_active":"2021-10-08T19:34:24.777445+0000","last_peered":"2021-10-08T19:34:24.777445+0000","last_clean":"2021-10-08T19:34:24.777445+0000","last_became_active":"2021-10-08T19:32:45.162914+0000","last_became_peered":"2021-10-08T19:32:45.162914+0000","last_unstale":"2021-10-08T19:34:24.777445+0000","last_undegraded":"2021-10-08T19:34:24.777445+0000","last_fullsized":"2021-10-08T19:34:24.777445+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'27","last_scrub_stamp":"2021-10-08T19:33:25.351908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:33:25.351908+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0073004960000000001,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":550,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":178,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.803425+0000","last_change":"2021-10-08T19:33:23.420571+0000","last_active":"2021-10-08T19:34:25.803425+0000","last_peered":"2021-10-08T19:34:25.803425+0000","last_clean":"2021-10-08T19:34:25.803425+0000","last_became_active":"2021-10-08T19:29:40.631290+0000","last_became_peered":"2021-10-08T19:29:40.631290+0000","last_unstale":"2021-10-08T19:34:25.803425+0000","last_undegraded":"2021-10-08T19:34:25.803425+0000","last_fullsized":"2021-10-08T19:34:25.803425+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:23.420464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:30:11.102934+0000","last_clean_scrub_stamp":"2021-10-08T19:33:23.420464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0090076059999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"88'9","reported_seq":472,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:26.884376+0000","last_change":"2021-10-08T19:32:44.385874+0000","last_active":"2021-10-08T19:34:26.884376+0000","last_peered":"2021-10-08T19:34:26.884376+0000","last_clean":"2021-10-08T19:34:26.884376+0000","last_became_active":"2021-10-08T19:21:27.636432+0000","last_became_peered":"2021-10-08T19:21:27.636432+0000","last_unstale":"2021-10-08T19:34:26.884376+0000","last_undegraded":"2021-10-08T19:34:26.884376+0000","last_fullsized":"2021-10-08T19:34:26.884376+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'9","last_scrub_stamp":"2021-10-08T19:32:44.385765+0000","last_deep_scrub":"88'9","last_deep_scrub_stamp":"2021-10-08T19:23:00.048245+0000","last_clean_scrub_stamp":"2021-10-08T19:32:44.385765+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0082317169999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":322,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.782003+0000","last_change":"2021-10-08T19:34:02.605330+0000","last_active":"2021-10-08T19:34:24.782003+0000","last_peered":"2021-10-08T19:34:24.782003+0000","last_clean":"2021-10-08T19:34:24.782003+0000","last_became_active":"2021-10-08T19:28:40.137966+0000","last_became_peered":"2021-10-08T19:28:40.137966+0000","last_unstale":"2021-10-08T19:34:24.782003+0000","last_undegraded":"2021-10-08T19:34:24.782003+0000","last_fullsized":"2021-10-08T19:34:24.782003+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:30:32.621835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:30:32.621835+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.01635269,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.8","version":"70'5","reported_seq":121,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.800007+0000","last_change":"2021-10-08T19:32:39.783608+0000","last_active":"2021-10-08T19:34:25.800007+0000","last_peered":"2021-10-08T19:34:25.800007+0000","last_clean":"2021-10-08T19:34:25.800007+0000","last_became_active":"2021-10-08T19:29:40.639786+0000","last_became_peered":"2021-10-08T19:29:40.639786+0000","last_unstale":"2021-10-08T19:34:25.800007+0000","last_undegraded":"2021-10-08T19:34:25.800007+0000","last_fullsized":"2021-10-08T19:34:25.800007+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:32:39.783498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:39.783498+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0078782899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3","version":"341'12690","reported_seq":12749,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.636631+0000","last_change":"2021-10-08T19:31:33.862720+0000","last_active":"2021-10-08T19:34:28.636631+0000","last_peered":"2021-10-08T19:34:28.636631+0000","last_clean":"2021-10-08T19:34:28.636631+0000","last_became_active":"2021-10-08T19:31:33.861869+0000","last_became_peered":"2021-10-08T19:31:33.861869+0000","last_unstale":"2021-10-08T19:34:28.636631+0000","last_undegraded":"2021-10-08T19:34:28.636631+0000","last_fullsized":"2021-10-08T19:34:28.636631+0000","mapping_epoch":290,"log_start":"328'8900","ondisk_log_start":"328'8900","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.825378+0000","log_size":3790,"ondisk_log_size":3790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":136839168,"num_objects":2088,"num_object_clones":0,"num_object_copies":6264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2088,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12690,"num_write_kb":472896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"289'19","reported_seq":483,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.787875+0000","last_change":"2021-10-08T19:32:48.385494+0000","last_active":"2021-10-08T19:34:25.787875+0000","last_peered":"2021-10-08T19:34:25.787875+0000","last_clean":"2021-10-08T19:34:25.787875+0000","last_became_active":"2021-10-08T19:31:51.677509+0000","last_became_peered":"2021-10-08T19:31:51.677509+0000","last_unstale":"2021-10-08T19:34:25.787875+0000","last_undegraded":"2021-10-08T19:34:25.787875+0000","last_fullsized":"2021-10-08T19:34:25.787875+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:32:48.385367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:32:48.385367+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0082509920000000004,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":770,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":333,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.777180+0000","last_change":"2021-10-08T19:33:23.001573+0000","last_active":"2021-10-08T19:34:24.777180+0000","last_peered":"2021-10-08T19:34:24.777180+0000","last_clean":"2021-10-08T19:34:24.777180+0000","last_became_active":"2021-10-08T19:28:40.100691+0000","last_became_peered":"2021-10-08T19:28:40.100691+0000","last_unstale":"2021-10-08T19:34:24.777180+0000","last_undegraded":"2021-10-08T19:34:24.777180+0000","last_fullsized":"2021-10-08T19:34:24.777180+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:23.001455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:33:23.001455+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0091227059999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":320,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.780365+0000","last_change":"2021-10-08T19:33:17.529783+0000","last_active":"2021-10-08T19:34:24.780365+0000","last_peered":"2021-10-08T19:34:24.780365+0000","last_clean":"2021-10-08T19:34:24.780365+0000","last_became_active":"2021-10-08T19:24:25.105244+0000","last_became_peered":"2021-10-08T19:24:25.105244+0000","last_unstale":"2021-10-08T19:34:24.780365+0000","last_undegraded":"2021-10-08T19:34:24.780365+0000","last_fullsized":"2021-10-08T19:34:24.780365+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:17.529713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:33:17.529713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011576375999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":127,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.821677+0000","last_change":"2021-10-08T19:33:21.903287+0000","last_active":"2021-10-08T19:34:25.821677+0000","last_peered":"2021-10-08T19:34:25.821677+0000","last_clean":"2021-10-08T19:34:25.821677+0000","last_became_active":"2021-10-08T19:29:40.638099+0000","last_became_peered":"2021-10-08T19:29:40.638099+0000","last_unstale":"2021-10-08T19:34:25.821677+0000","last_undegraded":"2021-10-08T19:34:25.821677+0000","last_fullsized":"2021-10-08T19:34:25.821677+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:21.903188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:17.422176+0000","last_clean_scrub_stamp":"2021-10-08T19:33:21.903188+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014417607000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":258,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.786724+0000","last_change":"2021-10-08T19:32:51.293238+0000","last_active":"2021-10-08T19:34:25.786724+0000","last_peered":"2021-10-08T19:34:25.786724+0000","last_clean":"2021-10-08T19:34:25.786724+0000","last_became_active":"2021-10-08T19:24:13.506602+0000","last_became_peered":"2021-10-08T19:24:13.506602+0000","last_unstale":"2021-10-08T19:34:25.786724+0000","last_undegraded":"2021-10-08T19:34:25.786724+0000","last_fullsized":"2021-10-08T19:34:25.786724+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:51.293159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:51.293159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0082740520000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.c","version":"342'12333","reported_seq":12393,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:29.082670+0000","last_change":"2021-10-08T19:31:33.861894+0000","last_active":"2021-10-08T19:34:29.082670+0000","last_peered":"2021-10-08T19:34:29.082670+0000","last_clean":"2021-10-08T19:34:29.082670+0000","last_became_active":"2021-10-08T19:31:33.861544+0000","last_became_peered":"2021-10-08T19:31:33.861544+0000","last_unstale":"2021-10-08T19:34:29.082670+0000","last_undegraded":"2021-10-08T19:34:29.082670+0000","last_fullsized":"2021-10-08T19:34:29.082670+0000","mapping_epoch":290,"log_start":"328'8300","ondisk_log_start":"328'8300","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.825378+0000","log_size":4033,"ondisk_log_size":4033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":127991808,"num_objects":1953,"num_object_clones":0,"num_object_copies":5859,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1953,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12333,"num_write_kb":457152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"90'130","reported_seq":451,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.821629+0000","last_change":"2021-10-08T19:32:46.759726+0000","last_active":"2021-10-08T19:34:25.821629+0000","last_peered":"2021-10-08T19:34:25.821629+0000","last_clean":"2021-10-08T19:34:25.821629+0000","last_became_active":"2021-10-08T19:29:43.636733+0000","last_became_peered":"2021-10-08T19:29:43.636733+0000","last_unstale":"2021-10-08T19:34:25.821629+0000","last_undegraded":"2021-10-08T19:34:25.821629+0000","last_fullsized":"2021-10-08T19:34:25.821629+0000","mapping_epoch":239,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:32:46.759636+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:32:46.759636+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013166881,"stat_sum":{"num_bytes":327680,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"238'13","reported_seq":185,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:26.884319+0000","last_change":"2021-10-08T19:31:21.473012+0000","last_active":"2021-10-08T19:34:26.884319+0000","last_peered":"2021-10-08T19:34:26.884319+0000","last_clean":"2021-10-08T19:34:26.884319+0000","last_became_active":"2021-10-08T19:29:40.640248+0000","last_became_peered":"2021-10-08T19:29:40.640248+0000","last_unstale":"2021-10-08T19:34:26.884319+0000","last_undegraded":"2021-10-08T19:34:26.884319+0000","last_fullsized":"2021-10-08T19:34:26.884319+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"238'13","last_scrub_stamp":"2021-10-08T19:31:21.472930+0000","last_deep_scrub":"91'9","last_deep_scrub_stamp":"2021-10-08T19:23:32.329475+0000","last_clean_scrub_stamp":"2021-10-08T19:31:21.472930+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040000679999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"289'28","reported_seq":397,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.786926+0000","last_change":"2021-10-08T19:32:02.490565+0000","last_active":"2021-10-08T19:34:25.786926+0000","last_peered":"2021-10-08T19:34:25.786926+0000","last_clean":"2021-10-08T19:34:25.786926+0000","last_became_active":"2021-10-08T19:24:25.098743+0000","last_became_peered":"2021-10-08T19:24:25.098743+0000","last_unstale":"2021-10-08T19:34:25.786926+0000","last_undegraded":"2021-10-08T19:34:25.786926+0000","last_fullsized":"2021-10-08T19:34:25.786926+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'28","last_scrub_stamp":"2021-10-08T19:32:02.490435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:32:02.490435+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.005683698,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":42,"num_read_kb":35,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":249,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.780836+0000","last_change":"2021-10-08T19:32:36.867281+0000","last_active":"2021-10-08T19:34:24.780836+0000","last_peered":"2021-10-08T19:34:24.780836+0000","last_clean":"2021-10-08T19:34:24.780836+0000","last_became_active":"2021-10-08T19:24:25.094364+0000","last_became_peered":"2021-10-08T19:24:25.094364+0000","last_unstale":"2021-10-08T19:34:24.780836+0000","last_undegraded":"2021-10-08T19:34:24.780836+0000","last_fullsized":"2021-10-08T19:34:24.780836+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:36.867172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:36.867172+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0036742749999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":321,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.782115+0000","last_change":"2021-10-08T19:32:15.378399+0000","last_active":"2021-10-08T19:34:24.782115+0000","last_peered":"2021-10-08T19:34:24.782115+0000","last_clean":"2021-10-08T19:34:24.782115+0000","last_became_active":"2021-10-08T19:24:25.094848+0000","last_became_peered":"2021-10-08T19:24:25.094848+0000","last_unstale":"2021-10-08T19:34:24.782115+0000","last_undegraded":"2021-10-08T19:34:24.782115+0000","last_fullsized":"2021-10-08T19:34:24.782115+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:15.378288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:32:15.378288+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.043151555000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":281,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.800582+0000","last_change":"2021-10-08T19:34:12.966540+0000","last_active":"2021-10-08T19:34:25.800582+0000","last_peered":"2021-10-08T19:34:25.800582+0000","last_clean":"2021-10-08T19:34:25.800582+0000","last_became_active":"2021-10-08T19:28:40.132751+0000","last_became_peered":"2021-10-08T19:28:40.132751+0000","last_unstale":"2021-10-08T19:34:25.800582+0000","last_undegraded":"2021-10-08T19:34:25.800582+0000","last_fullsized":"2021-10-08T19:34:25.800582+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:03.274966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:03.274966+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001658084,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.d","version":"341'12558","reported_seq":14807,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.642900+0000","last_change":"2021-10-08T19:32:03.749570+0000","last_active":"2021-10-08T19:34:28.642900+0000","last_peered":"2021-10-08T19:34:28.642900+0000","last_clean":"2021-10-08T19:34:28.642900+0000","last_became_active":"2021-10-08T19:32:03.747395+0000","last_became_peered":"2021-10-08T19:32:03.747395+0000","last_unstale":"2021-10-08T19:34:28.642900+0000","last_undegraded":"2021-10-08T19:34:28.642900+0000","last_fullsized":"2021-10-08T19:34:28.642900+0000","mapping_epoch":308,"log_start":"328'8800","ondisk_log_start":"328'8800","created":290,"last_epoch_clean":309,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.825378+0000","log_size":3758,"ondisk_log_size":3758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":132710424,"num_objects":2026,"num_object_clones":0,"num_object_copies":6078,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2026,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":12558,"num_write_kb":466625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1088,"num_bytes_recovered":71303168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5],"acting":[7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.5","version":"90'130","reported_seq":484,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.787616+0000","last_change":"2021-10-08T19:32:14.582950+0000","last_active":"2021-10-08T19:34:25.787616+0000","last_peered":"2021-10-08T19:34:25.787616+0000","last_clean":"2021-10-08T19:34:25.787616+0000","last_became_active":"2021-10-08T19:27:26.590651+0000","last_became_peered":"2021-10-08T19:27:26.590651+0000","last_unstale":"2021-10-08T19:34:25.787616+0000","last_undegraded":"2021-10-08T19:34:25.787616+0000","last_fullsized":"2021-10-08T19:34:25.787616+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:32:14.582883+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:32:14.582883+0000","last_clean_scrub_stamp":"2021-10-08T19:32:14.582883+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0031287540000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":321,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.787221+0000","last_change":"2021-10-08T19:32:08.581599+0000","last_active":"2021-10-08T19:34:25.787221+0000","last_peered":"2021-10-08T19:34:25.787221+0000","last_clean":"2021-10-08T19:34:25.787221+0000","last_became_active":"2021-10-08T19:29:40.639405+0000","last_became_peered":"2021-10-08T19:29:40.639405+0000","last_unstale":"2021-10-08T19:34:25.787221+0000","last_undegraded":"2021-10-08T19:34:25.787221+0000","last_fullsized":"2021-10-08T19:34:25.787221+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:08.581479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:32:08.581479+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012079604000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"289'30","reported_seq":163,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.799875+0000","last_change":"2021-10-08T19:34:06.085387+0000","last_active":"2021-10-08T19:34:25.799875+0000","last_peered":"2021-10-08T19:34:25.799875+0000","last_clean":"2021-10-08T19:34:25.799875+0000","last_became_active":"2021-10-08T19:29:40.635007+0000","last_became_peered":"2021-10-08T19:29:40.635007+0000","last_unstale":"2021-10-08T19:34:25.799875+0000","last_undegraded":"2021-10-08T19:34:25.799875+0000","last_fullsized":"2021-10-08T19:34:25.799875+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'30","last_scrub_stamp":"2021-10-08T19:34:06.085282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:34:06.085282+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.015398577,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":51,"num_read_kb":39,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":154,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.805694+0000","last_change":"2021-10-08T19:32:42.574389+0000","last_active":"2021-10-08T19:34:25.805694+0000","last_peered":"2021-10-08T19:34:25.805694+0000","last_clean":"2021-10-08T19:34:25.805694+0000","last_became_active":"2021-10-08T19:28:40.141714+0000","last_became_peered":"2021-10-08T19:28:40.141714+0000","last_unstale":"2021-10-08T19:34:25.805694+0000","last_undegraded":"2021-10-08T19:34:25.805694+0000","last_fullsized":"2021-10-08T19:34:25.805694+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:42.574293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:07.710367+0000","last_clean_scrub_stamp":"2021-10-08T19:32:42.574293+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.035504648,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":319,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.787035+0000","last_change":"2021-10-08T19:32:49.356419+0000","last_active":"2021-10-08T19:34:25.787035+0000","last_peered":"2021-10-08T19:34:25.787035+0000","last_clean":"2021-10-08T19:34:25.787035+0000","last_became_active":"2021-10-08T19:29:40.638253+0000","last_became_peered":"2021-10-08T19:29:40.638253+0000","last_unstale":"2021-10-08T19:34:25.787035+0000","last_undegraded":"2021-10-08T19:34:25.787035+0000","last_fullsized":"2021-10-08T19:34:25.787035+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:49.356299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:32:49.356299+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.007536137,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":121,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.806898+0000","last_change":"2021-10-08T19:32:41.758468+0000","last_active":"2021-10-08T19:34:25.806898+0000","last_peered":"2021-10-08T19:34:25.806898+0000","last_clean":"2021-10-08T19:34:25.806898+0000","last_became_active":"2021-10-08T19:29:40.634579+0000","last_became_peered":"2021-10-08T19:29:40.634579+0000","last_unstale":"2021-10-08T19:34:25.806898+0000","last_undegraded":"2021-10-08T19:34:25.806898+0000","last_fullsized":"2021-10-08T19:34:25.806898+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:41.758382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:41.758382+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.015929216999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"341'12407","reported_seq":12470,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.637989+0000","last_change":"2021-10-08T19:34:13.621217+0000","last_active":"2021-10-08T19:34:28.637989+0000","last_peered":"2021-10-08T19:34:28.637989+0000","last_clean":"2021-10-08T19:34:28.637989+0000","last_became_active":"2021-10-08T19:31:33.861748+0000","last_became_peered":"2021-10-08T19:31:33.861748+0000","last_unstale":"2021-10-08T19:34:28.637989+0000","last_undegraded":"2021-10-08T19:34:28.637989+0000","last_fullsized":"2021-10-08T19:34:28.637989+0000","mapping_epoch":290,"log_start":"328'8600","ondisk_log_start":"328'8600","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"337'11353","last_scrub_stamp":"2021-10-08T19:34:13.621140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:34:13.621140+0000","log_size":3807,"ondisk_log_size":3807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.98600984000000003,"stat_sum":{"num_bytes":133103616,"num_objects":2031,"num_object_clones":0,"num_object_copies":6093,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2031,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12407,"num_write_kb":462016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.6","version":"90'130","reported_seq":418,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.780478+0000","last_change":"2021-10-08T19:34:07.251557+0000","last_active":"2021-10-08T19:34:24.780478+0000","last_peered":"2021-10-08T19:34:24.780478+0000","last_clean":"2021-10-08T19:34:24.780478+0000","last_became_active":"2021-10-08T19:30:00.643797+0000","last_became_peered":"2021-10-08T19:30:00.643797+0000","last_unstale":"2021-10-08T19:34:24.780478+0000","last_undegraded":"2021-10-08T19:34:24.780478+0000","last_fullsized":"2021-10-08T19:34:24.780478+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:32:34.820273+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:32:34.820273+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0080506420000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":255,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.779775+0000","last_change":"2021-10-08T19:32:52.822269+0000","last_active":"2021-10-08T19:34:24.779775+0000","last_peered":"2021-10-08T19:34:24.779775+0000","last_clean":"2021-10-08T19:34:24.779775+0000","last_became_active":"2021-10-08T19:24:25.095389+0000","last_became_peered":"2021-10-08T19:24:25.095389+0000","last_unstale":"2021-10-08T19:34:24.779775+0000","last_undegraded":"2021-10-08T19:34:24.779775+0000","last_fullsized":"2021-10-08T19:34:24.779775+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:52.822170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:32:52.822170+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0019409270000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"289'29","reported_seq":363,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.800676+0000","last_change":"2021-10-08T19:33:21.055265+0000","last_active":"2021-10-08T19:34:25.800676+0000","last_peered":"2021-10-08T19:34:25.800676+0000","last_clean":"2021-10-08T19:34:25.800676+0000","last_became_active":"2021-10-08T19:21:25.741812+0000","last_became_peered":"2021-10-08T19:21:25.741812+0000","last_unstale":"2021-10-08T19:34:25.800676+0000","last_undegraded":"2021-10-08T19:34:25.800676+0000","last_fullsized":"2021-10-08T19:34:25.800676+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'29","last_scrub_stamp":"2021-10-08T19:33:21.055136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:33:21.055136+0000","log_size":29,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0053848539999999997,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":54,"num_read_kb":40,"num_write":32,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"328'2","reported_seq":323,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.783245+0000","last_change":"2021-10-08T19:33:29.990487+0000","last_active":"2021-10-08T19:34:24.783245+0000","last_peered":"2021-10-08T19:34:24.783245+0000","last_clean":"2021-10-08T19:34:24.783245+0000","last_became_active":"2021-10-08T19:21:23.604258+0000","last_became_peered":"2021-10-08T19:21:23.604258+0000","last_unstale":"2021-10-08T19:34:24.783245+0000","last_undegraded":"2021-10-08T19:34:24.783245+0000","last_fullsized":"2021-10-08T19:34:24.783245+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"328'2","last_scrub_stamp":"2021-10-08T19:33:29.990395+0000","last_deep_scrub":"328'2","last_deep_scrub_stamp":"2021-10-08T19:33:29.990395+0000","last_clean_scrub_stamp":"2021-10-08T19:33:29.990395+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.020847460000000002,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":154,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.803298+0000","last_change":"2021-10-08T19:32:34.604785+0000","last_active":"2021-10-08T19:34:25.803298+0000","last_peered":"2021-10-08T19:34:25.803298+0000","last_clean":"2021-10-08T19:34:25.803298+0000","last_became_active":"2021-10-08T19:28:40.140876+0000","last_became_peered":"2021-10-08T19:28:40.140876+0000","last_unstale":"2021-10-08T19:34:25.803298+0000","last_undegraded":"2021-10-08T19:34:25.803298+0000","last_fullsized":"2021-10-08T19:34:25.803298+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:34.604679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:32:34.604679+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.029912211000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"70'5","reported_seq":160,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.804016+0000","last_change":"2021-10-08T19:34:06.579244+0000","last_active":"2021-10-08T19:34:25.804016+0000","last_peered":"2021-10-08T19:34:25.804016+0000","last_clean":"2021-10-08T19:34:25.804016+0000","last_became_active":"2021-10-08T19:28:40.150503+0000","last_became_peered":"2021-10-08T19:28:40.150503+0000","last_unstale":"2021-10-08T19:34:25.804016+0000","last_undegraded":"2021-10-08T19:34:25.804016+0000","last_fullsized":"2021-10-08T19:34:25.804016+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:34:06.579131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:06.579131+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0046237709999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"342'12354","reported_seq":12420,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:29.055235+0000","last_change":"2021-10-08T19:34:11.022967+0000","last_active":"2021-10-08T19:34:29.055235+0000","last_peered":"2021-10-08T19:34:29.055235+0000","last_clean":"2021-10-08T19:34:29.055235+0000","last_became_active":"2021-10-08T19:31:34.405616+0000","last_became_peered":"2021-10-08T19:31:34.405616+0000","last_unstale":"2021-10-08T19:34:29.055235+0000","last_undegraded":"2021-10-08T19:34:29.055235+0000","last_fullsized":"2021-10-08T19:34:29.055235+0000","mapping_epoch":290,"log_start":"324'7400","ondisk_log_start":"324'7400","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"336'11102","last_scrub_stamp":"2021-10-08T19:34:11.022854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:34:11.022854+0000","log_size":4954,"ondisk_log_size":4954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":1.1536645059999999,"stat_sum":{"num_bytes":128450560,"num_objects":1960,"num_object_clones":0,"num_object_copies":5880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1960,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12354,"num_write_kb":458048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"90'130","reported_seq":461,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.807886+0000","last_change":"2021-10-08T19:34:13.653358+0000","last_active":"2021-10-08T19:34:25.807886+0000","last_peered":"2021-10-08T19:34:25.807886+0000","last_clean":"2021-10-08T19:34:25.807886+0000","last_became_active":"2021-10-08T19:28:43.178371+0000","last_became_peered":"2021-10-08T19:28:43.178371+0000","last_unstale":"2021-10-08T19:34:25.807886+0000","last_undegraded":"2021-10-08T19:34:25.807886+0000","last_fullsized":"2021-10-08T19:34:25.807886+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:34:13.653248+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:34:13.653248+0000","last_clean_scrub_stamp":"2021-10-08T19:34:13.653248+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0071729649999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":73,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.780166+0000","last_change":"2021-10-08T19:33:21.590512+0000","last_active":"2021-10-08T19:34:24.780166+0000","last_peered":"2021-10-08T19:34:24.780166+0000","last_clean":"2021-10-08T19:34:24.780166+0000","last_became_active":"2021-10-08T19:31:22.783759+0000","last_became_peered":"2021-10-08T19:31:22.783759+0000","last_unstale":"2021-10-08T19:34:24.780166+0000","last_undegraded":"2021-10-08T19:34:24.780166+0000","last_fullsized":"2021-10-08T19:34:24.780166+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:21.590400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:33:21.590400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.022083749,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"289'24","reported_seq":415,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.800745+0000","last_change":"2021-10-08T19:33:23.117133+0000","last_active":"2021-10-08T19:34:25.800745+0000","last_peered":"2021-10-08T19:34:25.800745+0000","last_clean":"2021-10-08T19:34:25.800745+0000","last_became_active":"2021-10-08T19:32:45.154743+0000","last_became_peered":"2021-10-08T19:32:45.154743+0000","last_unstale":"2021-10-08T19:34:25.800745+0000","last_undegraded":"2021-10-08T19:34:25.800745+0000","last_fullsized":"2021-10-08T19:34:25.800745+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'24","last_scrub_stamp":"2021-10-08T19:33:23.117023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:33:23.117023+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0078508209999999991,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":30,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":296,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.775834+0000","last_change":"2021-10-08T19:32:38.544368+0000","last_active":"2021-10-08T19:34:24.775834+0000","last_peered":"2021-10-08T19:34:24.775834+0000","last_clean":"2021-10-08T19:34:24.775834+0000","last_became_active":"2021-10-08T19:28:40.140231+0000","last_became_peered":"2021-10-08T19:28:40.140231+0000","last_unstale":"2021-10-08T19:34:24.775834+0000","last_undegraded":"2021-10-08T19:34:24.775834+0000","last_fullsized":"2021-10-08T19:34:24.775834+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:38.544294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:32.922694+0000","last_clean_scrub_stamp":"2021-10-08T19:32:38.544294+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001371017,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":344,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.802792+0000","last_change":"2021-10-08T19:32:50.969378+0000","last_active":"2021-10-08T19:34:25.802792+0000","last_peered":"2021-10-08T19:34:25.802792+0000","last_clean":"2021-10-08T19:34:25.802792+0000","last_became_active":"2021-10-08T19:29:40.632010+0000","last_became_peered":"2021-10-08T19:29:40.632010+0000","last_unstale":"2021-10-08T19:34:25.802792+0000","last_undegraded":"2021-10-08T19:34:25.802792+0000","last_fullsized":"2021-10-08T19:34:25.802792+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:50.969293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:50.969293+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.015235362000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":62,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.803612+0000","last_change":"2021-10-08T19:34:21.644930+0000","last_active":"2021-10-08T19:34:25.803612+0000","last_peered":"2021-10-08T19:34:25.803612+0000","last_clean":"2021-10-08T19:34:25.803612+0000","last_became_active":"2021-10-08T19:31:51.673821+0000","last_became_peered":"2021-10-08T19:31:51.673821+0000","last_unstale":"2021-10-08T19:34:25.803612+0000","last_undegraded":"2021-10-08T19:34:25.803612+0000","last_fullsized":"2021-10-08T19:34:25.803612+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:21.644827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:21.644827+0000","last_clean_scrub_stamp":"2021-10-08T19:34:21.644827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0073867230000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"342'12684","reported_seq":12744,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:29.068205+0000","last_change":"2021-10-08T19:31:33.860786+0000","last_active":"2021-10-08T19:34:29.068205+0000","last_peered":"2021-10-08T19:34:29.068205+0000","last_clean":"2021-10-08T19:34:29.068205+0000","last_became_active":"2021-10-08T19:31:33.860551+0000","last_became_peered":"2021-10-08T19:31:33.860551+0000","last_unstale":"2021-10-08T19:34:29.068205+0000","last_undegraded":"2021-10-08T19:34:29.068205+0000","last_fullsized":"2021-10-08T19:34:29.068205+0000","mapping_epoch":290,"log_start":"328'8600","ondisk_log_start":"328'8600","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.825378+0000","log_size":4084,"ondisk_log_size":4084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":130547712,"num_objects":1992,"num_object_clones":0,"num_object_copies":5976,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1992,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12684,"num_write_kb":469632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":303,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.781998+0000","last_change":"2021-10-08T19:32:10.312482+0000","last_active":"2021-10-08T19:34:24.781998+0000","last_peered":"2021-10-08T19:34:24.781998+0000","last_clean":"2021-10-08T19:34:24.781998+0000","last_became_active":"2021-10-08T19:21:27.636086+0000","last_became_peered":"2021-10-08T19:21:27.636086+0000","last_unstale":"2021-10-08T19:34:24.781998+0000","last_undegraded":"2021-10-08T19:34:24.781998+0000","last_fullsized":"2021-10-08T19:34:24.781998+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:10.312378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:32:10.312378+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013579486,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"289'26","reported_seq":289,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.780013+0000","last_change":"2021-10-08T19:33:24.895190+0000","last_active":"2021-10-08T19:34:24.780013+0000","last_peered":"2021-10-08T19:34:24.780013+0000","last_clean":"2021-10-08T19:34:24.780013+0000","last_became_active":"2021-10-08T19:24:25.100384+0000","last_became_peered":"2021-10-08T19:24:25.100384+0000","last_unstale":"2021-10-08T19:34:24.780013+0000","last_undegraded":"2021-10-08T19:34:24.780013+0000","last_fullsized":"2021-10-08T19:34:24.780013+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'26","last_scrub_stamp":"2021-10-08T19:33:24.895081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:33:24.895081+0000","log_size":26,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0077530389999999998,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":42,"num_read_kb":32,"num_write":25,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"90'130","reported_seq":622,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.777096+0000","last_change":"2021-10-08T19:33:59.796799+0000","last_active":"2021-10-08T19:34:24.777096+0000","last_peered":"2021-10-08T19:34:24.777096+0000","last_clean":"2021-10-08T19:34:24.777096+0000","last_became_active":"2021-10-08T19:27:22.607289+0000","last_became_peered":"2021-10-08T19:27:22.607289+0000","last_unstale":"2021-10-08T19:34:24.777096+0000","last_undegraded":"2021-10-08T19:34:24.777096+0000","last_fullsized":"2021-10-08T19:34:24.777096+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:33:59.796700+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:33:59.796700+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0060175439999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":306,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.780170+0000","last_change":"2021-10-08T19:32:42.759368+0000","last_active":"2021-10-08T19:34:24.780170+0000","last_peered":"2021-10-08T19:34:24.780170+0000","last_clean":"2021-10-08T19:34:24.780170+0000","last_became_active":"2021-10-08T19:21:23.599143+0000","last_became_peered":"2021-10-08T19:21:23.599143+0000","last_unstale":"2021-10-08T19:34:24.780170+0000","last_undegraded":"2021-10-08T19:34:24.780170+0000","last_fullsized":"2021-10-08T19:34:24.780170+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:42.759288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:42.759288+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0067448220000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":121,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.811932+0000","last_change":"2021-10-08T19:32:40.754068+0000","last_active":"2021-10-08T19:34:25.811932+0000","last_peered":"2021-10-08T19:34:25.811932+0000","last_clean":"2021-10-08T19:34:25.811932+0000","last_became_active":"2021-10-08T19:29:40.638774+0000","last_became_peered":"2021-10-08T19:29:40.638774+0000","last_unstale":"2021-10-08T19:34:25.811932+0000","last_undegraded":"2021-10-08T19:34:25.811932+0000","last_fullsized":"2021-10-08T19:34:25.811932+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:40.753959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:40.753959+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0086989049999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":318,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.780506+0000","last_change":"2021-10-08T19:32:15.872970+0000","last_active":"2021-10-08T19:34:24.780506+0000","last_peered":"2021-10-08T19:34:24.780506+0000","last_clean":"2021-10-08T19:34:24.780506+0000","last_became_active":"2021-10-08T19:29:40.627256+0000","last_became_peered":"2021-10-08T19:29:40.627256+0000","last_unstale":"2021-10-08T19:34:24.780506+0000","last_undegraded":"2021-10-08T19:34:24.780506+0000","last_fullsized":"2021-10-08T19:34:24.780506+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:15.872860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:32:15.872860+0000","last_clean_scrub_stamp":"2021-10-08T19:32:15.872860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.068573066000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"341'12427","reported_seq":12492,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.584576+0000","last_change":"2021-10-08T19:34:09.706910+0000","last_active":"2021-10-08T19:34:28.584576+0000","last_peered":"2021-10-08T19:34:28.584576+0000","last_clean":"2021-10-08T19:34:28.584576+0000","last_became_active":"2021-10-08T19:31:33.859047+0000","last_became_peered":"2021-10-08T19:31:33.859047+0000","last_unstale":"2021-10-08T19:34:28.584576+0000","last_undegraded":"2021-10-08T19:34:28.584576+0000","last_fullsized":"2021-10-08T19:34:28.584576+0000","mapping_epoch":290,"log_start":"326'7962","ondisk_log_start":"326'7962","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"336'11118","last_scrub_stamp":"2021-10-08T19:34:09.706829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:34:09.706829+0000","log_size":4465,"ondisk_log_size":4465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":1.1768237109999999,"stat_sum":{"num_bytes":134938624,"num_objects":2059,"num_object_clones":0,"num_object_copies":6177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2059,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12427,"num_write_kb":463552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"90'130","reported_seq":630,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.786943+0000","last_change":"2021-10-08T19:34:05.737954+0000","last_active":"2021-10-08T19:34:24.786943+0000","last_peered":"2021-10-08T19:34:24.786943+0000","last_clean":"2021-10-08T19:34:24.786943+0000","last_became_active":"2021-10-08T19:27:26.591250+0000","last_became_peered":"2021-10-08T19:27:26.591250+0000","last_unstale":"2021-10-08T19:34:24.786943+0000","last_undegraded":"2021-10-08T19:34:24.786943+0000","last_fullsized":"2021-10-08T19:34:24.786943+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:34:05.737882+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:34:05.737882+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0037827009999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":313,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.776616+0000","last_change":"2021-10-08T19:34:20.092197+0000","last_active":"2021-10-08T19:34:24.776616+0000","last_peered":"2021-10-08T19:34:24.776616+0000","last_clean":"2021-10-08T19:34:24.776616+0000","last_became_active":"2021-10-08T19:21:27.637875+0000","last_became_peered":"2021-10-08T19:21:27.637875+0000","last_unstale":"2021-10-08T19:34:24.776616+0000","last_undegraded":"2021-10-08T19:34:24.776616+0000","last_fullsized":"2021-10-08T19:34:24.776616+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:20.092069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:20.092069+0000","last_clean_scrub_stamp":"2021-10-08T19:34:20.092069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0051905989999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"289'17","reported_seq":68,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.804135+0000","last_change":"2021-10-08T19:33:24.425584+0000","last_active":"2021-10-08T19:34:25.804135+0000","last_peered":"2021-10-08T19:34:25.804135+0000","last_clean":"2021-10-08T19:34:25.804135+0000","last_became_active":"2021-10-08T19:31:51.674965+0000","last_became_peered":"2021-10-08T19:31:51.674965+0000","last_unstale":"2021-10-08T19:34:25.804135+0000","last_undegraded":"2021-10-08T19:34:25.804135+0000","last_fullsized":"2021-10-08T19:34:25.804135+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'17","last_scrub_stamp":"2021-10-08T19:33:24.425500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:33:24.425500+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.015679596000000001,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":23,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":990,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":333,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.775824+0000","last_change":"2021-10-08T19:33:21.374979+0000","last_active":"2021-10-08T19:34:24.775824+0000","last_peered":"2021-10-08T19:34:24.775824+0000","last_clean":"2021-10-08T19:34:24.775824+0000","last_became_active":"2021-10-08T19:29:40.619746+0000","last_became_peered":"2021-10-08T19:29:40.619746+0000","last_unstale":"2021-10-08T19:34:24.775824+0000","last_undegraded":"2021-10-08T19:34:24.775824+0000","last_fullsized":"2021-10-08T19:34:24.775824+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:21.374908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:33:21.374908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034369499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"70'5","reported_seq":162,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.802889+0000","last_change":"2021-10-08T19:34:18.630491+0000","last_active":"2021-10-08T19:34:25.802889+0000","last_peered":"2021-10-08T19:34:25.802889+0000","last_clean":"2021-10-08T19:34:25.802889+0000","last_became_active":"2021-10-08T19:28:40.148054+0000","last_became_peered":"2021-10-08T19:28:40.148054+0000","last_unstale":"2021-10-08T19:34:25.802889+0000","last_undegraded":"2021-10-08T19:34:25.802889+0000","last_fullsized":"2021-10-08T19:34:25.802889+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:34:18.630378+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2021-10-08T19:34:18.630378+0000","last_clean_scrub_stamp":"2021-10-08T19:34:18.630378+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0054668570000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":337,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.783191+0000","last_change":"2021-10-08T19:32:42.131131+0000","last_active":"2021-10-08T19:34:24.783191+0000","last_peered":"2021-10-08T19:34:24.783191+0000","last_clean":"2021-10-08T19:34:24.783191+0000","last_became_active":"2021-10-08T19:29:40.652528+0000","last_became_peered":"2021-10-08T19:29:40.652528+0000","last_unstale":"2021-10-08T19:34:24.783191+0000","last_undegraded":"2021-10-08T19:34:24.783191+0000","last_fullsized":"2021-10-08T19:34:24.783191+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:42.131020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:32:42.131020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.027867907000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.9","version":"342'12451","reported_seq":12517,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:29.083212+0000","last_change":"2021-10-08T19:34:07.731840+0000","last_active":"2021-10-08T19:34:29.083212+0000","last_peered":"2021-10-08T19:34:29.083212+0000","last_clean":"2021-10-08T19:34:29.083212+0000","last_became_active":"2021-10-08T19:31:33.858961+0000","last_became_peered":"2021-10-08T19:31:33.858961+0000","last_unstale":"2021-10-08T19:34:29.083212+0000","last_undegraded":"2021-10-08T19:34:29.083212+0000","last_fullsized":"2021-10-08T19:34:29.083212+0000","mapping_epoch":290,"log_start":"324'7500","ondisk_log_start":"324'7500","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"336'10990","last_scrub_stamp":"2021-10-08T19:34:07.731731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:34:07.731731+0000","log_size":4951,"ondisk_log_size":4951,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.89057212100000005,"stat_sum":{"num_bytes":128778240,"num_objects":1965,"num_object_clones":0,"num_object_copies":5895,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1965,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12451,"num_write_kb":461312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,5],"acting":[0,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"90'130","reported_seq":482,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.778742+0000","last_change":"2021-10-08T19:31:33.806970+0000","last_active":"2021-10-08T19:34:24.778742+0000","last_peered":"2021-10-08T19:34:24.778742+0000","last_clean":"2021-10-08T19:34:24.778742+0000","last_became_active":"2021-10-08T19:27:26.591993+0000","last_became_peered":"2021-10-08T19:27:26.591993+0000","last_unstale":"2021-10-08T19:34:24.778742+0000","last_undegraded":"2021-10-08T19:34:24.778742+0000","last_fullsized":"2021-10-08T19:34:24.778742+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:31:33.806885+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:31:33.806885+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.00183936,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,2],"acting":[5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":326,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.805558+0000","last_change":"2021-10-08T19:33:27.102932+0000","last_active":"2021-10-08T19:34:25.805558+0000","last_peered":"2021-10-08T19:34:25.805558+0000","last_clean":"2021-10-08T19:34:25.805558+0000","last_became_active":"2021-10-08T19:28:40.133414+0000","last_became_peered":"2021-10-08T19:28:40.133414+0000","last_unstale":"2021-10-08T19:34:25.805558+0000","last_undegraded":"2021-10-08T19:34:25.805558+0000","last_fullsized":"2021-10-08T19:34:25.805558+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:27.102857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:33:27.102857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.008485991,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"289'44","reported_seq":333,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:26.884581+0000","last_change":"2021-10-08T19:34:04.465039+0000","last_active":"2021-10-08T19:34:26.884581+0000","last_peered":"2021-10-08T19:34:26.884581+0000","last_clean":"2021-10-08T19:34:26.884581+0000","last_became_active":"2021-10-08T19:29:40.626138+0000","last_became_peered":"2021-10-08T19:29:40.626138+0000","last_unstale":"2021-10-08T19:34:26.884581+0000","last_undegraded":"2021-10-08T19:34:26.884581+0000","last_fullsized":"2021-10-08T19:34:26.884581+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'44","last_scrub_stamp":"2021-10-08T19:34:04.464934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:34:04.464934+0000","log_size":44,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.004062642,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":65,"num_read_kb":50,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":1432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":342,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.778573+0000","last_change":"2021-10-08T19:32:06.793381+0000","last_active":"2021-10-08T19:34:24.778573+0000","last_peered":"2021-10-08T19:34:24.778573+0000","last_clean":"2021-10-08T19:34:24.778573+0000","last_became_active":"2021-10-08T19:28:40.137919+0000","last_became_peered":"2021-10-08T19:28:40.137919+0000","last_unstale":"2021-10-08T19:34:24.778573+0000","last_undegraded":"2021-10-08T19:34:24.778573+0000","last_fullsized":"2021-10-08T19:34:24.778573+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:06.793283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:06.793283+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0046514379999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":123,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.806825+0000","last_change":"2021-10-08T19:34:09.025163+0000","last_active":"2021-10-08T19:34:25.806825+0000","last_peered":"2021-10-08T19:34:25.806825+0000","last_clean":"2021-10-08T19:34:25.806825+0000","last_became_active":"2021-10-08T19:29:40.637371+0000","last_became_peered":"2021-10-08T19:29:40.637371+0000","last_unstale":"2021-10-08T19:34:25.806825+0000","last_undegraded":"2021-10-08T19:34:25.806825+0000","last_fullsized":"2021-10-08T19:34:25.806825+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:30:51.432925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:30:51.432925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0033942310000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":269,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.787241+0000","last_change":"2021-10-08T19:34:04.039092+0000","last_active":"2021-10-08T19:34:25.787241+0000","last_peered":"2021-10-08T19:34:25.787241+0000","last_clean":"2021-10-08T19:34:25.787241+0000","last_became_active":"2021-10-08T19:25:14.550690+0000","last_became_peered":"2021-10-08T19:25:14.550690+0000","last_unstale":"2021-10-08T19:34:25.787241+0000","last_undegraded":"2021-10-08T19:34:25.787241+0000","last_fullsized":"2021-10-08T19:34:25.787241+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:04.038995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:04.038995+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0083020339999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.f","version":"341'12469","reported_seq":12530,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.577337+0000","last_change":"2021-10-08T19:34:13.589045+0000","last_active":"2021-10-08T19:34:28.577337+0000","last_peered":"2021-10-08T19:34:28.577337+0000","last_clean":"2021-10-08T19:34:28.577337+0000","last_became_active":"2021-10-08T19:31:33.859443+0000","last_became_peered":"2021-10-08T19:31:33.859443+0000","last_unstale":"2021-10-08T19:34:28.577337+0000","last_undegraded":"2021-10-08T19:34:28.577337+0000","last_fullsized":"2021-10-08T19:34:28.577337+0000","mapping_epoch":290,"log_start":"326'8000","ondisk_log_start":"326'8000","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.825378+0000","log_size":4469,"ondisk_log_size":4469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":133890048,"num_objects":2043,"num_object_clones":0,"num_object_copies":6129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2043,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12469,"num_write_kb":464384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"90'130","reported_seq":584,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.780634+0000","last_change":"2021-10-08T19:34:01.146361+0000","last_active":"2021-10-08T19:34:24.780634+0000","last_peered":"2021-10-08T19:34:24.780634+0000","last_clean":"2021-10-08T19:34:24.780634+0000","last_became_active":"2021-10-08T19:29:43.636820+0000","last_became_peered":"2021-10-08T19:29:43.636820+0000","last_unstale":"2021-10-08T19:34:24.780634+0000","last_undegraded":"2021-10-08T19:34:24.780634+0000","last_fullsized":"2021-10-08T19:34:24.780634+0000","mapping_epoch":239,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:34:01.146246+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:34:01.146246+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.006677657,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"114'10","reported_seq":504,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:26.884204+0000","last_change":"2021-10-08T19:34:03.864493+0000","last_active":"2021-10-08T19:34:26.884204+0000","last_peered":"2021-10-08T19:34:26.884204+0000","last_clean":"2021-10-08T19:34:26.884204+0000","last_became_active":"2021-10-08T19:24:25.106695+0000","last_became_peered":"2021-10-08T19:24:25.106695+0000","last_unstale":"2021-10-08T19:34:26.884204+0000","last_undegraded":"2021-10-08T19:34:26.884204+0000","last_fullsized":"2021-10-08T19:34:26.884204+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'10","last_scrub_stamp":"2021-10-08T19:34:03.864384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:34:03.864384+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.007036924,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"289'20","reported_seq":68,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.804606+0000","last_change":"2021-10-08T19:34:16.658166+0000","last_active":"2021-10-08T19:34:25.804606+0000","last_peered":"2021-10-08T19:34:25.804606+0000","last_clean":"2021-10-08T19:34:25.804606+0000","last_became_active":"2021-10-08T19:31:51.675569+0000","last_became_peered":"2021-10-08T19:31:51.675569+0000","last_unstale":"2021-10-08T19:34:25.804606+0000","last_undegraded":"2021-10-08T19:34:25.804606+0000","last_fullsized":"2021-10-08T19:34:25.804606+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'20","last_scrub_stamp":"2021-10-08T19:34:16.658057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:34:16.658057+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010989301999999999,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":23,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":160,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.803780+0000","last_change":"2021-10-08T19:32:52.491940+0000","last_active":"2021-10-08T19:34:25.803780+0000","last_peered":"2021-10-08T19:34:25.803780+0000","last_clean":"2021-10-08T19:34:25.803780+0000","last_became_active":"2021-10-08T19:28:40.141737+0000","last_became_peered":"2021-10-08T19:28:40.141737+0000","last_unstale":"2021-10-08T19:34:25.803780+0000","last_undegraded":"2021-10-08T19:34:25.803780+0000","last_fullsized":"2021-10-08T19:34:25.803780+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:52.491828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:52.491828+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.015794227000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":328,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.802654+0000","last_change":"2021-10-08T19:34:16.042895+0000","last_active":"2021-10-08T19:34:25.802654+0000","last_peered":"2021-10-08T19:34:25.802654+0000","last_clean":"2021-10-08T19:34:25.802654+0000","last_became_active":"2021-10-08T19:29:40.643614+0000","last_became_peered":"2021-10-08T19:29:40.643614+0000","last_unstale":"2021-10-08T19:34:25.802654+0000","last_undegraded":"2021-10-08T19:34:25.802654+0000","last_fullsized":"2021-10-08T19:34:25.802654+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:16.042797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:16.042797+0000","last_clean_scrub_stamp":"2021-10-08T19:34:16.042797+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.038141670000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":282,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.781716+0000","last_change":"2021-10-08T19:32:49.731052+0000","last_active":"2021-10-08T19:34:24.781716+0000","last_peered":"2021-10-08T19:34:24.781716+0000","last_clean":"2021-10-08T19:34:24.781716+0000","last_became_active":"2021-10-08T19:29:40.626998+0000","last_became_peered":"2021-10-08T19:29:40.626998+0000","last_unstale":"2021-10-08T19:34:24.781716+0000","last_undegraded":"2021-10-08T19:34:24.781716+0000","last_fullsized":"2021-10-08T19:34:24.781716+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:49.730960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:49.730960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.017072971999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.4","version":"342'12843","reported_seq":12911,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:29.098322+0000","last_change":"2021-10-08T19:34:00.850587+0000","last_active":"2021-10-08T19:34:29.098322+0000","last_peered":"2021-10-08T19:34:29.098322+0000","last_clean":"2021-10-08T19:34:29.098322+0000","last_became_active":"2021-10-08T19:31:33.861531+0000","last_became_peered":"2021-10-08T19:31:33.861531+0000","last_unstale":"2021-10-08T19:34:29.098322+0000","last_undegraded":"2021-10-08T19:34:29.098322+0000","last_fullsized":"2021-10-08T19:34:29.098322+0000","mapping_epoch":290,"log_start":"328'8401","ondisk_log_start":"328'8401","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"334'10939","last_scrub_stamp":"2021-10-08T19:34:00.850475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:34:00.850475+0000","log_size":4442,"ondisk_log_size":4442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":1.492343617,"stat_sum":{"num_bytes":127270912,"num_objects":1942,"num_object_clones":0,"num_object_copies":5826,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1942,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12376,"num_write_kb":458176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":327,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.776106+0000","last_change":"2021-10-08T19:33:18.301452+0000","last_active":"2021-10-08T19:34:24.776106+0000","last_peered":"2021-10-08T19:34:24.776106+0000","last_clean":"2021-10-08T19:34:24.776106+0000","last_became_active":"2021-10-08T19:28:40.138726+0000","last_became_peered":"2021-10-08T19:28:40.138726+0000","last_unstale":"2021-10-08T19:34:24.776106+0000","last_undegraded":"2021-10-08T19:34:24.776106+0000","last_fullsized":"2021-10-08T19:34:24.776106+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:18.301355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:50.435552+0000","last_clean_scrub_stamp":"2021-10-08T19:33:18.301355+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011225987999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"289'18","reported_seq":421,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.787139+0000","last_change":"2021-10-08T19:33:19.173918+0000","last_active":"2021-10-08T19:34:25.787139+0000","last_peered":"2021-10-08T19:34:25.787139+0000","last_clean":"2021-10-08T19:34:25.787139+0000","last_became_active":"2021-10-08T19:29:40.638957+0000","last_became_peered":"2021-10-08T19:29:40.638957+0000","last_unstale":"2021-10-08T19:34:25.787139+0000","last_undegraded":"2021-10-08T19:34:25.787139+0000","last_fullsized":"2021-10-08T19:34:25.787139+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'18","last_scrub_stamp":"2021-10-08T19:33:19.173830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:33:19.173830+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014315273999999999,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":25,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"61'2","reported_seq":323,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.788058+0000","last_change":"2021-10-08T19:32:50.319062+0000","last_active":"2021-10-08T19:34:25.788058+0000","last_peered":"2021-10-08T19:34:25.788058+0000","last_clean":"2021-10-08T19:34:25.788058+0000","last_became_active":"2021-10-08T19:21:23.603614+0000","last_became_peered":"2021-10-08T19:21:23.603614+0000","last_unstale":"2021-10-08T19:34:25.788058+0000","last_undegraded":"2021-10-08T19:34:25.788058+0000","last_fullsized":"2021-10-08T19:34:25.788058+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'2","last_scrub_stamp":"2021-10-08T19:32:50.318952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:50.318952+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0102337,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":121,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.807445+0000","last_change":"2021-10-08T19:31:29.506433+0000","last_active":"2021-10-08T19:34:25.807445+0000","last_peered":"2021-10-08T19:34:25.807445+0000","last_clean":"2021-10-08T19:34:25.807445+0000","last_became_active":"2021-10-08T19:29:40.645211+0000","last_became_peered":"2021-10-08T19:29:40.645211+0000","last_unstale":"2021-10-08T19:34:25.807445+0000","last_undegraded":"2021-10-08T19:34:25.807445+0000","last_fullsized":"2021-10-08T19:34:25.807445+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:29.506331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:31:29.506331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.042894232999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":242,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.781935+0000","last_change":"2021-10-08T19:31:29.399846+0000","last_active":"2021-10-08T19:34:24.781935+0000","last_peered":"2021-10-08T19:34:24.781935+0000","last_clean":"2021-10-08T19:34:24.781935+0000","last_became_active":"2021-10-08T19:28:40.100770+0000","last_became_peered":"2021-10-08T19:28:40.100770+0000","last_unstale":"2021-10-08T19:34:24.781935+0000","last_undegraded":"2021-10-08T19:34:24.781935+0000","last_fullsized":"2021-10-08T19:34:24.781935+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:29.399771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:31:29.399771+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001424972,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"289'15","reported_seq":375,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.800828+0000","last_change":"2021-10-08T19:33:32.998429+0000","last_active":"2021-10-08T19:34:25.800828+0000","last_peered":"2021-10-08T19:34:25.800828+0000","last_clean":"2021-10-08T19:34:25.800828+0000","last_became_active":"2021-10-08T19:29:40.644354+0000","last_became_peered":"2021-10-08T19:29:40.644354+0000","last_unstale":"2021-10-08T19:34:25.800828+0000","last_undegraded":"2021-10-08T19:34:25.800828+0000","last_fullsized":"2021-10-08T19:34:25.800828+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'15","last_scrub_stamp":"2021-10-08T19:33:32.998322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:33:32.998322+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014909828999999999,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":341,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.776017+0000","last_change":"2021-10-08T19:34:11.126528+0000","last_active":"2021-10-08T19:34:24.776017+0000","last_peered":"2021-10-08T19:34:24.776017+0000","last_clean":"2021-10-08T19:34:24.776017+0000","last_became_active":"2021-10-08T19:28:40.139234+0000","last_became_peered":"2021-10-08T19:28:40.139234+0000","last_unstale":"2021-10-08T19:34:24.776017+0000","last_undegraded":"2021-10-08T19:34:24.776017+0000","last_fullsized":"2021-10-08T19:34:24.776017+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:11.126413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:11.126413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011475828,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":121,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.806997+0000","last_change":"2021-10-08T19:32:05.472718+0000","last_active":"2021-10-08T19:34:25.806997+0000","last_peered":"2021-10-08T19:34:25.806997+0000","last_clean":"2021-10-08T19:34:25.806997+0000","last_became_active":"2021-10-08T19:29:40.645111+0000","last_became_peered":"2021-10-08T19:29:40.645111+0000","last_unstale":"2021-10-08T19:34:25.806997+0000","last_undegraded":"2021-10-08T19:34:25.806997+0000","last_fullsized":"2021-10-08T19:34:25.806997+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:05.472621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:32:05.472621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0050247119999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":305,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.776588+0000","last_change":"2021-10-08T19:32:36.559264+0000","last_active":"2021-10-08T19:34:24.776588+0000","last_peered":"2021-10-08T19:34:24.776588+0000","last_clean":"2021-10-08T19:34:24.776588+0000","last_became_active":"2021-10-08T19:21:29.640674+0000","last_became_peered":"2021-10-08T19:21:29.640674+0000","last_unstale":"2021-10-08T19:34:24.776588+0000","last_undegraded":"2021-10-08T19:34:24.776588+0000","last_fullsized":"2021-10-08T19:34:24.776588+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:36.559192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:32:36.559192+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.01026267,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":234,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.783745+0000","last_change":"2021-10-08T19:32:53.182703+0000","last_active":"2021-10-08T19:34:24.783745+0000","last_peered":"2021-10-08T19:34:24.783745+0000","last_clean":"2021-10-08T19:34:24.783745+0000","last_became_active":"2021-10-08T19:25:15.501118+0000","last_became_peered":"2021-10-08T19:25:15.501118+0000","last_unstale":"2021-10-08T19:34:24.783745+0000","last_undegraded":"2021-10-08T19:34:24.783745+0000","last_fullsized":"2021-10-08T19:34:24.783745+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:53.182628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:53.182628+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0033567269999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"289'12","reported_seq":144,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.806908+0000","last_change":"2021-10-08T19:33:23.899814+0000","last_active":"2021-10-08T19:34:25.806908+0000","last_peered":"2021-10-08T19:34:25.806908+0000","last_clean":"2021-10-08T19:34:25.806908+0000","last_became_active":"2021-10-08T19:29:40.644657+0000","last_became_peered":"2021-10-08T19:29:40.644657+0000","last_unstale":"2021-10-08T19:34:25.806908+0000","last_undegraded":"2021-10-08T19:34:25.806908+0000","last_fullsized":"2021-10-08T19:34:25.806908+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'12","last_scrub_stamp":"2021-10-08T19:33:23.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:33:23.899705+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.016253179999999999,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":18,"num_read_kb":15,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":275,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.780998+0000","last_change":"2021-10-08T19:33:59.151842+0000","last_active":"2021-10-08T19:34:24.780998+0000","last_peered":"2021-10-08T19:34:24.780998+0000","last_clean":"2021-10-08T19:34:24.780998+0000","last_became_active":"2021-10-08T19:28:40.101898+0000","last_became_peered":"2021-10-08T19:28:40.101898+0000","last_unstale":"2021-10-08T19:34:24.780998+0000","last_undegraded":"2021-10-08T19:34:24.780998+0000","last_fullsized":"2021-10-08T19:34:24.780998+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:59.151732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:16.444582+0000","last_clean_scrub_stamp":"2021-10-08T19:33:59.151732+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0072227530000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":344,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.779177+0000","last_change":"2021-10-08T19:34:03.603560+0000","last_active":"2021-10-08T19:34:24.779177+0000","last_peered":"2021-10-08T19:34:24.779177+0000","last_clean":"2021-10-08T19:34:24.779177+0000","last_became_active":"2021-10-08T19:29:40.626950+0000","last_became_peered":"2021-10-08T19:29:40.626950+0000","last_unstale":"2021-10-08T19:34:24.779177+0000","last_undegraded":"2021-10-08T19:34:24.779177+0000","last_fullsized":"2021-10-08T19:34:24.779177+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:03.603487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:34:03.603487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011751039,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":325,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.782670+0000","last_change":"2021-10-08T19:32:38.147982+0000","last_active":"2021-10-08T19:34:24.782670+0000","last_peered":"2021-10-08T19:34:24.782670+0000","last_clean":"2021-10-08T19:34:24.782670+0000","last_became_active":"2021-10-08T19:24:25.099371+0000","last_became_peered":"2021-10-08T19:24:25.099371+0000","last_unstale":"2021-10-08T19:34:24.782670+0000","last_undegraded":"2021-10-08T19:34:24.782670+0000","last_fullsized":"2021-10-08T19:34:24.782670+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:38.147897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:32:38.147897+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.044536603000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"70'5","reported_seq":504,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.779193+0000","last_change":"2021-10-08T19:34:09.254133+0000","last_active":"2021-10-08T19:34:24.779193+0000","last_peered":"2021-10-08T19:34:24.779193+0000","last_clean":"2021-10-08T19:34:24.779193+0000","last_became_active":"2021-10-08T19:31:22.785193+0000","last_became_peered":"2021-10-08T19:31:22.785193+0000","last_unstale":"2021-10-08T19:34:24.779193+0000","last_undegraded":"2021-10-08T19:34:24.779193+0000","last_fullsized":"2021-10-08T19:34:24.779193+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":5,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:32:40.868606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:40.868606+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0051348670000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"289'20","reported_seq":192,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.821494+0000","last_change":"2021-10-08T19:32:38.773549+0000","last_active":"2021-10-08T19:34:25.821494+0000","last_peered":"2021-10-08T19:34:25.821494+0000","last_clean":"2021-10-08T19:34:25.821494+0000","last_became_active":"2021-10-08T19:31:51.677055+0000","last_became_peered":"2021-10-08T19:31:51.677055+0000","last_unstale":"2021-10-08T19:34:25.821494+0000","last_undegraded":"2021-10-08T19:34:25.821494+0000","last_fullsized":"2021-10-08T19:34:25.821494+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'20","last_scrub_stamp":"2021-10-08T19:32:38.773440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:32:38.773440+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0043484539999999999,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":324,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.778497+0000","last_change":"2021-10-08T19:31:30.802257+0000","last_active":"2021-10-08T19:34:24.778497+0000","last_peered":"2021-10-08T19:34:24.778497+0000","last_clean":"2021-10-08T19:34:24.778497+0000","last_became_active":"2021-10-08T19:29:40.631331+0000","last_became_peered":"2021-10-08T19:29:40.631331+0000","last_unstale":"2021-10-08T19:34:24.778497+0000","last_undegraded":"2021-10-08T19:34:24.778497+0000","last_fullsized":"2021-10-08T19:34:24.778497+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:30.802102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:31:30.802102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0025761069999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"328'11","reported_seq":501,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.804048+0000","last_change":"2021-10-08T19:33:32.545949+0000","last_active":"2021-10-08T19:34:25.804048+0000","last_peered":"2021-10-08T19:34:25.804048+0000","last_clean":"2021-10-08T19:34:25.804048+0000","last_became_active":"2021-10-08T19:28:40.138031+0000","last_became_peered":"2021-10-08T19:28:40.138031+0000","last_unstale":"2021-10-08T19:34:25.804048+0000","last_undegraded":"2021-10-08T19:34:25.804048+0000","last_fullsized":"2021-10-08T19:34:25.804048+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"328'11","last_scrub_stamp":"2021-10-08T19:33:32.545870+0000","last_deep_scrub":"328'11","last_deep_scrub_stamp":"2021-10-08T19:33:32.545870+0000","last_clean_scrub_stamp":"2021-10-08T19:33:32.545870+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.023323448,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":322,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.800659+0000","last_change":"2021-10-08T19:33:29.076679+0000","last_active":"2021-10-08T19:34:25.800659+0000","last_peered":"2021-10-08T19:34:25.800659+0000","last_clean":"2021-10-08T19:34:25.800659+0000","last_became_active":"2021-10-08T19:29:40.644819+0000","last_became_peered":"2021-10-08T19:29:40.644819+0000","last_unstale":"2021-10-08T19:34:25.800659+0000","last_undegraded":"2021-10-08T19:34:25.800659+0000","last_fullsized":"2021-10-08T19:34:25.800659+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:29.076571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:33:29.076571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.046814043999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":230,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.781533+0000","last_change":"2021-10-08T19:32:08.300983+0000","last_active":"2021-10-08T19:34:24.781533+0000","last_peered":"2021-10-08T19:34:24.781533+0000","last_clean":"2021-10-08T19:34:24.781533+0000","last_became_active":"2021-10-08T19:25:15.498770+0000","last_became_peered":"2021-10-08T19:25:15.498770+0000","last_unstale":"2021-10-08T19:34:24.781533+0000","last_undegraded":"2021-10-08T19:34:24.781533+0000","last_fullsized":"2021-10-08T19:34:24.781533+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:08.300907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:08.300907+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.00342115,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"289'15","reported_seq":92,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.781639+0000","last_change":"2021-10-08T19:33:30.506573+0000","last_active":"2021-10-08T19:34:24.781639+0000","last_peered":"2021-10-08T19:34:24.781639+0000","last_clean":"2021-10-08T19:34:24.781639+0000","last_became_active":"2021-10-08T19:31:22.786860+0000","last_became_peered":"2021-10-08T19:31:22.786860+0000","last_unstale":"2021-10-08T19:34:24.781639+0000","last_undegraded":"2021-10-08T19:34:24.781639+0000","last_fullsized":"2021-10-08T19:34:24.781639+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'15","last_scrub_stamp":"2021-10-08T19:33:30.506458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:33:30.506458+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010013156,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":336,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.800751+0000","last_change":"2021-10-08T19:33:32.035734+0000","last_active":"2021-10-08T19:34:25.800751+0000","last_peered":"2021-10-08T19:34:25.800751+0000","last_clean":"2021-10-08T19:34:25.800751+0000","last_became_active":"2021-10-08T19:29:44.439397+0000","last_became_peered":"2021-10-08T19:29:44.439397+0000","last_unstale":"2021-10-08T19:34:25.800751+0000","last_undegraded":"2021-10-08T19:34:25.800751+0000","last_fullsized":"2021-10-08T19:34:25.800751+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:32.035617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:33:32.035617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.016251978,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"238'10","reported_seq":189,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:26.884341+0000","last_change":"2021-10-08T19:34:14.090645+0000","last_active":"2021-10-08T19:34:26.884341+0000","last_peered":"2021-10-08T19:34:26.884341+0000","last_clean":"2021-10-08T19:34:26.884341+0000","last_became_active":"2021-10-08T19:29:40.637650+0000","last_became_peered":"2021-10-08T19:29:40.637650+0000","last_unstale":"2021-10-08T19:34:26.884341+0000","last_undegraded":"2021-10-08T19:34:26.884341+0000","last_fullsized":"2021-10-08T19:34:26.884341+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"238'10","last_scrub_stamp":"2021-10-08T19:34:14.090547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:34:14.090547+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.017481770000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":301,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.788313+0000","last_change":"2021-10-08T19:33:16.237668+0000","last_active":"2021-10-08T19:34:25.788313+0000","last_peered":"2021-10-08T19:34:25.788313+0000","last_clean":"2021-10-08T19:34:25.788313+0000","last_became_active":"2021-10-08T19:21:29.640302+0000","last_became_peered":"2021-10-08T19:21:29.640302+0000","last_unstale":"2021-10-08T19:34:25.788313+0000","last_undegraded":"2021-10-08T19:34:25.788313+0000","last_fullsized":"2021-10-08T19:34:25.788313+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:16.237548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:33:16.237548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.060114668000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":243,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.800553+0000","last_change":"2021-10-08T19:32:48.970818+0000","last_active":"2021-10-08T19:34:25.800553+0000","last_peered":"2021-10-08T19:34:25.800553+0000","last_clean":"2021-10-08T19:34:25.800553+0000","last_became_active":"2021-10-08T19:29:40.631374+0000","last_became_peered":"2021-10-08T19:29:40.631374+0000","last_unstale":"2021-10-08T19:34:25.800553+0000","last_undegraded":"2021-10-08T19:34:25.800553+0000","last_fullsized":"2021-10-08T19:34:25.800553+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:48.970722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:48.970722+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011612008,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":246,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.782594+0000","last_change":"2021-10-08T19:32:40.137708+0000","last_active":"2021-10-08T19:34:24.782594+0000","last_peered":"2021-10-08T19:34:24.782594+0000","last_clean":"2021-10-08T19:34:24.782594+0000","last_became_active":"2021-10-08T19:29:40.652966+0000","last_became_peered":"2021-10-08T19:29:40.652966+0000","last_unstale":"2021-10-08T19:34:24.782594+0000","last_undegraded":"2021-10-08T19:34:24.782594+0000","last_fullsized":"2021-10-08T19:34:24.782594+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:40.137613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:40.137613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0079745670000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"289'19","reported_seq":66,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.804291+0000","last_change":"2021-10-08T19:32:46.539916+0000","last_active":"2021-10-08T19:34:25.804291+0000","last_peered":"2021-10-08T19:34:25.804291+0000","last_clean":"2021-10-08T19:34:25.804291+0000","last_became_active":"2021-10-08T19:31:51.676961+0000","last_became_peered":"2021-10-08T19:31:51.676961+0000","last_unstale":"2021-10-08T19:34:25.804291+0000","last_undegraded":"2021-10-08T19:34:25.804291+0000","last_fullsized":"2021-10-08T19:34:25.804291+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:32:46.539792+0000","last_deep_scrub":"289'19","last_deep_scrub_stamp":"2021-10-08T19:32:46.539792+0000","last_clean_scrub_stamp":"2021-10-08T19:32:46.539792+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010982540000000001,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":291,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.779940+0000","last_change":"2021-10-08T19:33:20.923704+0000","last_active":"2021-10-08T19:34:24.779940+0000","last_peered":"2021-10-08T19:34:24.779940+0000","last_clean":"2021-10-08T19:34:24.779940+0000","last_became_active":"2021-10-08T19:31:22.786651+0000","last_became_peered":"2021-10-08T19:31:22.786651+0000","last_unstale":"2021-10-08T19:34:24.779940+0000","last_undegraded":"2021-10-08T19:34:24.779940+0000","last_fullsized":"2021-10-08T19:34:24.779940+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:20.923605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:33:20.923605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.022344111,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":123,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.807359+0000","last_change":"2021-10-08T19:34:07.049328+0000","last_active":"2021-10-08T19:34:25.807359+0000","last_peered":"2021-10-08T19:34:25.807359+0000","last_clean":"2021-10-08T19:34:25.807359+0000","last_became_active":"2021-10-08T19:29:40.644770+0000","last_became_peered":"2021-10-08T19:29:40.644770+0000","last_unstale":"2021-10-08T19:34:25.807359+0000","last_undegraded":"2021-10-08T19:34:25.807359+0000","last_fullsized":"2021-10-08T19:34:25.807359+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:30:32.410928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:30:32.410928+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003423953,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":324,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.802566+0000","last_change":"2021-10-08T19:33:22.113737+0000","last_active":"2021-10-08T19:34:25.802566+0000","last_peered":"2021-10-08T19:34:25.802566+0000","last_clean":"2021-10-08T19:34:25.802566+0000","last_became_active":"2021-10-08T19:28:40.133744+0000","last_became_peered":"2021-10-08T19:28:40.133744+0000","last_unstale":"2021-10-08T19:34:25.802566+0000","last_undegraded":"2021-10-08T19:34:25.802566+0000","last_fullsized":"2021-10-08T19:34:25.802566+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:22.113636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:33:22.113636+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.042931799,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"289'19","reported_seq":461,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.787172+0000","last_change":"2021-10-08T19:34:11.033790+0000","last_active":"2021-10-08T19:34:25.787172+0000","last_peered":"2021-10-08T19:34:25.787172+0000","last_clean":"2021-10-08T19:34:25.787172+0000","last_became_active":"2021-10-08T19:28:40.100196+0000","last_became_peered":"2021-10-08T19:28:40.100196+0000","last_unstale":"2021-10-08T19:34:25.787172+0000","last_undegraded":"2021-10-08T19:34:25.787172+0000","last_fullsized":"2021-10-08T19:34:25.787172+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:34:11.033685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:34:11.033685+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0073615640000000001,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":162,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.803850+0000","last_change":"2021-10-08T19:33:29.463878+0000","last_active":"2021-10-08T19:34:25.803850+0000","last_peered":"2021-10-08T19:34:25.803850+0000","last_clean":"2021-10-08T19:34:25.803850+0000","last_became_active":"2021-10-08T19:28:40.146673+0000","last_became_peered":"2021-10-08T19:28:40.146673+0000","last_unstale":"2021-10-08T19:34:25.803850+0000","last_undegraded":"2021-10-08T19:34:25.803850+0000","last_fullsized":"2021-10-08T19:34:25.803850+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:29.463767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:33:29.463767+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.020329192999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":172,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.804679+0000","last_change":"2021-10-08T19:32:38.465030+0000","last_active":"2021-10-08T19:34:25.804679+0000","last_peered":"2021-10-08T19:34:25.804679+0000","last_clean":"2021-10-08T19:34:25.804679+0000","last_became_active":"2021-10-08T19:29:40.638536+0000","last_became_peered":"2021-10-08T19:29:40.638536+0000","last_unstale":"2021-10-08T19:34:25.804679+0000","last_undegraded":"2021-10-08T19:34:25.804679+0000","last_fullsized":"2021-10-08T19:34:25.804679+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:38.464962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:43.186684+0000","last_clean_scrub_stamp":"2021-10-08T19:32:38.464962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0013247059999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":121,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.808040+0000","last_change":"2021-10-08T19:32:15.476992+0000","last_active":"2021-10-08T19:34:25.808040+0000","last_peered":"2021-10-08T19:34:25.808040+0000","last_clean":"2021-10-08T19:34:25.808040+0000","last_became_active":"2021-10-08T19:29:40.634300+0000","last_became_peered":"2021-10-08T19:29:40.634300+0000","last_unstale":"2021-10-08T19:34:25.808040+0000","last_undegraded":"2021-10-08T19:34:25.808040+0000","last_fullsized":"2021-10-08T19:34:25.808040+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:15.476868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:32:15.476868+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.021548916000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"70'5","reported_seq":231,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.787642+0000","last_change":"2021-10-08T19:34:03.061411+0000","last_active":"2021-10-08T19:34:25.787642+0000","last_peered":"2021-10-08T19:34:25.787642+0000","last_clean":"2021-10-08T19:34:25.787642+0000","last_became_active":"2021-10-08T19:25:15.496309+0000","last_became_peered":"2021-10-08T19:25:15.496309+0000","last_unstale":"2021-10-08T19:34:25.787642+0000","last_undegraded":"2021-10-08T19:34:25.787642+0000","last_fullsized":"2021-10-08T19:34:25.787642+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:34:03.061301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:03.061301+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0077145800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.10","version":"289'8","reported_seq":150,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.800077+0000","last_change":"2021-10-08T19:32:45.349635+0000","last_active":"2021-10-08T19:34:25.800077+0000","last_peered":"2021-10-08T19:34:25.800077+0000","last_clean":"2021-10-08T19:34:25.800077+0000","last_became_active":"2021-10-08T19:32:45.165103+0000","last_became_peered":"2021-10-08T19:32:45.165103+0000","last_unstale":"2021-10-08T19:34:25.800077+0000","last_undegraded":"2021-10-08T19:34:25.800077+0000","last_fullsized":"2021-10-08T19:34:25.800077+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'8","last_scrub_stamp":"2021-10-08T19:32:34.689691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:32:34.689691+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0041717799999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":324,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.779363+0000","last_change":"2021-10-08T19:31:27.832981+0000","last_active":"2021-10-08T19:34:24.779363+0000","last_peered":"2021-10-08T19:34:24.779363+0000","last_clean":"2021-10-08T19:34:24.779363+0000","last_became_active":"2021-10-08T19:24:25.094384+0000","last_became_peered":"2021-10-08T19:24:25.094384+0000","last_unstale":"2021-10-08T19:34:24.779363+0000","last_undegraded":"2021-10-08T19:34:24.779363+0000","last_fullsized":"2021-10-08T19:34:24.779363+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:27.832886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:13.716331+0000","last_clean_scrub_stamp":"2021-10-08T19:31:27.832886+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034204959999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":264,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.781083+0000","last_change":"2021-10-08T19:34:18.377860+0000","last_active":"2021-10-08T19:34:24.781083+0000","last_peered":"2021-10-08T19:34:24.781083+0000","last_clean":"2021-10-08T19:34:24.781083+0000","last_became_active":"2021-10-08T19:24:25.106186+0000","last_became_peered":"2021-10-08T19:24:25.106186+0000","last_unstale":"2021-10-08T19:34:24.781083+0000","last_undegraded":"2021-10-08T19:34:24.781083+0000","last_fullsized":"2021-10-08T19:34:24.781083+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:18.377739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:18.377739+0000","last_clean_scrub_stamp":"2021-10-08T19:34:18.377739+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0082105919999999992,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":309,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.787040+0000","last_change":"2021-10-08T19:33:18.992912+0000","last_active":"2021-10-08T19:34:24.787040+0000","last_peered":"2021-10-08T19:34:24.787040+0000","last_clean":"2021-10-08T19:34:24.787040+0000","last_became_active":"2021-10-08T19:21:29.642835+0000","last_became_peered":"2021-10-08T19:21:29.642835+0000","last_unstale":"2021-10-08T19:34:24.787040+0000","last_undegraded":"2021-10-08T19:34:24.787040+0000","last_fullsized":"2021-10-08T19:34:24.787040+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:18.992806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:33:18.992806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0058345690000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":242,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.778657+0000","last_change":"2021-10-08T19:32:05.845506+0000","last_active":"2021-10-08T19:34:24.778657+0000","last_peered":"2021-10-08T19:34:24.778657+0000","last_clean":"2021-10-08T19:34:24.778657+0000","last_became_active":"2021-10-08T19:28:40.099215+0000","last_became_peered":"2021-10-08T19:28:40.099215+0000","last_unstale":"2021-10-08T19:34:24.778657+0000","last_undegraded":"2021-10-08T19:34:24.778657+0000","last_fullsized":"2021-10-08T19:34:24.778657+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:05.845412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:05.845412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.00772998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"289'19","reported_seq":145,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.807769+0000","last_change":"2021-10-08T19:31:23.525281+0000","last_active":"2021-10-08T19:34:25.807769+0000","last_peered":"2021-10-08T19:34:25.807769+0000","last_clean":"2021-10-08T19:34:25.807769+0000","last_became_active":"2021-10-08T19:29:40.640914+0000","last_became_peered":"2021-10-08T19:29:40.640914+0000","last_unstale":"2021-10-08T19:34:25.807769+0000","last_undegraded":"2021-10-08T19:34:25.807769+0000","last_fullsized":"2021-10-08T19:34:25.807769+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'11","last_scrub_stamp":"2021-10-08T19:31:23.525209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:31:23.525209+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039841909999999998,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":255,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.780768+0000","last_change":"2021-10-08T19:33:14.901012+0000","last_active":"2021-10-08T19:34:24.780768+0000","last_peered":"2021-10-08T19:34:24.780768+0000","last_clean":"2021-10-08T19:34:24.780768+0000","last_became_active":"2021-10-08T19:24:25.098128+0000","last_became_peered":"2021-10-08T19:24:25.098128+0000","last_unstale":"2021-10-08T19:34:24.780768+0000","last_undegraded":"2021-10-08T19:34:24.780768+0000","last_fullsized":"2021-10-08T19:34:24.780768+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:14.900916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:34.508558+0000","last_clean_scrub_stamp":"2021-10-08T19:33:14.900916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0050012340000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":321,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.777400+0000","last_change":"2021-10-08T19:32:35.080957+0000","last_active":"2021-10-08T19:34:24.777400+0000","last_peered":"2021-10-08T19:34:24.777400+0000","last_clean":"2021-10-08T19:34:24.777400+0000","last_became_active":"2021-10-08T19:24:25.095490+0000","last_became_peered":"2021-10-08T19:24:25.095490+0000","last_unstale":"2021-10-08T19:34:24.777400+0000","last_undegraded":"2021-10-08T19:34:24.777400+0000","last_fullsized":"2021-10-08T19:34:24.777400+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:35.080865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:11.383779+0000","last_clean_scrub_stamp":"2021-10-08T19:32:35.080865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.01018439,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":127,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.807768+0000","last_change":"2021-10-08T19:33:31.003550+0000","last_active":"2021-10-08T19:34:25.807768+0000","last_peered":"2021-10-08T19:34:25.807768+0000","last_clean":"2021-10-08T19:34:25.807768+0000","last_became_active":"2021-10-08T19:29:40.639358+0000","last_became_peered":"2021-10-08T19:29:40.639358+0000","last_unstale":"2021-10-08T19:34:25.807768+0000","last_undegraded":"2021-10-08T19:34:25.807768+0000","last_fullsized":"2021-10-08T19:34:25.807768+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:31.003458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:33:31.003458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.053588330000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"289'20","reported_seq":386,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.801420+0000","last_change":"2021-10-08T19:34:12.001980+0000","last_active":"2021-10-08T19:34:25.801420+0000","last_peered":"2021-10-08T19:34:25.801420+0000","last_clean":"2021-10-08T19:34:25.801420+0000","last_became_active":"2021-10-08T19:29:40.636448+0000","last_became_peered":"2021-10-08T19:29:40.636448+0000","last_unstale":"2021-10-08T19:34:25.801420+0000","last_undegraded":"2021-10-08T19:34:25.801420+0000","last_fullsized":"2021-10-08T19:34:25.801420+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'20","last_scrub_stamp":"2021-10-08T19:34:12.001875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:34:12.001875+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0097733339999999998,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":306,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.778325+0000","last_change":"2021-10-08T19:32:44.776643+0000","last_active":"2021-10-08T19:34:24.778325+0000","last_peered":"2021-10-08T19:34:24.778325+0000","last_clean":"2021-10-08T19:34:24.778325+0000","last_became_active":"2021-10-08T19:21:23.604530+0000","last_became_peered":"2021-10-08T19:21:23.604530+0000","last_unstale":"2021-10-08T19:34:24.778325+0000","last_undegraded":"2021-10-08T19:34:24.778325+0000","last_fullsized":"2021-10-08T19:34:24.778325+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:44.776567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:44.776567+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0068263819999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1f","version":"114'10","reported_seq":374,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.812780+0000","last_change":"2021-10-08T19:32:38.829487+0000","last_active":"2021-10-08T19:34:25.812780+0000","last_peered":"2021-10-08T19:34:25.812780+0000","last_clean":"2021-10-08T19:34:25.812780+0000","last_became_active":"2021-10-08T19:24:25.105742+0000","last_became_peered":"2021-10-08T19:24:25.105742+0000","last_unstale":"2021-10-08T19:34:25.812780+0000","last_undegraded":"2021-10-08T19:34:25.812780+0000","last_fullsized":"2021-10-08T19:34:25.812780+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'10","last_scrub_stamp":"2021-10-08T19:32:38.829395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:32:38.829395+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0081928529999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"69'1","reported_seq":302,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.782176+0000","last_change":"2021-10-08T19:31:36.328498+0000","last_active":"2021-10-08T19:34:24.782176+0000","last_peered":"2021-10-08T19:34:24.782176+0000","last_clean":"2021-10-08T19:34:24.782176+0000","last_became_active":"2021-10-08T19:21:29.640296+0000","last_became_peered":"2021-10-08T19:21:29.640296+0000","last_unstale":"2021-10-08T19:34:24.782176+0000","last_undegraded":"2021-10-08T19:34:24.782176+0000","last_fullsized":"2021-10-08T19:34:24.782176+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2021-10-08T19:31:36.328401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:31:36.328401+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040870780000000001,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"289'19","reported_seq":321,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.781036+0000","last_change":"2021-10-08T19:33:19.899016+0000","last_active":"2021-10-08T19:34:24.781036+0000","last_peered":"2021-10-08T19:34:24.781036+0000","last_clean":"2021-10-08T19:34:24.781036+0000","last_became_active":"2021-10-08T19:28:40.126425+0000","last_became_peered":"2021-10-08T19:28:40.126425+0000","last_unstale":"2021-10-08T19:34:24.781036+0000","last_undegraded":"2021-10-08T19:34:24.781036+0000","last_fullsized":"2021-10-08T19:34:24.781036+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:33:19.898917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:33:19.898917+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0085652420000000007,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":127,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.807556+0000","last_change":"2021-10-08T19:34:13.102972+0000","last_active":"2021-10-08T19:34:25.807556+0000","last_peered":"2021-10-08T19:34:25.807556+0000","last_clean":"2021-10-08T19:34:25.807556+0000","last_became_active":"2021-10-08T19:29:40.640952+0000","last_became_peered":"2021-10-08T19:29:40.640952+0000","last_unstale":"2021-10-08T19:34:25.807556+0000","last_undegraded":"2021-10-08T19:34:25.807556+0000","last_fullsized":"2021-10-08T19:34:25.807556+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:13.102869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:13.102869+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0080406309999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":310,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.801414+0000","last_change":"2021-10-08T19:33:19.099040+0000","last_active":"2021-10-08T19:34:25.801414+0000","last_peered":"2021-10-08T19:34:25.801414+0000","last_clean":"2021-10-08T19:34:25.801414+0000","last_became_active":"2021-10-08T19:21:27.632648+0000","last_became_peered":"2021-10-08T19:21:27.632648+0000","last_unstale":"2021-10-08T19:34:25.801414+0000","last_undegraded":"2021-10-08T19:34:25.801414+0000","last_fullsized":"2021-10-08T19:34:25.801414+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:19.098920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:33:19.098920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002952966,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"69'1","reported_seq":158,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.803931+0000","last_change":"2021-10-08T19:32:43.588347+0000","last_active":"2021-10-08T19:34:25.803931+0000","last_peered":"2021-10-08T19:34:25.803931+0000","last_clean":"2021-10-08T19:34:25.803931+0000","last_became_active":"2021-10-08T19:28:40.146302+0000","last_became_peered":"2021-10-08T19:28:40.146302+0000","last_unstale":"2021-10-08T19:34:25.803931+0000","last_undegraded":"2021-10-08T19:34:25.803931+0000","last_fullsized":"2021-10-08T19:34:25.803931+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2021-10-08T19:32:43.588271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:32:43.588271+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.074694546000000001,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"289'27","reported_seq":479,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.777032+0000","last_change":"2021-10-08T19:33:30.412016+0000","last_active":"2021-10-08T19:34:24.777032+0000","last_peered":"2021-10-08T19:34:24.777032+0000","last_clean":"2021-10-08T19:34:24.777032+0000","last_became_active":"2021-10-08T19:29:40.629461+0000","last_became_peered":"2021-10-08T19:29:40.629461+0000","last_unstale":"2021-10-08T19:34:24.777032+0000","last_undegraded":"2021-10-08T19:34:24.777032+0000","last_fullsized":"2021-10-08T19:34:24.777032+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'27","last_scrub_stamp":"2021-10-08T19:33:30.411911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:33:30.411911+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0070106459999999997,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":550,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":263,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.779843+0000","last_change":"2021-10-08T19:34:22.343729+0000","last_active":"2021-10-08T19:34:24.779843+0000","last_peered":"2021-10-08T19:34:24.779843+0000","last_clean":"2021-10-08T19:34:24.779843+0000","last_became_active":"2021-10-08T19:24:25.106119+0000","last_became_peered":"2021-10-08T19:24:25.106119+0000","last_unstale":"2021-10-08T19:34:24.779843+0000","last_undegraded":"2021-10-08T19:34:24.779843+0000","last_fullsized":"2021-10-08T19:34:24.779843+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:22.343621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:46.422866+0000","last_clean_scrub_stamp":"2021-10-08T19:34:22.343621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0027685370000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":154,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.804013+0000","last_change":"2021-10-08T19:32:10.735314+0000","last_active":"2021-10-08T19:34:25.804013+0000","last_peered":"2021-10-08T19:34:25.804013+0000","last_clean":"2021-10-08T19:34:25.804013+0000","last_became_active":"2021-10-08T19:28:40.148009+0000","last_became_peered":"2021-10-08T19:28:40.148009+0000","last_unstale":"2021-10-08T19:34:25.804013+0000","last_undegraded":"2021-10-08T19:34:25.804013+0000","last_fullsized":"2021-10-08T19:34:25.804013+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:10.735237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:32:10.735237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0071591729999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":319,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.788026+0000","last_change":"2021-10-08T19:32:40.398092+0000","last_active":"2021-10-08T19:34:25.788026+0000","last_peered":"2021-10-08T19:34:25.788026+0000","last_clean":"2021-10-08T19:34:25.788026+0000","last_became_active":"2021-10-08T19:24:25.097782+0000","last_became_peered":"2021-10-08T19:24:25.097782+0000","last_unstale":"2021-10-08T19:34:25.788026+0000","last_undegraded":"2021-10-08T19:34:25.788026+0000","last_fullsized":"2021-10-08T19:34:25.788026+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:40.397976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:37.219503+0000","last_clean_scrub_stamp":"2021-10-08T19:32:40.397976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039828600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"289'18","reported_seq":148,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.806708+0000","last_change":"2021-10-08T19:33:26.859021+0000","last_active":"2021-10-08T19:34:25.806708+0000","last_peered":"2021-10-08T19:34:25.806708+0000","last_clean":"2021-10-08T19:34:25.806708+0000","last_became_active":"2021-10-08T19:29:40.645144+0000","last_became_peered":"2021-10-08T19:29:40.645144+0000","last_unstale":"2021-10-08T19:34:25.806708+0000","last_undegraded":"2021-10-08T19:34:25.806708+0000","last_fullsized":"2021-10-08T19:34:25.806708+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'18","last_scrub_stamp":"2021-10-08T19:33:26.858913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:33:26.858913+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012581844999999999,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":25,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":121,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.807527+0000","last_change":"2021-10-08T19:32:13.456918+0000","last_active":"2021-10-08T19:34:25.807527+0000","last_peered":"2021-10-08T19:34:25.807527+0000","last_clean":"2021-10-08T19:34:25.807527+0000","last_became_active":"2021-10-08T19:29:44.443807+0000","last_became_peered":"2021-10-08T19:29:44.443807+0000","last_unstale":"2021-10-08T19:34:25.807527+0000","last_undegraded":"2021-10-08T19:34:25.807527+0000","last_fullsized":"2021-10-08T19:34:25.807527+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:13.456818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:32:13.456818+0000","last_clean_scrub_stamp":"2021-10-08T19:32:13.456818+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013599351000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":321,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.787543+0000","last_change":"2021-10-08T19:31:59.409211+0000","last_active":"2021-10-08T19:34:25.787543+0000","last_peered":"2021-10-08T19:34:25.787543+0000","last_clean":"2021-10-08T19:34:25.787543+0000","last_became_active":"2021-10-08T19:29:40.638352+0000","last_became_peered":"2021-10-08T19:29:40.638352+0000","last_unstale":"2021-10-08T19:34:25.787543+0000","last_undegraded":"2021-10-08T19:34:25.787543+0000","last_fullsized":"2021-10-08T19:34:25.787543+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:59.409131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:31:59.409131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0098736889999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":139,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.807052+0000","last_change":"2021-10-08T19:32:12.549448+0000","last_active":"2021-10-08T19:34:25.807052+0000","last_peered":"2021-10-08T19:34:25.807052+0000","last_clean":"2021-10-08T19:34:25.807052+0000","last_became_active":"2021-10-08T19:31:22.788455+0000","last_became_peered":"2021-10-08T19:31:22.788455+0000","last_unstale":"2021-10-08T19:34:25.807052+0000","last_undegraded":"2021-10-08T19:34:25.807052+0000","last_fullsized":"2021-10-08T19:34:25.807052+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:12.549351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:32:12.549351+0000","last_clean_scrub_stamp":"2021-10-08T19:32:12.549351+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.087121061999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"289'15","reported_seq":370,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.786791+0000","last_change":"2021-10-08T19:34:09.072669+0000","last_active":"2021-10-08T19:34:25.786791+0000","last_peered":"2021-10-08T19:34:25.786791+0000","last_clean":"2021-10-08T19:34:25.786791+0000","last_became_active":"2021-10-08T19:29:40.631689+0000","last_became_peered":"2021-10-08T19:29:40.631689+0000","last_unstale":"2021-10-08T19:34:25.786791+0000","last_undegraded":"2021-10-08T19:34:25.786791+0000","last_fullsized":"2021-10-08T19:34:25.786791+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'15","last_scrub_stamp":"2021-10-08T19:34:09.072548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:34:09.072548+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.01071632,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":317,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.781767+0000","last_change":"2021-10-08T19:34:15.628608+0000","last_active":"2021-10-08T19:34:24.781767+0000","last_peered":"2021-10-08T19:34:24.781767+0000","last_clean":"2021-10-08T19:34:24.781767+0000","last_became_active":"2021-10-08T19:21:23.607785+0000","last_became_peered":"2021-10-08T19:21:23.607785+0000","last_unstale":"2021-10-08T19:34:24.781767+0000","last_undegraded":"2021-10-08T19:34:24.781767+0000","last_fullsized":"2021-10-08T19:34:24.781767+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:15.628516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:15.628516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0075668530000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":302,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.780095+0000","last_change":"2021-10-08T19:32:11.832450+0000","last_active":"2021-10-08T19:34:24.780095+0000","last_peered":"2021-10-08T19:34:24.780095+0000","last_clean":"2021-10-08T19:34:24.780095+0000","last_became_active":"2021-10-08T19:21:27.633979+0000","last_became_peered":"2021-10-08T19:21:27.633979+0000","last_unstale":"2021-10-08T19:34:24.780095+0000","last_undegraded":"2021-10-08T19:34:24.780095+0000","last_fullsized":"2021-10-08T19:34:24.780095+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:11.832343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:05.799361+0000","last_clean_scrub_stamp":"2021-10-08T19:32:11.832343+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0049579899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":324,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.803147+0000","last_change":"2021-10-08T19:32:43.041993+0000","last_active":"2021-10-08T19:34:25.803147+0000","last_peered":"2021-10-08T19:34:25.803147+0000","last_clean":"2021-10-08T19:34:25.803147+0000","last_became_active":"2021-10-08T19:28:40.159162+0000","last_became_peered":"2021-10-08T19:28:40.159162+0000","last_unstale":"2021-10-08T19:34:25.803147+0000","last_undegraded":"2021-10-08T19:34:25.803147+0000","last_fullsized":"2021-10-08T19:34:25.803147+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:43.041874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:32:43.041874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.039844900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"289'7","reported_seq":401,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.787336+0000","last_change":"2021-10-08T19:34:14.978409+0000","last_active":"2021-10-08T19:34:25.787336+0000","last_peered":"2021-10-08T19:34:25.787336+0000","last_clean":"2021-10-08T19:34:25.787336+0000","last_became_active":"2021-10-08T19:31:51.675189+0000","last_became_peered":"2021-10-08T19:31:51.675189+0000","last_unstale":"2021-10-08T19:34:25.787336+0000","last_undegraded":"2021-10-08T19:34:25.787336+0000","last_fullsized":"2021-10-08T19:34:25.787336+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'7","last_scrub_stamp":"2021-10-08T19:34:14.978294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:34:14.978294+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.015468765000000001,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":10,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":333,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.783054+0000","last_change":"2021-10-08T19:32:46.108417+0000","last_active":"2021-10-08T19:34:24.783054+0000","last_peered":"2021-10-08T19:34:24.783054+0000","last_clean":"2021-10-08T19:34:24.783054+0000","last_became_active":"2021-10-08T19:24:25.096225+0000","last_became_peered":"2021-10-08T19:24:25.096225+0000","last_unstale":"2021-10-08T19:34:24.783054+0000","last_undegraded":"2021-10-08T19:34:24.783054+0000","last_fullsized":"2021-10-08T19:34:24.783054+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:46.108322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:29:40.244757+0000","last_clean_scrub_stamp":"2021-10-08T19:32:46.108322+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002015986,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":331,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.784512+0000","last_change":"2021-10-08T19:34:11.633837+0000","last_active":"2021-10-08T19:34:24.784512+0000","last_peered":"2021-10-08T19:34:24.784512+0000","last_clean":"2021-10-08T19:34:24.784512+0000","last_became_active":"2021-10-08T19:28:40.101187+0000","last_became_peered":"2021-10-08T19:28:40.101187+0000","last_unstale":"2021-10-08T19:34:24.784512+0000","last_undegraded":"2021-10-08T19:34:24.784512+0000","last_fullsized":"2021-10-08T19:34:24.784512+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:11.633739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:11.633739+0000","last_clean_scrub_stamp":"2021-10-08T19:34:11.633739+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0065073010000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":336,"reported_epoch":340,"state":"active+clean","last_fresh":"2021-10-08T19:34:24.778891+0000","last_change":"2021-10-08T19:32:48.773228+0000","last_active":"2021-10-08T19:34:24.778891+0000","last_peered":"2021-10-08T19:34:24.778891+0000","last_clean":"2021-10-08T19:34:24.778891+0000","last_became_active":"2021-10-08T19:29:40.632965+0000","last_became_peered":"2021-10-08T19:29:40.632965+0000","last_unstale":"2021-10-08T19:34:24.778891+0000","last_undegraded":"2021-10-08T19:34:24.778891+0000","last_fullsized":"2021-10-08T19:34:24.778891+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:48.773123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:32:48.773123+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.031438125999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"289'19","reported_seq":444,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.786557+0000","last_change":"2021-10-08T19:31:22.251853+0000","last_active":"2021-10-08T19:34:25.786557+0000","last_peered":"2021-10-08T19:34:25.786557+0000","last_clean":"2021-10-08T19:34:25.786557+0000","last_became_active":"2021-10-08T19:28:40.099770+0000","last_became_peered":"2021-10-08T19:28:40.099770+0000","last_unstale":"2021-10-08T19:34:25.786557+0000","last_undegraded":"2021-10-08T19:34:25.786557+0000","last_fullsized":"2021-10-08T19:34:25.786557+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'13","last_scrub_stamp":"2021-10-08T19:31:22.251742+0000","last_deep_scrub":"88'13","last_deep_scrub_stamp":"2021-10-08T19:23:16.016646+0000","last_clean_scrub_stamp":"2021-10-08T19:31:22.251742+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039856270000000003,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":127,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.806817+0000","last_change":"2021-10-08T19:34:04.124983+0000","last_active":"2021-10-08T19:34:25.806817+0000","last_peered":"2021-10-08T19:34:25.806817+0000","last_clean":"2021-10-08T19:34:25.806817+0000","last_became_active":"2021-10-08T19:29:40.627394+0000","last_became_peered":"2021-10-08T19:29:40.627394+0000","last_unstale":"2021-10-08T19:34:25.806817+0000","last_undegraded":"2021-10-08T19:34:25.806817+0000","last_fullsized":"2021-10-08T19:34:25.806817+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:04.124886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:04.124886+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0093513629999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":154,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.803456+0000","last_change":"2021-10-08T19:32:09.778928+0000","last_active":"2021-10-08T19:34:25.803456+0000","last_peered":"2021-10-08T19:34:25.803456+0000","last_clean":"2021-10-08T19:34:25.803456+0000","last_became_active":"2021-10-08T19:28:40.145868+0000","last_became_peered":"2021-10-08T19:28:40.145868+0000","last_unstale":"2021-10-08T19:34:25.803456+0000","last_undegraded":"2021-10-08T19:34:25.803456+0000","last_fullsized":"2021-10-08T19:34:25.803456+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:09.778832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:32:09.778832+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010192680000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":321,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.786739+0000","last_change":"2021-10-08T19:33:27.280376+0000","last_active":"2021-10-08T19:34:25.786739+0000","last_peered":"2021-10-08T19:34:25.786739+0000","last_clean":"2021-10-08T19:34:25.786739+0000","last_became_active":"2021-10-08T19:28:40.099543+0000","last_became_peered":"2021-10-08T19:28:40.099543+0000","last_unstale":"2021-10-08T19:34:25.786739+0000","last_undegraded":"2021-10-08T19:34:25.786739+0000","last_fullsized":"2021-10-08T19:34:25.786739+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:27.280257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:50.032367+0000","last_clean_scrub_stamp":"2021-10-08T19:33:27.280257+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.023013090999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"289'27","reported_seq":155,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.807638+0000","last_change":"2021-10-08T19:31:31.454233+0000","last_active":"2021-10-08T19:34:25.807638+0000","last_peered":"2021-10-08T19:34:25.807638+0000","last_clean":"2021-10-08T19:34:25.807638+0000","last_became_active":"2021-10-08T19:29:40.631002+0000","last_became_peered":"2021-10-08T19:29:40.631002+0000","last_unstale":"2021-10-08T19:34:25.807638+0000","last_undegraded":"2021-10-08T19:34:25.807638+0000","last_fullsized":"2021-10-08T19:34:25.807638+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'15","last_scrub_stamp":"2021-10-08T19:31:31.454160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:31:31.454160+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0041423509999999998,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":308,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.801550+0000","last_change":"2021-10-08T19:32:14.367390+0000","last_active":"2021-10-08T19:34:25.801550+0000","last_peered":"2021-10-08T19:34:25.801550+0000","last_clean":"2021-10-08T19:34:25.801550+0000","last_became_active":"2021-10-08T19:21:23.603422+0000","last_became_peered":"2021-10-08T19:21:23.603422+0000","last_unstale":"2021-10-08T19:34:25.801550+0000","last_undegraded":"2021-10-08T19:34:25.801550+0000","last_fullsized":"2021-10-08T19:34:25.801550+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:14.367284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:15.535842+0000","last_clean_scrub_stamp":"2021-10-08T19:32:14.367284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0022503430000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":347,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.786660+0000","last_change":"2021-10-08T19:34:08.021043+0000","last_active":"2021-10-08T19:34:25.786660+0000","last_peered":"2021-10-08T19:34:25.786660+0000","last_clean":"2021-10-08T19:34:25.786660+0000","last_became_active":"2021-10-08T19:28:40.099286+0000","last_became_peered":"2021-10-08T19:28:40.099286+0000","last_unstale":"2021-10-08T19:34:25.786660+0000","last_undegraded":"2021-10-08T19:34:25.786660+0000","last_fullsized":"2021-10-08T19:34:25.786660+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:08.020934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:31.176160+0000","last_clean_scrub_stamp":"2021-10-08T19:34:08.020934+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0064825229999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":121,"reported_epoch":341,"state":"active+clean","last_fresh":"2021-10-08T19:34:25.807687+0000","last_change":"2021-10-08T19:31:32.458220+0000","last_active":"2021-10-08T19:34:25.807687+0000","last_peered":"2021-10-08T19:34:25.807687+0000","last_clean":"2021-10-08T19:34:25.807687+0000","last_became_active":"2021-10-08T19:29:40.638221+0000","last_became_peered":"2021-10-08T19:29:40.638221+0000","last_unstale":"2021-10-08T19:34:25.807687+0000","last_undegraded":"2021-10-08T19:34:25.807687+0000","last_fullsized":"2021-10-08T19:34:25.807687+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.458082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.458082+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.045433947000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":2096431128,"num_objects":31990,"num_object_clones":0,"num_object_copies":95970,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31990,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":199388,"num_write_kb":7404033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1088,"num_bytes_recovered":71303168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6285570048,"data_stored":6285557832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":69149,"ondisk_log_size":69149,"up":48,"acting":48,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":11,"stat_sum":{"num_bytes":381350,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":28,"num_write":16,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":686385,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1430,"ondisk_log_size":1430,"up":33,"acting":33,"num_store_stats":8},{"poolid":3,"num_pg":23,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":606,"num_read_kb":606,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1167,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":69,"acting":69,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1113,"num_read_kb":870,"num_write":703,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":520,"num_bytes_recovered":10826,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":700,"ondisk_log_size":700,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":96,"acting":96,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201441,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1419820,"kb_used_data":1200420,"kb_used_omap":0,"kb_used_meta":219328,"kb_avail":92325332,"statfs":{"total":95995035648,"available":94541139968,"internally_reserved":0,"allocated":1229230080,"data_stored":1228824931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224591872},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,4],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:33:31 2021","interfaces":[{"interface":"back","average":{"1min":1.8,"5min":1.5620000000000001,"15min":1.2749999999999999},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20100000000000001},"max":{"1min":6.4699999999999998,"5min":26.065000000000001,"15min":32.366999999999997},"last":1.8939999999999999},{"interface":"front","average":{"1min":2.9369999999999998,"5min":1.9039999999999999,"15min":1.4830000000000001},"min":{"1min":0.26000000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":17.018999999999998,"5min":25.75,"15min":29.736000000000001},"last":3.9849999999999999}]},{"osd":1,"last update":"Fri Oct 8 19:33:31 2021","interfaces":[{"interface":"back","average":{"1min":2.0129999999999999,"5min":2.044,"15min":1.5349999999999999},"min":{"1min":0.23400000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":6.7699999999999996,"5min":26.044,"15min":26.044},"last":4.5979999999999999},{"interface":"front","average":{"1min":3.004,"5min":2.4809999999999999,"15min":1.391},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":17.056000000000001,"5min":28.119,"15min":28.119},"last":3.9630000000000001}]},{"osd":2,"last update":"Fri Oct 8 19:33:31 2021","interfaces":[{"interface":"back","average":{"1min":1.6759999999999999,"5min":1.5760000000000001,"15min":1.417},"min":{"1min":0.27700000000000002,"5min":0.26300000000000001,"15min":0.26100000000000001},"max":{"1min":4.8769999999999998,"5min":7.524,"15min":27.018000000000001},"last":3.1379999999999999},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.4339999999999999,"15min":1.3129999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.27800000000000002},"max":{"1min":5.0899999999999999,"5min":8.2870000000000008,"15min":27.113},"last":2.331}]},{"osd":3,"last update":"Fri Oct 8 19:33:31 2021","interfaces":[{"interface":"back","average":{"1min":2.1230000000000002,"5min":2.722,"15min":1.849},"min":{"1min":0.311,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":6.0380000000000003,"5min":72.093999999999994,"15min":72.093999999999994},"last":0.35499999999999998},{"interface":"front","average":{"1min":3.407,"5min":2.8820000000000001,"15min":1.8540000000000001},"min":{"1min":0.34499999999999997,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":17.103999999999999,"5min":71.864999999999995,"15min":71.864999999999995},"last":3.8999999999999999}]},{"osd":4,"last update":"Fri Oct 8 19:33:31 2021","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":0.98799999999999999,"15min":0.75},"min":{"1min":0.249,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":8.391,"5min":8.391,"15min":8.391},"last":1.9610000000000001},{"interface":"front","average":{"1min":1.6950000000000001,"5min":1.1870000000000001,"15min":0.76700000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":5.7089999999999996,"5min":9.0820000000000007,"15min":9.0820000000000007},"last":1.4279999999999999}]},{"osd":5,"last update":"Fri Oct 8 19:33:31 2021","interfaces":[{"interface":"back","average":{"1min":1.637,"5min":1.3069999999999999,"15min":0.876},"min":{"1min":0.28000000000000003,"5min":0.26800000000000002,"15min":0.251},"max":{"1min":6.5389999999999997,"5min":9.9280000000000008,"15min":9.9280000000000008},"last":1.9359999999999999},{"interface":"front","average":{"1min":2.0529999999999999,"5min":1.3680000000000001,"15min":0.82699999999999996},"min":{"1min":0.30199999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":16.093,"5min":18.655000000000001,"15min":18.655000000000001},"last":0.56599999999999995}]},{"osd":6,"last update":"Fri Oct 8 19:33:31 2021","interfaces":[{"interface":"back","average":{"1min":2.4289999999999998,"5min":1.3400000000000001,"15min":0.90400000000000003},"min":{"1min":0.318,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":17.082000000000001,"5min":17.082000000000001,"15min":17.082000000000001},"last":3.9359999999999999},{"interface":"front","average":{"1min":1.341,"5min":1.0640000000000001,"15min":0.85799999999999998},"min":{"1min":0.33700000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":4.6699999999999999,"5min":7.742,"15min":7.742},"last":1.9179999999999999}]}]},{"osd":6,"up_from":47,"seq":201863463077,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":572048,"kb_used_data":393800,"kb_used_omap":0,"kb_used_meta":178176,"kb_avail":93173104,"statfs":{"total":95995035648,"available":95409258496,"internally_reserved":0,"allocated":403251200,"data_stored":402873176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":182452224},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:34:15 2021","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":0.98499999999999999,"15min":1.151},"min":{"1min":0.224,"5min":0.20899999999999999,"15min":0.20100000000000001},"max":{"1min":5.194,"5min":5.194,"15min":28.382999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":1.548,"5min":1.6519999999999999,"15min":1.649},"min":{"1min":0.25900000000000001,"5min":0.22600000000000001,"15min":0.21299999999999999},"max":{"1min":8.3300000000000001,"5min":15.458,"15min":69.477000000000004},"last":0.503}]},{"osd":1,"last update":"Fri Oct 8 19:34:15 2021","interfaces":[{"interface":"back","average":{"1min":1.861,"5min":1.385,"15min":1.0640000000000001},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.23000000000000001},"max":{"1min":5.0579999999999998,"5min":5.4809999999999999,"15min":14.878},"last":0.48299999999999998},{"interface":"front","average":{"1min":1.7589999999999999,"5min":1.452,"15min":1.119},"min":{"1min":0.28999999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":5.0880000000000001,"5min":7.4189999999999996,"15min":14.779},"last":0.49299999999999999}]},{"osd":2,"last update":"Fri Oct 8 19:34:15 2021","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.252,"15min":1.508},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.251},"max":{"1min":5.1269999999999998,"5min":6.7960000000000003,"15min":69.322999999999993},"last":0.51800000000000002},{"interface":"front","average":{"1min":2.0670000000000002,"5min":1.7709999999999999,"15min":1.6779999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.245},"max":{"1min":8.3710000000000004,"5min":15.504,"15min":69.418999999999997},"last":0.46200000000000002}]},{"osd":3,"last update":"Fri Oct 8 19:34:15 2021","interfaces":[{"interface":"back","average":{"1min":1.8999999999999999,"5min":1.6040000000000001,"15min":1.3899999999999999},"min":{"1min":0.35399999999999998,"5min":0.307,"15min":0.27900000000000003},"max":{"1min":4.1020000000000003,"5min":7.2910000000000004,"15min":21.670000000000002},"last":0.51100000000000001},{"interface":"front","average":{"1min":1.359,"5min":1.335,"15min":1.216},"min":{"1min":0.34200000000000003,"5min":0.32600000000000001,"15min":0.28000000000000003},"max":{"1min":5.1740000000000004,"5min":8.3360000000000003,"15min":22.254999999999999},"last":0.442}]},{"osd":4,"last update":"Fri Oct 8 19:34:15 2021","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.3640000000000001,"15min":0.78600000000000003},"min":{"1min":0.29499999999999998,"5min":0.254,"15min":0.254},"max":{"1min":3.5129999999999999,"5min":24.516999999999999,"15min":24.516999999999999},"last":0.35999999999999999},{"interface":"front","average":{"1min":1.361,"5min":1.099,"15min":1.004},"min":{"1min":0.28599999999999998,"5min":0.27500000000000002,"15min":0.26100000000000001},"max":{"1min":4.0700000000000003,"5min":9.6890000000000001,"15min":69.593999999999994},"last":0.42499999999999999}]},{"osd":5,"last update":"Fri Oct 8 19:34:15 2021","interfaces":[{"interface":"back","average":{"1min":1.9259999999999999,"5min":2.0659999999999998,"15min":1.0580000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.28499999999999998},"max":{"1min":8.5760000000000005,"5min":48.545999999999999,"15min":48.545999999999999},"last":107.485},{"interface":"front","average":{"1min":1.649,"5min":1.8540000000000001,"15min":1.276},"min":{"1min":0.31,"5min":0.31,"15min":0.252},"max":{"1min":7.0309999999999997,"5min":46.003999999999998,"15min":69.561000000000007},"last":107.90300000000001}]},{"osd":7,"last update":"Fri Oct 8 19:33:38 2021","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.0820000000000001,"15min":0.745},"min":{"1min":0.36899999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":4.4470000000000001,"5min":5.5019999999999998,"15min":5.5019999999999998},"last":0.39000000000000001},{"interface":"front","average":{"1min":1.569,"5min":1.423,"15min":0.90500000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.313},"max":{"1min":4.3840000000000003,"5min":15.962,"15min":15.962},"last":0.40100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575032,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1439684,"kb_used_data":1167036,"kb_used_omap":0,"kb_used_meta":272640,"kb_avail":92305468,"statfs":{"total":95995035648,"available":94520799232,"internally_reserved":0,"allocated":1195044864,"data_stored":1194614434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":279183360},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,2,4],"upper_bound":128},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:33:53 2021","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":4.0640000000000001,"15min":2.8889999999999998},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.184},"max":{"1min":5.1479999999999997,"5min":126.256,"15min":126.256},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.7509999999999999,"5min":3.9020000000000001,"15min":3.109},"min":{"1min":0.22700000000000001,"5min":0.182,"15min":0.182},"max":{"1min":5.8250000000000002,"5min":126.176,"15min":126.176},"last":1.653}]},{"osd":2,"last update":"Fri Oct 8 19:34:13 2021","interfaces":[{"interface":"back","average":{"1min":1.423,"5min":2.5310000000000001,"15min":2.1819999999999999},"min":{"1min":0.20899999999999999,"5min":0.192,"15min":0.192},"max":{"1min":6.9530000000000003,"5min":102.395,"15min":102.395},"last":1.359},{"interface":"front","average":{"1min":1.234,"5min":3.1040000000000001,"15min":2.52},"min":{"1min":0.28899999999999998,"5min":0.23400000000000001,"15min":0.22700000000000001},"max":{"1min":2.7629999999999999,"5min":102.50700000000001,"15min":102.50700000000001},"last":1.5720000000000001}]},{"osd":3,"last update":"Fri Oct 8 19:33:29 2021","interfaces":[{"interface":"back","average":{"1min":4.0910000000000002,"5min":3.9039999999999999,"15min":2.6019999999999999},"min":{"1min":0.309,"5min":0.24399999999999999,"15min":0.23999999999999999},"max":{"1min":33.655000000000001,"5min":105.836,"15min":105.836},"last":1.631},{"interface":"front","average":{"1min":3.2349999999999999,"5min":3.9199999999999999,"15min":2.3900000000000001},"min":{"1min":0.33400000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":33.582999999999998,"5min":106.12,"15min":106.12},"last":2.2160000000000002}]},{"osd":4,"last update":"Fri Oct 8 19:33:41 2021","interfaces":[{"interface":"back","average":{"1min":1.554,"5min":2.5259999999999998,"15min":1.7589999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":4.3730000000000002,"5min":103.538,"15min":103.538},"last":0.44500000000000001},{"interface":"front","average":{"1min":1.3400000000000001,"5min":2.5049999999999999,"15min":1.4630000000000001},"min":{"1min":0.34599999999999997,"5min":0.254,"15min":0.254},"max":{"1min":5.125,"5min":102.67100000000001,"15min":102.67100000000001},"last":1.327}]},{"osd":5,"last update":"Fri Oct 8 19:34:06 2021","interfaces":[{"interface":"back","average":{"1min":1.4359999999999999,"5min":2.7440000000000002,"15min":1.8600000000000001},"min":{"1min":0.34100000000000003,"5min":0.33200000000000002,"15min":0.29899999999999999},"max":{"1min":6.1520000000000001,"5min":102.717,"15min":102.717},"last":1.595},{"interface":"front","average":{"1min":1.327,"5min":2.6499999999999999,"15min":1.55},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.29999999999999999},"max":{"1min":5.8120000000000003,"5min":102.617,"15min":102.617},"last":1.3799999999999999}]},{"osd":6,"last update":"Fri Oct 8 19:34:24 2021","interfaces":[{"interface":"back","average":{"1min":2.2250000000000001,"5min":2.7490000000000001,"15min":1.9059999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.26700000000000002},"max":{"1min":7.024,"5min":103.73,"15min":103.73},"last":0.47999999999999998},{"interface":"front","average":{"1min":1.028,"5min":2.774,"15min":1.917},"min":{"1min":0.377,"5min":0.35599999999999998,"15min":0.28399999999999997},"max":{"1min":2.5430000000000001,"5min":102.753,"15min":102.753},"last":1.5469999999999999}]},{"osd":7,"last update":"Fri Oct 8 19:33:41 2021","interfaces":[{"interface":"back","average":{"1min":1.671,"5min":4.0199999999999996,"15min":2.323},"min":{"1min":0.39900000000000002,"5min":0.36399999999999999,"15min":0.312},"max":{"1min":4.6639999999999997,"5min":106.011,"15min":106.011},"last":1.504},{"interface":"front","average":{"1min":1.675,"5min":3.8300000000000001,"15min":1.9419999999999999},"min":{"1min":0.45200000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":5.1749999999999998,"5min":103.78400000000001,"15min":103.78400000000001},"last":1.401}]}]},{"osd":0,"up_from":8,"seq":34359738555,"num_pgs":61,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":716784,"kb_used_data":509992,"kb_used_omap":0,"kb_used_meta":206784,"kb_avail":93028368,"statfs":{"total":95995035648,"available":95261048832,"internally_reserved":0,"allocated":522231808,"data_stored":521828341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":211746816},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,1,1,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 8 19:33:49 2021","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":2.8660000000000001,"15min":1.9410000000000001},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":4.2949999999999999,"5min":91.954999999999998,"15min":91.954999999999998},"last":6.4539999999999997},{"interface":"front","average":{"1min":2.8740000000000001,"5min":3.056,"15min":2.048},"min":{"1min":0.23699999999999999,"5min":0.219,"15min":0.217},"max":{"1min":11.113,"5min":91.046000000000006,"15min":91.046000000000006},"last":6.1189999999999998}]},{"osd":2,"last update":"Fri Oct 8 19:34:14 2021","interfaces":[{"interface":"back","average":{"1min":2.4849999999999999,"5min":1.893,"15min":1.905},"min":{"1min":0.248,"5min":0.22900000000000001,"15min":0.22700000000000001},"max":{"1min":9.6129999999999995,"5min":12.164999999999999,"15min":62.390000000000001},"last":0.33700000000000002},{"interface":"front","average":{"1min":2.157,"5min":1.8029999999999999,"15min":1.7869999999999999},"min":{"1min":0.219,"5min":0.20000000000000001,"15min":0.19500000000000001},"max":{"1min":6.8819999999999997,"5min":10.121,"15min":62.718000000000004},"last":2.8900000000000001}]},{"osd":3,"last update":"Fri Oct 8 19:33:33 2021","interfaces":[{"interface":"back","average":{"1min":2.5960000000000001,"5min":2.448,"15min":2.012},"min":{"1min":0.218,"5min":0.217,"15min":0.217},"max":{"1min":11.068,"5min":14.551,"15min":62.491},"last":0.371},{"interface":"front","average":{"1min":1.5820000000000001,"5min":2.3079999999999998,"15min":1.806},"min":{"1min":0.28899999999999998,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":7,"5min":22.016999999999999,"15min":62.673000000000002},"last":3.0819999999999999}]},{"osd":4,"last update":"Fri Oct 8 19:33:49 2021","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.7529999999999999,"15min":1.4419999999999999},"min":{"1min":0.36299999999999999,"5min":0.25800000000000001,"15min":0.22900000000000001},"max":{"1min":4.3570000000000002,"5min":16.805,"15min":16.805},"last":6.2060000000000004},{"interface":"front","average":{"1min":2.0819999999999999,"5min":1.278,"15min":1.2609999999999999},"min":{"1min":0.313,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":7.0890000000000004,"5min":7.0890000000000004,"15min":11.823},"last":0.39800000000000002}]},{"osd":5,"last update":"Fri Oct 8 19:34:05 2021","interfaces":[{"interface":"back","average":{"1min":1.7969999999999999,"5min":1.4930000000000001,"15min":1.1990000000000001},"min":{"1min":0.36599999999999999,"5min":0.28399999999999997,"15min":0.24099999999999999},"max":{"1min":6.9180000000000001,"5min":8.6530000000000005,"15min":15.56},"last":2.9319999999999999},{"interface":"front","average":{"1min":1.145,"5min":1.4570000000000001,"15min":1.4179999999999999},"min":{"1min":0.40200000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":4.3319999999999999,"5min":11.619999999999999,"15min":15.484999999999999},"last":6.1660000000000004}]},{"osd":6,"last update":"Fri Oct 8 19:34:21 2021","interfaces":[{"interface":"back","average":{"1min":2.1970000000000001,"5min":1.421,"15min":1.405},"min":{"1min":0.34100000000000003,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":7.165,"5min":7.165,"15min":11.869},"last":0.496},{"interface":"front","average":{"1min":1.5509999999999999,"5min":1.5609999999999999,"15min":1.329},"min":{"1min":0.39900000000000002,"5min":0.32000000000000001,"15min":0.27500000000000002},"max":{"1min":5.8129999999999997,"5min":8.609,"15min":10.519},"last":2.9550000000000001}]},{"osd":7,"last update":"Fri Oct 8 19:33:33 2021","interfaces":[{"interface":"back","average":{"1min":1.76,"5min":1.768,"15min":1.4890000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.35399999999999998},"max":{"1min":5.1449999999999996,"5min":11.669,"15min":11.669},"last":6.2309999999999999},{"interface":"front","average":{"1min":1.4950000000000001,"5min":1.5049999999999999,"15min":1.4810000000000001},"min":{"1min":0.45000000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":3.6709999999999998,"5min":9.8849999999999998,"15min":11.898999999999999},"last":6.093}]}]},{"osd":2,"up_from":18,"seq":77309411507,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":609236,"kb_used_data":394892,"kb_used_omap":0,"kb_used_meta":214336,"kb_avail":93135916,"statfs":{"total":95995035648,"available":95371177984,"internally_reserved":0,"allocated":404369408,"data_stored":403987686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":219480064},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:34:07 2021","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":2.133,"15min":2.101},"min":{"1min":0.19600000000000001,"5min":0.184,"15min":0.17699999999999999},"max":{"1min":4.9530000000000003,"5min":60.990000000000002,"15min":61.670999999999999},"last":0.247},{"interface":"front","average":{"1min":1.4530000000000001,"5min":2.113,"15min":2.0819999999999999},"min":{"1min":0.23999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":5.4630000000000001,"5min":60.850999999999999,"15min":65.284999999999997},"last":0.72499999999999998}]},{"osd":1,"last update":"Fri Oct 8 19:34:07 2021","interfaces":[{"interface":"back","average":{"1min":4.867,"5min":3.7040000000000002,"15min":2.4289999999999998},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.192},"max":{"1min":63.738,"5min":63.738,"15min":63.738},"last":0.32400000000000001},{"interface":"front","average":{"1min":5.5860000000000003,"5min":4.0410000000000004,"15min":2.629},"min":{"1min":0.26500000000000001,"5min":0.25900000000000001,"15min":0.21299999999999999},"max":{"1min":63.619999999999997,"5min":63.619999999999997,"15min":63.619999999999997},"last":5.7880000000000003}]},{"osd":3,"last update":"Fri Oct 8 19:34:15 2021","interfaces":[{"interface":"back","average":{"1min":2.661,"5min":3.6379999999999999,"15min":2.6349999999999998},"min":{"1min":0.30099999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":7.8460000000000001,"5min":63.658999999999999,"15min":65.322999999999993},"last":2.581},{"interface":"front","average":{"1min":1.8779999999999999,"5min":3.5739999999999998,"15min":2.5329999999999999},"min":{"1min":0.29599999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":10.317,"5min":65.418000000000006,"15min":65.418000000000006},"last":0.63900000000000001}]},{"osd":4,"last update":"Fri Oct 8 19:33:39 2021","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":1.4359999999999999,"15min":1.3120000000000001},"min":{"1min":0.32800000000000001,"5min":0.29499999999999998,"15min":0.26900000000000002},"max":{"1min":3.4239999999999999,"5min":24.657,"15min":24.657},"last":0.42499999999999999},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.452,"15min":1.4019999999999999},"min":{"1min":0.28399999999999997,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":7.7469999999999999,"5min":8.5990000000000002,"15min":15.143000000000001},"last":0.76000000000000001}]},{"osd":5,"last update":"Fri Oct 8 19:34:07 2021","interfaces":[{"interface":"back","average":{"1min":1.962,"5min":1.613,"15min":1.4319999999999999},"min":{"1min":0.32100000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":7.7409999999999997,"5min":8.6240000000000006,"15min":15.087999999999999},"last":2.5499999999999998},{"interface":"front","average":{"1min":1.6679999999999999,"5min":1.603,"15min":1.4570000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.27600000000000002},"max":{"1min":5.4379999999999997,"5min":26.094000000000001,"15min":26.094000000000001},"last":1.3939999999999999}]},{"osd":6,"last update":"Fri Oct 8 19:34:15 2021","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.242,"15min":1.3360000000000001},"min":{"1min":0.40899999999999997,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":3.4510000000000001,"5min":7.7779999999999996,"15min":14.162000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":1.9450000000000001,"5min":1.3779999999999999,"15min":1.413},"min":{"1min":0.378,"5min":0.313,"15min":0.313},"max":{"1min":5.1500000000000004,"5min":10.92,"15min":16.68},"last":0.47399999999999998}]},{"osd":7,"last update":"Fri Oct 8 19:33:39 2021","interfaces":[{"interface":"back","average":{"1min":1.7030000000000001,"5min":1.633,"15min":1.4490000000000001},"min":{"1min":0.371,"5min":0.32200000000000001,"15min":0.31900000000000001},"max":{"1min":6.7080000000000002,"5min":12.175000000000001,"15min":14.185},"last":0.57699999999999996},{"interface":"front","average":{"1min":1.627,"5min":1.484,"15min":1.413},"min":{"1min":0.39100000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":4.9770000000000003,"5min":10.898,"15min":16.702999999999999},"last":0.44700000000000001}]}]},{"osd":3,"up_from":24,"seq":103079215281,"num_pgs":75,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1315908,"kb_used_data":1014972,"kb_used_omap":0,"kb_used_meta":300864,"kb_avail":92429244,"statfs":{"total":95995035648,"available":94647545856,"internally_reserved":0,"allocated":1039331328,"data_stored":1038908442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308084736},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:33:28 2021","interfaces":[{"interface":"back","average":{"1min":3.6480000000000001,"5min":2.601,"15min":2.1400000000000001},"min":{"1min":0.187,"5min":0.187,"15min":0.17000000000000001},"max":{"1min":13.036,"5min":17.553999999999998,"15min":109.601},"last":0.314},{"interface":"front","average":{"1min":1.77,"5min":2.012,"15min":2.1230000000000002},"min":{"1min":0.20200000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":10.997,"5min":12.696999999999999,"15min":107.84},"last":0.23000000000000001}]},{"osd":1,"last update":"Fri Oct 8 19:33:28 2021","interfaces":[{"interface":"back","average":{"1min":2.3140000000000001,"5min":2.3399999999999999,"15min":1.7709999999999999},"min":{"1min":0.28399999999999997,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":13.228999999999999,"5min":37.271999999999998,"15min":37.271999999999998},"last":0.27100000000000002},{"interface":"front","average":{"1min":1.7629999999999999,"5min":2.218,"15min":1.748},"min":{"1min":0.215,"5min":0.19,"15min":0.19},"max":{"1min":6.1399999999999997,"5min":37.033000000000001,"15min":37.033000000000001},"last":0.25900000000000001}]},{"osd":2,"last update":"Fri Oct 8 19:33:28 2021","interfaces":[{"interface":"back","average":{"1min":1.6859999999999999,"5min":1.6180000000000001,"15min":1.758},"min":{"1min":0.25700000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":6.2699999999999996,"5min":8.6890000000000001,"15min":32.277000000000001},"last":0.29299999999999998},{"interface":"front","average":{"1min":4.1609999999999996,"5min":2.423,"15min":1.7070000000000001},"min":{"1min":0.27500000000000002,"5min":0.27200000000000002,"15min":0.22700000000000001},"max":{"1min":23.189,"5min":23.189,"15min":23.189},"last":0.28599999999999998}]},{"osd":4,"last update":"Fri Oct 8 19:33:41 2021","interfaces":[{"interface":"back","average":{"1min":2.71,"5min":1.8280000000000001,"15min":1.4219999999999999},"min":{"1min":0.30499999999999999,"5min":0.26600000000000001,"15min":0.25600000000000001},"max":{"1min":13.968,"5min":13.968,"15min":18.064},"last":0.36199999999999999},{"interface":"front","average":{"1min":1.919,"5min":2.0609999999999999,"15min":1.5629999999999999},"min":{"1min":0.312,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":8.8460000000000001,"5min":15.414,"15min":18.692},"last":0.41299999999999998}]},{"osd":5,"last update":"Fri Oct 8 19:34:01 2021","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.5509999999999999,"15min":1.3859999999999999},"min":{"1min":0.30599999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":4.8719999999999999,"5min":11.125,"15min":13.186},"last":75.397000000000006},{"interface":"front","average":{"1min":3.3460000000000001,"5min":2.222,"15min":1.591},"min":{"1min":0.32600000000000001,"5min":0.311,"15min":0.28100000000000003},"max":{"1min":22.861000000000001,"5min":22.861000000000001,"15min":22.861000000000001},"last":75.680000000000007}]},{"osd":6,"last update":"Fri Oct 8 19:34:17 2021","interfaces":[{"interface":"back","average":{"1min":1.5920000000000001,"5min":1.8100000000000001,"15min":1.8580000000000001},"min":{"1min":0.34300000000000003,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":3.8399999999999999,"5min":10.606999999999999,"15min":21.538},"last":0.44},{"interface":"front","average":{"1min":1.54,"5min":1.6739999999999999,"15min":1.4690000000000001},"min":{"1min":0.42799999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":4.7999999999999998,"5min":13.067,"15min":13.298},"last":0.42999999999999999}]},{"osd":7,"last update":"Fri Oct 8 19:33:41 2021","interfaces":[{"interface":"back","average":{"1min":2.0169999999999999,"5min":1.9570000000000001,"15min":1.4379999999999999},"min":{"1min":0.35799999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":8.9000000000000004,"5min":10.696999999999999,"15min":10.696999999999999},"last":0.48099999999999998},{"interface":"front","average":{"1min":1.8779999999999999,"5min":1.5569999999999999,"15min":1.4159999999999999},"min":{"1min":0.38,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":6.1920000000000002,"5min":7.0460000000000003,"15min":13.225},"last":0.40300000000000002}]}]},{"osd":4,"up_from":30,"seq":128849019051,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":554620,"kb_used_data":380084,"kb_used_omap":0,"kb_used_meta":174528,"kb_avail":93190532,"statfs":{"total":95995035648,"available":95427104768,"internally_reserved":0,"allocated":389206016,"data_stored":388791301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":178716672},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:33:42 2021","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":2.1699999999999999,"15min":1.635},"min":{"1min":0.219,"5min":0.188,"15min":0.185},"max":{"1min":7.1319999999999997,"5min":82.109999999999999,"15min":82.109999999999999},"last":0.245},{"interface":"front","average":{"1min":1.7549999999999999,"5min":2.1070000000000002,"15min":1.6299999999999999},"min":{"1min":0.253,"5min":0.23000000000000001,"15min":0.20399999999999999},"max":{"1min":4.2939999999999996,"5min":82.025999999999996,"15min":82.025999999999996},"last":1.093}]},{"osd":1,"last update":"Fri Oct 8 19:33:42 2021","interfaces":[{"interface":"back","average":{"1min":1.7829999999999999,"5min":1.9710000000000001,"15min":1.496},"min":{"1min":0.33200000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":4.5789999999999997,"5min":41.033000000000001,"15min":41.033000000000001},"last":2.3940000000000001},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.966,"15min":1.252},"min":{"1min":0.26100000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":3.8679999999999999,"5min":41.396999999999998,"15min":41.396999999999998},"last":3.4649999999999999}]},{"osd":2,"last update":"Fri Oct 8 19:33:42 2021","interfaces":[{"interface":"back","average":{"1min":1.6279999999999999,"5min":1.3280000000000001,"15min":1.24},"min":{"1min":0.34699999999999998,"5min":0.26800000000000002,"15min":0.23499999999999999},"max":{"1min":4.3449999999999998,"5min":7.9189999999999996,"15min":21.257000000000001},"last":0.311},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.252,"15min":1.222},"min":{"1min":0.26900000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":4.7770000000000001,"5min":6.6929999999999996,"15min":21.600000000000001},"last":3.5369999999999999}]},{"osd":3,"last update":"Fri Oct 8 19:33:42 2021","interfaces":[{"interface":"back","average":{"1min":1.7849999999999999,"5min":2.0569999999999999,"15min":1.869},"min":{"1min":0.30299999999999999,"5min":0.28499999999999998,"15min":0.26500000000000001},"max":{"1min":7.4130000000000003,"5min":40.026000000000003,"15min":58.506999999999998},"last":3.5059999999999998},{"interface":"front","average":{"1min":1.55,"5min":2.2250000000000001,"15min":1.611},"min":{"1min":0.35799999999999998,"5min":0.29999999999999999,"15min":0.27400000000000002},"max":{"1min":4.6760000000000002,"5min":41.316000000000003,"15min":58.521000000000001},"last":2.3700000000000001}]},{"osd":5,"last update":"Fri Oct 8 19:34:06 2021","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.0329999999999999,"15min":0.70699999999999996},"min":{"1min":0.33500000000000002,"5min":0.247,"15min":0.222},"max":{"1min":4.242,"5min":7.101,"15min":7.101},"last":0.84999999999999998},{"interface":"front","average":{"1min":1.1910000000000001,"5min":0.98699999999999999,"15min":0.68700000000000006},"min":{"1min":0.29099999999999998,"5min":0.23999999999999999,"15min":0.22900000000000001},"max":{"1min":4.1660000000000004,"5min":8.1319999999999997,"15min":8.1319999999999997},"last":0.27700000000000002}]},{"osd":6,"last update":"Fri Oct 8 19:34:20 2021","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":0.93000000000000005,"15min":0.72499999999999998},"min":{"1min":0.34699999999999998,"5min":0.28899999999999998,"15min":0.23599999999999999},"max":{"1min":4.2670000000000003,"5min":6.7300000000000004,"15min":6.7300000000000004},"last":0.28699999999999998},{"interface":"front","average":{"1min":1.155,"5min":0.97199999999999998,"15min":0.75600000000000001},"min":{"1min":0.36699999999999999,"5min":0.26600000000000001,"15min":0.247},"max":{"1min":4.6500000000000004,"5min":7.0720000000000001,"15min":7.0720000000000001},"last":0.88}]},{"osd":7,"last update":"Fri Oct 8 19:33:42 2021","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":0.97899999999999998,"15min":0.69699999999999995},"min":{"1min":0.35299999999999998,"5min":0.29099999999999998,"15min":0.26400000000000001},"max":{"1min":4.2199999999999998,"5min":8.0050000000000008,"15min":8.0050000000000008},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.29,"5min":0.97199999999999998,"15min":0.78500000000000003},"min":{"1min":0.35299999999999998,"5min":0.30499999999999999,"15min":0.29699999999999999},"max":{"1min":4.3209999999999997,"5min":6.3959999999999999,"15min":6.3959999999999999},"last":1.1259999999999999}]}]},{"osd":5,"up_from":38,"seq":163208757415,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1449316,"kb_used_data":1201948,"kb_used_omap":0,"kb_used_meta":247360,"kb_avail":92295836,"statfs":{"total":95995035648,"available":94510936064,"internally_reserved":0,"allocated":1230794752,"data_stored":1230398027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":253296640},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:34:03 2021","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.4770000000000001,"15min":1.155},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":9.5310000000000006,"5min":24.597000000000001,"15min":24.597000000000001},"last":3.2029999999999998},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.502,"15min":1.137},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":3.8639999999999999,"5min":24.510999999999999,"15min":24.510999999999999},"last":5.4269999999999996}]},{"osd":1,"last update":"Fri Oct 8 19:34:03 2021","interfaces":[{"interface":"back","average":{"1min":5.375,"5min":2.5110000000000001,"15min":1.554},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23000000000000001},"max":{"1min":94.558999999999997,"5min":94.558999999999997,"15min":94.558999999999997},"last":0.40500000000000003},{"interface":"front","average":{"1min":5.5999999999999996,"5min":2.4510000000000001,"15min":1.5249999999999999},"min":{"1min":0.23899999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":94.456999999999994,"5min":94.456999999999994,"15min":94.456999999999994},"last":0.33000000000000002}]},{"osd":2,"last update":"Fri Oct 8 19:34:03 2021","interfaces":[{"interface":"back","average":{"1min":1.6120000000000001,"5min":1.2450000000000001,"15min":1.4339999999999999},"min":{"1min":0.28000000000000003,"5min":0.25800000000000001,"15min":0.25700000000000001},"max":{"1min":7.2210000000000001,"5min":8.1259999999999994,"15min":29.398},"last":0.54600000000000004},{"interface":"front","average":{"1min":1.5329999999999999,"5min":1.355,"15min":1.4550000000000001},"min":{"1min":0.29499999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":5.944,"5min":8.3599999999999994,"15min":29.387},"last":1.579}]},{"osd":3,"last update":"Fri Oct 8 19:34:03 2021","interfaces":[{"interface":"back","average":{"1min":2.0529999999999999,"5min":1.7130000000000001,"15min":1.4399999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.26200000000000001},"max":{"1min":5.875,"5min":11.685,"15min":12.356},"last":3.282},{"interface":"front","average":{"1min":1.7330000000000001,"5min":2.0169999999999999,"15min":1.542},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":4.9580000000000002,"5min":13.366,"15min":21.504000000000001},"last":1.8100000000000001}]},{"osd":4,"last update":"Fri Oct 8 19:34:03 2021","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":0.89700000000000002,"15min":0.68400000000000005},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.224},"max":{"1min":5.8650000000000002,"5min":9.2759999999999998,"15min":9.2759999999999998},"last":0.44900000000000001},{"interface":"front","average":{"1min":1.446,"5min":0.95099999999999996,"15min":0.69699999999999995},"min":{"1min":0.27900000000000003,"5min":0.25900000000000001,"15min":0.23799999999999999},"max":{"1min":5.0890000000000004,"5min":7.8959999999999999,"15min":7.8959999999999999},"last":0.41599999999999998}]},{"osd":6,"last update":"Fri Oct 8 19:34:21 2021","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":0.96499999999999997,"15min":0.76100000000000001},"min":{"1min":0.28499999999999998,"5min":0.255,"15min":0.255},"max":{"1min":5.8879999999999999,"5min":5.8879999999999999,"15min":7.266},"last":0.47699999999999998},{"interface":"front","average":{"1min":1.0189999999999999,"5min":0.96499999999999997,"15min":0.75},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29099999999999998},"max":{"1min":3.7320000000000002,"5min":7.9390000000000001,"15min":7.9390000000000001},"last":3.226}]},{"osd":7,"last update":"Fri Oct 8 19:33:37 2021","interfaces":[{"interface":"back","average":{"1min":2.331,"5min":1.1830000000000001,"15min":0.82099999999999995},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":29.946999999999999,"5min":29.946999999999999,"15min":29.946999999999999},"last":0.436},{"interface":"front","average":{"1min":2.5790000000000002,"5min":1.3120000000000001,"15min":0.91300000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":29.294,"5min":29.294,"15min":29.294},"last":1.3380000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":266240,"data_stored":262688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":327680,"data_stored":327680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":518258688,"data_stored":518258688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1174081536,"data_stored":1174077464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":392560640,"data_stored":392560640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1036255232,"data_stored":1036255232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":379781120,"data_stored":379781120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1192562688,"data_stored":1192558616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":397869056,"data_stored":397869056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1194201088,"data_stored":1194197016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-10-08T19:34:33.559 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph pg dump --format=json 2021-10-08T19:34:33.560 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:34:33.876 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:33 smithi097 ceph-mon[32687]: from='client.25690 v1:172.21.15.97:0/207367372' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:34:33.877 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:33 smithi097 ceph-mon[32687]: pgmap v658: 178 pgs: 178 active+clean; 2.0 GiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 732 B/s rd, 0 B/s wr, 775 op/s 2021-10-08T19:34:33.877 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:33 smithi097 ceph-mon[41966]: from='client.25690 v1:172.21.15.97:0/207367372' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:34:33.877 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:33 smithi097 ceph-mon[41966]: pgmap v658: 178 pgs: 178 active+clean; 2.0 GiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 732 B/s rd, 0 B/s wr, 775 op/s 2021-10-08T19:34:34.021 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:34:34.025 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:34:33 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:34:33] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:34:34.026 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:34.027 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:34:34.028 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:33 smithi117 ceph-mon[34585]: from='client.25690 v1:172.21.15.97:0/207367372' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:34:34.028 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:33 smithi117 ceph-mon[34585]: pgmap v658: 178 pgs: 178 active+clean; 2.0 GiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 732 B/s rd, 0 B/s wr, 775 op/s 2021-10-08T19:34:34.131 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:34:34.181 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:34.257 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:34:34.259 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:34.260 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:34:34.361 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:34:34.373 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:34:34.425 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:34.553 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:34:34.555 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:34.556 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:34:34.657 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:34:34.707 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:34.819 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset noscrub 2021-10-08T19:34:34.964 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2021-10-08T19:34:34.964 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:34:35.288 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:34:35.293 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:35.293 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:34:35.395 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:34:35.449 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:35.675 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:34:35.677 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:35.678 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:34:35.779 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:34:35.808 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:35.941 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:34:35.944 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:35.944 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:34:36.027 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:34:36.046 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:34:36.064 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:34:36.103 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:35 smithi097 ceph-mon[32687]: pgmap v659: 178 pgs: 178 active+clean; 1.6 GiB data, 6.7 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.39k op/s 2021-10-08T19:34:36.104 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:35 smithi097 ceph-mon[41966]: pgmap v659: 178 pgs: 178 active+clean; 1.6 GiB data, 6.7 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.39k op/s 2021-10-08T19:34:36.109 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:36.120 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:34:36.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:35 smithi117 ceph-mon[34585]: pgmap v659: 178 pgs: 178 active+clean; 1.6 GiB data, 6.7 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.39k op/s 2021-10-08T19:34:36.159 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:34:36.190 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:34:36.216 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:34:36.225 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:36.226 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:34:36.229 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:34:36.253 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:34:36.320 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2021-10-08T19:34:36.323 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:34:36.323 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:34:36.323 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true' 2021-10-08T19:34:36.324 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true' 2021-10-08T19:34:36.324 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true' 2021-10-08T19:34:36.324 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true' 2021-10-08T19:34:36.324 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true' 2021-10-08T19:34:36.325 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true' 2021-10-08T19:34:36.325 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'true' 2021-10-08T19:34:36.325 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'true' 2021-10-08T19:34:36.327 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:34:36.413 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:36.560 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:34:36.568 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:36.569 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:34:36.671 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:34:36.730 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:36.831 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:34:36.975 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:36 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/4081131218' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:34:36.975 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:36 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/4081131218' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:34:37.088 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:34:37.098 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:37.099 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:34:37.155 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:34:36 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:34:37.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:36 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/4081131218' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:34:37.202 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:34:37.253 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:38.016 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:34:38.017 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:38.017 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:34:38.119 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:34:38.121 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:37 smithi097 ceph-mon[32687]: pgmap v660: 178 pgs: 178 active+clean; 1.6 GiB data, 6.7 GiB used, 709 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 1.09k op/s 2021-10-08T19:34:38.121 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:37 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:34:38.122 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:37 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:34:38.122 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:37 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:34:38.122 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:37 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:34:38.122 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:37 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:34:38.131 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:37 smithi097 ceph-mon[41966]: pgmap v660: 178 pgs: 178 active+clean; 1.6 GiB data, 6.7 GiB used, 709 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 1.09k op/s 2021-10-08T19:34:38.131 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:37 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:34:38.131 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:37 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:34:38.132 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:37 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:34:38.132 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:37 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:34:38.132 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:37 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:34:38.152 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:37 smithi117 ceph-mon[34585]: pgmap v660: 178 pgs: 178 active+clean; 1.6 GiB data, 6.7 GiB used, 709 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 1.09k op/s 2021-10-08T19:34:38.152 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:37 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:34:38.152 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:37 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:34:38.152 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:37 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:34:38.153 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:37 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:34:38.153 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:37 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:34:38.163 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:38.717 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:34:38.728 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2021-10-08T19:34:38.738 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:34:38.743 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:38.744 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:34:38.846 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:34:38.906 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:39.720 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:34:39 smithi097 conmon[33110]: 172.21.15.117 - - [08/Oct/2021:19:34:39] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:34:39.882 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:39 smithi117 ceph-mon[34585]: from='client.25699 v1:172.21.15.97:0/3086673461' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:34:39.882 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:39 smithi117 ceph-mon[34585]: pgmap v661: 178 pgs: 178 active+clean; 1.5 GiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1.11k op/s 2021-10-08T19:34:39.899 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:34:39.899 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2021-10-08T19:34:39.899 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2021-10-08T19:34:39.900 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2021-10-08T19:34:39.900 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.900 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:117006 7.1 7:89df6efd:::benchmark_data_smithi097_93198_object25186:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e146)", 2021-10-08T19:34:39.900 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:25:57.609765+0000", 2021-10-08T19:34:39.900 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 522.28539591699996, 2021-10-08T19:34:39.901 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.12628213299999999, 2021-10-08T19:34:39.901 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:34:39.901 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:34:39.901 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:34:39.902 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:34:39.902 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:34:39.902 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 117006 2021-10-08T19:34:39.902 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.902 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:34:39.903 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.903 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:34:39.903 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.609765+0000", 2021-10-08T19:34:39.903 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:39.903 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.904 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.904 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:34:39.904 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.609765+0000", 2021-10-08T19:34:39.905 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:39.905 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.905 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.905 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:34:39.906 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.609762+0000", 2021-10-08T19:34:39.906 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999971 2021-10-08T19:34:39.906 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.906 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.907 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:34:39.907 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.609770+0000", 2021-10-08T19:34:39.907 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3019999999999995e-06 2021-10-08T19:34:39.907 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.907 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.908 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:34:39.908 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.609786+0000", 2021-10-08T19:34:39.908 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5743000000000002e-05 2021-10-08T19:34:39.908 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.909 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.909 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:34:39.909 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.609793+0000", 2021-10-08T19:34:39.909 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.764e-06 2021-10-08T19:34:39.910 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.910 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.910 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:34:39.910 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.613988+0000", 2021-10-08T19:34:39.911 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004194723 2021-10-08T19:34:39.911 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.911 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.911 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2021-10-08T19:34:39.912 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.614080+0000", 2021-10-08T19:34:39.912 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.2621999999999995e-05 2021-10-08T19:34:39.912 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.912 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.913 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:34:39.913 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.619927+0000", 2021-10-08T19:34:39.913 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0058469389999999998 2021-10-08T19:34:39.913 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.913 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.914 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:34:39.914 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.620047+0000", 2021-10-08T19:34:39.914 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011939599999999999 2021-10-08T19:34:39.914 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.915 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.915 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 3,6", 2021-10-08T19:34:39.916 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.620238+0000", 2021-10-08T19:34:39.916 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00019126200000000001 2021-10-08T19:34:39.916 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.916 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.917 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:34:39.917 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.632525+0000", 2021-10-08T19:34:39.917 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012286728 2021-10-08T19:34:39.917 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.917 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.918 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:39.918 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.633274+0000", 2021-10-08T19:34:39.918 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00074901099999999995 2021-10-08T19:34:39.918 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.918 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.919 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:39.919 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.735394+0000", 2021-10-08T19:34:39.919 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.10211999099999999 2021-10-08T19:34:39.919 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.920 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.920 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:34:39.920 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.735429+0000", 2021-10-08T19:34:39.920 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.5151999999999998e-05 2021-10-08T19:34:39.920 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.921 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.921 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:34:39.921 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.736047+0000", 2021-10-08T19:34:39.921 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000618258 2021-10-08T19:34:39.922 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:39.922 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:34:39.922 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:39.922 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.922 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.923 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:117014 7.1 7:8f0e063d:::benchmark_data_smithi097_93198_object25194:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e146)", 2021-10-08T19:34:39.923 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:25:57.622073+0000", 2021-10-08T19:34:39.923 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 522.27308785299999, 2021-10-08T19:34:39.923 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.114659727, 2021-10-08T19:34:39.924 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:34:39.924 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:34:39.924 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:34:39.924 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:34:39.925 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:34:39.925 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 117014 2021-10-08T19:34:39.925 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.925 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:34:39.926 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.926 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:34:39.926 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.622073+0000", 2021-10-08T19:34:39.926 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:39.926 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.927 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.927 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:34:39.927 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.622073+0000", 2021-10-08T19:34:39.927 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:39.928 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.928 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.928 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:34:39.929 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.622071+0000", 2021-10-08T19:34:39.929 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:34:39.929 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.929 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.930 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:34:39.930 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.622078+0000", 2021-10-08T19:34:39.930 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7950000000000002e-06 2021-10-08T19:34:39.930 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.931 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.931 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:34:39.931 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.622089+0000", 2021-10-08T19:34:39.931 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0703000000000001e-05 2021-10-08T19:34:39.931 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.932 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.932 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:34:39.932 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.622095+0000", 2021-10-08T19:34:39.932 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7170000000000002e-06 2021-10-08T19:34:39.933 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.933 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.933 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:34:39.933 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.622630+0000", 2021-10-08T19:34:39.933 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00053484300000000002 2021-10-08T19:34:39.934 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.934 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.934 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:34:39.934 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.622768+0000", 2021-10-08T19:34:39.935 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013772799999999999 2021-10-08T19:34:39.935 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.935 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.935 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 3,6", 2021-10-08T19:34:39.935 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.622918+0000", 2021-10-08T19:34:39.936 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014995500000000001 2021-10-08T19:34:39.936 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.936 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.936 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:34:39.937 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.632535+0000", 2021-10-08T19:34:39.937 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0096170979999999993 2021-10-08T19:34:39.937 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.937 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.937 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:39.938 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.633309+0000", 2021-10-08T19:34:39.938 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00077388200000000004 2021-10-08T19:34:39.938 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.938 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.939 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:39.939 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.736104+0000", 2021-10-08T19:34:39.939 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.102794785 2021-10-08T19:34:39.939 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.939 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.940 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:34:39.940 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.736144+0000", 2021-10-08T19:34:39.940 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0638e-05 2021-10-08T19:34:39.941 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.941 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.941 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:34:39.941 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.736733+0000", 2021-10-08T19:34:39.942 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00058851599999999997 2021-10-08T19:34:39.942 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:39.942 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:34:39.942 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:39.943 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.943 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.943 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:117015 7.1 7:8e662d21:::benchmark_data_smithi097_93198_object25195:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e146)", 2021-10-08T19:34:39.943 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:25:57.622105+0000", 2021-10-08T19:34:39.943 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 522.27305556099998, 2021-10-08T19:34:39.944 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.123142053, 2021-10-08T19:34:39.944 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:34:39.944 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:34:39.944 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:34:39.945 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:34:39.945 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:34:39.945 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 117015 2021-10-08T19:34:39.945 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.945 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:34:39.946 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.946 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:34:39.946 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.622105+0000", 2021-10-08T19:34:39.946 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:39.947 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.947 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.947 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:34:39.947 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.622105+0000", 2021-10-08T19:34:39.947 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:39.948 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.948 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.948 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:34:39.948 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.622105+0000", 2021-10-08T19:34:39.948 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999995 2021-10-08T19:34:39.949 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.949 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.949 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:34:39.949 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.622108+0000", 2021-10-08T19:34:39.949 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.3950000000000001e-06 2021-10-08T19:34:39.950 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.950 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.950 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:34:39.950 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.622120+0000", 2021-10-08T19:34:39.951 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.166e-05 2021-10-08T19:34:39.951 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.951 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.951 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:34:39.951 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.622124+0000", 2021-10-08T19:34:39.952 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8579999999999999e-06 2021-10-08T19:34:39.952 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.952 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.952 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:34:39.953 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.625234+0000", 2021-10-08T19:34:39.953 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031095820000000001 2021-10-08T19:34:39.953 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.953 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.953 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:34:39.954 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.625394+0000", 2021-10-08T19:34:39.954 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016029600000000001 2021-10-08T19:34:39.954 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.954 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.954 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 3,6", 2021-10-08T19:34:39.955 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.625557+0000", 2021-10-08T19:34:39.955 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000163065 2021-10-08T19:34:39.955 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.955 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.955 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:34:39.956 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.632540+0000", 2021-10-08T19:34:39.956 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0069821589999999999 2021-10-08T19:34:39.956 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.956 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.957 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:39.957 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.634341+0000", 2021-10-08T19:34:39.957 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018017459999999999 2021-10-08T19:34:39.957 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.957 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.958 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:39.958 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.743952+0000", 2021-10-08T19:34:39.958 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.109610323 2021-10-08T19:34:39.958 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.958 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.959 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:34:39.959 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.744013+0000", 2021-10-08T19:34:39.959 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1184000000000002e-05 2021-10-08T19:34:39.959 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.959 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.960 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:34:39.960 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:25:57.745247+0000", 2021-10-08T19:34:39.960 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001234466 2021-10-08T19:34:39.960 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:39.961 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:34:39.961 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:39.961 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.961 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.962 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:133117 7.1 7:84d1147c:::benchmark_data_smithi097_93198_object41297:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e151)", 2021-10-08T19:34:39.962 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:26:19.406084+0000", 2021-10-08T19:34:39.962 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 500.48907687500002, 2021-10-08T19:34:39.963 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.10585810800000001, 2021-10-08T19:34:39.963 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:34:39.963 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:34:39.963 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:34:39.964 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:34:39.964 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:34:39.964 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 133117 2021-10-08T19:34:39.964 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.964 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:34:39.965 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.965 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:34:39.965 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.406084+0000", 2021-10-08T19:34:39.965 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:39.965 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.966 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.966 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:34:39.966 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.406084+0000", 2021-10-08T19:34:39.966 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:39.967 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.967 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.967 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:34:39.967 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.406083+0000", 2021-10-08T19:34:39.967 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:34:39.968 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.968 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.968 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:34:39.968 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.406088+0000", 2021-10-08T19:34:39.968 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7659999999999998e-06 2021-10-08T19:34:39.969 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.969 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.969 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:34:39.969 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.406100+0000", 2021-10-08T19:34:39.969 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2036e-05 2021-10-08T19:34:39.970 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.970 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.970 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:34:39.970 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.406106+0000", 2021-10-08T19:34:39.970 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5119999999999997e-06 2021-10-08T19:34:39.971 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.971 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.971 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:34:39.971 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.409394+0000", 2021-10-08T19:34:39.972 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032877420000000002 2021-10-08T19:34:39.972 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.972 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.972 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:34:39.973 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.409607+0000", 2021-10-08T19:34:39.973 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00021351399999999999 2021-10-08T19:34:39.973 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.973 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.973 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 3,6", 2021-10-08T19:34:39.974 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.409807+0000", 2021-10-08T19:34:39.974 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00019952199999999999 2021-10-08T19:34:39.974 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.974 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.974 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:34:39.975 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.412493+0000", 2021-10-08T19:34:39.975 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002686646 2021-10-08T19:34:39.975 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.975 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.976 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:39.976 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.413731+0000", 2021-10-08T19:34:39.976 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012370549999999999 2021-10-08T19:34:39.976 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.976 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.977 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:39.977 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.510804+0000", 2021-10-08T19:34:39.977 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.097073004000000004 2021-10-08T19:34:39.977 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.977 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.978 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:34:39.978 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.510868+0000", 2021-10-08T19:34:39.978 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4945999999999998e-05 2021-10-08T19:34:39.978 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.978 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.979 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:34:39.979 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:19.511942+0000", 2021-10-08T19:34:39.979 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0010735569999999999 2021-10-08T19:34:39.979 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:39.980 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:34:39.980 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:39.980 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.980 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.980 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24796.0:161971 7.1 7:8fd2b586:::benchmark_data_smithi097_93198_object70151:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158)", 2021-10-08T19:34:39.981 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:26:58.326610+0000", 2021-10-08T19:34:39.981 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 461.56855109000003, 2021-10-08T19:34:39.981 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.21848095000000001, 2021-10-08T19:34:39.981 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:34:39.981 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:34:39.982 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:34:39.982 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24796", 2021-10-08T19:34:39.982 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:34:39.982 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 161971 2021-10-08T19:34:39.983 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.983 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:34:39.983 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.983 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:34:39.983 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.326610+0000", 2021-10-08T19:34:39.984 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:39.984 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.984 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.984 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:34:39.984 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.326610+0000", 2021-10-08T19:34:39.985 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:39.985 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.985 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.985 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:34:39.986 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.326607+0000", 2021-10-08T19:34:39.986 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:34:39.986 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.986 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.987 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:34:39.987 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.326616+0000", 2021-10-08T19:34:39.987 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.8999999999999995e-06 2021-10-08T19:34:39.987 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.987 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.988 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:34:39.988 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.326629+0000", 2021-10-08T19:34:39.988 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.279e-05 2021-10-08T19:34:39.988 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.988 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.989 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:34:39.989 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.326637+0000", 2021-10-08T19:34:39.989 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0590000000000003e-06 2021-10-08T19:34:39.989 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.990 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.990 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:34:39.990 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.326682+0000", 2021-10-08T19:34:39.990 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5385e-05 2021-10-08T19:34:39.990 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.991 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.991 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:34:39.991 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.326771+0000", 2021-10-08T19:34:39.991 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.8628000000000006e-05 2021-10-08T19:34:39.991 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.992 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.992 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 3,6", 2021-10-08T19:34:39.992 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.326886+0000", 2021-10-08T19:34:39.992 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000115016 2021-10-08T19:34:39.993 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.993 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.993 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:34:39.993 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.539537+0000", 2021-10-08T19:34:39.994 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.21265069 2021-10-08T19:34:39.994 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.994 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.994 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:39.994 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.539568+0000", 2021-10-08T19:34:39.995 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.1335999999999999e-05 2021-10-08T19:34:39.995 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.995 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.995 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:39.995 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.544333+0000", 2021-10-08T19:34:39.996 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0047652149999999997 2021-10-08T19:34:39.996 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.996 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.996 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:34:39.997 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.544392+0000", 2021-10-08T19:34:39.997 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.872e-05 2021-10-08T19:34:39.997 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.997 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.997 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:34:39.998 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.545091+0000", 2021-10-08T19:34:39.998 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00069866299999999998 2021-10-08T19:34:39.998 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:39.998 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:34:39.999 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:39.999 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:39.999 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:39.999 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.24796.0:161973 7.4 e158/94 7:2d96b882:::benchmark_data_smithi097_93198_object70153:head v 158'10064, mlcod=158'10062)", 2021-10-08T19:34:39.999 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:26:58.329972+0000", 2021-10-08T19:34:40.000 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 461.56518873099998, 2021-10-08T19:34:40.000 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.21382468800000001, 2021-10-08T19:34:40.000 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:34:40.000 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:34:40.001 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:34:40.001 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.001 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:34:40.001 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.329972+0000", 2021-10-08T19:34:40.001 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:40.002 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.002 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.003 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:34:40.003 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.329972+0000", 2021-10-08T19:34:40.003 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:40.003 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.004 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.004 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:34:40.004 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.329971+0000", 2021-10-08T19:34:40.004 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:34:40.005 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.005 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.005 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:34:40.005 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.329982+0000", 2021-10-08T19:34:40.005 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1072e-05 2021-10-08T19:34:40.006 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.006 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.006 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:34:40.006 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.537881+0000", 2021-10-08T19:34:40.007 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.20789914900000001 2021-10-08T19:34:40.007 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.007 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.007 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:34:40.008 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.537893+0000", 2021-10-08T19:34:40.008 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2051e-05 2021-10-08T19:34:40.008 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.008 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.008 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:34:40.009 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.537941+0000", 2021-10-08T19:34:40.009 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7973000000000003e-05 2021-10-08T19:34:40.009 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.009 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.009 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:34:40.010 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.537964+0000", 2021-10-08T19:34:40.010 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2889999999999999e-05 2021-10-08T19:34:40.010 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.010 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.011 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:34:40.011 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.543764+0000", 2021-10-08T19:34:40.011 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0058003359999999997 2021-10-08T19:34:40.011 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.012 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.012 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:34:40.012 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.543797+0000", 2021-10-08T19:34:40.012 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2527000000000002e-05 2021-10-08T19:34:40.012 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:40.013 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:34:40.013 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:40.013 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.013 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.014 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.24796.0:161975 7.8 e158/94 7:114b2586:::benchmark_data_smithi097_93198_object70155:head v 158'10036, mlcod=158'10034)", 2021-10-08T19:34:40.014 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:26:58.332795+0000", 2021-10-08T19:34:40.014 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 461.56236588399997, 2021-10-08T19:34:40.014 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.211518449, 2021-10-08T19:34:40.015 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:34:40.015 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:34:40.015 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:34:40.015 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.016 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:34:40.016 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.332795+0000", 2021-10-08T19:34:40.016 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:40.016 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.017 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.017 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:34:40.017 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.332795+0000", 2021-10-08T19:34:40.017 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:40.018 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.018 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.018 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:34:40.018 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.332793+0000", 2021-10-08T19:34:40.018 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:34:40.019 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.019 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.019 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:34:40.019 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.332802+0000", 2021-10-08T19:34:40.020 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.1850000000000004e-06 2021-10-08T19:34:40.020 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.020 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.020 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:34:40.020 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.537879+0000", 2021-10-08T19:34:40.021 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.20507779600000001 2021-10-08T19:34:40.021 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.021 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.021 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:34:40.021 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.537894+0000", 2021-10-08T19:34:40.022 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.413e-05 2021-10-08T19:34:40.022 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.022 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.022 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:34:40.023 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.537962+0000", 2021-10-08T19:34:40.023 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7983000000000003e-05 2021-10-08T19:34:40.023 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.023 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.023 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:34:40.024 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.537983+0000", 2021-10-08T19:34:40.024 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1392000000000001e-05 2021-10-08T19:34:40.024 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.024 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.024 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:34:40.025 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.544284+0000", 2021-10-08T19:34:40.025 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0063013740000000002 2021-10-08T19:34:40.025 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.025 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.025 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:34:40.026 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.544313+0000", 2021-10-08T19:34:40.026 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9030000000000002e-05 2021-10-08T19:34:40.026 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:40.027 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:34:40.027 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:40.027 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.027 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.028 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop_reply(client.24796.0:161971 7.1 e158/113 ondisk, result = 0)", 2021-10-08T19:34:40.028 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:26:58.333145+0000", 2021-10-08T19:34:40.028 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 461.56201542700001, 2021-10-08T19:34:40.028 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.206424358, 2021-10-08T19:34:40.028 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:34:40.029 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2021-10-08T19:34:40.029 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:34:40.029 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.029 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:34:40.030 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.333145+0000", 2021-10-08T19:34:40.030 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:40.030 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.030 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.030 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:34:40.031 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.333145+0000", 2021-10-08T19:34:40.031 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:40.031 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.031 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.032 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:34:40.032 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.333144+0000", 2021-10-08T19:34:40.032 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:34:40.032 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.033 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.033 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:34:40.033 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.333153+0000", 2021-10-08T19:34:40.033 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3329999999999997e-06 2021-10-08T19:34:40.034 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.034 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.034 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:34:40.034 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.537881+0000", 2021-10-08T19:34:40.035 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.204728403 2021-10-08T19:34:40.035 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.035 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.035 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:34:40.035 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.537894+0000", 2021-10-08T19:34:40.036 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2975e-05 2021-10-08T19:34:40.036 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.036 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.036 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:34:40.037 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.539558+0000", 2021-10-08T19:34:40.037 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0016645060000000001 2021-10-08T19:34:40.037 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.037 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.038 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:34:40.038 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.539564+0000", 2021-10-08T19:34:40.038 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1850000000000003e-06 2021-10-08T19:34:40.038 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.038 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.039 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:34:40.039 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:26:58.539570+0000", 2021-10-08T19:34:40.039 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1399999999999997e-06 2021-10-08T19:34:40.039 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:40.040 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:34:40.040 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:40.040 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.040 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.041 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:28518 8.2 8:43b63649:::benchmark_data_smithi097_144160_object28517:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e191)", 2021-10-08T19:34:40.041 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:28:03.427669+0000", 2021-10-08T19:34:40.041 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 396.46749148100002, 2021-10-08T19:34:40.041 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.097097359999999994, 2021-10-08T19:34:40.041 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:34:40.042 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:34:40.042 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:34:40.042 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:34:40.042 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:34:40.043 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 28518 2021-10-08T19:34:40.043 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.043 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:34:40.043 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.043 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:34:40.044 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:03.427669+0000", 2021-10-08T19:34:40.044 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:40.044 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.044 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.044 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:34:40.045 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:03.427669+0000", 2021-10-08T19:34:40.045 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:40.045 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.045 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.046 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:34:40.046 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:03.427667+0000", 2021-10-08T19:34:40.046 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:34:40.046 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.046 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.047 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:34:40.047 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:03.427722+0000", 2021-10-08T19:34:40.047 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4987000000000001e-05 2021-10-08T19:34:40.047 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.048 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.048 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:34:40.048 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:03.427734+0000", 2021-10-08T19:34:40.048 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2411e-05 2021-10-08T19:34:40.049 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.049 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.049 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:34:40.049 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:03.427740+0000", 2021-10-08T19:34:40.050 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9050000000000002e-06 2021-10-08T19:34:40.050 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.050 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.050 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:34:40.050 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:03.427794+0000", 2021-10-08T19:34:40.051 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4104999999999998e-05 2021-10-08T19:34:40.051 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.051 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.051 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:34:40.052 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:03.427940+0000", 2021-10-08T19:34:40.052 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000145573 2021-10-08T19:34:40.052 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.052 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.052 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:34:40.053 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:03.428116+0000", 2021-10-08T19:34:40.053 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017587599999999999 2021-10-08T19:34:40.053 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.053 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.053 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:34:40.054 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:03.429351+0000", 2021-10-08T19:34:40.054 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012355230000000001 2021-10-08T19:34:40.054 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.054 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.055 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:40.055 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:03.430339+0000", 2021-10-08T19:34:40.055 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00098754799999999998 2021-10-08T19:34:40.055 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.055 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.056 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:40.056 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:03.524669+0000", 2021-10-08T19:34:40.056 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.094330751000000004 2021-10-08T19:34:40.056 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.056 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.057 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:34:40.057 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:03.524725+0000", 2021-10-08T19:34:40.057 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5658999999999997e-05 2021-10-08T19:34:40.057 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.058 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.058 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:34:40.058 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:28:03.524767+0000", 2021-10-08T19:34:40.058 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1542000000000003e-05 2021-10-08T19:34:40.058 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:40.059 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:34:40.059 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:40.059 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.059 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.059 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:93113 8.2 8:4f637685:::benchmark_data_smithi097_144160_object4373:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e227)", 2021-10-08T19:34:40.060 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:29:26.684723+0000", 2021-10-08T19:34:40.060 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 313.21043794399998, 2021-10-08T19:34:40.060 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.107680844, 2021-10-08T19:34:40.060 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:34:40.061 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:34:40.061 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:34:40.061 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:34:40.061 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:34:40.061 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 93113 2021-10-08T19:34:40.062 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.062 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:34:40.062 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.062 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:34:40.063 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:26.684723+0000", 2021-10-08T19:34:40.063 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:40.063 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.063 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.064 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:34:40.064 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:26.684723+0000", 2021-10-08T19:34:40.064 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:40.064 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.064 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.065 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:34:40.065 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:26.684721+0000", 2021-10-08T19:34:40.065 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:34:40.065 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.066 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.066 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:34:40.066 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:26.684728+0000", 2021-10-08T19:34:40.066 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6579999999999996e-06 2021-10-08T19:34:40.066 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.067 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.067 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:34:40.067 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:26.684742+0000", 2021-10-08T19:34:40.067 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4134000000000001e-05 2021-10-08T19:34:40.068 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.068 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.068 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:34:40.068 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:26.684749+0000", 2021-10-08T19:34:40.069 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3100000000000003e-06 2021-10-08T19:34:40.069 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.069 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.069 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:34:40.070 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:26.684809+0000", 2021-10-08T19:34:40.070 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9647e-05 2021-10-08T19:34:40.070 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.070 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.070 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:34:40.071 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:26.684953+0000", 2021-10-08T19:34:40.071 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000144439 2021-10-08T19:34:40.072 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.072 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.072 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:34:40.073 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:26.685090+0000", 2021-10-08T19:34:40.073 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000136916 2021-10-08T19:34:40.074 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.074 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.075 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:34:40.075 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:26.689093+0000", 2021-10-08T19:34:40.075 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004002884 2021-10-08T19:34:40.075 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.076 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.076 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:40.076 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:26.690827+0000", 2021-10-08T19:34:40.076 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001734045 2021-10-08T19:34:40.076 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.077 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.077 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:40.077 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:26.792292+0000", 2021-10-08T19:34:40.077 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.101464864 2021-10-08T19:34:40.078 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.078 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.078 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:34:40.078 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:26.792354+0000", 2021-10-08T19:34:40.078 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2374999999999998e-05 2021-10-08T19:34:40.079 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.079 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.079 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:34:40.079 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:26.792404+0000", 2021-10-08T19:34:40.079 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9444000000000003e-05 2021-10-08T19:34:40.080 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:40.080 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:34:40.080 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:40.080 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.081 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.081 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:93114 8.2 8:4b394eeb:::benchmark_data_smithi097_144160_object4374:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e227)", 2021-10-08T19:34:40.081 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:29:26.684768+0000", 2021-10-08T19:34:40.081 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 313.21039310600003, 2021-10-08T19:34:40.081 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.110426494, 2021-10-08T19:34:40.082 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:34:40.082 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:34:40.082 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:34:40.082 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:34:40.083 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:34:40.083 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 93114 2021-10-08T19:34:40.083 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.083 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:34:40.083 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.084 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:34:40.084 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:26.684768+0000", 2021-10-08T19:34:40.084 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:40.084 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.085 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.085 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:34:40.085 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:26.684768+0000", 2021-10-08T19:34:40.085 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:40.085 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.086 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.086 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:34:40.086 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:26.684767+0000", 2021-10-08T19:34:40.086 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:34:40.087 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.087 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.087 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:34:40.087 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:26.684771+0000", 2021-10-08T19:34:40.088 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.3239999999999996e-06 2021-10-08T19:34:40.088 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.088 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.088 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:34:40.089 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:26.684780+0000", 2021-10-08T19:34:40.089 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.8920000000000006e-06 2021-10-08T19:34:40.089 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.089 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.090 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:34:40.090 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:26.684786+0000", 2021-10-08T19:34:40.090 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2149999999999998e-06 2021-10-08T19:34:40.090 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.091 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.091 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:34:40.091 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:26.687332+0000", 2021-10-08T19:34:40.091 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0025462560000000002 2021-10-08T19:34:40.091 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.092 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.092 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:34:40.092 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:26.687435+0000", 2021-10-08T19:34:40.092 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000102691 2021-10-08T19:34:40.092 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.093 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.093 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:34:40.093 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:26.687526+0000", 2021-10-08T19:34:40.093 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.1108999999999998e-05 2021-10-08T19:34:40.094 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.094 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.094 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:34:40.094 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:26.689503+0000", 2021-10-08T19:34:40.095 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0019767999999999999 2021-10-08T19:34:40.095 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.095 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.095 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:40.096 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:26.690980+0000", 2021-10-08T19:34:40.096 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0014774059999999999 2021-10-08T19:34:40.096 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.097 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.098 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:40.098 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:26.795121+0000", 2021-10-08T19:34:40.098 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.104140078 2021-10-08T19:34:40.099 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.099 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.099 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:34:40.099 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:26.795154+0000", 2021-10-08T19:34:40.100 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.3300999999999998e-05 2021-10-08T19:34:40.100 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.100 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.100 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:34:40.101 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:26.795194+0000", 2021-10-08T19:34:40.101 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0405999999999999e-05 2021-10-08T19:34:40.101 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:40.101 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:34:40.101 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:40.102 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.102 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.102 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:96599 8.2 8:499c045f:::benchmark_data_smithi097_144160_object7859:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e243)", 2021-10-08T19:34:40.103 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:29:52.347196+0000", 2021-10-08T19:34:40.103 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 287.54796485899999, 2021-10-08T19:34:40.104 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.092091184000000006, 2021-10-08T19:34:40.104 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:34:40.104 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:34:40.104 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:34:40.104 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:34:40.105 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:34:40.105 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 96599 2021-10-08T19:34:40.105 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.105 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:34:40.106 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.106 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:34:40.106 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:52.347196+0000", 2021-10-08T19:34:40.106 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:40.107 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.107 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.107 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:34:40.107 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:52.347196+0000", 2021-10-08T19:34:40.107 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:40.108 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.108 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.108 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:34:40.108 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:52.347193+0000", 2021-10-08T19:34:40.109 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999967 2021-10-08T19:34:40.109 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.109 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.109 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:34:40.109 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:52.347203+0000", 2021-10-08T19:34:40.110 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0696999999999999e-05 2021-10-08T19:34:40.110 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.110 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.110 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:34:40.110 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:52.347226+0000", 2021-10-08T19:34:40.111 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2419999999999999e-05 2021-10-08T19:34:40.111 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.111 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.111 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:34:40.112 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:52.347234+0000", 2021-10-08T19:34:40.112 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3739999999999998e-06 2021-10-08T19:34:40.112 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.112 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.112 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:34:40.113 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:52.347300+0000", 2021-10-08T19:34:40.113 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5376999999999994e-05 2021-10-08T19:34:40.113 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.113 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.113 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:34:40.114 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:52.347424+0000", 2021-10-08T19:34:40.114 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012482500000000001 2021-10-08T19:34:40.114 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.115 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.115 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:34:40.115 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:52.347520+0000", 2021-10-08T19:34:40.115 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.5891999999999996e-05 2021-10-08T19:34:40.116 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.116 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.116 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:34:40.116 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:52.349982+0000", 2021-10-08T19:34:40.116 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024613880000000001 2021-10-08T19:34:40.117 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.117 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.117 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:40.117 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:52.352936+0000", 2021-10-08T19:34:40.118 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0029545830000000002 2021-10-08T19:34:40.118 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.118 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.118 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:40.119 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:52.439208+0000", 2021-10-08T19:34:40.119 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.086271518000000005 2021-10-08T19:34:40.119 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.119 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.120 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:34:40.120 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:52.439253+0000", 2021-10-08T19:34:40.120 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5371000000000003e-05 2021-10-08T19:34:40.120 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.121 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.121 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:34:40.121 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:29:52.439287+0000", 2021-10-08T19:34:40.121 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4051000000000003e-05 2021-10-08T19:34:40.122 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:40.122 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:34:40.122 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:40.122 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.123 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.123 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:119583 8.2 8:421395fa:::benchmark_data_smithi097_144160_object30843:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e252)", 2021-10-08T19:34:40.123 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:30:14.050334+0000", 2021-10-08T19:34:40.123 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 265.84482709299999, 2021-10-08T19:34:40.124 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.103927964, 2021-10-08T19:34:40.124 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:34:40.124 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:34:40.124 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:34:40.125 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:34:40.125 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:34:40.125 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 119583 2021-10-08T19:34:40.126 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.126 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:34:40.126 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.126 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:34:40.127 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:14.050334+0000", 2021-10-08T19:34:40.127 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:40.127 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.127 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.128 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:34:40.128 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:14.050334+0000", 2021-10-08T19:34:40.128 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:40.128 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.128 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.129 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:34:40.129 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:14.050332+0000", 2021-10-08T19:34:40.129 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:34:40.129 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.130 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.130 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:34:40.130 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:14.050340+0000", 2021-10-08T19:34:40.131 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6470000000000004e-06 2021-10-08T19:34:40.131 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.131 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.131 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:34:40.132 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:14.050354+0000", 2021-10-08T19:34:40.132 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3596e-05 2021-10-08T19:34:40.132 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.132 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.132 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:34:40.133 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:14.050361+0000", 2021-10-08T19:34:40.133 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8349999999999998e-06 2021-10-08T19:34:40.133 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.134 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.134 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:34:40.134 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:14.050415+0000", 2021-10-08T19:34:40.134 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4824000000000002e-05 2021-10-08T19:34:40.134 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.135 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.135 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:34:40.135 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:14.050552+0000", 2021-10-08T19:34:40.135 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013693700000000001 2021-10-08T19:34:40.136 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.136 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.136 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:34:40.136 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:14.050684+0000", 2021-10-08T19:34:40.137 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000131333 2021-10-08T19:34:40.137 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.137 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.137 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:34:40.137 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:14.052542+0000", 2021-10-08T19:34:40.138 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018582990000000001 2021-10-08T19:34:40.145 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.145 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.146 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:40.146 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:14.055882+0000", 2021-10-08T19:34:40.146 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0033396110000000001 2021-10-08T19:34:40.146 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.147 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.147 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:40.147 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:14.154163+0000", 2021-10-08T19:34:40.147 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.098281438999999998 2021-10-08T19:34:40.147 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.148 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.148 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:34:40.148 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:14.154217+0000", 2021-10-08T19:34:40.148 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.3814999999999999e-05 2021-10-08T19:34:40.149 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.149 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.149 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:34:40.149 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:14.154262+0000", 2021-10-08T19:34:40.149 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4838e-05 2021-10-08T19:34:40.150 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:40.150 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:34:40.150 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:40.150 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.151 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.151 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:119594 8.2 8:409687b3:::benchmark_data_smithi097_144160_object30854:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e252)", 2021-10-08T19:34:40.151 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:30:14.059168+0000", 2021-10-08T19:34:40.151 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 265.835992336, 2021-10-08T19:34:40.152 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.097952199000000004, 2021-10-08T19:34:40.152 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:34:40.152 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:34:40.152 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:34:40.152 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:34:40.153 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:34:40.153 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 119594 2021-10-08T19:34:40.153 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.153 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:34:40.154 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.154 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:34:40.154 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:14.059168+0000", 2021-10-08T19:34:40.154 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:40.155 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.155 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.155 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:34:40.156 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:14.059168+0000", 2021-10-08T19:34:40.156 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:40.156 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.157 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.157 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:34:40.157 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:14.059167+0000", 2021-10-08T19:34:40.157 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:34:40.158 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.158 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.158 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:34:40.158 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:14.059172+0000", 2021-10-08T19:34:40.158 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4260000000000002e-06 2021-10-08T19:34:40.159 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.159 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.159 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:34:40.159 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:14.059183+0000", 2021-10-08T19:34:40.160 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0934000000000001e-05 2021-10-08T19:34:40.160 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.160 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.160 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:34:40.160 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:14.059188+0000", 2021-10-08T19:34:40.161 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7360000000000001e-06 2021-10-08T19:34:40.161 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.161 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.161 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:34:40.161 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:14.059230+0000", 2021-10-08T19:34:40.162 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2304e-05 2021-10-08T19:34:40.162 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.162 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.162 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:34:40.163 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:14.059347+0000", 2021-10-08T19:34:40.163 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011709600000000001 2021-10-08T19:34:40.163 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.163 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.163 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:34:40.164 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:14.059427+0000", 2021-10-08T19:34:40.164 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9874000000000001e-05 2021-10-08T19:34:40.164 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.164 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.165 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:34:40.165 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:14.061125+0000", 2021-10-08T19:34:40.165 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00169761 2021-10-08T19:34:40.165 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.166 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.166 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:40.166 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:14.061383+0000", 2021-10-08T19:34:40.167 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00025782499999999999 2021-10-08T19:34:40.167 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.167 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.167 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:40.168 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:14.157023+0000", 2021-10-08T19:34:40.168 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.095640006 2021-10-08T19:34:40.168 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.169 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.169 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:34:40.169 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:14.157069+0000", 2021-10-08T19:34:40.170 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.6003e-05 2021-10-08T19:34:40.170 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.170 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.170 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:34:40.171 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:14.157121+0000", 2021-10-08T19:34:40.171 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1940000000000001e-05 2021-10-08T19:34:40.171 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:40.172 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:34:40.172 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:40.172 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.172 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.172 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:139350 8.2 8:414f9408:::benchmark_data_smithi097_144160_object50610:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e259)", 2021-10-08T19:34:40.173 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:30:35.350712+0000", 2021-10-08T19:34:40.173 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 244.54444861299999, 2021-10-08T19:34:40.174 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.093651133999999997, 2021-10-08T19:34:40.174 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:34:40.174 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:34:40.175 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:34:40.175 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:34:40.175 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:34:40.175 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 139350 2021-10-08T19:34:40.176 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.177 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:34:40.177 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.177 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:34:40.177 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:35.350712+0000", 2021-10-08T19:34:40.177 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:40.178 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.178 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.178 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:34:40.178 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:35.350712+0000", 2021-10-08T19:34:40.179 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:40.179 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.179 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.179 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:34:40.179 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:35.350712+0000", 2021-10-08T19:34:40.180 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999995 2021-10-08T19:34:40.180 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.180 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.180 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:34:40.181 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:35.350715+0000", 2021-10-08T19:34:40.181 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.05e-06 2021-10-08T19:34:40.181 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.181 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.181 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:34:40.182 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:35.351207+0000", 2021-10-08T19:34:40.182 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00049226000000000001 2021-10-08T19:34:40.182 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.182 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.183 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:34:40.183 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:35.351215+0000", 2021-10-08T19:34:40.183 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6000000000000007e-06 2021-10-08T19:34:40.183 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.184 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.184 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:34:40.184 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:35.353130+0000", 2021-10-08T19:34:40.184 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0019147019999999999 2021-10-08T19:34:40.185 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.185 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.185 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:34:40.185 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:35.353255+0000", 2021-10-08T19:34:40.186 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012522499999999999 2021-10-08T19:34:40.186 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.187 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.187 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:34:40.188 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:35.353392+0000", 2021-10-08T19:34:40.188 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013621400000000001 2021-10-08T19:34:40.189 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.189 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.189 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:34:40.190 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:35.357606+0000", 2021-10-08T19:34:40.190 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042140429999999998 2021-10-08T19:34:40.191 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.191 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.192 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:40.192 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:35.359924+0000", 2021-10-08T19:34:40.193 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0023180029999999999 2021-10-08T19:34:40.193 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.194 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.195 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:40.195 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:35.444262+0000", 2021-10-08T19:34:40.196 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.084338862000000001 2021-10-08T19:34:40.201 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.202 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.202 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:34:40.202 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:35.444320+0000", 2021-10-08T19:34:40.202 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7797999999999998e-05 2021-10-08T19:34:40.203 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.204 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.204 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:34:40.204 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:35.444363+0000", 2021-10-08T19:34:40.204 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.3074000000000001e-05 2021-10-08T19:34:40.205 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:40.205 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:34:40.205 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:40.206 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.206 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.207 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:172220 8.2 8:482c3a22:::benchmark_data_smithi097_144160_object83480:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e277)", 2021-10-08T19:34:40.207 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:31:12.338963+0000", 2021-10-08T19:34:40.207 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 207.55619776699999, 2021-10-08T19:34:40.207 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.098746374999999997, 2021-10-08T19:34:40.208 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:34:40.208 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:34:40.208 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:34:40.208 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:34:40.209 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:34:40.209 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 172220 2021-10-08T19:34:40.209 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.209 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:34:40.209 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.210 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:34:40.210 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:31:12.338963+0000", 2021-10-08T19:34:40.210 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:40.210 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.211 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.211 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:34:40.211 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:31:12.338963+0000", 2021-10-08T19:34:40.211 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:40.211 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.212 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.212 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:34:40.212 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:31:12.338960+0000", 2021-10-08T19:34:40.212 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:34:40.212 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.213 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.213 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:34:40.213 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:31:12.338970+0000", 2021-10-08T19:34:40.213 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.1090000000000004e-06 2021-10-08T19:34:40.214 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.214 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.214 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:34:40.214 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:31:12.338982+0000", 2021-10-08T19:34:40.214 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2904e-05 2021-10-08T19:34:40.215 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.215 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.215 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:34:40.215 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:31:12.338990+0000", 2021-10-08T19:34:40.215 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0849999999999999e-06 2021-10-08T19:34:40.216 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.216 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.216 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:34:40.216 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:31:12.339519+0000", 2021-10-08T19:34:40.216 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00052908999999999996 2021-10-08T19:34:40.217 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.217 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.217 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:34:40.217 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:31:12.339604+0000", 2021-10-08T19:34:40.218 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4948000000000001e-05 2021-10-08T19:34:40.218 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.218 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.218 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:34:40.218 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:31:12.339691+0000", 2021-10-08T19:34:40.219 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6890000000000003e-05 2021-10-08T19:34:40.219 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.219 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.219 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:34:40.219 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:31:12.341647+0000", 2021-10-08T19:34:40.220 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001956653 2021-10-08T19:34:40.220 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.220 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.220 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:40.220 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:31:12.344022+0000", 2021-10-08T19:34:40.221 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002375224 2021-10-08T19:34:40.221 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.221 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.221 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:40.222 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:31:12.437591+0000", 2021-10-08T19:34:40.222 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.093568894 2021-10-08T19:34:40.222 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.222 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.222 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:34:40.223 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:31:12.437656+0000", 2021-10-08T19:34:40.223 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4593999999999999e-05 2021-10-08T19:34:40.223 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.223 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.223 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:34:40.224 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:31:12.437709+0000", 2021-10-08T19:34:40.224 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.3560000000000002e-05 2021-10-08T19:34:40.224 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:40.224 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:34:40.225 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:40.225 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.225 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.225 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:172226 8.2 8:43d833e6:::benchmark_data_smithi097_144160_object83486:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e277)", 2021-10-08T19:34:40.226 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:31:12.345357+0000", 2021-10-08T19:34:40.226 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 207.54980408399999, 2021-10-08T19:34:40.226 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.095418002000000002, 2021-10-08T19:34:40.226 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:34:40.227 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:34:40.227 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:34:40.227 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:34:40.227 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:34:40.228 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 172226 2021-10-08T19:34:40.228 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.228 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:34:40.228 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.229 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:34:40.229 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:31:12.345357+0000", 2021-10-08T19:34:40.229 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:40.229 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.229 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.230 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:34:40.230 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:31:12.345357+0000", 2021-10-08T19:34:40.230 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:40.230 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.231 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.231 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:34:40.231 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:31:12.345355+0000", 2021-10-08T19:34:40.231 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:34:40.232 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.232 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.232 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:34:40.233 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:31:12.345362+0000", 2021-10-08T19:34:40.233 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6120000000000001e-06 2021-10-08T19:34:40.233 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.233 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.233 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:34:40.234 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:31:12.345374+0000", 2021-10-08T19:34:40.234 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2249000000000001e-05 2021-10-08T19:34:40.234 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.234 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.235 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:34:40.235 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:31:12.345380+0000", 2021-10-08T19:34:40.235 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2830000000000001e-06 2021-10-08T19:34:40.235 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.236 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.236 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:34:40.236 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:31:12.345430+0000", 2021-10-08T19:34:40.236 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0034000000000002e-05 2021-10-08T19:34:40.236 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.237 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.237 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:34:40.237 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:31:12.345594+0000", 2021-10-08T19:34:40.237 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000163807 2021-10-08T19:34:40.238 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.238 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.238 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:34:40.238 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:31:12.345752+0000", 2021-10-08T19:34:40.239 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000157949 2021-10-08T19:34:40.239 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.239 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.239 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:40.239 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:31:12.348105+0000", 2021-10-08T19:34:40.240 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0023532420000000002 2021-10-08T19:34:40.240 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.240 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.240 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:34:40.241 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:31:12.348195+0000", 2021-10-08T19:34:40.241 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0087999999999995e-05 2021-10-08T19:34:40.241 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.241 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.241 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:40.242 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:31:12.440673+0000", 2021-10-08T19:34:40.242 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.092478437999999996 2021-10-08T19:34:40.242 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.242 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.242 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:34:40.243 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:31:12.440733+0000", 2021-10-08T19:34:40.243 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9345999999999997e-05 2021-10-08T19:34:40.243 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.243 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.244 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:34:40.244 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:31:12.440775+0000", 2021-10-08T19:34:40.244 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2109e-05 2021-10-08T19:34:40.244 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:40.244 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:34:40.245 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:40.245 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.245 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.245 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:208957 9.c e343/290 9:339dfce0:::benchmark_data_smithi097_196985_object93266:head v 343'12904, mlcod=343'12902)", 2021-10-08T19:34:40.245 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:34:37.505770+0000", 2021-10-08T19:34:40.246 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 2.3893908509999999, 2021-10-08T19:34:40.246 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024295852999999999, 2021-10-08T19:34:40.246 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:34:40.246 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:34:40.247 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:34:40.247 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.247 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:34:40.247 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:37.505770+0000", 2021-10-08T19:34:40.247 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:40.248 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.248 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.248 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:34:40.248 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:37.505770+0000", 2021-10-08T19:34:40.248 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:40.249 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.249 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.249 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:34:40.249 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:37.505766+0000", 2021-10-08T19:34:40.250 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999957 2021-10-08T19:34:40.250 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.250 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.250 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:34:40.251 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:37.505778+0000", 2021-10-08T19:34:40.251 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2513e-05 2021-10-08T19:34:40.251 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.251 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.252 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:34:40.252 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:37.505792+0000", 2021-10-08T19:34:40.252 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3616e-05 2021-10-08T19:34:40.252 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.252 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.253 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:34:40.253 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:37.505798+0000", 2021-10-08T19:34:40.253 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1979999999999998e-06 2021-10-08T19:34:40.253 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.254 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.254 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:34:40.254 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:37.507183+0000", 2021-10-08T19:34:40.254 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001384845 2021-10-08T19:34:40.255 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.255 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.255 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:34:40.255 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:37.507205+0000", 2021-10-08T19:34:40.256 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2189999999999999e-05 2021-10-08T19:34:40.256 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.256 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.256 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:34:40.257 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:37.530026+0000", 2021-10-08T19:34:40.257 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.022820801000000002 2021-10-08T19:34:40.257 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.257 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.258 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:34:40.258 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:37.530066+0000", 2021-10-08T19:34:40.258 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9814000000000002e-05 2021-10-08T19:34:40.259 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:40.259 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:34:40.259 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:40.259 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.260 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.260 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:208961 9.c e343/290 9:3e7fdd34:::benchmark_data_smithi097_196985_object93270:head v 343'12905, mlcod=343'12902)", 2021-10-08T19:34:40.261 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:34:37.510491+0000", 2021-10-08T19:34:40.261 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 2.384670319, 2021-10-08T19:34:40.261 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019594699, 2021-10-08T19:34:40.262 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:34:40.262 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:34:40.262 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:34:40.262 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.263 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:34:40.263 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:37.510491+0000", 2021-10-08T19:34:40.263 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:40.263 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.263 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.264 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:34:40.264 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:37.510491+0000", 2021-10-08T19:34:40.264 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:40.264 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.264 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.265 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:34:40.265 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:37.510489+0000", 2021-10-08T19:34:40.265 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:34:40.265 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.266 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.266 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:34:40.266 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:37.510502+0000", 2021-10-08T19:34:40.266 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3740999999999999e-05 2021-10-08T19:34:40.267 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.267 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.267 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:34:40.267 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:37.510515+0000", 2021-10-08T19:34:40.268 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2279000000000001e-05 2021-10-08T19:34:40.268 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.268 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.268 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:34:40.269 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:37.510521+0000", 2021-10-08T19:34:40.269 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7340000000000002e-06 2021-10-08T19:34:40.269 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.269 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.269 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:34:40.270 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:37.510576+0000", 2021-10-08T19:34:40.270 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4664999999999999e-05 2021-10-08T19:34:40.270 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.270 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.271 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:34:40.271 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:37.510595+0000", 2021-10-08T19:34:40.271 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9343000000000001e-05 2021-10-08T19:34:40.271 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.271 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.272 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:34:40.272 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:37.530070+0000", 2021-10-08T19:34:40.272 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019474076999999999 2021-10-08T19:34:40.272 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.273 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.273 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:34:40.273 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:37.530085+0000", 2021-10-08T19:34:40.273 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5684000000000001e-05 2021-10-08T19:34:40.273 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:40.274 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:34:40.274 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:40.274 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.274 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.275 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:208962 9.c e343/290 9:30083528:::benchmark_data_smithi097_196985_object93271:head v 343'12906, mlcod=343'12902)", 2021-10-08T19:34:40.275 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:34:37.512418+0000", 2021-10-08T19:34:40.275 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 2.3827425579999999, 2021-10-08T19:34:40.275 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017677449000000001, 2021-10-08T19:34:40.276 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:34:40.276 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:34:40.276 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:34:40.276 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.276 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:34:40.277 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:37.512418+0000", 2021-10-08T19:34:40.277 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:40.277 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.277 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.277 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:34:40.278 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:37.512418+0000", 2021-10-08T19:34:40.278 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:40.278 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.279 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.279 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:34:40.279 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:37.512417+0000", 2021-10-08T19:34:40.279 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:34:40.280 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.280 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.280 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:34:40.280 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:37.512426+0000", 2021-10-08T19:34:40.280 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.132e-06 2021-10-08T19:34:40.281 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.281 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.281 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:34:40.282 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:37.512436+0000", 2021-10-08T19:34:40.282 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0549e-05 2021-10-08T19:34:40.282 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.282 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.283 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:34:40.283 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:37.512442+0000", 2021-10-08T19:34:40.283 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8680000000000004e-06 2021-10-08T19:34:40.283 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.283 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.284 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:34:40.284 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:37.512759+0000", 2021-10-08T19:34:40.284 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00031682599999999998 2021-10-08T19:34:40.284 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.284 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.285 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:34:40.285 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:37.512777+0000", 2021-10-08T19:34:40.285 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8156999999999999e-05 2021-10-08T19:34:40.285 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.286 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.286 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:34:40.286 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:37.530087+0000", 2021-10-08T19:34:40.286 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017309682999999999 2021-10-08T19:34:40.286 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:40.287 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:40.287 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:34:40.287 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:37.530096+0000", 2021-10-08T19:34:40.287 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.7830000000000004e-06 2021-10-08T19:34:40.288 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:40.288 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:34:40.288 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:40.288 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:40.288 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:34:40.289 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:34:40.289 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2021-10-08T19:34:40.291 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:39 smithi097 ceph-mon[32687]: from='client.25699 v1:172.21.15.97:0/3086673461' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:34:40.291 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:39 smithi097 ceph-mon[32687]: pgmap v661: 178 pgs: 178 active+clean; 1.5 GiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1.11k op/s 2021-10-08T19:34:40.291 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:39 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:34:40.292 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:39 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:34:40.292 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:39 smithi097 ceph-mon[41966]: from='client.25699 v1:172.21.15.97:0/3086673461' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:34:40.292 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:39 smithi097 ceph-mon[41966]: pgmap v661: 178 pgs: 178 active+clean; 1.5 GiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1.11k op/s 2021-10-08T19:34:40.292 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:39 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:34:40.370 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:34:40.379 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:40.380 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:34:40.482 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:34:40.517 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:41.003 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2021-10-08T19:34:41.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:40 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:34:41.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:40 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:34:41.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:40 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:34:41.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:40 smithi117 ceph-mon[34585]: 172.21.15.117 - - [08/Oct/2021:19:34:39] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:34:41.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:40 smithi117 ceph-mon[34585]: osdmap e344: 8 total, 8 up, 8 in 2021-10-08T19:34:41.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:40 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:34:41.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:40 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:34:41.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:40 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:34:41.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:40 smithi097 ceph-mon[32687]: 172.21.15.117 - - [08/Oct/2021:19:34:39] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:34:41.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:40 smithi097 ceph-mon[32687]: osdmap e344: 8 total, 8 up, 8 in 2021-10-08T19:34:41.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:40 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:34:41.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:40 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:34:41.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:40 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:34:41.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:40 smithi097 ceph-mon[41966]: 172.21.15.117 - - [08/Oct/2021:19:34:39] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:34:41.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:40 smithi097 ceph-mon[41966]: osdmap e344: 8 total, 8 up, 8 in 2021-10-08T19:34:41.233 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:34:41.240 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:41.241 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:34:41.317 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":660,"stamp":"2021-10-08T19:34:36.781196+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1721296994,"num_objects":26453,"num_object_clones":0,"num_object_copies":79359,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26453,"num_whiteouts":0,"num_read":1771,"num_read_kb":1537,"num_write":205844,"num_write_kb":7404292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1624,"num_bytes_recovered":72001559,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71428,"ondisk_log_size":71428,"up":534,"acting":534,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":534,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":7011796,"kb_used_data":5160132,"kb_used_omap":0,"kb_used_meta":1850688,"kb_avail":742949420,"statfs":{"total":767960285184,"available":760780206080,"internally_reserved":0,"allocated":5283975168,"data_stored":5281113468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1895104512},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-572850176,"num_objects":-8741,"num_object_clones":0,"num_object_copies":-26223,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-8741,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":8741,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002645"},"pg_stats":[{"pgid":"9.5","version":"343'12703","reported_seq":12770,"reported_epoch":343,"state":"active+clean","last_fresh":"2021-10-08T19:34:34.069228+0000","last_change":"2021-10-08T19:33:36.880651+0000","last_active":"2021-10-08T19:34:34.069228+0000","last_peered":"2021-10-08T19:34:34.069228+0000","last_clean":"2021-10-08T19:34:34.069228+0000","last_became_active":"2021-10-08T19:31:33.860267+0000","last_became_peered":"2021-10-08T19:31:33.860267+0000","last_unstale":"2021-10-08T19:34:34.069228+0000","last_undegraded":"2021-10-08T19:34:34.069228+0000","last_fullsized":"2021-10-08T19:34:34.069228+0000","mapping_epoch":290,"log_start":"324'7700","ondisk_log_start":"324'7700","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"329'8650","last_scrub_stamp":"2021-10-08T19:33:36.880554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:33:36.880554+0000","log_size":5003,"ondisk_log_size":5003,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":1.859313738,"stat_sum":{"num_bytes":106627072,"num_objects":1627,"num_object_clones":0,"num_object_copies":4881,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1627,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12703,"num_write_kb":458560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"114'10","reported_seq":504,"reported_epoch":343,"state":"active+clean","last_fresh":"2021-10-08T19:34:31.762712+0000","last_change":"2021-10-08T19:34:14.586366+0000","last_active":"2021-10-08T19:34:31.762712+0000","last_peered":"2021-10-08T19:34:31.762712+0000","last_clean":"2021-10-08T19:34:31.762712+0000","last_became_active":"2021-10-08T19:24:25.096162+0000","last_became_peered":"2021-10-08T19:24:25.096162+0000","last_unstale":"2021-10-08T19:34:31.762712+0000","last_undegraded":"2021-10-08T19:34:31.762712+0000","last_fullsized":"2021-10-08T19:34:31.762712+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'10","last_scrub_stamp":"2021-10-08T19:34:14.586030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:34:14.586030+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034352250000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"289'34","reported_seq":109,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.838281+0000","last_change":"2021-10-08T19:33:23.562208+0000","last_active":"2021-10-08T19:34:28.838281+0000","last_peered":"2021-10-08T19:34:28.838281+0000","last_clean":"2021-10-08T19:34:28.838281+0000","last_became_active":"2021-10-08T19:31:22.787271+0000","last_became_peered":"2021-10-08T19:31:22.787271+0000","last_unstale":"2021-10-08T19:34:28.838281+0000","last_undegraded":"2021-10-08T19:34:28.838281+0000","last_fullsized":"2021-10-08T19:34:28.838281+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'34","last_scrub_stamp":"2021-10-08T19:33:23.562083+0000","last_deep_scrub":"87'22","last_deep_scrub_stamp":"2021-10-08T19:22:58.705632+0000","last_clean_scrub_stamp":"2021-10-08T19:33:23.562083+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011294012000000001,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":337,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.842994+0000","last_change":"2021-10-08T19:32:41.520904+0000","last_active":"2021-10-08T19:34:28.842994+0000","last_peered":"2021-10-08T19:34:28.842994+0000","last_clean":"2021-10-08T19:34:28.842994+0000","last_became_active":"2021-10-08T19:29:40.632678+0000","last_became_peered":"2021-10-08T19:29:40.632678+0000","last_unstale":"2021-10-08T19:34:28.842994+0000","last_undegraded":"2021-10-08T19:34:28.842994+0000","last_fullsized":"2021-10-08T19:34:28.842994+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:41.520808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:41.520808+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0086535729999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":320,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.838752+0000","last_change":"2021-10-08T19:32:40.772624+0000","last_active":"2021-10-08T19:34:28.838752+0000","last_peered":"2021-10-08T19:34:28.838752+0000","last_clean":"2021-10-08T19:34:28.838752+0000","last_became_active":"2021-10-08T19:24:25.089002+0000","last_became_peered":"2021-10-08T19:24:25.089002+0000","last_unstale":"2021-10-08T19:34:28.838752+0000","last_undegraded":"2021-10-08T19:34:28.838752+0000","last_fullsized":"2021-10-08T19:34:28.838752+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:40.772524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:08.936801+0000","last_clean_scrub_stamp":"2021-10-08T19:32:40.772524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013535126999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":243,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.847906+0000","last_change":"2021-10-08T19:33:28.036369+0000","last_active":"2021-10-08T19:34:28.847906+0000","last_peered":"2021-10-08T19:34:28.847906+0000","last_clean":"2021-10-08T19:34:28.847906+0000","last_became_active":"2021-10-08T19:25:15.510457+0000","last_became_peered":"2021-10-08T19:25:15.510457+0000","last_unstale":"2021-10-08T19:34:28.847906+0000","last_undegraded":"2021-10-08T19:34:28.847906+0000","last_fullsized":"2021-10-08T19:34:28.847906+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:28.036266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:33:28.036266+0000","last_clean_scrub_stamp":"2021-10-08T19:33:28.036266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0045241719999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"343'12963","reported_seq":13022,"reported_epoch":343,"state":"active+clean","last_fresh":"2021-10-08T19:34:33.573903+0000","last_change":"2021-10-08T19:31:33.858962+0000","last_active":"2021-10-08T19:34:33.573903+0000","last_peered":"2021-10-08T19:34:33.573903+0000","last_clean":"2021-10-08T19:34:33.573903+0000","last_became_active":"2021-10-08T19:31:33.858616+0000","last_became_peered":"2021-10-08T19:31:33.858616+0000","last_unstale":"2021-10-08T19:34:33.573903+0000","last_undegraded":"2021-10-08T19:34:33.573903+0000","last_fullsized":"2021-10-08T19:34:33.573903+0000","mapping_epoch":290,"log_start":"328'8500","ondisk_log_start":"328'8500","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.825378+0000","log_size":4463,"ondisk_log_size":4463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":107544576,"num_objects":1641,"num_object_clones":0,"num_object_copies":4923,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1641,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12963,"num_write_kb":467328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,1],"acting":[5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"337'19","reported_seq":380,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.837596+0000","last_change":"2021-10-08T19:34:14.040366+0000","last_active":"2021-10-08T19:34:28.837596+0000","last_peered":"2021-10-08T19:34:28.837596+0000","last_clean":"2021-10-08T19:34:28.837596+0000","last_became_active":"2021-10-08T19:28:40.159729+0000","last_became_peered":"2021-10-08T19:28:40.159729+0000","last_unstale":"2021-10-08T19:34:28.837596+0000","last_undegraded":"2021-10-08T19:34:28.837596+0000","last_fullsized":"2021-10-08T19:34:28.837596+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"337'19","last_scrub_stamp":"2021-10-08T19:34:14.040249+0000","last_deep_scrub":"337'19","last_deep_scrub_stamp":"2021-10-08T19:34:14.040249+0000","last_clean_scrub_stamp":"2021-10-08T19:34:14.040249+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.068085647999999999,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":179,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.847368+0000","last_change":"2021-10-08T19:32:49.595885+0000","last_active":"2021-10-08T19:34:28.847368+0000","last_peered":"2021-10-08T19:34:28.847368+0000","last_clean":"2021-10-08T19:34:28.847368+0000","last_became_active":"2021-10-08T19:29:40.624977+0000","last_became_peered":"2021-10-08T19:29:40.624977+0000","last_unstale":"2021-10-08T19:34:28.847368+0000","last_undegraded":"2021-10-08T19:34:28.847368+0000","last_fullsized":"2021-10-08T19:34:28.847368+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:49.595787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:49.595787+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0093433409999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":329,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.842454+0000","last_change":"2021-10-08T19:33:31.442700+0000","last_active":"2021-10-08T19:34:28.842454+0000","last_peered":"2021-10-08T19:34:28.842454+0000","last_clean":"2021-10-08T19:34:28.842454+0000","last_became_active":"2021-10-08T19:29:40.629422+0000","last_became_peered":"2021-10-08T19:29:40.629422+0000","last_unstale":"2021-10-08T19:34:28.842454+0000","last_undegraded":"2021-10-08T19:34:28.842454+0000","last_fullsized":"2021-10-08T19:34:28.842454+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:31.442595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:33:31.442595+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0061671119999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":305,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.835795+0000","last_change":"2021-10-08T19:32:45.121184+0000","last_active":"2021-10-08T19:34:28.835795+0000","last_peered":"2021-10-08T19:34:28.835795+0000","last_clean":"2021-10-08T19:34:28.835795+0000","last_became_active":"2021-10-08T19:21:29.643022+0000","last_became_peered":"2021-10-08T19:21:29.643022+0000","last_unstale":"2021-10-08T19:34:28.835795+0000","last_undegraded":"2021-10-08T19:34:28.835795+0000","last_fullsized":"2021-10-08T19:34:28.835795+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:45.121072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:32:45.121072+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.057771428999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"70'5","reported_seq":923,"reported_epoch":343,"state":"active+clean","last_fresh":"2021-10-08T19:34:32.378548+0000","last_change":"2021-10-08T19:34:01.651995+0000","last_active":"2021-10-08T19:34:32.378548+0000","last_peered":"2021-10-08T19:34:32.378548+0000","last_clean":"2021-10-08T19:34:32.378548+0000","last_became_active":"2021-10-08T19:29:40.630821+0000","last_became_peered":"2021-10-08T19:29:40.630821+0000","last_unstale":"2021-10-08T19:34:32.378548+0000","last_undegraded":"2021-10-08T19:34:32.378548+0000","last_fullsized":"2021-10-08T19:34:32.378548+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:30:10.566251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:30:10.566251+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0093751019999999997,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":611,"num_read_kb":611,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1167,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.7","version":"343'12720","reported_seq":12781,"reported_epoch":343,"state":"active+clean","last_fresh":"2021-10-08T19:34:33.585344+0000","last_change":"2021-10-08T19:31:33.859765+0000","last_active":"2021-10-08T19:34:33.585344+0000","last_peered":"2021-10-08T19:34:33.585344+0000","last_clean":"2021-10-08T19:34:33.585344+0000","last_became_active":"2021-10-08T19:31:33.859470+0000","last_became_peered":"2021-10-08T19:31:33.859470+0000","last_unstale":"2021-10-08T19:34:33.585344+0000","last_undegraded":"2021-10-08T19:34:33.585344+0000","last_fullsized":"2021-10-08T19:34:33.585344+0000","mapping_epoch":290,"log_start":"328'8243","ondisk_log_start":"328'8243","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.825378+0000","log_size":4477,"ondisk_log_size":4477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":104071168,"num_objects":1588,"num_object_clones":0,"num_object_copies":4764,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1588,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12720,"num_write_kb":457856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"289'35","reported_seq":368,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.841176+0000","last_change":"2021-10-08T19:34:17.416086+0000","last_active":"2021-10-08T19:34:28.841176+0000","last_peered":"2021-10-08T19:34:28.841176+0000","last_clean":"2021-10-08T19:34:28.841176+0000","last_became_active":"2021-10-08T19:28:40.101648+0000","last_became_peered":"2021-10-08T19:28:40.101648+0000","last_unstale":"2021-10-08T19:34:28.841176+0000","last_undegraded":"2021-10-08T19:34:28.841176+0000","last_fullsized":"2021-10-08T19:34:28.841176+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'35","last_scrub_stamp":"2021-10-08T19:34:17.415983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:34:17.415983+0000","log_size":35,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0070104399999999997,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":55,"num_read_kb":44,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":321,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.842963+0000","last_change":"2021-10-08T19:34:19.118563+0000","last_active":"2021-10-08T19:34:28.842963+0000","last_peered":"2021-10-08T19:34:28.842963+0000","last_clean":"2021-10-08T19:34:28.842963+0000","last_became_active":"2021-10-08T19:21:23.595919+0000","last_became_peered":"2021-10-08T19:21:23.595919+0000","last_unstale":"2021-10-08T19:34:28.842963+0000","last_undegraded":"2021-10-08T19:34:28.842963+0000","last_fullsized":"2021-10-08T19:34:28.842963+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:19.118460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:19.118460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0038562129999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":329,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.842610+0000","last_change":"2021-10-08T19:34:17.109330+0000","last_active":"2021-10-08T19:34:28.842610+0000","last_peered":"2021-10-08T19:34:28.842610+0000","last_clean":"2021-10-08T19:34:28.842610+0000","last_became_active":"2021-10-08T19:31:22.783725+0000","last_became_peered":"2021-10-08T19:31:22.783725+0000","last_unstale":"2021-10-08T19:34:28.842610+0000","last_undegraded":"2021-10-08T19:34:28.842610+0000","last_fullsized":"2021-10-08T19:34:28.842610+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:17.109225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:34:17.109225+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0087778820000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":327,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.842101+0000","last_change":"2021-10-08T19:34:20.691431+0000","last_active":"2021-10-08T19:34:28.842101+0000","last_peered":"2021-10-08T19:34:28.842101+0000","last_clean":"2021-10-08T19:34:28.842101+0000","last_became_active":"2021-10-08T19:29:40.638354+0000","last_became_peered":"2021-10-08T19:29:40.638354+0000","last_unstale":"2021-10-08T19:34:28.842101+0000","last_undegraded":"2021-10-08T19:34:28.842101+0000","last_fullsized":"2021-10-08T19:34:28.842101+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:20.691312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:39.528699+0000","last_clean_scrub_stamp":"2021-10-08T19:34:20.691312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0054161239999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":254,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.845317+0000","last_change":"2021-10-08T19:33:15.014419+0000","last_active":"2021-10-08T19:34:28.845317+0000","last_peered":"2021-10-08T19:34:28.845317+0000","last_clean":"2021-10-08T19:34:28.845317+0000","last_became_active":"2021-10-08T19:31:22.785590+0000","last_became_peered":"2021-10-08T19:31:22.785590+0000","last_unstale":"2021-10-08T19:34:28.845317+0000","last_undegraded":"2021-10-08T19:34:28.845317+0000","last_fullsized":"2021-10-08T19:34:28.845317+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:15.014302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:33:15.014302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0066500459999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.0","version":"343'12970","reported_seq":13036,"reported_epoch":343,"state":"active+clean","last_fresh":"2021-10-08T19:34:34.073361+0000","last_change":"2021-10-08T19:34:02.943797+0000","last_active":"2021-10-08T19:34:34.073361+0000","last_peered":"2021-10-08T19:34:34.073361+0000","last_clean":"2021-10-08T19:34:34.073361+0000","last_became_active":"2021-10-08T19:31:34.404922+0000","last_became_peered":"2021-10-08T19:31:34.404922+0000","last_unstale":"2021-10-08T19:34:34.073361+0000","last_undegraded":"2021-10-08T19:34:34.073361+0000","last_fullsized":"2021-10-08T19:34:34.073361+0000","mapping_epoch":290,"log_start":"328'8600","ondisk_log_start":"328'8600","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"334'10784","last_scrub_stamp":"2021-10-08T19:34:02.943715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:34:02.943715+0000","log_size":4370,"ondisk_log_size":4370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":1.5732822230000001,"stat_sum":{"num_bytes":107610112,"num_objects":1642,"num_object_clones":0,"num_object_copies":4926,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1642,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12970,"num_write_kb":467584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.8","version":"90'130","reported_seq":419,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.838427+0000","last_change":"2021-10-08T19:33:59.611856+0000","last_active":"2021-10-08T19:34:28.838427+0000","last_peered":"2021-10-08T19:34:28.838427+0000","last_clean":"2021-10-08T19:34:28.838427+0000","last_became_active":"2021-10-08T19:31:25.647505+0000","last_became_peered":"2021-10-08T19:31:25.647505+0000","last_unstale":"2021-10-08T19:34:28.838427+0000","last_undegraded":"2021-10-08T19:34:28.838427+0000","last_fullsized":"2021-10-08T19:34:28.838427+0000","mapping_epoch":286,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":287,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:23:28.284249+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020087920000000001,"stat_sum":{"num_bytes":53670,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":28,"num_write":16,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":686385,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"289'31","reported_seq":409,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.828064+0000","last_change":"2021-10-08T19:32:35.520408+0000","last_active":"2021-10-08T19:34:28.828064+0000","last_peered":"2021-10-08T19:34:28.828064+0000","last_clean":"2021-10-08T19:34:28.828064+0000","last_became_active":"2021-10-08T19:28:40.099618+0000","last_became_peered":"2021-10-08T19:28:40.099618+0000","last_unstale":"2021-10-08T19:34:28.828064+0000","last_undegraded":"2021-10-08T19:34:28.828064+0000","last_fullsized":"2021-10-08T19:34:28.828064+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'31","last_scrub_stamp":"2021-10-08T19:32:35.520292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:32:35.520292+0000","log_size":31,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0063783820000000001,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":50,"num_read_kb":40,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"61'1","reported_seq":317,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.845125+0000","last_change":"2021-10-08T19:32:34.124480+0000","last_active":"2021-10-08T19:34:28.845125+0000","last_peered":"2021-10-08T19:34:28.845125+0000","last_clean":"2021-10-08T19:34:28.845125+0000","last_became_active":"2021-10-08T19:21:23.607064+0000","last_became_peered":"2021-10-08T19:21:23.607064+0000","last_unstale":"2021-10-08T19:34:28.845125+0000","last_undegraded":"2021-10-08T19:34:28.845125+0000","last_fullsized":"2021-10-08T19:34:28.845125+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'1","last_scrub_stamp":"2021-10-08T19:32:34.124360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:34.124360+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013485919000000001,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":161,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.846960+0000","last_change":"2021-10-08T19:33:28.473187+0000","last_active":"2021-10-08T19:34:28.846960+0000","last_peered":"2021-10-08T19:34:28.846960+0000","last_clean":"2021-10-08T19:34:28.846960+0000","last_became_active":"2021-10-08T19:28:40.152478+0000","last_became_peered":"2021-10-08T19:28:40.152478+0000","last_unstale":"2021-10-08T19:34:28.846960+0000","last_undegraded":"2021-10-08T19:34:28.846960+0000","last_fullsized":"2021-10-08T19:34:28.846960+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:28.473061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:30:09.081635+0000","last_clean_scrub_stamp":"2021-10-08T19:33:28.473061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.015238223,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":329,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.842870+0000","last_change":"2021-10-08T19:34:06.289528+0000","last_active":"2021-10-08T19:34:28.842870+0000","last_peered":"2021-10-08T19:34:28.842870+0000","last_clean":"2021-10-08T19:34:28.842870+0000","last_became_active":"2021-10-08T19:29:40.629424+0000","last_became_peered":"2021-10-08T19:29:40.629424+0000","last_unstale":"2021-10-08T19:34:28.842870+0000","last_undegraded":"2021-10-08T19:34:28.842870+0000","last_fullsized":"2021-10-08T19:34:28.842870+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:06.289410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:34:06.289410+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.125790019,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":293,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.841419+0000","last_change":"2021-10-08T19:33:31.895971+0000","last_active":"2021-10-08T19:34:28.841419+0000","last_peered":"2021-10-08T19:34:28.841419+0000","last_clean":"2021-10-08T19:34:28.841419+0000","last_became_active":"2021-10-08T19:31:51.676829+0000","last_became_peered":"2021-10-08T19:31:51.676829+0000","last_unstale":"2021-10-08T19:34:28.841419+0000","last_undegraded":"2021-10-08T19:34:28.841419+0000","last_fullsized":"2021-10-08T19:34:28.841419+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:31.895862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:33:31.895862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0071960000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"343'12718","reported_seq":12779,"reported_epoch":343,"state":"active+clean","last_fresh":"2021-10-08T19:34:34.071453+0000","last_change":"2021-10-08T19:31:34.405282+0000","last_active":"2021-10-08T19:34:34.071453+0000","last_peered":"2021-10-08T19:34:34.071453+0000","last_clean":"2021-10-08T19:34:34.071453+0000","last_became_active":"2021-10-08T19:31:34.404950+0000","last_became_peered":"2021-10-08T19:31:34.404950+0000","last_unstale":"2021-10-08T19:34:34.071453+0000","last_undegraded":"2021-10-08T19:34:34.071453+0000","last_fullsized":"2021-10-08T19:34:34.071453+0000","mapping_epoch":290,"log_start":"329'8700","ondisk_log_start":"329'8700","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.825378+0000","log_size":4018,"ondisk_log_size":4018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":106823680,"num_objects":1630,"num_object_clones":0,"num_object_copies":4890,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1630,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12718,"num_write_kb":459136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.9","version":"90'130","reported_seq":657,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.844595+0000","last_change":"2021-10-08T19:32:45.137224+0000","last_active":"2021-10-08T19:34:28.844595+0000","last_peered":"2021-10-08T19:34:28.844595+0000","last_clean":"2021-10-08T19:34:28.844595+0000","last_became_active":"2021-10-08T19:29:43.634789+0000","last_became_peered":"2021-10-08T19:29:43.634789+0000","last_unstale":"2021-10-08T19:34:28.844595+0000","last_undegraded":"2021-10-08T19:34:28.844595+0000","last_fullsized":"2021-10-08T19:34:28.844595+0000","mapping_epoch":239,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:32:45.137128+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:32:45.137128+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0066909819999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"289'20","reported_seq":420,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.829823+0000","last_change":"2021-10-08T19:32:43.431315+0000","last_active":"2021-10-08T19:34:28.829823+0000","last_peered":"2021-10-08T19:34:28.829823+0000","last_clean":"2021-10-08T19:34:28.829823+0000","last_became_active":"2021-10-08T19:29:40.631807+0000","last_became_peered":"2021-10-08T19:29:40.631807+0000","last_unstale":"2021-10-08T19:34:28.829823+0000","last_undegraded":"2021-10-08T19:34:28.829823+0000","last_fullsized":"2021-10-08T19:34:28.829823+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'20","last_scrub_stamp":"2021-10-08T19:32:43.431197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:32:43.431197+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0057648359999999997,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":181,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.847271+0000","last_change":"2021-10-08T19:33:32.394260+0000","last_active":"2021-10-08T19:34:28.847271+0000","last_peered":"2021-10-08T19:34:28.847271+0000","last_clean":"2021-10-08T19:34:28.847271+0000","last_became_active":"2021-10-08T19:29:40.638988+0000","last_became_peered":"2021-10-08T19:29:40.638988+0000","last_unstale":"2021-10-08T19:34:28.847271+0000","last_undegraded":"2021-10-08T19:34:28.847271+0000","last_fullsized":"2021-10-08T19:34:28.847271+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:32.394149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:33:32.394149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011814760000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"250'9","reported_seq":480,"reported_epoch":343,"state":"active+clean","last_fresh":"2021-10-08T19:34:31.749778+0000","last_change":"2021-10-08T19:34:10.138016+0000","last_active":"2021-10-08T19:34:31.749778+0000","last_peered":"2021-10-08T19:34:31.749778+0000","last_clean":"2021-10-08T19:34:31.749778+0000","last_became_active":"2021-10-08T19:21:27.637930+0000","last_became_peered":"2021-10-08T19:21:27.637930+0000","last_unstale":"2021-10-08T19:34:31.749778+0000","last_undegraded":"2021-10-08T19:34:31.749778+0000","last_fullsized":"2021-10-08T19:34:31.749778+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'9","last_scrub_stamp":"2021-10-08T19:32:07.490536+0000","last_deep_scrub":"250'9","last_deep_scrub_stamp":"2021-10-08T19:30:04.239189+0000","last_clean_scrub_stamp":"2021-10-08T19:32:07.490536+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0085166219999999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":320,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.828724+0000","last_change":"2021-10-08T19:32:05.558417+0000","last_active":"2021-10-08T19:34:28.828724+0000","last_peered":"2021-10-08T19:34:28.828724+0000","last_clean":"2021-10-08T19:34:28.828724+0000","last_became_active":"2021-10-08T19:28:40.100213+0000","last_became_peered":"2021-10-08T19:28:40.100213+0000","last_unstale":"2021-10-08T19:34:28.828724+0000","last_undegraded":"2021-10-08T19:34:28.828724+0000","last_fullsized":"2021-10-08T19:34:28.828724+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:05.558296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:32:05.558296+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.018815749,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":122,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.834693+0000","last_change":"2021-10-08T19:33:18.913013+0000","last_active":"2021-10-08T19:34:28.834693+0000","last_peered":"2021-10-08T19:34:28.834693+0000","last_clean":"2021-10-08T19:34:28.834693+0000","last_became_active":"2021-10-08T19:29:44.443507+0000","last_became_peered":"2021-10-08T19:29:44.443507+0000","last_unstale":"2021-10-08T19:34:28.834693+0000","last_undegraded":"2021-10-08T19:34:28.834693+0000","last_fullsized":"2021-10-08T19:34:28.834693+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:18.912952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:33:18.912952+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0091031900000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"343'12765","reported_seq":12826,"reported_epoch":343,"state":"active+clean","last_fresh":"2021-10-08T19:34:34.066074+0000","last_change":"2021-10-08T19:31:33.858496+0000","last_active":"2021-10-08T19:34:34.066074+0000","last_peered":"2021-10-08T19:34:34.066074+0000","last_clean":"2021-10-08T19:34:34.066074+0000","last_became_active":"2021-10-08T19:31:33.858205+0000","last_became_peered":"2021-10-08T19:31:33.858205+0000","last_unstale":"2021-10-08T19:34:34.066074+0000","last_undegraded":"2021-10-08T19:34:34.066074+0000","last_fullsized":"2021-10-08T19:34:34.066074+0000","mapping_epoch":290,"log_start":"329'8700","ondisk_log_start":"329'8700","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.825378+0000","log_size":4065,"ondisk_log_size":4065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":105054208,"num_objects":1603,"num_object_clones":0,"num_object_copies":4809,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1603,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12765,"num_write_kb":459776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.a","version":"90'130","reported_seq":491,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.838667+0000","last_change":"2021-10-08T19:34:11.489040+0000","last_active":"2021-10-08T19:34:28.838667+0000","last_peered":"2021-10-08T19:34:28.838667+0000","last_clean":"2021-10-08T19:34:28.838667+0000","last_became_active":"2021-10-08T19:27:26.591129+0000","last_became_peered":"2021-10-08T19:27:26.591129+0000","last_unstale":"2021-10-08T19:34:28.838667+0000","last_undegraded":"2021-10-08T19:34:28.838667+0000","last_fullsized":"2021-10-08T19:34:28.838667+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:34:11.488938+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:34:11.488938+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0022431069999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.f","version":"289'27","reported_seq":57,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.842663+0000","last_change":"2021-10-08T19:33:25.352000+0000","last_active":"2021-10-08T19:34:28.842663+0000","last_peered":"2021-10-08T19:34:28.842663+0000","last_clean":"2021-10-08T19:34:28.842663+0000","last_became_active":"2021-10-08T19:32:45.162914+0000","last_became_peered":"2021-10-08T19:32:45.162914+0000","last_unstale":"2021-10-08T19:34:28.842663+0000","last_undegraded":"2021-10-08T19:34:28.842663+0000","last_fullsized":"2021-10-08T19:34:28.842663+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'27","last_scrub_stamp":"2021-10-08T19:33:25.351908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:33:25.351908+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0073004960000000001,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":550,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":179,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.846673+0000","last_change":"2021-10-08T19:33:23.420571+0000","last_active":"2021-10-08T19:34:28.846673+0000","last_peered":"2021-10-08T19:34:28.846673+0000","last_clean":"2021-10-08T19:34:28.846673+0000","last_became_active":"2021-10-08T19:29:40.631290+0000","last_became_peered":"2021-10-08T19:29:40.631290+0000","last_unstale":"2021-10-08T19:34:28.846673+0000","last_undegraded":"2021-10-08T19:34:28.846673+0000","last_fullsized":"2021-10-08T19:34:28.846673+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:23.420464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:30:11.102934+0000","last_clean_scrub_stamp":"2021-10-08T19:33:23.420464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0090076059999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"88'9","reported_seq":474,"reported_epoch":343,"state":"active+clean","last_fresh":"2021-10-08T19:34:31.755605+0000","last_change":"2021-10-08T19:32:44.385874+0000","last_active":"2021-10-08T19:34:31.755605+0000","last_peered":"2021-10-08T19:34:31.755605+0000","last_clean":"2021-10-08T19:34:31.755605+0000","last_became_active":"2021-10-08T19:21:27.636432+0000","last_became_peered":"2021-10-08T19:21:27.636432+0000","last_unstale":"2021-10-08T19:34:31.755605+0000","last_undegraded":"2021-10-08T19:34:31.755605+0000","last_fullsized":"2021-10-08T19:34:31.755605+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'9","last_scrub_stamp":"2021-10-08T19:32:44.385765+0000","last_deep_scrub":"88'9","last_deep_scrub_stamp":"2021-10-08T19:23:00.048245+0000","last_clean_scrub_stamp":"2021-10-08T19:32:44.385765+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0082317169999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":324,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.840197+0000","last_change":"2021-10-08T19:34:02.605330+0000","last_active":"2021-10-08T19:34:28.840197+0000","last_peered":"2021-10-08T19:34:28.840197+0000","last_clean":"2021-10-08T19:34:28.840197+0000","last_became_active":"2021-10-08T19:28:40.137966+0000","last_became_peered":"2021-10-08T19:28:40.137966+0000","last_unstale":"2021-10-08T19:34:28.840197+0000","last_undegraded":"2021-10-08T19:34:28.840197+0000","last_fullsized":"2021-10-08T19:34:28.840197+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:30:32.621835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:30:32.621835+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.01635269,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.8","version":"70'5","reported_seq":122,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.834944+0000","last_change":"2021-10-08T19:32:39.783608+0000","last_active":"2021-10-08T19:34:28.834944+0000","last_peered":"2021-10-08T19:34:28.834944+0000","last_clean":"2021-10-08T19:34:28.834944+0000","last_became_active":"2021-10-08T19:29:40.639786+0000","last_became_peered":"2021-10-08T19:29:40.639786+0000","last_unstale":"2021-10-08T19:34:28.834944+0000","last_undegraded":"2021-10-08T19:34:28.834944+0000","last_fullsized":"2021-10-08T19:34:28.834944+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:32:39.783498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:39.783498+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0078782899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3","version":"343'13075","reported_seq":13136,"reported_epoch":343,"state":"active+clean","last_fresh":"2021-10-08T19:34:33.622467+0000","last_change":"2021-10-08T19:31:33.862720+0000","last_active":"2021-10-08T19:34:33.622467+0000","last_peered":"2021-10-08T19:34:33.622467+0000","last_clean":"2021-10-08T19:34:33.622467+0000","last_became_active":"2021-10-08T19:31:33.861869+0000","last_became_peered":"2021-10-08T19:31:33.861869+0000","last_unstale":"2021-10-08T19:34:33.622467+0000","last_undegraded":"2021-10-08T19:34:33.622467+0000","last_fullsized":"2021-10-08T19:34:33.622467+0000","mapping_epoch":290,"log_start":"330'9300","ondisk_log_start":"330'9300","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.825378+0000","log_size":3775,"ondisk_log_size":3775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":111607808,"num_objects":1703,"num_object_clones":0,"num_object_copies":5109,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1703,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13075,"num_write_kb":472896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"289'19","reported_seq":484,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.828564+0000","last_change":"2021-10-08T19:32:48.385494+0000","last_active":"2021-10-08T19:34:28.828564+0000","last_peered":"2021-10-08T19:34:28.828564+0000","last_clean":"2021-10-08T19:34:28.828564+0000","last_became_active":"2021-10-08T19:31:51.677509+0000","last_became_peered":"2021-10-08T19:31:51.677509+0000","last_unstale":"2021-10-08T19:34:28.828564+0000","last_undegraded":"2021-10-08T19:34:28.828564+0000","last_fullsized":"2021-10-08T19:34:28.828564+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:32:48.385367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:32:48.385367+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0082509920000000004,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":770,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":335,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.842247+0000","last_change":"2021-10-08T19:33:23.001573+0000","last_active":"2021-10-08T19:34:28.842247+0000","last_peered":"2021-10-08T19:34:28.842247+0000","last_clean":"2021-10-08T19:34:28.842247+0000","last_became_active":"2021-10-08T19:28:40.100691+0000","last_became_peered":"2021-10-08T19:28:40.100691+0000","last_unstale":"2021-10-08T19:34:28.842247+0000","last_undegraded":"2021-10-08T19:34:28.842247+0000","last_fullsized":"2021-10-08T19:34:28.842247+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:23.001455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:33:23.001455+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0091227059999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":322,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.839335+0000","last_change":"2021-10-08T19:33:17.529783+0000","last_active":"2021-10-08T19:34:28.839335+0000","last_peered":"2021-10-08T19:34:28.839335+0000","last_clean":"2021-10-08T19:34:28.839335+0000","last_became_active":"2021-10-08T19:24:25.105244+0000","last_became_peered":"2021-10-08T19:24:25.105244+0000","last_unstale":"2021-10-08T19:34:28.839335+0000","last_undegraded":"2021-10-08T19:34:28.839335+0000","last_fullsized":"2021-10-08T19:34:28.839335+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:17.529713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:33:17.529713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011576375999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":128,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.836995+0000","last_change":"2021-10-08T19:33:21.903287+0000","last_active":"2021-10-08T19:34:28.836995+0000","last_peered":"2021-10-08T19:34:28.836995+0000","last_clean":"2021-10-08T19:34:28.836995+0000","last_became_active":"2021-10-08T19:29:40.638099+0000","last_became_peered":"2021-10-08T19:29:40.638099+0000","last_unstale":"2021-10-08T19:34:28.836995+0000","last_undegraded":"2021-10-08T19:34:28.836995+0000","last_fullsized":"2021-10-08T19:34:28.836995+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:21.903188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:17.422176+0000","last_clean_scrub_stamp":"2021-10-08T19:33:21.903188+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014417607000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":259,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.826548+0000","last_change":"2021-10-08T19:32:51.293238+0000","last_active":"2021-10-08T19:34:28.826548+0000","last_peered":"2021-10-08T19:34:28.826548+0000","last_clean":"2021-10-08T19:34:28.826548+0000","last_became_active":"2021-10-08T19:24:13.506602+0000","last_became_peered":"2021-10-08T19:24:13.506602+0000","last_unstale":"2021-10-08T19:34:28.826548+0000","last_undegraded":"2021-10-08T19:34:28.826548+0000","last_fullsized":"2021-10-08T19:34:28.826548+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:51.293159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:51.293159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0082740520000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.c","version":"343'12684","reported_seq":12745,"reported_epoch":343,"state":"active+clean","last_fresh":"2021-10-08T19:34:34.079586+0000","last_change":"2021-10-08T19:31:33.861894+0000","last_active":"2021-10-08T19:34:34.079586+0000","last_peered":"2021-10-08T19:34:34.079586+0000","last_clean":"2021-10-08T19:34:34.079586+0000","last_became_active":"2021-10-08T19:31:33.861544+0000","last_became_peered":"2021-10-08T19:31:33.861544+0000","last_unstale":"2021-10-08T19:34:34.079586+0000","last_undegraded":"2021-10-08T19:34:34.079586+0000","last_fullsized":"2021-10-08T19:34:34.079586+0000","mapping_epoch":290,"log_start":"328'8600","ondisk_log_start":"328'8600","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.825378+0000","log_size":4084,"ondisk_log_size":4084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":104988672,"num_objects":1602,"num_object_clones":0,"num_object_copies":4806,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1602,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12684,"num_write_kb":457152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"90'130","reported_seq":452,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.836909+0000","last_change":"2021-10-08T19:32:46.759726+0000","last_active":"2021-10-08T19:34:28.836909+0000","last_peered":"2021-10-08T19:34:28.836909+0000","last_clean":"2021-10-08T19:34:28.836909+0000","last_became_active":"2021-10-08T19:29:43.636733+0000","last_became_peered":"2021-10-08T19:29:43.636733+0000","last_unstale":"2021-10-08T19:34:28.836909+0000","last_undegraded":"2021-10-08T19:34:28.836909+0000","last_fullsized":"2021-10-08T19:34:28.836909+0000","mapping_epoch":239,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:32:46.759636+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:32:46.759636+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013166881,"stat_sum":{"num_bytes":327680,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"238'13","reported_seq":187,"reported_epoch":343,"state":"active+clean","last_fresh":"2021-10-08T19:34:31.752362+0000","last_change":"2021-10-08T19:31:21.473012+0000","last_active":"2021-10-08T19:34:31.752362+0000","last_peered":"2021-10-08T19:34:31.752362+0000","last_clean":"2021-10-08T19:34:31.752362+0000","last_became_active":"2021-10-08T19:29:40.640248+0000","last_became_peered":"2021-10-08T19:29:40.640248+0000","last_unstale":"2021-10-08T19:34:31.752362+0000","last_undegraded":"2021-10-08T19:34:31.752362+0000","last_fullsized":"2021-10-08T19:34:31.752362+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"238'13","last_scrub_stamp":"2021-10-08T19:31:21.472930+0000","last_deep_scrub":"91'9","last_deep_scrub_stamp":"2021-10-08T19:23:32.329475+0000","last_clean_scrub_stamp":"2021-10-08T19:31:21.472930+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040000679999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"289'28","reported_seq":398,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.826756+0000","last_change":"2021-10-08T19:32:02.490565+0000","last_active":"2021-10-08T19:34:28.826756+0000","last_peered":"2021-10-08T19:34:28.826756+0000","last_clean":"2021-10-08T19:34:28.826756+0000","last_became_active":"2021-10-08T19:24:25.098743+0000","last_became_peered":"2021-10-08T19:24:25.098743+0000","last_unstale":"2021-10-08T19:34:28.826756+0000","last_undegraded":"2021-10-08T19:34:28.826756+0000","last_fullsized":"2021-10-08T19:34:28.826756+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'28","last_scrub_stamp":"2021-10-08T19:32:02.490435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:32:02.490435+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.005683698,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":42,"num_read_kb":35,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":251,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.840902+0000","last_change":"2021-10-08T19:32:36.867281+0000","last_active":"2021-10-08T19:34:28.840902+0000","last_peered":"2021-10-08T19:34:28.840902+0000","last_clean":"2021-10-08T19:34:28.840902+0000","last_became_active":"2021-10-08T19:24:25.094364+0000","last_became_peered":"2021-10-08T19:24:25.094364+0000","last_unstale":"2021-10-08T19:34:28.840902+0000","last_undegraded":"2021-10-08T19:34:28.840902+0000","last_fullsized":"2021-10-08T19:34:28.840902+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:36.867172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:36.867172+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0036742749999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":323,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.845441+0000","last_change":"2021-10-08T19:32:15.378399+0000","last_active":"2021-10-08T19:34:28.845441+0000","last_peered":"2021-10-08T19:34:28.845441+0000","last_clean":"2021-10-08T19:34:28.845441+0000","last_became_active":"2021-10-08T19:24:25.094848+0000","last_became_peered":"2021-10-08T19:24:25.094848+0000","last_unstale":"2021-10-08T19:34:28.845441+0000","last_undegraded":"2021-10-08T19:34:28.845441+0000","last_fullsized":"2021-10-08T19:34:28.845441+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:15.378288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:32:15.378288+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.043151555000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":282,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.835663+0000","last_change":"2021-10-08T19:34:12.966540+0000","last_active":"2021-10-08T19:34:28.835663+0000","last_peered":"2021-10-08T19:34:28.835663+0000","last_clean":"2021-10-08T19:34:28.835663+0000","last_became_active":"2021-10-08T19:28:40.132751+0000","last_became_peered":"2021-10-08T19:28:40.132751+0000","last_unstale":"2021-10-08T19:34:28.835663+0000","last_undegraded":"2021-10-08T19:34:28.835663+0000","last_fullsized":"2021-10-08T19:34:28.835663+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:03.274966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:03.274966+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001658084,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.d","version":"343'12900","reported_seq":15153,"reported_epoch":343,"state":"active+clean","last_fresh":"2021-10-08T19:34:33.629947+0000","last_change":"2021-10-08T19:32:03.749570+0000","last_active":"2021-10-08T19:34:33.629947+0000","last_peered":"2021-10-08T19:34:33.629947+0000","last_clean":"2021-10-08T19:34:33.629947+0000","last_became_active":"2021-10-08T19:32:03.747395+0000","last_became_peered":"2021-10-08T19:32:03.747395+0000","last_unstale":"2021-10-08T19:34:33.629947+0000","last_undegraded":"2021-10-08T19:34:33.629947+0000","last_fullsized":"2021-10-08T19:34:33.629947+0000","mapping_epoch":308,"log_start":"330'9100","ondisk_log_start":"330'9100","created":290,"last_epoch_clean":309,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.825378+0000","log_size":3800,"ondisk_log_size":3800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110297112,"num_objects":1684,"num_object_clones":0,"num_object_copies":5052,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1684,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":12900,"num_write_kb":466625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1088,"num_bytes_recovered":71303168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5],"acting":[7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.5","version":"90'130","reported_seq":485,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.827675+0000","last_change":"2021-10-08T19:32:14.582950+0000","last_active":"2021-10-08T19:34:28.827675+0000","last_peered":"2021-10-08T19:34:28.827675+0000","last_clean":"2021-10-08T19:34:28.827675+0000","last_became_active":"2021-10-08T19:27:26.590651+0000","last_became_peered":"2021-10-08T19:27:26.590651+0000","last_unstale":"2021-10-08T19:34:28.827675+0000","last_undegraded":"2021-10-08T19:34:28.827675+0000","last_fullsized":"2021-10-08T19:34:28.827675+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:32:14.582883+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:32:14.582883+0000","last_clean_scrub_stamp":"2021-10-08T19:32:14.582883+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0031287540000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":322,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.827036+0000","last_change":"2021-10-08T19:32:08.581599+0000","last_active":"2021-10-08T19:34:28.827036+0000","last_peered":"2021-10-08T19:34:28.827036+0000","last_clean":"2021-10-08T19:34:28.827036+0000","last_became_active":"2021-10-08T19:29:40.639405+0000","last_became_peered":"2021-10-08T19:29:40.639405+0000","last_unstale":"2021-10-08T19:34:28.827036+0000","last_undegraded":"2021-10-08T19:34:28.827036+0000","last_fullsized":"2021-10-08T19:34:28.827036+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:08.581479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:32:08.581479+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012079604000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"289'30","reported_seq":164,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.834777+0000","last_change":"2021-10-08T19:34:06.085387+0000","last_active":"2021-10-08T19:34:28.834777+0000","last_peered":"2021-10-08T19:34:28.834777+0000","last_clean":"2021-10-08T19:34:28.834777+0000","last_became_active":"2021-10-08T19:29:40.635007+0000","last_became_peered":"2021-10-08T19:29:40.635007+0000","last_unstale":"2021-10-08T19:34:28.834777+0000","last_undegraded":"2021-10-08T19:34:28.834777+0000","last_fullsized":"2021-10-08T19:34:28.834777+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'30","last_scrub_stamp":"2021-10-08T19:34:06.085282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:34:06.085282+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.015398577,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":51,"num_read_kb":39,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":155,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.855784+0000","last_change":"2021-10-08T19:32:42.574389+0000","last_active":"2021-10-08T19:34:28.855784+0000","last_peered":"2021-10-08T19:34:28.855784+0000","last_clean":"2021-10-08T19:34:28.855784+0000","last_became_active":"2021-10-08T19:28:40.141714+0000","last_became_peered":"2021-10-08T19:28:40.141714+0000","last_unstale":"2021-10-08T19:34:28.855784+0000","last_undegraded":"2021-10-08T19:34:28.855784+0000","last_fullsized":"2021-10-08T19:34:28.855784+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:42.574293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:07.710367+0000","last_clean_scrub_stamp":"2021-10-08T19:32:42.574293+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.035504648,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":320,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.826807+0000","last_change":"2021-10-08T19:32:49.356419+0000","last_active":"2021-10-08T19:34:28.826807+0000","last_peered":"2021-10-08T19:34:28.826807+0000","last_clean":"2021-10-08T19:34:28.826807+0000","last_became_active":"2021-10-08T19:29:40.638253+0000","last_became_peered":"2021-10-08T19:29:40.638253+0000","last_unstale":"2021-10-08T19:34:28.826807+0000","last_undegraded":"2021-10-08T19:34:28.826807+0000","last_fullsized":"2021-10-08T19:34:28.826807+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:49.356299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:32:49.356299+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.007536137,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":122,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.835351+0000","last_change":"2021-10-08T19:32:41.758468+0000","last_active":"2021-10-08T19:34:28.835351+0000","last_peered":"2021-10-08T19:34:28.835351+0000","last_clean":"2021-10-08T19:34:28.835351+0000","last_became_active":"2021-10-08T19:29:40.634579+0000","last_became_peered":"2021-10-08T19:29:40.634579+0000","last_unstale":"2021-10-08T19:34:28.835351+0000","last_undegraded":"2021-10-08T19:34:28.835351+0000","last_fullsized":"2021-10-08T19:34:28.835351+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:41.758382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:41.758382+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.015929216999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"343'12737","reported_seq":12804,"reported_epoch":343,"state":"active+clean","last_fresh":"2021-10-08T19:34:33.632000+0000","last_change":"2021-10-08T19:34:13.621217+0000","last_active":"2021-10-08T19:34:33.632000+0000","last_peered":"2021-10-08T19:34:33.632000+0000","last_clean":"2021-10-08T19:34:33.632000+0000","last_became_active":"2021-10-08T19:31:33.861748+0000","last_became_peered":"2021-10-08T19:31:33.861748+0000","last_unstale":"2021-10-08T19:34:33.632000+0000","last_undegraded":"2021-10-08T19:34:33.632000+0000","last_fullsized":"2021-10-08T19:34:33.632000+0000","mapping_epoch":290,"log_start":"330'8900","ondisk_log_start":"330'8900","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"337'11353","last_scrub_stamp":"2021-10-08T19:34:13.621140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:34:13.621140+0000","log_size":3837,"ondisk_log_size":3837,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.98600984000000003,"stat_sum":{"num_bytes":111476736,"num_objects":1701,"num_object_clones":0,"num_object_copies":5103,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1701,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12737,"num_write_kb":462016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.6","version":"90'130","reported_seq":420,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.840831+0000","last_change":"2021-10-08T19:34:07.251557+0000","last_active":"2021-10-08T19:34:28.840831+0000","last_peered":"2021-10-08T19:34:28.840831+0000","last_clean":"2021-10-08T19:34:28.840831+0000","last_became_active":"2021-10-08T19:30:00.643797+0000","last_became_peered":"2021-10-08T19:30:00.643797+0000","last_unstale":"2021-10-08T19:34:28.840831+0000","last_undegraded":"2021-10-08T19:34:28.840831+0000","last_fullsized":"2021-10-08T19:34:28.840831+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:32:34.820273+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:32:34.820273+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0080506420000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":257,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.841257+0000","last_change":"2021-10-08T19:32:52.822269+0000","last_active":"2021-10-08T19:34:28.841257+0000","last_peered":"2021-10-08T19:34:28.841257+0000","last_clean":"2021-10-08T19:34:28.841257+0000","last_became_active":"2021-10-08T19:24:25.095389+0000","last_became_peered":"2021-10-08T19:24:25.095389+0000","last_unstale":"2021-10-08T19:34:28.841257+0000","last_undegraded":"2021-10-08T19:34:28.841257+0000","last_fullsized":"2021-10-08T19:34:28.841257+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:52.822170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:32:52.822170+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0019409270000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"289'29","reported_seq":364,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.837431+0000","last_change":"2021-10-08T19:33:21.055265+0000","last_active":"2021-10-08T19:34:28.837431+0000","last_peered":"2021-10-08T19:34:28.837431+0000","last_clean":"2021-10-08T19:34:28.837431+0000","last_became_active":"2021-10-08T19:21:25.741812+0000","last_became_peered":"2021-10-08T19:21:25.741812+0000","last_unstale":"2021-10-08T19:34:28.837431+0000","last_undegraded":"2021-10-08T19:34:28.837431+0000","last_fullsized":"2021-10-08T19:34:28.837431+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'29","last_scrub_stamp":"2021-10-08T19:33:21.055136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:33:21.055136+0000","log_size":29,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0053848539999999997,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":54,"num_read_kb":40,"num_write":32,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"328'2","reported_seq":325,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.845517+0000","last_change":"2021-10-08T19:33:29.990487+0000","last_active":"2021-10-08T19:34:28.845517+0000","last_peered":"2021-10-08T19:34:28.845517+0000","last_clean":"2021-10-08T19:34:28.845517+0000","last_became_active":"2021-10-08T19:21:23.604258+0000","last_became_peered":"2021-10-08T19:21:23.604258+0000","last_unstale":"2021-10-08T19:34:28.845517+0000","last_undegraded":"2021-10-08T19:34:28.845517+0000","last_fullsized":"2021-10-08T19:34:28.845517+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"328'2","last_scrub_stamp":"2021-10-08T19:33:29.990395+0000","last_deep_scrub":"328'2","last_deep_scrub_stamp":"2021-10-08T19:33:29.990395+0000","last_clean_scrub_stamp":"2021-10-08T19:33:29.990395+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.020847460000000002,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":155,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.846469+0000","last_change":"2021-10-08T19:32:34.604785+0000","last_active":"2021-10-08T19:34:28.846469+0000","last_peered":"2021-10-08T19:34:28.846469+0000","last_clean":"2021-10-08T19:34:28.846469+0000","last_became_active":"2021-10-08T19:28:40.140876+0000","last_became_peered":"2021-10-08T19:28:40.140876+0000","last_unstale":"2021-10-08T19:34:28.846469+0000","last_undegraded":"2021-10-08T19:34:28.846469+0000","last_fullsized":"2021-10-08T19:34:28.846469+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:34.604679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:32:34.604679+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.029912211000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"70'5","reported_seq":161,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.848767+0000","last_change":"2021-10-08T19:34:06.579244+0000","last_active":"2021-10-08T19:34:28.848767+0000","last_peered":"2021-10-08T19:34:28.848767+0000","last_clean":"2021-10-08T19:34:28.848767+0000","last_became_active":"2021-10-08T19:28:40.150503+0000","last_became_peered":"2021-10-08T19:28:40.150503+0000","last_unstale":"2021-10-08T19:34:28.848767+0000","last_undegraded":"2021-10-08T19:34:28.848767+0000","last_fullsized":"2021-10-08T19:34:28.848767+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:34:06.579131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:06.579131+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0046237709999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"343'12718","reported_seq":12785,"reported_epoch":343,"state":"active+clean","last_fresh":"2021-10-08T19:34:34.084793+0000","last_change":"2021-10-08T19:34:11.022967+0000","last_active":"2021-10-08T19:34:34.084793+0000","last_peered":"2021-10-08T19:34:34.084793+0000","last_clean":"2021-10-08T19:34:34.084793+0000","last_became_active":"2021-10-08T19:31:34.405616+0000","last_became_peered":"2021-10-08T19:31:34.405616+0000","last_unstale":"2021-10-08T19:34:34.084793+0000","last_undegraded":"2021-10-08T19:34:34.084793+0000","last_fullsized":"2021-10-08T19:34:34.084793+0000","mapping_epoch":290,"log_start":"324'7700","ondisk_log_start":"324'7700","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"336'11102","last_scrub_stamp":"2021-10-08T19:34:11.022854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:34:11.022854+0000","log_size":5018,"ondisk_log_size":5018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":1.1536645059999999,"stat_sum":{"num_bytes":104595456,"num_objects":1596,"num_object_clones":0,"num_object_copies":4788,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1596,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12718,"num_write_kb":458048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"90'130","reported_seq":462,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.846660+0000","last_change":"2021-10-08T19:34:13.653358+0000","last_active":"2021-10-08T19:34:28.846660+0000","last_peered":"2021-10-08T19:34:28.846660+0000","last_clean":"2021-10-08T19:34:28.846660+0000","last_became_active":"2021-10-08T19:28:43.178371+0000","last_became_peered":"2021-10-08T19:28:43.178371+0000","last_unstale":"2021-10-08T19:34:28.846660+0000","last_undegraded":"2021-10-08T19:34:28.846660+0000","last_fullsized":"2021-10-08T19:34:28.846660+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:34:13.653248+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:34:13.653248+0000","last_clean_scrub_stamp":"2021-10-08T19:34:13.653248+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0071729649999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":75,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.839196+0000","last_change":"2021-10-08T19:33:21.590512+0000","last_active":"2021-10-08T19:34:28.839196+0000","last_peered":"2021-10-08T19:34:28.839196+0000","last_clean":"2021-10-08T19:34:28.839196+0000","last_became_active":"2021-10-08T19:31:22.783759+0000","last_became_peered":"2021-10-08T19:31:22.783759+0000","last_unstale":"2021-10-08T19:34:28.839196+0000","last_undegraded":"2021-10-08T19:34:28.839196+0000","last_fullsized":"2021-10-08T19:34:28.839196+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:21.590400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:33:21.590400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.022083749,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"289'24","reported_seq":416,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.835823+0000","last_change":"2021-10-08T19:33:23.117133+0000","last_active":"2021-10-08T19:34:28.835823+0000","last_peered":"2021-10-08T19:34:28.835823+0000","last_clean":"2021-10-08T19:34:28.835823+0000","last_became_active":"2021-10-08T19:32:45.154743+0000","last_became_peered":"2021-10-08T19:32:45.154743+0000","last_unstale":"2021-10-08T19:34:28.835823+0000","last_undegraded":"2021-10-08T19:34:28.835823+0000","last_fullsized":"2021-10-08T19:34:28.835823+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'24","last_scrub_stamp":"2021-10-08T19:33:23.117023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:33:23.117023+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0078508209999999991,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":30,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":298,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.842245+0000","last_change":"2021-10-08T19:32:38.544368+0000","last_active":"2021-10-08T19:34:28.842245+0000","last_peered":"2021-10-08T19:34:28.842245+0000","last_clean":"2021-10-08T19:34:28.842245+0000","last_became_active":"2021-10-08T19:28:40.140231+0000","last_became_peered":"2021-10-08T19:28:40.140231+0000","last_unstale":"2021-10-08T19:34:28.842245+0000","last_undegraded":"2021-10-08T19:34:28.842245+0000","last_fullsized":"2021-10-08T19:34:28.842245+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:38.544294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:32.922694+0000","last_clean_scrub_stamp":"2021-10-08T19:32:38.544294+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001371017,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":345,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.835510+0000","last_change":"2021-10-08T19:32:50.969378+0000","last_active":"2021-10-08T19:34:28.835510+0000","last_peered":"2021-10-08T19:34:28.835510+0000","last_clean":"2021-10-08T19:34:28.835510+0000","last_became_active":"2021-10-08T19:29:40.632010+0000","last_became_peered":"2021-10-08T19:29:40.632010+0000","last_unstale":"2021-10-08T19:34:28.835510+0000","last_undegraded":"2021-10-08T19:34:28.835510+0000","last_fullsized":"2021-10-08T19:34:28.835510+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:50.969293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:50.969293+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.015235362000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":63,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.846469+0000","last_change":"2021-10-08T19:34:21.644930+0000","last_active":"2021-10-08T19:34:28.846469+0000","last_peered":"2021-10-08T19:34:28.846469+0000","last_clean":"2021-10-08T19:34:28.846469+0000","last_became_active":"2021-10-08T19:31:51.673821+0000","last_became_peered":"2021-10-08T19:31:51.673821+0000","last_unstale":"2021-10-08T19:34:28.846469+0000","last_undegraded":"2021-10-08T19:34:28.846469+0000","last_fullsized":"2021-10-08T19:34:28.846469+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:21.644827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:21.644827+0000","last_clean_scrub_stamp":"2021-10-08T19:34:21.644827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0073867230000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"343'13055","reported_seq":13116,"reported_epoch":343,"state":"active+clean","last_fresh":"2021-10-08T19:34:34.084227+0000","last_change":"2021-10-08T19:31:33.860786+0000","last_active":"2021-10-08T19:34:34.084227+0000","last_peered":"2021-10-08T19:34:34.084227+0000","last_clean":"2021-10-08T19:34:34.084227+0000","last_became_active":"2021-10-08T19:31:33.860551+0000","last_became_peered":"2021-10-08T19:31:33.860551+0000","last_unstale":"2021-10-08T19:34:34.084227+0000","last_undegraded":"2021-10-08T19:34:34.084227+0000","last_fullsized":"2021-10-08T19:34:34.084227+0000","mapping_epoch":290,"log_start":"330'9000","ondisk_log_start":"330'9000","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.825378+0000","log_size":4055,"ondisk_log_size":4055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":106233856,"num_objects":1621,"num_object_clones":0,"num_object_copies":4863,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1621,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13055,"num_write_kb":469632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":305,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.846201+0000","last_change":"2021-10-08T19:32:10.312482+0000","last_active":"2021-10-08T19:34:28.846201+0000","last_peered":"2021-10-08T19:34:28.846201+0000","last_clean":"2021-10-08T19:34:28.846201+0000","last_became_active":"2021-10-08T19:21:27.636086+0000","last_became_peered":"2021-10-08T19:21:27.636086+0000","last_unstale":"2021-10-08T19:34:28.846201+0000","last_undegraded":"2021-10-08T19:34:28.846201+0000","last_fullsized":"2021-10-08T19:34:28.846201+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:10.312378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:32:10.312378+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013579486,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"289'26","reported_seq":291,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.840750+0000","last_change":"2021-10-08T19:33:24.895190+0000","last_active":"2021-10-08T19:34:28.840750+0000","last_peered":"2021-10-08T19:34:28.840750+0000","last_clean":"2021-10-08T19:34:28.840750+0000","last_became_active":"2021-10-08T19:24:25.100384+0000","last_became_peered":"2021-10-08T19:24:25.100384+0000","last_unstale":"2021-10-08T19:34:28.840750+0000","last_undegraded":"2021-10-08T19:34:28.840750+0000","last_fullsized":"2021-10-08T19:34:28.840750+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'26","last_scrub_stamp":"2021-10-08T19:33:24.895081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:33:24.895081+0000","log_size":26,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0077530389999999998,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":42,"num_read_kb":32,"num_write":25,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"90'130","reported_seq":624,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.842177+0000","last_change":"2021-10-08T19:33:59.796799+0000","last_active":"2021-10-08T19:34:28.842177+0000","last_peered":"2021-10-08T19:34:28.842177+0000","last_clean":"2021-10-08T19:34:28.842177+0000","last_became_active":"2021-10-08T19:27:22.607289+0000","last_became_peered":"2021-10-08T19:27:22.607289+0000","last_unstale":"2021-10-08T19:34:28.842177+0000","last_undegraded":"2021-10-08T19:34:28.842177+0000","last_fullsized":"2021-10-08T19:34:28.842177+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:33:59.796700+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:33:59.796700+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0060175439999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":308,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.838384+0000","last_change":"2021-10-08T19:32:42.759368+0000","last_active":"2021-10-08T19:34:28.838384+0000","last_peered":"2021-10-08T19:34:28.838384+0000","last_clean":"2021-10-08T19:34:28.838384+0000","last_became_active":"2021-10-08T19:21:23.599143+0000","last_became_peered":"2021-10-08T19:21:23.599143+0000","last_unstale":"2021-10-08T19:34:28.838384+0000","last_undegraded":"2021-10-08T19:34:28.838384+0000","last_fullsized":"2021-10-08T19:34:28.838384+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:42.759288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:42.759288+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0067448220000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":122,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.835257+0000","last_change":"2021-10-08T19:32:40.754068+0000","last_active":"2021-10-08T19:34:28.835257+0000","last_peered":"2021-10-08T19:34:28.835257+0000","last_clean":"2021-10-08T19:34:28.835257+0000","last_became_active":"2021-10-08T19:29:40.638774+0000","last_became_peered":"2021-10-08T19:29:40.638774+0000","last_unstale":"2021-10-08T19:34:28.835257+0000","last_undegraded":"2021-10-08T19:34:28.835257+0000","last_fullsized":"2021-10-08T19:34:28.835257+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:40.753959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:40.753959+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0086989049999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":320,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.839416+0000","last_change":"2021-10-08T19:32:15.872970+0000","last_active":"2021-10-08T19:34:28.839416+0000","last_peered":"2021-10-08T19:34:28.839416+0000","last_clean":"2021-10-08T19:34:28.839416+0000","last_became_active":"2021-10-08T19:29:40.627256+0000","last_became_peered":"2021-10-08T19:29:40.627256+0000","last_unstale":"2021-10-08T19:34:28.839416+0000","last_undegraded":"2021-10-08T19:34:28.839416+0000","last_fullsized":"2021-10-08T19:34:28.839416+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:15.872860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:32:15.872860+0000","last_clean_scrub_stamp":"2021-10-08T19:32:15.872860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.068573066000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"343'12788","reported_seq":12855,"reported_epoch":343,"state":"active+clean","last_fresh":"2021-10-08T19:34:33.591521+0000","last_change":"2021-10-08T19:34:09.706910+0000","last_active":"2021-10-08T19:34:33.591521+0000","last_peered":"2021-10-08T19:34:33.591521+0000","last_clean":"2021-10-08T19:34:33.591521+0000","last_became_active":"2021-10-08T19:31:33.859047+0000","last_became_peered":"2021-10-08T19:31:33.859047+0000","last_unstale":"2021-10-08T19:34:33.591521+0000","last_undegraded":"2021-10-08T19:34:33.591521+0000","last_fullsized":"2021-10-08T19:34:33.591521+0000","mapping_epoch":290,"log_start":"328'8362","ondisk_log_start":"328'8362","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"336'11118","last_scrub_stamp":"2021-10-08T19:34:09.706829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:34:09.706829+0000","log_size":4426,"ondisk_log_size":4426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":1.1768237109999999,"stat_sum":{"num_bytes":111280128,"num_objects":1698,"num_object_clones":0,"num_object_copies":5094,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1698,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12788,"num_write_kb":463552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"90'130","reported_seq":632,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.845040+0000","last_change":"2021-10-08T19:34:05.737954+0000","last_active":"2021-10-08T19:34:28.845040+0000","last_peered":"2021-10-08T19:34:28.845040+0000","last_clean":"2021-10-08T19:34:28.845040+0000","last_became_active":"2021-10-08T19:27:26.591250+0000","last_became_peered":"2021-10-08T19:27:26.591250+0000","last_unstale":"2021-10-08T19:34:28.845040+0000","last_undegraded":"2021-10-08T19:34:28.845040+0000","last_fullsized":"2021-10-08T19:34:28.845040+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:34:05.737882+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:34:05.737882+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0037827009999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":315,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.843225+0000","last_change":"2021-10-08T19:34:20.092197+0000","last_active":"2021-10-08T19:34:28.843225+0000","last_peered":"2021-10-08T19:34:28.843225+0000","last_clean":"2021-10-08T19:34:28.843225+0000","last_became_active":"2021-10-08T19:21:27.637875+0000","last_became_peered":"2021-10-08T19:21:27.637875+0000","last_unstale":"2021-10-08T19:34:28.843225+0000","last_undegraded":"2021-10-08T19:34:28.843225+0000","last_fullsized":"2021-10-08T19:34:28.843225+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:20.092069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:20.092069+0000","last_clean_scrub_stamp":"2021-10-08T19:34:20.092069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0051905989999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"289'17","reported_seq":69,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.855484+0000","last_change":"2021-10-08T19:33:24.425584+0000","last_active":"2021-10-08T19:34:28.855484+0000","last_peered":"2021-10-08T19:34:28.855484+0000","last_clean":"2021-10-08T19:34:28.855484+0000","last_became_active":"2021-10-08T19:31:51.674965+0000","last_became_peered":"2021-10-08T19:31:51.674965+0000","last_unstale":"2021-10-08T19:34:28.855484+0000","last_undegraded":"2021-10-08T19:34:28.855484+0000","last_fullsized":"2021-10-08T19:34:28.855484+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'17","last_scrub_stamp":"2021-10-08T19:33:24.425500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:33:24.425500+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.015679596000000001,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":23,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":990,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":335,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.842396+0000","last_change":"2021-10-08T19:33:21.374979+0000","last_active":"2021-10-08T19:34:28.842396+0000","last_peered":"2021-10-08T19:34:28.842396+0000","last_clean":"2021-10-08T19:34:28.842396+0000","last_became_active":"2021-10-08T19:29:40.619746+0000","last_became_peered":"2021-10-08T19:29:40.619746+0000","last_unstale":"2021-10-08T19:34:28.842396+0000","last_undegraded":"2021-10-08T19:34:28.842396+0000","last_fullsized":"2021-10-08T19:34:28.842396+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:21.374908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:33:21.374908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034369499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"70'5","reported_seq":163,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.855284+0000","last_change":"2021-10-08T19:34:18.630491+0000","last_active":"2021-10-08T19:34:28.855284+0000","last_peered":"2021-10-08T19:34:28.855284+0000","last_clean":"2021-10-08T19:34:28.855284+0000","last_became_active":"2021-10-08T19:28:40.148054+0000","last_became_peered":"2021-10-08T19:28:40.148054+0000","last_unstale":"2021-10-08T19:34:28.855284+0000","last_undegraded":"2021-10-08T19:34:28.855284+0000","last_fullsized":"2021-10-08T19:34:28.855284+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:34:18.630378+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2021-10-08T19:34:18.630378+0000","last_clean_scrub_stamp":"2021-10-08T19:34:18.630378+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0054668570000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":339,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.845457+0000","last_change":"2021-10-08T19:32:42.131131+0000","last_active":"2021-10-08T19:34:28.845457+0000","last_peered":"2021-10-08T19:34:28.845457+0000","last_clean":"2021-10-08T19:34:28.845457+0000","last_became_active":"2021-10-08T19:29:40.652528+0000","last_became_peered":"2021-10-08T19:29:40.652528+0000","last_unstale":"2021-10-08T19:34:28.845457+0000","last_undegraded":"2021-10-08T19:34:28.845457+0000","last_fullsized":"2021-10-08T19:34:28.845457+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:42.131020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:32:42.131020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.027867907000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.9","version":"343'12784","reported_seq":12851,"reported_epoch":343,"state":"active+clean","last_fresh":"2021-10-08T19:34:34.048259+0000","last_change":"2021-10-08T19:34:07.731840+0000","last_active":"2021-10-08T19:34:34.048259+0000","last_peered":"2021-10-08T19:34:34.048259+0000","last_clean":"2021-10-08T19:34:34.048259+0000","last_became_active":"2021-10-08T19:31:33.858961+0000","last_became_peered":"2021-10-08T19:31:33.858961+0000","last_unstale":"2021-10-08T19:34:34.048259+0000","last_undegraded":"2021-10-08T19:34:34.048259+0000","last_fullsized":"2021-10-08T19:34:34.048259+0000","mapping_epoch":290,"log_start":"324'7800","ondisk_log_start":"324'7800","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"336'10990","last_scrub_stamp":"2021-10-08T19:34:07.731731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:34:07.731731+0000","log_size":4984,"ondisk_log_size":4984,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.89057212100000005,"stat_sum":{"num_bytes":106954752,"num_objects":1632,"num_object_clones":0,"num_object_copies":4896,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1632,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12784,"num_write_kb":461312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,5],"acting":[0,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"90'130","reported_seq":484,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.838715+0000","last_change":"2021-10-08T19:31:33.806970+0000","last_active":"2021-10-08T19:34:28.838715+0000","last_peered":"2021-10-08T19:34:28.838715+0000","last_clean":"2021-10-08T19:34:28.838715+0000","last_became_active":"2021-10-08T19:27:26.591993+0000","last_became_peered":"2021-10-08T19:27:26.591993+0000","last_unstale":"2021-10-08T19:34:28.838715+0000","last_undegraded":"2021-10-08T19:34:28.838715+0000","last_fullsized":"2021-10-08T19:34:28.838715+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:31:33.806885+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:31:33.806885+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.00183936,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,2],"acting":[5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":327,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.838525+0000","last_change":"2021-10-08T19:33:27.102932+0000","last_active":"2021-10-08T19:34:28.838525+0000","last_peered":"2021-10-08T19:34:28.838525+0000","last_clean":"2021-10-08T19:34:28.838525+0000","last_became_active":"2021-10-08T19:28:40.133414+0000","last_became_peered":"2021-10-08T19:28:40.133414+0000","last_unstale":"2021-10-08T19:34:28.838525+0000","last_undegraded":"2021-10-08T19:34:28.838525+0000","last_fullsized":"2021-10-08T19:34:28.838525+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:27.102857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:33:27.102857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.008485991,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"289'44","reported_seq":335,"reported_epoch":343,"state":"active+clean","last_fresh":"2021-10-08T19:34:31.764493+0000","last_change":"2021-10-08T19:34:04.465039+0000","last_active":"2021-10-08T19:34:31.764493+0000","last_peered":"2021-10-08T19:34:31.764493+0000","last_clean":"2021-10-08T19:34:31.764493+0000","last_became_active":"2021-10-08T19:29:40.626138+0000","last_became_peered":"2021-10-08T19:29:40.626138+0000","last_unstale":"2021-10-08T19:34:31.764493+0000","last_undegraded":"2021-10-08T19:34:31.764493+0000","last_fullsized":"2021-10-08T19:34:31.764493+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'44","last_scrub_stamp":"2021-10-08T19:34:04.464934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:34:04.464934+0000","log_size":44,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.004062642,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":65,"num_read_kb":50,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":1432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":344,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.838914+0000","last_change":"2021-10-08T19:32:06.793381+0000","last_active":"2021-10-08T19:34:28.838914+0000","last_peered":"2021-10-08T19:34:28.838914+0000","last_clean":"2021-10-08T19:34:28.838914+0000","last_became_active":"2021-10-08T19:28:40.137919+0000","last_became_peered":"2021-10-08T19:28:40.137919+0000","last_unstale":"2021-10-08T19:34:28.838914+0000","last_undegraded":"2021-10-08T19:34:28.838914+0000","last_fullsized":"2021-10-08T19:34:28.838914+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:06.793283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:06.793283+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0046514379999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":124,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.834909+0000","last_change":"2021-10-08T19:34:09.025163+0000","last_active":"2021-10-08T19:34:28.834909+0000","last_peered":"2021-10-08T19:34:28.834909+0000","last_clean":"2021-10-08T19:34:28.834909+0000","last_became_active":"2021-10-08T19:29:40.637371+0000","last_became_peered":"2021-10-08T19:29:40.637371+0000","last_unstale":"2021-10-08T19:34:28.834909+0000","last_undegraded":"2021-10-08T19:34:28.834909+0000","last_fullsized":"2021-10-08T19:34:28.834909+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:30:51.432925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:30:51.432925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0033942310000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":270,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.827128+0000","last_change":"2021-10-08T19:34:04.039092+0000","last_active":"2021-10-08T19:34:28.827128+0000","last_peered":"2021-10-08T19:34:28.827128+0000","last_clean":"2021-10-08T19:34:28.827128+0000","last_became_active":"2021-10-08T19:25:14.550690+0000","last_became_peered":"2021-10-08T19:25:14.550690+0000","last_unstale":"2021-10-08T19:34:28.827128+0000","last_undegraded":"2021-10-08T19:34:28.827128+0000","last_fullsized":"2021-10-08T19:34:28.827128+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:04.038995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:04.038995+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0083020339999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.f","version":"343'12823","reported_seq":12886,"reported_epoch":343,"state":"active+clean","last_fresh":"2021-10-08T19:34:33.578402+0000","last_change":"2021-10-08T19:34:13.589045+0000","last_active":"2021-10-08T19:34:33.578402+0000","last_peered":"2021-10-08T19:34:33.578402+0000","last_clean":"2021-10-08T19:34:33.578402+0000","last_became_active":"2021-10-08T19:31:33.859443+0000","last_became_peered":"2021-10-08T19:31:33.859443+0000","last_unstale":"2021-10-08T19:34:33.578402+0000","last_undegraded":"2021-10-08T19:34:33.578402+0000","last_fullsized":"2021-10-08T19:34:33.578402+0000","mapping_epoch":290,"log_start":"328'8400","ondisk_log_start":"328'8400","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.825378+0000","log_size":4423,"ondisk_log_size":4423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110690304,"num_objects":1689,"num_object_clones":0,"num_object_copies":5067,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1689,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12823,"num_write_kb":464384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"90'130","reported_seq":586,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.840727+0000","last_change":"2021-10-08T19:34:01.146361+0000","last_active":"2021-10-08T19:34:28.840727+0000","last_peered":"2021-10-08T19:34:28.840727+0000","last_clean":"2021-10-08T19:34:28.840727+0000","last_became_active":"2021-10-08T19:29:43.636820+0000","last_became_peered":"2021-10-08T19:29:43.636820+0000","last_unstale":"2021-10-08T19:34:28.840727+0000","last_undegraded":"2021-10-08T19:34:28.840727+0000","last_fullsized":"2021-10-08T19:34:28.840727+0000","mapping_epoch":239,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:34:01.146246+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:34:01.146246+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.006677657,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"114'10","reported_seq":506,"reported_epoch":343,"state":"active+clean","last_fresh":"2021-10-08T19:34:31.762470+0000","last_change":"2021-10-08T19:34:03.864493+0000","last_active":"2021-10-08T19:34:31.762470+0000","last_peered":"2021-10-08T19:34:31.762470+0000","last_clean":"2021-10-08T19:34:31.762470+0000","last_became_active":"2021-10-08T19:24:25.106695+0000","last_became_peered":"2021-10-08T19:24:25.106695+0000","last_unstale":"2021-10-08T19:34:31.762470+0000","last_undegraded":"2021-10-08T19:34:31.762470+0000","last_fullsized":"2021-10-08T19:34:31.762470+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'10","last_scrub_stamp":"2021-10-08T19:34:03.864384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:34:03.864384+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.007036924,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"289'20","reported_seq":69,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.846930+0000","last_change":"2021-10-08T19:34:16.658166+0000","last_active":"2021-10-08T19:34:28.846930+0000","last_peered":"2021-10-08T19:34:28.846930+0000","last_clean":"2021-10-08T19:34:28.846930+0000","last_became_active":"2021-10-08T19:31:51.675569+0000","last_became_peered":"2021-10-08T19:31:51.675569+0000","last_unstale":"2021-10-08T19:34:28.846930+0000","last_undegraded":"2021-10-08T19:34:28.846930+0000","last_fullsized":"2021-10-08T19:34:28.846930+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'20","last_scrub_stamp":"2021-10-08T19:34:16.658057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:34:16.658057+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010989301999999999,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":23,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":161,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.846931+0000","last_change":"2021-10-08T19:32:52.491940+0000","last_active":"2021-10-08T19:34:28.846931+0000","last_peered":"2021-10-08T19:34:28.846931+0000","last_clean":"2021-10-08T19:34:28.846931+0000","last_became_active":"2021-10-08T19:28:40.141737+0000","last_became_peered":"2021-10-08T19:28:40.141737+0000","last_unstale":"2021-10-08T19:34:28.846931+0000","last_undegraded":"2021-10-08T19:34:28.846931+0000","last_fullsized":"2021-10-08T19:34:28.846931+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:52.491828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:52.491828+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.015794227000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":329,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.836226+0000","last_change":"2021-10-08T19:34:16.042895+0000","last_active":"2021-10-08T19:34:28.836226+0000","last_peered":"2021-10-08T19:34:28.836226+0000","last_clean":"2021-10-08T19:34:28.836226+0000","last_became_active":"2021-10-08T19:29:40.643614+0000","last_became_peered":"2021-10-08T19:29:40.643614+0000","last_unstale":"2021-10-08T19:34:28.836226+0000","last_undegraded":"2021-10-08T19:34:28.836226+0000","last_fullsized":"2021-10-08T19:34:28.836226+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:16.042797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:16.042797+0000","last_clean_scrub_stamp":"2021-10-08T19:34:16.042797+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.038141670000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":284,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.839986+0000","last_change":"2021-10-08T19:32:49.731052+0000","last_active":"2021-10-08T19:34:28.839986+0000","last_peered":"2021-10-08T19:34:28.839986+0000","last_clean":"2021-10-08T19:34:28.839986+0000","last_became_active":"2021-10-08T19:29:40.626998+0000","last_became_peered":"2021-10-08T19:29:40.626998+0000","last_unstale":"2021-10-08T19:34:28.839986+0000","last_undegraded":"2021-10-08T19:34:28.839986+0000","last_fullsized":"2021-10-08T19:34:28.839986+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:49.730960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:49.730960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.017072971999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.4","version":"343'13182","reported_seq":13251,"reported_epoch":343,"state":"active+clean","last_fresh":"2021-10-08T19:34:34.085220+0000","last_change":"2021-10-08T19:34:00.850587+0000","last_active":"2021-10-08T19:34:34.085220+0000","last_peered":"2021-10-08T19:34:34.085220+0000","last_clean":"2021-10-08T19:34:34.085220+0000","last_became_active":"2021-10-08T19:31:33.861531+0000","last_became_peered":"2021-10-08T19:31:33.861531+0000","last_unstale":"2021-10-08T19:34:34.085220+0000","last_undegraded":"2021-10-08T19:34:34.085220+0000","last_fullsized":"2021-10-08T19:34:34.085220+0000","mapping_epoch":290,"log_start":"328'8801","ondisk_log_start":"328'8801","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"334'10939","last_scrub_stamp":"2021-10-08T19:34:00.850475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:34:00.850475+0000","log_size":4381,"ondisk_log_size":4381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":1.492343617,"stat_sum":{"num_bytes":105054208,"num_objects":1603,"num_object_clones":0,"num_object_copies":4809,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1603,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12715,"num_write_kb":458176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":329,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.842526+0000","last_change":"2021-10-08T19:33:18.301452+0000","last_active":"2021-10-08T19:34:28.842526+0000","last_peered":"2021-10-08T19:34:28.842526+0000","last_clean":"2021-10-08T19:34:28.842526+0000","last_became_active":"2021-10-08T19:28:40.138726+0000","last_became_peered":"2021-10-08T19:28:40.138726+0000","last_unstale":"2021-10-08T19:34:28.842526+0000","last_undegraded":"2021-10-08T19:34:28.842526+0000","last_fullsized":"2021-10-08T19:34:28.842526+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:18.301355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:50.435552+0000","last_clean_scrub_stamp":"2021-10-08T19:33:18.301355+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011225987999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"289'18","reported_seq":422,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.826957+0000","last_change":"2021-10-08T19:33:19.173918+0000","last_active":"2021-10-08T19:34:28.826957+0000","last_peered":"2021-10-08T19:34:28.826957+0000","last_clean":"2021-10-08T19:34:28.826957+0000","last_became_active":"2021-10-08T19:29:40.638957+0000","last_became_peered":"2021-10-08T19:29:40.638957+0000","last_unstale":"2021-10-08T19:34:28.826957+0000","last_undegraded":"2021-10-08T19:34:28.826957+0000","last_fullsized":"2021-10-08T19:34:28.826957+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'18","last_scrub_stamp":"2021-10-08T19:33:19.173830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:33:19.173830+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014315273999999999,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":25,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"61'2","reported_seq":324,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.828035+0000","last_change":"2021-10-08T19:32:50.319062+0000","last_active":"2021-10-08T19:34:28.828035+0000","last_peered":"2021-10-08T19:34:28.828035+0000","last_clean":"2021-10-08T19:34:28.828035+0000","last_became_active":"2021-10-08T19:21:23.603614+0000","last_became_peered":"2021-10-08T19:21:23.603614+0000","last_unstale":"2021-10-08T19:34:28.828035+0000","last_undegraded":"2021-10-08T19:34:28.828035+0000","last_fullsized":"2021-10-08T19:34:28.828035+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'2","last_scrub_stamp":"2021-10-08T19:32:50.318952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:50.318952+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0102337,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":122,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.834540+0000","last_change":"2021-10-08T19:31:29.506433+0000","last_active":"2021-10-08T19:34:28.834540+0000","last_peered":"2021-10-08T19:34:28.834540+0000","last_clean":"2021-10-08T19:34:28.834540+0000","last_became_active":"2021-10-08T19:29:40.645211+0000","last_became_peered":"2021-10-08T19:29:40.645211+0000","last_unstale":"2021-10-08T19:34:28.834540+0000","last_undegraded":"2021-10-08T19:34:28.834540+0000","last_fullsized":"2021-10-08T19:34:28.834540+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:29.506331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:31:29.506331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.042894232999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":244,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.847727+0000","last_change":"2021-10-08T19:31:29.399846+0000","last_active":"2021-10-08T19:34:28.847727+0000","last_peered":"2021-10-08T19:34:28.847727+0000","last_clean":"2021-10-08T19:34:28.847727+0000","last_became_active":"2021-10-08T19:28:40.100770+0000","last_became_peered":"2021-10-08T19:28:40.100770+0000","last_unstale":"2021-10-08T19:34:28.847727+0000","last_undegraded":"2021-10-08T19:34:28.847727+0000","last_fullsized":"2021-10-08T19:34:28.847727+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:29.399771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:31:29.399771+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001424972,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"289'15","reported_seq":376,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.835903+0000","last_change":"2021-10-08T19:33:32.998429+0000","last_active":"2021-10-08T19:34:28.835903+0000","last_peered":"2021-10-08T19:34:28.835903+0000","last_clean":"2021-10-08T19:34:28.835903+0000","last_became_active":"2021-10-08T19:29:40.644354+0000","last_became_peered":"2021-10-08T19:29:40.644354+0000","last_unstale":"2021-10-08T19:34:28.835903+0000","last_undegraded":"2021-10-08T19:34:28.835903+0000","last_fullsized":"2021-10-08T19:34:28.835903+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'15","last_scrub_stamp":"2021-10-08T19:33:32.998322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:33:32.998322+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014909828999999999,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":343,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.842830+0000","last_change":"2021-10-08T19:34:11.126528+0000","last_active":"2021-10-08T19:34:28.842830+0000","last_peered":"2021-10-08T19:34:28.842830+0000","last_clean":"2021-10-08T19:34:28.842830+0000","last_became_active":"2021-10-08T19:28:40.139234+0000","last_became_peered":"2021-10-08T19:28:40.139234+0000","last_unstale":"2021-10-08T19:34:28.842830+0000","last_undegraded":"2021-10-08T19:34:28.842830+0000","last_fullsized":"2021-10-08T19:34:28.842830+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:11.126413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:11.126413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011475828,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":122,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.835556+0000","last_change":"2021-10-08T19:32:05.472718+0000","last_active":"2021-10-08T19:34:28.835556+0000","last_peered":"2021-10-08T19:34:28.835556+0000","last_clean":"2021-10-08T19:34:28.835556+0000","last_became_active":"2021-10-08T19:29:40.645111+0000","last_became_peered":"2021-10-08T19:29:40.645111+0000","last_unstale":"2021-10-08T19:34:28.835556+0000","last_undegraded":"2021-10-08T19:34:28.835556+0000","last_fullsized":"2021-10-08T19:34:28.835556+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:05.472621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:32:05.472621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0050247119999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":307,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.842548+0000","last_change":"2021-10-08T19:32:36.559264+0000","last_active":"2021-10-08T19:34:28.842548+0000","last_peered":"2021-10-08T19:34:28.842548+0000","last_clean":"2021-10-08T19:34:28.842548+0000","last_became_active":"2021-10-08T19:21:29.640674+0000","last_became_peered":"2021-10-08T19:21:29.640674+0000","last_unstale":"2021-10-08T19:34:28.842548+0000","last_undegraded":"2021-10-08T19:34:28.842548+0000","last_fullsized":"2021-10-08T19:34:28.842548+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:36.559192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:32:36.559192+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.01026267,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":236,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.845176+0000","last_change":"2021-10-08T19:32:53.182703+0000","last_active":"2021-10-08T19:34:28.845176+0000","last_peered":"2021-10-08T19:34:28.845176+0000","last_clean":"2021-10-08T19:34:28.845176+0000","last_became_active":"2021-10-08T19:25:15.501118+0000","last_became_peered":"2021-10-08T19:25:15.501118+0000","last_unstale":"2021-10-08T19:34:28.845176+0000","last_undegraded":"2021-10-08T19:34:28.845176+0000","last_fullsized":"2021-10-08T19:34:28.845176+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:53.182628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:53.182628+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0033567269999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"289'12","reported_seq":145,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.835429+0000","last_change":"2021-10-08T19:33:23.899814+0000","last_active":"2021-10-08T19:34:28.835429+0000","last_peered":"2021-10-08T19:34:28.835429+0000","last_clean":"2021-10-08T19:34:28.835429+0000","last_became_active":"2021-10-08T19:29:40.644657+0000","last_became_peered":"2021-10-08T19:29:40.644657+0000","last_unstale":"2021-10-08T19:34:28.835429+0000","last_undegraded":"2021-10-08T19:34:28.835429+0000","last_fullsized":"2021-10-08T19:34:28.835429+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'12","last_scrub_stamp":"2021-10-08T19:33:23.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:33:23.899705+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.016253179999999999,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":18,"num_read_kb":15,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":277,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.840848+0000","last_change":"2021-10-08T19:33:59.151842+0000","last_active":"2021-10-08T19:34:28.840848+0000","last_peered":"2021-10-08T19:34:28.840848+0000","last_clean":"2021-10-08T19:34:28.840848+0000","last_became_active":"2021-10-08T19:28:40.101898+0000","last_became_peered":"2021-10-08T19:28:40.101898+0000","last_unstale":"2021-10-08T19:34:28.840848+0000","last_undegraded":"2021-10-08T19:34:28.840848+0000","last_fullsized":"2021-10-08T19:34:28.840848+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:59.151732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:16.444582+0000","last_clean_scrub_stamp":"2021-10-08T19:33:59.151732+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0072227530000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":346,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.838922+0000","last_change":"2021-10-08T19:34:03.603560+0000","last_active":"2021-10-08T19:34:28.838922+0000","last_peered":"2021-10-08T19:34:28.838922+0000","last_clean":"2021-10-08T19:34:28.838922+0000","last_became_active":"2021-10-08T19:29:40.626950+0000","last_became_peered":"2021-10-08T19:29:40.626950+0000","last_unstale":"2021-10-08T19:34:28.838922+0000","last_undegraded":"2021-10-08T19:34:28.838922+0000","last_fullsized":"2021-10-08T19:34:28.838922+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:03.603487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:34:03.603487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011751039,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":327,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.845273+0000","last_change":"2021-10-08T19:32:38.147982+0000","last_active":"2021-10-08T19:34:28.845273+0000","last_peered":"2021-10-08T19:34:28.845273+0000","last_clean":"2021-10-08T19:34:28.845273+0000","last_became_active":"2021-10-08T19:24:25.099371+0000","last_became_peered":"2021-10-08T19:24:25.099371+0000","last_unstale":"2021-10-08T19:34:28.845273+0000","last_undegraded":"2021-10-08T19:34:28.845273+0000","last_fullsized":"2021-10-08T19:34:28.845273+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:38.147897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:32:38.147897+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.044536603000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"70'5","reported_seq":506,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.840365+0000","last_change":"2021-10-08T19:34:09.254133+0000","last_active":"2021-10-08T19:34:28.840365+0000","last_peered":"2021-10-08T19:34:28.840365+0000","last_clean":"2021-10-08T19:34:28.840365+0000","last_became_active":"2021-10-08T19:31:22.785193+0000","last_became_peered":"2021-10-08T19:31:22.785193+0000","last_unstale":"2021-10-08T19:34:28.840365+0000","last_undegraded":"2021-10-08T19:34:28.840365+0000","last_fullsized":"2021-10-08T19:34:28.840365+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":5,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:32:40.868606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:40.868606+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0051348670000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"289'20","reported_seq":193,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.835588+0000","last_change":"2021-10-08T19:32:38.773549+0000","last_active":"2021-10-08T19:34:28.835588+0000","last_peered":"2021-10-08T19:34:28.835588+0000","last_clean":"2021-10-08T19:34:28.835588+0000","last_became_active":"2021-10-08T19:31:51.677055+0000","last_became_peered":"2021-10-08T19:31:51.677055+0000","last_unstale":"2021-10-08T19:34:28.835588+0000","last_undegraded":"2021-10-08T19:34:28.835588+0000","last_fullsized":"2021-10-08T19:34:28.835588+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'20","last_scrub_stamp":"2021-10-08T19:32:38.773440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:32:38.773440+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0043484539999999999,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":326,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.838809+0000","last_change":"2021-10-08T19:31:30.802257+0000","last_active":"2021-10-08T19:34:28.838809+0000","last_peered":"2021-10-08T19:34:28.838809+0000","last_clean":"2021-10-08T19:34:28.838809+0000","last_became_active":"2021-10-08T19:29:40.631331+0000","last_became_peered":"2021-10-08T19:29:40.631331+0000","last_unstale":"2021-10-08T19:34:28.838809+0000","last_undegraded":"2021-10-08T19:34:28.838809+0000","last_fullsized":"2021-10-08T19:34:28.838809+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:30.802102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:31:30.802102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0025761069999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"328'11","reported_seq":504,"reported_epoch":343,"state":"active+clean","last_fresh":"2021-10-08T19:34:31.767506+0000","last_change":"2021-10-08T19:33:32.545949+0000","last_active":"2021-10-08T19:34:31.767506+0000","last_peered":"2021-10-08T19:34:31.767506+0000","last_clean":"2021-10-08T19:34:31.767506+0000","last_became_active":"2021-10-08T19:28:40.138031+0000","last_became_peered":"2021-10-08T19:28:40.138031+0000","last_unstale":"2021-10-08T19:34:31.767506+0000","last_undegraded":"2021-10-08T19:34:31.767506+0000","last_fullsized":"2021-10-08T19:34:31.767506+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"328'11","last_scrub_stamp":"2021-10-08T19:33:32.545870+0000","last_deep_scrub":"328'11","last_deep_scrub_stamp":"2021-10-08T19:33:32.545870+0000","last_clean_scrub_stamp":"2021-10-08T19:33:32.545870+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.023323448,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":323,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.835739+0000","last_change":"2021-10-08T19:33:29.076679+0000","last_active":"2021-10-08T19:34:28.835739+0000","last_peered":"2021-10-08T19:34:28.835739+0000","last_clean":"2021-10-08T19:34:28.835739+0000","last_became_active":"2021-10-08T19:29:40.644819+0000","last_became_peered":"2021-10-08T19:29:40.644819+0000","last_unstale":"2021-10-08T19:34:28.835739+0000","last_undegraded":"2021-10-08T19:34:28.835739+0000","last_fullsized":"2021-10-08T19:34:28.835739+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:29.076571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:33:29.076571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.046814043999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":232,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.844809+0000","last_change":"2021-10-08T19:32:08.300983+0000","last_active":"2021-10-08T19:34:28.844809+0000","last_peered":"2021-10-08T19:34:28.844809+0000","last_clean":"2021-10-08T19:34:28.844809+0000","last_became_active":"2021-10-08T19:25:15.498770+0000","last_became_peered":"2021-10-08T19:25:15.498770+0000","last_unstale":"2021-10-08T19:34:28.844809+0000","last_undegraded":"2021-10-08T19:34:28.844809+0000","last_fullsized":"2021-10-08T19:34:28.844809+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:08.300907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:08.300907+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.00342115,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"289'15","reported_seq":94,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.839899+0000","last_change":"2021-10-08T19:33:30.506573+0000","last_active":"2021-10-08T19:34:28.839899+0000","last_peered":"2021-10-08T19:34:28.839899+0000","last_clean":"2021-10-08T19:34:28.839899+0000","last_became_active":"2021-10-08T19:31:22.786860+0000","last_became_peered":"2021-10-08T19:31:22.786860+0000","last_unstale":"2021-10-08T19:34:28.839899+0000","last_undegraded":"2021-10-08T19:34:28.839899+0000","last_fullsized":"2021-10-08T19:34:28.839899+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'15","last_scrub_stamp":"2021-10-08T19:33:30.506458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:33:30.506458+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010013156,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":337,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.837512+0000","last_change":"2021-10-08T19:33:32.035734+0000","last_active":"2021-10-08T19:34:28.837512+0000","last_peered":"2021-10-08T19:34:28.837512+0000","last_clean":"2021-10-08T19:34:28.837512+0000","last_became_active":"2021-10-08T19:29:44.439397+0000","last_became_peered":"2021-10-08T19:29:44.439397+0000","last_unstale":"2021-10-08T19:34:28.837512+0000","last_undegraded":"2021-10-08T19:34:28.837512+0000","last_fullsized":"2021-10-08T19:34:28.837512+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:32.035617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:33:32.035617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.016251978,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"238'10","reported_seq":191,"reported_epoch":343,"state":"active+clean","last_fresh":"2021-10-08T19:34:31.752951+0000","last_change":"2021-10-08T19:34:14.090645+0000","last_active":"2021-10-08T19:34:31.752951+0000","last_peered":"2021-10-08T19:34:31.752951+0000","last_clean":"2021-10-08T19:34:31.752951+0000","last_became_active":"2021-10-08T19:29:40.637650+0000","last_became_peered":"2021-10-08T19:29:40.637650+0000","last_unstale":"2021-10-08T19:34:31.752951+0000","last_undegraded":"2021-10-08T19:34:31.752951+0000","last_fullsized":"2021-10-08T19:34:31.752951+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"238'10","last_scrub_stamp":"2021-10-08T19:34:14.090547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:34:14.090547+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.017481770000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":302,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.828342+0000","last_change":"2021-10-08T19:33:16.237668+0000","last_active":"2021-10-08T19:34:28.828342+0000","last_peered":"2021-10-08T19:34:28.828342+0000","last_clean":"2021-10-08T19:34:28.828342+0000","last_became_active":"2021-10-08T19:21:29.640302+0000","last_became_peered":"2021-10-08T19:21:29.640302+0000","last_unstale":"2021-10-08T19:34:28.828342+0000","last_undegraded":"2021-10-08T19:34:28.828342+0000","last_fullsized":"2021-10-08T19:34:28.828342+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:16.237548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:33:16.237548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.060114668000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":244,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.835287+0000","last_change":"2021-10-08T19:32:48.970818+0000","last_active":"2021-10-08T19:34:28.835287+0000","last_peered":"2021-10-08T19:34:28.835287+0000","last_clean":"2021-10-08T19:34:28.835287+0000","last_became_active":"2021-10-08T19:29:40.631374+0000","last_became_peered":"2021-10-08T19:29:40.631374+0000","last_unstale":"2021-10-08T19:34:28.835287+0000","last_undegraded":"2021-10-08T19:34:28.835287+0000","last_fullsized":"2021-10-08T19:34:28.835287+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:48.970722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:48.970722+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011612008,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":248,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.845222+0000","last_change":"2021-10-08T19:32:40.137708+0000","last_active":"2021-10-08T19:34:28.845222+0000","last_peered":"2021-10-08T19:34:28.845222+0000","last_clean":"2021-10-08T19:34:28.845222+0000","last_became_active":"2021-10-08T19:29:40.652966+0000","last_became_peered":"2021-10-08T19:29:40.652966+0000","last_unstale":"2021-10-08T19:34:28.845222+0000","last_undegraded":"2021-10-08T19:34:28.845222+0000","last_fullsized":"2021-10-08T19:34:28.845222+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:40.137613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:40.137613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0079745670000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"289'19","reported_seq":67,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.846605+0000","last_change":"2021-10-08T19:32:46.539916+0000","last_active":"2021-10-08T19:34:28.846605+0000","last_peered":"2021-10-08T19:34:28.846605+0000","last_clean":"2021-10-08T19:34:28.846605+0000","last_became_active":"2021-10-08T19:31:51.676961+0000","last_became_peered":"2021-10-08T19:31:51.676961+0000","last_unstale":"2021-10-08T19:34:28.846605+0000","last_undegraded":"2021-10-08T19:34:28.846605+0000","last_fullsized":"2021-10-08T19:34:28.846605+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:32:46.539792+0000","last_deep_scrub":"289'19","last_deep_scrub_stamp":"2021-10-08T19:32:46.539792+0000","last_clean_scrub_stamp":"2021-10-08T19:32:46.539792+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010982540000000001,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":293,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.840529+0000","last_change":"2021-10-08T19:33:20.923704+0000","last_active":"2021-10-08T19:34:28.840529+0000","last_peered":"2021-10-08T19:34:28.840529+0000","last_clean":"2021-10-08T19:34:28.840529+0000","last_became_active":"2021-10-08T19:31:22.786651+0000","last_became_peered":"2021-10-08T19:31:22.786651+0000","last_unstale":"2021-10-08T19:34:28.840529+0000","last_undegraded":"2021-10-08T19:34:28.840529+0000","last_fullsized":"2021-10-08T19:34:28.840529+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:20.923605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:33:20.923605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.022344111,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":124,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.834452+0000","last_change":"2021-10-08T19:34:07.049328+0000","last_active":"2021-10-08T19:34:28.834452+0000","last_peered":"2021-10-08T19:34:28.834452+0000","last_clean":"2021-10-08T19:34:28.834452+0000","last_became_active":"2021-10-08T19:29:40.644770+0000","last_became_peered":"2021-10-08T19:29:40.644770+0000","last_unstale":"2021-10-08T19:34:28.834452+0000","last_undegraded":"2021-10-08T19:34:28.834452+0000","last_fullsized":"2021-10-08T19:34:28.834452+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:30:32.410928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:30:32.410928+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003423953,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":325,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.836145+0000","last_change":"2021-10-08T19:33:22.113737+0000","last_active":"2021-10-08T19:34:28.836145+0000","last_peered":"2021-10-08T19:34:28.836145+0000","last_clean":"2021-10-08T19:34:28.836145+0000","last_became_active":"2021-10-08T19:28:40.133744+0000","last_became_peered":"2021-10-08T19:28:40.133744+0000","last_unstale":"2021-10-08T19:34:28.836145+0000","last_undegraded":"2021-10-08T19:34:28.836145+0000","last_fullsized":"2021-10-08T19:34:28.836145+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:22.113636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:33:22.113636+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.042931799,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"289'19","reported_seq":462,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.827057+0000","last_change":"2021-10-08T19:34:11.033790+0000","last_active":"2021-10-08T19:34:28.827057+0000","last_peered":"2021-10-08T19:34:28.827057+0000","last_clean":"2021-10-08T19:34:28.827057+0000","last_became_active":"2021-10-08T19:28:40.100196+0000","last_became_peered":"2021-10-08T19:28:40.100196+0000","last_unstale":"2021-10-08T19:34:28.827057+0000","last_undegraded":"2021-10-08T19:34:28.827057+0000","last_fullsized":"2021-10-08T19:34:28.827057+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:34:11.033685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:34:11.033685+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0073615640000000001,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":163,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.847438+0000","last_change":"2021-10-08T19:33:29.463878+0000","last_active":"2021-10-08T19:34:28.847438+0000","last_peered":"2021-10-08T19:34:28.847438+0000","last_clean":"2021-10-08T19:34:28.847438+0000","last_became_active":"2021-10-08T19:28:40.146673+0000","last_became_peered":"2021-10-08T19:28:40.146673+0000","last_unstale":"2021-10-08T19:34:28.847438+0000","last_undegraded":"2021-10-08T19:34:28.847438+0000","last_fullsized":"2021-10-08T19:34:28.847438+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:29.463767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:33:29.463767+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.020329192999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":173,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.847013+0000","last_change":"2021-10-08T19:32:38.465030+0000","last_active":"2021-10-08T19:34:28.847013+0000","last_peered":"2021-10-08T19:34:28.847013+0000","last_clean":"2021-10-08T19:34:28.847013+0000","last_became_active":"2021-10-08T19:29:40.638536+0000","last_became_peered":"2021-10-08T19:29:40.638536+0000","last_unstale":"2021-10-08T19:34:28.847013+0000","last_undegraded":"2021-10-08T19:34:28.847013+0000","last_fullsized":"2021-10-08T19:34:28.847013+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:38.464962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:43.186684+0000","last_clean_scrub_stamp":"2021-10-08T19:32:38.464962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0013247059999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":122,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.834732+0000","last_change":"2021-10-08T19:32:15.476992+0000","last_active":"2021-10-08T19:34:28.834732+0000","last_peered":"2021-10-08T19:34:28.834732+0000","last_clean":"2021-10-08T19:34:28.834732+0000","last_became_active":"2021-10-08T19:29:40.634300+0000","last_became_peered":"2021-10-08T19:29:40.634300+0000","last_unstale":"2021-10-08T19:34:28.834732+0000","last_undegraded":"2021-10-08T19:34:28.834732+0000","last_fullsized":"2021-10-08T19:34:28.834732+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:15.476868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:32:15.476868+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.021548916000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"70'5","reported_seq":232,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.829954+0000","last_change":"2021-10-08T19:34:03.061411+0000","last_active":"2021-10-08T19:34:28.829954+0000","last_peered":"2021-10-08T19:34:28.829954+0000","last_clean":"2021-10-08T19:34:28.829954+0000","last_became_active":"2021-10-08T19:25:15.496309+0000","last_became_peered":"2021-10-08T19:25:15.496309+0000","last_unstale":"2021-10-08T19:34:28.829954+0000","last_undegraded":"2021-10-08T19:34:28.829954+0000","last_fullsized":"2021-10-08T19:34:28.829954+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:34:03.061301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:03.061301+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0077145800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.10","version":"289'8","reported_seq":151,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.835028+0000","last_change":"2021-10-08T19:32:45.349635+0000","last_active":"2021-10-08T19:34:28.835028+0000","last_peered":"2021-10-08T19:34:28.835028+0000","last_clean":"2021-10-08T19:34:28.835028+0000","last_became_active":"2021-10-08T19:32:45.165103+0000","last_became_peered":"2021-10-08T19:32:45.165103+0000","last_unstale":"2021-10-08T19:34:28.835028+0000","last_undegraded":"2021-10-08T19:34:28.835028+0000","last_fullsized":"2021-10-08T19:34:28.835028+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'8","last_scrub_stamp":"2021-10-08T19:32:34.689691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:32:34.689691+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0041717799999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":326,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.839100+0000","last_change":"2021-10-08T19:31:27.832981+0000","last_active":"2021-10-08T19:34:28.839100+0000","last_peered":"2021-10-08T19:34:28.839100+0000","last_clean":"2021-10-08T19:34:28.839100+0000","last_became_active":"2021-10-08T19:24:25.094384+0000","last_became_peered":"2021-10-08T19:24:25.094384+0000","last_unstale":"2021-10-08T19:34:28.839100+0000","last_undegraded":"2021-10-08T19:34:28.839100+0000","last_fullsized":"2021-10-08T19:34:28.839100+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:27.832886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:13.716331+0000","last_clean_scrub_stamp":"2021-10-08T19:31:27.832886+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034204959999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":266,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.840934+0000","last_change":"2021-10-08T19:34:18.377860+0000","last_active":"2021-10-08T19:34:28.840934+0000","last_peered":"2021-10-08T19:34:28.840934+0000","last_clean":"2021-10-08T19:34:28.840934+0000","last_became_active":"2021-10-08T19:24:25.106186+0000","last_became_peered":"2021-10-08T19:24:25.106186+0000","last_unstale":"2021-10-08T19:34:28.840934+0000","last_undegraded":"2021-10-08T19:34:28.840934+0000","last_fullsized":"2021-10-08T19:34:28.840934+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:18.377739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:18.377739+0000","last_clean_scrub_stamp":"2021-10-08T19:34:18.377739+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0082105919999999992,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":311,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.845120+0000","last_change":"2021-10-08T19:33:18.992912+0000","last_active":"2021-10-08T19:34:28.845120+0000","last_peered":"2021-10-08T19:34:28.845120+0000","last_clean":"2021-10-08T19:34:28.845120+0000","last_became_active":"2021-10-08T19:21:29.642835+0000","last_became_peered":"2021-10-08T19:21:29.642835+0000","last_unstale":"2021-10-08T19:34:28.845120+0000","last_undegraded":"2021-10-08T19:34:28.845120+0000","last_fullsized":"2021-10-08T19:34:28.845120+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:18.992806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:33:18.992806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0058345690000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":244,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.838790+0000","last_change":"2021-10-08T19:32:05.845506+0000","last_active":"2021-10-08T19:34:28.838790+0000","last_peered":"2021-10-08T19:34:28.838790+0000","last_clean":"2021-10-08T19:34:28.838790+0000","last_became_active":"2021-10-08T19:28:40.099215+0000","last_became_peered":"2021-10-08T19:28:40.099215+0000","last_unstale":"2021-10-08T19:34:28.838790+0000","last_undegraded":"2021-10-08T19:34:28.838790+0000","last_fullsized":"2021-10-08T19:34:28.838790+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:05.845412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:05.845412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.00772998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"289'19","reported_seq":146,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.834638+0000","last_change":"2021-10-08T19:31:23.525281+0000","last_active":"2021-10-08T19:34:28.834638+0000","last_peered":"2021-10-08T19:34:28.834638+0000","last_clean":"2021-10-08T19:34:28.834638+0000","last_became_active":"2021-10-08T19:29:40.640914+0000","last_became_peered":"2021-10-08T19:29:40.640914+0000","last_unstale":"2021-10-08T19:34:28.834638+0000","last_undegraded":"2021-10-08T19:34:28.834638+0000","last_fullsized":"2021-10-08T19:34:28.834638+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'11","last_scrub_stamp":"2021-10-08T19:31:23.525209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:31:23.525209+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039841909999999998,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":257,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.840854+0000","last_change":"2021-10-08T19:33:14.901012+0000","last_active":"2021-10-08T19:34:28.840854+0000","last_peered":"2021-10-08T19:34:28.840854+0000","last_clean":"2021-10-08T19:34:28.840854+0000","last_became_active":"2021-10-08T19:24:25.098128+0000","last_became_peered":"2021-10-08T19:24:25.098128+0000","last_unstale":"2021-10-08T19:34:28.840854+0000","last_undegraded":"2021-10-08T19:34:28.840854+0000","last_fullsized":"2021-10-08T19:34:28.840854+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:14.900916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:34.508558+0000","last_clean_scrub_stamp":"2021-10-08T19:33:14.900916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0050012340000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":323,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.842416+0000","last_change":"2021-10-08T19:32:35.080957+0000","last_active":"2021-10-08T19:34:28.842416+0000","last_peered":"2021-10-08T19:34:28.842416+0000","last_clean":"2021-10-08T19:34:28.842416+0000","last_became_active":"2021-10-08T19:24:25.095490+0000","last_became_peered":"2021-10-08T19:24:25.095490+0000","last_unstale":"2021-10-08T19:34:28.842416+0000","last_undegraded":"2021-10-08T19:34:28.842416+0000","last_fullsized":"2021-10-08T19:34:28.842416+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:35.080865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:11.383779+0000","last_clean_scrub_stamp":"2021-10-08T19:32:35.080865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.01018439,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":128,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.834846+0000","last_change":"2021-10-08T19:33:31.003550+0000","last_active":"2021-10-08T19:34:28.834846+0000","last_peered":"2021-10-08T19:34:28.834846+0000","last_clean":"2021-10-08T19:34:28.834846+0000","last_became_active":"2021-10-08T19:29:40.639358+0000","last_became_peered":"2021-10-08T19:29:40.639358+0000","last_unstale":"2021-10-08T19:34:28.834846+0000","last_undegraded":"2021-10-08T19:34:28.834846+0000","last_fullsized":"2021-10-08T19:34:28.834846+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:31.003458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:33:31.003458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.053588330000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"289'20","reported_seq":387,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.836276+0000","last_change":"2021-10-08T19:34:12.001980+0000","last_active":"2021-10-08T19:34:28.836276+0000","last_peered":"2021-10-08T19:34:28.836276+0000","last_clean":"2021-10-08T19:34:28.836276+0000","last_became_active":"2021-10-08T19:29:40.636448+0000","last_became_peered":"2021-10-08T19:29:40.636448+0000","last_unstale":"2021-10-08T19:34:28.836276+0000","last_undegraded":"2021-10-08T19:34:28.836276+0000","last_fullsized":"2021-10-08T19:34:28.836276+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'20","last_scrub_stamp":"2021-10-08T19:34:12.001875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:34:12.001875+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0097733339999999998,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":308,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.838508+0000","last_change":"2021-10-08T19:32:44.776643+0000","last_active":"2021-10-08T19:34:28.838508+0000","last_peered":"2021-10-08T19:34:28.838508+0000","last_clean":"2021-10-08T19:34:28.838508+0000","last_became_active":"2021-10-08T19:21:23.604530+0000","last_became_peered":"2021-10-08T19:21:23.604530+0000","last_unstale":"2021-10-08T19:34:28.838508+0000","last_undegraded":"2021-10-08T19:34:28.838508+0000","last_fullsized":"2021-10-08T19:34:28.838508+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:44.776567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:44.776567+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0068263819999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1f","version":"114'10","reported_seq":377,"reported_epoch":343,"state":"active+clean","last_fresh":"2021-10-08T19:34:31.772324+0000","last_change":"2021-10-08T19:32:38.829487+0000","last_active":"2021-10-08T19:34:31.772324+0000","last_peered":"2021-10-08T19:34:31.772324+0000","last_clean":"2021-10-08T19:34:31.772324+0000","last_became_active":"2021-10-08T19:24:25.105742+0000","last_became_peered":"2021-10-08T19:24:25.105742+0000","last_unstale":"2021-10-08T19:34:31.772324+0000","last_undegraded":"2021-10-08T19:34:31.772324+0000","last_fullsized":"2021-10-08T19:34:31.772324+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'10","last_scrub_stamp":"2021-10-08T19:32:38.829395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:32:38.829395+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0081928529999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"69'1","reported_seq":304,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.846291+0000","last_change":"2021-10-08T19:31:36.328498+0000","last_active":"2021-10-08T19:34:28.846291+0000","last_peered":"2021-10-08T19:34:28.846291+0000","last_clean":"2021-10-08T19:34:28.846291+0000","last_became_active":"2021-10-08T19:21:29.640296+0000","last_became_peered":"2021-10-08T19:21:29.640296+0000","last_unstale":"2021-10-08T19:34:28.846291+0000","last_undegraded":"2021-10-08T19:34:28.846291+0000","last_fullsized":"2021-10-08T19:34:28.846291+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2021-10-08T19:31:36.328401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:31:36.328401+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040870780000000001,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"289'19","reported_seq":323,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.841141+0000","last_change":"2021-10-08T19:33:19.899016+0000","last_active":"2021-10-08T19:34:28.841141+0000","last_peered":"2021-10-08T19:34:28.841141+0000","last_clean":"2021-10-08T19:34:28.841141+0000","last_became_active":"2021-10-08T19:28:40.126425+0000","last_became_peered":"2021-10-08T19:28:40.126425+0000","last_unstale":"2021-10-08T19:34:28.841141+0000","last_undegraded":"2021-10-08T19:34:28.841141+0000","last_fullsized":"2021-10-08T19:34:28.841141+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:33:19.898917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:33:19.898917+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0085652420000000007,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":128,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.834395+0000","last_change":"2021-10-08T19:34:13.102972+0000","last_active":"2021-10-08T19:34:28.834395+0000","last_peered":"2021-10-08T19:34:28.834395+0000","last_clean":"2021-10-08T19:34:28.834395+0000","last_became_active":"2021-10-08T19:29:40.640952+0000","last_became_peered":"2021-10-08T19:29:40.640952+0000","last_unstale":"2021-10-08T19:34:28.834395+0000","last_undegraded":"2021-10-08T19:34:28.834395+0000","last_fullsized":"2021-10-08T19:34:28.834395+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:13.102869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:13.102869+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0080406309999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":311,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.836227+0000","last_change":"2021-10-08T19:33:19.099040+0000","last_active":"2021-10-08T19:34:28.836227+0000","last_peered":"2021-10-08T19:34:28.836227+0000","last_clean":"2021-10-08T19:34:28.836227+0000","last_became_active":"2021-10-08T19:21:27.632648+0000","last_became_peered":"2021-10-08T19:21:27.632648+0000","last_unstale":"2021-10-08T19:34:28.836227+0000","last_undegraded":"2021-10-08T19:34:28.836227+0000","last_fullsized":"2021-10-08T19:34:28.836227+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:19.098920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:33:19.098920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002952966,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"69'1","reported_seq":159,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.847516+0000","last_change":"2021-10-08T19:32:43.588347+0000","last_active":"2021-10-08T19:34:28.847516+0000","last_peered":"2021-10-08T19:34:28.847516+0000","last_clean":"2021-10-08T19:34:28.847516+0000","last_became_active":"2021-10-08T19:28:40.146302+0000","last_became_peered":"2021-10-08T19:28:40.146302+0000","last_unstale":"2021-10-08T19:34:28.847516+0000","last_undegraded":"2021-10-08T19:34:28.847516+0000","last_fullsized":"2021-10-08T19:34:28.847516+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2021-10-08T19:32:43.588271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:32:43.588271+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.074694546000000001,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"289'27","reported_seq":481,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.844202+0000","last_change":"2021-10-08T19:33:30.412016+0000","last_active":"2021-10-08T19:34:28.844202+0000","last_peered":"2021-10-08T19:34:28.844202+0000","last_clean":"2021-10-08T19:34:28.844202+0000","last_became_active":"2021-10-08T19:29:40.629461+0000","last_became_peered":"2021-10-08T19:29:40.629461+0000","last_unstale":"2021-10-08T19:34:28.844202+0000","last_undegraded":"2021-10-08T19:34:28.844202+0000","last_fullsized":"2021-10-08T19:34:28.844202+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'27","last_scrub_stamp":"2021-10-08T19:33:30.411911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:33:30.411911+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0070106459999999997,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":550,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":265,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.841342+0000","last_change":"2021-10-08T19:34:22.343729+0000","last_active":"2021-10-08T19:34:28.841342+0000","last_peered":"2021-10-08T19:34:28.841342+0000","last_clean":"2021-10-08T19:34:28.841342+0000","last_became_active":"2021-10-08T19:24:25.106119+0000","last_became_peered":"2021-10-08T19:24:25.106119+0000","last_unstale":"2021-10-08T19:34:28.841342+0000","last_undegraded":"2021-10-08T19:34:28.841342+0000","last_fullsized":"2021-10-08T19:34:28.841342+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:22.343621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:46.422866+0000","last_clean_scrub_stamp":"2021-10-08T19:34:22.343621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0027685370000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":155,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.847587+0000","last_change":"2021-10-08T19:32:10.735314+0000","last_active":"2021-10-08T19:34:28.847587+0000","last_peered":"2021-10-08T19:34:28.847587+0000","last_clean":"2021-10-08T19:34:28.847587+0000","last_became_active":"2021-10-08T19:28:40.148009+0000","last_became_peered":"2021-10-08T19:28:40.148009+0000","last_unstale":"2021-10-08T19:34:28.847587+0000","last_undegraded":"2021-10-08T19:34:28.847587+0000","last_fullsized":"2021-10-08T19:34:28.847587+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:10.735237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:32:10.735237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0071591729999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":320,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.828623+0000","last_change":"2021-10-08T19:32:40.398092+0000","last_active":"2021-10-08T19:34:28.828623+0000","last_peered":"2021-10-08T19:34:28.828623+0000","last_clean":"2021-10-08T19:34:28.828623+0000","last_became_active":"2021-10-08T19:24:25.097782+0000","last_became_peered":"2021-10-08T19:24:25.097782+0000","last_unstale":"2021-10-08T19:34:28.828623+0000","last_undegraded":"2021-10-08T19:34:28.828623+0000","last_fullsized":"2021-10-08T19:34:28.828623+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:40.397976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:37.219503+0000","last_clean_scrub_stamp":"2021-10-08T19:32:40.397976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039828600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"289'18","reported_seq":149,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.834414+0000","last_change":"2021-10-08T19:33:26.859021+0000","last_active":"2021-10-08T19:34:28.834414+0000","last_peered":"2021-10-08T19:34:28.834414+0000","last_clean":"2021-10-08T19:34:28.834414+0000","last_became_active":"2021-10-08T19:29:40.645144+0000","last_became_peered":"2021-10-08T19:29:40.645144+0000","last_unstale":"2021-10-08T19:34:28.834414+0000","last_undegraded":"2021-10-08T19:34:28.834414+0000","last_fullsized":"2021-10-08T19:34:28.834414+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'18","last_scrub_stamp":"2021-10-08T19:33:26.858913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:33:26.858913+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012581844999999999,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":25,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":122,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.834618+0000","last_change":"2021-10-08T19:32:13.456918+0000","last_active":"2021-10-08T19:34:28.834618+0000","last_peered":"2021-10-08T19:34:28.834618+0000","last_clean":"2021-10-08T19:34:28.834618+0000","last_became_active":"2021-10-08T19:29:44.443807+0000","last_became_peered":"2021-10-08T19:29:44.443807+0000","last_unstale":"2021-10-08T19:34:28.834618+0000","last_undegraded":"2021-10-08T19:34:28.834618+0000","last_fullsized":"2021-10-08T19:34:28.834618+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:13.456818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:32:13.456818+0000","last_clean_scrub_stamp":"2021-10-08T19:32:13.456818+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013599351000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":322,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.827607+0000","last_change":"2021-10-08T19:31:59.409211+0000","last_active":"2021-10-08T19:34:28.827607+0000","last_peered":"2021-10-08T19:34:28.827607+0000","last_clean":"2021-10-08T19:34:28.827607+0000","last_became_active":"2021-10-08T19:29:40.638352+0000","last_became_peered":"2021-10-08T19:29:40.638352+0000","last_unstale":"2021-10-08T19:34:28.827607+0000","last_undegraded":"2021-10-08T19:34:28.827607+0000","last_fullsized":"2021-10-08T19:34:28.827607+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:59.409131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:31:59.409131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0098736889999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":140,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.835627+0000","last_change":"2021-10-08T19:32:12.549448+0000","last_active":"2021-10-08T19:34:28.835627+0000","last_peered":"2021-10-08T19:34:28.835627+0000","last_clean":"2021-10-08T19:34:28.835627+0000","last_became_active":"2021-10-08T19:31:22.788455+0000","last_became_peered":"2021-10-08T19:31:22.788455+0000","last_unstale":"2021-10-08T19:34:28.835627+0000","last_undegraded":"2021-10-08T19:34:28.835627+0000","last_fullsized":"2021-10-08T19:34:28.835627+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:12.549351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:32:12.549351+0000","last_clean_scrub_stamp":"2021-10-08T19:32:12.549351+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.087121061999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"289'15","reported_seq":371,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.826538+0000","last_change":"2021-10-08T19:34:09.072669+0000","last_active":"2021-10-08T19:34:28.826538+0000","last_peered":"2021-10-08T19:34:28.826538+0000","last_clean":"2021-10-08T19:34:28.826538+0000","last_became_active":"2021-10-08T19:29:40.631689+0000","last_became_peered":"2021-10-08T19:29:40.631689+0000","last_unstale":"2021-10-08T19:34:28.826538+0000","last_undegraded":"2021-10-08T19:34:28.826538+0000","last_fullsized":"2021-10-08T19:34:28.826538+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'15","last_scrub_stamp":"2021-10-08T19:34:09.072548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:34:09.072548+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.01071632,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":319,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.846095+0000","last_change":"2021-10-08T19:34:15.628608+0000","last_active":"2021-10-08T19:34:28.846095+0000","last_peered":"2021-10-08T19:34:28.846095+0000","last_clean":"2021-10-08T19:34:28.846095+0000","last_became_active":"2021-10-08T19:21:23.607785+0000","last_became_peered":"2021-10-08T19:21:23.607785+0000","last_unstale":"2021-10-08T19:34:28.846095+0000","last_undegraded":"2021-10-08T19:34:28.846095+0000","last_fullsized":"2021-10-08T19:34:28.846095+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:15.628516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:15.628516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0075668530000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":304,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.838313+0000","last_change":"2021-10-08T19:32:11.832450+0000","last_active":"2021-10-08T19:34:28.838313+0000","last_peered":"2021-10-08T19:34:28.838313+0000","last_clean":"2021-10-08T19:34:28.838313+0000","last_became_active":"2021-10-08T19:21:27.633979+0000","last_became_peered":"2021-10-08T19:21:27.633979+0000","last_unstale":"2021-10-08T19:34:28.838313+0000","last_undegraded":"2021-10-08T19:34:28.838313+0000","last_fullsized":"2021-10-08T19:34:28.838313+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:11.832343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:05.799361+0000","last_clean_scrub_stamp":"2021-10-08T19:32:11.832343+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0049579899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":325,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.836671+0000","last_change":"2021-10-08T19:32:43.041993+0000","last_active":"2021-10-08T19:34:28.836671+0000","last_peered":"2021-10-08T19:34:28.836671+0000","last_clean":"2021-10-08T19:34:28.836671+0000","last_became_active":"2021-10-08T19:28:40.159162+0000","last_became_peered":"2021-10-08T19:28:40.159162+0000","last_unstale":"2021-10-08T19:34:28.836671+0000","last_undegraded":"2021-10-08T19:34:28.836671+0000","last_fullsized":"2021-10-08T19:34:28.836671+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:43.041874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:32:43.041874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.039844900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"289'7","reported_seq":402,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.827256+0000","last_change":"2021-10-08T19:34:14.978409+0000","last_active":"2021-10-08T19:34:28.827256+0000","last_peered":"2021-10-08T19:34:28.827256+0000","last_clean":"2021-10-08T19:34:28.827256+0000","last_became_active":"2021-10-08T19:31:51.675189+0000","last_became_peered":"2021-10-08T19:31:51.675189+0000","last_unstale":"2021-10-08T19:34:28.827256+0000","last_undegraded":"2021-10-08T19:34:28.827256+0000","last_fullsized":"2021-10-08T19:34:28.827256+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'7","last_scrub_stamp":"2021-10-08T19:34:14.978294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:34:14.978294+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.015468765000000001,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":10,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":335,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.845360+0000","last_change":"2021-10-08T19:32:46.108417+0000","last_active":"2021-10-08T19:34:28.845360+0000","last_peered":"2021-10-08T19:34:28.845360+0000","last_clean":"2021-10-08T19:34:28.845360+0000","last_became_active":"2021-10-08T19:24:25.096225+0000","last_became_peered":"2021-10-08T19:24:25.096225+0000","last_unstale":"2021-10-08T19:34:28.845360+0000","last_undegraded":"2021-10-08T19:34:28.845360+0000","last_fullsized":"2021-10-08T19:34:28.845360+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:46.108322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:29:40.244757+0000","last_clean_scrub_stamp":"2021-10-08T19:32:46.108322+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002015986,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":333,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.844831+0000","last_change":"2021-10-08T19:34:11.633837+0000","last_active":"2021-10-08T19:34:28.844831+0000","last_peered":"2021-10-08T19:34:28.844831+0000","last_clean":"2021-10-08T19:34:28.844831+0000","last_became_active":"2021-10-08T19:28:40.101187+0000","last_became_peered":"2021-10-08T19:28:40.101187+0000","last_unstale":"2021-10-08T19:34:28.844831+0000","last_undegraded":"2021-10-08T19:34:28.844831+0000","last_fullsized":"2021-10-08T19:34:28.844831+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:11.633739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:11.633739+0000","last_clean_scrub_stamp":"2021-10-08T19:34:11.633739+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0065073010000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":338,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.838857+0000","last_change":"2021-10-08T19:32:48.773228+0000","last_active":"2021-10-08T19:34:28.838857+0000","last_peered":"2021-10-08T19:34:28.838857+0000","last_clean":"2021-10-08T19:34:28.838857+0000","last_became_active":"2021-10-08T19:29:40.632965+0000","last_became_peered":"2021-10-08T19:29:40.632965+0000","last_unstale":"2021-10-08T19:34:28.838857+0000","last_undegraded":"2021-10-08T19:34:28.838857+0000","last_fullsized":"2021-10-08T19:34:28.838857+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:48.773123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:32:48.773123+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.031438125999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"289'19","reported_seq":445,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.826126+0000","last_change":"2021-10-08T19:31:22.251853+0000","last_active":"2021-10-08T19:34:28.826126+0000","last_peered":"2021-10-08T19:34:28.826126+0000","last_clean":"2021-10-08T19:34:28.826126+0000","last_became_active":"2021-10-08T19:28:40.099770+0000","last_became_peered":"2021-10-08T19:28:40.099770+0000","last_unstale":"2021-10-08T19:34:28.826126+0000","last_undegraded":"2021-10-08T19:34:28.826126+0000","last_fullsized":"2021-10-08T19:34:28.826126+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'13","last_scrub_stamp":"2021-10-08T19:31:22.251742+0000","last_deep_scrub":"88'13","last_deep_scrub_stamp":"2021-10-08T19:23:16.016646+0000","last_clean_scrub_stamp":"2021-10-08T19:31:22.251742+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039856270000000003,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":128,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.834828+0000","last_change":"2021-10-08T19:34:04.124983+0000","last_active":"2021-10-08T19:34:28.834828+0000","last_peered":"2021-10-08T19:34:28.834828+0000","last_clean":"2021-10-08T19:34:28.834828+0000","last_became_active":"2021-10-08T19:29:40.627394+0000","last_became_peered":"2021-10-08T19:29:40.627394+0000","last_unstale":"2021-10-08T19:34:28.834828+0000","last_undegraded":"2021-10-08T19:34:28.834828+0000","last_fullsized":"2021-10-08T19:34:28.834828+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:04.124886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:04.124886+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0093513629999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":155,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.846750+0000","last_change":"2021-10-08T19:32:09.778928+0000","last_active":"2021-10-08T19:34:28.846750+0000","last_peered":"2021-10-08T19:34:28.846750+0000","last_clean":"2021-10-08T19:34:28.846750+0000","last_became_active":"2021-10-08T19:28:40.145868+0000","last_became_peered":"2021-10-08T19:28:40.145868+0000","last_unstale":"2021-10-08T19:34:28.846750+0000","last_undegraded":"2021-10-08T19:34:28.846750+0000","last_fullsized":"2021-10-08T19:34:28.846750+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:09.778832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:32:09.778832+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010192680000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":322,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.826453+0000","last_change":"2021-10-08T19:33:27.280376+0000","last_active":"2021-10-08T19:34:28.826453+0000","last_peered":"2021-10-08T19:34:28.826453+0000","last_clean":"2021-10-08T19:34:28.826453+0000","last_became_active":"2021-10-08T19:28:40.099543+0000","last_became_peered":"2021-10-08T19:28:40.099543+0000","last_unstale":"2021-10-08T19:34:28.826453+0000","last_undegraded":"2021-10-08T19:34:28.826453+0000","last_fullsized":"2021-10-08T19:34:28.826453+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:27.280257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:50.032367+0000","last_clean_scrub_stamp":"2021-10-08T19:33:27.280257+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.023013090999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"289'27","reported_seq":156,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.834486+0000","last_change":"2021-10-08T19:31:31.454233+0000","last_active":"2021-10-08T19:34:28.834486+0000","last_peered":"2021-10-08T19:34:28.834486+0000","last_clean":"2021-10-08T19:34:28.834486+0000","last_became_active":"2021-10-08T19:29:40.631002+0000","last_became_peered":"2021-10-08T19:29:40.631002+0000","last_unstale":"2021-10-08T19:34:28.834486+0000","last_undegraded":"2021-10-08T19:34:28.834486+0000","last_fullsized":"2021-10-08T19:34:28.834486+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'15","last_scrub_stamp":"2021-10-08T19:31:31.454160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:31:31.454160+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0041423509999999998,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":309,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.835942+0000","last_change":"2021-10-08T19:32:14.367390+0000","last_active":"2021-10-08T19:34:28.835942+0000","last_peered":"2021-10-08T19:34:28.835942+0000","last_clean":"2021-10-08T19:34:28.835942+0000","last_became_active":"2021-10-08T19:21:23.603422+0000","last_became_peered":"2021-10-08T19:21:23.603422+0000","last_unstale":"2021-10-08T19:34:28.835942+0000","last_undegraded":"2021-10-08T19:34:28.835942+0000","last_fullsized":"2021-10-08T19:34:28.835942+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:14.367284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:15.535842+0000","last_clean_scrub_stamp":"2021-10-08T19:32:14.367284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0022503430000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":348,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.826373+0000","last_change":"2021-10-08T19:34:08.021043+0000","last_active":"2021-10-08T19:34:28.826373+0000","last_peered":"2021-10-08T19:34:28.826373+0000","last_clean":"2021-10-08T19:34:28.826373+0000","last_became_active":"2021-10-08T19:28:40.099286+0000","last_became_peered":"2021-10-08T19:28:40.099286+0000","last_unstale":"2021-10-08T19:34:28.826373+0000","last_undegraded":"2021-10-08T19:34:28.826373+0000","last_fullsized":"2021-10-08T19:34:28.826373+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:08.020934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:31.176160+0000","last_clean_scrub_stamp":"2021-10-08T19:34:08.020934+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0064825229999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":122,"reported_epoch":342,"state":"active+clean","last_fresh":"2021-10-08T19:34:28.834771+0000","last_change":"2021-10-08T19:31:32.458220+0000","last_active":"2021-10-08T19:34:28.834771+0000","last_peered":"2021-10-08T19:34:28.834771+0000","last_clean":"2021-10-08T19:34:28.834771+0000","last_became_active":"2021-10-08T19:29:40.638221+0000","last_became_peered":"2021-10-08T19:29:40.638221+0000","last_unstale":"2021-10-08T19:34:28.834771+0000","last_undegraded":"2021-10-08T19:34:28.834771+0000","last_fullsized":"2021-10-08T19:34:28.834771+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.458082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.458082+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.045433947000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":1720909848,"num_objects":26260,"num_object_clones":0,"num_object_copies":78780,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26260,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":205118,"num_write_kb":7404033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1088,"num_bytes_recovered":71303168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":5159268352,"data_stored":5159256136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":69179,"ondisk_log_size":69179,"up":48,"acting":48,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":11,"stat_sum":{"num_bytes":381350,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":28,"num_write":16,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":686385,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1430,"ondisk_log_size":1430,"up":33,"acting":33,"num_store_stats":8},{"poolid":3,"num_pg":23,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":611,"num_read_kb":611,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1167,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":69,"acting":69,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1113,"num_read_kb":870,"num_write":703,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":520,"num_bytes_recovered":10826,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":700,"ondisk_log_size":700,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":96,"acting":96,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201442,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1212868,"kb_used_data":991108,"kb_used_omap":0,"kb_used_meta":221632,"kb_avail":92532284,"statfs":{"total":95995035648,"available":94753058816,"internally_reserved":0,"allocated":1014894592,"data_stored":1014533879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":226951168},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:34:32 2021","interfaces":[{"interface":"back","average":{"1min":1.734,"5min":1.6040000000000001,"15min":1.359},"min":{"1min":0.21199999999999999,"5min":0.20699999999999999,"15min":0.20100000000000001},"max":{"1min":8.8160000000000007,"5min":26.065000000000001,"15min":32.366999999999997},"last":0.49099999999999999},{"interface":"front","average":{"1min":2.476,"5min":2.1299999999999999,"15min":1.617},"min":{"1min":0.30099999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":9.4410000000000007,"5min":25.75,"15min":29.736000000000001},"last":0.63900000000000001}]},{"osd":1,"last update":"Fri Oct 8 19:34:32 2021","interfaces":[{"interface":"back","average":{"1min":1.986,"5min":2.1459999999999999,"15min":1.6339999999999999},"min":{"1min":0.22600000000000001,"5min":0.19900000000000001,"15min":0.19600000000000001},"max":{"1min":5.2080000000000002,"5min":26.044,"15min":26.044},"last":0.33100000000000002},{"interface":"front","average":{"1min":2.1280000000000001,"5min":2.1960000000000002,"15min":1.4990000000000001},"min":{"1min":0.24099999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":5.25,"5min":26.138999999999999,"15min":28.119},"last":1.788}]},{"osd":2,"last update":"Fri Oct 8 19:34:32 2021","interfaces":[{"interface":"back","average":{"1min":2.1150000000000002,"5min":1.6639999999999999,"15min":1.526},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":5.7130000000000001,"5min":7.524,"15min":27.018000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":2.105,"5min":1.6240000000000001,"15min":1.421},"min":{"1min":0.31,"5min":0.28199999999999997,"15min":0.27800000000000002},"max":{"1min":7.29,"5min":8.2870000000000008,"15min":27.113},"last":2.2330000000000001}]},{"osd":3,"last update":"Fri Oct 8 19:34:32 2021","interfaces":[{"interface":"back","average":{"1min":2.9460000000000002,"5min":2.7570000000000001,"15min":2.0129999999999999},"min":{"1min":0.34499999999999997,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":24.945,"5min":72.093999999999994,"15min":72.093999999999994},"last":2.3170000000000002},{"interface":"front","average":{"1min":2.444,"5min":2.8399999999999999,"15min":1.9830000000000001},"min":{"1min":0.33000000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":7.4909999999999997,"5min":71.864999999999995,"15min":71.864999999999995},"last":0.66700000000000004}]},{"osd":4,"last update":"Fri Oct 8 19:34:32 2021","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.95999999999999996,"15min":0.78400000000000003},"min":{"1min":0.28100000000000003,"5min":0.23899999999999999,"15min":0.22800000000000001},"max":{"1min":4.258,"5min":8.391,"15min":8.391},"last":0.53200000000000003},{"interface":"front","average":{"1min":1.6759999999999999,"5min":1.3100000000000001,"15min":0.84799999999999998},"min":{"1min":0.27800000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":4.976,"5min":9.0820000000000007,"15min":9.0820000000000007},"last":4.976}]},{"osd":5,"last update":"Fri Oct 8 19:34:32 2021","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.236,"15min":0.91800000000000004},"min":{"1min":0.28199999999999997,"5min":0.26800000000000002,"15min":0.251},"max":{"1min":4.1280000000000001,"5min":9.9280000000000008,"15min":9.9280000000000008},"last":0.55400000000000005},{"interface":"front","average":{"1min":1.976,"5min":1.401,"15min":0.92400000000000004},"min":{"1min":0.34799999999999998,"5min":0.30199999999999999,"15min":0.26100000000000001},"max":{"1min":7.54,"5min":16.093,"15min":18.655000000000001},"last":7.54}]},{"osd":6,"last update":"Fri Oct 8 19:34:32 2021","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.3799999999999999,"15min":0.96599999999999997},"min":{"1min":0.314,"5min":0.30399999999999999,"15min":0.27900000000000003},"max":{"1min":5.093,"5min":17.082000000000001,"15min":17.082000000000001},"last":5.093},{"interface":"front","average":{"1min":1.171,"5min":1.1040000000000001,"15min":0.89900000000000002},"min":{"1min":0.31900000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":3.3919999999999999,"5min":7.742,"15min":7.742},"last":0.59899999999999998}]}]},{"osd":6,"up_from":47,"seq":201863463078,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":511344,"kb_used_data":324200,"kb_used_omap":0,"kb_used_meta":187136,"kb_avail":93233808,"statfs":{"total":95995035648,"available":95471419392,"internally_reserved":0,"allocated":331980800,"data_stored":331647212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":191627264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:34:15 2021","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":0.98499999999999999,"15min":1.151},"min":{"1min":0.224,"5min":0.20899999999999999,"15min":0.20100000000000001},"max":{"1min":5.194,"5min":5.194,"15min":28.382999999999999},"last":0.36699999999999999},{"interface":"front","average":{"1min":1.548,"5min":1.6519999999999999,"15min":1.649},"min":{"1min":0.25900000000000001,"5min":0.22600000000000001,"15min":0.21299999999999999},"max":{"1min":8.3300000000000001,"5min":15.458,"15min":69.477000000000004},"last":1.161}]},{"osd":1,"last update":"Fri Oct 8 19:34:15 2021","interfaces":[{"interface":"back","average":{"1min":1.861,"5min":1.385,"15min":1.0640000000000001},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.23000000000000001},"max":{"1min":5.0579999999999998,"5min":5.4809999999999999,"15min":14.878},"last":3.9100000000000001},{"interface":"front","average":{"1min":1.7589999999999999,"5min":1.452,"15min":1.119},"min":{"1min":0.28999999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":5.0880000000000001,"5min":7.4189999999999996,"15min":14.779},"last":3.5600000000000001}]},{"osd":2,"last update":"Fri Oct 8 19:34:15 2021","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.252,"15min":1.508},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.251},"max":{"1min":5.1269999999999998,"5min":6.7960000000000003,"15min":69.322999999999993},"last":2.089},{"interface":"front","average":{"1min":2.0670000000000002,"5min":1.7709999999999999,"15min":1.6779999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.245},"max":{"1min":8.3710000000000004,"5min":15.504,"15min":69.418999999999997},"last":5.5209999999999999}]},{"osd":3,"last update":"Fri Oct 8 19:34:15 2021","interfaces":[{"interface":"back","average":{"1min":1.8999999999999999,"5min":1.6040000000000001,"15min":1.3899999999999999},"min":{"1min":0.35399999999999998,"5min":0.307,"15min":0.27900000000000003},"max":{"1min":4.1020000000000003,"5min":7.2910000000000004,"15min":21.670000000000002},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.359,"5min":1.335,"15min":1.216},"min":{"1min":0.34200000000000003,"5min":0.32600000000000001,"15min":0.28000000000000003},"max":{"1min":5.1740000000000004,"5min":8.3360000000000003,"15min":22.254999999999999},"last":0.56799999999999995}]},{"osd":4,"last update":"Fri Oct 8 19:34:15 2021","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.3640000000000001,"15min":0.78600000000000003},"min":{"1min":0.29499999999999998,"5min":0.254,"15min":0.254},"max":{"1min":3.5129999999999999,"5min":24.516999999999999,"15min":24.516999999999999},"last":1.101},{"interface":"front","average":{"1min":1.361,"5min":1.099,"15min":1.004},"min":{"1min":0.28599999999999998,"5min":0.27500000000000002,"15min":0.26100000000000001},"max":{"1min":4.0700000000000003,"5min":9.6890000000000001,"15min":69.593999999999994},"last":0.45700000000000002}]},{"osd":5,"last update":"Fri Oct 8 19:34:15 2021","interfaces":[{"interface":"back","average":{"1min":1.9259999999999999,"5min":2.0659999999999998,"15min":1.0580000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.28499999999999998},"max":{"1min":8.5760000000000005,"5min":48.545999999999999,"15min":48.545999999999999},"last":1.867},{"interface":"front","average":{"1min":1.649,"5min":1.8540000000000001,"15min":1.276},"min":{"1min":0.31,"5min":0.31,"15min":0.252},"max":{"1min":7.0309999999999997,"5min":46.003999999999998,"15min":69.561000000000007},"last":4.1500000000000004}]},{"osd":7,"last update":"Fri Oct 8 19:33:38 2021","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.0820000000000001,"15min":0.745},"min":{"1min":0.36899999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":4.4470000000000001,"5min":5.5019999999999998,"15min":5.5019999999999998},"last":7.1230000000000002},{"interface":"front","average":{"1min":1.569,"5min":1.423,"15min":0.90500000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.313},"max":{"1min":4.3840000000000003,"5min":15.962,"15min":15.962},"last":1.135}]}]},{"osd":1,"up_from":13,"seq":55834575033,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1238940,"kb_used_data":959708,"kb_used_omap":0,"kb_used_meta":278976,"kb_avail":92506212,"statfs":{"total":95995035648,"available":94726361088,"internally_reserved":0,"allocated":982740992,"data_stored":982354998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":285671424},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:33:53 2021","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":4.0640000000000001,"15min":2.8889999999999998},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.184},"max":{"1min":5.1479999999999997,"5min":126.256,"15min":126.256},"last":0.68200000000000005},{"interface":"front","average":{"1min":1.7509999999999999,"5min":3.9020000000000001,"15min":3.109},"min":{"1min":0.22700000000000001,"5min":0.182,"15min":0.182},"max":{"1min":5.8250000000000002,"5min":126.176,"15min":126.176},"last":0.27000000000000002}]},{"osd":2,"last update":"Fri Oct 8 19:34:13 2021","interfaces":[{"interface":"back","average":{"1min":1.423,"5min":2.5310000000000001,"15min":2.1819999999999999},"min":{"1min":0.20899999999999999,"5min":0.192,"15min":0.192},"max":{"1min":6.9530000000000003,"5min":102.395,"15min":102.395},"last":0.46300000000000002},{"interface":"front","average":{"1min":1.234,"5min":3.1040000000000001,"15min":2.52},"min":{"1min":0.28899999999999998,"5min":0.23400000000000001,"15min":0.22700000000000001},"max":{"1min":2.7629999999999999,"5min":102.50700000000001,"15min":102.50700000000001},"last":0.35399999999999998}]},{"osd":3,"last update":"Fri Oct 8 19:34:31 2021","interfaces":[{"interface":"back","average":{"1min":1.875,"5min":3.7519999999999998,"15min":2.6949999999999998},"min":{"1min":0.307,"5min":0.24399999999999999,"15min":0.23999999999999999},"max":{"1min":7.0800000000000001,"5min":105.836,"15min":105.836},"last":0.64800000000000002},{"interface":"front","average":{"1min":2.8319999999999999,"5min":3.831,"15min":2.548},"min":{"1min":0.32700000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":9.282,"5min":106.12,"15min":106.12},"last":0.98099999999999998}]},{"osd":4,"last update":"Fri Oct 8 19:33:41 2021","interfaces":[{"interface":"back","average":{"1min":1.554,"5min":2.5259999999999998,"15min":1.7589999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":4.3730000000000002,"5min":103.538,"15min":103.538},"last":1.099},{"interface":"front","average":{"1min":1.3400000000000001,"5min":2.5049999999999999,"15min":1.4630000000000001},"min":{"1min":0.34599999999999997,"5min":0.254,"15min":0.254},"max":{"1min":5.125,"5min":102.67100000000001,"15min":102.67100000000001},"last":1.3959999999999999}]},{"osd":5,"last update":"Fri Oct 8 19:34:06 2021","interfaces":[{"interface":"back","average":{"1min":1.4359999999999999,"5min":2.7440000000000002,"15min":1.8600000000000001},"min":{"1min":0.34100000000000003,"5min":0.33200000000000002,"15min":0.29899999999999999},"max":{"1min":6.1520000000000001,"5min":102.717,"15min":102.717},"last":0.308},{"interface":"front","average":{"1min":1.327,"5min":2.6499999999999999,"15min":1.55},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.29999999999999999},"max":{"1min":5.8120000000000003,"5min":102.617,"15min":102.617},"last":0.59199999999999997}]},{"osd":6,"last update":"Fri Oct 8 19:34:24 2021","interfaces":[{"interface":"back","average":{"1min":2.2250000000000001,"5min":2.7490000000000001,"15min":1.9059999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.26700000000000002},"max":{"1min":7.024,"5min":103.73,"15min":103.73},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.028,"5min":2.774,"15min":1.917},"min":{"1min":0.377,"5min":0.35599999999999998,"15min":0.28399999999999997},"max":{"1min":2.5430000000000001,"5min":102.753,"15min":102.753},"last":0.54900000000000004}]},{"osd":7,"last update":"Fri Oct 8 19:33:41 2021","interfaces":[{"interface":"back","average":{"1min":1.671,"5min":4.0199999999999996,"15min":2.323},"min":{"1min":0.39900000000000002,"5min":0.36399999999999999,"15min":0.312},"max":{"1min":4.6639999999999997,"5min":106.011,"15min":106.011},"last":0.51700000000000002},{"interface":"front","average":{"1min":1.675,"5min":3.8300000000000001,"15min":1.9419999999999999},"min":{"1min":0.45200000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":5.1749999999999998,"5min":103.78400000000001,"15min":103.78400000000001},"last":3.3570000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738556,"num_pgs":61,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":634300,"kb_used_data":418172,"kb_used_omap":0,"kb_used_meta":216000,"kb_avail":93110852,"statfs":{"total":95995035648,"available":95345512448,"internally_reserved":0,"allocated":428208128,"data_stored":427854407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":221184000},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 8 19:33:49 2021","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":2.8660000000000001,"15min":1.9410000000000001},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":4.2949999999999999,"5min":91.954999999999998,"15min":91.954999999999998},"last":2.1419999999999999},{"interface":"front","average":{"1min":2.8740000000000001,"5min":3.056,"15min":2.048},"min":{"1min":0.23699999999999999,"5min":0.219,"15min":0.217},"max":{"1min":11.113,"5min":91.046000000000006,"15min":91.046000000000006},"last":3.6749999999999998}]},{"osd":2,"last update":"Fri Oct 8 19:34:14 2021","interfaces":[{"interface":"back","average":{"1min":2.4849999999999999,"5min":1.893,"15min":1.905},"min":{"1min":0.248,"5min":0.22900000000000001,"15min":0.22700000000000001},"max":{"1min":9.6129999999999995,"5min":12.164999999999999,"15min":62.390000000000001},"last":5.093},{"interface":"front","average":{"1min":2.157,"5min":1.8029999999999999,"15min":1.7869999999999999},"min":{"1min":0.219,"5min":0.20000000000000001,"15min":0.19500000000000001},"max":{"1min":6.8819999999999997,"5min":10.121,"15min":62.718000000000004},"last":2.5859999999999999}]},{"osd":3,"last update":"Fri Oct 8 19:33:33 2021","interfaces":[{"interface":"back","average":{"1min":2.5960000000000001,"5min":2.448,"15min":2.012},"min":{"1min":0.218,"5min":0.217,"15min":0.217},"max":{"1min":11.068,"5min":14.551,"15min":62.491},"last":3.2000000000000002},{"interface":"front","average":{"1min":1.5820000000000001,"5min":2.3079999999999998,"15min":1.806},"min":{"1min":0.28899999999999998,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":7,"5min":22.016999999999999,"15min":62.673000000000002},"last":2.9550000000000001}]},{"osd":4,"last update":"Fri Oct 8 19:33:49 2021","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.7529999999999999,"15min":1.4419999999999999},"min":{"1min":0.36299999999999999,"5min":0.25800000000000001,"15min":0.22900000000000001},"max":{"1min":4.3570000000000002,"5min":16.805,"15min":16.805},"last":0.54200000000000004},{"interface":"front","average":{"1min":2.0819999999999999,"5min":1.278,"15min":1.2609999999999999},"min":{"1min":0.313,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":7.0890000000000004,"5min":7.0890000000000004,"15min":11.823},"last":2.2770000000000001}]},{"osd":5,"last update":"Fri Oct 8 19:34:05 2021","interfaces":[{"interface":"back","average":{"1min":1.7969999999999999,"5min":1.4930000000000001,"15min":1.1990000000000001},"min":{"1min":0.36599999999999999,"5min":0.28399999999999997,"15min":0.24099999999999999},"max":{"1min":6.9180000000000001,"5min":8.6530000000000005,"15min":15.56},"last":2.8439999999999999},{"interface":"front","average":{"1min":1.145,"5min":1.4570000000000001,"15min":1.4179999999999999},"min":{"1min":0.40200000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":4.3319999999999999,"5min":11.619999999999999,"15min":15.484999999999999},"last":2.097}]},{"osd":6,"last update":"Fri Oct 8 19:34:21 2021","interfaces":[{"interface":"back","average":{"1min":2.1970000000000001,"5min":1.421,"15min":1.405},"min":{"1min":0.34100000000000003,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":7.165,"5min":7.165,"15min":11.869},"last":2.355},{"interface":"front","average":{"1min":1.5509999999999999,"5min":1.5609999999999999,"15min":1.329},"min":{"1min":0.39900000000000002,"5min":0.32000000000000001,"15min":0.27500000000000002},"max":{"1min":5.8129999999999997,"5min":8.609,"15min":10.519},"last":2.9260000000000002}]},{"osd":7,"last update":"Fri Oct 8 19:33:33 2021","interfaces":[{"interface":"back","average":{"1min":1.76,"5min":1.768,"15min":1.4890000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.35399999999999998},"max":{"1min":5.1449999999999996,"5min":11.669,"15min":11.669},"last":0.57499999999999996},{"interface":"front","average":{"1min":1.4950000000000001,"5min":1.5049999999999999,"15min":1.4810000000000001},"min":{"1min":0.45000000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":3.6709999999999998,"5min":9.8849999999999998,"15min":11.898999999999999},"last":2.3100000000000001}]}]},{"osd":2,"up_from":18,"seq":77309411508,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":541228,"kb_used_data":325932,"kb_used_omap":0,"kb_used_meta":215104,"kb_avail":93203924,"statfs":{"total":95995035648,"available":95440818176,"internally_reserved":0,"allocated":333754368,"data_stored":333417082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220266496},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:34:07 2021","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":2.133,"15min":2.101},"min":{"1min":0.19600000000000001,"5min":0.184,"15min":0.17699999999999999},"max":{"1min":4.9530000000000003,"5min":60.990000000000002,"15min":61.670999999999999},"last":4.1550000000000002},{"interface":"front","average":{"1min":1.4530000000000001,"5min":2.113,"15min":2.0819999999999999},"min":{"1min":0.23999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":5.4630000000000001,"5min":60.850999999999999,"15min":65.284999999999997},"last":6.6660000000000004}]},{"osd":1,"last update":"Fri Oct 8 19:34:07 2021","interfaces":[{"interface":"back","average":{"1min":4.867,"5min":3.7040000000000002,"15min":2.4289999999999998},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.192},"max":{"1min":63.738,"5min":63.738,"15min":63.738},"last":0.67100000000000004},{"interface":"front","average":{"1min":5.5860000000000003,"5min":4.0410000000000004,"15min":2.629},"min":{"1min":0.26500000000000001,"5min":0.25900000000000001,"15min":0.21299999999999999},"max":{"1min":63.619999999999997,"5min":63.619999999999997,"15min":63.619999999999997},"last":4.8209999999999997}]},{"osd":3,"last update":"Fri Oct 8 19:34:15 2021","interfaces":[{"interface":"back","average":{"1min":2.661,"5min":3.6379999999999999,"15min":2.6349999999999998},"min":{"1min":0.30099999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":7.8460000000000001,"5min":63.658999999999999,"15min":65.322999999999993},"last":1.7150000000000001},{"interface":"front","average":{"1min":1.8779999999999999,"5min":3.5739999999999998,"15min":2.5329999999999999},"min":{"1min":0.29599999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":10.317,"5min":65.418000000000006,"15min":65.418000000000006},"last":0.53500000000000003}]},{"osd":4,"last update":"Fri Oct 8 19:33:39 2021","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":1.4359999999999999,"15min":1.3120000000000001},"min":{"1min":0.32800000000000001,"5min":0.29499999999999998,"15min":0.26900000000000002},"max":{"1min":3.4239999999999999,"5min":24.657,"15min":24.657},"last":0.39900000000000002},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.452,"15min":1.4019999999999999},"min":{"1min":0.28399999999999997,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":7.7469999999999999,"5min":8.5990000000000002,"15min":15.143000000000001},"last":1.776}]},{"osd":5,"last update":"Fri Oct 8 19:34:07 2021","interfaces":[{"interface":"back","average":{"1min":1.962,"5min":1.613,"15min":1.4319999999999999},"min":{"1min":0.32100000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":7.7409999999999997,"5min":8.6240000000000006,"15min":15.087999999999999},"last":2.1669999999999998},{"interface":"front","average":{"1min":1.6679999999999999,"5min":1.603,"15min":1.4570000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.27600000000000002},"max":{"1min":5.4379999999999997,"5min":26.094000000000001,"15min":26.094000000000001},"last":3.823}]},{"osd":6,"last update":"Fri Oct 8 19:34:15 2021","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.242,"15min":1.3360000000000001},"min":{"1min":0.40899999999999997,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":3.4510000000000001,"5min":7.7779999999999996,"15min":14.162000000000001},"last":0.37},{"interface":"front","average":{"1min":1.9450000000000001,"5min":1.3779999999999999,"15min":1.413},"min":{"1min":0.378,"5min":0.313,"15min":0.313},"max":{"1min":5.1500000000000004,"5min":10.92,"15min":16.68},"last":1.569}]},{"osd":7,"last update":"Fri Oct 8 19:33:39 2021","interfaces":[{"interface":"back","average":{"1min":1.7030000000000001,"5min":1.633,"15min":1.4490000000000001},"min":{"1min":0.371,"5min":0.32200000000000001,"15min":0.31900000000000001},"max":{"1min":6.7080000000000002,"5min":12.175000000000001,"15min":14.185},"last":1.952},{"interface":"front","average":{"1min":1.627,"5min":1.484,"15min":1.413},"min":{"1min":0.39100000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":4.9770000000000003,"5min":10.898,"15min":16.702999999999999},"last":1.5189999999999999}]}]},{"osd":3,"up_from":24,"seq":103079215282,"num_pgs":75,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1137688,"kb_used_data":830736,"kb_used_omap":0,"kb_used_meta":306944,"kb_avail":92607464,"statfs":{"total":95995035648,"available":94830043136,"internally_reserved":0,"allocated":850673664,"data_stored":850300524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":314310656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:34:31 2021","interfaces":[{"interface":"back","average":{"1min":2.524,"5min":2.4180000000000001,"15min":2.2839999999999998},"min":{"1min":0.20699999999999999,"5min":0.187,"15min":0.17000000000000001},"max":{"1min":7.7409999999999997,"5min":13.036,"15min":109.601},"last":7.7409999999999997},{"interface":"front","average":{"1min":1.407,"5min":1.8859999999999999,"15min":2.1899999999999999},"min":{"1min":0.23000000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":3.919,"5min":12.696999999999999,"15min":107.84},"last":3.0249999999999999}]},{"osd":1,"last update":"Fri Oct 8 19:34:31 2021","interfaces":[{"interface":"back","average":{"1min":1.6519999999999999,"5min":2.2010000000000001,"15min":1.8540000000000001},"min":{"1min":0.27100000000000002,"5min":0.23699999999999999,"15min":0.20999999999999999},"max":{"1min":4.1289999999999996,"5min":37.271999999999998,"15min":37.271999999999998},"last":3.0390000000000001},{"interface":"front","average":{"1min":1.796,"5min":2.093,"15min":1.8400000000000001},"min":{"1min":0.251,"5min":0.19,"15min":0.19},"max":{"1min":6.8310000000000004,"5min":37.033000000000001,"15min":37.033000000000001},"last":2.9220000000000002}]},{"osd":2,"last update":"Fri Oct 8 19:34:31 2021","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":1.3620000000000001,"15min":1.79},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":2.653,"5min":7.6890000000000001,"15min":32.277000000000001},"last":1.2470000000000001},{"interface":"front","average":{"1min":1.704,"5min":2.3399999999999999,"15min":1.792},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.22700000000000001},"max":{"1min":4.0170000000000003,"5min":23.189,"15min":23.189},"last":0.53000000000000003}]},{"osd":4,"last update":"Fri Oct 8 19:33:41 2021","interfaces":[{"interface":"back","average":{"1min":2.71,"5min":1.8280000000000001,"15min":1.4219999999999999},"min":{"1min":0.30499999999999999,"5min":0.26600000000000001,"15min":0.25600000000000001},"max":{"1min":13.968,"5min":13.968,"15min":18.064},"last":0.57099999999999995},{"interface":"front","average":{"1min":1.919,"5min":2.0609999999999999,"15min":1.5629999999999999},"min":{"1min":0.312,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":8.8460000000000001,"5min":15.414,"15min":18.692},"last":2.9889999999999999}]},{"osd":5,"last update":"Fri Oct 8 19:34:01 2021","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.5509999999999999,"15min":1.3859999999999999},"min":{"1min":0.30599999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":4.8719999999999999,"5min":11.125,"15min":13.186},"last":0.505},{"interface":"front","average":{"1min":3.3460000000000001,"5min":2.222,"15min":1.591},"min":{"1min":0.32600000000000001,"5min":0.311,"15min":0.28100000000000003},"max":{"1min":22.861000000000001,"5min":22.861000000000001,"15min":22.861000000000001},"last":0.54900000000000004}]},{"osd":6,"last update":"Fri Oct 8 19:34:17 2021","interfaces":[{"interface":"back","average":{"1min":1.5920000000000001,"5min":1.8100000000000001,"15min":1.8580000000000001},"min":{"1min":0.34300000000000003,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":3.8399999999999999,"5min":10.606999999999999,"15min":21.538},"last":3.5960000000000001},{"interface":"front","average":{"1min":1.54,"5min":1.6739999999999999,"15min":1.4690000000000001},"min":{"1min":0.42799999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":4.7999999999999998,"5min":13.067,"15min":13.298},"last":0.48299999999999998}]},{"osd":7,"last update":"Fri Oct 8 19:33:41 2021","interfaces":[{"interface":"back","average":{"1min":2.0169999999999999,"5min":1.9570000000000001,"15min":1.4379999999999999},"min":{"1min":0.35799999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":8.9000000000000004,"5min":10.696999999999999,"15min":10.696999999999999},"last":3.0539999999999998},{"interface":"front","average":{"1min":1.8779999999999999,"5min":1.5569999999999999,"15min":1.4159999999999999},"min":{"1min":0.38,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":6.1920000000000002,"5min":7.0460000000000003,"15min":13.225},"last":0.45800000000000002}]}]},{"osd":4,"up_from":30,"seq":128849019052,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":479816,"kb_used_data":312584,"kb_used_omap":0,"kb_used_meta":167104,"kb_avail":93265336,"statfs":{"total":95995035648,"available":95503704064,"internally_reserved":0,"allocated":320086016,"data_stored":319721047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":171114496},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:33:42 2021","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":2.1699999999999999,"15min":1.635},"min":{"1min":0.219,"5min":0.188,"15min":0.185},"max":{"1min":7.1319999999999997,"5min":82.109999999999999,"15min":82.109999999999999},"last":2.923},{"interface":"front","average":{"1min":1.7549999999999999,"5min":2.1070000000000002,"15min":1.6299999999999999},"min":{"1min":0.253,"5min":0.23000000000000001,"15min":0.20399999999999999},"max":{"1min":4.2939999999999996,"5min":82.025999999999996,"15min":82.025999999999996},"last":3.3559999999999999}]},{"osd":1,"last update":"Fri Oct 8 19:33:42 2021","interfaces":[{"interface":"back","average":{"1min":1.7829999999999999,"5min":1.9710000000000001,"15min":1.496},"min":{"1min":0.33200000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":4.5789999999999997,"5min":41.033000000000001,"15min":41.033000000000001},"last":5.8369999999999997},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.966,"15min":1.252},"min":{"1min":0.26100000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":3.8679999999999999,"5min":41.396999999999998,"15min":41.396999999999998},"last":2.8029999999999999}]},{"osd":2,"last update":"Fri Oct 8 19:33:42 2021","interfaces":[{"interface":"back","average":{"1min":1.6279999999999999,"5min":1.3280000000000001,"15min":1.24},"min":{"1min":0.34699999999999998,"5min":0.26800000000000002,"15min":0.23499999999999999},"max":{"1min":4.3449999999999998,"5min":7.9189999999999996,"15min":21.257000000000001},"last":0.505},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.252,"15min":1.222},"min":{"1min":0.26900000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":4.7770000000000001,"5min":6.6929999999999996,"15min":21.600000000000001},"last":0.29299999999999998}]},{"osd":3,"last update":"Fri Oct 8 19:33:42 2021","interfaces":[{"interface":"back","average":{"1min":1.7849999999999999,"5min":2.0569999999999999,"15min":1.869},"min":{"1min":0.30299999999999999,"5min":0.28499999999999998,"15min":0.26500000000000001},"max":{"1min":7.4130000000000003,"5min":40.026000000000003,"15min":58.506999999999998},"last":0.48899999999999999},{"interface":"front","average":{"1min":1.55,"5min":2.2250000000000001,"15min":1.611},"min":{"1min":0.35799999999999998,"5min":0.29999999999999999,"15min":0.27400000000000002},"max":{"1min":4.6760000000000002,"5min":41.316000000000003,"15min":58.521000000000001},"last":3.2210000000000001}]},{"osd":5,"last update":"Fri Oct 8 19:34:06 2021","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.0329999999999999,"15min":0.70699999999999996},"min":{"1min":0.33500000000000002,"5min":0.247,"15min":0.222},"max":{"1min":4.242,"5min":7.101,"15min":7.101},"last":2.7109999999999999},{"interface":"front","average":{"1min":1.1910000000000001,"5min":0.98699999999999999,"15min":0.68700000000000006},"min":{"1min":0.29099999999999998,"5min":0.23999999999999999,"15min":0.22900000000000001},"max":{"1min":4.1660000000000004,"5min":8.1319999999999997,"15min":8.1319999999999997},"last":0.46700000000000003}]},{"osd":6,"last update":"Fri Oct 8 19:34:20 2021","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":0.93000000000000005,"15min":0.72499999999999998},"min":{"1min":0.34699999999999998,"5min":0.28899999999999998,"15min":0.23599999999999999},"max":{"1min":4.2670000000000003,"5min":6.7300000000000004,"15min":6.7300000000000004},"last":0.32300000000000001},{"interface":"front","average":{"1min":1.155,"5min":0.97199999999999998,"15min":0.75600000000000001},"min":{"1min":0.36699999999999999,"5min":0.26600000000000001,"15min":0.247},"max":{"1min":4.6500000000000004,"5min":7.0720000000000001,"15min":7.0720000000000001},"last":1.5600000000000001}]},{"osd":7,"last update":"Fri Oct 8 19:33:42 2021","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":0.97899999999999998,"15min":0.69699999999999995},"min":{"1min":0.35299999999999998,"5min":0.29099999999999998,"15min":0.26400000000000001},"max":{"1min":4.2199999999999998,"5min":8.0050000000000008,"15min":8.0050000000000008},"last":1.5820000000000001},{"interface":"front","average":{"1min":1.29,"5min":0.97199999999999998,"15min":0.78500000000000003},"min":{"1min":0.35299999999999998,"5min":0.30499999999999999,"15min":0.29699999999999999},"max":{"1min":4.3209999999999997,"5min":6.3959999999999999,"15min":6.3959999999999999},"last":0.63300000000000001}]}]},{"osd":5,"up_from":38,"seq":163208757416,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1255612,"kb_used_data":997692,"kb_used_omap":0,"kb_used_meta":257792,"kb_avail":92489540,"statfs":{"total":95995035648,"available":94709288960,"internally_reserved":0,"allocated":1021636608,"data_stored":1021284319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":263979008},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:34:03 2021","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.4770000000000001,"15min":1.155},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":9.5310000000000006,"5min":24.597000000000001,"15min":24.597000000000001},"last":0.214},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.502,"15min":1.137},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":3.8639999999999999,"5min":24.510999999999999,"15min":24.510999999999999},"last":0.29099999999999998}]},{"osd":1,"last update":"Fri Oct 8 19:34:03 2021","interfaces":[{"interface":"back","average":{"1min":5.375,"5min":2.5110000000000001,"15min":1.554},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23000000000000001},"max":{"1min":94.558999999999997,"5min":94.558999999999997,"15min":94.558999999999997},"last":0.26300000000000001},{"interface":"front","average":{"1min":5.5999999999999996,"5min":2.4510000000000001,"15min":1.5249999999999999},"min":{"1min":0.23899999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":94.456999999999994,"5min":94.456999999999994,"15min":94.456999999999994},"last":0.32100000000000001}]},{"osd":2,"last update":"Fri Oct 8 19:34:03 2021","interfaces":[{"interface":"back","average":{"1min":1.6120000000000001,"5min":1.2450000000000001,"15min":1.4339999999999999},"min":{"1min":0.28000000000000003,"5min":0.25800000000000001,"15min":0.25700000000000001},"max":{"1min":7.2210000000000001,"5min":8.1259999999999994,"15min":29.398},"last":0.93400000000000005},{"interface":"front","average":{"1min":1.5329999999999999,"5min":1.355,"15min":1.4550000000000001},"min":{"1min":0.29499999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":5.944,"5min":8.3599999999999994,"15min":29.387},"last":0.25600000000000001}]},{"osd":3,"last update":"Fri Oct 8 19:34:03 2021","interfaces":[{"interface":"back","average":{"1min":2.0529999999999999,"5min":1.7130000000000001,"15min":1.4399999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.26200000000000001},"max":{"1min":5.875,"5min":11.685,"15min":12.356},"last":0.27700000000000002},{"interface":"front","average":{"1min":1.7330000000000001,"5min":2.0169999999999999,"15min":1.542},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":4.9580000000000002,"5min":13.366,"15min":21.504000000000001},"last":0.35999999999999999}]},{"osd":4,"last update":"Fri Oct 8 19:34:03 2021","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":0.89700000000000002,"15min":0.68400000000000005},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.224},"max":{"1min":5.8650000000000002,"5min":9.2759999999999998,"15min":9.2759999999999998},"last":2.3500000000000001},{"interface":"front","average":{"1min":1.446,"5min":0.95099999999999996,"15min":0.69699999999999995},"min":{"1min":0.27900000000000003,"5min":0.25900000000000001,"15min":0.23799999999999999},"max":{"1min":5.0890000000000004,"5min":7.8959999999999999,"15min":7.8959999999999999},"last":0.48499999999999999}]},{"osd":6,"last update":"Fri Oct 8 19:34:21 2021","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":0.96499999999999997,"15min":0.76100000000000001},"min":{"1min":0.28499999999999998,"5min":0.255,"15min":0.255},"max":{"1min":5.8879999999999999,"5min":5.8879999999999999,"15min":7.266},"last":0.81299999999999994},{"interface":"front","average":{"1min":1.0189999999999999,"5min":0.96499999999999997,"15min":0.75},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29099999999999998},"max":{"1min":3.7320000000000002,"5min":7.9390000000000001,"15min":7.9390000000000001},"last":0.75700000000000001}]},{"osd":7,"last update":"Fri Oct 8 19:33:37 2021","interfaces":[{"interface":"back","average":{"1min":2.331,"5min":1.1830000000000001,"15min":0.82099999999999995},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":29.946999999999999,"5min":29.946999999999999,"15min":29.946999999999999},"last":3.1120000000000001},{"interface":"front","average":{"1min":2.5790000000000002,"5min":1.3120000000000001,"15min":0.91300000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":29.294,"5min":29.294,"15min":29.294},"last":1.3129999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":266240,"data_stored":262688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":327680,"data_stored":327680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":424280064,"data_stored":424280064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":966725632,"data_stored":966721560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":321060864,"data_stored":321060864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":848232448,"data_stored":848232448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":312737792,"data_stored":312737792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":977932288,"data_stored":977928216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":326828032,"data_stored":326828032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":981471232,"data_stored":981467160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-10-08T19:34:41.329 INFO:tasks.cephadm.ceph_manager.ceph:recovered! 2021-10-08T19:34:41.329 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2021-10-08T19:34:41.330 INFO:tasks.thrashosds.thrasher:inject_pause on 2 2021-10-08T19:34:41.330 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2021-10-08T19:34:41.330 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2021-10-08T19:34:41.331 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.2 config set filestore_inject_stall 3 2021-10-08T19:34:41.342 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:34:41.425 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:41.435 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:34:41.499 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:34:41.635 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:34:41.645 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:41.646 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:34:41.747 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:34:41.795 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:41.873 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:34:41.883 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:41.884 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:34:41.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:41 smithi097 ceph-mon[32687]: pgmap v663: 178 pgs: 178 active+clean; 1.3 GiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.20k op/s 2021-10-08T19:34:41.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:41 smithi097 ceph-mon[41966]: pgmap v663: 178 pgs: 178 active+clean; 1.3 GiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.20k op/s 2021-10-08T19:34:41.985 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:34:42.049 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:42.121 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:41 smithi117 ceph-mon[34585]: pgmap v663: 178 pgs: 178 active+clean; 1.3 GiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.20k op/s 2021-10-08T19:34:42.137 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:34:42.144 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:42.145 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:34:42.248 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:34:42.301 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:42.371 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:34:42.373 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:42.374 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:34:42.475 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:34:42.536 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:42.657 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:34:42 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:34:42] "GET /metrics HTTP/1.1" 200 155821 "" "Prometheus/2.18.1" 2021-10-08T19:34:42.919 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:42 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1577933957' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:34:42.920 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:42 smithi097 ceph-mon[41966]: from='client.35735 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:34:42.920 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:42 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:34:42.920 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:42 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:34:42.923 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:42 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1577933957' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:34:42.923 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:42 smithi097 ceph-mon[32687]: from='client.35735 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:34:42.924 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:42 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:34:42.924 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:42 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:34:42.934 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is unset 2021-10-08T19:34:43.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:42 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1577933957' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:34:43.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:42 smithi117 ceph-mon[34585]: from='client.35735 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:34:43.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:42 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:34:43.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:42 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:34:43.255 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:34:43.585 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:34:43.593 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:43.594 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:34:43.698 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:34:43.761 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:34:43 smithi117 conmon[69189]: level=error ts=2021-10-08T19:34:43.505Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=2 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:34:43.782 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:43.791 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:34:43.792 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2021-10-08T19:34:43.792 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.792 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.25465.0:215733 9.f 9:fa9be2d8:::benchmark_data_smithi097_196985_object100042:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e345)", 2021-10-08T19:34:43.792 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:34:43.777559+0000", 2021-10-08T19:34:43.792 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.011496253999999999, 2021-10-08T19:34:43.793 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011526668, 2021-10-08T19:34:43.793 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:34:43.793 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "waiting for sub ops", 2021-10-08T19:34:43.793 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:34:43.794 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.25465", 2021-10-08T19:34:43.794 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:34:43.794 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 215733 2021-10-08T19:34:43.794 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.795 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:34:43.795 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.795 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:34:43.796 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.777559+0000", 2021-10-08T19:34:43.796 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:43.796 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.796 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.797 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:34:43.797 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.777559+0000", 2021-10-08T19:34:43.798 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:43.798 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.798 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.798 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:34:43.799 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.777556+0000", 2021-10-08T19:34:43.799 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:34:43.799 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.799 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.800 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:34:43.800 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.777564+0000", 2021-10-08T19:34:43.800 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.7200000000000006e-06 2021-10-08T19:34:43.800 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.800 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.801 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:34:43.801 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.777580+0000", 2021-10-08T19:34:43.801 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5695000000000001e-05 2021-10-08T19:34:43.801 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.802 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.802 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:34:43.802 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.777587+0000", 2021-10-08T19:34:43.803 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8650000000000003e-06 2021-10-08T19:34:43.803 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.804 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.804 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:34:43.804 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.777672+0000", 2021-10-08T19:34:43.804 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5550999999999995e-05 2021-10-08T19:34:43.805 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.805 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.805 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:34:43.806 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.777831+0000", 2021-10-08T19:34:43.806 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015854700000000001 2021-10-08T19:34:43.806 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.807 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.807 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 1,3", 2021-10-08T19:34:43.807 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.777963+0000", 2021-10-08T19:34:43.808 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013243099999999999 2021-10-08T19:34:43.808 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.808 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.809 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:34:43.809 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.780814+0000", 2021-10-08T19:34:43.809 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028504089999999999 2021-10-08T19:34:43.809 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.809 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.810 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:34:43.810 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.785292+0000", 2021-10-08T19:34:43.810 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044785210000000001 2021-10-08T19:34:43.811 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:43.811 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:34:43.811 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:43.812 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.812 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.812 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.25465.0:215734 9.6 9:650b2101:::benchmark_data_smithi097_196985_object100043:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e345)", 2021-10-08T19:34:43.813 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:34:43.777786+0000", 2021-10-08T19:34:43.813 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.011269036, 2021-10-08T19:34:43.814 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011377490000000001, 2021-10-08T19:34:43.814 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:34:43.814 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "waiting for sub ops", 2021-10-08T19:34:43.815 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:34:43.815 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.25465", 2021-10-08T19:34:43.816 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:34:43.816 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 215734 2021-10-08T19:34:43.816 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.817 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:34:43.817 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.817 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:34:43.818 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.777786+0000", 2021-10-08T19:34:43.818 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:43.818 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.819 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.819 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:34:43.820 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.777786+0000", 2021-10-08T19:34:43.820 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:43.820 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.821 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.821 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:34:43.821 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.777785+0000", 2021-10-08T19:34:43.822 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:34:43.822 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.822 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.823 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:34:43.823 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.777791+0000", 2021-10-08T19:34:43.823 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3860000000000004e-06 2021-10-08T19:34:43.824 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.824 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.825 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:34:43.825 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.777801+0000", 2021-10-08T19:34:43.826 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.961e-06 2021-10-08T19:34:43.826 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.826 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.827 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:34:43.827 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.777808+0000", 2021-10-08T19:34:43.828 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2690000000000002e-06 2021-10-08T19:34:43.828 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.828 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.829 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:34:43.829 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.777858+0000", 2021-10-08T19:34:43.829 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0175e-05 2021-10-08T19:34:43.830 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.830 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.831 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:34:43.831 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.777973+0000", 2021-10-08T19:34:43.832 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011465599999999999 2021-10-08T19:34:43.832 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.833 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.833 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 1,2", 2021-10-08T19:34:43.833 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.778092+0000", 2021-10-08T19:34:43.834 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011869799999999999 2021-10-08T19:34:43.834 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.835 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.835 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:34:43.836 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.780912+0000", 2021-10-08T19:34:43.836 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002820735 2021-10-08T19:34:43.836 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:43.837 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:34:43.837 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:43.837 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.838 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.838 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.25465.0:215741 9.f 9:f29fa30e:::benchmark_data_smithi097_196985_object100050:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e345)", 2021-10-08T19:34:43.839 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:34:43.782388+0000", 2021-10-08T19:34:43.839 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.0066667460000000003, 2021-10-08T19:34:43.839 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0068279439999999999, 2021-10-08T19:34:43.840 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:34:43.840 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "waiting for sub ops", 2021-10-08T19:34:43.840 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:34:43.841 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.25465", 2021-10-08T19:34:43.841 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:34:43.841 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 215741 2021-10-08T19:34:43.842 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.842 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:34:43.843 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.843 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:34:43.844 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.782388+0000", 2021-10-08T19:34:43.844 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:43.844 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.845 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.845 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:34:43.845 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.782388+0000", 2021-10-08T19:34:43.846 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:43.846 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.846 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.847 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:34:43.847 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.782386+0000", 2021-10-08T19:34:43.848 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:34:43.848 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.849 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.849 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:34:43.849 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.782393+0000", 2021-10-08T19:34:43.850 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.99e-06 2021-10-08T19:34:43.850 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.851 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.851 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:34:43.852 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.782407+0000", 2021-10-08T19:34:43.852 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3951000000000001e-05 2021-10-08T19:34:43.852 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.853 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.853 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:34:43.854 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.782414+0000", 2021-10-08T19:34:43.855 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4370000000000004e-06 2021-10-08T19:34:43.855 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.855 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.855 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:34:43.855 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.782476+0000", 2021-10-08T19:34:43.856 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2800999999999997e-05 2021-10-08T19:34:43.856 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.857 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.857 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:34:43.857 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.782627+0000", 2021-10-08T19:34:43.857 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015081200000000001 2021-10-08T19:34:43.858 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.858 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.858 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 1,3", 2021-10-08T19:34:43.859 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.782765+0000", 2021-10-08T19:34:43.859 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013825400000000001 2021-10-08T19:34:43.859 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.859 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.860 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:34:43.860 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.785420+0000", 2021-10-08T19:34:43.860 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0026550499999999999 2021-10-08T19:34:43.860 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:43.861 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:34:43.861 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:43.861 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.861 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.861 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.25465.0:215745 9.7 9:edcfe2a1:::benchmark_data_smithi097_196985_object100054:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e345)", 2021-10-08T19:34:43.862 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:34:43.785559+0000", 2021-10-08T19:34:43.862 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.0034958340000000002, 2021-10-08T19:34:43.862 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0037120909999999998, 2021-10-08T19:34:43.862 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:34:43.862 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "waiting for sub ops", 2021-10-08T19:34:43.863 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:34:43.863 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.25465", 2021-10-08T19:34:43.863 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:34:43.863 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 215745 2021-10-08T19:34:43.864 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.864 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:34:43.864 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.864 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:34:43.864 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.785559+0000", 2021-10-08T19:34:43.865 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:43.865 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.865 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.865 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:34:43.865 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.785559+0000", 2021-10-08T19:34:43.866 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:43.866 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.866 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.866 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:34:43.866 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.785557+0000", 2021-10-08T19:34:43.867 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:34:43.867 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.867 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.867 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:34:43.868 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.785565+0000", 2021-10-08T19:34:43.868 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4810000000000006e-06 2021-10-08T19:34:43.868 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.868 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.868 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:34:43.869 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.785581+0000", 2021-10-08T19:34:43.869 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5597999999999999e-05 2021-10-08T19:34:43.869 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.869 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.869 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:34:43.870 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.785588+0000", 2021-10-08T19:34:43.870 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0360000000000001e-06 2021-10-08T19:34:43.870 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.870 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.870 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:34:43.871 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.785651+0000", 2021-10-08T19:34:43.871 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3348000000000004e-05 2021-10-08T19:34:43.871 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.871 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.872 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:34:43.872 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.785799+0000", 2021-10-08T19:34:43.872 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014841299999999999 2021-10-08T19:34:43.872 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.872 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.873 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 3,7", 2021-10-08T19:34:43.873 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.785924+0000", 2021-10-08T19:34:43.873 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012467700000000001 2021-10-08T19:34:43.873 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:43.873 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:34:43.874 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:43.874 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.874 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.874 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.25465.0:215746 9.f 9:fb44d325:::benchmark_data_smithi097_196985_object100055:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e345)", 2021-10-08T19:34:43.875 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:34:43.785602+0000", 2021-10-08T19:34:43.875 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.0034532669999999999, 2021-10-08T19:34:43.875 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003716919, 2021-10-08T19:34:43.875 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:34:43.876 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "waiting for sub ops", 2021-10-08T19:34:43.876 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:34:43.876 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.25465", 2021-10-08T19:34:43.876 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:34:43.877 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 215746 2021-10-08T19:34:43.877 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.877 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:34:43.877 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.877 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:34:43.878 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.785602+0000", 2021-10-08T19:34:43.878 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:43.878 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.878 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.878 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:34:43.879 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.785602+0000", 2021-10-08T19:34:43.879 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:43.879 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.879 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.880 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:34:43.880 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.785601+0000", 2021-10-08T19:34:43.880 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:34:43.880 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.880 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.881 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:34:43.881 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.785605+0000", 2021-10-08T19:34:43.881 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9620000000000004e-06 2021-10-08T19:34:43.881 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.881 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.882 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:34:43.882 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.785611+0000", 2021-10-08T19:34:43.882 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3210000000000001e-06 2021-10-08T19:34:43.882 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.882 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.883 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:34:43.883 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.785615+0000", 2021-10-08T19:34:43.883 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2560000000000004e-06 2021-10-08T19:34:43.884 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.884 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.884 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:34:43.884 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.787726+0000", 2021-10-08T19:34:43.884 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021104869999999999 2021-10-08T19:34:43.885 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.885 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.885 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:34:43.885 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.787833+0000", 2021-10-08T19:34:43.885 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000106953 2021-10-08T19:34:43.886 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.886 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.886 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 1,3", 2021-10-08T19:34:43.886 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.787942+0000", 2021-10-08T19:34:43.887 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000109671 2021-10-08T19:34:43.887 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:43.887 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:34:43.887 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:43.887 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.888 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.888 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop_reply(client.25465.0:215733 9.f e345/290)", 2021-10-08T19:34:43.888 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:34:43.787928+0000", 2021-10-08T19:34:43.888 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.0011266760000000001, 2021-10-08T19:34:43.889 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001461986, 2021-10-08T19:34:43.889 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:34:43.889 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "queued for pg", 2021-10-08T19:34:43.889 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:34:43.889 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.890 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:34:43.890 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.787928+0000", 2021-10-08T19:34:43.890 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:43.890 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.890 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.891 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:34:43.891 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.787928+0000", 2021-10-08T19:34:43.891 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:43.891 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.891 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.892 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:34:43.892 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.787927+0000", 2021-10-08T19:34:43.892 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:34:43.892 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.892 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.893 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:34:43.893 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.787934+0000", 2021-10-08T19:34:43.893 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1219999999999997e-06 2021-10-08T19:34:43.893 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.893 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.894 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:34:43.894 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.787944+0000", 2021-10-08T19:34:43.894 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9080000000000007e-06 2021-10-08T19:34:43.894 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.895 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.895 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:34:43.895 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.787950+0000", 2021-10-08T19:34:43.895 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1430000000000003e-06 2021-10-08T19:34:43.895 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:43.896 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:34:43.896 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:43.896 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.896 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.896 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:215742 9.8 e345/290 9:1ad12f38:::benchmark_data_smithi097_196985_object100051:head v 345'13689, mlcod=345'13687)", 2021-10-08T19:34:43.897 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:34:43.788490+0000", 2021-10-08T19:34:43.897 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.00056508399999999999, 2021-10-08T19:34:43.897 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00095124800000000002, 2021-10-08T19:34:43.897 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:34:43.897 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2021-10-08T19:34:43.898 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:34:43.898 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.898 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:34:43.898 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.788490+0000", 2021-10-08T19:34:43.899 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:43.899 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.899 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.899 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:34:43.899 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.788490+0000", 2021-10-08T19:34:43.900 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:43.900 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.900 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.900 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:34:43.900 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.788489+0000", 2021-10-08T19:34:43.901 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:34:43.901 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.901 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.901 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:34:43.901 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.788496+0000", 2021-10-08T19:34:43.902 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4699999999999996e-06 2021-10-08T19:34:43.902 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.902 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.902 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:34:43.902 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.788505+0000", 2021-10-08T19:34:43.903 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.8119999999999997e-06 2021-10-08T19:34:43.903 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.903 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.903 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:34:43.904 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.788510+0000", 2021-10-08T19:34:43.904 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2050000000000001e-06 2021-10-08T19:34:43.904 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.904 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.904 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:34:43.905 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.788597+0000", 2021-10-08T19:34:43.905 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6718000000000006e-05 2021-10-08T19:34:43.905 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.905 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.905 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:34:43.906 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.788616+0000", 2021-10-08T19:34:43.906 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8989999999999999e-05 2021-10-08T19:34:43.906 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:43.906 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:34:43.906 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:43.907 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.907 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.907 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop_reply(client.25465.0:215741 9.f e345/290)", 2021-10-08T19:34:43.907 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:34:43.788522+0000", 2021-10-08T19:34:43.907 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.00053289099999999996, 2021-10-08T19:34:43.908 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00098636899999999996, 2021-10-08T19:34:43.908 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:34:43.908 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "queued for pg", 2021-10-08T19:34:43.908 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:34:43.908 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.909 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:34:43.909 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.788522+0000", 2021-10-08T19:34:43.909 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:43.909 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.910 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.910 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:34:43.910 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.788522+0000", 2021-10-08T19:34:43.910 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:43.910 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.911 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.911 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:34:43.911 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.788522+0000", 2021-10-08T19:34:43.911 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999995 2021-10-08T19:34:43.912 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.912 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.912 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:34:43.912 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.788525+0000", 2021-10-08T19:34:43.912 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.1149999999999998e-06 2021-10-08T19:34:43.913 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.913 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.913 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:34:43.913 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.788529+0000", 2021-10-08T19:34:43.913 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.6609999999999999e-06 2021-10-08T19:34:43.914 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:43.914 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:43.914 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:34:43.914 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:43.788533+0000", 2021-10-08T19:34:43.914 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6169999999999998e-06 2021-10-08T19:34:43.915 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:43.915 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:34:43.915 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:43.915 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:43.916 INFO:teuthology.orchestra.run.smithi117.stdout: ], 2021-10-08T19:34:43.916 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 8 2021-10-08T19:34:43.916 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:34:43.917 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:43 smithi097 ceph-mon[32687]: pgmap v664: 178 pgs: 178 active+clean; 1.3 GiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.09k op/s 2021-10-08T19:34:43.917 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:43 smithi097 ceph-mon[32687]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:34:43.917 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:43 smithi097 ceph-mon[32687]: from='client.35735 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:34:43.918 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:43 smithi097 ceph-mon[32687]: osdmap e345: 8 total, 8 up, 8 in 2021-10-08T19:34:43.918 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:43 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:34:43.918 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:43 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:34:43.918 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:43.919 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:34:43.919 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:34:44.021 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:34:44.066 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:44.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:34:43 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:34:43] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:34:44.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:43 smithi117 ceph-mon[34585]: pgmap v664: 178 pgs: 178 active+clean; 1.3 GiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.09k op/s 2021-10-08T19:34:44.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:43 smithi117 ceph-mon[34585]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:34:44.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:43 smithi117 ceph-mon[34585]: from='client.35735 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:34:44.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:43 smithi117 ceph-mon[34585]: osdmap e345: 8 total, 8 up, 8 in 2021-10-08T19:34:44.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:43 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:34:44.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:43 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:34:44.227 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:43 smithi097 ceph-mon[41966]: pgmap v664: 178 pgs: 178 active+clean; 1.3 GiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.09k op/s 2021-10-08T19:34:44.228 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:43 smithi097 ceph-mon[41966]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:34:44.228 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:43 smithi097 ceph-mon[41966]: from='client.35735 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:34:44.228 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:43 smithi097 ceph-mon[41966]: osdmap e345: 8 total, 8 up, 8 in 2021-10-08T19:34:44.228 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:43 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:34:44.229 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:43 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:34:44.623 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:34:44.628 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:44.629 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:34:44.731 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:34:44.783 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:44.949 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2021-10-08T19:34:44.969 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:34:44.971 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:44.972 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:34:45.075 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:34:45.118 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:45.147 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:44 smithi097 ceph-mon[32687]: 1.6 scrub ok 2021-10-08T19:34:45.148 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:44 smithi097 ceph-mon[32687]: osdmap e346: 8 total, 8 up, 8 in 2021-10-08T19:34:45.149 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:44 smithi097 ceph-mon[32687]: 5.13 scrub ok 2021-10-08T19:34:45.149 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:44 smithi097 ceph-mon[41966]: 1.6 scrub ok 2021-10-08T19:34:45.150 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:44 smithi097 ceph-mon[41966]: osdmap e346: 8 total, 8 up, 8 in 2021-10-08T19:34:45.150 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:44 smithi097 ceph-mon[41966]: 5.13 scrub ok 2021-10-08T19:34:45.208 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:34:45.213 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:45.214 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:34:45.214 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:44 smithi117 ceph-mon[34585]: 1.6 scrub ok 2021-10-08T19:34:45.214 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:44 smithi117 ceph-mon[34585]: osdmap e346: 8 total, 8 up, 8 in 2021-10-08T19:34:45.215 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:44 smithi117 ceph-mon[34585]: 5.13 scrub ok 2021-10-08T19:34:45.315 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:34:45.362 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:34:45.388 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:45.502 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:34:45.541 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:34:45.576 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:34:45.589 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:34:45.597 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:45.598 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:34:45.623 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:34:45.659 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:34:45.699 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:34:45.702 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:34:45.740 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:34:45.755 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:45.770 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:34:45.782 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'false' 2021-10-08T19:34:45.783 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'false' 2021-10-08T19:34:45.783 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'false' 2021-10-08T19:34:45.784 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'false' 2021-10-08T19:34:45.784 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'false' 2021-10-08T19:34:45.784 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'false' 2021-10-08T19:34:45.784 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'false' 2021-10-08T19:34:45.785 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'false' 2021-10-08T19:34:45.932 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:45 smithi097 ceph-mon[32687]: 5.d scrub ok 2021-10-08T19:34:45.933 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:45 smithi097 ceph-mon[32687]: 3.10 scrub ok 2021-10-08T19:34:45.933 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:45 smithi097 ceph-mon[32687]: pgmap v667: 178 pgs: 178 active+clean; 969 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 1.41k op/s 2021-10-08T19:34:45.933 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:45 smithi097 ceph-mon[32687]: 1.8 scrub ok 2021-10-08T19:34:45.933 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:45 smithi097 ceph-mon[32687]: 3.e scrub ok 2021-10-08T19:34:45.933 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:45 smithi097 ceph-mon[32687]: 3.6 scrub ok 2021-10-08T19:34:45.934 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:45 smithi097 ceph-mon[32687]: 6.6 scrub ok 2021-10-08T19:34:45.934 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:45 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3225802097' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:34:45.934 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:45 smithi097 ceph-mon[32687]: 5.1d scrub ok 2021-10-08T19:34:46.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:45 smithi097 ceph-mon[41966]: 5.d scrub ok 2021-10-08T19:34:46.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:45 smithi097 ceph-mon[41966]: 3.10 scrub ok 2021-10-08T19:34:46.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:45 smithi097 ceph-mon[41966]: pgmap v667: 178 pgs: 178 active+clean; 969 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 1.41k op/s 2021-10-08T19:34:46.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:45 smithi097 ceph-mon[41966]: 1.8 scrub ok 2021-10-08T19:34:46.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:45 smithi097 ceph-mon[41966]: 3.e scrub ok 2021-10-08T19:34:46.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:45 smithi097 ceph-mon[41966]: 3.6 scrub ok 2021-10-08T19:34:46.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:45 smithi097 ceph-mon[41966]: 6.6 scrub ok 2021-10-08T19:34:46.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:45 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3225802097' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:34:46.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:45 smithi097 ceph-mon[41966]: 5.1d scrub ok 2021-10-08T19:34:46.402 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:34:46.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:45 smithi117 ceph-mon[34585]: 5.d scrub ok 2021-10-08T19:34:46.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:45 smithi117 ceph-mon[34585]: 3.10 scrub ok 2021-10-08T19:34:46.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:45 smithi117 ceph-mon[34585]: pgmap v667: 178 pgs: 178 active+clean; 969 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 1.41k op/s 2021-10-08T19:34:46.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:45 smithi117 ceph-mon[34585]: 1.8 scrub ok 2021-10-08T19:34:46.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:45 smithi117 ceph-mon[34585]: 3.e scrub ok 2021-10-08T19:34:46.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:45 smithi117 ceph-mon[34585]: 3.6 scrub ok 2021-10-08T19:34:46.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:45 smithi117 ceph-mon[34585]: 6.6 scrub ok 2021-10-08T19:34:46.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:45 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3225802097' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:34:46.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:45 smithi117 ceph-mon[34585]: 5.1d scrub ok 2021-10-08T19:34:46.411 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:46.411 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:34:46.513 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:34:46.556 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:46.665 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset nodeep-scrub 2021-10-08T19:34:46.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:46 smithi097 ceph-mon[32687]: 3.c scrub ok 2021-10-08T19:34:46.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:46 smithi097 ceph-mon[32687]: 4.18 scrub ok 2021-10-08T19:34:46.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:46 smithi097 ceph-mon[41966]: 3.c scrub ok 2021-10-08T19:34:46.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:46 smithi097 ceph-mon[41966]: 4.18 scrub ok 2021-10-08T19:34:47.011 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:34:47.121 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:47.122 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:34:47.155 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:34:46 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:34:47.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:46 smithi117 ceph-mon[34585]: 3.c scrub ok 2021-10-08T19:34:47.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:46 smithi117 ceph-mon[34585]: 4.18 scrub ok 2021-10-08T19:34:47.223 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:34:47.274 INFO:journalctl@ceph.osd.0.smithi097.stdout:Oct 08 19:34:47 smithi097 conmon[47373]: 2021-10-08T19:34:47.007+0000 7f8334790700 -1 osd.0 pg_epoch: 346 pg[2.1f( empty local-lis/les=60/61 n=0 ec=60/60 lis/c=60/60 les/c/f=61/61/0 sis=60) [0,7,4] r=0 lpr=60 crt=0'0 mlcod 0'0 active+clean] scrubber pg(2.1f) handle_scrub_reserve_grant: received unsolicited reservation grant from osd 4 (0x55cbf90686e0) 2021-10-08T19:34:47.276 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:47.571 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:34:47.615 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:34:47.616 INFO:teuthology.orchestra.run.smithi097.stdout: "success": "filestore_inject_stall = '3' (not observed, change may require restart) " 2021-10-08T19:34:47.616 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:34:47.746 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:34:47.750 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:47.750 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:34:47.809 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2021-10-08T19:34:47.809 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:34:47.852 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:34:47.902 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:47.947 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:47 smithi097 ceph-mon[32687]: 2.e scrub ok 2021-10-08T19:34:47.948 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:47 smithi097 ceph-mon[32687]: pgmap v668: 178 pgs: 178 active+clean; 969 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 740 B/s rd, 0 B/s wr, 811 op/s 2021-10-08T19:34:47.948 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:47 smithi097 ceph-mon[41966]: 2.e scrub ok 2021-10-08T19:34:47.949 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:47 smithi097 ceph-mon[41966]: pgmap v668: 178 pgs: 178 active+clean; 969 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 740 B/s rd, 0 B/s wr, 811 op/s 2021-10-08T19:34:47.949 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:47 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:34:47.949 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:47 smithi097 ceph-mon[41966]: 5.19 scrub ok 2021-10-08T19:34:48.136 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:34:48.138 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:47 smithi117 ceph-mon[34585]: 2.e scrub ok 2021-10-08T19:34:48.139 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:47 smithi117 ceph-mon[34585]: pgmap v668: 178 pgs: 178 active+clean; 969 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 740 B/s rd, 0 B/s wr, 811 op/s 2021-10-08T19:34:48.139 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:47 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:34:48.139 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:47 smithi117 ceph-mon[34585]: 5.19 scrub ok 2021-10-08T19:34:48.140 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:48.141 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:34:48.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:47 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:34:48.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:47 smithi097 ceph-mon[32687]: 5.19 scrub ok 2021-10-08T19:34:48.242 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:34:48.299 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:48.882 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:34:48.886 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:48.887 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:34:48.892 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2021-10-08T19:34:48.988 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:34:49.053 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:49.124 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2021-10-08T19:34:49.146 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:34:49.153 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:48 smithi097 ceph-mon[32687]: 9.3 scrub ok 2021-10-08T19:34:49.154 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:48 smithi097 ceph-mon[32687]: 2.7 scrub ok 2021-10-08T19:34:49.154 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:48 smithi097 ceph-mon[32687]: 9.d scrub ok 2021-10-08T19:34:49.154 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:48 smithi097 ceph-mon[32687]: 4.1 scrub ok 2021-10-08T19:34:49.155 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:49.156 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:34:49.156 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:48 smithi097 ceph-mon[41966]: 9.3 scrub ok 2021-10-08T19:34:49.156 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:48 smithi097 ceph-mon[41966]: 2.7 scrub ok 2021-10-08T19:34:49.157 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:48 smithi097 ceph-mon[41966]: 9.d scrub ok 2021-10-08T19:34:49.157 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:48 smithi097 ceph-mon[41966]: 4.1 scrub ok 2021-10-08T19:34:49.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:48 smithi117 ceph-mon[34585]: 9.3 scrub ok 2021-10-08T19:34:49.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:48 smithi117 ceph-mon[34585]: 2.7 scrub ok 2021-10-08T19:34:49.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:48 smithi117 ceph-mon[34585]: 9.d scrub ok 2021-10-08T19:34:49.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:48 smithi117 ceph-mon[34585]: 4.1 scrub ok 2021-10-08T19:34:49.257 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:34:49.294 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:49.326 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:34:49.363 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:34:49.371 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:49.372 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:34:49.473 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:34:49.514 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:49.703 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:34:49.708 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:49.709 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:34:49.810 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:34:49.863 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:49.952 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:34:49.956 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:49.957 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:34:50.058 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:34:50.102 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:50.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:49 smithi097 ceph-mon[41966]: pgmap v669: 178 pgs: 178 active+clean; 806 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 0 B/s wr, 1.02k op/s 2021-10-08T19:34:50.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:49 smithi097 ceph-mon[41966]: 5.1 scrub ok 2021-10-08T19:34:50.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:49 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:34:50.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:49 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:34:50.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:49 smithi097 ceph-mon[32687]: pgmap v669: 178 pgs: 178 active+clean; 806 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 0 B/s wr, 1.02k op/s 2021-10-08T19:34:50.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:49 smithi097 ceph-mon[32687]: 5.1 scrub ok 2021-10-08T19:34:50.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:49 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:34:50.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:49 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:34:50.266 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:34:50.272 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:50.273 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:34:50.303 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:34:50.374 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:34:50.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:49 smithi117 ceph-mon[34585]: pgmap v669: 178 pgs: 178 active+clean; 806 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 0 B/s wr, 1.02k op/s 2021-10-08T19:34:50.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:49 smithi117 ceph-mon[34585]: 5.1 scrub ok 2021-10-08T19:34:50.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:49 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:34:50.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:49 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:34:50.409 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:50.487 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:34:50.489 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:50.490 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:34:50.591 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:34:50.654 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:50.903 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:34:50.911 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:50.912 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:34:51.013 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:34:51.042 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:51.198 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:51 smithi097 ceph-mon[41966]: 5.1f scrub ok 2021-10-08T19:34:51.199 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:51 smithi097 ceph-mon[41966]: 2.0 scrub ok 2021-10-08T19:34:51.199 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:51 smithi097 ceph-mon[41966]: osdmap e347: 8 total, 8 up, 8 in 2021-10-08T19:34:51.199 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:51 smithi097 ceph-mon[41966]: 6.18 scrub ok 2021-10-08T19:34:51.199 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:51 smithi097 ceph-mon[41966]: 4.19 scrub ok 2021-10-08T19:34:51.199 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:51 smithi097 ceph-mon[41966]: 2.6 scrub ok 2021-10-08T19:34:51.200 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:50 smithi097 ceph-mon[32687]: 5.1f scrub ok 2021-10-08T19:34:51.200 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:50 smithi097 ceph-mon[32687]: 2.0 scrub ok 2021-10-08T19:34:51.200 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:50 smithi097 ceph-mon[32687]: osdmap e347: 8 total, 8 up, 8 in 2021-10-08T19:34:51.201 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:50 smithi097 ceph-mon[32687]: 6.18 scrub ok 2021-10-08T19:34:51.201 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:50 smithi097 ceph-mon[32687]: 4.19 scrub ok 2021-10-08T19:34:51.201 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:50 smithi097 ceph-mon[32687]: 2.6 scrub ok 2021-10-08T19:34:51.226 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:34:51.232 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:51.233 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:34:51.334 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:34:51.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:50 smithi117 ceph-mon[34585]: 5.1f scrub ok 2021-10-08T19:34:51.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:50 smithi117 ceph-mon[34585]: 2.0 scrub ok 2021-10-08T19:34:51.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:50 smithi117 ceph-mon[34585]: osdmap e347: 8 total, 8 up, 8 in 2021-10-08T19:34:51.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:50 smithi117 ceph-mon[34585]: 6.18 scrub ok 2021-10-08T19:34:51.374 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:50 smithi117 ceph-mon[34585]: 4.19 scrub ok 2021-10-08T19:34:51.374 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:50 smithi117 ceph-mon[34585]: 2.6 scrub ok 2021-10-08T19:34:51.379 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:51.556 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:34:51.560 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:51.561 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:34:51.662 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:34:51.706 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:51.788 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:34:51.790 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:51.791 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:34:51.874 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2021-10-08T19:34:51.875 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:34:51.892 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:34:51.942 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:52.014 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is unset 2021-10-08T19:34:52.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:52 smithi097 ceph-mon[32687]: pgmap v671: 178 pgs: 178 active+clean; 603 MiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 0 B/s wr, 1.45k op/s 2021-10-08T19:34:52.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:52 smithi097 ceph-mon[32687]: 6.d scrub ok 2021-10-08T19:34:52.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:52 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1704659935' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:34:52.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:52 smithi097 ceph-mon[32687]: from='client.25714 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:34:52.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:52 smithi097 ceph-mon[41966]: pgmap v671: 178 pgs: 178 active+clean; 603 MiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 0 B/s wr, 1.45k op/s 2021-10-08T19:34:52.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:52 smithi097 ceph-mon[41966]: 6.d scrub ok 2021-10-08T19:34:52.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:52 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1704659935' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:34:52.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:52 smithi097 ceph-mon[41966]: from='client.25714 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:34:52.317 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:34:52 smithi117 conmon[69189]: level=error ts=2021-10-08T19:34:52.314Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=1 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:34:52.317 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:52 smithi117 ceph-mon[34585]: pgmap v671: 178 pgs: 178 active+clean; 603 MiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 0 B/s wr, 1.45k op/s 2021-10-08T19:34:52.317 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:52 smithi117 ceph-mon[34585]: 6.d scrub ok 2021-10-08T19:34:52.318 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:52 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1704659935' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:34:52.318 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:52 smithi117 ceph-mon[34585]: from='client.25714 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:34:52.351 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:34:52.354 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:52.355 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:34:52.456 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:34:52.509 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:52.971 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:34:52 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:34:52] "GET /metrics HTTP/1.1" 200 155821 "" "Prometheus/2.18.1" 2021-10-08T19:34:52.974 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2021-10-08T19:34:53.005 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:34:53.015 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:53.016 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:34:53.118 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:34:53.164 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:53.260 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:34:53.271 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:53 smithi117 ceph-mon[34585]: 4.1c scrub ok 2021-10-08T19:34:53.271 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:53 smithi117 ceph-mon[34585]: 5.2 scrub ok 2021-10-08T19:34:53.271 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:53 smithi117 ceph-mon[34585]: 6.1c scrub ok 2021-10-08T19:34:53.272 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:53 smithi117 ceph-mon[34585]: 3.12 scrub ok 2021-10-08T19:34:53.272 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:53 smithi117 ceph-mon[34585]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:34:53.272 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:53 smithi117 ceph-mon[34585]: Cluster is now healthy 2021-10-08T19:34:53.272 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:53 smithi117 ceph-mon[34585]: from='client.25714 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:34:53.272 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:53 smithi117 ceph-mon[34585]: osdmap e348: 8 total, 8 up, 8 in 2021-10-08T19:34:53.273 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:53 smithi117 ceph-mon[34585]: 2.14 scrub ok 2021-10-08T19:34:53.273 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:53 smithi117 ceph-mon[34585]: 2.d scrub ok 2021-10-08T19:34:53.274 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:53.274 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:34:53.351 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:53 smithi097 ceph-mon[32687]: 4.1c scrub ok 2021-10-08T19:34:53.351 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:53 smithi097 ceph-mon[32687]: 5.2 scrub ok 2021-10-08T19:34:53.352 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:53 smithi097 ceph-mon[32687]: 6.1c scrub ok 2021-10-08T19:34:53.352 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:53 smithi097 ceph-mon[32687]: 3.12 scrub ok 2021-10-08T19:34:53.352 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:53 smithi097 ceph-mon[32687]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:34:53.353 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:53 smithi097 ceph-mon[32687]: Cluster is now healthy 2021-10-08T19:34:53.353 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:53 smithi097 ceph-mon[32687]: from='client.25714 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:34:53.353 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:53 smithi097 ceph-mon[32687]: osdmap e348: 8 total, 8 up, 8 in 2021-10-08T19:34:53.353 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:53 smithi097 ceph-mon[32687]: 2.14 scrub ok 2021-10-08T19:34:53.354 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:53 smithi097 ceph-mon[32687]: 2.d scrub ok 2021-10-08T19:34:53.354 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:53 smithi097 ceph-mon[41966]: 4.1c scrub ok 2021-10-08T19:34:53.354 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:53 smithi097 ceph-mon[41966]: 5.2 scrub ok 2021-10-08T19:34:53.355 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:53 smithi097 ceph-mon[41966]: 6.1c scrub ok 2021-10-08T19:34:53.355 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:53 smithi097 ceph-mon[41966]: 3.12 scrub ok 2021-10-08T19:34:53.355 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:53 smithi097 ceph-mon[41966]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:34:53.355 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:53 smithi097 ceph-mon[41966]: Cluster is now healthy 2021-10-08T19:34:53.356 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:53 smithi097 ceph-mon[41966]: from='client.25714 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:34:53.356 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:53 smithi097 ceph-mon[41966]: osdmap e348: 8 total, 8 up, 8 in 2021-10-08T19:34:53.356 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:53 smithi097 ceph-mon[41966]: 2.14 scrub ok 2021-10-08T19:34:53.356 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:53 smithi097 ceph-mon[41966]: 2.d scrub ok 2021-10-08T19:34:53.375 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:34:53.402 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:34:53.437 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:53.711 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:34:53.737 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:34:53.755 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:53.756 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:34:53.757 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:34:53.789 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:34:53.827 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:34:53.858 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:34:53.863 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:34:53.881 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 4, 5, 7, 6, 1, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2021-10-08T19:34:53.881 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2021-10-08T19:34:53.883 INFO:tasks.thrashosds.thrasher:fixing pg num pool default.rgw.meta 2021-10-08T19:34:53.883 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph pg dump --format=json 2021-10-08T19:34:53.901 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:53.908 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:34:53.956 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:34:53.975 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:34:53.980 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:34:53 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:34:53] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:34:53.980 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:53.983 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:34:53.997 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:34:54.016 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true' 2021-10-08T19:34:54.016 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true' 2021-10-08T19:34:54.016 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true' 2021-10-08T19:34:54.016 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true' 2021-10-08T19:34:54.017 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true' 2021-10-08T19:34:54.017 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true' 2021-10-08T19:34:54.017 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'true' 2021-10-08T19:34:54.018 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'true' 2021-10-08T19:34:54.023 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:54 smithi097 ceph-mon[32687]: pgmap v673: 178 pgs: 178 active+clean; 603 MiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 0 B/s wr, 729 op/s 2021-10-08T19:34:54.023 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:54 smithi097 ceph-mon[32687]: 9.f scrub ok 2021-10-08T19:34:54.024 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:54 smithi097 ceph-mon[32687]: 5.8 scrub ok 2021-10-08T19:34:54.024 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:54 smithi097 ceph-mon[32687]: 6.9 scrub ok 2021-10-08T19:34:54.024 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:54 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1300819860' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:34:54.025 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:54 smithi097 ceph-mon[32687]: 4.12 scrub ok 2021-10-08T19:34:54.084 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:34:54.119 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:54.252 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:34:54.256 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:54 smithi117 ceph-mon[34585]: pgmap v673: 178 pgs: 178 active+clean; 603 MiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 0 B/s wr, 729 op/s 2021-10-08T19:34:54.256 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:54 smithi117 ceph-mon[34585]: 9.f scrub ok 2021-10-08T19:34:54.256 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:54 smithi117 ceph-mon[34585]: 5.8 scrub ok 2021-10-08T19:34:54.257 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:54 smithi117 ceph-mon[34585]: 6.9 scrub ok 2021-10-08T19:34:54.257 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:54 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1300819860' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:34:54.257 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:54 smithi117 ceph-mon[34585]: 4.12 scrub ok 2021-10-08T19:34:54.258 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:54.259 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:34:54.361 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:34:54.403 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:54.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:54 smithi097 ceph-mon[41966]: pgmap v673: 178 pgs: 178 active+clean; 603 MiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 0 B/s wr, 729 op/s 2021-10-08T19:34:54.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:54 smithi097 ceph-mon[41966]: 9.f scrub ok 2021-10-08T19:34:54.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:54 smithi097 ceph-mon[41966]: 5.8 scrub ok 2021-10-08T19:34:54.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:54 smithi097 ceph-mon[41966]: 6.9 scrub ok 2021-10-08T19:34:54.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:54 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1300819860' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:34:54.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:54 smithi097 ceph-mon[41966]: 4.12 scrub ok 2021-10-08T19:34:54.540 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:34:54.546 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:54.546 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:34:54.647 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:34:54.682 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:54.774 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:34:54.778 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:54.778 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:34:54.879 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:34:54.920 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:54.989 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:34:54.991 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:54.992 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:34:55.094 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:34:55.110 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set noscrub 2021-10-08T19:34:55.139 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:55.267 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:34:55.271 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:34:55.280 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:55.281 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:34:55.382 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:34:55.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:55 smithi117 ceph-mon[34585]: 4.11 deep-scrub ok 2021-10-08T19:34:55.440 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:55 smithi097 ceph-mon[32687]: 4.11 deep-scrub ok 2021-10-08T19:34:55.440 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:55 smithi097 ceph-mon[41966]: 4.11 deep-scrub ok 2021-10-08T19:34:55.451 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:55.587 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:34:55.590 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:55.591 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:34:55.692 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:34:55.768 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:55.847 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:34:55.858 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:55.859 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:34:55.960 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:34:55.993 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:34:55.993 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2021-10-08T19:34:55.993 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:55.994 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:229608 9.0 e348/290 9:0afa9e6e:::benchmark_data_smithi097_196985_object113917:head v 348'14488, mlcod=348'14486)", 2021-10-08T19:34:55.994 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:34:55.984514+0000", 2021-10-08T19:34:55.994 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.0043451339999999996, 2021-10-08T19:34:55.994 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0043748470000000003, 2021-10-08T19:34:55.995 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:34:55.995 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2021-10-08T19:34:55.996 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:34:55.996 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:55.996 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:34:55.997 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:55.984514+0000", 2021-10-08T19:34:55.997 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:55.997 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:55.997 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:55.998 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:34:55.998 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:55.984514+0000", 2021-10-08T19:34:55.998 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:55.998 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:55.999 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:55.999 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:34:55.999 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:55.984512+0000", 2021-10-08T19:34:56.000 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:34:56.000 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:56.000 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:56.000 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:34:56.001 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:55.984527+0000", 2021-10-08T19:34:56.002 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4627000000000001e-05 2021-10-08T19:34:56.002 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:56.002 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:56.002 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:34:56.003 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:55.984539+0000", 2021-10-08T19:34:56.003 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1527e-05 2021-10-08T19:34:56.003 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:56.003 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:56.003 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:34:56.004 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:55.984545+0000", 2021-10-08T19:34:56.004 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1460000000000001e-06 2021-10-08T19:34:56.004 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:56.004 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:56.005 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:34:56.005 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:55.984585+0000", 2021-10-08T19:34:56.005 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0355999999999998e-05 2021-10-08T19:34:56.005 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:56.005 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:56.006 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:34:56.006 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:55.984604+0000", 2021-10-08T19:34:56.006 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8861000000000001e-05 2021-10-08T19:34:56.006 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:56.007 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:34:56.007 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:56.007 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:56.007 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:56.007 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:229623 9.0 e348/290 9:00d8793f:::benchmark_data_smithi097_196985_object113932:head v 348'14489, mlcod=348'14486)", 2021-10-08T19:34:56.008 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:34:55.987049+0000", 2021-10-08T19:34:56.008 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.0018100099999999999, 2021-10-08T19:34:56.008 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001907417, 2021-10-08T19:34:56.009 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:34:56.009 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2021-10-08T19:34:56.009 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:34:56.009 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:56.010 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:34:56.010 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:55.987049+0000", 2021-10-08T19:34:56.010 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:56.010 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:56.011 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:56.011 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:34:56.011 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:55.987049+0000", 2021-10-08T19:34:56.011 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:34:56.012 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:56.012 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:56.012 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:34:56.012 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:55.987048+0000", 2021-10-08T19:34:56.013 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:34:56.013 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:56.013 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:56.013 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:34:56.013 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:55.987061+0000", 2021-10-08T19:34:56.014 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3799e-05 2021-10-08T19:34:56.014 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:56.014 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:56.014 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:34:56.015 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:55.987073+0000", 2021-10-08T19:34:56.015 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1252e-05 2021-10-08T19:34:56.015 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:56.015 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:56.015 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:34:56.016 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:55.987079+0000", 2021-10-08T19:34:56.016 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5769999999999999e-06 2021-10-08T19:34:56.016 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:56.016 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:56.017 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:34:56.017 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:55.987131+0000", 2021-10-08T19:34:56.017 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1674e-05 2021-10-08T19:34:56.017 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:34:56.017 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:34:56.018 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:34:56.018 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:55.987151+0000", 2021-10-08T19:34:56.018 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0550000000000001e-05 2021-10-08T19:34:56.018 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:56.018 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:34:56.019 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:56.019 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:34:56.019 INFO:teuthology.orchestra.run.smithi117.stdout: ], 2021-10-08T19:34:56.020 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 2 2021-10-08T19:34:56.020 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:34:56.021 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:56.208 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:34:56.247 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:34:56.251 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:56.252 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:34:56.353 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:34:56.399 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:56 smithi097 ceph-mon[32687]: pgmap v674: 178 pgs: 178 active+clean; 255 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 0 B/s wr, 1.42k op/s 2021-10-08T19:34:56.400 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:56 smithi097 ceph-mon[32687]: 5.4 scrub ok 2021-10-08T19:34:56.400 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:56 smithi097 ceph-mon[32687]: 5.12 scrub ok 2021-10-08T19:34:56.401 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:34:56 smithi097 conmon[33110]: 172.21.15.97 - - [08/Oct/2021:19:34:56] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:34:56.401 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:56 smithi097 ceph-mon[41966]: pgmap v674: 178 pgs: 178 active+clean; 255 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 0 B/s wr, 1.42k op/s 2021-10-08T19:34:56.401 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:56 smithi097 ceph-mon[41966]: 5.4 scrub ok 2021-10-08T19:34:56.402 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:56 smithi097 ceph-mon[41966]: 5.12 scrub ok 2021-10-08T19:34:56.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:56 smithi117 ceph-mon[34585]: pgmap v674: 178 pgs: 178 active+clean; 255 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 0 B/s wr, 1.42k op/s 2021-10-08T19:34:56.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:56 smithi117 ceph-mon[34585]: 5.4 scrub ok 2021-10-08T19:34:56.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:56 smithi117 ceph-mon[34585]: 5.12 scrub ok 2021-10-08T19:34:56.412 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:56.971 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2021-10-08T19:34:57.176 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:34:57.181 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:57.183 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:34:57.214 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:34:56 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:34:57.270 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2021-10-08T19:34:57.283 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:34:57.352 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:57.384 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:34:57.461 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Removed 115688 objects 2021-10-08T19:34:57.462 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Clean up completed and total clean up time :103.586 2021-10-08T19:34:57.462 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:57 smithi097 ceph-mon[32687]: 6.e scrub ok 2021-10-08T19:34:57.462 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:57 smithi097 ceph-mon[32687]: 4.f scrub ok 2021-10-08T19:34:57.463 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:57 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:34:57.463 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:57 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:34:57.463 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:57 smithi097 ceph-mon[32687]: 172.21.15.97 - - [08/Oct/2021:19:34:56] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:34:57.464 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:57 smithi097 ceph-mon[32687]: 6.1 scrub ok 2021-10-08T19:34:57.464 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:57 smithi097 ceph-mon[32687]: 5.a scrub ok 2021-10-08T19:34:57.464 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:57 smithi097 ceph-mon[41966]: 6.e scrub ok 2021-10-08T19:34:57.465 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:57 smithi097 ceph-mon[41966]: 4.f scrub ok 2021-10-08T19:34:57.465 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:57 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:34:57.465 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:57 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:34:57.466 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:57 smithi097 ceph-mon[41966]: 172.21.15.97 - - [08/Oct/2021:19:34:56] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:34:57.466 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:57 smithi097 ceph-mon[41966]: 6.1 scrub ok 2021-10-08T19:34:57.466 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:57 smithi097 ceph-mon[41966]: 5.a scrub ok 2021-10-08T19:34:57.573 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:34:57.576 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:57.576 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:34:57.626 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:57 smithi117 ceph-mon[34585]: 6.e scrub ok 2021-10-08T19:34:57.626 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:57 smithi117 ceph-mon[34585]: 4.f scrub ok 2021-10-08T19:34:57.627 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:57 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:34:57.627 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:57 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:34:57.628 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:57 smithi117 ceph-mon[34585]: 172.21.15.97 - - [08/Oct/2021:19:34:56] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:34:57.628 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:57 smithi117 ceph-mon[34585]: 6.1 scrub ok 2021-10-08T19:34:57.628 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:57 smithi117 ceph-mon[34585]: 5.a scrub ok 2021-10-08T19:34:57.678 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:34:57.706 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:57.852 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:34:57.853 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:34:57.856 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:57.857 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:34:57.959 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:34:57.992 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:58.055 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:34:58.060 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2021-10-08T19:34:58.243 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:34:58.245 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:58.245 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:34:58.347 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:34:58.371 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:58.412 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:34:58.414 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:58.415 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:34:58.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:58 smithi097 ceph-mon[32687]: 5.1c scrub ok 2021-10-08T19:34:58.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:58 smithi097 ceph-mon[32687]: pgmap v675: 178 pgs: 178 active+clean; 255 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 638 B/s rd, 0 B/s wr, 1.10k op/s 2021-10-08T19:34:58.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:58 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:34:58.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:58 smithi097 ceph-mon[41966]: 5.1c scrub ok 2021-10-08T19:34:58.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:58 smithi097 ceph-mon[41966]: pgmap v675: 178 pgs: 178 active+clean; 255 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 638 B/s rd, 0 B/s wr, 1.10k op/s 2021-10-08T19:34:58.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:58 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:34:58.516 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:34:58.541 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:58.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:58 smithi117 ceph-mon[34585]: 5.1c scrub ok 2021-10-08T19:34:58.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:58 smithi117 ceph-mon[34585]: pgmap v675: 178 pgs: 178 active+clean; 255 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 638 B/s rd, 0 B/s wr, 1.10k op/s 2021-10-08T19:34:58.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:58 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:34:58.685 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:34:58.688 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:58.688 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:34:58.790 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:34:58.813 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:58.963 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:34:58.965 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:58.965 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:34:59.069 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:34:59.096 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:59.153 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":675,"stamp":"2021-10-08T19:34:56.811485+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":267589852,"num_objects":4269,"num_object_clones":0,"num_object_copies":12807,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4269,"num_whiteouts":0,"num_read":1772,"num_read_kb":1529,"num_write":228013,"num_write_kb":7404073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1622,"num_bytes_recovered":71315174,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71418,"ondisk_log_size":71418,"up":534,"acting":534,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":534,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":2783012,"kb_used_data":914596,"kb_used_omap":0,"kb_used_meta":1868224,"kb_avail":747178204,"statfs":{"total":767960285184,"available":765110480896,"internally_reserved":0,"allocated":936546304,"data_stored":933471404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1913061376},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-577830912,"num_objects":-8817,"num_object_clones":0,"num_object_copies":-26451,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-8817,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":8817,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.022960"},"pg_stats":[{"pgid":"9.5","version":"348'14082","reported_seq":14154,"reported_epoch":348,"state":"active+clean","last_fresh":"2021-10-08T19:34:54.081495+0000","last_change":"2021-10-08T19:33:36.880651+0000","last_active":"2021-10-08T19:34:54.081495+0000","last_peered":"2021-10-08T19:34:54.081495+0000","last_clean":"2021-10-08T19:34:54.081495+0000","last_became_active":"2021-10-08T19:31:33.860267+0000","last_became_peered":"2021-10-08T19:31:33.860267+0000","last_unstale":"2021-10-08T19:34:54.081495+0000","last_undegraded":"2021-10-08T19:34:54.081495+0000","last_fullsized":"2021-10-08T19:34:54.081495+0000","mapping_epoch":290,"log_start":"330'9100","ondisk_log_start":"330'9100","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"329'8650","last_scrub_stamp":"2021-10-08T19:33:36.880554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:33:36.880554+0000","log_size":4982,"ondisk_log_size":4982,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":1.859313738,"stat_sum":{"num_bytes":16252928,"num_objects":248,"num_object_clones":0,"num_object_copies":744,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14082,"num_write_kb":458560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"114'10","reported_seq":513,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:51.891467+0000","last_change":"2021-10-08T19:34:14.586366+0000","last_active":"2021-10-08T19:34:51.891467+0000","last_peered":"2021-10-08T19:34:51.891467+0000","last_clean":"2021-10-08T19:34:51.891467+0000","last_became_active":"2021-10-08T19:24:25.096162+0000","last_became_peered":"2021-10-08T19:24:25.096162+0000","last_unstale":"2021-10-08T19:34:51.891467+0000","last_undegraded":"2021-10-08T19:34:51.891467+0000","last_fullsized":"2021-10-08T19:34:51.891467+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'10","last_scrub_stamp":"2021-10-08T19:34:14.586030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:34:14.586030+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034352250000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"289'34","reported_seq":114,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.983286+0000","last_change":"2021-10-08T19:33:23.562208+0000","last_active":"2021-10-08T19:34:49.983286+0000","last_peered":"2021-10-08T19:34:49.983286+0000","last_clean":"2021-10-08T19:34:49.983286+0000","last_became_active":"2021-10-08T19:31:22.787271+0000","last_became_peered":"2021-10-08T19:31:22.787271+0000","last_unstale":"2021-10-08T19:34:49.983286+0000","last_undegraded":"2021-10-08T19:34:49.983286+0000","last_fullsized":"2021-10-08T19:34:49.983286+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'34","last_scrub_stamp":"2021-10-08T19:33:23.562083+0000","last_deep_scrub":"87'22","last_deep_scrub_stamp":"2021-10-08T19:22:58.705632+0000","last_clean_scrub_stamp":"2021-10-08T19:33:23.562083+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011294012000000001,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":348,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.981663+0000","last_change":"2021-10-08T19:34:46.067465+0000","last_active":"2021-10-08T19:34:49.981663+0000","last_peered":"2021-10-08T19:34:49.981663+0000","last_clean":"2021-10-08T19:34:49.981663+0000","last_became_active":"2021-10-08T19:29:40.632678+0000","last_became_peered":"2021-10-08T19:29:40.632678+0000","last_unstale":"2021-10-08T19:34:49.981663+0000","last_undegraded":"2021-10-08T19:34:49.981663+0000","last_fullsized":"2021-10-08T19:34:49.981663+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:46.067383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:46.067383+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0055929609999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":325,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.984139+0000","last_change":"2021-10-08T19:32:40.772624+0000","last_active":"2021-10-08T19:34:49.984139+0000","last_peered":"2021-10-08T19:34:49.984139+0000","last_clean":"2021-10-08T19:34:49.984139+0000","last_became_active":"2021-10-08T19:24:25.089002+0000","last_became_peered":"2021-10-08T19:24:25.089002+0000","last_unstale":"2021-10-08T19:34:49.984139+0000","last_undegraded":"2021-10-08T19:34:49.984139+0000","last_fullsized":"2021-10-08T19:34:49.984139+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:40.772524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:08.936801+0000","last_clean_scrub_stamp":"2021-10-08T19:32:40.772524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013535126999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":248,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.990155+0000","last_change":"2021-10-08T19:33:28.036369+0000","last_active":"2021-10-08T19:34:49.990155+0000","last_peered":"2021-10-08T19:34:49.990155+0000","last_clean":"2021-10-08T19:34:49.990155+0000","last_became_active":"2021-10-08T19:25:15.510457+0000","last_became_peered":"2021-10-08T19:25:15.510457+0000","last_unstale":"2021-10-08T19:34:49.990155+0000","last_undegraded":"2021-10-08T19:34:49.990155+0000","last_fullsized":"2021-10-08T19:34:49.990155+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:28.036266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:33:28.036266+0000","last_clean_scrub_stamp":"2021-10-08T19:33:28.036266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0045241719999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"348'14340","reported_seq":14406,"reported_epoch":348,"state":"active+clean","last_fresh":"2021-10-08T19:34:53.602247+0000","last_change":"2021-10-08T19:31:33.858962+0000","last_active":"2021-10-08T19:34:53.602247+0000","last_peered":"2021-10-08T19:34:53.602247+0000","last_clean":"2021-10-08T19:34:53.602247+0000","last_became_active":"2021-10-08T19:31:33.858616+0000","last_became_peered":"2021-10-08T19:31:33.858616+0000","last_unstale":"2021-10-08T19:34:53.602247+0000","last_undegraded":"2021-10-08T19:34:53.602247+0000","last_fullsized":"2021-10-08T19:34:53.602247+0000","mapping_epoch":290,"log_start":"332'9900","ondisk_log_start":"332'9900","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.825378+0000","log_size":4440,"ondisk_log_size":4440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":17301504,"num_objects":264,"num_object_clones":0,"num_object_copies":792,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":264,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14340,"num_write_kb":467328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,1],"acting":[5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"337'19","reported_seq":385,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:50.007723+0000","last_change":"2021-10-08T19:34:14.040366+0000","last_active":"2021-10-08T19:34:50.007723+0000","last_peered":"2021-10-08T19:34:50.007723+0000","last_clean":"2021-10-08T19:34:50.007723+0000","last_became_active":"2021-10-08T19:28:40.159729+0000","last_became_peered":"2021-10-08T19:28:40.159729+0000","last_unstale":"2021-10-08T19:34:50.007723+0000","last_undegraded":"2021-10-08T19:34:50.007723+0000","last_fullsized":"2021-10-08T19:34:50.007723+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"337'19","last_scrub_stamp":"2021-10-08T19:34:14.040249+0000","last_deep_scrub":"337'19","last_deep_scrub_stamp":"2021-10-08T19:34:14.040249+0000","last_clean_scrub_stamp":"2021-10-08T19:34:14.040249+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.068085647999999999,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":190,"reported_epoch":348,"state":"active+clean","last_fresh":"2021-10-08T19:34:52.700300+0000","last_change":"2021-10-08T19:34:52.700263+0000","last_active":"2021-10-08T19:34:52.700300+0000","last_peered":"2021-10-08T19:34:52.700300+0000","last_clean":"2021-10-08T19:34:52.700300+0000","last_became_active":"2021-10-08T19:29:40.624977+0000","last_became_peered":"2021-10-08T19:29:40.624977+0000","last_unstale":"2021-10-08T19:34:52.700300+0000","last_undegraded":"2021-10-08T19:34:52.700300+0000","last_fullsized":"2021-10-08T19:34:52.700300+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:52.700168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:52.700168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0094829509999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":334,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.987464+0000","last_change":"2021-10-08T19:33:31.442700+0000","last_active":"2021-10-08T19:34:49.987464+0000","last_peered":"2021-10-08T19:34:49.987464+0000","last_clean":"2021-10-08T19:34:49.987464+0000","last_became_active":"2021-10-08T19:29:40.629422+0000","last_became_peered":"2021-10-08T19:29:40.629422+0000","last_unstale":"2021-10-08T19:34:49.987464+0000","last_undegraded":"2021-10-08T19:34:49.987464+0000","last_fullsized":"2021-10-08T19:34:49.987464+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:31.442595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:33:31.442595+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0061671119999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":316,"reported_epoch":348,"state":"active+clean","last_fresh":"2021-10-08T19:34:53.070287+0000","last_change":"2021-10-08T19:34:53.070243+0000","last_active":"2021-10-08T19:34:53.070287+0000","last_peered":"2021-10-08T19:34:53.070287+0000","last_clean":"2021-10-08T19:34:53.070287+0000","last_became_active":"2021-10-08T19:21:29.643022+0000","last_became_peered":"2021-10-08T19:21:29.643022+0000","last_unstale":"2021-10-08T19:34:53.070287+0000","last_undegraded":"2021-10-08T19:34:53.070287+0000","last_fullsized":"2021-10-08T19:34:53.070287+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:53.070138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:34:53.070138+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.076770236000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"70'5","reported_seq":954,"reported_epoch":348,"state":"active+clean","last_fresh":"2021-10-08T19:34:52.440805+0000","last_change":"2021-10-08T19:34:45.765175+0000","last_active":"2021-10-08T19:34:52.440805+0000","last_peered":"2021-10-08T19:34:52.440805+0000","last_clean":"2021-10-08T19:34:52.440805+0000","last_became_active":"2021-10-08T19:29:40.630821+0000","last_became_peered":"2021-10-08T19:29:40.630821+0000","last_unstale":"2021-10-08T19:34:52.440805+0000","last_undegraded":"2021-10-08T19:34:52.440805+0000","last_fullsized":"2021-10-08T19:34:52.440805+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:34:45.765074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:45.765074+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0069135860000000002,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":631,"num_read_kb":631,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1167,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.7","version":"348'14048","reported_seq":14114,"reported_epoch":348,"state":"active+clean","last_fresh":"2021-10-08T19:34:53.562795+0000","last_change":"2021-10-08T19:31:33.859765+0000","last_active":"2021-10-08T19:34:53.562795+0000","last_peered":"2021-10-08T19:34:53.562795+0000","last_clean":"2021-10-08T19:34:53.562795+0000","last_became_active":"2021-10-08T19:31:33.859470+0000","last_became_peered":"2021-10-08T19:31:33.859470+0000","last_unstale":"2021-10-08T19:34:53.562795+0000","last_undegraded":"2021-10-08T19:34:53.562795+0000","last_fullsized":"2021-10-08T19:34:53.562795+0000","mapping_epoch":290,"log_start":"332'9543","ondisk_log_start":"332'9543","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.825378+0000","log_size":4505,"ondisk_log_size":4505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":17039360,"num_objects":260,"num_object_clones":0,"num_object_copies":780,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":260,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14048,"num_write_kb":457856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"289'35","reported_seq":373,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.980933+0000","last_change":"2021-10-08T19:34:17.416086+0000","last_active":"2021-10-08T19:34:49.980933+0000","last_peered":"2021-10-08T19:34:49.980933+0000","last_clean":"2021-10-08T19:34:49.980933+0000","last_became_active":"2021-10-08T19:28:40.101648+0000","last_became_peered":"2021-10-08T19:28:40.101648+0000","last_unstale":"2021-10-08T19:34:49.980933+0000","last_undegraded":"2021-10-08T19:34:49.980933+0000","last_fullsized":"2021-10-08T19:34:49.980933+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'35","last_scrub_stamp":"2021-10-08T19:34:17.415983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:34:17.415983+0000","log_size":35,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0070104399999999997,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":55,"num_read_kb":44,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":326,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.982135+0000","last_change":"2021-10-08T19:34:19.118563+0000","last_active":"2021-10-08T19:34:49.982135+0000","last_peered":"2021-10-08T19:34:49.982135+0000","last_clean":"2021-10-08T19:34:49.982135+0000","last_became_active":"2021-10-08T19:21:23.595919+0000","last_became_peered":"2021-10-08T19:21:23.595919+0000","last_unstale":"2021-10-08T19:34:49.982135+0000","last_undegraded":"2021-10-08T19:34:49.982135+0000","last_fullsized":"2021-10-08T19:34:49.982135+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:19.118460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:19.118460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0038562129999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":334,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.981762+0000","last_change":"2021-10-08T19:34:17.109330+0000","last_active":"2021-10-08T19:34:49.981762+0000","last_peered":"2021-10-08T19:34:49.981762+0000","last_clean":"2021-10-08T19:34:49.981762+0000","last_became_active":"2021-10-08T19:31:22.783725+0000","last_became_peered":"2021-10-08T19:31:22.783725+0000","last_unstale":"2021-10-08T19:34:49.981762+0000","last_undegraded":"2021-10-08T19:34:49.981762+0000","last_fullsized":"2021-10-08T19:34:49.981762+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:17.109225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:34:17.109225+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0087778820000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":332,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.989259+0000","last_change":"2021-10-08T19:34:20.691431+0000","last_active":"2021-10-08T19:34:49.989259+0000","last_peered":"2021-10-08T19:34:49.989259+0000","last_clean":"2021-10-08T19:34:49.989259+0000","last_became_active":"2021-10-08T19:29:40.638354+0000","last_became_peered":"2021-10-08T19:29:40.638354+0000","last_unstale":"2021-10-08T19:34:49.989259+0000","last_undegraded":"2021-10-08T19:34:49.989259+0000","last_fullsized":"2021-10-08T19:34:49.989259+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:20.691312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:39.528699+0000","last_clean_scrub_stamp":"2021-10-08T19:34:20.691312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0054161239999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":259,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.989862+0000","last_change":"2021-10-08T19:33:15.014419+0000","last_active":"2021-10-08T19:34:49.989862+0000","last_peered":"2021-10-08T19:34:49.989862+0000","last_clean":"2021-10-08T19:34:49.989862+0000","last_became_active":"2021-10-08T19:31:22.785590+0000","last_became_peered":"2021-10-08T19:31:22.785590+0000","last_unstale":"2021-10-08T19:34:49.989862+0000","last_undegraded":"2021-10-08T19:34:49.989862+0000","last_fullsized":"2021-10-08T19:34:49.989862+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:15.014302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:33:15.014302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0066500459999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.0","version":"348'14362","reported_seq":14433,"reported_epoch":348,"state":"active+clean","last_fresh":"2021-10-08T19:34:54.077088+0000","last_change":"2021-10-08T19:34:02.943797+0000","last_active":"2021-10-08T19:34:54.077088+0000","last_peered":"2021-10-08T19:34:54.077088+0000","last_clean":"2021-10-08T19:34:54.077088+0000","last_became_active":"2021-10-08T19:31:34.404922+0000","last_became_peered":"2021-10-08T19:31:34.404922+0000","last_unstale":"2021-10-08T19:34:54.077088+0000","last_undegraded":"2021-10-08T19:34:54.077088+0000","last_fullsized":"2021-10-08T19:34:54.077088+0000","mapping_epoch":290,"log_start":"332'10000","ondisk_log_start":"332'10000","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"334'10784","last_scrub_stamp":"2021-10-08T19:34:02.943715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:34:02.943715+0000","log_size":4362,"ondisk_log_size":4362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":1.5732822230000001,"stat_sum":{"num_bytes":16384000,"num_objects":250,"num_object_clones":0,"num_object_copies":750,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":250,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14362,"num_write_kb":467584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.8","version":"90'130","reported_seq":430,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.983359+0000","last_change":"2021-10-08T19:34:44.803061+0000","last_active":"2021-10-08T19:34:49.983359+0000","last_peered":"2021-10-08T19:34:49.983359+0000","last_clean":"2021-10-08T19:34:49.983359+0000","last_became_active":"2021-10-08T19:31:25.647505+0000","last_became_peered":"2021-10-08T19:31:25.647505+0000","last_unstale":"2021-10-08T19:34:49.983359+0000","last_undegraded":"2021-10-08T19:34:49.983359+0000","last_fullsized":"2021-10-08T19:34:49.983359+0000","mapping_epoch":286,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":287,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:34:44.802994+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:34:44.802994+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.016276585,"stat_sum":{"num_bytes":262688,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"289'31","reported_seq":414,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:50.008457+0000","last_change":"2021-10-08T19:32:35.520408+0000","last_active":"2021-10-08T19:34:50.008457+0000","last_peered":"2021-10-08T19:34:50.008457+0000","last_clean":"2021-10-08T19:34:50.008457+0000","last_became_active":"2021-10-08T19:28:40.099618+0000","last_became_peered":"2021-10-08T19:28:40.099618+0000","last_unstale":"2021-10-08T19:34:50.008457+0000","last_undegraded":"2021-10-08T19:34:50.008457+0000","last_fullsized":"2021-10-08T19:34:50.008457+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'31","last_scrub_stamp":"2021-10-08T19:32:35.520292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:32:35.520292+0000","log_size":31,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0063783820000000001,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":50,"num_read_kb":40,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"61'1","reported_seq":322,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.989842+0000","last_change":"2021-10-08T19:32:34.124480+0000","last_active":"2021-10-08T19:34:49.989842+0000","last_peered":"2021-10-08T19:34:49.989842+0000","last_clean":"2021-10-08T19:34:49.989842+0000","last_became_active":"2021-10-08T19:21:23.607064+0000","last_became_peered":"2021-10-08T19:21:23.607064+0000","last_unstale":"2021-10-08T19:34:49.989842+0000","last_undegraded":"2021-10-08T19:34:49.989842+0000","last_fullsized":"2021-10-08T19:34:49.989842+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'1","last_scrub_stamp":"2021-10-08T19:32:34.124360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:34.124360+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013485919000000001,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":166,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:50.000110+0000","last_change":"2021-10-08T19:33:28.473187+0000","last_active":"2021-10-08T19:34:50.000110+0000","last_peered":"2021-10-08T19:34:50.000110+0000","last_clean":"2021-10-08T19:34:50.000110+0000","last_became_active":"2021-10-08T19:28:40.152478+0000","last_became_peered":"2021-10-08T19:28:40.152478+0000","last_unstale":"2021-10-08T19:34:50.000110+0000","last_undegraded":"2021-10-08T19:34:50.000110+0000","last_fullsized":"2021-10-08T19:34:50.000110+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:28.473061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:30:09.081635+0000","last_clean_scrub_stamp":"2021-10-08T19:33:28.473061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.015238223,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":334,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.983956+0000","last_change":"2021-10-08T19:34:06.289528+0000","last_active":"2021-10-08T19:34:49.983956+0000","last_peered":"2021-10-08T19:34:49.983956+0000","last_clean":"2021-10-08T19:34:49.983956+0000","last_became_active":"2021-10-08T19:29:40.629424+0000","last_became_peered":"2021-10-08T19:29:40.629424+0000","last_unstale":"2021-10-08T19:34:49.983956+0000","last_undegraded":"2021-10-08T19:34:49.983956+0000","last_fullsized":"2021-10-08T19:34:49.983956+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:06.289410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:34:06.289410+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.125790019,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":298,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.981161+0000","last_change":"2021-10-08T19:33:31.895971+0000","last_active":"2021-10-08T19:34:49.981161+0000","last_peered":"2021-10-08T19:34:49.981161+0000","last_clean":"2021-10-08T19:34:49.981161+0000","last_became_active":"2021-10-08T19:31:51.676829+0000","last_became_peered":"2021-10-08T19:31:51.676829+0000","last_unstale":"2021-10-08T19:34:49.981161+0000","last_undegraded":"2021-10-08T19:34:49.981161+0000","last_fullsized":"2021-10-08T19:34:49.981161+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:31.895862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:33:31.895862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0071960000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"348'14111","reported_seq":14177,"reported_epoch":348,"state":"active+clean","last_fresh":"2021-10-08T19:34:54.078045+0000","last_change":"2021-10-08T19:31:34.405282+0000","last_active":"2021-10-08T19:34:54.078045+0000","last_peered":"2021-10-08T19:34:54.078045+0000","last_clean":"2021-10-08T19:34:54.078045+0000","last_became_active":"2021-10-08T19:31:34.404950+0000","last_became_peered":"2021-10-08T19:31:34.404950+0000","last_unstale":"2021-10-08T19:34:54.078045+0000","last_undegraded":"2021-10-08T19:34:54.078045+0000","last_fullsized":"2021-10-08T19:34:54.078045+0000","mapping_epoch":290,"log_start":"333'10100","ondisk_log_start":"333'10100","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.825378+0000","log_size":4011,"ondisk_log_size":4011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":15532032,"num_objects":237,"num_object_clones":0,"num_object_copies":711,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":237,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14111,"num_write_kb":459136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.9","version":"90'130","reported_seq":662,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.990368+0000","last_change":"2021-10-08T19:32:45.137224+0000","last_active":"2021-10-08T19:34:49.990368+0000","last_peered":"2021-10-08T19:34:49.990368+0000","last_clean":"2021-10-08T19:34:49.990368+0000","last_became_active":"2021-10-08T19:29:43.634789+0000","last_became_peered":"2021-10-08T19:29:43.634789+0000","last_unstale":"2021-10-08T19:34:49.990368+0000","last_undegraded":"2021-10-08T19:34:49.990368+0000","last_fullsized":"2021-10-08T19:34:49.990368+0000","mapping_epoch":239,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:32:45.137128+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:32:45.137128+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0066909819999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"289'20","reported_seq":425,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:50.007644+0000","last_change":"2021-10-08T19:32:43.431315+0000","last_active":"2021-10-08T19:34:50.007644+0000","last_peered":"2021-10-08T19:34:50.007644+0000","last_clean":"2021-10-08T19:34:50.007644+0000","last_became_active":"2021-10-08T19:29:40.631807+0000","last_became_peered":"2021-10-08T19:29:40.631807+0000","last_unstale":"2021-10-08T19:34:50.007644+0000","last_undegraded":"2021-10-08T19:34:50.007644+0000","last_fullsized":"2021-10-08T19:34:50.007644+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'20","last_scrub_stamp":"2021-10-08T19:32:43.431197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:32:43.431197+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0057648359999999997,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":186,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.998733+0000","last_change":"2021-10-08T19:33:32.394260+0000","last_active":"2021-10-08T19:34:49.998733+0000","last_peered":"2021-10-08T19:34:49.998733+0000","last_clean":"2021-10-08T19:34:49.998733+0000","last_became_active":"2021-10-08T19:29:40.638988+0000","last_became_peered":"2021-10-08T19:29:40.638988+0000","last_unstale":"2021-10-08T19:34:49.998733+0000","last_undegraded":"2021-10-08T19:34:49.998733+0000","last_fullsized":"2021-10-08T19:34:49.998733+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:32.394149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:33:32.394149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011814760000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"250'9","reported_seq":495,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:51.891382+0000","last_change":"2021-10-08T19:34:44.124906+0000","last_active":"2021-10-08T19:34:51.891382+0000","last_peered":"2021-10-08T19:34:51.891382+0000","last_clean":"2021-10-08T19:34:51.891382+0000","last_became_active":"2021-10-08T19:21:27.637930+0000","last_became_peered":"2021-10-08T19:21:27.637930+0000","last_unstale":"2021-10-08T19:34:51.891382+0000","last_undegraded":"2021-10-08T19:34:51.891382+0000","last_fullsized":"2021-10-08T19:34:51.891382+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'9","last_scrub_stamp":"2021-10-08T19:34:44.124799+0000","last_deep_scrub":"250'9","last_deep_scrub_stamp":"2021-10-08T19:30:04.239189+0000","last_clean_scrub_stamp":"2021-10-08T19:34:44.124799+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.025894820999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":325,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:50.009010+0000","last_change":"2021-10-08T19:32:05.558417+0000","last_active":"2021-10-08T19:34:50.009010+0000","last_peered":"2021-10-08T19:34:50.009010+0000","last_clean":"2021-10-08T19:34:50.009010+0000","last_became_active":"2021-10-08T19:28:40.100213+0000","last_became_peered":"2021-10-08T19:28:40.100213+0000","last_unstale":"2021-10-08T19:34:50.009010+0000","last_undegraded":"2021-10-08T19:34:50.009010+0000","last_fullsized":"2021-10-08T19:34:50.009010+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:05.558296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:32:05.558296+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.018815749,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":127,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.991609+0000","last_change":"2021-10-08T19:33:18.913013+0000","last_active":"2021-10-08T19:34:49.991609+0000","last_peered":"2021-10-08T19:34:49.991609+0000","last_clean":"2021-10-08T19:34:49.991609+0000","last_became_active":"2021-10-08T19:29:44.443507+0000","last_became_peered":"2021-10-08T19:29:44.443507+0000","last_unstale":"2021-10-08T19:34:49.991609+0000","last_undegraded":"2021-10-08T19:34:49.991609+0000","last_fullsized":"2021-10-08T19:34:49.991609+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:18.912952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:33:18.912952+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0091031900000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"348'14115","reported_seq":14180,"reported_epoch":348,"state":"active+clean","last_fresh":"2021-10-08T19:34:54.081798+0000","last_change":"2021-10-08T19:31:33.858496+0000","last_active":"2021-10-08T19:34:54.081798+0000","last_peered":"2021-10-08T19:34:54.081798+0000","last_clean":"2021-10-08T19:34:54.081798+0000","last_became_active":"2021-10-08T19:31:33.858205+0000","last_became_peered":"2021-10-08T19:31:33.858205+0000","last_unstale":"2021-10-08T19:34:54.081798+0000","last_undegraded":"2021-10-08T19:34:54.081798+0000","last_fullsized":"2021-10-08T19:34:54.081798+0000","mapping_epoch":290,"log_start":"333'10100","ondisk_log_start":"333'10100","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.825378+0000","log_size":4015,"ondisk_log_size":4015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":16580608,"num_objects":253,"num_object_clones":0,"num_object_copies":759,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":253,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14115,"num_write_kb":459776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.a","version":"90'130","reported_seq":496,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.984012+0000","last_change":"2021-10-08T19:34:11.489040+0000","last_active":"2021-10-08T19:34:49.984012+0000","last_peered":"2021-10-08T19:34:49.984012+0000","last_clean":"2021-10-08T19:34:49.984012+0000","last_became_active":"2021-10-08T19:27:26.591129+0000","last_became_peered":"2021-10-08T19:27:26.591129+0000","last_unstale":"2021-10-08T19:34:49.984012+0000","last_undegraded":"2021-10-08T19:34:49.984012+0000","last_fullsized":"2021-10-08T19:34:49.984012+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:34:11.488938+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:34:11.488938+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0022431069999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.f","version":"289'27","reported_seq":62,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.983767+0000","last_change":"2021-10-08T19:33:25.352000+0000","last_active":"2021-10-08T19:34:49.983767+0000","last_peered":"2021-10-08T19:34:49.983767+0000","last_clean":"2021-10-08T19:34:49.983767+0000","last_became_active":"2021-10-08T19:32:45.162914+0000","last_became_peered":"2021-10-08T19:32:45.162914+0000","last_unstale":"2021-10-08T19:34:49.983767+0000","last_undegraded":"2021-10-08T19:34:49.983767+0000","last_fullsized":"2021-10-08T19:34:49.983767+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'27","last_scrub_stamp":"2021-10-08T19:33:25.351908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:33:25.351908+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0073004960000000001,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":550,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":184,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.997378+0000","last_change":"2021-10-08T19:33:23.420571+0000","last_active":"2021-10-08T19:34:49.997378+0000","last_peered":"2021-10-08T19:34:49.997378+0000","last_clean":"2021-10-08T19:34:49.997378+0000","last_became_active":"2021-10-08T19:29:40.631290+0000","last_became_peered":"2021-10-08T19:29:40.631290+0000","last_unstale":"2021-10-08T19:34:49.997378+0000","last_undegraded":"2021-10-08T19:34:49.997378+0000","last_fullsized":"2021-10-08T19:34:49.997378+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:23.420464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:30:11.102934+0000","last_clean_scrub_stamp":"2021-10-08T19:33:23.420464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0090076059999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"88'9","reported_seq":483,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:51.891138+0000","last_change":"2021-10-08T19:32:44.385874+0000","last_active":"2021-10-08T19:34:51.891138+0000","last_peered":"2021-10-08T19:34:51.891138+0000","last_clean":"2021-10-08T19:34:51.891138+0000","last_became_active":"2021-10-08T19:21:27.636432+0000","last_became_peered":"2021-10-08T19:21:27.636432+0000","last_unstale":"2021-10-08T19:34:51.891138+0000","last_undegraded":"2021-10-08T19:34:51.891138+0000","last_fullsized":"2021-10-08T19:34:51.891138+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'9","last_scrub_stamp":"2021-10-08T19:32:44.385765+0000","last_deep_scrub":"88'9","last_deep_scrub_stamp":"2021-10-08T19:23:00.048245+0000","last_clean_scrub_stamp":"2021-10-08T19:32:44.385765+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0082317169999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":335,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:50.829779+0000","last_change":"2021-10-08T19:34:50.829320+0000","last_active":"2021-10-08T19:34:50.829779+0000","last_peered":"2021-10-08T19:34:50.829779+0000","last_clean":"2021-10-08T19:34:50.829779+0000","last_became_active":"2021-10-08T19:28:40.137966+0000","last_became_peered":"2021-10-08T19:28:40.137966+0000","last_unstale":"2021-10-08T19:34:50.829779+0000","last_undegraded":"2021-10-08T19:34:50.829779+0000","last_fullsized":"2021-10-08T19:34:50.829779+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:50.829228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:34:50.829228+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.056194888999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.8","version":"70'5","reported_seq":127,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.996458+0000","last_change":"2021-10-08T19:32:39.783608+0000","last_active":"2021-10-08T19:34:49.996458+0000","last_peered":"2021-10-08T19:34:49.996458+0000","last_clean":"2021-10-08T19:34:49.996458+0000","last_became_active":"2021-10-08T19:29:40.639786+0000","last_became_peered":"2021-10-08T19:29:40.639786+0000","last_unstale":"2021-10-08T19:34:49.996458+0000","last_undegraded":"2021-10-08T19:34:49.996458+0000","last_fullsized":"2021-10-08T19:34:49.996458+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:32:39.783498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:39.783498+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0078782899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3","version":"348'14516","reported_seq":14588,"reported_epoch":348,"state":"active+clean","last_fresh":"2021-10-08T19:34:53.671683+0000","last_change":"2021-10-08T19:34:47.248651+0000","last_active":"2021-10-08T19:34:53.671683+0000","last_peered":"2021-10-08T19:34:53.671683+0000","last_clean":"2021-10-08T19:34:53.671683+0000","last_became_active":"2021-10-08T19:31:33.861869+0000","last_became_peered":"2021-10-08T19:31:33.861869+0000","last_unstale":"2021-10-08T19:34:53.671683+0000","last_undegraded":"2021-10-08T19:34:53.671683+0000","last_fullsized":"2021-10-08T19:34:53.671683+0000","mapping_epoch":290,"log_start":"334'10700","ondisk_log_start":"334'10700","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"346'14022","last_scrub_stamp":"2021-10-08T19:34:47.248539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:34:47.248539+0000","log_size":3816,"ondisk_log_size":3816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.33946653599999999,"stat_sum":{"num_bytes":17170432,"num_objects":262,"num_object_clones":0,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":262,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14516,"num_write_kb":472896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"289'19","reported_seq":489,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:50.008813+0000","last_change":"2021-10-08T19:32:48.385494+0000","last_active":"2021-10-08T19:34:50.008813+0000","last_peered":"2021-10-08T19:34:50.008813+0000","last_clean":"2021-10-08T19:34:50.008813+0000","last_became_active":"2021-10-08T19:31:51.677509+0000","last_became_peered":"2021-10-08T19:31:51.677509+0000","last_unstale":"2021-10-08T19:34:50.008813+0000","last_undegraded":"2021-10-08T19:34:50.008813+0000","last_fullsized":"2021-10-08T19:34:50.008813+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:32:48.385367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:32:48.385367+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0082509920000000004,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":770,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":340,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.989340+0000","last_change":"2021-10-08T19:33:23.001573+0000","last_active":"2021-10-08T19:34:49.989340+0000","last_peered":"2021-10-08T19:34:49.989340+0000","last_clean":"2021-10-08T19:34:49.989340+0000","last_became_active":"2021-10-08T19:28:40.100691+0000","last_became_peered":"2021-10-08T19:28:40.100691+0000","last_unstale":"2021-10-08T19:34:49.989340+0000","last_undegraded":"2021-10-08T19:34:49.989340+0000","last_fullsized":"2021-10-08T19:34:49.989340+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:23.001455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:33:23.001455+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0091227059999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":327,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.984501+0000","last_change":"2021-10-08T19:33:17.529783+0000","last_active":"2021-10-08T19:34:49.984501+0000","last_peered":"2021-10-08T19:34:49.984501+0000","last_clean":"2021-10-08T19:34:49.984501+0000","last_became_active":"2021-10-08T19:24:25.105244+0000","last_became_peered":"2021-10-08T19:24:25.105244+0000","last_unstale":"2021-10-08T19:34:49.984501+0000","last_undegraded":"2021-10-08T19:34:49.984501+0000","last_fullsized":"2021-10-08T19:34:49.984501+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:17.529713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:33:17.529713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011576375999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":133,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.995283+0000","last_change":"2021-10-08T19:33:21.903287+0000","last_active":"2021-10-08T19:34:49.995283+0000","last_peered":"2021-10-08T19:34:49.995283+0000","last_clean":"2021-10-08T19:34:49.995283+0000","last_became_active":"2021-10-08T19:29:40.638099+0000","last_became_peered":"2021-10-08T19:29:40.638099+0000","last_unstale":"2021-10-08T19:34:49.995283+0000","last_undegraded":"2021-10-08T19:34:49.995283+0000","last_fullsized":"2021-10-08T19:34:49.995283+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:21.903188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:17.422176+0000","last_clean_scrub_stamp":"2021-10-08T19:33:21.903188+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014417607000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":264,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:50.006739+0000","last_change":"2021-10-08T19:32:51.293238+0000","last_active":"2021-10-08T19:34:50.006739+0000","last_peered":"2021-10-08T19:34:50.006739+0000","last_clean":"2021-10-08T19:34:50.006739+0000","last_became_active":"2021-10-08T19:24:13.506602+0000","last_became_peered":"2021-10-08T19:24:13.506602+0000","last_unstale":"2021-10-08T19:34:50.006739+0000","last_undegraded":"2021-10-08T19:34:50.006739+0000","last_fullsized":"2021-10-08T19:34:50.006739+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:51.293159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:51.293159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0082740520000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.c","version":"348'14050","reported_seq":14116,"reported_epoch":348,"state":"active+clean","last_fresh":"2021-10-08T19:34:54.081726+0000","last_change":"2021-10-08T19:31:33.861894+0000","last_active":"2021-10-08T19:34:54.081726+0000","last_peered":"2021-10-08T19:34:54.081726+0000","last_clean":"2021-10-08T19:34:54.081726+0000","last_became_active":"2021-10-08T19:31:33.861544+0000","last_became_peered":"2021-10-08T19:31:33.861544+0000","last_unstale":"2021-10-08T19:34:54.081726+0000","last_undegraded":"2021-10-08T19:34:54.081726+0000","last_fullsized":"2021-10-08T19:34:54.081726+0000","mapping_epoch":290,"log_start":"332'10000","ondisk_log_start":"332'10000","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.825378+0000","log_size":4050,"ondisk_log_size":4050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":15466496,"num_objects":236,"num_object_clones":0,"num_object_copies":708,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":236,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14050,"num_write_kb":457152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"90'130","reported_seq":457,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.995224+0000","last_change":"2021-10-08T19:32:46.759726+0000","last_active":"2021-10-08T19:34:49.995224+0000","last_peered":"2021-10-08T19:34:49.995224+0000","last_clean":"2021-10-08T19:34:49.995224+0000","last_became_active":"2021-10-08T19:29:43.636733+0000","last_became_peered":"2021-10-08T19:29:43.636733+0000","last_unstale":"2021-10-08T19:34:49.995224+0000","last_undegraded":"2021-10-08T19:34:49.995224+0000","last_fullsized":"2021-10-08T19:34:49.995224+0000","mapping_epoch":239,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:32:46.759636+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:32:46.759636+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013166881,"stat_sum":{"num_bytes":327680,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"238'13","reported_seq":198,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:51.893027+0000","last_change":"2021-10-08T19:34:46.158545+0000","last_active":"2021-10-08T19:34:51.893027+0000","last_peered":"2021-10-08T19:34:51.893027+0000","last_clean":"2021-10-08T19:34:51.893027+0000","last_became_active":"2021-10-08T19:29:40.640248+0000","last_became_peered":"2021-10-08T19:29:40.640248+0000","last_unstale":"2021-10-08T19:34:51.893027+0000","last_undegraded":"2021-10-08T19:34:51.893027+0000","last_fullsized":"2021-10-08T19:34:51.893027+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"238'13","last_scrub_stamp":"2021-10-08T19:31:21.472930+0000","last_deep_scrub":"91'9","last_deep_scrub_stamp":"2021-10-08T19:23:32.329475+0000","last_clean_scrub_stamp":"2021-10-08T19:31:21.472930+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040000679999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"289'28","reported_seq":409,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:50.006854+0000","last_change":"2021-10-08T19:34:48.208696+0000","last_active":"2021-10-08T19:34:50.006854+0000","last_peered":"2021-10-08T19:34:50.006854+0000","last_clean":"2021-10-08T19:34:50.006854+0000","last_became_active":"2021-10-08T19:24:25.098743+0000","last_became_peered":"2021-10-08T19:24:25.098743+0000","last_unstale":"2021-10-08T19:34:50.006854+0000","last_undegraded":"2021-10-08T19:34:50.006854+0000","last_fullsized":"2021-10-08T19:34:50.006854+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'28","last_scrub_stamp":"2021-10-08T19:34:48.208614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:34:48.208614+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.01283696,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":42,"num_read_kb":35,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":262,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.981858+0000","last_change":"2021-10-08T19:34:47.431125+0000","last_active":"2021-10-08T19:34:49.981858+0000","last_peered":"2021-10-08T19:34:49.981858+0000","last_clean":"2021-10-08T19:34:49.981858+0000","last_became_active":"2021-10-08T19:24:25.094364+0000","last_became_peered":"2021-10-08T19:24:25.094364+0000","last_unstale":"2021-10-08T19:34:49.981858+0000","last_undegraded":"2021-10-08T19:34:49.981858+0000","last_fullsized":"2021-10-08T19:34:49.981858+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:47.431007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:47.431007+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0058596159999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":328,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.990575+0000","last_change":"2021-10-08T19:32:15.378399+0000","last_active":"2021-10-08T19:34:49.990575+0000","last_peered":"2021-10-08T19:34:49.990575+0000","last_clean":"2021-10-08T19:34:49.990575+0000","last_became_active":"2021-10-08T19:24:25.094848+0000","last_became_peered":"2021-10-08T19:24:25.094848+0000","last_unstale":"2021-10-08T19:34:49.990575+0000","last_undegraded":"2021-10-08T19:34:49.990575+0000","last_fullsized":"2021-10-08T19:34:49.990575+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:15.378288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:32:15.378288+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.043151555000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":293,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:50.003512+0000","last_change":"2021-10-08T19:34:44.965618+0000","last_active":"2021-10-08T19:34:50.003512+0000","last_peered":"2021-10-08T19:34:50.003512+0000","last_clean":"2021-10-08T19:34:50.003512+0000","last_became_active":"2021-10-08T19:28:40.132751+0000","last_became_peered":"2021-10-08T19:28:40.132751+0000","last_unstale":"2021-10-08T19:34:50.003512+0000","last_undegraded":"2021-10-08T19:34:50.003512+0000","last_fullsized":"2021-10-08T19:34:50.003512+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:44.965505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:44.965505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.020193916999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.d","version":"348'14316","reported_seq":16580,"reported_epoch":348,"state":"active+clean","last_fresh":"2021-10-08T19:34:53.674944+0000","last_change":"2021-10-08T19:34:48.168279+0000","last_active":"2021-10-08T19:34:53.674944+0000","last_peered":"2021-10-08T19:34:53.674944+0000","last_clean":"2021-10-08T19:34:53.674944+0000","last_became_active":"2021-10-08T19:32:03.747395+0000","last_became_peered":"2021-10-08T19:32:03.747395+0000","last_unstale":"2021-10-08T19:34:53.674944+0000","last_undegraded":"2021-10-08T19:34:53.674944+0000","last_fullsized":"2021-10-08T19:34:53.674944+0000","mapping_epoch":308,"log_start":"334'10500","ondisk_log_start":"334'10500","created":290,"last_epoch_clean":309,"parent":"0.0","parent_split_bits":0,"last_scrub":"346'13945","last_scrub_stamp":"2021-10-08T19:34:48.168179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:34:48.168179+0000","log_size":3816,"ondisk_log_size":3816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.30163512599999998,"stat_sum":{"num_bytes":17498136,"num_objects":268,"num_object_clones":0,"num_object_copies":804,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":268,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":14316,"num_write_kb":466625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1088,"num_bytes_recovered":71303168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5],"acting":[7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.5","version":"90'130","reported_seq":490,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:50.006917+0000","last_change":"2021-10-08T19:32:14.582950+0000","last_active":"2021-10-08T19:34:50.006917+0000","last_peered":"2021-10-08T19:34:50.006917+0000","last_clean":"2021-10-08T19:34:50.006917+0000","last_became_active":"2021-10-08T19:27:26.590651+0000","last_became_peered":"2021-10-08T19:27:26.590651+0000","last_unstale":"2021-10-08T19:34:50.006917+0000","last_undegraded":"2021-10-08T19:34:50.006917+0000","last_fullsized":"2021-10-08T19:34:50.006917+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:32:14.582883+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:32:14.582883+0000","last_clean_scrub_stamp":"2021-10-08T19:32:14.582883+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0031287540000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":333,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:50.007043+0000","last_change":"2021-10-08T19:34:49.244387+0000","last_active":"2021-10-08T19:34:50.007043+0000","last_peered":"2021-10-08T19:34:50.007043+0000","last_clean":"2021-10-08T19:34:50.007043+0000","last_became_active":"2021-10-08T19:29:40.639405+0000","last_became_peered":"2021-10-08T19:29:40.639405+0000","last_unstale":"2021-10-08T19:34:50.007043+0000","last_undegraded":"2021-10-08T19:34:50.007043+0000","last_fullsized":"2021-10-08T19:34:50.007043+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:49.244279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:34:49.244279+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.018839582000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"289'30","reported_seq":169,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.996259+0000","last_change":"2021-10-08T19:34:06.085387+0000","last_active":"2021-10-08T19:34:49.996259+0000","last_peered":"2021-10-08T19:34:49.996259+0000","last_clean":"2021-10-08T19:34:49.996259+0000","last_became_active":"2021-10-08T19:29:40.635007+0000","last_became_peered":"2021-10-08T19:29:40.635007+0000","last_unstale":"2021-10-08T19:34:49.996259+0000","last_undegraded":"2021-10-08T19:34:49.996259+0000","last_fullsized":"2021-10-08T19:34:49.996259+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'30","last_scrub_stamp":"2021-10-08T19:34:06.085282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:34:06.085282+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.015398577,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":51,"num_read_kb":39,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":166,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:50.753401+0000","last_change":"2021-10-08T19:34:50.752974+0000","last_active":"2021-10-08T19:34:50.753401+0000","last_peered":"2021-10-08T19:34:50.753401+0000","last_clean":"2021-10-08T19:34:50.753401+0000","last_became_active":"2021-10-08T19:28:40.141714+0000","last_became_peered":"2021-10-08T19:28:40.141714+0000","last_unstale":"2021-10-08T19:34:50.753401+0000","last_undegraded":"2021-10-08T19:34:50.753401+0000","last_fullsized":"2021-10-08T19:34:50.753401+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:50.752866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:07.710367+0000","last_clean_scrub_stamp":"2021-10-08T19:34:50.752866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013659034,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":325,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:50.007471+0000","last_change":"2021-10-08T19:32:49.356419+0000","last_active":"2021-10-08T19:34:50.007471+0000","last_peered":"2021-10-08T19:34:50.007471+0000","last_clean":"2021-10-08T19:34:50.007471+0000","last_became_active":"2021-10-08T19:29:40.638253+0000","last_became_peered":"2021-10-08T19:29:40.638253+0000","last_unstale":"2021-10-08T19:34:50.007471+0000","last_undegraded":"2021-10-08T19:34:50.007471+0000","last_fullsized":"2021-10-08T19:34:50.007471+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:49.356299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:32:49.356299+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.007536137,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":127,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.991826+0000","last_change":"2021-10-08T19:32:41.758468+0000","last_active":"2021-10-08T19:34:49.991826+0000","last_peered":"2021-10-08T19:34:49.991826+0000","last_clean":"2021-10-08T19:34:49.991826+0000","last_became_active":"2021-10-08T19:29:40.634579+0000","last_became_peered":"2021-10-08T19:29:40.634579+0000","last_unstale":"2021-10-08T19:34:49.991826+0000","last_undegraded":"2021-10-08T19:34:49.991826+0000","last_fullsized":"2021-10-08T19:34:49.991826+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:41.758382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:41.758382+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.015929216999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"348'14149","reported_seq":14221,"reported_epoch":348,"state":"active+clean","last_fresh":"2021-10-08T19:34:53.661853+0000","last_change":"2021-10-08T19:34:13.621217+0000","last_active":"2021-10-08T19:34:53.661853+0000","last_peered":"2021-10-08T19:34:53.661853+0000","last_clean":"2021-10-08T19:34:53.661853+0000","last_became_active":"2021-10-08T19:31:33.861748+0000","last_became_peered":"2021-10-08T19:31:33.861748+0000","last_unstale":"2021-10-08T19:34:53.661853+0000","last_undegraded":"2021-10-08T19:34:53.661853+0000","last_fullsized":"2021-10-08T19:34:53.661853+0000","mapping_epoch":290,"log_start":"333'10300","ondisk_log_start":"333'10300","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"337'11353","last_scrub_stamp":"2021-10-08T19:34:13.621140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:34:13.621140+0000","log_size":3849,"ondisk_log_size":3849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.98600984000000003,"stat_sum":{"num_bytes":18939904,"num_objects":289,"num_object_clones":0,"num_object_copies":867,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":289,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14149,"num_write_kb":462016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.6","version":"90'130","reported_seq":431,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.981647+0000","last_change":"2021-10-08T19:34:43.467940+0000","last_active":"2021-10-08T19:34:49.981647+0000","last_peered":"2021-10-08T19:34:49.981647+0000","last_clean":"2021-10-08T19:34:49.981647+0000","last_became_active":"2021-10-08T19:30:00.643797+0000","last_became_peered":"2021-10-08T19:30:00.643797+0000","last_unstale":"2021-10-08T19:34:49.981647+0000","last_undegraded":"2021-10-08T19:34:49.981647+0000","last_fullsized":"2021-10-08T19:34:49.981647+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:34:43.467830+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:34:43.467830+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002526702,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":268,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:51.522064+0000","last_change":"2021-10-08T19:34:51.521930+0000","last_active":"2021-10-08T19:34:51.522064+0000","last_peered":"2021-10-08T19:34:51.522064+0000","last_clean":"2021-10-08T19:34:51.522064+0000","last_became_active":"2021-10-08T19:24:25.095389+0000","last_became_peered":"2021-10-08T19:24:25.095389+0000","last_unstale":"2021-10-08T19:34:51.522064+0000","last_undegraded":"2021-10-08T19:34:51.522064+0000","last_fullsized":"2021-10-08T19:34:51.522064+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:51.521824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:34:51.521824+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010031283,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"289'29","reported_seq":369,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:50.007578+0000","last_change":"2021-10-08T19:33:21.055265+0000","last_active":"2021-10-08T19:34:50.007578+0000","last_peered":"2021-10-08T19:34:50.007578+0000","last_clean":"2021-10-08T19:34:50.007578+0000","last_became_active":"2021-10-08T19:21:25.741812+0000","last_became_peered":"2021-10-08T19:21:25.741812+0000","last_unstale":"2021-10-08T19:34:50.007578+0000","last_undegraded":"2021-10-08T19:34:50.007578+0000","last_fullsized":"2021-10-08T19:34:50.007578+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'29","last_scrub_stamp":"2021-10-08T19:33:21.055136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:33:21.055136+0000","log_size":29,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0053848539999999997,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":54,"num_read_kb":40,"num_write":32,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"328'2","reported_seq":330,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.990163+0000","last_change":"2021-10-08T19:33:29.990487+0000","last_active":"2021-10-08T19:34:49.990163+0000","last_peered":"2021-10-08T19:34:49.990163+0000","last_clean":"2021-10-08T19:34:49.990163+0000","last_became_active":"2021-10-08T19:21:23.604258+0000","last_became_peered":"2021-10-08T19:21:23.604258+0000","last_unstale":"2021-10-08T19:34:49.990163+0000","last_undegraded":"2021-10-08T19:34:49.990163+0000","last_fullsized":"2021-10-08T19:34:49.990163+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"328'2","last_scrub_stamp":"2021-10-08T19:33:29.990395+0000","last_deep_scrub":"328'2","last_deep_scrub_stamp":"2021-10-08T19:33:29.990395+0000","last_clean_scrub_stamp":"2021-10-08T19:33:29.990395+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.020847460000000002,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":160,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.997294+0000","last_change":"2021-10-08T19:32:34.604785+0000","last_active":"2021-10-08T19:34:49.997294+0000","last_peered":"2021-10-08T19:34:49.997294+0000","last_clean":"2021-10-08T19:34:49.997294+0000","last_became_active":"2021-10-08T19:28:40.140876+0000","last_became_peered":"2021-10-08T19:28:40.140876+0000","last_unstale":"2021-10-08T19:34:49.997294+0000","last_undegraded":"2021-10-08T19:34:49.997294+0000","last_fullsized":"2021-10-08T19:34:49.997294+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:34.604679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:32:34.604679+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.029912211000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"70'5","reported_seq":166,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:50.000269+0000","last_change":"2021-10-08T19:34:06.579244+0000","last_active":"2021-10-08T19:34:50.000269+0000","last_peered":"2021-10-08T19:34:50.000269+0000","last_clean":"2021-10-08T19:34:50.000269+0000","last_became_active":"2021-10-08T19:28:40.150503+0000","last_became_peered":"2021-10-08T19:28:40.150503+0000","last_unstale":"2021-10-08T19:34:50.000269+0000","last_undegraded":"2021-10-08T19:34:50.000269+0000","last_fullsized":"2021-10-08T19:34:50.000269+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:34:06.579131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:06.579131+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0046237709999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"348'14083","reported_seq":14155,"reported_epoch":348,"state":"active+clean","last_fresh":"2021-10-08T19:34:54.087898+0000","last_change":"2021-10-08T19:34:11.022967+0000","last_active":"2021-10-08T19:34:54.087898+0000","last_peered":"2021-10-08T19:34:54.087898+0000","last_clean":"2021-10-08T19:34:54.087898+0000","last_became_active":"2021-10-08T19:31:34.405616+0000","last_became_peered":"2021-10-08T19:31:34.405616+0000","last_unstale":"2021-10-08T19:34:54.087898+0000","last_undegraded":"2021-10-08T19:34:54.087898+0000","last_fullsized":"2021-10-08T19:34:54.087898+0000","mapping_epoch":290,"log_start":"330'9100","ondisk_log_start":"330'9100","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"336'11102","last_scrub_stamp":"2021-10-08T19:34:11.022854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:34:11.022854+0000","log_size":4983,"ondisk_log_size":4983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":1.1536645059999999,"stat_sum":{"num_bytes":15138816,"num_objects":231,"num_object_clones":0,"num_object_copies":693,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":231,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14083,"num_write_kb":458048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"90'130","reported_seq":467,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.999015+0000","last_change":"2021-10-08T19:34:13.653358+0000","last_active":"2021-10-08T19:34:49.999015+0000","last_peered":"2021-10-08T19:34:49.999015+0000","last_clean":"2021-10-08T19:34:49.999015+0000","last_became_active":"2021-10-08T19:28:43.178371+0000","last_became_peered":"2021-10-08T19:28:43.178371+0000","last_unstale":"2021-10-08T19:34:49.999015+0000","last_undegraded":"2021-10-08T19:34:49.999015+0000","last_fullsized":"2021-10-08T19:34:49.999015+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:34:13.653248+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:34:13.653248+0000","last_clean_scrub_stamp":"2021-10-08T19:34:13.653248+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0071729649999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":80,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.984390+0000","last_change":"2021-10-08T19:33:21.590512+0000","last_active":"2021-10-08T19:34:49.984390+0000","last_peered":"2021-10-08T19:34:49.984390+0000","last_clean":"2021-10-08T19:34:49.984390+0000","last_became_active":"2021-10-08T19:31:22.783759+0000","last_became_peered":"2021-10-08T19:31:22.783759+0000","last_unstale":"2021-10-08T19:34:49.984390+0000","last_undegraded":"2021-10-08T19:34:49.984390+0000","last_fullsized":"2021-10-08T19:34:49.984390+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:21.590400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:33:21.590400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.022083749,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"289'24","reported_seq":421,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:50.003684+0000","last_change":"2021-10-08T19:33:23.117133+0000","last_active":"2021-10-08T19:34:50.003684+0000","last_peered":"2021-10-08T19:34:50.003684+0000","last_clean":"2021-10-08T19:34:50.003684+0000","last_became_active":"2021-10-08T19:32:45.154743+0000","last_became_peered":"2021-10-08T19:32:45.154743+0000","last_unstale":"2021-10-08T19:34:50.003684+0000","last_undegraded":"2021-10-08T19:34:50.003684+0000","last_fullsized":"2021-10-08T19:34:50.003684+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'24","last_scrub_stamp":"2021-10-08T19:33:23.117023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:33:23.117023+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0078508209999999991,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":30,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":309,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.982519+0000","last_change":"2021-10-08T19:34:49.971594+0000","last_active":"2021-10-08T19:34:49.982519+0000","last_peered":"2021-10-08T19:34:49.982519+0000","last_clean":"2021-10-08T19:34:49.982519+0000","last_became_active":"2021-10-08T19:28:40.140231+0000","last_became_peered":"2021-10-08T19:28:40.140231+0000","last_unstale":"2021-10-08T19:34:49.982519+0000","last_undegraded":"2021-10-08T19:34:49.982519+0000","last_fullsized":"2021-10-08T19:34:49.982519+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:49.971481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:32.922694+0000","last_clean_scrub_stamp":"2021-10-08T19:34:49.971481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0062248970000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":350,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:50.000218+0000","last_change":"2021-10-08T19:32:50.969378+0000","last_active":"2021-10-08T19:34:50.000218+0000","last_peered":"2021-10-08T19:34:50.000218+0000","last_clean":"2021-10-08T19:34:50.000218+0000","last_became_active":"2021-10-08T19:29:40.632010+0000","last_became_peered":"2021-10-08T19:29:40.632010+0000","last_unstale":"2021-10-08T19:34:50.000218+0000","last_undegraded":"2021-10-08T19:34:50.000218+0000","last_fullsized":"2021-10-08T19:34:50.000218+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:50.969293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:50.969293+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.015235362000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":68,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.998775+0000","last_change":"2021-10-08T19:34:21.644930+0000","last_active":"2021-10-08T19:34:49.998775+0000","last_peered":"2021-10-08T19:34:49.998775+0000","last_clean":"2021-10-08T19:34:49.998775+0000","last_became_active":"2021-10-08T19:31:51.673821+0000","last_became_peered":"2021-10-08T19:31:51.673821+0000","last_unstale":"2021-10-08T19:34:49.998775+0000","last_undegraded":"2021-10-08T19:34:49.998775+0000","last_fullsized":"2021-10-08T19:34:49.998775+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:21.644827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:21.644827+0000","last_clean_scrub_stamp":"2021-10-08T19:34:21.644827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0073867230000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"348'14431","reported_seq":14497,"reported_epoch":348,"state":"active+clean","last_fresh":"2021-10-08T19:34:54.081402+0000","last_change":"2021-10-08T19:31:33.860786+0000","last_active":"2021-10-08T19:34:54.081402+0000","last_peered":"2021-10-08T19:34:54.081402+0000","last_clean":"2021-10-08T19:34:54.081402+0000","last_became_active":"2021-10-08T19:31:33.860551+0000","last_became_peered":"2021-10-08T19:31:33.860551+0000","last_unstale":"2021-10-08T19:34:54.081402+0000","last_undegraded":"2021-10-08T19:34:54.081402+0000","last_fullsized":"2021-10-08T19:34:54.081402+0000","mapping_epoch":290,"log_start":"333'10400","ondisk_log_start":"333'10400","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.825378+0000","log_size":4031,"ondisk_log_size":4031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":16056320,"num_objects":245,"num_object_clones":0,"num_object_copies":735,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":245,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14431,"num_write_kb":469632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":310,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.990007+0000","last_change":"2021-10-08T19:32:10.312482+0000","last_active":"2021-10-08T19:34:49.990007+0000","last_peered":"2021-10-08T19:34:49.990007+0000","last_clean":"2021-10-08T19:34:49.990007+0000","last_became_active":"2021-10-08T19:21:27.636086+0000","last_became_peered":"2021-10-08T19:21:27.636086+0000","last_unstale":"2021-10-08T19:34:49.990007+0000","last_undegraded":"2021-10-08T19:34:49.990007+0000","last_fullsized":"2021-10-08T19:34:49.990007+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:10.312378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:32:10.312378+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013579486,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"289'26","reported_seq":296,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.981430+0000","last_change":"2021-10-08T19:33:24.895190+0000","last_active":"2021-10-08T19:34:49.981430+0000","last_peered":"2021-10-08T19:34:49.981430+0000","last_clean":"2021-10-08T19:34:49.981430+0000","last_became_active":"2021-10-08T19:24:25.100384+0000","last_became_peered":"2021-10-08T19:24:25.100384+0000","last_unstale":"2021-10-08T19:34:49.981430+0000","last_undegraded":"2021-10-08T19:34:49.981430+0000","last_fullsized":"2021-10-08T19:34:49.981430+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'26","last_scrub_stamp":"2021-10-08T19:33:24.895081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:33:24.895081+0000","log_size":26,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0077530389999999998,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":42,"num_read_kb":32,"num_write":25,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"90'130","reported_seq":629,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.989295+0000","last_change":"2021-10-08T19:33:59.796799+0000","last_active":"2021-10-08T19:34:49.989295+0000","last_peered":"2021-10-08T19:34:49.989295+0000","last_clean":"2021-10-08T19:34:49.989295+0000","last_became_active":"2021-10-08T19:27:22.607289+0000","last_became_peered":"2021-10-08T19:27:22.607289+0000","last_unstale":"2021-10-08T19:34:49.989295+0000","last_undegraded":"2021-10-08T19:34:49.989295+0000","last_fullsized":"2021-10-08T19:34:49.989295+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:33:59.796700+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:33:59.796700+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0060175439999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":313,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.983718+0000","last_change":"2021-10-08T19:32:42.759368+0000","last_active":"2021-10-08T19:34:49.983718+0000","last_peered":"2021-10-08T19:34:49.983718+0000","last_clean":"2021-10-08T19:34:49.983718+0000","last_became_active":"2021-10-08T19:21:23.599143+0000","last_became_peered":"2021-10-08T19:21:23.599143+0000","last_unstale":"2021-10-08T19:34:49.983718+0000","last_undegraded":"2021-10-08T19:34:49.983718+0000","last_fullsized":"2021-10-08T19:34:49.983718+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:42.759288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:42.759288+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0067448220000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":127,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.989028+0000","last_change":"2021-10-08T19:32:40.754068+0000","last_active":"2021-10-08T19:34:49.989028+0000","last_peered":"2021-10-08T19:34:49.989028+0000","last_clean":"2021-10-08T19:34:49.989028+0000","last_became_active":"2021-10-08T19:29:40.638774+0000","last_became_peered":"2021-10-08T19:29:40.638774+0000","last_unstale":"2021-10-08T19:34:49.989028+0000","last_undegraded":"2021-10-08T19:34:49.989028+0000","last_fullsized":"2021-10-08T19:34:49.989028+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:40.753959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:40.753959+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0086989049999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":325,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.984578+0000","last_change":"2021-10-08T19:32:15.872970+0000","last_active":"2021-10-08T19:34:49.984578+0000","last_peered":"2021-10-08T19:34:49.984578+0000","last_clean":"2021-10-08T19:34:49.984578+0000","last_became_active":"2021-10-08T19:29:40.627256+0000","last_became_peered":"2021-10-08T19:29:40.627256+0000","last_unstale":"2021-10-08T19:34:49.984578+0000","last_undegraded":"2021-10-08T19:34:49.984578+0000","last_fullsized":"2021-10-08T19:34:49.984578+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:15.872860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:32:15.872860+0000","last_clean_scrub_stamp":"2021-10-08T19:32:15.872860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.068573066000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"348'14194","reported_seq":14266,"reported_epoch":348,"state":"active+clean","last_fresh":"2021-10-08T19:34:53.596589+0000","last_change":"2021-10-08T19:34:09.706910+0000","last_active":"2021-10-08T19:34:53.596589+0000","last_peered":"2021-10-08T19:34:53.596589+0000","last_clean":"2021-10-08T19:34:53.596589+0000","last_became_active":"2021-10-08T19:31:33.859047+0000","last_became_peered":"2021-10-08T19:31:33.859047+0000","last_unstale":"2021-10-08T19:34:53.596589+0000","last_undegraded":"2021-10-08T19:34:53.596589+0000","last_fullsized":"2021-10-08T19:34:53.596589+0000","mapping_epoch":290,"log_start":"332'9762","ondisk_log_start":"332'9762","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"336'11118","last_scrub_stamp":"2021-10-08T19:34:09.706829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:34:09.706829+0000","log_size":4432,"ondisk_log_size":4432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":1.1768237109999999,"stat_sum":{"num_bytes":19136512,"num_objects":292,"num_object_clones":0,"num_object_copies":876,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":292,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14194,"num_write_kb":463552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"90'130","reported_seq":637,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.991120+0000","last_change":"2021-10-08T19:34:05.737954+0000","last_active":"2021-10-08T19:34:49.991120+0000","last_peered":"2021-10-08T19:34:49.991120+0000","last_clean":"2021-10-08T19:34:49.991120+0000","last_became_active":"2021-10-08T19:27:26.591250+0000","last_became_peered":"2021-10-08T19:27:26.591250+0000","last_unstale":"2021-10-08T19:34:49.991120+0000","last_undegraded":"2021-10-08T19:34:49.991120+0000","last_fullsized":"2021-10-08T19:34:49.991120+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:34:05.737882+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:34:05.737882+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0037827009999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":320,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.981921+0000","last_change":"2021-10-08T19:34:20.092197+0000","last_active":"2021-10-08T19:34:49.981921+0000","last_peered":"2021-10-08T19:34:49.981921+0000","last_clean":"2021-10-08T19:34:49.981921+0000","last_became_active":"2021-10-08T19:21:27.637875+0000","last_became_peered":"2021-10-08T19:21:27.637875+0000","last_unstale":"2021-10-08T19:34:49.981921+0000","last_undegraded":"2021-10-08T19:34:49.981921+0000","last_fullsized":"2021-10-08T19:34:49.981921+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:20.092069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:20.092069+0000","last_clean_scrub_stamp":"2021-10-08T19:34:20.092069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0051905989999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"289'17","reported_seq":74,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:50.001077+0000","last_change":"2021-10-08T19:33:24.425584+0000","last_active":"2021-10-08T19:34:50.001077+0000","last_peered":"2021-10-08T19:34:50.001077+0000","last_clean":"2021-10-08T19:34:50.001077+0000","last_became_active":"2021-10-08T19:31:51.674965+0000","last_became_peered":"2021-10-08T19:31:51.674965+0000","last_unstale":"2021-10-08T19:34:50.001077+0000","last_undegraded":"2021-10-08T19:34:50.001077+0000","last_fullsized":"2021-10-08T19:34:50.001077+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'17","last_scrub_stamp":"2021-10-08T19:33:24.425500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:33:24.425500+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.015679596000000001,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":23,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":990,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":340,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.981540+0000","last_change":"2021-10-08T19:33:21.374979+0000","last_active":"2021-10-08T19:34:49.981540+0000","last_peered":"2021-10-08T19:34:49.981540+0000","last_clean":"2021-10-08T19:34:49.981540+0000","last_became_active":"2021-10-08T19:29:40.619746+0000","last_became_peered":"2021-10-08T19:29:40.619746+0000","last_unstale":"2021-10-08T19:34:49.981540+0000","last_undegraded":"2021-10-08T19:34:49.981540+0000","last_fullsized":"2021-10-08T19:34:49.981540+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:21.374908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:33:21.374908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034369499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"70'5","reported_seq":168,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.998300+0000","last_change":"2021-10-08T19:34:18.630491+0000","last_active":"2021-10-08T19:34:49.998300+0000","last_peered":"2021-10-08T19:34:49.998300+0000","last_clean":"2021-10-08T19:34:49.998300+0000","last_became_active":"2021-10-08T19:28:40.148054+0000","last_became_peered":"2021-10-08T19:28:40.148054+0000","last_unstale":"2021-10-08T19:34:49.998300+0000","last_undegraded":"2021-10-08T19:34:49.998300+0000","last_fullsized":"2021-10-08T19:34:49.998300+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:34:18.630378+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2021-10-08T19:34:18.630378+0000","last_clean_scrub_stamp":"2021-10-08T19:34:18.630378+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0054668570000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":344,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.990083+0000","last_change":"2021-10-08T19:32:42.131131+0000","last_active":"2021-10-08T19:34:49.990083+0000","last_peered":"2021-10-08T19:34:49.990083+0000","last_clean":"2021-10-08T19:34:49.990083+0000","last_became_active":"2021-10-08T19:29:40.652528+0000","last_became_peered":"2021-10-08T19:29:40.652528+0000","last_unstale":"2021-10-08T19:34:49.990083+0000","last_undegraded":"2021-10-08T19:34:49.990083+0000","last_fullsized":"2021-10-08T19:34:49.990083+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:42.131020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:32:42.131020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.027867907000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.9","version":"348'14168","reported_seq":14238,"reported_epoch":348,"state":"active+clean","last_fresh":"2021-10-08T19:34:54.067326+0000","last_change":"2021-10-08T19:34:07.731840+0000","last_active":"2021-10-08T19:34:54.067326+0000","last_peered":"2021-10-08T19:34:54.067326+0000","last_clean":"2021-10-08T19:34:54.067326+0000","last_became_active":"2021-10-08T19:31:33.858961+0000","last_became_peered":"2021-10-08T19:31:33.858961+0000","last_unstale":"2021-10-08T19:34:54.067326+0000","last_undegraded":"2021-10-08T19:34:54.067326+0000","last_fullsized":"2021-10-08T19:34:54.067326+0000","mapping_epoch":290,"log_start":"330'9200","ondisk_log_start":"330'9200","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"336'10990","last_scrub_stamp":"2021-10-08T19:34:07.731731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:34:07.731731+0000","log_size":4968,"ondisk_log_size":4968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.89057212100000005,"stat_sum":{"num_bytes":16252928,"num_objects":248,"num_object_clones":0,"num_object_copies":744,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14168,"num_write_kb":461312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,5],"acting":[0,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"90'130","reported_seq":489,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.983285+0000","last_change":"2021-10-08T19:31:33.806970+0000","last_active":"2021-10-08T19:34:49.983285+0000","last_peered":"2021-10-08T19:34:49.983285+0000","last_clean":"2021-10-08T19:34:49.983285+0000","last_became_active":"2021-10-08T19:27:26.591993+0000","last_became_peered":"2021-10-08T19:27:26.591993+0000","last_unstale":"2021-10-08T19:34:49.983285+0000","last_undegraded":"2021-10-08T19:34:49.983285+0000","last_fullsized":"2021-10-08T19:34:49.983285+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:31:33.806885+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:31:33.806885+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.00183936,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,2],"acting":[5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":332,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:50.005492+0000","last_change":"2021-10-08T19:33:27.102932+0000","last_active":"2021-10-08T19:34:50.005492+0000","last_peered":"2021-10-08T19:34:50.005492+0000","last_clean":"2021-10-08T19:34:50.005492+0000","last_became_active":"2021-10-08T19:28:40.133414+0000","last_became_peered":"2021-10-08T19:28:40.133414+0000","last_unstale":"2021-10-08T19:34:50.005492+0000","last_undegraded":"2021-10-08T19:34:50.005492+0000","last_fullsized":"2021-10-08T19:34:50.005492+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:27.102857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:33:27.102857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.008485991,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"289'44","reported_seq":344,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:51.891000+0000","last_change":"2021-10-08T19:34:04.465039+0000","last_active":"2021-10-08T19:34:51.891000+0000","last_peered":"2021-10-08T19:34:51.891000+0000","last_clean":"2021-10-08T19:34:51.891000+0000","last_became_active":"2021-10-08T19:29:40.626138+0000","last_became_peered":"2021-10-08T19:29:40.626138+0000","last_unstale":"2021-10-08T19:34:51.891000+0000","last_undegraded":"2021-10-08T19:34:51.891000+0000","last_fullsized":"2021-10-08T19:34:51.891000+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'44","last_scrub_stamp":"2021-10-08T19:34:04.464934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:34:04.464934+0000","log_size":44,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.004062642,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":65,"num_read_kb":50,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":1432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":349,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.984267+0000","last_change":"2021-10-08T19:32:06.793381+0000","last_active":"2021-10-08T19:34:49.984267+0000","last_peered":"2021-10-08T19:34:49.984267+0000","last_clean":"2021-10-08T19:34:49.984267+0000","last_became_active":"2021-10-08T19:28:40.137919+0000","last_became_peered":"2021-10-08T19:28:40.137919+0000","last_unstale":"2021-10-08T19:34:49.984267+0000","last_undegraded":"2021-10-08T19:34:49.984267+0000","last_fullsized":"2021-10-08T19:34:49.984267+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:06.793283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:06.793283+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0046514379999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":135,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.991536+0000","last_change":"2021-10-08T19:34:45.208220+0000","last_active":"2021-10-08T19:34:49.991536+0000","last_peered":"2021-10-08T19:34:49.991536+0000","last_clean":"2021-10-08T19:34:49.991536+0000","last_became_active":"2021-10-08T19:29:40.637371+0000","last_became_peered":"2021-10-08T19:29:40.637371+0000","last_unstale":"2021-10-08T19:34:49.991536+0000","last_undegraded":"2021-10-08T19:34:49.991536+0000","last_fullsized":"2021-10-08T19:34:49.991536+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:45.208127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:34:45.208127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.01258626,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":275,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:50.007806+0000","last_change":"2021-10-08T19:34:04.039092+0000","last_active":"2021-10-08T19:34:50.007806+0000","last_peered":"2021-10-08T19:34:50.007806+0000","last_clean":"2021-10-08T19:34:50.007806+0000","last_became_active":"2021-10-08T19:25:14.550690+0000","last_became_peered":"2021-10-08T19:25:14.550690+0000","last_unstale":"2021-10-08T19:34:50.007806+0000","last_undegraded":"2021-10-08T19:34:50.007806+0000","last_fullsized":"2021-10-08T19:34:50.007806+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:04.038995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:04.038995+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0083020339999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.f","version":"348'14258","reported_seq":14332,"reported_epoch":348,"state":"active+clean","last_fresh":"2021-10-08T19:34:53.593903+0000","last_change":"2021-10-08T19:34:52.902603+0000","last_active":"2021-10-08T19:34:53.593903+0000","last_peered":"2021-10-08T19:34:53.593903+0000","last_clean":"2021-10-08T19:34:53.593903+0000","last_became_active":"2021-10-08T19:31:33.859443+0000","last_became_peered":"2021-10-08T19:31:33.859443+0000","last_unstale":"2021-10-08T19:34:53.593903+0000","last_undegraded":"2021-10-08T19:34:53.593903+0000","last_fullsized":"2021-10-08T19:34:53.593903+0000","mapping_epoch":290,"log_start":"332'9800","ondisk_log_start":"332'9800","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"348'14208","last_scrub_stamp":"2021-10-08T19:34:52.902492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:34:52.902492+0000","log_size":4458,"ondisk_log_size":4458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.158487459,"stat_sum":{"num_bytes":16646144,"num_objects":254,"num_object_clones":0,"num_object_copies":762,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":254,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14258,"num_write_kb":464384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"90'130","reported_seq":591,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.981593+0000","last_change":"2021-10-08T19:34:01.146361+0000","last_active":"2021-10-08T19:34:49.981593+0000","last_peered":"2021-10-08T19:34:49.981593+0000","last_clean":"2021-10-08T19:34:49.981593+0000","last_became_active":"2021-10-08T19:29:43.636820+0000","last_became_peered":"2021-10-08T19:29:43.636820+0000","last_unstale":"2021-10-08T19:34:49.981593+0000","last_undegraded":"2021-10-08T19:34:49.981593+0000","last_fullsized":"2021-10-08T19:34:49.981593+0000","mapping_epoch":239,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:34:01.146246+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:34:01.146246+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.006677657,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"114'10","reported_seq":515,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:51.891838+0000","last_change":"2021-10-08T19:34:03.864493+0000","last_active":"2021-10-08T19:34:51.891838+0000","last_peered":"2021-10-08T19:34:51.891838+0000","last_clean":"2021-10-08T19:34:51.891838+0000","last_became_active":"2021-10-08T19:24:25.106695+0000","last_became_peered":"2021-10-08T19:24:25.106695+0000","last_unstale":"2021-10-08T19:34:51.891838+0000","last_undegraded":"2021-10-08T19:34:51.891838+0000","last_fullsized":"2021-10-08T19:34:51.891838+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'10","last_scrub_stamp":"2021-10-08T19:34:03.864384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:34:03.864384+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.007036924,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"289'20","reported_seq":74,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.998436+0000","last_change":"2021-10-08T19:34:16.658166+0000","last_active":"2021-10-08T19:34:49.998436+0000","last_peered":"2021-10-08T19:34:49.998436+0000","last_clean":"2021-10-08T19:34:49.998436+0000","last_became_active":"2021-10-08T19:31:51.675569+0000","last_became_peered":"2021-10-08T19:31:51.675569+0000","last_unstale":"2021-10-08T19:34:49.998436+0000","last_undegraded":"2021-10-08T19:34:49.998436+0000","last_fullsized":"2021-10-08T19:34:49.998436+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'20","last_scrub_stamp":"2021-10-08T19:34:16.658057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:34:16.658057+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010989301999999999,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":23,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":166,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.999983+0000","last_change":"2021-10-08T19:32:52.491940+0000","last_active":"2021-10-08T19:34:49.999983+0000","last_peered":"2021-10-08T19:34:49.999983+0000","last_clean":"2021-10-08T19:34:49.999983+0000","last_became_active":"2021-10-08T19:28:40.141737+0000","last_became_peered":"2021-10-08T19:28:40.141737+0000","last_unstale":"2021-10-08T19:34:49.999983+0000","last_undegraded":"2021-10-08T19:34:49.999983+0000","last_fullsized":"2021-10-08T19:34:49.999983+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:52.491828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:52.491828+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.015794227000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":334,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:50.004288+0000","last_change":"2021-10-08T19:34:16.042895+0000","last_active":"2021-10-08T19:34:50.004288+0000","last_peered":"2021-10-08T19:34:50.004288+0000","last_clean":"2021-10-08T19:34:50.004288+0000","last_became_active":"2021-10-08T19:29:40.643614+0000","last_became_peered":"2021-10-08T19:29:40.643614+0000","last_unstale":"2021-10-08T19:34:50.004288+0000","last_undegraded":"2021-10-08T19:34:50.004288+0000","last_fullsized":"2021-10-08T19:34:50.004288+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:16.042797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:16.042797+0000","last_clean_scrub_stamp":"2021-10-08T19:34:16.042797+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.038141670000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":289,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.983784+0000","last_change":"2021-10-08T19:32:49.731052+0000","last_active":"2021-10-08T19:34:49.983784+0000","last_peered":"2021-10-08T19:34:49.983784+0000","last_clean":"2021-10-08T19:34:49.983784+0000","last_became_active":"2021-10-08T19:29:40.626998+0000","last_became_peered":"2021-10-08T19:29:40.626998+0000","last_unstale":"2021-10-08T19:34:49.983784+0000","last_undegraded":"2021-10-08T19:34:49.983784+0000","last_fullsized":"2021-10-08T19:34:49.983784+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:49.730960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:49.730960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.017072971999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.4","version":"348'14547","reported_seq":14621,"reported_epoch":348,"state":"active+clean","last_fresh":"2021-10-08T19:34:54.098627+0000","last_change":"2021-10-08T19:34:00.850587+0000","last_active":"2021-10-08T19:34:54.098627+0000","last_peered":"2021-10-08T19:34:54.098627+0000","last_clean":"2021-10-08T19:34:54.098627+0000","last_became_active":"2021-10-08T19:31:33.861531+0000","last_became_peered":"2021-10-08T19:31:33.861531+0000","last_unstale":"2021-10-08T19:34:54.098627+0000","last_undegraded":"2021-10-08T19:34:54.098627+0000","last_fullsized":"2021-10-08T19:34:54.098627+0000","mapping_epoch":290,"log_start":"332'10101","ondisk_log_start":"332'10101","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"334'10939","last_scrub_stamp":"2021-10-08T19:34:00.850475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:32.825378+0000","last_clean_scrub_stamp":"2021-10-08T19:34:00.850475+0000","log_size":4446,"ondisk_log_size":4446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":1.492343617,"stat_sum":{"num_bytes":15597568,"num_objects":238,"num_object_clones":0,"num_object_copies":714,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":238,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14080,"num_write_kb":458176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":340,"reported_epoch":348,"state":"active+clean","last_fresh":"2021-10-08T19:34:52.986527+0000","last_change":"2021-10-08T19:34:52.986483+0000","last_active":"2021-10-08T19:34:52.986527+0000","last_peered":"2021-10-08T19:34:52.986527+0000","last_clean":"2021-10-08T19:34:52.986527+0000","last_became_active":"2021-10-08T19:28:40.138726+0000","last_became_peered":"2021-10-08T19:28:40.138726+0000","last_unstale":"2021-10-08T19:34:52.986527+0000","last_undegraded":"2021-10-08T19:34:52.986527+0000","last_fullsized":"2021-10-08T19:34:52.986527+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:52.986367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:50.435552+0000","last_clean_scrub_stamp":"2021-10-08T19:34:52.986367+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011315057999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"289'18","reported_seq":427,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:50.006963+0000","last_change":"2021-10-08T19:33:19.173918+0000","last_active":"2021-10-08T19:34:50.006963+0000","last_peered":"2021-10-08T19:34:50.006963+0000","last_clean":"2021-10-08T19:34:50.006963+0000","last_became_active":"2021-10-08T19:29:40.638957+0000","last_became_peered":"2021-10-08T19:29:40.638957+0000","last_unstale":"2021-10-08T19:34:50.006963+0000","last_undegraded":"2021-10-08T19:34:50.006963+0000","last_fullsized":"2021-10-08T19:34:50.006963+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'18","last_scrub_stamp":"2021-10-08T19:33:19.173830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:33:19.173830+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014315273999999999,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":25,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"61'2","reported_seq":329,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:50.010149+0000","last_change":"2021-10-08T19:32:50.319062+0000","last_active":"2021-10-08T19:34:50.010149+0000","last_peered":"2021-10-08T19:34:50.010149+0000","last_clean":"2021-10-08T19:34:50.010149+0000","last_became_active":"2021-10-08T19:21:23.603614+0000","last_became_peered":"2021-10-08T19:21:23.603614+0000","last_unstale":"2021-10-08T19:34:50.010149+0000","last_undegraded":"2021-10-08T19:34:50.010149+0000","last_fullsized":"2021-10-08T19:34:50.010149+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'2","last_scrub_stamp":"2021-10-08T19:32:50.318952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:50.318952+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0102337,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":127,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.988008+0000","last_change":"2021-10-08T19:31:29.506433+0000","last_active":"2021-10-08T19:34:49.988008+0000","last_peered":"2021-10-08T19:34:49.988008+0000","last_clean":"2021-10-08T19:34:49.988008+0000","last_became_active":"2021-10-08T19:29:40.645211+0000","last_became_peered":"2021-10-08T19:29:40.645211+0000","last_unstale":"2021-10-08T19:34:49.988008+0000","last_undegraded":"2021-10-08T19:34:49.988008+0000","last_fullsized":"2021-10-08T19:34:49.988008+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:29.506331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:31:29.506331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.042894232999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":255,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.991181+0000","last_change":"2021-10-08T19:34:44.848499+0000","last_active":"2021-10-08T19:34:49.991181+0000","last_peered":"2021-10-08T19:34:49.991181+0000","last_clean":"2021-10-08T19:34:49.991181+0000","last_became_active":"2021-10-08T19:28:40.100770+0000","last_became_peered":"2021-10-08T19:28:40.100770+0000","last_unstale":"2021-10-08T19:34:49.991181+0000","last_undegraded":"2021-10-08T19:34:49.991181+0000","last_fullsized":"2021-10-08T19:34:49.991181+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:44.848412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:44.848412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011032586,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"289'15","reported_seq":381,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:50.003776+0000","last_change":"2021-10-08T19:33:32.998429+0000","last_active":"2021-10-08T19:34:50.003776+0000","last_peered":"2021-10-08T19:34:50.003776+0000","last_clean":"2021-10-08T19:34:50.003776+0000","last_became_active":"2021-10-08T19:29:40.644354+0000","last_became_peered":"2021-10-08T19:29:40.644354+0000","last_unstale":"2021-10-08T19:34:50.003776+0000","last_undegraded":"2021-10-08T19:34:50.003776+0000","last_fullsized":"2021-10-08T19:34:50.003776+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'15","last_scrub_stamp":"2021-10-08T19:33:32.998322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:33:32.998322+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014909828999999999,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":348,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.982724+0000","last_change":"2021-10-08T19:34:11.126528+0000","last_active":"2021-10-08T19:34:49.982724+0000","last_peered":"2021-10-08T19:34:49.982724+0000","last_clean":"2021-10-08T19:34:49.982724+0000","last_became_active":"2021-10-08T19:28:40.139234+0000","last_became_peered":"2021-10-08T19:28:40.139234+0000","last_unstale":"2021-10-08T19:34:49.982724+0000","last_undegraded":"2021-10-08T19:34:49.982724+0000","last_fullsized":"2021-10-08T19:34:49.982724+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:11.126413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:11.126413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011475828,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":127,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.998906+0000","last_change":"2021-10-08T19:32:05.472718+0000","last_active":"2021-10-08T19:34:49.998906+0000","last_peered":"2021-10-08T19:34:49.998906+0000","last_clean":"2021-10-08T19:34:49.998906+0000","last_became_active":"2021-10-08T19:29:40.645111+0000","last_became_peered":"2021-10-08T19:29:40.645111+0000","last_unstale":"2021-10-08T19:34:49.998906+0000","last_undegraded":"2021-10-08T19:34:49.998906+0000","last_fullsized":"2021-10-08T19:34:49.998906+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:05.472621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:32:05.472621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0050247119999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":314,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.981919+0000","last_change":"2021-10-08T19:34:48.025833+0000","last_active":"2021-10-08T19:34:49.981919+0000","last_peered":"2021-10-08T19:34:49.981919+0000","last_clean":"2021-10-08T19:34:49.981919+0000","last_became_active":"2021-10-08T19:21:29.640674+0000","last_became_peered":"2021-10-08T19:21:29.640674+0000","last_unstale":"2021-10-08T19:34:49.981919+0000","last_undegraded":"2021-10-08T19:34:49.981919+0000","last_fullsized":"2021-10-08T19:34:49.981919+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:36.559192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:32:36.559192+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.01026267,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":241,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.990443+0000","last_change":"2021-10-08T19:32:53.182703+0000","last_active":"2021-10-08T19:34:49.990443+0000","last_peered":"2021-10-08T19:34:49.990443+0000","last_clean":"2021-10-08T19:34:49.990443+0000","last_became_active":"2021-10-08T19:25:15.501118+0000","last_became_peered":"2021-10-08T19:25:15.501118+0000","last_unstale":"2021-10-08T19:34:49.990443+0000","last_undegraded":"2021-10-08T19:34:49.990443+0000","last_fullsized":"2021-10-08T19:34:49.990443+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:53.182628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:53.182628+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0033567269999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"289'12","reported_seq":150,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.996882+0000","last_change":"2021-10-08T19:33:23.899814+0000","last_active":"2021-10-08T19:34:49.996882+0000","last_peered":"2021-10-08T19:34:49.996882+0000","last_clean":"2021-10-08T19:34:49.996882+0000","last_became_active":"2021-10-08T19:29:40.644657+0000","last_became_peered":"2021-10-08T19:29:40.644657+0000","last_unstale":"2021-10-08T19:34:49.996882+0000","last_undegraded":"2021-10-08T19:34:49.996882+0000","last_fullsized":"2021-10-08T19:34:49.996882+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'12","last_scrub_stamp":"2021-10-08T19:33:23.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:33:23.899705+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.016253179999999999,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":18,"num_read_kb":15,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":282,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.981804+0000","last_change":"2021-10-08T19:33:59.151842+0000","last_active":"2021-10-08T19:34:49.981804+0000","last_peered":"2021-10-08T19:34:49.981804+0000","last_clean":"2021-10-08T19:34:49.981804+0000","last_became_active":"2021-10-08T19:28:40.101898+0000","last_became_peered":"2021-10-08T19:28:40.101898+0000","last_unstale":"2021-10-08T19:34:49.981804+0000","last_undegraded":"2021-10-08T19:34:49.981804+0000","last_fullsized":"2021-10-08T19:34:49.981804+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:59.151732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:16.444582+0000","last_clean_scrub_stamp":"2021-10-08T19:33:59.151732+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0072227530000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":351,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.984316+0000","last_change":"2021-10-08T19:34:03.603560+0000","last_active":"2021-10-08T19:34:49.984316+0000","last_peered":"2021-10-08T19:34:49.984316+0000","last_clean":"2021-10-08T19:34:49.984316+0000","last_became_active":"2021-10-08T19:29:40.626950+0000","last_became_peered":"2021-10-08T19:29:40.626950+0000","last_unstale":"2021-10-08T19:34:49.984316+0000","last_undegraded":"2021-10-08T19:34:49.984316+0000","last_fullsized":"2021-10-08T19:34:49.984316+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:03.603487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:34:03.603487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011751039,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":332,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.989787+0000","last_change":"2021-10-08T19:32:38.147982+0000","last_active":"2021-10-08T19:34:49.989787+0000","last_peered":"2021-10-08T19:34:49.989787+0000","last_clean":"2021-10-08T19:34:49.989787+0000","last_became_active":"2021-10-08T19:24:25.099371+0000","last_became_peered":"2021-10-08T19:24:25.099371+0000","last_unstale":"2021-10-08T19:34:49.989787+0000","last_undegraded":"2021-10-08T19:34:49.989787+0000","last_fullsized":"2021-10-08T19:34:49.989787+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:38.147897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:32:38.147897+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.044536603000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"70'5","reported_seq":517,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.980387+0000","last_change":"2021-10-08T19:34:44.463372+0000","last_active":"2021-10-08T19:34:49.980387+0000","last_peered":"2021-10-08T19:34:49.980387+0000","last_clean":"2021-10-08T19:34:49.980387+0000","last_became_active":"2021-10-08T19:31:22.785193+0000","last_became_peered":"2021-10-08T19:31:22.785193+0000","last_unstale":"2021-10-08T19:34:49.980387+0000","last_undegraded":"2021-10-08T19:34:49.980387+0000","last_fullsized":"2021-10-08T19:34:49.980387+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":5,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:34:44.463258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:44.463258+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0069818839999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"289'20","reported_seq":198,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.989686+0000","last_change":"2021-10-08T19:32:38.773549+0000","last_active":"2021-10-08T19:34:49.989686+0000","last_peered":"2021-10-08T19:34:49.989686+0000","last_clean":"2021-10-08T19:34:49.989686+0000","last_became_active":"2021-10-08T19:31:51.677055+0000","last_became_peered":"2021-10-08T19:31:51.677055+0000","last_unstale":"2021-10-08T19:34:49.989686+0000","last_undegraded":"2021-10-08T19:34:49.989686+0000","last_fullsized":"2021-10-08T19:34:49.989686+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'20","last_scrub_stamp":"2021-10-08T19:32:38.773440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:32:38.773440+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0043484539999999999,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":331,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.984548+0000","last_change":"2021-10-08T19:31:30.802257+0000","last_active":"2021-10-08T19:34:49.984548+0000","last_peered":"2021-10-08T19:34:49.984548+0000","last_clean":"2021-10-08T19:34:49.984548+0000","last_became_active":"2021-10-08T19:29:40.631331+0000","last_became_peered":"2021-10-08T19:29:40.631331+0000","last_unstale":"2021-10-08T19:34:49.984548+0000","last_undegraded":"2021-10-08T19:34:49.984548+0000","last_fullsized":"2021-10-08T19:34:49.984548+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:30.802102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:31:30.802102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0025761069999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"328'11","reported_seq":513,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:51.890725+0000","last_change":"2021-10-08T19:33:32.545949+0000","last_active":"2021-10-08T19:34:51.890725+0000","last_peered":"2021-10-08T19:34:51.890725+0000","last_clean":"2021-10-08T19:34:51.890725+0000","last_became_active":"2021-10-08T19:28:40.138031+0000","last_became_peered":"2021-10-08T19:28:40.138031+0000","last_unstale":"2021-10-08T19:34:51.890725+0000","last_undegraded":"2021-10-08T19:34:51.890725+0000","last_fullsized":"2021-10-08T19:34:51.890725+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"328'11","last_scrub_stamp":"2021-10-08T19:33:32.545870+0000","last_deep_scrub":"328'11","last_deep_scrub_stamp":"2021-10-08T19:33:32.545870+0000","last_clean_scrub_stamp":"2021-10-08T19:33:32.545870+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.023323448,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":328,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:50.003594+0000","last_change":"2021-10-08T19:33:29.076679+0000","last_active":"2021-10-08T19:34:50.003594+0000","last_peered":"2021-10-08T19:34:50.003594+0000","last_clean":"2021-10-08T19:34:50.003594+0000","last_became_active":"2021-10-08T19:29:40.644819+0000","last_became_peered":"2021-10-08T19:29:40.644819+0000","last_unstale":"2021-10-08T19:34:50.003594+0000","last_undegraded":"2021-10-08T19:34:50.003594+0000","last_fullsized":"2021-10-08T19:34:50.003594+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:29.076571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:33:29.076571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.046814043999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":237,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.989643+0000","last_change":"2021-10-08T19:32:08.300983+0000","last_active":"2021-10-08T19:34:49.989643+0000","last_peered":"2021-10-08T19:34:49.989643+0000","last_clean":"2021-10-08T19:34:49.989643+0000","last_became_active":"2021-10-08T19:25:15.498770+0000","last_became_peered":"2021-10-08T19:25:15.498770+0000","last_unstale":"2021-10-08T19:34:49.989643+0000","last_undegraded":"2021-10-08T19:34:49.989643+0000","last_fullsized":"2021-10-08T19:34:49.989643+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:08.300907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:08.300907+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.00342115,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"289'15","reported_seq":99,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.983703+0000","last_change":"2021-10-08T19:33:30.506573+0000","last_active":"2021-10-08T19:34:49.983703+0000","last_peered":"2021-10-08T19:34:49.983703+0000","last_clean":"2021-10-08T19:34:49.983703+0000","last_became_active":"2021-10-08T19:31:22.786860+0000","last_became_peered":"2021-10-08T19:31:22.786860+0000","last_unstale":"2021-10-08T19:34:49.983703+0000","last_undegraded":"2021-10-08T19:34:49.983703+0000","last_fullsized":"2021-10-08T19:34:49.983703+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'15","last_scrub_stamp":"2021-10-08T19:33:30.506458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:33:30.506458+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010013156,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":342,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:50.007674+0000","last_change":"2021-10-08T19:33:32.035734+0000","last_active":"2021-10-08T19:34:50.007674+0000","last_peered":"2021-10-08T19:34:50.007674+0000","last_clean":"2021-10-08T19:34:50.007674+0000","last_became_active":"2021-10-08T19:29:44.439397+0000","last_became_peered":"2021-10-08T19:29:44.439397+0000","last_unstale":"2021-10-08T19:34:50.007674+0000","last_undegraded":"2021-10-08T19:34:50.007674+0000","last_fullsized":"2021-10-08T19:34:50.007674+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:32.035617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:33:32.035617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.016251978,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"238'10","reported_seq":200,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:51.892368+0000","last_change":"2021-10-08T19:34:14.090645+0000","last_active":"2021-10-08T19:34:51.892368+0000","last_peered":"2021-10-08T19:34:51.892368+0000","last_clean":"2021-10-08T19:34:51.892368+0000","last_became_active":"2021-10-08T19:29:40.637650+0000","last_became_peered":"2021-10-08T19:29:40.637650+0000","last_unstale":"2021-10-08T19:34:51.892368+0000","last_undegraded":"2021-10-08T19:34:51.892368+0000","last_fullsized":"2021-10-08T19:34:51.892368+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"238'10","last_scrub_stamp":"2021-10-08T19:34:14.090547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:34:14.090547+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.017481770000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":307,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:50.010265+0000","last_change":"2021-10-08T19:33:16.237668+0000","last_active":"2021-10-08T19:34:50.010265+0000","last_peered":"2021-10-08T19:34:50.010265+0000","last_clean":"2021-10-08T19:34:50.010265+0000","last_became_active":"2021-10-08T19:21:29.640302+0000","last_became_peered":"2021-10-08T19:21:29.640302+0000","last_unstale":"2021-10-08T19:34:50.010265+0000","last_undegraded":"2021-10-08T19:34:50.010265+0000","last_fullsized":"2021-10-08T19:34:50.010265+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:16.237548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:33:16.237548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.060114668000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":255,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:51.965102+0000","last_change":"2021-10-08T19:34:51.964960+0000","last_active":"2021-10-08T19:34:51.965102+0000","last_peered":"2021-10-08T19:34:51.965102+0000","last_clean":"2021-10-08T19:34:51.965102+0000","last_became_active":"2021-10-08T19:29:40.631374+0000","last_became_peered":"2021-10-08T19:29:40.631374+0000","last_unstale":"2021-10-08T19:34:51.965102+0000","last_undegraded":"2021-10-08T19:34:51.965102+0000","last_fullsized":"2021-10-08T19:34:51.965102+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:51.964844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:51.964844+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010245107,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":253,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.989708+0000","last_change":"2021-10-08T19:32:40.137708+0000","last_active":"2021-10-08T19:34:49.989708+0000","last_peered":"2021-10-08T19:34:49.989708+0000","last_clean":"2021-10-08T19:34:49.989708+0000","last_became_active":"2021-10-08T19:29:40.652966+0000","last_became_peered":"2021-10-08T19:29:40.652966+0000","last_unstale":"2021-10-08T19:34:49.989708+0000","last_undegraded":"2021-10-08T19:34:49.989708+0000","last_fullsized":"2021-10-08T19:34:49.989708+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:40.137613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:40.137613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0079745670000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"289'19","reported_seq":78,"reported_epoch":348,"state":"active+clean","last_fresh":"2021-10-08T19:34:53.739992+0000","last_change":"2021-10-08T19:34:53.739955+0000","last_active":"2021-10-08T19:34:53.739992+0000","last_peered":"2021-10-08T19:34:53.739992+0000","last_clean":"2021-10-08T19:34:53.739992+0000","last_became_active":"2021-10-08T19:31:51.676961+0000","last_became_peered":"2021-10-08T19:31:51.676961+0000","last_unstale":"2021-10-08T19:34:53.739992+0000","last_undegraded":"2021-10-08T19:34:53.739992+0000","last_fullsized":"2021-10-08T19:34:53.739992+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:34:53.739851+0000","last_deep_scrub":"289'19","last_deep_scrub_stamp":"2021-10-08T19:32:46.539792+0000","last_clean_scrub_stamp":"2021-10-08T19:34:53.739851+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.018714432,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":304,"reported_epoch":348,"state":"active+clean","last_fresh":"2021-10-08T19:34:52.557902+0000","last_change":"2021-10-08T19:34:52.557866+0000","last_active":"2021-10-08T19:34:52.557902+0000","last_peered":"2021-10-08T19:34:52.557902+0000","last_clean":"2021-10-08T19:34:52.557902+0000","last_became_active":"2021-10-08T19:31:22.786651+0000","last_became_peered":"2021-10-08T19:31:22.786651+0000","last_unstale":"2021-10-08T19:34:52.557902+0000","last_undegraded":"2021-10-08T19:34:52.557902+0000","last_fullsized":"2021-10-08T19:34:52.557902+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:52.557763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:52.557763+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.01007186,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":135,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.987957+0000","last_change":"2021-10-08T19:34:44.147010+0000","last_active":"2021-10-08T19:34:49.987957+0000","last_peered":"2021-10-08T19:34:49.987957+0000","last_clean":"2021-10-08T19:34:49.987957+0000","last_became_active":"2021-10-08T19:29:40.644770+0000","last_became_peered":"2021-10-08T19:29:40.644770+0000","last_unstale":"2021-10-08T19:34:49.987957+0000","last_undegraded":"2021-10-08T19:34:49.987957+0000","last_fullsized":"2021-10-08T19:34:49.987957+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:44.146892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:34:44.146892+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0086783989999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":330,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:50.004204+0000","last_change":"2021-10-08T19:33:22.113737+0000","last_active":"2021-10-08T19:34:50.004204+0000","last_peered":"2021-10-08T19:34:50.004204+0000","last_clean":"2021-10-08T19:34:50.004204+0000","last_became_active":"2021-10-08T19:28:40.133744+0000","last_became_peered":"2021-10-08T19:28:40.133744+0000","last_unstale":"2021-10-08T19:34:50.004204+0000","last_undegraded":"2021-10-08T19:34:50.004204+0000","last_fullsized":"2021-10-08T19:34:50.004204+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:22.113636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:33:22.113636+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.042931799,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"289'19","reported_seq":467,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:50.007734+0000","last_change":"2021-10-08T19:34:11.033790+0000","last_active":"2021-10-08T19:34:50.007734+0000","last_peered":"2021-10-08T19:34:50.007734+0000","last_clean":"2021-10-08T19:34:50.007734+0000","last_became_active":"2021-10-08T19:28:40.100196+0000","last_became_peered":"2021-10-08T19:28:40.100196+0000","last_unstale":"2021-10-08T19:34:50.007734+0000","last_undegraded":"2021-10-08T19:34:50.007734+0000","last_fullsized":"2021-10-08T19:34:50.007734+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:34:11.033685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:34:11.033685+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0073615640000000001,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":168,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:50.000785+0000","last_change":"2021-10-08T19:33:29.463878+0000","last_active":"2021-10-08T19:34:50.000785+0000","last_peered":"2021-10-08T19:34:50.000785+0000","last_clean":"2021-10-08T19:34:50.000785+0000","last_became_active":"2021-10-08T19:28:40.146673+0000","last_became_peered":"2021-10-08T19:28:40.146673+0000","last_unstale":"2021-10-08T19:34:50.000785+0000","last_undegraded":"2021-10-08T19:34:50.000785+0000","last_fullsized":"2021-10-08T19:34:50.000785+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:29.463767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:33:29.463767+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.020329192999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":178,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.998495+0000","last_change":"2021-10-08T19:32:38.465030+0000","last_active":"2021-10-08T19:34:49.998495+0000","last_peered":"2021-10-08T19:34:49.998495+0000","last_clean":"2021-10-08T19:34:49.998495+0000","last_became_active":"2021-10-08T19:29:40.638536+0000","last_became_peered":"2021-10-08T19:29:40.638536+0000","last_unstale":"2021-10-08T19:34:49.998495+0000","last_undegraded":"2021-10-08T19:34:49.998495+0000","last_fullsized":"2021-10-08T19:34:49.998495+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:38.464962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:43.186684+0000","last_clean_scrub_stamp":"2021-10-08T19:32:38.464962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0013247059999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":127,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.988511+0000","last_change":"2021-10-08T19:32:15.476992+0000","last_active":"2021-10-08T19:34:49.988511+0000","last_peered":"2021-10-08T19:34:49.988511+0000","last_clean":"2021-10-08T19:34:49.988511+0000","last_became_active":"2021-10-08T19:29:40.634300+0000","last_became_peered":"2021-10-08T19:29:40.634300+0000","last_unstale":"2021-10-08T19:34:49.988511+0000","last_undegraded":"2021-10-08T19:34:49.988511+0000","last_fullsized":"2021-10-08T19:34:49.988511+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:15.476868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:32:15.476868+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.021548916000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"70'5","reported_seq":237,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:50.007769+0000","last_change":"2021-10-08T19:34:03.061411+0000","last_active":"2021-10-08T19:34:50.007769+0000","last_peered":"2021-10-08T19:34:50.007769+0000","last_clean":"2021-10-08T19:34:50.007769+0000","last_became_active":"2021-10-08T19:25:15.496309+0000","last_became_peered":"2021-10-08T19:25:15.496309+0000","last_unstale":"2021-10-08T19:34:50.007769+0000","last_undegraded":"2021-10-08T19:34:50.007769+0000","last_fullsized":"2021-10-08T19:34:50.007769+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:34:03.061301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:03.061301+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0077145800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.10","version":"289'8","reported_seq":156,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.996517+0000","last_change":"2021-10-08T19:32:45.349635+0000","last_active":"2021-10-08T19:34:49.996517+0000","last_peered":"2021-10-08T19:34:49.996517+0000","last_clean":"2021-10-08T19:34:49.996517+0000","last_became_active":"2021-10-08T19:32:45.165103+0000","last_became_peered":"2021-10-08T19:32:45.165103+0000","last_unstale":"2021-10-08T19:34:49.996517+0000","last_undegraded":"2021-10-08T19:34:49.996517+0000","last_fullsized":"2021-10-08T19:34:49.996517+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'8","last_scrub_stamp":"2021-10-08T19:32:34.689691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:32:34.689691+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0041717799999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":331,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.984430+0000","last_change":"2021-10-08T19:31:27.832981+0000","last_active":"2021-10-08T19:34:49.984430+0000","last_peered":"2021-10-08T19:34:49.984430+0000","last_clean":"2021-10-08T19:34:49.984430+0000","last_became_active":"2021-10-08T19:24:25.094384+0000","last_became_peered":"2021-10-08T19:24:25.094384+0000","last_unstale":"2021-10-08T19:34:49.984430+0000","last_undegraded":"2021-10-08T19:34:49.984430+0000","last_fullsized":"2021-10-08T19:34:49.984430+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:27.832886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:13.716331+0000","last_clean_scrub_stamp":"2021-10-08T19:31:27.832886+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034204959999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":271,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.981795+0000","last_change":"2021-10-08T19:34:18.377860+0000","last_active":"2021-10-08T19:34:49.981795+0000","last_peered":"2021-10-08T19:34:49.981795+0000","last_clean":"2021-10-08T19:34:49.981795+0000","last_became_active":"2021-10-08T19:24:25.106186+0000","last_became_peered":"2021-10-08T19:24:25.106186+0000","last_unstale":"2021-10-08T19:34:49.981795+0000","last_undegraded":"2021-10-08T19:34:49.981795+0000","last_fullsized":"2021-10-08T19:34:49.981795+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:18.377739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:18.377739+0000","last_clean_scrub_stamp":"2021-10-08T19:34:18.377739+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0082105919999999992,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":316,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.991170+0000","last_change":"2021-10-08T19:33:18.992912+0000","last_active":"2021-10-08T19:34:49.991170+0000","last_peered":"2021-10-08T19:34:49.991170+0000","last_clean":"2021-10-08T19:34:49.991170+0000","last_became_active":"2021-10-08T19:21:29.642835+0000","last_became_peered":"2021-10-08T19:21:29.642835+0000","last_unstale":"2021-10-08T19:34:49.991170+0000","last_undegraded":"2021-10-08T19:34:49.991170+0000","last_fullsized":"2021-10-08T19:34:49.991170+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:18.992806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:33:18.992806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0058345690000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":249,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.984257+0000","last_change":"2021-10-08T19:32:05.845506+0000","last_active":"2021-10-08T19:34:49.984257+0000","last_peered":"2021-10-08T19:34:49.984257+0000","last_clean":"2021-10-08T19:34:49.984257+0000","last_became_active":"2021-10-08T19:28:40.099215+0000","last_became_peered":"2021-10-08T19:28:40.099215+0000","last_unstale":"2021-10-08T19:34:49.984257+0000","last_undegraded":"2021-10-08T19:34:49.984257+0000","last_fullsized":"2021-10-08T19:34:49.984257+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:05.845412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:05.845412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.00772998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"348'24","reported_seq":162,"reported_epoch":348,"state":"active+clean","last_fresh":"2021-10-08T19:34:53.274385+0000","last_change":"2021-10-08T19:34:53.274347+0000","last_active":"2021-10-08T19:34:53.274385+0000","last_peered":"2021-10-08T19:34:53.274385+0000","last_clean":"2021-10-08T19:34:53.274385+0000","last_became_active":"2021-10-08T19:29:40.640914+0000","last_became_peered":"2021-10-08T19:29:40.640914+0000","last_unstale":"2021-10-08T19:34:53.274385+0000","last_undegraded":"2021-10-08T19:34:53.274385+0000","last_fullsized":"2021-10-08T19:34:53.274385+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"348'24","last_scrub_stamp":"2021-10-08T19:34:53.274250+0000","last_deep_scrub":"348'24","last_deep_scrub_stamp":"2021-10-08T19:34:53.274250+0000","last_clean_scrub_stamp":"2021-10-08T19:34:53.274250+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.018882408,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":262,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.981838+0000","last_change":"2021-10-08T19:33:14.901012+0000","last_active":"2021-10-08T19:34:49.981838+0000","last_peered":"2021-10-08T19:34:49.981838+0000","last_clean":"2021-10-08T19:34:49.981838+0000","last_became_active":"2021-10-08T19:24:25.098128+0000","last_became_peered":"2021-10-08T19:24:25.098128+0000","last_unstale":"2021-10-08T19:34:49.981838+0000","last_undegraded":"2021-10-08T19:34:49.981838+0000","last_fullsized":"2021-10-08T19:34:49.981838+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:14.900916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:34.508558+0000","last_clean_scrub_stamp":"2021-10-08T19:33:14.900916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0050012340000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":328,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.989453+0000","last_change":"2021-10-08T19:32:35.080957+0000","last_active":"2021-10-08T19:34:49.989453+0000","last_peered":"2021-10-08T19:34:49.989453+0000","last_clean":"2021-10-08T19:34:49.989453+0000","last_became_active":"2021-10-08T19:24:25.095490+0000","last_became_peered":"2021-10-08T19:24:25.095490+0000","last_unstale":"2021-10-08T19:34:49.989453+0000","last_undegraded":"2021-10-08T19:34:49.989453+0000","last_fullsized":"2021-10-08T19:34:49.989453+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:35.080865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:11.383779+0000","last_clean_scrub_stamp":"2021-10-08T19:32:35.080865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.01018439,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":133,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.988728+0000","last_change":"2021-10-08T19:33:31.003550+0000","last_active":"2021-10-08T19:34:49.988728+0000","last_peered":"2021-10-08T19:34:49.988728+0000","last_clean":"2021-10-08T19:34:49.988728+0000","last_became_active":"2021-10-08T19:29:40.639358+0000","last_became_peered":"2021-10-08T19:29:40.639358+0000","last_unstale":"2021-10-08T19:34:49.988728+0000","last_undegraded":"2021-10-08T19:34:49.988728+0000","last_fullsized":"2021-10-08T19:34:49.988728+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:31.003458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:33:31.003458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.053588330000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"289'20","reported_seq":392,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:50.003980+0000","last_change":"2021-10-08T19:34:12.001980+0000","last_active":"2021-10-08T19:34:50.003980+0000","last_peered":"2021-10-08T19:34:50.003980+0000","last_clean":"2021-10-08T19:34:50.003980+0000","last_became_active":"2021-10-08T19:29:40.636448+0000","last_became_peered":"2021-10-08T19:29:40.636448+0000","last_unstale":"2021-10-08T19:34:50.003980+0000","last_undegraded":"2021-10-08T19:34:50.003980+0000","last_fullsized":"2021-10-08T19:34:50.003980+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'20","last_scrub_stamp":"2021-10-08T19:34:12.001875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:34:12.001875+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0097733339999999998,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":313,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.983440+0000","last_change":"2021-10-08T19:32:44.776643+0000","last_active":"2021-10-08T19:34:49.983440+0000","last_peered":"2021-10-08T19:34:49.983440+0000","last_clean":"2021-10-08T19:34:49.983440+0000","last_became_active":"2021-10-08T19:21:23.604530+0000","last_became_peered":"2021-10-08T19:21:23.604530+0000","last_unstale":"2021-10-08T19:34:49.983440+0000","last_undegraded":"2021-10-08T19:34:49.983440+0000","last_fullsized":"2021-10-08T19:34:49.983440+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:44.776567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:44.776567+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0068263819999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1f","version":"114'10","reported_seq":392,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:51.890697+0000","last_change":"2021-10-08T19:34:49.474966+0000","last_active":"2021-10-08T19:34:51.890697+0000","last_peered":"2021-10-08T19:34:51.890697+0000","last_clean":"2021-10-08T19:34:51.890697+0000","last_became_active":"2021-10-08T19:24:25.105742+0000","last_became_peered":"2021-10-08T19:24:25.105742+0000","last_unstale":"2021-10-08T19:34:51.890697+0000","last_undegraded":"2021-10-08T19:34:51.890697+0000","last_fullsized":"2021-10-08T19:34:51.890697+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'10","last_scrub_stamp":"2021-10-08T19:34:49.474891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:34:49.474891+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0022257399999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"69'1","reported_seq":315,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:51.901281+0000","last_change":"2021-10-08T19:34:51.899798+0000","last_active":"2021-10-08T19:34:51.901281+0000","last_peered":"2021-10-08T19:34:51.901281+0000","last_clean":"2021-10-08T19:34:51.901281+0000","last_became_active":"2021-10-08T19:21:29.640296+0000","last_became_peered":"2021-10-08T19:21:29.640296+0000","last_unstale":"2021-10-08T19:34:51.901281+0000","last_undegraded":"2021-10-08T19:34:51.901281+0000","last_fullsized":"2021-10-08T19:34:51.901281+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2021-10-08T19:34:51.899691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:34:51.899691+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012893907,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"289'19","reported_seq":328,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.981939+0000","last_change":"2021-10-08T19:33:19.899016+0000","last_active":"2021-10-08T19:34:49.981939+0000","last_peered":"2021-10-08T19:34:49.981939+0000","last_clean":"2021-10-08T19:34:49.981939+0000","last_became_active":"2021-10-08T19:28:40.126425+0000","last_became_peered":"2021-10-08T19:28:40.126425+0000","last_unstale":"2021-10-08T19:34:49.981939+0000","last_undegraded":"2021-10-08T19:34:49.981939+0000","last_fullsized":"2021-10-08T19:34:49.981939+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:33:19.898917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:33:19.898917+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0085652420000000007,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":133,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.988218+0000","last_change":"2021-10-08T19:34:13.102972+0000","last_active":"2021-10-08T19:34:49.988218+0000","last_peered":"2021-10-08T19:34:49.988218+0000","last_clean":"2021-10-08T19:34:49.988218+0000","last_became_active":"2021-10-08T19:29:40.640952+0000","last_became_peered":"2021-10-08T19:29:40.640952+0000","last_unstale":"2021-10-08T19:34:49.988218+0000","last_undegraded":"2021-10-08T19:34:49.988218+0000","last_fullsized":"2021-10-08T19:34:49.988218+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:13.102869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:13.102869+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0080406309999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":316,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:50.004054+0000","last_change":"2021-10-08T19:33:19.099040+0000","last_active":"2021-10-08T19:34:50.004054+0000","last_peered":"2021-10-08T19:34:50.004054+0000","last_clean":"2021-10-08T19:34:50.004054+0000","last_became_active":"2021-10-08T19:21:27.632648+0000","last_became_peered":"2021-10-08T19:21:27.632648+0000","last_unstale":"2021-10-08T19:34:50.004054+0000","last_undegraded":"2021-10-08T19:34:50.004054+0000","last_fullsized":"2021-10-08T19:34:50.004054+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:19.098920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:33:19.098920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002952966,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"69'1","reported_seq":164,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:50.000886+0000","last_change":"2021-10-08T19:32:43.588347+0000","last_active":"2021-10-08T19:34:50.000886+0000","last_peered":"2021-10-08T19:34:50.000886+0000","last_clean":"2021-10-08T19:34:50.000886+0000","last_became_active":"2021-10-08T19:28:40.146302+0000","last_became_peered":"2021-10-08T19:28:40.146302+0000","last_unstale":"2021-10-08T19:34:50.000886+0000","last_undegraded":"2021-10-08T19:34:50.000886+0000","last_fullsized":"2021-10-08T19:34:50.000886+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2021-10-08T19:32:43.588271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:32:43.588271+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.074694546000000001,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"289'27","reported_seq":492,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:51.018695+0000","last_change":"2021-10-08T19:34:51.018306+0000","last_active":"2021-10-08T19:34:51.018695+0000","last_peered":"2021-10-08T19:34:51.018695+0000","last_clean":"2021-10-08T19:34:51.018695+0000","last_became_active":"2021-10-08T19:29:40.629461+0000","last_became_peered":"2021-10-08T19:29:40.629461+0000","last_unstale":"2021-10-08T19:34:51.018695+0000","last_undegraded":"2021-10-08T19:34:51.018695+0000","last_fullsized":"2021-10-08T19:34:51.018695+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'27","last_scrub_stamp":"2021-10-08T19:34:51.018186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:34:51.018186+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.031219910999999999,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":550,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":270,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.981082+0000","last_change":"2021-10-08T19:34:22.343729+0000","last_active":"2021-10-08T19:34:49.981082+0000","last_peered":"2021-10-08T19:34:49.981082+0000","last_clean":"2021-10-08T19:34:49.981082+0000","last_became_active":"2021-10-08T19:24:25.106119+0000","last_became_peered":"2021-10-08T19:24:25.106119+0000","last_unstale":"2021-10-08T19:34:49.981082+0000","last_undegraded":"2021-10-08T19:34:49.981082+0000","last_fullsized":"2021-10-08T19:34:49.981082+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:22.343621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:46.422866+0000","last_clean_scrub_stamp":"2021-10-08T19:34:22.343621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0027685370000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":166,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:50.000973+0000","last_change":"2021-10-08T19:34:45.792403+0000","last_active":"2021-10-08T19:34:50.000973+0000","last_peered":"2021-10-08T19:34:50.000973+0000","last_clean":"2021-10-08T19:34:50.000973+0000","last_became_active":"2021-10-08T19:28:40.148009+0000","last_became_peered":"2021-10-08T19:28:40.148009+0000","last_unstale":"2021-10-08T19:34:50.000973+0000","last_undegraded":"2021-10-08T19:34:50.000973+0000","last_fullsized":"2021-10-08T19:34:50.000973+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:45.792309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:34:45.792309+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0077010439999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":325,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:50.008899+0000","last_change":"2021-10-08T19:32:40.398092+0000","last_active":"2021-10-08T19:34:50.008899+0000","last_peered":"2021-10-08T19:34:50.008899+0000","last_clean":"2021-10-08T19:34:50.008899+0000","last_became_active":"2021-10-08T19:24:25.097782+0000","last_became_peered":"2021-10-08T19:24:25.097782+0000","last_unstale":"2021-10-08T19:34:50.008899+0000","last_undegraded":"2021-10-08T19:34:50.008899+0000","last_fullsized":"2021-10-08T19:34:50.008899+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:40.397976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:37.219503+0000","last_clean_scrub_stamp":"2021-10-08T19:32:40.397976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039828600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"289'18","reported_seq":154,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.991317+0000","last_change":"2021-10-08T19:33:26.859021+0000","last_active":"2021-10-08T19:34:49.991317+0000","last_peered":"2021-10-08T19:34:49.991317+0000","last_clean":"2021-10-08T19:34:49.991317+0000","last_became_active":"2021-10-08T19:29:40.645144+0000","last_became_peered":"2021-10-08T19:29:40.645144+0000","last_unstale":"2021-10-08T19:34:49.991317+0000","last_undegraded":"2021-10-08T19:34:49.991317+0000","last_fullsized":"2021-10-08T19:34:49.991317+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'18","last_scrub_stamp":"2021-10-08T19:33:26.858913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:33:26.858913+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012581844999999999,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":25,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":127,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.988052+0000","last_change":"2021-10-08T19:32:13.456918+0000","last_active":"2021-10-08T19:34:49.988052+0000","last_peered":"2021-10-08T19:34:49.988052+0000","last_clean":"2021-10-08T19:34:49.988052+0000","last_became_active":"2021-10-08T19:29:44.443807+0000","last_became_peered":"2021-10-08T19:29:44.443807+0000","last_unstale":"2021-10-08T19:34:49.988052+0000","last_undegraded":"2021-10-08T19:34:49.988052+0000","last_fullsized":"2021-10-08T19:34:49.988052+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:13.456818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:32:13.456818+0000","last_clean_scrub_stamp":"2021-10-08T19:32:13.456818+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013599351000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":327,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:50.007518+0000","last_change":"2021-10-08T19:31:59.409211+0000","last_active":"2021-10-08T19:34:50.007518+0000","last_peered":"2021-10-08T19:34:50.007518+0000","last_clean":"2021-10-08T19:34:50.007518+0000","last_became_active":"2021-10-08T19:29:40.638352+0000","last_became_peered":"2021-10-08T19:29:40.638352+0000","last_unstale":"2021-10-08T19:34:50.007518+0000","last_undegraded":"2021-10-08T19:34:50.007518+0000","last_fullsized":"2021-10-08T19:34:50.007518+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:59.409131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:31:59.409131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0098736889999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":145,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.999032+0000","last_change":"2021-10-08T19:32:12.549448+0000","last_active":"2021-10-08T19:34:49.999032+0000","last_peered":"2021-10-08T19:34:49.999032+0000","last_clean":"2021-10-08T19:34:49.999032+0000","last_became_active":"2021-10-08T19:31:22.788455+0000","last_became_peered":"2021-10-08T19:31:22.788455+0000","last_unstale":"2021-10-08T19:34:49.999032+0000","last_undegraded":"2021-10-08T19:34:49.999032+0000","last_fullsized":"2021-10-08T19:34:49.999032+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:12.549351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:32:12.549351+0000","last_clean_scrub_stamp":"2021-10-08T19:32:12.549351+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.087121061999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"289'15","reported_seq":376,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:50.007169+0000","last_change":"2021-10-08T19:34:09.072669+0000","last_active":"2021-10-08T19:34:50.007169+0000","last_peered":"2021-10-08T19:34:50.007169+0000","last_clean":"2021-10-08T19:34:50.007169+0000","last_became_active":"2021-10-08T19:29:40.631689+0000","last_became_peered":"2021-10-08T19:29:40.631689+0000","last_unstale":"2021-10-08T19:34:50.007169+0000","last_undegraded":"2021-10-08T19:34:50.007169+0000","last_fullsized":"2021-10-08T19:34:50.007169+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'15","last_scrub_stamp":"2021-10-08T19:34:09.072548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:34:09.072548+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.01071632,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":324,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.989818+0000","last_change":"2021-10-08T19:34:15.628608+0000","last_active":"2021-10-08T19:34:49.989818+0000","last_peered":"2021-10-08T19:34:49.989818+0000","last_clean":"2021-10-08T19:34:49.989818+0000","last_became_active":"2021-10-08T19:21:23.607785+0000","last_became_peered":"2021-10-08T19:21:23.607785+0000","last_unstale":"2021-10-08T19:34:49.989818+0000","last_undegraded":"2021-10-08T19:34:49.989818+0000","last_fullsized":"2021-10-08T19:34:49.989818+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:15.628516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:15.628516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0075668530000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":309,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.983641+0000","last_change":"2021-10-08T19:32:11.832450+0000","last_active":"2021-10-08T19:34:49.983641+0000","last_peered":"2021-10-08T19:34:49.983641+0000","last_clean":"2021-10-08T19:34:49.983641+0000","last_became_active":"2021-10-08T19:21:27.633979+0000","last_became_peered":"2021-10-08T19:21:27.633979+0000","last_unstale":"2021-10-08T19:34:49.983641+0000","last_undegraded":"2021-10-08T19:34:49.983641+0000","last_fullsized":"2021-10-08T19:34:49.983641+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:11.832343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:05.799361+0000","last_clean_scrub_stamp":"2021-10-08T19:32:11.832343+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0049579899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":336,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:50.034683+0000","last_change":"2021-10-08T19:34:50.034539+0000","last_active":"2021-10-08T19:34:50.034683+0000","last_peered":"2021-10-08T19:34:50.034683+0000","last_clean":"2021-10-08T19:34:50.034683+0000","last_became_active":"2021-10-08T19:28:40.159162+0000","last_became_peered":"2021-10-08T19:28:40.159162+0000","last_unstale":"2021-10-08T19:34:50.034683+0000","last_undegraded":"2021-10-08T19:34:50.034683+0000","last_fullsized":"2021-10-08T19:34:50.034683+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:50.034064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:34:50.034064+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.029837211999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"289'7","reported_seq":407,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:50.007928+0000","last_change":"2021-10-08T19:34:14.978409+0000","last_active":"2021-10-08T19:34:50.007928+0000","last_peered":"2021-10-08T19:34:50.007928+0000","last_clean":"2021-10-08T19:34:50.007928+0000","last_became_active":"2021-10-08T19:31:51.675189+0000","last_became_peered":"2021-10-08T19:31:51.675189+0000","last_unstale":"2021-10-08T19:34:50.007928+0000","last_undegraded":"2021-10-08T19:34:50.007928+0000","last_fullsized":"2021-10-08T19:34:50.007928+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'7","last_scrub_stamp":"2021-10-08T19:34:14.978294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:34:14.978294+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.015468765000000001,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":10,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":340,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.989946+0000","last_change":"2021-10-08T19:32:46.108417+0000","last_active":"2021-10-08T19:34:49.989946+0000","last_peered":"2021-10-08T19:34:49.989946+0000","last_clean":"2021-10-08T19:34:49.989946+0000","last_became_active":"2021-10-08T19:24:25.096225+0000","last_became_peered":"2021-10-08T19:24:25.096225+0000","last_unstale":"2021-10-08T19:34:49.989946+0000","last_undegraded":"2021-10-08T19:34:49.989946+0000","last_fullsized":"2021-10-08T19:34:49.989946+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:46.108322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:29:40.244757+0000","last_clean_scrub_stamp":"2021-10-08T19:32:46.108322+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002015986,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":338,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.990964+0000","last_change":"2021-10-08T19:34:11.633837+0000","last_active":"2021-10-08T19:34:49.990964+0000","last_peered":"2021-10-08T19:34:49.990964+0000","last_clean":"2021-10-08T19:34:49.990964+0000","last_became_active":"2021-10-08T19:28:40.101187+0000","last_became_peered":"2021-10-08T19:28:40.101187+0000","last_unstale":"2021-10-08T19:34:49.990964+0000","last_undegraded":"2021-10-08T19:34:49.990964+0000","last_fullsized":"2021-10-08T19:34:49.990964+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:11.633739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:11.633739+0000","last_clean_scrub_stamp":"2021-10-08T19:34:11.633739+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0065073010000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":343,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.983392+0000","last_change":"2021-10-08T19:32:48.773228+0000","last_active":"2021-10-08T19:34:49.983392+0000","last_peered":"2021-10-08T19:34:49.983392+0000","last_clean":"2021-10-08T19:34:49.983392+0000","last_became_active":"2021-10-08T19:29:40.632965+0000","last_became_peered":"2021-10-08T19:29:40.632965+0000","last_unstale":"2021-10-08T19:34:49.983392+0000","last_undegraded":"2021-10-08T19:34:49.983392+0000","last_fullsized":"2021-10-08T19:34:49.983392+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:48.773123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:32:48.773123+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.031438125999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"289'19","reported_seq":456,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:50.005258+0000","last_change":"2021-10-08T19:34:46.163249+0000","last_active":"2021-10-08T19:34:50.005258+0000","last_peered":"2021-10-08T19:34:50.005258+0000","last_clean":"2021-10-08T19:34:50.005258+0000","last_became_active":"2021-10-08T19:28:40.099770+0000","last_became_peered":"2021-10-08T19:28:40.099770+0000","last_unstale":"2021-10-08T19:34:50.005258+0000","last_undegraded":"2021-10-08T19:34:50.005258+0000","last_fullsized":"2021-10-08T19:34:50.005258+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:34:46.163159+0000","last_deep_scrub":"88'13","last_deep_scrub_stamp":"2021-10-08T19:23:16.016646+0000","last_clean_scrub_stamp":"2021-10-08T19:34:46.163159+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013309632,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":133,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.991499+0000","last_change":"2021-10-08T19:34:04.124983+0000","last_active":"2021-10-08T19:34:49.991499+0000","last_peered":"2021-10-08T19:34:49.991499+0000","last_clean":"2021-10-08T19:34:49.991499+0000","last_became_active":"2021-10-08T19:29:40.627394+0000","last_became_peered":"2021-10-08T19:29:40.627394+0000","last_unstale":"2021-10-08T19:34:49.991499+0000","last_undegraded":"2021-10-08T19:34:49.991499+0000","last_fullsized":"2021-10-08T19:34:49.991499+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:04.124886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:04.124886+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0093513629999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":166,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.997441+0000","last_change":"2021-10-08T19:34:47.797510+0000","last_active":"2021-10-08T19:34:49.997441+0000","last_peered":"2021-10-08T19:34:49.997441+0000","last_clean":"2021-10-08T19:34:49.997441+0000","last_became_active":"2021-10-08T19:28:40.145868+0000","last_became_peered":"2021-10-08T19:28:40.145868+0000","last_unstale":"2021-10-08T19:34:49.997441+0000","last_undegraded":"2021-10-08T19:34:49.997441+0000","last_fullsized":"2021-10-08T19:34:49.997441+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:47.797403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:34:47.797403+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011791311000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":327,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:50.007089+0000","last_change":"2021-10-08T19:33:27.280376+0000","last_active":"2021-10-08T19:34:50.007089+0000","last_peered":"2021-10-08T19:34:50.007089+0000","last_clean":"2021-10-08T19:34:50.007089+0000","last_became_active":"2021-10-08T19:28:40.099543+0000","last_became_peered":"2021-10-08T19:28:40.099543+0000","last_unstale":"2021-10-08T19:34:50.007089+0000","last_undegraded":"2021-10-08T19:34:50.007089+0000","last_fullsized":"2021-10-08T19:34:50.007089+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:27.280257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:50.032367+0000","last_clean_scrub_stamp":"2021-10-08T19:33:27.280257+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.023013090999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"289'27","reported_seq":167,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:50.214220+0000","last_change":"2021-10-08T19:34:50.213817+0000","last_active":"2021-10-08T19:34:50.214220+0000","last_peered":"2021-10-08T19:34:50.214220+0000","last_clean":"2021-10-08T19:34:50.214220+0000","last_became_active":"2021-10-08T19:29:40.631002+0000","last_became_peered":"2021-10-08T19:29:40.631002+0000","last_unstale":"2021-10-08T19:34:50.214220+0000","last_undegraded":"2021-10-08T19:34:50.214220+0000","last_fullsized":"2021-10-08T19:34:50.214220+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'27","last_scrub_stamp":"2021-10-08T19:34:50.213690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:34:50.213690+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.016992080999999999,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":316,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:50.004316+0000","last_change":"2021-10-08T19:34:47.006927+0000","last_active":"2021-10-08T19:34:50.004316+0000","last_peered":"2021-10-08T19:34:50.004316+0000","last_clean":"2021-10-08T19:34:50.004316+0000","last_became_active":"2021-10-08T19:21:23.603422+0000","last_became_peered":"2021-10-08T19:21:23.603422+0000","last_unstale":"2021-10-08T19:34:50.004316+0000","last_undegraded":"2021-10-08T19:34:50.004316+0000","last_fullsized":"2021-10-08T19:34:50.004316+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:14.367284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:15.535842+0000","last_clean_scrub_stamp":"2021-10-08T19:32:14.367284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0022503430000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":353,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:50.005489+0000","last_change":"2021-10-08T19:34:08.021043+0000","last_active":"2021-10-08T19:34:50.005489+0000","last_peered":"2021-10-08T19:34:50.005489+0000","last_clean":"2021-10-08T19:34:50.005489+0000","last_became_active":"2021-10-08T19:28:40.099286+0000","last_became_peered":"2021-10-08T19:28:40.099286+0000","last_unstale":"2021-10-08T19:34:50.005489+0000","last_undegraded":"2021-10-08T19:34:50.005489+0000","last_fullsized":"2021-10-08T19:34:50.005489+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:08.020934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:31.176160+0000","last_clean_scrub_stamp":"2021-10-08T19:34:08.020934+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0064825229999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":127,"reported_epoch":347,"state":"active+clean","last_fresh":"2021-10-08T19:34:49.988639+0000","last_change":"2021-10-08T19:31:32.458220+0000","last_active":"2021-10-08T19:34:49.988639+0000","last_peered":"2021-10-08T19:34:49.988639+0000","last_clean":"2021-10-08T19:34:49.988639+0000","last_became_active":"2021-10-08T19:29:40.638221+0000","last_became_peered":"2021-10-08T19:29:40.638221+0000","last_unstale":"2021-10-08T19:34:49.988639+0000","last_undegraded":"2021-10-08T19:34:49.988639+0000","last_fullsized":"2021-10-08T19:34:49.988639+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:31:32.458082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:31:32.458082+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.045433947000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":266993688,"num_objects":4075,"num_object_clones":0,"num_object_copies":12225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4075,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":227303,"num_write_kb":7404033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1088,"num_bytes_recovered":71303168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":793194496,"data_stored":793182280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":69164,"ondisk_log_size":69164,"up":48,"acting":48,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":11,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1430,"ondisk_log_size":1430,"up":33,"acting":33,"num_store_stats":8},{"poolid":3,"num_pg":23,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":631,"num_read_kb":631,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1167,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":69,"acting":69,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1113,"num_read_kb":870,"num_write":703,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":520,"num_bytes_recovered":10826,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":705,"ondisk_log_size":705,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":96,"acting":96,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201446,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":416840,"kb_used_data":190592,"kb_used_omap":0,"kb_used_meta":226240,"kb_avail":93328312,"statfs":{"total":95995035648,"available":95568191488,"internally_reserved":0,"allocated":195166208,"data_stored":194778845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":231669760},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:34:32 2021","interfaces":[{"interface":"back","average":{"1min":1.734,"5min":1.6040000000000001,"15min":1.359},"min":{"1min":0.21199999999999999,"5min":0.20699999999999999,"15min":0.20100000000000001},"max":{"1min":8.8160000000000007,"5min":26.065000000000001,"15min":32.366999999999997},"last":1.9430000000000001},{"interface":"front","average":{"1min":2.476,"5min":2.1299999999999999,"15min":1.617},"min":{"1min":0.30099999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":9.4410000000000007,"5min":25.75,"15min":29.736000000000001},"last":0.83699999999999997}]},{"osd":1,"last update":"Fri Oct 8 19:34:32 2021","interfaces":[{"interface":"back","average":{"1min":1.986,"5min":2.1459999999999999,"15min":1.6339999999999999},"min":{"1min":0.22600000000000001,"5min":0.19900000000000001,"15min":0.19600000000000001},"max":{"1min":5.2080000000000002,"5min":26.044,"15min":26.044},"last":2.0619999999999998},{"interface":"front","average":{"1min":2.1280000000000001,"5min":2.1960000000000002,"15min":1.4990000000000001},"min":{"1min":0.24099999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":5.25,"5min":26.138999999999999,"15min":28.119},"last":3.9969999999999999}]},{"osd":2,"last update":"Fri Oct 8 19:34:32 2021","interfaces":[{"interface":"back","average":{"1min":2.1150000000000002,"5min":1.6639999999999999,"15min":1.526},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":5.7130000000000001,"5min":7.524,"15min":27.018000000000001},"last":0.38900000000000001},{"interface":"front","average":{"1min":2.105,"5min":1.6240000000000001,"15min":1.421},"min":{"1min":0.31,"5min":0.28199999999999997,"15min":0.27800000000000002},"max":{"1min":7.29,"5min":8.2870000000000008,"15min":27.113},"last":4.5800000000000001}]},{"osd":3,"last update":"Fri Oct 8 19:34:32 2021","interfaces":[{"interface":"back","average":{"1min":2.9460000000000002,"5min":2.7570000000000001,"15min":2.0129999999999999},"min":{"1min":0.34499999999999997,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":24.945,"5min":72.093999999999994,"15min":72.093999999999994},"last":4.6589999999999998},{"interface":"front","average":{"1min":2.444,"5min":2.8399999999999999,"15min":1.9830000000000001},"min":{"1min":0.33000000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":7.4909999999999997,"5min":71.864999999999995,"15min":71.864999999999995},"last":2.6930000000000001}]},{"osd":4,"last update":"Fri Oct 8 19:34:32 2021","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.95999999999999996,"15min":0.78400000000000003},"min":{"1min":0.28100000000000003,"5min":0.23899999999999999,"15min":0.22800000000000001},"max":{"1min":4.258,"5min":8.391,"15min":8.391},"last":0.34899999999999998},{"interface":"front","average":{"1min":1.6759999999999999,"5min":1.3100000000000001,"15min":0.84799999999999998},"min":{"1min":0.27800000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":4.976,"5min":9.0820000000000007,"15min":9.0820000000000007},"last":1.3029999999999999}]},{"osd":5,"last update":"Fri Oct 8 19:34:32 2021","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.236,"15min":0.91800000000000004},"min":{"1min":0.28199999999999997,"5min":0.26800000000000002,"15min":0.251},"max":{"1min":4.1280000000000001,"5min":9.9280000000000008,"15min":9.9280000000000008},"last":0.66300000000000003},{"interface":"front","average":{"1min":1.976,"5min":1.401,"15min":0.92400000000000004},"min":{"1min":0.34799999999999998,"5min":0.30199999999999999,"15min":0.26100000000000001},"max":{"1min":7.54,"5min":16.093,"15min":18.655000000000001},"last":1.768}]},{"osd":6,"last update":"Fri Oct 8 19:34:32 2021","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.3799999999999999,"15min":0.96599999999999997},"min":{"1min":0.314,"5min":0.30399999999999999,"15min":0.27900000000000003},"max":{"1min":5.093,"5min":17.082000000000001,"15min":17.082000000000001},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.171,"5min":1.1040000000000001,"15min":0.89900000000000002},"min":{"1min":0.31900000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":3.3919999999999999,"5min":7.742,"15min":7.742},"last":0.374}]}]},{"osd":6,"up_from":47,"seq":201863463082,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":243052,"kb_used_data":52900,"kb_used_omap":0,"kb_used_meta":190144,"kb_avail":93502100,"statfs":{"total":95995035648,"available":95746150400,"internally_reserved":0,"allocated":54169600,"data_stored":53809362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":194707456},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:34:15 2021","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":0.98499999999999999,"15min":1.151},"min":{"1min":0.224,"5min":0.20899999999999999,"15min":0.20100000000000001},"max":{"1min":5.194,"5min":5.194,"15min":28.382999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":1.548,"5min":1.6519999999999999,"15min":1.649},"min":{"1min":0.25900000000000001,"5min":0.22600000000000001,"15min":0.21299999999999999},"max":{"1min":8.3300000000000001,"5min":15.458,"15min":69.477000000000004},"last":2.5139999999999998}]},{"osd":1,"last update":"Fri Oct 8 19:34:15 2021","interfaces":[{"interface":"back","average":{"1min":1.861,"5min":1.385,"15min":1.0640000000000001},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.23000000000000001},"max":{"1min":5.0579999999999998,"5min":5.4809999999999999,"15min":14.878},"last":0.314},{"interface":"front","average":{"1min":1.7589999999999999,"5min":1.452,"15min":1.119},"min":{"1min":0.28999999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":5.0880000000000001,"5min":7.4189999999999996,"15min":14.779},"last":0.44900000000000001}]},{"osd":2,"last update":"Fri Oct 8 19:34:15 2021","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.252,"15min":1.508},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.251},"max":{"1min":5.1269999999999998,"5min":6.7960000000000003,"15min":69.322999999999993},"last":0.498},{"interface":"front","average":{"1min":2.0670000000000002,"5min":1.7709999999999999,"15min":1.6779999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.245},"max":{"1min":8.3710000000000004,"5min":15.504,"15min":69.418999999999997},"last":4.0910000000000002}]},{"osd":3,"last update":"Fri Oct 8 19:34:15 2021","interfaces":[{"interface":"back","average":{"1min":1.8999999999999999,"5min":1.6040000000000001,"15min":1.3899999999999999},"min":{"1min":0.35399999999999998,"5min":0.307,"15min":0.27900000000000003},"max":{"1min":4.1020000000000003,"5min":7.2910000000000004,"15min":21.670000000000002},"last":0.34100000000000003},{"interface":"front","average":{"1min":1.359,"5min":1.335,"15min":1.216},"min":{"1min":0.34200000000000003,"5min":0.32600000000000001,"15min":0.28000000000000003},"max":{"1min":5.1740000000000004,"5min":8.3360000000000003,"15min":22.254999999999999},"last":5.3399999999999999}]},{"osd":4,"last update":"Fri Oct 8 19:34:15 2021","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.3640000000000001,"15min":0.78600000000000003},"min":{"1min":0.29499999999999998,"5min":0.254,"15min":0.254},"max":{"1min":3.5129999999999999,"5min":24.516999999999999,"15min":24.516999999999999},"last":2.698},{"interface":"front","average":{"1min":1.361,"5min":1.099,"15min":1.004},"min":{"1min":0.28599999999999998,"5min":0.27500000000000002,"15min":0.26100000000000001},"max":{"1min":4.0700000000000003,"5min":9.6890000000000001,"15min":69.593999999999994},"last":5.4299999999999997}]},{"osd":5,"last update":"Fri Oct 8 19:34:15 2021","interfaces":[{"interface":"back","average":{"1min":1.9259999999999999,"5min":2.0659999999999998,"15min":1.0580000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.28499999999999998},"max":{"1min":8.5760000000000005,"5min":48.545999999999999,"15min":48.545999999999999},"last":2.7160000000000002},{"interface":"front","average":{"1min":1.649,"5min":1.8540000000000001,"15min":1.276},"min":{"1min":0.31,"5min":0.31,"15min":0.252},"max":{"1min":7.0309999999999997,"5min":46.003999999999998,"15min":69.561000000000007},"last":5.399}]},{"osd":7,"last update":"Fri Oct 8 19:34:40 2021","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":1.173,"15min":0.81200000000000006},"min":{"1min":0.315,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":7.1230000000000002,"5min":7.1230000000000002,"15min":7.1230000000000002},"last":0.47599999999999998},{"interface":"front","average":{"1min":1.46,"5min":1.5509999999999999,"15min":0.96599999999999997},"min":{"1min":0.35599999999999998,"5min":0.32800000000000001,"15min":0.313},"max":{"1min":4.5309999999999997,"5min":15.962,"15min":15.962},"last":2.7309999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575037,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":442912,"kb_used_data":155160,"kb_used_omap":0,"kb_used_meta":287744,"kb_avail":93302240,"statfs":{"total":95995035648,"available":95541493760,"internally_reserved":0,"allocated":158883840,"data_stored":158471196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":294649856},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:33:53 2021","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":4.0640000000000001,"15min":2.8889999999999998},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.184},"max":{"1min":5.1479999999999997,"5min":126.256,"15min":126.256},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.7509999999999999,"5min":3.9020000000000001,"15min":3.109},"min":{"1min":0.22700000000000001,"5min":0.182,"15min":0.182},"max":{"1min":5.8250000000000002,"5min":126.176,"15min":126.176},"last":0.20499999999999999}]},{"osd":2,"last update":"Fri Oct 8 19:34:13 2021","interfaces":[{"interface":"back","average":{"1min":1.423,"5min":2.5310000000000001,"15min":2.1819999999999999},"min":{"1min":0.20899999999999999,"5min":0.192,"15min":0.192},"max":{"1min":6.9530000000000003,"5min":102.395,"15min":102.395},"last":6.1639999999999997},{"interface":"front","average":{"1min":1.234,"5min":3.1040000000000001,"15min":2.52},"min":{"1min":0.28899999999999998,"5min":0.23400000000000001,"15min":0.22700000000000001},"max":{"1min":2.7629999999999999,"5min":102.50700000000001,"15min":102.50700000000001},"last":0.25700000000000001}]},{"osd":3,"last update":"Fri Oct 8 19:34:31 2021","interfaces":[{"interface":"back","average":{"1min":1.875,"5min":3.7519999999999998,"15min":2.6949999999999998},"min":{"1min":0.307,"5min":0.24399999999999999,"15min":0.23999999999999999},"max":{"1min":7.0800000000000001,"5min":105.836,"15min":105.836},"last":0.97699999999999998},{"interface":"front","average":{"1min":2.8319999999999999,"5min":3.831,"15min":2.548},"min":{"1min":0.32700000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":9.282,"5min":106.12,"15min":106.12},"last":0.31}]},{"osd":4,"last update":"Fri Oct 8 19:34:42 2021","interfaces":[{"interface":"back","average":{"1min":2.044,"5min":2.6240000000000001,"15min":1.861},"min":{"1min":0.31,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":7.2370000000000001,"5min":103.538,"15min":103.538},"last":6.7649999999999997},{"interface":"front","average":{"1min":1.383,"5min":2.4969999999999999,"15min":1.5189999999999999},"min":{"1min":0.29299999999999998,"5min":0.254,"15min":0.254},"max":{"1min":3.3690000000000002,"5min":102.67100000000001,"15min":102.67100000000001},"last":0.36299999999999999}]},{"osd":5,"last update":"Fri Oct 8 19:34:06 2021","interfaces":[{"interface":"back","average":{"1min":1.4359999999999999,"5min":2.7440000000000002,"15min":1.8600000000000001},"min":{"1min":0.34100000000000003,"5min":0.33200000000000002,"15min":0.29899999999999999},"max":{"1min":6.1520000000000001,"5min":102.717,"15min":102.717},"last":3.516},{"interface":"front","average":{"1min":1.327,"5min":2.6499999999999999,"15min":1.55},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.29999999999999999},"max":{"1min":5.8120000000000003,"5min":102.617,"15min":102.617},"last":1.474}]},{"osd":6,"last update":"Fri Oct 8 19:34:24 2021","interfaces":[{"interface":"back","average":{"1min":2.2250000000000001,"5min":2.7490000000000001,"15min":1.9059999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.26700000000000002},"max":{"1min":7.024,"5min":103.73,"15min":103.73},"last":6.8159999999999998},{"interface":"front","average":{"1min":1.028,"5min":2.774,"15min":1.917},"min":{"1min":0.377,"5min":0.35599999999999998,"15min":0.28399999999999997},"max":{"1min":2.5430000000000001,"5min":102.753,"15min":102.753},"last":3.5670000000000002}]},{"osd":7,"last update":"Fri Oct 8 19:34:42 2021","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":3.7770000000000001,"15min":2.3740000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.312},"max":{"1min":3.8090000000000002,"5min":106.011,"15min":106.011},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.4650000000000001,"5min":3.8090000000000002,"15min":2.0009999999999999},"min":{"1min":0.36699999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":3.3570000000000002,"5min":103.78400000000001,"15min":103.78400000000001},"last":2.161}]}]},{"osd":0,"up_from":8,"seq":34359738560,"num_pgs":61,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":276672,"kb_used_data":64952,"kb_used_omap":0,"kb_used_meta":211648,"kb_avail":93468480,"statfs":{"total":95995035648,"available":95711723520,"internally_reserved":0,"allocated":66510848,"data_stored":66130477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":216727552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 8 19:34:51 2021","interfaces":[{"interface":"back","average":{"1min":1.6459999999999999,"5min":2.903,"15min":2.028},"min":{"1min":0.22800000000000001,"5min":0.185,"15min":0.185},"max":{"1min":6.4539999999999997,"5min":91.954999999999998,"15min":91.954999999999998},"last":0.46999999999999997},{"interface":"front","average":{"1min":2.528,"5min":3.2229999999999999,"15min":2.1920000000000002},"min":{"1min":0.29999999999999999,"5min":0.22600000000000001,"15min":0.217},"max":{"1min":7.7229999999999999,"5min":91.046000000000006,"15min":91.046000000000006},"last":0.439}]},{"osd":2,"last update":"Fri Oct 8 19:34:14 2021","interfaces":[{"interface":"back","average":{"1min":2.4849999999999999,"5min":1.893,"15min":1.905},"min":{"1min":0.248,"5min":0.22900000000000001,"15min":0.22700000000000001},"max":{"1min":9.6129999999999995,"5min":12.164999999999999,"15min":62.390000000000001},"last":0.29499999999999998},{"interface":"front","average":{"1min":2.157,"5min":1.8029999999999999,"15min":1.7869999999999999},"min":{"1min":0.219,"5min":0.20000000000000001,"15min":0.19500000000000001},"max":{"1min":6.8819999999999997,"5min":10.121,"15min":62.718000000000004},"last":0.37}]},{"osd":3,"last update":"Fri Oct 8 19:34:37 2021","interfaces":[{"interface":"back","average":{"1min":2.6859999999999999,"5min":2.528,"15min":2.157},"min":{"1min":0.36799999999999999,"5min":0.218,"15min":0.217},"max":{"1min":7.2389999999999999,"5min":14.551,"15min":62.491},"last":0.316},{"interface":"front","average":{"1min":2.1909999999999998,"5min":2.1659999999999999,"15min":1.921},"min":{"1min":0.249,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":10.052,"5min":22.016999999999999,"15min":62.673000000000002},"last":0.42799999999999999}]},{"osd":4,"last update":"Fri Oct 8 19:34:51 2021","interfaces":[{"interface":"back","average":{"1min":2.1110000000000002,"5min":1.889,"15min":1.546},"min":{"1min":0.29199999999999998,"5min":0.25800000000000001,"15min":0.22900000000000001},"max":{"1min":9.5380000000000003,"5min":16.805,"15min":16.805},"last":0.504},{"interface":"front","average":{"1min":2.004,"5min":1.3799999999999999,"15min":1.355},"min":{"1min":0.33200000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":6.2270000000000003,"5min":7.0890000000000004,"15min":11.823},"last":0.33200000000000002}]},{"osd":5,"last update":"Fri Oct 8 19:34:05 2021","interfaces":[{"interface":"back","average":{"1min":1.7969999999999999,"5min":1.4930000000000001,"15min":1.1990000000000001},"min":{"1min":0.36599999999999999,"5min":0.28399999999999997,"15min":0.24099999999999999},"max":{"1min":6.9180000000000001,"5min":8.6530000000000005,"15min":15.56},"last":0.48499999999999999},{"interface":"front","average":{"1min":1.145,"5min":1.4570000000000001,"15min":1.4179999999999999},"min":{"1min":0.40200000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":4.3319999999999999,"5min":11.619999999999999,"15min":15.484999999999999},"last":1.169}]},{"osd":6,"last update":"Fri Oct 8 19:34:21 2021","interfaces":[{"interface":"back","average":{"1min":2.1970000000000001,"5min":1.421,"15min":1.405},"min":{"1min":0.34100000000000003,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":7.165,"5min":7.165,"15min":11.869},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.5509999999999999,"5min":1.5609999999999999,"15min":1.329},"min":{"1min":0.39900000000000002,"5min":0.32000000000000001,"15min":0.27500000000000002},"max":{"1min":5.8129999999999997,"5min":8.609,"15min":10.519},"last":0.96399999999999997}]},{"osd":7,"last update":"Fri Oct 8 19:34:37 2021","interfaces":[{"interface":"back","average":{"1min":1.6020000000000001,"5min":1.7649999999999999,"15min":1.5589999999999999},"min":{"1min":0.38500000000000001,"5min":0.38200000000000001,"15min":0.35399999999999998},"max":{"1min":6.2309999999999999,"5min":11.669,"15min":11.669},"last":4.2480000000000002},{"interface":"front","average":{"1min":2.7189999999999999,"5min":1.6599999999999999,"15min":1.6240000000000001},"min":{"1min":0.49099999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":7.2210000000000001,"5min":9.8849999999999998,"15min":11.898999999999999},"last":4.3540000000000001}]}]},{"osd":2,"up_from":18,"seq":77309411512,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":277168,"kb_used_data":63272,"kb_used_omap":0,"kb_used_meta":213888,"kb_avail":93467984,"statfs":{"total":95995035648,"available":95711215616,"internally_reserved":0,"allocated":64790528,"data_stored":64426592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":219021312},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:34:07 2021","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":2.133,"15min":2.101},"min":{"1min":0.19600000000000001,"5min":0.184,"15min":0.17699999999999999},"max":{"1min":4.9530000000000003,"5min":60.990000000000002,"15min":61.670999999999999},"last":1.9219999999999999},{"interface":"front","average":{"1min":1.4530000000000001,"5min":2.113,"15min":2.0819999999999999},"min":{"1min":0.23999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":5.4630000000000001,"5min":60.850999999999999,"15min":65.284999999999997},"last":1.2729999999999999}]},{"osd":1,"last update":"Fri Oct 8 19:34:07 2021","interfaces":[{"interface":"back","average":{"1min":4.867,"5min":3.7040000000000002,"15min":2.4289999999999998},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.192},"max":{"1min":63.738,"5min":63.738,"15min":63.738},"last":2.4089999999999998},{"interface":"front","average":{"1min":5.5860000000000003,"5min":4.0410000000000004,"15min":2.629},"min":{"1min":0.26500000000000001,"5min":0.25900000000000001,"15min":0.21299999999999999},"max":{"1min":63.619999999999997,"5min":63.619999999999997,"15min":63.619999999999997},"last":1.2949999999999999}]},{"osd":3,"last update":"Fri Oct 8 19:34:15 2021","interfaces":[{"interface":"back","average":{"1min":2.661,"5min":3.6379999999999999,"15min":2.6349999999999998},"min":{"1min":0.30099999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":7.8460000000000001,"5min":63.658999999999999,"15min":65.322999999999993},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.8779999999999999,"5min":3.5739999999999998,"15min":2.5329999999999999},"min":{"1min":0.29599999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":10.317,"5min":65.418000000000006,"15min":65.418000000000006},"last":2.302}]},{"osd":4,"last update":"Fri Oct 8 19:34:44 2021","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":1.2569999999999999,"15min":1.3380000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.26900000000000002},"max":{"1min":4.1689999999999996,"5min":24.657,"15min":24.657},"last":1.881},{"interface":"front","average":{"1min":1.339,"5min":1.448,"15min":1.452},"min":{"1min":0.313,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":3.6960000000000002,"5min":8.5990000000000002,"15min":15.143000000000001},"last":1.329}]},{"osd":5,"last update":"Fri Oct 8 19:34:07 2021","interfaces":[{"interface":"back","average":{"1min":1.962,"5min":1.613,"15min":1.4319999999999999},"min":{"1min":0.32100000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":7.7409999999999997,"5min":8.6240000000000006,"15min":15.087999999999999},"last":1.401},{"interface":"front","average":{"1min":1.6679999999999999,"5min":1.603,"15min":1.4570000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.27600000000000002},"max":{"1min":5.4379999999999997,"5min":26.094000000000001,"15min":26.094000000000001},"last":1.946}]},{"osd":6,"last update":"Fri Oct 8 19:34:15 2021","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.242,"15min":1.3360000000000001},"min":{"1min":0.40899999999999997,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":3.4510000000000001,"5min":7.7779999999999996,"15min":14.162000000000001},"last":1.845},{"interface":"front","average":{"1min":1.9450000000000001,"5min":1.3779999999999999,"15min":1.413},"min":{"1min":0.378,"5min":0.313,"15min":0.313},"max":{"1min":5.1500000000000004,"5min":10.92,"15min":16.68},"last":5.734}]},{"osd":7,"last update":"Fri Oct 8 19:34:44 2021","interfaces":[{"interface":"back","average":{"1min":9.7460000000000004,"5min":3.141,"15min":2.0609999999999999},"min":{"1min":0.46999999999999997,"5min":0.32200000000000001,"15min":0.31900000000000001},"max":{"1min":136.00200000000001,"5min":136.00200000000001,"15min":136.00200000000001},"last":1.9850000000000001},{"interface":"front","average":{"1min":9.3360000000000003,"5min":3.0739999999999998,"15min":1.9950000000000001},"min":{"1min":0.41799999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":133.26300000000001,"5min":133.26300000000001,"15min":133.26300000000001},"last":1.976}]}]},{"osd":3,"up_from":24,"seq":103079215286,"num_pgs":75,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":462356,"kb_used_data":152140,"kb_used_omap":0,"kb_used_meta":310208,"kb_avail":93282796,"statfs":{"total":95995035648,"available":95521583104,"internally_reserved":0,"allocated":155791360,"data_stored":155391570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":317652992},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:34:31 2021","interfaces":[{"interface":"back","average":{"1min":2.524,"5min":2.4180000000000001,"15min":2.2839999999999998},"min":{"1min":0.20699999999999999,"5min":0.187,"15min":0.17000000000000001},"max":{"1min":7.7409999999999997,"5min":13.036,"15min":109.601},"last":6.4630000000000001},{"interface":"front","average":{"1min":1.407,"5min":1.8859999999999999,"15min":2.1899999999999999},"min":{"1min":0.23000000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":3.919,"5min":12.696999999999999,"15min":107.84},"last":2.9180000000000001}]},{"osd":1,"last update":"Fri Oct 8 19:34:31 2021","interfaces":[{"interface":"back","average":{"1min":1.6519999999999999,"5min":2.2010000000000001,"15min":1.8540000000000001},"min":{"1min":0.27100000000000002,"5min":0.23699999999999999,"15min":0.20999999999999999},"max":{"1min":4.1289999999999996,"5min":37.271999999999998,"15min":37.271999999999998},"last":5.6360000000000001},{"interface":"front","average":{"1min":1.796,"5min":2.093,"15min":1.8400000000000001},"min":{"1min":0.251,"5min":0.19,"15min":0.19},"max":{"1min":6.8310000000000004,"5min":37.033000000000001,"15min":37.033000000000001},"last":0.61199999999999999}]},{"osd":2,"last update":"Fri Oct 8 19:34:31 2021","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":1.3620000000000001,"15min":1.79},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":2.653,"5min":7.6890000000000001,"15min":32.277000000000001},"last":0.38100000000000001},{"interface":"front","average":{"1min":1.704,"5min":2.3399999999999999,"15min":1.792},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.22700000000000001},"max":{"1min":4.0170000000000003,"5min":23.189,"15min":23.189},"last":6.625}]},{"osd":4,"last update":"Fri Oct 8 19:34:44 2021","interfaces":[{"interface":"back","average":{"1min":1.764,"5min":1.8460000000000001,"15min":1.5},"min":{"1min":0.29199999999999998,"5min":0.26600000000000001,"15min":0.25600000000000001},"max":{"1min":6.915,"5min":13.968,"15min":18.064},"last":3.2050000000000001},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.728,"15min":1.607},"min":{"1min":0.35799999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":3.831,"5min":15.414,"15min":18.692},"last":0.47199999999999998}]},{"osd":5,"last update":"Fri Oct 8 19:34:01 2021","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.5509999999999999,"15min":1.3859999999999999},"min":{"1min":0.30599999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":4.8719999999999999,"5min":11.125,"15min":13.186},"last":0.34599999999999997},{"interface":"front","average":{"1min":3.3460000000000001,"5min":2.222,"15min":1.591},"min":{"1min":0.32600000000000001,"5min":0.311,"15min":0.28100000000000003},"max":{"1min":22.861000000000001,"5min":22.861000000000001,"15min":22.861000000000001},"last":3.7839999999999998}]},{"osd":6,"last update":"Fri Oct 8 19:34:17 2021","interfaces":[{"interface":"back","average":{"1min":1.5920000000000001,"5min":1.8100000000000001,"15min":1.8580000000000001},"min":{"1min":0.34300000000000003,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":3.8399999999999999,"5min":10.606999999999999,"15min":21.538},"last":0.497},{"interface":"front","average":{"1min":1.54,"5min":1.6739999999999999,"15min":1.4690000000000001},"min":{"1min":0.42799999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":4.7999999999999998,"5min":13.067,"15min":13.298},"last":1.345}]},{"osd":7,"last update":"Fri Oct 8 19:34:44 2021","interfaces":[{"interface":"back","average":{"1min":2.218,"5min":1.8560000000000001,"15min":1.5449999999999999},"min":{"1min":0.40500000000000003,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":7.1840000000000002,"5min":10.656000000000001,"15min":10.696999999999999},"last":3.3799999999999999},{"interface":"front","average":{"1min":1.7030000000000001,"5min":1.581,"15min":1.488},"min":{"1min":0.40300000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":7.165,"5min":7.165,"15min":13.225},"last":0.40699999999999997}]}]},{"osd":4,"up_from":30,"seq":128849019056,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":214348,"kb_used_data":44292,"kb_used_omap":0,"kb_used_meta":170048,"kb_avail":93530804,"statfs":{"total":95995035648,"available":95775543296,"internally_reserved":0,"allocated":45355008,"data_stored":44963389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":174129152},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:34:44 2021","interfaces":[{"interface":"back","average":{"1min":1.5029999999999999,"5min":2.1000000000000001,"15min":1.7},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.185},"max":{"1min":3.9359999999999999,"5min":82.109999999999999,"15min":82.109999999999999},"last":0.217},{"interface":"front","average":{"1min":1.284,"5min":2.1760000000000002,"15min":1.681},"min":{"1min":0.25800000000000001,"5min":0.23000000000000001,"15min":0.20399999999999999},"max":{"1min":3.3559999999999999,"5min":82.025999999999996,"15min":82.025999999999996},"last":4.5570000000000004}]},{"osd":1,"last update":"Fri Oct 8 19:34:44 2021","interfaces":[{"interface":"back","average":{"1min":9.3789999999999996,"5min":3.3069999999999999,"15min":2.0859999999999999},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":122.422,"5min":122.422,"15min":122.422},"last":0.41499999999999998},{"interface":"front","average":{"1min":9.25,"5min":3.1240000000000001,"15min":1.835},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":123.122,"5min":123.122,"15min":123.122},"last":0.25}]},{"osd":2,"last update":"Fri Oct 8 19:34:44 2021","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.3500000000000001,"15min":1.288},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.23499999999999999},"max":{"1min":4.5439999999999996,"5min":7.9189999999999996,"15min":21.257000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":1.6220000000000001,"5min":1.3149999999999999,"15min":1.294},"min":{"1min":0.29299999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":5.0270000000000001,"5min":6.242,"15min":21.600000000000001},"last":4.6349999999999998}]},{"osd":3,"last update":"Fri Oct 8 19:34:44 2021","interfaces":[{"interface":"back","average":{"1min":2.0270000000000001,"5min":1.581,"15min":1.9690000000000001},"min":{"1min":0.315,"5min":0.28499999999999998,"15min":0.26500000000000001},"max":{"1min":3.8940000000000001,"5min":7.4130000000000003,"15min":58.506999999999998},"last":4.5990000000000002},{"interface":"front","average":{"1min":1.7789999999999999,"5min":1.7669999999999999,"15min":1.694},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":5.5940000000000003,"5min":10.981,"15min":58.521000000000001},"last":0.46400000000000002}]},{"osd":5,"last update":"Fri Oct 8 19:34:06 2021","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.0329999999999999,"15min":0.70699999999999996},"min":{"1min":0.33500000000000002,"5min":0.247,"15min":0.222},"max":{"1min":4.242,"5min":7.101,"15min":7.101},"last":2.0630000000000002},{"interface":"front","average":{"1min":1.1910000000000001,"5min":0.98699999999999999,"15min":0.68700000000000006},"min":{"1min":0.29099999999999998,"5min":0.23999999999999999,"15min":0.22900000000000001},"max":{"1min":4.1660000000000004,"5min":8.1319999999999997,"15min":8.1319999999999997},"last":0.52800000000000002}]},{"osd":6,"last update":"Fri Oct 8 19:34:20 2021","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":0.93000000000000005,"15min":0.72499999999999998},"min":{"1min":0.34699999999999998,"5min":0.28899999999999998,"15min":0.23599999999999999},"max":{"1min":4.2670000000000003,"5min":6.7300000000000004,"15min":6.7300000000000004},"last":4.6970000000000001},{"interface":"front","average":{"1min":1.155,"5min":0.97199999999999998,"15min":0.75600000000000001},"min":{"1min":0.36699999999999999,"5min":0.26600000000000001,"15min":0.247},"max":{"1min":4.6500000000000004,"5min":7.0720000000000001,"15min":7.0720000000000001},"last":0.443}]},{"osd":7,"last update":"Fri Oct 8 19:34:44 2021","interfaces":[{"interface":"back","average":{"1min":1.5129999999999999,"5min":1.085,"15min":0.76600000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.26400000000000001},"max":{"1min":3.903,"5min":8.0050000000000008,"15min":8.0050000000000008},"last":3.8220000000000001},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.097,"15min":0.83099999999999996},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":2.7000000000000002,"5min":6.3959999999999999,"15min":6.3959999999999999},"last":4.665}]}]},{"osd":5,"up_from":38,"seq":163208757420,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":449664,"kb_used_data":191288,"kb_used_omap":0,"kb_used_meta":258304,"kb_avail":93295488,"statfs":{"total":95995035648,"available":95534579712,"internally_reserved":0,"allocated":195878912,"data_stored":195499973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":264503296},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:34:03 2021","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.4770000000000001,"15min":1.155},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":9.5310000000000006,"5min":24.597000000000001,"15min":24.597000000000001},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.502,"15min":1.137},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":3.8639999999999999,"5min":24.510999999999999,"15min":24.510999999999999},"last":1.0149999999999999}]},{"osd":1,"last update":"Fri Oct 8 19:34:03 2021","interfaces":[{"interface":"back","average":{"1min":5.375,"5min":2.5110000000000001,"15min":1.554},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23000000000000001},"max":{"1min":94.558999999999997,"5min":94.558999999999997,"15min":94.558999999999997},"last":0.35699999999999998},{"interface":"front","average":{"1min":5.5999999999999996,"5min":2.4510000000000001,"15min":1.5249999999999999},"min":{"1min":0.23899999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":94.456999999999994,"5min":94.456999999999994,"15min":94.456999999999994},"last":0.45500000000000002}]},{"osd":2,"last update":"Fri Oct 8 19:34:03 2021","interfaces":[{"interface":"back","average":{"1min":1.6120000000000001,"5min":1.2450000000000001,"15min":1.4339999999999999},"min":{"1min":0.28000000000000003,"5min":0.25800000000000001,"15min":0.25700000000000001},"max":{"1min":7.2210000000000001,"5min":8.1259999999999994,"15min":29.398},"last":0.43099999999999999},{"interface":"front","average":{"1min":1.5329999999999999,"5min":1.355,"15min":1.4550000000000001},"min":{"1min":0.29499999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":5.944,"5min":8.3599999999999994,"15min":29.387},"last":2.6480000000000001}]},{"osd":3,"last update":"Fri Oct 8 19:34:03 2021","interfaces":[{"interface":"back","average":{"1min":2.0529999999999999,"5min":1.7130000000000001,"15min":1.4399999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.26200000000000001},"max":{"1min":5.875,"5min":11.685,"15min":12.356},"last":5.0720000000000001},{"interface":"front","average":{"1min":1.7330000000000001,"5min":2.0169999999999999,"15min":1.542},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":4.9580000000000002,"5min":13.366,"15min":21.504000000000001},"last":5.3310000000000004}]},{"osd":4,"last update":"Fri Oct 8 19:34:03 2021","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":0.89700000000000002,"15min":0.68400000000000005},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.224},"max":{"1min":5.8650000000000002,"5min":9.2759999999999998,"15min":9.2759999999999998},"last":0.36699999999999999},{"interface":"front","average":{"1min":1.446,"5min":0.95099999999999996,"15min":0.69699999999999995},"min":{"1min":0.27900000000000003,"5min":0.25900000000000001,"15min":0.23799999999999999},"max":{"1min":5.0890000000000004,"5min":7.8959999999999999,"15min":7.8959999999999999},"last":0.34200000000000003}]},{"osd":6,"last update":"Fri Oct 8 19:34:21 2021","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":0.96499999999999997,"15min":0.76100000000000001},"min":{"1min":0.28499999999999998,"5min":0.255,"15min":0.255},"max":{"1min":5.8879999999999999,"5min":5.8879999999999999,"15min":7.266},"last":0.40500000000000003},{"interface":"front","average":{"1min":1.0189999999999999,"5min":0.96499999999999997,"15min":0.75},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29099999999999998},"max":{"1min":3.7320000000000002,"5min":7.9390000000000001,"15min":7.9390000000000001},"last":1.823}]},{"osd":7,"last update":"Fri Oct 8 19:34:40 2021","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.3460000000000001,"15min":0.88},"min":{"1min":0.34899999999999998,"5min":0.252,"15min":0.252},"max":{"1min":3.798,"5min":29.946999999999999,"15min":29.946999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":1.5349999999999999,"5min":1.4550000000000001,"15min":0.97699999999999998},"min":{"1min":0.34300000000000003,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":5.4119999999999999,"5min":29.294,"15min":29.294},"last":0.52300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":266240,"data_stored":262688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":327680,"data_stored":327680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":63569920,"data_stored":63569920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":141299712,"data_stored":141295640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51052544,"data_stored":51052544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":124649472,"data_stored":124649472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":41418752,"data_stored":41418752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":159846400,"data_stored":159842328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":52625408,"data_stored":52625408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":158732288,"data_stored":158728216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-10-08T19:34:59.167 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd pool set default.rgw.meta pgp_num 32 2021-10-08T19:34:59.189 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:34:59.192 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:59.192 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:34:59.293 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:34:59.319 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:59.363 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:34:59.364 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:59 smithi117 ceph-mon[34585]: 9.6 scrub ok 2021-10-08T19:34:59.364 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:59 smithi117 ceph-mon[34585]: 6.3 scrub ok 2021-10-08T19:34:59.364 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:59 smithi117 ceph-mon[34585]: from='client.15783 v1:172.21.15.97:0/2980979783' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:34:59.364 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:34:59 smithi117 ceph-mon[34585]: 4.5 scrub ok 2021-10-08T19:34:59.366 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:59.366 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:34:59.411 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:34:59.411 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2021-10-08T19:34:59.411 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2021-10-08T19:34:59.412 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2021-10-08T19:34:59.412 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:34:59.455 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:59 smithi097 ceph-mon[41966]: 9.6 scrub ok 2021-10-08T19:34:59.455 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:59 smithi097 ceph-mon[41966]: 6.3 scrub ok 2021-10-08T19:34:59.456 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:59 smithi097 ceph-mon[41966]: from='client.15783 v1:172.21.15.97:0/2980979783' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:34:59.456 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:34:59 smithi097 ceph-mon[41966]: 4.5 scrub ok 2021-10-08T19:34:59.457 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:59 smithi097 ceph-mon[32687]: 9.6 scrub ok 2021-10-08T19:34:59.457 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:59 smithi097 ceph-mon[32687]: 6.3 scrub ok 2021-10-08T19:34:59.457 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:59 smithi097 ceph-mon[32687]: from='client.15783 v1:172.21.15.97:0/2980979783' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:34:59.457 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:34:59 smithi097 ceph-mon[32687]: 4.5 scrub ok 2021-10-08T19:34:59.468 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:34:59.497 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:34:59.852 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:34:59.855 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:34:59.856 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:34:59.957 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:34:59.982 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:00.236 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is set 2021-10-08T19:35:00.338 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:35:00.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:00 smithi117 ceph-mon[34585]: 6.1b scrub ok 2021-10-08T19:35:00.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:00 smithi117 ceph-mon[34585]: pgmap v676: 178 pgs: 178 active+clean; 137 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 843 op/s 2021-10-08T19:35:00.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:00 smithi117 ceph-mon[34585]: 3.13 scrub ok 2021-10-08T19:35:00.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:00 smithi117 ceph-mon[34585]: 3.1 scrub ok 2021-10-08T19:35:00.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:00 smithi117 ceph-mon[34585]: 2.17 scrub ok 2021-10-08T19:35:00.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:00 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/832786551' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:35:00.496 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2021-10-08T19:35:00.577 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:35:00.579 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:00.580 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:35:00.681 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:35:00.704 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:00 smithi097 ceph-mon[41966]: 6.1b scrub ok 2021-10-08T19:35:00.705 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:00 smithi097 ceph-mon[41966]: pgmap v676: 178 pgs: 178 active+clean; 137 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 843 op/s 2021-10-08T19:35:00.705 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:00 smithi097 ceph-mon[41966]: 3.13 scrub ok 2021-10-08T19:35:00.705 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:00 smithi097 ceph-mon[41966]: 3.1 scrub ok 2021-10-08T19:35:00.705 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:00 smithi097 ceph-mon[41966]: 2.17 scrub ok 2021-10-08T19:35:00.706 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:00 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/832786551' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:35:00.706 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:00 smithi097 ceph-mon[32687]: 6.1b scrub ok 2021-10-08T19:35:00.707 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:00 smithi097 ceph-mon[32687]: pgmap v676: 178 pgs: 178 active+clean; 137 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 843 op/s 2021-10-08T19:35:00.707 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:00 smithi097 ceph-mon[32687]: 3.13 scrub ok 2021-10-08T19:35:00.707 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:00 smithi097 ceph-mon[32687]: 3.1 scrub ok 2021-10-08T19:35:00.707 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:00 smithi097 ceph-mon[32687]: 2.17 scrub ok 2021-10-08T19:35:00.707 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:00 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/832786551' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:35:00.708 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:00.837 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:35:00.838 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:00.839 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:35:00.940 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:35:00.964 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:01.209 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:35:01.213 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:01.213 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:35:01.239 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:35:01.315 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:35:01.340 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:01.387 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:35:01.405 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:35:01.423 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:35:01.444 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:35:01.464 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:35:01.482 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:35:01.501 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:35:01.510 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:01 smithi117 ceph-mon[34585]: 1.5 scrub ok 2021-10-08T19:35:01.510 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:01 smithi117 ceph-mon[34585]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:35:01.510 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:01 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/832786551' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:35:01.510 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:01 smithi117 ceph-mon[34585]: osdmap e349: 8 total, 8 up, 8 in 2021-10-08T19:35:01.521 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:35:01.522 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'false' 2021-10-08T19:35:01.522 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'false' 2021-10-08T19:35:01.522 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'false' 2021-10-08T19:35:01.526 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'false' 2021-10-08T19:35:01.526 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'false' 2021-10-08T19:35:01.527 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'false' 2021-10-08T19:35:01.528 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'false' 2021-10-08T19:35:01.528 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'false' 2021-10-08T19:35:01.544 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:01 smithi097 ceph-mon[41966]: 1.5 scrub ok 2021-10-08T19:35:01.545 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:01 smithi097 ceph-mon[41966]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:35:01.545 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:01 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/832786551' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:35:01.546 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:01 smithi097 ceph-mon[41966]: osdmap e349: 8 total, 8 up, 8 in 2021-10-08T19:35:01.547 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:01 smithi097 ceph-mon[32687]: 1.5 scrub ok 2021-10-08T19:35:01.547 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:01 smithi097 ceph-mon[32687]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:35:01.547 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:01 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/832786551' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:35:01.547 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:01 smithi097 ceph-mon[32687]: osdmap e349: 8 total, 8 up, 8 in 2021-10-08T19:35:01.595 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:35:01.597 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:01.598 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:35:01.699 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:35:01.725 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:01.778 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:35:01.783 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:01.784 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:35:01.886 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:35:01.911 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:02.558 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:02 smithi097 ceph-mon[41966]: pgmap v678: 178 pgs: 178 active+clean; 582 KiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.09k op/s 2021-10-08T19:35:02.559 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:02 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/712048276' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:35:02.559 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:02 smithi097 ceph-mon[32687]: pgmap v678: 178 pgs: 178 active+clean; 582 KiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.09k op/s 2021-10-08T19:35:02.559 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:02 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/712048276' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:35:02.577 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:35:02.580 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:02.581 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:35:02.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:02 smithi117 ceph-mon[34585]: pgmap v678: 178 pgs: 178 active+clean; 582 KiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.09k op/s 2021-10-08T19:35:02.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:02 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/712048276' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:35:02.683 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:35:02.710 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:02.806 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:35:02.810 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:02.811 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:35:02.912 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:35:02.935 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set nodeep-scrub 2021-10-08T19:35:02.936 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:35:02 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:35:02] "GET /metrics HTTP/1.1" 200 155810 "" "Prometheus/2.18.1" 2021-10-08T19:35:02.939 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:02.990 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:35:02.992 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:02.993 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:35:03.094 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:35:03.121 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:03.209 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:35:03.238 INFO:teuthology.orchestra.run.smithi097.stderr:set pool 6 pgp_num to 32 2021-10-08T19:35:03.357 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2021-10-08T19:35:03.358 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:35:03.368 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:03 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3262303755' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pgp_num", "val": "32"}]: dispatch 2021-10-08T19:35:03.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:03 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3262303755' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pgp_num", "val": "32"}]: dispatch 2021-10-08T19:35:03.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:03 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3262303755' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pgp_num", "val": "32"}]: dispatch 2021-10-08T19:35:03.819 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:35:03.822 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:03.824 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:35:03.925 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:35:03.952 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:04.104 INFO:tasks.cephadm.ceph_manager.ceph:removing pool_name unique_pool_2 2021-10-08T19:35:04.105 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd pool rm unique_pool_2 unique_pool_2 --yes-i-really-really-mean-it 2021-10-08T19:35:04.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:35:03 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:35:03] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:35:04.334 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:04 smithi097 ceph-mon[41966]: pgmap v679: 178 pgs: 178 active+clean; 582 KiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 963 op/s 2021-10-08T19:35:04.335 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:04 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3262303755' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pgp_num", "val": "32"}]': finished 2021-10-08T19:35:04.335 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:04 smithi097 ceph-mon[41966]: osdmap e350: 8 total, 8 up, 8 in 2021-10-08T19:35:04.335 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:04 smithi097 ceph-mon[32687]: pgmap v679: 178 pgs: 178 active+clean; 582 KiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 963 op/s 2021-10-08T19:35:04.336 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:04 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3262303755' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pgp_num", "val": "32"}]': finished 2021-10-08T19:35:04.336 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:04 smithi097 ceph-mon[32687]: osdmap e350: 8 total, 8 up, 8 in 2021-10-08T19:35:04.415 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:35:04.418 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:04.420 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:35:04.521 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:35:04.545 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:04 smithi117 ceph-mon[34585]: pgmap v679: 178 pgs: 178 active+clean; 582 KiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 963 op/s 2021-10-08T19:35:04.546 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:04 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3262303755' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pgp_num", "val": "32"}]': finished 2021-10-08T19:35:04.547 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:04 smithi117 ceph-mon[34585]: osdmap e350: 8 total, 8 up, 8 in 2021-10-08T19:35:04.547 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:04.561 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2021-10-08T19:35:04.650 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:35:04.653 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:04.654 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:35:04.656 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2021-10-08T19:35:04.757 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:35:04.781 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:04.979 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:35:04.981 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:04.983 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:35:04.992 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:35:05.001 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:35:05.008 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:35:05.084 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:35:05.110 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:05.274 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:35:05.276 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:05.277 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:35:05.379 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:35:05.407 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:05.856 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:35:05.859 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:05.860 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:35:05.961 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:35:05.987 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:06.030 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:35:06.032 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:06.033 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:35:06.134 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:35:06.159 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:06.249 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is set 2021-10-08T19:35:06.375 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:35:06.378 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:06.379 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:35:06.480 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:35:06.511 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:06 smithi117 ceph-mon[34585]: pgmap v681: 178 pgs: 178 active+clean; 582 KiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 510 op/s 2021-10-08T19:35:06.511 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:06 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3379195228' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:35:06.511 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:06 smithi117 ceph-mon[34585]: from='client.25750 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:35:06.513 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:06.711 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:35:06.717 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:06.718 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:35:06.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:06 smithi097 ceph-mon[32687]: pgmap v681: 178 pgs: 178 active+clean; 582 KiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 510 op/s 2021-10-08T19:35:06.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:06 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3379195228' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:35:06.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:06 smithi097 ceph-mon[32687]: from='client.25750 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:35:06.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:06 smithi097 ceph-mon[41966]: pgmap v681: 178 pgs: 178 active+clean; 582 KiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 510 op/s 2021-10-08T19:35:06.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:06 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3379195228' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:35:06.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:06 smithi097 ceph-mon[41966]: from='client.25750 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:35:06.820 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:35:06.845 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:06.891 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2021-10-08T19:35:06.892 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:35:07.240 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:35:06 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:35:07.568 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:07 smithi097 ceph-mon[41966]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:35:07.573 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:07 smithi097 ceph-mon[41966]: from='client.25750 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:35:07.574 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:07 smithi097 ceph-mon[41966]: osdmap e351: 8 total, 8 up, 8 in 2021-10-08T19:35:07.580 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:07 smithi097 ceph-mon[32687]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:35:07.581 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:07 smithi097 ceph-mon[32687]: from='client.25750 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:35:07.581 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:07 smithi097 ceph-mon[32687]: osdmap e351: 8 total, 8 up, 8 in 2021-10-08T19:35:07.603 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:07.604 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:35:07.605 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:35:07.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:07 smithi117 ceph-mon[34585]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:35:07.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:07 smithi117 ceph-mon[34585]: from='client.25750 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:35:07.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:07 smithi117 ceph-mon[34585]: osdmap e351: 8 total, 8 up, 8 in 2021-10-08T19:35:07.662 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2021-10-08T19:35:07.707 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:35:07.737 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:07.907 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:35:07.909 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:07.910 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:35:07.986 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:35:08.012 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:35:08.014 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:35:08.023 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:35:08.042 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:35:08.045 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:08.061 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:35:08.070 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:35:08.079 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:35:08.096 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:35:08.098 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:08.099 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:35:08.100 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:35:08.117 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:35:08.118 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true' 2021-10-08T19:35:08.118 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true' 2021-10-08T19:35:08.119 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true' 2021-10-08T19:35:08.119 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true' 2021-10-08T19:35:08.119 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true' 2021-10-08T19:35:08.120 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true' 2021-10-08T19:35:08.120 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'true' 2021-10-08T19:35:08.120 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'true' 2021-10-08T19:35:08.200 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:35:08.225 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:08.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:08 smithi117 ceph-mon[34585]: pgmap v683: 178 pgs: 178 active+clean; 582 KiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 777 B/s rd, 0 op/s 2021-10-08T19:35:08.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:08 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:35:08.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:08 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/343047037' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:35:08.472 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:35:08.476 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:08.478 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:35:08.580 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:35:08.604 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:08 smithi097 ceph-mon[41966]: pgmap v683: 178 pgs: 178 active+clean; 582 KiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 777 B/s rd, 0 op/s 2021-10-08T19:35:08.604 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:08 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:35:08.604 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:08 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/343047037' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:35:08.605 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:08 smithi097 ceph-mon[32687]: pgmap v683: 178 pgs: 178 active+clean; 582 KiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 777 B/s rd, 0 op/s 2021-10-08T19:35:08.605 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:08 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:35:08.605 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:08 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/343047037' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:35:08.606 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:08.815 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:35:08.816 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:08.817 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:35:08.918 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:35:08.943 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:08.987 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:08.988 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:35:08.988 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:35:09.089 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:35:09.105 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 4, 5, 7, 6, 1, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2021-10-08T19:35:09.105 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd reweight 0 1 2021-10-08T19:35:09.117 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:09.272 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'unique_pool_2' removed 2021-10-08T19:35:09.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:09 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/4011389486' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_2", "pool2": "unique_pool_2", "yes_i_really_really_mean_it": true}]: dispatch 2021-10-08T19:35:09.457 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:35:09.469 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:09.470 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:35:09.575 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:35:09.584 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset noscrub 2021-10-08T19:35:09.606 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:09 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/4011389486' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_2", "pool2": "unique_pool_2", "yes_i_really_really_mean_it": true}]: dispatch 2021-10-08T19:35:09.606 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:09 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/4011389486' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_2", "pool2": "unique_pool_2", "yes_i_really_really_mean_it": true}]: dispatch 2021-10-08T19:35:09.607 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:09.783 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:35:09.785 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:09.786 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:35:09.887 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:35:09.913 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:09.945 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2021-10-08T19:35:09.946 INFO:tasks.radosbench:Beginning radosbench... 2021-10-08T19:35:09.947 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_3 2021-10-08T19:35:09.947 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd pool create unique_pool_3 16 2021-10-08T19:35:09.961 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:35:09.976 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:35:10.015 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:35:10.017 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:10.018 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:35:10.119 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:35:10.147 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:10.327 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:35:10.327 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2021-10-08T19:35:10.327 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2021-10-08T19:35:10.327 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2021-10-08T19:35:10.328 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:35:10.350 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:35:10.355 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:10.356 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:35:10.409 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:10 smithi117 ceph-mon[34585]: pgmap v684: 178 pgs: 178 active+clean; 582 KiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:35:10.409 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:10 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/4011389486' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_2", "pool2": "unique_pool_2", "yes_i_really_really_mean_it": true}]': finished 2021-10-08T19:35:10.410 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:10 smithi117 ceph-mon[34585]: osdmap e352: 8 total, 8 up, 8 in 2021-10-08T19:35:10.458 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:35:10.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:10 smithi097 ceph-mon[41966]: pgmap v684: 178 pgs: 178 active+clean; 582 KiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:35:10.474 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:10 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/4011389486' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_2", "pool2": "unique_pool_2", "yes_i_really_really_mean_it": true}]': finished 2021-10-08T19:35:10.475 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:10 smithi097 ceph-mon[41966]: osdmap e352: 8 total, 8 up, 8 in 2021-10-08T19:35:10.475 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:10 smithi097 ceph-mon[32687]: pgmap v684: 178 pgs: 178 active+clean; 582 KiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:35:10.475 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:10 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/4011389486' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_2", "pool2": "unique_pool_2", "yes_i_really_really_mean_it": true}]': finished 2021-10-08T19:35:10.476 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:10 smithi097 ceph-mon[32687]: osdmap e352: 8 total, 8 up, 8 in 2021-10-08T19:35:10.482 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:10.734 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:35:10.737 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:10.738 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:35:10.804 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2021-10-08T19:35:10.839 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:35:10.867 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:11.120 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:35:11.193 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2021-10-08T19:35:11.228 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:35:11.236 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:11.236 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:35:11.337 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:35:11.360 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:11.413 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:35:11.413 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:11.414 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:35:11.508 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:35:11.516 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:35:11.541 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:11.720 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:35:11 smithi097 conmon[33110]: 172.21.15.117 - - [08/Oct/2021:19:35:11] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:35:11.808 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:35:11.810 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:11.810 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:35:11.911 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:35:11.939 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:11.986 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:35:11.988 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:11.989 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:35:12.007 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:11 smithi097 ceph-mon[41966]: pgmap v686: 162 pgs: 162 active+clean; 582 KiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:35:12.007 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:11 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:35:12.007 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:11 smithi097 ceph-mon[32687]: pgmap v686: 162 pgs: 162 active+clean; 582 KiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:35:12.008 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:11 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:35:12.093 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:35:12.102 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:35:12.104 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:11 smithi117 ceph-mon[34585]: pgmap v686: 162 pgs: 162 active+clean; 582 KiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:35:12.104 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:11 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:35:12.121 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:12.366 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:35:12.369 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:12.369 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:35:12.471 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:35:12.495 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:12.537 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:35:12.538 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:12.539 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:35:12.640 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:35:12.669 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:12.970 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:35:12 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:35:12] "GET /metrics HTTP/1.1" 200 154680 "" "Prometheus/2.18.1" 2021-10-08T19:35:12.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:12 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:35:12.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:12 smithi097 ceph-mon[32687]: 172.21.15.117 - - [08/Oct/2021:19:35:11] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:35:12.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:12 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:35:12.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:12 smithi097 ceph-mon[41966]: 172.21.15.117 - - [08/Oct/2021:19:35:11] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:35:13.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:12 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:35:13.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:12 smithi117 ceph-mon[34585]: 172.21.15.117 - - [08/Oct/2021:19:35:11] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:35:13.217 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:35:13.219 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:13.220 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:35:13.321 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:35:13.348 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:13.393 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:35:13.396 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:13.397 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:35:13.403 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:35:13.403 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2021-10-08T19:35:13.403 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2021-10-08T19:35:13.403 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2021-10-08T19:35:13.404 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.404 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.25465.0:50756 9.3 9:cf42c892:::benchmark_data_smithi097_196985_object50755:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e311)", 2021-10-08T19:35:13.405 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:32:15.147588+0000", 2021-10-08T19:35:13.405 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 178.25147941899999, 2021-10-08T19:35:13.405 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.18313448800000001, 2021-10-08T19:35:13.405 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:35:13.405 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:35:13.406 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:35:13.406 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.25465", 2021-10-08T19:35:13.406 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:35:13.406 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 50756 2021-10-08T19:35:13.407 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.407 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:35:13.407 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.407 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:35:13.407 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:15.147588+0000", 2021-10-08T19:35:13.408 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:35:13.408 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.408 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.408 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:35:13.408 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:15.147588+0000", 2021-10-08T19:35:13.409 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:35:13.409 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.409 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.409 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:35:13.410 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:15.147587+0000", 2021-10-08T19:35:13.410 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:35:13.410 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.410 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.410 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:35:13.411 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:15.147615+0000", 2021-10-08T19:35:13.411 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8030000000000001e-05 2021-10-08T19:35:13.411 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.411 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.412 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:35:13.412 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:15.147621+0000", 2021-10-08T19:35:13.412 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9399999999999999e-06 2021-10-08T19:35:13.412 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.413 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.413 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:35:13.413 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:15.147625+0000", 2021-10-08T19:35:13.413 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2359999999999998e-06 2021-10-08T19:35:13.413 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.414 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.414 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:35:13.415 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:15.147679+0000", 2021-10-08T19:35:13.415 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4271999999999998e-05 2021-10-08T19:35:13.415 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.415 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.416 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:35:13.416 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:15.147801+0000", 2021-10-08T19:35:13.416 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000121947 2021-10-08T19:35:13.416 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.417 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.417 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 1,3", 2021-10-08T19:35:13.417 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:15.147941+0000", 2021-10-08T19:35:13.417 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013947100000000001 2021-10-08T19:35:13.417 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.418 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.418 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:35:13.418 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:15.152447+0000", 2021-10-08T19:35:13.418 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0045064459999999999 2021-10-08T19:35:13.419 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.419 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.419 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:35:13.420 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:15.152700+0000", 2021-10-08T19:35:13.421 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00025262700000000001 2021-10-08T19:35:13.421 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.422 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.422 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:35:13.422 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:15.330627+0000", 2021-10-08T19:35:13.422 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.17792706699999999 2021-10-08T19:35:13.423 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.423 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.423 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:35:13.423 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:15.330681+0000", 2021-10-08T19:35:13.424 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4188999999999999e-05 2021-10-08T19:35:13.424 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.424 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.425 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:35:13.425 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:15.330722+0000", 2021-10-08T19:35:13.425 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.108e-05 2021-10-08T19:35:13.425 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:35:13.425 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:35:13.426 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:35:13.426 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.426 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.426 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:77499 9.5 e316/290 9:ac4969c9:::benchmark_data_smithi097_196985_object77498:head v 316'4760, mlcod=316'4757)", 2021-10-08T19:35:13.427 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:32:38.370431+0000", 2021-10-08T19:35:13.427 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 155.02863605300001, 2021-10-08T19:35:13.427 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.21244118000000001, 2021-10-08T19:35:13.427 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:35:13.427 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:35:13.428 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:35:13.428 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.428 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:35:13.428 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370431+0000", 2021-10-08T19:35:13.428 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:35:13.429 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.429 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.429 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:35:13.429 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370431+0000", 2021-10-08T19:35:13.430 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:35:13.430 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.430 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.430 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:35:13.430 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370430+0000", 2021-10-08T19:35:13.431 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:35:13.431 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.431 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.431 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:35:13.431 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370481+0000", 2021-10-08T19:35:13.432 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1430000000000001e-05 2021-10-08T19:35:13.432 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.433 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.433 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:35:13.433 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370492+0000", 2021-10-08T19:35:13.433 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0755e-05 2021-10-08T19:35:13.434 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.434 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.434 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:35:13.434 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370498+0000", 2021-10-08T19:35:13.434 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4869999999999999e-06 2021-10-08T19:35:13.435 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.435 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.435 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:35:13.435 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370541+0000", 2021-10-08T19:35:13.435 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2460999999999999e-05 2021-10-08T19:35:13.436 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.436 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.436 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:35:13.436 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370559+0000", 2021-10-08T19:35:13.437 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8150000000000001e-05 2021-10-08T19:35:13.437 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.437 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.437 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:35:13.437 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.582843+0000", 2021-10-08T19:35:13.438 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.21228397099999999 2021-10-08T19:35:13.438 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.438 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.438 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:35:13.438 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.582872+0000", 2021-10-08T19:35:13.439 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9221e-05 2021-10-08T19:35:13.439 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:35:13.439 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:35:13.439 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:35:13.440 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.440 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.440 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:77507 9.c e316/290 9:3c2e9901:::benchmark_data_smithi097_196985_object77506:head v 316'4807, mlcod=316'4804)", 2021-10-08T19:35:13.440 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:32:38.370481+0000", 2021-10-08T19:35:13.440 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 155.028586305, 2021-10-08T19:35:13.441 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.210201309, 2021-10-08T19:35:13.441 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:35:13.441 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:35:13.441 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:35:13.442 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.442 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:35:13.442 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370481+0000", 2021-10-08T19:35:13.442 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:35:13.443 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.443 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.443 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:35:13.444 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370481+0000", 2021-10-08T19:35:13.444 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:35:13.444 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.444 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.445 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:35:13.445 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370480+0000", 2021-10-08T19:35:13.445 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999995 2021-10-08T19:35:13.445 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.445 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.446 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:35:13.446 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370508+0000", 2021-10-08T19:35:13.446 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7653000000000001e-05 2021-10-08T19:35:13.446 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.447 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.447 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:35:13.447 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370514+0000", 2021-10-08T19:35:13.447 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1920000000000002e-06 2021-10-08T19:35:13.447 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.448 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.448 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:35:13.448 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370519+0000", 2021-10-08T19:35:13.448 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.113e-06 2021-10-08T19:35:13.449 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.449 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.449 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:35:13.449 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370630+0000", 2021-10-08T19:35:13.449 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000110925 2021-10-08T19:35:13.450 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.450 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.450 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:35:13.450 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370649+0000", 2021-10-08T19:35:13.451 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9063999999999999e-05 2021-10-08T19:35:13.451 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.451 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.451 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:35:13.451 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.377750+0000", 2021-10-08T19:35:13.452 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0071006710000000002 2021-10-08T19:35:13.452 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.452 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.452 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:35:13.453 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580682+0000", 2021-10-08T19:35:13.453 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.202932268 2021-10-08T19:35:13.453 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:35:13.454 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:35:13.454 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:35:13.454 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.454 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.455 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:77503 9.5 e316/290 9:a86a20e3:::benchmark_data_smithi097_196985_object77502:head v 316'4761, mlcod=316'4758)", 2021-10-08T19:35:13.455 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:32:38.372458+0000", 2021-10-08T19:35:13.455 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 155.02660917200001, 2021-10-08T19:35:13.455 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.210430539, 2021-10-08T19:35:13.455 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:35:13.456 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:35:13.456 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:35:13.456 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.456 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:35:13.457 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.372458+0000", 2021-10-08T19:35:13.457 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:35:13.457 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.457 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.457 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:35:13.458 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.372458+0000", 2021-10-08T19:35:13.458 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:35:13.458 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.458 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.458 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:35:13.459 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.372457+0000", 2021-10-08T19:35:13.459 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:35:13.459 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.459 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.460 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:35:13.460 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.372492+0000", 2021-10-08T19:35:13.460 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.5354000000000001e-05 2021-10-08T19:35:13.460 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.460 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.461 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:35:13.461 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.372502+0000", 2021-10-08T19:35:13.461 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8810000000000008e-06 2021-10-08T19:35:13.461 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.461 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.462 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:35:13.462 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.372508+0000", 2021-10-08T19:35:13.462 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3069999999999999e-06 2021-10-08T19:35:13.462 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.463 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.463 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:35:13.463 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.372792+0000", 2021-10-08T19:35:13.463 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00028411499999999999 2021-10-08T19:35:13.463 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.464 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.464 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:35:13.464 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.372804+0000", 2021-10-08T19:35:13.464 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2058e-05 2021-10-08T19:35:13.464 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.465 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.465 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:35:13.465 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.582875+0000", 2021-10-08T19:35:13.465 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.210070701 2021-10-08T19:35:13.466 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.466 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.466 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:35:13.466 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.582888+0000", 2021-10-08T19:35:13.466 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3345e-05 2021-10-08T19:35:13.467 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:35:13.467 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:35:13.467 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:35:13.467 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.467 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.468 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:77509 9.5 e316/290 9:a04d875b:::benchmark_data_smithi097_196985_object77508:head v 316'4762, mlcod=316'4758)", 2021-10-08T19:35:13.468 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:32:38.373454+0000", 2021-10-08T19:35:13.468 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 155.025612978, 2021-10-08T19:35:13.468 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.20948882399999999, 2021-10-08T19:35:13.469 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:35:13.469 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:35:13.469 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:35:13.469 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.469 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:35:13.470 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.373454+0000", 2021-10-08T19:35:13.470 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:35:13.470 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.470 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.470 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:35:13.471 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.373454+0000", 2021-10-08T19:35:13.471 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:35:13.471 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.471 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.472 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:35:13.472 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.373453+0000", 2021-10-08T19:35:13.472 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:35:13.472 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.472 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.473 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:35:13.473 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.373614+0000", 2021-10-08T19:35:13.473 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016036300000000001 2021-10-08T19:35:13.473 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.473 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.474 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:35:13.474 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.373627+0000", 2021-10-08T19:35:13.474 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3759e-05 2021-10-08T19:35:13.474 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.474 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.475 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:35:13.475 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.373631+0000", 2021-10-08T19:35:13.475 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.019e-06 2021-10-08T19:35:13.475 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.475 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.476 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:35:13.476 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.375396+0000", 2021-10-08T19:35:13.476 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0017641810000000001 2021-10-08T19:35:13.477 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.477 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.477 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:35:13.477 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.375414+0000", 2021-10-08T19:35:13.477 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8949000000000001e-05 2021-10-08T19:35:13.478 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.478 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.478 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:35:13.478 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.582929+0000", 2021-10-08T19:35:13.478 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.20751492799999999 2021-10-08T19:35:13.479 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.479 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.479 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:35:13.479 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.582943+0000", 2021-10-08T19:35:13.480 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3382e-05 2021-10-08T19:35:13.480 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:35:13.480 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:35:13.480 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:35:13.480 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.481 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.481 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:77510 9.c e316/290 9:3e9f4d30:::benchmark_data_smithi097_196985_object77509:head v 316'4808, mlcod=316'4804)", 2021-10-08T19:35:13.481 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:32:38.373489+0000", 2021-10-08T19:35:13.481 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 155.025577618, 2021-10-08T19:35:13.482 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.20722019899999999, 2021-10-08T19:35:13.482 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:35:13.482 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:35:13.482 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:35:13.482 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.483 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:35:13.483 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.373489+0000", 2021-10-08T19:35:13.483 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:35:13.483 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.484 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.484 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:35:13.484 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.373489+0000", 2021-10-08T19:35:13.484 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:35:13.484 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.485 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.485 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:35:13.485 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.373489+0000", 2021-10-08T19:35:13.485 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:35:13.485 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.486 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.486 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:35:13.486 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.373614+0000", 2021-10-08T19:35:13.486 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012516400000000001 2021-10-08T19:35:13.486 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.487 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.487 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:35:13.487 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.373624+0000", 2021-10-08T19:35:13.487 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0078000000000001e-05 2021-10-08T19:35:13.488 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.488 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.488 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:35:13.488 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.373630+0000", 2021-10-08T19:35:13.489 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9349999999999999e-06 2021-10-08T19:35:13.489 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.489 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.489 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:35:13.490 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.373791+0000", 2021-10-08T19:35:13.490 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016118299999999999 2021-10-08T19:35:13.490 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.490 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.490 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:35:13.491 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.373808+0000", 2021-10-08T19:35:13.491 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7280999999999999e-05 2021-10-08T19:35:13.491 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.491 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.491 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:35:13.492 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580687+0000", 2021-10-08T19:35:13.492 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.20687856399999999 2021-10-08T19:35:13.492 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.492 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.493 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:35:13.493 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580710+0000", 2021-10-08T19:35:13.493 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2738000000000002e-05 2021-10-08T19:35:13.493 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:35:13.493 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:35:13.494 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:35:13.494 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.494 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.494 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.25465.0:77517 9.d 9:b7278e79:::benchmark_data_smithi097_196985_object77516:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e316)", 2021-10-08T19:35:13.494 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:32:38.375271+0000", 2021-10-08T19:35:13.495 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 155.02379563100001, 2021-10-08T19:35:13.495 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.214728957, 2021-10-08T19:35:13.495 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:35:13.495 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:35:13.496 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:35:13.496 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.25465", 2021-10-08T19:35:13.496 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:35:13.496 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 77517 2021-10-08T19:35:13.496 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.497 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:35:13.497 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.497 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:35:13.497 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.375271+0000", 2021-10-08T19:35:13.498 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:35:13.498 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.498 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.498 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:35:13.499 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.375271+0000", 2021-10-08T19:35:13.499 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:35:13.499 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.499 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.499 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:35:13.500 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.375269+0000", 2021-10-08T19:35:13.500 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:35:13.500 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.500 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.500 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:35:13.501 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.375303+0000", 2021-10-08T19:35:13.501 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.3868999999999997e-05 2021-10-08T19:35:13.501 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.501 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.501 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:35:13.502 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.375315+0000", 2021-10-08T19:35:13.502 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1728e-05 2021-10-08T19:35:13.502 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.502 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.503 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:35:13.503 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.375321+0000", 2021-10-08T19:35:13.503 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7499999999999997e-06 2021-10-08T19:35:13.503 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.503 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.504 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:35:13.504 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.377409+0000", 2021-10-08T19:35:13.504 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020878939999999999 2021-10-08T19:35:13.504 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.504 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.505 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:35:13.505 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.377528+0000", 2021-10-08T19:35:13.505 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000118972 2021-10-08T19:35:13.505 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.505 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.506 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 1,5", 2021-10-08T19:35:13.506 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.377696+0000", 2021-10-08T19:35:13.506 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016830600000000001 2021-10-08T19:35:13.506 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.507 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.507 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:35:13.507 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.582927+0000", 2021-10-08T19:35:13.507 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.205230724 2021-10-08T19:35:13.507 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.508 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.508 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:35:13.508 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.584639+0000", 2021-10-08T19:35:13.508 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001711808 2021-10-08T19:35:13.508 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.509 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.509 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:35:13.509 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.589921+0000", 2021-10-08T19:35:13.509 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0052821830000000002 2021-10-08T19:35:13.509 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.510 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.510 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:35:13.510 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.589964+0000", 2021-10-08T19:35:13.510 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.3319000000000003e-05 2021-10-08T19:35:13.511 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.511 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.511 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:35:13.511 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.590000+0000", 2021-10-08T19:35:13.511 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.5793000000000001e-05 2021-10-08T19:35:13.512 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:35:13.512 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:35:13.512 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:35:13.512 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.512 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.513 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:77518 9.9 e316/290 9:9bd075f7:::benchmark_data_smithi097_196985_object77517:head v 316'4852, mlcod=316'4850)", 2021-10-08T19:35:13.513 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:32:38.376302+0000", 2021-10-08T19:35:13.513 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 155.02276478499999, 2021-10-08T19:35:13.513 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.20439987900000001, 2021-10-08T19:35:13.514 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:35:13.514 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:35:13.514 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:35:13.514 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.515 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:35:13.515 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.376302+0000", 2021-10-08T19:35:13.515 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:35:13.515 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.516 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.516 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:35:13.516 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.376302+0000", 2021-10-08T19:35:13.516 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:35:13.516 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.517 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.517 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:35:13.517 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.376299+0000", 2021-10-08T19:35:13.517 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999967 2021-10-08T19:35:13.517 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.518 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.518 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:35:13.518 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.376325+0000", 2021-10-08T19:35:13.518 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6188000000000001e-05 2021-10-08T19:35:13.519 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.519 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.519 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:35:13.519 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.376333+0000", 2021-10-08T19:35:13.519 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9160000000000001e-06 2021-10-08T19:35:13.520 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.520 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.520 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:35:13.520 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.376337+0000", 2021-10-08T19:35:13.520 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1930000000000003e-06 2021-10-08T19:35:13.521 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.521 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.521 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:35:13.521 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.376378+0000", 2021-10-08T19:35:13.522 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0917999999999997e-05 2021-10-08T19:35:13.522 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.522 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.522 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:35:13.522 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.376398+0000", 2021-10-08T19:35:13.523 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9882999999999999e-05 2021-10-08T19:35:13.523 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.523 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.523 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:35:13.523 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580668+0000", 2021-10-08T19:35:13.524 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.204270813 2021-10-08T19:35:13.524 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.524 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.524 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:35:13.524 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580702+0000", 2021-10-08T19:35:13.525 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.3528000000000002e-05 2021-10-08T19:35:13.525 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:35:13.525 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:35:13.525 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:35:13.525 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.526 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.526 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:77511 9.1 e316/290 9:84400f31:::benchmark_data_smithi097_196985_object77510:head v 316'4798, mlcod=316'4795)", 2021-10-08T19:35:13.526 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:32:38.377524+0000", 2021-10-08T19:35:13.526 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 155.02154322199999, 2021-10-08T19:35:13.527 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.20320565800000001, 2021-10-08T19:35:13.527 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:35:13.527 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:35:13.527 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:35:13.527 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.528 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:35:13.528 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.377524+0000", 2021-10-08T19:35:13.528 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:35:13.528 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.528 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.529 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:35:13.529 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.377524+0000", 2021-10-08T19:35:13.529 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:35:13.529 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.529 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.530 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:35:13.530 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.377523+0000", 2021-10-08T19:35:13.530 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999995 2021-10-08T19:35:13.530 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.530 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.531 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:35:13.531 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.377552+0000", 2021-10-08T19:35:13.531 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9136e-05 2021-10-08T19:35:13.531 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.532 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.532 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:35:13.532 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.377558+0000", 2021-10-08T19:35:13.532 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.959e-06 2021-10-08T19:35:13.532 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.533 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.533 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:35:13.533 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.377562+0000", 2021-10-08T19:35:13.533 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0090000000000001e-06 2021-10-08T19:35:13.533 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.534 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.534 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:35:13.534 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.377638+0000", 2021-10-08T19:35:13.534 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5498000000000001e-05 2021-10-08T19:35:13.534 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.535 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.535 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:35:13.535 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.377656+0000", 2021-10-08T19:35:13.535 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8423999999999998e-05 2021-10-08T19:35:13.536 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.536 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.536 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:35:13.536 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580708+0000", 2021-10-08T19:35:13.536 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.20305161199999999 2021-10-08T19:35:13.537 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.537 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.537 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:35:13.537 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580729+0000", 2021-10-08T19:35:13.537 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1585000000000001e-05 2021-10-08T19:35:13.538 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:35:13.538 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:35:13.538 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:35:13.538 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.538 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.539 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:77514 9.1 e316/290 9:8c08759a:::benchmark_data_smithi097_196985_object77513:head v 316'4799, mlcod=316'4796)", 2021-10-08T19:35:13.539 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:32:38.380203+0000", 2021-10-08T19:35:13.539 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 155.01886368699999, 2021-10-08T19:35:13.539 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.20752410600000001, 2021-10-08T19:35:13.539 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:35:13.540 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:35:13.540 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:35:13.540 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.540 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:35:13.541 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.380203+0000", 2021-10-08T19:35:13.541 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:35:13.541 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.541 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.541 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:35:13.542 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.380203+0000", 2021-10-08T19:35:13.542 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:35:13.542 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.542 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.542 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:35:13.543 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.380202+0000", 2021-10-08T19:35:13.543 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:35:13.543 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.543 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.543 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:35:13.544 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.380266+0000", 2021-10-08T19:35:13.544 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4292e-05 2021-10-08T19:35:13.544 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.544 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.545 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:35:13.545 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580625+0000", 2021-10-08T19:35:13.545 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.20035874300000001 2021-10-08T19:35:13.545 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.545 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.546 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:35:13.546 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580647+0000", 2021-10-08T19:35:13.546 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1883e-05 2021-10-08T19:35:13.546 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.546 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.547 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:35:13.547 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580750+0000", 2021-10-08T19:35:13.547 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000102703 2021-10-08T19:35:13.547 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.548 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.548 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:35:13.548 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580766+0000", 2021-10-08T19:35:13.548 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6155e-05 2021-10-08T19:35:13.548 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.549 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.549 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:35:13.549 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.587680+0000", 2021-10-08T19:35:13.549 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0069146219999999996 2021-10-08T19:35:13.549 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.550 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.550 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:35:13.550 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.587727+0000", 2021-10-08T19:35:13.550 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7018000000000003e-05 2021-10-08T19:35:13.550 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:35:13.551 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:35:13.551 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:35:13.551 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.551 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.551 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop_reply(client.25465.0:77517 9.d e316/308 ondisk, result = 0)", 2021-10-08T19:35:13.552 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:32:38.380417+0000", 2021-10-08T19:35:13.552 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 155.01864962900001, 2021-10-08T19:35:13.552 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.202527015, 2021-10-08T19:35:13.552 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:35:13.553 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2021-10-08T19:35:13.553 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:35:13.553 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.553 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:35:13.553 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.380417+0000", 2021-10-08T19:35:13.554 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:35:13.554 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.554 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.554 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:35:13.554 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.380417+0000", 2021-10-08T19:35:13.555 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:35:13.555 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.555 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.555 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:35:13.555 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.380416+0000", 2021-10-08T19:35:13.556 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:35:13.556 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.556 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.556 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:35:13.557 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.380422+0000", 2021-10-08T19:35:13.557 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5339999999999999e-06 2021-10-08T19:35:13.557 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.557 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.557 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:35:13.558 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580587+0000", 2021-10-08T19:35:13.558 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.200164861 2021-10-08T19:35:13.558 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.558 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.558 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:35:13.559 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580618+0000", 2021-10-08T19:35:13.559 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.1516000000000001e-05 2021-10-08T19:35:13.559 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.559 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.560 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:35:13.560 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.582913+0000", 2021-10-08T19:35:13.560 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022951719999999998 2021-10-08T19:35:13.560 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.560 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.561 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:35:13.561 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.582920+0000", 2021-10-08T19:35:13.561 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1300000000000003e-06 2021-10-08T19:35:13.561 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.561 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.562 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:35:13.562 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.582944+0000", 2021-10-08T19:35:13.562 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3972e-05 2021-10-08T19:35:13.562 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:35:13.562 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:35:13.563 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:35:13.563 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.563 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.564 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:77532 9.9 e316/290 9:9ff58f88:::benchmark_data_smithi097_196985_object77531:head v 316'4853, mlcod=316'4850)", 2021-10-08T19:35:13.564 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:32:38.395624+0000", 2021-10-08T19:35:13.564 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 155.00344257099999, 2021-10-08T19:35:13.564 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.192136736, 2021-10-08T19:35:13.564 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:35:13.565 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:35:13.565 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:35:13.565 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.565 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:35:13.566 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.395624+0000", 2021-10-08T19:35:13.566 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:35:13.566 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.566 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.566 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:35:13.567 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.395624+0000", 2021-10-08T19:35:13.567 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:35:13.567 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.567 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.567 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:35:13.568 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.395622+0000", 2021-10-08T19:35:13.568 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:35:13.568 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.569 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.569 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:35:13.570 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.395684+0000", 2021-10-08T19:35:13.570 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1247000000000005e-05 2021-10-08T19:35:13.571 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.571 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.571 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:35:13.572 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580588+0000", 2021-10-08T19:35:13.572 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.18490478199999999 2021-10-08T19:35:13.572 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.572 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.572 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:35:13.573 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580644+0000", 2021-10-08T19:35:13.573 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5415999999999999e-05 2021-10-08T19:35:13.573 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.573 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.574 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:35:13.574 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580726+0000", 2021-10-08T19:35:13.574 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2120999999999995e-05 2021-10-08T19:35:13.574 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.575 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.575 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:35:13.575 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580747+0000", 2021-10-08T19:35:13.575 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0856000000000002e-05 2021-10-08T19:35:13.575 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.576 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.576 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:35:13.576 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.587731+0000", 2021-10-08T19:35:13.576 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0069841850000000004 2021-10-08T19:35:13.577 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.577 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.577 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:35:13.577 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.587761+0000", 2021-10-08T19:35:13.578 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.0134999999999999e-05 2021-10-08T19:35:13.578 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:35:13.578 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:35:13.578 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:35:13.579 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.579 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.579 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.25465.0:169834 9.d 9:b89d2b99:::benchmark_data_smithi097_196985_object54143:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e334)", 2021-10-08T19:35:13.579 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:34:02.167884+0000", 2021-10-08T19:35:13.580 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 71.231183357000006, 2021-10-08T19:35:13.580 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.17812953400000001, 2021-10-08T19:35:13.580 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:35:13.580 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:35:13.581 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:35:13.581 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.25465", 2021-10-08T19:35:13.581 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:35:13.581 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 169834 2021-10-08T19:35:13.581 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.582 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:35:13.582 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.582 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:35:13.582 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.167884+0000", 2021-10-08T19:35:13.583 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:35:13.583 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.583 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.583 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:35:13.583 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.167884+0000", 2021-10-08T19:35:13.584 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:35:13.584 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.584 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.584 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:35:13.585 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.167882+0000", 2021-10-08T19:35:13.585 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:35:13.585 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.585 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.585 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:35:13.586 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.167888+0000", 2021-10-08T19:35:13.586 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9900000000000002e-06 2021-10-08T19:35:13.586 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.586 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.587 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:35:13.587 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.167898+0000", 2021-10-08T19:35:13.587 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0148e-05 2021-10-08T19:35:13.587 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.588 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.588 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:35:13.588 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.167903+0000", 2021-10-08T19:35:13.588 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.6210000000000003e-06 2021-10-08T19:35:13.588 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.589 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.589 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:35:13.589 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.167936+0000", 2021-10-08T19:35:13.589 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.3404000000000001e-05 2021-10-08T19:35:13.590 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.590 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.590 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:35:13.590 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.168052+0000", 2021-10-08T19:35:13.591 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000116078 2021-10-08T19:35:13.591 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.591 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.591 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 1,5", 2021-10-08T19:35:13.591 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.168130+0000", 2021-10-08T19:35:13.592 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.7768000000000005e-05 2021-10-08T19:35:13.592 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.592 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.592 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:35:13.593 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.172735+0000", 2021-10-08T19:35:13.593 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046050509999999998 2021-10-08T19:35:13.593 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.593 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.593 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:35:13.594 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.173657+0000", 2021-10-08T19:35:13.594 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00092227699999999999 2021-10-08T19:35:13.594 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.594 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.595 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:35:13.595 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.345917+0000", 2021-10-08T19:35:13.595 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.17225993100000001 2021-10-08T19:35:13.595 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.596 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.596 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:35:13.596 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.345975+0000", 2021-10-08T19:35:13.596 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7921000000000003e-05 2021-10-08T19:35:13.596 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.597 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.597 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:35:13.597 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.346013+0000", 2021-10-08T19:35:13.597 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7981000000000001e-05 2021-10-08T19:35:13.598 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:35:13.598 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:35:13.598 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:35:13.598 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.598 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.599 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.25465.0:169835 9.3 9:cc4ebcfb:::benchmark_data_smithi097_196985_object54144:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e334)", 2021-10-08T19:35:13.599 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:34:02.167920+0000", 2021-10-08T19:35:13.599 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 71.231146718000005, 2021-10-08T19:35:13.599 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.17812224500000001, 2021-10-08T19:35:13.600 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:35:13.600 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:35:13.600 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:35:13.600 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.25465", 2021-10-08T19:35:13.601 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:35:13.601 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 169835 2021-10-08T19:35:13.601 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.601 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:35:13.601 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.602 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:35:13.602 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.167920+0000", 2021-10-08T19:35:13.602 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:35:13.602 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.603 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.603 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:35:13.603 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.167920+0000", 2021-10-08T19:35:13.603 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:35:13.604 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.604 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.604 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:35:13.604 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.167919+0000", 2021-10-08T19:35:13.604 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:35:13.605 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.605 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.605 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:35:13.605 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.167923+0000", 2021-10-08T19:35:13.605 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.738e-06 2021-10-08T19:35:13.606 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.606 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.606 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:35:13.606 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.167929+0000", 2021-10-08T19:35:13.607 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.835e-06 2021-10-08T19:35:13.607 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.607 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.607 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:35:13.608 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.167933+0000", 2021-10-08T19:35:13.608 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.3100000000000002e-06 2021-10-08T19:35:13.608 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.608 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.608 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:35:13.609 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.167986+0000", 2021-10-08T19:35:13.609 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.3077e-05 2021-10-08T19:35:13.609 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.609 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.610 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:35:13.610 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.168113+0000", 2021-10-08T19:35:13.610 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000127016 2021-10-08T19:35:13.610 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.610 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.611 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 1,3", 2021-10-08T19:35:13.611 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.168242+0000", 2021-10-08T19:35:13.611 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012833300000000001 2021-10-08T19:35:13.611 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.611 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.612 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:35:13.612 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.172455+0000", 2021-10-08T19:35:13.612 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042135549999999999 2021-10-08T19:35:13.612 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.613 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.613 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:35:13.613 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.175142+0000", 2021-10-08T19:35:13.613 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0026870610000000001 2021-10-08T19:35:13.613 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.614 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.614 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:35:13.614 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.345944+0000", 2021-10-08T19:35:13.614 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.170801182 2021-10-08T19:35:13.615 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.615 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.615 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:35:13.615 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.346001+0000", 2021-10-08T19:35:13.615 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7509000000000001e-05 2021-10-08T19:35:13.616 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.616 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.616 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:35:13.616 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.346042+0000", 2021-10-08T19:35:13.617 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1389e-05 2021-10-08T19:35:13.617 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:35:13.617 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:35:13.617 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:35:13.617 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.618 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.618 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.25465.0:169838 9.3 9:cc713d20:::benchmark_data_smithi097_196985_object54147:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e334)", 2021-10-08T19:35:13.618 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:34:02.168016+0000", 2021-10-08T19:35:13.618 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 71.231050518000004, 2021-10-08T19:35:13.619 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.18378728999999999, 2021-10-08T19:35:13.619 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:35:13.619 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:35:13.619 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:35:13.619 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.25465", 2021-10-08T19:35:13.620 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:35:13.620 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 169838 2021-10-08T19:35:13.620 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.620 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:35:13.620 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.621 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:35:13.621 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.168016+0000", 2021-10-08T19:35:13.621 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:35:13.621 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.622 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.622 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:35:13.622 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.168016+0000", 2021-10-08T19:35:13.622 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:35:13.622 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.623 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.623 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:35:13.623 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.168015+0000", 2021-10-08T19:35:13.623 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:35:13.624 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.624 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.624 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:35:13.624 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.168020+0000", 2021-10-08T19:35:13.624 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.651e-06 2021-10-08T19:35:13.625 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.625 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.625 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:35:13.625 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.168028+0000", 2021-10-08T19:35:13.625 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4300000000000006e-06 2021-10-08T19:35:13.626 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.626 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.626 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:35:13.626 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.168034+0000", 2021-10-08T19:35:13.627 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6500000000000001e-06 2021-10-08T19:35:13.627 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.627 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.627 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:35:13.627 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.170324+0000", 2021-10-08T19:35:13.628 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022904560000000002 2021-10-08T19:35:13.628 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.628 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.628 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:35:13.629 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.170455+0000", 2021-10-08T19:35:13.629 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013018900000000001 2021-10-08T19:35:13.629 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.629 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.629 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 1,3", 2021-10-08T19:35:13.630 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.170588+0000", 2021-10-08T19:35:13.630 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000133814 2021-10-08T19:35:13.630 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.630 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.631 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:35:13.631 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.172605+0000", 2021-10-08T19:35:13.631 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002016847 2021-10-08T19:35:13.631 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.631 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.632 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:35:13.632 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.176258+0000", 2021-10-08T19:35:13.632 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036532439999999999 2021-10-08T19:35:13.632 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.633 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.633 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:35:13.633 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.351710+0000", 2021-10-08T19:35:13.633 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.175451194 2021-10-08T19:35:13.634 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.634 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.634 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:35:13.634 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.351762+0000", 2021-10-08T19:35:13.634 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2623000000000001e-05 2021-10-08T19:35:13.635 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.635 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.635 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:35:13.635 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.351804+0000", 2021-10-08T19:35:13.636 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1440000000000003e-05 2021-10-08T19:35:13.636 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:35:13.636 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:35:13.636 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:35:13.636 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.637 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.637 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.25465.0:169841 9.d 9:b8132437:::benchmark_data_smithi097_196985_object54150:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e334)", 2021-10-08T19:35:13.637 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:34:02.168177+0000", 2021-10-08T19:35:13.637 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 71.230889997999995, 2021-10-08T19:35:13.638 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.18269624500000001, 2021-10-08T19:35:13.638 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:35:13.638 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:35:13.638 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:35:13.638 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.25465", 2021-10-08T19:35:13.639 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:35:13.639 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 169841 2021-10-08T19:35:13.639 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.639 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:35:13.640 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.640 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:35:13.640 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.168177+0000", 2021-10-08T19:35:13.640 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:35:13.640 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.641 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.641 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:35:13.641 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.168177+0000", 2021-10-08T19:35:13.641 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:35:13.642 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.642 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.642 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:35:13.642 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.168176+0000", 2021-10-08T19:35:13.643 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:35:13.643 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.643 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.643 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:35:13.643 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.168180+0000", 2021-10-08T19:35:13.644 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4950000000000002e-06 2021-10-08T19:35:13.644 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.644 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.644 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:35:13.645 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.168187+0000", 2021-10-08T19:35:13.645 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1099999999999997e-06 2021-10-08T19:35:13.645 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.645 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.646 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:35:13.646 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.168193+0000", 2021-10-08T19:35:13.646 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2510000000000002e-06 2021-10-08T19:35:13.646 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.646 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.647 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:35:13.647 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.170545+0000", 2021-10-08T19:35:13.647 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0023527130000000002 2021-10-08T19:35:13.647 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.648 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.648 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:35:13.648 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.170621+0000", 2021-10-08T19:35:13.648 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6001999999999995e-05 2021-10-08T19:35:13.649 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.649 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.649 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 1,5", 2021-10-08T19:35:13.649 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.170751+0000", 2021-10-08T19:35:13.649 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012955400000000001 2021-10-08T19:35:13.650 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.650 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.650 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:35:13.650 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.173676+0000", 2021-10-08T19:35:13.651 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0029249079999999999 2021-10-08T19:35:13.651 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.651 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.651 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:35:13.651 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.173715+0000", 2021-10-08T19:35:13.652 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9578e-05 2021-10-08T19:35:13.652 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.652 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.652 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:35:13.653 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.350786+0000", 2021-10-08T19:35:13.653 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.17707047400000001 2021-10-08T19:35:13.653 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.653 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.653 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:35:13.654 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.350836+0000", 2021-10-08T19:35:13.654 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9673999999999999e-05 2021-10-08T19:35:13.654 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.654 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.654 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:35:13.655 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.350873+0000", 2021-10-08T19:35:13.655 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7602999999999999e-05 2021-10-08T19:35:13.655 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:35:13.655 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:35:13.656 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:35:13.656 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.656 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.656 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:209975 9.1 e343/290 9:89bb0ba3:::benchmark_data_smithi097_196985_object94284:head v 343'12999, mlcod=343'12997)", 2021-10-08T19:35:13.656 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:34:38.428534+0000", 2021-10-08T19:35:13.657 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 34.970533052999997, 2021-10-08T19:35:13.657 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.236116147, 2021-10-08T19:35:13.657 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:35:13.657 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:35:13.658 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:35:13.658 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.658 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:35:13.658 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.428534+0000", 2021-10-08T19:35:13.658 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:35:13.659 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.659 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.659 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:35:13.659 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.428534+0000", 2021-10-08T19:35:13.660 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:35:13.660 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.660 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.660 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:35:13.660 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.428533+0000", 2021-10-08T19:35:13.661 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:35:13.661 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.661 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.661 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:35:13.662 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.428540+0000", 2021-10-08T19:35:13.662 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.109e-06 2021-10-08T19:35:13.662 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.662 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.662 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:35:13.663 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.428549+0000", 2021-10-08T19:35:13.663 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3249999999999997e-06 2021-10-08T19:35:13.663 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.664 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.664 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:35:13.664 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.428555+0000", 2021-10-08T19:35:13.664 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8220000000000003e-06 2021-10-08T19:35:13.664 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.665 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.665 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:35:13.665 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.428601+0000", 2021-10-08T19:35:13.665 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5527e-05 2021-10-08T19:35:13.666 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.666 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.666 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:35:13.666 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.428618+0000", 2021-10-08T19:35:13.667 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7547e-05 2021-10-08T19:35:13.667 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.667 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.667 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:35:13.667 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.664627+0000", 2021-10-08T19:35:13.668 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.23600927099999999 2021-10-08T19:35:13.668 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.668 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.668 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:35:13.668 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.664650+0000", 2021-10-08T19:35:13.669 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2654999999999999e-05 2021-10-08T19:35:13.669 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:35:13.669 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:35:13.669 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:35:13.670 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.670 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.670 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:209977 9.a e343/290 9:575a8bb2:::benchmark_data_smithi097_196985_object94286:head v 343'13104, mlcod=343'13101)", 2021-10-08T19:35:13.670 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:34:38.431569+0000", 2021-10-08T19:35:13.670 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 34.967497737999999, 2021-10-08T19:35:13.671 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.234467443, 2021-10-08T19:35:13.671 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:35:13.671 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:35:13.671 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:35:13.672 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.672 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:35:13.672 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.431569+0000", 2021-10-08T19:35:13.672 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:35:13.673 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.673 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.673 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:35:13.673 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.431569+0000", 2021-10-08T19:35:13.673 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:35:13.674 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.674 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.674 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:35:13.674 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.431568+0000", 2021-10-08T19:35:13.674 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:35:13.675 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.675 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.675 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:35:13.675 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.431574+0000", 2021-10-08T19:35:13.676 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0970000000000002e-06 2021-10-08T19:35:13.676 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.676 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.676 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:35:13.676 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.661194+0000", 2021-10-08T19:35:13.677 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.229619776 2021-10-08T19:35:13.677 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.677 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.677 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:35:13.678 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.661212+0000", 2021-10-08T19:35:13.678 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8576e-05 2021-10-08T19:35:13.678 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.678 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.678 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:35:13.679 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.661306+0000", 2021-10-08T19:35:13.679 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3208000000000006e-05 2021-10-08T19:35:13.679 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.679 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.680 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:35:13.680 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.661367+0000", 2021-10-08T19:35:13.680 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1753000000000003e-05 2021-10-08T19:35:13.680 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.680 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.681 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:35:13.681 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.666011+0000", 2021-10-08T19:35:13.681 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046439899999999998 2021-10-08T19:35:13.681 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.682 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.682 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:35:13.682 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.666037+0000", 2021-10-08T19:35:13.682 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5211999999999998e-05 2021-10-08T19:35:13.683 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:35:13.683 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:35:13.683 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:35:13.683 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.683 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.684 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.25465.0:209980 9.e 9:7c138995:::benchmark_data_smithi097_196985_object94289:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e343)", 2021-10-08T19:35:13.684 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:34:38.435304+0000", 2021-10-08T19:35:13.684 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 34.963762871999997, 2021-10-08T19:35:13.684 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.23664207800000001, 2021-10-08T19:35:13.685 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:35:13.685 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:35:13.685 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:35:13.685 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.25465", 2021-10-08T19:35:13.685 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:35:13.686 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 209980 2021-10-08T19:35:13.686 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.686 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:35:13.686 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.686 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:35:13.687 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.435304+0000", 2021-10-08T19:35:13.687 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:35:13.687 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.687 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.688 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:35:13.688 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.435304+0000", 2021-10-08T19:35:13.688 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:35:13.688 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.688 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.689 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:35:13.689 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.435302+0000", 2021-10-08T19:35:13.689 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:35:13.689 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.689 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.690 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:35:13.690 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.435308+0000", 2021-10-08T19:35:13.690 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0190000000000003e-06 2021-10-08T19:35:13.690 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.691 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.691 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:35:13.691 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.661204+0000", 2021-10-08T19:35:13.691 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.225895185 2021-10-08T19:35:13.692 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.692 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.692 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:35:13.692 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.661231+0000", 2021-10-08T19:35:13.692 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7769000000000001e-05 2021-10-08T19:35:13.693 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.693 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.693 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:35:13.693 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.661484+0000", 2021-10-08T19:35:13.694 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000252372 2021-10-08T19:35:13.694 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.694 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.694 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:35:13.694 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.661605+0000", 2021-10-08T19:35:13.695 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012129 2021-10-08T19:35:13.695 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.695 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.695 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:35:13.695 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.661795+0000", 2021-10-08T19:35:13.696 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00018975099999999999 2021-10-08T19:35:13.696 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.696 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.696 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:35:13.697 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.666573+0000", 2021-10-08T19:35:13.697 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0047777619999999996 2021-10-08T19:35:13.697 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.697 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.697 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:35:13.698 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.666621+0000", 2021-10-08T19:35:13.698 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8196999999999999e-05 2021-10-08T19:35:13.698 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.698 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.699 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:35:13.699 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.671845+0000", 2021-10-08T19:35:13.699 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0052243530000000002 2021-10-08T19:35:13.699 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.699 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.700 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:35:13.700 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.671905+0000", 2021-10-08T19:35:13.700 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0053999999999998e-05 2021-10-08T19:35:13.700 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.701 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.701 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:35:13.701 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.671946+0000", 2021-10-08T19:35:13.701 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1006e-05 2021-10-08T19:35:13.701 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:35:13.702 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:35:13.702 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:35:13.702 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.702 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.703 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:209994 9.9 e343/290 9:93bcfe32:::benchmark_data_smithi097_196985_object94303:head v 343'13083, mlcod=343'13081)", 2021-10-08T19:35:13.703 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:34:38.454236+0000", 2021-10-08T19:35:13.703 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 34.944830558, 2021-10-08T19:35:13.703 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.21043297699999999, 2021-10-08T19:35:13.703 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:35:13.704 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:35:13.704 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:35:13.704 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.704 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:35:13.705 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.454236+0000", 2021-10-08T19:35:13.705 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:35:13.705 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.705 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.705 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:35:13.706 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.454236+0000", 2021-10-08T19:35:13.706 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:35:13.706 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.706 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.707 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:35:13.707 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.454233+0000", 2021-10-08T19:35:13.707 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999962 2021-10-08T19:35:13.707 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.707 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.708 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:35:13.708 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.454252+0000", 2021-10-08T19:35:13.708 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9372999999999999e-05 2021-10-08T19:35:13.708 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.708 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.709 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:35:13.709 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.661194+0000", 2021-10-08T19:35:13.709 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.20694248000000001 2021-10-08T19:35:13.709 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.710 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.710 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:35:13.710 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.661217+0000", 2021-10-08T19:35:13.710 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2983e-05 2021-10-08T19:35:13.710 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.711 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.711 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:35:13.711 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.661547+0000", 2021-10-08T19:35:13.711 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00032985499999999999 2021-10-08T19:35:13.711 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.712 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.712 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:35:13.712 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.661567+0000", 2021-10-08T19:35:13.712 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9718999999999999e-05 2021-10-08T19:35:13.713 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.713 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.713 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:35:13.713 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.664652+0000", 2021-10-08T19:35:13.713 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0030853310000000002 2021-10-08T19:35:13.714 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:35:13.714 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:35:13.714 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:35:13.714 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.664669+0000", 2021-10-08T19:35:13.715 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7008999999999999e-05 2021-10-08T19:35:13.715 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:35:13.715 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:35:13.715 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:35:13.715 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:35:13.716 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:35:13.716 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:35:13.716 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:35:13.737 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:35:13 smithi117 conmon[69189]: level=error ts=2021-10-08T19:35:13.504Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=2 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:35:13.740 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:13.761 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is unset 2021-10-08T19:35:13.768 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.0 to 1 (10000) 2021-10-08T19:35:13.785 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:35:13.786 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:13.787 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:35:13.888 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:35:13.915 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:14.084 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:35:13 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:35:13] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:35:14.085 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:13 smithi117 ceph-mon[34585]: pgmap v687: 162 pgs: 162 active+clean; 582 KiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2021-10-08T19:35:14.085 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:13 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1271356992' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:35:14.086 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:13 smithi117 ceph-mon[34585]: from='client.25768 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:35:14.086 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:13 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3127551963' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2021-10-08T19:35:14.086 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:13 smithi117 ceph-mon[34585]: from='client.25774 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2021-10-08T19:35:14.087 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2021-10-08T19:35:14.108 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:13 smithi097 ceph-mon[41966]: pgmap v687: 162 pgs: 162 active+clean; 582 KiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2021-10-08T19:35:14.109 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:13 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1271356992' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:35:14.109 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:13 smithi097 ceph-mon[41966]: from='client.25768 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:35:14.109 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:13 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3127551963' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2021-10-08T19:35:14.110 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:13 smithi097 ceph-mon[41966]: from='client.25774 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2021-10-08T19:35:14.110 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:13 smithi097 ceph-mon[32687]: pgmap v687: 162 pgs: 162 active+clean; 582 KiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2021-10-08T19:35:14.111 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:13 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1271356992' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:35:14.111 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:13 smithi097 ceph-mon[32687]: from='client.25768 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:35:14.111 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:13 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3127551963' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2021-10-08T19:35:14.111 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:13 smithi097 ceph-mon[32687]: from='client.25774 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2021-10-08T19:35:14.258 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:35:14.261 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:14.261 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:35:14.362 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:35:14.386 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:14.778 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd reweight 2 1 2021-10-08T19:35:14.879 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:35:14.882 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:14.883 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:35:14.984 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:35:15.011 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:14 smithi117 ceph-mon[34585]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:35:15.012 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:14 smithi117 ceph-mon[34585]: from='client.25768 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:35:15.012 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:14 smithi117 ceph-mon[34585]: from='client.25774 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2021-10-08T19:35:15.012 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:14 smithi117 ceph-mon[34585]: osdmap e353: 8 total, 8 up, 8 in 2021-10-08T19:35:15.014 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:15.066 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:35:15.070 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:15.071 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:35:15.173 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:35:15.199 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:15.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:14 smithi097 ceph-mon[41966]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:35:15.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:14 smithi097 ceph-mon[41966]: from='client.25768 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:35:15.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:14 smithi097 ceph-mon[41966]: from='client.25774 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2021-10-08T19:35:15.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:14 smithi097 ceph-mon[41966]: osdmap e353: 8 total, 8 up, 8 in 2021-10-08T19:35:15.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:14 smithi097 ceph-mon[32687]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:35:15.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:14 smithi097 ceph-mon[32687]: from='client.25768 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:35:15.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:14 smithi097 ceph-mon[32687]: from='client.25774 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2021-10-08T19:35:15.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:14 smithi097 ceph-mon[32687]: osdmap e353: 8 total, 8 up, 8 in 2021-10-08T19:35:15.240 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:35:15.242 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:15.243 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:35:15.344 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:35:15.368 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:15.410 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:35:15.412 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:15.413 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:35:15.512 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:35:15.514 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:35:15.536 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:15.543 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:35:15.578 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:35:15.580 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:15.581 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:35:15.647 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:35:15.668 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:35:15.683 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:35:15.687 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:35:15.707 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:35:15.709 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:15.729 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:35:15.753 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:35:15.776 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'unique_pool_3' created 2021-10-08T19:35:15.778 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:35:15.803 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:35:15.806 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:15.807 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:35:15.808 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:35:15.810 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'false' 2021-10-08T19:35:15.810 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'false' 2021-10-08T19:35:15.811 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'false' 2021-10-08T19:35:15.811 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'false' 2021-10-08T19:35:15.811 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'false' 2021-10-08T19:35:15.811 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'false' 2021-10-08T19:35:15.811 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'false' 2021-10-08T19:35:15.812 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'false' 2021-10-08T19:35:15.909 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:35:15.937 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:15.968 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:15 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:35:15.968 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:15 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:35:15.968 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:15 smithi097 ceph-mon[32687]: osdmap e354: 8 total, 8 up, 8 in 2021-10-08T19:35:15.968 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:15 smithi097 ceph-mon[32687]: 6.1d scrub ok 2021-10-08T19:35:15.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:15 smithi097 ceph-mon[32687]: pgmap v690: 162 pgs: 162 active+clean; 582 KiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2021-10-08T19:35:15.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:15 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/513309853' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_3", "pg_num": 16}]: dispatch 2021-10-08T19:35:15.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:15 smithi097 ceph-mon[32687]: from='client.25780 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_3", "pg_num": 16}]: dispatch 2021-10-08T19:35:15.969 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:15 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1167221182' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:35:15.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:15 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:35:15.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:15 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:35:15.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:15 smithi097 ceph-mon[41966]: osdmap e354: 8 total, 8 up, 8 in 2021-10-08T19:35:15.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:15 smithi097 ceph-mon[41966]: 6.1d scrub ok 2021-10-08T19:35:15.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:15 smithi097 ceph-mon[41966]: pgmap v690: 162 pgs: 162 active+clean; 582 KiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2021-10-08T19:35:15.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:15 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/513309853' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_3", "pg_num": 16}]: dispatch 2021-10-08T19:35:15.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:15 smithi097 ceph-mon[41966]: from='client.25780 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_3", "pg_num": 16}]: dispatch 2021-10-08T19:35:15.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:15 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1167221182' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:35:16.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:15 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:35:16.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:15 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:35:16.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:15 smithi117 ceph-mon[34585]: osdmap e354: 8 total, 8 up, 8 in 2021-10-08T19:35:16.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:15 smithi117 ceph-mon[34585]: 6.1d scrub ok 2021-10-08T19:35:16.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:15 smithi117 ceph-mon[34585]: pgmap v690: 162 pgs: 162 active+clean; 582 KiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2021-10-08T19:35:16.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:15 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/513309853' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_3", "pg_num": 16}]: dispatch 2021-10-08T19:35:16.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:15 smithi117 ceph-mon[34585]: from='client.25780 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_3", "pg_num": 16}]: dispatch 2021-10-08T19:35:16.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:15 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1167221182' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:35:16.611 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:35:16.614 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:16.615 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:35:16.628 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd pool application enable unique_pool_3 rados --yes-i-really-mean-it || true 2021-10-08T19:35:16.716 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:35:16.741 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:16.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:16 smithi097 ceph-mon[41966]: 4.1f scrub ok 2021-10-08T19:35:16.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:16 smithi097 ceph-mon[41966]: from='client.25780 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_3", "pg_num": 16}]': finished 2021-10-08T19:35:16.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:16 smithi097 ceph-mon[41966]: osdmap e355: 8 total, 8 up, 8 in 2021-10-08T19:35:16.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:16 smithi097 ceph-mon[41966]: 5.0 scrub ok 2021-10-08T19:35:16.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:16 smithi097 ceph-mon[41966]: 6.1e scrub ok 2021-10-08T19:35:16.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:16 smithi097 ceph-mon[32687]: 4.1f scrub ok 2021-10-08T19:35:16.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:16 smithi097 ceph-mon[32687]: from='client.25780 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_3", "pg_num": 16}]': finished 2021-10-08T19:35:16.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:16 smithi097 ceph-mon[32687]: osdmap e355: 8 total, 8 up, 8 in 2021-10-08T19:35:16.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:16 smithi097 ceph-mon[32687]: 5.0 scrub ok 2021-10-08T19:35:16.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:16 smithi097 ceph-mon[32687]: 6.1e scrub ok 2021-10-08T19:35:17.155 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:35:16 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:35:17.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:16 smithi117 ceph-mon[34585]: 4.1f scrub ok 2021-10-08T19:35:17.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:16 smithi117 ceph-mon[34585]: from='client.25780 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_3", "pg_num": 16}]': finished 2021-10-08T19:35:17.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:16 smithi117 ceph-mon[34585]: osdmap e355: 8 total, 8 up, 8 in 2021-10-08T19:35:17.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:16 smithi117 ceph-mon[34585]: 5.0 scrub ok 2021-10-08T19:35:17.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:16 smithi117 ceph-mon[34585]: 6.1e scrub ok 2021-10-08T19:35:17.485 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset nodeep-scrub 2021-10-08T19:35:17.600 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:35:17.602 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:17.603 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:35:17.704 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:35:17.727 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:18.089 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:17 smithi097 ceph-mon[41966]: 3.a scrub ok 2021-10-08T19:35:18.113 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:17 smithi097 ceph-mon[41966]: 2.4 scrub ok 2021-10-08T19:35:18.114 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:17 smithi097 ceph-mon[41966]: osdmap e356: 8 total, 8 up, 8 in 2021-10-08T19:35:18.114 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:17 smithi097 ceph-mon[41966]: pgmap v693: 178 pgs: 16 unknown, 162 active+clean; 582 KiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:35:18.114 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:17 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:35:18.115 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:17 smithi097 ceph-mon[32687]: 3.a scrub ok 2021-10-08T19:35:18.115 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:17 smithi097 ceph-mon[32687]: 2.4 scrub ok 2021-10-08T19:35:18.115 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:17 smithi097 ceph-mon[32687]: osdmap e356: 8 total, 8 up, 8 in 2021-10-08T19:35:18.116 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:17 smithi097 ceph-mon[32687]: pgmap v693: 178 pgs: 16 unknown, 162 active+clean; 582 KiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:35:18.116 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:17 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:35:18.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:17 smithi117 ceph-mon[34585]: 3.a scrub ok 2021-10-08T19:35:18.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:17 smithi117 ceph-mon[34585]: 2.4 scrub ok 2021-10-08T19:35:18.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:17 smithi117 ceph-mon[34585]: osdmap e356: 8 total, 8 up, 8 in 2021-10-08T19:35:18.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:17 smithi117 ceph-mon[34585]: pgmap v693: 178 pgs: 16 unknown, 162 active+clean; 582 KiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:35:18.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:17 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:35:18.184 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:35:18.272 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:35:18.275 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:18.275 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:35:18.376 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:35:18.406 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:18.454 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:35:18.457 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:18.458 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:35:18.559 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:35:18.584 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:18.628 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:35:18.630 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:18.631 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:35:18.733 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:35:18.758 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:19.083 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:18 smithi097 ceph-mon[41966]: 6.14 scrub ok 2021-10-08T19:35:19.083 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:18 smithi097 ceph-mon[41966]: osdmap e357: 8 total, 8 up, 8 in 2021-10-08T19:35:19.084 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:18 smithi097 ceph-mon[41966]: 3.15 scrub ok 2021-10-08T19:35:19.084 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:18 smithi097 ceph-mon[41966]: 2.1 scrub ok 2021-10-08T19:35:19.084 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:18 smithi097 ceph-mon[41966]: 6.b scrub ok 2021-10-08T19:35:19.084 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:18 smithi097 ceph-mon[41966]: 2.16 scrub ok 2021-10-08T19:35:19.085 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:18 smithi097 ceph-mon[32687]: 6.14 scrub ok 2021-10-08T19:35:19.085 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:18 smithi097 ceph-mon[32687]: osdmap e357: 8 total, 8 up, 8 in 2021-10-08T19:35:19.085 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:18 smithi097 ceph-mon[32687]: 3.15 scrub ok 2021-10-08T19:35:19.085 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:18 smithi097 ceph-mon[32687]: 2.1 scrub ok 2021-10-08T19:35:19.086 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:18 smithi097 ceph-mon[32687]: 6.b scrub ok 2021-10-08T19:35:19.086 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:18 smithi097 ceph-mon[32687]: 2.16 scrub ok 2021-10-08T19:35:19.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:18 smithi117 ceph-mon[34585]: 6.14 scrub ok 2021-10-08T19:35:19.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:18 smithi117 ceph-mon[34585]: osdmap e357: 8 total, 8 up, 8 in 2021-10-08T19:35:19.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:18 smithi117 ceph-mon[34585]: 3.15 scrub ok 2021-10-08T19:35:19.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:18 smithi117 ceph-mon[34585]: 2.1 scrub ok 2021-10-08T19:35:19.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:18 smithi117 ceph-mon[34585]: 6.b scrub ok 2021-10-08T19:35:19.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:18 smithi117 ceph-mon[34585]: 2.16 scrub ok 2021-10-08T19:35:19.157 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:35:19.159 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:19.160 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:35:19.262 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:35:19.289 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:19.336 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:35:19.338 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:19.339 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:35:19.440 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:35:19.445 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2021-10-08T19:35:19.462 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:35:19.465 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:19.509 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:35:19.511 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:19.512 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:35:19.613 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:35:19.637 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:19.679 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:35:19.681 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:19.682 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:35:19.783 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:35:19.807 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:19.850 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:35:19.852 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:19.853 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:35:19.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:19 smithi117 ceph-mon[34585]: 2.a scrub ok 2021-10-08T19:35:19.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:19 smithi117 ceph-mon[34585]: pgmap v695: 178 pgs: 7 unknown, 171 active+clean; 582 KiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:35:19.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:19 smithi117 ceph-mon[34585]: 5.17 scrub ok 2021-10-08T19:35:19.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:19 smithi117 ceph-mon[34585]: 4.c scrub ok 2021-10-08T19:35:19.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:19 smithi117 ceph-mon[34585]: 1.1 scrub ok 2021-10-08T19:35:19.954 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:35:19.977 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:20.019 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:35:20.021 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:20.022 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:35:20.124 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:35:20.149 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:19 smithi097 ceph-mon[41966]: 2.a scrub ok 2021-10-08T19:35:20.149 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:19 smithi097 ceph-mon[41966]: pgmap v695: 178 pgs: 7 unknown, 171 active+clean; 582 KiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:35:20.149 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:19 smithi097 ceph-mon[41966]: 5.17 scrub ok 2021-10-08T19:35:20.150 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:19 smithi097 ceph-mon[41966]: 4.c scrub ok 2021-10-08T19:35:20.150 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:19 smithi097 ceph-mon[41966]: 1.1 scrub ok 2021-10-08T19:35:20.150 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:19 smithi097 ceph-mon[32687]: 2.a scrub ok 2021-10-08T19:35:20.151 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:19 smithi097 ceph-mon[32687]: pgmap v695: 178 pgs: 7 unknown, 171 active+clean; 582 KiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:35:20.151 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:19 smithi097 ceph-mon[32687]: 5.17 scrub ok 2021-10-08T19:35:20.151 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:19 smithi097 ceph-mon[32687]: 4.c scrub ok 2021-10-08T19:35:20.151 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:19 smithi097 ceph-mon[32687]: 1.1 scrub ok 2021-10-08T19:35:20.152 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:20.675 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:35:20.678 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:20.678 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:35:20.779 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:35:20.805 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.2 to 1 (10000) 2021-10-08T19:35:20.806 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:20.833 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:35:20.850 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:35:20.852 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:20.853 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:35:20.894 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2021-10-08T19:35:20.894 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:35:20.956 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:35:20.981 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:21.025 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:21.026 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:35:21.026 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:35:21.127 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:35:21.151 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:20 smithi097 ceph-mon[41966]: 2.10 scrub ok 2021-10-08T19:35:21.152 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:20 smithi097 ceph-mon[41966]: 2.11 scrub ok 2021-10-08T19:35:21.153 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:20 smithi097 ceph-mon[41966]: 2.9 scrub ok 2021-10-08T19:35:21.153 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:20 smithi097 ceph-mon[41966]: 5.e scrub ok 2021-10-08T19:35:21.153 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:20 smithi097 ceph-mon[41966]: 2.12 scrub ok 2021-10-08T19:35:21.154 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:20 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1702994021' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2021-10-08T19:35:21.154 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:20 smithi097 ceph-mon[41966]: from='client.35819 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2021-10-08T19:35:21.155 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:20 smithi097 ceph-mon[32687]: 2.10 scrub ok 2021-10-08T19:35:21.155 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:20 smithi097 ceph-mon[32687]: 2.11 scrub ok 2021-10-08T19:35:21.155 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:20 smithi097 ceph-mon[32687]: 2.9 scrub ok 2021-10-08T19:35:21.155 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:20 smithi097 ceph-mon[32687]: 5.e scrub ok 2021-10-08T19:35:21.156 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:20 smithi097 ceph-mon[32687]: 2.12 scrub ok 2021-10-08T19:35:21.156 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:20 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1702994021' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2021-10-08T19:35:21.156 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:20 smithi097 ceph-mon[32687]: from='client.35819 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2021-10-08T19:35:21.156 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:21.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:20 smithi117 ceph-mon[34585]: 2.10 scrub ok 2021-10-08T19:35:21.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:20 smithi117 ceph-mon[34585]: 2.11 scrub ok 2021-10-08T19:35:21.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:20 smithi117 ceph-mon[34585]: 2.9 scrub ok 2021-10-08T19:35:21.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:20 smithi117 ceph-mon[34585]: 5.e scrub ok 2021-10-08T19:35:21.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:20 smithi117 ceph-mon[34585]: 2.12 scrub ok 2021-10-08T19:35:21.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:20 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1702994021' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2021-10-08T19:35:21.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:20 smithi117 ceph-mon[34585]: from='client.35819 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2021-10-08T19:35:21.961 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:35:21.963 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:21.964 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:35:22.065 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:35:22.091 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:21 smithi117 ceph-mon[34585]: 6.f scrub ok 2021-10-08T19:35:22.091 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:21 smithi117 ceph-mon[34585]: from='client.35819 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2021-10-08T19:35:22.091 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:21 smithi117 ceph-mon[34585]: osdmap e358: 8 total, 8 up, 8 in 2021-10-08T19:35:22.092 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:21 smithi117 ceph-mon[34585]: pgmap v697: 178 pgs: 178 active+clean; 582 KiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 1013 B/s rd, 0 op/s 2021-10-08T19:35:22.092 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:21 smithi117 ceph-mon[34585]: 1.9 scrub ok 2021-10-08T19:35:22.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:21 smithi117 ceph-mon[34585]: 3.16 scrub ok 2021-10-08T19:35:22.094 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:22.141 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:35:22.144 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:22.145 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:35:22.160 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:21 smithi097 ceph-mon[41966]: 6.f scrub ok 2021-10-08T19:35:22.160 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:21 smithi097 ceph-mon[41966]: from='client.35819 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2021-10-08T19:35:22.161 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:21 smithi097 ceph-mon[41966]: osdmap e358: 8 total, 8 up, 8 in 2021-10-08T19:35:22.161 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:21 smithi097 ceph-mon[41966]: pgmap v697: 178 pgs: 178 active+clean; 582 KiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 1013 B/s rd, 0 op/s 2021-10-08T19:35:22.161 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:21 smithi097 ceph-mon[41966]: 1.9 scrub ok 2021-10-08T19:35:22.161 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:21 smithi097 ceph-mon[41966]: 3.16 scrub ok 2021-10-08T19:35:22.162 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:21 smithi097 ceph-mon[32687]: 6.f scrub ok 2021-10-08T19:35:22.162 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:21 smithi097 ceph-mon[32687]: from='client.35819 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2021-10-08T19:35:22.162 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:21 smithi097 ceph-mon[32687]: osdmap e358: 8 total, 8 up, 8 in 2021-10-08T19:35:22.163 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:21 smithi097 ceph-mon[32687]: pgmap v697: 178 pgs: 178 active+clean; 582 KiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 1013 B/s rd, 0 op/s 2021-10-08T19:35:22.163 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:21 smithi097 ceph-mon[32687]: 1.9 scrub ok 2021-10-08T19:35:22.163 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:21 smithi097 ceph-mon[32687]: 3.16 scrub ok 2021-10-08T19:35:22.164 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd reweight 4 1 2021-10-08T19:35:22.246 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:35:22.275 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:22.319 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:22.319 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:35:22.320 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:35:22.405 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:35:22 smithi117 conmon[69189]: level=error ts=2021-10-08T19:35:22.314Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=1 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:35:22.421 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:35:22.445 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:22.488 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2021-10-08T19:35:22.720 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:35:22 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:35:22] "GET /metrics HTTP/1.1" 200 154680 "" "Prometheus/2.18.1" 2021-10-08T19:35:22.941 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:35:22.943 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:22.944 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:35:23.045 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:35:23.062 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:22 smithi097 ceph-mon[41966]: 6.11 scrub ok 2021-10-08T19:35:23.063 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:22 smithi097 ceph-mon[32687]: 6.11 scrub ok 2021-10-08T19:35:23.082 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:23.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:22 smithi117 ceph-mon[34585]: 6.11 scrub ok 2021-10-08T19:35:23.494 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:35:23.497 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:23.498 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:35:23.599 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:35:23.627 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:23.677 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:35:23.679 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:23.680 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:35:23.767 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:35:23.781 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:35:23.812 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:23.835 INFO:teuthology.orchestra.run.smithi097.stderr:enabled application 'rados' on pool 'unique_pool_3' 2021-10-08T19:35:23.864 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:35:23.905 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:35:23 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:35:23] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:35:23.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:23 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:35:23.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:23 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:35:23.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:23 smithi117 ceph-mon[34585]: 4.7 scrub ok 2021-10-08T19:35:23.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:23 smithi117 ceph-mon[34585]: 2.1f scrub ok 2021-10-08T19:35:23.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:23 smithi117 ceph-mon[34585]: osdmap e359: 8 total, 8 up, 8 in 2021-10-08T19:35:23.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:23 smithi117 ceph-mon[34585]: pgmap v699: 178 pgs: 178 active+clean; 582 KiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:35:23.908 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:23 smithi117 ceph-mon[34585]: 2.b scrub ok 2021-10-08T19:35:23.908 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:23 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1121007507' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_3", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:23.908 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:23 smithi117 ceph-mon[34585]: from='client.25798 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_3", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:23.908 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:23 smithi117 ceph-mon[34585]: 2.2 scrub ok 2021-10-08T19:35:24.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:23 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:35:24.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:23 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:35:24.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:23 smithi097 ceph-mon[32687]: 4.7 scrub ok 2021-10-08T19:35:24.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:23 smithi097 ceph-mon[32687]: 2.1f scrub ok 2021-10-08T19:35:24.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:23 smithi097 ceph-mon[32687]: osdmap e359: 8 total, 8 up, 8 in 2021-10-08T19:35:24.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:23 smithi097 ceph-mon[32687]: pgmap v699: 178 pgs: 178 active+clean; 582 KiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:35:24.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:23 smithi097 ceph-mon[32687]: 2.b scrub ok 2021-10-08T19:35:24.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:23 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1121007507' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_3", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:24.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:23 smithi097 ceph-mon[32687]: from='client.25798 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_3", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:24.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:23 smithi097 ceph-mon[32687]: 2.2 scrub ok 2021-10-08T19:35:24.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:23 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:35:24.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:23 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:35:24.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:23 smithi097 ceph-mon[41966]: 4.7 scrub ok 2021-10-08T19:35:24.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:23 smithi097 ceph-mon[41966]: 2.1f scrub ok 2021-10-08T19:35:24.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:23 smithi097 ceph-mon[41966]: osdmap e359: 8 total, 8 up, 8 in 2021-10-08T19:35:24.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:23 smithi097 ceph-mon[41966]: pgmap v699: 178 pgs: 178 active+clean; 582 KiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:35:24.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:23 smithi097 ceph-mon[41966]: 2.b scrub ok 2021-10-08T19:35:24.225 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:23 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1121007507' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_3", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:24.225 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:23 smithi097 ceph-mon[41966]: from='client.25798 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_3", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:24.225 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:23 smithi097 ceph-mon[41966]: 2.2 scrub ok 2021-10-08T19:35:24.820 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:35:24.823 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:24.825 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:35:24.837 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is unset 2021-10-08T19:35:24.926 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:35:24.953 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:24.998 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:35:25.000 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:25.001 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:35:25.103 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:35:25.122 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:24 smithi097 ceph-mon[41966]: 5.6 scrub ok 2021-10-08T19:35:25.123 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:24 smithi097 ceph-mon[41966]: from='client.25798 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_3", "app": "rados", "yes_i_really_mean_it": true}]': finished 2021-10-08T19:35:25.123 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:24 smithi097 ceph-mon[41966]: osdmap e360: 8 total, 8 up, 8 in 2021-10-08T19:35:25.123 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:24 smithi097 ceph-mon[41966]: 6.1f scrub ok 2021-10-08T19:35:25.124 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:24 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/311642298' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:35:25.124 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:24 smithi097 ceph-mon[41966]: from='client.25804 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:35:25.124 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:24 smithi097 ceph-mon[41966]: 6.7 scrub ok 2021-10-08T19:35:25.124 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:24 smithi097 ceph-mon[32687]: 5.6 scrub ok 2021-10-08T19:35:25.125 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:24 smithi097 ceph-mon[32687]: from='client.25798 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_3", "app": "rados", "yes_i_really_mean_it": true}]': finished 2021-10-08T19:35:25.125 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:24 smithi097 ceph-mon[32687]: osdmap e360: 8 total, 8 up, 8 in 2021-10-08T19:35:25.125 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:24 smithi097 ceph-mon[32687]: 6.1f scrub ok 2021-10-08T19:35:25.125 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:24 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/311642298' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:35:25.126 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:24 smithi097 ceph-mon[32687]: from='client.25804 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:35:25.126 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:24 smithi097 ceph-mon[32687]: 6.7 scrub ok 2021-10-08T19:35:25.126 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:24 smithi117 ceph-mon[34585]: 5.6 scrub ok 2021-10-08T19:35:25.127 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:24 smithi117 ceph-mon[34585]: from='client.25798 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_3", "app": "rados", "yes_i_really_mean_it": true}]': finished 2021-10-08T19:35:25.127 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:24 smithi117 ceph-mon[34585]: osdmap e360: 8 total, 8 up, 8 in 2021-10-08T19:35:25.128 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:24 smithi117 ceph-mon[34585]: 6.1f scrub ok 2021-10-08T19:35:25.128 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:24 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/311642298' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:35:25.128 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:24 smithi117 ceph-mon[34585]: from='client.25804 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:35:25.130 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:24 smithi117 ceph-mon[34585]: 6.7 scrub ok 2021-10-08T19:35:25.131 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:25.169 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:35:25.171 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:25.172 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:35:25.273 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:35:25.312 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:26.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:25 smithi117 ceph-mon[34585]: 6.10 scrub ok 2021-10-08T19:35:26.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:25 smithi117 ceph-mon[34585]: pgmap v701: 178 pgs: 178 active+clean; 582 KiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:35:26.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:25 smithi117 ceph-mon[34585]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:35:26.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:25 smithi117 ceph-mon[34585]: Cluster is now healthy 2021-10-08T19:35:26.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:25 smithi117 ceph-mon[34585]: from='client.25804 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:35:26.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:25 smithi117 ceph-mon[34585]: osdmap e361: 8 total, 8 up, 8 in 2021-10-08T19:35:26.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:25 smithi117 ceph-mon[34585]: 2.1d scrub ok 2021-10-08T19:35:26.165 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:35:26.165 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:25 smithi097 ceph-mon[41966]: 6.10 scrub ok 2021-10-08T19:35:26.166 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:25 smithi097 ceph-mon[41966]: pgmap v701: 178 pgs: 178 active+clean; 582 KiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:35:26.166 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:25 smithi097 ceph-mon[41966]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:35:26.166 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:25 smithi097 ceph-mon[41966]: Cluster is now healthy 2021-10-08T19:35:26.167 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:25 smithi097 ceph-mon[41966]: from='client.25804 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:35:26.167 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:25 smithi097 ceph-mon[41966]: osdmap e361: 8 total, 8 up, 8 in 2021-10-08T19:35:26.168 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:25 smithi097 ceph-mon[41966]: 2.1d scrub ok 2021-10-08T19:35:26.168 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:25 smithi097 ceph-mon[32687]: 6.10 scrub ok 2021-10-08T19:35:26.168 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:25 smithi097 ceph-mon[32687]: pgmap v701: 178 pgs: 178 active+clean; 582 KiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:35:26.169 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:25 smithi097 ceph-mon[32687]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:35:26.169 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:25 smithi097 ceph-mon[32687]: Cluster is now healthy 2021-10-08T19:35:26.169 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:25 smithi097 ceph-mon[32687]: from='client.25804 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:35:26.169 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:25 smithi097 ceph-mon[32687]: osdmap e361: 8 total, 8 up, 8 in 2021-10-08T19:35:26.170 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:25 smithi097 ceph-mon[32687]: 2.1d scrub ok 2021-10-08T19:35:26.170 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:26.171 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:35:26.272 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:35:26.299 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:26.301 DEBUG:teuthology.orchestra.run.smithi097:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_3 bench 90 write' 2021-10-08T19:35:26.303 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2021-10-08T19:35:26.304 INFO:teuthology.orchestra.run:waiting for 3000 2021-10-08T19:35:26.350 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:hints = 1 2021-10-08T19:35:26.350 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2021-10-08T19:35:26.351 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Object prefix: benchmark_data_smithi097_245820 2021-10-08T19:35:26.351 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2021-10-08T19:35:26.351 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 0 0 0 0 0 0 - 0 2021-10-08T19:35:26.807 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:35:26.815 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:26.816 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:35:26.895 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:35:26.917 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:35:26.935 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:35:26.970 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:26.974 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:35:27.010 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:35:27.054 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:35:27.083 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:35:27.113 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:35:27.120 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:26 smithi097 ceph-mon[41966]: 5.c scrub ok 2021-10-08T19:35:27.121 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:26 smithi097 ceph-mon[41966]: 4.16 scrub ok 2021-10-08T19:35:27.121 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:26 smithi097 ceph-mon[41966]: 5.10 scrub ok 2021-10-08T19:35:27.121 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:26 smithi097 ceph-mon[41966]: 4.d scrub ok 2021-10-08T19:35:27.122 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:35:27.122 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:27.123 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:35:27.124 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:26 smithi097 ceph-mon[32687]: 5.c scrub ok 2021-10-08T19:35:27.124 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:26 smithi097 ceph-mon[32687]: 4.16 scrub ok 2021-10-08T19:35:27.124 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:26 smithi097 ceph-mon[32687]: 5.10 scrub ok 2021-10-08T19:35:27.124 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:26 smithi097 ceph-mon[32687]: 4.d scrub ok 2021-10-08T19:35:27.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:26 smithi117 ceph-mon[34585]: 5.c scrub ok 2021-10-08T19:35:27.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:26 smithi117 ceph-mon[34585]: 4.16 scrub ok 2021-10-08T19:35:27.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:26 smithi117 ceph-mon[34585]: 5.10 scrub ok 2021-10-08T19:35:27.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:26 smithi117 ceph-mon[34585]: 4.d scrub ok 2021-10-08T19:35:27.160 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:35:26 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:35:27.160 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:35:27.167 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true' 2021-10-08T19:35:27.168 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true' 2021-10-08T19:35:27.168 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true' 2021-10-08T19:35:27.168 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true' 2021-10-08T19:35:27.169 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true' 2021-10-08T19:35:27.169 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true' 2021-10-08T19:35:27.169 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'true' 2021-10-08T19:35:27.169 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'true' 2021-10-08T19:35:27.225 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:35:27.270 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:27.351 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 1 16 3353 3337 208.55 208.562 0.00239119 0.0047843 2021-10-08T19:35:28.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:27 smithi117 ceph-mon[34585]: pgmap v703: 178 pgs: 178 active+clean; 582 KiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:35:28.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:27 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3375024571' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:35:28.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:27 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:35:28.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:27 smithi117 ceph-mon[34585]: 2.f scrub ok 2021-10-08T19:35:28.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:27 smithi117 ceph-mon[34585]: 5.1b deep-scrub ok 2021-10-08T19:35:28.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:27 smithi097 ceph-mon[41966]: pgmap v703: 178 pgs: 178 active+clean; 582 KiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:35:28.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:27 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3375024571' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:35:28.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:27 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:35:28.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:27 smithi097 ceph-mon[41966]: 2.f scrub ok 2021-10-08T19:35:28.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:27 smithi097 ceph-mon[41966]: 5.1b deep-scrub ok 2021-10-08T19:35:28.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:27 smithi097 ceph-mon[32687]: pgmap v703: 178 pgs: 178 active+clean; 582 KiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:35:28.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:27 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3375024571' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:35:28.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:27 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:35:28.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:27 smithi097 ceph-mon[32687]: 2.f scrub ok 2021-10-08T19:35:28.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:27 smithi097 ceph-mon[32687]: 5.1b deep-scrub ok 2021-10-08T19:35:28.350 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 2 15 6995 6980 218.11 227.688 0.00528942 0.00457414 2021-10-08T19:35:28.776 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set noscrub 2021-10-08T19:35:28.800 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:35:28.804 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:28.806 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:35:28.907 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:35:28.951 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:29.034 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:35:29.039 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:29.039 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:35:29.140 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:35:29.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:28 smithi117 ceph-mon[34585]: 5.11 scrub ok 2021-10-08T19:35:29.181 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:29.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:28 smithi097 ceph-mon[32687]: 5.11 scrub ok 2021-10-08T19:35:29.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:28 smithi097 ceph-mon[41966]: 5.11 scrub ok 2021-10-08T19:35:29.253 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:35:29.258 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:29.260 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:35:29.351 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 3 16 10042 10026 208.821 190.375 0.00867609 0.00477768 2021-10-08T19:35:29.362 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:35:29.402 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:29.468 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:35:29.471 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:29.471 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:35:29.572 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:35:29.609 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:29.673 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:35:29.675 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:29.676 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:35:29.776 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:35:29.777 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2021-10-08T19:35:29.777 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2021-10-08T19:35:29.777 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2021-10-08T19:35:29.777 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:35:29.778 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:35:29.779 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:35:29.868 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:30.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:29 smithi117 ceph-mon[34585]: pgmap v704: 178 pgs: 178 active+clean; 281 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 47 MiB/s wr, 748 op/s 2021-10-08T19:35:30.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:29 smithi097 ceph-mon[41966]: pgmap v704: 178 pgs: 178 active+clean; 281 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 47 MiB/s wr, 748 op/s 2021-10-08T19:35:30.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:29 smithi097 ceph-mon[32687]: pgmap v704: 178 pgs: 178 active+clean; 281 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 47 MiB/s wr, 748 op/s 2021-10-08T19:35:30.304 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:35:30.308 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:30.309 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:35:30.351 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 4 15 12486 12471 194.818 152.812 0.00473699 0.00512537 2021-10-08T19:35:30.411 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:35:30.435 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:30.522 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:35:30.525 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:30.526 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:35:30.627 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:35:30.673 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:30.768 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:35:30.770 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:30.771 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:35:30.873 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:35:30.888 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.4 to 1 (10000) 2021-10-08T19:35:30.921 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:31.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:30 smithi117 ceph-mon[34585]: 1.7 scrub ok 2021-10-08T19:35:31.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:30 smithi117 ceph-mon[34585]: 2.15 scrub ok 2021-10-08T19:35:31.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:30 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/22543967' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2021-10-08T19:35:31.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:30 smithi117 ceph-mon[34585]: from='client.25822 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2021-10-08T19:35:31.159 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:30 smithi097 ceph-mon[32687]: 1.7 scrub ok 2021-10-08T19:35:31.159 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:30 smithi097 ceph-mon[32687]: 2.15 scrub ok 2021-10-08T19:35:31.159 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:30 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/22543967' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2021-10-08T19:35:31.159 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:30 smithi097 ceph-mon[32687]: from='client.25822 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2021-10-08T19:35:31.160 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:30 smithi097 ceph-mon[41966]: 1.7 scrub ok 2021-10-08T19:35:31.160 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:30 smithi097 ceph-mon[41966]: 2.15 scrub ok 2021-10-08T19:35:31.161 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:30 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/22543967' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2021-10-08T19:35:31.161 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:30 smithi097 ceph-mon[41966]: from='client.25822 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2021-10-08T19:35:31.352 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 5 16 15064 15048 188.065 161.062 0.00913077 0.00530959 2021-10-08T19:35:31.378 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2021-10-08T19:35:32.048 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2021-10-08T19:35:32.090 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:31 smithi097 ceph-mon[32687]: 3.4 scrub ok 2021-10-08T19:35:32.091 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:31 smithi097 ceph-mon[32687]: pgmap v705: 178 pgs: 178 active+clean; 541 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 68 MiB/s wr, 1.08k op/s 2021-10-08T19:35:32.091 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:31 smithi097 ceph-mon[32687]: from='client.25822 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]': finished 2021-10-08T19:35:32.091 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:31 smithi097 ceph-mon[32687]: osdmap e362: 8 total, 8 up, 8 in 2021-10-08T19:35:32.091 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:31 smithi097 ceph-mon[32687]: 6.5 scrub ok 2021-10-08T19:35:32.092 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:31 smithi097 ceph-mon[32687]: 2.3 scrub ok 2021-10-08T19:35:32.092 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:31 smithi097 ceph-mon[41966]: 3.4 scrub ok 2021-10-08T19:35:32.092 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:31 smithi097 ceph-mon[41966]: pgmap v705: 178 pgs: 178 active+clean; 541 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 68 MiB/s wr, 1.08k op/s 2021-10-08T19:35:32.093 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:31 smithi097 ceph-mon[41966]: from='client.25822 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]': finished 2021-10-08T19:35:32.093 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:31 smithi097 ceph-mon[41966]: osdmap e362: 8 total, 8 up, 8 in 2021-10-08T19:35:32.093 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:31 smithi097 ceph-mon[41966]: 6.5 scrub ok 2021-10-08T19:35:32.093 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:31 smithi097 ceph-mon[41966]: 2.3 scrub ok 2021-10-08T19:35:32.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:31 smithi117 ceph-mon[34585]: 3.4 scrub ok 2021-10-08T19:35:32.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:31 smithi117 ceph-mon[34585]: pgmap v705: 178 pgs: 178 active+clean; 541 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 68 MiB/s wr, 1.08k op/s 2021-10-08T19:35:32.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:31 smithi117 ceph-mon[34585]: from='client.25822 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]': finished 2021-10-08T19:35:32.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:31 smithi117 ceph-mon[34585]: osdmap e362: 8 total, 8 up, 8 in 2021-10-08T19:35:32.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:31 smithi117 ceph-mon[34585]: 6.5 scrub ok 2021-10-08T19:35:32.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:31 smithi117 ceph-mon[34585]: 2.3 scrub ok 2021-10-08T19:35:32.353 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 6 16 17292 17276 179.907 139.25 0.00841691 0.0055499 2021-10-08T19:35:32.381 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:35:32.393 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:32.394 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:35:32.495 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:35:32.541 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:32.643 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:35:32.651 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:32.652 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:35:32.753 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:35:32.798 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:32.862 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd reweight 5 1 2021-10-08T19:35:32.869 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:32.870 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:35:32.870 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:35:32.910 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:35:32 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:35:32] "GET /metrics HTTP/1.1" 200 155760 "" "Prometheus/2.18.1" 2021-10-08T19:35:32.911 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:32 smithi097 ceph-mon[41966]: 6.2 scrub ok 2021-10-08T19:35:32.911 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:32 smithi097 ceph-mon[32687]: 6.2 scrub ok 2021-10-08T19:35:32.972 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:35:33.011 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:33.088 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:35:33.089 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:32 smithi117 ceph-mon[34585]: 6.2 scrub ok 2021-10-08T19:35:33.089 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:33.090 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:35:33.097 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:35:33.151 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:35:33.191 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:35:33.220 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:33.313 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:35:33.316 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:33.317 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:35:33.352 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 7 16 19452 19436 173.492 135 0.0103018 0.00575592 2021-10-08T19:35:33.418 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:35:33.473 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:33.690 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:35:33.693 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:33.694 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:35:33.726 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:35:33.796 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:35:33.827 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:33.897 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:35:33.902 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:33.903 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:35:33.948 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:33 smithi097 ceph-mon[41966]: 4.4 scrub ok 2021-10-08T19:35:33.949 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:33 smithi097 ceph-mon[41966]: pgmap v707: 178 pgs: 178 active+clean; 541 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 639 B/s rd, 68 MiB/s wr, 1.08k op/s 2021-10-08T19:35:33.949 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:33 smithi097 ceph-mon[41966]: 2.1b deep-scrub ok 2021-10-08T19:35:33.950 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:33 smithi097 ceph-mon[32687]: 4.4 scrub ok 2021-10-08T19:35:33.951 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:33 smithi097 ceph-mon[32687]: pgmap v707: 178 pgs: 178 active+clean; 541 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 639 B/s rd, 68 MiB/s wr, 1.08k op/s 2021-10-08T19:35:33.951 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:33 smithi097 ceph-mon[32687]: 2.1b deep-scrub ok 2021-10-08T19:35:34.004 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:35:34.039 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:34.117 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:35:34.120 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:33 smithi117 ceph-mon[34585]: 4.4 scrub ok 2021-10-08T19:35:34.120 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:33 smithi117 ceph-mon[34585]: pgmap v707: 178 pgs: 178 active+clean; 541 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 639 B/s rd, 68 MiB/s wr, 1.08k op/s 2021-10-08T19:35:34.120 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:33 smithi117 ceph-mon[34585]: 2.1b deep-scrub ok 2021-10-08T19:35:34.121 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:34.122 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:35:34.122 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:35:33 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:35:33] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:35:34.223 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:35:34.277 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:34.352 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 8 16 21161 21145 165.157 106.812 0.0096995 0.00604542 2021-10-08T19:35:34.431 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:35:34.443 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:34.444 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:35:34.545 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:35:34.595 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:34.936 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is set 2021-10-08T19:35:34.968 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:34 smithi097 ceph-mon[41966]: 3.2 scrub ok 2021-10-08T19:35:34.969 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:34 smithi097 ceph-mon[41966]: 6.15 scrub ok 2021-10-08T19:35:34.969 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:34 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/943411095' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:35:34.969 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:34 smithi097 ceph-mon[41966]: from='client.25825 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:35:34.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:34 smithi097 ceph-mon[32687]: 3.2 scrub ok 2021-10-08T19:35:34.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:34 smithi097 ceph-mon[32687]: 6.15 scrub ok 2021-10-08T19:35:34.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:34 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/943411095' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:35:34.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:34 smithi097 ceph-mon[32687]: from='client.25825 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:35:35.353 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 9 16 23106 23090 160.296 121.562 0.00916581 0.00623286 2021-10-08T19:35:35.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:34 smithi117 ceph-mon[34585]: 3.2 scrub ok 2021-10-08T19:35:35.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:34 smithi117 ceph-mon[34585]: 6.15 scrub ok 2021-10-08T19:35:35.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:34 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/943411095' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:35:35.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:34 smithi117 ceph-mon[34585]: from='client.25825 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:35:36.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:35 smithi097 ceph-mon[32687]: 4.e scrub ok 2021-10-08T19:35:36.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:35 smithi097 ceph-mon[32687]: pgmap v708: 178 pgs: 178 active+clean; 1.2 GiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 1 KiB/s rd, 127 MiB/s wr, 2.04k op/s 2021-10-08T19:35:36.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:35 smithi097 ceph-mon[32687]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:35:36.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:35 smithi097 ceph-mon[32687]: 3.11 scrub ok 2021-10-08T19:35:36.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:35 smithi097 ceph-mon[32687]: from='client.25825 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:35:36.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:35 smithi097 ceph-mon[32687]: osdmap e363: 8 total, 8 up, 8 in 2021-10-08T19:35:36.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:35 smithi097 ceph-mon[41966]: 4.e scrub ok 2021-10-08T19:35:36.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:35 smithi097 ceph-mon[41966]: pgmap v708: 178 pgs: 178 active+clean; 1.2 GiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 1 KiB/s rd, 127 MiB/s wr, 2.04k op/s 2021-10-08T19:35:36.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:35 smithi097 ceph-mon[41966]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:35:36.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:35 smithi097 ceph-mon[41966]: 3.11 scrub ok 2021-10-08T19:35:36.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:35 smithi097 ceph-mon[41966]: from='client.25825 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:35:36.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:35 smithi097 ceph-mon[41966]: osdmap e363: 8 total, 8 up, 8 in 2021-10-08T19:35:36.353 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 10 16 25345 25329 158.259 139.938 0.0106266 0.0063126 2021-10-08T19:35:36.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:35 smithi117 ceph-mon[34585]: 4.e scrub ok 2021-10-08T19:35:36.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:35 smithi117 ceph-mon[34585]: pgmap v708: 178 pgs: 178 active+clean; 1.2 GiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 1 KiB/s rd, 127 MiB/s wr, 2.04k op/s 2021-10-08T19:35:36.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:35 smithi117 ceph-mon[34585]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:35:36.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:35 smithi117 ceph-mon[34585]: 3.11 scrub ok 2021-10-08T19:35:36.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:35 smithi117 ceph-mon[34585]: from='client.25825 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:35:36.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:35 smithi117 ceph-mon[34585]: osdmap e363: 8 total, 8 up, 8 in 2021-10-08T19:35:36.928 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:36 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:35:36.928 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:36 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:35:36.929 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:36 smithi117 ceph-mon[34585]: osdmap e364: 8 total, 8 up, 8 in 2021-10-08T19:35:37.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:36 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:35:37.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:36 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:35:37.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:36 smithi097 ceph-mon[41966]: osdmap e364: 8 total, 8 up, 8 in 2021-10-08T19:35:37.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:36 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:35:37.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:36 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:35:37.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:36 smithi097 ceph-mon[32687]: osdmap e364: 8 total, 8 up, 8 in 2021-10-08T19:35:37.354 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 11 16 27348 27332 155.246 125.188 0.00283573 0.00643609 2021-10-08T19:35:37.405 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:35:36 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:35:37.615 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:35:37.626 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:37.628 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:35:37.730 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:35:37.778 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:38.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:37 smithi097 ceph-mon[41966]: pgmap v711: 178 pgs: 178 active+clean; 1.2 GiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 852 B/s rd, 122 MiB/s wr, 1.95k op/s 2021-10-08T19:35:38.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:37 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:35:38.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:37 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:35:38.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:37 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:35:38.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:37 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:35:38.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:37 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:35:38.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:37 smithi097 ceph-mon[32687]: pgmap v711: 178 pgs: 178 active+clean; 1.2 GiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 852 B/s rd, 122 MiB/s wr, 1.95k op/s 2021-10-08T19:35:38.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:37 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:35:38.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:37 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:35:38.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:37 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:35:38.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:37 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:35:38.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:37 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:35:38.354 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 12 16 29009 28993 150.96 103.812 0.00725118 0.0066182 2021-10-08T19:35:38.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:37 smithi117 ceph-mon[34585]: pgmap v711: 178 pgs: 178 active+clean; 1.2 GiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 852 B/s rd, 122 MiB/s wr, 1.95k op/s 2021-10-08T19:35:38.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:37 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:35:38.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:37 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:35:38.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:37 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:35:38.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:37 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:35:38.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:37 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:35:38.633 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:35:38.637 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:38.639 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:35:38.740 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:35:38.792 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:38.873 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:35:38.874 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2021-10-08T19:35:38.874 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2021-10-08T19:35:38.876 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2021-10-08T19:35:38.876 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.877 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:161973 7.4 7:2d96b882:::benchmark_data_smithi097_93198_object70153:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158)", 2021-10-08T19:35:38.877 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:26:58.326199+0000", 2021-10-08T19:35:38.877 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 520.54118240299999, 2021-10-08T19:35:38.878 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.21778922100000001, 2021-10-08T19:35:38.878 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:35:38.879 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:35:38.879 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:35:38.880 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:35:38.880 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:35:38.880 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 161973 2021-10-08T19:35:38.883 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.883 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:35:38.884 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.884 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:35:38.885 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.326199+0000", 2021-10-08T19:35:38.885 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:35:38.885 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.886 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.886 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:35:38.888 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.326199+0000", 2021-10-08T19:35:38.889 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:35:38.889 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.889 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.890 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:35:38.890 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.326197+0000", 2021-10-08T19:35:38.890 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:35:38.890 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.891 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.891 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:35:38.891 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.326203+0000", 2021-10-08T19:35:38.891 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1809999999999998e-06 2021-10-08T19:35:38.892 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.892 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.892 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:35:38.892 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.326214+0000", 2021-10-08T19:35:38.892 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1503e-05 2021-10-08T19:35:38.893 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.893 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.893 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:35:38.893 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.326221+0000", 2021-10-08T19:35:38.893 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3620000000000002e-06 2021-10-08T19:35:38.894 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.894 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.894 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:35:38.894 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.326275+0000", 2021-10-08T19:35:38.895 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4481999999999998e-05 2021-10-08T19:35:38.897 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.897 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.897 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:35:38.897 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.326383+0000", 2021-10-08T19:35:38.898 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010808599999999999 2021-10-08T19:35:38.898 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.898 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.898 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:35:38.899 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.326491+0000", 2021-10-08T19:35:38.899 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000108179 2021-10-08T19:35:38.899 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.900 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.900 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:35:38.900 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.332151+0000", 2021-10-08T19:35:38.900 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0056596270000000004 2021-10-08T19:35:38.900 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.901 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.901 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:35:38.901 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.333565+0000", 2021-10-08T19:35:38.901 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0014136470000000001 2021-10-08T19:35:38.902 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.902 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.902 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:35:38.904 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.543895+0000", 2021-10-08T19:35:38.904 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.21033058700000001 2021-10-08T19:35:38.904 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.905 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.906 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:35:38.906 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.543948+0000", 2021-10-08T19:35:38.906 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3049e-05 2021-10-08T19:35:38.907 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.907 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.907 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:35:38.908 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.543988+0000", 2021-10-08T19:35:38.909 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9496000000000003e-05 2021-10-08T19:35:38.909 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:35:38.909 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:35:38.909 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:35:38.910 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.910 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.911 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:161980 7.9 7:9db1918e:::benchmark_data_smithi097_93198_object70160:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158)", 2021-10-08T19:35:38.911 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:26:58.335982+0000", 2021-10-08T19:35:38.911 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 520.53139844600003, 2021-10-08T19:35:38.912 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.21682858699999999, 2021-10-08T19:35:38.912 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:35:38.912 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:35:38.912 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:35:38.912 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:35:38.913 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:35:38.913 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 161980 2021-10-08T19:35:38.913 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.913 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:35:38.914 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.914 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:35:38.914 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.335982+0000", 2021-10-08T19:35:38.914 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:35:38.914 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.915 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.915 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:35:38.915 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.335982+0000", 2021-10-08T19:35:38.915 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:35:38.916 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.916 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.916 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:35:38.916 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.335982+0000", 2021-10-08T19:35:38.916 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:35:38.917 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.917 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.917 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:35:38.918 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.335986+0000", 2021-10-08T19:35:38.918 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9890000000000003e-06 2021-10-08T19:35:38.918 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.919 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.919 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:35:38.919 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.335994+0000", 2021-10-08T19:35:38.920 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2369999999999992e-06 2021-10-08T19:35:38.920 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.920 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.921 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:35:38.921 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.335998+0000", 2021-10-08T19:35:38.921 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4819999999999996e-06 2021-10-08T19:35:38.921 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.921 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.922 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:35:38.922 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.336082+0000", 2021-10-08T19:35:38.922 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4211999999999999e-05 2021-10-08T19:35:38.922 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.923 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.923 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:35:38.923 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.336229+0000", 2021-10-08T19:35:38.923 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014613300000000001 2021-10-08T19:35:38.923 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.924 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.924 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:35:38.924 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.336358+0000", 2021-10-08T19:35:38.924 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000128892 2021-10-08T19:35:38.924 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.925 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.925 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:35:38.925 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.341692+0000", 2021-10-08T19:35:38.925 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0053348989999999997 2021-10-08T19:35:38.925 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.926 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.926 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:35:38.926 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.342367+0000", 2021-10-08T19:35:38.927 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00067464900000000004 2021-10-08T19:35:38.927 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.927 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.927 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:35:38.927 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.552730+0000", 2021-10-08T19:35:38.928 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.21036318100000001 2021-10-08T19:35:38.928 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.928 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.928 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:35:38.929 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.552775+0000", 2021-10-08T19:35:38.929 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4768000000000002e-05 2021-10-08T19:35:38.929 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.929 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.929 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:35:38.930 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.552811+0000", 2021-10-08T19:35:38.930 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6044999999999998e-05 2021-10-08T19:35:38.930 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:35:38.930 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:35:38.930 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:35:38.931 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.931 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.931 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:161985 7.4 7:226c67e6:::benchmark_data_smithi097_93198_object70165:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158)", 2021-10-08T19:35:38.931 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:26:58.341548+0000", 2021-10-08T19:35:38.931 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 520.52583289899997, 2021-10-08T19:35:38.932 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.20250479900000001, 2021-10-08T19:35:38.932 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:35:38.932 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:35:38.932 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:35:38.933 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:35:38.933 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:35:38.933 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 161985 2021-10-08T19:35:38.933 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.933 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:35:38.934 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.935 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:38.936 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:35:38.937 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:35:38.938 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:35:38.938 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.341548+0000", 2021-10-08T19:35:38.939 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:35:38.939 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.939 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.940 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:35:38.940 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.341548+0000", 2021-10-08T19:35:38.940 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:35:38.940 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.941 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.941 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:35:38.941 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.341546+0000", 2021-10-08T19:35:38.941 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:35:38.942 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.942 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.942 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:35:38.942 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.341552+0000", 2021-10-08T19:35:38.943 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1700000000000002e-06 2021-10-08T19:35:38.943 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.943 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.944 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:35:38.944 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.341561+0000", 2021-10-08T19:35:38.944 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.3149999999999998e-06 2021-10-08T19:35:38.944 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.944 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.945 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:35:38.945 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.341568+0000", 2021-10-08T19:35:38.945 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5300000000000002e-06 2021-10-08T19:35:38.945 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.946 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.946 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:35:38.946 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.341755+0000", 2021-10-08T19:35:38.946 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00018718900000000001 2021-10-08T19:35:38.946 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.947 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.947 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:35:38.947 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.341879+0000", 2021-10-08T19:35:38.947 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012378399999999999 2021-10-08T19:35:38.948 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.948 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.948 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:35:38.948 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.342009+0000", 2021-10-08T19:35:38.948 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013071900000000001 2021-10-08T19:35:38.949 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.949 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.949 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:35:38.949 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.346624+0000", 2021-10-08T19:35:38.949 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0046141940000000003 2021-10-08T19:35:38.950 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.950 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.950 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:35:38.950 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.347710+0000", 2021-10-08T19:35:38.951 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010865930000000001 2021-10-08T19:35:38.951 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.951 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.951 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:35:38.951 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.544012+0000", 2021-10-08T19:35:38.952 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.19630222899999999 2021-10-08T19:35:38.952 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.952 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.952 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:35:38.953 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.544034+0000", 2021-10-08T19:35:38.953 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1889e-05 2021-10-08T19:35:38.953 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.953 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.953 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:35:38.954 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.544053+0000", 2021-10-08T19:35:38.954 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8434e-05 2021-10-08T19:35:38.954 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:35:38.954 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:35:38.954 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:35:38.955 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.955 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.955 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:95878 8.c 8:3e268961:::benchmark_data_smithi097_144160_object7138:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e227)", 2021-10-08T19:35:38.955 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:29.708862+0000", 2021-10-08T19:35:38.956 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 369.158518668, 2021-10-08T19:35:38.956 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0215476309999998, 2021-10-08T19:35:38.956 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:35:38.956 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "reached pg", 2021-10-08T19:35:38.956 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:35:38.957 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:35:38.957 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:35:38.957 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 95878 2021-10-08T19:35:38.957 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.957 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:35:38.958 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.958 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:35:38.958 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.708862+0000", 2021-10-08T19:35:38.958 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:35:38.959 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.959 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.959 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:35:38.959 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.708862+0000", 2021-10-08T19:35:38.959 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:35:38.960 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.960 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.960 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:35:38.960 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.708860+0000", 2021-10-08T19:35:38.960 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:35:38.961 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.961 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.961 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:35:38.961 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.708867+0000", 2021-10-08T19:35:38.962 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3989999999999998e-06 2021-10-08T19:35:38.962 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.962 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.962 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:35:38.962 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.708879+0000", 2021-10-08T19:35:38.963 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1596999999999999e-05 2021-10-08T19:35:38.963 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.963 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.963 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:35:38.964 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.708886+0000", 2021-10-08T19:35:38.964 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6329999999999999e-06 2021-10-08T19:35:38.964 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.964 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.964 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:35:38.965 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.709040+0000", 2021-10-08T19:35:38.965 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000154165 2021-10-08T19:35:38.965 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.965 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.965 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:35:38.966 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.709175+0000", 2021-10-08T19:35:38.966 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013537799999999999 2021-10-08T19:35:38.966 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.966 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.967 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,7", 2021-10-08T19:35:38.967 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.709298+0000", 2021-10-08T19:35:38.967 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012234999999999999 2021-10-08T19:35:38.967 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.967 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.968 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:35:38.968 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.714212+0000", 2021-10-08T19:35:38.968 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0049148669999999998 2021-10-08T19:35:38.968 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.968 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.969 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:35:38.969 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.719125+0000", 2021-10-08T19:35:38.969 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0049129270000000001 2021-10-08T19:35:38.969 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.970 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.970 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:35:38.970 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.776199+0000", 2021-10-08T19:35:38.970 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.057073696 2021-10-08T19:35:38.970 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.971 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.971 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:35:38.971 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.776205+0000", 2021-10-08T19:35:38.971 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3600000000000001e-06 2021-10-08T19:35:38.972 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.972 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.972 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:35:38.972 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:30.603441+0000", 2021-10-08T19:35:38.972 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.82723589799999997 2021-10-08T19:35:38.973 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.973 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.973 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:35:38.973 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:30.603450+0000", 2021-10-08T19:35:38.973 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9970000000000004e-06 2021-10-08T19:35:38.974 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.974 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.974 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:35:38.974 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.711819+0000", 2021-10-08T19:35:38.975 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.108368746 2021-10-08T19:35:38.975 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.975 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.975 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for missing object", 2021-10-08T19:35:38.975 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.711960+0000", 2021-10-08T19:35:38.976 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000140827 2021-10-08T19:35:38.976 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.976 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.976 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:35:38.976 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.730339+0000", 2021-10-08T19:35:38.977 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.018379296 2021-10-08T19:35:38.977 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.977 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.977 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:35:38.977 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.730410+0000", 2021-10-08T19:35:38.978 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0765000000000004e-05 2021-10-08T19:35:38.978 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:35:38.978 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:35:38.978 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:35:38.979 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.979 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.979 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:95908 8.c 8:369db9f4:::benchmark_data_smithi097_144160_object7168:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e228)", 2021-10-08T19:35:38.979 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:29.787345+0000", 2021-10-08T19:35:38.979 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 369.08003633700002, 2021-10-08T19:35:38.980 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.94171282, 2021-10-08T19:35:38.980 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:35:38.980 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:35:38.980 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:35:38.981 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:35:38.981 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:35:38.981 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 95908 2021-10-08T19:35:38.981 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.981 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:35:38.982 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.982 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:35:38.982 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.787345+0000", 2021-10-08T19:35:38.982 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:35:38.982 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.983 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.983 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:35:38.983 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.787345+0000", 2021-10-08T19:35:38.983 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:35:38.984 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.984 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.984 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:35:38.984 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.787342+0000", 2021-10-08T19:35:38.984 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:35:38.985 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.985 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.985 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:35:38.985 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.787350+0000", 2021-10-08T19:35:38.986 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.909e-06 2021-10-08T19:35:38.986 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.986 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.986 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:35:38.986 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.787365+0000", 2021-10-08T19:35:38.987 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5223e-05 2021-10-08T19:35:38.987 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.987 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.987 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:35:38.987 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.787372+0000", 2021-10-08T19:35:38.988 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0010000000000004e-06 2021-10-08T19:35:38.988 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.988 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.988 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:35:38.988 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.787418+0000", 2021-10-08T19:35:38.989 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5334000000000003e-05 2021-10-08T19:35:38.989 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.989 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.989 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:35:38.990 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.787425+0000", 2021-10-08T19:35:38.990 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.255e-06 2021-10-08T19:35:38.990 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.990 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.990 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:35:38.991 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:30.603471+0000", 2021-10-08T19:35:38.991 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.81604612899999995 2021-10-08T19:35:38.991 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.991 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.991 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:35:38.992 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:30.603477+0000", 2021-10-08T19:35:38.992 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5500000000000002e-06 2021-10-08T19:35:38.992 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.992 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.993 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:35:38.993 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.712237+0000", 2021-10-08T19:35:38.993 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1087600710000001 2021-10-08T19:35:38.993 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.993 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.994 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:35:38.994 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.712323+0000", 2021-10-08T19:35:38.994 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6013999999999993e-05 2021-10-08T19:35:38.994 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.995 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.995 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,5,7", 2021-10-08T19:35:38.995 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.712639+0000", 2021-10-08T19:35:38.995 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031625499999999999 2021-10-08T19:35:38.995 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.996 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.996 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:35:38.996 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.719902+0000", 2021-10-08T19:35:38.996 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0072627710000000003 2021-10-08T19:35:38.996 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.997 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.997 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:35:38.997 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.720064+0000", 2021-10-08T19:35:38.997 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016218999999999999 2021-10-08T19:35:38.998 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.998 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.998 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:35:38.998 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.722758+0000", 2021-10-08T19:35:38.998 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00269367 2021-10-08T19:35:38.999 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:38.999 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:38.999 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:35:38.999 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.728832+0000", 2021-10-08T19:35:38.999 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0060743510000000004 2021-10-08T19:35:39.000 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.000 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.000 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:35:39.000 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.728900+0000", 2021-10-08T19:35:39.001 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7603999999999999e-05 2021-10-08T19:35:39.001 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.001 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.001 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:35:39.001 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.729057+0000", 2021-10-08T19:35:39.002 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000157708 2021-10-08T19:35:39.002 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:35:39.002 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:35:39.002 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:35:39.002 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.003 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.003 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:95914 8.c 8:36c7e6f1:::benchmark_data_smithi097_144160_object7174:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e228)", 2021-10-08T19:35:39.003 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:29.793186+0000", 2021-10-08T19:35:39.003 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 369.07419510099999, 2021-10-08T19:35:39.004 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.936144155, 2021-10-08T19:35:39.004 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:35:39.004 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:35:39.004 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:35:39.004 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:35:39.005 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:35:39.005 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 95914 2021-10-08T19:35:39.005 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.005 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:35:39.005 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.006 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:35:39.006 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.793186+0000", 2021-10-08T19:35:39.006 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:35:39.006 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.007 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.007 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:35:39.007 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.793186+0000", 2021-10-08T19:35:39.007 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:35:39.007 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.008 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.008 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:35:39.008 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.793184+0000", 2021-10-08T19:35:39.008 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:35:39.008 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.009 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.009 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:35:39.009 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.793190+0000", 2021-10-08T19:35:39.009 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.674e-06 2021-10-08T19:35:39.010 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.010 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.010 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:35:39.010 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.793205+0000", 2021-10-08T19:35:39.010 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4525999999999999e-05 2021-10-08T19:35:39.011 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.011 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.011 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:35:39.011 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.793213+0000", 2021-10-08T19:35:39.011 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4549999999999995e-06 2021-10-08T19:35:39.012 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.012 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.012 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:35:39.012 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.793263+0000", 2021-10-08T19:35:39.012 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.003e-05 2021-10-08T19:35:39.013 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.013 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.013 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:35:39.013 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.793272+0000", 2021-10-08T19:35:39.014 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.602e-06 2021-10-08T19:35:39.014 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.014 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.014 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:35:39.014 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:30.603493+0000", 2021-10-08T19:35:39.015 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.81022135200000001 2021-10-08T19:35:39.015 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.015 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.015 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:35:39.015 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:30.603499+0000", 2021-10-08T19:35:39.016 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7610000000000004e-06 2021-10-08T19:35:39.016 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.016 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.016 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:35:39.017 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.716324+0000", 2021-10-08T19:35:39.017 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.112824788 2021-10-08T19:35:39.017 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.017 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.017 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:35:39.018 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.716431+0000", 2021-10-08T19:35:39.018 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010764000000000001 2021-10-08T19:35:39.018 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.018 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.019 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,5,7", 2021-10-08T19:35:39.019 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.716514+0000", 2021-10-08T19:35:39.019 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2886999999999994e-05 2021-10-08T19:35:39.019 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.019 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.020 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:35:39.020 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.720153+0000", 2021-10-08T19:35:39.020 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0036386349999999999 2021-10-08T19:35:39.020 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.020 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.021 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:35:39.021 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.722770+0000", 2021-10-08T19:35:39.021 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002616878 2021-10-08T19:35:39.021 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.022 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.022 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:35:39.022 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.727179+0000", 2021-10-08T19:35:39.023 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0044094709999999999 2021-10-08T19:35:39.023 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.023 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.023 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:35:39.024 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.729124+0000", 2021-10-08T19:35:39.024 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0019448969999999999 2021-10-08T19:35:39.024 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.024 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.024 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:35:39.025 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.729190+0000", 2021-10-08T19:35:39.025 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5302000000000006e-05 2021-10-08T19:35:39.025 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.025 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.025 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:35:39.026 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.729330+0000", 2021-10-08T19:35:39.026 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000140464 2021-10-08T19:35:39.026 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:35:39.026 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:35:39.027 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:35:39.027 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.027 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.027 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:95923 8.c 8:34256d31:::benchmark_data_smithi097_144160_object7183:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e228)", 2021-10-08T19:35:39.027 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:29.812115+0000", 2021-10-08T19:35:39.028 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 369.05526623899999, 2021-10-08T19:35:39.028 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9176770869999999, 2021-10-08T19:35:39.028 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:35:39.028 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:35:39.029 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:35:39.029 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:35:39.029 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:35:39.029 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 95923 2021-10-08T19:35:39.030 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.030 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:35:39.030 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.030 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:35:39.031 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.812115+0000", 2021-10-08T19:35:39.031 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:35:39.031 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.031 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.031 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:35:39.032 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.812115+0000", 2021-10-08T19:35:39.032 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:35:39.032 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.032 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.032 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:35:39.033 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.812112+0000", 2021-10-08T19:35:39.033 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:35:39.033 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.033 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.033 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:35:39.034 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.812120+0000", 2021-10-08T19:35:39.034 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1450000000000008e-06 2021-10-08T19:35:39.034 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.034 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.035 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:35:39.035 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.812136+0000", 2021-10-08T19:35:39.035 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5447999999999998e-05 2021-10-08T19:35:39.035 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.035 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.036 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:35:39.036 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.812142+0000", 2021-10-08T19:35:39.036 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4969999999999998e-06 2021-10-08T19:35:39.036 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.037 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.037 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:35:39.037 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.812185+0000", 2021-10-08T19:35:39.037 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2920999999999998e-05 2021-10-08T19:35:39.037 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.038 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.038 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:35:39.038 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.812192+0000", 2021-10-08T19:35:39.038 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.703e-06 2021-10-08T19:35:39.038 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.039 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.039 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:35:39.039 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:30.603516+0000", 2021-10-08T19:35:39.039 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.79132443600000002 2021-10-08T19:35:39.040 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.040 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.040 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:35:39.040 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:30.603522+0000", 2021-10-08T19:35:39.040 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.755e-06 2021-10-08T19:35:39.041 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.041 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.041 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:35:39.041 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.717936+0000", 2021-10-08T19:35:39.041 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1144141670000001 2021-10-08T19:35:39.042 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.042 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.042 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:35:39.042 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.718079+0000", 2021-10-08T19:35:39.043 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000143146 2021-10-08T19:35:39.043 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.043 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.043 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,5,7", 2021-10-08T19:35:39.043 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.718167+0000", 2021-10-08T19:35:39.044 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7744000000000006e-05 2021-10-08T19:35:39.044 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.044 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.044 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:35:39.044 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.722739+0000", 2021-10-08T19:35:39.045 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.004571777 2021-10-08T19:35:39.045 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.045 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.045 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:35:39.046 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.722774+0000", 2021-10-08T19:35:39.046 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4669999999999998e-05 2021-10-08T19:35:39.046 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.046 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.046 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:35:39.047 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.727236+0000", 2021-10-08T19:35:39.047 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0044624249999999999 2021-10-08T19:35:39.047 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.047 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.047 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:35:39.048 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.729619+0000", 2021-10-08T19:35:39.048 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0023831740000000001 2021-10-08T19:35:39.048 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.048 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.049 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:35:39.049 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.729681+0000", 2021-10-08T19:35:39.049 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1555000000000003e-05 2021-10-08T19:35:39.049 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.049 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.050 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:35:39.050 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.729792+0000", 2021-10-08T19:35:39.050 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000110925 2021-10-08T19:35:39.050 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:35:39.050 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:35:39.051 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:35:39.051 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.051 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.051 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.25465.0:77499 9.5 9:ac4969c9:::benchmark_data_smithi097_196985_object77498:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e316)", 2021-10-08T19:35:39.052 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:32:38.365704+0000", 2021-10-08T19:35:39.052 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 180.50167693500001, 2021-10-08T19:35:39.052 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.218248098, 2021-10-08T19:35:39.052 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:35:39.052 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:35:39.053 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:35:39.053 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.25465", 2021-10-08T19:35:39.053 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:35:39.053 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 77499 2021-10-08T19:35:39.053 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.054 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:35:39.054 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.054 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:35:39.054 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.365704+0000", 2021-10-08T19:35:39.055 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:35:39.055 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.055 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.055 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:35:39.055 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.365704+0000", 2021-10-08T19:35:39.056 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:35:39.056 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.056 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.056 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:35:39.056 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.365703+0000", 2021-10-08T19:35:39.057 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:35:39.057 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.057 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.057 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:35:39.057 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.365732+0000", 2021-10-08T19:35:39.058 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9413000000000001e-05 2021-10-08T19:35:39.058 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.058 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.058 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:35:39.059 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.365740+0000", 2021-10-08T19:35:39.059 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.9799999999999998e-06 2021-10-08T19:35:39.059 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.059 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.059 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:35:39.060 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.365746+0000", 2021-10-08T19:35:39.060 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5180000000000004e-06 2021-10-08T19:35:39.060 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.060 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.060 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:35:39.061 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.365833+0000", 2021-10-08T19:35:39.061 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6839e-05 2021-10-08T19:35:39.061 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.061 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.062 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:35:39.062 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.365980+0000", 2021-10-08T19:35:39.062 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014722699999999999 2021-10-08T19:35:39.062 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.062 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.063 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5,7", 2021-10-08T19:35:39.063 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.366140+0000", 2021-10-08T19:35:39.063 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000159724 2021-10-08T19:35:39.063 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.064 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.064 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:35:39.064 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.374408+0000", 2021-10-08T19:35:39.064 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0082680989999999992 2021-10-08T19:35:39.064 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.065 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.065 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:35:39.065 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.374700+0000", 2021-10-08T19:35:39.065 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00029231899999999998 2021-10-08T19:35:39.065 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.066 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.066 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:35:39.066 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.583849+0000", 2021-10-08T19:35:39.066 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.209148682 2021-10-08T19:35:39.067 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.067 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.067 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:35:39.067 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.583907+0000", 2021-10-08T19:35:39.067 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8595999999999999e-05 2021-10-08T19:35:39.068 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.068 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.068 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:35:39.068 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.583952+0000", 2021-10-08T19:35:39.068 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4725000000000003e-05 2021-10-08T19:35:39.069 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:35:39.069 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:35:39.069 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:35:39.069 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.069 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.070 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.25465.0:77503 9.5 9:a86a20e3:::benchmark_data_smithi097_196985_object77502:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e316)", 2021-10-08T19:35:39.070 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:32:38.365758+0000", 2021-10-08T19:35:39.070 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 180.50162278900001, 2021-10-08T19:35:39.070 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.21830512399999999, 2021-10-08T19:35:39.071 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:35:39.071 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:35:39.071 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:35:39.071 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.25465", 2021-10-08T19:35:39.071 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:35:39.072 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 77503 2021-10-08T19:35:39.072 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.072 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:35:39.072 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.073 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:35:39.073 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.365758+0000", 2021-10-08T19:35:39.073 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:35:39.073 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.073 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.074 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:35:39.074 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.365758+0000", 2021-10-08T19:35:39.075 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:35:39.075 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.075 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.075 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:35:39.076 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.365757+0000", 2021-10-08T19:35:39.076 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:35:39.076 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.076 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.077 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:35:39.077 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.365780+0000", 2021-10-08T19:35:39.077 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3122e-05 2021-10-08T19:35:39.077 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.077 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.078 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:35:39.078 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.365787+0000", 2021-10-08T19:35:39.080 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2590000000000003e-06 2021-10-08T19:35:39.081 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.082 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.082 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:35:39.083 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.365792+0000", 2021-10-08T19:35:39.084 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6299999999999997e-06 2021-10-08T19:35:39.085 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.085 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.086 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:35:39.087 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.368908+0000", 2021-10-08T19:35:39.087 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031160990000000002 2021-10-08T19:35:39.090 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.091 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.092 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:35:39.095 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.369030+0000", 2021-10-08T19:35:39.095 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000121586 2021-10-08T19:35:39.095 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.096 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.096 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5,7", 2021-10-08T19:35:39.096 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.369198+0000", 2021-10-08T19:35:39.096 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016790899999999999 2021-10-08T19:35:39.097 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.097 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.097 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:35:39.098 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.374707+0000", 2021-10-08T19:35:39.098 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0055095439999999999 2021-10-08T19:35:39.098 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.099 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.099 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:35:39.099 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.378362+0000", 2021-10-08T19:35:39.100 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0036545200000000001 2021-10-08T19:35:39.100 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.100 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.101 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:35:39.101 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.583999+0000", 2021-10-08T19:35:39.102 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.205637458 2021-10-08T19:35:39.102 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.102 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.103 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:35:39.103 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.584040+0000", 2021-10-08T19:35:39.103 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1136000000000001e-05 2021-10-08T19:35:39.104 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.104 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.104 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:35:39.105 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.584063+0000", 2021-10-08T19:35:39.105 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2898999999999999e-05 2021-10-08T19:35:39.105 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:35:39.105 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:35:39.106 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:35:39.106 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.106 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.106 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.25465.0:77509 9.5 9:a04d875b:::benchmark_data_smithi097_196985_object77508:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e316)", 2021-10-08T19:35:39.107 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:32:38.371415+0000", 2021-10-08T19:35:39.107 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 180.49596568499999, 2021-10-08T19:35:39.107 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.21278445500000001, 2021-10-08T19:35:39.107 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:35:39.108 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:35:39.108 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:35:39.108 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.25465", 2021-10-08T19:35:39.108 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:35:39.108 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 77509 2021-10-08T19:35:39.109 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.109 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:35:39.110 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.110 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:35:39.110 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.371415+0000", 2021-10-08T19:35:39.110 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:35:39.111 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.111 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.111 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:35:39.111 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.371415+0000", 2021-10-08T19:35:39.112 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:35:39.112 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.112 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.112 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:35:39.112 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.371406+0000", 2021-10-08T19:35:39.113 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999905 2021-10-08T19:35:39.113 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.113 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.113 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:35:39.114 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.371438+0000", 2021-10-08T19:35:39.114 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2721000000000001e-05 2021-10-08T19:35:39.114 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.114 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.115 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:35:39.115 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.371455+0000", 2021-10-08T19:35:39.115 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6358000000000002e-05 2021-10-08T19:35:39.116 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.116 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.116 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:35:39.116 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.371462+0000", 2021-10-08T19:35:39.117 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9670000000000004e-06 2021-10-08T19:35:39.117 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.118 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.118 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:35:39.118 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.371659+0000", 2021-10-08T19:35:39.118 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019755700000000001 2021-10-08T19:35:39.119 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.119 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.119 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:35:39.119 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.371783+0000", 2021-10-08T19:35:39.120 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012396900000000001 2021-10-08T19:35:39.120 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.120 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.120 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5,7", 2021-10-08T19:35:39.121 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.371927+0000", 2021-10-08T19:35:39.121 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014406999999999999 2021-10-08T19:35:39.121 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.121 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.122 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:35:39.122 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.374712+0000", 2021-10-08T19:35:39.122 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002784637 2021-10-08T19:35:39.122 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.122 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.123 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:35:39.123 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.379861+0000", 2021-10-08T19:35:39.124 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0051490629999999997 2021-10-08T19:35:39.124 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.125 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.125 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:35:39.126 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.584119+0000", 2021-10-08T19:35:39.126 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.20425789899999999 2021-10-08T19:35:39.126 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.126 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.127 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:35:39.127 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.584168+0000", 2021-10-08T19:35:39.127 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8950999999999999e-05 2021-10-08T19:35:39.127 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.128 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.128 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:35:39.128 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.584200+0000", 2021-10-08T19:35:39.129 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1919999999999999e-05 2021-10-08T19:35:39.129 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:35:39.129 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:35:39.129 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:35:39.130 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.130 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.130 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.25465.0:77518 9.9 9:9bd075f7:::benchmark_data_smithi097_196985_object77517:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e316)", 2021-10-08T19:35:39.130 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:32:38.375390+0000", 2021-10-08T19:35:39.130 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 180.49199114199999, 2021-10-08T19:35:39.131 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.205559359, 2021-10-08T19:35:39.131 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:35:39.131 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:35:39.131 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:35:39.132 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.25465", 2021-10-08T19:35:39.132 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:35:39.132 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 77518 2021-10-08T19:35:39.132 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.132 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:35:39.133 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.133 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:35:39.133 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.375390+0000", 2021-10-08T19:35:39.133 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:35:39.134 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.134 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.134 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:35:39.134 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.375390+0000", 2021-10-08T19:35:39.135 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:35:39.135 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.135 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.135 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:35:39.136 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.375387+0000", 2021-10-08T19:35:39.136 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:35:39.137 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.137 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.137 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:35:39.137 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.375416+0000", 2021-10-08T19:35:39.138 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8918999999999999e-05 2021-10-08T19:35:39.138 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.138 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.138 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:35:39.138 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.375427+0000", 2021-10-08T19:35:39.139 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1015999999999999e-05 2021-10-08T19:35:39.139 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.139 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.139 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:35:39.140 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.375433+0000", 2021-10-08T19:35:39.140 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.429e-06 2021-10-08T19:35:39.140 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.141 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.141 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:35:39.141 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.375474+0000", 2021-10-08T19:35:39.141 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1088999999999999e-05 2021-10-08T19:35:39.141 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.142 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.142 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:35:39.142 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.375599+0000", 2021-10-08T19:35:39.143 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012533299999999999 2021-10-08T19:35:39.143 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.143 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.143 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5,7", 2021-10-08T19:35:39.144 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.375735+0000", 2021-10-08T19:35:39.144 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013548499999999999 2021-10-08T19:35:39.144 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.144 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.144 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:35:39.145 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.379297+0000", 2021-10-08T19:35:39.145 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0035629390000000002 2021-10-08T19:35:39.146 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.146 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.146 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:35:39.147 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.379825+0000", 2021-10-08T19:35:39.147 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00052726900000000002 2021-10-08T19:35:39.147 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.148 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.148 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:35:39.148 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.580863+0000", 2021-10-08T19:35:39.148 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.20103870200000001 2021-10-08T19:35:39.149 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.149 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.149 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:35:39.149 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.580907+0000", 2021-10-08T19:35:39.150 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3170999999999997e-05 2021-10-08T19:35:39.151 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.151 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.151 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:35:39.152 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.580949+0000", 2021-10-08T19:35:39.152 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2543000000000002e-05 2021-10-08T19:35:39.152 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:35:39.152 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:35:39.153 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:35:39.153 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.153 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.153 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.25465.0:196909 9.b 9:d3161f3e:::benchmark_data_smithi097_196985_object81218:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e341)", 2021-10-08T19:35:39.153 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:34:26.373452+0000", 2021-10-08T19:35:39.154 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 72.493929381000001, 2021-10-08T19:35:39.154 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.29762082699999998, 2021-10-08T19:35:39.154 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:35:39.154 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:35:39.155 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:35:39.155 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.25465", 2021-10-08T19:35:39.155 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:35:39.155 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 196909 2021-10-08T19:35:39.155 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.156 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:35:39.156 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.156 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:35:39.156 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.373452+0000", 2021-10-08T19:35:39.156 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:35:39.159 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.160 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.160 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:35:39.160 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.373452+0000", 2021-10-08T19:35:39.160 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:35:39.161 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.161 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.161 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:35:39.161 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.373451+0000", 2021-10-08T19:35:39.161 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:35:39.162 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.162 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.162 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:35:39.162 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.373454+0000", 2021-10-08T19:35:39.163 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6830000000000001e-06 2021-10-08T19:35:39.163 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.163 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.163 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:35:39.163 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.373460+0000", 2021-10-08T19:35:39.164 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8629999999999996e-06 2021-10-08T19:35:39.164 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.164 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.164 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:35:39.165 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.373465+0000", 2021-10-08T19:35:39.165 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4560000000000002e-06 2021-10-08T19:35:39.165 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.165 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.165 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:35:39.166 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.378034+0000", 2021-10-08T19:35:39.166 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0045690009999999996 2021-10-08T19:35:39.166 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.166 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.167 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:35:39.167 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.378139+0000", 2021-10-08T19:35:39.167 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000104813 2021-10-08T19:35:39.167 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.167 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.168 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5,6", 2021-10-08T19:35:39.168 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.378241+0000", 2021-10-08T19:35:39.168 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000102816 2021-10-08T19:35:39.168 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.168 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.169 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:35:39.169 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.382310+0000", 2021-10-08T19:35:39.169 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0040688900000000004 2021-10-08T19:35:39.169 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.170 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.170 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:35:39.170 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.382322+0000", 2021-10-08T19:35:39.170 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1875999999999999e-05 2021-10-08T19:35:39.170 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.171 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.171 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:35:39.171 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.670947+0000", 2021-10-08T19:35:39.171 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.28862520800000002 2021-10-08T19:35:39.172 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.172 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.172 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:35:39.172 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.671025+0000", 2021-10-08T19:35:39.173 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7998999999999996e-05 2021-10-08T19:35:39.173 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.173 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.173 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:35:39.173 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.671072+0000", 2021-10-08T19:35:39.174 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6992e-05 2021-10-08T19:35:39.174 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:35:39.174 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:35:39.174 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:35:39.175 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.175 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.175 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.25465.0:196921 9.b 9:dd1735bf:::benchmark_data_smithi097_196985_object81230:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e341)", 2021-10-08T19:35:39.175 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:34:26.382586+0000", 2021-10-08T19:35:39.176 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 72.484795367999993, 2021-10-08T19:35:39.176 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.28861674900000001, 2021-10-08T19:35:39.176 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:35:39.176 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:35:39.176 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:35:39.177 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.25465", 2021-10-08T19:35:39.177 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:35:39.177 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 196921 2021-10-08T19:35:39.177 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.177 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:35:39.178 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.178 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:35:39.178 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.382586+0000", 2021-10-08T19:35:39.178 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:35:39.179 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.179 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.179 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:35:39.179 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.382586+0000", 2021-10-08T19:35:39.180 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:35:39.180 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.180 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.180 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:35:39.181 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.382584+0000", 2021-10-08T19:35:39.181 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:35:39.181 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.182 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.182 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:35:39.182 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.382590+0000", 2021-10-08T19:35:39.182 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8039999999999998e-06 2021-10-08T19:35:39.183 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.183 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.183 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:35:39.183 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.382601+0000", 2021-10-08T19:35:39.183 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1226000000000001e-05 2021-10-08T19:35:39.184 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.184 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.184 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:35:39.184 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.382607+0000", 2021-10-08T19:35:39.185 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7509999999999997e-06 2021-10-08T19:35:39.185 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.185 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.185 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:35:39.185 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.382650+0000", 2021-10-08T19:35:39.186 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2886000000000002e-05 2021-10-08T19:35:39.186 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.186 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.186 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:35:39.187 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.382768+0000", 2021-10-08T19:35:39.187 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000118529 2021-10-08T19:35:39.187 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.187 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.187 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5,6", 2021-10-08T19:35:39.188 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.382899+0000", 2021-10-08T19:35:39.188 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013076799999999999 2021-10-08T19:35:39.188 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.188 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.189 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:35:39.189 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.388100+0000", 2021-10-08T19:35:39.189 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0052012300000000003 2021-10-08T19:35:39.189 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.190 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.190 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:35:39.190 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.388755+0000", 2021-10-08T19:35:39.190 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065508199999999997 2021-10-08T19:35:39.191 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.191 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.191 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:35:39.191 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.671120+0000", 2021-10-08T19:35:39.191 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.28236478799999998 2021-10-08T19:35:39.192 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.193 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.193 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:35:39.193 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.671160+0000", 2021-10-08T19:35:39.193 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0522999999999998e-05 2021-10-08T19:35:39.193 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.194 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.194 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:35:39.194 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.671202+0000", 2021-10-08T19:35:39.194 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1845999999999999e-05 2021-10-08T19:35:39.195 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:35:39.195 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:35:39.195 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:35:39.195 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.196 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.196 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.25465.0:196925 9.5 9:ac405794:::benchmark_data_smithi097_196985_object81234:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e341)", 2021-10-08T19:35:39.196 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:34:26.386316+0000", 2021-10-08T19:35:39.196 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 72.481064598000003, 2021-10-08T19:35:39.196 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.29086161999999999, 2021-10-08T19:35:39.197 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:35:39.197 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:35:39.197 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:35:39.197 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.25465", 2021-10-08T19:35:39.198 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:35:39.198 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 196925 2021-10-08T19:35:39.198 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.198 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:35:39.198 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.199 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:35:39.199 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.386316+0000", 2021-10-08T19:35:39.199 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:35:39.199 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.200 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.200 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:35:39.200 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.386316+0000", 2021-10-08T19:35:39.200 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:35:39.200 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.201 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.201 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:35:39.201 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.386314+0000", 2021-10-08T19:35:39.206 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:35:39.207 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.207 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.207 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:35:39.207 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.386322+0000", 2021-10-08T19:35:39.208 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4669999999999998e-06 2021-10-08T19:35:39.208 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.208 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.208 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:35:39.209 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.386335+0000", 2021-10-08T19:35:39.209 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3692999999999999e-05 2021-10-08T19:35:39.209 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.209 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.210 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:35:39.210 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.386342+0000", 2021-10-08T19:35:39.210 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3709999999999996e-06 2021-10-08T19:35:39.210 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.211 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.211 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:35:39.211 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.386395+0000", 2021-10-08T19:35:39.211 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3667e-05 2021-10-08T19:35:39.212 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.212 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.212 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:35:39.212 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.386540+0000", 2021-10-08T19:35:39.212 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000144802 2021-10-08T19:35:39.213 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.213 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.213 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5,7", 2021-10-08T19:35:39.213 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.386673+0000", 2021-10-08T19:35:39.214 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013296799999999999 2021-10-08T19:35:39.214 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.214 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.214 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:35:39.214 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.388773+0000", 2021-10-08T19:35:39.215 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0020994160000000002 2021-10-08T19:35:39.215 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.215 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.215 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:35:39.216 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.389104+0000", 2021-10-08T19:35:39.216 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00033187400000000001 2021-10-08T19:35:39.216 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.216 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.216 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:35:39.217 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.677085+0000", 2021-10-08T19:35:39.217 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.28798012000000001 2021-10-08T19:35:39.217 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.218 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.218 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:35:39.218 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.677139+0000", 2021-10-08T19:35:39.219 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4388999999999997e-05 2021-10-08T19:35:39.219 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.219 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.219 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:35:39.220 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.677178+0000", 2021-10-08T19:35:39.220 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9005999999999999e-05 2021-10-08T19:35:39.220 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:35:39.220 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:35:39.220 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:35:39.221 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.221 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.221 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.25465.0:196928 9.b 9:d665e198:::benchmark_data_smithi097_196985_object81237:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e341)", 2021-10-08T19:35:39.221 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:34:26.389260+0000", 2021-10-08T19:35:39.222 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 72.478120871000002, 2021-10-08T19:35:39.222 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.28951838899999999, 2021-10-08T19:35:39.222 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:35:39.222 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:35:39.222 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:35:39.223 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.25465", 2021-10-08T19:35:39.223 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:35:39.223 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 196928 2021-10-08T19:35:39.223 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.224 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:35:39.224 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.224 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:35:39.224 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.389260+0000", 2021-10-08T19:35:39.224 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:35:39.225 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.225 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.225 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:35:39.225 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.389260+0000", 2021-10-08T19:35:39.226 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:35:39.226 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.226 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.228 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:35:39.228 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.389258+0000", 2021-10-08T19:35:39.228 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:35:39.229 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.229 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.229 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:35:39.229 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.389264+0000", 2021-10-08T19:35:39.229 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2600000000000002e-06 2021-10-08T19:35:39.230 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.230 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.230 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:35:39.230 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.389273+0000", 2021-10-08T19:35:39.231 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9930000000000001e-06 2021-10-08T19:35:39.231 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.231 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.231 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:35:39.231 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.389279+0000", 2021-10-08T19:35:39.232 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1390000000000003e-06 2021-10-08T19:35:39.232 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.232 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.232 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:35:39.233 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.389319+0000", 2021-10-08T19:35:39.233 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0753000000000001e-05 2021-10-08T19:35:39.233 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.234 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.234 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:35:39.234 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.389437+0000", 2021-10-08T19:35:39.235 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000117525 2021-10-08T19:35:39.235 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.235 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.235 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5,6", 2021-10-08T19:35:39.236 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.389559+0000", 2021-10-08T19:35:39.236 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012188099999999999 2021-10-08T19:35:39.236 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.236 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.236 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:35:39.237 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.392094+0000", 2021-10-08T19:35:39.237 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0025352909999999998 2021-10-08T19:35:39.237 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.237 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.238 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:35:39.238 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.392234+0000", 2021-10-08T19:35:39.238 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000140137 2021-10-08T19:35:39.238 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.238 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.239 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:35:39.239 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.678693+0000", 2021-10-08T19:35:39.239 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.28645897199999998 2021-10-08T19:35:39.239 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.240 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.240 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:35:39.240 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.678740+0000", 2021-10-08T19:35:39.241 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6947000000000003e-05 2021-10-08T19:35:39.241 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.241 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.241 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:35:39.242 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.678778+0000", 2021-10-08T19:35:39.242 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8306999999999998e-05 2021-10-08T19:35:39.242 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:35:39.242 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:35:39.243 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:35:39.243 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.243 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.243 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.25465.0:196929 9.9 9:97d8a271:::benchmark_data_smithi097_196985_object81238:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e341)", 2021-10-08T19:35:39.244 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:34:26.389290+0000", 2021-10-08T19:35:39.244 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 72.478091105999994, 2021-10-08T19:35:39.244 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.28974777299999999, 2021-10-08T19:35:39.245 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:35:39.245 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:35:39.245 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:35:39.245 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.25465", 2021-10-08T19:35:39.246 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:35:39.246 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 196929 2021-10-08T19:35:39.246 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.246 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:35:39.246 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.247 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:35:39.247 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.389290+0000", 2021-10-08T19:35:39.247 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:35:39.247 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.248 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.248 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:35:39.248 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.389290+0000", 2021-10-08T19:35:39.248 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:35:39.249 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.249 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.249 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:35:39.249 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.389289+0000", 2021-10-08T19:35:39.250 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:35:39.250 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.250 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.251 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:35:39.251 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.389292+0000", 2021-10-08T19:35:39.251 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3469999999999999e-06 2021-10-08T19:35:39.251 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.252 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.252 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:35:39.252 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.389296+0000", 2021-10-08T19:35:39.252 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8240000000000001e-06 2021-10-08T19:35:39.252 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.253 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.253 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:35:39.253 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.389299+0000", 2021-10-08T19:35:39.253 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.79e-06 2021-10-08T19:35:39.254 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.254 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.254 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:35:39.254 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.389337+0000", 2021-10-08T19:35:39.254 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8405000000000002e-05 2021-10-08T19:35:39.255 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.255 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.255 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:35:39.256 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.389413+0000", 2021-10-08T19:35:39.256 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5648999999999993e-05 2021-10-08T19:35:39.256 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.256 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.256 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5,7", 2021-10-08T19:35:39.257 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.389490+0000", 2021-10-08T19:35:39.257 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6394000000000001e-05 2021-10-08T19:35:39.257 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.257 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.257 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:35:39.258 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.391545+0000", 2021-10-08T19:35:39.258 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0020555199999999999 2021-10-08T19:35:39.258 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.258 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.259 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:35:39.259 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.392409+0000", 2021-10-08T19:35:39.259 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00086392200000000004 2021-10-08T19:35:39.259 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.260 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.260 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:35:39.260 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.678952+0000", 2021-10-08T19:35:39.261 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.28654300100000002 2021-10-08T19:35:39.261 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.261 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.261 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:35:39.261 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.678999+0000", 2021-10-08T19:35:39.262 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7131e-05 2021-10-08T19:35:39.262 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.262 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.262 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:35:39.264 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.679038+0000", 2021-10-08T19:35:39.264 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8507999999999998e-05 2021-10-08T19:35:39.264 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:35:39.265 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:35:39.265 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:35:39.265 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.266 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.266 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.25465.0:196931 9.b 9:dfa4ef30:::benchmark_data_smithi097_196985_object81240:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e341)", 2021-10-08T19:35:39.266 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:34:26.393860+0000", 2021-10-08T19:35:39.268 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 72.473520841999999, 2021-10-08T19:35:39.268 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.28502909100000001, 2021-10-08T19:35:39.269 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:35:39.269 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:35:39.269 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:35:39.269 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.25465", 2021-10-08T19:35:39.271 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:35:39.272 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 196931 2021-10-08T19:35:39.272 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.272 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:35:39.272 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.273 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:35:39.273 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.393860+0000", 2021-10-08T19:35:39.273 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:35:39.273 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.274 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.274 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:35:39.274 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.393860+0000", 2021-10-08T19:35:39.274 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:35:39.276 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.276 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.276 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:35:39.276 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.393858+0000", 2021-10-08T19:35:39.277 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:35:39.277 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.277 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.278 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:35:39.278 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.393867+0000", 2021-10-08T19:35:39.279 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0999999999999993e-06 2021-10-08T19:35:39.281 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.281 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.281 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:35:39.282 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.393878+0000", 2021-10-08T19:35:39.282 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0854e-05 2021-10-08T19:35:39.282 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.283 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.283 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:35:39.283 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.393883+0000", 2021-10-08T19:35:39.284 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2569999999999998e-06 2021-10-08T19:35:39.285 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.285 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.285 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:35:39.286 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.393930+0000", 2021-10-08T19:35:39.286 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6879000000000003e-05 2021-10-08T19:35:39.286 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.286 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.287 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:35:39.287 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.394057+0000", 2021-10-08T19:35:39.287 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012658 2021-10-08T19:35:39.287 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.288 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.288 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5,6", 2021-10-08T19:35:39.288 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.394193+0000", 2021-10-08T19:35:39.288 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013653299999999999 2021-10-08T19:35:39.288 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.289 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.289 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:35:39.289 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.396081+0000", 2021-10-08T19:35:39.289 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0018877430000000001 2021-10-08T19:35:39.290 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.290 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.290 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:35:39.290 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.396205+0000", 2021-10-08T19:35:39.291 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012362000000000001 2021-10-08T19:35:39.291 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.291 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.291 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:35:39.291 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.678819+0000", 2021-10-08T19:35:39.292 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.28261443000000003 2021-10-08T19:35:39.292 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.292 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.292 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:35:39.293 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.678861+0000", 2021-10-08T19:35:39.293 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2246999999999997e-05 2021-10-08T19:35:39.293 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.293 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.293 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:35:39.294 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.678889+0000", 2021-10-08T19:35:39.294 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7849999999999999e-05 2021-10-08T19:35:39.294 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:35:39.294 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:35:39.294 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:35:39.295 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.295 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.296 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.25465.0:209994 9.9 9:93bcfe32:::benchmark_data_smithi097_196985_object94303:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e343)", 2021-10-08T19:35:39.296 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:34:38.453735+0000", 2021-10-08T19:35:39.297 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 60.413645459999998, 2021-10-08T19:35:39.297 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.21142575199999999, 2021-10-08T19:35:39.297 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:35:39.297 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:35:39.298 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:35:39.298 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.25465", 2021-10-08T19:35:39.298 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:35:39.298 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 209994 2021-10-08T19:35:39.299 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.299 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:35:39.299 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.300 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:35:39.300 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:38.453735+0000", 2021-10-08T19:35:39.300 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:35:39.300 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.301 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.301 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:35:39.301 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:38.453735+0000", 2021-10-08T19:35:39.301 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:35:39.301 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.302 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.302 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:35:39.302 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:38.453732+0000", 2021-10-08T19:35:39.302 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2021-10-08T19:35:39.302 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.303 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.303 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:35:39.303 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:38.453744+0000", 2021-10-08T19:35:39.303 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1208e-05 2021-10-08T19:35:39.304 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.304 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.304 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:35:39.304 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:38.453765+0000", 2021-10-08T19:35:39.304 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0939000000000001e-05 2021-10-08T19:35:39.305 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.305 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.305 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:35:39.305 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:38.453773+0000", 2021-10-08T19:35:39.305 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5040000000000002e-06 2021-10-08T19:35:39.306 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.306 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.306 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:35:39.306 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:38.453817+0000", 2021-10-08T19:35:39.307 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4017999999999998e-05 2021-10-08T19:35:39.307 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.307 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.307 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:35:39.308 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:38.453939+0000", 2021-10-08T19:35:39.308 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000122378 2021-10-08T19:35:39.308 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.308 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.309 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5,7", 2021-10-08T19:35:39.309 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:38.454042+0000", 2021-10-08T19:35:39.309 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010236800000000001 2021-10-08T19:35:39.309 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.310 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.310 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:35:39.310 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:38.456427+0000", 2021-10-08T19:35:39.310 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0023853939999999999 2021-10-08T19:35:39.311 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.311 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.311 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:35:39.311 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:38.456825+0000", 2021-10-08T19:35:39.311 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00039824100000000002 2021-10-08T19:35:39.312 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.312 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.312 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:35:39.312 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:38.665039+0000", 2021-10-08T19:35:39.312 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.20821398699999999 2021-10-08T19:35:39.313 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.313 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.313 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:35:39.313 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:38.665113+0000", 2021-10-08T19:35:39.314 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3213999999999994e-05 2021-10-08T19:35:39.314 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.314 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.314 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:35:39.314 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:38.665161+0000", 2021-10-08T19:35:39.315 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8560999999999998e-05 2021-10-08T19:35:39.315 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:35:39.315 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:35:39.315 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:35:39.316 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.316 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.316 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15870.0:28530 10.4 10:2743f565:::benchmark_data_smithi097_245820_object28529:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e364)", 2021-10-08T19:35:39.316 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:35:38.023694+0000", 2021-10-08T19:35:39.316 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.84368686100000001, 2021-10-08T19:35:39.317 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.11442221399999999, 2021-10-08T19:35:39.317 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:35:39.317 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:35:39.318 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:35:39.318 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15870", 2021-10-08T19:35:39.318 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1128006081", 2021-10-08T19:35:39.318 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 28530 2021-10-08T19:35:39.319 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.319 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:35:39.319 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.319 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:35:39.320 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:38.023694+0000", 2021-10-08T19:35:39.320 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:35:39.320 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.320 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.320 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:35:39.321 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:38.023694+0000", 2021-10-08T19:35:39.321 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:35:39.321 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.321 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.321 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:35:39.322 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:38.023692+0000", 2021-10-08T19:35:39.322 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:35:39.322 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.322 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.322 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:35:39.323 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:38.023716+0000", 2021-10-08T19:35:39.323 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4105e-05 2021-10-08T19:35:39.323 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.323 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.324 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:35:39.324 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:38.023727+0000", 2021-10-08T19:35:39.324 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1542000000000001e-05 2021-10-08T19:35:39.324 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.324 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.325 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:35:39.325 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:38.023734+0000", 2021-10-08T19:35:39.325 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6290000000000004e-06 2021-10-08T19:35:39.325 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.325 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.326 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:35:39.326 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:38.023782+0000", 2021-10-08T19:35:39.326 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7661999999999999e-05 2021-10-08T19:35:39.326 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.326 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.327 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:35:39.327 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:38.132932+0000", 2021-10-08T19:35:39.327 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.109150679 2021-10-08T19:35:39.327 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.328 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.328 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,4", 2021-10-08T19:35:39.328 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:38.133108+0000", 2021-10-08T19:35:39.329 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017590800000000001 2021-10-08T19:35:39.329 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.329 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.329 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:35:39.329 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:38.135259+0000", 2021-10-08T19:35:39.330 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002150707 2021-10-08T19:35:39.330 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.330 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.330 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:35:39.331 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:38.135266+0000", 2021-10-08T19:35:39.331 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2139999999999999e-06 2021-10-08T19:35:39.331 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.331 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.331 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:35:39.332 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:38.138019+0000", 2021-10-08T19:35:39.332 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0027522610000000002 2021-10-08T19:35:39.332 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.332 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.332 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:35:39.333 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:38.138070+0000", 2021-10-08T19:35:39.333 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1277999999999999e-05 2021-10-08T19:35:39.333 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.333 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.333 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:35:39.334 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:38.138116+0000", 2021-10-08T19:35:39.334 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6434999999999998e-05 2021-10-08T19:35:39.334 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:35:39.334 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:35:39.335 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:35:39.335 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.335 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.335 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.15870.0:28529 10.c e364/355 10:3df6e969:::benchmark_data_smithi097_245820_object28528:head v 364'1792, mlcod=364'1790)", 2021-10-08T19:35:39.336 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:35:38.023922+0000", 2021-10-08T19:35:39.336 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.84345853699999995, 2021-10-08T19:35:39.336 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.11375858699999999, 2021-10-08T19:35:39.336 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:35:39.337 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:35:39.337 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:35:39.337 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.337 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:35:39.337 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:38.023922+0000", 2021-10-08T19:35:39.338 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:35:39.338 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.338 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.338 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:35:39.339 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:38.023922+0000", 2021-10-08T19:35:39.339 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:35:39.339 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.339 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.339 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:35:39.340 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:38.023921+0000", 2021-10-08T19:35:39.340 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2021-10-08T19:35:39.340 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.340 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.340 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:35:39.341 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:38.023973+0000", 2021-10-08T19:35:39.341 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1935999999999999e-05 2021-10-08T19:35:39.341 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.341 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.341 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:35:39.342 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:38.132854+0000", 2021-10-08T19:35:39.342 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.108881358 2021-10-08T19:35:39.342 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.342 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.343 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:35:39.343 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:38.132866+0000", 2021-10-08T19:35:39.343 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1821000000000001e-05 2021-10-08T19:35:39.343 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.344 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.344 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:35:39.344 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:38.134212+0000", 2021-10-08T19:35:39.344 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001345628 2021-10-08T19:35:39.344 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.345 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.345 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:35:39.345 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:38.134229+0000", 2021-10-08T19:35:39.345 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6821e-05 2021-10-08T19:35:39.346 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.346 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.346 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:35:39.346 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:38.137648+0000", 2021-10-08T19:35:39.346 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003418978 2021-10-08T19:35:39.347 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:35:39.347 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:35:39.347 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:35:39.347 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:38.137681+0000", 2021-10-08T19:35:39.348 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3377999999999998e-05 2021-10-08T19:35:39.348 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:35:39.348 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:35:39.348 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:35:39.348 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:35:39.349 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:35:39.349 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:35:39.349 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:35:39.350 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:35:39 smithi097 conmon[33110]: 172.21.15.97 - - [08/Oct/2021:19:35:39] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:35:39.358 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 13 16 30847 30831 148.184 114.875 0.00466508 0.00674175 2021-10-08T19:35:39.409 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:39.579 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:35:39.579 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:35:39.603 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:35:39.638 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:35:39.671 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:35:39.704 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:35:39.737 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:35:39.770 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:35:39.777 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'false' 2021-10-08T19:35:39.778 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'false' 2021-10-08T19:35:39.778 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'false' 2021-10-08T19:35:39.778 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'false' 2021-10-08T19:35:39.779 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'false' 2021-10-08T19:35:39.779 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'false' 2021-10-08T19:35:39.779 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'false' 2021-10-08T19:35:39.780 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'false' 2021-10-08T19:35:40.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:40 smithi097 ceph-mon[32687]: pgmap v712: 178 pgs: 178 active+clean; 1.6 GiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 1.3 KiB/s rd, 134 MiB/s wr, 2.15k op/s 2021-10-08T19:35:40.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:40 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:35:40.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:40 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:35:40.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:40 smithi097 ceph-mon[32687]: 172.21.15.97 - - [08/Oct/2021:19:35:39] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:35:40.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:40 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/4063143193' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:35:40.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:40 smithi097 ceph-mon[41966]: pgmap v712: 178 pgs: 178 active+clean; 1.6 GiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 1.3 KiB/s rd, 134 MiB/s wr, 2.15k op/s 2021-10-08T19:35:40.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:40 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:35:40.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:40 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:35:40.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:40 smithi097 ceph-mon[41966]: 172.21.15.97 - - [08/Oct/2021:19:35:39] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:35:40.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:40 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/4063143193' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:35:40.355 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 14 16 32616 32600 145.485 110.562 0.00753279 0.00686666 2021-10-08T19:35:40.373 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2021-10-08T19:35:40.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:40 smithi117 ceph-mon[34585]: pgmap v712: 178 pgs: 178 active+clean; 1.6 GiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 1.3 KiB/s rd, 134 MiB/s wr, 2.15k op/s 2021-10-08T19:35:40.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:40 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:35:40.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:40 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:35:40.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:40 smithi117 ceph-mon[34585]: 172.21.15.97 - - [08/Oct/2021:19:35:39] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:35:40.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:40 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/4063143193' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:35:40.417 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:35:40.424 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:40.425 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:35:40.529 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:35:40.545 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set nodeep-scrub 2021-10-08T19:35:40.579 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:40.688 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:35:40.691 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:40.692 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:35:40.793 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:35:40.854 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:41.051 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:35:41.059 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:41.060 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:35:41.068 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.5 to 1 (10000) 2021-10-08T19:35:41.091 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:35:41.161 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:35:41.213 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:41.218 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:35:41.355 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 15 16 34233 34217 142.523 101.062 0.00788128 0.00700967 2021-10-08T19:35:41.395 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:35:41.403 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:41 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3634353654' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2021-10-08T19:35:41.409 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:41.410 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:35:41.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:41 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3634353654' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2021-10-08T19:35:41.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:41 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3634353654' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2021-10-08T19:35:41.510 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:35:41.549 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:41.818 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:35:41.822 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:41.822 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:35:41.923 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:35:41.948 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd reweight 7 1 2021-10-08T19:35:41.977 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:42.064 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:35:42.068 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:42.069 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:35:42.158 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:42 smithi097 ceph-mon[32687]: pgmap v713: 178 pgs: 178 active+clean; 1.8 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 1.2 KiB/s rd, 166 MiB/s wr, 2.66k op/s 2021-10-08T19:35:42.159 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:42 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3634353654' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]': finished 2021-10-08T19:35:42.159 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:42 smithi097 ceph-mon[32687]: osdmap e365: 8 total, 8 up, 8 in 2021-10-08T19:35:42.159 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:42 smithi097 ceph-mon[41966]: pgmap v713: 178 pgs: 178 active+clean; 1.8 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 1.2 KiB/s rd, 166 MiB/s wr, 2.66k op/s 2021-10-08T19:35:42.160 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:42 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3634353654' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]': finished 2021-10-08T19:35:42.160 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:42 smithi097 ceph-mon[41966]: osdmap e365: 8 total, 8 up, 8 in 2021-10-08T19:35:42.170 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:35:42.269 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:42.315 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:42 smithi117 ceph-mon[34585]: pgmap v713: 178 pgs: 178 active+clean; 1.8 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 1.2 KiB/s rd, 166 MiB/s wr, 2.66k op/s 2021-10-08T19:35:42.316 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:42 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3634353654' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]': finished 2021-10-08T19:35:42.316 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:42 smithi117 ceph-mon[34585]: osdmap e365: 8 total, 8 up, 8 in 2021-10-08T19:35:42.355 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 16 15 35885 35870 140.073 103.312 0.011674 0.007133 2021-10-08T19:35:42.379 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:35:42.389 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:42.390 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:35:42.491 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:35:42.544 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:42.655 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:35:42 smithi117 conmon[69189]: level=error ts=2021-10-08T19:35:42.314Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=1 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:35:42.838 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:35:42.841 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:35:42 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:35:42] "GET /metrics HTTP/1.1" 200 155832 "" "Prometheus/2.18.1" 2021-10-08T19:35:42.843 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:42.844 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:35:42.945 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:35:42.995 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:43.077 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2021-10-08T19:35:43.088 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:35:43.092 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:43.093 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:35:43.110 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:35:43.111 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:35:43.111 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:35:43.112 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:35:43.194 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:35:43.236 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:43.360 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 17 16 37494 37478 137.734 100.5 0.00613361 0.00725635 2021-10-08T19:35:43.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:35:43.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:35:44.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:44 smithi117 ceph-mon[34585]: pgmap v715: 178 pgs: 178 active+clean; 1.8 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 646 B/s rd, 76 MiB/s wr, 1.21k op/s 2021-10-08T19:35:44.157 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:35:43 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:35:43] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:35:44.359 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 18 16 38924 38908 135.035 89.375 0.0142961 0.00739955 2021-10-08T19:35:44.362 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:35:44.470 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:35:44 smithi097 conmon[33110]: 172.21.15.117 - - [08/Oct/2021:19:35:44] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:35:44.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:44 smithi097 ceph-mon[41966]: pgmap v715: 178 pgs: 178 active+clean; 1.8 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 646 B/s rd, 76 MiB/s wr, 1.21k op/s 2021-10-08T19:35:44.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:44 smithi097 ceph-mon[32687]: pgmap v715: 178 pgs: 178 active+clean; 1.8 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 646 B/s rd, 76 MiB/s wr, 1.21k op/s 2021-10-08T19:35:44.534 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:35:44.540 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:44.540 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:35:44.642 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:35:44.686 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:44.691 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:35:44.765 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:35:44.768 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:44.768 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:35:44.869 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:35:44.935 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:45.076 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:35:45.098 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:45.100 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:35:45.202 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:35:45.257 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:45.360 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 19 16 40385 40369 132.734 91.3125 0.0210994 0.00752628 2021-10-08T19:35:45.413 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:35:45.416 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:45 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:35:45.416 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:45 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:35:45.416 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:45 smithi097 ceph-mon[41966]: 172.21.15.117 - - [08/Oct/2021:19:35:44] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:35:45.417 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:45.418 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:35:45.421 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:45 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:35:45.421 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:45 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:35:45.421 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:45 smithi097 ceph-mon[32687]: 172.21.15.117 - - [08/Oct/2021:19:35:44] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:35:45.519 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:35:45.550 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:45.628 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:35:45.632 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:45.633 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:35:45.634 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:45 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:35:45.634 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:45 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:35:45.634 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:45 smithi117 ceph-mon[34585]: 172.21.15.117 - - [08/Oct/2021:19:35:44] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:35:45.734 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:35:45.774 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:45.857 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:35:45.864 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:45.864 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:35:45.924 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2021-10-08T19:35:45.924 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:35:45.965 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:35:46.005 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:46.063 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:35:46.065 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:46.066 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:35:46.167 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:35:46.207 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:46.290 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:35:46.298 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:46.298 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:35:46.358 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is set 2021-10-08T19:35:46.359 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:2021-10-08T19:35:46.358966+0000 min lat: 0.00140955 max lat: 0.134402 avg lat: 0.00765667 2021-10-08T19:35:46.359 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2021-10-08T19:35:46.359 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 20 15 41798 41783 130.515 88.375 0.00877258 0.00765667 2021-10-08T19:35:46.400 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:35:46.438 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:46.518 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:35:46.526 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:46.527 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:35:46.628 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:35:46.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:46 smithi117 ceph-mon[34585]: pgmap v716: 178 pgs: 178 active+clean; 2.3 GiB data, 8.9 GiB used, 706 GiB / 715 GiB avail; 1.2 KiB/s rd, 138 MiB/s wr, 2.20k op/s 2021-10-08T19:35:46.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:46 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3060757278' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:35:46.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:46 smithi117 ceph-mon[34585]: from='client.35861 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:35:46.669 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:46.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:46 smithi097 ceph-mon[32687]: pgmap v716: 178 pgs: 178 active+clean; 2.3 GiB data, 8.9 GiB used, 706 GiB / 715 GiB avail; 1.2 KiB/s rd, 138 MiB/s wr, 2.20k op/s 2021-10-08T19:35:46.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:46 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3060757278' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:35:46.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:46 smithi097 ceph-mon[32687]: from='client.35861 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:35:46.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:46 smithi097 ceph-mon[41966]: pgmap v716: 178 pgs: 178 active+clean; 2.3 GiB data, 8.9 GiB used, 706 GiB / 715 GiB avail; 1.2 KiB/s rd, 138 MiB/s wr, 2.20k op/s 2021-10-08T19:35:46.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:46 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3060757278' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:35:46.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:46 smithi097 ceph-mon[41966]: from='client.35861 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:35:46.740 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:35:46.746 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:46.747 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:35:46.848 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:35:46.889 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:46.967 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:35:46.971 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:35:46 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:35:46.973 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:46.974 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:35:47.075 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:35:47.102 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:47.331 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:47 smithi117 ceph-mon[34585]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:35:47.331 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:47 smithi117 ceph-mon[34585]: from='client.35861 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:35:47.331 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:47 smithi117 ceph-mon[34585]: osdmap e366: 8 total, 8 up, 8 in 2021-10-08T19:35:47.360 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 21 16 43222 43206 128.535 88.9375 0.00431612 0.00777655 2021-10-08T19:35:47.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:47 smithi097 ceph-mon[41966]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:35:47.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:47 smithi097 ceph-mon[41966]: from='client.35861 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:35:47.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:47 smithi097 ceph-mon[41966]: osdmap e366: 8 total, 8 up, 8 in 2021-10-08T19:35:47.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:47 smithi097 ceph-mon[32687]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:35:47.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:47 smithi097 ceph-mon[32687]: from='client.35861 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:35:47.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:47 smithi097 ceph-mon[32687]: osdmap e366: 8 total, 8 up, 8 in 2021-10-08T19:35:48.062 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:35:48.069 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:48.071 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:35:48.172 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:35:48.207 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:48.254 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:35:48.256 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:48.258 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:35:48.332 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:48 smithi097 ceph-mon[32687]: pgmap v718: 178 pgs: 178 active+clean; 2.3 GiB data, 8.9 GiB used, 706 GiB / 715 GiB avail; 639 B/s rd, 97 MiB/s wr, 1.55k op/s 2021-10-08T19:35:48.332 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:48 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:35:48.359 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:35:48.361 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 22 15 44762 44747 127.059 96.3125 0.0124542 0.00786576 2021-10-08T19:35:48.407 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:48.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:48 smithi117 ceph-mon[34585]: pgmap v718: 178 pgs: 178 active+clean; 2.3 GiB data, 8.9 GiB used, 706 GiB / 715 GiB avail; 639 B/s rd, 97 MiB/s wr, 1.55k op/s 2021-10-08T19:35:48.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:48 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:35:48.711 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:35:48.720 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:48.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:48 smithi097 ceph-mon[41966]: pgmap v718: 178 pgs: 178 active+clean; 2.3 GiB data, 8.9 GiB used, 706 GiB / 715 GiB avail; 639 B/s rd, 97 MiB/s wr, 1.55k op/s 2021-10-08T19:35:48.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:48 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:35:48.722 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:35:48.764 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2021-10-08T19:35:48.823 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:35:48.864 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:48.942 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:35:49.020 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:49.021 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:35:49.122 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:35:49.177 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:49.327 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:35:49.327 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:35:49.334 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:49.335 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:35:49.364 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 23 16 46151 46135 125.291 86.75 0.0106839 0.00797494 2021-10-08T19:35:49.376 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:35:49.412 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:35:49.436 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:35:49.438 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:35:49.455 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:35:49.491 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:49.500 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:35:49.537 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:35:49.570 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:35:49.586 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:35:49.592 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:49.592 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:35:49.599 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:49 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:35:49.599 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:49 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:35:49.600 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:49 smithi097 ceph-mon[32687]: pgmap v719: 178 pgs: 178 active+clean; 2.6 GiB data, 9.3 GiB used, 706 GiB / 715 GiB avail; 1.2 KiB/s rd, 96 MiB/s wr, 1.54k op/s 2021-10-08T19:35:49.600 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:49 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1249629933' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:35:49.600 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:49 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:35:49.601 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:49 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:35:49.601 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:49 smithi097 ceph-mon[41966]: pgmap v719: 178 pgs: 178 active+clean; 2.6 GiB data, 9.3 GiB used, 706 GiB / 715 GiB avail; 1.2 KiB/s rd, 96 MiB/s wr, 1.54k op/s 2021-10-08T19:35:49.601 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:49 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1249629933' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:35:49.605 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:35:49.612 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true' 2021-10-08T19:35:49.612 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true' 2021-10-08T19:35:49.613 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true' 2021-10-08T19:35:49.613 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true' 2021-10-08T19:35:49.613 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true' 2021-10-08T19:35:49.613 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true' 2021-10-08T19:35:49.614 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'true' 2021-10-08T19:35:49.614 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'true' 2021-10-08T19:35:49.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:49 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:35:49.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:49 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:35:49.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:49 smithi117 ceph-mon[34585]: pgmap v719: 178 pgs: 178 active+clean; 2.6 GiB data, 9.3 GiB used, 706 GiB / 715 GiB avail; 1.2 KiB/s rd, 96 MiB/s wr, 1.54k op/s 2021-10-08T19:35:49.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:49 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1249629933' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:35:49.693 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:35:49.731 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:49.801 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:35:49.804 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:49.805 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:35:49.906 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:35:49.958 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:50.042 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:35:50.044 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:50.045 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:35:50.147 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:35:50.195 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:50.289 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:35:50.294 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:50.295 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:35:50.364 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 24 16 47561 47545 123.743 88.125 0.0109044 0.00807538 2021-10-08T19:35:50.375 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.7 to 1 (10000) 2021-10-08T19:35:50.396 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:35:50.433 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:50.484 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset noscrub 2021-10-08T19:35:50.513 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:35:50.518 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:50 smithi117 ceph-mon[34585]: osdmap e367: 8 total, 8 up, 8 in 2021-10-08T19:35:50.518 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:50 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/4279740380' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2021-10-08T19:35:50.519 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:50 smithi117 ceph-mon[34585]: from='client.35873 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2021-10-08T19:35:50.521 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:50.522 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:35:50.624 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:35:50.696 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:50 smithi097 ceph-mon[41966]: osdmap e367: 8 total, 8 up, 8 in 2021-10-08T19:35:50.696 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:50 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/4279740380' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2021-10-08T19:35:50.697 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:50 smithi097 ceph-mon[41966]: from='client.35873 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2021-10-08T19:35:50.697 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:50 smithi097 ceph-mon[32687]: osdmap e367: 8 total, 8 up, 8 in 2021-10-08T19:35:50.698 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:50 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/4279740380' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2021-10-08T19:35:50.699 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:50 smithi097 ceph-mon[32687]: from='client.35873 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2021-10-08T19:35:50.710 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:51.364 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 25 16 49078 49062 122.586 94.8125 0.0114351 0.00815259 2021-10-08T19:35:51.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:51 smithi117 ceph-mon[34585]: from='client.35873 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]': finished 2021-10-08T19:35:51.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:51 smithi117 ceph-mon[34585]: osdmap e368: 8 total, 8 up, 8 in 2021-10-08T19:35:51.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:51 smithi117 ceph-mon[34585]: osdmap e369: 8 total, 8 up, 8 in 2021-10-08T19:35:51.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:51 smithi117 ceph-mon[34585]: pgmap v723: 178 pgs: 178 active+clean; 2.8 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 1.1 KiB/s rd, 102 MiB/s wr, 1.63k op/s 2021-10-08T19:35:51.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:51 smithi097 ceph-mon[32687]: from='client.35873 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]': finished 2021-10-08T19:35:51.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:51 smithi097 ceph-mon[32687]: osdmap e368: 8 total, 8 up, 8 in 2021-10-08T19:35:51.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:51 smithi097 ceph-mon[32687]: osdmap e369: 8 total, 8 up, 8 in 2021-10-08T19:35:51.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:51 smithi097 ceph-mon[32687]: pgmap v723: 178 pgs: 178 active+clean; 2.8 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 1.1 KiB/s rd, 102 MiB/s wr, 1.63k op/s 2021-10-08T19:35:51.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:51 smithi097 ceph-mon[41966]: from='client.35873 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]': finished 2021-10-08T19:35:51.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:51 smithi097 ceph-mon[41966]: osdmap e368: 8 total, 8 up, 8 in 2021-10-08T19:35:51.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:51 smithi097 ceph-mon[41966]: osdmap e369: 8 total, 8 up, 8 in 2021-10-08T19:35:51.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:51 smithi097 ceph-mon[41966]: pgmap v723: 178 pgs: 178 active+clean; 2.8 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 1.1 KiB/s rd, 102 MiB/s wr, 1.63k op/s 2021-10-08T19:35:52.142 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:35:52.149 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:52.154 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:35:52.232 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd reweight 6 1 2021-10-08T19:35:52.250 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:35:52.255 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:35:52.304 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:52.365 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 26 16 50442 50426 121.147 85.25 0.00953914 0.00824814 2021-10-08T19:35:52.380 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:35:52.382 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:52.383 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:35:52.485 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:35:52.519 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:52.598 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:35:52.605 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:35:52 smithi117 conmon[69189]: level=error ts=2021-10-08T19:35:52.314Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=1 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:35:52.605 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:52.606 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:35:52.708 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:35:52.720 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:35:52 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:35:52] "GET /metrics HTTP/1.1" 200 155832 "" "Prometheus/2.18.1" 2021-10-08T19:35:52.776 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:52.822 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:35:52.822 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2021-10-08T19:35:52.822 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2021-10-08T19:35:52.823 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2021-10-08T19:35:52.823 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:35:53.365 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 27 16 51774 51758 119.744 83.25 0.00729885 0.00834298 2021-10-08T19:35:53.787 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:53 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:35:53.787 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:53 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:35:53.787 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:53 smithi117 ceph-mon[34585]: osdmap e370: 8 total, 8 up, 8 in 2021-10-08T19:35:53.787 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:53 smithi117 ceph-mon[34585]: pgmap v725: 178 pgs: 178 active+clean; 2.8 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 50 MiB/s wr, 794 op/s 2021-10-08T19:35:53.788 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:35:53 smithi117 conmon[69189]: level=error ts=2021-10-08T19:35:53.506Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=2 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:35:53.788 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:35:53.792 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:53.793 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:35:53.894 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:35:53.930 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:54.010 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:35:54.018 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:54.019 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:35:54.070 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2021-10-08T19:35:54.108 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:53 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:35:54.108 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:53 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:35:54.108 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:53 smithi097 ceph-mon[32687]: osdmap e370: 8 total, 8 up, 8 in 2021-10-08T19:35:54.108 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:53 smithi097 ceph-mon[32687]: pgmap v725: 178 pgs: 178 active+clean; 2.8 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 50 MiB/s wr, 794 op/s 2021-10-08T19:35:54.109 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:53 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:35:54.109 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:53 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:35:54.110 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:53 smithi097 ceph-mon[41966]: osdmap e370: 8 total, 8 up, 8 in 2021-10-08T19:35:54.110 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:53 smithi097 ceph-mon[41966]: pgmap v725: 178 pgs: 178 active+clean; 2.8 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 50 MiB/s wr, 794 op/s 2021-10-08T19:35:54.120 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:35:54.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:35:53 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:35:53] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:35:54.168 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:54.370 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 28 16 53207 53191 118.645 89.5625 0.0122418 0.00842306 2021-10-08T19:35:54.456 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:35:54.495 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2021-10-08T19:35:54.649 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:35:54.655 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:54.656 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:35:54.758 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:35:54.794 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:35:54.837 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:54.952 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:35:54.961 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:54.962 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:35:55.063 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:35:55.127 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:55.266 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:35:55.272 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:55.273 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:35:55.370 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 29 16 54407 54391 117.141 75 0.0130969 0.00853081 2021-10-08T19:35:55.374 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:35:55.406 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:55.423 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:35:55.474 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:35:55.478 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:55.479 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:35:55.580 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:35:55.649 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:56.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:55 smithi117 ceph-mon[34585]: pgmap v726: 178 pgs: 178 active+clean; 3.2 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 935 B/s rd, 90 MiB/s wr, 1.45k op/s 2021-10-08T19:35:56.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:55 smithi117 ceph-mon[34585]: osdmap e371: 8 total, 8 up, 8 in 2021-10-08T19:35:56.172 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:55 smithi097 ceph-mon[32687]: pgmap v726: 178 pgs: 178 active+clean; 3.2 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 935 B/s rd, 90 MiB/s wr, 1.45k op/s 2021-10-08T19:35:56.172 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:55 smithi097 ceph-mon[32687]: osdmap e371: 8 total, 8 up, 8 in 2021-10-08T19:35:56.173 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:55 smithi097 ceph-mon[41966]: pgmap v726: 178 pgs: 178 active+clean; 3.2 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 935 B/s rd, 90 MiB/s wr, 1.45k op/s 2021-10-08T19:35:56.173 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:55 smithi097 ceph-mon[41966]: osdmap e371: 8 total, 8 up, 8 in 2021-10-08T19:35:56.371 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 30 16 55358 55342 115.218 59.4375 0.0170999 0.00867387 2021-10-08T19:35:56.928 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is unset 2021-10-08T19:35:57.155 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:35:56 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:35:57.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:56 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1073817763' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:35:57.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:56 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1073817763' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:35:57.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:56 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1073817763' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:35:57.370 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 31 16 56798 56782 114.405 90 0.00602257 0.00873657 2021-10-08T19:35:57.653 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:35:57.658 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:57.659 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:35:57.761 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:35:57.822 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:57.907 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:57 smithi097 ceph-mon[32687]: pgmap v728: 178 pgs: 178 active+clean; 3.2 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 842 B/s rd, 72 MiB/s wr, 1.15k op/s 2021-10-08T19:35:57.907 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:57 smithi097 ceph-mon[32687]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:35:57.907 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:57 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1073817763' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:35:57.908 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:57 smithi097 ceph-mon[32687]: osdmap e372: 8 total, 8 up, 8 in 2021-10-08T19:35:57.908 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:57 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:35:57.908 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:57 smithi097 ceph-mon[32687]: 6.12 scrub ok 2021-10-08T19:35:57.908 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:57 smithi097 ceph-mon[32687]: 5.b scrub ok 2021-10-08T19:35:57.908 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:57 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:35:57.909 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:57 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:35:57.909 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:57 smithi097 ceph-mon[32687]: 5.5 scrub ok 2021-10-08T19:35:57.909 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:57 smithi097 ceph-mon[41966]: pgmap v728: 178 pgs: 178 active+clean; 3.2 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 842 B/s rd, 72 MiB/s wr, 1.15k op/s 2021-10-08T19:35:57.910 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:57 smithi097 ceph-mon[41966]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:35:57.910 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:57 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1073817763' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:35:57.910 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:57 smithi097 ceph-mon[41966]: osdmap e372: 8 total, 8 up, 8 in 2021-10-08T19:35:57.911 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:57 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:35:57.911 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:57 smithi097 ceph-mon[41966]: 6.12 scrub ok 2021-10-08T19:35:57.911 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:57 smithi097 ceph-mon[41966]: 5.b scrub ok 2021-10-08T19:35:57.911 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:57 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:35:57.912 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:57 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:35:57.912 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:57 smithi097 ceph-mon[41966]: 5.5 scrub ok 2021-10-08T19:35:58.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:57 smithi117 ceph-mon[34585]: pgmap v728: 178 pgs: 178 active+clean; 3.2 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 842 B/s rd, 72 MiB/s wr, 1.15k op/s 2021-10-08T19:35:58.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:57 smithi117 ceph-mon[34585]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:35:58.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:57 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1073817763' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:35:58.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:57 smithi117 ceph-mon[34585]: osdmap e372: 8 total, 8 up, 8 in 2021-10-08T19:35:58.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:57 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:35:58.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:57 smithi117 ceph-mon[34585]: 6.12 scrub ok 2021-10-08T19:35:58.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:57 smithi117 ceph-mon[34585]: 5.b scrub ok 2021-10-08T19:35:58.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:57 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:35:58.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:57 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:35:58.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:57 smithi117 ceph-mon[34585]: 5.5 scrub ok 2021-10-08T19:35:58.329 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:35:58.331 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:58.332 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:35:58.371 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 32 16 58128 58112 113.427 83.125 0.00907526 0.00881072 2021-10-08T19:35:58.434 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:35:58.484 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:58.991 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:35:58.995 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:58.996 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:35:59.097 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:35:59.151 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:59.192 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:58 smithi097 ceph-mon[41966]: 4.a scrub ok 2021-10-08T19:35:59.192 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:58 smithi097 ceph-mon[41966]: osdmap e373: 8 total, 8 up, 8 in 2021-10-08T19:35:59.193 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:58 smithi097 ceph-mon[41966]: 3.d scrub ok 2021-10-08T19:35:59.195 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:58 smithi097 ceph-mon[32687]: 4.a scrub ok 2021-10-08T19:35:59.196 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:58 smithi097 ceph-mon[32687]: osdmap e373: 8 total, 8 up, 8 in 2021-10-08T19:35:59.196 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:58 smithi097 ceph-mon[32687]: 3.d scrub ok 2021-10-08T19:35:59.371 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 33 16 59364 59348 112.332 77.25 0.0165426 0.00889722 2021-10-08T19:35:59.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:58 smithi117 ceph-mon[34585]: 4.a scrub ok 2021-10-08T19:35:59.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:58 smithi117 ceph-mon[34585]: osdmap e373: 8 total, 8 up, 8 in 2021-10-08T19:35:59.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:58 smithi117 ceph-mon[34585]: 3.d scrub ok 2021-10-08T19:35:59.502 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:35:59.510 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:59.511 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:35:59.612 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:35:59.642 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:59.709 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:35:59.717 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:59.717 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:35:59.787 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:35:59.818 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:35:59.833 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:35:59.850 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:35:59.890 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:35:59.923 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:35:59.929 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:35:59.930 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:35:59.931 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:35:59.961 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.6 to 1 (10000) 2021-10-08T19:35:59.963 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:35:59.996 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:36:00.028 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:36:00.031 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:36:00.073 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:36:00.075 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:00.080 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'false' 2021-10-08T19:36:00.080 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'false' 2021-10-08T19:36:00.081 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'false' 2021-10-08T19:36:00.081 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'false' 2021-10-08T19:36:00.081 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'false' 2021-10-08T19:36:00.081 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'false' 2021-10-08T19:36:00.082 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'false' 2021-10-08T19:36:00.082 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'false' 2021-10-08T19:36:00.110 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:59 smithi097 ceph-mon[32687]: 2.c scrub ok 2021-10-08T19:36:00.110 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:59 smithi097 ceph-mon[32687]: 3.9 scrub ok 2021-10-08T19:36:00.111 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:59 smithi097 ceph-mon[32687]: pgmap v731: 178 pgs: 178 active+clean; 3.4 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1.7 KiB/s rd, 110 MiB/s wr, 1.76k op/s 2021-10-08T19:36:00.111 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:59 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2734163748' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:36:00.111 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:35:59 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/4271648367' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2021-10-08T19:36:00.112 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:59 smithi097 ceph-mon[41966]: 2.c scrub ok 2021-10-08T19:36:00.112 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:59 smithi097 ceph-mon[41966]: 3.9 scrub ok 2021-10-08T19:36:00.113 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:59 smithi097 ceph-mon[41966]: pgmap v731: 178 pgs: 178 active+clean; 3.4 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1.7 KiB/s rd, 110 MiB/s wr, 1.76k op/s 2021-10-08T19:36:00.113 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:59 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2734163748' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:36:00.113 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:35:59 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/4271648367' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2021-10-08T19:36:00.140 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:36:00.142 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2021-10-08T19:36:00.143 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:36:00.143 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:00.144 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:36:00.152 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset nodeep-scrub 2021-10-08T19:36:00.245 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:36:00.282 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:59 smithi117 ceph-mon[34585]: 2.c scrub ok 2021-10-08T19:36:00.282 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:59 smithi117 ceph-mon[34585]: 3.9 scrub ok 2021-10-08T19:36:00.282 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:59 smithi117 ceph-mon[34585]: pgmap v731: 178 pgs: 178 active+clean; 3.4 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1.7 KiB/s rd, 110 MiB/s wr, 1.76k op/s 2021-10-08T19:36:00.282 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:59 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2734163748' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:36:00.283 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:35:59 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/4271648367' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2021-10-08T19:36:00.285 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:00.370 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:36:00.371 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 34 16 60399 60383 110.931 64.6875 0.0101979 0.00900864 2021-10-08T19:36:00.380 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:00.381 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:36:00.482 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:36:00.521 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:00.599 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:36:00.603 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:00.604 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:36:00.705 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:36:00.740 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:00.801 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:36:00.808 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:00.809 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:36:00.910 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:36:00.950 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:01.029 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:36:01.035 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:01.038 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:36:01.140 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:36:01.184 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:01.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:00 smithi097 ceph-mon[41966]: 2.1a scrub ok 2021-10-08T19:36:01.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:00 smithi097 ceph-mon[41966]: 4.14 scrub ok 2021-10-08T19:36:01.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:00 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/4271648367' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]': finished 2021-10-08T19:36:01.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:00 smithi097 ceph-mon[41966]: osdmap e374: 8 total, 8 up, 8 in 2021-10-08T19:36:01.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:00 smithi097 ceph-mon[41966]: 6.a scrub ok 2021-10-08T19:36:01.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:00 smithi097 ceph-mon[41966]: osdmap e375: 8 total, 8 up, 8 in 2021-10-08T19:36:01.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:00 smithi097 ceph-mon[32687]: 2.1a scrub ok 2021-10-08T19:36:01.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:00 smithi097 ceph-mon[32687]: 4.14 scrub ok 2021-10-08T19:36:01.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:00 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/4271648367' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]': finished 2021-10-08T19:36:01.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:00 smithi097 ceph-mon[32687]: osdmap e374: 8 total, 8 up, 8 in 2021-10-08T19:36:01.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:00 smithi097 ceph-mon[32687]: 6.a scrub ok 2021-10-08T19:36:01.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:00 smithi097 ceph-mon[32687]: osdmap e375: 8 total, 8 up, 8 in 2021-10-08T19:36:01.268 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:36:01.275 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:01.276 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:36:01.277 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:00 smithi117 ceph-mon[34585]: 2.1a scrub ok 2021-10-08T19:36:01.277 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:00 smithi117 ceph-mon[34585]: 4.14 scrub ok 2021-10-08T19:36:01.277 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:00 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/4271648367' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]': finished 2021-10-08T19:36:01.277 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:00 smithi117 ceph-mon[34585]: osdmap e374: 8 total, 8 up, 8 in 2021-10-08T19:36:01.278 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:00 smithi117 ceph-mon[34585]: 6.a scrub ok 2021-10-08T19:36:01.278 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:00 smithi117 ceph-mon[34585]: osdmap e375: 8 total, 8 up, 8 in 2021-10-08T19:36:01.371 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 35 16 61704 61688 110.092 81.5625 0.00702524 0.00907855 2021-10-08T19:36:01.378 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:36:01.406 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:01.447 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:36:01.449 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:01.450 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:36:01.551 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:36:01.575 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:01.646 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:36:01.647 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:01.648 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:36:01.749 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:36:01.797 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:02.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:01 smithi097 ceph-mon[32687]: 6.17 scrub ok 2021-10-08T19:36:02.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:01 smithi097 ceph-mon[32687]: 5.2 scrub ok 2021-10-08T19:36:02.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:01 smithi097 ceph-mon[32687]: pgmap v734: 178 pgs: 178 active+clean; 3.6 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 1.2 KiB/s rd, 97 MiB/s wr, 1.56k op/s 2021-10-08T19:36:02.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:01 smithi097 ceph-mon[41966]: 6.17 scrub ok 2021-10-08T19:36:02.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:01 smithi097 ceph-mon[41966]: 5.2 scrub ok 2021-10-08T19:36:02.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:01 smithi097 ceph-mon[41966]: pgmap v734: 178 pgs: 178 active+clean; 3.6 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 1.2 KiB/s rd, 97 MiB/s wr, 1.56k op/s 2021-10-08T19:36:02.316 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:01 smithi117 ceph-mon[34585]: 6.17 scrub ok 2021-10-08T19:36:02.319 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:01 smithi117 ceph-mon[34585]: 5.2 scrub ok 2021-10-08T19:36:02.319 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:01 smithi117 ceph-mon[34585]: pgmap v734: 178 pgs: 178 active+clean; 3.6 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 1.2 KiB/s rd, 97 MiB/s wr, 1.56k op/s 2021-10-08T19:36:02.320 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:36:02 smithi117 conmon[69189]: level=error ts=2021-10-08T19:36:02.314Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=1 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:36:02.371 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 36 16 62863 62847 109.046 72.4375 0.00963188 0.00916574 2021-10-08T19:36:02.590 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2021-10-08T19:36:02.751 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:36:02.757 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:02.758 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:36:02.777 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd reweight 1 1 2021-10-08T19:36:02.859 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:36:02.873 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:36:02 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:36:02] "GET /metrics HTTP/1.1" 200 155853 "" "Prometheus/2.18.1" 2021-10-08T19:36:02.928 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:02.930 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:36:03.121 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:36:03.127 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:03.127 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:02 smithi097 ceph-mon[32687]: 4.9 scrub ok 2021-10-08T19:36:03.128 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:02 smithi097 ceph-mon[32687]: 1.6 scrub ok 2021-10-08T19:36:03.128 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:02 smithi097 ceph-mon[32687]: 2.8 scrub ok 2021-10-08T19:36:03.128 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:02 smithi097 ceph-mon[32687]: 5.1e scrub ok 2021-10-08T19:36:03.129 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:02 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:36:03.129 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:02 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:36:03.129 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:02 smithi097 ceph-mon[41966]: 4.9 scrub ok 2021-10-08T19:36:03.130 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:02 smithi097 ceph-mon[41966]: 1.6 scrub ok 2021-10-08T19:36:03.130 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:02 smithi097 ceph-mon[41966]: 2.8 scrub ok 2021-10-08T19:36:03.130 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:02 smithi097 ceph-mon[41966]: 5.1e scrub ok 2021-10-08T19:36:03.130 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:02 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:36:03.131 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:02 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:36:03.131 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:36:03.232 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:36:03.291 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:36:03.315 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:03.372 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 37 16 64000 63984 108.02 71.0625 0.00814956 0.00925189 2021-10-08T19:36:03.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:02 smithi117 ceph-mon[34585]: 4.9 scrub ok 2021-10-08T19:36:03.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:02 smithi117 ceph-mon[34585]: 1.6 scrub ok 2021-10-08T19:36:03.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:02 smithi117 ceph-mon[34585]: 2.8 scrub ok 2021-10-08T19:36:03.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:02 smithi117 ceph-mon[34585]: 5.1e scrub ok 2021-10-08T19:36:03.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:02 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:36:03.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:02 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:36:03.510 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:36:03.514 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:03.515 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:36:03.616 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:36:03.657 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:03.714 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:36:03.718 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:03.719 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:36:03.821 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:36:03.866 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:03.905 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:36:03 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:36:03] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:36:03.945 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:36:03.947 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:03.948 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:36:04.049 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:36:04.092 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:03 smithi097 ceph-mon[32687]: pgmap v735: 178 pgs: 178 active+clean; 3.6 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 864 B/s rd, 66 MiB/s wr, 1.05k op/s 2021-10-08T19:36:04.093 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:03 smithi097 ceph-mon[32687]: osdmap e376: 8 total, 8 up, 8 in 2021-10-08T19:36:04.093 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:03 smithi097 ceph-mon[41966]: pgmap v735: 178 pgs: 178 active+clean; 3.6 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 864 B/s rd, 66 MiB/s wr, 1.05k op/s 2021-10-08T19:36:04.093 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:03 smithi097 ceph-mon[41966]: osdmap e376: 8 total, 8 up, 8 in 2021-10-08T19:36:04.105 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:04.241 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:36:04.371 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 38 16 65060 65044 106.921 66.25 0.0146753 0.00934676 2021-10-08T19:36:04.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:03 smithi117 ceph-mon[34585]: pgmap v735: 178 pgs: 178 active+clean; 3.6 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 864 B/s rd, 66 MiB/s wr, 1.05k op/s 2021-10-08T19:36:04.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:03 smithi117 ceph-mon[34585]: osdmap e376: 8 total, 8 up, 8 in 2021-10-08T19:36:04.517 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:36:04.525 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:04.525 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:36:04.628 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:36:04.675 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:04.719 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2021-10-08T19:36:05.373 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 39 16 66164 66148 105.943 69 0.00780736 0.00943407 2021-10-08T19:36:05.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:04 smithi117 ceph-mon[34585]: 6.1a scrub ok 2021-10-08T19:36:05.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:04 smithi117 ceph-mon[34585]: 2.5 scrub ok 2021-10-08T19:36:05.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:04 smithi117 ceph-mon[34585]: 4.2 scrub ok 2021-10-08T19:36:05.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:04 smithi097 ceph-mon[41966]: 6.1a scrub ok 2021-10-08T19:36:05.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:04 smithi097 ceph-mon[41966]: 2.5 scrub ok 2021-10-08T19:36:05.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:04 smithi097 ceph-mon[41966]: 4.2 scrub ok 2021-10-08T19:36:05.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:04 smithi097 ceph-mon[32687]: 6.1a scrub ok 2021-10-08T19:36:05.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:04 smithi097 ceph-mon[32687]: 2.5 scrub ok 2021-10-08T19:36:05.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:04 smithi097 ceph-mon[32687]: 4.2 scrub ok 2021-10-08T19:36:05.533 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:36:05.538 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:05.539 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:36:05.640 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:36:05.683 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:05.729 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:36:05.733 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:05.734 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:36:05.835 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:36:05.879 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:06.073 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:36:06.077 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:06.078 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:36:06.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:06 smithi117 ceph-mon[34585]: pgmap v737: 178 pgs: 178 active+clean; 3.9 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 852 B/s rd, 89 MiB/s wr, 1.42k op/s 2021-10-08T19:36:06.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:06 smithi117 ceph-mon[34585]: 3.f scrub ok 2021-10-08T19:36:06.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:06 smithi117 ceph-mon[34585]: 5.d scrub ok 2021-10-08T19:36:06.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:06 smithi117 ceph-mon[34585]: 4.3 scrub ok 2021-10-08T19:36:06.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:06 smithi117 ceph-mon[34585]: osdmap e377: 8 total, 8 up, 8 in 2021-10-08T19:36:06.180 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:36:06.223 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:06.307 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:36:06.312 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:06.313 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:36:06.373 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:2021-10-08T19:36:06.373511+0000 min lat: 0.00140955 max lat: 0.227624 avg lat: 0.00951048 2021-10-08T19:36:06.374 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2021-10-08T19:36:06.374 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 40 16 67314 67298 105.092 71.875 0.00898119 0.00951048 2021-10-08T19:36:06.414 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:36:06.452 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:05 smithi097 ceph-mon[41966]: pgmap v737: 178 pgs: 178 active+clean; 3.9 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 852 B/s rd, 89 MiB/s wr, 1.42k op/s 2021-10-08T19:36:06.452 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:05 smithi097 ceph-mon[41966]: 3.f scrub ok 2021-10-08T19:36:06.453 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:05 smithi097 ceph-mon[41966]: 5.d scrub ok 2021-10-08T19:36:06.453 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:05 smithi097 ceph-mon[41966]: 4.3 scrub ok 2021-10-08T19:36:06.453 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:05 smithi097 ceph-mon[41966]: osdmap e377: 8 total, 8 up, 8 in 2021-10-08T19:36:06.454 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:05 smithi097 ceph-mon[32687]: pgmap v737: 178 pgs: 178 active+clean; 3.9 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 852 B/s rd, 89 MiB/s wr, 1.42k op/s 2021-10-08T19:36:06.454 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:05 smithi097 ceph-mon[32687]: 3.f scrub ok 2021-10-08T19:36:06.454 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:05 smithi097 ceph-mon[32687]: 5.d scrub ok 2021-10-08T19:36:06.454 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:05 smithi097 ceph-mon[32687]: 4.3 scrub ok 2021-10-08T19:36:06.455 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:05 smithi097 ceph-mon[32687]: osdmap e377: 8 total, 8 up, 8 in 2021-10-08T19:36:06.456 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:07.008 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:36:07.014 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:07.015 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:36:07.116 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:36:07.144 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:07.216 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:36:07.219 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:07.220 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:36:07.301 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:07 smithi097 ceph-mon[41966]: 1.4 scrub ok 2021-10-08T19:36:07.301 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:07 smithi097 ceph-mon[41966]: 4.6 scrub ok 2021-10-08T19:36:07.302 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:07 smithi097 ceph-mon[41966]: 3.14 scrub ok 2021-10-08T19:36:07.302 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:07 smithi097 ceph-mon[32687]: 1.4 scrub ok 2021-10-08T19:36:07.303 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:07 smithi097 ceph-mon[32687]: 4.6 scrub ok 2021-10-08T19:36:07.303 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:07 smithi097 ceph-mon[32687]: 3.14 scrub ok 2021-10-08T19:36:07.321 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:36:07.359 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:36:06 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:36:07.360 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:07 smithi117 ceph-mon[34585]: 1.4 scrub ok 2021-10-08T19:36:07.360 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:07 smithi117 ceph-mon[34585]: 4.6 scrub ok 2021-10-08T19:36:07.360 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:07 smithi117 ceph-mon[34585]: 3.14 scrub ok 2021-10-08T19:36:07.364 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:07.373 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 41 16 68442 68426 104.248 70.5 0.0206411 0.00958808 2021-10-08T19:36:07.550 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:36:07.554 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:07.555 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:36:07.657 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:36:07.686 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:36:07.756 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:08.012 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:08 smithi097 ceph-mon[32687]: 2.e scrub ok 2021-10-08T19:36:08.013 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:08 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:36:08.013 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:08 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:36:08.013 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:08 smithi097 ceph-mon[32687]: 4.10 scrub ok 2021-10-08T19:36:08.013 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:08 smithi097 ceph-mon[32687]: pgmap v739: 178 pgs: 178 active+clean; 3.9 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 842 B/s rd, 60 MiB/s wr, 957 op/s 2021-10-08T19:36:08.014 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:08 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:36:08.014 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:08 smithi097 ceph-mon[32687]: osdmap e378: 8 total, 8 up, 8 in 2021-10-08T19:36:08.014 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:08 smithi097 ceph-mon[32687]: 6.16 scrub ok 2021-10-08T19:36:08.014 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:08 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/350554198' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:36:08.054 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is unset 2021-10-08T19:36:08.375 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 42 16 69535 69519 103.39 68.3125 0.0180361 0.00966743 2021-10-08T19:36:08.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:08 smithi117 ceph-mon[34585]: 2.e scrub ok 2021-10-08T19:36:08.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:08 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:36:08.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:08 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:36:08.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:08 smithi117 ceph-mon[34585]: 4.10 scrub ok 2021-10-08T19:36:08.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:08 smithi117 ceph-mon[34585]: pgmap v739: 178 pgs: 178 active+clean; 3.9 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 842 B/s rd, 60 MiB/s wr, 957 op/s 2021-10-08T19:36:08.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:08 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:36:08.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:08 smithi117 ceph-mon[34585]: osdmap e378: 8 total, 8 up, 8 in 2021-10-08T19:36:08.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:08 smithi117 ceph-mon[34585]: 6.16 scrub ok 2021-10-08T19:36:08.409 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:08 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/350554198' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:36:08.409 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:08 smithi117 ceph-mon[34585]: from='client.25858 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:36:08.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:08 smithi097 ceph-mon[41966]: 2.e scrub ok 2021-10-08T19:36:08.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:08 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:36:08.474 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:08 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:36:08.474 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:08 smithi097 ceph-mon[41966]: 4.10 scrub ok 2021-10-08T19:36:08.474 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:08 smithi097 ceph-mon[41966]: pgmap v739: 178 pgs: 178 active+clean; 3.9 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 842 B/s rd, 60 MiB/s wr, 957 op/s 2021-10-08T19:36:08.474 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:08 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:36:08.475 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:08 smithi097 ceph-mon[41966]: osdmap e378: 8 total, 8 up, 8 in 2021-10-08T19:36:08.475 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:08 smithi097 ceph-mon[41966]: 6.16 scrub ok 2021-10-08T19:36:08.475 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:08 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/350554198' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:36:08.475 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:08 smithi097 ceph-mon[41966]: from='client.25858 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:36:08.482 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:08 smithi097 ceph-mon[32687]: from='client.25858 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:36:08.591 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2021-10-08T19:36:08.591 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:36:08.610 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:36:08.617 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:08.617 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:36:08.718 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:36:08.757 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:08.853 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:36:08.857 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:08.858 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:36:08.960 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:36:09.003 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:09.019 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:09 smithi117 ceph-mon[34585]: 3.10 scrub ok 2021-10-08T19:36:09.020 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:09 smithi117 ceph-mon[34585]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:36:09.020 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:09 smithi117 ceph-mon[34585]: Cluster is now healthy 2021-10-08T19:36:09.020 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:09 smithi117 ceph-mon[34585]: from='client.25858 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:36:09.020 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:09 smithi117 ceph-mon[34585]: osdmap e379: 8 total, 8 up, 8 in 2021-10-08T19:36:09.020 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:09 smithi117 ceph-mon[34585]: 4.1a scrub ok 2021-10-08T19:36:09.078 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:36:09.084 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:09.085 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:36:09.186 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:36:09.244 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:09.375 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 43 16 70697 70681 102.674 72.625 0.0171072 0.00973491 2021-10-08T19:36:09.402 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:09 smithi097 ceph-mon[32687]: 3.10 scrub ok 2021-10-08T19:36:09.403 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:09 smithi097 ceph-mon[32687]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:36:09.403 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:09 smithi097 ceph-mon[32687]: Cluster is now healthy 2021-10-08T19:36:09.403 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:09 smithi097 ceph-mon[32687]: from='client.25858 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:36:09.403 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:09 smithi097 ceph-mon[32687]: osdmap e379: 8 total, 8 up, 8 in 2021-10-08T19:36:09.403 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:09 smithi097 ceph-mon[32687]: 4.1a scrub ok 2021-10-08T19:36:09.404 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:09 smithi097 ceph-mon[41966]: 3.10 scrub ok 2021-10-08T19:36:09.404 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:09 smithi097 ceph-mon[41966]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:36:09.405 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:09 smithi097 ceph-mon[41966]: Cluster is now healthy 2021-10-08T19:36:09.405 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:09 smithi097 ceph-mon[41966]: from='client.25858 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:36:09.405 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:09 smithi097 ceph-mon[41966]: osdmap e379: 8 total, 8 up, 8 in 2021-10-08T19:36:09.405 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:09 smithi097 ceph-mon[41966]: 4.1a scrub ok 2021-10-08T19:36:10.124 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:36:10.128 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:10.129 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:36:10.163 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2021-10-08T19:36:10.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:10 smithi097 ceph-mon[32687]: 2.0 scrub ok 2021-10-08T19:36:10.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:10 smithi097 ceph-mon[32687]: 3.8 deep-scrub ok 2021-10-08T19:36:10.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:10 smithi097 ceph-mon[32687]: pgmap v742: 178 pgs: 178 active+clean; 4.1 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1.7 KiB/s rd, 95 MiB/s wr, 1.52k op/s 2021-10-08T19:36:10.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:10 smithi097 ceph-mon[32687]: 4.1c scrub ok 2021-10-08T19:36:10.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:10 smithi097 ceph-mon[32687]: 3.3 deep-scrub ok 2021-10-08T19:36:10.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:10 smithi097 ceph-mon[32687]: 1.3 scrub ok 2021-10-08T19:36:10.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:10 smithi097 ceph-mon[41966]: 2.0 scrub ok 2021-10-08T19:36:10.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:10 smithi097 ceph-mon[41966]: 3.8 deep-scrub ok 2021-10-08T19:36:10.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:10 smithi097 ceph-mon[41966]: pgmap v742: 178 pgs: 178 active+clean; 4.1 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1.7 KiB/s rd, 95 MiB/s wr, 1.52k op/s 2021-10-08T19:36:10.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:10 smithi097 ceph-mon[41966]: 4.1c scrub ok 2021-10-08T19:36:10.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:10 smithi097 ceph-mon[41966]: 3.3 deep-scrub ok 2021-10-08T19:36:10.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:10 smithi097 ceph-mon[41966]: 1.3 scrub ok 2021-10-08T19:36:10.230 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:36:10.282 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:10.380 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 44 16 71782 71766 101.87 67.8125 0.0104459 0.00981176 2021-10-08T19:36:10.390 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:36:10.396 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:10.397 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:36:10.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:10 smithi117 ceph-mon[34585]: 2.0 scrub ok 2021-10-08T19:36:10.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:10 smithi117 ceph-mon[34585]: 3.8 deep-scrub ok 2021-10-08T19:36:10.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:10 smithi117 ceph-mon[34585]: pgmap v742: 178 pgs: 178 active+clean; 4.1 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1.7 KiB/s rd, 95 MiB/s wr, 1.52k op/s 2021-10-08T19:36:10.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:10 smithi117 ceph-mon[34585]: 4.1c scrub ok 2021-10-08T19:36:10.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:10 smithi117 ceph-mon[34585]: 3.3 deep-scrub ok 2021-10-08T19:36:10.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:10 smithi117 ceph-mon[34585]: 1.3 scrub ok 2021-10-08T19:36:10.498 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:36:10.546 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:10.860 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:36:10.864 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:10.865 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:36:10.966 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:36:11.016 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:11.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:11 smithi117 ceph-mon[34585]: 1.0 scrub ok 2021-10-08T19:36:11.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:11 smithi117 ceph-mon[34585]: 4.13 scrub ok 2021-10-08T19:36:11.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:11 smithi117 ceph-mon[34585]: 6.19 scrub ok 2021-10-08T19:36:11.297 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:11 smithi097 ceph-mon[41966]: 1.0 scrub ok 2021-10-08T19:36:11.298 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:11 smithi097 ceph-mon[41966]: 4.13 scrub ok 2021-10-08T19:36:11.298 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:11 smithi097 ceph-mon[41966]: 6.19 scrub ok 2021-10-08T19:36:11.299 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:11 smithi097 ceph-mon[32687]: 1.0 scrub ok 2021-10-08T19:36:11.299 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:11 smithi097 ceph-mon[32687]: 4.13 scrub ok 2021-10-08T19:36:11.299 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:11 smithi097 ceph-mon[32687]: 6.19 scrub ok 2021-10-08T19:36:11.304 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:36:11.312 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:11.312 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:36:11.382 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 45 16 72838 72822 101.071 66 0.018663 0.00988786 2021-10-08T19:36:11.406 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set noscrub 2021-10-08T19:36:11.413 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:36:11.445 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:11.446 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:36:11.503 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:36:11.506 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:11.507 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:36:11.608 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:36:11.640 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:11.755 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:36:11.760 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:11.761 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:36:11.862 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:36:11.907 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:11.984 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:36:11.989 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:11.990 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:36:12.046 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:12 smithi117 ceph-mon[34585]: 3.7 scrub ok 2021-10-08T19:36:12.047 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:12 smithi117 ceph-mon[34585]: pgmap v743: 178 pgs: 178 active+clean; 4.3 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 853 B/s rd, 58 MiB/s wr, 929 op/s 2021-10-08T19:36:12.047 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:12 smithi117 ceph-mon[34585]: 5.8 scrub ok 2021-10-08T19:36:12.047 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:12 smithi117 ceph-mon[34585]: 5.18 scrub ok 2021-10-08T19:36:12.047 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:12 smithi117 ceph-mon[34585]: 6.4 scrub ok 2021-10-08T19:36:12.047 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:12 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2176220111' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2021-10-08T19:36:12.048 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:12 smithi117 ceph-mon[34585]: from='client.25861 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2021-10-08T19:36:12.091 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:36:12.154 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:12 smithi097 ceph-mon[41966]: 3.7 scrub ok 2021-10-08T19:36:12.155 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:12 smithi097 ceph-mon[41966]: pgmap v743: 178 pgs: 178 active+clean; 4.3 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 853 B/s rd, 58 MiB/s wr, 929 op/s 2021-10-08T19:36:12.155 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:12 smithi097 ceph-mon[41966]: 5.8 scrub ok 2021-10-08T19:36:12.155 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:12 smithi097 ceph-mon[41966]: 5.18 scrub ok 2021-10-08T19:36:12.155 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:12 smithi097 ceph-mon[41966]: 6.4 scrub ok 2021-10-08T19:36:12.156 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:12 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2176220111' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2021-10-08T19:36:12.156 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:12 smithi097 ceph-mon[41966]: from='client.25861 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2021-10-08T19:36:12.157 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:12 smithi097 ceph-mon[32687]: 3.7 scrub ok 2021-10-08T19:36:12.157 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:12 smithi097 ceph-mon[32687]: pgmap v743: 178 pgs: 178 active+clean; 4.3 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 853 B/s rd, 58 MiB/s wr, 929 op/s 2021-10-08T19:36:12.157 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:12 smithi097 ceph-mon[32687]: 5.8 scrub ok 2021-10-08T19:36:12.157 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:12 smithi097 ceph-mon[32687]: 5.18 scrub ok 2021-10-08T19:36:12.158 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:12 smithi097 ceph-mon[32687]: 6.4 scrub ok 2021-10-08T19:36:12.158 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:12 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2176220111' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2021-10-08T19:36:12.158 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:12 smithi097 ceph-mon[32687]: from='client.25861 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2021-10-08T19:36:12.159 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:12.263 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:36:12.270 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:12.271 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:36:12.320 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:36:12.352 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:36:12.372 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:36:12.381 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 46 16 73658 73642 99.9883 51.25 0.0126588 0.00999572 2021-10-08T19:36:12.392 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:36:12.404 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:36:12.428 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:12.444 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:36:12.491 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:36:12.524 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:36:12.563 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:36:12.602 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:36:12.604 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:36:12.611 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:12.612 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:36:12.614 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true' 2021-10-08T19:36:12.615 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true' 2021-10-08T19:36:12.615 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true' 2021-10-08T19:36:12.615 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true' 2021-10-08T19:36:12.616 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true' 2021-10-08T19:36:12.616 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true' 2021-10-08T19:36:12.616 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'true' 2021-10-08T19:36:12.616 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'true' 2021-10-08T19:36:12.713 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:36:12.721 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:36:12 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:36:12] "GET /metrics HTTP/1.1" 200 155855 "" "Prometheus/2.18.1" 2021-10-08T19:36:12.755 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:12.833 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.1 to 1 (10000) 2021-10-08T19:36:12.941 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:36:12.945 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:12.946 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:36:13.048 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:36:13.054 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:13 smithi117 ceph-mon[34585]: 1.2 scrub ok 2021-10-08T19:36:13.055 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:13 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2259628174' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:36:13.055 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:13 smithi117 ceph-mon[34585]: 2.7 scrub ok 2021-10-08T19:36:13.055 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:13 smithi117 ceph-mon[34585]: from='client.25861 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2021-10-08T19:36:13.055 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:13 smithi117 ceph-mon[34585]: osdmap e380: 8 total, 8 up, 8 in 2021-10-08T19:36:13.096 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:13.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:13 smithi097 ceph-mon[41966]: 1.2 scrub ok 2021-10-08T19:36:13.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:13 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2259628174' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:36:13.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:13 smithi097 ceph-mon[41966]: 2.7 scrub ok 2021-10-08T19:36:13.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:13 smithi097 ceph-mon[41966]: from='client.25861 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2021-10-08T19:36:13.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:13 smithi097 ceph-mon[41966]: osdmap e380: 8 total, 8 up, 8 in 2021-10-08T19:36:13.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:13 smithi097 ceph-mon[32687]: 1.2 scrub ok 2021-10-08T19:36:13.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:13 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2259628174' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:36:13.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:13 smithi097 ceph-mon[32687]: 2.7 scrub ok 2021-10-08T19:36:13.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:13 smithi097 ceph-mon[32687]: from='client.25861 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2021-10-08T19:36:13.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:13 smithi097 ceph-mon[32687]: osdmap e380: 8 total, 8 up, 8 in 2021-10-08T19:36:13.382 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 47 16 74737 74721 99.296 67.4375 0.0114367 0.0100658 2021-10-08T19:36:14.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:36:13 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:36:13] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:36:14.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:14 smithi117 ceph-mon[34585]: 6.13 deep-scrub ok 2021-10-08T19:36:14.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:14 smithi117 ceph-mon[34585]: pgmap v745: 178 pgs: 178 active+clean; 4.3 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 853 B/s rd, 58 MiB/s wr, 929 op/s 2021-10-08T19:36:14.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:14 smithi117 ceph-mon[34585]: 4.f scrub ok 2021-10-08T19:36:14.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:14 smithi117 ceph-mon[34585]: 2.13 scrub ok 2021-10-08T19:36:14.382 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 48 16 75801 75785 98.6131 66.5 0.0179196 0.0101352 2021-10-08T19:36:14.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:14 smithi097 ceph-mon[41966]: 6.13 deep-scrub ok 2021-10-08T19:36:14.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:14 smithi097 ceph-mon[41966]: pgmap v745: 178 pgs: 178 active+clean; 4.3 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 853 B/s rd, 58 MiB/s wr, 929 op/s 2021-10-08T19:36:14.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:14 smithi097 ceph-mon[41966]: 4.f scrub ok 2021-10-08T19:36:14.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:14 smithi097 ceph-mon[41966]: 2.13 scrub ok 2021-10-08T19:36:14.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:14 smithi097 ceph-mon[32687]: 6.13 deep-scrub ok 2021-10-08T19:36:14.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:14 smithi097 ceph-mon[32687]: pgmap v745: 178 pgs: 178 active+clean; 4.3 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 853 B/s rd, 58 MiB/s wr, 929 op/s 2021-10-08T19:36:14.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:14 smithi097 ceph-mon[32687]: 4.f scrub ok 2021-10-08T19:36:14.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:14 smithi097 ceph-mon[32687]: 2.13 scrub ok 2021-10-08T19:36:14.622 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd reweight 3 1 2021-10-08T19:36:14.819 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:36:14.834 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:14.835 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:36:14.921 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:36:14 smithi097 conmon[33110]: 172.21.15.117 - - [08/Oct/2021:19:36:14] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:36:14.936 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:36:14.967 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:15.040 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:36:15.043 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:15.043 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:36:15.145 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:36:15.169 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:36:15.169 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2021-10-08T19:36:15.170 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2021-10-08T19:36:15.170 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2021-10-08T19:36:15.170 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:36:15.209 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:15.382 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 49 16 76736 76720 97.7933 58.4375 0.0156873 0.0102214 2021-10-08T19:36:15.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:15 smithi117 ceph-mon[34585]: 4.1b scrub ok 2021-10-08T19:36:15.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:15 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:36:15.458 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:36:15.464 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:15 smithi097 ceph-mon[41966]: 4.1b scrub ok 2021-10-08T19:36:15.465 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:15 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:36:15.465 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:15.466 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:36:15.467 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:15 smithi097 ceph-mon[32687]: 4.1b scrub ok 2021-10-08T19:36:15.467 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:15 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:36:15.567 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:36:15.609 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:16.382 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 50 16 77798 77782 97.1652 66.375 0.0106591 0.0102868 2021-10-08T19:36:16.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:16 smithi117 ceph-mon[34585]: 4.17 scrub ok 2021-10-08T19:36:16.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:16 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:36:16.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:16 smithi117 ceph-mon[34585]: 172.21.15.117 - - [08/Oct/2021:19:36:14] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:36:16.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:16 smithi117 ceph-mon[34585]: pgmap v746: 178 pgs: 178 active+clean; 4.6 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.3 KiB/s rd, 86 MiB/s wr, 1.37k op/s 2021-10-08T19:36:16.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:16 smithi117 ceph-mon[34585]: 4.18 deep-scrub ok 2021-10-08T19:36:16.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:16 smithi117 ceph-mon[34585]: osdmap e381: 8 total, 8 up, 8 in 2021-10-08T19:36:16.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:16 smithi097 ceph-mon[32687]: 4.17 scrub ok 2021-10-08T19:36:16.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:16 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:36:16.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:16 smithi097 ceph-mon[32687]: 172.21.15.117 - - [08/Oct/2021:19:36:14] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:36:16.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:16 smithi097 ceph-mon[32687]: pgmap v746: 178 pgs: 178 active+clean; 4.6 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.3 KiB/s rd, 86 MiB/s wr, 1.37k op/s 2021-10-08T19:36:16.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:16 smithi097 ceph-mon[32687]: 4.18 deep-scrub ok 2021-10-08T19:36:16.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:16 smithi097 ceph-mon[32687]: osdmap e381: 8 total, 8 up, 8 in 2021-10-08T19:36:16.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:16 smithi097 ceph-mon[41966]: 4.17 scrub ok 2021-10-08T19:36:16.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:16 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:36:16.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:16 smithi097 ceph-mon[41966]: 172.21.15.117 - - [08/Oct/2021:19:36:14] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:36:16.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:16 smithi097 ceph-mon[41966]: pgmap v746: 178 pgs: 178 active+clean; 4.6 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.3 KiB/s rd, 86 MiB/s wr, 1.37k op/s 2021-10-08T19:36:16.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:16 smithi097 ceph-mon[41966]: 4.18 deep-scrub ok 2021-10-08T19:36:16.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:16 smithi097 ceph-mon[41966]: osdmap e381: 8 total, 8 up, 8 in 2021-10-08T19:36:16.653 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2021-10-08T19:36:16.738 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:36:16.748 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:16.749 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:36:16.793 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:36:16.838 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2021-10-08T19:36:16.851 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:36:16.923 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:17.074 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:36:17.082 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:17.083 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:36:17.184 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:36:17.209 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:17.264 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:36:17.266 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:36:17 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:36:17.266 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:17 smithi117 ceph-mon[34585]: 3.b scrub ok 2021-10-08T19:36:17.266 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:17 smithi117 ceph-mon[34585]: 4.1 scrub ok 2021-10-08T19:36:17.267 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:17.268 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:36:17.297 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:17 smithi097 ceph-mon[32687]: 3.b scrub ok 2021-10-08T19:36:17.297 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:17 smithi097 ceph-mon[32687]: 4.1 scrub ok 2021-10-08T19:36:17.298 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:17 smithi097 ceph-mon[41966]: 3.b scrub ok 2021-10-08T19:36:17.298 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:17 smithi097 ceph-mon[41966]: 4.1 scrub ok 2021-10-08T19:36:17.368 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:36:17.382 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 51 16 78733 78717 96.4061 58.4375 0.0289585 0.0103677 2021-10-08T19:36:17.402 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:17.466 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:36:17.470 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:17.471 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:36:17.572 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:36:17.613 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:17.683 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:36:17.685 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:17.686 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:36:17.716 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:36:17.721 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:36:17.787 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:36:17.858 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:17.952 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:36:17.957 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:17.957 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:36:18.058 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:36:18.090 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:18.120 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is set 2021-10-08T19:36:18.176 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:36:18.180 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:18.181 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:36:18.283 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:36:18.336 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:18.383 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 52 16 79734 79718 95.7555 62.5625 0.0152579 0.0104384 2021-10-08T19:36:18.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:18 smithi117 ceph-mon[34585]: 2.1c scrub ok 2021-10-08T19:36:18.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:18 smithi117 ceph-mon[34585]: pgmap v748: 178 pgs: 178 active+clean; 4.6 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 639 B/s rd, 60 MiB/s wr, 958 op/s 2021-10-08T19:36:18.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:18 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:36:18.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:18 smithi117 ceph-mon[34585]: 4.b scrub ok 2021-10-08T19:36:18.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:18 smithi117 ceph-mon[34585]: 2.18 scrub ok 2021-10-08T19:36:18.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:18 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2978518181' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:36:18.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:18 smithi117 ceph-mon[34585]: from='client.25873 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:36:18.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:18 smithi117 ceph-mon[34585]: 6.14 scrub ok 2021-10-08T19:36:18.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:18 smithi097 ceph-mon[41966]: 2.1c scrub ok 2021-10-08T19:36:18.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:18 smithi097 ceph-mon[41966]: pgmap v748: 178 pgs: 178 active+clean; 4.6 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 639 B/s rd, 60 MiB/s wr, 958 op/s 2021-10-08T19:36:18.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:18 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:36:18.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:18 smithi097 ceph-mon[41966]: 4.b scrub ok 2021-10-08T19:36:18.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:18 smithi097 ceph-mon[41966]: 2.18 scrub ok 2021-10-08T19:36:18.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:18 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2978518181' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:36:18.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:18 smithi097 ceph-mon[41966]: from='client.25873 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:36:18.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:18 smithi097 ceph-mon[41966]: 6.14 scrub ok 2021-10-08T19:36:18.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:18 smithi097 ceph-mon[32687]: 2.1c scrub ok 2021-10-08T19:36:18.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:18 smithi097 ceph-mon[32687]: pgmap v748: 178 pgs: 178 active+clean; 4.6 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 639 B/s rd, 60 MiB/s wr, 958 op/s 2021-10-08T19:36:18.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:18 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:36:18.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:18 smithi097 ceph-mon[32687]: 4.b scrub ok 2021-10-08T19:36:18.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:18 smithi097 ceph-mon[32687]: 2.18 scrub ok 2021-10-08T19:36:18.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:18 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2978518181' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:36:18.474 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:18 smithi097 ceph-mon[32687]: from='client.25873 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:36:18.474 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:18 smithi097 ceph-mon[32687]: 6.14 scrub ok 2021-10-08T19:36:19.383 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 53 16 80920 80904 95.3464 74.125 0.0124324 0.0104838 2021-10-08T19:36:19.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:19 smithi117 ceph-mon[34585]: 4.1d scrub ok 2021-10-08T19:36:19.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:19 smithi117 ceph-mon[34585]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:36:19.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:19 smithi117 ceph-mon[34585]: from='client.25873 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:36:19.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:19 smithi117 ceph-mon[34585]: osdmap e382: 8 total, 8 up, 8 in 2021-10-08T19:36:19.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:19 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:36:19.409 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:19 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:36:19.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:19 smithi097 ceph-mon[32687]: 4.1d scrub ok 2021-10-08T19:36:19.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:19 smithi097 ceph-mon[32687]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:36:19.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:19 smithi097 ceph-mon[32687]: from='client.25873 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:36:19.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:19 smithi097 ceph-mon[32687]: osdmap e382: 8 total, 8 up, 8 in 2021-10-08T19:36:19.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:19 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:36:19.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:19 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:36:19.475 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:19 smithi097 ceph-mon[41966]: 4.1d scrub ok 2021-10-08T19:36:19.475 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:19 smithi097 ceph-mon[41966]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:36:19.475 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:19 smithi097 ceph-mon[41966]: from='client.25873 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:36:19.476 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:19 smithi097 ceph-mon[41966]: osdmap e382: 8 total, 8 up, 8 in 2021-10-08T19:36:19.476 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:19 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:36:19.476 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:19 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:36:19.563 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:36:19.566 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:19.567 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:36:19.668 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:36:19.707 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:19.776 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:36:19.779 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:19.780 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:36:19.881 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:36:19.915 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:20.029 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:20.030 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:36:20.031 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:36:20.132 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:36:20.163 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:20.242 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:36:20.247 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:20 smithi117 ceph-mon[34585]: pgmap v750: 178 pgs: 178 active+clean; 4.8 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.7 KiB/s rd, 82 MiB/s wr, 1.32k op/s 2021-10-08T19:36:20.247 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:20 smithi117 ceph-mon[34585]: osdmap e383: 8 total, 8 up, 8 in 2021-10-08T19:36:20.248 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:20.248 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:36:20.349 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:36:20.370 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:20 smithi097 ceph-mon[32687]: pgmap v750: 178 pgs: 178 active+clean; 4.8 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.7 KiB/s rd, 82 MiB/s wr, 1.32k op/s 2021-10-08T19:36:20.371 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:20 smithi097 ceph-mon[32687]: osdmap e383: 8 total, 8 up, 8 in 2021-10-08T19:36:20.371 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:20 smithi097 ceph-mon[41966]: pgmap v750: 178 pgs: 178 active+clean; 4.8 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.7 KiB/s rd, 82 MiB/s wr, 1.32k op/s 2021-10-08T19:36:20.371 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:20 smithi097 ceph-mon[41966]: osdmap e383: 8 total, 8 up, 8 in 2021-10-08T19:36:20.382 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:20.386 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 54 16 81911 81895 94.7229 61.9375 0.0183918 0.0105524 2021-10-08T19:36:20.460 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:36:20.463 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:20.464 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:36:20.565 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:36:20.593 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:20.678 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:36:20.682 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:20.683 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:36:20.785 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:36:20.833 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:21.147 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:21 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/538700630' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2021-10-08T19:36:21.147 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:21 smithi097 ceph-mon[32687]: from='client.35912 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2021-10-08T19:36:21.149 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.3 to 1 (10000) 2021-10-08T19:36:21.389 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 55 16 82940 82924 94.1654 64.3125 0.014745 0.0106149 2021-10-08T19:36:21.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:21 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/538700630' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2021-10-08T19:36:21.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:21 smithi117 ceph-mon[34585]: from='client.35912 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2021-10-08T19:36:21.431 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:21 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/538700630' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2021-10-08T19:36:21.432 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:21 smithi097 ceph-mon[41966]: from='client.35912 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2021-10-08T19:36:21.720 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:36:21 smithi097 conmon[33110]: 172.21.15.97 - - [08/Oct/2021:19:36:21] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:36:21.816 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set nodeep-scrub 2021-10-08T19:36:22.147 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:22 smithi097 ceph-mon[32687]: pgmap v752: 178 pgs: 178 active+clean; 4.9 GiB data, 17 GiB used, 699 GiB / 715 GiB avail; 852 B/s rd, 53 MiB/s wr, 841 op/s 2021-10-08T19:36:22.148 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:22 smithi097 ceph-mon[32687]: from='client.35912 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2021-10-08T19:36:22.148 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:22 smithi097 ceph-mon[32687]: osdmap e384: 8 total, 8 up, 8 in 2021-10-08T19:36:22.148 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:22 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:36:22.171 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:36:22.179 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:22.179 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:36:22.281 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:36:22.331 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:22.352 INFO:tasks.cephadm.ceph_manager.ceph:waiting for recovery to complete 2021-10-08T19:36:22.352 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph pg dump --format=json 2021-10-08T19:36:22.392 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 56 16 84076 84060 93.7474 71 0.0125488 0.0106619 2021-10-08T19:36:22.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:22 smithi117 ceph-mon[34585]: pgmap v752: 178 pgs: 178 active+clean; 4.9 GiB data, 17 GiB used, 699 GiB / 715 GiB avail; 852 B/s rd, 53 MiB/s wr, 841 op/s 2021-10-08T19:36:22.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:22 smithi117 ceph-mon[34585]: from='client.35912 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2021-10-08T19:36:22.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:22 smithi117 ceph-mon[34585]: osdmap e384: 8 total, 8 up, 8 in 2021-10-08T19:36:22.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:22 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:36:22.474 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:22 smithi097 ceph-mon[41966]: pgmap v752: 178 pgs: 178 active+clean; 4.9 GiB data, 17 GiB used, 699 GiB / 715 GiB avail; 852 B/s rd, 53 MiB/s wr, 841 op/s 2021-10-08T19:36:22.475 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:22 smithi097 ceph-mon[41966]: from='client.35912 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2021-10-08T19:36:22.475 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:22 smithi097 ceph-mon[41966]: osdmap e384: 8 total, 8 up, 8 in 2021-10-08T19:36:22.476 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:22 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:36:22.970 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:36:22 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:36:22] "GET /metrics HTTP/1.1" 200 155855 "" "Prometheus/2.18.1" 2021-10-08T19:36:23.011 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:36:23.015 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:23.016 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:36:23.118 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:36:23.188 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:23.269 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:36:23.276 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:23.277 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:36:23.277 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:23 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:36:23.277 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:23 smithi097 ceph-mon[41966]: 172.21.15.97 - - [08/Oct/2021:19:36:21] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:36:23.278 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:23 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:36:23.278 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:23 smithi097 ceph-mon[32687]: 172.21.15.97 - - [08/Oct/2021:19:36:21] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:36:23.377 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:36:23.377 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:36:23.384 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:36:23.391 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 57 16 85144 85128 93.274 66.75 0.0317487 0.0107168 2021-10-08T19:36:23.407 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:23.484 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:36:23.489 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:23 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:36:23.489 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:23 smithi117 ceph-mon[34585]: 172.21.15.97 - - [08/Oct/2021:19:36:21] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:36:23.491 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:23.491 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:36:23.515 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:36:23.516 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2021-10-08T19:36:23.516 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2021-10-08T19:36:23.516 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2021-10-08T19:36:23.516 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.517 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:158640 7.e 7:705eda0e:::benchmark_data_smithi097_93198_object66820:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158)", 2021-10-08T19:36:23.517 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:26:53.907516+0000", 2021-10-08T19:36:23.517 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 569.60392009199995, 2021-10-08T19:36:23.517 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.115901639, 2021-10-08T19:36:23.517 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:36:23.518 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:36:23.518 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:36:23.518 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:36:23.518 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:36:23.519 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 158640 2021-10-08T19:36:23.519 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.519 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:36:23.520 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.520 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:36:23.520 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:53.907516+0000", 2021-10-08T19:36:23.520 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:36:23.521 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.521 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.521 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:36:23.521 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:53.907516+0000", 2021-10-08T19:36:23.522 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:36:23.522 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.522 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.522 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:36:23.522 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:53.907515+0000", 2021-10-08T19:36:23.523 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:36:23.524 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.525 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.525 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:36:23.525 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:53.907519+0000", 2021-10-08T19:36:23.525 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6129999999999997e-06 2021-10-08T19:36:23.525 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.526 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.526 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:36:23.526 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:53.907527+0000", 2021-10-08T19:36:23.528 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7680000000000008e-06 2021-10-08T19:36:23.528 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.528 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.529 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:36:23.529 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:53.907533+0000", 2021-10-08T19:36:23.529 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5439999999999998e-06 2021-10-08T19:36:23.529 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.530 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.530 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:36:23.530 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:53.907577+0000", 2021-10-08T19:36:23.530 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4567000000000002e-05 2021-10-08T19:36:23.530 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.531 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.531 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:36:23.531 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:53.907672+0000", 2021-10-08T19:36:23.531 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5169999999999999e-05 2021-10-08T19:36:23.532 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.532 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.532 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:36:23.532 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:53.907767+0000", 2021-10-08T19:36:23.533 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5175999999999998e-05 2021-10-08T19:36:23.533 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.533 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.533 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:36:23.533 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:54.004267+0000", 2021-10-08T19:36:23.534 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.096499101000000004 2021-10-08T19:36:23.534 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.534 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.534 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:36:23.535 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:54.004287+0000", 2021-10-08T19:36:23.535 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0599e-05 2021-10-08T19:36:23.535 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.535 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.535 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:36:23.536 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:54.023326+0000", 2021-10-08T19:36:23.536 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019038798999999999 2021-10-08T19:36:23.536 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.536 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.536 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:36:23.537 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:54.023376+0000", 2021-10-08T19:36:23.537 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0269999999999998e-05 2021-10-08T19:36:23.537 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.537 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.538 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:36:23.538 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:54.023417+0000", 2021-10-08T19:36:23.538 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1094999999999999e-05 2021-10-08T19:36:23.538 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:36:23.538 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:36:23.539 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:36:23.539 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.539 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.539 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:159676 7.e 7:74985da7:::benchmark_data_smithi097_93198_object67856:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158)", 2021-10-08T19:36:23.539 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:26:55.204112+0000", 2021-10-08T19:36:23.540 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 568.30732397600002, 2021-10-08T19:36:23.540 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.10814876399999999, 2021-10-08T19:36:23.540 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:36:23.540 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:36:23.541 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:36:23.541 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:36:23.541 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:36:23.541 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 159676 2021-10-08T19:36:23.541 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.542 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:36:23.542 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.542 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:36:23.542 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.204112+0000", 2021-10-08T19:36:23.543 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:36:23.543 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.543 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.543 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:36:23.544 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.204112+0000", 2021-10-08T19:36:23.544 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:36:23.544 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.544 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.545 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:36:23.545 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.204110+0000", 2021-10-08T19:36:23.545 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:36:23.545 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.545 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.546 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:36:23.546 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.204117+0000", 2021-10-08T19:36:23.546 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6340000000000001e-06 2021-10-08T19:36:23.546 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.547 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.547 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:36:23.547 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.204129+0000", 2021-10-08T19:36:23.547 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1851000000000001e-05 2021-10-08T19:36:23.547 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.548 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.548 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:36:23.548 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.204136+0000", 2021-10-08T19:36:23.548 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7170000000000002e-06 2021-10-08T19:36:23.549 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.549 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.549 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:36:23.549 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.204177+0000", 2021-10-08T19:36:23.549 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1601999999999999e-05 2021-10-08T19:36:23.550 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.550 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.550 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:36:23.550 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.204253+0000", 2021-10-08T19:36:23.551 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6007999999999995e-05 2021-10-08T19:36:23.551 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.551 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.551 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:36:23.551 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.204337+0000", 2021-10-08T19:36:23.552 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3407999999999998e-05 2021-10-08T19:36:23.552 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.552 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.552 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:36:23.553 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.206699+0000", 2021-10-08T19:36:23.553 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0023617680000000002 2021-10-08T19:36:23.553 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.553 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.553 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:36:23.554 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.207753+0000", 2021-10-08T19:36:23.554 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010547410000000001 2021-10-08T19:36:23.554 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.554 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.555 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:36:23.555 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.312177+0000", 2021-10-08T19:36:23.555 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.10442370199999999 2021-10-08T19:36:23.555 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.555 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.556 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:36:23.556 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.312223+0000", 2021-10-08T19:36:23.556 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6147999999999999e-05 2021-10-08T19:36:23.556 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.557 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.557 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:36:23.557 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:55.312261+0000", 2021-10-08T19:36:23.557 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7398999999999999e-05 2021-10-08T19:36:23.557 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:36:23.558 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:36:23.558 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:36:23.558 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.558 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.559 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:161975 7.8 7:114b2586:::benchmark_data_smithi097_93198_object70155:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158)", 2021-10-08T19:36:23.559 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:26:58.330662+0000", 2021-10-08T19:36:23.559 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 565.18077363999998, 2021-10-08T19:36:23.559 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.21377785099999999, 2021-10-08T19:36:23.560 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:36:23.560 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:36:23.560 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:36:23.560 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:36:23.561 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:36:23.561 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 161975 2021-10-08T19:36:23.561 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.562 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:36:23.563 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.563 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:36:23.563 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.330662+0000", 2021-10-08T19:36:23.564 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:36:23.564 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.564 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.564 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:36:23.564 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.330662+0000", 2021-10-08T19:36:23.565 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:36:23.565 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.565 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.565 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:36:23.566 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.330660+0000", 2021-10-08T19:36:23.566 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:36:23.566 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.566 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.567 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:36:23.567 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.330667+0000", 2021-10-08T19:36:23.567 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0280000000000003e-06 2021-10-08T19:36:23.567 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.568 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.568 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:36:23.568 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.330677+0000", 2021-10-08T19:36:23.568 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0149000000000001e-05 2021-10-08T19:36:23.568 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.569 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.569 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:36:23.569 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.330683+0000", 2021-10-08T19:36:23.569 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7649999999999999e-06 2021-10-08T19:36:23.570 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.570 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.570 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:36:23.570 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.330722+0000", 2021-10-08T19:36:23.571 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8717999999999998e-05 2021-10-08T19:36:23.571 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.571 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.571 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:36:23.571 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.330831+0000", 2021-10-08T19:36:23.572 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000108887 2021-10-08T19:36:23.572 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.572 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.572 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4,7", 2021-10-08T19:36:23.573 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.330939+0000", 2021-10-08T19:36:23.573 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000108608 2021-10-08T19:36:23.573 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.573 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.574 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:36:23.574 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.335977+0000", 2021-10-08T19:36:23.574 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0050375250000000002 2021-10-08T19:36:23.575 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.575 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.575 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:36:23.576 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.335997+0000", 2021-10-08T19:36:23.576 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0086999999999999e-05 2021-10-08T19:36:23.576 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.577 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.577 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:36:23.577 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.544379+0000", 2021-10-08T19:36:23.577 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.208382345 2021-10-08T19:36:23.577 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.578 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.578 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:36:23.578 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.544415+0000", 2021-10-08T19:36:23.578 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5704999999999998e-05 2021-10-08T19:36:23.579 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.579 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.579 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:36:23.579 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.544440+0000", 2021-10-08T19:36:23.580 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5032e-05 2021-10-08T19:36:23.580 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:36:23.580 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:36:23.580 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:36:23.581 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.581 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.581 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:161982 7.8 7:17dd4ca8:::benchmark_data_smithi097_93198_object70162:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158)", 2021-10-08T19:36:23.581 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:26:58.338172+0000", 2021-10-08T19:36:23.582 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 565.17326388699996, 2021-10-08T19:36:23.582 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.20636200499999999, 2021-10-08T19:36:23.582 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:36:23.582 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:36:23.583 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:36:23.583 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:36:23.583 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:36:23.583 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 161982 2021-10-08T19:36:23.583 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.584 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:36:23.584 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.584 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:36:23.584 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.338172+0000", 2021-10-08T19:36:23.585 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:36:23.585 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.585 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.585 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:36:23.585 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.338172+0000", 2021-10-08T19:36:23.586 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:36:23.586 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.586 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.586 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:36:23.587 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.338169+0000", 2021-10-08T19:36:23.587 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:36:23.587 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.587 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.587 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:36:23.588 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.338178+0000", 2021-10-08T19:36:23.588 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1089999999999998e-06 2021-10-08T19:36:23.588 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.588 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.588 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:36:23.589 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.338189+0000", 2021-10-08T19:36:23.589 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.167e-05 2021-10-08T19:36:23.589 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.589 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.590 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:36:23.590 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.338196+0000", 2021-10-08T19:36:23.590 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7880000000000001e-06 2021-10-08T19:36:23.590 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.591 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.591 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:36:23.591 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.338239+0000", 2021-10-08T19:36:23.591 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3055e-05 2021-10-08T19:36:23.591 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.592 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.592 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:36:23.592 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.338355+0000", 2021-10-08T19:36:23.592 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000116012 2021-10-08T19:36:23.593 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.593 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.593 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4,7", 2021-10-08T19:36:23.593 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.338478+0000", 2021-10-08T19:36:23.593 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012258399999999999 2021-10-08T19:36:23.594 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.594 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.594 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:36:23.594 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.341678+0000", 2021-10-08T19:36:23.595 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031999760000000002 2021-10-08T19:36:23.595 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.595 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.595 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:36:23.595 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.345366+0000", 2021-10-08T19:36:23.596 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003688654 2021-10-08T19:36:23.596 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.596 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.596 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:36:23.597 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.544479+0000", 2021-10-08T19:36:23.597 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.19911299299999999 2021-10-08T19:36:23.597 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.597 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.597 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:36:23.598 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.544513+0000", 2021-10-08T19:36:23.598 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4167e-05 2021-10-08T19:36:23.598 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.598 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.598 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:36:23.599 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.544534+0000", 2021-10-08T19:36:23.599 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0406000000000001e-05 2021-10-08T19:36:23.599 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:36:23.599 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:36:23.600 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:36:23.600 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.600 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.600 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:162006 7.8 7:18e88623:::benchmark_data_smithi097_93198_object70186:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158)", 2021-10-08T19:36:23.600 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:26:58.374366+0000", 2021-10-08T19:36:23.601 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 565.13706938500002, 2021-10-08T19:36:23.601 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.17491137500000001, 2021-10-08T19:36:23.601 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:36:23.601 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:36:23.601 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:36:23.602 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:36:23.602 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:36:23.602 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 162006 2021-10-08T19:36:23.602 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.603 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:36:23.603 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.603 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:36:23.603 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.374366+0000", 2021-10-08T19:36:23.604 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:36:23.604 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.604 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.604 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:36:23.604 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.374366+0000", 2021-10-08T19:36:23.605 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:36:23.605 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.605 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.605 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:36:23.605 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.374364+0000", 2021-10-08T19:36:23.606 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:36:23.606 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.606 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.606 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:36:23.607 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.374372+0000", 2021-10-08T19:36:23.607 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4200000000000001e-06 2021-10-08T19:36:23.607 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.607 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.608 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:36:23.608 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.374387+0000", 2021-10-08T19:36:23.608 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5359999999999999e-05 2021-10-08T19:36:23.608 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.608 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.609 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:36:23.609 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.374395+0000", 2021-10-08T19:36:23.609 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4719999999999998e-06 2021-10-08T19:36:23.609 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.610 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.610 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:36:23.610 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.374451+0000", 2021-10-08T19:36:23.610 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5791000000000002e-05 2021-10-08T19:36:23.610 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.611 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.611 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:36:23.611 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.374539+0000", 2021-10-08T19:36:23.611 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8510999999999993e-05 2021-10-08T19:36:23.612 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.612 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.612 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4,7", 2021-10-08T19:36:23.612 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.374659+0000", 2021-10-08T19:36:23.612 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119647 2021-10-08T19:36:23.613 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.613 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.613 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:36:23.613 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.377838+0000", 2021-10-08T19:36:23.613 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003178817 2021-10-08T19:36:23.614 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.614 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.614 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:36:23.614 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.378153+0000", 2021-10-08T19:36:23.615 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031545800000000001 2021-10-08T19:36:23.615 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.615 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.615 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:36:23.616 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.549177+0000", 2021-10-08T19:36:23.616 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.171024236 2021-10-08T19:36:23.616 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.616 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.616 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:36:23.617 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.549233+0000", 2021-10-08T19:36:23.617 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5806000000000001e-05 2021-10-08T19:36:23.617 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.617 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.618 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:36:23.618 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.549278+0000", 2021-10-08T19:36:23.618 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4728000000000003e-05 2021-10-08T19:36:23.618 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:36:23.618 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:36:23.619 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:36:23.619 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.619 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.619 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.24796.0:162015 7.8 7:13e56b01:::benchmark_data_smithi097_93198_object70195:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158)", 2021-10-08T19:36:23.620 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:26:58.403700+0000", 2021-10-08T19:36:23.620 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 565.10773569399998, 2021-10-08T19:36:23.620 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.145692814, 2021-10-08T19:36:23.621 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:36:23.621 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:36:23.621 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:36:23.621 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.24796", 2021-10-08T19:36:23.622 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/742960869", 2021-10-08T19:36:23.622 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 162015 2021-10-08T19:36:23.622 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.622 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:36:23.622 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.623 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:36:23.623 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.403700+0000", 2021-10-08T19:36:23.623 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:36:23.623 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.624 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.624 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:36:23.624 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.403700+0000", 2021-10-08T19:36:23.624 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:36:23.625 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.625 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.625 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:36:23.625 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.403697+0000", 2021-10-08T19:36:23.626 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2021-10-08T19:36:23.626 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.626 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.626 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:36:23.627 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.403708+0000", 2021-10-08T19:36:23.627 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0558e-05 2021-10-08T19:36:23.627 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.627 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.627 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:36:23.628 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.403728+0000", 2021-10-08T19:36:23.628 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0367e-05 2021-10-08T19:36:23.628 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.628 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.629 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:36:23.629 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.403736+0000", 2021-10-08T19:36:23.629 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2460000000000003e-06 2021-10-08T19:36:23.629 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.629 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.630 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:36:23.630 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.403791+0000", 2021-10-08T19:36:23.630 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4670999999999999e-05 2021-10-08T19:36:23.630 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.631 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.631 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:36:23.631 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.403937+0000", 2021-10-08T19:36:23.631 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014544300000000001 2021-10-08T19:36:23.631 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.632 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.632 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4,7", 2021-10-08T19:36:23.632 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.404069+0000", 2021-10-08T19:36:23.632 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000132082 2021-10-08T19:36:23.632 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.633 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.633 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:36:23.633 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.406592+0000", 2021-10-08T19:36:23.633 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00252375 2021-10-08T19:36:23.634 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.634 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.634 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:36:23.634 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.406657+0000", 2021-10-08T19:36:23.635 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4361000000000003e-05 2021-10-08T19:36:23.635 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.635 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.635 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:36:23.636 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.549322+0000", 2021-10-08T19:36:23.636 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.14266500200000001 2021-10-08T19:36:23.636 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.636 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.636 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:36:23.637 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.549367+0000", 2021-10-08T19:36:23.637 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4883999999999999e-05 2021-10-08T19:36:23.637 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.637 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.637 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:36:23.638 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:26:58.549393+0000", 2021-10-08T19:36:23.638 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6273000000000001e-05 2021-10-08T19:36:23.638 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:36:23.638 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:36:23.639 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:36:23.639 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.639 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.639 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "MOSDPGPushReply(4.1c 197/196 [PushReplyOp(4:3d9e841d:::obj_delete_at_hint.0000000041:head)])", 2021-10-08T19:36:23.639 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:28:24.395953+0000", 2021-10-08T19:36:23.640 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 479.11548294200003, 2021-10-08T19:36:23.640 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.11790047100000001, 2021-10-08T19:36:23.640 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:36:23.640 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "reached pg", 2021-10-08T19:36:23.640 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:36:23.641 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.641 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:36:23.641 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:24.395953+0000", 2021-10-08T19:36:23.641 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:36:23.642 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.642 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.642 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:36:23.642 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:24.395953+0000", 2021-10-08T19:36:23.642 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:36:23.643 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.643 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.643 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:36:23.643 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:24.395951+0000", 2021-10-08T19:36:23.644 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2021-10-08T19:36:23.644 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.644 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.644 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:36:23.644 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:24.395959+0000", 2021-10-08T19:36:23.645 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4789999999999999e-06 2021-10-08T19:36:23.645 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.645 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.646 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:36:23.646 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:24.395970+0000", 2021-10-08T19:36:23.646 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1021e-05 2021-10-08T19:36:23.647 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.647 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.647 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:36:23.648 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:24.395975+0000", 2021-10-08T19:36:23.648 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9370000000000003e-06 2021-10-08T19:36:23.648 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.648 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.648 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:36:23.649 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:24.513707+0000", 2021-10-08T19:36:23.649 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.11773249700000001 2021-10-08T19:36:23.649 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.649 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.649 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:36:23.650 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:28:24.513853+0000", 2021-10-08T19:36:23.650 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000146069 2021-10-08T19:36:23.650 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:36:23.650 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:36:23.651 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:36:23.651 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.651 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.651 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:95896 8.f 8:f4157ae7:::benchmark_data_smithi097_144160_object7156:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e228)", 2021-10-08T19:36:23.652 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:29.766663+0000", 2021-10-08T19:36:23.652 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 413.74477251500002, 2021-10-08T19:36:23.652 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9412932270000001, 2021-10-08T19:36:23.652 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:36:23.652 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:36:23.653 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:36:23.653 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:36:23.653 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:36:23.653 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 95896 2021-10-08T19:36:23.654 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.654 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:36:23.654 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.654 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:36:23.654 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.766663+0000", 2021-10-08T19:36:23.655 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:36:23.655 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.655 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.655 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:36:23.656 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.766663+0000", 2021-10-08T19:36:23.656 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:36:23.656 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.656 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.656 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:36:23.657 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.766662+0000", 2021-10-08T19:36:23.657 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2021-10-08T19:36:23.657 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.657 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.657 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:36:23.658 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.766667+0000", 2021-10-08T19:36:23.658 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7809999999999996e-06 2021-10-08T19:36:23.658 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.658 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.659 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:36:23.659 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.766673+0000", 2021-10-08T19:36:23.659 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1419999999999998e-06 2021-10-08T19:36:23.659 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.659 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.660 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:36:23.660 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.766678+0000", 2021-10-08T19:36:23.660 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5090000000000001e-06 2021-10-08T19:36:23.660 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.661 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.661 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:36:23.661 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.766728+0000", 2021-10-08T19:36:23.661 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9429999999999999e-05 2021-10-08T19:36:23.661 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.662 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.662 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:36:23.662 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:29.766737+0000", 2021-10-08T19:36:23.662 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8829999999999995e-06 2021-10-08T19:36:23.663 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.663 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.663 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:36:23.663 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:30.600075+0000", 2021-10-08T19:36:23.663 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.833338095 2021-10-08T19:36:23.664 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.664 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.664 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:36:23.664 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:30.600085+0000", 2021-10-08T19:36:23.664 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0237999999999999e-05 2021-10-08T19:36:23.665 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.665 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.665 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:36:23.665 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.703691+0000", 2021-10-08T19:36:23.666 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.103606206 2021-10-08T19:36:23.666 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.666 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.666 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:36:23.666 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.703858+0000", 2021-10-08T19:36:23.667 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000166284 2021-10-08T19:36:23.667 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.667 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.667 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,3,4", 2021-10-08T19:36:23.667 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.704051+0000", 2021-10-08T19:36:23.668 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019300200000000001 2021-10-08T19:36:23.668 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.668 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.668 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:36:23.669 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.706431+0000", 2021-10-08T19:36:23.669 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002380521 2021-10-08T19:36:23.669 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.669 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.669 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:36:23.670 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.706718+0000", 2021-10-08T19:36:23.670 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00028731500000000001 2021-10-08T19:36:23.670 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.670 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.671 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:36:23.671 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.706931+0000", 2021-10-08T19:36:23.671 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000212358 2021-10-08T19:36:23.671 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.671 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.672 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:36:23.672 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.707782+0000", 2021-10-08T19:36:23.672 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00085145800000000003 2021-10-08T19:36:23.672 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.672 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.673 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:36:23.673 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.707841+0000", 2021-10-08T19:36:23.673 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9330999999999998e-05 2021-10-08T19:36:23.673 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.673 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.674 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:36:23.674 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:31.707956+0000", 2021-10-08T19:36:23.674 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011496499999999999 2021-10-08T19:36:23.674 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:36:23.675 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:36:23.675 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:36:23.675 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.675 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.675 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15870.0:28438 10.3 10:cea831ba:::benchmark_data_smithi097_245820_object28437:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e364)", 2021-10-08T19:36:23.676 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:35:37.885466+0000", 2021-10-08T19:36:23.676 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 45.625969732000001, 2021-10-08T19:36:23.676 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.111564729, 2021-10-08T19:36:23.676 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:36:23.676 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:36:23.677 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:36:23.677 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15870", 2021-10-08T19:36:23.677 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1128006081", 2021-10-08T19:36:23.677 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 28438 2021-10-08T19:36:23.678 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.678 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:36:23.678 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.678 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:36:23.678 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.885466+0000", 2021-10-08T19:36:23.679 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:36:23.679 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.679 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.679 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:36:23.679 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.885466+0000", 2021-10-08T19:36:23.680 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:36:23.680 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.680 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.680 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:36:23.681 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.885464+0000", 2021-10-08T19:36:23.681 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:36:23.681 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.681 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.681 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:36:23.682 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.885525+0000", 2021-10-08T19:36:23.682 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1155000000000007e-05 2021-10-08T19:36:23.682 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.682 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.683 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:36:23.683 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.885538+0000", 2021-10-08T19:36:23.683 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3236e-05 2021-10-08T19:36:23.683 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.683 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.684 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:36:23.684 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.885545+0000", 2021-10-08T19:36:23.684 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0230000000000004e-06 2021-10-08T19:36:23.684 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.684 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.685 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:36:23.685 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.885594+0000", 2021-10-08T19:36:23.685 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8766e-05 2021-10-08T19:36:23.685 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.686 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.686 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:36:23.686 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.885689+0000", 2021-10-08T19:36:23.686 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5181999999999998e-05 2021-10-08T19:36:23.686 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.687 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.687 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,5", 2021-10-08T19:36:23.687 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.885775+0000", 2021-10-08T19:36:23.687 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6274999999999996e-05 2021-10-08T19:36:23.687 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.688 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.688 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:36:23.688 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.889986+0000", 2021-10-08T19:36:23.688 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0042109820000000003 2021-10-08T19:36:23.689 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.689 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.689 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:36:23.689 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.889997+0000", 2021-10-08T19:36:23.689 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0536e-05 2021-10-08T19:36:23.690 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.690 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.690 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:36:23.690 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.996937+0000", 2021-10-08T19:36:23.691 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.106940125 2021-10-08T19:36:23.691 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.691 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.691 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:36:23.691 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.996989+0000", 2021-10-08T19:36:23.692 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2101000000000001e-05 2021-10-08T19:36:23.692 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.692 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.692 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:36:23.693 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.997031+0000", 2021-10-08T19:36:23.693 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1761000000000002e-05 2021-10-08T19:36:23.693 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:36:23.693 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:36:23.693 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:36:23.694 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.694 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.694 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15870.0:28440 10.3 10:c2a5c245:::benchmark_data_smithi097_245820_object28439:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e364)", 2021-10-08T19:36:23.694 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:35:37.886945+0000", 2021-10-08T19:36:23.695 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 45.624490794000003, 2021-10-08T19:36:23.695 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.11030833700000001, 2021-10-08T19:36:23.695 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:36:23.695 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:36:23.695 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:36:23.696 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15870", 2021-10-08T19:36:23.696 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1128006081", 2021-10-08T19:36:23.696 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 28440 2021-10-08T19:36:23.696 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.697 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:36:23.697 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.697 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:36:23.697 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.886945+0000", 2021-10-08T19:36:23.697 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:36:23.698 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.698 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.698 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:36:23.698 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.886945+0000", 2021-10-08T19:36:23.698 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:36:23.699 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.699 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.699 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:36:23.699 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.886943+0000", 2021-10-08T19:36:23.700 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:36:23.700 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.700 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.700 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:36:23.700 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.887000+0000", 2021-10-08T19:36:23.701 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7813999999999999e-05 2021-10-08T19:36:23.701 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.701 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.701 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:36:23.701 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.887012+0000", 2021-10-08T19:36:23.702 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.172e-05 2021-10-08T19:36:23.702 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.702 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.702 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:36:23.703 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.887019+0000", 2021-10-08T19:36:23.703 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5289999999999997e-06 2021-10-08T19:36:23.703 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.703 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.703 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:36:23.704 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.888672+0000", 2021-10-08T19:36:23.704 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001652915 2021-10-08T19:36:23.704 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.704 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.704 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:36:23.705 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.888778+0000", 2021-10-08T19:36:23.705 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010637999999999999 2021-10-08T19:36:23.705 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.705 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.706 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,5", 2021-10-08T19:36:23.706 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.888900+0000", 2021-10-08T19:36:23.706 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000122266 2021-10-08T19:36:23.706 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.706 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.707 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:36:23.707 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.891496+0000", 2021-10-08T19:36:23.707 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0025961270000000002 2021-10-08T19:36:23.707 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.707 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.708 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:36:23.708 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.997135+0000", 2021-10-08T19:36:23.708 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.105638432 2021-10-08T19:36:23.708 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.709 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.709 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:36:23.709 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.997170+0000", 2021-10-08T19:36:23.709 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5369e-05 2021-10-08T19:36:23.709 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.710 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.710 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:36:23.710 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.997217+0000", 2021-10-08T19:36:23.710 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6999999999999997e-05 2021-10-08T19:36:23.711 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.711 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.711 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:36:23.711 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.997253+0000", 2021-10-08T19:36:23.711 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6140999999999998e-05 2021-10-08T19:36:23.712 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:36:23.712 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:36:23.712 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:36:23.712 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.713 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.713 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15870.0:28446 10.5 10:a4fdf424:::benchmark_data_smithi097_245820_object28445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e364)", 2021-10-08T19:36:23.713 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:35:37.889981+0000", 2021-10-08T19:36:23.713 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 45.621455107000003, 2021-10-08T19:36:23.713 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.111889523, 2021-10-08T19:36:23.714 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:36:23.714 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:36:23.714 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:36:23.714 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15870", 2021-10-08T19:36:23.715 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1128006081", 2021-10-08T19:36:23.715 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 28446 2021-10-08T19:36:23.715 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.715 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:36:23.715 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.716 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:36:23.716 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.889981+0000", 2021-10-08T19:36:23.716 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:36:23.716 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.717 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.717 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:36:23.717 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.889981+0000", 2021-10-08T19:36:23.717 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:36:23.717 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.718 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.718 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:36:23.718 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.889979+0000", 2021-10-08T19:36:23.718 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2021-10-08T19:36:23.718 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.719 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.719 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:36:23.719 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.890019+0000", 2021-10-08T19:36:23.719 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9824999999999999e-05 2021-10-08T19:36:23.720 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.720 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.720 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:36:23.720 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.890027+0000", 2021-10-08T19:36:23.720 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8900000000000007e-06 2021-10-08T19:36:23.721 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.721 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.721 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:36:23.721 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.890031+0000", 2021-10-08T19:36:23.722 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6619999999999996e-06 2021-10-08T19:36:23.722 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.722 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.722 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:36:23.722 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.890079+0000", 2021-10-08T19:36:23.723 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7837000000000003e-05 2021-10-08T19:36:23.723 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.723 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.723 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:36:23.724 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.890254+0000", 2021-10-08T19:36:23.724 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017515799999999999 2021-10-08T19:36:23.724 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.724 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.724 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,3", 2021-10-08T19:36:23.725 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.890437+0000", 2021-10-08T19:36:23.725 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00018275100000000001 2021-10-08T19:36:23.725 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.725 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.725 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:36:23.726 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.995818+0000", 2021-10-08T19:36:23.726 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.105380667 2021-10-08T19:36:23.726 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.726 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.727 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:36:23.727 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.995827+0000", 2021-10-08T19:36:23.727 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9609999999999994e-06 2021-10-08T19:36:23.727 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.727 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.728 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:36:23.728 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:38.001776+0000", 2021-10-08T19:36:23.728 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.005949111 2021-10-08T19:36:23.728 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.728 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.729 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:36:23.729 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:38.001829+0000", 2021-10-08T19:36:23.729 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2734e-05 2021-10-08T19:36:23.730 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.730 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.730 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:36:23.730 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:38.001870+0000", 2021-10-08T19:36:23.731 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1547e-05 2021-10-08T19:36:23.731 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:36:23.731 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:36:23.731 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:36:23.731 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.732 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.732 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15870.0:28450 10.3 10:cab2c3bf:::benchmark_data_smithi097_245820_object28449:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e364)", 2021-10-08T19:36:23.732 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:35:37.890045+0000", 2021-10-08T19:36:23.732 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 45.621390808000001, 2021-10-08T19:36:23.732 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.107354429, 2021-10-08T19:36:23.733 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:36:23.733 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:36:23.733 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:36:23.733 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15870", 2021-10-08T19:36:23.734 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1128006081", 2021-10-08T19:36:23.734 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 28450 2021-10-08T19:36:23.734 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.734 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:36:23.734 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.735 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:36:23.735 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.890045+0000", 2021-10-08T19:36:23.735 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:36:23.735 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.736 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.736 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:36:23.736 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.890045+0000", 2021-10-08T19:36:23.736 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:36:23.736 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.737 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.737 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:36:23.737 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.890044+0000", 2021-10-08T19:36:23.737 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:36:23.737 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.738 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.738 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:36:23.738 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.890093+0000", 2021-10-08T19:36:23.738 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8909000000000002e-05 2021-10-08T19:36:23.739 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.739 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.739 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:36:23.739 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.890100+0000", 2021-10-08T19:36:23.739 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7560000000000002e-06 2021-10-08T19:36:23.740 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.740 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.740 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:36:23.740 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.890104+0000", 2021-10-08T19:36:23.740 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6829999999999999e-06 2021-10-08T19:36:23.741 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.741 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.741 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:36:23.741 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.890140+0000", 2021-10-08T19:36:23.741 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5781000000000002e-05 2021-10-08T19:36:23.742 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.742 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.742 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:36:23.742 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.890226+0000", 2021-10-08T19:36:23.743 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6248000000000005e-05 2021-10-08T19:36:23.743 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.743 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.743 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,5", 2021-10-08T19:36:23.743 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.890373+0000", 2021-10-08T19:36:23.744 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014602300000000001 2021-10-08T19:36:23.744 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.744 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.744 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:36:23.744 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.997041+0000", 2021-10-08T19:36:23.745 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.10666837899999999 2021-10-08T19:36:23.745 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.745 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.745 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:36:23.746 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.997290+0000", 2021-10-08T19:36:23.746 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024948800000000002 2021-10-08T19:36:23.746 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.746 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.746 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:36:23.747 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.997327+0000", 2021-10-08T19:36:23.747 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6884000000000001e-05 2021-10-08T19:36:23.747 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.747 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.748 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:36:23.748 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.997366+0000", 2021-10-08T19:36:23.748 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8763999999999997e-05 2021-10-08T19:36:23.748 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.748 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.749 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:36:23.749 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.997399+0000", 2021-10-08T19:36:23.749 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3348e-05 2021-10-08T19:36:23.749 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:36:23.749 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:36:23.750 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:36:23.750 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.750 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.750 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15870.0:28452 10.3 10:c51568ca:::benchmark_data_smithi097_245820_object28451:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e364)", 2021-10-08T19:36:23.751 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:35:37.890119+0000", 2021-10-08T19:36:23.751 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 45.621316399000001, 2021-10-08T19:36:23.751 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.109439035, 2021-10-08T19:36:23.751 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:36:23.751 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:36:23.752 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:36:23.752 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15870", 2021-10-08T19:36:23.752 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1128006081", 2021-10-08T19:36:23.752 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 28452 2021-10-08T19:36:23.752 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.753 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:36:23.753 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.753 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:36:23.753 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.890119+0000", 2021-10-08T19:36:23.754 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:36:23.754 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.754 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.754 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:36:23.754 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.890119+0000", 2021-10-08T19:36:23.755 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:36:23.755 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.755 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.755 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:36:23.755 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.890118+0000", 2021-10-08T19:36:23.756 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:36:23.756 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.756 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.756 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:36:23.757 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.890162+0000", 2021-10-08T19:36:23.757 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3609999999999998e-05 2021-10-08T19:36:23.757 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.757 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.757 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:36:23.758 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.890169+0000", 2021-10-08T19:36:23.758 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6669999999999999e-06 2021-10-08T19:36:23.758 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.758 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.759 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:36:23.759 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.890173+0000", 2021-10-08T19:36:23.759 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3630000000000004e-06 2021-10-08T19:36:23.759 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.759 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.760 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:36:23.760 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.891614+0000", 2021-10-08T19:36:23.760 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0014405970000000001 2021-10-08T19:36:23.760 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.760 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.761 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:36:23.761 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.891750+0000", 2021-10-08T19:36:23.761 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013599200000000001 2021-10-08T19:36:23.761 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.762 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.762 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,5", 2021-10-08T19:36:23.762 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.891885+0000", 2021-10-08T19:36:23.762 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013567399999999999 2021-10-08T19:36:23.762 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.763 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.763 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:36:23.763 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.997436+0000", 2021-10-08T19:36:23.763 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.105550482 2021-10-08T19:36:23.763 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.764 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.764 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:36:23.764 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.997471+0000", 2021-10-08T19:36:23.764 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5348000000000001e-05 2021-10-08T19:36:23.765 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.765 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.765 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:36:23.765 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.999467+0000", 2021-10-08T19:36:23.766 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00199562 2021-10-08T19:36:23.766 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.767 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.767 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:36:23.767 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.999516+0000", 2021-10-08T19:36:23.768 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9487000000000002e-05 2021-10-08T19:36:23.768 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.768 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.768 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:36:23.769 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:37.999558+0000", 2021-10-08T19:36:23.769 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2126999999999998e-05 2021-10-08T19:36:23.769 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:36:23.769 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:36:23.769 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:36:23.770 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.770 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.770 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15870.0:55049 10.5 10:a0db19ce:::benchmark_data_smithi097_245820_object55048:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e371)", 2021-10-08T19:36:23.770 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:35:55.919392+0000", 2021-10-08T19:36:23.771 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 27.592043787000001, 2021-10-08T19:36:23.771 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.20681543799999999, 2021-10-08T19:36:23.772 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:36:23.772 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:36:23.772 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:36:23.772 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15870", 2021-10-08T19:36:23.773 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1128006081", 2021-10-08T19:36:23.773 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 55049 2021-10-08T19:36:23.773 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.773 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:36:23.774 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.774 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:36:23.774 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.919392+0000", 2021-10-08T19:36:23.774 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:36:23.774 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.775 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.775 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:36:23.775 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.919392+0000", 2021-10-08T19:36:23.775 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:36:23.776 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.776 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.776 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:36:23.776 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.919391+0000", 2021-10-08T19:36:23.777 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2021-10-08T19:36:23.777 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.777 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.777 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:36:23.777 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.919413+0000", 2021-10-08T19:36:23.778 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2416e-05 2021-10-08T19:36:23.778 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.778 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.778 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:36:23.779 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.919421+0000", 2021-10-08T19:36:23.779 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7719999999999994e-06 2021-10-08T19:36:23.779 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.779 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.779 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:36:23.780 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.919425+0000", 2021-10-08T19:36:23.780 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1930000000000003e-06 2021-10-08T19:36:23.780 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.780 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.781 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:36:23.781 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.919459+0000", 2021-10-08T19:36:23.781 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3946000000000003e-05 2021-10-08T19:36:23.781 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.781 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.782 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:36:23.782 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.919590+0000", 2021-10-08T19:36:23.782 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000130901 2021-10-08T19:36:23.782 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.783 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.783 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,3", 2021-10-08T19:36:23.783 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.919679+0000", 2021-10-08T19:36:23.783 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8671000000000005e-05 2021-10-08T19:36:23.783 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.784 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.784 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:36:23.784 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.921741+0000", 2021-10-08T19:36:23.784 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002062539 2021-10-08T19:36:23.785 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.785 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.785 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:36:23.785 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.921895+0000", 2021-10-08T19:36:23.785 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015344800000000001 2021-10-08T19:36:23.786 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.786 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.786 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:36:23.786 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:56.126111+0000", 2021-10-08T19:36:23.787 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.20421688599999999 2021-10-08T19:36:23.787 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.787 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.787 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:36:23.787 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:56.126166+0000", 2021-10-08T19:36:23.788 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4228999999999999e-05 2021-10-08T19:36:23.788 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.788 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.788 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:36:23.788 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:56.126207+0000", 2021-10-08T19:36:23.789 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1675999999999999e-05 2021-10-08T19:36:23.789 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:36:23.789 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:36:23.789 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:36:23.790 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.790 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.790 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15870.0:77036 10.3 10:cfeb6ef9:::benchmark_data_smithi097_245820_object77035:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e380)", 2021-10-08T19:36:23.790 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:36:15.640250+0000", 2021-10-08T19:36:23.791 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 7.8711853420000004, 2021-10-08T19:36:23.791 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.115051652, 2021-10-08T19:36:23.791 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:36:23.791 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:36:23.791 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:36:23.792 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15870", 2021-10-08T19:36:23.792 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1128006081", 2021-10-08T19:36:23.792 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 77036 2021-10-08T19:36:23.792 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.793 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:36:23.793 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.793 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:36:23.793 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.640250+0000", 2021-10-08T19:36:23.793 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:36:23.794 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.794 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.794 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:36:23.794 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.640250+0000", 2021-10-08T19:36:23.795 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:36:23.795 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.795 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.795 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:36:23.795 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.640248+0000", 2021-10-08T19:36:23.796 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:36:23.796 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.796 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.796 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:36:23.797 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.640288+0000", 2021-10-08T19:36:23.797 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0447000000000001e-05 2021-10-08T19:36:23.797 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.797 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.797 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:36:23.798 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.640301+0000", 2021-10-08T19:36:23.798 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2846e-05 2021-10-08T19:36:23.798 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.798 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.799 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:36:23.799 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.640308+0000", 2021-10-08T19:36:23.799 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.968e-06 2021-10-08T19:36:23.799 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.799 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.800 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:36:23.800 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.640372+0000", 2021-10-08T19:36:23.800 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3688000000000004e-05 2021-10-08T19:36:23.800 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.801 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.801 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:36:23.801 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.640567+0000", 2021-10-08T19:36:23.801 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019479499999999999 2021-10-08T19:36:23.801 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.802 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.802 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,5", 2021-10-08T19:36:23.802 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.640766+0000", 2021-10-08T19:36:23.802 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019947000000000001 2021-10-08T19:36:23.803 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.803 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.803 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:36:23.803 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.649679+0000", 2021-10-08T19:36:23.803 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0089129459999999997 2021-10-08T19:36:23.804 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.804 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.804 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:36:23.804 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.649725+0000", 2021-10-08T19:36:23.804 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5507000000000003e-05 2021-10-08T19:36:23.805 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.805 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.805 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:36:23.805 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.755195+0000", 2021-10-08T19:36:23.806 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.105470035 2021-10-08T19:36:23.806 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.806 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.806 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:36:23.807 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.755255+0000", 2021-10-08T19:36:23.807 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9837999999999999e-05 2021-10-08T19:36:23.807 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.807 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.808 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:36:23.808 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.755302+0000", 2021-10-08T19:36:23.808 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7475999999999997e-05 2021-10-08T19:36:23.808 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:36:23.809 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:36:23.809 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:36:23.809 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.809 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.809 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15870.0:77038 10.3 10:c6222104:::benchmark_data_smithi097_245820_object77037:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e380)", 2021-10-08T19:36:23.810 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:36:15.640339+0000", 2021-10-08T19:36:23.810 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 7.871096283, 2021-10-08T19:36:23.810 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.115825724, 2021-10-08T19:36:23.810 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:36:23.811 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:36:23.811 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:36:23.811 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15870", 2021-10-08T19:36:23.811 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1128006081", 2021-10-08T19:36:23.812 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 77038 2021-10-08T19:36:23.812 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.812 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:36:23.812 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.813 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:36:23.813 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.640339+0000", 2021-10-08T19:36:23.813 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:36:23.813 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.814 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.814 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:36:23.814 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.640339+0000", 2021-10-08T19:36:23.814 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:36:23.815 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.815 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.815 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:36:23.815 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.640338+0000", 2021-10-08T19:36:23.815 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:36:23.816 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.816 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.816 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:36:23.816 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.640370+0000", 2021-10-08T19:36:23.817 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1640000000000002e-05 2021-10-08T19:36:23.817 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.817 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.817 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:36:23.817 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.640378+0000", 2021-10-08T19:36:23.818 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0709999999999995e-06 2021-10-08T19:36:23.818 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.818 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.818 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:36:23.819 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.640383+0000", 2021-10-08T19:36:23.819 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1410000000000004e-06 2021-10-08T19:36:23.819 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.819 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.819 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:36:23.820 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.643495+0000", 2021-10-08T19:36:23.820 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031117129999999999 2021-10-08T19:36:23.820 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.820 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.821 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:36:23.821 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.643645+0000", 2021-10-08T19:36:23.821 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014964000000000001 2021-10-08T19:36:23.821 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.821 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.822 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,5", 2021-10-08T19:36:23.822 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.643801+0000", 2021-10-08T19:36:23.822 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000156756 2021-10-08T19:36:23.822 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.823 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.823 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:36:23.823 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.649686+0000", 2021-10-08T19:36:23.823 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.005884991 2021-10-08T19:36:23.823 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.824 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.824 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:36:23.824 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.651543+0000", 2021-10-08T19:36:23.824 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0018564810000000001 2021-10-08T19:36:23.825 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.825 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.825 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:36:23.825 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.756075+0000", 2021-10-08T19:36:23.825 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.10453229 2021-10-08T19:36:23.826 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.826 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.826 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:36:23.826 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.756129+0000", 2021-10-08T19:36:23.827 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3538000000000001e-05 2021-10-08T19:36:23.827 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.827 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.827 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:36:23.827 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.756165+0000", 2021-10-08T19:36:23.828 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6489000000000002e-05 2021-10-08T19:36:23.828 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:36:23.828 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:36:23.828 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:36:23.829 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.829 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.829 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15870.0:77039 10.3 10:c3abcd0c:::benchmark_data_smithi097_245820_object77038:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e380)", 2021-10-08T19:36:23.829 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:36:15.640400+0000", 2021-10-08T19:36:23.829 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 7.8710360100000001, 2021-10-08T19:36:23.830 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.11587955, 2021-10-08T19:36:23.830 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:36:23.830 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:36:23.830 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:36:23.831 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15870", 2021-10-08T19:36:23.831 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1128006081", 2021-10-08T19:36:23.831 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 77039 2021-10-08T19:36:23.831 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.831 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:36:23.832 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.832 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:36:23.832 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.640400+0000", 2021-10-08T19:36:23.832 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:36:23.833 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.833 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.833 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:36:23.833 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.640400+0000", 2021-10-08T19:36:23.833 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:36:23.834 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.834 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.834 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:36:23.834 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.640399+0000", 2021-10-08T19:36:23.835 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:36:23.835 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.835 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.835 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:36:23.835 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.640447+0000", 2021-10-08T19:36:23.836 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7772000000000003e-05 2021-10-08T19:36:23.836 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.836 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.836 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:36:23.837 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.640453+0000", 2021-10-08T19:36:23.837 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6930000000000001e-06 2021-10-08T19:36:23.837 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.837 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.837 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:36:23.838 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.640458+0000", 2021-10-08T19:36:23.838 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.527e-06 2021-10-08T19:36:23.838 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.838 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.838 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:36:23.839 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.646640+0000", 2021-10-08T19:36:23.839 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0061818869999999996 2021-10-08T19:36:23.839 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.839 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.840 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:36:23.840 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.646771+0000", 2021-10-08T19:36:23.840 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013076 2021-10-08T19:36:23.840 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.840 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.841 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,5", 2021-10-08T19:36:23.841 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.646918+0000", 2021-10-08T19:36:23.841 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014724900000000001 2021-10-08T19:36:23.841 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.842 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.842 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:36:23.842 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.651569+0000", 2021-10-08T19:36:23.842 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0046515050000000002 2021-10-08T19:36:23.842 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.843 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.843 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:36:23.843 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.755329+0000", 2021-10-08T19:36:23.843 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.103759221 2021-10-08T19:36:23.844 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.844 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.844 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:36:23.844 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.756201+0000", 2021-10-08T19:36:23.844 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00087212900000000002 2021-10-08T19:36:23.845 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.845 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.845 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:36:23.845 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.756245+0000", 2021-10-08T19:36:23.845 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4709000000000002e-05 2021-10-08T19:36:23.846 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.846 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.846 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:36:23.846 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.756279+0000", 2021-10-08T19:36:23.847 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3927999999999998e-05 2021-10-08T19:36:23.847 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:36:23.847 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:36:23.847 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:36:23.847 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.848 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.848 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.15870.0:77050 10.e e380/355 10:71a84a26:::benchmark_data_smithi097_245820_object77049:head v 380'4836, mlcod=380'4833)", 2021-10-08T19:36:23.848 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:36:15.648759+0000", 2021-10-08T19:36:23.848 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 7.8626770500000003, 2021-10-08T19:36:23.849 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.118860483, 2021-10-08T19:36:23.849 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:36:23.849 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:36:23.849 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:36:23.849 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.850 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:36:23.850 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.648759+0000", 2021-10-08T19:36:23.850 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:36:23.850 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.851 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.851 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:36:23.851 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.648759+0000", 2021-10-08T19:36:23.851 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:36:23.851 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.852 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.852 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:36:23.852 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.648757+0000", 2021-10-08T19:36:23.852 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2021-10-08T19:36:23.853 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.853 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.853 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:36:23.853 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.648813+0000", 2021-10-08T19:36:23.853 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5795999999999999e-05 2021-10-08T19:36:23.854 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.854 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.854 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:36:23.854 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.648824+0000", 2021-10-08T19:36:23.855 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1018e-05 2021-10-08T19:36:23.855 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.855 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.855 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:36:23.855 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.648830+0000", 2021-10-08T19:36:23.856 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7540000000000003e-06 2021-10-08T19:36:23.856 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.856 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.856 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:36:23.857 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.648908+0000", 2021-10-08T19:36:23.857 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8258999999999997e-05 2021-10-08T19:36:23.857 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.857 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.857 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:36:23.858 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.648928+0000", 2021-10-08T19:36:23.858 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0355000000000001e-05 2021-10-08T19:36:23.858 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.858 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.859 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:36:23.859 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.767579+0000", 2021-10-08T19:36:23.859 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.118650228 2021-10-08T19:36:23.859 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.859 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.860 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:36:23.860 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.767619+0000", 2021-10-08T19:36:23.860 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0472000000000001e-05 2021-10-08T19:36:23.860 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:36:23.861 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:36:23.861 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:36:23.861 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.861 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.861 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop_reply(client.15870.0:77036 10.3 e380/355 ondisk, result = 0)", 2021-10-08T19:36:23.862 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:36:15.652369+0000", 2021-10-08T19:36:23.862 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 7.8590665849999999, 2021-10-08T19:36:23.863 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.102939691, 2021-10-08T19:36:23.863 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:36:23.863 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2021-10-08T19:36:23.863 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:36:23.864 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.864 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:36:23.864 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.652369+0000", 2021-10-08T19:36:23.864 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:36:23.864 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.865 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.865 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:36:23.865 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.652369+0000", 2021-10-08T19:36:23.865 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:36:23.866 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.866 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.866 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:36:23.866 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.652368+0000", 2021-10-08T19:36:23.866 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:36:23.867 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.867 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.867 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:36:23.867 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.652373+0000", 2021-10-08T19:36:23.868 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.186e-06 2021-10-08T19:36:23.868 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.868 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.868 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:36:23.868 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.652388+0000", 2021-10-08T19:36:23.869 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4463e-05 2021-10-08T19:36:23.869 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.869 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.869 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:36:23.870 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.652394+0000", 2021-10-08T19:36:23.870 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7749999999999998e-06 2021-10-08T19:36:23.870 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.870 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.870 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:36:23.871 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.755175+0000", 2021-10-08T19:36:23.871 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.102781261 2021-10-08T19:36:23.871 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.871 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.872 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:36:23.872 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.755186+0000", 2021-10-08T19:36:23.872 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.113e-05 2021-10-08T19:36:23.872 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.872 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.873 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:36:23.873 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.755309+0000", 2021-10-08T19:36:23.873 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012295900000000001 2021-10-08T19:36:23.873 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:36:23.874 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:36:23.874 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:36:23.874 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.874 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.874 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.15870.0:77052 10.e e380/355 10:7fe7df30:::benchmark_data_smithi097_245820_object77051:head v 380'4837, mlcod=380'4833)", 2021-10-08T19:36:23.875 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:36:15.652673+0000", 2021-10-08T19:36:23.875 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 7.8587624470000002, 2021-10-08T19:36:23.875 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.114975929, 2021-10-08T19:36:23.875 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:36:23.876 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:36:23.876 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:36:23.876 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.876 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:36:23.876 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.652673+0000", 2021-10-08T19:36:23.877 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:36:23.877 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.877 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.877 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:36:23.878 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.652673+0000", 2021-10-08T19:36:23.878 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:36:23.878 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.878 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.878 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:36:23.879 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.652672+0000", 2021-10-08T19:36:23.879 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:36:23.879 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.879 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.880 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:36:23.880 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.652789+0000", 2021-10-08T19:36:23.880 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011682499999999999 2021-10-08T19:36:23.880 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.880 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.881 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:36:23.881 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.755154+0000", 2021-10-08T19:36:23.881 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.10236469600000001 2021-10-08T19:36:23.881 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.882 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.882 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:36:23.882 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.755166+0000", 2021-10-08T19:36:23.882 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1833e-05 2021-10-08T19:36:23.882 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.883 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.883 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:36:23.883 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.755629+0000", 2021-10-08T19:36:23.883 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00046354600000000001 2021-10-08T19:36:23.883 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.884 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.884 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:36:23.884 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.755651+0000", 2021-10-08T19:36:23.884 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1858e-05 2021-10-08T19:36:23.885 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.885 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.885 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:36:23.885 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.767624+0000", 2021-10-08T19:36:23.885 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011973262 2021-10-08T19:36:23.886 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:36:23.886 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:36:23.886 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:36:23.886 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:36:15.767649+0000", 2021-10-08T19:36:23.887 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5060000000000001e-05 2021-10-08T19:36:23.887 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:36:23.887 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:36:23.887 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:36:23.887 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:36:23.888 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:36:23.888 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:36:23.888 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:36:23.889 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:36:23 smithi117 conmon[69189]: level=error ts=2021-10-08T19:36:23.505Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=2 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:36:23.929 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:24.017 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:36:24.018 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:24.019 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:36:24.078 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:36:24.079 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:36:24.085 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:36:24.119 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:36:24.131 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:36:24.147 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:36:23 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:36:23] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:36:24.148 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:24.173 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:36:24.205 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:36:24.228 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:36:24.231 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:24.232 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:36:24.237 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:36:24.273 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:36:24.274 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'false' 2021-10-08T19:36:24.274 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'false' 2021-10-08T19:36:24.274 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'false' 2021-10-08T19:36:24.275 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'false' 2021-10-08T19:36:24.275 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'false' 2021-10-08T19:36:24.275 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'false' 2021-10-08T19:36:24.275 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'false' 2021-10-08T19:36:24.275 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'false' 2021-10-08T19:36:24.332 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:36:24.371 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:24.394 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 58 16 86204 86188 92.8082 66.25 0.0154585 0.0107692 2021-10-08T19:36:24.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:24 smithi117 ceph-mon[34585]: pgmap v754: 178 pgs: 178 active+clean; 4.9 GiB data, 17 GiB used, 699 GiB / 715 GiB avail; 852 B/s rd, 53 MiB/s wr, 841 op/s 2021-10-08T19:36:24.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:24 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2715582389' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:36:24.453 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:36:24.458 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:24.459 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:36:24.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:24 smithi097 ceph-mon[32687]: pgmap v754: 178 pgs: 178 active+clean; 4.9 GiB data, 17 GiB used, 699 GiB / 715 GiB avail; 852 B/s rd, 53 MiB/s wr, 841 op/s 2021-10-08T19:36:24.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:24 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2715582389' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:36:24.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:24 smithi097 ceph-mon[41966]: pgmap v754: 178 pgs: 178 active+clean; 4.9 GiB data, 17 GiB used, 699 GiB / 715 GiB avail; 852 B/s rd, 53 MiB/s wr, 841 op/s 2021-10-08T19:36:24.474 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:24 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2715582389' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:36:24.560 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:36:24.605 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:24.703 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:36:24.708 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:24.709 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:36:24.810 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:36:24.851 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:24.891 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:36:24.892 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:24.897 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:36:24.999 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:36:25.028 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:25.110 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2021-10-08T19:36:25.111 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:36:25.113 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:25.114 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:36:25.218 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:36:25.270 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:25.340 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:36:25.346 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:25.347 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:36:25.392 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 59 16 87213 87197 92.3043 63.0625 0.0240813 0.0108288 2021-10-08T19:36:25.448 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:36:25.488 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:25.552 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:36:25.557 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:25.558 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:36:25.659 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:36:25.730 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:25.811 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:36:25.830 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:36:25.840 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:25.840 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:36:25.942 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:36:26.000 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:26.393 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:2021-10-08T19:36:26.393100+0000 min lat: 0.00140955 max lat: 0.227624 avg lat: 0.0108806 2021-10-08T19:36:26.394 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2021-10-08T19:36:26.394 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 60 16 88270 88254 91.8656 66.0625 0.00895171 0.0108806 2021-10-08T19:36:26.410 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:36:26.416 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:26 smithi097 ceph-mon[32687]: pgmap v755: 178 pgs: 178 active+clean; 5.2 GiB data, 18 GiB used, 698 GiB / 715 GiB avail; 1.5 KiB/s rd, 96 MiB/s wr, 1.53k op/s 2021-10-08T19:36:26.416 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:26 smithi097 ceph-mon[41966]: pgmap v755: 178 pgs: 178 active+clean; 5.2 GiB data, 18 GiB used, 698 GiB / 715 GiB avail; 1.5 KiB/s rd, 96 MiB/s wr, 1.53k op/s 2021-10-08T19:36:26.417 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:26.418 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:36:26.519 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:36:26.567 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:26.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:26 smithi117 ceph-mon[34585]: pgmap v755: 178 pgs: 178 active+clean; 5.2 GiB data, 18 GiB used, 698 GiB / 715 GiB avail; 1.5 KiB/s rd, 96 MiB/s wr, 1.53k op/s 2021-10-08T19:36:27.075 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:36:27.078 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:27.079 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:36:27.180 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:36:27.226 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:27.303 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:36:27.308 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:27.309 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:36:27 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:36:27.310 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:36:27.343 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2021-10-08T19:36:27.393 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 61 16 89424 89408 91.542 72.125 0.00624144 0.0109197 2021-10-08T19:36:27.410 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:36:27.451 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:27.528 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:36:27.531 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:27.531 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:36:27.632 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:36:27.703 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:27.815 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:36:27.830 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:27.831 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:36:27.931 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:36:27.982 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:28.317 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:36:28.331 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:36:28.340 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:28.341 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:36:28.393 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 62 16 90338 90322 90.9872 57.125 0.0126804 0.010987 2021-10-08T19:36:28.442 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:36:28.469 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:28 smithi117 ceph-mon[34585]: pgmap v756: 178 pgs: 178 active+clean; 5.2 GiB data, 18 GiB used, 698 GiB / 715 GiB avail; 639 B/s rd, 59 MiB/s wr, 945 op/s 2021-10-08T19:36:28.470 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:28 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:36:28.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:28 smithi097 ceph-mon[32687]: pgmap v756: 178 pgs: 178 active+clean; 5.2 GiB data, 18 GiB used, 698 GiB / 715 GiB avail; 639 B/s rd, 59 MiB/s wr, 945 op/s 2021-10-08T19:36:28.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:28 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:36:28.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:28 smithi097 ceph-mon[41966]: pgmap v756: 178 pgs: 178 active+clean; 5.2 GiB data, 18 GiB used, 698 GiB / 715 GiB avail; 639 B/s rd, 59 MiB/s wr, 945 op/s 2021-10-08T19:36:28.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:28 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:36:28.473 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:28.549 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:36:28.551 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:28.553 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:36:28.653 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:36:28.678 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:36:28.683 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2021-10-08T19:36:28.720 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:29.246 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is set 2021-10-08T19:36:29.393 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 63 16 91444 91428 90.6403 69.125 0.00760968 0.0110278 2021-10-08T19:36:29.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:29 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2593179789' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:36:29.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:29 smithi117 ceph-mon[34585]: from='client.35921 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:36:29.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:29 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2593179789' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:36:29.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:29 smithi097 ceph-mon[41966]: from='client.35921 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:36:29.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:29 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2593179789' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:36:29.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:29 smithi097 ceph-mon[32687]: from='client.35921 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:36:29.860 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:36:29.862 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:29.863 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:36:29.920 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":756,"stamp":"2021-10-08T19:36:26.847998+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5611264196,"num_objects":85806,"num_object_clones":0,"num_object_copies":257418,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85806,"num_whiteouts":0,"num_read":1861,"num_read_kb":1618,"num_write":86322,"num_write_kb":5479208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":534,"num_bytes_recovered":12006,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":77366,"ondisk_log_size":77366,"up":534,"acting":534,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":534,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":18520112,"kb_used_data":16359096,"kb_used_omap":0,"kb_used_meta":2159872,"kb_avail":731441104,"statfs":{"total":767960285184,"available":748995690496,"internally_reserved":0,"allocated":16751714304,"data_stored":16748805164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2211708928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,3,6,4,5,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":495845376,"num_objects":7566,"num_object_clones":0,"num_object_copies":22698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7566,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":7566,"num_write_kb":484224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.004518"},"pg_stats":[{"pgid":"10.6","version":"384'5422","reported_seq":5459,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:23.593598+0000","last_change":"2021-10-08T19:35:16.782994+0000","last_active":"2021-10-08T19:36:23.593598+0000","last_peered":"2021-10-08T19:36:23.593598+0000","last_clean":"2021-10-08T19:36:23.593598+0000","last_became_active":"2021-10-08T19:35:16.782658+0000","last_became_peered":"2021-10-08T19:35:16.782658+0000","last_unstale":"2021-10-08T19:36:23.593598+0000","last_undegraded":"2021-10-08T19:36:23.593598+0000","last_fullsized":"2021-10-08T19:36:23.593598+0000","mapping_epoch":355,"log_start":"361'700","ondisk_log_start":"361'700","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:35:15.759693+0000","log_size":4722,"ondisk_log_size":4722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":355336192,"num_objects":5422,"num_object_clones":0,"num_object_copies":16266,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5422,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5422,"num_write_kb":347008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4],"acting":[5,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"114'10","reported_seq":567,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.144104+0000","last_change":"2021-10-08T19:34:14.586366+0000","last_active":"2021-10-08T19:36:21.144104+0000","last_peered":"2021-10-08T19:36:21.144104+0000","last_clean":"2021-10-08T19:36:21.144104+0000","last_became_active":"2021-10-08T19:24:25.096162+0000","last_became_peered":"2021-10-08T19:24:25.096162+0000","last_unstale":"2021-10-08T19:36:21.144104+0000","last_undegraded":"2021-10-08T19:36:21.144104+0000","last_fullsized":"2021-10-08T19:36:21.144104+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'10","last_scrub_stamp":"2021-10-08T19:34:14.586030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:34:14.586030+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034352250000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"289'34","reported_seq":150,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.121815+0000","last_change":"2021-10-08T19:33:23.562208+0000","last_active":"2021-10-08T19:36:19.121815+0000","last_peered":"2021-10-08T19:36:19.121815+0000","last_clean":"2021-10-08T19:36:19.121815+0000","last_became_active":"2021-10-08T19:31:22.787271+0000","last_became_peered":"2021-10-08T19:31:22.787271+0000","last_unstale":"2021-10-08T19:36:19.121815+0000","last_undegraded":"2021-10-08T19:36:19.121815+0000","last_fullsized":"2021-10-08T19:36:19.121815+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'34","last_scrub_stamp":"2021-10-08T19:33:23.562083+0000","last_deep_scrub":"87'22","last_deep_scrub_stamp":"2021-10-08T19:22:58.705632+0000","last_clean_scrub_stamp":"2021-10-08T19:33:23.562083+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011294012000000001,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":390,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.119717+0000","last_change":"2021-10-08T19:36:06.093016+0000","last_active":"2021-10-08T19:36:19.119717+0000","last_peered":"2021-10-08T19:36:19.119717+0000","last_clean":"2021-10-08T19:36:19.119717+0000","last_became_active":"2021-10-08T19:29:40.632678+0000","last_became_peered":"2021-10-08T19:29:40.632678+0000","last_unstale":"2021-10-08T19:36:19.119717+0000","last_undegraded":"2021-10-08T19:36:19.119717+0000","last_fullsized":"2021-10-08T19:36:19.119717+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:06.092943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:06.092943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0048028580000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":367,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.123442+0000","last_change":"2021-10-08T19:36:00.572697+0000","last_active":"2021-10-08T19:36:19.123442+0000","last_peered":"2021-10-08T19:36:19.123442+0000","last_clean":"2021-10-08T19:36:19.123442+0000","last_became_active":"2021-10-08T19:24:25.089002+0000","last_became_peered":"2021-10-08T19:24:25.089002+0000","last_unstale":"2021-10-08T19:36:19.123442+0000","last_undegraded":"2021-10-08T19:36:19.123442+0000","last_fullsized":"2021-10-08T19:36:19.123442+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:00.572589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:08.936801+0000","last_clean_scrub_stamp":"2021-10-08T19:36:00.572589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.031713926000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":290,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.129442+0000","last_change":"2021-10-08T19:36:04.907070+0000","last_active":"2021-10-08T19:36:19.129442+0000","last_peered":"2021-10-08T19:36:19.129442+0000","last_clean":"2021-10-08T19:36:19.129442+0000","last_became_active":"2021-10-08T19:25:15.510457+0000","last_became_peered":"2021-10-08T19:25:15.510457+0000","last_unstale":"2021-10-08T19:36:19.129442+0000","last_undegraded":"2021-10-08T19:36:19.129442+0000","last_fullsized":"2021-10-08T19:36:19.129442+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:04.906938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:33:28.036266+0000","last_clean_scrub_stamp":"2021-10-08T19:36:04.906938+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0079401560000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"384'5342","reported_seq":5379,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:23.845019+0000","last_change":"2021-10-08T19:35:17.125078+0000","last_active":"2021-10-08T19:36:23.845019+0000","last_peered":"2021-10-08T19:36:23.845019+0000","last_clean":"2021-10-08T19:36:23.845019+0000","last_became_active":"2021-10-08T19:35:17.124786+0000","last_became_peered":"2021-10-08T19:35:17.124786+0000","last_unstale":"2021-10-08T19:36:23.845019+0000","last_undegraded":"2021-10-08T19:36:23.845019+0000","last_fullsized":"2021-10-08T19:36:23.845019+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:35:15.759693+0000","log_size":5342,"ondisk_log_size":5342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":350093312,"num_objects":5342,"num_object_clones":0,"num_object_copies":16026,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5342,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5342,"num_write_kb":341888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"337'19","reported_seq":427,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.124898+0000","last_change":"2021-10-08T19:36:17.162468+0000","last_active":"2021-10-08T19:36:19.124898+0000","last_peered":"2021-10-08T19:36:19.124898+0000","last_clean":"2021-10-08T19:36:19.124898+0000","last_became_active":"2021-10-08T19:28:40.159729+0000","last_became_peered":"2021-10-08T19:28:40.159729+0000","last_unstale":"2021-10-08T19:36:19.124898+0000","last_undegraded":"2021-10-08T19:36:19.124898+0000","last_fullsized":"2021-10-08T19:36:19.124898+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"337'19","last_scrub_stamp":"2021-10-08T19:36:17.162349+0000","last_deep_scrub":"337'19","last_deep_scrub_stamp":"2021-10-08T19:34:14.040249+0000","last_clean_scrub_stamp":"2021-10-08T19:36:17.162349+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.019723487000000001,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":226,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.128592+0000","last_change":"2021-10-08T19:34:52.700263+0000","last_active":"2021-10-08T19:36:19.128592+0000","last_peered":"2021-10-08T19:36:19.128592+0000","last_clean":"2021-10-08T19:36:19.128592+0000","last_became_active":"2021-10-08T19:29:40.624977+0000","last_became_peered":"2021-10-08T19:29:40.624977+0000","last_unstale":"2021-10-08T19:36:19.128592+0000","last_undegraded":"2021-10-08T19:36:19.128592+0000","last_fullsized":"2021-10-08T19:36:19.128592+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:52.700168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:52.700168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0094829509999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":376,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.122615+0000","last_change":"2021-10-08T19:34:57.000885+0000","last_active":"2021-10-08T19:36:19.122615+0000","last_peered":"2021-10-08T19:36:19.122615+0000","last_clean":"2021-10-08T19:36:19.122615+0000","last_became_active":"2021-10-08T19:29:40.629422+0000","last_became_peered":"2021-10-08T19:29:40.629422+0000","last_unstale":"2021-10-08T19:36:19.122615+0000","last_undegraded":"2021-10-08T19:36:19.122615+0000","last_fullsized":"2021-10-08T19:36:19.122615+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:57.000786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:34:57.000786+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0096958310000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":352,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.124858+0000","last_change":"2021-10-08T19:34:53.070243+0000","last_active":"2021-10-08T19:36:19.124858+0000","last_peered":"2021-10-08T19:36:19.124858+0000","last_clean":"2021-10-08T19:36:19.124858+0000","last_became_active":"2021-10-08T19:21:29.643022+0000","last_became_peered":"2021-10-08T19:21:29.643022+0000","last_unstale":"2021-10-08T19:36:19.124858+0000","last_undegraded":"2021-10-08T19:36:19.124858+0000","last_fullsized":"2021-10-08T19:36:19.124858+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:53.070138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:34:53.070138+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.076770236000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"70'5","reported_seq":1080,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:22.607311+0000","last_change":"2021-10-08T19:34:45.765175+0000","last_active":"2021-10-08T19:36:22.607311+0000","last_peered":"2021-10-08T19:36:22.607311+0000","last_clean":"2021-10-08T19:36:22.607311+0000","last_became_active":"2021-10-08T19:29:40.630821+0000","last_became_peered":"2021-10-08T19:29:40.630821+0000","last_unstale":"2021-10-08T19:36:22.607311+0000","last_undegraded":"2021-10-08T19:36:22.607311+0000","last_fullsized":"2021-10-08T19:36:22.607311+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:34:45.765074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:45.765074+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0069135860000000002,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":721,"num_read_kb":721,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1167,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.4","version":"384'5299","reported_seq":5336,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:24.057938+0000","last_change":"2021-10-08T19:35:17.124862+0000","last_active":"2021-10-08T19:36:24.057938+0000","last_peered":"2021-10-08T19:36:24.057938+0000","last_clean":"2021-10-08T19:36:24.057938+0000","last_became_active":"2021-10-08T19:35:17.124559+0000","last_became_peered":"2021-10-08T19:35:17.124559+0000","last_unstale":"2021-10-08T19:36:24.057938+0000","last_undegraded":"2021-10-08T19:36:24.057938+0000","last_fullsized":"2021-10-08T19:36:24.057938+0000","mapping_epoch":355,"log_start":"361'800","ondisk_log_start":"361'800","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:35:15.759693+0000","log_size":4499,"ondisk_log_size":4499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":347275264,"num_objects":5299,"num_object_clones":0,"num_object_copies":15897,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5299,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5299,"num_write_kb":339136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"289'35","reported_seq":415,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.122578+0000","last_change":"2021-10-08T19:35:57.653426+0000","last_active":"2021-10-08T19:36:19.122578+0000","last_peered":"2021-10-08T19:36:19.122578+0000","last_clean":"2021-10-08T19:36:19.122578+0000","last_became_active":"2021-10-08T19:28:40.101648+0000","last_became_peered":"2021-10-08T19:28:40.101648+0000","last_unstale":"2021-10-08T19:36:19.122578+0000","last_undegraded":"2021-10-08T19:36:19.122578+0000","last_fullsized":"2021-10-08T19:36:19.122578+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'35","last_scrub_stamp":"2021-10-08T19:35:57.653345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:35:57.653345+0000","log_size":35,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040502669999999998,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":55,"num_read_kb":44,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":368,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.119297+0000","last_change":"2021-10-08T19:35:58.075011+0000","last_active":"2021-10-08T19:36:19.119297+0000","last_peered":"2021-10-08T19:36:19.119297+0000","last_clean":"2021-10-08T19:36:19.119297+0000","last_became_active":"2021-10-08T19:21:23.595919+0000","last_became_peered":"2021-10-08T19:21:23.595919+0000","last_unstale":"2021-10-08T19:36:19.119297+0000","last_undegraded":"2021-10-08T19:36:19.119297+0000","last_fullsized":"2021-10-08T19:36:19.119297+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:58.074848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:58.074848+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0063866330000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":376,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.120598+0000","last_change":"2021-10-08T19:35:57.051876+0000","last_active":"2021-10-08T19:36:19.120598+0000","last_peered":"2021-10-08T19:36:19.120598+0000","last_clean":"2021-10-08T19:36:19.120598+0000","last_became_active":"2021-10-08T19:31:22.783725+0000","last_became_peered":"2021-10-08T19:31:22.783725+0000","last_unstale":"2021-10-08T19:36:19.120598+0000","last_undegraded":"2021-10-08T19:36:19.120598+0000","last_fullsized":"2021-10-08T19:36:19.120598+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:57.051759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:35:57.051759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0084059809999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":368,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.125234+0000","last_change":"2021-10-08T19:34:20.691431+0000","last_active":"2021-10-08T19:36:19.125234+0000","last_peered":"2021-10-08T19:36:19.125234+0000","last_clean":"2021-10-08T19:36:19.125234+0000","last_became_active":"2021-10-08T19:29:40.638354+0000","last_became_peered":"2021-10-08T19:29:40.638354+0000","last_unstale":"2021-10-08T19:36:19.125234+0000","last_undegraded":"2021-10-08T19:36:19.125234+0000","last_fullsized":"2021-10-08T19:36:19.125234+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:20.691312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:39.528699+0000","last_clean_scrub_stamp":"2021-10-08T19:34:20.691312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0054161239999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":301,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.126507+0000","last_change":"2021-10-08T19:35:58.023652+0000","last_active":"2021-10-08T19:36:19.126507+0000","last_peered":"2021-10-08T19:36:19.126507+0000","last_clean":"2021-10-08T19:36:19.126507+0000","last_became_active":"2021-10-08T19:31:22.785590+0000","last_became_peered":"2021-10-08T19:31:22.785590+0000","last_unstale":"2021-10-08T19:36:19.126507+0000","last_undegraded":"2021-10-08T19:36:19.126507+0000","last_fullsized":"2021-10-08T19:36:19.126507+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:58.023581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:58.023581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0070639609999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3","version":"384'5447","reported_seq":5484,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:23.780079+0000","last_change":"2021-10-08T19:35:17.124080+0000","last_active":"2021-10-08T19:36:23.780079+0000","last_peered":"2021-10-08T19:36:23.780079+0000","last_clean":"2021-10-08T19:36:23.780079+0000","last_became_active":"2021-10-08T19:35:17.123799+0000","last_became_peered":"2021-10-08T19:35:17.123799+0000","last_unstale":"2021-10-08T19:36:23.780079+0000","last_undegraded":"2021-10-08T19:36:23.780079+0000","last_fullsized":"2021-10-08T19:36:23.780079+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:35:15.759693+0000","log_size":5447,"ondisk_log_size":5447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":356974592,"num_objects":5447,"num_object_clones":0,"num_object_copies":16341,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5447,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5447,"num_write_kb":348608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.8","version":"90'130","reported_seq":466,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.121662+0000","last_change":"2021-10-08T19:34:44.803061+0000","last_active":"2021-10-08T19:36:19.121662+0000","last_peered":"2021-10-08T19:36:19.121662+0000","last_clean":"2021-10-08T19:36:19.121662+0000","last_became_active":"2021-10-08T19:31:25.647505+0000","last_became_peered":"2021-10-08T19:31:25.647505+0000","last_unstale":"2021-10-08T19:36:19.121662+0000","last_undegraded":"2021-10-08T19:36:19.121662+0000","last_fullsized":"2021-10-08T19:36:19.121662+0000","mapping_epoch":286,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":287,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:34:44.802994+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:34:44.802994+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.016276585,"stat_sum":{"num_bytes":262688,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"289'31","reported_seq":456,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.120213+0000","last_change":"2021-10-08T19:35:26.152730+0000","last_active":"2021-10-08T19:36:19.120213+0000","last_peered":"2021-10-08T19:36:19.120213+0000","last_clean":"2021-10-08T19:36:19.120213+0000","last_became_active":"2021-10-08T19:28:40.099618+0000","last_became_peered":"2021-10-08T19:28:40.099618+0000","last_unstale":"2021-10-08T19:36:19.120213+0000","last_undegraded":"2021-10-08T19:36:19.120213+0000","last_fullsized":"2021-10-08T19:36:19.120213+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'31","last_scrub_stamp":"2021-10-08T19:35:26.152640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:35:26.152640+0000","log_size":31,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0031552659999999999,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":50,"num_read_kb":40,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"61'1","reported_seq":364,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.126263+0000","last_change":"2021-10-08T19:35:22.904758+0000","last_active":"2021-10-08T19:36:19.126263+0000","last_peered":"2021-10-08T19:36:19.126263+0000","last_clean":"2021-10-08T19:36:19.126263+0000","last_became_active":"2021-10-08T19:21:23.607064+0000","last_became_peered":"2021-10-08T19:21:23.607064+0000","last_unstale":"2021-10-08T19:36:19.126263+0000","last_undegraded":"2021-10-08T19:36:19.126263+0000","last_fullsized":"2021-10-08T19:36:19.126263+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'1","last_scrub_stamp":"2021-10-08T19:35:22.904628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:22.904628+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0051040089999999996,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":208,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.128408+0000","last_change":"2021-10-08T19:35:25.704060+0000","last_active":"2021-10-08T19:36:19.128408+0000","last_peered":"2021-10-08T19:36:19.128408+0000","last_clean":"2021-10-08T19:36:19.128408+0000","last_became_active":"2021-10-08T19:28:40.152478+0000","last_became_peered":"2021-10-08T19:28:40.152478+0000","last_unstale":"2021-10-08T19:36:19.128408+0000","last_undegraded":"2021-10-08T19:36:19.128408+0000","last_fullsized":"2021-10-08T19:36:19.128408+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:25.703955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:30:09.081635+0000","last_clean_scrub_stamp":"2021-10-08T19:35:25.703955+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0021998410000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":376,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.119843+0000","last_change":"2021-10-08T19:35:20.102212+0000","last_active":"2021-10-08T19:36:19.119843+0000","last_peered":"2021-10-08T19:36:19.119843+0000","last_clean":"2021-10-08T19:36:19.119843+0000","last_became_active":"2021-10-08T19:29:40.629424+0000","last_became_peered":"2021-10-08T19:29:40.629424+0000","last_unstale":"2021-10-08T19:36:19.119843+0000","last_undegraded":"2021-10-08T19:36:19.119843+0000","last_fullsized":"2021-10-08T19:36:19.119843+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:20.102116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:35:20.102116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.075222543000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":340,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.122770+0000","last_change":"2021-10-08T19:35:16.628777+0000","last_active":"2021-10-08T19:36:19.122770+0000","last_peered":"2021-10-08T19:36:19.122770+0000","last_clean":"2021-10-08T19:36:19.122770+0000","last_became_active":"2021-10-08T19:31:51.676829+0000","last_became_peered":"2021-10-08T19:31:51.676829+0000","last_unstale":"2021-10-08T19:36:19.122770+0000","last_undegraded":"2021-10-08T19:36:19.122770+0000","last_fullsized":"2021-10-08T19:36:19.122770+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:16.628688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:16.628688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0015118340000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"384'5414","reported_seq":5451,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:24.142058+0000","last_change":"2021-10-08T19:35:16.780327+0000","last_active":"2021-10-08T19:36:24.142058+0000","last_peered":"2021-10-08T19:36:24.142058+0000","last_clean":"2021-10-08T19:36:24.142058+0000","last_became_active":"2021-10-08T19:35:16.780016+0000","last_became_peered":"2021-10-08T19:35:16.780016+0000","last_unstale":"2021-10-08T19:36:24.142058+0000","last_undegraded":"2021-10-08T19:36:24.142058+0000","last_fullsized":"2021-10-08T19:36:24.142058+0000","mapping_epoch":355,"log_start":"361'600","ondisk_log_start":"361'600","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:35:15.759693+0000","log_size":4814,"ondisk_log_size":4814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":354811904,"num_objects":5414,"num_object_clones":0,"num_object_copies":16242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5414,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5414,"num_write_kb":346496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.9","version":"90'130","reported_seq":704,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.125886+0000","last_change":"2021-10-08T19:35:20.911809+0000","last_active":"2021-10-08T19:36:19.125886+0000","last_peered":"2021-10-08T19:36:19.125886+0000","last_clean":"2021-10-08T19:36:19.125886+0000","last_became_active":"2021-10-08T19:29:43.634789+0000","last_became_peered":"2021-10-08T19:29:43.634789+0000","last_unstale":"2021-10-08T19:36:19.125886+0000","last_undegraded":"2021-10-08T19:36:19.125886+0000","last_fullsized":"2021-10-08T19:36:19.125886+0000","mapping_epoch":239,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:35:20.911733+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:35:20.911733+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0029675249999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"289'20","reported_seq":467,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.118889+0000","last_change":"2021-10-08T19:35:19.156261+0000","last_active":"2021-10-08T19:36:19.118889+0000","last_peered":"2021-10-08T19:36:19.118889+0000","last_clean":"2021-10-08T19:36:19.118889+0000","last_became_active":"2021-10-08T19:29:40.631807+0000","last_became_peered":"2021-10-08T19:29:40.631807+0000","last_unstale":"2021-10-08T19:36:19.118889+0000","last_undegraded":"2021-10-08T19:36:19.118889+0000","last_fullsized":"2021-10-08T19:36:19.118889+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'20","last_scrub_stamp":"2021-10-08T19:35:19.156174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:35:19.156174+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039866930000000004,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":228,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.130578+0000","last_change":"2021-10-08T19:35:18.712034+0000","last_active":"2021-10-08T19:36:19.130578+0000","last_peered":"2021-10-08T19:36:19.130578+0000","last_clean":"2021-10-08T19:36:19.130578+0000","last_became_active":"2021-10-08T19:29:40.638988+0000","last_became_peered":"2021-10-08T19:29:40.638988+0000","last_unstale":"2021-10-08T19:36:19.130578+0000","last_undegraded":"2021-10-08T19:36:19.130578+0000","last_fullsized":"2021-10-08T19:36:19.130578+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:18.711965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:18.711965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0014885569999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"250'9","reported_seq":555,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.143139+0000","last_change":"2021-10-08T19:36:05.056752+0000","last_active":"2021-10-08T19:36:21.143139+0000","last_peered":"2021-10-08T19:36:21.143139+0000","last_clean":"2021-10-08T19:36:21.143139+0000","last_became_active":"2021-10-08T19:21:27.637930+0000","last_became_peered":"2021-10-08T19:21:27.637930+0000","last_unstale":"2021-10-08T19:36:21.143139+0000","last_undegraded":"2021-10-08T19:36:21.143139+0000","last_fullsized":"2021-10-08T19:36:21.143139+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'9","last_scrub_stamp":"2021-10-08T19:36:05.056649+0000","last_deep_scrub":"250'9","last_deep_scrub_stamp":"2021-10-08T19:30:04.239189+0000","last_clean_scrub_stamp":"2021-10-08T19:36:05.056649+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0049163460000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":367,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.119223+0000","last_change":"2021-10-08T19:34:55.383199+0000","last_active":"2021-10-08T19:36:19.119223+0000","last_peered":"2021-10-08T19:36:19.119223+0000","last_clean":"2021-10-08T19:36:19.119223+0000","last_became_active":"2021-10-08T19:28:40.100213+0000","last_became_peered":"2021-10-08T19:28:40.100213+0000","last_unstale":"2021-10-08T19:36:19.119223+0000","last_undegraded":"2021-10-08T19:36:19.119223+0000","last_fullsized":"2021-10-08T19:36:19.119223+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:55.383084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:34:55.383084+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.017427761999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":168,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.122167+0000","last_change":"2021-10-08T19:36:15.769584+0000","last_active":"2021-10-08T19:36:19.122167+0000","last_peered":"2021-10-08T19:36:19.122167+0000","last_clean":"2021-10-08T19:36:19.122167+0000","last_became_active":"2021-10-08T19:29:44.443507+0000","last_became_peered":"2021-10-08T19:29:44.443507+0000","last_unstale":"2021-10-08T19:36:19.122167+0000","last_undegraded":"2021-10-08T19:36:19.122167+0000","last_fullsized":"2021-10-08T19:36:19.122167+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:15.769469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:15.769469+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0068300569999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"384'5473","reported_seq":5510,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:24.492832+0000","last_change":"2021-10-08T19:35:16.778534+0000","last_active":"2021-10-08T19:36:24.492832+0000","last_peered":"2021-10-08T19:36:24.492832+0000","last_clean":"2021-10-08T19:36:24.492832+0000","last_became_active":"2021-10-08T19:35:16.778182+0000","last_became_peered":"2021-10-08T19:35:16.778182+0000","last_unstale":"2021-10-08T19:36:24.492832+0000","last_undegraded":"2021-10-08T19:36:24.492832+0000","last_fullsized":"2021-10-08T19:36:24.492832+0000","mapping_epoch":355,"log_start":"363'1400","ondisk_log_start":"363'1400","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:35:15.759693+0000","log_size":4073,"ondisk_log_size":4073,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":358678528,"num_objects":5473,"num_object_clones":0,"num_object_copies":16419,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5473,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5473,"num_write_kb":350272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,0],"acting":[4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.a","version":"90'130","reported_seq":532,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.123322+0000","last_change":"2021-10-08T19:34:11.489040+0000","last_active":"2021-10-08T19:36:19.123322+0000","last_peered":"2021-10-08T19:36:19.123322+0000","last_clean":"2021-10-08T19:36:19.123322+0000","last_became_active":"2021-10-08T19:27:26.591129+0000","last_became_peered":"2021-10-08T19:27:26.591129+0000","last_unstale":"2021-10-08T19:36:19.123322+0000","last_undegraded":"2021-10-08T19:36:19.123322+0000","last_fullsized":"2021-10-08T19:36:19.123322+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:34:11.488938+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:34:11.488938+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0022431069999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.f","version":"289'27","reported_seq":110,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.119653+0000","last_change":"2021-10-08T19:36:12.961210+0000","last_active":"2021-10-08T19:36:19.119653+0000","last_peered":"2021-10-08T19:36:19.119653+0000","last_clean":"2021-10-08T19:36:19.119653+0000","last_became_active":"2021-10-08T19:32:45.162914+0000","last_became_peered":"2021-10-08T19:32:45.162914+0000","last_unstale":"2021-10-08T19:36:19.119653+0000","last_undegraded":"2021-10-08T19:36:19.119653+0000","last_fullsized":"2021-10-08T19:36:19.119653+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'27","last_scrub_stamp":"2021-10-08T19:36:12.961130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:12.961130+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0063489530000000001,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":550,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":226,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.128168+0000","last_change":"2021-10-08T19:35:19.757453+0000","last_active":"2021-10-08T19:36:19.128168+0000","last_peered":"2021-10-08T19:36:19.128168+0000","last_clean":"2021-10-08T19:36:19.128168+0000","last_became_active":"2021-10-08T19:29:40.631290+0000","last_became_peered":"2021-10-08T19:29:40.631290+0000","last_unstale":"2021-10-08T19:36:19.128168+0000","last_undegraded":"2021-10-08T19:36:19.128168+0000","last_fullsized":"2021-10-08T19:36:19.128168+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:19.757349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:30:11.102934+0000","last_clean_scrub_stamp":"2021-10-08T19:35:19.757349+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001709061,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"88'9","reported_seq":543,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.139968+0000","last_change":"2021-10-08T19:35:20.114948+0000","last_active":"2021-10-08T19:36:21.139968+0000","last_peered":"2021-10-08T19:36:21.139968+0000","last_clean":"2021-10-08T19:36:21.139968+0000","last_became_active":"2021-10-08T19:21:27.636432+0000","last_became_peered":"2021-10-08T19:21:27.636432+0000","last_unstale":"2021-10-08T19:36:21.139968+0000","last_undegraded":"2021-10-08T19:36:21.139968+0000","last_fullsized":"2021-10-08T19:36:21.139968+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'9","last_scrub_stamp":"2021-10-08T19:35:20.114852+0000","last_deep_scrub":"88'9","last_deep_scrub_stamp":"2021-10-08T19:23:00.048245+0000","last_clean_scrub_stamp":"2021-10-08T19:35:20.114852+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0019977990000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":371,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.122606+0000","last_change":"2021-10-08T19:34:50.829320+0000","last_active":"2021-10-08T19:36:19.122606+0000","last_peered":"2021-10-08T19:36:19.122606+0000","last_clean":"2021-10-08T19:36:19.122606+0000","last_became_active":"2021-10-08T19:28:40.137966+0000","last_became_peered":"2021-10-08T19:28:40.137966+0000","last_unstale":"2021-10-08T19:36:19.122606+0000","last_undegraded":"2021-10-08T19:36:19.122606+0000","last_fullsized":"2021-10-08T19:36:19.122606+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:50.829228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:34:50.829228+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.056194888999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.8","version":"70'5","reported_seq":168,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.120577+0000","last_change":"2021-10-08T19:36:08.760775+0000","last_active":"2021-10-08T19:36:19.120577+0000","last_peered":"2021-10-08T19:36:19.120577+0000","last_clean":"2021-10-08T19:36:19.120577+0000","last_became_active":"2021-10-08T19:29:40.639786+0000","last_became_peered":"2021-10-08T19:29:40.639786+0000","last_unstale":"2021-10-08T19:36:19.120577+0000","last_undegraded":"2021-10-08T19:36:19.120577+0000","last_fullsized":"2021-10-08T19:36:19.120577+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:36:08.760670+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2021-10-08T19:36:08.760670+0000","last_clean_scrub_stamp":"2021-10-08T19:36:08.760670+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011613982,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.0","version":"384'5293","reported_seq":5330,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:23.564202+0000","last_change":"2021-10-08T19:35:16.783810+0000","last_active":"2021-10-08T19:36:23.564202+0000","last_peered":"2021-10-08T19:36:23.564202+0000","last_clean":"2021-10-08T19:36:23.564202+0000","last_became_active":"2021-10-08T19:35:16.783489+0000","last_became_peered":"2021-10-08T19:35:16.783489+0000","last_unstale":"2021-10-08T19:36:23.564202+0000","last_undegraded":"2021-10-08T19:36:23.564202+0000","last_fullsized":"2021-10-08T19:36:23.564202+0000","mapping_epoch":355,"log_start":"361'500","ondisk_log_start":"361'500","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:35:15.759693+0000","log_size":4793,"ondisk_log_size":4793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":346882048,"num_objects":5293,"num_object_clones":0,"num_object_copies":15879,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5293,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5293,"num_write_kb":338752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4],"acting":[6,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"289'19","reported_seq":531,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.118835+0000","last_change":"2021-10-08T19:35:34.394900+0000","last_active":"2021-10-08T19:36:19.118835+0000","last_peered":"2021-10-08T19:36:19.118835+0000","last_clean":"2021-10-08T19:36:19.118835+0000","last_became_active":"2021-10-08T19:31:51.677509+0000","last_became_peered":"2021-10-08T19:31:51.677509+0000","last_unstale":"2021-10-08T19:36:19.118835+0000","last_undegraded":"2021-10-08T19:36:19.118835+0000","last_fullsized":"2021-10-08T19:36:19.118835+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:35:34.394820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:35:34.394820+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0061638159999999999,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":770,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":382,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.125503+0000","last_change":"2021-10-08T19:36:01.984163+0000","last_active":"2021-10-08T19:36:19.125503+0000","last_peered":"2021-10-08T19:36:19.125503+0000","last_clean":"2021-10-08T19:36:19.125503+0000","last_became_active":"2021-10-08T19:28:40.100691+0000","last_became_peered":"2021-10-08T19:28:40.100691+0000","last_unstale":"2021-10-08T19:36:19.125503+0000","last_undegraded":"2021-10-08T19:36:19.125503+0000","last_fullsized":"2021-10-08T19:36:19.125503+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:01.984068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:01.984068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0028891239999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":363,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.123099+0000","last_change":"2021-10-08T19:33:17.529783+0000","last_active":"2021-10-08T19:36:19.123099+0000","last_peered":"2021-10-08T19:36:19.123099+0000","last_clean":"2021-10-08T19:36:19.123099+0000","last_became_active":"2021-10-08T19:24:25.105244+0000","last_became_peered":"2021-10-08T19:24:25.105244+0000","last_unstale":"2021-10-08T19:36:19.123099+0000","last_undegraded":"2021-10-08T19:36:19.123099+0000","last_fullsized":"2021-10-08T19:36:19.123099+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:17.529713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:33:17.529713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011576375999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":168,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.123362+0000","last_change":"2021-10-08T19:33:21.903287+0000","last_active":"2021-10-08T19:36:19.123362+0000","last_peered":"2021-10-08T19:36:19.123362+0000","last_clean":"2021-10-08T19:36:19.123362+0000","last_became_active":"2021-10-08T19:29:40.638099+0000","last_became_peered":"2021-10-08T19:29:40.638099+0000","last_unstale":"2021-10-08T19:36:19.123362+0000","last_undegraded":"2021-10-08T19:36:19.123362+0000","last_fullsized":"2021-10-08T19:36:19.123362+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:21.903188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:17.422176+0000","last_clean_scrub_stamp":"2021-10-08T19:33:21.903188+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014417607000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":306,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.118983+0000","last_change":"2021-10-08T19:35:58.368794+0000","last_active":"2021-10-08T19:36:19.118983+0000","last_peered":"2021-10-08T19:36:19.118983+0000","last_clean":"2021-10-08T19:36:19.118983+0000","last_became_active":"2021-10-08T19:24:13.506602+0000","last_became_peered":"2021-10-08T19:24:13.506602+0000","last_unstale":"2021-10-08T19:36:19.118983+0000","last_undegraded":"2021-10-08T19:36:19.118983+0000","last_fullsized":"2021-10-08T19:36:19.118983+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:58.368720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:58.368720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.005639519,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"384'5374","reported_seq":5411,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:23.612436+0000","last_change":"2021-10-08T19:35:17.125222+0000","last_active":"2021-10-08T19:36:23.612436+0000","last_peered":"2021-10-08T19:36:23.612436+0000","last_clean":"2021-10-08T19:36:23.612436+0000","last_became_active":"2021-10-08T19:35:17.124842+0000","last_became_peered":"2021-10-08T19:35:17.124842+0000","last_unstale":"2021-10-08T19:36:23.612436+0000","last_undegraded":"2021-10-08T19:36:23.612436+0000","last_fullsized":"2021-10-08T19:36:23.612436+0000","mapping_epoch":355,"log_start":"361'600","ondisk_log_start":"361'600","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:35:15.759693+0000","log_size":4774,"ondisk_log_size":4774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":352190464,"num_objects":5374,"num_object_clones":0,"num_object_copies":16122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5374,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5374,"num_write_kb":343936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.4","version":"90'130","reported_seq":498,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.123277+0000","last_change":"2021-10-08T19:36:05.771481+0000","last_active":"2021-10-08T19:36:19.123277+0000","last_peered":"2021-10-08T19:36:19.123277+0000","last_clean":"2021-10-08T19:36:19.123277+0000","last_became_active":"2021-10-08T19:29:43.636733+0000","last_became_peered":"2021-10-08T19:29:43.636733+0000","last_unstale":"2021-10-08T19:36:19.123277+0000","last_undegraded":"2021-10-08T19:36:19.123277+0000","last_fullsized":"2021-10-08T19:36:19.123277+0000","mapping_epoch":239,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:36:05.771344+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:36:05.771344+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014695206000000001,"stat_sum":{"num_bytes":327680,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"238'13","reported_seq":257,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.138744+0000","last_change":"2021-10-08T19:35:16.139228+0000","last_active":"2021-10-08T19:36:21.138744+0000","last_peered":"2021-10-08T19:36:21.138744+0000","last_clean":"2021-10-08T19:36:21.138744+0000","last_became_active":"2021-10-08T19:29:40.640248+0000","last_became_peered":"2021-10-08T19:29:40.640248+0000","last_unstale":"2021-10-08T19:36:21.138744+0000","last_undegraded":"2021-10-08T19:36:21.138744+0000","last_fullsized":"2021-10-08T19:36:21.138744+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"238'13","last_scrub_stamp":"2021-10-08T19:35:16.139154+0000","last_deep_scrub":"91'9","last_deep_scrub_stamp":"2021-10-08T19:23:32.329475+0000","last_clean_scrub_stamp":"2021-10-08T19:35:16.139154+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040429799999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"289'28","reported_seq":451,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.119067+0000","last_change":"2021-10-08T19:36:16.219370+0000","last_active":"2021-10-08T19:36:19.119067+0000","last_peered":"2021-10-08T19:36:19.119067+0000","last_clean":"2021-10-08T19:36:19.119067+0000","last_became_active":"2021-10-08T19:24:25.098743+0000","last_became_peered":"2021-10-08T19:24:25.098743+0000","last_unstale":"2021-10-08T19:36:19.119067+0000","last_undegraded":"2021-10-08T19:36:19.119067+0000","last_fullsized":"2021-10-08T19:36:19.119067+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'28","last_scrub_stamp":"2021-10-08T19:36:16.219258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:16.219258+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0095071070000000008,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":42,"num_read_kb":35,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":304,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.126126+0000","last_change":"2021-10-08T19:36:12.643738+0000","last_active":"2021-10-08T19:36:19.126126+0000","last_peered":"2021-10-08T19:36:19.126126+0000","last_clean":"2021-10-08T19:36:19.126126+0000","last_became_active":"2021-10-08T19:24:25.094364+0000","last_became_peered":"2021-10-08T19:24:25.094364+0000","last_unstale":"2021-10-08T19:36:19.126126+0000","last_undegraded":"2021-10-08T19:36:19.126126+0000","last_fullsized":"2021-10-08T19:36:19.126126+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:12.643664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:12.643664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0025959149999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":370,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.126632+0000","last_change":"2021-10-08T19:34:57.935414+0000","last_active":"2021-10-08T19:36:19.126632+0000","last_peered":"2021-10-08T19:36:19.126632+0000","last_clean":"2021-10-08T19:36:19.126632+0000","last_became_active":"2021-10-08T19:24:25.094848+0000","last_became_peered":"2021-10-08T19:24:25.094848+0000","last_unstale":"2021-10-08T19:36:19.126632+0000","last_undegraded":"2021-10-08T19:36:19.126632+0000","last_fullsized":"2021-10-08T19:36:19.126632+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:57.935312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:34:57.935312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.031026839000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":329,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.126906+0000","last_change":"2021-10-08T19:34:44.965618+0000","last_active":"2021-10-08T19:36:19.126906+0000","last_peered":"2021-10-08T19:36:19.126906+0000","last_clean":"2021-10-08T19:36:19.126906+0000","last_became_active":"2021-10-08T19:28:40.132751+0000","last_became_peered":"2021-10-08T19:28:40.132751+0000","last_unstale":"2021-10-08T19:36:19.126906+0000","last_undegraded":"2021-10-08T19:36:19.126906+0000","last_fullsized":"2021-10-08T19:36:19.126906+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:44.965505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:44.965505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.020193916999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.e","version":"384'5405","reported_seq":5442,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:24.514762+0000","last_change":"2021-10-08T19:35:16.776363+0000","last_active":"2021-10-08T19:36:24.514762+0000","last_peered":"2021-10-08T19:36:24.514762+0000","last_clean":"2021-10-08T19:36:24.514762+0000","last_became_active":"2021-10-08T19:35:16.776024+0000","last_became_peered":"2021-10-08T19:35:16.776024+0000","last_unstale":"2021-10-08T19:36:24.514762+0000","last_undegraded":"2021-10-08T19:36:24.514762+0000","last_fullsized":"2021-10-08T19:36:24.514762+0000","mapping_epoch":355,"log_start":"362'1300","ondisk_log_start":"362'1300","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:35:15.759693+0000","log_size":4105,"ondisk_log_size":4105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":354222080,"num_objects":5405,"num_object_clones":0,"num_object_copies":16215,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5405,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5405,"num_write_kb":345920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"90'130","reported_seq":532,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.119826+0000","last_change":"2021-10-08T19:34:59.306555+0000","last_active":"2021-10-08T19:36:19.119826+0000","last_peered":"2021-10-08T19:36:19.119826+0000","last_clean":"2021-10-08T19:36:19.119826+0000","last_became_active":"2021-10-08T19:27:26.590651+0000","last_became_peered":"2021-10-08T19:27:26.590651+0000","last_unstale":"2021-10-08T19:36:19.119826+0000","last_undegraded":"2021-10-08T19:36:19.119826+0000","last_fullsized":"2021-10-08T19:36:19.119826+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:34:59.306414+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:32:14.582883+0000","last_clean_scrub_stamp":"2021-10-08T19:34:59.306414+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0017696229999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":369,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.119333+0000","last_change":"2021-10-08T19:34:49.244387+0000","last_active":"2021-10-08T19:36:19.119333+0000","last_peered":"2021-10-08T19:36:19.119333+0000","last_clean":"2021-10-08T19:36:19.119333+0000","last_became_active":"2021-10-08T19:29:40.639405+0000","last_became_peered":"2021-10-08T19:29:40.639405+0000","last_unstale":"2021-10-08T19:36:19.119333+0000","last_undegraded":"2021-10-08T19:36:19.119333+0000","last_fullsized":"2021-10-08T19:36:19.119333+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:49.244279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:34:49.244279+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.018839582000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"289'30","reported_seq":204,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.120364+0000","last_change":"2021-10-08T19:34:06.085387+0000","last_active":"2021-10-08T19:36:19.120364+0000","last_peered":"2021-10-08T19:36:19.120364+0000","last_clean":"2021-10-08T19:36:19.120364+0000","last_became_active":"2021-10-08T19:29:40.635007+0000","last_became_peered":"2021-10-08T19:29:40.635007+0000","last_unstale":"2021-10-08T19:36:19.120364+0000","last_undegraded":"2021-10-08T19:36:19.120364+0000","last_fullsized":"2021-10-08T19:36:19.120364+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'30","last_scrub_stamp":"2021-10-08T19:34:06.085282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:34:06.085282+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.015398577,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":51,"num_read_kb":39,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":202,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.128941+0000","last_change":"2021-10-08T19:34:50.752974+0000","last_active":"2021-10-08T19:36:19.128941+0000","last_peered":"2021-10-08T19:36:19.128941+0000","last_clean":"2021-10-08T19:36:19.128941+0000","last_became_active":"2021-10-08T19:28:40.141714+0000","last_became_peered":"2021-10-08T19:28:40.141714+0000","last_unstale":"2021-10-08T19:36:19.128941+0000","last_undegraded":"2021-10-08T19:36:19.128941+0000","last_fullsized":"2021-10-08T19:36:19.128941+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:50.752866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:07.710367+0000","last_clean_scrub_stamp":"2021-10-08T19:34:50.752866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013659034,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":367,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.120630+0000","last_change":"2021-10-08T19:35:31.347742+0000","last_active":"2021-10-08T19:36:19.120630+0000","last_peered":"2021-10-08T19:36:19.120630+0000","last_clean":"2021-10-08T19:36:19.120630+0000","last_became_active":"2021-10-08T19:29:40.638253+0000","last_became_peered":"2021-10-08T19:29:40.638253+0000","last_unstale":"2021-10-08T19:36:19.120630+0000","last_undegraded":"2021-10-08T19:36:19.120630+0000","last_fullsized":"2021-10-08T19:36:19.120630+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:31.347606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:35:31.347606+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0053338960000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":168,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.121500+0000","last_change":"2021-10-08T19:36:10.804434+0000","last_active":"2021-10-08T19:36:19.121500+0000","last_peered":"2021-10-08T19:36:19.121500+0000","last_clean":"2021-10-08T19:36:19.121500+0000","last_became_active":"2021-10-08T19:29:40.634579+0000","last_became_peered":"2021-10-08T19:29:40.634579+0000","last_unstale":"2021-10-08T19:36:19.121500+0000","last_undegraded":"2021-10-08T19:36:19.121500+0000","last_fullsized":"2021-10-08T19:36:19.121500+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:10.804325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:10.804325+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0063916950000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.d","version":"384'5238","reported_seq":5272,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:23.649294+0000","last_change":"2021-10-08T19:35:16.783067+0000","last_active":"2021-10-08T19:36:23.649294+0000","last_peered":"2021-10-08T19:36:23.649294+0000","last_clean":"2021-10-08T19:36:23.649294+0000","last_became_active":"2021-10-08T19:35:16.782695+0000","last_became_peered":"2021-10-08T19:35:16.782695+0000","last_unstale":"2021-10-08T19:36:23.649294+0000","last_undegraded":"2021-10-08T19:36:23.649294+0000","last_fullsized":"2021-10-08T19:36:23.649294+0000","mapping_epoch":355,"log_start":"361'400","ondisk_log_start":"361'400","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:35:15.759693+0000","log_size":4838,"ondisk_log_size":4838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":343277568,"num_objects":5238,"num_object_clones":0,"num_object_copies":15714,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5238,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5238,"num_write_kb":335232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"90'130","reported_seq":473,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.124240+0000","last_change":"2021-10-08T19:36:01.675001+0000","last_active":"2021-10-08T19:36:19.124240+0000","last_peered":"2021-10-08T19:36:19.124240+0000","last_clean":"2021-10-08T19:36:19.124240+0000","last_became_active":"2021-10-08T19:30:00.643797+0000","last_became_peered":"2021-10-08T19:30:00.643797+0000","last_unstale":"2021-10-08T19:36:19.124240+0000","last_undegraded":"2021-10-08T19:36:19.124240+0000","last_fullsized":"2021-10-08T19:36:19.124240+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:36:01.674904+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:36:01.674904+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.072145927999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":310,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.122656+0000","last_change":"2021-10-08T19:36:00.599933+0000","last_active":"2021-10-08T19:36:19.122656+0000","last_peered":"2021-10-08T19:36:19.122656+0000","last_clean":"2021-10-08T19:36:19.122656+0000","last_became_active":"2021-10-08T19:24:25.095389+0000","last_became_peered":"2021-10-08T19:24:25.095389+0000","last_unstale":"2021-10-08T19:36:19.122656+0000","last_undegraded":"2021-10-08T19:36:19.122656+0000","last_fullsized":"2021-10-08T19:36:19.122656+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:00.599845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:36:00.599845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0065529969999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"289'29","reported_seq":411,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.124688+0000","last_change":"2021-10-08T19:36:05.122735+0000","last_active":"2021-10-08T19:36:19.124688+0000","last_peered":"2021-10-08T19:36:19.124688+0000","last_clean":"2021-10-08T19:36:19.124688+0000","last_became_active":"2021-10-08T19:21:25.741812+0000","last_became_peered":"2021-10-08T19:21:25.741812+0000","last_unstale":"2021-10-08T19:36:19.124688+0000","last_undegraded":"2021-10-08T19:36:19.124688+0000","last_fullsized":"2021-10-08T19:36:19.124688+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'29","last_scrub_stamp":"2021-10-08T19:36:05.122593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:05.122593+0000","log_size":29,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0069217020000000001,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":54,"num_read_kb":40,"num_write":32,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"328'2","reported_seq":372,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.130002+0000","last_change":"2021-10-08T19:36:03.954708+0000","last_active":"2021-10-08T19:36:19.130002+0000","last_peered":"2021-10-08T19:36:19.130002+0000","last_clean":"2021-10-08T19:36:19.130002+0000","last_became_active":"2021-10-08T19:21:23.604258+0000","last_became_peered":"2021-10-08T19:21:23.604258+0000","last_unstale":"2021-10-08T19:36:19.130002+0000","last_undegraded":"2021-10-08T19:36:19.130002+0000","last_fullsized":"2021-10-08T19:36:19.130002+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"328'2","last_scrub_stamp":"2021-10-08T19:36:03.954613+0000","last_deep_scrub":"328'2","last_deep_scrub_stamp":"2021-10-08T19:33:29.990395+0000","last_clean_scrub_stamp":"2021-10-08T19:36:03.954613+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0074631530000000001,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":202,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.127874+0000","last_change":"2021-10-08T19:34:56.791831+0000","last_active":"2021-10-08T19:36:19.127874+0000","last_peered":"2021-10-08T19:36:19.127874+0000","last_clean":"2021-10-08T19:36:19.127874+0000","last_became_active":"2021-10-08T19:28:40.140876+0000","last_became_peered":"2021-10-08T19:28:40.140876+0000","last_unstale":"2021-10-08T19:36:19.127874+0000","last_undegraded":"2021-10-08T19:36:19.127874+0000","last_fullsized":"2021-10-08T19:36:19.127874+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:56.791734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:34:56.791734+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.031194143000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"70'5","reported_seq":208,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.128539+0000","last_change":"2021-10-08T19:35:30.660394+0000","last_active":"2021-10-08T19:36:19.128539+0000","last_peered":"2021-10-08T19:36:19.128539+0000","last_clean":"2021-10-08T19:36:19.128539+0000","last_became_active":"2021-10-08T19:28:40.150503+0000","last_became_peered":"2021-10-08T19:28:40.150503+0000","last_unstale":"2021-10-08T19:36:19.128539+0000","last_undegraded":"2021-10-08T19:36:19.128539+0000","last_fullsized":"2021-10-08T19:36:19.128539+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:35:30.660285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:30.660285+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0035933829999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.8","version":"384'5262","reported_seq":5299,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:24.098396+0000","last_change":"2021-10-08T19:35:16.778383+0000","last_active":"2021-10-08T19:36:24.098396+0000","last_peered":"2021-10-08T19:36:24.098396+0000","last_clean":"2021-10-08T19:36:24.098396+0000","last_became_active":"2021-10-08T19:35:16.778100+0000","last_became_peered":"2021-10-08T19:35:16.778100+0000","last_unstale":"2021-10-08T19:36:24.098396+0000","last_undegraded":"2021-10-08T19:36:24.098396+0000","last_fullsized":"2021-10-08T19:36:24.098396+0000","mapping_epoch":355,"log_start":"361'700","ondisk_log_start":"361'700","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:35:15.759693+0000","log_size":4562,"ondisk_log_size":4562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":344850432,"num_objects":5262,"num_object_clones":0,"num_object_copies":15786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5262,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5262,"num_write_kb":336768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7],"acting":[0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"90'130","reported_seq":509,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.129697+0000","last_change":"2021-10-08T19:36:09.840616+0000","last_active":"2021-10-08T19:36:19.129697+0000","last_peered":"2021-10-08T19:36:19.129697+0000","last_clean":"2021-10-08T19:36:19.129697+0000","last_became_active":"2021-10-08T19:28:43.178371+0000","last_became_peered":"2021-10-08T19:28:43.178371+0000","last_unstale":"2021-10-08T19:36:19.129697+0000","last_undegraded":"2021-10-08T19:36:19.129697+0000","last_fullsized":"2021-10-08T19:36:19.129697+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:36:09.840508+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:34:13.653248+0000","last_clean_scrub_stamp":"2021-10-08T19:36:09.840508+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0067520610000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":116,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.122878+0000","last_change":"2021-10-08T19:33:21.590512+0000","last_active":"2021-10-08T19:36:19.122878+0000","last_peered":"2021-10-08T19:36:19.122878+0000","last_clean":"2021-10-08T19:36:19.122878+0000","last_became_active":"2021-10-08T19:31:22.783759+0000","last_became_peered":"2021-10-08T19:31:22.783759+0000","last_unstale":"2021-10-08T19:36:19.122878+0000","last_undegraded":"2021-10-08T19:36:19.122878+0000","last_fullsized":"2021-10-08T19:36:19.122878+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:21.590400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:33:21.590400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.022083749,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"289'24","reported_seq":463,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.127012+0000","last_change":"2021-10-08T19:36:06.098172+0000","last_active":"2021-10-08T19:36:19.127012+0000","last_peered":"2021-10-08T19:36:19.127012+0000","last_clean":"2021-10-08T19:36:19.127012+0000","last_became_active":"2021-10-08T19:32:45.154743+0000","last_became_peered":"2021-10-08T19:32:45.154743+0000","last_unstale":"2021-10-08T19:36:19.127012+0000","last_undegraded":"2021-10-08T19:36:19.127012+0000","last_fullsized":"2021-10-08T19:36:19.127012+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'24","last_scrub_stamp":"2021-10-08T19:36:06.098078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:06.098078+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0071628120000000002,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":30,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":351,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.118933+0000","last_change":"2021-10-08T19:36:08.078394+0000","last_active":"2021-10-08T19:36:19.118933+0000","last_peered":"2021-10-08T19:36:19.118933+0000","last_clean":"2021-10-08T19:36:19.118933+0000","last_became_active":"2021-10-08T19:28:40.140231+0000","last_became_peered":"2021-10-08T19:28:40.140231+0000","last_unstale":"2021-10-08T19:36:19.118933+0000","last_undegraded":"2021-10-08T19:36:19.118933+0000","last_fullsized":"2021-10-08T19:36:19.118933+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:08.078324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:32.922694+0000","last_clean_scrub_stamp":"2021-10-08T19:36:08.078324+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020685959999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":392,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.124556+0000","last_change":"2021-10-08T19:34:58.928837+0000","last_active":"2021-10-08T19:36:19.124556+0000","last_peered":"2021-10-08T19:36:19.124556+0000","last_clean":"2021-10-08T19:36:19.124556+0000","last_became_active":"2021-10-08T19:29:40.632010+0000","last_became_peered":"2021-10-08T19:29:40.632010+0000","last_unstale":"2021-10-08T19:36:19.124556+0000","last_undegraded":"2021-10-08T19:36:19.124556+0000","last_fullsized":"2021-10-08T19:36:19.124556+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:58.928758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:58.928758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0012564410000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":110,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.128269+0000","last_change":"2021-10-08T19:36:11.789864+0000","last_active":"2021-10-08T19:36:19.128269+0000","last_peered":"2021-10-08T19:36:19.128269+0000","last_clean":"2021-10-08T19:36:19.128269+0000","last_became_active":"2021-10-08T19:31:51.673821+0000","last_became_peered":"2021-10-08T19:31:51.673821+0000","last_unstale":"2021-10-08T19:36:19.128269+0000","last_undegraded":"2021-10-08T19:36:19.128269+0000","last_fullsized":"2021-10-08T19:36:19.128269+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:11.789757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:21.644827+0000","last_clean_scrub_stamp":"2021-10-08T19:36:11.789757+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0099411570000000008,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"384'5240","reported_seq":5277,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:23.657493+0000","last_change":"2021-10-08T19:35:16.785023+0000","last_active":"2021-10-08T19:36:23.657493+0000","last_peered":"2021-10-08T19:36:23.657493+0000","last_clean":"2021-10-08T19:36:23.657493+0000","last_became_active":"2021-10-08T19:35:16.784654+0000","last_became_peered":"2021-10-08T19:35:16.784654+0000","last_unstale":"2021-10-08T19:36:23.657493+0000","last_undegraded":"2021-10-08T19:36:23.657493+0000","last_fullsized":"2021-10-08T19:36:23.657493+0000","mapping_epoch":355,"log_start":"361'400","ondisk_log_start":"361'400","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:35:15.759693+0000","log_size":4840,"ondisk_log_size":4840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":343408640,"num_objects":5240,"num_object_clones":0,"num_object_copies":15720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5240,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5240,"num_write_kb":335360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0],"acting":[6,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":352,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.126970+0000","last_change":"2021-10-08T19:34:54.892507+0000","last_active":"2021-10-08T19:36:19.126970+0000","last_peered":"2021-10-08T19:36:19.126970+0000","last_clean":"2021-10-08T19:36:19.126970+0000","last_became_active":"2021-10-08T19:21:27.636086+0000","last_became_peered":"2021-10-08T19:21:27.636086+0000","last_unstale":"2021-10-08T19:36:19.126970+0000","last_undegraded":"2021-10-08T19:36:19.126970+0000","last_fullsized":"2021-10-08T19:36:19.126970+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:54.892389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:34:54.892389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0079512119999999992,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"289'26","reported_seq":338,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.125491+0000","last_change":"2021-10-08T19:34:58.535327+0000","last_active":"2021-10-08T19:36:19.125491+0000","last_peered":"2021-10-08T19:36:19.125491+0000","last_clean":"2021-10-08T19:36:19.125491+0000","last_became_active":"2021-10-08T19:24:25.100384+0000","last_became_peered":"2021-10-08T19:24:25.100384+0000","last_unstale":"2021-10-08T19:36:19.125491+0000","last_undegraded":"2021-10-08T19:36:19.125491+0000","last_fullsized":"2021-10-08T19:36:19.125491+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'26","last_scrub_stamp":"2021-10-08T19:34:58.535228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:34:58.535228+0000","log_size":26,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020755830000000002,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":42,"num_read_kb":32,"num_write":25,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"90'130","reported_seq":671,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.125352+0000","last_change":"2021-10-08T19:36:09.855513+0000","last_active":"2021-10-08T19:36:19.125352+0000","last_peered":"2021-10-08T19:36:19.125352+0000","last_clean":"2021-10-08T19:36:19.125352+0000","last_became_active":"2021-10-08T19:27:22.607289+0000","last_became_peered":"2021-10-08T19:27:22.607289+0000","last_unstale":"2021-10-08T19:36:19.125352+0000","last_undegraded":"2021-10-08T19:36:19.125352+0000","last_fullsized":"2021-10-08T19:36:19.125352+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:36:09.855393+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:36:09.855393+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0065522590000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":355,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.122795+0000","last_change":"2021-10-08T19:35:31.652594+0000","last_active":"2021-10-08T19:36:19.122795+0000","last_peered":"2021-10-08T19:36:19.122795+0000","last_clean":"2021-10-08T19:36:19.122795+0000","last_became_active":"2021-10-08T19:21:23.599143+0000","last_became_peered":"2021-10-08T19:21:23.599143+0000","last_unstale":"2021-10-08T19:36:19.122795+0000","last_undegraded":"2021-10-08T19:36:19.122795+0000","last_fullsized":"2021-10-08T19:36:19.122795+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:31.652494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:31.652494+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0075080879999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":168,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.120810+0000","last_change":"2021-10-08T19:35:33.861695+0000","last_active":"2021-10-08T19:36:19.120810+0000","last_peered":"2021-10-08T19:36:19.120810+0000","last_clean":"2021-10-08T19:36:19.120810+0000","last_became_active":"2021-10-08T19:29:40.638774+0000","last_became_peered":"2021-10-08T19:29:40.638774+0000","last_unstale":"2021-10-08T19:36:19.120810+0000","last_undegraded":"2021-10-08T19:36:19.120810+0000","last_fullsized":"2021-10-08T19:36:19.120810+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:33.861554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:33.861554+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011946132999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":367,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.123226+0000","last_change":"2021-10-08T19:35:24.690698+0000","last_active":"2021-10-08T19:36:19.123226+0000","last_peered":"2021-10-08T19:36:19.123226+0000","last_clean":"2021-10-08T19:36:19.123226+0000","last_became_active":"2021-10-08T19:29:40.627256+0000","last_became_peered":"2021-10-08T19:29:40.627256+0000","last_unstale":"2021-10-08T19:36:19.123226+0000","last_undegraded":"2021-10-08T19:36:19.123226+0000","last_fullsized":"2021-10-08T19:36:19.123226+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:24.690591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:32:15.872860+0000","last_clean_scrub_stamp":"2021-10-08T19:35:24.690591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.065857132999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"384'5323","reported_seq":5360,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:23.607389+0000","last_change":"2021-10-08T19:35:16.780954+0000","last_active":"2021-10-08T19:36:23.607389+0000","last_peered":"2021-10-08T19:36:23.607389+0000","last_clean":"2021-10-08T19:36:23.607389+0000","last_became_active":"2021-10-08T19:35:16.780624+0000","last_became_peered":"2021-10-08T19:35:16.780624+0000","last_unstale":"2021-10-08T19:36:23.607389+0000","last_undegraded":"2021-10-08T19:36:23.607389+0000","last_fullsized":"2021-10-08T19:36:23.607389+0000","mapping_epoch":355,"log_start":"361'600","ondisk_log_start":"361'600","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:35:15.759693+0000","log_size":4723,"ondisk_log_size":4723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":348848128,"num_objects":5323,"num_object_clones":0,"num_object_copies":15969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5323,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5323,"num_write_kb":340672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"90'130","reported_seq":679,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.126054+0000","last_change":"2021-10-08T19:36:11.798375+0000","last_active":"2021-10-08T19:36:19.126054+0000","last_peered":"2021-10-08T19:36:19.126054+0000","last_clean":"2021-10-08T19:36:19.126054+0000","last_became_active":"2021-10-08T19:27:26.591250+0000","last_became_peered":"2021-10-08T19:27:26.591250+0000","last_unstale":"2021-10-08T19:36:19.126054+0000","last_undegraded":"2021-10-08T19:36:19.126054+0000","last_fullsized":"2021-10-08T19:36:19.126054+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:36:11.798245+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:36:11.798245+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013110805,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":362,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.119910+0000","last_change":"2021-10-08T19:35:23.047013+0000","last_active":"2021-10-08T19:36:19.119910+0000","last_peered":"2021-10-08T19:36:19.119910+0000","last_clean":"2021-10-08T19:36:19.119910+0000","last_became_active":"2021-10-08T19:21:27.637875+0000","last_became_peered":"2021-10-08T19:21:27.637875+0000","last_unstale":"2021-10-08T19:36:19.119910+0000","last_undegraded":"2021-10-08T19:36:19.119910+0000","last_fullsized":"2021-10-08T19:36:19.119910+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:23.046871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:20.092069+0000","last_clean_scrub_stamp":"2021-10-08T19:35:23.046871+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0044452409999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"289'17","reported_seq":116,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.129074+0000","last_change":"2021-10-08T19:35:22.787177+0000","last_active":"2021-10-08T19:36:19.129074+0000","last_peered":"2021-10-08T19:36:19.129074+0000","last_clean":"2021-10-08T19:36:19.129074+0000","last_became_active":"2021-10-08T19:31:51.674965+0000","last_became_peered":"2021-10-08T19:31:51.674965+0000","last_unstale":"2021-10-08T19:36:19.129074+0000","last_undegraded":"2021-10-08T19:36:19.129074+0000","last_fullsized":"2021-10-08T19:36:19.129074+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'17","last_scrub_stamp":"2021-10-08T19:35:22.787087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:35:22.787087+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.004183717,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":23,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":990,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":382,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.119176+0000","last_change":"2021-10-08T19:35:18.015926+0000","last_active":"2021-10-08T19:36:19.119176+0000","last_peered":"2021-10-08T19:36:19.119176+0000","last_clean":"2021-10-08T19:36:19.119176+0000","last_became_active":"2021-10-08T19:29:40.619746+0000","last_became_peered":"2021-10-08T19:29:40.619746+0000","last_unstale":"2021-10-08T19:36:19.119176+0000","last_undegraded":"2021-10-08T19:36:19.119176+0000","last_fullsized":"2021-10-08T19:36:19.119176+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:18.015850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:18.015850+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0013167389999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"70'5","reported_seq":206,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.128261+0000","last_change":"2021-10-08T19:36:16.753049+0000","last_active":"2021-10-08T19:36:19.128261+0000","last_peered":"2021-10-08T19:36:19.128261+0000","last_clean":"2021-10-08T19:36:19.128261+0000","last_became_active":"2021-10-08T19:28:40.148054+0000","last_became_peered":"2021-10-08T19:28:40.148054+0000","last_unstale":"2021-10-08T19:36:19.128261+0000","last_undegraded":"2021-10-08T19:36:19.128261+0000","last_fullsized":"2021-10-08T19:36:19.128261+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:34:18.630378+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2021-10-08T19:34:18.630378+0000","last_clean_scrub_stamp":"2021-10-08T19:34:18.630378+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0054668570000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":386,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.129912+0000","last_change":"2021-10-08T19:35:30.916430+0000","last_active":"2021-10-08T19:36:19.129912+0000","last_peered":"2021-10-08T19:36:19.129912+0000","last_clean":"2021-10-08T19:36:19.129912+0000","last_became_active":"2021-10-08T19:29:40.652528+0000","last_became_peered":"2021-10-08T19:29:40.652528+0000","last_unstale":"2021-10-08T19:36:19.129912+0000","last_undegraded":"2021-10-08T19:36:19.129912+0000","last_fullsized":"2021-10-08T19:36:19.129912+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:30.916326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:35:30.916326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.048993430999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.a","version":"384'5301","reported_seq":5338,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:23.619511+0000","last_change":"2021-10-08T19:35:16.783039+0000","last_active":"2021-10-08T19:36:23.619511+0000","last_peered":"2021-10-08T19:36:23.619511+0000","last_clean":"2021-10-08T19:36:23.619511+0000","last_became_active":"2021-10-08T19:35:16.782677+0000","last_became_peered":"2021-10-08T19:35:16.782677+0000","last_unstale":"2021-10-08T19:36:23.619511+0000","last_undegraded":"2021-10-08T19:36:23.619511+0000","last_fullsized":"2021-10-08T19:36:23.619511+0000","mapping_epoch":355,"log_start":"361'500","ondisk_log_start":"361'500","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:35:15.759693+0000","log_size":4801,"ondisk_log_size":4801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":347406336,"num_objects":5301,"num_object_clones":0,"num_object_copies":15903,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5301,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5301,"num_write_kb":339264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"90'130","reported_seq":531,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.122009+0000","last_change":"2021-10-08T19:35:19.581334+0000","last_active":"2021-10-08T19:36:19.122009+0000","last_peered":"2021-10-08T19:36:19.122009+0000","last_clean":"2021-10-08T19:36:19.122009+0000","last_became_active":"2021-10-08T19:27:26.591993+0000","last_became_peered":"2021-10-08T19:27:26.591993+0000","last_unstale":"2021-10-08T19:36:19.122009+0000","last_undegraded":"2021-10-08T19:36:19.122009+0000","last_fullsized":"2021-10-08T19:36:19.122009+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:35:19.581220+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:35:19.581220+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001876345,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,2],"acting":[5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":374,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.125401+0000","last_change":"2021-10-08T19:35:57.184673+0000","last_active":"2021-10-08T19:36:19.125401+0000","last_peered":"2021-10-08T19:36:19.125401+0000","last_clean":"2021-10-08T19:36:19.125401+0000","last_became_active":"2021-10-08T19:28:40.133414+0000","last_became_peered":"2021-10-08T19:28:40.133414+0000","last_unstale":"2021-10-08T19:36:19.125401+0000","last_undegraded":"2021-10-08T19:36:19.125401+0000","last_fullsized":"2021-10-08T19:36:19.125401+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:57.184578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:35:57.184578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014526842,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"289'44","reported_seq":404,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.156876+0000","last_change":"2021-10-08T19:35:32.703833+0000","last_active":"2021-10-08T19:36:21.156876+0000","last_peered":"2021-10-08T19:36:21.156876+0000","last_clean":"2021-10-08T19:36:21.156876+0000","last_became_active":"2021-10-08T19:29:40.626138+0000","last_became_peered":"2021-10-08T19:29:40.626138+0000","last_unstale":"2021-10-08T19:36:21.156876+0000","last_undegraded":"2021-10-08T19:36:21.156876+0000","last_fullsized":"2021-10-08T19:36:21.156876+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'44","last_scrub_stamp":"2021-10-08T19:35:32.703721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:35:32.703721+0000","log_size":44,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0064438680000000002,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":65,"num_read_kb":50,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":1432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":391,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.123580+0000","last_change":"2021-10-08T19:35:23.647578+0000","last_active":"2021-10-08T19:36:19.123580+0000","last_peered":"2021-10-08T19:36:19.123580+0000","last_clean":"2021-10-08T19:36:19.123580+0000","last_became_active":"2021-10-08T19:28:40.137919+0000","last_became_peered":"2021-10-08T19:28:40.137919+0000","last_unstale":"2021-10-08T19:36:19.123580+0000","last_undegraded":"2021-10-08T19:36:19.123580+0000","last_fullsized":"2021-10-08T19:36:19.123580+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:23.647485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:23.647485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002822181,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":170,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.121328+0000","last_change":"2021-10-08T19:34:45.208220+0000","last_active":"2021-10-08T19:36:19.121328+0000","last_peered":"2021-10-08T19:36:19.121328+0000","last_clean":"2021-10-08T19:36:19.121328+0000","last_became_active":"2021-10-08T19:29:40.637371+0000","last_became_peered":"2021-10-08T19:29:40.637371+0000","last_unstale":"2021-10-08T19:36:19.121328+0000","last_undegraded":"2021-10-08T19:36:19.121328+0000","last_fullsized":"2021-10-08T19:36:19.121328+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:45.208127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:34:45.208127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.01258626,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":317,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.118797+0000","last_change":"2021-10-08T19:36:09.181971+0000","last_active":"2021-10-08T19:36:19.118797+0000","last_peered":"2021-10-08T19:36:19.118797+0000","last_clean":"2021-10-08T19:36:19.118797+0000","last_became_active":"2021-10-08T19:25:14.550690+0000","last_became_peered":"2021-10-08T19:25:14.550690+0000","last_unstale":"2021-10-08T19:36:19.118797+0000","last_undegraded":"2021-10-08T19:36:19.118797+0000","last_fullsized":"2021-10-08T19:36:19.118797+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:09.181866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:36:09.181866+0000","last_clean_scrub_stamp":"2021-10-08T19:36:09.181866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0070630550000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"384'5411","reported_seq":5445,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:23.693847+0000","last_change":"2021-10-08T19:35:16.778370+0000","last_active":"2021-10-08T19:36:23.693847+0000","last_peered":"2021-10-08T19:36:23.693847+0000","last_clean":"2021-10-08T19:36:23.693847+0000","last_became_active":"2021-10-08T19:35:16.778062+0000","last_became_peered":"2021-10-08T19:35:16.778062+0000","last_unstale":"2021-10-08T19:36:23.693847+0000","last_undegraded":"2021-10-08T19:36:23.693847+0000","last_fullsized":"2021-10-08T19:36:23.693847+0000","mapping_epoch":355,"log_start":"362'1400","ondisk_log_start":"362'1400","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:35:15.759693+0000","log_size":4011,"ondisk_log_size":4011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":354615296,"num_objects":5411,"num_object_clones":0,"num_object_copies":16233,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5411,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5411,"num_write_kb":346304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.7","version":"90'130","reported_seq":633,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.124589+0000","last_change":"2021-10-08T19:35:29.542745+0000","last_active":"2021-10-08T19:36:19.124589+0000","last_peered":"2021-10-08T19:36:19.124589+0000","last_clean":"2021-10-08T19:36:19.124589+0000","last_became_active":"2021-10-08T19:29:43.636820+0000","last_became_peered":"2021-10-08T19:29:43.636820+0000","last_unstale":"2021-10-08T19:36:19.124589+0000","last_undegraded":"2021-10-08T19:36:19.124589+0000","last_fullsized":"2021-10-08T19:36:19.124589+0000","mapping_epoch":239,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:35:29.542673+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:35:29.542673+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002657024,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"114'10","reported_seq":569,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.155124+0000","last_change":"2021-10-08T19:34:03.864493+0000","last_active":"2021-10-08T19:36:21.155124+0000","last_peered":"2021-10-08T19:36:21.155124+0000","last_clean":"2021-10-08T19:36:21.155124+0000","last_became_active":"2021-10-08T19:24:25.106695+0000","last_became_peered":"2021-10-08T19:24:25.106695+0000","last_unstale":"2021-10-08T19:36:21.155124+0000","last_undegraded":"2021-10-08T19:36:21.155124+0000","last_fullsized":"2021-10-08T19:36:21.155124+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'10","last_scrub_stamp":"2021-10-08T19:34:03.864384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:34:03.864384+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.007036924,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"289'20","reported_seq":116,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.130430+0000","last_change":"2021-10-08T19:36:04.773566+0000","last_active":"2021-10-08T19:36:19.130430+0000","last_peered":"2021-10-08T19:36:19.130430+0000","last_clean":"2021-10-08T19:36:19.130430+0000","last_became_active":"2021-10-08T19:31:51.675569+0000","last_became_peered":"2021-10-08T19:31:51.675569+0000","last_unstale":"2021-10-08T19:36:19.130430+0000","last_undegraded":"2021-10-08T19:36:19.130430+0000","last_fullsized":"2021-10-08T19:36:19.130430+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'20","last_scrub_stamp":"2021-10-08T19:36:04.773449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:04.773449+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0045168379999999996,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":23,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":208,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.128339+0000","last_change":"2021-10-08T19:35:16.702516+0000","last_active":"2021-10-08T19:36:19.128339+0000","last_peered":"2021-10-08T19:36:19.128339+0000","last_clean":"2021-10-08T19:36:19.128339+0000","last_became_active":"2021-10-08T19:28:40.141737+0000","last_became_peered":"2021-10-08T19:28:40.141737+0000","last_unstale":"2021-10-08T19:36:19.128339+0000","last_undegraded":"2021-10-08T19:36:19.128339+0000","last_fullsized":"2021-10-08T19:36:19.128339+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:16.702426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:16.702426+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0018085219999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":370,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.125029+0000","last_change":"2021-10-08T19:34:16.042895+0000","last_active":"2021-10-08T19:36:19.125029+0000","last_peered":"2021-10-08T19:36:19.125029+0000","last_clean":"2021-10-08T19:36:19.125029+0000","last_became_active":"2021-10-08T19:29:40.643614+0000","last_became_peered":"2021-10-08T19:29:40.643614+0000","last_unstale":"2021-10-08T19:36:19.125029+0000","last_undegraded":"2021-10-08T19:36:19.125029+0000","last_fullsized":"2021-10-08T19:36:19.125029+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:16.042797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:16.042797+0000","last_clean_scrub_stamp":"2021-10-08T19:34:16.042797+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.038141670000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":325,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.122319+0000","last_change":"2021-10-08T19:32:49.731052+0000","last_active":"2021-10-08T19:36:19.122319+0000","last_peered":"2021-10-08T19:36:19.122319+0000","last_clean":"2021-10-08T19:36:19.122319+0000","last_became_active":"2021-10-08T19:29:40.626998+0000","last_became_peered":"2021-10-08T19:29:40.626998+0000","last_unstale":"2021-10-08T19:36:19.122319+0000","last_undegraded":"2021-10-08T19:36:19.122319+0000","last_fullsized":"2021-10-08T19:36:19.122319+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:49.730960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:49.730960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.017072971999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"384'5368","reported_seq":5405,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:23.594422+0000","last_change":"2021-10-08T19:35:17.125218+0000","last_active":"2021-10-08T19:36:23.594422+0000","last_peered":"2021-10-08T19:36:23.594422+0000","last_clean":"2021-10-08T19:36:23.594422+0000","last_became_active":"2021-10-08T19:35:17.124846+0000","last_became_peered":"2021-10-08T19:35:17.124846+0000","last_unstale":"2021-10-08T19:36:23.594422+0000","last_undegraded":"2021-10-08T19:36:23.594422+0000","last_fullsized":"2021-10-08T19:36:23.594422+0000","mapping_epoch":355,"log_start":"361'600","ondisk_log_start":"361'600","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:35:15.759693+0000","log_size":4768,"ondisk_log_size":4768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":351797248,"num_objects":5368,"num_object_clones":0,"num_object_copies":16104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5368,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5368,"num_write_kb":343552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":382,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.119207+0000","last_change":"2021-10-08T19:36:11.024465+0000","last_active":"2021-10-08T19:36:19.119207+0000","last_peered":"2021-10-08T19:36:19.119207+0000","last_clean":"2021-10-08T19:36:19.119207+0000","last_became_active":"2021-10-08T19:28:40.138726+0000","last_became_peered":"2021-10-08T19:28:40.138726+0000","last_unstale":"2021-10-08T19:36:19.119207+0000","last_undegraded":"2021-10-08T19:36:19.119207+0000","last_fullsized":"2021-10-08T19:36:19.119207+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:11.024348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:50.435552+0000","last_clean_scrub_stamp":"2021-10-08T19:36:11.024348+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012476683000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"289'18","reported_seq":469,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.119259+0000","last_change":"2021-10-08T19:36:01.333174+0000","last_active":"2021-10-08T19:36:19.119259+0000","last_peered":"2021-10-08T19:36:19.119259+0000","last_clean":"2021-10-08T19:36:19.119259+0000","last_became_active":"2021-10-08T19:29:40.638957+0000","last_became_peered":"2021-10-08T19:29:40.638957+0000","last_unstale":"2021-10-08T19:36:19.119259+0000","last_undegraded":"2021-10-08T19:36:19.119259+0000","last_fullsized":"2021-10-08T19:36:19.119259+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'18","last_scrub_stamp":"2021-10-08T19:36:01.333053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:01.333053+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011804939,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":25,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"61'2","reported_seq":371,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.119067+0000","last_change":"2021-10-08T19:35:27.186175+0000","last_active":"2021-10-08T19:36:19.119067+0000","last_peered":"2021-10-08T19:36:19.119067+0000","last_clean":"2021-10-08T19:36:19.119067+0000","last_became_active":"2021-10-08T19:21:23.603614+0000","last_became_peered":"2021-10-08T19:21:23.603614+0000","last_unstale":"2021-10-08T19:36:19.119067+0000","last_undegraded":"2021-10-08T19:36:19.119067+0000","last_fullsized":"2021-10-08T19:36:19.119067+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'2","last_scrub_stamp":"2021-10-08T19:35:27.186086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:27.186086+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0052704600000000002,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":168,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.122009+0000","last_change":"2021-10-08T19:35:18.179768+0000","last_active":"2021-10-08T19:36:19.122009+0000","last_peered":"2021-10-08T19:36:19.122009+0000","last_clean":"2021-10-08T19:36:19.122009+0000","last_became_active":"2021-10-08T19:29:40.645211+0000","last_became_peered":"2021-10-08T19:29:40.645211+0000","last_unstale":"2021-10-08T19:36:19.122009+0000","last_undegraded":"2021-10-08T19:36:19.122009+0000","last_fullsized":"2021-10-08T19:36:19.122009+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:18.179673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:35:18.179673+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.080956615999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":291,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.126380+0000","last_change":"2021-10-08T19:34:44.848499+0000","last_active":"2021-10-08T19:36:19.126380+0000","last_peered":"2021-10-08T19:36:19.126380+0000","last_clean":"2021-10-08T19:36:19.126380+0000","last_became_active":"2021-10-08T19:28:40.100770+0000","last_became_peered":"2021-10-08T19:28:40.100770+0000","last_unstale":"2021-10-08T19:36:19.126380+0000","last_undegraded":"2021-10-08T19:36:19.126380+0000","last_fullsized":"2021-10-08T19:36:19.126380+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:44.848412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:44.848412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011032586,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"289'15","reported_seq":423,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.127176+0000","last_change":"2021-10-08T19:35:25.783136+0000","last_active":"2021-10-08T19:36:19.127176+0000","last_peered":"2021-10-08T19:36:19.127176+0000","last_clean":"2021-10-08T19:36:19.127176+0000","last_became_active":"2021-10-08T19:29:40.644354+0000","last_became_peered":"2021-10-08T19:29:40.644354+0000","last_unstale":"2021-10-08T19:36:19.127176+0000","last_undegraded":"2021-10-08T19:36:19.127176+0000","last_fullsized":"2021-10-08T19:36:19.127176+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'15","last_scrub_stamp":"2021-10-08T19:35:25.783048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:35:25.783048+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0045023340000000002,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":390,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.119134+0000","last_change":"2021-10-08T19:35:19.040312+0000","last_active":"2021-10-08T19:36:19.119134+0000","last_peered":"2021-10-08T19:36:19.119134+0000","last_clean":"2021-10-08T19:36:19.119134+0000","last_became_active":"2021-10-08T19:28:40.139234+0000","last_became_peered":"2021-10-08T19:28:40.139234+0000","last_unstale":"2021-10-08T19:36:19.119134+0000","last_undegraded":"2021-10-08T19:36:19.119134+0000","last_fullsized":"2021-10-08T19:36:19.119134+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:19.040235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:19.040235+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0015896599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":168,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.121659+0000","last_change":"2021-10-08T19:35:19.059789+0000","last_active":"2021-10-08T19:36:19.121659+0000","last_peered":"2021-10-08T19:36:19.121659+0000","last_clean":"2021-10-08T19:36:19.121659+0000","last_became_active":"2021-10-08T19:29:40.645111+0000","last_became_peered":"2021-10-08T19:29:40.645111+0000","last_unstale":"2021-10-08T19:36:19.121659+0000","last_undegraded":"2021-10-08T19:36:19.121659+0000","last_fullsized":"2021-10-08T19:36:19.121659+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:19.059695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:35:19.059695+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0017259879999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":362,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.119058+0000","last_change":"2021-10-08T19:36:17.901591+0000","last_active":"2021-10-08T19:36:19.119058+0000","last_peered":"2021-10-08T19:36:19.119058+0000","last_clean":"2021-10-08T19:36:19.119058+0000","last_became_active":"2021-10-08T19:21:29.640674+0000","last_became_peered":"2021-10-08T19:21:29.640674+0000","last_unstale":"2021-10-08T19:36:19.119058+0000","last_undegraded":"2021-10-08T19:36:19.119058+0000","last_fullsized":"2021-10-08T19:36:19.119058+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:17.901480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:36:17.901480+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034584479999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":283,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.126671+0000","last_change":"2021-10-08T19:35:34.911655+0000","last_active":"2021-10-08T19:36:19.126671+0000","last_peered":"2021-10-08T19:36:19.126671+0000","last_clean":"2021-10-08T19:36:19.126671+0000","last_became_active":"2021-10-08T19:25:15.501118+0000","last_became_peered":"2021-10-08T19:25:15.501118+0000","last_unstale":"2021-10-08T19:36:19.126671+0000","last_undegraded":"2021-10-08T19:36:19.126671+0000","last_fullsized":"2021-10-08T19:36:19.126671+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:34.911590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:34.911590+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.00387858,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"289'12","reported_seq":191,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.121582+0000","last_change":"2021-10-08T19:36:14.746788+0000","last_active":"2021-10-08T19:36:19.121582+0000","last_peered":"2021-10-08T19:36:19.121582+0000","last_clean":"2021-10-08T19:36:19.121582+0000","last_became_active":"2021-10-08T19:29:40.644657+0000","last_became_peered":"2021-10-08T19:29:40.644657+0000","last_unstale":"2021-10-08T19:36:19.121582+0000","last_undegraded":"2021-10-08T19:36:19.121582+0000","last_fullsized":"2021-10-08T19:36:19.121582+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'12","last_scrub_stamp":"2021-10-08T19:36:14.746690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:14.746690+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0050396959999999998,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":18,"num_read_kb":15,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":324,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.121703+0000","last_change":"2021-10-08T19:35:19.626725+0000","last_active":"2021-10-08T19:36:19.121703+0000","last_peered":"2021-10-08T19:36:19.121703+0000","last_clean":"2021-10-08T19:36:19.121703+0000","last_became_active":"2021-10-08T19:28:40.101898+0000","last_became_peered":"2021-10-08T19:28:40.101898+0000","last_unstale":"2021-10-08T19:36:19.121703+0000","last_undegraded":"2021-10-08T19:36:19.121703+0000","last_fullsized":"2021-10-08T19:36:19.121703+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:19.626649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:16.444582+0000","last_clean_scrub_stamp":"2021-10-08T19:35:19.626649+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0017102389999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":387,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.122980+0000","last_change":"2021-10-08T19:34:03.603560+0000","last_active":"2021-10-08T19:36:19.122980+0000","last_peered":"2021-10-08T19:36:19.122980+0000","last_clean":"2021-10-08T19:36:19.122980+0000","last_became_active":"2021-10-08T19:29:40.626950+0000","last_became_peered":"2021-10-08T19:29:40.626950+0000","last_unstale":"2021-10-08T19:36:19.122980+0000","last_undegraded":"2021-10-08T19:36:19.122980+0000","last_fullsized":"2021-10-08T19:36:19.122980+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:03.603487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:34:03.603487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011751039,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":374,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.126420+0000","last_change":"2021-10-08T19:35:33.907637+0000","last_active":"2021-10-08T19:36:19.126420+0000","last_peered":"2021-10-08T19:36:19.126420+0000","last_clean":"2021-10-08T19:36:19.126420+0000","last_became_active":"2021-10-08T19:24:25.099371+0000","last_became_peered":"2021-10-08T19:24:25.099371+0000","last_unstale":"2021-10-08T19:36:19.126420+0000","last_undegraded":"2021-10-08T19:36:19.126420+0000","last_fullsized":"2021-10-08T19:36:19.126420+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:33.907545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:35:33.907545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.028929507,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"70'5","reported_seq":559,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.121326+0000","last_change":"2021-10-08T19:36:07.636175+0000","last_active":"2021-10-08T19:36:19.121326+0000","last_peered":"2021-10-08T19:36:19.121326+0000","last_clean":"2021-10-08T19:36:19.121326+0000","last_became_active":"2021-10-08T19:31:22.785193+0000","last_became_peered":"2021-10-08T19:31:22.785193+0000","last_unstale":"2021-10-08T19:36:19.121326+0000","last_undegraded":"2021-10-08T19:36:19.121326+0000","last_fullsized":"2021-10-08T19:36:19.121326+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":5,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:36:07.636099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:07.636099+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.004695103,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"289'20","reported_seq":239,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.123138+0000","last_change":"2021-10-08T19:35:59.742206+0000","last_active":"2021-10-08T19:36:19.123138+0000","last_peered":"2021-10-08T19:36:19.123138+0000","last_clean":"2021-10-08T19:36:19.123138+0000","last_became_active":"2021-10-08T19:31:51.677055+0000","last_became_peered":"2021-10-08T19:31:51.677055+0000","last_unstale":"2021-10-08T19:36:19.123138+0000","last_undegraded":"2021-10-08T19:36:19.123138+0000","last_fullsized":"2021-10-08T19:36:19.123138+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'20","last_scrub_stamp":"2021-10-08T19:35:59.742121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:35:59.742121+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0052506209999999996,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":373,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.123456+0000","last_change":"2021-10-08T19:35:20.582479+0000","last_active":"2021-10-08T19:36:19.123456+0000","last_peered":"2021-10-08T19:36:19.123456+0000","last_clean":"2021-10-08T19:36:19.123456+0000","last_became_active":"2021-10-08T19:29:40.631331+0000","last_became_peered":"2021-10-08T19:29:40.631331+0000","last_unstale":"2021-10-08T19:36:19.123456+0000","last_undegraded":"2021-10-08T19:36:19.123456+0000","last_fullsized":"2021-10-08T19:36:19.123456+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:20.582397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:20.582397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001422972,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"328'11","reported_seq":567,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.149602+0000","last_change":"2021-10-08T19:33:32.545949+0000","last_active":"2021-10-08T19:36:21.149602+0000","last_peered":"2021-10-08T19:36:21.149602+0000","last_clean":"2021-10-08T19:36:21.149602+0000","last_became_active":"2021-10-08T19:28:40.138031+0000","last_became_peered":"2021-10-08T19:28:40.138031+0000","last_unstale":"2021-10-08T19:36:21.149602+0000","last_undegraded":"2021-10-08T19:36:21.149602+0000","last_fullsized":"2021-10-08T19:36:21.149602+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"328'11","last_scrub_stamp":"2021-10-08T19:33:32.545870+0000","last_deep_scrub":"328'11","last_deep_scrub_stamp":"2021-10-08T19:33:32.545870+0000","last_clean_scrub_stamp":"2021-10-08T19:33:32.545870+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.023323448,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":370,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.127567+0000","last_change":"2021-10-08T19:36:07.150538+0000","last_active":"2021-10-08T19:36:19.127567+0000","last_peered":"2021-10-08T19:36:19.127567+0000","last_clean":"2021-10-08T19:36:19.127567+0000","last_became_active":"2021-10-08T19:29:40.644819+0000","last_became_peered":"2021-10-08T19:29:40.644819+0000","last_unstale":"2021-10-08T19:36:19.127567+0000","last_undegraded":"2021-10-08T19:36:19.127567+0000","last_fullsized":"2021-10-08T19:36:19.127567+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:07.150440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:36:07.150440+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.032064849999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":279,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.126067+0000","last_change":"2021-10-08T19:34:58.902486+0000","last_active":"2021-10-08T19:36:19.126067+0000","last_peered":"2021-10-08T19:36:19.126067+0000","last_clean":"2021-10-08T19:36:19.126067+0000","last_became_active":"2021-10-08T19:25:15.498770+0000","last_became_peered":"2021-10-08T19:25:15.498770+0000","last_unstale":"2021-10-08T19:36:19.126067+0000","last_undegraded":"2021-10-08T19:36:19.126067+0000","last_fullsized":"2021-10-08T19:36:19.126067+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:58.902409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:58.902409+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034749170000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"289'15","reported_seq":135,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.122242+0000","last_change":"2021-10-08T19:33:30.506573+0000","last_active":"2021-10-08T19:36:19.122242+0000","last_peered":"2021-10-08T19:36:19.122242+0000","last_clean":"2021-10-08T19:36:19.122242+0000","last_became_active":"2021-10-08T19:31:22.786860+0000","last_became_peered":"2021-10-08T19:31:22.786860+0000","last_unstale":"2021-10-08T19:36:19.122242+0000","last_undegraded":"2021-10-08T19:36:19.122242+0000","last_fullsized":"2021-10-08T19:36:19.122242+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'15","last_scrub_stamp":"2021-10-08T19:33:30.506458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:33:30.506458+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010013156,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":384,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.124819+0000","last_change":"2021-10-08T19:36:13.061448+0000","last_active":"2021-10-08T19:36:19.124819+0000","last_peered":"2021-10-08T19:36:19.124819+0000","last_clean":"2021-10-08T19:36:19.124819+0000","last_became_active":"2021-10-08T19:29:44.439397+0000","last_became_peered":"2021-10-08T19:29:44.439397+0000","last_unstale":"2021-10-08T19:36:19.124819+0000","last_undegraded":"2021-10-08T19:36:19.124819+0000","last_fullsized":"2021-10-08T19:36:19.124819+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:13.061347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:13.061347+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0089607839999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"238'10","reported_seq":253,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.140282+0000","last_change":"2021-10-08T19:34:14.090645+0000","last_active":"2021-10-08T19:36:21.140282+0000","last_peered":"2021-10-08T19:36:21.140282+0000","last_clean":"2021-10-08T19:36:21.140282+0000","last_became_active":"2021-10-08T19:29:40.637650+0000","last_became_peered":"2021-10-08T19:29:40.637650+0000","last_unstale":"2021-10-08T19:36:21.140282+0000","last_undegraded":"2021-10-08T19:36:21.140282+0000","last_fullsized":"2021-10-08T19:36:21.140282+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"238'10","last_scrub_stamp":"2021-10-08T19:34:14.090547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:34:14.090547+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.017481770000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":349,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.119385+0000","last_change":"2021-10-08T19:36:00.407971+0000","last_active":"2021-10-08T19:36:19.119385+0000","last_peered":"2021-10-08T19:36:19.119385+0000","last_clean":"2021-10-08T19:36:19.119385+0000","last_became_active":"2021-10-08T19:21:29.640302+0000","last_became_peered":"2021-10-08T19:21:29.640302+0000","last_unstale":"2021-10-08T19:36:19.119385+0000","last_undegraded":"2021-10-08T19:36:19.119385+0000","last_fullsized":"2021-10-08T19:36:19.119385+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:00.407898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:36:00.407898+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.105360284,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":291,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.126345+0000","last_change":"2021-10-08T19:34:51.964960+0000","last_active":"2021-10-08T19:36:19.126345+0000","last_peered":"2021-10-08T19:36:19.126345+0000","last_clean":"2021-10-08T19:36:19.126345+0000","last_became_active":"2021-10-08T19:29:40.631374+0000","last_became_peered":"2021-10-08T19:29:40.631374+0000","last_unstale":"2021-10-08T19:36:19.126345+0000","last_undegraded":"2021-10-08T19:36:19.126345+0000","last_fullsized":"2021-10-08T19:36:19.126345+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:51.964844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:51.964844+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010245107,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":295,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.126332+0000","last_change":"2021-10-08T19:35:17.858327+0000","last_active":"2021-10-08T19:36:19.126332+0000","last_peered":"2021-10-08T19:36:19.126332+0000","last_clean":"2021-10-08T19:36:19.126332+0000","last_became_active":"2021-10-08T19:29:40.652966+0000","last_became_peered":"2021-10-08T19:29:40.652966+0000","last_unstale":"2021-10-08T19:36:19.126332+0000","last_undegraded":"2021-10-08T19:36:19.126332+0000","last_fullsized":"2021-10-08T19:36:19.126332+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:17.858192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:17.858192+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0019694320000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"289'19","reported_seq":114,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.130308+0000","last_change":"2021-10-08T19:34:53.739955+0000","last_active":"2021-10-08T19:36:19.130308+0000","last_peered":"2021-10-08T19:36:19.130308+0000","last_clean":"2021-10-08T19:36:19.130308+0000","last_became_active":"2021-10-08T19:31:51.676961+0000","last_became_peered":"2021-10-08T19:31:51.676961+0000","last_unstale":"2021-10-08T19:36:19.130308+0000","last_undegraded":"2021-10-08T19:36:19.130308+0000","last_fullsized":"2021-10-08T19:36:19.130308+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:34:53.739851+0000","last_deep_scrub":"289'19","last_deep_scrub_stamp":"2021-10-08T19:32:46.539792+0000","last_clean_scrub_stamp":"2021-10-08T19:34:53.739851+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.018714432,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":340,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.121935+0000","last_change":"2021-10-08T19:34:52.557866+0000","last_active":"2021-10-08T19:36:19.121935+0000","last_peered":"2021-10-08T19:36:19.121935+0000","last_clean":"2021-10-08T19:36:19.121935+0000","last_became_active":"2021-10-08T19:31:22.786651+0000","last_became_peered":"2021-10-08T19:31:22.786651+0000","last_unstale":"2021-10-08T19:36:19.121935+0000","last_undegraded":"2021-10-08T19:36:19.121935+0000","last_fullsized":"2021-10-08T19:36:19.121935+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:52.557763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:52.557763+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.01007186,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":170,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.121929+0000","last_change":"2021-10-08T19:34:44.147010+0000","last_active":"2021-10-08T19:36:19.121929+0000","last_peered":"2021-10-08T19:36:19.121929+0000","last_clean":"2021-10-08T19:36:19.121929+0000","last_became_active":"2021-10-08T19:29:40.644770+0000","last_became_peered":"2021-10-08T19:29:40.644770+0000","last_unstale":"2021-10-08T19:36:19.121929+0000","last_undegraded":"2021-10-08T19:36:19.121929+0000","last_fullsized":"2021-10-08T19:36:19.121929+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:44.146892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:34:44.146892+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0086783989999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":372,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.124953+0000","last_change":"2021-10-08T19:35:24.753897+0000","last_active":"2021-10-08T19:36:19.124953+0000","last_peered":"2021-10-08T19:36:19.124953+0000","last_clean":"2021-10-08T19:36:19.124953+0000","last_became_active":"2021-10-08T19:28:40.133744+0000","last_became_peered":"2021-10-08T19:28:40.133744+0000","last_unstale":"2021-10-08T19:36:19.124953+0000","last_undegraded":"2021-10-08T19:36:19.124953+0000","last_fullsized":"2021-10-08T19:36:19.124953+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:24.753785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:35:24.753785+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.021400018999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"289'19","reported_seq":509,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.119730+0000","last_change":"2021-10-08T19:36:10.148431+0000","last_active":"2021-10-08T19:36:19.119730+0000","last_peered":"2021-10-08T19:36:19.119730+0000","last_clean":"2021-10-08T19:36:19.119730+0000","last_became_active":"2021-10-08T19:28:40.100196+0000","last_became_peered":"2021-10-08T19:28:40.100196+0000","last_unstale":"2021-10-08T19:36:19.119730+0000","last_undegraded":"2021-10-08T19:36:19.119730+0000","last_fullsized":"2021-10-08T19:36:19.119730+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:36:10.148317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:10.148317+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013984083,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":210,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.128666+0000","last_change":"2021-10-08T19:35:29.678176+0000","last_active":"2021-10-08T19:36:19.128666+0000","last_peered":"2021-10-08T19:36:19.128666+0000","last_clean":"2021-10-08T19:36:19.128666+0000","last_became_active":"2021-10-08T19:28:40.146673+0000","last_became_peered":"2021-10-08T19:28:40.146673+0000","last_unstale":"2021-10-08T19:36:19.128666+0000","last_undegraded":"2021-10-08T19:36:19.128666+0000","last_fullsized":"2021-10-08T19:36:19.128666+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:29.677982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:29.677982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0076172159999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":220,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.130465+0000","last_change":"2021-10-08T19:34:55.788781+0000","last_active":"2021-10-08T19:36:19.130465+0000","last_peered":"2021-10-08T19:36:19.130465+0000","last_clean":"2021-10-08T19:36:19.130465+0000","last_became_active":"2021-10-08T19:29:40.638536+0000","last_became_peered":"2021-10-08T19:29:40.638536+0000","last_unstale":"2021-10-08T19:36:19.130465+0000","last_undegraded":"2021-10-08T19:36:19.130465+0000","last_fullsized":"2021-10-08T19:36:19.130465+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:55.788660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:43.186684+0000","last_clean_scrub_stamp":"2021-10-08T19:34:55.788660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.020657894,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":168,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.121110+0000","last_change":"2021-10-08T19:35:21.993459+0000","last_active":"2021-10-08T19:36:19.121110+0000","last_peered":"2021-10-08T19:36:19.121110+0000","last_clean":"2021-10-08T19:36:19.121110+0000","last_became_active":"2021-10-08T19:29:40.634300+0000","last_became_peered":"2021-10-08T19:29:40.634300+0000","last_unstale":"2021-10-08T19:36:19.121110+0000","last_undegraded":"2021-10-08T19:36:19.121110+0000","last_fullsized":"2021-10-08T19:36:19.121110+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:21.993295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:35:21.993295+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.015124034,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"70'5","reported_seq":279,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.119056+0000","last_change":"2021-10-08T19:36:06.256008+0000","last_active":"2021-10-08T19:36:19.119056+0000","last_peered":"2021-10-08T19:36:19.119056+0000","last_clean":"2021-10-08T19:36:19.119056+0000","last_became_active":"2021-10-08T19:25:15.496309+0000","last_became_peered":"2021-10-08T19:25:15.496309+0000","last_unstale":"2021-10-08T19:36:19.119056+0000","last_undegraded":"2021-10-08T19:36:19.119056+0000","last_fullsized":"2021-10-08T19:36:19.119056+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:36:06.255898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:06.255898+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0073902810000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.10","version":"289'8","reported_seq":197,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.120675+0000","last_change":"2021-10-08T19:36:06.812233+0000","last_active":"2021-10-08T19:36:19.120675+0000","last_peered":"2021-10-08T19:36:19.120675+0000","last_clean":"2021-10-08T19:36:19.120675+0000","last_became_active":"2021-10-08T19:32:45.165103+0000","last_became_peered":"2021-10-08T19:32:45.165103+0000","last_unstale":"2021-10-08T19:36:19.120675+0000","last_undegraded":"2021-10-08T19:36:19.120675+0000","last_fullsized":"2021-10-08T19:36:19.120675+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'8","last_scrub_stamp":"2021-10-08T19:36:06.812115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:06.812115+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010666471,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":373,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.123078+0000","last_change":"2021-10-08T19:35:18.550632+0000","last_active":"2021-10-08T19:36:19.123078+0000","last_peered":"2021-10-08T19:36:19.123078+0000","last_clean":"2021-10-08T19:36:19.123078+0000","last_became_active":"2021-10-08T19:24:25.094384+0000","last_became_peered":"2021-10-08T19:24:25.094384+0000","last_unstale":"2021-10-08T19:36:19.123078+0000","last_undegraded":"2021-10-08T19:36:19.123078+0000","last_fullsized":"2021-10-08T19:36:19.123078+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:18.550521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:13.716331+0000","last_clean_scrub_stamp":"2021-10-08T19:35:18.550521+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0037919709999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":313,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.121774+0000","last_change":"2021-10-08T19:35:27.551866+0000","last_active":"2021-10-08T19:36:19.121774+0000","last_peered":"2021-10-08T19:36:19.121774+0000","last_clean":"2021-10-08T19:36:19.121774+0000","last_became_active":"2021-10-08T19:24:25.106186+0000","last_became_peered":"2021-10-08T19:24:25.106186+0000","last_unstale":"2021-10-08T19:36:19.121774+0000","last_undegraded":"2021-10-08T19:36:19.121774+0000","last_fullsized":"2021-10-08T19:36:19.121774+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:27.551788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:18.377739+0000","last_clean_scrub_stamp":"2021-10-08T19:35:27.551788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0030249280000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":358,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.126095+0000","last_change":"2021-10-08T19:35:57.018331+0000","last_active":"2021-10-08T19:36:19.126095+0000","last_peered":"2021-10-08T19:36:19.126095+0000","last_clean":"2021-10-08T19:36:19.126095+0000","last_became_active":"2021-10-08T19:21:29.642835+0000","last_became_peered":"2021-10-08T19:21:29.642835+0000","last_unstale":"2021-10-08T19:36:19.126095+0000","last_undegraded":"2021-10-08T19:36:19.126095+0000","last_fullsized":"2021-10-08T19:36:19.126095+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:57.018227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:35:57.018227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012449864,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":291,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.122829+0000","last_change":"2021-10-08T19:35:21.620918+0000","last_active":"2021-10-08T19:36:19.122829+0000","last_peered":"2021-10-08T19:36:19.122829+0000","last_clean":"2021-10-08T19:36:19.122829+0000","last_became_active":"2021-10-08T19:28:40.099215+0000","last_became_peered":"2021-10-08T19:28:40.099215+0000","last_unstale":"2021-10-08T19:36:19.122829+0000","last_undegraded":"2021-10-08T19:36:19.122829+0000","last_fullsized":"2021-10-08T19:36:19.122829+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:21.620837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:21.620837+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034355459999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"348'24","reported_seq":197,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.121026+0000","last_change":"2021-10-08T19:34:53.274347+0000","last_active":"2021-10-08T19:36:19.121026+0000","last_peered":"2021-10-08T19:36:19.121026+0000","last_clean":"2021-10-08T19:36:19.121026+0000","last_became_active":"2021-10-08T19:29:40.640914+0000","last_became_peered":"2021-10-08T19:29:40.640914+0000","last_unstale":"2021-10-08T19:36:19.121026+0000","last_undegraded":"2021-10-08T19:36:19.121026+0000","last_fullsized":"2021-10-08T19:36:19.121026+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"348'24","last_scrub_stamp":"2021-10-08T19:34:53.274250+0000","last_deep_scrub":"348'24","last_deep_scrub_stamp":"2021-10-08T19:34:53.274250+0000","last_clean_scrub_stamp":"2021-10-08T19:34:53.274250+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.018882408,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":304,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.124690+0000","last_change":"2021-10-08T19:34:59.547710+0000","last_active":"2021-10-08T19:36:19.124690+0000","last_peered":"2021-10-08T19:36:19.124690+0000","last_clean":"2021-10-08T19:36:19.124690+0000","last_became_active":"2021-10-08T19:24:25.098128+0000","last_became_peered":"2021-10-08T19:24:25.098128+0000","last_unstale":"2021-10-08T19:36:19.124690+0000","last_undegraded":"2021-10-08T19:36:19.124690+0000","last_fullsized":"2021-10-08T19:36:19.124690+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:59.547640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:34.508558+0000","last_clean_scrub_stamp":"2021-10-08T19:34:59.547640+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0015010729999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":370,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.125765+0000","last_change":"2021-10-08T19:35:25.845334+0000","last_active":"2021-10-08T19:36:19.125765+0000","last_peered":"2021-10-08T19:36:19.125765+0000","last_clean":"2021-10-08T19:36:19.125765+0000","last_became_active":"2021-10-08T19:24:25.095490+0000","last_became_peered":"2021-10-08T19:24:25.095490+0000","last_unstale":"2021-10-08T19:36:19.125765+0000","last_undegraded":"2021-10-08T19:36:19.125765+0000","last_fullsized":"2021-10-08T19:36:19.125765+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:25.845262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:11.383779+0000","last_clean_scrub_stamp":"2021-10-08T19:35:25.845262+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0015112610000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":174,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.122321+0000","last_change":"2021-10-08T19:36:12.821415+0000","last_active":"2021-10-08T19:36:19.122321+0000","last_peered":"2021-10-08T19:36:19.122321+0000","last_clean":"2021-10-08T19:36:19.122321+0000","last_became_active":"2021-10-08T19:29:40.639358+0000","last_became_peered":"2021-10-08T19:29:40.639358+0000","last_unstale":"2021-10-08T19:36:19.122321+0000","last_undegraded":"2021-10-08T19:36:19.122321+0000","last_fullsized":"2021-10-08T19:36:19.122321+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:12.821316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:36:12.821316+0000","last_clean_scrub_stamp":"2021-10-08T19:36:12.821316+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.068456382999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"289'20","reported_seq":428,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.127387+0000","last_change":"2021-10-08T19:34:12.001980+0000","last_active":"2021-10-08T19:36:19.127387+0000","last_peered":"2021-10-08T19:36:19.127387+0000","last_clean":"2021-10-08T19:36:19.127387+0000","last_became_active":"2021-10-08T19:29:40.636448+0000","last_became_peered":"2021-10-08T19:29:40.636448+0000","last_unstale":"2021-10-08T19:36:19.127387+0000","last_undegraded":"2021-10-08T19:36:19.127387+0000","last_fullsized":"2021-10-08T19:36:19.127387+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'20","last_scrub_stamp":"2021-10-08T19:34:12.001875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:34:12.001875+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0097733339999999998,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":355,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.121738+0000","last_change":"2021-10-08T19:36:17.700202+0000","last_active":"2021-10-08T19:36:19.121738+0000","last_peered":"2021-10-08T19:36:19.121738+0000","last_clean":"2021-10-08T19:36:19.121738+0000","last_became_active":"2021-10-08T19:21:23.604530+0000","last_became_peered":"2021-10-08T19:21:23.604530+0000","last_unstale":"2021-10-08T19:36:19.121738+0000","last_undegraded":"2021-10-08T19:36:19.121738+0000","last_fullsized":"2021-10-08T19:36:19.121738+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:17.700127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:17.700127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0031895790000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1f","version":"114'10","reported_seq":446,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.148891+0000","last_change":"2021-10-08T19:34:49.474966+0000","last_active":"2021-10-08T19:36:21.148891+0000","last_peered":"2021-10-08T19:36:21.148891+0000","last_clean":"2021-10-08T19:36:21.148891+0000","last_became_active":"2021-10-08T19:24:25.105742+0000","last_became_peered":"2021-10-08T19:24:25.105742+0000","last_unstale":"2021-10-08T19:36:21.148891+0000","last_undegraded":"2021-10-08T19:36:21.148891+0000","last_fullsized":"2021-10-08T19:36:21.148891+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'10","last_scrub_stamp":"2021-10-08T19:34:49.474891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:34:49.474891+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0022257399999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"69'1","reported_seq":351,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.127101+0000","last_change":"2021-10-08T19:34:51.899798+0000","last_active":"2021-10-08T19:36:19.127101+0000","last_peered":"2021-10-08T19:36:19.127101+0000","last_clean":"2021-10-08T19:36:19.127101+0000","last_became_active":"2021-10-08T19:21:29.640296+0000","last_became_peered":"2021-10-08T19:21:29.640296+0000","last_unstale":"2021-10-08T19:36:19.127101+0000","last_undegraded":"2021-10-08T19:36:19.127101+0000","last_fullsized":"2021-10-08T19:36:19.127101+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2021-10-08T19:34:51.899691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:34:51.899691+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012893907,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"289'19","reported_seq":370,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.126545+0000","last_change":"2021-10-08T19:35:15.665522+0000","last_active":"2021-10-08T19:36:19.126545+0000","last_peered":"2021-10-08T19:36:19.126545+0000","last_clean":"2021-10-08T19:36:19.126545+0000","last_became_active":"2021-10-08T19:28:40.126425+0000","last_became_peered":"2021-10-08T19:28:40.126425+0000","last_unstale":"2021-10-08T19:36:19.126545+0000","last_undegraded":"2021-10-08T19:36:19.126545+0000","last_fullsized":"2021-10-08T19:36:19.126545+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:35:15.665434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:35:15.665434+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0027800889999999999,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":168,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.120810+0000","last_change":"2021-10-08T19:34:13.102972+0000","last_active":"2021-10-08T19:36:19.120810+0000","last_peered":"2021-10-08T19:36:19.120810+0000","last_clean":"2021-10-08T19:36:19.120810+0000","last_became_active":"2021-10-08T19:29:40.640952+0000","last_became_peered":"2021-10-08T19:29:40.640952+0000","last_unstale":"2021-10-08T19:36:19.120810+0000","last_undegraded":"2021-10-08T19:36:19.120810+0000","last_fullsized":"2021-10-08T19:36:19.120810+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:13.102869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:13.102869+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0080406309999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":358,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.127465+0000","last_change":"2021-10-08T19:36:02.157958+0000","last_active":"2021-10-08T19:36:19.127465+0000","last_peered":"2021-10-08T19:36:19.127465+0000","last_clean":"2021-10-08T19:36:19.127465+0000","last_became_active":"2021-10-08T19:21:27.632648+0000","last_became_peered":"2021-10-08T19:21:27.632648+0000","last_unstale":"2021-10-08T19:36:19.127465+0000","last_undegraded":"2021-10-08T19:36:19.127465+0000","last_fullsized":"2021-10-08T19:36:19.127465+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:02.157885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:36:02.157885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0018671,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"69'1","reported_seq":206,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.128738+0000","last_change":"2021-10-08T19:35:14.779532+0000","last_active":"2021-10-08T19:36:19.128738+0000","last_peered":"2021-10-08T19:36:19.128738+0000","last_clean":"2021-10-08T19:36:19.128738+0000","last_became_active":"2021-10-08T19:28:40.146302+0000","last_became_peered":"2021-10-08T19:28:40.146302+0000","last_unstale":"2021-10-08T19:36:19.128738+0000","last_undegraded":"2021-10-08T19:36:19.128738+0000","last_fullsized":"2021-10-08T19:36:19.128738+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2021-10-08T19:35:14.779433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:35:14.779433+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.101324384,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"289'27","reported_seq":534,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.119551+0000","last_change":"2021-10-08T19:36:09.038305+0000","last_active":"2021-10-08T19:36:19.119551+0000","last_peered":"2021-10-08T19:36:19.119551+0000","last_clean":"2021-10-08T19:36:19.119551+0000","last_became_active":"2021-10-08T19:29:40.629461+0000","last_became_peered":"2021-10-08T19:29:40.629461+0000","last_unstale":"2021-10-08T19:36:19.119551+0000","last_undegraded":"2021-10-08T19:36:19.119551+0000","last_fullsized":"2021-10-08T19:36:19.119551+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'27","last_scrub_stamp":"2021-10-08T19:36:09.038188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:09.038188+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0091474969999999992,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":550,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":312,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.122733+0000","last_change":"2021-10-08T19:35:59.598376+0000","last_active":"2021-10-08T19:36:19.122733+0000","last_peered":"2021-10-08T19:36:19.122733+0000","last_clean":"2021-10-08T19:36:19.122733+0000","last_became_active":"2021-10-08T19:24:25.106119+0000","last_became_peered":"2021-10-08T19:24:25.106119+0000","last_unstale":"2021-10-08T19:36:19.122733+0000","last_undegraded":"2021-10-08T19:36:19.122733+0000","last_fullsized":"2021-10-08T19:36:19.122733+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:59.598294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:46.422866+0000","last_clean_scrub_stamp":"2021-10-08T19:35:59.598294+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.032131808999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":202,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.128784+0000","last_change":"2021-10-08T19:34:45.792403+0000","last_active":"2021-10-08T19:36:19.128784+0000","last_peered":"2021-10-08T19:36:19.128784+0000","last_clean":"2021-10-08T19:36:19.128784+0000","last_became_active":"2021-10-08T19:28:40.148009+0000","last_became_peered":"2021-10-08T19:28:40.148009+0000","last_unstale":"2021-10-08T19:36:19.128784+0000","last_undegraded":"2021-10-08T19:36:19.128784+0000","last_fullsized":"2021-10-08T19:36:19.128784+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:45.792309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:34:45.792309+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0077010439999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":367,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.118927+0000","last_change":"2021-10-08T19:35:16.284591+0000","last_active":"2021-10-08T19:36:19.118927+0000","last_peered":"2021-10-08T19:36:19.118927+0000","last_clean":"2021-10-08T19:36:19.118927+0000","last_became_active":"2021-10-08T19:24:25.097782+0000","last_became_peered":"2021-10-08T19:24:25.097782+0000","last_unstale":"2021-10-08T19:36:19.118927+0000","last_undegraded":"2021-10-08T19:36:19.118927+0000","last_fullsized":"2021-10-08T19:36:19.118927+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:16.284510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:37.219503+0000","last_clean_scrub_stamp":"2021-10-08T19:35:16.284510+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001625755,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"289'18","reported_seq":195,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.121626+0000","last_change":"2021-10-08T19:36:17.847260+0000","last_active":"2021-10-08T19:36:19.121626+0000","last_peered":"2021-10-08T19:36:19.121626+0000","last_clean":"2021-10-08T19:36:19.121626+0000","last_became_active":"2021-10-08T19:29:40.645144+0000","last_became_peered":"2021-10-08T19:29:40.645144+0000","last_unstale":"2021-10-08T19:36:19.121626+0000","last_undegraded":"2021-10-08T19:36:19.121626+0000","last_fullsized":"2021-10-08T19:36:19.121626+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'18","last_scrub_stamp":"2021-10-08T19:36:17.846978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:17.846978+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.018882475999999999,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":25,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":168,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.122084+0000","last_change":"2021-10-08T19:35:32.854645+0000","last_active":"2021-10-08T19:36:19.122084+0000","last_peered":"2021-10-08T19:36:19.122084+0000","last_clean":"2021-10-08T19:36:19.122084+0000","last_became_active":"2021-10-08T19:29:44.443807+0000","last_became_peered":"2021-10-08T19:29:44.443807+0000","last_unstale":"2021-10-08T19:36:19.122084+0000","last_undegraded":"2021-10-08T19:36:19.122084+0000","last_fullsized":"2021-10-08T19:36:19.122084+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:32.854550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:32.854550+0000","last_clean_scrub_stamp":"2021-10-08T19:35:32.854550+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0089578279999999993,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":369,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.118795+0000","last_change":"2021-10-08T19:34:56.418386+0000","last_active":"2021-10-08T19:36:19.118795+0000","last_peered":"2021-10-08T19:36:19.118795+0000","last_clean":"2021-10-08T19:36:19.118795+0000","last_became_active":"2021-10-08T19:29:40.638352+0000","last_became_peered":"2021-10-08T19:29:40.638352+0000","last_unstale":"2021-10-08T19:36:19.118795+0000","last_undegraded":"2021-10-08T19:36:19.118795+0000","last_fullsized":"2021-10-08T19:36:19.118795+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:56.418264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:34:56.418264+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0060118899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":186,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.121726+0000","last_change":"2021-10-08T19:35:24.071959+0000","last_active":"2021-10-08T19:36:19.121726+0000","last_peered":"2021-10-08T19:36:19.121726+0000","last_clean":"2021-10-08T19:36:19.121726+0000","last_became_active":"2021-10-08T19:31:22.788455+0000","last_became_peered":"2021-10-08T19:31:22.788455+0000","last_unstale":"2021-10-08T19:36:19.121726+0000","last_undegraded":"2021-10-08T19:36:19.121726+0000","last_fullsized":"2021-10-08T19:36:19.121726+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:24.071866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:32:12.549351+0000","last_clean_scrub_stamp":"2021-10-08T19:35:24.071866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.097681799,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"289'15","reported_seq":418,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.119856+0000","last_change":"2021-10-08T19:36:08.207665+0000","last_active":"2021-10-08T19:36:19.119856+0000","last_peered":"2021-10-08T19:36:19.119856+0000","last_clean":"2021-10-08T19:36:19.119856+0000","last_became_active":"2021-10-08T19:29:40.631689+0000","last_became_peered":"2021-10-08T19:29:40.631689+0000","last_unstale":"2021-10-08T19:36:19.119856+0000","last_undegraded":"2021-10-08T19:36:19.119856+0000","last_fullsized":"2021-10-08T19:36:19.119856+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'15","last_scrub_stamp":"2021-10-08T19:36:08.207585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:08.207585+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.016557056000000001,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":366,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.126793+0000","last_change":"2021-10-08T19:36:16.752767+0000","last_active":"2021-10-08T19:36:19.126793+0000","last_peered":"2021-10-08T19:36:19.126793+0000","last_clean":"2021-10-08T19:36:19.126793+0000","last_became_active":"2021-10-08T19:21:23.607785+0000","last_became_peered":"2021-10-08T19:21:23.607785+0000","last_unstale":"2021-10-08T19:36:19.126793+0000","last_undegraded":"2021-10-08T19:36:19.126793+0000","last_fullsized":"2021-10-08T19:36:19.126793+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:16.752654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:16.752654+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0071954510000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":351,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.122716+0000","last_change":"2021-10-08T19:35:27.586471+0000","last_active":"2021-10-08T19:36:19.122716+0000","last_peered":"2021-10-08T19:36:19.122716+0000","last_clean":"2021-10-08T19:36:19.122716+0000","last_became_active":"2021-10-08T19:21:27.633979+0000","last_became_peered":"2021-10-08T19:21:27.633979+0000","last_unstale":"2021-10-08T19:36:19.122716+0000","last_undegraded":"2021-10-08T19:36:19.122716+0000","last_fullsized":"2021-10-08T19:36:19.122716+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:27.586341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:27.586341+0000","last_clean_scrub_stamp":"2021-10-08T19:35:27.586341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0047091140000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":372,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.125545+0000","last_change":"2021-10-08T19:34:50.034539+0000","last_active":"2021-10-08T19:36:19.125545+0000","last_peered":"2021-10-08T19:36:19.125545+0000","last_clean":"2021-10-08T19:36:19.125545+0000","last_became_active":"2021-10-08T19:28:40.159162+0000","last_became_peered":"2021-10-08T19:28:40.159162+0000","last_unstale":"2021-10-08T19:36:19.125545+0000","last_undegraded":"2021-10-08T19:36:19.125545+0000","last_fullsized":"2021-10-08T19:36:19.125545+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:50.034064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:34:50.034064+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.029837211999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"289'7","reported_seq":449,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.119552+0000","last_change":"2021-10-08T19:36:14.120690+0000","last_active":"2021-10-08T19:36:19.119552+0000","last_peered":"2021-10-08T19:36:19.119552+0000","last_clean":"2021-10-08T19:36:19.119552+0000","last_became_active":"2021-10-08T19:31:51.675189+0000","last_became_peered":"2021-10-08T19:31:51.675189+0000","last_unstale":"2021-10-08T19:36:19.119552+0000","last_undegraded":"2021-10-08T19:36:19.119552+0000","last_fullsized":"2021-10-08T19:36:19.119552+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'7","last_scrub_stamp":"2021-10-08T19:36:14.120570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:14.120570+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.006350138,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":10,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":382,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.130177+0000","last_change":"2021-10-08T19:35:24.852668+0000","last_active":"2021-10-08T19:36:19.130177+0000","last_peered":"2021-10-08T19:36:19.130177+0000","last_clean":"2021-10-08T19:36:19.130177+0000","last_became_active":"2021-10-08T19:24:25.096225+0000","last_became_peered":"2021-10-08T19:24:25.096225+0000","last_unstale":"2021-10-08T19:36:19.130177+0000","last_undegraded":"2021-10-08T19:36:19.130177+0000","last_fullsized":"2021-10-08T19:36:19.130177+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:24.852584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:29:40.244757+0000","last_clean_scrub_stamp":"2021-10-08T19:35:24.852584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0014639150000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":374,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.126011+0000","last_change":"2021-10-08T19:34:11.633837+0000","last_active":"2021-10-08T19:36:19.126011+0000","last_peered":"2021-10-08T19:36:19.126011+0000","last_clean":"2021-10-08T19:36:19.126011+0000","last_became_active":"2021-10-08T19:28:40.101187+0000","last_became_peered":"2021-10-08T19:28:40.101187+0000","last_unstale":"2021-10-08T19:36:19.126011+0000","last_undegraded":"2021-10-08T19:36:19.126011+0000","last_fullsized":"2021-10-08T19:36:19.126011+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:11.633739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:11.633739+0000","last_clean_scrub_stamp":"2021-10-08T19:34:11.633739+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0065073010000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":385,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.122147+0000","last_change":"2021-10-08T19:36:10.650417+0000","last_active":"2021-10-08T19:36:19.122147+0000","last_peered":"2021-10-08T19:36:19.122147+0000","last_clean":"2021-10-08T19:36:19.122147+0000","last_became_active":"2021-10-08T19:29:40.632965+0000","last_became_peered":"2021-10-08T19:29:40.632965+0000","last_unstale":"2021-10-08T19:36:19.122147+0000","last_undegraded":"2021-10-08T19:36:19.122147+0000","last_fullsized":"2021-10-08T19:36:19.122147+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:10.650288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:36:10.650288+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.029752064000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"289'19","reported_seq":498,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.118315+0000","last_change":"2021-10-08T19:36:15.167452+0000","last_active":"2021-10-08T19:36:19.118315+0000","last_peered":"2021-10-08T19:36:19.118315+0000","last_clean":"2021-10-08T19:36:19.118315+0000","last_became_active":"2021-10-08T19:28:40.099770+0000","last_became_peered":"2021-10-08T19:28:40.099770+0000","last_unstale":"2021-10-08T19:36:19.118315+0000","last_undegraded":"2021-10-08T19:36:19.118315+0000","last_fullsized":"2021-10-08T19:36:19.118315+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:36:15.167374+0000","last_deep_scrub":"289'19","last_deep_scrub_stamp":"2021-10-08T19:36:15.167374+0000","last_clean_scrub_stamp":"2021-10-08T19:36:15.167374+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0067424360000000001,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":168,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.121248+0000","last_change":"2021-10-08T19:34:04.124983+0000","last_active":"2021-10-08T19:36:19.121248+0000","last_peered":"2021-10-08T19:36:19.121248+0000","last_clean":"2021-10-08T19:36:19.121248+0000","last_became_active":"2021-10-08T19:29:40.627394+0000","last_became_peered":"2021-10-08T19:29:40.627394+0000","last_unstale":"2021-10-08T19:36:19.121248+0000","last_undegraded":"2021-10-08T19:36:19.121248+0000","last_fullsized":"2021-10-08T19:36:19.121248+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:04.124886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:04.124886+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0093513629999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":202,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.128247+0000","last_change":"2021-10-08T19:34:47.797510+0000","last_active":"2021-10-08T19:36:19.128247+0000","last_peered":"2021-10-08T19:36:19.128247+0000","last_clean":"2021-10-08T19:36:19.128247+0000","last_became_active":"2021-10-08T19:28:40.145868+0000","last_became_peered":"2021-10-08T19:28:40.145868+0000","last_unstale":"2021-10-08T19:36:19.128247+0000","last_undegraded":"2021-10-08T19:36:19.128247+0000","last_fullsized":"2021-10-08T19:36:19.128247+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:47.797403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:34:47.797403+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011791311000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":369,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.119770+0000","last_change":"2021-10-08T19:36:03.314076+0000","last_active":"2021-10-08T19:36:19.119770+0000","last_peered":"2021-10-08T19:36:19.119770+0000","last_clean":"2021-10-08T19:36:19.119770+0000","last_became_active":"2021-10-08T19:28:40.099543+0000","last_became_peered":"2021-10-08T19:28:40.099543+0000","last_unstale":"2021-10-08T19:36:19.119770+0000","last_undegraded":"2021-10-08T19:36:19.119770+0000","last_fullsized":"2021-10-08T19:36:19.119770+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:03.313977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:50.032367+0000","last_clean_scrub_stamp":"2021-10-08T19:36:03.313977+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.038973248000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"289'27","reported_seq":202,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.120895+0000","last_change":"2021-10-08T19:34:50.213817+0000","last_active":"2021-10-08T19:36:19.120895+0000","last_peered":"2021-10-08T19:36:19.120895+0000","last_clean":"2021-10-08T19:36:19.120895+0000","last_became_active":"2021-10-08T19:29:40.631002+0000","last_became_peered":"2021-10-08T19:29:40.631002+0000","last_unstale":"2021-10-08T19:36:19.120895+0000","last_undegraded":"2021-10-08T19:36:19.120895+0000","last_fullsized":"2021-10-08T19:36:19.120895+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'27","last_scrub_stamp":"2021-10-08T19:34:50.213690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:34:50.213690+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.016992080999999999,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":358,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.124852+0000","last_change":"2021-10-08T19:35:22.798375+0000","last_active":"2021-10-08T19:36:19.124852+0000","last_peered":"2021-10-08T19:36:19.124852+0000","last_clean":"2021-10-08T19:36:19.124852+0000","last_became_active":"2021-10-08T19:21:23.603422+0000","last_became_peered":"2021-10-08T19:21:23.603422+0000","last_unstale":"2021-10-08T19:36:19.124852+0000","last_undegraded":"2021-10-08T19:36:19.124852+0000","last_fullsized":"2021-10-08T19:36:19.124852+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:22.798309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:15.535842+0000","last_clean_scrub_stamp":"2021-10-08T19:35:22.798309+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0012757689999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":395,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.118556+0000","last_change":"2021-10-08T19:36:11.147338+0000","last_active":"2021-10-08T19:36:19.118556+0000","last_peered":"2021-10-08T19:36:19.118556+0000","last_clean":"2021-10-08T19:36:19.118556+0000","last_became_active":"2021-10-08T19:28:40.099286+0000","last_became_peered":"2021-10-08T19:28:40.099286+0000","last_unstale":"2021-10-08T19:36:19.118556+0000","last_undegraded":"2021-10-08T19:36:19.118556+0000","last_fullsized":"2021-10-08T19:36:19.118556+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:11.147246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:31.176160+0000","last_clean_scrub_stamp":"2021-10-08T19:36:11.147246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.005657235,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":168,"reported_epoch":383,"state":"active+clean","last_fresh":"2021-10-08T19:36:19.122246+0000","last_change":"2021-10-08T19:34:58.263999+0000","last_active":"2021-10-08T19:36:19.122246+0000","last_peered":"2021-10-08T19:36:19.122246+0000","last_clean":"2021-10-08T19:36:19.122246+0000","last_became_active":"2021-10-08T19:29:40.638221+0000","last_became_peered":"2021-10-08T19:29:40.638221+0000","last_unstale":"2021-10-08T19:36:19.122246+0000","last_undegraded":"2021-10-08T19:36:19.122246+0000","last_fullsized":"2021-10-08T19:36:19.122246+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:58.263883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:34:58.263883+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.050129448,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":5610668032,"num_objects":85612,"num_object_clones":0,"num_object_copies":256836,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85612,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85612,"num_write_kb":5479168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16864444416,"data_stored":16864444416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75112,"ondisk_log_size":75112,"up":48,"acting":48,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":11,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1430,"ondisk_log_size":1430,"up":33,"acting":33,"num_store_stats":8},{"poolid":3,"num_pg":23,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":721,"num_read_kb":721,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1167,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":69,"acting":69,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1113,"num_read_kb":870,"num_write":703,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":520,"num_bytes_recovered":10826,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":705,"ondisk_log_size":705,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":96,"acting":96,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201464,"num_pgs":75,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1607488,"kb_used_data":1354704,"kb_used_omap":0,"kb_used_meta":252416,"kb_avail":92137664,"statfs":{"total":95995035648,"available":94348967936,"internally_reserved":0,"allocated":1387216896,"data_stored":1386852798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":258473984},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:35:33 2021","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.3260000000000001,"15min":1.3959999999999999},"min":{"1min":0.26400000000000001,"5min":0.20699999999999999,"15min":0.20100000000000001},"max":{"1min":6.0860000000000003,"5min":8.8160000000000007,"15min":32.366999999999997},"last":3.4929999999999999},{"interface":"front","average":{"1min":0.79400000000000004,"5min":1.8959999999999999,"15min":1.6379999999999999},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":6.0170000000000003,"5min":17.018999999999998,"15min":29.736000000000001},"last":0.27800000000000002}]},{"osd":1,"last update":"Fri Oct 8 19:35:33 2021","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":1.782,"15min":1.6599999999999999},"min":{"1min":0.23599999999999999,"5min":0.19900000000000001,"15min":0.19600000000000001},"max":{"1min":4.0330000000000004,"5min":17.452999999999999,"15min":26.044},"last":0.23699999999999999},{"interface":"front","average":{"1min":1.3580000000000001,"5min":2.0329999999999999,"15min":1.5549999999999999},"min":{"1min":0.28799999999999998,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":6.0819999999999999,"5min":18.053000000000001,"15min":28.119},"last":1.498}]},{"osd":2,"last update":"Fri Oct 8 19:35:33 2021","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.5960000000000001,"15min":1.5589999999999999},"min":{"1min":0.33800000000000002,"5min":0.255,"15min":0.255},"max":{"1min":3.75,"5min":7.524,"15min":27.018000000000001},"last":2.2360000000000002},{"interface":"front","average":{"1min":1.181,"5min":1.6020000000000001,"15min":1.468},"min":{"1min":0.32300000000000001,"5min":0.28199999999999997,"15min":0.27800000000000002},"max":{"1min":4.5800000000000001,"5min":8.2870000000000008,"15min":27.113},"last":0.253}]},{"osd":3,"last update":"Fri Oct 8 19:35:33 2021","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":2.7400000000000002,"15min":2.0430000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":4.6589999999999998,"5min":72.093999999999994,"15min":72.093999999999994},"last":7.8419999999999996},{"interface":"front","average":{"1min":1.1639999999999999,"5min":2.8570000000000002,"15min":2.0259999999999998},"min":{"1min":0.373,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":6.0510000000000002,"5min":71.864999999999995,"15min":71.864999999999995},"last":1.5289999999999999}]},{"osd":4,"last update":"Fri Oct 8 19:35:33 2021","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.99199999999999999,"15min":0.81100000000000005},"min":{"1min":0.315,"5min":0.23899999999999999,"15min":0.22800000000000001},"max":{"1min":6.1130000000000004,"5min":8.391,"15min":8.391},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.97299999999999998,"5min":1.3380000000000001,"15min":0.88300000000000001},"min":{"1min":0.27100000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":5.5229999999999997,"5min":9.0820000000000007,"15min":9.0820000000000007},"last":0.28999999999999998}]},{"osd":5,"last update":"Fri Oct 8 19:35:33 2021","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":1.1950000000000001,"15min":0.93700000000000006},"min":{"1min":0.33800000000000002,"5min":0.26800000000000002,"15min":0.251},"max":{"1min":3.7280000000000002,"5min":9.9280000000000008,"15min":9.9280000000000008},"last":0.31900000000000001},{"interface":"front","average":{"1min":1.002,"5min":1.4139999999999999,"15min":0.95699999999999996},"min":{"1min":0.32400000000000001,"5min":0.30199999999999999,"15min":0.26100000000000001},"max":{"1min":4.1799999999999997,"5min":16.093,"15min":18.655000000000001},"last":1.758}]},{"osd":6,"last update":"Fri Oct 8 19:35:33 2021","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":1.3839999999999999,"15min":0.999},"min":{"1min":0.311,"5min":0.30399999999999999,"15min":0.27900000000000003},"max":{"1min":6.4560000000000004,"5min":17.082000000000001,"15min":17.082000000000001},"last":0.307},{"interface":"front","average":{"1min":1.3,"5min":1.173,"15min":0.94799999999999995},"min":{"1min":0.36799999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":6.1219999999999999,"5min":7.742,"15min":7.742},"last":0.35199999999999998}]}]},{"osd":6,"up_from":47,"seq":201863463100,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2597632,"kb_used_data":2379640,"kb_used_omap":0,"kb_used_meta":217984,"kb_avail":91147520,"statfs":{"total":95995035648,"available":93335060480,"internally_reserved":0,"allocated":2436751360,"data_stored":2436410315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":223215616},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,3,1,4],"upper_bound":32},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:36:17 2021","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":0.95399999999999996,"15min":1.222},"min":{"1min":0.28000000000000003,"5min":0.20899999999999999,"15min":0.20100000000000001},"max":{"1min":4.242,"5min":5.194,"15min":28.382999999999999},"last":0.40500000000000003},{"interface":"front","average":{"1min":2.0590000000000002,"5min":1.609,"15min":1.8029999999999999},"min":{"1min":0.309,"5min":0.22600000000000001,"15min":0.21299999999999999},"max":{"1min":8.4619999999999997,"5min":8.4619999999999997,"15min":69.477000000000004},"last":0.252}]},{"osd":1,"last update":"Fri Oct 8 19:36:17 2021","interfaces":[{"interface":"back","average":{"1min":1.9339999999999999,"5min":1.5229999999999999,"15min":1.1870000000000001},"min":{"1min":0.26500000000000001,"5min":0.23699999999999999,"15min":0.23000000000000001},"max":{"1min":6.1050000000000004,"5min":6.1050000000000004,"15min":14.878},"last":4.4669999999999996},{"interface":"front","average":{"1min":1.6339999999999999,"5min":1.341,"15min":1.2270000000000001},"min":{"1min":0.31,"5min":0.253,"15min":0.253},"max":{"1min":7.0090000000000003,"5min":7.0090000000000003,"15min":14.779},"last":3.2400000000000002}]},{"osd":2,"last update":"Fri Oct 8 19:36:17 2021","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.1499999999999999,"15min":1.5840000000000001},"min":{"1min":0.33100000000000002,"5min":0.27400000000000002,"15min":0.251},"max":{"1min":5.8899999999999997,"5min":6.7960000000000003,"15min":69.322999999999993},"last":0.41999999999999998},{"interface":"front","average":{"1min":1.629,"5min":1.6559999999999999,"15min":1.839},"min":{"1min":0.33700000000000002,"5min":0.315,"15min":0.245},"max":{"1min":5.133,"5min":8.3710000000000004,"15min":69.418999999999997},"last":0.27100000000000002}]},{"osd":3,"last update":"Fri Oct 8 19:36:17 2021","interfaces":[{"interface":"back","average":{"1min":1.5920000000000001,"5min":1.5309999999999999,"15min":1.4990000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.27900000000000003},"max":{"1min":5.4219999999999997,"5min":7.2910000000000004,"15min":21.670000000000002},"last":6.4880000000000004},{"interface":"front","average":{"1min":1.5620000000000001,"5min":1.266,"15min":1.3220000000000001},"min":{"1min":0.41599999999999998,"5min":0.29099999999999998,"15min":0.28000000000000003},"max":{"1min":5.5220000000000002,"5min":8.3360000000000003,"15min":22.254999999999999},"last":0.433}]},{"osd":4,"last update":"Fri Oct 8 19:36:17 2021","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.1379999999999999,"15min":0.90100000000000002},"min":{"1min":0.28599999999999998,"5min":0.28100000000000003,"15min":0.254},"max":{"1min":5.0679999999999996,"5min":6.4459999999999997,"15min":24.516999999999999},"last":0.19600000000000001},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.1419999999999999,"15min":1.087},"min":{"1min":0.33100000000000002,"5min":0.27700000000000002,"15min":0.26100000000000001},"max":{"1min":5.8070000000000004,"5min":5.8070000000000004,"15min":69.593999999999994},"last":1.978}]},{"osd":5,"last update":"Fri Oct 8 19:36:17 2021","interfaces":[{"interface":"back","average":{"1min":1.4199999999999999,"5min":3.0640000000000001,"15min":1.5469999999999999},"min":{"1min":0.307,"5min":0.30399999999999999,"15min":0.28499999999999998},"max":{"1min":4.3209999999999997,"5min":107.485,"15min":107.485},"last":0.22900000000000001},{"interface":"front","average":{"1min":2.0920000000000001,"5min":3.177,"15min":1.8320000000000001},"min":{"1min":0.34399999999999997,"5min":0.31,"15min":0.252},"max":{"1min":7.4900000000000002,"5min":107.90300000000001,"15min":107.90300000000001},"last":1.9470000000000001}]},{"osd":7,"last update":"Fri Oct 8 19:35:44 2021","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":1.135,"15min":0.82999999999999996},"min":{"1min":0.32200000000000001,"5min":0.29599999999999999,"15min":0.27800000000000002},"max":{"1min":2.823,"5min":7.1230000000000002,"15min":7.1230000000000002},"last":0.34399999999999997},{"interface":"front","average":{"1min":1.161,"5min":1.272,"15min":1.008},"min":{"1min":0.38400000000000001,"5min":0.32800000000000001,"15min":0.313},"max":{"1min":4.6699999999999999,"5min":4.6699999999999999,"15min":15.962},"last":0.29899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575055,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1336880,"kb_used_data":1020712,"kb_used_omap":0,"kb_used_meta":316160,"kb_avail":92408272,"statfs":{"total":95995035648,"available":94626070528,"internally_reserved":0,"allocated":1045209088,"data_stored":1044819709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":323747840},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:36:01 2021","interfaces":[{"interface":"back","average":{"1min":3.5099999999999998,"5min":2.96,"15min":3.1589999999999998},"min":{"1min":0.188,"5min":0.188,"15min":0.184},"max":{"1min":40.173000000000002,"5min":102.352,"15min":126.256},"last":4.0510000000000002},{"interface":"front","average":{"1min":3.3820000000000001,"5min":3.0099999999999998,"15min":3.3940000000000001},"min":{"1min":0.25600000000000001,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":40.337000000000003,"5min":102.462,"15min":126.176},"last":0.33800000000000002}]},{"osd":2,"last update":"Fri Oct 8 19:36:16 2021","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":2.4609999999999999,"15min":2.3250000000000002},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.192},"max":{"1min":11.497,"5min":102.395,"15min":102.395},"last":3.6150000000000002},{"interface":"front","average":{"1min":0.94499999999999995,"5min":2.5800000000000001,"15min":2.6269999999999998},"min":{"1min":0.27600000000000002,"5min":0.253,"15min":0.22700000000000001},"max":{"1min":3.7919999999999998,"5min":102.50700000000001,"15min":102.50700000000001},"last":3.4049999999999998}]},{"osd":3,"last update":"Fri Oct 8 19:35:31 2021","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":3.5979999999999999,"15min":2.734},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.23999999999999999},"max":{"1min":3.8359999999999999,"5min":105.836,"15min":105.836},"last":3.371},{"interface":"front","average":{"1min":1.3520000000000001,"5min":3.73,"15min":2.6080000000000001},"min":{"1min":0.307,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":11.473000000000001,"5min":106.12,"15min":106.12},"last":3.5049999999999999}]},{"osd":4,"last update":"Fri Oct 8 19:35:45 2021","interfaces":[{"interface":"back","average":{"1min":1.7210000000000001,"5min":2.7160000000000002,"15min":1.9419999999999999},"min":{"1min":0.34599999999999997,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":6.7649999999999997,"5min":103.538,"15min":103.538},"last":1.8460000000000001},{"interface":"front","average":{"1min":1.28,"5min":2.4580000000000002,"15min":1.569},"min":{"1min":0.34999999999999998,"5min":0.27100000000000002,"15min":0.254},"max":{"1min":11.337999999999999,"5min":102.67100000000001,"15min":102.67100000000001},"last":3.4609999999999999}]},{"osd":5,"last update":"Fri Oct 8 19:36:11 2021","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":5.7439999999999998,"15min":3.0459999999999998},"min":{"1min":0.28599999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":3.9980000000000002,"5min":262.14100000000002,"15min":262.14100000000002},"last":0.41999999999999998},{"interface":"front","average":{"1min":1.5409999999999999,"5min":5.8869999999999996,"15min":2.7749999999999999},"min":{"1min":0.33500000000000002,"5min":0.30099999999999999,"15min":0.29999999999999999},"max":{"1min":11.414999999999999,"5min":261.959,"15min":261.959},"last":3.552}]},{"osd":6,"last update":"Fri Oct 8 19:35:26 2021","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":2.6349999999999998,"15min":1.946},"min":{"1min":0.35999999999999999,"5min":0.34100000000000003,"15min":0.26700000000000002},"max":{"1min":6.8159999999999998,"5min":103.73,"15min":103.73},"last":1.8009999999999999},{"interface":"front","average":{"1min":1.141,"5min":2.544,"15min":1.948},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.28399999999999997},"max":{"1min":3.8580000000000001,"5min":102.753,"15min":102.753},"last":0.377}]},{"osd":7,"last update":"Fri Oct 8 19:35:45 2021","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":3.7170000000000001,"15min":2.3860000000000001},"min":{"1min":0.42499999999999999,"5min":0.316,"15min":0.312},"max":{"1min":2.1139999999999999,"5min":106.011,"15min":106.011},"last":0.39900000000000002},{"interface":"front","average":{"1min":1.514,"5min":3.8330000000000002,"15min":2.0630000000000002},"min":{"1min":0.44600000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":11.445,"5min":103.78400000000001,"15min":103.78400000000001},"last":3.5819999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738578,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3659196,"kb_used_data":3390284,"kb_used_omap":0,"kb_used_meta":268544,"kb_avail":90085956,"statfs":{"total":95995035648,"available":92248018944,"internally_reserved":0,"allocated":3471650816,"data_stored":3471289638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":274989056},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,3,1,2,1,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 8 19:35:54 2021","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":2.2090000000000001,"15min":2.0720000000000001},"min":{"1min":0.20399999999999999,"5min":0.185,"15min":0.185},"max":{"1min":4.1059999999999999,"5min":91.954999999999998,"15min":91.954999999999998},"last":1.6299999999999999},{"interface":"front","average":{"1min":1.0760000000000001,"5min":2.8250000000000002,"15min":2.2400000000000002},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":5.7750000000000004,"5min":91.046000000000006,"15min":91.046000000000006},"last":0.48399999999999999}]},{"osd":2,"last update":"Fri Oct 8 19:36:19 2021","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.458,"15min":2.0110000000000001},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":3.9540000000000002,"5min":9.6129999999999995,"15min":62.390000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":1.6519999999999999,"5min":1.611,"15min":1.9419999999999999},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.19500000000000001},"max":{"1min":7.0640000000000001,"5min":10.026,"15min":62.718000000000004},"last":7.0640000000000001}]},{"osd":3,"last update":"Fri Oct 8 19:35:40 2021","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":2.1560000000000001,"15min":2.1789999999999998},"min":{"1min":0.316,"5min":0.218,"15min":0.217},"max":{"1min":4.3780000000000001,"5min":14.551,"15min":62.491},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":1.8120000000000001,"15min":1.9259999999999999},"min":{"1min":0.22600000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":3.831,"5min":22.016999999999999,"15min":62.673000000000002},"last":6.7199999999999998}]},{"osd":4,"last update":"Fri Oct 8 19:35:54 2021","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.6599999999999999,"15min":1.593},"min":{"1min":0.34100000000000003,"5min":0.25800000000000001,"15min":0.22900000000000001},"max":{"1min":5.7759999999999998,"5min":16.805,"15min":16.805},"last":1.6990000000000001},{"interface":"front","average":{"1min":0.90000000000000002,"5min":1.3560000000000001,"15min":1.377},"min":{"1min":0.34399999999999997,"5min":0.30299999999999999,"15min":0.28199999999999997},"max":{"1min":4.0650000000000004,"5min":7.0890000000000004,"15min":11.823},"last":0.67300000000000004}]},{"osd":5,"last update":"Fri Oct 8 19:36:11 2021","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":1.446,"15min":1.302},"min":{"1min":0.39900000000000002,"5min":0.311,"15min":0.24099999999999999},"max":{"1min":2.2970000000000002,"5min":9.9529999999999994,"15min":15.56},"last":6.7770000000000001},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.599,"15min":1.599},"min":{"1min":0.33100000000000002,"5min":0.31900000000000001,"15min":0.28599999999999998},"max":{"1min":4.4390000000000001,"5min":15.115,"15min":15.484999999999999},"last":1.6040000000000001}]},{"osd":6,"last update":"Fri Oct 8 19:35:23 2021","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.454,"15min":1.446},"min":{"1min":0.435,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":4.1449999999999996,"5min":7.165,"15min":11.869},"last":0.69999999999999996},{"interface":"front","average":{"1min":1.9259999999999999,"5min":1.651,"15min":1.419},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.27500000000000002},"max":{"1min":9.9990000000000006,"5min":9.9990000000000006,"15min":10.519},"last":6.8029999999999999}]},{"osd":7,"last update":"Fri Oct 8 19:35:40 2021","interfaces":[{"interface":"back","average":{"1min":1.6319999999999999,"5min":1.7310000000000001,"15min":1.6299999999999999},"min":{"1min":0.39400000000000002,"5min":0.38200000000000001,"15min":0.35399999999999998},"max":{"1min":6.2699999999999996,"5min":7.4470000000000001,"15min":11.669},"last":1.667},{"interface":"front","average":{"1min":1.528,"5min":1.673,"15min":1.6879999999999999},"min":{"1min":0.40899999999999997,"5min":0.34999999999999998,"15min":0.33400000000000002},"max":{"1min":7.2279999999999998,"5min":7.2279999999999998,"15min":11.898999999999999},"last":0.72399999999999998}]}]},{"osd":2,"up_from":18,"seq":77309411530,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2281324,"kb_used_data":2036476,"kb_used_omap":0,"kb_used_meta":244480,"kb_avail":91463828,"statfs":{"total":95995035648,"available":93658959872,"internally_reserved":0,"allocated":2085351424,"data_stored":2085006681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":250347520},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:36:08 2021","interfaces":[{"interface":"back","average":{"1min":1.9470000000000001,"5min":1.4299999999999999,"15min":2.2589999999999999},"min":{"1min":0.19900000000000001,"5min":0.184,"15min":0.184},"max":{"1min":10.83,"5min":17.491,"15min":61.670999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.4350000000000001,"15min":2.242},"min":{"1min":0.26700000000000002,"5min":0.215,"15min":0.17999999999999999},"max":{"1min":5.5510000000000002,"5min":7.8049999999999997,"15min":65.284999999999997},"last":8.1959999999999997}]},{"osd":1,"last update":"Fri Oct 8 19:36:08 2021","interfaces":[{"interface":"back","average":{"1min":1.677,"5min":3.0609999999999999,"15min":2.5619999999999998},"min":{"1min":0.22900000000000001,"5min":0.19700000000000001,"15min":0.192},"max":{"1min":9.3059999999999992,"5min":63.738,"15min":63.738},"last":4.234},{"interface":"front","average":{"1min":1.375,"5min":3.2309999999999999,"15min":2.798},"min":{"1min":0.26000000000000001,"5min":0.23899999999999999,"15min":0.21299999999999999},"max":{"1min":5.5789999999999997,"5min":63.619999999999997,"15min":63.619999999999997},"last":0.75}]},{"osd":3,"last update":"Fri Oct 8 19:36:18 2021","interfaces":[{"interface":"back","average":{"1min":1.5409999999999999,"5min":3.2429999999999999,"15min":2.7629999999999999},"min":{"1min":0.27300000000000002,"5min":0.254,"15min":0.21199999999999999},"max":{"1min":5.742,"5min":63.658999999999999,"15min":65.322999999999993},"last":0.51800000000000002},{"interface":"front","average":{"1min":1.8069999999999999,"5min":2.8610000000000002,"15min":2.6579999999999999},"min":{"1min":0.26100000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":9.218,"5min":65.418000000000006,"15min":65.418000000000006},"last":0.56100000000000005}]},{"osd":4,"last update":"Fri Oct 8 19:35:45 2021","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.111,"15min":1.391},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.26900000000000002},"max":{"1min":6.5380000000000003,"5min":6.5380000000000003,"15min":24.657},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.83299999999999996,"5min":1.3280000000000001,"15min":1.4690000000000001},"min":{"1min":0.314,"5min":0.28299999999999997,"15min":0.26600000000000001},"max":{"1min":5.524,"5min":7.7469999999999999,"15min":15.143000000000001},"last":3.6280000000000001}]},{"osd":5,"last update":"Fri Oct 8 19:36:08 2021","interfaces":[{"interface":"back","average":{"1min":1.9099999999999999,"5min":1.702,"15min":1.5880000000000001},"min":{"1min":0.35799999999999998,"5min":0.315,"15min":0.28899999999999998},"max":{"1min":5.625,"5min":7.7409999999999997,"15min":15.087999999999999},"last":3.6749999999999998},{"interface":"front","average":{"1min":1.915,"5min":1.516,"15min":1.607},"min":{"1min":0.44400000000000001,"5min":0.29499999999999998,"15min":0.27600000000000002},"max":{"1min":8.1769999999999996,"5min":10.862,"15min":26.094000000000001},"last":3.8849999999999998}]},{"osd":6,"last update":"Fri Oct 8 19:36:18 2021","interfaces":[{"interface":"back","average":{"1min":2.3359999999999999,"5min":1.2509999999999999,"15min":1.488},"min":{"1min":0.33900000000000002,"5min":0.29999999999999999,"15min":0.28000000000000003},"max":{"1min":6.6909999999999998,"5min":6.6909999999999998,"15min":14.162000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":2.5830000000000002,"5min":1.6990000000000001,"15min":1.637},"min":{"1min":0.46999999999999997,"5min":0.33600000000000002,"15min":0.313},"max":{"1min":8.7829999999999995,"5min":8.7829999999999995,"15min":16.68},"last":3.8559999999999999}]},{"osd":7,"last update":"Fri Oct 8 19:35:45 2021","interfaces":[{"interface":"back","average":{"1min":1.512,"5min":3.1680000000000001,"15min":2.1230000000000002},"min":{"1min":0.32600000000000001,"5min":0.32200000000000001,"15min":0.31900000000000001},"max":{"1min":6.4119999999999999,"5min":136.00200000000001,"15min":136.00200000000001},"last":3.7330000000000001},{"interface":"front","average":{"1min":1.345,"5min":3.056,"15min":2.044},"min":{"1min":0.41499999999999998,"5min":0.36399999999999999,"15min":0.34899999999999998},"max":{"1min":3.9049999999999998,"5min":133.26300000000001,"15min":133.26300000000001},"last":3.907}]}]},{"osd":3,"up_from":24,"seq":103079215304,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2062888,"kb_used_data":1717280,"kb_used_omap":0,"kb_used_meta":345600,"kb_avail":91682264,"statfs":{"total":95995035648,"available":93882638336,"internally_reserved":0,"allocated":1758494720,"data_stored":1758114123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":353894400},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:35:31 2021","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":2.347,"15min":2.331},"min":{"1min":0.22600000000000001,"5min":0.187,"15min":0.17000000000000001},"max":{"1min":6.4630000000000001,"5min":13.036,"15min":109.601},"last":4.7270000000000003},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.76,"15min":2.2440000000000002},"min":{"1min":0.20799999999999999,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":10.743,"5min":12.696999999999999,"15min":107.84},"last":3.2879999999999998}]},{"osd":1,"last update":"Fri Oct 8 19:35:31 2021","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":2.2029999999999998,"15min":1.911},"min":{"1min":0.27400000000000002,"5min":0.24299999999999999,"15min":0.20999999999999999},"max":{"1min":7.4690000000000003,"5min":37.271999999999998,"15min":37.271999999999998},"last":1.3049999999999999},{"interface":"front","average":{"1min":0.498,"5min":1.794,"15min":1.845},"min":{"1min":0.23899999999999999,"5min":0.19,"15min":0.19},"max":{"1min":1.6859999999999999,"5min":37.033000000000001,"15min":37.033000000000001},"last":4.1369999999999996}]},{"osd":2,"last update":"Fri Oct 8 19:35:31 2021","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":1.236,"15min":1.8009999999999999},"min":{"1min":0.28699999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":2.3730000000000002,"5min":7.6890000000000001,"15min":32.277000000000001},"last":4.274},{"interface":"front","average":{"1min":0.995,"5min":2.2280000000000002,"15min":1.8300000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.22700000000000001},"max":{"1min":6.625,"5min":23.189,"15min":23.189},"last":3.7999999999999998}]},{"osd":4,"last update":"Fri Oct 8 19:35:46 2021","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.7030000000000001,"15min":1.53},"min":{"1min":0.30499999999999999,"5min":0.29199999999999998,"15min":0.25600000000000001},"max":{"1min":7.3849999999999998,"5min":13.968,"15min":18.064},"last":3.625},{"interface":"front","average":{"1min":1.335,"5min":1.482,"15min":1.6419999999999999},"min":{"1min":0.42499999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":7.5069999999999997,"5min":10.632,"15min":18.692},"last":1.2709999999999999}]},{"osd":5,"last update":"Fri Oct 8 19:36:04 2021","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":2.1030000000000002,"15min":1.7070000000000001},"min":{"1min":0.33400000000000002,"5min":0.28299999999999997,"15min":0.27000000000000002},"max":{"1min":1.369,"5min":75.397000000000006,"15min":75.397000000000006},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.21,"5min":2.9409999999999998,"15min":1.9810000000000001},"min":{"1min":0.34000000000000002,"5min":0.311,"15min":0.28100000000000003},"max":{"1min":5.4770000000000003,"5min":75.680000000000007,"15min":75.680000000000007},"last":3.585}]},{"osd":6,"last update":"Fri Oct 8 19:36:19 2021","interfaces":[{"interface":"back","average":{"1min":1.885,"5min":1.6579999999999999,"15min":1.849},"min":{"1min":0.45300000000000001,"5min":0.33900000000000002,"15min":0.28599999999999998},"max":{"1min":9.5,"5min":9.5,"15min":21.538},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.331,"5min":1.3089999999999999,"15min":1.5349999999999999},"min":{"1min":0.36499999999999999,"5min":0.35599999999999998,"15min":0.32700000000000001},"max":{"1min":7.5010000000000003,"5min":7.5010000000000003,"15min":13.298},"last":0.92200000000000004}]},{"osd":7,"last update":"Fri Oct 8 19:35:46 2021","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.7190000000000001,"15min":1.6000000000000001},"min":{"1min":0.38100000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":7.5780000000000003,"5min":10.656000000000001,"15min":10.696999999999999},"last":1.3660000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":1.353,"15min":1.488},"min":{"1min":0.38,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.875,"5min":7.165,"15min":13.225},"last":0.86199999999999999}]}]},{"osd":4,"up_from":30,"seq":128849019074,"num_pgs":74,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2974560,"kb_used_data":2758168,"kb_used_omap":0,"kb_used_meta":216384,"kb_avail":90770592,"statfs":{"total":95995035648,"available":92949086208,"internally_reserved":0,"allocated":2824364032,"data_stored":2823991606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":221577216},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:35:47 2021","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":1.0209999999999999,"15min":1.71},"min":{"1min":0.217,"5min":0.20899999999999999,"15min":0.185},"max":{"1min":2.7999999999999998,"5min":7.1319999999999997,"15min":82.109999999999999},"last":1.8220000000000001},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.1990000000000001,"15min":1.712},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.20399999999999999},"max":{"1min":4.6559999999999997,"5min":7.0330000000000004,"15min":82.025999999999996},"last":2.7109999999999999}]},{"osd":1,"last update":"Fri Oct 8 19:35:47 2021","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":3.1880000000000002,"15min":2.1120000000000001},"min":{"1min":0.28100000000000003,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":4.0289999999999999,"5min":122.422,"15min":122.422},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.85599999999999998,"5min":2.9409999999999998,"15min":1.8580000000000001},"min":{"1min":0.25,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":3.6070000000000002,"5min":123.122,"15min":123.122},"last":0.41099999999999998}]},{"osd":2,"last update":"Fri Oct 8 19:35:47 2021","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":1.25,"15min":1.3160000000000001},"min":{"1min":0.41399999999999998,"5min":0.26100000000000001,"15min":0.23499999999999999},"max":{"1min":2.8900000000000001,"5min":7.9189999999999996,"15min":21.257000000000001},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.89800000000000002,"5min":1.21,"15min":1.3180000000000001},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":4.6349999999999998,"5min":5.0270000000000001,"15min":21.600000000000001},"last":3.8370000000000002}]},{"osd":3,"last update":"Fri Oct 8 19:35:47 2021","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":1.5209999999999999,"15min":1.9910000000000001},"min":{"1min":0.30599999999999999,"5min":0.28699999999999998,"15min":0.26500000000000001},"max":{"1min":4.5990000000000002,"5min":7.4130000000000003,"15min":58.506999999999998},"last":1.7110000000000001},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.5669999999999999,"15min":1.732},"min":{"1min":0.38400000000000001,"5min":0.254,"15min":0.254},"max":{"1min":8.5540000000000003,"5min":8.5540000000000003,"15min":58.521000000000001},"last":0.34300000000000003}]},{"osd":5,"last update":"Fri Oct 8 19:36:07 2021","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.288,"15min":0.84999999999999998},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.222},"max":{"1min":3.327,"5min":7.101,"15min":7.101},"last":0.313},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.1180000000000001,"15min":0.80300000000000005},"min":{"1min":0.35299999999999998,"5min":0.27700000000000002,"15min":0.22900000000000001},"max":{"1min":3.0019999999999998,"5min":7.8029999999999999,"15min":8.1319999999999997},"last":0.35299999999999998}]},{"osd":6,"last update":"Fri Oct 8 19:36:24 2021","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.0029999999999999,"15min":0.81399999999999995},"min":{"1min":0.32200000000000001,"5min":0.28699999999999998,"15min":0.23599999999999999},"max":{"1min":4.1879999999999997,"5min":5.4800000000000004,"15min":6.7300000000000004},"last":1.091},{"interface":"front","average":{"1min":1.28,"5min":1.1379999999999999,"15min":0.873},"min":{"1min":0.35699999999999998,"5min":0.26600000000000001,"15min":0.247},"max":{"1min":3.8620000000000001,"5min":6.1319999999999997,"15min":7.0720000000000001},"last":0.45300000000000001}]},{"osd":7,"last update":"Fri Oct 8 19:35:47 2021","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.1160000000000001,"15min":0.80400000000000005},"min":{"1min":0.33200000000000002,"5min":0.31,"15min":0.26400000000000001},"max":{"1min":6.157,"5min":8.0050000000000008,"15min":8.0050000000000008},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.042,"15min":0.86399999999999999},"min":{"1min":0.42599999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":4.665,"5min":4.665,"15min":6.3959999999999999},"last":1.127}]}]},{"osd":5,"up_from":38,"seq":163208757438,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2000144,"kb_used_data":1701832,"kb_used_omap":0,"kb_used_meta":298304,"kb_avail":91745008,"statfs":{"total":95995035648,"available":93946888192,"internally_reserved":0,"allocated":1742675968,"data_stored":1742320294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":305463296},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:36:05 2021","interfaces":[{"interface":"back","average":{"1min":3.0329999999999999,"5min":1.6379999999999999,"15min":1.383},"min":{"1min":0.23799999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":43.332999999999998,"5min":43.332999999999998,"15min":43.332999999999998},"last":0.41699999999999998},{"interface":"front","average":{"1min":3.161,"5min":1.7170000000000001,"15min":1.381},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":42.637,"5min":42.637,"15min":42.637},"last":0.34599999999999997}]},{"osd":1,"last update":"Fri Oct 8 19:36:05 2021","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":2.0249999999999999,"15min":1.6339999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23000000000000001},"max":{"1min":4.6059999999999999,"5min":94.558999999999997,"15min":94.558999999999997},"last":0.372},{"interface":"front","average":{"1min":0.94999999999999996,"5min":1.9430000000000001,"15min":1.577},"min":{"1min":0.40100000000000002,"5min":0.23899999999999999,"15min":0.23100000000000001},"max":{"1min":3.9729999999999999,"5min":94.456999999999994,"15min":94.456999999999994},"last":0.36699999999999999}]},{"osd":2,"last update":"Fri Oct 8 19:36:05 2021","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":1.2450000000000001,"15min":1.5389999999999999},"min":{"1min":0.29799999999999999,"5min":0.27000000000000002,"15min":0.25700000000000001},"max":{"1min":3.452,"5min":8.1259999999999994,"15min":29.398},"last":0.38400000000000001},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.2190000000000001,"15min":1.5249999999999999},"min":{"1min":0.38500000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":4.0730000000000004,"5min":8.3599999999999994,"15min":29.387},"last":0.34100000000000003}]},{"osd":3,"last update":"Fri Oct 8 19:36:05 2021","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.847,"15min":1.599},"min":{"1min":0.33900000000000002,"5min":0.27000000000000002,"15min":0.26200000000000001},"max":{"1min":3.8130000000000002,"5min":11.685,"15min":12.356},"last":0.32500000000000001},{"interface":"front","average":{"1min":1.6659999999999999,"5min":1.6140000000000001,"15min":1.6870000000000001},"min":{"1min":0.38100000000000001,"5min":0.218,"15min":0.218},"max":{"1min":8.9920000000000009,"5min":8.9920000000000009,"15min":21.504000000000001},"last":0.42399999999999999}]},{"osd":4,"last update":"Fri Oct 8 19:36:05 2021","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.96799999999999997,"15min":0.745},"min":{"1min":0.28199999999999997,"5min":0.25800000000000001,"15min":0.224},"max":{"1min":4.0990000000000002,"5min":9.2759999999999998,"15min":9.2759999999999998},"last":0.27000000000000002},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.044,"15min":0.76800000000000002},"min":{"1min":0.36499999999999999,"5min":0.27100000000000002,"15min":0.23799999999999999},"max":{"1min":4.569,"5min":7.8959999999999999,"15min":7.8959999999999999},"last":0.28999999999999998}]},{"osd":6,"last update":"Fri Oct 8 19:35:23 2021","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.92800000000000005,"15min":0.77400000000000002},"min":{"1min":0.309,"5min":0.255,"15min":0.255},"max":{"1min":1.7410000000000001,"5min":5.8879999999999999,"15min":7.266},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.98199999999999998,"15min":0.77200000000000002},"min":{"1min":0.316,"5min":0.29199999999999998,"15min":0.29099999999999998},"max":{"1min":3.226,"5min":7.9390000000000001,"15min":7.9390000000000001},"last":0.35699999999999998}]},{"osd":7,"last update":"Fri Oct 8 19:35:40 2021","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":1.343,"15min":0.91100000000000003},"min":{"1min":0.38200000000000001,"5min":0.252,"15min":0.252},"max":{"1min":7.1390000000000002,"5min":29.946999999999999,"15min":29.946999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":1.4139999999999999,"15min":0.98099999999999998},"min":{"1min":0.39100000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":2.0009999999999999,"5min":29.294,"15min":29.294},"last":0.39600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":266240,"data_stored":262688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":327680,"data_stored":327680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3510108160,"data_stored":3510108160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1049821184,"data_stored":1049821184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2105999360,"data_stored":2105999360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1766129664,"data_stored":1766129664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2834825216,"data_stored":2834825216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1759576064,"data_stored":1759576064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":2436235264,"data_stored":2436235264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1401749504,"data_stored":1401749504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-10-08T19:36:29.937 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph pg dump --format=json 2021-10-08T19:36:29.965 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:36:30.027 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:30.395 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 64 16 92561 92545 90.3149 69.8125 0.0102321 0.0110678 2021-10-08T19:36:30.499 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:36:30.511 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:30.512 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:30 smithi097 ceph-mon[32687]: from='client.15954 v1:172.21.15.97:0/275283651' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:36:30.512 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:30 smithi097 ceph-mon[32687]: pgmap v757: 178 pgs: 178 active+clean; 5.4 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1.0 KiB/s rd, 63 MiB/s wr, 1.01k op/s 2021-10-08T19:36:30.513 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:30 smithi097 ceph-mon[32687]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:36:30.513 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:30 smithi097 ceph-mon[32687]: from='client.35921 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:36:30.513 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:30 smithi097 ceph-mon[32687]: osdmap e385: 8 total, 8 up, 8 in 2021-10-08T19:36:30.514 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:30 smithi097 ceph-mon[41966]: from='client.15954 v1:172.21.15.97:0/275283651' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:36:30.514 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:30 smithi097 ceph-mon[41966]: pgmap v757: 178 pgs: 178 active+clean; 5.4 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1.0 KiB/s rd, 63 MiB/s wr, 1.01k op/s 2021-10-08T19:36:30.514 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:30 smithi097 ceph-mon[41966]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:36:30.514 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:30 smithi097 ceph-mon[41966]: from='client.35921 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:36:30.515 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:30 smithi097 ceph-mon[41966]: osdmap e385: 8 total, 8 up, 8 in 2021-10-08T19:36:30.515 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:36:30.617 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:36:30.664 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:30 smithi117 ceph-mon[34585]: from='client.15954 v1:172.21.15.97:0/275283651' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:36:30.665 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:30 smithi117 ceph-mon[34585]: pgmap v757: 178 pgs: 178 active+clean; 5.4 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1.0 KiB/s rd, 63 MiB/s wr, 1.01k op/s 2021-10-08T19:36:30.665 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:30 smithi117 ceph-mon[34585]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:36:30.666 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:30 smithi117 ceph-mon[34585]: from='client.35921 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:36:30.666 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:30 smithi117 ceph-mon[34585]: osdmap e385: 8 total, 8 up, 8 in 2021-10-08T19:36:30.683 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:30.804 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:30.805 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:36:30.809 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:36:30.911 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:36:30.947 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:31.031 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:36:31.034 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:31.035 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:36:31.065 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2021-10-08T19:36:31.066 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:36:31.102 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:36:31.136 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:36:31.171 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:31.259 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:36:31.266 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:31.267 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:36:31.372 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:36:31.394 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 65 16 93567 93551 89.8929 62.875 0.0152855 0.0111193 2021-10-08T19:36:31.412 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:31.512 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:36:31.515 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:31.515 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:36:31.617 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:36:31.659 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:31.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:31 smithi097 ceph-mon[41966]: pgmap v759: 178 pgs: 178 active+clean; 5.5 GiB data, 19 GiB used, 697 GiB / 715 GiB avail; 1.0 KiB/s rd, 68 MiB/s wr, 1.08k op/s 2021-10-08T19:36:31.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:31 smithi097 ceph-mon[32687]: pgmap v759: 178 pgs: 178 active+clean; 5.5 GiB data, 19 GiB used, 697 GiB / 715 GiB avail; 1.0 KiB/s rd, 68 MiB/s wr, 1.08k op/s 2021-10-08T19:36:32.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:31 smithi117 ceph-mon[34585]: pgmap v759: 178 pgs: 178 active+clean; 5.5 GiB data, 19 GiB used, 697 GiB / 715 GiB avail; 1.0 KiB/s rd, 68 MiB/s wr, 1.08k op/s 2021-10-08T19:36:32.396 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 66 16 94719 94703 89.619 72 0.0123619 0.0111538 2021-10-08T19:36:32.572 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2021-10-08T19:36:32.608 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:36:32.611 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:32.614 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:36:32.644 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset noscrub 2021-10-08T19:36:32.655 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:36:32 smithi117 conmon[69189]: level=error ts=2021-10-08T19:36:32.314Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=1 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:36:32.716 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:36:32.749 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:32.814 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:36:32.820 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:32.821 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:36:32.837 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:36:32 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:36:32] "GET /metrics HTTP/1.1" 200 155855 "" "Prometheus/2.18.1" 2021-10-08T19:36:32.922 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:36:32.955 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:33.022 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:36:33.028 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:33.029 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:36:33.130 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:36:33.184 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:33.267 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:36:33.273 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:33.274 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:36:33.327 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:36:33.378 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:36:33.380 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:36:33.396 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 67 16 95637 95621 89.138 57.375 0.0140016 0.0112112 2021-10-08T19:36:33.418 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:36:33.430 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:33.455 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:36:33.490 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:36:33.527 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:36:33.540 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:33.541 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:36:33.541 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:36:33.568 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:36:33.602 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:36:33.608 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true' 2021-10-08T19:36:33.608 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true' 2021-10-08T19:36:33.608 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true' 2021-10-08T19:36:33.609 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true' 2021-10-08T19:36:33.609 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true' 2021-10-08T19:36:33.609 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true' 2021-10-08T19:36:33.609 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'true' 2021-10-08T19:36:33.609 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'true' 2021-10-08T19:36:33.643 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:36:33.693 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:33.787 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:36:33.791 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:33.792 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:36:33.895 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:36:33.934 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:36:33 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:36:33] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:36:33.935 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:33 smithi117 ceph-mon[34585]: pgmap v760: 178 pgs: 178 active+clean; 5.5 GiB data, 19 GiB used, 697 GiB / 715 GiB avail; 1023 B/s rd, 66 MiB/s wr, 1.05k op/s 2021-10-08T19:36:33.935 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:33 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2835327291' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:36:33.939 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:34.043 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:36:34.048 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:34.049 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:36:34.150 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:36:34.205 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:34.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:33 smithi097 ceph-mon[41966]: pgmap v760: 178 pgs: 178 active+clean; 5.5 GiB data, 19 GiB used, 697 GiB / 715 GiB avail; 1023 B/s rd, 66 MiB/s wr, 1.05k op/s 2021-10-08T19:36:34.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:33 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2835327291' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:36:34.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:33 smithi097 ceph-mon[32687]: pgmap v760: 178 pgs: 178 active+clean; 5.5 GiB data, 19 GiB used, 697 GiB / 715 GiB avail; 1023 B/s rd, 66 MiB/s wr, 1.05k op/s 2021-10-08T19:36:34.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:33 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2835327291' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:36:34.279 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:36:34.287 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:34.288 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:36:34.390 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:36:34.398 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 68 16 96791 96775 88.8879 72.125 0.0203807 0.0112454 2021-10-08T19:36:34.439 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:34.533 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:36:34.535 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:34.535 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:36:34.637 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:36:34.674 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:34.749 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:36:34.787 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:36:34.788 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:34.789 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:36:34.802 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:36:34.891 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:36:34.940 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:35.074 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:36:35.076 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:35.077 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:36:35.179 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:36:35.232 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:35.332 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:36:35.336 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:35.337 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:36:35.401 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 69 16 97814 97798 88.5211 63.9375 0.0197864 0.011292 2021-10-08T19:36:35.440 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:36:35.527 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:35.666 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:36:35.686 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:35.686 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:36:35.787 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:36:35.819 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:35.910 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:36:35.918 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2021-10-08T19:36:35.940 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:35 smithi097 ceph-mon[41966]: pgmap v761: 178 pgs: 178 active+clean; 5.9 GiB data, 20 GiB used, 696 GiB / 715 GiB avail; 921 B/s rd, 66 MiB/s wr, 1.06k op/s 2021-10-08T19:36:35.941 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:35 smithi097 ceph-mon[32687]: pgmap v761: 178 pgs: 178 active+clean; 5.9 GiB data, 20 GiB used, 696 GiB / 715 GiB avail; 921 B/s rd, 66 MiB/s wr, 1.06k op/s 2021-10-08T19:36:36.078 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:36:36.085 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:36.086 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:36:36.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:35 smithi117 ceph-mon[34585]: pgmap v761: 178 pgs: 178 active+clean; 5.9 GiB data, 20 GiB used, 696 GiB / 715 GiB avail; 921 B/s rd, 66 MiB/s wr, 1.06k op/s 2021-10-08T19:36:36.187 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:36:36.235 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:36.403 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 70 16 98529 98513 87.8951 44.6875 0.00388357 0.0113485 2021-10-08T19:36:36.778 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2021-10-08T19:36:37.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:36 smithi097 ceph-mon[32687]: from='client.35939 v1:172.21.15.97:0/2274232622' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:36:37.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:36 smithi097 ceph-mon[41966]: from='client.35939 v1:172.21.15.97:0/2274232622' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:36:37.401 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 71 16 99664 99648 87.6563 70.9375 0.0130428 0.0114037 2021-10-08T19:36:37.410 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:36 smithi117 ceph-mon[34585]: from='client.35939 v1:172.21.15.97:0/2274232622' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:36:37.411 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:36:37 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:36:37.816 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:36:37.818 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:37.819 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:36:37.920 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:36:37.971 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:38.033 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:36:38.076 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:37 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:36:38.076 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:37 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:36:38.077 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:37 smithi097 ceph-mon[32687]: pgmap v762: 178 pgs: 178 active+clean; 5.9 GiB data, 20 GiB used, 696 GiB / 715 GiB avail; 921 B/s rd, 66 MiB/s wr, 1.06k op/s 2021-10-08T19:36:38.079 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:37 smithi097 ceph-mon[32687]: osdmap e386: 8 total, 8 up, 8 in 2021-10-08T19:36:38.079 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:37 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:36:38.079 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:37 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:36:38.079 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:37 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:36:38.080 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:37 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:36:38.080 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:37 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:36:38.082 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":761,"stamp":"2021-10-08T19:36:34.853156+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6304897220,"num_objects":96390,"num_object_clones":0,"num_object_copies":289170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96390,"num_whiteouts":0,"num_read":1870,"num_read_kb":1627,"num_write":96906,"num_write_kb":6156584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":534,"num_bytes_recovered":12006,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":77650,"ondisk_log_size":77650,"up":534,"acting":534,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":534,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":20604536,"kb_used_data":18381496,"kb_used_omap":0,"kb_used_meta":2223040,"kb_avail":729356680,"statfs":{"total":767960285184,"available":746861240320,"internally_reserved":0,"allocated":18822651904,"data_stored":18819742764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2276392960},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":693633024,"num_objects":10584,"num_object_clones":0,"num_object_copies":31752,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10584,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":10584,"num_write_kb":677376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.005873"},"pg_stats":[{"pgid":"10.6","version":"385'6091","reported_seq":6129,"reported_epoch":385,"state":"active+clean","last_fresh":"2021-10-08T19:36:33.590490+0000","last_change":"2021-10-08T19:35:16.782994+0000","last_active":"2021-10-08T19:36:33.590490+0000","last_peered":"2021-10-08T19:36:33.590490+0000","last_clean":"2021-10-08T19:36:33.590490+0000","last_became_active":"2021-10-08T19:35:16.782658+0000","last_became_peered":"2021-10-08T19:35:16.782658+0000","last_unstale":"2021-10-08T19:36:33.590490+0000","last_undegraded":"2021-10-08T19:36:33.590490+0000","last_fullsized":"2021-10-08T19:36:33.590490+0000","mapping_epoch":355,"log_start":"362'1400","ondisk_log_start":"362'1400","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:35:15.759693+0000","log_size":4691,"ondisk_log_size":4691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":399179776,"num_objects":6091,"num_object_clones":0,"num_object_copies":18273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6091,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6091,"num_write_kb":389824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4],"acting":[5,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"114'10","reported_seq":570,"reported_epoch":385,"state":"active+clean","last_fresh":"2021-10-08T19:36:29.222597+0000","last_change":"2021-10-08T19:34:14.586366+0000","last_active":"2021-10-08T19:36:29.222597+0000","last_peered":"2021-10-08T19:36:29.222597+0000","last_clean":"2021-10-08T19:36:29.222597+0000","last_became_active":"2021-10-08T19:24:25.096162+0000","last_became_peered":"2021-10-08T19:24:25.096162+0000","last_unstale":"2021-10-08T19:36:29.222597+0000","last_undegraded":"2021-10-08T19:36:29.222597+0000","last_fullsized":"2021-10-08T19:36:29.222597+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'10","last_scrub_stamp":"2021-10-08T19:34:14.586030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:34:14.586030+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034352250000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"289'34","reported_seq":151,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.145344+0000","last_change":"2021-10-08T19:33:23.562208+0000","last_active":"2021-10-08T19:36:21.145344+0000","last_peered":"2021-10-08T19:36:21.145344+0000","last_clean":"2021-10-08T19:36:21.145344+0000","last_became_active":"2021-10-08T19:31:22.787271+0000","last_became_peered":"2021-10-08T19:31:22.787271+0000","last_unstale":"2021-10-08T19:36:21.145344+0000","last_undegraded":"2021-10-08T19:36:21.145344+0000","last_fullsized":"2021-10-08T19:36:21.145344+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'34","last_scrub_stamp":"2021-10-08T19:33:23.562083+0000","last_deep_scrub":"87'22","last_deep_scrub_stamp":"2021-10-08T19:22:58.705632+0000","last_clean_scrub_stamp":"2021-10-08T19:33:23.562083+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011294012000000001,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":391,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.141576+0000","last_change":"2021-10-08T19:36:06.093016+0000","last_active":"2021-10-08T19:36:21.141576+0000","last_peered":"2021-10-08T19:36:21.141576+0000","last_clean":"2021-10-08T19:36:21.141576+0000","last_became_active":"2021-10-08T19:29:40.632678+0000","last_became_peered":"2021-10-08T19:29:40.632678+0000","last_unstale":"2021-10-08T19:36:21.141576+0000","last_undegraded":"2021-10-08T19:36:21.141576+0000","last_fullsized":"2021-10-08T19:36:21.141576+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:06.092943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:06.092943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0048028580000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":368,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.147092+0000","last_change":"2021-10-08T19:36:00.572697+0000","last_active":"2021-10-08T19:36:21.147092+0000","last_peered":"2021-10-08T19:36:21.147092+0000","last_clean":"2021-10-08T19:36:21.147092+0000","last_became_active":"2021-10-08T19:24:25.089002+0000","last_became_peered":"2021-10-08T19:24:25.089002+0000","last_unstale":"2021-10-08T19:36:21.147092+0000","last_undegraded":"2021-10-08T19:36:21.147092+0000","last_fullsized":"2021-10-08T19:36:21.147092+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:00.572589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:08.936801+0000","last_clean_scrub_stamp":"2021-10-08T19:36:00.572589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.031713926000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":291,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.144724+0000","last_change":"2021-10-08T19:36:04.907070+0000","last_active":"2021-10-08T19:36:21.144724+0000","last_peered":"2021-10-08T19:36:21.144724+0000","last_clean":"2021-10-08T19:36:21.144724+0000","last_became_active":"2021-10-08T19:25:15.510457+0000","last_became_peered":"2021-10-08T19:25:15.510457+0000","last_unstale":"2021-10-08T19:36:21.144724+0000","last_undegraded":"2021-10-08T19:36:21.144724+0000","last_fullsized":"2021-10-08T19:36:21.144724+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:04.906938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:33:28.036266+0000","last_clean_scrub_stamp":"2021-10-08T19:36:04.906938+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0079401560000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"385'5968","reported_seq":6006,"reported_epoch":385,"state":"active+clean","last_fresh":"2021-10-08T19:36:33.869370+0000","last_change":"2021-10-08T19:35:17.125078+0000","last_active":"2021-10-08T19:36:33.869370+0000","last_peered":"2021-10-08T19:36:33.869370+0000","last_clean":"2021-10-08T19:36:33.869370+0000","last_became_active":"2021-10-08T19:35:17.124786+0000","last_became_peered":"2021-10-08T19:35:17.124786+0000","last_unstale":"2021-10-08T19:36:33.869370+0000","last_undegraded":"2021-10-08T19:36:33.869370+0000","last_fullsized":"2021-10-08T19:36:33.869370+0000","mapping_epoch":355,"log_start":"361'600","ondisk_log_start":"361'600","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:35:15.759693+0000","log_size":5368,"ondisk_log_size":5368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":391118848,"num_objects":5968,"num_object_clones":0,"num_object_copies":17904,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5968,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5968,"num_write_kb":381952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"337'19","reported_seq":428,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.155040+0000","last_change":"2021-10-08T19:36:17.162468+0000","last_active":"2021-10-08T19:36:21.155040+0000","last_peered":"2021-10-08T19:36:21.155040+0000","last_clean":"2021-10-08T19:36:21.155040+0000","last_became_active":"2021-10-08T19:28:40.159729+0000","last_became_peered":"2021-10-08T19:28:40.159729+0000","last_unstale":"2021-10-08T19:36:21.155040+0000","last_undegraded":"2021-10-08T19:36:21.155040+0000","last_fullsized":"2021-10-08T19:36:21.155040+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"337'19","last_scrub_stamp":"2021-10-08T19:36:17.162349+0000","last_deep_scrub":"337'19","last_deep_scrub_stamp":"2021-10-08T19:34:14.040249+0000","last_clean_scrub_stamp":"2021-10-08T19:36:17.162349+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.019723487000000001,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":227,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.156653+0000","last_change":"2021-10-08T19:34:52.700263+0000","last_active":"2021-10-08T19:36:21.156653+0000","last_peered":"2021-10-08T19:36:21.156653+0000","last_clean":"2021-10-08T19:36:21.156653+0000","last_became_active":"2021-10-08T19:29:40.624977+0000","last_became_peered":"2021-10-08T19:29:40.624977+0000","last_unstale":"2021-10-08T19:36:21.156653+0000","last_undegraded":"2021-10-08T19:36:21.156653+0000","last_fullsized":"2021-10-08T19:36:21.156653+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:52.700168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:52.700168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0094829509999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":377,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.142006+0000","last_change":"2021-10-08T19:34:57.000885+0000","last_active":"2021-10-08T19:36:21.142006+0000","last_peered":"2021-10-08T19:36:21.142006+0000","last_clean":"2021-10-08T19:36:21.142006+0000","last_became_active":"2021-10-08T19:29:40.629422+0000","last_became_peered":"2021-10-08T19:29:40.629422+0000","last_unstale":"2021-10-08T19:36:21.142006+0000","last_undegraded":"2021-10-08T19:36:21.142006+0000","last_fullsized":"2021-10-08T19:36:21.142006+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:57.000786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:34:57.000786+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0096958310000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":353,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.153424+0000","last_change":"2021-10-08T19:34:53.070243+0000","last_active":"2021-10-08T19:36:21.153424+0000","last_peered":"2021-10-08T19:36:21.153424+0000","last_clean":"2021-10-08T19:36:21.153424+0000","last_became_active":"2021-10-08T19:21:29.643022+0000","last_became_peered":"2021-10-08T19:21:29.643022+0000","last_unstale":"2021-10-08T19:36:21.153424+0000","last_undegraded":"2021-10-08T19:36:21.153424+0000","last_fullsized":"2021-10-08T19:36:21.153424+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:53.070138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:34:53.070138+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.076770236000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"70'5","reported_seq":1090,"reported_epoch":385,"state":"active+clean","last_fresh":"2021-10-08T19:36:31.624294+0000","last_change":"2021-10-08T19:34:45.765175+0000","last_active":"2021-10-08T19:36:31.624294+0000","last_peered":"2021-10-08T19:36:31.624294+0000","last_clean":"2021-10-08T19:36:31.624294+0000","last_became_active":"2021-10-08T19:29:40.630821+0000","last_became_peered":"2021-10-08T19:29:40.630821+0000","last_unstale":"2021-10-08T19:36:31.624294+0000","last_undegraded":"2021-10-08T19:36:31.624294+0000","last_fullsized":"2021-10-08T19:36:31.624294+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:34:45.765074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:45.765074+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0069135860000000002,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":730,"num_read_kb":730,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1167,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.4","version":"385'5971","reported_seq":6009,"reported_epoch":385,"state":"active+clean","last_fresh":"2021-10-08T19:36:34.110982+0000","last_change":"2021-10-08T19:35:17.124862+0000","last_active":"2021-10-08T19:36:34.110982+0000","last_peered":"2021-10-08T19:36:34.110982+0000","last_clean":"2021-10-08T19:36:34.110982+0000","last_became_active":"2021-10-08T19:35:17.124559+0000","last_became_peered":"2021-10-08T19:35:17.124559+0000","last_unstale":"2021-10-08T19:36:34.110982+0000","last_undegraded":"2021-10-08T19:36:34.110982+0000","last_fullsized":"2021-10-08T19:36:34.110982+0000","mapping_epoch":355,"log_start":"363'1400","ondisk_log_start":"363'1400","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:35:15.759693+0000","log_size":4571,"ondisk_log_size":4571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":391315456,"num_objects":5971,"num_object_clones":0,"num_object_copies":17913,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5971,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5971,"num_write_kb":382144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"289'35","reported_seq":416,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.148184+0000","last_change":"2021-10-08T19:35:57.653426+0000","last_active":"2021-10-08T19:36:21.148184+0000","last_peered":"2021-10-08T19:36:21.148184+0000","last_clean":"2021-10-08T19:36:21.148184+0000","last_became_active":"2021-10-08T19:28:40.101648+0000","last_became_peered":"2021-10-08T19:28:40.101648+0000","last_unstale":"2021-10-08T19:36:21.148184+0000","last_undegraded":"2021-10-08T19:36:21.148184+0000","last_fullsized":"2021-10-08T19:36:21.148184+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'35","last_scrub_stamp":"2021-10-08T19:35:57.653345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:35:57.653345+0000","log_size":35,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040502669999999998,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":55,"num_read_kb":44,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":369,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.140931+0000","last_change":"2021-10-08T19:35:58.075011+0000","last_active":"2021-10-08T19:36:21.140931+0000","last_peered":"2021-10-08T19:36:21.140931+0000","last_clean":"2021-10-08T19:36:21.140931+0000","last_became_active":"2021-10-08T19:21:23.595919+0000","last_became_peered":"2021-10-08T19:21:23.595919+0000","last_unstale":"2021-10-08T19:36:21.140931+0000","last_undegraded":"2021-10-08T19:36:21.140931+0000","last_fullsized":"2021-10-08T19:36:21.140931+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:58.074848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:58.074848+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0063866330000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":377,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.142518+0000","last_change":"2021-10-08T19:35:57.051876+0000","last_active":"2021-10-08T19:36:21.142518+0000","last_peered":"2021-10-08T19:36:21.142518+0000","last_clean":"2021-10-08T19:36:21.142518+0000","last_became_active":"2021-10-08T19:31:22.783725+0000","last_became_peered":"2021-10-08T19:31:22.783725+0000","last_unstale":"2021-10-08T19:36:21.142518+0000","last_undegraded":"2021-10-08T19:36:21.142518+0000","last_fullsized":"2021-10-08T19:36:21.142518+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:57.051759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:35:57.051759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0084059809999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":369,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.143823+0000","last_change":"2021-10-08T19:34:20.691431+0000","last_active":"2021-10-08T19:36:21.143823+0000","last_peered":"2021-10-08T19:36:21.143823+0000","last_clean":"2021-10-08T19:36:21.143823+0000","last_became_active":"2021-10-08T19:29:40.638354+0000","last_became_peered":"2021-10-08T19:29:40.638354+0000","last_unstale":"2021-10-08T19:36:21.143823+0000","last_undegraded":"2021-10-08T19:36:21.143823+0000","last_fullsized":"2021-10-08T19:36:21.143823+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:20.691312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:39.528699+0000","last_clean_scrub_stamp":"2021-10-08T19:34:20.691312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0054161239999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":302,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.144355+0000","last_change":"2021-10-08T19:35:58.023652+0000","last_active":"2021-10-08T19:36:21.144355+0000","last_peered":"2021-10-08T19:36:21.144355+0000","last_clean":"2021-10-08T19:36:21.144355+0000","last_became_active":"2021-10-08T19:31:22.785590+0000","last_became_peered":"2021-10-08T19:31:22.785590+0000","last_unstale":"2021-10-08T19:36:21.144355+0000","last_undegraded":"2021-10-08T19:36:21.144355+0000","last_fullsized":"2021-10-08T19:36:21.144355+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:58.023581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:58.023581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0070639609999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3","version":"385'6100","reported_seq":6137,"reported_epoch":385,"state":"active+clean","last_fresh":"2021-10-08T19:36:33.857959+0000","last_change":"2021-10-08T19:35:17.124080+0000","last_active":"2021-10-08T19:36:33.857959+0000","last_peered":"2021-10-08T19:36:33.857959+0000","last_clean":"2021-10-08T19:36:33.857959+0000","last_became_active":"2021-10-08T19:35:17.123799+0000","last_became_peered":"2021-10-08T19:35:17.123799+0000","last_unstale":"2021-10-08T19:36:33.857959+0000","last_undegraded":"2021-10-08T19:36:33.857959+0000","last_fullsized":"2021-10-08T19:36:33.857959+0000","mapping_epoch":355,"log_start":"361'700","ondisk_log_start":"361'700","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:35:15.759693+0000","log_size":5400,"ondisk_log_size":5400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":399769600,"num_objects":6100,"num_object_clones":0,"num_object_copies":18300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6100,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6100,"num_write_kb":390400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.8","version":"90'130","reported_seq":467,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.145500+0000","last_change":"2021-10-08T19:34:44.803061+0000","last_active":"2021-10-08T19:36:21.145500+0000","last_peered":"2021-10-08T19:36:21.145500+0000","last_clean":"2021-10-08T19:36:21.145500+0000","last_became_active":"2021-10-08T19:31:25.647505+0000","last_became_peered":"2021-10-08T19:31:25.647505+0000","last_unstale":"2021-10-08T19:36:21.145500+0000","last_undegraded":"2021-10-08T19:36:21.145500+0000","last_fullsized":"2021-10-08T19:36:21.145500+0000","mapping_epoch":286,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":287,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:34:44.802994+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:34:44.802994+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.016276585,"stat_sum":{"num_bytes":262688,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"289'31","reported_seq":457,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.141710+0000","last_change":"2021-10-08T19:35:26.152730+0000","last_active":"2021-10-08T19:36:21.141710+0000","last_peered":"2021-10-08T19:36:21.141710+0000","last_clean":"2021-10-08T19:36:21.141710+0000","last_became_active":"2021-10-08T19:28:40.099618+0000","last_became_peered":"2021-10-08T19:28:40.099618+0000","last_unstale":"2021-10-08T19:36:21.141710+0000","last_undegraded":"2021-10-08T19:36:21.141710+0000","last_fullsized":"2021-10-08T19:36:21.141710+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'31","last_scrub_stamp":"2021-10-08T19:35:26.152640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:35:26.152640+0000","log_size":31,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0031552659999999999,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":50,"num_read_kb":40,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"61'1","reported_seq":365,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.144373+0000","last_change":"2021-10-08T19:35:22.904758+0000","last_active":"2021-10-08T19:36:21.144373+0000","last_peered":"2021-10-08T19:36:21.144373+0000","last_clean":"2021-10-08T19:36:21.144373+0000","last_became_active":"2021-10-08T19:21:23.607064+0000","last_became_peered":"2021-10-08T19:21:23.607064+0000","last_unstale":"2021-10-08T19:36:21.144373+0000","last_undegraded":"2021-10-08T19:36:21.144373+0000","last_fullsized":"2021-10-08T19:36:21.144373+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'1","last_scrub_stamp":"2021-10-08T19:35:22.904628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:22.904628+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0051040089999999996,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":209,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.156497+0000","last_change":"2021-10-08T19:35:25.704060+0000","last_active":"2021-10-08T19:36:21.156497+0000","last_peered":"2021-10-08T19:36:21.156497+0000","last_clean":"2021-10-08T19:36:21.156497+0000","last_became_active":"2021-10-08T19:28:40.152478+0000","last_became_peered":"2021-10-08T19:28:40.152478+0000","last_unstale":"2021-10-08T19:36:21.156497+0000","last_undegraded":"2021-10-08T19:36:21.156497+0000","last_fullsized":"2021-10-08T19:36:21.156497+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:25.703955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:30:09.081635+0000","last_clean_scrub_stamp":"2021-10-08T19:35:25.703955+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0021998410000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":377,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.142615+0000","last_change":"2021-10-08T19:35:20.102212+0000","last_active":"2021-10-08T19:36:21.142615+0000","last_peered":"2021-10-08T19:36:21.142615+0000","last_clean":"2021-10-08T19:36:21.142615+0000","last_became_active":"2021-10-08T19:29:40.629424+0000","last_became_peered":"2021-10-08T19:29:40.629424+0000","last_unstale":"2021-10-08T19:36:21.142615+0000","last_undegraded":"2021-10-08T19:36:21.142615+0000","last_fullsized":"2021-10-08T19:36:21.142615+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:20.102116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:35:20.102116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.075222543000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":341,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.148414+0000","last_change":"2021-10-08T19:35:16.628777+0000","last_active":"2021-10-08T19:36:21.148414+0000","last_peered":"2021-10-08T19:36:21.148414+0000","last_clean":"2021-10-08T19:36:21.148414+0000","last_became_active":"2021-10-08T19:31:51.676829+0000","last_became_peered":"2021-10-08T19:31:51.676829+0000","last_unstale":"2021-10-08T19:36:21.148414+0000","last_undegraded":"2021-10-08T19:36:21.148414+0000","last_fullsized":"2021-10-08T19:36:21.148414+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:16.628688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:16.628688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0015118340000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"385'6053","reported_seq":6091,"reported_epoch":385,"state":"active+clean","last_fresh":"2021-10-08T19:36:34.123726+0000","last_change":"2021-10-08T19:35:16.780327+0000","last_active":"2021-10-08T19:36:34.123726+0000","last_peered":"2021-10-08T19:36:34.123726+0000","last_clean":"2021-10-08T19:36:34.123726+0000","last_became_active":"2021-10-08T19:35:16.780016+0000","last_became_peered":"2021-10-08T19:35:16.780016+0000","last_unstale":"2021-10-08T19:36:34.123726+0000","last_undegraded":"2021-10-08T19:36:34.123726+0000","last_fullsized":"2021-10-08T19:36:34.123726+0000","mapping_epoch":355,"log_start":"362'1200","ondisk_log_start":"362'1200","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:35:15.759693+0000","log_size":4853,"ondisk_log_size":4853,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":396689408,"num_objects":6053,"num_object_clones":0,"num_object_copies":18159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6053,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6053,"num_write_kb":387392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.9","version":"90'130","reported_seq":705,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.143736+0000","last_change":"2021-10-08T19:35:20.911809+0000","last_active":"2021-10-08T19:36:21.143736+0000","last_peered":"2021-10-08T19:36:21.143736+0000","last_clean":"2021-10-08T19:36:21.143736+0000","last_became_active":"2021-10-08T19:29:43.634789+0000","last_became_peered":"2021-10-08T19:29:43.634789+0000","last_unstale":"2021-10-08T19:36:21.143736+0000","last_undegraded":"2021-10-08T19:36:21.143736+0000","last_fullsized":"2021-10-08T19:36:21.143736+0000","mapping_epoch":239,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:35:20.911733+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:35:20.911733+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0029675249999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"289'20","reported_seq":468,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.139566+0000","last_change":"2021-10-08T19:35:19.156261+0000","last_active":"2021-10-08T19:36:21.139566+0000","last_peered":"2021-10-08T19:36:21.139566+0000","last_clean":"2021-10-08T19:36:21.139566+0000","last_became_active":"2021-10-08T19:29:40.631807+0000","last_became_peered":"2021-10-08T19:29:40.631807+0000","last_unstale":"2021-10-08T19:36:21.139566+0000","last_undegraded":"2021-10-08T19:36:21.139566+0000","last_fullsized":"2021-10-08T19:36:21.139566+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'20","last_scrub_stamp":"2021-10-08T19:35:19.156174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:35:19.156174+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039866930000000004,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":229,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.156941+0000","last_change":"2021-10-08T19:35:18.712034+0000","last_active":"2021-10-08T19:36:21.156941+0000","last_peered":"2021-10-08T19:36:21.156941+0000","last_clean":"2021-10-08T19:36:21.156941+0000","last_became_active":"2021-10-08T19:29:40.638988+0000","last_became_peered":"2021-10-08T19:29:40.638988+0000","last_unstale":"2021-10-08T19:36:21.156941+0000","last_undegraded":"2021-10-08T19:36:21.156941+0000","last_fullsized":"2021-10-08T19:36:21.156941+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:18.711965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:18.711965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0014885569999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"250'9","reported_seq":558,"reported_epoch":385,"state":"active+clean","last_fresh":"2021-10-08T19:36:29.225866+0000","last_change":"2021-10-08T19:36:05.056752+0000","last_active":"2021-10-08T19:36:29.225866+0000","last_peered":"2021-10-08T19:36:29.225866+0000","last_clean":"2021-10-08T19:36:29.225866+0000","last_became_active":"2021-10-08T19:21:27.637930+0000","last_became_peered":"2021-10-08T19:21:27.637930+0000","last_unstale":"2021-10-08T19:36:29.225866+0000","last_undegraded":"2021-10-08T19:36:29.225866+0000","last_fullsized":"2021-10-08T19:36:29.225866+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'9","last_scrub_stamp":"2021-10-08T19:36:05.056649+0000","last_deep_scrub":"250'9","last_deep_scrub_stamp":"2021-10-08T19:30:04.239189+0000","last_clean_scrub_stamp":"2021-10-08T19:36:05.056649+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0049163460000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":368,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.140052+0000","last_change":"2021-10-08T19:34:55.383199+0000","last_active":"2021-10-08T19:36:21.140052+0000","last_peered":"2021-10-08T19:36:21.140052+0000","last_clean":"2021-10-08T19:36:21.140052+0000","last_became_active":"2021-10-08T19:28:40.100213+0000","last_became_peered":"2021-10-08T19:28:40.100213+0000","last_unstale":"2021-10-08T19:36:21.140052+0000","last_undegraded":"2021-10-08T19:36:21.140052+0000","last_fullsized":"2021-10-08T19:36:21.140052+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:55.383084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:34:55.383084+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.017427761999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":169,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.141355+0000","last_change":"2021-10-08T19:36:15.769584+0000","last_active":"2021-10-08T19:36:21.141355+0000","last_peered":"2021-10-08T19:36:21.141355+0000","last_clean":"2021-10-08T19:36:21.141355+0000","last_became_active":"2021-10-08T19:29:44.443507+0000","last_became_peered":"2021-10-08T19:29:44.443507+0000","last_unstale":"2021-10-08T19:36:21.141355+0000","last_undegraded":"2021-10-08T19:36:21.141355+0000","last_fullsized":"2021-10-08T19:36:21.141355+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:15.769469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:15.769469+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0068300569999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"385'6143","reported_seq":6181,"reported_epoch":385,"state":"active+clean","last_fresh":"2021-10-08T19:36:34.528908+0000","last_change":"2021-10-08T19:35:16.778534+0000","last_active":"2021-10-08T19:36:34.528908+0000","last_peered":"2021-10-08T19:36:34.528908+0000","last_clean":"2021-10-08T19:36:34.528908+0000","last_became_active":"2021-10-08T19:35:16.778182+0000","last_became_peered":"2021-10-08T19:35:16.778182+0000","last_unstale":"2021-10-08T19:36:34.528908+0000","last_undegraded":"2021-10-08T19:36:34.528908+0000","last_fullsized":"2021-10-08T19:36:34.528908+0000","mapping_epoch":355,"log_start":"364'2000","ondisk_log_start":"364'2000","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:35:15.759693+0000","log_size":4143,"ondisk_log_size":4143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":402587648,"num_objects":6143,"num_object_clones":0,"num_object_copies":18429,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6143,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6143,"num_write_kb":393152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,0],"acting":[4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.a","version":"90'130","reported_seq":533,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.145275+0000","last_change":"2021-10-08T19:34:11.489040+0000","last_active":"2021-10-08T19:36:21.145275+0000","last_peered":"2021-10-08T19:36:21.145275+0000","last_clean":"2021-10-08T19:36:21.145275+0000","last_became_active":"2021-10-08T19:27:26.591129+0000","last_became_peered":"2021-10-08T19:27:26.591129+0000","last_unstale":"2021-10-08T19:36:21.145275+0000","last_undegraded":"2021-10-08T19:36:21.145275+0000","last_fullsized":"2021-10-08T19:36:21.145275+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:34:11.488938+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:34:11.488938+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0022431069999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.f","version":"289'27","reported_seq":111,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.142356+0000","last_change":"2021-10-08T19:36:12.961210+0000","last_active":"2021-10-08T19:36:21.142356+0000","last_peered":"2021-10-08T19:36:21.142356+0000","last_clean":"2021-10-08T19:36:21.142356+0000","last_became_active":"2021-10-08T19:32:45.162914+0000","last_became_peered":"2021-10-08T19:32:45.162914+0000","last_unstale":"2021-10-08T19:36:21.142356+0000","last_undegraded":"2021-10-08T19:36:21.142356+0000","last_fullsized":"2021-10-08T19:36:21.142356+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'27","last_scrub_stamp":"2021-10-08T19:36:12.961130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:12.961130+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0063489530000000001,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":550,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":227,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.157014+0000","last_change":"2021-10-08T19:35:19.757453+0000","last_active":"2021-10-08T19:36:21.157014+0000","last_peered":"2021-10-08T19:36:21.157014+0000","last_clean":"2021-10-08T19:36:21.157014+0000","last_became_active":"2021-10-08T19:29:40.631290+0000","last_became_peered":"2021-10-08T19:29:40.631290+0000","last_unstale":"2021-10-08T19:36:21.157014+0000","last_undegraded":"2021-10-08T19:36:21.157014+0000","last_fullsized":"2021-10-08T19:36:21.157014+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:19.757349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:30:11.102934+0000","last_clean_scrub_stamp":"2021-10-08T19:35:19.757349+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001709061,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"88'9","reported_seq":546,"reported_epoch":385,"state":"active+clean","last_fresh":"2021-10-08T19:36:29.222291+0000","last_change":"2021-10-08T19:35:20.114948+0000","last_active":"2021-10-08T19:36:29.222291+0000","last_peered":"2021-10-08T19:36:29.222291+0000","last_clean":"2021-10-08T19:36:29.222291+0000","last_became_active":"2021-10-08T19:21:27.636432+0000","last_became_peered":"2021-10-08T19:21:27.636432+0000","last_unstale":"2021-10-08T19:36:29.222291+0000","last_undegraded":"2021-10-08T19:36:29.222291+0000","last_fullsized":"2021-10-08T19:36:29.222291+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'9","last_scrub_stamp":"2021-10-08T19:35:20.114852+0000","last_deep_scrub":"88'9","last_deep_scrub_stamp":"2021-10-08T19:23:00.048245+0000","last_clean_scrub_stamp":"2021-10-08T19:35:20.114852+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0019977990000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":372,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.149742+0000","last_change":"2021-10-08T19:34:50.829320+0000","last_active":"2021-10-08T19:36:21.149742+0000","last_peered":"2021-10-08T19:36:21.149742+0000","last_clean":"2021-10-08T19:36:21.149742+0000","last_became_active":"2021-10-08T19:28:40.137966+0000","last_became_peered":"2021-10-08T19:28:40.137966+0000","last_unstale":"2021-10-08T19:36:21.149742+0000","last_undegraded":"2021-10-08T19:36:21.149742+0000","last_fullsized":"2021-10-08T19:36:21.149742+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:50.829228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:34:50.829228+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.056194888999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.8","version":"70'5","reported_seq":169,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.138834+0000","last_change":"2021-10-08T19:36:08.760775+0000","last_active":"2021-10-08T19:36:21.138834+0000","last_peered":"2021-10-08T19:36:21.138834+0000","last_clean":"2021-10-08T19:36:21.138834+0000","last_became_active":"2021-10-08T19:29:40.639786+0000","last_became_peered":"2021-10-08T19:29:40.639786+0000","last_unstale":"2021-10-08T19:36:21.138834+0000","last_undegraded":"2021-10-08T19:36:21.138834+0000","last_fullsized":"2021-10-08T19:36:21.138834+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:36:08.760670+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2021-10-08T19:36:08.760670+0000","last_clean_scrub_stamp":"2021-10-08T19:36:08.760670+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011613982,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.0","version":"385'5961","reported_seq":5999,"reported_epoch":385,"state":"active+clean","last_fresh":"2021-10-08T19:36:33.655115+0000","last_change":"2021-10-08T19:35:16.783810+0000","last_active":"2021-10-08T19:36:33.655115+0000","last_peered":"2021-10-08T19:36:33.655115+0000","last_clean":"2021-10-08T19:36:33.655115+0000","last_became_active":"2021-10-08T19:35:16.783489+0000","last_became_peered":"2021-10-08T19:35:16.783489+0000","last_unstale":"2021-10-08T19:36:33.655115+0000","last_undegraded":"2021-10-08T19:36:33.655115+0000","last_fullsized":"2021-10-08T19:36:33.655115+0000","mapping_epoch":355,"log_start":"362'1100","ondisk_log_start":"362'1100","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:35:15.759693+0000","log_size":4861,"ondisk_log_size":4861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":390660096,"num_objects":5961,"num_object_clones":0,"num_object_copies":17883,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5961,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5961,"num_write_kb":381504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4],"acting":[6,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"289'19","reported_seq":532,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.139768+0000","last_change":"2021-10-08T19:35:34.394900+0000","last_active":"2021-10-08T19:36:21.139768+0000","last_peered":"2021-10-08T19:36:21.139768+0000","last_clean":"2021-10-08T19:36:21.139768+0000","last_became_active":"2021-10-08T19:31:51.677509+0000","last_became_peered":"2021-10-08T19:31:51.677509+0000","last_unstale":"2021-10-08T19:36:21.139768+0000","last_undegraded":"2021-10-08T19:36:21.139768+0000","last_fullsized":"2021-10-08T19:36:21.139768+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:35:34.394820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:35:34.394820+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0061638159999999999,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":770,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":383,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.143907+0000","last_change":"2021-10-08T19:36:01.984163+0000","last_active":"2021-10-08T19:36:21.143907+0000","last_peered":"2021-10-08T19:36:21.143907+0000","last_clean":"2021-10-08T19:36:21.143907+0000","last_became_active":"2021-10-08T19:28:40.100691+0000","last_became_peered":"2021-10-08T19:28:40.100691+0000","last_unstale":"2021-10-08T19:36:21.143907+0000","last_undegraded":"2021-10-08T19:36:21.143907+0000","last_fullsized":"2021-10-08T19:36:21.143907+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:01.984068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:01.984068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0028891239999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":364,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.148038+0000","last_change":"2021-10-08T19:33:17.529783+0000","last_active":"2021-10-08T19:36:21.148038+0000","last_peered":"2021-10-08T19:36:21.148038+0000","last_clean":"2021-10-08T19:36:21.148038+0000","last_became_active":"2021-10-08T19:24:25.105244+0000","last_became_peered":"2021-10-08T19:24:25.105244+0000","last_unstale":"2021-10-08T19:36:21.148038+0000","last_undegraded":"2021-10-08T19:36:21.148038+0000","last_fullsized":"2021-10-08T19:36:21.148038+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:17.529713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:33:17.529713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011576375999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":169,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.140559+0000","last_change":"2021-10-08T19:33:21.903287+0000","last_active":"2021-10-08T19:36:21.140559+0000","last_peered":"2021-10-08T19:36:21.140559+0000","last_clean":"2021-10-08T19:36:21.140559+0000","last_became_active":"2021-10-08T19:29:40.638099+0000","last_became_peered":"2021-10-08T19:29:40.638099+0000","last_unstale":"2021-10-08T19:36:21.140559+0000","last_undegraded":"2021-10-08T19:36:21.140559+0000","last_fullsized":"2021-10-08T19:36:21.140559+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:21.903188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:17.422176+0000","last_clean_scrub_stamp":"2021-10-08T19:33:21.903188+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014417607000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":307,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.139613+0000","last_change":"2021-10-08T19:35:58.368794+0000","last_active":"2021-10-08T19:36:21.139613+0000","last_peered":"2021-10-08T19:36:21.139613+0000","last_clean":"2021-10-08T19:36:21.139613+0000","last_became_active":"2021-10-08T19:24:13.506602+0000","last_became_peered":"2021-10-08T19:24:13.506602+0000","last_unstale":"2021-10-08T19:36:21.139613+0000","last_undegraded":"2021-10-08T19:36:21.139613+0000","last_fullsized":"2021-10-08T19:36:21.139613+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:58.368720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:58.368720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.005639519,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"385'6031","reported_seq":6069,"reported_epoch":385,"state":"active+clean","last_fresh":"2021-10-08T19:36:33.641594+0000","last_change":"2021-10-08T19:35:17.125222+0000","last_active":"2021-10-08T19:36:33.641594+0000","last_peered":"2021-10-08T19:36:33.641594+0000","last_clean":"2021-10-08T19:36:33.641594+0000","last_became_active":"2021-10-08T19:35:17.124842+0000","last_became_peered":"2021-10-08T19:35:17.124842+0000","last_unstale":"2021-10-08T19:36:33.641594+0000","last_undegraded":"2021-10-08T19:36:33.641594+0000","last_fullsized":"2021-10-08T19:36:33.641594+0000","mapping_epoch":355,"log_start":"362'1200","ondisk_log_start":"362'1200","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:35:15.759693+0000","log_size":4831,"ondisk_log_size":4831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":395247616,"num_objects":6031,"num_object_clones":0,"num_object_copies":18093,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6031,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6031,"num_write_kb":385984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.4","version":"90'130","reported_seq":499,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.140484+0000","last_change":"2021-10-08T19:36:05.771481+0000","last_active":"2021-10-08T19:36:21.140484+0000","last_peered":"2021-10-08T19:36:21.140484+0000","last_clean":"2021-10-08T19:36:21.140484+0000","last_became_active":"2021-10-08T19:29:43.636733+0000","last_became_peered":"2021-10-08T19:29:43.636733+0000","last_unstale":"2021-10-08T19:36:21.140484+0000","last_undegraded":"2021-10-08T19:36:21.140484+0000","last_fullsized":"2021-10-08T19:36:21.140484+0000","mapping_epoch":239,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:36:05.771344+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:36:05.771344+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014695206000000001,"stat_sum":{"num_bytes":327680,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"238'13","reported_seq":260,"reported_epoch":385,"state":"active+clean","last_fresh":"2021-10-08T19:36:29.233776+0000","last_change":"2021-10-08T19:35:16.139228+0000","last_active":"2021-10-08T19:36:29.233776+0000","last_peered":"2021-10-08T19:36:29.233776+0000","last_clean":"2021-10-08T19:36:29.233776+0000","last_became_active":"2021-10-08T19:29:40.640248+0000","last_became_peered":"2021-10-08T19:29:40.640248+0000","last_unstale":"2021-10-08T19:36:29.233776+0000","last_undegraded":"2021-10-08T19:36:29.233776+0000","last_fullsized":"2021-10-08T19:36:29.233776+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"238'13","last_scrub_stamp":"2021-10-08T19:35:16.139154+0000","last_deep_scrub":"91'9","last_deep_scrub_stamp":"2021-10-08T19:23:32.329475+0000","last_clean_scrub_stamp":"2021-10-08T19:35:16.139154+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040429799999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"289'28","reported_seq":452,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.139802+0000","last_change":"2021-10-08T19:36:16.219370+0000","last_active":"2021-10-08T19:36:21.139802+0000","last_peered":"2021-10-08T19:36:21.139802+0000","last_clean":"2021-10-08T19:36:21.139802+0000","last_became_active":"2021-10-08T19:24:25.098743+0000","last_became_peered":"2021-10-08T19:24:25.098743+0000","last_unstale":"2021-10-08T19:36:21.139802+0000","last_undegraded":"2021-10-08T19:36:21.139802+0000","last_fullsized":"2021-10-08T19:36:21.139802+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'28","last_scrub_stamp":"2021-10-08T19:36:16.219258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:16.219258+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0095071070000000008,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":42,"num_read_kb":35,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":305,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.148804+0000","last_change":"2021-10-08T19:36:12.643738+0000","last_active":"2021-10-08T19:36:21.148804+0000","last_peered":"2021-10-08T19:36:21.148804+0000","last_clean":"2021-10-08T19:36:21.148804+0000","last_became_active":"2021-10-08T19:24:25.094364+0000","last_became_peered":"2021-10-08T19:24:25.094364+0000","last_unstale":"2021-10-08T19:36:21.148804+0000","last_undegraded":"2021-10-08T19:36:21.148804+0000","last_fullsized":"2021-10-08T19:36:21.148804+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:12.643664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:12.643664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0025959149999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":371,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.144543+0000","last_change":"2021-10-08T19:34:57.935414+0000","last_active":"2021-10-08T19:36:21.144543+0000","last_peered":"2021-10-08T19:36:21.144543+0000","last_clean":"2021-10-08T19:36:21.144543+0000","last_became_active":"2021-10-08T19:24:25.094848+0000","last_became_peered":"2021-10-08T19:24:25.094848+0000","last_unstale":"2021-10-08T19:36:21.144543+0000","last_undegraded":"2021-10-08T19:36:21.144543+0000","last_fullsized":"2021-10-08T19:36:21.144543+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:57.935312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:34:57.935312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.031026839000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":330,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.160348+0000","last_change":"2021-10-08T19:34:44.965618+0000","last_active":"2021-10-08T19:36:21.160348+0000","last_peered":"2021-10-08T19:36:21.160348+0000","last_clean":"2021-10-08T19:36:21.160348+0000","last_became_active":"2021-10-08T19:28:40.132751+0000","last_became_peered":"2021-10-08T19:28:40.132751+0000","last_unstale":"2021-10-08T19:36:21.160348+0000","last_undegraded":"2021-10-08T19:36:21.160348+0000","last_fullsized":"2021-10-08T19:36:21.160348+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:44.965505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:44.965505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.020193916999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.e","version":"385'6094","reported_seq":6132,"reported_epoch":385,"state":"active+clean","last_fresh":"2021-10-08T19:36:34.526676+0000","last_change":"2021-10-08T19:35:16.776363+0000","last_active":"2021-10-08T19:36:34.526676+0000","last_peered":"2021-10-08T19:36:34.526676+0000","last_clean":"2021-10-08T19:36:34.526676+0000","last_became_active":"2021-10-08T19:35:16.776024+0000","last_became_peered":"2021-10-08T19:35:16.776024+0000","last_unstale":"2021-10-08T19:36:34.526676+0000","last_undegraded":"2021-10-08T19:36:34.526676+0000","last_fullsized":"2021-10-08T19:36:34.526676+0000","mapping_epoch":355,"log_start":"364'2000","ondisk_log_start":"364'2000","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:35:15.759693+0000","log_size":4094,"ondisk_log_size":4094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":399376384,"num_objects":6094,"num_object_clones":0,"num_object_copies":18282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6094,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6094,"num_write_kb":390016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"90'130","reported_seq":533,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.142273+0000","last_change":"2021-10-08T19:34:59.306555+0000","last_active":"2021-10-08T19:36:21.142273+0000","last_peered":"2021-10-08T19:36:21.142273+0000","last_clean":"2021-10-08T19:36:21.142273+0000","last_became_active":"2021-10-08T19:27:26.590651+0000","last_became_peered":"2021-10-08T19:27:26.590651+0000","last_unstale":"2021-10-08T19:36:21.142273+0000","last_undegraded":"2021-10-08T19:36:21.142273+0000","last_fullsized":"2021-10-08T19:36:21.142273+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:34:59.306414+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:32:14.582883+0000","last_clean_scrub_stamp":"2021-10-08T19:34:59.306414+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0017696229999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":370,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.140012+0000","last_change":"2021-10-08T19:34:49.244387+0000","last_active":"2021-10-08T19:36:21.140012+0000","last_peered":"2021-10-08T19:36:21.140012+0000","last_clean":"2021-10-08T19:36:21.140012+0000","last_became_active":"2021-10-08T19:29:40.639405+0000","last_became_peered":"2021-10-08T19:29:40.639405+0000","last_unstale":"2021-10-08T19:36:21.140012+0000","last_undegraded":"2021-10-08T19:36:21.140012+0000","last_fullsized":"2021-10-08T19:36:21.140012+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:49.244279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:34:49.244279+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.018839582000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"289'30","reported_seq":205,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.138660+0000","last_change":"2021-10-08T19:34:06.085387+0000","last_active":"2021-10-08T19:36:21.138660+0000","last_peered":"2021-10-08T19:36:21.138660+0000","last_clean":"2021-10-08T19:36:21.138660+0000","last_became_active":"2021-10-08T19:29:40.635007+0000","last_became_peered":"2021-10-08T19:29:40.635007+0000","last_unstale":"2021-10-08T19:36:21.138660+0000","last_undegraded":"2021-10-08T19:36:21.138660+0000","last_fullsized":"2021-10-08T19:36:21.138660+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'30","last_scrub_stamp":"2021-10-08T19:34:06.085282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:34:06.085282+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.015398577,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":51,"num_read_kb":39,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":203,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.157409+0000","last_change":"2021-10-08T19:34:50.752974+0000","last_active":"2021-10-08T19:36:21.157409+0000","last_peered":"2021-10-08T19:36:21.157409+0000","last_clean":"2021-10-08T19:36:21.157409+0000","last_became_active":"2021-10-08T19:28:40.141714+0000","last_became_peered":"2021-10-08T19:28:40.141714+0000","last_unstale":"2021-10-08T19:36:21.157409+0000","last_undegraded":"2021-10-08T19:36:21.157409+0000","last_fullsized":"2021-10-08T19:36:21.157409+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:50.752866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:07.710367+0000","last_clean_scrub_stamp":"2021-10-08T19:34:50.752866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013659034,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":368,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.139882+0000","last_change":"2021-10-08T19:35:31.347742+0000","last_active":"2021-10-08T19:36:21.139882+0000","last_peered":"2021-10-08T19:36:21.139882+0000","last_clean":"2021-10-08T19:36:21.139882+0000","last_became_active":"2021-10-08T19:29:40.638253+0000","last_became_peered":"2021-10-08T19:29:40.638253+0000","last_unstale":"2021-10-08T19:36:21.139882+0000","last_undegraded":"2021-10-08T19:36:21.139882+0000","last_fullsized":"2021-10-08T19:36:21.139882+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:31.347606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:35:31.347606+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0053338960000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":169,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.140504+0000","last_change":"2021-10-08T19:36:10.804434+0000","last_active":"2021-10-08T19:36:21.140504+0000","last_peered":"2021-10-08T19:36:21.140504+0000","last_clean":"2021-10-08T19:36:21.140504+0000","last_became_active":"2021-10-08T19:29:40.634579+0000","last_became_peered":"2021-10-08T19:29:40.634579+0000","last_unstale":"2021-10-08T19:36:21.140504+0000","last_undegraded":"2021-10-08T19:36:21.140504+0000","last_fullsized":"2021-10-08T19:36:21.140504+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:10.804325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:10.804325+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0063916950000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.d","version":"385'5883","reported_seq":5919,"reported_epoch":385,"state":"active+clean","last_fresh":"2021-10-08T19:36:33.650666+0000","last_change":"2021-10-08T19:35:16.783067+0000","last_active":"2021-10-08T19:36:33.650666+0000","last_peered":"2021-10-08T19:36:33.650666+0000","last_clean":"2021-10-08T19:36:33.650666+0000","last_became_active":"2021-10-08T19:35:16.782695+0000","last_became_peered":"2021-10-08T19:35:16.782695+0000","last_unstale":"2021-10-08T19:36:33.650666+0000","last_undegraded":"2021-10-08T19:36:33.650666+0000","last_fullsized":"2021-10-08T19:36:33.650666+0000","mapping_epoch":355,"log_start":"362'1100","ondisk_log_start":"362'1100","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:35:15.759693+0000","log_size":4783,"ondisk_log_size":4783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":385548288,"num_objects":5883,"num_object_clones":0,"num_object_copies":17649,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5883,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5883,"num_write_kb":376512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"90'130","reported_seq":474,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.149200+0000","last_change":"2021-10-08T19:36:01.675001+0000","last_active":"2021-10-08T19:36:21.149200+0000","last_peered":"2021-10-08T19:36:21.149200+0000","last_clean":"2021-10-08T19:36:21.149200+0000","last_became_active":"2021-10-08T19:30:00.643797+0000","last_became_peered":"2021-10-08T19:30:00.643797+0000","last_unstale":"2021-10-08T19:36:21.149200+0000","last_undegraded":"2021-10-08T19:36:21.149200+0000","last_fullsized":"2021-10-08T19:36:21.149200+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:36:01.674904+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:36:01.674904+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.072145927999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":311,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.148262+0000","last_change":"2021-10-08T19:36:00.599933+0000","last_active":"2021-10-08T19:36:21.148262+0000","last_peered":"2021-10-08T19:36:21.148262+0000","last_clean":"2021-10-08T19:36:21.148262+0000","last_became_active":"2021-10-08T19:24:25.095389+0000","last_became_peered":"2021-10-08T19:24:25.095389+0000","last_unstale":"2021-10-08T19:36:21.148262+0000","last_undegraded":"2021-10-08T19:36:21.148262+0000","last_fullsized":"2021-10-08T19:36:21.148262+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:00.599845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:36:00.599845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0065529969999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"289'29","reported_seq":412,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.154937+0000","last_change":"2021-10-08T19:36:05.122735+0000","last_active":"2021-10-08T19:36:21.154937+0000","last_peered":"2021-10-08T19:36:21.154937+0000","last_clean":"2021-10-08T19:36:21.154937+0000","last_became_active":"2021-10-08T19:21:25.741812+0000","last_became_peered":"2021-10-08T19:21:25.741812+0000","last_unstale":"2021-10-08T19:36:21.154937+0000","last_undegraded":"2021-10-08T19:36:21.154937+0000","last_fullsized":"2021-10-08T19:36:21.154937+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'29","last_scrub_stamp":"2021-10-08T19:36:05.122593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:05.122593+0000","log_size":29,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0069217020000000001,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":54,"num_read_kb":40,"num_write":32,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"328'2","reported_seq":373,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.144638+0000","last_change":"2021-10-08T19:36:03.954708+0000","last_active":"2021-10-08T19:36:21.144638+0000","last_peered":"2021-10-08T19:36:21.144638+0000","last_clean":"2021-10-08T19:36:21.144638+0000","last_became_active":"2021-10-08T19:21:23.604258+0000","last_became_peered":"2021-10-08T19:21:23.604258+0000","last_unstale":"2021-10-08T19:36:21.144638+0000","last_undegraded":"2021-10-08T19:36:21.144638+0000","last_fullsized":"2021-10-08T19:36:21.144638+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"328'2","last_scrub_stamp":"2021-10-08T19:36:03.954613+0000","last_deep_scrub":"328'2","last_deep_scrub_stamp":"2021-10-08T19:33:29.990395+0000","last_clean_scrub_stamp":"2021-10-08T19:36:03.954613+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0074631530000000001,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":203,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.156030+0000","last_change":"2021-10-08T19:34:56.791831+0000","last_active":"2021-10-08T19:36:21.156030+0000","last_peered":"2021-10-08T19:36:21.156030+0000","last_clean":"2021-10-08T19:36:21.156030+0000","last_became_active":"2021-10-08T19:28:40.140876+0000","last_became_peered":"2021-10-08T19:28:40.140876+0000","last_unstale":"2021-10-08T19:36:21.156030+0000","last_undegraded":"2021-10-08T19:36:21.156030+0000","last_fullsized":"2021-10-08T19:36:21.156030+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:56.791734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:34:56.791734+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.031194143000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"70'5","reported_seq":209,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.156787+0000","last_change":"2021-10-08T19:35:30.660394+0000","last_active":"2021-10-08T19:36:21.156787+0000","last_peered":"2021-10-08T19:36:21.156787+0000","last_clean":"2021-10-08T19:36:21.156787+0000","last_became_active":"2021-10-08T19:28:40.150503+0000","last_became_peered":"2021-10-08T19:28:40.150503+0000","last_unstale":"2021-10-08T19:36:21.156787+0000","last_undegraded":"2021-10-08T19:36:21.156787+0000","last_fullsized":"2021-10-08T19:36:21.156787+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:35:30.660285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:30.660285+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0035933829999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.8","version":"385'5940","reported_seq":5977,"reported_epoch":385,"state":"active+clean","last_fresh":"2021-10-08T19:36:34.079361+0000","last_change":"2021-10-08T19:35:16.778383+0000","last_active":"2021-10-08T19:36:34.079361+0000","last_peered":"2021-10-08T19:36:34.079361+0000","last_clean":"2021-10-08T19:36:34.079361+0000","last_became_active":"2021-10-08T19:35:16.778100+0000","last_became_peered":"2021-10-08T19:35:16.778100+0000","last_unstale":"2021-10-08T19:36:34.079361+0000","last_undegraded":"2021-10-08T19:36:34.079361+0000","last_fullsized":"2021-10-08T19:36:34.079361+0000","mapping_epoch":355,"log_start":"362'1400","ondisk_log_start":"362'1400","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:35:15.759693+0000","log_size":4540,"ondisk_log_size":4540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":389283840,"num_objects":5940,"num_object_clones":0,"num_object_copies":17820,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5940,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5940,"num_write_kb":380160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7],"acting":[0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"90'130","reported_seq":510,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.162159+0000","last_change":"2021-10-08T19:36:09.840616+0000","last_active":"2021-10-08T19:36:21.162159+0000","last_peered":"2021-10-08T19:36:21.162159+0000","last_clean":"2021-10-08T19:36:21.162159+0000","last_became_active":"2021-10-08T19:28:43.178371+0000","last_became_peered":"2021-10-08T19:28:43.178371+0000","last_unstale":"2021-10-08T19:36:21.162159+0000","last_undegraded":"2021-10-08T19:36:21.162159+0000","last_fullsized":"2021-10-08T19:36:21.162159+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:36:09.840508+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:34:13.653248+0000","last_clean_scrub_stamp":"2021-10-08T19:36:09.840508+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0067520610000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":117,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.147884+0000","last_change":"2021-10-08T19:33:21.590512+0000","last_active":"2021-10-08T19:36:21.147884+0000","last_peered":"2021-10-08T19:36:21.147884+0000","last_clean":"2021-10-08T19:36:21.147884+0000","last_became_active":"2021-10-08T19:31:22.783759+0000","last_became_peered":"2021-10-08T19:31:22.783759+0000","last_unstale":"2021-10-08T19:36:21.147884+0000","last_undegraded":"2021-10-08T19:36:21.147884+0000","last_fullsized":"2021-10-08T19:36:21.147884+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:21.590400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:33:21.590400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.022083749,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"289'24","reported_seq":464,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.160524+0000","last_change":"2021-10-08T19:36:06.098172+0000","last_active":"2021-10-08T19:36:21.160524+0000","last_peered":"2021-10-08T19:36:21.160524+0000","last_clean":"2021-10-08T19:36:21.160524+0000","last_became_active":"2021-10-08T19:32:45.154743+0000","last_became_peered":"2021-10-08T19:32:45.154743+0000","last_unstale":"2021-10-08T19:36:21.160524+0000","last_undegraded":"2021-10-08T19:36:21.160524+0000","last_fullsized":"2021-10-08T19:36:21.160524+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'24","last_scrub_stamp":"2021-10-08T19:36:06.098078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:06.098078+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0071628120000000002,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":30,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":352,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.141183+0000","last_change":"2021-10-08T19:36:08.078394+0000","last_active":"2021-10-08T19:36:21.141183+0000","last_peered":"2021-10-08T19:36:21.141183+0000","last_clean":"2021-10-08T19:36:21.141183+0000","last_became_active":"2021-10-08T19:28:40.140231+0000","last_became_peered":"2021-10-08T19:28:40.140231+0000","last_unstale":"2021-10-08T19:36:21.141183+0000","last_undegraded":"2021-10-08T19:36:21.141183+0000","last_fullsized":"2021-10-08T19:36:21.141183+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:08.078324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:32.922694+0000","last_clean_scrub_stamp":"2021-10-08T19:36:08.078324+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020685959999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":393,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.153112+0000","last_change":"2021-10-08T19:34:58.928837+0000","last_active":"2021-10-08T19:36:21.153112+0000","last_peered":"2021-10-08T19:36:21.153112+0000","last_clean":"2021-10-08T19:36:21.153112+0000","last_became_active":"2021-10-08T19:29:40.632010+0000","last_became_peered":"2021-10-08T19:29:40.632010+0000","last_unstale":"2021-10-08T19:36:21.153112+0000","last_undegraded":"2021-10-08T19:36:21.153112+0000","last_fullsized":"2021-10-08T19:36:21.153112+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:58.928758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:58.928758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0012564410000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":111,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.156341+0000","last_change":"2021-10-08T19:36:11.789864+0000","last_active":"2021-10-08T19:36:21.156341+0000","last_peered":"2021-10-08T19:36:21.156341+0000","last_clean":"2021-10-08T19:36:21.156341+0000","last_became_active":"2021-10-08T19:31:51.673821+0000","last_became_peered":"2021-10-08T19:31:51.673821+0000","last_unstale":"2021-10-08T19:36:21.156341+0000","last_undegraded":"2021-10-08T19:36:21.156341+0000","last_fullsized":"2021-10-08T19:36:21.156341+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:11.789757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:21.644827+0000","last_clean_scrub_stamp":"2021-10-08T19:36:11.789757+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0099411570000000008,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"385'5853","reported_seq":5891,"reported_epoch":385,"state":"active+clean","last_fresh":"2021-10-08T19:36:33.572545+0000","last_change":"2021-10-08T19:35:16.785023+0000","last_active":"2021-10-08T19:36:33.572545+0000","last_peered":"2021-10-08T19:36:33.572545+0000","last_clean":"2021-10-08T19:36:33.572545+0000","last_became_active":"2021-10-08T19:35:16.784654+0000","last_became_peered":"2021-10-08T19:35:16.784654+0000","last_unstale":"2021-10-08T19:36:33.572545+0000","last_undegraded":"2021-10-08T19:36:33.572545+0000","last_fullsized":"2021-10-08T19:36:33.572545+0000","mapping_epoch":355,"log_start":"362'1000","ondisk_log_start":"362'1000","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:35:15.759693+0000","log_size":4853,"ondisk_log_size":4853,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":383582208,"num_objects":5853,"num_object_clones":0,"num_object_copies":17559,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5853,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5853,"num_write_kb":374592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0],"acting":[6,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":353,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.147371+0000","last_change":"2021-10-08T19:34:54.892507+0000","last_active":"2021-10-08T19:36:21.147371+0000","last_peered":"2021-10-08T19:36:21.147371+0000","last_clean":"2021-10-08T19:36:21.147371+0000","last_became_active":"2021-10-08T19:21:27.636086+0000","last_became_peered":"2021-10-08T19:21:27.636086+0000","last_unstale":"2021-10-08T19:36:21.147371+0000","last_undegraded":"2021-10-08T19:36:21.147371+0000","last_fullsized":"2021-10-08T19:36:21.147371+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:54.892389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:34:54.892389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0079512119999999992,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"289'26","reported_seq":339,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.147879+0000","last_change":"2021-10-08T19:34:58.535327+0000","last_active":"2021-10-08T19:36:21.147879+0000","last_peered":"2021-10-08T19:36:21.147879+0000","last_clean":"2021-10-08T19:36:21.147879+0000","last_became_active":"2021-10-08T19:24:25.100384+0000","last_became_peered":"2021-10-08T19:24:25.100384+0000","last_unstale":"2021-10-08T19:36:21.147879+0000","last_undegraded":"2021-10-08T19:36:21.147879+0000","last_fullsized":"2021-10-08T19:36:21.147879+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'26","last_scrub_stamp":"2021-10-08T19:34:58.535228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:34:58.535228+0000","log_size":26,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020755830000000002,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":42,"num_read_kb":32,"num_write":25,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"90'130","reported_seq":672,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.144957+0000","last_change":"2021-10-08T19:36:09.855513+0000","last_active":"2021-10-08T19:36:21.144957+0000","last_peered":"2021-10-08T19:36:21.144957+0000","last_clean":"2021-10-08T19:36:21.144957+0000","last_became_active":"2021-10-08T19:27:22.607289+0000","last_became_peered":"2021-10-08T19:27:22.607289+0000","last_unstale":"2021-10-08T19:36:21.144957+0000","last_undegraded":"2021-10-08T19:36:21.144957+0000","last_fullsized":"2021-10-08T19:36:21.144957+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:36:09.855393+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:36:09.855393+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0065522590000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":356,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.147611+0000","last_change":"2021-10-08T19:35:31.652594+0000","last_active":"2021-10-08T19:36:21.147611+0000","last_peered":"2021-10-08T19:36:21.147611+0000","last_clean":"2021-10-08T19:36:21.147611+0000","last_became_active":"2021-10-08T19:21:23.599143+0000","last_became_peered":"2021-10-08T19:21:23.599143+0000","last_unstale":"2021-10-08T19:36:21.147611+0000","last_undegraded":"2021-10-08T19:36:21.147611+0000","last_fullsized":"2021-10-08T19:36:21.147611+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:31.652494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:31.652494+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0075080879999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":169,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.139448+0000","last_change":"2021-10-08T19:35:33.861695+0000","last_active":"2021-10-08T19:36:21.139448+0000","last_peered":"2021-10-08T19:36:21.139448+0000","last_clean":"2021-10-08T19:36:21.139448+0000","last_became_active":"2021-10-08T19:29:40.638774+0000","last_became_peered":"2021-10-08T19:29:40.638774+0000","last_unstale":"2021-10-08T19:36:21.139448+0000","last_undegraded":"2021-10-08T19:36:21.139448+0000","last_fullsized":"2021-10-08T19:36:21.139448+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:33.861554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:33.861554+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011946132999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":368,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.148180+0000","last_change":"2021-10-08T19:35:24.690698+0000","last_active":"2021-10-08T19:36:21.148180+0000","last_peered":"2021-10-08T19:36:21.148180+0000","last_clean":"2021-10-08T19:36:21.148180+0000","last_became_active":"2021-10-08T19:29:40.627256+0000","last_became_peered":"2021-10-08T19:29:40.627256+0000","last_unstale":"2021-10-08T19:36:21.148180+0000","last_undegraded":"2021-10-08T19:36:21.148180+0000","last_fullsized":"2021-10-08T19:36:21.148180+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:24.690591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:32:15.872860+0000","last_clean_scrub_stamp":"2021-10-08T19:35:24.690591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.065857132999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"385'6000","reported_seq":6038,"reported_epoch":385,"state":"active+clean","last_fresh":"2021-10-08T19:36:33.609826+0000","last_change":"2021-10-08T19:35:16.780954+0000","last_active":"2021-10-08T19:36:33.609826+0000","last_peered":"2021-10-08T19:36:33.609826+0000","last_clean":"2021-10-08T19:36:33.609826+0000","last_became_active":"2021-10-08T19:35:16.780624+0000","last_became_peered":"2021-10-08T19:35:16.780624+0000","last_unstale":"2021-10-08T19:36:33.609826+0000","last_undegraded":"2021-10-08T19:36:33.609826+0000","last_fullsized":"2021-10-08T19:36:33.609826+0000","mapping_epoch":355,"log_start":"362'1300","ondisk_log_start":"362'1300","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:35:15.759693+0000","log_size":4700,"ondisk_log_size":4700,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":393216000,"num_objects":6000,"num_object_clones":0,"num_object_copies":18000,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6000,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6000,"num_write_kb":384000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"90'130","reported_seq":680,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.144860+0000","last_change":"2021-10-08T19:36:11.798375+0000","last_active":"2021-10-08T19:36:21.144860+0000","last_peered":"2021-10-08T19:36:21.144860+0000","last_clean":"2021-10-08T19:36:21.144860+0000","last_became_active":"2021-10-08T19:27:26.591250+0000","last_became_peered":"2021-10-08T19:27:26.591250+0000","last_unstale":"2021-10-08T19:36:21.144860+0000","last_undegraded":"2021-10-08T19:36:21.144860+0000","last_fullsized":"2021-10-08T19:36:21.144860+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:36:11.798245+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:36:11.798245+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013110805,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":363,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.141743+0000","last_change":"2021-10-08T19:35:23.047013+0000","last_active":"2021-10-08T19:36:21.141743+0000","last_peered":"2021-10-08T19:36:21.141743+0000","last_clean":"2021-10-08T19:36:21.141743+0000","last_became_active":"2021-10-08T19:21:27.637875+0000","last_became_peered":"2021-10-08T19:21:27.637875+0000","last_unstale":"2021-10-08T19:36:21.141743+0000","last_undegraded":"2021-10-08T19:36:21.141743+0000","last_fullsized":"2021-10-08T19:36:21.141743+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:23.046871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:20.092069+0000","last_clean_scrub_stamp":"2021-10-08T19:35:23.046871+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0044452409999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"289'17","reported_seq":117,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.157311+0000","last_change":"2021-10-08T19:35:22.787177+0000","last_active":"2021-10-08T19:36:21.157311+0000","last_peered":"2021-10-08T19:36:21.157311+0000","last_clean":"2021-10-08T19:36:21.157311+0000","last_became_active":"2021-10-08T19:31:51.674965+0000","last_became_peered":"2021-10-08T19:31:51.674965+0000","last_unstale":"2021-10-08T19:36:21.157311+0000","last_undegraded":"2021-10-08T19:36:21.157311+0000","last_fullsized":"2021-10-08T19:36:21.157311+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'17","last_scrub_stamp":"2021-10-08T19:35:22.787087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:35:22.787087+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.004183717,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":23,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":990,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":383,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.142243+0000","last_change":"2021-10-08T19:35:18.015926+0000","last_active":"2021-10-08T19:36:21.142243+0000","last_peered":"2021-10-08T19:36:21.142243+0000","last_clean":"2021-10-08T19:36:21.142243+0000","last_became_active":"2021-10-08T19:29:40.619746+0000","last_became_peered":"2021-10-08T19:29:40.619746+0000","last_unstale":"2021-10-08T19:36:21.142243+0000","last_undegraded":"2021-10-08T19:36:21.142243+0000","last_fullsized":"2021-10-08T19:36:21.142243+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:18.015850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:18.015850+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0013167389999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"70'5","reported_seq":207,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.156079+0000","last_change":"2021-10-08T19:36:16.753049+0000","last_active":"2021-10-08T19:36:21.156079+0000","last_peered":"2021-10-08T19:36:21.156079+0000","last_clean":"2021-10-08T19:36:21.156079+0000","last_became_active":"2021-10-08T19:28:40.148054+0000","last_became_peered":"2021-10-08T19:28:40.148054+0000","last_unstale":"2021-10-08T19:36:21.156079+0000","last_undegraded":"2021-10-08T19:36:21.156079+0000","last_fullsized":"2021-10-08T19:36:21.156079+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:34:18.630378+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2021-10-08T19:34:18.630378+0000","last_clean_scrub_stamp":"2021-10-08T19:34:18.630378+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0054668570000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":387,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.144580+0000","last_change":"2021-10-08T19:35:30.916430+0000","last_active":"2021-10-08T19:36:21.144580+0000","last_peered":"2021-10-08T19:36:21.144580+0000","last_clean":"2021-10-08T19:36:21.144580+0000","last_became_active":"2021-10-08T19:29:40.652528+0000","last_became_peered":"2021-10-08T19:29:40.652528+0000","last_unstale":"2021-10-08T19:36:21.144580+0000","last_undegraded":"2021-10-08T19:36:21.144580+0000","last_fullsized":"2021-10-08T19:36:21.144580+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:30.916326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:35:30.916326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.048993430999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.a","version":"385'5960","reported_seq":5998,"reported_epoch":385,"state":"active+clean","last_fresh":"2021-10-08T19:36:33.650370+0000","last_change":"2021-10-08T19:35:16.783039+0000","last_active":"2021-10-08T19:36:33.650370+0000","last_peered":"2021-10-08T19:36:33.650370+0000","last_clean":"2021-10-08T19:36:33.650370+0000","last_became_active":"2021-10-08T19:35:16.782677+0000","last_became_peered":"2021-10-08T19:35:16.782677+0000","last_unstale":"2021-10-08T19:36:33.650370+0000","last_undegraded":"2021-10-08T19:36:33.650370+0000","last_fullsized":"2021-10-08T19:36:33.650370+0000","mapping_epoch":355,"log_start":"362'1100","ondisk_log_start":"362'1100","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:35:15.759693+0000","log_size":4860,"ondisk_log_size":4860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":390594560,"num_objects":5960,"num_object_clones":0,"num_object_copies":17880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5960,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5960,"num_write_kb":381440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"90'130","reported_seq":532,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.145447+0000","last_change":"2021-10-08T19:35:19.581334+0000","last_active":"2021-10-08T19:36:21.145447+0000","last_peered":"2021-10-08T19:36:21.145447+0000","last_clean":"2021-10-08T19:36:21.145447+0000","last_became_active":"2021-10-08T19:27:26.591993+0000","last_became_peered":"2021-10-08T19:27:26.591993+0000","last_unstale":"2021-10-08T19:36:21.145447+0000","last_undegraded":"2021-10-08T19:36:21.145447+0000","last_fullsized":"2021-10-08T19:36:21.145447+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:35:19.581220+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:35:19.581220+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001876345,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,2],"acting":[5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":375,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.155489+0000","last_change":"2021-10-08T19:35:57.184673+0000","last_active":"2021-10-08T19:36:21.155489+0000","last_peered":"2021-10-08T19:36:21.155489+0000","last_clean":"2021-10-08T19:36:21.155489+0000","last_became_active":"2021-10-08T19:28:40.133414+0000","last_became_peered":"2021-10-08T19:28:40.133414+0000","last_unstale":"2021-10-08T19:36:21.155489+0000","last_undegraded":"2021-10-08T19:36:21.155489+0000","last_fullsized":"2021-10-08T19:36:21.155489+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:57.184578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:35:57.184578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014526842,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"289'44","reported_seq":407,"reported_epoch":385,"state":"active+clean","last_fresh":"2021-10-08T19:36:29.236122+0000","last_change":"2021-10-08T19:35:32.703833+0000","last_active":"2021-10-08T19:36:29.236122+0000","last_peered":"2021-10-08T19:36:29.236122+0000","last_clean":"2021-10-08T19:36:29.236122+0000","last_became_active":"2021-10-08T19:29:40.626138+0000","last_became_peered":"2021-10-08T19:29:40.626138+0000","last_unstale":"2021-10-08T19:36:29.236122+0000","last_undegraded":"2021-10-08T19:36:29.236122+0000","last_fullsized":"2021-10-08T19:36:29.236122+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'44","last_scrub_stamp":"2021-10-08T19:35:32.703721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:35:32.703721+0000","log_size":44,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0064438680000000002,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":65,"num_read_kb":50,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":1432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":392,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.147335+0000","last_change":"2021-10-08T19:35:23.647578+0000","last_active":"2021-10-08T19:36:21.147335+0000","last_peered":"2021-10-08T19:36:21.147335+0000","last_clean":"2021-10-08T19:36:21.147335+0000","last_became_active":"2021-10-08T19:28:40.137919+0000","last_became_peered":"2021-10-08T19:28:40.137919+0000","last_unstale":"2021-10-08T19:36:21.147335+0000","last_undegraded":"2021-10-08T19:36:21.147335+0000","last_fullsized":"2021-10-08T19:36:21.147335+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:23.647485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:23.647485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002822181,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":171,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.139820+0000","last_change":"2021-10-08T19:34:45.208220+0000","last_active":"2021-10-08T19:36:21.139820+0000","last_peered":"2021-10-08T19:36:21.139820+0000","last_clean":"2021-10-08T19:36:21.139820+0000","last_became_active":"2021-10-08T19:29:40.637371+0000","last_became_peered":"2021-10-08T19:29:40.637371+0000","last_unstale":"2021-10-08T19:36:21.139820+0000","last_undegraded":"2021-10-08T19:36:21.139820+0000","last_fullsized":"2021-10-08T19:36:21.139820+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:45.208127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:34:45.208127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.01258626,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":318,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.138075+0000","last_change":"2021-10-08T19:36:09.181971+0000","last_active":"2021-10-08T19:36:21.138075+0000","last_peered":"2021-10-08T19:36:21.138075+0000","last_clean":"2021-10-08T19:36:21.138075+0000","last_became_active":"2021-10-08T19:25:14.550690+0000","last_became_peered":"2021-10-08T19:25:14.550690+0000","last_unstale":"2021-10-08T19:36:21.138075+0000","last_undegraded":"2021-10-08T19:36:21.138075+0000","last_fullsized":"2021-10-08T19:36:21.138075+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:09.181866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:36:09.181866+0000","last_clean_scrub_stamp":"2021-10-08T19:36:09.181866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0070630550000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"385'6103","reported_seq":6141,"reported_epoch":385,"state":"active+clean","last_fresh":"2021-10-08T19:36:33.701620+0000","last_change":"2021-10-08T19:35:16.778370+0000","last_active":"2021-10-08T19:36:33.701620+0000","last_peered":"2021-10-08T19:36:33.701620+0000","last_clean":"2021-10-08T19:36:33.701620+0000","last_became_active":"2021-10-08T19:35:16.778062+0000","last_became_peered":"2021-10-08T19:35:16.778062+0000","last_unstale":"2021-10-08T19:36:33.701620+0000","last_undegraded":"2021-10-08T19:36:33.701620+0000","last_fullsized":"2021-10-08T19:36:33.701620+0000","mapping_epoch":355,"log_start":"364'2100","ondisk_log_start":"364'2100","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:35:15.759693+0000","log_size":4003,"ondisk_log_size":4003,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":399966208,"num_objects":6103,"num_object_clones":0,"num_object_copies":18309,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6103,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6103,"num_write_kb":390592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.7","version":"90'130","reported_seq":634,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.148260+0000","last_change":"2021-10-08T19:35:29.542745+0000","last_active":"2021-10-08T19:36:21.148260+0000","last_peered":"2021-10-08T19:36:21.148260+0000","last_clean":"2021-10-08T19:36:21.148260+0000","last_became_active":"2021-10-08T19:29:43.636820+0000","last_became_peered":"2021-10-08T19:29:43.636820+0000","last_unstale":"2021-10-08T19:36:21.148260+0000","last_undegraded":"2021-10-08T19:36:21.148260+0000","last_fullsized":"2021-10-08T19:36:21.148260+0000","mapping_epoch":239,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:35:29.542673+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:35:29.542673+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002657024,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"114'10","reported_seq":572,"reported_epoch":385,"state":"active+clean","last_fresh":"2021-10-08T19:36:29.226556+0000","last_change":"2021-10-08T19:34:03.864493+0000","last_active":"2021-10-08T19:36:29.226556+0000","last_peered":"2021-10-08T19:36:29.226556+0000","last_clean":"2021-10-08T19:36:29.226556+0000","last_became_active":"2021-10-08T19:24:25.106695+0000","last_became_peered":"2021-10-08T19:24:25.106695+0000","last_unstale":"2021-10-08T19:36:29.226556+0000","last_undegraded":"2021-10-08T19:36:29.226556+0000","last_fullsized":"2021-10-08T19:36:29.226556+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'10","last_scrub_stamp":"2021-10-08T19:34:03.864384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:34:03.864384+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.007036924,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"289'20","reported_seq":117,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.156550+0000","last_change":"2021-10-08T19:36:04.773566+0000","last_active":"2021-10-08T19:36:21.156550+0000","last_peered":"2021-10-08T19:36:21.156550+0000","last_clean":"2021-10-08T19:36:21.156550+0000","last_became_active":"2021-10-08T19:31:51.675569+0000","last_became_peered":"2021-10-08T19:31:51.675569+0000","last_unstale":"2021-10-08T19:36:21.156550+0000","last_undegraded":"2021-10-08T19:36:21.156550+0000","last_fullsized":"2021-10-08T19:36:21.156550+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'20","last_scrub_stamp":"2021-10-08T19:36:04.773449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:04.773449+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0045168379999999996,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":23,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":209,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.156422+0000","last_change":"2021-10-08T19:35:16.702516+0000","last_active":"2021-10-08T19:36:21.156422+0000","last_peered":"2021-10-08T19:36:21.156422+0000","last_clean":"2021-10-08T19:36:21.156422+0000","last_became_active":"2021-10-08T19:28:40.141737+0000","last_became_peered":"2021-10-08T19:28:40.141737+0000","last_unstale":"2021-10-08T19:36:21.156422+0000","last_undegraded":"2021-10-08T19:36:21.156422+0000","last_fullsized":"2021-10-08T19:36:21.156422+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:16.702426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:16.702426+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0018085219999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":371,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.152252+0000","last_change":"2021-10-08T19:34:16.042895+0000","last_active":"2021-10-08T19:36:21.152252+0000","last_peered":"2021-10-08T19:36:21.152252+0000","last_clean":"2021-10-08T19:36:21.152252+0000","last_became_active":"2021-10-08T19:29:40.643614+0000","last_became_peered":"2021-10-08T19:29:40.643614+0000","last_unstale":"2021-10-08T19:36:21.152252+0000","last_undegraded":"2021-10-08T19:36:21.152252+0000","last_fullsized":"2021-10-08T19:36:21.152252+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:16.042797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:16.042797+0000","last_clean_scrub_stamp":"2021-10-08T19:34:16.042797+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.038141670000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":326,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.149477+0000","last_change":"2021-10-08T19:32:49.731052+0000","last_active":"2021-10-08T19:36:21.149477+0000","last_peered":"2021-10-08T19:36:21.149477+0000","last_clean":"2021-10-08T19:36:21.149477+0000","last_became_active":"2021-10-08T19:29:40.626998+0000","last_became_peered":"2021-10-08T19:29:40.626998+0000","last_unstale":"2021-10-08T19:36:21.149477+0000","last_undegraded":"2021-10-08T19:36:21.149477+0000","last_fullsized":"2021-10-08T19:36:21.149477+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:32:49.730960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:32:49.730960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.017072971999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"385'6045","reported_seq":6083,"reported_epoch":385,"state":"active+clean","last_fresh":"2021-10-08T19:36:33.621646+0000","last_change":"2021-10-08T19:35:17.125218+0000","last_active":"2021-10-08T19:36:33.621646+0000","last_peered":"2021-10-08T19:36:33.621646+0000","last_clean":"2021-10-08T19:36:33.621646+0000","last_became_active":"2021-10-08T19:35:17.124846+0000","last_became_peered":"2021-10-08T19:35:17.124846+0000","last_unstale":"2021-10-08T19:36:33.621646+0000","last_undegraded":"2021-10-08T19:36:33.621646+0000","last_fullsized":"2021-10-08T19:36:33.621646+0000","mapping_epoch":355,"log_start":"362'1200","ondisk_log_start":"362'1200","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:35:15.759693+0000","log_size":4845,"ondisk_log_size":4845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":396165120,"num_objects":6045,"num_object_clones":0,"num_object_copies":18135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6045,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6045,"num_write_kb":386880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":383,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.141423+0000","last_change":"2021-10-08T19:36:11.024465+0000","last_active":"2021-10-08T19:36:21.141423+0000","last_peered":"2021-10-08T19:36:21.141423+0000","last_clean":"2021-10-08T19:36:21.141423+0000","last_became_active":"2021-10-08T19:28:40.138726+0000","last_became_peered":"2021-10-08T19:28:40.138726+0000","last_unstale":"2021-10-08T19:36:21.141423+0000","last_undegraded":"2021-10-08T19:36:21.141423+0000","last_fullsized":"2021-10-08T19:36:21.141423+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:11.024348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:50.435552+0000","last_clean_scrub_stamp":"2021-10-08T19:36:11.024348+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012476683000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"289'18","reported_seq":470,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.140017+0000","last_change":"2021-10-08T19:36:01.333174+0000","last_active":"2021-10-08T19:36:21.140017+0000","last_peered":"2021-10-08T19:36:21.140017+0000","last_clean":"2021-10-08T19:36:21.140017+0000","last_became_active":"2021-10-08T19:29:40.638957+0000","last_became_peered":"2021-10-08T19:29:40.638957+0000","last_unstale":"2021-10-08T19:36:21.140017+0000","last_undegraded":"2021-10-08T19:36:21.140017+0000","last_fullsized":"2021-10-08T19:36:21.140017+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'18","last_scrub_stamp":"2021-10-08T19:36:01.333053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:01.333053+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011804939,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":25,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"61'2","reported_seq":372,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.138585+0000","last_change":"2021-10-08T19:35:27.186175+0000","last_active":"2021-10-08T19:36:21.138585+0000","last_peered":"2021-10-08T19:36:21.138585+0000","last_clean":"2021-10-08T19:36:21.138585+0000","last_became_active":"2021-10-08T19:21:23.603614+0000","last_became_peered":"2021-10-08T19:21:23.603614+0000","last_unstale":"2021-10-08T19:36:21.138585+0000","last_undegraded":"2021-10-08T19:36:21.138585+0000","last_fullsized":"2021-10-08T19:36:21.138585+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'2","last_scrub_stamp":"2021-10-08T19:35:27.186086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:27.186086+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0052704600000000002,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":169,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.141054+0000","last_change":"2021-10-08T19:35:18.179768+0000","last_active":"2021-10-08T19:36:21.141054+0000","last_peered":"2021-10-08T19:36:21.141054+0000","last_clean":"2021-10-08T19:36:21.141054+0000","last_became_active":"2021-10-08T19:29:40.645211+0000","last_became_peered":"2021-10-08T19:29:40.645211+0000","last_unstale":"2021-10-08T19:36:21.141054+0000","last_undegraded":"2021-10-08T19:36:21.141054+0000","last_fullsized":"2021-10-08T19:36:21.141054+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:18.179673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:35:18.179673+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.080956615999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":292,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.144368+0000","last_change":"2021-10-08T19:34:44.848499+0000","last_active":"2021-10-08T19:36:21.144368+0000","last_peered":"2021-10-08T19:36:21.144368+0000","last_clean":"2021-10-08T19:36:21.144368+0000","last_became_active":"2021-10-08T19:28:40.100770+0000","last_became_peered":"2021-10-08T19:28:40.100770+0000","last_unstale":"2021-10-08T19:36:21.144368+0000","last_undegraded":"2021-10-08T19:36:21.144368+0000","last_fullsized":"2021-10-08T19:36:21.144368+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:44.848412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:44.848412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011032586,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"289'15","reported_seq":424,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.160595+0000","last_change":"2021-10-08T19:35:25.783136+0000","last_active":"2021-10-08T19:36:21.160595+0000","last_peered":"2021-10-08T19:36:21.160595+0000","last_clean":"2021-10-08T19:36:21.160595+0000","last_became_active":"2021-10-08T19:29:40.644354+0000","last_became_peered":"2021-10-08T19:29:40.644354+0000","last_unstale":"2021-10-08T19:36:21.160595+0000","last_undegraded":"2021-10-08T19:36:21.160595+0000","last_fullsized":"2021-10-08T19:36:21.160595+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'15","last_scrub_stamp":"2021-10-08T19:35:25.783048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:35:25.783048+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0045023340000000002,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":391,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.141355+0000","last_change":"2021-10-08T19:35:19.040312+0000","last_active":"2021-10-08T19:36:21.141355+0000","last_peered":"2021-10-08T19:36:21.141355+0000","last_clean":"2021-10-08T19:36:21.141355+0000","last_became_active":"2021-10-08T19:28:40.139234+0000","last_became_peered":"2021-10-08T19:28:40.139234+0000","last_unstale":"2021-10-08T19:36:21.141355+0000","last_undegraded":"2021-10-08T19:36:21.141355+0000","last_fullsized":"2021-10-08T19:36:21.141355+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:19.040235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:19.040235+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0015896599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":169,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.140734+0000","last_change":"2021-10-08T19:35:19.059789+0000","last_active":"2021-10-08T19:36:21.140734+0000","last_peered":"2021-10-08T19:36:21.140734+0000","last_clean":"2021-10-08T19:36:21.140734+0000","last_became_active":"2021-10-08T19:29:40.645111+0000","last_became_peered":"2021-10-08T19:29:40.645111+0000","last_unstale":"2021-10-08T19:36:21.140734+0000","last_undegraded":"2021-10-08T19:36:21.140734+0000","last_fullsized":"2021-10-08T19:36:21.140734+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:19.059695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:35:19.059695+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0017259879999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":363,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.140726+0000","last_change":"2021-10-08T19:36:17.901591+0000","last_active":"2021-10-08T19:36:21.140726+0000","last_peered":"2021-10-08T19:36:21.140726+0000","last_clean":"2021-10-08T19:36:21.140726+0000","last_became_active":"2021-10-08T19:21:29.640674+0000","last_became_peered":"2021-10-08T19:21:29.640674+0000","last_unstale":"2021-10-08T19:36:21.140726+0000","last_undegraded":"2021-10-08T19:36:21.140726+0000","last_fullsized":"2021-10-08T19:36:21.140726+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:17.901480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:36:17.901480+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034584479999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":284,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.143822+0000","last_change":"2021-10-08T19:35:34.911655+0000","last_active":"2021-10-08T19:36:21.143822+0000","last_peered":"2021-10-08T19:36:21.143822+0000","last_clean":"2021-10-08T19:36:21.143822+0000","last_became_active":"2021-10-08T19:25:15.501118+0000","last_became_peered":"2021-10-08T19:25:15.501118+0000","last_unstale":"2021-10-08T19:36:21.143822+0000","last_undegraded":"2021-10-08T19:36:21.143822+0000","last_fullsized":"2021-10-08T19:36:21.143822+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:34.911590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:34.911590+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.00387858,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"289'12","reported_seq":192,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.140593+0000","last_change":"2021-10-08T19:36:14.746788+0000","last_active":"2021-10-08T19:36:21.140593+0000","last_peered":"2021-10-08T19:36:21.140593+0000","last_clean":"2021-10-08T19:36:21.140593+0000","last_became_active":"2021-10-08T19:29:40.644657+0000","last_became_peered":"2021-10-08T19:29:40.644657+0000","last_unstale":"2021-10-08T19:36:21.140593+0000","last_undegraded":"2021-10-08T19:36:21.140593+0000","last_fullsized":"2021-10-08T19:36:21.140593+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'12","last_scrub_stamp":"2021-10-08T19:36:14.746690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:14.746690+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0050396959999999998,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":18,"num_read_kb":15,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":325,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.143434+0000","last_change":"2021-10-08T19:35:19.626725+0000","last_active":"2021-10-08T19:36:21.143434+0000","last_peered":"2021-10-08T19:36:21.143434+0000","last_clean":"2021-10-08T19:36:21.143434+0000","last_became_active":"2021-10-08T19:28:40.101898+0000","last_became_peered":"2021-10-08T19:28:40.101898+0000","last_unstale":"2021-10-08T19:36:21.143434+0000","last_undegraded":"2021-10-08T19:36:21.143434+0000","last_fullsized":"2021-10-08T19:36:21.143434+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:19.626649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:16.444582+0000","last_clean_scrub_stamp":"2021-10-08T19:35:19.626649+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0017102389999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":388,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.148833+0000","last_change":"2021-10-08T19:34:03.603560+0000","last_active":"2021-10-08T19:36:21.148833+0000","last_peered":"2021-10-08T19:36:21.148833+0000","last_clean":"2021-10-08T19:36:21.148833+0000","last_became_active":"2021-10-08T19:29:40.626950+0000","last_became_peered":"2021-10-08T19:29:40.626950+0000","last_unstale":"2021-10-08T19:36:21.148833+0000","last_undegraded":"2021-10-08T19:36:21.148833+0000","last_fullsized":"2021-10-08T19:36:21.148833+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:03.603487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:34:03.603487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011751039,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":375,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.144282+0000","last_change":"2021-10-08T19:35:33.907637+0000","last_active":"2021-10-08T19:36:21.144282+0000","last_peered":"2021-10-08T19:36:21.144282+0000","last_clean":"2021-10-08T19:36:21.144282+0000","last_became_active":"2021-10-08T19:24:25.099371+0000","last_became_peered":"2021-10-08T19:24:25.099371+0000","last_unstale":"2021-10-08T19:36:21.144282+0000","last_undegraded":"2021-10-08T19:36:21.144282+0000","last_fullsized":"2021-10-08T19:36:21.144282+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:33.907545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:35:33.907545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.028929507,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"70'5","reported_seq":560,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.143130+0000","last_change":"2021-10-08T19:36:07.636175+0000","last_active":"2021-10-08T19:36:21.143130+0000","last_peered":"2021-10-08T19:36:21.143130+0000","last_clean":"2021-10-08T19:36:21.143130+0000","last_became_active":"2021-10-08T19:31:22.785193+0000","last_became_peered":"2021-10-08T19:31:22.785193+0000","last_unstale":"2021-10-08T19:36:21.143130+0000","last_undegraded":"2021-10-08T19:36:21.143130+0000","last_fullsized":"2021-10-08T19:36:21.143130+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":5,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:36:07.636099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:07.636099+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.004695103,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"289'20","reported_seq":240,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.140361+0000","last_change":"2021-10-08T19:35:59.742206+0000","last_active":"2021-10-08T19:36:21.140361+0000","last_peered":"2021-10-08T19:36:21.140361+0000","last_clean":"2021-10-08T19:36:21.140361+0000","last_became_active":"2021-10-08T19:31:51.677055+0000","last_became_peered":"2021-10-08T19:31:51.677055+0000","last_unstale":"2021-10-08T19:36:21.140361+0000","last_undegraded":"2021-10-08T19:36:21.140361+0000","last_fullsized":"2021-10-08T19:36:21.140361+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'20","last_scrub_stamp":"2021-10-08T19:35:59.742121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:35:59.742121+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0052506209999999996,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":374,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.147192+0000","last_change":"2021-10-08T19:35:20.582479+0000","last_active":"2021-10-08T19:36:21.147192+0000","last_peered":"2021-10-08T19:36:21.147192+0000","last_clean":"2021-10-08T19:36:21.147192+0000","last_became_active":"2021-10-08T19:29:40.631331+0000","last_became_peered":"2021-10-08T19:29:40.631331+0000","last_unstale":"2021-10-08T19:36:21.147192+0000","last_undegraded":"2021-10-08T19:36:21.147192+0000","last_fullsized":"2021-10-08T19:36:21.147192+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:20.582397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:20.582397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001422972,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"328'11","reported_seq":570,"reported_epoch":385,"state":"active+clean","last_fresh":"2021-10-08T19:36:29.226698+0000","last_change":"2021-10-08T19:33:32.545949+0000","last_active":"2021-10-08T19:36:29.226698+0000","last_peered":"2021-10-08T19:36:29.226698+0000","last_clean":"2021-10-08T19:36:29.226698+0000","last_became_active":"2021-10-08T19:28:40.138031+0000","last_became_peered":"2021-10-08T19:28:40.138031+0000","last_unstale":"2021-10-08T19:36:29.226698+0000","last_undegraded":"2021-10-08T19:36:29.226698+0000","last_fullsized":"2021-10-08T19:36:29.226698+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"328'11","last_scrub_stamp":"2021-10-08T19:33:32.545870+0000","last_deep_scrub":"328'11","last_deep_scrub_stamp":"2021-10-08T19:33:32.545870+0000","last_clean_scrub_stamp":"2021-10-08T19:33:32.545870+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.023323448,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":371,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.160457+0000","last_change":"2021-10-08T19:36:07.150538+0000","last_active":"2021-10-08T19:36:21.160457+0000","last_peered":"2021-10-08T19:36:21.160457+0000","last_clean":"2021-10-08T19:36:21.160457+0000","last_became_active":"2021-10-08T19:29:40.644819+0000","last_became_peered":"2021-10-08T19:29:40.644819+0000","last_unstale":"2021-10-08T19:36:21.160457+0000","last_undegraded":"2021-10-08T19:36:21.160457+0000","last_fullsized":"2021-10-08T19:36:21.160457+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:07.150440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:36:07.150440+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.032064849999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":280,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.144207+0000","last_change":"2021-10-08T19:34:58.902486+0000","last_active":"2021-10-08T19:36:21.144207+0000","last_peered":"2021-10-08T19:36:21.144207+0000","last_clean":"2021-10-08T19:36:21.144207+0000","last_became_active":"2021-10-08T19:25:15.498770+0000","last_became_peered":"2021-10-08T19:25:15.498770+0000","last_unstale":"2021-10-08T19:36:21.144207+0000","last_undegraded":"2021-10-08T19:36:21.144207+0000","last_fullsized":"2021-10-08T19:36:21.144207+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:58.902409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:58.902409+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034749170000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"289'15","reported_seq":136,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.149399+0000","last_change":"2021-10-08T19:33:30.506573+0000","last_active":"2021-10-08T19:36:21.149399+0000","last_peered":"2021-10-08T19:36:21.149399+0000","last_clean":"2021-10-08T19:36:21.149399+0000","last_became_active":"2021-10-08T19:31:22.786860+0000","last_became_peered":"2021-10-08T19:31:22.786860+0000","last_unstale":"2021-10-08T19:36:21.149399+0000","last_undegraded":"2021-10-08T19:36:21.149399+0000","last_fullsized":"2021-10-08T19:36:21.149399+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'15","last_scrub_stamp":"2021-10-08T19:33:30.506458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:33:30.506458+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010013156,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":385,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.155028+0000","last_change":"2021-10-08T19:36:13.061448+0000","last_active":"2021-10-08T19:36:21.155028+0000","last_peered":"2021-10-08T19:36:21.155028+0000","last_clean":"2021-10-08T19:36:21.155028+0000","last_became_active":"2021-10-08T19:29:44.439397+0000","last_became_peered":"2021-10-08T19:29:44.439397+0000","last_unstale":"2021-10-08T19:36:21.155028+0000","last_undegraded":"2021-10-08T19:36:21.155028+0000","last_fullsized":"2021-10-08T19:36:21.155028+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:13.061347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:13.061347+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0089607839999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"238'10","reported_seq":256,"reported_epoch":385,"state":"active+clean","last_fresh":"2021-10-08T19:36:29.237151+0000","last_change":"2021-10-08T19:34:14.090645+0000","last_active":"2021-10-08T19:36:29.237151+0000","last_peered":"2021-10-08T19:36:29.237151+0000","last_clean":"2021-10-08T19:36:29.237151+0000","last_became_active":"2021-10-08T19:29:40.637650+0000","last_became_peered":"2021-10-08T19:29:40.637650+0000","last_unstale":"2021-10-08T19:36:29.237151+0000","last_undegraded":"2021-10-08T19:36:29.237151+0000","last_fullsized":"2021-10-08T19:36:29.237151+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"238'10","last_scrub_stamp":"2021-10-08T19:34:14.090547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:34:14.090547+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.017481770000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":350,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.138885+0000","last_change":"2021-10-08T19:36:00.407971+0000","last_active":"2021-10-08T19:36:21.138885+0000","last_peered":"2021-10-08T19:36:21.138885+0000","last_clean":"2021-10-08T19:36:21.138885+0000","last_became_active":"2021-10-08T19:21:29.640302+0000","last_became_peered":"2021-10-08T19:21:29.640302+0000","last_unstale":"2021-10-08T19:36:21.138885+0000","last_undegraded":"2021-10-08T19:36:21.138885+0000","last_fullsized":"2021-10-08T19:36:21.138885+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:00.407898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:36:00.407898+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.105360284,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":292,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.152763+0000","last_change":"2021-10-08T19:34:51.964960+0000","last_active":"2021-10-08T19:36:21.152763+0000","last_peered":"2021-10-08T19:36:21.152763+0000","last_clean":"2021-10-08T19:36:21.152763+0000","last_became_active":"2021-10-08T19:29:40.631374+0000","last_became_peered":"2021-10-08T19:29:40.631374+0000","last_unstale":"2021-10-08T19:36:21.152763+0000","last_undegraded":"2021-10-08T19:36:21.152763+0000","last_fullsized":"2021-10-08T19:36:21.152763+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:51.964844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:51.964844+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010245107,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":296,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.144194+0000","last_change":"2021-10-08T19:35:17.858327+0000","last_active":"2021-10-08T19:36:21.144194+0000","last_peered":"2021-10-08T19:36:21.144194+0000","last_clean":"2021-10-08T19:36:21.144194+0000","last_became_active":"2021-10-08T19:29:40.652966+0000","last_became_peered":"2021-10-08T19:29:40.652966+0000","last_unstale":"2021-10-08T19:36:21.144194+0000","last_undegraded":"2021-10-08T19:36:21.144194+0000","last_fullsized":"2021-10-08T19:36:21.144194+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:17.858192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:17.858192+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0019694320000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"289'19","reported_seq":115,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.156286+0000","last_change":"2021-10-08T19:34:53.739955+0000","last_active":"2021-10-08T19:36:21.156286+0000","last_peered":"2021-10-08T19:36:21.156286+0000","last_clean":"2021-10-08T19:36:21.156286+0000","last_became_active":"2021-10-08T19:31:51.676961+0000","last_became_peered":"2021-10-08T19:31:51.676961+0000","last_unstale":"2021-10-08T19:36:21.156286+0000","last_undegraded":"2021-10-08T19:36:21.156286+0000","last_fullsized":"2021-10-08T19:36:21.156286+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:34:53.739851+0000","last_deep_scrub":"289'19","last_deep_scrub_stamp":"2021-10-08T19:32:46.539792+0000","last_clean_scrub_stamp":"2021-10-08T19:34:53.739851+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.018714432,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":341,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.147351+0000","last_change":"2021-10-08T19:34:52.557866+0000","last_active":"2021-10-08T19:36:21.147351+0000","last_peered":"2021-10-08T19:36:21.147351+0000","last_clean":"2021-10-08T19:36:21.147351+0000","last_became_active":"2021-10-08T19:31:22.786651+0000","last_became_peered":"2021-10-08T19:31:22.786651+0000","last_unstale":"2021-10-08T19:36:21.147351+0000","last_undegraded":"2021-10-08T19:36:21.147351+0000","last_fullsized":"2021-10-08T19:36:21.147351+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:52.557763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:52.557763+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.01007186,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":171,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.140976+0000","last_change":"2021-10-08T19:34:44.147010+0000","last_active":"2021-10-08T19:36:21.140976+0000","last_peered":"2021-10-08T19:36:21.140976+0000","last_clean":"2021-10-08T19:36:21.140976+0000","last_became_active":"2021-10-08T19:29:40.644770+0000","last_became_peered":"2021-10-08T19:29:40.644770+0000","last_unstale":"2021-10-08T19:36:21.140976+0000","last_undegraded":"2021-10-08T19:36:21.140976+0000","last_fullsized":"2021-10-08T19:36:21.140976+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:44.146892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:34:44.146892+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0086783989999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":373,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.150551+0000","last_change":"2021-10-08T19:35:24.753897+0000","last_active":"2021-10-08T19:36:21.150551+0000","last_peered":"2021-10-08T19:36:21.150551+0000","last_clean":"2021-10-08T19:36:21.150551+0000","last_became_active":"2021-10-08T19:28:40.133744+0000","last_became_peered":"2021-10-08T19:28:40.133744+0000","last_unstale":"2021-10-08T19:36:21.150551+0000","last_undegraded":"2021-10-08T19:36:21.150551+0000","last_fullsized":"2021-10-08T19:36:21.150551+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:24.753785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:35:24.753785+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.021400018999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"289'19","reported_seq":510,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.138004+0000","last_change":"2021-10-08T19:36:10.148431+0000","last_active":"2021-10-08T19:36:21.138004+0000","last_peered":"2021-10-08T19:36:21.138004+0000","last_clean":"2021-10-08T19:36:21.138004+0000","last_became_active":"2021-10-08T19:28:40.100196+0000","last_became_peered":"2021-10-08T19:28:40.100196+0000","last_unstale":"2021-10-08T19:36:21.138004+0000","last_undegraded":"2021-10-08T19:36:21.138004+0000","last_fullsized":"2021-10-08T19:36:21.138004+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:36:10.148317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:10.148317+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013984083,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":211,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.156732+0000","last_change":"2021-10-08T19:35:29.678176+0000","last_active":"2021-10-08T19:36:21.156732+0000","last_peered":"2021-10-08T19:36:21.156732+0000","last_clean":"2021-10-08T19:36:21.156732+0000","last_became_active":"2021-10-08T19:28:40.146673+0000","last_became_peered":"2021-10-08T19:28:40.146673+0000","last_unstale":"2021-10-08T19:36:21.156732+0000","last_undegraded":"2021-10-08T19:36:21.156732+0000","last_fullsized":"2021-10-08T19:36:21.156732+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:29.677982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:29.677982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0076172159999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":221,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.156641+0000","last_change":"2021-10-08T19:34:55.788781+0000","last_active":"2021-10-08T19:36:21.156641+0000","last_peered":"2021-10-08T19:36:21.156641+0000","last_clean":"2021-10-08T19:36:21.156641+0000","last_became_active":"2021-10-08T19:29:40.638536+0000","last_became_peered":"2021-10-08T19:29:40.638536+0000","last_unstale":"2021-10-08T19:36:21.156641+0000","last_undegraded":"2021-10-08T19:36:21.156641+0000","last_fullsized":"2021-10-08T19:36:21.156641+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:55.788660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:43.186684+0000","last_clean_scrub_stamp":"2021-10-08T19:34:55.788660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.020657894,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":169,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.139186+0000","last_change":"2021-10-08T19:35:21.993459+0000","last_active":"2021-10-08T19:36:21.139186+0000","last_peered":"2021-10-08T19:36:21.139186+0000","last_clean":"2021-10-08T19:36:21.139186+0000","last_became_active":"2021-10-08T19:29:40.634300+0000","last_became_peered":"2021-10-08T19:29:40.634300+0000","last_unstale":"2021-10-08T19:36:21.139186+0000","last_undegraded":"2021-10-08T19:36:21.139186+0000","last_fullsized":"2021-10-08T19:36:21.139186+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:21.993295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:35:21.993295+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.015124034,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"70'5","reported_seq":280,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.139772+0000","last_change":"2021-10-08T19:36:06.256008+0000","last_active":"2021-10-08T19:36:21.139772+0000","last_peered":"2021-10-08T19:36:21.139772+0000","last_clean":"2021-10-08T19:36:21.139772+0000","last_became_active":"2021-10-08T19:25:15.496309+0000","last_became_peered":"2021-10-08T19:25:15.496309+0000","last_unstale":"2021-10-08T19:36:21.139772+0000","last_undegraded":"2021-10-08T19:36:21.139772+0000","last_fullsized":"2021-10-08T19:36:21.139772+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:36:06.255898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:06.255898+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0073902810000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.10","version":"289'8","reported_seq":198,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.138923+0000","last_change":"2021-10-08T19:36:06.812233+0000","last_active":"2021-10-08T19:36:21.138923+0000","last_peered":"2021-10-08T19:36:21.138923+0000","last_clean":"2021-10-08T19:36:21.138923+0000","last_became_active":"2021-10-08T19:32:45.165103+0000","last_became_peered":"2021-10-08T19:32:45.165103+0000","last_unstale":"2021-10-08T19:36:21.138923+0000","last_undegraded":"2021-10-08T19:36:21.138923+0000","last_fullsized":"2021-10-08T19:36:21.138923+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'8","last_scrub_stamp":"2021-10-08T19:36:06.812115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:06.812115+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010666471,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":374,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.149021+0000","last_change":"2021-10-08T19:35:18.550632+0000","last_active":"2021-10-08T19:36:21.149021+0000","last_peered":"2021-10-08T19:36:21.149021+0000","last_clean":"2021-10-08T19:36:21.149021+0000","last_became_active":"2021-10-08T19:24:25.094384+0000","last_became_peered":"2021-10-08T19:24:25.094384+0000","last_unstale":"2021-10-08T19:36:21.149021+0000","last_undegraded":"2021-10-08T19:36:21.149021+0000","last_fullsized":"2021-10-08T19:36:21.149021+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:18.550521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:13.716331+0000","last_clean_scrub_stamp":"2021-10-08T19:35:18.550521+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0037919709999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":314,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.143515+0000","last_change":"2021-10-08T19:35:27.551866+0000","last_active":"2021-10-08T19:36:21.143515+0000","last_peered":"2021-10-08T19:36:21.143515+0000","last_clean":"2021-10-08T19:36:21.143515+0000","last_became_active":"2021-10-08T19:24:25.106186+0000","last_became_peered":"2021-10-08T19:24:25.106186+0000","last_unstale":"2021-10-08T19:36:21.143515+0000","last_undegraded":"2021-10-08T19:36:21.143515+0000","last_fullsized":"2021-10-08T19:36:21.143515+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:27.551788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:18.377739+0000","last_clean_scrub_stamp":"2021-10-08T19:35:27.551788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0030249280000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":359,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.144897+0000","last_change":"2021-10-08T19:35:57.018331+0000","last_active":"2021-10-08T19:36:21.144897+0000","last_peered":"2021-10-08T19:36:21.144897+0000","last_clean":"2021-10-08T19:36:21.144897+0000","last_became_active":"2021-10-08T19:21:29.642835+0000","last_became_peered":"2021-10-08T19:21:29.642835+0000","last_unstale":"2021-10-08T19:36:21.144897+0000","last_undegraded":"2021-10-08T19:36:21.144897+0000","last_fullsized":"2021-10-08T19:36:21.144897+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:57.018227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:35:57.018227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012449864,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":292,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.148697+0000","last_change":"2021-10-08T19:35:21.620918+0000","last_active":"2021-10-08T19:36:21.148697+0000","last_peered":"2021-10-08T19:36:21.148697+0000","last_clean":"2021-10-08T19:36:21.148697+0000","last_became_active":"2021-10-08T19:28:40.099215+0000","last_became_peered":"2021-10-08T19:28:40.099215+0000","last_unstale":"2021-10-08T19:36:21.148697+0000","last_undegraded":"2021-10-08T19:36:21.148697+0000","last_fullsized":"2021-10-08T19:36:21.148697+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:21.620837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:21.620837+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034355459999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"348'24","reported_seq":198,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.139097+0000","last_change":"2021-10-08T19:34:53.274347+0000","last_active":"2021-10-08T19:36:21.139097+0000","last_peered":"2021-10-08T19:36:21.139097+0000","last_clean":"2021-10-08T19:36:21.139097+0000","last_became_active":"2021-10-08T19:29:40.640914+0000","last_became_peered":"2021-10-08T19:29:40.640914+0000","last_unstale":"2021-10-08T19:36:21.139097+0000","last_undegraded":"2021-10-08T19:36:21.139097+0000","last_fullsized":"2021-10-08T19:36:21.139097+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"348'24","last_scrub_stamp":"2021-10-08T19:34:53.274250+0000","last_deep_scrub":"348'24","last_deep_scrub_stamp":"2021-10-08T19:34:53.274250+0000","last_clean_scrub_stamp":"2021-10-08T19:34:53.274250+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.018882408,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":305,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.148636+0000","last_change":"2021-10-08T19:34:59.547710+0000","last_active":"2021-10-08T19:36:21.148636+0000","last_peered":"2021-10-08T19:36:21.148636+0000","last_clean":"2021-10-08T19:36:21.148636+0000","last_became_active":"2021-10-08T19:24:25.098128+0000","last_became_peered":"2021-10-08T19:24:25.098128+0000","last_unstale":"2021-10-08T19:36:21.148636+0000","last_undegraded":"2021-10-08T19:36:21.148636+0000","last_fullsized":"2021-10-08T19:36:21.148636+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:59.547640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:34.508558+0000","last_clean_scrub_stamp":"2021-10-08T19:34:59.547640+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0015010729999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":371,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.144101+0000","last_change":"2021-10-08T19:35:25.845334+0000","last_active":"2021-10-08T19:36:21.144101+0000","last_peered":"2021-10-08T19:36:21.144101+0000","last_clean":"2021-10-08T19:36:21.144101+0000","last_became_active":"2021-10-08T19:24:25.095490+0000","last_became_peered":"2021-10-08T19:24:25.095490+0000","last_unstale":"2021-10-08T19:36:21.144101+0000","last_undegraded":"2021-10-08T19:36:21.144101+0000","last_fullsized":"2021-10-08T19:36:21.144101+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:25.845262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:11.383779+0000","last_clean_scrub_stamp":"2021-10-08T19:35:25.845262+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0015112610000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":175,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.141289+0000","last_change":"2021-10-08T19:36:12.821415+0000","last_active":"2021-10-08T19:36:21.141289+0000","last_peered":"2021-10-08T19:36:21.141289+0000","last_clean":"2021-10-08T19:36:21.141289+0000","last_became_active":"2021-10-08T19:29:40.639358+0000","last_became_peered":"2021-10-08T19:29:40.639358+0000","last_unstale":"2021-10-08T19:36:21.141289+0000","last_undegraded":"2021-10-08T19:36:21.141289+0000","last_fullsized":"2021-10-08T19:36:21.141289+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:12.821316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:36:12.821316+0000","last_clean_scrub_stamp":"2021-10-08T19:36:12.821316+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.068456382999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"289'20","reported_seq":429,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.160784+0000","last_change":"2021-10-08T19:34:12.001980+0000","last_active":"2021-10-08T19:36:21.160784+0000","last_peered":"2021-10-08T19:36:21.160784+0000","last_clean":"2021-10-08T19:36:21.160784+0000","last_became_active":"2021-10-08T19:29:40.636448+0000","last_became_peered":"2021-10-08T19:29:40.636448+0000","last_unstale":"2021-10-08T19:36:21.160784+0000","last_undegraded":"2021-10-08T19:36:21.160784+0000","last_fullsized":"2021-10-08T19:36:21.160784+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'20","last_scrub_stamp":"2021-10-08T19:34:12.001875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:34:12.001875+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0097733339999999998,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":356,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.145574+0000","last_change":"2021-10-08T19:36:17.700202+0000","last_active":"2021-10-08T19:36:21.145574+0000","last_peered":"2021-10-08T19:36:21.145574+0000","last_clean":"2021-10-08T19:36:21.145574+0000","last_became_active":"2021-10-08T19:21:23.604530+0000","last_became_peered":"2021-10-08T19:21:23.604530+0000","last_unstale":"2021-10-08T19:36:21.145574+0000","last_undegraded":"2021-10-08T19:36:21.145574+0000","last_fullsized":"2021-10-08T19:36:21.145574+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:17.700127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:17.700127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0031895790000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1f","version":"114'10","reported_seq":449,"reported_epoch":385,"state":"active+clean","last_fresh":"2021-10-08T19:36:29.226651+0000","last_change":"2021-10-08T19:34:49.474966+0000","last_active":"2021-10-08T19:36:29.226651+0000","last_peered":"2021-10-08T19:36:29.226651+0000","last_clean":"2021-10-08T19:36:29.226651+0000","last_became_active":"2021-10-08T19:24:25.105742+0000","last_became_peered":"2021-10-08T19:24:25.105742+0000","last_unstale":"2021-10-08T19:36:29.226651+0000","last_undegraded":"2021-10-08T19:36:29.226651+0000","last_fullsized":"2021-10-08T19:36:29.226651+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'10","last_scrub_stamp":"2021-10-08T19:34:49.474891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:34:49.474891+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0022257399999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"69'1","reported_seq":352,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.147523+0000","last_change":"2021-10-08T19:34:51.899798+0000","last_active":"2021-10-08T19:36:21.147523+0000","last_peered":"2021-10-08T19:36:21.147523+0000","last_clean":"2021-10-08T19:36:21.147523+0000","last_became_active":"2021-10-08T19:21:29.640296+0000","last_became_peered":"2021-10-08T19:21:29.640296+0000","last_unstale":"2021-10-08T19:36:21.147523+0000","last_undegraded":"2021-10-08T19:36:21.147523+0000","last_fullsized":"2021-10-08T19:36:21.147523+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2021-10-08T19:34:51.899691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:34:51.899691+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012893907,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"289'19","reported_seq":371,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.149044+0000","last_change":"2021-10-08T19:35:15.665522+0000","last_active":"2021-10-08T19:36:21.149044+0000","last_peered":"2021-10-08T19:36:21.149044+0000","last_clean":"2021-10-08T19:36:21.149044+0000","last_became_active":"2021-10-08T19:28:40.126425+0000","last_became_peered":"2021-10-08T19:28:40.126425+0000","last_unstale":"2021-10-08T19:36:21.149044+0000","last_undegraded":"2021-10-08T19:36:21.149044+0000","last_fullsized":"2021-10-08T19:36:21.149044+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:35:15.665434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:35:15.665434+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0027800889999999999,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":169,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.138831+0000","last_change":"2021-10-08T19:34:13.102972+0000","last_active":"2021-10-08T19:36:21.138831+0000","last_peered":"2021-10-08T19:36:21.138831+0000","last_clean":"2021-10-08T19:36:21.138831+0000","last_became_active":"2021-10-08T19:29:40.640952+0000","last_became_peered":"2021-10-08T19:29:40.640952+0000","last_unstale":"2021-10-08T19:36:21.138831+0000","last_undegraded":"2021-10-08T19:36:21.138831+0000","last_fullsized":"2021-10-08T19:36:21.138831+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:13.102869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:13.102869+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0080406309999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":359,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.160861+0000","last_change":"2021-10-08T19:36:02.157958+0000","last_active":"2021-10-08T19:36:21.160861+0000","last_peered":"2021-10-08T19:36:21.160861+0000","last_clean":"2021-10-08T19:36:21.160861+0000","last_became_active":"2021-10-08T19:21:27.632648+0000","last_became_peered":"2021-10-08T19:21:27.632648+0000","last_unstale":"2021-10-08T19:36:21.160861+0000","last_undegraded":"2021-10-08T19:36:21.160861+0000","last_fullsized":"2021-10-08T19:36:21.160861+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:02.157885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:36:02.157885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0018671,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"69'1","reported_seq":207,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.156816+0000","last_change":"2021-10-08T19:35:14.779532+0000","last_active":"2021-10-08T19:36:21.156816+0000","last_peered":"2021-10-08T19:36:21.156816+0000","last_clean":"2021-10-08T19:36:21.156816+0000","last_became_active":"2021-10-08T19:28:40.146302+0000","last_became_peered":"2021-10-08T19:28:40.146302+0000","last_unstale":"2021-10-08T19:36:21.156816+0000","last_undegraded":"2021-10-08T19:36:21.156816+0000","last_fullsized":"2021-10-08T19:36:21.156816+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2021-10-08T19:35:14.779433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:35:14.779433+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.101324384,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"289'27","reported_seq":535,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.141181+0000","last_change":"2021-10-08T19:36:09.038305+0000","last_active":"2021-10-08T19:36:21.141181+0000","last_peered":"2021-10-08T19:36:21.141181+0000","last_clean":"2021-10-08T19:36:21.141181+0000","last_became_active":"2021-10-08T19:29:40.629461+0000","last_became_peered":"2021-10-08T19:29:40.629461+0000","last_unstale":"2021-10-08T19:36:21.141181+0000","last_undegraded":"2021-10-08T19:36:21.141181+0000","last_fullsized":"2021-10-08T19:36:21.141181+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'27","last_scrub_stamp":"2021-10-08T19:36:09.038188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:09.038188+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0091474969999999992,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":550,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":313,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.148344+0000","last_change":"2021-10-08T19:35:59.598376+0000","last_active":"2021-10-08T19:36:21.148344+0000","last_peered":"2021-10-08T19:36:21.148344+0000","last_clean":"2021-10-08T19:36:21.148344+0000","last_became_active":"2021-10-08T19:24:25.106119+0000","last_became_peered":"2021-10-08T19:24:25.106119+0000","last_unstale":"2021-10-08T19:36:21.148344+0000","last_undegraded":"2021-10-08T19:36:21.148344+0000","last_fullsized":"2021-10-08T19:36:21.148344+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:59.598294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:46.422866+0000","last_clean_scrub_stamp":"2021-10-08T19:35:59.598294+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.032131808999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":203,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.156891+0000","last_change":"2021-10-08T19:34:45.792403+0000","last_active":"2021-10-08T19:36:21.156891+0000","last_peered":"2021-10-08T19:36:21.156891+0000","last_clean":"2021-10-08T19:36:21.156891+0000","last_became_active":"2021-10-08T19:28:40.148009+0000","last_became_peered":"2021-10-08T19:28:40.148009+0000","last_unstale":"2021-10-08T19:36:21.156891+0000","last_undegraded":"2021-10-08T19:36:21.156891+0000","last_fullsized":"2021-10-08T19:36:21.156891+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:45.792309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:34:45.792309+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0077010439999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":368,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.139825+0000","last_change":"2021-10-08T19:35:16.284591+0000","last_active":"2021-10-08T19:36:21.139825+0000","last_peered":"2021-10-08T19:36:21.139825+0000","last_clean":"2021-10-08T19:36:21.139825+0000","last_became_active":"2021-10-08T19:24:25.097782+0000","last_became_peered":"2021-10-08T19:24:25.097782+0000","last_unstale":"2021-10-08T19:36:21.139825+0000","last_undegraded":"2021-10-08T19:36:21.139825+0000","last_fullsized":"2021-10-08T19:36:21.139825+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:16.284510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:37.219503+0000","last_clean_scrub_stamp":"2021-10-08T19:35:16.284510+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001625755,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"289'18","reported_seq":196,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.142852+0000","last_change":"2021-10-08T19:36:17.847260+0000","last_active":"2021-10-08T19:36:21.142852+0000","last_peered":"2021-10-08T19:36:21.142852+0000","last_clean":"2021-10-08T19:36:21.142852+0000","last_became_active":"2021-10-08T19:29:40.645144+0000","last_became_peered":"2021-10-08T19:29:40.645144+0000","last_unstale":"2021-10-08T19:36:21.142852+0000","last_undegraded":"2021-10-08T19:36:21.142852+0000","last_fullsized":"2021-10-08T19:36:21.142852+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'18","last_scrub_stamp":"2021-10-08T19:36:17.846978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:17.846978+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.018882475999999999,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":25,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":169,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.141134+0000","last_change":"2021-10-08T19:35:32.854645+0000","last_active":"2021-10-08T19:36:21.141134+0000","last_peered":"2021-10-08T19:36:21.141134+0000","last_clean":"2021-10-08T19:36:21.141134+0000","last_became_active":"2021-10-08T19:29:44.443807+0000","last_became_peered":"2021-10-08T19:29:44.443807+0000","last_unstale":"2021-10-08T19:36:21.141134+0000","last_undegraded":"2021-10-08T19:36:21.141134+0000","last_fullsized":"2021-10-08T19:36:21.141134+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:32.854550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:32.854550+0000","last_clean_scrub_stamp":"2021-10-08T19:35:32.854550+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0089578279999999993,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":370,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.139473+0000","last_change":"2021-10-08T19:34:56.418386+0000","last_active":"2021-10-08T19:36:21.139473+0000","last_peered":"2021-10-08T19:36:21.139473+0000","last_clean":"2021-10-08T19:36:21.139473+0000","last_became_active":"2021-10-08T19:29:40.638352+0000","last_became_peered":"2021-10-08T19:29:40.638352+0000","last_unstale":"2021-10-08T19:36:21.139473+0000","last_undegraded":"2021-10-08T19:36:21.139473+0000","last_fullsized":"2021-10-08T19:36:21.139473+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:56.418264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:34:56.418264+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0060118899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":187,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.140822+0000","last_change":"2021-10-08T19:35:24.071959+0000","last_active":"2021-10-08T19:36:21.140822+0000","last_peered":"2021-10-08T19:36:21.140822+0000","last_clean":"2021-10-08T19:36:21.140822+0000","last_became_active":"2021-10-08T19:31:22.788455+0000","last_became_peered":"2021-10-08T19:31:22.788455+0000","last_unstale":"2021-10-08T19:36:21.140822+0000","last_undegraded":"2021-10-08T19:36:21.140822+0000","last_fullsized":"2021-10-08T19:36:21.140822+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:24.071866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:32:12.549351+0000","last_clean_scrub_stamp":"2021-10-08T19:35:24.071866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.097681799,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"289'15","reported_seq":419,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.139085+0000","last_change":"2021-10-08T19:36:08.207665+0000","last_active":"2021-10-08T19:36:21.139085+0000","last_peered":"2021-10-08T19:36:21.139085+0000","last_clean":"2021-10-08T19:36:21.139085+0000","last_became_active":"2021-10-08T19:29:40.631689+0000","last_became_peered":"2021-10-08T19:29:40.631689+0000","last_unstale":"2021-10-08T19:36:21.139085+0000","last_undegraded":"2021-10-08T19:36:21.139085+0000","last_fullsized":"2021-10-08T19:36:21.139085+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'15","last_scrub_stamp":"2021-10-08T19:36:08.207585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:08.207585+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.016557056000000001,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":367,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.147172+0000","last_change":"2021-10-08T19:36:16.752767+0000","last_active":"2021-10-08T19:36:21.147172+0000","last_peered":"2021-10-08T19:36:21.147172+0000","last_clean":"2021-10-08T19:36:21.147172+0000","last_became_active":"2021-10-08T19:21:23.607785+0000","last_became_peered":"2021-10-08T19:21:23.607785+0000","last_unstale":"2021-10-08T19:36:21.147172+0000","last_undegraded":"2021-10-08T19:36:21.147172+0000","last_fullsized":"2021-10-08T19:36:21.147172+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:16.752654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:16.752654+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0071954510000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":352,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.147539+0000","last_change":"2021-10-08T19:35:27.586471+0000","last_active":"2021-10-08T19:36:21.147539+0000","last_peered":"2021-10-08T19:36:21.147539+0000","last_clean":"2021-10-08T19:36:21.147539+0000","last_became_active":"2021-10-08T19:21:27.633979+0000","last_became_peered":"2021-10-08T19:21:27.633979+0000","last_unstale":"2021-10-08T19:36:21.147539+0000","last_undegraded":"2021-10-08T19:36:21.147539+0000","last_fullsized":"2021-10-08T19:36:21.147539+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:27.586341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:27.586341+0000","last_clean_scrub_stamp":"2021-10-08T19:35:27.586341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0047091140000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":373,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.152690+0000","last_change":"2021-10-08T19:34:50.034539+0000","last_active":"2021-10-08T19:36:21.152690+0000","last_peered":"2021-10-08T19:36:21.152690+0000","last_clean":"2021-10-08T19:36:21.152690+0000","last_became_active":"2021-10-08T19:28:40.159162+0000","last_became_peered":"2021-10-08T19:28:40.159162+0000","last_unstale":"2021-10-08T19:36:21.152690+0000","last_undegraded":"2021-10-08T19:36:21.152690+0000","last_fullsized":"2021-10-08T19:36:21.152690+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:50.034064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:34:50.034064+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.029837211999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"289'7","reported_seq":450,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.138194+0000","last_change":"2021-10-08T19:36:14.120690+0000","last_active":"2021-10-08T19:36:21.138194+0000","last_peered":"2021-10-08T19:36:21.138194+0000","last_clean":"2021-10-08T19:36:21.138194+0000","last_became_active":"2021-10-08T19:31:51.675189+0000","last_became_peered":"2021-10-08T19:31:51.675189+0000","last_unstale":"2021-10-08T19:36:21.138194+0000","last_undegraded":"2021-10-08T19:36:21.138194+0000","last_fullsized":"2021-10-08T19:36:21.138194+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'7","last_scrub_stamp":"2021-10-08T19:36:14.120570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:14.120570+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.006350138,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":10,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":383,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.144428+0000","last_change":"2021-10-08T19:35:24.852668+0000","last_active":"2021-10-08T19:36:21.144428+0000","last_peered":"2021-10-08T19:36:21.144428+0000","last_clean":"2021-10-08T19:36:21.144428+0000","last_became_active":"2021-10-08T19:24:25.096225+0000","last_became_peered":"2021-10-08T19:24:25.096225+0000","last_unstale":"2021-10-08T19:36:21.144428+0000","last_undegraded":"2021-10-08T19:36:21.144428+0000","last_fullsized":"2021-10-08T19:36:21.144428+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:24.852584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:29:40.244757+0000","last_clean_scrub_stamp":"2021-10-08T19:35:24.852584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0014639150000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":375,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.143977+0000","last_change":"2021-10-08T19:34:11.633837+0000","last_active":"2021-10-08T19:36:21.143977+0000","last_peered":"2021-10-08T19:36:21.143977+0000","last_clean":"2021-10-08T19:36:21.143977+0000","last_became_active":"2021-10-08T19:28:40.101187+0000","last_became_peered":"2021-10-08T19:28:40.101187+0000","last_unstale":"2021-10-08T19:36:21.143977+0000","last_undegraded":"2021-10-08T19:36:21.143977+0000","last_fullsized":"2021-10-08T19:36:21.143977+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:11.633739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:11.633739+0000","last_clean_scrub_stamp":"2021-10-08T19:34:11.633739+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0065073010000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":386,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.145606+0000","last_change":"2021-10-08T19:36:10.650417+0000","last_active":"2021-10-08T19:36:21.145606+0000","last_peered":"2021-10-08T19:36:21.145606+0000","last_clean":"2021-10-08T19:36:21.145606+0000","last_became_active":"2021-10-08T19:29:40.632965+0000","last_became_peered":"2021-10-08T19:29:40.632965+0000","last_unstale":"2021-10-08T19:36:21.145606+0000","last_undegraded":"2021-10-08T19:36:21.145606+0000","last_fullsized":"2021-10-08T19:36:21.145606+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:10.650288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:36:10.650288+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.029752064000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"289'19","reported_seq":499,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.138470+0000","last_change":"2021-10-08T19:36:15.167452+0000","last_active":"2021-10-08T19:36:21.138470+0000","last_peered":"2021-10-08T19:36:21.138470+0000","last_clean":"2021-10-08T19:36:21.138470+0000","last_became_active":"2021-10-08T19:28:40.099770+0000","last_became_peered":"2021-10-08T19:28:40.099770+0000","last_unstale":"2021-10-08T19:36:21.138470+0000","last_undegraded":"2021-10-08T19:36:21.138470+0000","last_fullsized":"2021-10-08T19:36:21.138470+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:36:15.167374+0000","last_deep_scrub":"289'19","last_deep_scrub_stamp":"2021-10-08T19:36:15.167374+0000","last_clean_scrub_stamp":"2021-10-08T19:36:15.167374+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0067424360000000001,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":169,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.139750+0000","last_change":"2021-10-08T19:34:04.124983+0000","last_active":"2021-10-08T19:36:21.139750+0000","last_peered":"2021-10-08T19:36:21.139750+0000","last_clean":"2021-10-08T19:36:21.139750+0000","last_became_active":"2021-10-08T19:29:40.627394+0000","last_became_peered":"2021-10-08T19:29:40.627394+0000","last_unstale":"2021-10-08T19:36:21.139750+0000","last_undegraded":"2021-10-08T19:36:21.139750+0000","last_fullsized":"2021-10-08T19:36:21.139750+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:04.124886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:04.124886+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0093513629999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":203,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.157085+0000","last_change":"2021-10-08T19:34:47.797510+0000","last_active":"2021-10-08T19:36:21.157085+0000","last_peered":"2021-10-08T19:36:21.157085+0000","last_clean":"2021-10-08T19:36:21.157085+0000","last_became_active":"2021-10-08T19:28:40.145868+0000","last_became_peered":"2021-10-08T19:28:40.145868+0000","last_unstale":"2021-10-08T19:36:21.157085+0000","last_undegraded":"2021-10-08T19:36:21.157085+0000","last_fullsized":"2021-10-08T19:36:21.157085+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:47.797403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:34:47.797403+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011791311000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":370,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.139001+0000","last_change":"2021-10-08T19:36:03.314076+0000","last_active":"2021-10-08T19:36:21.139001+0000","last_peered":"2021-10-08T19:36:21.139001+0000","last_clean":"2021-10-08T19:36:21.139001+0000","last_became_active":"2021-10-08T19:28:40.099543+0000","last_became_peered":"2021-10-08T19:28:40.099543+0000","last_unstale":"2021-10-08T19:36:21.139001+0000","last_undegraded":"2021-10-08T19:36:21.139001+0000","last_fullsized":"2021-10-08T19:36:21.139001+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:03.313977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:50.032367+0000","last_clean_scrub_stamp":"2021-10-08T19:36:03.313977+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.038973248000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"289'27","reported_seq":203,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.138920+0000","last_change":"2021-10-08T19:34:50.213817+0000","last_active":"2021-10-08T19:36:21.138920+0000","last_peered":"2021-10-08T19:36:21.138920+0000","last_clean":"2021-10-08T19:36:21.138920+0000","last_became_active":"2021-10-08T19:29:40.631002+0000","last_became_peered":"2021-10-08T19:29:40.631002+0000","last_unstale":"2021-10-08T19:36:21.138920+0000","last_undegraded":"2021-10-08T19:36:21.138920+0000","last_fullsized":"2021-10-08T19:36:21.138920+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'27","last_scrub_stamp":"2021-10-08T19:34:50.213690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:34:50.213690+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.016992080999999999,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":359,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.155321+0000","last_change":"2021-10-08T19:35:22.798375+0000","last_active":"2021-10-08T19:36:21.155321+0000","last_peered":"2021-10-08T19:36:21.155321+0000","last_clean":"2021-10-08T19:36:21.155321+0000","last_became_active":"2021-10-08T19:21:23.603422+0000","last_became_peered":"2021-10-08T19:21:23.603422+0000","last_unstale":"2021-10-08T19:36:21.155321+0000","last_undegraded":"2021-10-08T19:36:21.155321+0000","last_fullsized":"2021-10-08T19:36:21.155321+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:22.798309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:15.535842+0000","last_clean_scrub_stamp":"2021-10-08T19:35:22.798309+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0012757689999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":396,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.138705+0000","last_change":"2021-10-08T19:36:11.147338+0000","last_active":"2021-10-08T19:36:21.138705+0000","last_peered":"2021-10-08T19:36:21.138705+0000","last_clean":"2021-10-08T19:36:21.138705+0000","last_became_active":"2021-10-08T19:28:40.099286+0000","last_became_peered":"2021-10-08T19:28:40.099286+0000","last_unstale":"2021-10-08T19:36:21.138705+0000","last_undegraded":"2021-10-08T19:36:21.138705+0000","last_fullsized":"2021-10-08T19:36:21.138705+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:11.147246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:31.176160+0000","last_clean_scrub_stamp":"2021-10-08T19:36:11.147246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.005657235,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":169,"reported_epoch":384,"state":"active+clean","last_fresh":"2021-10-08T19:36:21.141219+0000","last_change":"2021-10-08T19:34:58.263999+0000","last_active":"2021-10-08T19:36:21.141219+0000","last_peered":"2021-10-08T19:36:21.141219+0000","last_clean":"2021-10-08T19:36:21.141219+0000","last_became_active":"2021-10-08T19:29:40.638221+0000","last_became_peered":"2021-10-08T19:29:40.638221+0000","last_unstale":"2021-10-08T19:36:21.141219+0000","last_undegraded":"2021-10-08T19:36:21.141219+0000","last_fullsized":"2021-10-08T19:36:21.141219+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:58.263883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:34:58.263883+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.050129448,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":6304301056,"num_objects":96196,"num_object_clones":0,"num_object_copies":288588,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96196,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96196,"num_write_kb":6156544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18939576320,"data_stored":18939576320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75396,"ondisk_log_size":75396,"up":48,"acting":48,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":11,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1430,"ondisk_log_size":1430,"up":33,"acting":33,"num_store_stats":8},{"poolid":3,"num_pg":23,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":730,"num_read_kb":730,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1167,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":69,"acting":69,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1113,"num_read_kb":870,"num_write":703,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":520,"num_bytes_recovered":10826,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":705,"ondisk_log_size":705,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":96,"acting":96,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201466,"num_pgs":75,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1790872,"kb_used_data":1531344,"kb_used_omap":0,"kb_used_meta":259520,"kb_avail":91954280,"statfs":{"total":95995035648,"available":94161182720,"internally_reserved":0,"allocated":1568096256,"data_stored":1567732158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":265748480},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:35:33 2021","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.3260000000000001,"15min":1.3959999999999999},"min":{"1min":0.26400000000000001,"5min":0.20699999999999999,"15min":0.20100000000000001},"max":{"1min":6.0860000000000003,"5min":8.8160000000000007,"15min":32.366999999999997},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.79400000000000004,"5min":1.8959999999999999,"15min":1.6379999999999999},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":6.0170000000000003,"5min":17.018999999999998,"15min":29.736000000000001},"last":4.4260000000000002}]},{"osd":1,"last update":"Fri Oct 8 19:35:33 2021","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":1.782,"15min":1.6599999999999999},"min":{"1min":0.23599999999999999,"5min":0.19900000000000001,"15min":0.19600000000000001},"max":{"1min":4.0330000000000004,"5min":17.452999999999999,"15min":26.044},"last":3.387},{"interface":"front","average":{"1min":1.3580000000000001,"5min":2.0329999999999999,"15min":1.5549999999999999},"min":{"1min":0.28799999999999998,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":6.0819999999999999,"5min":18.053000000000001,"15min":28.119},"last":2.8399999999999999}]},{"osd":2,"last update":"Fri Oct 8 19:35:33 2021","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.5960000000000001,"15min":1.5589999999999999},"min":{"1min":0.33800000000000002,"5min":0.255,"15min":0.255},"max":{"1min":3.75,"5min":7.524,"15min":27.018000000000001},"last":1.891},{"interface":"front","average":{"1min":1.181,"5min":1.6020000000000001,"15min":1.468},"min":{"1min":0.32300000000000001,"5min":0.28199999999999997,"15min":0.27800000000000002},"max":{"1min":4.5800000000000001,"5min":8.2870000000000008,"15min":27.113},"last":2.681}]},{"osd":3,"last update":"Fri Oct 8 19:35:33 2021","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":2.7400000000000002,"15min":2.0430000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":4.6589999999999998,"5min":72.093999999999994,"15min":72.093999999999994},"last":2.8999999999999999},{"interface":"front","average":{"1min":1.1639999999999999,"5min":2.8570000000000002,"15min":2.0259999999999998},"min":{"1min":0.373,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":6.0510000000000002,"5min":71.864999999999995,"15min":71.864999999999995},"last":2.8820000000000001}]},{"osd":4,"last update":"Fri Oct 8 19:35:33 2021","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.99199999999999999,"15min":0.81100000000000005},"min":{"1min":0.315,"5min":0.23899999999999999,"15min":0.22800000000000001},"max":{"1min":6.1130000000000004,"5min":8.391,"15min":8.391},"last":2.6680000000000001},{"interface":"front","average":{"1min":0.97299999999999998,"5min":1.3380000000000001,"15min":0.88300000000000001},"min":{"1min":0.27100000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":5.5229999999999997,"5min":9.0820000000000007,"15min":9.0820000000000007},"last":11.622}]},{"osd":5,"last update":"Fri Oct 8 19:35:33 2021","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":1.1950000000000001,"15min":0.93700000000000006},"min":{"1min":0.33800000000000002,"5min":0.26800000000000002,"15min":0.251},"max":{"1min":3.7280000000000002,"5min":9.9280000000000008,"15min":9.9280000000000008},"last":2.3069999999999999},{"interface":"front","average":{"1min":1.002,"5min":1.4139999999999999,"15min":0.95699999999999996},"min":{"1min":0.32400000000000001,"5min":0.30199999999999999,"15min":0.26100000000000001},"max":{"1min":4.1799999999999997,"5min":16.093,"15min":18.655000000000001},"last":2.641}]},{"osd":6,"last update":"Fri Oct 8 19:35:33 2021","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":1.3839999999999999,"15min":0.999},"min":{"1min":0.311,"5min":0.30399999999999999,"15min":0.27900000000000003},"max":{"1min":6.4560000000000004,"5min":17.082000000000001,"15min":17.082000000000001},"last":2.7069999999999999},{"interface":"front","average":{"1min":1.3,"5min":1.173,"15min":0.94799999999999995},"min":{"1min":0.36799999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":6.1219999999999999,"5min":7.742,"15min":7.742},"last":2.0209999999999999}]}]},{"osd":6,"up_from":47,"seq":201863463102,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2883904,"kb_used_data":2653048,"kb_used_omap":0,"kb_used_meta":230848,"kb_avail":90861248,"statfs":{"total":95995035648,"available":93041917952,"internally_reserved":0,"allocated":2716721152,"data_stored":2716380107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":236388352},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:36:17 2021","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":0.95399999999999996,"15min":1.222},"min":{"1min":0.28000000000000003,"5min":0.20899999999999999,"15min":0.20100000000000001},"max":{"1min":4.242,"5min":5.194,"15min":28.382999999999999},"last":0.32200000000000001},{"interface":"front","average":{"1min":2.0590000000000002,"5min":1.609,"15min":1.8029999999999999},"min":{"1min":0.309,"5min":0.22600000000000001,"15min":0.21299999999999999},"max":{"1min":8.4619999999999997,"5min":8.4619999999999997,"15min":69.477000000000004},"last":1.4550000000000001}]},{"osd":1,"last update":"Fri Oct 8 19:36:17 2021","interfaces":[{"interface":"back","average":{"1min":1.9339999999999999,"5min":1.5229999999999999,"15min":1.1870000000000001},"min":{"1min":0.26500000000000001,"5min":0.23699999999999999,"15min":0.23000000000000001},"max":{"1min":6.1050000000000004,"5min":6.1050000000000004,"15min":14.878},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.6339999999999999,"5min":1.341,"15min":1.2270000000000001},"min":{"1min":0.31,"5min":0.253,"15min":0.253},"max":{"1min":7.0090000000000003,"5min":7.0090000000000003,"15min":14.779},"last":0.94199999999999995}]},{"osd":2,"last update":"Fri Oct 8 19:36:17 2021","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.1499999999999999,"15min":1.5840000000000001},"min":{"1min":0.33100000000000002,"5min":0.27400000000000002,"15min":0.251},"max":{"1min":5.8899999999999997,"5min":6.7960000000000003,"15min":69.322999999999993},"last":0.38800000000000001},{"interface":"front","average":{"1min":1.629,"5min":1.6559999999999999,"15min":1.839},"min":{"1min":0.33700000000000002,"5min":0.315,"15min":0.245},"max":{"1min":5.133,"5min":8.3710000000000004,"15min":69.418999999999997},"last":5.8710000000000004}]},{"osd":3,"last update":"Fri Oct 8 19:36:17 2021","interfaces":[{"interface":"back","average":{"1min":1.5920000000000001,"5min":1.5309999999999999,"15min":1.4990000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.27900000000000003},"max":{"1min":5.4219999999999997,"5min":7.2910000000000004,"15min":21.670000000000002},"last":1.7370000000000001},{"interface":"front","average":{"1min":1.5620000000000001,"5min":1.266,"15min":1.3220000000000001},"min":{"1min":0.41599999999999998,"5min":0.29099999999999998,"15min":0.28000000000000003},"max":{"1min":5.5220000000000002,"5min":8.3360000000000003,"15min":22.254999999999999},"last":4.3710000000000004}]},{"osd":4,"last update":"Fri Oct 8 19:36:17 2021","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.1379999999999999,"15min":0.90100000000000002},"min":{"1min":0.28599999999999998,"5min":0.28100000000000003,"15min":0.254},"max":{"1min":5.0679999999999996,"5min":6.4459999999999997,"15min":24.516999999999999},"last":0.31},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.1419999999999999,"15min":1.087},"min":{"1min":0.33100000000000002,"5min":0.27700000000000002,"15min":0.26100000000000001},"max":{"1min":5.8070000000000004,"5min":5.8070000000000004,"15min":69.593999999999994},"last":0.33300000000000002}]},{"osd":5,"last update":"Fri Oct 8 19:36:17 2021","interfaces":[{"interface":"back","average":{"1min":1.4199999999999999,"5min":3.0640000000000001,"15min":1.5469999999999999},"min":{"1min":0.307,"5min":0.30399999999999999,"15min":0.28499999999999998},"max":{"1min":4.3209999999999997,"5min":107.485,"15min":107.485},"last":0.42999999999999999},{"interface":"front","average":{"1min":2.0920000000000001,"5min":3.177,"15min":1.8320000000000001},"min":{"1min":0.34399999999999997,"5min":0.31,"15min":0.252},"max":{"1min":7.4900000000000002,"5min":107.90300000000001,"15min":107.90300000000001},"last":0.56100000000000005}]},{"osd":7,"last update":"Fri Oct 8 19:35:44 2021","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":1.135,"15min":0.82999999999999996},"min":{"1min":0.32200000000000001,"5min":0.29599999999999999,"15min":0.27800000000000002},"max":{"1min":2.823,"5min":7.1230000000000002,"15min":7.1230000000000002},"last":0.45500000000000002},{"interface":"front","average":{"1min":1.161,"5min":1.272,"15min":1.008},"min":{"1min":0.38400000000000001,"5min":0.32800000000000001,"15min":0.313},"max":{"1min":4.6699999999999999,"5min":4.6699999999999999,"15min":15.962},"last":0.377}]}]},{"osd":1,"up_from":13,"seq":55834575057,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1460016,"kb_used_data":1141800,"kb_used_omap":0,"kb_used_meta":318208,"kb_avail":92285136,"statfs":{"total":95995035648,"available":94499979264,"internally_reserved":0,"allocated":1169203200,"data_stored":1168813821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":325844992},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:36:01 2021","interfaces":[{"interface":"back","average":{"1min":3.5099999999999998,"5min":2.96,"15min":3.1589999999999998},"min":{"1min":0.188,"5min":0.188,"15min":0.184},"max":{"1min":40.173000000000002,"5min":102.352,"15min":126.256},"last":0.33500000000000002},{"interface":"front","average":{"1min":3.3820000000000001,"5min":3.0099999999999998,"15min":3.3940000000000001},"min":{"1min":0.25600000000000001,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":40.337000000000003,"5min":102.462,"15min":126.176},"last":0.65000000000000002}]},{"osd":2,"last update":"Fri Oct 8 19:36:16 2021","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":2.4609999999999999,"15min":2.3250000000000002},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.192},"max":{"1min":11.497,"5min":102.395,"15min":102.395},"last":0.221},{"interface":"front","average":{"1min":0.94499999999999995,"5min":2.5800000000000001,"15min":2.6269999999999998},"min":{"1min":0.27600000000000002,"5min":0.253,"15min":0.22700000000000001},"max":{"1min":3.7919999999999998,"5min":102.50700000000001,"15min":102.50700000000001},"last":0.58199999999999996}]},{"osd":3,"last update":"Fri Oct 8 19:36:33 2021","interfaces":[{"interface":"back","average":{"1min":1.597,"5min":2.0179999999999998,"15min":2.8090000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":4.6239999999999997,"5min":33.655000000000001,"15min":105.836},"last":0.61599999999999999},{"interface":"front","average":{"1min":1.2370000000000001,"5min":2.004,"15min":2.6589999999999998},"min":{"1min":0.27700000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":4.7400000000000002,"5min":33.582999999999998,"15min":106.12},"last":0.27700000000000002}]},{"osd":4,"last update":"Fri Oct 8 19:35:45 2021","interfaces":[{"interface":"back","average":{"1min":1.7210000000000001,"5min":2.7160000000000002,"15min":1.9419999999999999},"min":{"1min":0.34599999999999997,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":6.7649999999999997,"5min":103.538,"15min":103.538},"last":0.35599999999999998},{"interface":"front","average":{"1min":1.28,"5min":2.4580000000000002,"15min":1.569},"min":{"1min":0.34999999999999998,"5min":0.27100000000000002,"15min":0.254},"max":{"1min":11.337999999999999,"5min":102.67100000000001,"15min":102.67100000000001},"last":1.1259999999999999}]},{"osd":5,"last update":"Fri Oct 8 19:36:11 2021","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":5.7439999999999998,"15min":3.0459999999999998},"min":{"1min":0.28599999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":3.9980000000000002,"5min":262.14100000000002,"15min":262.14100000000002},"last":1.387},{"interface":"front","average":{"1min":1.5409999999999999,"5min":5.8869999999999996,"15min":2.7749999999999999},"min":{"1min":0.33500000000000002,"5min":0.30099999999999999,"15min":0.29999999999999999},"max":{"1min":11.414999999999999,"5min":261.959,"15min":261.959},"last":2.863}]},{"osd":6,"last update":"Fri Oct 8 19:36:29 2021","interfaces":[{"interface":"back","average":{"1min":1.97,"5min":1.5309999999999999,"15min":2.0409999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.26700000000000002},"max":{"1min":5.8490000000000002,"5min":7.024,"15min":103.73},"last":0.38500000000000001},{"interface":"front","average":{"1min":1.486,"5min":1.3660000000000001,"15min":2.0019999999999998},"min":{"1min":0.377,"5min":0.34399999999999997,"15min":0.28399999999999997},"max":{"1min":4.2699999999999996,"5min":4.6349999999999998,"15min":102.753},"last":0.63300000000000001}]},{"osd":7,"last update":"Fri Oct 8 19:35:45 2021","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":3.7170000000000001,"15min":2.3860000000000001},"min":{"1min":0.42499999999999999,"5min":0.316,"15min":0.312},"max":{"1min":2.1139999999999999,"5min":106.011,"15min":106.011},"last":1.552},{"interface":"front","average":{"1min":1.514,"5min":3.8330000000000002,"15min":2.0630000000000002},"min":{"1min":0.44600000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":11.445,"5min":103.78400000000001,"15min":103.78400000000001},"last":0.98599999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738580,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":4099348,"kb_used_data":3815372,"kb_used_omap":0,"kb_used_meta":283968,"kb_avail":89645804,"statfs":{"total":95995035648,"available":91797303296,"internally_reserved":0,"allocated":3906940928,"data_stored":3906579750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":290783232},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 8 19:35:54 2021","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":2.2090000000000001,"15min":2.0720000000000001},"min":{"1min":0.20399999999999999,"5min":0.185,"15min":0.185},"max":{"1min":4.1059999999999999,"5min":91.954999999999998,"15min":91.954999999999998},"last":0.43099999999999999},{"interface":"front","average":{"1min":1.0760000000000001,"5min":2.8250000000000002,"15min":2.2400000000000002},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":5.7750000000000004,"5min":91.046000000000006,"15min":91.046000000000006},"last":9.9019999999999992}]},{"osd":2,"last update":"Fri Oct 8 19:36:19 2021","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.458,"15min":2.0110000000000001},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":3.9540000000000002,"5min":9.6129999999999995,"15min":62.390000000000001},"last":9.8030000000000008},{"interface":"front","average":{"1min":1.6519999999999999,"5min":1.611,"15min":1.9419999999999999},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.19500000000000001},"max":{"1min":7.0640000000000001,"5min":10.026,"15min":62.718000000000004},"last":10.109}]},{"osd":3,"last update":"Fri Oct 8 19:35:40 2021","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":2.1560000000000001,"15min":2.1789999999999998},"min":{"1min":0.316,"5min":0.218,"15min":0.217},"max":{"1min":4.3780000000000001,"5min":14.551,"15min":62.491},"last":9.7690000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":1.8120000000000001,"15min":1.9259999999999999},"min":{"1min":0.22600000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":3.831,"5min":22.016999999999999,"15min":62.673000000000002},"last":10.026999999999999}]},{"osd":4,"last update":"Fri Oct 8 19:35:54 2021","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.6599999999999999,"15min":1.593},"min":{"1min":0.34100000000000003,"5min":0.25800000000000001,"15min":0.22900000000000001},"max":{"1min":5.7759999999999998,"5min":16.805,"15min":16.805},"last":0.629},{"interface":"front","average":{"1min":0.90000000000000002,"5min":1.3560000000000001,"15min":1.377},"min":{"1min":0.34399999999999997,"5min":0.30299999999999999,"15min":0.28199999999999997},"max":{"1min":4.0650000000000004,"5min":7.0890000000000004,"15min":11.823},"last":4.774}]},{"osd":5,"last update":"Fri Oct 8 19:36:11 2021","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":1.446,"15min":1.302},"min":{"1min":0.39900000000000002,"5min":0.311,"15min":0.24099999999999999},"max":{"1min":2.2970000000000002,"5min":9.9529999999999994,"15min":15.56},"last":9.9730000000000008},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.599,"15min":1.599},"min":{"1min":0.33100000000000002,"5min":0.31900000000000001,"15min":0.28599999999999998},"max":{"1min":4.4390000000000001,"5min":15.115,"15min":15.484999999999999},"last":0.67200000000000004}]},{"osd":6,"last update":"Fri Oct 8 19:36:25 2021","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":1.478,"15min":1.508},"min":{"1min":0.45900000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":4.5469999999999997,"5min":7.165,"15min":11.869},"last":4.7530000000000001},{"interface":"front","average":{"1min":1.373,"5min":1.5389999999999999,"15min":1.4730000000000001},"min":{"1min":0.32200000000000001,"5min":0.28199999999999997,"15min":0.27500000000000002},"max":{"1min":6.8029999999999999,"5min":9.9990000000000006,"15min":10.519},"last":10.002000000000001}]},{"osd":7,"last update":"Fri Oct 8 19:35:40 2021","interfaces":[{"interface":"back","average":{"1min":1.6319999999999999,"5min":1.7310000000000001,"15min":1.6299999999999999},"min":{"1min":0.39400000000000002,"5min":0.38200000000000001,"15min":0.35399999999999998},"max":{"1min":6.2699999999999996,"5min":7.4470000000000001,"15min":11.669},"last":3.093},{"interface":"front","average":{"1min":1.528,"5min":1.673,"15min":1.6879999999999999},"min":{"1min":0.40899999999999997,"5min":0.34999999999999998,"15min":0.33400000000000002},"max":{"1min":7.2279999999999998,"5min":7.2279999999999998,"15min":11.898999999999999},"last":4.7169999999999996}]}]},{"osd":2,"up_from":18,"seq":77309411532,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2541636,"kb_used_data":2288828,"kb_used_omap":0,"kb_used_meta":252864,"kb_avail":91203516,"statfs":{"total":95995035648,"available":93392400384,"internally_reserved":0,"allocated":2343759872,"data_stored":2343415129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":258932736},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:36:08 2021","interfaces":[{"interface":"back","average":{"1min":1.9470000000000001,"5min":1.4299999999999999,"15min":2.2589999999999999},"min":{"1min":0.19900000000000001,"5min":0.184,"15min":0.184},"max":{"1min":10.83,"5min":17.491,"15min":61.670999999999999},"last":0.36699999999999999},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.4350000000000001,"15min":2.242},"min":{"1min":0.26700000000000002,"5min":0.215,"15min":0.17999999999999999},"max":{"1min":5.5510000000000002,"5min":7.8049999999999997,"15min":65.284999999999997},"last":0.79600000000000004}]},{"osd":1,"last update":"Fri Oct 8 19:36:08 2021","interfaces":[{"interface":"back","average":{"1min":1.677,"5min":3.0609999999999999,"15min":2.5619999999999998},"min":{"1min":0.22900000000000001,"5min":0.19700000000000001,"15min":0.192},"max":{"1min":9.3059999999999992,"5min":63.738,"15min":63.738},"last":5.6719999999999997},{"interface":"front","average":{"1min":1.375,"5min":3.2309999999999999,"15min":2.798},"min":{"1min":0.26000000000000001,"5min":0.23899999999999999,"15min":0.21299999999999999},"max":{"1min":5.5789999999999997,"5min":63.619999999999997,"15min":63.619999999999997},"last":0.86399999999999999}]},{"osd":3,"last update":"Fri Oct 8 19:36:18 2021","interfaces":[{"interface":"back","average":{"1min":1.5409999999999999,"5min":3.2429999999999999,"15min":2.7629999999999999},"min":{"1min":0.27300000000000002,"5min":0.254,"15min":0.21199999999999999},"max":{"1min":5.742,"5min":63.658999999999999,"15min":65.322999999999993},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.8069999999999999,"5min":2.8610000000000002,"15min":2.6579999999999999},"min":{"1min":0.26100000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":9.218,"5min":65.418000000000006,"15min":65.418000000000006},"last":4.1609999999999996}]},{"osd":4,"last update":"Fri Oct 8 19:35:45 2021","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.111,"15min":1.391},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.26900000000000002},"max":{"1min":6.5380000000000003,"5min":6.5380000000000003,"15min":24.657},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.83299999999999996,"5min":1.3280000000000001,"15min":1.4690000000000001},"min":{"1min":0.314,"5min":0.28299999999999997,"15min":0.26600000000000001},"max":{"1min":5.524,"5min":7.7469999999999999,"15min":15.143000000000001},"last":0.92500000000000004}]},{"osd":5,"last update":"Fri Oct 8 19:36:08 2021","interfaces":[{"interface":"back","average":{"1min":1.9099999999999999,"5min":1.702,"15min":1.5880000000000001},"min":{"1min":0.35799999999999998,"5min":0.315,"15min":0.28899999999999998},"max":{"1min":5.625,"5min":7.7409999999999997,"15min":15.087999999999999},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.915,"5min":1.516,"15min":1.607},"min":{"1min":0.44400000000000001,"5min":0.29499999999999998,"15min":0.27600000000000002},"max":{"1min":8.1769999999999996,"5min":10.862,"15min":26.094000000000001},"last":0.41699999999999998}]},{"osd":6,"last update":"Fri Oct 8 19:36:18 2021","interfaces":[{"interface":"back","average":{"1min":2.3359999999999999,"5min":1.2509999999999999,"15min":1.488},"min":{"1min":0.33900000000000002,"5min":0.29999999999999999,"15min":0.28000000000000003},"max":{"1min":6.6909999999999998,"5min":6.6909999999999998,"15min":14.162000000000001},"last":2.7240000000000002},{"interface":"front","average":{"1min":2.5830000000000002,"5min":1.6990000000000001,"15min":1.637},"min":{"1min":0.46999999999999997,"5min":0.33600000000000002,"15min":0.313},"max":{"1min":8.7829999999999995,"5min":8.7829999999999995,"15min":16.68},"last":0.39800000000000002}]},{"osd":7,"last update":"Fri Oct 8 19:35:45 2021","interfaces":[{"interface":"back","average":{"1min":1.512,"5min":3.1680000000000001,"15min":2.1230000000000002},"min":{"1min":0.32600000000000001,"5min":0.32200000000000001,"15min":0.31900000000000001},"max":{"1min":6.4119999999999999,"5min":136.00200000000001,"15min":136.00200000000001},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.345,"5min":3.056,"15min":2.044},"min":{"1min":0.41499999999999998,"5min":0.36399999999999999,"15min":0.34899999999999998},"max":{"1min":3.9049999999999998,"5min":133.26300000000001,"15min":133.26300000000001},"last":0.54400000000000004}]}]},{"osd":3,"up_from":24,"seq":103079215306,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2271784,"kb_used_data":1926688,"kb_used_omap":0,"kb_used_meta":345088,"kb_avail":91473368,"statfs":{"total":95995035648,"available":93668728832,"internally_reserved":0,"allocated":1972928512,"data_stored":1972547915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":353370112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:36:31 2021","interfaces":[{"interface":"back","average":{"1min":1.669,"5min":1.9119999999999999,"15min":2.419},"min":{"1min":0.222,"5min":0.187,"15min":0.17000000000000001},"max":{"1min":6.391,"5min":13.036,"15min":109.601},"last":1.206},{"interface":"front","average":{"1min":1.661,"5min":1.3500000000000001,"15min":2.3279999999999998},"min":{"1min":0.21199999999999999,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":5.5060000000000002,"5min":10.997,"15min":107.84},"last":0.20799999999999999}]},{"osd":1,"last update":"Fri Oct 8 19:36:31 2021","interfaces":[{"interface":"back","average":{"1min":1.546,"5min":1.9450000000000001,"15min":1.9870000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.20999999999999999},"max":{"1min":5.3959999999999999,"5min":37.271999999999998,"15min":37.271999999999998},"last":1.361},{"interface":"front","average":{"1min":1.222,"5min":1.6930000000000001,"15min":1.899},"min":{"1min":0.26700000000000002,"5min":0.215,"15min":0.19},"max":{"1min":4.1369999999999996,"5min":37.033000000000001,"15min":37.033000000000001},"last":0.432}]},{"osd":2,"last update":"Fri Oct 8 19:36:31 2021","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.0309999999999999,"15min":1.857},"min":{"1min":0.27600000000000002,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":4.274,"5min":6.2699999999999996,"15min":32.277000000000001},"last":5.9930000000000003},{"interface":"front","average":{"1min":1.6830000000000001,"5min":1.9610000000000001,"15min":1.913},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":7.6150000000000002,"5min":23.189,"15min":23.189},"last":1.2310000000000001}]},{"osd":4,"last update":"Fri Oct 8 19:35:46 2021","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.7030000000000001,"15min":1.53},"min":{"1min":0.30499999999999999,"5min":0.29199999999999998,"15min":0.25600000000000001},"max":{"1min":7.3849999999999998,"5min":13.968,"15min":18.064},"last":1.325},{"interface":"front","average":{"1min":1.335,"5min":1.482,"15min":1.6419999999999999},"min":{"1min":0.42499999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":7.5069999999999997,"5min":10.632,"15min":18.692},"last":4.859}]},{"osd":5,"last update":"Fri Oct 8 19:36:04 2021","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":2.1030000000000002,"15min":1.7070000000000001},"min":{"1min":0.33400000000000002,"5min":0.28299999999999997,"15min":0.27000000000000002},"max":{"1min":1.369,"5min":75.397000000000006,"15min":75.397000000000006},"last":0.47799999999999998},{"interface":"front","average":{"1min":1.21,"5min":2.9409999999999998,"15min":1.9810000000000001},"min":{"1min":0.34000000000000002,"5min":0.311,"15min":0.28100000000000003},"max":{"1min":5.4770000000000003,"5min":75.680000000000007,"15min":75.680000000000007},"last":4.9020000000000001}]},{"osd":6,"last update":"Fri Oct 8 19:36:19 2021","interfaces":[{"interface":"back","average":{"1min":1.885,"5min":1.6579999999999999,"15min":1.849},"min":{"1min":0.45300000000000001,"5min":0.33900000000000002,"15min":0.28599999999999998},"max":{"1min":9.5,"5min":9.5,"15min":21.538},"last":0.38400000000000001},{"interface":"front","average":{"1min":1.331,"5min":1.3089999999999999,"15min":1.5349999999999999},"min":{"1min":0.36499999999999999,"5min":0.35599999999999998,"15min":0.32700000000000001},"max":{"1min":7.5010000000000003,"5min":7.5010000000000003,"15min":13.298},"last":0.45600000000000002}]},{"osd":7,"last update":"Fri Oct 8 19:35:46 2021","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.7190000000000001,"15min":1.6000000000000001},"min":{"1min":0.38100000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":7.5780000000000003,"5min":10.656000000000001,"15min":10.696999999999999},"last":4.8140000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":1.353,"15min":1.488},"min":{"1min":0.38,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.875,"5min":7.165,"15min":13.225},"last":2.73}]}]},{"osd":4,"up_from":30,"seq":128849019076,"num_pgs":74,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3335968,"kb_used_data":3105432,"kb_used_omap":0,"kb_used_meta":230528,"kb_avail":90409184,"statfs":{"total":95995035648,"available":92579004416,"internally_reserved":0,"allocated":3179962368,"data_stored":3179589942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":236060672},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:35:47 2021","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":1.0209999999999999,"15min":1.71},"min":{"1min":0.217,"5min":0.20899999999999999,"15min":0.185},"max":{"1min":2.7999999999999998,"5min":7.1319999999999997,"15min":82.109999999999999},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.1990000000000001,"15min":1.712},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.20399999999999999},"max":{"1min":4.6559999999999997,"5min":7.0330000000000004,"15min":82.025999999999996},"last":0.32200000000000001}]},{"osd":1,"last update":"Fri Oct 8 19:35:47 2021","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":3.1880000000000002,"15min":2.1120000000000001},"min":{"1min":0.28100000000000003,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":4.0289999999999999,"5min":122.422,"15min":122.422},"last":4.0839999999999996},{"interface":"front","average":{"1min":0.85599999999999998,"5min":2.9409999999999998,"15min":1.8580000000000001},"min":{"1min":0.25,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":3.6070000000000002,"5min":123.122,"15min":123.122},"last":0.251}]},{"osd":2,"last update":"Fri Oct 8 19:35:47 2021","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":1.25,"15min":1.3160000000000001},"min":{"1min":0.41399999999999998,"5min":0.26100000000000001,"15min":0.23499999999999999},"max":{"1min":2.8900000000000001,"5min":7.9189999999999996,"15min":21.257000000000001},"last":1.4990000000000001},{"interface":"front","average":{"1min":0.89800000000000002,"5min":1.21,"15min":1.3180000000000001},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":4.6349999999999998,"5min":5.0270000000000001,"15min":21.600000000000001},"last":1.3200000000000001}]},{"osd":3,"last update":"Fri Oct 8 19:35:47 2021","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":1.5209999999999999,"15min":1.9910000000000001},"min":{"1min":0.30599999999999999,"5min":0.28699999999999998,"15min":0.26500000000000001},"max":{"1min":4.5990000000000002,"5min":7.4130000000000003,"15min":58.506999999999998},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.5669999999999999,"15min":1.732},"min":{"1min":0.38400000000000001,"5min":0.254,"15min":0.254},"max":{"1min":8.5540000000000003,"5min":8.5540000000000003,"15min":58.521000000000001},"last":6.0810000000000004}]},{"osd":5,"last update":"Fri Oct 8 19:36:07 2021","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.288,"15min":0.84999999999999998},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.222},"max":{"1min":3.327,"5min":7.101,"15min":7.101},"last":4.0140000000000002},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.1180000000000001,"15min":0.80300000000000005},"min":{"1min":0.35299999999999998,"5min":0.27700000000000002,"15min":0.22900000000000001},"max":{"1min":3.0019999999999998,"5min":7.8029999999999999,"15min":8.1319999999999997},"last":0.33600000000000002}]},{"osd":6,"last update":"Fri Oct 8 19:36:24 2021","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.0029999999999999,"15min":0.81399999999999995},"min":{"1min":0.32200000000000001,"5min":0.28699999999999998,"15min":0.23599999999999999},"max":{"1min":4.1879999999999997,"5min":5.4800000000000004,"15min":6.7300000000000004},"last":0.44800000000000001},{"interface":"front","average":{"1min":1.28,"5min":1.1379999999999999,"15min":0.873},"min":{"1min":0.35699999999999998,"5min":0.26600000000000001,"15min":0.247},"max":{"1min":3.8620000000000001,"5min":6.1319999999999997,"15min":7.0720000000000001},"last":4.0510000000000002}]},{"osd":7,"last update":"Fri Oct 8 19:35:47 2021","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.1160000000000001,"15min":0.80400000000000005},"min":{"1min":0.33200000000000002,"5min":0.31,"15min":0.26400000000000001},"max":{"1min":6.157,"5min":8.0050000000000008,"15min":8.0050000000000008},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.042,"15min":0.86399999999999999},"min":{"1min":0.42599999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":4.665,"5min":4.665,"15min":6.3959999999999999},"last":0.46200000000000002}]}]},{"osd":5,"up_from":38,"seq":163208757440,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2221008,"kb_used_data":1918984,"kb_used_omap":0,"kb_used_meta":302016,"kb_avail":91524144,"statfs":{"total":95995035648,"available":93720723456,"internally_reserved":0,"allocated":1965039616,"data_stored":1964683942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":309264384},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:36:05 2021","interfaces":[{"interface":"back","average":{"1min":3.0329999999999999,"5min":1.6379999999999999,"15min":1.383},"min":{"1min":0.23799999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":43.332999999999998,"5min":43.332999999999998,"15min":43.332999999999998},"last":0.249},{"interface":"front","average":{"1min":3.161,"5min":1.7170000000000001,"15min":1.381},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":42.637,"5min":42.637,"15min":42.637},"last":0.56000000000000005}]},{"osd":1,"last update":"Fri Oct 8 19:36:05 2021","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":2.0249999999999999,"15min":1.6339999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23000000000000001},"max":{"1min":4.6059999999999999,"5min":94.558999999999997,"15min":94.558999999999997},"last":0.433},{"interface":"front","average":{"1min":0.94999999999999996,"5min":1.9430000000000001,"15min":1.577},"min":{"1min":0.40100000000000002,"5min":0.23899999999999999,"15min":0.23100000000000001},"max":{"1min":3.9729999999999999,"5min":94.456999999999994,"15min":94.456999999999994},"last":0.41299999999999998}]},{"osd":2,"last update":"Fri Oct 8 19:36:05 2021","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":1.2450000000000001,"15min":1.5389999999999999},"min":{"1min":0.29799999999999999,"5min":0.27000000000000002,"15min":0.25700000000000001},"max":{"1min":3.452,"5min":8.1259999999999994,"15min":29.398},"last":0.33600000000000002},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.2190000000000001,"15min":1.5249999999999999},"min":{"1min":0.38500000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":4.0730000000000004,"5min":8.3599999999999994,"15min":29.387},"last":0.378}]},{"osd":3,"last update":"Fri Oct 8 19:36:05 2021","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.847,"15min":1.599},"min":{"1min":0.33900000000000002,"5min":0.27000000000000002,"15min":0.26200000000000001},"max":{"1min":3.8130000000000002,"5min":11.685,"15min":12.356},"last":0.48899999999999999},{"interface":"front","average":{"1min":1.6659999999999999,"5min":1.6140000000000001,"15min":1.6870000000000001},"min":{"1min":0.38100000000000001,"5min":0.218,"15min":0.218},"max":{"1min":8.9920000000000009,"5min":8.9920000000000009,"15min":21.504000000000001},"last":0.44900000000000001}]},{"osd":4,"last update":"Fri Oct 8 19:36:05 2021","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.96799999999999997,"15min":0.745},"min":{"1min":0.28199999999999997,"5min":0.25800000000000001,"15min":0.224},"max":{"1min":4.0990000000000002,"5min":9.2759999999999998,"15min":9.2759999999999998},"last":0.69599999999999995},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.044,"15min":0.76800000000000002},"min":{"1min":0.36499999999999999,"5min":0.27100000000000002,"15min":0.23799999999999999},"max":{"1min":4.569,"5min":7.8959999999999999,"15min":7.8959999999999999},"last":0.39800000000000002}]},{"osd":6,"last update":"Fri Oct 8 19:36:24 2021","interfaces":[{"interface":"back","average":{"1min":1.4750000000000001,"5min":0.99399999999999999,"15min":0.84199999999999997},"min":{"1min":0.30099999999999999,"5min":0.255,"15min":0.255},"max":{"1min":4.0510000000000002,"5min":5.8879999999999999,"15min":7.266},"last":3.9980000000000002},{"interface":"front","average":{"1min":1.609,"5min":1.1160000000000001,"15min":0.84599999999999997},"min":{"1min":0.35699999999999998,"5min":0.29199999999999998,"15min":0.29099999999999998},"max":{"1min":7.9349999999999996,"5min":7.9390000000000001,"15min":7.9390000000000001},"last":0.45600000000000002}]},{"osd":7,"last update":"Fri Oct 8 19:35:40 2021","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":1.343,"15min":0.91100000000000003},"min":{"1min":0.38200000000000001,"5min":0.252,"15min":0.252},"max":{"1min":7.1390000000000002,"5min":29.946999999999999,"15min":29.946999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.64900000000000002,"5min":1.4139999999999999,"15min":0.98099999999999998},"min":{"1min":0.39100000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":2.0009999999999999,"5min":29.294,"15min":29.294},"last":3.9569999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":266240,"data_stored":262688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":327680,"data_stored":327680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3940089856,"data_stored":3940089856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1175519232,"data_stored":1175519232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2364538880,"data_stored":2364538880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1980039168,"data_stored":1980039168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":3186098176,"data_stored":3186098176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1977745408,"data_stored":1977745408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":2735931392,"data_stored":2735931392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1579614208,"data_stored":1579614208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-10-08T19:36:38.097 INFO:tasks.cephadm.ceph_manager.ceph:recovered! 2021-10-08T19:36:38.097 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:36:38.098 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2021-10-08T19:36:38.099 INFO:tasks.thrashosds.thrasher:Growing pool .rgw.root 2021-10-08T19:36:38.099 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph pg dump --format=json 2021-10-08T19:36:38.100 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:37 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:36:38.101 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:37 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:36:38.101 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:37 smithi097 ceph-mon[41966]: pgmap v762: 178 pgs: 178 active+clean; 5.9 GiB data, 20 GiB used, 696 GiB / 715 GiB avail; 921 B/s rd, 66 MiB/s wr, 1.06k op/s 2021-10-08T19:36:38.101 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:37 smithi097 ceph-mon[41966]: osdmap e386: 8 total, 8 up, 8 in 2021-10-08T19:36:38.101 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:37 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:36:38.102 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:37 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:36:38.102 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:37 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:36:38.102 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:37 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:36:38.102 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:37 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:36:38.103 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:38.104 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:36:38.205 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:36:38.267 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:38.401 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 72 15 100726 100711 87.3617 66.4375 0.0161988 0.0114419 2021-10-08T19:36:38.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:37 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:36:38.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:37 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:36:38.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:37 smithi117 ceph-mon[34585]: pgmap v762: 178 pgs: 178 active+clean; 5.9 GiB data, 20 GiB used, 696 GiB / 715 GiB avail; 921 B/s rd, 66 MiB/s wr, 1.06k op/s 2021-10-08T19:36:38.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:37 smithi117 ceph-mon[34585]: osdmap e386: 8 total, 8 up, 8 in 2021-10-08T19:36:38.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:37 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:36:38.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:37 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:36:38.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:37 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:36:38.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:37 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:36:38.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:37 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:36:38.581 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:36:38.603 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:38.605 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:36:38.614 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:36:38.615 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2021-10-08T19:36:38.615 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2021-10-08T19:36:38.615 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2021-10-08T19:36:38.616 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:36:38.706 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:36:38.779 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:39.401 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 73 16 101631 101615 86.9391 56.5 0.00819438 0.0114972 2021-10-08T19:36:39.485 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:36:39.997 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is unset 2021-10-08T19:36:40.174 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:36:40.176 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:40.177 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:36:40.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:39 smithi097 ceph-mon[32687]: pgmap v764: 178 pgs: 178 active+clean; 6.0 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 955 B/s rd, 57 MiB/s wr, 919 op/s 2021-10-08T19:36:40.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:39 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3875775868' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:36:40.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:39 smithi097 ceph-mon[32687]: from='client.25891 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:36:40.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:39 smithi097 ceph-mon[41966]: pgmap v764: 178 pgs: 178 active+clean; 6.0 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 955 B/s rd, 57 MiB/s wr, 919 op/s 2021-10-08T19:36:40.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:39 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3875775868' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:36:40.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:39 smithi097 ceph-mon[41966]: from='client.25891 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:36:40.280 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:36:40.323 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:40.402 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 74 16 102656 102640 86.6284 64.0625 0.0114976 0.0115392 2021-10-08T19:36:40.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:39 smithi117 ceph-mon[34585]: pgmap v764: 178 pgs: 178 active+clean; 6.0 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 955 B/s rd, 57 MiB/s wr, 919 op/s 2021-10-08T19:36:40.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:39 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3875775868' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:36:40.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:39 smithi117 ceph-mon[34585]: from='client.25891 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:36:40.778 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:36:40.795 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:40.796 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:36:40.828 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2021-10-08T19:36:40.897 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:36:41.006 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:41.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:40 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:36:41.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:40 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:36:41.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:40 smithi097 ceph-mon[41966]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:36:41.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:40 smithi097 ceph-mon[41966]: from='client.25891 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:36:41.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:40 smithi097 ceph-mon[41966]: osdmap e387: 8 total, 8 up, 8 in 2021-10-08T19:36:41.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:40 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:36:41.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:40 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:36:41.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:40 smithi097 ceph-mon[32687]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:36:41.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:40 smithi097 ceph-mon[32687]: from='client.25891 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:36:41.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:40 smithi097 ceph-mon[32687]: osdmap e387: 8 total, 8 up, 8 in 2021-10-08T19:36:41.288 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:36:41.292 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:41.293 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:36:41.394 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:36:41.402 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 75 16 103650 103634 86.3017 62.125 0.0185485 0.0115821 2021-10-08T19:36:41.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:40 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:36:41.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:40 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:36:41.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:40 smithi117 ceph-mon[34585]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:36:41.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:40 smithi117 ceph-mon[34585]: from='client.25891 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:36:41.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:40 smithi117 ceph-mon[34585]: osdmap e387: 8 total, 8 up, 8 in 2021-10-08T19:36:41.471 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:41.653 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:36:41.664 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:41.666 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:36:41.762 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:36:41.767 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:36:41.776 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:36:41.807 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:36:41.855 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:41.856 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:36:41.903 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:36:41.961 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:36:42.005 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:36:42.024 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:36:42.034 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:42.035 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:36:42.040 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:36:42.076 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:36:42.079 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'false' 2021-10-08T19:36:42.079 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'false' 2021-10-08T19:36:42.079 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'false' 2021-10-08T19:36:42.079 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'false' 2021-10-08T19:36:42.080 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'false' 2021-10-08T19:36:42.080 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'false' 2021-10-08T19:36:42.080 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'false' 2021-10-08T19:36:42.080 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'false' 2021-10-08T19:36:42.136 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:36:42.184 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:42.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:41 smithi097 ceph-mon[32687]: 6.e scrub ok 2021-10-08T19:36:42.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:41 smithi097 ceph-mon[32687]: pgmap v766: 178 pgs: 178 active+clean; 6.2 GiB data, 21 GiB used, 695 GiB / 715 GiB avail; 1.1 KiB/s rd, 80 MiB/s wr, 1.29k op/s 2021-10-08T19:36:42.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:41 smithi097 ceph-mon[32687]: 3.5 scrub ok 2021-10-08T19:36:42.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:41 smithi097 ceph-mon[32687]: 5.1f scrub ok 2021-10-08T19:36:42.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:41 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2483867323' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:36:42.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:41 smithi097 ceph-mon[41966]: 6.e scrub ok 2021-10-08T19:36:42.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:41 smithi097 ceph-mon[41966]: pgmap v766: 178 pgs: 178 active+clean; 6.2 GiB data, 21 GiB used, 695 GiB / 715 GiB avail; 1.1 KiB/s rd, 80 MiB/s wr, 1.29k op/s 2021-10-08T19:36:42.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:41 smithi097 ceph-mon[41966]: 3.5 scrub ok 2021-10-08T19:36:42.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:41 smithi097 ceph-mon[41966]: 5.1f scrub ok 2021-10-08T19:36:42.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:41 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2483867323' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:36:42.313 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:41 smithi117 ceph-mon[34585]: 6.e scrub ok 2021-10-08T19:36:42.314 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:41 smithi117 ceph-mon[34585]: pgmap v766: 178 pgs: 178 active+clean; 6.2 GiB data, 21 GiB used, 695 GiB / 715 GiB avail; 1.1 KiB/s rd, 80 MiB/s wr, 1.29k op/s 2021-10-08T19:36:42.314 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:41 smithi117 ceph-mon[34585]: 3.5 scrub ok 2021-10-08T19:36:42.314 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:41 smithi117 ceph-mon[34585]: 5.1f scrub ok 2021-10-08T19:36:42.314 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:41 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2483867323' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:36:42.403 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 76 16 104580 104564 85.9311 58.125 0.0107092 0.0116328 2021-10-08T19:36:42.703 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:36:42.707 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:42.708 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:36:42.809 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:36:42.852 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:36:42 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:36:42] "GET /metrics HTTP/1.1" 200 155851 "" "Prometheus/2.18.1" 2021-10-08T19:36:42.862 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:43.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:42 smithi097 ceph-mon[32687]: 5.f scrub ok 2021-10-08T19:36:43.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:42 smithi097 ceph-mon[32687]: 2.14 scrub ok 2021-10-08T19:36:43.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:42 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:36:43.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:42 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:36:43.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:42 smithi097 ceph-mon[41966]: 5.f scrub ok 2021-10-08T19:36:43.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:42 smithi097 ceph-mon[41966]: 2.14 scrub ok 2021-10-08T19:36:43.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:42 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:36:43.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:42 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:36:43.258 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset nodeep-scrub 2021-10-08T19:36:43.403 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 77 16 105677 105661 85.7049 68.5625 0.0124013 0.0116631 2021-10-08T19:36:43.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:42 smithi117 ceph-mon[34585]: 5.f scrub ok 2021-10-08T19:36:43.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:42 smithi117 ceph-mon[34585]: 2.14 scrub ok 2021-10-08T19:36:43.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:42 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:36:43.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:42 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:36:43.565 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:36:43.572 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:43.573 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:36:43.674 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:36:43.747 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:43.837 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:36:43.844 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:43.845 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:36:43.947 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:36:43.989 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:36:43 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:36:43] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:36:43.994 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:44.220 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:36:44.226 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:44.227 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:36:44.257 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:43 smithi097 ceph-mon[32687]: 5.1 scrub ok 2021-10-08T19:36:44.257 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:43 smithi097 ceph-mon[32687]: pgmap v767: 178 pgs: 178 active+clean; 6.2 GiB data, 21 GiB used, 695 GiB / 715 GiB avail; 639 B/s rd, 38 MiB/s wr, 615 op/s 2021-10-08T19:36:44.257 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:43 smithi097 ceph-mon[32687]: 4.15 scrub ok 2021-10-08T19:36:44.257 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:43 smithi097 ceph-mon[32687]: 6.c scrub ok 2021-10-08T19:36:44.258 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:43 smithi097 ceph-mon[41966]: 5.1 scrub ok 2021-10-08T19:36:44.258 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:43 smithi097 ceph-mon[41966]: pgmap v767: 178 pgs: 178 active+clean; 6.2 GiB data, 21 GiB used, 695 GiB / 715 GiB avail; 639 B/s rd, 38 MiB/s wr, 615 op/s 2021-10-08T19:36:44.258 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:43 smithi097 ceph-mon[41966]: 4.15 scrub ok 2021-10-08T19:36:44.259 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:43 smithi097 ceph-mon[41966]: 6.c scrub ok 2021-10-08T19:36:44.329 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:36:44.365 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:43 smithi117 ceph-mon[34585]: 5.1 scrub ok 2021-10-08T19:36:44.365 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:43 smithi117 ceph-mon[34585]: pgmap v767: 178 pgs: 178 active+clean; 6.2 GiB data, 21 GiB used, 695 GiB / 715 GiB avail; 639 B/s rd, 38 MiB/s wr, 615 op/s 2021-10-08T19:36:44.366 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:43 smithi117 ceph-mon[34585]: 4.15 scrub ok 2021-10-08T19:36:44.366 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:43 smithi117 ceph-mon[34585]: 6.c scrub ok 2021-10-08T19:36:44.368 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:44.406 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 78 16 106705 106689 85.4293 64.25 0.00777148 0.0117008 2021-10-08T19:36:44.459 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:36:44.462 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:44.463 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:36:44.564 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:36:44.602 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:44.788 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:36:44.795 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:44.796 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:36:44.797 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:36:44.898 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:36:44.984 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:45.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:45 smithi117 ceph-mon[34585]: 1.5 scrub ok 2021-10-08T19:36:45.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:45 smithi117 ceph-mon[34585]: 4.5 scrub ok 2021-10-08T19:36:45.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:45 smithi117 ceph-mon[34585]: 3.0 scrub ok 2021-10-08T19:36:45.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:45 smithi097 ceph-mon[32687]: 1.5 scrub ok 2021-10-08T19:36:45.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:45 smithi097 ceph-mon[32687]: 4.5 scrub ok 2021-10-08T19:36:45.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:45 smithi097 ceph-mon[32687]: 3.0 scrub ok 2021-10-08T19:36:45.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:45 smithi097 ceph-mon[41966]: 1.5 scrub ok 2021-10-08T19:36:45.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:45 smithi097 ceph-mon[41966]: 4.5 scrub ok 2021-10-08T19:36:45.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:45 smithi097 ceph-mon[41966]: 3.0 scrub ok 2021-10-08T19:36:45.404 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 79 16 107705 107689 85.1391 62.5 0.0169634 0.0117413 2021-10-08T19:36:45.530 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:36:45.534 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:45.535 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:36:45.644 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:36:45.690 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:45.760 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:36:45.772 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2021-10-08T19:36:46.160 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2021-10-08T19:36:46.184 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:46 smithi097 ceph-mon[41966]: pgmap v768: 178 pgs: 178 active+clean; 6.5 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 1.2 KiB/s rd, 76 MiB/s wr, 1.22k op/s 2021-10-08T19:36:46.185 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:46 smithi097 ceph-mon[41966]: 5.1a scrub ok 2021-10-08T19:36:46.186 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:46 smithi097 ceph-mon[41966]: 2.10 scrub ok 2021-10-08T19:36:46.186 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:46 smithi097 ceph-mon[32687]: pgmap v768: 178 pgs: 178 active+clean; 6.5 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 1.2 KiB/s rd, 76 MiB/s wr, 1.22k op/s 2021-10-08T19:36:46.186 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:46 smithi097 ceph-mon[32687]: 5.1a scrub ok 2021-10-08T19:36:46.187 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:46 smithi097 ceph-mon[32687]: 2.10 scrub ok 2021-10-08T19:36:46.407 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:2021-10-08T19:36:46.406718+0000 min lat: 0.00140955 max lat: 0.227624 avg lat: 0.0117909 2021-10-08T19:36:46.408 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2021-10-08T19:36:46.408 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 80 16 108608 108592 84.7776 56.4375 0.0136316 0.0117909 2021-10-08T19:36:46.409 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:46 smithi117 ceph-mon[34585]: pgmap v768: 178 pgs: 178 active+clean; 6.5 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 1.2 KiB/s rd, 76 MiB/s wr, 1.22k op/s 2021-10-08T19:36:46.410 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:46 smithi117 ceph-mon[34585]: 5.1a scrub ok 2021-10-08T19:36:46.410 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:46 smithi117 ceph-mon[34585]: 2.10 scrub ok 2021-10-08T19:36:46.856 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:36:46.860 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:46.860 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:36:46.962 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:36:47.006 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:47.193 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:47 smithi097 ceph-mon[41966]: 4.1e scrub ok 2021-10-08T19:36:47.194 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:47 smithi097 ceph-mon[41966]: from='client.15975 v1:172.21.15.97:0/802099181' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:36:47.194 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:47 smithi097 ceph-mon[41966]: 5.19 scrub ok 2021-10-08T19:36:47.194 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:47 smithi097 ceph-mon[32687]: 4.1e scrub ok 2021-10-08T19:36:47.195 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:47 smithi097 ceph-mon[32687]: from='client.15975 v1:172.21.15.97:0/802099181' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:36:47.195 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:47 smithi097 ceph-mon[32687]: 5.19 scrub ok 2021-10-08T19:36:47.210 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:36:47.215 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:47.217 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:36:47.317 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:36:47.361 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:47 smithi117 ceph-mon[34585]: 4.1e scrub ok 2021-10-08T19:36:47.362 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:47 smithi117 ceph-mon[34585]: from='client.15975 v1:172.21.15.97:0/802099181' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:36:47.362 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:47 smithi117 ceph-mon[34585]: 5.19 scrub ok 2021-10-08T19:36:47.363 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:36:47 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:36:47.368 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:47.407 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 81 16 109642 109626 84.5289 64.625 0.0204507 0.0118256 2021-10-08T19:36:47.412 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":768,"stamp":"2021-10-08T19:36:44.859042+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6944397508,"num_objects":106148,"num_object_clones":0,"num_object_copies":318444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106148,"num_whiteouts":0,"num_read":1880,"num_read_kb":1637,"num_write":106664,"num_write_kb":6781096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":534,"num_bytes_recovered":12006,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":77508,"ondisk_log_size":77508,"up":534,"acting":534,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":534,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":22435640,"kb_used_data":20197688,"kb_used_omap":0,"kb_used_meta":2237888,"kb_avail":727525576,"statfs":{"total":767960285184,"available":744986189824,"internally_reserved":0,"allocated":20682432512,"data_stored":20679438412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2291597312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,3,0,0,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":639500288,"num_objects":9758,"num_object_clones":0,"num_object_copies":29274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9758,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":9758,"num_write_kb":624512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.004973"},"pg_stats":[{"pgid":"10.6","version":"387'6717","reported_seq":6757,"reported_epoch":387,"state":"active+clean","last_fresh":"2021-10-08T19:36:43.594188+0000","last_change":"2021-10-08T19:35:16.782994+0000","last_active":"2021-10-08T19:36:43.594188+0000","last_peered":"2021-10-08T19:36:43.594188+0000","last_clean":"2021-10-08T19:36:43.594188+0000","last_became_active":"2021-10-08T19:35:16.782658+0000","last_became_peered":"2021-10-08T19:35:16.782658+0000","last_unstale":"2021-10-08T19:36:43.594188+0000","last_undegraded":"2021-10-08T19:36:43.594188+0000","last_fullsized":"2021-10-08T19:36:43.594188+0000","mapping_epoch":355,"log_start":"364'2000","ondisk_log_start":"364'2000","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:35:15.759693+0000","log_size":4717,"ondisk_log_size":4717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":440205312,"num_objects":6717,"num_object_clones":0,"num_object_copies":20151,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6717,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6717,"num_write_kb":429888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4],"acting":[5,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"114'10","reported_seq":574,"reported_epoch":387,"state":"active+clean","last_fresh":"2021-10-08T19:36:40.006090+0000","last_change":"2021-10-08T19:34:14.586366+0000","last_active":"2021-10-08T19:36:40.006090+0000","last_peered":"2021-10-08T19:36:40.006090+0000","last_clean":"2021-10-08T19:36:40.006090+0000","last_became_active":"2021-10-08T19:24:25.096162+0000","last_became_peered":"2021-10-08T19:24:25.096162+0000","last_unstale":"2021-10-08T19:36:40.006090+0000","last_undegraded":"2021-10-08T19:36:40.006090+0000","last_fullsized":"2021-10-08T19:36:40.006090+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'10","last_scrub_stamp":"2021-10-08T19:34:14.586030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:34:14.586030+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034352250000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"289'34","reported_seq":153,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.962372+0000","last_change":"2021-10-08T19:33:23.562208+0000","last_active":"2021-10-08T19:36:36.962372+0000","last_peered":"2021-10-08T19:36:36.962372+0000","last_clean":"2021-10-08T19:36:36.962372+0000","last_became_active":"2021-10-08T19:31:22.787271+0000","last_became_peered":"2021-10-08T19:31:22.787271+0000","last_unstale":"2021-10-08T19:36:36.962372+0000","last_undegraded":"2021-10-08T19:36:36.962372+0000","last_fullsized":"2021-10-08T19:36:36.962372+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'34","last_scrub_stamp":"2021-10-08T19:33:23.562083+0000","last_deep_scrub":"87'22","last_deep_scrub_stamp":"2021-10-08T19:22:58.705632+0000","last_clean_scrub_stamp":"2021-10-08T19:33:23.562083+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011294012000000001,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":393,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.957605+0000","last_change":"2021-10-08T19:36:06.093016+0000","last_active":"2021-10-08T19:36:36.957605+0000","last_peered":"2021-10-08T19:36:36.957605+0000","last_clean":"2021-10-08T19:36:36.957605+0000","last_became_active":"2021-10-08T19:29:40.632678+0000","last_became_peered":"2021-10-08T19:29:40.632678+0000","last_unstale":"2021-10-08T19:36:36.957605+0000","last_undegraded":"2021-10-08T19:36:36.957605+0000","last_fullsized":"2021-10-08T19:36:36.957605+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:06.092943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:06.092943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0048028580000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":370,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.962875+0000","last_change":"2021-10-08T19:36:00.572697+0000","last_active":"2021-10-08T19:36:36.962875+0000","last_peered":"2021-10-08T19:36:36.962875+0000","last_clean":"2021-10-08T19:36:36.962875+0000","last_became_active":"2021-10-08T19:24:25.089002+0000","last_became_peered":"2021-10-08T19:24:25.089002+0000","last_unstale":"2021-10-08T19:36:36.962875+0000","last_undegraded":"2021-10-08T19:36:36.962875+0000","last_fullsized":"2021-10-08T19:36:36.962875+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:00.572589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:08.936801+0000","last_clean_scrub_stamp":"2021-10-08T19:36:00.572589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.031713926000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":293,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.967231+0000","last_change":"2021-10-08T19:36:04.907070+0000","last_active":"2021-10-08T19:36:36.967231+0000","last_peered":"2021-10-08T19:36:36.967231+0000","last_clean":"2021-10-08T19:36:36.967231+0000","last_became_active":"2021-10-08T19:25:15.510457+0000","last_became_peered":"2021-10-08T19:25:15.510457+0000","last_unstale":"2021-10-08T19:36:36.967231+0000","last_undegraded":"2021-10-08T19:36:36.967231+0000","last_fullsized":"2021-10-08T19:36:36.967231+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:04.906938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:33:28.036266+0000","last_clean_scrub_stamp":"2021-10-08T19:36:04.906938+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0079401560000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"387'6590","reported_seq":6626,"reported_epoch":387,"state":"active+clean","last_fresh":"2021-10-08T19:36:43.853928+0000","last_change":"2021-10-08T19:35:17.125078+0000","last_active":"2021-10-08T19:36:43.853928+0000","last_peered":"2021-10-08T19:36:43.853928+0000","last_clean":"2021-10-08T19:36:43.853928+0000","last_became_active":"2021-10-08T19:35:17.124786+0000","last_became_peered":"2021-10-08T19:35:17.124786+0000","last_unstale":"2021-10-08T19:36:43.853928+0000","last_undegraded":"2021-10-08T19:36:43.853928+0000","last_fullsized":"2021-10-08T19:36:43.853928+0000","mapping_epoch":355,"log_start":"362'1200","ondisk_log_start":"362'1200","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:35:15.759693+0000","log_size":5390,"ondisk_log_size":5390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":431882240,"num_objects":6590,"num_object_clones":0,"num_object_copies":19770,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6590,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6590,"num_write_kb":421760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"337'19","reported_seq":430,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.962576+0000","last_change":"2021-10-08T19:36:17.162468+0000","last_active":"2021-10-08T19:36:36.962576+0000","last_peered":"2021-10-08T19:36:36.962576+0000","last_clean":"2021-10-08T19:36:36.962576+0000","last_became_active":"2021-10-08T19:28:40.159729+0000","last_became_peered":"2021-10-08T19:28:40.159729+0000","last_unstale":"2021-10-08T19:36:36.962576+0000","last_undegraded":"2021-10-08T19:36:36.962576+0000","last_fullsized":"2021-10-08T19:36:36.962576+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"337'19","last_scrub_stamp":"2021-10-08T19:36:17.162349+0000","last_deep_scrub":"337'19","last_deep_scrub_stamp":"2021-10-08T19:34:14.040249+0000","last_clean_scrub_stamp":"2021-10-08T19:36:17.162349+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.019723487000000001,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":229,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.963279+0000","last_change":"2021-10-08T19:34:52.700263+0000","last_active":"2021-10-08T19:36:36.963279+0000","last_peered":"2021-10-08T19:36:36.963279+0000","last_clean":"2021-10-08T19:36:36.963279+0000","last_became_active":"2021-10-08T19:29:40.624977+0000","last_became_peered":"2021-10-08T19:29:40.624977+0000","last_unstale":"2021-10-08T19:36:36.963279+0000","last_undegraded":"2021-10-08T19:36:36.963279+0000","last_fullsized":"2021-10-08T19:36:36.963279+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:52.700168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:52.700168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0094829509999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":379,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.957388+0000","last_change":"2021-10-08T19:34:57.000885+0000","last_active":"2021-10-08T19:36:36.957388+0000","last_peered":"2021-10-08T19:36:36.957388+0000","last_clean":"2021-10-08T19:36:36.957388+0000","last_became_active":"2021-10-08T19:29:40.629422+0000","last_became_peered":"2021-10-08T19:29:40.629422+0000","last_unstale":"2021-10-08T19:36:36.957388+0000","last_undegraded":"2021-10-08T19:36:36.957388+0000","last_fullsized":"2021-10-08T19:36:36.957388+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:57.000786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:34:57.000786+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0096958310000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":355,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.961593+0000","last_change":"2021-10-08T19:34:53.070243+0000","last_active":"2021-10-08T19:36:36.961593+0000","last_peered":"2021-10-08T19:36:36.961593+0000","last_clean":"2021-10-08T19:36:36.961593+0000","last_became_active":"2021-10-08T19:21:29.643022+0000","last_became_peered":"2021-10-08T19:21:29.643022+0000","last_unstale":"2021-10-08T19:36:36.961593+0000","last_undegraded":"2021-10-08T19:36:36.961593+0000","last_fullsized":"2021-10-08T19:36:36.961593+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:53.070138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:34:53.070138+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.076770236000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"70'5","reported_seq":1102,"reported_epoch":387,"state":"active+clean","last_fresh":"2021-10-08T19:36:41.646311+0000","last_change":"2021-10-08T19:34:45.765175+0000","last_active":"2021-10-08T19:36:41.646311+0000","last_peered":"2021-10-08T19:36:41.646311+0000","last_clean":"2021-10-08T19:36:41.646311+0000","last_became_active":"2021-10-08T19:29:40.630821+0000","last_became_peered":"2021-10-08T19:29:40.630821+0000","last_unstale":"2021-10-08T19:36:41.646311+0000","last_undegraded":"2021-10-08T19:36:41.646311+0000","last_fullsized":"2021-10-08T19:36:41.646311+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:34:45.765074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:45.765074+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0069135860000000002,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":740,"num_read_kb":740,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1167,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.4","version":"387'6569","reported_seq":6608,"reported_epoch":387,"state":"active+clean","last_fresh":"2021-10-08T19:36:43.437518+0000","last_change":"2021-10-08T19:35:17.124862+0000","last_active":"2021-10-08T19:36:43.437518+0000","last_peered":"2021-10-08T19:36:43.437518+0000","last_clean":"2021-10-08T19:36:43.437518+0000","last_became_active":"2021-10-08T19:35:17.124559+0000","last_became_peered":"2021-10-08T19:35:17.124559+0000","last_unstale":"2021-10-08T19:36:43.437518+0000","last_undegraded":"2021-10-08T19:36:43.437518+0000","last_fullsized":"2021-10-08T19:36:43.437518+0000","mapping_epoch":355,"log_start":"364'2000","ondisk_log_start":"364'2000","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:35:15.759693+0000","log_size":4569,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":430505984,"num_objects":6569,"num_object_clones":0,"num_object_copies":19707,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6569,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6569,"num_write_kb":420416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"289'35","reported_seq":418,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.962290+0000","last_change":"2021-10-08T19:35:57.653426+0000","last_active":"2021-10-08T19:36:36.962290+0000","last_peered":"2021-10-08T19:36:36.962290+0000","last_clean":"2021-10-08T19:36:36.962290+0000","last_became_active":"2021-10-08T19:28:40.101648+0000","last_became_peered":"2021-10-08T19:28:40.101648+0000","last_unstale":"2021-10-08T19:36:36.962290+0000","last_undegraded":"2021-10-08T19:36:36.962290+0000","last_fullsized":"2021-10-08T19:36:36.962290+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'35","last_scrub_stamp":"2021-10-08T19:35:57.653345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:35:57.653345+0000","log_size":35,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040502669999999998,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":55,"num_read_kb":44,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":371,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.958044+0000","last_change":"2021-10-08T19:35:58.075011+0000","last_active":"2021-10-08T19:36:36.958044+0000","last_peered":"2021-10-08T19:36:36.958044+0000","last_clean":"2021-10-08T19:36:36.958044+0000","last_became_active":"2021-10-08T19:21:23.595919+0000","last_became_peered":"2021-10-08T19:21:23.595919+0000","last_unstale":"2021-10-08T19:36:36.958044+0000","last_undegraded":"2021-10-08T19:36:36.958044+0000","last_fullsized":"2021-10-08T19:36:36.958044+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:58.074848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:58.074848+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0063866330000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":379,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.957820+0000","last_change":"2021-10-08T19:35:57.051876+0000","last_active":"2021-10-08T19:36:36.957820+0000","last_peered":"2021-10-08T19:36:36.957820+0000","last_clean":"2021-10-08T19:36:36.957820+0000","last_became_active":"2021-10-08T19:31:22.783725+0000","last_became_peered":"2021-10-08T19:31:22.783725+0000","last_unstale":"2021-10-08T19:36:36.957820+0000","last_undegraded":"2021-10-08T19:36:36.957820+0000","last_fullsized":"2021-10-08T19:36:36.957820+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:57.051759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:35:57.051759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0084059809999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":371,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.966124+0000","last_change":"2021-10-08T19:34:20.691431+0000","last_active":"2021-10-08T19:36:36.966124+0000","last_peered":"2021-10-08T19:36:36.966124+0000","last_clean":"2021-10-08T19:36:36.966124+0000","last_became_active":"2021-10-08T19:29:40.638354+0000","last_became_peered":"2021-10-08T19:29:40.638354+0000","last_unstale":"2021-10-08T19:36:36.966124+0000","last_undegraded":"2021-10-08T19:36:36.966124+0000","last_fullsized":"2021-10-08T19:36:36.966124+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:20.691312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:39.528699+0000","last_clean_scrub_stamp":"2021-10-08T19:34:20.691312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0054161239999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":304,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.966533+0000","last_change":"2021-10-08T19:35:58.023652+0000","last_active":"2021-10-08T19:36:36.966533+0000","last_peered":"2021-10-08T19:36:36.966533+0000","last_clean":"2021-10-08T19:36:36.966533+0000","last_became_active":"2021-10-08T19:31:22.785590+0000","last_became_peered":"2021-10-08T19:31:22.785590+0000","last_unstale":"2021-10-08T19:36:36.966533+0000","last_undegraded":"2021-10-08T19:36:36.966533+0000","last_fullsized":"2021-10-08T19:36:36.966533+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:58.023581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:58.023581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0070639609999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3","version":"387'6735","reported_seq":6775,"reported_epoch":387,"state":"active+clean","last_fresh":"2021-10-08T19:36:43.864412+0000","last_change":"2021-10-08T19:35:17.124080+0000","last_active":"2021-10-08T19:36:43.864412+0000","last_peered":"2021-10-08T19:36:43.864412+0000","last_clean":"2021-10-08T19:36:43.864412+0000","last_became_active":"2021-10-08T19:35:17.123799+0000","last_became_peered":"2021-10-08T19:35:17.123799+0000","last_unstale":"2021-10-08T19:36:43.864412+0000","last_undegraded":"2021-10-08T19:36:43.864412+0000","last_fullsized":"2021-10-08T19:36:43.864412+0000","mapping_epoch":355,"log_start":"362'1300","ondisk_log_start":"362'1300","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:35:15.759693+0000","log_size":5435,"ondisk_log_size":5435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":441384960,"num_objects":6735,"num_object_clones":0,"num_object_copies":20205,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6735,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6735,"num_write_kb":431040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.8","version":"90'130","reported_seq":469,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.962575+0000","last_change":"2021-10-08T19:34:44.803061+0000","last_active":"2021-10-08T19:36:36.962575+0000","last_peered":"2021-10-08T19:36:36.962575+0000","last_clean":"2021-10-08T19:36:36.962575+0000","last_became_active":"2021-10-08T19:31:25.647505+0000","last_became_peered":"2021-10-08T19:31:25.647505+0000","last_unstale":"2021-10-08T19:36:36.962575+0000","last_undegraded":"2021-10-08T19:36:36.962575+0000","last_fullsized":"2021-10-08T19:36:36.962575+0000","mapping_epoch":286,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":287,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:34:44.802994+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:34:44.802994+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.016276585,"stat_sum":{"num_bytes":262688,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"289'31","reported_seq":459,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.956276+0000","last_change":"2021-10-08T19:35:26.152730+0000","last_active":"2021-10-08T19:36:36.956276+0000","last_peered":"2021-10-08T19:36:36.956276+0000","last_clean":"2021-10-08T19:36:36.956276+0000","last_became_active":"2021-10-08T19:28:40.099618+0000","last_became_peered":"2021-10-08T19:28:40.099618+0000","last_unstale":"2021-10-08T19:36:36.956276+0000","last_undegraded":"2021-10-08T19:36:36.956276+0000","last_fullsized":"2021-10-08T19:36:36.956276+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'31","last_scrub_stamp":"2021-10-08T19:35:26.152640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:35:26.152640+0000","log_size":31,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0031552659999999999,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":50,"num_read_kb":40,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"61'1","reported_seq":367,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.970534+0000","last_change":"2021-10-08T19:35:22.904758+0000","last_active":"2021-10-08T19:36:36.970534+0000","last_peered":"2021-10-08T19:36:36.970534+0000","last_clean":"2021-10-08T19:36:36.970534+0000","last_became_active":"2021-10-08T19:21:23.607064+0000","last_became_peered":"2021-10-08T19:21:23.607064+0000","last_unstale":"2021-10-08T19:36:36.970534+0000","last_undegraded":"2021-10-08T19:36:36.970534+0000","last_fullsized":"2021-10-08T19:36:36.970534+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'1","last_scrub_stamp":"2021-10-08T19:35:22.904628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:22.904628+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0051040089999999996,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":211,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.962991+0000","last_change":"2021-10-08T19:35:25.704060+0000","last_active":"2021-10-08T19:36:36.962991+0000","last_peered":"2021-10-08T19:36:36.962991+0000","last_clean":"2021-10-08T19:36:36.962991+0000","last_became_active":"2021-10-08T19:28:40.152478+0000","last_became_peered":"2021-10-08T19:28:40.152478+0000","last_unstale":"2021-10-08T19:36:36.962991+0000","last_undegraded":"2021-10-08T19:36:36.962991+0000","last_fullsized":"2021-10-08T19:36:36.962991+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:25.703955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:30:09.081635+0000","last_clean_scrub_stamp":"2021-10-08T19:35:25.703955+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0021998410000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":379,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.959432+0000","last_change":"2021-10-08T19:35:20.102212+0000","last_active":"2021-10-08T19:36:36.959432+0000","last_peered":"2021-10-08T19:36:36.959432+0000","last_clean":"2021-10-08T19:36:36.959432+0000","last_became_active":"2021-10-08T19:29:40.629424+0000","last_became_peered":"2021-10-08T19:29:40.629424+0000","last_unstale":"2021-10-08T19:36:36.959432+0000","last_undegraded":"2021-10-08T19:36:36.959432+0000","last_fullsized":"2021-10-08T19:36:36.959432+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:20.102116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:35:20.102116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.075222543000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":343,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.962517+0000","last_change":"2021-10-08T19:35:16.628777+0000","last_active":"2021-10-08T19:36:36.962517+0000","last_peered":"2021-10-08T19:36:36.962517+0000","last_clean":"2021-10-08T19:36:36.962517+0000","last_became_active":"2021-10-08T19:31:51.676829+0000","last_became_peered":"2021-10-08T19:31:51.676829+0000","last_unstale":"2021-10-08T19:36:36.962517+0000","last_undegraded":"2021-10-08T19:36:36.962517+0000","last_fullsized":"2021-10-08T19:36:36.962517+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:16.628688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:16.628688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0015118340000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"387'6654","reported_seq":6694,"reported_epoch":387,"state":"active+clean","last_fresh":"2021-10-08T19:36:44.114236+0000","last_change":"2021-10-08T19:35:16.780327+0000","last_active":"2021-10-08T19:36:44.114236+0000","last_peered":"2021-10-08T19:36:44.114236+0000","last_clean":"2021-10-08T19:36:44.114236+0000","last_became_active":"2021-10-08T19:35:16.780016+0000","last_became_peered":"2021-10-08T19:35:16.780016+0000","last_unstale":"2021-10-08T19:36:44.114236+0000","last_undegraded":"2021-10-08T19:36:44.114236+0000","last_fullsized":"2021-10-08T19:36:44.114236+0000","mapping_epoch":355,"log_start":"364'1800","ondisk_log_start":"364'1800","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:35:15.759693+0000","log_size":4854,"ondisk_log_size":4854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":436076544,"num_objects":6654,"num_object_clones":0,"num_object_copies":19962,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6654,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6654,"num_write_kb":425856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.9","version":"90'130","reported_seq":707,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.966785+0000","last_change":"2021-10-08T19:35:20.911809+0000","last_active":"2021-10-08T19:36:36.966785+0000","last_peered":"2021-10-08T19:36:36.966785+0000","last_clean":"2021-10-08T19:36:36.966785+0000","last_became_active":"2021-10-08T19:29:43.634789+0000","last_became_peered":"2021-10-08T19:29:43.634789+0000","last_unstale":"2021-10-08T19:36:36.966785+0000","last_undegraded":"2021-10-08T19:36:36.966785+0000","last_fullsized":"2021-10-08T19:36:36.966785+0000","mapping_epoch":239,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:35:20.911733+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:35:20.911733+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0029675249999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"289'20","reported_seq":470,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.956606+0000","last_change":"2021-10-08T19:35:19.156261+0000","last_active":"2021-10-08T19:36:36.956606+0000","last_peered":"2021-10-08T19:36:36.956606+0000","last_clean":"2021-10-08T19:36:36.956606+0000","last_became_active":"2021-10-08T19:29:40.631807+0000","last_became_peered":"2021-10-08T19:29:40.631807+0000","last_unstale":"2021-10-08T19:36:36.956606+0000","last_undegraded":"2021-10-08T19:36:36.956606+0000","last_fullsized":"2021-10-08T19:36:36.956606+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'20","last_scrub_stamp":"2021-10-08T19:35:19.156174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:35:19.156174+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039866930000000004,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":231,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.966294+0000","last_change":"2021-10-08T19:35:18.712034+0000","last_active":"2021-10-08T19:36:36.966294+0000","last_peered":"2021-10-08T19:36:36.966294+0000","last_clean":"2021-10-08T19:36:36.966294+0000","last_became_active":"2021-10-08T19:29:40.638988+0000","last_became_peered":"2021-10-08T19:29:40.638988+0000","last_unstale":"2021-10-08T19:36:36.966294+0000","last_undegraded":"2021-10-08T19:36:36.966294+0000","last_fullsized":"2021-10-08T19:36:36.966294+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:18.711965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:18.711965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0014885569999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"250'9","reported_seq":562,"reported_epoch":387,"state":"active+clean","last_fresh":"2021-10-08T19:36:39.987320+0000","last_change":"2021-10-08T19:36:05.056752+0000","last_active":"2021-10-08T19:36:39.987320+0000","last_peered":"2021-10-08T19:36:39.987320+0000","last_clean":"2021-10-08T19:36:39.987320+0000","last_became_active":"2021-10-08T19:21:27.637930+0000","last_became_peered":"2021-10-08T19:21:27.637930+0000","last_unstale":"2021-10-08T19:36:39.987320+0000","last_undegraded":"2021-10-08T19:36:39.987320+0000","last_fullsized":"2021-10-08T19:36:39.987320+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'9","last_scrub_stamp":"2021-10-08T19:36:05.056649+0000","last_deep_scrub":"250'9","last_deep_scrub_stamp":"2021-10-08T19:30:04.239189+0000","last_clean_scrub_stamp":"2021-10-08T19:36:05.056649+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0049163460000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":376,"reported_epoch":387,"state":"active+clean","last_fresh":"2021-10-08T19:36:40.486920+0000","last_change":"2021-10-08T19:36:40.486877+0000","last_active":"2021-10-08T19:36:40.486920+0000","last_peered":"2021-10-08T19:36:40.486920+0000","last_clean":"2021-10-08T19:36:40.486920+0000","last_became_active":"2021-10-08T19:28:40.100213+0000","last_became_peered":"2021-10-08T19:28:40.100213+0000","last_unstale":"2021-10-08T19:36:40.486920+0000","last_undegraded":"2021-10-08T19:36:40.486920+0000","last_fullsized":"2021-10-08T19:36:40.486920+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:40.486763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:36:40.486763+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.030070781000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":171,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.959369+0000","last_change":"2021-10-08T19:36:15.769584+0000","last_active":"2021-10-08T19:36:36.959369+0000","last_peered":"2021-10-08T19:36:36.959369+0000","last_clean":"2021-10-08T19:36:36.959369+0000","last_became_active":"2021-10-08T19:29:44.443507+0000","last_became_peered":"2021-10-08T19:29:44.443507+0000","last_unstale":"2021-10-08T19:36:36.959369+0000","last_undegraded":"2021-10-08T19:36:36.959369+0000","last_fullsized":"2021-10-08T19:36:36.959369+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:15.769469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:15.769469+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0068300569999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"387'6684","reported_seq":6724,"reported_epoch":387,"state":"active+clean","last_fresh":"2021-10-08T19:36:43.376414+0000","last_change":"2021-10-08T19:35:16.778534+0000","last_active":"2021-10-08T19:36:43.376414+0000","last_peered":"2021-10-08T19:36:43.376414+0000","last_clean":"2021-10-08T19:36:43.376414+0000","last_became_active":"2021-10-08T19:35:16.778182+0000","last_became_peered":"2021-10-08T19:35:16.778182+0000","last_unstale":"2021-10-08T19:36:43.376414+0000","last_undegraded":"2021-10-08T19:36:43.376414+0000","last_fullsized":"2021-10-08T19:36:43.376414+0000","mapping_epoch":355,"log_start":"365'2600","ondisk_log_start":"365'2600","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:35:15.759693+0000","log_size":4084,"ondisk_log_size":4084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":438042624,"num_objects":6684,"num_object_clones":0,"num_object_copies":20052,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6684,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6684,"num_write_kb":427776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,0],"acting":[4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.a","version":"90'130","reported_seq":535,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.962744+0000","last_change":"2021-10-08T19:34:11.489040+0000","last_active":"2021-10-08T19:36:36.962744+0000","last_peered":"2021-10-08T19:36:36.962744+0000","last_clean":"2021-10-08T19:36:36.962744+0000","last_became_active":"2021-10-08T19:27:26.591129+0000","last_became_peered":"2021-10-08T19:27:26.591129+0000","last_unstale":"2021-10-08T19:36:36.962744+0000","last_undegraded":"2021-10-08T19:36:36.962744+0000","last_fullsized":"2021-10-08T19:36:36.962744+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:34:11.488938+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:34:11.488938+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0022431069999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.f","version":"289'27","reported_seq":113,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.959222+0000","last_change":"2021-10-08T19:36:12.961210+0000","last_active":"2021-10-08T19:36:36.959222+0000","last_peered":"2021-10-08T19:36:36.959222+0000","last_clean":"2021-10-08T19:36:36.959222+0000","last_became_active":"2021-10-08T19:32:45.162914+0000","last_became_peered":"2021-10-08T19:32:45.162914+0000","last_unstale":"2021-10-08T19:36:36.959222+0000","last_undegraded":"2021-10-08T19:36:36.959222+0000","last_fullsized":"2021-10-08T19:36:36.959222+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'27","last_scrub_stamp":"2021-10-08T19:36:12.961130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:12.961130+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0063489530000000001,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":550,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":229,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.962782+0000","last_change":"2021-10-08T19:35:19.757453+0000","last_active":"2021-10-08T19:36:36.962782+0000","last_peered":"2021-10-08T19:36:36.962782+0000","last_clean":"2021-10-08T19:36:36.962782+0000","last_became_active":"2021-10-08T19:29:40.631290+0000","last_became_peered":"2021-10-08T19:29:40.631290+0000","last_unstale":"2021-10-08T19:36:36.962782+0000","last_undegraded":"2021-10-08T19:36:36.962782+0000","last_fullsized":"2021-10-08T19:36:36.962782+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:19.757349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:30:11.102934+0000","last_clean_scrub_stamp":"2021-10-08T19:35:19.757349+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001709061,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"88'9","reported_seq":550,"reported_epoch":387,"state":"active+clean","last_fresh":"2021-10-08T19:36:39.993378+0000","last_change":"2021-10-08T19:35:20.114948+0000","last_active":"2021-10-08T19:36:39.993378+0000","last_peered":"2021-10-08T19:36:39.993378+0000","last_clean":"2021-10-08T19:36:39.993378+0000","last_became_active":"2021-10-08T19:21:27.636432+0000","last_became_peered":"2021-10-08T19:21:27.636432+0000","last_unstale":"2021-10-08T19:36:39.993378+0000","last_undegraded":"2021-10-08T19:36:39.993378+0000","last_fullsized":"2021-10-08T19:36:39.993378+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'9","last_scrub_stamp":"2021-10-08T19:35:20.114852+0000","last_deep_scrub":"88'9","last_deep_scrub_stamp":"2021-10-08T19:23:00.048245+0000","last_clean_scrub_stamp":"2021-10-08T19:35:20.114852+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0019977990000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":374,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.963150+0000","last_change":"2021-10-08T19:34:50.829320+0000","last_active":"2021-10-08T19:36:36.963150+0000","last_peered":"2021-10-08T19:36:36.963150+0000","last_clean":"2021-10-08T19:36:36.963150+0000","last_became_active":"2021-10-08T19:28:40.137966+0000","last_became_peered":"2021-10-08T19:28:40.137966+0000","last_unstale":"2021-10-08T19:36:36.963150+0000","last_undegraded":"2021-10-08T19:36:36.963150+0000","last_fullsized":"2021-10-08T19:36:36.963150+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:50.829228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:34:50.829228+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.056194888999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.8","version":"70'5","reported_seq":171,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.957160+0000","last_change":"2021-10-08T19:36:08.760775+0000","last_active":"2021-10-08T19:36:36.957160+0000","last_peered":"2021-10-08T19:36:36.957160+0000","last_clean":"2021-10-08T19:36:36.957160+0000","last_became_active":"2021-10-08T19:29:40.639786+0000","last_became_peered":"2021-10-08T19:29:40.639786+0000","last_unstale":"2021-10-08T19:36:36.957160+0000","last_undegraded":"2021-10-08T19:36:36.957160+0000","last_fullsized":"2021-10-08T19:36:36.957160+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:36:08.760670+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2021-10-08T19:36:08.760670+0000","last_clean_scrub_stamp":"2021-10-08T19:36:08.760670+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011613982,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.0","version":"387'6582","reported_seq":6622,"reported_epoch":387,"state":"active+clean","last_fresh":"2021-10-08T19:36:43.624497+0000","last_change":"2021-10-08T19:35:16.783810+0000","last_active":"2021-10-08T19:36:43.624497+0000","last_peered":"2021-10-08T19:36:43.624497+0000","last_clean":"2021-10-08T19:36:43.624497+0000","last_became_active":"2021-10-08T19:35:16.783489+0000","last_became_peered":"2021-10-08T19:35:16.783489+0000","last_unstale":"2021-10-08T19:36:43.624497+0000","last_undegraded":"2021-10-08T19:36:43.624497+0000","last_fullsized":"2021-10-08T19:36:43.624497+0000","mapping_epoch":355,"log_start":"364'1800","ondisk_log_start":"364'1800","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:35:15.759693+0000","log_size":4782,"ondisk_log_size":4782,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":431357952,"num_objects":6582,"num_object_clones":0,"num_object_copies":19746,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6582,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6582,"num_write_kb":421248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4],"acting":[6,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"289'19","reported_seq":534,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.956016+0000","last_change":"2021-10-08T19:35:34.394900+0000","last_active":"2021-10-08T19:36:36.956016+0000","last_peered":"2021-10-08T19:36:36.956016+0000","last_clean":"2021-10-08T19:36:36.956016+0000","last_became_active":"2021-10-08T19:31:51.677509+0000","last_became_peered":"2021-10-08T19:31:51.677509+0000","last_unstale":"2021-10-08T19:36:36.956016+0000","last_undegraded":"2021-10-08T19:36:36.956016+0000","last_fullsized":"2021-10-08T19:36:36.956016+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:35:34.394820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:35:34.394820+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0061638159999999999,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":770,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":385,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.966293+0000","last_change":"2021-10-08T19:36:01.984163+0000","last_active":"2021-10-08T19:36:36.966293+0000","last_peered":"2021-10-08T19:36:36.966293+0000","last_clean":"2021-10-08T19:36:36.966293+0000","last_became_active":"2021-10-08T19:28:40.100691+0000","last_became_peered":"2021-10-08T19:28:40.100691+0000","last_unstale":"2021-10-08T19:36:36.966293+0000","last_undegraded":"2021-10-08T19:36:36.966293+0000","last_fullsized":"2021-10-08T19:36:36.966293+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:01.984068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:01.984068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0028891239999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":372,"reported_epoch":387,"state":"active+clean","last_fresh":"2021-10-08T19:36:41.852644+0000","last_change":"2021-10-08T19:36:41.852598+0000","last_active":"2021-10-08T19:36:41.852644+0000","last_peered":"2021-10-08T19:36:41.852644+0000","last_clean":"2021-10-08T19:36:41.852644+0000","last_became_active":"2021-10-08T19:24:25.105244+0000","last_became_peered":"2021-10-08T19:24:25.105244+0000","last_unstale":"2021-10-08T19:36:41.852644+0000","last_undegraded":"2021-10-08T19:36:41.852644+0000","last_fullsized":"2021-10-08T19:36:41.852644+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:41.852519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:36:41.852519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034719450000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":177,"reported_epoch":387,"state":"active+clean","last_fresh":"2021-10-08T19:36:43.015944+0000","last_change":"2021-10-08T19:36:43.015897+0000","last_active":"2021-10-08T19:36:43.015944+0000","last_peered":"2021-10-08T19:36:43.015944+0000","last_clean":"2021-10-08T19:36:43.015944+0000","last_became_active":"2021-10-08T19:29:40.638099+0000","last_became_peered":"2021-10-08T19:29:40.638099+0000","last_unstale":"2021-10-08T19:36:43.015944+0000","last_undegraded":"2021-10-08T19:36:43.015944+0000","last_fullsized":"2021-10-08T19:36:43.015944+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:43.015835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:17.422176+0000","last_clean_scrub_stamp":"2021-10-08T19:36:43.015835+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003426634,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":309,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.957455+0000","last_change":"2021-10-08T19:35:58.368794+0000","last_active":"2021-10-08T19:36:36.957455+0000","last_peered":"2021-10-08T19:36:36.957455+0000","last_clean":"2021-10-08T19:36:36.957455+0000","last_became_active":"2021-10-08T19:24:13.506602+0000","last_became_peered":"2021-10-08T19:24:13.506602+0000","last_unstale":"2021-10-08T19:36:36.957455+0000","last_undegraded":"2021-10-08T19:36:36.957455+0000","last_fullsized":"2021-10-08T19:36:36.957455+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:58.368720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:58.368720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.005639519,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"387'6610","reported_seq":6649,"reported_epoch":387,"state":"active+clean","last_fresh":"2021-10-08T19:36:43.675781+0000","last_change":"2021-10-08T19:35:17.125222+0000","last_active":"2021-10-08T19:36:43.675781+0000","last_peered":"2021-10-08T19:36:43.675781+0000","last_clean":"2021-10-08T19:36:43.675781+0000","last_became_active":"2021-10-08T19:35:17.124842+0000","last_became_peered":"2021-10-08T19:35:17.124842+0000","last_unstale":"2021-10-08T19:36:43.675781+0000","last_undegraded":"2021-10-08T19:36:43.675781+0000","last_fullsized":"2021-10-08T19:36:43.675781+0000","mapping_epoch":355,"log_start":"364'1800","ondisk_log_start":"364'1800","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:35:15.759693+0000","log_size":4810,"ondisk_log_size":4810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":433192960,"num_objects":6610,"num_object_clones":0,"num_object_copies":19830,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6610,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6610,"num_write_kb":423040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.4","version":"90'130","reported_seq":501,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.961361+0000","last_change":"2021-10-08T19:36:05.771481+0000","last_active":"2021-10-08T19:36:36.961361+0000","last_peered":"2021-10-08T19:36:36.961361+0000","last_clean":"2021-10-08T19:36:36.961361+0000","last_became_active":"2021-10-08T19:29:43.636733+0000","last_became_peered":"2021-10-08T19:29:43.636733+0000","last_unstale":"2021-10-08T19:36:36.961361+0000","last_undegraded":"2021-10-08T19:36:36.961361+0000","last_fullsized":"2021-10-08T19:36:36.961361+0000","mapping_epoch":239,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:36:05.771344+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:36:05.771344+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014695206000000001,"stat_sum":{"num_bytes":327680,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"238'13","reported_seq":264,"reported_epoch":387,"state":"active+clean","last_fresh":"2021-10-08T19:36:39.988946+0000","last_change":"2021-10-08T19:35:16.139228+0000","last_active":"2021-10-08T19:36:39.988946+0000","last_peered":"2021-10-08T19:36:39.988946+0000","last_clean":"2021-10-08T19:36:39.988946+0000","last_became_active":"2021-10-08T19:29:40.640248+0000","last_became_peered":"2021-10-08T19:29:40.640248+0000","last_unstale":"2021-10-08T19:36:39.988946+0000","last_undegraded":"2021-10-08T19:36:39.988946+0000","last_fullsized":"2021-10-08T19:36:39.988946+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"238'13","last_scrub_stamp":"2021-10-08T19:35:16.139154+0000","last_deep_scrub":"91'9","last_deep_scrub_stamp":"2021-10-08T19:23:32.329475+0000","last_clean_scrub_stamp":"2021-10-08T19:35:16.139154+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040429799999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"289'28","reported_seq":454,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.957563+0000","last_change":"2021-10-08T19:36:16.219370+0000","last_active":"2021-10-08T19:36:36.957563+0000","last_peered":"2021-10-08T19:36:36.957563+0000","last_clean":"2021-10-08T19:36:36.957563+0000","last_became_active":"2021-10-08T19:24:25.098743+0000","last_became_peered":"2021-10-08T19:24:25.098743+0000","last_unstale":"2021-10-08T19:36:36.957563+0000","last_undegraded":"2021-10-08T19:36:36.957563+0000","last_fullsized":"2021-10-08T19:36:36.957563+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'28","last_scrub_stamp":"2021-10-08T19:36:16.219258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:16.219258+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0095071070000000008,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":42,"num_read_kb":35,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":307,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.962376+0000","last_change":"2021-10-08T19:36:12.643738+0000","last_active":"2021-10-08T19:36:36.962376+0000","last_peered":"2021-10-08T19:36:36.962376+0000","last_clean":"2021-10-08T19:36:36.962376+0000","last_became_active":"2021-10-08T19:24:25.094364+0000","last_became_peered":"2021-10-08T19:24:25.094364+0000","last_unstale":"2021-10-08T19:36:36.962376+0000","last_undegraded":"2021-10-08T19:36:36.962376+0000","last_fullsized":"2021-10-08T19:36:36.962376+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:12.643664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:12.643664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0025959149999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":373,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.968758+0000","last_change":"2021-10-08T19:34:57.935414+0000","last_active":"2021-10-08T19:36:36.968758+0000","last_peered":"2021-10-08T19:36:36.968758+0000","last_clean":"2021-10-08T19:36:36.968758+0000","last_became_active":"2021-10-08T19:24:25.094848+0000","last_became_peered":"2021-10-08T19:24:25.094848+0000","last_unstale":"2021-10-08T19:36:36.968758+0000","last_undegraded":"2021-10-08T19:36:36.968758+0000","last_fullsized":"2021-10-08T19:36:36.968758+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:57.935312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:34:57.935312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.031026839000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":332,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.961210+0000","last_change":"2021-10-08T19:34:44.965618+0000","last_active":"2021-10-08T19:36:36.961210+0000","last_peered":"2021-10-08T19:36:36.961210+0000","last_clean":"2021-10-08T19:36:36.961210+0000","last_became_active":"2021-10-08T19:28:40.132751+0000","last_became_peered":"2021-10-08T19:28:40.132751+0000","last_unstale":"2021-10-08T19:36:36.961210+0000","last_undegraded":"2021-10-08T19:36:36.961210+0000","last_fullsized":"2021-10-08T19:36:36.961210+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:44.965505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:44.965505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.020193916999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.e","version":"387'6631","reported_seq":6671,"reported_epoch":387,"state":"active+clean","last_fresh":"2021-10-08T19:36:43.411331+0000","last_change":"2021-10-08T19:35:16.776363+0000","last_active":"2021-10-08T19:36:43.411331+0000","last_peered":"2021-10-08T19:36:43.411331+0000","last_clean":"2021-10-08T19:36:43.411331+0000","last_became_active":"2021-10-08T19:35:16.776024+0000","last_became_peered":"2021-10-08T19:35:16.776024+0000","last_unstale":"2021-10-08T19:36:43.411331+0000","last_undegraded":"2021-10-08T19:36:43.411331+0000","last_fullsized":"2021-10-08T19:36:43.411331+0000","mapping_epoch":355,"log_start":"365'2500","ondisk_log_start":"365'2500","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:35:15.759693+0000","log_size":4131,"ondisk_log_size":4131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":434569216,"num_objects":6631,"num_object_clones":0,"num_object_copies":19893,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6631,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6631,"num_write_kb":424384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"90'130","reported_seq":535,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.955825+0000","last_change":"2021-10-08T19:34:59.306555+0000","last_active":"2021-10-08T19:36:36.955825+0000","last_peered":"2021-10-08T19:36:36.955825+0000","last_clean":"2021-10-08T19:36:36.955825+0000","last_became_active":"2021-10-08T19:27:26.590651+0000","last_became_peered":"2021-10-08T19:27:26.590651+0000","last_unstale":"2021-10-08T19:36:36.955825+0000","last_undegraded":"2021-10-08T19:36:36.955825+0000","last_fullsized":"2021-10-08T19:36:36.955825+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:34:59.306414+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:32:14.582883+0000","last_clean_scrub_stamp":"2021-10-08T19:34:59.306414+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0017696229999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":378,"reported_epoch":387,"state":"active+clean","last_fresh":"2021-10-08T19:36:42.480603+0000","last_change":"2021-10-08T19:36:42.480557+0000","last_active":"2021-10-08T19:36:42.480603+0000","last_peered":"2021-10-08T19:36:42.480603+0000","last_clean":"2021-10-08T19:36:42.480603+0000","last_became_active":"2021-10-08T19:29:40.639405+0000","last_became_peered":"2021-10-08T19:29:40.639405+0000","last_unstale":"2021-10-08T19:36:42.480603+0000","last_undegraded":"2021-10-08T19:36:42.480603+0000","last_fullsized":"2021-10-08T19:36:42.480603+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:42.480429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:36:42.480429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0070932640000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"289'30","reported_seq":207,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.957344+0000","last_change":"2021-10-08T19:34:06.085387+0000","last_active":"2021-10-08T19:36:36.957344+0000","last_peered":"2021-10-08T19:36:36.957344+0000","last_clean":"2021-10-08T19:36:36.957344+0000","last_became_active":"2021-10-08T19:29:40.635007+0000","last_became_peered":"2021-10-08T19:29:40.635007+0000","last_unstale":"2021-10-08T19:36:36.957344+0000","last_undegraded":"2021-10-08T19:36:36.957344+0000","last_fullsized":"2021-10-08T19:36:36.957344+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'30","last_scrub_stamp":"2021-10-08T19:34:06.085282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:34:06.085282+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.015398577,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":51,"num_read_kb":39,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":205,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.963889+0000","last_change":"2021-10-08T19:34:50.752974+0000","last_active":"2021-10-08T19:36:36.963889+0000","last_peered":"2021-10-08T19:36:36.963889+0000","last_clean":"2021-10-08T19:36:36.963889+0000","last_became_active":"2021-10-08T19:28:40.141714+0000","last_became_peered":"2021-10-08T19:28:40.141714+0000","last_unstale":"2021-10-08T19:36:36.963889+0000","last_undegraded":"2021-10-08T19:36:36.963889+0000","last_fullsized":"2021-10-08T19:36:36.963889+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:50.752866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:07.710367+0000","last_clean_scrub_stamp":"2021-10-08T19:34:50.752866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013659034,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":370,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.957716+0000","last_change":"2021-10-08T19:35:31.347742+0000","last_active":"2021-10-08T19:36:36.957716+0000","last_peered":"2021-10-08T19:36:36.957716+0000","last_clean":"2021-10-08T19:36:36.957716+0000","last_became_active":"2021-10-08T19:29:40.638253+0000","last_became_peered":"2021-10-08T19:29:40.638253+0000","last_unstale":"2021-10-08T19:36:36.957716+0000","last_undegraded":"2021-10-08T19:36:36.957716+0000","last_fullsized":"2021-10-08T19:36:36.957716+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:31.347606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:35:31.347606+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0053338960000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":171,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.961464+0000","last_change":"2021-10-08T19:36:10.804434+0000","last_active":"2021-10-08T19:36:36.961464+0000","last_peered":"2021-10-08T19:36:36.961464+0000","last_clean":"2021-10-08T19:36:36.961464+0000","last_became_active":"2021-10-08T19:29:40.634579+0000","last_became_peered":"2021-10-08T19:29:40.634579+0000","last_unstale":"2021-10-08T19:36:36.961464+0000","last_undegraded":"2021-10-08T19:36:36.961464+0000","last_fullsized":"2021-10-08T19:36:36.961464+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:10.804325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:10.804325+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0063916950000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.d","version":"387'6533","reported_seq":6573,"reported_epoch":387,"state":"active+clean","last_fresh":"2021-10-08T19:36:43.634476+0000","last_change":"2021-10-08T19:35:16.783067+0000","last_active":"2021-10-08T19:36:43.634476+0000","last_peered":"2021-10-08T19:36:43.634476+0000","last_clean":"2021-10-08T19:36:43.634476+0000","last_became_active":"2021-10-08T19:35:16.782695+0000","last_became_peered":"2021-10-08T19:35:16.782695+0000","last_unstale":"2021-10-08T19:36:43.634476+0000","last_undegraded":"2021-10-08T19:36:43.634476+0000","last_fullsized":"2021-10-08T19:36:43.634476+0000","mapping_epoch":355,"log_start":"364'1700","ondisk_log_start":"364'1700","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:35:15.759693+0000","log_size":4833,"ondisk_log_size":4833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":428146688,"num_objects":6533,"num_object_clones":0,"num_object_copies":19599,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6533,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6533,"num_write_kb":418112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"90'130","reported_seq":476,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.962095+0000","last_change":"2021-10-08T19:36:01.675001+0000","last_active":"2021-10-08T19:36:36.962095+0000","last_peered":"2021-10-08T19:36:36.962095+0000","last_clean":"2021-10-08T19:36:36.962095+0000","last_became_active":"2021-10-08T19:30:00.643797+0000","last_became_peered":"2021-10-08T19:30:00.643797+0000","last_unstale":"2021-10-08T19:36:36.962095+0000","last_undegraded":"2021-10-08T19:36:36.962095+0000","last_fullsized":"2021-10-08T19:36:36.962095+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:36:01.674904+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:36:01.674904+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.072145927999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":313,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.962363+0000","last_change":"2021-10-08T19:36:00.599933+0000","last_active":"2021-10-08T19:36:36.962363+0000","last_peered":"2021-10-08T19:36:36.962363+0000","last_clean":"2021-10-08T19:36:36.962363+0000","last_became_active":"2021-10-08T19:24:25.095389+0000","last_became_peered":"2021-10-08T19:24:25.095389+0000","last_unstale":"2021-10-08T19:36:36.962363+0000","last_undegraded":"2021-10-08T19:36:36.962363+0000","last_fullsized":"2021-10-08T19:36:36.962363+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:00.599845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:36:00.599845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0065529969999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"289'29","reported_seq":414,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.962363+0000","last_change":"2021-10-08T19:36:05.122735+0000","last_active":"2021-10-08T19:36:36.962363+0000","last_peered":"2021-10-08T19:36:36.962363+0000","last_clean":"2021-10-08T19:36:36.962363+0000","last_became_active":"2021-10-08T19:21:25.741812+0000","last_became_peered":"2021-10-08T19:21:25.741812+0000","last_unstale":"2021-10-08T19:36:36.962363+0000","last_undegraded":"2021-10-08T19:36:36.962363+0000","last_fullsized":"2021-10-08T19:36:36.962363+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'29","last_scrub_stamp":"2021-10-08T19:36:05.122593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:05.122593+0000","log_size":29,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0069217020000000001,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":54,"num_read_kb":40,"num_write":32,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"328'2","reported_seq":375,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.966833+0000","last_change":"2021-10-08T19:36:03.954708+0000","last_active":"2021-10-08T19:36:36.966833+0000","last_peered":"2021-10-08T19:36:36.966833+0000","last_clean":"2021-10-08T19:36:36.966833+0000","last_became_active":"2021-10-08T19:21:23.604258+0000","last_became_peered":"2021-10-08T19:21:23.604258+0000","last_unstale":"2021-10-08T19:36:36.966833+0000","last_undegraded":"2021-10-08T19:36:36.966833+0000","last_fullsized":"2021-10-08T19:36:36.966833+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"328'2","last_scrub_stamp":"2021-10-08T19:36:03.954613+0000","last_deep_scrub":"328'2","last_deep_scrub_stamp":"2021-10-08T19:33:29.990395+0000","last_clean_scrub_stamp":"2021-10-08T19:36:03.954613+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0074631530000000001,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":205,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.962581+0000","last_change":"2021-10-08T19:34:56.791831+0000","last_active":"2021-10-08T19:36:36.962581+0000","last_peered":"2021-10-08T19:36:36.962581+0000","last_clean":"2021-10-08T19:36:36.962581+0000","last_became_active":"2021-10-08T19:28:40.140876+0000","last_became_peered":"2021-10-08T19:28:40.140876+0000","last_unstale":"2021-10-08T19:36:36.962581+0000","last_undegraded":"2021-10-08T19:36:36.962581+0000","last_fullsized":"2021-10-08T19:36:36.962581+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:56.791734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:34:56.791734+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.031194143000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"70'5","reported_seq":211,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.963134+0000","last_change":"2021-10-08T19:35:30.660394+0000","last_active":"2021-10-08T19:36:36.963134+0000","last_peered":"2021-10-08T19:36:36.963134+0000","last_clean":"2021-10-08T19:36:36.963134+0000","last_became_active":"2021-10-08T19:28:40.150503+0000","last_became_peered":"2021-10-08T19:28:40.150503+0000","last_unstale":"2021-10-08T19:36:36.963134+0000","last_undegraded":"2021-10-08T19:36:36.963134+0000","last_fullsized":"2021-10-08T19:36:36.963134+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:35:30.660285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:30.660285+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0035933829999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.8","version":"387'6550","reported_seq":6590,"reported_epoch":387,"state":"active+clean","last_fresh":"2021-10-08T19:36:43.395648+0000","last_change":"2021-10-08T19:35:16.778383+0000","last_active":"2021-10-08T19:36:43.395648+0000","last_peered":"2021-10-08T19:36:43.395648+0000","last_clean":"2021-10-08T19:36:43.395648+0000","last_became_active":"2021-10-08T19:35:16.778100+0000","last_became_peered":"2021-10-08T19:35:16.778100+0000","last_unstale":"2021-10-08T19:36:43.395648+0000","last_undegraded":"2021-10-08T19:36:43.395648+0000","last_fullsized":"2021-10-08T19:36:43.395648+0000","mapping_epoch":355,"log_start":"364'2000","ondisk_log_start":"364'2000","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:35:15.759693+0000","log_size":4550,"ondisk_log_size":4550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":429260800,"num_objects":6550,"num_object_clones":0,"num_object_copies":19650,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6550,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6550,"num_write_kb":419200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7],"acting":[0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"90'130","reported_seq":512,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.965048+0000","last_change":"2021-10-08T19:36:09.840616+0000","last_active":"2021-10-08T19:36:36.965048+0000","last_peered":"2021-10-08T19:36:36.965048+0000","last_clean":"2021-10-08T19:36:36.965048+0000","last_became_active":"2021-10-08T19:28:43.178371+0000","last_became_peered":"2021-10-08T19:28:43.178371+0000","last_unstale":"2021-10-08T19:36:36.965048+0000","last_undegraded":"2021-10-08T19:36:36.965048+0000","last_fullsized":"2021-10-08T19:36:36.965048+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:36:09.840508+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:34:13.653248+0000","last_clean_scrub_stamp":"2021-10-08T19:36:09.840508+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0067520610000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":119,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.962813+0000","last_change":"2021-10-08T19:33:21.590512+0000","last_active":"2021-10-08T19:36:36.962813+0000","last_peered":"2021-10-08T19:36:36.962813+0000","last_clean":"2021-10-08T19:36:36.962813+0000","last_became_active":"2021-10-08T19:31:22.783759+0000","last_became_peered":"2021-10-08T19:31:22.783759+0000","last_unstale":"2021-10-08T19:36:36.962813+0000","last_undegraded":"2021-10-08T19:36:36.962813+0000","last_fullsized":"2021-10-08T19:36:36.962813+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:33:21.590400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:33:21.590400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.022083749,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"289'24","reported_seq":466,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.961371+0000","last_change":"2021-10-08T19:36:06.098172+0000","last_active":"2021-10-08T19:36:36.961371+0000","last_peered":"2021-10-08T19:36:36.961371+0000","last_clean":"2021-10-08T19:36:36.961371+0000","last_became_active":"2021-10-08T19:32:45.154743+0000","last_became_peered":"2021-10-08T19:32:45.154743+0000","last_unstale":"2021-10-08T19:36:36.961371+0000","last_undegraded":"2021-10-08T19:36:36.961371+0000","last_fullsized":"2021-10-08T19:36:36.961371+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'24","last_scrub_stamp":"2021-10-08T19:36:06.098078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:06.098078+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0071628120000000002,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":30,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":354,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.957838+0000","last_change":"2021-10-08T19:36:08.078394+0000","last_active":"2021-10-08T19:36:36.957838+0000","last_peered":"2021-10-08T19:36:36.957838+0000","last_clean":"2021-10-08T19:36:36.957838+0000","last_became_active":"2021-10-08T19:28:40.140231+0000","last_became_peered":"2021-10-08T19:28:40.140231+0000","last_unstale":"2021-10-08T19:36:36.957838+0000","last_undegraded":"2021-10-08T19:36:36.957838+0000","last_fullsized":"2021-10-08T19:36:36.957838+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:08.078324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:32.922694+0000","last_clean_scrub_stamp":"2021-10-08T19:36:08.078324+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020685959999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":395,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.961236+0000","last_change":"2021-10-08T19:34:58.928837+0000","last_active":"2021-10-08T19:36:36.961236+0000","last_peered":"2021-10-08T19:36:36.961236+0000","last_clean":"2021-10-08T19:36:36.961236+0000","last_became_active":"2021-10-08T19:29:40.632010+0000","last_became_peered":"2021-10-08T19:29:40.632010+0000","last_unstale":"2021-10-08T19:36:36.961236+0000","last_undegraded":"2021-10-08T19:36:36.961236+0000","last_fullsized":"2021-10-08T19:36:36.961236+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:58.928758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:58.928758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0012564410000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":113,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.962840+0000","last_change":"2021-10-08T19:36:11.789864+0000","last_active":"2021-10-08T19:36:36.962840+0000","last_peered":"2021-10-08T19:36:36.962840+0000","last_clean":"2021-10-08T19:36:36.962840+0000","last_became_active":"2021-10-08T19:31:51.673821+0000","last_became_peered":"2021-10-08T19:31:51.673821+0000","last_unstale":"2021-10-08T19:36:36.962840+0000","last_undegraded":"2021-10-08T19:36:36.962840+0000","last_fullsized":"2021-10-08T19:36:36.962840+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:11.789757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:21.644827+0000","last_clean_scrub_stamp":"2021-10-08T19:36:11.789757+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0099411570000000008,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"387'6467","reported_seq":6507,"reported_epoch":387,"state":"active+clean","last_fresh":"2021-10-08T19:36:43.647662+0000","last_change":"2021-10-08T19:35:16.785023+0000","last_active":"2021-10-08T19:36:43.647662+0000","last_peered":"2021-10-08T19:36:43.647662+0000","last_clean":"2021-10-08T19:36:43.647662+0000","last_became_active":"2021-10-08T19:35:16.784654+0000","last_became_peered":"2021-10-08T19:35:16.784654+0000","last_unstale":"2021-10-08T19:36:43.647662+0000","last_undegraded":"2021-10-08T19:36:43.647662+0000","last_fullsized":"2021-10-08T19:36:43.647662+0000","mapping_epoch":355,"log_start":"364'1700","ondisk_log_start":"364'1700","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:35:15.759693+0000","log_size":4767,"ondisk_log_size":4767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":423821312,"num_objects":6467,"num_object_clones":0,"num_object_copies":19401,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6467,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6467,"num_write_kb":413888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0],"acting":[6,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":355,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.968074+0000","last_change":"2021-10-08T19:34:54.892507+0000","last_active":"2021-10-08T19:36:36.968074+0000","last_peered":"2021-10-08T19:36:36.968074+0000","last_clean":"2021-10-08T19:36:36.968074+0000","last_became_active":"2021-10-08T19:21:27.636086+0000","last_became_peered":"2021-10-08T19:21:27.636086+0000","last_unstale":"2021-10-08T19:36:36.968074+0000","last_undegraded":"2021-10-08T19:36:36.968074+0000","last_fullsized":"2021-10-08T19:36:36.968074+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:54.892389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:34:54.892389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0079512119999999992,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"289'26","reported_seq":341,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.962031+0000","last_change":"2021-10-08T19:34:58.535327+0000","last_active":"2021-10-08T19:36:36.962031+0000","last_peered":"2021-10-08T19:36:36.962031+0000","last_clean":"2021-10-08T19:36:36.962031+0000","last_became_active":"2021-10-08T19:24:25.100384+0000","last_became_peered":"2021-10-08T19:24:25.100384+0000","last_unstale":"2021-10-08T19:36:36.962031+0000","last_undegraded":"2021-10-08T19:36:36.962031+0000","last_fullsized":"2021-10-08T19:36:36.962031+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'26","last_scrub_stamp":"2021-10-08T19:34:58.535228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:34:58.535228+0000","log_size":26,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020755830000000002,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":42,"num_read_kb":32,"num_write":25,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"90'130","reported_seq":674,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.966209+0000","last_change":"2021-10-08T19:36:09.855513+0000","last_active":"2021-10-08T19:36:36.966209+0000","last_peered":"2021-10-08T19:36:36.966209+0000","last_clean":"2021-10-08T19:36:36.966209+0000","last_became_active":"2021-10-08T19:27:22.607289+0000","last_became_peered":"2021-10-08T19:27:22.607289+0000","last_unstale":"2021-10-08T19:36:36.966209+0000","last_undegraded":"2021-10-08T19:36:36.966209+0000","last_fullsized":"2021-10-08T19:36:36.966209+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:36:09.855393+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:36:09.855393+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0065522590000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":358,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.964052+0000","last_change":"2021-10-08T19:35:31.652594+0000","last_active":"2021-10-08T19:36:36.964052+0000","last_peered":"2021-10-08T19:36:36.964052+0000","last_clean":"2021-10-08T19:36:36.964052+0000","last_became_active":"2021-10-08T19:21:23.599143+0000","last_became_peered":"2021-10-08T19:21:23.599143+0000","last_unstale":"2021-10-08T19:36:36.964052+0000","last_undegraded":"2021-10-08T19:36:36.964052+0000","last_fullsized":"2021-10-08T19:36:36.964052+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:31.652494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:31.652494+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0075080879999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":171,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.958228+0000","last_change":"2021-10-08T19:35:33.861695+0000","last_active":"2021-10-08T19:36:36.958228+0000","last_peered":"2021-10-08T19:36:36.958228+0000","last_clean":"2021-10-08T19:36:36.958228+0000","last_became_active":"2021-10-08T19:29:40.638774+0000","last_became_peered":"2021-10-08T19:29:40.638774+0000","last_unstale":"2021-10-08T19:36:36.958228+0000","last_undegraded":"2021-10-08T19:36:36.958228+0000","last_fullsized":"2021-10-08T19:36:36.958228+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:33.861554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:33.861554+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011946132999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":370,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.963143+0000","last_change":"2021-10-08T19:35:24.690698+0000","last_active":"2021-10-08T19:36:36.963143+0000","last_peered":"2021-10-08T19:36:36.963143+0000","last_clean":"2021-10-08T19:36:36.963143+0000","last_became_active":"2021-10-08T19:29:40.627256+0000","last_became_peered":"2021-10-08T19:29:40.627256+0000","last_unstale":"2021-10-08T19:36:36.963143+0000","last_undegraded":"2021-10-08T19:36:36.963143+0000","last_fullsized":"2021-10-08T19:36:36.963143+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:24.690591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:32:15.872860+0000","last_clean_scrub_stamp":"2021-10-08T19:35:24.690591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.065857132999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"387'6624","reported_seq":6664,"reported_epoch":387,"state":"active+clean","last_fresh":"2021-10-08T19:36:43.612814+0000","last_change":"2021-10-08T19:35:16.780954+0000","last_active":"2021-10-08T19:36:43.612814+0000","last_peered":"2021-10-08T19:36:43.612814+0000","last_clean":"2021-10-08T19:36:43.612814+0000","last_became_active":"2021-10-08T19:35:16.780624+0000","last_became_peered":"2021-10-08T19:35:16.780624+0000","last_unstale":"2021-10-08T19:36:43.612814+0000","last_undegraded":"2021-10-08T19:36:43.612814+0000","last_fullsized":"2021-10-08T19:36:43.612814+0000","mapping_epoch":355,"log_start":"364'1900","ondisk_log_start":"364'1900","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:35:15.759693+0000","log_size":4724,"ondisk_log_size":4724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":434110464,"num_objects":6624,"num_object_clones":0,"num_object_copies":19872,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6624,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6624,"num_write_kb":423936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"90'130","reported_seq":682,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.965960+0000","last_change":"2021-10-08T19:36:11.798375+0000","last_active":"2021-10-08T19:36:36.965960+0000","last_peered":"2021-10-08T19:36:36.965960+0000","last_clean":"2021-10-08T19:36:36.965960+0000","last_became_active":"2021-10-08T19:27:26.591250+0000","last_became_peered":"2021-10-08T19:27:26.591250+0000","last_unstale":"2021-10-08T19:36:36.965960+0000","last_undegraded":"2021-10-08T19:36:36.965960+0000","last_fullsized":"2021-10-08T19:36:36.965960+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:36:11.798245+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:36:11.798245+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013110805,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":365,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.958279+0000","last_change":"2021-10-08T19:35:23.047013+0000","last_active":"2021-10-08T19:36:36.958279+0000","last_peered":"2021-10-08T19:36:36.958279+0000","last_clean":"2021-10-08T19:36:36.958279+0000","last_became_active":"2021-10-08T19:21:27.637875+0000","last_became_peered":"2021-10-08T19:21:27.637875+0000","last_unstale":"2021-10-08T19:36:36.958279+0000","last_undegraded":"2021-10-08T19:36:36.958279+0000","last_fullsized":"2021-10-08T19:36:36.958279+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:23.046871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:20.092069+0000","last_clean_scrub_stamp":"2021-10-08T19:35:23.046871+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0044452409999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"289'17","reported_seq":119,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.963978+0000","last_change":"2021-10-08T19:35:22.787177+0000","last_active":"2021-10-08T19:36:36.963978+0000","last_peered":"2021-10-08T19:36:36.963978+0000","last_clean":"2021-10-08T19:36:36.963978+0000","last_became_active":"2021-10-08T19:31:51.674965+0000","last_became_peered":"2021-10-08T19:31:51.674965+0000","last_unstale":"2021-10-08T19:36:36.963978+0000","last_undegraded":"2021-10-08T19:36:36.963978+0000","last_fullsized":"2021-10-08T19:36:36.963978+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'17","last_scrub_stamp":"2021-10-08T19:35:22.787087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:35:22.787087+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.004183717,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":23,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":990,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":385,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.958325+0000","last_change":"2021-10-08T19:35:18.015926+0000","last_active":"2021-10-08T19:36:36.958325+0000","last_peered":"2021-10-08T19:36:36.958325+0000","last_clean":"2021-10-08T19:36:36.958325+0000","last_became_active":"2021-10-08T19:29:40.619746+0000","last_became_peered":"2021-10-08T19:29:40.619746+0000","last_unstale":"2021-10-08T19:36:36.958325+0000","last_undegraded":"2021-10-08T19:36:36.958325+0000","last_fullsized":"2021-10-08T19:36:36.958325+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:18.015850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:18.015850+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0013167389999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"70'5","reported_seq":209,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.965952+0000","last_change":"2021-10-08T19:36:16.753049+0000","last_active":"2021-10-08T19:36:36.965952+0000","last_peered":"2021-10-08T19:36:36.965952+0000","last_clean":"2021-10-08T19:36:36.965952+0000","last_became_active":"2021-10-08T19:28:40.148054+0000","last_became_peered":"2021-10-08T19:28:40.148054+0000","last_unstale":"2021-10-08T19:36:36.965952+0000","last_undegraded":"2021-10-08T19:36:36.965952+0000","last_fullsized":"2021-10-08T19:36:36.965952+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:34:18.630378+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2021-10-08T19:34:18.630378+0000","last_clean_scrub_stamp":"2021-10-08T19:34:18.630378+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0054668570000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":389,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.966750+0000","last_change":"2021-10-08T19:35:30.916430+0000","last_active":"2021-10-08T19:36:36.966750+0000","last_peered":"2021-10-08T19:36:36.966750+0000","last_clean":"2021-10-08T19:36:36.966750+0000","last_became_active":"2021-10-08T19:29:40.652528+0000","last_became_peered":"2021-10-08T19:29:40.652528+0000","last_unstale":"2021-10-08T19:36:36.966750+0000","last_undegraded":"2021-10-08T19:36:36.966750+0000","last_fullsized":"2021-10-08T19:36:36.966750+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:30.916326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:35:30.916326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.048993430999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.a","version":"387'6616","reported_seq":6656,"reported_epoch":387,"state":"active+clean","last_fresh":"2021-10-08T19:36:43.643592+0000","last_change":"2021-10-08T19:35:16.783039+0000","last_active":"2021-10-08T19:36:43.643592+0000","last_peered":"2021-10-08T19:36:43.643592+0000","last_clean":"2021-10-08T19:36:43.643592+0000","last_became_active":"2021-10-08T19:35:16.782677+0000","last_became_peered":"2021-10-08T19:35:16.782677+0000","last_unstale":"2021-10-08T19:36:43.643592+0000","last_undegraded":"2021-10-08T19:36:43.643592+0000","last_fullsized":"2021-10-08T19:36:43.643592+0000","mapping_epoch":355,"log_start":"364'1800","ondisk_log_start":"364'1800","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:35:15.759693+0000","log_size":4816,"ondisk_log_size":4816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":433586176,"num_objects":6616,"num_object_clones":0,"num_object_copies":19848,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6616,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6616,"num_write_kb":423424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"90'130","reported_seq":534,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.962645+0000","last_change":"2021-10-08T19:35:19.581334+0000","last_active":"2021-10-08T19:36:36.962645+0000","last_peered":"2021-10-08T19:36:36.962645+0000","last_clean":"2021-10-08T19:36:36.962645+0000","last_became_active":"2021-10-08T19:27:26.591993+0000","last_became_peered":"2021-10-08T19:27:26.591993+0000","last_unstale":"2021-10-08T19:36:36.962645+0000","last_undegraded":"2021-10-08T19:36:36.962645+0000","last_fullsized":"2021-10-08T19:36:36.962645+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:35:19.581220+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:35:19.581220+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001876345,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,2],"acting":[5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":377,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.962156+0000","last_change":"2021-10-08T19:35:57.184673+0000","last_active":"2021-10-08T19:36:36.962156+0000","last_peered":"2021-10-08T19:36:36.962156+0000","last_clean":"2021-10-08T19:36:36.962156+0000","last_became_active":"2021-10-08T19:28:40.133414+0000","last_became_peered":"2021-10-08T19:28:40.133414+0000","last_unstale":"2021-10-08T19:36:36.962156+0000","last_undegraded":"2021-10-08T19:36:36.962156+0000","last_fullsized":"2021-10-08T19:36:36.962156+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:57.184578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:35:57.184578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014526842,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"289'44","reported_seq":411,"reported_epoch":387,"state":"active+clean","last_fresh":"2021-10-08T19:36:40.001156+0000","last_change":"2021-10-08T19:35:32.703833+0000","last_active":"2021-10-08T19:36:40.001156+0000","last_peered":"2021-10-08T19:36:40.001156+0000","last_clean":"2021-10-08T19:36:40.001156+0000","last_became_active":"2021-10-08T19:29:40.626138+0000","last_became_peered":"2021-10-08T19:29:40.626138+0000","last_unstale":"2021-10-08T19:36:40.001156+0000","last_undegraded":"2021-10-08T19:36:40.001156+0000","last_fullsized":"2021-10-08T19:36:40.001156+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'44","last_scrub_stamp":"2021-10-08T19:35:32.703721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:35:32.703721+0000","log_size":44,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0064438680000000002,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":65,"num_read_kb":50,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":1432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":394,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.963058+0000","last_change":"2021-10-08T19:35:23.647578+0000","last_active":"2021-10-08T19:36:36.963058+0000","last_peered":"2021-10-08T19:36:36.963058+0000","last_clean":"2021-10-08T19:36:36.963058+0000","last_became_active":"2021-10-08T19:28:40.137919+0000","last_became_peered":"2021-10-08T19:28:40.137919+0000","last_unstale":"2021-10-08T19:36:36.963058+0000","last_undegraded":"2021-10-08T19:36:36.963058+0000","last_fullsized":"2021-10-08T19:36:36.963058+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:23.647485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:23.647485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002822181,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":173,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.958760+0000","last_change":"2021-10-08T19:34:45.208220+0000","last_active":"2021-10-08T19:36:36.958760+0000","last_peered":"2021-10-08T19:36:36.958760+0000","last_clean":"2021-10-08T19:36:36.958760+0000","last_became_active":"2021-10-08T19:29:40.637371+0000","last_became_peered":"2021-10-08T19:29:40.637371+0000","last_unstale":"2021-10-08T19:36:36.958760+0000","last_undegraded":"2021-10-08T19:36:36.958760+0000","last_fullsized":"2021-10-08T19:36:36.958760+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:45.208127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:34:45.208127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.01258626,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":320,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.955724+0000","last_change":"2021-10-08T19:36:09.181971+0000","last_active":"2021-10-08T19:36:36.955724+0000","last_peered":"2021-10-08T19:36:36.955724+0000","last_clean":"2021-10-08T19:36:36.955724+0000","last_became_active":"2021-10-08T19:25:14.550690+0000","last_became_peered":"2021-10-08T19:25:14.550690+0000","last_unstale":"2021-10-08T19:36:36.955724+0000","last_undegraded":"2021-10-08T19:36:36.955724+0000","last_fullsized":"2021-10-08T19:36:36.955724+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:09.181866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:36:09.181866+0000","last_clean_scrub_stamp":"2021-10-08T19:36:09.181866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0070630550000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"387'6711","reported_seq":6751,"reported_epoch":387,"state":"active+clean","last_fresh":"2021-10-08T19:36:43.705916+0000","last_change":"2021-10-08T19:35:16.778370+0000","last_active":"2021-10-08T19:36:43.705916+0000","last_peered":"2021-10-08T19:36:43.705916+0000","last_clean":"2021-10-08T19:36:43.705916+0000","last_became_active":"2021-10-08T19:35:16.778062+0000","last_became_peered":"2021-10-08T19:35:16.778062+0000","last_unstale":"2021-10-08T19:36:43.705916+0000","last_undegraded":"2021-10-08T19:36:43.705916+0000","last_fullsized":"2021-10-08T19:36:43.705916+0000","mapping_epoch":355,"log_start":"366'2700","ondisk_log_start":"366'2700","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:35:15.759693+0000","log_size":4011,"ondisk_log_size":4011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":439812096,"num_objects":6711,"num_object_clones":0,"num_object_copies":20133,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6711,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6711,"num_write_kb":429504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.7","version":"90'130","reported_seq":636,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.962133+0000","last_change":"2021-10-08T19:35:29.542745+0000","last_active":"2021-10-08T19:36:36.962133+0000","last_peered":"2021-10-08T19:36:36.962133+0000","last_clean":"2021-10-08T19:36:36.962133+0000","last_became_active":"2021-10-08T19:29:43.636820+0000","last_became_peered":"2021-10-08T19:29:43.636820+0000","last_unstale":"2021-10-08T19:36:36.962133+0000","last_undegraded":"2021-10-08T19:36:36.962133+0000","last_fullsized":"2021-10-08T19:36:36.962133+0000","mapping_epoch":239,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:35:29.542673+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:35:29.542673+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002657024,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"114'10","reported_seq":576,"reported_epoch":387,"state":"active+clean","last_fresh":"2021-10-08T19:36:39.994417+0000","last_change":"2021-10-08T19:34:03.864493+0000","last_active":"2021-10-08T19:36:39.994417+0000","last_peered":"2021-10-08T19:36:39.994417+0000","last_clean":"2021-10-08T19:36:39.994417+0000","last_became_active":"2021-10-08T19:24:25.106695+0000","last_became_peered":"2021-10-08T19:24:25.106695+0000","last_unstale":"2021-10-08T19:36:39.994417+0000","last_undegraded":"2021-10-08T19:36:39.994417+0000","last_fullsized":"2021-10-08T19:36:39.994417+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'10","last_scrub_stamp":"2021-10-08T19:34:03.864384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:34:03.864384+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.007036924,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"289'20","reported_seq":119,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.966004+0000","last_change":"2021-10-08T19:36:04.773566+0000","last_active":"2021-10-08T19:36:36.966004+0000","last_peered":"2021-10-08T19:36:36.966004+0000","last_clean":"2021-10-08T19:36:36.966004+0000","last_became_active":"2021-10-08T19:31:51.675569+0000","last_became_peered":"2021-10-08T19:31:51.675569+0000","last_unstale":"2021-10-08T19:36:36.966004+0000","last_undegraded":"2021-10-08T19:36:36.966004+0000","last_fullsized":"2021-10-08T19:36:36.966004+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'20","last_scrub_stamp":"2021-10-08T19:36:04.773449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:04.773449+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0045168379999999996,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":23,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":211,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.962920+0000","last_change":"2021-10-08T19:35:16.702516+0000","last_active":"2021-10-08T19:36:36.962920+0000","last_peered":"2021-10-08T19:36:36.962920+0000","last_clean":"2021-10-08T19:36:36.962920+0000","last_became_active":"2021-10-08T19:28:40.141737+0000","last_became_peered":"2021-10-08T19:28:40.141737+0000","last_unstale":"2021-10-08T19:36:36.962920+0000","last_undegraded":"2021-10-08T19:36:36.962920+0000","last_fullsized":"2021-10-08T19:36:36.962920+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:16.702426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:16.702426+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0018085219999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":373,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.960520+0000","last_change":"2021-10-08T19:34:16.042895+0000","last_active":"2021-10-08T19:36:36.960520+0000","last_peered":"2021-10-08T19:36:36.960520+0000","last_clean":"2021-10-08T19:36:36.960520+0000","last_became_active":"2021-10-08T19:29:40.643614+0000","last_became_peered":"2021-10-08T19:29:40.643614+0000","last_unstale":"2021-10-08T19:36:36.960520+0000","last_undegraded":"2021-10-08T19:36:36.960520+0000","last_fullsized":"2021-10-08T19:36:36.960520+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:16.042797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:16.042797+0000","last_clean_scrub_stamp":"2021-10-08T19:34:16.042797+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.038141670000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":334,"reported_epoch":387,"state":"active+clean","last_fresh":"2021-10-08T19:36:40.867864+0000","last_change":"2021-10-08T19:36:40.867823+0000","last_active":"2021-10-08T19:36:40.867864+0000","last_peered":"2021-10-08T19:36:40.867864+0000","last_clean":"2021-10-08T19:36:40.867864+0000","last_became_active":"2021-10-08T19:29:40.626998+0000","last_became_peered":"2021-10-08T19:29:40.626998+0000","last_unstale":"2021-10-08T19:36:40.867864+0000","last_undegraded":"2021-10-08T19:36:40.867864+0000","last_fullsized":"2021-10-08T19:36:40.867864+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:40.867717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:40.867717+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.00742825,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"387'6681","reported_seq":6721,"reported_epoch":387,"state":"active+clean","last_fresh":"2021-10-08T19:36:43.654025+0000","last_change":"2021-10-08T19:35:17.125218+0000","last_active":"2021-10-08T19:36:43.654025+0000","last_peered":"2021-10-08T19:36:43.654025+0000","last_clean":"2021-10-08T19:36:43.654025+0000","last_became_active":"2021-10-08T19:35:17.124846+0000","last_became_peered":"2021-10-08T19:35:17.124846+0000","last_unstale":"2021-10-08T19:36:43.654025+0000","last_undegraded":"2021-10-08T19:36:43.654025+0000","last_fullsized":"2021-10-08T19:36:43.654025+0000","mapping_epoch":355,"log_start":"364'1900","ondisk_log_start":"364'1900","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:35:15.759693+0000","log_size":4781,"ondisk_log_size":4781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":437846016,"num_objects":6681,"num_object_clones":0,"num_object_copies":20043,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6681,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6681,"num_write_kb":427584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":385,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.959520+0000","last_change":"2021-10-08T19:36:11.024465+0000","last_active":"2021-10-08T19:36:36.959520+0000","last_peered":"2021-10-08T19:36:36.959520+0000","last_clean":"2021-10-08T19:36:36.959520+0000","last_became_active":"2021-10-08T19:28:40.138726+0000","last_became_peered":"2021-10-08T19:28:40.138726+0000","last_unstale":"2021-10-08T19:36:36.959520+0000","last_undegraded":"2021-10-08T19:36:36.959520+0000","last_fullsized":"2021-10-08T19:36:36.959520+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:11.024348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:50.435552+0000","last_clean_scrub_stamp":"2021-10-08T19:36:11.024348+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012476683000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"289'18","reported_seq":472,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.957670+0000","last_change":"2021-10-08T19:36:01.333174+0000","last_active":"2021-10-08T19:36:36.957670+0000","last_peered":"2021-10-08T19:36:36.957670+0000","last_clean":"2021-10-08T19:36:36.957670+0000","last_became_active":"2021-10-08T19:29:40.638957+0000","last_became_peered":"2021-10-08T19:29:40.638957+0000","last_unstale":"2021-10-08T19:36:36.957670+0000","last_undegraded":"2021-10-08T19:36:36.957670+0000","last_fullsized":"2021-10-08T19:36:36.957670+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'18","last_scrub_stamp":"2021-10-08T19:36:01.333053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:01.333053+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011804939,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":25,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"61'2","reported_seq":374,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.955941+0000","last_change":"2021-10-08T19:35:27.186175+0000","last_active":"2021-10-08T19:36:36.955941+0000","last_peered":"2021-10-08T19:36:36.955941+0000","last_clean":"2021-10-08T19:36:36.955941+0000","last_became_active":"2021-10-08T19:21:23.603614+0000","last_became_peered":"2021-10-08T19:21:23.603614+0000","last_unstale":"2021-10-08T19:36:36.955941+0000","last_undegraded":"2021-10-08T19:36:36.955941+0000","last_fullsized":"2021-10-08T19:36:36.955941+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'2","last_scrub_stamp":"2021-10-08T19:35:27.186086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:27.186086+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0052704600000000002,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":171,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.959215+0000","last_change":"2021-10-08T19:35:18.179768+0000","last_active":"2021-10-08T19:36:36.959215+0000","last_peered":"2021-10-08T19:36:36.959215+0000","last_clean":"2021-10-08T19:36:36.959215+0000","last_became_active":"2021-10-08T19:29:40.645211+0000","last_became_peered":"2021-10-08T19:29:40.645211+0000","last_unstale":"2021-10-08T19:36:36.959215+0000","last_undegraded":"2021-10-08T19:36:36.959215+0000","last_fullsized":"2021-10-08T19:36:36.959215+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:18.179673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:35:18.179673+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.080956615999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":294,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.966996+0000","last_change":"2021-10-08T19:34:44.848499+0000","last_active":"2021-10-08T19:36:36.966996+0000","last_peered":"2021-10-08T19:36:36.966996+0000","last_clean":"2021-10-08T19:36:36.966996+0000","last_became_active":"2021-10-08T19:28:40.100770+0000","last_became_peered":"2021-10-08T19:28:40.100770+0000","last_unstale":"2021-10-08T19:36:36.966996+0000","last_undegraded":"2021-10-08T19:36:36.966996+0000","last_fullsized":"2021-10-08T19:36:36.966996+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:44.848412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:44.848412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011032586,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"289'15","reported_seq":426,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.961457+0000","last_change":"2021-10-08T19:35:25.783136+0000","last_active":"2021-10-08T19:36:36.961457+0000","last_peered":"2021-10-08T19:36:36.961457+0000","last_clean":"2021-10-08T19:36:36.961457+0000","last_became_active":"2021-10-08T19:29:40.644354+0000","last_became_peered":"2021-10-08T19:29:40.644354+0000","last_unstale":"2021-10-08T19:36:36.961457+0000","last_undegraded":"2021-10-08T19:36:36.961457+0000","last_fullsized":"2021-10-08T19:36:36.961457+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'15","last_scrub_stamp":"2021-10-08T19:35:25.783048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:35:25.783048+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0045023340000000002,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":393,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.958391+0000","last_change":"2021-10-08T19:35:19.040312+0000","last_active":"2021-10-08T19:36:36.958391+0000","last_peered":"2021-10-08T19:36:36.958391+0000","last_clean":"2021-10-08T19:36:36.958391+0000","last_became_active":"2021-10-08T19:28:40.139234+0000","last_became_peered":"2021-10-08T19:28:40.139234+0000","last_unstale":"2021-10-08T19:36:36.958391+0000","last_undegraded":"2021-10-08T19:36:36.958391+0000","last_fullsized":"2021-10-08T19:36:36.958391+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:19.040235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:19.040235+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0015896599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":171,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.961118+0000","last_change":"2021-10-08T19:35:19.059789+0000","last_active":"2021-10-08T19:36:36.961118+0000","last_peered":"2021-10-08T19:36:36.961118+0000","last_clean":"2021-10-08T19:36:36.961118+0000","last_became_active":"2021-10-08T19:29:40.645111+0000","last_became_peered":"2021-10-08T19:29:40.645111+0000","last_unstale":"2021-10-08T19:36:36.961118+0000","last_undegraded":"2021-10-08T19:36:36.961118+0000","last_fullsized":"2021-10-08T19:36:36.961118+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:19.059695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:35:19.059695+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0017259879999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":365,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.957807+0000","last_change":"2021-10-08T19:36:17.901591+0000","last_active":"2021-10-08T19:36:36.957807+0000","last_peered":"2021-10-08T19:36:36.957807+0000","last_clean":"2021-10-08T19:36:36.957807+0000","last_became_active":"2021-10-08T19:21:29.640674+0000","last_became_peered":"2021-10-08T19:21:29.640674+0000","last_unstale":"2021-10-08T19:36:36.957807+0000","last_undegraded":"2021-10-08T19:36:36.957807+0000","last_fullsized":"2021-10-08T19:36:36.957807+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:17.901480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:36:17.901480+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034584479999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":286,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.966864+0000","last_change":"2021-10-08T19:35:34.911655+0000","last_active":"2021-10-08T19:36:36.966864+0000","last_peered":"2021-10-08T19:36:36.966864+0000","last_clean":"2021-10-08T19:36:36.966864+0000","last_became_active":"2021-10-08T19:25:15.501118+0000","last_became_peered":"2021-10-08T19:25:15.501118+0000","last_unstale":"2021-10-08T19:36:36.966864+0000","last_undegraded":"2021-10-08T19:36:36.966864+0000","last_fullsized":"2021-10-08T19:36:36.966864+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:34.911590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:34.911590+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.00387858,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"289'12","reported_seq":194,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.960971+0000","last_change":"2021-10-08T19:36:14.746788+0000","last_active":"2021-10-08T19:36:36.960971+0000","last_peered":"2021-10-08T19:36:36.960971+0000","last_clean":"2021-10-08T19:36:36.960971+0000","last_became_active":"2021-10-08T19:29:40.644657+0000","last_became_peered":"2021-10-08T19:29:40.644657+0000","last_unstale":"2021-10-08T19:36:36.960971+0000","last_undegraded":"2021-10-08T19:36:36.960971+0000","last_fullsized":"2021-10-08T19:36:36.960971+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'12","last_scrub_stamp":"2021-10-08T19:36:14.746690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:14.746690+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0050396959999999998,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":18,"num_read_kb":15,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":327,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.961803+0000","last_change":"2021-10-08T19:35:19.626725+0000","last_active":"2021-10-08T19:36:36.961803+0000","last_peered":"2021-10-08T19:36:36.961803+0000","last_clean":"2021-10-08T19:36:36.961803+0000","last_became_active":"2021-10-08T19:28:40.101898+0000","last_became_peered":"2021-10-08T19:28:40.101898+0000","last_unstale":"2021-10-08T19:36:36.961803+0000","last_undegraded":"2021-10-08T19:36:36.961803+0000","last_fullsized":"2021-10-08T19:36:36.961803+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:19.626649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:16.444582+0000","last_clean_scrub_stamp":"2021-10-08T19:35:19.626649+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0017102389999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":390,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.963536+0000","last_change":"2021-10-08T19:34:03.603560+0000","last_active":"2021-10-08T19:36:36.963536+0000","last_peered":"2021-10-08T19:36:36.963536+0000","last_clean":"2021-10-08T19:36:36.963536+0000","last_became_active":"2021-10-08T19:29:40.626950+0000","last_became_peered":"2021-10-08T19:29:40.626950+0000","last_unstale":"2021-10-08T19:36:36.963536+0000","last_undegraded":"2021-10-08T19:36:36.963536+0000","last_fullsized":"2021-10-08T19:36:36.963536+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:03.603487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:34:03.603487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011751039,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":377,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.966448+0000","last_change":"2021-10-08T19:35:33.907637+0000","last_active":"2021-10-08T19:36:36.966448+0000","last_peered":"2021-10-08T19:36:36.966448+0000","last_clean":"2021-10-08T19:36:36.966448+0000","last_became_active":"2021-10-08T19:24:25.099371+0000","last_became_peered":"2021-10-08T19:24:25.099371+0000","last_unstale":"2021-10-08T19:36:36.966448+0000","last_undegraded":"2021-10-08T19:36:36.966448+0000","last_fullsized":"2021-10-08T19:36:36.966448+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:33.907545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:35:33.907545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.028929507,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"70'5","reported_seq":562,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.961548+0000","last_change":"2021-10-08T19:36:07.636175+0000","last_active":"2021-10-08T19:36:36.961548+0000","last_peered":"2021-10-08T19:36:36.961548+0000","last_clean":"2021-10-08T19:36:36.961548+0000","last_became_active":"2021-10-08T19:31:22.785193+0000","last_became_peered":"2021-10-08T19:31:22.785193+0000","last_unstale":"2021-10-08T19:36:36.961548+0000","last_undegraded":"2021-10-08T19:36:36.961548+0000","last_fullsized":"2021-10-08T19:36:36.961548+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":5,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:36:07.636099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:07.636099+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.004695103,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"289'20","reported_seq":242,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.961265+0000","last_change":"2021-10-08T19:35:59.742206+0000","last_active":"2021-10-08T19:36:36.961265+0000","last_peered":"2021-10-08T19:36:36.961265+0000","last_clean":"2021-10-08T19:36:36.961265+0000","last_became_active":"2021-10-08T19:31:51.677055+0000","last_became_peered":"2021-10-08T19:31:51.677055+0000","last_unstale":"2021-10-08T19:36:36.961265+0000","last_undegraded":"2021-10-08T19:36:36.961265+0000","last_fullsized":"2021-10-08T19:36:36.961265+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'20","last_scrub_stamp":"2021-10-08T19:35:59.742121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:35:59.742121+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0052506209999999996,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":376,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.962930+0000","last_change":"2021-10-08T19:35:20.582479+0000","last_active":"2021-10-08T19:36:36.962930+0000","last_peered":"2021-10-08T19:36:36.962930+0000","last_clean":"2021-10-08T19:36:36.962930+0000","last_became_active":"2021-10-08T19:29:40.631331+0000","last_became_peered":"2021-10-08T19:29:40.631331+0000","last_unstale":"2021-10-08T19:36:36.962930+0000","last_undegraded":"2021-10-08T19:36:36.962930+0000","last_fullsized":"2021-10-08T19:36:36.962930+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:20.582397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:20.582397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001422972,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"328'11","reported_seq":574,"reported_epoch":387,"state":"active+clean","last_fresh":"2021-10-08T19:36:39.991010+0000","last_change":"2021-10-08T19:33:32.545949+0000","last_active":"2021-10-08T19:36:39.991010+0000","last_peered":"2021-10-08T19:36:39.991010+0000","last_clean":"2021-10-08T19:36:39.991010+0000","last_became_active":"2021-10-08T19:28:40.138031+0000","last_became_peered":"2021-10-08T19:28:40.138031+0000","last_unstale":"2021-10-08T19:36:39.991010+0000","last_undegraded":"2021-10-08T19:36:39.991010+0000","last_fullsized":"2021-10-08T19:36:39.991010+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"328'11","last_scrub_stamp":"2021-10-08T19:33:32.545870+0000","last_deep_scrub":"328'11","last_deep_scrub_stamp":"2021-10-08T19:33:32.545870+0000","last_clean_scrub_stamp":"2021-10-08T19:33:32.545870+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.023323448,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":373,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.961291+0000","last_change":"2021-10-08T19:36:07.150538+0000","last_active":"2021-10-08T19:36:36.961291+0000","last_peered":"2021-10-08T19:36:36.961291+0000","last_clean":"2021-10-08T19:36:36.961291+0000","last_became_active":"2021-10-08T19:29:40.644819+0000","last_became_peered":"2021-10-08T19:29:40.644819+0000","last_unstale":"2021-10-08T19:36:36.961291+0000","last_undegraded":"2021-10-08T19:36:36.961291+0000","last_fullsized":"2021-10-08T19:36:36.961291+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:07.150440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:36:07.150440+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.032064849999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":282,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.965680+0000","last_change":"2021-10-08T19:34:58.902486+0000","last_active":"2021-10-08T19:36:36.965680+0000","last_peered":"2021-10-08T19:36:36.965680+0000","last_clean":"2021-10-08T19:36:36.965680+0000","last_became_active":"2021-10-08T19:25:15.498770+0000","last_became_peered":"2021-10-08T19:25:15.498770+0000","last_unstale":"2021-10-08T19:36:36.965680+0000","last_undegraded":"2021-10-08T19:36:36.965680+0000","last_fullsized":"2021-10-08T19:36:36.965680+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:58.902409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:58.902409+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034749170000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"289'15","reported_seq":144,"reported_epoch":387,"state":"active+clean","last_fresh":"2021-10-08T19:36:42.879730+0000","last_change":"2021-10-08T19:36:42.879691+0000","last_active":"2021-10-08T19:36:42.879730+0000","last_peered":"2021-10-08T19:36:42.879730+0000","last_clean":"2021-10-08T19:36:42.879730+0000","last_became_active":"2021-10-08T19:31:22.786860+0000","last_became_peered":"2021-10-08T19:31:22.786860+0000","last_unstale":"2021-10-08T19:36:42.879730+0000","last_undegraded":"2021-10-08T19:36:42.879730+0000","last_fullsized":"2021-10-08T19:36:42.879730+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'15","last_scrub_stamp":"2021-10-08T19:36:42.879493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:42.879493+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040447189999999996,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":387,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.962496+0000","last_change":"2021-10-08T19:36:13.061448+0000","last_active":"2021-10-08T19:36:36.962496+0000","last_peered":"2021-10-08T19:36:36.962496+0000","last_clean":"2021-10-08T19:36:36.962496+0000","last_became_active":"2021-10-08T19:29:44.439397+0000","last_became_peered":"2021-10-08T19:29:44.439397+0000","last_unstale":"2021-10-08T19:36:36.962496+0000","last_undegraded":"2021-10-08T19:36:36.962496+0000","last_fullsized":"2021-10-08T19:36:36.962496+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:13.061347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:13.061347+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0089607839999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"238'10","reported_seq":260,"reported_epoch":387,"state":"active+clean","last_fresh":"2021-10-08T19:36:39.989660+0000","last_change":"2021-10-08T19:34:14.090645+0000","last_active":"2021-10-08T19:36:39.989660+0000","last_peered":"2021-10-08T19:36:39.989660+0000","last_clean":"2021-10-08T19:36:39.989660+0000","last_became_active":"2021-10-08T19:29:40.637650+0000","last_became_peered":"2021-10-08T19:29:40.637650+0000","last_unstale":"2021-10-08T19:36:39.989660+0000","last_undegraded":"2021-10-08T19:36:39.989660+0000","last_fullsized":"2021-10-08T19:36:39.989660+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"238'10","last_scrub_stamp":"2021-10-08T19:34:14.090547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:34:14.090547+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.017481770000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":352,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.956433+0000","last_change":"2021-10-08T19:36:00.407971+0000","last_active":"2021-10-08T19:36:36.956433+0000","last_peered":"2021-10-08T19:36:36.956433+0000","last_clean":"2021-10-08T19:36:36.956433+0000","last_became_active":"2021-10-08T19:21:29.640302+0000","last_became_peered":"2021-10-08T19:21:29.640302+0000","last_unstale":"2021-10-08T19:36:36.956433+0000","last_undegraded":"2021-10-08T19:36:36.956433+0000","last_fullsized":"2021-10-08T19:36:36.956433+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:00.407898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:36:00.407898+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.105360284,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":294,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.963490+0000","last_change":"2021-10-08T19:34:51.964960+0000","last_active":"2021-10-08T19:36:36.963490+0000","last_peered":"2021-10-08T19:36:36.963490+0000","last_clean":"2021-10-08T19:36:36.963490+0000","last_became_active":"2021-10-08T19:29:40.631374+0000","last_became_peered":"2021-10-08T19:29:40.631374+0000","last_unstale":"2021-10-08T19:36:36.963490+0000","last_undegraded":"2021-10-08T19:36:36.963490+0000","last_fullsized":"2021-10-08T19:36:36.963490+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:51.964844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:51.964844+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010245107,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":298,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.966330+0000","last_change":"2021-10-08T19:35:17.858327+0000","last_active":"2021-10-08T19:36:36.966330+0000","last_peered":"2021-10-08T19:36:36.966330+0000","last_clean":"2021-10-08T19:36:36.966330+0000","last_became_active":"2021-10-08T19:29:40.652966+0000","last_became_peered":"2021-10-08T19:29:40.652966+0000","last_unstale":"2021-10-08T19:36:36.966330+0000","last_undegraded":"2021-10-08T19:36:36.966330+0000","last_fullsized":"2021-10-08T19:36:36.966330+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:17.858192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:17.858192+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0019694320000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"289'19","reported_seq":117,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.965771+0000","last_change":"2021-10-08T19:34:53.739955+0000","last_active":"2021-10-08T19:36:36.965771+0000","last_peered":"2021-10-08T19:36:36.965771+0000","last_clean":"2021-10-08T19:36:36.965771+0000","last_became_active":"2021-10-08T19:31:51.676961+0000","last_became_peered":"2021-10-08T19:31:51.676961+0000","last_unstale":"2021-10-08T19:36:36.965771+0000","last_undegraded":"2021-10-08T19:36:36.965771+0000","last_fullsized":"2021-10-08T19:36:36.965771+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:34:53.739851+0000","last_deep_scrub":"289'19","last_deep_scrub_stamp":"2021-10-08T19:32:46.539792+0000","last_clean_scrub_stamp":"2021-10-08T19:34:53.739851+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.018714432,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":349,"reported_epoch":387,"state":"active+clean","last_fresh":"2021-10-08T19:36:41.943837+0000","last_change":"2021-10-08T19:36:41.943798+0000","last_active":"2021-10-08T19:36:41.943837+0000","last_peered":"2021-10-08T19:36:41.943837+0000","last_clean":"2021-10-08T19:36:41.943837+0000","last_became_active":"2021-10-08T19:31:22.786651+0000","last_became_peered":"2021-10-08T19:31:22.786651+0000","last_unstale":"2021-10-08T19:36:41.943837+0000","last_undegraded":"2021-10-08T19:36:41.943837+0000","last_fullsized":"2021-10-08T19:36:41.943837+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:41.943676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:41.943676+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014561818000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":173,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.959121+0000","last_change":"2021-10-08T19:34:44.147010+0000","last_active":"2021-10-08T19:36:36.959121+0000","last_peered":"2021-10-08T19:36:36.959121+0000","last_clean":"2021-10-08T19:36:36.959121+0000","last_became_active":"2021-10-08T19:29:40.644770+0000","last_became_peered":"2021-10-08T19:29:40.644770+0000","last_unstale":"2021-10-08T19:36:36.959121+0000","last_undegraded":"2021-10-08T19:36:36.959121+0000","last_fullsized":"2021-10-08T19:36:36.959121+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:44.146892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:34:44.146892+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0086783989999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":375,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.960432+0000","last_change":"2021-10-08T19:35:24.753897+0000","last_active":"2021-10-08T19:36:36.960432+0000","last_peered":"2021-10-08T19:36:36.960432+0000","last_clean":"2021-10-08T19:36:36.960432+0000","last_became_active":"2021-10-08T19:28:40.133744+0000","last_became_peered":"2021-10-08T19:28:40.133744+0000","last_unstale":"2021-10-08T19:36:36.960432+0000","last_undegraded":"2021-10-08T19:36:36.960432+0000","last_fullsized":"2021-10-08T19:36:36.960432+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:24.753785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:35:24.753785+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.021400018999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"289'19","reported_seq":512,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.955732+0000","last_change":"2021-10-08T19:36:10.148431+0000","last_active":"2021-10-08T19:36:36.955732+0000","last_peered":"2021-10-08T19:36:36.955732+0000","last_clean":"2021-10-08T19:36:36.955732+0000","last_became_active":"2021-10-08T19:28:40.100196+0000","last_became_peered":"2021-10-08T19:28:40.100196+0000","last_unstale":"2021-10-08T19:36:36.955732+0000","last_undegraded":"2021-10-08T19:36:36.955732+0000","last_fullsized":"2021-10-08T19:36:36.955732+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:36:10.148317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:10.148317+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013984083,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":213,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.963357+0000","last_change":"2021-10-08T19:35:29.678176+0000","last_active":"2021-10-08T19:36:36.963357+0000","last_peered":"2021-10-08T19:36:36.963357+0000","last_clean":"2021-10-08T19:36:36.963357+0000","last_became_active":"2021-10-08T19:28:40.146673+0000","last_became_peered":"2021-10-08T19:28:40.146673+0000","last_unstale":"2021-10-08T19:36:36.963357+0000","last_undegraded":"2021-10-08T19:36:36.963357+0000","last_fullsized":"2021-10-08T19:36:36.963357+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:29.677982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:29.677982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0076172159999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":223,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.966077+0000","last_change":"2021-10-08T19:34:55.788781+0000","last_active":"2021-10-08T19:36:36.966077+0000","last_peered":"2021-10-08T19:36:36.966077+0000","last_clean":"2021-10-08T19:36:36.966077+0000","last_became_active":"2021-10-08T19:29:40.638536+0000","last_became_peered":"2021-10-08T19:29:40.638536+0000","last_unstale":"2021-10-08T19:36:36.966077+0000","last_undegraded":"2021-10-08T19:36:36.966077+0000","last_fullsized":"2021-10-08T19:36:36.966077+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:55.788660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:43.186684+0000","last_clean_scrub_stamp":"2021-10-08T19:34:55.788660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.020657894,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":171,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.957826+0000","last_change":"2021-10-08T19:35:21.993459+0000","last_active":"2021-10-08T19:36:36.957826+0000","last_peered":"2021-10-08T19:36:36.957826+0000","last_clean":"2021-10-08T19:36:36.957826+0000","last_became_active":"2021-10-08T19:29:40.634300+0000","last_became_peered":"2021-10-08T19:29:40.634300+0000","last_unstale":"2021-10-08T19:36:36.957826+0000","last_undegraded":"2021-10-08T19:36:36.957826+0000","last_fullsized":"2021-10-08T19:36:36.957826+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:21.993295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:35:21.993295+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.015124034,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"70'5","reported_seq":282,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.956770+0000","last_change":"2021-10-08T19:36:06.256008+0000","last_active":"2021-10-08T19:36:36.956770+0000","last_peered":"2021-10-08T19:36:36.956770+0000","last_clean":"2021-10-08T19:36:36.956770+0000","last_became_active":"2021-10-08T19:25:15.496309+0000","last_became_peered":"2021-10-08T19:25:15.496309+0000","last_unstale":"2021-10-08T19:36:36.956770+0000","last_undegraded":"2021-10-08T19:36:36.956770+0000","last_fullsized":"2021-10-08T19:36:36.956770+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:36:06.255898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:06.255898+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0073902810000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.10","version":"289'8","reported_seq":200,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.957276+0000","last_change":"2021-10-08T19:36:06.812233+0000","last_active":"2021-10-08T19:36:36.957276+0000","last_peered":"2021-10-08T19:36:36.957276+0000","last_clean":"2021-10-08T19:36:36.957276+0000","last_became_active":"2021-10-08T19:32:45.165103+0000","last_became_peered":"2021-10-08T19:32:45.165103+0000","last_unstale":"2021-10-08T19:36:36.957276+0000","last_undegraded":"2021-10-08T19:36:36.957276+0000","last_fullsized":"2021-10-08T19:36:36.957276+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'8","last_scrub_stamp":"2021-10-08T19:36:06.812115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:06.812115+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010666471,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":376,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.963724+0000","last_change":"2021-10-08T19:35:18.550632+0000","last_active":"2021-10-08T19:36:36.963724+0000","last_peered":"2021-10-08T19:36:36.963724+0000","last_clean":"2021-10-08T19:36:36.963724+0000","last_became_active":"2021-10-08T19:24:25.094384+0000","last_became_peered":"2021-10-08T19:24:25.094384+0000","last_unstale":"2021-10-08T19:36:36.963724+0000","last_undegraded":"2021-10-08T19:36:36.963724+0000","last_fullsized":"2021-10-08T19:36:36.963724+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:18.550521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:13.716331+0000","last_clean_scrub_stamp":"2021-10-08T19:35:18.550521+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0037919709999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":316,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.961887+0000","last_change":"2021-10-08T19:35:27.551866+0000","last_active":"2021-10-08T19:36:36.961887+0000","last_peered":"2021-10-08T19:36:36.961887+0000","last_clean":"2021-10-08T19:36:36.961887+0000","last_became_active":"2021-10-08T19:24:25.106186+0000","last_became_peered":"2021-10-08T19:24:25.106186+0000","last_unstale":"2021-10-08T19:36:36.961887+0000","last_undegraded":"2021-10-08T19:36:36.961887+0000","last_fullsized":"2021-10-08T19:36:36.961887+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:27.551788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:18.377739+0000","last_clean_scrub_stamp":"2021-10-08T19:35:27.551788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0030249280000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":361,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.966043+0000","last_change":"2021-10-08T19:35:57.018331+0000","last_active":"2021-10-08T19:36:36.966043+0000","last_peered":"2021-10-08T19:36:36.966043+0000","last_clean":"2021-10-08T19:36:36.966043+0000","last_became_active":"2021-10-08T19:21:29.642835+0000","last_became_peered":"2021-10-08T19:21:29.642835+0000","last_unstale":"2021-10-08T19:36:36.966043+0000","last_undegraded":"2021-10-08T19:36:36.966043+0000","last_fullsized":"2021-10-08T19:36:36.966043+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:57.018227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:35:57.018227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012449864,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":294,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.963394+0000","last_change":"2021-10-08T19:35:21.620918+0000","last_active":"2021-10-08T19:36:36.963394+0000","last_peered":"2021-10-08T19:36:36.963394+0000","last_clean":"2021-10-08T19:36:36.963394+0000","last_became_active":"2021-10-08T19:28:40.099215+0000","last_became_peered":"2021-10-08T19:28:40.099215+0000","last_unstale":"2021-10-08T19:36:36.963394+0000","last_undegraded":"2021-10-08T19:36:36.963394+0000","last_fullsized":"2021-10-08T19:36:36.963394+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:21.620837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:21.620837+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034355459999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"348'24","reported_seq":200,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.957755+0000","last_change":"2021-10-08T19:34:53.274347+0000","last_active":"2021-10-08T19:36:36.957755+0000","last_peered":"2021-10-08T19:36:36.957755+0000","last_clean":"2021-10-08T19:36:36.957755+0000","last_became_active":"2021-10-08T19:29:40.640914+0000","last_became_peered":"2021-10-08T19:29:40.640914+0000","last_unstale":"2021-10-08T19:36:36.957755+0000","last_undegraded":"2021-10-08T19:36:36.957755+0000","last_fullsized":"2021-10-08T19:36:36.957755+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"348'24","last_scrub_stamp":"2021-10-08T19:34:53.274250+0000","last_deep_scrub":"348'24","last_deep_scrub_stamp":"2021-10-08T19:34:53.274250+0000","last_clean_scrub_stamp":"2021-10-08T19:34:53.274250+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.018882408,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":307,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.962223+0000","last_change":"2021-10-08T19:34:59.547710+0000","last_active":"2021-10-08T19:36:36.962223+0000","last_peered":"2021-10-08T19:36:36.962223+0000","last_clean":"2021-10-08T19:36:36.962223+0000","last_became_active":"2021-10-08T19:24:25.098128+0000","last_became_peered":"2021-10-08T19:24:25.098128+0000","last_unstale":"2021-10-08T19:36:36.962223+0000","last_undegraded":"2021-10-08T19:36:36.962223+0000","last_fullsized":"2021-10-08T19:36:36.962223+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:59.547640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:34.508558+0000","last_clean_scrub_stamp":"2021-10-08T19:34:59.547640+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0015010729999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":373,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.966485+0000","last_change":"2021-10-08T19:35:25.845334+0000","last_active":"2021-10-08T19:36:36.966485+0000","last_peered":"2021-10-08T19:36:36.966485+0000","last_clean":"2021-10-08T19:36:36.966485+0000","last_became_active":"2021-10-08T19:24:25.095490+0000","last_became_peered":"2021-10-08T19:24:25.095490+0000","last_unstale":"2021-10-08T19:36:36.966485+0000","last_undegraded":"2021-10-08T19:36:36.966485+0000","last_fullsized":"2021-10-08T19:36:36.966485+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:25.845262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:11.383779+0000","last_clean_scrub_stamp":"2021-10-08T19:35:25.845262+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0015112610000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":177,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.959528+0000","last_change":"2021-10-08T19:36:12.821415+0000","last_active":"2021-10-08T19:36:36.959528+0000","last_peered":"2021-10-08T19:36:36.959528+0000","last_clean":"2021-10-08T19:36:36.959528+0000","last_became_active":"2021-10-08T19:29:40.639358+0000","last_became_peered":"2021-10-08T19:29:40.639358+0000","last_unstale":"2021-10-08T19:36:36.959528+0000","last_undegraded":"2021-10-08T19:36:36.959528+0000","last_fullsized":"2021-10-08T19:36:36.959528+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:12.821316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:36:12.821316+0000","last_clean_scrub_stamp":"2021-10-08T19:36:12.821316+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.068456382999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"289'20","reported_seq":431,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.961762+0000","last_change":"2021-10-08T19:34:12.001980+0000","last_active":"2021-10-08T19:36:36.961762+0000","last_peered":"2021-10-08T19:36:36.961762+0000","last_clean":"2021-10-08T19:36:36.961762+0000","last_became_active":"2021-10-08T19:29:40.636448+0000","last_became_peered":"2021-10-08T19:29:40.636448+0000","last_unstale":"2021-10-08T19:36:36.961762+0000","last_undegraded":"2021-10-08T19:36:36.961762+0000","last_fullsized":"2021-10-08T19:36:36.961762+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'20","last_scrub_stamp":"2021-10-08T19:34:12.001875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:34:12.001875+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0097733339999999998,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":358,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.962490+0000","last_change":"2021-10-08T19:36:17.700202+0000","last_active":"2021-10-08T19:36:36.962490+0000","last_peered":"2021-10-08T19:36:36.962490+0000","last_clean":"2021-10-08T19:36:36.962490+0000","last_became_active":"2021-10-08T19:21:23.604530+0000","last_became_peered":"2021-10-08T19:21:23.604530+0000","last_unstale":"2021-10-08T19:36:36.962490+0000","last_undegraded":"2021-10-08T19:36:36.962490+0000","last_fullsized":"2021-10-08T19:36:36.962490+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:17.700127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:17.700127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0031895790000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1f","version":"114'10","reported_seq":459,"reported_epoch":387,"state":"active+clean","last_fresh":"2021-10-08T19:36:40.888437+0000","last_change":"2021-10-08T19:36:40.888275+0000","last_active":"2021-10-08T19:36:40.888437+0000","last_peered":"2021-10-08T19:36:40.888437+0000","last_clean":"2021-10-08T19:36:40.888437+0000","last_became_active":"2021-10-08T19:24:25.105742+0000","last_became_peered":"2021-10-08T19:24:25.105742+0000","last_unstale":"2021-10-08T19:36:40.888437+0000","last_undegraded":"2021-10-08T19:36:40.888437+0000","last_fullsized":"2021-10-08T19:36:40.888437+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'10","last_scrub_stamp":"2021-10-08T19:36:40.888198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:36:40.888198+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0055243009999999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"69'1","reported_seq":354,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.968219+0000","last_change":"2021-10-08T19:34:51.899798+0000","last_active":"2021-10-08T19:36:36.968219+0000","last_peered":"2021-10-08T19:36:36.968219+0000","last_clean":"2021-10-08T19:36:36.968219+0000","last_became_active":"2021-10-08T19:21:29.640296+0000","last_became_peered":"2021-10-08T19:21:29.640296+0000","last_unstale":"2021-10-08T19:36:36.968219+0000","last_undegraded":"2021-10-08T19:36:36.968219+0000","last_fullsized":"2021-10-08T19:36:36.968219+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2021-10-08T19:34:51.899691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:34:51.899691+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012893907,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"289'19","reported_seq":373,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.962597+0000","last_change":"2021-10-08T19:35:15.665522+0000","last_active":"2021-10-08T19:36:36.962597+0000","last_peered":"2021-10-08T19:36:36.962597+0000","last_clean":"2021-10-08T19:36:36.962597+0000","last_became_active":"2021-10-08T19:28:40.126425+0000","last_became_peered":"2021-10-08T19:28:40.126425+0000","last_unstale":"2021-10-08T19:36:36.962597+0000","last_undegraded":"2021-10-08T19:36:36.962597+0000","last_fullsized":"2021-10-08T19:36:36.962597+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:35:15.665434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:35:15.665434+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0027800889999999999,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":171,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.957548+0000","last_change":"2021-10-08T19:34:13.102972+0000","last_active":"2021-10-08T19:36:36.957548+0000","last_peered":"2021-10-08T19:36:36.957548+0000","last_clean":"2021-10-08T19:36:36.957548+0000","last_became_active":"2021-10-08T19:29:40.640952+0000","last_became_peered":"2021-10-08T19:29:40.640952+0000","last_unstale":"2021-10-08T19:36:36.957548+0000","last_undegraded":"2021-10-08T19:36:36.957548+0000","last_fullsized":"2021-10-08T19:36:36.957548+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:13.102869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:13.102869+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0080406309999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":361,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.962829+0000","last_change":"2021-10-08T19:36:02.157958+0000","last_active":"2021-10-08T19:36:36.962829+0000","last_peered":"2021-10-08T19:36:36.962829+0000","last_clean":"2021-10-08T19:36:36.962829+0000","last_became_active":"2021-10-08T19:21:27.632648+0000","last_became_peered":"2021-10-08T19:21:27.632648+0000","last_unstale":"2021-10-08T19:36:36.962829+0000","last_undegraded":"2021-10-08T19:36:36.962829+0000","last_fullsized":"2021-10-08T19:36:36.962829+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:02.157885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:36:02.157885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0018671,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"69'1","reported_seq":209,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.963445+0000","last_change":"2021-10-08T19:35:14.779532+0000","last_active":"2021-10-08T19:36:36.963445+0000","last_peered":"2021-10-08T19:36:36.963445+0000","last_clean":"2021-10-08T19:36:36.963445+0000","last_became_active":"2021-10-08T19:28:40.146302+0000","last_became_peered":"2021-10-08T19:28:40.146302+0000","last_unstale":"2021-10-08T19:36:36.963445+0000","last_undegraded":"2021-10-08T19:36:36.963445+0000","last_fullsized":"2021-10-08T19:36:36.963445+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2021-10-08T19:35:14.779433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:35:14.779433+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.101324384,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"289'27","reported_seq":537,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.958323+0000","last_change":"2021-10-08T19:36:09.038305+0000","last_active":"2021-10-08T19:36:36.958323+0000","last_peered":"2021-10-08T19:36:36.958323+0000","last_clean":"2021-10-08T19:36:36.958323+0000","last_became_active":"2021-10-08T19:29:40.629461+0000","last_became_peered":"2021-10-08T19:29:40.629461+0000","last_unstale":"2021-10-08T19:36:36.958323+0000","last_undegraded":"2021-10-08T19:36:36.958323+0000","last_fullsized":"2021-10-08T19:36:36.958323+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'27","last_scrub_stamp":"2021-10-08T19:36:09.038188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:09.038188+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0091474969999999992,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":550,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":315,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.962434+0000","last_change":"2021-10-08T19:35:59.598376+0000","last_active":"2021-10-08T19:36:36.962434+0000","last_peered":"2021-10-08T19:36:36.962434+0000","last_clean":"2021-10-08T19:36:36.962434+0000","last_became_active":"2021-10-08T19:24:25.106119+0000","last_became_peered":"2021-10-08T19:24:25.106119+0000","last_unstale":"2021-10-08T19:36:36.962434+0000","last_undegraded":"2021-10-08T19:36:36.962434+0000","last_fullsized":"2021-10-08T19:36:36.962434+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:59.598294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:46.422866+0000","last_clean_scrub_stamp":"2021-10-08T19:35:59.598294+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.032131808999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":205,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.963525+0000","last_change":"2021-10-08T19:34:45.792403+0000","last_active":"2021-10-08T19:36:36.963525+0000","last_peered":"2021-10-08T19:36:36.963525+0000","last_clean":"2021-10-08T19:36:36.963525+0000","last_became_active":"2021-10-08T19:28:40.148009+0000","last_became_peered":"2021-10-08T19:28:40.148009+0000","last_unstale":"2021-10-08T19:36:36.963525+0000","last_undegraded":"2021-10-08T19:36:36.963525+0000","last_fullsized":"2021-10-08T19:36:36.963525+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:45.792309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:34:45.792309+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0077010439999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":370,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.956100+0000","last_change":"2021-10-08T19:35:16.284591+0000","last_active":"2021-10-08T19:36:36.956100+0000","last_peered":"2021-10-08T19:36:36.956100+0000","last_clean":"2021-10-08T19:36:36.956100+0000","last_became_active":"2021-10-08T19:24:25.097782+0000","last_became_peered":"2021-10-08T19:24:25.097782+0000","last_unstale":"2021-10-08T19:36:36.956100+0000","last_undegraded":"2021-10-08T19:36:36.956100+0000","last_fullsized":"2021-10-08T19:36:36.956100+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:16.284510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:37.219503+0000","last_clean_scrub_stamp":"2021-10-08T19:35:16.284510+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001625755,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"289'18","reported_seq":198,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.959968+0000","last_change":"2021-10-08T19:36:17.847260+0000","last_active":"2021-10-08T19:36:36.959968+0000","last_peered":"2021-10-08T19:36:36.959968+0000","last_clean":"2021-10-08T19:36:36.959968+0000","last_became_active":"2021-10-08T19:29:40.645144+0000","last_became_peered":"2021-10-08T19:29:40.645144+0000","last_unstale":"2021-10-08T19:36:36.959968+0000","last_undegraded":"2021-10-08T19:36:36.959968+0000","last_fullsized":"2021-10-08T19:36:36.959968+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'18","last_scrub_stamp":"2021-10-08T19:36:17.846978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:17.846978+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.018882475999999999,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":25,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":171,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.959294+0000","last_change":"2021-10-08T19:35:32.854645+0000","last_active":"2021-10-08T19:36:36.959294+0000","last_peered":"2021-10-08T19:36:36.959294+0000","last_clean":"2021-10-08T19:36:36.959294+0000","last_became_active":"2021-10-08T19:29:44.443807+0000","last_became_peered":"2021-10-08T19:29:44.443807+0000","last_unstale":"2021-10-08T19:36:36.959294+0000","last_undegraded":"2021-10-08T19:36:36.959294+0000","last_fullsized":"2021-10-08T19:36:36.959294+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:32.854550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:32.854550+0000","last_clean_scrub_stamp":"2021-10-08T19:35:32.854550+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0089578279999999993,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":372,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.956532+0000","last_change":"2021-10-08T19:34:56.418386+0000","last_active":"2021-10-08T19:36:36.956532+0000","last_peered":"2021-10-08T19:36:36.956532+0000","last_clean":"2021-10-08T19:36:36.956532+0000","last_became_active":"2021-10-08T19:29:40.638352+0000","last_became_peered":"2021-10-08T19:29:40.638352+0000","last_unstale":"2021-10-08T19:36:36.956532+0000","last_undegraded":"2021-10-08T19:36:36.956532+0000","last_fullsized":"2021-10-08T19:36:36.956532+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:56.418264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:34:56.418264+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0060118899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":189,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.961194+0000","last_change":"2021-10-08T19:35:24.071959+0000","last_active":"2021-10-08T19:36:36.961194+0000","last_peered":"2021-10-08T19:36:36.961194+0000","last_clean":"2021-10-08T19:36:36.961194+0000","last_became_active":"2021-10-08T19:31:22.788455+0000","last_became_peered":"2021-10-08T19:31:22.788455+0000","last_unstale":"2021-10-08T19:36:36.961194+0000","last_undegraded":"2021-10-08T19:36:36.961194+0000","last_fullsized":"2021-10-08T19:36:36.961194+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:24.071866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:32:12.549351+0000","last_clean_scrub_stamp":"2021-10-08T19:35:24.071866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.097681799,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"289'15","reported_seq":421,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.957587+0000","last_change":"2021-10-08T19:36:08.207665+0000","last_active":"2021-10-08T19:36:36.957587+0000","last_peered":"2021-10-08T19:36:36.957587+0000","last_clean":"2021-10-08T19:36:36.957587+0000","last_became_active":"2021-10-08T19:29:40.631689+0000","last_became_peered":"2021-10-08T19:29:40.631689+0000","last_unstale":"2021-10-08T19:36:36.957587+0000","last_undegraded":"2021-10-08T19:36:36.957587+0000","last_fullsized":"2021-10-08T19:36:36.957587+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'15","last_scrub_stamp":"2021-10-08T19:36:08.207585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:08.207585+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.016557056000000001,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":369,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.967834+0000","last_change":"2021-10-08T19:36:16.752767+0000","last_active":"2021-10-08T19:36:36.967834+0000","last_peered":"2021-10-08T19:36:36.967834+0000","last_clean":"2021-10-08T19:36:36.967834+0000","last_became_active":"2021-10-08T19:21:23.607785+0000","last_became_peered":"2021-10-08T19:21:23.607785+0000","last_unstale":"2021-10-08T19:36:36.967834+0000","last_undegraded":"2021-10-08T19:36:36.967834+0000","last_fullsized":"2021-10-08T19:36:36.967834+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:16.752654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:16.752654+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0071954510000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":354,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.963970+0000","last_change":"2021-10-08T19:35:27.586471+0000","last_active":"2021-10-08T19:36:36.963970+0000","last_peered":"2021-10-08T19:36:36.963970+0000","last_clean":"2021-10-08T19:36:36.963970+0000","last_became_active":"2021-10-08T19:21:27.633979+0000","last_became_peered":"2021-10-08T19:21:27.633979+0000","last_unstale":"2021-10-08T19:36:36.963970+0000","last_undegraded":"2021-10-08T19:36:36.963970+0000","last_fullsized":"2021-10-08T19:36:36.963970+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:27.586341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:27.586341+0000","last_clean_scrub_stamp":"2021-10-08T19:35:27.586341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0047091140000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":375,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.960923+0000","last_change":"2021-10-08T19:34:50.034539+0000","last_active":"2021-10-08T19:36:36.960923+0000","last_peered":"2021-10-08T19:36:36.960923+0000","last_clean":"2021-10-08T19:36:36.960923+0000","last_became_active":"2021-10-08T19:28:40.159162+0000","last_became_peered":"2021-10-08T19:28:40.159162+0000","last_unstale":"2021-10-08T19:36:36.960923+0000","last_undegraded":"2021-10-08T19:36:36.960923+0000","last_fullsized":"2021-10-08T19:36:36.960923+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:50.034064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:34:50.034064+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.029837211999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"289'7","reported_seq":452,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.955842+0000","last_change":"2021-10-08T19:36:14.120690+0000","last_active":"2021-10-08T19:36:36.955842+0000","last_peered":"2021-10-08T19:36:36.955842+0000","last_clean":"2021-10-08T19:36:36.955842+0000","last_became_active":"2021-10-08T19:31:51.675189+0000","last_became_peered":"2021-10-08T19:31:51.675189+0000","last_unstale":"2021-10-08T19:36:36.955842+0000","last_undegraded":"2021-10-08T19:36:36.955842+0000","last_fullsized":"2021-10-08T19:36:36.955842+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'7","last_scrub_stamp":"2021-10-08T19:36:14.120570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:14.120570+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.006350138,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":10,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":385,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.966602+0000","last_change":"2021-10-08T19:35:24.852668+0000","last_active":"2021-10-08T19:36:36.966602+0000","last_peered":"2021-10-08T19:36:36.966602+0000","last_clean":"2021-10-08T19:36:36.966602+0000","last_became_active":"2021-10-08T19:24:25.096225+0000","last_became_peered":"2021-10-08T19:24:25.096225+0000","last_unstale":"2021-10-08T19:36:36.966602+0000","last_undegraded":"2021-10-08T19:36:36.966602+0000","last_fullsized":"2021-10-08T19:36:36.966602+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:24.852584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:29:40.244757+0000","last_clean_scrub_stamp":"2021-10-08T19:35:24.852584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0014639150000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":377,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.965821+0000","last_change":"2021-10-08T19:34:11.633837+0000","last_active":"2021-10-08T19:36:36.965821+0000","last_peered":"2021-10-08T19:36:36.965821+0000","last_clean":"2021-10-08T19:36:36.965821+0000","last_became_active":"2021-10-08T19:28:40.101187+0000","last_became_peered":"2021-10-08T19:28:40.101187+0000","last_unstale":"2021-10-08T19:36:36.965821+0000","last_undegraded":"2021-10-08T19:36:36.965821+0000","last_fullsized":"2021-10-08T19:36:36.965821+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:11.633739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:11.633739+0000","last_clean_scrub_stamp":"2021-10-08T19:34:11.633739+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0065073010000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":388,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.962697+0000","last_change":"2021-10-08T19:36:10.650417+0000","last_active":"2021-10-08T19:36:36.962697+0000","last_peered":"2021-10-08T19:36:36.962697+0000","last_clean":"2021-10-08T19:36:36.962697+0000","last_became_active":"2021-10-08T19:29:40.632965+0000","last_became_peered":"2021-10-08T19:29:40.632965+0000","last_unstale":"2021-10-08T19:36:36.962697+0000","last_undegraded":"2021-10-08T19:36:36.962697+0000","last_fullsized":"2021-10-08T19:36:36.962697+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:10.650288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:36:10.650288+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.029752064000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"289'19","reported_seq":501,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.955457+0000","last_change":"2021-10-08T19:36:15.167452+0000","last_active":"2021-10-08T19:36:36.955457+0000","last_peered":"2021-10-08T19:36:36.955457+0000","last_clean":"2021-10-08T19:36:36.955457+0000","last_became_active":"2021-10-08T19:28:40.099770+0000","last_became_peered":"2021-10-08T19:28:40.099770+0000","last_unstale":"2021-10-08T19:36:36.955457+0000","last_undegraded":"2021-10-08T19:36:36.955457+0000","last_fullsized":"2021-10-08T19:36:36.955457+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:36:15.167374+0000","last_deep_scrub":"289'19","last_deep_scrub_stamp":"2021-10-08T19:36:15.167374+0000","last_clean_scrub_stamp":"2021-10-08T19:36:15.167374+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0067424360000000001,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":171,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.958716+0000","last_change":"2021-10-08T19:34:04.124983+0000","last_active":"2021-10-08T19:36:36.958716+0000","last_peered":"2021-10-08T19:36:36.958716+0000","last_clean":"2021-10-08T19:36:36.958716+0000","last_became_active":"2021-10-08T19:29:40.627394+0000","last_became_peered":"2021-10-08T19:29:40.627394+0000","last_unstale":"2021-10-08T19:36:36.958716+0000","last_undegraded":"2021-10-08T19:36:36.958716+0000","last_fullsized":"2021-10-08T19:36:36.958716+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:04.124886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:34:04.124886+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0093513629999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":205,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.962866+0000","last_change":"2021-10-08T19:34:47.797510+0000","last_active":"2021-10-08T19:36:36.962866+0000","last_peered":"2021-10-08T19:36:36.962866+0000","last_clean":"2021-10-08T19:36:36.962866+0000","last_became_active":"2021-10-08T19:28:40.145868+0000","last_became_peered":"2021-10-08T19:28:40.145868+0000","last_unstale":"2021-10-08T19:36:36.962866+0000","last_undegraded":"2021-10-08T19:36:36.962866+0000","last_fullsized":"2021-10-08T19:36:36.962866+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:47.797403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:34:47.797403+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011791311000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":372,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.957497+0000","last_change":"2021-10-08T19:36:03.314076+0000","last_active":"2021-10-08T19:36:36.957497+0000","last_peered":"2021-10-08T19:36:36.957497+0000","last_clean":"2021-10-08T19:36:36.957497+0000","last_became_active":"2021-10-08T19:28:40.099543+0000","last_became_peered":"2021-10-08T19:28:40.099543+0000","last_unstale":"2021-10-08T19:36:36.957497+0000","last_undegraded":"2021-10-08T19:36:36.957497+0000","last_fullsized":"2021-10-08T19:36:36.957497+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:03.313977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:50.032367+0000","last_clean_scrub_stamp":"2021-10-08T19:36:03.313977+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.038973248000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"289'27","reported_seq":205,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.957634+0000","last_change":"2021-10-08T19:34:50.213817+0000","last_active":"2021-10-08T19:36:36.957634+0000","last_peered":"2021-10-08T19:36:36.957634+0000","last_clean":"2021-10-08T19:36:36.957634+0000","last_became_active":"2021-10-08T19:29:40.631002+0000","last_became_peered":"2021-10-08T19:29:40.631002+0000","last_unstale":"2021-10-08T19:36:36.957634+0000","last_undegraded":"2021-10-08T19:36:36.957634+0000","last_fullsized":"2021-10-08T19:36:36.957634+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'27","last_scrub_stamp":"2021-10-08T19:34:50.213690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:34:50.213690+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.016992080999999999,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":361,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.960893+0000","last_change":"2021-10-08T19:35:22.798375+0000","last_active":"2021-10-08T19:36:36.960893+0000","last_peered":"2021-10-08T19:36:36.960893+0000","last_clean":"2021-10-08T19:36:36.960893+0000","last_became_active":"2021-10-08T19:21:23.603422+0000","last_became_peered":"2021-10-08T19:21:23.603422+0000","last_unstale":"2021-10-08T19:36:36.960893+0000","last_undegraded":"2021-10-08T19:36:36.960893+0000","last_fullsized":"2021-10-08T19:36:36.960893+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:22.798309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:15.535842+0000","last_clean_scrub_stamp":"2021-10-08T19:35:22.798309+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0012757689999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":398,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.955631+0000","last_change":"2021-10-08T19:36:11.147338+0000","last_active":"2021-10-08T19:36:36.955631+0000","last_peered":"2021-10-08T19:36:36.955631+0000","last_clean":"2021-10-08T19:36:36.955631+0000","last_became_active":"2021-10-08T19:28:40.099286+0000","last_became_peered":"2021-10-08T19:28:40.099286+0000","last_unstale":"2021-10-08T19:36:36.955631+0000","last_undegraded":"2021-10-08T19:36:36.955631+0000","last_fullsized":"2021-10-08T19:36:36.955631+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:11.147246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:31.176160+0000","last_clean_scrub_stamp":"2021-10-08T19:36:11.147246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.005657235,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":171,"reported_epoch":386,"state":"active+clean","last_fresh":"2021-10-08T19:36:36.959449+0000","last_change":"2021-10-08T19:34:58.263999+0000","last_active":"2021-10-08T19:36:36.959449+0000","last_peered":"2021-10-08T19:36:36.959449+0000","last_clean":"2021-10-08T19:36:36.959449+0000","last_became_active":"2021-10-08T19:29:40.638221+0000","last_became_peered":"2021-10-08T19:29:40.638221+0000","last_unstale":"2021-10-08T19:36:36.959449+0000","last_undegraded":"2021-10-08T19:36:36.959449+0000","last_fullsized":"2021-10-08T19:36:36.959449+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:58.263883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:34:58.263883+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.050129448,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":6943801344,"num_objects":105954,"num_object_clones":0,"num_object_copies":317862,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105954,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105954,"num_write_kb":6781056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20836057088,"data_stored":20836057088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75254,"ondisk_log_size":75254,"up":48,"acting":48,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":11,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1430,"ondisk_log_size":1430,"up":33,"acting":33,"num_store_stats":8},{"poolid":3,"num_pg":23,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":740,"num_read_kb":740,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1167,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":69,"acting":69,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1113,"num_read_kb":870,"num_write":703,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":520,"num_bytes_recovered":10826,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":705,"ondisk_log_size":705,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":96,"acting":96,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201468,"num_pgs":75,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1956528,"kb_used_data":1690152,"kb_used_omap":0,"kb_used_meta":266368,"kb_avail":91788624,"statfs":{"total":95995035648,"available":93991550976,"internally_reserved":0,"allocated":1730715648,"data_stored":1730340930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":272760832},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:36:36 2021","interfaces":[{"interface":"back","average":{"1min":1.8160000000000001,"5min":1.4510000000000001,"15min":1.486},"min":{"1min":0.28199999999999997,"5min":0.20699999999999999,"15min":0.20100000000000001},"max":{"1min":4.9630000000000001,"5min":8.8160000000000007,"15min":32.366999999999997},"last":0.51900000000000002},{"interface":"front","average":{"1min":1.423,"5min":1.766,"15min":1.7010000000000001},"min":{"1min":0.22800000000000001,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":5.0439999999999996,"5min":17.018999999999998,"15min":29.736000000000001},"last":1.391}]},{"osd":1,"last update":"Fri Oct 8 19:36:36 2021","interfaces":[{"interface":"back","average":{"1min":2.1800000000000002,"5min":1.6639999999999999,"15min":1.772},"min":{"1min":0.215,"5min":0.19900000000000001,"15min":0.19600000000000001},"max":{"1min":6.2949999999999999,"5min":6.7699999999999996,"15min":26.044},"last":2.024},{"interface":"front","average":{"1min":1.5720000000000001,"5min":1.7869999999999999,"15min":1.6259999999999999},"min":{"1min":0.315,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":5.8810000000000002,"5min":17.056000000000001,"15min":28.119},"last":1.7370000000000001}]},{"osd":2,"last update":"Fri Oct 8 19:36:36 2021","interfaces":[{"interface":"back","average":{"1min":2.1099999999999999,"5min":1.5900000000000001,"15min":1.667},"min":{"1min":0.27600000000000002,"5min":0.255,"15min":0.255},"max":{"1min":4.8780000000000001,"5min":5.7130000000000001,"15min":27.018000000000001},"last":1.208},{"interface":"front","average":{"1min":1.617,"5min":1.4870000000000001,"15min":1.544},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":8.4090000000000007,"5min":8.4090000000000007,"15min":27.113},"last":8.2370000000000001}]},{"osd":3,"last update":"Fri Oct 8 19:36:36 2021","interfaces":[{"interface":"back","average":{"1min":2.6259999999999999,"5min":2.7719999999999998,"15min":2.1859999999999999},"min":{"1min":0.28199999999999997,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":10.444000000000001,"5min":72.093999999999994,"15min":72.093999999999994},"last":4.0880000000000001},{"interface":"front","average":{"1min":1.3700000000000001,"5min":2.6920000000000002,"15min":2.0840000000000001},"min":{"1min":0.374,"5min":0.28899999999999998,"15min":0.28000000000000003},"max":{"1min":3.8439999999999999,"5min":71.864999999999995,"15min":71.864999999999995},"last":2.992}]},{"osd":4,"last update":"Fri Oct 8 19:36:36 2021","interfaces":[{"interface":"back","average":{"1min":1.671,"5min":1.095,"15min":0.89100000000000001},"min":{"1min":0.26800000000000002,"5min":0.23899999999999999,"15min":0.22800000000000001},"max":{"1min":4.9889999999999999,"5min":8.391,"15min":8.391},"last":2.8940000000000001},{"interface":"front","average":{"1min":1.9199999999999999,"5min":1.5169999999999999,"15min":0.98099999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":11.622,"5min":11.622,"15min":11.622},"last":2.6080000000000001}]},{"osd":5,"last update":"Fri Oct 8 19:36:36 2021","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.147,"15min":0.99299999999999999},"min":{"1min":0.31900000000000001,"5min":0.26800000000000002,"15min":0.251},"max":{"1min":4.8440000000000003,"5min":6.5389999999999997,"15min":9.9280000000000008},"last":2.339},{"interface":"front","average":{"1min":1.9930000000000001,"5min":1.617,"15min":1.056},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.26100000000000001},"max":{"1min":10.435,"5min":16.093,"15min":18.655000000000001},"last":2.4620000000000002}]},{"osd":6,"last update":"Fri Oct 8 19:36:36 2021","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.3959999999999999,"15min":1.048},"min":{"1min":0.307,"5min":0.307,"15min":0.27900000000000003},"max":{"1min":3.7240000000000002,"5min":17.082000000000001,"15min":17.082000000000001},"last":1.9319999999999999},{"interface":"front","average":{"1min":1.8029999999999999,"5min":1.2729999999999999,"15min":1.03},"min":{"1min":0.34300000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":6.8150000000000004,"5min":6.8150000000000004,"15min":7.742},"last":2.4780000000000002}]}]},{"osd":6,"up_from":47,"seq":201863463104,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3159832,"kb_used_data":2932368,"kb_used_omap":0,"kb_used_meta":227456,"kb_avail":90585320,"statfs":{"total":95995035648,"available":92759367680,"internally_reserved":0,"allocated":3002744832,"data_stored":3002393167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":232914944},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:36:17 2021","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":0.95399999999999996,"15min":1.222},"min":{"1min":0.28000000000000003,"5min":0.20899999999999999,"15min":0.20100000000000001},"max":{"1min":4.242,"5min":5.194,"15min":28.382999999999999},"last":0.23200000000000001},{"interface":"front","average":{"1min":2.0590000000000002,"5min":1.609,"15min":1.8029999999999999},"min":{"1min":0.309,"5min":0.22600000000000001,"15min":0.21299999999999999},"max":{"1min":8.4619999999999997,"5min":8.4619999999999997,"15min":69.477000000000004},"last":1.855}]},{"osd":1,"last update":"Fri Oct 8 19:36:17 2021","interfaces":[{"interface":"back","average":{"1min":1.9339999999999999,"5min":1.5229999999999999,"15min":1.1870000000000001},"min":{"1min":0.26500000000000001,"5min":0.23699999999999999,"15min":0.23000000000000001},"max":{"1min":6.1050000000000004,"5min":6.1050000000000004,"15min":14.878},"last":3.746},{"interface":"front","average":{"1min":1.6339999999999999,"5min":1.341,"15min":1.2270000000000001},"min":{"1min":0.31,"5min":0.253,"15min":0.253},"max":{"1min":7.0090000000000003,"5min":7.0090000000000003,"15min":14.779},"last":0.29299999999999998}]},{"osd":2,"last update":"Fri Oct 8 19:36:17 2021","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.1499999999999999,"15min":1.5840000000000001},"min":{"1min":0.33100000000000002,"5min":0.27400000000000002,"15min":0.251},"max":{"1min":5.8899999999999997,"5min":6.7960000000000003,"15min":69.322999999999993},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.629,"5min":1.6559999999999999,"15min":1.839},"min":{"1min":0.33700000000000002,"5min":0.315,"15min":0.245},"max":{"1min":5.133,"5min":8.3710000000000004,"15min":69.418999999999997},"last":3.802}]},{"osd":3,"last update":"Fri Oct 8 19:36:17 2021","interfaces":[{"interface":"back","average":{"1min":1.5920000000000001,"5min":1.5309999999999999,"15min":1.4990000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.27900000000000003},"max":{"1min":5.4219999999999997,"5min":7.2910000000000004,"15min":21.670000000000002},"last":2.302},{"interface":"front","average":{"1min":1.5620000000000001,"5min":1.266,"15min":1.3220000000000001},"min":{"1min":0.41599999999999998,"5min":0.29099999999999998,"15min":0.28000000000000003},"max":{"1min":5.5220000000000002,"5min":8.3360000000000003,"15min":22.254999999999999},"last":0.317}]},{"osd":4,"last update":"Fri Oct 8 19:36:17 2021","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.1379999999999999,"15min":0.90100000000000002},"min":{"1min":0.28599999999999998,"5min":0.28100000000000003,"15min":0.254},"max":{"1min":5.0679999999999996,"5min":6.4459999999999997,"15min":24.516999999999999},"last":3.7610000000000001},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.1419999999999999,"15min":1.087},"min":{"1min":0.33100000000000002,"5min":0.27700000000000002,"15min":0.26100000000000001},"max":{"1min":5.8070000000000004,"5min":5.8070000000000004,"15min":69.593999999999994},"last":2.121}]},{"osd":5,"last update":"Fri Oct 8 19:36:17 2021","interfaces":[{"interface":"back","average":{"1min":1.4199999999999999,"5min":3.0640000000000001,"15min":1.5469999999999999},"min":{"1min":0.307,"5min":0.30399999999999999,"15min":0.28499999999999998},"max":{"1min":4.3209999999999997,"5min":107.485,"15min":107.485},"last":1.8979999999999999},{"interface":"front","average":{"1min":2.0920000000000001,"5min":3.177,"15min":1.8320000000000001},"min":{"1min":0.34399999999999997,"5min":0.31,"15min":0.252},"max":{"1min":7.4900000000000002,"5min":107.90300000000001,"15min":107.90300000000001},"last":6.952}]},{"osd":7,"last update":"Fri Oct 8 19:35:44 2021","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":1.135,"15min":0.82999999999999996},"min":{"1min":0.32200000000000001,"5min":0.29599999999999999,"15min":0.27800000000000002},"max":{"1min":2.823,"5min":7.1230000000000002,"15min":7.1230000000000002},"last":0.372},{"interface":"front","average":{"1min":1.161,"5min":1.272,"15min":1.008},"min":{"1min":0.38400000000000001,"5min":0.32800000000000001,"15min":0.313},"max":{"1min":4.6699999999999999,"5min":4.6699999999999999,"15min":15.962},"last":5.0759999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575059,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1574216,"kb_used_data":1258048,"kb_used_omap":0,"kb_used_meta":316160,"kb_avail":92170936,"statfs":{"total":95995035648,"available":94383038464,"internally_reserved":0,"allocated":1288241152,"data_stored":1287841153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":323747840},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:36:01 2021","interfaces":[{"interface":"back","average":{"1min":3.5099999999999998,"5min":2.96,"15min":3.1589999999999998},"min":{"1min":0.188,"5min":0.188,"15min":0.184},"max":{"1min":40.173000000000002,"5min":102.352,"15min":126.256},"last":0.23499999999999999},{"interface":"front","average":{"1min":3.3820000000000001,"5min":3.0099999999999998,"15min":3.3940000000000001},"min":{"1min":0.25600000000000001,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":40.337000000000003,"5min":102.462,"15min":126.176},"last":3.774}]},{"osd":2,"last update":"Fri Oct 8 19:36:16 2021","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":2.4609999999999999,"15min":2.3250000000000002},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.192},"max":{"1min":11.497,"5min":102.395,"15min":102.395},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.94499999999999995,"5min":2.5800000000000001,"15min":2.6269999999999998},"min":{"1min":0.27600000000000002,"5min":0.253,"15min":0.22700000000000001},"max":{"1min":3.7919999999999998,"5min":102.50700000000001,"15min":102.50700000000001},"last":5.8760000000000003}]},{"osd":3,"last update":"Fri Oct 8 19:36:33 2021","interfaces":[{"interface":"back","average":{"1min":1.597,"5min":2.0179999999999998,"15min":2.8090000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":4.6239999999999997,"5min":33.655000000000001,"15min":105.836},"last":4.0289999999999999},{"interface":"front","average":{"1min":1.2370000000000001,"5min":2.004,"15min":2.6589999999999998},"min":{"1min":0.27700000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":4.7400000000000002,"5min":33.582999999999998,"15min":106.12},"last":0.67300000000000004}]},{"osd":4,"last update":"Fri Oct 8 19:35:45 2021","interfaces":[{"interface":"back","average":{"1min":1.7210000000000001,"5min":2.7160000000000002,"15min":1.9419999999999999},"min":{"1min":0.34599999999999997,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":6.7649999999999997,"5min":103.538,"15min":103.538},"last":0.39700000000000002},{"interface":"front","average":{"1min":1.28,"5min":2.4580000000000002,"15min":1.569},"min":{"1min":0.34999999999999998,"5min":0.27100000000000002,"15min":0.254},"max":{"1min":11.337999999999999,"5min":102.67100000000001,"15min":102.67100000000001},"last":0.45600000000000002}]},{"osd":5,"last update":"Fri Oct 8 19:36:11 2021","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":5.7439999999999998,"15min":3.0459999999999998},"min":{"1min":0.28599999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":3.9980000000000002,"5min":262.14100000000002,"15min":262.14100000000002},"last":3.8279999999999998},{"interface":"front","average":{"1min":1.5409999999999999,"5min":5.8869999999999996,"15min":2.7749999999999999},"min":{"1min":0.33500000000000002,"5min":0.30099999999999999,"15min":0.29999999999999999},"max":{"1min":11.414999999999999,"5min":261.959,"15min":261.959},"last":0.51800000000000002}]},{"osd":6,"last update":"Fri Oct 8 19:36:29 2021","interfaces":[{"interface":"back","average":{"1min":1.97,"5min":1.5309999999999999,"15min":2.0409999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.26700000000000002},"max":{"1min":5.8490000000000002,"5min":7.024,"15min":103.73},"last":0.35999999999999999},{"interface":"front","average":{"1min":1.486,"5min":1.3660000000000001,"15min":2.0019999999999998},"min":{"1min":0.377,"5min":0.34399999999999997,"15min":0.28399999999999997},"max":{"1min":4.2699999999999996,"5min":4.6349999999999998,"15min":102.753},"last":4.1029999999999998}]},{"osd":7,"last update":"Fri Oct 8 19:35:45 2021","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":3.7170000000000001,"15min":2.3860000000000001},"min":{"1min":0.42499999999999999,"5min":0.316,"15min":0.312},"max":{"1min":2.1139999999999999,"5min":106.011,"15min":106.011},"last":3.8700000000000001},{"interface":"front","average":{"1min":1.514,"5min":3.8330000000000002,"15min":2.0630000000000002},"min":{"1min":0.44600000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":11.445,"5min":103.78400000000001,"15min":103.78400000000001},"last":0.48899999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738582,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":4475756,"kb_used_data":4181412,"kb_used_omap":0,"kb_used_meta":294336,"kb_avail":89269396,"statfs":{"total":95995035648,"available":91411861504,"internally_reserved":0,"allocated":4281765888,"data_stored":4281394090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":301400064},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 8 19:35:54 2021","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":2.2090000000000001,"15min":2.0720000000000001},"min":{"1min":0.20399999999999999,"5min":0.185,"15min":0.185},"max":{"1min":4.1059999999999999,"5min":91.954999999999998,"15min":91.954999999999998},"last":0.35799999999999998},{"interface":"front","average":{"1min":1.0760000000000001,"5min":2.8250000000000002,"15min":2.2400000000000002},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":5.7750000000000004,"5min":91.046000000000006,"15min":91.046000000000006},"last":0.54000000000000004}]},{"osd":2,"last update":"Fri Oct 8 19:36:19 2021","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.458,"15min":2.0110000000000001},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":3.9540000000000002,"5min":9.6129999999999995,"15min":62.390000000000001},"last":7.8659999999999997},{"interface":"front","average":{"1min":1.6519999999999999,"5min":1.611,"15min":1.9419999999999999},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.19500000000000001},"max":{"1min":7.0640000000000001,"5min":10.026,"15min":62.718000000000004},"last":3.8919999999999999}]},{"osd":3,"last update":"Fri Oct 8 19:36:41 2021","interfaces":[{"interface":"back","average":{"1min":1.6359999999999999,"5min":1.915,"15min":2.2549999999999999},"min":{"1min":0.307,"5min":0.218,"15min":0.217},"max":{"1min":9.7690000000000001,"5min":12.138,"15min":62.491},"last":0.44400000000000001},{"interface":"front","average":{"1min":2.1179999999999999,"5min":1.6459999999999999,"15min":2.036},"min":{"1min":0.26100000000000001,"5min":0.22600000000000001,"15min":0.20899999999999999},"max":{"1min":10.026999999999999,"5min":10.052,"15min":62.673000000000002},"last":0.57299999999999995}]},{"osd":4,"last update":"Fri Oct 8 19:35:54 2021","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.6599999999999999,"15min":1.593},"min":{"1min":0.34100000000000003,"5min":0.25800000000000001,"15min":0.22900000000000001},"max":{"1min":5.7759999999999998,"5min":16.805,"15min":16.805},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.90000000000000002,"5min":1.3560000000000001,"15min":1.377},"min":{"1min":0.34399999999999997,"5min":0.30299999999999999,"15min":0.28199999999999997},"max":{"1min":4.0650000000000004,"5min":7.0890000000000004,"15min":11.823},"last":0.46999999999999997}]},{"osd":5,"last update":"Fri Oct 8 19:36:11 2021","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":1.446,"15min":1.302},"min":{"1min":0.39900000000000002,"5min":0.311,"15min":0.24099999999999999},"max":{"1min":2.2970000000000002,"5min":9.9529999999999994,"15min":15.56},"last":0.71899999999999997},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.599,"15min":1.599},"min":{"1min":0.33100000000000002,"5min":0.31900000000000001,"15min":0.28599999999999998},"max":{"1min":4.4390000000000001,"5min":15.115,"15min":15.484999999999999},"last":0.58699999999999997}]},{"osd":6,"last update":"Fri Oct 8 19:36:25 2021","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":1.478,"15min":1.508},"min":{"1min":0.45900000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":4.5469999999999997,"5min":7.165,"15min":11.869},"last":0.51500000000000001},{"interface":"front","average":{"1min":1.373,"5min":1.5389999999999999,"15min":1.4730000000000001},"min":{"1min":0.32200000000000001,"5min":0.28199999999999997,"15min":0.27500000000000002},"max":{"1min":6.8029999999999999,"5min":9.9990000000000006,"15min":10.519},"last":0.68400000000000005}]},{"osd":7,"last update":"Fri Oct 8 19:36:41 2021","interfaces":[{"interface":"back","average":{"1min":1.7310000000000001,"5min":1.607,"15min":1.708},"min":{"1min":0.379,"5min":0.379,"15min":0.35399999999999998},"max":{"1min":5.8150000000000004,"5min":6.2699999999999996,"15min":11.669},"last":0.65900000000000003},{"interface":"front","average":{"1min":1.6559999999999999,"5min":1.714,"15min":1.76},"min":{"1min":0.45900000000000002,"5min":0.34999999999999998,"15min":0.33400000000000002},"max":{"1min":4.7169999999999996,"5min":7.2279999999999998,"15min":11.898999999999999},"last":0.49399999999999999}]}]},{"osd":2,"up_from":18,"seq":77309411534,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2782812,"kb_used_data":2525844,"kb_used_omap":0,"kb_used_meta":256960,"kb_avail":90962340,"statfs":{"total":95995035648,"available":93145436160,"internally_reserved":0,"allocated":2586464256,"data_stored":2586108893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":263127040},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:36:08 2021","interfaces":[{"interface":"back","average":{"1min":1.9470000000000001,"5min":1.4299999999999999,"15min":2.2589999999999999},"min":{"1min":0.19900000000000001,"5min":0.184,"15min":0.184},"max":{"1min":10.83,"5min":17.491,"15min":61.670999999999999},"last":1.528},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.4350000000000001,"15min":2.242},"min":{"1min":0.26700000000000002,"5min":0.215,"15min":0.17999999999999999},"max":{"1min":5.5510000000000002,"5min":7.8049999999999997,"15min":65.284999999999997},"last":0.73099999999999998}]},{"osd":1,"last update":"Fri Oct 8 19:36:08 2021","interfaces":[{"interface":"back","average":{"1min":1.677,"5min":3.0609999999999999,"15min":2.5619999999999998},"min":{"1min":0.22900000000000001,"5min":0.19700000000000001,"15min":0.192},"max":{"1min":9.3059999999999992,"5min":63.738,"15min":63.738},"last":1.071},{"interface":"front","average":{"1min":1.375,"5min":3.2309999999999999,"15min":2.798},"min":{"1min":0.26000000000000001,"5min":0.23899999999999999,"15min":0.21299999999999999},"max":{"1min":5.5789999999999997,"5min":63.619999999999997,"15min":63.619999999999997},"last":1.9530000000000001}]},{"osd":3,"last update":"Fri Oct 8 19:36:18 2021","interfaces":[{"interface":"back","average":{"1min":1.5409999999999999,"5min":3.2429999999999999,"15min":2.7629999999999999},"min":{"1min":0.27300000000000002,"5min":0.254,"15min":0.21199999999999999},"max":{"1min":5.742,"5min":63.658999999999999,"15min":65.322999999999993},"last":0.755},{"interface":"front","average":{"1min":1.8069999999999999,"5min":2.8610000000000002,"15min":2.6579999999999999},"min":{"1min":0.26100000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":9.218,"5min":65.418000000000006,"15min":65.418000000000006},"last":1.9430000000000001}]},{"osd":4,"last update":"Fri Oct 8 19:35:45 2021","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.111,"15min":1.391},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.26900000000000002},"max":{"1min":6.5380000000000003,"5min":6.5380000000000003,"15min":24.657},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.83299999999999996,"5min":1.3280000000000001,"15min":1.4690000000000001},"min":{"1min":0.314,"5min":0.28299999999999997,"15min":0.26600000000000001},"max":{"1min":5.524,"5min":7.7469999999999999,"15min":15.143000000000001},"last":0.47199999999999998}]},{"osd":5,"last update":"Fri Oct 8 19:36:08 2021","interfaces":[{"interface":"back","average":{"1min":1.9099999999999999,"5min":1.702,"15min":1.5880000000000001},"min":{"1min":0.35799999999999998,"5min":0.315,"15min":0.28899999999999998},"max":{"1min":5.625,"5min":7.7409999999999997,"15min":15.087999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":1.915,"5min":1.516,"15min":1.607},"min":{"1min":0.44400000000000001,"5min":0.29499999999999998,"15min":0.27600000000000002},"max":{"1min":8.1769999999999996,"5min":10.862,"15min":26.094000000000001},"last":1.0009999999999999}]},{"osd":6,"last update":"Fri Oct 8 19:36:18 2021","interfaces":[{"interface":"back","average":{"1min":2.3359999999999999,"5min":1.2509999999999999,"15min":1.488},"min":{"1min":0.33900000000000002,"5min":0.29999999999999999,"15min":0.28000000000000003},"max":{"1min":6.6909999999999998,"5min":6.6909999999999998,"15min":14.162000000000001},"last":0.91400000000000003},{"interface":"front","average":{"1min":2.5830000000000002,"5min":1.6990000000000001,"15min":1.637},"min":{"1min":0.46999999999999997,"5min":0.33600000000000002,"15min":0.313},"max":{"1min":8.7829999999999995,"5min":8.7829999999999995,"15min":16.68},"last":1.0309999999999999}]},{"osd":7,"last update":"Fri Oct 8 19:35:45 2021","interfaces":[{"interface":"back","average":{"1min":1.512,"5min":3.1680000000000001,"15min":2.1230000000000002},"min":{"1min":0.32600000000000001,"5min":0.32200000000000001,"15min":0.31900000000000001},"max":{"1min":6.4119999999999999,"5min":136.00200000000001,"15min":136.00200000000001},"last":0.89600000000000002},{"interface":"front","average":{"1min":1.345,"5min":3.056,"15min":2.044},"min":{"1min":0.41499999999999998,"5min":0.36399999999999999,"15min":0.34899999999999998},"max":{"1min":3.9049999999999998,"5min":133.26300000000001,"15min":133.26300000000001},"last":1.0509999999999999}]}]},{"osd":3,"up_from":24,"seq":103079215308,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2476800,"kb_used_data":2132280,"kb_used_omap":0,"kb_used_meta":344512,"kb_avail":91268352,"statfs":{"total":95995035648,"available":93458792448,"internally_reserved":0,"allocated":2183454720,"data_stored":2183063503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":352780288},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:36:31 2021","interfaces":[{"interface":"back","average":{"1min":1.669,"5min":1.9119999999999999,"15min":2.419},"min":{"1min":0.222,"5min":0.187,"15min":0.17000000000000001},"max":{"1min":6.391,"5min":13.036,"15min":109.601},"last":2.879},{"interface":"front","average":{"1min":1.661,"5min":1.3500000000000001,"15min":2.3279999999999998},"min":{"1min":0.21199999999999999,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":5.5060000000000002,"5min":10.997,"15min":107.84},"last":0.33500000000000002}]},{"osd":1,"last update":"Fri Oct 8 19:36:31 2021","interfaces":[{"interface":"back","average":{"1min":1.546,"5min":1.9450000000000001,"15min":1.9870000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.20999999999999999},"max":{"1min":5.3959999999999999,"5min":37.271999999999998,"15min":37.271999999999998},"last":0.38600000000000001},{"interface":"front","average":{"1min":1.222,"5min":1.6930000000000001,"15min":1.899},"min":{"1min":0.26700000000000002,"5min":0.215,"15min":0.19},"max":{"1min":4.1369999999999996,"5min":37.033000000000001,"15min":37.033000000000001},"last":2.5659999999999998}]},{"osd":2,"last update":"Fri Oct 8 19:36:31 2021","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.0309999999999999,"15min":1.857},"min":{"1min":0.27600000000000002,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":4.274,"5min":6.2699999999999996,"15min":32.277000000000001},"last":0.502},{"interface":"front","average":{"1min":1.6830000000000001,"5min":1.9610000000000001,"15min":1.913},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":7.6150000000000002,"5min":23.189,"15min":23.189},"last":2.911}]},{"osd":4,"last update":"Fri Oct 8 19:35:46 2021","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.7030000000000001,"15min":1.53},"min":{"1min":0.30499999999999999,"5min":0.29199999999999998,"15min":0.25600000000000001},"max":{"1min":7.3849999999999998,"5min":13.968,"15min":18.064},"last":2.9470000000000001},{"interface":"front","average":{"1min":1.335,"5min":1.482,"15min":1.6419999999999999},"min":{"1min":0.42499999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":7.5069999999999997,"5min":10.632,"15min":18.692},"last":1.548}]},{"osd":5,"last update":"Fri Oct 8 19:36:04 2021","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":2.1030000000000002,"15min":1.7070000000000001},"min":{"1min":0.33400000000000002,"5min":0.28299999999999997,"15min":0.27000000000000002},"max":{"1min":1.369,"5min":75.397000000000006,"15min":75.397000000000006},"last":0.317},{"interface":"front","average":{"1min":1.21,"5min":2.9409999999999998,"15min":1.9810000000000001},"min":{"1min":0.34000000000000002,"5min":0.311,"15min":0.28100000000000003},"max":{"1min":5.4770000000000003,"5min":75.680000000000007,"15min":75.680000000000007},"last":2.9300000000000002}]},{"osd":6,"last update":"Fri Oct 8 19:36:19 2021","interfaces":[{"interface":"back","average":{"1min":1.885,"5min":1.6579999999999999,"15min":1.849},"min":{"1min":0.45300000000000001,"5min":0.33900000000000002,"15min":0.28599999999999998},"max":{"1min":9.5,"5min":9.5,"15min":21.538},"last":0.36399999999999999},{"interface":"front","average":{"1min":1.331,"5min":1.3089999999999999,"15min":1.5349999999999999},"min":{"1min":0.36499999999999999,"5min":0.35599999999999998,"15min":0.32700000000000001},"max":{"1min":7.5010000000000003,"5min":7.5010000000000003,"15min":13.298},"last":0.46600000000000003}]},{"osd":7,"last update":"Fri Oct 8 19:35:46 2021","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.7190000000000001,"15min":1.6000000000000001},"min":{"1min":0.38100000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":7.5780000000000003,"5min":10.656000000000001,"15min":10.696999999999999},"last":1.04},{"interface":"front","average":{"1min":0.63600000000000001,"5min":1.353,"15min":1.488},"min":{"1min":0.38,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.875,"5min":7.165,"15min":13.225},"last":2.2549999999999999}]}]},{"osd":4,"up_from":30,"seq":128849019078,"num_pgs":74,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3581880,"kb_used_data":3359280,"kb_used_omap":0,"kb_used_meta":222592,"kb_avail":90163272,"statfs":{"total":95995035648,"available":92327190528,"internally_reserved":0,"allocated":3439902720,"data_stored":3439519674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":227934208},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,3,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:35:47 2021","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":1.0209999999999999,"15min":1.71},"min":{"1min":0.217,"5min":0.20899999999999999,"15min":0.185},"max":{"1min":2.7999999999999998,"5min":7.1319999999999997,"15min":82.109999999999999},"last":0.22900000000000001},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.1990000000000001,"15min":1.712},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.20399999999999999},"max":{"1min":4.6559999999999997,"5min":7.0330000000000004,"15min":82.025999999999996},"last":3.379}]},{"osd":1,"last update":"Fri Oct 8 19:35:47 2021","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":3.1880000000000002,"15min":2.1120000000000001},"min":{"1min":0.28100000000000003,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":4.0289999999999999,"5min":122.422,"15min":122.422},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.85599999999999998,"5min":2.9409999999999998,"15min":1.8580000000000001},"min":{"1min":0.25,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":3.6070000000000002,"5min":123.122,"15min":123.122},"last":4.5430000000000001}]},{"osd":2,"last update":"Fri Oct 8 19:35:47 2021","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":1.25,"15min":1.3160000000000001},"min":{"1min":0.41399999999999998,"5min":0.26100000000000001,"15min":0.23499999999999999},"max":{"1min":2.8900000000000001,"5min":7.9189999999999996,"15min":21.257000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.89800000000000002,"5min":1.21,"15min":1.3180000000000001},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":4.6349999999999998,"5min":5.0270000000000001,"15min":21.600000000000001},"last":3.4329999999999998}]},{"osd":3,"last update":"Fri Oct 8 19:35:47 2021","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":1.5209999999999999,"15min":1.9910000000000001},"min":{"1min":0.30599999999999999,"5min":0.28699999999999998,"15min":0.26500000000000001},"max":{"1min":4.5990000000000002,"5min":7.4130000000000003,"15min":58.506999999999998},"last":3.411},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.5669999999999999,"15min":1.732},"min":{"1min":0.38400000000000001,"5min":0.254,"15min":0.254},"max":{"1min":8.5540000000000003,"5min":8.5540000000000003,"15min":58.521000000000001},"last":0.58999999999999997}]},{"osd":5,"last update":"Fri Oct 8 19:36:07 2021","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.288,"15min":0.84999999999999998},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.222},"max":{"1min":3.327,"5min":7.101,"15min":7.101},"last":0.39800000000000002},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.1180000000000001,"15min":0.80300000000000005},"min":{"1min":0.35299999999999998,"5min":0.27700000000000002,"15min":0.22900000000000001},"max":{"1min":3.0019999999999998,"5min":7.8029999999999999,"15min":8.1319999999999997},"last":1.5669999999999999}]},{"osd":6,"last update":"Fri Oct 8 19:36:24 2021","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.0029999999999999,"15min":0.81399999999999995},"min":{"1min":0.32200000000000001,"5min":0.28699999999999998,"15min":0.23599999999999999},"max":{"1min":4.1879999999999997,"5min":5.4800000000000004,"15min":6.7300000000000004},"last":3.3540000000000001},{"interface":"front","average":{"1min":1.28,"5min":1.1379999999999999,"15min":0.873},"min":{"1min":0.35699999999999998,"5min":0.26600000000000001,"15min":0.247},"max":{"1min":3.8620000000000001,"5min":6.1319999999999997,"15min":7.0720000000000001},"last":4.2009999999999996}]},{"osd":7,"last update":"Fri Oct 8 19:35:47 2021","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.1160000000000001,"15min":0.80400000000000005},"min":{"1min":0.33200000000000002,"5min":0.31,"15min":0.26400000000000001},"max":{"1min":6.157,"5min":8.0050000000000008,"15min":8.0050000000000008},"last":1.609},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.042,"15min":0.86399999999999999},"min":{"1min":0.42599999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":4.665,"5min":4.665,"15min":6.3959999999999999},"last":7.4779999999999998}]}]},{"osd":5,"up_from":38,"seq":163208757442,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2427816,"kb_used_data":2118304,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":91317336,"statfs":{"total":95995035648,"available":93508952064,"internally_reserved":0,"allocated":2169143296,"data_stored":2168777002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:36:05 2021","interfaces":[{"interface":"back","average":{"1min":3.0329999999999999,"5min":1.6379999999999999,"15min":1.383},"min":{"1min":0.23799999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":43.332999999999998,"5min":43.332999999999998,"15min":43.332999999999998},"last":0.25700000000000001},{"interface":"front","average":{"1min":3.161,"5min":1.7170000000000001,"15min":1.381},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":42.637,"5min":42.637,"15min":42.637},"last":2.8010000000000002}]},{"osd":1,"last update":"Fri Oct 8 19:36:05 2021","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":2.0249999999999999,"15min":1.6339999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23000000000000001},"max":{"1min":4.6059999999999999,"5min":94.558999999999997,"15min":94.558999999999997},"last":2.8969999999999998},{"interface":"front","average":{"1min":0.94999999999999996,"5min":1.9430000000000001,"15min":1.577},"min":{"1min":0.40100000000000002,"5min":0.23899999999999999,"15min":0.23100000000000001},"max":{"1min":3.9729999999999999,"5min":94.456999999999994,"15min":94.456999999999994},"last":0.39500000000000002}]},{"osd":2,"last update":"Fri Oct 8 19:36:05 2021","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":1.2450000000000001,"15min":1.5389999999999999},"min":{"1min":0.29799999999999999,"5min":0.27000000000000002,"15min":0.25700000000000001},"max":{"1min":3.452,"5min":8.1259999999999994,"15min":29.398},"last":1.6830000000000001},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.2190000000000001,"15min":1.5249999999999999},"min":{"1min":0.38500000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":4.0730000000000004,"5min":8.3599999999999994,"15min":29.387},"last":1.6359999999999999}]},{"osd":3,"last update":"Fri Oct 8 19:36:05 2021","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.847,"15min":1.599},"min":{"1min":0.33900000000000002,"5min":0.27000000000000002,"15min":0.26200000000000001},"max":{"1min":3.8130000000000002,"5min":11.685,"15min":12.356},"last":0.316},{"interface":"front","average":{"1min":1.6659999999999999,"5min":1.6140000000000001,"15min":1.6870000000000001},"min":{"1min":0.38100000000000001,"5min":0.218,"15min":0.218},"max":{"1min":8.9920000000000009,"5min":8.9920000000000009,"15min":21.504000000000001},"last":2.8340000000000001}]},{"osd":4,"last update":"Fri Oct 8 19:36:05 2021","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.96799999999999997,"15min":0.745},"min":{"1min":0.28199999999999997,"5min":0.25800000000000001,"15min":0.224},"max":{"1min":4.0990000000000002,"5min":9.2759999999999998,"15min":9.2759999999999998},"last":0.36599999999999999},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.044,"15min":0.76800000000000002},"min":{"1min":0.36499999999999999,"5min":0.27100000000000002,"15min":0.23799999999999999},"max":{"1min":4.569,"5min":7.8959999999999999,"15min":7.8959999999999999},"last":0.34999999999999998}]},{"osd":6,"last update":"Fri Oct 8 19:36:24 2021","interfaces":[{"interface":"back","average":{"1min":1.4750000000000001,"5min":0.99399999999999999,"15min":0.84199999999999997},"min":{"1min":0.30099999999999999,"5min":0.255,"15min":0.255},"max":{"1min":4.0510000000000002,"5min":5.8879999999999999,"15min":7.266},"last":0.33600000000000002},{"interface":"front","average":{"1min":1.609,"5min":1.1160000000000001,"15min":0.84599999999999997},"min":{"1min":0.35699999999999998,"5min":0.29199999999999998,"15min":0.29099999999999998},"max":{"1min":7.9349999999999996,"5min":7.9390000000000001,"15min":7.9390000000000001},"last":2.7080000000000002}]},{"osd":7,"last update":"Fri Oct 8 19:36:42 2021","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.3720000000000001,"15min":0.95299999999999996},"min":{"1min":0.31900000000000001,"5min":0.252,"15min":0.252},"max":{"1min":3.415,"5min":29.946999999999999,"15min":29.946999999999999},"last":2.8620000000000001},{"interface":"front","average":{"1min":1.589,"5min":1.446,"15min":1.0489999999999999},"min":{"1min":0.33300000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":4.2560000000000002,"5min":29.294,"15min":29.294},"last":0.46000000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":266240,"data_stored":262688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":327680,"data_stored":327680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4321378304,"data_stored":4321378304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1294729216,"data_stored":1294729216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2610036736,"data_stored":2610036736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2184839168,"data_stored":2184839168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":3471638528,"data_stored":3471638528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":2185428992,"data_stored":2185428992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3023634432,"data_stored":3023634432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1744371712,"data_stored":1744371712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-10-08T19:36:47.426 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2021-10-08T19:36:47.427 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd pool set .rgw.root pg_num 42 2021-10-08T19:36:47.468 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:36:47.475 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:47.477 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:36:47.578 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:36:47.659 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:47.879 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:36:47.986 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:36:47.994 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:47.995 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:36:48.096 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:36:48.151 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:48 smithi097 ceph-mon[41966]: pgmap v769: 178 pgs: 178 active+clean; 6.5 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 1.0 KiB/s rd, 62 MiB/s wr, 985 op/s 2021-10-08T19:36:48.151 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:48 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:36:48.152 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:48 smithi097 ceph-mon[32687]: pgmap v769: 178 pgs: 178 active+clean; 6.5 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 1.0 KiB/s rd, 62 MiB/s wr, 985 op/s 2021-10-08T19:36:48.152 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:48 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:36:48.173 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2021-10-08T19:36:48.173 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:36:48.174 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:48.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:48 smithi117 ceph-mon[34585]: pgmap v769: 178 pgs: 178 active+clean; 6.5 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 1.0 KiB/s rd, 62 MiB/s wr, 985 op/s 2021-10-08T19:36:48.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:48 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:36:48.408 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 82 16 110572 110556 84.207 58.125 0.0210654 0.011871 2021-10-08T19:36:48.669 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:36:48.675 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:48.678 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:36:48.779 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:36:48.830 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:48.916 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:36:48.922 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:48.924 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:36:48.971 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:36:48 smithi097 conmon[33110]: 172.21.15.117 - - [08/Oct/2021:19:36:48] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:36:49.025 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:36:49.072 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:49.407 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 83 16 111673 111657 84.0216 68.8125 0.0101993 0.0118976 2021-10-08T19:36:49.575 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:36:49.582 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:49.583 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:36:49.684 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:36:49.729 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2021-10-08T19:36:49.731 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:36:49.739 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:49.834 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:49 smithi097 ceph-mon[32687]: 10.d scrub ok 2021-10-08T19:36:49.835 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:49 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:36:49.835 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:49 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:36:49.835 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:49 smithi097 ceph-mon[32687]: 172.21.15.117 - - [08/Oct/2021:19:36:48] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:36:49.885 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:36:49.891 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:49.892 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:36:49.993 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:36:50.061 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:50.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:49 smithi117 ceph-mon[34585]: 10.d scrub ok 2021-10-08T19:36:50.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:49 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:36:50.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:49 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:36:50.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:49 smithi117 ceph-mon[34585]: 172.21.15.117 - - [08/Oct/2021:19:36:48] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:36:50.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:49 smithi117 ceph-mon[34585]: pgmap v770: 178 pgs: 1 active+clean+scrubbing, 177 active+clean; 6.7 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1023 B/s rd, 69 MiB/s wr, 1.10k op/s 2021-10-08T19:36:50.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:49 smithi117 ceph-mon[34585]: 6.8 scrub ok 2021-10-08T19:36:50.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:49 smithi117 ceph-mon[34585]: 2.11 scrub ok 2021-10-08T19:36:50.157 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:36:50.159 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:50.161 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:36:50.162 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:49 smithi097 ceph-mon[41966]: 10.d scrub ok 2021-10-08T19:36:50.162 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:49 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:36:50.162 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:49 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:36:50.163 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:49 smithi097 ceph-mon[41966]: 172.21.15.117 - - [08/Oct/2021:19:36:48] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:36:50.163 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:49 smithi097 ceph-mon[41966]: pgmap v770: 178 pgs: 1 active+clean+scrubbing, 177 active+clean; 6.7 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1023 B/s rd, 69 MiB/s wr, 1.10k op/s 2021-10-08T19:36:50.163 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:49 smithi097 ceph-mon[41966]: 6.8 scrub ok 2021-10-08T19:36:50.164 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:49 smithi097 ceph-mon[41966]: 2.11 scrub ok 2021-10-08T19:36:50.168 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:49 smithi097 ceph-mon[32687]: pgmap v770: 178 pgs: 1 active+clean+scrubbing, 177 active+clean; 6.7 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1023 B/s rd, 69 MiB/s wr, 1.10k op/s 2021-10-08T19:36:50.169 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:49 smithi097 ceph-mon[32687]: 6.8 scrub ok 2021-10-08T19:36:50.169 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:49 smithi097 ceph-mon[32687]: 2.11 scrub ok 2021-10-08T19:36:50.172 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:36:50.268 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:36:50.323 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:50.407 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 84 16 112612 112596 83.7201 58.6875 0.0278879 0.0119397 2021-10-08T19:36:50.516 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:36:50.525 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:50.526 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:36:50.627 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:36:50.676 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:50.795 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:36:50.799 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:50.801 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:36:50.862 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is unset 2021-10-08T19:36:50.903 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:36:51.018 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:50 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/601791058' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:36:51.019 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:50 smithi117 ceph-mon[34585]: from='client.25906 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:36:51.062 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:51.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:50 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/601791058' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:36:51.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:50 smithi097 ceph-mon[32687]: from='client.25906 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:36:51.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:50 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/601791058' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:36:51.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:50 smithi097 ceph-mon[41966]: from='client.25906 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:36:51.407 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 85 16 113648 113632 83.497 64.75 0.0127451 0.011972 2021-10-08T19:36:51.519 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:36:51.530 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:51.531 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:36:51.632 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:36:51.680 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:51.842 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:51 smithi097 ceph-mon[41966]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:36:51.842 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:51 smithi097 ceph-mon[41966]: Cluster is now healthy 2021-10-08T19:36:51.843 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:51 smithi097 ceph-mon[32687]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:36:51.843 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:51 smithi097 ceph-mon[32687]: Cluster is now healthy 2021-10-08T19:36:51.843 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:51 smithi097 ceph-mon[32687]: from='client.25906 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:36:51.843 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:51 smithi097 ceph-mon[32687]: osdmap e388: 8 total, 8 up, 8 in 2021-10-08T19:36:51.844 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:51 smithi097 ceph-mon[32687]: pgmap v772: 178 pgs: 1 active+clean+scrubbing, 177 active+clean; 6.8 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1023 B/s rd, 61 MiB/s wr, 976 op/s 2021-10-08T19:36:52.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:51 smithi117 ceph-mon[34585]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:36:52.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:51 smithi117 ceph-mon[34585]: Cluster is now healthy 2021-10-08T19:36:52.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:51 smithi117 ceph-mon[34585]: from='client.25906 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:36:52.160 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:51 smithi117 ceph-mon[34585]: osdmap e388: 8 total, 8 up, 8 in 2021-10-08T19:36:52.160 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:51 smithi117 ceph-mon[34585]: pgmap v772: 178 pgs: 1 active+clean+scrubbing, 177 active+clean; 6.8 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1023 B/s rd, 61 MiB/s wr, 976 op/s 2021-10-08T19:36:52.164 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:36:52.172 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:51 smithi097 ceph-mon[41966]: from='client.25906 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:36:52.172 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:51 smithi097 ceph-mon[41966]: osdmap e388: 8 total, 8 up, 8 in 2021-10-08T19:36:52.172 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:51 smithi097 ceph-mon[41966]: pgmap v772: 178 pgs: 1 active+clean+scrubbing, 177 active+clean; 6.8 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1023 B/s rd, 61 MiB/s wr, 976 op/s 2021-10-08T19:36:52.173 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:52.174 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:36:52.275 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:36:52.313 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:52.383 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:36:52.385 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:52.385 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:36:52.407 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 86 16 114710 114694 83.2979 66.375 0.0118886 0.0120004 2021-10-08T19:36:52.486 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:36:52.556 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:52.657 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:36:52 smithi117 conmon[69189]: level=error ts=2021-10-08T19:36:52.314Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=1 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:36:52.722 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:36:52 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:36:52] "GET /metrics HTTP/1.1" 200 155851 "" "Prometheus/2.18.1" 2021-10-08T19:36:52.774 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:36:52.779 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:52.780 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:36:52.809 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:36:52.855 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:36:52.883 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:36:52.886 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:36:52.923 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:36:52.931 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:52.968 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:36:53.003 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:36:53.033 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:36:53.068 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:36:53.085 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:36:53.086 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true' 2021-10-08T19:36:53.087 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true' 2021-10-08T19:36:53.087 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true' 2021-10-08T19:36:53.087 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true' 2021-10-08T19:36:53.088 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true' 2021-10-08T19:36:53.088 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true' 2021-10-08T19:36:53.089 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'true' 2021-10-08T19:36:53.089 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'true' 2021-10-08T19:36:53.091 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:53.092 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:36:53.093 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:52 smithi097 ceph-mon[32687]: 5.12 scrub ok 2021-10-08T19:36:53.093 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:52 smithi097 ceph-mon[32687]: 10.e scrub ok 2021-10-08T19:36:53.094 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:52 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/4123587390' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:36:53.094 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:52 smithi097 ceph-mon[41966]: 5.12 scrub ok 2021-10-08T19:36:53.094 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:52 smithi097 ceph-mon[41966]: 10.e scrub ok 2021-10-08T19:36:53.095 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:52 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/4123587390' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:36:53.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:52 smithi117 ceph-mon[34585]: 5.12 scrub ok 2021-10-08T19:36:53.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:52 smithi117 ceph-mon[34585]: 10.e scrub ok 2021-10-08T19:36:53.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:52 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/4123587390' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:36:53.195 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:36:53.242 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:53.409 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 87 16 115678 115662 83.0343 60.5 0.0194192 0.012038 2021-10-08T19:36:53.440 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:36:53.445 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:53.446 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:36:53.547 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:36:53.594 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:54.156 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:36:53 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:36:53] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:36:54.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:53 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:36:54.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:53 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:36:54.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:53 smithi117 ceph-mon[34585]: pgmap v774: 178 pgs: 1 active+clean+scrubbing, 177 active+clean; 6.8 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 639 B/s rd, 38 MiB/s wr, 614 op/s 2021-10-08T19:36:54.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:53 smithi117 ceph-mon[34585]: osdmap e389: 8 total, 8 up, 8 in 2021-10-08T19:36:54.178 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set noscrub 2021-10-08T19:36:54.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:53 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:36:54.225 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:53 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:36:54.225 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:53 smithi097 ceph-mon[32687]: pgmap v774: 178 pgs: 1 active+clean+scrubbing, 177 active+clean; 6.8 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 639 B/s rd, 38 MiB/s wr, 614 op/s 2021-10-08T19:36:54.225 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:53 smithi097 ceph-mon[32687]: osdmap e389: 8 total, 8 up, 8 in 2021-10-08T19:36:54.226 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:53 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:36:54.226 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:53 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:36:54.227 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:53 smithi097 ceph-mon[41966]: pgmap v774: 178 pgs: 1 active+clean+scrubbing, 177 active+clean; 6.8 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 639 B/s rd, 38 MiB/s wr, 614 op/s 2021-10-08T19:36:54.227 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:53 smithi097 ceph-mon[41966]: osdmap e389: 8 total, 8 up, 8 in 2021-10-08T19:36:54.227 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:54.228 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:36:54.229 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:36:54.331 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:36:54.381 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:54.412 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 88 16 116703 116687 82.816 64.0625 0.00517174 0.0120698 2021-10-08T19:36:54.466 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:36:54.471 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:54.472 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:36:54.540 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:36:54.541 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2021-10-08T19:36:54.541 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:36:54.541 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15870.0:116791 10.1 10:8e2b2a5c:::benchmark_data_smithi097_245820_object116790:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e389)", 2021-10-08T19:36:54.541 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:36:54.526797+0000", 2021-10-08T19:36:54.542 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.012634552, 2021-10-08T19:36:54.542 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012659757000000001, 2021-10-08T19:36:54.542 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:36:54.542 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "waiting for sub ops", 2021-10-08T19:36:54.543 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:36:54.543 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15870", 2021-10-08T19:36:54.543 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1128006081", 2021-10-08T19:36:54.543 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 116791 2021-10-08T19:36:54.544 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:36:54.544 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:36:54.544 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:36:54.544 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:36:54.544 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:54.526797+0000", 2021-10-08T19:36:54.545 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:36:54.545 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:36:54.545 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:36:54.545 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:36:54.546 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:54.526797+0000", 2021-10-08T19:36:54.547 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:36:54.547 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:36:54.548 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:36:54.550 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:36:54.550 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:54.526795+0000", 2021-10-08T19:36:54.550 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:36:54.551 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:36:54.551 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:36:54.551 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:36:54.552 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:54.526843+0000", 2021-10-08T19:36:54.552 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8188e-05 2021-10-08T19:36:54.552 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:36:54.553 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:36:54.553 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:36:54.553 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:54.526854+0000", 2021-10-08T19:36:54.553 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1293e-05 2021-10-08T19:36:54.553 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:36:54.554 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:36:54.554 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:36:54.554 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:54.526859+0000", 2021-10-08T19:36:54.554 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9960000000000001e-06 2021-10-08T19:36:54.555 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:36:54.555 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:36:54.555 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:36:54.556 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:54.526899+0000", 2021-10-08T19:36:54.557 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9653999999999997e-05 2021-10-08T19:36:54.557 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:36:54.557 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:36:54.558 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:36:54.558 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:54.527007+0000", 2021-10-08T19:36:54.559 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000108186 2021-10-08T19:36:54.559 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:36:54.559 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:36:54.560 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,7", 2021-10-08T19:36:54.560 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:54.527178+0000", 2021-10-08T19:36:54.560 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000170822 2021-10-08T19:36:54.561 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:36:54.561 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:36:54.561 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:36:54.562 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:54.529598+0000", 2021-10-08T19:36:54.562 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024196899999999999 2021-10-08T19:36:54.562 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:36:54.562 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:36:54.563 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:36:54.563 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:54.532062+0000", 2021-10-08T19:36:54.563 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024646379999999999 2021-10-08T19:36:54.564 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:36:54.564 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:36:54.564 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:36:54.564 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:36:54.565 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:36:54.565 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15870.0:116795 10.e 10:7588537d:::benchmark_data_smithi097_245820_object116794:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e389)", 2021-10-08T19:36:54.565 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:36:54.526871+0000", 2021-10-08T19:36:54.565 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.01256059, 2021-10-08T19:36:54.566 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01266401, 2021-10-08T19:36:54.566 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:36:54.566 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "waiting for sub ops", 2021-10-08T19:36:54.567 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:36:54.567 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15870", 2021-10-08T19:36:54.567 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1128006081", 2021-10-08T19:36:54.567 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 116795 2021-10-08T19:36:54.568 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:36:54.568 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:36:54.568 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:36:54.568 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:36:54.569 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:54.526871+0000", 2021-10-08T19:36:54.570 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:36:54.570 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:36:54.570 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:36:54.571 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:36:54.571 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:54.526871+0000", 2021-10-08T19:36:54.572 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:36:54.572 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:36:54.572 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:36:54.572 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:36:54.573 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:54.526870+0000", 2021-10-08T19:36:54.573 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999995 2021-10-08T19:36:54.573 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:36:54.573 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:36:54.573 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:36:54.574 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:54.526905+0000", 2021-10-08T19:36:54.574 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4751e-05 2021-10-08T19:36:54.574 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:36:54.574 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:36:54.575 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:36:54.575 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:54.526909+0000", 2021-10-08T19:36:54.576 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.3510000000000004e-06 2021-10-08T19:36:54.576 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:36:54.576 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:36:54.576 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:36:54.577 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:54.526914+0000", 2021-10-08T19:36:54.577 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.904e-06 2021-10-08T19:36:54.578 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:36:54.578 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:36:54.578 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:36:54.578 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:54.526962+0000", 2021-10-08T19:36:54.578 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8445000000000001e-05 2021-10-08T19:36:54.579 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:36:54.579 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:36:54.580 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:36:54.580 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:54.527089+0000", 2021-10-08T19:36:54.581 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012627800000000001 2021-10-08T19:36:54.581 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:36:54.581 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:36:54.582 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 2,6", 2021-10-08T19:36:54.582 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:54.527246+0000", 2021-10-08T19:36:54.582 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000157427 2021-10-08T19:36:54.582 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:36:54.582 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:36:54.583 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:36:54.583 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:54.529225+0000", 2021-10-08T19:36:54.583 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0019788729999999999 2021-10-08T19:36:54.583 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:36:54.584 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:36:54.584 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:36:54.584 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:54.534232+0000", 2021-10-08T19:36:54.584 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00500689 2021-10-08T19:36:54.585 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:36:54.585 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:36:54.585 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:36:54.585 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:36:54.586 INFO:teuthology.orchestra.run.smithi117.stdout: ], 2021-10-08T19:36:54.586 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 2 2021-10-08T19:36:54.586 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:36:54.586 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:36:54.658 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:54.692 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:36:54.767 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:36:54.786 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:54.787 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:36:54.888 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:36:54.939 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:54 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3359529527' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": ".rgw.root", "var": "pg_num", "val": "42"}]: dispatch 2021-10-08T19:36:54.940 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:54 smithi097 ceph-mon[32687]: from='client.25915 ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": ".rgw.root", "var": "pg_num", "val": "42"}]: dispatch 2021-10-08T19:36:54.944 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:54.985 INFO:teuthology.orchestra.run.smithi097.stderr:set pool 2 pg_num to 42 2021-10-08T19:36:55.014 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:36:55.015 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:55.016 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:36:55.118 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:36:55.154 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:55.220 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:36:55.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:54 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3359529527' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": ".rgw.root", "var": "pg_num", "val": "42"}]: dispatch 2021-10-08T19:36:55.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:54 smithi097 ceph-mon[41966]: from='client.25915 ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": ".rgw.root", "var": "pg_num", "val": "42"}]: dispatch 2021-10-08T19:36:55.225 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:54 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3359529527' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": ".rgw.root", "var": "pg_num", "val": "42"}]: dispatch 2021-10-08T19:36:55.225 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:54 smithi117 ceph-mon[34585]: from='client.25915 ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": ".rgw.root", "var": "pg_num", "val": "42"}]: dispatch 2021-10-08T19:36:55.226 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:55.227 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:36:55.328 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:36:55.389 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:55.412 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 89 16 117564 117548 82.49 53.8125 0.00784763 0.0121181 2021-10-08T19:36:55.740 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2021-10-08T19:36:56.072 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2021-10-08T19:36:56.113 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:55 smithi097 ceph-mon[41966]: pgmap v775: 178 pgs: 1 active+clean+scrubbing, 177 active+clean; 7.1 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 1.2 KiB/s rd, 78 MiB/s wr, 1.25k op/s 2021-10-08T19:36:56.114 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:55 smithi097 ceph-mon[41966]: from='client.25915 ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": ".rgw.root", "var": "pg_num", "val": "42"}]': finished 2021-10-08T19:36:56.114 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:55 smithi097 ceph-mon[41966]: osdmap e390: 8 total, 8 up, 8 in 2021-10-08T19:36:56.115 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:55 smithi097 ceph-mon[32687]: pgmap v775: 178 pgs: 1 active+clean+scrubbing, 177 active+clean; 7.1 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 1.2 KiB/s rd, 78 MiB/s wr, 1.25k op/s 2021-10-08T19:36:56.115 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:55 smithi097 ceph-mon[32687]: from='client.25915 ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": ".rgw.root", "var": "pg_num", "val": "42"}]': finished 2021-10-08T19:36:56.115 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:55 smithi097 ceph-mon[32687]: osdmap e390: 8 total, 8 up, 8 in 2021-10-08T19:36:56.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:55 smithi117 ceph-mon[34585]: pgmap v775: 178 pgs: 1 active+clean+scrubbing, 177 active+clean; 7.1 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 1.2 KiB/s rd, 78 MiB/s wr, 1.25k op/s 2021-10-08T19:36:56.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:55 smithi117 ceph-mon[34585]: from='client.25915 ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": ".rgw.root", "var": "pg_num", "val": "42"}]': finished 2021-10-08T19:36:56.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:55 smithi117 ceph-mon[34585]: osdmap e390: 8 total, 8 up, 8 in 2021-10-08T19:36:56.184 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:36:56.313 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:36:56.324 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:56.326 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:36:56.413 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Total time run: 90.0066 2021-10-08T19:36:56.413 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Total writes made: 118499 2021-10-08T19:36:56.413 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Write size: 65536 2021-10-08T19:36:56.414 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Object size: 65536 2021-10-08T19:36:56.414 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Bandwidth (MB/sec): 82.2849 2021-10-08T19:36:56.414 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Stddev Bandwidth: 33.2174 2021-10-08T19:36:56.414 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Max bandwidth (MB/sec): 227.688 2021-10-08T19:36:56.415 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Min bandwidth (MB/sec): 44.6875 2021-10-08T19:36:56.415 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Average IOPS: 1316 2021-10-08T19:36:56.415 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Stddev IOPS: 531.478 2021-10-08T19:36:56.415 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Max IOPS: 3643 2021-10-08T19:36:56.415 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Min IOPS: 715 2021-10-08T19:36:56.416 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Average Latency(s): 0.0121495 2021-10-08T19:36:56.416 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Stddev Latency(s): 0.00906702 2021-10-08T19:36:56.416 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Max latency(s): 0.227624 2021-10-08T19:36:56.416 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Min latency(s): 0.00140955 2021-10-08T19:36:56.418 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Cleaning up (deleting benchmark objects) 2021-10-08T19:36:56.429 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:36:56.495 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:56.578 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:36:56.583 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:56.583 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:36:56.684 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:36:56.738 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:56.820 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:36:56.824 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:56.825 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:36:56.926 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:36:56.975 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:57.156 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:36:57 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:36:57.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:56 smithi117 ceph-mon[34585]: 4.8 scrub ok 2021-10-08T19:36:57.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:56 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": ".rgw.root", "var": "pg_num_actual", "val": "42"}]: dispatch 2021-10-08T19:36:57.193 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:36:57.198 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:57.199 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:36:57.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:56 smithi097 ceph-mon[41966]: 4.8 scrub ok 2021-10-08T19:36:57.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:56 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": ".rgw.root", "var": "pg_num_actual", "val": "42"}]: dispatch 2021-10-08T19:36:57.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:56 smithi097 ceph-mon[32687]: 4.8 scrub ok 2021-10-08T19:36:57.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:56 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": ".rgw.root", "var": "pg_num_actual", "val": "42"}]: dispatch 2021-10-08T19:36:57.300 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:36:57.335 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:57.337 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:36:57.398 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:36:57.400 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:57.401 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:36:57.502 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:36:57.576 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:57.722 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:36:57.725 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:57.726 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:36:57.829 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:36:57.874 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:57.938 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:36:57.943 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:57.944 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:36:58.045 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:36:58.090 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:58 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:36:58.091 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:58 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:36:58.091 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:58 smithi097 ceph-mon[41966]: 10.5 scrub ok 2021-10-08T19:36:58.091 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:58 smithi097 ceph-mon[41966]: pgmap v777: 178 pgs: 1 active+clean+scrubbing, 177 active+clean; 7.1 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 850 B/s rd, 53 MiB/s wr, 843 op/s 2021-10-08T19:36:58.091 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:58 smithi097 ceph-mon[41966]: 4.1f deep-scrub ok 2021-10-08T19:36:58.092 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:58 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": ".rgw.root", "var": "pg_num_actual", "val": "42"}]': finished 2021-10-08T19:36:58.092 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:58 smithi097 ceph-mon[41966]: osdmap e391: 8 total, 8 up, 8 in 2021-10-08T19:36:58.092 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:58 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:36:58.092 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:58 smithi097 ceph-mon[41966]: 2.1e scrub ok 2021-10-08T19:36:58.092 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:58 smithi097 ceph-mon[41966]: 2.d scrub ok 2021-10-08T19:36:58.093 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:57 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:36:58.093 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:57 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:36:58.094 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:57 smithi097 ceph-mon[32687]: 10.5 scrub ok 2021-10-08T19:36:58.094 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:57 smithi097 ceph-mon[32687]: pgmap v777: 178 pgs: 1 active+clean+scrubbing, 177 active+clean; 7.1 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 850 B/s rd, 53 MiB/s wr, 843 op/s 2021-10-08T19:36:58.094 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:57 smithi097 ceph-mon[32687]: 4.1f deep-scrub ok 2021-10-08T19:36:58.094 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:57 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": ".rgw.root", "var": "pg_num_actual", "val": "42"}]': finished 2021-10-08T19:36:58.094 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:57 smithi097 ceph-mon[32687]: osdmap e391: 8 total, 8 up, 8 in 2021-10-08T19:36:58.095 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:57 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:36:58.095 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:57 smithi097 ceph-mon[32687]: 2.1e scrub ok 2021-10-08T19:36:58.096 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:57 smithi097 ceph-mon[32687]: 2.d scrub ok 2021-10-08T19:36:58.102 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:58.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:57 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:36:58.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:57 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:36:58.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:57 smithi117 ceph-mon[34585]: 10.5 scrub ok 2021-10-08T19:36:58.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:57 smithi117 ceph-mon[34585]: pgmap v777: 178 pgs: 1 active+clean+scrubbing, 177 active+clean; 7.1 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 850 B/s rd, 53 MiB/s wr, 843 op/s 2021-10-08T19:36:58.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:57 smithi117 ceph-mon[34585]: 4.1f deep-scrub ok 2021-10-08T19:36:58.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:57 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": ".rgw.root", "var": "pg_num_actual", "val": "42"}]': finished 2021-10-08T19:36:58.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:57 smithi117 ceph-mon[34585]: osdmap e391: 8 total, 8 up, 8 in 2021-10-08T19:36:58.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:57 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:36:58.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:57 smithi117 ceph-mon[34585]: 2.1e scrub ok 2021-10-08T19:36:58.160 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:57 smithi117 ceph-mon[34585]: 2.d scrub ok 2021-10-08T19:36:58.465 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:36:58.470 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:58.471 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:36:58.471 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:36:58 smithi097 conmon[33110]: 172.21.15.97 - - [08/Oct/2021:19:36:58] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:36:58.573 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:36:58.634 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:58.871 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:36:58.885 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:58.886 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:36:58.942 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:36:58.943 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2021-10-08T19:36:58.943 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2021-10-08T19:36:58.943 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2021-10-08T19:36:58.943 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:36:58.987 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:36:59.033 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:59.126 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:36:59.131 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:59.132 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:36:59.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:59 smithi117 ceph-mon[34585]: 5.6 scrub ok 2021-10-08T19:36:59.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:59 smithi117 ceph-mon[34585]: osdmap e392: 8 total, 8 up, 8 in 2021-10-08T19:36:59.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:59 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:36:59.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:59 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:36:59.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:59 smithi117 ceph-mon[34585]: 172.21.15.97 - - [08/Oct/2021:19:36:58] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:36:59.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:59 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1761463430' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:36:59.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:59 smithi117 ceph-mon[34585]: from='client.35972 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:36:59.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:36:59 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": ".rgw.root", "var": "pgp_num_actual", "val": "42"}]: dispatch 2021-10-08T19:36:59.233 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:36:59.279 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:59.341 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is set 2021-10-08T19:36:59.363 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:36:59.366 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:59.367 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:36:59.369 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:59 smithi097 ceph-mon[41966]: 5.6 scrub ok 2021-10-08T19:36:59.369 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:59 smithi097 ceph-mon[41966]: osdmap e392: 8 total, 8 up, 8 in 2021-10-08T19:36:59.370 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:59 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:36:59.370 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:59 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:36:59.370 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:59 smithi097 ceph-mon[41966]: 172.21.15.97 - - [08/Oct/2021:19:36:58] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:36:59.370 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:59 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1761463430' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:36:59.371 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:59 smithi097 ceph-mon[41966]: from='client.35972 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:36:59.371 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:36:59 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": ".rgw.root", "var": "pgp_num_actual", "val": "42"}]: dispatch 2021-10-08T19:36:59.371 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:59 smithi097 ceph-mon[32687]: 5.6 scrub ok 2021-10-08T19:36:59.372 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:59 smithi097 ceph-mon[32687]: osdmap e392: 8 total, 8 up, 8 in 2021-10-08T19:36:59.372 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:59 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:36:59.372 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:59 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:36:59.372 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:59 smithi097 ceph-mon[32687]: 172.21.15.97 - - [08/Oct/2021:19:36:58] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:36:59.373 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:59 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1761463430' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:36:59.373 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:59 smithi097 ceph-mon[32687]: from='client.35972 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:36:59.373 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:36:59 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": ".rgw.root", "var": "pgp_num_actual", "val": "42"}]: dispatch 2021-10-08T19:36:59.468 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:36:59.517 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:59.606 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:36:59.611 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:59.612 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:36:59.713 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:36:59.752 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:36:59.837 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:36:59.840 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:36:59.841 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:36:59.943 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:36:59.988 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:00.079 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:37:00.081 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:00.082 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:37:00.184 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:37:00.212 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:00.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:00 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:37:00.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:00 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:37:00.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:00 smithi117 ceph-mon[34585]: pgmap v780: 188 pgs: 4 unknown, 1 active+clean+scrubbing, 183 active+clean; 7.1 GiB data, 24 GiB used, 692 GiB / 715 GiB avail; 1.8 KiB/s rd, 75 MiB/s wr, 1.49k op/s 2021-10-08T19:37:00.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:00 smithi117 ceph-mon[34585]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:37:00.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:00 smithi117 ceph-mon[34585]: from='client.35972 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:37:00.409 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:00 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": ".rgw.root", "var": "pgp_num_actual", "val": "42"}]': finished 2021-10-08T19:37:00.409 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:00 smithi117 ceph-mon[34585]: osdmap e393: 8 total, 8 up, 8 in 2021-10-08T19:37:00.428 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:37:00.432 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:00 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:37:00.433 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:00 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:37:00.433 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:00 smithi097 ceph-mon[41966]: pgmap v780: 188 pgs: 4 unknown, 1 active+clean+scrubbing, 183 active+clean; 7.1 GiB data, 24 GiB used, 692 GiB / 715 GiB avail; 1.8 KiB/s rd, 75 MiB/s wr, 1.49k op/s 2021-10-08T19:37:00.433 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:00 smithi097 ceph-mon[41966]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:37:00.433 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:00 smithi097 ceph-mon[41966]: from='client.35972 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:37:00.434 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:00 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": ".rgw.root", "var": "pgp_num_actual", "val": "42"}]': finished 2021-10-08T19:37:00.434 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:00 smithi097 ceph-mon[41966]: osdmap e393: 8 total, 8 up, 8 in 2021-10-08T19:37:00.435 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:00.436 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:37:00.436 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:00 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:37:00.437 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:00 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:37:00.437 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:00 smithi097 ceph-mon[32687]: pgmap v780: 188 pgs: 4 unknown, 1 active+clean+scrubbing, 183 active+clean; 7.1 GiB data, 24 GiB used, 692 GiB / 715 GiB avail; 1.8 KiB/s rd, 75 MiB/s wr, 1.49k op/s 2021-10-08T19:37:00.437 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:00 smithi097 ceph-mon[32687]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:37:00.437 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:00 smithi097 ceph-mon[32687]: from='client.35972 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:37:00.438 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:00 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": ".rgw.root", "var": "pgp_num_actual", "val": "42"}]': finished 2021-10-08T19:37:00.438 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:00 smithi097 ceph-mon[32687]: osdmap e393: 8 total, 8 up, 8 in 2021-10-08T19:37:00.530 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2021-10-08T19:37:00.537 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:37:00.614 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:00.724 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:37:00.733 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:00.734 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:37:00.836 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:37:00.841 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:37:00.870 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:37:00.891 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:00.903 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:37:00.930 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:37:00.963 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:37:00.965 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:37:00.985 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:37:00.991 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:00.992 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:37:01.001 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:37:01.049 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:37:01.080 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:37:01.090 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'false' 2021-10-08T19:37:01.091 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'false' 2021-10-08T19:37:01.091 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'false' 2021-10-08T19:37:01.091 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'false' 2021-10-08T19:37:01.091 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'false' 2021-10-08T19:37:01.091 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'false' 2021-10-08T19:37:01.092 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'false' 2021-10-08T19:37:01.092 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'false' 2021-10-08T19:37:01.093 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:37:01.138 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:01.348 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 4, 5, 7, 6, 1, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2021-10-08T19:37:01.348 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2021-10-08T19:37:01.349 INFO:tasks.thrashosds.thrasher:inject_pause on 4 2021-10-08T19:37:01.349 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2021-10-08T19:37:01.350 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2021-10-08T19:37:01.350 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.4 config set filestore_inject_stall 3 2021-10-08T19:37:01.360 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:37:01.362 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:01.363 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:37:01.464 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:37:01.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:01 smithi097 ceph-mon[32687]: osdmap e394: 8 total, 8 up, 8 in 2021-10-08T19:37:01.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:01 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1091693658' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:37:01.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:01 smithi097 ceph-mon[41966]: osdmap e394: 8 total, 8 up, 8 in 2021-10-08T19:37:01.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:01 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1091693658' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:37:01.520 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:01 smithi117 ceph-mon[34585]: osdmap e394: 8 total, 8 up, 8 in 2021-10-08T19:37:01.520 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:01 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1091693658' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:37:01.531 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:01.776 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:37:01.784 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:01.785 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:37:01.888 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:37:01.940 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:02.029 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:37:02.041 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:02.047 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:37:02.149 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:37:02.188 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:02.269 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:37:02.273 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:02.274 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:37:02.321 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:37:02 smithi117 conmon[69189]: level=error ts=2021-10-08T19:37:02.319Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=1 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:37:02.327 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:02 smithi097 ceph-mon[32687]: pgmap v783: 188 pgs: 188 active+clean; 7.1 GiB data, 24 GiB used, 692 GiB / 715 GiB avail; 1.5 KiB/s rd, 40 MiB/s wr, 1.19k op/s 2021-10-08T19:37:02.377 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:37:02.419 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:02.496 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:37:02.501 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:02.502 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:37:02.603 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:37:02.630 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set nodeep-scrub 2021-10-08T19:37:02.641 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:02 smithi117 ceph-mon[34585]: pgmap v783: 188 pgs: 188 active+clean; 7.1 GiB data, 24 GiB used, 692 GiB / 715 GiB avail; 1.5 KiB/s rd, 40 MiB/s wr, 1.19k op/s 2021-10-08T19:37:02.646 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:02.649 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:02 smithi097 ceph-mon[41966]: pgmap v783: 188 pgs: 188 active+clean; 7.1 GiB data, 24 GiB used, 692 GiB / 715 GiB avail; 1.5 KiB/s rd, 40 MiB/s wr, 1.19k op/s 2021-10-08T19:37:02.705 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:37:02.713 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:02.715 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:37:02.816 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:37:02.877 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:02.972 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:37:02 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:37:02] "GET /metrics HTTP/1.1" 200 155937 "" "Prometheus/2.18.1" 2021-10-08T19:37:02.990 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:37:02.996 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:02.997 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:37:03.098 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:37:03.139 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:03.149 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:37:03.208 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:37:03.221 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:37:03.224 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:03.225 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:37:03.327 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:37:03.375 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:03.505 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:37:03.528 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:03.529 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:37:03.630 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:37:03.681 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:03.766 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:37:03.773 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:03.774 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:37:03.809 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2021-10-08T19:37:03.809 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:37:03.827 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:37:03 smithi117 conmon[69189]: level=error ts=2021-10-08T19:37:03.505Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=2 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:37:03.875 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:37:03.918 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:04.051 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2021-10-08T19:37:04.102 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:37:04.110 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:04.112 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:37:04.156 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:37:03 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:37:03] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:37:04.213 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:37:04.262 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:04.373 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:37:04.379 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:04.380 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:37:04.380 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:04 smithi097 ceph-mon[32687]: pgmap v784: 188 pgs: 188 active+clean; 7.1 GiB data, 24 GiB used, 692 GiB / 715 GiB avail; 1.0 KiB/s rd, 27 MiB/s wr, 808 op/s 2021-10-08T19:37:04.381 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:04 smithi097 ceph-mon[41966]: pgmap v784: 188 pgs: 188 active+clean; 7.1 GiB data, 24 GiB used, 692 GiB / 715 GiB avail; 1.0 KiB/s rd, 27 MiB/s wr, 808 op/s 2021-10-08T19:37:04.481 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:37:04.520 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:04.651 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:04 smithi117 ceph-mon[34585]: pgmap v784: 188 pgs: 188 active+clean; 7.1 GiB data, 24 GiB used, 692 GiB / 715 GiB avail; 1.0 KiB/s rd, 27 MiB/s wr, 808 op/s 2021-10-08T19:37:04.992 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:37:05.885 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2021-10-08T19:37:06.090 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:37:06.091 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:06.092 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:37:06.193 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:37:06.233 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:06.324 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:37:06.330 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:06.330 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:37:06.366 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is set 2021-10-08T19:37:06.432 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:37:06.479 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:06.597 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:37:06.624 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:37:06.628 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:06.629 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:37:06.630 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:06 smithi117 ceph-mon[34585]: pgmap v785: 188 pgs: 188 active+clean; 6.7 GiB data, 23 GiB used, 693 GiB / 715 GiB avail; 1.6 KiB/s rd, 23 MiB/s wr, 1.52k op/s; 51 B/s, 0 objects/s recovering 2021-10-08T19:37:06.630 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:06 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/4058505377' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:37:06.630 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:06 smithi117 ceph-mon[34585]: from='client.35975 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:37:06.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:06 smithi097 ceph-mon[32687]: pgmap v785: 188 pgs: 188 active+clean; 6.7 GiB data, 23 GiB used, 693 GiB / 715 GiB avail; 1.6 KiB/s rd, 23 MiB/s wr, 1.52k op/s; 51 B/s, 0 objects/s recovering 2021-10-08T19:37:06.724 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:06 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/4058505377' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:37:06.725 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:06 smithi097 ceph-mon[32687]: from='client.35975 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:37:06.725 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:06 smithi097 ceph-mon[41966]: pgmap v785: 188 pgs: 188 active+clean; 6.7 GiB data, 23 GiB used, 693 GiB / 715 GiB avail; 1.6 KiB/s rd, 23 MiB/s wr, 1.52k op/s; 51 B/s, 0 objects/s recovering 2021-10-08T19:37:06.726 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:06 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/4058505377' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:37:06.726 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:06 smithi097 ceph-mon[41966]: from='client.35975 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:37:06.731 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:37:06.753 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:37:06.753 INFO:teuthology.orchestra.run.smithi117.stdout: "success": "filestore_inject_stall = '3' (not observed, change may require restart) " 2021-10-08T19:37:06.754 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:37:06.776 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:07.364 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:37:07 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:37:07.364 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:07 smithi117 ceph-mon[34585]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:37:07.364 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:07 smithi117 ceph-mon[34585]: from='client.35975 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:37:07.365 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:07 smithi117 ceph-mon[34585]: osdmap e395: 8 total, 8 up, 8 in 2021-10-08T19:37:07.375 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:37:07.377 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:07.377 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:37:07.478 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:37:07.529 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:07.637 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:07 smithi097 ceph-mon[32687]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:37:07.638 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:07 smithi097 ceph-mon[32687]: from='client.35975 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:37:07.638 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:07 smithi097 ceph-mon[32687]: osdmap e395: 8 total, 8 up, 8 in 2021-10-08T19:37:07.638 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:07 smithi097 ceph-mon[41966]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:37:07.639 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:07 smithi097 ceph-mon[41966]: from='client.35975 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:37:07.639 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:07 smithi097 ceph-mon[41966]: osdmap e395: 8 total, 8 up, 8 in 2021-10-08T19:37:08.060 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:37:08.091 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:37:08.118 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:37:08.149 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:37:08.187 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:37:08.221 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:37:08.254 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:37:08.292 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:37:08.309 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true' 2021-10-08T19:37:08.310 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true' 2021-10-08T19:37:08.310 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true' 2021-10-08T19:37:08.310 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true' 2021-10-08T19:37:08.310 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true' 2021-10-08T19:37:08.311 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true' 2021-10-08T19:37:08.311 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'true' 2021-10-08T19:37:08.311 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'true' 2021-10-08T19:37:08.321 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:37:08.324 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:08.325 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:37:08.426 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:37:08.478 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:08.566 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:37:08.569 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:08.570 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:37:08.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:08 smithi117 ceph-mon[34585]: pgmap v787: 188 pgs: 188 active+clean; 6.7 GiB data, 23 GiB used, 693 GiB / 715 GiB avail; 677 B/s rd, 0 B/s wr, 757 op/s; 47 B/s, 0 objects/s recovering 2021-10-08T19:37:08.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:08 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:37:08.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:08 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3292979830' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:37:08.671 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:37:08.718 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:08.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:08 smithi097 ceph-mon[41966]: pgmap v787: 188 pgs: 188 active+clean; 6.7 GiB data, 23 GiB used, 693 GiB / 715 GiB avail; 677 B/s rd, 0 B/s wr, 757 op/s; 47 B/s, 0 objects/s recovering 2021-10-08T19:37:08.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:08 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:37:08.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:08 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3292979830' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:37:08.724 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:08 smithi097 ceph-mon[32687]: pgmap v787: 188 pgs: 188 active+clean; 6.7 GiB data, 23 GiB used, 693 GiB / 715 GiB avail; 677 B/s rd, 0 B/s wr, 757 op/s; 47 B/s, 0 objects/s recovering 2021-10-08T19:37:08.724 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:08 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:37:08.724 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:08 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3292979830' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:37:08.915 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:37:08.917 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:08.918 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:37:09.019 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:37:09.074 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:09.241 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:37:09.244 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:09.246 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:37:09.347 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:37:09.404 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:09.523 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:09.524 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:37:09.524 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:37:09.625 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:37:09.640 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset noscrub 2021-10-08T19:37:09.663 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:09.777 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:37:09.777 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2021-10-08T19:37:09.777 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:09.778 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.15870.0:133388 10.7 e395/355 10:e6555356:::benchmark_data_smithi097_245820_object14886:head v 395'8462, mlcod=395'8459)", 2021-10-08T19:37:09.778 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:37:09.773540+0000", 2021-10-08T19:37:09.778 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.001677125, 2021-10-08T19:37:09.778 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0016979810000000001, 2021-10-08T19:37:09.779 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:37:09.779 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2021-10-08T19:37:09.779 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:37:09.779 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:09.780 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:37:09.780 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:09.773540+0000", 2021-10-08T19:37:09.780 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:37:09.780 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:09.781 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:09.781 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:37:09.781 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:09.773540+0000", 2021-10-08T19:37:09.781 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:37:09.781 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:09.782 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:09.783 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:37:09.783 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:09.773539+0000", 2021-10-08T19:37:09.783 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:37:09.783 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:09.784 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:09.787 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:37:09.788 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:09.773545+0000", 2021-10-08T19:37:09.789 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3409999999999999e-06 2021-10-08T19:37:09.789 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:09.789 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:09.790 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:37:09.790 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:09.773551+0000", 2021-10-08T19:37:09.790 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2310000000000001e-06 2021-10-08T19:37:09.790 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:09.790 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:09.791 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:37:09.791 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:09.773556+0000", 2021-10-08T19:37:09.791 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.357e-06 2021-10-08T19:37:09.791 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:09.792 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:09.792 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:37:09.792 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:09.773719+0000", 2021-10-08T19:37:09.792 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000163008 2021-10-08T19:37:09.792 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:09.793 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:09.793 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:37:09.793 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:09.773736+0000", 2021-10-08T19:37:09.794 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7159e-05 2021-10-08T19:37:09.799 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:37:09.799 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:37:09.799 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:37:09.799 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:37:09.800 INFO:teuthology.orchestra.run.smithi117.stdout: ], 2021-10-08T19:37:09.800 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 1 2021-10-08T19:37:09.800 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:37:09.801 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:37:09.811 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:09.812 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:37:09.913 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:37:09.950 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:10.045 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:37:10.056 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:10.057 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:37:10.137 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:37:10.157 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:37:10.198 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:10.355 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:37:10.363 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:10.365 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:37:10.466 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:37:10.491 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:10.539 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:37:10.540 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:10.541 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:37:10.642 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:37:10.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:10 smithi117 ceph-mon[34585]: pgmap v788: 188 pgs: 188 active+clean; 6.5 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.19k op/s; 41 B/s, 0 objects/s recovering 2021-10-08T19:37:10.703 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:10.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:10 smithi097 ceph-mon[41966]: pgmap v788: 188 pgs: 188 active+clean; 6.5 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.19k op/s; 41 B/s, 0 objects/s recovering 2021-10-08T19:37:10.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:10 smithi097 ceph-mon[32687]: pgmap v788: 188 pgs: 188 active+clean; 6.5 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.19k op/s; 41 B/s, 0 objects/s recovering 2021-10-08T19:37:11.283 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2021-10-08T19:37:11.705 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:37:11.708 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:11.708 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:37:11.809 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:37:11.824 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2021-10-08T19:37:11.857 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:11.927 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:37:12.059 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:11 smithi117 ceph-mon[34585]: pgmap v789: 188 pgs: 188 active+clean; 6.4 GiB data, 22 GiB used, 694 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.14k op/s; 35 B/s, 0 objects/s recovering 2021-10-08T19:37:12.066 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:37:12.069 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:12.070 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:37:12.171 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:37:12.196 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:11 smithi097 ceph-mon[32687]: pgmap v789: 188 pgs: 188 active+clean; 6.4 GiB data, 22 GiB used, 694 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.14k op/s; 35 B/s, 0 objects/s recovering 2021-10-08T19:37:12.197 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:11 smithi097 ceph-mon[41966]: pgmap v789: 188 pgs: 188 active+clean; 6.4 GiB data, 22 GiB used, 694 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.14k op/s; 35 B/s, 0 objects/s recovering 2021-10-08T19:37:12.208 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:12.286 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:37:12.292 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:12.292 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:37:12.316 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:37:12 smithi117 conmon[69189]: level=error ts=2021-10-08T19:37:12.314Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=1 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:37:12.394 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:37:12.425 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:37:12.441 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:12.544 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:37:12.556 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:12.557 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:37:12.658 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:37:12.697 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:12.803 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:37:12.812 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:12.814 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:37:12.916 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:37:12.947 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:37:12 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:37:12] "GET /metrics HTTP/1.1" 200 155870 "" "Prometheus/2.18.1" 2021-10-08T19:37:12.957 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:12.973 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is unset 2021-10-08T19:37:13.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:12 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3528055724' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:37:13.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:12 smithi097 ceph-mon[41966]: from='client.25936 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:37:13.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:12 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3528055724' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:37:13.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:12 smithi097 ceph-mon[32687]: from='client.25936 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:37:13.295 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 4, 5, 7, 6, 1, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2021-10-08T19:37:13.295 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2021-10-08T19:37:13.296 INFO:tasks.thrashosds.thrasher:Setting osd 5 primary_affinity to 0.289054 2021-10-08T19:37:13.296 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd primary-affinity 5 0.28905414015180075 2021-10-08T19:37:13.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:12 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3528055724' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:37:13.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:12 smithi117 ceph-mon[34585]: from='client.25936 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:37:13.867 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:37:13.870 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:13.871 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:37:13.972 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:37:13.997 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:14.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:37:13 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:37:13] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:37:14.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:13 smithi117 ceph-mon[34585]: pgmap v790: 188 pgs: 188 active+clean; 6.4 GiB data, 22 GiB used, 694 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.14k op/s; 35 B/s, 0 objects/s recovering 2021-10-08T19:37:14.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:13 smithi117 ceph-mon[34585]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:37:14.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:13 smithi117 ceph-mon[34585]: from='client.25936 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:37:14.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:13 smithi117 ceph-mon[34585]: osdmap e396: 8 total, 8 up, 8 in 2021-10-08T19:37:14.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:13 smithi117 ceph-mon[34585]: 2.17 scrub ok 2021-10-08T19:37:14.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:13 smithi117 ceph-mon[34585]: 5.15 scrub ok 2021-10-08T19:37:14.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:13 smithi097 ceph-mon[41966]: pgmap v790: 188 pgs: 188 active+clean; 6.4 GiB data, 22 GiB used, 694 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.14k op/s; 35 B/s, 0 objects/s recovering 2021-10-08T19:37:14.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:13 smithi097 ceph-mon[41966]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:37:14.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:13 smithi097 ceph-mon[41966]: from='client.25936 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:37:14.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:13 smithi097 ceph-mon[41966]: osdmap e396: 8 total, 8 up, 8 in 2021-10-08T19:37:14.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:13 smithi097 ceph-mon[41966]: 2.17 scrub ok 2021-10-08T19:37:14.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:13 smithi097 ceph-mon[41966]: 5.15 scrub ok 2021-10-08T19:37:14.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:13 smithi097 ceph-mon[32687]: pgmap v790: 188 pgs: 188 active+clean; 6.4 GiB data, 22 GiB used, 694 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.14k op/s; 35 B/s, 0 objects/s recovering 2021-10-08T19:37:14.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:13 smithi097 ceph-mon[32687]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:37:14.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:13 smithi097 ceph-mon[32687]: from='client.25936 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:37:14.225 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:13 smithi097 ceph-mon[32687]: osdmap e396: 8 total, 8 up, 8 in 2021-10-08T19:37:14.225 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:13 smithi097 ceph-mon[32687]: 2.17 scrub ok 2021-10-08T19:37:14.225 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:13 smithi097 ceph-mon[32687]: 5.15 scrub ok 2021-10-08T19:37:14.396 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:37:14.398 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:14.399 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:37:14.499 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:37:14.500 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:37:14.560 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:14.981 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:37:15.000 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:14 smithi097 ceph-mon[41966]: 6.0 scrub ok 2021-10-08T19:37:15.000 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:14 smithi097 ceph-mon[41966]: 2.19 scrub ok 2021-10-08T19:37:15.000 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:14 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/419113994' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:37:15.001 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:14 smithi097 ceph-mon[32687]: 6.0 scrub ok 2021-10-08T19:37:15.001 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:14 smithi097 ceph-mon[32687]: 2.19 scrub ok 2021-10-08T19:37:15.002 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:14 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/419113994' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:37:15.014 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:37:15.053 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:37:15.088 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:37:15.117 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:37:15.154 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:37:15.170 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:37:15.174 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:15.174 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:37:15.189 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:37:15.218 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:37:15.226 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'false' 2021-10-08T19:37:15.227 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'false' 2021-10-08T19:37:15.227 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'false' 2021-10-08T19:37:15.227 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'false' 2021-10-08T19:37:15.228 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'false' 2021-10-08T19:37:15.228 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'false' 2021-10-08T19:37:15.228 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'false' 2021-10-08T19:37:15.228 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'false' 2021-10-08T19:37:15.275 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:37:15.317 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:14 smithi117 ceph-mon[34585]: 6.0 scrub ok 2021-10-08T19:37:15.318 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:14 smithi117 ceph-mon[34585]: 2.19 scrub ok 2021-10-08T19:37:15.318 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:14 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/419113994' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:37:15.319 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:15.418 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:37:15.420 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:15.421 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:37:15.523 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:37:15.570 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:15.968 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:15 smithi097 ceph-mon[41966]: 5.1d scrub ok 2021-10-08T19:37:15.969 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:15 smithi097 ceph-mon[41966]: pgmap v792: 188 pgs: 188 active+clean; 6.1 GiB data, 21 GiB used, 695 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.31k op/s 2021-10-08T19:37:15.970 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:15 smithi117 ceph-mon[34585]: 5.1d scrub ok 2021-10-08T19:37:15.970 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:15 smithi117 ceph-mon[34585]: pgmap v792: 188 pgs: 188 active+clean; 6.1 GiB data, 21 GiB used, 695 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.31k op/s 2021-10-08T19:37:15.970 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:15 smithi117 ceph-mon[34585]: 5.a scrub ok 2021-10-08T19:37:16.004 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2021-10-08T19:37:16.005 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:37:16.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:15 smithi097 ceph-mon[41966]: 5.a scrub ok 2021-10-08T19:37:16.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:15 smithi097 ceph-mon[32687]: 5.1d scrub ok 2021-10-08T19:37:16.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:15 smithi097 ceph-mon[32687]: pgmap v792: 188 pgs: 188 active+clean; 6.1 GiB data, 21 GiB used, 695 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.31k op/s 2021-10-08T19:37:16.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:15 smithi097 ceph-mon[32687]: 5.a scrub ok 2021-10-08T19:37:16.479 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset nodeep-scrub 2021-10-08T19:37:16.554 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:37:16.565 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:16.566 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:37:16.667 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:37:16.714 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:17.005 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:37:17.023 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:37:17.031 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:17.032 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:37:17.134 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:37:17.155 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2021-10-08T19:37:17.188 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:17.406 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:37:17.410 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:37:17 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:37:17.413 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:17.414 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:37:17.515 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:37:17.559 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:17.749 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:37:17.752 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:17.752 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:37:17.756 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:37:17.856 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:37:17.903 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:18.010 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:18 smithi117 ceph-mon[34585]: 5.1c scrub ok 2021-10-08T19:37:18.011 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:18 smithi117 ceph-mon[34585]: pgmap v793: 188 pgs: 188 active+clean; 6.1 GiB data, 21 GiB used, 695 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.12k op/s 2021-10-08T19:37:18.011 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:18 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:37:18.011 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:18 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:37:18.011 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:18 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:37:18.012 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:18 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3182282355' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 5, "weight": 0.28905414015180075}]: dispatch 2021-10-08T19:37:18.012 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:18 smithi117 ceph-mon[34585]: from='client.25948 ' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 5, "weight": 0.28905414015180075}]: dispatch 2021-10-08T19:37:18.027 INFO:teuthology.orchestra.run.smithi097.stderr:set osd.5 primary-affinity to 0.289054 (8189432) 2021-10-08T19:37:18.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:18 smithi097 ceph-mon[32687]: 5.1c scrub ok 2021-10-08T19:37:18.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:18 smithi097 ceph-mon[32687]: pgmap v793: 188 pgs: 188 active+clean; 6.1 GiB data, 21 GiB used, 695 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.12k op/s 2021-10-08T19:37:18.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:18 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:37:18.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:18 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:37:18.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:18 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:37:18.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:18 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3182282355' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 5, "weight": 0.28905414015180075}]: dispatch 2021-10-08T19:37:18.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:18 smithi097 ceph-mon[32687]: from='client.25948 ' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 5, "weight": 0.28905414015180075}]: dispatch 2021-10-08T19:37:18.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:18 smithi097 ceph-mon[41966]: 5.1c scrub ok 2021-10-08T19:37:18.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:18 smithi097 ceph-mon[41966]: pgmap v793: 188 pgs: 188 active+clean; 6.1 GiB data, 21 GiB used, 695 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.12k op/s 2021-10-08T19:37:18.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:18 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:37:18.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:18 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:37:18.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:18 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:37:18.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:18 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3182282355' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 5, "weight": 0.28905414015180075}]: dispatch 2021-10-08T19:37:18.225 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:18 smithi097 ceph-mon[41966]: from='client.25948 ' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 5, "weight": 0.28905414015180075}]: dispatch 2021-10-08T19:37:18.751 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2021-10-08T19:37:19.171 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:37:19.182 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:19.183 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:19 smithi097 ceph-mon[32687]: from='client.25948 ' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 5, "weight": 0.28905414015180075}]': finished 2021-10-08T19:37:19.183 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:19 smithi097 ceph-mon[32687]: osdmap e397: 8 total, 8 up, 8 in 2021-10-08T19:37:19.183 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:19 smithi097 ceph-mon[32687]: osdmap e398: 8 total, 8 up, 8 in 2021-10-08T19:37:19.184 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:19 smithi097 ceph-mon[41966]: from='client.25948 ' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 5, "weight": 0.28905414015180075}]': finished 2021-10-08T19:37:19.184 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:19 smithi097 ceph-mon[41966]: osdmap e397: 8 total, 8 up, 8 in 2021-10-08T19:37:19.184 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:19 smithi097 ceph-mon[41966]: osdmap e398: 8 total, 8 up, 8 in 2021-10-08T19:37:19.185 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:37:19.287 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:37:19.335 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:19 smithi117 ceph-mon[34585]: from='client.25948 ' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 5, "weight": 0.28905414015180075}]': finished 2021-10-08T19:37:19.336 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:19 smithi117 ceph-mon[34585]: osdmap e397: 8 total, 8 up, 8 in 2021-10-08T19:37:19.336 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:19 smithi117 ceph-mon[34585]: osdmap e398: 8 total, 8 up, 8 in 2021-10-08T19:37:19.339 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:20.012 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:37:20.192 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:20 smithi097 ceph-mon[41966]: 10.b scrub ok 2021-10-08T19:37:20.192 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:20 smithi097 ceph-mon[41966]: 10.3 scrub ok 2021-10-08T19:37:20.192 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:20 smithi097 ceph-mon[41966]: pgmap v795: 188 pgs: 7 peering, 181 active+clean; 5.9 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 3.9 KiB/s rd, 27 KiB/s wr, 1.13k op/s; 20 KiB/s, 0 objects/s recovering 2021-10-08T19:37:20.192 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:20 smithi097 ceph-mon[41966]: Health check failed: Reduced data availability: 3 pgs inactive, 6 pgs peering (PG_AVAILABILITY) 2021-10-08T19:37:20.194 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:20 smithi097 ceph-mon[41966]: 5.7 scrub ok 2021-10-08T19:37:20.195 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:20 smithi097 ceph-mon[32687]: 10.b scrub ok 2021-10-08T19:37:20.195 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:20 smithi097 ceph-mon[32687]: 10.3 scrub ok 2021-10-08T19:37:20.195 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:20 smithi097 ceph-mon[32687]: pgmap v795: 188 pgs: 7 peering, 181 active+clean; 5.9 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 3.9 KiB/s rd, 27 KiB/s wr, 1.13k op/s; 20 KiB/s, 0 objects/s recovering 2021-10-08T19:37:20.195 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:20 smithi097 ceph-mon[32687]: Health check failed: Reduced data availability: 3 pgs inactive, 6 pgs peering (PG_AVAILABILITY) 2021-10-08T19:37:20.196 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:20 smithi097 ceph-mon[32687]: 5.7 scrub ok 2021-10-08T19:37:20.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:20 smithi117 ceph-mon[34585]: 10.b scrub ok 2021-10-08T19:37:20.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:20 smithi117 ceph-mon[34585]: 10.3 scrub ok 2021-10-08T19:37:20.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:20 smithi117 ceph-mon[34585]: pgmap v795: 188 pgs: 7 peering, 181 active+clean; 5.9 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 3.9 KiB/s rd, 27 KiB/s wr, 1.13k op/s; 20 KiB/s, 0 objects/s recovering 2021-10-08T19:37:20.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:20 smithi117 ceph-mon[34585]: Health check failed: Reduced data availability: 3 pgs inactive, 6 pgs peering (PG_AVAILABILITY) 2021-10-08T19:37:20.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:20 smithi117 ceph-mon[34585]: 5.7 scrub ok 2021-10-08T19:37:20.513 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:37:20.516 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:20.517 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:37:20.618 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:37:20.712 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:21.161 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:21 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:37:21.161 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:21 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:37:21.162 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:21 smithi117 ceph-mon[34585]: osdmap e399: 8 total, 8 up, 8 in 2021-10-08T19:37:21.162 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:21 smithi117 ceph-mon[34585]: osdmap e400: 8 total, 8 up, 8 in 2021-10-08T19:37:21.162 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:21 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2609453175' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:37:21.162 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:21 smithi117 ceph-mon[34585]: from='client.35993 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:37:21.297 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2021-10-08T19:37:21.297 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:37:21.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:21 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:37:21.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:21 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:37:21.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:21 smithi097 ceph-mon[41966]: osdmap e399: 8 total, 8 up, 8 in 2021-10-08T19:37:21.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:21 smithi097 ceph-mon[41966]: osdmap e400: 8 total, 8 up, 8 in 2021-10-08T19:37:21.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:21 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2609453175' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:37:21.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:21 smithi097 ceph-mon[41966]: from='client.35993 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:37:21.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:21 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:37:21.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:21 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:37:21.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:21 smithi097 ceph-mon[32687]: osdmap e399: 8 total, 8 up, 8 in 2021-10-08T19:37:21.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:21 smithi097 ceph-mon[32687]: osdmap e400: 8 total, 8 up, 8 in 2021-10-08T19:37:21.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:21 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2609453175' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:37:21.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:21 smithi097 ceph-mon[32687]: from='client.35993 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:37:21.729 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:37:21.732 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:21.733 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:37:21.834 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:37:21.858 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is unset 2021-10-08T19:37:21.890 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:22.037 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:22 smithi097 ceph-mon[32687]: pgmap v799: 188 pgs: 11 peering, 177 active+clean; 5.8 GiB data, 20 GiB used, 696 GiB / 715 GiB avail; 164 KiB/s wr, 1.16k op/s; 246 KiB/s, 0 objects/s recovering 2021-10-08T19:37:22.038 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:22 smithi097 ceph-mon[32687]: 5.1b scrub ok 2021-10-08T19:37:22.038 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:22 smithi097 ceph-mon[32687]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:37:22.038 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:22 smithi097 ceph-mon[32687]: from='client.35993 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:37:22.038 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:22 smithi097 ceph-mon[32687]: osdmap e401: 8 total, 8 up, 8 in 2021-10-08T19:37:22.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:22 smithi117 ceph-mon[34585]: pgmap v799: 188 pgs: 11 peering, 177 active+clean; 5.8 GiB data, 20 GiB used, 696 GiB / 715 GiB avail; 164 KiB/s wr, 1.16k op/s; 246 KiB/s, 0 objects/s recovering 2021-10-08T19:37:22.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:22 smithi117 ceph-mon[34585]: 5.1b scrub ok 2021-10-08T19:37:22.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:22 smithi117 ceph-mon[34585]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:37:22.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:22 smithi117 ceph-mon[34585]: from='client.35993 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:37:22.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:22 smithi117 ceph-mon[34585]: osdmap e401: 8 total, 8 up, 8 in 2021-10-08T19:37:22.443 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:37:22.450 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:22.451 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:37:22.451 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:22 smithi097 ceph-mon[41966]: pgmap v799: 188 pgs: 11 peering, 177 active+clean; 5.8 GiB data, 20 GiB used, 696 GiB / 715 GiB avail; 164 KiB/s wr, 1.16k op/s; 246 KiB/s, 0 objects/s recovering 2021-10-08T19:37:22.452 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:22 smithi097 ceph-mon[41966]: 5.1b scrub ok 2021-10-08T19:37:22.452 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:22 smithi097 ceph-mon[41966]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:37:22.452 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:22 smithi097 ceph-mon[41966]: from='client.35993 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:37:22.452 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:22 smithi097 ceph-mon[41966]: osdmap e401: 8 total, 8 up, 8 in 2021-10-08T19:37:22.552 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:37:22.593 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:22.721 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:37:22 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:37:22] "GET /metrics HTTP/1.1" 200 155870 "" "Prometheus/2.18.1" 2021-10-08T19:37:22.916 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2021-10-08T19:37:23.295 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:37:23.303 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:23.304 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:37:23.329 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:23 smithi097 ceph-mon[41966]: 10.f scrub ok 2021-10-08T19:37:23.330 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:23 smithi097 ceph-mon[41966]: 3.e scrub ok 2021-10-08T19:37:23.330 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:23 smithi097 ceph-mon[41966]: 4.c scrub ok 2021-10-08T19:37:23.331 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:23 smithi097 ceph-mon[41966]: 5.3 scrub ok 2021-10-08T19:37:23.331 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:23 smithi097 ceph-mon[32687]: 10.f scrub ok 2021-10-08T19:37:23.332 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:23 smithi097 ceph-mon[32687]: 3.e scrub ok 2021-10-08T19:37:23.332 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:23 smithi097 ceph-mon[32687]: 4.c scrub ok 2021-10-08T19:37:23.333 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:23 smithi097 ceph-mon[32687]: 5.3 scrub ok 2021-10-08T19:37:23.405 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:37:23.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:23 smithi117 ceph-mon[34585]: 10.f scrub ok 2021-10-08T19:37:23.409 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:23 smithi117 ceph-mon[34585]: 3.e scrub ok 2021-10-08T19:37:23.409 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:23 smithi117 ceph-mon[34585]: 4.c scrub ok 2021-10-08T19:37:23.410 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:23 smithi117 ceph-mon[34585]: 5.3 scrub ok 2021-10-08T19:37:23.453 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:23.530 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:37:23.647 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:37:23.648 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:23.649 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:37:23.750 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:37:23.790 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:23.928 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:37:23.934 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:23.935 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:37:23.959 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:37:23.991 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:37:24.032 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:37:24.038 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:37:24.061 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:37:24.063 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:24 smithi117 ceph-mon[34585]: 5.4 scrub ok 2021-10-08T19:37:24.063 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:24 smithi117 ceph-mon[34585]: pgmap v801: 188 pgs: 11 peering, 177 active+clean; 5.8 GiB data, 20 GiB used, 696 GiB / 715 GiB avail; 109 KiB/s wr, 284 op/s; 207 KiB/s, 0 objects/s recovering 2021-10-08T19:37:24.063 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:37:23 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:37:23] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:37:24.094 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:24.103 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:37:24.143 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:37:24.191 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:37:24.225 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:37:24.228 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:37:24.230 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:24.232 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:37:24.257 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true' 2021-10-08T19:37:24.257 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true' 2021-10-08T19:37:24.257 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true' 2021-10-08T19:37:24.258 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true' 2021-10-08T19:37:24.258 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true' 2021-10-08T19:37:24.258 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true' 2021-10-08T19:37:24.259 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'true' 2021-10-08T19:37:24.259 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'true' 2021-10-08T19:37:24.326 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:24 smithi117 ceph-mon[34585]: 6.f scrub ok 2021-10-08T19:37:24.327 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:24 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/734222083' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:37:24.333 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:37:24.391 INFO:journalctl@ceph.osd.3.smithi097.stdout:Oct 08 19:37:24 smithi097 conmon[59546]: 2021-10-08T19:37:24.110+0000 7fac92809700 -1 osd.3 pg_epoch: 401 pg[5.16( empty local-lis/les=397/398 n=0 ec=64/64 lis/c=397/397 les/c/f=398/398/0 sis=397) [3,5,1] r=0 lpr=397 crt=0'0 mlcod 0'0 active+clean] scrubber pg(5.16) handle_scrub_reserve_grant: received unsolicited reservation grant from osd 1 (0x563cb65891e0) 2021-10-08T19:37:24.392 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:24 smithi097 ceph-mon[41966]: 5.4 scrub ok 2021-10-08T19:37:24.392 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:24 smithi097 ceph-mon[41966]: pgmap v801: 188 pgs: 11 peering, 177 active+clean; 5.8 GiB data, 20 GiB used, 696 GiB / 715 GiB avail; 109 KiB/s wr, 284 op/s; 207 KiB/s, 0 objects/s recovering 2021-10-08T19:37:24.392 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:24 smithi097 ceph-mon[41966]: 6.f scrub ok 2021-10-08T19:37:24.393 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:24 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/734222083' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:37:24.393 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:24 smithi097 ceph-mon[32687]: 5.4 scrub ok 2021-10-08T19:37:24.393 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:24 smithi097 ceph-mon[32687]: pgmap v801: 188 pgs: 11 peering, 177 active+clean; 5.8 GiB data, 20 GiB used, 696 GiB / 715 GiB avail; 109 KiB/s wr, 284 op/s; 207 KiB/s, 0 objects/s recovering 2021-10-08T19:37:24.394 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:24 smithi097 ceph-mon[32687]: 6.f scrub ok 2021-10-08T19:37:24.394 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:24 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/734222083' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:37:24.406 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:25.000 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 4, 5, 7, 6, 1, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2021-10-08T19:37:25.001 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd reweight 0 1 2021-10-08T19:37:25.151 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set noscrub 2021-10-08T19:37:25.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:25 smithi117 ceph-mon[34585]: 6.1c scrub ok 2021-10-08T19:37:25.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:25 smithi097 ceph-mon[32687]: 6.1c scrub ok 2021-10-08T19:37:25.474 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:25 smithi097 ceph-mon[41966]: 6.1c scrub ok 2021-10-08T19:37:25.710 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:37:25.715 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:25.722 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:37:25.824 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:37:25.876 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:25.970 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:37:25 smithi097 conmon[33110]: 172.21.15.117 - - [08/Oct/2021:19:37:25] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:37:26.010 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:37:26.016 INFO:journalctl@ceph.osd.4.smithi117.stdout:Oct 08 19:37:25 smithi117 conmon[42287]: 2021-10-08T19:37:25.666+0000 7f7e88a0b700 -1 osd.4 pg_epoch: 401 pg[5.e( v 88'9 (0'0,88'9] local-lis/les=64/65 n=1 ec=64/64 lis/c=64/64 les/c/f=65/65/0 sis=64) [4,5,0] r=0 lpr=64 crt=88'9 lcod 69'8 mlcod 69'8 active+clean TIME_FOR_DEEP] scrubber pg(5.e) handle_scrub_reserve_grant: received unsolicited reservation grant from osd 0 (0x556c40005600) 2021-10-08T19:37:26.017 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:26.017 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:37:26.118 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:37:26.161 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:26.206 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:37:26.248 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:37:26.252 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:26.253 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:37:26.273 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:37:26.354 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:37:26.355 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:26 smithi117 ceph-mon[34585]: pgmap v802: 188 pgs: 188 active+clean; 5.5 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 0 B/s wr, 901 op/s 2021-10-08T19:37:26.356 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:26 smithi117 ceph-mon[34585]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs inactive, 8 pgs peering) 2021-10-08T19:37:26.356 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:26 smithi117 ceph-mon[34585]: Cluster is now healthy 2021-10-08T19:37:26.356 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:26 smithi117 ceph-mon[34585]: osdmap e402: 8 total, 8 up, 8 in 2021-10-08T19:37:26.356 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:26 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:37:26.403 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:26.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:26 smithi097 ceph-mon[32687]: pgmap v802: 188 pgs: 188 active+clean; 5.5 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 0 B/s wr, 901 op/s 2021-10-08T19:37:26.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:26 smithi097 ceph-mon[32687]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs inactive, 8 pgs peering) 2021-10-08T19:37:26.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:26 smithi097 ceph-mon[32687]: Cluster is now healthy 2021-10-08T19:37:26.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:26 smithi097 ceph-mon[32687]: osdmap e402: 8 total, 8 up, 8 in 2021-10-08T19:37:26.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:26 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:37:26.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:26 smithi097 ceph-mon[41966]: pgmap v802: 188 pgs: 188 active+clean; 5.5 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 0 B/s wr, 901 op/s 2021-10-08T19:37:26.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:26 smithi097 ceph-mon[41966]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs inactive, 8 pgs peering) 2021-10-08T19:37:26.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:26 smithi097 ceph-mon[41966]: Cluster is now healthy 2021-10-08T19:37:26.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:26 smithi097 ceph-mon[41966]: osdmap e402: 8 total, 8 up, 8 in 2021-10-08T19:37:26.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:26 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:37:26.629 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:37:26.634 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:26.636 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:37:26.698 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:37:26.699 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2021-10-08T19:37:26.699 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.699 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15870.0:150500 10.0 10:0274a348:::benchmark_data_smithi097_245820_object31998:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e402)", 2021-10-08T19:37:26.699 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:37:26.690195+0000", 2021-10-08T19:37:26.700 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.0056222310000000001, 2021-10-08T19:37:26.700 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0056520349999999997, 2021-10-08T19:37:26.700 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:37:26.700 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "waiting for sub ops", 2021-10-08T19:37:26.700 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:37:26.701 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15870", 2021-10-08T19:37:26.701 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1128006081", 2021-10-08T19:37:26.701 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 150500 2021-10-08T19:37:26.701 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:26.702 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:37:26.702 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.702 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:37:26.702 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:26.690195+0000", 2021-10-08T19:37:26.702 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:37:26.703 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:26.703 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.703 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:37:26.703 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:26.690195+0000", 2021-10-08T19:37:26.704 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:37:26.704 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:26.704 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.704 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:37:26.704 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:26.690192+0000", 2021-10-08T19:37:26.705 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:37:26.705 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:26.705 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.705 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:37:26.705 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:26.690200+0000", 2021-10-08T19:37:26.706 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5079999999999999e-06 2021-10-08T19:37:26.706 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:26.706 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.706 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:37:26.707 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:26.690211+0000", 2021-10-08T19:37:26.707 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1585e-05 2021-10-08T19:37:26.707 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:26.707 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.708 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:37:26.708 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:26.690216+0000", 2021-10-08T19:37:26.708 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9640000000000002e-06 2021-10-08T19:37:26.708 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:26.709 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.709 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:37:26.709 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:26.690256+0000", 2021-10-08T19:37:26.709 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9437000000000002e-05 2021-10-08T19:37:26.709 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:26.710 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.710 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:37:26.710 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:26.690380+0000", 2021-10-08T19:37:26.710 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012460999999999999 2021-10-08T19:37:26.711 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:26.711 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.711 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:37:26.711 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:26.690526+0000", 2021-10-08T19:37:26.711 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014572399999999999 2021-10-08T19:37:26.712 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:26.712 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.712 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:37:26.712 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:26.695281+0000", 2021-10-08T19:37:26.713 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0047546089999999999 2021-10-08T19:37:26.713 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:37:26.713 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:37:26.713 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:37:26.714 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:26.714 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.714 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15870.0:150502 10.0 10:0142e8d0:::benchmark_data_smithi097_245820_object32000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e402)", 2021-10-08T19:37:26.714 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:37:26.690225+0000", 2021-10-08T19:37:26.715 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.0055913159999999998, 2021-10-08T19:37:26.715 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0057331470000000001, 2021-10-08T19:37:26.715 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:37:26.715 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "waiting for sub ops", 2021-10-08T19:37:26.715 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:37:26.716 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15870", 2021-10-08T19:37:26.716 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1128006081", 2021-10-08T19:37:26.716 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 150502 2021-10-08T19:37:26.717 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:26.717 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:37:26.717 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.717 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:37:26.718 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:26.690225+0000", 2021-10-08T19:37:26.718 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:37:26.718 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:26.718 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.718 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:37:26.719 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:26.690225+0000", 2021-10-08T19:37:26.719 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:37:26.719 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:26.719 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.720 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:37:26.720 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:26.690225+0000", 2021-10-08T19:37:26.720 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999995 2021-10-08T19:37:26.720 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:26.721 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.721 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:37:26.721 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:26.690228+0000", 2021-10-08T19:37:26.721 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9569999999999998e-06 2021-10-08T19:37:26.722 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:26.722 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.722 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:37:26.723 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:26.690233+0000", 2021-10-08T19:37:26.723 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.169e-06 2021-10-08T19:37:26.723 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:26.723 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.724 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:37:26.724 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:26.690237+0000", 2021-10-08T19:37:26.724 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4329999999999997e-06 2021-10-08T19:37:26.724 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:26.725 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.725 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:37:26.725 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:26.692825+0000", 2021-10-08T19:37:26.725 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002587411 2021-10-08T19:37:26.726 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:26.726 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.726 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:37:26.726 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:26.692948+0000", 2021-10-08T19:37:26.726 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012363000000000001 2021-10-08T19:37:26.727 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:26.727 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.727 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:37:26.727 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:26.693062+0000", 2021-10-08T19:37:26.727 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011393 2021-10-08T19:37:26.728 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:26.728 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.728 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:37:26.728 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:26.695590+0000", 2021-10-08T19:37:26.729 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0025280649999999999 2021-10-08T19:37:26.729 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:37:26.729 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:37:26.729 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:37:26.729 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:26.730 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.730 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15870.0:150503 10.d 10:b63b58a4:::benchmark_data_smithi097_245820_object32001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e402)", 2021-10-08T19:37:26.730 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:37:26.690240+0000", 2021-10-08T19:37:26.730 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.005576475, 2021-10-08T19:37:26.730 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0058070149999999996, 2021-10-08T19:37:26.731 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:37:26.731 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "waiting for sub ops", 2021-10-08T19:37:26.731 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:37:26.732 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15870", 2021-10-08T19:37:26.732 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1128006081", 2021-10-08T19:37:26.732 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 150503 2021-10-08T19:37:26.732 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:26.732 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:37:26.733 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.733 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:37:26.733 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:26.690240+0000", 2021-10-08T19:37:26.733 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:37:26.734 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:26.734 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.734 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:37:26.735 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:26.690240+0000", 2021-10-08T19:37:26.735 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:37:26.735 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:26.735 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.735 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:37:26.736 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:26.690240+0000", 2021-10-08T19:37:26.736 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999995 2021-10-08T19:37:26.736 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:26.736 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.737 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:37:26.737 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:26.690242+0000", 2021-10-08T19:37:26.737 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5239999999999999e-06 2021-10-08T19:37:26.737 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:26.737 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.738 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:37:26.738 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:26.690247+0000", 2021-10-08T19:37:26.738 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5700000000000003e-06 2021-10-08T19:37:26.738 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:26.739 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.739 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:37:26.739 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:26.690250+0000", 2021-10-08T19:37:26.739 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4010000000000001e-06 2021-10-08T19:37:26.739 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:26.740 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.740 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:37:26.740 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:26.690286+0000", 2021-10-08T19:37:26.740 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.5732999999999998e-05 2021-10-08T19:37:26.740 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:26.741 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.741 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:37:26.741 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:26.690382+0000", 2021-10-08T19:37:26.741 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6232999999999998e-05 2021-10-08T19:37:26.741 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:26.742 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.742 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,4", 2021-10-08T19:37:26.742 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:26.690530+0000", 2021-10-08T19:37:26.743 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014746400000000001 2021-10-08T19:37:26.743 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:26.743 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.743 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:37:26.744 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:26.695109+0000", 2021-10-08T19:37:26.744 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004578843 2021-10-08T19:37:26.744 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:26.744 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.744 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:37:26.745 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:26.696002+0000", 2021-10-08T19:37:26.745 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00089331499999999999 2021-10-08T19:37:26.745 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:37:26.745 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:37:26.745 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:37:26.746 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:26.746 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.746 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15870.0:150504 10.7 10:e77517a2:::benchmark_data_smithi097_245820_object32002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e402)", 2021-10-08T19:37:26.746 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:37:26.695281+0000", 2021-10-08T19:37:26.747 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.00053571300000000005, 2021-10-08T19:37:26.747 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00083689400000000003, 2021-10-08T19:37:26.747 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:37:26.747 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "waiting for sub ops", 2021-10-08T19:37:26.747 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:37:26.748 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15870", 2021-10-08T19:37:26.748 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1128006081", 2021-10-08T19:37:26.748 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 150504 2021-10-08T19:37:26.748 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:26.748 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:37:26.749 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.749 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:37:26.749 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:26.695281+0000", 2021-10-08T19:37:26.749 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:37:26.749 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:26.750 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.750 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:37:26.750 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:26.695281+0000", 2021-10-08T19:37:26.750 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:37:26.751 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:26.751 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.751 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:37:26.751 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:26.695277+0000", 2021-10-08T19:37:26.751 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999967 2021-10-08T19:37:26.752 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:26.752 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.752 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:37:26.752 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:26.695287+0000", 2021-10-08T19:37:26.752 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8660000000000001e-06 2021-10-08T19:37:26.753 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:26.753 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.753 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:37:26.753 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:26.695302+0000", 2021-10-08T19:37:26.753 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4466e-05 2021-10-08T19:37:26.754 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:26.754 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.754 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:37:26.754 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:26.695309+0000", 2021-10-08T19:37:26.755 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4150000000000002e-06 2021-10-08T19:37:26.755 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:26.755 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.755 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:37:26.755 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:26.695361+0000", 2021-10-08T19:37:26.756 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1820999999999997e-05 2021-10-08T19:37:26.756 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:26.756 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.756 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:37:26.756 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:26.695500+0000", 2021-10-08T19:37:26.757 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000138849 2021-10-08T19:37:26.757 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:26.757 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.757 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 3,5", 2021-10-08T19:37:26.757 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:26.695624+0000", 2021-10-08T19:37:26.758 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000124043 2021-10-08T19:37:26.758 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:37:26.759 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:37:26.759 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:37:26.759 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:26.759 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.759 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.15870.0:150498 10.e e402/355 10:7f40eb5b:::benchmark_data_smithi097_245820_object31996:head v 402'9386, mlcod=402'9383)", 2021-10-08T19:37:26.760 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:37:26.695884+0000", 2021-10-08T19:37:26.760 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4294967295.9999323, 2021-10-08T19:37:26.760 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00027698099999999998, 2021-10-08T19:37:26.760 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:37:26.761 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2021-10-08T19:37:26.761 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:37:26.761 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.761 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:37:26.761 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:26.695884+0000", 2021-10-08T19:37:26.762 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:37:26.762 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:26.762 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.762 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:37:26.763 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:26.695884+0000", 2021-10-08T19:37:26.763 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:37:26.763 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:26.763 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.763 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:37:26.764 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:26.695883+0000", 2021-10-08T19:37:26.764 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:37:26.764 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:26.765 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.765 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:37:26.765 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:26.695891+0000", 2021-10-08T19:37:26.765 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4919999999999993e-06 2021-10-08T19:37:26.766 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:26.766 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.766 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:37:26.766 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:26.695904+0000", 2021-10-08T19:37:26.766 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2818e-05 2021-10-08T19:37:26.767 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:26.767 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.767 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:37:26.767 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:26.695910+0000", 2021-10-08T19:37:26.767 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9950000000000002e-06 2021-10-08T19:37:26.768 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:26.768 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.769 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:37:26.769 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:26.696014+0000", 2021-10-08T19:37:26.769 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000104159 2021-10-08T19:37:26.769 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:26.770 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.770 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:37:26.770 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:26.696033+0000", 2021-10-08T19:37:26.770 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8369999999999999e-05 2021-10-08T19:37:26.773 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:37:26.773 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:37:26.773 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:37:26.773 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:26.774 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.778 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop_reply(client.15870.0:150502 10.0 e402/355)", 2021-10-08T19:37:26.778 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:37:26.695975+0000", 2021-10-08T19:37:26.779 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4294967295.9998417, 2021-10-08T19:37:26.779 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00021946100000000001, 2021-10-08T19:37:26.779 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:37:26.780 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "queued for pg", 2021-10-08T19:37:26.780 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:37:26.781 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.781 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:37:26.781 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:26.695975+0000", 2021-10-08T19:37:26.781 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:37:26.782 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:26.782 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.782 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:37:26.782 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:26.695975+0000", 2021-10-08T19:37:26.783 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:37:26.783 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:26.783 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.783 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:37:26.784 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:26.695975+0000", 2021-10-08T19:37:26.784 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999995 2021-10-08T19:37:26.784 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:26.784 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.785 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:37:26.785 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:26.695977+0000", 2021-10-08T19:37:26.785 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1390000000000002e-06 2021-10-08T19:37:26.785 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:26.785 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.786 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:37:26.786 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:26.695981+0000", 2021-10-08T19:37:26.786 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.3390000000000003e-06 2021-10-08T19:37:26.786 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:26.787 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:26.787 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:37:26.787 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:26.695984+0000", 2021-10-08T19:37:26.787 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.1429999999999998e-06 2021-10-08T19:37:26.787 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:37:26.788 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:37:26.788 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:37:26.788 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:37:26.788 INFO:teuthology.orchestra.run.smithi117.stdout: ], 2021-10-08T19:37:26.789 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 6 2021-10-08T19:37:26.789 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:37:26.789 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:37:26.820 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:26.984 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:37:26.993 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:26.994 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:37:27.095 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:37:27.109 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:27 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:37:27.109 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:27 smithi097 ceph-mon[32687]: 172.21.15.117 - - [08/Oct/2021:19:37:25] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:37:27.109 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:27 smithi097 ceph-mon[32687]: 10.9 scrub ok 2021-10-08T19:37:27.197 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:27.376 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:37:27.382 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:27.387 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:27 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:37:27.387 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:27 smithi097 ceph-mon[41966]: 172.21.15.117 - - [08/Oct/2021:19:37:25] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:37:27.387 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:27 smithi097 ceph-mon[41966]: 10.9 scrub ok 2021-10-08T19:37:27.388 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:37:27.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:27 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:37:27.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:27 smithi117 ceph-mon[34585]: 172.21.15.117 - - [08/Oct/2021:19:37:25] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:37:27.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:27 smithi117 ceph-mon[34585]: 10.9 scrub ok 2021-10-08T19:37:27.407 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:37:27 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:37:27.489 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:37:27.533 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:27.938 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2021-10-08T19:37:28.138 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2021-10-08T19:37:28.374 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:37:28.410 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:28 smithi117 ceph-mon[34585]: pgmap v804: 188 pgs: 188 active+clean; 5.5 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 843 B/s rd, 0 B/s wr, 832 op/s 2021-10-08T19:37:28.411 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:28 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:37:28.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:28 smithi097 ceph-mon[32687]: pgmap v804: 188 pgs: 188 active+clean; 5.5 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 843 B/s rd, 0 B/s wr, 832 op/s 2021-10-08T19:37:28.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:28 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:37:28.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:28 smithi097 ceph-mon[41966]: pgmap v804: 188 pgs: 188 active+clean; 5.5 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 843 B/s rd, 0 B/s wr, 832 op/s 2021-10-08T19:37:28.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:28 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:37:28.686 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:37:28.691 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:28.692 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:37:28.793 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:37:28.826 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:29.094 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:37:29.122 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:37:29.128 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:29.129 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:37:29.231 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:37:29.288 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:29.449 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:37:29.455 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:29.456 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:37:29.557 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:37:29.598 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:29.685 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:29.686 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:37:29.686 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:37:29.788 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:37:29.821 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:29.899 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:37:29.900 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:29.901 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:37:29.901 INFO:journalctl@ceph.osd.5.smithi117.stdout:Oct 08 19:37:29 smithi117 conmon[46504]: 2021-10-08T19:37:29.702+0000 7f7bf575b700 -1 osd.5 pg_epoch: 402 pg[3.16( empty local-lis/les=202/203 n=0 ec=131/60 lis/c=202/202 les/c/f=203/203/0 sis=202) [5,7,1] r=0 lpr=202 crt=0'0 mlcod 0'0 active+clean TIME_FOR_DEEP] scrubber pg(3.16) handle_scrub_reserve_grant: received unsolicited reservation grant from osd 1 (0x561531b31b80) 2021-10-08T19:37:30.003 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:37:30.039 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:30.104 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:37:30.107 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:30.108 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:37:30.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:30 smithi117 ceph-mon[34585]: pgmap v805: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 5.2 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 1.14k op/s 2021-10-08T19:37:30.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:30 smithi117 ceph-mon[34585]: 2.16 scrub ok 2021-10-08T19:37:30.210 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:37:30.250 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:30.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:30 smithi097 ceph-mon[32687]: pgmap v805: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 5.2 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 1.14k op/s 2021-10-08T19:37:30.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:30 smithi097 ceph-mon[32687]: 2.16 scrub ok 2021-10-08T19:37:30.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:30 smithi097 ceph-mon[41966]: pgmap v805: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 5.2 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 1.14k op/s 2021-10-08T19:37:30.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:30 smithi097 ceph-mon[41966]: 2.16 scrub ok 2021-10-08T19:37:30.587 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:37:30.600 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:30.601 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:37:30.705 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:37:30.754 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:30.827 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.0 to 1 (10000) 2021-10-08T19:37:30.850 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is set 2021-10-08T19:37:31.131 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:31 smithi097 ceph-mon[32687]: 10.1 scrub ok 2021-10-08T19:37:31.132 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:31 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2913374471' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:37:31.132 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:31 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1824337116' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2021-10-08T19:37:31.132 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:31 smithi097 ceph-mon[32687]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:37:31.132 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:31 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2913374471' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:37:31.133 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:31 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1824337116' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2021-10-08T19:37:31.133 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:31 smithi097 ceph-mon[32687]: osdmap e403: 8 total, 8 up, 8 in 2021-10-08T19:37:31.281 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:37:31.282 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2021-10-08T19:37:31.282 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2021-10-08T19:37:31.282 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2021-10-08T19:37:31.286 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:37:31.304 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:31 smithi117 ceph-mon[34585]: 10.1 scrub ok 2021-10-08T19:37:31.304 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:31 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2913374471' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:37:31.304 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:31 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1824337116' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2021-10-08T19:37:31.305 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:31 smithi117 ceph-mon[34585]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:37:31.305 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:31 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2913374471' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:37:31.305 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:31 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1824337116' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2021-10-08T19:37:31.305 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:31 smithi117 ceph-mon[34585]: osdmap e403: 8 total, 8 up, 8 in 2021-10-08T19:37:31.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:31 smithi097 ceph-mon[41966]: 10.1 scrub ok 2021-10-08T19:37:31.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:31 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2913374471' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:37:31.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:31 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1824337116' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2021-10-08T19:37:31.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:31 smithi097 ceph-mon[41966]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:37:31.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:31 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2913374471' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:37:31.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:31 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1824337116' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2021-10-08T19:37:31.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:31 smithi097 ceph-mon[41966]: osdmap e403: 8 total, 8 up, 8 in 2021-10-08T19:37:32.391 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:32 smithi097 ceph-mon[41966]: 2.f scrub ok 2021-10-08T19:37:32.391 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:32 smithi097 ceph-mon[41966]: pgmap v807: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 5.1 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.31k op/s 2021-10-08T19:37:32.394 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd reweight 2 1 2021-10-08T19:37:32.395 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:32 smithi097 ceph-mon[32687]: 2.f scrub ok 2021-10-08T19:37:32.395 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:32 smithi097 ceph-mon[32687]: pgmap v807: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 5.1 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.31k op/s 2021-10-08T19:37:32.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:32 smithi117 ceph-mon[34585]: 2.f scrub ok 2021-10-08T19:37:32.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:32 smithi117 ceph-mon[34585]: pgmap v807: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 5.1 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.31k op/s 2021-10-08T19:37:32.552 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:37:32.557 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:32.558 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:37:32.566 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2021-10-08T19:37:32.660 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:37:32.736 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:32.846 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:37:32.855 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:32.855 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:37:32.928 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:37:32 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:37:32] "GET /metrics HTTP/1.1" 200 155883 "" "Prometheus/2.18.1" 2021-10-08T19:37:32.958 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:37:32.962 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:37:33.010 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:33.106 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:37:33.112 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:37:33.118 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:33.118 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:37:33.220 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:37:33.244 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:37:33.266 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:33.273 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:37:33.304 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:37:33.336 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:37:33.338 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:33.339 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:37:33.344 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:37:33.386 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:37:33.419 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:37:33.442 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:37:33.477 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:37:33.504 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:33.533 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:37:33.533 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'false' 2021-10-08T19:37:33.534 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'false' 2021-10-08T19:37:33.534 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'false' 2021-10-08T19:37:33.534 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'false' 2021-10-08T19:37:33.534 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'false' 2021-10-08T19:37:33.535 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'false' 2021-10-08T19:37:33.535 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'false' 2021-10-08T19:37:33.535 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'false' 2021-10-08T19:37:33.656 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:37:33 smithi117 conmon[69189]: level=error ts=2021-10-08T19:37:33.505Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=2 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:37:33.731 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:37:33.735 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:33.736 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:37:33.837 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:37:33.874 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:34.070 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:37:34.075 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:34.076 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:37:33 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:37:33] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:37:34.077 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:37:34.144 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:34 smithi097 ceph-mon[41966]: pgmap v808: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 5.1 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 679 op/s 2021-10-08T19:37:34.144 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:34 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3433278698' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:37:34.145 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:34 smithi097 ceph-mon[32687]: pgmap v808: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 5.1 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 679 op/s 2021-10-08T19:37:34.145 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:34 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3433278698' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:37:34.178 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:37:34.230 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:34.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:34 smithi117 ceph-mon[34585]: pgmap v808: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 5.1 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 679 op/s 2021-10-08T19:37:34.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:34 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3433278698' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:37:34.536 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set nodeep-scrub 2021-10-08T19:37:34.905 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:37:34.909 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:34.911 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:37:35.012 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:37:35.054 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:35.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:35 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:37:35.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:35 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:37:35.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:35 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:37:35.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:35 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:37:35.468 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:37:35.473 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:35.473 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:37:35.547 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2021-10-08T19:37:35.547 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:37:35.568 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:35 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:37:35.568 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:35 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:37:35.574 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:37:35.608 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:37:35.627 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:35.750 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:37:35.755 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:35.756 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:37:35.857 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:37:35.906 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:36.003 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:37:36.009 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:36.010 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:37:36.112 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:37:36.166 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:36.242 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:37:36.246 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:36.247 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:37:36.261 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:36 smithi097 ceph-mon[32687]: pgmap v809: 188 pgs: 188 active+clean; 4.8 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.17k op/s 2021-10-08T19:37:36.262 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:36 smithi097 ceph-mon[32687]: osdmap e404: 8 total, 8 up, 8 in 2021-10-08T19:37:36.264 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:36 smithi097 ceph-mon[41966]: pgmap v809: 188 pgs: 188 active+clean; 4.8 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.17k op/s 2021-10-08T19:37:36.264 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:36 smithi097 ceph-mon[41966]: osdmap e404: 8 total, 8 up, 8 in 2021-10-08T19:37:36.348 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:37:36.380 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:36.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:36 smithi117 ceph-mon[34585]: pgmap v809: 188 pgs: 188 active+clean; 4.8 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.17k op/s 2021-10-08T19:37:36.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:36 smithi117 ceph-mon[34585]: osdmap e404: 8 total, 8 up, 8 in 2021-10-08T19:37:36.700 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:37:36.702 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:36.703 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:37:36.710 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2021-10-08T19:37:36.755 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2021-10-08T19:37:36.804 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:37:36.838 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:36.969 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:37:36.970 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:36.970 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:37:37.071 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:37:37.120 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:37:36 smithi097 conmon[33110]: 172.21.15.97 - - [08/Oct/2021:19:37:36] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:37:37.133 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:37.177 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:37:37.406 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:37:37 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:37:37.507 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:37:37.517 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:37.517 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:37:37.603 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:37:37.624 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:37:37.657 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:37.752 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:37:37.755 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:37.756 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:37:37.812 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.2 to 1 (10000) 2021-10-08T19:37:37.813 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:37 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:37:37.814 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:37 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:37:37.814 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:37 smithi117 ceph-mon[34585]: 172.21.15.97 - - [08/Oct/2021:19:37:36] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:37:37.816 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:37 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1798638668' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2021-10-08T19:37:37.817 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:37 smithi117 ceph-mon[34585]: pgmap v811: 188 pgs: 188 active+clean; 4.8 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 824 op/s 2021-10-08T19:37:37.817 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:37 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:37:37.817 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:37 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:37:37.817 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:37 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:37:37.817 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:37 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:37:37.857 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:37:37.907 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:38.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:37 smithi117 ceph-mon[34585]: poll took 540288.727 ms: 1 events 2021-10-08T19:37:38.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:37 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:37:38.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:37 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:37:38.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:37 smithi097 ceph-mon[41966]: 172.21.15.97 - - [08/Oct/2021:19:37:36] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:37:38.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:37 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1798638668' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2021-10-08T19:37:38.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:37 smithi097 ceph-mon[41966]: pgmap v811: 188 pgs: 188 active+clean; 4.8 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 824 op/s 2021-10-08T19:37:38.228 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:37 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:37:38.229 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:37 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:37:38.229 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:37 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:37:38.229 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:37 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:37:38.230 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:37 smithi097 ceph-mon[41966]: poll took 540288.727 ms: 1 events 2021-10-08T19:37:38.231 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:37 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:37:38.231 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:37 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:37:38.232 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:37 smithi097 ceph-mon[32687]: 172.21.15.97 - - [08/Oct/2021:19:37:36] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:37:38.232 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:37 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1798638668' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2021-10-08T19:37:38.233 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:37 smithi097 ceph-mon[32687]: pgmap v811: 188 pgs: 188 active+clean; 4.8 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 824 op/s 2021-10-08T19:37:38.233 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:37 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:37:38.233 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:37 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:37:38.234 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:37 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:37:38.234 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:37 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:37:38.235 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:37 smithi097 ceph-mon[32687]: poll took 540288.727 ms: 1 events 2021-10-08T19:37:39.021 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd reweight 4 1 2021-10-08T19:37:39.063 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:38 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1798638668' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2021-10-08T19:37:39.064 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:38 smithi097 ceph-mon[41966]: osdmap e405: 8 total, 8 up, 8 in 2021-10-08T19:37:39.064 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:38 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:37:39.064 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:38 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:37:39.077 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:38 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1798638668' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2021-10-08T19:37:39.078 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:38 smithi097 ceph-mon[32687]: osdmap e405: 8 total, 8 up, 8 in 2021-10-08T19:37:39.078 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:38 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:37:39.078 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:38 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:37:39.079 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:39.080 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:37:39.080 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:37:39.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:38 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1798638668' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2021-10-08T19:37:39.160 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:38 smithi117 ceph-mon[34585]: osdmap e405: 8 total, 8 up, 8 in 2021-10-08T19:37:39.160 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:38 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:37:39.160 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:38 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:37:39.181 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:37:39.228 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:39.303 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:37:39.305 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:39.306 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:37:39.410 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:37:39.450 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:39.542 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:37:39.551 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:39.552 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:37:39.674 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:37:39.717 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:39.827 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:39 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2296599833' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:37:39.828 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:39 smithi097 ceph-mon[32687]: pgmap v813: 188 pgs: 188 active+clean; 4.6 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 1.18k op/s 2021-10-08T19:37:39.842 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is set 2021-10-08T19:37:39.843 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:37:39.847 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:39.848 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:37:39.849 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2021-10-08T19:37:39.849 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:37:39.949 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:37:39.988 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:40.161 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:39 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2296599833' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:37:40.161 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:39 smithi117 ceph-mon[34585]: pgmap v813: 188 pgs: 188 active+clean; 4.6 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 1.18k op/s 2021-10-08T19:37:40.179 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:37:40.184 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:40.185 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:37:40.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:39 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2296599833' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:37:40.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:39 smithi097 ceph-mon[41966]: pgmap v813: 188 pgs: 188 active+clean; 4.6 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 1.18k op/s 2021-10-08T19:37:40.286 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:37:40.333 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:41.027 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2021-10-08T19:37:41.123 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:37:41.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:40 smithi117 ceph-mon[34585]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:37:41.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:40 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2296599833' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:37:41.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:40 smithi117 ceph-mon[34585]: osdmap e406: 8 total, 8 up, 8 in 2021-10-08T19:37:41.193 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:37:41.194 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:40 smithi097 ceph-mon[32687]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:37:41.194 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:40 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2296599833' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:37:41.194 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:40 smithi097 ceph-mon[32687]: osdmap e406: 8 total, 8 up, 8 in 2021-10-08T19:37:41.195 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:40 smithi097 ceph-mon[41966]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:37:41.195 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:40 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2296599833' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:37:41.195 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:40 smithi097 ceph-mon[41966]: osdmap e406: 8 total, 8 up, 8 in 2021-10-08T19:37:41.196 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:41.197 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:37:41.301 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:37:41.354 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:41.469 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:37:41.626 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:37:41.637 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:41.646 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:37:41.747 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:37:41.761 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:37:41.801 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:37:41.818 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:41.851 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:37:41.896 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:37:41.902 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:37:41.908 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:41.909 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:37:41.943 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:37:41.965 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:37:42.004 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:37:42.010 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:37:42.046 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:41 smithi117 ceph-mon[34585]: pgmap v815: 188 pgs: 188 active+clean; 4.5 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 927 op/s 2021-10-08T19:37:42.047 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:41 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3168043969' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:37:42.047 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:37:42.047 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true' 2021-10-08T19:37:42.048 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true' 2021-10-08T19:37:42.048 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true' 2021-10-08T19:37:42.048 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true' 2021-10-08T19:37:42.049 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true' 2021-10-08T19:37:42.049 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true' 2021-10-08T19:37:42.049 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'true' 2021-10-08T19:37:42.049 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'true' 2021-10-08T19:37:42.059 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:42.074 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:41 smithi097 ceph-mon[41966]: pgmap v815: 188 pgs: 188 active+clean; 4.5 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 927 op/s 2021-10-08T19:37:42.074 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:41 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3168043969' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:37:42.078 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:41 smithi097 ceph-mon[32687]: pgmap v815: 188 pgs: 188 active+clean; 4.5 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 927 op/s 2021-10-08T19:37:42.079 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:41 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3168043969' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:37:42.287 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:37:42.290 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:42.292 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:37:42.319 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:37:42 smithi117 conmon[69189]: level=error ts=2021-10-08T19:37:42.314Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=1 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:37:42.400 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:37:42.458 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:42.721 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:37:42 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:37:42] "GET /metrics HTTP/1.1" 200 155883 "" "Prometheus/2.18.1" 2021-10-08T19:37:43.161 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:42 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:37:43.196 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset noscrub 2021-10-08T19:37:43.228 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:42 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:37:43.229 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:42 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:37:43.642 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:43.642 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:37:43.643 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:37:43.747 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:37:43.797 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:43.943 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:37:43.944 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:43 smithi097 ceph-mon[41966]: pgmap v816: 188 pgs: 188 active+clean; 4.5 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 662 B/s rd, 0 B/s wr, 720 op/s 2021-10-08T19:37:43.944 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:37:43.945 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:43 smithi097 ceph-mon[32687]: pgmap v816: 188 pgs: 188 active+clean; 4.5 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 662 B/s rd, 0 B/s wr, 720 op/s 2021-10-08T19:37:44.015 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:37:44.016 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:44.016 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:37:44.081 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:37:44.085 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2021-10-08T19:37:44.085 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2021-10-08T19:37:44.085 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2021-10-08T19:37:44.086 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:37:44.110 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:37:44.111 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:37:43 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:37:43] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:37:44.111 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:37:44.111 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:43 smithi117 ceph-mon[34585]: pgmap v816: 188 pgs: 188 active+clean; 4.5 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 662 B/s rd, 0 B/s wr, 720 op/s 2021-10-08T19:37:44.118 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:37:44.177 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:44.291 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:37:44.297 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:44.298 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:37:44.400 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:37:44.442 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:44.513 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:37:44.520 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:44.521 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:37:44.622 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:37:44.669 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:44.763 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:37:44.770 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:44.771 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:37:44.873 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:37:44.886 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.4 to 1 (10000) 2021-10-08T19:37:44.919 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:44 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-10-08T19:37:44.919 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:44 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 1]}]: dispatch 2021-10-08T19:37:44.920 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:44 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.29", "id": [7, 2]}]: dispatch 2021-10-08T19:37:44.920 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:44 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1554135366' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2021-10-08T19:37:44.921 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:44 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-10-08T19:37:44.922 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:44 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 1]}]: dispatch 2021-10-08T19:37:44.922 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:44 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.29", "id": [7, 2]}]: dispatch 2021-10-08T19:37:44.922 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:44 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1554135366' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2021-10-08T19:37:44.923 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:45.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:44 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-10-08T19:37:45.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:44 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 1]}]: dispatch 2021-10-08T19:37:45.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:44 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.29", "id": [7, 2]}]: dispatch 2021-10-08T19:37:45.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:44 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1554135366' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2021-10-08T19:37:45.216 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2021-10-08T19:37:45.551 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:37:45.767 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2021-10-08T19:37:46.153 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:37:46.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:45 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]': finished 2021-10-08T19:37:46.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:45 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 1]}]': finished 2021-10-08T19:37:46.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:45 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.29", "id": [7, 2]}]': finished 2021-10-08T19:37:46.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:45 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1554135366' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]': finished 2021-10-08T19:37:46.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:45 smithi117 ceph-mon[34585]: osdmap e407: 8 total, 8 up, 8 in 2021-10-08T19:37:46.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:45 smithi117 ceph-mon[34585]: pgmap v818: 188 pgs: 188 active+clean; 4.1 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1.60k op/s 2021-10-08T19:37:46.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:45 smithi117 ceph-mon[34585]: osdmap e408: 8 total, 8 up, 8 in 2021-10-08T19:37:46.158 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:45 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]': finished 2021-10-08T19:37:46.158 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:45 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 1]}]': finished 2021-10-08T19:37:46.158 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:45 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.29", "id": [7, 2]}]': finished 2021-10-08T19:37:46.159 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:45 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1554135366' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]': finished 2021-10-08T19:37:46.159 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:45 smithi097 ceph-mon[32687]: osdmap e407: 8 total, 8 up, 8 in 2021-10-08T19:37:46.159 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:45 smithi097 ceph-mon[32687]: pgmap v818: 188 pgs: 188 active+clean; 4.1 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1.60k op/s 2021-10-08T19:37:46.159 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:45 smithi097 ceph-mon[32687]: osdmap e408: 8 total, 8 up, 8 in 2021-10-08T19:37:46.160 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:45 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]': finished 2021-10-08T19:37:46.160 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:45 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 1]}]': finished 2021-10-08T19:37:46.160 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:45 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.29", "id": [7, 2]}]': finished 2021-10-08T19:37:46.161 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:45 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1554135366' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]': finished 2021-10-08T19:37:46.161 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:45 smithi097 ceph-mon[41966]: osdmap e407: 8 total, 8 up, 8 in 2021-10-08T19:37:46.161 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:45 smithi097 ceph-mon[41966]: pgmap v818: 188 pgs: 188 active+clean; 4.1 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1.60k op/s 2021-10-08T19:37:46.161 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:45 smithi097 ceph-mon[41966]: osdmap e408: 8 total, 8 up, 8 in 2021-10-08T19:37:46.162 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:46.163 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:37:46.264 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:37:46.314 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:46.615 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:37:46.619 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:46.620 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:37:46.722 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:37:46.766 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:46.772 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:37:46.792 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd reweight 5 1 2021-10-08T19:37:47.261 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:37:47.263 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:37:47 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:37:47.264 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:47.265 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:37:47.366 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:37:47.433 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:47.508 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:37:47.514 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:47.515 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:37:47.616 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:37:47.665 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:37:47.677 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:47.836 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:37:47.839 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:47.840 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:37:47.941 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:37:47.959 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:47 smithi097 ceph-mon[32687]: pgmap v820: 188 pgs: 188 active+clean; 4.1 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 725 B/s rd, 0 B/s wr, 817 op/s 2021-10-08T19:37:47.960 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:47 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:37:47.960 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:47 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3663950927' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:37:47.960 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:47 smithi097 ceph-mon[32687]: from='client.36032 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:37:47.961 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:47 smithi097 ceph-mon[41966]: pgmap v820: 188 pgs: 188 active+clean; 4.1 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 725 B/s rd, 0 B/s wr, 817 op/s 2021-10-08T19:37:47.961 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:47 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:37:47.961 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:47 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3663950927' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:37:47.961 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:47 smithi097 ceph-mon[41966]: from='client.36032 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:37:47.963 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is unset 2021-10-08T19:37:47.984 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:48.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:47 smithi117 ceph-mon[34585]: pgmap v820: 188 pgs: 188 active+clean; 4.1 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 725 B/s rd, 0 B/s wr, 817 op/s 2021-10-08T19:37:48.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:47 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:37:48.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:47 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3663950927' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:37:48.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:47 smithi117 ceph-mon[34585]: from='client.36032 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:37:48.581 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:37:48.584 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:48.585 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:37:48.686 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:37:48.726 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:48.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:48 smithi097 ceph-mon[41966]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:37:48.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:48 smithi097 ceph-mon[41966]: from='client.36032 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:37:48.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:48 smithi097 ceph-mon[41966]: osdmap e409: 8 total, 8 up, 8 in 2021-10-08T19:37:48.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:48 smithi097 ceph-mon[41966]: 2.1 scrub ok 2021-10-08T19:37:48.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:48 smithi097 ceph-mon[32687]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:37:48.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:48 smithi097 ceph-mon[32687]: from='client.36032 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:37:48.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:48 smithi097 ceph-mon[32687]: osdmap e409: 8 total, 8 up, 8 in 2021-10-08T19:37:48.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:48 smithi097 ceph-mon[32687]: 2.1 scrub ok 2021-10-08T19:37:49.217 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:48 smithi117 ceph-mon[34585]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:37:49.218 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:48 smithi117 ceph-mon[34585]: from='client.36032 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:37:49.218 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:48 smithi117 ceph-mon[34585]: osdmap e409: 8 total, 8 up, 8 in 2021-10-08T19:37:49.218 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:48 smithi117 ceph-mon[34585]: 2.1 scrub ok 2021-10-08T19:37:49.276 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:37:49.276 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2021-10-08T19:37:49.276 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2021-10-08T19:37:49.277 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2021-10-08T19:37:49.277 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.277 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.25465.0:50756 9.3 9:cf42c892:::benchmark_data_smithi097_196985_object50755:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e311)", 2021-10-08T19:37:49.277 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:32:15.147588+0000", 2021-10-08T19:37:49.278 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 334.11342238200001, 2021-10-08T19:37:49.278 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.18313448800000001, 2021-10-08T19:37:49.278 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:37:49.278 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:37:49.278 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:37:49.279 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.25465", 2021-10-08T19:37:49.279 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:37:49.280 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 50756 2021-10-08T19:37:49.280 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.280 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:37:49.280 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.280 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:37:49.281 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:15.147588+0000", 2021-10-08T19:37:49.281 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:37:49.281 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.281 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.282 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:37:49.282 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:15.147588+0000", 2021-10-08T19:37:49.282 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:37:49.282 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.283 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.283 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:37:49.283 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:15.147587+0000", 2021-10-08T19:37:49.283 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:37:49.284 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.284 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.284 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:37:49.284 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:15.147615+0000", 2021-10-08T19:37:49.285 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8030000000000001e-05 2021-10-08T19:37:49.285 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.286 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.286 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:37:49.286 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:15.147621+0000", 2021-10-08T19:37:49.286 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9399999999999999e-06 2021-10-08T19:37:49.287 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.287 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.287 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:37:49.287 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:15.147625+0000", 2021-10-08T19:37:49.288 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2359999999999998e-06 2021-10-08T19:37:49.288 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.288 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.288 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:37:49.289 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:15.147679+0000", 2021-10-08T19:37:49.289 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4271999999999998e-05 2021-10-08T19:37:49.289 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.289 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.290 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:37:49.290 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:15.147801+0000", 2021-10-08T19:37:49.290 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000121947 2021-10-08T19:37:49.290 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.290 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.291 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 1,3", 2021-10-08T19:37:49.291 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:15.147941+0000", 2021-10-08T19:37:49.291 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013947100000000001 2021-10-08T19:37:49.291 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.292 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.292 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:37:49.292 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:15.152447+0000", 2021-10-08T19:37:49.292 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0045064459999999999 2021-10-08T19:37:49.292 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.293 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.293 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:37:49.293 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:15.152700+0000", 2021-10-08T19:37:49.293 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00025262700000000001 2021-10-08T19:37:49.293 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.294 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.294 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:37:49.294 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:15.330627+0000", 2021-10-08T19:37:49.294 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.17792706699999999 2021-10-08T19:37:49.295 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.295 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.295 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:37:49.295 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:15.330681+0000", 2021-10-08T19:37:49.296 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4188999999999999e-05 2021-10-08T19:37:49.296 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.296 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.297 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:37:49.297 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:15.330722+0000", 2021-10-08T19:37:49.297 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.108e-05 2021-10-08T19:37:49.297 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:37:49.297 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:37:49.298 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:37:49.298 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.298 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.298 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:77499 9.5 e316/290 9:ac4969c9:::benchmark_data_smithi097_196985_object77498:head v 316'4760, mlcod=316'4757)", 2021-10-08T19:37:49.299 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:32:38.370431+0000", 2021-10-08T19:37:49.299 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 310.890579016, 2021-10-08T19:37:49.299 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.21244118000000001, 2021-10-08T19:37:49.299 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:37:49.299 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:37:49.300 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:37:49.300 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.300 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:37:49.300 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370431+0000", 2021-10-08T19:37:49.300 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:37:49.301 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.301 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.301 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:37:49.301 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370431+0000", 2021-10-08T19:37:49.301 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:37:49.302 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.302 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.302 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:37:49.302 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370430+0000", 2021-10-08T19:37:49.303 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:37:49.303 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.303 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.303 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:37:49.303 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370481+0000", 2021-10-08T19:37:49.304 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1430000000000001e-05 2021-10-08T19:37:49.304 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.304 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.304 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:37:49.304 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370492+0000", 2021-10-08T19:37:49.305 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0755e-05 2021-10-08T19:37:49.305 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.305 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.305 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:37:49.306 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370498+0000", 2021-10-08T19:37:49.306 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4869999999999999e-06 2021-10-08T19:37:49.306 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.307 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.307 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:37:49.307 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370541+0000", 2021-10-08T19:37:49.307 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2460999999999999e-05 2021-10-08T19:37:49.308 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.308 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.308 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:37:49.308 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370559+0000", 2021-10-08T19:37:49.309 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8150000000000001e-05 2021-10-08T19:37:49.309 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.309 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.309 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:37:49.309 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.582843+0000", 2021-10-08T19:37:49.310 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.21228397099999999 2021-10-08T19:37:49.310 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.310 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.310 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:37:49.310 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.582872+0000", 2021-10-08T19:37:49.311 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9221e-05 2021-10-08T19:37:49.311 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:37:49.311 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:37:49.311 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:37:49.312 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.312 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.312 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:77507 9.c e316/290 9:3c2e9901:::benchmark_data_smithi097_196985_object77506:head v 316'4807, mlcod=316'4804)", 2021-10-08T19:37:49.312 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:32:38.370481+0000", 2021-10-08T19:37:49.312 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 310.89052926800002, 2021-10-08T19:37:49.313 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.210201309, 2021-10-08T19:37:49.313 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:37:49.313 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:37:49.313 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:37:49.313 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.314 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:37:49.314 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370481+0000", 2021-10-08T19:37:49.314 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:37:49.314 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.315 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.315 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:37:49.315 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370481+0000", 2021-10-08T19:37:49.315 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:37:49.315 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.316 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.316 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:37:49.316 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370480+0000", 2021-10-08T19:37:49.317 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999995 2021-10-08T19:37:49.317 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.318 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.318 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:37:49.318 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370508+0000", 2021-10-08T19:37:49.318 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7653000000000001e-05 2021-10-08T19:37:49.319 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.319 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.319 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:37:49.319 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370514+0000", 2021-10-08T19:37:49.319 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1920000000000002e-06 2021-10-08T19:37:49.320 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.320 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.320 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:37:49.320 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370519+0000", 2021-10-08T19:37:49.321 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.113e-06 2021-10-08T19:37:49.321 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.321 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.321 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:37:49.321 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370630+0000", 2021-10-08T19:37:49.322 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000110925 2021-10-08T19:37:49.322 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.322 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.322 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:37:49.323 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370649+0000", 2021-10-08T19:37:49.323 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9063999999999999e-05 2021-10-08T19:37:49.323 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.323 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.323 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:37:49.324 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.377750+0000", 2021-10-08T19:37:49.324 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0071006710000000002 2021-10-08T19:37:49.324 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.324 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.325 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:37:49.325 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580682+0000", 2021-10-08T19:37:49.325 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.202932268 2021-10-08T19:37:49.325 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:37:49.325 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:37:49.326 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:37:49.326 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.326 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.326 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:77503 9.5 e316/290 9:a86a20e3:::benchmark_data_smithi097_196985_object77502:head v 316'4761, mlcod=316'4758)", 2021-10-08T19:37:49.327 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:32:38.372458+0000", 2021-10-08T19:37:49.327 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 310.888552135, 2021-10-08T19:37:49.327 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.210430539, 2021-10-08T19:37:49.328 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:37:49.328 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:37:49.328 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:37:49.328 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.328 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:37:49.329 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.372458+0000", 2021-10-08T19:37:49.329 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:37:49.329 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.329 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.330 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:37:49.330 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.372458+0000", 2021-10-08T19:37:49.330 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:37:49.330 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.330 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.331 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:37:49.331 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.372457+0000", 2021-10-08T19:37:49.331 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:37:49.331 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.332 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.332 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:37:49.332 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.372492+0000", 2021-10-08T19:37:49.332 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.5354000000000001e-05 2021-10-08T19:37:49.332 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.333 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.333 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:37:49.333 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.372502+0000", 2021-10-08T19:37:49.333 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8810000000000008e-06 2021-10-08T19:37:49.333 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.334 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.334 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:37:49.334 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.372508+0000", 2021-10-08T19:37:49.334 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3069999999999999e-06 2021-10-08T19:37:49.334 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.335 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.335 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:37:49.335 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.372792+0000", 2021-10-08T19:37:49.335 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00028411499999999999 2021-10-08T19:37:49.336 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.336 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.336 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:37:49.336 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.372804+0000", 2021-10-08T19:37:49.336 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2058e-05 2021-10-08T19:37:49.337 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.337 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.337 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:37:49.337 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.582875+0000", 2021-10-08T19:37:49.338 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.210070701 2021-10-08T19:37:49.338 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.338 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.339 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:37:49.339 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.582888+0000", 2021-10-08T19:37:49.339 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3345e-05 2021-10-08T19:37:49.339 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:37:49.339 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:37:49.340 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:37:49.340 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.340 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.340 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:77509 9.5 e316/290 9:a04d875b:::benchmark_data_smithi097_196985_object77508:head v 316'4762, mlcod=316'4758)", 2021-10-08T19:37:49.341 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:32:38.373454+0000", 2021-10-08T19:37:49.341 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 310.88755594100002, 2021-10-08T19:37:49.341 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.20948882399999999, 2021-10-08T19:37:49.341 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:37:49.341 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:37:49.342 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:37:49.342 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.342 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:37:49.342 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.373454+0000", 2021-10-08T19:37:49.342 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:37:49.343 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.343 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.343 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:37:49.343 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.373454+0000", 2021-10-08T19:37:49.344 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:37:49.344 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.344 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.344 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:37:49.344 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.373453+0000", 2021-10-08T19:37:49.345 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:37:49.345 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.345 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.345 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:37:49.345 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.373614+0000", 2021-10-08T19:37:49.346 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016036300000000001 2021-10-08T19:37:49.346 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.346 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.346 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:37:49.346 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.373627+0000", 2021-10-08T19:37:49.347 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3759e-05 2021-10-08T19:37:49.347 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.347 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.347 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:37:49.348 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.373631+0000", 2021-10-08T19:37:49.348 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.019e-06 2021-10-08T19:37:49.348 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.348 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.348 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:37:49.349 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.375396+0000", 2021-10-08T19:37:49.349 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0017641810000000001 2021-10-08T19:37:49.349 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.349 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.349 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:37:49.350 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.375414+0000", 2021-10-08T19:37:49.350 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8949000000000001e-05 2021-10-08T19:37:49.350 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.350 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.350 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:37:49.351 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.582929+0000", 2021-10-08T19:37:49.351 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.20751492799999999 2021-10-08T19:37:49.351 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.351 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.352 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:37:49.352 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.582943+0000", 2021-10-08T19:37:49.352 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3382e-05 2021-10-08T19:37:49.352 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:37:49.352 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:37:49.353 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:37:49.353 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.353 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.353 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:77510 9.c e316/290 9:3e9f4d30:::benchmark_data_smithi097_196985_object77509:head v 316'4808, mlcod=316'4804)", 2021-10-08T19:37:49.353 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:32:38.373489+0000", 2021-10-08T19:37:49.354 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 310.88752058099999, 2021-10-08T19:37:49.354 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.20722019899999999, 2021-10-08T19:37:49.354 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:37:49.354 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:37:49.355 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:37:49.355 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.355 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:37:49.355 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.373489+0000", 2021-10-08T19:37:49.355 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:37:49.356 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.356 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.356 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:37:49.356 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.373489+0000", 2021-10-08T19:37:49.357 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:37:49.357 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.357 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.357 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:37:49.357 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.373489+0000", 2021-10-08T19:37:49.358 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:37:49.358 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.358 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.358 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:37:49.359 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.373614+0000", 2021-10-08T19:37:49.359 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012516400000000001 2021-10-08T19:37:49.359 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.359 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.359 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:37:49.360 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.373624+0000", 2021-10-08T19:37:49.360 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0078000000000001e-05 2021-10-08T19:37:49.360 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.360 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.360 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:37:49.361 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.373630+0000", 2021-10-08T19:37:49.361 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9349999999999999e-06 2021-10-08T19:37:49.361 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.361 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.361 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:37:49.362 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.373791+0000", 2021-10-08T19:37:49.362 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016118299999999999 2021-10-08T19:37:49.362 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.362 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.363 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:37:49.363 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.373808+0000", 2021-10-08T19:37:49.363 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7280999999999999e-05 2021-10-08T19:37:49.363 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.363 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.364 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:37:49.364 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580687+0000", 2021-10-08T19:37:49.364 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.20687856399999999 2021-10-08T19:37:49.364 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.365 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.365 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:37:49.365 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580710+0000", 2021-10-08T19:37:49.365 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2738000000000002e-05 2021-10-08T19:37:49.365 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:37:49.366 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:37:49.366 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:37:49.366 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.366 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.366 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.25465.0:77517 9.d 9:b7278e79:::benchmark_data_smithi097_196985_object77516:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e316)", 2021-10-08T19:37:49.367 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:32:38.375271+0000", 2021-10-08T19:37:49.367 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 310.88573859399997, 2021-10-08T19:37:49.367 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.214728957, 2021-10-08T19:37:49.367 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:37:49.368 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:37:49.368 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:37:49.368 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.25465", 2021-10-08T19:37:49.368 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:37:49.368 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 77517 2021-10-08T19:37:49.369 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.369 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:37:49.369 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.369 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:37:49.370 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.375271+0000", 2021-10-08T19:37:49.370 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:37:49.370 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.370 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.370 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:37:49.371 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.375271+0000", 2021-10-08T19:37:49.371 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:37:49.371 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.371 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.371 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:37:49.372 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.375269+0000", 2021-10-08T19:37:49.372 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:37:49.372 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.372 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.372 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:37:49.373 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.375303+0000", 2021-10-08T19:37:49.373 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.3868999999999997e-05 2021-10-08T19:37:49.373 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.373 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.374 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:37:49.374 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.375315+0000", 2021-10-08T19:37:49.374 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1728e-05 2021-10-08T19:37:49.374 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.374 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.375 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:37:49.375 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.375321+0000", 2021-10-08T19:37:49.375 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7499999999999997e-06 2021-10-08T19:37:49.375 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.375 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.376 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:37:49.376 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.377409+0000", 2021-10-08T19:37:49.376 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020878939999999999 2021-10-08T19:37:49.376 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.377 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.377 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:37:49.377 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.377528+0000", 2021-10-08T19:37:49.377 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000118972 2021-10-08T19:37:49.377 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.378 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.378 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 1,5", 2021-10-08T19:37:49.378 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.377696+0000", 2021-10-08T19:37:49.378 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016830600000000001 2021-10-08T19:37:49.378 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.379 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.379 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:37:49.379 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.582927+0000", 2021-10-08T19:37:49.379 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.205230724 2021-10-08T19:37:49.380 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.380 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.380 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:37:49.380 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.584639+0000", 2021-10-08T19:37:49.380 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001711808 2021-10-08T19:37:49.381 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.381 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.381 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:37:49.381 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.589921+0000", 2021-10-08T19:37:49.382 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0052821830000000002 2021-10-08T19:37:49.382 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.382 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.382 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:37:49.382 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.589964+0000", 2021-10-08T19:37:49.383 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.3319000000000003e-05 2021-10-08T19:37:49.383 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.383 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.383 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:37:49.384 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.590000+0000", 2021-10-08T19:37:49.384 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.5793000000000001e-05 2021-10-08T19:37:49.384 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:37:49.384 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:37:49.384 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:37:49.385 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.385 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.385 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:77518 9.9 e316/290 9:9bd075f7:::benchmark_data_smithi097_196985_object77517:head v 316'4852, mlcod=316'4850)", 2021-10-08T19:37:49.385 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:32:38.376302+0000", 2021-10-08T19:37:49.386 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 310.88470774799998, 2021-10-08T19:37:49.386 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.20439987900000001, 2021-10-08T19:37:49.386 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:37:49.386 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:37:49.386 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:37:49.387 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.387 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:37:49.387 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.376302+0000", 2021-10-08T19:37:49.387 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:37:49.387 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.388 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.388 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:37:49.388 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.376302+0000", 2021-10-08T19:37:49.388 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:37:49.389 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.389 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.389 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:37:49.389 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.376299+0000", 2021-10-08T19:37:49.389 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999967 2021-10-08T19:37:49.390 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.390 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.390 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:37:49.390 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.376325+0000", 2021-10-08T19:37:49.391 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6188000000000001e-05 2021-10-08T19:37:49.391 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.391 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.391 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:37:49.391 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.376333+0000", 2021-10-08T19:37:49.392 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9160000000000001e-06 2021-10-08T19:37:49.392 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.392 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.392 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:37:49.393 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.376337+0000", 2021-10-08T19:37:49.393 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1930000000000003e-06 2021-10-08T19:37:49.393 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.393 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.393 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:37:49.394 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.376378+0000", 2021-10-08T19:37:49.394 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0917999999999997e-05 2021-10-08T19:37:49.394 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.394 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.394 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:37:49.395 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.376398+0000", 2021-10-08T19:37:49.395 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9882999999999999e-05 2021-10-08T19:37:49.395 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.395 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.395 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:37:49.396 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580668+0000", 2021-10-08T19:37:49.396 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.204270813 2021-10-08T19:37:49.396 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.396 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.397 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:37:49.397 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580702+0000", 2021-10-08T19:37:49.397 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.3528000000000002e-05 2021-10-08T19:37:49.397 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:37:49.397 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:37:49.398 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:37:49.398 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.398 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.398 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:77511 9.1 e316/290 9:84400f31:::benchmark_data_smithi097_196985_object77510:head v 316'4798, mlcod=316'4795)", 2021-10-08T19:37:49.398 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:32:38.377524+0000", 2021-10-08T19:37:49.399 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 310.88348618499998, 2021-10-08T19:37:49.399 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.20320565800000001, 2021-10-08T19:37:49.399 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:37:49.399 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:37:49.400 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:37:49.400 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.400 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:37:49.400 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.377524+0000", 2021-10-08T19:37:49.400 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:37:49.401 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.401 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.401 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:37:49.401 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.377524+0000", 2021-10-08T19:37:49.401 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:37:49.402 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.402 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.402 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:37:49.402 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.377523+0000", 2021-10-08T19:37:49.403 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999995 2021-10-08T19:37:49.403 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.403 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.403 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:37:49.403 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.377552+0000", 2021-10-08T19:37:49.404 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9136e-05 2021-10-08T19:37:49.404 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.404 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.404 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:37:49.404 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.377558+0000", 2021-10-08T19:37:49.405 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.959e-06 2021-10-08T19:37:49.405 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.405 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.405 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:37:49.406 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.377562+0000", 2021-10-08T19:37:49.406 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0090000000000001e-06 2021-10-08T19:37:49.406 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.406 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.406 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:37:49.407 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.377638+0000", 2021-10-08T19:37:49.407 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5498000000000001e-05 2021-10-08T19:37:49.407 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.407 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.407 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:37:49.408 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.377656+0000", 2021-10-08T19:37:49.408 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8423999999999998e-05 2021-10-08T19:37:49.408 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.408 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.409 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:37:49.409 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580708+0000", 2021-10-08T19:37:49.409 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.20305161199999999 2021-10-08T19:37:49.409 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.409 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.410 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:37:49.410 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580729+0000", 2021-10-08T19:37:49.410 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1585000000000001e-05 2021-10-08T19:37:49.410 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:37:49.410 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:37:49.411 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:37:49.411 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.411 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.411 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:77514 9.1 e316/290 9:8c08759a:::benchmark_data_smithi097_196985_object77513:head v 316'4799, mlcod=316'4796)", 2021-10-08T19:37:49.412 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:32:38.380203+0000", 2021-10-08T19:37:49.412 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 310.88080665000001, 2021-10-08T19:37:49.412 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.20752410600000001, 2021-10-08T19:37:49.412 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:37:49.412 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:37:49.413 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:37:49.413 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.413 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:37:49.413 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.380203+0000", 2021-10-08T19:37:49.413 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:37:49.414 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.414 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.414 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:37:49.414 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.380203+0000", 2021-10-08T19:37:49.414 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:37:49.415 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.415 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.415 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:37:49.415 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.380202+0000", 2021-10-08T19:37:49.415 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:37:49.416 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.416 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.416 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:37:49.416 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.380266+0000", 2021-10-08T19:37:49.417 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4292e-05 2021-10-08T19:37:49.417 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.417 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.417 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:37:49.417 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580625+0000", 2021-10-08T19:37:49.418 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.20035874300000001 2021-10-08T19:37:49.418 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.418 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.418 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:37:49.418 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580647+0000", 2021-10-08T19:37:49.419 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1883e-05 2021-10-08T19:37:49.419 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.419 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.419 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:37:49.419 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580750+0000", 2021-10-08T19:37:49.420 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000102703 2021-10-08T19:37:49.420 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.420 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.420 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:37:49.421 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580766+0000", 2021-10-08T19:37:49.421 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6155e-05 2021-10-08T19:37:49.421 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.421 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.421 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:37:49.422 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.587680+0000", 2021-10-08T19:37:49.422 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0069146219999999996 2021-10-08T19:37:49.422 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.422 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.423 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:37:49.423 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.587727+0000", 2021-10-08T19:37:49.423 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7018000000000003e-05 2021-10-08T19:37:49.423 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:37:49.423 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:37:49.424 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:37:49.424 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.424 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.424 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop_reply(client.25465.0:77517 9.d e316/308 ondisk, result = 0)", 2021-10-08T19:37:49.424 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:32:38.380417+0000", 2021-10-08T19:37:49.425 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 310.88059259200003, 2021-10-08T19:37:49.425 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.202527015, 2021-10-08T19:37:49.425 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:37:49.425 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2021-10-08T19:37:49.426 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:37:49.426 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.426 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:37:49.426 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.380417+0000", 2021-10-08T19:37:49.426 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:37:49.427 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.427 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.427 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:37:49.427 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.380417+0000", 2021-10-08T19:37:49.427 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:37:49.428 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.428 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.428 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:37:49.428 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.380416+0000", 2021-10-08T19:37:49.429 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:37:49.429 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.429 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.429 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:37:49.429 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.380422+0000", 2021-10-08T19:37:49.430 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5339999999999999e-06 2021-10-08T19:37:49.430 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.430 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.430 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:37:49.430 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580587+0000", 2021-10-08T19:37:49.431 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.200164861 2021-10-08T19:37:49.431 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.431 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.431 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:37:49.431 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580618+0000", 2021-10-08T19:37:49.432 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.1516000000000001e-05 2021-10-08T19:37:49.432 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.432 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.432 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:37:49.433 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.582913+0000", 2021-10-08T19:37:49.433 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022951719999999998 2021-10-08T19:37:49.434 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.434 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.434 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:37:49.434 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.582920+0000", 2021-10-08T19:37:49.435 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1300000000000003e-06 2021-10-08T19:37:49.435 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.435 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.435 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:37:49.435 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.582944+0000", 2021-10-08T19:37:49.436 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3972e-05 2021-10-08T19:37:49.436 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:37:49.436 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:37:49.436 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:37:49.437 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.437 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.437 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:77532 9.9 e316/290 9:9ff58f88:::benchmark_data_smithi097_196985_object77531:head v 316'4853, mlcod=316'4850)", 2021-10-08T19:37:49.437 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:32:38.395624+0000", 2021-10-08T19:37:49.437 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 310.86538553399998, 2021-10-08T19:37:49.438 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.192136736, 2021-10-08T19:37:49.438 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:37:49.438 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:37:49.438 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:37:49.438 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.439 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:37:49.439 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.395624+0000", 2021-10-08T19:37:49.439 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:37:49.439 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.440 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.440 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:37:49.440 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.395624+0000", 2021-10-08T19:37:49.440 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:37:49.440 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.441 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.441 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:37:49.441 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.395622+0000", 2021-10-08T19:37:49.441 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:37:49.441 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.442 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.442 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:37:49.442 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.395684+0000", 2021-10-08T19:37:49.442 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1247000000000005e-05 2021-10-08T19:37:49.443 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.443 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.443 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:37:49.443 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580588+0000", 2021-10-08T19:37:49.443 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.18490478199999999 2021-10-08T19:37:49.444 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.444 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.444 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:37:49.444 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580644+0000", 2021-10-08T19:37:49.444 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5415999999999999e-05 2021-10-08T19:37:49.445 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.445 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.445 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:37:49.445 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580726+0000", 2021-10-08T19:37:49.445 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2120999999999995e-05 2021-10-08T19:37:49.446 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.446 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.446 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:37:49.446 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580747+0000", 2021-10-08T19:37:49.447 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0856000000000002e-05 2021-10-08T19:37:49.447 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.447 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.447 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:37:49.447 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.587731+0000", 2021-10-08T19:37:49.448 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0069841850000000004 2021-10-08T19:37:49.448 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.448 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.448 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:37:49.448 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.587761+0000", 2021-10-08T19:37:49.449 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.0134999999999999e-05 2021-10-08T19:37:49.449 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:37:49.449 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:37:49.449 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:37:49.450 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.450 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.450 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.25465.0:169834 9.d 9:b89d2b99:::benchmark_data_smithi097_196985_object54143:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e334)", 2021-10-08T19:37:49.450 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:34:02.167884+0000", 2021-10-08T19:37:49.450 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 227.09312632000001, 2021-10-08T19:37:49.451 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.17812953400000001, 2021-10-08T19:37:49.451 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:37:49.451 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:37:49.451 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:37:49.451 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.25465", 2021-10-08T19:37:49.452 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:37:49.452 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 169834 2021-10-08T19:37:49.452 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.452 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:37:49.453 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.453 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:37:49.453 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.167884+0000", 2021-10-08T19:37:49.453 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:37:49.453 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.454 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.454 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:37:49.454 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.167884+0000", 2021-10-08T19:37:49.454 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:37:49.455 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.455 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.455 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:37:49.455 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.167882+0000", 2021-10-08T19:37:49.455 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:37:49.456 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.456 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.456 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:37:49.456 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.167888+0000", 2021-10-08T19:37:49.456 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9900000000000002e-06 2021-10-08T19:37:49.457 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.457 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.457 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:37:49.457 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.167898+0000", 2021-10-08T19:37:49.458 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0148e-05 2021-10-08T19:37:49.458 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.458 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.458 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:37:49.458 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.167903+0000", 2021-10-08T19:37:49.459 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.6210000000000003e-06 2021-10-08T19:37:49.459 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.459 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.459 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:37:49.459 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.167936+0000", 2021-10-08T19:37:49.460 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.3404000000000001e-05 2021-10-08T19:37:49.460 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.460 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.460 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:37:49.461 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.168052+0000", 2021-10-08T19:37:49.461 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000116078 2021-10-08T19:37:49.461 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.461 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.461 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 1,5", 2021-10-08T19:37:49.462 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.168130+0000", 2021-10-08T19:37:49.462 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.7768000000000005e-05 2021-10-08T19:37:49.462 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.462 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.462 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:37:49.463 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.172735+0000", 2021-10-08T19:37:49.463 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046050509999999998 2021-10-08T19:37:49.463 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.463 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.464 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:37:49.464 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.173657+0000", 2021-10-08T19:37:49.464 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00092227699999999999 2021-10-08T19:37:49.464 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.464 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.465 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:37:49.465 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.345917+0000", 2021-10-08T19:37:49.465 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.17225993100000001 2021-10-08T19:37:49.465 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.465 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.466 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:37:49.466 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.345975+0000", 2021-10-08T19:37:49.466 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7921000000000003e-05 2021-10-08T19:37:49.466 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.466 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.467 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:37:49.467 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.346013+0000", 2021-10-08T19:37:49.467 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7981000000000001e-05 2021-10-08T19:37:49.467 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:37:49.468 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:37:49.468 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:37:49.468 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.468 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.468 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.25465.0:169838 9.3 9:cc713d20:::benchmark_data_smithi097_196985_object54147:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e334)", 2021-10-08T19:37:49.469 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:34:02.168016+0000", 2021-10-08T19:37:49.469 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 227.09299348100001, 2021-10-08T19:37:49.469 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.18378728999999999, 2021-10-08T19:37:49.469 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:37:49.469 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:37:49.470 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:37:49.470 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.25465", 2021-10-08T19:37:49.470 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:37:49.470 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 169838 2021-10-08T19:37:49.471 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.471 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:37:49.471 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.471 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:37:49.471 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.168016+0000", 2021-10-08T19:37:49.472 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:37:49.472 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.472 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.472 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:37:49.472 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.168016+0000", 2021-10-08T19:37:49.473 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:37:49.473 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.473 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.473 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:37:49.474 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.168015+0000", 2021-10-08T19:37:49.474 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:37:49.474 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.474 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.474 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:37:49.475 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.168020+0000", 2021-10-08T19:37:49.475 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.651e-06 2021-10-08T19:37:49.475 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.475 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.476 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:37:49.476 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.168028+0000", 2021-10-08T19:37:49.476 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4300000000000006e-06 2021-10-08T19:37:49.476 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.476 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.477 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:37:49.477 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.168034+0000", 2021-10-08T19:37:49.477 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6500000000000001e-06 2021-10-08T19:37:49.477 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.477 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.478 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:37:49.478 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.170324+0000", 2021-10-08T19:37:49.478 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022904560000000002 2021-10-08T19:37:49.478 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.479 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.479 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:37:49.479 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.170455+0000", 2021-10-08T19:37:49.479 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013018900000000001 2021-10-08T19:37:49.479 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.480 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.480 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 1,3", 2021-10-08T19:37:49.480 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.170588+0000", 2021-10-08T19:37:49.480 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000133814 2021-10-08T19:37:49.480 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.481 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.481 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:37:49.481 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.172605+0000", 2021-10-08T19:37:49.481 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002016847 2021-10-08T19:37:49.482 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.482 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.482 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:37:49.482 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.176258+0000", 2021-10-08T19:37:49.482 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036532439999999999 2021-10-08T19:37:49.483 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.483 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.483 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:37:49.483 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.351710+0000", 2021-10-08T19:37:49.483 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.175451194 2021-10-08T19:37:49.484 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.484 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.484 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:37:49.484 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.351762+0000", 2021-10-08T19:37:49.484 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2623000000000001e-05 2021-10-08T19:37:49.485 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.485 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.485 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:37:49.485 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.351804+0000", 2021-10-08T19:37:49.486 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1440000000000003e-05 2021-10-08T19:37:49.486 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:37:49.486 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:37:49.486 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:37:49.486 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.487 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.487 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.25465.0:169841 9.d 9:b8132437:::benchmark_data_smithi097_196985_object54150:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e334)", 2021-10-08T19:37:49.487 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:34:02.168177+0000", 2021-10-08T19:37:49.487 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 227.092832961, 2021-10-08T19:37:49.487 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.18269624500000001, 2021-10-08T19:37:49.488 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:37:49.488 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:37:49.488 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:37:49.488 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.25465", 2021-10-08T19:37:49.489 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:37:49.489 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 169841 2021-10-08T19:37:49.489 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.489 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:37:49.489 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.490 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:37:49.490 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.168177+0000", 2021-10-08T19:37:49.490 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:37:49.490 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.490 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.491 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:37:49.491 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.168177+0000", 2021-10-08T19:37:49.491 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:37:49.491 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.492 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.492 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:37:49.492 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.168176+0000", 2021-10-08T19:37:49.492 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:37:49.492 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.493 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.493 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:37:49.493 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.168180+0000", 2021-10-08T19:37:49.493 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4950000000000002e-06 2021-10-08T19:37:49.493 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.494 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.494 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:37:49.494 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.168187+0000", 2021-10-08T19:37:49.494 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1099999999999997e-06 2021-10-08T19:37:49.494 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.495 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.495 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:37:49.495 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.168193+0000", 2021-10-08T19:37:49.496 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2510000000000002e-06 2021-10-08T19:37:49.496 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.496 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.497 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:37:49.497 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.170545+0000", 2021-10-08T19:37:49.497 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0023527130000000002 2021-10-08T19:37:49.498 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.498 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.498 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:37:49.498 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.170621+0000", 2021-10-08T19:37:49.499 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6001999999999995e-05 2021-10-08T19:37:49.499 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.499 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.499 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 1,5", 2021-10-08T19:37:49.500 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.170751+0000", 2021-10-08T19:37:49.500 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012955400000000001 2021-10-08T19:37:49.500 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.500 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.500 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:37:49.501 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.173676+0000", 2021-10-08T19:37:49.501 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0029249079999999999 2021-10-08T19:37:49.501 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.501 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.502 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:37:49.502 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.173715+0000", 2021-10-08T19:37:49.502 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9578e-05 2021-10-08T19:37:49.502 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.502 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.503 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:37:49.503 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.350786+0000", 2021-10-08T19:37:49.503 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.17707047400000001 2021-10-08T19:37:49.503 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.503 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.504 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:37:49.504 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.350836+0000", 2021-10-08T19:37:49.504 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9673999999999999e-05 2021-10-08T19:37:49.504 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.505 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.505 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:37:49.505 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.350873+0000", 2021-10-08T19:37:49.505 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7602999999999999e-05 2021-10-08T19:37:49.505 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:37:49.506 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:37:49.506 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:37:49.506 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.506 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.507 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:209975 9.1 e343/290 9:89bb0ba3:::benchmark_data_smithi097_196985_object94284:head v 343'12999, mlcod=343'12997)", 2021-10-08T19:37:49.507 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:34:38.428534+0000", 2021-10-08T19:37:49.507 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 190.83247601599999, 2021-10-08T19:37:49.507 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.236116147, 2021-10-08T19:37:49.508 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:37:49.508 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:37:49.508 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:37:49.508 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.509 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:37:49.509 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.428534+0000", 2021-10-08T19:37:49.509 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:37:49.509 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.510 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.510 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:37:49.510 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.428534+0000", 2021-10-08T19:37:49.510 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:37:49.511 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.511 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.511 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:37:49.511 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.428533+0000", 2021-10-08T19:37:49.511 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:37:49.512 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.512 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.512 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:37:49.512 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.428540+0000", 2021-10-08T19:37:49.512 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.109e-06 2021-10-08T19:37:49.513 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.513 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.513 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:37:49.513 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.428549+0000", 2021-10-08T19:37:49.514 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3249999999999997e-06 2021-10-08T19:37:49.514 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.514 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.514 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:37:49.515 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.428555+0000", 2021-10-08T19:37:49.515 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8220000000000003e-06 2021-10-08T19:37:49.515 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.515 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.515 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:37:49.516 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.428601+0000", 2021-10-08T19:37:49.516 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5527e-05 2021-10-08T19:37:49.516 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.516 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.516 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:37:49.517 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.428618+0000", 2021-10-08T19:37:49.517 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7547e-05 2021-10-08T19:37:49.517 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.517 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.518 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:37:49.518 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.664627+0000", 2021-10-08T19:37:49.518 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.23600927099999999 2021-10-08T19:37:49.519 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.519 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.519 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:37:49.519 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.664650+0000", 2021-10-08T19:37:49.519 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2654999999999999e-05 2021-10-08T19:37:49.520 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:37:49.520 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:37:49.520 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:37:49.520 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.521 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.521 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:209977 9.a e343/290 9:575a8bb2:::benchmark_data_smithi097_196985_object94286:head v 343'13104, mlcod=343'13101)", 2021-10-08T19:37:49.521 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:34:38.431569+0000", 2021-10-08T19:37:49.521 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 190.82944070100001, 2021-10-08T19:37:49.521 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.234467443, 2021-10-08T19:37:49.522 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:37:49.522 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:37:49.522 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:37:49.522 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.522 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:37:49.523 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.431569+0000", 2021-10-08T19:37:49.523 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:37:49.523 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.523 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.523 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:37:49.524 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.431569+0000", 2021-10-08T19:37:49.524 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:37:49.524 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.524 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.524 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:37:49.525 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.431568+0000", 2021-10-08T19:37:49.525 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:37:49.525 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.525 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.526 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:37:49.526 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.431574+0000", 2021-10-08T19:37:49.526 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0970000000000002e-06 2021-10-08T19:37:49.526 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.526 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.527 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:37:49.527 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.661194+0000", 2021-10-08T19:37:49.527 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.229619776 2021-10-08T19:37:49.528 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.528 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.528 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:37:49.528 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.661212+0000", 2021-10-08T19:37:49.529 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8576e-05 2021-10-08T19:37:49.529 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.529 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.529 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:37:49.530 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.661306+0000", 2021-10-08T19:37:49.530 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3208000000000006e-05 2021-10-08T19:37:49.530 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.530 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.531 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:37:49.531 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.661367+0000", 2021-10-08T19:37:49.531 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1753000000000003e-05 2021-10-08T19:37:49.531 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.531 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.532 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:37:49.532 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.666011+0000", 2021-10-08T19:37:49.532 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046439899999999998 2021-10-08T19:37:49.532 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.533 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.533 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:37:49.533 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.666037+0000", 2021-10-08T19:37:49.533 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5211999999999998e-05 2021-10-08T19:37:49.534 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:37:49.534 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:37:49.534 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:37:49.534 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.534 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.535 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.25465.0:209980 9.e 9:7c138995:::benchmark_data_smithi097_196985_object94289:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e343)", 2021-10-08T19:37:49.535 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:34:38.435304+0000", 2021-10-08T19:37:49.535 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 190.82570583500001, 2021-10-08T19:37:49.535 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.23664207800000001, 2021-10-08T19:37:49.536 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:37:49.536 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:37:49.536 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:37:49.536 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.25465", 2021-10-08T19:37:49.536 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:37:49.537 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 209980 2021-10-08T19:37:49.537 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.537 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:37:49.538 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.538 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:37:49.538 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.435304+0000", 2021-10-08T19:37:49.538 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:37:49.539 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.539 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.539 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:37:49.539 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.435304+0000", 2021-10-08T19:37:49.540 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:37:49.540 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.540 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.540 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:37:49.540 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.435302+0000", 2021-10-08T19:37:49.541 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:37:49.541 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.541 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.541 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:37:49.542 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.435308+0000", 2021-10-08T19:37:49.542 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0190000000000003e-06 2021-10-08T19:37:49.542 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.542 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.542 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:37:49.543 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.661204+0000", 2021-10-08T19:37:49.543 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.225895185 2021-10-08T19:37:49.543 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.543 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.544 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:37:49.544 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.661231+0000", 2021-10-08T19:37:49.544 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7769000000000001e-05 2021-10-08T19:37:49.544 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.544 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.545 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:37:49.545 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.661484+0000", 2021-10-08T19:37:49.545 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000252372 2021-10-08T19:37:49.545 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.546 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.546 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:37:49.546 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.661605+0000", 2021-10-08T19:37:49.546 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012129 2021-10-08T19:37:49.547 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.547 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.547 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:37:49.547 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.661795+0000", 2021-10-08T19:37:49.548 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00018975099999999999 2021-10-08T19:37:49.548 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.548 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.548 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:37:49.549 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.666573+0000", 2021-10-08T19:37:49.549 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0047777619999999996 2021-10-08T19:37:49.549 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.549 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.550 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:37:49.550 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.666621+0000", 2021-10-08T19:37:49.550 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8196999999999999e-05 2021-10-08T19:37:49.550 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.550 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.551 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:37:49.551 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.671845+0000", 2021-10-08T19:37:49.551 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0052243530000000002 2021-10-08T19:37:49.551 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.552 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.552 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:37:49.552 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.671905+0000", 2021-10-08T19:37:49.552 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0053999999999998e-05 2021-10-08T19:37:49.552 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.553 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.553 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:37:49.553 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.671946+0000", 2021-10-08T19:37:49.553 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1006e-05 2021-10-08T19:37:49.553 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:37:49.554 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:37:49.554 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:37:49.554 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.554 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.555 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:209994 9.9 e343/290 9:93bcfe32:::benchmark_data_smithi097_196985_object94303:head v 343'13083, mlcod=343'13081)", 2021-10-08T19:37:49.555 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:34:38.454236+0000", 2021-10-08T19:37:49.555 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 190.806773521, 2021-10-08T19:37:49.555 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.21043297699999999, 2021-10-08T19:37:49.556 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:37:49.556 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:37:49.556 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:37:49.556 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.556 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:37:49.557 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.454236+0000", 2021-10-08T19:37:49.557 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:37:49.557 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.557 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.557 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:37:49.558 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.454236+0000", 2021-10-08T19:37:49.558 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:37:49.558 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.558 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.559 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:37:49.559 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.454233+0000", 2021-10-08T19:37:49.559 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999962 2021-10-08T19:37:49.559 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.559 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.560 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:37:49.560 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.454252+0000", 2021-10-08T19:37:49.560 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9372999999999999e-05 2021-10-08T19:37:49.560 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.560 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.561 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:37:49.561 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.661194+0000", 2021-10-08T19:37:49.561 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.20694248000000001 2021-10-08T19:37:49.561 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.561 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.562 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:37:49.562 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.661217+0000", 2021-10-08T19:37:49.562 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2983e-05 2021-10-08T19:37:49.562 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.563 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.563 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:37:49.563 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.661547+0000", 2021-10-08T19:37:49.563 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00032985499999999999 2021-10-08T19:37:49.563 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.564 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.564 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:37:49.564 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.661567+0000", 2021-10-08T19:37:49.564 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9718999999999999e-05 2021-10-08T19:37:49.564 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.565 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.565 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:37:49.565 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.664652+0000", 2021-10-08T19:37:49.565 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0030853310000000002 2021-10-08T19:37:49.565 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.566 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.566 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:37:49.566 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.664669+0000", 2021-10-08T19:37:49.566 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7008999999999999e-05 2021-10-08T19:37:49.567 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:37:49.567 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:37:49.567 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:37:49.567 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.567 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.568 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15870.0:55048 10.c 10:36071c76:::benchmark_data_smithi097_245820_object55047:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e371)", 2021-10-08T19:37:49.568 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:35:55.919347+0000", 2021-10-08T19:37:49.568 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 113.341663012, 2021-10-08T19:37:49.568 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.201994387, 2021-10-08T19:37:49.568 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:37:49.569 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:37:49.569 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:37:49.569 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15870", 2021-10-08T19:37:49.569 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1128006081", 2021-10-08T19:37:49.569 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 55048 2021-10-08T19:37:49.570 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.570 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:37:49.570 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.570 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:37:49.571 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:35:55.919347+0000", 2021-10-08T19:37:49.571 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:37:49.571 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.571 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.571 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:37:49.572 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:35:55.919347+0000", 2021-10-08T19:37:49.572 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:37:49.572 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.572 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.572 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:37:49.573 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:35:55.919345+0000", 2021-10-08T19:37:49.573 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:37:49.573 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.573 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.573 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:37:49.574 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:35:55.919394+0000", 2021-10-08T19:37:49.574 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9344000000000001e-05 2021-10-08T19:37:49.574 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.574 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.575 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:37:49.575 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:35:55.919413+0000", 2021-10-08T19:37:49.575 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9347e-05 2021-10-08T19:37:49.575 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.575 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.576 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:37:49.576 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:35:55.919422+0000", 2021-10-08T19:37:49.576 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2849999999999995e-06 2021-10-08T19:37:49.576 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.576 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.577 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:37:49.577 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:35:55.919490+0000", 2021-10-08T19:37:49.577 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7917999999999996e-05 2021-10-08T19:37:49.577 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.577 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.578 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:37:49.578 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:35:55.919645+0000", 2021-10-08T19:37:49.578 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015573099999999999 2021-10-08T19:37:49.578 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.579 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.579 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,4", 2021-10-08T19:37:49.579 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:35:55.919785+0000", 2021-10-08T19:37:49.579 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013953500000000001 2021-10-08T19:37:49.579 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.580 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.580 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:37:49.580 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:35:55.921831+0000", 2021-10-08T19:37:49.580 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020465219999999998 2021-10-08T19:37:49.580 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.581 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.581 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:37:49.581 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:35:55.922670+0000", 2021-10-08T19:37:49.581 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00083903799999999996 2021-10-08T19:37:49.581 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.582 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.582 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:37:49.582 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:35:56.121241+0000", 2021-10-08T19:37:49.582 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.19857038900000001 2021-10-08T19:37:49.582 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.583 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.583 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:37:49.583 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:35:56.121302+0000", 2021-10-08T19:37:49.583 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1616000000000001e-05 2021-10-08T19:37:49.584 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:37:49.584 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:37:49.584 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:37:49.584 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:35:56.121341+0000", 2021-10-08T19:37:49.584 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8800999999999997e-05 2021-10-08T19:37:49.585 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:37:49.585 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:37:49.585 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:37:49.585 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:37:49.585 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:37:49.586 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:37:49.587 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:49.587 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:37:49.588 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:37:49.689 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:37:49.735 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:49.824 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:37:49.829 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:49.830 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:37:49.931 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:37:49.964 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:50.073 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:37:50.099 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:37:50.133 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:37:50.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:49 smithi117 ceph-mon[34585]: pgmap v822: 188 pgs: 188 active+clean; 3.9 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 1.63k op/s 2021-10-08T19:37:50.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:49 smithi117 ceph-mon[34585]: 5.16 scrub ok 2021-10-08T19:37:50.167 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:37:50.183 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:37:50.189 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:50.190 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:37:50.201 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:37:50.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:49 smithi097 ceph-mon[32687]: pgmap v822: 188 pgs: 188 active+clean; 3.9 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 1.63k op/s 2021-10-08T19:37:50.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:49 smithi097 ceph-mon[32687]: 5.16 scrub ok 2021-10-08T19:37:50.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:49 smithi097 ceph-mon[41966]: pgmap v822: 188 pgs: 188 active+clean; 3.9 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 1.63k op/s 2021-10-08T19:37:50.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:49 smithi097 ceph-mon[41966]: 5.16 scrub ok 2021-10-08T19:37:50.235 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:37:50.271 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:37:50.292 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:37:50.307 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:37:50.324 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'false' 2021-10-08T19:37:50.324 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'false' 2021-10-08T19:37:50.325 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'false' 2021-10-08T19:37:50.325 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'false' 2021-10-08T19:37:50.325 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'false' 2021-10-08T19:37:50.325 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'false' 2021-10-08T19:37:50.326 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'false' 2021-10-08T19:37:50.326 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'false' 2021-10-08T19:37:50.338 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:50.564 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:37:50.573 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:50.574 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:37:50.583 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2021-10-08T19:37:50.676 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:37:50.719 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:50.783 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:37:50.787 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:50.788 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:37:50.889 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:37:50.931 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:50.988 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:37:50.988 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:50.989 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:37:51.090 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:37:51.123 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:51.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:50 smithi097 ceph-mon[41966]: 6.9 scrub ok 2021-10-08T19:37:51.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:50 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2074991978' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:37:51.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:50 smithi097 ceph-mon[41966]: osdmap e410: 8 total, 8 up, 8 in 2021-10-08T19:37:51.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:50 smithi097 ceph-mon[32687]: 6.9 scrub ok 2021-10-08T19:37:51.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:50 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2074991978' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:37:51.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:50 smithi097 ceph-mon[32687]: osdmap e410: 8 total, 8 up, 8 in 2021-10-08T19:37:51.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:50 smithi117 ceph-mon[34585]: 6.9 scrub ok 2021-10-08T19:37:51.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:50 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2074991978' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:37:51.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:50 smithi117 ceph-mon[34585]: osdmap e410: 8 total, 8 up, 8 in 2021-10-08T19:37:51.422 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:37:51.431 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:51.432 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:37:51.535 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:37:51.546 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:37:51.582 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:51.590 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset nodeep-scrub 2021-10-08T19:37:51.753 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:37:51.757 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:51.758 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:37:51.859 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:37:51.921 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:51.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:51 smithi097 ceph-mon[32687]: pgmap v824: 188 pgs: 188 active+clean; 3.8 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 882 op/s 2021-10-08T19:37:51.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:51 smithi097 ceph-mon[32687]: 3.6 scrub ok 2021-10-08T19:37:52.011 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:37:52.019 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:52.020 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:37:52.122 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:37:52.180 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:52.277 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:37:52.285 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:52.286 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:37:52.287 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:51 smithi097 ceph-mon[41966]: pgmap v824: 188 pgs: 188 active+clean; 3.8 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 882 op/s 2021-10-08T19:37:52.287 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:51 smithi097 ceph-mon[41966]: 3.6 scrub ok 2021-10-08T19:37:52.388 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:37:52.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:51 smithi117 ceph-mon[34585]: pgmap v824: 188 pgs: 188 active+clean; 3.8 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 882 op/s 2021-10-08T19:37:52.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:51 smithi117 ceph-mon[34585]: 3.6 scrub ok 2021-10-08T19:37:52.434 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:52.549 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:37:52.763 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:37:52.768 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:52.769 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:37:52.870 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:37:53.092 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:37:52 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:37:52] "GET /metrics HTTP/1.1" 200 155883 "" "Prometheus/2.18.1" 2021-10-08T19:37:53.092 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.5 to 1 (10000) 2021-10-08T19:37:53.132 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:53.217 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:37:53.218 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:53.219 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:37:53.320 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:37:53.359 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:52 smithi097 ceph-mon[41966]: 2.0 scrub ok 2021-10-08T19:37:53.359 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:52 smithi097 ceph-mon[41966]: 5.e scrub ok 2021-10-08T19:37:53.360 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:52 smithi097 ceph-mon[41966]: 5.9 scrub ok 2021-10-08T19:37:53.360 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:52 smithi097 ceph-mon[41966]: 3.12 scrub ok 2021-10-08T19:37:53.360 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:52 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3128812171' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2021-10-08T19:37:53.360 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:52 smithi097 ceph-mon[41966]: from='client.26008 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2021-10-08T19:37:53.360 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:52 smithi097 ceph-mon[41966]: 2.18 scrub ok 2021-10-08T19:37:53.361 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:52 smithi097 ceph-mon[32687]: 2.0 scrub ok 2021-10-08T19:37:53.361 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:52 smithi097 ceph-mon[32687]: 5.e scrub ok 2021-10-08T19:37:53.361 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:52 smithi097 ceph-mon[32687]: 5.9 scrub ok 2021-10-08T19:37:53.362 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:52 smithi097 ceph-mon[32687]: 3.12 scrub ok 2021-10-08T19:37:53.362 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:52 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3128812171' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2021-10-08T19:37:53.362 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:52 smithi097 ceph-mon[32687]: from='client.26008 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2021-10-08T19:37:53.363 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:52 smithi097 ceph-mon[32687]: 2.18 scrub ok 2021-10-08T19:37:53.363 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:53.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:52 smithi117 ceph-mon[34585]: 2.0 scrub ok 2021-10-08T19:37:53.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:52 smithi117 ceph-mon[34585]: 5.e scrub ok 2021-10-08T19:37:53.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:52 smithi117 ceph-mon[34585]: 5.9 scrub ok 2021-10-08T19:37:53.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:52 smithi117 ceph-mon[34585]: 3.12 scrub ok 2021-10-08T19:37:53.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:52 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3128812171' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2021-10-08T19:37:53.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:52 smithi117 ceph-mon[34585]: from='client.26008 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2021-10-08T19:37:53.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:52 smithi117 ceph-mon[34585]: 2.18 scrub ok 2021-10-08T19:37:53.513 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2021-10-08T19:37:54.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:53 smithi117 ceph-mon[34585]: 2.21 scrub ok 2021-10-08T19:37:54.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:53 smithi117 ceph-mon[34585]: 4.d scrub ok 2021-10-08T19:37:54.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:53 smithi117 ceph-mon[34585]: 6.3 scrub ok 2021-10-08T19:37:54.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:53 smithi117 ceph-mon[34585]: pgmap v825: 188 pgs: 188 active+clean; 3.8 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 723 B/s rd, 0 B/s wr, 748 op/s 2021-10-08T19:37:54.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:53 smithi117 ceph-mon[34585]: from='client.26008 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]': finished 2021-10-08T19:37:54.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:53 smithi117 ceph-mon[34585]: osdmap e411: 8 total, 8 up, 8 in 2021-10-08T19:37:54.160 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:53 smithi117 ceph-mon[34585]: 5.b scrub ok 2021-10-08T19:37:54.160 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:37:53 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:37:53] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:37:54.410 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:37:54.412 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:53 smithi097 ceph-mon[32687]: 2.21 scrub ok 2021-10-08T19:37:54.413 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:53 smithi097 ceph-mon[32687]: 4.d scrub ok 2021-10-08T19:37:54.413 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:53 smithi097 ceph-mon[32687]: 6.3 scrub ok 2021-10-08T19:37:54.413 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:53 smithi097 ceph-mon[32687]: pgmap v825: 188 pgs: 188 active+clean; 3.8 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 723 B/s rd, 0 B/s wr, 748 op/s 2021-10-08T19:37:54.413 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:53 smithi097 ceph-mon[32687]: from='client.26008 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]': finished 2021-10-08T19:37:54.414 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:53 smithi097 ceph-mon[32687]: osdmap e411: 8 total, 8 up, 8 in 2021-10-08T19:37:54.414 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:53 smithi097 ceph-mon[32687]: 5.b scrub ok 2021-10-08T19:37:54.415 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:54.415 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:37:54.417 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:53 smithi097 ceph-mon[41966]: 2.21 scrub ok 2021-10-08T19:37:54.417 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:53 smithi097 ceph-mon[41966]: 4.d scrub ok 2021-10-08T19:37:54.417 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:53 smithi097 ceph-mon[41966]: 6.3 scrub ok 2021-10-08T19:37:54.417 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:53 smithi097 ceph-mon[41966]: pgmap v825: 188 pgs: 188 active+clean; 3.8 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 723 B/s rd, 0 B/s wr, 748 op/s 2021-10-08T19:37:54.418 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:53 smithi097 ceph-mon[41966]: from='client.26008 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]': finished 2021-10-08T19:37:54.418 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:53 smithi097 ceph-mon[41966]: osdmap e411: 8 total, 8 up, 8 in 2021-10-08T19:37:54.418 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:53 smithi097 ceph-mon[41966]: 5.b scrub ok 2021-10-08T19:37:54.517 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:37:54.586 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:54.653 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd reweight 7 1 2021-10-08T19:37:54.779 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:37:54.782 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:54.782 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:37:54.884 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:37:54.968 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:55.056 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2021-10-08T19:37:55.061 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:37:55.066 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:37:55.079 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:37:55.084 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:55.085 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:37:55.186 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:37:55.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:55 smithi097 ceph-mon[32687]: 4.12 scrub ok 2021-10-08T19:37:55.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:55 smithi097 ceph-mon[41966]: 4.12 scrub ok 2021-10-08T19:37:55.230 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:55.389 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:37:55.391 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:55.392 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:37:55.393 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:55 smithi117 ceph-mon[34585]: 4.12 scrub ok 2021-10-08T19:37:55.493 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:37:55.531 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:56.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:56 smithi117 ceph-mon[34585]: 2.e scrub ok 2021-10-08T19:37:56.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:56 smithi117 ceph-mon[34585]: 6.d scrub ok 2021-10-08T19:37:56.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:56 smithi117 ceph-mon[34585]: pgmap v827: 188 pgs: 188 active+clean; 3.5 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1.53k op/s 2021-10-08T19:37:56.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:56 smithi117 ceph-mon[34585]: 6.18 scrub ok 2021-10-08T19:37:56.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:56 smithi117 ceph-mon[34585]: 6.2 scrub ok 2021-10-08T19:37:56.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:56 smithi117 ceph-mon[34585]: 6.1 scrub ok 2021-10-08T19:37:56.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:56 smithi117 ceph-mon[34585]: osdmap e412: 8 total, 8 up, 8 in 2021-10-08T19:37:56.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:56 smithi097 ceph-mon[41966]: 2.e scrub ok 2021-10-08T19:37:56.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:56 smithi097 ceph-mon[41966]: 6.d scrub ok 2021-10-08T19:37:56.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:56 smithi097 ceph-mon[41966]: pgmap v827: 188 pgs: 188 active+clean; 3.5 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1.53k op/s 2021-10-08T19:37:56.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:56 smithi097 ceph-mon[41966]: 6.18 scrub ok 2021-10-08T19:37:56.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:56 smithi097 ceph-mon[41966]: 6.2 scrub ok 2021-10-08T19:37:56.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:56 smithi097 ceph-mon[41966]: 6.1 scrub ok 2021-10-08T19:37:56.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:56 smithi097 ceph-mon[41966]: osdmap e412: 8 total, 8 up, 8 in 2021-10-08T19:37:56.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:56 smithi097 ceph-mon[32687]: 2.e scrub ok 2021-10-08T19:37:56.474 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:56 smithi097 ceph-mon[32687]: 6.d scrub ok 2021-10-08T19:37:56.474 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:56 smithi097 ceph-mon[32687]: pgmap v827: 188 pgs: 188 active+clean; 3.5 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1.53k op/s 2021-10-08T19:37:56.477 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:56 smithi097 ceph-mon[32687]: 6.18 scrub ok 2021-10-08T19:37:56.477 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:56 smithi097 ceph-mon[32687]: 6.2 scrub ok 2021-10-08T19:37:56.477 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:56 smithi097 ceph-mon[32687]: 6.1 scrub ok 2021-10-08T19:37:56.477 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:56 smithi097 ceph-mon[32687]: osdmap e412: 8 total, 8 up, 8 in 2021-10-08T19:37:56.478 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:37:56 smithi097 conmon[33110]: 172.21.15.117 - - [08/Oct/2021:19:37:56] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:37:56.529 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:37:56.533 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:56.534 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:37:56.635 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:37:56.685 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:56.704 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2021-10-08T19:37:56.821 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:37:56.910 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:37:56.926 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:56.927 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:37:57.028 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:37:57.100 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:57.333 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:57 smithi097 ceph-mon[41966]: 4.1c scrub ok 2021-10-08T19:37:57.333 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:57 smithi097 ceph-mon[41966]: 4.0 scrub ok 2021-10-08T19:37:57.334 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:57 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:37:57.334 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:57 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:37:57.334 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:57 smithi097 ceph-mon[41966]: 172.21.15.117 - - [08/Oct/2021:19:37:56] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:37:57.335 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:57 smithi097 ceph-mon[32687]: 4.1c scrub ok 2021-10-08T19:37:57.335 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:57 smithi097 ceph-mon[32687]: 4.0 scrub ok 2021-10-08T19:37:57.335 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:57 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:37:57.335 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:57 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:37:57.335 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:57 smithi097 ceph-mon[32687]: 172.21.15.117 - - [08/Oct/2021:19:37:56] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:37:57.407 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:37:57 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:37:57.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:57 smithi117 ceph-mon[34585]: 4.1c scrub ok 2021-10-08T19:37:57.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:57 smithi117 ceph-mon[34585]: 4.0 scrub ok 2021-10-08T19:37:57.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:57 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:37:57.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:57 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:37:57.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:57 smithi117 ceph-mon[34585]: 172.21.15.117 - - [08/Oct/2021:19:37:56] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:37:57.568 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:57.569 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:37:57.569 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:37:57.671 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:37:57.708 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:57.772 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:37:57.776 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:57.777 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:37:57.878 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:37:57.928 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:57.988 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:37:57.993 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:57.994 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:37:58.096 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:37:58.155 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:58.253 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is unset 2021-10-08T19:37:58.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:58 smithi117 ceph-mon[34585]: pgmap v829: 188 pgs: 188 active+clean; 3.5 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 841 B/s rd, 0 B/s wr, 875 op/s 2021-10-08T19:37:58.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:58 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:37:58.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:58 smithi117 ceph-mon[34585]: 10.7 scrub ok 2021-10-08T19:37:58.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:58 smithi117 ceph-mon[34585]: 3.a scrub ok 2021-10-08T19:37:58.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:58 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3264504278' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:37:58.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:58 smithi117 ceph-mon[34585]: 3.16 scrub ok 2021-10-08T19:37:58.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:58 smithi097 ceph-mon[32687]: pgmap v829: 188 pgs: 188 active+clean; 3.5 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 841 B/s rd, 0 B/s wr, 875 op/s 2021-10-08T19:37:58.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:58 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:37:58.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:58 smithi097 ceph-mon[32687]: 10.7 scrub ok 2021-10-08T19:37:58.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:58 smithi097 ceph-mon[32687]: 3.a scrub ok 2021-10-08T19:37:58.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:58 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3264504278' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:37:58.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:58 smithi097 ceph-mon[32687]: 3.16 scrub ok 2021-10-08T19:37:58.474 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:58 smithi097 ceph-mon[41966]: pgmap v829: 188 pgs: 188 active+clean; 3.5 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 841 B/s rd, 0 B/s wr, 875 op/s 2021-10-08T19:37:58.474 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:58 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:37:58.477 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:58 smithi097 ceph-mon[41966]: 10.7 scrub ok 2021-10-08T19:37:58.477 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:58 smithi097 ceph-mon[41966]: 3.a scrub ok 2021-10-08T19:37:58.477 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:58 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3264504278' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:37:58.477 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:58 smithi097 ceph-mon[41966]: 3.16 scrub ok 2021-10-08T19:37:58.860 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:37:58.867 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:58.868 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:37:58.969 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:37:59.012 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:59.089 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:37:59.097 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:59.098 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:37:59.199 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:37:59.239 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:59.286 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:59 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:37:59.286 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:59 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:37:59.286 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:59 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:37:59.287 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:59 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:37:59.287 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:59 smithi117 ceph-mon[34585]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:37:59.287 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:59 smithi117 ceph-mon[34585]: Cluster is now healthy 2021-10-08T19:37:59.287 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:59 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3264504278' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:37:59.288 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:37:59 smithi117 ceph-mon[34585]: osdmap e413: 8 total, 8 up, 8 in 2021-10-08T19:37:59.618 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:37:59.621 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:59 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:37:59.621 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:59 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:37:59.622 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:59 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:37:59.622 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:59 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:37:59.622 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:59 smithi097 ceph-mon[32687]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:37:59.622 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:59 smithi097 ceph-mon[32687]: Cluster is now healthy 2021-10-08T19:37:59.623 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:59 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3264504278' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:37:59.623 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:37:59 smithi097 ceph-mon[32687]: osdmap e413: 8 total, 8 up, 8 in 2021-10-08T19:37:59.624 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:59.625 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:37:59.625 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:59 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:37:59.625 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:59 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:37:59.625 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:59 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:37:59.626 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:59 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:37:59.626 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:59 smithi097 ceph-mon[41966]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:37:59.626 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:59 smithi097 ceph-mon[41966]: Cluster is now healthy 2021-10-08T19:37:59.626 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:59 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3264504278' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:37:59.627 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:37:59 smithi097 ceph-mon[41966]: osdmap e413: 8 total, 8 up, 8 in 2021-10-08T19:37:59.658 INFO:journalctl@ceph.osd.4.smithi117.stdout:Oct 08 19:37:59 smithi117 conmon[42287]: 2021-10-08T19:37:59.278+0000 7f7e84a03700 -1 osd.4 pg_epoch: 413 pg[4.e( v 289'19 (0'0,289'19] local-lis/les=301/302 n=5 ec=62/62 lis/c=301/301 les/c/f=302/302/0 sis=301) [4,6,1] r=0 lpr=301 crt=289'19 lcod 289'18 mlcod 0'0 active+clean TIME_FOR_DEEP] scrubber pg(4.e) handle_scrub_reserve_grant: received unsolicited reservation grant from osd 1 (0x556c6965a580) 2021-10-08T19:37:59.726 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:37:59.766 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:37:59.870 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:37:59.870 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:37:59.871 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:37:59.972 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:38:00.011 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:00.108 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:38:00.112 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:00.114 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:38:00.215 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:38:00.259 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:00.261 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:00 smithi117 ceph-mon[34585]: pgmap v831: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 3.3 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 851 B/s rd, 0 B/s wr, 1.52k op/s 2021-10-08T19:38:00.261 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:00 smithi117 ceph-mon[34585]: 10.a scrub ok 2021-10-08T19:38:00.328 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:38:00.332 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:00.333 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:38:00.434 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:38:00.479 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:00.584 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:00 smithi097 ceph-mon[41966]: pgmap v831: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 3.3 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 851 B/s rd, 0 B/s wr, 1.52k op/s 2021-10-08T19:38:00.584 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:00 smithi097 ceph-mon[41966]: 10.a scrub ok 2021-10-08T19:38:00.585 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:00 smithi097 ceph-mon[32687]: pgmap v831: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 3.3 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 851 B/s rd, 0 B/s wr, 1.52k op/s 2021-10-08T19:38:00.585 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:00 smithi097 ceph-mon[32687]: 10.a scrub ok 2021-10-08T19:38:00.786 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:38:00.792 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:00.794 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:38:00.890 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:38:00.896 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:38:00.945 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:38:00.991 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:38:01.023 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:38:01.034 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:01.063 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:38:01.092 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:38:01.126 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:38:01.162 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:38:01.196 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:38:01.208 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true' 2021-10-08T19:38:01.208 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true' 2021-10-08T19:38:01.208 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true' 2021-10-08T19:38:01.209 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true' 2021-10-08T19:38:01.209 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true' 2021-10-08T19:38:01.209 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true' 2021-10-08T19:38:01.209 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'true' 2021-10-08T19:38:01.209 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'true' 2021-10-08T19:38:01.345 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:01 smithi097 ceph-mon[41966]: 5.14 deep-scrub ok 2021-10-08T19:38:01.346 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:01 smithi097 ceph-mon[41966]: 3.1 scrub ok 2021-10-08T19:38:01.346 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:01 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:38:01.346 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:01 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:38:01.346 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:01 smithi097 ceph-mon[41966]: 1.8 scrub ok 2021-10-08T19:38:01.347 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:01 smithi097 ceph-mon[41966]: osdmap e414: 8 total, 8 up, 8 in 2021-10-08T19:38:01.347 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:01 smithi097 ceph-mon[41966]: 2.25 scrub ok 2021-10-08T19:38:01.347 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:01 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2236701668' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:38:01.347 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:01 smithi097 ceph-mon[41966]: 1.a scrub ok 2021-10-08T19:38:01.348 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:01 smithi097 ceph-mon[32687]: 5.14 deep-scrub ok 2021-10-08T19:38:01.348 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:01 smithi097 ceph-mon[32687]: 3.1 scrub ok 2021-10-08T19:38:01.348 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:01 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:38:01.349 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:01 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:38:01.349 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:01 smithi097 ceph-mon[32687]: 1.8 scrub ok 2021-10-08T19:38:01.349 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:01 smithi097 ceph-mon[32687]: osdmap e414: 8 total, 8 up, 8 in 2021-10-08T19:38:01.349 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:01 smithi097 ceph-mon[32687]: 2.25 scrub ok 2021-10-08T19:38:01.350 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:01 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2236701668' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:38:01.351 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:01 smithi097 ceph-mon[32687]: 1.a scrub ok 2021-10-08T19:38:01.447 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:38:01.458 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:01.459 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:38:01.560 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:38:01.590 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:01 smithi117 ceph-mon[34585]: 5.14 deep-scrub ok 2021-10-08T19:38:01.590 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:01 smithi117 ceph-mon[34585]: 3.1 scrub ok 2021-10-08T19:38:01.590 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:01 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:38:01.590 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:01 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:38:01.591 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:01 smithi117 ceph-mon[34585]: 1.8 scrub ok 2021-10-08T19:38:01.591 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:01 smithi117 ceph-mon[34585]: osdmap e414: 8 total, 8 up, 8 in 2021-10-08T19:38:01.591 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:01 smithi117 ceph-mon[34585]: 2.25 scrub ok 2021-10-08T19:38:01.591 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:01 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2236701668' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:38:01.592 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:01 smithi117 ceph-mon[34585]: 1.a scrub ok 2021-10-08T19:38:01.596 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:01.669 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:38:01.674 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:01.677 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:38:01.778 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:38:01.824 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:01.909 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:38:01.913 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:01.914 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:38:02.015 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:38:02.074 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:02.272 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:02 smithi117 ceph-mon[34585]: 6.6 scrub ok 2021-10-08T19:38:02.273 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:02 smithi117 ceph-mon[34585]: pgmap v833: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 3.2 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 851 B/s rd, 0 B/s wr, 857 op/s 2021-10-08T19:38:02.273 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:02 smithi117 ceph-mon[34585]: 10.2 scrub ok 2021-10-08T19:38:02.273 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:02 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/138946482' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2021-10-08T19:38:02.273 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:02 smithi117 ceph-mon[34585]: from='client.36056 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2021-10-08T19:38:02.299 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.7 to 1 (10000) 2021-10-08T19:38:02.323 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:02 smithi097 ceph-mon[41966]: 6.6 scrub ok 2021-10-08T19:38:02.324 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:02 smithi097 ceph-mon[41966]: pgmap v833: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 3.2 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 851 B/s rd, 0 B/s wr, 857 op/s 2021-10-08T19:38:02.324 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:02 smithi097 ceph-mon[41966]: 10.2 scrub ok 2021-10-08T19:38:02.324 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:02 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/138946482' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2021-10-08T19:38:02.325 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:02 smithi097 ceph-mon[41966]: from='client.36056 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2021-10-08T19:38:02.325 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:02 smithi097 ceph-mon[32687]: 6.6 scrub ok 2021-10-08T19:38:02.325 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:02 smithi097 ceph-mon[32687]: pgmap v833: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 3.2 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 851 B/s rd, 0 B/s wr, 857 op/s 2021-10-08T19:38:02.326 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:02 smithi097 ceph-mon[32687]: 10.2 scrub ok 2021-10-08T19:38:02.326 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:02 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/138946482' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2021-10-08T19:38:02.326 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:02 smithi097 ceph-mon[32687]: from='client.36056 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2021-10-08T19:38:02.330 INFO:journalctl@ceph.osd.2.smithi097.stdout:Oct 08 19:38:02 smithi097 conmon[55904]: 2021-10-08T19:38:02.198+0000 7f599b64d700 -1 osd.2 pg_epoch: 414 pg[2.c( empty local-lis/les=60/61 n=0 ec=60/60 lis/c=60/60 les/c/f=61/61/0 sis=60) [2,5,0] r=0 lpr=60 crt=0'0 mlcod 0'0 active+clean] scrubber pg(2.c) handle_scrub_reserve_grant: received unsolicited reservation grant from osd 5 (0x56222b850580) 2021-10-08T19:38:02.564 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:38:02.567 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:02.568 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:38:02.655 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:38:02 smithi117 conmon[69189]: level=error ts=2021-10-08T19:38:02.315Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=1 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:38:02.668 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:38:02.712 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:02.829 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set noscrub 2021-10-08T19:38:02.970 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:38:02 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:38:02] "GET /metrics HTTP/1.1" 200 155892 "" "Prometheus/2.18.1" 2021-10-08T19:38:03.529 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:38:03.535 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:03.536 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:38:03.542 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:03 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:38:03.544 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:03 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:38:03.544 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:03 smithi097 ceph-mon[41966]: from='client.36056 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]': finished 2021-10-08T19:38:03.544 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:03 smithi097 ceph-mon[41966]: osdmap e415: 8 total, 8 up, 8 in 2021-10-08T19:38:03.545 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:03 smithi097 ceph-mon[41966]: 3.c scrub ok 2021-10-08T19:38:03.545 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:03 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:38:03.545 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:03 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:38:03.546 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:03 smithi097 ceph-mon[32687]: from='client.36056 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]': finished 2021-10-08T19:38:03.546 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:03 smithi097 ceph-mon[32687]: osdmap e415: 8 total, 8 up, 8 in 2021-10-08T19:38:03.546 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:03 smithi097 ceph-mon[32687]: 3.c scrub ok 2021-10-08T19:38:03.640 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:38:03.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:03 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:38:03.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:03 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:38:03.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:03 smithi117 ceph-mon[34585]: from='client.36056 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]': finished 2021-10-08T19:38:03.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:03 smithi117 ceph-mon[34585]: osdmap e415: 8 total, 8 up, 8 in 2021-10-08T19:38:03.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:03 smithi117 ceph-mon[34585]: 3.c scrub ok 2021-10-08T19:38:04.151 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:04.158 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:38:03 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:38:03] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:38:04.369 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd reweight 6 1 2021-10-08T19:38:04.370 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:38:04.378 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:04.379 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:38:04.399 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:04 smithi097 ceph-mon[41966]: pgmap v835: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 3.2 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 858 op/s 2021-10-08T19:38:04.399 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:04 smithi097 ceph-mon[41966]: 10.c scrub ok 2021-10-08T19:38:04.400 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:04 smithi097 ceph-mon[41966]: 1.7 scrub ok 2021-10-08T19:38:04.400 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:04 smithi097 ceph-mon[41966]: 3.9 scrub ok 2021-10-08T19:38:04.400 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:04 smithi097 ceph-mon[41966]: 6.1d scrub ok 2021-10-08T19:38:04.401 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:04 smithi097 ceph-mon[32687]: pgmap v835: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 3.2 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 858 op/s 2021-10-08T19:38:04.401 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:04 smithi097 ceph-mon[32687]: 10.c scrub ok 2021-10-08T19:38:04.401 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:04 smithi097 ceph-mon[32687]: 1.7 scrub ok 2021-10-08T19:38:04.401 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:04 smithi097 ceph-mon[32687]: 3.9 scrub ok 2021-10-08T19:38:04.401 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:04 smithi097 ceph-mon[32687]: 6.1d scrub ok 2021-10-08T19:38:04.455 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:38:04.480 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:38:04.516 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:04.598 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:38:04.602 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:04.603 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:38:04.604 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:04 smithi117 ceph-mon[34585]: pgmap v835: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 3.2 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 858 op/s 2021-10-08T19:38:04.604 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:04 smithi117 ceph-mon[34585]: 10.c scrub ok 2021-10-08T19:38:04.604 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:04 smithi117 ceph-mon[34585]: 1.7 scrub ok 2021-10-08T19:38:04.604 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:04 smithi117 ceph-mon[34585]: 3.9 scrub ok 2021-10-08T19:38:04.605 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:04 smithi117 ceph-mon[34585]: 6.1d scrub ok 2021-10-08T19:38:04.704 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:38:04.740 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:04.821 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:38:04.831 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:04.833 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:38:04.935 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:38:04.986 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:05.071 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:38:05.078 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:05.080 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:38:05.183 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:38:05.226 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:05.297 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:05 smithi117 ceph-mon[34585]: 4.19 scrub ok 2021-10-08T19:38:05.299 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:38:05.302 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:05.303 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:38:05.404 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:38:05.450 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:05.526 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2021-10-08T19:38:05.527 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:05.528 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:38:05.528 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:38:05.570 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:05 smithi097 ceph-mon[32687]: 4.19 scrub ok 2021-10-08T19:38:05.571 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:05 smithi097 ceph-mon[41966]: 4.19 scrub ok 2021-10-08T19:38:05.631 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:38:05.683 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:05.732 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:38:05.739 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:05.743 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:38:05.844 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:38:05.877 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:05.931 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:38:05.934 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:05.935 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:38:06.036 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:38:06.075 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:06.154 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:38:06.157 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:06.157 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:38:06.161 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:38:06.259 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:38:06.307 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:06.370 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:38:06.377 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:06.377 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:38:06.428 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:38:06.429 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2021-10-08T19:38:06.429 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2021-10-08T19:38:06.429 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2021-10-08T19:38:06.429 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:38:06.455 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:06 smithi097 ceph-mon[41966]: pgmap v836: 188 pgs: 188 active+clean; 2.8 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 0 B/s wr, 1.59k op/s 2021-10-08T19:38:06.455 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:06 smithi097 ceph-mon[41966]: 10.8 scrub ok 2021-10-08T19:38:06.456 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:06 smithi097 ceph-mon[41966]: 10.0 scrub ok 2021-10-08T19:38:06.456 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:06 smithi097 ceph-mon[41966]: 4.7 scrub ok 2021-10-08T19:38:06.456 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:06 smithi097 ceph-mon[41966]: osdmap e416: 8 total, 8 up, 8 in 2021-10-08T19:38:06.456 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:06 smithi097 ceph-mon[41966]: 6.14 scrub ok 2021-10-08T19:38:06.457 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:06 smithi097 ceph-mon[32687]: pgmap v836: 188 pgs: 188 active+clean; 2.8 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 0 B/s wr, 1.59k op/s 2021-10-08T19:38:06.457 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:06 smithi097 ceph-mon[32687]: 10.8 scrub ok 2021-10-08T19:38:06.457 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:06 smithi097 ceph-mon[32687]: 10.0 scrub ok 2021-10-08T19:38:06.458 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:06 smithi097 ceph-mon[32687]: 4.7 scrub ok 2021-10-08T19:38:06.458 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:06 smithi097 ceph-mon[32687]: osdmap e416: 8 total, 8 up, 8 in 2021-10-08T19:38:06.458 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:06 smithi097 ceph-mon[32687]: 6.14 scrub ok 2021-10-08T19:38:06.479 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:38:06.522 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:06.607 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:38:06.610 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:06.610 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:38:06.611 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:06 smithi117 ceph-mon[34585]: pgmap v836: 188 pgs: 188 active+clean; 2.8 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 0 B/s wr, 1.59k op/s 2021-10-08T19:38:06.611 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:06 smithi117 ceph-mon[34585]: 10.8 scrub ok 2021-10-08T19:38:06.611 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:06 smithi117 ceph-mon[34585]: 10.0 scrub ok 2021-10-08T19:38:06.612 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:06 smithi117 ceph-mon[34585]: 4.7 scrub ok 2021-10-08T19:38:06.612 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:06 smithi117 ceph-mon[34585]: osdmap e416: 8 total, 8 up, 8 in 2021-10-08T19:38:06.612 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:06 smithi117 ceph-mon[34585]: 6.14 scrub ok 2021-10-08T19:38:06.712 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:38:06.837 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:07.405 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:38:07 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:38:07.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:07 smithi117 ceph-mon[34585]: 4.11 scrub ok 2021-10-08T19:38:07.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:07 smithi117 ceph-mon[34585]: 6.17 scrub ok 2021-10-08T19:38:07.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:07 smithi117 ceph-mon[34585]: 2.a scrub ok 2021-10-08T19:38:07.657 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:38:07.662 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:07.662 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:07 smithi097 ceph-mon[32687]: 4.11 scrub ok 2021-10-08T19:38:07.663 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:07 smithi097 ceph-mon[32687]: 6.17 scrub ok 2021-10-08T19:38:07.663 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:07 smithi097 ceph-mon[32687]: 2.a scrub ok 2021-10-08T19:38:07.663 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:07 smithi097 ceph-mon[41966]: 4.11 scrub ok 2021-10-08T19:38:07.664 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:07 smithi097 ceph-mon[41966]: 6.17 scrub ok 2021-10-08T19:38:07.664 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:07 smithi097 ceph-mon[41966]: 2.a scrub ok 2021-10-08T19:38:07.664 INFO:journalctl@ceph.osd.3.smithi097.stdout:Oct 08 19:38:07 smithi097 conmon[59546]: 2021-10-08T19:38:07.325+0000 7fac99817700 -1 osd.3 pg_epoch: 416 pg[5.0( v 238'13 (0'0,238'13] local-lis/les=236/237 n=1 ec=64/64 lis/c=236/236 les/c/f=237/237/0 sis=236) [3,1,4] r=0 lpr=236 crt=230'12 lcod 230'12 mlcod 230'12 active+clean] scrubber pg(5.0) handle_scrub_reserve_grant: received unsolicited reservation grant from osd 1 (0x563cb5b2cb00) 2021-10-08T19:38:07.665 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:38:07.766 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:38:07.805 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:07.876 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:38:07.880 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:07.881 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:38:07.982 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:38:08.017 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:08.099 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:38:08.105 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:08.106 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:38:08.207 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:38:08.245 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:08.288 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:38:08.312 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:38:08.318 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:08.319 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:38:08.383 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2021-10-08T19:38:08.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:08 smithi117 ceph-mon[34585]: 5.13 deep-scrub ok 2021-10-08T19:38:08.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:08 smithi117 ceph-mon[34585]: 3.13 scrub ok 2021-10-08T19:38:08.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:08 smithi117 ceph-mon[34585]: pgmap v838: 188 pgs: 188 active+clean; 2.8 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 0 B/s wr, 813 op/s 2021-10-08T19:38:08.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:08 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:38:08.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:08 smithi117 ceph-mon[34585]: 4.f scrub ok 2021-10-08T19:38:08.421 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:38:08.455 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:08.512 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:38:08.513 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:08.514 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:38:08.591 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:08 smithi097 ceph-mon[32687]: 5.13 deep-scrub ok 2021-10-08T19:38:08.591 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:08 smithi097 ceph-mon[32687]: 3.13 scrub ok 2021-10-08T19:38:08.592 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:08 smithi097 ceph-mon[32687]: pgmap v838: 188 pgs: 188 active+clean; 2.8 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 0 B/s wr, 813 op/s 2021-10-08T19:38:08.592 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:08 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:38:08.592 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:08 smithi097 ceph-mon[32687]: 4.f scrub ok 2021-10-08T19:38:08.594 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:08 smithi097 ceph-mon[41966]: 5.13 deep-scrub ok 2021-10-08T19:38:08.595 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:08 smithi097 ceph-mon[41966]: 3.13 scrub ok 2021-10-08T19:38:08.595 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:08 smithi097 ceph-mon[41966]: pgmap v838: 188 pgs: 188 active+clean; 2.8 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 0 B/s wr, 813 op/s 2021-10-08T19:38:08.595 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:08 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:38:08.596 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:08 smithi097 ceph-mon[41966]: 4.f scrub ok 2021-10-08T19:38:08.616 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:38:08.692 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:08.882 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:38:08.888 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:08.889 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:38:08.992 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:38:09.017 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:09.074 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:38:09.076 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:09.077 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:38:09.179 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:38:09.251 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:09.348 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:09 smithi117 ceph-mon[34585]: 10.6 scrub ok 2021-10-08T19:38:09.349 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:09 smithi117 ceph-mon[34585]: 3.15 deep-scrub ok 2021-10-08T19:38:09.349 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:09 smithi117 ceph-mon[34585]: 2.3 scrub ok 2021-10-08T19:38:09.583 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:09 smithi097 ceph-mon[41966]: 10.6 scrub ok 2021-10-08T19:38:09.584 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:09 smithi097 ceph-mon[41966]: 3.15 deep-scrub ok 2021-10-08T19:38:09.584 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:09 smithi097 ceph-mon[41966]: 2.3 scrub ok 2021-10-08T19:38:09.584 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:09 smithi097 ceph-mon[32687]: 10.6 scrub ok 2021-10-08T19:38:09.585 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:09 smithi097 ceph-mon[32687]: 3.15 deep-scrub ok 2021-10-08T19:38:09.585 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:09 smithi097 ceph-mon[32687]: 2.3 scrub ok 2021-10-08T19:38:10.202 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:38:10.209 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:10.210 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:38:10.311 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:38:10.359 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:10.384 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is set 2021-10-08T19:38:10.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:10 smithi097 ceph-mon[41966]: 6.1b scrub ok 2021-10-08T19:38:10.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:10 smithi097 ceph-mon[41966]: pgmap v839: 188 pgs: 188 active+clean; 2.6 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 0 B/s wr, 1.18k op/s 2021-10-08T19:38:10.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:10 smithi097 ceph-mon[41966]: 4.1a scrub ok 2021-10-08T19:38:10.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:10 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3014430055' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:38:10.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:10 smithi097 ceph-mon[41966]: 2.15 deep-scrub ok 2021-10-08T19:38:10.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:10 smithi097 ceph-mon[32687]: 6.1b scrub ok 2021-10-08T19:38:10.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:10 smithi097 ceph-mon[32687]: pgmap v839: 188 pgs: 188 active+clean; 2.6 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 0 B/s wr, 1.18k op/s 2021-10-08T19:38:10.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:10 smithi097 ceph-mon[32687]: 4.1a scrub ok 2021-10-08T19:38:10.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:10 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3014430055' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:38:10.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:10 smithi097 ceph-mon[32687]: 2.15 deep-scrub ok 2021-10-08T19:38:10.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:10 smithi117 ceph-mon[34585]: 6.1b scrub ok 2021-10-08T19:38:10.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:10 smithi117 ceph-mon[34585]: pgmap v839: 188 pgs: 188 active+clean; 2.6 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 0 B/s wr, 1.18k op/s 2021-10-08T19:38:10.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:10 smithi117 ceph-mon[34585]: 4.1a scrub ok 2021-10-08T19:38:10.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:10 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3014430055' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:38:10.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:10 smithi117 ceph-mon[34585]: 2.15 deep-scrub ok 2021-10-08T19:38:10.811 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:38:11.082 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:38:11.088 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:11.089 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:38:11.190 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:38:11.227 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:11.302 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:38:11.310 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:11.311 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:38:11.351 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:11 smithi097 ceph-mon[32687]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:38:11.352 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:11 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3014430055' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:38:11.352 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:11 smithi097 ceph-mon[32687]: osdmap e417: 8 total, 8 up, 8 in 2021-10-08T19:38:11.352 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:11 smithi097 ceph-mon[32687]: osdmap e418: 8 total, 8 up, 8 in 2021-10-08T19:38:11.412 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:38:11.452 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:11.542 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:38:11.546 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:11 smithi117 ceph-mon[34585]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:38:11.547 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:11 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3014430055' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:38:11.547 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:11 smithi117 ceph-mon[34585]: osdmap e417: 8 total, 8 up, 8 in 2021-10-08T19:38:11.547 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:11 smithi117 ceph-mon[34585]: osdmap e418: 8 total, 8 up, 8 in 2021-10-08T19:38:11.548 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:11.549 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:38:11.650 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:38:11.696 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:11.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:11 smithi097 ceph-mon[41966]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:38:11.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:11 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3014430055' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:38:11.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:11 smithi097 ceph-mon[41966]: osdmap e417: 8 total, 8 up, 8 in 2021-10-08T19:38:11.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:11 smithi097 ceph-mon[41966]: osdmap e418: 8 total, 8 up, 8 in 2021-10-08T19:38:11.791 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:38:11.795 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:11.796 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:38:11.897 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:38:11.937 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:12.000 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:38:12.004 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:12.005 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:38:12.107 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:38:12.173 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:12.304 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:38:12.316 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:12.317 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:38:12.419 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:38:12.492 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:12.651 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:12 smithi097 ceph-mon[41966]: pgmap v842: 188 pgs: 188 active+clean; 2.5 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 903 op/s 2021-10-08T19:38:12.652 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:12 smithi097 ceph-mon[32687]: pgmap v842: 188 pgs: 188 active+clean; 2.5 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 903 op/s 2021-10-08T19:38:12.656 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:38:12 smithi117 conmon[69189]: level=error ts=2021-10-08T19:38:12.314Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=1 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:38:12.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:12 smithi117 ceph-mon[34585]: pgmap v842: 188 pgs: 188 active+clean; 2.5 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 903 op/s 2021-10-08T19:38:12.847 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:38:12.850 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:12.851 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:38:12.953 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:38:12.970 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:38:12 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:38:12] "GET /metrics HTTP/1.1" 200 155889 "" "Prometheus/2.18.1" 2021-10-08T19:38:12.996 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:13.075 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:38:13.079 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:13.080 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:38:13.182 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:38:13.385 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.6 to 1 (10000) 2021-10-08T19:38:13.395 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:13.405 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:38:13.406 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:38:13.428 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:38:13.461 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:38:13.491 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:38:13.526 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:38:13.557 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:38:13.591 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:38:13.601 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'false' 2021-10-08T19:38:13.601 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'false' 2021-10-08T19:38:13.601 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'false' 2021-10-08T19:38:13.602 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'false' 2021-10-08T19:38:13.602 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'false' 2021-10-08T19:38:13.602 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'false' 2021-10-08T19:38:13.602 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'false' 2021-10-08T19:38:13.603 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'false' 2021-10-08T19:38:13.631 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:13 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/265770242' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2021-10-08T19:38:13.631 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:13 smithi097 ceph-mon[32687]: from='client.36062 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2021-10-08T19:38:13.632 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:13 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/951026381' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:38:13.632 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:13 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/265770242' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2021-10-08T19:38:13.633 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:13 smithi097 ceph-mon[41966]: from='client.36062 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2021-10-08T19:38:13.633 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:13 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/951026381' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:38:13.655 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:38:13 smithi117 conmon[69189]: level=error ts=2021-10-08T19:38:13.505Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=2 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:38:13.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:13 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/265770242' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2021-10-08T19:38:13.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:13 smithi117 ceph-mon[34585]: from='client.36062 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2021-10-08T19:38:13.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:13 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/951026381' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:38:13.688 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:38:13.696 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:13.698 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:38:13.800 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:38:13.847 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:13.934 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:38:13.938 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:13.939 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:38:14.043 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:38:14.083 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:14.158 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:38:13 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:38:13] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:38:14.167 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set nodeep-scrub 2021-10-08T19:38:14.174 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:38:14.178 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:14.179 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:38:14.280 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:38:14.315 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:14.379 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:38:14.381 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:14.382 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:38:14.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:14 smithi097 ceph-mon[32687]: pgmap v843: 188 pgs: 188 active+clean; 2.5 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 722 B/s rd, 0 B/s wr, 765 op/s 2021-10-08T19:38:14.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:14 smithi097 ceph-mon[32687]: from='client.36062 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]': finished 2021-10-08T19:38:14.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:14 smithi097 ceph-mon[32687]: osdmap e419: 8 total, 8 up, 8 in 2021-10-08T19:38:14.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:14 smithi097 ceph-mon[41966]: pgmap v843: 188 pgs: 188 active+clean; 2.5 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 722 B/s rd, 0 B/s wr, 765 op/s 2021-10-08T19:38:14.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:14 smithi097 ceph-mon[41966]: from='client.36062 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]': finished 2021-10-08T19:38:14.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:14 smithi097 ceph-mon[41966]: osdmap e419: 8 total, 8 up, 8 in 2021-10-08T19:38:14.483 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:38:14.523 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:14.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:14 smithi117 ceph-mon[34585]: pgmap v843: 188 pgs: 188 active+clean; 2.5 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 722 B/s rd, 0 B/s wr, 765 op/s 2021-10-08T19:38:14.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:14 smithi117 ceph-mon[34585]: from='client.36062 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]': finished 2021-10-08T19:38:14.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:14 smithi117 ceph-mon[34585]: osdmap e419: 8 total, 8 up, 8 in 2021-10-08T19:38:15.264 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:38:15.269 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:15.269 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:38:15.292 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd reweight 1 1 2021-10-08T19:38:15.370 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:38:15.403 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:15.455 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:38:15.458 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:15.459 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:38:15.561 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:38:15.668 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:15.779 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:38:15.803 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:38:15.816 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:15.817 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:38:15.856 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2021-10-08T19:38:15.856 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:38:15.919 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:38:15.958 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:38:15.973 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:16.305 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:38:16.311 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:16.312 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:38:16.413 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:38:16.460 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:16.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:16 smithi117 ceph-mon[34585]: pgmap v845: 188 pgs: 188 active+clean; 2.2 GiB data, 9.0 GiB used, 706 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 1.12k op/s 2021-10-08T19:38:16.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:16 smithi117 ceph-mon[34585]: osdmap e420: 8 total, 8 up, 8 in 2021-10-08T19:38:16.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:16 smithi097 ceph-mon[41966]: pgmap v845: 188 pgs: 188 active+clean; 2.2 GiB data, 9.0 GiB used, 706 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 1.12k op/s 2021-10-08T19:38:16.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:16 smithi097 ceph-mon[41966]: osdmap e420: 8 total, 8 up, 8 in 2021-10-08T19:38:16.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:16 smithi097 ceph-mon[32687]: pgmap v845: 188 pgs: 188 active+clean; 2.2 GiB data, 9.0 GiB used, 706 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 1.12k op/s 2021-10-08T19:38:16.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:16 smithi097 ceph-mon[32687]: osdmap e420: 8 total, 8 up, 8 in 2021-10-08T19:38:16.934 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:38:16.937 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:16.938 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:38:17.039 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:38:17.087 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2021-10-08T19:38:17.088 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:17.155 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:38:17 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:38:17.208 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2021-10-08T19:38:17.286 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:38:17.307 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:17.309 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:38:17.410 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:38:17.521 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:17.763 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:38:17.768 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:17.768 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:38:17.869 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:38:17.919 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:18.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:18 smithi097 ceph-mon[32687]: pgmap v847: 188 pgs: 188 active+clean; 2.2 GiB data, 9.0 GiB used, 706 GiB / 715 GiB avail; 841 B/s rd, 0 B/s wr, 876 op/s 2021-10-08T19:38:18.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:18 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:38:18.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:18 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:38:18.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:18 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:38:18.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:18 smithi097 ceph-mon[41966]: pgmap v847: 188 pgs: 188 active+clean; 2.2 GiB data, 9.0 GiB used, 706 GiB / 715 GiB avail; 841 B/s rd, 0 B/s wr, 876 op/s 2021-10-08T19:38:18.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:18 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:38:18.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:18 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:38:18.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:18 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:38:18.818 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:38:18.819 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:38:18.824 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:18.825 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:38:18.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:18 smithi117 ceph-mon[34585]: pgmap v847: 188 pgs: 188 active+clean; 2.2 GiB data, 9.0 GiB used, 706 GiB / 715 GiB avail; 841 B/s rd, 0 B/s wr, 876 op/s 2021-10-08T19:38:18.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:18 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:38:18.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:18 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:38:18.908 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:18 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:38:18.927 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:38:18.964 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:19.048 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:38:19.050 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:19.051 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:38:19.152 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:38:19.200 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:19.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:19 smithi097 ceph-mon[41966]: osdmap e421: 8 total, 8 up, 8 in 2021-10-08T19:38:19.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:19 smithi097 ceph-mon[41966]: pgmap v849: 188 pgs: 188 active+clean; 1.9 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 1.56k op/s 2021-10-08T19:38:19.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:19 smithi097 ceph-mon[32687]: osdmap e421: 8 total, 8 up, 8 in 2021-10-08T19:38:19.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:19 smithi097 ceph-mon[32687]: pgmap v849: 188 pgs: 188 active+clean; 1.9 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 1.56k op/s 2021-10-08T19:38:19.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:19 smithi117 ceph-mon[34585]: osdmap e421: 8 total, 8 up, 8 in 2021-10-08T19:38:19.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:19 smithi117 ceph-mon[34585]: pgmap v849: 188 pgs: 188 active+clean; 1.9 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 1.56k op/s 2021-10-08T19:38:19.703 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:38:19.713 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:19.714 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:38:19.752 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:38:19.815 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:38:19.861 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:20.108 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:38:20.120 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:20.122 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:38:20.223 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:38:20.295 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:20.434 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:20 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3531356176' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:38:20.453 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is set 2021-10-08T19:38:20.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:20 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3531356176' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:38:20.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:20 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3531356176' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:38:21.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:21 smithi097 ceph-mon[41966]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:38:21.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:21 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3531356176' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:38:21.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:21 smithi097 ceph-mon[41966]: osdmap e422: 8 total, 8 up, 8 in 2021-10-08T19:38:21.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:21 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2263030748' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2021-10-08T19:38:21.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:21 smithi097 ceph-mon[41966]: pgmap v851: 188 pgs: 188 active+clean; 1.9 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 888 op/s 2021-10-08T19:38:21.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:21 smithi097 ceph-mon[32687]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:38:21.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:21 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3531356176' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:38:21.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:21 smithi097 ceph-mon[32687]: osdmap e422: 8 total, 8 up, 8 in 2021-10-08T19:38:21.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:21 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2263030748' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2021-10-08T19:38:21.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:21 smithi097 ceph-mon[32687]: pgmap v851: 188 pgs: 188 active+clean; 1.9 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 888 op/s 2021-10-08T19:38:21.797 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:38:21.804 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:21.805 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:38:21.847 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.1 to 1 (10000) 2021-10-08T19:38:21.905 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:38:21.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:21 smithi117 ceph-mon[34585]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:38:21.908 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:21 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3531356176' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:38:21.908 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:21 smithi117 ceph-mon[34585]: osdmap e422: 8 total, 8 up, 8 in 2021-10-08T19:38:21.908 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:21 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2263030748' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2021-10-08T19:38:21.908 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:21 smithi117 ceph-mon[34585]: pgmap v851: 188 pgs: 188 active+clean; 1.9 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 888 op/s 2021-10-08T19:38:21.954 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:22.043 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:38:22.046 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:22.047 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:38:22.148 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:38:22.200 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:22.289 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:38:22.293 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:22.294 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:38:22.395 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:38:22.434 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:22.526 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:38:22.535 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:22.536 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:38:22.637 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:38:22.655 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:38:22 smithi117 conmon[69189]: level=error ts=2021-10-08T19:38:22.314Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=1 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:38:22.687 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:22.824 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:38:22.829 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:22.830 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:38:22.831 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:38:22 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:38:22] "GET /metrics HTTP/1.1" 200 155889 "" "Prometheus/2.18.1" 2021-10-08T19:38:22.831 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:22 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:38:22.832 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:22 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:38:22.832 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:22 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2263030748' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2021-10-08T19:38:22.832 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:22 smithi097 ceph-mon[32687]: osdmap e423: 8 total, 8 up, 8 in 2021-10-08T19:38:22.931 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:38:22.983 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:23.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:22 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:38:23.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:22 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:38:23.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:22 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2263030748' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2021-10-08T19:38:23.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:22 smithi117 ceph-mon[34585]: osdmap e423: 8 total, 8 up, 8 in 2021-10-08T19:38:23.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:22 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:38:23.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:22 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:38:23.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:22 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2263030748' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2021-10-08T19:38:23.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:22 smithi097 ceph-mon[41966]: osdmap e423: 8 total, 8 up, 8 in 2021-10-08T19:38:23.491 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:38:23.497 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:23.498 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:38:23.599 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:38:23.621 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:38:23 smithi097 conmon[33110]: 172.21.15.97 - - [08/Oct/2021:19:38:23] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:38:23.623 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:24.107 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:38:24.109 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:24.110 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:38:24.157 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:38:23 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:38:23] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:38:24.212 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:38:24.239 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd reweight 3 1 2021-10-08T19:38:24.282 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:24.367 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:24 smithi097 ceph-mon[41966]: pgmap v853: 188 pgs: 188 active+clean; 1.9 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 889 op/s 2021-10-08T19:38:24.368 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:24 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:38:24.368 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:24 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:38:24.369 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:24 smithi097 ceph-mon[41966]: 172.21.15.97 - - [08/Oct/2021:19:38:23] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:38:24.369 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:24 smithi097 ceph-mon[32687]: pgmap v853: 188 pgs: 188 active+clean; 1.9 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 889 op/s 2021-10-08T19:38:24.369 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:24 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:38:24.370 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:24 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:38:24.370 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:24 smithi097 ceph-mon[32687]: 172.21.15.97 - - [08/Oct/2021:19:38:23] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:38:24.503 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:38:24.512 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:24.519 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:38:24.555 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset noscrub 2021-10-08T19:38:24.621 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:38:24.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:24 smithi117 ceph-mon[34585]: pgmap v853: 188 pgs: 188 active+clean; 1.9 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 889 op/s 2021-10-08T19:38:24.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:24 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:38:24.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:24 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:38:24.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:24 smithi117 ceph-mon[34585]: 172.21.15.97 - - [08/Oct/2021:19:38:23] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:38:24.720 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:24.750 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2021-10-08T19:38:24.751 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:38:24.886 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:38:24.930 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:38:24.967 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:38:24.998 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:38:25.002 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:25.003 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:38:25.013 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:38:25.050 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:38:25.085 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:38:25.105 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:38:25.123 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:38:25.154 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:25.159 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:38:25.160 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true' 2021-10-08T19:38:25.160 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true' 2021-10-08T19:38:25.161 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true' 2021-10-08T19:38:25.161 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true' 2021-10-08T19:38:25.161 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true' 2021-10-08T19:38:25.161 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true' 2021-10-08T19:38:25.162 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'true' 2021-10-08T19:38:25.162 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'true' 2021-10-08T19:38:25.248 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:38:25.253 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:25.254 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:38:25.355 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:38:25.394 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:25.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:25 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1106595303' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:38:25.672 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:38:25.676 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:25 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1106595303' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:38:25.676 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:25.677 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:38:25.678 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:25 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1106595303' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:38:25.778 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:38:25.814 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:25.860 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:38:25.863 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:25.864 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:38:25.967 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:38:25.974 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:38:25 smithi097 conmon[33110]: 172.21.15.117 - - [08/Oct/2021:19:38:25] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:38:26.006 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:26.094 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:38:26.098 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:26.099 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:38:26.113 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2021-10-08T19:38:26.200 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:38:26.274 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:26.371 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:38:26.379 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:38:26.403 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:38:26.409 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:26 smithi117 ceph-mon[34585]: pgmap v854: 188 pgs: 188 active+clean; 1.5 GiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1.65k op/s 2021-10-08T19:38:26.409 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:26 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:38:26.409 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:26 smithi117 ceph-mon[34585]: osdmap e424: 8 total, 8 up, 8 in 2021-10-08T19:38:26.411 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:26 smithi097 ceph-mon[32687]: pgmap v854: 188 pgs: 188 active+clean; 1.5 GiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1.65k op/s 2021-10-08T19:38:26.411 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:26 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:38:26.411 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:26 smithi097 ceph-mon[32687]: osdmap e424: 8 total, 8 up, 8 in 2021-10-08T19:38:26.412 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:26 smithi097 ceph-mon[41966]: pgmap v854: 188 pgs: 188 active+clean; 1.5 GiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1.65k op/s 2021-10-08T19:38:26.412 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:26 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:38:26.412 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:26 smithi097 ceph-mon[41966]: osdmap e424: 8 total, 8 up, 8 in 2021-10-08T19:38:26.413 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:26.414 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:38:26.515 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:38:26.548 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:26.627 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:38:26.628 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:26.629 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:38:26.732 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:38:26.767 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:26.842 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:38:26.844 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:26.845 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:38:26.946 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:38:26.986 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:27.065 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:38:27.070 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:27.072 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:38:27.173 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:38:27.220 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:27.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:27 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:38:27.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:27 smithi097 ceph-mon[41966]: 172.21.15.117 - - [08/Oct/2021:19:38:25] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:38:27.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:27 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:38:27.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:27 smithi097 ceph-mon[32687]: 172.21.15.117 - - [08/Oct/2021:19:38:25] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:38:27.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:27 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:38:27.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:27 smithi117 ceph-mon[34585]: 172.21.15.117 - - [08/Oct/2021:19:38:25] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:38:27.658 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:38:27 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:38:28.195 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:38:28.416 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2021-10-08T19:38:28.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:28 smithi117 ceph-mon[34585]: pgmap v856: 188 pgs: 188 active+clean; 1.5 GiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 788 B/s rd, 0 B/s wr, 834 op/s 2021-10-08T19:38:28.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:28 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:38:28.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:28 smithi097 ceph-mon[41966]: pgmap v856: 188 pgs: 188 active+clean; 1.5 GiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 788 B/s rd, 0 B/s wr, 834 op/s 2021-10-08T19:38:28.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:28 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:38:28.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:28 smithi097 ceph-mon[32687]: pgmap v856: 188 pgs: 188 active+clean; 1.5 GiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 788 B/s rd, 0 B/s wr, 834 op/s 2021-10-08T19:38:28.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:28 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:38:28.822 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:38:28.828 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:28.829 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:38:28.930 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:38:28.960 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:29.050 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:38:29.053 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:29.054 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:38:29.098 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:38:29.156 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:38:29.213 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:29.360 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:38:29.381 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:29.382 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:38:29.483 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:38:29.512 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:29.571 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:38:29.573 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:29.574 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:38:29.675 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:38:29.738 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:29.970 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:38:29.971 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:29.972 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:38:30.073 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:38:30.106 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:30.166 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:38:30.170 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:30.170 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:38:30.271 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:38:30.303 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:30.378 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.3 to 1 (10000) 2021-10-08T19:38:30.384 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:38:30.389 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:30.390 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:38:30.491 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:38:30.531 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:30.623 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:38:30.630 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:30.631 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:38:30.632 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:30 smithi117 ceph-mon[34585]: pgmap v857: 188 pgs: 188 active+clean; 1.3 GiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 1.18k op/s 2021-10-08T19:38:30.632 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:30 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1045984992' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2021-10-08T19:38:30.640 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:30 smithi097 ceph-mon[32687]: pgmap v857: 188 pgs: 188 active+clean; 1.3 GiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 1.18k op/s 2021-10-08T19:38:30.640 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:30 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1045984992' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2021-10-08T19:38:30.640 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:30 smithi097 ceph-mon[41966]: pgmap v857: 188 pgs: 188 active+clean; 1.3 GiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 1.18k op/s 2021-10-08T19:38:30.641 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:30 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1045984992' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2021-10-08T19:38:30.733 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:38:30.758 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:30.864 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is unset 2021-10-08T19:38:31.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:31 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1045984992' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2021-10-08T19:38:31.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:31 smithi117 ceph-mon[34585]: osdmap e425: 8 total, 8 up, 8 in 2021-10-08T19:38:31.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:31 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2492180502' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:38:31.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:31 smithi117 ceph-mon[34585]: from='client.36086 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:38:31.659 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:31 smithi117 ceph-mon[34585]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:38:31.659 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:31 smithi117 ceph-mon[34585]: from='client.36086 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:38:31.659 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:31 smithi117 ceph-mon[34585]: osdmap e426: 8 total, 8 up, 8 in 2021-10-08T19:38:31.659 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:31 smithi117 ceph-mon[34585]: 5.d scrub ok 2021-10-08T19:38:31.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:31 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1045984992' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2021-10-08T19:38:31.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:31 smithi097 ceph-mon[32687]: osdmap e425: 8 total, 8 up, 8 in 2021-10-08T19:38:31.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:31 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2492180502' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:38:31.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:31 smithi097 ceph-mon[32687]: from='client.36086 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:38:31.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:31 smithi097 ceph-mon[32687]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:38:31.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:31 smithi097 ceph-mon[32687]: from='client.36086 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:38:31.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:31 smithi097 ceph-mon[32687]: osdmap e426: 8 total, 8 up, 8 in 2021-10-08T19:38:31.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:31 smithi097 ceph-mon[32687]: 5.d scrub ok 2021-10-08T19:38:31.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:31 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1045984992' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2021-10-08T19:38:31.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:31 smithi097 ceph-mon[41966]: osdmap e425: 8 total, 8 up, 8 in 2021-10-08T19:38:31.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:31 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2492180502' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:38:31.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:31 smithi097 ceph-mon[41966]: from='client.36086 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:38:31.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:31 smithi097 ceph-mon[41966]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:38:31.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:31 smithi097 ceph-mon[41966]: from='client.36086 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:38:31.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:31 smithi097 ceph-mon[41966]: osdmap e426: 8 total, 8 up, 8 in 2021-10-08T19:38:31.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:31 smithi097 ceph-mon[41966]: 5.d scrub ok 2021-10-08T19:38:31.818 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:38:31.823 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:31.825 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:38:31.927 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:38:31.950 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:32.286 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:38:32.291 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:32.292 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:38:32.393 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:38:32.438 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:32.652 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:32 smithi097 ceph-mon[41966]: pgmap v860: 188 pgs: 188 active+clean; 1.2 GiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 887 op/s 2021-10-08T19:38:32.652 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:32 smithi097 ceph-mon[41966]: 5.0 scrub ok 2021-10-08T19:38:32.653 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:38:32 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:38:32] "GET /metrics HTTP/1.1" 200 155888 "" "Prometheus/2.18.1" 2021-10-08T19:38:32.653 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:32 smithi097 ceph-mon[32687]: pgmap v860: 188 pgs: 188 active+clean; 1.2 GiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 887 op/s 2021-10-08T19:38:32.653 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:32 smithi097 ceph-mon[32687]: 5.0 scrub ok 2021-10-08T19:38:32.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:32 smithi117 ceph-mon[34585]: pgmap v860: 188 pgs: 188 active+clean; 1.2 GiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 887 op/s 2021-10-08T19:38:32.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:32 smithi117 ceph-mon[34585]: 5.0 scrub ok 2021-10-08T19:38:33.289 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:38:33.297 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:33.297 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:38:33.356 INFO:tasks.cephadm.ceph_manager.ceph:waiting for recovery to complete 2021-10-08T19:38:33.356 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph pg dump --format=json 2021-10-08T19:38:33.398 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:38:33.460 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:33.645 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:33 smithi097 ceph-mon[32687]: 5.11 scrub ok 2021-10-08T19:38:33.646 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:33 smithi097 ceph-mon[32687]: 5.7 scrub ok 2021-10-08T19:38:33.646 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:33 smithi097 ceph-mon[32687]: 2.b scrub ok 2021-10-08T19:38:33.646 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:33 smithi097 ceph-mon[41966]: 5.11 scrub ok 2021-10-08T19:38:33.647 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:33 smithi097 ceph-mon[41966]: 5.7 scrub ok 2021-10-08T19:38:33.647 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:33 smithi097 ceph-mon[41966]: 2.b scrub ok 2021-10-08T19:38:33.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:33 smithi117 ceph-mon[34585]: 5.11 scrub ok 2021-10-08T19:38:33.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:33 smithi117 ceph-mon[34585]: 5.7 scrub ok 2021-10-08T19:38:33.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:33 smithi117 ceph-mon[34585]: 2.b scrub ok 2021-10-08T19:38:33.779 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:38:33.785 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:33.787 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:38:33.888 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:38:33.894 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:38:33.894 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2021-10-08T19:38:33.895 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2021-10-08T19:38:33.895 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2021-10-08T19:38:33.895 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:38:33.923 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:33.946 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:38:33.986 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:38:33.988 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:33.988 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:38:34.051 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:38:34.089 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:38:34.095 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:38:34.118 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:38:33 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:38:33] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:38:34.121 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:34.139 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:38:34.177 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:38:34.198 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:38:34.202 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:34.203 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:38:34.220 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:38:34.256 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:38:34.289 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:38:34.304 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:38:34.327 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:38:34.343 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'false' 2021-10-08T19:38:34.343 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'false' 2021-10-08T19:38:34.343 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'false' 2021-10-08T19:38:34.344 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'false' 2021-10-08T19:38:34.344 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'false' 2021-10-08T19:38:34.344 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'false' 2021-10-08T19:38:34.344 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'false' 2021-10-08T19:38:34.345 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'false' 2021-10-08T19:38:34.359 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:34.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:34 smithi117 ceph-mon[34585]: pgmap v861: 188 pgs: 188 active+clean; 1.2 GiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 721 B/s rd, 0 B/s wr, 751 op/s 2021-10-08T19:38:34.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:34 smithi117 ceph-mon[34585]: 2.1f scrub ok 2021-10-08T19:38:34.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:34 smithi117 ceph-mon[34585]: 5.c scrub ok 2021-10-08T19:38:34.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:34 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1327976576' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:38:34.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:34 smithi097 ceph-mon[41966]: pgmap v861: 188 pgs: 188 active+clean; 1.2 GiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 721 B/s rd, 0 B/s wr, 751 op/s 2021-10-08T19:38:34.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:34 smithi097 ceph-mon[41966]: 2.1f scrub ok 2021-10-08T19:38:34.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:34 smithi097 ceph-mon[41966]: 5.c scrub ok 2021-10-08T19:38:34.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:34 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1327976576' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:38:34.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:34 smithi097 ceph-mon[32687]: pgmap v861: 188 pgs: 188 active+clean; 1.2 GiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 721 B/s rd, 0 B/s wr, 751 op/s 2021-10-08T19:38:34.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:34 smithi097 ceph-mon[32687]: 2.1f scrub ok 2021-10-08T19:38:34.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:34 smithi097 ceph-mon[32687]: 5.c scrub ok 2021-10-08T19:38:34.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:34 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1327976576' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:38:34.911 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2021-10-08T19:38:35.002 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:38:35.006 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:35.007 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:38:35.014 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset nodeep-scrub 2021-10-08T19:38:35.108 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:38:35.141 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:35.207 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:38:35.220 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:35.221 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:38:35.322 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:38:35.380 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:35.700 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:38:35.702 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:35 smithi097 ceph-mon[41966]: 10.4 scrub ok 2021-10-08T19:38:35.703 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:35 smithi097 ceph-mon[41966]: 2.c scrub ok 2021-10-08T19:38:35.703 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:35.704 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:38:35.705 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:35 smithi097 ceph-mon[32687]: 10.4 scrub ok 2021-10-08T19:38:35.705 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:35 smithi097 ceph-mon[32687]: 2.c scrub ok 2021-10-08T19:38:35.805 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:38:35.835 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:35 smithi117 ceph-mon[34585]: 10.4 scrub ok 2021-10-08T19:38:35.835 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:35 smithi117 ceph-mon[34585]: 2.c scrub ok 2021-10-08T19:38:35.838 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:35.897 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:38:35.899 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:35.900 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:38:36.001 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:38:36.048 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:36.140 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:38:36.145 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:36.146 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:38:36.245 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:38:36.245 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:38:36.247 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:38:36.307 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:36.494 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:38:36.503 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:36.504 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:38:36.605 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:38:36.639 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:36 smithi097 ceph-mon[32687]: pgmap v862: 188 pgs: 188 active+clean; 903 MiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.33k op/s 2021-10-08T19:38:36.639 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:36 smithi097 ceph-mon[32687]: 4.16 scrub ok 2021-10-08T19:38:36.640 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:36 smithi097 ceph-mon[32687]: 3.11 scrub ok 2021-10-08T19:38:36.640 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:36 smithi097 ceph-mon[32687]: 5.8 scrub ok 2021-10-08T19:38:36.641 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:36 smithi097 ceph-mon[41966]: pgmap v862: 188 pgs: 188 active+clean; 903 MiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.33k op/s 2021-10-08T19:38:36.641 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:36 smithi097 ceph-mon[41966]: 4.16 scrub ok 2021-10-08T19:38:36.641 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:36 smithi097 ceph-mon[41966]: 3.11 scrub ok 2021-10-08T19:38:36.641 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:36 smithi097 ceph-mon[41966]: 5.8 scrub ok 2021-10-08T19:38:36.642 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:36.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:36 smithi117 ceph-mon[34585]: pgmap v862: 188 pgs: 188 active+clean; 903 MiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.33k op/s 2021-10-08T19:38:36.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:36 smithi117 ceph-mon[34585]: 4.16 scrub ok 2021-10-08T19:38:36.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:36 smithi117 ceph-mon[34585]: 3.11 scrub ok 2021-10-08T19:38:36.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:36 smithi117 ceph-mon[34585]: 5.8 scrub ok 2021-10-08T19:38:37.033 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:38:37.038 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:37.039 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:38:37.140 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:38:37.191 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:37.443 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:38:37 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:38:37.448 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:38:37.455 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:37.456 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:38:37.556 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:38:37.612 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:37.688 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:38:37.692 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:37.692 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:38:37.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:37 smithi097 ceph-mon[32687]: 6.10 scrub ok 2021-10-08T19:38:37.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:37 smithi097 ceph-mon[32687]: 2.24 scrub ok 2021-10-08T19:38:37.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:37 smithi097 ceph-mon[32687]: 5.1b scrub ok 2021-10-08T19:38:37.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:37 smithi097 ceph-mon[32687]: 2.1d scrub ok 2021-10-08T19:38:37.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:37 smithi097 ceph-mon[32687]: 6.1e scrub ok 2021-10-08T19:38:37.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:37 smithi097 ceph-mon[41966]: 6.10 scrub ok 2021-10-08T19:38:37.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:37 smithi097 ceph-mon[41966]: 2.24 scrub ok 2021-10-08T19:38:37.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:37 smithi097 ceph-mon[41966]: 5.1b scrub ok 2021-10-08T19:38:37.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:37 smithi097 ceph-mon[41966]: 2.1d scrub ok 2021-10-08T19:38:37.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:37 smithi097 ceph-mon[41966]: 6.1e scrub ok 2021-10-08T19:38:37.793 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:38:37.845 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:37.859 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2021-10-08T19:38:37.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:37 smithi117 ceph-mon[34585]: 6.10 scrub ok 2021-10-08T19:38:37.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:37 smithi117 ceph-mon[34585]: 2.24 scrub ok 2021-10-08T19:38:37.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:37 smithi117 ceph-mon[34585]: 5.1b scrub ok 2021-10-08T19:38:37.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:37 smithi117 ceph-mon[34585]: 2.1d scrub ok 2021-10-08T19:38:37.908 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:37 smithi117 ceph-mon[34585]: 6.1e scrub ok 2021-10-08T19:38:38.429 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:38 smithi097 ceph-mon[32687]: pgmap v863: 188 pgs: 188 active+clean; 903 MiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 828 op/s 2021-10-08T19:38:38.429 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:38 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:38:38.429 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:38 smithi097 ceph-mon[32687]: 6.5 scrub ok 2021-10-08T19:38:38.430 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:38 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:38:38.430 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:38 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:38:38.430 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:38 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:38:38.430 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:38 smithi097 ceph-mon[32687]: 4.e scrub ok 2021-10-08T19:38:38.431 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:38 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:38:38.431 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:38 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:38:38.463 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:38:38.469 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2021-10-08T19:38:38.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:38 smithi117 ceph-mon[34585]: pgmap v863: 188 pgs: 188 active+clean; 903 MiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 828 op/s 2021-10-08T19:38:38.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:38 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:38:38.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:38 smithi117 ceph-mon[34585]: 6.5 scrub ok 2021-10-08T19:38:38.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:38 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:38:38.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:38 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:38:38.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:38 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:38:38.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:38 smithi117 ceph-mon[34585]: 4.e scrub ok 2021-10-08T19:38:38.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:38 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:38:38.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:38 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:38:38.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:38 smithi097 ceph-mon[41966]: pgmap v863: 188 pgs: 188 active+clean; 903 MiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 828 op/s 2021-10-08T19:38:38.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:38 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:38:38.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:38 smithi097 ceph-mon[41966]: 6.5 scrub ok 2021-10-08T19:38:38.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:38 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:38:38.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:38 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:38:38.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:38 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:38:38.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:38 smithi097 ceph-mon[41966]: 4.e scrub ok 2021-10-08T19:38:38.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:38 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:38:38.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:38 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:38:39.252 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:38:39.579 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:39.580 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:38:39.681 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:38:39.707 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:39 smithi117 ceph-mon[34585]: poll took 60044.459 ms: 1 events 2021-10-08T19:38:39.707 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:39 smithi117 ceph-mon[34585]: 3.10 scrub ok 2021-10-08T19:38:39.708 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:39 smithi117 ceph-mon[34585]: from='client.36098 v1:172.21.15.97:0/4249345346' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:38:39.708 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:39 smithi117 ceph-mon[34585]: 5.10 scrub ok 2021-10-08T19:38:39.708 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:39 smithi117 ceph-mon[34585]: 3.4 scrub ok 2021-10-08T19:38:39.709 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:39.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:39 smithi097 ceph-mon[41966]: poll took 60044.459 ms: 1 events 2021-10-08T19:38:39.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:39 smithi097 ceph-mon[41966]: 3.10 scrub ok 2021-10-08T19:38:39.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:39 smithi097 ceph-mon[41966]: from='client.36098 v1:172.21.15.97:0/4249345346' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:38:39.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:39 smithi097 ceph-mon[41966]: 5.10 scrub ok 2021-10-08T19:38:39.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:39 smithi097 ceph-mon[41966]: 3.4 scrub ok 2021-10-08T19:38:39.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:39 smithi097 ceph-mon[32687]: poll took 60044.459 ms: 1 events 2021-10-08T19:38:39.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:39 smithi097 ceph-mon[32687]: 3.10 scrub ok 2021-10-08T19:38:39.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:39 smithi097 ceph-mon[32687]: from='client.36098 v1:172.21.15.97:0/4249345346' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:38:39.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:39 smithi097 ceph-mon[32687]: 5.10 scrub ok 2021-10-08T19:38:39.724 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:39 smithi097 ceph-mon[32687]: 3.4 scrub ok 2021-10-08T19:38:39.796 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:38:39.800 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:39.801 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:38:39.902 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:38:39.933 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:40.002 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:38:40.008 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:40.009 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:38:40.110 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:38:40.338 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:40.684 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:38:40.685 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:40 smithi097 ceph-mon[32687]: pgmap v864: 188 pgs: 188 active+clean; 642 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 478 B/s rd, 0 B/s wr, 1.11k op/s 2021-10-08T19:38:40.685 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:40 smithi097 ceph-mon[32687]: 5.2 scrub ok 2021-10-08T19:38:40.686 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:40 smithi097 ceph-mon[32687]: 6.7 scrub ok 2021-10-08T19:38:40.687 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:40 smithi097 ceph-mon[32687]: 4.9 scrub ok 2021-10-08T19:38:40.687 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:40.688 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:38:40.688 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:40 smithi097 ceph-mon[41966]: pgmap v864: 188 pgs: 188 active+clean; 642 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 478 B/s rd, 0 B/s wr, 1.11k op/s 2021-10-08T19:38:40.689 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:40 smithi097 ceph-mon[41966]: 5.2 scrub ok 2021-10-08T19:38:40.689 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:40 smithi097 ceph-mon[41966]: 6.7 scrub ok 2021-10-08T19:38:40.690 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:40 smithi097 ceph-mon[41966]: 4.9 scrub ok 2021-10-08T19:38:40.703 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:38:40.743 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":863,"stamp":"2021-10-08T19:38:36.925511+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":946662197,"num_objects":14631,"num_object_clones":0,"num_object_copies":43893,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14631,"num_whiteouts":0,"num_read":1549,"num_read_kb":1314,"num_write":223290,"num_write_kb":7584196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":534,"num_bytes_recovered":172627,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":73595,"ondisk_log_size":73595,"up":564,"acting":564,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":564,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":5368484,"kb_used_data":2858660,"kb_used_omap":0,"kb_used_meta":2509376,"kb_avail":744592732,"statfs":{"total":767960285184,"available":762462957568,"internally_reserved":0,"allocated":2927267840,"data_stored":2922619028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2569601024},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,4,17,9,1,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-433913856,"num_objects":-6621,"num_object_clones":0,"num_object_copies":-19863,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-6621,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6621,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003325"},"pg_stats":[{"pgid":"2.29","version":"0'0","reported_seq":51,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.373759+0000","last_change":"2021-10-08T19:37:45.848942+0000","last_active":"2021-10-08T19:38:30.373759+0000","last_peered":"2021-10-08T19:38:30.373759+0000","last_clean":"2021-10-08T19:38:30.373759+0000","last_became_active":"2021-10-08T19:37:45.848663+0000","last_became_peered":"2021-10-08T19:37:45.848663+0000","last_unstale":"2021-10-08T19:38:30.373759+0000","last_undegraded":"2021-10-08T19:38:30.373759+0000","last_fullsized":"2021-10-08T19:38:30.373759+0000","mapping_epoch":407,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":408,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:19.757349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:30:11.102934+0000","last_clean_scrub_stamp":"2021-10-08T19:35:19.757349+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001709061,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.28","version":"0'0","reported_seq":42,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.377157+0000","last_change":"2021-10-08T19:37:00.334823+0000","last_active":"2021-10-08T19:38:30.377157+0000","last_peered":"2021-10-08T19:38:30.377157+0000","last_clean":"2021-10-08T19:38:30.377157+0000","last_became_active":"2021-10-08T19:37:00.334502+0000","last_became_peered":"2021-10-08T19:37:00.334502+0000","last_unstale":"2021-10-08T19:38:30.377157+0000","last_undegraded":"2021-10-08T19:38:30.377157+0000","last_fullsized":"2021-10-08T19:38:30.377157+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:01.984068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:01.984068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0028891239999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.27","version":"0'0","reported_seq":355,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.377801+0000","last_change":"2021-10-08T19:37:00.342826+0000","last_active":"2021-10-08T19:38:30.377801+0000","last_peered":"2021-10-08T19:38:30.377801+0000","last_clean":"2021-10-08T19:38:30.377801+0000","last_became_active":"2021-10-08T19:37:00.342526+0000","last_became_peered":"2021-10-08T19:37:00.342526+0000","last_unstale":"2021-10-08T19:38:30.377801+0000","last_undegraded":"2021-10-08T19:38:30.377801+0000","last_fullsized":"2021-10-08T19:38:30.377801+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:12.643664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:12.643664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0025959149999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.26","version":"0'0","reported_seq":42,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.377524+0000","last_change":"2021-10-08T19:37:00.340647+0000","last_active":"2021-10-08T19:38:30.377524+0000","last_peered":"2021-10-08T19:38:30.377524+0000","last_clean":"2021-10-08T19:38:30.377524+0000","last_became_active":"2021-10-08T19:37:00.340327+0000","last_became_peered":"2021-10-08T19:37:00.340327+0000","last_unstale":"2021-10-08T19:38:30.377524+0000","last_undegraded":"2021-10-08T19:38:30.377524+0000","last_fullsized":"2021-10-08T19:38:30.377524+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:50.752866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:07.710367+0000","last_clean_scrub_stamp":"2021-10-08T19:34:50.752866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013659034,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.25","version":"328'2","reported_seq":359,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.367244+0000","last_change":"2021-10-08T19:38:00.259167+0000","last_active":"2021-10-08T19:38:30.367244+0000","last_peered":"2021-10-08T19:38:30.367244+0000","last_clean":"2021-10-08T19:38:30.367244+0000","last_became_active":"2021-10-08T19:37:00.344673+0000","last_became_peered":"2021-10-08T19:37:00.344673+0000","last_unstale":"2021-10-08T19:38:30.367244+0000","last_undegraded":"2021-10-08T19:38:30.367244+0000","last_fullsized":"2021-10-08T19:38:30.367244+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"328'2","last_scrub_stamp":"2021-10-08T19:38:00.259074+0000","last_deep_scrub":"328'2","last_deep_scrub_stamp":"2021-10-08T19:33:29.990395+0000","last_clean_scrub_stamp":"2021-10-08T19:38:00.259074+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011095977,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.24","version":"0'0","reported_seq":42,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.379819+0000","last_change":"2021-10-08T19:37:00.337143+0000","last_active":"2021-10-08T19:38:30.379819+0000","last_peered":"2021-10-08T19:38:30.379819+0000","last_clean":"2021-10-08T19:38:30.379819+0000","last_became_active":"2021-10-08T19:37:00.336960+0000","last_became_peered":"2021-10-08T19:37:00.336960+0000","last_unstale":"2021-10-08T19:38:30.379819+0000","last_undegraded":"2021-10-08T19:38:30.379819+0000","last_fullsized":"2021-10-08T19:38:30.379819+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:16.702426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:16.702426+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0018085219999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.23","version":"0'0","reported_seq":42,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.377930+0000","last_change":"2021-10-08T19:37:00.348151+0000","last_active":"2021-10-08T19:38:30.377930+0000","last_peered":"2021-10-08T19:38:30.377930+0000","last_clean":"2021-10-08T19:38:30.377930+0000","last_became_active":"2021-10-08T19:37:00.347789+0000","last_became_peered":"2021-10-08T19:37:00.347789+0000","last_unstale":"2021-10-08T19:38:30.377930+0000","last_undegraded":"2021-10-08T19:38:30.377930+0000","last_fullsized":"2021-10-08T19:38:30.377930+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:31.652494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:31.652494+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0075080879999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.22","version":"0'0","reported_seq":442,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.380580+0000","last_change":"2021-10-08T19:37:00.343730+0000","last_active":"2021-10-08T19:38:30.380580+0000","last_peered":"2021-10-08T19:38:30.380580+0000","last_clean":"2021-10-08T19:38:30.380580+0000","last_became_active":"2021-10-08T19:37:00.343394+0000","last_became_peered":"2021-10-08T19:37:00.343394+0000","last_unstale":"2021-10-08T19:38:30.380580+0000","last_undegraded":"2021-10-08T19:38:30.380580+0000","last_fullsized":"2021-10-08T19:38:30.380580+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:23.647485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:23.647485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002822181,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3],"acting":[6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.21","version":"0'0","reported_seq":447,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.372479+0000","last_change":"2021-10-08T19:37:52.183026+0000","last_active":"2021-10-08T19:38:30.372479+0000","last_peered":"2021-10-08T19:38:30.372479+0000","last_clean":"2021-10-08T19:38:30.372479+0000","last_became_active":"2021-10-08T19:37:00.335409+0000","last_became_peered":"2021-10-08T19:37:00.335409+0000","last_unstale":"2021-10-08T19:38:30.372479+0000","last_undegraded":"2021-10-08T19:38:30.372479+0000","last_fullsized":"2021-10-08T19:38:30.372479+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:52.182934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:37:52.182934+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.023529145000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7],"acting":[2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.20","version":"0'0","reported_seq":52,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.381078+0000","last_change":"2021-10-08T19:37:00.342150+0000","last_active":"2021-10-08T19:38:30.381078+0000","last_peered":"2021-10-08T19:38:30.381078+0000","last_clean":"2021-10-08T19:38:30.381078+0000","last_became_active":"2021-10-08T19:37:00.341831+0000","last_became_peered":"2021-10-08T19:37:00.341831+0000","last_unstale":"2021-10-08T19:38:30.381078+0000","last_undegraded":"2021-10-08T19:38:30.381078+0000","last_fullsized":"2021-10-08T19:38:30.381078+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:08.078324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:32.922694+0000","last_clean_scrub_stamp":"2021-10-08T19:36:08.078324+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0052928530000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.6","version":"426'14075","reported_seq":14168,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:33.618279+0000","last_change":"2021-10-08T19:38:08.036367+0000","last_active":"2021-10-08T19:38:33.618279+0000","last_peered":"2021-10-08T19:38:33.618279+0000","last_clean":"2021-10-08T19:38:33.618279+0000","last_became_active":"2021-10-08T19:37:19.001470+0000","last_became_peered":"2021-10-08T19:37:19.001470+0000","last_unstale":"2021-10-08T19:38:33.618279+0000","last_undegraded":"2021-10-08T19:38:33.618279+0000","last_fullsized":"2021-10-08T19:38:33.618279+0000","mapping_epoch":397,"log_start":"402'9584","ondisk_log_start":"402'9584","created":355,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"416'12331","last_scrub_stamp":"2021-10-08T19:38:08.036268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:38:08.036268+0000","log_size":4491,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.91506893,"stat_sum":{"num_bytes":58130432,"num_objects":887,"num_object_clones":0,"num_object_copies":2661,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":887,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14075,"num_write_kb":478784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,4],"acting":[0,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"114'10","reported_seq":645,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.846733+0000","last_change":"2021-10-08T19:37:51.741192+0000","last_active":"2021-10-08T19:38:30.846733+0000","last_peered":"2021-10-08T19:38:30.846733+0000","last_clean":"2021-10-08T19:38:30.846733+0000","last_became_active":"2021-10-08T19:24:25.096162+0000","last_became_peered":"2021-10-08T19:24:25.096162+0000","last_unstale":"2021-10-08T19:38:30.846733+0000","last_undegraded":"2021-10-08T19:38:30.846733+0000","last_fullsized":"2021-10-08T19:38:30.846733+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'10","last_scrub_stamp":"2021-10-08T19:37:51.741091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:37:51.741091+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0076100259999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"289'34","reported_seq":87,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.378715+0000","last_change":"2021-10-08T19:37:18.998690+0000","last_active":"2021-10-08T19:38:30.378715+0000","last_peered":"2021-10-08T19:38:30.378715+0000","last_clean":"2021-10-08T19:38:30.378715+0000","last_became_active":"2021-10-08T19:37:18.998305+0000","last_became_peered":"2021-10-08T19:37:18.998305+0000","last_unstale":"2021-10-08T19:38:30.378715+0000","last_undegraded":"2021-10-08T19:38:30.378715+0000","last_fullsized":"2021-10-08T19:38:30.378715+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'34","last_scrub_stamp":"2021-10-08T19:36:55.766292+0000","last_deep_scrub":"87'22","last_deep_scrub_stamp":"2021-10-08T19:22:58.705632+0000","last_clean_scrub_stamp":"2021-10-08T19:36:55.766292+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":438,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.370965+0000","last_change":"2021-10-08T19:37:54.177746+0000","last_active":"2021-10-08T19:38:30.370965+0000","last_peered":"2021-10-08T19:38:30.370965+0000","last_clean":"2021-10-08T19:38:30.370965+0000","last_became_active":"2021-10-08T19:29:40.632678+0000","last_became_peered":"2021-10-08T19:29:40.632678+0000","last_unstale":"2021-10-08T19:38:30.370965+0000","last_undegraded":"2021-10-08T19:38:30.370965+0000","last_fullsized":"2021-10-08T19:38:30.370965+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:54.177635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:37:54.177635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0085167739999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":109,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.380749+0000","last_change":"2021-10-08T19:37:19.000575+0000","last_active":"2021-10-08T19:38:30.380749+0000","last_peered":"2021-10-08T19:38:30.380749+0000","last_clean":"2021-10-08T19:38:30.380749+0000","last_became_active":"2021-10-08T19:37:19.000347+0000","last_became_peered":"2021-10-08T19:37:19.000347+0000","last_unstale":"2021-10-08T19:38:30.380749+0000","last_undegraded":"2021-10-08T19:38:30.380749+0000","last_fullsized":"2021-10-08T19:38:30.380749+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:00.572589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:08.936801+0000","last_clean_scrub_stamp":"2021-10-08T19:36:00.572589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.00168849,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":332,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.377989+0000","last_change":"2021-10-08T19:36:04.907070+0000","last_active":"2021-10-08T19:38:30.377989+0000","last_peered":"2021-10-08T19:38:30.377989+0000","last_clean":"2021-10-08T19:38:30.377989+0000","last_became_active":"2021-10-08T19:25:15.510457+0000","last_became_peered":"2021-10-08T19:25:15.510457+0000","last_unstale":"2021-10-08T19:38:30.377989+0000","last_undegraded":"2021-10-08T19:38:30.377989+0000","last_fullsized":"2021-10-08T19:38:30.377989+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:04.906938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:33:28.036266+0000","last_clean_scrub_stamp":"2021-10-08T19:36:04.906938+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0079401560000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"426'13785","reported_seq":13870,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:33.909732+0000","last_change":"2021-10-08T19:36:56.665437+0000","last_active":"2021-10-08T19:38:33.909732+0000","last_peered":"2021-10-08T19:38:33.909732+0000","last_clean":"2021-10-08T19:38:33.909732+0000","last_became_active":"2021-10-08T19:35:17.124786+0000","last_became_peered":"2021-10-08T19:35:17.124786+0000","last_unstale":"2021-10-08T19:38:33.909732+0000","last_undegraded":"2021-10-08T19:38:33.909732+0000","last_fullsized":"2021-10-08T19:38:33.909732+0000","mapping_epoch":355,"log_start":"396'8556","ondisk_log_start":"396'8556","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"390'7344","last_scrub_stamp":"2021-10-08T19:36:56.665333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:36:56.665333+0000","log_size":5229,"ondisk_log_size":5229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":3.7252241010000002,"stat_sum":{"num_bytes":57212928,"num_objects":873,"num_object_clones":0,"num_object_copies":2619,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":873,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13785,"num_write_kb":469056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"337'19","reported_seq":469,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.378050+0000","last_change":"2021-10-08T19:36:17.162468+0000","last_active":"2021-10-08T19:38:30.378050+0000","last_peered":"2021-10-08T19:38:30.378050+0000","last_clean":"2021-10-08T19:38:30.378050+0000","last_became_active":"2021-10-08T19:28:40.159729+0000","last_became_peered":"2021-10-08T19:28:40.159729+0000","last_unstale":"2021-10-08T19:38:30.378050+0000","last_undegraded":"2021-10-08T19:38:30.378050+0000","last_fullsized":"2021-10-08T19:38:30.378050+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"337'19","last_scrub_stamp":"2021-10-08T19:36:17.162349+0000","last_deep_scrub":"337'19","last_deep_scrub_stamp":"2021-10-08T19:34:14.040249+0000","last_clean_scrub_stamp":"2021-10-08T19:36:17.162349+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.019723487000000001,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":274,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.404105+0000","last_change":"2021-10-08T19:36:57.596887+0000","last_active":"2021-10-08T19:38:30.404105+0000","last_peered":"2021-10-08T19:38:30.404105+0000","last_clean":"2021-10-08T19:38:30.404105+0000","last_became_active":"2021-10-08T19:29:40.624977+0000","last_became_peered":"2021-10-08T19:29:40.624977+0000","last_unstale":"2021-10-08T19:38:30.404105+0000","last_undegraded":"2021-10-08T19:38:30.404105+0000","last_fullsized":"2021-10-08T19:38:30.404105+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:57.596784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:57.596784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010370961,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":426,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.370308+0000","last_change":"2021-10-08T19:37:14.912131+0000","last_active":"2021-10-08T19:38:30.370308+0000","last_peered":"2021-10-08T19:38:30.370308+0000","last_clean":"2021-10-08T19:38:30.370308+0000","last_became_active":"2021-10-08T19:29:40.629422+0000","last_became_peered":"2021-10-08T19:29:40.629422+0000","last_unstale":"2021-10-08T19:38:30.370308+0000","last_undegraded":"2021-10-08T19:38:30.370308+0000","last_fullsized":"2021-10-08T19:38:30.370308+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:14.912048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:37:14.912048+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0013646590000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":402,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.378235+0000","last_change":"2021-10-08T19:37:49.991077+0000","last_active":"2021-10-08T19:38:30.378235+0000","last_peered":"2021-10-08T19:38:30.378235+0000","last_clean":"2021-10-08T19:38:30.378235+0000","last_became_active":"2021-10-08T19:21:29.643022+0000","last_became_peered":"2021-10-08T19:21:29.643022+0000","last_unstale":"2021-10-08T19:38:30.378235+0000","last_undegraded":"2021-10-08T19:38:30.378235+0000","last_fullsized":"2021-10-08T19:38:30.378235+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:49.990967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:37:49.990967+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.047700399999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"70'5","reported_seq":624,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:32.206945+0000","last_change":"2021-10-08T19:38:02.331641+0000","last_active":"2021-10-08T19:38:32.206945+0000","last_peered":"2021-10-08T19:38:32.206945+0000","last_clean":"2021-10-08T19:38:32.206945+0000","last_became_active":"2021-10-08T19:37:19.006464+0000","last_became_peered":"2021-10-08T19:37:19.006464+0000","last_unstale":"2021-10-08T19:38:32.206945+0000","last_undegraded":"2021-10-08T19:38:32.206945+0000","last_fullsized":"2021-10-08T19:38:32.206945+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:38:02.331532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:38:02.331532+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0043661940000000003,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":393,"num_read_kb":393,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":778,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.4","version":"426'13819","reported_seq":13898,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:33.650613+0000","last_change":"2021-10-08T19:35:17.124862+0000","last_active":"2021-10-08T19:38:33.650613+0000","last_peered":"2021-10-08T19:38:33.650613+0000","last_clean":"2021-10-08T19:38:33.650613+0000","last_became_active":"2021-10-08T19:35:17.124559+0000","last_became_peered":"2021-10-08T19:35:17.124559+0000","last_unstale":"2021-10-08T19:38:33.650613+0000","last_undegraded":"2021-10-08T19:38:33.650613+0000","last_fullsized":"2021-10-08T19:38:33.650613+0000","mapping_epoch":355,"log_start":"402'9325","ondisk_log_start":"402'9325","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:35:15.759693+0000","log_size":4494,"ondisk_log_size":4494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":58654720,"num_objects":895,"num_object_clones":0,"num_object_copies":2685,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":895,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13819,"num_write_kb":470848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"289'35","reported_seq":457,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.380857+0000","last_change":"2021-10-08T19:35:57.653426+0000","last_active":"2021-10-08T19:38:30.380857+0000","last_peered":"2021-10-08T19:38:30.380857+0000","last_clean":"2021-10-08T19:38:30.380857+0000","last_became_active":"2021-10-08T19:28:40.101648+0000","last_became_peered":"2021-10-08T19:28:40.101648+0000","last_unstale":"2021-10-08T19:38:30.380857+0000","last_undegraded":"2021-10-08T19:38:30.380857+0000","last_fullsized":"2021-10-08T19:38:30.380857+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'35","last_scrub_stamp":"2021-10-08T19:35:57.653345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:35:57.653345+0000","log_size":35,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040502669999999998,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":55,"num_read_kb":44,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":412,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.369768+0000","last_change":"2021-10-08T19:38:02.197608+0000","last_active":"2021-10-08T19:38:30.369768+0000","last_peered":"2021-10-08T19:38:30.369768+0000","last_clean":"2021-10-08T19:38:30.369768+0000","last_became_active":"2021-10-08T19:21:23.595919+0000","last_became_peered":"2021-10-08T19:21:23.595919+0000","last_unstale":"2021-10-08T19:38:30.369768+0000","last_undegraded":"2021-10-08T19:38:30.369768+0000","last_fullsized":"2021-10-08T19:38:30.369768+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:58.074848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:58.074848+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0063866330000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":424,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.369552+0000","last_change":"2021-10-08T19:37:53.130636+0000","last_active":"2021-10-08T19:38:30.369552+0000","last_peered":"2021-10-08T19:38:30.369552+0000","last_clean":"2021-10-08T19:38:30.369552+0000","last_became_active":"2021-10-08T19:31:22.783725+0000","last_became_peered":"2021-10-08T19:31:22.783725+0000","last_unstale":"2021-10-08T19:38:30.369552+0000","last_undegraded":"2021-10-08T19:38:30.369552+0000","last_fullsized":"2021-10-08T19:38:30.369552+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:53.130533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:37:53.130533+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0085012260000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":416,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.378397+0000","last_change":"2021-10-08T19:36:48.881526+0000","last_active":"2021-10-08T19:38:30.378397+0000","last_peered":"2021-10-08T19:38:30.378397+0000","last_clean":"2021-10-08T19:38:30.378397+0000","last_became_active":"2021-10-08T19:29:40.638354+0000","last_became_peered":"2021-10-08T19:29:40.638354+0000","last_unstale":"2021-10-08T19:38:30.378397+0000","last_undegraded":"2021-10-08T19:38:30.378397+0000","last_fullsized":"2021-10-08T19:38:30.378397+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:48.881410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:39.528699+0000","last_clean_scrub_stamp":"2021-10-08T19:36:48.881410+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0060881240000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":343,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.376943+0000","last_change":"2021-10-08T19:35:58.023652+0000","last_active":"2021-10-08T19:38:30.376943+0000","last_peered":"2021-10-08T19:38:30.376943+0000","last_clean":"2021-10-08T19:38:30.376943+0000","last_became_active":"2021-10-08T19:31:22.785590+0000","last_became_peered":"2021-10-08T19:31:22.785590+0000","last_unstale":"2021-10-08T19:38:30.376943+0000","last_undegraded":"2021-10-08T19:38:30.376943+0000","last_fullsized":"2021-10-08T19:38:30.376943+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:58.023581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:58.023581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0070639609999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3","version":"426'14102","reported_seq":14187,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:33.885195+0000","last_change":"2021-10-08T19:37:18.859736+0000","last_active":"2021-10-08T19:38:33.885195+0000","last_peered":"2021-10-08T19:38:33.885195+0000","last_clean":"2021-10-08T19:38:33.885195+0000","last_became_active":"2021-10-08T19:35:17.123799+0000","last_became_peered":"2021-10-08T19:35:17.123799+0000","last_unstale":"2021-10-08T19:38:33.885195+0000","last_undegraded":"2021-10-08T19:38:33.885195+0000","last_fullsized":"2021-10-08T19:38:33.885195+0000","mapping_epoch":355,"log_start":"396'8888","ondisk_log_start":"396'8888","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"397'9089","last_scrub_stamp":"2021-10-08T19:37:18.859650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:37:18.859650+0000","log_size":5214,"ondisk_log_size":5214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":1.891578097,"stat_sum":{"num_bytes":58589184,"num_objects":894,"num_object_clones":0,"num_object_copies":2682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":894,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14102,"num_write_kb":479872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.8","version":"90'130","reported_seq":404,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.370168+0000","last_change":"2021-10-08T19:38:00.214648+0000","last_active":"2021-10-08T19:38:30.370168+0000","last_peered":"2021-10-08T19:38:30.370168+0000","last_clean":"2021-10-08T19:38:30.370168+0000","last_became_active":"2021-10-08T19:37:19.009239+0000","last_became_peered":"2021-10-08T19:37:19.009239+0000","last_unstale":"2021-10-08T19:38:30.370168+0000","last_undegraded":"2021-10-08T19:38:30.370168+0000","last_fullsized":"2021-10-08T19:38:30.370168+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:38:00.214557+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:38:00.214557+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013077909,"stat_sum":{"num_bytes":262688,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"289'31","reported_seq":504,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.367510+0000","last_change":"2021-10-08T19:37:52.422769+0000","last_active":"2021-10-08T19:38:30.367510+0000","last_peered":"2021-10-08T19:38:30.367510+0000","last_clean":"2021-10-08T19:38:30.367510+0000","last_became_active":"2021-10-08T19:28:40.099618+0000","last_became_peered":"2021-10-08T19:28:40.099618+0000","last_unstale":"2021-10-08T19:38:30.367510+0000","last_undegraded":"2021-10-08T19:38:30.367510+0000","last_fullsized":"2021-10-08T19:38:30.367510+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'31","last_scrub_stamp":"2021-10-08T19:37:52.422690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:37:52.422690+0000","log_size":31,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.01215956,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":50,"num_read_kb":40,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"61'1","reported_seq":412,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:32.632484+0000","last_change":"2021-10-08T19:38:32.632445+0000","last_active":"2021-10-08T19:38:32.632484+0000","last_peered":"2021-10-08T19:38:32.632484+0000","last_clean":"2021-10-08T19:38:32.632484+0000","last_became_active":"2021-10-08T19:21:23.607064+0000","last_became_peered":"2021-10-08T19:21:23.607064+0000","last_unstale":"2021-10-08T19:38:32.632484+0000","last_undegraded":"2021-10-08T19:38:32.632484+0000","last_fullsized":"2021-10-08T19:38:32.632484+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'1","last_scrub_stamp":"2021-10-08T19:38:32.632368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:38:32.632368+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011475187,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":256,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:33.731207+0000","last_change":"2021-10-08T19:38:33.731166+0000","last_active":"2021-10-08T19:38:33.731207+0000","last_peered":"2021-10-08T19:38:33.731207+0000","last_clean":"2021-10-08T19:38:33.731207+0000","last_became_active":"2021-10-08T19:28:40.152478+0000","last_became_peered":"2021-10-08T19:28:40.152478+0000","last_unstale":"2021-10-08T19:38:33.731207+0000","last_undegraded":"2021-10-08T19:38:33.731207+0000","last_fullsized":"2021-10-08T19:38:33.731207+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:33.731025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:30:09.081635+0000","last_clean_scrub_stamp":"2021-10-08T19:38:33.731025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0017739489999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":424,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.371603+0000","last_change":"2021-10-08T19:37:23.106186+0000","last_active":"2021-10-08T19:38:30.371603+0000","last_peered":"2021-10-08T19:38:30.371603+0000","last_clean":"2021-10-08T19:38:30.371603+0000","last_became_active":"2021-10-08T19:29:40.629424+0000","last_became_peered":"2021-10-08T19:29:40.629424+0000","last_unstale":"2021-10-08T19:38:30.371603+0000","last_undegraded":"2021-10-08T19:38:30.371603+0000","last_fullsized":"2021-10-08T19:38:30.371603+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:23.106065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:37:23.106065+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.113287978,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":388,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.380979+0000","last_change":"2021-10-08T19:37:57.261677+0000","last_active":"2021-10-08T19:38:30.380979+0000","last_peered":"2021-10-08T19:38:30.380979+0000","last_clean":"2021-10-08T19:38:30.380979+0000","last_became_active":"2021-10-08T19:31:51.676829+0000","last_became_peered":"2021-10-08T19:31:51.676829+0000","last_unstale":"2021-10-08T19:38:30.380979+0000","last_undegraded":"2021-10-08T19:38:30.380979+0000","last_fullsized":"2021-10-08T19:38:30.380979+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:57.261583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:37:57.261583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.005169168,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"426'13954","reported_seq":14039,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:34.280394+0000","last_change":"2021-10-08T19:38:01.760828+0000","last_active":"2021-10-08T19:38:34.280394+0000","last_peered":"2021-10-08T19:38:34.280394+0000","last_clean":"2021-10-08T19:38:34.280394+0000","last_became_active":"2021-10-08T19:35:16.780016+0000","last_became_peered":"2021-10-08T19:35:16.780016+0000","last_unstale":"2021-10-08T19:38:34.280394+0000","last_undegraded":"2021-10-08T19:38:34.280394+0000","last_fullsized":"2021-10-08T19:38:34.280394+0000","mapping_epoch":355,"log_start":"401'9396","ondisk_log_start":"401'9396","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"414'11799","last_scrub_stamp":"2021-10-08T19:38:01.760693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:38:01.760693+0000","log_size":4558,"ondisk_log_size":4558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":1.1938455160000001,"stat_sum":{"num_bytes":55836672,"num_objects":852,"num_object_clones":0,"num_object_copies":2556,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":852,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13954,"num_write_kb":473792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.9","version":"90'130","reported_seq":746,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.377569+0000","last_change":"2021-10-08T19:35:20.911809+0000","last_active":"2021-10-08T19:38:30.377569+0000","last_peered":"2021-10-08T19:38:30.377569+0000","last_clean":"2021-10-08T19:38:30.377569+0000","last_became_active":"2021-10-08T19:29:43.634789+0000","last_became_peered":"2021-10-08T19:29:43.634789+0000","last_unstale":"2021-10-08T19:38:30.377569+0000","last_undegraded":"2021-10-08T19:38:30.377569+0000","last_fullsized":"2021-10-08T19:38:30.377569+0000","mapping_epoch":239,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:35:20.911733+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:35:20.911733+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0029675249999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"289'20","reported_seq":515,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.369010+0000","last_change":"2021-10-08T19:37:21.712075+0000","last_active":"2021-10-08T19:38:30.369010+0000","last_peered":"2021-10-08T19:38:30.369010+0000","last_clean":"2021-10-08T19:38:30.369010+0000","last_became_active":"2021-10-08T19:29:40.631807+0000","last_became_peered":"2021-10-08T19:29:40.631807+0000","last_unstale":"2021-10-08T19:38:30.369010+0000","last_undegraded":"2021-10-08T19:38:30.369010+0000","last_fullsized":"2021-10-08T19:38:30.369010+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'20","last_scrub_stamp":"2021-10-08T19:37:21.711953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:37:21.711953+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0046877220000000001,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":276,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.403927+0000","last_change":"2021-10-08T19:38:06.597254+0000","last_active":"2021-10-08T19:38:30.403927+0000","last_peered":"2021-10-08T19:38:30.403927+0000","last_clean":"2021-10-08T19:38:30.403927+0000","last_became_active":"2021-10-08T19:29:40.638988+0000","last_became_peered":"2021-10-08T19:29:40.638988+0000","last_unstale":"2021-10-08T19:38:30.403927+0000","last_undegraded":"2021-10-08T19:38:30.403927+0000","last_fullsized":"2021-10-08T19:38:30.403927+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:06.597140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:38:06.597140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0062006580000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"250'9","reported_seq":631,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:31.086590+0000","last_change":"2021-10-08T19:38:31.086180+0000","last_active":"2021-10-08T19:38:31.086590+0000","last_peered":"2021-10-08T19:38:31.086590+0000","last_clean":"2021-10-08T19:38:31.086590+0000","last_became_active":"2021-10-08T19:21:27.637930+0000","last_became_peered":"2021-10-08T19:21:27.637930+0000","last_unstale":"2021-10-08T19:38:31.086590+0000","last_undegraded":"2021-10-08T19:38:31.086590+0000","last_fullsized":"2021-10-08T19:38:31.086590+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'9","last_scrub_stamp":"2021-10-08T19:38:31.086061+0000","last_deep_scrub":"250'9","last_deep_scrub_stamp":"2021-10-08T19:30:04.239189+0000","last_clean_scrub_stamp":"2021-10-08T19:38:31.086061+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0074221679999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":415,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.369372+0000","last_change":"2021-10-08T19:36:40.486877+0000","last_active":"2021-10-08T19:38:30.369372+0000","last_peered":"2021-10-08T19:38:30.369372+0000","last_clean":"2021-10-08T19:38:30.369372+0000","last_became_active":"2021-10-08T19:28:40.100213+0000","last_became_peered":"2021-10-08T19:28:40.100213+0000","last_unstale":"2021-10-08T19:38:30.369372+0000","last_undegraded":"2021-10-08T19:38:30.369372+0000","last_fullsized":"2021-10-08T19:38:30.369372+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:40.486763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:36:40.486763+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.030070781000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":210,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.383544+0000","last_change":"2021-10-08T19:36:15.769584+0000","last_active":"2021-10-08T19:38:30.383544+0000","last_peered":"2021-10-08T19:38:30.383544+0000","last_clean":"2021-10-08T19:38:30.383544+0000","last_became_active":"2021-10-08T19:29:44.443507+0000","last_became_peered":"2021-10-08T19:29:44.443507+0000","last_unstale":"2021-10-08T19:38:30.383544+0000","last_undegraded":"2021-10-08T19:38:30.383544+0000","last_fullsized":"2021-10-08T19:38:30.383544+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:15.769469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:15.769469+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0068300569999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"426'14040","reported_seq":14125,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:33.433826+0000","last_change":"2021-10-08T19:37:29.999619+0000","last_active":"2021-10-08T19:38:33.433826+0000","last_peered":"2021-10-08T19:38:33.433826+0000","last_clean":"2021-10-08T19:38:33.433826+0000","last_became_active":"2021-10-08T19:35:16.778182+0000","last_became_peered":"2021-10-08T19:35:16.778182+0000","last_unstale":"2021-10-08T19:38:33.433826+0000","last_undegraded":"2021-10-08T19:38:33.433826+0000","last_fullsized":"2021-10-08T19:38:33.433826+0000","mapping_epoch":355,"log_start":"404'10153","ondisk_log_start":"404'10153","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'9671","last_scrub_stamp":"2021-10-08T19:37:29.999513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:37:29.999513+0000","log_size":3887,"ondisk_log_size":3887,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":2.31606253,"stat_sum":{"num_bytes":58064896,"num_objects":886,"num_object_clones":0,"num_object_copies":2658,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":886,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14040,"num_write_kb":477632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,0],"acting":[4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.a","version":"90'130","reported_seq":344,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.370224+0000","last_change":"2021-10-08T19:38:01.240328+0000","last_active":"2021-10-08T19:38:30.370224+0000","last_peered":"2021-10-08T19:38:30.370224+0000","last_clean":"2021-10-08T19:38:30.370224+0000","last_became_active":"2021-10-08T19:37:19.000525+0000","last_became_peered":"2021-10-08T19:37:19.000525+0000","last_unstale":"2021-10-08T19:38:30.370224+0000","last_undegraded":"2021-10-08T19:38:30.370224+0000","last_fullsized":"2021-10-08T19:38:30.370224+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:38:01.240236+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:38:01.240236+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0043514979999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"289'27","reported_seq":158,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.371337+0000","last_change":"2021-10-08T19:38:08.232601+0000","last_active":"2021-10-08T19:38:30.371337+0000","last_peered":"2021-10-08T19:38:30.371337+0000","last_clean":"2021-10-08T19:38:30.371337+0000","last_became_active":"2021-10-08T19:32:45.162914+0000","last_became_peered":"2021-10-08T19:32:45.162914+0000","last_unstale":"2021-10-08T19:38:30.371337+0000","last_undegraded":"2021-10-08T19:38:30.371337+0000","last_fullsized":"2021-10-08T19:38:30.371337+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'27","last_scrub_stamp":"2021-10-08T19:38:08.232495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:38:08.232495+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012973241999999999,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":550,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":277,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.403065+0000","last_change":"2021-10-08T19:36:58.005216+0000","last_active":"2021-10-08T19:38:30.403065+0000","last_peered":"2021-10-08T19:38:30.403065+0000","last_clean":"2021-10-08T19:38:30.403065+0000","last_became_active":"2021-10-08T19:36:58.004540+0000","last_became_peered":"2021-10-08T19:36:58.004540+0000","last_unstale":"2021-10-08T19:38:30.403065+0000","last_undegraded":"2021-10-08T19:38:30.403065+0000","last_fullsized":"2021-10-08T19:38:30.403065+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:19.757349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:30:11.102934+0000","last_clean_scrub_stamp":"2021-10-08T19:35:19.757349+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001709061,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"88'9","reported_seq":619,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.837733+0000","last_change":"2021-10-08T19:37:51.400366+0000","last_active":"2021-10-08T19:38:30.837733+0000","last_peered":"2021-10-08T19:38:30.837733+0000","last_clean":"2021-10-08T19:38:30.837733+0000","last_became_active":"2021-10-08T19:21:27.636432+0000","last_became_peered":"2021-10-08T19:21:27.636432+0000","last_unstale":"2021-10-08T19:38:30.837733+0000","last_undegraded":"2021-10-08T19:38:30.837733+0000","last_fullsized":"2021-10-08T19:38:30.837733+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'9","last_scrub_stamp":"2021-10-08T19:37:51.400280+0000","last_deep_scrub":"88'9","last_deep_scrub_stamp":"2021-10-08T19:23:00.048245+0000","last_clean_scrub_stamp":"2021-10-08T19:37:51.400280+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010321472999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":211,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.403897+0000","last_change":"2021-10-08T19:37:54.590428+0000","last_active":"2021-10-08T19:38:30.403897+0000","last_peered":"2021-10-08T19:38:30.403897+0000","last_clean":"2021-10-08T19:38:30.403897+0000","last_became_active":"2021-10-08T19:37:19.016085+0000","last_became_peered":"2021-10-08T19:37:19.016085+0000","last_unstale":"2021-10-08T19:38:30.403897+0000","last_undegraded":"2021-10-08T19:38:30.403897+0000","last_fullsized":"2021-10-08T19:38:30.403897+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:54.590301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:37:54.590301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.095282983000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"70'5","reported_seq":210,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.377638+0000","last_change":"2021-10-08T19:36:08.760775+0000","last_active":"2021-10-08T19:38:30.377638+0000","last_peered":"2021-10-08T19:38:30.377638+0000","last_clean":"2021-10-08T19:38:30.377638+0000","last_became_active":"2021-10-08T19:29:40.639786+0000","last_became_peered":"2021-10-08T19:29:40.639786+0000","last_unstale":"2021-10-08T19:38:30.377638+0000","last_undegraded":"2021-10-08T19:38:30.377638+0000","last_fullsized":"2021-10-08T19:38:30.377638+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:36:08.760670+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2021-10-08T19:36:08.760670+0000","last_clean_scrub_stamp":"2021-10-08T19:36:08.760670+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011613982,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.0","version":"426'13830","reported_seq":13915,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:33.673805+0000","last_change":"2021-10-08T19:38:05.203726+0000","last_active":"2021-10-08T19:38:33.673805+0000","last_peered":"2021-10-08T19:38:33.673805+0000","last_clean":"2021-10-08T19:38:33.673805+0000","last_became_active":"2021-10-08T19:35:16.783489+0000","last_became_peered":"2021-10-08T19:35:16.783489+0000","last_unstale":"2021-10-08T19:38:33.673805+0000","last_undegraded":"2021-10-08T19:38:33.673805+0000","last_fullsized":"2021-10-08T19:38:33.673805+0000","mapping_epoch":355,"log_start":"402'9515","ondisk_log_start":"402'9515","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"415'11964","last_scrub_stamp":"2021-10-08T19:38:05.203625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:38:05.203625+0000","log_size":4315,"ondisk_log_size":4315,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.87608043800000002,"stat_sum":{"num_bytes":60424192,"num_objects":922,"num_object_clones":0,"num_object_copies":2766,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":922,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13830,"num_write_kb":472064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4],"acting":[6,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"289'19","reported_seq":575,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.369035+0000","last_change":"2021-10-08T19:37:59.252887+0000","last_active":"2021-10-08T19:38:30.369035+0000","last_peered":"2021-10-08T19:38:30.369035+0000","last_clean":"2021-10-08T19:38:30.369035+0000","last_became_active":"2021-10-08T19:31:51.677509+0000","last_became_peered":"2021-10-08T19:31:51.677509+0000","last_unstale":"2021-10-08T19:38:30.369035+0000","last_undegraded":"2021-10-08T19:38:30.369035+0000","last_fullsized":"2021-10-08T19:38:30.369035+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:35:34.394820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:35:34.394820+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0061638159999999999,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":770,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":433,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.378581+0000","last_change":"2021-10-08T19:36:58.001988+0000","last_active":"2021-10-08T19:38:30.378581+0000","last_peered":"2021-10-08T19:38:30.378581+0000","last_clean":"2021-10-08T19:38:30.378581+0000","last_became_active":"2021-10-08T19:36:58.001610+0000","last_became_peered":"2021-10-08T19:36:58.001610+0000","last_unstale":"2021-10-08T19:38:30.378581+0000","last_undegraded":"2021-10-08T19:38:30.378581+0000","last_fullsized":"2021-10-08T19:38:30.378581+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:01.984068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:01.984068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0028891239999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":111,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.367618+0000","last_change":"2021-10-08T19:37:18.997786+0000","last_active":"2021-10-08T19:38:30.367618+0000","last_peered":"2021-10-08T19:38:30.367618+0000","last_clean":"2021-10-08T19:38:30.367618+0000","last_became_active":"2021-10-08T19:37:18.997446+0000","last_became_peered":"2021-10-08T19:37:18.997446+0000","last_unstale":"2021-10-08T19:38:30.367618+0000","last_undegraded":"2021-10-08T19:38:30.367618+0000","last_fullsized":"2021-10-08T19:38:30.367618+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:41.852519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:36:41.852519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0033939769999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":216,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.379787+0000","last_change":"2021-10-08T19:36:43.015897+0000","last_active":"2021-10-08T19:38:30.379787+0000","last_peered":"2021-10-08T19:38:30.379787+0000","last_clean":"2021-10-08T19:38:30.379787+0000","last_became_active":"2021-10-08T19:29:40.638099+0000","last_became_peered":"2021-10-08T19:29:40.638099+0000","last_unstale":"2021-10-08T19:38:30.379787+0000","last_undegraded":"2021-10-08T19:38:30.379787+0000","last_fullsized":"2021-10-08T19:38:30.379787+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:43.015835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:17.422176+0000","last_clean_scrub_stamp":"2021-10-08T19:36:43.015835+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003426634,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":354,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.366926+0000","last_change":"2021-10-08T19:38:03.310863+0000","last_active":"2021-10-08T19:38:30.366926+0000","last_peered":"2021-10-08T19:38:30.366926+0000","last_clean":"2021-10-08T19:38:30.366926+0000","last_became_active":"2021-10-08T19:24:13.506602+0000","last_became_peered":"2021-10-08T19:24:13.506602+0000","last_unstale":"2021-10-08T19:38:30.366926+0000","last_undegraded":"2021-10-08T19:38:30.366926+0000","last_fullsized":"2021-10-08T19:38:30.366926+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:03.310761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:38:03.310761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0095709139999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"426'13957","reported_seq":14045,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:33.684866+0000","last_change":"2021-10-08T19:37:21.628788+0000","last_active":"2021-10-08T19:38:33.684866+0000","last_peered":"2021-10-08T19:38:33.684866+0000","last_clean":"2021-10-08T19:38:33.684866+0000","last_became_active":"2021-10-08T19:35:17.124842+0000","last_became_peered":"2021-10-08T19:35:17.124842+0000","last_unstale":"2021-10-08T19:38:33.684866+0000","last_undegraded":"2021-10-08T19:38:33.684866+0000","last_fullsized":"2021-10-08T19:38:33.684866+0000","mapping_epoch":355,"log_start":"402'9584","ondisk_log_start":"402'9584","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"400'9090","last_scrub_stamp":"2021-10-08T19:37:21.628686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:37:21.628686+0000","log_size":4373,"ondisk_log_size":4373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":2.5331604400000001,"stat_sum":{"num_bytes":60162048,"num_objects":918,"num_object_clones":0,"num_object_copies":2754,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":918,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13898,"num_write_kb":474112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.4","version":"90'130","reported_seq":540,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.379699+0000","last_change":"2021-10-08T19:36:05.771481+0000","last_active":"2021-10-08T19:38:30.379699+0000","last_peered":"2021-10-08T19:38:30.379699+0000","last_clean":"2021-10-08T19:38:30.379699+0000","last_became_active":"2021-10-08T19:29:43.636733+0000","last_became_peered":"2021-10-08T19:29:43.636733+0000","last_unstale":"2021-10-08T19:38:30.379699+0000","last_undegraded":"2021-10-08T19:38:30.379699+0000","last_fullsized":"2021-10-08T19:38:30.379699+0000","mapping_epoch":239,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:36:05.771344+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:36:05.771344+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014695206000000001,"stat_sum":{"num_bytes":327680,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"238'13","reported_seq":333,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:32.165299+0000","last_change":"2021-10-08T19:38:32.165269+0000","last_active":"2021-10-08T19:38:32.165299+0000","last_peered":"2021-10-08T19:38:32.165299+0000","last_clean":"2021-10-08T19:38:32.165299+0000","last_became_active":"2021-10-08T19:29:40.640248+0000","last_became_peered":"2021-10-08T19:29:40.640248+0000","last_unstale":"2021-10-08T19:38:32.165299+0000","last_undegraded":"2021-10-08T19:38:32.165299+0000","last_fullsized":"2021-10-08T19:38:32.165299+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"238'13","last_scrub_stamp":"2021-10-08T19:38:32.165194+0000","last_deep_scrub":"91'9","last_deep_scrub_stamp":"2021-10-08T19:23:32.329475+0000","last_clean_scrub_stamp":"2021-10-08T19:38:32.165194+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0056171720000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"289'28","reported_seq":493,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.367134+0000","last_change":"2021-10-08T19:36:16.219370+0000","last_active":"2021-10-08T19:38:30.367134+0000","last_peered":"2021-10-08T19:38:30.367134+0000","last_clean":"2021-10-08T19:38:30.367134+0000","last_became_active":"2021-10-08T19:24:25.098743+0000","last_became_peered":"2021-10-08T19:24:25.098743+0000","last_unstale":"2021-10-08T19:38:30.367134+0000","last_undegraded":"2021-10-08T19:38:30.367134+0000","last_fullsized":"2021-10-08T19:38:30.367134+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'28","last_scrub_stamp":"2021-10-08T19:36:16.219258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:16.219258+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0095071070000000008,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":42,"num_read_kb":35,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":364,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.383409+0000","last_change":"2021-10-08T19:37:45.830300+0000","last_active":"2021-10-08T19:38:30.383409+0000","last_peered":"2021-10-08T19:38:30.383409+0000","last_clean":"2021-10-08T19:38:30.383409+0000","last_became_active":"2021-10-08T19:37:45.829953+0000","last_became_peered":"2021-10-08T19:37:45.829953+0000","last_unstale":"2021-10-08T19:38:30.383409+0000","last_undegraded":"2021-10-08T19:38:30.383409+0000","last_fullsized":"2021-10-08T19:38:30.383409+0000","mapping_epoch":407,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":408,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:12.643664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:12.643664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0025959149999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,2],"acting":[6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":422,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.377093+0000","last_change":"2021-10-08T19:37:52.836635+0000","last_active":"2021-10-08T19:38:30.377093+0000","last_peered":"2021-10-08T19:38:30.377093+0000","last_clean":"2021-10-08T19:38:30.377093+0000","last_became_active":"2021-10-08T19:24:25.094848+0000","last_became_peered":"2021-10-08T19:24:25.094848+0000","last_unstale":"2021-10-08T19:38:30.377093+0000","last_undegraded":"2021-10-08T19:38:30.377093+0000","last_fullsized":"2021-10-08T19:38:30.377093+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:52.836518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:37:52.836518+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.079698321000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":377,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.379348+0000","last_change":"2021-10-08T19:37:51.046331+0000","last_active":"2021-10-08T19:38:30.379348+0000","last_peered":"2021-10-08T19:38:30.379348+0000","last_clean":"2021-10-08T19:38:30.379348+0000","last_became_active":"2021-10-08T19:28:40.132751+0000","last_became_peered":"2021-10-08T19:28:40.132751+0000","last_unstale":"2021-10-08T19:38:30.379348+0000","last_undegraded":"2021-10-08T19:38:30.379348+0000","last_fullsized":"2021-10-08T19:38:30.379348+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:51.046234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:37:51.046234+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0044534300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.e","version":"426'13930","reported_seq":14015,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:33.428178+0000","last_change":"2021-10-08T19:36:52.050640+0000","last_active":"2021-10-08T19:38:33.428178+0000","last_peered":"2021-10-08T19:38:33.428178+0000","last_clean":"2021-10-08T19:38:33.428178+0000","last_became_active":"2021-10-08T19:35:16.776024+0000","last_became_peered":"2021-10-08T19:35:16.776024+0000","last_unstale":"2021-10-08T19:38:33.428178+0000","last_undegraded":"2021-10-08T19:38:33.428178+0000","last_fullsized":"2021-10-08T19:38:33.428178+0000","mapping_epoch":355,"log_start":"404'10111","ondisk_log_start":"404'10111","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"388'7171","last_scrub_stamp":"2021-10-08T19:36:52.050522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:36:52.050522+0000","log_size":3819,"ondisk_log_size":3819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":2.5548819749999998,"stat_sum":{"num_bytes":58064896,"num_objects":886,"num_object_clones":0,"num_object_copies":2658,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":886,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13930,"num_write_kb":474112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"90'130","reported_seq":580,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.367203+0000","last_change":"2021-10-08T19:36:43.505866+0000","last_active":"2021-10-08T19:38:30.367203+0000","last_peered":"2021-10-08T19:38:30.367203+0000","last_clean":"2021-10-08T19:38:30.367203+0000","last_became_active":"2021-10-08T19:27:26.590651+0000","last_became_peered":"2021-10-08T19:27:26.590651+0000","last_unstale":"2021-10-08T19:38:30.367203+0000","last_undegraded":"2021-10-08T19:38:30.367203+0000","last_fullsized":"2021-10-08T19:38:30.367203+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:36:43.505746+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:32:14.582883+0000","last_clean_scrub_stamp":"2021-10-08T19:36:43.505746+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003205388,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":417,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.367329+0000","last_change":"2021-10-08T19:36:42.480557+0000","last_active":"2021-10-08T19:38:30.367329+0000","last_peered":"2021-10-08T19:38:30.367329+0000","last_clean":"2021-10-08T19:38:30.367329+0000","last_became_active":"2021-10-08T19:29:40.639405+0000","last_became_peered":"2021-10-08T19:29:40.639405+0000","last_unstale":"2021-10-08T19:38:30.367329+0000","last_undegraded":"2021-10-08T19:38:30.367329+0000","last_fullsized":"2021-10-08T19:38:30.367329+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:42.480429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:36:42.480429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0070932640000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"289'30","reported_seq":252,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.377442+0000","last_change":"2021-10-08T19:37:55.431244+0000","last_active":"2021-10-08T19:38:30.377442+0000","last_peered":"2021-10-08T19:38:30.377442+0000","last_clean":"2021-10-08T19:38:30.377442+0000","last_became_active":"2021-10-08T19:29:40.635007+0000","last_became_peered":"2021-10-08T19:29:40.635007+0000","last_unstale":"2021-10-08T19:38:30.377442+0000","last_undegraded":"2021-10-08T19:38:30.377442+0000","last_fullsized":"2021-10-08T19:38:30.377442+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'30","last_scrub_stamp":"2021-10-08T19:37:55.431161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:37:55.431161+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0042801929999999998,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":51,"num_read_kb":39,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":253,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.404726+0000","last_change":"2021-10-08T19:36:58.014127+0000","last_active":"2021-10-08T19:38:30.404726+0000","last_peered":"2021-10-08T19:38:30.404726+0000","last_clean":"2021-10-08T19:38:30.404726+0000","last_became_active":"2021-10-08T19:36:58.013501+0000","last_became_peered":"2021-10-08T19:36:58.013501+0000","last_unstale":"2021-10-08T19:38:30.404726+0000","last_undegraded":"2021-10-08T19:38:30.404726+0000","last_fullsized":"2021-10-08T19:38:30.404726+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:50.752866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:07.710367+0000","last_clean_scrub_stamp":"2021-10-08T19:34:50.752866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013659034,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":415,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.368037+0000","last_change":"2021-10-08T19:37:55.342916+0000","last_active":"2021-10-08T19:38:30.368037+0000","last_peered":"2021-10-08T19:38:30.368037+0000","last_clean":"2021-10-08T19:38:30.368037+0000","last_became_active":"2021-10-08T19:29:40.638253+0000","last_became_peered":"2021-10-08T19:29:40.638253+0000","last_unstale":"2021-10-08T19:38:30.368037+0000","last_undegraded":"2021-10-08T19:38:30.368037+0000","last_fullsized":"2021-10-08T19:38:30.368037+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:55.342809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:37:55.342809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0074854370000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":210,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.385965+0000","last_change":"2021-10-08T19:36:10.804434+0000","last_active":"2021-10-08T19:38:30.385965+0000","last_peered":"2021-10-08T19:38:30.385965+0000","last_clean":"2021-10-08T19:38:30.385965+0000","last_became_active":"2021-10-08T19:29:40.634579+0000","last_became_peered":"2021-10-08T19:29:40.634579+0000","last_unstale":"2021-10-08T19:38:30.385965+0000","last_undegraded":"2021-10-08T19:38:30.385965+0000","last_fullsized":"2021-10-08T19:38:30.385965+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:10.804325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:10.804325+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0063916950000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.d","version":"426'13714","reported_seq":13800,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:33.658961+0000","last_change":"2021-10-08T19:36:48.787555+0000","last_active":"2021-10-08T19:38:33.658961+0000","last_peered":"2021-10-08T19:38:33.658961+0000","last_clean":"2021-10-08T19:38:33.658961+0000","last_became_active":"2021-10-08T19:35:16.782695+0000","last_became_peered":"2021-10-08T19:35:16.782695+0000","last_unstale":"2021-10-08T19:38:33.658961+0000","last_undegraded":"2021-10-08T19:38:33.658961+0000","last_fullsized":"2021-10-08T19:38:33.658961+0000","mapping_epoch":355,"log_start":"402'9332","ondisk_log_start":"402'9332","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"387'6844","last_scrub_stamp":"2021-10-08T19:36:48.784582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:36:48.784582+0000","log_size":4382,"ondisk_log_size":4382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":2.9044785690000001,"stat_sum":{"num_bytes":59179032,"num_objects":904,"num_object_clones":0,"num_object_copies":2712,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":904,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13714,"num_write_kb":467713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"90'130","reported_seq":515,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.380524+0000","last_change":"2021-10-08T19:36:01.675001+0000","last_active":"2021-10-08T19:38:30.380524+0000","last_peered":"2021-10-08T19:38:30.380524+0000","last_clean":"2021-10-08T19:38:30.380524+0000","last_became_active":"2021-10-08T19:30:00.643797+0000","last_became_peered":"2021-10-08T19:30:00.643797+0000","last_unstale":"2021-10-08T19:38:30.380524+0000","last_undegraded":"2021-10-08T19:38:30.380524+0000","last_fullsized":"2021-10-08T19:38:30.380524+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:36:01.674904+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:36:01.674904+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.072145927999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":352,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.380900+0000","last_change":"2021-10-08T19:36:00.599933+0000","last_active":"2021-10-08T19:38:30.380900+0000","last_peered":"2021-10-08T19:38:30.380900+0000","last_clean":"2021-10-08T19:38:30.380900+0000","last_became_active":"2021-10-08T19:24:25.095389+0000","last_became_peered":"2021-10-08T19:24:25.095389+0000","last_unstale":"2021-10-08T19:38:30.380900+0000","last_undegraded":"2021-10-08T19:38:30.380900+0000","last_fullsized":"2021-10-08T19:38:30.380900+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:00.599845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:36:00.599845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0065529969999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"289'29","reported_seq":453,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.377807+0000","last_change":"2021-10-08T19:36:05.122735+0000","last_active":"2021-10-08T19:38:30.377807+0000","last_peered":"2021-10-08T19:38:30.377807+0000","last_clean":"2021-10-08T19:38:30.377807+0000","last_became_active":"2021-10-08T19:21:25.741812+0000","last_became_peered":"2021-10-08T19:21:25.741812+0000","last_unstale":"2021-10-08T19:38:30.377807+0000","last_undegraded":"2021-10-08T19:38:30.377807+0000","last_fullsized":"2021-10-08T19:38:30.377807+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'29","last_scrub_stamp":"2021-10-08T19:36:05.122593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:05.122593+0000","log_size":29,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0069217020000000001,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":54,"num_read_kb":40,"num_write":32,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"328'2","reported_seq":423,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.377300+0000","last_change":"2021-10-08T19:36:58.000426+0000","last_active":"2021-10-08T19:38:30.377300+0000","last_peered":"2021-10-08T19:38:30.377300+0000","last_clean":"2021-10-08T19:38:30.377300+0000","last_became_active":"2021-10-08T19:36:58.000171+0000","last_became_peered":"2021-10-08T19:36:58.000171+0000","last_unstale":"2021-10-08T19:38:30.377300+0000","last_undegraded":"2021-10-08T19:38:30.377300+0000","last_fullsized":"2021-10-08T19:38:30.377300+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"328'2","last_scrub_stamp":"2021-10-08T19:36:03.954613+0000","last_deep_scrub":"328'2","last_deep_scrub_stamp":"2021-10-08T19:33:29.990395+0000","last_clean_scrub_stamp":"2021-10-08T19:36:03.954613+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0074631530000000001,"stat_sum":{"num_bytes":179,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":250,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.402854+0000","last_change":"2021-10-08T19:37:55.594168+0000","last_active":"2021-10-08T19:38:30.402854+0000","last_peered":"2021-10-08T19:38:30.402854+0000","last_clean":"2021-10-08T19:38:30.402854+0000","last_became_active":"2021-10-08T19:28:40.140876+0000","last_became_peered":"2021-10-08T19:28:40.140876+0000","last_unstale":"2021-10-08T19:38:30.402854+0000","last_undegraded":"2021-10-08T19:38:30.402854+0000","last_fullsized":"2021-10-08T19:38:30.402854+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:55.594051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:37:55.594051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.083118095000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"70'5","reported_seq":250,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.403622+0000","last_change":"2021-10-08T19:35:30.660394+0000","last_active":"2021-10-08T19:38:30.403622+0000","last_peered":"2021-10-08T19:38:30.403622+0000","last_clean":"2021-10-08T19:38:30.403622+0000","last_became_active":"2021-10-08T19:28:40.150503+0000","last_became_peered":"2021-10-08T19:28:40.150503+0000","last_unstale":"2021-10-08T19:38:30.403622+0000","last_undegraded":"2021-10-08T19:38:30.403622+0000","last_fullsized":"2021-10-08T19:38:30.403622+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:35:30.660285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:30.660285+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0035933829999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.8","version":"426'13804","reported_seq":13889,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:33.634171+0000","last_change":"2021-10-08T19:38:05.147128+0000","last_active":"2021-10-08T19:38:33.634171+0000","last_peered":"2021-10-08T19:38:33.634171+0000","last_clean":"2021-10-08T19:38:33.634171+0000","last_became_active":"2021-10-08T19:35:16.778100+0000","last_became_peered":"2021-10-08T19:35:16.778100+0000","last_unstale":"2021-10-08T19:38:33.634171+0000","last_undegraded":"2021-10-08T19:38:33.634171+0000","last_fullsized":"2021-10-08T19:38:33.634171+0000","mapping_epoch":355,"log_start":"402'9345","ondisk_log_start":"402'9345","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"415'11820","last_scrub_stamp":"2021-10-08T19:38:05.147000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:38:05.147000+0000","log_size":4459,"ondisk_log_size":4459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":1.12989524,"stat_sum":{"num_bytes":61734912,"num_objects":942,"num_object_clones":0,"num_object_copies":2826,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":942,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13804,"num_write_kb":471872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7],"acting":[0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"90'130","reported_seq":551,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.403205+0000","last_change":"2021-10-08T19:36:09.840616+0000","last_active":"2021-10-08T19:38:30.403205+0000","last_peered":"2021-10-08T19:38:30.403205+0000","last_clean":"2021-10-08T19:38:30.403205+0000","last_became_active":"2021-10-08T19:28:43.178371+0000","last_became_peered":"2021-10-08T19:28:43.178371+0000","last_unstale":"2021-10-08T19:38:30.403205+0000","last_undegraded":"2021-10-08T19:38:30.403205+0000","last_fullsized":"2021-10-08T19:38:30.403205+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:36:09.840508+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:34:13.653248+0000","last_clean_scrub_stamp":"2021-10-08T19:36:09.840508+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0067520610000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":170,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:32.463258+0000","last_change":"2021-10-08T19:38:32.463211+0000","last_active":"2021-10-08T19:38:32.463258+0000","last_peered":"2021-10-08T19:38:32.463258+0000","last_clean":"2021-10-08T19:38:32.463258+0000","last_became_active":"2021-10-08T19:31:22.783759+0000","last_became_peered":"2021-10-08T19:31:22.783759+0000","last_unstale":"2021-10-08T19:38:32.463258+0000","last_undegraded":"2021-10-08T19:38:32.463258+0000","last_fullsized":"2021-10-08T19:38:32.463258+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:32.463096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:38:32.463096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.030313300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"289'24","reported_seq":505,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.379511+0000","last_change":"2021-10-08T19:36:06.098172+0000","last_active":"2021-10-08T19:38:30.379511+0000","last_peered":"2021-10-08T19:38:30.379511+0000","last_clean":"2021-10-08T19:38:30.379511+0000","last_became_active":"2021-10-08T19:32:45.154743+0000","last_became_peered":"2021-10-08T19:32:45.154743+0000","last_unstale":"2021-10-08T19:38:30.379511+0000","last_undegraded":"2021-10-08T19:38:30.379511+0000","last_fullsized":"2021-10-08T19:38:30.379511+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'24","last_scrub_stamp":"2021-10-08T19:36:06.098078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:06.098078+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0071628120000000002,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":30,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":410,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.370322+0000","last_change":"2021-10-08T19:37:51.166923+0000","last_active":"2021-10-08T19:38:30.370322+0000","last_peered":"2021-10-08T19:38:30.370322+0000","last_clean":"2021-10-08T19:38:30.370322+0000","last_became_active":"2021-10-08T19:36:58.012034+0000","last_became_peered":"2021-10-08T19:36:58.012034+0000","last_unstale":"2021-10-08T19:38:30.370322+0000","last_undegraded":"2021-10-08T19:38:30.370322+0000","last_fullsized":"2021-10-08T19:38:30.370322+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:51.166846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:32.922694+0000","last_clean_scrub_stamp":"2021-10-08T19:37:51.166846+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0061294460000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":440,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.377908+0000","last_change":"2021-10-08T19:37:59.963810+0000","last_active":"2021-10-08T19:38:30.377908+0000","last_peered":"2021-10-08T19:38:30.377908+0000","last_clean":"2021-10-08T19:38:30.377908+0000","last_became_active":"2021-10-08T19:29:40.632010+0000","last_became_peered":"2021-10-08T19:29:40.632010+0000","last_unstale":"2021-10-08T19:38:30.377908+0000","last_undegraded":"2021-10-08T19:38:30.377908+0000","last_fullsized":"2021-10-08T19:38:30.377908+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:59.963721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:37:59.963721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0066016690000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":152,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.403340+0000","last_change":"2021-10-08T19:36:11.789864+0000","last_active":"2021-10-08T19:38:30.403340+0000","last_peered":"2021-10-08T19:38:30.403340+0000","last_clean":"2021-10-08T19:38:30.403340+0000","last_became_active":"2021-10-08T19:31:51.673821+0000","last_became_peered":"2021-10-08T19:31:51.673821+0000","last_unstale":"2021-10-08T19:38:30.403340+0000","last_undegraded":"2021-10-08T19:38:30.403340+0000","last_fullsized":"2021-10-08T19:38:30.403340+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:11.789757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:21.644827+0000","last_clean_scrub_stamp":"2021-10-08T19:36:11.789757+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0099411570000000008,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"426'13592","reported_seq":13679,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:33.715651+0000","last_change":"2021-10-08T19:37:18.182651+0000","last_active":"2021-10-08T19:38:33.715651+0000","last_peered":"2021-10-08T19:38:33.715651+0000","last_clean":"2021-10-08T19:38:33.715651+0000","last_became_active":"2021-10-08T19:35:16.784654+0000","last_became_peered":"2021-10-08T19:35:16.784654+0000","last_unstale":"2021-10-08T19:38:33.715651+0000","last_undegraded":"2021-10-08T19:38:33.715651+0000","last_fullsized":"2021-10-08T19:38:33.715651+0000","mapping_epoch":355,"log_start":"402'9239","ondisk_log_start":"402'9239","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"397'8632","last_scrub_stamp":"2021-10-08T19:37:18.182547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:37:18.182547+0000","log_size":4353,"ondisk_log_size":4353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":2.0639313760000002,"stat_sum":{"num_bytes":56623104,"num_objects":864,"num_object_clones":0,"num_object_copies":2592,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":864,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13592,"num_write_kb":462592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0],"acting":[6,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":400,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.377408+0000","last_change":"2021-10-08T19:37:22.697805+0000","last_active":"2021-10-08T19:38:30.377408+0000","last_peered":"2021-10-08T19:38:30.377408+0000","last_clean":"2021-10-08T19:38:30.377408+0000","last_became_active":"2021-10-08T19:21:27.636086+0000","last_became_peered":"2021-10-08T19:21:27.636086+0000","last_unstale":"2021-10-08T19:38:30.377408+0000","last_undegraded":"2021-10-08T19:38:30.377408+0000","last_fullsized":"2021-10-08T19:38:30.377408+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:22.697722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:37:22.697722+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010100266,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"289'26","reported_seq":386,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.380392+0000","last_change":"2021-10-08T19:36:43.949273+0000","last_active":"2021-10-08T19:38:30.380392+0000","last_peered":"2021-10-08T19:38:30.380392+0000","last_clean":"2021-10-08T19:38:30.380392+0000","last_became_active":"2021-10-08T19:24:25.100384+0000","last_became_peered":"2021-10-08T19:24:25.100384+0000","last_unstale":"2021-10-08T19:38:30.380392+0000","last_undegraded":"2021-10-08T19:38:30.380392+0000","last_fullsized":"2021-10-08T19:38:30.380392+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'26","last_scrub_stamp":"2021-10-08T19:36:43.949161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:43.949161+0000","log_size":26,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011337099,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":42,"num_read_kb":32,"num_write":25,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"90'130","reported_seq":713,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.378506+0000","last_change":"2021-10-08T19:36:09.855513+0000","last_active":"2021-10-08T19:38:30.378506+0000","last_peered":"2021-10-08T19:38:30.378506+0000","last_clean":"2021-10-08T19:38:30.378506+0000","last_became_active":"2021-10-08T19:27:22.607289+0000","last_became_peered":"2021-10-08T19:27:22.607289+0000","last_unstale":"2021-10-08T19:38:30.378506+0000","last_undegraded":"2021-10-08T19:38:30.378506+0000","last_fullsized":"2021-10-08T19:38:30.378506+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:36:09.855393+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:36:09.855393+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0065522590000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":418,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.369625+0000","last_change":"2021-10-08T19:38:09.230388+0000","last_active":"2021-10-08T19:38:30.369625+0000","last_peered":"2021-10-08T19:38:30.369625+0000","last_clean":"2021-10-08T19:38:30.369625+0000","last_became_active":"2021-10-08T19:37:45.837378+0000","last_became_peered":"2021-10-08T19:37:45.837378+0000","last_unstale":"2021-10-08T19:38:30.369625+0000","last_undegraded":"2021-10-08T19:38:30.369625+0000","last_fullsized":"2021-10-08T19:38:30.369625+0000","mapping_epoch":407,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":408,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:09.230297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:38:09.230297+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0072500209999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":210,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.378392+0000","last_change":"2021-10-08T19:35:33.861695+0000","last_active":"2021-10-08T19:38:30.378392+0000","last_peered":"2021-10-08T19:38:30.378392+0000","last_clean":"2021-10-08T19:38:30.378392+0000","last_became_active":"2021-10-08T19:29:40.638774+0000","last_became_peered":"2021-10-08T19:29:40.638774+0000","last_unstale":"2021-10-08T19:38:30.378392+0000","last_undegraded":"2021-10-08T19:38:30.378392+0000","last_fullsized":"2021-10-08T19:38:30.378392+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:33.861554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:33.861554+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011946132999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":239,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.386145+0000","last_change":"2021-10-08T19:37:19.006887+0000","last_active":"2021-10-08T19:38:30.386145+0000","last_peered":"2021-10-08T19:38:30.386145+0000","last_clean":"2021-10-08T19:38:30.386145+0000","last_became_active":"2021-10-08T19:37:19.006459+0000","last_became_peered":"2021-10-08T19:37:19.006459+0000","last_unstale":"2021-10-08T19:38:30.386145+0000","last_undegraded":"2021-10-08T19:38:30.386145+0000","last_fullsized":"2021-10-08T19:38:30.386145+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:24.690591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:32:15.872860+0000","last_clean_scrub_stamp":"2021-10-08T19:35:24.690591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.023009359,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4],"acting":[3,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"426'13945","reported_seq":14038,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:33.887956+0000","last_change":"2021-10-08T19:37:25.988228+0000","last_active":"2021-10-08T19:38:33.887956+0000","last_peered":"2021-10-08T19:38:33.887956+0000","last_clean":"2021-10-08T19:38:33.887956+0000","last_became_active":"2021-10-08T19:37:19.009172+0000","last_became_peered":"2021-10-08T19:37:19.009172+0000","last_unstale":"2021-10-08T19:38:33.887956+0000","last_undegraded":"2021-10-08T19:38:33.887956+0000","last_fullsized":"2021-10-08T19:38:33.887956+0000","mapping_epoch":397,"log_start":"396'8715","ondisk_log_start":"396'8715","created":355,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'9371","last_scrub_stamp":"2021-10-08T19:37:25.988130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:37:25.988130+0000","log_size":5230,"ondisk_log_size":5230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":1.9691678000000001,"stat_sum":{"num_bytes":60882944,"num_objects":929,"num_object_clones":0,"num_object_copies":2787,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":929,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13945,"num_write_kb":475968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"90'130","reported_seq":721,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.376767+0000","last_change":"2021-10-08T19:36:11.798375+0000","last_active":"2021-10-08T19:38:30.376767+0000","last_peered":"2021-10-08T19:38:30.376767+0000","last_clean":"2021-10-08T19:38:30.376767+0000","last_became_active":"2021-10-08T19:27:26.591250+0000","last_became_peered":"2021-10-08T19:27:26.591250+0000","last_unstale":"2021-10-08T19:38:30.376767+0000","last_undegraded":"2021-10-08T19:38:30.376767+0000","last_fullsized":"2021-10-08T19:38:30.376767+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:36:11.798245+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:36:11.798245+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013110805,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":410,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.371174+0000","last_change":"2021-10-08T19:36:57.860840+0000","last_active":"2021-10-08T19:38:30.371174+0000","last_peered":"2021-10-08T19:38:30.371174+0000","last_clean":"2021-10-08T19:38:30.371174+0000","last_became_active":"2021-10-08T19:21:27.637875+0000","last_became_peered":"2021-10-08T19:21:27.637875+0000","last_unstale":"2021-10-08T19:38:30.371174+0000","last_undegraded":"2021-10-08T19:38:30.371174+0000","last_fullsized":"2021-10-08T19:38:30.371174+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:57.860724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:20.092069+0000","last_clean_scrub_stamp":"2021-10-08T19:36:57.860724+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010614343,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"289'17","reported_seq":164,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.404893+0000","last_change":"2021-10-08T19:38:05.629718+0000","last_active":"2021-10-08T19:38:30.404893+0000","last_peered":"2021-10-08T19:38:30.404893+0000","last_clean":"2021-10-08T19:38:30.404893+0000","last_became_active":"2021-10-08T19:31:51.674965+0000","last_became_peered":"2021-10-08T19:31:51.674965+0000","last_unstale":"2021-10-08T19:38:30.404893+0000","last_undegraded":"2021-10-08T19:38:30.404893+0000","last_fullsized":"2021-10-08T19:38:30.404893+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'17","last_scrub_stamp":"2021-10-08T19:38:05.629630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:38:05.629630+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0080242690000000005,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":23,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":990,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":441,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.372709+0000","last_change":"2021-10-08T19:37:48.098527+0000","last_active":"2021-10-08T19:38:30.372709+0000","last_peered":"2021-10-08T19:38:30.372709+0000","last_clean":"2021-10-08T19:38:30.372709+0000","last_became_active":"2021-10-08T19:36:58.015216+0000","last_became_peered":"2021-10-08T19:36:58.015216+0000","last_unstale":"2021-10-08T19:38:30.372709+0000","last_undegraded":"2021-10-08T19:38:30.372709+0000","last_fullsized":"2021-10-08T19:38:30.372709+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:48.098449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:37:48.098449+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0092712760000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"70'5","reported_seq":254,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.404728+0000","last_change":"2021-10-08T19:36:44.490475+0000","last_active":"2021-10-08T19:38:30.404728+0000","last_peered":"2021-10-08T19:38:30.404728+0000","last_clean":"2021-10-08T19:38:30.404728+0000","last_became_active":"2021-10-08T19:28:40.148054+0000","last_became_peered":"2021-10-08T19:28:40.148054+0000","last_unstale":"2021-10-08T19:38:30.404728+0000","last_undegraded":"2021-10-08T19:38:30.404728+0000","last_fullsized":"2021-10-08T19:38:30.404728+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:36:44.490372+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2021-10-08T19:34:18.630378+0000","last_clean_scrub_stamp":"2021-10-08T19:36:44.490372+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0089419340000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":428,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.377214+0000","last_change":"2021-10-08T19:35:30.916430+0000","last_active":"2021-10-08T19:38:30.377214+0000","last_peered":"2021-10-08T19:38:30.377214+0000","last_clean":"2021-10-08T19:38:30.377214+0000","last_became_active":"2021-10-08T19:29:40.652528+0000","last_became_peered":"2021-10-08T19:29:40.652528+0000","last_unstale":"2021-10-08T19:38:30.377214+0000","last_undegraded":"2021-10-08T19:38:30.377214+0000","last_fullsized":"2021-10-08T19:38:30.377214+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:30.916326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:35:30.916326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.048993430999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.a","version":"426'13906","reported_seq":13991,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:33.695439+0000","last_change":"2021-10-08T19:37:59.309373+0000","last_active":"2021-10-08T19:38:33.695439+0000","last_peered":"2021-10-08T19:38:33.695439+0000","last_clean":"2021-10-08T19:38:33.695439+0000","last_became_active":"2021-10-08T19:35:16.782677+0000","last_became_peered":"2021-10-08T19:35:16.782677+0000","last_unstale":"2021-10-08T19:38:33.695439+0000","last_undegraded":"2021-10-08T19:38:33.695439+0000","last_fullsized":"2021-10-08T19:38:33.695439+0000","mapping_epoch":355,"log_start":"402'9538","ondisk_log_start":"402'9538","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"413'11586","last_scrub_stamp":"2021-10-08T19:37:59.309296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:37:59.309296+0000","log_size":4368,"ondisk_log_size":4368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":1.0725495869999999,"stat_sum":{"num_bytes":61603840,"num_objects":940,"num_object_clones":0,"num_object_copies":2820,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":940,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13906,"num_write_kb":475072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"90'130","reported_seq":343,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.377823+0000","last_change":"2021-10-08T19:37:19.033103+0000","last_active":"2021-10-08T19:38:30.377823+0000","last_peered":"2021-10-08T19:38:30.377823+0000","last_clean":"2021-10-08T19:38:30.377823+0000","last_became_active":"2021-10-08T19:37:19.032630+0000","last_became_peered":"2021-10-08T19:37:19.032630+0000","last_unstale":"2021-10-08T19:38:30.377823+0000","last_undegraded":"2021-10-08T19:38:30.377823+0000","last_fullsized":"2021-10-08T19:38:30.377823+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:35:19.581220+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:35:19.581220+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020087920000000001,"stat_sum":{"num_bytes":53670,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":28,"num_write":17,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":161010,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":416,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.380807+0000","last_change":"2021-10-08T19:35:57.184673+0000","last_active":"2021-10-08T19:38:30.380807+0000","last_peered":"2021-10-08T19:38:30.380807+0000","last_clean":"2021-10-08T19:38:30.380807+0000","last_became_active":"2021-10-08T19:28:40.133414+0000","last_became_peered":"2021-10-08T19:28:40.133414+0000","last_unstale":"2021-10-08T19:38:30.380807+0000","last_undegraded":"2021-10-08T19:38:30.380807+0000","last_fullsized":"2021-10-08T19:38:30.380807+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:57.184578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:35:57.184578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014526842,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"289'44","reported_seq":472,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.856391+0000","last_change":"2021-10-08T19:35:32.703833+0000","last_active":"2021-10-08T19:38:30.856391+0000","last_peered":"2021-10-08T19:38:30.856391+0000","last_clean":"2021-10-08T19:38:30.856391+0000","last_became_active":"2021-10-08T19:29:40.626138+0000","last_became_peered":"2021-10-08T19:29:40.626138+0000","last_unstale":"2021-10-08T19:38:30.856391+0000","last_undegraded":"2021-10-08T19:38:30.856391+0000","last_fullsized":"2021-10-08T19:38:30.856391+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'44","last_scrub_stamp":"2021-10-08T19:35:32.703721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:35:32.703721+0000","log_size":44,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0064438680000000002,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":65,"num_read_kb":50,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":1432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":439,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.403438+0000","last_change":"2021-10-08T19:37:19.004656+0000","last_active":"2021-10-08T19:38:30.403438+0000","last_peered":"2021-10-08T19:38:30.403438+0000","last_clean":"2021-10-08T19:38:30.403438+0000","last_became_active":"2021-10-08T19:37:19.004386+0000","last_became_peered":"2021-10-08T19:37:19.004386+0000","last_unstale":"2021-10-08T19:38:30.403438+0000","last_undegraded":"2021-10-08T19:38:30.403438+0000","last_fullsized":"2021-10-08T19:38:30.403438+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:23.647485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:23.647485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002822181,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":218,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.379574+0000","last_change":"2021-10-08T19:38:00.340784+0000","last_active":"2021-10-08T19:38:30.379574+0000","last_peered":"2021-10-08T19:38:30.379574+0000","last_clean":"2021-10-08T19:38:30.379574+0000","last_became_active":"2021-10-08T19:29:40.637371+0000","last_became_peered":"2021-10-08T19:29:40.637371+0000","last_unstale":"2021-10-08T19:38:30.379574+0000","last_undegraded":"2021-10-08T19:38:30.379574+0000","last_fullsized":"2021-10-08T19:38:30.379574+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:00.340701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:38:00.340701+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.015510070000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":359,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.369147+0000","last_change":"2021-10-08T19:36:09.181971+0000","last_active":"2021-10-08T19:38:30.369147+0000","last_peered":"2021-10-08T19:38:30.369147+0000","last_clean":"2021-10-08T19:38:30.369147+0000","last_became_active":"2021-10-08T19:25:14.550690+0000","last_became_peered":"2021-10-08T19:25:14.550690+0000","last_unstale":"2021-10-08T19:38:30.369147+0000","last_undegraded":"2021-10-08T19:38:30.369147+0000","last_fullsized":"2021-10-08T19:38:30.369147+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:09.181866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:36:09.181866+0000","last_clean_scrub_stamp":"2021-10-08T19:36:09.181866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0070630550000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"426'14092","reported_seq":14177,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:33.695907+0000","last_change":"2021-10-08T19:38:03.167993+0000","last_active":"2021-10-08T19:38:33.695907+0000","last_peered":"2021-10-08T19:38:33.695907+0000","last_clean":"2021-10-08T19:38:33.695907+0000","last_became_active":"2021-10-08T19:35:16.778062+0000","last_became_peered":"2021-10-08T19:35:16.778062+0000","last_unstale":"2021-10-08T19:38:33.695907+0000","last_undegraded":"2021-10-08T19:38:33.695907+0000","last_fullsized":"2021-10-08T19:38:33.695907+0000","mapping_epoch":355,"log_start":"404'10266","ondisk_log_start":"404'10266","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"415'12045","last_scrub_stamp":"2021-10-08T19:38:03.167870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:38:03.167870+0000","log_size":3826,"ondisk_log_size":3826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":1.364145553,"stat_sum":{"num_bytes":58720256,"num_objects":896,"num_object_clones":0,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":896,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14092,"num_write_kb":479616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.7","version":"90'130","reported_seq":681,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.383056+0000","last_change":"2021-10-08T19:38:03.289225+0000","last_active":"2021-10-08T19:38:30.383056+0000","last_peered":"2021-10-08T19:38:30.383056+0000","last_clean":"2021-10-08T19:38:30.383056+0000","last_became_active":"2021-10-08T19:29:43.636820+0000","last_became_peered":"2021-10-08T19:29:43.636820+0000","last_unstale":"2021-10-08T19:38:30.383056+0000","last_undegraded":"2021-10-08T19:38:30.383056+0000","last_fullsized":"2021-10-08T19:38:30.383056+0000","mapping_epoch":239,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:38:03.289111+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:38:03.289111+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0028045850000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"114'10","reported_seq":643,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.853280+0000","last_change":"2021-10-08T19:37:21.787584+0000","last_active":"2021-10-08T19:38:30.853280+0000","last_peered":"2021-10-08T19:38:30.853280+0000","last_clean":"2021-10-08T19:38:30.853280+0000","last_became_active":"2021-10-08T19:24:25.106695+0000","last_became_peered":"2021-10-08T19:24:25.106695+0000","last_unstale":"2021-10-08T19:38:30.853280+0000","last_undegraded":"2021-10-08T19:38:30.853280+0000","last_fullsized":"2021-10-08T19:38:30.853280+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'10","last_scrub_stamp":"2021-10-08T19:37:21.787486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:37:21.787486+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0082555349999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"289'20","reported_seq":158,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.403629+0000","last_change":"2021-10-08T19:36:04.773566+0000","last_active":"2021-10-08T19:38:30.403629+0000","last_peered":"2021-10-08T19:38:30.403629+0000","last_clean":"2021-10-08T19:38:30.403629+0000","last_became_active":"2021-10-08T19:31:51.675569+0000","last_became_peered":"2021-10-08T19:31:51.675569+0000","last_unstale":"2021-10-08T19:38:30.403629+0000","last_undegraded":"2021-10-08T19:38:30.403629+0000","last_fullsized":"2021-10-08T19:38:30.403629+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'20","last_scrub_stamp":"2021-10-08T19:36:04.773449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:04.773449+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0045168379999999996,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":23,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":259,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.403419+0000","last_change":"2021-10-08T19:36:58.014402+0000","last_active":"2021-10-08T19:38:30.403419+0000","last_peered":"2021-10-08T19:38:30.403419+0000","last_clean":"2021-10-08T19:38:30.403419+0000","last_became_active":"2021-10-08T19:36:58.013921+0000","last_became_peered":"2021-10-08T19:36:58.013921+0000","last_unstale":"2021-10-08T19:38:30.403419+0000","last_undegraded":"2021-10-08T19:38:30.403419+0000","last_fullsized":"2021-10-08T19:38:30.403419+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:16.702426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:16.702426+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0018085219999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":418,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.380166+0000","last_change":"2021-10-08T19:37:13.773377+0000","last_active":"2021-10-08T19:38:30.380166+0000","last_peered":"2021-10-08T19:38:30.380166+0000","last_clean":"2021-10-08T19:38:30.380166+0000","last_became_active":"2021-10-08T19:29:40.643614+0000","last_became_peered":"2021-10-08T19:29:40.643614+0000","last_unstale":"2021-10-08T19:38:30.380166+0000","last_undegraded":"2021-10-08T19:38:30.380166+0000","last_fullsized":"2021-10-08T19:38:30.380166+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:13.773265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:16.042797+0000","last_clean_scrub_stamp":"2021-10-08T19:37:13.773265+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.032956425999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":203,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.379881+0000","last_change":"2021-10-08T19:37:19.012787+0000","last_active":"2021-10-08T19:38:30.379881+0000","last_peered":"2021-10-08T19:38:30.379881+0000","last_clean":"2021-10-08T19:38:30.379881+0000","last_became_active":"2021-10-08T19:37:19.012488+0000","last_became_peered":"2021-10-08T19:37:19.012488+0000","last_unstale":"2021-10-08T19:38:30.379881+0000","last_undegraded":"2021-10-08T19:38:30.379881+0000","last_fullsized":"2021-10-08T19:38:30.379881+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:40.867717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:40.867717+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0052805589999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,2],"acting":[3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.7","version":"426'14078","reported_seq":14166,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:33.702741+0000","last_change":"2021-10-08T19:37:57.223024+0000","last_active":"2021-10-08T19:38:33.702741+0000","last_peered":"2021-10-08T19:38:33.702741+0000","last_clean":"2021-10-08T19:38:33.702741+0000","last_became_active":"2021-10-08T19:35:17.124846+0000","last_became_peered":"2021-10-08T19:35:17.124846+0000","last_unstale":"2021-10-08T19:38:33.702741+0000","last_undegraded":"2021-10-08T19:38:33.702741+0000","last_fullsized":"2021-10-08T19:38:33.702741+0000","mapping_epoch":355,"log_start":"402'9744","ondisk_log_start":"402'9744","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"412'11610","last_scrub_stamp":"2021-10-08T19:37:57.222895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:37:57.222895+0000","log_size":4334,"ondisk_log_size":4334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.993709756,"stat_sum":{"num_bytes":62128128,"num_objects":948,"num_object_clones":0,"num_object_copies":2844,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":948,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14078,"num_write_kb":480832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":426,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.370617+0000","last_change":"2021-10-08T19:38:07.234247+0000","last_active":"2021-10-08T19:38:30.370617+0000","last_peered":"2021-10-08T19:38:30.370617+0000","last_clean":"2021-10-08T19:38:30.370617+0000","last_became_active":"2021-10-08T19:28:40.138726+0000","last_became_peered":"2021-10-08T19:28:40.138726+0000","last_unstale":"2021-10-08T19:38:30.370617+0000","last_undegraded":"2021-10-08T19:38:30.370617+0000","last_fullsized":"2021-10-08T19:38:30.370617+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:11.024348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:50.435552+0000","last_clean_scrub_stamp":"2021-10-08T19:36:11.024348+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012476683000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"289'18","reported_seq":511,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.367407+0000","last_change":"2021-10-08T19:36:01.333174+0000","last_active":"2021-10-08T19:38:30.367407+0000","last_peered":"2021-10-08T19:38:30.367407+0000","last_clean":"2021-10-08T19:38:30.367407+0000","last_became_active":"2021-10-08T19:29:40.638957+0000","last_became_peered":"2021-10-08T19:29:40.638957+0000","last_unstale":"2021-10-08T19:38:30.367407+0000","last_undegraded":"2021-10-08T19:38:30.367407+0000","last_fullsized":"2021-10-08T19:38:30.367407+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'18","last_scrub_stamp":"2021-10-08T19:36:01.333053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:01.333053+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011804939,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":25,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"61'2","reported_seq":419,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.367407+0000","last_change":"2021-10-08T19:37:30.690153+0000","last_active":"2021-10-08T19:38:30.367407+0000","last_peered":"2021-10-08T19:38:30.367407+0000","last_clean":"2021-10-08T19:38:30.367407+0000","last_became_active":"2021-10-08T19:21:23.603614+0000","last_became_peered":"2021-10-08T19:21:23.603614+0000","last_unstale":"2021-10-08T19:38:30.367407+0000","last_undegraded":"2021-10-08T19:38:30.367407+0000","last_fullsized":"2021-10-08T19:38:30.367407+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'2","last_scrub_stamp":"2021-10-08T19:37:30.690057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:37:30.690057+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0038410610000000002,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":210,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.383399+0000","last_change":"2021-10-08T19:35:18.179768+0000","last_active":"2021-10-08T19:38:30.383399+0000","last_peered":"2021-10-08T19:38:30.383399+0000","last_clean":"2021-10-08T19:38:30.383399+0000","last_became_active":"2021-10-08T19:29:40.645211+0000","last_became_peered":"2021-10-08T19:29:40.645211+0000","last_unstale":"2021-10-08T19:38:30.383399+0000","last_undegraded":"2021-10-08T19:38:30.383399+0000","last_fullsized":"2021-10-08T19:38:30.383399+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:18.179673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:35:18.179673+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.080956615999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":339,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.377649+0000","last_change":"2021-10-08T19:37:21.652886+0000","last_active":"2021-10-08T19:38:30.377649+0000","last_peered":"2021-10-08T19:38:30.377649+0000","last_clean":"2021-10-08T19:38:30.377649+0000","last_became_active":"2021-10-08T19:28:40.100770+0000","last_became_peered":"2021-10-08T19:28:40.100770+0000","last_unstale":"2021-10-08T19:38:30.377649+0000","last_undegraded":"2021-10-08T19:38:30.377649+0000","last_fullsized":"2021-10-08T19:38:30.377649+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:21.652815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:37:21.652815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.006008953,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"289'15","reported_seq":465,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.379596+0000","last_change":"2021-10-08T19:35:25.783136+0000","last_active":"2021-10-08T19:38:30.379596+0000","last_peered":"2021-10-08T19:38:30.379596+0000","last_clean":"2021-10-08T19:38:30.379596+0000","last_became_active":"2021-10-08T19:29:40.644354+0000","last_became_peered":"2021-10-08T19:29:40.644354+0000","last_unstale":"2021-10-08T19:38:30.379596+0000","last_undegraded":"2021-10-08T19:38:30.379596+0000","last_fullsized":"2021-10-08T19:38:30.379596+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'15","last_scrub_stamp":"2021-10-08T19:35:25.783048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:35:25.783048+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0045023340000000002,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":438,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.370530+0000","last_change":"2021-10-08T19:36:45.011649+0000","last_active":"2021-10-08T19:38:30.370530+0000","last_peered":"2021-10-08T19:38:30.370530+0000","last_clean":"2021-10-08T19:38:30.370530+0000","last_became_active":"2021-10-08T19:28:40.139234+0000","last_became_peered":"2021-10-08T19:28:40.139234+0000","last_unstale":"2021-10-08T19:38:30.370530+0000","last_undegraded":"2021-10-08T19:38:30.370530+0000","last_fullsized":"2021-10-08T19:38:30.370530+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:45.011548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:45.011548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0092964109999999992,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":210,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.386215+0000","last_change":"2021-10-08T19:35:19.059789+0000","last_active":"2021-10-08T19:38:30.386215+0000","last_peered":"2021-10-08T19:38:30.386215+0000","last_clean":"2021-10-08T19:38:30.386215+0000","last_became_active":"2021-10-08T19:29:40.645111+0000","last_became_peered":"2021-10-08T19:29:40.645111+0000","last_unstale":"2021-10-08T19:38:30.386215+0000","last_undegraded":"2021-10-08T19:38:30.386215+0000","last_fullsized":"2021-10-08T19:38:30.386215+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:19.059695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:35:19.059695+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0017259879999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":410,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.369516+0000","last_change":"2021-10-08T19:38:06.192532+0000","last_active":"2021-10-08T19:38:30.369516+0000","last_peered":"2021-10-08T19:38:30.369516+0000","last_clean":"2021-10-08T19:38:30.369516+0000","last_became_active":"2021-10-08T19:21:29.640674+0000","last_became_peered":"2021-10-08T19:21:29.640674+0000","last_unstale":"2021-10-08T19:38:30.369516+0000","last_undegraded":"2021-10-08T19:38:30.369516+0000","last_fullsized":"2021-10-08T19:38:30.369516+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:06.192441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:38:06.192441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040996660000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":325,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.377756+0000","last_change":"2021-10-08T19:35:34.911655+0000","last_active":"2021-10-08T19:38:30.377756+0000","last_peered":"2021-10-08T19:38:30.377756+0000","last_clean":"2021-10-08T19:38:30.377756+0000","last_became_active":"2021-10-08T19:25:15.501118+0000","last_became_peered":"2021-10-08T19:25:15.501118+0000","last_unstale":"2021-10-08T19:38:30.377756+0000","last_undegraded":"2021-10-08T19:38:30.377756+0000","last_fullsized":"2021-10-08T19:38:30.377756+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:34.911590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:34.911590+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.00387858,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"289'12","reported_seq":233,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.386043+0000","last_change":"2021-10-08T19:36:14.746788+0000","last_active":"2021-10-08T19:38:30.386043+0000","last_peered":"2021-10-08T19:38:30.386043+0000","last_clean":"2021-10-08T19:38:30.386043+0000","last_became_active":"2021-10-08T19:29:40.644657+0000","last_became_peered":"2021-10-08T19:29:40.644657+0000","last_unstale":"2021-10-08T19:38:30.386043+0000","last_undegraded":"2021-10-08T19:38:30.386043+0000","last_fullsized":"2021-10-08T19:38:30.386043+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'12","last_scrub_stamp":"2021-10-08T19:36:14.746690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:14.746690+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0050396959999999998,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":18,"num_read_kb":15,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":372,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.379889+0000","last_change":"2021-10-08T19:36:48.882690+0000","last_active":"2021-10-08T19:38:30.379889+0000","last_peered":"2021-10-08T19:38:30.379889+0000","last_clean":"2021-10-08T19:38:30.379889+0000","last_became_active":"2021-10-08T19:28:40.101898+0000","last_became_peered":"2021-10-08T19:28:40.101898+0000","last_unstale":"2021-10-08T19:38:30.379889+0000","last_undegraded":"2021-10-08T19:38:30.379889+0000","last_fullsized":"2021-10-08T19:38:30.379889+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:16.444582+0000","last_clean_scrub_stamp":"2021-10-08T19:36:48.882597+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011015562,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":267,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.379415+0000","last_change":"2021-10-08T19:37:49.277058+0000","last_active":"2021-10-08T19:38:30.379415+0000","last_peered":"2021-10-08T19:38:30.379415+0000","last_clean":"2021-10-08T19:38:30.379415+0000","last_became_active":"2021-10-08T19:37:19.011117+0000","last_became_peered":"2021-10-08T19:37:19.011117+0000","last_unstale":"2021-10-08T19:38:30.379415+0000","last_undegraded":"2021-10-08T19:38:30.379415+0000","last_fullsized":"2021-10-08T19:38:30.379415+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:49.276955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:37:49.276955+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014777808,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":416,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.376860+0000","last_change":"2021-10-08T19:35:33.907637+0000","last_active":"2021-10-08T19:38:30.376860+0000","last_peered":"2021-10-08T19:38:30.376860+0000","last_clean":"2021-10-08T19:38:30.376860+0000","last_became_active":"2021-10-08T19:24:25.099371+0000","last_became_peered":"2021-10-08T19:24:25.099371+0000","last_unstale":"2021-10-08T19:38:30.376860+0000","last_undegraded":"2021-10-08T19:38:30.376860+0000","last_fullsized":"2021-10-08T19:38:30.376860+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:33.907545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:35:33.907545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.028929507,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"70'5","reported_seq":601,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.373765+0000","last_change":"2021-10-08T19:36:07.636175+0000","last_active":"2021-10-08T19:38:30.373765+0000","last_peered":"2021-10-08T19:38:30.373765+0000","last_clean":"2021-10-08T19:38:30.373765+0000","last_became_active":"2021-10-08T19:31:22.785193+0000","last_became_peered":"2021-10-08T19:31:22.785193+0000","last_unstale":"2021-10-08T19:38:30.373765+0000","last_undegraded":"2021-10-08T19:38:30.373765+0000","last_fullsized":"2021-10-08T19:38:30.373765+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":5,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:36:07.636099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:07.636099+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.004695103,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"289'20","reported_seq":281,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.379550+0000","last_change":"2021-10-08T19:35:59.742206+0000","last_active":"2021-10-08T19:38:30.379550+0000","last_peered":"2021-10-08T19:38:30.379550+0000","last_clean":"2021-10-08T19:38:30.379550+0000","last_became_active":"2021-10-08T19:31:51.677055+0000","last_became_peered":"2021-10-08T19:31:51.677055+0000","last_unstale":"2021-10-08T19:38:30.379550+0000","last_undegraded":"2021-10-08T19:38:30.379550+0000","last_fullsized":"2021-10-08T19:38:30.379550+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'20","last_scrub_stamp":"2021-10-08T19:35:59.742121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:35:59.742121+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0052506209999999996,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":245,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.378316+0000","last_change":"2021-10-08T19:37:19.006072+0000","last_active":"2021-10-08T19:38:30.378316+0000","last_peered":"2021-10-08T19:38:30.378316+0000","last_clean":"2021-10-08T19:38:30.378316+0000","last_became_active":"2021-10-08T19:37:19.005757+0000","last_became_peered":"2021-10-08T19:37:19.005757+0000","last_unstale":"2021-10-08T19:38:30.378316+0000","last_undegraded":"2021-10-08T19:38:30.378316+0000","last_fullsized":"2021-10-08T19:38:30.378316+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:20.582397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:20.582397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0033141500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"398'12","reported_seq":527,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.854959+0000","last_change":"2021-10-08T19:37:19.016457+0000","last_active":"2021-10-08T19:38:30.854959+0000","last_peered":"2021-10-08T19:38:30.854959+0000","last_clean":"2021-10-08T19:38:30.854959+0000","last_became_active":"2021-10-08T19:37:19.015189+0000","last_became_peered":"2021-10-08T19:37:19.015189+0000","last_unstale":"2021-10-08T19:38:30.854959+0000","last_undegraded":"2021-10-08T19:38:30.854959+0000","last_fullsized":"2021-10-08T19:38:30.854959+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"328'11","last_scrub_stamp":"2021-10-08T19:37:13.666624+0000","last_deep_scrub":"328'11","last_deep_scrub_stamp":"2021-10-08T19:33:32.545870+0000","last_clean_scrub_stamp":"2021-10-08T19:37:13.666624+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0085427560000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":412,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.379428+0000","last_change":"2021-10-08T19:36:07.150538+0000","last_active":"2021-10-08T19:38:30.379428+0000","last_peered":"2021-10-08T19:38:30.379428+0000","last_clean":"2021-10-08T19:38:30.379428+0000","last_became_active":"2021-10-08T19:29:40.644819+0000","last_became_peered":"2021-10-08T19:29:40.644819+0000","last_unstale":"2021-10-08T19:38:30.379428+0000","last_undegraded":"2021-10-08T19:38:30.379428+0000","last_fullsized":"2021-10-08T19:38:30.379428+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:07.150440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:36:07.150440+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.032064849999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":327,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.376606+0000","last_change":"2021-10-08T19:38:06.778006+0000","last_active":"2021-10-08T19:38:30.376606+0000","last_peered":"2021-10-08T19:38:30.376606+0000","last_clean":"2021-10-08T19:38:30.376606+0000","last_became_active":"2021-10-08T19:25:15.498770+0000","last_became_peered":"2021-10-08T19:25:15.498770+0000","last_unstale":"2021-10-08T19:38:30.376606+0000","last_undegraded":"2021-10-08T19:38:30.376606+0000","last_fullsized":"2021-10-08T19:38:30.376606+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:06.777889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:38:06.777889+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012207519,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"289'15","reported_seq":72,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.377129+0000","last_change":"2021-10-08T19:37:19.007863+0000","last_active":"2021-10-08T19:38:30.377129+0000","last_peered":"2021-10-08T19:38:30.377129+0000","last_clean":"2021-10-08T19:38:30.377129+0000","last_became_active":"2021-10-08T19:37:19.007551+0000","last_became_peered":"2021-10-08T19:37:19.007551+0000","last_unstale":"2021-10-08T19:38:30.377129+0000","last_undegraded":"2021-10-08T19:38:30.377129+0000","last_fullsized":"2021-10-08T19:38:30.377129+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'15","last_scrub_stamp":"2021-10-08T19:36:42.879493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:42.879493+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0047281429999999998,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":426,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.377959+0000","last_change":"2021-10-08T19:36:13.061448+0000","last_active":"2021-10-08T19:38:30.377959+0000","last_peered":"2021-10-08T19:38:30.377959+0000","last_clean":"2021-10-08T19:38:30.377959+0000","last_became_active":"2021-10-08T19:29:44.439397+0000","last_became_peered":"2021-10-08T19:29:44.439397+0000","last_unstale":"2021-10-08T19:38:30.377959+0000","last_undegraded":"2021-10-08T19:38:30.377959+0000","last_fullsized":"2021-10-08T19:38:30.377959+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:13.061347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:13.061347+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0089607839999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"413'11","reported_seq":328,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.847749+0000","last_change":"2021-10-08T19:37:59.373999+0000","last_active":"2021-10-08T19:38:30.847749+0000","last_peered":"2021-10-08T19:38:30.847749+0000","last_clean":"2021-10-08T19:38:30.847749+0000","last_became_active":"2021-10-08T19:29:40.637650+0000","last_became_peered":"2021-10-08T19:29:40.637650+0000","last_unstale":"2021-10-08T19:38:30.847749+0000","last_undegraded":"2021-10-08T19:38:30.847749+0000","last_fullsized":"2021-10-08T19:38:30.847749+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"413'11","last_scrub_stamp":"2021-10-08T19:37:59.373882+0000","last_deep_scrub":"413'11","last_deep_scrub_stamp":"2021-10-08T19:37:59.373882+0000","last_clean_scrub_stamp":"2021-10-08T19:37:59.373882+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0097897460000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":397,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.367655+0000","last_change":"2021-10-08T19:38:06.355634+0000","last_active":"2021-10-08T19:38:30.367655+0000","last_peered":"2021-10-08T19:38:30.367655+0000","last_clean":"2021-10-08T19:38:30.367655+0000","last_became_active":"2021-10-08T19:21:29.640302+0000","last_became_peered":"2021-10-08T19:21:29.640302+0000","last_unstale":"2021-10-08T19:38:30.367655+0000","last_undegraded":"2021-10-08T19:38:30.367655+0000","last_fullsized":"2021-10-08T19:38:30.367655+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:06.355521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:38:06.355521+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.101121058,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":339,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.378255+0000","last_change":"2021-10-08T19:37:52.056229+0000","last_active":"2021-10-08T19:38:30.378255+0000","last_peered":"2021-10-08T19:38:30.378255+0000","last_clean":"2021-10-08T19:38:30.378255+0000","last_became_active":"2021-10-08T19:29:40.631374+0000","last_became_peered":"2021-10-08T19:29:40.631374+0000","last_unstale":"2021-10-08T19:38:30.378255+0000","last_undegraded":"2021-10-08T19:38:30.378255+0000","last_fullsized":"2021-10-08T19:38:30.378255+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:52.056118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:37:52.056118+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0046200219999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":343,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.376775+0000","last_change":"2021-10-08T19:38:08.749060+0000","last_active":"2021-10-08T19:38:30.376775+0000","last_peered":"2021-10-08T19:38:30.376775+0000","last_clean":"2021-10-08T19:38:30.376775+0000","last_became_active":"2021-10-08T19:29:40.652966+0000","last_became_peered":"2021-10-08T19:29:40.652966+0000","last_unstale":"2021-10-08T19:38:30.376775+0000","last_undegraded":"2021-10-08T19:38:30.376775+0000","last_fullsized":"2021-10-08T19:38:30.376775+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:08.748947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:08.748947+0000","last_clean_scrub_stamp":"2021-10-08T19:38:08.748947+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0079490979999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"289'19","reported_seq":164,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.403358+0000","last_change":"2021-10-08T19:37:53.478710+0000","last_active":"2021-10-08T19:38:30.403358+0000","last_peered":"2021-10-08T19:38:30.403358+0000","last_clean":"2021-10-08T19:38:30.403358+0000","last_became_active":"2021-10-08T19:31:51.676961+0000","last_became_peered":"2021-10-08T19:31:51.676961+0000","last_unstale":"2021-10-08T19:38:30.403358+0000","last_undegraded":"2021-10-08T19:38:30.403358+0000","last_fullsized":"2021-10-08T19:38:30.403358+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:37:53.478605+0000","last_deep_scrub":"289'19","last_deep_scrub_stamp":"2021-10-08T19:32:46.539792+0000","last_clean_scrub_stamp":"2021-10-08T19:37:53.478605+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0084777749999999999,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":388,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.379903+0000","last_change":"2021-10-08T19:36:41.943798+0000","last_active":"2021-10-08T19:38:30.379903+0000","last_peered":"2021-10-08T19:38:30.379903+0000","last_clean":"2021-10-08T19:38:30.379903+0000","last_became_active":"2021-10-08T19:31:22.786651+0000","last_became_peered":"2021-10-08T19:31:22.786651+0000","last_unstale":"2021-10-08T19:38:30.379903+0000","last_undegraded":"2021-10-08T19:38:30.379903+0000","last_fullsized":"2021-10-08T19:38:30.379903+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:41.943676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:41.943676+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014561818000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":218,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.383319+0000","last_change":"2021-10-08T19:38:06.367374+0000","last_active":"2021-10-08T19:38:30.383319+0000","last_peered":"2021-10-08T19:38:30.383319+0000","last_clean":"2021-10-08T19:38:30.383319+0000","last_became_active":"2021-10-08T19:29:40.644770+0000","last_became_peered":"2021-10-08T19:29:40.644770+0000","last_unstale":"2021-10-08T19:38:30.383319+0000","last_undegraded":"2021-10-08T19:38:30.383319+0000","last_fullsized":"2021-10-08T19:38:30.383319+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:06.367259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:06.367259+0000","last_clean_scrub_stamp":"2021-10-08T19:38:06.367259+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010215291,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":414,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.380082+0000","last_change":"2021-10-08T19:35:24.753897+0000","last_active":"2021-10-08T19:38:30.380082+0000","last_peered":"2021-10-08T19:38:30.380082+0000","last_clean":"2021-10-08T19:38:30.380082+0000","last_became_active":"2021-10-08T19:28:40.133744+0000","last_became_peered":"2021-10-08T19:28:40.133744+0000","last_unstale":"2021-10-08T19:38:30.380082+0000","last_undegraded":"2021-10-08T19:38:30.380082+0000","last_fullsized":"2021-10-08T19:38:30.380082+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:24.753785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:35:24.753785+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.021400018999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"289'19","reported_seq":551,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.367210+0000","last_change":"2021-10-08T19:36:10.148431+0000","last_active":"2021-10-08T19:38:30.367210+0000","last_peered":"2021-10-08T19:38:30.367210+0000","last_clean":"2021-10-08T19:38:30.367210+0000","last_became_active":"2021-10-08T19:28:40.100196+0000","last_became_peered":"2021-10-08T19:28:40.100196+0000","last_unstale":"2021-10-08T19:38:30.367210+0000","last_undegraded":"2021-10-08T19:38:30.367210+0000","last_fullsized":"2021-10-08T19:38:30.367210+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:36:10.148317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:10.148317+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013984083,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":258,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.404180+0000","last_change":"2021-10-08T19:38:09.610754+0000","last_active":"2021-10-08T19:38:30.404180+0000","last_peered":"2021-10-08T19:38:30.404180+0000","last_clean":"2021-10-08T19:38:30.404180+0000","last_became_active":"2021-10-08T19:28:40.146673+0000","last_became_peered":"2021-10-08T19:28:40.146673+0000","last_unstale":"2021-10-08T19:38:30.404180+0000","last_undegraded":"2021-10-08T19:38:30.404180+0000","last_fullsized":"2021-10-08T19:38:30.404180+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:09.610637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:09.610637+0000","last_clean_scrub_stamp":"2021-10-08T19:38:09.610637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0088560310000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":268,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.403709+0000","last_change":"2021-10-08T19:36:51.493553+0000","last_active":"2021-10-08T19:38:30.403709+0000","last_peered":"2021-10-08T19:38:30.403709+0000","last_clean":"2021-10-08T19:38:30.403709+0000","last_became_active":"2021-10-08T19:29:40.638536+0000","last_became_peered":"2021-10-08T19:29:40.638536+0000","last_unstale":"2021-10-08T19:38:30.403709+0000","last_undegraded":"2021-10-08T19:38:30.403709+0000","last_fullsized":"2021-10-08T19:38:30.403709+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:51.493442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:43.186684+0000","last_clean_scrub_stamp":"2021-10-08T19:36:51.493442+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013830541,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":210,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.378788+0000","last_change":"2021-10-08T19:35:21.993459+0000","last_active":"2021-10-08T19:38:30.378788+0000","last_peered":"2021-10-08T19:38:30.378788+0000","last_clean":"2021-10-08T19:38:30.378788+0000","last_became_active":"2021-10-08T19:29:40.634300+0000","last_became_peered":"2021-10-08T19:29:40.634300+0000","last_unstale":"2021-10-08T19:38:30.378788+0000","last_undegraded":"2021-10-08T19:38:30.378788+0000","last_fullsized":"2021-10-08T19:38:30.378788+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:21.993295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:35:21.993295+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.015124034,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"70'5","reported_seq":321,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.369204+0000","last_change":"2021-10-08T19:36:06.256008+0000","last_active":"2021-10-08T19:38:30.369204+0000","last_peered":"2021-10-08T19:38:30.369204+0000","last_clean":"2021-10-08T19:38:30.369204+0000","last_became_active":"2021-10-08T19:25:15.496309+0000","last_became_peered":"2021-10-08T19:25:15.496309+0000","last_unstale":"2021-10-08T19:38:30.369204+0000","last_undegraded":"2021-10-08T19:38:30.369204+0000","last_fullsized":"2021-10-08T19:38:30.369204+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:36:06.255898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:06.255898+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0073902810000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.10","version":"289'8","reported_seq":239,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.377726+0000","last_change":"2021-10-08T19:36:06.812233+0000","last_active":"2021-10-08T19:38:30.377726+0000","last_peered":"2021-10-08T19:38:30.377726+0000","last_clean":"2021-10-08T19:38:30.377726+0000","last_became_active":"2021-10-08T19:32:45.165103+0000","last_became_peered":"2021-10-08T19:32:45.165103+0000","last_unstale":"2021-10-08T19:38:30.377726+0000","last_undegraded":"2021-10-08T19:38:30.377726+0000","last_fullsized":"2021-10-08T19:38:30.377726+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'8","last_scrub_stamp":"2021-10-08T19:36:06.812115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:06.812115+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010666471,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":127,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.380386+0000","last_change":"2021-10-08T19:37:29.114140+0000","last_active":"2021-10-08T19:38:30.380386+0000","last_peered":"2021-10-08T19:38:30.380386+0000","last_clean":"2021-10-08T19:38:30.380386+0000","last_became_active":"2021-10-08T19:37:19.009349+0000","last_became_peered":"2021-10-08T19:37:19.009349+0000","last_unstale":"2021-10-08T19:38:30.380386+0000","last_undegraded":"2021-10-08T19:38:30.380386+0000","last_fullsized":"2021-10-08T19:38:30.380386+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:29.114037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:13.716331+0000","last_clean_scrub_stamp":"2021-10-08T19:37:29.114037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0076932069999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":363,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:32.348673+0000","last_change":"2021-10-08T19:38:32.348636+0000","last_active":"2021-10-08T19:38:32.348673+0000","last_peered":"2021-10-08T19:38:32.348673+0000","last_clean":"2021-10-08T19:38:32.348673+0000","last_became_active":"2021-10-08T19:24:25.106186+0000","last_became_peered":"2021-10-08T19:24:25.106186+0000","last_unstale":"2021-10-08T19:38:32.348673+0000","last_undegraded":"2021-10-08T19:38:32.348673+0000","last_fullsized":"2021-10-08T19:38:32.348673+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:32.348544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:18.377739+0000","last_clean_scrub_stamp":"2021-10-08T19:38:32.348544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0041413229999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":400,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.376843+0000","last_change":"2021-10-08T19:35:57.018331+0000","last_active":"2021-10-08T19:38:30.376843+0000","last_peered":"2021-10-08T19:38:30.376843+0000","last_clean":"2021-10-08T19:38:30.376843+0000","last_became_active":"2021-10-08T19:21:29.642835+0000","last_became_peered":"2021-10-08T19:21:29.642835+0000","last_unstale":"2021-10-08T19:38:30.376843+0000","last_undegraded":"2021-10-08T19:38:30.376843+0000","last_fullsized":"2021-10-08T19:38:30.376843+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:57.018227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:35:57.018227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012449864,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":343,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.376153+0000","last_change":"2021-10-08T19:37:57.752389+0000","last_active":"2021-10-08T19:38:30.376153+0000","last_peered":"2021-10-08T19:38:30.376153+0000","last_clean":"2021-10-08T19:38:30.376153+0000","last_became_active":"2021-10-08T19:28:40.099215+0000","last_became_peered":"2021-10-08T19:28:40.099215+0000","last_unstale":"2021-10-08T19:38:30.376153+0000","last_undegraded":"2021-10-08T19:38:30.376153+0000","last_fullsized":"2021-10-08T19:38:30.376153+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:57.752238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:37:57.752238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012035994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"348'24","reported_seq":245,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.378704+0000","last_change":"2021-10-08T19:38:05.385295+0000","last_active":"2021-10-08T19:38:30.378704+0000","last_peered":"2021-10-08T19:38:30.378704+0000","last_clean":"2021-10-08T19:38:30.378704+0000","last_became_active":"2021-10-08T19:29:40.640914+0000","last_became_peered":"2021-10-08T19:29:40.640914+0000","last_unstale":"2021-10-08T19:38:30.378704+0000","last_undegraded":"2021-10-08T19:38:30.378704+0000","last_fullsized":"2021-10-08T19:38:30.378704+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"348'24","last_scrub_stamp":"2021-10-08T19:38:05.385196+0000","last_deep_scrub":"348'24","last_deep_scrub_stamp":"2021-10-08T19:34:53.274250+0000","last_clean_scrub_stamp":"2021-10-08T19:38:05.385196+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0079524399999999999,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":354,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.383225+0000","last_change":"2021-10-08T19:37:13.001449+0000","last_active":"2021-10-08T19:38:30.383225+0000","last_peered":"2021-10-08T19:38:30.383225+0000","last_clean":"2021-10-08T19:38:30.383225+0000","last_became_active":"2021-10-08T19:24:25.098128+0000","last_became_peered":"2021-10-08T19:24:25.098128+0000","last_unstale":"2021-10-08T19:38:30.383225+0000","last_undegraded":"2021-10-08T19:38:30.383225+0000","last_fullsized":"2021-10-08T19:38:30.383225+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:13.001343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:34.508558+0000","last_clean_scrub_stamp":"2021-10-08T19:37:13.001343+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0068614030000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":412,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.378789+0000","last_change":"2021-10-08T19:35:25.845334+0000","last_active":"2021-10-08T19:38:30.378789+0000","last_peered":"2021-10-08T19:38:30.378789+0000","last_clean":"2021-10-08T19:38:30.378789+0000","last_became_active":"2021-10-08T19:24:25.095490+0000","last_became_peered":"2021-10-08T19:24:25.095490+0000","last_unstale":"2021-10-08T19:38:30.378789+0000","last_undegraded":"2021-10-08T19:38:30.378789+0000","last_fullsized":"2021-10-08T19:38:30.378789+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:25.845262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:11.383779+0000","last_clean_scrub_stamp":"2021-10-08T19:35:25.845262+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0015112610000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":216,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.383694+0000","last_change":"2021-10-08T19:36:12.821415+0000","last_active":"2021-10-08T19:38:30.383694+0000","last_peered":"2021-10-08T19:38:30.383694+0000","last_clean":"2021-10-08T19:38:30.383694+0000","last_became_active":"2021-10-08T19:29:40.639358+0000","last_became_peered":"2021-10-08T19:29:40.639358+0000","last_unstale":"2021-10-08T19:38:30.383694+0000","last_undegraded":"2021-10-08T19:38:30.383694+0000","last_fullsized":"2021-10-08T19:38:30.383694+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:12.821316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:36:12.821316+0000","last_clean_scrub_stamp":"2021-10-08T19:36:12.821316+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.068456382999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"289'20","reported_seq":476,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.379794+0000","last_change":"2021-10-08T19:36:45.604663+0000","last_active":"2021-10-08T19:38:30.379794+0000","last_peered":"2021-10-08T19:38:30.379794+0000","last_clean":"2021-10-08T19:38:30.379794+0000","last_became_active":"2021-10-08T19:29:40.636448+0000","last_became_peered":"2021-10-08T19:29:40.636448+0000","last_unstale":"2021-10-08T19:38:30.379794+0000","last_undegraded":"2021-10-08T19:38:30.379794+0000","last_fullsized":"2021-10-08T19:38:30.379794+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'20","last_scrub_stamp":"2021-10-08T19:36:45.604576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:45.604576+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.007213863,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":403,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.375142+0000","last_change":"2021-10-08T19:37:52.735109+0000","last_active":"2021-10-08T19:38:30.375142+0000","last_peered":"2021-10-08T19:38:30.375142+0000","last_clean":"2021-10-08T19:38:30.375142+0000","last_became_active":"2021-10-08T19:21:23.604530+0000","last_became_peered":"2021-10-08T19:21:23.604530+0000","last_unstale":"2021-10-08T19:38:30.375142+0000","last_undegraded":"2021-10-08T19:38:30.375142+0000","last_fullsized":"2021-10-08T19:38:30.375142+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:52.735006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:37:52.735006+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039941940000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1f","version":"114'10","reported_seq":520,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.844567+0000","last_change":"2021-10-08T19:36:40.888275+0000","last_active":"2021-10-08T19:38:30.844567+0000","last_peered":"2021-10-08T19:38:30.844567+0000","last_clean":"2021-10-08T19:38:30.844567+0000","last_became_active":"2021-10-08T19:24:25.105742+0000","last_became_peered":"2021-10-08T19:24:25.105742+0000","last_unstale":"2021-10-08T19:38:30.844567+0000","last_undegraded":"2021-10-08T19:38:30.844567+0000","last_fullsized":"2021-10-08T19:38:30.844567+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'10","last_scrub_stamp":"2021-10-08T19:36:40.888198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:36:40.888198+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0055243009999999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"69'1","reported_seq":399,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.377554+0000","last_change":"2021-10-08T19:37:23.683434+0000","last_active":"2021-10-08T19:38:30.377554+0000","last_peered":"2021-10-08T19:38:30.377554+0000","last_clean":"2021-10-08T19:38:30.377554+0000","last_became_active":"2021-10-08T19:21:29.640296+0000","last_became_peered":"2021-10-08T19:21:29.640296+0000","last_unstale":"2021-10-08T19:38:30.377554+0000","last_undegraded":"2021-10-08T19:38:30.377554+0000","last_fullsized":"2021-10-08T19:38:30.377554+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2021-10-08T19:37:23.683320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:37:23.683320+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011686882000000001,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"390'24","reported_seq":423,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.383610+0000","last_change":"2021-10-08T19:36:56.930986+0000","last_active":"2021-10-08T19:38:30.383610+0000","last_peered":"2021-10-08T19:38:30.383610+0000","last_clean":"2021-10-08T19:38:30.383610+0000","last_became_active":"2021-10-08T19:28:40.126425+0000","last_became_peered":"2021-10-08T19:28:40.126425+0000","last_unstale":"2021-10-08T19:38:30.383610+0000","last_undegraded":"2021-10-08T19:38:30.383610+0000","last_fullsized":"2021-10-08T19:38:30.383610+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"390'24","last_scrub_stamp":"2021-10-08T19:36:56.930887+0000","last_deep_scrub":"390'24","last_deep_scrub_stamp":"2021-10-08T19:36:56.930887+0000","last_clean_scrub_stamp":"2021-10-08T19:36:56.930887+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.015519527999999999,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":216,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.378481+0000","last_change":"2021-10-08T19:37:14.139452+0000","last_active":"2021-10-08T19:38:30.378481+0000","last_peered":"2021-10-08T19:38:30.378481+0000","last_clean":"2021-10-08T19:38:30.378481+0000","last_became_active":"2021-10-08T19:29:40.640952+0000","last_became_peered":"2021-10-08T19:29:40.640952+0000","last_unstale":"2021-10-08T19:38:30.378481+0000","last_undegraded":"2021-10-08T19:38:30.378481+0000","last_fullsized":"2021-10-08T19:38:30.378481+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:14.139384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:37:14.139384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0033835190000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":400,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.379871+0000","last_change":"2021-10-08T19:36:02.157958+0000","last_active":"2021-10-08T19:38:30.379871+0000","last_peered":"2021-10-08T19:38:30.379871+0000","last_clean":"2021-10-08T19:38:30.379871+0000","last_became_active":"2021-10-08T19:21:27.632648+0000","last_became_peered":"2021-10-08T19:21:27.632648+0000","last_unstale":"2021-10-08T19:38:30.379871+0000","last_undegraded":"2021-10-08T19:38:30.379871+0000","last_fullsized":"2021-10-08T19:38:30.379871+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:02.157885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:36:02.157885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0018671,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"69'1","reported_seq":254,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.404264+0000","last_change":"2021-10-08T19:38:03.796487+0000","last_active":"2021-10-08T19:38:30.404264+0000","last_peered":"2021-10-08T19:38:30.404264+0000","last_clean":"2021-10-08T19:38:30.404264+0000","last_became_active":"2021-10-08T19:28:40.146302+0000","last_became_peered":"2021-10-08T19:28:40.146302+0000","last_unstale":"2021-10-08T19:38:30.404264+0000","last_undegraded":"2021-10-08T19:38:30.404264+0000","last_fullsized":"2021-10-08T19:38:30.404264+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2021-10-08T19:38:03.796375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:38:03.796375+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.12770116100000001,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"289'27","reported_seq":582,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.370051+0000","last_change":"2021-10-08T19:37:55.195213+0000","last_active":"2021-10-08T19:38:30.370051+0000","last_peered":"2021-10-08T19:38:30.370051+0000","last_clean":"2021-10-08T19:38:30.370051+0000","last_became_active":"2021-10-08T19:29:40.629461+0000","last_became_peered":"2021-10-08T19:29:40.629461+0000","last_unstale":"2021-10-08T19:38:30.370051+0000","last_undegraded":"2021-10-08T19:38:30.370051+0000","last_fullsized":"2021-10-08T19:38:30.370051+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'27","last_scrub_stamp":"2021-10-08T19:37:55.195108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:37:55.195108+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.016851959999999999,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":550,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":354,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.380940+0000","last_change":"2021-10-08T19:35:59.598376+0000","last_active":"2021-10-08T19:38:30.380940+0000","last_peered":"2021-10-08T19:38:30.380940+0000","last_clean":"2021-10-08T19:38:30.380940+0000","last_became_active":"2021-10-08T19:24:25.106119+0000","last_became_peered":"2021-10-08T19:24:25.106119+0000","last_unstale":"2021-10-08T19:38:30.380940+0000","last_undegraded":"2021-10-08T19:38:30.380940+0000","last_fullsized":"2021-10-08T19:38:30.380940+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:59.598294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:46.422866+0000","last_clean_scrub_stamp":"2021-10-08T19:35:59.598294+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.032131808999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":252,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.404351+0000","last_change":"2021-10-08T19:37:14.702746+0000","last_active":"2021-10-08T19:38:30.404351+0000","last_peered":"2021-10-08T19:38:30.404351+0000","last_clean":"2021-10-08T19:38:30.404351+0000","last_became_active":"2021-10-08T19:28:40.148009+0000","last_became_peered":"2021-10-08T19:28:40.148009+0000","last_unstale":"2021-10-08T19:38:30.404351+0000","last_undegraded":"2021-10-08T19:38:30.404351+0000","last_fullsized":"2021-10-08T19:38:30.404351+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:14.702628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:37:14.702628+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0066034209999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":411,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.369132+0000","last_change":"2021-10-08T19:37:56.315654+0000","last_active":"2021-10-08T19:38:30.369132+0000","last_peered":"2021-10-08T19:38:30.369132+0000","last_clean":"2021-10-08T19:38:30.369132+0000","last_became_active":"2021-10-08T19:24:25.097782+0000","last_became_peered":"2021-10-08T19:24:25.097782+0000","last_unstale":"2021-10-08T19:38:30.369132+0000","last_undegraded":"2021-10-08T19:38:30.369132+0000","last_fullsized":"2021-10-08T19:38:30.369132+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:16.284510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:37.219503+0000","last_clean_scrub_stamp":"2021-10-08T19:35:16.284510+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001625755,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"289'18","reported_seq":237,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.379979+0000","last_change":"2021-10-08T19:36:17.847260+0000","last_active":"2021-10-08T19:38:30.379979+0000","last_peered":"2021-10-08T19:38:30.379979+0000","last_clean":"2021-10-08T19:38:30.379979+0000","last_became_active":"2021-10-08T19:29:40.645144+0000","last_became_peered":"2021-10-08T19:29:40.645144+0000","last_unstale":"2021-10-08T19:38:30.379979+0000","last_undegraded":"2021-10-08T19:38:30.379979+0000","last_fullsized":"2021-10-08T19:38:30.379979+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'18","last_scrub_stamp":"2021-10-08T19:36:17.846978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:17.846978+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.018882475999999999,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":25,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":210,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.383472+0000","last_change":"2021-10-08T19:35:32.854645+0000","last_active":"2021-10-08T19:38:30.383472+0000","last_peered":"2021-10-08T19:38:30.383472+0000","last_clean":"2021-10-08T19:38:30.383472+0000","last_became_active":"2021-10-08T19:29:44.443807+0000","last_became_peered":"2021-10-08T19:29:44.443807+0000","last_unstale":"2021-10-08T19:38:30.383472+0000","last_undegraded":"2021-10-08T19:38:30.383472+0000","last_fullsized":"2021-10-08T19:38:30.383472+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:32.854550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:32.854550+0000","last_clean_scrub_stamp":"2021-10-08T19:35:32.854550+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0089578279999999993,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":417,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.368929+0000","last_change":"2021-10-08T19:37:16.729232+0000","last_active":"2021-10-08T19:38:30.368929+0000","last_peered":"2021-10-08T19:38:30.368929+0000","last_clean":"2021-10-08T19:38:30.368929+0000","last_became_active":"2021-10-08T19:29:40.638352+0000","last_became_peered":"2021-10-08T19:29:40.638352+0000","last_unstale":"2021-10-08T19:38:30.368929+0000","last_undegraded":"2021-10-08T19:38:30.368929+0000","last_fullsized":"2021-10-08T19:38:30.368929+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:16.729133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:37:16.729133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010092746,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":228,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.386286+0000","last_change":"2021-10-08T19:35:24.071959+0000","last_active":"2021-10-08T19:38:30.386286+0000","last_peered":"2021-10-08T19:38:30.386286+0000","last_clean":"2021-10-08T19:38:30.386286+0000","last_became_active":"2021-10-08T19:31:22.788455+0000","last_became_peered":"2021-10-08T19:31:22.788455+0000","last_unstale":"2021-10-08T19:38:30.386286+0000","last_undegraded":"2021-10-08T19:38:30.386286+0000","last_fullsized":"2021-10-08T19:38:30.386286+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:24.071866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:32:12.549351+0000","last_clean_scrub_stamp":"2021-10-08T19:35:24.071866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.097681799,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"289'15","reported_seq":466,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.367683+0000","last_change":"2021-10-08T19:38:09.250253+0000","last_active":"2021-10-08T19:38:30.367683+0000","last_peered":"2021-10-08T19:38:30.367683+0000","last_clean":"2021-10-08T19:38:30.367683+0000","last_became_active":"2021-10-08T19:29:40.631689+0000","last_became_peered":"2021-10-08T19:29:40.631689+0000","last_unstale":"2021-10-08T19:38:30.367683+0000","last_undegraded":"2021-10-08T19:38:30.367683+0000","last_fullsized":"2021-10-08T19:38:30.367683+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'15","last_scrub_stamp":"2021-10-08T19:38:09.250133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:38:09.250133+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0047959150000000004,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":408,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.377228+0000","last_change":"2021-10-08T19:36:16.752767+0000","last_active":"2021-10-08T19:38:30.377228+0000","last_peered":"2021-10-08T19:38:30.377228+0000","last_clean":"2021-10-08T19:38:30.377228+0000","last_became_active":"2021-10-08T19:21:23.607785+0000","last_became_peered":"2021-10-08T19:21:23.607785+0000","last_unstale":"2021-10-08T19:38:30.377228+0000","last_undegraded":"2021-10-08T19:38:30.377228+0000","last_fullsized":"2021-10-08T19:38:30.377228+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:16.752654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:16.752654+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0071954510000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":399,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.380133+0000","last_change":"2021-10-08T19:37:21.731373+0000","last_active":"2021-10-08T19:38:30.380133+0000","last_peered":"2021-10-08T19:38:30.380133+0000","last_clean":"2021-10-08T19:38:30.380133+0000","last_became_active":"2021-10-08T19:21:27.633979+0000","last_became_peered":"2021-10-08T19:21:27.633979+0000","last_unstale":"2021-10-08T19:38:30.380133+0000","last_undegraded":"2021-10-08T19:38:30.380133+0000","last_fullsized":"2021-10-08T19:38:30.380133+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:21.731260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:27.586341+0000","last_clean_scrub_stamp":"2021-10-08T19:37:21.731260+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011765390000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":420,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.380652+0000","last_change":"2021-10-08T19:37:55.032408+0000","last_active":"2021-10-08T19:38:30.380652+0000","last_peered":"2021-10-08T19:38:30.380652+0000","last_clean":"2021-10-08T19:38:30.380652+0000","last_became_active":"2021-10-08T19:28:40.159162+0000","last_became_peered":"2021-10-08T19:28:40.159162+0000","last_unstale":"2021-10-08T19:38:30.380652+0000","last_undegraded":"2021-10-08T19:38:30.380652+0000","last_fullsized":"2021-10-08T19:38:30.380652+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:55.032301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:37:55.032301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.054063366000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"289'7","reported_seq":491,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.368632+0000","last_change":"2021-10-08T19:36:14.120690+0000","last_active":"2021-10-08T19:38:30.368632+0000","last_peered":"2021-10-08T19:38:30.368632+0000","last_clean":"2021-10-08T19:38:30.368632+0000","last_became_active":"2021-10-08T19:31:51.675189+0000","last_became_peered":"2021-10-08T19:31:51.675189+0000","last_unstale":"2021-10-08T19:38:30.368632+0000","last_undegraded":"2021-10-08T19:38:30.368632+0000","last_fullsized":"2021-10-08T19:38:30.368632+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'7","last_scrub_stamp":"2021-10-08T19:36:14.120570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:14.120570+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.006350138,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":10,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":424,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.377044+0000","last_change":"2021-10-08T19:35:24.852668+0000","last_active":"2021-10-08T19:38:30.377044+0000","last_peered":"2021-10-08T19:38:30.377044+0000","last_clean":"2021-10-08T19:38:30.377044+0000","last_became_active":"2021-10-08T19:24:25.096225+0000","last_became_peered":"2021-10-08T19:24:25.096225+0000","last_unstale":"2021-10-08T19:38:30.377044+0000","last_undegraded":"2021-10-08T19:38:30.377044+0000","last_fullsized":"2021-10-08T19:38:30.377044+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:24.852584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:29:40.244757+0000","last_clean_scrub_stamp":"2021-10-08T19:35:24.852584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0014639150000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":422,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.376627+0000","last_change":"2021-10-08T19:36:44.948482+0000","last_active":"2021-10-08T19:38:30.376627+0000","last_peered":"2021-10-08T19:38:30.376627+0000","last_clean":"2021-10-08T19:38:30.376627+0000","last_became_active":"2021-10-08T19:28:40.101187+0000","last_became_peered":"2021-10-08T19:28:40.101187+0000","last_unstale":"2021-10-08T19:38:30.376627+0000","last_undegraded":"2021-10-08T19:38:30.376627+0000","last_fullsized":"2021-10-08T19:38:30.376627+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:44.948359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:11.633739+0000","last_clean_scrub_stamp":"2021-10-08T19:36:44.948359+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0035272509999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":257,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.402994+0000","last_change":"2021-10-08T19:37:19.007798+0000","last_active":"2021-10-08T19:38:30.402994+0000","last_peered":"2021-10-08T19:38:30.402994+0000","last_clean":"2021-10-08T19:38:30.402994+0000","last_became_active":"2021-10-08T19:37:19.007583+0000","last_became_peered":"2021-10-08T19:37:19.007583+0000","last_unstale":"2021-10-08T19:38:30.402994+0000","last_undegraded":"2021-10-08T19:38:30.402994+0000","last_fullsized":"2021-10-08T19:38:30.402994+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:10.650288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:36:10.650288+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.020979794,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"289'19","reported_seq":540,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.366748+0000","last_change":"2021-10-08T19:36:15.167452+0000","last_active":"2021-10-08T19:38:30.366748+0000","last_peered":"2021-10-08T19:38:30.366748+0000","last_clean":"2021-10-08T19:38:30.366748+0000","last_became_active":"2021-10-08T19:28:40.099770+0000","last_became_peered":"2021-10-08T19:28:40.099770+0000","last_unstale":"2021-10-08T19:38:30.366748+0000","last_undegraded":"2021-10-08T19:38:30.366748+0000","last_fullsized":"2021-10-08T19:38:30.366748+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:36:15.167374+0000","last_deep_scrub":"289'19","last_deep_scrub_stamp":"2021-10-08T19:36:15.167374+0000","last_clean_scrub_stamp":"2021-10-08T19:36:15.167374+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0067424360000000001,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":216,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.379494+0000","last_change":"2021-10-08T19:36:57.099908+0000","last_active":"2021-10-08T19:38:30.379494+0000","last_peered":"2021-10-08T19:38:30.379494+0000","last_clean":"2021-10-08T19:38:30.379494+0000","last_became_active":"2021-10-08T19:29:40.627394+0000","last_became_peered":"2021-10-08T19:29:40.627394+0000","last_unstale":"2021-10-08T19:38:30.379494+0000","last_undegraded":"2021-10-08T19:38:30.379494+0000","last_fullsized":"2021-10-08T19:38:30.379494+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:57.099805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:57.099805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034117000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":250,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.403148+0000","last_change":"2021-10-08T19:36:46.569493+0000","last_active":"2021-10-08T19:38:30.403148+0000","last_peered":"2021-10-08T19:38:30.403148+0000","last_clean":"2021-10-08T19:38:30.403148+0000","last_became_active":"2021-10-08T19:28:40.145868+0000","last_became_peered":"2021-10-08T19:28:40.145868+0000","last_unstale":"2021-10-08T19:38:30.403148+0000","last_undegraded":"2021-10-08T19:38:30.403148+0000","last_fullsized":"2021-10-08T19:38:30.403148+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:46.569374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:36:46.569374+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011431800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":411,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.367593+0000","last_change":"2021-10-08T19:36:03.314076+0000","last_active":"2021-10-08T19:38:30.367593+0000","last_peered":"2021-10-08T19:38:30.367593+0000","last_clean":"2021-10-08T19:38:30.367593+0000","last_became_active":"2021-10-08T19:28:40.099543+0000","last_became_peered":"2021-10-08T19:28:40.099543+0000","last_unstale":"2021-10-08T19:38:30.367593+0000","last_undegraded":"2021-10-08T19:38:30.367593+0000","last_fullsized":"2021-10-08T19:38:30.367593+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:03.313977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:50.032367+0000","last_clean_scrub_stamp":"2021-10-08T19:36:03.313977+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.038973248000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"289'27","reported_seq":250,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.378565+0000","last_change":"2021-10-08T19:38:03.371773+0000","last_active":"2021-10-08T19:38:30.378565+0000","last_peered":"2021-10-08T19:38:30.378565+0000","last_clean":"2021-10-08T19:38:30.378565+0000","last_became_active":"2021-10-08T19:29:40.631002+0000","last_became_peered":"2021-10-08T19:29:40.631002+0000","last_unstale":"2021-10-08T19:38:30.378565+0000","last_undegraded":"2021-10-08T19:38:30.378565+0000","last_fullsized":"2021-10-08T19:38:30.378565+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'27","last_scrub_stamp":"2021-10-08T19:38:03.371690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:38:03.371690+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012656639000000001,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":406,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:33.129666+0000","last_change":"2021-10-08T19:38:33.129623+0000","last_active":"2021-10-08T19:38:33.129666+0000","last_peered":"2021-10-08T19:38:33.129666+0000","last_clean":"2021-10-08T19:38:33.129666+0000","last_became_active":"2021-10-08T19:21:23.603422+0000","last_became_peered":"2021-10-08T19:21:23.603422+0000","last_unstale":"2021-10-08T19:38:33.129666+0000","last_undegraded":"2021-10-08T19:38:33.129666+0000","last_fullsized":"2021-10-08T19:38:33.129666+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:33.129516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:15.535842+0000","last_clean_scrub_stamp":"2021-10-08T19:38:33.129516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012096857000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":437,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.366883+0000","last_change":"2021-10-08T19:36:11.147338+0000","last_active":"2021-10-08T19:38:30.366883+0000","last_peered":"2021-10-08T19:38:30.366883+0000","last_clean":"2021-10-08T19:38:30.366883+0000","last_became_active":"2021-10-08T19:28:40.099286+0000","last_became_peered":"2021-10-08T19:28:40.099286+0000","last_unstale":"2021-10-08T19:38:30.366883+0000","last_undegraded":"2021-10-08T19:38:30.366883+0000","last_fullsized":"2021-10-08T19:38:30.366883+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:11.147246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:31.176160+0000","last_clean_scrub_stamp":"2021-10-08T19:36:11.147246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.005657235,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":216,"reported_epoch":425,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.383619+0000","last_change":"2021-10-08T19:38:08.397525+0000","last_active":"2021-10-08T19:38:30.383619+0000","last_peered":"2021-10-08T19:38:30.383619+0000","last_clean":"2021-10-08T19:38:30.383619+0000","last_became_active":"2021-10-08T19:29:40.638221+0000","last_became_peered":"2021-10-08T19:29:40.638221+0000","last_unstale":"2021-10-08T19:38:30.383619+0000","last_undegraded":"2021-10-08T19:38:30.383619+0000","last_fullsized":"2021-10-08T19:38:30.383619+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:08.397432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:38:08.397432+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.11831541399999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":946012184,"num_objects":14436,"num_object_clones":0,"num_object_copies":43308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14436,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":222564,"num_write_kb":7583937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2834313216,"data_stored":2834301000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71332,"ondisk_log_size":71332,"up":48,"acting":48,"num_store_stats":8},{"poolid":2,"num_pg":42,"stat_sum":{"num_bytes":1502,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":126,"acting":126,"num_store_stats":8},{"poolid":1,"num_pg":11,"stat_sum":{"num_bytes":644038,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":28,"num_write":17,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":161010,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1430,"ondisk_log_size":1430,"up":33,"acting":33,"num_store_stats":8},{"poolid":3,"num_pg":23,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":393,"num_read_kb":393,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":778,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":69,"acting":69,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1111,"num_read_kb":868,"num_write":703,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":520,"num_bytes_recovered":10826,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":710,"ondisk_log_size":710,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":84,"ondisk_log_size":84,"up":96,"acting":96,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201490,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":529472,"kb_used_data":236664,"kb_used_omap":0,"kb_used_meta":292800,"kb_avail":93215680,"statfs":{"total":95995035648,"available":95452856320,"internally_reserved":0,"allocated":242343936,"data_stored":241767644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":299827200},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,3,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:37:40 2021","interfaces":[{"interface":"back","average":{"1min":1.6779999999999999,"5min":1.6100000000000001,"15min":1.5669999999999999},"min":{"1min":0.27100000000000002,"5min":0.20699999999999999,"15min":0.20100000000000001},"max":{"1min":4.9980000000000002,"5min":8.8160000000000007,"15min":32.366999999999997},"last":4.6909999999999998},{"interface":"front","average":{"1min":1.325,"5min":1.7909999999999999,"15min":1.758},"min":{"1min":0.249,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":4.7149999999999999,"5min":17.018999999999998,"15min":29.736000000000001},"last":1.6970000000000001}]},{"osd":1,"last update":"Fri Oct 8 19:37:40 2021","interfaces":[{"interface":"back","average":{"1min":6.0330000000000004,"5min":2.617,"15min":2.141},"min":{"1min":0.217,"5min":0.215,"15min":0.19600000000000001},"max":{"1min":87.966999999999999,"5min":87.966999999999999,"15min":87.966999999999999},"last":2.1560000000000001},{"interface":"front","average":{"1min":1.635,"5min":1.9390000000000001,"15min":1.7010000000000001},"min":{"1min":0.23699999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":5.4279999999999999,"5min":17.056000000000001,"15min":28.119},"last":1.728}]},{"osd":2,"last update":"Fri Oct 8 19:37:40 2021","interfaces":[{"interface":"back","average":{"1min":1.9690000000000001,"5min":1.7729999999999999,"15min":1.766},"min":{"1min":0.32300000000000001,"5min":0.255,"15min":0.255},"max":{"1min":3.8039999999999998,"5min":5.7130000000000001,"15min":27.018000000000001},"last":2.1859999999999999},{"interface":"front","average":{"1min":1.581,"5min":1.5860000000000001,"15min":1.6180000000000001},"min":{"1min":0.254,"5min":0.253,"15min":0.253},"max":{"1min":8.2370000000000001,"5min":8.4090000000000007,"15min":27.113},"last":0.66200000000000003}]},{"osd":3,"last update":"Fri Oct 8 19:37:40 2021","interfaces":[{"interface":"back","average":{"1min":1.8640000000000001,"5min":2.101,"15min":2.2770000000000001},"min":{"1min":0.311,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":4.0880000000000001,"5min":24.945,"15min":72.093999999999994},"last":0.68700000000000006},{"interface":"front","average":{"1min":2.2610000000000001,"5min":2.129,"15min":2.2010000000000001},"min":{"1min":0.34699999999999998,"5min":0.33000000000000002,"15min":0.28000000000000003},"max":{"1min":7.1760000000000002,"5min":17.103999999999999,"15min":71.864999999999995},"last":1.8109999999999999}]},{"osd":4,"last update":"Fri Oct 8 19:37:40 2021","interfaces":[{"interface":"back","average":{"1min":4.1769999999999996,"5min":1.8129999999999999,"15min":1.137},"min":{"1min":0.26300000000000001,"5min":0.249,"15min":0.22800000000000001},"max":{"1min":55.890999999999998,"5min":55.890999999999998,"15min":55.890999999999998},"last":0.81499999999999995},{"interface":"front","average":{"1min":4.3639999999999999,"5min":2.125,"15min":1.242},"min":{"1min":0.28100000000000003,"5min":0.254,"15min":0.254},"max":{"1min":54.448999999999998,"5min":54.448999999999998,"15min":54.448999999999998},"last":0.63}]},{"osd":5,"last update":"Fri Oct 8 19:37:40 2021","interfaces":[{"interface":"back","average":{"1min":1.5920000000000001,"5min":1.282,"15min":1.0669999999999999},"min":{"1min":0.30299999999999999,"5min":0.28000000000000003,"15min":0.251},"max":{"1min":5.819,"5min":6.5389999999999997,"15min":9.9280000000000008},"last":0.78300000000000003},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.6759999999999999,"15min":1.1120000000000001},"min":{"1min":0.32500000000000001,"5min":0.28299999999999997,"15min":0.26100000000000001},"max":{"1min":3.25,"5min":16.093,"15min":18.655000000000001},"last":0.72599999999999998}]},{"osd":6,"last update":"Fri Oct 8 19:37:40 2021","interfaces":[{"interface":"back","average":{"1min":4.5890000000000004,"5min":2.1389999999999998,"15min":1.3200000000000001},"min":{"1min":0.32100000000000001,"5min":0.307,"15min":0.27900000000000003},"max":{"1min":58.039000000000001,"5min":58.039000000000001,"15min":58.039000000000001},"last":1.659},{"interface":"front","average":{"1min":4.6589999999999998,"5min":2.0539999999999998,"15min":1.3029999999999999},"min":{"1min":0.45300000000000001,"5min":0.31900000000000001,"15min":0.30299999999999999},"max":{"1min":58.079999999999998,"5min":58.079999999999998,"15min":58.079999999999998},"last":0.74399999999999999}]}]},{"osd":6,"up_from":47,"seq":201863463126,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":689460,"kb_used_data":419692,"kb_used_omap":0,"kb_used_meta":269760,"kb_avail":93055692,"statfs":{"total":95995035648,"available":95289028608,"internally_reserved":0,"allocated":429764608,"data_stored":429199821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":276234240},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,5,4,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:38:20 2021","interfaces":[{"interface":"back","average":{"1min":1.988,"5min":1.504,"15min":1.4419999999999999},"min":{"1min":0.214,"5min":0.214,"15min":0.20100000000000001},"max":{"1min":9.7780000000000005,"5min":9.7780000000000005,"15min":28.382999999999999},"last":2.1579999999999999},{"interface":"front","average":{"1min":1.8180000000000001,"5min":1.897,"15min":2.0499999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.21299999999999999},"max":{"1min":3.5750000000000002,"5min":16.173999999999999,"15min":69.477000000000004},"last":2.867}]},{"osd":1,"last update":"Fri Oct 8 19:38:20 2021","interfaces":[{"interface":"back","average":{"1min":2.1499999999999999,"5min":1.728,"15min":1.383},"min":{"1min":0.251,"5min":0.23699999999999999,"15min":0.23000000000000001},"max":{"1min":5.7640000000000002,"5min":6.1050000000000004,"15min":14.878},"last":3.3999999999999999},{"interface":"front","average":{"1min":2.222,"5min":1.7689999999999999,"15min":1.4590000000000001},"min":{"1min":0.28000000000000003,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":5.5469999999999997,"5min":7.0090000000000003,"15min":14.779},"last":2.1379999999999999}]},{"osd":2,"last update":"Fri Oct 8 19:38:20 2021","interfaces":[{"interface":"back","average":{"1min":2.3620000000000001,"5min":1.603,"15min":1.837},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.251},"max":{"1min":10.304,"5min":10.304,"15min":69.322999999999993},"last":2.1709999999999998},{"interface":"front","average":{"1min":1.7709999999999999,"5min":2.1259999999999999,"15min":2.1200000000000001},"min":{"1min":0.32700000000000001,"5min":0.27100000000000002,"15min":0.245},"max":{"1min":2.9950000000000001,"5min":13.339,"15min":69.418999999999997},"last":2.9020000000000001}]},{"osd":3,"last update":"Fri Oct 8 19:38:20 2021","interfaces":[{"interface":"back","average":{"1min":2.3479999999999999,"5min":1.8049999999999999,"15min":1.7370000000000001},"min":{"1min":0.34499999999999997,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":8.7300000000000004,"5min":8.7300000000000004,"15min":21.670000000000002},"last":3.4359999999999999},{"interface":"front","average":{"1min":2.5640000000000001,"5min":1.992,"15min":1.6559999999999999},"min":{"1min":0.42099999999999999,"5min":0.29099999999999998,"15min":0.28000000000000003},"max":{"1min":6.609,"5min":14.867000000000001,"15min":22.254999999999999},"last":2.1880000000000002}]},{"osd":4,"last update":"Fri Oct 8 19:38:20 2021","interfaces":[{"interface":"back","average":{"1min":1.881,"5min":1.456,"15min":1.0880000000000001},"min":{"1min":0.26700000000000002,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":4.7169999999999996,"5min":5.6989999999999998,"15min":24.516999999999999},"last":4.0279999999999996},{"interface":"front","average":{"1min":1.964,"5min":1.585,"15min":1.323},"min":{"1min":0.28899999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":8.8379999999999992,"5min":9.9079999999999995,"15min":69.593999999999994},"last":3.464}]},{"osd":5,"last update":"Fri Oct 8 19:38:20 2021","interfaces":[{"interface":"back","average":{"1min":2.4420000000000002,"5min":3.012,"15min":1.8120000000000001},"min":{"1min":0.38700000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":8.0830000000000002,"5min":107.485,"15min":107.485},"last":6.5519999999999996},{"interface":"front","average":{"1min":1.8460000000000001,"5min":2.968,"15min":2.0310000000000001},"min":{"1min":0.41399999999999998,"5min":0.251,"15min":0.251},"max":{"1min":5.819,"5min":107.90300000000001,"15min":107.90300000000001},"last":3.4860000000000002}]},{"osd":7,"last update":"Fri Oct 8 19:37:47 2021","interfaces":[{"interface":"back","average":{"1min":2.1150000000000002,"5min":1.5609999999999999,"15min":1.0609999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.27800000000000002},"max":{"1min":5.2080000000000002,"5min":8.8840000000000003,"15min":8.8840000000000003},"last":2.2090000000000001},{"interface":"front","average":{"1min":2.5219999999999998,"5min":1.752,"15min":1.24},"min":{"1min":0.40000000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":8.3740000000000006,"5min":8.3740000000000006,"15min":15.962},"last":6.5860000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575081,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":505436,"kb_used_data":172756,"kb_used_omap":0,"kb_used_meta":332672,"kb_avail":93239716,"statfs":{"total":95995035648,"available":95477469184,"internally_reserved":0,"allocated":176902144,"data_stored":176296833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":340656128},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:38:06 2021","interfaces":[{"interface":"back","average":{"1min":3.4129999999999998,"5min":2.2410000000000001,"15min":3.4580000000000002},"min":{"1min":0.22500000000000001,"5min":0.188,"15min":0.188},"max":{"1min":43.786000000000001,"5min":43.786000000000001,"15min":126.256},"last":0.63},{"interface":"front","average":{"1min":4.0860000000000003,"5min":2.532,"15min":3.7400000000000002},"min":{"1min":0.28399999999999997,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":42.174999999999997,"5min":42.174999999999997,"15min":126.176},"last":4.6600000000000001}]},{"osd":2,"last update":"Fri Oct 8 19:38:27 2021","interfaces":[{"interface":"back","average":{"1min":1.8180000000000001,"5min":1.6539999999999999,"15min":2.5369999999999999},"min":{"1min":0.21199999999999999,"5min":0.192,"15min":0.192},"max":{"1min":9.6669999999999998,"5min":11.497,"15min":102.395},"last":0.42299999999999999},{"interface":"front","average":{"1min":1.7909999999999999,"5min":1.5980000000000001,"15min":2.8559999999999999},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.22700000000000001},"max":{"1min":7.0410000000000004,"5min":9.8650000000000002,"15min":102.50700000000001},"last":4.5679999999999996}]},{"osd":3,"last update":"Fri Oct 8 19:37:37 2021","interfaces":[{"interface":"back","average":{"1min":1.8029999999999999,"5min":2.0840000000000001,"15min":2.903},"min":{"1min":0.34499999999999997,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":6.1109999999999998,"5min":33.655000000000001,"15min":105.836},"last":5.4880000000000004},{"interface":"front","average":{"1min":2.0350000000000001,"5min":2.1379999999999999,"15min":2.7679999999999998},"min":{"1min":0.29599999999999999,"5min":0.27700000000000002,"15min":0.22900000000000001},"max":{"1min":6.5609999999999999,"5min":33.582999999999998,"15min":106.12},"last":0.52900000000000003}]},{"osd":4,"last update":"Fri Oct 8 19:37:47 2021","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":1.6819999999999999,"15min":2.0800000000000001},"min":{"1min":0.33000000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":6.0659999999999998,"5min":7.2370000000000001,"15min":103.538},"last":4.6950000000000003},{"interface":"front","average":{"1min":2.1259999999999999,"5min":1.512,"15min":1.7350000000000001},"min":{"1min":0.435,"5min":0.29299999999999998,"15min":0.254},"max":{"1min":5.3639999999999999,"5min":11.337999999999999,"15min":102.67100000000001},"last":0.36899999999999999}]},{"osd":5,"last update":"Fri Oct 8 19:38:17 2021","interfaces":[{"interface":"back","average":{"1min":1.827,"5min":4.7729999999999997,"15min":3.2090000000000001},"min":{"1min":0.436,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":6.9569999999999999,"5min":262.14100000000002,"15min":262.14100000000002},"last":4.609},{"interface":"front","average":{"1min":1.5189999999999999,"5min":4.9180000000000001,"15min":2.952},"min":{"1min":0.33100000000000002,"5min":0.30099999999999999,"15min":0.29999999999999999},"max":{"1min":9.7289999999999992,"5min":261.959,"15min":261.959},"last":0.40100000000000002}]},{"osd":6,"last update":"Fri Oct 8 19:38:30 2021","interfaces":[{"interface":"back","average":{"1min":2.0899999999999999,"5min":1.8129999999999999,"15min":2.2200000000000002},"min":{"1min":0.38700000000000001,"5min":0.32500000000000001,"15min":0.26700000000000002},"max":{"1min":13.837,"5min":13.837,"15min":103.73},"last":5.6539999999999999},{"interface":"front","average":{"1min":1.357,"5min":1.4410000000000001,"15min":2.1589999999999998},"min":{"1min":0.48199999999999998,"5min":0.34399999999999997,"15min":0.33800000000000002},"max":{"1min":3.9470000000000001,"5min":6.915,"15min":102.753},"last":4.7480000000000002}]},{"osd":7,"last update":"Fri Oct 8 19:37:47 2021","interfaces":[{"interface":"back","average":{"1min":1.8759999999999999,"5min":1.4770000000000001,"15min":2.5529999999999999},"min":{"1min":0.436,"5min":0.316,"15min":0.312},"max":{"1min":7.0979999999999999,"5min":7.0979999999999999,"15min":106.011},"last":4.633},{"interface":"front","average":{"1min":1.52,"5min":1.6419999999999999,"15min":2.2240000000000002},"min":{"1min":0.373,"5min":0.36699999999999999,"15min":0.34200000000000003},"max":{"1min":5.407,"5min":11.445,"15min":103.78400000000001},"last":0.45000000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738604,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":938496,"kb_used_data":601912,"kb_used_omap":0,"kb_used_meta":336384,"kb_avail":92806656,"statfs":{"total":95995035648,"available":95034015744,"internally_reserved":0,"allocated":616357888,"data_stored":615780444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":344457216},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,1,0,0,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 8 19:38:00 2021","interfaces":[{"interface":"back","average":{"1min":2.5899999999999999,"5min":1.605,"15min":2.3159999999999998},"min":{"1min":0.17499999999999999,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":16.632000000000001,"5min":16.632000000000001,"15min":91.954999999999998},"last":0.23699999999999999},{"interface":"front","average":{"1min":2.1179999999999999,"5min":2.036,"15min":2.4329999999999998},"min":{"1min":0.20599999999999999,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":7.6909999999999998,"5min":11.113,"15min":91.046000000000006},"last":0.247}]},{"osd":2,"last update":"Fri Oct 8 19:38:22 2021","interfaces":[{"interface":"back","average":{"1min":1.9490000000000001,"5min":1.794,"15min":2.234},"min":{"1min":0.26600000000000001,"5min":0.217,"15min":0.217},"max":{"1min":8.2219999999999995,"5min":9.8030000000000008,"15min":62.390000000000001},"last":0.26800000000000002},{"interface":"front","average":{"1min":1.655,"5min":1.901,"15min":2.1739999999999999},"min":{"1min":0.23400000000000001,"5min":0.21099999999999999,"15min":0.19500000000000001},"max":{"1min":7.1459999999999999,"5min":10.109,"15min":62.718000000000004},"last":1.8919999999999999}]},{"osd":3,"last update":"Fri Oct 8 19:37:42 2021","interfaces":[{"interface":"back","average":{"1min":2.1640000000000001,"5min":1.982,"15min":2.3719999999999999},"min":{"1min":0.218,"5min":0.218,"15min":0.217},"max":{"1min":7.6479999999999997,"5min":11.068,"15min":62.491},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.9119999999999999,"5min":1.6699999999999999,"15min":2.1379999999999999},"min":{"1min":0.221,"5min":0.221,"15min":0.20899999999999999},"max":{"1min":7.1740000000000004,"5min":10.052,"15min":62.673000000000002},"last":1.923}]},{"osd":4,"last update":"Fri Oct 8 19:38:00 2021","interfaces":[{"interface":"back","average":{"1min":2.5299999999999998,"5min":1.6359999999999999,"15min":1.772},"min":{"1min":0.29999999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":12.135,"5min":12.135,"15min":16.805},"last":0.26400000000000001},{"interface":"front","average":{"1min":1.47,"5min":1.601,"15min":1.504},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":5.4710000000000001,"5min":7.0890000000000004,"15min":11.823},"last":5.0300000000000002}]},{"osd":5,"last update":"Fri Oct 8 19:38:12 2021","interfaces":[{"interface":"back","average":{"1min":2.2879999999999998,"5min":1.8049999999999999,"15min":1.5349999999999999},"min":{"1min":0.432,"5min":0.28199999999999997,"15min":0.24099999999999999},"max":{"1min":7.25,"5min":9.9730000000000008,"15min":15.56},"last":1.944},{"interface":"front","average":{"1min":3.4119999999999999,"5min":1.9870000000000001,"15min":1.855},"min":{"1min":0.35999999999999999,"5min":0.30599999999999999,"15min":0.28599999999999998},"max":{"1min":12.095000000000001,"5min":15.115,"15min":15.484999999999999},"last":0.34599999999999997}]},{"osd":6,"last update":"Fri Oct 8 19:38:30 2021","interfaces":[{"interface":"back","average":{"1min":1.8360000000000001,"5min":1.762,"15min":1.6899999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":5.931,"5min":7.165,"15min":11.869},"last":0.48499999999999999},{"interface":"front","average":{"1min":2.855,"5min":1.984,"15min":1.734},"min":{"1min":0.48899999999999999,"5min":0.28199999999999997,"15min":0.27500000000000002},"max":{"1min":7.1950000000000003,"5min":10.002000000000001,"15min":10.519},"last":1.966}]},{"osd":7,"last update":"Fri Oct 8 19:37:42 2021","interfaces":[{"interface":"back","average":{"1min":2.6030000000000002,"5min":1.865,"15min":1.8440000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":13.214,"5min":13.214,"15min":13.214},"last":0.40300000000000002},{"interface":"front","average":{"1min":1.8660000000000001,"5min":1.8520000000000001,"15min":1.8460000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":7.4050000000000002,"5min":7.4050000000000002,"15min":11.898999999999999},"last":0.42299999999999999}]}]},{"osd":2,"up_from":18,"seq":77309411556,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":656944,"kb_used_data":367144,"kb_used_omap":0,"kb_used_meta":289728,"kb_avail":93088208,"statfs":{"total":95995035648,"available":95322324992,"internally_reserved":0,"allocated":375955456,"data_stored":375394781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":296681472},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,3,1,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:38:15 2021","interfaces":[{"interface":"back","average":{"1min":2.8900000000000001,"5min":1.819,"15min":2.5310000000000001},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.184},"max":{"1min":10.176,"5min":10.83,"15min":61.670999999999999},"last":2.371},{"interface":"front","average":{"1min":2.8700000000000001,"5min":1.839,"15min":2.5},"min":{"1min":0.22,"5min":0.20000000000000001,"15min":0.17999999999999999},"max":{"1min":9.0909999999999993,"5min":9.1630000000000003,"15min":65.284999999999997},"last":0.70399999999999996}]},{"osd":1,"last update":"Fri Oct 8 19:38:15 2021","interfaces":[{"interface":"back","average":{"1min":2.6699999999999999,"5min":2.4340000000000002,"15min":2.8199999999999998},"min":{"1min":0.28299999999999997,"5min":0.19700000000000001,"15min":0.192},"max":{"1min":10.218999999999999,"5min":63.738,"15min":63.738},"last":0.56100000000000005},{"interface":"front","average":{"1min":2.4660000000000002,"5min":2.569,"15min":3.0030000000000001},"min":{"1min":0.252,"5min":0.23899999999999999,"15min":0.21299999999999999},"max":{"1min":11.988,"5min":63.619999999999997,"15min":63.619999999999997},"last":0.48799999999999999}]},{"osd":3,"last update":"Fri Oct 8 19:38:21 2021","interfaces":[{"interface":"back","average":{"1min":2.3039999999999998,"5min":2.6190000000000002,"15min":3.2210000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.21199999999999999},"max":{"1min":12.012,"5min":67.198999999999998,"15min":67.198999999999998},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.847,"5min":2.4700000000000002,"15min":3.125},"min":{"1min":0.28299999999999997,"5min":0.22900000000000001,"15min":0.21299999999999999},"max":{"1min":5.5389999999999997,"5min":66.963999999999999,"15min":66.963999999999999},"last":3.7669999999999999}]},{"osd":4,"last update":"Fri Oct 8 19:37:47 2021","interfaces":[{"interface":"back","average":{"1min":2.4039999999999999,"5min":1.52,"15min":1.627},"min":{"1min":0.33200000000000002,"5min":0.27800000000000002,"15min":0.26900000000000002},"max":{"1min":10.988,"5min":10.988,"15min":24.657},"last":3.714},{"interface":"front","average":{"1min":2.6899999999999999,"5min":1.6759999999999999,"15min":1.7250000000000001},"min":{"1min":0.318,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":11.912000000000001,"5min":11.912000000000001,"15min":15.143000000000001},"last":1.744}]},{"osd":5,"last update":"Fri Oct 8 19:38:15 2021","interfaces":[{"interface":"back","average":{"1min":2.4950000000000001,"5min":1.978,"15min":1.8100000000000001},"min":{"1min":0.29299999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":11.956,"5min":11.956,"15min":15.087999999999999},"last":1.208},{"interface":"front","average":{"1min":2.1659999999999999,"5min":1.782,"15min":1.786},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.27600000000000002},"max":{"1min":6.9560000000000004,"5min":8.1769999999999996,"15min":26.094000000000001},"last":0.54300000000000004}]},{"osd":6,"last update":"Fri Oct 8 19:38:21 2021","interfaces":[{"interface":"back","average":{"1min":1.5640000000000001,"5min":1.7569999999999999,"15min":1.681},"min":{"1min":0.34000000000000002,"5min":0.29999999999999999,"15min":0.28000000000000003},"max":{"1min":4.9130000000000003,"5min":11.023999999999999,"15min":14.162000000000001},"last":3.9380000000000002},{"interface":"front","average":{"1min":2.3420000000000001,"5min":2.1280000000000001,"15min":1.8400000000000001},"min":{"1min":0.378,"5min":0.31,"15min":0.31},"max":{"1min":8.5,"5min":8.7829999999999995,"15min":16.68},"last":0.52400000000000002}]},{"osd":7,"last update":"Fri Oct 8 19:37:47 2021","interfaces":[{"interface":"back","average":{"1min":2.2810000000000001,"5min":3.4950000000000001,"15min":2.3490000000000002},"min":{"1min":0.51800000000000002,"5min":0.32600000000000001,"15min":0.31900000000000001},"max":{"1min":11.045999999999999,"5min":136.00200000000001,"15min":136.00200000000001},"last":3.7450000000000001},{"interface":"front","average":{"1min":2.145,"5min":3.3860000000000001,"15min":2.2719999999999998},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":7.0049999999999999,"5min":133.26300000000001,"15min":133.26300000000001},"last":3.5539999999999998}]}]},{"osd":3,"up_from":24,"seq":103079215330,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":669396,"kb_used_data":285004,"kb_used_omap":0,"kb_used_meta":384256,"kb_avail":93075756,"statfs":{"total":95995035648,"available":95309574144,"internally_reserved":0,"allocated":291844096,"data_stored":291247567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":393478144},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:37:32 2021","interfaces":[{"interface":"back","average":{"1min":1.7250000000000001,"5min":2.1240000000000001,"15min":2.5089999999999999},"min":{"1min":0.187,"5min":0.187,"15min":0.17000000000000001},"max":{"1min":4.3769999999999998,"5min":13.036,"15min":109.601},"last":5.5},{"interface":"front","average":{"1min":1.9790000000000001,"5min":1.6060000000000001,"15min":2.4359999999999999},"min":{"1min":0.20799999999999999,"5min":0.20200000000000001,"15min":0.19500000000000001},"max":{"1min":9.5530000000000008,"5min":10.997,"15min":107.84},"last":3.2679999999999998}]},{"osd":1,"last update":"Fri Oct 8 19:37:32 2021","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":1.5329999999999999,"15min":2.0219999999999998},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":3.7829999999999999,"5min":13.228999999999999,"15min":37.271999999999998},"last":3.1829999999999998},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.3460000000000001,"15min":1.972},"min":{"1min":0.223,"5min":0.215,"15min":0.19},"max":{"1min":9.0229999999999997,"5min":9.0229999999999997,"15min":37.033000000000001},"last":1.1639999999999999}]},{"osd":2,"last update":"Fri Oct 8 19:37:32 2021","interfaces":[{"interface":"back","average":{"1min":1.798,"5min":1.26,"15min":1.952},"min":{"1min":0.246,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":8.1880000000000006,"5min":8.1880000000000006,"15min":32.277000000000001},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.9970000000000001,"5min":2.1080000000000001,"15min":2.0179999999999998},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":5.6200000000000001,"5min":23.189,"15min":23.189},"last":0.30399999999999999}]},{"osd":4,"last update":"Fri Oct 8 19:37:49 2021","interfaces":[{"interface":"back","average":{"1min":1.8819999999999999,"5min":1.9550000000000001,"15min":1.7370000000000001},"min":{"1min":0.29399999999999998,"5min":0.28100000000000003,"15min":0.25600000000000001},"max":{"1min":8.7940000000000005,"5min":13.968,"15min":18.064},"last":1.6619999999999999},{"interface":"front","average":{"1min":1.9219999999999999,"5min":1.774,"15min":1.827},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.26900000000000002},"max":{"1min":5.6319999999999997,"5min":8.8460000000000001,"15min":18.692},"last":3.8969999999999998}]},{"osd":5,"last update":"Fri Oct 8 19:38:09 2021","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":2.097,"15min":1.8500000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.27000000000000002},"max":{"1min":3.8980000000000001,"5min":75.397000000000006,"15min":75.397000000000006},"last":0.85999999999999999},{"interface":"front","average":{"1min":1.772,"5min":3.0600000000000001,"15min":2.2050000000000001},"min":{"1min":0.44600000000000001,"5min":0.32600000000000001,"15min":0.28100000000000003},"max":{"1min":8.7579999999999991,"5min":75.680000000000007,"15min":75.680000000000007},"last":5.577}]},{"osd":6,"last update":"Fri Oct 8 19:38:21 2021","interfaces":[{"interface":"back","average":{"1min":1.601,"5min":1.675,"15min":1.921},"min":{"1min":0.39400000000000002,"5min":0.32600000000000001,"15min":0.28599999999999998},"max":{"1min":5.6900000000000004,"5min":9.5,"15min":17.512},"last":3.8460000000000001},{"interface":"front","average":{"1min":2.3849999999999998,"5min":1.627,"15min":1.762},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":8.9779999999999998,"5min":8.9779999999999998,"15min":13.298},"last":1.4330000000000001}]},{"osd":7,"last update":"Fri Oct 8 19:37:49 2021","interfaces":[{"interface":"back","average":{"1min":1.966,"5min":2.0649999999999999,"15min":1.8300000000000001},"min":{"1min":0.371,"5min":0.35799999999999998,"15min":0.32200000000000001},"max":{"1min":8.7260000000000009,"5min":8.9000000000000004,"15min":10.696999999999999},"last":3.8759999999999999},{"interface":"front","average":{"1min":2.4710000000000001,"5min":1.7090000000000001,"15min":1.694},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":9.0239999999999991,"5min":9.0239999999999991,"15min":13.225},"last":0.89000000000000001}]}]},{"osd":4,"up_from":30,"seq":128849019100,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":739600,"kb_used_data":473160,"kb_used_omap":0,"kb_used_meta":266432,"kb_avail":93005552,"statfs":{"total":95995035648,"available":95237685248,"internally_reserved":0,"allocated":484515840,"data_stored":483923410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":272826368},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,3,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:37:49 2021","interfaces":[{"interface":"back","average":{"1min":1.7010000000000001,"5min":1.3140000000000001,"15min":1.849},"min":{"1min":0.219,"5min":0.20899999999999999,"15min":0.185},"max":{"1min":4.875,"5min":7.1319999999999997,"15min":82.109999999999999},"last":3.1659999999999999},{"interface":"front","average":{"1min":1.403,"5min":1.3859999999999999,"15min":1.8360000000000001},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.20399999999999999},"max":{"1min":7.3760000000000003,"5min":7.9340000000000002,"15min":82.025999999999996},"last":0.32800000000000001}]},{"osd":1,"last update":"Fri Oct 8 19:37:49 2021","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":3.048,"15min":2.2570000000000001},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":4.2370000000000001,"5min":122.422,"15min":122.422},"last":2.2160000000000002},{"interface":"front","average":{"1min":1.113,"5min":2.7410000000000001,"15min":1.962},"min":{"1min":0.247,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":3.6560000000000001,"5min":123.122,"15min":123.122},"last":3.0979999999999999}]},{"osd":2,"last update":"Fri Oct 8 19:37:49 2021","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.268,"15min":1.419},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":6.2720000000000002,"5min":6.2720000000000002,"15min":21.257000000000001},"last":3.1829999999999998},{"interface":"front","average":{"1min":1.8759999999999999,"5min":1.45,"15min":1.4790000000000001},"min":{"1min":0.29899999999999999,"5min":0.221,"15min":0.221},"max":{"1min":7.5010000000000003,"5min":7.5010000000000003,"15min":21.600000000000001},"last":2.2490000000000001}]},{"osd":3,"last update":"Fri Oct 8 19:37:49 2021","interfaces":[{"interface":"back","average":{"1min":1.5109999999999999,"5min":1.6910000000000001,"15min":2.177},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.26500000000000001},"max":{"1min":7.468,"5min":7.468,"15min":58.506999999999998},"last":2.407},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.427,"15min":1.845},"min":{"1min":0.27000000000000002,"5min":0.254,"15min":0.254},"max":{"1min":3.3580000000000001,"5min":8.5540000000000003,"15min":58.521000000000001},"last":2.2669999999999999}]},{"osd":5,"last update":"Fri Oct 8 19:38:10 2021","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.4139999999999999,"15min":0.998},"min":{"1min":0.27800000000000002,"5min":0.25900000000000001,"15min":0.23899999999999999},"max":{"1min":3.411,"5min":10.477,"15min":10.477},"last":2.2909999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":1.1439999999999999,"15min":0.88300000000000001},"min":{"1min":0.28799999999999998,"5min":0.27700000000000002,"15min":0.22900000000000001},"max":{"1min":2.383,"5min":6.1900000000000004,"15min":8.1319999999999997},"last":3.1269999999999998}]},{"osd":6,"last update":"Fri Oct 8 19:38:26 2021","interfaces":[{"interface":"back","average":{"1min":12.135999999999999,"5min":4.181,"15min":1.9359999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.23599999999999999},"max":{"1min":171.69800000000001,"5min":171.69800000000001,"15min":171.69800000000001},"last":2.351},{"interface":"front","average":{"1min":12.487,"5min":4.3959999999999999,"15min":2.0289999999999999},"min":{"1min":0.35799999999999998,"5min":0.308,"15min":0.247},"max":{"1min":171.613,"5min":171.613,"15min":171.613},"last":2.1440000000000001}]},{"osd":7,"last update":"Fri Oct 8 19:37:49 2021","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":1.28,"15min":0.91100000000000003},"min":{"1min":0.314,"5min":0.30199999999999999,"15min":0.26400000000000001},"max":{"1min":5.2009999999999996,"5min":6.157,"15min":8.0050000000000008},"last":3.149},{"interface":"front","average":{"1min":1.9199999999999999,"5min":1.375,"15min":1.0269999999999999},"min":{"1min":0.32500000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":7.702,"5min":7.702,"15min":7.702},"last":2.0680000000000001}]}]},{"osd":5,"up_from":38,"seq":163208757464,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":639680,"kb_used_data":302328,"kb_used_omap":0,"kb_used_meta":337344,"kb_avail":93105472,"statfs":{"total":95995035648,"available":95340003328,"internally_reserved":0,"allocated":309583872,"data_stored":309008528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":345440256},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:38:11 2021","interfaces":[{"interface":"back","average":{"1min":3.0209999999999999,"5min":2.0259999999999998,"15min":1.5329999999999999},"min":{"1min":0.221,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":33.469999999999999,"5min":43.332999999999998,"15min":43.332999999999998},"last":0.50700000000000001},{"interface":"front","average":{"1min":3.7000000000000002,"5min":2.165,"15min":1.647},"min":{"1min":0.26300000000000001,"5min":0.216,"15min":0.216},"max":{"1min":32.857999999999997,"5min":42.637,"15min":42.637},"last":0.71899999999999997}]},{"osd":1,"last update":"Fri Oct 8 19:38:11 2021","interfaces":[{"interface":"back","average":{"1min":2.2559999999999998,"5min":2.3420000000000001,"15min":1.847},"min":{"1min":0.29299999999999998,"5min":0.23599999999999999,"15min":0.23000000000000001},"max":{"1min":8.9990000000000006,"5min":94.558999999999997,"15min":94.558999999999997},"last":2.5750000000000002},{"interface":"front","average":{"1min":1.2849999999999999,"5min":2.0579999999999998,"15min":1.7050000000000001},"min":{"1min":0.26000000000000001,"5min":0.23899999999999999,"15min":0.23100000000000001},"max":{"1min":5.4829999999999997,"5min":94.456999999999994,"15min":94.456999999999994},"last":2.5600000000000001}]},{"osd":2,"last update":"Fri Oct 8 19:38:11 2021","interfaces":[{"interface":"back","average":{"1min":2.4449999999999998,"5min":1.54,"15min":1.718},"min":{"1min":0.251,"5min":0.249,"15min":0.249},"max":{"1min":22.931999999999999,"5min":22.931999999999999,"15min":29.398},"last":0.29899999999999999},{"interface":"front","average":{"1min":2.8740000000000001,"5min":1.607,"15min":1.6799999999999999},"min":{"1min":0.28199999999999997,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":22.963999999999999,"5min":22.963999999999999,"15min":29.387},"last":0.94499999999999995}]},{"osd":3,"last update":"Fri Oct 8 19:38:11 2021","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.712,"15min":1.746},"min":{"1min":0.30499999999999999,"5min":0.27000000000000002,"15min":0.26200000000000001},"max":{"1min":4.1159999999999997,"5min":9.5899999999999999,"15min":12.356},"last":3.5819999999999999},{"interface":"front","average":{"1min":2.2349999999999999,"5min":1.8400000000000001,"15min":1.9119999999999999},"min":{"1min":0.29999999999999999,"5min":0.218,"15min":0.218},"max":{"1min":5.3849999999999998,"5min":8.9920000000000009,"15min":21.504000000000001},"last":0.436}]},{"osd":4,"last update":"Fri Oct 8 19:38:11 2021","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.1140000000000001,"15min":0.85299999999999998},"min":{"1min":0.29899999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":9.1600000000000001,"5min":9.1600000000000001,"15min":9.2759999999999998},"last":0.96499999999999997},{"interface":"front","average":{"1min":2.016,"5min":1.248,"15min":0.89900000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.25900000000000001},"max":{"1min":11.231,"5min":11.231,"15min":11.231},"last":0.39300000000000002}]},{"osd":6,"last update":"Fri Oct 8 19:38:24 2021","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.335,"15min":1.0049999999999999},"min":{"1min":0.29399999999999998,"5min":0.28499999999999998,"15min":0.255},"max":{"1min":3.3340000000000001,"5min":11.192,"15min":11.192},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.349,"15min":1},"min":{"1min":0.33000000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":4.1420000000000003,"5min":11.259,"15min":11.259},"last":0.46000000000000002}]},{"osd":7,"last update":"Fri Oct 8 19:37:46 2021","interfaces":[{"interface":"back","average":{"1min":1.5660000000000001,"5min":1.48,"15min":1.024},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":5.0519999999999996,"5min":29.946999999999999,"15min":29.946999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.468,"15min":1.077},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":4.2460000000000004,"5min":29.294,"15min":29.294},"last":1.6120000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":266240,"data_stored":262688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":327680,"data_stored":327680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":590155776,"data_stored":590151704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":167641088,"data_stored":167641088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":352321536,"data_stored":352321536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":289406976,"data_stored":289406976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":475664384,"data_stored":475660312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":303431680,"data_stored":303431680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":416813056,"data_stored":416808984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":238878720,"data_stored":238878720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-10-08T19:38:40.770 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph pg dump --format=json 2021-10-08T19:38:40.791 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:38:40.822 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:40 smithi117 ceph-mon[34585]: pgmap v864: 188 pgs: 188 active+clean; 642 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 478 B/s rd, 0 B/s wr, 1.11k op/s 2021-10-08T19:38:40.822 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:40 smithi117 ceph-mon[34585]: 5.2 scrub ok 2021-10-08T19:38:40.823 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:40 smithi117 ceph-mon[34585]: 6.7 scrub ok 2021-10-08T19:38:40.823 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:40 smithi117 ceph-mon[34585]: 4.9 scrub ok 2021-10-08T19:38:40.824 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:40.898 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:38:40.905 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:40.905 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:38:41.007 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:38:41.073 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:41.227 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2021-10-08T19:38:41.227 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:38:41.650 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:38:41.655 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:41.656 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:38:41.759 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:38:41.804 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:41.876 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is unset 2021-10-08T19:38:41.910 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:41 smithi097 ceph-mon[41966]: pgmap v865: 188 pgs: 188 active+clean; 554 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 913 B/s rd, 0 B/s wr, 1.08k op/s 2021-10-08T19:38:41.910 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:41 smithi097 ceph-mon[41966]: 10.5 scrub ok 2021-10-08T19:38:41.910 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:41 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1428750008' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:38:41.910 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:41 smithi097 ceph-mon[41966]: from='client.26062 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:38:41.911 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:41 smithi097 ceph-mon[32687]: pgmap v865: 188 pgs: 188 active+clean; 554 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 913 B/s rd, 0 B/s wr, 1.08k op/s 2021-10-08T19:38:41.911 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:41 smithi097 ceph-mon[32687]: 10.5 scrub ok 2021-10-08T19:38:41.912 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:41 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1428750008' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:38:41.912 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:41 smithi097 ceph-mon[32687]: from='client.26062 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:38:42.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:41 smithi117 ceph-mon[34585]: pgmap v865: 188 pgs: 188 active+clean; 554 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 913 B/s rd, 0 B/s wr, 1.08k op/s 2021-10-08T19:38:42.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:41 smithi117 ceph-mon[34585]: 10.5 scrub ok 2021-10-08T19:38:42.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:41 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1428750008' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:38:42.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:41 smithi117 ceph-mon[34585]: from='client.26062 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:38:42.245 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:38:42.248 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:42.249 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:38:42.353 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:38:42.381 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:42.739 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:38:42.744 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:42.744 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:38:42.848 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:38:42.849 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2021-10-08T19:38:42.901 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:42 smithi097 ceph-mon[32687]: 4.4 scrub ok 2021-10-08T19:38:42.902 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:42 smithi097 ceph-mon[32687]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:38:42.902 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:42 smithi097 ceph-mon[32687]: Cluster is now healthy 2021-10-08T19:38:42.902 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:42 smithi097 ceph-mon[32687]: from='client.26062 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:38:42.902 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:42 smithi097 ceph-mon[32687]: osdmap e427: 8 total, 8 up, 8 in 2021-10-08T19:38:42.903 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:42 smithi097 ceph-mon[32687]: 2.12 scrub ok 2021-10-08T19:38:42.903 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:42 smithi097 ceph-mon[32687]: 4.6 scrub ok 2021-10-08T19:38:42.903 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:42 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:38:42.904 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:38:42 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:38:42] "GET /metrics HTTP/1.1" 200 155891 "" "Prometheus/2.18.1" 2021-10-08T19:38:42.904 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:42 smithi097 ceph-mon[41966]: 4.4 scrub ok 2021-10-08T19:38:42.904 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:42 smithi097 ceph-mon[41966]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:38:42.904 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:42 smithi097 ceph-mon[41966]: Cluster is now healthy 2021-10-08T19:38:42.905 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:42 smithi097 ceph-mon[41966]: from='client.26062 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:38:42.905 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:42 smithi097 ceph-mon[41966]: osdmap e427: 8 total, 8 up, 8 in 2021-10-08T19:38:42.905 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:42 smithi097 ceph-mon[41966]: 2.12 scrub ok 2021-10-08T19:38:42.905 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:42 smithi097 ceph-mon[41966]: 4.6 scrub ok 2021-10-08T19:38:42.905 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:42 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:38:42.906 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:43.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:42 smithi117 ceph-mon[34585]: 4.4 scrub ok 2021-10-08T19:38:43.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:42 smithi117 ceph-mon[34585]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:38:43.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:42 smithi117 ceph-mon[34585]: Cluster is now healthy 2021-10-08T19:38:43.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:42 smithi117 ceph-mon[34585]: from='client.26062 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:38:43.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:42 smithi117 ceph-mon[34585]: osdmap e427: 8 total, 8 up, 8 in 2021-10-08T19:38:43.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:42 smithi117 ceph-mon[34585]: 2.12 scrub ok 2021-10-08T19:38:43.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:42 smithi117 ceph-mon[34585]: 4.6 scrub ok 2021-10-08T19:38:43.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:42 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:38:43.391 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:38:43.394 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:43.394 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:38:43.495 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:38:43.536 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:43.590 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:38:43.592 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:43.593 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:38:43.605 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:38:43.695 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:38:43.727 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:43.811 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:38:43.817 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:43.818 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:38:43.819 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:38:43 smithi117 conmon[69189]: level=error ts=2021-10-08T19:38:43.506Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=2 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:38:43.920 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:38:43.979 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:44.087 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:38:44.093 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:44.094 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:38:44.094 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:43 smithi097 ceph-mon[41966]: 2.1a scrub ok 2021-10-08T19:38:44.094 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:43 smithi097 ceph-mon[41966]: 2.6 scrub ok 2021-10-08T19:38:44.095 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:38:44.095 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:43 smithi097 ceph-mon[41966]: pgmap v867: 188 pgs: 188 active+clean; 554 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 921 B/s rd, 0 B/s wr, 1.09k op/s 2021-10-08T19:38:44.095 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:43 smithi097 ceph-mon[41966]: 5.5 scrub ok 2021-10-08T19:38:44.095 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:43 smithi097 ceph-mon[41966]: 3.14 scrub ok 2021-10-08T19:38:44.096 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:43 smithi097 ceph-mon[32687]: 2.1a scrub ok 2021-10-08T19:38:44.096 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:43 smithi097 ceph-mon[32687]: 2.6 scrub ok 2021-10-08T19:38:44.096 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:38:44.096 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:43 smithi097 ceph-mon[32687]: pgmap v867: 188 pgs: 188 active+clean; 554 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 921 B/s rd, 0 B/s wr, 1.09k op/s 2021-10-08T19:38:44.097 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:43 smithi097 ceph-mon[32687]: 5.5 scrub ok 2021-10-08T19:38:44.097 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:43 smithi097 ceph-mon[32687]: 3.14 scrub ok 2021-10-08T19:38:44.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:38:43 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:38:43] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:38:44.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:43 smithi117 ceph-mon[34585]: 2.1a scrub ok 2021-10-08T19:38:44.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:43 smithi117 ceph-mon[34585]: 2.6 scrub ok 2021-10-08T19:38:44.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:38:44.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:43 smithi117 ceph-mon[34585]: pgmap v867: 188 pgs: 188 active+clean; 554 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 921 B/s rd, 0 B/s wr, 1.09k op/s 2021-10-08T19:38:44.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:43 smithi117 ceph-mon[34585]: 5.5 scrub ok 2021-10-08T19:38:44.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:43 smithi117 ceph-mon[34585]: 3.14 scrub ok 2021-10-08T19:38:44.195 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:38:44.257 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:44.372 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:38:44.467 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:38:44.470 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:44.470 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:38:44.572 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:38:44.614 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:44.692 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:38:44.698 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:44.700 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:38:44.743 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:38:44.744 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:38:44.744 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:38:44.744 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:38:44.744 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:38:44.745 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:38:44.745 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:38:44.745 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:38:44.745 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true' 2021-10-08T19:38:44.746 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true' 2021-10-08T19:38:44.746 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true' 2021-10-08T19:38:44.746 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true' 2021-10-08T19:38:44.746 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true' 2021-10-08T19:38:44.747 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true' 2021-10-08T19:38:44.747 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'true' 2021-10-08T19:38:44.747 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'true' 2021-10-08T19:38:44.802 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:38:44.853 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:45.132 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:44 smithi097 ceph-mon[32687]: 1.9 scrub ok 2021-10-08T19:38:45.132 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:44 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1379226310' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:38:45.133 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:44 smithi097 ceph-mon[41966]: 1.9 scrub ok 2021-10-08T19:38:45.133 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:44 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1379226310' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:38:45.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:44 smithi117 ceph-mon[34585]: 1.9 scrub ok 2021-10-08T19:38:45.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:44 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1379226310' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:38:45.590 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set noscrub 2021-10-08T19:38:45.902 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:45 smithi097 ceph-mon[32687]: pgmap v868: 188 pgs: 188 active+clean; 214 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.10k op/s 2021-10-08T19:38:45.903 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:45 smithi097 ceph-mon[41966]: pgmap v868: 188 pgs: 188 active+clean; 214 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.10k op/s 2021-10-08T19:38:45.903 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:45 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:38:45.903 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:45 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:38:46.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:45 smithi117 ceph-mon[34585]: pgmap v868: 188 pgs: 188 active+clean; 214 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.10k op/s 2021-10-08T19:38:46.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:45 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:38:46.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:45 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:38:46.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:45 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:38:46.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:45 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:38:46.757 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Removed 118499 objects 2021-10-08T19:38:46.758 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Clean up completed and total clean up time :110.339 2021-10-08T19:38:46.865 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:38:46.867 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:46.868 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:38:46.968 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:38:47.052 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:47.127 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:46 smithi097 ceph-mon[41966]: 6.a scrub ok 2021-10-08T19:38:47.127 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:46 smithi097 ceph-mon[41966]: 2.4 deep-scrub ok 2021-10-08T19:38:47.128 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:46 smithi097 ceph-mon[41966]: osdmap e428: 8 total, 8 up, 8 in 2021-10-08T19:38:47.128 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:46 smithi097 ceph-mon[41966]: 6.16 deep-scrub ok 2021-10-08T19:38:47.128 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:46 smithi097 ceph-mon[41966]: 2.10 scrub ok 2021-10-08T19:38:47.128 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:46 smithi097 ceph-mon[32687]: 6.a scrub ok 2021-10-08T19:38:47.129 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:46 smithi097 ceph-mon[32687]: 2.4 deep-scrub ok 2021-10-08T19:38:47.129 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:46 smithi097 ceph-mon[32687]: osdmap e428: 8 total, 8 up, 8 in 2021-10-08T19:38:47.129 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:46 smithi097 ceph-mon[32687]: 6.16 deep-scrub ok 2021-10-08T19:38:47.129 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:46 smithi097 ceph-mon[32687]: 2.10 scrub ok 2021-10-08T19:38:47.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:46 smithi117 ceph-mon[34585]: 6.a scrub ok 2021-10-08T19:38:47.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:46 smithi117 ceph-mon[34585]: 2.4 deep-scrub ok 2021-10-08T19:38:47.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:46 smithi117 ceph-mon[34585]: osdmap e428: 8 total, 8 up, 8 in 2021-10-08T19:38:47.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:46 smithi117 ceph-mon[34585]: 6.16 deep-scrub ok 2021-10-08T19:38:47.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:46 smithi117 ceph-mon[34585]: 2.10 scrub ok 2021-10-08T19:38:47.177 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:38:47.184 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:47.184 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:38:47.286 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:38:47.311 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:47.498 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:38:47.656 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:38:47 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:38:47.662 INFO:tasks.cephadm.ceph_manager.ceph:removing pool_name unique_pool_3 2021-10-08T19:38:47.663 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd pool rm unique_pool_3 unique_pool_3 --yes-i-really-really-mean-it 2021-10-08T19:38:47.856 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:38:47.860 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2021-10-08T19:38:47.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:47 smithi097 ceph-mon[32687]: pgmap v870: 188 pgs: 188 active+clean; 214 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 856 op/s 2021-10-08T19:38:47.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:47 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:38:47.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:47 smithi097 ceph-mon[32687]: 6.11 deep-scrub ok 2021-10-08T19:38:47.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:47 smithi097 ceph-mon[32687]: 4.18 scrub ok 2021-10-08T19:38:47.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:47 smithi097 ceph-mon[41966]: pgmap v870: 188 pgs: 188 active+clean; 214 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 856 op/s 2021-10-08T19:38:47.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:47 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:38:47.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:47 smithi097 ceph-mon[41966]: 6.11 deep-scrub ok 2021-10-08T19:38:47.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:47 smithi097 ceph-mon[41966]: 4.18 scrub ok 2021-10-08T19:38:48.262 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:38:48.263 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:47 smithi117 ceph-mon[34585]: pgmap v870: 188 pgs: 188 active+clean; 214 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 856 op/s 2021-10-08T19:38:48.264 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:47 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:38:48.264 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:47 smithi117 ceph-mon[34585]: 6.11 deep-scrub ok 2021-10-08T19:38:48.264 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:47 smithi117 ceph-mon[34585]: 4.18 scrub ok 2021-10-08T19:38:48.265 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:48.265 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:38:48.368 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:38:48.406 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:48.446 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:38:48.448 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:48.448 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:38:48.550 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:38:48.577 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:48.624 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:38:48.625 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:48.625 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:38:48.726 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:38:48.753 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:48.858 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2021-10-08T19:38:49.155 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:48 smithi097 ceph-mon[41966]: 4.a deep-scrub ok 2021-10-08T19:38:49.155 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:48 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:38:49.155 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:48 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:38:49.156 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:48 smithi097 ceph-mon[41966]: 2.9 deep-scrub ok 2021-10-08T19:38:49.156 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:48 smithi097 ceph-mon[41966]: from='client.26068 v1:172.21.15.97:0/3601241155' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:38:49.156 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:48 smithi097 ceph-mon[41966]: osdmap e429: 8 total, 8 up, 8 in 2021-10-08T19:38:49.157 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:48 smithi097 ceph-mon[41966]: 5.6 scrub ok 2021-10-08T19:38:49.157 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:48 smithi097 ceph-mon[32687]: 4.a deep-scrub ok 2021-10-08T19:38:49.157 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:48 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:38:49.158 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:48 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:38:49.158 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:48 smithi097 ceph-mon[32687]: 2.9 deep-scrub ok 2021-10-08T19:38:49.159 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:48 smithi097 ceph-mon[32687]: from='client.26068 v1:172.21.15.97:0/3601241155' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:38:49.159 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:48 smithi097 ceph-mon[32687]: osdmap e429: 8 total, 8 up, 8 in 2021-10-08T19:38:49.159 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:48 smithi097 ceph-mon[32687]: 5.6 scrub ok 2021-10-08T19:38:49.161 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":870,"stamp":"2021-10-08T19:38:46.928605+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":224717621,"num_objects":3615,"num_object_clones":0,"num_object_copies":10845,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3615,"num_whiteouts":0,"num_read":1559,"num_read_kb":1324,"num_write":234306,"num_write_kb":7584196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":534,"num_bytes_recovered":172627,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":73411,"ondisk_log_size":73411,"up":564,"acting":564,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":564,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":3308324,"kb_used_data":757956,"kb_used_omap":0,"kb_used_meta":2548480,"kb_avail":746652892,"statfs":{"total":767960285184,"available":764572561408,"internally_reserved":0,"allocated":776146944,"data_stored":772735956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2609643520},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-448659456,"num_objects":-6846,"num_object_clones":0,"num_object_copies":-20538,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-6846,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6846,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002653"},"pg_stats":[{"pgid":"2.29","version":"0'0","reported_seq":52,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.841991+0000","last_change":"2021-10-08T19:37:45.848942+0000","last_active":"2021-10-08T19:38:30.841991+0000","last_peered":"2021-10-08T19:38:30.841991+0000","last_clean":"2021-10-08T19:38:30.841991+0000","last_became_active":"2021-10-08T19:37:45.848663+0000","last_became_peered":"2021-10-08T19:37:45.848663+0000","last_unstale":"2021-10-08T19:38:30.841991+0000","last_undegraded":"2021-10-08T19:38:30.841991+0000","last_fullsized":"2021-10-08T19:38:30.841991+0000","mapping_epoch":407,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":408,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:19.757349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:30:11.102934+0000","last_clean_scrub_stamp":"2021-10-08T19:35:19.757349+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001709061,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.28","version":"0'0","reported_seq":43,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.847241+0000","last_change":"2021-10-08T19:37:00.334823+0000","last_active":"2021-10-08T19:38:30.847241+0000","last_peered":"2021-10-08T19:38:30.847241+0000","last_clean":"2021-10-08T19:38:30.847241+0000","last_became_active":"2021-10-08T19:37:00.334502+0000","last_became_peered":"2021-10-08T19:37:00.334502+0000","last_unstale":"2021-10-08T19:38:30.847241+0000","last_undegraded":"2021-10-08T19:38:30.847241+0000","last_fullsized":"2021-10-08T19:38:30.847241+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:01.984068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:01.984068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0028891239999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.27","version":"0'0","reported_seq":356,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.844300+0000","last_change":"2021-10-08T19:37:00.342826+0000","last_active":"2021-10-08T19:38:30.844300+0000","last_peered":"2021-10-08T19:38:30.844300+0000","last_clean":"2021-10-08T19:38:30.844300+0000","last_became_active":"2021-10-08T19:37:00.342526+0000","last_became_peered":"2021-10-08T19:37:00.342526+0000","last_unstale":"2021-10-08T19:38:30.844300+0000","last_undegraded":"2021-10-08T19:38:30.844300+0000","last_fullsized":"2021-10-08T19:38:30.844300+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:12.643664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:12.643664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0025959149999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.26","version":"0'0","reported_seq":43,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.845166+0000","last_change":"2021-10-08T19:37:00.340647+0000","last_active":"2021-10-08T19:38:30.845166+0000","last_peered":"2021-10-08T19:38:30.845166+0000","last_clean":"2021-10-08T19:38:30.845166+0000","last_became_active":"2021-10-08T19:37:00.340327+0000","last_became_peered":"2021-10-08T19:37:00.340327+0000","last_unstale":"2021-10-08T19:38:30.845166+0000","last_undegraded":"2021-10-08T19:38:30.845166+0000","last_fullsized":"2021-10-08T19:38:30.845166+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:34:50.752866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:07.710367+0000","last_clean_scrub_stamp":"2021-10-08T19:34:50.752866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013659034,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.25","version":"328'2","reported_seq":360,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.837374+0000","last_change":"2021-10-08T19:38:00.259167+0000","last_active":"2021-10-08T19:38:30.837374+0000","last_peered":"2021-10-08T19:38:30.837374+0000","last_clean":"2021-10-08T19:38:30.837374+0000","last_became_active":"2021-10-08T19:37:00.344673+0000","last_became_peered":"2021-10-08T19:37:00.344673+0000","last_unstale":"2021-10-08T19:38:30.837374+0000","last_undegraded":"2021-10-08T19:38:30.837374+0000","last_fullsized":"2021-10-08T19:38:30.837374+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"328'2","last_scrub_stamp":"2021-10-08T19:38:00.259074+0000","last_deep_scrub":"328'2","last_deep_scrub_stamp":"2021-10-08T19:33:29.990395+0000","last_clean_scrub_stamp":"2021-10-08T19:38:00.259074+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011095977,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.24","version":"0'0","reported_seq":49,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:36.327268+0000","last_change":"2021-10-08T19:38:36.327118+0000","last_active":"2021-10-08T19:38:36.327268+0000","last_peered":"2021-10-08T19:38:36.327268+0000","last_clean":"2021-10-08T19:38:36.327268+0000","last_became_active":"2021-10-08T19:37:00.336960+0000","last_became_peered":"2021-10-08T19:37:00.336960+0000","last_unstale":"2021-10-08T19:38:36.327268+0000","last_undegraded":"2021-10-08T19:38:36.327268+0000","last_fullsized":"2021-10-08T19:38:36.327268+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:36.327020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:38:36.327020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011868632,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.23","version":"0'0","reported_seq":43,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.848017+0000","last_change":"2021-10-08T19:37:00.348151+0000","last_active":"2021-10-08T19:38:30.848017+0000","last_peered":"2021-10-08T19:38:30.848017+0000","last_clean":"2021-10-08T19:38:30.848017+0000","last_became_active":"2021-10-08T19:37:00.347789+0000","last_became_peered":"2021-10-08T19:37:00.347789+0000","last_unstale":"2021-10-08T19:38:30.848017+0000","last_undegraded":"2021-10-08T19:38:30.848017+0000","last_fullsized":"2021-10-08T19:38:30.848017+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:31.652494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:31.652494+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0075080879999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.22","version":"0'0","reported_seq":445,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:34.297063+0000","last_change":"2021-10-08T19:38:34.297063+0000","last_active":"2021-10-08T19:38:34.297063+0000","last_peered":"2021-10-08T19:38:34.297063+0000","last_clean":"2021-10-08T19:38:34.297063+0000","last_became_active":"2021-10-08T19:37:00.343394+0000","last_became_peered":"2021-10-08T19:37:00.343394+0000","last_unstale":"2021-10-08T19:38:34.297063+0000","last_undegraded":"2021-10-08T19:38:34.297063+0000","last_fullsized":"2021-10-08T19:38:34.297063+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:23.647485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:23.647485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002822181,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3],"acting":[6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.21","version":"0'0","reported_seq":448,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.841481+0000","last_change":"2021-10-08T19:37:52.183026+0000","last_active":"2021-10-08T19:38:30.841481+0000","last_peered":"2021-10-08T19:38:30.841481+0000","last_clean":"2021-10-08T19:38:30.841481+0000","last_became_active":"2021-10-08T19:37:00.335409+0000","last_became_peered":"2021-10-08T19:37:00.335409+0000","last_unstale":"2021-10-08T19:38:30.841481+0000","last_undegraded":"2021-10-08T19:38:30.841481+0000","last_fullsized":"2021-10-08T19:38:30.841481+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:52.182934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:37:52.182934+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.023529145000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7],"acting":[2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.20","version":"0'0","reported_seq":53,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.843936+0000","last_change":"2021-10-08T19:37:00.342150+0000","last_active":"2021-10-08T19:38:30.843936+0000","last_peered":"2021-10-08T19:38:30.843936+0000","last_clean":"2021-10-08T19:38:30.843936+0000","last_became_active":"2021-10-08T19:37:00.341831+0000","last_became_peered":"2021-10-08T19:37:00.341831+0000","last_unstale":"2021-10-08T19:38:30.843936+0000","last_undegraded":"2021-10-08T19:38:30.843936+0000","last_fullsized":"2021-10-08T19:38:30.843936+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:08.078324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:32.922694+0000","last_clean_scrub_stamp":"2021-10-08T19:36:08.078324+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0052928530000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.6","version":"427'14750","reported_seq":14843,"reported_epoch":427,"state":"active+clean","last_fresh":"2021-10-08T19:38:43.671013+0000","last_change":"2021-10-08T19:38:08.036367+0000","last_active":"2021-10-08T19:38:43.671013+0000","last_peered":"2021-10-08T19:38:43.671013+0000","last_clean":"2021-10-08T19:38:43.671013+0000","last_became_active":"2021-10-08T19:37:19.001470+0000","last_became_peered":"2021-10-08T19:37:19.001470+0000","last_unstale":"2021-10-08T19:38:43.671013+0000","last_undegraded":"2021-10-08T19:38:43.671013+0000","last_fullsized":"2021-10-08T19:38:43.671013+0000","mapping_epoch":397,"log_start":"405'10284","ondisk_log_start":"405'10284","created":355,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"416'12331","last_scrub_stamp":"2021-10-08T19:38:08.036268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:38:08.036268+0000","log_size":4466,"ondisk_log_size":4466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.91506893,"stat_sum":{"num_bytes":13893632,"num_objects":212,"num_object_clones":0,"num_object_copies":636,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":212,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14750,"num_write_kb":478784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,4],"acting":[0,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"114'10","reported_seq":648,"reported_epoch":427,"state":"active+clean","last_fresh":"2021-10-08T19:38:41.872725+0000","last_change":"2021-10-08T19:37:51.741192+0000","last_active":"2021-10-08T19:38:41.872725+0000","last_peered":"2021-10-08T19:38:41.872725+0000","last_clean":"2021-10-08T19:38:41.872725+0000","last_became_active":"2021-10-08T19:24:25.096162+0000","last_became_peered":"2021-10-08T19:24:25.096162+0000","last_unstale":"2021-10-08T19:38:41.872725+0000","last_undegraded":"2021-10-08T19:38:41.872725+0000","last_fullsized":"2021-10-08T19:38:41.872725+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'10","last_scrub_stamp":"2021-10-08T19:37:51.741091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:37:51.741091+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0076100259999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"289'34","reported_seq":88,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.844394+0000","last_change":"2021-10-08T19:37:18.998690+0000","last_active":"2021-10-08T19:38:30.844394+0000","last_peered":"2021-10-08T19:38:30.844394+0000","last_clean":"2021-10-08T19:38:30.844394+0000","last_became_active":"2021-10-08T19:37:18.998305+0000","last_became_peered":"2021-10-08T19:37:18.998305+0000","last_unstale":"2021-10-08T19:38:30.844394+0000","last_undegraded":"2021-10-08T19:38:30.844394+0000","last_fullsized":"2021-10-08T19:38:30.844394+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'34","last_scrub_stamp":"2021-10-08T19:36:55.766292+0000","last_deep_scrub":"87'22","last_deep_scrub_stamp":"2021-10-08T19:22:58.705632+0000","last_clean_scrub_stamp":"2021-10-08T19:36:55.766292+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":439,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.840796+0000","last_change":"2021-10-08T19:37:54.177746+0000","last_active":"2021-10-08T19:38:30.840796+0000","last_peered":"2021-10-08T19:38:30.840796+0000","last_clean":"2021-10-08T19:38:30.840796+0000","last_became_active":"2021-10-08T19:29:40.632678+0000","last_became_peered":"2021-10-08T19:29:40.632678+0000","last_unstale":"2021-10-08T19:38:30.840796+0000","last_undegraded":"2021-10-08T19:38:30.840796+0000","last_fullsized":"2021-10-08T19:38:30.840796+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:54.177635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:37:54.177635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0085167739999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":110,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.842293+0000","last_change":"2021-10-08T19:37:19.000575+0000","last_active":"2021-10-08T19:38:30.842293+0000","last_peered":"2021-10-08T19:38:30.842293+0000","last_clean":"2021-10-08T19:38:30.842293+0000","last_became_active":"2021-10-08T19:37:19.000347+0000","last_became_peered":"2021-10-08T19:37:19.000347+0000","last_unstale":"2021-10-08T19:38:30.842293+0000","last_undegraded":"2021-10-08T19:38:30.842293+0000","last_fullsized":"2021-10-08T19:38:30.842293+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:00.572589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:08.936801+0000","last_clean_scrub_stamp":"2021-10-08T19:36:00.572589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.00168849,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":333,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.844781+0000","last_change":"2021-10-08T19:36:04.907070+0000","last_active":"2021-10-08T19:38:30.844781+0000","last_peered":"2021-10-08T19:38:30.844781+0000","last_clean":"2021-10-08T19:38:30.844781+0000","last_became_active":"2021-10-08T19:25:15.510457+0000","last_became_peered":"2021-10-08T19:25:15.510457+0000","last_unstale":"2021-10-08T19:38:30.844781+0000","last_undegraded":"2021-10-08T19:38:30.844781+0000","last_fullsized":"2021-10-08T19:38:30.844781+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:04.906938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:33:28.036266+0000","last_clean_scrub_stamp":"2021-10-08T19:36:04.906938+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0079401560000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"427'14464","reported_seq":14556,"reported_epoch":427,"state":"active+clean","last_fresh":"2021-10-08T19:38:43.911620+0000","last_change":"2021-10-08T19:38:41.244979+0000","last_active":"2021-10-08T19:38:43.911620+0000","last_peered":"2021-10-08T19:38:43.911620+0000","last_clean":"2021-10-08T19:38:43.911620+0000","last_became_active":"2021-10-08T19:35:17.124786+0000","last_became_peered":"2021-10-08T19:35:17.124786+0000","last_unstale":"2021-10-08T19:38:43.911620+0000","last_undegraded":"2021-10-08T19:38:43.911620+0000","last_fullsized":"2021-10-08T19:38:43.911620+0000","mapping_epoch":355,"log_start":"401'9256","ondisk_log_start":"401'9256","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"426'14294","last_scrub_stamp":"2021-10-08T19:38:41.244853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:38:41.244853+0000","log_size":5208,"ondisk_log_size":5208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.281578673,"stat_sum":{"num_bytes":12713984,"num_objects":194,"num_object_clones":0,"num_object_copies":582,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14464,"num_write_kb":469056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"337'19","reported_seq":470,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.850015+0000","last_change":"2021-10-08T19:36:17.162468+0000","last_active":"2021-10-08T19:38:30.850015+0000","last_peered":"2021-10-08T19:38:30.850015+0000","last_clean":"2021-10-08T19:38:30.850015+0000","last_became_active":"2021-10-08T19:28:40.159729+0000","last_became_peered":"2021-10-08T19:28:40.159729+0000","last_unstale":"2021-10-08T19:38:30.850015+0000","last_undegraded":"2021-10-08T19:38:30.850015+0000","last_fullsized":"2021-10-08T19:38:30.850015+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"337'19","last_scrub_stamp":"2021-10-08T19:36:17.162349+0000","last_deep_scrub":"337'19","last_deep_scrub_stamp":"2021-10-08T19:34:14.040249+0000","last_clean_scrub_stamp":"2021-10-08T19:36:17.162349+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.019723487000000001,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":275,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.855070+0000","last_change":"2021-10-08T19:36:57.596887+0000","last_active":"2021-10-08T19:38:30.855070+0000","last_peered":"2021-10-08T19:38:30.855070+0000","last_clean":"2021-10-08T19:38:30.855070+0000","last_became_active":"2021-10-08T19:29:40.624977+0000","last_became_peered":"2021-10-08T19:29:40.624977+0000","last_unstale":"2021-10-08T19:38:30.855070+0000","last_undegraded":"2021-10-08T19:38:30.855070+0000","last_fullsized":"2021-10-08T19:38:30.855070+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:57.596784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:57.596784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010370961,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":427,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.838794+0000","last_change":"2021-10-08T19:37:14.912131+0000","last_active":"2021-10-08T19:38:30.838794+0000","last_peered":"2021-10-08T19:38:30.838794+0000","last_clean":"2021-10-08T19:38:30.838794+0000","last_became_active":"2021-10-08T19:29:40.629422+0000","last_became_peered":"2021-10-08T19:29:40.629422+0000","last_unstale":"2021-10-08T19:38:30.838794+0000","last_undegraded":"2021-10-08T19:38:30.838794+0000","last_fullsized":"2021-10-08T19:38:30.838794+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:14.912048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:37:14.912048+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0013646590000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":403,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.854065+0000","last_change":"2021-10-08T19:37:49.991077+0000","last_active":"2021-10-08T19:38:30.854065+0000","last_peered":"2021-10-08T19:38:30.854065+0000","last_clean":"2021-10-08T19:38:30.854065+0000","last_became_active":"2021-10-08T19:21:29.643022+0000","last_became_peered":"2021-10-08T19:21:29.643022+0000","last_unstale":"2021-10-08T19:38:30.854065+0000","last_undegraded":"2021-10-08T19:38:30.854065+0000","last_fullsized":"2021-10-08T19:38:30.854065+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:49.990967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:37:49.990967+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.047700399999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"70'5","reported_seq":635,"reported_epoch":427,"state":"active+clean","last_fresh":"2021-10-08T19:38:42.241974+0000","last_change":"2021-10-08T19:38:02.331641+0000","last_active":"2021-10-08T19:38:42.241974+0000","last_peered":"2021-10-08T19:38:42.241974+0000","last_clean":"2021-10-08T19:38:42.241974+0000","last_became_active":"2021-10-08T19:37:19.006464+0000","last_became_peered":"2021-10-08T19:37:19.006464+0000","last_unstale":"2021-10-08T19:38:42.241974+0000","last_undegraded":"2021-10-08T19:38:42.241974+0000","last_fullsized":"2021-10-08T19:38:42.241974+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:38:02.331532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:38:02.331532+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0043661940000000003,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":403,"num_read_kb":403,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":778,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.4","version":"427'14502","reported_seq":14588,"reported_epoch":427,"state":"active+clean","last_fresh":"2021-10-08T19:38:43.654170+0000","last_change":"2021-10-08T19:38:34.485736+0000","last_active":"2021-10-08T19:38:43.654170+0000","last_peered":"2021-10-08T19:38:43.654170+0000","last_clean":"2021-10-08T19:38:43.654170+0000","last_became_active":"2021-10-08T19:35:17.124559+0000","last_became_peered":"2021-10-08T19:35:17.124559+0000","last_unstale":"2021-10-08T19:38:43.654170+0000","last_undegraded":"2021-10-08T19:38:43.654170+0000","last_fullsized":"2021-10-08T19:38:43.654170+0000","mapping_epoch":355,"log_start":"404'10025","ondisk_log_start":"404'10025","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"426'13867","last_scrub_stamp":"2021-10-08T19:38:34.485633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:38:34.485633+0000","log_size":4477,"ondisk_log_size":4477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.31484567800000002,"stat_sum":{"num_bytes":13893632,"num_objects":212,"num_object_clones":0,"num_object_copies":636,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":212,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14502,"num_write_kb":470848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"289'35","reported_seq":458,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.842399+0000","last_change":"2021-10-08T19:35:57.653426+0000","last_active":"2021-10-08T19:38:30.842399+0000","last_peered":"2021-10-08T19:38:30.842399+0000","last_clean":"2021-10-08T19:38:30.842399+0000","last_became_active":"2021-10-08T19:28:40.101648+0000","last_became_peered":"2021-10-08T19:28:40.101648+0000","last_unstale":"2021-10-08T19:38:30.842399+0000","last_undegraded":"2021-10-08T19:38:30.842399+0000","last_fullsized":"2021-10-08T19:38:30.842399+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'35","last_scrub_stamp":"2021-10-08T19:35:57.653345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:35:57.653345+0000","log_size":35,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040502669999999998,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":55,"num_read_kb":44,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":419,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:35.042242+0000","last_change":"2021-10-08T19:38:35.041815+0000","last_active":"2021-10-08T19:38:35.042242+0000","last_peered":"2021-10-08T19:38:35.042242+0000","last_clean":"2021-10-08T19:38:35.042242+0000","last_became_active":"2021-10-08T19:21:23.595919+0000","last_became_peered":"2021-10-08T19:21:23.595919+0000","last_unstale":"2021-10-08T19:38:35.042242+0000","last_undegraded":"2021-10-08T19:38:35.042242+0000","last_fullsized":"2021-10-08T19:38:35.042242+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:35.041713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:38:35.041713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0077214359999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":425,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.839739+0000","last_change":"2021-10-08T19:37:53.130636+0000","last_active":"2021-10-08T19:38:30.839739+0000","last_peered":"2021-10-08T19:38:30.839739+0000","last_clean":"2021-10-08T19:38:30.839739+0000","last_became_active":"2021-10-08T19:31:22.783725+0000","last_became_peered":"2021-10-08T19:31:22.783725+0000","last_unstale":"2021-10-08T19:38:30.839739+0000","last_undegraded":"2021-10-08T19:38:30.839739+0000","last_fullsized":"2021-10-08T19:38:30.839739+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:53.130533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:37:53.130533+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0085012260000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":417,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.844205+0000","last_change":"2021-10-08T19:36:48.881526+0000","last_active":"2021-10-08T19:38:30.844205+0000","last_peered":"2021-10-08T19:38:30.844205+0000","last_clean":"2021-10-08T19:38:30.844205+0000","last_became_active":"2021-10-08T19:29:40.638354+0000","last_became_peered":"2021-10-08T19:29:40.638354+0000","last_unstale":"2021-10-08T19:38:30.844205+0000","last_undegraded":"2021-10-08T19:38:30.844205+0000","last_fullsized":"2021-10-08T19:38:30.844205+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:48.881410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:39.528699+0000","last_clean_scrub_stamp":"2021-10-08T19:36:48.881410+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0060881240000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":344,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.845251+0000","last_change":"2021-10-08T19:35:58.023652+0000","last_active":"2021-10-08T19:38:30.845251+0000","last_peered":"2021-10-08T19:38:30.845251+0000","last_clean":"2021-10-08T19:38:30.845251+0000","last_became_active":"2021-10-08T19:31:22.785590+0000","last_became_peered":"2021-10-08T19:31:22.785590+0000","last_unstale":"2021-10-08T19:38:30.845251+0000","last_undegraded":"2021-10-08T19:38:30.845251+0000","last_fullsized":"2021-10-08T19:38:30.845251+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:58.023581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:58.023581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0070639609999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3","version":"427'14790","reported_seq":14876,"reported_epoch":427,"state":"active+clean","last_fresh":"2021-10-08T19:38:43.897312+0000","last_change":"2021-10-08T19:37:18.859736+0000","last_active":"2021-10-08T19:38:43.897312+0000","last_peered":"2021-10-08T19:38:43.897312+0000","last_clean":"2021-10-08T19:38:43.897312+0000","last_became_active":"2021-10-08T19:35:17.123799+0000","last_became_peered":"2021-10-08T19:35:17.123799+0000","last_unstale":"2021-10-08T19:38:43.897312+0000","last_undegraded":"2021-10-08T19:38:43.897312+0000","last_fullsized":"2021-10-08T19:38:43.897312+0000","mapping_epoch":355,"log_start":"402'9588","ondisk_log_start":"402'9588","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"397'9089","last_scrub_stamp":"2021-10-08T19:37:18.859650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:37:18.859650+0000","log_size":5202,"ondisk_log_size":5202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":1.891578097,"stat_sum":{"num_bytes":13500416,"num_objects":206,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":206,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14790,"num_write_kb":479872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.8","version":"90'130","reported_seq":405,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.838066+0000","last_change":"2021-10-08T19:38:00.214648+0000","last_active":"2021-10-08T19:38:30.838066+0000","last_peered":"2021-10-08T19:38:30.838066+0000","last_clean":"2021-10-08T19:38:30.838066+0000","last_became_active":"2021-10-08T19:37:19.009239+0000","last_became_peered":"2021-10-08T19:37:19.009239+0000","last_unstale":"2021-10-08T19:38:30.838066+0000","last_undegraded":"2021-10-08T19:38:30.838066+0000","last_fullsized":"2021-10-08T19:38:30.838066+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:38:00.214557+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:38:00.214557+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013077909,"stat_sum":{"num_bytes":262688,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"289'31","reported_seq":505,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.837707+0000","last_change":"2021-10-08T19:37:52.422769+0000","last_active":"2021-10-08T19:38:30.837707+0000","last_peered":"2021-10-08T19:38:30.837707+0000","last_clean":"2021-10-08T19:38:30.837707+0000","last_became_active":"2021-10-08T19:28:40.099618+0000","last_became_peered":"2021-10-08T19:28:40.099618+0000","last_unstale":"2021-10-08T19:38:30.837707+0000","last_undegraded":"2021-10-08T19:38:30.837707+0000","last_fullsized":"2021-10-08T19:38:30.837707+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'31","last_scrub_stamp":"2021-10-08T19:37:52.422690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:37:52.422690+0000","log_size":31,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.01215956,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":50,"num_read_kb":40,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"61'1","reported_seq":413,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:32.632908+0000","last_change":"2021-10-08T19:38:32.632445+0000","last_active":"2021-10-08T19:38:32.632908+0000","last_peered":"2021-10-08T19:38:32.632908+0000","last_clean":"2021-10-08T19:38:32.632908+0000","last_became_active":"2021-10-08T19:21:23.607064+0000","last_became_peered":"2021-10-08T19:21:23.607064+0000","last_unstale":"2021-10-08T19:38:32.632908+0000","last_undegraded":"2021-10-08T19:38:32.632908+0000","last_fullsized":"2021-10-08T19:38:32.632908+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'1","last_scrub_stamp":"2021-10-08T19:38:32.632368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:38:32.632368+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011475187,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":257,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:33.731301+0000","last_change":"2021-10-08T19:38:33.731166+0000","last_active":"2021-10-08T19:38:33.731301+0000","last_peered":"2021-10-08T19:38:33.731301+0000","last_clean":"2021-10-08T19:38:33.731301+0000","last_became_active":"2021-10-08T19:28:40.152478+0000","last_became_peered":"2021-10-08T19:28:40.152478+0000","last_unstale":"2021-10-08T19:38:33.731301+0000","last_undegraded":"2021-10-08T19:38:33.731301+0000","last_fullsized":"2021-10-08T19:38:33.731301+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:33.731025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:30:09.081635+0000","last_clean_scrub_stamp":"2021-10-08T19:38:33.731025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0017739489999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":425,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.839400+0000","last_change":"2021-10-08T19:37:23.106186+0000","last_active":"2021-10-08T19:38:30.839400+0000","last_peered":"2021-10-08T19:38:30.839400+0000","last_clean":"2021-10-08T19:38:30.839400+0000","last_became_active":"2021-10-08T19:29:40.629424+0000","last_became_peered":"2021-10-08T19:29:40.629424+0000","last_unstale":"2021-10-08T19:38:30.839400+0000","last_undegraded":"2021-10-08T19:38:30.839400+0000","last_fullsized":"2021-10-08T19:38:30.839400+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:23.106065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:37:23.106065+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.113287978,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":389,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.842538+0000","last_change":"2021-10-08T19:37:57.261677+0000","last_active":"2021-10-08T19:38:30.842538+0000","last_peered":"2021-10-08T19:38:30.842538+0000","last_clean":"2021-10-08T19:38:30.842538+0000","last_became_active":"2021-10-08T19:31:51.676829+0000","last_became_peered":"2021-10-08T19:31:51.676829+0000","last_unstale":"2021-10-08T19:38:30.842538+0000","last_undegraded":"2021-10-08T19:38:30.842538+0000","last_fullsized":"2021-10-08T19:38:30.842538+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:57.261583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:37:57.261583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.005169168,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"427'14607","reported_seq":14693,"reported_epoch":427,"state":"active+clean","last_fresh":"2021-10-08T19:38:44.282323+0000","last_change":"2021-10-08T19:38:01.760828+0000","last_active":"2021-10-08T19:38:44.282323+0000","last_peered":"2021-10-08T19:38:44.282323+0000","last_clean":"2021-10-08T19:38:44.282323+0000","last_became_active":"2021-10-08T19:35:16.780016+0000","last_became_peered":"2021-10-08T19:35:16.780016+0000","last_unstale":"2021-10-08T19:38:44.282323+0000","last_undegraded":"2021-10-08T19:38:44.282323+0000","last_fullsized":"2021-10-08T19:38:44.282323+0000","mapping_epoch":355,"log_start":"404'10096","ondisk_log_start":"404'10096","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"414'11799","last_scrub_stamp":"2021-10-08T19:38:01.760693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:38:01.760693+0000","log_size":4511,"ondisk_log_size":4511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":1.1938455160000001,"stat_sum":{"num_bytes":13041664,"num_objects":199,"num_object_clones":0,"num_object_copies":597,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14607,"num_write_kb":473792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.9","version":"90'130","reported_seq":753,"reported_epoch":427,"state":"active+clean","last_fresh":"2021-10-08T19:38:43.587748+0000","last_change":"2021-10-08T19:38:43.587701+0000","last_active":"2021-10-08T19:38:43.587748+0000","last_peered":"2021-10-08T19:38:43.587748+0000","last_clean":"2021-10-08T19:38:43.587748+0000","last_became_active":"2021-10-08T19:29:43.634789+0000","last_became_peered":"2021-10-08T19:29:43.634789+0000","last_unstale":"2021-10-08T19:38:43.587748+0000","last_undegraded":"2021-10-08T19:38:43.587748+0000","last_fullsized":"2021-10-08T19:38:43.587748+0000","mapping_epoch":239,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:38:43.587557+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:38:43.587557+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010306226999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"289'20","reported_seq":516,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.836806+0000","last_change":"2021-10-08T19:37:21.712075+0000","last_active":"2021-10-08T19:38:30.836806+0000","last_peered":"2021-10-08T19:38:30.836806+0000","last_clean":"2021-10-08T19:38:30.836806+0000","last_became_active":"2021-10-08T19:29:40.631807+0000","last_became_peered":"2021-10-08T19:29:40.631807+0000","last_unstale":"2021-10-08T19:38:30.836806+0000","last_undegraded":"2021-10-08T19:38:30.836806+0000","last_fullsized":"2021-10-08T19:38:30.836806+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'20","last_scrub_stamp":"2021-10-08T19:37:21.711953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:37:21.711953+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0046877220000000001,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":277,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.854074+0000","last_change":"2021-10-08T19:38:06.597254+0000","last_active":"2021-10-08T19:38:30.854074+0000","last_peered":"2021-10-08T19:38:30.854074+0000","last_clean":"2021-10-08T19:38:30.854074+0000","last_became_active":"2021-10-08T19:29:40.638988+0000","last_became_peered":"2021-10-08T19:29:40.638988+0000","last_unstale":"2021-10-08T19:38:30.854074+0000","last_undegraded":"2021-10-08T19:38:30.854074+0000","last_fullsized":"2021-10-08T19:38:30.854074+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:06.597140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:38:06.597140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0062006580000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"250'9","reported_seq":634,"reported_epoch":427,"state":"active+clean","last_fresh":"2021-10-08T19:38:41.862258+0000","last_change":"2021-10-08T19:38:31.086180+0000","last_active":"2021-10-08T19:38:41.862258+0000","last_peered":"2021-10-08T19:38:41.862258+0000","last_clean":"2021-10-08T19:38:41.862258+0000","last_became_active":"2021-10-08T19:21:27.637930+0000","last_became_peered":"2021-10-08T19:21:27.637930+0000","last_unstale":"2021-10-08T19:38:41.862258+0000","last_undegraded":"2021-10-08T19:38:41.862258+0000","last_fullsized":"2021-10-08T19:38:41.862258+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'9","last_scrub_stamp":"2021-10-08T19:38:31.086061+0000","last_deep_scrub":"250'9","last_deep_scrub_stamp":"2021-10-08T19:30:04.239189+0000","last_clean_scrub_stamp":"2021-10-08T19:38:31.086061+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0074221679999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":416,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.837810+0000","last_change":"2021-10-08T19:36:40.486877+0000","last_active":"2021-10-08T19:38:30.837810+0000","last_peered":"2021-10-08T19:38:30.837810+0000","last_clean":"2021-10-08T19:38:30.837810+0000","last_became_active":"2021-10-08T19:28:40.100213+0000","last_became_peered":"2021-10-08T19:28:40.100213+0000","last_unstale":"2021-10-08T19:38:30.837810+0000","last_undegraded":"2021-10-08T19:38:30.837810+0000","last_fullsized":"2021-10-08T19:38:30.837810+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:40.486763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:36:40.486763+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.030070781000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":211,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.850363+0000","last_change":"2021-10-08T19:36:15.769584+0000","last_active":"2021-10-08T19:38:30.850363+0000","last_peered":"2021-10-08T19:38:30.850363+0000","last_clean":"2021-10-08T19:38:30.850363+0000","last_became_active":"2021-10-08T19:29:44.443507+0000","last_became_peered":"2021-10-08T19:29:44.443507+0000","last_unstale":"2021-10-08T19:38:30.850363+0000","last_undegraded":"2021-10-08T19:38:30.850363+0000","last_fullsized":"2021-10-08T19:38:30.850363+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:15.769469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:15.769469+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0068300569999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"427'14703","reported_seq":14789,"reported_epoch":427,"state":"active+clean","last_fresh":"2021-10-08T19:38:43.460060+0000","last_change":"2021-10-08T19:37:29.999619+0000","last_active":"2021-10-08T19:38:43.460060+0000","last_peered":"2021-10-08T19:38:43.460060+0000","last_clean":"2021-10-08T19:38:43.460060+0000","last_became_active":"2021-10-08T19:35:16.778182+0000","last_became_peered":"2021-10-08T19:35:16.778182+0000","last_unstale":"2021-10-08T19:38:43.460060+0000","last_undegraded":"2021-10-08T19:38:43.460060+0000","last_fullsized":"2021-10-08T19:38:43.460060+0000","mapping_epoch":355,"log_start":"408'10853","ondisk_log_start":"408'10853","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'9671","last_scrub_stamp":"2021-10-08T19:37:29.999513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:37:29.999513+0000","log_size":3850,"ondisk_log_size":3850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":2.31606253,"stat_sum":{"num_bytes":14614528,"num_objects":223,"num_object_clones":0,"num_object_copies":669,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":223,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14703,"num_write_kb":477632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,0],"acting":[4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.a","version":"90'130","reported_seq":345,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.838716+0000","last_change":"2021-10-08T19:38:01.240328+0000","last_active":"2021-10-08T19:38:30.838716+0000","last_peered":"2021-10-08T19:38:30.838716+0000","last_clean":"2021-10-08T19:38:30.838716+0000","last_became_active":"2021-10-08T19:37:19.000525+0000","last_became_peered":"2021-10-08T19:37:19.000525+0000","last_unstale":"2021-10-08T19:38:30.838716+0000","last_undegraded":"2021-10-08T19:38:30.838716+0000","last_fullsized":"2021-10-08T19:38:30.838716+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:38:01.240236+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:38:01.240236+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0043514979999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"289'27","reported_seq":159,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.839177+0000","last_change":"2021-10-08T19:38:08.232601+0000","last_active":"2021-10-08T19:38:30.839177+0000","last_peered":"2021-10-08T19:38:30.839177+0000","last_clean":"2021-10-08T19:38:30.839177+0000","last_became_active":"2021-10-08T19:32:45.162914+0000","last_became_peered":"2021-10-08T19:32:45.162914+0000","last_unstale":"2021-10-08T19:38:30.839177+0000","last_undegraded":"2021-10-08T19:38:30.839177+0000","last_fullsized":"2021-10-08T19:38:30.839177+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'27","last_scrub_stamp":"2021-10-08T19:38:08.232495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:38:08.232495+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012973241999999999,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":550,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":278,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.853755+0000","last_change":"2021-10-08T19:36:58.005216+0000","last_active":"2021-10-08T19:38:30.853755+0000","last_peered":"2021-10-08T19:38:30.853755+0000","last_clean":"2021-10-08T19:38:30.853755+0000","last_became_active":"2021-10-08T19:36:58.004540+0000","last_became_peered":"2021-10-08T19:36:58.004540+0000","last_unstale":"2021-10-08T19:38:30.853755+0000","last_undegraded":"2021-10-08T19:38:30.853755+0000","last_fullsized":"2021-10-08T19:38:30.853755+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:19.757349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:30:11.102934+0000","last_clean_scrub_stamp":"2021-10-08T19:35:19.757349+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001709061,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"88'9","reported_seq":622,"reported_epoch":427,"state":"active+clean","last_fresh":"2021-10-08T19:38:41.868167+0000","last_change":"2021-10-08T19:37:51.400366+0000","last_active":"2021-10-08T19:38:41.868167+0000","last_peered":"2021-10-08T19:38:41.868167+0000","last_clean":"2021-10-08T19:38:41.868167+0000","last_became_active":"2021-10-08T19:21:27.636432+0000","last_became_peered":"2021-10-08T19:21:27.636432+0000","last_unstale":"2021-10-08T19:38:41.868167+0000","last_undegraded":"2021-10-08T19:38:41.868167+0000","last_fullsized":"2021-10-08T19:38:41.868167+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'9","last_scrub_stamp":"2021-10-08T19:37:51.400280+0000","last_deep_scrub":"88'9","last_deep_scrub_stamp":"2021-10-08T19:23:00.048245+0000","last_clean_scrub_stamp":"2021-10-08T19:37:51.400280+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010321472999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":212,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.854883+0000","last_change":"2021-10-08T19:37:54.590428+0000","last_active":"2021-10-08T19:38:30.854883+0000","last_peered":"2021-10-08T19:38:30.854883+0000","last_clean":"2021-10-08T19:38:30.854883+0000","last_became_active":"2021-10-08T19:37:19.016085+0000","last_became_peered":"2021-10-08T19:37:19.016085+0000","last_unstale":"2021-10-08T19:38:30.854883+0000","last_undegraded":"2021-10-08T19:38:30.854883+0000","last_fullsized":"2021-10-08T19:38:30.854883+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:54.590301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:37:54.590301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.095282983000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"70'5","reported_seq":211,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.847692+0000","last_change":"2021-10-08T19:36:08.760775+0000","last_active":"2021-10-08T19:38:30.847692+0000","last_peered":"2021-10-08T19:38:30.847692+0000","last_clean":"2021-10-08T19:38:30.847692+0000","last_became_active":"2021-10-08T19:29:40.639786+0000","last_became_peered":"2021-10-08T19:29:40.639786+0000","last_unstale":"2021-10-08T19:38:30.847692+0000","last_undegraded":"2021-10-08T19:38:30.847692+0000","last_fullsized":"2021-10-08T19:38:30.847692+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:36:08.760670+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2021-10-08T19:36:08.760670+0000","last_clean_scrub_stamp":"2021-10-08T19:36:08.760670+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011613982,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.0","version":"427'14537","reported_seq":14623,"reported_epoch":427,"state":"active+clean","last_fresh":"2021-10-08T19:38:43.716658+0000","last_change":"2021-10-08T19:38:05.203726+0000","last_active":"2021-10-08T19:38:43.716658+0000","last_peered":"2021-10-08T19:38:43.716658+0000","last_clean":"2021-10-08T19:38:43.716658+0000","last_became_active":"2021-10-08T19:35:16.783489+0000","last_became_peered":"2021-10-08T19:35:16.783489+0000","last_unstale":"2021-10-08T19:38:43.716658+0000","last_undegraded":"2021-10-08T19:38:43.716658+0000","last_fullsized":"2021-10-08T19:38:43.716658+0000","mapping_epoch":355,"log_start":"405'10215","ondisk_log_start":"405'10215","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"415'11964","last_scrub_stamp":"2021-10-08T19:38:05.203625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:38:05.203625+0000","log_size":4322,"ondisk_log_size":4322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.87608043800000002,"stat_sum":{"num_bytes":14090240,"num_objects":215,"num_object_clones":0,"num_object_copies":645,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14537,"num_write_kb":472064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4],"acting":[6,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"289'19","reported_seq":582,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:38.216430+0000","last_change":"2021-10-08T19:38:38.216245+0000","last_active":"2021-10-08T19:38:38.216430+0000","last_peered":"2021-10-08T19:38:38.216430+0000","last_clean":"2021-10-08T19:38:38.216430+0000","last_became_active":"2021-10-08T19:31:51.677509+0000","last_became_peered":"2021-10-08T19:31:51.677509+0000","last_unstale":"2021-10-08T19:38:38.216430+0000","last_undegraded":"2021-10-08T19:38:38.216430+0000","last_fullsized":"2021-10-08T19:38:38.216430+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:38:38.216137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:38:38.216137+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0059711859999999999,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":770,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":434,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.844291+0000","last_change":"2021-10-08T19:36:58.001988+0000","last_active":"2021-10-08T19:38:30.844291+0000","last_peered":"2021-10-08T19:38:30.844291+0000","last_clean":"2021-10-08T19:38:30.844291+0000","last_became_active":"2021-10-08T19:36:58.001610+0000","last_became_peered":"2021-10-08T19:36:58.001610+0000","last_unstale":"2021-10-08T19:38:30.844291+0000","last_undegraded":"2021-10-08T19:38:30.844291+0000","last_fullsized":"2021-10-08T19:38:30.844291+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:01.984068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:01.984068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0028891239999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":112,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.837205+0000","last_change":"2021-10-08T19:37:18.997786+0000","last_active":"2021-10-08T19:38:30.837205+0000","last_peered":"2021-10-08T19:38:30.837205+0000","last_clean":"2021-10-08T19:38:30.837205+0000","last_became_active":"2021-10-08T19:37:18.997446+0000","last_became_peered":"2021-10-08T19:37:18.997446+0000","last_unstale":"2021-10-08T19:38:30.837205+0000","last_undegraded":"2021-10-08T19:38:30.837205+0000","last_fullsized":"2021-10-08T19:38:30.837205+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:41.852519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:36:41.852519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0033939769999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":217,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.848051+0000","last_change":"2021-10-08T19:36:43.015897+0000","last_active":"2021-10-08T19:38:30.848051+0000","last_peered":"2021-10-08T19:38:30.848051+0000","last_clean":"2021-10-08T19:38:30.848051+0000","last_became_active":"2021-10-08T19:29:40.638099+0000","last_became_peered":"2021-10-08T19:29:40.638099+0000","last_unstale":"2021-10-08T19:38:30.848051+0000","last_undegraded":"2021-10-08T19:38:30.848051+0000","last_fullsized":"2021-10-08T19:38:30.848051+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:43.015835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:17.422176+0000","last_clean_scrub_stamp":"2021-10-08T19:36:43.015835+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003426634,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":355,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.835838+0000","last_change":"2021-10-08T19:38:03.310863+0000","last_active":"2021-10-08T19:38:30.835838+0000","last_peered":"2021-10-08T19:38:30.835838+0000","last_clean":"2021-10-08T19:38:30.835838+0000","last_became_active":"2021-10-08T19:24:13.506602+0000","last_became_peered":"2021-10-08T19:24:13.506602+0000","last_unstale":"2021-10-08T19:38:30.835838+0000","last_undegraded":"2021-10-08T19:38:30.835838+0000","last_fullsized":"2021-10-08T19:38:30.835838+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:03.310761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:38:03.310761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0095709139999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"427'14673","reported_seq":14761,"reported_epoch":427,"state":"active+clean","last_fresh":"2021-10-08T19:38:43.706783+0000","last_change":"2021-10-08T19:37:21.628788+0000","last_active":"2021-10-08T19:38:43.706783+0000","last_peered":"2021-10-08T19:38:43.706783+0000","last_clean":"2021-10-08T19:38:43.706783+0000","last_became_active":"2021-10-08T19:35:17.124842+0000","last_became_peered":"2021-10-08T19:35:17.124842+0000","last_unstale":"2021-10-08T19:38:43.706783+0000","last_undegraded":"2021-10-08T19:38:43.706783+0000","last_fullsized":"2021-10-08T19:38:43.706783+0000","mapping_epoch":355,"log_start":"406'10384","ondisk_log_start":"406'10384","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"400'9090","last_scrub_stamp":"2021-10-08T19:37:21.628686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:37:21.628686+0000","log_size":4289,"ondisk_log_size":4289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":2.5331604400000001,"stat_sum":{"num_bytes":13238272,"num_objects":202,"num_object_clones":0,"num_object_copies":606,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":202,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14614,"num_write_kb":474112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.4","version":"90'130","reported_seq":541,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.847969+0000","last_change":"2021-10-08T19:36:05.771481+0000","last_active":"2021-10-08T19:38:30.847969+0000","last_peered":"2021-10-08T19:38:30.847969+0000","last_clean":"2021-10-08T19:38:30.847969+0000","last_became_active":"2021-10-08T19:29:43.636733+0000","last_became_peered":"2021-10-08T19:29:43.636733+0000","last_unstale":"2021-10-08T19:38:30.847969+0000","last_undegraded":"2021-10-08T19:38:30.847969+0000","last_fullsized":"2021-10-08T19:38:30.847969+0000","mapping_epoch":239,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:36:05.771344+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:36:05.771344+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014695206000000001,"stat_sum":{"num_bytes":327680,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"238'13","reported_seq":336,"reported_epoch":427,"state":"active+clean","last_fresh":"2021-10-08T19:38:41.867128+0000","last_change":"2021-10-08T19:38:32.165269+0000","last_active":"2021-10-08T19:38:41.867128+0000","last_peered":"2021-10-08T19:38:41.867128+0000","last_clean":"2021-10-08T19:38:41.867128+0000","last_became_active":"2021-10-08T19:29:40.640248+0000","last_became_peered":"2021-10-08T19:29:40.640248+0000","last_unstale":"2021-10-08T19:38:41.867128+0000","last_undegraded":"2021-10-08T19:38:41.867128+0000","last_fullsized":"2021-10-08T19:38:41.867128+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"238'13","last_scrub_stamp":"2021-10-08T19:38:32.165194+0000","last_deep_scrub":"91'9","last_deep_scrub_stamp":"2021-10-08T19:23:32.329475+0000","last_clean_scrub_stamp":"2021-10-08T19:38:32.165194+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0056171720000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"289'28","reported_seq":494,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.835925+0000","last_change":"2021-10-08T19:36:16.219370+0000","last_active":"2021-10-08T19:38:30.835925+0000","last_peered":"2021-10-08T19:38:30.835925+0000","last_clean":"2021-10-08T19:38:30.835925+0000","last_became_active":"2021-10-08T19:24:25.098743+0000","last_became_peered":"2021-10-08T19:24:25.098743+0000","last_unstale":"2021-10-08T19:38:30.835925+0000","last_undegraded":"2021-10-08T19:38:30.835925+0000","last_fullsized":"2021-10-08T19:38:30.835925+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'28","last_scrub_stamp":"2021-10-08T19:36:16.219258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:16.219258+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0095071070000000008,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":42,"num_read_kb":35,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":365,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.844510+0000","last_change":"2021-10-08T19:37:45.830300+0000","last_active":"2021-10-08T19:38:30.844510+0000","last_peered":"2021-10-08T19:38:30.844510+0000","last_clean":"2021-10-08T19:38:30.844510+0000","last_became_active":"2021-10-08T19:37:45.829953+0000","last_became_peered":"2021-10-08T19:37:45.829953+0000","last_unstale":"2021-10-08T19:38:30.844510+0000","last_undegraded":"2021-10-08T19:38:30.844510+0000","last_fullsized":"2021-10-08T19:38:30.844510+0000","mapping_epoch":407,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":408,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:12.643664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:12.643664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0025959149999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,2],"acting":[6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":423,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.844890+0000","last_change":"2021-10-08T19:37:52.836635+0000","last_active":"2021-10-08T19:38:30.844890+0000","last_peered":"2021-10-08T19:38:30.844890+0000","last_clean":"2021-10-08T19:38:30.844890+0000","last_became_active":"2021-10-08T19:24:25.094848+0000","last_became_peered":"2021-10-08T19:24:25.094848+0000","last_unstale":"2021-10-08T19:38:30.844890+0000","last_undegraded":"2021-10-08T19:38:30.844890+0000","last_fullsized":"2021-10-08T19:38:30.844890+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:52.836518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:37:52.836518+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.079698321000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":378,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.848526+0000","last_change":"2021-10-08T19:37:51.046331+0000","last_active":"2021-10-08T19:38:30.848526+0000","last_peered":"2021-10-08T19:38:30.848526+0000","last_clean":"2021-10-08T19:38:30.848526+0000","last_became_active":"2021-10-08T19:28:40.132751+0000","last_became_peered":"2021-10-08T19:28:40.132751+0000","last_unstale":"2021-10-08T19:38:30.848526+0000","last_undegraded":"2021-10-08T19:38:30.848526+0000","last_fullsized":"2021-10-08T19:38:30.848526+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:51.046234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:37:51.046234+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0044534300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.e","version":"427'14602","reported_seq":14688,"reported_epoch":427,"state":"active+clean","last_fresh":"2021-10-08T19:38:43.415715+0000","last_change":"2021-10-08T19:36:52.050640+0000","last_active":"2021-10-08T19:38:43.415715+0000","last_peered":"2021-10-08T19:38:43.415715+0000","last_clean":"2021-10-08T19:38:43.415715+0000","last_became_active":"2021-10-08T19:35:16.776024+0000","last_became_peered":"2021-10-08T19:35:16.776024+0000","last_unstale":"2021-10-08T19:38:43.415715+0000","last_undegraded":"2021-10-08T19:38:43.415715+0000","last_fullsized":"2021-10-08T19:38:43.415715+0000","mapping_epoch":355,"log_start":"408'10711","ondisk_log_start":"408'10711","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"388'7171","last_scrub_stamp":"2021-10-08T19:36:52.050522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:36:52.050522+0000","log_size":3891,"ondisk_log_size":3891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":2.5548819749999998,"stat_sum":{"num_bytes":14024704,"num_objects":214,"num_object_clones":0,"num_object_copies":642,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":214,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14602,"num_write_kb":474112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"90'130","reported_seq":581,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.837324+0000","last_change":"2021-10-08T19:36:43.505866+0000","last_active":"2021-10-08T19:38:30.837324+0000","last_peered":"2021-10-08T19:38:30.837324+0000","last_clean":"2021-10-08T19:38:30.837324+0000","last_became_active":"2021-10-08T19:27:26.590651+0000","last_became_peered":"2021-10-08T19:27:26.590651+0000","last_unstale":"2021-10-08T19:38:30.837324+0000","last_undegraded":"2021-10-08T19:38:30.837324+0000","last_fullsized":"2021-10-08T19:38:30.837324+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:36:43.505746+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:32:14.582883+0000","last_clean_scrub_stamp":"2021-10-08T19:36:43.505746+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003205388,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":418,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.836054+0000","last_change":"2021-10-08T19:36:42.480557+0000","last_active":"2021-10-08T19:38:30.836054+0000","last_peered":"2021-10-08T19:38:30.836054+0000","last_clean":"2021-10-08T19:38:30.836054+0000","last_became_active":"2021-10-08T19:29:40.639405+0000","last_became_peered":"2021-10-08T19:29:40.639405+0000","last_unstale":"2021-10-08T19:38:30.836054+0000","last_undegraded":"2021-10-08T19:38:30.836054+0000","last_fullsized":"2021-10-08T19:38:30.836054+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:42.480429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:36:42.480429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0070932640000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"289'30","reported_seq":253,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.847513+0000","last_change":"2021-10-08T19:37:55.431244+0000","last_active":"2021-10-08T19:38:30.847513+0000","last_peered":"2021-10-08T19:38:30.847513+0000","last_clean":"2021-10-08T19:38:30.847513+0000","last_became_active":"2021-10-08T19:29:40.635007+0000","last_became_peered":"2021-10-08T19:29:40.635007+0000","last_unstale":"2021-10-08T19:38:30.847513+0000","last_undegraded":"2021-10-08T19:38:30.847513+0000","last_fullsized":"2021-10-08T19:38:30.847513+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'30","last_scrub_stamp":"2021-10-08T19:37:55.431161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:37:55.431161+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0042801929999999998,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":51,"num_read_kb":39,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":260,"reported_epoch":427,"state":"active+clean","last_fresh":"2021-10-08T19:38:42.717056+0000","last_change":"2021-10-08T19:38:42.717018+0000","last_active":"2021-10-08T19:38:42.717056+0000","last_peered":"2021-10-08T19:38:42.717056+0000","last_clean":"2021-10-08T19:38:42.717056+0000","last_became_active":"2021-10-08T19:36:58.013501+0000","last_became_peered":"2021-10-08T19:36:58.013501+0000","last_unstale":"2021-10-08T19:38:42.717056+0000","last_undegraded":"2021-10-08T19:38:42.717056+0000","last_fullsized":"2021-10-08T19:38:42.717056+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:42.716926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:07.710367+0000","last_clean_scrub_stamp":"2021-10-08T19:38:42.716926+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0044019300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":416,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.836625+0000","last_change":"2021-10-08T19:37:55.342916+0000","last_active":"2021-10-08T19:38:30.836625+0000","last_peered":"2021-10-08T19:38:30.836625+0000","last_clean":"2021-10-08T19:38:30.836625+0000","last_became_active":"2021-10-08T19:29:40.638253+0000","last_became_peered":"2021-10-08T19:29:40.638253+0000","last_unstale":"2021-10-08T19:38:30.836625+0000","last_undegraded":"2021-10-08T19:38:30.836625+0000","last_fullsized":"2021-10-08T19:38:30.836625+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:55.342809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:37:55.342809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0074854370000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":211,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.864608+0000","last_change":"2021-10-08T19:36:10.804434+0000","last_active":"2021-10-08T19:38:30.864608+0000","last_peered":"2021-10-08T19:38:30.864608+0000","last_clean":"2021-10-08T19:38:30.864608+0000","last_became_active":"2021-10-08T19:29:40.634579+0000","last_became_peered":"2021-10-08T19:29:40.634579+0000","last_unstale":"2021-10-08T19:38:30.864608+0000","last_undegraded":"2021-10-08T19:38:30.864608+0000","last_fullsized":"2021-10-08T19:38:30.864608+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:10.804325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:10.804325+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0063916950000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.d","version":"427'14398","reported_seq":14485,"reported_epoch":427,"state":"active+clean","last_fresh":"2021-10-08T19:38:43.693446+0000","last_change":"2021-10-08T19:36:48.787555+0000","last_active":"2021-10-08T19:38:43.693446+0000","last_peered":"2021-10-08T19:38:43.693446+0000","last_clean":"2021-10-08T19:38:43.693446+0000","last_became_active":"2021-10-08T19:35:16.782695+0000","last_became_peered":"2021-10-08T19:35:16.782695+0000","last_unstale":"2021-10-08T19:38:43.693446+0000","last_undegraded":"2021-10-08T19:38:43.693446+0000","last_fullsized":"2021-10-08T19:38:43.693446+0000","mapping_epoch":355,"log_start":"404'10032","ondisk_log_start":"404'10032","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"387'6844","last_scrub_stamp":"2021-10-08T19:36:48.784582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:36:48.784582+0000","log_size":4366,"ondisk_log_size":4366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":2.9044785690000001,"stat_sum":{"num_bytes":14352408,"num_objects":220,"num_object_clones":0,"num_object_copies":660,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":14398,"num_write_kb":467713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"90'130","reported_seq":516,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.844699+0000","last_change":"2021-10-08T19:36:01.675001+0000","last_active":"2021-10-08T19:38:30.844699+0000","last_peered":"2021-10-08T19:38:30.844699+0000","last_clean":"2021-10-08T19:38:30.844699+0000","last_became_active":"2021-10-08T19:30:00.643797+0000","last_became_peered":"2021-10-08T19:30:00.643797+0000","last_unstale":"2021-10-08T19:38:30.844699+0000","last_undegraded":"2021-10-08T19:38:30.844699+0000","last_fullsized":"2021-10-08T19:38:30.844699+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:36:01.674904+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:36:01.674904+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.072145927999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":359,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:39.327117+0000","last_change":"2021-10-08T19:38:39.326995+0000","last_active":"2021-10-08T19:38:39.327117+0000","last_peered":"2021-10-08T19:38:39.327117+0000","last_clean":"2021-10-08T19:38:39.327117+0000","last_became_active":"2021-10-08T19:24:25.095389+0000","last_became_peered":"2021-10-08T19:24:25.095389+0000","last_unstale":"2021-10-08T19:38:39.327117+0000","last_undegraded":"2021-10-08T19:38:39.327117+0000","last_fullsized":"2021-10-08T19:38:39.327117+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:39.326929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:38:39.326929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0043694370000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"289'29","reported_seq":454,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.849774+0000","last_change":"2021-10-08T19:36:05.122735+0000","last_active":"2021-10-08T19:38:30.849774+0000","last_peered":"2021-10-08T19:38:30.849774+0000","last_clean":"2021-10-08T19:38:30.849774+0000","last_became_active":"2021-10-08T19:21:25.741812+0000","last_became_peered":"2021-10-08T19:21:25.741812+0000","last_unstale":"2021-10-08T19:38:30.849774+0000","last_undegraded":"2021-10-08T19:38:30.849774+0000","last_fullsized":"2021-10-08T19:38:30.849774+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'29","last_scrub_stamp":"2021-10-08T19:36:05.122593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:05.122593+0000","log_size":29,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0069217020000000001,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":54,"num_read_kb":40,"num_write":32,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"328'2","reported_seq":424,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.845449+0000","last_change":"2021-10-08T19:36:58.000426+0000","last_active":"2021-10-08T19:38:30.845449+0000","last_peered":"2021-10-08T19:38:30.845449+0000","last_clean":"2021-10-08T19:38:30.845449+0000","last_became_active":"2021-10-08T19:36:58.000171+0000","last_became_peered":"2021-10-08T19:36:58.000171+0000","last_unstale":"2021-10-08T19:38:30.845449+0000","last_undegraded":"2021-10-08T19:38:30.845449+0000","last_fullsized":"2021-10-08T19:38:30.845449+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"328'2","last_scrub_stamp":"2021-10-08T19:36:03.954613+0000","last_deep_scrub":"328'2","last_deep_scrub_stamp":"2021-10-08T19:33:29.990395+0000","last_clean_scrub_stamp":"2021-10-08T19:36:03.954613+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0074631530000000001,"stat_sum":{"num_bytes":179,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":251,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.853520+0000","last_change":"2021-10-08T19:37:55.594168+0000","last_active":"2021-10-08T19:38:30.853520+0000","last_peered":"2021-10-08T19:38:30.853520+0000","last_clean":"2021-10-08T19:38:30.853520+0000","last_became_active":"2021-10-08T19:28:40.140876+0000","last_became_peered":"2021-10-08T19:28:40.140876+0000","last_unstale":"2021-10-08T19:38:30.853520+0000","last_undegraded":"2021-10-08T19:38:30.853520+0000","last_fullsized":"2021-10-08T19:38:30.853520+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:55.594051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:37:55.594051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.083118095000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"70'5","reported_seq":257,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:38.667223+0000","last_change":"2021-10-08T19:38:38.667059+0000","last_active":"2021-10-08T19:38:38.667223+0000","last_peered":"2021-10-08T19:38:38.667223+0000","last_clean":"2021-10-08T19:38:38.667223+0000","last_became_active":"2021-10-08T19:28:40.150503+0000","last_became_peered":"2021-10-08T19:28:40.150503+0000","last_unstale":"2021-10-08T19:38:38.667223+0000","last_undegraded":"2021-10-08T19:38:38.667223+0000","last_fullsized":"2021-10-08T19:38:38.667223+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:38:38.666933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:38:38.666933+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0081526670000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.8","version":"427'14542","reported_seq":14628,"reported_epoch":427,"state":"active+clean","last_fresh":"2021-10-08T19:38:43.651185+0000","last_change":"2021-10-08T19:38:05.147128+0000","last_active":"2021-10-08T19:38:43.651185+0000","last_peered":"2021-10-08T19:38:43.651185+0000","last_clean":"2021-10-08T19:38:43.651185+0000","last_became_active":"2021-10-08T19:35:16.778100+0000","last_became_peered":"2021-10-08T19:35:16.778100+0000","last_unstale":"2021-10-08T19:38:43.651185+0000","last_undegraded":"2021-10-08T19:38:43.651185+0000","last_fullsized":"2021-10-08T19:38:43.651185+0000","mapping_epoch":355,"log_start":"404'10045","ondisk_log_start":"404'10045","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"415'11820","last_scrub_stamp":"2021-10-08T19:38:05.147000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:38:05.147000+0000","log_size":4497,"ondisk_log_size":4497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":1.12989524,"stat_sum":{"num_bytes":13369344,"num_objects":204,"num_object_clones":0,"num_object_copies":612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":204,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14542,"num_write_kb":471872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7],"acting":[0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"90'130","reported_seq":552,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.855172+0000","last_change":"2021-10-08T19:36:09.840616+0000","last_active":"2021-10-08T19:38:30.855172+0000","last_peered":"2021-10-08T19:38:30.855172+0000","last_clean":"2021-10-08T19:38:30.855172+0000","last_became_active":"2021-10-08T19:28:43.178371+0000","last_became_peered":"2021-10-08T19:28:43.178371+0000","last_unstale":"2021-10-08T19:38:30.855172+0000","last_undegraded":"2021-10-08T19:38:30.855172+0000","last_fullsized":"2021-10-08T19:38:30.855172+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:36:09.840508+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:34:13.653248+0000","last_clean_scrub_stamp":"2021-10-08T19:36:09.840508+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0067520610000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":171,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:32.463656+0000","last_change":"2021-10-08T19:38:32.463211+0000","last_active":"2021-10-08T19:38:32.463656+0000","last_peered":"2021-10-08T19:38:32.463656+0000","last_clean":"2021-10-08T19:38:32.463656+0000","last_became_active":"2021-10-08T19:31:22.783759+0000","last_became_peered":"2021-10-08T19:31:22.783759+0000","last_unstale":"2021-10-08T19:38:32.463656+0000","last_undegraded":"2021-10-08T19:38:32.463656+0000","last_fullsized":"2021-10-08T19:38:32.463656+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:32.463096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:38:32.463096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.030313300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"289'24","reported_seq":512,"reported_epoch":427,"state":"active+clean","last_fresh":"2021-10-08T19:38:42.136675+0000","last_change":"2021-10-08T19:38:42.136633+0000","last_active":"2021-10-08T19:38:42.136675+0000","last_peered":"2021-10-08T19:38:42.136675+0000","last_clean":"2021-10-08T19:38:42.136675+0000","last_became_active":"2021-10-08T19:32:45.154743+0000","last_became_peered":"2021-10-08T19:32:45.154743+0000","last_unstale":"2021-10-08T19:38:42.136675+0000","last_undegraded":"2021-10-08T19:38:42.136675+0000","last_fullsized":"2021-10-08T19:38:42.136675+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'24","last_scrub_stamp":"2021-10-08T19:38:42.136529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:38:42.136529+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012781328,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":30,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":411,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.838246+0000","last_change":"2021-10-08T19:37:51.166923+0000","last_active":"2021-10-08T19:38:30.838246+0000","last_peered":"2021-10-08T19:38:30.838246+0000","last_clean":"2021-10-08T19:38:30.838246+0000","last_became_active":"2021-10-08T19:36:58.012034+0000","last_became_peered":"2021-10-08T19:36:58.012034+0000","last_unstale":"2021-10-08T19:38:30.838246+0000","last_undegraded":"2021-10-08T19:38:30.838246+0000","last_fullsized":"2021-10-08T19:38:30.838246+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:51.166846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:32.922694+0000","last_clean_scrub_stamp":"2021-10-08T19:37:51.166846+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0061294460000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":441,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.853788+0000","last_change":"2021-10-08T19:37:59.963810+0000","last_active":"2021-10-08T19:38:30.853788+0000","last_peered":"2021-10-08T19:38:30.853788+0000","last_clean":"2021-10-08T19:38:30.853788+0000","last_became_active":"2021-10-08T19:29:40.632010+0000","last_became_peered":"2021-10-08T19:29:40.632010+0000","last_unstale":"2021-10-08T19:38:30.853788+0000","last_undegraded":"2021-10-08T19:38:30.853788+0000","last_fullsized":"2021-10-08T19:38:30.853788+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:59.963721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:37:59.963721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0066016690000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":153,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.854065+0000","last_change":"2021-10-08T19:36:11.789864+0000","last_active":"2021-10-08T19:38:30.854065+0000","last_peered":"2021-10-08T19:38:30.854065+0000","last_clean":"2021-10-08T19:38:30.854065+0000","last_became_active":"2021-10-08T19:31:51.673821+0000","last_became_peered":"2021-10-08T19:31:51.673821+0000","last_unstale":"2021-10-08T19:38:30.854065+0000","last_undegraded":"2021-10-08T19:38:30.854065+0000","last_fullsized":"2021-10-08T19:38:30.854065+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:11.789757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:21.644827+0000","last_clean_scrub_stamp":"2021-10-08T19:36:11.789757+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0099411570000000008,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"427'14237","reported_seq":14325,"reported_epoch":427,"state":"active+clean","last_fresh":"2021-10-08T19:38:43.699977+0000","last_change":"2021-10-08T19:37:18.182651+0000","last_active":"2021-10-08T19:38:43.699977+0000","last_peered":"2021-10-08T19:38:43.699977+0000","last_clean":"2021-10-08T19:38:43.699977+0000","last_became_active":"2021-10-08T19:35:16.784654+0000","last_became_peered":"2021-10-08T19:35:16.784654+0000","last_unstale":"2021-10-08T19:38:43.699977+0000","last_undegraded":"2021-10-08T19:38:43.699977+0000","last_fullsized":"2021-10-08T19:38:43.699977+0000","mapping_epoch":355,"log_start":"405'9939","ondisk_log_start":"405'9939","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"397'8632","last_scrub_stamp":"2021-10-08T19:37:18.182547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:37:18.182547+0000","log_size":4298,"ondisk_log_size":4298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":2.0639313760000002,"stat_sum":{"num_bytes":14352384,"num_objects":219,"num_object_clones":0,"num_object_copies":657,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":219,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14237,"num_write_kb":462592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0],"acting":[6,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":401,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.845543+0000","last_change":"2021-10-08T19:37:22.697805+0000","last_active":"2021-10-08T19:38:30.845543+0000","last_peered":"2021-10-08T19:38:30.845543+0000","last_clean":"2021-10-08T19:38:30.845543+0000","last_became_active":"2021-10-08T19:21:27.636086+0000","last_became_peered":"2021-10-08T19:21:27.636086+0000","last_unstale":"2021-10-08T19:38:30.845543+0000","last_undegraded":"2021-10-08T19:38:30.845543+0000","last_fullsized":"2021-10-08T19:38:30.845543+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:22.697722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:37:22.697722+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010100266,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"289'26","reported_seq":387,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.842803+0000","last_change":"2021-10-08T19:36:43.949273+0000","last_active":"2021-10-08T19:38:30.842803+0000","last_peered":"2021-10-08T19:38:30.842803+0000","last_clean":"2021-10-08T19:38:30.842803+0000","last_became_active":"2021-10-08T19:24:25.100384+0000","last_became_peered":"2021-10-08T19:24:25.100384+0000","last_unstale":"2021-10-08T19:38:30.842803+0000","last_undegraded":"2021-10-08T19:38:30.842803+0000","last_fullsized":"2021-10-08T19:38:30.842803+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'26","last_scrub_stamp":"2021-10-08T19:36:43.949161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:43.949161+0000","log_size":26,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011337099,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":42,"num_read_kb":32,"num_write":25,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"90'130","reported_seq":714,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.844269+0000","last_change":"2021-10-08T19:36:09.855513+0000","last_active":"2021-10-08T19:38:30.844269+0000","last_peered":"2021-10-08T19:38:30.844269+0000","last_clean":"2021-10-08T19:38:30.844269+0000","last_became_active":"2021-10-08T19:27:22.607289+0000","last_became_peered":"2021-10-08T19:27:22.607289+0000","last_unstale":"2021-10-08T19:38:30.844269+0000","last_undegraded":"2021-10-08T19:38:30.844269+0000","last_fullsized":"2021-10-08T19:38:30.844269+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:36:09.855393+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:36:09.855393+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0065522590000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":419,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.839820+0000","last_change":"2021-10-08T19:38:09.230388+0000","last_active":"2021-10-08T19:38:30.839820+0000","last_peered":"2021-10-08T19:38:30.839820+0000","last_clean":"2021-10-08T19:38:30.839820+0000","last_became_active":"2021-10-08T19:37:45.837378+0000","last_became_peered":"2021-10-08T19:37:45.837378+0000","last_unstale":"2021-10-08T19:38:30.839820+0000","last_undegraded":"2021-10-08T19:38:30.839820+0000","last_fullsized":"2021-10-08T19:38:30.839820+0000","mapping_epoch":407,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":408,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:09.230297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:38:09.230297+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0072500209999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":211,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.850070+0000","last_change":"2021-10-08T19:35:33.861695+0000","last_active":"2021-10-08T19:38:30.850070+0000","last_peered":"2021-10-08T19:38:30.850070+0000","last_clean":"2021-10-08T19:38:30.850070+0000","last_became_active":"2021-10-08T19:29:40.638774+0000","last_became_peered":"2021-10-08T19:29:40.638774+0000","last_unstale":"2021-10-08T19:38:30.850070+0000","last_undegraded":"2021-10-08T19:38:30.850070+0000","last_fullsized":"2021-10-08T19:38:30.850070+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:33.861554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:33.861554+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011946132999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":246,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:40.123567+0000","last_change":"2021-10-08T19:38:40.123422+0000","last_active":"2021-10-08T19:38:40.123567+0000","last_peered":"2021-10-08T19:38:40.123567+0000","last_clean":"2021-10-08T19:38:40.123567+0000","last_became_active":"2021-10-08T19:37:19.006459+0000","last_became_peered":"2021-10-08T19:37:19.006459+0000","last_unstale":"2021-10-08T19:38:40.123567+0000","last_undegraded":"2021-10-08T19:38:40.123567+0000","last_fullsized":"2021-10-08T19:38:40.123567+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:40.123325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:32:15.872860+0000","last_clean_scrub_stamp":"2021-10-08T19:38:40.123325+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.103398937,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4],"acting":[3,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"427'14660","reported_seq":14753,"reported_epoch":427,"state":"active+clean","last_fresh":"2021-10-08T19:38:43.930435+0000","last_change":"2021-10-08T19:37:25.988228+0000","last_active":"2021-10-08T19:38:43.930435+0000","last_peered":"2021-10-08T19:38:43.930435+0000","last_clean":"2021-10-08T19:38:43.930435+0000","last_became_active":"2021-10-08T19:37:19.009172+0000","last_became_peered":"2021-10-08T19:37:19.009172+0000","last_unstale":"2021-10-08T19:38:43.930435+0000","last_undegraded":"2021-10-08T19:38:43.930435+0000","last_fullsized":"2021-10-08T19:38:43.930435+0000","mapping_epoch":397,"log_start":"402'9415","ondisk_log_start":"402'9415","created":355,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'9371","last_scrub_stamp":"2021-10-08T19:37:25.988130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:37:25.988130+0000","log_size":5245,"ondisk_log_size":5245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":1.9691678000000001,"stat_sum":{"num_bytes":14024704,"num_objects":214,"num_object_clones":0,"num_object_copies":642,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":214,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14660,"num_write_kb":475968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"90'130","reported_seq":722,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.844532+0000","last_change":"2021-10-08T19:36:11.798375+0000","last_active":"2021-10-08T19:38:30.844532+0000","last_peered":"2021-10-08T19:38:30.844532+0000","last_clean":"2021-10-08T19:38:30.844532+0000","last_became_active":"2021-10-08T19:27:26.591250+0000","last_became_peered":"2021-10-08T19:27:26.591250+0000","last_unstale":"2021-10-08T19:38:30.844532+0000","last_undegraded":"2021-10-08T19:38:30.844532+0000","last_fullsized":"2021-10-08T19:38:30.844532+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:36:11.798245+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:36:11.798245+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013110805,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":411,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.840983+0000","last_change":"2021-10-08T19:36:57.860840+0000","last_active":"2021-10-08T19:38:30.840983+0000","last_peered":"2021-10-08T19:38:30.840983+0000","last_clean":"2021-10-08T19:38:30.840983+0000","last_became_active":"2021-10-08T19:21:27.637875+0000","last_became_peered":"2021-10-08T19:21:27.637875+0000","last_unstale":"2021-10-08T19:38:30.840983+0000","last_undegraded":"2021-10-08T19:38:30.840983+0000","last_fullsized":"2021-10-08T19:38:30.840983+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:57.860724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:20.092069+0000","last_clean_scrub_stamp":"2021-10-08T19:36:57.860724+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010614343,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"289'17","reported_seq":165,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.855801+0000","last_change":"2021-10-08T19:38:05.629718+0000","last_active":"2021-10-08T19:38:30.855801+0000","last_peered":"2021-10-08T19:38:30.855801+0000","last_clean":"2021-10-08T19:38:30.855801+0000","last_became_active":"2021-10-08T19:31:51.674965+0000","last_became_peered":"2021-10-08T19:31:51.674965+0000","last_unstale":"2021-10-08T19:38:30.855801+0000","last_undegraded":"2021-10-08T19:38:30.855801+0000","last_fullsized":"2021-10-08T19:38:30.855801+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'17","last_scrub_stamp":"2021-10-08T19:38:05.629630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:38:05.629630+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0080242690000000005,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":23,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":990,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":442,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.841891+0000","last_change":"2021-10-08T19:37:48.098527+0000","last_active":"2021-10-08T19:38:30.841891+0000","last_peered":"2021-10-08T19:38:30.841891+0000","last_clean":"2021-10-08T19:38:30.841891+0000","last_became_active":"2021-10-08T19:36:58.015216+0000","last_became_peered":"2021-10-08T19:36:58.015216+0000","last_unstale":"2021-10-08T19:38:30.841891+0000","last_undegraded":"2021-10-08T19:38:30.841891+0000","last_fullsized":"2021-10-08T19:38:30.841891+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:48.098449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:37:48.098449+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0092712760000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"70'5","reported_seq":255,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.854859+0000","last_change":"2021-10-08T19:36:44.490475+0000","last_active":"2021-10-08T19:38:30.854859+0000","last_peered":"2021-10-08T19:38:30.854859+0000","last_clean":"2021-10-08T19:38:30.854859+0000","last_became_active":"2021-10-08T19:28:40.148054+0000","last_became_peered":"2021-10-08T19:28:40.148054+0000","last_unstale":"2021-10-08T19:38:30.854859+0000","last_undegraded":"2021-10-08T19:38:30.854859+0000","last_fullsized":"2021-10-08T19:38:30.854859+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:36:44.490372+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2021-10-08T19:34:18.630378+0000","last_clean_scrub_stamp":"2021-10-08T19:36:44.490372+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0089419340000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":435,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:37.611060+0000","last_change":"2021-10-08T19:38:37.610892+0000","last_active":"2021-10-08T19:38:37.611060+0000","last_peered":"2021-10-08T19:38:37.611060+0000","last_clean":"2021-10-08T19:38:37.611060+0000","last_became_active":"2021-10-08T19:29:40.652528+0000","last_became_peered":"2021-10-08T19:29:40.652528+0000","last_unstale":"2021-10-08T19:38:37.611060+0000","last_undegraded":"2021-10-08T19:38:37.611060+0000","last_fullsized":"2021-10-08T19:38:37.611060+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:37.610765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:38:37.610765+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.053777754999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.a","version":"427'14611","reported_seq":14697,"reported_epoch":427,"state":"active+clean","last_fresh":"2021-10-08T19:38:43.694727+0000","last_change":"2021-10-08T19:37:59.309373+0000","last_active":"2021-10-08T19:38:43.694727+0000","last_peered":"2021-10-08T19:38:43.694727+0000","last_clean":"2021-10-08T19:38:43.694727+0000","last_became_active":"2021-10-08T19:35:16.782677+0000","last_became_peered":"2021-10-08T19:35:16.782677+0000","last_unstale":"2021-10-08T19:38:43.694727+0000","last_undegraded":"2021-10-08T19:38:43.694727+0000","last_fullsized":"2021-10-08T19:38:43.694727+0000","mapping_epoch":355,"log_start":"406'10238","ondisk_log_start":"406'10238","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"413'11586","last_scrub_stamp":"2021-10-08T19:37:59.309296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:37:59.309296+0000","log_size":4373,"ondisk_log_size":4373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":1.0725495869999999,"stat_sum":{"num_bytes":15400960,"num_objects":235,"num_object_clones":0,"num_object_copies":705,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":235,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14611,"num_write_kb":475072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"90'130","reported_seq":344,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.853708+0000","last_change":"2021-10-08T19:37:19.033103+0000","last_active":"2021-10-08T19:38:30.853708+0000","last_peered":"2021-10-08T19:38:30.853708+0000","last_clean":"2021-10-08T19:38:30.853708+0000","last_became_active":"2021-10-08T19:37:19.032630+0000","last_became_peered":"2021-10-08T19:37:19.032630+0000","last_unstale":"2021-10-08T19:38:30.853708+0000","last_undegraded":"2021-10-08T19:38:30.853708+0000","last_fullsized":"2021-10-08T19:38:30.853708+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:35:19.581220+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:35:19.581220+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020087920000000001,"stat_sum":{"num_bytes":53670,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":28,"num_write":17,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":161010,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":423,"reported_epoch":427,"state":"active+clean","last_fresh":"2021-10-08T19:38:43.096864+0000","last_change":"2021-10-08T19:38:43.096830+0000","last_active":"2021-10-08T19:38:43.096864+0000","last_peered":"2021-10-08T19:38:43.096864+0000","last_clean":"2021-10-08T19:38:43.096864+0000","last_became_active":"2021-10-08T19:28:40.133414+0000","last_became_peered":"2021-10-08T19:28:40.133414+0000","last_unstale":"2021-10-08T19:38:43.096864+0000","last_undegraded":"2021-10-08T19:38:43.096864+0000","last_fullsized":"2021-10-08T19:38:43.096864+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:43.096755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:38:43.096755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011508566,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"289'44","reported_seq":481,"reported_epoch":427,"state":"active+clean","last_fresh":"2021-10-08T19:38:41.881763+0000","last_change":"2021-10-08T19:38:41.715286+0000","last_active":"2021-10-08T19:38:41.881763+0000","last_peered":"2021-10-08T19:38:41.881763+0000","last_clean":"2021-10-08T19:38:41.881763+0000","last_became_active":"2021-10-08T19:29:40.626138+0000","last_became_peered":"2021-10-08T19:29:40.626138+0000","last_unstale":"2021-10-08T19:38:41.881763+0000","last_undegraded":"2021-10-08T19:38:41.881763+0000","last_fullsized":"2021-10-08T19:38:41.881763+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'44","last_scrub_stamp":"2021-10-08T19:38:41.715181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:38:41.715181+0000","log_size":44,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0032677489999999999,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":65,"num_read_kb":50,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":1432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":440,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.853600+0000","last_change":"2021-10-08T19:37:19.004656+0000","last_active":"2021-10-08T19:38:30.853600+0000","last_peered":"2021-10-08T19:38:30.853600+0000","last_clean":"2021-10-08T19:38:30.853600+0000","last_became_active":"2021-10-08T19:37:19.004386+0000","last_became_peered":"2021-10-08T19:37:19.004386+0000","last_unstale":"2021-10-08T19:38:30.853600+0000","last_undegraded":"2021-10-08T19:38:30.853600+0000","last_fullsized":"2021-10-08T19:38:30.853600+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:23.647485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:23.647485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002822181,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":219,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.854513+0000","last_change":"2021-10-08T19:38:00.340784+0000","last_active":"2021-10-08T19:38:30.854513+0000","last_peered":"2021-10-08T19:38:30.854513+0000","last_clean":"2021-10-08T19:38:30.854513+0000","last_became_active":"2021-10-08T19:29:40.637371+0000","last_became_peered":"2021-10-08T19:29:40.637371+0000","last_unstale":"2021-10-08T19:38:30.854513+0000","last_undegraded":"2021-10-08T19:38:30.854513+0000","last_fullsized":"2021-10-08T19:38:30.854513+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:00.340701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:38:00.340701+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.015510070000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":360,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.836318+0000","last_change":"2021-10-08T19:36:09.181971+0000","last_active":"2021-10-08T19:38:30.836318+0000","last_peered":"2021-10-08T19:38:30.836318+0000","last_clean":"2021-10-08T19:38:30.836318+0000","last_became_active":"2021-10-08T19:25:14.550690+0000","last_became_peered":"2021-10-08T19:25:14.550690+0000","last_unstale":"2021-10-08T19:38:30.836318+0000","last_undegraded":"2021-10-08T19:38:30.836318+0000","last_fullsized":"2021-10-08T19:38:30.836318+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:09.181866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:36:09.181866+0000","last_clean_scrub_stamp":"2021-10-08T19:36:09.181866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0070630550000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"427'14778","reported_seq":14864,"reported_epoch":427,"state":"active+clean","last_fresh":"2021-10-08T19:38:43.706605+0000","last_change":"2021-10-08T19:38:03.167993+0000","last_active":"2021-10-08T19:38:43.706605+0000","last_peered":"2021-10-08T19:38:43.706605+0000","last_clean":"2021-10-08T19:38:43.706605+0000","last_became_active":"2021-10-08T19:35:16.778062+0000","last_became_peered":"2021-10-08T19:35:16.778062+0000","last_unstale":"2021-10-08T19:38:43.706605+0000","last_undegraded":"2021-10-08T19:38:43.706605+0000","last_fullsized":"2021-10-08T19:38:43.706605+0000","mapping_epoch":355,"log_start":"408'10966","ondisk_log_start":"408'10966","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"415'12045","last_scrub_stamp":"2021-10-08T19:38:03.167870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:38:03.167870+0000","log_size":3812,"ondisk_log_size":3812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":1.364145553,"stat_sum":{"num_bytes":13762560,"num_objects":210,"num_object_clones":0,"num_object_copies":630,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":210,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14778,"num_write_kb":479616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.7","version":"90'130","reported_seq":682,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.844180+0000","last_change":"2021-10-08T19:38:03.289225+0000","last_active":"2021-10-08T19:38:30.844180+0000","last_peered":"2021-10-08T19:38:30.844180+0000","last_clean":"2021-10-08T19:38:30.844180+0000","last_became_active":"2021-10-08T19:29:43.636820+0000","last_became_peered":"2021-10-08T19:29:43.636820+0000","last_unstale":"2021-10-08T19:38:30.844180+0000","last_undegraded":"2021-10-08T19:38:30.844180+0000","last_fullsized":"2021-10-08T19:38:30.844180+0000","mapping_epoch":239,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:38:03.289111+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:38:03.289111+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0028045850000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"114'10","reported_seq":646,"reported_epoch":427,"state":"active+clean","last_fresh":"2021-10-08T19:38:41.866690+0000","last_change":"2021-10-08T19:37:21.787584+0000","last_active":"2021-10-08T19:38:41.866690+0000","last_peered":"2021-10-08T19:38:41.866690+0000","last_clean":"2021-10-08T19:38:41.866690+0000","last_became_active":"2021-10-08T19:24:25.106695+0000","last_became_peered":"2021-10-08T19:24:25.106695+0000","last_unstale":"2021-10-08T19:38:41.866690+0000","last_undegraded":"2021-10-08T19:38:41.866690+0000","last_fullsized":"2021-10-08T19:38:41.866690+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'10","last_scrub_stamp":"2021-10-08T19:37:21.787486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:37:21.787486+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0082555349999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"289'20","reported_seq":159,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.853786+0000","last_change":"2021-10-08T19:36:04.773566+0000","last_active":"2021-10-08T19:38:30.853786+0000","last_peered":"2021-10-08T19:38:30.853786+0000","last_clean":"2021-10-08T19:38:30.853786+0000","last_became_active":"2021-10-08T19:31:51.675569+0000","last_became_peered":"2021-10-08T19:31:51.675569+0000","last_unstale":"2021-10-08T19:38:30.853786+0000","last_undegraded":"2021-10-08T19:38:30.853786+0000","last_fullsized":"2021-10-08T19:38:30.853786+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'20","last_scrub_stamp":"2021-10-08T19:36:04.773449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:04.773449+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0045168379999999996,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":23,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":260,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.856156+0000","last_change":"2021-10-08T19:36:58.014402+0000","last_active":"2021-10-08T19:38:30.856156+0000","last_peered":"2021-10-08T19:38:30.856156+0000","last_clean":"2021-10-08T19:38:30.856156+0000","last_became_active":"2021-10-08T19:36:58.013921+0000","last_became_peered":"2021-10-08T19:36:58.013921+0000","last_unstale":"2021-10-08T19:38:30.856156+0000","last_undegraded":"2021-10-08T19:38:30.856156+0000","last_fullsized":"2021-10-08T19:38:30.856156+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:16.702426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:16.702426+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0018085219999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":419,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.845347+0000","last_change":"2021-10-08T19:37:13.773377+0000","last_active":"2021-10-08T19:38:30.845347+0000","last_peered":"2021-10-08T19:38:30.845347+0000","last_clean":"2021-10-08T19:38:30.845347+0000","last_became_active":"2021-10-08T19:29:40.643614+0000","last_became_peered":"2021-10-08T19:29:40.643614+0000","last_unstale":"2021-10-08T19:38:30.845347+0000","last_undegraded":"2021-10-08T19:38:30.845347+0000","last_fullsized":"2021-10-08T19:38:30.845347+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:13.773265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:16.042797+0000","last_clean_scrub_stamp":"2021-10-08T19:37:13.773265+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.032956425999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":204,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.855182+0000","last_change":"2021-10-08T19:37:19.012787+0000","last_active":"2021-10-08T19:38:30.855182+0000","last_peered":"2021-10-08T19:38:30.855182+0000","last_clean":"2021-10-08T19:38:30.855182+0000","last_became_active":"2021-10-08T19:37:19.012488+0000","last_became_peered":"2021-10-08T19:37:19.012488+0000","last_unstale":"2021-10-08T19:38:30.855182+0000","last_undegraded":"2021-10-08T19:38:30.855182+0000","last_fullsized":"2021-10-08T19:38:30.855182+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:40.867717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:40.867717+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0052805589999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,2],"acting":[3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.7","version":"427'14785","reported_seq":14874,"reported_epoch":427,"state":"active+clean","last_fresh":"2021-10-08T19:38:43.711657+0000","last_change":"2021-10-08T19:37:57.223024+0000","last_active":"2021-10-08T19:38:43.711657+0000","last_peered":"2021-10-08T19:38:43.711657+0000","last_clean":"2021-10-08T19:38:43.711657+0000","last_became_active":"2021-10-08T19:35:17.124846+0000","last_became_peered":"2021-10-08T19:35:17.124846+0000","last_unstale":"2021-10-08T19:38:43.711657+0000","last_undegraded":"2021-10-08T19:38:43.711657+0000","last_fullsized":"2021-10-08T19:38:43.711657+0000","mapping_epoch":355,"log_start":"406'10444","ondisk_log_start":"406'10444","created":355,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"412'11610","last_scrub_stamp":"2021-10-08T19:37:57.222895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:15.759693+0000","last_clean_scrub_stamp":"2021-10-08T19:37:57.222895+0000","log_size":4341,"ondisk_log_size":4341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.993709756,"stat_sum":{"num_bytes":15794176,"num_objects":241,"num_object_clones":0,"num_object_copies":723,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":241,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14785,"num_write_kb":480832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":433,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:35.991521+0000","last_change":"2021-10-08T19:38:35.991385+0000","last_active":"2021-10-08T19:38:35.991521+0000","last_peered":"2021-10-08T19:38:35.991521+0000","last_clean":"2021-10-08T19:38:35.991521+0000","last_became_active":"2021-10-08T19:28:40.138726+0000","last_became_peered":"2021-10-08T19:28:40.138726+0000","last_unstale":"2021-10-08T19:38:35.991521+0000","last_undegraded":"2021-10-08T19:38:35.991521+0000","last_fullsized":"2021-10-08T19:38:35.991521+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:35.991278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:50.435552+0000","last_clean_scrub_stamp":"2021-10-08T19:38:35.991278+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0059341070000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"289'18","reported_seq":518,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:40.229784+0000","last_change":"2021-10-08T19:38:40.229383+0000","last_active":"2021-10-08T19:38:40.229784+0000","last_peered":"2021-10-08T19:38:40.229784+0000","last_clean":"2021-10-08T19:38:40.229784+0000","last_became_active":"2021-10-08T19:29:40.638957+0000","last_became_peered":"2021-10-08T19:29:40.638957+0000","last_unstale":"2021-10-08T19:38:40.229784+0000","last_undegraded":"2021-10-08T19:38:40.229784+0000","last_fullsized":"2021-10-08T19:38:40.229784+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'18","last_scrub_stamp":"2021-10-08T19:38:40.229289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:38:40.229289+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.015217840999999999,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":25,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"61'2","reported_seq":420,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.837053+0000","last_change":"2021-10-08T19:37:30.690153+0000","last_active":"2021-10-08T19:38:30.837053+0000","last_peered":"2021-10-08T19:38:30.837053+0000","last_clean":"2021-10-08T19:38:30.837053+0000","last_became_active":"2021-10-08T19:21:23.603614+0000","last_became_peered":"2021-10-08T19:21:23.603614+0000","last_unstale":"2021-10-08T19:38:30.837053+0000","last_undegraded":"2021-10-08T19:38:30.837053+0000","last_fullsized":"2021-10-08T19:38:30.837053+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'2","last_scrub_stamp":"2021-10-08T19:37:30.690057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:37:30.690057+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0038410610000000002,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":213,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:36.149231+0000","last_change":"2021-10-08T19:38:36.149231+0000","last_active":"2021-10-08T19:38:36.149231+0000","last_peered":"2021-10-08T19:38:36.149231+0000","last_clean":"2021-10-08T19:38:36.149231+0000","last_became_active":"2021-10-08T19:29:40.645211+0000","last_became_peered":"2021-10-08T19:29:40.645211+0000","last_unstale":"2021-10-08T19:38:36.149231+0000","last_undegraded":"2021-10-08T19:38:36.149231+0000","last_fullsized":"2021-10-08T19:38:36.149231+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:18.179673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:35:18.179673+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.080956615999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":340,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.845261+0000","last_change":"2021-10-08T19:37:21.652886+0000","last_active":"2021-10-08T19:38:30.845261+0000","last_peered":"2021-10-08T19:38:30.845261+0000","last_clean":"2021-10-08T19:38:30.845261+0000","last_became_active":"2021-10-08T19:28:40.100770+0000","last_became_peered":"2021-10-08T19:28:40.100770+0000","last_unstale":"2021-10-08T19:38:30.845261+0000","last_undegraded":"2021-10-08T19:38:30.845261+0000","last_fullsized":"2021-10-08T19:38:30.845261+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:21.652815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:37:21.652815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.006008953,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"289'15","reported_seq":472,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:35.166631+0000","last_change":"2021-10-08T19:38:35.166495+0000","last_active":"2021-10-08T19:38:35.166631+0000","last_peered":"2021-10-08T19:38:35.166631+0000","last_clean":"2021-10-08T19:38:35.166631+0000","last_became_active":"2021-10-08T19:29:40.644354+0000","last_became_peered":"2021-10-08T19:29:40.644354+0000","last_unstale":"2021-10-08T19:38:35.166631+0000","last_undegraded":"2021-10-08T19:38:35.166631+0000","last_fullsized":"2021-10-08T19:38:35.166631+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'15","last_scrub_stamp":"2021-10-08T19:38:35.166389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:38:35.166389+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.017091423000000001,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":439,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.838428+0000","last_change":"2021-10-08T19:36:45.011649+0000","last_active":"2021-10-08T19:38:30.838428+0000","last_peered":"2021-10-08T19:38:30.838428+0000","last_clean":"2021-10-08T19:38:30.838428+0000","last_became_active":"2021-10-08T19:28:40.139234+0000","last_became_peered":"2021-10-08T19:28:40.139234+0000","last_unstale":"2021-10-08T19:38:30.838428+0000","last_undegraded":"2021-10-08T19:38:30.838428+0000","last_fullsized":"2021-10-08T19:38:30.838428+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:45.011548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:45.011548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0092964109999999992,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":211,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.864873+0000","last_change":"2021-10-08T19:35:19.059789+0000","last_active":"2021-10-08T19:38:30.864873+0000","last_peered":"2021-10-08T19:38:30.864873+0000","last_clean":"2021-10-08T19:38:30.864873+0000","last_became_active":"2021-10-08T19:29:40.645111+0000","last_became_peered":"2021-10-08T19:29:40.645111+0000","last_unstale":"2021-10-08T19:38:30.864873+0000","last_undegraded":"2021-10-08T19:38:30.864873+0000","last_fullsized":"2021-10-08T19:38:30.864873+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:19.059695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:35:19.059695+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0017259879999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":411,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.839855+0000","last_change":"2021-10-08T19:38:06.192532+0000","last_active":"2021-10-08T19:38:30.839855+0000","last_peered":"2021-10-08T19:38:30.839855+0000","last_clean":"2021-10-08T19:38:30.839855+0000","last_became_active":"2021-10-08T19:21:29.640674+0000","last_became_peered":"2021-10-08T19:21:29.640674+0000","last_unstale":"2021-10-08T19:38:30.839855+0000","last_undegraded":"2021-10-08T19:38:30.839855+0000","last_fullsized":"2021-10-08T19:38:30.839855+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:06.192441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:38:06.192441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040996660000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":332,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:35.553843+0000","last_change":"2021-10-08T19:38:35.553709+0000","last_active":"2021-10-08T19:38:35.553843+0000","last_peered":"2021-10-08T19:38:35.553843+0000","last_clean":"2021-10-08T19:38:35.553843+0000","last_became_active":"2021-10-08T19:25:15.501118+0000","last_became_peered":"2021-10-08T19:25:15.501118+0000","last_unstale":"2021-10-08T19:38:35.553843+0000","last_undegraded":"2021-10-08T19:38:35.553843+0000","last_fullsized":"2021-10-08T19:38:35.553843+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:35.553608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:38:35.553608+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0017789769999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"289'12","reported_seq":234,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.864703+0000","last_change":"2021-10-08T19:36:14.746788+0000","last_active":"2021-10-08T19:38:30.864703+0000","last_peered":"2021-10-08T19:38:30.864703+0000","last_clean":"2021-10-08T19:38:30.864703+0000","last_became_active":"2021-10-08T19:29:40.644657+0000","last_became_peered":"2021-10-08T19:29:40.644657+0000","last_unstale":"2021-10-08T19:38:30.864703+0000","last_undegraded":"2021-10-08T19:38:30.864703+0000","last_fullsized":"2021-10-08T19:38:30.864703+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'12","last_scrub_stamp":"2021-10-08T19:36:14.746690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:14.746690+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0050396959999999998,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":18,"num_read_kb":15,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":373,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.842271+0000","last_change":"2021-10-08T19:36:48.882690+0000","last_active":"2021-10-08T19:38:30.842271+0000","last_peered":"2021-10-08T19:38:30.842271+0000","last_clean":"2021-10-08T19:38:30.842271+0000","last_became_active":"2021-10-08T19:28:40.101898+0000","last_became_peered":"2021-10-08T19:28:40.101898+0000","last_unstale":"2021-10-08T19:38:30.842271+0000","last_undegraded":"2021-10-08T19:38:30.842271+0000","last_fullsized":"2021-10-08T19:38:30.842271+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:16.444582+0000","last_clean_scrub_stamp":"2021-10-08T19:36:48.882597+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011015562,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":268,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.854364+0000","last_change":"2021-10-08T19:37:49.277058+0000","last_active":"2021-10-08T19:38:30.854364+0000","last_peered":"2021-10-08T19:38:30.854364+0000","last_clean":"2021-10-08T19:38:30.854364+0000","last_became_active":"2021-10-08T19:37:19.011117+0000","last_became_peered":"2021-10-08T19:37:19.011117+0000","last_unstale":"2021-10-08T19:38:30.854364+0000","last_undegraded":"2021-10-08T19:38:30.854364+0000","last_fullsized":"2021-10-08T19:38:30.854364+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:49.276955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:37:49.276955+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014777808,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":417,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.845192+0000","last_change":"2021-10-08T19:35:33.907637+0000","last_active":"2021-10-08T19:38:30.845192+0000","last_peered":"2021-10-08T19:38:30.845192+0000","last_clean":"2021-10-08T19:38:30.845192+0000","last_became_active":"2021-10-08T19:24:25.099371+0000","last_became_peered":"2021-10-08T19:24:25.099371+0000","last_unstale":"2021-10-08T19:38:30.845192+0000","last_undegraded":"2021-10-08T19:38:30.845192+0000","last_fullsized":"2021-10-08T19:38:30.845192+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:33.907545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:35:33.907545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.028929507,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"70'5","reported_seq":608,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:38.295156+0000","last_change":"2021-10-08T19:38:38.295005+0000","last_active":"2021-10-08T19:38:38.295156+0000","last_peered":"2021-10-08T19:38:38.295156+0000","last_clean":"2021-10-08T19:38:38.295156+0000","last_became_active":"2021-10-08T19:31:22.785193+0000","last_became_peered":"2021-10-08T19:31:22.785193+0000","last_unstale":"2021-10-08T19:38:38.295156+0000","last_undegraded":"2021-10-08T19:38:38.295156+0000","last_fullsized":"2021-10-08T19:38:38.295156+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":5,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:38:38.294930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:38:38.294930+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0055411690000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"289'20","reported_seq":282,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.847833+0000","last_change":"2021-10-08T19:35:59.742206+0000","last_active":"2021-10-08T19:38:30.847833+0000","last_peered":"2021-10-08T19:38:30.847833+0000","last_clean":"2021-10-08T19:38:30.847833+0000","last_became_active":"2021-10-08T19:31:51.677055+0000","last_became_peered":"2021-10-08T19:31:51.677055+0000","last_unstale":"2021-10-08T19:38:30.847833+0000","last_undegraded":"2021-10-08T19:38:30.847833+0000","last_fullsized":"2021-10-08T19:38:30.847833+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'20","last_scrub_stamp":"2021-10-08T19:35:59.742121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:35:59.742121+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0052506209999999996,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":252,"reported_epoch":427,"state":"active+clean","last_fresh":"2021-10-08T19:38:42.050866+0000","last_change":"2021-10-08T19:38:42.050830+0000","last_active":"2021-10-08T19:38:42.050866+0000","last_peered":"2021-10-08T19:38:42.050866+0000","last_clean":"2021-10-08T19:38:42.050866+0000","last_became_active":"2021-10-08T19:37:19.005757+0000","last_became_peered":"2021-10-08T19:37:19.005757+0000","last_unstale":"2021-10-08T19:38:42.050866+0000","last_undegraded":"2021-10-08T19:38:42.050866+0000","last_fullsized":"2021-10-08T19:38:42.050866+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:42.050731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:38:42.050731+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034338810000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"398'12","reported_seq":530,"reported_epoch":427,"state":"active+clean","last_fresh":"2021-10-08T19:38:41.880962+0000","last_change":"2021-10-08T19:37:19.016457+0000","last_active":"2021-10-08T19:38:41.880962+0000","last_peered":"2021-10-08T19:38:41.880962+0000","last_clean":"2021-10-08T19:38:41.880962+0000","last_became_active":"2021-10-08T19:37:19.015189+0000","last_became_peered":"2021-10-08T19:37:19.015189+0000","last_unstale":"2021-10-08T19:38:41.880962+0000","last_undegraded":"2021-10-08T19:38:41.880962+0000","last_fullsized":"2021-10-08T19:38:41.880962+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"328'11","last_scrub_stamp":"2021-10-08T19:37:13.666624+0000","last_deep_scrub":"328'11","last_deep_scrub_stamp":"2021-10-08T19:33:32.545870+0000","last_clean_scrub_stamp":"2021-10-08T19:37:13.666624+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0085427560000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":413,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.848605+0000","last_change":"2021-10-08T19:36:07.150538+0000","last_active":"2021-10-08T19:38:30.848605+0000","last_peered":"2021-10-08T19:38:30.848605+0000","last_clean":"2021-10-08T19:38:30.848605+0000","last_became_active":"2021-10-08T19:29:40.644819+0000","last_became_peered":"2021-10-08T19:29:40.644819+0000","last_unstale":"2021-10-08T19:38:30.848605+0000","last_undegraded":"2021-10-08T19:38:30.848605+0000","last_fullsized":"2021-10-08T19:38:30.848605+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:07.150440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:36:07.150440+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.032064849999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":328,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.844442+0000","last_change":"2021-10-08T19:38:06.778006+0000","last_active":"2021-10-08T19:38:30.844442+0000","last_peered":"2021-10-08T19:38:30.844442+0000","last_clean":"2021-10-08T19:38:30.844442+0000","last_became_active":"2021-10-08T19:25:15.498770+0000","last_became_peered":"2021-10-08T19:25:15.498770+0000","last_unstale":"2021-10-08T19:38:30.844442+0000","last_undegraded":"2021-10-08T19:38:30.844442+0000","last_fullsized":"2021-10-08T19:38:30.844442+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:06.777889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:38:06.777889+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012207519,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"289'15","reported_seq":73,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.845352+0000","last_change":"2021-10-08T19:37:19.007863+0000","last_active":"2021-10-08T19:38:30.845352+0000","last_peered":"2021-10-08T19:38:30.845352+0000","last_clean":"2021-10-08T19:38:30.845352+0000","last_became_active":"2021-10-08T19:37:19.007551+0000","last_became_peered":"2021-10-08T19:37:19.007551+0000","last_unstale":"2021-10-08T19:38:30.845352+0000","last_undegraded":"2021-10-08T19:38:30.845352+0000","last_fullsized":"2021-10-08T19:38:30.845352+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'15","last_scrub_stamp":"2021-10-08T19:36:42.879493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:42.879493+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0047281429999999998,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":427,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.849922+0000","last_change":"2021-10-08T19:36:13.061448+0000","last_active":"2021-10-08T19:38:30.849922+0000","last_peered":"2021-10-08T19:38:30.849922+0000","last_clean":"2021-10-08T19:38:30.849922+0000","last_became_active":"2021-10-08T19:29:44.439397+0000","last_became_peered":"2021-10-08T19:29:44.439397+0000","last_unstale":"2021-10-08T19:38:30.849922+0000","last_undegraded":"2021-10-08T19:38:30.849922+0000","last_fullsized":"2021-10-08T19:38:30.849922+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:13.061347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:13.061347+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0089607839999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"413'11","reported_seq":331,"reported_epoch":427,"state":"active+clean","last_fresh":"2021-10-08T19:38:41.870827+0000","last_change":"2021-10-08T19:37:59.373999+0000","last_active":"2021-10-08T19:38:41.870827+0000","last_peered":"2021-10-08T19:38:41.870827+0000","last_clean":"2021-10-08T19:38:41.870827+0000","last_became_active":"2021-10-08T19:29:40.637650+0000","last_became_peered":"2021-10-08T19:29:40.637650+0000","last_unstale":"2021-10-08T19:38:41.870827+0000","last_undegraded":"2021-10-08T19:38:41.870827+0000","last_fullsized":"2021-10-08T19:38:41.870827+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"413'11","last_scrub_stamp":"2021-10-08T19:37:59.373882+0000","last_deep_scrub":"413'11","last_deep_scrub_stamp":"2021-10-08T19:37:59.373882+0000","last_clean_scrub_stamp":"2021-10-08T19:37:59.373882+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0097897460000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":398,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.837252+0000","last_change":"2021-10-08T19:38:06.355634+0000","last_active":"2021-10-08T19:38:30.837252+0000","last_peered":"2021-10-08T19:38:30.837252+0000","last_clean":"2021-10-08T19:38:30.837252+0000","last_became_active":"2021-10-08T19:21:29.640302+0000","last_became_peered":"2021-10-08T19:21:29.640302+0000","last_unstale":"2021-10-08T19:38:30.837252+0000","last_undegraded":"2021-10-08T19:38:30.837252+0000","last_fullsized":"2021-10-08T19:38:30.837252+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:06.355521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:38:06.355521+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.101121058,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":340,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.847653+0000","last_change":"2021-10-08T19:37:52.056229+0000","last_active":"2021-10-08T19:38:30.847653+0000","last_peered":"2021-10-08T19:38:30.847653+0000","last_clean":"2021-10-08T19:38:30.847653+0000","last_became_active":"2021-10-08T19:29:40.631374+0000","last_became_peered":"2021-10-08T19:29:40.631374+0000","last_unstale":"2021-10-08T19:38:30.847653+0000","last_undegraded":"2021-10-08T19:38:30.847653+0000","last_fullsized":"2021-10-08T19:38:30.847653+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:52.056118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:37:52.056118+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0046200219999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":344,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.845158+0000","last_change":"2021-10-08T19:38:08.749060+0000","last_active":"2021-10-08T19:38:30.845158+0000","last_peered":"2021-10-08T19:38:30.845158+0000","last_clean":"2021-10-08T19:38:30.845158+0000","last_became_active":"2021-10-08T19:29:40.652966+0000","last_became_peered":"2021-10-08T19:29:40.652966+0000","last_unstale":"2021-10-08T19:38:30.845158+0000","last_undegraded":"2021-10-08T19:38:30.845158+0000","last_fullsized":"2021-10-08T19:38:30.845158+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:08.748947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:08.748947+0000","last_clean_scrub_stamp":"2021-10-08T19:38:08.748947+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0079490979999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"289'19","reported_seq":165,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.853521+0000","last_change":"2021-10-08T19:37:53.478710+0000","last_active":"2021-10-08T19:38:30.853521+0000","last_peered":"2021-10-08T19:38:30.853521+0000","last_clean":"2021-10-08T19:38:30.853521+0000","last_became_active":"2021-10-08T19:31:51.676961+0000","last_became_peered":"2021-10-08T19:31:51.676961+0000","last_unstale":"2021-10-08T19:38:30.853521+0000","last_undegraded":"2021-10-08T19:38:30.853521+0000","last_fullsized":"2021-10-08T19:38:30.853521+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:37:53.478605+0000","last_deep_scrub":"289'19","last_deep_scrub_stamp":"2021-10-08T19:32:46.539792+0000","last_clean_scrub_stamp":"2021-10-08T19:37:53.478605+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0084777749999999999,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":389,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.842326+0000","last_change":"2021-10-08T19:36:41.943798+0000","last_active":"2021-10-08T19:38:30.842326+0000","last_peered":"2021-10-08T19:38:30.842326+0000","last_clean":"2021-10-08T19:38:30.842326+0000","last_became_active":"2021-10-08T19:31:22.786651+0000","last_became_peered":"2021-10-08T19:31:22.786651+0000","last_unstale":"2021-10-08T19:38:30.842326+0000","last_undegraded":"2021-10-08T19:38:30.842326+0000","last_fullsized":"2021-10-08T19:38:30.842326+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:41.943676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:41.943676+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014561818000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":219,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.848274+0000","last_change":"2021-10-08T19:38:06.367374+0000","last_active":"2021-10-08T19:38:30.848274+0000","last_peered":"2021-10-08T19:38:30.848274+0000","last_clean":"2021-10-08T19:38:30.848274+0000","last_became_active":"2021-10-08T19:29:40.644770+0000","last_became_peered":"2021-10-08T19:29:40.644770+0000","last_unstale":"2021-10-08T19:38:30.848274+0000","last_undegraded":"2021-10-08T19:38:30.848274+0000","last_fullsized":"2021-10-08T19:38:30.848274+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:06.367259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:06.367259+0000","last_clean_scrub_stamp":"2021-10-08T19:38:06.367259+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010215291,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":421,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:36.179803+0000","last_change":"2021-10-08T19:38:36.179667+0000","last_active":"2021-10-08T19:38:36.179803+0000","last_peered":"2021-10-08T19:38:36.179803+0000","last_clean":"2021-10-08T19:38:36.179803+0000","last_became_active":"2021-10-08T19:28:40.133744+0000","last_became_peered":"2021-10-08T19:28:40.133744+0000","last_unstale":"2021-10-08T19:38:36.179803+0000","last_undegraded":"2021-10-08T19:38:36.179803+0000","last_fullsized":"2021-10-08T19:38:36.179803+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:36.179579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:38:36.179579+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.035775066000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"289'19","reported_seq":552,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.836277+0000","last_change":"2021-10-08T19:36:10.148431+0000","last_active":"2021-10-08T19:38:30.836277+0000","last_peered":"2021-10-08T19:38:30.836277+0000","last_clean":"2021-10-08T19:38:30.836277+0000","last_became_active":"2021-10-08T19:28:40.100196+0000","last_became_peered":"2021-10-08T19:28:40.100196+0000","last_unstale":"2021-10-08T19:38:30.836277+0000","last_undegraded":"2021-10-08T19:38:30.836277+0000","last_fullsized":"2021-10-08T19:38:30.836277+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:36:10.148317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:10.148317+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013984083,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":259,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.855161+0000","last_change":"2021-10-08T19:38:09.610754+0000","last_active":"2021-10-08T19:38:30.855161+0000","last_peered":"2021-10-08T19:38:30.855161+0000","last_clean":"2021-10-08T19:38:30.855161+0000","last_became_active":"2021-10-08T19:28:40.146673+0000","last_became_peered":"2021-10-08T19:28:40.146673+0000","last_unstale":"2021-10-08T19:38:30.855161+0000","last_undegraded":"2021-10-08T19:38:30.855161+0000","last_fullsized":"2021-10-08T19:38:30.855161+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:09.610637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:09.610637+0000","last_clean_scrub_stamp":"2021-10-08T19:38:09.610637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0088560310000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":269,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.853860+0000","last_change":"2021-10-08T19:36:51.493553+0000","last_active":"2021-10-08T19:38:30.853860+0000","last_peered":"2021-10-08T19:38:30.853860+0000","last_clean":"2021-10-08T19:38:30.853860+0000","last_became_active":"2021-10-08T19:29:40.638536+0000","last_became_peered":"2021-10-08T19:29:40.638536+0000","last_unstale":"2021-10-08T19:38:30.853860+0000","last_undegraded":"2021-10-08T19:38:30.853860+0000","last_fullsized":"2021-10-08T19:38:30.853860+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:51.493442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:43.186684+0000","last_clean_scrub_stamp":"2021-10-08T19:36:51.493442+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013830541,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":211,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.849954+0000","last_change":"2021-10-08T19:35:21.993459+0000","last_active":"2021-10-08T19:38:30.849954+0000","last_peered":"2021-10-08T19:38:30.849954+0000","last_clean":"2021-10-08T19:38:30.849954+0000","last_became_active":"2021-10-08T19:29:40.634300+0000","last_became_peered":"2021-10-08T19:29:40.634300+0000","last_unstale":"2021-10-08T19:38:30.849954+0000","last_undegraded":"2021-10-08T19:38:30.849954+0000","last_fullsized":"2021-10-08T19:38:30.849954+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:21.993295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:35:21.993295+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.015124034,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"70'5","reported_seq":328,"reported_epoch":427,"state":"active+clean","last_fresh":"2021-10-08T19:38:43.224638+0000","last_change":"2021-10-08T19:38:43.224604+0000","last_active":"2021-10-08T19:38:43.224638+0000","last_peered":"2021-10-08T19:38:43.224638+0000","last_clean":"2021-10-08T19:38:43.224638+0000","last_became_active":"2021-10-08T19:25:15.496309+0000","last_became_peered":"2021-10-08T19:25:15.496309+0000","last_unstale":"2021-10-08T19:38:43.224638+0000","last_undegraded":"2021-10-08T19:38:43.224638+0000","last_fullsized":"2021-10-08T19:38:43.224638+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:38:43.224497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:38:43.224497+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0052930809999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.10","version":"289'8","reported_seq":240,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.847782+0000","last_change":"2021-10-08T19:36:06.812233+0000","last_active":"2021-10-08T19:38:30.847782+0000","last_peered":"2021-10-08T19:38:30.847782+0000","last_clean":"2021-10-08T19:38:30.847782+0000","last_became_active":"2021-10-08T19:32:45.165103+0000","last_became_peered":"2021-10-08T19:32:45.165103+0000","last_unstale":"2021-10-08T19:38:30.847782+0000","last_undegraded":"2021-10-08T19:38:30.847782+0000","last_fullsized":"2021-10-08T19:38:30.847782+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'8","last_scrub_stamp":"2021-10-08T19:36:06.812115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:06.812115+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010666471,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":128,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.843937+0000","last_change":"2021-10-08T19:37:29.114140+0000","last_active":"2021-10-08T19:38:30.843937+0000","last_peered":"2021-10-08T19:38:30.843937+0000","last_clean":"2021-10-08T19:38:30.843937+0000","last_became_active":"2021-10-08T19:37:19.009349+0000","last_became_peered":"2021-10-08T19:37:19.009349+0000","last_unstale":"2021-10-08T19:38:30.843937+0000","last_undegraded":"2021-10-08T19:38:30.843937+0000","last_fullsized":"2021-10-08T19:38:30.843937+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:29.114037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:13.716331+0000","last_clean_scrub_stamp":"2021-10-08T19:37:29.114037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0076932069999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":364,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:32.348788+0000","last_change":"2021-10-08T19:38:32.348636+0000","last_active":"2021-10-08T19:38:32.348788+0000","last_peered":"2021-10-08T19:38:32.348788+0000","last_clean":"2021-10-08T19:38:32.348788+0000","last_became_active":"2021-10-08T19:24:25.106186+0000","last_became_peered":"2021-10-08T19:24:25.106186+0000","last_unstale":"2021-10-08T19:38:32.348788+0000","last_undegraded":"2021-10-08T19:38:32.348788+0000","last_fullsized":"2021-10-08T19:38:32.348788+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:32.348544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:18.377739+0000","last_clean_scrub_stamp":"2021-10-08T19:38:32.348544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0041413229999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":401,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.844620+0000","last_change":"2021-10-08T19:35:57.018331+0000","last_active":"2021-10-08T19:38:30.844620+0000","last_peered":"2021-10-08T19:38:30.844620+0000","last_clean":"2021-10-08T19:38:30.844620+0000","last_became_active":"2021-10-08T19:21:29.642835+0000","last_became_peered":"2021-10-08T19:21:29.642835+0000","last_unstale":"2021-10-08T19:38:30.844620+0000","last_undegraded":"2021-10-08T19:38:30.844620+0000","last_fullsized":"2021-10-08T19:38:30.844620+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:57.018227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:35:57.018227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012449864,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":344,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.851957+0000","last_change":"2021-10-08T19:37:57.752389+0000","last_active":"2021-10-08T19:38:30.851957+0000","last_peered":"2021-10-08T19:38:30.851957+0000","last_clean":"2021-10-08T19:38:30.851957+0000","last_became_active":"2021-10-08T19:28:40.099215+0000","last_became_peered":"2021-10-08T19:28:40.099215+0000","last_unstale":"2021-10-08T19:38:30.851957+0000","last_undegraded":"2021-10-08T19:38:30.851957+0000","last_fullsized":"2021-10-08T19:38:30.851957+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:57.752238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:37:57.752238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012035994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"348'24","reported_seq":246,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.849871+0000","last_change":"2021-10-08T19:38:05.385295+0000","last_active":"2021-10-08T19:38:30.849871+0000","last_peered":"2021-10-08T19:38:30.849871+0000","last_clean":"2021-10-08T19:38:30.849871+0000","last_became_active":"2021-10-08T19:29:40.640914+0000","last_became_peered":"2021-10-08T19:29:40.640914+0000","last_unstale":"2021-10-08T19:38:30.849871+0000","last_undegraded":"2021-10-08T19:38:30.849871+0000","last_fullsized":"2021-10-08T19:38:30.849871+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"348'24","last_scrub_stamp":"2021-10-08T19:38:05.385196+0000","last_deep_scrub":"348'24","last_deep_scrub_stamp":"2021-10-08T19:34:53.274250+0000","last_clean_scrub_stamp":"2021-10-08T19:38:05.385196+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0079524399999999999,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":355,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.844317+0000","last_change":"2021-10-08T19:37:13.001449+0000","last_active":"2021-10-08T19:38:30.844317+0000","last_peered":"2021-10-08T19:38:30.844317+0000","last_clean":"2021-10-08T19:38:30.844317+0000","last_became_active":"2021-10-08T19:24:25.098128+0000","last_became_peered":"2021-10-08T19:24:25.098128+0000","last_unstale":"2021-10-08T19:38:30.844317+0000","last_undegraded":"2021-10-08T19:38:30.844317+0000","last_fullsized":"2021-10-08T19:38:30.844317+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:13.001343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:34.508558+0000","last_clean_scrub_stamp":"2021-10-08T19:37:13.001343+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0068614030000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":419,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:38.558013+0000","last_change":"2021-10-08T19:38:38.557866+0000","last_active":"2021-10-08T19:38:38.558013+0000","last_peered":"2021-10-08T19:38:38.558013+0000","last_clean":"2021-10-08T19:38:38.558013+0000","last_became_active":"2021-10-08T19:24:25.095490+0000","last_became_peered":"2021-10-08T19:24:25.095490+0000","last_unstale":"2021-10-08T19:38:38.558013+0000","last_undegraded":"2021-10-08T19:38:38.558013+0000","last_fullsized":"2021-10-08T19:38:38.558013+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:38.557763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:11.383779+0000","last_clean_scrub_stamp":"2021-10-08T19:38:38.557763+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012167577000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":217,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.850505+0000","last_change":"2021-10-08T19:36:12.821415+0000","last_active":"2021-10-08T19:38:30.850505+0000","last_peered":"2021-10-08T19:38:30.850505+0000","last_clean":"2021-10-08T19:38:30.850505+0000","last_became_active":"2021-10-08T19:29:40.639358+0000","last_became_peered":"2021-10-08T19:29:40.639358+0000","last_unstale":"2021-10-08T19:38:30.850505+0000","last_undegraded":"2021-10-08T19:38:30.850505+0000","last_fullsized":"2021-10-08T19:38:30.850505+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:12.821316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:36:12.821316+0000","last_clean_scrub_stamp":"2021-10-08T19:36:12.821316+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.068456382999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"289'20","reported_seq":477,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.848964+0000","last_change":"2021-10-08T19:36:45.604663+0000","last_active":"2021-10-08T19:38:30.848964+0000","last_peered":"2021-10-08T19:38:30.848964+0000","last_clean":"2021-10-08T19:38:30.848964+0000","last_became_active":"2021-10-08T19:29:40.636448+0000","last_became_peered":"2021-10-08T19:29:40.636448+0000","last_unstale":"2021-10-08T19:38:30.848964+0000","last_undegraded":"2021-10-08T19:38:30.848964+0000","last_fullsized":"2021-10-08T19:38:30.848964+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'20","last_scrub_stamp":"2021-10-08T19:36:45.604576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:45.604576+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.007213863,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":404,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.851806+0000","last_change":"2021-10-08T19:37:52.735109+0000","last_active":"2021-10-08T19:38:30.851806+0000","last_peered":"2021-10-08T19:38:30.851806+0000","last_clean":"2021-10-08T19:38:30.851806+0000","last_became_active":"2021-10-08T19:21:23.604530+0000","last_became_peered":"2021-10-08T19:21:23.604530+0000","last_unstale":"2021-10-08T19:38:30.851806+0000","last_undegraded":"2021-10-08T19:38:30.851806+0000","last_fullsized":"2021-10-08T19:38:30.851806+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:52.735006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:37:52.735006+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039941940000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1f","version":"114'10","reported_seq":523,"reported_epoch":427,"state":"active+clean","last_fresh":"2021-10-08T19:38:41.872862+0000","last_change":"2021-10-08T19:36:40.888275+0000","last_active":"2021-10-08T19:38:41.872862+0000","last_peered":"2021-10-08T19:38:41.872862+0000","last_clean":"2021-10-08T19:38:41.872862+0000","last_became_active":"2021-10-08T19:24:25.105742+0000","last_became_peered":"2021-10-08T19:24:25.105742+0000","last_unstale":"2021-10-08T19:38:41.872862+0000","last_undegraded":"2021-10-08T19:38:41.872862+0000","last_fullsized":"2021-10-08T19:38:41.872862+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'10","last_scrub_stamp":"2021-10-08T19:36:40.888198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:36:40.888198+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0055243009999999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"69'1","reported_seq":400,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.845623+0000","last_change":"2021-10-08T19:37:23.683434+0000","last_active":"2021-10-08T19:38:30.845623+0000","last_peered":"2021-10-08T19:38:30.845623+0000","last_clean":"2021-10-08T19:38:30.845623+0000","last_became_active":"2021-10-08T19:21:29.640296+0000","last_became_peered":"2021-10-08T19:21:29.640296+0000","last_unstale":"2021-10-08T19:38:30.845623+0000","last_undegraded":"2021-10-08T19:38:30.845623+0000","last_fullsized":"2021-10-08T19:38:30.845623+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2021-10-08T19:37:23.683320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:37:23.683320+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011686882000000001,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"390'24","reported_seq":424,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.844656+0000","last_change":"2021-10-08T19:36:56.930986+0000","last_active":"2021-10-08T19:38:30.844656+0000","last_peered":"2021-10-08T19:38:30.844656+0000","last_clean":"2021-10-08T19:38:30.844656+0000","last_became_active":"2021-10-08T19:28:40.126425+0000","last_became_peered":"2021-10-08T19:28:40.126425+0000","last_unstale":"2021-10-08T19:38:30.844656+0000","last_undegraded":"2021-10-08T19:38:30.844656+0000","last_fullsized":"2021-10-08T19:38:30.844656+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"390'24","last_scrub_stamp":"2021-10-08T19:36:56.930887+0000","last_deep_scrub":"390'24","last_deep_scrub_stamp":"2021-10-08T19:36:56.930887+0000","last_clean_scrub_stamp":"2021-10-08T19:36:56.930887+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.015519527999999999,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":217,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.849638+0000","last_change":"2021-10-08T19:37:14.139452+0000","last_active":"2021-10-08T19:38:30.849638+0000","last_peered":"2021-10-08T19:38:30.849638+0000","last_clean":"2021-10-08T19:38:30.849638+0000","last_became_active":"2021-10-08T19:29:40.640952+0000","last_became_peered":"2021-10-08T19:29:40.640952+0000","last_unstale":"2021-10-08T19:38:30.849638+0000","last_undegraded":"2021-10-08T19:38:30.849638+0000","last_fullsized":"2021-10-08T19:38:30.849638+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:14.139384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:37:14.139384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0033835190000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":401,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.849030+0000","last_change":"2021-10-08T19:36:02.157958+0000","last_active":"2021-10-08T19:38:30.849030+0000","last_peered":"2021-10-08T19:38:30.849030+0000","last_clean":"2021-10-08T19:38:30.849030+0000","last_became_active":"2021-10-08T19:21:27.632648+0000","last_became_peered":"2021-10-08T19:21:27.632648+0000","last_unstale":"2021-10-08T19:38:30.849030+0000","last_undegraded":"2021-10-08T19:38:30.849030+0000","last_fullsized":"2021-10-08T19:38:30.849030+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:02.157885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:36:02.157885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0018671,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"69'1","reported_seq":255,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.855259+0000","last_change":"2021-10-08T19:38:03.796487+0000","last_active":"2021-10-08T19:38:30.855259+0000","last_peered":"2021-10-08T19:38:30.855259+0000","last_clean":"2021-10-08T19:38:30.855259+0000","last_became_active":"2021-10-08T19:28:40.146302+0000","last_became_peered":"2021-10-08T19:28:40.146302+0000","last_unstale":"2021-10-08T19:38:30.855259+0000","last_undegraded":"2021-10-08T19:38:30.855259+0000","last_fullsized":"2021-10-08T19:38:30.855259+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2021-10-08T19:38:03.796375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:38:03.796375+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.12770116100000001,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"289'27","reported_seq":583,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.840347+0000","last_change":"2021-10-08T19:37:55.195213+0000","last_active":"2021-10-08T19:38:30.840347+0000","last_peered":"2021-10-08T19:38:30.840347+0000","last_clean":"2021-10-08T19:38:30.840347+0000","last_became_active":"2021-10-08T19:29:40.629461+0000","last_became_peered":"2021-10-08T19:29:40.629461+0000","last_unstale":"2021-10-08T19:38:30.840347+0000","last_undegraded":"2021-10-08T19:38:30.840347+0000","last_fullsized":"2021-10-08T19:38:30.840347+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'27","last_scrub_stamp":"2021-10-08T19:37:55.195108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:37:55.195108+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.016851959999999999,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":550,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":361,"reported_epoch":427,"state":"active+clean","last_fresh":"2021-10-08T19:38:42.260479+0000","last_change":"2021-10-08T19:38:42.260441+0000","last_active":"2021-10-08T19:38:42.260479+0000","last_peered":"2021-10-08T19:38:42.260479+0000","last_clean":"2021-10-08T19:38:42.260479+0000","last_became_active":"2021-10-08T19:24:25.106119+0000","last_became_peered":"2021-10-08T19:24:25.106119+0000","last_unstale":"2021-10-08T19:38:42.260479+0000","last_undegraded":"2021-10-08T19:38:42.260479+0000","last_fullsized":"2021-10-08T19:38:42.260479+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:42.260340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:46.422866+0000","last_clean_scrub_stamp":"2021-10-08T19:38:42.260340+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0082769149999999993,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":253,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.855318+0000","last_change":"2021-10-08T19:37:14.702746+0000","last_active":"2021-10-08T19:38:30.855318+0000","last_peered":"2021-10-08T19:38:30.855318+0000","last_clean":"2021-10-08T19:38:30.855318+0000","last_became_active":"2021-10-08T19:28:40.148009+0000","last_became_peered":"2021-10-08T19:28:40.148009+0000","last_unstale":"2021-10-08T19:38:30.855318+0000","last_undegraded":"2021-10-08T19:38:30.855318+0000","last_fullsized":"2021-10-08T19:38:30.855318+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:14.702628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:37:14.702628+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0066034209999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":418,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:37.167695+0000","last_change":"2021-10-08T19:38:37.167564+0000","last_active":"2021-10-08T19:38:37.167695+0000","last_peered":"2021-10-08T19:38:37.167695+0000","last_clean":"2021-10-08T19:38:37.167695+0000","last_became_active":"2021-10-08T19:24:25.097782+0000","last_became_peered":"2021-10-08T19:24:25.097782+0000","last_unstale":"2021-10-08T19:38:37.167695+0000","last_undegraded":"2021-10-08T19:38:37.167695+0000","last_fullsized":"2021-10-08T19:38:37.167695+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:37.167455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:37.219503+0000","last_clean_scrub_stamp":"2021-10-08T19:38:37.167455+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0027382449999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"289'18","reported_seq":238,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.855331+0000","last_change":"2021-10-08T19:36:17.847260+0000","last_active":"2021-10-08T19:38:30.855331+0000","last_peered":"2021-10-08T19:38:30.855331+0000","last_clean":"2021-10-08T19:38:30.855331+0000","last_became_active":"2021-10-08T19:29:40.645144+0000","last_became_peered":"2021-10-08T19:29:40.645144+0000","last_unstale":"2021-10-08T19:38:30.855331+0000","last_undegraded":"2021-10-08T19:38:30.855331+0000","last_fullsized":"2021-10-08T19:38:30.855331+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'18","last_scrub_stamp":"2021-10-08T19:36:17.846978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:17.846978+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.018882475999999999,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":25,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":211,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.850288+0000","last_change":"2021-10-08T19:35:32.854645+0000","last_active":"2021-10-08T19:38:30.850288+0000","last_peered":"2021-10-08T19:38:30.850288+0000","last_clean":"2021-10-08T19:38:30.850288+0000","last_became_active":"2021-10-08T19:29:44.443807+0000","last_became_peered":"2021-10-08T19:29:44.443807+0000","last_unstale":"2021-10-08T19:38:30.850288+0000","last_undegraded":"2021-10-08T19:38:30.850288+0000","last_fullsized":"2021-10-08T19:38:30.850288+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:32.854550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:32.854550+0000","last_clean_scrub_stamp":"2021-10-08T19:35:32.854550+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0089578279999999993,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":418,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.836718+0000","last_change":"2021-10-08T19:37:16.729232+0000","last_active":"2021-10-08T19:38:30.836718+0000","last_peered":"2021-10-08T19:38:30.836718+0000","last_clean":"2021-10-08T19:38:30.836718+0000","last_became_active":"2021-10-08T19:29:40.638352+0000","last_became_peered":"2021-10-08T19:29:40.638352+0000","last_unstale":"2021-10-08T19:38:30.836718+0000","last_undegraded":"2021-10-08T19:38:30.836718+0000","last_fullsized":"2021-10-08T19:38:30.836718+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:16.729133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:37:16.729133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010092746,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":229,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.864958+0000","last_change":"2021-10-08T19:35:24.071959+0000","last_active":"2021-10-08T19:38:30.864958+0000","last_peered":"2021-10-08T19:38:30.864958+0000","last_clean":"2021-10-08T19:38:30.864958+0000","last_became_active":"2021-10-08T19:31:22.788455+0000","last_became_peered":"2021-10-08T19:31:22.788455+0000","last_unstale":"2021-10-08T19:38:30.864958+0000","last_undegraded":"2021-10-08T19:38:30.864958+0000","last_fullsized":"2021-10-08T19:38:30.864958+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:24.071866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:32:12.549351+0000","last_clean_scrub_stamp":"2021-10-08T19:35:24.071866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.097681799,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"289'15","reported_seq":467,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.836298+0000","last_change":"2021-10-08T19:38:09.250253+0000","last_active":"2021-10-08T19:38:30.836298+0000","last_peered":"2021-10-08T19:38:30.836298+0000","last_clean":"2021-10-08T19:38:30.836298+0000","last_became_active":"2021-10-08T19:29:40.631689+0000","last_became_peered":"2021-10-08T19:29:40.631689+0000","last_unstale":"2021-10-08T19:38:30.836298+0000","last_undegraded":"2021-10-08T19:38:30.836298+0000","last_fullsized":"2021-10-08T19:38:30.836298+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'15","last_scrub_stamp":"2021-10-08T19:38:09.250133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:38:09.250133+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0047959150000000004,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":409,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.845366+0000","last_change":"2021-10-08T19:36:16.752767+0000","last_active":"2021-10-08T19:38:30.845366+0000","last_peered":"2021-10-08T19:38:30.845366+0000","last_clean":"2021-10-08T19:38:30.845366+0000","last_became_active":"2021-10-08T19:21:23.607785+0000","last_became_peered":"2021-10-08T19:21:23.607785+0000","last_unstale":"2021-10-08T19:38:30.845366+0000","last_undegraded":"2021-10-08T19:38:30.845366+0000","last_fullsized":"2021-10-08T19:38:30.845366+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:16.752654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:16.752654+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0071954510000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":408,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:36.391822+0000","last_change":"2021-10-08T19:38:36.391388+0000","last_active":"2021-10-08T19:38:36.391822+0000","last_peered":"2021-10-08T19:38:36.391822+0000","last_clean":"2021-10-08T19:38:36.391822+0000","last_became_active":"2021-10-08T19:21:27.633979+0000","last_became_peered":"2021-10-08T19:21:27.633979+0000","last_unstale":"2021-10-08T19:38:36.391822+0000","last_undegraded":"2021-10-08T19:38:36.391822+0000","last_fullsized":"2021-10-08T19:38:36.391822+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:36.391288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:27.586341+0000","last_clean_scrub_stamp":"2021-10-08T19:38:36.391288+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010425952,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":421,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.845843+0000","last_change":"2021-10-08T19:37:55.032408+0000","last_active":"2021-10-08T19:38:30.845843+0000","last_peered":"2021-10-08T19:38:30.845843+0000","last_clean":"2021-10-08T19:38:30.845843+0000","last_became_active":"2021-10-08T19:28:40.159162+0000","last_became_peered":"2021-10-08T19:28:40.159162+0000","last_unstale":"2021-10-08T19:38:30.845843+0000","last_undegraded":"2021-10-08T19:38:30.845843+0000","last_fullsized":"2021-10-08T19:38:30.845843+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:55.032301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:37:55.032301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.054063366000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"289'7","reported_seq":492,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.836409+0000","last_change":"2021-10-08T19:36:14.120690+0000","last_active":"2021-10-08T19:38:30.836409+0000","last_peered":"2021-10-08T19:38:30.836409+0000","last_clean":"2021-10-08T19:38:30.836409+0000","last_became_active":"2021-10-08T19:31:51.675189+0000","last_became_peered":"2021-10-08T19:31:51.675189+0000","last_unstale":"2021-10-08T19:38:30.836409+0000","last_undegraded":"2021-10-08T19:38:30.836409+0000","last_fullsized":"2021-10-08T19:38:30.836409+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'7","last_scrub_stamp":"2021-10-08T19:36:14.120570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:14.120570+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.006350138,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":10,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":431,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:36.587149+0000","last_change":"2021-10-08T19:38:36.587034+0000","last_active":"2021-10-08T19:38:36.587149+0000","last_peered":"2021-10-08T19:38:36.587149+0000","last_clean":"2021-10-08T19:38:36.587149+0000","last_became_active":"2021-10-08T19:24:25.096225+0000","last_became_peered":"2021-10-08T19:24:25.096225+0000","last_unstale":"2021-10-08T19:38:36.587149+0000","last_undegraded":"2021-10-08T19:38:36.587149+0000","last_fullsized":"2021-10-08T19:38:36.587149+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:36.586933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:29:40.244757+0000","last_clean_scrub_stamp":"2021-10-08T19:38:36.586933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003904257,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":423,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.844353+0000","last_change":"2021-10-08T19:36:44.948482+0000","last_active":"2021-10-08T19:38:30.844353+0000","last_peered":"2021-10-08T19:38:30.844353+0000","last_clean":"2021-10-08T19:38:30.844353+0000","last_became_active":"2021-10-08T19:28:40.101187+0000","last_became_peered":"2021-10-08T19:28:40.101187+0000","last_unstale":"2021-10-08T19:38:30.844353+0000","last_undegraded":"2021-10-08T19:38:30.844353+0000","last_fullsized":"2021-10-08T19:38:30.844353+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:44.948359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:11.633739+0000","last_clean_scrub_stamp":"2021-10-08T19:36:44.948359+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0035272509999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":258,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.853671+0000","last_change":"2021-10-08T19:37:19.007798+0000","last_active":"2021-10-08T19:38:30.853671+0000","last_peered":"2021-10-08T19:38:30.853671+0000","last_clean":"2021-10-08T19:38:30.853671+0000","last_became_active":"2021-10-08T19:37:19.007583+0000","last_became_peered":"2021-10-08T19:37:19.007583+0000","last_unstale":"2021-10-08T19:38:30.853671+0000","last_undegraded":"2021-10-08T19:38:30.853671+0000","last_fullsized":"2021-10-08T19:38:30.853671+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:10.650288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:36:10.650288+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.020979794,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"289'19","reported_seq":541,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.835720+0000","last_change":"2021-10-08T19:36:15.167452+0000","last_active":"2021-10-08T19:38:30.835720+0000","last_peered":"2021-10-08T19:38:30.835720+0000","last_clean":"2021-10-08T19:38:30.835720+0000","last_became_active":"2021-10-08T19:28:40.099770+0000","last_became_peered":"2021-10-08T19:28:40.099770+0000","last_unstale":"2021-10-08T19:38:30.835720+0000","last_undegraded":"2021-10-08T19:38:30.835720+0000","last_fullsized":"2021-10-08T19:38:30.835720+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:36:15.167374+0000","last_deep_scrub":"289'19","last_deep_scrub_stamp":"2021-10-08T19:36:15.167374+0000","last_clean_scrub_stamp":"2021-10-08T19:36:15.167374+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0067424360000000001,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":217,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.854436+0000","last_change":"2021-10-08T19:36:57.099908+0000","last_active":"2021-10-08T19:38:30.854436+0000","last_peered":"2021-10-08T19:38:30.854436+0000","last_clean":"2021-10-08T19:38:30.854436+0000","last_became_active":"2021-10-08T19:29:40.627394+0000","last_became_peered":"2021-10-08T19:29:40.627394+0000","last_unstale":"2021-10-08T19:38:30.854436+0000","last_undegraded":"2021-10-08T19:38:30.854436+0000","last_fullsized":"2021-10-08T19:38:30.854436+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:57.099805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:57.099805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034117000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":251,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.853842+0000","last_change":"2021-10-08T19:36:46.569493+0000","last_active":"2021-10-08T19:38:30.853842+0000","last_peered":"2021-10-08T19:38:30.853842+0000","last_clean":"2021-10-08T19:38:30.853842+0000","last_became_active":"2021-10-08T19:28:40.145868+0000","last_became_peered":"2021-10-08T19:28:40.145868+0000","last_unstale":"2021-10-08T19:38:30.853842+0000","last_undegraded":"2021-10-08T19:38:30.853842+0000","last_fullsized":"2021-10-08T19:38:30.853842+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:46.569374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:36:46.569374+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011431800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":412,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.836249+0000","last_change":"2021-10-08T19:36:03.314076+0000","last_active":"2021-10-08T19:38:30.836249+0000","last_peered":"2021-10-08T19:38:30.836249+0000","last_clean":"2021-10-08T19:38:30.836249+0000","last_became_active":"2021-10-08T19:28:40.099543+0000","last_became_peered":"2021-10-08T19:28:40.099543+0000","last_unstale":"2021-10-08T19:38:30.836249+0000","last_undegraded":"2021-10-08T19:38:30.836249+0000","last_fullsized":"2021-10-08T19:38:30.836249+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:03.313977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:50.032367+0000","last_clean_scrub_stamp":"2021-10-08T19:36:03.313977+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.038973248000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"289'27","reported_seq":251,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.849724+0000","last_change":"2021-10-08T19:38:03.371773+0000","last_active":"2021-10-08T19:38:30.849724+0000","last_peered":"2021-10-08T19:38:30.849724+0000","last_clean":"2021-10-08T19:38:30.849724+0000","last_became_active":"2021-10-08T19:29:40.631002+0000","last_became_peered":"2021-10-08T19:29:40.631002+0000","last_unstale":"2021-10-08T19:38:30.849724+0000","last_undegraded":"2021-10-08T19:38:30.849724+0000","last_fullsized":"2021-10-08T19:38:30.849724+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'27","last_scrub_stamp":"2021-10-08T19:38:03.371690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:38:03.371690+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012656639000000001,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":407,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:33.129762+0000","last_change":"2021-10-08T19:38:33.129623+0000","last_active":"2021-10-08T19:38:33.129762+0000","last_peered":"2021-10-08T19:38:33.129762+0000","last_clean":"2021-10-08T19:38:33.129762+0000","last_became_active":"2021-10-08T19:21:23.603422+0000","last_became_peered":"2021-10-08T19:21:23.603422+0000","last_unstale":"2021-10-08T19:38:33.129762+0000","last_undegraded":"2021-10-08T19:38:33.129762+0000","last_fullsized":"2021-10-08T19:38:33.129762+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:33.129516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:15.535842+0000","last_clean_scrub_stamp":"2021-10-08T19:38:33.129516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012096857000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":438,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.835839+0000","last_change":"2021-10-08T19:36:11.147338+0000","last_active":"2021-10-08T19:38:30.835839+0000","last_peered":"2021-10-08T19:38:30.835839+0000","last_clean":"2021-10-08T19:38:30.835839+0000","last_became_active":"2021-10-08T19:28:40.099286+0000","last_became_peered":"2021-10-08T19:28:40.099286+0000","last_unstale":"2021-10-08T19:38:30.835839+0000","last_undegraded":"2021-10-08T19:38:30.835839+0000","last_fullsized":"2021-10-08T19:38:30.835839+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:11.147246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:31.176160+0000","last_clean_scrub_stamp":"2021-10-08T19:36:11.147246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.005657235,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":217,"reported_epoch":426,"state":"active+clean","last_fresh":"2021-10-08T19:38:30.850437+0000","last_change":"2021-10-08T19:38:08.397525+0000","last_active":"2021-10-08T19:38:30.850437+0000","last_peered":"2021-10-08T19:38:30.850437+0000","last_clean":"2021-10-08T19:38:30.850437+0000","last_became_active":"2021-10-08T19:29:40.638221+0000","last_became_peered":"2021-10-08T19:29:40.638221+0000","last_unstale":"2021-10-08T19:38:30.850437+0000","last_undegraded":"2021-10-08T19:38:30.850437+0000","last_fullsized":"2021-10-08T19:38:30.850437+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:08.397432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:38:08.397432+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.11831541399999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":224067608,"num_objects":3420,"num_object_clones":0,"num_object_copies":10260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3420,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":233580,"num_write_kb":7583937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":668676096,"data_stored":668663880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71148,"ondisk_log_size":71148,"up":48,"acting":48,"num_store_stats":8},{"poolid":2,"num_pg":42,"stat_sum":{"num_bytes":1502,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":126,"acting":126,"num_store_stats":8},{"poolid":1,"num_pg":11,"stat_sum":{"num_bytes":644038,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":28,"num_write":17,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":161010,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1430,"ondisk_log_size":1430,"up":33,"acting":33,"num_store_stats":8},{"poolid":3,"num_pg":23,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":403,"num_read_kb":403,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":778,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":69,"acting":69,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1111,"num_read_kb":868,"num_write":703,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":520,"num_bytes_recovered":10826,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":710,"ondisk_log_size":710,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":84,"ondisk_log_size":84,"up":96,"acting":96,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201492,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":352740,"kb_used_data":58012,"kb_used_omap":0,"kb_used_meta":294720,"kb_avail":93392412,"statfs":{"total":95995035648,"available":95633829888,"internally_reserved":0,"allocated":59404288,"data_stored":58982724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":301793280},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:38:43 2021","interfaces":[{"interface":"back","average":{"1min":1.631,"5min":1.5760000000000001,"15min":1.647},"min":{"1min":0.23200000000000001,"5min":0.21199999999999999,"15min":0.20100000000000001},"max":{"1min":5.3630000000000004,"5min":8.8160000000000007,"15min":32.366999999999997},"last":1.391},{"interface":"front","average":{"1min":1.641,"5min":1.5309999999999999,"15min":1.831},"min":{"1min":0.219,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":8.2639999999999993,"5min":9.4410000000000007,"15min":29.736000000000001},"last":0.26500000000000001}]},{"osd":1,"last update":"Fri Oct 8 19:38:43 2021","interfaces":[{"interface":"back","average":{"1min":2.0249999999999999,"5min":2.6190000000000002,"15min":2.2469999999999999},"min":{"1min":0.27400000000000002,"5min":0.215,"15min":0.19600000000000001},"max":{"1min":7.3079999999999998,"5min":87.966999999999999,"15min":87.966999999999999},"last":2.9199999999999999},{"interface":"front","average":{"1min":1.238,"5min":1.5860000000000001,"15min":1.746},"min":{"1min":0.253,"5min":0.23699999999999999,"15min":0.22700000000000001},"max":{"1min":4.5229999999999997,"5min":6.0819999999999999,"15min":28.119},"last":0.29899999999999999}]},{"osd":2,"last update":"Fri Oct 8 19:38:43 2021","interfaces":[{"interface":"back","average":{"1min":5.2599999999999998,"5min":2.4900000000000002,"15min":2.085},"min":{"1min":0.32100000000000001,"5min":0.255,"15min":0.255},"max":{"1min":81.204999999999998,"5min":81.204999999999998,"15min":81.204999999999998},"last":1.986},{"interface":"front","average":{"1min":5.556,"5min":2.4079999999999999,"15min":1.958},"min":{"1min":0.42699999999999999,"5min":0.253,"15min":0.253},"max":{"1min":81.022000000000006,"5min":81.022000000000006,"15min":81.022000000000006},"last":2.1680000000000001}]},{"osd":3,"last update":"Fri Oct 8 19:38:43 2021","interfaces":[{"interface":"back","average":{"1min":2.0830000000000002,"5min":2.093,"15min":2.3860000000000001},"min":{"1min":0.313,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":7.5069999999999997,"5min":24.945,"15min":72.093999999999994},"last":5.9779999999999998},{"interface":"front","average":{"1min":2.3180000000000001,"5min":1.911,"15min":2.3140000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.28000000000000003},"max":{"1min":9,"5min":9,"15min":71.864999999999995},"last":0.36899999999999999}]},{"osd":4,"last update":"Fri Oct 8 19:38:43 2021","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.7789999999999999,"15min":1.1879999999999999},"min":{"1min":0.26600000000000001,"5min":0.26300000000000001,"15min":0.22800000000000001},"max":{"1min":3.952,"5min":55.890999999999998,"15min":55.890999999999998},"last":3.556},{"interface":"front","average":{"1min":0.92200000000000004,"5min":1.9710000000000001,"15min":1.274},"min":{"1min":0.27800000000000002,"5min":0.254,"15min":0.254},"max":{"1min":3.1890000000000001,"5min":54.448999999999998,"15min":54.448999999999998},"last":2.198}]},{"osd":5,"last update":"Fri Oct 8 19:38:43 2021","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.1739999999999999,"15min":1.109},"min":{"1min":0.33500000000000002,"5min":0.28199999999999997,"15min":0.26800000000000002},"max":{"1min":5.0590000000000002,"5min":5.819,"15min":9.9280000000000008},"last":2.339},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.4870000000000001,"15min":1.1539999999999999},"min":{"1min":0.29399999999999998,"5min":0.28299999999999997,"15min":0.26100000000000001},"max":{"1min":3.6339999999999999,"5min":10.435,"15min":18.655000000000001},"last":3.6339999999999999}]},{"osd":6,"last update":"Fri Oct 8 19:38:43 2021","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.8839999999999999,"15min":1.3540000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.27900000000000003},"max":{"1min":4.5780000000000003,"5min":58.039000000000001,"15min":58.039000000000001},"last":0.32800000000000001},{"interface":"front","average":{"1min":1.3640000000000001,"5min":2.0590000000000002,"15min":1.357},"min":{"1min":0.38400000000000001,"5min":0.31900000000000001,"15min":0.30299999999999999},"max":{"1min":6.2969999999999997,"5min":58.079999999999998,"15min":58.079999999999998},"last":3.7480000000000002}]}]},{"osd":6,"up_from":47,"seq":201863463128,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":386688,"kb_used_data":113232,"kb_used_omap":0,"kb_used_meta":273088,"kb_avail":93358464,"statfs":{"total":95995035648,"available":95599067136,"internally_reserved":0,"allocated":115949568,"data_stored":115539509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":279642112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:38:20 2021","interfaces":[{"interface":"back","average":{"1min":1.988,"5min":1.504,"15min":1.4419999999999999},"min":{"1min":0.214,"5min":0.214,"15min":0.20100000000000001},"max":{"1min":9.7780000000000005,"5min":9.7780000000000005,"15min":28.382999999999999},"last":0.33200000000000002},{"interface":"front","average":{"1min":1.8180000000000001,"5min":1.897,"15min":2.0499999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.21299999999999999},"max":{"1min":3.5750000000000002,"5min":16.173999999999999,"15min":69.477000000000004},"last":3.153}]},{"osd":1,"last update":"Fri Oct 8 19:38:20 2021","interfaces":[{"interface":"back","average":{"1min":2.1499999999999999,"5min":1.728,"15min":1.383},"min":{"1min":0.251,"5min":0.23699999999999999,"15min":0.23000000000000001},"max":{"1min":5.7640000000000002,"5min":6.1050000000000004,"15min":14.878},"last":0.44900000000000001},{"interface":"front","average":{"1min":2.222,"5min":1.7689999999999999,"15min":1.4590000000000001},"min":{"1min":0.28000000000000003,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":5.5469999999999997,"5min":7.0090000000000003,"15min":14.779},"last":0.41799999999999998}]},{"osd":2,"last update":"Fri Oct 8 19:38:20 2021","interfaces":[{"interface":"back","average":{"1min":2.3620000000000001,"5min":1.603,"15min":1.837},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.251},"max":{"1min":10.304,"5min":10.304,"15min":69.322999999999993},"last":0.48999999999999999},{"interface":"front","average":{"1min":1.7709999999999999,"5min":2.1259999999999999,"15min":2.1200000000000001},"min":{"1min":0.32700000000000001,"5min":0.27100000000000002,"15min":0.245},"max":{"1min":2.9950000000000001,"5min":13.339,"15min":69.418999999999997},"last":0.39000000000000001}]},{"osd":3,"last update":"Fri Oct 8 19:38:20 2021","interfaces":[{"interface":"back","average":{"1min":2.3479999999999999,"5min":1.8049999999999999,"15min":1.7370000000000001},"min":{"1min":0.34499999999999997,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":8.7300000000000004,"5min":8.7300000000000004,"15min":21.670000000000002},"last":1.2869999999999999},{"interface":"front","average":{"1min":2.5640000000000001,"5min":1.992,"15min":1.6559999999999999},"min":{"1min":0.42099999999999999,"5min":0.29099999999999998,"15min":0.28000000000000003},"max":{"1min":6.609,"5min":14.867000000000001,"15min":22.254999999999999},"last":0.53600000000000003}]},{"osd":4,"last update":"Fri Oct 8 19:38:20 2021","interfaces":[{"interface":"back","average":{"1min":1.881,"5min":1.456,"15min":1.0880000000000001},"min":{"1min":0.26700000000000002,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":4.7169999999999996,"5min":5.6989999999999998,"15min":24.516999999999999},"last":0.41199999999999998},{"interface":"front","average":{"1min":1.964,"5min":1.585,"15min":1.323},"min":{"1min":0.28899999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":8.8379999999999992,"5min":9.9079999999999995,"15min":69.593999999999994},"last":0.47199999999999998}]},{"osd":5,"last update":"Fri Oct 8 19:38:20 2021","interfaces":[{"interface":"back","average":{"1min":2.4420000000000002,"5min":3.012,"15min":1.8120000000000001},"min":{"1min":0.38700000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":8.0830000000000002,"5min":107.485,"15min":107.485},"last":0.437},{"interface":"front","average":{"1min":1.8460000000000001,"5min":2.968,"15min":2.0310000000000001},"min":{"1min":0.41399999999999998,"5min":0.251,"15min":0.251},"max":{"1min":5.819,"5min":107.90300000000001,"15min":107.90300000000001},"last":0.58299999999999996}]},{"osd":7,"last update":"Fri Oct 8 19:37:47 2021","interfaces":[{"interface":"back","average":{"1min":2.1150000000000002,"5min":1.5609999999999999,"15min":1.0609999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.27800000000000002},"max":{"1min":5.2080000000000002,"5min":8.8840000000000003,"15min":8.8840000000000003},"last":0.51900000000000002},{"interface":"front","average":{"1min":2.5219999999999998,"5min":1.752,"15min":1.24},"min":{"1min":0.40000000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":8.3740000000000006,"5min":8.3740000000000006,"15min":15.962},"last":0.48099999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575083,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":378112,"kb_used_data":44024,"kb_used_omap":0,"kb_used_meta":334080,"kb_avail":93367040,"statfs":{"total":95995035648,"available":95607848960,"internally_reserved":0,"allocated":45080576,"data_stored":44629993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":342097920},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:38:06 2021","interfaces":[{"interface":"back","average":{"1min":3.4129999999999998,"5min":2.2410000000000001,"15min":3.4580000000000002},"min":{"1min":0.22500000000000001,"5min":0.188,"15min":0.188},"max":{"1min":43.786000000000001,"5min":43.786000000000001,"15min":126.256},"last":3.5779999999999998},{"interface":"front","average":{"1min":4.0860000000000003,"5min":2.532,"15min":3.7400000000000002},"min":{"1min":0.28399999999999997,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":42.174999999999997,"5min":42.174999999999997,"15min":126.176},"last":0.47599999999999998}]},{"osd":2,"last update":"Fri Oct 8 19:38:27 2021","interfaces":[{"interface":"back","average":{"1min":1.8180000000000001,"5min":1.6539999999999999,"15min":2.5369999999999999},"min":{"1min":0.21199999999999999,"5min":0.192,"15min":0.192},"max":{"1min":9.6669999999999998,"5min":11.497,"15min":102.395},"last":4.306},{"interface":"front","average":{"1min":1.7909999999999999,"5min":1.5980000000000001,"15min":2.8559999999999999},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.22700000000000001},"max":{"1min":7.0410000000000004,"5min":9.8650000000000002,"15min":102.50700000000001},"last":0.38100000000000001}]},{"osd":3,"last update":"Fri Oct 8 19:38:39 2021","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.4930000000000001,"15min":2.9540000000000002},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":5.4880000000000004,"5min":7.0800000000000001,"15min":105.836},"last":0.40300000000000002},{"interface":"front","average":{"1min":1.825,"5min":1.8560000000000001,"15min":2.8660000000000001},"min":{"1min":0.29799999999999999,"5min":0.27700000000000002,"15min":0.22900000000000001},"max":{"1min":9.8460000000000001,"5min":11.473000000000001,"15min":106.12},"last":8.2769999999999992}]},{"osd":4,"last update":"Fri Oct 8 19:37:47 2021","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":1.6819999999999999,"15min":2.0800000000000001},"min":{"1min":0.33000000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":6.0659999999999998,"5min":7.2370000000000001,"15min":103.538},"last":2.9900000000000002},{"interface":"front","average":{"1min":2.1259999999999999,"5min":1.512,"15min":1.7350000000000001},"min":{"1min":0.435,"5min":0.29299999999999998,"15min":0.254},"max":{"1min":5.3639999999999999,"5min":11.337999999999999,"15min":102.67100000000001},"last":4.3410000000000002}]},{"osd":5,"last update":"Fri Oct 8 19:38:17 2021","interfaces":[{"interface":"back","average":{"1min":1.827,"5min":4.7729999999999997,"15min":3.2090000000000001},"min":{"1min":0.436,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":6.9569999999999999,"5min":262.14100000000002,"15min":262.14100000000002},"last":2.2320000000000002},{"interface":"front","average":{"1min":1.5189999999999999,"5min":4.9180000000000001,"15min":2.952},"min":{"1min":0.33100000000000002,"5min":0.30099999999999999,"15min":0.29999999999999999},"max":{"1min":9.7289999999999992,"5min":261.959,"15min":261.959},"last":4.3799999999999999}]},{"osd":6,"last update":"Fri Oct 8 19:38:30 2021","interfaces":[{"interface":"back","average":{"1min":2.0899999999999999,"5min":1.8129999999999999,"15min":2.2200000000000002},"min":{"1min":0.38700000000000001,"5min":0.32500000000000001,"15min":0.26700000000000002},"max":{"1min":13.837,"5min":13.837,"15min":103.73},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.357,"5min":1.4410000000000001,"15min":2.1589999999999998},"min":{"1min":0.48199999999999998,"5min":0.34399999999999997,"15min":0.33800000000000002},"max":{"1min":3.9470000000000001,"5min":6.915,"15min":102.753},"last":0.437}]},{"osd":7,"last update":"Fri Oct 8 19:37:47 2021","interfaces":[{"interface":"back","average":{"1min":1.8759999999999999,"5min":1.4770000000000001,"15min":2.5529999999999999},"min":{"1min":0.436,"5min":0.316,"15min":0.312},"max":{"1min":7.0979999999999999,"5min":7.0979999999999999,"15min":106.011},"last":0.49199999999999999},{"interface":"front","average":{"1min":1.52,"5min":1.6419999999999999,"15min":2.2240000000000002},"min":{"1min":0.373,"5min":0.36699999999999999,"15min":0.34200000000000003},"max":{"1min":5.407,"5min":11.445,"15min":103.78400000000001},"last":4.4089999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738606,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":520908,"kb_used_data":166940,"kb_used_omap":0,"kb_used_meta":353344,"kb_avail":93224244,"statfs":{"total":95995035648,"available":95461625856,"internally_reserved":0,"allocated":170946560,"data_stored":170523844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":361824256},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 8 19:38:00 2021","interfaces":[{"interface":"back","average":{"1min":2.5899999999999999,"5min":1.605,"15min":2.3159999999999998},"min":{"1min":0.17499999999999999,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":16.632000000000001,"5min":16.632000000000001,"15min":91.954999999999998},"last":0.249},{"interface":"front","average":{"1min":2.1179999999999999,"5min":2.036,"15min":2.4329999999999998},"min":{"1min":0.20599999999999999,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":7.6909999999999998,"5min":11.113,"15min":91.046000000000006},"last":1.337}]},{"osd":2,"last update":"Fri Oct 8 19:38:22 2021","interfaces":[{"interface":"back","average":{"1min":1.9490000000000001,"5min":1.794,"15min":2.234},"min":{"1min":0.26600000000000001,"5min":0.217,"15min":0.217},"max":{"1min":8.2219999999999995,"5min":9.8030000000000008,"15min":62.390000000000001},"last":4.6959999999999997},{"interface":"front","average":{"1min":1.655,"5min":1.901,"15min":2.1739999999999999},"min":{"1min":0.23400000000000001,"5min":0.21099999999999999,"15min":0.19500000000000001},"max":{"1min":7.1459999999999999,"5min":10.109,"15min":62.718000000000004},"last":4.5339999999999998}]},{"osd":3,"last update":"Fri Oct 8 19:38:42 2021","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.7230000000000001,"15min":2.4350000000000001},"min":{"1min":0.221,"5min":0.218,"15min":0.217},"max":{"1min":5.9589999999999996,"5min":9.7690000000000001,"15min":62.491},"last":1.413},{"interface":"front","average":{"1min":2.2029999999999998,"5min":1.794,"15min":2.2610000000000001},"min":{"1min":0.255,"5min":0.221,"15min":0.20899999999999999},"max":{"1min":6.7679999999999998,"5min":10.052,"15min":62.673000000000002},"last":4.8600000000000003}]},{"osd":4,"last update":"Fri Oct 8 19:38:00 2021","interfaces":[{"interface":"back","average":{"1min":2.5299999999999998,"5min":1.6359999999999999,"15min":1.772},"min":{"1min":0.29999999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":12.135,"5min":12.135,"15min":16.805},"last":4.0389999999999997},{"interface":"front","average":{"1min":1.47,"5min":1.601,"15min":1.504},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":5.4710000000000001,"5min":7.0890000000000004,"15min":11.823},"last":1.2989999999999999}]},{"osd":5,"last update":"Fri Oct 8 19:38:12 2021","interfaces":[{"interface":"back","average":{"1min":2.2879999999999998,"5min":1.8049999999999999,"15min":1.5349999999999999},"min":{"1min":0.432,"5min":0.28199999999999997,"15min":0.24099999999999999},"max":{"1min":7.25,"5min":9.9730000000000008,"15min":15.56},"last":4.4130000000000003},{"interface":"front","average":{"1min":3.4119999999999999,"5min":1.9870000000000001,"15min":1.855},"min":{"1min":0.35999999999999999,"5min":0.30599999999999999,"15min":0.28599999999999998},"max":{"1min":12.095000000000001,"5min":15.115,"15min":15.484999999999999},"last":4.0750000000000002}]},{"osd":6,"last update":"Fri Oct 8 19:38:30 2021","interfaces":[{"interface":"back","average":{"1min":1.8360000000000001,"5min":1.762,"15min":1.6899999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":5.931,"5min":7.165,"15min":11.869},"last":1.389},{"interface":"front","average":{"1min":2.855,"5min":1.984,"15min":1.734},"min":{"1min":0.48899999999999999,"5min":0.28199999999999997,"15min":0.27500000000000002},"max":{"1min":7.1950000000000003,"5min":10.002000000000001,"15min":10.519},"last":4.3760000000000003}]},{"osd":7,"last update":"Fri Oct 8 19:38:42 2021","interfaces":[{"interface":"back","average":{"1min":2.484,"5min":2.0099999999999998,"15min":1.972},"min":{"1min":0.40300000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":11.147,"5min":13.214,"15min":13.214},"last":4.0960000000000001},{"interface":"front","average":{"1min":1.5309999999999999,"5min":1.8600000000000001,"15min":1.909},"min":{"1min":0.33100000000000002,"5min":0.315,"15min":0.315},"max":{"1min":8.7609999999999992,"5min":8.7609999999999992,"15min":11.898999999999999},"last":1.367}]}]},{"osd":2,"up_from":18,"seq":77309411558,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":398716,"kb_used_data":101644,"kb_used_omap":0,"kb_used_meta":296704,"kb_avail":93346436,"statfs":{"total":95995035648,"available":95586750464,"internally_reserved":0,"allocated":104083456,"data_stored":103677509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":303824896},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:38:15 2021","interfaces":[{"interface":"back","average":{"1min":2.8900000000000001,"5min":1.819,"15min":2.5310000000000001},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.184},"max":{"1min":10.176,"5min":10.83,"15min":61.670999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":2.8700000000000001,"5min":1.839,"15min":2.5},"min":{"1min":0.22,"5min":0.20000000000000001,"15min":0.17999999999999999},"max":{"1min":9.0909999999999993,"5min":9.1630000000000003,"15min":65.284999999999997},"last":0.193}]},{"osd":1,"last update":"Fri Oct 8 19:38:15 2021","interfaces":[{"interface":"back","average":{"1min":2.6699999999999999,"5min":2.4340000000000002,"15min":2.8199999999999998},"min":{"1min":0.28299999999999997,"5min":0.19700000000000001,"15min":0.192},"max":{"1min":10.218999999999999,"5min":63.738,"15min":63.738},"last":0.29899999999999999},{"interface":"front","average":{"1min":2.4660000000000002,"5min":2.569,"15min":3.0030000000000001},"min":{"1min":0.252,"5min":0.23899999999999999,"15min":0.21299999999999999},"max":{"1min":11.988,"5min":63.619999999999997,"15min":63.619999999999997},"last":2.5219999999999998}]},{"osd":3,"last update":"Fri Oct 8 19:38:21 2021","interfaces":[{"interface":"back","average":{"1min":2.3039999999999998,"5min":2.6190000000000002,"15min":3.2210000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.21199999999999999},"max":{"1min":12.012,"5min":67.198999999999998,"15min":67.198999999999998},"last":0.42099999999999999},{"interface":"front","average":{"1min":1.847,"5min":2.4700000000000002,"15min":3.125},"min":{"1min":0.28299999999999997,"5min":0.22900000000000001,"15min":0.21299999999999999},"max":{"1min":5.5389999999999997,"5min":66.963999999999999,"15min":66.963999999999999},"last":0.32400000000000001}]},{"osd":4,"last update":"Fri Oct 8 19:37:47 2021","interfaces":[{"interface":"back","average":{"1min":2.4039999999999999,"5min":1.52,"15min":1.627},"min":{"1min":0.33200000000000002,"5min":0.27800000000000002,"15min":0.26900000000000002},"max":{"1min":10.988,"5min":10.988,"15min":24.657},"last":0.36499999999999999},{"interface":"front","average":{"1min":2.6899999999999999,"5min":1.6759999999999999,"15min":1.7250000000000001},"min":{"1min":0.318,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":11.912000000000001,"5min":11.912000000000001,"15min":15.143000000000001},"last":2.367}]},{"osd":5,"last update":"Fri Oct 8 19:38:15 2021","interfaces":[{"interface":"back","average":{"1min":2.4950000000000001,"5min":1.978,"15min":1.8100000000000001},"min":{"1min":0.29299999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":11.956,"5min":11.956,"15min":15.087999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":2.1659999999999999,"5min":1.782,"15min":1.786},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.27600000000000002},"max":{"1min":6.9560000000000004,"5min":8.1769999999999996,"15min":26.094000000000001},"last":0.497}]},{"osd":6,"last update":"Fri Oct 8 19:38:21 2021","interfaces":[{"interface":"back","average":{"1min":1.5640000000000001,"5min":1.7569999999999999,"15min":1.681},"min":{"1min":0.34000000000000002,"5min":0.29999999999999999,"15min":0.28000000000000003},"max":{"1min":4.9130000000000003,"5min":11.023999999999999,"15min":14.162000000000001},"last":0.39100000000000001},{"interface":"front","average":{"1min":2.3420000000000001,"5min":2.1280000000000001,"15min":1.8400000000000001},"min":{"1min":0.378,"5min":0.31,"15min":0.31},"max":{"1min":8.5,"5min":8.7829999999999995,"15min":16.68},"last":0.47499999999999998}]},{"osd":7,"last update":"Fri Oct 8 19:37:47 2021","interfaces":[{"interface":"back","average":{"1min":2.2810000000000001,"5min":3.4950000000000001,"15min":2.3490000000000002},"min":{"1min":0.51800000000000002,"5min":0.32600000000000001,"15min":0.31900000000000001},"max":{"1min":11.045999999999999,"5min":136.00200000000001,"15min":136.00200000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":2.145,"5min":3.3860000000000001,"15min":2.2719999999999998},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":7.0049999999999999,"5min":133.26300000000001,"15min":133.26300000000001},"last":1.2490000000000001}]}]},{"osd":3,"up_from":24,"seq":103079215332,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":437496,"kb_used_data":63152,"kb_used_omap":0,"kb_used_meta":374336,"kb_avail":93307656,"statfs":{"total":95995035648,"available":95547039744,"internally_reserved":0,"allocated":64667648,"data_stored":64225847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":383320064},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:38:37 2021","interfaces":[{"interface":"back","average":{"1min":2.1720000000000002,"5min":1.829,"15min":2.633},"min":{"1min":0.22,"5min":0.187,"15min":0.17000000000000001},"max":{"1min":8.8300000000000001,"5min":8.8300000000000001,"15min":109.601},"last":1.6830000000000001},{"interface":"front","average":{"1min":2.4199999999999999,"5min":1.736,"15min":2.5750000000000002},"min":{"1min":0.217,"5min":0.20799999999999999,"15min":0.19500000000000001},"max":{"1min":8.9640000000000004,"5min":10.743,"15min":107.84},"last":8.9239999999999995}]},{"osd":1,"last update":"Fri Oct 8 19:38:37 2021","interfaces":[{"interface":"back","average":{"1min":2.0939999999999999,"5min":1.4890000000000001,"15min":2.137},"min":{"1min":0.21099999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":8.6059999999999999,"5min":8.6059999999999999,"15min":37.271999999999998},"last":8.8610000000000007},{"interface":"front","average":{"1min":2.4049999999999998,"5min":1.474,"15min":2.109},"min":{"1min":0.32600000000000001,"5min":0.223,"15min":0.19},"max":{"1min":8.9499999999999993,"5min":9.0229999999999997,"15min":37.033000000000001},"last":1.583}]},{"osd":2,"last update":"Fri Oct 8 19:38:37 2021","interfaces":[{"interface":"back","average":{"1min":2.9529999999999998,"5min":1.514,"15min":2.1240000000000001},"min":{"1min":0.31,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":10.086,"5min":10.086,"15min":32.277000000000001},"last":1.49},{"interface":"front","average":{"1min":2.2789999999999999,"5min":1.7310000000000001,"15min":2.1429999999999998},"min":{"1min":0.24399999999999999,"5min":0.224,"15min":0.224},"max":{"1min":11.207000000000001,"5min":11.207000000000001,"15min":23.189},"last":0.27900000000000003}]},{"osd":4,"last update":"Fri Oct 8 19:37:49 2021","interfaces":[{"interface":"back","average":{"1min":1.8819999999999999,"5min":1.9550000000000001,"15min":1.7370000000000001},"min":{"1min":0.29399999999999998,"5min":0.28100000000000003,"15min":0.25600000000000001},"max":{"1min":8.7940000000000005,"5min":13.968,"15min":18.064},"last":0.32700000000000001},{"interface":"front","average":{"1min":1.9219999999999999,"5min":1.774,"15min":1.827},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.26900000000000002},"max":{"1min":5.6319999999999997,"5min":8.8460000000000001,"15min":18.692},"last":8.9009999999999998}]},{"osd":5,"last update":"Fri Oct 8 19:38:09 2021","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":2.097,"15min":1.8500000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.27000000000000002},"max":{"1min":3.8980000000000001,"5min":75.397000000000006,"15min":75.397000000000006},"last":0.44700000000000001},{"interface":"front","average":{"1min":1.772,"5min":3.0600000000000001,"15min":2.2050000000000001},"min":{"1min":0.44600000000000001,"5min":0.32600000000000001,"15min":0.28100000000000003},"max":{"1min":8.7579999999999991,"5min":75.680000000000007,"15min":75.680000000000007},"last":1.419}]},{"osd":6,"last update":"Fri Oct 8 19:38:21 2021","interfaces":[{"interface":"back","average":{"1min":1.601,"5min":1.675,"15min":1.921},"min":{"1min":0.39400000000000002,"5min":0.32600000000000001,"15min":0.28599999999999998},"max":{"1min":5.6900000000000004,"5min":9.5,"15min":17.512},"last":9.1170000000000009},{"interface":"front","average":{"1min":2.3849999999999998,"5min":1.627,"15min":1.762},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":8.9779999999999998,"5min":8.9779999999999998,"15min":13.298},"last":1.0660000000000001}]},{"osd":7,"last update":"Fri Oct 8 19:37:49 2021","interfaces":[{"interface":"back","average":{"1min":1.966,"5min":2.0649999999999999,"15min":1.8300000000000001},"min":{"1min":0.371,"5min":0.35799999999999998,"15min":0.32200000000000001},"max":{"1min":8.7260000000000009,"5min":8.9000000000000004,"15min":10.696999999999999},"last":9.1560000000000006},{"interface":"front","average":{"1min":2.4710000000000001,"5min":1.7090000000000001,"15min":1.694},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":9.0239999999999991,"5min":9.0239999999999991,"15min":13.225},"last":0.77300000000000002}]}]},{"osd":4,"up_from":30,"seq":128849019102,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":408820,"kb_used_data":126188,"kb_used_omap":0,"kb_used_meta":282496,"kb_avail":93336332,"statfs":{"total":95995035648,"available":95576403968,"internally_reserved":0,"allocated":129216512,"data_stored":128778810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":289275904},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:37:49 2021","interfaces":[{"interface":"back","average":{"1min":1.7010000000000001,"5min":1.3140000000000001,"15min":1.849},"min":{"1min":0.219,"5min":0.20899999999999999,"15min":0.185},"max":{"1min":4.875,"5min":7.1319999999999997,"15min":82.109999999999999},"last":4.444},{"interface":"front","average":{"1min":1.403,"5min":1.3859999999999999,"15min":1.8360000000000001},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.20399999999999999},"max":{"1min":7.3760000000000003,"5min":7.9340000000000002,"15min":82.025999999999996},"last":1.8520000000000001}]},{"osd":1,"last update":"Fri Oct 8 19:37:49 2021","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":3.048,"15min":2.2570000000000001},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":4.2370000000000001,"5min":122.422,"15min":122.422},"last":2.7130000000000001},{"interface":"front","average":{"1min":1.113,"5min":2.7410000000000001,"15min":1.962},"min":{"1min":0.247,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":3.6560000000000001,"5min":123.122,"15min":123.122},"last":0.86099999999999999}]},{"osd":2,"last update":"Fri Oct 8 19:37:49 2021","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.268,"15min":1.419},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":6.2720000000000002,"5min":6.2720000000000002,"15min":21.257000000000001},"last":1.762},{"interface":"front","average":{"1min":1.8759999999999999,"5min":1.45,"15min":1.4790000000000001},"min":{"1min":0.29899999999999999,"5min":0.221,"15min":0.221},"max":{"1min":7.5010000000000003,"5min":7.5010000000000003,"15min":21.600000000000001},"last":1.9059999999999999}]},{"osd":3,"last update":"Fri Oct 8 19:37:49 2021","interfaces":[{"interface":"back","average":{"1min":1.5109999999999999,"5min":1.6910000000000001,"15min":2.177},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.26500000000000001},"max":{"1min":7.468,"5min":7.468,"15min":58.506999999999998},"last":3.6949999999999998},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.427,"15min":1.845},"min":{"1min":0.27000000000000002,"5min":0.254,"15min":0.254},"max":{"1min":3.3580000000000001,"5min":8.5540000000000003,"15min":58.521000000000001},"last":2.6850000000000001}]},{"osd":5,"last update":"Fri Oct 8 19:38:10 2021","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.4139999999999999,"15min":0.998},"min":{"1min":0.27800000000000002,"5min":0.25900000000000001,"15min":0.23899999999999999},"max":{"1min":3.411,"5min":10.477,"15min":10.477},"last":2.137},{"interface":"front","average":{"1min":0.67900000000000005,"5min":1.1439999999999999,"15min":0.88300000000000001},"min":{"1min":0.28799999999999998,"5min":0.27700000000000002,"15min":0.22900000000000001},"max":{"1min":2.383,"5min":6.1900000000000004,"15min":8.1319999999999997},"last":4.1760000000000002}]},{"osd":6,"last update":"Fri Oct 8 19:38:26 2021","interfaces":[{"interface":"back","average":{"1min":12.135999999999999,"5min":4.181,"15min":1.9359999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.23599999999999999},"max":{"1min":171.69800000000001,"5min":171.69800000000001,"15min":171.69800000000001},"last":1.879},{"interface":"front","average":{"1min":12.487,"5min":4.3959999999999999,"15min":2.0289999999999999},"min":{"1min":0.35799999999999998,"5min":0.308,"15min":0.247},"max":{"1min":171.613,"5min":171.613,"15min":171.613},"last":0.89900000000000002}]},{"osd":7,"last update":"Fri Oct 8 19:37:49 2021","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":1.28,"15min":0.91100000000000003},"min":{"1min":0.314,"5min":0.30199999999999999,"15min":0.26400000000000001},"max":{"1min":5.2009999999999996,"5min":6.157,"15min":8.0050000000000008},"last":0.436},{"interface":"front","average":{"1min":1.9199999999999999,"5min":1.375,"15min":1.0269999999999999},"min":{"1min":0.32500000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":7.702,"5min":7.702,"15min":7.702},"last":1.8169999999999999}]}]},{"osd":5,"up_from":38,"seq":163208757466,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":424844,"kb_used_data":84764,"kb_used_omap":0,"kb_used_meta":339712,"kb_avail":93320308,"statfs":{"total":95995035648,"available":95559995392,"internally_reserved":0,"allocated":86798336,"data_stored":86377720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":347865088},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:38:11 2021","interfaces":[{"interface":"back","average":{"1min":3.0209999999999999,"5min":2.0259999999999998,"15min":1.5329999999999999},"min":{"1min":0.221,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":33.469999999999999,"5min":43.332999999999998,"15min":43.332999999999998},"last":0.20699999999999999},{"interface":"front","average":{"1min":3.7000000000000002,"5min":2.165,"15min":1.647},"min":{"1min":0.26300000000000001,"5min":0.216,"15min":0.216},"max":{"1min":32.857999999999997,"5min":42.637,"15min":42.637},"last":0.54800000000000004}]},{"osd":1,"last update":"Fri Oct 8 19:38:11 2021","interfaces":[{"interface":"back","average":{"1min":2.2559999999999998,"5min":2.3420000000000001,"15min":1.847},"min":{"1min":0.29299999999999998,"5min":0.23599999999999999,"15min":0.23000000000000001},"max":{"1min":8.9990000000000006,"5min":94.558999999999997,"15min":94.558999999999997},"last":1.5569999999999999},{"interface":"front","average":{"1min":1.2849999999999999,"5min":2.0579999999999998,"15min":1.7050000000000001},"min":{"1min":0.26000000000000001,"5min":0.23899999999999999,"15min":0.23100000000000001},"max":{"1min":5.4829999999999997,"5min":94.456999999999994,"15min":94.456999999999994},"last":0.312}]},{"osd":2,"last update":"Fri Oct 8 19:38:11 2021","interfaces":[{"interface":"back","average":{"1min":2.4449999999999998,"5min":1.54,"15min":1.718},"min":{"1min":0.251,"5min":0.249,"15min":0.249},"max":{"1min":22.931999999999999,"5min":22.931999999999999,"15min":29.398},"last":0.58399999999999996},{"interface":"front","average":{"1min":2.8740000000000001,"5min":1.607,"15min":1.6799999999999999},"min":{"1min":0.28199999999999997,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":22.963999999999999,"5min":22.963999999999999,"15min":29.387},"last":3.8479999999999999}]},{"osd":3,"last update":"Fri Oct 8 19:38:11 2021","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.712,"15min":1.746},"min":{"1min":0.30499999999999999,"5min":0.27000000000000002,"15min":0.26200000000000001},"max":{"1min":4.1159999999999997,"5min":9.5899999999999999,"15min":12.356},"last":0.29799999999999999},{"interface":"front","average":{"1min":2.2349999999999999,"5min":1.8400000000000001,"15min":1.9119999999999999},"min":{"1min":0.29999999999999999,"5min":0.218,"15min":0.218},"max":{"1min":5.3849999999999998,"5min":8.9920000000000009,"15min":21.504000000000001},"last":0.56100000000000005}]},{"osd":4,"last update":"Fri Oct 8 19:38:11 2021","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.1140000000000001,"15min":0.85299999999999998},"min":{"1min":0.29899999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":9.1600000000000001,"5min":9.1600000000000001,"15min":9.2759999999999998},"last":0.34499999999999997},{"interface":"front","average":{"1min":2.016,"5min":1.248,"15min":0.89900000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.25900000000000001},"max":{"1min":11.231,"5min":11.231,"15min":11.231},"last":0.26700000000000002}]},{"osd":6,"last update":"Fri Oct 8 19:38:24 2021","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.335,"15min":1.0049999999999999},"min":{"1min":0.29399999999999998,"5min":0.28499999999999998,"15min":0.255},"max":{"1min":3.3340000000000001,"5min":11.192,"15min":11.192},"last":0.67200000000000004},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.349,"15min":1},"min":{"1min":0.33000000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":4.1420000000000003,"5min":11.259,"15min":11.259},"last":0.41399999999999998}]},{"osd":7,"last update":"Fri Oct 8 19:37:46 2021","interfaces":[{"interface":"back","average":{"1min":1.5660000000000001,"5min":1.48,"15min":1.024},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":5.0519999999999996,"5min":29.946999999999999,"15min":29.946999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.468,"15min":1.077},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":4.2460000000000004,"5min":29.294,"15min":29.294},"last":0.372}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":266240,"data_stored":262688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":327680,"data_stored":327680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":142675968,"data_stored":142671896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":36700160,"data_stored":36700160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":76742656,"data_stored":76742656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":60948480,"data_stored":60948480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":118689792,"data_stored":118685720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":76480512,"data_stored":76480512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":100339712,"data_stored":100335640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":56098816,"data_stored":56098816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-10-08T19:38:49.175 INFO:tasks.cephadm.ceph_manager.ceph:recovered! 2021-10-08T19:38:49.175 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2021-10-08T19:38:49.175 INFO:tasks.thrashosds.thrasher:inject_pause on 6 2021-10-08T19:38:49.176 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2021-10-08T19:38:49.176 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2021-10-08T19:38:49.176 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.6 config set filestore_inject_stall 3 2021-10-08T19:38:49.200 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:48 smithi117 ceph-mon[34585]: 4.a deep-scrub ok 2021-10-08T19:38:49.201 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:48 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:38:49.201 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:48 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:38:49.201 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:48 smithi117 ceph-mon[34585]: 2.9 deep-scrub ok 2021-10-08T19:38:49.201 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:48 smithi117 ceph-mon[34585]: from='client.26068 v1:172.21.15.97:0/3601241155' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:38:49.202 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:48 smithi117 ceph-mon[34585]: osdmap e429: 8 total, 8 up, 8 in 2021-10-08T19:38:49.202 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:48 smithi117 ceph-mon[34585]: 5.6 scrub ok 2021-10-08T19:38:49.604 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:38:49.607 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:49.607 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:38:49.709 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:38:49.735 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:50.132 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:38:50.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:49 smithi117 ceph-mon[34585]: 1.6 scrub ok 2021-10-08T19:38:50.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:49 smithi117 ceph-mon[34585]: 4.2 scrub ok 2021-10-08T19:38:50.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:49 smithi117 ceph-mon[34585]: pgmap v872: 188 pgs: 188 active+clean; 51 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 724 B/s rd, 0 B/s wr, 1.14k op/s 2021-10-08T19:38:50.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:49 smithi117 ceph-mon[34585]: 6.f scrub ok 2021-10-08T19:38:50.196 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:38:50.196 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2021-10-08T19:38:50.197 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2021-10-08T19:38:50.197 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:38:50.215 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:49 smithi097 ceph-mon[32687]: 1.6 scrub ok 2021-10-08T19:38:50.215 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:49 smithi097 ceph-mon[32687]: 4.2 scrub ok 2021-10-08T19:38:50.216 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:49 smithi097 ceph-mon[32687]: pgmap v872: 188 pgs: 188 active+clean; 51 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 724 B/s rd, 0 B/s wr, 1.14k op/s 2021-10-08T19:38:50.216 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:49 smithi097 ceph-mon[32687]: 6.f scrub ok 2021-10-08T19:38:50.216 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:49 smithi097 ceph-mon[41966]: 1.6 scrub ok 2021-10-08T19:38:50.217 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:49 smithi097 ceph-mon[41966]: 4.2 scrub ok 2021-10-08T19:38:50.217 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:49 smithi097 ceph-mon[41966]: pgmap v872: 188 pgs: 188 active+clean; 51 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 724 B/s rd, 0 B/s wr, 1.14k op/s 2021-10-08T19:38:50.217 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:49 smithi097 ceph-mon[41966]: 6.f scrub ok 2021-10-08T19:38:50.231 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:38:51.088 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2021-10-08T19:38:51.220 INFO:journalctl@ceph.osd.0.smithi097.stdout:Oct 08 19:38:51 smithi097 conmon[47373]: 2021-10-08T19:38:51.023+0000 7f833278c700 -1 osd.0 pg_epoch: 429 pg[2.13( empty local-lis/les=236/240 n=0 ec=60/60 lis/c=236/236 les/c/f=240/240/0 sis=236) [0,4,3] r=0 lpr=236 crt=0'0 mlcod 0'0 active+clean] scrubber pg(2.13) handle_scrub_reserve_grant: received unsolicited reservation grant from osd 4 (0x55cc11291340) 2021-10-08T19:38:51.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:50 smithi097 ceph-mon[32687]: 2.2 deep-scrub ok 2021-10-08T19:38:51.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:50 smithi097 ceph-mon[32687]: 1.1 scrub ok 2021-10-08T19:38:51.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:50 smithi097 ceph-mon[32687]: 6.1a scrub ok 2021-10-08T19:38:51.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:50 smithi097 ceph-mon[41966]: 2.2 deep-scrub ok 2021-10-08T19:38:51.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:50 smithi097 ceph-mon[41966]: 1.1 scrub ok 2021-10-08T19:38:51.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:50 smithi097 ceph-mon[41966]: 6.1a scrub ok 2021-10-08T19:38:51.286 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:38:51.286 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:50 smithi117 ceph-mon[34585]: 2.2 deep-scrub ok 2021-10-08T19:38:51.287 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:50 smithi117 ceph-mon[34585]: 1.1 scrub ok 2021-10-08T19:38:51.287 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:50 smithi117 ceph-mon[34585]: 6.1a scrub ok 2021-10-08T19:38:51.288 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:51.288 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:38:51.363 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:38:51.390 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:38:51.419 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:51.545 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:38:51.547 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:51.547 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:38:51.649 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:38:51.674 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:51.718 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:38:51.725 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:51.726 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:38:51.827 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:38:51.859 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:51.975 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:38:52.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:51 smithi117 ceph-mon[34585]: 6.15 scrub ok 2021-10-08T19:38:52.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:51 smithi117 ceph-mon[34585]: pgmap v873: 188 pgs: 188 active+clean; 635 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.11k op/s 2021-10-08T19:38:52.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:51 smithi117 ceph-mon[34585]: 10.3 scrub ok 2021-10-08T19:38:52.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:51 smithi117 ceph-mon[34585]: 5.17 scrub ok 2021-10-08T19:38:52.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:51 smithi097 ceph-mon[32687]: 6.15 scrub ok 2021-10-08T19:38:52.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:51 smithi097 ceph-mon[32687]: pgmap v873: 188 pgs: 188 active+clean; 635 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.11k op/s 2021-10-08T19:38:52.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:51 smithi097 ceph-mon[32687]: 10.3 scrub ok 2021-10-08T19:38:52.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:51 smithi097 ceph-mon[32687]: 5.17 scrub ok 2021-10-08T19:38:52.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:51 smithi097 ceph-mon[41966]: 6.15 scrub ok 2021-10-08T19:38:52.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:51 smithi097 ceph-mon[41966]: pgmap v873: 188 pgs: 188 active+clean; 635 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.11k op/s 2021-10-08T19:38:52.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:51 smithi097 ceph-mon[41966]: 10.3 scrub ok 2021-10-08T19:38:52.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:51 smithi097 ceph-mon[41966]: 5.17 scrub ok 2021-10-08T19:38:52.659 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:38:52 smithi117 conmon[69189]: level=error ts=2021-10-08T19:38:52.314Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=2 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:38:52.948 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:38:52 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:38:52] "GET /metrics HTTP/1.1" 200 155891 "" "Prometheus/2.18.1" 2021-10-08T19:38:52.949 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:52 smithi097 ceph-mon[32687]: 5.1e deep-scrub ok 2021-10-08T19:38:52.949 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:52 smithi097 ceph-mon[32687]: 3.3 scrub ok 2021-10-08T19:38:52.949 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:52 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1490549233' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:38:52.950 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:52 smithi097 ceph-mon[32687]: from='client.26074 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:38:52.954 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is set 2021-10-08T19:38:53.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:52 smithi117 ceph-mon[34585]: 5.1e deep-scrub ok 2021-10-08T19:38:53.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:52 smithi117 ceph-mon[34585]: 3.3 scrub ok 2021-10-08T19:38:53.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:52 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1490549233' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:38:53.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:52 smithi117 ceph-mon[34585]: from='client.26074 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:38:53.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:52 smithi097 ceph-mon[41966]: 5.1e deep-scrub ok 2021-10-08T19:38:53.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:52 smithi097 ceph-mon[41966]: 3.3 scrub ok 2021-10-08T19:38:53.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:52 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1490549233' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:38:53.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:52 smithi097 ceph-mon[41966]: from='client.26074 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:38:53.408 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:38:53.411 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:53.412 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:38:53.518 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:38:53.546 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:53.595 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:53.599 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:38:53.600 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:38:53.702 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:38:53.727 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:53.986 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:53 smithi097 ceph-mon[41966]: 6.19 scrub ok 2021-10-08T19:38:53.986 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:53 smithi097 ceph-mon[41966]: pgmap v874: 188 pgs: 188 active+clean; 635 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 427 op/s 2021-10-08T19:38:53.986 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:53 smithi097 ceph-mon[41966]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:38:53.987 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:53 smithi097 ceph-mon[41966]: from='client.26074 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:38:53.987 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:53 smithi097 ceph-mon[41966]: osdmap e430: 8 total, 8 up, 8 in 2021-10-08T19:38:53.987 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:53 smithi097 ceph-mon[41966]: 4.3 scrub ok 2021-10-08T19:38:53.987 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:53 smithi097 ceph-mon[32687]: 6.19 scrub ok 2021-10-08T19:38:53.988 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:53 smithi097 ceph-mon[32687]: pgmap v874: 188 pgs: 188 active+clean; 635 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 427 op/s 2021-10-08T19:38:53.988 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:53 smithi097 ceph-mon[32687]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:38:53.988 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:53 smithi097 ceph-mon[32687]: from='client.26074 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:38:53.988 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:53 smithi097 ceph-mon[32687]: osdmap e430: 8 total, 8 up, 8 in 2021-10-08T19:38:53.989 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:53 smithi097 ceph-mon[32687]: 4.3 scrub ok 2021-10-08T19:38:54.029 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:38:54.029 INFO:teuthology.orchestra.run.smithi117.stdout: "success": "" 2021-10-08T19:38:54.030 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:38:54.052 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:38:53 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:38:53] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:38:54.053 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:53 smithi117 ceph-mon[34585]: 6.19 scrub ok 2021-10-08T19:38:54.053 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:53 smithi117 ceph-mon[34585]: pgmap v874: 188 pgs: 188 active+clean; 635 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 427 op/s 2021-10-08T19:38:54.053 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:53 smithi117 ceph-mon[34585]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:38:54.053 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:53 smithi117 ceph-mon[34585]: from='client.26074 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:38:54.054 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:53 smithi117 ceph-mon[34585]: osdmap e430: 8 total, 8 up, 8 in 2021-10-08T19:38:54.054 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:53 smithi117 ceph-mon[34585]: 4.3 scrub ok 2021-10-08T19:38:54.223 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:38:54.227 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:54.228 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:38:54.329 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:38:54.357 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:55.010 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:38:55.010 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:38:55.010 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:38:55.011 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:38:55.021 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:38:55.042 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:38:55.061 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:38:55.083 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:38:55.084 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'false' 2021-10-08T19:38:55.084 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'false' 2021-10-08T19:38:55.084 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'false' 2021-10-08T19:38:55.084 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'false' 2021-10-08T19:38:55.085 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'false' 2021-10-08T19:38:55.085 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'false' 2021-10-08T19:38:55.085 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'false' 2021-10-08T19:38:55.085 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'false' 2021-10-08T19:38:55.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:54 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3676781650' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:38:55.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:54 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3676781650' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:38:55.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:54 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3676781650' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:38:55.309 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:38:55.310 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:55.311 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:38:55.412 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:38:55.442 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:55.780 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:55.781 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:38:55.782 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:38:55.896 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:38:55.927 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:55.996 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'unique_pool_3' removed 2021-10-08T19:38:56.030 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:38:56.038 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:55 smithi097 ceph-mon[41966]: pgmap v876: 188 pgs: 188 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 0 B/s wr, 425 op/s 2021-10-08T19:38:56.038 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:55 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1676052566' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_3", "pool2": "unique_pool_3", "yes_i_really_really_mean_it": true}]: dispatch 2021-10-08T19:38:56.038 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:55 smithi097 ceph-mon[41966]: from='client.26086 ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_3", "pool2": "unique_pool_3", "yes_i_really_really_mean_it": true}]: dispatch 2021-10-08T19:38:56.039 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:55 smithi097 ceph-mon[32687]: pgmap v876: 188 pgs: 188 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 0 B/s wr, 425 op/s 2021-10-08T19:38:56.039 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:55 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1676052566' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_3", "pool2": "unique_pool_3", "yes_i_really_really_mean_it": true}]: dispatch 2021-10-08T19:38:56.039 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:55 smithi097 ceph-mon[32687]: from='client.26086 ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_3", "pool2": "unique_pool_3", "yes_i_really_really_mean_it": true}]: dispatch 2021-10-08T19:38:56.040 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:56.040 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:38:56.102 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2021-10-08T19:38:56.103 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:38:56.141 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:38:56.171 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:56.284 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:38:56.285 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:55 smithi117 ceph-mon[34585]: pgmap v876: 188 pgs: 188 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 0 B/s wr, 425 op/s 2021-10-08T19:38:56.286 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:55 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1676052566' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_3", "pool2": "unique_pool_3", "yes_i_really_really_mean_it": true}]: dispatch 2021-10-08T19:38:56.286 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:55 smithi117 ceph-mon[34585]: from='client.26086 ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_3", "pool2": "unique_pool_3", "yes_i_really_really_mean_it": true}]: dispatch 2021-10-08T19:38:56.287 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:56.287 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:38:56.374 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set nodeep-scrub 2021-10-08T19:38:56.390 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:38:56.415 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:56.466 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:56.467 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:38:56.467 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:38:56.570 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:38:56.596 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:56.688 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:38:56.689 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:56.690 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:38:56.791 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:38:56.817 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:57.134 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:56 smithi097 ceph-mon[41966]: from='client.26086 ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_3", "pool2": "unique_pool_3", "yes_i_really_really_mean_it": true}]': finished 2021-10-08T19:38:57.134 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:56 smithi097 ceph-mon[41966]: osdmap e431: 8 total, 8 up, 8 in 2021-10-08T19:38:57.135 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:56 smithi097 ceph-mon[32687]: from='client.26086 ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_3", "pool2": "unique_pool_3", "yes_i_really_really_mean_it": true}]': finished 2021-10-08T19:38:57.135 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:56 smithi097 ceph-mon[32687]: osdmap e431: 8 total, 8 up, 8 in 2021-10-08T19:38:57.136 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2021-10-08T19:38:57.165 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:38:57.175 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2021-10-08T19:38:57.176 INFO:tasks.radosbench:Beginning radosbench... 2021-10-08T19:38:57.177 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_4 2021-10-08T19:38:57.177 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd pool create unique_pool_4 16 2021-10-08T19:38:57.213 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:38:57.220 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:57.221 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:38:57.322 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:38:57.344 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:38:57 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:38:57.345 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:56 smithi117 ceph-mon[34585]: from='client.26086 ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_3", "pool2": "unique_pool_3", "yes_i_really_really_mean_it": true}]': finished 2021-10-08T19:38:57.345 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:56 smithi117 ceph-mon[34585]: osdmap e431: 8 total, 8 up, 8 in 2021-10-08T19:38:57.364 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:57.394 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:38:57.397 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:57.398 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:38:57.519 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:38:57.552 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:57.599 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:38:57.600 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:57.601 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:38:57.706 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:38:57.732 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:57.768 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:38:57.769 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:38:57.778 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:38:57.783 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:57.784 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:38:57.816 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2021-10-08T19:38:57.885 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:38:57.921 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:57.957 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:38:57.960 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:57.961 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:38:57.990 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:57 smithi097 ceph-mon[32687]: pgmap v878: 172 pgs: 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2021-10-08T19:38:57.991 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:57 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:38:57.992 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:57 smithi097 ceph-mon[41966]: pgmap v878: 172 pgs: 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2021-10-08T19:38:57.992 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:57 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:38:57.993 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:38:57 smithi097 conmon[33110]: 172.21.15.117 - - [08/Oct/2021:19:38:57] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:38:58.064 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:38:58.097 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:58.141 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:58.142 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:38:58.143 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:38:58.245 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:38:58.293 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:57 smithi117 ceph-mon[34585]: pgmap v878: 172 pgs: 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2021-10-08T19:38:58.294 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:57 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:38:58.294 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:58.315 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:58.316 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:38:58.317 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:38:58.420 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:38:58.447 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:58.612 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:38:58.614 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:58.615 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:38:58.722 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:38:58.747 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:58.798 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:58.799 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:38:58.799 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:38:58.900 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:38:58.933 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:59.051 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:59.052 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:38:59.052 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:38:59.153 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:38:59.160 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:58 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:38:59.160 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:58 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:38:59.160 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:58 smithi117 ceph-mon[34585]: 172.21.15.117 - - [08/Oct/2021:19:38:57] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:38:59.177 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:59.205 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:58 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:38:59.205 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:58 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:38:59.205 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:58 smithi097 ceph-mon[41966]: 172.21.15.117 - - [08/Oct/2021:19:38:57] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:38:59.206 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:58 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:38:59.206 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:58 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:38:59.207 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:58 smithi097 ceph-mon[32687]: 172.21.15.117 - - [08/Oct/2021:19:38:57] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:38:59.217 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:38:59.227 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:59.228 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:38:59.295 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:38:59.331 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:38:59.360 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:38:59.790 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 4, 5, 7, 6, 1, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2021-10-08T19:38:59.791 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2021-10-08T19:38:59.792 INFO:tasks.thrashosds.thrasher:inject_pause on 5 2021-10-08T19:38:59.792 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2021-10-08T19:38:59.792 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2021-10-08T19:38:59.794 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.5 config set filestore_inject_stall 3 2021-10-08T19:38:59.959 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:38:59.960 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:38:59.961 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:38:59.999 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is set 2021-10-08T19:39:00.063 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:39:00.068 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:39:00.090 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:00.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:59 smithi117 ceph-mon[34585]: pgmap v879: 172 pgs: 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2021-10-08T19:39:00.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:38:59 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1238747280' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:39:00.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:59 smithi097 ceph-mon[32687]: pgmap v879: 172 pgs: 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2021-10-08T19:39:00.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:38:59 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1238747280' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:39:00.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:59 smithi097 ceph-mon[41966]: pgmap v879: 172 pgs: 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2021-10-08T19:39:00.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:38:59 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1238747280' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:39:00.734 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:39:00.737 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:00.737 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:39:00.842 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:39:00.870 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:01.067 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:39:01.071 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:01.072 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:39:01.173 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:39:01.196 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:01 smithi097 ceph-mon[41966]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:39:01.196 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:01 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1238747280' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:39:01.197 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:01 smithi097 ceph-mon[41966]: osdmap e432: 8 total, 8 up, 8 in 2021-10-08T19:39:01.197 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:01 smithi097 ceph-mon[32687]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:39:01.198 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:01 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1238747280' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:39:01.198 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:01 smithi097 ceph-mon[32687]: osdmap e432: 8 total, 8 up, 8 in 2021-10-08T19:39:01.199 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:01.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:01 smithi117 ceph-mon[34585]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:39:01.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:01 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1238747280' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:39:01.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:01 smithi117 ceph-mon[34585]: osdmap e432: 8 total, 8 up, 8 in 2021-10-08T19:39:01.941 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:39:01.942 INFO:teuthology.orchestra.run.smithi117.stdout: "success": "" 2021-10-08T19:39:01.942 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:39:02.100 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:02.101 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:39:02.101 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:39:02.203 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:39:02.235 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:02.253 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:02 smithi097 ceph-mon[32687]: pgmap v881: 172 pgs: 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2021-10-08T19:39:02.254 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:02 smithi097 ceph-mon[41966]: pgmap v881: 172 pgs: 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2021-10-08T19:39:02.277 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:39:02.278 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:02 smithi117 ceph-mon[34585]: pgmap v881: 172 pgs: 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2021-10-08T19:39:02.279 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:02.279 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:39:02.389 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:39:02.412 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:02.616 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:39:02.618 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:02.619 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:39:02.657 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2021-10-08T19:39:02.657 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:39:02.720 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:39:02.747 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:39:02 smithi097 conmon[33110]: 172.21.15.97 - - [08/Oct/2021:19:39:02] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:39:02.747 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:39:02 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:39:02] "GET /metrics HTTP/1.1" 200 154749 "" "Prometheus/2.18.1" 2021-10-08T19:39:02.748 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:02.853 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:39:02.854 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:02.854 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:39:02.956 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:39:02.981 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:03.027 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:39:03.030 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:03.031 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:39:03.048 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:39:03.064 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:39:03.083 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:39:03.104 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:39:03.118 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:39:03.132 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:39:03.136 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:39:03.159 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:39:03.160 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:03.178 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:39:03.179 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true' 2021-10-08T19:39:03.179 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true' 2021-10-08T19:39:03.179 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true' 2021-10-08T19:39:03.184 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true' 2021-10-08T19:39:03.184 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true' 2021-10-08T19:39:03.185 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true' 2021-10-08T19:39:03.185 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'true' 2021-10-08T19:39:03.185 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'true' 2021-10-08T19:39:03.200 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:39:03.202 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:03.203 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:39:03.305 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:39:03.329 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:03.372 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:39:03.373 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:03.374 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:39:03.475 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:39:03.508 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:03.509 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'unique_pool_4' created 2021-10-08T19:39:03.546 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:39:03.555 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:03.566 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:39:03.668 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:39:03.693 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:03.736 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:39:03.738 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:03.739 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:39:03.840 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:39:03.866 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:03 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:39:03.867 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:03 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:39:03.867 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:03 smithi097 ceph-mon[41966]: 172.21.15.97 - - [08/Oct/2021:19:39:02] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:39:03.868 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:03 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3320298935' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_4", "pg_num": 16}]: dispatch 2021-10-08T19:39:03.868 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:03 smithi097 ceph-mon[41966]: from='client.26098 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_4", "pg_num": 16}]: dispatch 2021-10-08T19:39:03.869 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:03 smithi097 ceph-mon[41966]: pgmap v882: 172 pgs: 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2021-10-08T19:39:03.869 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:03 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1154270722' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:39:03.870 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:03 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:39:03.870 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:03 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:39:03.870 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:03 smithi097 ceph-mon[32687]: 172.21.15.97 - - [08/Oct/2021:19:39:02] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:39:03.870 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:03 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3320298935' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_4", "pg_num": 16}]: dispatch 2021-10-08T19:39:03.871 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:03 smithi097 ceph-mon[32687]: from='client.26098 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_4", "pg_num": 16}]: dispatch 2021-10-08T19:39:03.871 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:03 smithi097 ceph-mon[32687]: pgmap v882: 172 pgs: 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2021-10-08T19:39:03.871 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:03 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1154270722' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:39:03.872 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:03.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:03 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:39:03.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:03 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:39:03.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:03 smithi117 ceph-mon[34585]: 172.21.15.97 - - [08/Oct/2021:19:39:02] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:39:03.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:03 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3320298935' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_4", "pg_num": 16}]: dispatch 2021-10-08T19:39:03.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:03 smithi117 ceph-mon[34585]: from='client.26098 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_4", "pg_num": 16}]: dispatch 2021-10-08T19:39:03.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:03 smithi117 ceph-mon[34585]: pgmap v882: 172 pgs: 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2021-10-08T19:39:03.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:03 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1154270722' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:39:04.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:39:03 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:39:03] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:39:04.478 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd pool application enable unique_pool_4 rados --yes-i-really-mean-it || true 2021-10-08T19:39:04.501 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset noscrub 2021-10-08T19:39:04.584 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:39:04.587 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:04.588 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:39:04.642 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2021-10-08T19:39:04.689 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:39:04.715 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:04 smithi097 ceph-mon[41966]: from='client.26098 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_4", "pg_num": 16}]': finished 2021-10-08T19:39:04.715 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:04 smithi097 ceph-mon[41966]: osdmap e433: 8 total, 8 up, 8 in 2021-10-08T19:39:04.716 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:04 smithi097 ceph-mon[32687]: from='client.26098 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_4", "pg_num": 16}]': finished 2021-10-08T19:39:04.716 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:04 smithi097 ceph-mon[32687]: osdmap e433: 8 total, 8 up, 8 in 2021-10-08T19:39:04.718 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:04.773 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:39:04.779 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:04.780 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:39:04.828 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:39:04.881 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:39:04.888 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:39:04.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:04 smithi117 ceph-mon[34585]: from='client.26098 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_4", "pg_num": 16}]': finished 2021-10-08T19:39:04.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:04 smithi117 ceph-mon[34585]: osdmap e433: 8 total, 8 up, 8 in 2021-10-08T19:39:04.911 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:04.959 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:39:04.961 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:04.962 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:39:05.063 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:39:05.101 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:05.197 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:39:05.199 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:05.200 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:39:05.301 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:39:05.328 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:05.373 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:39:05.375 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:05.376 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:39:05.387 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:39:05.478 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:39:05.504 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:05.549 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:39:05.551 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:05.552 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:39:05.653 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:39:05.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:05 smithi117 ceph-mon[34585]: osdmap e434: 8 total, 8 up, 8 in 2021-10-08T19:39:05.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:05 smithi117 ceph-mon[34585]: pgmap v885: 188 pgs: 15 creating+peering, 1 unknown, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2021-10-08T19:39:05.675 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:05 smithi097 ceph-mon[41966]: osdmap e434: 8 total, 8 up, 8 in 2021-10-08T19:39:05.676 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:05 smithi097 ceph-mon[41966]: pgmap v885: 188 pgs: 15 creating+peering, 1 unknown, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2021-10-08T19:39:05.676 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:05 smithi097 ceph-mon[32687]: osdmap e434: 8 total, 8 up, 8 in 2021-10-08T19:39:05.676 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:05 smithi097 ceph-mon[32687]: pgmap v885: 188 pgs: 15 creating+peering, 1 unknown, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2021-10-08T19:39:05.678 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:06.201 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:39:06.205 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:06.206 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:39:06.306 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:39:06.335 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:06.380 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:39:06.382 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:06.383 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:39:06.452 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2021-10-08T19:39:06.485 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:39:06.523 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:06.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:06 smithi117 ceph-mon[34585]: osdmap e435: 8 total, 8 up, 8 in 2021-10-08T19:39:06.767 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:06 smithi097 ceph-mon[41966]: osdmap e435: 8 total, 8 up, 8 in 2021-10-08T19:39:06.768 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:06 smithi097 ceph-mon[32687]: osdmap e435: 8 total, 8 up, 8 in 2021-10-08T19:39:06.836 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:39:06.839 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:06.840 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:39:06.941 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:39:06.971 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:07.163 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:39:07.168 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:39:07.173 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:07.173 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:39:07.274 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:39:07.299 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:07.394 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:39:07.397 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:07.398 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:39:07.499 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:39:07.512 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:39:07 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:39:07.529 INFO:teuthology.orchestra.run.smithi097.stderr:enabled application 'rados' on pool 'unique_pool_4' 2021-10-08T19:39:07.530 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:07.580 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:39:07.582 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:07.583 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:39:07.617 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 4, 5, 7, 6, 1, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2021-10-08T19:39:07.618 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2021-10-08T19:39:07.618 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd dump -f json-pretty 2021-10-08T19:39:07.640 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:07 smithi097 ceph-mon[41966]: pgmap v887: 188 pgs: 15 creating+peering, 1 unknown, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:39:07.641 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:07 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:39:07.643 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:07 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2174265946' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_4", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:07.643 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:07 smithi097 ceph-mon[32687]: pgmap v887: 188 pgs: 15 creating+peering, 1 unknown, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:39:07.643 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:07 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:39:07.644 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:07 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2174265946' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_4", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:07.684 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:39:07.709 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:07.753 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:39:07.755 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:07.756 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:39:07.857 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:39:07.883 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:07.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:07 smithi117 ceph-mon[34585]: pgmap v887: 188 pgs: 15 creating+peering, 1 unknown, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:39:07.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:07 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:39:07.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:07 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2174265946' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_4", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:08.382 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:39:08.384 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:08.385 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:39:08.486 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:39:08.515 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:08.542 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:39:08.543 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is unset 2021-10-08T19:39:08.565 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:39:08.567 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:08.568 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:39:08.670 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:39:08.697 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:08.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:08 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2174265946' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_4", "app": "rados", "yes_i_really_mean_it": true}]': finished 2021-10-08T19:39:08.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:08 smithi097 ceph-mon[41966]: osdmap e436: 8 total, 8 up, 8 in 2021-10-08T19:39:08.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:08 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/787975247' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:39:08.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:08 smithi097 ceph-mon[41966]: from='client.26116 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:39:08.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:08 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2174265946' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_4", "app": "rados", "yes_i_really_mean_it": true}]': finished 2021-10-08T19:39:08.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:08 smithi097 ceph-mon[32687]: osdmap e436: 8 total, 8 up, 8 in 2021-10-08T19:39:08.724 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:08 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/787975247' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:39:08.724 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:08 smithi097 ceph-mon[32687]: from='client.26116 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:39:08.739 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:39:08.741 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:08.742 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:39:08.844 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:39:08.866 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:08 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2174265946' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_4", "app": "rados", "yes_i_really_mean_it": true}]': finished 2021-10-08T19:39:08.867 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:08 smithi117 ceph-mon[34585]: osdmap e436: 8 total, 8 up, 8 in 2021-10-08T19:39:08.867 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:08 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/787975247' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:39:08.867 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:08 smithi117 ceph-mon[34585]: from='client.26116 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:39:08.868 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:08.908 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:39:08.910 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:08.911 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:39:09.013 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:39:09.041 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:09.547 DEBUG:teuthology.orchestra.run.smithi097:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_4 bench 90 write' 2021-10-08T19:39:09.550 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2021-10-08T19:39:09.551 INFO:teuthology.orchestra.run:waiting for 3000 2021-10-08T19:39:09.635 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:09 smithi097 ceph-mon[32687]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:39:09.636 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:09 smithi097 ceph-mon[32687]: from='client.26116 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:39:09.636 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:09 smithi097 ceph-mon[32687]: osdmap e437: 8 total, 8 up, 8 in 2021-10-08T19:39:09.636 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:09 smithi097 ceph-mon[32687]: pgmap v890: 188 pgs: 9 creating+peering, 179 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2021-10-08T19:39:09.637 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:09 smithi097 ceph-mon[41966]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:39:09.638 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:09 smithi097 ceph-mon[41966]: from='client.26116 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:39:09.639 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:09 smithi097 ceph-mon[41966]: osdmap e437: 8 total, 8 up, 8 in 2021-10-08T19:39:09.639 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:09 smithi097 ceph-mon[41966]: pgmap v890: 188 pgs: 9 creating+peering, 179 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2021-10-08T19:39:09.664 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:hints = 1 2021-10-08T19:39:09.665 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2021-10-08T19:39:09.665 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Object prefix: benchmark_data_smithi097_295476 2021-10-08T19:39:09.666 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2021-10-08T19:39:09.667 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 0 0 0 0 0 0 - 0 2021-10-08T19:39:09.689 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:39:09.696 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:09.697 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:39:09.798 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:39:09.824 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:09 smithi117 ceph-mon[34585]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:39:09.825 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:09 smithi117 ceph-mon[34585]: from='client.26116 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:39:09.825 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:09 smithi117 ceph-mon[34585]: osdmap e437: 8 total, 8 up, 8 in 2021-10-08T19:39:09.825 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:09 smithi117 ceph-mon[34585]: pgmap v890: 188 pgs: 9 creating+peering, 179 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2021-10-08T19:39:09.827 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:09.886 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:39:09.890 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:09.891 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:39:09.978 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:39:09.979 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2021-10-08T19:39:09.979 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:09.979 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.26125.0:820 11.9 11:9fc498c7:::benchmark_data_smithi097_295476_object819:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e437)", 2021-10-08T19:39:09.980 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:39:09.971132+0000", 2021-10-08T19:39:09.980 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0051401950000000002, 2021-10-08T19:39:09.980 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0051754729999999999, 2021-10-08T19:39:09.980 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:39:09.980 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2021-10-08T19:39:09.981 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:39:09.981 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.26125", 2021-10-08T19:39:09.981 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:39:09.981 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 820 2021-10-08T19:39:09.981 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:09.982 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:39:09.982 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:09.982 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:39:09.982 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.971132+0000", 2021-10-08T19:39:09.983 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:39:09.983 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:09.983 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:09.983 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:39:09.984 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.971132+0000", 2021-10-08T19:39:09.984 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:39:09.985 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:09.985 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:09.985 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:39:09.985 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.971130+0000", 2021-10-08T19:39:09.986 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:39:09.986 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:09.986 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:09.986 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:39:09.986 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.971155+0000", 2021-10-08T19:39:09.987 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4922999999999998e-05 2021-10-08T19:39:09.987 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:09.987 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:09.987 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:39:09.988 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.971171+0000", 2021-10-08T19:39:09.988 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5466999999999999e-05 2021-10-08T19:39:09.988 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:09.988 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:09.988 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:39:09.989 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.971177+0000", 2021-10-08T19:39:09.989 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7399999999999998e-06 2021-10-08T19:39:09.989 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:09.989 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:09.989 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:39:09.990 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.971235+0000", 2021-10-08T19:39:09.990 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7553999999999998e-05 2021-10-08T19:39:09.990 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:09.990 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:09.991 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:39:09.991 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.971383+0000", 2021-10-08T19:39:09.991 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014839399999999999 2021-10-08T19:39:09.991 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:09.991 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:09.992 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,6", 2021-10-08T19:39:09.992 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.971600+0000", 2021-10-08T19:39:09.992 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000216336 2021-10-08T19:39:09.992 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:09.993 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:09.993 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:39:09.993 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.974177+0000", 2021-10-08T19:39:09.993 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0025771140000000001 2021-10-08T19:39:09.993 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:09.994 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:09.994 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:39:09.995 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.975996+0000", 2021-10-08T19:39:09.995 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0018195100000000001 2021-10-08T19:39:09.995 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:09.995 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:09.995 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:09.996 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:09.996 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:09.996 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.26125.0:824 11.a 11:5993ecb3:::benchmark_data_smithi097_295476_object823:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e437)", 2021-10-08T19:39:09.996 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:39:09.971379+0000", 2021-10-08T19:39:09.997 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0048940449999999996, 2021-10-08T19:39:09.997 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0050374139999999996, 2021-10-08T19:39:09.997 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:39:09.997 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2021-10-08T19:39:09.997 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:39:09.998 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.26125", 2021-10-08T19:39:09.998 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:39:09.998 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 824 2021-10-08T19:39:09.998 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:09.999 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:39:09.999 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:09.999 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:39:10.000 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.971379+0000", 2021-10-08T19:39:10.000 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:39:10.000 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.000 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.001 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:39:10.001 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.971379+0000", 2021-10-08T19:39:10.001 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:39:10.001 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.002 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.002 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:39:10.002 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.971377+0000", 2021-10-08T19:39:10.002 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2021-10-08T19:39:10.003 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.003 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.003 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:39:10.003 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.971398+0000", 2021-10-08T19:39:10.003 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0755e-05 2021-10-08T19:39:10.004 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.004 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.004 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:39:10.005 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.971408+0000", 2021-10-08T19:39:10.005 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5510000000000005e-06 2021-10-08T19:39:10.005 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.005 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.006 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:39:10.006 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.971413+0000", 2021-10-08T19:39:10.006 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5230000000000003e-06 2021-10-08T19:39:10.006 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.007 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.007 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:39:10.007 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.971530+0000", 2021-10-08T19:39:10.007 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000117396 2021-10-08T19:39:10.008 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.008 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.008 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:39:10.008 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.971644+0000", 2021-10-08T19:39:10.008 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000113386 2021-10-08T19:39:10.009 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.009 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.009 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5,6", 2021-10-08T19:39:10.009 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.971797+0000", 2021-10-08T19:39:10.010 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015327 2021-10-08T19:39:10.010 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.010 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.010 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:39:10.010 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.974162+0000", 2021-10-08T19:39:10.011 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0023648039999999999 2021-10-08T19:39:10.011 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.011 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.011 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:39:10.012 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.975513+0000", 2021-10-08T19:39:10.012 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013514289999999999 2021-10-08T19:39:10.012 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:10.012 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:10.012 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:10.013 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.013 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.013 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.26125.0:827 11.b 11:ddfd6398:::benchmark_data_smithi097_295476_object826:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e437)", 2021-10-08T19:39:10.013 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:39:09.971428+0000", 2021-10-08T19:39:10.014 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0048449239999999996, 2021-10-08T19:39:10.014 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0051384409999999997, 2021-10-08T19:39:10.014 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:39:10.014 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2021-10-08T19:39:10.015 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:39:10.015 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.26125", 2021-10-08T19:39:10.015 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:39:10.016 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 827 2021-10-08T19:39:10.016 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.016 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:39:10.016 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.017 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:39:10.017 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.971428+0000", 2021-10-08T19:39:10.017 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:39:10.017 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.017 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.018 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:39:10.018 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.971428+0000", 2021-10-08T19:39:10.018 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:39:10.018 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.019 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.019 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:39:10.019 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.971427+0000", 2021-10-08T19:39:10.019 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2021-10-08T19:39:10.019 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.020 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.020 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:39:10.021 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.971473+0000", 2021-10-08T19:39:10.021 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6456999999999999e-05 2021-10-08T19:39:10.021 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.021 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.022 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:39:10.022 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.971480+0000", 2021-10-08T19:39:10.023 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0129999999999996e-06 2021-10-08T19:39:10.023 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.023 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.023 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:39:10.024 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.971485+0000", 2021-10-08T19:39:10.024 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4900000000000002e-06 2021-10-08T19:39:10.024 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.024 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.025 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:39:10.025 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.973324+0000", 2021-10-08T19:39:10.025 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0018395079999999999 2021-10-08T19:39:10.026 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.026 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.026 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:39:10.026 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.973444+0000", 2021-10-08T19:39:10.027 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119795 2021-10-08T19:39:10.027 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.027 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.028 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,1", 2021-10-08T19:39:10.028 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.973589+0000", 2021-10-08T19:39:10.028 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000144742 2021-10-08T19:39:10.028 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.028 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.029 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:39:10.029 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.976537+0000", 2021-10-08T19:39:10.029 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00294839 2021-10-08T19:39:10.029 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:10.030 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:10.030 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:10.030 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.030 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.030 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.26125.0:823 11.0 e437/433 11:00943a41:::benchmark_data_smithi097_295476_object822:head v 437'53, mlcod=437'51)", 2021-10-08T19:39:10.031 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:39:09.975335+0000", 2021-10-08T19:39:10.031 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.00093722300000000005, 2021-10-08T19:39:10.031 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013169119999999999, 2021-10-08T19:39:10.031 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:39:10.032 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2021-10-08T19:39:10.032 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:39:10.032 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.032 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:39:10.032 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.975335+0000", 2021-10-08T19:39:10.033 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:39:10.033 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.033 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.033 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:39:10.034 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.975335+0000", 2021-10-08T19:39:10.034 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:39:10.034 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.034 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.035 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:39:10.035 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.975334+0000", 2021-10-08T19:39:10.035 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:39:10.035 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.036 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.036 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:39:10.036 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.975358+0000", 2021-10-08T19:39:10.036 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3717999999999999e-05 2021-10-08T19:39:10.037 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.037 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.037 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:39:10.037 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.975368+0000", 2021-10-08T19:39:10.037 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4700000000000008e-06 2021-10-08T19:39:10.038 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.038 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.038 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:39:10.038 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.975372+0000", 2021-10-08T19:39:10.039 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9920000000000001e-06 2021-10-08T19:39:10.039 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.039 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.039 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:39:10.039 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.975543+0000", 2021-10-08T19:39:10.040 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000171337 2021-10-08T19:39:10.041 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.041 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.042 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:39:10.042 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.975568+0000", 2021-10-08T19:39:10.043 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5556000000000001e-05 2021-10-08T19:39:10.043 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:10.043 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:10.044 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:10.044 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.045 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.045 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.26125.0:825 11.0 e437/433 11:0897f75f:::benchmark_data_smithi097_295476_object824:head v 437'54, mlcod=437'51)", 2021-10-08T19:39:10.045 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:39:09.975395+0000", 2021-10-08T19:39:10.046 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.00087787800000000001, 2021-10-08T19:39:10.046 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001324904, 2021-10-08T19:39:10.046 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:39:10.047 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2021-10-08T19:39:10.047 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:39:10.047 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.048 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:39:10.048 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.975395+0000", 2021-10-08T19:39:10.048 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:39:10.048 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.049 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.049 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:39:10.050 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.975395+0000", 2021-10-08T19:39:10.050 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:39:10.050 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.050 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.051 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:39:10.051 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.975394+0000", 2021-10-08T19:39:10.051 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2021-10-08T19:39:10.051 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.052 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.052 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:39:10.052 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.975417+0000", 2021-10-08T19:39:10.052 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3388999999999999e-05 2021-10-08T19:39:10.054 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.055 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.055 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:39:10.055 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.975426+0000", 2021-10-08T19:39:10.056 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4970000000000001e-06 2021-10-08T19:39:10.056 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.056 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.056 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:39:10.057 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.975430+0000", 2021-10-08T19:39:10.057 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5750000000000002e-06 2021-10-08T19:39:10.057 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.057 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.058 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:39:10.058 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.975796+0000", 2021-10-08T19:39:10.058 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00036567700000000002 2021-10-08T19:39:10.058 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.059 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.059 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:39:10.060 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.975814+0000", 2021-10-08T19:39:10.060 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7927e-05 2021-10-08T19:39:10.060 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:10.060 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:10.061 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:10.061 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.061 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.061 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop_reply(client.26125.0:824 11.a e437/433)", 2021-10-08T19:39:10.061 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:39:09.976328+0000", 2021-10-08T19:39:10.062 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4294967295.9999442, 2021-10-08T19:39:10.062 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00045481699999999999, 2021-10-08T19:39:10.062 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:39:10.062 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "queued for pg", 2021-10-08T19:39:10.063 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:39:10.063 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.063 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:39:10.063 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.976328+0000", 2021-10-08T19:39:10.063 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:39:10.064 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.064 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.064 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:39:10.064 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.976328+0000", 2021-10-08T19:39:10.064 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:39:10.065 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.065 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.065 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:39:10.065 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.976327+0000", 2021-10-08T19:39:10.066 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2021-10-08T19:39:10.066 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.066 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.066 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:39:10.066 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.976334+0000", 2021-10-08T19:39:10.067 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.922e-06 2021-10-08T19:39:10.067 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.067 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.067 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:39:10.068 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.976343+0000", 2021-10-08T19:39:10.069 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5559999999999996e-06 2021-10-08T19:39:10.069 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.069 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.069 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:39:10.070 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.976350+0000", 2021-10-08T19:39:10.070 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3749999999999999e-06 2021-10-08T19:39:10.070 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:10.070 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:10.071 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:10.071 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.071 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.071 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop_reply(client.26125.0:820 11.9 e437/433)", 2021-10-08T19:39:10.072 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:39:09.976383+0000", 2021-10-08T19:39:10.072 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4294967295.9998899, 2021-10-08T19:39:10.073 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00045569600000000001, 2021-10-08T19:39:10.073 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:39:10.074 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "reached pg", 2021-10-08T19:39:10.074 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:39:10.074 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.074 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:39:10.075 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.976383+0000", 2021-10-08T19:39:10.075 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:39:10.075 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.075 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.075 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:39:10.076 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.976383+0000", 2021-10-08T19:39:10.076 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:39:10.076 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.077 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.077 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:39:10.079 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.976382+0000", 2021-10-08T19:39:10.079 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:39:10.079 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.079 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.080 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:39:10.080 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.976386+0000", 2021-10-08T19:39:10.080 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0110000000000002e-06 2021-10-08T19:39:10.080 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.081 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.081 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:39:10.081 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.976393+0000", 2021-10-08T19:39:10.081 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5490000000000003e-06 2021-10-08T19:39:10.081 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.082 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.082 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:39:10.082 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.976397+0000", 2021-10-08T19:39:10.082 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0910000000000003e-06 2021-10-08T19:39:10.083 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.083 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.083 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:39:10.083 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.976834+0000", 2021-10-08T19:39:10.084 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00043741500000000003 2021-10-08T19:39:10.084 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.084 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.084 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:39:10.084 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.976842+0000", 2021-10-08T19:39:10.085 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7030000000000006e-06 2021-10-08T19:39:10.085 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:10.085 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:10.085 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:10.085 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.086 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.086 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.26125.0:832 11.8 11:11a6dad9:::benchmark_data_smithi097_295476_object831:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e437)", 2021-10-08T19:39:10.086 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:39:09.976416+0000", 2021-10-08T19:39:10.086 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4294967295.9998569, 2021-10-08T19:39:10.087 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00049749600000000005, 2021-10-08T19:39:10.088 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:39:10.088 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2021-10-08T19:39:10.089 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:39:10.089 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.26125", 2021-10-08T19:39:10.089 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:39:10.089 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 832 2021-10-08T19:39:10.090 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.090 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:39:10.090 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.090 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:39:10.090 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.976416+0000", 2021-10-08T19:39:10.091 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:39:10.091 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.091 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.091 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:39:10.092 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.976416+0000", 2021-10-08T19:39:10.092 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:39:10.092 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.092 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.093 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:39:10.093 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.976414+0000", 2021-10-08T19:39:10.093 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:39:10.093 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.093 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.094 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:39:10.094 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.976466+0000", 2021-10-08T19:39:10.094 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1706000000000003e-05 2021-10-08T19:39:10.094 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.095 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.095 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:39:10.095 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.976475+0000", 2021-10-08T19:39:10.095 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.1109999999999997e-06 2021-10-08T19:39:10.096 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.096 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.096 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:39:10.096 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.976480+0000", 2021-10-08T19:39:10.096 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4729999999999999e-06 2021-10-08T19:39:10.097 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.097 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.097 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:39:10.097 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.976524+0000", 2021-10-08T19:39:10.097 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3442000000000002e-05 2021-10-08T19:39:10.098 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.099 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.099 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:39:10.099 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.976632+0000", 2021-10-08T19:39:10.099 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010795599999999999 2021-10-08T19:39:10.100 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:10.100 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:10.100 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5,6", 2021-10-08T19:39:10.100 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:09.976777+0000", 2021-10-08T19:39:10.101 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000145045 2021-10-08T19:39:10.101 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:10.101 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:10.101 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:10.101 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:10.102 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:39:10.102 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 8 2021-10-08T19:39:10.102 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:39:10.103 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:39:10.139 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:10.208 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:39:10.461 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:10.462 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:39:10.564 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:39:10.607 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:10 smithi097 ceph-mon[32687]: 2.13 scrub ok 2021-10-08T19:39:10.608 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:10 smithi097 ceph-mon[32687]: 2.8 scrub ok 2021-10-08T19:39:10.609 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:10 smithi097 ceph-mon[41966]: 2.13 scrub ok 2021-10-08T19:39:10.609 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:10 smithi097 ceph-mon[41966]: 2.8 scrub ok 2021-10-08T19:39:10.617 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:10.664 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 1 16 3073 3057 191.05 191.062 0.00543018 0.0052101 2021-10-08T19:39:10.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:10 smithi117 ceph-mon[34585]: 2.13 scrub ok 2021-10-08T19:39:10.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:10 smithi117 ceph-mon[34585]: 2.8 scrub ok 2021-10-08T19:39:11.667 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 2 16 6314 6298 196.678 202.562 0.00474709 0.0050703 2021-10-08T19:39:11.704 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset nodeep-scrub 2021-10-08T19:39:11.712 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:39:11.719 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:11.720 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:39:11.821 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:39:11.850 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:11 smithi117 ceph-mon[34585]: 2.18 scrub ok 2021-10-08T19:39:11.850 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:11 smithi117 ceph-mon[34585]: 2.5 scrub ok 2021-10-08T19:39:11.850 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:11 smithi117 ceph-mon[34585]: pgmap v891: 188 pgs: 188 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:39:11.851 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:11 smithi117 ceph-mon[34585]: 4.1 scrub ok 2021-10-08T19:39:11.851 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:11 smithi117 ceph-mon[34585]: 6.b scrub ok 2021-10-08T19:39:11.852 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:11.915 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:39:11.917 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:11.918 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:39:11.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:11 smithi097 ceph-mon[32687]: 2.18 scrub ok 2021-10-08T19:39:11.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:11 smithi097 ceph-mon[32687]: 2.5 scrub ok 2021-10-08T19:39:11.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:11 smithi097 ceph-mon[32687]: pgmap v891: 188 pgs: 188 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:39:11.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:11 smithi097 ceph-mon[32687]: 4.1 scrub ok 2021-10-08T19:39:11.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:11 smithi097 ceph-mon[32687]: 6.b scrub ok 2021-10-08T19:39:11.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:11 smithi097 ceph-mon[41966]: 2.18 scrub ok 2021-10-08T19:39:11.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:11 smithi097 ceph-mon[41966]: 2.5 scrub ok 2021-10-08T19:39:11.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:11 smithi097 ceph-mon[41966]: pgmap v891: 188 pgs: 188 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:39:11.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:11 smithi097 ceph-mon[41966]: 4.1 scrub ok 2021-10-08T19:39:11.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:11 smithi097 ceph-mon[41966]: 6.b scrub ok 2021-10-08T19:39:12.019 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:39:12.063 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:12.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:12 smithi117 ceph-mon[34585]: 2.22 scrub ok 2021-10-08T19:39:12.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:12 smithi117 ceph-mon[34585]: 3.16 scrub ok 2021-10-08T19:39:12.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:12 smithi117 ceph-mon[34585]: 2.20 scrub ok 2021-10-08T19:39:12.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:12 smithi117 ceph-mon[34585]: 5.a scrub ok 2021-10-08T19:39:12.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:12 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:39:12.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:12 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:39:12.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:12 smithi117 ceph-mon[34585]: 5.18 scrub ok 2021-10-08T19:39:12.658 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:39:12 smithi117 conmon[69189]: level=error ts=2021-10-08T19:39:12.314Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=1 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:39:12.666 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 3 16 8879 8863 184.557 160.312 0.00440921 0.00541119 2021-10-08T19:39:12.823 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2021-10-08T19:39:12.823 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:12 smithi097 ceph-mon[41966]: 2.22 scrub ok 2021-10-08T19:39:12.824 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:12 smithi097 ceph-mon[41966]: 3.16 scrub ok 2021-10-08T19:39:12.824 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:12 smithi097 ceph-mon[41966]: 2.20 scrub ok 2021-10-08T19:39:12.824 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:12 smithi097 ceph-mon[41966]: 5.a scrub ok 2021-10-08T19:39:12.824 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:12 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:39:12.825 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:12 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:39:12.825 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:12 smithi097 ceph-mon[41966]: 5.18 scrub ok 2021-10-08T19:39:12.825 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:12 smithi097 ceph-mon[32687]: 2.22 scrub ok 2021-10-08T19:39:12.826 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:12 smithi097 ceph-mon[32687]: 3.16 scrub ok 2021-10-08T19:39:12.826 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:12 smithi097 ceph-mon[32687]: 2.20 scrub ok 2021-10-08T19:39:12.826 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:12 smithi097 ceph-mon[32687]: 5.a scrub ok 2021-10-08T19:39:12.826 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:12 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:39:12.827 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:12 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:39:12.827 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:12 smithi097 ceph-mon[32687]: 5.18 scrub ok 2021-10-08T19:39:12.828 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:39:12 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:39:12] "GET /metrics HTTP/1.1" 200 155811 "" "Prometheus/2.18.1" 2021-10-08T19:39:12.950 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:39:12.959 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:12.960 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:39:13.043 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:39:13.062 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:39:13.094 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:13.153 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:39:13.156 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:13.158 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:39:13.260 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:39:13.334 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:13.508 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:39:13.513 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:13.514 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:39:13.615 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:39:13.667 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 4 16 11004 10988 171.622 132.812 0.0122723 0.00581861 2021-10-08T19:39:13.687 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:13.715 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:39:13.782 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:39:13.823 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:39:13.859 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:39:13.862 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:39:13.878 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:13.879 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:39:13.903 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:39:13.948 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:39:13.981 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:39:13.982 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:39:14.010 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:14.017 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:39:14.029 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'false' 2021-10-08T19:39:14.030 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'false' 2021-10-08T19:39:14.034 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'false' 2021-10-08T19:39:14.034 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'false' 2021-10-08T19:39:14.034 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'false' 2021-10-08T19:39:14.035 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'false' 2021-10-08T19:39:14.035 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'false' 2021-10-08T19:39:14.035 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'false' 2021-10-08T19:39:14.068 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:39:14.071 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:14.072 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:39:14.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:39:13 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:39:13] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:39:14.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:13 smithi117 ceph-mon[34585]: 2.27 scrub ok 2021-10-08T19:39:14.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:13 smithi117 ceph-mon[34585]: 1.3 scrub ok 2021-10-08T19:39:14.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:13 smithi117 ceph-mon[34585]: osdmap e438: 8 total, 8 up, 8 in 2021-10-08T19:39:14.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:13 smithi117 ceph-mon[34585]: pgmap v893: 188 pgs: 188 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-10-08T19:39:14.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:13 smithi117 ceph-mon[34585]: 4.1b scrub ok 2021-10-08T19:39:14.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:13 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2302217419' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:39:14.174 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:39:14.175 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:13 smithi097 ceph-mon[41966]: 2.27 scrub ok 2021-10-08T19:39:14.176 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:13 smithi097 ceph-mon[41966]: 1.3 scrub ok 2021-10-08T19:39:14.176 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:13 smithi097 ceph-mon[41966]: osdmap e438: 8 total, 8 up, 8 in 2021-10-08T19:39:14.176 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:13 smithi097 ceph-mon[41966]: pgmap v893: 188 pgs: 188 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-10-08T19:39:14.176 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:13 smithi097 ceph-mon[41966]: 4.1b scrub ok 2021-10-08T19:39:14.177 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:13 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2302217419' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:39:14.177 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:13 smithi097 ceph-mon[32687]: 2.27 scrub ok 2021-10-08T19:39:14.177 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:13 smithi097 ceph-mon[32687]: 1.3 scrub ok 2021-10-08T19:39:14.178 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:13 smithi097 ceph-mon[32687]: osdmap e438: 8 total, 8 up, 8 in 2021-10-08T19:39:14.178 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:13 smithi097 ceph-mon[32687]: pgmap v893: 188 pgs: 188 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-10-08T19:39:14.178 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:13 smithi097 ceph-mon[32687]: 4.1b scrub ok 2021-10-08T19:39:14.178 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:13 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2302217419' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:39:14.211 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:39:14.232 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:14.268 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:39:14.268 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:39:14.269 INFO:teuthology.orchestra.run.smithi097.stdout: "epoch": 438, 2021-10-08T19:39:14.269 INFO:teuthology.orchestra.run.smithi097.stdout: "fsid": "1d01f6d6-286c-11ec-8c25-001a4aab830c", 2021-10-08T19:39:14.269 INFO:teuthology.orchestra.run.smithi097.stdout: "created": "2021-10-08T19:16:25.258003+0000", 2021-10-08T19:39:14.269 INFO:teuthology.orchestra.run.smithi097.stdout: "modified": "2021-10-08T19:39:12.855119+0000", 2021-10-08T19:39:14.270 INFO:teuthology.orchestra.run.smithi097.stdout: "last_up_change": "2021-10-08T19:21:15.388758+0000", 2021-10-08T19:39:14.270 INFO:teuthology.orchestra.run.smithi097.stdout: "last_in_change": "2021-10-08T19:29:39.736986+0000", 2021-10-08T19:39:14.270 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-08T19:39:14.270 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_num": 5804032, 2021-10-08T19:39:14.271 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_set": [ 2021-10-08T19:39:14.271 INFO:teuthology.orchestra.run.smithi097.stdout: "nodeep-scrub", 2021-10-08T19:39:14.271 INFO:teuthology.orchestra.run.smithi097.stdout: "pglog_hardlimit", 2021-10-08T19:39:14.271 INFO:teuthology.orchestra.run.smithi097.stdout: "purged_snapdirs", 2021-10-08T19:39:14.271 INFO:teuthology.orchestra.run.smithi097.stdout: "recovery_deletes", 2021-10-08T19:39:14.272 INFO:teuthology.orchestra.run.smithi097.stdout: "sortbitwise" 2021-10-08T19:39:14.272 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:39:14.272 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_version": 18, 2021-10-08T19:39:14.272 INFO:teuthology.orchestra.run.smithi097.stdout: "full_ratio": 0.94999998807907104, 2021-10-08T19:39:14.272 INFO:teuthology.orchestra.run.smithi097.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-08T19:39:14.273 INFO:teuthology.orchestra.run.smithi097.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-08T19:39:14.273 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_snapshot": "", 2021-10-08T19:39:14.273 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_max": 11, 2021-10-08T19:39:14.273 INFO:teuthology.orchestra.run.smithi097.stdout: "max_osd": 8, 2021-10-08T19:39:14.273 INFO:teuthology.orchestra.run.smithi097.stdout: "require_min_compat_client": "luminous", 2021-10-08T19:39:14.274 INFO:teuthology.orchestra.run.smithi097.stdout: "min_compat_client": "luminous", 2021-10-08T19:39:14.274 INFO:teuthology.orchestra.run.smithi097.stdout: "require_osd_release": "quincy", 2021-10-08T19:39:14.274 INFO:teuthology.orchestra.run.smithi097.stdout: "pools": [ 2021-10-08T19:39:14.274 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.275 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 1, 2021-10-08T19:39:14.275 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": ".mgr", 2021-10-08T19:39:14.275 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:19:44.413311+0000", 2021-10-08T19:39:14.275 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:39:14.275 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:39:14.276 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:39:14.276 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:39:14.276 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:39:14.276 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:39:14.276 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:39:14.277 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:39:14.277 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:39:14.277 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:39:14.277 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:39:14.278 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:39:14.278 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 11, 2021-10-08T19:39:14.278 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 11, 2021-10-08T19:39:14.278 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 11, 2021-10-08T19:39:14.278 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 11, 2021-10-08T19:39:14.279 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 11, 2021-10-08T19:39:14.279 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:39:14.279 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:39:14.279 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:39:14.280 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:39:14.281 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:39:14.281 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:39:14.281 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:39:14.281 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.282 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "171", 2021-10-08T19:39:14.282 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:39:14.282 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:39:14.282 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "170", 2021-10-08T19:39:14.283 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:39:14.283 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:39:14.284 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:39:14.284 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:39:14.284 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:39:14.284 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:39:14.284 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:39:14.285 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:39:14.285 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:39:14.285 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:39:14.285 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:39:14.286 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:39:14.286 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:39:14.286 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:39:14.286 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:39:14.286 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:39:14.287 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:39:14.287 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:39:14.287 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:39:14.287 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:39:14.287 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:39:14.288 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:39:14.288 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:39:14.288 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.289 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:39:14.289 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:39:14.289 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:39:14.289 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:39:14.289 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:39:14.290 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:39:14.290 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:39:14.290 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:39:14.290 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:39:14.291 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:39:14.291 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:39:14.291 INFO:teuthology.orchestra.run.smithi097.stdout: "options": { 2021-10-08T19:39:14.291 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_min": 1 2021-10-08T19:39:14.291 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.292 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:39:14.292 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": {} 2021-10-08T19:39:14.292 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:14.292 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.292 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.293 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 2, 2021-10-08T19:39:14.293 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": ".rgw.root", 2021-10-08T19:39:14.293 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:21:21.940881+0000", 2021-10-08T19:39:14.293 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:39:14.293 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:39:14.294 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:39:14.294 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:39:14.294 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:39:14.294 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:39:14.295 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:39:14.295 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:39:14.295 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:39:14.295 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:39:14.295 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:39:14.296 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:39:14.296 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 42, 2021-10-08T19:39:14.296 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 42, 2021-10-08T19:39:14.296 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 42, 2021-10-08T19:39:14.296 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 42, 2021-10-08T19:39:14.297 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 42, 2021-10-08T19:39:14.297 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:39:14.297 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:39:14.297 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:39:14.297 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:39:14.298 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:39:14.298 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:39:14.298 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:39:14.298 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.299 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "393", 2021-10-08T19:39:14.299 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:39:14.299 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:39:14.299 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "391", 2021-10-08T19:39:14.299 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:39:14.300 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:39:14.300 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:39:14.300 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:39:14.300 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:39:14.300 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:39:14.301 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:39:14.301 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:39:14.301 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:39:14.301 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:39:14.301 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:39:14.302 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:39:14.302 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:39:14.302 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:39:14.302 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:39:14.303 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:39:14.303 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:39:14.303 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:39:14.303 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:39:14.303 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:39:14.304 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:39:14.304 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:39:14.304 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:39:14.304 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.304 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:39:14.305 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:39:14.305 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:39:14.305 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:39:14.305 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:39:14.305 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:39:14.306 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:39:14.306 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:39:14.306 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:39:14.307 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:39:14.307 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:39:14.307 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2021-10-08T19:39:14.307 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:39:14.307 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw": {} 2021-10-08T19:39:14.308 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:14.308 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.308 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.309 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 3, 2021-10-08T19:39:14.309 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "iscsi", 2021-10-08T19:39:14.309 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:21:22.536945+0000", 2021-10-08T19:39:14.310 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:39:14.310 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:39:14.310 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:39:14.310 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:39:14.310 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:39:14.311 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:39:14.311 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:39:14.311 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:39:14.311 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:39:14.312 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:39:14.312 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:39:14.312 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:39:14.312 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 23, 2021-10-08T19:39:14.312 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 23, 2021-10-08T19:39:14.313 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 23, 2021-10-08T19:39:14.313 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 23, 2021-10-08T19:39:14.313 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 23, 2021-10-08T19:39:14.313 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:39:14.313 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:39:14.314 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:39:14.314 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:39:14.314 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:39:14.314 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:39:14.315 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:39:14.315 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.315 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "132", 2021-10-08T19:39:14.315 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:39:14.315 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:39:14.316 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "131", 2021-10-08T19:39:14.316 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:39:14.316 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:39:14.316 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:39:14.316 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:39:14.317 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:39:14.317 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:39:14.317 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:39:14.317 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:39:14.318 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:39:14.318 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:39:14.318 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:39:14.318 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:39:14.318 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:39:14.319 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:39:14.319 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:39:14.319 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:39:14.319 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:39:14.320 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:39:14.320 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:39:14.320 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:39:14.320 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:39:14.320 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:39:14.321 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:39:14.321 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.321 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:39:14.321 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:39:14.322 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:39:14.322 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:39:14.322 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:39:14.322 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:39:14.322 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:39:14.323 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:39:14.323 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:39:14.323 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:39:14.323 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:39:14.323 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2021-10-08T19:39:14.324 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:39:14.324 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd": {} 2021-10-08T19:39:14.324 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:14.324 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.325 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.325 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 4, 2021-10-08T19:39:14.325 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "default.rgw.log", 2021-10-08T19:39:14.325 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:21:23.886328+0000", 2021-10-08T19:39:14.325 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:39:14.326 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:39:14.326 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:39:14.326 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:39:14.327 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:39:14.327 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:39:14.327 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:39:14.327 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:39:14.327 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:39:14.328 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:39:14.328 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:39:14.328 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:39:14.328 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 32, 2021-10-08T19:39:14.329 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 32, 2021-10-08T19:39:14.329 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 32, 2021-10-08T19:39:14.329 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 32, 2021-10-08T19:39:14.329 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 32, 2021-10-08T19:39:14.330 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:39:14.330 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:39:14.330 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:39:14.330 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:39:14.330 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:39:14.331 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:39:14.331 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:39:14.331 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.331 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "64", 2021-10-08T19:39:14.331 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:39:14.332 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:39:14.332 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2021-10-08T19:39:14.332 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:39:14.332 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:39:14.332 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:39:14.333 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:39:14.333 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:39:14.333 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:39:14.333 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:39:14.333 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:39:14.334 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:39:14.334 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:39:14.334 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:39:14.334 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:39:14.335 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:39:14.335 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:39:14.335 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:39:14.335 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:39:14.335 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:39:14.336 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:39:14.336 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:39:14.336 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:39:14.336 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:39:14.337 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:39:14.337 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:39:14.337 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.337 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:39:14.337 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:39:14.338 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:39:14.338 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:39:14.338 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:39:14.338 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:39:14.339 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:39:14.339 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:39:14.339 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:39:14.339 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:39:14.339 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:39:14.340 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2021-10-08T19:39:14.340 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:39:14.340 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw": {} 2021-10-08T19:39:14.340 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:14.340 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.341 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.341 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 5, 2021-10-08T19:39:14.341 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "default.rgw.control", 2021-10-08T19:39:14.341 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:21:25.865032+0000", 2021-10-08T19:39:14.341 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:39:14.342 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:39:14.342 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:39:14.342 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:39:14.342 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:39:14.343 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:39:14.343 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:39:14.343 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:39:14.343 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:39:14.343 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:39:14.344 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:39:14.344 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:39:14.344 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 32, 2021-10-08T19:39:14.344 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 32, 2021-10-08T19:39:14.344 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 32, 2021-10-08T19:39:14.345 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 32, 2021-10-08T19:39:14.345 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 32, 2021-10-08T19:39:14.345 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:39:14.345 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:39:14.345 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:39:14.346 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:39:14.346 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:39:14.346 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:39:14.346 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:39:14.347 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.347 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "66", 2021-10-08T19:39:14.347 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:39:14.347 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:39:14.347 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2021-10-08T19:39:14.348 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:39:14.348 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:39:14.348 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:39:14.348 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:39:14.348 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:39:14.349 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:39:14.349 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:39:14.349 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:39:14.349 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:39:14.349 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:39:14.350 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:39:14.350 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:39:14.350 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:39:14.350 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:39:14.350 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:39:14.351 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:39:14.351 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:39:14.351 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:39:14.351 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:39:14.351 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:39:14.352 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:39:14.352 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:39:14.352 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:39:14.352 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.352 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:39:14.353 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:39:14.353 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:39:14.353 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:39:14.353 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:39:14.354 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:39:14.354 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:39:14.354 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:39:14.354 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:39:14.354 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:39:14.355 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:39:14.355 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2021-10-08T19:39:14.355 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:39:14.355 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw": {} 2021-10-08T19:39:14.355 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:14.356 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.356 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.356 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 6, 2021-10-08T19:39:14.356 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "default.rgw.meta", 2021-10-08T19:39:14.356 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:21:27.940767+0000", 2021-10-08T19:39:14.357 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:39:14.357 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:39:14.357 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:39:14.357 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:39:14.357 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:39:14.358 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:39:14.358 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:39:14.358 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:39:14.358 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:39:14.359 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:39:14.359 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:39:14.359 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:39:14.359 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 32, 2021-10-08T19:39:14.360 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 32, 2021-10-08T19:39:14.360 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 32, 2021-10-08T19:39:14.360 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 32, 2021-10-08T19:39:14.360 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 32, 2021-10-08T19:39:14.361 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:39:14.361 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:39:14.368 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:39:14.368 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:39:14.369 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:39:14.369 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:39:14.369 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:39:14.369 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.369 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "350", 2021-10-08T19:39:14.370 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:39:14.370 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:39:14.370 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2021-10-08T19:39:14.370 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:39:14.370 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:39:14.371 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:39:14.371 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:39:14.371 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:39:14.371 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:39:14.371 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:39:14.372 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:39:14.372 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:39:14.372 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:39:14.372 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:39:14.373 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:39:14.373 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:39:14.373 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:39:14.373 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:39:14.373 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:39:14.374 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:39:14.374 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:39:14.374 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:39:14.374 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:39:14.374 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:39:14.375 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:39:14.375 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:39:14.375 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.375 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:39:14.375 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:39:14.376 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:39:14.376 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:39:14.376 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:39:14.376 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:39:14.376 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:39:14.377 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:39:14.377 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:39:14.377 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:39:14.377 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:39:14.377 INFO:teuthology.orchestra.run.smithi097.stdout: "options": { 2021-10-08T19:39:14.378 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_bias": 4, 2021-10-08T19:39:14.378 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_min": 8 2021-10-08T19:39:14.378 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.378 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:39:14.379 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw": {} 2021-10-08T19:39:14.379 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:14.379 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.379 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.379 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 11, 2021-10-08T19:39:14.380 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "unique_pool_4", 2021-10-08T19:39:14.380 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:39:02.796147+0000", 2021-10-08T19:39:14.380 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:39:14.380 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:39:14.380 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:39:14.381 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:39:14.381 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:39:14.381 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:39:14.381 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:39:14.381 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:39:14.382 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:39:14.382 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:39:14.382 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:39:14.382 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:39:14.383 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 16, 2021-10-08T19:39:14.383 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 16, 2021-10-08T19:39:14.383 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 16, 2021-10-08T19:39:14.383 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 16, 2021-10-08T19:39:14.383 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 16, 2021-10-08T19:39:14.384 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:39:14.384 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:39:14.384 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:39:14.385 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:39:14.385 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:39:14.385 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:39:14.385 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:39:14.385 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.386 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "436", 2021-10-08T19:39:14.386 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:39:14.386 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:39:14.386 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2021-10-08T19:39:14.386 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:39:14.387 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:39:14.387 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:39:14.387 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:39:14.387 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:39:14.388 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:39:14.388 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:39:14.388 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:39:14.388 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:39:14.388 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:39:14.389 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:39:14.389 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:39:14.389 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:39:14.389 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:39:14.389 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:39:14.390 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:39:14.390 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:39:14.390 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:39:14.390 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:39:14.391 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:39:14.391 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:39:14.391 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:39:14.391 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:39:14.391 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.392 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:39:14.392 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:39:14.392 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:39:14.392 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:39:14.392 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:39:14.393 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:39:14.393 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:39:14.393 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:39:14.393 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:39:14.393 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:39:14.394 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:39:14.394 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2021-10-08T19:39:14.394 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:39:14.394 INFO:teuthology.orchestra.run.smithi097.stdout: "rados": {} 2021-10-08T19:39:14.394 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:14.395 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:14.395 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:39:14.395 INFO:teuthology.orchestra.run.smithi097.stdout: "osds": [ 2021-10-08T19:39:14.395 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.396 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 0, 2021-10-08T19:39:14.396 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "9e64e714-a5d5-4fbb-ae2b-1df4bf14b8e0", 2021-10-08T19:39:14.396 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:39:14.396 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:39:14.396 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:39:14.397 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:39:14.397 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:39:14.397 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:39:14.397 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 8, 2021-10-08T19:39:14.397 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 433, 2021-10-08T19:39:14.398 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:39:14.398 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:39:14.398 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:39:14.398 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:39:14.398 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.399 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:39:14.399 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6801", 2021-10-08T19:39:14.399 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3354161282 2021-10-08T19:39:14.399 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:14.400 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:14.400 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.400 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:39:14.400 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:39:14.400 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.401 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:39:14.401 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6802", 2021-10-08T19:39:14.401 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3354161282 2021-10-08T19:39:14.402 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:14.402 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:14.402 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.402 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:39:14.402 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:39:14.403 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.403 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:39:14.403 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6804", 2021-10-08T19:39:14.403 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3354161282 2021-10-08T19:39:14.403 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:14.404 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:14.404 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.404 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:39:14.405 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:39:14.405 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.405 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:39:14.405 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6803", 2021-10-08T19:39:14.405 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3354161282 2021-10-08T19:39:14.406 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:14.406 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:14.406 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.406 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.97:6801/3354161282", 2021-10-08T19:39:14.407 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.97:6802/3354161282", 2021-10-08T19:39:14.407 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.97:6804/3354161282", 2021-10-08T19:39:14.407 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.97:6803/3354161282", 2021-10-08T19:39:14.407 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:39:14.408 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:39:14.408 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:39:14.408 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:14.408 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.408 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.409 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 1, 2021-10-08T19:39:14.409 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "32602a22-f263-4b62-a8d8-50fddfb73fa8", 2021-10-08T19:39:14.410 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:39:14.410 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:39:14.410 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:39:14.410 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:39:14.410 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:39:14.411 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:39:14.411 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 13, 2021-10-08T19:39:14.411 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 433, 2021-10-08T19:39:14.411 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:39:14.411 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:39:14.412 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:39:14.412 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:39:14.412 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.412 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:39:14.412 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6805", 2021-10-08T19:39:14.413 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 735799205 2021-10-08T19:39:14.413 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:14.413 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:14.413 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.413 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:39:14.414 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:39:14.414 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.414 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:39:14.415 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6806", 2021-10-08T19:39:14.415 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 735799205 2021-10-08T19:39:14.415 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:14.415 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:14.415 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.416 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:39:14.416 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:39:14.416 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.416 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:39:14.416 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6808", 2021-10-08T19:39:14.417 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 735799205 2021-10-08T19:39:14.417 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:14.417 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:14.417 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.418 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:39:14.418 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:39:14.418 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.418 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:39:14.418 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6807", 2021-10-08T19:39:14.419 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 735799205 2021-10-08T19:39:14.419 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:14.419 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:14.419 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.419 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.97:6805/735799205", 2021-10-08T19:39:14.420 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.97:6806/735799205", 2021-10-08T19:39:14.420 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.97:6808/735799205", 2021-10-08T19:39:14.420 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.97:6807/735799205", 2021-10-08T19:39:14.420 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:39:14.420 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:39:14.421 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:39:14.421 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:14.421 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.421 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.421 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 2, 2021-10-08T19:39:14.422 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "88e0e4a2-b4a3-4a00-8669-03c3d9b166c5", 2021-10-08T19:39:14.422 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:39:14.422 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:39:14.422 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:39:14.422 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:39:14.423 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:39:14.423 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:39:14.423 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 18, 2021-10-08T19:39:14.423 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 433, 2021-10-08T19:39:14.424 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:39:14.424 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:39:14.424 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:39:14.424 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:39:14.424 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.425 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:39:14.425 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6809", 2021-10-08T19:39:14.425 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2366482649 2021-10-08T19:39:14.425 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:14.425 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:14.426 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.426 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:39:14.426 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:39:14.426 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.427 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:39:14.427 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6810", 2021-10-08T19:39:14.427 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2366482649 2021-10-08T19:39:14.427 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:14.427 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:14.428 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.428 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:39:14.428 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:39:14.428 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.428 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:39:14.429 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6812", 2021-10-08T19:39:14.429 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2366482649 2021-10-08T19:39:14.429 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:14.429 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:14.430 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.430 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:39:14.430 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:39:14.430 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.431 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:39:14.431 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6811", 2021-10-08T19:39:14.431 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2366482649 2021-10-08T19:39:14.431 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:14.431 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:14.432 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.432 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.97:6809/2366482649", 2021-10-08T19:39:14.432 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.97:6810/2366482649", 2021-10-08T19:39:14.432 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.97:6812/2366482649", 2021-10-08T19:39:14.432 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.97:6811/2366482649", 2021-10-08T19:39:14.433 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:39:14.433 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:39:14.433 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:39:14.433 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:14.434 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.434 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.434 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 3, 2021-10-08T19:39:14.434 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "e689d708-b501-4526-a31a-1e598b74654d", 2021-10-08T19:39:14.434 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:39:14.435 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:39:14.435 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:39:14.435 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:39:14.435 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:39:14.436 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:39:14.436 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 24, 2021-10-08T19:39:14.436 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 433, 2021-10-08T19:39:14.436 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:39:14.436 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:39:14.437 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:39:14.437 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:39:14.437 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.437 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:39:14.438 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6813", 2021-10-08T19:39:14.438 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3191181122 2021-10-08T19:39:14.438 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:14.438 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:14.438 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.439 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:39:14.439 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:39:14.439 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.439 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:39:14.439 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6814", 2021-10-08T19:39:14.440 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3191181122 2021-10-08T19:39:14.440 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:14.440 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:14.440 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.441 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:39:14.441 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:39:14.441 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.441 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:39:14.441 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6816", 2021-10-08T19:39:14.442 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3191181122 2021-10-08T19:39:14.442 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:14.442 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:14.442 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.442 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:39:14.443 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:39:14.443 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.443 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:39:14.443 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6815", 2021-10-08T19:39:14.443 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3191181122 2021-10-08T19:39:14.444 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:14.444 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:14.444 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.444 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.97:6813/3191181122", 2021-10-08T19:39:14.444 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.97:6814/3191181122", 2021-10-08T19:39:14.445 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.97:6816/3191181122", 2021-10-08T19:39:14.445 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.97:6815/3191181122", 2021-10-08T19:39:14.445 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:39:14.445 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:39:14.445 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:39:14.446 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:14.446 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.446 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.446 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 4, 2021-10-08T19:39:14.447 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "67e4730a-be1c-4d88-9307-e3c2cf3ab2ef", 2021-10-08T19:39:14.447 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:39:14.447 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:39:14.447 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:39:14.447 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:39:14.448 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:39:14.448 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:39:14.448 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 30, 2021-10-08T19:39:14.448 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 433, 2021-10-08T19:39:14.448 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:39:14.449 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:39:14.449 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:39:14.449 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:39:14.449 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.450 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:39:14.450 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6800", 2021-10-08T19:39:14.450 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 106778208 2021-10-08T19:39:14.450 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:14.450 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:14.451 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.451 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:39:14.451 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:39:14.451 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.452 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:39:14.452 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6801", 2021-10-08T19:39:14.452 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 106778208 2021-10-08T19:39:14.452 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:14.452 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:14.453 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.453 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:39:14.453 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:39:14.453 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.454 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:39:14.454 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6803", 2021-10-08T19:39:14.454 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 106778208 2021-10-08T19:39:14.454 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:14.454 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:14.455 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.455 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:39:14.455 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:39:14.455 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.456 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:39:14.456 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6802", 2021-10-08T19:39:14.456 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 106778208 2021-10-08T19:39:14.456 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:14.456 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:14.457 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.457 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.117:6800/106778208", 2021-10-08T19:39:14.457 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.117:6801/106778208", 2021-10-08T19:39:14.457 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.117:6803/106778208", 2021-10-08T19:39:14.458 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.117:6802/106778208", 2021-10-08T19:39:14.458 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:39:14.458 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:39:14.458 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:39:14.458 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:14.459 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.459 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.459 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 5, 2021-10-08T19:39:14.459 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "f9fd3153-3e4e-4489-8927-a65641f05d42", 2021-10-08T19:39:14.459 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:39:14.460 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:39:14.460 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:39:14.460 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 0.2890472412109375, 2021-10-08T19:39:14.460 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:39:14.460 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:39:14.461 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 38, 2021-10-08T19:39:14.461 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 391, 2021-10-08T19:39:14.461 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:39:14.461 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:39:14.461 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:39:14.462 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:39:14.462 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.464 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:39:14.464 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6804", 2021-10-08T19:39:14.464 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3199889891 2021-10-08T19:39:14.464 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:14.465 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:14.465 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.465 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:39:14.465 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:39:14.465 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.466 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:39:14.466 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6805", 2021-10-08T19:39:14.466 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3199889891 2021-10-08T19:39:14.466 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:14.466 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:14.467 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.467 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:39:14.467 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:39:14.467 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.468 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:39:14.468 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6807", 2021-10-08T19:39:14.468 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3199889891 2021-10-08T19:39:14.468 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:14.468 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:14.469 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.469 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:39:14.469 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:39:14.469 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.469 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:39:14.470 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6806", 2021-10-08T19:39:14.470 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3199889891 2021-10-08T19:39:14.470 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:14.470 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:14.470 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.471 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.117:6804/3199889891", 2021-10-08T19:39:14.471 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.117:6805/3199889891", 2021-10-08T19:39:14.471 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.117:6807/3199889891", 2021-10-08T19:39:14.471 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.117:6806/3199889891", 2021-10-08T19:39:14.471 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:39:14.472 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:39:14.472 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:39:14.472 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:14.472 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.472 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.473 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 6, 2021-10-08T19:39:14.473 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "84898f12-c37d-4eb6-8b71-5b86bfe16e7d", 2021-10-08T19:39:14.473 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:39:14.473 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:39:14.474 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:39:14.474 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:39:14.474 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:39:14.474 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:39:14.474 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 47, 2021-10-08T19:39:14.475 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 433, 2021-10-08T19:39:14.475 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:39:14.475 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:39:14.475 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:39:14.475 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:39:14.476 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.476 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:39:14.476 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6808", 2021-10-08T19:39:14.476 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2185843951 2021-10-08T19:39:14.476 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:14.477 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:14.477 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.477 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:39:14.477 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:39:14.477 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.478 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:39:14.478 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6809", 2021-10-08T19:39:14.478 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2185843951 2021-10-08T19:39:14.478 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:14.478 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:14.479 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.479 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:39:14.479 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:39:14.479 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.480 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:39:14.480 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6811", 2021-10-08T19:39:14.480 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2185843951 2021-10-08T19:39:14.480 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:14.480 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:14.481 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.481 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:39:14.481 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:39:14.481 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.481 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:39:14.482 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6810", 2021-10-08T19:39:14.482 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2185843951 2021-10-08T19:39:14.482 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:14.482 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:14.482 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.483 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.117:6808/2185843951", 2021-10-08T19:39:14.483 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.117:6809/2185843951", 2021-10-08T19:39:14.483 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.117:6811/2185843951", 2021-10-08T19:39:14.483 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.117:6810/2185843951", 2021-10-08T19:39:14.483 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:39:14.484 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:39:14.484 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:39:14.484 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:14.484 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.485 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.485 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 7, 2021-10-08T19:39:14.485 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "529af2ce-2ae9-41ed-8c8e-d133628cfd20", 2021-10-08T19:39:14.485 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:39:14.485 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:39:14.486 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:39:14.486 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:39:14.486 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:39:14.486 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:39:14.487 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 55, 2021-10-08T19:39:14.487 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 433, 2021-10-08T19:39:14.487 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:39:14.487 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:39:14.487 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:39:14.488 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:39:14.488 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.488 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:39:14.488 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6812", 2021-10-08T19:39:14.488 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2817683239 2021-10-08T19:39:14.489 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:14.489 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:14.489 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.489 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:39:14.489 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:39:14.490 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.490 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:39:14.490 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6813", 2021-10-08T19:39:14.490 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2817683239 2021-10-08T19:39:14.490 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:14.491 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:14.491 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.491 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:39:14.491 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:39:14.492 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.492 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:39:14.492 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6815", 2021-10-08T19:39:14.492 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2817683239 2021-10-08T19:39:14.492 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:14.493 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:14.493 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.493 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:39:14.493 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:39:14.493 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.494 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:39:14.494 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6814", 2021-10-08T19:39:14.494 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2817683239 2021-10-08T19:39:14.494 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:14.494 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:14.495 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.495 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.117:6812/2817683239", 2021-10-08T19:39:14.495 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.117:6813/2817683239", 2021-10-08T19:39:14.495 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.117:6815/2817683239", 2021-10-08T19:39:14.496 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.117:6814/2817683239", 2021-10-08T19:39:14.496 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:39:14.496 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:39:14.496 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:39:14.497 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:14.497 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:14.497 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:39:14.497 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_xinfo": [ 2021-10-08T19:39:14.497 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.498 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 0, 2021-10-08T19:39:14.498 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:39:14.498 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:39:14.498 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:39:14.498 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:39:14.499 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:39:14.499 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:38:01.696541+0000", 2021-10-08T19:39:14.499 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:39:14.499 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.500 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.500 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 1, 2021-10-08T19:39:14.500 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:39:14.500 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:39:14.500 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:39:14.501 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:39:14.501 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:39:14.501 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:38:47.566027+0000", 2021-10-08T19:39:14.501 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:39:14.501 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.502 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.502 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 2, 2021-10-08T19:39:14.502 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:39:14.502 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:39:14.502 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:39:14.503 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:39:14.503 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:39:14.503 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:37:58.050910+0000", 2021-10-08T19:39:14.503 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:39:14.503 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.504 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.504 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 3, 2021-10-08T19:39:14.504 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:39:14.504 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:39:14.504 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:39:14.505 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:39:14.505 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:39:14.505 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:38:00.075922+0000", 2021-10-08T19:39:14.505 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:39:14.506 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.506 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.506 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 4, 2021-10-08T19:39:14.506 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:39:14.506 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:39:14.507 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:39:14.507 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:39:14.507 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:39:14.508 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:39:11.950770+0000", 2021-10-08T19:39:14.508 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:39:14.508 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.508 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.508 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 5, 2021-10-08T19:39:14.509 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:39:14.509 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:39:14.509 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:39:14.509 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:39:14.509 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:39:14.510 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:38:17.656213+0000", 2021-10-08T19:39:14.510 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:39:14.510 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.510 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.511 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 6, 2021-10-08T19:39:14.511 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:39:14.511 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:39:14.511 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:39:14.511 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:39:14.512 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:39:14.512 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:38:21.529127+0000", 2021-10-08T19:39:14.512 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:39:14.512 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.513 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.513 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 7, 2021-10-08T19:39:14.513 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:39:14.513 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:39:14.513 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:39:14.514 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:39:14.514 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:39:14.514 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:38:45.288856+0000", 2021-10-08T19:39:14.514 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:39:14.514 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:14.515 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:39:14.515 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_upmap": [], 2021-10-08T19:39:14.515 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_upmap_items": [ 2021-10-08T19:39:14.515 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.515 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "2.0", 2021-10-08T19:39:14.516 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:39:14.516 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.516 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 7, 2021-10-08T19:39:14.516 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 2 2021-10-08T19:39:14.517 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:14.517 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:14.517 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.517 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.517 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "2.3", 2021-10-08T19:39:14.518 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:39:14.518 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.518 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 7, 2021-10-08T19:39:14.518 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 4 2021-10-08T19:39:14.519 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:14.519 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:14.519 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.519 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.520 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "2.7", 2021-10-08T19:39:14.520 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:39:14.520 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.520 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 7, 2021-10-08T19:39:14.520 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 1 2021-10-08T19:39:14.521 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:14.521 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:14.521 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.521 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.521 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "2.1a", 2021-10-08T19:39:14.522 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:39:14.522 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.522 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 7, 2021-10-08T19:39:14.522 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 2 2021-10-08T19:39:14.522 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:14.523 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:14.523 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.523 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.523 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "2.29", 2021-10-08T19:39:14.523 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:39:14.524 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.524 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 7, 2021-10-08T19:39:14.524 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 2 2021-10-08T19:39:14.524 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:14.525 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:14.525 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.525 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.525 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "4.6", 2021-10-08T19:39:14.525 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:39:14.526 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.526 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 1, 2021-10-08T19:39:14.526 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 5 2021-10-08T19:39:14.526 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:14.526 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:14.527 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.527 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.527 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "4.f", 2021-10-08T19:39:14.528 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:39:14.528 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.528 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 1, 2021-10-08T19:39:14.528 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 2 2021-10-08T19:39:14.529 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:14.529 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:14.529 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.529 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.529 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "4.10", 2021-10-08T19:39:14.530 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:39:14.530 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.530 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 1, 2021-10-08T19:39:14.530 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 2 2021-10-08T19:39:14.531 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:14.531 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:14.531 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.531 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.531 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "5.19", 2021-10-08T19:39:14.532 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:39:14.532 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:14.532 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 5, 2021-10-08T19:39:14.532 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 7 2021-10-08T19:39:14.532 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:14.533 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:14.533 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:14.533 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:39:14.533 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_temp": [], 2021-10-08T19:39:14.534 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_temp": [], 2021-10-08T19:39:14.534 INFO:teuthology.orchestra.run.smithi097.stdout: "blocklist": { 2021-10-08T19:39:14.534 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/2600364788": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:39:14.534 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/4129083289": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:39:14.534 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/1443158975": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:39:14.535 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/2472640384": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:39:14.535 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/3196919488": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:39:14.535 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:6800/3195862546": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:39:14.535 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:6800/3931202434": "2021-10-09T19:17:10.051948+0000", 2021-10-08T19:39:14.535 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/2761595213": "2021-10-09T19:17:10.051948+0000", 2021-10-08T19:39:14.536 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/900681504": "2021-10-09T19:17:10.051948+0000", 2021-10-08T19:39:14.536 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/3932251406": "2021-10-09T19:17:10.051948+0000", 2021-10-08T19:39:14.536 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/398006785": "2021-10-09T19:16:48.651177+0000", 2021-10-08T19:39:14.536 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/1642570050": "2021-10-09T19:16:48.651177+0000", 2021-10-08T19:39:14.536 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/300178790": "2021-10-09T19:16:48.651177+0000", 2021-10-08T19:39:14.537 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:6800/845999767": "2021-10-09T19:16:48.651177+0000" 2021-10-08T19:39:14.537 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.537 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profiles": { 2021-10-08T19:39:14.537 INFO:teuthology.orchestra.run.smithi097.stdout: "default": { 2021-10-08T19:39:14.537 INFO:teuthology.orchestra.run.smithi097.stdout: "crush-failure-domain": "osd", 2021-10-08T19:39:14.538 INFO:teuthology.orchestra.run.smithi097.stdout: "k": "2", 2021-10-08T19:39:14.538 INFO:teuthology.orchestra.run.smithi097.stdout: "m": "1", 2021-10-08T19:39:14.538 INFO:teuthology.orchestra.run.smithi097.stdout: "plugin": "jerasure", 2021-10-08T19:39:14.538 INFO:teuthology.orchestra.run.smithi097.stdout: "technique": "reed_sol_van" 2021-10-08T19:39:14.539 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:14.539 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:14.539 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps_queue": [], 2021-10-08T19:39:14.539 INFO:teuthology.orchestra.run.smithi097.stdout: "new_removed_snaps": [], 2021-10-08T19:39:14.539 INFO:teuthology.orchestra.run.smithi097.stdout: "new_purged_snaps": [], 2021-10-08T19:39:14.540 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_node_flags": {}, 2021-10-08T19:39:14.540 INFO:teuthology.orchestra.run.smithi097.stdout: "device_class_flags": {}, 2021-10-08T19:39:14.540 INFO:teuthology.orchestra.run.smithi097.stdout: "stretch_mode": { 2021-10-08T19:39:14.540 INFO:teuthology.orchestra.run.smithi097.stdout: "stretch_mode_enabled": false, 2021-10-08T19:39:14.540 INFO:teuthology.orchestra.run.smithi097.stdout: "stretch_bucket_count": 0, 2021-10-08T19:39:14.541 INFO:teuthology.orchestra.run.smithi097.stdout: "degraded_stretch_mode": 0, 2021-10-08T19:39:14.541 INFO:teuthology.orchestra.run.smithi097.stdout: "recovering_stretch_mode": 0, 2021-10-08T19:39:14.541 INFO:teuthology.orchestra.run.smithi097.stdout: "stretch_mode_bucket": 0 2021-10-08T19:39:14.541 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:14.542 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:39:14.668 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 5 16 13082 13066 163.225 129.875 0.0034711 0.00611982 2021-10-08T19:39:15.104 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:39:15.106 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:15.107 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:39:15.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:14 smithi117 ceph-mon[34585]: 5.1f scrub ok 2021-10-08T19:39:15.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:14 smithi117 ceph-mon[34585]: 6.1f scrub ok 2021-10-08T19:39:15.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:14 smithi117 ceph-mon[34585]: 2.26 scrub ok 2021-10-08T19:39:15.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:14 smithi117 ceph-mon[34585]: 2.1b scrub ok 2021-10-08T19:39:15.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:14 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1333351315' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2021-10-08T19:39:15.207 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:39:15.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:14 smithi097 ceph-mon[41966]: 5.1f scrub ok 2021-10-08T19:39:15.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:14 smithi097 ceph-mon[41966]: 6.1f scrub ok 2021-10-08T19:39:15.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:14 smithi097 ceph-mon[41966]: 2.26 scrub ok 2021-10-08T19:39:15.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:14 smithi097 ceph-mon[41966]: 2.1b scrub ok 2021-10-08T19:39:15.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:14 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1333351315' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2021-10-08T19:39:15.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:14 smithi097 ceph-mon[32687]: 5.1f scrub ok 2021-10-08T19:39:15.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:14 smithi097 ceph-mon[32687]: 6.1f scrub ok 2021-10-08T19:39:15.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:14 smithi097 ceph-mon[32687]: 2.26 scrub ok 2021-10-08T19:39:15.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:14 smithi097 ceph-mon[32687]: 2.1b scrub ok 2021-10-08T19:39:15.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:14 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1333351315' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2021-10-08T19:39:15.255 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:15.670 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 6 16 15704 15688 163.329 163.875 0.00176129 0.00609031 2021-10-08T19:39:16.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:15 smithi097 ceph-mon[32687]: 2.7 scrub ok 2021-10-08T19:39:16.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:15 smithi097 ceph-mon[32687]: pgmap v894: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 721 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 966 B/s rd, 97 MiB/s wr, 1.55k op/s 2021-10-08T19:39:16.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:15 smithi097 ceph-mon[32687]: 2.21 scrub ok 2021-10-08T19:39:16.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:15 smithi097 ceph-mon[32687]: 4.b scrub ok 2021-10-08T19:39:16.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:15 smithi097 ceph-mon[41966]: 2.7 scrub ok 2021-10-08T19:39:16.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:15 smithi097 ceph-mon[41966]: pgmap v894: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 721 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 966 B/s rd, 97 MiB/s wr, 1.55k op/s 2021-10-08T19:39:16.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:15 smithi097 ceph-mon[41966]: 2.21 scrub ok 2021-10-08T19:39:16.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:15 smithi097 ceph-mon[41966]: 4.b scrub ok 2021-10-08T19:39:16.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:15 smithi117 ceph-mon[34585]: 2.7 scrub ok 2021-10-08T19:39:16.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:15 smithi117 ceph-mon[34585]: pgmap v894: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 721 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 966 B/s rd, 97 MiB/s wr, 1.55k op/s 2021-10-08T19:39:16.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:15 smithi117 ceph-mon[34585]: 2.21 scrub ok 2021-10-08T19:39:16.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:15 smithi117 ceph-mon[34585]: 4.b scrub ok 2021-10-08T19:39:16.669 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 7 16 18114 18098 161.513 150.625 0.0030773 0.00618447 2021-10-08T19:39:17.212 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:16 smithi117 ceph-mon[34585]: 2.29 scrub ok 2021-10-08T19:39:17.213 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:16 smithi117 ceph-mon[34585]: 1.0 scrub ok 2021-10-08T19:39:17.213 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:16 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:39:17.213 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:16 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:39:17.213 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:16 smithi117 ceph-mon[34585]: osdmap e439: 8 total, 8 up, 8 in 2021-10-08T19:39:17.213 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:16 smithi117 ceph-mon[34585]: 4.1e scrub ok 2021-10-08T19:39:17.214 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:39:17 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:39:17.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:16 smithi097 ceph-mon[32687]: 2.29 scrub ok 2021-10-08T19:39:17.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:16 smithi097 ceph-mon[32687]: 1.0 scrub ok 2021-10-08T19:39:17.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:16 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:39:17.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:16 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:39:17.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:16 smithi097 ceph-mon[32687]: osdmap e439: 8 total, 8 up, 8 in 2021-10-08T19:39:17.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:16 smithi097 ceph-mon[32687]: 4.1e scrub ok 2021-10-08T19:39:17.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:16 smithi097 ceph-mon[41966]: 2.29 scrub ok 2021-10-08T19:39:17.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:16 smithi097 ceph-mon[41966]: 1.0 scrub ok 2021-10-08T19:39:17.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:16 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:39:17.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:16 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:39:17.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:16 smithi097 ceph-mon[41966]: osdmap e439: 8 total, 8 up, 8 in 2021-10-08T19:39:17.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:16 smithi097 ceph-mon[41966]: 4.1e scrub ok 2021-10-08T19:39:17.622 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:39:17.657 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:17.658 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:39:17.668 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 8 15 19716 19701 153.85 100.188 0.00252876 0.00649182 2021-10-08T19:39:17.760 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:39:17.814 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:17.933 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:17 smithi097 ceph-mon[32687]: 2.14 scrub ok 2021-10-08T19:39:17.934 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:17 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:39:17.934 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:17 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:39:17.934 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:17 smithi097 ceph-mon[32687]: osdmap e440: 8 total, 8 up, 8 in 2021-10-08T19:39:17.934 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:17 smithi097 ceph-mon[32687]: pgmap v897: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 721 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 341 B/s rd, 120 MiB/s wr, 1.92k op/s 2021-10-08T19:39:17.935 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:17 smithi097 ceph-mon[32687]: 4.13 scrub ok 2021-10-08T19:39:17.935 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:17 smithi097 ceph-mon[32687]: 6.0 scrub ok 2021-10-08T19:39:17.935 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:17 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:39:18.028 INFO:tasks.thrashosds.thrasher:j is {'epoch': 438, 'fsid': '1d01f6d6-286c-11ec-8c25-001a4aab830c', 'created': '2021-10-08T19:16:25.258003+0000', 'modified': '2021-10-08T19:39:12.855119+0000', 'last_up_change': '2021-10-08T19:21:15.388758+0000', 'last_in_change': '2021-10-08T19:29:39.736986+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 18, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 11, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'quincy', 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2021-10-08T19:19:44.413311+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 11, 'pg_placement_num': 11, 'pg_placement_num_target': 11, 'pg_num_target': 11, 'pg_num_pending': 11, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '171', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '170', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': '.rgw.root', 'create_time': '2021-10-08T19:21:21.940881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 42, 'pg_placement_num': 42, 'pg_placement_num_target': 42, 'pg_num_target': 42, 'pg_num_pending': 42, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '393', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '391', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 3, 'pool_name': 'iscsi', 'create_time': '2021-10-08T19:21:22.536945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 23, 'pg_placement_num': 23, 'pg_placement_num_target': 23, 'pg_num_target': 23, 'pg_num_pending': 23, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '132', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '131', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 4, 'pool_name': 'default.rgw.log', 'create_time': '2021-10-08T19:21:23.886328+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 5, 'pool_name': 'default.rgw.control', 'create_time': '2021-10-08T19:21:25.865032+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 6, 'pool_name': 'default.rgw.meta', 'create_time': '2021-10-08T19:21:27.940767+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '350', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 8}, 'application_metadata': {'rgw': {}}}, {'pool': 11, 'pool_name': 'unique_pool_4', 'create_time': '2021-10-08T19:39:02.796147+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '436', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}], 'osds': [{'osd': 0, 'uuid': '9e64e714-a5d5-4fbb-ae2b-1df4bf14b8e0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 433, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6801', 'nonce': 3354161282}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6802', 'nonce': 3354161282}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6804', 'nonce': 3354161282}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6803', 'nonce': 3354161282}]}, 'public_addr': '172.21.15.97:6801/3354161282', 'cluster_addr': '172.21.15.97:6802/3354161282', 'heartbeat_back_addr': '172.21.15.97:6804/3354161282', 'heartbeat_front_addr': '172.21.15.97:6803/3354161282', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '32602a22-f263-4b62-a8d8-50fddfb73fa8', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 433, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6805', 'nonce': 735799205}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6806', 'nonce': 735799205}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6808', 'nonce': 735799205}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6807', 'nonce': 735799205}]}, 'public_addr': '172.21.15.97:6805/735799205', 'cluster_addr': '172.21.15.97:6806/735799205', 'heartbeat_back_addr': '172.21.15.97:6808/735799205', 'heartbeat_front_addr': '172.21.15.97:6807/735799205', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '88e0e4a2-b4a3-4a00-8669-03c3d9b166c5', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 18, 'up_thru': 433, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6809', 'nonce': 2366482649}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6810', 'nonce': 2366482649}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6812', 'nonce': 2366482649}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6811', 'nonce': 2366482649}]}, 'public_addr': '172.21.15.97:6809/2366482649', 'cluster_addr': '172.21.15.97:6810/2366482649', 'heartbeat_back_addr': '172.21.15.97:6812/2366482649', 'heartbeat_front_addr': '172.21.15.97:6811/2366482649', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': 'e689d708-b501-4526-a31a-1e598b74654d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 24, 'up_thru': 433, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6813', 'nonce': 3191181122}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6814', 'nonce': 3191181122}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6816', 'nonce': 3191181122}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6815', 'nonce': 3191181122}]}, 'public_addr': '172.21.15.97:6813/3191181122', 'cluster_addr': '172.21.15.97:6814/3191181122', 'heartbeat_back_addr': '172.21.15.97:6816/3191181122', 'heartbeat_front_addr': '172.21.15.97:6815/3191181122', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '67e4730a-be1c-4d88-9307-e3c2cf3ab2ef', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 30, 'up_thru': 433, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6800', 'nonce': 106778208}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6801', 'nonce': 106778208}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6803', 'nonce': 106778208}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6802', 'nonce': 106778208}]}, 'public_addr': '172.21.15.117:6800/106778208', 'cluster_addr': '172.21.15.117:6801/106778208', 'heartbeat_back_addr': '172.21.15.117:6803/106778208', 'heartbeat_front_addr': '172.21.15.117:6802/106778208', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'f9fd3153-3e4e-4489-8927-a65641f05d42', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.2890472412109375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 38, 'up_thru': 391, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6804', 'nonce': 3199889891}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6805', 'nonce': 3199889891}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6807', 'nonce': 3199889891}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6806', 'nonce': 3199889891}]}, 'public_addr': '172.21.15.117:6804/3199889891', 'cluster_addr': '172.21.15.117:6805/3199889891', 'heartbeat_back_addr': '172.21.15.117:6807/3199889891', 'heartbeat_front_addr': '172.21.15.117:6806/3199889891', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '84898f12-c37d-4eb6-8b71-5b86bfe16e7d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 47, 'up_thru': 433, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6808', 'nonce': 2185843951}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6809', 'nonce': 2185843951}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6811', 'nonce': 2185843951}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6810', 'nonce': 2185843951}]}, 'public_addr': '172.21.15.117:6808/2185843951', 'cluster_addr': '172.21.15.117:6809/2185843951', 'heartbeat_back_addr': '172.21.15.117:6811/2185843951', 'heartbeat_front_addr': '172.21.15.117:6810/2185843951', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '529af2ce-2ae9-41ed-8c8e-d133628cfd20', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 55, 'up_thru': 433, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6812', 'nonce': 2817683239}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6813', 'nonce': 2817683239}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6815', 'nonce': 2817683239}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6814', 'nonce': 2817683239}]}, 'public_addr': '172.21.15.117:6812/2817683239', 'cluster_addr': '172.21.15.117:6813/2817683239', 'heartbeat_back_addr': '172.21.15.117:6815/2817683239', 'heartbeat_front_addr': '172.21.15.117:6814/2817683239', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:38:01.696541+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:38:47.566027+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:37:58.050910+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:38:00.075922+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:39:11.950770+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:38:17.656213+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:38:21.529127+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:38:45.288856+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [{'pgid': '2.0', 'mappings': [{'from': 7, 'to': 2}]}, {'pgid': '2.3', 'mappings': [{'from': 7, 'to': 4}]}, {'pgid': '2.7', 'mappings': [{'from': 7, 'to': 1}]}, {'pgid': '2.1a', 'mappings': [{'from': 7, 'to': 2}]}, {'pgid': '2.29', 'mappings': [{'from': 7, 'to': 2}]}, {'pgid': '4.6', 'mappings': [{'from': 1, 'to': 5}]}, {'pgid': '4.f', 'mappings': [{'from': 1, 'to': 2}]}, {'pgid': '4.10', 'mappings': [{'from': 1, 'to': 2}]}, {'pgid': '5.19', 'mappings': [{'from': 5, 'to': 7}]}], 'pg_temp': [], 'primary_temp': [], 'blocklist': {'172.21.15.97:0/2600364788': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:0/4129083289': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:0/1443158975': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:0/2472640384': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:0/3196919488': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:6800/3195862546': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:6800/3931202434': '2021-10-09T19:17:10.051948+0000', '172.21.15.97:0/2761595213': '2021-10-09T19:17:10.051948+0000', '172.21.15.97:0/900681504': '2021-10-09T19:17:10.051948+0000', '172.21.15.97:0/3932251406': '2021-10-09T19:17:10.051948+0000', '172.21.15.97:0/398006785': '2021-10-09T19:16:48.651177+0000', '172.21.15.97:0/1642570050': '2021-10-09T19:16:48.651177+0000', '172.21.15.97:0/300178790': '2021-10-09T19:16:48.651177+0000', '172.21.15.97:6800/845999767': '2021-10-09T19:16:48.651177+0000'}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2021-10-08T19:39:18.028 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph pg dump --format=json 2021-10-08T19:39:18.154 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:39:18.158 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:18.159 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:39:18.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:17 smithi097 ceph-mon[41966]: 2.14 scrub ok 2021-10-08T19:39:18.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:17 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:39:18.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:17 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:39:18.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:17 smithi097 ceph-mon[41966]: osdmap e440: 8 total, 8 up, 8 in 2021-10-08T19:39:18.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:17 smithi097 ceph-mon[41966]: pgmap v897: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 721 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 341 B/s rd, 120 MiB/s wr, 1.92k op/s 2021-10-08T19:39:18.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:17 smithi097 ceph-mon[41966]: 4.13 scrub ok 2021-10-08T19:39:18.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:17 smithi097 ceph-mon[41966]: 6.0 scrub ok 2021-10-08T19:39:18.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:17 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:39:18.260 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:39:18.318 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:17 smithi117 ceph-mon[34585]: 2.14 scrub ok 2021-10-08T19:39:18.319 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:17 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:39:18.319 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:17 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:39:18.319 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:17 smithi117 ceph-mon[34585]: osdmap e440: 8 total, 8 up, 8 in 2021-10-08T19:39:18.319 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:17 smithi117 ceph-mon[34585]: pgmap v897: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 721 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 341 B/s rd, 120 MiB/s wr, 1.92k op/s 2021-10-08T19:39:18.320 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:17 smithi117 ceph-mon[34585]: 4.13 scrub ok 2021-10-08T19:39:18.320 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:17 smithi117 ceph-mon[34585]: 6.0 scrub ok 2021-10-08T19:39:18.320 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:17 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:39:18.327 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:18.531 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:39:18.539 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:18.540 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:39:18.643 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:39:18.670 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 9 16 21592 21576 149.733 117.188 0.00742844 0.00666915 2021-10-08T19:39:18.719 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:18.852 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:39:18.856 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:18.856 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:39:18.926 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:39:18.935 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:18 smithi117 ceph-mon[34585]: 3.d scrub ok 2021-10-08T19:39:18.958 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:39:19.021 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:19.179 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:39:19.188 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:18 smithi097 ceph-mon[41966]: 3.d scrub ok 2021-10-08T19:39:19.191 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:19.191 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:18 smithi097 ceph-mon[32687]: 3.d scrub ok 2021-10-08T19:39:19.192 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:39:19.293 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:39:19.339 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:19.433 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:39:19.440 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:19.441 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:39:19.543 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:39:19.590 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:19.673 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 10 16 23468 23452 146.484 117.25 0.00746499 0.00682212 2021-10-08T19:39:19.677 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:39:19.681 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:19.682 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:39:19.783 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:39:19.831 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:19.953 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:39:19.958 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:19.959 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:39:20.031 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2021-10-08T19:39:20.061 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:39:20.083 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is unset 2021-10-08T19:39:20.120 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:19 smithi097 ceph-mon[32687]: 3.f scrub ok 2021-10-08T19:39:20.120 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:19 smithi097 ceph-mon[32687]: pgmap v898: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 1011 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 336 B/s rd, 166 MiB/s wr, 2.66k op/s 2021-10-08T19:39:20.120 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:19 smithi097 ceph-mon[32687]: 2.1 scrub ok 2021-10-08T19:39:20.121 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:19 smithi097 ceph-mon[32687]: 5.3 scrub ok 2021-10-08T19:39:20.121 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:19 smithi097 ceph-mon[32687]: 3.2 scrub ok 2021-10-08T19:39:20.121 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:19 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/879549281' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:39:20.122 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:19 smithi097 ceph-mon[32687]: from='client.26143 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:39:20.122 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:19 smithi097 ceph-mon[41966]: 3.f scrub ok 2021-10-08T19:39:20.123 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:19 smithi097 ceph-mon[41966]: pgmap v898: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 1011 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 336 B/s rd, 166 MiB/s wr, 2.66k op/s 2021-10-08T19:39:20.123 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:19 smithi097 ceph-mon[41966]: 2.1 scrub ok 2021-10-08T19:39:20.123 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:19 smithi097 ceph-mon[41966]: 5.3 scrub ok 2021-10-08T19:39:20.124 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:19 smithi097 ceph-mon[41966]: 3.2 scrub ok 2021-10-08T19:39:20.124 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:19 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/879549281' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:39:20.124 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:19 smithi097 ceph-mon[41966]: from='client.26143 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:39:20.125 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:20.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:19 smithi117 ceph-mon[34585]: 3.f scrub ok 2021-10-08T19:39:20.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:19 smithi117 ceph-mon[34585]: pgmap v898: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 1011 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 336 B/s rd, 166 MiB/s wr, 2.66k op/s 2021-10-08T19:39:20.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:19 smithi117 ceph-mon[34585]: 2.1 scrub ok 2021-10-08T19:39:20.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:19 smithi117 ceph-mon[34585]: 5.3 scrub ok 2021-10-08T19:39:20.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:19 smithi117 ceph-mon[34585]: 3.2 scrub ok 2021-10-08T19:39:20.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:19 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/879549281' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:39:20.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:19 smithi117 ceph-mon[34585]: from='client.26143 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:39:20.650 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:39:20.655 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:20.655 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:39:20.671 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 11 16 25212 25196 143.078 109 0.00700552 0.00698185 2021-10-08T19:39:20.761 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:39:20.804 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:20.889 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:39:20.893 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:20.894 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:39:20.950 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:20 smithi097 ceph-mon[32687]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:39:20.950 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:20 smithi097 ceph-mon[32687]: Cluster is now healthy 2021-10-08T19:39:20.951 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:20 smithi097 ceph-mon[32687]: from='client.26143 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:39:20.951 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:20 smithi097 ceph-mon[32687]: osdmap e441: 8 total, 8 up, 8 in 2021-10-08T19:39:20.952 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:20 smithi097 ceph-mon[32687]: 6.e scrub ok 2021-10-08T19:39:20.952 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:20 smithi097 ceph-mon[32687]: osdmap e442: 8 total, 8 up, 8 in 2021-10-08T19:39:20.995 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:39:21.041 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:21.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:20 smithi117 ceph-mon[34585]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:39:21.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:20 smithi117 ceph-mon[34585]: Cluster is now healthy 2021-10-08T19:39:21.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:20 smithi117 ceph-mon[34585]: from='client.26143 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:39:21.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:20 smithi117 ceph-mon[34585]: osdmap e441: 8 total, 8 up, 8 in 2021-10-08T19:39:21.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:20 smithi117 ceph-mon[34585]: 6.e scrub ok 2021-10-08T19:39:21.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:20 smithi117 ceph-mon[34585]: osdmap e442: 8 total, 8 up, 8 in 2021-10-08T19:39:21.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:20 smithi097 ceph-mon[41966]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:39:21.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:20 smithi097 ceph-mon[41966]: Cluster is now healthy 2021-10-08T19:39:21.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:20 smithi097 ceph-mon[41966]: from='client.26143 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:39:21.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:20 smithi097 ceph-mon[41966]: osdmap e441: 8 total, 8 up, 8 in 2021-10-08T19:39:21.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:20 smithi097 ceph-mon[41966]: 6.e scrub ok 2021-10-08T19:39:21.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:20 smithi097 ceph-mon[41966]: osdmap e442: 8 total, 8 up, 8 in 2021-10-08T19:39:21.674 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 12 16 27067 27051 140.816 115.938 0.0114354 0.00709609 2021-10-08T19:39:21.733 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:39:21.744 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:21.744 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:39:21.847 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:39:21.904 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:22.177 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:39:22.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:21 smithi097 ceph-mon[41966]: pgmap v901: 188 pgs: 188 active+clean; 1.3 GiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 1017 B/s rd, 131 MiB/s wr, 2.10k op/s 2021-10-08T19:39:22.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:21 smithi097 ceph-mon[41966]: 5.f scrub ok 2021-10-08T19:39:22.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:21 smithi097 ceph-mon[41966]: 2.28 scrub ok 2021-10-08T19:39:22.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:21 smithi097 ceph-mon[32687]: pgmap v901: 188 pgs: 188 active+clean; 1.3 GiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 1017 B/s rd, 131 MiB/s wr, 2.10k op/s 2021-10-08T19:39:22.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:21 smithi097 ceph-mon[32687]: 5.f scrub ok 2021-10-08T19:39:22.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:21 smithi097 ceph-mon[32687]: 2.28 scrub ok 2021-10-08T19:39:22.223 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2021-10-08T19:39:22.223 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:39:22.351 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:39:22.358 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:22.359 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:39:22.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:21 smithi117 ceph-mon[34585]: pgmap v901: 188 pgs: 188 active+clean; 1.3 GiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 1017 B/s rd, 131 MiB/s wr, 2.10k op/s 2021-10-08T19:39:22.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:21 smithi117 ceph-mon[34585]: 5.f scrub ok 2021-10-08T19:39:22.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:21 smithi117 ceph-mon[34585]: 2.28 scrub ok 2021-10-08T19:39:22.459 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:39:22.503 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:22.671 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 13 16 28749 28733 138.071 105.125 0.00574526 0.00723596 2021-10-08T19:39:22.955 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:39:22 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:39:22] "GET /metrics HTTP/1.1" 200 155811 "" "Prometheus/2.18.1" 2021-10-08T19:39:23.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:22 smithi097 ceph-mon[41966]: 2.1c deep-scrub ok 2021-10-08T19:39:23.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:22 smithi097 ceph-mon[41966]: 3.12 scrub ok 2021-10-08T19:39:23.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:22 smithi097 ceph-mon[41966]: 2.0 deep-scrub ok 2021-10-08T19:39:23.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:22 smithi097 ceph-mon[32687]: 2.1c deep-scrub ok 2021-10-08T19:39:23.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:22 smithi097 ceph-mon[32687]: 3.12 scrub ok 2021-10-08T19:39:23.225 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:22 smithi097 ceph-mon[32687]: 2.0 deep-scrub ok 2021-10-08T19:39:23.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:22 smithi117 ceph-mon[34585]: 2.1c deep-scrub ok 2021-10-08T19:39:23.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:22 smithi117 ceph-mon[34585]: 3.12 scrub ok 2021-10-08T19:39:23.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:22 smithi117 ceph-mon[34585]: 2.0 deep-scrub ok 2021-10-08T19:39:23.408 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:39:23.457 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:23.458 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:39:23.560 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:39:23.671 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 14 16 30156 30140 134.491 87.9375 0.00943249 0.00742893 2021-10-08T19:39:23.691 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:23.747 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set noscrub 2021-10-08T19:39:23.868 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:39:23 smithi117 conmon[69189]: level=error ts=2021-10-08T19:39:23.505Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=2 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:39:23.969 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:23 smithi097 ceph-mon[41966]: 6.4 scrub ok 2021-10-08T19:39:23.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:23 smithi097 ceph-mon[41966]: pgmap v902: 188 pgs: 188 active+clean; 1.3 GiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 849 B/s rd, 109 MiB/s wr, 1.75k op/s 2021-10-08T19:39:23.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:23 smithi097 ceph-mon[32687]: 6.4 scrub ok 2021-10-08T19:39:23.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:23 smithi097 ceph-mon[32687]: pgmap v902: 188 pgs: 188 active+clean; 1.3 GiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 849 B/s rd, 109 MiB/s wr, 1.75k op/s 2021-10-08T19:39:24.121 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:39:24.140 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:24.141 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:39:24.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:39:23 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:39:23] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:39:24.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:23 smithi117 ceph-mon[34585]: 6.4 scrub ok 2021-10-08T19:39:24.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:23 smithi117 ceph-mon[34585]: pgmap v902: 188 pgs: 188 active+clean; 1.3 GiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 849 B/s rd, 109 MiB/s wr, 1.75k op/s 2021-10-08T19:39:24.243 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:39:24.305 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:24.316 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2021-10-08T19:39:24.393 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:39:24.401 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:24.402 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:39:24.503 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:39:24.538 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:24.671 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 15 16 31679 31663 131.871 95.1875 0.0111923 0.00757773 2021-10-08T19:39:24.698 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:39:24.701 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:24.702 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:39:24.803 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:39:24.841 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:24.911 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:39:24.913 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:24.914 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:39:24.918 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:39:25.014 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:39:25.066 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:25.144 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:39:25.147 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:24 smithi117 ceph-mon[34585]: 6.12 scrub ok 2021-10-08T19:39:25.148 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:24 smithi117 ceph-mon[34585]: 4.1c scrub ok 2021-10-08T19:39:25.149 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:25.150 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:39:25.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:24 smithi097 ceph-mon[32687]: 6.12 scrub ok 2021-10-08T19:39:25.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:24 smithi097 ceph-mon[32687]: 4.1c scrub ok 2021-10-08T19:39:25.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:24 smithi097 ceph-mon[41966]: 6.12 scrub ok 2021-10-08T19:39:25.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:24 smithi097 ceph-mon[41966]: 4.1c scrub ok 2021-10-08T19:39:25.251 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:39:25.294 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:25.479 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:39:25.485 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:25.486 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:39:25.587 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:39:25.671 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 16 16 33249 33233 129.762 98.125 0.0116329 0.00770068 2021-10-08T19:39:25.725 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:25.774 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:39:25.791 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2021-10-08T19:39:25.842 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:39:25.844 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:25.845 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:39:25.865 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:39:25.947 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:39:25.993 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:26.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:25 smithi117 ceph-mon[34585]: 5.19 scrub ok 2021-10-08T19:39:26.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:25 smithi117 ceph-mon[34585]: pgmap v903: 188 pgs: 188 active+clean; 1.9 GiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 150 MiB/s wr, 2.39k op/s 2021-10-08T19:39:26.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:25 smithi117 ceph-mon[34585]: 5.1 scrub ok 2021-10-08T19:39:26.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:25 smithi117 ceph-mon[34585]: osdmap e443: 8 total, 8 up, 8 in 2021-10-08T19:39:26.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:25 smithi097 ceph-mon[32687]: 5.19 scrub ok 2021-10-08T19:39:26.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:25 smithi097 ceph-mon[32687]: pgmap v903: 188 pgs: 188 active+clean; 1.9 GiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 150 MiB/s wr, 2.39k op/s 2021-10-08T19:39:26.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:25 smithi097 ceph-mon[32687]: 5.1 scrub ok 2021-10-08T19:39:26.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:25 smithi097 ceph-mon[32687]: osdmap e443: 8 total, 8 up, 8 in 2021-10-08T19:39:26.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:25 smithi097 ceph-mon[41966]: 5.19 scrub ok 2021-10-08T19:39:26.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:25 smithi097 ceph-mon[41966]: pgmap v903: 188 pgs: 188 active+clean; 1.9 GiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 150 MiB/s wr, 2.39k op/s 2021-10-08T19:39:26.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:25 smithi097 ceph-mon[41966]: 5.1 scrub ok 2021-10-08T19:39:26.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:25 smithi097 ceph-mon[41966]: osdmap e443: 8 total, 8 up, 8 in 2021-10-08T19:39:26.672 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 17 16 34734 34718 127.584 92.8125 0.0108077 0.00783202 2021-10-08T19:39:26.841 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:39:26.852 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:26.854 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:39:26.956 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:39:27.009 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:27.100 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:39:27.101 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:27.102 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:39:27.203 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:39:27.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:26 smithi097 ceph-mon[41966]: 3.0 scrub ok 2021-10-08T19:39:27.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:26 smithi097 ceph-mon[41966]: from='client.16218 v1:172.21.15.97:0/1110409672' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:39:27.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:26 smithi097 ceph-mon[41966]: 1.2 scrub ok 2021-10-08T19:39:27.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:26 smithi097 ceph-mon[41966]: 6.9 deep-scrub ok 2021-10-08T19:39:27.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:26 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:39:27.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:26 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:39:27.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:26 smithi097 ceph-mon[41966]: 1.5 scrub ok 2021-10-08T19:39:27.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:26 smithi097 ceph-mon[41966]: 2.23 scrub ok 2021-10-08T19:39:27.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:26 smithi097 ceph-mon[32687]: 3.0 scrub ok 2021-10-08T19:39:27.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:26 smithi097 ceph-mon[32687]: from='client.16218 v1:172.21.15.97:0/1110409672' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:39:27.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:26 smithi097 ceph-mon[32687]: 1.2 scrub ok 2021-10-08T19:39:27.225 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:26 smithi097 ceph-mon[32687]: 6.9 deep-scrub ok 2021-10-08T19:39:27.225 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:26 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:39:27.225 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:26 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:39:27.225 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:26 smithi097 ceph-mon[32687]: 1.5 scrub ok 2021-10-08T19:39:27.225 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:26 smithi097 ceph-mon[32687]: 2.23 scrub ok 2021-10-08T19:39:27.252 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:27.405 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:39:27 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:39:27.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:26 smithi117 ceph-mon[34585]: 3.0 scrub ok 2021-10-08T19:39:27.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:26 smithi117 ceph-mon[34585]: from='client.16218 v1:172.21.15.97:0/1110409672' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:39:27.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:26 smithi117 ceph-mon[34585]: 1.2 scrub ok 2021-10-08T19:39:27.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:26 smithi117 ceph-mon[34585]: 6.9 deep-scrub ok 2021-10-08T19:39:27.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:26 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:39:27.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:26 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:39:27.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:26 smithi117 ceph-mon[34585]: 1.5 scrub ok 2021-10-08T19:39:27.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:26 smithi117 ceph-mon[34585]: 2.23 scrub ok 2021-10-08T19:39:27.672 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 18 16 36256 36240 125.781 95.125 0.00421229 0.00794411 2021-10-08T19:39:28.253 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:39:28.257 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:28 smithi097 ceph-mon[41966]: 4.5 deep-scrub ok 2021-10-08T19:39:28.257 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:28 smithi097 ceph-mon[41966]: pgmap v905: 188 pgs: 188 active+clean; 1.9 GiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 732 B/s rd, 77 MiB/s wr, 1.23k op/s 2021-10-08T19:39:28.258 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:28 smithi097 ceph-mon[41966]: osdmap e444: 8 total, 8 up, 8 in 2021-10-08T19:39:28.258 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:28 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:39:28.259 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:28.259 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:39:28.260 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:28 smithi097 ceph-mon[32687]: 4.5 deep-scrub ok 2021-10-08T19:39:28.260 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:28 smithi097 ceph-mon[32687]: pgmap v905: 188 pgs: 188 active+clean; 1.9 GiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 732 B/s rd, 77 MiB/s wr, 1.23k op/s 2021-10-08T19:39:28.260 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:28 smithi097 ceph-mon[32687]: osdmap e444: 8 total, 8 up, 8 in 2021-10-08T19:39:28.261 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:28 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:39:28.294 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":903,"stamp":"2021-10-08T19:39:24.944805+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2011371716,"num_objects":30876,"num_object_clones":0,"num_object_copies":92628,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30876,"num_whiteouts":0,"num_read":1575,"num_read_kb":1332,"num_write":31391,"num_write_kb":1963687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":533,"num_bytes_recovered":11617,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32954,"ondisk_log_size":32954,"up":564,"acting":564,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":564,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":8369752,"kb_used_data":5731480,"kb_used_omap":0,"kb_used_meta":2638208,"kb_avail":741591464,"statfs":{"total":767960285184,"available":759389659136,"internally_reserved":0,"allocated":5869035520,"data_stored":5865534204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2701524992},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1255276544,"num_objects":19154,"num_object_clones":0,"num_object_copies":57462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19154,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":19154,"num_write_kb":1225856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.007169"},"pg_stats":[{"pgid":"2.29","version":"0'0","reported_seq":73,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.967041+0000","last_change":"2021-10-08T19:39:15.207230+0000","last_active":"2021-10-08T19:39:19.967041+0000","last_peered":"2021-10-08T19:39:19.967041+0000","last_clean":"2021-10-08T19:39:19.967041+0000","last_became_active":"2021-10-08T19:37:45.848663+0000","last_became_peered":"2021-10-08T19:37:45.848663+0000","last_unstale":"2021-10-08T19:39:19.967041+0000","last_undegraded":"2021-10-08T19:39:19.967041+0000","last_fullsized":"2021-10-08T19:39:19.967041+0000","mapping_epoch":407,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":408,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:15.207136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:30:11.102934+0000","last_clean_scrub_stamp":"2021-10-08T19:39:15.207136+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0027672759999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.28","version":"0'0","reported_seq":64,"reported_epoch":442,"state":"active+clean","last_fresh":"2021-10-08T19:39:21.168040+0000","last_change":"2021-10-08T19:39:21.168002+0000","last_active":"2021-10-08T19:39:21.168040+0000","last_peered":"2021-10-08T19:39:21.168040+0000","last_clean":"2021-10-08T19:39:21.168040+0000","last_became_active":"2021-10-08T19:37:00.334502+0000","last_became_peered":"2021-10-08T19:37:00.334502+0000","last_unstale":"2021-10-08T19:39:21.168040+0000","last_undegraded":"2021-10-08T19:39:21.168040+0000","last_fullsized":"2021-10-08T19:39:21.168040+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:21.167907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:21.167907+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0095106210000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.27","version":"0'0","reported_seq":377,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.960782+0000","last_change":"2021-10-08T19:39:12.559639+0000","last_active":"2021-10-08T19:39:19.960782+0000","last_peered":"2021-10-08T19:39:19.960782+0000","last_clean":"2021-10-08T19:39:19.960782+0000","last_became_active":"2021-10-08T19:37:00.342526+0000","last_became_peered":"2021-10-08T19:37:00.342526+0000","last_unstale":"2021-10-08T19:39:19.960782+0000","last_undegraded":"2021-10-08T19:39:19.960782+0000","last_fullsized":"2021-10-08T19:39:19.960782+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:12.559542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:12.559542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0025174720000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.26","version":"0'0","reported_seq":64,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.960749+0000","last_change":"2021-10-08T19:39:13.573021+0000","last_active":"2021-10-08T19:39:19.960749+0000","last_peered":"2021-10-08T19:39:19.960749+0000","last_clean":"2021-10-08T19:39:19.960749+0000","last_became_active":"2021-10-08T19:37:00.340327+0000","last_became_peered":"2021-10-08T19:37:00.340327+0000","last_unstale":"2021-10-08T19:39:19.960749+0000","last_undegraded":"2021-10-08T19:39:19.960749+0000","last_fullsized":"2021-10-08T19:39:19.960749+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:13.572950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:07.710367+0000","last_clean_scrub_stamp":"2021-10-08T19:39:13.572950+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0022297720000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.25","version":"328'2","reported_seq":375,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.954510+0000","last_change":"2021-10-08T19:38:00.259167+0000","last_active":"2021-10-08T19:39:19.954510+0000","last_peered":"2021-10-08T19:39:19.954510+0000","last_clean":"2021-10-08T19:39:19.954510+0000","last_became_active":"2021-10-08T19:37:00.344673+0000","last_became_peered":"2021-10-08T19:37:00.344673+0000","last_unstale":"2021-10-08T19:39:19.954510+0000","last_undegraded":"2021-10-08T19:39:19.954510+0000","last_fullsized":"2021-10-08T19:39:19.954510+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"328'2","last_scrub_stamp":"2021-10-08T19:38:00.259074+0000","last_deep_scrub":"328'2","last_deep_scrub_stamp":"2021-10-08T19:33:29.990395+0000","last_clean_scrub_stamp":"2021-10-08T19:38:00.259074+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011095977,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.24","version":"0'0","reported_seq":64,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.967258+0000","last_change":"2021-10-08T19:38:36.327118+0000","last_active":"2021-10-08T19:39:19.967258+0000","last_peered":"2021-10-08T19:39:19.967258+0000","last_clean":"2021-10-08T19:39:19.967258+0000","last_became_active":"2021-10-08T19:37:00.336960+0000","last_became_peered":"2021-10-08T19:37:00.336960+0000","last_unstale":"2021-10-08T19:39:19.967258+0000","last_undegraded":"2021-10-08T19:39:19.967258+0000","last_fullsized":"2021-10-08T19:39:19.967258+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:36.327020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:38:36.327020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011868632,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.23","version":"0'0","reported_seq":58,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.075999+0000","last_change":"2021-10-08T19:37:00.348151+0000","last_active":"2021-10-08T19:39:20.075999+0000","last_peered":"2021-10-08T19:39:20.075999+0000","last_clean":"2021-10-08T19:39:20.075999+0000","last_became_active":"2021-10-08T19:37:00.347789+0000","last_became_peered":"2021-10-08T19:37:00.347789+0000","last_unstale":"2021-10-08T19:39:20.075999+0000","last_undegraded":"2021-10-08T19:39:20.075999+0000","last_fullsized":"2021-10-08T19:39:20.075999+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:35:31.652494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:35:31.652494+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0075080879999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.22","version":"0'0","reported_seq":466,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.967125+0000","last_change":"2021-10-08T19:39:11.208487+0000","last_active":"2021-10-08T19:39:19.967125+0000","last_peered":"2021-10-08T19:39:19.967125+0000","last_clean":"2021-10-08T19:39:19.967125+0000","last_became_active":"2021-10-08T19:37:00.343394+0000","last_became_peered":"2021-10-08T19:37:00.343394+0000","last_unstale":"2021-10-08T19:39:19.967125+0000","last_undegraded":"2021-10-08T19:39:19.967125+0000","last_fullsized":"2021-10-08T19:39:19.967125+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:11.208391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:11.208391+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003871958,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3],"acting":[6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.21","version":"0'0","reported_seq":469,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.956229+0000","last_change":"2021-10-08T19:39:15.016799+0000","last_active":"2021-10-08T19:39:19.956229+0000","last_peered":"2021-10-08T19:39:19.956229+0000","last_clean":"2021-10-08T19:39:19.956229+0000","last_became_active":"2021-10-08T19:37:00.335409+0000","last_became_peered":"2021-10-08T19:37:00.335409+0000","last_unstale":"2021-10-08T19:39:19.956229+0000","last_undegraded":"2021-10-08T19:39:19.956229+0000","last_fullsized":"2021-10-08T19:39:19.956229+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:15.016682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:15.016682+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.005398969,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7],"acting":[2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.20","version":"0'0","reported_seq":74,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.958575+0000","last_change":"2021-10-08T19:39:11.566964+0000","last_active":"2021-10-08T19:39:19.958575+0000","last_peered":"2021-10-08T19:39:19.958575+0000","last_clean":"2021-10-08T19:39:19.958575+0000","last_became_active":"2021-10-08T19:37:00.341831+0000","last_became_peered":"2021-10-08T19:37:00.341831+0000","last_unstale":"2021-10-08T19:39:19.958575+0000","last_undegraded":"2021-10-08T19:39:19.958575+0000","last_fullsized":"2021-10-08T19:39:19.958575+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:11.566891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:32.922694+0000","last_clean_scrub_stamp":"2021-10-08T19:39:11.566891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0018543839999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.7","version":"442'1931","reported_seq":1948,"reported_epoch":442,"state":"active+clean","last_fresh":"2021-10-08T19:39:24.263458+0000","last_change":"2021-10-08T19:39:04.771604+0000","last_active":"2021-10-08T19:39:24.263458+0000","last_peered":"2021-10-08T19:39:24.263458+0000","last_clean":"2021-10-08T19:39:24.263458+0000","last_became_active":"2021-10-08T19:39:04.771230+0000","last_became_peered":"2021-10-08T19:39:04.771230+0000","last_unstale":"2021-10-08T19:39:24.263458+0000","last_undegraded":"2021-10-08T19:39:24.263458+0000","last_fullsized":"2021-10-08T19:39:24.263458+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:03.490762+0000","log_size":1931,"ondisk_log_size":1931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":126550016,"num_objects":1931,"num_object_clones":0,"num_object_copies":5793,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1931,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1931,"num_write_kb":123584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"114'10","reported_seq":671,"reported_epoch":442,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.857005+0000","last_change":"2021-10-08T19:37:51.741192+0000","last_active":"2021-10-08T19:39:20.857005+0000","last_peered":"2021-10-08T19:39:20.857005+0000","last_clean":"2021-10-08T19:39:20.857005+0000","last_became_active":"2021-10-08T19:24:25.096162+0000","last_became_peered":"2021-10-08T19:24:25.096162+0000","last_unstale":"2021-10-08T19:39:20.857005+0000","last_undegraded":"2021-10-08T19:39:20.857005+0000","last_fullsized":"2021-10-08T19:39:20.857005+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'10","last_scrub_stamp":"2021-10-08T19:37:51.741091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:37:51.741091+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0076100259999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"289'34","reported_seq":103,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.958888+0000","last_change":"2021-10-08T19:37:18.998690+0000","last_active":"2021-10-08T19:39:19.958888+0000","last_peered":"2021-10-08T19:39:19.958888+0000","last_clean":"2021-10-08T19:39:19.958888+0000","last_became_active":"2021-10-08T19:37:18.998305+0000","last_became_peered":"2021-10-08T19:37:18.998305+0000","last_unstale":"2021-10-08T19:39:19.958888+0000","last_undegraded":"2021-10-08T19:39:19.958888+0000","last_fullsized":"2021-10-08T19:39:19.958888+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'34","last_scrub_stamp":"2021-10-08T19:36:55.766292+0000","last_deep_scrub":"87'22","last_deep_scrub_stamp":"2021-10-08T19:22:58.705632+0000","last_clean_scrub_stamp":"2021-10-08T19:36:55.766292+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":454,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.071249+0000","last_change":"2021-10-08T19:37:54.177746+0000","last_active":"2021-10-08T19:39:20.071249+0000","last_peered":"2021-10-08T19:39:20.071249+0000","last_clean":"2021-10-08T19:39:20.071249+0000","last_became_active":"2021-10-08T19:29:40.632678+0000","last_became_peered":"2021-10-08T19:29:40.632678+0000","last_unstale":"2021-10-08T19:39:20.071249+0000","last_undegraded":"2021-10-08T19:39:20.071249+0000","last_fullsized":"2021-10-08T19:39:20.071249+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:54.177635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:37:54.177635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0085167739999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":131,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.967310+0000","last_change":"2021-10-08T19:38:45.367010+0000","last_active":"2021-10-08T19:39:19.967310+0000","last_peered":"2021-10-08T19:39:19.967310+0000","last_clean":"2021-10-08T19:39:19.967310+0000","last_became_active":"2021-10-08T19:37:19.000347+0000","last_became_peered":"2021-10-08T19:37:19.000347+0000","last_unstale":"2021-10-08T19:39:19.967310+0000","last_undegraded":"2021-10-08T19:39:19.967310+0000","last_fullsized":"2021-10-08T19:39:19.967310+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:45.366890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:08.936801+0000","last_clean_scrub_stamp":"2021-10-08T19:38:45.366890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.026317591000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":354,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.961074+0000","last_change":"2021-10-08T19:39:18.594197+0000","last_active":"2021-10-08T19:39:19.961074+0000","last_peered":"2021-10-08T19:39:19.961074+0000","last_clean":"2021-10-08T19:39:19.961074+0000","last_became_active":"2021-10-08T19:25:15.510457+0000","last_became_peered":"2021-10-08T19:25:15.510457+0000","last_unstale":"2021-10-08T19:39:19.961074+0000","last_undegraded":"2021-10-08T19:39:19.961074+0000","last_fullsized":"2021-10-08T19:39:19.961074+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:18.594126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:33:28.036266+0000","last_clean_scrub_stamp":"2021-10-08T19:39:18.594126+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0026381920000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.4","version":"442'1865","reported_seq":1882,"reported_epoch":442,"state":"active+clean","last_fresh":"2021-10-08T19:39:23.716372+0000","last_change":"2021-10-08T19:39:04.511208+0000","last_active":"2021-10-08T19:39:23.716372+0000","last_peered":"2021-10-08T19:39:23.716372+0000","last_clean":"2021-10-08T19:39:23.716372+0000","last_became_active":"2021-10-08T19:39:04.510913+0000","last_became_peered":"2021-10-08T19:39:04.510913+0000","last_unstale":"2021-10-08T19:39:23.716372+0000","last_undegraded":"2021-10-08T19:39:23.716372+0000","last_fullsized":"2021-10-08T19:39:23.716372+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:03.490762+0000","log_size":1865,"ondisk_log_size":1865,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":122224640,"num_objects":1865,"num_object_clones":0,"num_object_copies":5595,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1865,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1865,"num_write_kb":119360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"337'19","reported_seq":491,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.071333+0000","last_change":"2021-10-08T19:39:15.098421+0000","last_active":"2021-10-08T19:39:20.071333+0000","last_peered":"2021-10-08T19:39:20.071333+0000","last_clean":"2021-10-08T19:39:20.071333+0000","last_became_active":"2021-10-08T19:28:40.159729+0000","last_became_peered":"2021-10-08T19:28:40.159729+0000","last_unstale":"2021-10-08T19:39:20.071333+0000","last_undegraded":"2021-10-08T19:39:20.071333+0000","last_fullsized":"2021-10-08T19:39:20.071333+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"337'19","last_scrub_stamp":"2021-10-08T19:39:15.098300+0000","last_deep_scrub":"337'19","last_deep_scrub_stamp":"2021-10-08T19:34:14.040249+0000","last_clean_scrub_stamp":"2021-10-08T19:39:15.098300+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010352118,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":290,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.075432+0000","last_change":"2021-10-08T19:36:57.596887+0000","last_active":"2021-10-08T19:39:20.075432+0000","last_peered":"2021-10-08T19:39:20.075432+0000","last_clean":"2021-10-08T19:39:20.075432+0000","last_became_active":"2021-10-08T19:29:40.624977+0000","last_became_peered":"2021-10-08T19:29:40.624977+0000","last_unstale":"2021-10-08T19:39:20.075432+0000","last_undegraded":"2021-10-08T19:39:20.075432+0000","last_fullsized":"2021-10-08T19:39:20.075432+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:57.596784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:57.596784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010370961,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":448,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.956736+0000","last_change":"2021-10-08T19:39:11.937304+0000","last_active":"2021-10-08T19:39:19.956736+0000","last_peered":"2021-10-08T19:39:19.956736+0000","last_clean":"2021-10-08T19:39:19.956736+0000","last_became_active":"2021-10-08T19:29:40.629422+0000","last_became_peered":"2021-10-08T19:29:40.629422+0000","last_unstale":"2021-10-08T19:39:19.956736+0000","last_undegraded":"2021-10-08T19:39:19.956736+0000","last_fullsized":"2021-10-08T19:39:19.956736+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:11.937237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:39:11.937237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0014203659999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":418,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.071373+0000","last_change":"2021-10-08T19:37:49.991077+0000","last_active":"2021-10-08T19:39:20.071373+0000","last_peered":"2021-10-08T19:39:20.071373+0000","last_clean":"2021-10-08T19:39:20.071373+0000","last_became_active":"2021-10-08T19:21:29.643022+0000","last_became_peered":"2021-10-08T19:21:29.643022+0000","last_unstale":"2021-10-08T19:39:20.071373+0000","last_undegraded":"2021-10-08T19:39:20.071373+0000","last_fullsized":"2021-10-08T19:39:20.071373+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:49.990967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:37:49.990967+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.047700399999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"70'5","reported_seq":690,"reported_epoch":442,"state":"active+clean","last_fresh":"2021-10-08T19:39:22.316364+0000","last_change":"2021-10-08T19:38:02.331641+0000","last_active":"2021-10-08T19:39:22.316364+0000","last_peered":"2021-10-08T19:39:22.316364+0000","last_clean":"2021-10-08T19:39:22.316364+0000","last_became_active":"2021-10-08T19:37:19.006464+0000","last_became_peered":"2021-10-08T19:37:19.006464+0000","last_unstale":"2021-10-08T19:39:22.316364+0000","last_undegraded":"2021-10-08T19:39:22.316364+0000","last_fullsized":"2021-10-08T19:39:22.316364+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:38:02.331532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:38:02.331532+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0043661940000000003,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":443,"num_read_kb":443,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":778,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.5","version":"442'1920","reported_seq":1937,"reported_epoch":442,"state":"active+clean","last_fresh":"2021-10-08T19:39:23.727980+0000","last_change":"2021-10-08T19:39:04.771577+0000","last_active":"2021-10-08T19:39:23.727980+0000","last_peered":"2021-10-08T19:39:23.727980+0000","last_clean":"2021-10-08T19:39:23.727980+0000","last_became_active":"2021-10-08T19:39:04.771214+0000","last_became_peered":"2021-10-08T19:39:04.771214+0000","last_unstale":"2021-10-08T19:39:23.727980+0000","last_undegraded":"2021-10-08T19:39:23.727980+0000","last_fullsized":"2021-10-08T19:39:23.727980+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:03.490762+0000","log_size":1920,"ondisk_log_size":1920,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":1920,"num_object_clones":0,"num_object_copies":5760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1920,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1920,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"428'44","reported_seq":488,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.967493+0000","last_change":"2021-10-08T19:38:47.335971+0000","last_active":"2021-10-08T19:39:19.967493+0000","last_peered":"2021-10-08T19:39:19.967493+0000","last_clean":"2021-10-08T19:39:19.967493+0000","last_became_active":"2021-10-08T19:28:40.101648+0000","last_became_peered":"2021-10-08T19:28:40.101648+0000","last_unstale":"2021-10-08T19:39:19.967493+0000","last_undegraded":"2021-10-08T19:39:19.967493+0000","last_fullsized":"2021-10-08T19:39:19.967493+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"428'44","last_scrub_stamp":"2021-10-08T19:38:47.335892+0000","last_deep_scrub":"428'44","last_deep_scrub_stamp":"2021-10-08T19:38:47.335892+0000","last_clean_scrub_stamp":"2021-10-08T19:38:47.335892+0000","log_size":44,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0080692939999999994,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":55,"num_read_kb":44,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":434,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.071607+0000","last_change":"2021-10-08T19:38:35.041815+0000","last_active":"2021-10-08T19:39:20.071607+0000","last_peered":"2021-10-08T19:39:20.071607+0000","last_clean":"2021-10-08T19:39:20.071607+0000","last_became_active":"2021-10-08T19:21:23.595919+0000","last_became_peered":"2021-10-08T19:21:23.595919+0000","last_unstale":"2021-10-08T19:39:20.071607+0000","last_undegraded":"2021-10-08T19:39:20.071607+0000","last_fullsized":"2021-10-08T19:39:20.071607+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:35.041713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:38:35.041713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0077214359999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":440,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.956217+0000","last_change":"2021-10-08T19:37:53.130636+0000","last_active":"2021-10-08T19:39:19.956217+0000","last_peered":"2021-10-08T19:39:19.956217+0000","last_clean":"2021-10-08T19:39:19.956217+0000","last_became_active":"2021-10-08T19:31:22.783725+0000","last_became_peered":"2021-10-08T19:31:22.783725+0000","last_unstale":"2021-10-08T19:39:19.956217+0000","last_undegraded":"2021-10-08T19:39:19.956217+0000","last_fullsized":"2021-10-08T19:39:19.956217+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:53.130533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:37:53.130533+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0085012260000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":432,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.958724+0000","last_change":"2021-10-08T19:36:48.881526+0000","last_active":"2021-10-08T19:39:19.958724+0000","last_peered":"2021-10-08T19:39:19.958724+0000","last_clean":"2021-10-08T19:39:19.958724+0000","last_became_active":"2021-10-08T19:29:40.638354+0000","last_became_peered":"2021-10-08T19:29:40.638354+0000","last_unstale":"2021-10-08T19:39:19.958724+0000","last_undegraded":"2021-10-08T19:39:19.958724+0000","last_fullsized":"2021-10-08T19:39:19.958724+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:48.881410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:39.528699+0000","last_clean_scrub_stamp":"2021-10-08T19:36:48.881410+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0060881240000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":365,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.960665+0000","last_change":"2021-10-08T19:39:17.629247+0000","last_active":"2021-10-08T19:39:19.960665+0000","last_peered":"2021-10-08T19:39:19.960665+0000","last_clean":"2021-10-08T19:39:19.960665+0000","last_became_active":"2021-10-08T19:31:22.785590+0000","last_became_peered":"2021-10-08T19:31:22.785590+0000","last_unstale":"2021-10-08T19:39:19.960665+0000","last_undegraded":"2021-10-08T19:39:19.960665+0000","last_fullsized":"2021-10-08T19:39:19.960665+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:17.629178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:17.629178+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001878256,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2","version":"442'1880","reported_seq":1897,"reported_epoch":442,"state":"active+clean","last_fresh":"2021-10-08T19:39:23.923834+0000","last_change":"2021-10-08T19:39:04.513954+0000","last_active":"2021-10-08T19:39:23.923834+0000","last_peered":"2021-10-08T19:39:23.923834+0000","last_clean":"2021-10-08T19:39:23.923834+0000","last_became_active":"2021-10-08T19:39:04.513549+0000","last_became_peered":"2021-10-08T19:39:04.513549+0000","last_unstale":"2021-10-08T19:39:23.923834+0000","last_undegraded":"2021-10-08T19:39:23.923834+0000","last_fullsized":"2021-10-08T19:39:23.923834+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:03.490762+0000","log_size":1880,"ondisk_log_size":1880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":123207680,"num_objects":1880,"num_object_clones":0,"num_object_copies":5640,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1880,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1880,"num_write_kb":120320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.8","version":"90'130","reported_seq":420,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.955837+0000","last_change":"2021-10-08T19:38:00.214648+0000","last_active":"2021-10-08T19:39:19.955837+0000","last_peered":"2021-10-08T19:39:19.955837+0000","last_clean":"2021-10-08T19:39:19.955837+0000","last_became_active":"2021-10-08T19:37:19.009239+0000","last_became_peered":"2021-10-08T19:37:19.009239+0000","last_unstale":"2021-10-08T19:39:19.955837+0000","last_undegraded":"2021-10-08T19:39:19.955837+0000","last_fullsized":"2021-10-08T19:39:19.955837+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:38:00.214557+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:38:00.214557+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013077909,"stat_sum":{"num_bytes":262688,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"289'31","reported_seq":520,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.955244+0000","last_change":"2021-10-08T19:37:52.422769+0000","last_active":"2021-10-08T19:39:19.955244+0000","last_peered":"2021-10-08T19:39:19.955244+0000","last_clean":"2021-10-08T19:39:19.955244+0000","last_became_active":"2021-10-08T19:28:40.099618+0000","last_became_peered":"2021-10-08T19:28:40.099618+0000","last_unstale":"2021-10-08T19:39:19.955244+0000","last_undegraded":"2021-10-08T19:39:19.955244+0000","last_fullsized":"2021-10-08T19:39:19.955244+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'31","last_scrub_stamp":"2021-10-08T19:37:52.422690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:37:52.422690+0000","log_size":31,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.01215956,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":50,"num_read_kb":40,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"61'1","reported_seq":428,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.960243+0000","last_change":"2021-10-08T19:38:32.632445+0000","last_active":"2021-10-08T19:39:19.960243+0000","last_peered":"2021-10-08T19:39:19.960243+0000","last_clean":"2021-10-08T19:39:19.960243+0000","last_became_active":"2021-10-08T19:21:23.607064+0000","last_became_peered":"2021-10-08T19:21:23.607064+0000","last_unstale":"2021-10-08T19:39:19.960243+0000","last_undegraded":"2021-10-08T19:39:19.960243+0000","last_fullsized":"2021-10-08T19:39:19.960243+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'1","last_scrub_stamp":"2021-10-08T19:38:32.632368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:38:32.632368+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011475187,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":272,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.076456+0000","last_change":"2021-10-08T19:38:33.731166+0000","last_active":"2021-10-08T19:39:20.076456+0000","last_peered":"2021-10-08T19:39:20.076456+0000","last_clean":"2021-10-08T19:39:20.076456+0000","last_became_active":"2021-10-08T19:28:40.152478+0000","last_became_peered":"2021-10-08T19:28:40.152478+0000","last_unstale":"2021-10-08T19:39:20.076456+0000","last_undegraded":"2021-10-08T19:39:20.076456+0000","last_fullsized":"2021-10-08T19:39:20.076456+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:33.731025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:30:09.081635+0000","last_clean_scrub_stamp":"2021-10-08T19:38:33.731025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0017739489999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":446,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.072035+0000","last_change":"2021-10-08T19:38:49.157179+0000","last_active":"2021-10-08T19:39:20.072035+0000","last_peered":"2021-10-08T19:39:20.072035+0000","last_clean":"2021-10-08T19:39:20.072035+0000","last_became_active":"2021-10-08T19:29:40.629424+0000","last_became_peered":"2021-10-08T19:29:40.629424+0000","last_unstale":"2021-10-08T19:39:20.072035+0000","last_undegraded":"2021-10-08T19:39:20.072035+0000","last_fullsized":"2021-10-08T19:39:20.072035+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:49.157069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:38:49.157069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.10873358299999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":404,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.967687+0000","last_change":"2021-10-08T19:37:57.261677+0000","last_active":"2021-10-08T19:39:19.967687+0000","last_peered":"2021-10-08T19:39:19.967687+0000","last_clean":"2021-10-08T19:39:19.967687+0000","last_became_active":"2021-10-08T19:31:51.676829+0000","last_became_peered":"2021-10-08T19:31:51.676829+0000","last_unstale":"2021-10-08T19:39:19.967687+0000","last_undegraded":"2021-10-08T19:39:19.967687+0000","last_fullsized":"2021-10-08T19:39:19.967687+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:57.261583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:37:57.261583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.005169168,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"442'1897","reported_seq":1914,"reported_epoch":442,"state":"active+clean","last_fresh":"2021-10-08T19:39:23.700098+0000","last_change":"2021-10-08T19:39:04.509158+0000","last_active":"2021-10-08T19:39:23.700098+0000","last_peered":"2021-10-08T19:39:23.700098+0000","last_clean":"2021-10-08T19:39:23.700098+0000","last_became_active":"2021-10-08T19:39:04.508797+0000","last_became_peered":"2021-10-08T19:39:04.508797+0000","last_unstale":"2021-10-08T19:39:23.700098+0000","last_undegraded":"2021-10-08T19:39:23.700098+0000","last_fullsized":"2021-10-08T19:39:23.700098+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:03.490762+0000","log_size":1897,"ondisk_log_size":1897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":124321792,"num_objects":1897,"num_object_clones":0,"num_object_copies":5691,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1897,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1897,"num_write_kb":121408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1],"acting":[6,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.9","version":"90'130","reported_seq":768,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.958865+0000","last_change":"2021-10-08T19:38:43.587701+0000","last_active":"2021-10-08T19:39:19.958865+0000","last_peered":"2021-10-08T19:39:19.958865+0000","last_clean":"2021-10-08T19:39:19.958865+0000","last_became_active":"2021-10-08T19:29:43.634789+0000","last_became_peered":"2021-10-08T19:29:43.634789+0000","last_unstale":"2021-10-08T19:39:19.958865+0000","last_undegraded":"2021-10-08T19:39:19.958865+0000","last_fullsized":"2021-10-08T19:39:19.958865+0000","mapping_epoch":239,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:38:43.587557+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:38:43.587557+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010306226999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"289'20","reported_seq":531,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.955094+0000","last_change":"2021-10-08T19:37:21.712075+0000","last_active":"2021-10-08T19:39:19.955094+0000","last_peered":"2021-10-08T19:39:19.955094+0000","last_clean":"2021-10-08T19:39:19.955094+0000","last_became_active":"2021-10-08T19:29:40.631807+0000","last_became_peered":"2021-10-08T19:29:40.631807+0000","last_unstale":"2021-10-08T19:39:19.955094+0000","last_undegraded":"2021-10-08T19:39:19.955094+0000","last_fullsized":"2021-10-08T19:39:19.955094+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'20","last_scrub_stamp":"2021-10-08T19:37:21.711953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:37:21.711953+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0046877220000000001,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":292,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.071132+0000","last_change":"2021-10-08T19:38:06.597254+0000","last_active":"2021-10-08T19:39:20.071132+0000","last_peered":"2021-10-08T19:39:20.071132+0000","last_clean":"2021-10-08T19:39:20.071132+0000","last_became_active":"2021-10-08T19:29:40.638988+0000","last_became_peered":"2021-10-08T19:29:40.638988+0000","last_unstale":"2021-10-08T19:39:20.071132+0000","last_undegraded":"2021-10-08T19:39:20.071132+0000","last_fullsized":"2021-10-08T19:39:20.071132+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:06.597140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:38:06.597140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0062006580000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"250'9","reported_seq":657,"reported_epoch":442,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.852136+0000","last_change":"2021-10-08T19:38:31.086180+0000","last_active":"2021-10-08T19:39:20.852136+0000","last_peered":"2021-10-08T19:39:20.852136+0000","last_clean":"2021-10-08T19:39:20.852136+0000","last_became_active":"2021-10-08T19:21:27.637930+0000","last_became_peered":"2021-10-08T19:21:27.637930+0000","last_unstale":"2021-10-08T19:39:20.852136+0000","last_undegraded":"2021-10-08T19:39:20.852136+0000","last_fullsized":"2021-10-08T19:39:20.852136+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'9","last_scrub_stamp":"2021-10-08T19:38:31.086061+0000","last_deep_scrub":"250'9","last_deep_scrub_stamp":"2021-10-08T19:30:04.239189+0000","last_clean_scrub_stamp":"2021-10-08T19:38:31.086061+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0074221679999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":437,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.150023+0000","last_change":"2021-10-08T19:39:20.149864+0000","last_active":"2021-10-08T19:39:20.150023+0000","last_peered":"2021-10-08T19:39:20.150023+0000","last_clean":"2021-10-08T19:39:20.150023+0000","last_became_active":"2021-10-08T19:28:40.100213+0000","last_became_peered":"2021-10-08T19:28:40.100213+0000","last_unstale":"2021-10-08T19:39:20.150023+0000","last_undegraded":"2021-10-08T19:39:20.150023+0000","last_fullsized":"2021-10-08T19:39:20.150023+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:20.149744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:20.149744+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.034036438000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":226,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.077990+0000","last_change":"2021-10-08T19:36:15.769584+0000","last_active":"2021-10-08T19:39:20.077990+0000","last_peered":"2021-10-08T19:39:20.077990+0000","last_clean":"2021-10-08T19:39:20.077990+0000","last_became_active":"2021-10-08T19:29:44.443507+0000","last_became_peered":"2021-10-08T19:29:44.443507+0000","last_unstale":"2021-10-08T19:39:20.077990+0000","last_undegraded":"2021-10-08T19:39:20.077990+0000","last_fullsized":"2021-10-08T19:39:20.077990+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:15.769469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:15.769469+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0068300569999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.0","version":"442'1928","reported_seq":1945,"reported_epoch":442,"state":"active+clean","last_fresh":"2021-10-08T19:39:24.245868+0000","last_change":"2021-10-08T19:39:04.508881+0000","last_active":"2021-10-08T19:39:24.245868+0000","last_peered":"2021-10-08T19:39:24.245868+0000","last_clean":"2021-10-08T19:39:24.245868+0000","last_became_active":"2021-10-08T19:39:04.508607+0000","last_became_peered":"2021-10-08T19:39:04.508607+0000","last_unstale":"2021-10-08T19:39:24.245868+0000","last_undegraded":"2021-10-08T19:39:24.245868+0000","last_fullsized":"2021-10-08T19:39:24.245868+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:03.490762+0000","log_size":1928,"ondisk_log_size":1928,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":126353408,"num_objects":1928,"num_object_clones":0,"num_object_copies":5784,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1928,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1928,"num_write_kb":123392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.a","version":"90'130","reported_seq":360,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.956651+0000","last_change":"2021-10-08T19:38:01.240328+0000","last_active":"2021-10-08T19:39:19.956651+0000","last_peered":"2021-10-08T19:39:19.956651+0000","last_clean":"2021-10-08T19:39:19.956651+0000","last_became_active":"2021-10-08T19:37:19.000525+0000","last_became_peered":"2021-10-08T19:37:19.000525+0000","last_unstale":"2021-10-08T19:39:19.956651+0000","last_undegraded":"2021-10-08T19:39:19.956651+0000","last_fullsized":"2021-10-08T19:39:19.956651+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:38:01.240236+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:38:01.240236+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0043514979999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"289'27","reported_seq":174,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.071760+0000","last_change":"2021-10-08T19:38:08.232601+0000","last_active":"2021-10-08T19:39:20.071760+0000","last_peered":"2021-10-08T19:39:20.071760+0000","last_clean":"2021-10-08T19:39:20.071760+0000","last_became_active":"2021-10-08T19:32:45.162914+0000","last_became_peered":"2021-10-08T19:32:45.162914+0000","last_unstale":"2021-10-08T19:39:20.071760+0000","last_undegraded":"2021-10-08T19:39:20.071760+0000","last_fullsized":"2021-10-08T19:39:20.071760+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'27","last_scrub_stamp":"2021-10-08T19:38:08.232495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:38:08.232495+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012973241999999999,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":550,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":299,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.959046+0000","last_change":"2021-10-08T19:38:47.613118+0000","last_active":"2021-10-08T19:39:19.959046+0000","last_peered":"2021-10-08T19:39:19.959046+0000","last_clean":"2021-10-08T19:39:19.959046+0000","last_became_active":"2021-10-08T19:36:58.004540+0000","last_became_peered":"2021-10-08T19:36:58.004540+0000","last_unstale":"2021-10-08T19:39:19.959046+0000","last_undegraded":"2021-10-08T19:39:19.959046+0000","last_fullsized":"2021-10-08T19:39:19.959046+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:47.613029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:47.613029+0000","last_clean_scrub_stamp":"2021-10-08T19:38:47.613029+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001875493,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"88'9","reported_seq":645,"reported_epoch":442,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.855036+0000","last_change":"2021-10-08T19:37:51.400366+0000","last_active":"2021-10-08T19:39:20.855036+0000","last_peered":"2021-10-08T19:39:20.855036+0000","last_clean":"2021-10-08T19:39:20.855036+0000","last_became_active":"2021-10-08T19:21:27.636432+0000","last_became_peered":"2021-10-08T19:21:27.636432+0000","last_unstale":"2021-10-08T19:39:20.855036+0000","last_undegraded":"2021-10-08T19:39:20.855036+0000","last_fullsized":"2021-10-08T19:39:20.855036+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'9","last_scrub_stamp":"2021-10-08T19:37:51.400280+0000","last_deep_scrub":"88'9","last_deep_scrub_stamp":"2021-10-08T19:23:00.048245+0000","last_clean_scrub_stamp":"2021-10-08T19:37:51.400280+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010321472999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":227,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.075191+0000","last_change":"2021-10-08T19:37:54.590428+0000","last_active":"2021-10-08T19:39:20.075191+0000","last_peered":"2021-10-08T19:39:20.075191+0000","last_clean":"2021-10-08T19:39:20.075191+0000","last_became_active":"2021-10-08T19:37:19.016085+0000","last_became_peered":"2021-10-08T19:37:19.016085+0000","last_unstale":"2021-10-08T19:39:20.075191+0000","last_undegraded":"2021-10-08T19:39:20.075191+0000","last_fullsized":"2021-10-08T19:39:20.075191+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:54.590301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:37:54.590301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.095282983000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"70'5","reported_seq":226,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.073046+0000","last_change":"2021-10-08T19:36:08.760775+0000","last_active":"2021-10-08T19:39:20.073046+0000","last_peered":"2021-10-08T19:39:20.073046+0000","last_clean":"2021-10-08T19:39:20.073046+0000","last_became_active":"2021-10-08T19:29:40.639786+0000","last_became_peered":"2021-10-08T19:29:40.639786+0000","last_unstale":"2021-10-08T19:39:20.073046+0000","last_undegraded":"2021-10-08T19:39:20.073046+0000","last_fullsized":"2021-10-08T19:39:20.073046+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:36:08.760670+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2021-10-08T19:36:08.760670+0000","last_clean_scrub_stamp":"2021-10-08T19:36:08.760670+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011613982,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1","version":"442'1901","reported_seq":1918,"reported_epoch":442,"state":"active+clean","last_fresh":"2021-10-08T19:39:23.709106+0000","last_change":"2021-10-08T19:39:04.511987+0000","last_active":"2021-10-08T19:39:23.709106+0000","last_peered":"2021-10-08T19:39:23.709106+0000","last_clean":"2021-10-08T19:39:23.709106+0000","last_became_active":"2021-10-08T19:39:04.511690+0000","last_became_peered":"2021-10-08T19:39:04.511690+0000","last_unstale":"2021-10-08T19:39:23.709106+0000","last_undegraded":"2021-10-08T19:39:23.709106+0000","last_fullsized":"2021-10-08T19:39:23.709106+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:03.490762+0000","log_size":1901,"ondisk_log_size":1901,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":124583936,"num_objects":1901,"num_object_clones":0,"num_object_copies":5703,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1901,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1901,"num_write_kb":121664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"289'19","reported_seq":597,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.954833+0000","last_change":"2021-10-08T19:38:38.216245+0000","last_active":"2021-10-08T19:39:19.954833+0000","last_peered":"2021-10-08T19:39:19.954833+0000","last_clean":"2021-10-08T19:39:19.954833+0000","last_became_active":"2021-10-08T19:31:51.677509+0000","last_became_peered":"2021-10-08T19:31:51.677509+0000","last_unstale":"2021-10-08T19:39:19.954833+0000","last_undegraded":"2021-10-08T19:39:19.954833+0000","last_fullsized":"2021-10-08T19:39:19.954833+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:38:38.216137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:38:38.216137+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0059711859999999999,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":770,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":455,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.958800+0000","last_change":"2021-10-08T19:39:09.585407+0000","last_active":"2021-10-08T19:39:19.958800+0000","last_peered":"2021-10-08T19:39:19.958800+0000","last_clean":"2021-10-08T19:39:19.958800+0000","last_became_active":"2021-10-08T19:36:58.001610+0000","last_became_peered":"2021-10-08T19:36:58.001610+0000","last_unstale":"2021-10-08T19:39:19.958800+0000","last_undegraded":"2021-10-08T19:39:19.958800+0000","last_fullsized":"2021-10-08T19:39:19.958800+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:09.585318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:09.585318+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002054714,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":133,"reported_epoch":442,"state":"active+clean","last_fresh":"2021-10-08T19:39:21.090832+0000","last_change":"2021-10-08T19:39:21.090794+0000","last_active":"2021-10-08T19:39:21.090832+0000","last_peered":"2021-10-08T19:39:21.090832+0000","last_clean":"2021-10-08T19:39:21.090832+0000","last_became_active":"2021-10-08T19:37:18.997446+0000","last_became_peered":"2021-10-08T19:37:18.997446+0000","last_unstale":"2021-10-08T19:39:21.090832+0000","last_undegraded":"2021-10-08T19:39:21.090832+0000","last_fullsized":"2021-10-08T19:39:21.090832+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:21.090701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:39:21.090701+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001395486,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":232,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.077819+0000","last_change":"2021-10-08T19:36:43.015897+0000","last_active":"2021-10-08T19:39:20.077819+0000","last_peered":"2021-10-08T19:39:20.077819+0000","last_clean":"2021-10-08T19:39:20.077819+0000","last_became_active":"2021-10-08T19:29:40.638099+0000","last_became_peered":"2021-10-08T19:29:40.638099+0000","last_unstale":"2021-10-08T19:39:20.077819+0000","last_undegraded":"2021-10-08T19:39:20.077819+0000","last_fullsized":"2021-10-08T19:39:20.077819+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:43.015835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:17.422176+0000","last_clean_scrub_stamp":"2021-10-08T19:36:43.015835+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003426634,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":370,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.955453+0000","last_change":"2021-10-08T19:38:03.310863+0000","last_active":"2021-10-08T19:39:19.955453+0000","last_peered":"2021-10-08T19:39:19.955453+0000","last_clean":"2021-10-08T19:39:19.955453+0000","last_became_active":"2021-10-08T19:24:13.506602+0000","last_became_peered":"2021-10-08T19:24:13.506602+0000","last_unstale":"2021-10-08T19:39:19.955453+0000","last_undegraded":"2021-10-08T19:39:19.955453+0000","last_fullsized":"2021-10-08T19:39:19.955453+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:03.310761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:38:03.310761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0095709139999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"442'1885","reported_seq":1902,"reported_epoch":442,"state":"active+clean","last_fresh":"2021-10-08T19:39:23.474915+0000","last_change":"2021-10-08T19:39:04.506038+0000","last_active":"2021-10-08T19:39:23.474915+0000","last_peered":"2021-10-08T19:39:23.474915+0000","last_clean":"2021-10-08T19:39:23.474915+0000","last_became_active":"2021-10-08T19:39:04.505739+0000","last_became_peered":"2021-10-08T19:39:04.505739+0000","last_unstale":"2021-10-08T19:39:23.474915+0000","last_undegraded":"2021-10-08T19:39:23.474915+0000","last_fullsized":"2021-10-08T19:39:23.474915+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:03.490762+0000","log_size":1885,"ondisk_log_size":1885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":123535360,"num_objects":1885,"num_object_clones":0,"num_object_copies":5655,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1885,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1885,"num_write_kb":120640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7],"acting":[4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"90'130","reported_seq":556,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.077740+0000","last_change":"2021-10-08T19:36:05.771481+0000","last_active":"2021-10-08T19:39:20.077740+0000","last_peered":"2021-10-08T19:39:20.077740+0000","last_clean":"2021-10-08T19:39:20.077740+0000","last_became_active":"2021-10-08T19:29:43.636733+0000","last_became_peered":"2021-10-08T19:29:43.636733+0000","last_unstale":"2021-10-08T19:39:20.077740+0000","last_undegraded":"2021-10-08T19:39:20.077740+0000","last_fullsized":"2021-10-08T19:39:20.077740+0000","mapping_epoch":239,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:36:05.771344+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:36:05.771344+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014695206000000001,"stat_sum":{"num_bytes":327680,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"238'13","reported_seq":359,"reported_epoch":442,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.860247+0000","last_change":"2021-10-08T19:38:32.165269+0000","last_active":"2021-10-08T19:39:20.860247+0000","last_peered":"2021-10-08T19:39:20.860247+0000","last_clean":"2021-10-08T19:39:20.860247+0000","last_became_active":"2021-10-08T19:29:40.640248+0000","last_became_peered":"2021-10-08T19:29:40.640248+0000","last_unstale":"2021-10-08T19:39:20.860247+0000","last_undegraded":"2021-10-08T19:39:20.860247+0000","last_fullsized":"2021-10-08T19:39:20.860247+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"238'13","last_scrub_stamp":"2021-10-08T19:38:32.165194+0000","last_deep_scrub":"91'9","last_deep_scrub_stamp":"2021-10-08T19:23:32.329475+0000","last_clean_scrub_stamp":"2021-10-08T19:38:32.165194+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0056171720000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"289'28","reported_seq":515,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.955117+0000","last_change":"2021-10-08T19:39:11.026869+0000","last_active":"2021-10-08T19:39:19.955117+0000","last_peered":"2021-10-08T19:39:19.955117+0000","last_clean":"2021-10-08T19:39:19.955117+0000","last_became_active":"2021-10-08T19:24:25.098743+0000","last_became_peered":"2021-10-08T19:24:25.098743+0000","last_unstale":"2021-10-08T19:39:19.955117+0000","last_undegraded":"2021-10-08T19:39:19.955117+0000","last_fullsized":"2021-10-08T19:39:19.955117+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'28","last_scrub_stamp":"2021-10-08T19:39:11.026789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:39:11.026789+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0043294240000000001,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":42,"num_read_kb":35,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":386,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.967920+0000","last_change":"2021-10-08T19:39:14.201859+0000","last_active":"2021-10-08T19:39:19.967920+0000","last_peered":"2021-10-08T19:39:19.967920+0000","last_clean":"2021-10-08T19:39:19.967920+0000","last_became_active":"2021-10-08T19:37:45.829953+0000","last_became_peered":"2021-10-08T19:37:45.829953+0000","last_unstale":"2021-10-08T19:39:19.967920+0000","last_undegraded":"2021-10-08T19:39:19.967920+0000","last_fullsized":"2021-10-08T19:39:19.967920+0000","mapping_epoch":407,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":408,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:14.201773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:14.201773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0032499429999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,2],"acting":[6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":438,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.960728+0000","last_change":"2021-10-08T19:37:52.836635+0000","last_active":"2021-10-08T19:39:19.960728+0000","last_peered":"2021-10-08T19:39:19.960728+0000","last_clean":"2021-10-08T19:39:19.960728+0000","last_became_active":"2021-10-08T19:24:25.094848+0000","last_became_peered":"2021-10-08T19:24:25.094848+0000","last_unstale":"2021-10-08T19:39:19.960728+0000","last_undegraded":"2021-10-08T19:39:19.960728+0000","last_fullsized":"2021-10-08T19:39:19.960728+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:52.836518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:37:52.836518+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.079698321000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":393,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.958028+0000","last_change":"2021-10-08T19:37:51.046331+0000","last_active":"2021-10-08T19:39:19.958028+0000","last_peered":"2021-10-08T19:39:19.958028+0000","last_clean":"2021-10-08T19:39:19.958028+0000","last_became_active":"2021-10-08T19:28:40.132751+0000","last_became_peered":"2021-10-08T19:28:40.132751+0000","last_unstale":"2021-10-08T19:39:19.958028+0000","last_undegraded":"2021-10-08T19:39:19.958028+0000","last_fullsized":"2021-10-08T19:39:19.958028+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:51.046234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:37:51.046234+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0044534300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.f","version":"442'1840","reported_seq":1857,"reported_epoch":442,"state":"active+clean","last_fresh":"2021-10-08T19:39:23.706258+0000","last_change":"2021-10-08T19:39:04.510165+0000","last_active":"2021-10-08T19:39:23.706258+0000","last_peered":"2021-10-08T19:39:23.706258+0000","last_clean":"2021-10-08T19:39:23.706258+0000","last_became_active":"2021-10-08T19:39:04.509869+0000","last_became_peered":"2021-10-08T19:39:04.509869+0000","last_unstale":"2021-10-08T19:39:23.706258+0000","last_undegraded":"2021-10-08T19:39:23.706258+0000","last_fullsized":"2021-10-08T19:39:23.706258+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:03.490762+0000","log_size":1840,"ondisk_log_size":1840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":120586240,"num_objects":1840,"num_object_clones":0,"num_object_copies":5520,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1840,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1840,"num_write_kb":117760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.5","version":"90'130","reported_seq":596,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.954402+0000","last_change":"2021-10-08T19:36:43.505866+0000","last_active":"2021-10-08T19:39:19.954402+0000","last_peered":"2021-10-08T19:39:19.954402+0000","last_clean":"2021-10-08T19:39:19.954402+0000","last_became_active":"2021-10-08T19:27:26.590651+0000","last_became_peered":"2021-10-08T19:27:26.590651+0000","last_unstale":"2021-10-08T19:39:19.954402+0000","last_undegraded":"2021-10-08T19:39:19.954402+0000","last_fullsized":"2021-10-08T19:39:19.954402+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:36:43.505746+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:32:14.582883+0000","last_clean_scrub_stamp":"2021-10-08T19:36:43.505746+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003205388,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":433,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.955422+0000","last_change":"2021-10-08T19:36:42.480557+0000","last_active":"2021-10-08T19:39:19.955422+0000","last_peered":"2021-10-08T19:39:19.955422+0000","last_clean":"2021-10-08T19:39:19.955422+0000","last_became_active":"2021-10-08T19:29:40.639405+0000","last_became_peered":"2021-10-08T19:29:40.639405+0000","last_unstale":"2021-10-08T19:39:19.955422+0000","last_undegraded":"2021-10-08T19:39:19.955422+0000","last_fullsized":"2021-10-08T19:39:19.955422+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:42.480429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:36:42.480429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0070932640000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"289'30","reported_seq":268,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.963957+0000","last_change":"2021-10-08T19:37:55.431244+0000","last_active":"2021-10-08T19:39:19.963957+0000","last_peered":"2021-10-08T19:39:19.963957+0000","last_clean":"2021-10-08T19:39:19.963957+0000","last_became_active":"2021-10-08T19:29:40.635007+0000","last_became_peered":"2021-10-08T19:29:40.635007+0000","last_unstale":"2021-10-08T19:39:19.963957+0000","last_undegraded":"2021-10-08T19:39:19.963957+0000","last_fullsized":"2021-10-08T19:39:19.963957+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'30","last_scrub_stamp":"2021-10-08T19:37:55.431161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:37:55.431161+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0042801929999999998,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":51,"num_read_kb":39,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":275,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.075629+0000","last_change":"2021-10-08T19:38:42.717018+0000","last_active":"2021-10-08T19:39:20.075629+0000","last_peered":"2021-10-08T19:39:20.075629+0000","last_clean":"2021-10-08T19:39:20.075629+0000","last_became_active":"2021-10-08T19:36:58.013501+0000","last_became_peered":"2021-10-08T19:36:58.013501+0000","last_unstale":"2021-10-08T19:39:20.075629+0000","last_undegraded":"2021-10-08T19:39:20.075629+0000","last_fullsized":"2021-10-08T19:39:20.075629+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:42.716926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:07.710367+0000","last_clean_scrub_stamp":"2021-10-08T19:38:42.716926+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0044019300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":431,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.954654+0000","last_change":"2021-10-08T19:37:55.342916+0000","last_active":"2021-10-08T19:39:19.954654+0000","last_peered":"2021-10-08T19:39:19.954654+0000","last_clean":"2021-10-08T19:39:19.954654+0000","last_became_active":"2021-10-08T19:29:40.638253+0000","last_became_peered":"2021-10-08T19:29:40.638253+0000","last_unstale":"2021-10-08T19:39:19.954654+0000","last_undegraded":"2021-10-08T19:39:19.954654+0000","last_fullsized":"2021-10-08T19:39:19.954654+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:55.342809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:37:55.342809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0074854370000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":226,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.078196+0000","last_change":"2021-10-08T19:36:10.804434+0000","last_active":"2021-10-08T19:39:20.078196+0000","last_peered":"2021-10-08T19:39:20.078196+0000","last_clean":"2021-10-08T19:39:20.078196+0000","last_became_active":"2021-10-08T19:29:40.634579+0000","last_became_peered":"2021-10-08T19:29:40.634579+0000","last_unstale":"2021-10-08T19:39:20.078196+0000","last_undegraded":"2021-10-08T19:39:20.078196+0000","last_fullsized":"2021-10-08T19:39:20.078196+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:10.804325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:10.804325+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0063916950000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"442'1949","reported_seq":1966,"reported_epoch":442,"state":"active+clean","last_fresh":"2021-10-08T19:39:24.268295+0000","last_change":"2021-10-08T19:39:04.508265+0000","last_active":"2021-10-08T19:39:24.268295+0000","last_peered":"2021-10-08T19:39:24.268295+0000","last_clean":"2021-10-08T19:39:24.268295+0000","last_became_active":"2021-10-08T19:39:04.507950+0000","last_became_peered":"2021-10-08T19:39:04.507950+0000","last_unstale":"2021-10-08T19:39:24.268295+0000","last_undegraded":"2021-10-08T19:39:24.268295+0000","last_fullsized":"2021-10-08T19:39:24.268295+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:03.490762+0000","log_size":1949,"ondisk_log_size":1949,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":127729664,"num_objects":1949,"num_object_clones":0,"num_object_copies":5847,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1949,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1949,"num_write_kb":124736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,4],"acting":[1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"90'130","reported_seq":537,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.968003+0000","last_change":"2021-10-08T19:38:48.375633+0000","last_active":"2021-10-08T19:39:19.968003+0000","last_peered":"2021-10-08T19:39:19.968003+0000","last_clean":"2021-10-08T19:39:19.968003+0000","last_became_active":"2021-10-08T19:30:00.643797+0000","last_became_peered":"2021-10-08T19:30:00.643797+0000","last_unstale":"2021-10-08T19:39:19.968003+0000","last_undegraded":"2021-10-08T19:39:19.968003+0000","last_fullsized":"2021-10-08T19:39:19.968003+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:38:48.375537+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:38:48.375537+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001929933,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":374,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.967528+0000","last_change":"2021-10-08T19:38:39.326995+0000","last_active":"2021-10-08T19:39:19.967528+0000","last_peered":"2021-10-08T19:39:19.967528+0000","last_clean":"2021-10-08T19:39:19.967528+0000","last_became_active":"2021-10-08T19:24:25.095389+0000","last_became_peered":"2021-10-08T19:24:25.095389+0000","last_unstale":"2021-10-08T19:39:19.967528+0000","last_undegraded":"2021-10-08T19:39:19.967528+0000","last_fullsized":"2021-10-08T19:39:19.967528+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:39.326929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:38:39.326929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0043694370000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"289'29","reported_seq":475,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.071522+0000","last_change":"2021-10-08T19:38:52.976796+0000","last_active":"2021-10-08T19:39:20.071522+0000","last_peered":"2021-10-08T19:39:20.071522+0000","last_clean":"2021-10-08T19:39:20.071522+0000","last_became_active":"2021-10-08T19:21:25.741812+0000","last_became_peered":"2021-10-08T19:21:25.741812+0000","last_unstale":"2021-10-08T19:39:20.071522+0000","last_undegraded":"2021-10-08T19:39:20.071522+0000","last_fullsized":"2021-10-08T19:39:20.071522+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'29","last_scrub_stamp":"2021-10-08T19:38:52.976718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:38:52.976718+0000","log_size":29,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0031034550000000002,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":54,"num_read_kb":40,"num_write":32,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"328'2","reported_seq":445,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.961635+0000","last_change":"2021-10-08T19:39:10.604166+0000","last_active":"2021-10-08T19:39:19.961635+0000","last_peered":"2021-10-08T19:39:19.961635+0000","last_clean":"2021-10-08T19:39:19.961635+0000","last_became_active":"2021-10-08T19:36:58.000171+0000","last_became_peered":"2021-10-08T19:36:58.000171+0000","last_unstale":"2021-10-08T19:39:19.961635+0000","last_undegraded":"2021-10-08T19:39:19.961635+0000","last_fullsized":"2021-10-08T19:39:19.961635+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"328'2","last_scrub_stamp":"2021-10-08T19:39:10.604077+0000","last_deep_scrub":"328'2","last_deep_scrub_stamp":"2021-10-08T19:33:29.990395+0000","last_clean_scrub_stamp":"2021-10-08T19:39:10.604077+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0017862959999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":266,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.958964+0000","last_change":"2021-10-08T19:37:55.594168+0000","last_active":"2021-10-08T19:39:19.958964+0000","last_peered":"2021-10-08T19:39:19.958964+0000","last_clean":"2021-10-08T19:39:19.958964+0000","last_became_active":"2021-10-08T19:28:40.140876+0000","last_became_peered":"2021-10-08T19:28:40.140876+0000","last_unstale":"2021-10-08T19:39:19.958964+0000","last_undegraded":"2021-10-08T19:39:19.958964+0000","last_fullsized":"2021-10-08T19:39:19.958964+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:55.594051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:37:55.594051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.083118095000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"70'5","reported_seq":272,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.076678+0000","last_change":"2021-10-08T19:38:38.667059+0000","last_active":"2021-10-08T19:39:20.076678+0000","last_peered":"2021-10-08T19:39:20.076678+0000","last_clean":"2021-10-08T19:39:20.076678+0000","last_became_active":"2021-10-08T19:28:40.150503+0000","last_became_peered":"2021-10-08T19:28:40.150503+0000","last_unstale":"2021-10-08T19:39:20.076678+0000","last_undegraded":"2021-10-08T19:39:20.076678+0000","last_fullsized":"2021-10-08T19:39:20.076678+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:38:38.666933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:38:38.666933+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0081526670000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.9","version":"442'2006","reported_seq":2023,"reported_epoch":442,"state":"active+clean","last_fresh":"2021-10-08T19:39:24.202070+0000","last_change":"2021-10-08T19:39:04.512253+0000","last_active":"2021-10-08T19:39:24.202070+0000","last_peered":"2021-10-08T19:39:24.202070+0000","last_clean":"2021-10-08T19:39:24.202070+0000","last_became_active":"2021-10-08T19:39:04.511738+0000","last_became_peered":"2021-10-08T19:39:04.511738+0000","last_unstale":"2021-10-08T19:39:24.202070+0000","last_undegraded":"2021-10-08T19:39:24.202070+0000","last_fullsized":"2021-10-08T19:39:24.202070+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:03.490762+0000","log_size":2006,"ondisk_log_size":2006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":131465216,"num_objects":2006,"num_object_clones":0,"num_object_copies":6018,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2006,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2006,"num_write_kb":128384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"90'130","reported_seq":573,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.074596+0000","last_change":"2021-10-08T19:39:12.712490+0000","last_active":"2021-10-08T19:39:20.074596+0000","last_peered":"2021-10-08T19:39:20.074596+0000","last_clean":"2021-10-08T19:39:20.074596+0000","last_became_active":"2021-10-08T19:28:43.178371+0000","last_became_peered":"2021-10-08T19:28:43.178371+0000","last_unstale":"2021-10-08T19:39:20.074596+0000","last_undegraded":"2021-10-08T19:39:20.074596+0000","last_fullsized":"2021-10-08T19:39:20.074596+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:39:12.712371+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:34:13.653248+0000","last_clean_scrub_stamp":"2021-10-08T19:39:12.712371+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0024492619999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":186,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.965517+0000","last_change":"2021-10-08T19:38:32.463211+0000","last_active":"2021-10-08T19:39:19.965517+0000","last_peered":"2021-10-08T19:39:19.965517+0000","last_clean":"2021-10-08T19:39:19.965517+0000","last_became_active":"2021-10-08T19:31:22.783759+0000","last_became_peered":"2021-10-08T19:31:22.783759+0000","last_unstale":"2021-10-08T19:39:19.965517+0000","last_undegraded":"2021-10-08T19:39:19.965517+0000","last_fullsized":"2021-10-08T19:39:19.965517+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:32.463096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:38:32.463096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.030313300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"289'24","reported_seq":527,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.071459+0000","last_change":"2021-10-08T19:38:42.136633+0000","last_active":"2021-10-08T19:39:20.071459+0000","last_peered":"2021-10-08T19:39:20.071459+0000","last_clean":"2021-10-08T19:39:20.071459+0000","last_became_active":"2021-10-08T19:32:45.154743+0000","last_became_peered":"2021-10-08T19:32:45.154743+0000","last_unstale":"2021-10-08T19:39:20.071459+0000","last_undegraded":"2021-10-08T19:39:20.071459+0000","last_fullsized":"2021-10-08T19:39:20.071459+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'24","last_scrub_stamp":"2021-10-08T19:38:42.136529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:38:42.136529+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012781328,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":30,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":432,"reported_epoch":442,"state":"active+clean","last_fresh":"2021-10-08T19:39:22.163826+0000","last_change":"2021-10-08T19:39:22.163784+0000","last_active":"2021-10-08T19:39:22.163826+0000","last_peered":"2021-10-08T19:39:22.163826+0000","last_clean":"2021-10-08T19:39:22.163826+0000","last_became_active":"2021-10-08T19:36:58.012034+0000","last_became_peered":"2021-10-08T19:36:58.012034+0000","last_unstale":"2021-10-08T19:39:22.163826+0000","last_undegraded":"2021-10-08T19:39:22.163826+0000","last_fullsized":"2021-10-08T19:39:22.163826+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:22.163674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:22.163674+0000","last_clean_scrub_stamp":"2021-10-08T19:39:22.163674+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.019072321,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":456,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.957696+0000","last_change":"2021-10-08T19:37:59.963810+0000","last_active":"2021-10-08T19:39:19.957696+0000","last_peered":"2021-10-08T19:39:19.957696+0000","last_clean":"2021-10-08T19:39:19.957696+0000","last_became_active":"2021-10-08T19:29:40.632010+0000","last_became_peered":"2021-10-08T19:29:40.632010+0000","last_unstale":"2021-10-08T19:39:19.957696+0000","last_undegraded":"2021-10-08T19:39:19.957696+0000","last_fullsized":"2021-10-08T19:39:19.957696+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:59.963721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:37:59.963721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0066016690000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":174,"reported_epoch":442,"state":"active+clean","last_fresh":"2021-10-08T19:39:22.680335+0000","last_change":"2021-10-08T19:39:22.680310+0000","last_active":"2021-10-08T19:39:22.680335+0000","last_peered":"2021-10-08T19:39:22.680335+0000","last_clean":"2021-10-08T19:39:22.680335+0000","last_became_active":"2021-10-08T19:31:51.673821+0000","last_became_peered":"2021-10-08T19:31:51.673821+0000","last_unstale":"2021-10-08T19:39:22.680335+0000","last_undegraded":"2021-10-08T19:39:22.680335+0000","last_fullsized":"2021-10-08T19:39:22.680335+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:22.680215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:21.644827+0000","last_clean_scrub_stamp":"2021-10-08T19:39:22.680215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002643659,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.a","version":"442'1938","reported_seq":1955,"reported_epoch":442,"state":"active+clean","last_fresh":"2021-10-08T19:39:24.202118+0000","last_change":"2021-10-08T19:39:04.774934+0000","last_active":"2021-10-08T19:39:24.202118+0000","last_peered":"2021-10-08T19:39:24.202118+0000","last_clean":"2021-10-08T19:39:24.202118+0000","last_became_active":"2021-10-08T19:39:04.774503+0000","last_became_peered":"2021-10-08T19:39:04.774503+0000","last_unstale":"2021-10-08T19:39:24.202118+0000","last_undegraded":"2021-10-08T19:39:24.202118+0000","last_fullsized":"2021-10-08T19:39:24.202118+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:03.490762+0000","log_size":1938,"ondisk_log_size":1938,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":127008768,"num_objects":1938,"num_object_clones":0,"num_object_copies":5814,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1938,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1938,"num_write_kb":124032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":416,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.960666+0000","last_change":"2021-10-08T19:37:22.697805+0000","last_active":"2021-10-08T19:39:19.960666+0000","last_peered":"2021-10-08T19:39:19.960666+0000","last_clean":"2021-10-08T19:39:19.960666+0000","last_became_active":"2021-10-08T19:21:27.636086+0000","last_became_peered":"2021-10-08T19:21:27.636086+0000","last_unstale":"2021-10-08T19:39:19.960666+0000","last_undegraded":"2021-10-08T19:39:19.960666+0000","last_fullsized":"2021-10-08T19:39:19.960666+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:22.697722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:37:22.697722+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010100266,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"289'26","reported_seq":402,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.967695+0000","last_change":"2021-10-08T19:36:43.949273+0000","last_active":"2021-10-08T19:39:19.967695+0000","last_peered":"2021-10-08T19:39:19.967695+0000","last_clean":"2021-10-08T19:39:19.967695+0000","last_became_active":"2021-10-08T19:24:25.100384+0000","last_became_peered":"2021-10-08T19:24:25.100384+0000","last_unstale":"2021-10-08T19:39:19.967695+0000","last_undegraded":"2021-10-08T19:39:19.967695+0000","last_fullsized":"2021-10-08T19:39:19.967695+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'26","last_scrub_stamp":"2021-10-08T19:36:43.949161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:43.949161+0000","log_size":26,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011337099,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":42,"num_read_kb":32,"num_write":25,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"90'130","reported_seq":735,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.958749+0000","last_change":"2021-10-08T19:39:15.614628+0000","last_active":"2021-10-08T19:39:19.958749+0000","last_peered":"2021-10-08T19:39:19.958749+0000","last_clean":"2021-10-08T19:39:19.958749+0000","last_became_active":"2021-10-08T19:27:22.607289+0000","last_became_peered":"2021-10-08T19:27:22.607289+0000","last_unstale":"2021-10-08T19:39:19.958749+0000","last_undegraded":"2021-10-08T19:39:19.958749+0000","last_fullsized":"2021-10-08T19:39:19.958749+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:39:15.614552+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:39:15.614552+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0018892329999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":434,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.956359+0000","last_change":"2021-10-08T19:38:09.230388+0000","last_active":"2021-10-08T19:39:19.956359+0000","last_peered":"2021-10-08T19:39:19.956359+0000","last_clean":"2021-10-08T19:39:19.956359+0000","last_became_active":"2021-10-08T19:37:45.837378+0000","last_became_peered":"2021-10-08T19:37:45.837378+0000","last_unstale":"2021-10-08T19:39:19.956359+0000","last_undegraded":"2021-10-08T19:39:19.956359+0000","last_fullsized":"2021-10-08T19:39:19.956359+0000","mapping_epoch":407,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":408,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:09.230297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:38:09.230297+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0072500209999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":232,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.075216+0000","last_change":"2021-10-08T19:39:19.171728+0000","last_active":"2021-10-08T19:39:20.075216+0000","last_peered":"2021-10-08T19:39:20.075216+0000","last_clean":"2021-10-08T19:39:20.075216+0000","last_became_active":"2021-10-08T19:29:40.638774+0000","last_became_peered":"2021-10-08T19:29:40.638774+0000","last_unstale":"2021-10-08T19:39:20.075216+0000","last_undegraded":"2021-10-08T19:39:20.075216+0000","last_fullsized":"2021-10-08T19:39:20.075216+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:19.171649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:19.171649+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.008189689,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":261,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.078355+0000","last_change":"2021-10-08T19:38:40.123422+0000","last_active":"2021-10-08T19:39:20.078355+0000","last_peered":"2021-10-08T19:39:20.078355+0000","last_clean":"2021-10-08T19:39:20.078355+0000","last_became_active":"2021-10-08T19:37:19.006459+0000","last_became_peered":"2021-10-08T19:37:19.006459+0000","last_unstale":"2021-10-08T19:39:20.078355+0000","last_undegraded":"2021-10-08T19:39:20.078355+0000","last_fullsized":"2021-10-08T19:39:20.078355+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:40.123325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:32:15.872860+0000","last_clean_scrub_stamp":"2021-10-08T19:38:40.123325+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.103398937,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4],"acting":[3,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"442'1967","reported_seq":1984,"reported_epoch":442,"state":"active+clean","last_fresh":"2021-10-08T19:39:24.201534+0000","last_change":"2021-10-08T19:39:04.774874+0000","last_active":"2021-10-08T19:39:24.201534+0000","last_peered":"2021-10-08T19:39:24.201534+0000","last_clean":"2021-10-08T19:39:24.201534+0000","last_became_active":"2021-10-08T19:39:04.774530+0000","last_became_peered":"2021-10-08T19:39:04.774530+0000","last_unstale":"2021-10-08T19:39:24.201534+0000","last_undegraded":"2021-10-08T19:39:24.201534+0000","last_fullsized":"2021-10-08T19:39:24.201534+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:03.490762+0000","log_size":1967,"ondisk_log_size":1967,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":128909312,"num_objects":1967,"num_object_clones":0,"num_object_copies":5901,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1967,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1967,"num_write_kb":125888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"90'130","reported_seq":737,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.959918+0000","last_change":"2021-10-08T19:36:11.798375+0000","last_active":"2021-10-08T19:39:19.959918+0000","last_peered":"2021-10-08T19:39:19.959918+0000","last_clean":"2021-10-08T19:39:19.959918+0000","last_became_active":"2021-10-08T19:27:26.591250+0000","last_became_peered":"2021-10-08T19:27:26.591250+0000","last_unstale":"2021-10-08T19:39:19.959918+0000","last_undegraded":"2021-10-08T19:39:19.959918+0000","last_fullsized":"2021-10-08T19:39:19.959918+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:36:11.798245+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:36:11.798245+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013110805,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":432,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.071447+0000","last_change":"2021-10-08T19:38:48.099839+0000","last_active":"2021-10-08T19:39:20.071447+0000","last_peered":"2021-10-08T19:39:20.071447+0000","last_clean":"2021-10-08T19:39:20.071447+0000","last_became_active":"2021-10-08T19:21:27.637875+0000","last_became_peered":"2021-10-08T19:21:27.637875+0000","last_unstale":"2021-10-08T19:39:20.071447+0000","last_undegraded":"2021-10-08T19:39:20.071447+0000","last_fullsized":"2021-10-08T19:39:20.071447+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:48.099755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:20.092069+0000","last_clean_scrub_stamp":"2021-10-08T19:38:48.099755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0076330690000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"289'17","reported_seq":180,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.076382+0000","last_change":"2021-10-08T19:38:05.629718+0000","last_active":"2021-10-08T19:39:20.076382+0000","last_peered":"2021-10-08T19:39:20.076382+0000","last_clean":"2021-10-08T19:39:20.076382+0000","last_became_active":"2021-10-08T19:31:51.674965+0000","last_became_peered":"2021-10-08T19:31:51.674965+0000","last_unstale":"2021-10-08T19:39:20.076382+0000","last_undegraded":"2021-10-08T19:39:20.076382+0000","last_fullsized":"2021-10-08T19:39:20.076382+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'17","last_scrub_stamp":"2021-10-08T19:38:05.629630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:38:05.629630+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0080242690000000005,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":23,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":990,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":463,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.956571+0000","last_change":"2021-10-08T19:39:19.068051+0000","last_active":"2021-10-08T19:39:19.956571+0000","last_peered":"2021-10-08T19:39:19.956571+0000","last_clean":"2021-10-08T19:39:19.956571+0000","last_became_active":"2021-10-08T19:36:58.015216+0000","last_became_peered":"2021-10-08T19:36:58.015216+0000","last_unstale":"2021-10-08T19:39:19.956571+0000","last_undegraded":"2021-10-08T19:39:19.956571+0000","last_fullsized":"2021-10-08T19:39:19.956571+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:19.067941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:19.067941+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0043419399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"70'5","reported_seq":270,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.959025+0000","last_change":"2021-10-08T19:36:44.490475+0000","last_active":"2021-10-08T19:39:19.959025+0000","last_peered":"2021-10-08T19:39:19.959025+0000","last_clean":"2021-10-08T19:39:19.959025+0000","last_became_active":"2021-10-08T19:28:40.148054+0000","last_became_peered":"2021-10-08T19:28:40.148054+0000","last_unstale":"2021-10-08T19:39:19.959025+0000","last_undegraded":"2021-10-08T19:39:19.959025+0000","last_fullsized":"2021-10-08T19:39:19.959025+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:36:44.490372+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2021-10-08T19:34:18.630378+0000","last_clean_scrub_stamp":"2021-10-08T19:36:44.490372+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0089419340000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":450,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.961551+0000","last_change":"2021-10-08T19:38:37.610892+0000","last_active":"2021-10-08T19:39:19.961551+0000","last_peered":"2021-10-08T19:39:19.961551+0000","last_clean":"2021-10-08T19:39:19.961551+0000","last_became_active":"2021-10-08T19:29:40.652528+0000","last_became_peered":"2021-10-08T19:29:40.652528+0000","last_unstale":"2021-10-08T19:39:19.961551+0000","last_undegraded":"2021-10-08T19:39:19.961551+0000","last_fullsized":"2021-10-08T19:39:19.961551+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:37.610765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:38:37.610765+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.053777754999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"442'2012","reported_seq":2029,"reported_epoch":442,"state":"active+clean","last_fresh":"2021-10-08T19:39:24.208353+0000","last_change":"2021-10-08T19:39:04.512013+0000","last_active":"2021-10-08T19:39:24.208353+0000","last_peered":"2021-10-08T19:39:24.208353+0000","last_clean":"2021-10-08T19:39:24.208353+0000","last_became_active":"2021-10-08T19:39:04.511692+0000","last_became_peered":"2021-10-08T19:39:04.511692+0000","last_unstale":"2021-10-08T19:39:24.208353+0000","last_undegraded":"2021-10-08T19:39:24.208353+0000","last_fullsized":"2021-10-08T19:39:24.208353+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:03.490762+0000","log_size":2012,"ondisk_log_size":2012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":131858432,"num_objects":2012,"num_object_clones":0,"num_object_copies":6036,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2012,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2012,"num_write_kb":128768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"90'130","reported_seq":365,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.957609+0000","last_change":"2021-10-08T19:38:50.034248+0000","last_active":"2021-10-08T19:39:19.957609+0000","last_peered":"2021-10-08T19:39:19.957609+0000","last_clean":"2021-10-08T19:39:19.957609+0000","last_became_active":"2021-10-08T19:37:19.032630+0000","last_became_peered":"2021-10-08T19:37:19.032630+0000","last_unstale":"2021-10-08T19:39:19.957609+0000","last_undegraded":"2021-10-08T19:39:19.957609+0000","last_fullsized":"2021-10-08T19:39:19.957609+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:38:50.034180+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:38:50.034180+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0017398100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":438,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.958140+0000","last_change":"2021-10-08T19:38:43.096830+0000","last_active":"2021-10-08T19:39:19.958140+0000","last_peered":"2021-10-08T19:39:19.958140+0000","last_clean":"2021-10-08T19:39:19.958140+0000","last_became_active":"2021-10-08T19:28:40.133414+0000","last_became_peered":"2021-10-08T19:28:40.133414+0000","last_unstale":"2021-10-08T19:39:19.958140+0000","last_undegraded":"2021-10-08T19:39:19.958140+0000","last_fullsized":"2021-10-08T19:39:19.958140+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:43.096755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:38:43.096755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011508566,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"289'44","reported_seq":504,"reported_epoch":442,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.862194+0000","last_change":"2021-10-08T19:38:41.715286+0000","last_active":"2021-10-08T19:39:20.862194+0000","last_peered":"2021-10-08T19:39:20.862194+0000","last_clean":"2021-10-08T19:39:20.862194+0000","last_became_active":"2021-10-08T19:29:40.626138+0000","last_became_peered":"2021-10-08T19:29:40.626138+0000","last_unstale":"2021-10-08T19:39:20.862194+0000","last_undegraded":"2021-10-08T19:39:20.862194+0000","last_fullsized":"2021-10-08T19:39:20.862194+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'44","last_scrub_stamp":"2021-10-08T19:38:41.715181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:38:41.715181+0000","log_size":44,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0032677489999999999,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":65,"num_read_kb":50,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":1432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":461,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.959084+0000","last_change":"2021-10-08T19:38:49.623619+0000","last_active":"2021-10-08T19:39:19.959084+0000","last_peered":"2021-10-08T19:39:19.959084+0000","last_clean":"2021-10-08T19:39:19.959084+0000","last_became_active":"2021-10-08T19:37:19.004386+0000","last_became_peered":"2021-10-08T19:37:19.004386+0000","last_unstale":"2021-10-08T19:39:19.959084+0000","last_undegraded":"2021-10-08T19:39:19.959084+0000","last_fullsized":"2021-10-08T19:39:19.959084+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:49.623545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:49.623545+0000","last_clean_scrub_stamp":"2021-10-08T19:38:49.623545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0019923559999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":234,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.077913+0000","last_change":"2021-10-08T19:38:00.340784+0000","last_active":"2021-10-08T19:39:20.077913+0000","last_peered":"2021-10-08T19:39:20.077913+0000","last_clean":"2021-10-08T19:39:20.077913+0000","last_became_active":"2021-10-08T19:29:40.637371+0000","last_became_peered":"2021-10-08T19:29:40.637371+0000","last_unstale":"2021-10-08T19:39:20.077913+0000","last_undegraded":"2021-10-08T19:39:20.077913+0000","last_fullsized":"2021-10-08T19:39:20.077913+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:00.340701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:38:00.340701+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.015510070000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":381,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.954481+0000","last_change":"2021-10-08T19:38:52.106606+0000","last_active":"2021-10-08T19:39:19.954481+0000","last_peered":"2021-10-08T19:39:19.954481+0000","last_clean":"2021-10-08T19:39:19.954481+0000","last_became_active":"2021-10-08T19:25:14.550690+0000","last_became_peered":"2021-10-08T19:25:14.550690+0000","last_unstale":"2021-10-08T19:39:19.954481+0000","last_undegraded":"2021-10-08T19:39:19.954481+0000","last_fullsized":"2021-10-08T19:39:19.954481+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:52.106531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:36:09.181866+0000","last_clean_scrub_stamp":"2021-10-08T19:38:52.106531+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034384849999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.d","version":"442'1906","reported_seq":1923,"reported_epoch":442,"state":"active+clean","last_fresh":"2021-10-08T19:39:23.920542+0000","last_change":"2021-10-08T19:39:04.508912+0000","last_active":"2021-10-08T19:39:23.920542+0000","last_peered":"2021-10-08T19:39:23.920542+0000","last_clean":"2021-10-08T19:39:23.920542+0000","last_became_active":"2021-10-08T19:39:04.508623+0000","last_became_peered":"2021-10-08T19:39:04.508623+0000","last_unstale":"2021-10-08T19:39:23.920542+0000","last_undegraded":"2021-10-08T19:39:23.920542+0000","last_fullsized":"2021-10-08T19:39:23.920542+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:03.490762+0000","log_size":1906,"ondisk_log_size":1906,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":124911616,"num_objects":1906,"num_object_clones":0,"num_object_copies":5718,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1906,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1906,"num_write_kb":121984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6],"acting":[2,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"90'130","reported_seq":697,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.967833+0000","last_change":"2021-10-08T19:38:03.289225+0000","last_active":"2021-10-08T19:39:19.967833+0000","last_peered":"2021-10-08T19:39:19.967833+0000","last_clean":"2021-10-08T19:39:19.967833+0000","last_became_active":"2021-10-08T19:29:43.636820+0000","last_became_peered":"2021-10-08T19:29:43.636820+0000","last_unstale":"2021-10-08T19:39:19.967833+0000","last_undegraded":"2021-10-08T19:39:19.967833+0000","last_fullsized":"2021-10-08T19:39:19.967833+0000","mapping_epoch":239,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:38:03.289111+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:38:03.289111+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0028045850000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"114'10","reported_seq":675,"reported_epoch":442,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.856596+0000","last_change":"2021-10-08T19:39:19.105420+0000","last_active":"2021-10-08T19:39:20.856596+0000","last_peered":"2021-10-08T19:39:20.856596+0000","last_clean":"2021-10-08T19:39:20.856596+0000","last_became_active":"2021-10-08T19:24:25.106695+0000","last_became_peered":"2021-10-08T19:24:25.106695+0000","last_unstale":"2021-10-08T19:39:20.856596+0000","last_undegraded":"2021-10-08T19:39:20.856596+0000","last_fullsized":"2021-10-08T19:39:20.856596+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'10","last_scrub_stamp":"2021-10-08T19:39:19.105307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:39:19.105307+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0036701049999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"289'20","reported_seq":180,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.959256+0000","last_change":"2021-10-08T19:38:48.611751+0000","last_active":"2021-10-08T19:39:19.959256+0000","last_peered":"2021-10-08T19:39:19.959256+0000","last_clean":"2021-10-08T19:39:19.959256+0000","last_became_active":"2021-10-08T19:31:51.675569+0000","last_became_peered":"2021-10-08T19:31:51.675569+0000","last_unstale":"2021-10-08T19:39:19.959256+0000","last_undegraded":"2021-10-08T19:39:19.959256+0000","last_fullsized":"2021-10-08T19:39:19.959256+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'20","last_scrub_stamp":"2021-10-08T19:38:48.611674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:38:48.611674+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0024522860000000001,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":23,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":281,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.076376+0000","last_change":"2021-10-08T19:38:45.612926+0000","last_active":"2021-10-08T19:39:20.076376+0000","last_peered":"2021-10-08T19:39:20.076376+0000","last_clean":"2021-10-08T19:39:20.076376+0000","last_became_active":"2021-10-08T19:36:58.013921+0000","last_became_peered":"2021-10-08T19:36:58.013921+0000","last_unstale":"2021-10-08T19:39:20.076376+0000","last_undegraded":"2021-10-08T19:39:20.076376+0000","last_fullsized":"2021-10-08T19:39:20.076376+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:45.612819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:45.612819+0000","last_clean_scrub_stamp":"2021-10-08T19:38:45.612819+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0017789839999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":440,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.073074+0000","last_change":"2021-10-08T19:39:17.145211+0000","last_active":"2021-10-08T19:39:20.073074+0000","last_peered":"2021-10-08T19:39:20.073074+0000","last_clean":"2021-10-08T19:39:20.073074+0000","last_became_active":"2021-10-08T19:29:40.643614+0000","last_became_peered":"2021-10-08T19:29:40.643614+0000","last_unstale":"2021-10-08T19:39:20.073074+0000","last_undegraded":"2021-10-08T19:39:20.073074+0000","last_fullsized":"2021-10-08T19:39:20.073074+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:17.145107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:16.042797+0000","last_clean_scrub_stamp":"2021-10-08T19:39:17.145107+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.050900147,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":219,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.077533+0000","last_change":"2021-10-08T19:37:19.012787+0000","last_active":"2021-10-08T19:39:20.077533+0000","last_peered":"2021-10-08T19:39:20.077533+0000","last_clean":"2021-10-08T19:39:20.077533+0000","last_became_active":"2021-10-08T19:37:19.012488+0000","last_became_peered":"2021-10-08T19:37:19.012488+0000","last_unstale":"2021-10-08T19:39:20.077533+0000","last_undegraded":"2021-10-08T19:39:20.077533+0000","last_fullsized":"2021-10-08T19:39:20.077533+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:40.867717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:40.867717+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0052805589999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,2],"acting":[3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.6","version":"442'1857","reported_seq":1872,"reported_epoch":442,"state":"active+clean","last_fresh":"2021-10-08T19:39:23.672515+0000","last_change":"2021-10-08T19:39:04.514590+0000","last_active":"2021-10-08T19:39:23.672515+0000","last_peered":"2021-10-08T19:39:23.672515+0000","last_clean":"2021-10-08T19:39:23.672515+0000","last_became_active":"2021-10-08T19:39:04.514288+0000","last_became_peered":"2021-10-08T19:39:04.514288+0000","last_unstale":"2021-10-08T19:39:23.672515+0000","last_undegraded":"2021-10-08T19:39:23.672515+0000","last_fullsized":"2021-10-08T19:39:23.672515+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:03.490762+0000","log_size":1857,"ondisk_log_size":1857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":121700352,"num_objects":1857,"num_object_clones":0,"num_object_copies":5571,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1857,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1857,"num_write_kb":118848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":448,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.956176+0000","last_change":"2021-10-08T19:38:35.991385+0000","last_active":"2021-10-08T19:39:19.956176+0000","last_peered":"2021-10-08T19:39:19.956176+0000","last_clean":"2021-10-08T19:39:19.956176+0000","last_became_active":"2021-10-08T19:28:40.138726+0000","last_became_peered":"2021-10-08T19:28:40.138726+0000","last_unstale":"2021-10-08T19:39:19.956176+0000","last_undegraded":"2021-10-08T19:39:19.956176+0000","last_fullsized":"2021-10-08T19:39:19.956176+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:35.991278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:50.435552+0000","last_clean_scrub_stamp":"2021-10-08T19:38:35.991278+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0059341070000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"289'18","reported_seq":533,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.955337+0000","last_change":"2021-10-08T19:38:40.229383+0000","last_active":"2021-10-08T19:39:19.955337+0000","last_peered":"2021-10-08T19:39:19.955337+0000","last_clean":"2021-10-08T19:39:19.955337+0000","last_became_active":"2021-10-08T19:29:40.638957+0000","last_became_peered":"2021-10-08T19:29:40.638957+0000","last_unstale":"2021-10-08T19:39:19.955337+0000","last_undegraded":"2021-10-08T19:39:19.955337+0000","last_fullsized":"2021-10-08T19:39:19.955337+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'18","last_scrub_stamp":"2021-10-08T19:38:40.229289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:38:40.229289+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.015217840999999999,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":25,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"61'2","reported_seq":435,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.955296+0000","last_change":"2021-10-08T19:37:30.690153+0000","last_active":"2021-10-08T19:39:19.955296+0000","last_peered":"2021-10-08T19:39:19.955296+0000","last_clean":"2021-10-08T19:39:19.955296+0000","last_became_active":"2021-10-08T19:21:23.603614+0000","last_became_peered":"2021-10-08T19:21:23.603614+0000","last_unstale":"2021-10-08T19:39:19.955296+0000","last_undegraded":"2021-10-08T19:39:19.955296+0000","last_fullsized":"2021-10-08T19:39:19.955296+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'2","last_scrub_stamp":"2021-10-08T19:37:30.690057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:37:30.690057+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0038410610000000002,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":234,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.075693+0000","last_change":"2021-10-08T19:39:11.360634+0000","last_active":"2021-10-08T19:39:20.075693+0000","last_peered":"2021-10-08T19:39:20.075693+0000","last_clean":"2021-10-08T19:39:20.075693+0000","last_became_active":"2021-10-08T19:29:40.645211+0000","last_became_peered":"2021-10-08T19:29:40.645211+0000","last_unstale":"2021-10-08T19:39:20.075693+0000","last_undegraded":"2021-10-08T19:39:20.075693+0000","last_fullsized":"2021-10-08T19:39:20.075693+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:11.360528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:11.360528+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.12852046,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":355,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.960804+0000","last_change":"2021-10-08T19:37:21.652886+0000","last_active":"2021-10-08T19:39:19.960804+0000","last_peered":"2021-10-08T19:39:19.960804+0000","last_clean":"2021-10-08T19:39:19.960804+0000","last_became_active":"2021-10-08T19:28:40.100770+0000","last_became_peered":"2021-10-08T19:28:40.100770+0000","last_unstale":"2021-10-08T19:39:19.960804+0000","last_undegraded":"2021-10-08T19:39:19.960804+0000","last_fullsized":"2021-10-08T19:39:19.960804+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:21.652815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:37:21.652815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.006008953,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"289'15","reported_seq":487,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.071561+0000","last_change":"2021-10-08T19:38:35.166495+0000","last_active":"2021-10-08T19:39:20.071561+0000","last_peered":"2021-10-08T19:39:20.071561+0000","last_clean":"2021-10-08T19:39:20.071561+0000","last_became_active":"2021-10-08T19:29:40.644354+0000","last_became_peered":"2021-10-08T19:29:40.644354+0000","last_unstale":"2021-10-08T19:39:20.071561+0000","last_undegraded":"2021-10-08T19:39:20.071561+0000","last_fullsized":"2021-10-08T19:39:20.071561+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'15","last_scrub_stamp":"2021-10-08T19:38:35.166389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:38:35.166389+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.017091423000000001,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":460,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.956411+0000","last_change":"2021-10-08T19:38:46.048452+0000","last_active":"2021-10-08T19:39:19.956411+0000","last_peered":"2021-10-08T19:39:19.956411+0000","last_clean":"2021-10-08T19:39:19.956411+0000","last_became_active":"2021-10-08T19:28:40.139234+0000","last_became_peered":"2021-10-08T19:28:40.139234+0000","last_unstale":"2021-10-08T19:39:19.956411+0000","last_undegraded":"2021-10-08T19:39:19.956411+0000","last_fullsized":"2021-10-08T19:39:19.956411+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:46.048339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:38:46.048339+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0063437160000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":232,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.078444+0000","last_change":"2021-10-08T19:38:51.158307+0000","last_active":"2021-10-08T19:39:20.078444+0000","last_peered":"2021-10-08T19:39:20.078444+0000","last_clean":"2021-10-08T19:39:20.078444+0000","last_became_active":"2021-10-08T19:29:40.645111+0000","last_became_peered":"2021-10-08T19:29:40.645111+0000","last_unstale":"2021-10-08T19:39:20.078444+0000","last_undegraded":"2021-10-08T19:39:20.078444+0000","last_fullsized":"2021-10-08T19:39:20.078444+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:51.158228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:38:51.158228+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020157690000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":426,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.956315+0000","last_change":"2021-10-08T19:38:06.192532+0000","last_active":"2021-10-08T19:39:19.956315+0000","last_peered":"2021-10-08T19:39:19.956315+0000","last_clean":"2021-10-08T19:39:19.956315+0000","last_became_active":"2021-10-08T19:21:29.640674+0000","last_became_peered":"2021-10-08T19:21:29.640674+0000","last_unstale":"2021-10-08T19:39:19.956315+0000","last_undegraded":"2021-10-08T19:39:19.956315+0000","last_fullsized":"2021-10-08T19:39:19.956315+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:06.192441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:38:06.192441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040996660000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":347,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.959013+0000","last_change":"2021-10-08T19:38:35.553709+0000","last_active":"2021-10-08T19:39:19.959013+0000","last_peered":"2021-10-08T19:39:19.959013+0000","last_clean":"2021-10-08T19:39:19.959013+0000","last_became_active":"2021-10-08T19:25:15.501118+0000","last_became_peered":"2021-10-08T19:25:15.501118+0000","last_unstale":"2021-10-08T19:39:19.959013+0000","last_undegraded":"2021-10-08T19:39:19.959013+0000","last_fullsized":"2021-10-08T19:39:19.959013+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:35.553608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:38:35.553608+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0017789769999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"289'12","reported_seq":249,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.078274+0000","last_change":"2021-10-08T19:36:14.746788+0000","last_active":"2021-10-08T19:39:20.078274+0000","last_peered":"2021-10-08T19:39:20.078274+0000","last_clean":"2021-10-08T19:39:20.078274+0000","last_became_active":"2021-10-08T19:29:40.644657+0000","last_became_peered":"2021-10-08T19:29:40.644657+0000","last_unstale":"2021-10-08T19:39:20.078274+0000","last_undegraded":"2021-10-08T19:39:20.078274+0000","last_fullsized":"2021-10-08T19:39:20.078274+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'12","last_scrub_stamp":"2021-10-08T19:36:14.746690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:14.746690+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0050396959999999998,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":18,"num_read_kb":15,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":388,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.967545+0000","last_change":"2021-10-08T19:36:48.882690+0000","last_active":"2021-10-08T19:39:19.967545+0000","last_peered":"2021-10-08T19:39:19.967545+0000","last_clean":"2021-10-08T19:39:19.967545+0000","last_became_active":"2021-10-08T19:28:40.101898+0000","last_became_peered":"2021-10-08T19:28:40.101898+0000","last_unstale":"2021-10-08T19:39:19.967545+0000","last_undegraded":"2021-10-08T19:39:19.967545+0000","last_fullsized":"2021-10-08T19:39:19.967545+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:16.444582+0000","last_clean_scrub_stamp":"2021-10-08T19:36:48.882597+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011015562,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":283,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.077753+0000","last_change":"2021-10-08T19:37:49.277058+0000","last_active":"2021-10-08T19:39:20.077753+0000","last_peered":"2021-10-08T19:39:20.077753+0000","last_clean":"2021-10-08T19:39:20.077753+0000","last_became_active":"2021-10-08T19:37:19.011117+0000","last_became_peered":"2021-10-08T19:37:19.011117+0000","last_unstale":"2021-10-08T19:39:20.077753+0000","last_undegraded":"2021-10-08T19:39:20.077753+0000","last_fullsized":"2021-10-08T19:39:20.077753+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:49.276955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:37:49.276955+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014777808,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":438,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.960559+0000","last_change":"2021-10-08T19:38:50.630127+0000","last_active":"2021-10-08T19:39:19.960559+0000","last_peered":"2021-10-08T19:39:19.960559+0000","last_clean":"2021-10-08T19:39:19.960559+0000","last_became_active":"2021-10-08T19:24:25.099371+0000","last_became_peered":"2021-10-08T19:24:25.099371+0000","last_unstale":"2021-10-08T19:39:19.960559+0000","last_undegraded":"2021-10-08T19:39:19.960559+0000","last_fullsized":"2021-10-08T19:39:19.960559+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:50.630005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:38:50.630005+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.033539035000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"70'5","reported_seq":623,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.966985+0000","last_change":"2021-10-08T19:38:38.295005+0000","last_active":"2021-10-08T19:39:19.966985+0000","last_peered":"2021-10-08T19:39:19.966985+0000","last_clean":"2021-10-08T19:39:19.966985+0000","last_became_active":"2021-10-08T19:31:22.785193+0000","last_became_peered":"2021-10-08T19:31:22.785193+0000","last_unstale":"2021-10-08T19:39:19.966985+0000","last_undegraded":"2021-10-08T19:39:19.966985+0000","last_fullsized":"2021-10-08T19:39:19.966985+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":5,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:38:38.294930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:38:38.294930+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0055411690000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"289'20","reported_seq":297,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.077597+0000","last_change":"2021-10-08T19:35:59.742206+0000","last_active":"2021-10-08T19:39:20.077597+0000","last_peered":"2021-10-08T19:39:20.077597+0000","last_clean":"2021-10-08T19:39:20.077597+0000","last_became_active":"2021-10-08T19:31:51.677055+0000","last_became_peered":"2021-10-08T19:31:51.677055+0000","last_unstale":"2021-10-08T19:39:20.077597+0000","last_undegraded":"2021-10-08T19:39:20.077597+0000","last_fullsized":"2021-10-08T19:39:20.077597+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'20","last_scrub_stamp":"2021-10-08T19:35:59.742121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:35:59.742121+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0052506209999999996,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":267,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.073649+0000","last_change":"2021-10-08T19:38:42.050830+0000","last_active":"2021-10-08T19:39:20.073649+0000","last_peered":"2021-10-08T19:39:20.073649+0000","last_clean":"2021-10-08T19:39:20.073649+0000","last_became_active":"2021-10-08T19:37:19.005757+0000","last_became_peered":"2021-10-08T19:37:19.005757+0000","last_unstale":"2021-10-08T19:39:20.073649+0000","last_undegraded":"2021-10-08T19:39:20.073649+0000","last_fullsized":"2021-10-08T19:39:20.073649+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:42.050731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:38:42.050731+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034338810000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"398'12","reported_seq":553,"reported_epoch":442,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.857458+0000","last_change":"2021-10-08T19:37:19.016457+0000","last_active":"2021-10-08T19:39:20.857458+0000","last_peered":"2021-10-08T19:39:20.857458+0000","last_clean":"2021-10-08T19:39:20.857458+0000","last_became_active":"2021-10-08T19:37:19.015189+0000","last_became_peered":"2021-10-08T19:37:19.015189+0000","last_unstale":"2021-10-08T19:39:20.857458+0000","last_undegraded":"2021-10-08T19:39:20.857458+0000","last_fullsized":"2021-10-08T19:39:20.857458+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"328'11","last_scrub_stamp":"2021-10-08T19:37:13.666624+0000","last_deep_scrub":"328'11","last_deep_scrub_stamp":"2021-10-08T19:33:32.545870+0000","last_clean_scrub_stamp":"2021-10-08T19:37:13.666624+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0085427560000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":434,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.958114+0000","last_change":"2021-10-08T19:38:46.025760+0000","last_active":"2021-10-08T19:39:19.958114+0000","last_peered":"2021-10-08T19:39:19.958114+0000","last_clean":"2021-10-08T19:39:19.958114+0000","last_became_active":"2021-10-08T19:29:40.644819+0000","last_became_peered":"2021-10-08T19:29:40.644819+0000","last_unstale":"2021-10-08T19:39:19.958114+0000","last_undegraded":"2021-10-08T19:39:19.958114+0000","last_fullsized":"2021-10-08T19:39:19.958114+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:46.025647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:46.025647+0000","last_clean_scrub_stamp":"2021-10-08T19:38:46.025647+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.031917295999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":343,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.960115+0000","last_change":"2021-10-08T19:38:06.778006+0000","last_active":"2021-10-08T19:39:19.960115+0000","last_peered":"2021-10-08T19:39:19.960115+0000","last_clean":"2021-10-08T19:39:19.960115+0000","last_became_active":"2021-10-08T19:25:15.498770+0000","last_became_peered":"2021-10-08T19:25:15.498770+0000","last_unstale":"2021-10-08T19:39:19.960115+0000","last_undegraded":"2021-10-08T19:39:19.960115+0000","last_fullsized":"2021-10-08T19:39:19.960115+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:06.777889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:38:06.777889+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012207519,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"289'15","reported_seq":88,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.961073+0000","last_change":"2021-10-08T19:37:19.007863+0000","last_active":"2021-10-08T19:39:19.961073+0000","last_peered":"2021-10-08T19:39:19.961073+0000","last_clean":"2021-10-08T19:39:19.961073+0000","last_became_active":"2021-10-08T19:37:19.007551+0000","last_became_peered":"2021-10-08T19:37:19.007551+0000","last_unstale":"2021-10-08T19:39:19.961073+0000","last_undegraded":"2021-10-08T19:39:19.961073+0000","last_fullsized":"2021-10-08T19:39:19.961073+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'15","last_scrub_stamp":"2021-10-08T19:36:42.879493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:42.879493+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0047281429999999998,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":450,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.071241+0000","last_change":"2021-10-08T19:39:09.108744+0000","last_active":"2021-10-08T19:39:20.071241+0000","last_peered":"2021-10-08T19:39:20.071241+0000","last_clean":"2021-10-08T19:39:20.071241+0000","last_became_active":"2021-10-08T19:29:44.439397+0000","last_became_peered":"2021-10-08T19:29:44.439397+0000","last_unstale":"2021-10-08T19:39:20.071241+0000","last_undegraded":"2021-10-08T19:39:20.071241+0000","last_fullsized":"2021-10-08T19:39:20.071241+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:09.108669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:09.108669+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.057135996000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"413'11","reported_seq":354,"reported_epoch":442,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.859977+0000","last_change":"2021-10-08T19:37:59.373999+0000","last_active":"2021-10-08T19:39:20.859977+0000","last_peered":"2021-10-08T19:39:20.859977+0000","last_clean":"2021-10-08T19:39:20.859977+0000","last_became_active":"2021-10-08T19:29:40.637650+0000","last_became_peered":"2021-10-08T19:29:40.637650+0000","last_unstale":"2021-10-08T19:39:20.859977+0000","last_undegraded":"2021-10-08T19:39:20.859977+0000","last_fullsized":"2021-10-08T19:39:20.859977+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"413'11","last_scrub_stamp":"2021-10-08T19:37:59.373882+0000","last_deep_scrub":"413'11","last_deep_scrub_stamp":"2021-10-08T19:37:59.373882+0000","last_clean_scrub_stamp":"2021-10-08T19:37:59.373882+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0097897460000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":413,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.955569+0000","last_change":"2021-10-08T19:38:06.355634+0000","last_active":"2021-10-08T19:39:19.955569+0000","last_peered":"2021-10-08T19:39:19.955569+0000","last_clean":"2021-10-08T19:39:19.955569+0000","last_became_active":"2021-10-08T19:21:29.640302+0000","last_became_peered":"2021-10-08T19:21:29.640302+0000","last_unstale":"2021-10-08T19:39:19.955569+0000","last_undegraded":"2021-10-08T19:39:19.955569+0000","last_fullsized":"2021-10-08T19:39:19.955569+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:06.355521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:38:06.355521+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.101121058,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":361,"reported_epoch":442,"state":"active+clean","last_fresh":"2021-10-08T19:39:22.092606+0000","last_change":"2021-10-08T19:39:22.092570+0000","last_active":"2021-10-08T19:39:22.092606+0000","last_peered":"2021-10-08T19:39:22.092606+0000","last_clean":"2021-10-08T19:39:22.092606+0000","last_became_active":"2021-10-08T19:29:40.631374+0000","last_became_peered":"2021-10-08T19:29:40.631374+0000","last_unstale":"2021-10-08T19:39:22.092606+0000","last_undegraded":"2021-10-08T19:39:22.092606+0000","last_fullsized":"2021-10-08T19:39:22.092606+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:22.092466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:22.092466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0027849989999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":359,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.960480+0000","last_change":"2021-10-08T19:38:08.749060+0000","last_active":"2021-10-08T19:39:19.960480+0000","last_peered":"2021-10-08T19:39:19.960480+0000","last_clean":"2021-10-08T19:39:19.960480+0000","last_became_active":"2021-10-08T19:29:40.652966+0000","last_became_peered":"2021-10-08T19:29:40.652966+0000","last_unstale":"2021-10-08T19:39:19.960480+0000","last_undegraded":"2021-10-08T19:39:19.960480+0000","last_fullsized":"2021-10-08T19:39:19.960480+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:08.748947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:08.748947+0000","last_clean_scrub_stamp":"2021-10-08T19:38:08.748947+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0079490979999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"289'19","reported_seq":180,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.959073+0000","last_change":"2021-10-08T19:37:53.478710+0000","last_active":"2021-10-08T19:39:19.959073+0000","last_peered":"2021-10-08T19:39:19.959073+0000","last_clean":"2021-10-08T19:39:19.959073+0000","last_became_active":"2021-10-08T19:31:51.676961+0000","last_became_peered":"2021-10-08T19:31:51.676961+0000","last_unstale":"2021-10-08T19:39:19.959073+0000","last_undegraded":"2021-10-08T19:39:19.959073+0000","last_fullsized":"2021-10-08T19:39:19.959073+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:37:53.478605+0000","last_deep_scrub":"289'19","last_deep_scrub_stamp":"2021-10-08T19:32:46.539792+0000","last_clean_scrub_stamp":"2021-10-08T19:37:53.478605+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0084777749999999999,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":410,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.967472+0000","last_change":"2021-10-08T19:39:16.255115+0000","last_active":"2021-10-08T19:39:19.967472+0000","last_peered":"2021-10-08T19:39:19.967472+0000","last_clean":"2021-10-08T19:39:19.967472+0000","last_became_active":"2021-10-08T19:31:22.786651+0000","last_became_peered":"2021-10-08T19:31:22.786651+0000","last_unstale":"2021-10-08T19:39:19.967472+0000","last_undegraded":"2021-10-08T19:39:19.967472+0000","last_fullsized":"2021-10-08T19:39:19.967472+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:16.255018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:16.255018+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034406480000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":234,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.075608+0000","last_change":"2021-10-08T19:38:06.367374+0000","last_active":"2021-10-08T19:39:20.075608+0000","last_peered":"2021-10-08T19:39:20.075608+0000","last_clean":"2021-10-08T19:39:20.075608+0000","last_became_active":"2021-10-08T19:29:40.644770+0000","last_became_peered":"2021-10-08T19:29:40.644770+0000","last_unstale":"2021-10-08T19:39:20.075608+0000","last_undegraded":"2021-10-08T19:39:20.075608+0000","last_fullsized":"2021-10-08T19:39:20.075608+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:06.367259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:06.367259+0000","last_clean_scrub_stamp":"2021-10-08T19:38:06.367259+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010215291,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":436,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.957515+0000","last_change":"2021-10-08T19:38:36.179667+0000","last_active":"2021-10-08T19:39:19.957515+0000","last_peered":"2021-10-08T19:39:19.957515+0000","last_clean":"2021-10-08T19:39:19.957515+0000","last_became_active":"2021-10-08T19:28:40.133744+0000","last_became_peered":"2021-10-08T19:28:40.133744+0000","last_unstale":"2021-10-08T19:39:19.957515+0000","last_undegraded":"2021-10-08T19:39:19.957515+0000","last_fullsized":"2021-10-08T19:39:19.957515+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:36.179579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:38:36.179579+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.035775066000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"289'19","reported_seq":573,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.954388+0000","last_change":"2021-10-08T19:39:17.052667+0000","last_active":"2021-10-08T19:39:19.954388+0000","last_peered":"2021-10-08T19:39:19.954388+0000","last_clean":"2021-10-08T19:39:19.954388+0000","last_became_active":"2021-10-08T19:28:40.100196+0000","last_became_peered":"2021-10-08T19:28:40.100196+0000","last_unstale":"2021-10-08T19:39:19.954388+0000","last_undegraded":"2021-10-08T19:39:19.954388+0000","last_fullsized":"2021-10-08T19:39:19.954388+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:39:17.052565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:39:17.052565+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0059573320000000001,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":274,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.075521+0000","last_change":"2021-10-08T19:38:09.610754+0000","last_active":"2021-10-08T19:39:20.075521+0000","last_peered":"2021-10-08T19:39:20.075521+0000","last_clean":"2021-10-08T19:39:20.075521+0000","last_became_active":"2021-10-08T19:28:40.146673+0000","last_became_peered":"2021-10-08T19:28:40.146673+0000","last_unstale":"2021-10-08T19:39:20.075521+0000","last_undegraded":"2021-10-08T19:39:20.075521+0000","last_fullsized":"2021-10-08T19:39:20.075521+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:09.610637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:09.610637+0000","last_clean_scrub_stamp":"2021-10-08T19:38:09.610637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0088560310000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":284,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.076086+0000","last_change":"2021-10-08T19:36:51.493553+0000","last_active":"2021-10-08T19:39:20.076086+0000","last_peered":"2021-10-08T19:39:20.076086+0000","last_clean":"2021-10-08T19:39:20.076086+0000","last_became_active":"2021-10-08T19:29:40.638536+0000","last_became_peered":"2021-10-08T19:29:40.638536+0000","last_unstale":"2021-10-08T19:39:20.076086+0000","last_undegraded":"2021-10-08T19:39:20.076086+0000","last_fullsized":"2021-10-08T19:39:20.076086+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:51.493442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:43.186684+0000","last_clean_scrub_stamp":"2021-10-08T19:36:51.493442+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013830541,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":232,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.072859+0000","last_change":"2021-10-08T19:38:47.187888+0000","last_active":"2021-10-08T19:39:20.072859+0000","last_peered":"2021-10-08T19:39:20.072859+0000","last_clean":"2021-10-08T19:39:20.072859+0000","last_became_active":"2021-10-08T19:29:40.634300+0000","last_became_peered":"2021-10-08T19:29:40.634300+0000","last_unstale":"2021-10-08T19:39:20.072859+0000","last_undegraded":"2021-10-08T19:39:20.072859+0000","last_fullsized":"2021-10-08T19:39:20.072859+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:47.187765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:47.187765+0000","last_clean_scrub_stamp":"2021-10-08T19:38:47.187765+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013817288,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"70'5","reported_seq":343,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.955270+0000","last_change":"2021-10-08T19:38:43.224604+0000","last_active":"2021-10-08T19:39:19.955270+0000","last_peered":"2021-10-08T19:39:19.955270+0000","last_clean":"2021-10-08T19:39:19.955270+0000","last_became_active":"2021-10-08T19:25:15.496309+0000","last_became_peered":"2021-10-08T19:25:15.496309+0000","last_unstale":"2021-10-08T19:39:19.955270+0000","last_undegraded":"2021-10-08T19:39:19.955270+0000","last_fullsized":"2021-10-08T19:39:19.955270+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:38:43.224497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:38:43.224497+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0052930809999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.10","version":"289'8","reported_seq":255,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.073157+0000","last_change":"2021-10-08T19:36:06.812233+0000","last_active":"2021-10-08T19:39:20.073157+0000","last_peered":"2021-10-08T19:39:20.073157+0000","last_clean":"2021-10-08T19:39:20.073157+0000","last_became_active":"2021-10-08T19:32:45.165103+0000","last_became_peered":"2021-10-08T19:32:45.165103+0000","last_unstale":"2021-10-08T19:39:20.073157+0000","last_undegraded":"2021-10-08T19:39:20.073157+0000","last_fullsized":"2021-10-08T19:39:20.073157+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'8","last_scrub_stamp":"2021-10-08T19:36:06.812115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:06.812115+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010666471,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":143,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.967857+0000","last_change":"2021-10-08T19:37:29.114140+0000","last_active":"2021-10-08T19:39:19.967857+0000","last_peered":"2021-10-08T19:39:19.967857+0000","last_clean":"2021-10-08T19:39:19.967857+0000","last_became_active":"2021-10-08T19:37:19.009349+0000","last_became_peered":"2021-10-08T19:37:19.009349+0000","last_unstale":"2021-10-08T19:39:19.967857+0000","last_undegraded":"2021-10-08T19:39:19.967857+0000","last_fullsized":"2021-10-08T19:39:19.967857+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:29.114037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:13.716331+0000","last_clean_scrub_stamp":"2021-10-08T19:37:29.114037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0076932069999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":379,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.967421+0000","last_change":"2021-10-08T19:38:32.348636+0000","last_active":"2021-10-08T19:39:19.967421+0000","last_peered":"2021-10-08T19:39:19.967421+0000","last_clean":"2021-10-08T19:39:19.967421+0000","last_became_active":"2021-10-08T19:24:25.106186+0000","last_became_peered":"2021-10-08T19:24:25.106186+0000","last_unstale":"2021-10-08T19:39:19.967421+0000","last_undegraded":"2021-10-08T19:39:19.967421+0000","last_fullsized":"2021-10-08T19:39:19.967421+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:32.348544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:18.377739+0000","last_clean_scrub_stamp":"2021-10-08T19:38:32.348544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0041413229999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":422,"reported_epoch":442,"state":"active+clean","last_fresh":"2021-10-08T19:39:23.706629+0000","last_change":"2021-10-08T19:39:23.706599+0000","last_active":"2021-10-08T19:39:23.706629+0000","last_peered":"2021-10-08T19:39:23.706629+0000","last_clean":"2021-10-08T19:39:23.706629+0000","last_became_active":"2021-10-08T19:21:29.642835+0000","last_became_peered":"2021-10-08T19:21:29.642835+0000","last_unstale":"2021-10-08T19:39:23.706629+0000","last_undegraded":"2021-10-08T19:39:23.706629+0000","last_fullsized":"2021-10-08T19:39:23.706629+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:23.706498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:23.706498+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0056310429999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":365,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.965278+0000","last_change":"2021-10-08T19:39:11.374698+0000","last_active":"2021-10-08T19:39:19.965278+0000","last_peered":"2021-10-08T19:39:19.965278+0000","last_clean":"2021-10-08T19:39:19.965278+0000","last_became_active":"2021-10-08T19:28:40.099215+0000","last_became_peered":"2021-10-08T19:28:40.099215+0000","last_unstale":"2021-10-08T19:39:19.965278+0000","last_undegraded":"2021-10-08T19:39:19.965278+0000","last_fullsized":"2021-10-08T19:39:19.965278+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:11.374610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:11.374610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039283219999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"348'24","reported_seq":261,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.072773+0000","last_change":"2021-10-08T19:38:05.385295+0000","last_active":"2021-10-08T19:39:20.072773+0000","last_peered":"2021-10-08T19:39:20.072773+0000","last_clean":"2021-10-08T19:39:20.072773+0000","last_became_active":"2021-10-08T19:29:40.640914+0000","last_became_peered":"2021-10-08T19:29:40.640914+0000","last_unstale":"2021-10-08T19:39:20.072773+0000","last_undegraded":"2021-10-08T19:39:20.072773+0000","last_fullsized":"2021-10-08T19:39:20.072773+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"348'24","last_scrub_stamp":"2021-10-08T19:38:05.385196+0000","last_deep_scrub":"348'24","last_deep_scrub_stamp":"2021-10-08T19:34:53.274250+0000","last_clean_scrub_stamp":"2021-10-08T19:38:05.385196+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0079524399999999999,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":370,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.967904+0000","last_change":"2021-10-08T19:37:13.001449+0000","last_active":"2021-10-08T19:39:19.967904+0000","last_peered":"2021-10-08T19:39:19.967904+0000","last_clean":"2021-10-08T19:39:19.967904+0000","last_became_active":"2021-10-08T19:24:25.098128+0000","last_became_peered":"2021-10-08T19:24:25.098128+0000","last_unstale":"2021-10-08T19:39:19.967904+0000","last_undegraded":"2021-10-08T19:39:19.967904+0000","last_fullsized":"2021-10-08T19:39:19.967904+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:13.001343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:34.508558+0000","last_clean_scrub_stamp":"2021-10-08T19:37:13.001343+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0068614030000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":434,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.958972+0000","last_change":"2021-10-08T19:38:38.557866+0000","last_active":"2021-10-08T19:39:19.958972+0000","last_peered":"2021-10-08T19:39:19.958972+0000","last_clean":"2021-10-08T19:39:19.958972+0000","last_became_active":"2021-10-08T19:24:25.095490+0000","last_became_peered":"2021-10-08T19:24:25.095490+0000","last_unstale":"2021-10-08T19:39:19.958972+0000","last_undegraded":"2021-10-08T19:39:19.958972+0000","last_fullsized":"2021-10-08T19:39:19.958972+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:38.557763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:11.383779+0000","last_clean_scrub_stamp":"2021-10-08T19:38:38.557763+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012167577000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":232,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.078156+0000","last_change":"2021-10-08T19:36:12.821415+0000","last_active":"2021-10-08T19:39:20.078156+0000","last_peered":"2021-10-08T19:39:20.078156+0000","last_clean":"2021-10-08T19:39:20.078156+0000","last_became_active":"2021-10-08T19:29:40.639358+0000","last_became_peered":"2021-10-08T19:29:40.639358+0000","last_unstale":"2021-10-08T19:39:20.078156+0000","last_undegraded":"2021-10-08T19:39:20.078156+0000","last_fullsized":"2021-10-08T19:39:20.078156+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:12.821316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:36:12.821316+0000","last_clean_scrub_stamp":"2021-10-08T19:36:12.821316+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.068456382999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"289'20","reported_seq":498,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.073603+0000","last_change":"2021-10-08T19:39:16.081314+0000","last_active":"2021-10-08T19:39:20.073603+0000","last_peered":"2021-10-08T19:39:20.073603+0000","last_clean":"2021-10-08T19:39:20.073603+0000","last_became_active":"2021-10-08T19:29:40.636448+0000","last_became_peered":"2021-10-08T19:29:40.636448+0000","last_unstale":"2021-10-08T19:39:20.073603+0000","last_undegraded":"2021-10-08T19:39:20.073603+0000","last_fullsized":"2021-10-08T19:39:20.073603+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'20","last_scrub_stamp":"2021-10-08T19:39:16.081220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:39:16.081220+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0046165160000000002,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":425,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.964964+0000","last_change":"2021-10-08T19:39:10.331198+0000","last_active":"2021-10-08T19:39:19.964964+0000","last_peered":"2021-10-08T19:39:19.964964+0000","last_clean":"2021-10-08T19:39:19.964964+0000","last_became_active":"2021-10-08T19:21:23.604530+0000","last_became_peered":"2021-10-08T19:21:23.604530+0000","last_unstale":"2021-10-08T19:39:19.964964+0000","last_undegraded":"2021-10-08T19:39:19.964964+0000","last_fullsized":"2021-10-08T19:39:19.964964+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:10.331108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:10.331108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001713989,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1f","version":"114'10","reported_seq":552,"reported_epoch":442,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.863252+0000","last_change":"2021-10-08T19:39:13.217120+0000","last_active":"2021-10-08T19:39:20.863252+0000","last_peered":"2021-10-08T19:39:20.863252+0000","last_clean":"2021-10-08T19:39:20.863252+0000","last_became_active":"2021-10-08T19:24:25.105742+0000","last_became_peered":"2021-10-08T19:24:25.105742+0000","last_unstale":"2021-10-08T19:39:20.863252+0000","last_undegraded":"2021-10-08T19:39:20.863252+0000","last_fullsized":"2021-10-08T19:39:20.863252+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'10","last_scrub_stamp":"2021-10-08T19:39:13.217012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:39:13.217012+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0025013180000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"69'1","reported_seq":415,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.960836+0000","last_change":"2021-10-08T19:37:23.683434+0000","last_active":"2021-10-08T19:39:19.960836+0000","last_peered":"2021-10-08T19:39:19.960836+0000","last_clean":"2021-10-08T19:39:19.960836+0000","last_became_active":"2021-10-08T19:21:29.640296+0000","last_became_peered":"2021-10-08T19:21:29.640296+0000","last_unstale":"2021-10-08T19:39:19.960836+0000","last_undegraded":"2021-10-08T19:39:19.960836+0000","last_fullsized":"2021-10-08T19:39:19.960836+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2021-10-08T19:37:23.683320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:37:23.683320+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011686882000000001,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"390'24","reported_seq":439,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.968043+0000","last_change":"2021-10-08T19:36:56.930986+0000","last_active":"2021-10-08T19:39:19.968043+0000","last_peered":"2021-10-08T19:39:19.968043+0000","last_clean":"2021-10-08T19:39:19.968043+0000","last_became_active":"2021-10-08T19:28:40.126425+0000","last_became_peered":"2021-10-08T19:28:40.126425+0000","last_unstale":"2021-10-08T19:39:19.968043+0000","last_undegraded":"2021-10-08T19:39:19.968043+0000","last_fullsized":"2021-10-08T19:39:19.968043+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"390'24","last_scrub_stamp":"2021-10-08T19:36:56.930887+0000","last_deep_scrub":"390'24","last_deep_scrub_stamp":"2021-10-08T19:36:56.930887+0000","last_clean_scrub_stamp":"2021-10-08T19:36:56.930887+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.015519527999999999,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":232,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.072542+0000","last_change":"2021-10-08T19:37:14.139452+0000","last_active":"2021-10-08T19:39:20.072542+0000","last_peered":"2021-10-08T19:39:20.072542+0000","last_clean":"2021-10-08T19:39:20.072542+0000","last_became_active":"2021-10-08T19:29:40.640952+0000","last_became_peered":"2021-10-08T19:29:40.640952+0000","last_unstale":"2021-10-08T19:39:20.072542+0000","last_undegraded":"2021-10-08T19:39:20.072542+0000","last_fullsized":"2021-10-08T19:39:20.072542+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:14.139384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:37:14.139384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0033835190000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":422,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.073689+0000","last_change":"2021-10-08T19:38:51.997620+0000","last_active":"2021-10-08T19:39:20.073689+0000","last_peered":"2021-10-08T19:39:20.073689+0000","last_clean":"2021-10-08T19:39:20.073689+0000","last_became_active":"2021-10-08T19:21:27.632648+0000","last_became_peered":"2021-10-08T19:21:27.632648+0000","last_unstale":"2021-10-08T19:39:20.073689+0000","last_undegraded":"2021-10-08T19:39:20.073689+0000","last_fullsized":"2021-10-08T19:39:20.073689+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:51.997511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:51.997511+0000","last_clean_scrub_stamp":"2021-10-08T19:38:51.997511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0017273900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"69'1","reported_seq":270,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.075619+0000","last_change":"2021-10-08T19:38:03.796487+0000","last_active":"2021-10-08T19:39:20.075619+0000","last_peered":"2021-10-08T19:39:20.075619+0000","last_clean":"2021-10-08T19:39:20.075619+0000","last_became_active":"2021-10-08T19:28:40.146302+0000","last_became_peered":"2021-10-08T19:28:40.146302+0000","last_unstale":"2021-10-08T19:39:20.075619+0000","last_undegraded":"2021-10-08T19:39:20.075619+0000","last_fullsized":"2021-10-08T19:39:20.075619+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2021-10-08T19:38:03.796375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:38:03.796375+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.12770116100000001,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"289'27","reported_seq":598,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.071955+0000","last_change":"2021-10-08T19:37:55.195213+0000","last_active":"2021-10-08T19:39:20.071955+0000","last_peered":"2021-10-08T19:39:20.071955+0000","last_clean":"2021-10-08T19:39:20.071955+0000","last_became_active":"2021-10-08T19:29:40.629461+0000","last_became_peered":"2021-10-08T19:29:40.629461+0000","last_unstale":"2021-10-08T19:39:20.071955+0000","last_undegraded":"2021-10-08T19:39:20.071955+0000","last_fullsized":"2021-10-08T19:39:20.071955+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'27","last_scrub_stamp":"2021-10-08T19:37:55.195108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:37:55.195108+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.016851959999999999,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":550,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":376,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.967611+0000","last_change":"2021-10-08T19:38:42.260441+0000","last_active":"2021-10-08T19:39:19.967611+0000","last_peered":"2021-10-08T19:39:19.967611+0000","last_clean":"2021-10-08T19:39:19.967611+0000","last_became_active":"2021-10-08T19:24:25.106119+0000","last_became_peered":"2021-10-08T19:24:25.106119+0000","last_unstale":"2021-10-08T19:39:19.967611+0000","last_undegraded":"2021-10-08T19:39:19.967611+0000","last_fullsized":"2021-10-08T19:39:19.967611+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:42.260340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:46.422866+0000","last_clean_scrub_stamp":"2021-10-08T19:38:42.260340+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0082769149999999993,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":268,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.075702+0000","last_change":"2021-10-08T19:37:14.702746+0000","last_active":"2021-10-08T19:39:20.075702+0000","last_peered":"2021-10-08T19:39:20.075702+0000","last_clean":"2021-10-08T19:39:20.075702+0000","last_became_active":"2021-10-08T19:28:40.148009+0000","last_became_peered":"2021-10-08T19:28:40.148009+0000","last_unstale":"2021-10-08T19:39:20.075702+0000","last_undegraded":"2021-10-08T19:39:20.075702+0000","last_fullsized":"2021-10-08T19:39:20.075702+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:14.702628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:37:14.702628+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0066034209999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":433,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.954821+0000","last_change":"2021-10-08T19:38:37.167564+0000","last_active":"2021-10-08T19:39:19.954821+0000","last_peered":"2021-10-08T19:39:19.954821+0000","last_clean":"2021-10-08T19:39:19.954821+0000","last_became_active":"2021-10-08T19:24:25.097782+0000","last_became_peered":"2021-10-08T19:24:25.097782+0000","last_unstale":"2021-10-08T19:39:19.954821+0000","last_undegraded":"2021-10-08T19:39:19.954821+0000","last_fullsized":"2021-10-08T19:39:19.954821+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:37.167455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:37.219503+0000","last_clean_scrub_stamp":"2021-10-08T19:38:37.167455+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0027382449999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"289'18","reported_seq":253,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.077674+0000","last_change":"2021-10-08T19:36:17.847260+0000","last_active":"2021-10-08T19:39:20.077674+0000","last_peered":"2021-10-08T19:39:20.077674+0000","last_clean":"2021-10-08T19:39:20.077674+0000","last_became_active":"2021-10-08T19:29:40.645144+0000","last_became_peered":"2021-10-08T19:29:40.645144+0000","last_unstale":"2021-10-08T19:39:20.077674+0000","last_undegraded":"2021-10-08T19:39:20.077674+0000","last_fullsized":"2021-10-08T19:39:20.077674+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'18","last_scrub_stamp":"2021-10-08T19:36:17.846978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:36:17.846978+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.018882475999999999,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":25,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":232,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.075771+0000","last_change":"2021-10-08T19:39:14.212962+0000","last_active":"2021-10-08T19:39:20.075771+0000","last_peered":"2021-10-08T19:39:20.075771+0000","last_clean":"2021-10-08T19:39:20.075771+0000","last_became_active":"2021-10-08T19:29:44.443807+0000","last_became_peered":"2021-10-08T19:29:44.443807+0000","last_unstale":"2021-10-08T19:39:20.075771+0000","last_undegraded":"2021-10-08T19:39:20.075771+0000","last_fullsized":"2021-10-08T19:39:20.075771+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:14.212865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:32.854550+0000","last_clean_scrub_stamp":"2021-10-08T19:39:14.212865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0077559439999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":433,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.955004+0000","last_change":"2021-10-08T19:37:16.729232+0000","last_active":"2021-10-08T19:39:19.955004+0000","last_peered":"2021-10-08T19:39:19.955004+0000","last_clean":"2021-10-08T19:39:19.955004+0000","last_became_active":"2021-10-08T19:29:40.638352+0000","last_became_peered":"2021-10-08T19:29:40.638352+0000","last_unstale":"2021-10-08T19:39:19.955004+0000","last_undegraded":"2021-10-08T19:39:19.955004+0000","last_fullsized":"2021-10-08T19:39:19.955004+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:16.729133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:37:16.729133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010092746,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":250,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.078529+0000","last_change":"2021-10-08T19:39:13.413298+0000","last_active":"2021-10-08T19:39:20.078529+0000","last_peered":"2021-10-08T19:39:20.078529+0000","last_clean":"2021-10-08T19:39:20.078529+0000","last_became_active":"2021-10-08T19:31:22.788455+0000","last_became_peered":"2021-10-08T19:31:22.788455+0000","last_unstale":"2021-10-08T19:39:20.078529+0000","last_undegraded":"2021-10-08T19:39:20.078529+0000","last_fullsized":"2021-10-08T19:39:20.078529+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:13.413194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:32:12.549351+0000","last_clean_scrub_stamp":"2021-10-08T19:39:13.413194+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.173684593,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"289'15","reported_seq":482,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.954329+0000","last_change":"2021-10-08T19:38:09.250253+0000","last_active":"2021-10-08T19:39:19.954329+0000","last_peered":"2021-10-08T19:39:19.954329+0000","last_clean":"2021-10-08T19:39:19.954329+0000","last_became_active":"2021-10-08T19:29:40.631689+0000","last_became_peered":"2021-10-08T19:29:40.631689+0000","last_unstale":"2021-10-08T19:39:19.954329+0000","last_undegraded":"2021-10-08T19:39:19.954329+0000","last_fullsized":"2021-10-08T19:39:19.954329+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'15","last_scrub_stamp":"2021-10-08T19:38:09.250133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:38:09.250133+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0047959150000000004,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":430,"reported_epoch":442,"state":"active+clean","last_fresh":"2021-10-08T19:39:21.657458+0000","last_change":"2021-10-08T19:39:21.657387+0000","last_active":"2021-10-08T19:39:21.657458+0000","last_peered":"2021-10-08T19:39:21.657458+0000","last_clean":"2021-10-08T19:39:21.657458+0000","last_became_active":"2021-10-08T19:21:23.607785+0000","last_became_peered":"2021-10-08T19:21:23.607785+0000","last_unstale":"2021-10-08T19:39:21.657458+0000","last_undegraded":"2021-10-08T19:39:21.657458+0000","last_fullsized":"2021-10-08T19:39:21.657458+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:21.657316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:21.657316+0000","last_clean_scrub_stamp":"2021-10-08T19:39:21.657316+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034173929999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":423,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.965075+0000","last_change":"2021-10-08T19:38:36.391388+0000","last_active":"2021-10-08T19:39:19.965075+0000","last_peered":"2021-10-08T19:39:19.965075+0000","last_clean":"2021-10-08T19:39:19.965075+0000","last_became_active":"2021-10-08T19:21:27.633979+0000","last_became_peered":"2021-10-08T19:21:27.633979+0000","last_unstale":"2021-10-08T19:39:19.965075+0000","last_undegraded":"2021-10-08T19:39:19.965075+0000","last_fullsized":"2021-10-08T19:39:19.965075+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:36.391288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:27.586341+0000","last_clean_scrub_stamp":"2021-10-08T19:38:36.391288+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010425952,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":436,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.957989+0000","last_change":"2021-10-08T19:37:55.032408+0000","last_active":"2021-10-08T19:39:19.957989+0000","last_peered":"2021-10-08T19:39:19.957989+0000","last_clean":"2021-10-08T19:39:19.957989+0000","last_became_active":"2021-10-08T19:28:40.159162+0000","last_became_peered":"2021-10-08T19:28:40.159162+0000","last_unstale":"2021-10-08T19:39:19.957989+0000","last_undegraded":"2021-10-08T19:39:19.957989+0000","last_fullsized":"2021-10-08T19:39:19.957989+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:55.032301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:37:55.032301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.054063366000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"289'7","reported_seq":513,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.954636+0000","last_change":"2021-10-08T19:39:13.080295+0000","last_active":"2021-10-08T19:39:19.954636+0000","last_peered":"2021-10-08T19:39:19.954636+0000","last_clean":"2021-10-08T19:39:19.954636+0000","last_became_active":"2021-10-08T19:31:51.675189+0000","last_became_peered":"2021-10-08T19:31:51.675189+0000","last_unstale":"2021-10-08T19:39:19.954636+0000","last_undegraded":"2021-10-08T19:39:19.954636+0000","last_fullsized":"2021-10-08T19:39:19.954636+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'7","last_scrub_stamp":"2021-10-08T19:39:13.080199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:39:13.080199+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0050767039999999996,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":10,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":446,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.960759+0000","last_change":"2021-10-08T19:38:36.587034+0000","last_active":"2021-10-08T19:39:19.960759+0000","last_peered":"2021-10-08T19:39:19.960759+0000","last_clean":"2021-10-08T19:39:19.960759+0000","last_became_active":"2021-10-08T19:24:25.096225+0000","last_became_peered":"2021-10-08T19:24:25.096225+0000","last_unstale":"2021-10-08T19:39:19.960759+0000","last_undegraded":"2021-10-08T19:39:19.960759+0000","last_fullsized":"2021-10-08T19:39:19.960759+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:36.586933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:29:40.244757+0000","last_clean_scrub_stamp":"2021-10-08T19:38:36.586933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003904257,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":438,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.959792+0000","last_change":"2021-10-08T19:36:44.948482+0000","last_active":"2021-10-08T19:39:19.959792+0000","last_peered":"2021-10-08T19:39:19.959792+0000","last_clean":"2021-10-08T19:39:19.959792+0000","last_became_active":"2021-10-08T19:28:40.101187+0000","last_became_peered":"2021-10-08T19:28:40.101187+0000","last_unstale":"2021-10-08T19:39:19.959792+0000","last_undegraded":"2021-10-08T19:39:19.959792+0000","last_fullsized":"2021-10-08T19:39:19.959792+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:44.948359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:11.633739+0000","last_clean_scrub_stamp":"2021-10-08T19:36:44.948359+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0035272509999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":279,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.958887+0000","last_change":"2021-10-08T19:38:52.700142+0000","last_active":"2021-10-08T19:39:19.958887+0000","last_peered":"2021-10-08T19:39:19.958887+0000","last_clean":"2021-10-08T19:39:19.958887+0000","last_became_active":"2021-10-08T19:37:19.007583+0000","last_became_peered":"2021-10-08T19:37:19.007583+0000","last_unstale":"2021-10-08T19:39:19.958887+0000","last_undegraded":"2021-10-08T19:39:19.958887+0000","last_fullsized":"2021-10-08T19:39:19.958887+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:52.700043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:38:52.700043+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.033717217000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"289'19","reported_seq":562,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.953933+0000","last_change":"2021-10-08T19:38:47.241885+0000","last_active":"2021-10-08T19:39:19.953933+0000","last_peered":"2021-10-08T19:39:19.953933+0000","last_clean":"2021-10-08T19:39:19.953933+0000","last_became_active":"2021-10-08T19:28:40.099770+0000","last_became_peered":"2021-10-08T19:28:40.099770+0000","last_unstale":"2021-10-08T19:39:19.953933+0000","last_undegraded":"2021-10-08T19:39:19.953933+0000","last_fullsized":"2021-10-08T19:39:19.953933+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:38:47.241810+0000","last_deep_scrub":"289'19","last_deep_scrub_stamp":"2021-10-08T19:36:15.167374+0000","last_clean_scrub_stamp":"2021-10-08T19:38:47.241810+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034070369999999999,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":232,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.077832+0000","last_change":"2021-10-08T19:36:57.099908+0000","last_active":"2021-10-08T19:39:20.077832+0000","last_peered":"2021-10-08T19:39:20.077832+0000","last_clean":"2021-10-08T19:39:20.077832+0000","last_became_active":"2021-10-08T19:29:40.627394+0000","last_became_peered":"2021-10-08T19:29:40.627394+0000","last_unstale":"2021-10-08T19:39:20.077832+0000","last_undegraded":"2021-10-08T19:39:20.077832+0000","last_fullsized":"2021-10-08T19:39:20.077832+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:57.099805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:57.099805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034117000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":266,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.959143+0000","last_change":"2021-10-08T19:36:46.569493+0000","last_active":"2021-10-08T19:39:19.959143+0000","last_peered":"2021-10-08T19:39:19.959143+0000","last_clean":"2021-10-08T19:39:19.959143+0000","last_became_active":"2021-10-08T19:28:40.145868+0000","last_became_peered":"2021-10-08T19:28:40.145868+0000","last_unstale":"2021-10-08T19:39:19.959143+0000","last_undegraded":"2021-10-08T19:39:19.959143+0000","last_fullsized":"2021-10-08T19:39:19.959143+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:46.569374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:36:46.569374+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011431800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":433,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.954276+0000","last_change":"2021-10-08T19:38:50.164955+0000","last_active":"2021-10-08T19:39:19.954276+0000","last_peered":"2021-10-08T19:39:19.954276+0000","last_clean":"2021-10-08T19:39:19.954276+0000","last_became_active":"2021-10-08T19:28:40.099543+0000","last_became_peered":"2021-10-08T19:28:40.099543+0000","last_unstale":"2021-10-08T19:39:19.954276+0000","last_undegraded":"2021-10-08T19:39:19.954276+0000","last_fullsized":"2021-10-08T19:39:19.954276+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:50.164851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:50.032367+0000","last_clean_scrub_stamp":"2021-10-08T19:38:50.164851+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.022295210999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"289'27","reported_seq":266,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.072633+0000","last_change":"2021-10-08T19:38:03.371773+0000","last_active":"2021-10-08T19:39:20.072633+0000","last_peered":"2021-10-08T19:39:20.072633+0000","last_clean":"2021-10-08T19:39:20.072633+0000","last_became_active":"2021-10-08T19:29:40.631002+0000","last_became_peered":"2021-10-08T19:29:40.631002+0000","last_unstale":"2021-10-08T19:39:20.072633+0000","last_undegraded":"2021-10-08T19:39:20.072633+0000","last_fullsized":"2021-10-08T19:39:20.072633+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'27","last_scrub_stamp":"2021-10-08T19:38:03.371690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:38:03.371690+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012656639000000001,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":422,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.073455+0000","last_change":"2021-10-08T19:38:33.129623+0000","last_active":"2021-10-08T19:39:20.073455+0000","last_peered":"2021-10-08T19:39:20.073455+0000","last_clean":"2021-10-08T19:39:20.073455+0000","last_became_active":"2021-10-08T19:21:23.603422+0000","last_became_peered":"2021-10-08T19:21:23.603422+0000","last_unstale":"2021-10-08T19:39:20.073455+0000","last_undegraded":"2021-10-08T19:39:20.073455+0000","last_fullsized":"2021-10-08T19:39:20.073455+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:33.129516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:15.535842+0000","last_clean_scrub_stamp":"2021-10-08T19:38:33.129516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012096857000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":459,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:19.954088+0000","last_change":"2021-10-08T19:39:12.077018+0000","last_active":"2021-10-08T19:39:19.954088+0000","last_peered":"2021-10-08T19:39:19.954088+0000","last_clean":"2021-10-08T19:39:19.954088+0000","last_became_active":"2021-10-08T19:28:40.099286+0000","last_became_peered":"2021-10-08T19:28:40.099286+0000","last_unstale":"2021-10-08T19:39:19.954088+0000","last_undegraded":"2021-10-08T19:39:19.954088+0000","last_fullsized":"2021-10-08T19:39:19.954088+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:12.076904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:31.176160+0000","last_clean_scrub_stamp":"2021-10-08T19:39:12.076904+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.006185444,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":232,"reported_epoch":441,"state":"active+clean","last_fresh":"2021-10-08T19:39:20.078072+0000","last_change":"2021-10-08T19:38:08.397525+0000","last_active":"2021-10-08T19:39:20.078072+0000","last_peered":"2021-10-08T19:39:20.078072+0000","last_clean":"2021-10-08T19:39:20.078072+0000","last_became_active":"2021-10-08T19:29:40.638221+0000","last_became_peered":"2021-10-08T19:29:40.638221+0000","last_unstale":"2021-10-08T19:39:20.078072+0000","last_undegraded":"2021-10-08T19:39:20.078072+0000","last_fullsized":"2021-10-08T19:39:20.078072+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:08.397432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:38:08.397432+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.11831541399999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":16,"stat_sum":{"num_bytes":2010775552,"num_objects":30682,"num_object_clones":0,"num_object_copies":92046,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30682,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30682,"num_write_kb":1963648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6003359744,"data_stored":6003359744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30682,"ondisk_log_size":30682,"up":48,"acting":48,"num_store_stats":8},{"poolid":2,"num_pg":42,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":126,"acting":126,"num_store_stats":8},{"poolid":1,"num_pg":11,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1430,"ondisk_log_size":1430,"up":33,"acting":33,"num_store_stats":8},{"poolid":3,"num_pg":23,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":443,"num_read_kb":443,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":778,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":69,"acting":69,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1111,"num_read_kb":868,"num_write":703,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":520,"num_bytes_recovered":10826,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":719,"ondisk_log_size":719,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":84,"ondisk_log_size":84,"up":96,"acting":96,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201500,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1019136,"kb_used_data":723448,"kb_used_omap":0,"kb_used_meta":295680,"kb_avail":92726016,"statfs":{"total":95995035648,"available":94951440384,"internally_reserved":0,"allocated":740810752,"data_stored":740376370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":302776320},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:38:43 2021","interfaces":[{"interface":"back","average":{"1min":1.631,"5min":1.5760000000000001,"15min":1.647},"min":{"1min":0.23200000000000001,"5min":0.21199999999999999,"15min":0.20100000000000001},"max":{"1min":5.3630000000000004,"5min":8.8160000000000007,"15min":32.366999999999997},"last":0.39400000000000002},{"interface":"front","average":{"1min":1.641,"5min":1.5309999999999999,"15min":1.831},"min":{"1min":0.219,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":8.2639999999999993,"5min":9.4410000000000007,"15min":29.736000000000001},"last":0.35299999999999998}]},{"osd":1,"last update":"Fri Oct 8 19:38:43 2021","interfaces":[{"interface":"back","average":{"1min":2.0249999999999999,"5min":2.6190000000000002,"15min":2.2469999999999999},"min":{"1min":0.27400000000000002,"5min":0.215,"15min":0.19600000000000001},"max":{"1min":7.3079999999999998,"5min":87.966999999999999,"15min":87.966999999999999},"last":1.647},{"interface":"front","average":{"1min":1.238,"5min":1.5860000000000001,"15min":1.746},"min":{"1min":0.253,"5min":0.23699999999999999,"15min":0.22700000000000001},"max":{"1min":4.5229999999999997,"5min":6.0819999999999999,"15min":28.119},"last":0.28699999999999998}]},{"osd":2,"last update":"Fri Oct 8 19:38:43 2021","interfaces":[{"interface":"back","average":{"1min":5.2599999999999998,"5min":2.4900000000000002,"15min":2.085},"min":{"1min":0.32100000000000001,"5min":0.255,"15min":0.255},"max":{"1min":81.204999999999998,"5min":81.204999999999998,"15min":81.204999999999998},"last":3.6120000000000001},{"interface":"front","average":{"1min":5.556,"5min":2.4079999999999999,"15min":1.958},"min":{"1min":0.42699999999999999,"5min":0.253,"15min":0.253},"max":{"1min":81.022000000000006,"5min":81.022000000000006,"15min":81.022000000000006},"last":0.94799999999999995}]},{"osd":3,"last update":"Fri Oct 8 19:38:43 2021","interfaces":[{"interface":"back","average":{"1min":2.0830000000000002,"5min":2.093,"15min":2.3860000000000001},"min":{"1min":0.313,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":7.5069999999999997,"5min":24.945,"15min":72.093999999999994},"last":1.446},{"interface":"front","average":{"1min":2.3180000000000001,"5min":1.911,"15min":2.3140000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.28000000000000003},"max":{"1min":9,"5min":9,"15min":71.864999999999995},"last":0.38200000000000001}]},{"osd":4,"last update":"Fri Oct 8 19:38:43 2021","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.7789999999999999,"15min":1.1879999999999999},"min":{"1min":0.26600000000000001,"5min":0.26300000000000001,"15min":0.22800000000000001},"max":{"1min":3.952,"5min":55.890999999999998,"15min":55.890999999999998},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.92200000000000004,"5min":1.9710000000000001,"15min":1.274},"min":{"1min":0.27800000000000002,"5min":0.254,"15min":0.254},"max":{"1min":3.1890000000000001,"5min":54.448999999999998,"15min":54.448999999999998},"last":0.36199999999999999}]},{"osd":5,"last update":"Fri Oct 8 19:38:43 2021","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.1739999999999999,"15min":1.109},"min":{"1min":0.33500000000000002,"5min":0.28199999999999997,"15min":0.26800000000000002},"max":{"1min":5.0590000000000002,"5min":5.819,"15min":9.9280000000000008},"last":0.53400000000000003},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.4870000000000001,"15min":1.1539999999999999},"min":{"1min":0.29399999999999998,"5min":0.28299999999999997,"15min":0.26100000000000001},"max":{"1min":3.6339999999999999,"5min":10.435,"15min":18.655000000000001},"last":0.41299999999999998}]},{"osd":6,"last update":"Fri Oct 8 19:38:43 2021","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.8839999999999999,"15min":1.3540000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.27900000000000003},"max":{"1min":4.5780000000000003,"5min":58.039000000000001,"15min":58.039000000000001},"last":0.503},{"interface":"front","average":{"1min":1.3640000000000001,"5min":2.0590000000000002,"15min":1.357},"min":{"1min":0.38400000000000001,"5min":0.31900000000000001,"15min":0.30299999999999999},"max":{"1min":6.2969999999999997,"5min":58.079999999999998,"15min":58.079999999999998},"last":0.56499999999999995}]}]},{"osd":6,"up_from":47,"seq":201863463136,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1247024,"kb_used_data":947752,"kb_used_omap":0,"kb_used_meta":299264,"kb_avail":92498128,"statfs":{"total":95995035648,"available":94718083072,"internally_reserved":0,"allocated":970498048,"data_stored":970079243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":306446336},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:39:20 2021","interfaces":[{"interface":"back","average":{"1min":3.161,"5min":1.869,"15min":1.6240000000000001},"min":{"1min":0.314,"5min":0.214,"15min":0.20100000000000001},"max":{"1min":39.262,"5min":39.262,"15min":39.262},"last":0.86699999999999999},{"interface":"front","average":{"1min":3.5230000000000001,"5min":2.2919999999999998,"15min":2.2480000000000002},"min":{"1min":0.215,"5min":0.215,"15min":0.21299999999999999},"max":{"1min":39.351999999999997,"5min":39.351999999999997,"15min":69.477000000000004},"last":1.2}]},{"osd":1,"last update":"Fri Oct 8 19:39:20 2021","interfaces":[{"interface":"back","average":{"1min":1.47,"5min":1.6499999999999999,"15min":1.4450000000000001},"min":{"1min":0.44900000000000001,"5min":0.23699999999999999,"15min":0.23000000000000001},"max":{"1min":5.1639999999999997,"5min":6.1050000000000004,"15min":14.878},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.319,"5min":1.681,"15min":1.5089999999999999},"min":{"1min":0.38500000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":5.1340000000000003,"5min":7.0090000000000003,"15min":14.779},"last":1.1870000000000001}]},{"osd":2,"last update":"Fri Oct 8 19:39:20 2021","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.6279999999999999,"15min":1.8779999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.251},"max":{"1min":3.4729999999999999,"5min":10.304,"15min":69.322999999999993},"last":0.81599999999999995},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.9379999999999999,"15min":2.149},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.245},"max":{"1min":3.4750000000000001,"5min":13.339,"15min":69.418999999999997},"last":1.4359999999999999}]},{"osd":3,"last update":"Fri Oct 8 19:39:20 2021","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.663,"15min":1.7789999999999999},"min":{"1min":0.27500000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":4.6630000000000003,"5min":8.7300000000000004,"15min":21.670000000000002},"last":0.47399999999999998},{"interface":"front","average":{"1min":1.4810000000000001,"5min":2.0169999999999999,"15min":1.7170000000000001},"min":{"1min":0.45200000000000001,"5min":0.29099999999999998,"15min":0.28000000000000003},"max":{"1min":8.6699999999999999,"5min":14.867000000000001,"15min":22.254999999999999},"last":2.4129999999999998}]},{"osd":4,"last update":"Fri Oct 8 19:39:20 2021","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":1.431,"15min":1.1240000000000001},"min":{"1min":0.26900000000000002,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":4.0279999999999996,"5min":5.6989999999999998,"15min":24.516999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":1.089,"5min":1.5309999999999999,"15min":1.3660000000000001},"min":{"1min":0.29199999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":4.2880000000000003,"5min":9.9079999999999995,"15min":69.593999999999994},"last":0.44800000000000001}]},{"osd":5,"last update":"Fri Oct 8 19:39:20 2021","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":2.8559999999999999,"15min":1.8580000000000001},"min":{"1min":0.29999999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":6.5519999999999996,"5min":107.485,"15min":107.485},"last":0.376},{"interface":"front","average":{"1min":0.88,"5min":2.8140000000000001,"15min":2.0569999999999999},"min":{"1min":0.31900000000000001,"5min":0.251,"15min":0.251},"max":{"1min":3.4860000000000002,"5min":107.90300000000001,"15min":107.90300000000001},"last":0.41299999999999998}]},{"osd":7,"last update":"Fri Oct 8 19:38:48 2021","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.6419999999999999,"15min":1.1279999999999999},"min":{"1min":0.32400000000000001,"5min":0.29399999999999998,"15min":0.27800000000000002},"max":{"1min":6.6790000000000003,"5min":8.8840000000000003,"15min":8.8840000000000003},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.7669999999999999,"5min":1.792,"15min":1.325},"min":{"1min":0.32400000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":6.5860000000000003,"5min":8.3740000000000006,"15min":15.962},"last":0.495}]}]},{"osd":1,"up_from":13,"seq":55834575091,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1312924,"kb_used_data":966164,"kb_used_omap":0,"kb_used_meta":346752,"kb_avail":92432228,"statfs":{"total":95995035648,"available":94650601472,"internally_reserved":0,"allocated":989351936,"data_stored":988888535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":355074048},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:39:07 2021","interfaces":[{"interface":"back","average":{"1min":5.6630000000000003,"5min":3.1059999999999999,"15min":3.8159999999999998},"min":{"1min":0.26400000000000001,"5min":0.188,"15min":0.188},"max":{"1min":81.459000000000003,"5min":81.459000000000003,"15min":126.256},"last":0.85699999999999998},{"interface":"front","average":{"1min":5.883,"5min":3.359,"15min":4.1100000000000003},"min":{"1min":0.30599999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":81.853999999999999,"5min":81.853999999999999,"15min":126.176},"last":0.76400000000000001}]},{"osd":2,"last update":"Fri Oct 8 19:38:27 2021","interfaces":[{"interface":"back","average":{"1min":1.8180000000000001,"5min":1.6539999999999999,"15min":2.5369999999999999},"min":{"1min":0.21199999999999999,"5min":0.192,"15min":0.192},"max":{"1min":9.6669999999999998,"5min":11.497,"15min":102.395},"last":0.46999999999999997},{"interface":"front","average":{"1min":1.7909999999999999,"5min":1.5980000000000001,"15min":2.8559999999999999},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.22700000000000001},"max":{"1min":7.0410000000000004,"5min":9.8650000000000002,"15min":102.50700000000001},"last":1.704}]},{"osd":3,"last update":"Fri Oct 8 19:38:39 2021","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.4930000000000001,"15min":2.9540000000000002},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":5.4880000000000004,"5min":7.0800000000000001,"15min":105.836},"last":1.498},{"interface":"front","average":{"1min":1.825,"5min":1.8560000000000001,"15min":2.8660000000000001},"min":{"1min":0.29799999999999999,"5min":0.27700000000000002,"15min":0.22900000000000001},"max":{"1min":9.8460000000000001,"5min":11.473000000000001,"15min":106.12},"last":0.68000000000000005}]},{"osd":4,"last update":"Fri Oct 8 19:38:48 2021","interfaces":[{"interface":"back","average":{"1min":1.5940000000000001,"5min":1.6899999999999999,"15min":2.1539999999999999},"min":{"1min":0.34000000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":4.6950000000000003,"5min":7.2370000000000001,"15min":103.538},"last":1.597},{"interface":"front","average":{"1min":1.9470000000000001,"5min":1.6339999999999999,"15min":1.8320000000000001},"min":{"1min":0.35499999999999998,"5min":0.29299999999999998,"15min":0.254},"max":{"1min":13.9,"5min":13.9,"15min":102.67100000000001},"last":0.51800000000000002}]},{"osd":5,"last update":"Fri Oct 8 19:39:20 2021","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":4.7729999999999997,"15min":3.2709999999999999},"min":{"1min":0.34699999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":4.609,"5min":262.14100000000002,"15min":262.14100000000002},"last":0.71899999999999997},{"interface":"front","average":{"1min":1.115,"5min":4.8760000000000003,"15min":2.9940000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.29999999999999999},"max":{"1min":4.3799999999999999,"5min":261.959,"15min":261.959},"last":0.54100000000000004}]},{"osd":6,"last update":"Fri Oct 8 19:38:30 2021","interfaces":[{"interface":"back","average":{"1min":2.0899999999999999,"5min":1.8129999999999999,"15min":2.2200000000000002},"min":{"1min":0.38700000000000001,"5min":0.32500000000000001,"15min":0.26700000000000002},"max":{"1min":13.837,"5min":13.837,"15min":103.73},"last":1.5640000000000001},{"interface":"front","average":{"1min":1.357,"5min":1.4410000000000001,"15min":2.1589999999999998},"min":{"1min":0.48199999999999998,"5min":0.34399999999999997,"15min":0.33800000000000002},"max":{"1min":3.9470000000000001,"5min":6.915,"15min":102.753},"last":0.78700000000000003}]},{"osd":7,"last update":"Fri Oct 8 19:38:48 2021","interfaces":[{"interface":"back","average":{"1min":1.7689999999999999,"5min":1.4970000000000001,"15min":2.6349999999999998},"min":{"1min":0.44400000000000001,"5min":0.316,"15min":0.312},"max":{"1min":5.0599999999999996,"5min":7.0979999999999999,"15min":106.011},"last":0.74399999999999999},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.5980000000000001,"15min":2.2869999999999999},"min":{"1min":0.36799999999999999,"5min":0.36699999999999999,"15min":0.34200000000000003},"max":{"1min":9.7720000000000002,"5min":11.445,"15min":103.78400000000001},"last":0.56100000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738614,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":945212,"kb_used_data":586740,"kb_used_omap":0,"kb_used_meta":358464,"kb_avail":92799940,"statfs":{"total":95995035648,"available":95027138560,"internally_reserved":0,"allocated":600821760,"data_stored":600390298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":367067136},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 8 19:39:05 2021","interfaces":[{"interface":"back","average":{"1min":1.968,"5min":1.7849999999999999,"15min":2.4289999999999998},"min":{"1min":0.20100000000000001,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":11.202,"5min":16.632000000000001,"15min":91.954999999999998},"last":2.7770000000000001},{"interface":"front","average":{"1min":1.044,"5min":1.6699999999999999,"15min":2.4790000000000001},"min":{"1min":0.224,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":4.4500000000000002,"5min":9.9019999999999992,"15min":91.046000000000006},"last":1.639}]},{"osd":2,"last update":"Fri Oct 8 19:38:22 2021","interfaces":[{"interface":"back","average":{"1min":1.9490000000000001,"5min":1.794,"15min":2.234},"min":{"1min":0.26600000000000001,"5min":0.217,"15min":0.217},"max":{"1min":8.2219999999999995,"5min":9.8030000000000008,"15min":62.390000000000001},"last":1.4910000000000001},{"interface":"front","average":{"1min":1.655,"5min":1.901,"15min":2.1739999999999999},"min":{"1min":0.23400000000000001,"5min":0.21099999999999999,"15min":0.19500000000000001},"max":{"1min":7.1459999999999999,"5min":10.109,"15min":62.718000000000004},"last":1.466}]},{"osd":3,"last update":"Fri Oct 8 19:38:42 2021","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.7230000000000001,"15min":2.4350000000000001},"min":{"1min":0.221,"5min":0.218,"15min":0.217},"max":{"1min":5.9589999999999996,"5min":9.7690000000000001,"15min":62.491},"last":1.526},{"interface":"front","average":{"1min":2.2029999999999998,"5min":1.794,"15min":2.2610000000000001},"min":{"1min":0.255,"5min":0.221,"15min":0.20899999999999999},"max":{"1min":6.7679999999999998,"5min":10.052,"15min":62.673000000000002},"last":1.696}]},{"osd":4,"last update":"Fri Oct 8 19:39:05 2021","interfaces":[{"interface":"back","average":{"1min":2.2200000000000002,"5min":1.865,"15min":1.885},"min":{"1min":0.26400000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":11.17,"5min":12.135,"15min":16.805},"last":2.7210000000000001},{"interface":"front","average":{"1min":1.6240000000000001,"5min":1.51,"15min":1.5760000000000001},"min":{"1min":0.29499999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":5.6669999999999998,"5min":6.2270000000000003,"15min":11.823},"last":1.5489999999999999}]},{"osd":5,"last update":"Fri Oct 8 19:39:13 2021","interfaces":[{"interface":"back","average":{"1min":1.3999999999999999,"5min":1.7250000000000001,"15min":1.5920000000000001},"min":{"1min":0.313,"5min":0.28199999999999997,"15min":0.24099999999999999},"max":{"1min":4.4130000000000003,"5min":9.9730000000000008,"15min":15.56},"last":1.397},{"interface":"front","average":{"1min":1.994,"5min":2.157,"15min":1.952},"min":{"1min":0.34599999999999997,"5min":0.30599999999999999,"15min":0.28599999999999998},"max":{"1min":11.112,"5min":15.115,"15min":15.484999999999999},"last":2.6680000000000001}]},{"osd":6,"last update":"Fri Oct 8 19:38:30 2021","interfaces":[{"interface":"back","average":{"1min":1.8360000000000001,"5min":1.762,"15min":1.6899999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":5.931,"5min":7.165,"15min":11.869},"last":1.5840000000000001},{"interface":"front","average":{"1min":2.855,"5min":1.984,"15min":1.734},"min":{"1min":0.48899999999999999,"5min":0.28199999999999997,"15min":0.27500000000000002},"max":{"1min":7.1950000000000003,"5min":10.002000000000001,"15min":10.519},"last":1.4379999999999999}]},{"osd":7,"last update":"Fri Oct 8 19:38:42 2021","interfaces":[{"interface":"back","average":{"1min":2.484,"5min":2.0099999999999998,"15min":1.972},"min":{"1min":0.40300000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":11.147,"5min":13.214,"15min":13.214},"last":2.7519999999999998},{"interface":"front","average":{"1min":1.5309999999999999,"5min":1.8600000000000001,"15min":1.909},"min":{"1min":0.33100000000000002,"5min":0.315,"15min":0.315},"max":{"1min":8.7609999999999992,"5min":8.7609999999999992,"15min":11.898999999999999},"last":1.609}]}]},{"osd":2,"up_from":18,"seq":77309411566,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":999408,"kb_used_data":689128,"kb_used_omap":0,"kb_used_meta":310272,"kb_avail":92745744,"statfs":{"total":95995035648,"available":94971641856,"internally_reserved":0,"allocated":705667072,"data_stored":705248307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":317718528},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:39:16 2021","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.7629999999999999,"15min":2.5750000000000002},"min":{"1min":0.24199999999999999,"5min":0.19600000000000001,"15min":0.184},"max":{"1min":3.2799999999999998,"5min":10.83,"15min":61.670999999999999},"last":0.376},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.8200000000000001,"15min":2.5659999999999998},"min":{"1min":0.193,"5min":0.193,"15min":0.17999999999999999},"max":{"1min":11.207000000000001,"5min":11.207000000000001,"15min":65.284999999999997},"last":1.5069999999999999}]},{"osd":1,"last update":"Fri Oct 8 19:39:16 2021","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":1.625,"15min":2.8359999999999999},"min":{"1min":0.29899999999999999,"5min":0.21299999999999999,"15min":0.192},"max":{"1min":3.1960000000000002,"5min":10.218999999999999,"15min":63.738},"last":0.57099999999999995},{"interface":"front","average":{"1min":1.29,"5min":1.71,"15min":3.0640000000000001},"min":{"1min":0.29099999999999998,"5min":0.23899999999999999,"15min":0.21299999999999999},"max":{"1min":8.5690000000000008,"5min":11.988,"15min":63.619999999999997},"last":1.4830000000000001}]},{"osd":3,"last update":"Fri Oct 8 19:39:22 2021","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":2.3719999999999999,"15min":3.2610000000000001},"min":{"1min":0.253,"5min":0.245,"15min":0.21199999999999999},"max":{"1min":8.5909999999999993,"5min":67.198999999999998,"15min":67.198999999999998},"last":1.6319999999999999},{"interface":"front","average":{"1min":1.111,"5min":2.3159999999999998,"15min":3.1419999999999999},"min":{"1min":0.28999999999999998,"5min":0.22900000000000001,"15min":0.21299999999999999},"max":{"1min":3.7669999999999999,"5min":66.963999999999999,"15min":66.963999999999999},"last":0.63600000000000001}]},{"osd":4,"last update":"Fri Oct 8 19:38:49 2021","interfaces":[{"interface":"back","average":{"1min":1.901,"5min":1.758,"15min":1.722},"min":{"1min":0.315,"5min":0.27800000000000002,"15min":0.26900000000000002},"max":{"1min":5.6529999999999996,"5min":10.988,"15min":24.657},"last":0.51000000000000001},{"interface":"front","average":{"1min":2.0019999999999998,"5min":1.8280000000000001,"15min":1.823},"min":{"1min":0.308,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":8.4979999999999993,"5min":11.912000000000001,"15min":15.143000000000001},"last":2.3210000000000002}]},{"osd":5,"last update":"Fri Oct 8 19:39:16 2021","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.8720000000000001,"15min":1.871},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":8.5429999999999993,"5min":11.956,"15min":15.087999999999999},"last":1.528},{"interface":"front","average":{"1min":0.72199999999999998,"5min":1.593,"15min":1.796},"min":{"1min":0.32600000000000001,"5min":0.29199999999999998,"15min":0.27600000000000002},"max":{"1min":2.5710000000000002,"5min":8.1769999999999996,"15min":26.094000000000001},"last":1.018}]},{"osd":6,"last update":"Fri Oct 8 19:39:22 2021","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.7370000000000001,"15min":1.7030000000000001},"min":{"1min":0.33800000000000002,"5min":0.29999999999999999,"15min":0.28000000000000003},"max":{"1min":3.9380000000000002,"5min":11.023999999999999,"15min":14.162000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.79300000000000004,"5min":1.8979999999999999,"15min":1.845},"min":{"1min":0.372,"5min":0.31,"15min":0.31},"max":{"1min":2.6019999999999999,"5min":8.7829999999999995,"15min":16.68},"last":0.64500000000000002}]},{"osd":7,"last update":"Fri Oct 8 19:38:49 2021","interfaces":[{"interface":"back","average":{"1min":1.8839999999999999,"5min":3.5310000000000001,"15min":2.4399999999999999},"min":{"1min":0.37,"5min":0.32600000000000001,"15min":0.32200000000000001},"max":{"1min":4.7130000000000001,"5min":136.00200000000001,"15min":136.00200000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":1.8340000000000001,"5min":3.4279999999999999,"15min":2.359},"min":{"1min":0.34100000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":5.4710000000000001,"5min":133.26300000000001,"15min":133.26300000000001},"last":0.68600000000000005}]}]},{"osd":3,"up_from":24,"seq":103079215340,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1275028,"kb_used_data":877388,"kb_used_omap":0,"kb_used_meta":397632,"kb_avail":92470124,"statfs":{"total":95995035648,"available":94689406976,"internally_reserved":0,"allocated":898445312,"data_stored":897990693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":407175168},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:38:37 2021","interfaces":[{"interface":"back","average":{"1min":2.1720000000000002,"5min":1.829,"15min":2.633},"min":{"1min":0.22,"5min":0.187,"15min":0.17000000000000001},"max":{"1min":8.8300000000000001,"5min":8.8300000000000001,"15min":109.601},"last":0.83099999999999996},{"interface":"front","average":{"1min":2.4199999999999999,"5min":1.736,"15min":2.5750000000000002},"min":{"1min":0.217,"5min":0.20799999999999999,"15min":0.19500000000000001},"max":{"1min":8.9640000000000004,"5min":10.743,"15min":107.84},"last":0.73899999999999999}]},{"osd":1,"last update":"Fri Oct 8 19:38:37 2021","interfaces":[{"interface":"back","average":{"1min":2.0939999999999999,"5min":1.4890000000000001,"15min":2.137},"min":{"1min":0.21099999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":8.6059999999999999,"5min":8.6059999999999999,"15min":37.271999999999998},"last":0.70999999999999996},{"interface":"front","average":{"1min":2.4049999999999998,"5min":1.474,"15min":2.109},"min":{"1min":0.32600000000000001,"5min":0.223,"15min":0.19},"max":{"1min":8.9499999999999993,"5min":9.0229999999999997,"15min":37.033000000000001},"last":2.5600000000000001}]},{"osd":2,"last update":"Fri Oct 8 19:38:37 2021","interfaces":[{"interface":"back","average":{"1min":2.9529999999999998,"5min":1.514,"15min":2.1240000000000001},"min":{"1min":0.31,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":10.086,"5min":10.086,"15min":32.277000000000001},"last":2.0129999999999999},{"interface":"front","average":{"1min":2.2789999999999999,"5min":1.7310000000000001,"15min":2.1429999999999998},"min":{"1min":0.24399999999999999,"5min":0.224,"15min":0.224},"max":{"1min":11.207000000000001,"5min":11.207000000000001,"15min":23.189},"last":0.871}]},{"osd":4,"last update":"Fri Oct 8 19:38:49 2021","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.649,"15min":1.786},"min":{"1min":0.30199999999999999,"5min":0.28100000000000003,"15min":0.25600000000000001},"max":{"1min":4.3639999999999999,"5min":8.7940000000000005,"15min":18.064},"last":0.89600000000000002},{"interface":"front","average":{"1min":2.637,"5min":1.9179999999999999,"15min":1.97},"min":{"1min":0.35199999999999998,"5min":0.29099999999999998,"15min":0.26900000000000002},"max":{"1min":8.9009999999999998,"5min":8.9009999999999998,"15min":18.692},"last":1.2010000000000001}]},{"osd":5,"last update":"Fri Oct 8 19:39:12 2021","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":2.1160000000000001,"15min":1.8999999999999999},"min":{"1min":0.39800000000000002,"5min":0.28699999999999998,"15min":0.27000000000000002},"max":{"1min":5.3449999999999998,"5min":75.397000000000006,"15min":75.397000000000006},"last":1.9950000000000001},{"interface":"front","average":{"1min":1.5169999999999999,"5min":2.6949999999999998,"15min":2.2770000000000001},"min":{"1min":0.41699999999999998,"5min":0.32700000000000001,"15min":0.28100000000000003},"max":{"1min":5.577,"5min":75.680000000000007,"15min":75.680000000000007},"last":2.452}]},{"osd":6,"last update":"Fri Oct 8 19:39:23 2021","interfaces":[{"interface":"back","average":{"1min":1.6279999999999999,"5min":1.6819999999999999,"15min":1.9790000000000001},"min":{"1min":0.35399999999999998,"5min":0.32600000000000001,"15min":0.28599999999999998},"max":{"1min":9.1170000000000009,"5min":9.5,"15min":17.512},"last":1.476},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.55,"15min":1.7829999999999999},"min":{"1min":0.441,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":4.0289999999999999,"5min":8.9779999999999998,"15min":13.298},"last":1.9670000000000001}]},{"osd":7,"last update":"Fri Oct 8 19:38:49 2021","interfaces":[{"interface":"back","average":{"1min":2.2290000000000001,"5min":2.1070000000000002,"15min":1.9430000000000001},"min":{"1min":0.439,"5min":0.371,"15min":0.32200000000000001},"max":{"1min":9.1560000000000006,"5min":9.1560000000000006,"15min":10.696999999999999},"last":1.3220000000000001},{"interface":"front","average":{"1min":2.1219999999999999,"5min":1.758,"15min":1.8009999999999999},"min":{"1min":0.53900000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":5.3840000000000003,"5min":9.0239999999999991,"15min":13.225},"last":2.6360000000000001}]}]},{"osd":4,"up_from":30,"seq":128849019110,"num_pgs":75,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":755788,"kb_used_data":466884,"kb_used_omap":0,"kb_used_meta":288896,"kb_avail":92989364,"statfs":{"total":95995035648,"available":95221108736,"internally_reserved":0,"allocated":478089216,"data_stored":477642768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":295829504},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:38:50 2021","interfaces":[{"interface":"back","average":{"1min":2.2589999999999999,"5min":1.5049999999999999,"15min":1.9710000000000001},"min":{"1min":0.311,"5min":0.20899999999999999,"15min":0.185},"max":{"1min":4.7720000000000002,"5min":6.8460000000000001,"15min":82.109999999999999},"last":58.609999999999999},{"interface":"front","average":{"1min":0.92600000000000005,"5min":1.22,"15min":1.8680000000000001},"min":{"1min":0.222,"5min":0.222,"15min":0.20399999999999999},"max":{"1min":2.702,"5min":7.9340000000000002,"15min":82.025999999999996},"last":58.329999999999998}]},{"osd":1,"last update":"Fri Oct 8 19:38:50 2021","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":2.9750000000000001,"15min":2.3220000000000001},"min":{"1min":0.27600000000000002,"5min":0.215,"15min":0.215},"max":{"1min":3.2069999999999999,"5min":122.422,"15min":122.422},"last":65.332999999999998},{"interface":"front","average":{"1min":1.329,"5min":2.79,"15min":2.0219999999999998},"min":{"1min":0.27000000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":5.8529999999999998,"5min":123.122,"15min":123.122},"last":62.140000000000001}]},{"osd":2,"last update":"Fri Oct 8 19:38:50 2021","interfaces":[{"interface":"back","average":{"1min":2.0459999999999998,"5min":1.3520000000000001,"15min":1.5269999999999999},"min":{"1min":0.379,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":10.182,"5min":10.182,"15min":21.257000000000001},"last":60.082999999999998},{"interface":"front","average":{"1min":2.2050000000000001,"5min":1.6319999999999999,"15min":1.595},"min":{"1min":0.34999999999999998,"5min":0.221,"15min":0.221},"max":{"1min":10.036,"5min":10.036,"15min":21.600000000000001},"last":60.539000000000001}]},{"osd":3,"last update":"Fri Oct 8 19:38:50 2021","interfaces":[{"interface":"back","average":{"1min":1.45,"5min":1.6240000000000001,"15min":2.2440000000000002},"min":{"1min":0.33800000000000002,"5min":0.27700000000000002,"15min":0.26500000000000001},"max":{"1min":3.6949999999999998,"5min":7.468,"15min":58.506999999999998},"last":59.137},{"interface":"front","average":{"1min":1.629,"5min":1.4430000000000001,"15min":1.921},"min":{"1min":0.30399999999999999,"5min":0.254,"15min":0.254},"max":{"1min":6.149,"5min":8.5540000000000003,"15min":58.521000000000001},"last":59.777000000000001}]},{"osd":5,"last update":"Fri Oct 8 19:39:11 2021","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":1.373,"15min":1.034},"min":{"1min":0.32000000000000001,"5min":0.25900000000000001,"15min":0.23899999999999999},"max":{"1min":2.4180000000000001,"5min":10.477,"15min":10.477},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.95799999999999996,"5min":1.097,"15min":0.91700000000000004},"min":{"1min":0.35699999999999998,"5min":0.27700000000000002,"15min":0.22900000000000001},"max":{"1min":4.1760000000000002,"5min":6.1900000000000004,"15min":8.1319999999999997},"last":0.45200000000000001}]},{"osd":6,"last update":"Fri Oct 8 19:38:26 2021","interfaces":[{"interface":"back","average":{"1min":12.135999999999999,"5min":4.181,"15min":1.9359999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.23599999999999999},"max":{"1min":171.69800000000001,"5min":171.69800000000001,"15min":171.69800000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":12.487,"5min":4.3959999999999999,"15min":2.0289999999999999},"min":{"1min":0.35799999999999998,"5min":0.308,"15min":0.247},"max":{"1min":171.613,"5min":171.613,"15min":171.613},"last":0.499}]},{"osd":7,"last update":"Fri Oct 8 19:38:50 2021","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":1.2210000000000001,"15min":0.94399999999999995},"min":{"1min":0.41399999999999998,"5min":0.30199999999999999,"15min":0.26400000000000001},"max":{"1min":3.149,"5min":6.157,"15min":8.0050000000000008},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.88300000000000001,"5min":1.294,"15min":1.052},"min":{"1min":0.32400000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":2.5990000000000002,"5min":7.702,"15min":7.702},"last":0.56000000000000005}]}]},{"osd":5,"up_from":38,"seq":163208757474,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":815232,"kb_used_data":473976,"kb_used_omap":0,"kb_used_meta":341248,"kb_avail":92929920,"statfs":{"total":95995035648,"available":95160238080,"internally_reserved":0,"allocated":485351424,"data_stored":484917990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":349437952},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:39:15 2021","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":1.8819999999999999,"15min":1.5509999999999999},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20300000000000001},"max":{"1min":3.9380000000000002,"5min":43.332999999999998,"15min":43.332999999999998},"last":1.448},{"interface":"front","average":{"1min":0.96999999999999997,"5min":2.0939999999999999,"15min":1.6830000000000001},"min":{"1min":0.23899999999999999,"5min":0.216,"15min":0.216},"max":{"1min":3.9529999999999998,"5min":42.637,"15min":42.637},"last":0.34300000000000003}]},{"osd":1,"last update":"Fri Oct 8 19:39:15 2021","interfaces":[{"interface":"back","average":{"1min":1.5389999999999999,"5min":1.5740000000000001,"15min":1.9199999999999999},"min":{"1min":0.28599999999999998,"5min":0.23599999999999999,"15min":0.23000000000000001},"max":{"1min":4.6219999999999999,"5min":8.9990000000000006,"15min":94.558999999999997},"last":0.30499999999999999},{"interface":"front","average":{"1min":1.409,"5min":1.22,"15min":1.77},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.23100000000000001},"max":{"1min":4.6310000000000002,"5min":6.8570000000000002,"15min":94.456999999999994},"last":1.1910000000000001}]},{"osd":2,"last update":"Fri Oct 8 19:39:15 2021","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":1.413,"15min":1.6779999999999999},"min":{"1min":0.29399999999999998,"5min":0.249,"15min":0.249},"max":{"1min":5.1859999999999999,"5min":22.931999999999999,"15min":29.398},"last":1.4770000000000001},{"interface":"front","average":{"1min":2.024,"5min":1.706,"15min":1.7869999999999999},"min":{"1min":0.376,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":8.4610000000000003,"5min":22.963999999999999,"15min":29.387},"last":1.839}]},{"osd":3,"last update":"Fri Oct 8 19:39:15 2021","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.5349999999999999,"15min":1.794},"min":{"1min":0.29599999999999999,"5min":0.27700000000000002,"15min":0.26200000000000001},"max":{"1min":5.9569999999999999,"5min":9.5899999999999999,"15min":12.356},"last":1.579},{"interface":"front","average":{"1min":1.661,"5min":1.825,"15min":1.992},"min":{"1min":0.33800000000000002,"5min":0.27100000000000002,"15min":0.218},"max":{"1min":5.8250000000000002,"5min":8.9920000000000009,"15min":21.504000000000001},"last":0.37}]},{"osd":4,"last update":"Fri Oct 8 19:39:15 2021","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.97199999999999998,"15min":0.872},"min":{"1min":0.26500000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":2.4140000000000001,"5min":9.1600000000000001,"15min":9.2759999999999998},"last":1.544},{"interface":"front","average":{"1min":0.70699999999999996,"5min":1.101,"15min":0.91500000000000004},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.25900000000000001},"max":{"1min":3.5649999999999999,"5min":11.231,"15min":11.231},"last":1.502}]},{"osd":6,"last update":"Fri Oct 8 19:38:24 2021","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.335,"15min":1.0049999999999999},"min":{"1min":0.29399999999999998,"5min":0.28499999999999998,"15min":0.255},"max":{"1min":3.3340000000000001,"5min":11.192,"15min":11.192},"last":1.6699999999999999},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.349,"15min":1},"min":{"1min":0.33000000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":4.1420000000000003,"5min":11.259,"15min":11.259},"last":1.407}]},{"osd":7,"last update":"Fri Oct 8 19:38:46 2021","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.22,"15min":1.0609999999999999},"min":{"1min":0.36599999999999999,"5min":0.22,"15min":0.22},"max":{"1min":2.8479999999999999,"5min":7.1390000000000002,"15min":29.946999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":1.7150000000000001,"5min":1.296,"15min":1.159},"min":{"1min":0.311,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":12.970000000000001,"5min":12.970000000000001,"15min":29.294},"last":1.8859999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":266240,"data_stored":262688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":327680,"data_stored":327680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":621740032,"data_stored":621740032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1019543552,"data_stored":1019543552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":742653952,"data_stored":742653952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":898760704,"data_stored":898760704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":487391232,"data_stored":487391232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":495845376,"data_stored":495845376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":996933632,"data_stored":996933632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":740491264,"data_stored":740491264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-10-08T19:39:28.307 INFO:tasks.thrashosds.thrasher:Setting 2.12 to [5, 4, 2] 2021-10-08T19:39:28.307 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '2.12', '5', '4', '2'] 2021-10-08T19:39:28.308 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd pg-upmap 2.12 5 4 2 2021-10-08T19:39:28.360 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:39:28.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:28 smithi117 ceph-mon[34585]: 4.5 deep-scrub ok 2021-10-08T19:39:28.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:28 smithi117 ceph-mon[34585]: pgmap v905: 188 pgs: 188 active+clean; 1.9 GiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 732 B/s rd, 77 MiB/s wr, 1.23k op/s 2021-10-08T19:39:28.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:28 smithi117 ceph-mon[34585]: osdmap e444: 8 total, 8 up, 8 in 2021-10-08T19:39:28.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:28 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:39:28.433 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:28.673 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 19 16 37673 37657 123.82 88.5625 0.0119981 0.00806632 2021-10-08T19:39:28.778 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:39:28.782 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:28.783 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:39:28.884 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:39:28.979 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:29.065 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:29 smithi097 ceph-mon[41966]: 4.14 scrub ok 2021-10-08T19:39:29.066 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:29 smithi097 ceph-mon[32687]: 4.14 scrub ok 2021-10-08T19:39:29.124 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:39:29.138 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:39:29.143 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:29.144 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:39:29.165 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:39:29.196 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:39:29.231 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:39:29.247 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:39:29.272 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:39:29.304 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:29.328 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:39:29.361 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:39:29.399 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:39:29.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:29 smithi117 ceph-mon[34585]: 4.14 scrub ok 2021-10-08T19:39:29.409 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true' 2021-10-08T19:39:29.409 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true' 2021-10-08T19:39:29.410 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true' 2021-10-08T19:39:29.410 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true' 2021-10-08T19:39:29.410 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true' 2021-10-08T19:39:29.410 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true' 2021-10-08T19:39:29.412 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'true' 2021-10-08T19:39:29.412 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'true' 2021-10-08T19:39:29.673 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:2021-10-08T19:39:29.672812+0000 min lat: 0.00117486 max lat: 0.262466 avg lat: 0.00823076 2021-10-08T19:39:29.673 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2021-10-08T19:39:29.673 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 20 16 38883 38867 121.41 75.625 0.00602535 0.00823076 2021-10-08T19:39:29.722 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:39:29 smithi097 conmon[33110]: 172.21.15.117 - - [08/Oct/2021:19:39:29] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:39:30.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:30 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:39:30.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:30 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:39:30.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:30 smithi117 ceph-mon[34585]: 2.11 scrub ok 2021-10-08T19:39:30.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:30 smithi117 ceph-mon[34585]: pgmap v907: 188 pgs: 188 active+clean; 2.1 GiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 639 B/s rd, 92 MiB/s wr, 1.48k op/s 2021-10-08T19:39:30.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:30 smithi117 ceph-mon[34585]: osdmap e445: 8 total, 8 up, 8 in 2021-10-08T19:39:30.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:30 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3563411078' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:39:30.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:30 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:39:30.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:30 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:39:30.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:30 smithi117 ceph-mon[34585]: 172.21.15.117 - - [08/Oct/2021:19:39:29] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:39:30.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:30 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:39:30.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:30 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:39:30.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:30 smithi097 ceph-mon[41966]: 2.11 scrub ok 2021-10-08T19:39:30.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:30 smithi097 ceph-mon[41966]: pgmap v907: 188 pgs: 188 active+clean; 2.1 GiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 639 B/s rd, 92 MiB/s wr, 1.48k op/s 2021-10-08T19:39:30.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:30 smithi097 ceph-mon[41966]: osdmap e445: 8 total, 8 up, 8 in 2021-10-08T19:39:30.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:30 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3563411078' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:39:30.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:30 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:39:30.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:30 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:39:30.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:30 smithi097 ceph-mon[41966]: 172.21.15.117 - - [08/Oct/2021:19:39:29] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:39:30.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:30 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:39:30.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:30 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:39:30.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:30 smithi097 ceph-mon[32687]: 2.11 scrub ok 2021-10-08T19:39:30.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:30 smithi097 ceph-mon[32687]: pgmap v907: 188 pgs: 188 active+clean; 2.1 GiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 639 B/s rd, 92 MiB/s wr, 1.48k op/s 2021-10-08T19:39:30.474 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:30 smithi097 ceph-mon[32687]: osdmap e445: 8 total, 8 up, 8 in 2021-10-08T19:39:30.474 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:30 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3563411078' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:39:30.474 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:30 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:39:30.475 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:30 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:39:30.475 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:30 smithi097 ceph-mon[32687]: 172.21.15.117 - - [08/Oct/2021:19:39:29] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:39:30.673 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 21 16 40348 40332 119.989 91.5625 0.00869006 0.00832893 2021-10-08T19:39:31.024 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:39:31.026 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:31.027 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:39:31.128 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:39:31.315 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:31 smithi097 ceph-mon[32687]: 3.6 scrub ok 2021-10-08T19:39:31.316 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:31 smithi097 ceph-mon[32687]: 1.8 scrub ok 2021-10-08T19:39:31.316 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:31 smithi097 ceph-mon[32687]: 1.4 scrub ok 2021-10-08T19:39:31.317 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:31 smithi097 ceph-mon[32687]: osdmap e446: 8 total, 8 up, 8 in 2021-10-08T19:39:31.318 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:31 smithi097 ceph-mon[41966]: 3.6 scrub ok 2021-10-08T19:39:31.319 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:31 smithi097 ceph-mon[41966]: 1.8 scrub ok 2021-10-08T19:39:31.319 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:31 smithi097 ceph-mon[41966]: 1.4 scrub ok 2021-10-08T19:39:31.319 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:31 smithi097 ceph-mon[41966]: osdmap e446: 8 total, 8 up, 8 in 2021-10-08T19:39:31.323 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:31.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:31 smithi117 ceph-mon[34585]: 3.6 scrub ok 2021-10-08T19:39:31.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:31 smithi117 ceph-mon[34585]: 1.8 scrub ok 2021-10-08T19:39:31.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:31 smithi117 ceph-mon[34585]: 1.4 scrub ok 2021-10-08T19:39:31.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:31 smithi117 ceph-mon[34585]: osdmap e446: 8 total, 8 up, 8 in 2021-10-08T19:39:31.676 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 22 16 41732 41716 118.461 86.5 0.0117317 0.00843636 2021-10-08T19:39:32.315 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:32 smithi117 ceph-mon[34585]: 2.17 scrub ok 2021-10-08T19:39:32.316 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:32 smithi117 ceph-mon[34585]: pgmap v910: 188 pgs: 188 active+clean; 2.3 GiB data, 9.4 GiB used, 706 GiB / 715 GiB avail; 1003 B/s rd, 89 MiB/s wr, 1.43k op/s 2021-10-08T19:39:32.316 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:32 smithi117 ceph-mon[34585]: 5.b scrub ok 2021-10-08T19:39:32.316 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:39:32 smithi117 conmon[69189]: level=error ts=2021-10-08T19:39:32.314Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=1 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:39:32.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:32 smithi097 ceph-mon[41966]: 2.17 scrub ok 2021-10-08T19:39:32.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:32 smithi097 ceph-mon[41966]: pgmap v910: 188 pgs: 188 active+clean; 2.3 GiB data, 9.4 GiB used, 706 GiB / 715 GiB avail; 1003 B/s rd, 89 MiB/s wr, 1.43k op/s 2021-10-08T19:39:32.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:32 smithi097 ceph-mon[41966]: 5.b scrub ok 2021-10-08T19:39:32.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:32 smithi097 ceph-mon[32687]: 2.17 scrub ok 2021-10-08T19:39:32.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:32 smithi097 ceph-mon[32687]: pgmap v910: 188 pgs: 188 active+clean; 2.3 GiB data, 9.4 GiB used, 706 GiB / 715 GiB avail; 1003 B/s rd, 89 MiB/s wr, 1.43k op/s 2021-10-08T19:39:32.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:32 smithi097 ceph-mon[32687]: 5.b scrub ok 2021-10-08T19:39:32.674 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 23 15 43013 42998 116.794 80.125 0.00569732 0.00855644 2021-10-08T19:39:32.705 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:39:32.710 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:32.711 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:39:32.812 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:39:32.872 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:32.921 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:39:32 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:39:32] "GET /metrics HTTP/1.1" 200 155901 "" "Prometheus/2.18.1" 2021-10-08T19:39:33.073 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:39:33.174 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:39:33.190 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:33.191 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:39:33.293 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:39:33.362 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:33.459 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:39:33.469 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:33.470 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:39:33.520 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:39:33.520 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2021-10-08T19:39:33.520 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2021-10-08T19:39:33.520 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2021-10-08T19:39:33.521 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.521 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:102327 8.b 8:d96333ad:::benchmark_data_smithi097_144160_object13587:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e245)", 2021-10-08T19:39:33.521 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:57.776586+0000", 2021-10-08T19:39:33.521 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 575.73574124000004, 2021-10-08T19:39:33.522 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.313372897, 2021-10-08T19:39:33.522 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:39:33.522 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "reached pg", 2021-10-08T19:39:33.523 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:39:33.524 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:39:33.524 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:39:33.524 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 102327 2021-10-08T19:39:33.524 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.525 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:39:33.525 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.525 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:39:33.525 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.776586+0000", 2021-10-08T19:39:33.526 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:39:33.526 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.526 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.526 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:39:33.526 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.776586+0000", 2021-10-08T19:39:33.527 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:39:33.527 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.527 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.527 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:39:33.528 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.776584+0000", 2021-10-08T19:39:33.528 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:39:33.528 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.528 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.528 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:39:33.529 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.776592+0000", 2021-10-08T19:39:33.529 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3229999999999998e-06 2021-10-08T19:39:33.529 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.529 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.529 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:39:33.530 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.776604+0000", 2021-10-08T19:39:33.530 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2075999999999999e-05 2021-10-08T19:39:33.530 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.530 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.531 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:39:33.531 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.776612+0000", 2021-10-08T19:39:33.531 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.182e-06 2021-10-08T19:39:33.531 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.531 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.532 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:39:33.532 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.776666+0000", 2021-10-08T19:39:33.532 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4580000000000003e-05 2021-10-08T19:39:33.532 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.533 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.533 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:39:33.533 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.776804+0000", 2021-10-08T19:39:33.533 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000137732 2021-10-08T19:39:33.533 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.534 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.534 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:39:33.534 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.776946+0000", 2021-10-08T19:39:33.534 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000141865 2021-10-08T19:39:33.534 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.535 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.535 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:39:33.535 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.784549+0000", 2021-10-08T19:39:33.535 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.007603004 2021-10-08T19:39:33.535 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.536 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.536 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:39:33.536 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.784555+0000", 2021-10-08T19:39:33.536 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.63e-06 2021-10-08T19:39:33.536 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.537 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.537 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:39:33.537 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.064145+0000", 2021-10-08T19:39:33.537 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.27958945 2021-10-08T19:39:33.538 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.538 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.538 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for missing object", 2021-10-08T19:39:33.538 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.064320+0000", 2021-10-08T19:39:33.538 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017478799999999999 2021-10-08T19:39:33.539 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.539 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.539 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:39:33.539 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.089870+0000", 2021-10-08T19:39:33.539 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.025550007999999999 2021-10-08T19:39:33.540 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.540 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.540 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:39:33.540 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.089959+0000", 2021-10-08T19:39:33.540 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9622000000000004e-05 2021-10-08T19:39:33.541 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:33.541 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:33.541 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:33.541 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.541 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.542 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:102343 8.b 8:d1ed84a2:::benchmark_data_smithi097_144160_object13603:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e246)", 2021-10-08T19:39:33.542 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:57.786622+0000", 2021-10-08T19:39:33.542 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 575.72570595800005, 2021-10-08T19:39:33.542 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3035327460000001, 2021-10-08T19:39:33.543 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:39:33.543 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:39:33.543 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:39:33.543 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:39:33.543 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:39:33.544 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 102343 2021-10-08T19:39:33.544 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.544 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:39:33.544 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.545 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:39:33.545 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.786622+0000", 2021-10-08T19:39:33.545 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:39:33.545 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.545 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.546 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:39:33.546 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.786622+0000", 2021-10-08T19:39:33.546 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:39:33.546 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.546 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.547 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:39:33.547 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.786619+0000", 2021-10-08T19:39:33.547 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:39:33.547 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.547 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.548 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:39:33.548 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.786627+0000", 2021-10-08T19:39:33.548 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2370000000000003e-06 2021-10-08T19:39:33.548 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.549 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.549 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:39:33.549 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.786640+0000", 2021-10-08T19:39:33.549 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3638000000000001e-05 2021-10-08T19:39:33.549 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.550 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.550 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:39:33.550 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.786647+0000", 2021-10-08T19:39:33.550 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.336e-06 2021-10-08T19:39:33.550 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.551 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.551 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:39:33.551 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.786694+0000", 2021-10-08T19:39:33.551 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7061999999999998e-05 2021-10-08T19:39:33.551 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.552 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.552 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:39:33.552 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.786702+0000", 2021-10-08T19:39:33.552 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.9759999999999995e-06 2021-10-08T19:39:33.553 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.553 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.553 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:39:33.553 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.064372+0000", 2021-10-08T19:39:33.553 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2776700810000001 2021-10-08T19:39:33.554 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.554 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.554 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:39:33.554 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.064483+0000", 2021-10-08T19:39:33.554 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000111037 2021-10-08T19:39:33.555 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.555 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.555 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:39:33.555 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.064576+0000", 2021-10-08T19:39:33.556 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.3629999999999996e-05 2021-10-08T19:39:33.556 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.556 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.556 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:39:33.556 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.073145+0000", 2021-10-08T19:39:33.557 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0085683519999999996 2021-10-08T19:39:33.557 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.557 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.557 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:39:33.557 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.089994+0000", 2021-10-08T19:39:33.558 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016849113999999998 2021-10-08T19:39:33.558 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.558 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.558 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:39:33.559 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.090049+0000", 2021-10-08T19:39:33.559 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4925e-05 2021-10-08T19:39:33.559 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.559 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.559 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:39:33.560 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.090087+0000", 2021-10-08T19:39:33.560 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8114000000000001e-05 2021-10-08T19:39:33.560 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.560 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.560 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:39:33.561 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.090154+0000", 2021-10-08T19:39:33.561 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7436999999999998e-05 2021-10-08T19:39:33.561 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:33.561 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:33.562 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:33.562 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.562 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.562 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:102361 8.b 8:d358b36d:::benchmark_data_smithi097_144160_object13621:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e246)", 2021-10-08T19:39:33.563 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:57.803469+0000", 2021-10-08T19:39:33.563 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 575.70885829899998, 2021-10-08T19:39:33.563 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2869686300000001, 2021-10-08T19:39:33.563 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:39:33.563 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:39:33.564 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:39:33.564 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:39:33.564 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:39:33.564 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 102361 2021-10-08T19:39:33.565 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.565 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:39:33.565 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.565 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:39:33.565 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.803469+0000", 2021-10-08T19:39:33.566 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:39:33.566 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.566 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.566 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:39:33.566 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.803469+0000", 2021-10-08T19:39:33.567 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:39:33.567 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.567 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.567 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:39:33.567 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.803466+0000", 2021-10-08T19:39:33.568 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2021-10-08T19:39:33.568 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.568 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.568 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:39:33.569 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.803475+0000", 2021-10-08T19:39:33.569 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4840000000000004e-06 2021-10-08T19:39:33.569 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.569 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.569 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:39:33.570 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.803489+0000", 2021-10-08T19:39:33.570 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4278e-05 2021-10-08T19:39:33.570 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.570 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.571 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:39:33.571 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.803495+0000", 2021-10-08T19:39:33.571 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6010000000000002e-06 2021-10-08T19:39:33.571 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.571 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.572 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:39:33.572 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.803548+0000", 2021-10-08T19:39:33.572 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2964999999999999e-05 2021-10-08T19:39:33.572 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.572 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.573 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:39:33.573 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.803560+0000", 2021-10-08T19:39:33.573 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1783000000000001e-05 2021-10-08T19:39:33.573 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.574 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.574 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:39:33.574 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.066723+0000", 2021-10-08T19:39:33.574 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2631632740000001 2021-10-08T19:39:33.575 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.575 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.575 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:39:33.575 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.066846+0000", 2021-10-08T19:39:33.576 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012360800000000001 2021-10-08T19:39:33.576 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.576 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.576 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:39:33.576 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.066947+0000", 2021-10-08T19:39:33.577 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010030300000000001 2021-10-08T19:39:33.577 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.577 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.577 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:39:33.578 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.073155+0000", 2021-10-08T19:39:33.578 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.006208369 2021-10-08T19:39:33.578 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.578 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.579 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:39:33.579 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.090022+0000", 2021-10-08T19:39:33.579 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016866467 2021-10-08T19:39:33.579 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.580 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.580 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:39:33.580 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.090239+0000", 2021-10-08T19:39:33.580 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021783300000000001 2021-10-08T19:39:33.580 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.581 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.581 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:39:33.581 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.090302+0000", 2021-10-08T19:39:33.581 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2689999999999998e-05 2021-10-08T19:39:33.581 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.582 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.582 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:39:33.582 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.090438+0000", 2021-10-08T19:39:33.582 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013576199999999999 2021-10-08T19:39:33.583 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:33.583 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:33.583 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:33.583 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.583 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.584 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:102370 8.b 8:d6039b15:::benchmark_data_smithi097_144160_object13630:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e246)", 2021-10-08T19:39:33.584 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:57.811310+0000", 2021-10-08T19:39:33.584 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 575.70101790800004, 2021-10-08T19:39:33.584 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.279322471, 2021-10-08T19:39:33.584 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:39:33.585 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:39:33.585 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:39:33.585 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:39:33.585 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:39:33.585 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 102370 2021-10-08T19:39:33.586 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.586 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:39:33.586 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.586 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:39:33.586 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.811310+0000", 2021-10-08T19:39:33.587 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:39:33.587 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.587 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.587 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:39:33.587 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.811310+0000", 2021-10-08T19:39:33.588 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:39:33.588 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.588 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.588 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:39:33.588 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.811307+0000", 2021-10-08T19:39:33.589 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2021-10-08T19:39:33.589 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.589 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.589 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:39:33.590 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.811316+0000", 2021-10-08T19:39:33.590 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0089999999999996e-06 2021-10-08T19:39:33.590 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.590 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.590 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:39:33.591 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.811330+0000", 2021-10-08T19:39:33.591 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4246999999999999e-05 2021-10-08T19:39:33.591 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.591 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.592 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:39:33.592 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.811337+0000", 2021-10-08T19:39:33.592 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0620000000000003e-06 2021-10-08T19:39:33.592 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.592 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.593 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:39:33.593 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.811393+0000", 2021-10-08T19:39:33.593 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5599000000000001e-05 2021-10-08T19:39:33.593 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.594 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.594 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:39:33.594 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.811402+0000", 2021-10-08T19:39:33.594 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4190000000000008e-06 2021-10-08T19:39:33.594 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.595 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.595 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:39:33.595 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.068209+0000", 2021-10-08T19:39:33.595 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2568067969999999 2021-10-08T19:39:33.595 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.596 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.596 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:39:33.596 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.068351+0000", 2021-10-08T19:39:33.596 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014235800000000001 2021-10-08T19:39:33.597 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.597 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.597 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:39:33.597 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.068521+0000", 2021-10-08T19:39:33.597 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016929400000000001 2021-10-08T19:39:33.598 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.598 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.598 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:39:33.598 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.076535+0000", 2021-10-08T19:39:33.598 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.008014284 2021-10-08T19:39:33.599 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.599 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.599 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:39:33.599 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.090183+0000", 2021-10-08T19:39:33.599 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013648118000000001 2021-10-08T19:39:33.600 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.600 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.600 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:39:33.600 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.090500+0000", 2021-10-08T19:39:33.601 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031644699999999997 2021-10-08T19:39:33.601 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.601 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.601 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:39:33.601 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.090537+0000", 2021-10-08T19:39:33.602 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7335000000000001e-05 2021-10-08T19:39:33.602 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.602 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.602 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:39:33.603 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.090632+0000", 2021-10-08T19:39:33.603 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5163999999999999e-05 2021-10-08T19:39:33.603 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:33.603 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:33.603 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:33.604 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.604 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.604 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:102371 8.b 8:d2cae905:::benchmark_data_smithi097_144160_object13631:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e246)", 2021-10-08T19:39:33.604 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:57.812258+0000", 2021-10-08T19:39:33.605 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 575.700069923, 2021-10-08T19:39:33.605 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2786662559999999, 2021-10-08T19:39:33.605 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:39:33.605 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:39:33.605 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:39:33.606 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:39:33.606 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:39:33.606 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 102371 2021-10-08T19:39:33.606 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.607 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:39:33.607 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.607 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:39:33.607 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.812258+0000", 2021-10-08T19:39:33.607 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:39:33.608 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.608 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.608 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:39:33.608 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.812258+0000", 2021-10-08T19:39:33.609 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:39:33.609 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.609 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.609 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:39:33.609 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.812255+0000", 2021-10-08T19:39:33.610 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:39:33.610 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.610 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.610 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:39:33.610 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.812263+0000", 2021-10-08T19:39:33.611 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8310000000000001e-06 2021-10-08T19:39:33.611 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.611 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.611 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:39:33.611 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.812274+0000", 2021-10-08T19:39:33.612 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1038e-05 2021-10-08T19:39:33.612 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.612 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.612 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:39:33.612 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.812281+0000", 2021-10-08T19:39:33.613 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9410000000000001e-06 2021-10-08T19:39:33.613 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.613 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.613 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:39:33.614 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.812328+0000", 2021-10-08T19:39:33.614 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7534999999999998e-05 2021-10-08T19:39:33.614 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.614 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.614 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:39:33.615 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.812337+0000", 2021-10-08T19:39:33.615 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0690000000000002e-06 2021-10-08T19:39:33.615 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.615 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.615 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:39:33.616 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.070249+0000", 2021-10-08T19:39:33.616 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2579120420000001 2021-10-08T19:39:33.616 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.616 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.616 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:39:33.617 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.070324+0000", 2021-10-08T19:39:33.617 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5723999999999995e-05 2021-10-08T19:39:33.617 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.617 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.617 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:39:33.618 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.070397+0000", 2021-10-08T19:39:33.618 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2696999999999999e-05 2021-10-08T19:39:33.618 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.619 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.619 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:39:33.619 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.076545+0000", 2021-10-08T19:39:33.619 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0061481239999999996 2021-10-08T19:39:33.620 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.620 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.620 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:39:33.620 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.090685+0000", 2021-10-08T19:39:33.620 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.014139413 2021-10-08T19:39:33.621 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.621 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.621 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:39:33.621 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.090755+0000", 2021-10-08T19:39:33.622 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9966000000000001e-05 2021-10-08T19:39:33.622 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.622 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.622 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:39:33.622 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.090808+0000", 2021-10-08T19:39:33.623 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3483999999999998e-05 2021-10-08T19:39:33.623 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.623 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.623 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:39:33.624 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.090924+0000", 2021-10-08T19:39:33.624 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115852 2021-10-08T19:39:33.624 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:33.624 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:33.624 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:33.625 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.625 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.625 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:102408 8.b 8:d5c85811:::benchmark_data_smithi097_144160_object13668:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e246)", 2021-10-08T19:39:33.625 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:57.849095+0000", 2021-10-08T19:39:33.626 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 575.66323274499996, 2021-10-08T19:39:33.626 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.242117699, 2021-10-08T19:39:33.626 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:39:33.626 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:39:33.626 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:39:33.627 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:39:33.627 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:39:33.627 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 102408 2021-10-08T19:39:33.627 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.628 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:39:33.628 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.628 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:39:33.628 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.849095+0000", 2021-10-08T19:39:33.628 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:39:33.629 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.629 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.629 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:39:33.629 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.849095+0000", 2021-10-08T19:39:33.630 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:39:33.630 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.630 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.630 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:39:33.630 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.849092+0000", 2021-10-08T19:39:33.631 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2021-10-08T19:39:33.631 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.631 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.631 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:39:33.631 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.849101+0000", 2021-10-08T19:39:33.632 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2150000000000007e-06 2021-10-08T19:39:33.632 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.632 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.632 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:39:33.633 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.849119+0000", 2021-10-08T19:39:33.633 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7762999999999999e-05 2021-10-08T19:39:33.633 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.633 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.633 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:39:33.634 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.849127+0000", 2021-10-08T19:39:33.634 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0339999999999997e-06 2021-10-08T19:39:33.634 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.634 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.634 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:39:33.635 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.849213+0000", 2021-10-08T19:39:33.635 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5550999999999995e-05 2021-10-08T19:39:33.635 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.635 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.636 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:39:33.636 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.849225+0000", 2021-10-08T19:39:33.636 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2784e-05 2021-10-08T19:39:33.636 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.636 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.637 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:39:33.637 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.071521+0000", 2021-10-08T19:39:33.637 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.222295881 2021-10-08T19:39:33.637 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.637 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.638 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:39:33.638 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.071592+0000", 2021-10-08T19:39:33.638 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0618999999999996e-05 2021-10-08T19:39:33.638 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.639 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.639 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:39:33.639 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.071704+0000", 2021-10-08T19:39:33.639 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000111947 2021-10-08T19:39:33.639 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.640 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.640 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:39:33.640 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.079462+0000", 2021-10-08T19:39:33.640 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0077579880000000004 2021-10-08T19:39:33.640 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.641 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.641 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:39:33.641 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.090992+0000", 2021-10-08T19:39:33.641 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011530228999999999 2021-10-08T19:39:33.641 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.642 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.642 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:39:33.642 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.091047+0000", 2021-10-08T19:39:33.642 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5003999999999997e-05 2021-10-08T19:39:33.643 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.643 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.643 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:39:33.643 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.091101+0000", 2021-10-08T19:39:33.643 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3915999999999997e-05 2021-10-08T19:39:33.644 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.644 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.644 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:39:33.644 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.091212+0000", 2021-10-08T19:39:33.645 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000111482 2021-10-08T19:39:33.645 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:33.645 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:33.645 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:33.645 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.646 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.646 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:102461 8.b 8:d92641bf:::benchmark_data_smithi097_144160_object13721:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e246)", 2021-10-08T19:39:33.646 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:57.896261+0000", 2021-10-08T19:39:33.646 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 575.61606606999999, 2021-10-08T19:39:33.647 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.19521414, 2021-10-08T19:39:33.647 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:39:33.647 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:39:33.647 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:39:33.647 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:39:33.648 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:39:33.648 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 102461 2021-10-08T19:39:33.648 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.648 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:39:33.648 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.649 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:39:33.649 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.896261+0000", 2021-10-08T19:39:33.649 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:39:33.649 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.649 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.650 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:39:33.650 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.896261+0000", 2021-10-08T19:39:33.650 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:39:33.650 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.651 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.651 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:39:33.651 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.896259+0000", 2021-10-08T19:39:33.651 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2021-10-08T19:39:33.651 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.652 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.652 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:39:33.652 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.896269+0000", 2021-10-08T19:39:33.652 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0076e-05 2021-10-08T19:39:33.653 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.653 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.653 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:39:33.653 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.896287+0000", 2021-10-08T19:39:33.653 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8287999999999998e-05 2021-10-08T19:39:33.654 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.654 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.654 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:39:33.654 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.896294+0000", 2021-10-08T19:39:33.654 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1080000000000004e-06 2021-10-08T19:39:33.655 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.655 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.655 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:39:33.655 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.898501+0000", 2021-10-08T19:39:33.655 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0022066809999999998 2021-10-08T19:39:33.656 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.656 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.656 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:39:33.656 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.898513+0000", 2021-10-08T19:39:33.656 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2515e-05 2021-10-08T19:39:33.657 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.657 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.657 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:39:33.657 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.073204+0000", 2021-10-08T19:39:33.657 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1746909130000001 2021-10-08T19:39:33.658 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.658 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.658 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:39:33.658 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.073334+0000", 2021-10-08T19:39:33.659 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012976599999999999 2021-10-08T19:39:33.659 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.659 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.659 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:39:33.659 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.073472+0000", 2021-10-08T19:39:33.660 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013843899999999999 2021-10-08T19:39:33.660 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.660 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.660 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:39:33.660 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.079467+0000", 2021-10-08T19:39:33.661 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0059946419999999997 2021-10-08T19:39:33.661 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.661 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.661 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:39:33.662 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.091278+0000", 2021-10-08T19:39:33.662 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011810835 2021-10-08T19:39:33.662 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.662 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.663 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:39:33.663 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.091321+0000", 2021-10-08T19:39:33.663 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2846999999999998e-05 2021-10-08T19:39:33.663 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.664 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.664 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:39:33.664 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.091367+0000", 2021-10-08T19:39:33.664 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6230000000000003e-05 2021-10-08T19:39:33.664 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.665 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.665 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:39:33.665 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.091476+0000", 2021-10-08T19:39:33.665 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000108612 2021-10-08T19:39:33.666 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:33.666 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:33.666 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:33.666 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.666 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.667 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:102466 8.b 8:d1830078:::benchmark_data_smithi097_144160_object13726:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e246)", 2021-10-08T19:39:33.667 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:57.901226+0000", 2021-10-08T19:39:33.667 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 575.61110142500002, 2021-10-08T19:39:33.667 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1905235759999999, 2021-10-08T19:39:33.668 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:39:33.668 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:39:33.668 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:39:33.668 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:39:33.668 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:39:33.669 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 102466 2021-10-08T19:39:33.669 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.669 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:39:33.669 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.669 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:39:33.670 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.901226+0000", 2021-10-08T19:39:33.670 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:39:33.670 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.670 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.670 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:39:33.671 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.901226+0000", 2021-10-08T19:39:33.671 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:39:33.671 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.671 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.671 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:39:33.672 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.901224+0000", 2021-10-08T19:39:33.672 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:39:33.672 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.672 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.673 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:39:33.673 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.901234+0000", 2021-10-08T19:39:33.673 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0096e-05 2021-10-08T19:39:33.673 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.673 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.674 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:39:33.674 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.901251+0000", 2021-10-08T19:39:33.674 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7295999999999998e-05 2021-10-08T19:39:33.674 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.674 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.675 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:39:33.675 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.901258+0000", 2021-10-08T19:39:33.675 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.537e-06 2021-10-08T19:39:33.675 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.675 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.676 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:39:33.676 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.901316+0000", 2021-10-08T19:39:33.676 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7095999999999997e-05 2021-10-08T19:39:33.676 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.676 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.677 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:39:33.677 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.901324+0000", 2021-10-08T19:39:33.677 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7120000000000006e-06 2021-10-08T19:39:33.677 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.678 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.678 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:39:33.678 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.074960+0000", 2021-10-08T19:39:33.678 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.173635974 2021-10-08T19:39:33.678 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.679 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.679 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:39:33.679 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.075044+0000", 2021-10-08T19:39:33.679 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3827999999999998e-05 2021-10-08T19:39:33.679 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.680 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.680 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:39:33.680 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.075129+0000", 2021-10-08T19:39:33.680 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5067000000000004e-05 2021-10-08T19:39:33.681 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.681 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.681 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:39:33.681 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.082429+0000", 2021-10-08T19:39:33.681 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0072995530000000003 2021-10-08T19:39:33.682 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.682 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.682 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:39:33.682 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.091536+0000", 2021-10-08T19:39:33.683 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0091073170000000002 2021-10-08T19:39:33.683 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.683 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.683 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:39:33.683 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.091592+0000", 2021-10-08T19:39:33.684 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6023999999999998e-05 2021-10-08T19:39:33.684 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.684 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.684 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:39:33.685 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.091641+0000", 2021-10-08T19:39:33.685 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9060000000000001e-05 2021-10-08T19:39:33.685 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.685 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.685 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:39:33.686 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.091750+0000", 2021-10-08T19:39:33.686 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010856199999999999 2021-10-08T19:39:33.686 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:33.687 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:33.687 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:33.687 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.687 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.687 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:102476 8.b 8:d4797e70:::benchmark_data_smithi097_144160_object13736:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e246)", 2021-10-08T19:39:33.688 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:57.905825+0000", 2021-10-08T19:39:33.688 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 575.606502181, 2021-10-08T19:39:33.688 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1861595030000001, 2021-10-08T19:39:33.688 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:39:33.689 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:39:33.689 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:39:33.689 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:39:33.689 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:39:33.689 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 102476 2021-10-08T19:39:33.690 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.690 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:39:33.690 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.690 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:39:33.690 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.905825+0000", 2021-10-08T19:39:33.691 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:39:33.691 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.691 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.691 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:39:33.691 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.905825+0000", 2021-10-08T19:39:33.692 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:39:33.692 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.692 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.692 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:39:33.693 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.905825+0000", 2021-10-08T19:39:33.693 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2021-10-08T19:39:33.693 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.693 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.693 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:39:33.694 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.905828+0000", 2021-10-08T19:39:33.694 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2270000000000002e-06 2021-10-08T19:39:33.694 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.695 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.695 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:39:33.695 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.905833+0000", 2021-10-08T19:39:33.695 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7079999999999996e-06 2021-10-08T19:39:33.696 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.696 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.696 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:39:33.696 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.905837+0000", 2021-10-08T19:39:33.697 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0419999999999996e-06 2021-10-08T19:39:33.697 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.697 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.697 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:39:33.697 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.905899+0000", 2021-10-08T19:39:33.698 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2711000000000003e-05 2021-10-08T19:39:33.698 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.698 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.698 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:39:33.699 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.905907+0000", 2021-10-08T19:39:33.699 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.157e-06 2021-10-08T19:39:33.699 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.699 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.699 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:39:33.700 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.076593+0000", 2021-10-08T19:39:33.700 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.170685502 2021-10-08T19:39:33.700 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.700 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.700 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:39:33.701 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.076721+0000", 2021-10-08T19:39:33.701 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012835900000000001 2021-10-08T19:39:33.701 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.701 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.701 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:39:33.702 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.076856+0000", 2021-10-08T19:39:33.702 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000134812 2021-10-08T19:39:33.702 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.702 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.703 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:39:33.703 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.082433+0000", 2021-10-08T19:39:33.703 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0055767919999999997 2021-10-08T19:39:33.703 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.703 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.704 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:39:33.704 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.091797+0000", 2021-10-08T19:39:33.704 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0093636450000000003 2021-10-08T19:39:33.704 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.704 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.705 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:39:33.705 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.091831+0000", 2021-10-08T19:39:33.705 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4465999999999998e-05 2021-10-08T19:39:33.705 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.705 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.706 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:39:33.706 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.091876+0000", 2021-10-08T19:39:33.706 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4512999999999999e-05 2021-10-08T19:39:33.706 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.706 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.707 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:39:33.707 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.091985+0000", 2021-10-08T19:39:33.707 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000109276 2021-10-08T19:39:33.707 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:33.708 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:33.708 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:33.708 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.708 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.708 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:102477 8.b 8:de0ad642:::benchmark_data_smithi097_144160_object13737:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e246)", 2021-10-08T19:39:33.709 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:57.907234+0000", 2021-10-08T19:39:33.709 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 575.60509361799996, 2021-10-08T19:39:33.709 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.184993988, 2021-10-08T19:39:33.709 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:39:33.709 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:39:33.710 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:39:33.710 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:39:33.710 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:39:33.710 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 102477 2021-10-08T19:39:33.710 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.711 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:39:33.711 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.711 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:39:33.711 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.907234+0000", 2021-10-08T19:39:33.712 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:39:33.712 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.712 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.712 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:39:33.712 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.907234+0000", 2021-10-08T19:39:33.713 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:39:33.713 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.713 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.713 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:39:33.713 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.907233+0000", 2021-10-08T19:39:33.714 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2021-10-08T19:39:33.714 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.714 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.714 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:39:33.714 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.907238+0000", 2021-10-08T19:39:33.715 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.04e-06 2021-10-08T19:39:33.715 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.715 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.715 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:39:33.715 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.907246+0000", 2021-10-08T19:39:33.716 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.9389999999999997e-06 2021-10-08T19:39:33.716 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.716 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.716 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:39:33.716 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.907251+0000", 2021-10-08T19:39:33.717 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.899e-06 2021-10-08T19:39:33.717 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.717 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.717 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:39:33.718 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.907298+0000", 2021-10-08T19:39:33.718 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7314999999999997e-05 2021-10-08T19:39:33.718 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.718 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.718 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:39:33.719 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.907304+0000", 2021-10-08T19:39:33.719 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7060000000000001e-06 2021-10-08T19:39:33.719 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.719 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.720 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:39:33.720 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.078324+0000", 2021-10-08T19:39:33.720 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1710208529999999 2021-10-08T19:39:33.720 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.720 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.721 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:39:33.721 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.078409+0000", 2021-10-08T19:39:33.721 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4567000000000005e-05 2021-10-08T19:39:33.721 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.721 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.722 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:39:33.722 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.078487+0000", 2021-10-08T19:39:33.722 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7886999999999995e-05 2021-10-08T19:39:33.722 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.723 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.723 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:39:33.723 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.085283+0000", 2021-10-08T19:39:33.723 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0067957410000000001 2021-10-08T19:39:33.723 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.724 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.724 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:39:33.724 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.092027+0000", 2021-10-08T19:39:33.724 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0067447239999999997 2021-10-08T19:39:33.724 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.725 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.725 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:39:33.725 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.092062+0000", 2021-10-08T19:39:33.725 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4635000000000003e-05 2021-10-08T19:39:33.725 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.726 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.726 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:39:33.726 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.092118+0000", 2021-10-08T19:39:33.726 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6450000000000003e-05 2021-10-08T19:39:33.727 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.727 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.727 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:39:33.727 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.092228+0000", 2021-10-08T19:39:33.727 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000109441 2021-10-08T19:39:33.728 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:33.728 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:33.728 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:33.728 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.728 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.729 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:102500 8.b 8:daf9ef34:::benchmark_data_smithi097_144160_object13760:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e246)", 2021-10-08T19:39:33.729 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:57.928825+0000", 2021-10-08T19:39:33.729 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 575.58350294599995, 2021-10-08T19:39:33.729 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.163637928, 2021-10-08T19:39:33.729 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:39:33.730 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:39:33.730 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:39:33.730 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:39:33.730 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:39:33.731 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 102500 2021-10-08T19:39:33.731 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.731 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:39:33.731 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.731 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:39:33.732 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.928825+0000", 2021-10-08T19:39:33.732 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:39:33.732 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.732 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.732 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:39:33.733 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.928825+0000", 2021-10-08T19:39:33.733 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:39:33.733 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.733 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.733 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:39:33.734 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.928823+0000", 2021-10-08T19:39:33.734 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:39:33.734 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.734 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.735 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:39:33.735 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.928829+0000", 2021-10-08T19:39:33.735 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2469999999999997e-06 2021-10-08T19:39:33.735 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.735 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.736 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:39:33.736 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.928841+0000", 2021-10-08T19:39:33.736 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1908e-05 2021-10-08T19:39:33.736 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.736 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.737 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:39:33.737 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.928848+0000", 2021-10-08T19:39:33.737 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.17e-06 2021-10-08T19:39:33.737 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.737 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.738 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:39:33.738 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.928904+0000", 2021-10-08T19:39:33.738 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5634000000000003e-05 2021-10-08T19:39:33.738 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.738 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.739 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:39:33.739 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.928913+0000", 2021-10-08T19:39:33.739 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.7550000000000006e-06 2021-10-08T19:39:33.739 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.740 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.740 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:39:33.740 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.079508+0000", 2021-10-08T19:39:33.740 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1505944669999999 2021-10-08T19:39:33.740 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.741 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.741 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:39:33.741 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.079635+0000", 2021-10-08T19:39:33.741 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012720599999999999 2021-10-08T19:39:33.741 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.742 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.742 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:39:33.742 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.079789+0000", 2021-10-08T19:39:33.742 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000154136 2021-10-08T19:39:33.743 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.743 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.743 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:39:33.743 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.085287+0000", 2021-10-08T19:39:33.743 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0054975060000000001 2021-10-08T19:39:33.744 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.744 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.744 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:39:33.744 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.092269+0000", 2021-10-08T19:39:33.744 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0069826239999999998 2021-10-08T19:39:33.745 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.745 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.745 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:39:33.745 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.092304+0000", 2021-10-08T19:39:33.745 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4981999999999998e-05 2021-10-08T19:39:33.746 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.746 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.746 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:39:33.746 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.092351+0000", 2021-10-08T19:39:33.747 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7095000000000002e-05 2021-10-08T19:39:33.747 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.747 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.747 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:39:33.747 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.092463+0000", 2021-10-08T19:39:33.748 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011102799999999999 2021-10-08T19:39:33.748 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:33.748 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:33.748 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:33.748 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.749 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.749 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:102519 8.b 8:d179cc81:::benchmark_data_smithi097_144160_object13779:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e246)", 2021-10-08T19:39:33.749 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:57.947553+0000", 2021-10-08T19:39:33.749 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 575.56477458999996, 2021-10-08T19:39:33.750 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1451397700000001, 2021-10-08T19:39:33.750 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:39:33.750 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:39:33.750 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:39:33.750 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:39:33.751 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:39:33.751 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 102519 2021-10-08T19:39:33.751 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.751 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:39:33.751 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.752 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:39:33.752 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.947553+0000", 2021-10-08T19:39:33.752 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:39:33.752 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.752 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.753 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:39:33.753 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.947553+0000", 2021-10-08T19:39:33.753 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:39:33.753 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.753 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.754 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:39:33.754 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.947550+0000", 2021-10-08T19:39:33.754 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2021-10-08T19:39:33.754 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.755 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.755 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:39:33.755 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.947560+0000", 2021-10-08T19:39:33.755 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.662e-06 2021-10-08T19:39:33.755 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.756 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.756 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:39:33.756 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.947576+0000", 2021-10-08T19:39:33.756 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6583999999999999e-05 2021-10-08T19:39:33.756 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.757 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.757 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:39:33.757 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.947583+0000", 2021-10-08T19:39:33.757 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9469999999999997e-06 2021-10-08T19:39:33.757 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.758 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.758 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:39:33.758 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.947647+0000", 2021-10-08T19:39:33.758 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3819999999999995e-05 2021-10-08T19:39:33.758 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.759 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.759 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:39:33.759 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.947657+0000", 2021-10-08T19:39:33.759 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.9520000000000006e-06 2021-10-08T19:39:33.760 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.760 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.760 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:39:33.760 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.081284+0000", 2021-10-08T19:39:33.760 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1336265889999999 2021-10-08T19:39:33.761 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.761 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.761 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:39:33.761 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.081360+0000", 2021-10-08T19:39:33.761 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6329999999999996e-05 2021-10-08T19:39:33.762 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.762 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.762 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:39:33.762 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.081446+0000", 2021-10-08T19:39:33.762 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5445999999999995e-05 2021-10-08T19:39:33.763 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.763 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.763 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:39:33.763 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.089270+0000", 2021-10-08T19:39:33.763 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0078239350000000006 2021-10-08T19:39:33.764 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.764 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.764 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:39:33.764 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.092502+0000", 2021-10-08T19:39:33.765 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032323769999999998 2021-10-08T19:39:33.765 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.765 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.765 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:39:33.765 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.092538+0000", 2021-10-08T19:39:33.766 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6174000000000003e-05 2021-10-08T19:39:33.766 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.766 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.766 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:39:33.766 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.092584+0000", 2021-10-08T19:39:33.767 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5661999999999998e-05 2021-10-08T19:39:33.767 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.767 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.767 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:39:33.767 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.092693+0000", 2021-10-08T19:39:33.768 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010898799999999999 2021-10-08T19:39:33.768 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:33.768 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:33.768 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:33.768 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.769 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.769 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:102556 8.b 8:db9c81ba:::benchmark_data_smithi097_144160_object13816:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e246)", 2021-10-08T19:39:33.769 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:57.990196+0000", 2021-10-08T19:39:33.769 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 575.52213112599998, 2021-10-08T19:39:33.770 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1027266650000001, 2021-10-08T19:39:33.770 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:39:33.770 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:39:33.770 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:39:33.770 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:39:33.771 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:39:33.771 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 102556 2021-10-08T19:39:33.771 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.771 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:39:33.771 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.772 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:39:33.772 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.990196+0000", 2021-10-08T19:39:33.772 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:39:33.772 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.773 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.773 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:39:33.773 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.990196+0000", 2021-10-08T19:39:33.773 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:39:33.773 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.774 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.774 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:39:33.774 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.990195+0000", 2021-10-08T19:39:33.774 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:39:33.774 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.775 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.775 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:39:33.775 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.990201+0000", 2021-10-08T19:39:33.775 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8939999999999998e-06 2021-10-08T19:39:33.776 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.776 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.776 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:39:33.776 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.990212+0000", 2021-10-08T19:39:33.776 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1318000000000001e-05 2021-10-08T19:39:33.777 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.777 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.777 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:39:33.777 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.990217+0000", 2021-10-08T19:39:33.777 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9590000000000003e-06 2021-10-08T19:39:33.778 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.778 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.778 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:39:33.778 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.990271+0000", 2021-10-08T19:39:33.779 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4546999999999998e-05 2021-10-08T19:39:33.779 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.779 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.779 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:39:33.779 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.990282+0000", 2021-10-08T19:39:33.780 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0720000000000001e-05 2021-10-08T19:39:33.780 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.780 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.780 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:39:33.781 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.082457+0000", 2021-10-08T19:39:33.781 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0921749110000001 2021-10-08T19:39:33.781 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.781 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.781 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:39:33.782 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.082574+0000", 2021-10-08T19:39:33.782 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000116808 2021-10-08T19:39:33.782 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.782 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.782 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:39:33.783 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.082708+0000", 2021-10-08T19:39:33.783 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000134614 2021-10-08T19:39:33.783 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.783 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.784 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:39:33.784 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.089281+0000", 2021-10-08T19:39:33.784 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0065724579999999998 2021-10-08T19:39:33.784 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.784 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.785 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:39:33.785 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.092733+0000", 2021-10-08T19:39:33.785 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0034523129999999998 2021-10-08T19:39:33.785 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.785 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.786 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:39:33.786 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.092771+0000", 2021-10-08T19:39:33.786 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7381e-05 2021-10-08T19:39:33.786 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.786 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.787 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:39:33.787 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.092816+0000", 2021-10-08T19:39:33.787 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5867e-05 2021-10-08T19:39:33.787 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.788 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.788 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:39:33.788 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.092923+0000", 2021-10-08T19:39:33.788 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0001066 2021-10-08T19:39:33.788 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:33.789 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:33.789 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:33.789 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.789 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.789 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:102559 8.b 8:d2754e32:::benchmark_data_smithi097_144160_object13819:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e246)", 2021-10-08T19:39:33.790 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:57.992106+0000", 2021-10-08T19:39:33.790 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 575.52022162000003, 2021-10-08T19:39:33.790 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1010586449999999, 2021-10-08T19:39:33.790 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:39:33.790 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:39:33.791 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:39:33.791 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:39:33.791 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:39:33.791 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 102559 2021-10-08T19:39:33.791 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.792 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:39:33.792 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.792 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:39:33.792 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.992106+0000", 2021-10-08T19:39:33.793 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:39:33.793 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.793 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.793 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:39:33.793 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.992106+0000", 2021-10-08T19:39:33.794 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:39:33.794 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.794 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.794 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:39:33.794 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.992104+0000", 2021-10-08T19:39:33.795 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2021-10-08T19:39:33.795 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.795 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.795 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:39:33.796 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.992111+0000", 2021-10-08T19:39:33.796 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.528e-06 2021-10-08T19:39:33.796 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.796 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.796 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:39:33.797 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.992123+0000", 2021-10-08T19:39:33.797 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2384e-05 2021-10-08T19:39:33.797 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.797 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.797 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:39:33.798 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.992130+0000", 2021-10-08T19:39:33.798 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3280000000000002e-06 2021-10-08T19:39:33.798 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.798 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.799 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:39:33.799 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.992182+0000", 2021-10-08T19:39:33.799 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2157000000000002e-05 2021-10-08T19:39:33.799 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.799 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.800 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:39:33.800 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:57.992191+0000", 2021-10-08T19:39:33.800 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.6209999999999999e-06 2021-10-08T19:39:33.800 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.800 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.801 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:39:33.801 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.084213+0000", 2021-10-08T19:39:33.801 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.092022096 2021-10-08T19:39:33.801 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.801 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.802 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:39:33.802 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.084284+0000", 2021-10-08T19:39:33.802 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1037000000000004e-05 2021-10-08T19:39:33.802 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.802 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.803 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:39:33.803 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.084357+0000", 2021-10-08T19:39:33.803 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2349999999999997e-05 2021-10-08T19:39:33.803 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.804 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.804 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:39:33.804 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.089408+0000", 2021-10-08T19:39:33.804 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0050516809999999997 2021-10-08T19:39:33.804 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.805 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.805 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:39:33.805 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.092964+0000", 2021-10-08T19:39:33.805 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0035552100000000001 2021-10-08T19:39:33.805 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.806 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.806 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:39:33.806 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.092999+0000", 2021-10-08T19:39:33.806 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5065999999999999e-05 2021-10-08T19:39:33.806 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.807 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.807 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:39:33.807 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.093046+0000", 2021-10-08T19:39:33.807 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7052999999999998e-05 2021-10-08T19:39:33.808 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.808 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.808 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:39:33.808 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.093165+0000", 2021-10-08T19:39:33.808 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011874 2021-10-08T19:39:33.809 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:33.809 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:33.809 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:33.809 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.809 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.810 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:102574 8.b 8:db3e2131:::benchmark_data_smithi097_144160_object13834:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e246)", 2021-10-08T19:39:33.810 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:58.017553+0000", 2021-10-08T19:39:33.810 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 575.49477492999995, 2021-10-08T19:39:33.810 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0758380169999999, 2021-10-08T19:39:33.810 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:39:33.811 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:39:33.811 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:39:33.811 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:39:33.811 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:39:33.811 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 102574 2021-10-08T19:39:33.812 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.812 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:39:33.812 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.812 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:39:33.812 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:58.017553+0000", 2021-10-08T19:39:33.813 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:39:33.813 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.813 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.813 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:39:33.813 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:58.017553+0000", 2021-10-08T19:39:33.814 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:39:33.814 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.814 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.814 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:39:33.815 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:58.017551+0000", 2021-10-08T19:39:33.815 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:39:33.815 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.815 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.815 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:39:33.816 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:58.017557+0000", 2021-10-08T19:39:33.816 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7839999999999998e-06 2021-10-08T19:39:33.816 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.816 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.816 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:39:33.817 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:58.017569+0000", 2021-10-08T19:39:33.817 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1382999999999999e-05 2021-10-08T19:39:33.817 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.817 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.817 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:39:33.818 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:58.017574+0000", 2021-10-08T19:39:33.818 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2889999999999997e-06 2021-10-08T19:39:33.818 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.818 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.818 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:39:33.819 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:58.017618+0000", 2021-10-08T19:39:33.819 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3401e-05 2021-10-08T19:39:33.819 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.819 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.820 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:39:33.820 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:58.017624+0000", 2021-10-08T19:39:33.820 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1310000000000003e-06 2021-10-08T19:39:33.820 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.820 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.821 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:39:33.821 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.085313+0000", 2021-10-08T19:39:33.821 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0676896259999999 2021-10-08T19:39:33.821 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.821 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.822 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:39:33.822 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.085443+0000", 2021-10-08T19:39:33.822 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013005300000000001 2021-10-08T19:39:33.822 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.822 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.823 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:39:33.823 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.085587+0000", 2021-10-08T19:39:33.823 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014407499999999999 2021-10-08T19:39:33.823 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.823 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.824 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:39:33.824 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.089418+0000", 2021-10-08T19:39:33.824 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038308050000000001 2021-10-08T19:39:33.824 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.825 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.825 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:39:33.825 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.093205+0000", 2021-10-08T19:39:33.825 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0037872510000000002 2021-10-08T19:39:33.825 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.826 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.826 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:39:33.826 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.093240+0000", 2021-10-08T19:39:33.826 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5015000000000003e-05 2021-10-08T19:39:33.826 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.827 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.827 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:39:33.827 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.093286+0000", 2021-10-08T19:39:33.827 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5104e-05 2021-10-08T19:39:33.828 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.828 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.828 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:39:33.828 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.093391+0000", 2021-10-08T19:39:33.828 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000105028 2021-10-08T19:39:33.829 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:33.829 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:33.829 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:33.829 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.829 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.830 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:102602 8.b 8:dacd0c67:::benchmark_data_smithi097_144160_object13862:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e246)", 2021-10-08T19:39:33.830 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:29:58.097142+0000", 2021-10-08T19:39:33.830 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 575.41518587999997, 2021-10-08T19:39:33.830 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.99654567599999999, 2021-10-08T19:39:33.830 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:39:33.831 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:39:33.831 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:39:33.831 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:39:33.831 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:39:33.831 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 102602 2021-10-08T19:39:33.832 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.832 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:39:33.832 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.832 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:39:33.832 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:58.097142+0000", 2021-10-08T19:39:33.833 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:39:33.833 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.833 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.833 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:39:33.834 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:58.097142+0000", 2021-10-08T19:39:33.834 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:39:33.834 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.834 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.834 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:39:33.835 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:58.097140+0000", 2021-10-08T19:39:33.835 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:39:33.835 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.835 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.835 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:39:33.836 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:58.097146+0000", 2021-10-08T19:39:33.836 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6150000000000002e-06 2021-10-08T19:39:33.836 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.836 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.836 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:39:33.837 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:58.097157+0000", 2021-10-08T19:39:33.837 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0821e-05 2021-10-08T19:39:33.837 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.837 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.837 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:39:33.838 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:58.097162+0000", 2021-10-08T19:39:33.838 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3900000000000001e-06 2021-10-08T19:39:33.838 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.838 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.839 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:39:33.839 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:58.097205+0000", 2021-10-08T19:39:33.839 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2239e-05 2021-10-08T19:39:33.839 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.839 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.840 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:39:33.840 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:58.097211+0000", 2021-10-08T19:39:33.840 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9499999999999998e-06 2021-10-08T19:39:33.840 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.840 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.841 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:39:33.841 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.087044+0000", 2021-10-08T19:39:33.841 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.98983380499999996 2021-10-08T19:39:33.841 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.841 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.842 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:39:33.842 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.087126+0000", 2021-10-08T19:39:33.842 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1479999999999999e-05 2021-10-08T19:39:33.842 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.842 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.843 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:39:33.843 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.087300+0000", 2021-10-08T19:39:33.843 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000174303 2021-10-08T19:39:33.843 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.843 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.844 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:39:33.844 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.089956+0000", 2021-10-08T19:39:33.844 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002655831 2021-10-08T19:39:33.844 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.845 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.845 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:39:33.845 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.093431+0000", 2021-10-08T19:39:33.845 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0034749030000000001 2021-10-08T19:39:33.845 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.846 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.846 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:39:33.846 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.093536+0000", 2021-10-08T19:39:33.846 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010552099999999999 2021-10-08T19:39:33.847 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.847 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.847 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:39:33.847 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.093585+0000", 2021-10-08T19:39:33.848 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8813000000000002e-05 2021-10-08T19:39:33.848 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.848 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.848 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:39:33.849 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:29:59.093687+0000", 2021-10-08T19:39:33.849 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000102042 2021-10-08T19:39:33.849 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:33.849 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:33.849 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:33.850 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.850 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.850 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:137845 8.b 8:d9013f90:::benchmark_data_smithi097_144160_object49105:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e256)", 2021-10-08T19:39:33.850 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:30:31.700795+0000", 2021-10-08T19:39:33.851 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 541.81153203999997, 2021-10-08T19:39:33.851 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.199398951, 2021-10-08T19:39:33.851 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:39:33.851 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:39:33.851 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:39:33.852 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:39:33.852 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:39:33.852 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 137845 2021-10-08T19:39:33.852 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.853 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:39:33.853 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.853 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:39:33.853 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.700795+0000", 2021-10-08T19:39:33.853 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:39:33.854 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.854 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.854 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:39:33.854 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.700795+0000", 2021-10-08T19:39:33.855 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:39:33.855 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.855 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.855 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:39:33.855 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.700795+0000", 2021-10-08T19:39:33.856 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:39:33.856 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.856 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.856 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:39:33.856 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.700798+0000", 2021-10-08T19:39:33.857 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8550000000000002e-06 2021-10-08T19:39:33.857 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.857 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.857 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:39:33.858 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.700802+0000", 2021-10-08T19:39:33.858 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6029999999999998e-06 2021-10-08T19:39:33.858 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.858 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.858 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:39:33.859 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.700806+0000", 2021-10-08T19:39:33.859 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.473e-06 2021-10-08T19:39:33.859 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.859 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.859 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:39:33.860 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.700840+0000", 2021-10-08T19:39:33.860 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3855e-05 2021-10-08T19:39:33.860 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.860 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.860 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:39:33.861 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.700847+0000", 2021-10-08T19:39:33.861 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7190000000000001e-06 2021-10-08T19:39:33.861 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.861 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.861 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:39:33.862 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:32.679303+0000", 2021-10-08T19:39:33.862 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.97845542299999999 2021-10-08T19:39:33.862 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.862 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.863 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:39:33.863 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:32.679313+0000", 2021-10-08T19:39:33.864 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0040999999999999e-05 2021-10-08T19:39:33.864 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.864 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.864 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:39:33.865 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.850376+0000", 2021-10-08T19:39:33.865 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1710636700000001 2021-10-08T19:39:33.865 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.865 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.865 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:39:33.866 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.850541+0000", 2021-10-08T19:39:33.866 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016506600000000001 2021-10-08T19:39:33.866 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.866 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.867 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,2,4", 2021-10-08T19:39:33.867 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.850978+0000", 2021-10-08T19:39:33.867 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00043636400000000001 2021-10-08T19:39:33.867 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.867 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.868 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:39:33.868 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.858001+0000", 2021-10-08T19:39:33.868 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0070231 2021-10-08T19:39:33.868 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.868 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.869 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:39:33.869 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.858148+0000", 2021-10-08T19:39:33.869 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014706499999999999 2021-10-08T19:39:33.869 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.869 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.870 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:39:33.870 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.862354+0000", 2021-10-08T19:39:33.870 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.004206319 2021-10-08T19:39:33.870 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.871 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.871 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:39:33.871 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.897983+0000", 2021-10-08T19:39:33.871 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.035628430000000003 2021-10-08T19:39:33.872 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.872 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.872 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:39:33.872 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.898043+0000", 2021-10-08T19:39:33.872 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0485000000000001e-05 2021-10-08T19:39:33.873 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.873 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.873 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:39:33.873 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.900194+0000", 2021-10-08T19:39:33.873 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021512329999999998 2021-10-08T19:39:33.874 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:33.874 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:33.874 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:33.874 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.875 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.875 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15147.0:137877 8.b 8:d0f459fb:::benchmark_data_smithi097_144160_object49137:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e256)", 2021-10-08T19:39:33.875 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:30:31.731950+0000", 2021-10-08T19:39:33.875 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 541.78037730999995, 2021-10-08T19:39:33.875 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1684614529999999, 2021-10-08T19:39:33.876 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:39:33.876 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:39:33.876 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:39:33.876 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15147", 2021-10-08T19:39:33.876 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:39:33.877 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 137877 2021-10-08T19:39:33.877 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.877 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:39:33.877 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.877 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:39:33.878 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.731950+0000", 2021-10-08T19:39:33.878 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:39:33.878 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.878 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.878 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:39:33.879 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.731950+0000", 2021-10-08T19:39:33.879 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:39:33.879 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.879 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.880 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:39:33.880 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.731948+0000", 2021-10-08T19:39:33.880 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:39:33.881 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.881 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.881 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:39:33.881 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.731954+0000", 2021-10-08T19:39:33.882 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.037e-06 2021-10-08T19:39:33.882 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.882 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.882 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:39:33.882 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.731963+0000", 2021-10-08T19:39:33.883 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.602e-06 2021-10-08T19:39:33.883 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.883 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.883 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:39:33.883 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.731968+0000", 2021-10-08T19:39:33.884 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6890000000000003e-06 2021-10-08T19:39:33.884 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.884 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.884 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:39:33.885 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.732005+0000", 2021-10-08T19:39:33.885 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7527999999999997e-05 2021-10-08T19:39:33.885 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.885 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.885 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:39:33.886 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:31.732011+0000", 2021-10-08T19:39:33.886 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9449999999999998e-06 2021-10-08T19:39:33.886 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.886 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.886 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:39:33.887 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:32.680646+0000", 2021-10-08T19:39:33.887 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.94863507499999999 2021-10-08T19:39:33.887 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.887 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.887 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2021-10-08T19:39:33.888 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:32.680654+0000", 2021-10-08T19:39:33.888 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8120000000000008e-06 2021-10-08T19:39:33.889 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.889 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.889 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:39:33.890 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:39:33.891 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.855389+0000", 2021-10-08T19:39:33.891 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1747352 2021-10-08T19:39:33.892 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.892 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.892 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:39:33.892 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.855513+0000", 2021-10-08T19:39:33.893 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012417799999999999 2021-10-08T19:39:33.893 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.893 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.893 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,2,4", 2021-10-08T19:39:33.893 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.855651+0000", 2021-10-08T19:39:33.894 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000137317 2021-10-08T19:39:33.894 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.894 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.894 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:39:33.894 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.860016+0000", 2021-10-08T19:39:33.895 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0043655860000000003 2021-10-08T19:39:33.895 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.895 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.895 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:39:33.896 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.862362+0000", 2021-10-08T19:39:33.896 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0023462370000000001 2021-10-08T19:39:33.896 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.896 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.896 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:39:33.897 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.876380+0000", 2021-10-08T19:39:33.897 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.014017514 2021-10-08T19:39:33.897 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.897 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.897 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:39:33.898 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.900242+0000", 2021-10-08T19:39:33.898 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.023861835000000001 2021-10-08T19:39:33.898 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.898 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.899 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:39:33.899 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.900298+0000", 2021-10-08T19:39:33.899 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6548999999999997e-05 2021-10-08T19:39:33.899 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.899 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.900 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:39:33.900 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:30:33.900412+0000", 2021-10-08T19:39:33.900 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000113278 2021-10-08T19:39:33.900 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:33.900 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:33.901 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:33.901 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.901 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.901 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.26125.0:41073 11.b 11:d38113c4:::benchmark_data_smithi097_295476_object41072:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e446)", 2021-10-08T19:39:33.902 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:39:31.129508+0000", 2021-10-08T19:39:33.902 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 2.3828194059999999, 2021-10-08T19:39:33.902 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.16408800700000001, 2021-10-08T19:39:33.902 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:39:33.902 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:39:33.903 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:39:33.903 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.26125", 2021-10-08T19:39:33.903 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:39:33.903 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 41073 2021-10-08T19:39:33.903 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.904 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:39:33.904 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.904 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:39:33.904 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.129508+0000", 2021-10-08T19:39:33.904 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:39:33.905 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.905 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.905 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:39:33.905 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.129508+0000", 2021-10-08T19:39:33.906 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:39:33.906 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.906 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.906 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:39:33.906 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.129506+0000", 2021-10-08T19:39:33.907 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:39:33.907 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.907 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.907 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:39:33.907 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.129544+0000", 2021-10-08T19:39:33.908 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7985000000000003e-05 2021-10-08T19:39:33.908 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.908 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.908 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:39:33.909 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.129556+0000", 2021-10-08T19:39:33.909 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2023e-05 2021-10-08T19:39:33.909 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.909 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.909 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:39:33.910 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.129563+0000", 2021-10-08T19:39:33.910 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0230000000000004e-06 2021-10-08T19:39:33.910 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.910 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.910 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:39:33.911 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.129642+0000", 2021-10-08T19:39:33.911 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8684999999999996e-05 2021-10-08T19:39:33.911 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.911 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.911 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:39:33.912 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.129783+0000", 2021-10-08T19:39:33.912 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000140519 2021-10-08T19:39:33.912 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.912 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.912 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,1", 2021-10-08T19:39:33.913 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.129914+0000", 2021-10-08T19:39:33.913 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013139 2021-10-08T19:39:33.913 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.913 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.914 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:39:33.914 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.132944+0000", 2021-10-08T19:39:33.914 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030303249999999999 2021-10-08T19:39:33.914 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.914 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.915 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:39:33.915 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.135598+0000", 2021-10-08T19:39:33.915 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026541870000000001 2021-10-08T19:39:33.915 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.915 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.916 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:39:33.916 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.293498+0000", 2021-10-08T19:39:33.916 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.15789928 2021-10-08T19:39:33.916 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.917 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.917 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:39:33.917 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.293553+0000", 2021-10-08T19:39:33.917 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5587999999999997e-05 2021-10-08T19:39:33.917 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.918 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.918 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:39:33.918 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.293596+0000", 2021-10-08T19:39:33.918 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2818000000000002e-05 2021-10-08T19:39:33.918 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:33.919 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:33.919 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:33.919 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.919 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.920 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.26125.0:41077 11.b 11:d44ccd16:::benchmark_data_smithi097_295476_object41076:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e446)", 2021-10-08T19:39:33.920 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:39:31.129622+0000", 2021-10-08T19:39:33.920 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 2.3827059739999998, 2021-10-08T19:39:33.920 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.16574817999999999, 2021-10-08T19:39:33.920 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:39:33.921 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:39:33.921 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:39:33.921 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.26125", 2021-10-08T19:39:33.921 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:39:33.921 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 41077 2021-10-08T19:39:33.922 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.922 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:39:33.922 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.922 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:39:33.923 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.129622+0000", 2021-10-08T19:39:33.923 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:39:33.923 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.923 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.923 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:39:33.924 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.129622+0000", 2021-10-08T19:39:33.924 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:39:33.924 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.924 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.925 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:39:33.925 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.129621+0000", 2021-10-08T19:39:33.925 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2021-10-08T19:39:33.925 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.926 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.926 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:39:33.926 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.129644+0000", 2021-10-08T19:39:33.926 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2637999999999999e-05 2021-10-08T19:39:33.926 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.927 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.927 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:39:33.927 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.129649+0000", 2021-10-08T19:39:33.927 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.823e-06 2021-10-08T19:39:33.927 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.928 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.928 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:39:33.928 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.129653+0000", 2021-10-08T19:39:33.928 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1500000000000001e-06 2021-10-08T19:39:33.928 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.929 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.929 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:39:33.929 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.131262+0000", 2021-10-08T19:39:33.929 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0016089769999999999 2021-10-08T19:39:33.929 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.930 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.930 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:39:33.930 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.131355+0000", 2021-10-08T19:39:33.930 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2954000000000005e-05 2021-10-08T19:39:33.931 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.931 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.931 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,1", 2021-10-08T19:39:33.931 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.131488+0000", 2021-10-08T19:39:33.931 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013260799999999999 2021-10-08T19:39:33.932 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.932 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.932 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:39:33.932 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.133502+0000", 2021-10-08T19:39:33.933 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0020135349999999999 2021-10-08T19:39:33.933 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.933 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.933 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:39:33.933 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.135628+0000", 2021-10-08T19:39:33.934 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021261819999999999 2021-10-08T19:39:33.934 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.934 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.934 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:39:33.935 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.295283+0000", 2021-10-08T19:39:33.935 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.159654975 2021-10-08T19:39:33.935 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.935 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.935 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:39:33.936 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.295333+0000", 2021-10-08T19:39:33.936 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0540000000000001e-05 2021-10-08T19:39:33.936 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:39:33.936 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:39:33.936 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:39:33.937 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.295370+0000", 2021-10-08T19:39:33.937 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6458999999999998e-05 2021-10-08T19:39:33.937 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:33.937 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:33.937 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:33.938 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:39:33.938 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:39:33.938 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:39:33.938 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 24 16 44161 44145 114.915 71.6875 0.00526798 0.00869647 2021-10-08T19:39:33.940 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:34.021 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:39:34.026 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:34.027 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:39:34.088 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is set 2021-10-08T19:39:34.128 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:39:34.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:39:33 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:39:33] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:39:34.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:34 smithi117 ceph-mon[34585]: 4.15 scrub ok 2021-10-08T19:39:34.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:34 smithi117 ceph-mon[34585]: pgmap v911: 188 pgs: 188 active+clean; 2.3 GiB data, 9.4 GiB used, 706 GiB / 715 GiB avail; 852 B/s rd, 76 MiB/s wr, 1.21k op/s 2021-10-08T19:39:34.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:34 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2626688032' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:39:34.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:34 smithi117 ceph-mon[34585]: from='client.36197 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:39:34.176 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:34.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:34 smithi097 ceph-mon[32687]: 4.15 scrub ok 2021-10-08T19:39:34.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:34 smithi097 ceph-mon[32687]: pgmap v911: 188 pgs: 188 active+clean; 2.3 GiB data, 9.4 GiB used, 706 GiB / 715 GiB avail; 852 B/s rd, 76 MiB/s wr, 1.21k op/s 2021-10-08T19:39:34.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:34 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2626688032' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:39:34.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:34 smithi097 ceph-mon[32687]: from='client.36197 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:39:34.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:34 smithi097 ceph-mon[41966]: 4.15 scrub ok 2021-10-08T19:39:34.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:34 smithi097 ceph-mon[41966]: pgmap v911: 188 pgs: 188 active+clean; 2.3 GiB data, 9.4 GiB used, 706 GiB / 715 GiB avail; 852 B/s rd, 76 MiB/s wr, 1.21k op/s 2021-10-08T19:39:34.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:34 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2626688032' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:39:34.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:34 smithi097 ceph-mon[41966]: from='client.36197 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:39:34.675 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 25 16 45475 45459 113.604 82.125 0.00882254 0.00879771 2021-10-08T19:39:34.825 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2021-10-08T19:39:35.208 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2021-10-08T19:39:35.209 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:35 smithi097 ceph-mon[32687]: 4.1f deep-scrub ok 2021-10-08T19:39:35.209 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:35 smithi097 ceph-mon[32687]: 2.d scrub ok 2021-10-08T19:39:35.209 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:35 smithi097 ceph-mon[32687]: 6.18 scrub ok 2021-10-08T19:39:35.209 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:35 smithi097 ceph-mon[32687]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:39:35.209 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:35 smithi097 ceph-mon[32687]: from='client.36197 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:39:35.210 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:35 smithi097 ceph-mon[32687]: osdmap e447: 8 total, 8 up, 8 in 2021-10-08T19:39:35.211 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:35 smithi097 ceph-mon[41966]: 4.1f deep-scrub ok 2021-10-08T19:39:35.211 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:35 smithi097 ceph-mon[41966]: 2.d scrub ok 2021-10-08T19:39:35.211 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:35 smithi097 ceph-mon[41966]: 6.18 scrub ok 2021-10-08T19:39:35.211 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:35 smithi097 ceph-mon[41966]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:39:35.212 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:35 smithi097 ceph-mon[41966]: from='client.36197 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:39:35.212 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:35 smithi097 ceph-mon[41966]: osdmap e447: 8 total, 8 up, 8 in 2021-10-08T19:39:35.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:35 smithi117 ceph-mon[34585]: 4.1f deep-scrub ok 2021-10-08T19:39:35.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:35 smithi117 ceph-mon[34585]: 2.d scrub ok 2021-10-08T19:39:35.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:35 smithi117 ceph-mon[34585]: 6.18 scrub ok 2021-10-08T19:39:35.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:35 smithi117 ceph-mon[34585]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:39:35.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:35 smithi117 ceph-mon[34585]: from='client.36197 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:39:35.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:35 smithi117 ceph-mon[34585]: osdmap e447: 8 total, 8 up, 8 in 2021-10-08T19:39:35.610 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:39:35.674 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 26 16 46804 46788 112.429 83.0625 0.00934622 0.00887219 2021-10-08T19:39:36.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:36 smithi117 ceph-mon[34585]: pgmap v913: 188 pgs: 188 active+clean; 2.7 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 1.7 KiB/s rd, 111 MiB/s wr, 1.78k op/s 2021-10-08T19:39:36.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:36 smithi097 ceph-mon[41966]: pgmap v913: 188 pgs: 188 active+clean; 2.7 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 1.7 KiB/s rd, 111 MiB/s wr, 1.78k op/s 2021-10-08T19:39:36.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:36 smithi097 ceph-mon[32687]: pgmap v913: 188 pgs: 188 active+clean; 2.7 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 1.7 KiB/s rd, 111 MiB/s wr, 1.78k op/s 2021-10-08T19:39:36.674 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 27 16 48256 48240 111.626 90.75 0.0161526 0.00895425 2021-10-08T19:39:36.821 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:39:36.830 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:36.831 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:39:36.933 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:39:36.961 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:39:37.002 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:37.094 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:39:37.098 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:37.099 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:39:37.200 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:39:37.236 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:37.297 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:39:37.300 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:37.300 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:39:37.402 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:39:37.471 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:37.553 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:39:37.569 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:37.571 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:39:37.655 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:39:37 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:39:37.671 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:39:37.675 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 28 16 49392 49376 110.175 71 0.00593694 0.00906992 2021-10-08T19:39:37.740 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:38.110 INFO:teuthology.orchestra.run.smithi097.stderr:set 2.12 pg_upmap mapping to [5,4,2] 2021-10-08T19:39:38.159 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:39:38.162 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:38.163 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:39:38.264 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:39:38.292 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:38.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:38 smithi117 ceph-mon[34585]: pgmap v914: 188 pgs: 188 active+clean; 2.7 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 1.3 KiB/s rd, 77 MiB/s wr, 1.23k op/s 2021-10-08T19:39:38.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:38 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:39:38.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:38 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1940905175' entity='client.admin' cmd=[{"prefix": "osd pg-upmap", "pgid": "2.12", "id": [5, 4, 2]}]: dispatch 2021-10-08T19:39:38.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:38 smithi097 ceph-mon[41966]: pgmap v914: 188 pgs: 188 active+clean; 2.7 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 1.3 KiB/s rd, 77 MiB/s wr, 1.23k op/s 2021-10-08T19:39:38.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:38 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:39:38.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:38 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1940905175' entity='client.admin' cmd=[{"prefix": "osd pg-upmap", "pgid": "2.12", "id": [5, 4, 2]}]: dispatch 2021-10-08T19:39:38.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:38 smithi097 ceph-mon[32687]: pgmap v914: 188 pgs: 188 active+clean; 2.7 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 1.3 KiB/s rd, 77 MiB/s wr, 1.23k op/s 2021-10-08T19:39:38.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:38 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:39:38.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:38 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1940905175' entity='client.admin' cmd=[{"prefix": "osd pg-upmap", "pgid": "2.12", "id": [5, 4, 2]}]: dispatch 2021-10-08T19:39:38.674 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 29 16 50090 50074 107.881 43.625 0.00253503 0.00913355 2021-10-08T19:39:38.860 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set nodeep-scrub 2021-10-08T19:39:39.143 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:39:39.154 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:39.155 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:39:39.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:39 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1940905175' entity='client.admin' cmd='[{"prefix": "osd pg-upmap", "pgid": "2.12", "id": [5, 4, 2]}]': finished 2021-10-08T19:39:39.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:39 smithi097 ceph-mon[41966]: osdmap e448: 8 total, 8 up, 8 in 2021-10-08T19:39:39.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:39 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:39:39.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:39 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:39:39.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:39 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:39:39.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:39 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:39:39.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:39 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1940905175' entity='client.admin' cmd='[{"prefix": "osd pg-upmap", "pgid": "2.12", "id": [5, 4, 2]}]': finished 2021-10-08T19:39:39.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:39 smithi097 ceph-mon[32687]: osdmap e448: 8 total, 8 up, 8 in 2021-10-08T19:39:39.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:39 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:39:39.225 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:39 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:39:39.225 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:39 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:39:39.225 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:39 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:39:39.256 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:39:39.299 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:39.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:39 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1940905175' entity='client.admin' cmd='[{"prefix": "osd pg-upmap", "pgid": "2.12", "id": [5, 4, 2]}]': finished 2021-10-08T19:39:39.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:39 smithi117 ceph-mon[34585]: osdmap e448: 8 total, 8 up, 8 in 2021-10-08T19:39:39.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:39 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:39:39.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:39 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:39:39.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:39 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:39:39.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:39 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:39:39.445 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:39:39.449 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:39.450 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:39:39.551 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:39:39.602 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:39.675 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 30 16 51354 51338 106.918 79 0.00824555 0.00934846 2021-10-08T19:39:39.788 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:39:39.793 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:39.794 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:39:39.869 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:39:39.870 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2021-10-08T19:39:39.870 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:39:39.870 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.26125.0:51572 11.c e449/433 11:36e87c16:::benchmark_data_smithi097_295476_object51571:head v 449'3198, mlcod=449'3196)", 2021-10-08T19:39:39.870 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:39:39.864595+0000", 2021-10-08T19:39:39.871 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.0026802699999999998, 2021-10-08T19:39:39.871 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027006539999999998, 2021-10-08T19:39:39.871 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:39:39.871 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2021-10-08T19:39:39.871 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:39:39.872 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:39:39.872 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:39:39.872 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:39.864595+0000", 2021-10-08T19:39:39.873 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:39:39.874 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:39:39.875 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:39:39.875 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:39:39.876 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:39.864595+0000", 2021-10-08T19:39:39.876 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:39:39.877 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:39:39.877 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:39:39.877 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:39:39.878 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:39.864593+0000", 2021-10-08T19:39:39.878 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:39:39.879 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:39:39.879 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:39:39.880 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:39:39.880 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:39.864654+0000", 2021-10-08T19:39:39.881 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0421000000000003e-05 2021-10-08T19:39:39.881 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:39:39.881 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:39:39.882 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:39:39.882 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:39.864666+0000", 2021-10-08T19:39:39.883 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2459999999999999e-05 2021-10-08T19:39:39.883 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:39:39.883 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:39:39.884 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:39:39.884 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:39.864673+0000", 2021-10-08T19:39:39.885 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4230000000000002e-06 2021-10-08T19:39:39.885 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:39:39.886 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:39:39.886 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:39:39.886 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:39.864719+0000", 2021-10-08T19:39:39.887 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.6533000000000003e-05 2021-10-08T19:39:39.887 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:39:39.888 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:39:39.888 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:39:39.888 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:39.864743+0000", 2021-10-08T19:39:39.889 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4190999999999999e-05 2021-10-08T19:39:39.889 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:39:39.889 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:39:39.889 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:39:39.890 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:39:39.890 INFO:teuthology.orchestra.run.smithi117.stdout: ], 2021-10-08T19:39:39.890 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 1 2021-10-08T19:39:39.890 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:39:39.892 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:39:39.896 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:39:39.930 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:40.126 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:40 smithi097 ceph-mon[32687]: pgmap v916: 188 pgs: 1 peering, 187 active+clean; 2.9 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 639 B/s rd, 72 MiB/s wr, 1.15k op/s 2021-10-08T19:39:40.126 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:40 smithi097 ceph-mon[32687]: osdmap e449: 8 total, 8 up, 8 in 2021-10-08T19:39:40.127 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:40 smithi117 ceph-mon[34585]: pgmap v916: 188 pgs: 1 peering, 187 active+clean; 2.9 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 639 B/s rd, 72 MiB/s wr, 1.15k op/s 2021-10-08T19:39:40.127 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:40 smithi117 ceph-mon[34585]: osdmap e449: 8 total, 8 up, 8 in 2021-10-08T19:39:40.155 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:39:40.158 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:40.159 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:39:40.261 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:39:40.295 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:40.360 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:39:40.361 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:40.362 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:39:40.384 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:40 smithi097 ceph-mon[41966]: pgmap v916: 188 pgs: 1 peering, 187 active+clean; 2.9 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 639 B/s rd, 72 MiB/s wr, 1.15k op/s 2021-10-08T19:39:40.385 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:40 smithi097 ceph-mon[41966]: osdmap e449: 8 total, 8 up, 8 in 2021-10-08T19:39:40.464 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:39:40.490 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:40.539 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:39:40.541 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:40.542 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:39:40.577 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:39:40.620 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:39:40.643 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:39:40.655 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:39:40.670 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:40.675 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 31 16 52483 52467 105.745 70.5625 0.0250526 0.00945053 2021-10-08T19:39:40.700 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:39:40.741 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:39:40.777 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:39:40.810 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:39:40.849 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:39:40.864 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'false' 2021-10-08T19:39:40.864 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'false' 2021-10-08T19:39:40.864 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'false' 2021-10-08T19:39:40.865 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'false' 2021-10-08T19:39:40.865 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'false' 2021-10-08T19:39:40.865 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'false' 2021-10-08T19:39:40.865 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'false' 2021-10-08T19:39:40.866 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'false' 2021-10-08T19:39:40.955 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2021-10-08T19:39:40.957 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:39:40.958 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:40.959 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:39:41.060 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:39:41.113 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:41.138 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:41 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/364644495' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:39:41.139 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:41 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:39:41.139 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:41 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:39:41.235 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:39:41.243 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:41 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/364644495' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:39:41.243 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:41 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:39:41.243 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:41 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:39:41.244 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:41.245 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:39:41.347 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:39:41.396 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:41.584 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:41 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/364644495' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:39:41.584 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:41 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:39:41.585 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:41 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:39:41.585 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:39:41.586 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:41.586 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:39:41.587 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:39:41.675 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 32 16 53797 53781 105.007 82.125 0.00918775 0.0095182 2021-10-08T19:39:41.688 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:39:41.736 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:42.154 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:42 smithi097 ceph-mon[32687]: pgmap v918: 188 pgs: 1 peering, 187 active+clean; 3.1 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1.5 KiB/s rd, 79 MiB/s wr, 1.27k op/s 2021-10-08T19:39:42.155 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:42 smithi097 ceph-mon[32687]: osdmap e450: 8 total, 8 up, 8 in 2021-10-08T19:39:42.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:42 smithi117 ceph-mon[34585]: pgmap v918: 188 pgs: 1 peering, 187 active+clean; 3.1 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1.5 KiB/s rd, 79 MiB/s wr, 1.27k op/s 2021-10-08T19:39:42.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:42 smithi117 ceph-mon[34585]: osdmap e450: 8 total, 8 up, 8 in 2021-10-08T19:39:42.407 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:39:42 smithi117 conmon[69189]: level=error ts=2021-10-08T19:39:42.314Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=1 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:39:42.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:42 smithi097 ceph-mon[41966]: pgmap v918: 188 pgs: 1 peering, 187 active+clean; 3.1 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1.5 KiB/s rd, 79 MiB/s wr, 1.27k op/s 2021-10-08T19:39:42.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:42 smithi097 ceph-mon[41966]: osdmap e450: 8 total, 8 up, 8 in 2021-10-08T19:39:42.675 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 33 15 54886 54871 103.89 68.125 0.0188197 0.00961977 2021-10-08T19:39:42.714 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:39:42.720 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:42.721 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:39:42.822 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:39:42.906 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:39:42 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:39:42] "GET /metrics HTTP/1.1" 200 155932 "" "Prometheus/2.18.1" 2021-10-08T19:39:42.915 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:43.063 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:39:43.076 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:43.077 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:39:43.176 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:39:43.177 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:39:43.179 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:39:43.213 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:43.331 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:39:43.337 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:43.340 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:39:43.441 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:39:43.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:39:43.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:39:43.495 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:43.597 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:39:43.607 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:43.608 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:39:43.626 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:39:43.626 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:39:43.675 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 34 15 56042 56027 102.959 72.25 0.0167485 0.00970673 2021-10-08T19:39:43.709 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:39:43.749 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:43.874 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:39:43.876 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:43.877 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:39:43.905 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:39:43 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:39:43] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:39:43.947 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2021-10-08T19:39:43.948 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:39:43.980 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:39:44.024 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:44.101 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:39:44.107 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:44.108 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:39:44.210 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:39:44.213 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is set 2021-10-08T19:39:44.219 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:39:43 smithi097 conmon[33110]: 172.21.15.97 - - [08/Oct/2021:19:39:43] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:39:44.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:44 smithi097 ceph-mon[41966]: pgmap v920: 188 pgs: 1 peering, 187 active+clean; 3.1 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 852 B/s rd, 61 MiB/s wr, 969 op/s 2021-10-08T19:39:44.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:44 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/636168294' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:39:44.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:44 smithi097 ceph-mon[41966]: from='client.36206 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:39:44.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:44 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:39:44.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:44 smithi097 ceph-mon[32687]: pgmap v920: 188 pgs: 1 peering, 187 active+clean; 3.1 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 852 B/s rd, 61 MiB/s wr, 969 op/s 2021-10-08T19:39:44.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:44 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/636168294' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:39:44.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:44 smithi097 ceph-mon[32687]: from='client.36206 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:39:44.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:44 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:39:44.256 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:44.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:44 smithi117 ceph-mon[34585]: pgmap v920: 188 pgs: 1 peering, 187 active+clean; 3.1 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 852 B/s rd, 61 MiB/s wr, 969 op/s 2021-10-08T19:39:44.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:44 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/636168294' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:39:44.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:44 smithi117 ceph-mon[34585]: from='client.36206 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:39:44.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:44 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:39:44.495 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:39:44.500 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:44.501 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:39:44.590 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2021-10-08T19:39:44.602 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:39:44.638 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:44.675 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 35 16 57293 57277 102.25 78.125 0.00963639 0.00977426 2021-10-08T19:39:44.696 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:39:44.698 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:44.698 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:39:44.800 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:39:44.833 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:44.854 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 4, 5, 7, 6, 1, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2021-10-08T19:39:44.854 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2021-10-08T19:39:44.855 INFO:tasks.thrashosds.thrasher:Setting osd 1 primary_affinity to 0.997869 2021-10-08T19:39:44.855 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd primary-affinity 1 0.9978685516010997 2021-10-08T19:39:45.095 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:39:45.099 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:45.099 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:39:45.114 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2021-10-08T19:39:45.186 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:45 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:39:45.186 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:45 smithi097 ceph-mon[32687]: 172.21.15.97 - - [08/Oct/2021:19:39:43] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:39:45.187 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:45 smithi097 ceph-mon[32687]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:39:45.187 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:45 smithi097 ceph-mon[32687]: from='client.36206 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:39:45.187 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:45 smithi097 ceph-mon[32687]: osdmap e451: 8 total, 8 up, 8 in 2021-10-08T19:39:45.202 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:39:45.240 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:45.336 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:39:45.341 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:45.341 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:39:45.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:45 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:39:45.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:45 smithi117 ceph-mon[34585]: 172.21.15.97 - - [08/Oct/2021:19:39:43] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:39:45.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:45 smithi117 ceph-mon[34585]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:39:45.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:45 smithi117 ceph-mon[34585]: from='client.36206 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:39:45.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:45 smithi117 ceph-mon[34585]: osdmap e451: 8 total, 8 up, 8 in 2021-10-08T19:39:45.443 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:39:45.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:45 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:39:45.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:45 smithi097 ceph-mon[41966]: 172.21.15.97 - - [08/Oct/2021:19:39:43] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:39:45.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:45 smithi097 ceph-mon[41966]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:39:45.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:45 smithi097 ceph-mon[41966]: from='client.36206 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:39:45.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:45 smithi097 ceph-mon[41966]: osdmap e451: 8 total, 8 up, 8 in 2021-10-08T19:39:45.486 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:45.571 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:39:45.574 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:39:45.578 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:39:45.596 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:45.597 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:39:45.639 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:39:45.675 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 36 16 58459 58443 101.433 72.875 0.016209 0.00985334 2021-10-08T19:39:45.698 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:39:45.757 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:45.890 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:39:45.894 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:45.895 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:39:45.996 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:39:46.035 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:46.120 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:39:46.126 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:46.134 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:39:46.238 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:39:46.278 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:46.396 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:46 smithi097 ceph-mon[32687]: pgmap v922: 188 pgs: 188 active+clean; 3.4 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1.7 KiB/s rd, 96 MiB/s wr, 1.54k op/s 2021-10-08T19:39:46.399 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:46 smithi097 ceph-mon[41966]: pgmap v922: 188 pgs: 188 active+clean; 3.4 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1.7 KiB/s rd, 96 MiB/s wr, 1.54k op/s 2021-10-08T19:39:46.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:46 smithi117 ceph-mon[34585]: pgmap v922: 188 pgs: 188 active+clean; 3.4 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1.7 KiB/s rd, 96 MiB/s wr, 1.54k op/s 2021-10-08T19:39:46.566 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:39:46.569 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:46.570 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:39:46.672 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:39:46.679 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 37 16 59613 59597 100.637 72.125 0.0158697 0.00993192 2021-10-08T19:39:46.745 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:47.572 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset noscrub 2021-10-08T19:39:47.655 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:39:47 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:39:47.680 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 38 16 60911 60895 100.121 81.125 0.0157401 0.00998237 2021-10-08T19:39:47.712 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:39:47.717 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:47.718 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:39:47.819 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:39:47.866 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:48.080 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:39:48.088 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:48.089 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:39:48.096 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2021-10-08T19:39:48.096 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:39:48.191 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:39:48.227 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:48.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:48 smithi117 ceph-mon[34585]: pgmap v923: 188 pgs: 188 active+clean; 3.4 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1.3 KiB/s rd, 68 MiB/s wr, 1.08k op/s 2021-10-08T19:39:48.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:48 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:39:48.439 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:39:48.443 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:48.444 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:39:48.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:48 smithi097 ceph-mon[41966]: pgmap v923: 188 pgs: 188 active+clean; 3.4 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1.3 KiB/s rd, 68 MiB/s wr, 1.08k op/s 2021-10-08T19:39:48.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:48 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:39:48.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:48 smithi097 ceph-mon[32687]: pgmap v923: 188 pgs: 188 active+clean; 3.4 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1.3 KiB/s rd, 68 MiB/s wr, 1.08k op/s 2021-10-08T19:39:48.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:48 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:39:48.546 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:39:48.602 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:39:48.604 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:48.679 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 39 16 62066 62050 99.4047 72.1875 0.0107269 0.0100545 2021-10-08T19:39:48.746 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:39:48.747 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:48.749 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:39:48.850 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:39:48.882 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:49.191 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:39:49.192 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:39:49.193 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:49.194 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:39:49.196 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2021-10-08T19:39:49.235 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:39:49.287 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:39:49.295 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:39:49.320 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:39:49.351 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:49.358 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:39:49.391 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:39:49.441 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:39:49.442 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:39:49.471 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:49.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:49 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/300515421' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:39:49.474 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:39:49.474 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:49 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/300515421' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:39:49.501 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:39:49.514 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true' 2021-10-08T19:39:49.514 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true' 2021-10-08T19:39:49.515 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true' 2021-10-08T19:39:49.515 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true' 2021-10-08T19:39:49.515 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true' 2021-10-08T19:39:49.515 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true' 2021-10-08T19:39:49.515 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'true' 2021-10-08T19:39:49.516 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'true' 2021-10-08T19:39:49.575 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:39:49.609 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:49 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/300515421' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:39:49.652 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:49.682 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:2021-10-08T19:39:49.678367+0000 min lat: 0.00117486 max lat: 0.499237 avg lat: 0.0101519 2021-10-08T19:39:49.682 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2021-10-08T19:39:49.683 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 40 16 63034 63018 98.4321 60.5 0.00628692 0.0101519 2021-10-08T19:39:50.108 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:39:50.186 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:39:50.191 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:50.192 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:39:50.255 INFO:teuthology.orchestra.run.smithi097.stderr:set osd.1 primary-affinity to 0.997869 (8653962) 2021-10-08T19:39:50.293 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:39:50.334 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:50.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:50 smithi117 ceph-mon[34585]: pgmap v924: 188 pgs: 188 active+clean; 3.6 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 639 B/s rd, 67 MiB/s wr, 1.07k op/s 2021-10-08T19:39:50.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:50 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3603030997' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 1, "weight": 0.9978685516010997}]: dispatch 2021-10-08T19:39:50.679 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 41 16 64192 64176 97.795 72.375 0.0172101 0.0102198 2021-10-08T19:39:50.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:50 smithi097 ceph-mon[41966]: pgmap v924: 188 pgs: 188 active+clean; 3.6 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 639 B/s rd, 67 MiB/s wr, 1.07k op/s 2021-10-08T19:39:50.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:50 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3603030997' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 1, "weight": 0.9978685516010997}]: dispatch 2021-10-08T19:39:50.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:50 smithi097 ceph-mon[32687]: pgmap v924: 188 pgs: 188 active+clean; 3.6 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 639 B/s rd, 67 MiB/s wr, 1.07k op/s 2021-10-08T19:39:50.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:50 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3603030997' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 1, "weight": 0.9978685516010997}]: dispatch 2021-10-08T19:39:51.045 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:39:51.047 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:51.048 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:39:51.149 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:39:51.195 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:51.303 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:51 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3603030997' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 1, "weight": 0.9978685516010997}]': finished 2021-10-08T19:39:51.304 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:51 smithi117 ceph-mon[34585]: osdmap e452: 8 total, 8 up, 8 in 2021-10-08T19:39:51.304 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:51 smithi117 ceph-mon[34585]: osdmap e453: 8 total, 8 up, 8 in 2021-10-08T19:39:51.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:51 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3603030997' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 1, "weight": 0.9978685516010997}]': finished 2021-10-08T19:39:51.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:51 smithi097 ceph-mon[32687]: osdmap e452: 8 total, 8 up, 8 in 2021-10-08T19:39:51.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:51 smithi097 ceph-mon[32687]: osdmap e453: 8 total, 8 up, 8 in 2021-10-08T19:39:51.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:51 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3603030997' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 1, "weight": 0.9978685516010997}]': finished 2021-10-08T19:39:51.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:51 smithi097 ceph-mon[41966]: osdmap e452: 8 total, 8 up, 8 in 2021-10-08T19:39:51.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:51 smithi097 ceph-mon[41966]: osdmap e453: 8 total, 8 up, 8 in 2021-10-08T19:39:51.682 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 42 15 65302 65287 97.1198 69.4375 0.00793976 0.0102913 2021-10-08T19:39:52.185 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:39:52.194 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:52.195 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:39:52.297 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:39:52.352 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:52.425 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:52 smithi097 ceph-mon[41966]: pgmap v927: 188 pgs: 188 active+clean; 3.8 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1.5 KiB/s rd, 79 MiB/s wr, 1.27k op/s 2021-10-08T19:39:52.425 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:52 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:39:52.425 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:52 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:39:52.426 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:52 smithi097 ceph-mon[41966]: osdmap e454: 8 total, 8 up, 8 in 2021-10-08T19:39:52.426 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:52 smithi097 ceph-mon[32687]: pgmap v927: 188 pgs: 188 active+clean; 3.8 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1.5 KiB/s rd, 79 MiB/s wr, 1.27k op/s 2021-10-08T19:39:52.427 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:52 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:39:52.427 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:52 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:39:52.427 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:52 smithi097 ceph-mon[32687]: osdmap e454: 8 total, 8 up, 8 in 2021-10-08T19:39:52.499 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:39:52.504 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:52.505 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:39:52.606 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:39:52.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:52 smithi117 ceph-mon[34585]: pgmap v927: 188 pgs: 188 active+clean; 3.8 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1.5 KiB/s rd, 79 MiB/s wr, 1.27k op/s 2021-10-08T19:39:52.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:52 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:39:52.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:52 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:39:52.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:52 smithi117 ceph-mon[34585]: osdmap e454: 8 total, 8 up, 8 in 2021-10-08T19:39:52.667 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:52.679 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 43 16 66442 66426 96.5167 71.1875 0.0105075 0.010356 2021-10-08T19:39:52.771 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:39:52.774 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:52.775 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:39:52.776 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:39:52 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:39:52] "GET /metrics HTTP/1.1" 200 155932 "" "Prometheus/2.18.1" 2021-10-08T19:39:52.876 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:39:52.923 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:53.012 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:39:53.017 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:53.018 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:39:53.120 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:39:53.155 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:53.231 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:39:53.239 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:53.239 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:39:53.289 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is unset 2021-10-08T19:39:53.341 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:39:53.397 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:53.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:53 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1927960104' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:39:53.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:53 smithi097 ceph-mon[41966]: from='client.26179 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:39:53.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:53 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1927960104' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:39:53.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:53 smithi097 ceph-mon[32687]: from='client.26179 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:39:53.530 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:39:53.539 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:53.540 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:39:53.641 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:39:53.655 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:39:53 smithi117 conmon[69189]: level=error ts=2021-10-08T19:39:53.506Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=2 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:39:53.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:53 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1927960104' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:39:53.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:53 smithi117 ceph-mon[34585]: from='client.26179 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:39:53.675 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:53.680 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 44 16 67577 67561 95.9354 70.9375 0.0105316 0.0104182 2021-10-08T19:39:53.810 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:39:53.815 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:53.816 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:39:53.917 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:39:53.956 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:54.024 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:39:53 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:39:53] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:39:54.039 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:39:54.045 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:54.046 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:39:54.136 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2021-10-08T19:39:54.148 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:39:54.229 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:54.322 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:39:54.323 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2021-10-08T19:39:54.323 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:39:54.323 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.26125.0:68328 11.a e455/433 11:505a5e6a:::benchmark_data_smithi097_295476_object68327:head v 455'4309, mlcod=455'4307)", 2021-10-08T19:39:54.323 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:39:54.321000+0000", 2021-10-08T19:39:54.324 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.00086289699999999995, 2021-10-08T19:39:54.324 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00088526800000000004, 2021-10-08T19:39:54.324 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:39:54.324 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2021-10-08T19:39:54.325 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:39:54.325 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:39:54.325 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:39:54.325 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:54.321000+0000", 2021-10-08T19:39:54.326 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:39:54.326 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:39:54.326 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:39:54.326 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:39:54.326 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:54.321000+0000", 2021-10-08T19:39:54.327 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:39:54.327 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:39:54.327 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:39:54.327 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:39:54.328 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:54.320992+0000", 2021-10-08T19:39:54.328 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999919 2021-10-08T19:39:54.328 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:39:54.328 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:39:54.328 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:39:54.329 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:54.321057+0000", 2021-10-08T19:39:54.329 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4304e-05 2021-10-08T19:39:54.329 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:39:54.329 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:39:54.329 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:39:54.330 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:54.321072+0000", 2021-10-08T19:39:54.330 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5327000000000001e-05 2021-10-08T19:39:54.330 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:39:54.330 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:39:54.331 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:39:54.331 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:54.321077+0000", 2021-10-08T19:39:54.331 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.3619999999999997e-06 2021-10-08T19:39:54.331 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:39:54.332 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:39:54.332 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:39:54.333 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:54.321124+0000", 2021-10-08T19:39:54.333 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.6842999999999999e-05 2021-10-08T19:39:54.333 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:39:54.333 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:39:54.333 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:39:54.334 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:54.321148+0000", 2021-10-08T19:39:54.334 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4193e-05 2021-10-08T19:39:54.334 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:39:54.334 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:39:54.335 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:39:54.335 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:39:54.335 INFO:teuthology.orchestra.run.smithi117.stdout: ], 2021-10-08T19:39:54.335 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 1 2021-10-08T19:39:54.335 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:39:54.352 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:54 smithi117 ceph-mon[34585]: pgmap v929: 188 pgs: 188 active+clean; 3.8 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 852 B/s rd, 62 MiB/s wr, 995 op/s 2021-10-08T19:39:54.352 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:54 smithi117 ceph-mon[34585]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:39:54.352 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:54 smithi117 ceph-mon[34585]: from='client.26179 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:39:54.353 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:54 smithi117 ceph-mon[34585]: osdmap e455: 8 total, 8 up, 8 in 2021-10-08T19:39:54.353 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:54 smithi117 ceph-mon[34585]: 5.1b scrub ok 2021-10-08T19:39:54.353 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:54 smithi117 ceph-mon[34585]: 2.16 scrub ok 2021-10-08T19:39:54.493 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:39:54.499 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:54 smithi097 ceph-mon[32687]: pgmap v929: 188 pgs: 188 active+clean; 3.8 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 852 B/s rd, 62 MiB/s wr, 995 op/s 2021-10-08T19:39:54.500 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:54 smithi097 ceph-mon[32687]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:39:54.500 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:54 smithi097 ceph-mon[32687]: from='client.26179 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:39:54.500 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:54 smithi097 ceph-mon[32687]: osdmap e455: 8 total, 8 up, 8 in 2021-10-08T19:39:54.500 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:54 smithi097 ceph-mon[32687]: 5.1b scrub ok 2021-10-08T19:39:54.501 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:54 smithi097 ceph-mon[32687]: 2.16 scrub ok 2021-10-08T19:39:54.501 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:54 smithi097 ceph-mon[41966]: pgmap v929: 188 pgs: 188 active+clean; 3.8 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 852 B/s rd, 62 MiB/s wr, 995 op/s 2021-10-08T19:39:54.501 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:54 smithi097 ceph-mon[41966]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:39:54.502 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:54 smithi097 ceph-mon[41966]: from='client.26179 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:39:54.502 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:54 smithi097 ceph-mon[41966]: osdmap e455: 8 total, 8 up, 8 in 2021-10-08T19:39:54.502 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:54 smithi097 ceph-mon[41966]: 5.1b scrub ok 2021-10-08T19:39:54.502 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:54 smithi097 ceph-mon[41966]: 2.16 scrub ok 2021-10-08T19:39:54.503 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:54.503 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:39:54.605 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:39:54.651 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:39:54.675 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:54.679 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 45 16 68704 68688 95.3686 70.4375 0.00922963 0.0104797 2021-10-08T19:39:54.772 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:39:54.776 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:54.776 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:39:54.877 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:39:54.919 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:55.227 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:39:55.230 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:55.231 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:39:55.333 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:39:55.371 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:55.394 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2021-10-08T19:39:55.446 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:55 smithi097 ceph-mon[32687]: 3.1 scrub ok 2021-10-08T19:39:55.446 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:55 smithi097 ceph-mon[32687]: 3.5 scrub ok 2021-10-08T19:39:55.447 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:55 smithi097 ceph-mon[41966]: 3.1 scrub ok 2021-10-08T19:39:55.447 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:55 smithi097 ceph-mon[41966]: 3.5 scrub ok 2021-10-08T19:39:55.489 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:39:55.492 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:55 smithi117 ceph-mon[34585]: 3.1 scrub ok 2021-10-08T19:39:55.493 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:55 smithi117 ceph-mon[34585]: 3.5 scrub ok 2021-10-08T19:39:55.495 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:55.496 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:39:55.598 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:39:55.651 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:55.680 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 46 16 69834 69818 94.8307 70.625 0.0083138 0.0105391 2021-10-08T19:39:55.807 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:39:55.813 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:55.814 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:39:55.915 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:39:55.962 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:55.999 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:39:56.045 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:39:56.047 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:56.048 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:39:56.149 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:39:56.200 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:56.506 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset nodeep-scrub 2021-10-08T19:39:56.542 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:56 smithi097 ceph-mon[41966]: 5.12 scrub ok 2021-10-08T19:39:56.543 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:56 smithi097 ceph-mon[41966]: 4.16 scrub ok 2021-10-08T19:39:56.543 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:56 smithi097 ceph-mon[41966]: 5.1a scrub ok 2021-10-08T19:39:56.543 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:56 smithi097 ceph-mon[41966]: pgmap v931: 188 pgs: 188 active+clean; 4.1 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.1 KiB/s rd, 74 MiB/s wr, 1.18k op/s 2021-10-08T19:39:56.543 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:56 smithi097 ceph-mon[41966]: 2.e scrub ok 2021-10-08T19:39:56.544 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:56 smithi097 ceph-mon[41966]: 5.7 scrub ok 2021-10-08T19:39:56.544 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:56 smithi097 ceph-mon[32687]: 5.12 scrub ok 2021-10-08T19:39:56.544 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:56 smithi097 ceph-mon[32687]: 4.16 scrub ok 2021-10-08T19:39:56.545 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:56 smithi097 ceph-mon[32687]: 5.1a scrub ok 2021-10-08T19:39:56.545 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:56 smithi097 ceph-mon[32687]: pgmap v931: 188 pgs: 188 active+clean; 4.1 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.1 KiB/s rd, 74 MiB/s wr, 1.18k op/s 2021-10-08T19:39:56.545 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:56 smithi097 ceph-mon[32687]: 2.e scrub ok 2021-10-08T19:39:56.545 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:56 smithi097 ceph-mon[32687]: 5.7 scrub ok 2021-10-08T19:39:56.550 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:56.551 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:39:56.552 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:39:56.653 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:39:56.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:56 smithi117 ceph-mon[34585]: 5.12 scrub ok 2021-10-08T19:39:56.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:56 smithi117 ceph-mon[34585]: 4.16 scrub ok 2021-10-08T19:39:56.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:56 smithi117 ceph-mon[34585]: 5.1a scrub ok 2021-10-08T19:39:56.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:56 smithi117 ceph-mon[34585]: pgmap v931: 188 pgs: 188 active+clean; 4.1 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.1 KiB/s rd, 74 MiB/s wr, 1.18k op/s 2021-10-08T19:39:56.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:56 smithi117 ceph-mon[34585]: 2.e scrub ok 2021-10-08T19:39:56.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:56 smithi117 ceph-mon[34585]: 5.7 scrub ok 2021-10-08T19:39:56.681 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 47 15 70961 70946 94.3106 70.5 0.0121912 0.0105983 2021-10-08T19:39:56.706 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:57.036 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:39:57.039 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:57.040 INFO:journalctl@ceph.osd.7.smithi117.stdout:Oct 08 19:39:56 smithi117 conmon[54364]: 2021-10-08T19:39:56.850+0000 7ff38a842700 -1 osd.7 pg_epoch: 455 pg[4.8( v 289'34 (0'0,289'34] local-lis/les=397/398 n=7 ec=62/62 lis/c=397/397 les/c/f=398/398/0 sis=397) [7,5,6] r=0 lpr=397 crt=289'34 lcod 289'33 mlcod 0'0 active+clean] scrubber pg(4.8) handle_scrub_reserve_grant: received unsolicited reservation grant from osd 6 (0x55a61726fce0) 2021-10-08T19:39:57.041 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:39:57.142 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:39:57.178 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:39:57.236 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:57.277 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 4, 5, 7, 6, 1, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2021-10-08T19:39:57.277 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd reweight 0 1 2021-10-08T19:39:57.303 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:39:57.309 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:39:57 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:39:57.310 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:57 smithi117 ceph-mon[34585]: 5.5 scrub ok 2021-10-08T19:39:57.310 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:57 smithi117 ceph-mon[34585]: 6.8 scrub ok 2021-10-08T19:39:57.310 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:57 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3135432861' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:39:57.332 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:39:57.338 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:57.339 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:39:57.344 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:39:57.393 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:39:57.428 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:39:57.441 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:39:57.465 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:39:57.505 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:39:57.511 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:57 smithi097 ceph-mon[32687]: 5.5 scrub ok 2021-10-08T19:39:57.512 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:57 smithi097 ceph-mon[32687]: 6.8 scrub ok 2021-10-08T19:39:57.512 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:57 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3135432861' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:39:57.513 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:57 smithi097 ceph-mon[41966]: 5.5 scrub ok 2021-10-08T19:39:57.513 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:57 smithi097 ceph-mon[41966]: 6.8 scrub ok 2021-10-08T19:39:57.514 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:57 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3135432861' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:39:57.516 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:57.575 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:39:57.623 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:39:57.631 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'false' 2021-10-08T19:39:57.632 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'false' 2021-10-08T19:39:57.632 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'false' 2021-10-08T19:39:57.632 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'false' 2021-10-08T19:39:57.632 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'false' 2021-10-08T19:39:57.633 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'false' 2021-10-08T19:39:57.633 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'false' 2021-10-08T19:39:57.633 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'false' 2021-10-08T19:39:57.653 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:39:57.659 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:57.660 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:39:57.681 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 48 16 71884 71868 93.5464 57.625 0.0174863 0.0106848 2021-10-08T19:39:57.761 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:39:57.801 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:57.936 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:39:57.942 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:57.943 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:39:58.044 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:39:58.087 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:58.333 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:39:58.335 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:58 smithi117 ceph-mon[34585]: 6.10 scrub ok 2021-10-08T19:39:58.335 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:58 smithi117 ceph-mon[34585]: 5.1d scrub ok 2021-10-08T19:39:58.335 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:58 smithi117 ceph-mon[34585]: pgmap v932: 188 pgs: 188 active+clean; 4.1 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 839 B/s rd, 57 MiB/s wr, 912 op/s 2021-10-08T19:39:58.335 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:58 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:39:58.336 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:58.337 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:39:58.438 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:39:58.483 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:58.626 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:39:58.682 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 49 16 72924 72908 92.9617 65 0.0212713 0.0107511 2021-10-08T19:39:58.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:58 smithi097 ceph-mon[32687]: 6.10 scrub ok 2021-10-08T19:39:58.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:58 smithi097 ceph-mon[32687]: 5.1d scrub ok 2021-10-08T19:39:58.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:58 smithi097 ceph-mon[32687]: pgmap v932: 188 pgs: 188 active+clean; 4.1 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 839 B/s rd, 57 MiB/s wr, 912 op/s 2021-10-08T19:39:58.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:58 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:39:58.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:58 smithi097 ceph-mon[41966]: 6.10 scrub ok 2021-10-08T19:39:58.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:58 smithi097 ceph-mon[41966]: 5.1d scrub ok 2021-10-08T19:39:58.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:58 smithi097 ceph-mon[41966]: pgmap v932: 188 pgs: 188 active+clean; 4.1 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 839 B/s rd, 57 MiB/s wr, 912 op/s 2021-10-08T19:39:58.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:58 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:39:58.804 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2021-10-08T19:39:58.805 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:39:59.118 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:39:59.122 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:59.123 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:39:59.225 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:39:59.275 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:59.330 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:59 smithi097 ceph-mon[32687]: 4.17 scrub ok 2021-10-08T19:39:59.330 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:39:59 smithi097 ceph-mon[32687]: 5.15 scrub ok 2021-10-08T19:39:59.653 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:39:59.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:59 smithi117 ceph-mon[34585]: 4.17 scrub ok 2021-10-08T19:39:59.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:39:59 smithi117 ceph-mon[34585]: 5.15 scrub ok 2021-10-08T19:39:59.662 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:59.662 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:59 smithi097 ceph-mon[41966]: 4.17 scrub ok 2021-10-08T19:39:59.663 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:39:59 smithi097 ceph-mon[41966]: 5.15 scrub ok 2021-10-08T19:39:59.663 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:39:59.683 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 50 16 74026 74010 92.4786 68.875 0.00877234 0.0108082 2021-10-08T19:39:59.765 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:39:59.842 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:39:59.978 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:39:59.987 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:39:59.988 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:40:00.089 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:40:00.141 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:00.234 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2021-10-08T19:40:00.280 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:40:00.283 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:00.284 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:40:00.384 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:40:00.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:00 smithi117 ceph-mon[34585]: 4.6 scrub ok 2021-10-08T19:40:00.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:00 smithi117 ceph-mon[34585]: pgmap v933: 188 pgs: 188 active+clean; 4.3 GiB data, 16 GiB used, 700 GiB / 715 GiB avail; 639 B/s rd, 62 MiB/s wr, 986 op/s 2021-10-08T19:40:00.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:00 smithi117 ceph-mon[34585]: 4.10 scrub ok 2021-10-08T19:40:00.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:00 smithi117 ceph-mon[34585]: 4.12 scrub ok 2021-10-08T19:40:00.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:00 smithi117 ceph-mon[34585]: overall HEALTH_WARN nodeep-scrub flag(s) set 2021-10-08T19:40:00.437 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:00.639 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:40:00.644 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:00.645 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:40:00.646 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:00 smithi097 ceph-mon[32687]: 4.6 scrub ok 2021-10-08T19:40:00.646 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:00 smithi097 ceph-mon[32687]: pgmap v933: 188 pgs: 188 active+clean; 4.3 GiB data, 16 GiB used, 700 GiB / 715 GiB avail; 639 B/s rd, 62 MiB/s wr, 986 op/s 2021-10-08T19:40:00.646 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:00 smithi097 ceph-mon[32687]: 4.10 scrub ok 2021-10-08T19:40:00.646 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:00 smithi097 ceph-mon[32687]: 4.12 scrub ok 2021-10-08T19:40:00.647 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:00 smithi097 ceph-mon[32687]: overall HEALTH_WARN nodeep-scrub flag(s) set 2021-10-08T19:40:00.647 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:00 smithi097 ceph-mon[41966]: 4.6 scrub ok 2021-10-08T19:40:00.648 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:00 smithi097 ceph-mon[41966]: pgmap v933: 188 pgs: 188 active+clean; 4.3 GiB data, 16 GiB used, 700 GiB / 715 GiB avail; 639 B/s rd, 62 MiB/s wr, 986 op/s 2021-10-08T19:40:00.648 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:00 smithi097 ceph-mon[41966]: 4.10 scrub ok 2021-10-08T19:40:00.648 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:00 smithi097 ceph-mon[41966]: 4.12 scrub ok 2021-10-08T19:40:00.649 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:00 smithi097 ceph-mon[41966]: overall HEALTH_WARN nodeep-scrub flag(s) set 2021-10-08T19:40:00.684 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 51 16 74981 74965 91.8356 59.6875 0.0119145 0.0108841 2021-10-08T19:40:00.747 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:40:00.802 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:00.887 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:40:00.895 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:00.896 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:40:00.950 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:40:01.001 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:40:01.041 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2021-10-08T19:40:01.044 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:01.125 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:40:01.138 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:01.139 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:40:01.240 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:40:01.284 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:01.419 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:40:01.424 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:01.425 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:40:01.526 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:40:01.561 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:01 smithi117 ceph-mon[34585]: 5.1c scrub ok 2021-10-08T19:40:01.562 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:01 smithi117 ceph-mon[34585]: 5.4 scrub ok 2021-10-08T19:40:01.562 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:01 smithi117 ceph-mon[34585]: 1.1 scrub ok 2021-10-08T19:40:01.562 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:01 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3831412814' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:40:01.563 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:01 smithi117 ceph-mon[34585]: from='client.26191 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:40:01.563 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:01 smithi117 ceph-mon[34585]: 3.a scrub ok 2021-10-08T19:40:01.566 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:01.659 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:40:01.663 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:01.663 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:40:01.691 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 52 16 76045 76029 91.3481 66.5 0.0166978 0.0109429 2021-10-08T19:40:01.725 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:01 smithi097 ceph-mon[32687]: 5.1c scrub ok 2021-10-08T19:40:01.725 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:01 smithi097 ceph-mon[32687]: 5.4 scrub ok 2021-10-08T19:40:01.726 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:01 smithi097 ceph-mon[32687]: 1.1 scrub ok 2021-10-08T19:40:01.726 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:01 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3831412814' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:40:01.726 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:01 smithi097 ceph-mon[32687]: from='client.26191 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:40:01.726 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:01 smithi097 ceph-mon[32687]: 3.a scrub ok 2021-10-08T19:40:01.727 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:01 smithi097 ceph-mon[41966]: 5.1c scrub ok 2021-10-08T19:40:01.727 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:01 smithi097 ceph-mon[41966]: 5.4 scrub ok 2021-10-08T19:40:01.727 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:01 smithi097 ceph-mon[41966]: 1.1 scrub ok 2021-10-08T19:40:01.727 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:01 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3831412814' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:40:01.728 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:01 smithi097 ceph-mon[41966]: from='client.26191 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:40:01.728 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:01 smithi097 ceph-mon[41966]: 3.a scrub ok 2021-10-08T19:40:01.747 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:40:01.764 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:40:01.810 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:01.907 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is unset 2021-10-08T19:40:02.352 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:40:02.353 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:02.354 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:40:02.455 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:40:02.499 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:02.587 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:40:02.594 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:40:02 smithi117 conmon[69189]: level=error ts=2021-10-08T19:40:02.316Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=2 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:40:02.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:02 smithi117 ceph-mon[34585]: 4.c scrub ok 2021-10-08T19:40:02.595 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:02 smithi117 ceph-mon[34585]: pgmap v934: 188 pgs: 188 active+clean; 4.5 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.1 KiB/s rd, 75 MiB/s wr, 1.20k op/s 2021-10-08T19:40:02.595 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:02 smithi117 ceph-mon[34585]: 1.a scrub ok 2021-10-08T19:40:02.596 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:02 smithi117 ceph-mon[34585]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:40:02.596 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:02 smithi117 ceph-mon[34585]: Cluster is now healthy 2021-10-08T19:40:02.596 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:02 smithi117 ceph-mon[34585]: from='client.26191 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:40:02.597 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:02 smithi117 ceph-mon[34585]: osdmap e456: 8 total, 8 up, 8 in 2021-10-08T19:40:02.597 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:02 smithi117 ceph-mon[34585]: 1.7 scrub ok 2021-10-08T19:40:02.597 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:02 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:40:02.598 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:02.598 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:40:02.649 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:02 smithi097 ceph-mon[32687]: 4.c scrub ok 2021-10-08T19:40:02.650 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:02 smithi097 ceph-mon[32687]: pgmap v934: 188 pgs: 188 active+clean; 4.5 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.1 KiB/s rd, 75 MiB/s wr, 1.20k op/s 2021-10-08T19:40:02.650 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:02 smithi097 ceph-mon[32687]: 1.a scrub ok 2021-10-08T19:40:02.650 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:02 smithi097 ceph-mon[32687]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:40:02.650 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:02 smithi097 ceph-mon[32687]: Cluster is now healthy 2021-10-08T19:40:02.651 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:02 smithi097 ceph-mon[32687]: from='client.26191 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:40:02.651 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:02 smithi097 ceph-mon[32687]: osdmap e456: 8 total, 8 up, 8 in 2021-10-08T19:40:02.651 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:02 smithi097 ceph-mon[32687]: 1.7 scrub ok 2021-10-08T19:40:02.651 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:02 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:40:02.652 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:40:02 smithi097 conmon[33110]: 172.21.15.117 - - [08/Oct/2021:19:40:02] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:40:02.653 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:40:02 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:40:02] "GET /metrics HTTP/1.1" 200 155921 "" "Prometheus/2.18.1" 2021-10-08T19:40:02.653 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:02 smithi097 ceph-mon[41966]: 4.c scrub ok 2021-10-08T19:40:02.654 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:02 smithi097 ceph-mon[41966]: pgmap v934: 188 pgs: 188 active+clean; 4.5 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.1 KiB/s rd, 75 MiB/s wr, 1.20k op/s 2021-10-08T19:40:02.656 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:02 smithi097 ceph-mon[41966]: 1.a scrub ok 2021-10-08T19:40:02.656 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:02 smithi097 ceph-mon[41966]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:40:02.657 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:02 smithi097 ceph-mon[41966]: Cluster is now healthy 2021-10-08T19:40:02.657 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:02 smithi097 ceph-mon[41966]: from='client.26191 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:40:02.657 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:02 smithi097 ceph-mon[41966]: osdmap e456: 8 total, 8 up, 8 in 2021-10-08T19:40:02.658 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:02 smithi097 ceph-mon[41966]: 1.7 scrub ok 2021-10-08T19:40:02.658 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:02 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:40:02.683 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 53 16 77142 77126 90.9182 68.5625 0.00931733 0.0109947 2021-10-08T19:40:02.699 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:40:02.756 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:03.027 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:40:03.036 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:03.037 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:40:03.139 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:40:03.189 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:03.280 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:40:03.285 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:03.286 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:40:03.388 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:40:03.420 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:03.607 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:40:03.612 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:03.613 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:40:03.614 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:03 smithi117 ceph-mon[34585]: 5.e scrub ok 2021-10-08T19:40:03.614 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:03 smithi117 ceph-mon[34585]: 2.1f scrub ok 2021-10-08T19:40:03.614 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:03 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:40:03.615 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:03 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:40:03.615 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:03 smithi117 ceph-mon[34585]: 6.14 deep-scrub ok 2021-10-08T19:40:03.615 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:03 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:40:03.615 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:03 smithi117 ceph-mon[34585]: 172.21.15.117 - - [08/Oct/2021:19:40:02] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:40:03.615 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:03 smithi117 ceph-mon[34585]: osdmap e457: 8 total, 8 up, 8 in 2021-10-08T19:40:03.616 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:03 smithi117 ceph-mon[34585]: 2.a scrub ok 2021-10-08T19:40:03.616 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:03 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3188928305' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2021-10-08T19:40:03.616 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:03 smithi117 ceph-mon[34585]: from='client.36236 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2021-10-08T19:40:03.683 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 54 16 78187 78171 90.444 65.3125 0.00955082 0.0110522 2021-10-08T19:40:03.714 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:40:03.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:03 smithi097 ceph-mon[32687]: 5.e scrub ok 2021-10-08T19:40:03.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:03 smithi097 ceph-mon[32687]: 2.1f scrub ok 2021-10-08T19:40:03.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:03 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:40:03.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:03 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:40:03.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:03 smithi097 ceph-mon[32687]: 6.14 deep-scrub ok 2021-10-08T19:40:03.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:03 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:40:03.724 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:03 smithi097 ceph-mon[32687]: 172.21.15.117 - - [08/Oct/2021:19:40:02] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:40:03.724 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:03 smithi097 ceph-mon[32687]: osdmap e457: 8 total, 8 up, 8 in 2021-10-08T19:40:03.724 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:03 smithi097 ceph-mon[32687]: 2.a scrub ok 2021-10-08T19:40:03.724 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:03 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3188928305' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2021-10-08T19:40:03.725 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:03 smithi097 ceph-mon[32687]: from='client.36236 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2021-10-08T19:40:03.725 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:03 smithi097 ceph-mon[41966]: 5.e scrub ok 2021-10-08T19:40:03.725 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:03 smithi097 ceph-mon[41966]: 2.1f scrub ok 2021-10-08T19:40:03.725 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:03 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:40:03.726 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:03 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:40:03.726 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:03 smithi097 ceph-mon[41966]: 6.14 deep-scrub ok 2021-10-08T19:40:03.726 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:03 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:40:03.726 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:03 smithi097 ceph-mon[41966]: 172.21.15.117 - - [08/Oct/2021:19:40:02] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:40:03.727 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:03 smithi097 ceph-mon[41966]: osdmap e457: 8 total, 8 up, 8 in 2021-10-08T19:40:03.727 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:03 smithi097 ceph-mon[41966]: 2.a scrub ok 2021-10-08T19:40:03.727 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:03 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3188928305' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2021-10-08T19:40:03.727 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:03 smithi097 ceph-mon[41966]: from='client.36236 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2021-10-08T19:40:03.763 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:03.857 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:40:03.862 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:03.863 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:40:03.901 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2021-10-08T19:40:03.901 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:40:03.924 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.0 to 1 (10000) 2021-10-08T19:40:03.965 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:40:04.017 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:04.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:40:03 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:40:03] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:40:04.352 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:04 smithi097 ceph-mon[32687]: 2.f scrub ok 2021-10-08T19:40:04.353 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:04 smithi097 ceph-mon[32687]: 6.1c scrub ok 2021-10-08T19:40:04.353 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:04 smithi097 ceph-mon[32687]: pgmap v937: 188 pgs: 188 active+clean; 4.5 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 639 B/s rd, 42 MiB/s wr, 667 op/s 2021-10-08T19:40:04.353 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:04 smithi097 ceph-mon[32687]: 4.f scrub ok 2021-10-08T19:40:04.532 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:40:04.539 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:04.540 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:40:04.641 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:40:04.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:04 smithi117 ceph-mon[34585]: 2.f scrub ok 2021-10-08T19:40:04.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:04 smithi117 ceph-mon[34585]: 6.1c scrub ok 2021-10-08T19:40:04.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:04 smithi117 ceph-mon[34585]: pgmap v937: 188 pgs: 188 active+clean; 4.5 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 639 B/s rd, 42 MiB/s wr, 667 op/s 2021-10-08T19:40:04.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:04 smithi117 ceph-mon[34585]: 4.f scrub ok 2021-10-08T19:40:04.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:04 smithi117 ceph-mon[34585]: from='client.36236 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2021-10-08T19:40:04.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:04 smithi117 ceph-mon[34585]: osdmap e458: 8 total, 8 up, 8 in 2021-10-08T19:40:04.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:04 smithi117 ceph-mon[34585]: 2.15 scrub ok 2021-10-08T19:40:04.689 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 55 16 79341 79325 90.1103 72.125 0.0119469 0.0110927 2021-10-08T19:40:04.690 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:04 smithi097 ceph-mon[41966]: 2.f scrub ok 2021-10-08T19:40:04.690 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:04 smithi097 ceph-mon[41966]: 6.1c scrub ok 2021-10-08T19:40:04.691 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:04 smithi097 ceph-mon[41966]: pgmap v937: 188 pgs: 188 active+clean; 4.5 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 639 B/s rd, 42 MiB/s wr, 667 op/s 2021-10-08T19:40:04.691 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:04 smithi097 ceph-mon[41966]: 4.f scrub ok 2021-10-08T19:40:04.691 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:04 smithi097 ceph-mon[41966]: from='client.36236 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2021-10-08T19:40:04.691 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:04 smithi097 ceph-mon[41966]: osdmap e458: 8 total, 8 up, 8 in 2021-10-08T19:40:04.692 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:04 smithi097 ceph-mon[41966]: 2.15 scrub ok 2021-10-08T19:40:04.693 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:04 smithi097 ceph-mon[32687]: from='client.36236 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2021-10-08T19:40:04.693 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:04 smithi097 ceph-mon[32687]: osdmap e458: 8 total, 8 up, 8 in 2021-10-08T19:40:04.694 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:04 smithi097 ceph-mon[32687]: 2.15 scrub ok 2021-10-08T19:40:04.700 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:04.899 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2021-10-08T19:40:05.129 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set noscrub 2021-10-08T19:40:05.278 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:40:05.281 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:05.282 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:40:05.324 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:40:05.382 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:40:05.450 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:05.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:05 smithi097 ceph-mon[41966]: 3.e scrub ok 2021-10-08T19:40:05.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:05 smithi097 ceph-mon[41966]: 5.d scrub ok 2021-10-08T19:40:05.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:05 smithi097 ceph-mon[41966]: 6.2 scrub ok 2021-10-08T19:40:05.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:05 smithi097 ceph-mon[32687]: 3.e scrub ok 2021-10-08T19:40:05.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:05 smithi097 ceph-mon[32687]: 5.d scrub ok 2021-10-08T19:40:05.474 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:05 smithi097 ceph-mon[32687]: 6.2 scrub ok 2021-10-08T19:40:05.516 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd reweight 2 1 2021-10-08T19:40:05.544 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:40:05.556 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:05.557 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:40:05.625 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:05 smithi117 ceph-mon[34585]: 3.e scrub ok 2021-10-08T19:40:05.626 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:05 smithi117 ceph-mon[34585]: 5.d scrub ok 2021-10-08T19:40:05.626 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:05 smithi117 ceph-mon[34585]: 6.2 scrub ok 2021-10-08T19:40:05.658 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:40:05.687 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 56 16 80367 80351 89.6417 64.125 0.00476564 0.011151 2021-10-08T19:40:05.745 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:05.966 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:40:06.100 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:40:06.108 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:06.109 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:40:06.210 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:40:06.229 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:40:06.251 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:06.268 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:40:06.308 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:40:06.321 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:40:06.325 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:06.325 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:40:06.339 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:40:06.371 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:06 smithi097 ceph-mon[32687]: 3.13 scrub ok 2021-10-08T19:40:06.372 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:06 smithi097 ceph-mon[32687]: pgmap v939: 188 pgs: 188 active+clean; 4.8 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.7 KiB/s rd, 86 MiB/s wr, 1.38k op/s 2021-10-08T19:40:06.372 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:06 smithi097 ceph-mon[32687]: osdmap e459: 8 total, 8 up, 8 in 2021-10-08T19:40:06.373 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:06 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3767717037' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:40:06.376 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:40:06.410 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:40:06.428 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:40:06.454 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:40:06.458 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:06.497 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:40:06.518 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true' 2021-10-08T19:40:06.519 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true' 2021-10-08T19:40:06.519 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true' 2021-10-08T19:40:06.519 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true' 2021-10-08T19:40:06.519 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true' 2021-10-08T19:40:06.520 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true' 2021-10-08T19:40:06.520 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'true' 2021-10-08T19:40:06.520 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'true' 2021-10-08T19:40:06.526 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:40:06.529 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:06 smithi117 ceph-mon[34585]: 3.13 scrub ok 2021-10-08T19:40:06.529 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:06 smithi117 ceph-mon[34585]: pgmap v939: 188 pgs: 188 active+clean; 4.8 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.7 KiB/s rd, 86 MiB/s wr, 1.38k op/s 2021-10-08T19:40:06.529 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:06 smithi117 ceph-mon[34585]: osdmap e459: 8 total, 8 up, 8 in 2021-10-08T19:40:06.529 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:06 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3767717037' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:40:06.530 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:06.531 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:40:06.632 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:40:06.673 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:06 smithi097 ceph-mon[41966]: 3.13 scrub ok 2021-10-08T19:40:06.675 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:06 smithi097 ceph-mon[41966]: pgmap v939: 188 pgs: 188 active+clean; 4.8 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.7 KiB/s rd, 86 MiB/s wr, 1.38k op/s 2021-10-08T19:40:06.675 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:06 smithi097 ceph-mon[41966]: osdmap e459: 8 total, 8 up, 8 in 2021-10-08T19:40:06.675 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:06 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3767717037' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:40:06.682 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:06.688 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 57 16 81365 81349 89.1619 62.375 0.0066391 0.0112105 2021-10-08T19:40:07.447 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:40:07.461 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:07.462 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:40:07.565 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:40:07.610 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:07.656 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:40:07 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:40:07.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:07 smithi117 ceph-mon[34585]: 2.3 scrub ok 2021-10-08T19:40:07.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:07 smithi117 ceph-mon[34585]: 3.b scrub ok 2021-10-08T19:40:07.682 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:40:07.683 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2021-10-08T19:40:07.683 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:07.683 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.26125.0:82436 11.3 11:c618bfd5:::benchmark_data_smithi097_295476_object82435:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e459)", 2021-10-08T19:40:07.684 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:40:07.672416+0000", 2021-10-08T19:40:07.684 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.0092270349999999998, 2021-10-08T19:40:07.684 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092507330000000006, 2021-10-08T19:40:07.684 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:40:07.685 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "waiting for sub ops", 2021-10-08T19:40:07.685 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:40:07.685 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.26125", 2021-10-08T19:40:07.686 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:40:07.686 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 82436 2021-10-08T19:40:07.686 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:07.686 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:40:07.687 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:07.687 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:40:07.687 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:07.672416+0000", 2021-10-08T19:40:07.687 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:07.687 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:07.688 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:07.688 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:40:07.688 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:07.672416+0000", 2021-10-08T19:40:07.688 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:07.689 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:07.689 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:07.689 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:40:07.690 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:07.672414+0000", 2021-10-08T19:40:07.690 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:40:07.690 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:07.690 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:07.691 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:40:07.691 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:07.672448+0000", 2021-10-08T19:40:07.691 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.3827e-05 2021-10-08T19:40:07.691 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:07.691 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:07.692 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:40:07.692 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:07.672472+0000", 2021-10-08T19:40:07.692 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4179999999999999e-05 2021-10-08T19:40:07.692 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:07.693 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:07.693 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:40:07.693 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:07.672480+0000", 2021-10-08T19:40:07.693 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8900000000000007e-06 2021-10-08T19:40:07.693 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:07.694 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:07.694 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:07.694 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:07.672532+0000", 2021-10-08T19:40:07.695 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2170999999999999e-05 2021-10-08T19:40:07.695 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:07.695 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:07.695 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:40:07.696 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:07.672700+0000", 2021-10-08T19:40:07.696 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016779699999999999 2021-10-08T19:40:07.696 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:07.696 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:07.697 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 1,7", 2021-10-08T19:40:07.697 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:07.672883+0000", 2021-10-08T19:40:07.697 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000182666 2021-10-08T19:40:07.697 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:07.697 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:07.698 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:40:07.698 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:07.677448+0000", 2021-10-08T19:40:07.698 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0045654700000000003 2021-10-08T19:40:07.699 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:07.700 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:07.700 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:07.700 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:07.678161+0000", 2021-10-08T19:40:07.700 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00071300300000000003 2021-10-08T19:40:07.701 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:07.701 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:40:07.701 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:07.701 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:07.701 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:07.702 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.26125.0:82437 11.3 11:c5e16928:::benchmark_data_smithi097_295476_object82436:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e459)", 2021-10-08T19:40:07.702 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:40:07.673649+0000", 2021-10-08T19:40:07.702 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.0079946989999999992, 2021-10-08T19:40:07.702 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0080876309999999996, 2021-10-08T19:40:07.703 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:40:07.703 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "waiting for sub ops", 2021-10-08T19:40:07.703 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:40:07.703 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.26125", 2021-10-08T19:40:07.704 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:40:07.704 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 82437 2021-10-08T19:40:07.704 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:07.704 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:40:07.704 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:07.705 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:40:07.705 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:07.673649+0000", 2021-10-08T19:40:07.705 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:07.705 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:07.706 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:07.706 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:40:07.706 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:07.673649+0000", 2021-10-08T19:40:07.706 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:07.707 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:07.707 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:07.707 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:40:07.707 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:07.673647+0000", 2021-10-08T19:40:07.707 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:40:07.708 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:07.708 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:07.708 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:40:07.708 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:07.673688+0000", 2021-10-08T19:40:07.708 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0389999999999998e-05 2021-10-08T19:40:07.709 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:07.709 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:07.709 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:40:07.709 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:07.673701+0000", 2021-10-08T19:40:07.710 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3818000000000001e-05 2021-10-08T19:40:07.710 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:07.710 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:07.710 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:40:07.710 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:07.673708+0000", 2021-10-08T19:40:07.711 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1999999999999999e-06 2021-10-08T19:40:07.711 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:07.711 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:07.711 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:07.711 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:07.675235+0000", 2021-10-08T19:40:07.712 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001526931 2021-10-08T19:40:07.712 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:07.712 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:07.712 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:40:07.712 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:07.675317+0000", 2021-10-08T19:40:07.713 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2273000000000003e-05 2021-10-08T19:40:07.713 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:07.713 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:07.713 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 1,7", 2021-10-08T19:40:07.714 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:07.675422+0000", 2021-10-08T19:40:07.714 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010560099999999999 2021-10-08T19:40:07.714 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:07.714 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:07.714 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:40:07.715 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:07.677548+0000", 2021-10-08T19:40:07.715 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00212531 2021-10-08T19:40:07.715 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:07.715 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:07.716 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:07.716 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:07.678322+0000", 2021-10-08T19:40:07.716 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00077470399999999997 2021-10-08T19:40:07.716 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:07.716 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:40:07.717 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:07.717 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:07.717 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:07.717 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.26125.0:82441 11.3 11:c4090be3:::benchmark_data_smithi097_295476_object82440:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e459)", 2021-10-08T19:40:07.717 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:40:07.678300+0000", 2021-10-08T19:40:07.718 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.0033435520000000001, 2021-10-08T19:40:07.718 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00349395, 2021-10-08T19:40:07.718 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:40:07.718 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "waiting for sub ops", 2021-10-08T19:40:07.719 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:40:07.719 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.26125", 2021-10-08T19:40:07.719 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:40:07.719 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 82441 2021-10-08T19:40:07.719 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:07.720 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:40:07.720 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:07.720 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:40:07.720 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:07.678300+0000", 2021-10-08T19:40:07.720 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:07.721 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:07.721 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:07.721 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:40:07.721 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:07.678300+0000", 2021-10-08T19:40:07.722 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:07.722 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:07.722 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:07.722 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:40:07.722 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:07.678298+0000", 2021-10-08T19:40:07.723 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:40:07.723 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:07.723 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:07.723 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:40:07.723 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:07.678346+0000", 2021-10-08T19:40:07.724 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8341999999999999e-05 2021-10-08T19:40:07.724 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:07.724 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:07.724 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:40:07.725 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:07.678371+0000", 2021-10-08T19:40:07.725 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4609000000000001e-05 2021-10-08T19:40:07.725 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:07.725 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:07.725 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:40:07.726 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:07.678380+0000", 2021-10-08T19:40:07.726 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.7280000000000001e-06 2021-10-08T19:40:07.726 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:07.726 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:07.726 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:07.727 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:07.678434+0000", 2021-10-08T19:40:07.727 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4004e-05 2021-10-08T19:40:07.727 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:07.727 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:07.728 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:40:07.728 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:07.678580+0000", 2021-10-08T19:40:07.728 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014622800000000001 2021-10-08T19:40:07.728 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:07.728 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:07.729 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 1,7", 2021-10-08T19:40:07.729 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:07.678739+0000", 2021-10-08T19:40:07.729 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015952300000000001 2021-10-08T19:40:07.729 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:07.730 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:07.730 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:40:07.730 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:07.681144+0000", 2021-10-08T19:40:07.730 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002404256 2021-10-08T19:40:07.730 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:07.731 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:40:07.731 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:07.731 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:07.731 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:07.732 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.26125.0:82443 11.1 11:8e10efcb:::benchmark_data_smithi097_295476_object82442:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e459)", 2021-10-08T19:40:07.732 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:40:07.678403+0000", 2021-10-08T19:40:07.732 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.0032400789999999999, 2021-10-08T19:40:07.732 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0034391109999999999, 2021-10-08T19:40:07.732 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:40:07.733 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "waiting for sub ops", 2021-10-08T19:40:07.733 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:40:07.733 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.26125", 2021-10-08T19:40:07.733 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:40:07.733 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 82443 2021-10-08T19:40:07.734 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:07.734 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:40:07.734 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:07.734 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:40:07.735 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:07.678403+0000", 2021-10-08T19:40:07.735 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:07.735 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:07.735 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:07.735 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:40:07.736 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:07.678403+0000", 2021-10-08T19:40:07.736 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:07.736 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:07.736 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:07.736 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:40:07.737 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:07.678403+0000", 2021-10-08T19:40:07.737 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:40:07.737 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:07.737 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:07.738 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:40:07.738 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:07.678429+0000", 2021-10-08T19:40:07.738 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6092999999999999e-05 2021-10-08T19:40:07.738 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:07.738 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:07.739 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:40:07.739 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:07.678443+0000", 2021-10-08T19:40:07.739 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4574e-05 2021-10-08T19:40:07.739 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:07.739 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:07.740 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:40:07.740 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:07.678448+0000", 2021-10-08T19:40:07.740 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4689999999999999e-06 2021-10-08T19:40:07.740 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:07.740 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:07.741 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:07.741 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:07.678496+0000", 2021-10-08T19:40:07.741 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8476000000000001e-05 2021-10-08T19:40:07.741 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:07.742 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:07.742 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:40:07.742 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:07.678596+0000", 2021-10-08T19:40:07.742 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9585000000000003e-05 2021-10-08T19:40:07.742 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:07.743 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:07.743 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,3", 2021-10-08T19:40:07.743 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:07.678694+0000", 2021-10-08T19:40:07.743 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8016999999999993e-05 2021-10-08T19:40:07.743 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:07.744 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:07.744 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:40:07.744 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:07.681315+0000", 2021-10-08T19:40:07.744 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002621108 2021-10-08T19:40:07.745 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:07.745 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:40:07.745 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:07.745 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:07.745 INFO:teuthology.orchestra.run.smithi117.stdout: ], 2021-10-08T19:40:07.746 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 4 2021-10-08T19:40:07.746 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:40:07.747 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 58 16 82453 82437 88.7971 68 0.010801 0.011257 2021-10-08T19:40:07.747 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:07 smithi097 ceph-mon[41966]: 2.3 scrub ok 2021-10-08T19:40:07.747 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:07 smithi097 ceph-mon[41966]: 3.b scrub ok 2021-10-08T19:40:07.748 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:07 smithi097 ceph-mon[32687]: 2.3 scrub ok 2021-10-08T19:40:07.748 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:07 smithi097 ceph-mon[32687]: 3.b scrub ok 2021-10-08T19:40:08.191 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:40:08.194 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:08.195 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:40:08.296 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:40:08.340 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:08.353 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:40:08.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:08 smithi097 ceph-mon[32687]: pgmap v941: 188 pgs: 188 active+clean; 4.8 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1008 B/s rd, 65 MiB/s wr, 1.03k op/s 2021-10-08T19:40:08.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:08 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:40:08.474 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:08 smithi097 ceph-mon[32687]: 2.25 scrub ok 2021-10-08T19:40:08.474 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:08 smithi097 ceph-mon[41966]: pgmap v941: 188 pgs: 188 active+clean; 4.8 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1008 B/s rd, 65 MiB/s wr, 1.03k op/s 2021-10-08T19:40:08.475 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:08 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:40:08.475 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:08 smithi097 ceph-mon[41966]: 2.25 scrub ok 2021-10-08T19:40:08.625 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:40:08.634 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:08.635 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:40:08.636 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:08 smithi117 ceph-mon[34585]: pgmap v941: 188 pgs: 188 active+clean; 4.8 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1008 B/s rd, 65 MiB/s wr, 1.03k op/s 2021-10-08T19:40:08.636 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:08 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:40:08.636 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:08 smithi117 ceph-mon[34585]: 2.25 scrub ok 2021-10-08T19:40:08.641 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2021-10-08T19:40:08.689 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 59 16 83560 83544 88.4629 69.1875 0.0131418 0.0112996 2021-10-08T19:40:08.736 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:40:08.772 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:08.854 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:40:08.856 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:08.857 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:40:08.958 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:40:09.039 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:09.061 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:40:09.456 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:40:09.460 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:09.461 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:40:09.563 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:40:09.591 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:09 smithi117 ceph-mon[34585]: 5.8 scrub ok 2021-10-08T19:40:09.591 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:09 smithi117 ceph-mon[34585]: 3.9 scrub ok 2021-10-08T19:40:09.591 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:09 smithi117 ceph-mon[34585]: 4.1d scrub ok 2021-10-08T19:40:09.592 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:09 smithi117 ceph-mon[34585]: 5.11 scrub ok 2021-10-08T19:40:09.594 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:09.669 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:09 smithi097 ceph-mon[41966]: 5.8 scrub ok 2021-10-08T19:40:09.670 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:09 smithi097 ceph-mon[41966]: 3.9 scrub ok 2021-10-08T19:40:09.670 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:09 smithi097 ceph-mon[41966]: 4.1d scrub ok 2021-10-08T19:40:09.671 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:09 smithi097 ceph-mon[41966]: 5.11 scrub ok 2021-10-08T19:40:09.672 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:09 smithi097 ceph-mon[32687]: 5.8 scrub ok 2021-10-08T19:40:09.672 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:09 smithi097 ceph-mon[32687]: 3.9 scrub ok 2021-10-08T19:40:09.673 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:09 smithi097 ceph-mon[32687]: 4.1d scrub ok 2021-10-08T19:40:09.673 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:09 smithi097 ceph-mon[32687]: 5.11 scrub ok 2021-10-08T19:40:09.690 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:2021-10-08T19:40:09.689583+0000 min lat: 0.00117486 max lat: 0.499237 avg lat: 0.0113538 2021-10-08T19:40:09.691 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2021-10-08T19:40:09.691 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 60 16 84566 84550 88.0365 62.875 0.0127709 0.0113538 2021-10-08T19:40:09.804 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:40:09.808 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:09.809 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:40:09.911 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:40:09.976 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:10.389 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2021-10-08T19:40:10.690 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 61 16 85661 85645 87.7152 68.4375 0.0139817 0.0113954 2021-10-08T19:40:10.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:10 smithi097 ceph-mon[32687]: pgmap v942: 188 pgs: 188 active+clean; 4.9 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 842 B/s rd, 78 MiB/s wr, 1.25k op/s 2021-10-08T19:40:10.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:10 smithi097 ceph-mon[32687]: 6.17 scrub ok 2021-10-08T19:40:10.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:10 smithi097 ceph-mon[32687]: 6.1 deep-scrub ok 2021-10-08T19:40:10.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:10 smithi097 ceph-mon[41966]: pgmap v942: 188 pgs: 188 active+clean; 4.9 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 842 B/s rd, 78 MiB/s wr, 1.25k op/s 2021-10-08T19:40:10.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:10 smithi097 ceph-mon[41966]: 6.17 scrub ok 2021-10-08T19:40:10.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:10 smithi097 ceph-mon[41966]: 6.1 deep-scrub ok 2021-10-08T19:40:10.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:10 smithi117 ceph-mon[34585]: pgmap v942: 188 pgs: 188 active+clean; 4.9 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 842 B/s rd, 78 MiB/s wr, 1.25k op/s 2021-10-08T19:40:10.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:10 smithi117 ceph-mon[34585]: 6.17 scrub ok 2021-10-08T19:40:10.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:10 smithi117 ceph-mon[34585]: 6.1 deep-scrub ok 2021-10-08T19:40:11.481 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:40:11.482 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2021-10-08T19:40:11.482 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2021-10-08T19:40:11.482 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2021-10-08T19:40:11.483 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:40:11.485 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:40:11.489 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:11.490 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:40:11.591 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:40:11.626 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:11.690 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 62 16 86734 86718 87.3821 67.0625 0.00708696 0.0114382 2021-10-08T19:40:11.791 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:40:11.796 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:11.797 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:40:11.901 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:40:11.933 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:11.968 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:40:11.982 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:40:11.984 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:11.985 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:40:12.086 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:40:12.139 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:11 smithi097 ceph-mon[32687]: 4.d deep-scrub ok 2021-10-08T19:40:12.140 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:11 smithi097 ceph-mon[32687]: 6.3 scrub ok 2021-10-08T19:40:12.140 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:11 smithi097 ceph-mon[32687]: pgmap v943: 188 pgs: 188 active+clean; 5.1 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1.2 KiB/s rd, 83 MiB/s wr, 1.32k op/s 2021-10-08T19:40:12.140 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:11 smithi097 ceph-mon[32687]: 6.16 deep-scrub ok 2021-10-08T19:40:12.140 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:11 smithi097 ceph-mon[32687]: 2.c deep-scrub ok 2021-10-08T19:40:12.141 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:11 smithi097 ceph-mon[41966]: 4.d deep-scrub ok 2021-10-08T19:40:12.141 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:11 smithi097 ceph-mon[41966]: 6.3 scrub ok 2021-10-08T19:40:12.142 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:11 smithi097 ceph-mon[41966]: pgmap v943: 188 pgs: 188 active+clean; 5.1 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1.2 KiB/s rd, 83 MiB/s wr, 1.32k op/s 2021-10-08T19:40:12.142 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:11 smithi097 ceph-mon[41966]: 6.16 deep-scrub ok 2021-10-08T19:40:12.143 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:11 smithi097 ceph-mon[41966]: 2.c deep-scrub ok 2021-10-08T19:40:12.145 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:12.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:11 smithi117 ceph-mon[34585]: 4.d deep-scrub ok 2021-10-08T19:40:12.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:11 smithi117 ceph-mon[34585]: 6.3 scrub ok 2021-10-08T19:40:12.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:11 smithi117 ceph-mon[34585]: pgmap v943: 188 pgs: 188 active+clean; 5.1 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1.2 KiB/s rd, 83 MiB/s wr, 1.32k op/s 2021-10-08T19:40:12.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:11 smithi117 ceph-mon[34585]: 6.16 deep-scrub ok 2021-10-08T19:40:12.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:11 smithi117 ceph-mon[34585]: 2.c deep-scrub ok 2021-10-08T19:40:12.382 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:40:12.587 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:12.588 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2021-10-08T19:40:12.589 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:40:12.661 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:40:12 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:40:12] "GET /metrics HTTP/1.1" 200 155912 "" "Prometheus/2.18.1" 2021-10-08T19:40:12.690 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:40:12.692 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 63 16 87597 87581 86.851 53.9375 0.0227054 0.0115088 2021-10-08T19:40:12.766 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:12.888 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:40:12.894 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:12.895 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:40:12.914 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:12 smithi097 ceph-mon[32687]: 4.1a scrub ok 2021-10-08T19:40:12.914 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:12 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1629118720' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:40:12.915 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:12 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2794676719' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2021-10-08T19:40:12.916 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is set 2021-10-08T19:40:12.926 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.2 to 1 (10000) 2021-10-08T19:40:12.949 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:40:12.997 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:40:13.045 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:13.208 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:12 smithi117 ceph-mon[34585]: 4.1a scrub ok 2021-10-08T19:40:13.209 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:12 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1629118720' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:40:13.209 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:12 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2794676719' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2021-10-08T19:40:13.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:12 smithi097 ceph-mon[41966]: 4.1a scrub ok 2021-10-08T19:40:13.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:12 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1629118720' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:40:13.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:12 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2794676719' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2021-10-08T19:40:13.690 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 64 16 88662 88646 86.534 66.5625 0.00819567 0.0115514 2021-10-08T19:40:14.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:40:13 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:40:13] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:40:14.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:13 smithi117 ceph-mon[34585]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:40:14.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:13 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1629118720' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:40:14.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:13 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2794676719' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2021-10-08T19:40:14.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:13 smithi117 ceph-mon[34585]: osdmap e460: 8 total, 8 up, 8 in 2021-10-08T19:40:14.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:13 smithi117 ceph-mon[34585]: pgmap v945: 188 pgs: 188 active+clean; 5.1 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 639 B/s rd, 42 MiB/s wr, 666 op/s 2021-10-08T19:40:14.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:13 smithi097 ceph-mon[32687]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:40:14.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:13 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1629118720' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:40:14.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:13 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2794676719' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2021-10-08T19:40:14.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:13 smithi097 ceph-mon[32687]: osdmap e460: 8 total, 8 up, 8 in 2021-10-08T19:40:14.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:13 smithi097 ceph-mon[32687]: pgmap v945: 188 pgs: 188 active+clean; 5.1 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 639 B/s rd, 42 MiB/s wr, 666 op/s 2021-10-08T19:40:14.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:13 smithi097 ceph-mon[41966]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:40:14.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:13 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1629118720' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:40:14.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:13 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2794676719' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2021-10-08T19:40:14.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:13 smithi097 ceph-mon[41966]: osdmap e460: 8 total, 8 up, 8 in 2021-10-08T19:40:14.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:13 smithi097 ceph-mon[41966]: pgmap v945: 188 pgs: 188 active+clean; 5.1 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 639 B/s rd, 42 MiB/s wr, 666 op/s 2021-10-08T19:40:14.691 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 65 16 89579 89563 86.0834 57.3125 0.0134306 0.0116123 2021-10-08T19:40:14.953 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:40:14.957 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:14.958 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:40:15.060 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:40:15.108 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:15.230 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:40:15.234 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:15.235 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:40:15.285 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:40:15.286 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2021-10-08T19:40:15.286 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2021-10-08T19:40:15.287 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2021-10-08T19:40:15.287 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.287 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:137826 8.9 8:9aba77ae:::benchmark_data_smithi097_144160_object49086:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e255)", 2021-10-08T19:40:15.287 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:30:31.671622+0000", 2021-10-08T19:40:15.287 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 583.61021755299998, 2021-10-08T19:40:15.288 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.166700311, 2021-10-08T19:40:15.288 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:40:15.288 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2021-10-08T19:40:15.288 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:40:15.289 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:40:15.289 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:40:15.289 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 137826 2021-10-08T19:40:15.289 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.289 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:40:15.290 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.290 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:40:15.290 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.671622+0000", 2021-10-08T19:40:15.290 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:15.290 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.291 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.291 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:40:15.291 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.671622+0000", 2021-10-08T19:40:15.291 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:15.292 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.292 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.292 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:40:15.292 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.671620+0000", 2021-10-08T19:40:15.292 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:40:15.293 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.293 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.293 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:40:15.293 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.671628+0000", 2021-10-08T19:40:15.294 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.1310000000000006e-06 2021-10-08T19:40:15.295 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.295 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.295 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:40:15.295 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.671640+0000", 2021-10-08T19:40:15.296 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2164000000000001e-05 2021-10-08T19:40:15.296 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.296 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.296 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:40:15.296 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.671647+0000", 2021-10-08T19:40:15.297 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8159999999999996e-06 2021-10-08T19:40:15.297 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.297 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.297 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:15.298 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.671725+0000", 2021-10-08T19:40:15.298 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8860000000000001e-05 2021-10-08T19:40:15.298 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.298 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.299 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:40:15.299 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.671871+0000", 2021-10-08T19:40:15.299 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014539500000000001 2021-10-08T19:40:15.299 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.299 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.300 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,5", 2021-10-08T19:40:15.300 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.672016+0000", 2021-10-08T19:40:15.300 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014515799999999999 2021-10-08T19:40:15.300 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.301 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.301 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:40:15.301 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.678831+0000", 2021-10-08T19:40:15.301 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0068148089999999998 2021-10-08T19:40:15.301 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.302 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.302 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:15.302 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.691132+0000", 2021-10-08T19:40:15.302 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012300963999999999 2021-10-08T19:40:15.303 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.303 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.303 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for peered", 2021-10-08T19:40:15.303 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.691139+0000", 2021-10-08T19:40:15.303 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0049999999999998e-06 2021-10-08T19:40:15.304 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.304 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.304 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:15.304 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:32.677752+0000", 2021-10-08T19:40:15.305 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.986613517 2021-10-08T19:40:15.305 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.305 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.305 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for peered", 2021-10-08T19:40:15.305 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:32.677762+0000", 2021-10-08T19:40:15.306 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9399999999999997e-06 2021-10-08T19:40:15.306 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.306 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.306 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:15.307 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.820420+0000", 2021-10-08T19:40:15.307 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1426576310000001 2021-10-08T19:40:15.307 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.307 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.307 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for missing object", 2021-10-08T19:40:15.308 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.820516+0000", 2021-10-08T19:40:15.308 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6328000000000003e-05 2021-10-08T19:40:15.308 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.308 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.308 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:15.309 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.838200+0000", 2021-10-08T19:40:15.309 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017683616999999999 2021-10-08T19:40:15.309 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.309 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.310 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:40:15.310 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.838322+0000", 2021-10-08T19:40:15.310 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000122378 2021-10-08T19:40:15.310 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:15.311 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:40:15.311 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:15.311 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.311 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.311 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:137840 8.9 8:9a45754b:::benchmark_data_smithi097_144160_object49100:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e256)", 2021-10-08T19:40:15.312 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:30:31.700515+0000", 2021-10-08T19:40:15.312 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 583.58132438799998, 2021-10-08T19:40:15.312 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1395049070000001, 2021-10-08T19:40:15.312 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:40:15.313 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:40:15.313 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:40:15.313 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:40:15.313 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:40:15.313 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 137840 2021-10-08T19:40:15.314 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.314 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:40:15.314 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.314 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:40:15.315 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.700515+0000", 2021-10-08T19:40:15.315 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:15.315 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.315 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.315 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:40:15.316 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.700515+0000", 2021-10-08T19:40:15.316 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:15.316 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.316 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.317 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:40:15.317 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.700513+0000", 2021-10-08T19:40:15.317 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:40:15.317 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.317 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.318 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:40:15.318 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.700520+0000", 2021-10-08T19:40:15.318 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.9940000000000003e-06 2021-10-08T19:40:15.318 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.319 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.319 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:40:15.319 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.700531+0000", 2021-10-08T19:40:15.319 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1068e-05 2021-10-08T19:40:15.319 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.320 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.320 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:40:15.320 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.700538+0000", 2021-10-08T19:40:15.320 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.131e-06 2021-10-08T19:40:15.320 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.321 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.321 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:15.321 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.700578+0000", 2021-10-08T19:40:15.321 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9786000000000002e-05 2021-10-08T19:40:15.321 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.322 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.322 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for peered", 2021-10-08T19:40:15.322 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.700584+0000", 2021-10-08T19:40:15.322 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1190000000000002e-06 2021-10-08T19:40:15.322 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.323 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.323 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:15.323 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:32.677784+0000", 2021-10-08T19:40:15.323 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.97719966199999997 2021-10-08T19:40:15.324 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.324 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.324 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for peered", 2021-10-08T19:40:15.324 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:32.677790+0000", 2021-10-08T19:40:15.324 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9510000000000003e-06 2021-10-08T19:40:15.325 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.325 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.325 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:15.325 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.820745+0000", 2021-10-08T19:40:15.325 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1429549269999999 2021-10-08T19:40:15.326 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.326 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.326 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:40:15.326 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.820836+0000", 2021-10-08T19:40:15.327 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.1749000000000005e-05 2021-10-08T19:40:15.327 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.327 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.327 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,3,5", 2021-10-08T19:40:15.327 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.821174+0000", 2021-10-08T19:40:15.328 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00033794899999999999 2021-10-08T19:40:15.328 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.328 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.328 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:40:15.328 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.828109+0000", 2021-10-08T19:40:15.329 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0069349219999999996 2021-10-08T19:40:15.329 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.329 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.329 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:15.330 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.828171+0000", 2021-10-08T19:40:15.330 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1371000000000006e-05 2021-10-08T19:40:15.330 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.330 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.330 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:15.331 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.838452+0000", 2021-10-08T19:40:15.331 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010281327999999999 2021-10-08T19:40:15.331 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.331 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.332 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:15.332 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.839817+0000", 2021-10-08T19:40:15.332 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013653199999999999 2021-10-08T19:40:15.332 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.332 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.333 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:40:15.333 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.839875+0000", 2021-10-08T19:40:15.333 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7399999999999999e-05 2021-10-08T19:40:15.333 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.333 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.334 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:40:15.334 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.840020+0000", 2021-10-08T19:40:15.334 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014520700000000001 2021-10-08T19:40:15.334 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:15.335 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:40:15.335 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:15.335 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.335 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.335 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:137857 8.9 8:93f36960:::benchmark_data_smithi097_144160_object49117:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e256)", 2021-10-08T19:40:15.336 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:30:31.713065+0000", 2021-10-08T19:40:15.336 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 583.56877419199998, 2021-10-08T19:40:15.336 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1272139019999998, 2021-10-08T19:40:15.336 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:40:15.336 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:40:15.337 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:40:15.337 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:40:15.337 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:40:15.337 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 137857 2021-10-08T19:40:15.338 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.338 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:40:15.338 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.338 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:40:15.338 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.713065+0000", 2021-10-08T19:40:15.339 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:15.339 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.339 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.339 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:40:15.339 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.713065+0000", 2021-10-08T19:40:15.340 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:15.340 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.340 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.340 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:40:15.341 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.713062+0000", 2021-10-08T19:40:15.341 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999971 2021-10-08T19:40:15.341 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.341 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.341 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:40:15.342 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.713072+0000", 2021-10-08T19:40:15.342 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.1740000000000006e-06 2021-10-08T19:40:15.342 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.342 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.342 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:40:15.343 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.713090+0000", 2021-10-08T19:40:15.343 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8770000000000002e-05 2021-10-08T19:40:15.343 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.343 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.344 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:40:15.344 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.713098+0000", 2021-10-08T19:40:15.344 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6760000000000007e-06 2021-10-08T19:40:15.344 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.344 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.345 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:15.345 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.713154+0000", 2021-10-08T19:40:15.345 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5893000000000002e-05 2021-10-08T19:40:15.345 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.345 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.346 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for peered", 2021-10-08T19:40:15.346 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.713165+0000", 2021-10-08T19:40:15.346 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1269e-05 2021-10-08T19:40:15.346 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.347 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.347 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:15.347 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:32.677808+0000", 2021-10-08T19:40:15.347 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.964642314 2021-10-08T19:40:15.347 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.348 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.348 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for peered", 2021-10-08T19:40:15.348 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:32.677813+0000", 2021-10-08T19:40:15.348 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.755e-06 2021-10-08T19:40:15.348 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.349 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.349 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:15.349 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.823829+0000", 2021-10-08T19:40:15.349 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1460159540000001 2021-10-08T19:40:15.350 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.350 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.350 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:40:15.350 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.823919+0000", 2021-10-08T19:40:15.351 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9611999999999995e-05 2021-10-08T19:40:15.352 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.352 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.352 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,3,5", 2021-10-08T19:40:15.353 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.824006+0000", 2021-10-08T19:40:15.353 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.7213999999999995e-05 2021-10-08T19:40:15.354 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.354 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.355 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:15.355 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.828209+0000", 2021-10-08T19:40:15.356 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004203137 2021-10-08T19:40:15.356 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.356 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.357 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:40:15.357 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.828217+0000", 2021-10-08T19:40:15.358 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2039999999999997e-06 2021-10-08T19:40:15.358 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.359 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.359 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:15.359 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.838525+0000", 2021-10-08T19:40:15.360 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010307363999999999 2021-10-08T19:40:15.360 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.361 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.361 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:15.362 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.840093+0000", 2021-10-08T19:40:15.362 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0015684710000000001 2021-10-08T19:40:15.363 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.363 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.364 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:40:15.364 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.840152+0000", 2021-10-08T19:40:15.365 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9191000000000003e-05 2021-10-08T19:40:15.365 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.366 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.366 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:40:15.367 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.840279+0000", 2021-10-08T19:40:15.367 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012667700000000001 2021-10-08T19:40:15.367 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:15.368 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:40:15.368 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:15.369 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.369 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.370 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:137858 8.9 8:9dbdeebe:::benchmark_data_smithi097_144160_object49118:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e256)", 2021-10-08T19:40:15.370 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:30:31.713112+0000", 2021-10-08T19:40:15.371 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 583.56872778699994, 2021-10-08T19:40:15.371 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1326835399999999, 2021-10-08T19:40:15.371 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:40:15.372 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:40:15.373 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:40:15.374 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:40:15.374 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:40:15.374 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 137858 2021-10-08T19:40:15.375 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.375 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:40:15.375 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.375 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:40:15.376 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.713112+0000", 2021-10-08T19:40:15.377 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:15.377 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.377 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.378 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:40:15.378 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.713112+0000", 2021-10-08T19:40:15.378 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:15.378 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.379 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.379 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:40:15.380 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.713111+0000", 2021-10-08T19:40:15.380 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:40:15.380 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.380 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.380 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:40:15.381 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.713115+0000", 2021-10-08T19:40:15.381 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0409999999999999e-06 2021-10-08T19:40:15.381 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.381 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.382 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:40:15.382 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.713129+0000", 2021-10-08T19:40:15.382 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4307999999999999e-05 2021-10-08T19:40:15.382 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.382 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.383 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:40:15.383 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.713282+0000", 2021-10-08T19:40:15.383 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000153239 2021-10-08T19:40:15.383 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.383 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.384 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:15.384 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.713333+0000", 2021-10-08T19:40:15.384 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0828999999999997e-05 2021-10-08T19:40:15.385 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.385 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.385 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for peered", 2021-10-08T19:40:15.385 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.713341+0000", 2021-10-08T19:40:15.385 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2449999999999998e-06 2021-10-08T19:40:15.386 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.386 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.386 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:15.386 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:32.677830+0000", 2021-10-08T19:40:15.387 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.96448898999999999 2021-10-08T19:40:15.387 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.387 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.388 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for peered", 2021-10-08T19:40:15.388 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:32.677836+0000", 2021-10-08T19:40:15.388 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6720000000000001e-06 2021-10-08T19:40:15.389 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.389 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.389 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:15.389 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.825817+0000", 2021-10-08T19:40:15.390 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1479806450000001 2021-10-08T19:40:15.390 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.390 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.390 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:40:15.391 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.825971+0000", 2021-10-08T19:40:15.391 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015410599999999999 2021-10-08T19:40:15.391 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.391 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.392 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,3,5", 2021-10-08T19:40:15.393 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.826139+0000", 2021-10-08T19:40:15.393 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016776700000000001 2021-10-08T19:40:15.393 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.393 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.394 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:15.394 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.828257+0000", 2021-10-08T19:40:15.394 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021187889999999998 2021-10-08T19:40:15.394 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.395 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.395 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:40:15.395 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.829840+0000", 2021-10-08T19:40:15.395 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001583026 2021-10-08T19:40:15.396 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.396 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.396 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:15.397 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.838577+0000", 2021-10-08T19:40:15.397 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0087363790000000007 2021-10-08T19:40:15.397 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.397 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.398 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:15.398 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.845641+0000", 2021-10-08T19:40:15.398 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0070641860000000001 2021-10-08T19:40:15.398 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.399 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.399 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:40:15.399 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.845689+0000", 2021-10-08T19:40:15.400 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8282000000000003e-05 2021-10-08T19:40:15.400 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.400 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.400 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:40:15.400 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.845795+0000", 2021-10-08T19:40:15.401 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000105902 2021-10-08T19:40:15.401 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:15.401 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:40:15.401 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:15.402 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.402 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.402 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:137902 8.9 8:915a9f96:::benchmark_data_smithi097_144160_object49162:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e256)", 2021-10-08T19:40:15.402 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:30:31.762130+0000", 2021-10-08T19:40:15.403 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 583.51970954800004, 2021-10-08T19:40:15.403 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0839035209999999, 2021-10-08T19:40:15.404 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:40:15.404 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:40:15.404 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:40:15.404 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:40:15.404 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:40:15.405 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 137902 2021-10-08T19:40:15.405 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.405 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:40:15.406 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.406 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:40:15.406 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.762130+0000", 2021-10-08T19:40:15.407 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:15.407 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.407 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.407 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:40:15.407 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.762130+0000", 2021-10-08T19:40:15.408 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:15.408 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.408 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.409 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:40:15.409 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.762128+0000", 2021-10-08T19:40:15.409 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:40:15.410 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.410 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.410 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:40:15.410 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.762134+0000", 2021-10-08T19:40:15.411 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3879999999999997e-06 2021-10-08T19:40:15.411 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.411 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.411 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:40:15.411 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.762146+0000", 2021-10-08T19:40:15.412 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1518999999999999e-05 2021-10-08T19:40:15.412 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.412 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.412 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:40:15.412 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.762150+0000", 2021-10-08T19:40:15.413 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.6090000000000003e-06 2021-10-08T19:40:15.413 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.414 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.414 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:15.414 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.762189+0000", 2021-10-08T19:40:15.414 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8754000000000002e-05 2021-10-08T19:40:15.414 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.415 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.415 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for peered", 2021-10-08T19:40:15.415 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.762196+0000", 2021-10-08T19:40:15.415 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5409999999999997e-06 2021-10-08T19:40:15.416 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.416 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.416 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:15.416 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:32.677853+0000", 2021-10-08T19:40:15.416 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.91565775999999999 2021-10-08T19:40:15.417 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.417 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.418 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for peered", 2021-10-08T19:40:15.418 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:32.677859+0000", 2021-10-08T19:40:15.419 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6470000000000003e-06 2021-10-08T19:40:15.419 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.420 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.420 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:15.420 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.828282+0000", 2021-10-08T19:40:15.420 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1504229800000001 2021-10-08T19:40:15.421 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.421 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.421 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:40:15.421 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.828366+0000", 2021-10-08T19:40:15.422 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4053000000000003e-05 2021-10-08T19:40:15.422 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.422 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.422 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,3,5", 2021-10-08T19:40:15.422 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.828456+0000", 2021-10-08T19:40:15.423 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9507999999999998e-05 2021-10-08T19:40:15.423 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.423 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.423 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:15.424 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.831393+0000", 2021-10-08T19:40:15.424 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0029371039999999998 2021-10-08T19:40:15.424 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.424 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.425 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:40:15.425 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.831416+0000", 2021-10-08T19:40:15.425 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3218999999999999e-05 2021-10-08T19:40:15.425 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.425 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.426 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:15.426 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.838633+0000", 2021-10-08T19:40:15.426 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0072170960000000001 2021-10-08T19:40:15.426 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.426 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.427 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:15.427 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.845847+0000", 2021-10-08T19:40:15.427 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0072138139999999998 2021-10-08T19:40:15.427 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.428 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.428 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:40:15.428 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.845898+0000", 2021-10-08T19:40:15.428 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0714999999999998e-05 2021-10-08T19:40:15.428 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.429 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.429 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:40:15.429 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.846033+0000", 2021-10-08T19:40:15.429 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013580600000000001 2021-10-08T19:40:15.429 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:15.430 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:40:15.430 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:15.430 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.430 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.431 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:137906 8.9 8:9b87594c:::benchmark_data_smithi097_144160_object49166:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e256)", 2021-10-08T19:40:15.431 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:30:31.770274+0000", 2021-10-08T19:40:15.431 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 583.51156527299997, 2021-10-08T19:40:15.431 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.082185452, 2021-10-08T19:40:15.431 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:40:15.432 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:40:15.432 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:40:15.432 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:40:15.432 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:40:15.432 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 137906 2021-10-08T19:40:15.433 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.433 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:40:15.433 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.433 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:40:15.434 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.770274+0000", 2021-10-08T19:40:15.434 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:15.434 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.434 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.434 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:40:15.435 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.770274+0000", 2021-10-08T19:40:15.435 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:15.435 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.435 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.435 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:40:15.436 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.770271+0000", 2021-10-08T19:40:15.436 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999967 2021-10-08T19:40:15.436 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.436 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.437 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:40:15.437 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.770284+0000", 2021-10-08T19:40:15.437 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3769e-05 2021-10-08T19:40:15.437 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.437 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.438 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:40:15.438 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.770317+0000", 2021-10-08T19:40:15.438 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2137000000000001e-05 2021-10-08T19:40:15.438 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.438 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.439 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:40:15.439 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.770330+0000", 2021-10-08T19:40:15.439 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3852999999999999e-05 2021-10-08T19:40:15.439 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.439 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.440 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:15.440 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.770453+0000", 2021-10-08T19:40:15.440 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000122514 2021-10-08T19:40:15.440 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.441 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.441 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for peered", 2021-10-08T19:40:15.441 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:31.770490+0000", 2021-10-08T19:40:15.441 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7045000000000002e-05 2021-10-08T19:40:15.441 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.442 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.442 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:15.442 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:32.677877+0000", 2021-10-08T19:40:15.442 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.90738696399999996 2021-10-08T19:40:15.442 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.443 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.443 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for peered", 2021-10-08T19:40:15.443 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:32.677883+0000", 2021-10-08T19:40:15.443 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6219999999999997e-06 2021-10-08T19:40:15.444 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.444 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.444 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:15.444 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.829875+0000", 2021-10-08T19:40:15.444 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.151992699 2021-10-08T19:40:15.445 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.445 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.445 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:40:15.445 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.830011+0000", 2021-10-08T19:40:15.445 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013545699999999999 2021-10-08T19:40:15.446 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.446 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.446 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,3,5", 2021-10-08T19:40:15.446 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.830169+0000", 2021-10-08T19:40:15.446 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015829599999999999 2021-10-08T19:40:15.447 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.447 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.447 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:40:15.447 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.831517+0000", 2021-10-08T19:40:15.448 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001348349 2021-10-08T19:40:15.448 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.448 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.448 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:15.448 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.831796+0000", 2021-10-08T19:40:15.449 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00027892800000000001 2021-10-08T19:40:15.449 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.449 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.449 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:15.449 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.838701+0000", 2021-10-08T19:40:15.450 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0069042729999999998 2021-10-08T19:40:15.450 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.450 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.450 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:15.450 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.852281+0000", 2021-10-08T19:40:15.451 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013580539000000001 2021-10-08T19:40:15.451 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.451 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.451 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:40:15.452 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.852339+0000", 2021-10-08T19:40:15.452 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7491999999999998e-05 2021-10-08T19:40:15.452 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.452 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.452 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:40:15.453 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:33.852460+0000", 2021-10-08T19:40:15.453 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000120975 2021-10-08T19:40:15.453 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:15.453 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:40:15.453 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:15.454 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.454 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.454 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:153473 8.9 8:941ef2fd:::benchmark_data_smithi097_144160_object64733:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e265)", 2021-10-08T19:40:15.454 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:30:50.613472+0000", 2021-10-08T19:40:15.455 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 564.66836752699999, 2021-10-08T19:40:15.455 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0813083269999999, 2021-10-08T19:40:15.455 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:40:15.455 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2021-10-08T19:40:15.455 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:40:15.456 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:40:15.456 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:40:15.456 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 153473 2021-10-08T19:40:15.456 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.456 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:40:15.457 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.457 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:40:15.457 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.613472+0000", 2021-10-08T19:40:15.457 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:15.458 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.458 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.458 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:40:15.458 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.613472+0000", 2021-10-08T19:40:15.458 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:15.459 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.459 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.459 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:40:15.459 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.613471+0000", 2021-10-08T19:40:15.459 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:40:15.460 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.460 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.460 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:40:15.460 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.613478+0000", 2021-10-08T19:40:15.461 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3030000000000002e-06 2021-10-08T19:40:15.461 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.461 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.461 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:40:15.461 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.613484+0000", 2021-10-08T19:40:15.462 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4840000000000001e-06 2021-10-08T19:40:15.462 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.462 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.462 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:40:15.462 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.613490+0000", 2021-10-08T19:40:15.463 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7440000000000004e-06 2021-10-08T19:40:15.463 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.463 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.463 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:15.463 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.619719+0000", 2021-10-08T19:40:15.464 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0062289679999999997 2021-10-08T19:40:15.464 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.464 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.465 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:40:15.465 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.619859+0000", 2021-10-08T19:40:15.465 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013937800000000001 2021-10-08T19:40:15.465 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.466 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.466 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,3,5", 2021-10-08T19:40:15.466 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.619985+0000", 2021-10-08T19:40:15.466 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012626099999999999 2021-10-08T19:40:15.466 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.467 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.467 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:40:15.467 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.623056+0000", 2021-10-08T19:40:15.467 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0030707260000000002 2021-10-08T19:40:15.467 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.468 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.468 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:15.468 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.626524+0000", 2021-10-08T19:40:15.468 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003468006 2021-10-08T19:40:15.469 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.469 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.469 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:15.469 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.627006+0000", 2021-10-08T19:40:15.469 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00048212400000000001 2021-10-08T19:40:15.470 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.470 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.470 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:15.470 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.644146+0000", 2021-10-08T19:40:15.471 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017140407999999999 2021-10-08T19:40:15.471 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.471 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.471 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for peered", 2021-10-08T19:40:15.471 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.644151+0000", 2021-10-08T19:40:15.472 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5560000000000001e-06 2021-10-08T19:40:15.472 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.472 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.472 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:15.472 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.694696+0000", 2021-10-08T19:40:15.473 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.050545721 2021-10-08T19:40:15.473 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.473 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.473 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:40:15.473 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.694780+0000", 2021-10-08T19:40:15.474 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3871999999999999e-05 2021-10-08T19:40:15.474 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:15.474 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:40:15.474 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:15.475 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.475 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.475 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:153500 8.9 8:96f9f00a:::benchmark_data_smithi097_144160_object64760:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e266)", 2021-10-08T19:40:15.475 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:30:50.643453+0000", 2021-10-08T19:40:15.475 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 564.63838646099998, 2021-10-08T19:40:15.476 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.064962492, 2021-10-08T19:40:15.476 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:40:15.476 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:40:15.476 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:40:15.477 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:40:15.477 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:40:15.477 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 153500 2021-10-08T19:40:15.477 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.478 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:40:15.478 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.478 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:40:15.478 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.643453+0000", 2021-10-08T19:40:15.479 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:15.479 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.479 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.479 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:40:15.479 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.643453+0000", 2021-10-08T19:40:15.480 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:15.480 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.480 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.480 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:40:15.480 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.643452+0000", 2021-10-08T19:40:15.481 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999995 2021-10-08T19:40:15.481 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.481 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.481 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:40:15.482 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.643455+0000", 2021-10-08T19:40:15.482 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.1549999999999999e-06 2021-10-08T19:40:15.482 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.483 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.483 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:40:15.483 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.643466+0000", 2021-10-08T19:40:15.483 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0659000000000001e-05 2021-10-08T19:40:15.484 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.484 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.484 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:40:15.484 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.643471+0000", 2021-10-08T19:40:15.485 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4769999999999997e-06 2021-10-08T19:40:15.485 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.485 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.485 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:15.485 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.644161+0000", 2021-10-08T19:40:15.486 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00069033899999999999 2021-10-08T19:40:15.486 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.486 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.486 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for peered", 2021-10-08T19:40:15.486 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.644164+0000", 2021-10-08T19:40:15.487 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.112e-06 2021-10-08T19:40:15.487 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.487 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.487 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:15.488 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.695214+0000", 2021-10-08T19:40:15.488 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.05104953 2021-10-08T19:40:15.488 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.488 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.488 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:40:15.489 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.695318+0000", 2021-10-08T19:40:15.489 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000104101 2021-10-08T19:40:15.489 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.489 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.489 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,3", 2021-10-08T19:40:15.490 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.695455+0000", 2021-10-08T19:40:15.490 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013753300000000001 2021-10-08T19:40:15.490 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.490 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.491 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:15.491 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.703887+0000", 2021-10-08T19:40:15.491 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0084321459999999997 2021-10-08T19:40:15.491 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.491 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.492 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:40:15.492 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.708199+0000", 2021-10-08T19:40:15.492 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0043118820000000004 2021-10-08T19:40:15.492 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.492 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.493 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:15.493 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.708314+0000", 2021-10-08T19:40:15.493 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000114537 2021-10-08T19:40:15.493 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.494 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.494 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:40:15.494 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.708370+0000", 2021-10-08T19:40:15.494 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5906999999999999e-05 2021-10-08T19:40:15.494 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.495 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.495 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:40:15.495 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.708415+0000", 2021-10-08T19:40:15.495 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5773999999999999e-05 2021-10-08T19:40:15.495 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:15.496 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:40:15.496 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:15.496 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.496 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.497 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:153508 8.9 8:9acac7e6:::benchmark_data_smithi097_144160_object64768:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e266)", 2021-10-08T19:40:15.497 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:30:50.654476+0000", 2021-10-08T19:40:15.497 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 564.627363371, 2021-10-08T19:40:15.497 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.05408868, 2021-10-08T19:40:15.497 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:40:15.498 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:40:15.498 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:40:15.498 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:40:15.499 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:40:15.499 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 153508 2021-10-08T19:40:15.499 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.499 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:40:15.499 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.500 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:40:15.500 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.654476+0000", 2021-10-08T19:40:15.500 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:15.500 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.500 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.501 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:40:15.501 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.654476+0000", 2021-10-08T19:40:15.501 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:15.501 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.501 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.502 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:40:15.502 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.654474+0000", 2021-10-08T19:40:15.502 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:40:15.502 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.503 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.503 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:40:15.503 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.654483+0000", 2021-10-08T19:40:15.503 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.8529999999999998e-06 2021-10-08T19:40:15.503 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.504 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.504 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:40:15.504 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.654502+0000", 2021-10-08T19:40:15.504 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9105000000000001e-05 2021-10-08T19:40:15.504 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.505 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.505 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:40:15.505 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.654510+0000", 2021-10-08T19:40:15.505 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9340000000000006e-06 2021-10-08T19:40:15.505 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.506 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.506 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:15.506 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.654583+0000", 2021-10-08T19:40:15.506 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2928000000000004e-05 2021-10-08T19:40:15.507 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.507 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.507 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for peered", 2021-10-08T19:40:15.507 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.654592+0000", 2021-10-08T19:40:15.507 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9539999999999993e-06 2021-10-08T19:40:15.508 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.508 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.508 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:15.508 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.697949+0000", 2021-10-08T19:40:15.508 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0433576710000001 2021-10-08T19:40:15.509 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.509 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.509 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:40:15.509 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.698079+0000", 2021-10-08T19:40:15.509 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012980199999999999 2021-10-08T19:40:15.510 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.510 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.510 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,3", 2021-10-08T19:40:15.510 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.698472+0000", 2021-10-08T19:40:15.511 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00039300799999999997 2021-10-08T19:40:15.511 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.511 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.511 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:40:15.511 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.708207+0000", 2021-10-08T19:40:15.512 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097354090000000004 2021-10-08T19:40:15.512 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.512 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.512 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:15.513 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.708265+0000", 2021-10-08T19:40:15.513 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7618999999999998e-05 2021-10-08T19:40:15.513 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.513 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.513 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:15.514 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.708515+0000", 2021-10-08T19:40:15.514 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00024970299999999999 2021-10-08T19:40:15.514 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.514 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.514 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:40:15.515 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.708543+0000", 2021-10-08T19:40:15.515 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.817e-05 2021-10-08T19:40:15.515 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.515 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.515 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:40:15.516 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.708565+0000", 2021-10-08T19:40:15.516 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1806000000000001e-05 2021-10-08T19:40:15.516 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:15.516 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:40:15.517 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:15.517 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.517 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.517 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:153511 8.9 8:9cbdb6f5:::benchmark_data_smithi097_144160_object64771:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e266)", 2021-10-08T19:40:15.517 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:30:50.662390+0000", 2021-10-08T19:40:15.518 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 564.61944933500001, 2021-10-08T19:40:15.518 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.05116802, 2021-10-08T19:40:15.518 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:40:15.518 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:40:15.518 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:40:15.519 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:40:15.519 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:40:15.519 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 153511 2021-10-08T19:40:15.519 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.520 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:40:15.520 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.520 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:40:15.520 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.662390+0000", 2021-10-08T19:40:15.520 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:15.521 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.521 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.521 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:40:15.521 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.662390+0000", 2021-10-08T19:40:15.521 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:15.522 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.522 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.522 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:40:15.522 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.662388+0000", 2021-10-08T19:40:15.522 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:40:15.523 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.523 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.523 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:40:15.523 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.662395+0000", 2021-10-08T19:40:15.524 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3660000000000003e-06 2021-10-08T19:40:15.524 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.524 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.524 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:40:15.524 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.662406+0000", 2021-10-08T19:40:15.525 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0567999999999999e-05 2021-10-08T19:40:15.525 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.525 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.525 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:40:15.525 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.662410+0000", 2021-10-08T19:40:15.526 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7149999999999997e-06 2021-10-08T19:40:15.526 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.526 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.526 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:15.527 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.662476+0000", 2021-10-08T19:40:15.527 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5372999999999999e-05 2021-10-08T19:40:15.527 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.527 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.527 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for peered", 2021-10-08T19:40:15.528 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.662485+0000", 2021-10-08T19:40:15.528 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.4669999999999993e-06 2021-10-08T19:40:15.528 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.528 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.528 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:15.529 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.701789+0000", 2021-10-08T19:40:15.529 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.039303243 2021-10-08T19:40:15.529 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.529 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.529 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:40:15.530 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.701925+0000", 2021-10-08T19:40:15.530 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000136525 2021-10-08T19:40:15.530 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.530 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.531 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,3", 2021-10-08T19:40:15.531 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.702056+0000", 2021-10-08T19:40:15.531 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000130679 2021-10-08T19:40:15.531 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.531 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.532 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:40:15.532 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.708215+0000", 2021-10-08T19:40:15.532 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0061597049999999997 2021-10-08T19:40:15.532 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.532 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.533 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:15.533 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.708475+0000", 2021-10-08T19:40:15.533 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00025967500000000001 2021-10-08T19:40:15.533 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.533 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.534 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:15.534 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.713448+0000", 2021-10-08T19:40:15.534 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049727920000000002 2021-10-08T19:40:15.534 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.535 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.535 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:40:15.535 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.713514+0000", 2021-10-08T19:40:15.535 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6526999999999995e-05 2021-10-08T19:40:15.535 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.536 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.536 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:40:15.536 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.713558+0000", 2021-10-08T19:40:15.536 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.3686000000000002e-05 2021-10-08T19:40:15.536 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:15.537 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:40:15.537 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:15.537 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.537 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.537 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:153513 8.9 8:9fdef309:::benchmark_data_smithi097_144160_object64773:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e266)", 2021-10-08T19:40:15.538 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:30:50.662421+0000", 2021-10-08T19:40:15.538 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 564.61941815, 2021-10-08T19:40:15.538 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.051246388, 2021-10-08T19:40:15.538 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:40:15.539 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:40:15.539 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:40:15.539 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:40:15.539 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:40:15.539 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 153513 2021-10-08T19:40:15.540 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.540 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:40:15.540 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.540 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:40:15.540 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.662421+0000", 2021-10-08T19:40:15.541 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:15.541 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.541 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.541 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:40:15.541 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.662421+0000", 2021-10-08T19:40:15.542 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:15.542 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.542 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.542 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:40:15.543 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.662421+0000", 2021-10-08T19:40:15.543 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999995 2021-10-08T19:40:15.543 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.543 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.543 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:40:15.544 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.662423+0000", 2021-10-08T19:40:15.544 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6860000000000002e-06 2021-10-08T19:40:15.544 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.544 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.544 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:40:15.545 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.662431+0000", 2021-10-08T19:40:15.545 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1210000000000001e-06 2021-10-08T19:40:15.545 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.545 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.545 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:40:15.546 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.662434+0000", 2021-10-08T19:40:15.546 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4359999999999998e-06 2021-10-08T19:40:15.546 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.546 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.547 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:15.547 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.664720+0000", 2021-10-08T19:40:15.547 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022865020000000002 2021-10-08T19:40:15.547 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.547 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.548 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for peered", 2021-10-08T19:40:15.548 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.664731+0000", 2021-10-08T19:40:15.548 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.061e-05 2021-10-08T19:40:15.548 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.548 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.549 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:15.549 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.703943+0000", 2021-10-08T19:40:15.549 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0392120279999999 2021-10-08T19:40:15.549 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.549 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.550 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:40:15.550 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.704060+0000", 2021-10-08T19:40:15.550 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000117377 2021-10-08T19:40:15.550 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.551 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.551 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,3", 2021-10-08T19:40:15.551 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.704193+0000", 2021-10-08T19:40:15.551 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013231899999999999 2021-10-08T19:40:15.551 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.552 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.552 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:40:15.552 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.708429+0000", 2021-10-08T19:40:15.552 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042360189999999997 2021-10-08T19:40:15.552 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.553 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.553 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:15.553 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.713589+0000", 2021-10-08T19:40:15.553 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0051600439999999999 2021-10-08T19:40:15.553 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.554 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.554 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:15.554 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.713615+0000", 2021-10-08T19:40:15.554 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6267000000000001e-05 2021-10-08T19:40:15.555 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.555 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.555 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:40:15.555 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.713644+0000", 2021-10-08T19:40:15.555 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8617000000000001e-05 2021-10-08T19:40:15.556 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.556 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.556 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:40:15.556 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.713668+0000", 2021-10-08T19:40:15.556 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3955e-05 2021-10-08T19:40:15.557 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:15.557 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:40:15.557 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:15.557 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.558 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.558 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:153519 8.9 8:99337a2d:::benchmark_data_smithi097_144160_object64779:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e266)", 2021-10-08T19:40:15.558 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:30:50.669907+0000", 2021-10-08T19:40:15.558 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 564.61193196700003, 2021-10-08T19:40:15.558 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0438780379999999, 2021-10-08T19:40:15.559 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:40:15.559 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:40:15.559 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:40:15.559 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:40:15.559 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:40:15.560 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 153519 2021-10-08T19:40:15.560 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.560 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:40:15.560 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.560 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:40:15.561 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.669907+0000", 2021-10-08T19:40:15.561 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:15.561 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.561 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.562 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:40:15.562 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.669907+0000", 2021-10-08T19:40:15.562 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:15.562 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.562 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.563 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:40:15.563 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.669905+0000", 2021-10-08T19:40:15.563 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:40:15.563 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.563 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.564 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:40:15.564 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.669913+0000", 2021-10-08T19:40:15.564 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.52e-06 2021-10-08T19:40:15.564 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.565 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.565 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:40:15.565 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.669929+0000", 2021-10-08T19:40:15.565 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6251000000000001e-05 2021-10-08T19:40:15.566 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.566 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.566 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:40:15.566 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.669936+0000", 2021-10-08T19:40:15.567 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1770000000000001e-06 2021-10-08T19:40:15.567 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.567 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.567 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:15.567 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.669992+0000", 2021-10-08T19:40:15.568 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6073000000000003e-05 2021-10-08T19:40:15.568 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.568 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.568 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for peered", 2021-10-08T19:40:15.568 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.669999+0000", 2021-10-08T19:40:15.569 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7950000000000002e-06 2021-10-08T19:40:15.569 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.569 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.569 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:15.569 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.706094+0000", 2021-10-08T19:40:15.570 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.036095169 2021-10-08T19:40:15.570 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.570 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.570 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:40:15.571 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.706209+0000", 2021-10-08T19:40:15.571 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011464 2021-10-08T19:40:15.571 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.571 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.571 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,3", 2021-10-08T19:40:15.572 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.706336+0000", 2021-10-08T19:40:15.572 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000127124 2021-10-08T19:40:15.572 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.572 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.572 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:40:15.573 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.713677+0000", 2021-10-08T19:40:15.573 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0073407059999999998 2021-10-08T19:40:15.573 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.573 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.573 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:15.574 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.713713+0000", 2021-10-08T19:40:15.574 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6211000000000003e-05 2021-10-08T19:40:15.574 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.574 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.575 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:15.575 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.713739+0000", 2021-10-08T19:40:15.575 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5721999999999999e-05 2021-10-08T19:40:15.575 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.575 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.576 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:40:15.576 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.713762+0000", 2021-10-08T19:40:15.576 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3311000000000001e-05 2021-10-08T19:40:15.576 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.576 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.577 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:40:15.577 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.713786+0000", 2021-10-08T19:40:15.577 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3538999999999999e-05 2021-10-08T19:40:15.577 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:15.578 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:40:15.578 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:15.578 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.578 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.578 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:153521 8.9 8:946ba086:::benchmark_data_smithi097_144160_object64781:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e266)", 2021-10-08T19:40:15.579 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:30:50.669949+0000", 2021-10-08T19:40:15.579 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 564.61189018699997, 2021-10-08T19:40:15.579 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.043931052, 2021-10-08T19:40:15.579 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:40:15.579 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:40:15.580 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:40:15.580 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:40:15.580 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:40:15.580 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 153521 2021-10-08T19:40:15.581 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.581 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:40:15.581 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.581 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:40:15.581 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.669949+0000", 2021-10-08T19:40:15.582 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:15.582 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.582 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.582 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:40:15.582 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.669949+0000", 2021-10-08T19:40:15.583 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:15.583 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.583 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.584 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:40:15.584 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.669948+0000", 2021-10-08T19:40:15.584 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:40:15.584 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.584 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.585 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:40:15.585 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.669953+0000", 2021-10-08T19:40:15.585 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2819999999999998e-06 2021-10-08T19:40:15.585 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.585 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.586 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:40:15.586 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.669961+0000", 2021-10-08T19:40:15.586 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0209999999999999e-06 2021-10-08T19:40:15.586 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.587 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.587 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:40:15.587 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.669964+0000", 2021-10-08T19:40:15.587 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.1329999999999999e-06 2021-10-08T19:40:15.587 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.588 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.588 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:15.588 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.670011+0000", 2021-10-08T19:40:15.588 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.6943000000000001e-05 2021-10-08T19:40:15.588 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.589 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.589 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for peered", 2021-10-08T19:40:15.589 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.670014+0000", 2021-10-08T19:40:15.589 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9000000000000002e-06 2021-10-08T19:40:15.589 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.590 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.590 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:15.590 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.708600+0000", 2021-10-08T19:40:15.590 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0385866319999999 2021-10-08T19:40:15.591 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.591 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.591 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:40:15.591 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.708705+0000", 2021-10-08T19:40:15.591 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000104691 2021-10-08T19:40:15.592 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.592 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.592 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,3", 2021-10-08T19:40:15.592 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.708810+0000", 2021-10-08T19:40:15.592 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010542 2021-10-08T19:40:15.593 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.593 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.593 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:40:15.593 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.713682+0000", 2021-10-08T19:40:15.594 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0048714609999999997 2021-10-08T19:40:15.594 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.594 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.594 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:15.594 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.713813+0000", 2021-10-08T19:40:15.595 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000131187 2021-10-08T19:40:15.595 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.595 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.595 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:15.595 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.713837+0000", 2021-10-08T19:40:15.596 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4355e-05 2021-10-08T19:40:15.596 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.596 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.596 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:40:15.597 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.713859+0000", 2021-10-08T19:40:15.597 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1838e-05 2021-10-08T19:40:15.597 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.597 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.597 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:40:15.598 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.713880+0000", 2021-10-08T19:40:15.598 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1090999999999998e-05 2021-10-08T19:40:15.598 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:15.598 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:40:15.599 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:15.599 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.599 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.599 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:153543 8.9 8:95c1d208:::benchmark_data_smithi097_144160_object64803:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e266)", 2021-10-08T19:40:15.600 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:30:50.691241+0000", 2021-10-08T19:40:15.600 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 564.59059889399998, 2021-10-08T19:40:15.600 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.022748386, 2021-10-08T19:40:15.600 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:40:15.600 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:40:15.601 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:40:15.601 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:40:15.601 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:40:15.601 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 153543 2021-10-08T19:40:15.601 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.602 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:40:15.602 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.602 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:40:15.602 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.691241+0000", 2021-10-08T19:40:15.603 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:15.603 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.603 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.603 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:40:15.603 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.691241+0000", 2021-10-08T19:40:15.604 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:15.604 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.604 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.604 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:40:15.604 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.691238+0000", 2021-10-08T19:40:15.605 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:40:15.605 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.605 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.605 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:40:15.605 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.691246+0000", 2021-10-08T19:40:15.606 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.525e-06 2021-10-08T19:40:15.606 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.606 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.606 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:40:15.607 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.691260+0000", 2021-10-08T19:40:15.607 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3709999999999999e-05 2021-10-08T19:40:15.607 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.607 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.607 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:40:15.608 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.691267+0000", 2021-10-08T19:40:15.608 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1439999999999997e-06 2021-10-08T19:40:15.608 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.608 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.609 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:15.609 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.691321+0000", 2021-10-08T19:40:15.609 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.3891000000000003e-05 2021-10-08T19:40:15.609 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.609 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.610 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for peered", 2021-10-08T19:40:15.610 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.691329+0000", 2021-10-08T19:40:15.610 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6920000000000008e-06 2021-10-08T19:40:15.610 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.611 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.611 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:15.611 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.711139+0000", 2021-10-08T19:40:15.611 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.019809602 2021-10-08T19:40:15.611 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.612 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.612 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:40:15.612 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.711266+0000", 2021-10-08T19:40:15.612 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012736600000000001 2021-10-08T19:40:15.612 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.613 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.613 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,3", 2021-10-08T19:40:15.613 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.711401+0000", 2021-10-08T19:40:15.613 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013464999999999999 2021-10-08T19:40:15.614 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.614 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.614 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:40:15.614 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.713687+0000", 2021-10-08T19:40:15.614 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022856840000000001 2021-10-08T19:40:15.615 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.615 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.615 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:15.615 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.713921+0000", 2021-10-08T19:40:15.615 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00023449500000000001 2021-10-08T19:40:15.616 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.616 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.616 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:15.616 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.713949+0000", 2021-10-08T19:40:15.617 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.758e-05 2021-10-08T19:40:15.617 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.617 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.617 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:40:15.617 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.713969+0000", 2021-10-08T19:40:15.618 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0438e-05 2021-10-08T19:40:15.618 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.618 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.618 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:40:15.618 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.713989+0000", 2021-10-08T19:40:15.619 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9879999999999999e-05 2021-10-08T19:40:15.619 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:15.619 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:40:15.619 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:15.620 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.620 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.620 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:153591 8.9 8:9d18c1f1:::benchmark_data_smithi097_144160_object64851:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e266)", 2021-10-08T19:40:15.620 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:30:50.745318+0000", 2021-10-08T19:40:15.620 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 564.53652147800005, 2021-10-08T19:40:15.621 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.99413427799999998, 2021-10-08T19:40:15.621 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:40:15.621 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:40:15.621 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:40:15.621 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:40:15.622 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:40:15.622 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 153591 2021-10-08T19:40:15.622 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.622 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:40:15.622 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.623 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:40:15.623 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.745318+0000", 2021-10-08T19:40:15.623 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:15.623 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.624 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.624 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:40:15.624 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.745318+0000", 2021-10-08T19:40:15.624 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:15.624 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.625 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.625 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:40:15.625 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.745315+0000", 2021-10-08T19:40:15.625 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999971 2021-10-08T19:40:15.626 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.626 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.626 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:40:15.626 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.745325+0000", 2021-10-08T19:40:15.626 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.73e-06 2021-10-08T19:40:15.627 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.627 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.627 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:40:15.627 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.745342+0000", 2021-10-08T19:40:15.627 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7523000000000001e-05 2021-10-08T19:40:15.628 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.628 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.628 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:40:15.628 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.745351+0000", 2021-10-08T19:40:15.628 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3829999999999992e-06 2021-10-08T19:40:15.629 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.629 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.629 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:15.629 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.745399+0000", 2021-10-08T19:40:15.630 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8653000000000003e-05 2021-10-08T19:40:15.630 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.630 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.630 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for peered", 2021-10-08T19:40:15.630 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.745413+0000", 2021-10-08T19:40:15.631 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3635000000000001e-05 2021-10-08T19:40:15.631 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.631 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.631 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:15.632 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.714013+0000", 2021-10-08T19:40:15.632 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.96859971499999997 2021-10-08T19:40:15.632 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.632 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.632 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:40:15.633 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.714086+0000", 2021-10-08T19:40:15.633 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.381e-05 2021-10-08T19:40:15.633 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.633 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.634 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,3", 2021-10-08T19:40:15.634 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.714200+0000", 2021-10-08T19:40:15.634 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000114004 2021-10-08T19:40:15.634 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.634 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.635 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:15.635 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.733258+0000", 2021-10-08T19:40:15.635 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019057582999999999 2021-10-08T19:40:15.635 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.636 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.636 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:15.636 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.733324+0000", 2021-10-08T19:40:15.636 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6223000000000006e-05 2021-10-08T19:40:15.637 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.637 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.637 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:40:15.637 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.739345+0000", 2021-10-08T19:40:15.637 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0060205709999999997 2021-10-08T19:40:15.638 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.638 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.638 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:40:15.638 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.739405+0000", 2021-10-08T19:40:15.638 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0142000000000001e-05 2021-10-08T19:40:15.639 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.639 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.639 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:40:15.639 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.739452+0000", 2021-10-08T19:40:15.640 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7287000000000003e-05 2021-10-08T19:40:15.640 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:15.640 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:40:15.640 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:15.640 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.641 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.641 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:153629 8.9 8:9bdfca0d:::benchmark_data_smithi097_144160_object64889:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e266)", 2021-10-08T19:40:15.641 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:30:50.802768+0000", 2021-10-08T19:40:15.641 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 564.47907189800003, 2021-10-08T19:40:15.641 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.93678050800000001, 2021-10-08T19:40:15.642 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:40:15.642 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:40:15.642 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:40:15.642 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:40:15.643 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:40:15.643 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 153629 2021-10-08T19:40:15.643 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.643 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:40:15.643 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.644 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:40:15.644 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.802768+0000", 2021-10-08T19:40:15.644 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:15.644 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.644 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.645 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:40:15.645 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.802768+0000", 2021-10-08T19:40:15.645 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:15.645 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.646 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.646 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:40:15.646 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.802765+0000", 2021-10-08T19:40:15.646 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999971 2021-10-08T19:40:15.646 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.647 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.647 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:40:15.647 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.802775+0000", 2021-10-08T19:40:15.647 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0040999999999999e-05 2021-10-08T19:40:15.647 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.648 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.648 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:40:15.648 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.802793+0000", 2021-10-08T19:40:15.648 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7649e-05 2021-10-08T19:40:15.648 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.649 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.649 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:40:15.649 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.802799+0000", 2021-10-08T19:40:15.649 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5409999999999997e-06 2021-10-08T19:40:15.650 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.650 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.650 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:15.650 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.802837+0000", 2021-10-08T19:40:15.650 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7972999999999997e-05 2021-10-08T19:40:15.651 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.651 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.651 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for peered", 2021-10-08T19:40:15.651 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.802844+0000", 2021-10-08T19:40:15.651 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0079999999999996e-06 2021-10-08T19:40:15.652 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.652 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.652 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:15.652 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.716490+0000", 2021-10-08T19:40:15.652 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.91364543300000001 2021-10-08T19:40:15.653 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.653 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.653 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:40:15.653 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.716620+0000", 2021-10-08T19:40:15.654 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013011199999999999 2021-10-08T19:40:15.654 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.654 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.654 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,3", 2021-10-08T19:40:15.654 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.716738+0000", 2021-10-08T19:40:15.655 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000118454 2021-10-08T19:40:15.655 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.655 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.655 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:15.655 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.733293+0000", 2021-10-08T19:40:15.656 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016554698 2021-10-08T19:40:15.656 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.656 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.656 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:15.657 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.733396+0000", 2021-10-08T19:40:15.657 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103231 2021-10-08T19:40:15.657 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.657 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.657 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:40:15.658 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.739473+0000", 2021-10-08T19:40:15.658 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0060773210000000001 2021-10-08T19:40:15.658 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.658 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.658 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:40:15.659 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.739512+0000", 2021-10-08T19:40:15.659 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8807999999999998e-05 2021-10-08T19:40:15.659 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.659 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.660 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:40:15.660 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.739548+0000", 2021-10-08T19:40:15.660 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.5902000000000003e-05 2021-10-08T19:40:15.660 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:15.660 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:40:15.661 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:15.661 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.661 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.661 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:153648 8.9 8:93d8c490:::benchmark_data_smithi097_144160_object64908:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e266)", 2021-10-08T19:40:15.662 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:30:50.827951+0000", 2021-10-08T19:40:15.662 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 564.45388809300005, 2021-10-08T19:40:15.662 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.91168046999999997, 2021-10-08T19:40:15.662 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:40:15.662 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:40:15.663 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:40:15.663 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:40:15.663 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:40:15.663 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 153648 2021-10-08T19:40:15.664 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.664 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:40:15.664 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.664 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:40:15.664 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.827951+0000", 2021-10-08T19:40:15.665 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:15.665 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.665 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.666 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:40:15.666 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.827951+0000", 2021-10-08T19:40:15.666 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:15.666 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.666 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.667 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:40:15.667 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.827949+0000", 2021-10-08T19:40:15.667 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:40:15.667 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.668 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.668 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:40:15.668 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.827957+0000", 2021-10-08T19:40:15.668 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0469999999999994e-06 2021-10-08T19:40:15.668 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.669 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.669 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:40:15.669 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.827972+0000", 2021-10-08T19:40:15.669 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4276e-05 2021-10-08T19:40:15.669 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.670 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.670 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:40:15.670 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.827979+0000", 2021-10-08T19:40:15.670 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1609999999999997e-06 2021-10-08T19:40:15.671 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.671 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.671 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:15.671 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.828038+0000", 2021-10-08T19:40:15.671 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9636999999999998e-05 2021-10-08T19:40:15.672 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.672 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.672 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for peered", 2021-10-08T19:40:15.672 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.828048+0000", 2021-10-08T19:40:15.672 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.893e-06 2021-10-08T19:40:15.673 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.673 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.673 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:15.673 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.718864+0000", 2021-10-08T19:40:15.674 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.89081596900000004 2021-10-08T19:40:15.674 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.674 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.674 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:40:15.674 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.718947+0000", 2021-10-08T19:40:15.675 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2168000000000003e-05 2021-10-08T19:40:15.675 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.675 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.675 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,3", 2021-10-08T19:40:15.676 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.719021+0000", 2021-10-08T19:40:15.676 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.428e-05 2021-10-08T19:40:15.676 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.676 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.676 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:15.677 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.733357+0000", 2021-10-08T19:40:15.677 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014336385 2021-10-08T19:40:15.677 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.677 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.677 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:15.678 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.733480+0000", 2021-10-08T19:40:15.678 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000122736 2021-10-08T19:40:15.678 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.678 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.679 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:40:15.679 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.739557+0000", 2021-10-08T19:40:15.679 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00607743 2021-10-08T19:40:15.679 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:40:15.681 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.681 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.681 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:40:15.682 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.739596+0000", 2021-10-08T19:40:15.682 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8164000000000003e-05 2021-10-08T19:40:15.682 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.682 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.683 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:40:15.683 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.739632+0000", 2021-10-08T19:40:15.683 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6329999999999999e-05 2021-10-08T19:40:15.683 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:15.683 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:40:15.684 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:15.684 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.684 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.685 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:153649 8.9 8:98a9f9c0:::benchmark_data_smithi097_144160_object64909:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e266)", 2021-10-08T19:40:15.685 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:30:50.827990+0000", 2021-10-08T19:40:15.685 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 564.45384903199999, 2021-10-08T19:40:15.685 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.91172655800000002, 2021-10-08T19:40:15.686 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:40:15.686 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:40:15.686 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:40:15.687 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:40:15.687 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:40:15.687 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 153649 2021-10-08T19:40:15.688 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.688 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:40:15.689 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.689 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:40:15.689 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.827990+0000", 2021-10-08T19:40:15.690 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:15.690 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.690 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.691 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:40:15.691 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.827990+0000", 2021-10-08T19:40:15.691 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:15.692 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.692 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.692 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:40:15.693 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.827990+0000", 2021-10-08T19:40:15.693 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:40:15.693 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.694 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.694 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:40:15.694 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.827994+0000", 2021-10-08T19:40:15.694 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.844e-06 2021-10-08T19:40:15.695 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.695 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.695 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:40:15.695 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.828002+0000", 2021-10-08T19:40:15.696 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2810000000000008e-06 2021-10-08T19:40:15.696 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.696 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.696 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:40:15.696 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.828006+0000", 2021-10-08T19:40:15.697 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.6430000000000003e-06 2021-10-08T19:40:15.697 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.697 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.697 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:15.698 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.828083+0000", 2021-10-08T19:40:15.698 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6148000000000003e-05 2021-10-08T19:40:15.698 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.698 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.698 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for peered", 2021-10-08T19:40:15.699 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.828092+0000", 2021-10-08T19:40:15.699 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8169999999999994e-06 2021-10-08T19:40:15.699 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.700 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.700 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:15.700 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.720747+0000", 2021-10-08T19:40:15.701 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.89265469600000003 2021-10-08T19:40:15.701 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.701 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.701 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:40:15.701 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.720870+0000", 2021-10-08T19:40:15.702 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000122843 2021-10-08T19:40:15.702 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.702 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.702 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,3", 2021-10-08T19:40:15.703 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.720980+0000", 2021-10-08T19:40:15.703 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000110103 2021-10-08T19:40:15.703 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.703 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.703 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:15.704 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.733432+0000", 2021-10-08T19:40:15.704 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01245199 2021-10-08T19:40:15.704 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.704 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.705 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:15.705 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.733544+0000", 2021-10-08T19:40:15.705 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112243 2021-10-08T19:40:15.705 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.705 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.706 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:40:15.706 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.739643+0000", 2021-10-08T19:40:15.706 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0060982429999999997 2021-10-08T19:40:15.706 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.706 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.707 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:40:15.707 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.739682+0000", 2021-10-08T19:40:15.707 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9759999999999999e-05 2021-10-08T19:40:15.707 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.708 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.708 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:40:15.708 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.739717+0000", 2021-10-08T19:40:15.708 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4709999999999998e-05 2021-10-08T19:40:15.709 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:15.709 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:40:15.709 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:15.709 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.709 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.710 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:153657 8.9 8:9d6618f9:::benchmark_data_smithi097_144160_object64917:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e266)", 2021-10-08T19:40:15.710 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:30:50.839226+0000", 2021-10-08T19:40:15.710 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 564.44261324199999, 2021-10-08T19:40:15.710 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.90057461699999997, 2021-10-08T19:40:15.711 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:40:15.711 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:40:15.711 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:40:15.711 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:40:15.712 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:40:15.712 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 153657 2021-10-08T19:40:15.713 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.714 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:40:15.714 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.714 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:40:15.714 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.839226+0000", 2021-10-08T19:40:15.715 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:15.715 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.715 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.715 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:40:15.715 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.839226+0000", 2021-10-08T19:40:15.716 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:15.716 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.716 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.716 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:40:15.717 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.839224+0000", 2021-10-08T19:40:15.717 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:40:15.717 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.717 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.717 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:40:15.718 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.839232+0000", 2021-10-08T19:40:15.718 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9400000000000002e-06 2021-10-08T19:40:15.718 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.718 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.719 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:40:15.719 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.839248+0000", 2021-10-08T19:40:15.719 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6282000000000001e-05 2021-10-08T19:40:15.719 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.719 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.720 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:40:15.720 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.839256+0000", 2021-10-08T19:40:15.720 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8879999999999997e-06 2021-10-08T19:40:15.720 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.720 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.721 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:15.721 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.839305+0000", 2021-10-08T19:40:15.721 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8931999999999998e-05 2021-10-08T19:40:15.721 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.722 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.722 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for peered", 2021-10-08T19:40:15.722 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.839311+0000", 2021-10-08T19:40:15.722 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5139999999999998e-06 2021-10-08T19:40:15.722 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.723 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.723 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:15.723 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.723229+0000", 2021-10-08T19:40:15.723 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.883917277 2021-10-08T19:40:15.723 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.724 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.724 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:40:15.724 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.723326+0000", 2021-10-08T19:40:15.724 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7447000000000004e-05 2021-10-08T19:40:15.724 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.725 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.725 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,3", 2021-10-08T19:40:15.725 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.723434+0000", 2021-10-08T19:40:15.725 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010813499999999999 2021-10-08T19:40:15.726 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.726 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.726 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:15.726 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.733511+0000", 2021-10-08T19:40:15.726 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010076754 2021-10-08T19:40:15.727 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.727 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.727 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:15.727 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.733617+0000", 2021-10-08T19:40:15.728 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010569 2021-10-08T19:40:15.728 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.728 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.728 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:40:15.728 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.739728+0000", 2021-10-08T19:40:15.729 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0061108589999999997 2021-10-08T19:40:15.729 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.729 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.729 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:40:15.729 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.739766+0000", 2021-10-08T19:40:15.730 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8075999999999999e-05 2021-10-08T19:40:15.730 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.730 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.730 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:40:15.731 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.739801+0000", 2021-10-08T19:40:15.731 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.5222999999999998e-05 2021-10-08T19:40:15.731 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:15.731 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:40:15.732 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:15.732 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.732 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.732 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15147.0:153683 8.9 8:911724a8:::benchmark_data_smithi097_144160_object64943:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e266)", 2021-10-08T19:40:15.732 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:30:50.880164+0000", 2021-10-08T19:40:15.733 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 564.40167543500002, 2021-10-08T19:40:15.733 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.859722188, 2021-10-08T19:40:15.733 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:40:15.733 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:40:15.733 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:40:15.734 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15147", 2021-10-08T19:40:15.734 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/2212302972", 2021-10-08T19:40:15.734 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 153683 2021-10-08T19:40:15.734 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.735 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:40:15.735 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.735 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:40:15.736 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.880164+0000", 2021-10-08T19:40:15.736 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:15.736 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.737 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.737 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:40:15.737 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.880164+0000", 2021-10-08T19:40:15.737 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:15.737 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.738 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.738 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:40:15.738 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.880162+0000", 2021-10-08T19:40:15.738 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:40:15.739 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.739 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.739 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:40:15.740 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.880171+0000", 2021-10-08T19:40:15.740 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.2799999999999992e-06 2021-10-08T19:40:15.740 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.740 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.740 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:40:15.741 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.880187+0000", 2021-10-08T19:40:15.741 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6427999999999999e-05 2021-10-08T19:40:15.741 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.741 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.741 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:40:15.742 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.880195+0000", 2021-10-08T19:40:15.742 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4050000000000003e-06 2021-10-08T19:40:15.742 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.742 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.743 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:15.743 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.880238+0000", 2021-10-08T19:40:15.743 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.3414000000000001e-05 2021-10-08T19:40:15.743 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.743 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.744 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for peered", 2021-10-08T19:40:15.744 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:50.880247+0000", 2021-10-08T19:40:15.744 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6570000000000003e-06 2021-10-08T19:40:15.744 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.744 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.745 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:15.745 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.725736+0000", 2021-10-08T19:40:15.745 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.84548944599999998 2021-10-08T19:40:15.745 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.745 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.746 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:40:15.746 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.725839+0000", 2021-10-08T19:40:15.746 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103015 2021-10-08T19:40:15.746 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.746 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.747 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,3", 2021-10-08T19:40:15.747 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.725953+0000", 2021-10-08T19:40:15.747 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000113774 2021-10-08T19:40:15.747 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.747 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.748 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:15.748 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.733583+0000", 2021-10-08T19:40:15.748 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0076303719999999998 2021-10-08T19:40:15.748 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.749 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.749 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:15.749 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.733681+0000", 2021-10-08T19:40:15.749 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7734999999999999e-05 2021-10-08T19:40:15.749 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.750 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.750 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:40:15.750 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.739812+0000", 2021-10-08T19:40:15.750 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0061307749999999998 2021-10-08T19:40:15.750 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.751 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.751 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:40:15.751 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.739851+0000", 2021-10-08T19:40:15.751 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8742999999999998e-05 2021-10-08T19:40:15.751 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:15.752 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:15.752 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:40:15.752 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:30:51.739886+0000", 2021-10-08T19:40:15.752 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.5618999999999999e-05 2021-10-08T19:40:15.752 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:15.753 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:40:15.753 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:15.753 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:15.753 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:40:15.753 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:40:15.755 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd reweight 4 1 2021-10-08T19:40:15.755 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 66 16 90633 90617 85.7772 65.875 0.0148076 0.0116529 2021-10-08T19:40:15.860 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:16.006 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:40:16.011 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:16.012 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:40:16.113 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:40:16.177 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:16.284 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:40:16.298 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:16 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:40:16.298 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:16 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:40:16.298 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:16 smithi097 ceph-mon[32687]: pgmap v946: 188 pgs: 188 active+clean; 5.4 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.1 KiB/s rd, 72 MiB/s wr, 1.15k op/s 2021-10-08T19:40:16.298 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:16 smithi097 ceph-mon[32687]: osdmap e461: 8 total, 8 up, 8 in 2021-10-08T19:40:16.299 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:16 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:40:16.299 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:16 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:40:16.300 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:16 smithi097 ceph-mon[41966]: pgmap v946: 188 pgs: 188 active+clean; 5.4 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.1 KiB/s rd, 72 MiB/s wr, 1.15k op/s 2021-10-08T19:40:16.300 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:16 smithi097 ceph-mon[41966]: osdmap e461: 8 total, 8 up, 8 in 2021-10-08T19:40:16.301 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:16.301 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:16 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:40:16.301 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:16 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:40:16.302 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:16 smithi117 ceph-mon[34585]: pgmap v946: 188 pgs: 188 active+clean; 5.4 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.1 KiB/s rd, 72 MiB/s wr, 1.15k op/s 2021-10-08T19:40:16.302 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:16 smithi117 ceph-mon[34585]: osdmap e461: 8 total, 8 up, 8 in 2021-10-08T19:40:16.303 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:40:16.304 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2021-10-08T19:40:16.341 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:40:16.377 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:40:16.405 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:40:16.420 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:40:16.439 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:16.458 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:40:16.494 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:40:16.512 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:40:16.519 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:16.520 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:40:16.540 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:40:16.573 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:40:16.614 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:40:16.621 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:40:16.649 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:40:16.664 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'false' 2021-10-08T19:40:16.664 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'false' 2021-10-08T19:40:16.664 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'false' 2021-10-08T19:40:16.664 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'false' 2021-10-08T19:40:16.665 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'false' 2021-10-08T19:40:16.665 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'false' 2021-10-08T19:40:16.665 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'false' 2021-10-08T19:40:16.666 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'false' 2021-10-08T19:40:16.666 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:16.695 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 67 16 91514 91498 85.3188 55.0625 0.0110125 0.0117164 2021-10-08T19:40:16.738 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:40:16.796 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:40:16.799 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:16.800 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:40:16.901 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:40:16.935 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:17.010 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:40:17.013 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:17.014 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:40:17.116 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:40:17.169 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:17.252 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:40:17.257 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:17.258 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:40:17.260 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:17 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2304943516' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:40:17.360 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:40:17.405 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:17.463 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:17 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2304943516' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:40:17.463 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:17 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2304943516' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:40:17.657 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:40:17 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:40:17.689 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:40:17.691 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 68 16 92620 92604 85.0807 69.125 0.013571 0.0117493 2021-10-08T19:40:17.694 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:17.695 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:40:17.758 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set nodeep-scrub 2021-10-08T19:40:17.797 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:40:17.835 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:17.899 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:40:17.900 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:17.901 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:40:18.003 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:40:18.034 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:18 smithi117 ceph-mon[34585]: pgmap v948: 188 pgs: 188 active+clean; 5.4 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.2 KiB/s rd, 63 MiB/s wr, 1.01k op/s 2021-10-08T19:40:18.035 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:18 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:40:18.048 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:18.110 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:40:18.112 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:18.114 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:40:18.219 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:40:18.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:18 smithi097 ceph-mon[32687]: pgmap v948: 188 pgs: 188 active+clean; 5.4 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.2 KiB/s rd, 63 MiB/s wr, 1.01k op/s 2021-10-08T19:40:18.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:18 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:40:18.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:18 smithi097 ceph-mon[41966]: pgmap v948: 188 pgs: 188 active+clean; 5.4 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.2 KiB/s rd, 63 MiB/s wr, 1.01k op/s 2021-10-08T19:40:18.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:18 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:40:18.277 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:18.671 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:40:18.692 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 69 16 93679 93663 84.8056 66.1875 0.0155275 0.0117867 2021-10-08T19:40:18.703 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:40:18.709 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:18.710 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:40:18.811 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:40:18.868 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:19.031 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2021-10-08T19:40:19.032 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:40:19.051 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:19 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:40:19.052 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:19 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:40:19.057 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:40:19.065 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:19.066 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:40:19.167 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:40:19.226 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:19.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:19 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:40:19.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:19 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:40:19.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:19 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:40:19.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:19 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:40:19.492 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:40:19.501 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:19.501 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:40:19.602 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:40:19.636 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:19.693 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 70 16 94577 94561 84.3957 56.125 0.0129019 0.011844 2021-10-08T19:40:19.702 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:40:19.704 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:19.705 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:40:19.806 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:40:19.834 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:19.927 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2021-10-08T19:40:20.045 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:40:20.051 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:20.051 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:40:20.062 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2021-10-08T19:40:20.093 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.4 to 1 (10000) 2021-10-08T19:40:20.153 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:40:20.215 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:20 smithi097 ceph-mon[32687]: pgmap v949: 188 pgs: 188 active+clean; 5.6 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 639 B/s rd, 57 MiB/s wr, 909 op/s 2021-10-08T19:40:20.215 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:20 smithi097 ceph-mon[32687]: osdmap e462: 8 total, 8 up, 8 in 2021-10-08T19:40:20.216 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:20 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3005214333' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2021-10-08T19:40:20.216 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:20 smithi097 ceph-mon[41966]: pgmap v949: 188 pgs: 188 active+clean; 5.6 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 639 B/s rd, 57 MiB/s wr, 909 op/s 2021-10-08T19:40:20.216 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:20 smithi097 ceph-mon[41966]: osdmap e462: 8 total, 8 up, 8 in 2021-10-08T19:40:20.217 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:20 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3005214333' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2021-10-08T19:40:20.225 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:20.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:20 smithi117 ceph-mon[34585]: pgmap v949: 188 pgs: 188 active+clean; 5.6 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 639 B/s rd, 57 MiB/s wr, 909 op/s 2021-10-08T19:40:20.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:20 smithi117 ceph-mon[34585]: osdmap e462: 8 total, 8 up, 8 in 2021-10-08T19:40:20.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:20 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3005214333' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2021-10-08T19:40:20.483 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:40:20.693 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 71 16 95659 95643 84.1594 67.625 0.00349645 0.0118776 2021-10-08T19:40:21.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:21 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3005214333' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]': finished 2021-10-08T19:40:21.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:21 smithi117 ceph-mon[34585]: osdmap e463: 8 total, 8 up, 8 in 2021-10-08T19:40:21.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:21 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3005214333' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]': finished 2021-10-08T19:40:21.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:21 smithi097 ceph-mon[41966]: osdmap e463: 8 total, 8 up, 8 in 2021-10-08T19:40:21.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:21 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3005214333' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]': finished 2021-10-08T19:40:21.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:21 smithi097 ceph-mon[32687]: osdmap e463: 8 total, 8 up, 8 in 2021-10-08T19:40:21.537 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:40:21.545 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:21.546 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:40:21.647 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:40:21.679 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:21.693 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 72 16 96627 96611 83.8309 60.5 0.00958907 0.0119245 2021-10-08T19:40:21.744 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:40:21.748 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:21.749 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:40:21.851 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:40:21.877 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:40:21.881 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:21.920 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd reweight 5 1 2021-10-08T19:40:22.171 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:40:22.176 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:22.177 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:40:22.213 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:22 smithi097 ceph-mon[32687]: pgmap v952: 188 pgs: 188 active+clean; 5.7 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 852 B/s rd, 52 MiB/s wr, 840 op/s 2021-10-08T19:40:22.214 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:22 smithi097 ceph-mon[41966]: pgmap v952: 188 pgs: 188 active+clean; 5.7 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 852 B/s rd, 52 MiB/s wr, 840 op/s 2021-10-08T19:40:22.279 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:40:22.364 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:22.405 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:40:22 smithi117 conmon[69189]: level=error ts=2021-10-08T19:40:22.314Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=1 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:40:22.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:22 smithi117 ceph-mon[34585]: pgmap v952: 188 pgs: 188 active+clean; 5.7 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 852 B/s rd, 52 MiB/s wr, 840 op/s 2021-10-08T19:40:22.638 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:40:22.646 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:22.647 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:40:22.693 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 73 16 97496 97480 83.4265 54.3125 0.0158655 0.0119826 2021-10-08T19:40:22.738 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2021-10-08T19:40:22.739 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:40:22.748 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:40:22.812 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:22.973 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:40:22 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:40:22] "GET /metrics HTTP/1.1" 200 155912 "" "Prometheus/2.18.1" 2021-10-08T19:40:22.993 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:40:22.998 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:22.999 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:40:23.043 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:40:23.083 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:23 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3895888863' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:40:23.084 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:23 smithi117 ceph-mon[34585]: from='client.36263 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:40:23.084 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:23 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:40:23.100 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:40:23.124 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is set 2021-10-08T19:40:23.130 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:23.470 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:40:22 smithi097 conmon[33110]: 172.21.15.97 - - [08/Oct/2021:19:40:22] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:40:23.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:23 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3895888863' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:40:23.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:23 smithi097 ceph-mon[32687]: from='client.36263 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:40:23.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:23 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:40:23.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:23 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3895888863' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:40:23.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:23 smithi097 ceph-mon[41966]: from='client.36263 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:40:23.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:23 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:40:23.695 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 74 16 98392 98376 83.0558 56 0.00348179 0.0120246 2021-10-08T19:40:24.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:24 smithi117 ceph-mon[34585]: pgmap v953: 188 pgs: 188 active+clean; 5.7 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 642 B/s rd, 40 MiB/s wr, 632 op/s 2021-10-08T19:40:24.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:24 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:40:24.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:24 smithi117 ceph-mon[34585]: 172.21.15.97 - - [08/Oct/2021:19:40:22] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:40:24.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:24 smithi117 ceph-mon[34585]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:40:24.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:24 smithi117 ceph-mon[34585]: from='client.36263 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:40:24.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:24 smithi117 ceph-mon[34585]: osdmap e464: 8 total, 8 up, 8 in 2021-10-08T19:40:24.159 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:40:23 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:40:23] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:40:24.241 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:40:24.245 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:24.246 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:40:24.348 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:40:24.383 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2021-10-08T19:40:24.393 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:24 smithi097 ceph-mon[32687]: pgmap v953: 188 pgs: 188 active+clean; 5.7 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 642 B/s rd, 40 MiB/s wr, 632 op/s 2021-10-08T19:40:24.394 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:24 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:40:24.394 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:24 smithi097 ceph-mon[32687]: 172.21.15.97 - - [08/Oct/2021:19:40:22] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:40:24.395 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:24 smithi097 ceph-mon[32687]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:40:24.395 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:24 smithi097 ceph-mon[32687]: from='client.36263 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:40:24.395 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:24 smithi097 ceph-mon[32687]: osdmap e464: 8 total, 8 up, 8 in 2021-10-08T19:40:24.396 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:24 smithi097 ceph-mon[41966]: pgmap v953: 188 pgs: 188 active+clean; 5.7 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 642 B/s rd, 40 MiB/s wr, 632 op/s 2021-10-08T19:40:24.396 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:24 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:40:24.396 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:24 smithi097 ceph-mon[41966]: 172.21.15.97 - - [08/Oct/2021:19:40:22] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:40:24.397 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:24 smithi097 ceph-mon[41966]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:40:24.397 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:24 smithi097 ceph-mon[41966]: from='client.36263 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:40:24.397 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:24 smithi097 ceph-mon[41966]: osdmap e464: 8 total, 8 up, 8 in 2021-10-08T19:40:24.401 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:24.690 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:40:24.694 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 75 16 99330 99314 82.7293 58.625 0.00759153 0.0120834 2021-10-08T19:40:24.694 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:24.695 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:40:24.799 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:40:24.858 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:24.947 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:40:24.953 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:24.953 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:40:25.055 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:40:25.073 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:40:25.104 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:25.170 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:40:25.179 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:25.179 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:40:25.200 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:25 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:40:25.200 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:25 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:40:25.201 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:25 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:40:25.201 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:25 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:40:25.280 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:40:25.323 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:25 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:40:25.323 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:25 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:40:25.324 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:25.405 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:40:25.409 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:25.409 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:40:25.453 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:40:25.494 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:40:25.511 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:40:25.536 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:40:25.554 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:25.575 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:40:25.613 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:40:25.644 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:40:25.654 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:40:25.656 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:25.657 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:40:25.687 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:40:25.694 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 76 16 100309 100293 82.4459 61.1875 0.0189781 0.0121246 2021-10-08T19:40:25.719 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:40:25.727 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true' 2021-10-08T19:40:25.727 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true' 2021-10-08T19:40:25.728 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true' 2021-10-08T19:40:25.728 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true' 2021-10-08T19:40:25.728 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true' 2021-10-08T19:40:25.728 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true' 2021-10-08T19:40:25.729 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'true' 2021-10-08T19:40:25.729 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'true' 2021-10-08T19:40:25.760 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:40:25.792 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:25.872 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:40:25.877 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:25.877 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:40:25.978 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:40:26.012 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:26.121 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:26 smithi097 ceph-mon[41966]: pgmap v955: 188 pgs: 188 active+clean; 6.0 GiB data, 21 GiB used, 695 GiB / 715 GiB avail; 1.7 KiB/s rd, 78 MiB/s wr, 1.25k op/s 2021-10-08T19:40:26.121 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:26 smithi097 ceph-mon[41966]: osdmap e465: 8 total, 8 up, 8 in 2021-10-08T19:40:26.121 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:26 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2955310275' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:40:26.122 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:26 smithi097 ceph-mon[32687]: pgmap v955: 188 pgs: 188 active+clean; 6.0 GiB data, 21 GiB used, 695 GiB / 715 GiB avail; 1.7 KiB/s rd, 78 MiB/s wr, 1.25k op/s 2021-10-08T19:40:26.122 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:26 smithi097 ceph-mon[32687]: osdmap e465: 8 total, 8 up, 8 in 2021-10-08T19:40:26.122 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:26 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2955310275' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:40:26.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:26 smithi117 ceph-mon[34585]: pgmap v955: 188 pgs: 188 active+clean; 6.0 GiB data, 21 GiB used, 695 GiB / 715 GiB avail; 1.7 KiB/s rd, 78 MiB/s wr, 1.25k op/s 2021-10-08T19:40:26.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:26 smithi117 ceph-mon[34585]: osdmap e465: 8 total, 8 up, 8 in 2021-10-08T19:40:26.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:26 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2955310275' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:40:26.448 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:40:26.451 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:26.452 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:40:26.553 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:40:26.586 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:26.694 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 77 16 101404 101388 82.2639 68.4375 0.00327169 0.0121425 2021-10-08T19:40:26.919 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset noscrub 2021-10-08T19:40:27.453 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:40:27.458 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:27.459 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:40:27.560 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:40:27.595 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:40:27 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:40:27.615 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:27.680 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:40:27.694 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 78 16 102383 102367 81.9937 61.1875 0.0209386 0.0121914 2021-10-08T19:40:27.716 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:40:27.719 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:27.720 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:40:27.821 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:40:27.872 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:28.000 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:40:28.008 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:28.009 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:40:28.110 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:40:28.143 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:28 smithi117 ceph-mon[34585]: pgmap v957: 188 pgs: 188 active+clean; 6.0 GiB data, 21 GiB used, 695 GiB / 715 GiB avail; 739 B/s rd, 42 MiB/s wr, 667 op/s 2021-10-08T19:40:28.144 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:28 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:40:28.144 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:28 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2008804530' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2021-10-08T19:40:28.150 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.5 to 1 (10000) 2021-10-08T19:40:28.172 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:28.236 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:40:28.236 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2021-10-08T19:40:28.236 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2021-10-08T19:40:28.237 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2021-10-08T19:40:28.238 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.238 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.25465.0:50756 9.3 9:cf42c892:::benchmark_data_smithi097_196985_object50755:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e311)", 2021-10-08T19:40:28.238 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:32:15.147588+0000", 2021-10-08T19:40:28.238 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 493.08049140899999, 2021-10-08T19:40:28.239 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.18313448800000001, 2021-10-08T19:40:28.239 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:40:28.239 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:40:28.239 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:40:28.240 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.25465", 2021-10-08T19:40:28.240 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:40:28.240 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 50756 2021-10-08T19:40:28.240 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.240 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:40:28.241 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.241 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:40:28.241 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:15.147588+0000", 2021-10-08T19:40:28.241 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:28.241 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.242 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.242 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:40:28.242 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:15.147588+0000", 2021-10-08T19:40:28.242 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:28.243 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.243 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.243 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:40:28.243 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:15.147587+0000", 2021-10-08T19:40:28.243 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:40:28.244 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.244 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.244 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:40:28.244 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:15.147615+0000", 2021-10-08T19:40:28.245 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8030000000000001e-05 2021-10-08T19:40:28.245 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.245 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.245 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:40:28.246 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:15.147621+0000", 2021-10-08T19:40:28.246 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9399999999999999e-06 2021-10-08T19:40:28.246 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.246 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.247 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:40:28.247 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:15.147625+0000", 2021-10-08T19:40:28.247 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2359999999999998e-06 2021-10-08T19:40:28.247 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.247 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.248 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:28.248 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:15.147679+0000", 2021-10-08T19:40:28.248 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4271999999999998e-05 2021-10-08T19:40:28.248 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.249 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.249 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:40:28.249 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:15.147801+0000", 2021-10-08T19:40:28.249 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000121947 2021-10-08T19:40:28.249 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.251 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.251 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 1,3", 2021-10-08T19:40:28.251 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:15.147941+0000", 2021-10-08T19:40:28.251 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013947100000000001 2021-10-08T19:40:28.251 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.252 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.252 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:40:28.252 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:15.152447+0000", 2021-10-08T19:40:28.252 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0045064459999999999 2021-10-08T19:40:28.253 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.253 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.253 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:28.253 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:15.152700+0000", 2021-10-08T19:40:28.253 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00025262700000000001 2021-10-08T19:40:28.254 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.254 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.254 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:28.254 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:15.330627+0000", 2021-10-08T19:40:28.255 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.17792706699999999 2021-10-08T19:40:28.255 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.255 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.255 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:40:28.255 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:15.330681+0000", 2021-10-08T19:40:28.256 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4188999999999999e-05 2021-10-08T19:40:28.256 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.256 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.256 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:40:28.256 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:15.330722+0000", 2021-10-08T19:40:28.257 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.108e-05 2021-10-08T19:40:28.257 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:28.257 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:40:28.257 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:28.257 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.258 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.258 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:77499 9.5 e316/290 9:ac4969c9:::benchmark_data_smithi097_196985_object77498:head v 316'4760, mlcod=316'4757)", 2021-10-08T19:40:28.258 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:32:38.370431+0000", 2021-10-08T19:40:28.258 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 469.85764804299998, 2021-10-08T19:40:28.259 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.21244118000000001, 2021-10-08T19:40:28.259 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:40:28.259 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:40:28.259 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:40:28.259 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.260 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:40:28.260 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370431+0000", 2021-10-08T19:40:28.260 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:28.260 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.260 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.261 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:40:28.261 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370431+0000", 2021-10-08T19:40:28.261 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:28.261 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.262 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.262 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:40:28.262 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370430+0000", 2021-10-08T19:40:28.262 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:40:28.262 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.263 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.263 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:40:28.264 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370481+0000", 2021-10-08T19:40:28.264 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1430000000000001e-05 2021-10-08T19:40:28.264 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.265 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.265 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:40:28.265 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370492+0000", 2021-10-08T19:40:28.265 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0755e-05 2021-10-08T19:40:28.266 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.266 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.266 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:40:28.266 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370498+0000", 2021-10-08T19:40:28.267 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4869999999999999e-06 2021-10-08T19:40:28.267 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.267 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.267 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:28.267 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370541+0000", 2021-10-08T19:40:28.268 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2460999999999999e-05 2021-10-08T19:40:28.268 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.268 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.268 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:40:28.268 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370559+0000", 2021-10-08T19:40:28.269 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8150000000000001e-05 2021-10-08T19:40:28.269 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.269 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.269 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:40:28.270 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.582843+0000", 2021-10-08T19:40:28.270 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.21228397099999999 2021-10-08T19:40:28.270 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.270 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.270 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:40:28.271 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.582872+0000", 2021-10-08T19:40:28.271 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9221e-05 2021-10-08T19:40:28.271 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:28.271 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:40:28.272 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:28.272 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.272 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.272 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:77507 9.c e316/290 9:3c2e9901:::benchmark_data_smithi097_196985_object77506:head v 316'4807, mlcod=316'4804)", 2021-10-08T19:40:28.273 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:32:38.370481+0000", 2021-10-08T19:40:28.273 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 469.857598295, 2021-10-08T19:40:28.273 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.210201309, 2021-10-08T19:40:28.273 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:40:28.274 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:40:28.274 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:40:28.274 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.274 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:40:28.274 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370481+0000", 2021-10-08T19:40:28.275 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:28.275 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.275 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.275 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:40:28.276 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370481+0000", 2021-10-08T19:40:28.276 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:28.276 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.276 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.276 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:40:28.277 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370480+0000", 2021-10-08T19:40:28.277 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999995 2021-10-08T19:40:28.277 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.277 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.278 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:40:28.278 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370508+0000", 2021-10-08T19:40:28.278 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7653000000000001e-05 2021-10-08T19:40:28.278 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.278 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.279 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:40:28.279 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370514+0000", 2021-10-08T19:40:28.279 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1920000000000002e-06 2021-10-08T19:40:28.279 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.279 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.280 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:40:28.280 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370519+0000", 2021-10-08T19:40:28.280 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.113e-06 2021-10-08T19:40:28.280 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.281 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.281 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:28.281 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370630+0000", 2021-10-08T19:40:28.281 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000110925 2021-10-08T19:40:28.281 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.282 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.282 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:40:28.282 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.370649+0000", 2021-10-08T19:40:28.282 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9063999999999999e-05 2021-10-08T19:40:28.283 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.283 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.283 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:40:28.283 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.377750+0000", 2021-10-08T19:40:28.283 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0071006710000000002 2021-10-08T19:40:28.284 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.284 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.284 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:40:28.284 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580682+0000", 2021-10-08T19:40:28.285 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.202932268 2021-10-08T19:40:28.285 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:28.285 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:40:28.285 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:28.285 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.286 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.286 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:77503 9.5 e316/290 9:a86a20e3:::benchmark_data_smithi097_196985_object77502:head v 316'4761, mlcod=316'4758)", 2021-10-08T19:40:28.286 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:32:38.372458+0000", 2021-10-08T19:40:28.286 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 469.85562116199998, 2021-10-08T19:40:28.287 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.210430539, 2021-10-08T19:40:28.287 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:40:28.287 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:40:28.287 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:40:28.287 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.288 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:40:28.288 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.372458+0000", 2021-10-08T19:40:28.288 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:28.288 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.288 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.289 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:40:28.289 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.372458+0000", 2021-10-08T19:40:28.289 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:28.289 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.290 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.290 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:40:28.290 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.372457+0000", 2021-10-08T19:40:28.290 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:40:28.290 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.291 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.291 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:40:28.291 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.372492+0000", 2021-10-08T19:40:28.291 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.5354000000000001e-05 2021-10-08T19:40:28.291 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.292 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.292 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:40:28.292 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.372502+0000", 2021-10-08T19:40:28.292 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8810000000000008e-06 2021-10-08T19:40:28.293 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.293 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.293 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:40:28.293 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.372508+0000", 2021-10-08T19:40:28.293 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3069999999999999e-06 2021-10-08T19:40:28.294 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.294 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.294 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:28.294 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.372792+0000", 2021-10-08T19:40:28.295 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00028411499999999999 2021-10-08T19:40:28.295 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.295 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.295 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:40:28.295 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.372804+0000", 2021-10-08T19:40:28.296 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2058e-05 2021-10-08T19:40:28.296 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.296 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.296 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:40:28.297 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.582875+0000", 2021-10-08T19:40:28.297 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.210070701 2021-10-08T19:40:28.297 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.297 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.297 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:40:28.298 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.582888+0000", 2021-10-08T19:40:28.298 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3345e-05 2021-10-08T19:40:28.299 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:28.299 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:40:28.299 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:28.300 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.300 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.300 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:77509 9.5 e316/290 9:a04d875b:::benchmark_data_smithi097_196985_object77508:head v 316'4762, mlcod=316'4758)", 2021-10-08T19:40:28.300 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:32:38.373454+0000", 2021-10-08T19:40:28.300 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 469.854624968, 2021-10-08T19:40:28.301 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.20948882399999999, 2021-10-08T19:40:28.301 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:40:28.301 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:40:28.301 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:40:28.302 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.302 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:40:28.302 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.373454+0000", 2021-10-08T19:40:28.302 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:28.303 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.303 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.303 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:40:28.303 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.373454+0000", 2021-10-08T19:40:28.304 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:28.304 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.304 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.304 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:40:28.304 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.373453+0000", 2021-10-08T19:40:28.305 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:40:28.305 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.305 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.305 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:40:28.305 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.373614+0000", 2021-10-08T19:40:28.306 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016036300000000001 2021-10-08T19:40:28.306 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.306 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.307 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:40:28.307 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.373627+0000", 2021-10-08T19:40:28.307 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3759e-05 2021-10-08T19:40:28.307 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.308 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.308 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:40:28.308 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.373631+0000", 2021-10-08T19:40:28.308 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.019e-06 2021-10-08T19:40:28.309 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.309 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.309 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:28.309 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.375396+0000", 2021-10-08T19:40:28.310 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0017641810000000001 2021-10-08T19:40:28.310 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.310 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.310 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:40:28.310 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.375414+0000", 2021-10-08T19:40:28.311 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8949000000000001e-05 2021-10-08T19:40:28.311 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.311 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.311 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:40:28.312 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.582929+0000", 2021-10-08T19:40:28.312 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.20751492799999999 2021-10-08T19:40:28.312 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.312 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.312 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:40:28.313 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.582943+0000", 2021-10-08T19:40:28.313 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3382e-05 2021-10-08T19:40:28.313 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:28.313 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:40:28.313 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:28.314 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.314 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.314 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:77510 9.c e316/290 9:3e9f4d30:::benchmark_data_smithi097_196985_object77509:head v 316'4808, mlcod=316'4804)", 2021-10-08T19:40:28.314 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:32:38.373489+0000", 2021-10-08T19:40:28.315 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 469.85458960800003, 2021-10-08T19:40:28.315 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.20722019899999999, 2021-10-08T19:40:28.315 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:40:28.315 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:40:28.315 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:40:28.316 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.316 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:40:28.316 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.373489+0000", 2021-10-08T19:40:28.316 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:28.317 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.317 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.317 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:40:28.317 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.373489+0000", 2021-10-08T19:40:28.318 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:28.318 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.318 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.319 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:40:28.319 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.373489+0000", 2021-10-08T19:40:28.319 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:40:28.319 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.320 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.320 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:40:28.320 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.373614+0000", 2021-10-08T19:40:28.320 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012516400000000001 2021-10-08T19:40:28.320 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.321 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.321 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:40:28.321 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.373624+0000", 2021-10-08T19:40:28.321 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0078000000000001e-05 2021-10-08T19:40:28.322 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.322 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.322 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:40:28.322 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.373630+0000", 2021-10-08T19:40:28.322 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9349999999999999e-06 2021-10-08T19:40:28.323 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.323 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.323 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:28.323 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.373791+0000", 2021-10-08T19:40:28.324 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016118299999999999 2021-10-08T19:40:28.324 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.324 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.324 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:40:28.324 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.373808+0000", 2021-10-08T19:40:28.325 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7280999999999999e-05 2021-10-08T19:40:28.325 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.325 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.325 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:40:28.325 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580687+0000", 2021-10-08T19:40:28.326 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.20687856399999999 2021-10-08T19:40:28.326 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.326 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.326 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:40:28.327 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580710+0000", 2021-10-08T19:40:28.327 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2738000000000002e-05 2021-10-08T19:40:28.327 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:28.327 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:40:28.328 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:28.328 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.328 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.328 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.25465.0:77517 9.d 9:b7278e79:::benchmark_data_smithi097_196985_object77516:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e316)", 2021-10-08T19:40:28.329 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:32:38.375271+0000", 2021-10-08T19:40:28.329 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 469.85280762100001, 2021-10-08T19:40:28.329 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.214728957, 2021-10-08T19:40:28.329 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:40:28.329 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:40:28.330 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:40:28.330 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.25465", 2021-10-08T19:40:28.330 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:40:28.330 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 77517 2021-10-08T19:40:28.331 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.331 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:40:28.331 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.331 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:40:28.331 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.375271+0000", 2021-10-08T19:40:28.332 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:28.332 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.332 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.333 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:40:28.333 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.375271+0000", 2021-10-08T19:40:28.333 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:28.334 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.334 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.334 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:40:28.335 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.375269+0000", 2021-10-08T19:40:28.335 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:40:28.335 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.335 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.336 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:40:28.336 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.375303+0000", 2021-10-08T19:40:28.336 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.3868999999999997e-05 2021-10-08T19:40:28.336 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.336 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.337 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:40:28.337 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.375315+0000", 2021-10-08T19:40:28.337 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1728e-05 2021-10-08T19:40:28.338 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.338 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.338 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:40:28.338 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.375321+0000", 2021-10-08T19:40:28.339 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7499999999999997e-06 2021-10-08T19:40:28.339 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.339 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.339 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:28.340 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.377409+0000", 2021-10-08T19:40:28.340 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020878939999999999 2021-10-08T19:40:28.341 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.341 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.341 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:40:28.341 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.377528+0000", 2021-10-08T19:40:28.342 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000118972 2021-10-08T19:40:28.342 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.342 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.342 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 1,5", 2021-10-08T19:40:28.342 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.377696+0000", 2021-10-08T19:40:28.343 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016830600000000001 2021-10-08T19:40:28.343 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.343 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.343 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:28.343 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.582927+0000", 2021-10-08T19:40:28.344 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.205230724 2021-10-08T19:40:28.344 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.344 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.344 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:28.345 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.584639+0000", 2021-10-08T19:40:28.345 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001711808 2021-10-08T19:40:28.345 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.345 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.345 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:40:28.346 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.589921+0000", 2021-10-08T19:40:28.346 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0052821830000000002 2021-10-08T19:40:28.346 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.347 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.347 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:40:28.347 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.589964+0000", 2021-10-08T19:40:28.347 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.3319000000000003e-05 2021-10-08T19:40:28.348 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.348 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.348 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:40:28.348 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.590000+0000", 2021-10-08T19:40:28.348 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.5793000000000001e-05 2021-10-08T19:40:28.349 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:28.349 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:40:28.349 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:28.349 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.350 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.350 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:77518 9.9 e316/290 9:9bd075f7:::benchmark_data_smithi097_196985_object77517:head v 316'4852, mlcod=316'4850)", 2021-10-08T19:40:28.350 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:32:38.376302+0000", 2021-10-08T19:40:28.351 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 469.85177677500002, 2021-10-08T19:40:28.351 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.20439987900000001, 2021-10-08T19:40:28.352 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:40:28.352 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:40:28.353 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:40:28.353 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.353 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:40:28.354 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.376302+0000", 2021-10-08T19:40:28.354 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:28.355 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.355 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.355 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:40:28.356 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.376302+0000", 2021-10-08T19:40:28.356 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:28.356 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.356 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.356 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:40:28.357 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.376299+0000", 2021-10-08T19:40:28.357 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999967 2021-10-08T19:40:28.357 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.357 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.358 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:40:28.358 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.376325+0000", 2021-10-08T19:40:28.358 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6188000000000001e-05 2021-10-08T19:40:28.358 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.359 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.359 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:40:28.359 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.376333+0000", 2021-10-08T19:40:28.359 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9160000000000001e-06 2021-10-08T19:40:28.360 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.360 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.360 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:40:28.360 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.376337+0000", 2021-10-08T19:40:28.360 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1930000000000003e-06 2021-10-08T19:40:28.361 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.361 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.361 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:28.361 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.376378+0000", 2021-10-08T19:40:28.362 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0917999999999997e-05 2021-10-08T19:40:28.362 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.362 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.362 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:40:28.362 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.376398+0000", 2021-10-08T19:40:28.363 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9882999999999999e-05 2021-10-08T19:40:28.363 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.363 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.363 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:40:28.364 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580668+0000", 2021-10-08T19:40:28.364 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.204270813 2021-10-08T19:40:28.364 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.364 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.364 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:40:28.365 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580702+0000", 2021-10-08T19:40:28.365 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.3528000000000002e-05 2021-10-08T19:40:28.365 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:28.365 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:40:28.366 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:28.366 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.366 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.367 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:77511 9.1 e316/290 9:84400f31:::benchmark_data_smithi097_196985_object77510:head v 316'4798, mlcod=316'4795)", 2021-10-08T19:40:28.367 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:32:38.377524+0000", 2021-10-08T19:40:28.367 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 469.85055521200002, 2021-10-08T19:40:28.368 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.20320565800000001, 2021-10-08T19:40:28.368 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:40:28.368 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:40:28.368 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:40:28.368 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.369 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:40:28.369 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.377524+0000", 2021-10-08T19:40:28.369 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:28.369 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.370 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.370 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:40:28.370 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.377524+0000", 2021-10-08T19:40:28.370 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:28.371 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.371 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.371 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:40:28.371 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.377523+0000", 2021-10-08T19:40:28.371 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999995 2021-10-08T19:40:28.372 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.372 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.372 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:40:28.372 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.377552+0000", 2021-10-08T19:40:28.373 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9136e-05 2021-10-08T19:40:28.373 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.373 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.373 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:40:28.373 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.377558+0000", 2021-10-08T19:40:28.374 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.959e-06 2021-10-08T19:40:28.374 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.374 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.374 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:40:28.375 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.377562+0000", 2021-10-08T19:40:28.375 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0090000000000001e-06 2021-10-08T19:40:28.375 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.375 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.376 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:28.376 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.377638+0000", 2021-10-08T19:40:28.376 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5498000000000001e-05 2021-10-08T19:40:28.376 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.377 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.377 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:40:28.377 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.377656+0000", 2021-10-08T19:40:28.377 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8423999999999998e-05 2021-10-08T19:40:28.378 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.378 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.378 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:40:28.378 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580708+0000", 2021-10-08T19:40:28.379 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.20305161199999999 2021-10-08T19:40:28.379 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.379 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.379 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:40:28.379 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580729+0000", 2021-10-08T19:40:28.380 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1585000000000001e-05 2021-10-08T19:40:28.380 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:28.380 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:40:28.380 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:28.381 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.381 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.381 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:77514 9.1 e316/290 9:8c08759a:::benchmark_data_smithi097_196985_object77513:head v 316'4799, mlcod=316'4796)", 2021-10-08T19:40:28.381 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:32:38.380203+0000", 2021-10-08T19:40:28.381 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 469.84787567699999, 2021-10-08T19:40:28.382 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.20752410600000001, 2021-10-08T19:40:28.382 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:40:28.382 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:40:28.382 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:40:28.383 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.383 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:40:28.383 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.380203+0000", 2021-10-08T19:40:28.383 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:28.383 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.384 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.384 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:40:28.384 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.380203+0000", 2021-10-08T19:40:28.384 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:28.385 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.385 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.385 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:40:28.385 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.380202+0000", 2021-10-08T19:40:28.385 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:40:28.386 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.386 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.386 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:40:28.386 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.380266+0000", 2021-10-08T19:40:28.387 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4292e-05 2021-10-08T19:40:28.387 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.387 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.387 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:40:28.387 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580625+0000", 2021-10-08T19:40:28.388 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.20035874300000001 2021-10-08T19:40:28.388 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.388 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.388 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:40:28.389 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580647+0000", 2021-10-08T19:40:28.389 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1883e-05 2021-10-08T19:40:28.389 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.389 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.389 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:28.390 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580750+0000", 2021-10-08T19:40:28.390 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000102703 2021-10-08T19:40:28.390 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.390 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.391 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:40:28.391 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580766+0000", 2021-10-08T19:40:28.391 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6155e-05 2021-10-08T19:40:28.391 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.391 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.392 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:40:28.392 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.587680+0000", 2021-10-08T19:40:28.392 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0069146219999999996 2021-10-08T19:40:28.392 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.392 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.393 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:40:28.393 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.587727+0000", 2021-10-08T19:40:28.393 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7018000000000003e-05 2021-10-08T19:40:28.393 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:28.393 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:40:28.394 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:28.394 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.394 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.394 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop_reply(client.25465.0:77517 9.d e316/308 ondisk, result = 0)", 2021-10-08T19:40:28.395 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:32:38.380417+0000", 2021-10-08T19:40:28.395 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 469.84766161900001, 2021-10-08T19:40:28.395 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.202527015, 2021-10-08T19:40:28.395 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:40:28.395 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2021-10-08T19:40:28.396 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:40:28.396 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.396 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:40:28.396 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.380417+0000", 2021-10-08T19:40:28.397 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:28.397 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.397 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.397 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:40:28.398 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.380417+0000", 2021-10-08T19:40:28.398 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:28.398 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.398 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.398 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:40:28.399 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.380416+0000", 2021-10-08T19:40:28.399 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:40:28.399 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.399 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.400 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:40:28.400 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.380422+0000", 2021-10-08T19:40:28.400 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5339999999999999e-06 2021-10-08T19:40:28.400 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.400 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.401 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:40:28.401 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580587+0000", 2021-10-08T19:40:28.402 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.200164861 2021-10-08T19:40:28.402 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.402 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.403 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:40:28.403 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580618+0000", 2021-10-08T19:40:28.404 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.1516000000000001e-05 2021-10-08T19:40:28.404 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.404 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.405 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:28.405 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.582913+0000", 2021-10-08T19:40:28.406 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022951719999999998 2021-10-08T19:40:28.406 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.407 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.407 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:40:28.408 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.582920+0000", 2021-10-08T19:40:28.408 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1300000000000003e-06 2021-10-08T19:40:28.409 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.409 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.409 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:40:28.410 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.582944+0000", 2021-10-08T19:40:28.410 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3972e-05 2021-10-08T19:40:28.411 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:28.411 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:40:28.412 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:28.412 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.413 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.413 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:77532 9.9 e316/290 9:9ff58f88:::benchmark_data_smithi097_196985_object77531:head v 316'4853, mlcod=316'4850)", 2021-10-08T19:40:28.413 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:32:38.395624+0000", 2021-10-08T19:40:28.414 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 469.83245456100002, 2021-10-08T19:40:28.414 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.192136736, 2021-10-08T19:40:28.414 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:40:28.414 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:40:28.415 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:40:28.415 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.415 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:40:28.415 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.395624+0000", 2021-10-08T19:40:28.416 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:28.416 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.416 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.416 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:40:28.416 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.395624+0000", 2021-10-08T19:40:28.417 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:28.417 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.417 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.417 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:40:28.418 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.395622+0000", 2021-10-08T19:40:28.418 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:40:28.418 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.418 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.419 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:40:28.419 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.395684+0000", 2021-10-08T19:40:28.419 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1247000000000005e-05 2021-10-08T19:40:28.419 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.419 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.420 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:40:28.420 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580588+0000", 2021-10-08T19:40:28.420 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.18490478199999999 2021-10-08T19:40:28.420 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.420 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.421 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:40:28.421 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580644+0000", 2021-10-08T19:40:28.421 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5415999999999999e-05 2021-10-08T19:40:28.421 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.422 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.422 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:28.422 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580726+0000", 2021-10-08T19:40:28.422 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2120999999999995e-05 2021-10-08T19:40:28.423 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.423 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.423 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:40:28.423 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.580747+0000", 2021-10-08T19:40:28.423 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0856000000000002e-05 2021-10-08T19:40:28.424 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.424 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.424 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:40:28.424 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.587731+0000", 2021-10-08T19:40:28.425 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0069841850000000004 2021-10-08T19:40:28.425 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.425 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.425 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:40:28.425 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:32:38.587761+0000", 2021-10-08T19:40:28.426 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.0134999999999999e-05 2021-10-08T19:40:28.426 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:28.426 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:40:28.426 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:28.427 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.427 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.427 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.25465.0:169838 9.3 9:cc713d20:::benchmark_data_smithi097_196985_object54147:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e334)", 2021-10-08T19:40:28.427 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:34:02.168016+0000", 2021-10-08T19:40:28.428 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 386.06006250799999, 2021-10-08T19:40:28.428 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.18378728999999999, 2021-10-08T19:40:28.428 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:40:28.428 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:40:28.428 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:40:28.429 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.25465", 2021-10-08T19:40:28.429 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:40:28.429 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 169838 2021-10-08T19:40:28.429 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.429 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:40:28.430 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.430 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:40:28.430 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.168016+0000", 2021-10-08T19:40:28.430 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:28.431 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.431 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.431 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:40:28.431 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.168016+0000", 2021-10-08T19:40:28.431 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:28.432 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.432 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.432 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:40:28.432 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.168015+0000", 2021-10-08T19:40:28.433 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:40:28.433 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.433 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.433 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:40:28.434 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.168020+0000", 2021-10-08T19:40:28.434 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.651e-06 2021-10-08T19:40:28.434 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.434 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.434 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:40:28.435 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.168028+0000", 2021-10-08T19:40:28.435 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4300000000000006e-06 2021-10-08T19:40:28.435 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.435 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.436 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:40:28.436 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.168034+0000", 2021-10-08T19:40:28.436 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6500000000000001e-06 2021-10-08T19:40:28.436 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.436 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.437 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:28.437 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.170324+0000", 2021-10-08T19:40:28.437 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022904560000000002 2021-10-08T19:40:28.437 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.437 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.438 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:40:28.438 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.170455+0000", 2021-10-08T19:40:28.438 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013018900000000001 2021-10-08T19:40:28.438 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.439 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.439 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 1,3", 2021-10-08T19:40:28.439 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.170588+0000", 2021-10-08T19:40:28.439 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000133814 2021-10-08T19:40:28.439 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.440 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.440 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:40:28.440 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.172605+0000", 2021-10-08T19:40:28.440 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002016847 2021-10-08T19:40:28.441 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.441 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.441 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:28.441 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.176258+0000", 2021-10-08T19:40:28.441 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036532439999999999 2021-10-08T19:40:28.442 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.442 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.442 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:28.442 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.351710+0000", 2021-10-08T19:40:28.443 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.175451194 2021-10-08T19:40:28.443 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.443 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.443 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:40:28.443 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.351762+0000", 2021-10-08T19:40:28.444 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2623000000000001e-05 2021-10-08T19:40:28.444 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.444 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.444 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:40:28.445 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.351804+0000", 2021-10-08T19:40:28.445 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1440000000000003e-05 2021-10-08T19:40:28.445 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:28.445 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:40:28.445 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:28.446 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.446 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.446 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.25465.0:169841 9.d 9:b8132437:::benchmark_data_smithi097_196985_object54150:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e334)", 2021-10-08T19:40:28.446 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:34:02.168177+0000", 2021-10-08T19:40:28.446 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 386.05990198799998, 2021-10-08T19:40:28.447 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.18269624500000001, 2021-10-08T19:40:28.447 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:40:28.447 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:40:28.447 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:40:28.448 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.25465", 2021-10-08T19:40:28.448 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:40:28.448 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 169841 2021-10-08T19:40:28.448 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.448 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:40:28.449 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.449 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:40:28.449 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.168177+0000", 2021-10-08T19:40:28.449 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:28.450 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.450 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.450 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:40:28.450 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.168177+0000", 2021-10-08T19:40:28.450 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:28.451 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.451 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.451 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:40:28.451 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.168176+0000", 2021-10-08T19:40:28.451 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:40:28.452 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.452 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.452 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:40:28.452 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.168180+0000", 2021-10-08T19:40:28.452 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4950000000000002e-06 2021-10-08T19:40:28.453 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.453 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.453 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:40:28.453 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.168187+0000", 2021-10-08T19:40:28.454 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1099999999999997e-06 2021-10-08T19:40:28.454 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.454 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.454 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:40:28.454 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.168193+0000", 2021-10-08T19:40:28.455 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2510000000000002e-06 2021-10-08T19:40:28.455 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.455 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.455 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:28.455 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.170545+0000", 2021-10-08T19:40:28.456 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0023527130000000002 2021-10-08T19:40:28.456 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.456 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.456 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:40:28.457 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.170621+0000", 2021-10-08T19:40:28.457 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6001999999999995e-05 2021-10-08T19:40:28.457 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.457 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.457 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 1,5", 2021-10-08T19:40:28.458 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.170751+0000", 2021-10-08T19:40:28.458 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012955400000000001 2021-10-08T19:40:28.458 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.458 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.458 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:40:28.459 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.173676+0000", 2021-10-08T19:40:28.459 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0029249079999999999 2021-10-08T19:40:28.459 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.459 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.460 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:28.460 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.173715+0000", 2021-10-08T19:40:28.460 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9578e-05 2021-10-08T19:40:28.460 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.460 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.461 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:28.461 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.350786+0000", 2021-10-08T19:40:28.461 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.17707047400000001 2021-10-08T19:40:28.461 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.461 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.462 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:40:28.462 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.350836+0000", 2021-10-08T19:40:28.462 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9673999999999999e-05 2021-10-08T19:40:28.462 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.462 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.463 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:40:28.463 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.350873+0000", 2021-10-08T19:40:28.463 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7602999999999999e-05 2021-10-08T19:40:28.463 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:28.464 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:40:28.464 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:28.464 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.464 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.464 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:209975 9.1 e343/290 9:89bb0ba3:::benchmark_data_smithi097_196985_object94284:head v 343'12999, mlcod=343'12997)", 2021-10-08T19:40:28.465 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:34:38.428534+0000", 2021-10-08T19:40:28.465 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 349.79954504300002, 2021-10-08T19:40:28.465 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.236116147, 2021-10-08T19:40:28.465 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:40:28.466 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:40:28.466 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:40:28.466 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.466 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:40:28.466 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.428534+0000", 2021-10-08T19:40:28.467 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:28.468 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.468 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.468 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:40:28.468 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.428534+0000", 2021-10-08T19:40:28.468 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:28.469 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.469 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.469 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:40:28.469 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.428533+0000", 2021-10-08T19:40:28.470 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:40:28.470 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.470 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.470 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:40:28.470 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.428540+0000", 2021-10-08T19:40:28.471 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.109e-06 2021-10-08T19:40:28.471 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.471 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.471 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:40:28.472 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.428549+0000", 2021-10-08T19:40:28.472 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3249999999999997e-06 2021-10-08T19:40:28.472 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.473 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.473 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:40:28.473 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.428555+0000", 2021-10-08T19:40:28.473 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8220000000000003e-06 2021-10-08T19:40:28.473 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.474 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.474 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:28.474 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.428601+0000", 2021-10-08T19:40:28.474 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5527e-05 2021-10-08T19:40:28.475 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.475 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.475 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:40:28.475 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.428618+0000", 2021-10-08T19:40:28.475 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7547e-05 2021-10-08T19:40:28.476 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.476 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.476 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:40:28.476 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.664627+0000", 2021-10-08T19:40:28.476 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.23600927099999999 2021-10-08T19:40:28.477 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.477 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.477 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:40:28.477 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.664650+0000", 2021-10-08T19:40:28.477 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2654999999999999e-05 2021-10-08T19:40:28.478 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:28.478 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:40:28.478 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:28.478 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.479 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.479 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:209977 9.a e343/290 9:575a8bb2:::benchmark_data_smithi097_196985_object94286:head v 343'13104, mlcod=343'13101)", 2021-10-08T19:40:28.479 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:34:38.431569+0000", 2021-10-08T19:40:28.479 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 349.79650972799999, 2021-10-08T19:40:28.480 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.234467443, 2021-10-08T19:40:28.480 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:40:28.480 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:40:28.480 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:40:28.481 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.481 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:40:28.481 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.431569+0000", 2021-10-08T19:40:28.481 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:28.481 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.482 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.482 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:40:28.482 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.431569+0000", 2021-10-08T19:40:28.482 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:28.483 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.483 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.483 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:40:28.483 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.431568+0000", 2021-10-08T19:40:28.483 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:40:28.484 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.484 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.484 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:40:28.484 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.431574+0000", 2021-10-08T19:40:28.485 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0970000000000002e-06 2021-10-08T19:40:28.485 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.485 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.485 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:40:28.485 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.661194+0000", 2021-10-08T19:40:28.486 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.229619776 2021-10-08T19:40:28.486 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.486 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.486 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:40:28.487 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.661212+0000", 2021-10-08T19:40:28.487 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8576e-05 2021-10-08T19:40:28.487 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.487 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.487 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:28.488 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.661306+0000", 2021-10-08T19:40:28.488 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3208000000000006e-05 2021-10-08T19:40:28.488 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.488 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.488 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:40:28.489 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.661367+0000", 2021-10-08T19:40:28.489 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1753000000000003e-05 2021-10-08T19:40:28.489 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.489 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.490 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:40:28.490 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.666011+0000", 2021-10-08T19:40:28.490 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046439899999999998 2021-10-08T19:40:28.490 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.490 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.491 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:40:28.491 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.666037+0000", 2021-10-08T19:40:28.491 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5211999999999998e-05 2021-10-08T19:40:28.491 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:28.492 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:40:28.492 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:28.492 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.492 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.492 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.25465.0:209980 9.e 9:7c138995:::benchmark_data_smithi097_196985_object94289:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e343)", 2021-10-08T19:40:28.493 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:34:38.435304+0000", 2021-10-08T19:40:28.493 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 349.79277486199999, 2021-10-08T19:40:28.493 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.23664207800000001, 2021-10-08T19:40:28.493 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:40:28.493 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:40:28.494 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:40:28.494 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.25465", 2021-10-08T19:40:28.494 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:40:28.494 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 209980 2021-10-08T19:40:28.495 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.495 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:40:28.495 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.495 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:40:28.495 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.435304+0000", 2021-10-08T19:40:28.496 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:28.496 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.496 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.496 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:40:28.497 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.435304+0000", 2021-10-08T19:40:28.497 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:28.497 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.497 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.497 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:40:28.498 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.435302+0000", 2021-10-08T19:40:28.498 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:40:28.498 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.498 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.498 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:40:28.499 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.435308+0000", 2021-10-08T19:40:28.499 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0190000000000003e-06 2021-10-08T19:40:28.499 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.499 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.500 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:40:28.500 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.661204+0000", 2021-10-08T19:40:28.500 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.225895185 2021-10-08T19:40:28.500 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.500 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.501 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:40:28.501 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.661231+0000", 2021-10-08T19:40:28.501 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7769000000000001e-05 2021-10-08T19:40:28.501 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.501 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.502 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:28.502 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.661484+0000", 2021-10-08T19:40:28.502 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000252372 2021-10-08T19:40:28.502 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.503 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.503 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:40:28.503 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.661605+0000", 2021-10-08T19:40:28.503 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012129 2021-10-08T19:40:28.503 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.504 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.504 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:40:28.504 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.661795+0000", 2021-10-08T19:40:28.504 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00018975099999999999 2021-10-08T19:40:28.505 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.505 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.505 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:40:28.505 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.666573+0000", 2021-10-08T19:40:28.505 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0047777619999999996 2021-10-08T19:40:28.506 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.506 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.506 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:28.506 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.666621+0000", 2021-10-08T19:40:28.507 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8196999999999999e-05 2021-10-08T19:40:28.507 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.507 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.507 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:28.507 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.671845+0000", 2021-10-08T19:40:28.508 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0052243530000000002 2021-10-08T19:40:28.508 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.508 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.508 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:40:28.509 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.671905+0000", 2021-10-08T19:40:28.509 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0053999999999998e-05 2021-10-08T19:40:28.509 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.509 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.510 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:40:28.510 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.671946+0000", 2021-10-08T19:40:28.510 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1006e-05 2021-10-08T19:40:28.510 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:28.510 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:40:28.511 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:28.511 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.511 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.511 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:209994 9.9 e343/290 9:93bcfe32:::benchmark_data_smithi097_196985_object94303:head v 343'13083, mlcod=343'13081)", 2021-10-08T19:40:28.512 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:34:38.454236+0000", 2021-10-08T19:40:28.512 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 349.773842548, 2021-10-08T19:40:28.512 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.21043297699999999, 2021-10-08T19:40:28.512 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:40:28.512 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:40:28.513 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:40:28.513 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.513 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:40:28.513 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.454236+0000", 2021-10-08T19:40:28.513 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:28.514 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.514 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.514 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:40:28.514 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.454236+0000", 2021-10-08T19:40:28.515 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:28.515 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.515 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.515 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:40:28.515 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.454233+0000", 2021-10-08T19:40:28.516 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999962 2021-10-08T19:40:28.516 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.516 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.516 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:40:28.516 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.454252+0000", 2021-10-08T19:40:28.517 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9372999999999999e-05 2021-10-08T19:40:28.517 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.517 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.517 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:40:28.517 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.661194+0000", 2021-10-08T19:40:28.518 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.20694248000000001 2021-10-08T19:40:28.518 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.518 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.518 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:40:28.519 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.661217+0000", 2021-10-08T19:40:28.519 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2983e-05 2021-10-08T19:40:28.519 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.519 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.519 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:28.520 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.661547+0000", 2021-10-08T19:40:28.520 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00032985499999999999 2021-10-08T19:40:28.520 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.520 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.520 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:40:28.521 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.661567+0000", 2021-10-08T19:40:28.521 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9718999999999999e-05 2021-10-08T19:40:28.521 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.521 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.522 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:40:28.522 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.664652+0000", 2021-10-08T19:40:28.522 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0030853310000000002 2021-10-08T19:40:28.522 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.522 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.523 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:40:28.523 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.664669+0000", 2021-10-08T19:40:28.523 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7008999999999999e-05 2021-10-08T19:40:28.523 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:28.523 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:40:28.524 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:28.524 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.524 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.524 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15870.0:55048 10.c 10:36071c76:::benchmark_data_smithi097_245820_object55047:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e371)", 2021-10-08T19:40:28.525 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:35:55.919347+0000", 2021-10-08T19:40:28.525 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 272.30873203900001, 2021-10-08T19:40:28.525 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.201994387, 2021-10-08T19:40:28.525 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:40:28.525 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:40:28.526 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:40:28.526 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15870", 2021-10-08T19:40:28.526 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1128006081", 2021-10-08T19:40:28.526 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 55048 2021-10-08T19:40:28.526 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.527 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:40:28.527 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.527 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:40:28.527 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:35:55.919347+0000", 2021-10-08T19:40:28.528 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:28.528 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.528 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.528 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:40:28.528 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:35:55.919347+0000", 2021-10-08T19:40:28.529 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:28.529 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.529 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.529 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:40:28.529 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:35:55.919345+0000", 2021-10-08T19:40:28.530 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:40:28.530 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.530 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.530 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:40:28.530 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:35:55.919394+0000", 2021-10-08T19:40:28.531 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9344000000000001e-05 2021-10-08T19:40:28.531 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.531 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.531 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:40:28.532 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:35:55.919413+0000", 2021-10-08T19:40:28.532 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9347e-05 2021-10-08T19:40:28.532 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.532 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.532 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:40:28.533 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:35:55.919422+0000", 2021-10-08T19:40:28.533 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2849999999999995e-06 2021-10-08T19:40:28.533 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.533 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.533 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:28.534 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:35:55.919490+0000", 2021-10-08T19:40:28.534 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7917999999999996e-05 2021-10-08T19:40:28.534 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.534 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.534 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:40:28.535 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:35:55.919645+0000", 2021-10-08T19:40:28.535 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015573099999999999 2021-10-08T19:40:28.535 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.535 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.536 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,4", 2021-10-08T19:40:28.536 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:35:55.919785+0000", 2021-10-08T19:40:28.536 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013953500000000001 2021-10-08T19:40:28.536 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.536 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.537 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:40:28.537 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:35:55.921831+0000", 2021-10-08T19:40:28.537 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020465219999999998 2021-10-08T19:40:28.537 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.537 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.538 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:28.538 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:35:55.922670+0000", 2021-10-08T19:40:28.538 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00083903799999999996 2021-10-08T19:40:28.539 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.539 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.539 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:28.539 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:35:56.121241+0000", 2021-10-08T19:40:28.539 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.19857038900000001 2021-10-08T19:40:28.540 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.540 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.540 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:40:28.540 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:35:56.121302+0000", 2021-10-08T19:40:28.540 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1616000000000001e-05 2021-10-08T19:40:28.541 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.541 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.541 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:40:28.541 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:35:56.121341+0000", 2021-10-08T19:40:28.542 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8800999999999997e-05 2021-10-08T19:40:28.542 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:28.542 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:40:28.542 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:28.542 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.543 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.543 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.26125.0:50065 11.4 11:271cd449:::benchmark_data_smithi097_295476_object50064:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e448)", 2021-10-08T19:40:28.543 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:39:38.253906+0000", 2021-10-08T19:40:28.543 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 49.974173241000003, 2021-10-08T19:40:28.544 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.47711858099999999, 2021-10-08T19:40:28.544 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:40:28.544 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:40:28.544 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:40:28.544 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.26125", 2021-10-08T19:40:28.545 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:40:28.545 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 50065 2021-10-08T19:40:28.545 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.545 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:40:28.545 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.546 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:40:28.546 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:38.253906+0000", 2021-10-08T19:40:28.546 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:28.546 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.547 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.547 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:40:28.547 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:38.253906+0000", 2021-10-08T19:40:28.547 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:40:28.547 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.548 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.548 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:40:28.548 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:38.253903+0000", 2021-10-08T19:40:28.548 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:40:28.548 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.549 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.549 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:40:28.549 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:38.253960+0000", 2021-10-08T19:40:28.549 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6891999999999997e-05 2021-10-08T19:40:28.550 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.550 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.550 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:40:28.550 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:38.253976+0000", 2021-10-08T19:40:28.550 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5872e-05 2021-10-08T19:40:28.551 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.551 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.551 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:40:28.551 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:38.253983+0000", 2021-10-08T19:40:28.552 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.764e-06 2021-10-08T19:40:28.552 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.552 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.552 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:40:28.552 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:38.254032+0000", 2021-10-08T19:40:28.553 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9651999999999998e-05 2021-10-08T19:40:28.553 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.553 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.553 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:40:28.553 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:38.254150+0000", 2021-10-08T19:40:28.554 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000117411 2021-10-08T19:40:28.554 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.554 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.554 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 2,6", 2021-10-08T19:40:28.555 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:38.254267+0000", 2021-10-08T19:40:28.555 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000116845 2021-10-08T19:40:28.555 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.555 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.555 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:40:28.556 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:38.256337+0000", 2021-10-08T19:40:28.556 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020707 2021-10-08T19:40:28.556 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.556 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.556 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:28.557 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:38.261811+0000", 2021-10-08T19:40:28.557 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054738249999999999 2021-10-08T19:40:28.557 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.557 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.558 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:28.558 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:38.730891+0000", 2021-10-08T19:40:28.558 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.46908010999999999 2021-10-08T19:40:28.558 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.559 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.559 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:40:28.559 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:38.730951+0000", 2021-10-08T19:40:28.559 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9765999999999997e-05 2021-10-08T19:40:28.559 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:40:28.560 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:40:28.560 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:40:28.560 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:38.731024+0000", 2021-10-08T19:40:28.560 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3127999999999995e-05 2021-10-08T19:40:28.560 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:28.561 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:40:28.561 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:28.561 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:40:28.561 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:40:28.561 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:40:28.563 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:28 smithi097 ceph-mon[41966]: pgmap v957: 188 pgs: 188 active+clean; 6.0 GiB data, 21 GiB used, 695 GiB / 715 GiB avail; 739 B/s rd, 42 MiB/s wr, 667 op/s 2021-10-08T19:40:28.563 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:28 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:40:28.563 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:28 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2008804530' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2021-10-08T19:40:28.564 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:28 smithi097 ceph-mon[32687]: pgmap v957: 188 pgs: 188 active+clean; 6.0 GiB data, 21 GiB used, 695 GiB / 715 GiB avail; 739 B/s rd, 42 MiB/s wr, 667 op/s 2021-10-08T19:40:28.564 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:28 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:40:28.565 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:28 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2008804530' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2021-10-08T19:40:28.566 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:28.567 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:40:28.567 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:40:28.668 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:40:28.696 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 79 16 103400 103384 81.7597 63.5625 0.0112306 0.0122263 2021-10-08T19:40:28.725 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:29.208 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2021-10-08T19:40:29.281 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2021-10-08T19:40:29.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:29 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2008804530' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]': finished 2021-10-08T19:40:29.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:29 smithi097 ceph-mon[32687]: osdmap e466: 8 total, 8 up, 8 in 2021-10-08T19:40:29.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:29 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2008804530' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]': finished 2021-10-08T19:40:29.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:29 smithi097 ceph-mon[41966]: osdmap e466: 8 total, 8 up, 8 in 2021-10-08T19:40:29.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:29 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2008804530' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]': finished 2021-10-08T19:40:29.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:29 smithi117 ceph-mon[34585]: osdmap e466: 8 total, 8 up, 8 in 2021-10-08T19:40:29.697 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:2021-10-08T19:40:29.697288+0000 min lat: 0.00117486 max lat: 0.499237 avg lat: 0.0122719 2021-10-08T19:40:29.698 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2021-10-08T19:40:29.698 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 80 16 104321 104305 81.4552 57.5625 0.0252045 0.0122719 2021-10-08T19:40:30.127 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd reweight 7 1 2021-10-08T19:40:30.144 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:40:30.153 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:30.155 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:40:30.256 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:40:30.258 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:40:30.295 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:30.365 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:40:30.366 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:40:30.373 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:30.374 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:40:30.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:30 smithi097 ceph-mon[32687]: pgmap v959: 188 pgs: 188 active+clean; 6.2 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 852 B/s rd, 78 MiB/s wr, 1.25k op/s 2021-10-08T19:40:30.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:30 smithi097 ceph-mon[41966]: pgmap v959: 188 pgs: 188 active+clean; 6.2 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 852 B/s rd, 78 MiB/s wr, 1.25k op/s 2021-10-08T19:40:30.474 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:40:30.505 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:30 smithi117 ceph-mon[34585]: pgmap v959: 188 pgs: 188 active+clean; 6.2 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 852 B/s rd, 78 MiB/s wr, 1.25k op/s 2021-10-08T19:40:30.508 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:30.635 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:40:30.640 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:30.641 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:40:30.697 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 81 16 105326 105310 81.225 62.8125 0.0138587 0.0123064 2021-10-08T19:40:30.742 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:40:30.772 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:30.953 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:40:30.957 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:30.958 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:40:31.059 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:40:31.089 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:31.149 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:40:31.151 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:31.152 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:40:31.210 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:40:31.254 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:40:31.281 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:31.342 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:40:31.347 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:31.348 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:40:31.449 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:40:31.475 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:31.698 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 82 16 106139 106123 80.8541 50.8125 0.00642976 0.0123489 2021-10-08T19:40:31.748 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:40:31.751 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:31.752 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:40:31.853 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:40:31.889 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:31.914 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is unset 2021-10-08T19:40:31.980 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:40:31.986 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:31.987 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:40:32.088 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:40:32.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:31 smithi117 ceph-mon[34585]: pgmap v960: 188 pgs: 188 active+clean; 6.3 GiB data, 22 GiB used, 694 GiB / 715 GiB avail; 1.3 KiB/s rd, 77 MiB/s wr, 1.23k op/s 2021-10-08T19:40:32.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:31 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/261779050' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:40:32.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:31 smithi117 ceph-mon[34585]: from='client.26230 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:40:32.125 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:32.213 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:40:32.217 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:32.217 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:40:32.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:31 smithi097 ceph-mon[32687]: pgmap v960: 188 pgs: 188 active+clean; 6.3 GiB data, 22 GiB used, 694 GiB / 715 GiB avail; 1.3 KiB/s rd, 77 MiB/s wr, 1.23k op/s 2021-10-08T19:40:32.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:31 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/261779050' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:40:32.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:31 smithi097 ceph-mon[32687]: from='client.26230 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:40:32.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:31 smithi097 ceph-mon[41966]: pgmap v960: 188 pgs: 188 active+clean; 6.3 GiB data, 22 GiB used, 694 GiB / 715 GiB avail; 1.3 KiB/s rd, 77 MiB/s wr, 1.23k op/s 2021-10-08T19:40:32.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:31 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/261779050' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:40:32.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:31 smithi097 ceph-mon[41966]: from='client.26230 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:40:32.318 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:40:32.362 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:32.439 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:40:32.441 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:32.442 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:40:32.544 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:40:32.567 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:32.609 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:40:32.611 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:32.612 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:40:32.697 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 83 16 107051 107035 80.5668 57 0.0172988 0.0124074 2021-10-08T19:40:32.713 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:40:32.771 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:32.894 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:32 smithi117 ceph-mon[34585]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:40:32.894 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:32 smithi117 ceph-mon[34585]: from='client.26230 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:40:32.894 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:32 smithi117 ceph-mon[34585]: osdmap e467: 8 total, 8 up, 8 in 2021-10-08T19:40:32.895 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:32 smithi117 ceph-mon[34585]: 4.8 scrub ok 2021-10-08T19:40:32.895 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:32 smithi117 ceph-mon[34585]: 5.1e scrub ok 2021-10-08T19:40:32.895 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:32 smithi117 ceph-mon[34585]: 2.10 scrub ok 2021-10-08T19:40:32.895 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:32 smithi117 ceph-mon[34585]: 3.8 scrub ok 2021-10-08T19:40:32.970 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:32 smithi097 ceph-mon[32687]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:40:32.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:32 smithi097 ceph-mon[32687]: from='client.26230 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:40:32.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:32 smithi097 ceph-mon[32687]: osdmap e467: 8 total, 8 up, 8 in 2021-10-08T19:40:32.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:32 smithi097 ceph-mon[32687]: 4.8 scrub ok 2021-10-08T19:40:32.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:32 smithi097 ceph-mon[32687]: 5.1e scrub ok 2021-10-08T19:40:32.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:32 smithi097 ceph-mon[32687]: 2.10 scrub ok 2021-10-08T19:40:32.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:32 smithi097 ceph-mon[32687]: 3.8 scrub ok 2021-10-08T19:40:32.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:32 smithi097 ceph-mon[41966]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:40:32.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:32 smithi097 ceph-mon[41966]: from='client.26230 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:40:32.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:32 smithi097 ceph-mon[41966]: osdmap e467: 8 total, 8 up, 8 in 2021-10-08T19:40:32.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:32 smithi097 ceph-mon[41966]: 4.8 scrub ok 2021-10-08T19:40:32.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:32 smithi097 ceph-mon[41966]: 5.1e scrub ok 2021-10-08T19:40:32.975 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:32 smithi097 ceph-mon[41966]: 2.10 scrub ok 2021-10-08T19:40:32.975 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:32 smithi097 ceph-mon[41966]: 3.8 scrub ok 2021-10-08T19:40:32.975 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:40:32 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:40:32] "GET /metrics HTTP/1.1" 200 155910 "" "Prometheus/2.18.1" 2021-10-08T19:40:33.464 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:40:33.471 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:33.472 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:40:33.575 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:40:33.608 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:33.665 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:40:33.668 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:33.669 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:40:33.698 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 84 16 108036 108020 80.3405 61.5625 0.00829859 0.0124418 2021-10-08T19:40:33.699 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:40:33 smithi097 conmon[33110]: 172.21.15.117 - - [08/Oct/2021:19:40:33] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:40:33.770 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:40:33.833 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:33.949 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:40:33.956 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:33.957 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:40:34.058 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:40:34.123 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:34.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:40:33 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:40:33] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:40:34.205 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:40:34.206 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2021-10-08T19:40:34.206 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:34.206 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.26125.0:108444 11.6 11:6feeb399:::benchmark_data_smithi097_295476_object108443:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e467)", 2021-10-08T19:40:34.206 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:40:34.187871+0000", 2021-10-08T19:40:34.207 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0075094879999999999, 2021-10-08T19:40:34.207 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0075456810000000003, 2021-10-08T19:40:34.207 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:40:34.207 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2021-10-08T19:40:34.207 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:40:34.208 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.26125", 2021-10-08T19:40:34.208 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:40:34.208 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 108444 2021-10-08T19:40:34.208 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:34.208 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:40:34.209 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:34.209 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:40:34.209 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:34.187871+0000", 2021-10-08T19:40:34.209 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:40:34.210 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:34.210 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:34.210 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:40:34.210 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:34.187871+0000", 2021-10-08T19:40:34.210 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:40:34.211 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:34.211 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:34.211 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:40:34.212 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:34.187867+0000", 2021-10-08T19:40:34.212 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999967 2021-10-08T19:40:34.212 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:34.212 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:34.212 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:40:34.213 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:34.187906+0000", 2021-10-08T19:40:34.213 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8954e-05 2021-10-08T19:40:34.213 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:34.213 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:34.213 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:40:34.214 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:34.187923+0000", 2021-10-08T19:40:34.214 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7104000000000001e-05 2021-10-08T19:40:34.214 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:34.214 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:34.215 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:40:34.215 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:34.187932+0000", 2021-10-08T19:40:34.215 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0489999999999993e-06 2021-10-08T19:40:34.215 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:34.215 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:34.216 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:40:34.216 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:34.187978+0000", 2021-10-08T19:40:34.216 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5522999999999998e-05 2021-10-08T19:40:34.216 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:34.217 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:34.217 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:40:34.217 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:34.188139+0000", 2021-10-08T19:40:34.217 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000160567 2021-10-08T19:40:34.218 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:34.218 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:34.218 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,2", 2021-10-08T19:40:34.218 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:34.188311+0000", 2021-10-08T19:40:34.219 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017222099999999999 2021-10-08T19:40:34.219 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:40:34.219 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:40:34.219 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:40:34.220 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:34.220 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:34.220 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.26125.0:108445 11.9 e467/433 11:9fad1baf:::benchmark_data_smithi097_295476_object108444:head v 467'6743, mlcod=467'6741)", 2021-10-08T19:40:34.220 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:40:34.192428+0000", 2021-10-08T19:40:34.221 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0029524080000000001, 2021-10-08T19:40:34.221 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003072445, 2021-10-08T19:40:34.221 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:40:34.221 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2021-10-08T19:40:34.221 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:40:34.222 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:34.222 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:40:34.222 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:34.192428+0000", 2021-10-08T19:40:34.222 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:40:34.223 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:34.223 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:34.223 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:40:34.223 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:34.192428+0000", 2021-10-08T19:40:34.223 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:40:34.224 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:34.224 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:34.224 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:40:34.224 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:34.192426+0000", 2021-10-08T19:40:34.225 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:40:34.225 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:34.225 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:34.225 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:40:34.225 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:34.192456+0000", 2021-10-08T19:40:34.226 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0371000000000001e-05 2021-10-08T19:40:34.226 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:34.230 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:34.230 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:40:34.231 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:34.192472+0000", 2021-10-08T19:40:34.231 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5795999999999999e-05 2021-10-08T19:40:34.231 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:34.231 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:34.231 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:40:34.232 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:34.192479+0000", 2021-10-08T19:40:34.232 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1189999999999999e-06 2021-10-08T19:40:34.232 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:34.232 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:34.233 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:40:34.233 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:34.193449+0000", 2021-10-08T19:40:34.233 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00096988200000000004 2021-10-08T19:40:34.233 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:34.234 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:34.234 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:40:34.234 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:34.193468+0000", 2021-10-08T19:40:34.234 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8627999999999999e-05 2021-10-08T19:40:34.234 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:40:34.235 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:40:34.235 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:40:34.235 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:34.235 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:34.236 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.26125.0:108446 11.b e467/433 11:db88f130:::benchmark_data_smithi097_295476_object108445:head v 467'6877, mlcod=467'6874)", 2021-10-08T19:40:34.236 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:40:34.192491+0000", 2021-10-08T19:40:34.236 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0028894480000000002, 2021-10-08T19:40:34.236 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003069347, 2021-10-08T19:40:34.236 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:40:34.237 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2021-10-08T19:40:34.237 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:40:34.238 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:34.238 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:40:34.238 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:34.192491+0000", 2021-10-08T19:40:34.238 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:40:34.238 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:34.239 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:34.239 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:40:34.239 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:34.192491+0000", 2021-10-08T19:40:34.239 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:40:34.240 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:34.240 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:34.240 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:40:34.240 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:34.192490+0000", 2021-10-08T19:40:34.240 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2021-10-08T19:40:34.241 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:34.241 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:34.241 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:40:34.241 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:34.192513+0000", 2021-10-08T19:40:34.242 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2742e-05 2021-10-08T19:40:34.242 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:34.242 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:34.242 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:40:34.243 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:34.192518+0000", 2021-10-08T19:40:34.243 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0769999999999998e-06 2021-10-08T19:40:34.243 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:34.243 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:34.244 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:40:34.244 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:34.192522+0000", 2021-10-08T19:40:34.244 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1350000000000002e-06 2021-10-08T19:40:34.244 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:34.244 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:34.245 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:40:34.245 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:34.192643+0000", 2021-10-08T19:40:34.245 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000120877 2021-10-08T19:40:34.245 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:34.246 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:34.246 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:40:34.246 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:34.192663+0000", 2021-10-08T19:40:34.246 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9990999999999999e-05 2021-10-08T19:40:34.246 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:40:34.247 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:40:34.247 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:40:34.247 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:40:34.248 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:40:34.248 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 3 2021-10-08T19:40:34.248 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:40:34.700 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 85 16 108981 108965 80.089 59.0625 0.0108392 0.0124816 2021-10-08T19:40:34.720 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:40:34.728 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:34.730 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:40:34.831 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:40:34.860 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:34 smithi117 ceph-mon[34585]: pgmap v962: 188 pgs: 188 active+clean; 6.3 GiB data, 22 GiB used, 694 GiB / 715 GiB avail; 650 B/s rd, 40 MiB/s wr, 645 op/s 2021-10-08T19:40:34.860 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:34 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:40:34.860 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:34 smithi117 ceph-mon[34585]: 3.16 scrub ok 2021-10-08T19:40:34.861 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:34 smithi117 ceph-mon[34585]: 4.e scrub ok 2021-10-08T19:40:34.866 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:34.926 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:40:34.931 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:34.932 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:40:34.955 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:40:34.970 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:40:34.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:34 smithi097 ceph-mon[32687]: pgmap v962: 188 pgs: 188 active+clean; 6.3 GiB data, 22 GiB used, 694 GiB / 715 GiB avail; 650 B/s rd, 40 MiB/s wr, 645 op/s 2021-10-08T19:40:34.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:34 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:40:34.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:34 smithi097 ceph-mon[32687]: 3.16 scrub ok 2021-10-08T19:40:34.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:34 smithi097 ceph-mon[32687]: 4.e scrub ok 2021-10-08T19:40:34.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:34 smithi097 ceph-mon[41966]: pgmap v962: 188 pgs: 188 active+clean; 6.3 GiB data, 22 GiB used, 694 GiB / 715 GiB avail; 650 B/s rd, 40 MiB/s wr, 645 op/s 2021-10-08T19:40:34.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:34 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:40:34.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:34 smithi097 ceph-mon[41966]: 3.16 scrub ok 2021-10-08T19:40:34.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:34 smithi097 ceph-mon[41966]: 4.e scrub ok 2021-10-08T19:40:35.001 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:40:35.032 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:40:35.037 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:40:35.080 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:40:35.099 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:35.118 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:40:35.159 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:40:35.190 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:40:35.222 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'false' 2021-10-08T19:40:35.223 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'false' 2021-10-08T19:40:35.223 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'false' 2021-10-08T19:40:35.223 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'false' 2021-10-08T19:40:35.223 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'false' 2021-10-08T19:40:35.224 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'false' 2021-10-08T19:40:35.224 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'false' 2021-10-08T19:40:35.224 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'false' 2021-10-08T19:40:35.407 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset nodeep-scrub 2021-10-08T19:40:35.416 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:40:35.420 INFO:journalctl@ceph.osd.1.smithi097.stdout:Oct 08 19:40:35 smithi097 conmon[51607]: 2021-10-08T19:40:35.097+0000 7f6f22830700 -1 osd.1 pg_epoch: 467 pg[6.d( empty local-lis/les=397/398 n=0 ec=66/66 lis/c=397/397 les/c/f=398/398/0 sis=397) [1,5,0] r=0 lpr=397 crt=0'0 mlcod 0'0 active+clean] scrubber pg(6.d) handle_scrub_reserve_grant: received unsolicited reservation grant from osd 5 (0x56152f66c2c0) 2021-10-08T19:40:35.422 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:35.423 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:40:35.524 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:40:35.611 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:35.700 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 86 16 109811 109795 79.7609 51.875 0.00398447 0.0125216 2021-10-08T19:40:35.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:35 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:40:35.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:35 smithi097 ceph-mon[32687]: 172.21.15.117 - - [08/Oct/2021:19:40:33] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:40:35.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:35 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3434875240' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:40:35.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:35 smithi097 ceph-mon[32687]: 5.9 scrub ok 2021-10-08T19:40:35.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:35 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:40:35.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:35 smithi097 ceph-mon[41966]: 172.21.15.117 - - [08/Oct/2021:19:40:33] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:40:35.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:35 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3434875240' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:40:35.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:35 smithi097 ceph-mon[41966]: 5.9 scrub ok 2021-10-08T19:40:35.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:35 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:40:35.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:35 smithi117 ceph-mon[34585]: 172.21.15.117 - - [08/Oct/2021:19:40:33] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:40:35.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:35 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3434875240' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:40:35.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:35 smithi117 ceph-mon[34585]: 5.9 scrub ok 2021-10-08T19:40:36.441 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:40:36.444 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:36.445 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:40:36.546 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:40:36.610 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:36.699 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 87 16 110901 110885 79.6272 68.125 0.00864925 0.0125541 2021-10-08T19:40:36.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:36 smithi097 ceph-mon[32687]: pgmap v963: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 6.6 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1.2 KiB/s rd, 76 MiB/s wr, 1.21k op/s 2021-10-08T19:40:36.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:36 smithi097 ceph-mon[41966]: pgmap v963: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 6.6 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1.2 KiB/s rd, 76 MiB/s wr, 1.21k op/s 2021-10-08T19:40:36.807 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2021-10-08T19:40:36.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:36 smithi117 ceph-mon[34585]: pgmap v963: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 6.6 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1.2 KiB/s rd, 76 MiB/s wr, 1.21k op/s 2021-10-08T19:40:37.062 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:40:37.067 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:37.069 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:40:37.087 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:40:37.170 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:40:37.196 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:37.276 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:40:37.279 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:37.280 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:40:37.381 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:40:37.433 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:37.522 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:40:37 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:40:37.587 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:40:37.588 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:40:37.591 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:37 smithi097 ceph-mon[32687]: 2.b scrub ok 2021-10-08T19:40:37.592 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:37 smithi097 ceph-mon[32687]: 2.24 scrub ok 2021-10-08T19:40:37.592 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:37 smithi097 ceph-mon[32687]: pgmap v964: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 6.6 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1.1 KiB/s rd, 68 MiB/s wr, 1.10k op/s 2021-10-08T19:40:37.593 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:37 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:40:37.593 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:37 smithi097 ceph-mon[41966]: 2.b scrub ok 2021-10-08T19:40:37.594 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:37 smithi097 ceph-mon[41966]: 2.24 scrub ok 2021-10-08T19:40:37.594 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:37 smithi097 ceph-mon[41966]: pgmap v964: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 6.6 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1.1 KiB/s rd, 68 MiB/s wr, 1.10k op/s 2021-10-08T19:40:37.595 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:37 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:40:37.599 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:37.601 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:40:37.702 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:40:37.703 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 88 16 111847 111831 79.3917 59.125 0.0160285 0.0125902 2021-10-08T19:40:37.773 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:37.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:37 smithi117 ceph-mon[34585]: 2.b scrub ok 2021-10-08T19:40:37.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:37 smithi117 ceph-mon[34585]: 2.24 scrub ok 2021-10-08T19:40:37.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:37 smithi117 ceph-mon[34585]: pgmap v964: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 6.6 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1.1 KiB/s rd, 68 MiB/s wr, 1.10k op/s 2021-10-08T19:40:37.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:37 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:40:38.226 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:40:38.232 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:38.233 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:40:38.334 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:40:38.368 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:38.443 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:40:38.445 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:38.446 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:40:38.548 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:40:38.554 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.7 to 1 (10000) 2021-10-08T19:40:38.575 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:38.650 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:40:38.655 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:38.655 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:40:38.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:38 smithi117 ceph-mon[34585]: 11.2 scrub ok 2021-10-08T19:40:38.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:38 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3136630638' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2021-10-08T19:40:38.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:38 smithi117 ceph-mon[34585]: from='client.36284 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2021-10-08T19:40:38.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:38 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:40:38.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:38 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:40:38.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:38 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:40:38.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:38 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:40:38.702 INFO:tasks.radosbench.radosbench.0.smithi097.stdout: 89 16 112849 112833 79.2033 62.625 0.00673176 0.0126213 2021-10-08T19:40:38.757 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:40:38.785 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:38.874 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:40:38.878 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:38.879 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:40:38.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:38 smithi097 ceph-mon[41966]: 11.2 scrub ok 2021-10-08T19:40:38.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:38 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3136630638' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2021-10-08T19:40:38.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:38 smithi097 ceph-mon[41966]: from='client.36284 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2021-10-08T19:40:38.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:38 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:40:38.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:38 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:40:38.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:38 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:40:38.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:38 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:40:38.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:38 smithi097 ceph-mon[32687]: 11.2 scrub ok 2021-10-08T19:40:38.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:38 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3136630638' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2021-10-08T19:40:38.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:38 smithi097 ceph-mon[32687]: from='client.36284 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2021-10-08T19:40:38.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:38 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:40:38.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:38 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:40:38.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:38 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:40:38.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:38 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:40:38.980 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:40:39.039 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:39.072 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2021-10-08T19:40:39.703 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Total time run: 90.0068 2021-10-08T19:40:39.703 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Total writes made: 113746 2021-10-08T19:40:39.704 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Write size: 65536 2021-10-08T19:40:39.704 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Object size: 65536 2021-10-08T19:40:39.704 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Bandwidth (MB/sec): 78.9844 2021-10-08T19:40:39.704 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Stddev Bandwidth: 29.3194 2021-10-08T19:40:39.705 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Max bandwidth (MB/sec): 202.562 2021-10-08T19:40:39.705 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Min bandwidth (MB/sec): 43.625 2021-10-08T19:40:39.705 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Average IOPS: 1263 2021-10-08T19:40:39.706 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Stddev IOPS: 469.11 2021-10-08T19:40:39.706 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Max IOPS: 3241 2021-10-08T19:40:39.707 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Min IOPS: 698 2021-10-08T19:40:39.707 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Average Latency(s): 0.0126569 2021-10-08T19:40:39.707 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Stddev Latency(s): 0.011931 2021-10-08T19:40:39.707 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Max latency(s): 0.499237 2021-10-08T19:40:39.708 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Min latency(s): 0.00117486 2021-10-08T19:40:39.710 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Cleaning up (deleting benchmark objects) 2021-10-08T19:40:39.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:39 smithi117 ceph-mon[34585]: 6.1d scrub ok 2021-10-08T19:40:39.908 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:39 smithi117 ceph-mon[34585]: from='client.36284 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]': finished 2021-10-08T19:40:39.908 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:39 smithi117 ceph-mon[34585]: osdmap e468: 8 total, 8 up, 8 in 2021-10-08T19:40:39.908 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:39 smithi117 ceph-mon[34585]: 2.18 scrub ok 2021-10-08T19:40:39.908 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:39 smithi117 ceph-mon[34585]: pgmap v966: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 6.7 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 639 B/s rd, 52 MiB/s wr, 834 op/s 2021-10-08T19:40:39.952 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:40:39.954 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:39 smithi097 ceph-mon[41966]: 6.1d scrub ok 2021-10-08T19:40:39.954 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:39 smithi097 ceph-mon[41966]: from='client.36284 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]': finished 2021-10-08T19:40:39.954 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:39 smithi097 ceph-mon[41966]: osdmap e468: 8 total, 8 up, 8 in 2021-10-08T19:40:39.954 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:39 smithi097 ceph-mon[41966]: 2.18 scrub ok 2021-10-08T19:40:39.955 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:39 smithi097 ceph-mon[41966]: pgmap v966: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 6.7 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 639 B/s rd, 52 MiB/s wr, 834 op/s 2021-10-08T19:40:39.955 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:39.959 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:40:39.960 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:39 smithi097 ceph-mon[32687]: 6.1d scrub ok 2021-10-08T19:40:39.960 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:39 smithi097 ceph-mon[32687]: from='client.36284 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]': finished 2021-10-08T19:40:39.960 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:39 smithi097 ceph-mon[32687]: osdmap e468: 8 total, 8 up, 8 in 2021-10-08T19:40:39.960 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:39 smithi097 ceph-mon[32687]: 2.18 scrub ok 2021-10-08T19:40:39.961 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:39 smithi097 ceph-mon[32687]: pgmap v966: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 6.7 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 639 B/s rd, 52 MiB/s wr, 834 op/s 2021-10-08T19:40:40.060 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:40:40.084 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:40.586 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd reweight 6 1 2021-10-08T19:40:40.636 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:40:40.640 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:40.642 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:40:40.667 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:40:40.744 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:40:40.778 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:40.838 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:40:40.839 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:40 smithi117 ceph-mon[34585]: 5.6 scrub ok 2021-10-08T19:40:40.839 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:40 smithi117 ceph-mon[34585]: 2.12 scrub ok 2021-10-08T19:40:40.841 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:40.841 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:40:40.913 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:40 smithi097 ceph-mon[32687]: 5.6 scrub ok 2021-10-08T19:40:40.913 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:40 smithi097 ceph-mon[32687]: 2.12 scrub ok 2021-10-08T19:40:40.913 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:40 smithi097 ceph-mon[41966]: 5.6 scrub ok 2021-10-08T19:40:40.914 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:40 smithi097 ceph-mon[41966]: 2.12 scrub ok 2021-10-08T19:40:40.942 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:40:41.005 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:41.313 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:40:41.320 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:41.322 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:40:41.424 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:40:41.449 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:41.500 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:40:41.504 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2021-10-08T19:40:41.504 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:40:41.505 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:41.506 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:40:41.607 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:40:41.701 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:41.916 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:41 smithi117 ceph-mon[34585]: 4.3 scrub ok 2021-10-08T19:40:41.916 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:41 smithi117 ceph-mon[34585]: 6.f scrub ok 2021-10-08T19:40:41.917 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:41 smithi117 ceph-mon[34585]: 4.18 scrub ok 2021-10-08T19:40:41.917 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:41 smithi117 ceph-mon[34585]: 2.1d scrub ok 2021-10-08T19:40:41.917 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:41 smithi117 ceph-mon[34585]: pgmap v967: 188 pgs: 188 active+clean; 6.9 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 1.1 KiB/s rd, 65 MiB/s wr, 1.05k op/s 2021-10-08T19:40:41.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:41 smithi097 ceph-mon[41966]: 4.3 scrub ok 2021-10-08T19:40:41.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:41 smithi097 ceph-mon[41966]: 6.f scrub ok 2021-10-08T19:40:41.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:41 smithi097 ceph-mon[41966]: 4.18 scrub ok 2021-10-08T19:40:41.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:41 smithi097 ceph-mon[41966]: 2.1d scrub ok 2021-10-08T19:40:41.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:41 smithi097 ceph-mon[41966]: pgmap v967: 188 pgs: 188 active+clean; 6.9 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 1.1 KiB/s rd, 65 MiB/s wr, 1.05k op/s 2021-10-08T19:40:41.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:41 smithi097 ceph-mon[32687]: 4.3 scrub ok 2021-10-08T19:40:41.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:41 smithi097 ceph-mon[32687]: 6.f scrub ok 2021-10-08T19:40:41.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:41 smithi097 ceph-mon[32687]: 4.18 scrub ok 2021-10-08T19:40:41.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:41 smithi097 ceph-mon[32687]: 2.1d scrub ok 2021-10-08T19:40:41.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:41 smithi097 ceph-mon[32687]: pgmap v967: 188 pgs: 188 active+clean; 6.9 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 1.1 KiB/s rd, 65 MiB/s wr, 1.05k op/s 2021-10-08T19:40:42.042 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:40:42.045 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:42.046 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:40:42.148 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:40:42.181 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:42.271 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:40:42.278 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:42.278 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:40:42.380 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:40:42.438 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:42.585 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:40:42 smithi117 conmon[69189]: level=error ts=2021-10-08T19:40:42.315Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=1 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:40:42.585 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:42 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2536814432' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:40:42.586 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:42 smithi117 ceph-mon[34585]: from='client.36290 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:40:42.598 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is unset 2021-10-08T19:40:42.600 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:40:42.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:42 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2536814432' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:40:42.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:42 smithi097 ceph-mon[41966]: from='client.36290 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:40:42.721 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:40:42 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:40:42] "GET /metrics HTTP/1.1" 200 155922 "" "Prometheus/2.18.1" 2021-10-08T19:40:42.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:42 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2536814432' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:40:42.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:42 smithi097 ceph-mon[32687]: from='client.36290 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:40:42.998 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:40:43.002 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:43.003 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:40:43.105 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:40:43.138 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:43.217 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:40:43.221 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:43.222 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:40:43.323 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:40:43.366 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:43.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:43 smithi097 ceph-mon[32687]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:40:43.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:43 smithi097 ceph-mon[32687]: Cluster is now healthy 2021-10-08T19:40:43.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:43 smithi097 ceph-mon[32687]: from='client.36290 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:40:43.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:43 smithi097 ceph-mon[32687]: osdmap e469: 8 total, 8 up, 8 in 2021-10-08T19:40:43.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:40:43.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:40:43.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:43 smithi097 ceph-mon[32687]: pgmap v969: 188 pgs: 188 active+clean; 6.9 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 639 B/s rd, 38 MiB/s wr, 609 op/s 2021-10-08T19:40:43.724 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:43 smithi097 ceph-mon[32687]: 4.7 scrub ok 2021-10-08T19:40:43.725 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:43 smithi097 ceph-mon[41966]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:40:43.726 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:43 smithi097 ceph-mon[41966]: Cluster is now healthy 2021-10-08T19:40:43.727 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:43 smithi097 ceph-mon[41966]: from='client.36290 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:40:43.727 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:43 smithi097 ceph-mon[41966]: osdmap e469: 8 total, 8 up, 8 in 2021-10-08T19:40:43.728 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:40:43.728 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:40:43.729 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:43 smithi097 ceph-mon[41966]: pgmap v969: 188 pgs: 188 active+clean; 6.9 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 639 B/s rd, 38 MiB/s wr, 609 op/s 2021-10-08T19:40:43.729 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:43 smithi097 ceph-mon[41966]: 4.7 scrub ok 2021-10-08T19:40:43.868 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:40:43 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:40:43] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:40:43.869 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:43 smithi117 ceph-mon[34585]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:40:43.869 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:43 smithi117 ceph-mon[34585]: Cluster is now healthy 2021-10-08T19:40:43.869 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:43 smithi117 ceph-mon[34585]: from='client.36290 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:40:43.870 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:43 smithi117 ceph-mon[34585]: osdmap e469: 8 total, 8 up, 8 in 2021-10-08T19:40:43.870 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:40:43.870 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:40:43.870 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:43 smithi117 ceph-mon[34585]: pgmap v969: 188 pgs: 188 active+clean; 6.9 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 639 B/s rd, 38 MiB/s wr, 609 op/s 2021-10-08T19:40:43.871 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:43 smithi117 ceph-mon[34585]: 4.7 scrub ok 2021-10-08T19:40:43.873 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2021-10-08T19:40:44.649 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:40:44.655 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:44.655 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:40:44.756 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:40:44.791 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:44.851 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:40:44.852 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:44.853 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:40:44.853 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:44 smithi117 ceph-mon[34585]: 11.d scrub ok 2021-10-08T19:40:44.854 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:44 smithi117 ceph-mon[34585]: 3.4 scrub ok 2021-10-08T19:40:44.854 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:44 smithi117 ceph-mon[34585]: 3.7 scrub ok 2021-10-08T19:40:44.864 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:44 smithi097 ceph-mon[32687]: 11.d scrub ok 2021-10-08T19:40:44.864 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:44 smithi097 ceph-mon[32687]: 3.4 scrub ok 2021-10-08T19:40:44.865 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:44 smithi097 ceph-mon[32687]: 3.7 scrub ok 2021-10-08T19:40:44.865 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:44 smithi097 ceph-mon[41966]: 11.d scrub ok 2021-10-08T19:40:44.865 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:44 smithi097 ceph-mon[41966]: 3.4 scrub ok 2021-10-08T19:40:44.866 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:44 smithi097 ceph-mon[41966]: 3.7 scrub ok 2021-10-08T19:40:44.954 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:40:44.986 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:45.048 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:40:45.050 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:45.051 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:40:45.153 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:40:45.187 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:45.247 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:40:45.251 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:45.251 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:40:45.353 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:40:45.381 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:45.411 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:40:45.444 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:40:45.445 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:40:45.447 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:45.448 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:40:45.485 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:40:45.519 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:40:45.551 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:40:45.561 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:40:45.591 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:45.596 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:40:45.633 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:40:45.644 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:40:45.648 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:45.649 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:40:45.667 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:40:45.703 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:40:45.707 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true' 2021-10-08T19:40:45.707 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true' 2021-10-08T19:40:45.708 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true' 2021-10-08T19:40:45.708 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true' 2021-10-08T19:40:45.708 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true' 2021-10-08T19:40:45.708 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true' 2021-10-08T19:40:45.709 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'true' 2021-10-08T19:40:45.709 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'true' 2021-10-08T19:40:45.750 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:40:45.778 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:45 smithi117 ceph-mon[34585]: pgmap v970: 188 pgs: 188 active+clean; 6.7 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 1.4 KiB/s rd, 42 MiB/s wr, 1.24k op/s 2021-10-08T19:40:45.779 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:45 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3861468322' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:40:45.780 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:45.836 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:40:45.840 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:45.841 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:40:45.944 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:40:45.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:45 smithi097 ceph-mon[41966]: pgmap v970: 188 pgs: 188 active+clean; 6.7 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 1.4 KiB/s rd, 42 MiB/s wr, 1.24k op/s 2021-10-08T19:40:45.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:45 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3861468322' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:40:45.973 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:45 smithi097 ceph-mon[32687]: pgmap v970: 188 pgs: 188 active+clean; 6.7 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 1.4 KiB/s rd, 42 MiB/s wr, 1.24k op/s 2021-10-08T19:40:45.979 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:45 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3861468322' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:40:46.002 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:46.790 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set noscrub 2021-10-08T19:40:47.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:46 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:40:47.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:46 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:40:47.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:46 smithi117 ceph-mon[34585]: 2.6 deep-scrub ok 2021-10-08T19:40:47.211 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:40:47.214 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:46 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:40:47.214 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:46 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:40:47.214 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:46 smithi097 ceph-mon[32687]: 2.6 deep-scrub ok 2021-10-08T19:40:47.215 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:47.215 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:46 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:40:47.215 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:46 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:40:47.216 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:46 smithi097 ceph-mon[41966]: 2.6 deep-scrub ok 2021-10-08T19:40:47.216 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:40:47.318 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:40:47.354 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:47.424 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:40:47.429 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:47.430 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:40:47.531 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:40:47.563 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:47.644 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:40:47.645 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:40:47 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:40:47.646 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:47.647 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:40:47.748 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:40:47.809 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:48.058 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:47 smithi097 ceph-mon[41966]: 2.21 deep-scrub ok 2021-10-08T19:40:48.059 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:47 smithi097 ceph-mon[41966]: osdmap e470: 8 total, 8 up, 8 in 2021-10-08T19:40:48.059 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:47 smithi097 ceph-mon[41966]: pgmap v972: 188 pgs: 188 active+clean; 6.7 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 1.4 KiB/s rd, 26 MiB/s wr, 978 op/s 2021-10-08T19:40:48.059 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:47 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:40:48.066 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:47 smithi097 ceph-mon[32687]: 2.21 deep-scrub ok 2021-10-08T19:40:48.066 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:47 smithi097 ceph-mon[32687]: osdmap e470: 8 total, 8 up, 8 in 2021-10-08T19:40:48.073 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:47 smithi097 ceph-mon[32687]: pgmap v972: 188 pgs: 188 active+clean; 6.7 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 1.4 KiB/s rd, 26 MiB/s wr, 978 op/s 2021-10-08T19:40:48.073 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:47 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:40:48.149 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:40:48.156 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:48.157 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:40:48.258 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:40:48.313 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:48.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:47 smithi117 ceph-mon[34585]: 2.21 deep-scrub ok 2021-10-08T19:40:48.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:47 smithi117 ceph-mon[34585]: osdmap e470: 8 total, 8 up, 8 in 2021-10-08T19:40:48.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:47 smithi117 ceph-mon[34585]: pgmap v972: 188 pgs: 188 active+clean; 6.7 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 1.4 KiB/s rd, 26 MiB/s wr, 978 op/s 2021-10-08T19:40:48.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:47 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:40:48.523 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:40:48.529 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:48.530 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:40:48.633 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:40:48.647 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:40:48.683 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:48.747 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:48.748 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:40:48.748 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:40:48.849 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:40:48.881 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:48.939 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:48 smithi097 ceph-mon[41966]: 3.14 scrub ok 2021-10-08T19:40:48.940 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:48 smithi097 ceph-mon[41966]: 3.11 scrub ok 2021-10-08T19:40:48.940 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:48 smithi097 ceph-mon[41966]: 4.2 scrub ok 2021-10-08T19:40:48.940 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:48 smithi117 ceph-mon[34585]: 3.14 scrub ok 2021-10-08T19:40:48.941 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:48 smithi117 ceph-mon[34585]: 3.11 scrub ok 2021-10-08T19:40:48.941 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:48 smithi117 ceph-mon[34585]: 4.2 scrub ok 2021-10-08T19:40:48.948 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:40:48.954 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:48.955 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:40:49.056 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:40:49.115 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:49.225 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:48 smithi097 ceph-mon[32687]: 3.14 scrub ok 2021-10-08T19:40:49.226 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:48 smithi097 ceph-mon[32687]: 3.11 scrub ok 2021-10-08T19:40:49.226 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:48 smithi097 ceph-mon[32687]: 4.2 scrub ok 2021-10-08T19:40:49.238 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:40:49.249 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:49.250 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:40:49.365 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:40:49.423 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:49.549 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:40:49.556 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:49.557 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:40:49.659 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:40:49.696 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:49.756 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:40:49.759 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:49.760 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:40:49.862 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:40:49.906 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:49.960 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:49 smithi117 ceph-mon[34585]: 2.1a scrub ok 2021-10-08T19:40:49.960 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:49 smithi117 ceph-mon[34585]: 5.a scrub ok 2021-10-08T19:40:49.961 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:49 smithi117 ceph-mon[34585]: pgmap v973: 188 pgs: 188 active+clean; 6.5 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 767 B/s rd, 4.4 MiB/s wr, 921 op/s 2021-10-08T19:40:49.961 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:49 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3906218781' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2021-10-08T19:40:49.961 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:49 smithi117 ceph-mon[34585]: from='client.26257 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2021-10-08T19:40:49.961 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:49 smithi117 ceph-mon[34585]: 5.c scrub ok 2021-10-08T19:40:49.962 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.6 to 1 (10000) 2021-10-08T19:40:50.066 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2021-10-08T19:40:50.118 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:49 smithi097 ceph-mon[41966]: 2.1a scrub ok 2021-10-08T19:40:50.119 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:49 smithi097 ceph-mon[41966]: 5.a scrub ok 2021-10-08T19:40:50.119 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:49 smithi097 ceph-mon[41966]: pgmap v973: 188 pgs: 188 active+clean; 6.5 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 767 B/s rd, 4.4 MiB/s wr, 921 op/s 2021-10-08T19:40:50.120 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:49 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3906218781' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2021-10-08T19:40:50.120 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:49 smithi097 ceph-mon[41966]: from='client.26257 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2021-10-08T19:40:50.120 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:49 smithi097 ceph-mon[41966]: 5.c scrub ok 2021-10-08T19:40:50.124 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:49 smithi097 ceph-mon[32687]: 2.1a scrub ok 2021-10-08T19:40:50.124 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:49 smithi097 ceph-mon[32687]: 5.a scrub ok 2021-10-08T19:40:50.125 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:49 smithi097 ceph-mon[32687]: pgmap v973: 188 pgs: 188 active+clean; 6.5 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 767 B/s rd, 4.4 MiB/s wr, 921 op/s 2021-10-08T19:40:50.125 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:49 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3906218781' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2021-10-08T19:40:50.125 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:49 smithi097 ceph-mon[32687]: from='client.26257 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2021-10-08T19:40:50.125 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:49 smithi097 ceph-mon[32687]: 5.c scrub ok 2021-10-08T19:40:51.031 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:40:51.036 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:51.038 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:40:51.139 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:40:51.175 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:51.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:50 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:40:51.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:50 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:40:51.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:50 smithi097 ceph-mon[32687]: 4.a scrub ok 2021-10-08T19:40:51.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:50 smithi097 ceph-mon[32687]: from='client.26257 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]': finished 2021-10-08T19:40:51.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:50 smithi097 ceph-mon[32687]: osdmap e471: 8 total, 8 up, 8 in 2021-10-08T19:40:51.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:50 smithi097 ceph-mon[32687]: 6.0 deep-scrub ok 2021-10-08T19:40:51.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:50 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:40:51.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:50 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:40:51.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:50 smithi097 ceph-mon[41966]: 4.a scrub ok 2021-10-08T19:40:51.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:50 smithi097 ceph-mon[41966]: from='client.26257 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]': finished 2021-10-08T19:40:51.228 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:50 smithi097 ceph-mon[41966]: osdmap e471: 8 total, 8 up, 8 in 2021-10-08T19:40:51.228 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:50 smithi097 ceph-mon[41966]: 6.0 deep-scrub ok 2021-10-08T19:40:51.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:50 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:40:51.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:50 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:40:51.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:50 smithi117 ceph-mon[34585]: 4.a scrub ok 2021-10-08T19:40:51.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:50 smithi117 ceph-mon[34585]: from='client.26257 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]': finished 2021-10-08T19:40:51.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:50 smithi117 ceph-mon[34585]: osdmap e471: 8 total, 8 up, 8 in 2021-10-08T19:40:51.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:50 smithi117 ceph-mon[34585]: 6.0 deep-scrub ok 2021-10-08T19:40:51.829 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd reweight 1 1 2021-10-08T19:40:51.899 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:40:51.908 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:51.909 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:40:52.010 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:40:52.082 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:51 smithi097 ceph-mon[32687]: 6.1a scrub ok 2021-10-08T19:40:52.083 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:51 smithi097 ceph-mon[32687]: pgmap v975: 188 pgs: 188 active+clean; 6.3 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1.4 KiB/s rd, 4.4 MiB/s wr, 1.30k op/s 2021-10-08T19:40:52.083 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:51 smithi097 ceph-mon[41966]: 6.1a scrub ok 2021-10-08T19:40:52.083 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:51 smithi097 ceph-mon[41966]: pgmap v975: 188 pgs: 188 active+clean; 6.3 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1.4 KiB/s rd, 4.4 MiB/s wr, 1.30k op/s 2021-10-08T19:40:52.084 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:52.196 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:40:52.200 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:52.201 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:40:52.302 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:40:52.316 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:51 smithi117 ceph-mon[34585]: 6.1a scrub ok 2021-10-08T19:40:52.316 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:51 smithi117 ceph-mon[34585]: pgmap v975: 188 pgs: 188 active+clean; 6.3 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1.4 KiB/s rd, 4.4 MiB/s wr, 1.30k op/s 2021-10-08T19:40:52.347 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:52.492 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:40:52.497 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:52.498 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:40:52.599 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:40:52.626 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:40:52 smithi117 conmon[69189]: level=error ts=2021-10-08T19:40:52.315Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=1 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:40:52.633 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:52.705 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:40:52.708 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:52.708 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:40:52.810 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:40:52.837 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:52.846 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:40:52.888 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:40:52.889 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:52.890 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:40:52.970 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:40:52 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:40:52] "GET /metrics HTTP/1.1" 200 155922 "" "Prometheus/2.18.1" 2021-10-08T19:40:52.992 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:40:53.040 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:40:53.040 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2021-10-08T19:40:53.041 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2021-10-08T19:40:53.041 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2021-10-08T19:40:53.041 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.042 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.25465.0:77499 9.5 9:ac4969c9:::benchmark_data_smithi097_196985_object77498:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e316)", 2021-10-08T19:40:53.042 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:32:38.365704+0000", 2021-10-08T19:40:53.042 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 494.66898750299998, 2021-10-08T19:40:53.042 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.218248098, 2021-10-08T19:40:53.043 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:40:53.043 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:40:53.043 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:40:53.043 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.25465", 2021-10-08T19:40:53.043 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:40:53.044 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 77499 2021-10-08T19:40:53.044 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.044 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:40:53.044 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.045 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:40:53.045 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.365704+0000", 2021-10-08T19:40:53.045 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:40:53.045 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.045 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.046 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:40:53.047 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.365704+0000", 2021-10-08T19:40:53.047 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:40:53.048 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.048 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.048 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:40:53.048 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.365703+0000", 2021-10-08T19:40:53.049 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:40:53.049 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.049 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.049 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:40:53.049 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.365732+0000", 2021-10-08T19:40:53.050 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9413000000000001e-05 2021-10-08T19:40:53.050 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.050 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.050 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:40:53.051 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.365740+0000", 2021-10-08T19:40:53.051 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.9799999999999998e-06 2021-10-08T19:40:53.051 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.051 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.051 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:40:53.052 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.365746+0000", 2021-10-08T19:40:53.052 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5180000000000004e-06 2021-10-08T19:40:53.052 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.052 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.052 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:40:53.053 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.365833+0000", 2021-10-08T19:40:53.053 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6839e-05 2021-10-08T19:40:53.053 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.053 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.054 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:40:53.054 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.365980+0000", 2021-10-08T19:40:53.054 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014722699999999999 2021-10-08T19:40:53.054 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.054 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.055 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5,7", 2021-10-08T19:40:53.055 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.366140+0000", 2021-10-08T19:40:53.055 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000159724 2021-10-08T19:40:53.055 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.056 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.056 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:53.056 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.374408+0000", 2021-10-08T19:40:53.056 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0082680989999999992 2021-10-08T19:40:53.056 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.057 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.057 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:40:53.057 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.374700+0000", 2021-10-08T19:40:53.058 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00029231899999999998 2021-10-08T19:40:53.058 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.058 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.058 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:53.059 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.583849+0000", 2021-10-08T19:40:53.059 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.209148682 2021-10-08T19:40:53.059 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.059 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.060 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:40:53.060 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.583907+0000", 2021-10-08T19:40:53.060 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8595999999999999e-05 2021-10-08T19:40:53.060 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.060 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.061 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:40:53.061 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.583952+0000", 2021-10-08T19:40:53.061 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4725000000000003e-05 2021-10-08T19:40:53.061 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:40:53.061 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:40:53.062 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:40:53.062 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.062 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.062 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.25465.0:77503 9.5 9:a86a20e3:::benchmark_data_smithi097_196985_object77502:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e316)", 2021-10-08T19:40:53.063 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:32:38.365758+0000", 2021-10-08T19:40:53.063 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 494.66893335700001, 2021-10-08T19:40:53.063 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.21830512399999999, 2021-10-08T19:40:53.063 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:40:53.063 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:40:53.064 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:40:53.064 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.25465", 2021-10-08T19:40:53.064 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:40:53.064 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 77503 2021-10-08T19:40:53.065 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.065 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:40:53.065 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.065 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:40:53.065 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.365758+0000", 2021-10-08T19:40:53.066 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:40:53.066 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.066 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.066 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:40:53.067 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.365758+0000", 2021-10-08T19:40:53.067 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:40:53.067 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.067 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.067 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:40:53.068 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.365757+0000", 2021-10-08T19:40:53.068 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:40:53.068 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.069 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.069 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:40:53.069 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.365780+0000", 2021-10-08T19:40:53.069 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3122e-05 2021-10-08T19:40:53.070 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.070 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.070 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:40:53.070 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.365787+0000", 2021-10-08T19:40:53.070 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2590000000000003e-06 2021-10-08T19:40:53.071 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.071 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.071 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:40:53.071 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.365792+0000", 2021-10-08T19:40:53.071 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6299999999999997e-06 2021-10-08T19:40:53.072 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.072 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.072 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:40:53.072 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.368908+0000", 2021-10-08T19:40:53.073 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031160990000000002 2021-10-08T19:40:53.073 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.073 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.073 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:40:53.073 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.369030+0000", 2021-10-08T19:40:53.074 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000121586 2021-10-08T19:40:53.074 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.074 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.074 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5,7", 2021-10-08T19:40:53.074 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.369198+0000", 2021-10-08T19:40:53.075 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016790899999999999 2021-10-08T19:40:53.075 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.075 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.075 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:40:53.076 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.374707+0000", 2021-10-08T19:40:53.076 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0055095439999999999 2021-10-08T19:40:53.076 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.076 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.076 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:53.077 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.378362+0000", 2021-10-08T19:40:53.078 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0036545200000000001 2021-10-08T19:40:53.078 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.078 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.078 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:53.079 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.583999+0000", 2021-10-08T19:40:53.079 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.205637458 2021-10-08T19:40:53.079 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.079 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.079 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:40:53.080 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.584040+0000", 2021-10-08T19:40:53.080 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1136000000000001e-05 2021-10-08T19:40:53.080 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.080 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.080 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:40:53.081 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:32:38.584063+0000", 2021-10-08T19:40:53.081 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2898999999999999e-05 2021-10-08T19:40:53.081 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:40:53.081 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:40:53.082 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:40:53.082 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.082 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.082 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.25465.0:196909 9.b 9:d3161f3e:::benchmark_data_smithi097_196985_object81218:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e341)", 2021-10-08T19:40:53.083 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:34:26.373452+0000", 2021-10-08T19:40:53.083 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 386.66123994899999, 2021-10-08T19:40:53.083 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.29762082699999998, 2021-10-08T19:40:53.083 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:40:53.083 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:40:53.084 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:40:53.084 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.25465", 2021-10-08T19:40:53.084 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:40:53.084 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 196909 2021-10-08T19:40:53.084 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.085 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:40:53.085 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.085 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:40:53.085 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.373452+0000", 2021-10-08T19:40:53.086 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:40:53.086 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.086 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.086 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:40:53.087 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.373452+0000", 2021-10-08T19:40:53.087 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:40:53.087 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.087 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.087 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:40:53.088 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.373451+0000", 2021-10-08T19:40:53.088 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:40:53.088 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.088 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.089 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:40:53.089 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.373454+0000", 2021-10-08T19:40:53.089 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6830000000000001e-06 2021-10-08T19:40:53.090 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.090 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.090 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:40:53.090 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.373460+0000", 2021-10-08T19:40:53.091 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8629999999999996e-06 2021-10-08T19:40:53.091 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.091 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.091 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:40:53.091 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.373465+0000", 2021-10-08T19:40:53.092 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4560000000000002e-06 2021-10-08T19:40:53.092 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.092 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.092 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:40:53.092 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.378034+0000", 2021-10-08T19:40:53.093 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0045690009999999996 2021-10-08T19:40:53.093 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.093 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.093 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:40:53.094 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.378139+0000", 2021-10-08T19:40:53.094 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000104813 2021-10-08T19:40:53.094 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.094 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.094 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5,6", 2021-10-08T19:40:53.095 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.378241+0000", 2021-10-08T19:40:53.095 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000102816 2021-10-08T19:40:53.095 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.096 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.096 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:53.096 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.382310+0000", 2021-10-08T19:40:53.096 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0040688900000000004 2021-10-08T19:40:53.096 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.097 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.097 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:40:53.097 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.382322+0000", 2021-10-08T19:40:53.097 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1875999999999999e-05 2021-10-08T19:40:53.098 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.098 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.098 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:53.098 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.670947+0000", 2021-10-08T19:40:53.098 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.28862520800000002 2021-10-08T19:40:53.099 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.099 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.099 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:40:53.099 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.671025+0000", 2021-10-08T19:40:53.099 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7998999999999996e-05 2021-10-08T19:40:53.100 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.100 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.100 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:40:53.100 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.671072+0000", 2021-10-08T19:40:53.101 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6992e-05 2021-10-08T19:40:53.101 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:40:53.101 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:40:53.101 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:40:53.101 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.102 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.102 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.25465.0:196921 9.b 9:dd1735bf:::benchmark_data_smithi097_196985_object81230:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e341)", 2021-10-08T19:40:53.102 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:34:26.382586+0000", 2021-10-08T19:40:53.102 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 386.652105936, 2021-10-08T19:40:53.103 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.28861674900000001, 2021-10-08T19:40:53.103 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:40:53.103 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:40:53.103 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:40:53.103 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.25465", 2021-10-08T19:40:53.104 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:40:53.104 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 196921 2021-10-08T19:40:53.104 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.105 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:40:53.106 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.107 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:40:53.107 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.382586+0000", 2021-10-08T19:40:53.108 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:40:53.108 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.108 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.108 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:40:53.109 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.382586+0000", 2021-10-08T19:40:53.109 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:40:53.109 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.109 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.109 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:40:53.110 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.382584+0000", 2021-10-08T19:40:53.110 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:40:53.110 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.110 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.111 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:40:53.111 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.382590+0000", 2021-10-08T19:40:53.111 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8039999999999998e-06 2021-10-08T19:40:53.111 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.111 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.112 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:40:53.112 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.382601+0000", 2021-10-08T19:40:53.112 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1226000000000001e-05 2021-10-08T19:40:53.112 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.112 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.113 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:40:53.113 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.382607+0000", 2021-10-08T19:40:53.113 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7509999999999997e-06 2021-10-08T19:40:53.113 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.114 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.114 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:40:53.114 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.382650+0000", 2021-10-08T19:40:53.114 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2886000000000002e-05 2021-10-08T19:40:53.114 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.115 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.115 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:40:53.115 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.382768+0000", 2021-10-08T19:40:53.115 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000118529 2021-10-08T19:40:53.115 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.116 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.116 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5,6", 2021-10-08T19:40:53.116 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.382899+0000", 2021-10-08T19:40:53.116 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013076799999999999 2021-10-08T19:40:53.117 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.117 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.117 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:53.118 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.388100+0000", 2021-10-08T19:40:53.118 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0052012300000000003 2021-10-08T19:40:53.118 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.118 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.118 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:40:53.119 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.388755+0000", 2021-10-08T19:40:53.119 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065508199999999997 2021-10-08T19:40:53.119 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.119 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.120 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:53.120 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.671120+0000", 2021-10-08T19:40:53.120 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.28236478799999998 2021-10-08T19:40:53.120 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.120 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.121 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:40:53.121 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.671160+0000", 2021-10-08T19:40:53.121 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0522999999999998e-05 2021-10-08T19:40:53.121 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.121 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.122 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:40:53.122 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.671202+0000", 2021-10-08T19:40:53.122 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1845999999999999e-05 2021-10-08T19:40:53.122 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:40:53.123 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:40:53.123 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:40:53.123 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.123 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.123 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.25465.0:196925 9.5 9:ac405794:::benchmark_data_smithi097_196985_object81234:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e341)", 2021-10-08T19:40:53.124 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:34:26.386316+0000", 2021-10-08T19:40:53.124 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 386.64837516599999, 2021-10-08T19:40:53.124 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.29086161999999999, 2021-10-08T19:40:53.124 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:40:53.124 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:40:53.125 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:40:53.125 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.25465", 2021-10-08T19:40:53.125 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:40:53.125 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 196925 2021-10-08T19:40:53.126 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.126 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:40:53.126 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.126 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:40:53.126 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.386316+0000", 2021-10-08T19:40:53.127 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:40:53.127 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.127 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.127 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:40:53.127 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.386316+0000", 2021-10-08T19:40:53.128 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:40:53.128 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.128 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.128 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:40:53.129 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.386314+0000", 2021-10-08T19:40:53.129 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:40:53.129 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.129 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.129 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:40:53.130 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.386322+0000", 2021-10-08T19:40:53.130 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4669999999999998e-06 2021-10-08T19:40:53.130 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.130 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.131 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:40:53.131 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.386335+0000", 2021-10-08T19:40:53.131 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3692999999999999e-05 2021-10-08T19:40:53.131 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.131 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.132 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:40:53.132 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.386342+0000", 2021-10-08T19:40:53.132 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3709999999999996e-06 2021-10-08T19:40:53.132 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.132 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.133 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:40:53.133 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.386395+0000", 2021-10-08T19:40:53.133 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3667e-05 2021-10-08T19:40:53.133 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.134 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.134 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:40:53.134 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.386540+0000", 2021-10-08T19:40:53.134 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000144802 2021-10-08T19:40:53.134 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.135 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.135 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5,7", 2021-10-08T19:40:53.135 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.386673+0000", 2021-10-08T19:40:53.135 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013296799999999999 2021-10-08T19:40:53.135 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.136 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.136 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:40:53.136 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.388773+0000", 2021-10-08T19:40:53.136 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0020994160000000002 2021-10-08T19:40:53.137 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.137 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.137 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:53.137 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.389104+0000", 2021-10-08T19:40:53.137 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00033187400000000001 2021-10-08T19:40:53.138 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.138 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.138 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:53.138 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.677085+0000", 2021-10-08T19:40:53.138 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.28798012000000001 2021-10-08T19:40:53.139 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.139 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.139 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:40:53.139 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.677139+0000", 2021-10-08T19:40:53.140 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4388999999999997e-05 2021-10-08T19:40:53.140 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.140 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.140 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:40:53.140 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.677178+0000", 2021-10-08T19:40:53.141 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9005999999999999e-05 2021-10-08T19:40:53.141 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:40:53.141 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:40:53.141 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:40:53.141 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.142 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.142 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.25465.0:196928 9.b 9:d665e198:::benchmark_data_smithi097_196985_object81237:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e341)", 2021-10-08T19:40:53.142 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:34:26.389260+0000", 2021-10-08T19:40:53.142 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 386.64543143899999, 2021-10-08T19:40:53.143 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.28951838899999999, 2021-10-08T19:40:53.143 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:40:53.143 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:40:53.144 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:40:53.144 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.25465", 2021-10-08T19:40:53.144 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:40:53.144 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 196928 2021-10-08T19:40:53.144 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.145 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:40:53.145 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.145 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:40:53.145 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.389260+0000", 2021-10-08T19:40:53.146 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:40:53.146 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.146 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.146 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:40:53.146 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.389260+0000", 2021-10-08T19:40:53.147 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:40:53.147 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.147 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.147 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:40:53.148 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.389258+0000", 2021-10-08T19:40:53.148 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:40:53.148 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.148 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.149 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:40:53.149 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.389264+0000", 2021-10-08T19:40:53.149 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2600000000000002e-06 2021-10-08T19:40:53.149 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.149 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.150 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:40:53.150 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.389273+0000", 2021-10-08T19:40:53.150 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9930000000000001e-06 2021-10-08T19:40:53.150 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.151 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.151 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:40:53.151 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.389279+0000", 2021-10-08T19:40:53.151 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1390000000000003e-06 2021-10-08T19:40:53.151 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.152 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.152 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:40:53.152 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.389319+0000", 2021-10-08T19:40:53.152 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0753000000000001e-05 2021-10-08T19:40:53.153 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.153 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.153 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:40:53.154 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.389437+0000", 2021-10-08T19:40:53.154 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000117525 2021-10-08T19:40:53.154 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.155 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.155 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5,6", 2021-10-08T19:40:53.155 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.389559+0000", 2021-10-08T19:40:53.155 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012188099999999999 2021-10-08T19:40:53.155 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.156 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.156 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:53.156 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.392094+0000", 2021-10-08T19:40:53.156 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0025352909999999998 2021-10-08T19:40:53.157 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.157 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.157 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:40:53.157 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.392234+0000", 2021-10-08T19:40:53.157 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000140137 2021-10-08T19:40:53.158 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.158 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.158 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:53.158 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.678693+0000", 2021-10-08T19:40:53.159 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.28645897199999998 2021-10-08T19:40:53.159 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.159 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.159 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:40:53.160 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.678740+0000", 2021-10-08T19:40:53.160 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6947000000000003e-05 2021-10-08T19:40:53.160 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.160 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.160 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:40:53.161 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.678778+0000", 2021-10-08T19:40:53.161 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8306999999999998e-05 2021-10-08T19:40:53.161 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:40:53.161 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:40:53.162 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:40:53.162 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.162 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.162 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.25465.0:196929 9.9 9:97d8a271:::benchmark_data_smithi097_196985_object81238:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e341)", 2021-10-08T19:40:53.162 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:34:26.389290+0000", 2021-10-08T19:40:53.163 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 386.64540167400003, 2021-10-08T19:40:53.163 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.28974777299999999, 2021-10-08T19:40:53.163 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:40:53.163 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:40:53.163 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:40:53.164 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.25465", 2021-10-08T19:40:53.164 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:40:53.164 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 196929 2021-10-08T19:40:53.164 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.165 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:40:53.165 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.165 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:40:53.165 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.389290+0000", 2021-10-08T19:40:53.166 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:40:53.166 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.166 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.166 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:40:53.167 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.389290+0000", 2021-10-08T19:40:53.167 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:40:53.167 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.167 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.168 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:40:53.168 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.389289+0000", 2021-10-08T19:40:53.168 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:40:53.168 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.168 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.169 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:40:53.169 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.389292+0000", 2021-10-08T19:40:53.169 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3469999999999999e-06 2021-10-08T19:40:53.169 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.169 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.170 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:40:53.170 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.389296+0000", 2021-10-08T19:40:53.170 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8240000000000001e-06 2021-10-08T19:40:53.170 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.171 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.171 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:40:53.171 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.389299+0000", 2021-10-08T19:40:53.172 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.79e-06 2021-10-08T19:40:53.172 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.172 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.172 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:40:53.172 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.389337+0000", 2021-10-08T19:40:53.173 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8405000000000002e-05 2021-10-08T19:40:53.173 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.173 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.173 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:40:53.174 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.389413+0000", 2021-10-08T19:40:53.174 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5648999999999993e-05 2021-10-08T19:40:53.174 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.174 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.174 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5,7", 2021-10-08T19:40:53.175 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.389490+0000", 2021-10-08T19:40:53.175 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6394000000000001e-05 2021-10-08T19:40:53.175 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.175 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.175 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:40:53.176 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.391545+0000", 2021-10-08T19:40:53.176 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0020555199999999999 2021-10-08T19:40:53.176 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.176 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.177 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:53.177 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.392409+0000", 2021-10-08T19:40:53.177 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00086392200000000004 2021-10-08T19:40:53.177 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.177 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.178 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:53.178 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.678952+0000", 2021-10-08T19:40:53.178 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.28654300100000002 2021-10-08T19:40:53.179 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.179 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.179 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:40:53.179 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.678999+0000", 2021-10-08T19:40:53.179 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7131e-05 2021-10-08T19:40:53.180 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.181 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.181 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:40:53.181 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.679038+0000", 2021-10-08T19:40:53.183 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8507999999999998e-05 2021-10-08T19:40:53.183 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:40:53.183 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:40:53.183 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:40:53.184 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.184 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.184 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.25465.0:196931 9.b 9:dfa4ef30:::benchmark_data_smithi097_196985_object81240:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e341)", 2021-10-08T19:40:53.184 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:34:26.393860+0000", 2021-10-08T19:40:53.184 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 386.64083140999998, 2021-10-08T19:40:53.185 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.28502909100000001, 2021-10-08T19:40:53.185 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:40:53.185 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:40:53.185 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:40:53.186 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.25465", 2021-10-08T19:40:53.186 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:40:53.186 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 196931 2021-10-08T19:40:53.186 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.187 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:40:53.187 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.187 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:40:53.187 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.393860+0000", 2021-10-08T19:40:53.187 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:40:53.188 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.188 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.188 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:40:53.189 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.393860+0000", 2021-10-08T19:40:53.189 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:40:53.189 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.189 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.191 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:40:53.191 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.393858+0000", 2021-10-08T19:40:53.192 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:40:53.192 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.193 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.193 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:40:53.193 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.393867+0000", 2021-10-08T19:40:53.194 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0999999999999993e-06 2021-10-08T19:40:53.194 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.194 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.195 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:40:53.195 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.393878+0000", 2021-10-08T19:40:53.195 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0854e-05 2021-10-08T19:40:53.195 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.195 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.196 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:40:53.196 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.393883+0000", 2021-10-08T19:40:53.196 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2569999999999998e-06 2021-10-08T19:40:53.196 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.197 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.197 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:40:53.197 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.393930+0000", 2021-10-08T19:40:53.197 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6879000000000003e-05 2021-10-08T19:40:53.197 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.198 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.198 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:40:53.198 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.394057+0000", 2021-10-08T19:40:53.198 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012658 2021-10-08T19:40:53.199 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.199 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.199 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5,6", 2021-10-08T19:40:53.199 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.394193+0000", 2021-10-08T19:40:53.199 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013653299999999999 2021-10-08T19:40:53.200 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.200 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.200 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:40:53.200 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.396081+0000", 2021-10-08T19:40:53.200 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0018877430000000001 2021-10-08T19:40:53.201 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.201 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.201 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:53.201 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.396205+0000", 2021-10-08T19:40:53.202 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012362000000000001 2021-10-08T19:40:53.202 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.202 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.202 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:53.202 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.678819+0000", 2021-10-08T19:40:53.203 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.28261443000000003 2021-10-08T19:40:53.203 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.203 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.203 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:40:53.204 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.678861+0000", 2021-10-08T19:40:53.204 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2246999999999997e-05 2021-10-08T19:40:53.204 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.204 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.204 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:40:53.205 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:34:26.678889+0000", 2021-10-08T19:40:53.205 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7849999999999999e-05 2021-10-08T19:40:53.205 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:40:53.205 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:40:53.205 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:40:53.206 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.206 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.206 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15870.0:55027 10.4 10:2a538188:::benchmark_data_smithi097_245820_object55026:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e371)", 2021-10-08T19:40:53.207 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:35:55.903505+0000", 2021-10-08T19:40:53.207 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 297.13118649500001, 2021-10-08T19:40:53.207 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.21639338299999999, 2021-10-08T19:40:53.208 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:40:53.208 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:40:53.208 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:40:53.208 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15870", 2021-10-08T19:40:53.209 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1128006081", 2021-10-08T19:40:53.209 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 55027 2021-10-08T19:40:53.209 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.209 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:40:53.209 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.210 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:40:53.210 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.903505+0000", 2021-10-08T19:40:53.210 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:40:53.210 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.210 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.211 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:40:53.211 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.903505+0000", 2021-10-08T19:40:53.211 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:40:53.211 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.212 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.212 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:40:53.212 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.903503+0000", 2021-10-08T19:40:53.212 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:40:53.212 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.213 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.213 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:40:53.213 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.903526+0000", 2021-10-08T19:40:53.213 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3271000000000001e-05 2021-10-08T19:40:53.213 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.214 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.214 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:40:53.214 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.903536+0000", 2021-10-08T19:40:53.214 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0242e-05 2021-10-08T19:40:53.215 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.215 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.215 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:40:53.215 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.903542+0000", 2021-10-08T19:40:53.215 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.947e-06 2021-10-08T19:40:53.216 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.216 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.216 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:40:53.217 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.903579+0000", 2021-10-08T19:40:53.217 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6871e-05 2021-10-08T19:40:53.217 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.218 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.218 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:40:53.219 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.903698+0000", 2021-10-08T19:40:53.219 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000118553 2021-10-08T19:40:53.219 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.219 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.220 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,4", 2021-10-08T19:40:53.220 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.903831+0000", 2021-10-08T19:40:53.220 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013356199999999999 2021-10-08T19:40:53.220 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.220 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.221 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:53.221 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.906641+0000", 2021-10-08T19:40:53.221 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028095250000000002 2021-10-08T19:40:53.221 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.222 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.222 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:40:53.222 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.906868+0000", 2021-10-08T19:40:53.222 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000227619 2021-10-08T19:40:53.223 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.223 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.223 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:53.223 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:56.119805+0000", 2021-10-08T19:40:53.223 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.21293631199999999 2021-10-08T19:40:53.224 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.224 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.224 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:40:53.224 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:56.119858+0000", 2021-10-08T19:40:53.224 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3303000000000001e-05 2021-10-08T19:40:53.225 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.225 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.225 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:40:53.225 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:56.119898+0000", 2021-10-08T19:40:53.226 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0309999999999999e-05 2021-10-08T19:40:53.226 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:40:53.226 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:40:53.226 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:40:53.226 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.227 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.227 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15870.0:55036 10.8 10:10e062f3:::benchmark_data_smithi097_245820_object55035:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e371)", 2021-10-08T19:40:53.227 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:35:55.906255+0000", 2021-10-08T19:40:53.227 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 297.128436652, 2021-10-08T19:40:53.228 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.21378018400000001, 2021-10-08T19:40:53.228 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:40:53.228 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:40:53.228 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:40:53.228 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15870", 2021-10-08T19:40:53.229 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1128006081", 2021-10-08T19:40:53.229 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 55036 2021-10-08T19:40:53.229 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.229 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:40:53.229 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.230 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:40:53.230 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.906255+0000", 2021-10-08T19:40:53.230 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:40:53.230 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.231 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.231 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:40:53.231 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.906255+0000", 2021-10-08T19:40:53.231 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:40:53.231 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.232 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.232 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:40:53.232 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.906253+0000", 2021-10-08T19:40:53.232 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:40:53.232 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.233 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.233 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:40:53.233 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.906274+0000", 2021-10-08T19:40:53.233 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.073e-05 2021-10-08T19:40:53.234 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.234 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.234 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:40:53.234 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.906283+0000", 2021-10-08T19:40:53.234 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8659999999999995e-06 2021-10-08T19:40:53.235 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.235 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.235 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:40:53.235 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.906288+0000", 2021-10-08T19:40:53.235 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9520000000000002e-06 2021-10-08T19:40:53.236 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.236 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.236 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:40:53.236 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.906321+0000", 2021-10-08T19:40:53.237 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3228000000000001e-05 2021-10-08T19:40:53.237 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.237 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.237 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:40:53.237 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.906416+0000", 2021-10-08T19:40:53.238 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5228000000000004e-05 2021-10-08T19:40:53.238 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.238 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.238 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2,7", 2021-10-08T19:40:53.238 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.906510+0000", 2021-10-08T19:40:53.239 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4102000000000001e-05 2021-10-08T19:40:53.239 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.239 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.239 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:53.240 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:56.119707+0000", 2021-10-08T19:40:53.240 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.21319653699999999 2021-10-08T19:40:53.240 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.240 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.240 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:40:53.241 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:56.119713+0000", 2021-10-08T19:40:53.241 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7340000000000002e-06 2021-10-08T19:40:53.241 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.241 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.241 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:53.242 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:56.119949+0000", 2021-10-08T19:40:53.242 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023569800000000001 2021-10-08T19:40:53.242 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.242 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.243 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:40:53.243 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:56.119999+0000", 2021-10-08T19:40:53.243 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0404000000000001e-05 2021-10-08T19:40:53.243 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.243 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.244 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:40:53.244 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:56.120035+0000", 2021-10-08T19:40:53.244 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5549999999999997e-05 2021-10-08T19:40:53.244 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:40:53.245 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:40:53.245 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:40:53.245 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.245 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.246 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.15870.0:55039 10.8 10:1d0be7d3:::benchmark_data_smithi097_245820_object55038:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e371)", 2021-10-08T19:40:53.246 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:35:55.906807+0000", 2021-10-08T19:40:53.246 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 297.12788494599999, 2021-10-08T19:40:53.246 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.21483376100000001, 2021-10-08T19:40:53.248 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:40:53.248 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:40:53.248 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:40:53.249 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.15870", 2021-10-08T19:40:53.249 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/1128006081", 2021-10-08T19:40:53.249 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 55039 2021-10-08T19:40:53.249 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.249 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:40:53.250 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.250 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:40:53.251 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.906807+0000", 2021-10-08T19:40:53.251 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:40:53.251 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.251 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.252 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:40:53.252 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.906807+0000", 2021-10-08T19:40:53.252 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:40:53.252 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.252 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.253 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:40:53.253 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.906805+0000", 2021-10-08T19:40:53.253 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2021-10-08T19:40:53.253 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.254 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.254 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:40:53.254 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.906827+0000", 2021-10-08T19:40:53.254 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1999000000000001e-05 2021-10-08T19:40:53.254 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.255 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.255 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:40:53.255 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.906836+0000", 2021-10-08T19:40:53.255 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.85e-06 2021-10-08T19:40:53.256 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.256 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.256 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:40:53.256 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.906842+0000", 2021-10-08T19:40:53.256 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7880000000000003e-06 2021-10-08T19:40:53.257 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.257 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.257 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:40:53.257 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.907985+0000", 2021-10-08T19:40:53.258 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011426800000000001 2021-10-08T19:40:53.258 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.258 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.258 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:40:53.258 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.908132+0000", 2021-10-08T19:40:53.259 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014720299999999999 2021-10-08T19:40:53.259 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.259 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.259 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2,7", 2021-10-08T19:40:53.260 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.908298+0000", 2021-10-08T19:40:53.260 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016665399999999999 2021-10-08T19:40:53.260 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.260 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.261 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:53.261 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:56.120108+0000", 2021-10-08T19:40:53.261 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.21180980799999999 2021-10-08T19:40:53.262 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.262 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.262 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:40:53.262 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:56.120640+0000", 2021-10-08T19:40:53.263 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00053186800000000001 2021-10-08T19:40:53.263 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.263 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.263 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:53.264 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:56.121548+0000", 2021-10-08T19:40:53.264 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000907583 2021-10-08T19:40:53.264 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.264 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.264 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:40:53.265 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:56.121598+0000", 2021-10-08T19:40:53.265 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0760000000000002e-05 2021-10-08T19:40:53.265 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.265 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.266 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:40:53.266 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:56.121640+0000", 2021-10-08T19:40:53.266 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1856e-05 2021-10-08T19:40:53.266 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:40:53.267 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:40:53.267 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:40:53.267 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.267 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.267 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.15870.0:55024 10.d e371/355 10:bf49b955:::benchmark_data_smithi097_245820_object55023:head v 371'3424, mlcod=371'3422)", 2021-10-08T19:40:53.268 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:35:55.908014+0000", 2021-10-08T19:40:53.268 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 297.12667712299998, 2021-10-08T19:40:53.268 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.21703382399999999, 2021-10-08T19:40:53.268 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:40:53.269 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:40:53.269 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:40:53.269 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.269 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:40:53.269 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.908014+0000", 2021-10-08T19:40:53.270 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:40:53.270 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.270 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.270 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:40:53.270 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.908014+0000", 2021-10-08T19:40:53.271 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:40:53.271 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.272 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.272 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:40:53.272 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.908013+0000", 2021-10-08T19:40:53.272 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2021-10-08T19:40:53.273 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.273 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.273 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:40:53.274 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.908068+0000", 2021-10-08T19:40:53.274 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4948000000000003e-05 2021-10-08T19:40:53.274 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.274 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.275 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:40:53.275 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.908080+0000", 2021-10-08T19:40:53.275 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1619e-05 2021-10-08T19:40:53.275 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.275 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.276 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:40:53.276 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.908086+0000", 2021-10-08T19:40:53.276 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3770000000000001e-06 2021-10-08T19:40:53.276 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.277 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.277 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:40:53.277 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.908134+0000", 2021-10-08T19:40:53.278 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7994999999999997e-05 2021-10-08T19:40:53.278 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.278 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.278 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:40:53.278 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.908153+0000", 2021-10-08T19:40:53.279 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8776000000000001e-05 2021-10-08T19:40:53.279 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.279 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.279 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:40:53.280 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:56.125005+0000", 2021-10-08T19:40:53.280 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.21685267899999999 2021-10-08T19:40:53.280 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.280 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.280 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:40:53.281 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:56.125048+0000", 2021-10-08T19:40:53.281 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2818999999999998e-05 2021-10-08T19:40:53.281 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:40:53.281 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:40:53.282 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:40:53.282 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.283 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.283 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.15870.0:55026 10.d e371/355 10:bbe032c8:::benchmark_data_smithi097_245820_object55025:head v 371'3425, mlcod=371'3422)", 2021-10-08T19:40:53.283 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:35:55.908104+0000", 2021-10-08T19:40:53.283 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 297.12658748400003, 2021-10-08T19:40:53.283 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.21696467899999999, 2021-10-08T19:40:53.284 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:40:53.284 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:40:53.284 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:40:53.285 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.285 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:40:53.285 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.908104+0000", 2021-10-08T19:40:53.285 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:40:53.285 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.286 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.286 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:40:53.286 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.908104+0000", 2021-10-08T19:40:53.288 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:40:53.288 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.288 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.288 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:40:53.288 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.908103+0000", 2021-10-08T19:40:53.289 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2021-10-08T19:40:53.289 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.289 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.289 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:40:53.290 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.908137+0000", 2021-10-08T19:40:53.290 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3229000000000003e-05 2021-10-08T19:40:53.290 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.290 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.291 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:40:53.291 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.908144+0000", 2021-10-08T19:40:53.291 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3370000000000002e-06 2021-10-08T19:40:53.291 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.292 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.292 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:40:53.292 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.908149+0000", 2021-10-08T19:40:53.293 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6670000000000004e-06 2021-10-08T19:40:53.293 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.293 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.293 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:40:53.293 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:56.117901+0000", 2021-10-08T19:40:53.294 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.20975223400000001 2021-10-08T19:40:53.294 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.294 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.294 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:40:53.295 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:56.117928+0000", 2021-10-08T19:40:53.295 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6947000000000001e-05 2021-10-08T19:40:53.295 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.295 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.296 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:40:53.296 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:56.125051+0000", 2021-10-08T19:40:53.296 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0071232530000000004 2021-10-08T19:40:53.296 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.296 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.297 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:40:53.297 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:56.125069+0000", 2021-10-08T19:40:53.297 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7651000000000001e-05 2021-10-08T19:40:53.298 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:40:53.298 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:40:53.299 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:40:53.300 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.301 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.301 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.15870.0:55037 10.d e371/355 10:b1e0433a:::benchmark_data_smithi097_245820_object55036:head v 371'3426, mlcod=371'3422)", 2021-10-08T19:40:53.301 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:35:55.908416+0000", 2021-10-08T19:40:53.301 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 297.12627547699998, 2021-10-08T19:40:53.302 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.21667799800000001, 2021-10-08T19:40:53.302 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:40:53.302 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:40:53.303 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:40:53.303 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.303 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:40:53.304 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.908416+0000", 2021-10-08T19:40:53.304 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:40:53.305 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.305 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.305 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:40:53.305 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.908416+0000", 2021-10-08T19:40:53.306 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:40:53.306 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.306 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.306 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:40:53.307 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.908415+0000", 2021-10-08T19:40:53.307 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2021-10-08T19:40:53.307 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.308 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.308 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:40:53.309 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:55.908469+0000", 2021-10-08T19:40:53.309 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4044e-05 2021-10-08T19:40:53.309 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.310 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.310 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:40:53.310 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:56.117827+0000", 2021-10-08T19:40:53.312 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.20935799199999999 2021-10-08T19:40:53.313 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.313 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.314 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:40:53.314 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:56.117842+0000", 2021-10-08T19:40:53.314 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5509e-05 2021-10-08T19:40:53.315 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.315 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.315 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:40:53.316 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:56.119960+0000", 2021-10-08T19:40:53.316 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021172750000000001 2021-10-08T19:40:53.316 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.316 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.316 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:40:53.317 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:56.119975+0000", 2021-10-08T19:40:53.317 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.509e-05 2021-10-08T19:40:53.319 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.319 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.319 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:40:53.320 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:56.125070+0000", 2021-10-08T19:40:53.320 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0050957349999999997 2021-10-08T19:40:53.320 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.320 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.321 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:40:53.321 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:35:56.125094+0000", 2021-10-08T19:40:53.321 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3629e-05 2021-10-08T19:40:53.321 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:40:53.321 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:40:53.322 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:40:53.322 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.322 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.322 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.26125.0:41091 11.6 11:67f91ee9:::benchmark_data_smithi097_295476_object41090:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e446)", 2021-10-08T19:40:53.323 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:39:31.135545+0000", 2021-10-08T19:40:53.323 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 81.899146905999999, 2021-10-08T19:40:53.323 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.156638895, 2021-10-08T19:40:53.324 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:40:53.324 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:40:53.324 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:40:53.324 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.26125", 2021-10-08T19:40:53.325 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:40:53.326 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 41091 2021-10-08T19:40:53.326 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.326 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:40:53.327 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.327 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:40:53.328 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.135545+0000", 2021-10-08T19:40:53.328 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:40:53.328 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.329 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.329 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:40:53.329 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.135545+0000", 2021-10-08T19:40:53.330 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:40:53.330 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.330 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.331 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:40:53.331 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.135542+0000", 2021-10-08T19:40:53.332 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:40:53.332 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.332 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.333 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:40:53.333 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.135570+0000", 2021-10-08T19:40:53.333 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7759e-05 2021-10-08T19:40:53.334 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.334 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.335 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:40:53.335 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.135588+0000", 2021-10-08T19:40:53.335 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7788999999999999e-05 2021-10-08T19:40:53.336 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.336 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.337 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:40:53.337 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.135596+0000", 2021-10-08T19:40:53.337 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2779999999999993e-06 2021-10-08T19:40:53.338 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.338 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.338 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:40:53.338 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.135647+0000", 2021-10-08T19:40:53.339 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0995000000000002e-05 2021-10-08T19:40:53.339 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.339 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.339 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:40:53.339 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.135774+0000", 2021-10-08T19:40:53.340 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012702899999999999 2021-10-08T19:40:53.340 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.340 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.340 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,2", 2021-10-08T19:40:53.341 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.135915+0000", 2021-10-08T19:40:53.341 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014030600000000001 2021-10-08T19:40:53.341 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.341 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.341 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:40:53.342 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.139138+0000", 2021-10-08T19:40:53.342 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032235720000000001 2021-10-08T19:40:53.342 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.342 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.343 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:53.343 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.139560+0000", 2021-10-08T19:40:53.343 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00042235100000000001 2021-10-08T19:40:53.343 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.343 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.344 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:53.344 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.292087+0000", 2021-10-08T19:40:53.344 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.152526351 2021-10-08T19:40:53.345 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.345 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.345 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:40:53.346 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.292146+0000", 2021-10-08T19:40:53.346 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9589000000000002e-05 2021-10-08T19:40:53.346 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.347 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.347 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:40:53.347 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.292183+0000", 2021-10-08T19:40:53.348 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7055999999999999e-05 2021-10-08T19:40:53.348 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:40:53.348 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:40:53.349 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:40:53.349 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.349 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.349 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.26125.0:89290 11.6 11:66ed1d1f:::benchmark_data_smithi097_295476_object89289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e460)", 2021-10-08T19:40:53.350 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:40:14.315562+0000", 2021-10-08T19:40:53.350 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 38.719129252000002, 2021-10-08T19:40:53.350 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.166063462, 2021-10-08T19:40:53.351 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:40:53.351 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:40:53.351 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:40:53.352 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.26125", 2021-10-08T19:40:53.352 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:40:53.352 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 89290 2021-10-08T19:40:53.353 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.353 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:40:53.353 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.353 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:40:53.354 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.315562+0000", 2021-10-08T19:40:53.354 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:40:53.355 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.356 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.356 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:40:53.356 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.315562+0000", 2021-10-08T19:40:53.357 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:40:53.357 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.357 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.358 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:40:53.358 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.315561+0000", 2021-10-08T19:40:53.358 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2021-10-08T19:40:53.359 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.359 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.359 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:40:53.360 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.315585+0000", 2021-10-08T19:40:53.360 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4283000000000001e-05 2021-10-08T19:40:53.360 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.361 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.361 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:40:53.361 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.315602+0000", 2021-10-08T19:40:53.362 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7118000000000001e-05 2021-10-08T19:40:53.362 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.362 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.363 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:40:53.363 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.315608+0000", 2021-10-08T19:40:53.364 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1820000000000003e-06 2021-10-08T19:40:53.364 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.364 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.365 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:40:53.365 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.319456+0000", 2021-10-08T19:40:53.366 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038475470000000002 2021-10-08T19:40:53.366 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.366 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.367 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:40:53.367 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.319613+0000", 2021-10-08T19:40:53.368 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000156778 2021-10-08T19:40:53.368 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.368 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.369 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,2", 2021-10-08T19:40:53.369 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.319799+0000", 2021-10-08T19:40:53.370 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0001864 2021-10-08T19:40:53.370 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.370 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.371 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:40:53.371 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.327520+0000", 2021-10-08T19:40:53.372 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0077210259999999998 2021-10-08T19:40:53.372 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.373 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.373 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:53.373 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.335693+0000", 2021-10-08T19:40:53.374 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.008173395 2021-10-08T19:40:53.374 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.375 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.375 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:53.376 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.481531+0000", 2021-10-08T19:40:53.376 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.14583739300000001 2021-10-08T19:40:53.376 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.377 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.377 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:40:53.378 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.481586+0000", 2021-10-08T19:40:53.378 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5232999999999998e-05 2021-10-08T19:40:53.378 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.379 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.379 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:40:53.380 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.481626+0000", 2021-10-08T19:40:53.380 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9589999999999999e-05 2021-10-08T19:40:53.380 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:40:53.381 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:40:53.381 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:40:53.382 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.382 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.383 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.26125.0:89297 11.6 11:6e92503b:::benchmark_data_smithi097_295476_object89296:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e460)", 2021-10-08T19:40:53.383 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:40:14.320008+0000", 2021-10-08T19:40:53.383 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 38.714683078, 2021-10-08T19:40:53.384 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.16179081000000001, 2021-10-08T19:40:53.384 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:40:53.385 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:40:53.385 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:40:53.385 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.26125", 2021-10-08T19:40:53.386 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:40:53.386 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 89297 2021-10-08T19:40:53.387 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.387 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:40:53.389 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.390 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:40:53.390 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.320008+0000", 2021-10-08T19:40:53.390 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:40:53.390 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.391 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.391 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:40:53.391 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.320008+0000", 2021-10-08T19:40:53.391 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:40:53.392 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.392 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.392 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:40:53.392 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.320005+0000", 2021-10-08T19:40:53.392 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999967 2021-10-08T19:40:53.393 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.393 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.393 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:40:53.393 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.320031+0000", 2021-10-08T19:40:53.393 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5973999999999999e-05 2021-10-08T19:40:53.394 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.394 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.394 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:40:53.394 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.320046+0000", 2021-10-08T19:40:53.395 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5495e-05 2021-10-08T19:40:53.395 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.395 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.395 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:40:53.395 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.320054+0000", 2021-10-08T19:40:53.396 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8259999999999993e-06 2021-10-08T19:40:53.396 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.396 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.396 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:40:53.396 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.322860+0000", 2021-10-08T19:40:53.397 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028060089999999999 2021-10-08T19:40:53.397 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.397 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.397 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:40:53.398 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.322990+0000", 2021-10-08T19:40:53.398 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012989499999999999 2021-10-08T19:40:53.398 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.398 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.398 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,2", 2021-10-08T19:40:53.399 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.323171+0000", 2021-10-08T19:40:53.399 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00018077600000000001 2021-10-08T19:40:53.399 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.399 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.399 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:40:53.400 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.327527+0000", 2021-10-08T19:40:53.400 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0043556059999999997 2021-10-08T19:40:53.400 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.400 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.401 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:53.401 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.335805+0000", 2021-10-08T19:40:53.401 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0082782250000000002 2021-10-08T19:40:53.401 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.401 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.402 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:53.402 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.481714+0000", 2021-10-08T19:40:53.402 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.145908751 2021-10-08T19:40:53.402 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.403 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.403 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:40:53.403 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.481761+0000", 2021-10-08T19:40:53.403 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7484999999999997e-05 2021-10-08T19:40:53.403 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.404 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.404 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:40:53.404 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.481799+0000", 2021-10-08T19:40:53.404 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8173000000000002e-05 2021-10-08T19:40:53.404 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:40:53.405 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:40:53.405 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:40:53.405 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.405 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.405 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.26125.0:89300 11.6 11:6549cb4f:::benchmark_data_smithi097_295476_object89299:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e460)", 2021-10-08T19:40:53.406 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:40:14.328123+0000", 2021-10-08T19:40:53.407 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 38.706568523999998, 2021-10-08T19:40:53.407 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.16269725700000001, 2021-10-08T19:40:53.408 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:40:53.408 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:40:53.408 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:40:53.409 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.26125", 2021-10-08T19:40:53.409 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:40:53.409 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 89300 2021-10-08T19:40:53.409 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.410 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:40:53.410 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.410 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:40:53.411 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.328123+0000", 2021-10-08T19:40:53.412 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:40:53.412 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.413 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.413 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:40:53.413 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.328123+0000", 2021-10-08T19:40:53.413 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:40:53.414 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.414 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.414 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:40:53.414 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.328120+0000", 2021-10-08T19:40:53.415 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2021-10-08T19:40:53.415 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.415 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.415 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:40:53.415 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.328166+0000", 2021-10-08T19:40:53.416 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6211000000000002e-05 2021-10-08T19:40:53.416 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.416 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.416 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:40:53.416 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.328183+0000", 2021-10-08T19:40:53.417 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6677e-05 2021-10-08T19:40:53.417 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.417 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.417 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:40:53.417 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.328191+0000", 2021-10-08T19:40:53.418 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0879999999999995e-06 2021-10-08T19:40:53.418 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.418 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.418 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:40:53.419 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.328258+0000", 2021-10-08T19:40:53.419 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6761000000000007e-05 2021-10-08T19:40:53.419 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.419 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.419 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:40:53.420 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.328426+0000", 2021-10-08T19:40:53.420 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000168555 2021-10-08T19:40:53.420 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.420 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.420 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,2", 2021-10-08T19:40:53.421 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.328608+0000", 2021-10-08T19:40:53.421 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00018190200000000001 2021-10-08T19:40:53.421 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.421 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.422 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:40:53.422 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.332309+0000", 2021-10-08T19:40:53.422 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0037007699999999999 2021-10-08T19:40:53.423 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.423 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.423 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:53.423 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.342932+0000", 2021-10-08T19:40:53.423 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010623252999999999 2021-10-08T19:40:53.424 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.424 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.424 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:53.424 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.490728+0000", 2021-10-08T19:40:53.425 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.147795543 2021-10-08T19:40:53.425 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.425 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.425 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:40:53.426 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.490780+0000", 2021-10-08T19:40:53.426 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2238999999999999e-05 2021-10-08T19:40:53.426 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.426 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.427 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:40:53.427 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.490820+0000", 2021-10-08T19:40:53.427 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0184e-05 2021-10-08T19:40:53.427 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:40:53.427 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:40:53.428 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:40:53.428 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.428 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.428 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.26125.0:89318 11.6 11:6278fea8:::benchmark_data_smithi097_295476_object89317:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e460)", 2021-10-08T19:40:53.429 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:40:14.346136+0000", 2021-10-08T19:40:53.429 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 38.688555510999997, 2021-10-08T19:40:53.429 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.149237863, 2021-10-08T19:40:53.429 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:40:53.429 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:40:53.430 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:40:53.430 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.26125", 2021-10-08T19:40:53.430 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:40:53.430 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 89318 2021-10-08T19:40:53.430 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.431 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:40:53.431 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.431 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:40:53.431 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.346136+0000", 2021-10-08T19:40:53.432 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:40:53.432 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.432 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.433 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:40:53.433 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.346136+0000", 2021-10-08T19:40:53.433 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:40:53.433 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.434 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.434 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:40:53.434 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.346134+0000", 2021-10-08T19:40:53.434 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:40:53.434 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.435 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.435 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:40:53.435 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.346160+0000", 2021-10-08T19:40:53.435 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6336e-05 2021-10-08T19:40:53.435 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.436 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.436 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:40:53.436 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.346175+0000", 2021-10-08T19:40:53.436 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4834000000000001e-05 2021-10-08T19:40:53.437 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.437 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.437 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:40:53.437 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.346182+0000", 2021-10-08T19:40:53.437 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3159999999999999e-06 2021-10-08T19:40:53.438 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.438 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.438 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:40:53.438 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.346234+0000", 2021-10-08T19:40:53.438 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1326000000000003e-05 2021-10-08T19:40:53.439 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.439 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.439 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:40:53.439 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.346394+0000", 2021-10-08T19:40:53.440 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016052500000000001 2021-10-08T19:40:53.440 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.440 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.440 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,2", 2021-10-08T19:40:53.440 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.346564+0000", 2021-10-08T19:40:53.441 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017002 2021-10-08T19:40:53.441 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.441 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.441 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:53.441 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.349874+0000", 2021-10-08T19:40:53.442 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033095360000000001 2021-10-08T19:40:53.442 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.442 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.442 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:40:53.442 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.349892+0000", 2021-10-08T19:40:53.443 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8158000000000001e-05 2021-10-08T19:40:53.444 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.444 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.444 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:53.445 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.495282+0000", 2021-10-08T19:40:53.445 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.14539007200000001 2021-10-08T19:40:53.445 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.445 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.446 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:40:53.446 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.495334+0000", 2021-10-08T19:40:53.446 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2061000000000002e-05 2021-10-08T19:40:53.446 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.447 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.447 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:40:53.447 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.495374+0000", 2021-10-08T19:40:53.448 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9684000000000002e-05 2021-10-08T19:40:53.448 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:40:53.448 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:40:53.448 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:40:53.448 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.449 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.449 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.26125.0:106135 11.6 11:662c1e0d:::benchmark_data_smithi097_295476_object106134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e466)", 2021-10-08T19:40:53.449 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:40:31.597467+0000", 2021-10-08T19:40:53.449 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 21.437224125, 2021-10-08T19:40:53.449 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.16488398800000001, 2021-10-08T19:40:53.450 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:40:53.450 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:40:53.450 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:40:53.450 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.26125", 2021-10-08T19:40:53.450 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:40:53.451 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 106135 2021-10-08T19:40:53.451 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.451 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:40:53.451 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.452 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:40:53.452 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.597467+0000", 2021-10-08T19:40:53.452 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:40:53.452 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.453 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.453 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:40:53.453 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.597467+0000", 2021-10-08T19:40:53.453 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:40:53.454 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.454 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.454 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:40:53.454 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.597465+0000", 2021-10-08T19:40:53.454 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:40:53.455 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.455 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.455 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:40:53.455 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.597491+0000", 2021-10-08T19:40:53.456 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5643000000000002e-05 2021-10-08T19:40:53.456 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.456 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.456 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:40:53.457 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.597504+0000", 2021-10-08T19:40:53.457 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3091999999999999e-05 2021-10-08T19:40:53.457 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.457 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.458 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:40:53.458 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.597511+0000", 2021-10-08T19:40:53.459 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9779999999999999e-06 2021-10-08T19:40:53.459 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.459 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.459 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:40:53.459 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.597554+0000", 2021-10-08T19:40:53.460 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3748999999999997e-05 2021-10-08T19:40:53.460 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.460 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.461 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:40:53.461 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.597650+0000", 2021-10-08T19:40:53.461 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5451999999999993e-05 2021-10-08T19:40:53.461 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.462 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.462 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1,2", 2021-10-08T19:40:53.462 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.597765+0000", 2021-10-08T19:40:53.462 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115414 2021-10-08T19:40:53.463 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.463 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.463 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:53.463 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.601471+0000", 2021-10-08T19:40:53.464 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0037053950000000002 2021-10-08T19:40:53.464 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.464 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.464 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:40:53.464 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.601986+0000", 2021-10-08T19:40:53.465 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000515107 2021-10-08T19:40:53.465 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.465 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.465 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:40:53.465 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.762250+0000", 2021-10-08T19:40:53.466 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.160264556 2021-10-08T19:40:53.466 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.466 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.467 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:40:53.467 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.762313+0000", 2021-10-08T19:40:53.467 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2714999999999998e-05 2021-10-08T19:40:53.468 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:40:53.468 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:40:53.468 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:40:53.469 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.762351+0000", 2021-10-08T19:40:53.469 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8251999999999999e-05 2021-10-08T19:40:53.469 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:40:53.469 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:40:53.470 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:40:53.470 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:40:53.470 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:40:53.470 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:40:53.471 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:52 smithi117 ceph-mon[34585]: 6.15 scrub ok 2021-10-08T19:40:53.472 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:53.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:52 smithi097 ceph-mon[41966]: 6.15 scrub ok 2021-10-08T19:40:53.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:52 smithi097 ceph-mon[32687]: 6.15 scrub ok 2021-10-08T19:40:53.473 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:53.474 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:40:53.474 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:40:53.555 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:40:53.575 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:40:53.606 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:53.813 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:40:53.815 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:53.816 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:40:53.917 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:40:53.960 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:54.030 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:40:54.035 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:54.035 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:40:54.137 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:40:54.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:40:53 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:40:53] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:40:54.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:54 smithi117 ceph-mon[34585]: pgmap v976: 188 pgs: 188 active+clean; 6.3 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 674 op/s 2021-10-08T19:40:54.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:54 smithi117 ceph-mon[34585]: 6.c scrub ok 2021-10-08T19:40:54.190 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:54.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:54 smithi097 ceph-mon[41966]: pgmap v976: 188 pgs: 188 active+clean; 6.3 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 674 op/s 2021-10-08T19:40:54.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:54 smithi097 ceph-mon[41966]: 6.c scrub ok 2021-10-08T19:40:54.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:54 smithi097 ceph-mon[32687]: pgmap v976: 188 pgs: 188 active+clean; 6.3 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 674 op/s 2021-10-08T19:40:54.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:54 smithi097 ceph-mon[32687]: 6.c scrub ok 2021-10-08T19:40:55.026 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is set 2021-10-08T19:40:55.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:55 smithi117 ceph-mon[34585]: 11.6 scrub ok 2021-10-08T19:40:55.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:55 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1006361641' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:40:55.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:55 smithi117 ceph-mon[34585]: from='client.36305 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:40:55.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:55 smithi117 ceph-mon[34585]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:40:55.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:55 smithi117 ceph-mon[34585]: from='client.36305 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:40:55.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:55 smithi117 ceph-mon[34585]: osdmap e472: 8 total, 8 up, 8 in 2021-10-08T19:40:55.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:55 smithi097 ceph-mon[32687]: 11.6 scrub ok 2021-10-08T19:40:55.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:55 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1006361641' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:40:55.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:55 smithi097 ceph-mon[32687]: from='client.36305 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:40:55.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:55 smithi097 ceph-mon[32687]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:40:55.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:55 smithi097 ceph-mon[32687]: from='client.36305 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:40:55.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:55 smithi097 ceph-mon[32687]: osdmap e472: 8 total, 8 up, 8 in 2021-10-08T19:40:55.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:55 smithi097 ceph-mon[41966]: 11.6 scrub ok 2021-10-08T19:40:55.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:55 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1006361641' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:40:55.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:55 smithi097 ceph-mon[41966]: from='client.36305 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:40:55.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:55 smithi097 ceph-mon[41966]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:40:55.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:55 smithi097 ceph-mon[41966]: from='client.36305 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:40:55.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:55 smithi097 ceph-mon[41966]: osdmap e472: 8 total, 8 up, 8 in 2021-10-08T19:40:55.538 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:40:55.547 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:55.548 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:40:55.649 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:40:55.715 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:56.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:56 smithi117 ceph-mon[34585]: 6.19 scrub ok 2021-10-08T19:40:56.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:56 smithi117 ceph-mon[34585]: 5.3 scrub ok 2021-10-08T19:40:56.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:56 smithi117 ceph-mon[34585]: 6.5 scrub ok 2021-10-08T19:40:56.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:56 smithi117 ceph-mon[34585]: pgmap v977: 188 pgs: 2 active+clean+scrubbing, 186 active+clean; 6.0 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.30k op/s 2021-10-08T19:40:56.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:56 smithi097 ceph-mon[32687]: 6.19 scrub ok 2021-10-08T19:40:56.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:56 smithi097 ceph-mon[32687]: 5.3 scrub ok 2021-10-08T19:40:56.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:56 smithi097 ceph-mon[32687]: 6.5 scrub ok 2021-10-08T19:40:56.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:56 smithi097 ceph-mon[32687]: pgmap v977: 188 pgs: 2 active+clean+scrubbing, 186 active+clean; 6.0 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.30k op/s 2021-10-08T19:40:56.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:56 smithi097 ceph-mon[41966]: 6.19 scrub ok 2021-10-08T19:40:56.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:56 smithi097 ceph-mon[41966]: 5.3 scrub ok 2021-10-08T19:40:56.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:56 smithi097 ceph-mon[41966]: 6.5 scrub ok 2021-10-08T19:40:56.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:56 smithi097 ceph-mon[41966]: pgmap v977: 188 pgs: 2 active+clean+scrubbing, 186 active+clean; 6.0 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.30k op/s 2021-10-08T19:40:56.732 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2021-10-08T19:40:57.043 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:40:57.059 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:57.062 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:40:57.163 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:40:57.201 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:57.278 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:40:57.282 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:57.283 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:40:57.336 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:57 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:40:57.336 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:57 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:40:57.336 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:57 smithi117 ceph-mon[34585]: osdmap e473: 8 total, 8 up, 8 in 2021-10-08T19:40:57.385 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:40:57.426 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:57 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:40:57.426 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:57 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:40:57.426 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:57 smithi097 ceph-mon[32687]: osdmap e473: 8 total, 8 up, 8 in 2021-10-08T19:40:57.427 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:57 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:40:57.427 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:57 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:40:57.427 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:57 smithi097 ceph-mon[41966]: osdmap e473: 8 total, 8 up, 8 in 2021-10-08T19:40:57.430 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:57.656 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:40:57 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:40:57.843 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:40:57.850 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:40:57.860 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:57.861 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:40:57.957 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:40:57.965 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:40:57.998 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:40:58.031 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:58.031 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:40:58.081 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:40:58.122 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:40:58.132 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:58 smithi097 ceph-mon[41966]: pgmap v980: 188 pgs: 2 active+clean+scrubbing, 186 active+clean; 6.0 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 724 B/s rd, 0 B/s wr, 728 op/s 2021-10-08T19:40:58.133 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:58 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:40:58.133 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:58 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/779746249' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:40:58.133 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:58 smithi097 ceph-mon[32687]: pgmap v980: 188 pgs: 2 active+clean+scrubbing, 186 active+clean; 6.0 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 724 B/s rd, 0 B/s wr, 728 op/s 2021-10-08T19:40:58.134 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:58 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:40:58.134 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:58 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/779746249' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:40:58.162 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:40:58.182 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:40:58.194 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:58.197 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:40:58.198 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:40:58.245 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:40:58.260 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'false' 2021-10-08T19:40:58.261 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'false' 2021-10-08T19:40:58.261 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'false' 2021-10-08T19:40:58.262 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'false' 2021-10-08T19:40:58.262 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'false' 2021-10-08T19:40:58.263 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'false' 2021-10-08T19:40:58.264 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'false' 2021-10-08T19:40:58.264 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'false' 2021-10-08T19:40:58.298 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:40:58.329 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:58 smithi117 ceph-mon[34585]: pgmap v980: 188 pgs: 2 active+clean+scrubbing, 186 active+clean; 6.0 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 724 B/s rd, 0 B/s wr, 728 op/s 2021-10-08T19:40:58.329 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:58 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:40:58.329 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:58 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/779746249' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:40:58.332 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:58.492 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:40:58.500 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:58.501 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:40:58.603 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:40:58.683 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:58.810 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set nodeep-scrub 2021-10-08T19:40:59.115 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.1 to 1 (10000) 2021-10-08T19:40:59.319 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:40:59.322 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:59.323 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:40:59.324 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:40:59 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2678362086' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2021-10-08T19:40:59.329 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:40:59 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2678362086' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2021-10-08T19:40:59.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:40:59 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2678362086' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2021-10-08T19:40:59.425 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:40:59.455 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:40:59.537 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:40:59.540 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:40:59.542 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:40:59.642 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:40:59.690 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:00.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:00 smithi097 ceph-mon[32687]: pgmap v981: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 5.9 GiB data, 21 GiB used, 695 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 920 op/s 2021-10-08T19:41:00.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:00 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2678362086' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2021-10-08T19:41:00.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:00 smithi097 ceph-mon[32687]: osdmap e474: 8 total, 8 up, 8 in 2021-10-08T19:41:00.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:00 smithi097 ceph-mon[41966]: pgmap v981: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 5.9 GiB data, 21 GiB used, 695 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 920 op/s 2021-10-08T19:41:00.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:00 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2678362086' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2021-10-08T19:41:00.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:00 smithi097 ceph-mon[41966]: osdmap e474: 8 total, 8 up, 8 in 2021-10-08T19:41:00.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:00 smithi117 ceph-mon[34585]: pgmap v981: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 5.9 GiB data, 21 GiB used, 695 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 920 op/s 2021-10-08T19:41:00.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:00 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2678362086' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2021-10-08T19:41:00.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:00 smithi117 ceph-mon[34585]: osdmap e474: 8 total, 8 up, 8 in 2021-10-08T19:41:00.434 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:41:00.441 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:00.441 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:41:00.473 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd reweight 3 1 2021-10-08T19:41:00.544 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:41:00.580 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:00.651 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:41:00.659 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:00.659 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:41:00.699 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:41:00.761 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:41:00.853 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:01.055 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:41:01.067 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:01.068 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:41:01.169 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:41:01.204 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:01.368 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:41:01.371 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:01.371 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:41:01.473 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:41:01.511 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:41:01.544 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:01.593 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2021-10-08T19:41:01.594 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:41:01.955 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2021-10-08T19:41:02.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:01 smithi117 ceph-mon[34585]: pgmap v983: 188 pgs: 188 active+clean; 5.7 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 852 op/s 2021-10-08T19:41:02.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:01 smithi097 ceph-mon[41966]: pgmap v983: 188 pgs: 188 active+clean; 5.7 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 852 op/s 2021-10-08T19:41:02.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:01 smithi097 ceph-mon[32687]: pgmap v983: 188 pgs: 188 active+clean; 5.7 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 852 op/s 2021-10-08T19:41:02.652 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:41:02 smithi097 conmon[33110]: 172.21.15.117 - - [08/Oct/2021:19:41:02] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:41:02.652 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:41:02 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:41:02] "GET /metrics HTTP/1.1" 200 156005 "" "Prometheus/2.18.1" 2021-10-08T19:41:02.903 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:02 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:41:03.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:02 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:41:03.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:02 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:41:03.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:02 smithi117 ceph-mon[34585]: osdmap e475: 8 total, 8 up, 8 in 2021-10-08T19:41:03.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:02 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:41:03.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:02 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:41:03.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:02 smithi117 ceph-mon[34585]: 172.21.15.117 - - [08/Oct/2021:19:41:02] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:41:03.202 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:41:03.208 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:03.209 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:41:03.210 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:02 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:41:03.210 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:02 smithi097 ceph-mon[32687]: osdmap e475: 8 total, 8 up, 8 in 2021-10-08T19:41:03.210 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:02 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:41:03.211 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:02 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:41:03.211 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:02 smithi097 ceph-mon[32687]: 172.21.15.117 - - [08/Oct/2021:19:41:02] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:41:03.211 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:02 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:41:03.211 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:02 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:41:03.212 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:02 smithi097 ceph-mon[41966]: osdmap e475: 8 total, 8 up, 8 in 2021-10-08T19:41:03.212 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:02 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:41:03.212 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:02 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:41:03.212 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:02 smithi097 ceph-mon[41966]: 172.21.15.117 - - [08/Oct/2021:19:41:02] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:41:03.239 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2021-10-08T19:41:03.310 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:41:03.350 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:03.416 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:41:03.418 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:03.419 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:41:03.521 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:41:03.624 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:03.656 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:41:03 smithi117 conmon[69189]: level=error ts=2021-10-08T19:41:03.505Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=2 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:41:03.870 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:41:03.981 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:41:03.996 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:03.996 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:03 smithi097 ceph-mon[41966]: pgmap v985: 188 pgs: 188 active+clean; 5.7 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 734 B/s rd, 0 B/s wr, 734 op/s 2021-10-08T19:41:03.997 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:41:03.998 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:03 smithi097 ceph-mon[32687]: pgmap v985: 188 pgs: 188 active+clean; 5.7 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 734 B/s rd, 0 B/s wr, 734 op/s 2021-10-08T19:41:04.098 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:41:04.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:41:03 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:41:03] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:41:04.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:03 smithi117 ceph-mon[34585]: pgmap v985: 188 pgs: 188 active+clean; 5.7 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 734 B/s rd, 0 B/s wr, 734 op/s 2021-10-08T19:41:04.160 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:04.963 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is set 2021-10-08T19:41:05.219 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:04 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/403088320' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:41:05.219 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:04 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/403088320' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:41:05.220 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:41:05.230 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:05.231 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:41:05.264 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:41:05.332 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:41:05.403 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:05.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:04 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/403088320' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:41:06.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:05 smithi097 ceph-mon[41966]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:41:06.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:05 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/403088320' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:41:06.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:05 smithi097 ceph-mon[41966]: osdmap e476: 8 total, 8 up, 8 in 2021-10-08T19:41:06.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:05 smithi097 ceph-mon[41966]: pgmap v987: 188 pgs: 188 active+clean; 5.4 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 1.36k op/s 2021-10-08T19:41:06.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:05 smithi097 ceph-mon[32687]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:41:06.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:05 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/403088320' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:41:06.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:05 smithi097 ceph-mon[32687]: osdmap e476: 8 total, 8 up, 8 in 2021-10-08T19:41:06.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:05 smithi097 ceph-mon[32687]: pgmap v987: 188 pgs: 188 active+clean; 5.4 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 1.36k op/s 2021-10-08T19:41:06.301 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:06.301 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:41:06.309 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:41:06.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:05 smithi117 ceph-mon[34585]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:41:06.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:05 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/403088320' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:41:06.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:05 smithi117 ceph-mon[34585]: osdmap e476: 8 total, 8 up, 8 in 2021-10-08T19:41:06.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:05 smithi117 ceph-mon[34585]: pgmap v987: 188 pgs: 188 active+clean; 5.4 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 1.36k op/s 2021-10-08T19:41:06.411 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:41:06.446 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:06.521 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:41:06.526 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:06.527 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:41:06.629 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:41:06.687 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:07.577 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:41:07.583 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:07.584 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:41:07.655 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:41:07 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:41:07.685 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:41:07.716 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:07.774 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:41:07.778 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:07.779 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:41:07.883 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:41:07.919 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:07.990 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:41:07.995 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:07.995 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:41:08.076 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.3 to 1 (10000) 2021-10-08T19:41:08.096 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:41:08.133 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:08.186 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:41:08.190 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:08.191 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:41:08.303 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:41:08.333 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:08 smithi117 ceph-mon[34585]: pgmap v988: 188 pgs: 188 active+clean; 5.4 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 948 op/s 2021-10-08T19:41:08.333 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:08 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:41:08.334 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:08 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2730692481' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2021-10-08T19:41:08.334 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:08 smithi117 ceph-mon[34585]: from='client.26278 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2021-10-08T19:41:08.335 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:08.345 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset noscrub 2021-10-08T19:41:08.392 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:08 smithi097 ceph-mon[41966]: pgmap v988: 188 pgs: 188 active+clean; 5.4 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 948 op/s 2021-10-08T19:41:08.392 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:08 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:41:08.392 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:08 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2730692481' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2021-10-08T19:41:08.392 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:08 smithi097 ceph-mon[41966]: from='client.26278 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2021-10-08T19:41:08.393 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:08 smithi097 ceph-mon[32687]: pgmap v988: 188 pgs: 188 active+clean; 5.4 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 948 op/s 2021-10-08T19:41:08.393 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:08 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:41:08.394 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:08 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2730692481' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2021-10-08T19:41:08.394 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:08 smithi097 ceph-mon[32687]: from='client.26278 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2021-10-08T19:41:08.394 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:41:08.399 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:08.399 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:41:08.501 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:41:08.551 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:09.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:09 smithi117 ceph-mon[34585]: from='client.26278 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2021-10-08T19:41:09.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:09 smithi117 ceph-mon[34585]: osdmap e477: 8 total, 8 up, 8 in 2021-10-08T19:41:09.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:09 smithi097 ceph-mon[32687]: from='client.26278 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2021-10-08T19:41:09.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:09 smithi097 ceph-mon[32687]: osdmap e477: 8 total, 8 up, 8 in 2021-10-08T19:41:09.474 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:09 smithi097 ceph-mon[41966]: from='client.26278 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2021-10-08T19:41:09.474 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:09 smithi097 ceph-mon[41966]: osdmap e477: 8 total, 8 up, 8 in 2021-10-08T19:41:09.598 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:41:09.603 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:09.604 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:41:09.705 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:41:09.740 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:09.805 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:41:09.810 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:09.811 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:41:09.912 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:41:09.944 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:09.949 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:41:09.958 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:41:09 smithi097 conmon[33110]: 172.21.15.97 - - [08/Oct/2021:19:41:09] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:41:09.959 INFO:tasks.cephadm.ceph_manager.ceph:waiting for recovery to complete 2021-10-08T19:41:09.959 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph pg dump --format=json 2021-10-08T19:41:09.996 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:41:10.000 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:10.001 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:41:10.035 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:41:10.085 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:41:10.101 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:41:10.139 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:41:10.176 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:41:10.209 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:10 smithi097 ceph-mon[41966]: pgmap v990: 188 pgs: 188 active+clean; 5.3 GiB data, 19 GiB used, 697 GiB / 715 GiB avail; 720 B/s rd, 0 B/s wr, 1.06k op/s 2021-10-08T19:41:10.210 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:10 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:41:10.210 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:10 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/506360970' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:41:10.215 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:10 smithi097 ceph-mon[32687]: pgmap v990: 188 pgs: 188 active+clean; 5.3 GiB data, 19 GiB used, 697 GiB / 715 GiB avail; 720 B/s rd, 0 B/s wr, 1.06k op/s 2021-10-08T19:41:10.215 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:10 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:41:10.216 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:10 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/506360970' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:41:10.216 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:10.218 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:41:10.251 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:41:10.289 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:41:10.340 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:41:10.344 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true' 2021-10-08T19:41:10.344 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true' 2021-10-08T19:41:10.344 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true' 2021-10-08T19:41:10.344 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true' 2021-10-08T19:41:10.345 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true' 2021-10-08T19:41:10.345 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true' 2021-10-08T19:41:10.346 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'true' 2021-10-08T19:41:10.346 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'true' 2021-10-08T19:41:10.381 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:41:10.383 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:10.384 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:41:10.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:10 smithi117 ceph-mon[34585]: pgmap v990: 188 pgs: 188 active+clean; 5.3 GiB data, 19 GiB used, 697 GiB / 715 GiB avail; 720 B/s rd, 0 B/s wr, 1.06k op/s 2021-10-08T19:41:10.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:10 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:41:10.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:10 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/506360970' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:41:10.484 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:41:10.511 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:41:10.512 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2021-10-08T19:41:10.512 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2021-10-08T19:41:10.512 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2021-10-08T19:41:10.513 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:41:10.513 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:10.578 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:41:10.581 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:10.582 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:41:10.685 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:41:10.742 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:11.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:11 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:41:11.409 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:11 smithi117 ceph-mon[34585]: 172.21.15.97 - - [08/Oct/2021:19:41:09] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:41:11.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:11 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:41:11.480 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:11 smithi097 ceph-mon[41966]: 172.21.15.97 - - [08/Oct/2021:19:41:09] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:41:11.480 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:11 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:41:11.481 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:11 smithi097 ceph-mon[32687]: 172.21.15.97 - - [08/Oct/2021:19:41:09] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:41:12.059 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:41:12.064 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:12.065 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:41:12.166 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:41:12.200 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:12.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:12 smithi097 ceph-mon[41966]: pgmap v991: 188 pgs: 188 active+clean; 5.1 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.32k op/s 2021-10-08T19:41:12.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:12 smithi097 ceph-mon[32687]: pgmap v991: 188 pgs: 188 active+clean; 5.1 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.32k op/s 2021-10-08T19:41:12.237 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2021-10-08T19:41:12.265 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:41:12.271 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:12.272 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:41:12.372 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:41:12.404 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:41:12 smithi117 conmon[69189]: level=error ts=2021-10-08T19:41:12.314Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=2 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:41:12.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:12 smithi117 ceph-mon[34585]: pgmap v991: 188 pgs: 188 active+clean; 5.1 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.32k op/s 2021-10-08T19:41:12.407 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:12.468 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:41:12.469 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:41:12.474 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:12.474 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:41:12.576 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:41:12.605 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:12.671 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:41:12.675 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:12.677 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:41:12.780 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:41:12.831 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:12.972 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:41:12 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:41:12] "GET /metrics HTTP/1.1" 200 155940 "" "Prometheus/2.18.1" 2021-10-08T19:41:13.081 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:41:13.086 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:13.087 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:41:13.188 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:41:13.222 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:13.235 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:41:13.279 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:41:13.284 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:13.285 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:41:13.386 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:41:13.441 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:13.627 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:41:13.631 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:13.632 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:41:13.733 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:41:13.767 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:13.836 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:41:13.839 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:13.840 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:41:13.941 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:41:13.974 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:14.042 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:41:14.043 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:41:13 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:41:13] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:41:14.043 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:14.044 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:41:14.145 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:41:14.205 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:14 smithi097 ceph-mon[41966]: pgmap v992: 188 pgs: 188 active+clean; 5.1 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 634 B/s rd, 0 B/s wr, 656 op/s 2021-10-08T19:41:14.207 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:14 smithi097 ceph-mon[32687]: pgmap v992: 188 pgs: 188 active+clean; 5.1 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 634 B/s rd, 0 B/s wr, 656 op/s 2021-10-08T19:41:14.210 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:14.360 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2021-10-08T19:41:14.409 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:14 smithi117 ceph-mon[34585]: pgmap v992: 188 pgs: 188 active+clean; 5.1 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 634 B/s rd, 0 B/s wr, 656 op/s 2021-10-08T19:41:15.146 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is unset 2021-10-08T19:41:15.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:15 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/143986346' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:41:15.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:15 smithi117 ceph-mon[34585]: from='client.36326 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:41:15.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:15 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/143986346' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:41:15.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:15 smithi097 ceph-mon[32687]: from='client.36326 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:41:15.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:15 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/143986346' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:41:15.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:15 smithi097 ceph-mon[41966]: from='client.36326 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:41:16.387 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:41:16.393 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:16.394 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:41:16.394 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:16 smithi097 ceph-mon[41966]: pgmap v993: 188 pgs: 188 active+clean; 4.7 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.07k op/s 2021-10-08T19:41:16.394 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:16 smithi097 ceph-mon[41966]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:41:16.395 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:16 smithi097 ceph-mon[41966]: from='client.36326 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:41:16.395 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:16 smithi097 ceph-mon[41966]: osdmap e478: 8 total, 8 up, 8 in 2021-10-08T19:41:16.395 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:16 smithi097 ceph-mon[32687]: pgmap v993: 188 pgs: 188 active+clean; 4.7 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.07k op/s 2021-10-08T19:41:16.396 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:16 smithi097 ceph-mon[32687]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:41:16.396 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:16 smithi097 ceph-mon[32687]: from='client.36326 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:41:16.396 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:16 smithi097 ceph-mon[32687]: osdmap e478: 8 total, 8 up, 8 in 2021-10-08T19:41:16.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:16 smithi117 ceph-mon[34585]: pgmap v993: 188 pgs: 188 active+clean; 4.7 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.07k op/s 2021-10-08T19:41:16.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:16 smithi117 ceph-mon[34585]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:41:16.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:16 smithi117 ceph-mon[34585]: from='client.36326 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:41:16.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:16 smithi117 ceph-mon[34585]: osdmap e478: 8 total, 8 up, 8 in 2021-10-08T19:41:16.495 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:41:16.549 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:16.849 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:41:16.865 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:41:16.875 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:16.875 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:41:16.976 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:41:17.019 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:17.082 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:41:17.084 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:17.085 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:41:17.187 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:41:17.253 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:17.353 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:41:17.362 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:17 smithi117 ceph-mon[34585]: 6.a scrub ok 2021-10-08T19:41:17.363 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:17 smithi117 ceph-mon[34585]: 6.13 scrub ok 2021-10-08T19:41:17.363 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:17 smithi097 ceph-mon[41966]: 6.a scrub ok 2021-10-08T19:41:17.364 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:17 smithi097 ceph-mon[41966]: 6.13 scrub ok 2021-10-08T19:41:17.364 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:17.365 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:41:17.366 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:17 smithi097 ceph-mon[32687]: 6.a scrub ok 2021-10-08T19:41:17.366 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:17 smithi097 ceph-mon[32687]: 6.13 scrub ok 2021-10-08T19:41:17.374 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:41:17.375 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2021-10-08T19:41:17.375 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2021-10-08T19:41:17.375 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2021-10-08T19:41:17.375 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.375 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.26125.0:41079 11.0 11:08cff7bc:::benchmark_data_smithi097_295476_object41078:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e446)", 2021-10-08T19:41:17.376 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:39:31.129400+0000", 2021-10-08T19:41:17.376 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 106.23560506600001, 2021-10-08T19:41:17.376 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.16243466400000001, 2021-10-08T19:41:17.376 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:41:17.377 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:41:17.377 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:41:17.377 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.26125", 2021-10-08T19:41:17.377 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:41:17.377 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 41079 2021-10-08T19:41:17.378 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.378 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:41:17.378 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.378 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:41:17.379 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.129400+0000", 2021-10-08T19:41:17.379 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:41:17.379 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.379 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.379 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:41:17.380 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.129400+0000", 2021-10-08T19:41:17.380 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:41:17.380 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.380 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.381 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:41:17.381 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.129398+0000", 2021-10-08T19:41:17.381 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2021-10-08T19:41:17.381 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.381 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.382 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:41:17.382 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.129423+0000", 2021-10-08T19:41:17.382 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4715e-05 2021-10-08T19:41:17.382 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.383 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.383 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:41:17.383 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.129433+0000", 2021-10-08T19:41:17.384 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.6460000000000005e-06 2021-10-08T19:41:17.384 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.384 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.384 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:41:17.384 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.129439+0000", 2021-10-08T19:41:17.385 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0700000000000003e-06 2021-10-08T19:41:17.385 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.385 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.385 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:41:17.386 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.129478+0000", 2021-10-08T19:41:17.386 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8812e-05 2021-10-08T19:41:17.386 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.386 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.386 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:41:17.387 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.129604+0000", 2021-10-08T19:41:17.387 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012632600000000001 2021-10-08T19:41:17.387 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.388 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.388 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,7", 2021-10-08T19:41:17.388 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.129746+0000", 2021-10-08T19:41:17.388 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014165799999999999 2021-10-08T19:41:17.388 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.389 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.389 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:41:17.389 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.289824+0000", 2021-10-08T19:41:17.389 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.160078845 2021-10-08T19:41:17.390 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.390 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.390 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:41:17.390 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.289833+0000", 2021-10-08T19:41:17.390 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3480000000000004e-06 2021-10-08T19:41:17.391 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.391 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.391 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:41:17.391 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.291700+0000", 2021-10-08T19:41:17.392 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001867554 2021-10-08T19:41:17.392 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.392 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.392 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:41:17.392 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.291779+0000", 2021-10-08T19:41:17.393 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8794000000000005e-05 2021-10-08T19:41:17.393 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.393 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.394 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:41:17.394 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.291835+0000", 2021-10-08T19:41:17.394 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5504999999999998e-05 2021-10-08T19:41:17.394 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:17.395 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:41:17.395 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:17.395 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.395 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.395 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.26125.0:41073 11.b e446/433 11:d38113c4:::benchmark_data_smithi097_295476_object41072:head v 446'2650, mlcod=446'2647)", 2021-10-08T19:41:17.396 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:39:31.131731+0000", 2021-10-08T19:41:17.396 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 106.23327448400001, 2021-10-08T19:41:17.396 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.16107992700000001, 2021-10-08T19:41:17.396 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:41:17.397 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:41:17.397 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:41:17.397 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.397 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:41:17.397 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.131731+0000", 2021-10-08T19:41:17.398 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:41:17.398 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.398 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.398 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:41:17.398 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.131731+0000", 2021-10-08T19:41:17.399 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:41:17.399 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.399 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.399 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:41:17.400 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.131730+0000", 2021-10-08T19:41:17.400 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:41:17.400 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.400 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.400 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:41:17.401 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.131752+0000", 2021-10-08T19:41:17.401 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2634999999999999e-05 2021-10-08T19:41:17.401 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.401 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.402 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:41:17.402 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.131760+0000", 2021-10-08T19:41:17.402 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6539999999999999e-06 2021-10-08T19:41:17.402 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.402 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.403 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:41:17.403 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.131765+0000", 2021-10-08T19:41:17.403 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8879999999999996e-06 2021-10-08T19:41:17.404 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.404 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.404 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:41:17.404 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.131876+0000", 2021-10-08T19:41:17.405 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000111587 2021-10-08T19:41:17.405 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.405 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.405 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:41:17.405 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.131894+0000", 2021-10-08T19:41:17.406 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8051999999999999e-05 2021-10-08T19:41:17.406 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.406 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.406 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:41:17.407 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.292778+0000", 2021-10-08T19:41:17.407 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.16088374599999999 2021-10-08T19:41:17.407 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.407 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.407 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:41:17.408 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.292810+0000", 2021-10-08T19:41:17.408 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2286000000000002e-05 2021-10-08T19:41:17.408 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:17.408 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:41:17.408 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:17.409 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.409 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.409 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.26125.0:41077 11.b e446/433 11:d44ccd16:::benchmark_data_smithi097_295476_object41076:head v 446'2651, mlcod=446'2647)", 2021-10-08T19:41:17.409 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:39:31.133111+0000", 2021-10-08T19:41:17.410 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 106.231894328, 2021-10-08T19:41:17.410 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.16099754099999999, 2021-10-08T19:41:17.410 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:41:17.410 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:41:17.410 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:41:17.411 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.411 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:41:17.411 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.133111+0000", 2021-10-08T19:41:17.411 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:41:17.411 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.412 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.412 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:41:17.412 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.133111+0000", 2021-10-08T19:41:17.412 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:41:17.413 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.413 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.413 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:41:17.413 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.133109+0000", 2021-10-08T19:41:17.413 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2021-10-08T19:41:17.414 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.414 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.414 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:41:17.414 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.133137+0000", 2021-10-08T19:41:17.414 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7197999999999999e-05 2021-10-08T19:41:17.415 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.415 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.415 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:41:17.415 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.133157+0000", 2021-10-08T19:41:17.416 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0018e-05 2021-10-08T19:41:17.416 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.416 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.416 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:41:17.416 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.133162+0000", 2021-10-08T19:41:17.417 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1150000000000002e-06 2021-10-08T19:41:17.417 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.417 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.417 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:41:17.418 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.133426+0000", 2021-10-08T19:41:17.418 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00026397299999999997 2021-10-08T19:41:17.418 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.418 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.418 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:41:17.419 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.133443+0000", 2021-10-08T19:41:17.419 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6861999999999999e-05 2021-10-08T19:41:17.419 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.419 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.419 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:41:17.420 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.294069+0000", 2021-10-08T19:41:17.420 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.16062681600000001 2021-10-08T19:41:17.420 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.420 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.421 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:41:17.421 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.294108+0000", 2021-10-08T19:41:17.421 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8818e-05 2021-10-08T19:41:17.421 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:17.421 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:41:17.422 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:17.422 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.422 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.422 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop_reply(client.26125.0:41079 11.0 e446/433 ondisk, result = 0)", 2021-10-08T19:41:17.422 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:39:31.134690+0000", 2021-10-08T19:41:17.423 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 106.230314789, 2021-10-08T19:41:17.423 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.15715515499999999, 2021-10-08T19:41:17.423 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:41:17.423 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2021-10-08T19:41:17.424 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:41:17.424 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.424 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:41:17.424 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.134690+0000", 2021-10-08T19:41:17.425 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:41:17.425 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.425 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.425 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:41:17.425 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.134690+0000", 2021-10-08T19:41:17.426 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:41:17.426 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.426 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.426 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:41:17.426 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.134689+0000", 2021-10-08T19:41:17.427 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2021-10-08T19:41:17.427 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.427 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.427 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:41:17.428 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.134695+0000", 2021-10-08T19:41:17.428 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0510000000000002e-06 2021-10-08T19:41:17.428 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.428 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.428 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:41:17.429 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.289737+0000", 2021-10-08T19:41:17.429 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.15504241699999999 2021-10-08T19:41:17.429 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.429 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.430 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:41:17.430 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.289756+0000", 2021-10-08T19:41:17.430 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8984e-05 2021-10-08T19:41:17.430 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.430 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.431 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:41:17.431 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.291676+0000", 2021-10-08T19:41:17.431 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0019198030000000001 2021-10-08T19:41:17.431 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.432 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.432 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:41:17.432 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.291693+0000", 2021-10-08T19:41:17.432 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7221e-05 2021-10-08T19:41:17.432 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.433 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.433 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:41:17.433 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.291845+0000", 2021-10-08T19:41:17.433 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000152175 2021-10-08T19:41:17.434 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:17.434 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:41:17.434 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:17.434 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.434 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.435 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.26125.0:41085 11.0 11:0dda6a9d:::benchmark_data_smithi097_295476_object41084:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e446)", 2021-10-08T19:41:17.435 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:39:31.135284+0000", 2021-10-08T19:41:17.435 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 106.229720781, 2021-10-08T19:41:17.435 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.163002855, 2021-10-08T19:41:17.435 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:41:17.436 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:41:17.436 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:41:17.436 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.26125", 2021-10-08T19:41:17.436 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:41:17.437 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 41085 2021-10-08T19:41:17.437 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.437 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:41:17.437 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.437 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:41:17.438 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.135284+0000", 2021-10-08T19:41:17.438 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:41:17.438 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.438 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.438 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:41:17.439 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.135284+0000", 2021-10-08T19:41:17.439 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:41:17.439 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.439 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.440 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:41:17.440 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.135281+0000", 2021-10-08T19:41:17.440 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2021-10-08T19:41:17.440 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.440 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.441 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:41:17.441 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.135305+0000", 2021-10-08T19:41:17.441 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3577000000000001e-05 2021-10-08T19:41:17.441 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.441 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.442 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:41:17.442 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.289763+0000", 2021-10-08T19:41:17.442 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.154457968 2021-10-08T19:41:17.442 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.443 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.443 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:41:17.443 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.289771+0000", 2021-10-08T19:41:17.443 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4090000000000003e-06 2021-10-08T19:41:17.443 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.444 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.444 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:41:17.444 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.289858+0000", 2021-10-08T19:41:17.444 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6787999999999996e-05 2021-10-08T19:41:17.444 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.445 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.445 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:41:17.445 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.290025+0000", 2021-10-08T19:41:17.445 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016703000000000001 2021-10-08T19:41:17.445 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.446 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.446 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,7", 2021-10-08T19:41:17.446 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.290209+0000", 2021-10-08T19:41:17.446 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00018344499999999999 2021-10-08T19:41:17.447 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.447 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.447 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:41:17.447 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.294985+0000", 2021-10-08T19:41:17.447 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0047768139999999999 2021-10-08T19:41:17.448 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.448 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.448 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:41:17.448 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.295018+0000", 2021-10-08T19:41:17.448 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2255000000000002e-05 2021-10-08T19:41:17.449 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.449 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.449 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:41:17.449 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.298200+0000", 2021-10-08T19:41:17.449 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003181835 2021-10-08T19:41:17.450 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.450 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.450 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:41:17.450 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.298250+0000", 2021-10-08T19:41:17.451 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0497000000000001e-05 2021-10-08T19:41:17.451 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.451 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.451 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:41:17.451 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:39:31.298287+0000", 2021-10-08T19:41:17.452 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7104000000000003e-05 2021-10-08T19:41:17.452 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:17.452 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:41:17.452 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:17.452 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.453 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.453 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.26125.0:89296 11.b e460/433 11:ddc2fd4b:::benchmark_data_smithi097_295476_object89295:head v 460'5658, mlcod=460'5656)", 2021-10-08T19:41:17.453 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:40:14.320418+0000", 2021-10-08T19:41:17.453 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 63.044586764999998, 2021-10-08T19:41:17.454 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.160867068, 2021-10-08T19:41:17.454 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:41:17.454 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:41:17.454 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:41:17.454 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.455 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:41:17.455 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.320418+0000", 2021-10-08T19:41:17.455 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:41:17.456 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.456 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.456 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:41:17.456 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.320418+0000", 2021-10-08T19:41:17.456 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:41:17.457 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.457 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.457 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:41:17.457 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.320417+0000", 2021-10-08T19:41:17.457 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2021-10-08T19:41:17.458 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.458 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.458 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:41:17.458 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.320441+0000", 2021-10-08T19:41:17.459 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3601e-05 2021-10-08T19:41:17.459 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.459 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.459 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:41:17.459 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.320456+0000", 2021-10-08T19:41:17.460 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5758999999999999e-05 2021-10-08T19:41:17.460 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.460 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.460 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:41:17.460 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.320462+0000", 2021-10-08T19:41:17.461 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2639999999999999e-06 2021-10-08T19:41:17.461 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.461 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.461 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:41:17.462 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.320504+0000", 2021-10-08T19:41:17.462 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2190000000000001e-05 2021-10-08T19:41:17.462 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.462 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.462 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:41:17.463 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.320523+0000", 2021-10-08T19:41:17.463 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.929e-05 2021-10-08T19:41:17.463 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.463 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.463 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:41:17.464 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.330114+0000", 2021-10-08T19:41:17.464 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.009590632 2021-10-08T19:41:17.464 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.464 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.464 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:41:17.465 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.481285+0000", 2021-10-08T19:41:17.465 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.151171689 2021-10-08T19:41:17.465 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:17.465 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:41:17.466 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:17.467 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.467 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.467 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.26125.0:89290 11.6 e460/433 11:66ed1d1f:::benchmark_data_smithi097_295476_object89289:head v 460'5497, mlcod=460'5493)", 2021-10-08T19:41:17.467 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:40:14.320682+0000", 2021-10-08T19:41:17.467 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 63.044322745000002, 2021-10-08T19:41:17.468 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.160599826, 2021-10-08T19:41:17.468 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:41:17.469 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:41:17.469 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:41:17.469 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.469 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:41:17.470 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.320682+0000", 2021-10-08T19:41:17.470 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:41:17.470 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.470 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.470 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:41:17.471 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.320682+0000", 2021-10-08T19:41:17.471 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:41:17.471 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.471 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.471 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:41:17.472 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.320681+0000", 2021-10-08T19:41:17.472 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2021-10-08T19:41:17.473 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.473 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.473 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:41:17.473 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.320703+0000", 2021-10-08T19:41:17.473 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2288000000000001e-05 2021-10-08T19:41:17.474 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.474 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.474 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:41:17.474 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.320712+0000", 2021-10-08T19:41:17.474 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9779999999999994e-06 2021-10-08T19:41:17.475 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.475 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.475 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:41:17.475 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.320717+0000", 2021-10-08T19:41:17.476 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0849999999999996e-06 2021-10-08T19:41:17.476 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.476 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.476 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:41:17.476 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.322665+0000", 2021-10-08T19:41:17.477 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0019477100000000001 2021-10-08T19:41:17.477 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.477 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.477 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:41:17.477 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.322684+0000", 2021-10-08T19:41:17.478 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8768000000000001e-05 2021-10-08T19:41:17.478 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.478 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.478 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:41:17.478 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.481201+0000", 2021-10-08T19:41:17.479 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.158517144 2021-10-08T19:41:17.479 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.479 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.479 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:41:17.480 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.481282+0000", 2021-10-08T19:41:17.480 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1136000000000004e-05 2021-10-08T19:41:17.480 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:17.480 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:41:17.480 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:17.481 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.481 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.481 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.26125.0:89307 11.0 11:009bc56b:::benchmark_data_smithi097_295476_object89306:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e460)", 2021-10-08T19:41:17.481 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:40:14.328370+0000", 2021-10-08T19:41:17.481 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 63.036634569999997, 2021-10-08T19:41:17.482 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.161469956, 2021-10-08T19:41:17.482 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:41:17.482 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:41:17.482 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:41:17.483 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.26125", 2021-10-08T19:41:17.483 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:41:17.483 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 89307 2021-10-08T19:41:17.483 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.483 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:41:17.484 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.484 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:41:17.484 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.328370+0000", 2021-10-08T19:41:17.484 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:41:17.485 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.485 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.485 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:41:17.485 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.328370+0000", 2021-10-08T19:41:17.485 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:41:17.486 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.486 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.486 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:41:17.486 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.328367+0000", 2021-10-08T19:41:17.486 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999967 2021-10-08T19:41:17.487 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.487 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.487 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:41:17.487 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.328400+0000", 2021-10-08T19:41:17.488 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2567000000000002e-05 2021-10-08T19:41:17.488 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.488 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.488 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:41:17.489 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.328413+0000", 2021-10-08T19:41:17.489 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3379e-05 2021-10-08T19:41:17.489 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.489 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.489 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:41:17.490 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.328419+0000", 2021-10-08T19:41:17.490 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5649999999999998e-06 2021-10-08T19:41:17.490 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.490 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.491 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:41:17.491 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.328469+0000", 2021-10-08T19:41:17.491 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9806999999999999e-05 2021-10-08T19:41:17.491 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.491 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.492 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:41:17.492 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.481370+0000", 2021-10-08T19:41:17.492 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.152900549 2021-10-08T19:41:17.492 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.493 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.493 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,7", 2021-10-08T19:41:17.493 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.481543+0000", 2021-10-08T19:41:17.493 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000173637 2021-10-08T19:41:17.493 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.494 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.494 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:41:17.494 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.489356+0000", 2021-10-08T19:41:17.494 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0078125199999999999 2021-10-08T19:41:17.495 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.495 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.495 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:41:17.495 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.489393+0000", 2021-10-08T19:41:17.496 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7095000000000003e-05 2021-10-08T19:41:17.496 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.496 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.496 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:41:17.496 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.489749+0000", 2021-10-08T19:41:17.497 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00035595700000000001 2021-10-08T19:41:17.497 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.497 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.497 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:41:17.497 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.489802+0000", 2021-10-08T19:41:17.498 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2547999999999999e-05 2021-10-08T19:41:17.498 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.498 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.498 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:41:17.499 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.489840+0000", 2021-10-08T19:41:17.499 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8832999999999999e-05 2021-10-08T19:41:17.499 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:17.499 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:41:17.499 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:17.500 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.500 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.500 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.26125.0:89301 11.b e460/433 11:dbdf9af6:::benchmark_data_smithi097_295476_object89300:head v 460'5659, mlcod=460'5656)", 2021-10-08T19:41:17.500 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:40:14.329039+0000", 2021-10-08T19:41:17.500 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 63.035965822000001, 2021-10-08T19:41:17.501 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.15763507399999999, 2021-10-08T19:41:17.501 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:41:17.501 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:41:17.501 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:41:17.502 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.502 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:41:17.502 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.329039+0000", 2021-10-08T19:41:17.502 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:41:17.502 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.503 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.503 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:41:17.503 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.329039+0000", 2021-10-08T19:41:17.503 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:41:17.504 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.504 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.504 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:41:17.504 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.329038+0000", 2021-10-08T19:41:17.505 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:41:17.505 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.505 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.505 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:41:17.505 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.329064+0000", 2021-10-08T19:41:17.506 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6874000000000001e-05 2021-10-08T19:41:17.506 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.506 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.506 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:41:17.506 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.481167+0000", 2021-10-08T19:41:17.507 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.152102871 2021-10-08T19:41:17.507 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.508 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.508 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:41:17.508 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.481191+0000", 2021-10-08T19:41:17.509 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3393000000000001e-05 2021-10-08T19:41:17.509 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.509 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.509 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:41:17.509 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.481345+0000", 2021-10-08T19:41:17.510 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000154625 2021-10-08T19:41:17.510 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.510 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.510 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:41:17.511 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.481373+0000", 2021-10-08T19:41:17.511 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7569e-05 2021-10-08T19:41:17.511 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.511 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.511 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:41:17.512 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.486637+0000", 2021-10-08T19:41:17.512 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0052638219999999996 2021-10-08T19:41:17.512 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.512 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.513 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:41:17.513 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:14.486674+0000", 2021-10-08T19:41:17.513 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7623999999999998e-05 2021-10-08T19:41:17.513 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:17.513 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:41:17.514 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:17.514 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.514 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.514 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.26125.0:106107 11.7 11:e10db1cf:::benchmark_data_smithi097_295476_object106106:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e466)", 2021-10-08T19:41:17.515 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:40:31.580034+0000", 2021-10-08T19:41:17.515 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 45.784970850000001, 2021-10-08T19:41:17.515 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.17863474700000001, 2021-10-08T19:41:17.515 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:41:17.515 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:41:17.516 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:41:17.516 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.26125", 2021-10-08T19:41:17.516 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:41:17.516 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 106107 2021-10-08T19:41:17.516 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.517 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:41:17.517 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.517 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:41:17.517 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.580034+0000", 2021-10-08T19:41:17.518 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:41:17.518 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.518 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.518 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:41:17.518 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.580034+0000", 2021-10-08T19:41:17.519 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:41:17.519 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.519 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.519 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:41:17.520 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.580032+0000", 2021-10-08T19:41:17.520 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:41:17.520 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.520 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.520 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:41:17.521 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.580071+0000", 2021-10-08T19:41:17.521 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8445000000000002e-05 2021-10-08T19:41:17.521 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.521 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.521 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:41:17.522 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.580082+0000", 2021-10-08T19:41:17.522 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0665e-05 2021-10-08T19:41:17.522 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.522 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.523 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:41:17.523 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.580087+0000", 2021-10-08T19:41:17.523 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5489999999999997e-06 2021-10-08T19:41:17.523 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.523 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.524 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:41:17.524 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.582800+0000", 2021-10-08T19:41:17.524 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0027133470000000001 2021-10-08T19:41:17.524 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.525 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.525 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:41:17.525 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.582920+0000", 2021-10-08T19:41:17.525 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119753 2021-10-08T19:41:17.525 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.526 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.526 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4,5", 2021-10-08T19:41:17.526 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.583080+0000", 2021-10-08T19:41:17.526 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015942800000000001 2021-10-08T19:41:17.527 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.527 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.527 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:41:17.527 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.587206+0000", 2021-10-08T19:41:17.527 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0041268829999999996 2021-10-08T19:41:17.528 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.528 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.528 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:41:17.528 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.754085+0000", 2021-10-08T19:41:17.528 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.16687882600000001 2021-10-08T19:41:17.529 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.529 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.529 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:41:17.529 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.758582+0000", 2021-10-08T19:41:17.529 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0044963690000000001 2021-10-08T19:41:17.530 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.530 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.530 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:41:17.530 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.758630+0000", 2021-10-08T19:41:17.531 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7862999999999999e-05 2021-10-08T19:41:17.531 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.531 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.531 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:41:17.531 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.758669+0000", 2021-10-08T19:41:17.532 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9410999999999999e-05 2021-10-08T19:41:17.532 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:17.532 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:41:17.532 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:17.533 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.533 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.533 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.26125.0:106111 11.c 11:32c805d1:::benchmark_data_smithi097_295476_object106110:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e466)", 2021-10-08T19:41:17.533 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:40:31.582286+0000", 2021-10-08T19:41:17.533 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 45.782718977000002, 2021-10-08T19:41:17.534 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.17171325200000001, 2021-10-08T19:41:17.534 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:41:17.534 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:41:17.534 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:41:17.534 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.26125", 2021-10-08T19:41:17.535 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:41:17.535 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 106111 2021-10-08T19:41:17.535 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.535 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:41:17.536 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.536 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:41:17.536 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.582286+0000", 2021-10-08T19:41:17.536 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:41:17.536 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.537 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.537 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:41:17.537 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.582286+0000", 2021-10-08T19:41:17.537 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:41:17.537 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.538 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.538 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:41:17.538 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.582284+0000", 2021-10-08T19:41:17.538 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:41:17.539 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.539 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.539 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:41:17.539 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.582309+0000", 2021-10-08T19:41:17.539 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5269000000000002e-05 2021-10-08T19:41:17.540 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.540 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.540 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:41:17.540 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.582321+0000", 2021-10-08T19:41:17.540 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2028000000000001e-05 2021-10-08T19:41:17.541 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.541 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.541 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:41:17.541 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.582327+0000", 2021-10-08T19:41:17.541 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1829999999999999e-06 2021-10-08T19:41:17.542 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.542 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.542 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:41:17.542 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.582541+0000", 2021-10-08T19:41:17.543 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021361500000000001 2021-10-08T19:41:17.543 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.543 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.543 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:41:17.543 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.582666+0000", 2021-10-08T19:41:17.544 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012481999999999999 2021-10-08T19:41:17.544 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.544 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.544 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2,4", 2021-10-08T19:41:17.545 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.582816+0000", 2021-10-08T19:41:17.545 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000149899 2021-10-08T19:41:17.545 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.545 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.545 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:41:17.546 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.587198+0000", 2021-10-08T19:41:17.546 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0043823940000000004 2021-10-08T19:41:17.546 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.546 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.546 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:41:17.547 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.587370+0000", 2021-10-08T19:41:17.547 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000172268 2021-10-08T19:41:17.547 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.547 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.548 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:41:17.548 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.592304+0000", 2021-10-08T19:41:17.548 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0049333490000000001 2021-10-08T19:41:17.548 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.548 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.549 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:41:17.549 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.592358+0000", 2021-10-08T19:41:17.549 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4147999999999997e-05 2021-10-08T19:41:17.549 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.549 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.550 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:41:17.550 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.753999+0000", 2021-10-08T19:41:17.550 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.16164139999999999 2021-10-08T19:41:17.550 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:17.551 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:41:17.551 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:17.551 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.551 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.551 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.26125.0:106122 11.0 11:05827b41:::benchmark_data_smithi097_295476_object106121:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e466)", 2021-10-08T19:41:17.552 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:40:31.588753+0000", 2021-10-08T19:41:17.552 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 45.776252132000003, 2021-10-08T19:41:17.552 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.16602751099999999, 2021-10-08T19:41:17.552 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:41:17.552 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:41:17.553 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:41:17.553 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.26125", 2021-10-08T19:41:17.553 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:41:17.553 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 106122 2021-10-08T19:41:17.554 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.554 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:41:17.554 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.554 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:41:17.554 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.588753+0000", 2021-10-08T19:41:17.555 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:41:17.555 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.555 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.556 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:41:17.556 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.588753+0000", 2021-10-08T19:41:17.556 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:41:17.556 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.557 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.557 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:41:17.557 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.588751+0000", 2021-10-08T19:41:17.557 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:41:17.557 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.558 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.558 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:41:17.558 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.588781+0000", 2021-10-08T19:41:17.558 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0086e-05 2021-10-08T19:41:17.559 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.559 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.559 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:41:17.559 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.588793+0000", 2021-10-08T19:41:17.559 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2099999999999999e-05 2021-10-08T19:41:17.560 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.560 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.560 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:41:17.560 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.588800+0000", 2021-10-08T19:41:17.560 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6830000000000002e-06 2021-10-08T19:41:17.561 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.561 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.561 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:41:17.561 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.588846+0000", 2021-10-08T19:41:17.561 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6211000000000002e-05 2021-10-08T19:41:17.562 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.562 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.562 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:41:17.562 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.588958+0000", 2021-10-08T19:41:17.563 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011228800000000001 2021-10-08T19:41:17.563 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.563 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.563 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3,7", 2021-10-08T19:41:17.563 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.589113+0000", 2021-10-08T19:41:17.564 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015519899999999999 2021-10-08T19:41:17.564 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.564 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.564 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:41:17.565 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.591476+0000", 2021-10-08T19:41:17.565 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0023629150000000002 2021-10-08T19:41:17.565 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.565 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.565 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:41:17.566 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.754340+0000", 2021-10-08T19:41:17.566 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.162863649 2021-10-08T19:41:17.566 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.566 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.567 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:41:17.567 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.754694+0000", 2021-10-08T19:41:17.567 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00035387199999999998 2021-10-08T19:41:17.567 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.567 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.568 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:41:17.568 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.754745+0000", 2021-10-08T19:41:17.568 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1010000000000001e-05 2021-10-08T19:41:17.568 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.568 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.569 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:41:17.569 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.754780+0000", 2021-10-08T19:41:17.569 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5562000000000003e-05 2021-10-08T19:41:17.569 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:17.570 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:41:17.570 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:17.570 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.570 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.570 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.26125.0:106118 11.f e466/433 11:ff53cee4:::benchmark_data_smithi097_295476_object106117:head v 466'6581, mlcod=466'6579)", 2021-10-08T19:41:17.571 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:40:31.589881+0000", 2021-10-08T19:41:17.571 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 45.775124298999998, 2021-10-08T19:41:17.571 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.16433692699999999, 2021-10-08T19:41:17.571 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:41:17.571 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:41:17.572 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:41:17.572 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.572 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:41:17.573 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.589881+0000", 2021-10-08T19:41:17.573 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:41:17.573 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.573 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.573 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:41:17.574 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.589881+0000", 2021-10-08T19:41:17.574 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:41:17.574 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.574 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.575 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:41:17.575 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.589879+0000", 2021-10-08T19:41:17.575 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2021-10-08T19:41:17.575 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.575 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.576 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:41:17.576 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.589935+0000", 2021-10-08T19:41:17.576 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5807000000000003e-05 2021-10-08T19:41:17.576 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.577 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.577 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:41:17.577 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.589946+0000", 2021-10-08T19:41:17.577 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0791000000000001e-05 2021-10-08T19:41:17.577 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.578 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.578 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:41:17.578 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.589951+0000", 2021-10-08T19:41:17.578 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7620000000000001e-06 2021-10-08T19:41:17.578 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.579 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.579 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:41:17.579 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.590007+0000", 2021-10-08T19:41:17.579 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5865000000000001e-05 2021-10-08T19:41:17.580 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.580 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.580 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:41:17.580 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.590027+0000", 2021-10-08T19:41:17.584 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9349000000000001e-05 2021-10-08T19:41:17.584 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.585 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.585 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:41:17.585 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.754144+0000", 2021-10-08T19:41:17.585 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.16411710800000001 2021-10-08T19:41:17.585 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.586 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.586 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:41:17.586 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.754218+0000", 2021-10-08T19:41:17.586 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3875000000000007e-05 2021-10-08T19:41:17.586 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:17.587 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:41:17.587 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:17.587 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.587 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.588 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.26125.0:106121 11.3 e466/433 11:c0882b5a:::benchmark_data_smithi097_295476_object106120:head v 466'6803, mlcod=466'6801)", 2021-10-08T19:41:17.588 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:40:31.590746+0000", 2021-10-08T19:41:17.588 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 45.774258561000003, 2021-10-08T19:41:17.588 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.163317991, 2021-10-08T19:41:17.588 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:41:17.589 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:41:17.589 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:41:17.589 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.589 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:41:17.590 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.590746+0000", 2021-10-08T19:41:17.590 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:41:17.590 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.590 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.590 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:41:17.591 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.590746+0000", 2021-10-08T19:41:17.591 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:41:17.591 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.591 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.592 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:41:17.592 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.590745+0000", 2021-10-08T19:41:17.592 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2021-10-08T19:41:17.592 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.593 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.593 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:41:17.593 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.590807+0000", 2021-10-08T19:41:17.593 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1617000000000003e-05 2021-10-08T19:41:17.593 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.594 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.594 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:41:17.594 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.590816+0000", 2021-10-08T19:41:17.594 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7700000000000007e-06 2021-10-08T19:41:17.595 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.595 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.595 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:41:17.595 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.590821+0000", 2021-10-08T19:41:17.595 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5520000000000004e-06 2021-10-08T19:41:17.596 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.596 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.596 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:41:17.596 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.590862+0000", 2021-10-08T19:41:17.597 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1091999999999999e-05 2021-10-08T19:41:17.597 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.597 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.597 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:41:17.597 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.590882+0000", 2021-10-08T19:41:17.598 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9919e-05 2021-10-08T19:41:17.598 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.598 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.598 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:41:17.599 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.753996+0000", 2021-10-08T19:41:17.599 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.16311386999999999 2021-10-08T19:41:17.599 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.599 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.599 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:41:17.600 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.754064+0000", 2021-10-08T19:41:17.600 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8511999999999997e-05 2021-10-08T19:41:17.600 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:17.600 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:41:17.600 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:17.601 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.601 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.601 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop_reply(client.26125.0:106111 11.c e466/433 ondisk, result = 0)", 2021-10-08T19:41:17.601 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:40:31.592227+0000", 2021-10-08T19:41:17.602 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 45.772778092999999, 2021-10-08T19:41:17.602 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.16178684099999999, 2021-10-08T19:41:17.602 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:41:17.602 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2021-10-08T19:41:17.602 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:41:17.603 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.603 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:41:17.603 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.592227+0000", 2021-10-08T19:41:17.603 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:41:17.603 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.604 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.604 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:41:17.604 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.592227+0000", 2021-10-08T19:41:17.604 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:41:17.605 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.605 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.605 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:41:17.605 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.592226+0000", 2021-10-08T19:41:17.605 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2021-10-08T19:41:17.606 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.606 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.606 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:41:17.606 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.592232+0000", 2021-10-08T19:41:17.606 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0700000000000003e-06 2021-10-08T19:41:17.607 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.607 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.607 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:41:17.607 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.592242+0000", 2021-10-08T19:41:17.608 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.8169999999999994e-06 2021-10-08T19:41:17.608 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.608 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.608 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:41:17.608 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.592248+0000", 2021-10-08T19:41:17.609 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0650000000000004e-06 2021-10-08T19:41:17.609 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.609 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.609 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:41:17.610 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.592289+0000", 2021-10-08T19:41:17.610 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1514999999999998e-05 2021-10-08T19:41:17.610 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.610 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.610 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:41:17.611 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.592297+0000", 2021-10-08T19:41:17.611 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4780000000000002e-06 2021-10-08T19:41:17.611 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.611 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.611 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:41:17.612 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.754014+0000", 2021-10-08T19:41:17.612 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.16171717599999999 2021-10-08T19:41:17.612 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:17.612 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:41:17.612 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:17.613 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.613 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.613 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.26125.0:106123 11.e e466/433 11:79558f0f:::benchmark_data_smithi097_295476_object106122:head v 466'6485, mlcod=466'6481)", 2021-10-08T19:41:17.613 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:40:31.592259+0000", 2021-10-08T19:41:17.614 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 45.772745667000002, 2021-10-08T19:41:17.614 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.16972288299999999, 2021-10-08T19:41:17.614 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:41:17.614 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:41:17.614 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:41:17.615 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.615 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:41:17.615 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.592259+0000", 2021-10-08T19:41:17.615 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:41:17.616 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.616 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.616 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:41:17.616 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.592259+0000", 2021-10-08T19:41:17.616 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:41:17.617 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.617 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.617 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:41:17.617 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.592259+0000", 2021-10-08T19:41:17.617 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2021-10-08T19:41:17.618 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.618 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.618 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:41:17.618 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.592288+0000", 2021-10-08T19:41:17.619 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8702000000000001e-05 2021-10-08T19:41:17.619 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.619 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.619 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:41:17.619 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.592294+0000", 2021-10-08T19:41:17.620 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9290000000000003e-06 2021-10-08T19:41:17.620 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.620 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.620 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:41:17.621 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.592298+0000", 2021-10-08T19:41:17.621 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.16e-06 2021-10-08T19:41:17.621 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.621 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.621 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:41:17.622 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.592332+0000", 2021-10-08T19:41:17.622 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4711e-05 2021-10-08T19:41:17.622 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.622 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.622 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:41:17.623 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.753893+0000", 2021-10-08T19:41:17.623 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.161560443 2021-10-08T19:41:17.623 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.623 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.623 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:41:17.624 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.761940+0000", 2021-10-08T19:41:17.624 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0080473869999999996 2021-10-08T19:41:17.624 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.624 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.624 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:41:17.625 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.761982+0000", 2021-10-08T19:41:17.625 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1999000000000002e-05 2021-10-08T19:41:17.625 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:17.625 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:41:17.626 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:17.626 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.626 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.626 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop_reply(client.26125.0:106107 11.7 e466/433 ondisk, result = 0)", 2021-10-08T19:41:17.626 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:40:31.592308+0000", 2021-10-08T19:41:17.627 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 45.772696623999998, 2021-10-08T19:41:17.627 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.161805591, 2021-10-08T19:41:17.627 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:41:17.627 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2021-10-08T19:41:17.627 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:41:17.628 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.628 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:41:17.628 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.592308+0000", 2021-10-08T19:41:17.628 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:41:17.629 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.629 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.629 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:41:17.629 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.592308+0000", 2021-10-08T19:41:17.629 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:41:17.630 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.630 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.630 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:41:17.630 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.592308+0000", 2021-10-08T19:41:17.630 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2021-10-08T19:41:17.631 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.631 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.631 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:41:17.631 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.592310+0000", 2021-10-08T19:41:17.631 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.34e-06 2021-10-08T19:41:17.632 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.632 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.632 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:41:17.632 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.592315+0000", 2021-10-08T19:41:17.633 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2590000000000002e-06 2021-10-08T19:41:17.633 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.633 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.633 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:41:17.633 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.592318+0000", 2021-10-08T19:41:17.634 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5300000000000001e-06 2021-10-08T19:41:17.634 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.634 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.634 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:41:17.635 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.754041+0000", 2021-10-08T19:41:17.635 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.161723165 2021-10-08T19:41:17.635 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.635 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.635 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:41:17.636 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.754064+0000", 2021-10-08T19:41:17.636 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2419e-05 2021-10-08T19:41:17.636 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.636 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.636 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:41:17.637 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.754114+0000", 2021-10-08T19:41:17.637 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0327000000000001e-05 2021-10-08T19:41:17.637 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:17.637 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:41:17.638 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:17.638 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.638 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.638 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop_reply(client.26125.0:106107 11.7 e466/433 ondisk, result = 0)", 2021-10-08T19:41:17.638 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:40:31.593165+0000", 2021-10-08T19:41:17.639 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 45.771840304999998, 2021-10-08T19:41:17.639 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.16551418300000001, 2021-10-08T19:41:17.639 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:41:17.639 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2021-10-08T19:41:17.639 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:41:17.640 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.640 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:41:17.640 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.593165+0000", 2021-10-08T19:41:17.640 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:41:17.641 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.641 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.641 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:41:17.641 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.593165+0000", 2021-10-08T19:41:17.641 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:41:17.642 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.642 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.642 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:41:17.642 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.593164+0000", 2021-10-08T19:41:17.642 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:41:17.643 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.643 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.643 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:41:17.643 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.593169+0000", 2021-10-08T19:41:17.644 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5940000000000001e-06 2021-10-08T19:41:17.644 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.644 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.644 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:41:17.644 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.753953+0000", 2021-10-08T19:41:17.645 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.16078389400000001 2021-10-08T19:41:17.645 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.645 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.645 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:41:17.645 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.753976+0000", 2021-10-08T19:41:17.646 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2453e-05 2021-10-08T19:41:17.646 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.646 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.646 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:41:17.647 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.758567+0000", 2021-10-08T19:41:17.647 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0045918369999999997 2021-10-08T19:41:17.647 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.647 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.647 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:41:17.648 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.758575+0000", 2021-10-08T19:41:17.648 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2810000000000003e-06 2021-10-08T19:41:17.648 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.648 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.649 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:41:17.649 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.758679+0000", 2021-10-08T19:41:17.649 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000104208 2021-10-08T19:41:17.649 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:17.649 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:41:17.650 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:17.650 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.650 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.650 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.26125.0:106130 11.7 11:e3f0d14f:::benchmark_data_smithi097_295476_object106129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e466)", 2021-10-08T19:41:17.651 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:40:31.595443+0000", 2021-10-08T19:41:17.651 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 45.769562469, 2021-10-08T19:41:17.651 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.17430362199999999, 2021-10-08T19:41:17.651 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:41:17.651 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:41:17.652 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:41:17.652 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.26125", 2021-10-08T19:41:17.652 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:41:17.652 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 106130 2021-10-08T19:41:17.652 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.653 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:41:17.653 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.653 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:41:17.653 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.595443+0000", 2021-10-08T19:41:17.653 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:41:17.654 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.654 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.654 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:41:17.654 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.595443+0000", 2021-10-08T19:41:17.655 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:41:17.655 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.655 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.655 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:41:17.655 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.595440+0000", 2021-10-08T19:41:17.656 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:41:17.656 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.656 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.656 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:41:17.657 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.595463+0000", 2021-10-08T19:41:17.657 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2911000000000001e-05 2021-10-08T19:41:17.657 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.657 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.657 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:41:17.658 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.753905+0000", 2021-10-08T19:41:17.658 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.15844169299999999 2021-10-08T19:41:17.658 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.658 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.659 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:41:17.659 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.753930+0000", 2021-10-08T19:41:17.659 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5159000000000001e-05 2021-10-08T19:41:17.659 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.659 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.660 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:41:17.660 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.758708+0000", 2021-10-08T19:41:17.660 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0047778150000000004 2021-10-08T19:41:17.660 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.660 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.661 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:41:17.661 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.758838+0000", 2021-10-08T19:41:17.661 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000130753 2021-10-08T19:41:17.661 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.661 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.662 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4,5", 2021-10-08T19:41:17.662 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.758991+0000", 2021-10-08T19:41:17.662 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000152106 2021-10-08T19:41:17.662 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.663 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.663 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:41:17.663 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.761913+0000", 2021-10-08T19:41:17.663 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029226759999999999 2021-10-08T19:41:17.663 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.664 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.664 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:41:17.664 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.763662+0000", 2021-10-08T19:41:17.664 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017483139999999999 2021-10-08T19:41:17.665 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.665 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.665 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:41:17.665 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.769653+0000", 2021-10-08T19:41:17.665 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0059918130000000003 2021-10-08T19:41:17.666 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.666 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.666 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:41:17.666 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.769707+0000", 2021-10-08T19:41:17.667 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3736000000000002e-05 2021-10-08T19:41:17.667 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.667 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.667 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:41:17.667 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.769746+0000", 2021-10-08T19:41:17.668 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9057999999999998e-05 2021-10-08T19:41:17.668 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:17.668 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:41:17.668 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:17.668 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.669 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.669 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.26125.0:106129 11.3 e466/433 11:c79fe91e:::benchmark_data_smithi097_295476_object106128:head v 466'6804, mlcod=466'6801)", 2021-10-08T19:41:17.669 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:40:31.595505+0000", 2021-10-08T19:41:17.669 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 45.769500121999997, 2021-10-08T19:41:17.670 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.16245030499999999, 2021-10-08T19:41:17.670 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:41:17.670 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:41:17.670 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:41:17.670 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.671 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:41:17.671 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.595505+0000", 2021-10-08T19:41:17.671 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:41:17.671 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.672 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.672 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:41:17.672 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.595505+0000", 2021-10-08T19:41:17.672 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:41:17.672 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.673 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.673 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:41:17.673 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.595503+0000", 2021-10-08T19:41:17.673 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2021-10-08T19:41:17.674 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.674 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.674 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:41:17.674 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.595608+0000", 2021-10-08T19:41:17.675 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010481599999999999 2021-10-08T19:41:17.675 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.675 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.675 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:41:17.675 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.753901+0000", 2021-10-08T19:41:17.676 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.15829273899999999 2021-10-08T19:41:17.676 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.676 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.676 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:41:17.677 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.753926+0000", 2021-10-08T19:41:17.677 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4833000000000001e-05 2021-10-08T19:41:17.677 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.677 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.677 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:41:17.678 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.754155+0000", 2021-10-08T19:41:17.678 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000229767 2021-10-08T19:41:17.678 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.678 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.679 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:41:17.679 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.754228+0000", 2021-10-08T19:41:17.679 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2092e-05 2021-10-08T19:41:17.679 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.679 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.680 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2021-10-08T19:41:17.680 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.757921+0000", 2021-10-08T19:41:17.680 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003693506 2021-10-08T19:41:17.680 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:17.680 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:17.681 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2021-10-08T19:41:17.681 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:40:31.757955+0000", 2021-10-08T19:41:17.681 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4131999999999998e-05 2021-10-08T19:41:17.681 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:17.681 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:41:17.682 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:17.682 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:17.682 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:41:17.682 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:41:17.683 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:41:17.684 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:41:17 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:41:17.690 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:41:17.694 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2021-10-08T19:41:17.785 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:17.877 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:41:17.884 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:17.885 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:41:17.986 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:41:18.030 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:18.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:18 smithi117 ceph-mon[34585]: 2.0 scrub ok 2021-10-08T19:41:18.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:18 smithi117 ceph-mon[34585]: pgmap v995: 188 pgs: 188 active+clean; 4.7 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.20k op/s 2021-10-08T19:41:18.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:18 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:41:18.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:18 smithi117 ceph-mon[34585]: 2.4 scrub ok 2021-10-08T19:41:18.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:18 smithi097 ceph-mon[32687]: 2.0 scrub ok 2021-10-08T19:41:18.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:18 smithi097 ceph-mon[32687]: pgmap v995: 188 pgs: 188 active+clean; 4.7 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.20k op/s 2021-10-08T19:41:18.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:18 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:41:18.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:18 smithi097 ceph-mon[32687]: 2.4 scrub ok 2021-10-08T19:41:18.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:18 smithi097 ceph-mon[41966]: 2.0 scrub ok 2021-10-08T19:41:18.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:18 smithi097 ceph-mon[41966]: pgmap v995: 188 pgs: 188 active+clean; 4.7 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.20k op/s 2021-10-08T19:41:18.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:18 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:41:18.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:18 smithi097 ceph-mon[41966]: 2.4 scrub ok 2021-10-08T19:41:18.809 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset nodeep-scrub 2021-10-08T19:41:18.918 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:41:18.934 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:18.935 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:41:19.036 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:41:19.086 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:19.170 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:19 smithi097 ceph-mon[32687]: from='client.26293 v1:172.21.15.97:0/2331503638' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:41:19.202 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2021-10-08T19:41:19.223 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":995,"stamp":"2021-10-08T19:41:17.010812+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5091236060,"num_objects":77872,"num_object_clones":0,"num_object_copies":233616,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77872,"num_whiteouts":0,"num_read":1686,"num_read_kb":1443,"num_write":150525,"num_write_kb":7279784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":533,"num_bytes_recovered":11617,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":69703,"ondisk_log_size":69703,"up":564,"acting":564,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":564,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":18060388,"kb_used_data":15041572,"kb_used_omap":0,"kb_used_meta":3018624,"kb_avail":731900828,"statfs":{"total":767960285184,"available":749466447872,"internally_reserved":0,"allocated":15402569728,"data_stored":15399411828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3091070976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,4,10,4,4],"upper_bound":32},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-703463424,"num_objects":-10734,"num_object_clones":0,"num_object_copies":-32202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-10734,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":10734,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.944158"},"pg_stats":[{"pgid":"2.29","version":"0'0","reported_seq":108,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.943043+0000","last_change":"2021-10-08T19:39:15.207230+0000","last_active":"2021-10-08T19:41:04.943043+0000","last_peered":"2021-10-08T19:41:04.943043+0000","last_clean":"2021-10-08T19:41:04.943043+0000","last_became_active":"2021-10-08T19:37:45.848663+0000","last_became_peered":"2021-10-08T19:37:45.848663+0000","last_unstale":"2021-10-08T19:41:04.943043+0000","last_undegraded":"2021-10-08T19:41:04.943043+0000","last_fullsized":"2021-10-08T19:41:04.943043+0000","mapping_epoch":407,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":408,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:15.207136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:30:11.102934+0000","last_clean_scrub_stamp":"2021-10-08T19:39:15.207136+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0027672759999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.28","version":"0'0","reported_seq":99,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.948423+0000","last_change":"2021-10-08T19:39:21.168002+0000","last_active":"2021-10-08T19:41:04.948423+0000","last_peered":"2021-10-08T19:41:04.948423+0000","last_clean":"2021-10-08T19:41:04.948423+0000","last_became_active":"2021-10-08T19:37:00.334502+0000","last_became_peered":"2021-10-08T19:37:00.334502+0000","last_unstale":"2021-10-08T19:41:04.948423+0000","last_undegraded":"2021-10-08T19:41:04.948423+0000","last_fullsized":"2021-10-08T19:41:04.948423+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:21.167907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:21.167907+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0095106210000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.27","version":"0'0","reported_seq":412,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.943901+0000","last_change":"2021-10-08T19:39:12.559639+0000","last_active":"2021-10-08T19:41:04.943901+0000","last_peered":"2021-10-08T19:41:04.943901+0000","last_clean":"2021-10-08T19:41:04.943901+0000","last_became_active":"2021-10-08T19:37:00.342526+0000","last_became_peered":"2021-10-08T19:37:00.342526+0000","last_unstale":"2021-10-08T19:41:04.943901+0000","last_undegraded":"2021-10-08T19:41:04.943901+0000","last_fullsized":"2021-10-08T19:41:04.943901+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:12.559542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:12.559542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0025174720000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.26","version":"0'0","reported_seq":99,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.945746+0000","last_change":"2021-10-08T19:39:13.573021+0000","last_active":"2021-10-08T19:41:04.945746+0000","last_peered":"2021-10-08T19:41:04.945746+0000","last_clean":"2021-10-08T19:41:04.945746+0000","last_became_active":"2021-10-08T19:37:00.340327+0000","last_became_peered":"2021-10-08T19:37:00.340327+0000","last_unstale":"2021-10-08T19:41:04.945746+0000","last_undegraded":"2021-10-08T19:41:04.945746+0000","last_fullsized":"2021-10-08T19:41:04.945746+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:13.572950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:07.710367+0000","last_clean_scrub_stamp":"2021-10-08T19:39:13.572950+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0022297720000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.25","version":"328'2","reported_seq":416,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.936667+0000","last_change":"2021-10-08T19:40:07.331172+0000","last_active":"2021-10-08T19:41:04.936667+0000","last_peered":"2021-10-08T19:41:04.936667+0000","last_clean":"2021-10-08T19:41:04.936667+0000","last_became_active":"2021-10-08T19:37:00.344673+0000","last_became_peered":"2021-10-08T19:37:00.344673+0000","last_unstale":"2021-10-08T19:41:04.936667+0000","last_undegraded":"2021-10-08T19:41:04.936667+0000","last_fullsized":"2021-10-08T19:41:04.936667+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"328'2","last_scrub_stamp":"2021-10-08T19:40:07.331064+0000","last_deep_scrub":"328'2","last_deep_scrub_stamp":"2021-10-08T19:33:29.990395+0000","last_clean_scrub_stamp":"2021-10-08T19:40:07.331064+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010473448999999999,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.24","version":"0'0","reported_seq":105,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.943734+0000","last_change":"2021-10-08T19:40:36.960572+0000","last_active":"2021-10-08T19:41:04.943734+0000","last_peered":"2021-10-08T19:41:04.943734+0000","last_clean":"2021-10-08T19:41:04.943734+0000","last_became_active":"2021-10-08T19:37:00.336960+0000","last_became_peered":"2021-10-08T19:37:00.336960+0000","last_unstale":"2021-10-08T19:41:04.943734+0000","last_undegraded":"2021-10-08T19:41:04.943734+0000","last_fullsized":"2021-10-08T19:41:04.943734+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:36.960483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:36.960483+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0017323569999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.23","version":"0'0","reported_seq":99,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.950594+0000","last_change":"2021-10-08T19:39:26.231063+0000","last_active":"2021-10-08T19:41:04.950594+0000","last_peered":"2021-10-08T19:41:04.950594+0000","last_clean":"2021-10-08T19:41:04.950594+0000","last_became_active":"2021-10-08T19:37:00.347789+0000","last_became_peered":"2021-10-08T19:37:00.347789+0000","last_unstale":"2021-10-08T19:41:04.950594+0000","last_undegraded":"2021-10-08T19:41:04.950594+0000","last_fullsized":"2021-10-08T19:41:04.950594+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:26.230969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:26.230969+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.01135425,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.22","version":"0'0","reported_seq":501,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.943107+0000","last_change":"2021-10-08T19:39:11.208487+0000","last_active":"2021-10-08T19:41:04.943107+0000","last_peered":"2021-10-08T19:41:04.943107+0000","last_clean":"2021-10-08T19:41:04.943107+0000","last_became_active":"2021-10-08T19:37:00.343394+0000","last_became_peered":"2021-10-08T19:37:00.343394+0000","last_unstale":"2021-10-08T19:41:04.943107+0000","last_undegraded":"2021-10-08T19:41:04.943107+0000","last_fullsized":"2021-10-08T19:41:04.943107+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:11.208391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:11.208391+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003871958,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3],"acting":[6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.21","version":"0'0","reported_seq":510,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.940594+0000","last_change":"2021-10-08T19:40:46.823451+0000","last_active":"2021-10-08T19:41:04.940594+0000","last_peered":"2021-10-08T19:41:04.940594+0000","last_clean":"2021-10-08T19:41:04.940594+0000","last_became_active":"2021-10-08T19:37:00.335409+0000","last_became_peered":"2021-10-08T19:37:00.335409+0000","last_unstale":"2021-10-08T19:41:04.940594+0000","last_undegraded":"2021-10-08T19:41:04.940594+0000","last_fullsized":"2021-10-08T19:41:04.940594+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:46.823341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:40:46.823341+0000","last_clean_scrub_stamp":"2021-10-08T19:40:46.823341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0093941830000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7],"acting":[2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.20","version":"0'0","reported_seq":109,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.940006+0000","last_change":"2021-10-08T19:39:11.566964+0000","last_active":"2021-10-08T19:41:04.940006+0000","last_peered":"2021-10-08T19:41:04.940006+0000","last_clean":"2021-10-08T19:41:04.940006+0000","last_became_active":"2021-10-08T19:37:00.341831+0000","last_became_peered":"2021-10-08T19:37:00.341831+0000","last_unstale":"2021-10-08T19:41:04.940006+0000","last_undegraded":"2021-10-08T19:41:04.940006+0000","last_fullsized":"2021-10-08T19:41:04.940006+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:11.566891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:32.922694+0000","last_clean_scrub_stamp":"2021-10-08T19:39:11.566891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0018543839999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.7","version":"477'9219","reported_seq":9270,"reported_epoch":477,"state":"active+clean","last_fresh":"2021-10-08T19:41:14.597608+0000","last_change":"2021-10-08T19:39:04.771604+0000","last_active":"2021-10-08T19:41:14.597608+0000","last_peered":"2021-10-08T19:41:14.597608+0000","last_clean":"2021-10-08T19:41:14.597608+0000","last_became_active":"2021-10-08T19:39:04.771230+0000","last_became_peered":"2021-10-08T19:39:04.771230+0000","last_unstale":"2021-10-08T19:41:14.597608+0000","last_undegraded":"2021-10-08T19:41:14.597608+0000","last_fullsized":"2021-10-08T19:41:14.597608+0000","mapping_epoch":433,"log_start":"459'5000","ondisk_log_start":"459'5000","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:03.490762+0000","log_size":4219,"ondisk_log_size":4219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":308609024,"num_objects":4709,"num_object_clones":0,"num_object_copies":14127,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4709,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9219,"num_write_kb":445696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"114'10","reported_seq":734,"reported_epoch":477,"state":"active+clean","last_fresh":"2021-10-08T19:41:08.110928+0000","last_change":"2021-10-08T19:40:34.920105+0000","last_active":"2021-10-08T19:41:08.110928+0000","last_peered":"2021-10-08T19:41:08.110928+0000","last_clean":"2021-10-08T19:41:08.110928+0000","last_became_active":"2021-10-08T19:24:25.096162+0000","last_became_peered":"2021-10-08T19:24:25.096162+0000","last_unstale":"2021-10-08T19:41:08.110928+0000","last_undegraded":"2021-10-08T19:41:08.110928+0000","last_fullsized":"2021-10-08T19:41:08.110928+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'10","last_scrub_stamp":"2021-10-08T19:40:34.920011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:40:34.920011+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002553937,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"289'34","reported_seq":146,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.940332+0000","last_change":"2021-10-08T19:40:31.983322+0000","last_active":"2021-10-08T19:41:04.940332+0000","last_peered":"2021-10-08T19:41:04.940332+0000","last_clean":"2021-10-08T19:41:04.940332+0000","last_became_active":"2021-10-08T19:37:18.998305+0000","last_became_peered":"2021-10-08T19:37:18.998305+0000","last_unstale":"2021-10-08T19:41:04.940332+0000","last_undegraded":"2021-10-08T19:41:04.940332+0000","last_fullsized":"2021-10-08T19:41:04.940332+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'34","last_scrub_stamp":"2021-10-08T19:40:31.983216+0000","last_deep_scrub":"87'22","last_deep_scrub_stamp":"2021-10-08T19:22:58.705632+0000","last_clean_scrub_stamp":"2021-10-08T19:40:31.983216+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012884054000000001,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":495,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.942037+0000","last_change":"2021-10-08T19:39:55.054394+0000","last_active":"2021-10-08T19:41:04.942037+0000","last_peered":"2021-10-08T19:41:04.942037+0000","last_clean":"2021-10-08T19:41:04.942037+0000","last_became_active":"2021-10-08T19:29:40.632678+0000","last_became_peered":"2021-10-08T19:29:40.632678+0000","last_unstale":"2021-10-08T19:41:04.942037+0000","last_undegraded":"2021-10-08T19:41:04.942037+0000","last_fullsized":"2021-10-08T19:41:04.942037+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:55.054274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:55.054274+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.009012684,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":168,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.943803+0000","last_change":"2021-10-08T19:40:33.919489+0000","last_active":"2021-10-08T19:41:04.943803+0000","last_peered":"2021-10-08T19:41:04.943803+0000","last_clean":"2021-10-08T19:41:04.943803+0000","last_became_active":"2021-10-08T19:37:19.000347+0000","last_became_peered":"2021-10-08T19:37:19.000347+0000","last_unstale":"2021-10-08T19:41:04.943803+0000","last_undegraded":"2021-10-08T19:41:04.943803+0000","last_fullsized":"2021-10-08T19:41:04.943803+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:45.366890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:08.936801+0000","last_clean_scrub_stamp":"2021-10-08T19:38:45.366890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.026317591000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":389,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.946303+0000","last_change":"2021-10-08T19:39:18.594197+0000","last_active":"2021-10-08T19:41:04.946303+0000","last_peered":"2021-10-08T19:41:04.946303+0000","last_clean":"2021-10-08T19:41:04.946303+0000","last_became_active":"2021-10-08T19:25:15.510457+0000","last_became_peered":"2021-10-08T19:25:15.510457+0000","last_unstale":"2021-10-08T19:41:04.946303+0000","last_undegraded":"2021-10-08T19:41:04.946303+0000","last_fullsized":"2021-10-08T19:41:04.946303+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:18.594126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:33:28.036266+0000","last_clean_scrub_stamp":"2021-10-08T19:39:18.594126+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0026381920000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.4","version":"477'9375","reported_seq":9427,"reported_epoch":477,"state":"active+clean","last_fresh":"2021-10-08T19:41:13.691669+0000","last_change":"2021-10-08T19:39:04.511208+0000","last_active":"2021-10-08T19:41:13.691669+0000","last_peered":"2021-10-08T19:41:13.691669+0000","last_clean":"2021-10-08T19:41:13.691669+0000","last_became_active":"2021-10-08T19:39:04.510913+0000","last_became_peered":"2021-10-08T19:39:04.510913+0000","last_unstale":"2021-10-08T19:41:13.691669+0000","last_undegraded":"2021-10-08T19:41:13.691669+0000","last_fullsized":"2021-10-08T19:41:13.691669+0000","mapping_epoch":433,"log_start":"460'5600","ondisk_log_start":"460'5600","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:03.490762+0000","log_size":3775,"ondisk_log_size":3775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":322240512,"num_objects":4917,"num_object_clones":0,"num_object_copies":14751,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4917,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9375,"num_write_kb":457344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"337'19","reported_seq":526,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.943381+0000","last_change":"2021-10-08T19:39:15.098421+0000","last_active":"2021-10-08T19:41:04.943381+0000","last_peered":"2021-10-08T19:41:04.943381+0000","last_clean":"2021-10-08T19:41:04.943381+0000","last_became_active":"2021-10-08T19:28:40.159729+0000","last_became_peered":"2021-10-08T19:28:40.159729+0000","last_unstale":"2021-10-08T19:41:04.943381+0000","last_undegraded":"2021-10-08T19:41:04.943381+0000","last_fullsized":"2021-10-08T19:41:04.943381+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"337'19","last_scrub_stamp":"2021-10-08T19:39:15.098300+0000","last_deep_scrub":"337'19","last_deep_scrub_stamp":"2021-10-08T19:34:14.040249+0000","last_clean_scrub_stamp":"2021-10-08T19:39:15.098300+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010352118,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":331,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.952745+0000","last_change":"2021-10-08T19:39:33.632923+0000","last_active":"2021-10-08T19:41:04.952745+0000","last_peered":"2021-10-08T19:41:04.952745+0000","last_clean":"2021-10-08T19:41:04.952745+0000","last_became_active":"2021-10-08T19:29:40.624977+0000","last_became_peered":"2021-10-08T19:29:40.624977+0000","last_unstale":"2021-10-08T19:41:04.952745+0000","last_undegraded":"2021-10-08T19:41:04.952745+0000","last_fullsized":"2021-10-08T19:41:04.952745+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:33.632818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:33.632818+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014140598000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":489,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.941359+0000","last_change":"2021-10-08T19:40:48.882826+0000","last_active":"2021-10-08T19:41:04.941359+0000","last_peered":"2021-10-08T19:41:04.941359+0000","last_clean":"2021-10-08T19:41:04.941359+0000","last_became_active":"2021-10-08T19:29:40.629422+0000","last_became_peered":"2021-10-08T19:29:40.629422+0000","last_unstale":"2021-10-08T19:41:04.941359+0000","last_undegraded":"2021-10-08T19:41:04.941359+0000","last_fullsized":"2021-10-08T19:41:04.941359+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:48.882724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:40:48.882724+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0032251089999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":459,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.944828+0000","last_change":"2021-10-08T19:39:26.158512+0000","last_active":"2021-10-08T19:41:04.944828+0000","last_peered":"2021-10-08T19:41:04.944828+0000","last_clean":"2021-10-08T19:41:04.944828+0000","last_became_active":"2021-10-08T19:21:29.643022+0000","last_became_peered":"2021-10-08T19:21:29.643022+0000","last_unstale":"2021-10-08T19:41:04.944828+0000","last_undegraded":"2021-10-08T19:41:04.944828+0000","last_fullsized":"2021-10-08T19:41:04.944828+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:26.158421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:26.158421+0000","last_clean_scrub_stamp":"2021-10-08T19:39:26.158421+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.11492822900000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"70'5","reported_seq":835,"reported_epoch":477,"state":"active+clean","last_fresh":"2021-10-08T19:41:12.637899+0000","last_change":"2021-10-08T19:38:02.331641+0000","last_active":"2021-10-08T19:41:12.637899+0000","last_peered":"2021-10-08T19:41:12.637899+0000","last_clean":"2021-10-08T19:41:12.637899+0000","last_became_active":"2021-10-08T19:37:19.006464+0000","last_became_peered":"2021-10-08T19:37:19.006464+0000","last_unstale":"2021-10-08T19:41:12.637899+0000","last_undegraded":"2021-10-08T19:41:12.637899+0000","last_fullsized":"2021-10-08T19:41:12.637899+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:38:02.331532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:38:02.331532+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0043661940000000003,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":553,"num_read_kb":553,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":778,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.5","version":"477'9258","reported_seq":9310,"reported_epoch":477,"state":"active+clean","last_fresh":"2021-10-08T19:41:13.754666+0000","last_change":"2021-10-08T19:39:04.771577+0000","last_active":"2021-10-08T19:41:13.754666+0000","last_peered":"2021-10-08T19:41:13.754666+0000","last_clean":"2021-10-08T19:41:13.754666+0000","last_became_active":"2021-10-08T19:39:04.771214+0000","last_became_peered":"2021-10-08T19:39:04.771214+0000","last_unstale":"2021-10-08T19:41:13.754666+0000","last_undegraded":"2021-10-08T19:41:13.754666+0000","last_fullsized":"2021-10-08T19:41:13.754666+0000","mapping_epoch":433,"log_start":"460'5500","ondisk_log_start":"460'5500","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:03.490762+0000","log_size":3758,"ondisk_log_size":3758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":310902784,"num_objects":4744,"num_object_clones":0,"num_object_copies":14232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4744,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9258,"num_write_kb":448064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"428'44","reported_seq":529,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.944101+0000","last_change":"2021-10-08T19:40:49.868198+0000","last_active":"2021-10-08T19:41:04.944101+0000","last_peered":"2021-10-08T19:41:04.944101+0000","last_clean":"2021-10-08T19:41:04.944101+0000","last_became_active":"2021-10-08T19:28:40.101648+0000","last_became_peered":"2021-10-08T19:28:40.101648+0000","last_unstale":"2021-10-08T19:41:04.944101+0000","last_undegraded":"2021-10-08T19:41:04.944101+0000","last_fullsized":"2021-10-08T19:41:04.944101+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"428'44","last_scrub_stamp":"2021-10-08T19:40:49.868088+0000","last_deep_scrub":"428'44","last_deep_scrub_stamp":"2021-10-08T19:38:47.335892+0000","last_clean_scrub_stamp":"2021-10-08T19:40:49.868088+0000","log_size":44,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0038363440000000002,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":55,"num_read_kb":44,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":475,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.940965+0000","last_change":"2021-10-08T19:40:11.180747+0000","last_active":"2021-10-08T19:41:04.940965+0000","last_peered":"2021-10-08T19:41:04.940965+0000","last_clean":"2021-10-08T19:41:04.940965+0000","last_became_active":"2021-10-08T19:21:23.595919+0000","last_became_peered":"2021-10-08T19:21:23.595919+0000","last_unstale":"2021-10-08T19:41:04.940965+0000","last_undegraded":"2021-10-08T19:41:04.940965+0000","last_fullsized":"2021-10-08T19:41:04.940965+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:11.180640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:40:11.180640+0000","last_clean_scrub_stamp":"2021-10-08T19:40:11.180640+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0088737490000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":481,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.943252+0000","last_change":"2021-10-08T19:39:31.136396+0000","last_active":"2021-10-08T19:41:04.943252+0000","last_peered":"2021-10-08T19:41:04.943252+0000","last_clean":"2021-10-08T19:41:04.943252+0000","last_became_active":"2021-10-08T19:31:22.783725+0000","last_became_peered":"2021-10-08T19:31:22.783725+0000","last_unstale":"2021-10-08T19:41:04.943252+0000","last_undegraded":"2021-10-08T19:41:04.943252+0000","last_fullsized":"2021-10-08T19:41:04.943252+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:31.136290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:39:31.136290+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0053463770000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":473,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.940163+0000","last_change":"2021-10-08T19:39:55.885308+0000","last_active":"2021-10-08T19:41:04.940163+0000","last_peered":"2021-10-08T19:41:04.940163+0000","last_clean":"2021-10-08T19:41:04.940163+0000","last_became_active":"2021-10-08T19:29:40.638354+0000","last_became_peered":"2021-10-08T19:29:40.638354+0000","last_unstale":"2021-10-08T19:41:04.940163+0000","last_undegraded":"2021-10-08T19:41:04.940163+0000","last_fullsized":"2021-10-08T19:41:04.940163+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:55.885197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:39.528699+0000","last_clean_scrub_stamp":"2021-10-08T19:39:55.885197+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011288616,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":400,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.944535+0000","last_change":"2021-10-08T19:39:17.629247+0000","last_active":"2021-10-08T19:41:04.944535+0000","last_peered":"2021-10-08T19:41:04.944535+0000","last_clean":"2021-10-08T19:41:04.944535+0000","last_became_active":"2021-10-08T19:31:22.785590+0000","last_became_peered":"2021-10-08T19:31:22.785590+0000","last_unstale":"2021-10-08T19:41:04.944535+0000","last_undegraded":"2021-10-08T19:41:04.944535+0000","last_fullsized":"2021-10-08T19:41:04.944535+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:17.629178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:17.629178+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001878256,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2","version":"477'9270","reported_seq":9328,"reported_epoch":477,"state":"active+clean","last_fresh":"2021-10-08T19:41:14.011983+0000","last_change":"2021-10-08T19:40:36.563540+0000","last_active":"2021-10-08T19:41:14.011983+0000","last_peered":"2021-10-08T19:41:14.011983+0000","last_clean":"2021-10-08T19:41:14.011983+0000","last_became_active":"2021-10-08T19:39:04.513549+0000","last_became_peered":"2021-10-08T19:39:04.513549+0000","last_unstale":"2021-10-08T19:41:14.011983+0000","last_undegraded":"2021-10-08T19:41:14.011983+0000","last_fullsized":"2021-10-08T19:41:14.011983+0000","mapping_epoch":433,"log_start":"454'4100","ondisk_log_start":"454'4100","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"467'6896","last_scrub_stamp":"2021-10-08T19:40:36.563423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:40:36.563423+0000","log_size":5170,"ondisk_log_size":5170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":3.479033571,"stat_sum":{"num_bytes":319553536,"num_objects":4876,"num_object_clones":0,"num_object_copies":14628,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4876,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9270,"num_write_kb":452672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.8","version":"90'130","reported_seq":461,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.943581+0000","last_change":"2021-10-08T19:39:30.172051+0000","last_active":"2021-10-08T19:41:04.943581+0000","last_peered":"2021-10-08T19:41:04.943581+0000","last_clean":"2021-10-08T19:41:04.943581+0000","last_became_active":"2021-10-08T19:37:19.009239+0000","last_became_peered":"2021-10-08T19:37:19.009239+0000","last_unstale":"2021-10-08T19:41:04.943581+0000","last_undegraded":"2021-10-08T19:41:04.943581+0000","last_fullsized":"2021-10-08T19:41:04.943581+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:39:30.171944+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:39:30.171944+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0069086290000000003,"stat_sum":{"num_bytes":262688,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"459'39","reported_seq":569,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.937096+0000","last_change":"2021-10-08T19:40:10.405161+0000","last_active":"2021-10-08T19:41:04.937096+0000","last_peered":"2021-10-08T19:41:04.937096+0000","last_clean":"2021-10-08T19:41:04.937096+0000","last_became_active":"2021-10-08T19:28:40.099618+0000","last_became_peered":"2021-10-08T19:28:40.099618+0000","last_unstale":"2021-10-08T19:41:04.937096+0000","last_undegraded":"2021-10-08T19:41:04.937096+0000","last_fullsized":"2021-10-08T19:41:04.937096+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"459'39","last_scrub_stamp":"2021-10-08T19:40:10.405068+0000","last_deep_scrub":"459'39","last_deep_scrub_stamp":"2021-10-08T19:40:10.405068+0000","last_clean_scrub_stamp":"2021-10-08T19:40:10.405068+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.024252185999999998,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":50,"num_read_kb":40,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"61'1","reported_seq":469,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.940842+0000","last_change":"2021-10-08T19:40:36.925924+0000","last_active":"2021-10-08T19:41:04.940842+0000","last_peered":"2021-10-08T19:41:04.940842+0000","last_clean":"2021-10-08T19:41:04.940842+0000","last_became_active":"2021-10-08T19:21:23.607064+0000","last_became_peered":"2021-10-08T19:21:23.607064+0000","last_unstale":"2021-10-08T19:41:04.940842+0000","last_undegraded":"2021-10-08T19:41:04.940842+0000","last_fullsized":"2021-10-08T19:41:04.940842+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'1","last_scrub_stamp":"2021-10-08T19:40:36.925849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:36.925849+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0081260700000000009,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":313,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.953841+0000","last_change":"2021-10-08T19:40:49.345813+0000","last_active":"2021-10-08T19:41:04.953841+0000","last_peered":"2021-10-08T19:41:04.953841+0000","last_clean":"2021-10-08T19:41:04.953841+0000","last_became_active":"2021-10-08T19:28:40.152478+0000","last_became_peered":"2021-10-08T19:28:40.152478+0000","last_unstale":"2021-10-08T19:41:04.953841+0000","last_undegraded":"2021-10-08T19:41:04.953841+0000","last_fullsized":"2021-10-08T19:41:04.953841+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:49.345703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:30:09.081635+0000","last_clean_scrub_stamp":"2021-10-08T19:40:49.345703+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0058856459999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":487,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.941760+0000","last_change":"2021-10-08T19:40:40.184580+0000","last_active":"2021-10-08T19:41:04.941760+0000","last_peered":"2021-10-08T19:41:04.941760+0000","last_clean":"2021-10-08T19:41:04.941760+0000","last_became_active":"2021-10-08T19:29:40.629424+0000","last_became_peered":"2021-10-08T19:29:40.629424+0000","last_unstale":"2021-10-08T19:41:04.941760+0000","last_undegraded":"2021-10-08T19:41:04.941760+0000","last_fullsized":"2021-10-08T19:41:04.941760+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:40.184460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:40:40.184460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.189286643,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":445,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.944345+0000","last_change":"2021-10-08T19:40:00.916866+0000","last_active":"2021-10-08T19:41:04.944345+0000","last_peered":"2021-10-08T19:41:04.944345+0000","last_clean":"2021-10-08T19:41:04.944345+0000","last_became_active":"2021-10-08T19:31:51.676829+0000","last_became_peered":"2021-10-08T19:31:51.676829+0000","last_unstale":"2021-10-08T19:41:04.944345+0000","last_undegraded":"2021-10-08T19:41:04.944345+0000","last_fullsized":"2021-10-08T19:41:04.944345+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:00.916780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:00.916780+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0077587489999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"477'9572","reported_seq":9623,"reported_epoch":477,"state":"active+clean","last_fresh":"2021-10-08T19:41:13.780061+0000","last_change":"2021-10-08T19:39:04.509158+0000","last_active":"2021-10-08T19:41:13.780061+0000","last_peered":"2021-10-08T19:41:13.780061+0000","last_clean":"2021-10-08T19:41:13.780061+0000","last_became_active":"2021-10-08T19:39:04.508797+0000","last_became_peered":"2021-10-08T19:39:04.508797+0000","last_unstale":"2021-10-08T19:41:13.780061+0000","last_undegraded":"2021-10-08T19:41:13.780061+0000","last_fullsized":"2021-10-08T19:41:13.780061+0000","mapping_epoch":433,"log_start":"459'5300","ondisk_log_start":"459'5300","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:03.490762+0000","log_size":4272,"ondisk_log_size":4272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":332922880,"num_objects":5080,"num_object_clones":0,"num_object_copies":15240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5080,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9572,"num_write_kb":468864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1],"acting":[6,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.9","version":"90'130","reported_seq":803,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.940086+0000","last_change":"2021-10-08T19:38:43.587701+0000","last_active":"2021-10-08T19:41:04.940086+0000","last_peered":"2021-10-08T19:41:04.940086+0000","last_clean":"2021-10-08T19:41:04.940086+0000","last_became_active":"2021-10-08T19:29:43.634789+0000","last_became_peered":"2021-10-08T19:29:43.634789+0000","last_unstale":"2021-10-08T19:41:04.940086+0000","last_undegraded":"2021-10-08T19:41:04.940086+0000","last_fullsized":"2021-10-08T19:41:04.940086+0000","mapping_epoch":239,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:38:43.587557+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:38:43.587557+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010306226999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"289'20","reported_seq":572,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.936496+0000","last_change":"2021-10-08T19:40:00.425294+0000","last_active":"2021-10-08T19:41:04.936496+0000","last_peered":"2021-10-08T19:41:04.936496+0000","last_clean":"2021-10-08T19:41:04.936496+0000","last_became_active":"2021-10-08T19:29:40.631807+0000","last_became_peered":"2021-10-08T19:29:40.631807+0000","last_unstale":"2021-10-08T19:41:04.936496+0000","last_undegraded":"2021-10-08T19:41:04.936496+0000","last_fullsized":"2021-10-08T19:41:04.936496+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'20","last_scrub_stamp":"2021-10-08T19:40:00.425194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:40:00.425194+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0087912159999999993,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":333,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.952335+0000","last_change":"2021-10-08T19:40:02.914149+0000","last_active":"2021-10-08T19:41:04.952335+0000","last_peered":"2021-10-08T19:41:04.952335+0000","last_clean":"2021-10-08T19:41:04.952335+0000","last_became_active":"2021-10-08T19:29:40.638988+0000","last_became_peered":"2021-10-08T19:29:40.638988+0000","last_unstale":"2021-10-08T19:41:04.952335+0000","last_undegraded":"2021-10-08T19:41:04.952335+0000","last_fullsized":"2021-10-08T19:41:04.952335+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:02.914080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:02.914080+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.022904704000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"250'9","reported_seq":720,"reported_epoch":477,"state":"active+clean","last_fresh":"2021-10-08T19:41:08.068288+0000","last_change":"2021-10-08T19:40:04.082786+0000","last_active":"2021-10-08T19:41:08.068288+0000","last_peered":"2021-10-08T19:41:08.068288+0000","last_clean":"2021-10-08T19:41:08.068288+0000","last_became_active":"2021-10-08T19:21:27.637930+0000","last_became_peered":"2021-10-08T19:21:27.637930+0000","last_unstale":"2021-10-08T19:41:08.068288+0000","last_undegraded":"2021-10-08T19:41:08.068288+0000","last_fullsized":"2021-10-08T19:41:08.068288+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'9","last_scrub_stamp":"2021-10-08T19:40:04.082682+0000","last_deep_scrub":"250'9","last_deep_scrub_stamp":"2021-10-08T19:30:04.239189+0000","last_clean_scrub_stamp":"2021-10-08T19:40:04.082682+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0097725820000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":472,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.936996+0000","last_change":"2021-10-08T19:39:20.149864+0000","last_active":"2021-10-08T19:41:04.936996+0000","last_peered":"2021-10-08T19:41:04.936996+0000","last_clean":"2021-10-08T19:41:04.936996+0000","last_became_active":"2021-10-08T19:28:40.100213+0000","last_became_peered":"2021-10-08T19:28:40.100213+0000","last_unstale":"2021-10-08T19:41:04.936996+0000","last_undegraded":"2021-10-08T19:41:04.936996+0000","last_fullsized":"2021-10-08T19:41:04.936996+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:20.149744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:20.149744+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.034036438000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":267,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.951146+0000","last_change":"2021-10-08T19:40:06.317558+0000","last_active":"2021-10-08T19:41:04.951146+0000","last_peered":"2021-10-08T19:41:04.951146+0000","last_clean":"2021-10-08T19:41:04.951146+0000","last_became_active":"2021-10-08T19:29:44.443507+0000","last_became_peered":"2021-10-08T19:29:44.443507+0000","last_unstale":"2021-10-08T19:41:04.951146+0000","last_undegraded":"2021-10-08T19:41:04.951146+0000","last_fullsized":"2021-10-08T19:41:04.951146+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:06.317461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:06.317461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0054001470000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.0","version":"477'9297","reported_seq":9349,"reported_epoch":477,"state":"active+clean","last_fresh":"2021-10-08T19:41:14.473390+0000","last_change":"2021-10-08T19:39:04.508881+0000","last_active":"2021-10-08T19:41:14.473390+0000","last_peered":"2021-10-08T19:41:14.473390+0000","last_clean":"2021-10-08T19:41:14.473390+0000","last_became_active":"2021-10-08T19:39:04.508607+0000","last_became_peered":"2021-10-08T19:39:04.508607+0000","last_unstale":"2021-10-08T19:41:14.473390+0000","last_undegraded":"2021-10-08T19:41:14.473390+0000","last_fullsized":"2021-10-08T19:41:14.473390+0000","mapping_epoch":433,"log_start":"459'5100","ondisk_log_start":"459'5100","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:03.490762+0000","log_size":4197,"ondisk_log_size":4197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":313458688,"num_objects":4783,"num_object_clones":0,"num_object_copies":14349,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4783,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9297,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.a","version":"90'130","reported_seq":401,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.941282+0000","last_change":"2021-10-08T19:40:01.053717+0000","last_active":"2021-10-08T19:41:04.941282+0000","last_peered":"2021-10-08T19:41:04.941282+0000","last_clean":"2021-10-08T19:41:04.941282+0000","last_became_active":"2021-10-08T19:37:19.000525+0000","last_became_peered":"2021-10-08T19:37:19.000525+0000","last_unstale":"2021-10-08T19:41:04.941282+0000","last_undegraded":"2021-10-08T19:41:04.941282+0000","last_fullsized":"2021-10-08T19:41:04.941282+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:40:01.053607+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:40:01.053607+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034190679999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"289'27","reported_seq":215,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.941502+0000","last_change":"2021-10-08T19:40:03.107059+0000","last_active":"2021-10-08T19:41:04.941502+0000","last_peered":"2021-10-08T19:41:04.941502+0000","last_clean":"2021-10-08T19:41:04.941502+0000","last_became_active":"2021-10-08T19:32:45.162914+0000","last_became_peered":"2021-10-08T19:32:45.162914+0000","last_unstale":"2021-10-08T19:41:04.941502+0000","last_undegraded":"2021-10-08T19:41:04.941502+0000","last_fullsized":"2021-10-08T19:41:04.941502+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'27","last_scrub_stamp":"2021-10-08T19:40:03.106967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:40:03.106967+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0080879679999999992,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":550,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":334,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.953467+0000","last_change":"2021-10-08T19:38:47.613118+0000","last_active":"2021-10-08T19:41:04.953467+0000","last_peered":"2021-10-08T19:41:04.953467+0000","last_clean":"2021-10-08T19:41:04.953467+0000","last_became_active":"2021-10-08T19:36:58.004540+0000","last_became_peered":"2021-10-08T19:36:58.004540+0000","last_unstale":"2021-10-08T19:41:04.953467+0000","last_undegraded":"2021-10-08T19:41:04.953467+0000","last_fullsized":"2021-10-08T19:41:04.953467+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:47.613029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:47.613029+0000","last_clean_scrub_stamp":"2021-10-08T19:38:47.613029+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001875493,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"88'9","reported_seq":708,"reported_epoch":477,"state":"active+clean","last_fresh":"2021-10-08T19:41:08.068395+0000","last_change":"2021-10-08T19:40:01.462959+0000","last_active":"2021-10-08T19:41:08.068395+0000","last_peered":"2021-10-08T19:41:08.068395+0000","last_clean":"2021-10-08T19:41:08.068395+0000","last_became_active":"2021-10-08T19:21:27.636432+0000","last_became_peered":"2021-10-08T19:21:27.636432+0000","last_unstale":"2021-10-08T19:41:08.068395+0000","last_undegraded":"2021-10-08T19:41:08.068395+0000","last_fullsized":"2021-10-08T19:41:08.068395+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'9","last_scrub_stamp":"2021-10-08T19:40:01.462851+0000","last_deep_scrub":"88'9","last_deep_scrub_stamp":"2021-10-08T19:23:00.048245+0000","last_clean_scrub_stamp":"2021-10-08T19:40:01.462851+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.020776886000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":264,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.952535+0000","last_change":"2021-10-08T19:40:35.098503+0000","last_active":"2021-10-08T19:41:04.952535+0000","last_peered":"2021-10-08T19:41:04.952535+0000","last_clean":"2021-10-08T19:41:04.952535+0000","last_became_active":"2021-10-08T19:37:19.016085+0000","last_became_peered":"2021-10-08T19:37:19.016085+0000","last_unstale":"2021-10-08T19:41:04.952535+0000","last_undegraded":"2021-10-08T19:41:04.952535+0000","last_fullsized":"2021-10-08T19:41:04.952535+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:54.590301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:37:54.590301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.095282983000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"70'5","reported_seq":267,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.948720+0000","last_change":"2021-10-08T19:40:32.248981+0000","last_active":"2021-10-08T19:41:04.948720+0000","last_peered":"2021-10-08T19:41:04.948720+0000","last_clean":"2021-10-08T19:41:04.948720+0000","last_became_active":"2021-10-08T19:29:40.639786+0000","last_became_peered":"2021-10-08T19:29:40.639786+0000","last_unstale":"2021-10-08T19:41:04.948720+0000","last_undegraded":"2021-10-08T19:41:04.948720+0000","last_fullsized":"2021-10-08T19:41:04.948720+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:40:32.248867+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2021-10-08T19:36:08.760670+0000","last_clean_scrub_stamp":"2021-10-08T19:40:32.248867+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.015954836,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1","version":"477'9470","reported_seq":9522,"reported_epoch":477,"state":"active+clean","last_fresh":"2021-10-08T19:41:13.737804+0000","last_change":"2021-10-08T19:39:04.511987+0000","last_active":"2021-10-08T19:41:13.737804+0000","last_peered":"2021-10-08T19:41:13.737804+0000","last_clean":"2021-10-08T19:41:13.737804+0000","last_became_active":"2021-10-08T19:39:04.511690+0000","last_became_peered":"2021-10-08T19:39:04.511690+0000","last_unstale":"2021-10-08T19:41:13.737804+0000","last_undegraded":"2021-10-08T19:41:13.737804+0000","last_fullsized":"2021-10-08T19:41:13.737804+0000","mapping_epoch":433,"log_start":"459'5200","ondisk_log_start":"459'5200","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:03.490762+0000","log_size":4270,"ondisk_log_size":4270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":328728576,"num_objects":5016,"num_object_clones":0,"num_object_copies":15048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5016,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9470,"num_write_kb":463552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"289'19","reported_seq":638,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.936891+0000","last_change":"2021-10-08T19:40:33.616897+0000","last_active":"2021-10-08T19:41:04.936891+0000","last_peered":"2021-10-08T19:41:04.936891+0000","last_clean":"2021-10-08T19:41:04.936891+0000","last_became_active":"2021-10-08T19:31:51.677509+0000","last_became_peered":"2021-10-08T19:31:51.677509+0000","last_unstale":"2021-10-08T19:41:04.936891+0000","last_undegraded":"2021-10-08T19:41:04.936891+0000","last_fullsized":"2021-10-08T19:41:04.936891+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:40:33.616776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:40:33.616776+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0050522830000000003,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":770,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":490,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.940251+0000","last_change":"2021-10-08T19:39:09.585407+0000","last_active":"2021-10-08T19:41:04.940251+0000","last_peered":"2021-10-08T19:41:04.940251+0000","last_clean":"2021-10-08T19:41:04.940251+0000","last_became_active":"2021-10-08T19:36:58.001610+0000","last_became_peered":"2021-10-08T19:36:58.001610+0000","last_unstale":"2021-10-08T19:41:04.940251+0000","last_undegraded":"2021-10-08T19:41:04.940251+0000","last_fullsized":"2021-10-08T19:41:04.940251+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:09.585318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:09.585318+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002054714,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":168,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.937202+0000","last_change":"2021-10-08T19:39:21.090794+0000","last_active":"2021-10-08T19:41:04.937202+0000","last_peered":"2021-10-08T19:41:04.937202+0000","last_clean":"2021-10-08T19:41:04.937202+0000","last_became_active":"2021-10-08T19:37:18.997446+0000","last_became_peered":"2021-10-08T19:37:18.997446+0000","last_unstale":"2021-10-08T19:41:04.937202+0000","last_undegraded":"2021-10-08T19:41:04.937202+0000","last_fullsized":"2021-10-08T19:41:04.937202+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:21.090701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:39:21.090701+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001395486,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":273,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.950172+0000","last_change":"2021-10-08T19:40:53.173789+0000","last_active":"2021-10-08T19:41:04.950172+0000","last_peered":"2021-10-08T19:41:04.950172+0000","last_clean":"2021-10-08T19:41:04.950172+0000","last_became_active":"2021-10-08T19:29:40.638099+0000","last_became_peered":"2021-10-08T19:29:40.638099+0000","last_unstale":"2021-10-08T19:41:04.950172+0000","last_undegraded":"2021-10-08T19:41:04.950172+0000","last_fullsized":"2021-10-08T19:41:04.950172+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:53.173689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:17.422176+0000","last_clean_scrub_stamp":"2021-10-08T19:40:53.173689+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0081726460000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":411,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.936069+0000","last_change":"2021-10-08T19:40:08.369310+0000","last_active":"2021-10-08T19:41:04.936069+0000","last_peered":"2021-10-08T19:41:04.936069+0000","last_clean":"2021-10-08T19:41:04.936069+0000","last_became_active":"2021-10-08T19:24:13.506602+0000","last_became_peered":"2021-10-08T19:24:13.506602+0000","last_unstale":"2021-10-08T19:41:04.936069+0000","last_undegraded":"2021-10-08T19:41:04.936069+0000","last_fullsized":"2021-10-08T19:41:04.936069+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:08.369244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:08.369244+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034824579999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"477'9124","reported_seq":9176,"reported_epoch":477,"state":"active+clean","last_fresh":"2021-10-08T19:41:13.486359+0000","last_change":"2021-10-08T19:39:04.506038+0000","last_active":"2021-10-08T19:41:13.486359+0000","last_peered":"2021-10-08T19:41:13.486359+0000","last_clean":"2021-10-08T19:41:13.486359+0000","last_became_active":"2021-10-08T19:39:04.505739+0000","last_became_peered":"2021-10-08T19:39:04.505739+0000","last_unstale":"2021-10-08T19:41:13.486359+0000","last_undegraded":"2021-10-08T19:41:13.486359+0000","last_fullsized":"2021-10-08T19:41:13.486359+0000","mapping_epoch":433,"log_start":"459'5100","ondisk_log_start":"459'5100","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:03.490762+0000","log_size":4024,"ondisk_log_size":4024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":309067776,"num_objects":4716,"num_object_clones":0,"num_object_copies":14148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4716,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9124,"num_write_kb":442880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7],"acting":[4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"90'130","reported_seq":597,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.950134+0000","last_change":"2021-10-08T19:39:30.252356+0000","last_active":"2021-10-08T19:41:04.950134+0000","last_peered":"2021-10-08T19:41:04.950134+0000","last_clean":"2021-10-08T19:41:04.950134+0000","last_became_active":"2021-10-08T19:29:43.636733+0000","last_became_peered":"2021-10-08T19:29:43.636733+0000","last_unstale":"2021-10-08T19:41:04.950134+0000","last_undegraded":"2021-10-08T19:41:04.950134+0000","last_fullsized":"2021-10-08T19:41:04.950134+0000","mapping_epoch":239,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:39:30.252247+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:39:30.252247+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012156159999999999,"stat_sum":{"num_bytes":327680,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"238'13","reported_seq":416,"reported_epoch":477,"state":"active+clean","last_fresh":"2021-10-08T19:41:08.070010+0000","last_change":"2021-10-08T19:38:32.165269+0000","last_active":"2021-10-08T19:41:08.070010+0000","last_peered":"2021-10-08T19:41:08.070010+0000","last_clean":"2021-10-08T19:41:08.070010+0000","last_became_active":"2021-10-08T19:29:40.640248+0000","last_became_peered":"2021-10-08T19:29:40.640248+0000","last_unstale":"2021-10-08T19:41:08.070010+0000","last_undegraded":"2021-10-08T19:41:08.070010+0000","last_fullsized":"2021-10-08T19:41:08.070010+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"238'13","last_scrub_stamp":"2021-10-08T19:38:32.165194+0000","last_deep_scrub":"91'9","last_deep_scrub_stamp":"2021-10-08T19:23:32.329475+0000","last_clean_scrub_stamp":"2021-10-08T19:38:32.165194+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0056171720000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"289'28","reported_seq":550,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.936195+0000","last_change":"2021-10-08T19:39:11.026869+0000","last_active":"2021-10-08T19:41:04.936195+0000","last_peered":"2021-10-08T19:41:04.936195+0000","last_clean":"2021-10-08T19:41:04.936195+0000","last_became_active":"2021-10-08T19:24:25.098743+0000","last_became_peered":"2021-10-08T19:24:25.098743+0000","last_unstale":"2021-10-08T19:41:04.936195+0000","last_undegraded":"2021-10-08T19:41:04.936195+0000","last_fullsized":"2021-10-08T19:41:04.936195+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'28","last_scrub_stamp":"2021-10-08T19:39:11.026789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:39:11.026789+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0043294240000000001,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":42,"num_read_kb":35,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":421,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.944305+0000","last_change":"2021-10-08T19:39:14.201859+0000","last_active":"2021-10-08T19:41:04.944305+0000","last_peered":"2021-10-08T19:41:04.944305+0000","last_clean":"2021-10-08T19:41:04.944305+0000","last_became_active":"2021-10-08T19:37:45.829953+0000","last_became_peered":"2021-10-08T19:37:45.829953+0000","last_unstale":"2021-10-08T19:41:04.944305+0000","last_undegraded":"2021-10-08T19:41:04.944305+0000","last_fullsized":"2021-10-08T19:41:04.944305+0000","mapping_epoch":407,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":408,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:14.201773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:14.201773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0032499429999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,2],"acting":[6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":479,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.941531+0000","last_change":"2021-10-08T19:40:10.935739+0000","last_active":"2021-10-08T19:41:04.941531+0000","last_peered":"2021-10-08T19:41:04.941531+0000","last_clean":"2021-10-08T19:41:04.941531+0000","last_became_active":"2021-10-08T19:24:25.094848+0000","last_became_peered":"2021-10-08T19:24:25.094848+0000","last_unstale":"2021-10-08T19:41:04.941531+0000","last_undegraded":"2021-10-08T19:41:04.941531+0000","last_fullsized":"2021-10-08T19:41:04.941531+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:10.935616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:40:10.935616+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.087461560999999993,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":434,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.944036+0000","last_change":"2021-10-08T19:39:29.921516+0000","last_active":"2021-10-08T19:41:04.944036+0000","last_peered":"2021-10-08T19:41:04.944036+0000","last_clean":"2021-10-08T19:41:04.944036+0000","last_became_active":"2021-10-08T19:28:40.132751+0000","last_became_peered":"2021-10-08T19:28:40.132751+0000","last_unstale":"2021-10-08T19:41:04.944036+0000","last_undegraded":"2021-10-08T19:41:04.944036+0000","last_fullsized":"2021-10-08T19:41:04.944036+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:29.921447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:29.921447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0045187020000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.f","version":"477'9237","reported_seq":9289,"reported_epoch":477,"state":"active+clean","last_fresh":"2021-10-08T19:41:13.727272+0000","last_change":"2021-10-08T19:39:04.510165+0000","last_active":"2021-10-08T19:41:13.727272+0000","last_peered":"2021-10-08T19:41:13.727272+0000","last_clean":"2021-10-08T19:41:13.727272+0000","last_became_active":"2021-10-08T19:39:04.509869+0000","last_became_peered":"2021-10-08T19:39:04.509869+0000","last_unstale":"2021-10-08T19:41:13.727272+0000","last_undegraded":"2021-10-08T19:41:13.727272+0000","last_fullsized":"2021-10-08T19:41:13.727272+0000","mapping_epoch":433,"log_start":"459'5400","ondisk_log_start":"459'5400","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:03.490762+0000","log_size":3837,"ondisk_log_size":3837,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":317915136,"num_objects":4851,"num_object_clones":0,"num_object_copies":14553,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4851,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9237,"num_write_kb":450816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.5","version":"90'130","reported_seq":637,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.936657+0000","last_change":"2021-10-08T19:39:26.207889+0000","last_active":"2021-10-08T19:41:04.936657+0000","last_peered":"2021-10-08T19:41:04.936657+0000","last_clean":"2021-10-08T19:41:04.936657+0000","last_became_active":"2021-10-08T19:27:26.590651+0000","last_became_peered":"2021-10-08T19:27:26.590651+0000","last_unstale":"2021-10-08T19:41:04.936657+0000","last_undegraded":"2021-10-08T19:41:04.936657+0000","last_fullsized":"2021-10-08T19:41:04.936657+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:39:26.207770+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:32:14.582883+0000","last_clean_scrub_stamp":"2021-10-08T19:39:26.207770+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011952313000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":474,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.936435+0000","last_change":"2021-10-08T19:39:25.156483+0000","last_active":"2021-10-08T19:41:04.936435+0000","last_peered":"2021-10-08T19:41:04.936435+0000","last_clean":"2021-10-08T19:41:04.936435+0000","last_became_active":"2021-10-08T19:29:40.639405+0000","last_became_peered":"2021-10-08T19:29:40.639405+0000","last_unstale":"2021-10-08T19:41:04.936435+0000","last_undegraded":"2021-10-08T19:41:04.936435+0000","last_fullsized":"2021-10-08T19:41:04.936435+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:25.156355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:39:25.156355+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0062655510000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"289'30","reported_seq":303,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.948625+0000","last_change":"2021-10-08T19:37:55.431244+0000","last_active":"2021-10-08T19:41:04.948625+0000","last_peered":"2021-10-08T19:41:04.948625+0000","last_clean":"2021-10-08T19:41:04.948625+0000","last_became_active":"2021-10-08T19:29:40.635007+0000","last_became_peered":"2021-10-08T19:29:40.635007+0000","last_unstale":"2021-10-08T19:41:04.948625+0000","last_undegraded":"2021-10-08T19:41:04.948625+0000","last_fullsized":"2021-10-08T19:41:04.948625+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'30","last_scrub_stamp":"2021-10-08T19:37:55.431161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:37:55.431161+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0042801929999999998,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":51,"num_read_kb":39,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":316,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.953777+0000","last_change":"2021-10-08T19:40:46.233555+0000","last_active":"2021-10-08T19:41:04.953777+0000","last_peered":"2021-10-08T19:41:04.953777+0000","last_clean":"2021-10-08T19:41:04.953777+0000","last_became_active":"2021-10-08T19:36:58.013501+0000","last_became_peered":"2021-10-08T19:36:58.013501+0000","last_unstale":"2021-10-08T19:41:04.953777+0000","last_undegraded":"2021-10-08T19:41:04.953777+0000","last_fullsized":"2021-10-08T19:41:04.953777+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:46.233456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:40:46.233456+0000","last_clean_scrub_stamp":"2021-10-08T19:40:46.233456+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.006516811,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":472,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.936688+0000","last_change":"2021-10-08T19:40:04.385494+0000","last_active":"2021-10-08T19:41:04.936688+0000","last_peered":"2021-10-08T19:41:04.936688+0000","last_clean":"2021-10-08T19:41:04.936688+0000","last_became_active":"2021-10-08T19:29:40.638253+0000","last_became_peered":"2021-10-08T19:29:40.638253+0000","last_unstale":"2021-10-08T19:41:04.936688+0000","last_undegraded":"2021-10-08T19:41:04.936688+0000","last_fullsized":"2021-10-08T19:41:04.936688+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:04.385386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:40:04.385386+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0092727669999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":267,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.949575+0000","last_change":"2021-10-08T19:40:44.228306+0000","last_active":"2021-10-08T19:41:04.949575+0000","last_peered":"2021-10-08T19:41:04.949575+0000","last_clean":"2021-10-08T19:41:04.949575+0000","last_became_active":"2021-10-08T19:29:40.634579+0000","last_became_peered":"2021-10-08T19:29:40.634579+0000","last_unstale":"2021-10-08T19:41:04.949575+0000","last_undegraded":"2021-10-08T19:41:04.949575+0000","last_fullsized":"2021-10-08T19:41:04.949575+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:44.228198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:44.228198+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013076706,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"477'9375","reported_seq":9427,"reported_epoch":477,"state":"active+clean","last_fresh":"2021-10-08T19:41:14.494271+0000","last_change":"2021-10-08T19:39:04.508265+0000","last_active":"2021-10-08T19:41:14.494271+0000","last_peered":"2021-10-08T19:41:14.494271+0000","last_clean":"2021-10-08T19:41:14.494271+0000","last_became_active":"2021-10-08T19:39:04.507950+0000","last_became_peered":"2021-10-08T19:39:04.507950+0000","last_unstale":"2021-10-08T19:41:14.494271+0000","last_undegraded":"2021-10-08T19:41:14.494271+0000","last_fullsized":"2021-10-08T19:41:14.494271+0000","mapping_epoch":433,"log_start":"459'5200","ondisk_log_start":"459'5200","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:03.490762+0000","log_size":4175,"ondisk_log_size":4175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":313720832,"num_objects":4787,"num_object_clones":0,"num_object_copies":14361,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4787,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9375,"num_write_kb":453184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,4],"acting":[1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"90'130","reported_seq":574,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.944014+0000","last_change":"2021-10-08T19:40:51.875213+0000","last_active":"2021-10-08T19:41:04.944014+0000","last_peered":"2021-10-08T19:41:04.944014+0000","last_clean":"2021-10-08T19:41:04.944014+0000","last_became_active":"2021-10-08T19:30:00.643797+0000","last_became_peered":"2021-10-08T19:30:00.643797+0000","last_unstale":"2021-10-08T19:41:04.944014+0000","last_undegraded":"2021-10-08T19:41:04.944014+0000","last_fullsized":"2021-10-08T19:41:04.944014+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:38:48.375537+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:38:48.375537+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001929933,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":411,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.944182+0000","last_change":"2021-10-08T19:40:35.936488+0000","last_active":"2021-10-08T19:41:04.944182+0000","last_peered":"2021-10-08T19:41:04.944182+0000","last_clean":"2021-10-08T19:41:04.944182+0000","last_became_active":"2021-10-08T19:24:25.095389+0000","last_became_peered":"2021-10-08T19:24:25.095389+0000","last_unstale":"2021-10-08T19:41:04.944182+0000","last_undegraded":"2021-10-08T19:41:04.944182+0000","last_fullsized":"2021-10-08T19:41:04.944182+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:39.326929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:38:39.326929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0043694370000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"289'29","reported_seq":516,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.943118+0000","last_change":"2021-10-08T19:40:39.869360+0000","last_active":"2021-10-08T19:41:04.943118+0000","last_peered":"2021-10-08T19:41:04.943118+0000","last_clean":"2021-10-08T19:41:04.943118+0000","last_became_active":"2021-10-08T19:21:25.741812+0000","last_became_peered":"2021-10-08T19:21:25.741812+0000","last_unstale":"2021-10-08T19:41:04.943118+0000","last_undegraded":"2021-10-08T19:41:04.943118+0000","last_fullsized":"2021-10-08T19:41:04.943118+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'29","last_scrub_stamp":"2021-10-08T19:40:39.869249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:40:39.869249+0000","log_size":29,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0043767700000000003,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":54,"num_read_kb":40,"num_write":32,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"328'2","reported_seq":480,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.944860+0000","last_change":"2021-10-08T19:39:10.604166+0000","last_active":"2021-10-08T19:41:04.944860+0000","last_peered":"2021-10-08T19:41:04.944860+0000","last_clean":"2021-10-08T19:41:04.944860+0000","last_became_active":"2021-10-08T19:36:58.000171+0000","last_became_peered":"2021-10-08T19:36:58.000171+0000","last_unstale":"2021-10-08T19:41:04.944860+0000","last_undegraded":"2021-10-08T19:41:04.944860+0000","last_fullsized":"2021-10-08T19:41:04.944860+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"328'2","last_scrub_stamp":"2021-10-08T19:39:10.604077+0000","last_deep_scrub":"328'2","last_deep_scrub_stamp":"2021-10-08T19:33:29.990395+0000","last_clean_scrub_stamp":"2021-10-08T19:39:10.604077+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0017862959999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":307,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.953057+0000","last_change":"2021-10-08T19:40:09.995072+0000","last_active":"2021-10-08T19:41:04.953057+0000","last_peered":"2021-10-08T19:41:04.953057+0000","last_clean":"2021-10-08T19:41:04.953057+0000","last_became_active":"2021-10-08T19:28:40.140876+0000","last_became_peered":"2021-10-08T19:28:40.140876+0000","last_unstale":"2021-10-08T19:41:04.953057+0000","last_undegraded":"2021-10-08T19:41:04.953057+0000","last_fullsized":"2021-10-08T19:41:04.953057+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:09.994958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:40:09.994958+0000","last_clean_scrub_stamp":"2021-10-08T19:40:09.994958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.065315867,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"70'5","reported_seq":313,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.954001+0000","last_change":"2021-10-08T19:40:44.202234+0000","last_active":"2021-10-08T19:41:04.954001+0000","last_peered":"2021-10-08T19:41:04.954001+0000","last_clean":"2021-10-08T19:41:04.954001+0000","last_became_active":"2021-10-08T19:28:40.150503+0000","last_became_peered":"2021-10-08T19:28:40.150503+0000","last_unstale":"2021-10-08T19:41:04.954001+0000","last_undegraded":"2021-10-08T19:41:04.954001+0000","last_fullsized":"2021-10-08T19:41:04.954001+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:40:44.202122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:44.202122+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.004019262,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.9","version":"477'9428","reported_seq":9480,"reported_epoch":477,"state":"active+clean","last_fresh":"2021-10-08T19:41:14.308669+0000","last_change":"2021-10-08T19:39:04.512253+0000","last_active":"2021-10-08T19:41:14.308669+0000","last_peered":"2021-10-08T19:41:14.308669+0000","last_clean":"2021-10-08T19:41:14.308669+0000","last_became_active":"2021-10-08T19:39:04.511738+0000","last_became_peered":"2021-10-08T19:39:04.511738+0000","last_unstale":"2021-10-08T19:41:14.308669+0000","last_undegraded":"2021-10-08T19:41:14.308669+0000","last_fullsized":"2021-10-08T19:41:14.308669+0000","mapping_epoch":433,"log_start":"460'5500","ondisk_log_start":"460'5500","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:03.490762+0000","log_size":3928,"ondisk_log_size":3928,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":310247424,"num_objects":4734,"num_object_clones":0,"num_object_copies":14202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4734,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9428,"num_write_kb":453184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"90'130","reported_seq":608,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.956927+0000","last_change":"2021-10-08T19:39:12.712490+0000","last_active":"2021-10-08T19:41:04.956927+0000","last_peered":"2021-10-08T19:41:04.956927+0000","last_clean":"2021-10-08T19:41:04.956927+0000","last_became_active":"2021-10-08T19:28:43.178371+0000","last_became_peered":"2021-10-08T19:28:43.178371+0000","last_unstale":"2021-10-08T19:41:04.956927+0000","last_undegraded":"2021-10-08T19:41:04.956927+0000","last_fullsized":"2021-10-08T19:41:04.956927+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:39:12.712371+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:34:13.653248+0000","last_clean_scrub_stamp":"2021-10-08T19:39:12.712371+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0024492619999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":227,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.951893+0000","last_change":"2021-10-08T19:39:55.493642+0000","last_active":"2021-10-08T19:41:04.951893+0000","last_peered":"2021-10-08T19:41:04.951893+0000","last_clean":"2021-10-08T19:41:04.951893+0000","last_became_active":"2021-10-08T19:31:22.783759+0000","last_became_peered":"2021-10-08T19:31:22.783759+0000","last_unstale":"2021-10-08T19:41:04.951893+0000","last_undegraded":"2021-10-08T19:41:04.951893+0000","last_fullsized":"2021-10-08T19:41:04.951893+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:55.493516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:39:55.493516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.030146177999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"289'24","reported_seq":568,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.944212+0000","last_change":"2021-10-08T19:39:58.874015+0000","last_active":"2021-10-08T19:41:04.944212+0000","last_peered":"2021-10-08T19:41:04.944212+0000","last_clean":"2021-10-08T19:41:04.944212+0000","last_became_active":"2021-10-08T19:32:45.154743+0000","last_became_peered":"2021-10-08T19:32:45.154743+0000","last_unstale":"2021-10-08T19:41:04.944212+0000","last_undegraded":"2021-10-08T19:41:04.944212+0000","last_fullsized":"2021-10-08T19:41:04.944212+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'24","last_scrub_stamp":"2021-10-08T19:39:58.873935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:39:58.873935+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010739402,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":30,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":469,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.943667+0000","last_change":"2021-10-08T19:40:49.866950+0000","last_active":"2021-10-08T19:41:04.943667+0000","last_peered":"2021-10-08T19:41:04.943667+0000","last_clean":"2021-10-08T19:41:04.943667+0000","last_became_active":"2021-10-08T19:36:58.012034+0000","last_became_peered":"2021-10-08T19:36:58.012034+0000","last_unstale":"2021-10-08T19:41:04.943667+0000","last_undegraded":"2021-10-08T19:41:04.943667+0000","last_fullsized":"2021-10-08T19:41:04.943667+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:22.163674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:22.163674+0000","last_clean_scrub_stamp":"2021-10-08T19:39:22.163674+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.019072321,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":497,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.944492+0000","last_change":"2021-10-08T19:39:53.907915+0000","last_active":"2021-10-08T19:41:04.944492+0000","last_peered":"2021-10-08T19:41:04.944492+0000","last_clean":"2021-10-08T19:41:04.944492+0000","last_became_active":"2021-10-08T19:29:40.632010+0000","last_became_peered":"2021-10-08T19:29:40.632010+0000","last_unstale":"2021-10-08T19:41:04.944492+0000","last_undegraded":"2021-10-08T19:41:04.944492+0000","last_fullsized":"2021-10-08T19:41:04.944492+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:53.907799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:53.907799+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0094451080000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":209,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.953683+0000","last_change":"2021-10-08T19:39:22.680310+0000","last_active":"2021-10-08T19:41:04.953683+0000","last_peered":"2021-10-08T19:41:04.953683+0000","last_clean":"2021-10-08T19:41:04.953683+0000","last_became_active":"2021-10-08T19:31:51.673821+0000","last_became_peered":"2021-10-08T19:31:51.673821+0000","last_unstale":"2021-10-08T19:41:04.953683+0000","last_undegraded":"2021-10-08T19:41:04.953683+0000","last_fullsized":"2021-10-08T19:41:04.953683+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:22.680215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:21.644827+0000","last_clean_scrub_stamp":"2021-10-08T19:39:22.680215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002643659,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.a","version":"477'9430","reported_seq":9482,"reported_epoch":477,"state":"active+clean","last_fresh":"2021-10-08T19:41:14.291902+0000","last_change":"2021-10-08T19:39:04.774934+0000","last_active":"2021-10-08T19:41:14.291902+0000","last_peered":"2021-10-08T19:41:14.291902+0000","last_clean":"2021-10-08T19:41:14.291902+0000","last_became_active":"2021-10-08T19:39:04.774503+0000","last_became_peered":"2021-10-08T19:39:04.774503+0000","last_unstale":"2021-10-08T19:41:14.291902+0000","last_undegraded":"2021-10-08T19:41:14.291902+0000","last_fullsized":"2021-10-08T19:41:14.291902+0000","mapping_epoch":433,"log_start":"459'5500","ondisk_log_start":"459'5500","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:03.490762+0000","log_size":3930,"ondisk_log_size":3930,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":321257472,"num_objects":4902,"num_object_clones":0,"num_object_copies":14706,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4902,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9430,"num_write_kb":458624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":457,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.945297+0000","last_change":"2021-10-08T19:39:59.811372+0000","last_active":"2021-10-08T19:41:04.945297+0000","last_peered":"2021-10-08T19:41:04.945297+0000","last_clean":"2021-10-08T19:41:04.945297+0000","last_became_active":"2021-10-08T19:21:27.636086+0000","last_became_peered":"2021-10-08T19:21:27.636086+0000","last_unstale":"2021-10-08T19:41:04.945297+0000","last_undegraded":"2021-10-08T19:41:04.945297+0000","last_fullsized":"2021-10-08T19:41:04.945297+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:59.811267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:39:59.811267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0070031299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"443'33","reported_seq":450,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.945343+0000","last_change":"2021-10-08T19:39:26.350865+0000","last_active":"2021-10-08T19:41:04.945343+0000","last_peered":"2021-10-08T19:41:04.945343+0000","last_clean":"2021-10-08T19:41:04.945343+0000","last_became_active":"2021-10-08T19:24:25.100384+0000","last_became_peered":"2021-10-08T19:24:25.100384+0000","last_unstale":"2021-10-08T19:41:04.945343+0000","last_undegraded":"2021-10-08T19:41:04.945343+0000","last_fullsized":"2021-10-08T19:41:04.945343+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"443'33","last_scrub_stamp":"2021-10-08T19:39:26.350786+0000","last_deep_scrub":"443'33","last_deep_scrub_stamp":"2021-10-08T19:39:26.350786+0000","last_clean_scrub_stamp":"2021-10-08T19:39:26.350786+0000","log_size":33,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010726793,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":42,"num_read_kb":32,"num_write":25,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"90'130","reported_seq":770,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.940195+0000","last_change":"2021-10-08T19:39:15.614628+0000","last_active":"2021-10-08T19:41:04.940195+0000","last_peered":"2021-10-08T19:41:04.940195+0000","last_clean":"2021-10-08T19:41:04.940195+0000","last_became_active":"2021-10-08T19:27:22.607289+0000","last_became_peered":"2021-10-08T19:27:22.607289+0000","last_unstale":"2021-10-08T19:41:04.940195+0000","last_undegraded":"2021-10-08T19:41:04.940195+0000","last_fullsized":"2021-10-08T19:41:04.940195+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:39:15.614552+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:39:15.614552+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0018892329999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":475,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.943335+0000","last_change":"2021-10-08T19:40:06.128693+0000","last_active":"2021-10-08T19:41:04.943335+0000","last_peered":"2021-10-08T19:41:04.943335+0000","last_clean":"2021-10-08T19:41:04.943335+0000","last_became_active":"2021-10-08T19:37:45.837378+0000","last_became_peered":"2021-10-08T19:37:45.837378+0000","last_unstale":"2021-10-08T19:41:04.943335+0000","last_undegraded":"2021-10-08T19:41:04.943335+0000","last_fullsized":"2021-10-08T19:41:04.943335+0000","mapping_epoch":407,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":408,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:06.128585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:06.128585+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011647138,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":267,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.951519+0000","last_change":"2021-10-08T19:39:19.171728+0000","last_active":"2021-10-08T19:41:04.951519+0000","last_peered":"2021-10-08T19:41:04.951519+0000","last_clean":"2021-10-08T19:41:04.951519+0000","last_became_active":"2021-10-08T19:29:40.638774+0000","last_became_peered":"2021-10-08T19:29:40.638774+0000","last_unstale":"2021-10-08T19:41:04.951519+0000","last_undegraded":"2021-10-08T19:41:04.951519+0000","last_fullsized":"2021-10-08T19:41:04.951519+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:19.171649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:19.171649+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.008189689,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":296,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.949679+0000","last_change":"2021-10-08T19:38:40.123422+0000","last_active":"2021-10-08T19:41:04.949679+0000","last_peered":"2021-10-08T19:41:04.949679+0000","last_clean":"2021-10-08T19:41:04.949679+0000","last_became_active":"2021-10-08T19:37:19.006459+0000","last_became_peered":"2021-10-08T19:37:19.006459+0000","last_unstale":"2021-10-08T19:41:04.949679+0000","last_undegraded":"2021-10-08T19:41:04.949679+0000","last_fullsized":"2021-10-08T19:41:04.949679+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:40.123325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:32:15.872860+0000","last_clean_scrub_stamp":"2021-10-08T19:38:40.123325+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.103398937,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4],"acting":[3,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"477'9487","reported_seq":9539,"reported_epoch":477,"state":"active+clean","last_fresh":"2021-10-08T19:41:14.301344+0000","last_change":"2021-10-08T19:39:04.774874+0000","last_active":"2021-10-08T19:41:14.301344+0000","last_peered":"2021-10-08T19:41:14.301344+0000","last_clean":"2021-10-08T19:41:14.301344+0000","last_became_active":"2021-10-08T19:39:04.774530+0000","last_became_peered":"2021-10-08T19:39:04.774530+0000","last_unstale":"2021-10-08T19:41:14.301344+0000","last_undegraded":"2021-10-08T19:41:14.301344+0000","last_fullsized":"2021-10-08T19:41:14.301344+0000","mapping_epoch":433,"log_start":"459'5500","ondisk_log_start":"459'5500","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:03.490762+0000","log_size":3987,"ondisk_log_size":3987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":324075520,"num_objects":4945,"num_object_clones":0,"num_object_copies":14835,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4945,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9487,"num_write_kb":461824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"90'130","reported_seq":778,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.940647+0000","last_change":"2021-10-08T19:39:25.754394+0000","last_active":"2021-10-08T19:41:04.940647+0000","last_peered":"2021-10-08T19:41:04.940647+0000","last_clean":"2021-10-08T19:41:04.940647+0000","last_became_active":"2021-10-08T19:27:26.591250+0000","last_became_peered":"2021-10-08T19:27:26.591250+0000","last_unstale":"2021-10-08T19:41:04.940647+0000","last_undegraded":"2021-10-08T19:41:04.940647+0000","last_fullsized":"2021-10-08T19:41:04.940647+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:39:25.754295+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:39:25.754295+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0065366060000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":473,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.942221+0000","last_change":"2021-10-08T19:40:39.008261+0000","last_active":"2021-10-08T19:41:04.942221+0000","last_peered":"2021-10-08T19:41:04.942221+0000","last_clean":"2021-10-08T19:41:04.942221+0000","last_became_active":"2021-10-08T19:21:27.637875+0000","last_became_peered":"2021-10-08T19:21:27.637875+0000","last_unstale":"2021-10-08T19:41:04.942221+0000","last_undegraded":"2021-10-08T19:41:04.942221+0000","last_fullsized":"2021-10-08T19:41:04.942221+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:39.008146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:20.092069+0000","last_clean_scrub_stamp":"2021-10-08T19:40:39.008146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0068776480000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"289'17","reported_seq":221,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.957530+0000","last_change":"2021-10-08T19:40:43.162940+0000","last_active":"2021-10-08T19:41:04.957530+0000","last_peered":"2021-10-08T19:41:04.957530+0000","last_clean":"2021-10-08T19:41:04.957530+0000","last_became_active":"2021-10-08T19:31:51.674965+0000","last_became_peered":"2021-10-08T19:31:51.674965+0000","last_unstale":"2021-10-08T19:41:04.957530+0000","last_undegraded":"2021-10-08T19:41:04.957530+0000","last_fullsized":"2021-10-08T19:41:04.957530+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'17","last_scrub_stamp":"2021-10-08T19:40:43.162834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:40:43.162834+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0077953040000000003,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":23,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":990,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":500,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.940896+0000","last_change":"2021-10-08T19:40:54.942527+0000","last_active":"2021-10-08T19:41:04.940896+0000","last_peered":"2021-10-08T19:41:04.940896+0000","last_clean":"2021-10-08T19:41:04.940896+0000","last_became_active":"2021-10-08T19:36:58.015216+0000","last_became_peered":"2021-10-08T19:36:58.015216+0000","last_unstale":"2021-10-08T19:41:04.940896+0000","last_undegraded":"2021-10-08T19:41:04.940896+0000","last_fullsized":"2021-10-08T19:41:04.940896+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:19.067941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:19.067941+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0043419399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"70'5","reported_seq":311,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.950927+0000","last_change":"2021-10-08T19:39:25.676595+0000","last_active":"2021-10-08T19:41:04.950927+0000","last_peered":"2021-10-08T19:41:04.950927+0000","last_clean":"2021-10-08T19:41:04.950927+0000","last_became_active":"2021-10-08T19:28:40.148054+0000","last_became_peered":"2021-10-08T19:28:40.148054+0000","last_unstale":"2021-10-08T19:41:04.950927+0000","last_undegraded":"2021-10-08T19:41:04.950927+0000","last_fullsized":"2021-10-08T19:41:04.950927+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:39:25.676492+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2021-10-08T19:34:18.630378+0000","last_clean_scrub_stamp":"2021-10-08T19:39:25.676492+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014341095999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":491,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.944777+0000","last_change":"2021-10-08T19:40:54.980585+0000","last_active":"2021-10-08T19:41:04.944777+0000","last_peered":"2021-10-08T19:41:04.944777+0000","last_clean":"2021-10-08T19:41:04.944777+0000","last_became_active":"2021-10-08T19:29:40.652528+0000","last_became_peered":"2021-10-08T19:29:40.652528+0000","last_unstale":"2021-10-08T19:41:04.944777+0000","last_undegraded":"2021-10-08T19:41:04.944777+0000","last_fullsized":"2021-10-08T19:41:04.944777+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:54.980484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:40:54.980484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.052397393,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"477'9568","reported_seq":9620,"reported_epoch":477,"state":"active+clean","last_fresh":"2021-10-08T19:41:14.308513+0000","last_change":"2021-10-08T19:39:04.512013+0000","last_active":"2021-10-08T19:41:14.308513+0000","last_peered":"2021-10-08T19:41:14.308513+0000","last_clean":"2021-10-08T19:41:14.308513+0000","last_became_active":"2021-10-08T19:39:04.511692+0000","last_became_peered":"2021-10-08T19:39:04.511692+0000","last_unstale":"2021-10-08T19:41:14.308513+0000","last_undegraded":"2021-10-08T19:41:14.308513+0000","last_fullsized":"2021-10-08T19:41:14.308513+0000","mapping_epoch":433,"log_start":"460'5600","ondisk_log_start":"460'5600","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:03.490762+0000","log_size":3968,"ondisk_log_size":3968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":319553536,"num_objects":4876,"num_object_clones":0,"num_object_copies":14628,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4876,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9568,"num_write_kb":462208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"90'130","reported_seq":406,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.944341+0000","last_change":"2021-10-08T19:39:59.921790+0000","last_active":"2021-10-08T19:41:04.944341+0000","last_peered":"2021-10-08T19:41:04.944341+0000","last_clean":"2021-10-08T19:41:04.944341+0000","last_became_active":"2021-10-08T19:37:19.032630+0000","last_became_peered":"2021-10-08T19:37:19.032630+0000","last_unstale":"2021-10-08T19:41:04.944341+0000","last_undegraded":"2021-10-08T19:41:04.944341+0000","last_fullsized":"2021-10-08T19:41:04.944341+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:39:59.921660+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:39:59.921660+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.01168085,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":479,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.942932+0000","last_change":"2021-10-08T19:39:55.826848+0000","last_active":"2021-10-08T19:41:04.942932+0000","last_peered":"2021-10-08T19:41:04.942932+0000","last_clean":"2021-10-08T19:41:04.942932+0000","last_became_active":"2021-10-08T19:28:40.133414+0000","last_became_peered":"2021-10-08T19:28:40.133414+0000","last_unstale":"2021-10-08T19:41:04.942932+0000","last_undegraded":"2021-10-08T19:41:04.942932+0000","last_fullsized":"2021-10-08T19:41:04.942932+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:55.826735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:39:55.826735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0091553829999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"289'44","reported_seq":561,"reported_epoch":477,"state":"active+clean","last_fresh":"2021-10-08T19:41:08.113314+0000","last_change":"2021-10-08T19:38:41.715286+0000","last_active":"2021-10-08T19:41:08.113314+0000","last_peered":"2021-10-08T19:41:08.113314+0000","last_clean":"2021-10-08T19:41:08.113314+0000","last_became_active":"2021-10-08T19:29:40.626138+0000","last_became_peered":"2021-10-08T19:29:40.626138+0000","last_unstale":"2021-10-08T19:41:08.113314+0000","last_undegraded":"2021-10-08T19:41:08.113314+0000","last_fullsized":"2021-10-08T19:41:08.113314+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'44","last_scrub_stamp":"2021-10-08T19:38:41.715181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:38:41.715181+0000","log_size":44,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0032677489999999999,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":65,"num_read_kb":50,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":1432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":496,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.951930+0000","last_change":"2021-10-08T19:38:49.623619+0000","last_active":"2021-10-08T19:41:04.951930+0000","last_peered":"2021-10-08T19:41:04.951930+0000","last_clean":"2021-10-08T19:41:04.951930+0000","last_became_active":"2021-10-08T19:37:19.004386+0000","last_became_peered":"2021-10-08T19:37:19.004386+0000","last_unstale":"2021-10-08T19:41:04.951930+0000","last_undegraded":"2021-10-08T19:41:04.951930+0000","last_fullsized":"2021-10-08T19:41:04.951930+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:49.623545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:49.623545+0000","last_clean_scrub_stamp":"2021-10-08T19:38:49.623545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0019923559999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":269,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.949578+0000","last_change":"2021-10-08T19:38:00.340784+0000","last_active":"2021-10-08T19:41:04.949578+0000","last_peered":"2021-10-08T19:41:04.949578+0000","last_clean":"2021-10-08T19:41:04.949578+0000","last_became_active":"2021-10-08T19:29:40.637371+0000","last_became_peered":"2021-10-08T19:29:40.637371+0000","last_unstale":"2021-10-08T19:41:04.949578+0000","last_undegraded":"2021-10-08T19:41:04.949578+0000","last_fullsized":"2021-10-08T19:41:04.949578+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:00.340701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:38:00.340701+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.015510070000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":416,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.936658+0000","last_change":"2021-10-08T19:38:52.106606+0000","last_active":"2021-10-08T19:41:04.936658+0000","last_peered":"2021-10-08T19:41:04.936658+0000","last_clean":"2021-10-08T19:41:04.936658+0000","last_became_active":"2021-10-08T19:25:14.550690+0000","last_became_peered":"2021-10-08T19:25:14.550690+0000","last_unstale":"2021-10-08T19:41:04.936658+0000","last_undegraded":"2021-10-08T19:41:04.936658+0000","last_fullsized":"2021-10-08T19:41:04.936658+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:52.106531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:36:09.181866+0000","last_clean_scrub_stamp":"2021-10-08T19:38:52.106531+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034384849999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.d","version":"477'9432","reported_seq":9491,"reported_epoch":477,"state":"active+clean","last_fresh":"2021-10-08T19:41:13.996482+0000","last_change":"2021-10-08T19:40:43.913456+0000","last_active":"2021-10-08T19:41:13.996482+0000","last_peered":"2021-10-08T19:41:13.996482+0000","last_clean":"2021-10-08T19:41:13.996482+0000","last_became_active":"2021-10-08T19:39:04.508623+0000","last_became_peered":"2021-10-08T19:39:04.508623+0000","last_unstale":"2021-10-08T19:41:13.996482+0000","last_undegraded":"2021-10-08T19:41:13.996482+0000","last_fullsized":"2021-10-08T19:41:13.996482+0000","mapping_epoch":433,"log_start":"455'4300","ondisk_log_start":"455'4300","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"469'7402","last_scrub_stamp":"2021-10-08T19:40:43.913335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:40:43.913335+0000","log_size":5132,"ondisk_log_size":5132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":2.962624098,"stat_sum":{"num_bytes":318570520,"num_objects":4862,"num_object_clones":0,"num_object_copies":14586,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4862,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9432,"num_write_kb":457345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6],"acting":[2,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"90'130","reported_seq":738,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.944227+0000","last_change":"2021-10-08T19:40:01.944949+0000","last_active":"2021-10-08T19:41:04.944227+0000","last_peered":"2021-10-08T19:41:04.944227+0000","last_clean":"2021-10-08T19:41:04.944227+0000","last_became_active":"2021-10-08T19:29:43.636820+0000","last_became_peered":"2021-10-08T19:29:43.636820+0000","last_unstale":"2021-10-08T19:41:04.944227+0000","last_undegraded":"2021-10-08T19:41:04.944227+0000","last_fullsized":"2021-10-08T19:41:04.944227+0000","mapping_epoch":239,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:40:01.944834+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:40:01.944834+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0061141190000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"114'10","reported_seq":738,"reported_epoch":477,"state":"active+clean","last_fresh":"2021-10-08T19:41:08.121440+0000","last_change":"2021-10-08T19:40:54.913771+0000","last_active":"2021-10-08T19:41:08.121440+0000","last_peered":"2021-10-08T19:41:08.121440+0000","last_clean":"2021-10-08T19:41:08.121440+0000","last_became_active":"2021-10-08T19:24:25.106695+0000","last_became_peered":"2021-10-08T19:24:25.106695+0000","last_unstale":"2021-10-08T19:41:08.121440+0000","last_undegraded":"2021-10-08T19:41:08.121440+0000","last_fullsized":"2021-10-08T19:41:08.121440+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'10","last_scrub_stamp":"2021-10-08T19:40:54.913650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:40:54.913650+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.006310749,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"289'20","reported_seq":221,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.952136+0000","last_change":"2021-10-08T19:40:48.298186+0000","last_active":"2021-10-08T19:41:04.952136+0000","last_peered":"2021-10-08T19:41:04.952136+0000","last_clean":"2021-10-08T19:41:04.952136+0000","last_became_active":"2021-10-08T19:31:51.675569+0000","last_became_peered":"2021-10-08T19:31:51.675569+0000","last_unstale":"2021-10-08T19:41:04.952136+0000","last_undegraded":"2021-10-08T19:41:04.952136+0000","last_fullsized":"2021-10-08T19:41:04.952136+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'20","last_scrub_stamp":"2021-10-08T19:40:48.298070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:40:48.298070+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0094577930000000008,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":23,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":316,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.953765+0000","last_change":"2021-10-08T19:38:45.612926+0000","last_active":"2021-10-08T19:41:04.953765+0000","last_peered":"2021-10-08T19:41:04.953765+0000","last_clean":"2021-10-08T19:41:04.953765+0000","last_became_active":"2021-10-08T19:36:58.013921+0000","last_became_peered":"2021-10-08T19:36:58.013921+0000","last_unstale":"2021-10-08T19:41:04.953765+0000","last_undegraded":"2021-10-08T19:41:04.953765+0000","last_fullsized":"2021-10-08T19:41:04.953765+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:45.612819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:45.612819+0000","last_clean_scrub_stamp":"2021-10-08T19:38:45.612819+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0017789839999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":481,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.938544+0000","last_change":"2021-10-08T19:40:49.951176+0000","last_active":"2021-10-08T19:41:04.938544+0000","last_peered":"2021-10-08T19:41:04.938544+0000","last_clean":"2021-10-08T19:41:04.938544+0000","last_became_active":"2021-10-08T19:29:40.643614+0000","last_became_peered":"2021-10-08T19:29:40.643614+0000","last_unstale":"2021-10-08T19:41:04.938544+0000","last_undegraded":"2021-10-08T19:41:04.938544+0000","last_fullsized":"2021-10-08T19:41:04.938544+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:49.951046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:40:49.951046+0000","last_clean_scrub_stamp":"2021-10-08T19:40:49.951046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.073125817999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":260,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.949006+0000","last_change":"2021-10-08T19:39:54.093007+0000","last_active":"2021-10-08T19:41:04.949006+0000","last_peered":"2021-10-08T19:41:04.949006+0000","last_clean":"2021-10-08T19:41:04.949006+0000","last_became_active":"2021-10-08T19:37:19.012488+0000","last_became_peered":"2021-10-08T19:37:19.012488+0000","last_unstale":"2021-10-08T19:41:04.949006+0000","last_undegraded":"2021-10-08T19:41:04.949006+0000","last_fullsized":"2021-10-08T19:41:04.949006+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:54.092909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:54.092909+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0066472559999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,2],"acting":[3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.6","version":"477'9274","reported_seq":9332,"reported_epoch":477,"state":"active+clean","last_fresh":"2021-10-08T19:41:13.732360+0000","last_change":"2021-10-08T19:40:53.997643+0000","last_active":"2021-10-08T19:41:13.732360+0000","last_peered":"2021-10-08T19:41:13.732360+0000","last_clean":"2021-10-08T19:41:13.732360+0000","last_became_active":"2021-10-08T19:39:04.514288+0000","last_became_peered":"2021-10-08T19:39:04.514288+0000","last_unstale":"2021-10-08T19:41:13.732360+0000","last_undegraded":"2021-10-08T19:41:13.732360+0000","last_fullsized":"2021-10-08T19:41:13.732360+0000","mapping_epoch":433,"log_start":"455'4500","ondisk_log_start":"455'4500","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"471'7995","last_scrub_stamp":"2021-10-08T19:40:53.997536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:40:53.997536+0000","log_size":4774,"ondisk_log_size":4774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":3.0690331159999999,"stat_sum":{"num_bytes":319815680,"num_objects":4880,"num_object_clones":0,"num_object_copies":14640,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4880,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9274,"num_write_kb":452928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":489,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.943937+0000","last_change":"2021-10-08T19:40:08.190048+0000","last_active":"2021-10-08T19:41:04.943937+0000","last_peered":"2021-10-08T19:41:04.943937+0000","last_clean":"2021-10-08T19:41:04.943937+0000","last_became_active":"2021-10-08T19:28:40.138726+0000","last_became_peered":"2021-10-08T19:28:40.138726+0000","last_unstale":"2021-10-08T19:41:04.943937+0000","last_undegraded":"2021-10-08T19:41:04.943937+0000","last_fullsized":"2021-10-08T19:41:04.943937+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:08.189929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:50.435552+0000","last_clean_scrub_stamp":"2021-10-08T19:40:08.189929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0083115949999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"289'18","reported_seq":568,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.936329+0000","last_change":"2021-10-08T19:38:40.229383+0000","last_active":"2021-10-08T19:41:04.936329+0000","last_peered":"2021-10-08T19:41:04.936329+0000","last_clean":"2021-10-08T19:41:04.936329+0000","last_became_active":"2021-10-08T19:29:40.638957+0000","last_became_peered":"2021-10-08T19:29:40.638957+0000","last_unstale":"2021-10-08T19:41:04.936329+0000","last_undegraded":"2021-10-08T19:41:04.936329+0000","last_fullsized":"2021-10-08T19:41:04.936329+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'18","last_scrub_stamp":"2021-10-08T19:38:40.229289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:38:40.229289+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.015217840999999999,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":25,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"61'2","reported_seq":476,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.937053+0000","last_change":"2021-10-08T19:40:02.407598+0000","last_active":"2021-10-08T19:41:04.937053+0000","last_peered":"2021-10-08T19:41:04.937053+0000","last_clean":"2021-10-08T19:41:04.937053+0000","last_became_active":"2021-10-08T19:21:23.603614+0000","last_became_peered":"2021-10-08T19:21:23.603614+0000","last_unstale":"2021-10-08T19:41:04.937053+0000","last_undegraded":"2021-10-08T19:41:04.937053+0000","last_fullsized":"2021-10-08T19:41:04.937053+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'2","last_scrub_stamp":"2021-10-08T19:40:02.407482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:02.407482+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0060178940000000002,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":269,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.951000+0000","last_change":"2021-10-08T19:39:11.360634+0000","last_active":"2021-10-08T19:41:04.951000+0000","last_peered":"2021-10-08T19:41:04.951000+0000","last_clean":"2021-10-08T19:41:04.951000+0000","last_became_active":"2021-10-08T19:29:40.645211+0000","last_became_peered":"2021-10-08T19:29:40.645211+0000","last_unstale":"2021-10-08T19:41:04.951000+0000","last_undegraded":"2021-10-08T19:41:04.951000+0000","last_fullsized":"2021-10-08T19:41:04.951000+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:11.360528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:11.360528+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.12852046,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":396,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.945820+0000","last_change":"2021-10-08T19:40:03.902724+0000","last_active":"2021-10-08T19:41:04.945820+0000","last_peered":"2021-10-08T19:41:04.945820+0000","last_clean":"2021-10-08T19:41:04.945820+0000","last_became_active":"2021-10-08T19:28:40.100770+0000","last_became_peered":"2021-10-08T19:28:40.100770+0000","last_unstale":"2021-10-08T19:41:04.945820+0000","last_undegraded":"2021-10-08T19:41:04.945820+0000","last_fullsized":"2021-10-08T19:41:04.945820+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:03.902636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:03.902636+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011310317,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"289'15","reported_seq":528,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.944302+0000","last_change":"2021-10-08T19:39:54.875637+0000","last_active":"2021-10-08T19:41:04.944302+0000","last_peered":"2021-10-08T19:41:04.944302+0000","last_clean":"2021-10-08T19:41:04.944302+0000","last_became_active":"2021-10-08T19:29:40.644354+0000","last_became_peered":"2021-10-08T19:29:40.644354+0000","last_unstale":"2021-10-08T19:41:04.944302+0000","last_undegraded":"2021-10-08T19:41:04.944302+0000","last_fullsized":"2021-10-08T19:41:04.944302+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'15","last_scrub_stamp":"2021-10-08T19:39:54.875517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:39:54.875517+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010969082,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":501,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.943867+0000","last_change":"2021-10-08T19:40:32.125560+0000","last_active":"2021-10-08T19:41:04.943867+0000","last_peered":"2021-10-08T19:41:04.943867+0000","last_clean":"2021-10-08T19:41:04.943867+0000","last_became_active":"2021-10-08T19:28:40.139234+0000","last_became_peered":"2021-10-08T19:28:40.139234+0000","last_unstale":"2021-10-08T19:41:04.943867+0000","last_undegraded":"2021-10-08T19:41:04.943867+0000","last_fullsized":"2021-10-08T19:41:04.943867+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:32.125490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:32.125490+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010928068000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":267,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.949719+0000","last_change":"2021-10-08T19:38:51.158307+0000","last_active":"2021-10-08T19:41:04.949719+0000","last_peered":"2021-10-08T19:41:04.949719+0000","last_clean":"2021-10-08T19:41:04.949719+0000","last_became_active":"2021-10-08T19:29:40.645111+0000","last_became_peered":"2021-10-08T19:29:40.645111+0000","last_unstale":"2021-10-08T19:41:04.949719+0000","last_undegraded":"2021-10-08T19:41:04.949719+0000","last_fullsized":"2021-10-08T19:41:04.949719+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:51.158228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:38:51.158228+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020157690000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":467,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.940715+0000","last_change":"2021-10-08T19:40:02.108048+0000","last_active":"2021-10-08T19:41:04.940715+0000","last_peered":"2021-10-08T19:41:04.940715+0000","last_clean":"2021-10-08T19:41:04.940715+0000","last_became_active":"2021-10-08T19:21:29.640674+0000","last_became_peered":"2021-10-08T19:21:29.640674+0000","last_unstale":"2021-10-08T19:41:04.940715+0000","last_undegraded":"2021-10-08T19:41:04.940715+0000","last_fullsized":"2021-10-08T19:41:04.940715+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:02.107943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:40:02.107943+0000","last_clean_scrub_stamp":"2021-10-08T19:40:02.107943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0082285750000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":388,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.940181+0000","last_change":"2021-10-08T19:40:47.809293+0000","last_active":"2021-10-08T19:41:04.940181+0000","last_peered":"2021-10-08T19:41:04.940181+0000","last_clean":"2021-10-08T19:41:04.940181+0000","last_became_active":"2021-10-08T19:25:15.501118+0000","last_became_peered":"2021-10-08T19:25:15.501118+0000","last_unstale":"2021-10-08T19:41:04.940181+0000","last_undegraded":"2021-10-08T19:41:04.940181+0000","last_fullsized":"2021-10-08T19:41:04.940181+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:47.809188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:47.809188+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0032071320000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"289'12","reported_seq":290,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.949635+0000","last_change":"2021-10-08T19:39:58.261469+0000","last_active":"2021-10-08T19:41:04.949635+0000","last_peered":"2021-10-08T19:41:04.949635+0000","last_clean":"2021-10-08T19:41:04.949635+0000","last_became_active":"2021-10-08T19:29:40.644657+0000","last_became_peered":"2021-10-08T19:29:40.644657+0000","last_unstale":"2021-10-08T19:41:04.949635+0000","last_undegraded":"2021-10-08T19:41:04.949635+0000","last_fullsized":"2021-10-08T19:41:04.949635+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'12","last_scrub_stamp":"2021-10-08T19:39:58.261366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:39:58.261366+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0074846620000000004,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":18,"num_read_kb":15,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":429,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.943377+0000","last_change":"2021-10-08T19:39:28.422329+0000","last_active":"2021-10-08T19:41:04.943377+0000","last_peered":"2021-10-08T19:41:04.943377+0000","last_clean":"2021-10-08T19:41:04.943377+0000","last_became_active":"2021-10-08T19:28:40.101898+0000","last_became_peered":"2021-10-08T19:28:40.101898+0000","last_unstale":"2021-10-08T19:41:04.943377+0000","last_undegraded":"2021-10-08T19:41:04.943377+0000","last_fullsized":"2021-10-08T19:41:04.943377+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:28.422254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:16.444582+0000","last_clean_scrub_stamp":"2021-10-08T19:39:28.422254+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0087056440000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":318,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.949494+0000","last_change":"2021-10-08T19:37:49.277058+0000","last_active":"2021-10-08T19:41:04.949494+0000","last_peered":"2021-10-08T19:41:04.949494+0000","last_clean":"2021-10-08T19:41:04.949494+0000","last_became_active":"2021-10-08T19:37:19.011117+0000","last_became_peered":"2021-10-08T19:37:19.011117+0000","last_unstale":"2021-10-08T19:41:04.949494+0000","last_undegraded":"2021-10-08T19:41:04.949494+0000","last_fullsized":"2021-10-08T19:41:04.949494+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:49.276955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:37:49.276955+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014777808,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":479,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.944353+0000","last_change":"2021-10-08T19:40:51.961161+0000","last_active":"2021-10-08T19:41:04.944353+0000","last_peered":"2021-10-08T19:41:04.944353+0000","last_clean":"2021-10-08T19:41:04.944353+0000","last_became_active":"2021-10-08T19:24:25.099371+0000","last_became_peered":"2021-10-08T19:24:25.099371+0000","last_unstale":"2021-10-08T19:41:04.944353+0000","last_undegraded":"2021-10-08T19:41:04.944353+0000","last_fullsized":"2021-10-08T19:41:04.944353+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:51.961084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:40:51.961084+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.038885474000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"70'5","reported_seq":660,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.942969+0000","last_change":"2021-10-08T19:40:52.878295+0000","last_active":"2021-10-08T19:41:04.942969+0000","last_peered":"2021-10-08T19:41:04.942969+0000","last_clean":"2021-10-08T19:41:04.942969+0000","last_became_active":"2021-10-08T19:31:22.785193+0000","last_became_peered":"2021-10-08T19:31:22.785193+0000","last_unstale":"2021-10-08T19:41:04.942969+0000","last_undegraded":"2021-10-08T19:41:04.942969+0000","last_fullsized":"2021-10-08T19:41:04.942969+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":5,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:38:38.294930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:38:38.294930+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0055411690000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"289'20","reported_seq":338,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.950038+0000","last_change":"2021-10-08T19:39:28.248294+0000","last_active":"2021-10-08T19:41:04.950038+0000","last_peered":"2021-10-08T19:41:04.950038+0000","last_clean":"2021-10-08T19:41:04.950038+0000","last_became_active":"2021-10-08T19:31:51.677055+0000","last_became_peered":"2021-10-08T19:31:51.677055+0000","last_unstale":"2021-10-08T19:41:04.950038+0000","last_undegraded":"2021-10-08T19:41:04.950038+0000","last_fullsized":"2021-10-08T19:41:04.950038+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'20","last_scrub_stamp":"2021-10-08T19:39:28.248174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:39:28.248174+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012648767999999999,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":44,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.936192+0000","last_change":"2021-10-08T19:40:39.787067+0000","last_active":"2021-10-08T19:41:04.936192+0000","last_peered":"2021-10-08T19:41:04.936192+0000","last_clean":"2021-10-08T19:41:04.936192+0000","last_became_active":"2021-10-08T19:39:39.136801+0000","last_became_peered":"2021-10-08T19:39:39.136801+0000","last_unstale":"2021-10-08T19:41:04.936192+0000","last_undegraded":"2021-10-08T19:41:04.936192+0000","last_fullsized":"2021-10-08T19:41:04.936192+0000","mapping_epoch":448,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":449,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:39.786960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:39.786960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011731676999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,2],"acting":[4,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"398'12","reported_seq":616,"reported_epoch":477,"state":"active+clean","last_fresh":"2021-10-08T19:41:08.108966+0000","last_change":"2021-10-08T19:39:58.937602+0000","last_active":"2021-10-08T19:41:08.108966+0000","last_peered":"2021-10-08T19:41:08.108966+0000","last_clean":"2021-10-08T19:41:08.108966+0000","last_became_active":"2021-10-08T19:37:19.015189+0000","last_became_peered":"2021-10-08T19:37:19.015189+0000","last_unstale":"2021-10-08T19:41:08.108966+0000","last_undegraded":"2021-10-08T19:41:08.108966+0000","last_fullsized":"2021-10-08T19:41:08.108966+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"398'12","last_scrub_stamp":"2021-10-08T19:39:58.937499+0000","last_deep_scrub":"328'11","last_deep_scrub_stamp":"2021-10-08T19:33:32.545870+0000","last_clean_scrub_stamp":"2021-10-08T19:39:58.937499+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012203161000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":475,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.944126+0000","last_change":"2021-10-08T19:40:11.028411+0000","last_active":"2021-10-08T19:41:04.944126+0000","last_peered":"2021-10-08T19:41:04.944126+0000","last_clean":"2021-10-08T19:41:04.944126+0000","last_became_active":"2021-10-08T19:29:40.644819+0000","last_became_peered":"2021-10-08T19:29:40.644819+0000","last_unstale":"2021-10-08T19:41:04.944126+0000","last_undegraded":"2021-10-08T19:41:04.944126+0000","last_fullsized":"2021-10-08T19:41:04.944126+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:11.028298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:40:11.028298+0000","last_clean_scrub_stamp":"2021-10-08T19:40:11.028298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.053608935000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":384,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.940747+0000","last_change":"2021-10-08T19:40:04.898401+0000","last_active":"2021-10-08T19:41:04.940747+0000","last_peered":"2021-10-08T19:41:04.940747+0000","last_clean":"2021-10-08T19:41:04.940747+0000","last_became_active":"2021-10-08T19:25:15.498770+0000","last_became_peered":"2021-10-08T19:25:15.498770+0000","last_unstale":"2021-10-08T19:41:04.940747+0000","last_undegraded":"2021-10-08T19:41:04.940747+0000","last_fullsized":"2021-10-08T19:41:04.940747+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:04.898293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:04.898293+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010628007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"289'15","reported_seq":129,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.944695+0000","last_change":"2021-10-08T19:39:32.769018+0000","last_active":"2021-10-08T19:41:04.944695+0000","last_peered":"2021-10-08T19:41:04.944695+0000","last_clean":"2021-10-08T19:41:04.944695+0000","last_became_active":"2021-10-08T19:37:19.007551+0000","last_became_peered":"2021-10-08T19:37:19.007551+0000","last_unstale":"2021-10-08T19:41:04.944695+0000","last_undegraded":"2021-10-08T19:41:04.944695+0000","last_fullsized":"2021-10-08T19:41:04.944695+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'15","last_scrub_stamp":"2021-10-08T19:39:32.768897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:39:32.768897+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0067183929999999996,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":485,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.943300+0000","last_change":"2021-10-08T19:39:09.108744+0000","last_active":"2021-10-08T19:41:04.943300+0000","last_peered":"2021-10-08T19:41:04.943300+0000","last_clean":"2021-10-08T19:41:04.943300+0000","last_became_active":"2021-10-08T19:29:44.439397+0000","last_became_peered":"2021-10-08T19:29:44.439397+0000","last_unstale":"2021-10-08T19:41:04.943300+0000","last_undegraded":"2021-10-08T19:41:04.943300+0000","last_fullsized":"2021-10-08T19:41:04.943300+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:09.108669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:09.108669+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.057135996000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"413'11","reported_seq":411,"reported_epoch":477,"state":"active+clean","last_fresh":"2021-10-08T19:41:08.070558+0000","last_change":"2021-10-08T19:37:59.373999+0000","last_active":"2021-10-08T19:41:08.070558+0000","last_peered":"2021-10-08T19:41:08.070558+0000","last_clean":"2021-10-08T19:41:08.070558+0000","last_became_active":"2021-10-08T19:29:40.637650+0000","last_became_peered":"2021-10-08T19:29:40.637650+0000","last_unstale":"2021-10-08T19:41:08.070558+0000","last_undegraded":"2021-10-08T19:41:08.070558+0000","last_fullsized":"2021-10-08T19:41:08.070558+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"413'11","last_scrub_stamp":"2021-10-08T19:37:59.373882+0000","last_deep_scrub":"413'11","last_deep_scrub_stamp":"2021-10-08T19:37:59.373882+0000","last_clean_scrub_stamp":"2021-10-08T19:37:59.373882+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0097897460000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":454,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.937189+0000","last_change":"2021-10-08T19:40:09.484050+0000","last_active":"2021-10-08T19:41:04.937189+0000","last_peered":"2021-10-08T19:41:04.937189+0000","last_clean":"2021-10-08T19:41:04.937189+0000","last_became_active":"2021-10-08T19:21:29.640302+0000","last_became_peered":"2021-10-08T19:21:29.640302+0000","last_unstale":"2021-10-08T19:41:04.937189+0000","last_undegraded":"2021-10-08T19:41:04.937189+0000","last_fullsized":"2021-10-08T19:41:04.937189+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:09.483932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:40:09.483932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.14512376099999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":396,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.942698+0000","last_change":"2021-10-08T19:39:22.092570+0000","last_active":"2021-10-08T19:41:04.942698+0000","last_peered":"2021-10-08T19:41:04.942698+0000","last_clean":"2021-10-08T19:41:04.942698+0000","last_became_active":"2021-10-08T19:29:40.631374+0000","last_became_peered":"2021-10-08T19:29:40.631374+0000","last_unstale":"2021-10-08T19:41:04.942698+0000","last_undegraded":"2021-10-08T19:41:04.942698+0000","last_fullsized":"2021-10-08T19:41:04.942698+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:22.092466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:22.092466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0027849989999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":396,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.944265+0000","last_change":"2021-10-08T19:40:35.894072+0000","last_active":"2021-10-08T19:41:04.944265+0000","last_peered":"2021-10-08T19:41:04.944265+0000","last_clean":"2021-10-08T19:41:04.944265+0000","last_became_active":"2021-10-08T19:29:40.652966+0000","last_became_peered":"2021-10-08T19:29:40.652966+0000","last_unstale":"2021-10-08T19:41:04.944265+0000","last_undegraded":"2021-10-08T19:41:04.944265+0000","last_fullsized":"2021-10-08T19:41:04.944265+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:08.748947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:08.748947+0000","last_clean_scrub_stamp":"2021-10-08T19:38:08.748947+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0079490979999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"289'19","reported_seq":221,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.951867+0000","last_change":"2021-10-08T19:39:59.953175+0000","last_active":"2021-10-08T19:41:04.951867+0000","last_peered":"2021-10-08T19:41:04.951867+0000","last_clean":"2021-10-08T19:41:04.951867+0000","last_became_active":"2021-10-08T19:31:51.676961+0000","last_became_peered":"2021-10-08T19:31:51.676961+0000","last_unstale":"2021-10-08T19:41:04.951867+0000","last_undegraded":"2021-10-08T19:41:04.951867+0000","last_fullsized":"2021-10-08T19:41:04.951867+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:39:59.953049+0000","last_deep_scrub":"289'19","last_deep_scrub_stamp":"2021-10-08T19:32:46.539792+0000","last_clean_scrub_stamp":"2021-10-08T19:39:59.953049+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0047403150000000002,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":445,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.943817+0000","last_change":"2021-10-08T19:39:16.255115+0000","last_active":"2021-10-08T19:41:04.943817+0000","last_peered":"2021-10-08T19:41:04.943817+0000","last_clean":"2021-10-08T19:41:04.943817+0000","last_became_active":"2021-10-08T19:31:22.786651+0000","last_became_peered":"2021-10-08T19:31:22.786651+0000","last_unstale":"2021-10-08T19:41:04.943817+0000","last_undegraded":"2021-10-08T19:41:04.943817+0000","last_fullsized":"2021-10-08T19:41:04.943817+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:16.255018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:16.255018+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034406480000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":269,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.950928+0000","last_change":"2021-10-08T19:38:06.367374+0000","last_active":"2021-10-08T19:41:04.950928+0000","last_peered":"2021-10-08T19:41:04.950928+0000","last_clean":"2021-10-08T19:41:04.950928+0000","last_became_active":"2021-10-08T19:29:40.644770+0000","last_became_peered":"2021-10-08T19:29:40.644770+0000","last_unstale":"2021-10-08T19:41:04.950928+0000","last_undegraded":"2021-10-08T19:41:04.950928+0000","last_fullsized":"2021-10-08T19:41:04.950928+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:06.367259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:06.367259+0000","last_clean_scrub_stamp":"2021-10-08T19:38:06.367259+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010215291,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":477,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.938533+0000","last_change":"2021-10-08T19:39:56.867112+0000","last_active":"2021-10-08T19:41:04.938533+0000","last_peered":"2021-10-08T19:41:04.938533+0000","last_clean":"2021-10-08T19:41:04.938533+0000","last_became_active":"2021-10-08T19:28:40.133744+0000","last_became_peered":"2021-10-08T19:28:40.133744+0000","last_unstale":"2021-10-08T19:41:04.938533+0000","last_undegraded":"2021-10-08T19:41:04.938533+0000","last_fullsized":"2021-10-08T19:41:04.938533+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:56.866997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:56.866997+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.058090835,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"289'19","reported_seq":608,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.936557+0000","last_change":"2021-10-08T19:39:17.052667+0000","last_active":"2021-10-08T19:41:04.936557+0000","last_peered":"2021-10-08T19:41:04.936557+0000","last_clean":"2021-10-08T19:41:04.936557+0000","last_became_active":"2021-10-08T19:28:40.100196+0000","last_became_peered":"2021-10-08T19:28:40.100196+0000","last_unstale":"2021-10-08T19:41:04.936557+0000","last_undegraded":"2021-10-08T19:41:04.936557+0000","last_fullsized":"2021-10-08T19:41:04.936557+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:39:17.052565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:39:17.052565+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0059573320000000001,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":315,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.952813+0000","last_change":"2021-10-08T19:40:03.951140+0000","last_active":"2021-10-08T19:41:04.952813+0000","last_peered":"2021-10-08T19:41:04.952813+0000","last_clean":"2021-10-08T19:41:04.952813+0000","last_became_active":"2021-10-08T19:28:40.146673+0000","last_became_peered":"2021-10-08T19:28:40.146673+0000","last_unstale":"2021-10-08T19:41:04.952813+0000","last_undegraded":"2021-10-08T19:41:04.952813+0000","last_fullsized":"2021-10-08T19:41:04.952813+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:03.950996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:09.610637+0000","last_clean_scrub_stamp":"2021-10-08T19:40:03.950996+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.021277893999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":325,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.952207+0000","last_change":"2021-10-08T19:39:54.862550+0000","last_active":"2021-10-08T19:41:04.952207+0000","last_peered":"2021-10-08T19:41:04.952207+0000","last_clean":"2021-10-08T19:41:04.952207+0000","last_became_active":"2021-10-08T19:29:40.638536+0000","last_became_peered":"2021-10-08T19:29:40.638536+0000","last_unstale":"2021-10-08T19:41:04.952207+0000","last_undegraded":"2021-10-08T19:41:04.952207+0000","last_fullsized":"2021-10-08T19:41:04.952207+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:54.862426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:43.186684+0000","last_clean_scrub_stamp":"2021-10-08T19:39:54.862426+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014441246,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":267,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.951809+0000","last_change":"2021-10-08T19:38:47.187888+0000","last_active":"2021-10-08T19:41:04.951809+0000","last_peered":"2021-10-08T19:41:04.951809+0000","last_clean":"2021-10-08T19:41:04.951809+0000","last_became_active":"2021-10-08T19:29:40.634300+0000","last_became_peered":"2021-10-08T19:29:40.634300+0000","last_unstale":"2021-10-08T19:41:04.951809+0000","last_undegraded":"2021-10-08T19:41:04.951809+0000","last_fullsized":"2021-10-08T19:41:04.951809+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:47.187765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:47.187765+0000","last_clean_scrub_stamp":"2021-10-08T19:38:47.187765+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013817288,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"70'5","reported_seq":384,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.936592+0000","last_change":"2021-10-08T19:40:47.760720+0000","last_active":"2021-10-08T19:41:04.936592+0000","last_peered":"2021-10-08T19:41:04.936592+0000","last_clean":"2021-10-08T19:41:04.936592+0000","last_became_active":"2021-10-08T19:25:15.496309+0000","last_became_peered":"2021-10-08T19:25:15.496309+0000","last_unstale":"2021-10-08T19:41:04.936592+0000","last_undegraded":"2021-10-08T19:41:04.936592+0000","last_fullsized":"2021-10-08T19:41:04.936592+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:40:47.760595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:47.760595+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0059370550000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.10","version":"289'8","reported_seq":296,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.948809+0000","last_change":"2021-10-08T19:39:59.311631+0000","last_active":"2021-10-08T19:41:04.948809+0000","last_peered":"2021-10-08T19:41:04.948809+0000","last_clean":"2021-10-08T19:41:04.948809+0000","last_became_active":"2021-10-08T19:32:45.165103+0000","last_became_peered":"2021-10-08T19:32:45.165103+0000","last_unstale":"2021-10-08T19:41:04.948809+0000","last_undegraded":"2021-10-08T19:41:04.948809+0000","last_fullsized":"2021-10-08T19:41:04.948809+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'8","last_scrub_stamp":"2021-10-08T19:39:59.311531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:39:59.311531+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013231531,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":184,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.943926+0000","last_change":"2021-10-08T19:39:53.941356+0000","last_active":"2021-10-08T19:41:04.943926+0000","last_peered":"2021-10-08T19:41:04.943926+0000","last_clean":"2021-10-08T19:41:04.943926+0000","last_became_active":"2021-10-08T19:37:19.009349+0000","last_became_peered":"2021-10-08T19:37:19.009349+0000","last_unstale":"2021-10-08T19:41:04.943926+0000","last_undegraded":"2021-10-08T19:41:04.943926+0000","last_fullsized":"2021-10-08T19:41:04.943926+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:53.941264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:13.716331+0000","last_clean_scrub_stamp":"2021-10-08T19:39:53.941264+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0037200029999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":420,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.943399+0000","last_change":"2021-10-08T19:40:08.939758+0000","last_active":"2021-10-08T19:41:04.943399+0000","last_peered":"2021-10-08T19:41:04.943399+0000","last_clean":"2021-10-08T19:41:04.943399+0000","last_became_active":"2021-10-08T19:24:25.106186+0000","last_became_peered":"2021-10-08T19:24:25.106186+0000","last_unstale":"2021-10-08T19:41:04.943399+0000","last_undegraded":"2021-10-08T19:41:04.943399+0000","last_fullsized":"2021-10-08T19:41:04.943399+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:08.939657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:18.377739+0000","last_clean_scrub_stamp":"2021-10-08T19:40:08.939657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014123263,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":457,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.940720+0000","last_change":"2021-10-08T19:39:23.706599+0000","last_active":"2021-10-08T19:41:04.940720+0000","last_peered":"2021-10-08T19:41:04.940720+0000","last_clean":"2021-10-08T19:41:04.940720+0000","last_became_active":"2021-10-08T19:21:29.642835+0000","last_became_peered":"2021-10-08T19:21:29.642835+0000","last_unstale":"2021-10-08T19:41:04.940720+0000","last_undegraded":"2021-10-08T19:41:04.940720+0000","last_fullsized":"2021-10-08T19:41:04.940720+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:23.706498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:23.706498+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0056310429999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":406,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.951697+0000","last_change":"2021-10-08T19:40:33.560943+0000","last_active":"2021-10-08T19:41:04.951697+0000","last_peered":"2021-10-08T19:41:04.951697+0000","last_clean":"2021-10-08T19:41:04.951697+0000","last_became_active":"2021-10-08T19:28:40.099215+0000","last_became_peered":"2021-10-08T19:28:40.099215+0000","last_unstale":"2021-10-08T19:41:04.951697+0000","last_undegraded":"2021-10-08T19:41:04.951697+0000","last_fullsized":"2021-10-08T19:41:04.951697+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:33.560831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:33.560831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011414511,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"348'24","reported_seq":296,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.951736+0000","last_change":"2021-10-08T19:38:05.385295+0000","last_active":"2021-10-08T19:41:04.951736+0000","last_peered":"2021-10-08T19:41:04.951736+0000","last_clean":"2021-10-08T19:41:04.951736+0000","last_became_active":"2021-10-08T19:29:40.640914+0000","last_became_peered":"2021-10-08T19:29:40.640914+0000","last_unstale":"2021-10-08T19:41:04.951736+0000","last_undegraded":"2021-10-08T19:41:04.951736+0000","last_fullsized":"2021-10-08T19:41:04.951736+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"348'24","last_scrub_stamp":"2021-10-08T19:38:05.385196+0000","last_deep_scrub":"348'24","last_deep_scrub_stamp":"2021-10-08T19:34:53.274250+0000","last_clean_scrub_stamp":"2021-10-08T19:38:05.385196+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0079524399999999999,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":411,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.944275+0000","last_change":"2021-10-08T19:39:30.445681+0000","last_active":"2021-10-08T19:41:04.944275+0000","last_peered":"2021-10-08T19:41:04.944275+0000","last_clean":"2021-10-08T19:41:04.944275+0000","last_became_active":"2021-10-08T19:24:25.098128+0000","last_became_peered":"2021-10-08T19:24:25.098128+0000","last_unstale":"2021-10-08T19:41:04.944275+0000","last_undegraded":"2021-10-08T19:41:04.944275+0000","last_fullsized":"2021-10-08T19:41:04.944275+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:30.445595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:34.508558+0000","last_clean_scrub_stamp":"2021-10-08T19:39:30.445595+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0050654009999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":471,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.940419+0000","last_change":"2021-10-08T19:40:41.841071+0000","last_active":"2021-10-08T19:41:04.940419+0000","last_peered":"2021-10-08T19:41:04.940419+0000","last_clean":"2021-10-08T19:41:04.940419+0000","last_became_active":"2021-10-08T19:24:25.095490+0000","last_became_peered":"2021-10-08T19:24:25.095490+0000","last_unstale":"2021-10-08T19:41:04.940419+0000","last_undegraded":"2021-10-08T19:41:04.940419+0000","last_fullsized":"2021-10-08T19:41:04.940419+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:38.557763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:11.383779+0000","last_clean_scrub_stamp":"2021-10-08T19:38:38.557763+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012167577000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":269,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.951266+0000","last_change":"2021-10-08T19:40:41.238255+0000","last_active":"2021-10-08T19:41:04.951266+0000","last_peered":"2021-10-08T19:41:04.951266+0000","last_clean":"2021-10-08T19:41:04.951266+0000","last_became_active":"2021-10-08T19:29:40.639358+0000","last_became_peered":"2021-10-08T19:29:40.639358+0000","last_unstale":"2021-10-08T19:41:04.951266+0000","last_undegraded":"2021-10-08T19:41:04.951266+0000","last_fullsized":"2021-10-08T19:41:04.951266+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:12.821316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:36:12.821316+0000","last_clean_scrub_stamp":"2021-10-08T19:36:12.821316+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.068456382999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"289'20","reported_seq":533,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.944509+0000","last_change":"2021-10-08T19:39:16.081314+0000","last_active":"2021-10-08T19:41:04.944509+0000","last_peered":"2021-10-08T19:41:04.944509+0000","last_clean":"2021-10-08T19:41:04.944509+0000","last_became_active":"2021-10-08T19:29:40.636448+0000","last_became_peered":"2021-10-08T19:29:40.636448+0000","last_unstale":"2021-10-08T19:41:04.944509+0000","last_undegraded":"2021-10-08T19:41:04.944509+0000","last_fullsized":"2021-10-08T19:41:04.944509+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'20","last_scrub_stamp":"2021-10-08T19:39:16.081220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:39:16.081220+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0046165160000000002,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":466,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.950902+0000","last_change":"2021-10-08T19:40:38.555450+0000","last_active":"2021-10-08T19:41:04.950902+0000","last_peered":"2021-10-08T19:41:04.950902+0000","last_clean":"2021-10-08T19:41:04.950902+0000","last_became_active":"2021-10-08T19:21:23.604530+0000","last_became_peered":"2021-10-08T19:21:23.604530+0000","last_unstale":"2021-10-08T19:41:04.950902+0000","last_undegraded":"2021-10-08T19:41:04.950902+0000","last_fullsized":"2021-10-08T19:41:04.950902+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:38.555378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:38.555378+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001706328,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1f","version":"114'10","reported_seq":609,"reported_epoch":477,"state":"active+clean","last_fresh":"2021-10-08T19:41:08.115333+0000","last_change":"2021-10-08T19:39:13.217120+0000","last_active":"2021-10-08T19:41:08.115333+0000","last_peered":"2021-10-08T19:41:08.115333+0000","last_clean":"2021-10-08T19:41:08.115333+0000","last_became_active":"2021-10-08T19:24:25.105742+0000","last_became_peered":"2021-10-08T19:24:25.105742+0000","last_unstale":"2021-10-08T19:41:08.115333+0000","last_undegraded":"2021-10-08T19:41:08.115333+0000","last_fullsized":"2021-10-08T19:41:08.115333+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'10","last_scrub_stamp":"2021-10-08T19:39:13.217012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:39:13.217012+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0025013180000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"69'1","reported_seq":456,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.945443+0000","last_change":"2021-10-08T19:40:02.876774+0000","last_active":"2021-10-08T19:41:04.945443+0000","last_peered":"2021-10-08T19:41:04.945443+0000","last_clean":"2021-10-08T19:41:04.945443+0000","last_became_active":"2021-10-08T19:21:29.640296+0000","last_became_peered":"2021-10-08T19:21:29.640296+0000","last_unstale":"2021-10-08T19:41:04.945443+0000","last_undegraded":"2021-10-08T19:41:04.945443+0000","last_fullsized":"2021-10-08T19:41:04.945443+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2021-10-08T19:40:02.876665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:40:02.876665+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011383189,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"390'24","reported_seq":480,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.944421+0000","last_change":"2021-10-08T19:39:33.440040+0000","last_active":"2021-10-08T19:41:04.944421+0000","last_peered":"2021-10-08T19:41:04.944421+0000","last_clean":"2021-10-08T19:41:04.944421+0000","last_became_active":"2021-10-08T19:28:40.126425+0000","last_became_peered":"2021-10-08T19:28:40.126425+0000","last_unstale":"2021-10-08T19:41:04.944421+0000","last_undegraded":"2021-10-08T19:41:04.944421+0000","last_fullsized":"2021-10-08T19:41:04.944421+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"390'24","last_scrub_stamp":"2021-10-08T19:39:33.439960+0000","last_deep_scrub":"390'24","last_deep_scrub_stamp":"2021-10-08T19:39:33.439960+0000","last_clean_scrub_stamp":"2021-10-08T19:39:33.439960+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.030901436000000001,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":267,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.951533+0000","last_change":"2021-10-08T19:37:14.139452+0000","last_active":"2021-10-08T19:41:04.951533+0000","last_peered":"2021-10-08T19:41:04.951533+0000","last_clean":"2021-10-08T19:41:04.951533+0000","last_became_active":"2021-10-08T19:29:40.640952+0000","last_became_peered":"2021-10-08T19:29:40.640952+0000","last_unstale":"2021-10-08T19:41:04.951533+0000","last_undegraded":"2021-10-08T19:41:04.951533+0000","last_fullsized":"2021-10-08T19:41:04.951533+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:14.139384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:37:14.139384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0033835190000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":463,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.944590+0000","last_change":"2021-10-08T19:40:32.036952+0000","last_active":"2021-10-08T19:41:04.944590+0000","last_peered":"2021-10-08T19:41:04.944590+0000","last_clean":"2021-10-08T19:41:04.944590+0000","last_became_active":"2021-10-08T19:21:27.632648+0000","last_became_peered":"2021-10-08T19:21:27.632648+0000","last_unstale":"2021-10-08T19:41:04.944590+0000","last_undegraded":"2021-10-08T19:41:04.944590+0000","last_fullsized":"2021-10-08T19:41:04.944590+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:32.036833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:51.997511+0000","last_clean_scrub_stamp":"2021-10-08T19:40:32.036833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0082112660000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"69'1","reported_seq":311,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.952891+0000","last_change":"2021-10-08T19:40:38.358403+0000","last_active":"2021-10-08T19:41:04.952891+0000","last_peered":"2021-10-08T19:41:04.952891+0000","last_clean":"2021-10-08T19:41:04.952891+0000","last_became_active":"2021-10-08T19:28:40.146302+0000","last_became_peered":"2021-10-08T19:28:40.146302+0000","last_unstale":"2021-10-08T19:41:04.952891+0000","last_undegraded":"2021-10-08T19:41:04.952891+0000","last_fullsized":"2021-10-08T19:41:04.952891+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2021-10-08T19:40:38.358284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:40:38.358284+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.17503824100000001,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"289'27","reported_seq":639,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.941318+0000","last_change":"2021-10-08T19:39:24.100672+0000","last_active":"2021-10-08T19:41:04.941318+0000","last_peered":"2021-10-08T19:41:04.941318+0000","last_clean":"2021-10-08T19:41:04.941318+0000","last_became_active":"2021-10-08T19:29:40.629461+0000","last_became_peered":"2021-10-08T19:29:40.629461+0000","last_unstale":"2021-10-08T19:41:04.941318+0000","last_undegraded":"2021-10-08T19:41:04.941318+0000","last_fullsized":"2021-10-08T19:41:04.941318+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'27","last_scrub_stamp":"2021-10-08T19:39:24.100563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:39:24.100563+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010116653999999999,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":550,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":417,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.944262+0000","last_change":"2021-10-08T19:40:48.873604+0000","last_active":"2021-10-08T19:41:04.944262+0000","last_peered":"2021-10-08T19:41:04.944262+0000","last_clean":"2021-10-08T19:41:04.944262+0000","last_became_active":"2021-10-08T19:24:25.106119+0000","last_became_peered":"2021-10-08T19:24:25.106119+0000","last_unstale":"2021-10-08T19:41:04.944262+0000","last_undegraded":"2021-10-08T19:41:04.944262+0000","last_fullsized":"2021-10-08T19:41:04.944262+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:48.873507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:46.422866+0000","last_clean_scrub_stamp":"2021-10-08T19:40:48.873507+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0080410519999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":309,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.952963+0000","last_change":"2021-10-08T19:39:56.892383+0000","last_active":"2021-10-08T19:41:04.952963+0000","last_peered":"2021-10-08T19:41:04.952963+0000","last_clean":"2021-10-08T19:41:04.952963+0000","last_became_active":"2021-10-08T19:28:40.148009+0000","last_became_peered":"2021-10-08T19:28:40.148009+0000","last_unstale":"2021-10-08T19:41:04.952963+0000","last_undegraded":"2021-10-08T19:41:04.952963+0000","last_fullsized":"2021-10-08T19:41:04.952963+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:56.892286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:39:56.892286+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.018782119,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":468,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.936845+0000","last_change":"2021-10-08T19:38:37.167564+0000","last_active":"2021-10-08T19:41:04.936845+0000","last_peered":"2021-10-08T19:41:04.936845+0000","last_clean":"2021-10-08T19:41:04.936845+0000","last_became_active":"2021-10-08T19:24:25.097782+0000","last_became_peered":"2021-10-08T19:24:25.097782+0000","last_unstale":"2021-10-08T19:41:04.936845+0000","last_undegraded":"2021-10-08T19:41:04.936845+0000","last_fullsized":"2021-10-08T19:41:04.936845+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:37.167455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:37.219503+0000","last_clean_scrub_stamp":"2021-10-08T19:38:37.167455+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0027382449999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"289'18","reported_seq":294,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.949168+0000","last_change":"2021-10-08T19:40:08.385125+0000","last_active":"2021-10-08T19:41:04.949168+0000","last_peered":"2021-10-08T19:41:04.949168+0000","last_clean":"2021-10-08T19:41:04.949168+0000","last_became_active":"2021-10-08T19:29:40.645144+0000","last_became_peered":"2021-10-08T19:29:40.645144+0000","last_unstale":"2021-10-08T19:41:04.949168+0000","last_undegraded":"2021-10-08T19:41:04.949168+0000","last_fullsized":"2021-10-08T19:41:04.949168+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'18","last_scrub_stamp":"2021-10-08T19:40:08.385003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:40:08.385003+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0077571740000000004,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":25,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":267,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.951071+0000","last_change":"2021-10-08T19:39:14.212962+0000","last_active":"2021-10-08T19:41:04.951071+0000","last_peered":"2021-10-08T19:41:04.951071+0000","last_clean":"2021-10-08T19:41:04.951071+0000","last_became_active":"2021-10-08T19:29:44.443807+0000","last_became_peered":"2021-10-08T19:29:44.443807+0000","last_unstale":"2021-10-08T19:41:04.951071+0000","last_undegraded":"2021-10-08T19:41:04.951071+0000","last_fullsized":"2021-10-08T19:41:04.951071+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:14.212865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:32.854550+0000","last_clean_scrub_stamp":"2021-10-08T19:39:14.212865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0077559439999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":474,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.936443+0000","last_change":"2021-10-08T19:39:59.439583+0000","last_active":"2021-10-08T19:41:04.936443+0000","last_peered":"2021-10-08T19:41:04.936443+0000","last_clean":"2021-10-08T19:41:04.936443+0000","last_became_active":"2021-10-08T19:29:40.638352+0000","last_became_peered":"2021-10-08T19:29:40.638352+0000","last_unstale":"2021-10-08T19:41:04.936443+0000","last_undegraded":"2021-10-08T19:41:04.936443+0000","last_fullsized":"2021-10-08T19:41:04.936443+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:59.439435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:39:59.439435+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0082132950000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":285,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.949760+0000","last_change":"2021-10-08T19:39:13.413298+0000","last_active":"2021-10-08T19:41:04.949760+0000","last_peered":"2021-10-08T19:41:04.949760+0000","last_clean":"2021-10-08T19:41:04.949760+0000","last_became_active":"2021-10-08T19:31:22.788455+0000","last_became_peered":"2021-10-08T19:31:22.788455+0000","last_unstale":"2021-10-08T19:41:04.949760+0000","last_undegraded":"2021-10-08T19:41:04.949760+0000","last_fullsized":"2021-10-08T19:41:04.949760+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:13.413194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:32:12.549351+0000","last_clean_scrub_stamp":"2021-10-08T19:39:13.413194+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.173684593,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"289'15","reported_seq":523,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.936369+0000","last_change":"2021-10-08T19:40:12.384765+0000","last_active":"2021-10-08T19:41:04.936369+0000","last_peered":"2021-10-08T19:41:04.936369+0000","last_clean":"2021-10-08T19:41:04.936369+0000","last_became_active":"2021-10-08T19:29:40.631689+0000","last_became_peered":"2021-10-08T19:29:40.631689+0000","last_unstale":"2021-10-08T19:41:04.936369+0000","last_undegraded":"2021-10-08T19:41:04.936369+0000","last_fullsized":"2021-10-08T19:41:04.936369+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'15","last_scrub_stamp":"2021-10-08T19:40:12.384664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:40:12.384664+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012045141000000001,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":465,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.945102+0000","last_change":"2021-10-08T19:39:21.657387+0000","last_active":"2021-10-08T19:41:04.945102+0000","last_peered":"2021-10-08T19:41:04.945102+0000","last_clean":"2021-10-08T19:41:04.945102+0000","last_became_active":"2021-10-08T19:21:23.607785+0000","last_became_peered":"2021-10-08T19:21:23.607785+0000","last_unstale":"2021-10-08T19:41:04.945102+0000","last_undegraded":"2021-10-08T19:41:04.945102+0000","last_fullsized":"2021-10-08T19:41:04.945102+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:21.657316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:21.657316+0000","last_clean_scrub_stamp":"2021-10-08T19:39:21.657316+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034173929999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":464,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.950947+0000","last_change":"2021-10-08T19:39:53.404582+0000","last_active":"2021-10-08T19:41:04.950947+0000","last_peered":"2021-10-08T19:41:04.950947+0000","last_clean":"2021-10-08T19:41:04.950947+0000","last_became_active":"2021-10-08T19:21:27.633979+0000","last_became_peered":"2021-10-08T19:21:27.633979+0000","last_unstale":"2021-10-08T19:41:04.950947+0000","last_undegraded":"2021-10-08T19:41:04.950947+0000","last_fullsized":"2021-10-08T19:41:04.950947+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:53.404469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:27.586341+0000","last_clean_scrub_stamp":"2021-10-08T19:39:53.404469+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0099197480000000008,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":477,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.938914+0000","last_change":"2021-10-08T19:39:33.931173+0000","last_active":"2021-10-08T19:41:04.938914+0000","last_peered":"2021-10-08T19:41:04.938914+0000","last_clean":"2021-10-08T19:41:04.938914+0000","last_became_active":"2021-10-08T19:28:40.159162+0000","last_became_peered":"2021-10-08T19:28:40.159162+0000","last_unstale":"2021-10-08T19:41:04.938914+0000","last_undegraded":"2021-10-08T19:41:04.938914+0000","last_fullsized":"2021-10-08T19:41:04.938914+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:33.931043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:33.931043+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.060666474999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"289'7","reported_seq":548,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.936803+0000","last_change":"2021-10-08T19:39:13.080295+0000","last_active":"2021-10-08T19:41:04.936803+0000","last_peered":"2021-10-08T19:41:04.936803+0000","last_clean":"2021-10-08T19:41:04.936803+0000","last_became_active":"2021-10-08T19:31:51.675189+0000","last_became_peered":"2021-10-08T19:31:51.675189+0000","last_unstale":"2021-10-08T19:41:04.936803+0000","last_undegraded":"2021-10-08T19:41:04.936803+0000","last_fullsized":"2021-10-08T19:41:04.936803+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'7","last_scrub_stamp":"2021-10-08T19:39:13.080199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:39:13.080199+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0050767039999999996,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":10,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":487,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.944612+0000","last_change":"2021-10-08T19:40:40.875610+0000","last_active":"2021-10-08T19:41:04.944612+0000","last_peered":"2021-10-08T19:41:04.944612+0000","last_clean":"2021-10-08T19:41:04.944612+0000","last_became_active":"2021-10-08T19:24:25.096225+0000","last_became_peered":"2021-10-08T19:24:25.096225+0000","last_unstale":"2021-10-08T19:41:04.944612+0000","last_undegraded":"2021-10-08T19:41:04.944612+0000","last_fullsized":"2021-10-08T19:41:04.944612+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:40.875537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:29:40.244757+0000","last_clean_scrub_stamp":"2021-10-08T19:40:40.875537+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011385456,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":479,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.940311+0000","last_change":"2021-10-08T19:39:54.903894+0000","last_active":"2021-10-08T19:41:04.940311+0000","last_peered":"2021-10-08T19:41:04.940311+0000","last_clean":"2021-10-08T19:41:04.940311+0000","last_became_active":"2021-10-08T19:28:40.101187+0000","last_became_peered":"2021-10-08T19:28:40.101187+0000","last_unstale":"2021-10-08T19:41:04.940311+0000","last_undegraded":"2021-10-08T19:41:04.940311+0000","last_fullsized":"2021-10-08T19:41:04.940311+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:54.903790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:11.633739+0000","last_clean_scrub_stamp":"2021-10-08T19:39:54.903790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0066268430000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":320,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.953394+0000","last_change":"2021-10-08T19:40:54.582567+0000","last_active":"2021-10-08T19:41:04.953394+0000","last_peered":"2021-10-08T19:41:04.953394+0000","last_clean":"2021-10-08T19:41:04.953394+0000","last_became_active":"2021-10-08T19:37:19.007583+0000","last_became_peered":"2021-10-08T19:37:19.007583+0000","last_unstale":"2021-10-08T19:41:04.953394+0000","last_undegraded":"2021-10-08T19:41:04.953394+0000","last_fullsized":"2021-10-08T19:41:04.953394+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:54.582461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:40:54.582461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.091027166000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"289'19","reported_seq":603,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.936010+0000","last_change":"2021-10-08T19:40:40.799532+0000","last_active":"2021-10-08T19:41:04.936010+0000","last_peered":"2021-10-08T19:41:04.936010+0000","last_clean":"2021-10-08T19:41:04.936010+0000","last_became_active":"2021-10-08T19:28:40.099770+0000","last_became_peered":"2021-10-08T19:28:40.099770+0000","last_unstale":"2021-10-08T19:41:04.936010+0000","last_undegraded":"2021-10-08T19:41:04.936010+0000","last_fullsized":"2021-10-08T19:41:04.936010+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:40:40.799434+0000","last_deep_scrub":"289'19","last_deep_scrub_stamp":"2021-10-08T19:36:15.167374+0000","last_clean_scrub_stamp":"2021-10-08T19:40:40.799434+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0041259089999999997,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":267,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.949528+0000","last_change":"2021-10-08T19:36:57.099908+0000","last_active":"2021-10-08T19:41:04.949528+0000","last_peered":"2021-10-08T19:41:04.949528+0000","last_clean":"2021-10-08T19:41:04.949528+0000","last_became_active":"2021-10-08T19:29:40.627394+0000","last_became_peered":"2021-10-08T19:29:40.627394+0000","last_unstale":"2021-10-08T19:41:04.949528+0000","last_undegraded":"2021-10-08T19:41:04.949528+0000","last_fullsized":"2021-10-08T19:41:04.949528+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:36:57.099805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:36:57.099805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034117000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":307,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.953546+0000","last_change":"2021-10-08T19:39:24.681886+0000","last_active":"2021-10-08T19:41:04.953546+0000","last_peered":"2021-10-08T19:41:04.953546+0000","last_clean":"2021-10-08T19:41:04.953546+0000","last_became_active":"2021-10-08T19:28:40.145868+0000","last_became_peered":"2021-10-08T19:28:40.145868+0000","last_unstale":"2021-10-08T19:41:04.953546+0000","last_undegraded":"2021-10-08T19:41:04.953546+0000","last_fullsized":"2021-10-08T19:41:04.953546+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:24.681790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:39:24.681790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034071100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":474,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.936324+0000","last_change":"2021-10-08T19:40:50.813705+0000","last_active":"2021-10-08T19:41:04.936324+0000","last_peered":"2021-10-08T19:41:04.936324+0000","last_clean":"2021-10-08T19:41:04.936324+0000","last_became_active":"2021-10-08T19:28:40.099543+0000","last_became_peered":"2021-10-08T19:28:40.099543+0000","last_unstale":"2021-10-08T19:41:04.936324+0000","last_undegraded":"2021-10-08T19:41:04.936324+0000","last_fullsized":"2021-10-08T19:41:04.936324+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:50.813601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:50.032367+0000","last_clean_scrub_stamp":"2021-10-08T19:40:50.813601+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.062705711999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"289'27","reported_seq":301,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.951612+0000","last_change":"2021-10-08T19:38:03.371773+0000","last_active":"2021-10-08T19:41:04.951612+0000","last_peered":"2021-10-08T19:41:04.951612+0000","last_clean":"2021-10-08T19:41:04.951612+0000","last_became_active":"2021-10-08T19:29:40.631002+0000","last_became_peered":"2021-10-08T19:29:40.631002+0000","last_unstale":"2021-10-08T19:41:04.951612+0000","last_undegraded":"2021-10-08T19:41:04.951612+0000","last_fullsized":"2021-10-08T19:41:04.951612+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'27","last_scrub_stamp":"2021-10-08T19:38:03.371690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:38:03.371690+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012656639000000001,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":463,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.944581+0000","last_change":"2021-10-08T19:40:01.981144+0000","last_active":"2021-10-08T19:41:04.944581+0000","last_peered":"2021-10-08T19:41:04.944581+0000","last_clean":"2021-10-08T19:41:04.944581+0000","last_became_active":"2021-10-08T19:21:23.603422+0000","last_became_peered":"2021-10-08T19:21:23.603422+0000","last_unstale":"2021-10-08T19:41:04.944581+0000","last_undegraded":"2021-10-08T19:41:04.944581+0000","last_fullsized":"2021-10-08T19:41:04.944581+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:01.981016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:15.535842+0000","last_clean_scrub_stamp":"2021-10-08T19:40:01.981016+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0019631129999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":494,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.936129+0000","last_change":"2021-10-08T19:39:12.077018+0000","last_active":"2021-10-08T19:41:04.936129+0000","last_peered":"2021-10-08T19:41:04.936129+0000","last_clean":"2021-10-08T19:41:04.936129+0000","last_became_active":"2021-10-08T19:28:40.099286+0000","last_became_peered":"2021-10-08T19:28:40.099286+0000","last_unstale":"2021-10-08T19:41:04.936129+0000","last_undegraded":"2021-10-08T19:41:04.936129+0000","last_fullsized":"2021-10-08T19:41:04.936129+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:12.076904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:31.176160+0000","last_clean_scrub_stamp":"2021-10-08T19:39:12.076904+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.006185444,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":267,"reported_epoch":476,"state":"active+clean","last_fresh":"2021-10-08T19:41:04.951220+0000","last_change":"2021-10-08T19:38:08.397525+0000","last_active":"2021-10-08T19:41:04.951220+0000","last_peered":"2021-10-08T19:41:04.951220+0000","last_clean":"2021-10-08T19:41:04.951220+0000","last_became_active":"2021-10-08T19:29:40.638221+0000","last_became_peered":"2021-10-08T19:29:40.638221+0000","last_unstale":"2021-10-08T19:41:04.951220+0000","last_undegraded":"2021-10-08T19:41:04.951220+0000","last_fullsized":"2021-10-08T19:41:04.951220+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:08.397432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:38:08.397432+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.11831541399999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":16,"stat_sum":{"num_bytes":5090639896,"num_objects":77678,"num_object_clones":0,"num_object_copies":233034,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77678,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":149816,"num_write_kb":7279745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15291330560,"data_stored":15291318344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":67416,"ondisk_log_size":67416,"up":48,"acting":48,"num_store_stats":8},{"poolid":2,"num_pg":42,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":126,"acting":126,"num_store_stats":8},{"poolid":1,"num_pg":11,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1430,"ondisk_log_size":1430,"up":33,"acting":33,"num_store_stats":8},{"poolid":3,"num_pg":23,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":553,"num_read_kb":553,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":778,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":69,"acting":69,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1111,"num_read_kb":868,"num_write":703,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":520,"num_bytes_recovered":10826,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":734,"ondisk_log_size":734,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":84,"ondisk_log_size":84,"up":96,"acting":96,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201522,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2219616,"kb_used_data":1881176,"kb_used_omap":0,"kb_used_meta":338432,"kb_avail":91525536,"statfs":{"total":95995035648,"available":93722148864,"internally_reserved":0,"allocated":1926324224,"data_stored":1925934296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":346554368},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,3],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:40:45 2021","interfaces":[{"interface":"back","average":{"1min":1.9670000000000001,"5min":1.587,"15min":1.546},"min":{"1min":0.23400000000000001,"5min":0.223,"15min":0.20100000000000001},"max":{"1min":13.686,"5min":13.686,"15min":26.065000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":1.804,"5min":1.4390000000000001,"15min":1.764},"min":{"1min":0.30099999999999999,"5min":0.219,"15min":0.20499999999999999},"max":{"1min":5.0220000000000002,"5min":8.2639999999999993,"15min":25.75},"last":1.6919999999999999}]},{"osd":1,"last update":"Fri Oct 8 19:40:45 2021","interfaces":[{"interface":"back","average":{"1min":2.5840000000000001,"5min":2.79,"15min":2.2429999999999999},"min":{"1min":0.23200000000000001,"5min":0.215,"15min":0.19600000000000001},"max":{"1min":7.0640000000000001,"5min":87.966999999999999,"15min":87.966999999999999},"last":0.27200000000000002},{"interface":"front","average":{"1min":1.907,"5min":1.4379999999999999,"15min":1.79},"min":{"1min":0.26000000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":9.3510000000000009,"5min":9.3510000000000009,"15min":28.119},"last":3.4420000000000002}]},{"osd":2,"last update":"Fri Oct 8 19:40:45 2021","interfaces":[{"interface":"back","average":{"1min":2.6070000000000002,"5min":2.5800000000000001,"15min":1.994},"min":{"1min":0.28000000000000003,"5min":0.27600000000000002,"15min":0.255},"max":{"1min":11.23,"5min":81.204999999999998,"15min":81.204999999999998},"last":0.69099999999999995},{"interface":"front","average":{"1min":3.0190000000000001,"5min":2.5870000000000002,"15min":1.96},"min":{"1min":0.26800000000000002,"5min":0.253,"15min":0.253},"max":{"1min":15.632999999999999,"5min":81.022000000000006,"15min":81.022000000000006},"last":2.024}]},{"osd":3,"last update":"Fri Oct 8 19:40:45 2021","interfaces":[{"interface":"back","average":{"1min":2.1869999999999998,"5min":2.0249999999999999,"15min":2.3959999999999999},"min":{"1min":0.28799999999999998,"5min":0.28199999999999997,"15min":0.28100000000000003},"max":{"1min":7.3289999999999997,"5min":10.444000000000001,"15min":72.093999999999994},"last":2.161},{"interface":"front","average":{"1min":2.3130000000000002,"5min":1.8320000000000001,"15min":2.1970000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28000000000000003},"max":{"1min":13.872,"5min":13.872,"15min":71.864999999999995},"last":3.468}]},{"osd":4,"last update":"Fri Oct 8 19:40:45 2021","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.796,"15min":1.244},"min":{"1min":0.254,"5min":0.254,"15min":0.22800000000000001},"max":{"1min":6.2759999999999998,"5min":55.890999999999998,"15min":55.890999999999998},"last":3.0190000000000001},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.8979999999999999,"15min":1.3460000000000001},"min":{"1min":0.25900000000000001,"5min":0.254,"15min":0.254},"max":{"1min":6.9059999999999997,"5min":54.448999999999998,"15min":54.448999999999998},"last":2.9100000000000001}]},{"osd":5,"last update":"Fri Oct 8 19:40:45 2021","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.1799999999999999,"15min":1.147},"min":{"1min":0.30399999999999999,"5min":0.30299999999999999,"15min":0.26800000000000002},"max":{"1min":6.3159999999999998,"5min":6.3159999999999998,"15min":9.9280000000000008},"last":0.73299999999999998},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.323,"15min":1.2190000000000001},"min":{"1min":0.29999999999999999,"5min":0.28299999999999997,"15min":0.26100000000000001},"max":{"1min":6.9850000000000003,"5min":10.435,"15min":18.655000000000001},"last":3.3079999999999998}]},{"osd":6,"last update":"Fri Oct 8 19:40:45 2021","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.758,"15min":1.3919999999999999},"min":{"1min":0.29899999999999999,"5min":0.28799999999999998,"15min":0.27900000000000003},"max":{"1min":4.633,"5min":58.039000000000001,"15min":58.039000000000001},"last":3.4129999999999998},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.996,"15min":1.399},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30299999999999999},"max":{"1min":6.3419999999999996,"5min":58.079999999999998,"15min":58.079999999999998},"last":1.7210000000000001}]}]},{"osd":6,"up_from":47,"seq":201863463158,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2892884,"kb_used_data":2548044,"kb_used_omap":0,"kb_used_meta":344832,"kb_avail":90852268,"statfs":{"total":95995035648,"available":93032722432,"internally_reserved":0,"allocated":2609197056,"data_stored":2608818633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":353107968},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,3,1,1,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:40:23 2021","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.9410000000000001,"15min":1.617},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":5.1710000000000003,"5min":39.262,"15min":39.262},"last":0.28799999999999998},{"interface":"front","average":{"1min":1.7669999999999999,"5min":2.399,"15min":2.266},"min":{"1min":0.22500000000000001,"5min":0.215,"15min":0.21299999999999999},"max":{"1min":7.4089999999999998,"5min":39.351999999999997,"15min":69.477000000000004},"last":0.41299999999999998}]},{"osd":1,"last update":"Fri Oct 8 19:40:23 2021","interfaces":[{"interface":"back","average":{"1min":2.3370000000000002,"5min":1.9319999999999999,"15min":1.5089999999999999},"min":{"1min":0.39000000000000001,"5min":0.251,"15min":0.23000000000000001},"max":{"1min":9.7850000000000001,"5min":9.7850000000000001,"15min":14.878},"last":0.375},{"interface":"front","average":{"1min":1.8169999999999999,"5min":1.847,"15min":1.5209999999999999},"min":{"1min":0.27500000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":9.8200000000000003,"5min":9.8200000000000003,"15min":14.779},"last":0.35199999999999998}]},{"osd":2,"last update":"Fri Oct 8 19:40:23 2021","interfaces":[{"interface":"back","average":{"1min":6.5380000000000003,"5min":2.7690000000000001,"15min":2.1789999999999998},"min":{"1min":0.27500000000000002,"5min":0.26000000000000001,"15min":0.251},"max":{"1min":95.846000000000004,"5min":95.846000000000004,"15min":95.846000000000004},"last":1.026},{"interface":"front","average":{"1min":6.6109999999999998,"5min":2.9060000000000001,"15min":2.4660000000000002},"min":{"1min":0.252,"5min":0.252,"15min":0.245},"max":{"1min":95.683999999999997,"5min":95.683999999999997,"15min":95.683999999999997},"last":0.442}]},{"osd":3,"last update":"Fri Oct 8 19:40:23 2021","interfaces":[{"interface":"back","average":{"1min":7.3170000000000002,"5min":2.9199999999999999,"15min":2.133},"min":{"1min":0.44600000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":96.522000000000006,"5min":96.522000000000006,"15min":96.522000000000006},"last":0.52400000000000002},{"interface":"front","average":{"1min":6.7869999999999999,"5min":3.1669999999999998,"15min":2.0750000000000002},"min":{"1min":0.31900000000000001,"5min":0.317,"15min":0.28000000000000003},"max":{"1min":96.728999999999999,"5min":96.728999999999999,"15min":96.728999999999999},"last":0.48799999999999999}]},{"osd":4,"last update":"Fri Oct 8 19:40:23 2021","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.4099999999999999,"15min":1.1519999999999999},"min":{"1min":0.28199999999999997,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":6.4059999999999997,"5min":6.4059999999999997,"15min":24.516999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.6399999999999999,"15min":1.417},"min":{"1min":0.315,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":5.577,"5min":9.9079999999999995,"15min":69.593999999999994},"last":0.71599999999999997}]},{"osd":5,"last update":"Fri Oct 8 19:40:23 2021","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.754,"15min":1.8879999999999999},"min":{"1min":0.308,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":6.4509999999999996,"5min":13.955,"15min":107.485},"last":0.65500000000000003},{"interface":"front","average":{"1min":1.361,"5min":1.647,"15min":2.1019999999999999},"min":{"1min":0.28399999999999997,"5min":0.251,"15min":0.251},"max":{"1min":5.4900000000000002,"5min":7.4900000000000002,"15min":107.90300000000001},"last":0.96099999999999997}]},{"osd":7,"last update":"Fri Oct 8 19:40:56 2021","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.6499999999999999,"15min":1.2010000000000001},"min":{"1min":0.30399999999999999,"5min":0.29399999999999998,"15min":0.27800000000000002},"max":{"1min":3.75,"5min":8.8840000000000003,"15min":8.8840000000000003},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.8879999999999999,"5min":1.784,"15min":1.405},"min":{"1min":0.36099999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":6.3719999999999999,"5min":8.3740000000000006,"15min":15.962},"last":0.58299999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575113,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2887740,"kb_used_data":2464756,"kb_used_omap":0,"kb_used_meta":422976,"kb_avail":90857412,"statfs":{"total":95995035648,"available":93037989888,"internally_reserved":0,"allocated":2523910144,"data_stored":2523491197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":433127424},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:41:08 2021","interfaces":[{"interface":"back","average":{"1min":2.302,"5min":2.839,"15min":3.194},"min":{"1min":0.221,"5min":0.20100000000000001,"15min":0.188},"max":{"1min":16.417000000000002,"5min":81.459000000000003,"15min":126.256},"last":0.68799999999999994},{"interface":"front","average":{"1min":3.4460000000000002,"5min":3.395,"15min":3.6230000000000002},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.17799999999999999},"max":{"1min":10.917,"5min":81.853999999999999,"15min":126.176},"last":5.9189999999999996}]},{"osd":2,"last update":"Fri Oct 8 19:40:31 2021","interfaces":[{"interface":"back","average":{"1min":2.3300000000000001,"5min":1.796,"15min":2.335},"min":{"1min":0.252,"5min":0.192,"15min":0.192},"max":{"1min":5.327,"5min":11.497,"15min":102.395},"last":0.71799999999999997},{"interface":"front","average":{"1min":1.913,"5min":1.8200000000000001,"15min":2.7309999999999999},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":7.7350000000000003,"5min":7.7350000000000003,"15min":102.50700000000001},"last":5.8869999999999996}]},{"osd":3,"last update":"Fri Oct 8 19:40:45 2021","interfaces":[{"interface":"back","average":{"1min":2.6549999999999998,"5min":1.8300000000000001,"15min":2.7909999999999999},"min":{"1min":0.371,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":16.186,"5min":16.186,"15min":105.836},"last":6.0140000000000002},{"interface":"front","average":{"1min":1.71,"5min":1.722,"15min":2.6480000000000001},"min":{"1min":0.33700000000000002,"5min":0.27700000000000002,"15min":0.22900000000000001},"max":{"1min":7.1829999999999998,"5min":9.8460000000000001,"15min":106.12},"last":0.875}]},{"osd":4,"last update":"Fri Oct 8 19:40:50 2021","interfaces":[{"interface":"back","average":{"1min":1.6759999999999999,"5min":1.4550000000000001,"15min":1.958},"min":{"1min":0.29499999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":4.4740000000000002,"5min":6.0659999999999998,"15min":103.538},"last":0.311},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.619,"15min":1.8280000000000001},"min":{"1min":0.311,"5min":0.29599999999999999,"15min":0.254},"max":{"1min":4.3129999999999997,"5min":13.9,"15min":102.67100000000001},"last":0.74299999999999999}]},{"osd":5,"last update":"Fri Oct 8 19:40:21 2021","interfaces":[{"interface":"back","average":{"1min":1.8600000000000001,"5min":1.583,"15min":3.306},"min":{"1min":0.29899999999999999,"5min":0.28599999999999998,"15min":0.27300000000000002},"max":{"1min":5.8109999999999999,"5min":6.9569999999999999,"15min":262.14100000000002},"last":5.9370000000000003},{"interface":"front","average":{"1min":1.7849999999999999,"5min":1.641,"15min":3.0310000000000001},"min":{"1min":0.34300000000000003,"5min":0.318,"15min":0.30099999999999999},"max":{"1min":5.9770000000000003,"5min":11.414999999999999,"15min":261.959},"last":0.77000000000000002}]},{"osd":6,"last update":"Fri Oct 8 19:40:32 2021","interfaces":[{"interface":"back","average":{"1min":1.583,"5min":1.734,"15min":2.181},"min":{"1min":0.32700000000000001,"5min":0.316,"15min":0.316},"max":{"1min":10.194000000000001,"5min":13.837,"15min":103.73},"last":0.375},{"interface":"front","average":{"1min":1.992,"5min":1.641,"15min":2.222},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":7.3490000000000002,"5min":7.3490000000000002,"15min":102.753},"last":5.9509999999999996}]},{"osd":7,"last update":"Fri Oct 8 19:40:50 2021","interfaces":[{"interface":"back","average":{"1min":2.2269999999999999,"5min":1.7609999999999999,"15min":2.597},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.316},"max":{"1min":5.4349999999999996,"5min":7.0979999999999999,"15min":106.011},"last":5.9729999999999999},{"interface":"front","average":{"1min":1.383,"5min":1.5169999999999999,"15min":2.2789999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.34200000000000003},"max":{"1min":5.8600000000000003,"5min":9.7720000000000002,"15min":103.78400000000001},"last":0.79400000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738636,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1995868,"kb_used_data":1580628,"kb_used_omap":0,"kb_used_meta":415168,"kb_avail":91749284,"statfs":{"total":95995035648,"available":93951266816,"internally_reserved":0,"allocated":1618563072,"data_stored":1618176064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":425132032},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 8 19:41:10 2021","interfaces":[{"interface":"back","average":{"1min":7.9470000000000001,"5min":3.137,"15min":2.746},"min":{"1min":0.19600000000000001,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":101.68600000000001,"5min":101.68600000000001,"15min":101.68600000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":8.4179999999999993,"5min":3.1160000000000001,"15min":2.843},"min":{"1min":0.47299999999999998,"5min":0.19900000000000001,"15min":0.19800000000000001},"max":{"1min":101.732,"5min":101.732,"15min":101.732},"last":2.5990000000000002}]},{"osd":2,"last update":"Fri Oct 8 19:40:25 2021","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.663,"15min":2.0209999999999999},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":6.3659999999999997,"5min":9.8030000000000008,"15min":14.814},"last":0.25600000000000001},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.7809999999999999,"15min":1.9610000000000001},"min":{"1min":0.28799999999999998,"5min":0.21099999999999999,"15min":0.20000000000000001},"max":{"1min":3.6640000000000001,"5min":10.509,"15min":10.509},"last":4.3380000000000001}]},{"osd":3,"last update":"Fri Oct 8 19:40:47 2021","interfaces":[{"interface":"back","average":{"1min":3.4980000000000002,"5min":2.0409999999999999,"15min":2.3580000000000001},"min":{"1min":0.41199999999999998,"5min":0.218,"15min":0.217},"max":{"1min":12.782,"5min":12.782,"15min":15.090999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":1.9730000000000001,"5min":1.8680000000000001,"15min":1.9790000000000001},"min":{"1min":0.25800000000000001,"5min":0.221,"15min":0.20899999999999999},"max":{"1min":4.4299999999999997,"5min":10.026999999999999,"15min":22.016999999999999},"last":4.6600000000000001}]},{"osd":4,"last update":"Fri Oct 8 19:41:10 2021","interfaces":[{"interface":"back","average":{"1min":1.8069999999999999,"5min":1.865,"15min":1.861},"min":{"1min":0.32600000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":7.6349999999999998,"5min":12.135,"15min":16.805},"last":0.32700000000000001},{"interface":"front","average":{"1min":1.5960000000000001,"5min":1.591,"15min":1.554},"min":{"1min":0.28499999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":4.4480000000000004,"5min":7.8339999999999996,"15min":11.823},"last":0.36799999999999999}]},{"osd":5,"last update":"Fri Oct 8 19:40:15 2021","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.5860000000000001,"15min":1.5700000000000001},"min":{"1min":0.32100000000000001,"5min":0.28199999999999997,"15min":0.24099999999999999},"max":{"1min":2.798,"5min":9.9730000000000008,"15min":15.56},"last":4.4109999999999996},{"interface":"front","average":{"1min":1.611,"5min":1.9950000000000001,"15min":1.9650000000000001},"min":{"1min":0.32100000000000001,"5min":0.30599999999999999,"15min":0.28599999999999998},"max":{"1min":3.8759999999999999,"5min":12.095000000000001,"15min":15.484999999999999},"last":0.38600000000000001}]},{"osd":6,"last update":"Fri Oct 8 19:40:33 2021","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.653,"15min":1.6930000000000001},"min":{"1min":0.32400000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":3.8050000000000002,"5min":5.931,"15min":11.869},"last":0.40600000000000003},{"interface":"front","average":{"1min":1.7669999999999999,"5min":1.875,"15min":1.736},"min":{"1min":0.39700000000000002,"5min":0.32100000000000001,"15min":0.28199999999999997},"max":{"1min":3.694,"5min":10.002000000000001,"15min":10.002000000000001},"last":4.383}]},{"osd":7,"last update":"Fri Oct 8 19:40:47 2021","interfaces":[{"interface":"back","average":{"1min":1.6220000000000001,"5min":1.9830000000000001,"15min":1.96},"min":{"1min":0.42199999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":3.8999999999999999,"5min":13.214,"15min":13.214},"last":0.438},{"interface":"front","average":{"1min":1.5700000000000001,"5min":1.6399999999999999,"15min":1.8280000000000001},"min":{"1min":0.44,"5min":0.315,"15min":0.315},"max":{"1min":3.8290000000000002,"5min":8.7609999999999992,"15min":11.898999999999999},"last":0.45200000000000001}]}]},{"osd":2,"up_from":18,"seq":77309411588,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2224724,"kb_used_data":1871052,"kb_used_omap":0,"kb_used_meta":353664,"kb_avail":91520428,"statfs":{"total":95995035648,"available":93716918272,"internally_reserved":0,"allocated":1915957248,"data_stored":1915578865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":362151936},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,5],"upper_bound":8},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:40:21 2021","interfaces":[{"interface":"back","average":{"1min":1.6950000000000001,"5min":1.8779999999999999,"15min":2.4039999999999999},"min":{"1min":0.21299999999999999,"5min":0.19600000000000001,"15min":0.184},"max":{"1min":4.8959999999999999,"5min":10.83,"15min":61.670999999999999},"last":1.3700000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":1.5840000000000001,"15min":2.4470000000000001},"min":{"1min":0.224,"5min":0.193,"15min":0.17999999999999999},"max":{"1min":1.778,"5min":11.207000000000001,"15min":65.284999999999997},"last":0.27400000000000002}]},{"osd":1,"last update":"Fri Oct 8 19:40:21 2021","interfaces":[{"interface":"back","average":{"1min":2.0510000000000002,"5min":1.8280000000000001,"15min":2.6960000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.192},"max":{"1min":9.7609999999999992,"5min":10.218999999999999,"15min":63.738},"last":4.0960000000000001},{"interface":"front","average":{"1min":1.917,"5min":1.706,"15min":2.8769999999999998},"min":{"1min":0.255,"5min":0.252,"15min":0.21299999999999999},"max":{"1min":7.4050000000000002,"5min":11.988,"15min":63.619999999999997},"last":0.23300000000000001}]},{"osd":3,"last update":"Fri Oct 8 19:40:24 2021","interfaces":[{"interface":"back","average":{"1min":2.1789999999999998,"5min":2.5510000000000002,"15min":3.177},"min":{"1min":0.27600000000000002,"5min":0.245,"15min":0.21199999999999999},"max":{"1min":8.5459999999999994,"5min":67.198999999999998,"15min":67.198999999999998},"last":0.45900000000000002},{"interface":"front","average":{"1min":2.1619999999999999,"5min":2.5659999999999998,"15min":3.0350000000000001},"min":{"1min":0.26500000000000001,"5min":0.22900000000000001,"15min":0.21299999999999999},"max":{"1min":10.635999999999999,"5min":66.963999999999999,"15min":66.963999999999999},"last":1.248}]},{"osd":4,"last update":"Fri Oct 8 19:40:50 2021","interfaces":[{"interface":"back","average":{"1min":4.4160000000000004,"5min":2.367,"15min":1.831},"min":{"1min":0.38900000000000001,"5min":0.315,"15min":0.26900000000000002},"max":{"1min":52.482999999999997,"5min":52.482999999999997,"15min":52.482999999999997},"last":0.29699999999999999},{"interface":"front","average":{"1min":4.3760000000000003,"5min":2.5,"15min":1.835},"min":{"1min":0.33000000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":51.015000000000001,"5min":51.015000000000001,"15min":51.015000000000001},"last":0.33700000000000002}]},{"osd":5,"last update":"Fri Oct 8 19:40:21 2021","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.8109999999999999,"15min":1.7969999999999999},"min":{"1min":0.44500000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":7.0590000000000002,"5min":11.956,"15min":15.087999999999999},"last":0.311},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.5740000000000001,"15min":1.7709999999999999},"min":{"1min":0.311,"5min":0.29199999999999998,"15min":0.27600000000000002},"max":{"1min":3.7669999999999999,"5min":8.1769999999999996,"15min":26.094000000000001},"last":4.0309999999999997}]},{"osd":6,"last update":"Fri Oct 8 19:40:24 2021","interfaces":[{"interface":"back","average":{"1min":4.4859999999999998,"5min":2.4169999999999998,"15min":1.8480000000000001},"min":{"1min":0.34899999999999998,"5min":0.33800000000000002,"15min":0.28000000000000003},"max":{"1min":55.970999999999997,"5min":55.970999999999997,"15min":55.970999999999997},"last":0.57099999999999995},{"interface":"front","average":{"1min":4.6619999999999999,"5min":2.4390000000000001,"15min":2.0129999999999999},"min":{"1min":0.36899999999999999,"5min":0.31,"15min":0.31},"max":{"1min":56.433,"5min":56.433,"15min":56.433},"last":1.393}]},{"osd":7,"last update":"Fri Oct 8 19:40:50 2021","interfaces":[{"interface":"back","average":{"1min":4.423,"5min":2.359,"15min":2.5049999999999999},"min":{"1min":0.41099999999999998,"5min":0.37,"15min":0.32200000000000001},"max":{"1min":52.610999999999997,"5min":52.610999999999997,"15min":136.00200000000001},"last":0.38500000000000001},{"interface":"front","average":{"1min":4.0739999999999998,"5min":2.339,"15min":2.4609999999999999},"min":{"1min":0.40400000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":51.100999999999999,"5min":51.100999999999999,"15min":133.26300000000001},"last":4.0709999999999997}]}]},{"osd":3,"up_from":24,"seq":103079215362,"num_pgs":77,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2656820,"kb_used_data":2209260,"kb_used_omap":0,"kb_used_meta":447488,"kb_avail":91088332,"statfs":{"total":95995035648,"available":93274451968,"internally_reserved":0,"allocated":2262282240,"data_stored":2261872075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":458227712},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,3,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:40:40 2021","interfaces":[{"interface":"back","average":{"1min":2.0550000000000002,"5min":1.631,"15min":2.161},"min":{"1min":0.219,"5min":0.187,"15min":0.17000000000000001},"max":{"1min":12.51,"5min":12.51,"15min":17.553999999999998},"last":1.4219999999999999},{"interface":"front","average":{"1min":2.6160000000000001,"5min":1.9219999999999999,"15min":2.105},"min":{"1min":0.20999999999999999,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":12.93,"5min":12.93,"15min":12.93},"last":1.7070000000000001}]},{"osd":1,"last update":"Fri Oct 8 19:40:40 2021","interfaces":[{"interface":"back","average":{"1min":2.3580000000000001,"5min":1.619,"15min":2.0800000000000001},"min":{"1min":0.249,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":7.9640000000000004,"5min":8.8610000000000007,"15min":37.271999999999998},"last":5.3339999999999996},{"interface":"front","average":{"1min":1.98,"5min":1.6890000000000001,"15min":2.0449999999999999},"min":{"1min":0.22500000000000001,"5min":0.223,"15min":0.19},"max":{"1min":8.3810000000000002,"5min":9.0229999999999997,"15min":37.033000000000001},"last":0.437}]},{"osd":2,"last update":"Fri Oct 8 19:40:40 2021","interfaces":[{"interface":"back","average":{"1min":2.0910000000000002,"5min":1.758,"15min":2.0110000000000001},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":8.359,"5min":10.086,"15min":32.277000000000001},"last":0.501},{"interface":"front","average":{"1min":1.361,"5min":1.5509999999999999,"15min":1.9650000000000001},"min":{"1min":0.252,"5min":0.224,"15min":0.224},"max":{"1min":11.970000000000001,"5min":11.970000000000001,"15min":23.189},"last":1.546}]},{"osd":4,"last update":"Fri Oct 8 19:40:54 2021","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.536,"15min":1.7270000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.25600000000000001},"max":{"1min":7.8109999999999999,"5min":8.7940000000000005,"15min":18.064},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.909,"5min":1.9419999999999999,"15min":1.887},"min":{"1min":0.309,"5min":0.28599999999999998,"15min":0.26900000000000002},"max":{"1min":4.5190000000000001,"5min":8.9009999999999998,"15min":18.692},"last":1.6120000000000001}]},{"osd":5,"last update":"Fri Oct 8 19:41:13 2021","interfaces":[{"interface":"back","average":{"1min":2.0790000000000002,"5min":1.609,"15min":1.8300000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":10.055,"5min":10.055,"15min":75.397000000000006},"last":0.47199999999999998},{"interface":"front","average":{"1min":1.796,"5min":1.8080000000000001,"15min":2.234},"min":{"1min":0.32600000000000001,"5min":0.309,"15min":0.309},"max":{"1min":7.9580000000000002,"5min":8.7579999999999991,"15min":75.680000000000007},"last":1.5109999999999999}]},{"osd":6,"last update":"Fri Oct 8 19:40:25 2021","interfaces":[{"interface":"back","average":{"1min":10.31,"5min":3.4430000000000001,"15min":2.492},"min":{"1min":0.32800000000000001,"5min":0.32600000000000001,"15min":0.28599999999999998},"max":{"1min":202.99799999999999,"5min":202.99799999999999,"15min":202.99799999999999},"last":1.649},{"interface":"front","average":{"1min":10.528,"5min":3.4990000000000001,"15min":2.3109999999999999},"min":{"1min":0.35399999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":202.31200000000001,"5min":202.31200000000001,"15min":202.31200000000001},"last":0.64600000000000002}]},{"osd":7,"last update":"Fri Oct 8 19:40:54 2021","interfaces":[{"interface":"back","average":{"1min":2.645,"5min":2.0859999999999999,"15min":1.915},"min":{"1min":0.48899999999999999,"5min":0.35799999999999998,"15min":0.32200000000000001},"max":{"1min":13.587,"5min":13.587,"15min":13.587},"last":1.675},{"interface":"front","average":{"1min":2.7229999999999999,"5min":2.0070000000000001,"15min":1.7589999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":13.644,"5min":13.644,"15min":13.644},"last":0.66800000000000004}]}]},{"osd":4,"up_from":30,"seq":128849019132,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1557872,"kb_used_data":1240296,"kb_used_omap":0,"kb_used_meta":317568,"kb_avail":92187280,"statfs":{"total":95995035648,"available":94399774720,"internally_reserved":0,"allocated":1270063104,"data_stored":1269657038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":325189632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:40:52 2021","interfaces":[{"interface":"back","average":{"1min":1.488,"5min":2.0710000000000002,"15min":1.881},"min":{"1min":0.22500000000000001,"5min":0.20999999999999999,"15min":0.185},"max":{"1min":4.3090000000000002,"5min":58.609999999999999,"15min":82.109999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":1.714,"5min":1.8959999999999999,"15min":1.8959999999999999},"min":{"1min":0.33000000000000002,"5min":0.222,"15min":0.222},"max":{"1min":4.7709999999999999,"5min":58.329999999999998,"15min":82.025999999999996},"last":1.2110000000000001}]},{"osd":1,"last update":"Fri Oct 8 19:40:52 2021","interfaces":[{"interface":"back","average":{"1min":1.8680000000000001,"5min":2.2080000000000002,"15min":2.4940000000000002},"min":{"1min":0.26500000000000001,"5min":0.215,"15min":0.215},"max":{"1min":8.8179999999999996,"5min":65.332999999999998,"15min":122.422},"last":2.0870000000000002},{"interface":"front","average":{"1min":1.905,"5min":2.077,"15min":2.2949999999999999},"min":{"1min":0.255,"5min":0.247,"15min":0.23599999999999999},"max":{"1min":6.1689999999999996,"5min":62.140000000000001,"15min":123.122},"last":2.1850000000000001}]},{"osd":2,"last update":"Fri Oct 8 19:40:52 2021","interfaces":[{"interface":"back","average":{"1min":1.927,"5min":2.4359999999999999,"15min":1.8280000000000001},"min":{"1min":0.30599999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":7.8280000000000003,"5min":60.082999999999998,"15min":60.082999999999998},"last":1.665},{"interface":"front","average":{"1min":1.7230000000000001,"5min":2.3650000000000002,"15min":1.778},"min":{"1min":0.33100000000000002,"5min":0.27000000000000002,"15min":0.221},"max":{"1min":7.7439999999999998,"5min":60.539000000000001,"15min":60.539000000000001},"last":1.587}]},{"osd":3,"last update":"Fri Oct 8 19:40:52 2021","interfaces":[{"interface":"back","average":{"1min":1.5209999999999999,"5min":2.5009999999999999,"15min":2.2879999999999998},"min":{"1min":0.36599999999999999,"5min":0.27700000000000002,"15min":0.26500000000000001},"max":{"1min":4.2110000000000003,"5min":59.137,"15min":59.137},"last":1.5589999999999999},{"interface":"front","average":{"1min":2.8580000000000001,"5min":2.359,"15min":2.0270000000000001},"min":{"1min":0.32300000000000001,"5min":0.27000000000000002,"15min":0.254},"max":{"1min":11.893000000000001,"5min":59.777000000000001,"15min":59.777000000000001},"last":4.3170000000000002}]},{"osd":5,"last update":"Fri Oct 8 19:40:12 2021","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":1.179,"15min":1.0680000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":3.4489999999999998,"5min":10.477,"15min":10.477},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.995,"15min":0.93899999999999995},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.22900000000000001},"max":{"1min":3.0470000000000002,"5min":5.4770000000000003,"15min":8.1319999999999997},"last":0.28999999999999998}]},{"osd":6,"last update":"Fri Oct 8 19:40:28 2021","interfaces":[{"interface":"back","average":{"1min":7.194,"5min":5.3890000000000002,"15min":2.3980000000000001},"min":{"1min":0.35699999999999998,"5min":0.28699999999999998,"15min":0.26400000000000001},"max":{"1min":113.14700000000001,"5min":171.69800000000001,"15min":171.69800000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":7.3010000000000002,"5min":5.5350000000000001,"15min":2.4870000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.247},"max":{"1min":112.651,"5min":171.613,"15min":171.613},"last":0.67600000000000005}]},{"osd":7,"last update":"Fri Oct 8 19:40:52 2021","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.0469999999999999,"15min":0.97099999999999997},"min":{"1min":0.32700000000000001,"5min":0.29499999999999998,"15min":0.29099999999999998},"max":{"1min":3.0720000000000001,"5min":5.2009999999999996,"15min":8.0050000000000008},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":1.1539999999999999,"15min":1.028},"min":{"1min":0.32100000000000001,"5min":0.31900000000000001,"15min":0.26800000000000002},"max":{"1min":1.9319999999999999,"5min":7.702,"15min":7.702},"last":0.45600000000000002}]}]},{"osd":5,"up_from":38,"seq":163208757496,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1624864,"kb_used_data":1246360,"kb_used_omap":0,"kb_used_meta":378496,"kb_avail":92120288,"statfs":{"total":95995035648,"available":94331174912,"internally_reserved":0,"allocated":1276272640,"data_stored":1275883660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":387579904},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:40:18 2021","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":1.794,"15min":1.5149999999999999},"min":{"1min":0.20899999999999999,"5min":0.20699999999999999,"15min":0.20300000000000001},"max":{"1min":3.4470000000000001,"5min":43.332999999999998,"15min":43.332999999999998},"last":2.6309999999999998},{"interface":"front","average":{"1min":0.82099999999999995,"5min":1.9710000000000001,"15min":1.6699999999999999},"min":{"1min":0.251,"5min":0.216,"15min":0.216},"max":{"1min":2.3570000000000002,"5min":42.637,"15min":42.637},"last":1.9279999999999999}]},{"osd":1,"last update":"Fri Oct 8 19:40:18 2021","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.6279999999999999,"15min":1.917},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":3.5510000000000002,"5min":8.9990000000000006,"15min":94.558999999999997},"last":4.2300000000000004},{"interface":"front","average":{"1min":1.528,"5min":1.3540000000000001,"15min":1.772},"min":{"1min":0.29899999999999999,"5min":0.25900000000000001,"15min":0.23100000000000001},"max":{"1min":5.0579999999999998,"5min":6.8570000000000002,"15min":94.456999999999994},"last":0.28100000000000003}]},{"osd":2,"last update":"Fri Oct 8 19:40:18 2021","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.3120000000000001,"15min":1.649},"min":{"1min":0.30099999999999999,"5min":0.249,"15min":0.249},"max":{"1min":2.7669999999999999,"5min":22.931999999999999,"15min":29.398},"last":2.5960000000000001},{"interface":"front","average":{"1min":1.5840000000000001,"5min":1.823,"15min":1.802},"min":{"1min":0.251,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":6.9180000000000001,"5min":22.963999999999999,"15min":29.387},"last":2.4319999999999999}]},{"osd":3,"last update":"Fri Oct 8 19:40:18 2021","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.3049999999999999,"15min":1.736},"min":{"1min":0.30099999999999999,"5min":0.28000000000000003,"15min":0.27000000000000002},"max":{"1min":4.2279999999999998,"5min":9.5899999999999999,"15min":12.356},"last":3.399},{"interface":"front","average":{"1min":1.9059999999999999,"5min":1.9079999999999999,"15min":2.02},"min":{"1min":0.37,"5min":0.29999999999999999,"15min":0.218},"max":{"1min":4.633,"5min":8.9920000000000009,"15min":21.504000000000001},"last":2.4729999999999999}]},{"osd":4,"last update":"Fri Oct 8 19:40:18 2021","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.04,"15min":0.89800000000000002},"min":{"1min":0.25800000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":3.839,"5min":9.1600000000000001,"15min":9.2759999999999998},"last":1.6799999999999999},{"interface":"front","average":{"1min":0.95799999999999996,"5min":1.1739999999999999,"15min":0.93000000000000005},"min":{"1min":0.28299999999999997,"5min":0.26700000000000002,"15min":0.25900000000000001},"max":{"1min":2.8580000000000001,"5min":11.231,"15min":11.231},"last":2.782}]},{"osd":6,"last update":"Fri Oct 8 19:40:27 2021","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.327,"15min":1.042},"min":{"1min":0.32500000000000001,"5min":0.29399999999999998,"15min":0.255},"max":{"1min":5.2809999999999997,"5min":11.192,"15min":11.192},"last":1.657},{"interface":"front","average":{"1min":0.745,"5min":1.296,"15min":1.014},"min":{"1min":0.32100000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":4.032,"5min":11.259,"15min":11.259},"last":2.8149999999999999}]},{"osd":7,"last update":"Fri Oct 8 19:40:48 2021","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.143,"15min":1.111},"min":{"1min":0.34499999999999997,"5min":0.22,"15min":0.22},"max":{"1min":5.8280000000000003,"5min":5.8280000000000003,"15min":29.946999999999999},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.92400000000000004,"5min":1.196,"15min":1.1830000000000001},"min":{"1min":0.35499999999999998,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":2.6240000000000001,"5min":12.970000000000001,"15min":29.294},"last":1.623}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":266240,"data_stored":262688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":327680,"data_stored":327680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1604845568,"data_stored":1604845568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2520121344,"data_stored":2520121344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1910444032,"data_stored":1910439960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2234122240,"data_stored":2234122240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1261441024,"data_stored":1261436952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1274347520,"data_stored":1274347520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":2577666048,"data_stored":2577661976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1908342784,"data_stored":1908342784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-10-08T19:41:19.236 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph pg dump --format=json 2021-10-08T19:41:19.348 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:41:19.353 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:19.354 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:41:19.455 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:41:19.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:19 smithi097 ceph-mon[41966]: from='client.26293 v1:172.21.15.97:0/2331503638' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:41:19.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:19 smithi097 ceph-mon[41966]: 5.2 scrub ok 2021-10-08T19:41:19.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:19 smithi097 ceph-mon[41966]: 2.1 scrub ok 2021-10-08T19:41:19.474 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:19 smithi097 ceph-mon[41966]: 5.7 scrub ok 2021-10-08T19:41:19.474 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:19 smithi097 ceph-mon[32687]: 5.2 scrub ok 2021-10-08T19:41:19.474 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:19 smithi097 ceph-mon[32687]: 2.1 scrub ok 2021-10-08T19:41:19.475 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:19 smithi097 ceph-mon[32687]: 5.7 scrub ok 2021-10-08T19:41:19.483 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:19 smithi117 ceph-mon[34585]: from='client.26293 v1:172.21.15.97:0/2331503638' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:41:19.483 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:19 smithi117 ceph-mon[34585]: 5.2 scrub ok 2021-10-08T19:41:19.483 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:19 smithi117 ceph-mon[34585]: 2.1 scrub ok 2021-10-08T19:41:19.484 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:19 smithi117 ceph-mon[34585]: 5.7 scrub ok 2021-10-08T19:41:19.484 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:19.538 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:41:19.542 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:19.543 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:41:19.645 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:41:19.715 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:20.183 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:41:20.193 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:20.194 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:41:20.195 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:41:20.223 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:41:20.261 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:41:20.296 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:41:20.372 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:20.474 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:20 smithi097 ceph-mon[41966]: pgmap v996: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 4.6 GiB data, 17 GiB used, 699 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.08k op/s 2021-10-08T19:41:20.475 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:20 smithi097 ceph-mon[32687]: pgmap v996: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 4.6 GiB data, 17 GiB used, 699 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.08k op/s 2021-10-08T19:41:20.584 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:41:20.590 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:20.591 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:41:20.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:20 smithi117 ceph-mon[34585]: pgmap v996: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 4.6 GiB data, 17 GiB used, 699 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.08k op/s 2021-10-08T19:41:20.692 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:41:20.758 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:21.020 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:41:21.026 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:21.027 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:41:21.128 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:41:21.183 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:21.227 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:41:21.276 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:41:21.315 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:41:21.352 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:41:21.383 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:41:21.405 INFO:journalctl@ceph.osd.7.smithi117.stdout:Oct 08 19:41:21 smithi117 conmon[54364]: 2021-10-08T19:41:21.036+0000 7ff38803d700 -1 osd.7 pg_epoch: 478 pg[3.15( empty local-lis/les=236/237 n=0 ec=131/60 lis/c=236/236 les/c/f=237/237/0 sis=236) [7,3,4] r=0 lpr=236 crt=0'0 mlcod 0'0 active+clean] scrubber pg(3.15) handle_scrub_reserve_grant: received unsolicited reservation grant from osd 3 (0x55a62878fce0) 2021-10-08T19:41:21.418 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:41:21.424 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:21.426 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:41:21.432 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:41:21.484 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:41:21.516 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:41:21.528 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:41:21.530 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'false' 2021-10-08T19:41:21.530 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'false' 2021-10-08T19:41:21.531 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'false' 2021-10-08T19:41:21.531 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'false' 2021-10-08T19:41:21.532 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'false' 2021-10-08T19:41:21.532 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'false' 2021-10-08T19:41:21.532 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'false' 2021-10-08T19:41:21.533 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'false' 2021-10-08T19:41:21.562 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:21.626 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:41:21.628 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:21.629 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:41:21.730 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:41:21.764 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:21.834 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:41:21.836 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:21.837 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:41:21.939 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:41:21.984 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:22.020 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:21 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:41:22.020 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:21 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:41:22.020 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:21 smithi097 ceph-mon[41966]: 1.6 scrub ok 2021-10-08T19:41:22.021 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:21 smithi097 ceph-mon[41966]: pgmap v997: 188 pgs: 2 active+clean+scrubbing, 186 active+clean; 4.4 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.09k op/s 2021-10-08T19:41:22.021 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:21 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:41:22.021 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:21 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:41:22.021 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:21 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2507999164' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:41:22.022 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:21 smithi097 ceph-mon[41966]: osdmap e479: 8 total, 8 up, 8 in 2021-10-08T19:41:22.022 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:21 smithi097 ceph-mon[41966]: 11.7 scrub ok 2021-10-08T19:41:22.022 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:21 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:41:22.022 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:21 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:41:22.023 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:21 smithi097 ceph-mon[32687]: 1.6 scrub ok 2021-10-08T19:41:22.023 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:21 smithi097 ceph-mon[32687]: pgmap v997: 188 pgs: 2 active+clean+scrubbing, 186 active+clean; 4.4 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.09k op/s 2021-10-08T19:41:22.023 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:21 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:41:22.023 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:21 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:41:22.023 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:21 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2507999164' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:41:22.024 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:21 smithi097 ceph-mon[32687]: osdmap e479: 8 total, 8 up, 8 in 2021-10-08T19:41:22.024 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:21 smithi097 ceph-mon[32687]: 11.7 scrub ok 2021-10-08T19:41:22.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:21 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:41:22.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:21 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:41:22.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:21 smithi117 ceph-mon[34585]: 1.6 scrub ok 2021-10-08T19:41:22.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:21 smithi117 ceph-mon[34585]: pgmap v997: 188 pgs: 2 active+clean+scrubbing, 186 active+clean; 4.4 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.09k op/s 2021-10-08T19:41:22.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:21 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:41:22.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:21 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:41:22.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:21 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2507999164' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:41:22.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:21 smithi117 ceph-mon[34585]: osdmap e479: 8 total, 8 up, 8 in 2021-10-08T19:41:22.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:21 smithi117 ceph-mon[34585]: 11.7 scrub ok 2021-10-08T19:41:22.923 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:22 smithi097 ceph-mon[32687]: 4.4 scrub ok 2021-10-08T19:41:22.923 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:22 smithi097 ceph-mon[32687]: 3.10 scrub ok 2021-10-08T19:41:22.923 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:22 smithi097 ceph-mon[32687]: 5.1b scrub ok 2021-10-08T19:41:22.924 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:41:22 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:41:22] "GET /metrics HTTP/1.1" 200 155940 "" "Prometheus/2.18.1" 2021-10-08T19:41:23.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:22 smithi097 ceph-mon[41966]: 4.4 scrub ok 2021-10-08T19:41:23.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:22 smithi097 ceph-mon[41966]: 3.10 scrub ok 2021-10-08T19:41:23.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:22 smithi097 ceph-mon[41966]: 5.1b scrub ok 2021-10-08T19:41:23.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:22 smithi117 ceph-mon[34585]: 4.4 scrub ok 2021-10-08T19:41:23.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:22 smithi117 ceph-mon[34585]: 3.10 scrub ok 2021-10-08T19:41:23.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:22 smithi117 ceph-mon[34585]: 5.1b scrub ok 2021-10-08T19:41:23.909 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:41:23.915 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:23.916 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:41:24.020 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:41:24.071 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:24.156 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:41:23 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:41:23] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:41:24.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:23 smithi117 ceph-mon[34585]: 2.2 scrub ok 2021-10-08T19:41:24.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:23 smithi117 ceph-mon[34585]: pgmap v999: 188 pgs: 2 active+clean+scrubbing, 186 active+clean; 4.4 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 686 op/s 2021-10-08T19:41:24.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:23 smithi097 ceph-mon[32687]: 2.2 scrub ok 2021-10-08T19:41:24.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:23 smithi097 ceph-mon[32687]: pgmap v999: 188 pgs: 2 active+clean+scrubbing, 186 active+clean; 4.4 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 686 op/s 2021-10-08T19:41:24.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:23 smithi097 ceph-mon[41966]: 2.2 scrub ok 2021-10-08T19:41:24.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:23 smithi097 ceph-mon[41966]: pgmap v999: 188 pgs: 2 active+clean+scrubbing, 186 active+clean; 4.4 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 686 op/s 2021-10-08T19:41:24.981 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:41:24.985 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:24.988 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:41:25.091 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:41:25.126 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:25.200 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:41:25.202 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:25.204 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:41:25.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:24 smithi097 ceph-mon[32687]: 2.1e scrub ok 2021-10-08T19:41:25.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:24 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:41:25.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:24 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:41:25.225 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:24 smithi097 ceph-mon[41966]: 2.1e scrub ok 2021-10-08T19:41:25.226 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:24 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:41:25.227 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:24 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:41:25.306 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:41:25.375 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:25.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:24 smithi117 ceph-mon[34585]: 2.1e scrub ok 2021-10-08T19:41:25.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:24 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:41:25.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:24 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:41:25.471 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:41:25.477 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:25.480 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:41:25.581 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:41:25.620 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:25.688 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:41:25.690 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:25.690 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:41:25.780 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2021-10-08T19:41:25.780 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:41:25.791 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:41:25.826 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:25.885 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:41:25.889 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:25.890 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:41:25.991 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:41:26.005 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is unset 2021-10-08T19:41:26.006 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2021-10-08T19:41:26.039 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:25 smithi097 ceph-mon[32687]: 2.9 scrub ok 2021-10-08T19:41:26.039 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:25 smithi097 ceph-mon[32687]: osdmap e480: 8 total, 8 up, 8 in 2021-10-08T19:41:26.039 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:25 smithi097 ceph-mon[32687]: pgmap v1001: 188 pgs: 188 active+clean; 4.1 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.36k op/s 2021-10-08T19:41:26.040 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:25 smithi097 ceph-mon[32687]: 5.10 scrub ok 2021-10-08T19:41:26.040 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:25 smithi097 ceph-mon[32687]: 2.19 scrub ok 2021-10-08T19:41:26.040 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:25 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/480535294' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:41:26.040 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:25 smithi097 ceph-mon[32687]: from='client.26299 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:41:26.041 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:25 smithi097 ceph-mon[41966]: 2.9 scrub ok 2021-10-08T19:41:26.041 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:25 smithi097 ceph-mon[41966]: osdmap e480: 8 total, 8 up, 8 in 2021-10-08T19:41:26.042 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:25 smithi097 ceph-mon[41966]: pgmap v1001: 188 pgs: 188 active+clean; 4.1 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.36k op/s 2021-10-08T19:41:26.042 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:25 smithi097 ceph-mon[41966]: 5.10 scrub ok 2021-10-08T19:41:26.042 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:25 smithi097 ceph-mon[41966]: 2.19 scrub ok 2021-10-08T19:41:26.042 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:25 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/480535294' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:41:26.043 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:25 smithi097 ceph-mon[41966]: from='client.26299 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:41:26.043 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:26.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:25 smithi117 ceph-mon[34585]: 2.9 scrub ok 2021-10-08T19:41:26.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:25 smithi117 ceph-mon[34585]: osdmap e480: 8 total, 8 up, 8 in 2021-10-08T19:41:26.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:25 smithi117 ceph-mon[34585]: pgmap v1001: 188 pgs: 188 active+clean; 4.1 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.36k op/s 2021-10-08T19:41:26.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:25 smithi117 ceph-mon[34585]: 5.10 scrub ok 2021-10-08T19:41:26.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:25 smithi117 ceph-mon[34585]: 2.19 scrub ok 2021-10-08T19:41:26.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:25 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/480535294' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:41:26.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:25 smithi117 ceph-mon[34585]: from='client.26299 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:41:26.362 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:41:26.384 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2021-10-08T19:41:27.378 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:26 smithi117 ceph-mon[34585]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:41:27.379 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:26 smithi117 ceph-mon[34585]: Cluster is now healthy 2021-10-08T19:41:27.379 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:26 smithi117 ceph-mon[34585]: from='client.26299 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:41:27.379 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:26 smithi117 ceph-mon[34585]: osdmap e481: 8 total, 8 up, 8 in 2021-10-08T19:41:27.379 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:26 smithi117 ceph-mon[34585]: from='client.16383 v1:172.21.15.97:0/2567449988' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:41:27.474 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:26 smithi097 ceph-mon[32687]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:41:27.475 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:26 smithi097 ceph-mon[32687]: Cluster is now healthy 2021-10-08T19:41:27.475 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:26 smithi097 ceph-mon[32687]: from='client.26299 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:41:27.475 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:26 smithi097 ceph-mon[32687]: osdmap e481: 8 total, 8 up, 8 in 2021-10-08T19:41:27.475 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:26 smithi097 ceph-mon[32687]: from='client.16383 v1:172.21.15.97:0/2567449988' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:41:27.476 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:26 smithi097 ceph-mon[41966]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:41:27.476 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:26 smithi097 ceph-mon[41966]: Cluster is now healthy 2021-10-08T19:41:27.476 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:26 smithi097 ceph-mon[41966]: from='client.26299 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:41:27.476 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:26 smithi097 ceph-mon[41966]: osdmap e481: 8 total, 8 up, 8 in 2021-10-08T19:41:27.477 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:26 smithi097 ceph-mon[41966]: from='client.16383 v1:172.21.15.97:0/2567449988' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:41:27.655 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:41:27 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:41:27.838 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:41:27.842 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:27.843 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:41:27.944 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:41:27.999 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:28.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:28 smithi097 ceph-mon[32687]: pgmap v1003: 188 pgs: 188 active+clean; 4.1 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 900 op/s 2021-10-08T19:41:28.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:28 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:41:28.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:28 smithi097 ceph-mon[41966]: pgmap v1003: 188 pgs: 188 active+clean; 4.1 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 900 op/s 2021-10-08T19:41:28.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:28 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:41:28.284 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:28 smithi117 ceph-mon[34585]: pgmap v1003: 188 pgs: 188 active+clean; 4.1 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 900 op/s 2021-10-08T19:41:28.285 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:28 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:41:28.444 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2021-10-08T19:41:28.556 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:41:28.561 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:28.562 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:41:28.663 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:41:28.675 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:41:28.696 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:28.718 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":1002,"stamp":"2021-10-08T19:41:25.980346+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4377549020,"num_objects":66982,"num_object_clones":0,"num_object_copies":200946,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66982,"num_whiteouts":0,"num_read":1696,"num_read_kb":1453,"num_write":161415,"num_write_kb":7279784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":533,"num_bytes_recovered":11617,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":69893,"ondisk_log_size":69893,"up":564,"acting":564,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":564,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":16040740,"kb_used_data":12991140,"kb_used_omap":0,"kb_used_meta":3049088,"kb_avail":733920476,"statfs":{"total":767960285184,"available":751534567424,"internally_reserved":0,"allocated":13302927360,"data_stored":13299686420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3122266112},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-556138496,"num_objects":-8486,"num_object_clones":0,"num_object_copies":-25458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-8486,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8486,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.969100"},"pg_stats":[{"pgid":"2.29","version":"0'0","reported_seq":110,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.151453+0000","last_change":"2021-10-08T19:39:15.207230+0000","last_active":"2021-10-08T19:41:15.151453+0000","last_peered":"2021-10-08T19:41:15.151453+0000","last_clean":"2021-10-08T19:41:15.151453+0000","last_became_active":"2021-10-08T19:37:45.848663+0000","last_became_peered":"2021-10-08T19:37:45.848663+0000","last_unstale":"2021-10-08T19:41:15.151453+0000","last_undegraded":"2021-10-08T19:41:15.151453+0000","last_fullsized":"2021-10-08T19:41:15.151453+0000","mapping_epoch":407,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":408,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:15.207136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:30:11.102934+0000","last_clean_scrub_stamp":"2021-10-08T19:39:15.207136+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0027672759999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.28","version":"0'0","reported_seq":101,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.140269+0000","last_change":"2021-10-08T19:39:21.168002+0000","last_active":"2021-10-08T19:41:15.140269+0000","last_peered":"2021-10-08T19:41:15.140269+0000","last_clean":"2021-10-08T19:41:15.140269+0000","last_became_active":"2021-10-08T19:37:00.334502+0000","last_became_peered":"2021-10-08T19:37:00.334502+0000","last_unstale":"2021-10-08T19:41:15.140269+0000","last_undegraded":"2021-10-08T19:41:15.140269+0000","last_fullsized":"2021-10-08T19:41:15.140269+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:21.167907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:21.167907+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0095106210000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.27","version":"0'0","reported_seq":414,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.151896+0000","last_change":"2021-10-08T19:39:12.559639+0000","last_active":"2021-10-08T19:41:15.151896+0000","last_peered":"2021-10-08T19:41:15.151896+0000","last_clean":"2021-10-08T19:41:15.151896+0000","last_became_active":"2021-10-08T19:37:00.342526+0000","last_became_peered":"2021-10-08T19:37:00.342526+0000","last_unstale":"2021-10-08T19:41:15.151896+0000","last_undegraded":"2021-10-08T19:41:15.151896+0000","last_fullsized":"2021-10-08T19:41:15.151896+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:12.559542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:12.559542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0025174720000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.26","version":"0'0","reported_seq":101,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.154396+0000","last_change":"2021-10-08T19:39:13.573021+0000","last_active":"2021-10-08T19:41:15.154396+0000","last_peered":"2021-10-08T19:41:15.154396+0000","last_clean":"2021-10-08T19:41:15.154396+0000","last_became_active":"2021-10-08T19:37:00.340327+0000","last_became_peered":"2021-10-08T19:37:00.340327+0000","last_unstale":"2021-10-08T19:41:15.154396+0000","last_undegraded":"2021-10-08T19:41:15.154396+0000","last_fullsized":"2021-10-08T19:41:15.154396+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:13.572950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:07.710367+0000","last_clean_scrub_stamp":"2021-10-08T19:39:13.572950+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0022297720000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.25","version":"328'2","reported_seq":418,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.148593+0000","last_change":"2021-10-08T19:40:07.331172+0000","last_active":"2021-10-08T19:41:15.148593+0000","last_peered":"2021-10-08T19:41:15.148593+0000","last_clean":"2021-10-08T19:41:15.148593+0000","last_became_active":"2021-10-08T19:37:00.344673+0000","last_became_peered":"2021-10-08T19:37:00.344673+0000","last_unstale":"2021-10-08T19:41:15.148593+0000","last_undegraded":"2021-10-08T19:41:15.148593+0000","last_fullsized":"2021-10-08T19:41:15.148593+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"328'2","last_scrub_stamp":"2021-10-08T19:40:07.331064+0000","last_deep_scrub":"328'2","last_deep_scrub_stamp":"2021-10-08T19:33:29.990395+0000","last_clean_scrub_stamp":"2021-10-08T19:40:07.331064+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010473448999999999,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.24","version":"0'0","reported_seq":107,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.149881+0000","last_change":"2021-10-08T19:40:36.960572+0000","last_active":"2021-10-08T19:41:15.149881+0000","last_peered":"2021-10-08T19:41:15.149881+0000","last_clean":"2021-10-08T19:41:15.149881+0000","last_became_active":"2021-10-08T19:37:00.336960+0000","last_became_peered":"2021-10-08T19:37:00.336960+0000","last_unstale":"2021-10-08T19:41:15.149881+0000","last_undegraded":"2021-10-08T19:41:15.149881+0000","last_fullsized":"2021-10-08T19:41:15.149881+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:36.960483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:36.960483+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0017323569999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.23","version":"0'0","reported_seq":101,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.140562+0000","last_change":"2021-10-08T19:39:26.231063+0000","last_active":"2021-10-08T19:41:15.140562+0000","last_peered":"2021-10-08T19:41:15.140562+0000","last_clean":"2021-10-08T19:41:15.140562+0000","last_became_active":"2021-10-08T19:37:00.347789+0000","last_became_peered":"2021-10-08T19:37:00.347789+0000","last_unstale":"2021-10-08T19:41:15.140562+0000","last_undegraded":"2021-10-08T19:41:15.140562+0000","last_fullsized":"2021-10-08T19:41:15.140562+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:26.230969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:26.230969+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.01135425,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.22","version":"0'0","reported_seq":503,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.149596+0000","last_change":"2021-10-08T19:39:11.208487+0000","last_active":"2021-10-08T19:41:15.149596+0000","last_peered":"2021-10-08T19:41:15.149596+0000","last_clean":"2021-10-08T19:41:15.149596+0000","last_became_active":"2021-10-08T19:37:00.343394+0000","last_became_peered":"2021-10-08T19:37:00.343394+0000","last_unstale":"2021-10-08T19:41:15.149596+0000","last_undegraded":"2021-10-08T19:41:15.149596+0000","last_fullsized":"2021-10-08T19:41:15.149596+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:11.208391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:11.208391+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003871958,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3],"acting":[6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.21","version":"0'0","reported_seq":512,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.142733+0000","last_change":"2021-10-08T19:40:46.823451+0000","last_active":"2021-10-08T19:41:15.142733+0000","last_peered":"2021-10-08T19:41:15.142733+0000","last_clean":"2021-10-08T19:41:15.142733+0000","last_became_active":"2021-10-08T19:37:00.335409+0000","last_became_peered":"2021-10-08T19:37:00.335409+0000","last_unstale":"2021-10-08T19:41:15.142733+0000","last_undegraded":"2021-10-08T19:41:15.142733+0000","last_fullsized":"2021-10-08T19:41:15.142733+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:46.823341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:40:46.823341+0000","last_clean_scrub_stamp":"2021-10-08T19:40:46.823341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0093941830000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7],"acting":[2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.20","version":"0'0","reported_seq":111,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.150862+0000","last_change":"2021-10-08T19:39:11.566964+0000","last_active":"2021-10-08T19:41:15.150862+0000","last_peered":"2021-10-08T19:41:15.150862+0000","last_clean":"2021-10-08T19:41:15.150862+0000","last_became_active":"2021-10-08T19:37:00.341831+0000","last_became_peered":"2021-10-08T19:37:00.341831+0000","last_unstale":"2021-10-08T19:41:15.150862+0000","last_undegraded":"2021-10-08T19:41:15.150862+0000","last_fullsized":"2021-10-08T19:41:15.150862+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:11.566891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:32.922694+0000","last_clean_scrub_stamp":"2021-10-08T19:39:11.566891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0018543839999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.7","version":"479'9887","reported_seq":9947,"reported_epoch":479,"state":"active+clean","last_fresh":"2021-10-08T19:41:24.571803+0000","last_change":"2021-10-08T19:41:21.466917+0000","last_active":"2021-10-08T19:41:24.571803+0000","last_peered":"2021-10-08T19:41:24.571803+0000","last_clean":"2021-10-08T19:41:24.571803+0000","last_became_active":"2021-10-08T19:39:04.771230+0000","last_became_peered":"2021-10-08T19:39:04.771230+0000","last_unstale":"2021-10-08T19:41:24.571803+0000","last_undegraded":"2021-10-08T19:41:24.571803+0000","last_fullsized":"2021-10-08T19:41:24.571803+0000","mapping_epoch":433,"log_start":"461'5700","ondisk_log_start":"461'5700","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"479'9659","last_scrub_stamp":"2021-10-08T19:41:21.466796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:41:21.466796+0000","log_size":4187,"ondisk_log_size":4187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":2.0087995510000001,"stat_sum":{"num_bytes":264830976,"num_objects":4041,"num_object_clones":0,"num_object_copies":12123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4041,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9887,"num_write_kb":445696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"114'10","reported_seq":738,"reported_epoch":479,"state":"active+clean","last_fresh":"2021-10-08T19:41:21.201827+0000","last_change":"2021-10-08T19:40:34.920105+0000","last_active":"2021-10-08T19:41:21.201827+0000","last_peered":"2021-10-08T19:41:21.201827+0000","last_clean":"2021-10-08T19:41:21.201827+0000","last_became_active":"2021-10-08T19:24:25.096162+0000","last_became_peered":"2021-10-08T19:24:25.096162+0000","last_unstale":"2021-10-08T19:41:21.201827+0000","last_undegraded":"2021-10-08T19:41:21.201827+0000","last_fullsized":"2021-10-08T19:41:21.201827+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'10","last_scrub_stamp":"2021-10-08T19:40:34.920011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:40:34.920011+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002553937,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"289'34","reported_seq":148,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.151227+0000","last_change":"2021-10-08T19:40:31.983322+0000","last_active":"2021-10-08T19:41:15.151227+0000","last_peered":"2021-10-08T19:41:15.151227+0000","last_clean":"2021-10-08T19:41:15.151227+0000","last_became_active":"2021-10-08T19:37:18.998305+0000","last_became_peered":"2021-10-08T19:37:18.998305+0000","last_unstale":"2021-10-08T19:41:15.151227+0000","last_undegraded":"2021-10-08T19:41:15.151227+0000","last_fullsized":"2021-10-08T19:41:15.151227+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'34","last_scrub_stamp":"2021-10-08T19:40:31.983216+0000","last_deep_scrub":"87'22","last_deep_scrub_stamp":"2021-10-08T19:22:58.705632+0000","last_clean_scrub_stamp":"2021-10-08T19:40:31.983216+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012884054000000001,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":497,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.143692+0000","last_change":"2021-10-08T19:39:55.054394+0000","last_active":"2021-10-08T19:41:15.143692+0000","last_peered":"2021-10-08T19:41:15.143692+0000","last_clean":"2021-10-08T19:41:15.143692+0000","last_became_active":"2021-10-08T19:29:40.632678+0000","last_became_peered":"2021-10-08T19:29:40.632678+0000","last_unstale":"2021-10-08T19:41:15.143692+0000","last_undegraded":"2021-10-08T19:41:15.143692+0000","last_fullsized":"2021-10-08T19:41:15.143692+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:55.054274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:55.054274+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.009012684,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":176,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.824432+0000","last_change":"2021-10-08T19:41:15.824286+0000","last_active":"2021-10-08T19:41:15.824432+0000","last_peered":"2021-10-08T19:41:15.824432+0000","last_clean":"2021-10-08T19:41:15.824432+0000","last_became_active":"2021-10-08T19:37:19.000347+0000","last_became_peered":"2021-10-08T19:37:19.000347+0000","last_unstale":"2021-10-08T19:41:15.824432+0000","last_undegraded":"2021-10-08T19:41:15.824432+0000","last_fullsized":"2021-10-08T19:41:15.824432+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:41:15.824215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:08.936801+0000","last_clean_scrub_stamp":"2021-10-08T19:41:15.824215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.036641003999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":391,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.152204+0000","last_change":"2021-10-08T19:39:18.594197+0000","last_active":"2021-10-08T19:41:15.152204+0000","last_peered":"2021-10-08T19:41:15.152204+0000","last_clean":"2021-10-08T19:41:15.152204+0000","last_became_active":"2021-10-08T19:25:15.510457+0000","last_became_peered":"2021-10-08T19:25:15.510457+0000","last_unstale":"2021-10-08T19:41:15.152204+0000","last_undegraded":"2021-10-08T19:41:15.152204+0000","last_fullsized":"2021-10-08T19:41:15.152204+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:18.594126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:33:28.036266+0000","last_clean_scrub_stamp":"2021-10-08T19:39:18.594126+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0026381920000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.4","version":"479'10053","reported_seq":10107,"reported_epoch":479,"state":"active+clean","last_fresh":"2021-10-08T19:41:23.737731+0000","last_change":"2021-10-08T19:39:04.511208+0000","last_active":"2021-10-08T19:41:23.737731+0000","last_peered":"2021-10-08T19:41:23.737731+0000","last_clean":"2021-10-08T19:41:23.737731+0000","last_became_active":"2021-10-08T19:39:04.510913+0000","last_became_peered":"2021-10-08T19:39:04.510913+0000","last_unstale":"2021-10-08T19:41:23.737731+0000","last_undegraded":"2021-10-08T19:41:23.737731+0000","last_fullsized":"2021-10-08T19:41:23.737731+0000","mapping_epoch":433,"log_start":"465'6300","ondisk_log_start":"465'6300","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:03.490762+0000","log_size":3753,"ondisk_log_size":3753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":277807104,"num_objects":4239,"num_object_clones":0,"num_object_copies":12717,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4239,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10053,"num_write_kb":457344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"337'19","reported_seq":528,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.145516+0000","last_change":"2021-10-08T19:39:15.098421+0000","last_active":"2021-10-08T19:41:15.145516+0000","last_peered":"2021-10-08T19:41:15.145516+0000","last_clean":"2021-10-08T19:41:15.145516+0000","last_became_active":"2021-10-08T19:28:40.159729+0000","last_became_peered":"2021-10-08T19:28:40.159729+0000","last_unstale":"2021-10-08T19:41:15.145516+0000","last_undegraded":"2021-10-08T19:41:15.145516+0000","last_fullsized":"2021-10-08T19:41:15.145516+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"337'19","last_scrub_stamp":"2021-10-08T19:39:15.098300+0000","last_deep_scrub":"337'19","last_deep_scrub_stamp":"2021-10-08T19:34:14.040249+0000","last_clean_scrub_stamp":"2021-10-08T19:39:15.098300+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010352118,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":333,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.153990+0000","last_change":"2021-10-08T19:39:33.632923+0000","last_active":"2021-10-08T19:41:15.153990+0000","last_peered":"2021-10-08T19:41:15.153990+0000","last_clean":"2021-10-08T19:41:15.153990+0000","last_became_active":"2021-10-08T19:29:40.624977+0000","last_became_peered":"2021-10-08T19:29:40.624977+0000","last_unstale":"2021-10-08T19:41:15.153990+0000","last_undegraded":"2021-10-08T19:41:15.153990+0000","last_fullsized":"2021-10-08T19:41:15.153990+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:33.632818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:33.632818+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014140598000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":491,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.143067+0000","last_change":"2021-10-08T19:40:48.882826+0000","last_active":"2021-10-08T19:41:15.143067+0000","last_peered":"2021-10-08T19:41:15.143067+0000","last_clean":"2021-10-08T19:41:15.143067+0000","last_became_active":"2021-10-08T19:29:40.629422+0000","last_became_peered":"2021-10-08T19:29:40.629422+0000","last_unstale":"2021-10-08T19:41:15.143067+0000","last_undegraded":"2021-10-08T19:41:15.143067+0000","last_fullsized":"2021-10-08T19:41:15.143067+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:48.882724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:40:48.882724+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0032251089999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":461,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.146494+0000","last_change":"2021-10-08T19:39:26.158512+0000","last_active":"2021-10-08T19:41:15.146494+0000","last_peered":"2021-10-08T19:41:15.146494+0000","last_clean":"2021-10-08T19:41:15.146494+0000","last_became_active":"2021-10-08T19:21:29.643022+0000","last_became_peered":"2021-10-08T19:21:29.643022+0000","last_unstale":"2021-10-08T19:41:15.146494+0000","last_undegraded":"2021-10-08T19:41:15.146494+0000","last_fullsized":"2021-10-08T19:41:15.146494+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:26.158421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:26.158421+0000","last_clean_scrub_stamp":"2021-10-08T19:39:26.158421+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.11492822900000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"70'5","reported_seq":847,"reported_epoch":479,"state":"active+clean","last_fresh":"2021-10-08T19:41:22.669261+0000","last_change":"2021-10-08T19:38:02.331641+0000","last_active":"2021-10-08T19:41:22.669261+0000","last_peered":"2021-10-08T19:41:22.669261+0000","last_clean":"2021-10-08T19:41:22.669261+0000","last_became_active":"2021-10-08T19:37:19.006464+0000","last_became_peered":"2021-10-08T19:37:19.006464+0000","last_unstale":"2021-10-08T19:41:22.669261+0000","last_undegraded":"2021-10-08T19:41:22.669261+0000","last_fullsized":"2021-10-08T19:41:22.669261+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:38:02.331532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:38:02.331532+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0043661940000000003,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":563,"num_read_kb":563,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":778,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.5","version":"479'9882","reported_seq":9936,"reported_epoch":479,"state":"active+clean","last_fresh":"2021-10-08T19:41:23.703888+0000","last_change":"2021-10-08T19:39:04.771577+0000","last_active":"2021-10-08T19:41:23.703888+0000","last_peered":"2021-10-08T19:41:23.703888+0000","last_clean":"2021-10-08T19:41:23.703888+0000","last_became_active":"2021-10-08T19:39:04.771214+0000","last_became_peered":"2021-10-08T19:39:04.771214+0000","last_unstale":"2021-10-08T19:41:23.703888+0000","last_undegraded":"2021-10-08T19:41:23.703888+0000","last_fullsized":"2021-10-08T19:41:23.703888+0000","mapping_epoch":433,"log_start":"464'6100","ondisk_log_start":"464'6100","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:03.490762+0000","log_size":3782,"ondisk_log_size":3782,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":270008320,"num_objects":4120,"num_object_clones":0,"num_object_copies":12360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4120,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9882,"num_write_kb":448064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"428'44","reported_seq":531,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.150040+0000","last_change":"2021-10-08T19:40:49.868198+0000","last_active":"2021-10-08T19:41:15.150040+0000","last_peered":"2021-10-08T19:41:15.150040+0000","last_clean":"2021-10-08T19:41:15.150040+0000","last_became_active":"2021-10-08T19:28:40.101648+0000","last_became_peered":"2021-10-08T19:28:40.101648+0000","last_unstale":"2021-10-08T19:41:15.150040+0000","last_undegraded":"2021-10-08T19:41:15.150040+0000","last_fullsized":"2021-10-08T19:41:15.150040+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"428'44","last_scrub_stamp":"2021-10-08T19:40:49.868088+0000","last_deep_scrub":"428'44","last_deep_scrub_stamp":"2021-10-08T19:38:47.335892+0000","last_clean_scrub_stamp":"2021-10-08T19:40:49.868088+0000","log_size":44,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0038363440000000002,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":55,"num_read_kb":44,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":477,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.144673+0000","last_change":"2021-10-08T19:40:11.180747+0000","last_active":"2021-10-08T19:41:15.144673+0000","last_peered":"2021-10-08T19:41:15.144673+0000","last_clean":"2021-10-08T19:41:15.144673+0000","last_became_active":"2021-10-08T19:21:23.595919+0000","last_became_peered":"2021-10-08T19:21:23.595919+0000","last_unstale":"2021-10-08T19:41:15.144673+0000","last_undegraded":"2021-10-08T19:41:15.144673+0000","last_fullsized":"2021-10-08T19:41:15.144673+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:11.180640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:40:11.180640+0000","last_clean_scrub_stamp":"2021-10-08T19:40:11.180640+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0088737490000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":483,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.143135+0000","last_change":"2021-10-08T19:39:31.136396+0000","last_active":"2021-10-08T19:41:15.143135+0000","last_peered":"2021-10-08T19:41:15.143135+0000","last_clean":"2021-10-08T19:41:15.143135+0000","last_became_active":"2021-10-08T19:31:22.783725+0000","last_became_peered":"2021-10-08T19:31:22.783725+0000","last_unstale":"2021-10-08T19:41:15.143135+0000","last_undegraded":"2021-10-08T19:41:15.143135+0000","last_fullsized":"2021-10-08T19:41:15.143135+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:31.136290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:39:31.136290+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0053463770000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":475,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.151080+0000","last_change":"2021-10-08T19:39:55.885308+0000","last_active":"2021-10-08T19:41:15.151080+0000","last_peered":"2021-10-08T19:41:15.151080+0000","last_clean":"2021-10-08T19:41:15.151080+0000","last_became_active":"2021-10-08T19:29:40.638354+0000","last_became_peered":"2021-10-08T19:29:40.638354+0000","last_unstale":"2021-10-08T19:41:15.151080+0000","last_undegraded":"2021-10-08T19:41:15.151080+0000","last_fullsized":"2021-10-08T19:41:15.151080+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:55.885197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:39.528699+0000","last_clean_scrub_stamp":"2021-10-08T19:39:55.885197+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011288616,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":402,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.152003+0000","last_change":"2021-10-08T19:39:17.629247+0000","last_active":"2021-10-08T19:41:15.152003+0000","last_peered":"2021-10-08T19:41:15.152003+0000","last_clean":"2021-10-08T19:41:15.152003+0000","last_became_active":"2021-10-08T19:31:22.785590+0000","last_became_peered":"2021-10-08T19:31:22.785590+0000","last_unstale":"2021-10-08T19:41:15.152003+0000","last_undegraded":"2021-10-08T19:41:15.152003+0000","last_fullsized":"2021-10-08T19:41:15.152003+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:17.629178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:17.629178+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001878256,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2","version":"479'9967","reported_seq":10025,"reported_epoch":479,"state":"active+clean","last_fresh":"2021-10-08T19:41:24.019132+0000","last_change":"2021-10-08T19:40:36.563540+0000","last_active":"2021-10-08T19:41:24.019132+0000","last_peered":"2021-10-08T19:41:24.019132+0000","last_clean":"2021-10-08T19:41:24.019132+0000","last_became_active":"2021-10-08T19:39:04.513549+0000","last_became_peered":"2021-10-08T19:39:04.513549+0000","last_unstale":"2021-10-08T19:41:24.019132+0000","last_undegraded":"2021-10-08T19:41:24.019132+0000","last_fullsized":"2021-10-08T19:41:24.019132+0000","mapping_epoch":433,"log_start":"457'4800","ondisk_log_start":"457'4800","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"467'6896","last_scrub_stamp":"2021-10-08T19:40:36.563423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:40:36.563423+0000","log_size":5167,"ondisk_log_size":5167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":3.479033571,"stat_sum":{"num_bytes":273874944,"num_objects":4179,"num_object_clones":0,"num_object_copies":12537,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4179,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9967,"num_write_kb":452672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.8","version":"90'130","reported_seq":463,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.142548+0000","last_change":"2021-10-08T19:39:30.172051+0000","last_active":"2021-10-08T19:41:15.142548+0000","last_peered":"2021-10-08T19:41:15.142548+0000","last_clean":"2021-10-08T19:41:15.142548+0000","last_became_active":"2021-10-08T19:37:19.009239+0000","last_became_peered":"2021-10-08T19:37:19.009239+0000","last_unstale":"2021-10-08T19:41:15.142548+0000","last_undegraded":"2021-10-08T19:41:15.142548+0000","last_fullsized":"2021-10-08T19:41:15.142548+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:39:30.171944+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:39:30.171944+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0069086290000000003,"stat_sum":{"num_bytes":262688,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"459'39","reported_seq":571,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.149020+0000","last_change":"2021-10-08T19:40:10.405161+0000","last_active":"2021-10-08T19:41:15.149020+0000","last_peered":"2021-10-08T19:41:15.149020+0000","last_clean":"2021-10-08T19:41:15.149020+0000","last_became_active":"2021-10-08T19:28:40.099618+0000","last_became_peered":"2021-10-08T19:28:40.099618+0000","last_unstale":"2021-10-08T19:41:15.149020+0000","last_undegraded":"2021-10-08T19:41:15.149020+0000","last_fullsized":"2021-10-08T19:41:15.149020+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"459'39","last_scrub_stamp":"2021-10-08T19:40:10.405068+0000","last_deep_scrub":"459'39","last_deep_scrub_stamp":"2021-10-08T19:40:10.405068+0000","last_clean_scrub_stamp":"2021-10-08T19:40:10.405068+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.024252185999999998,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":50,"num_read_kb":40,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"61'1","reported_seq":471,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.153137+0000","last_change":"2021-10-08T19:40:36.925924+0000","last_active":"2021-10-08T19:41:15.153137+0000","last_peered":"2021-10-08T19:41:15.153137+0000","last_clean":"2021-10-08T19:41:15.153137+0000","last_became_active":"2021-10-08T19:21:23.607064+0000","last_became_peered":"2021-10-08T19:21:23.607064+0000","last_unstale":"2021-10-08T19:41:15.153137+0000","last_undegraded":"2021-10-08T19:41:15.153137+0000","last_fullsized":"2021-10-08T19:41:15.153137+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'1","last_scrub_stamp":"2021-10-08T19:40:36.925849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:36.925849+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0081260700000000009,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":315,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.153645+0000","last_change":"2021-10-08T19:40:49.345813+0000","last_active":"2021-10-08T19:41:15.153645+0000","last_peered":"2021-10-08T19:41:15.153645+0000","last_clean":"2021-10-08T19:41:15.153645+0000","last_became_active":"2021-10-08T19:28:40.152478+0000","last_became_peered":"2021-10-08T19:28:40.152478+0000","last_unstale":"2021-10-08T19:41:15.153645+0000","last_undegraded":"2021-10-08T19:41:15.153645+0000","last_fullsized":"2021-10-08T19:41:15.153645+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:49.345703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:30:09.081635+0000","last_clean_scrub_stamp":"2021-10-08T19:40:49.345703+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0058856459999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":489,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.143980+0000","last_change":"2021-10-08T19:40:40.184580+0000","last_active":"2021-10-08T19:41:15.143980+0000","last_peered":"2021-10-08T19:41:15.143980+0000","last_clean":"2021-10-08T19:41:15.143980+0000","last_became_active":"2021-10-08T19:29:40.629424+0000","last_became_peered":"2021-10-08T19:29:40.629424+0000","last_unstale":"2021-10-08T19:41:15.143980+0000","last_undegraded":"2021-10-08T19:41:15.143980+0000","last_fullsized":"2021-10-08T19:41:15.143980+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:40.184460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:40:40.184460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.189286643,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":447,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.150313+0000","last_change":"2021-10-08T19:40:00.916866+0000","last_active":"2021-10-08T19:41:15.150313+0000","last_peered":"2021-10-08T19:41:15.150313+0000","last_clean":"2021-10-08T19:41:15.150313+0000","last_became_active":"2021-10-08T19:31:51.676829+0000","last_became_peered":"2021-10-08T19:31:51.676829+0000","last_unstale":"2021-10-08T19:41:15.150313+0000","last_undegraded":"2021-10-08T19:41:15.150313+0000","last_fullsized":"2021-10-08T19:41:15.150313+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:00.916780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:00.916780+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0077587489999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"479'10309","reported_seq":10362,"reported_epoch":479,"state":"active+clean","last_fresh":"2021-10-08T19:41:23.776387+0000","last_change":"2021-10-08T19:39:04.509158+0000","last_active":"2021-10-08T19:41:23.776387+0000","last_peered":"2021-10-08T19:41:23.776387+0000","last_clean":"2021-10-08T19:41:23.776387+0000","last_became_active":"2021-10-08T19:39:04.508797+0000","last_became_peered":"2021-10-08T19:39:04.508797+0000","last_unstale":"2021-10-08T19:41:23.776387+0000","last_undegraded":"2021-10-08T19:41:23.776387+0000","last_fullsized":"2021-10-08T19:41:23.776387+0000","mapping_epoch":433,"log_start":"461'6000","ondisk_log_start":"461'6000","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:03.490762+0000","log_size":4309,"ondisk_log_size":4309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":284622848,"num_objects":4343,"num_object_clones":0,"num_object_copies":13029,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4343,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10309,"num_write_kb":468864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1],"acting":[6,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.9","version":"90'130","reported_seq":805,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.150953+0000","last_change":"2021-10-08T19:38:43.587701+0000","last_active":"2021-10-08T19:41:15.150953+0000","last_peered":"2021-10-08T19:41:15.150953+0000","last_clean":"2021-10-08T19:41:15.150953+0000","last_became_active":"2021-10-08T19:29:43.634789+0000","last_became_peered":"2021-10-08T19:29:43.634789+0000","last_unstale":"2021-10-08T19:41:15.150953+0000","last_undegraded":"2021-10-08T19:41:15.150953+0000","last_fullsized":"2021-10-08T19:41:15.150953+0000","mapping_epoch":239,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:38:43.587557+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:38:43.587557+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010306226999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"289'20","reported_seq":574,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.149421+0000","last_change":"2021-10-08T19:40:00.425294+0000","last_active":"2021-10-08T19:41:15.149421+0000","last_peered":"2021-10-08T19:41:15.149421+0000","last_clean":"2021-10-08T19:41:15.149421+0000","last_became_active":"2021-10-08T19:29:40.631807+0000","last_became_peered":"2021-10-08T19:29:40.631807+0000","last_unstale":"2021-10-08T19:41:15.149421+0000","last_undegraded":"2021-10-08T19:41:15.149421+0000","last_fullsized":"2021-10-08T19:41:15.149421+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'20","last_scrub_stamp":"2021-10-08T19:40:00.425194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:40:00.425194+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0087912159999999993,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":335,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.150766+0000","last_change":"2021-10-08T19:40:02.914149+0000","last_active":"2021-10-08T19:41:15.150766+0000","last_peered":"2021-10-08T19:41:15.150766+0000","last_clean":"2021-10-08T19:41:15.150766+0000","last_became_active":"2021-10-08T19:29:40.638988+0000","last_became_peered":"2021-10-08T19:29:40.638988+0000","last_unstale":"2021-10-08T19:41:15.150766+0000","last_undegraded":"2021-10-08T19:41:15.150766+0000","last_fullsized":"2021-10-08T19:41:15.150766+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:02.914080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:02.914080+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.022904704000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"250'9","reported_seq":724,"reported_epoch":479,"state":"active+clean","last_fresh":"2021-10-08T19:41:21.196608+0000","last_change":"2021-10-08T19:40:04.082786+0000","last_active":"2021-10-08T19:41:21.196608+0000","last_peered":"2021-10-08T19:41:21.196608+0000","last_clean":"2021-10-08T19:41:21.196608+0000","last_became_active":"2021-10-08T19:21:27.637930+0000","last_became_peered":"2021-10-08T19:21:27.637930+0000","last_unstale":"2021-10-08T19:41:21.196608+0000","last_undegraded":"2021-10-08T19:41:21.196608+0000","last_fullsized":"2021-10-08T19:41:21.196608+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'9","last_scrub_stamp":"2021-10-08T19:40:04.082682+0000","last_deep_scrub":"250'9","last_deep_scrub_stamp":"2021-10-08T19:30:04.239189+0000","last_clean_scrub_stamp":"2021-10-08T19:40:04.082682+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0097725820000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":474,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.147919+0000","last_change":"2021-10-08T19:39:20.149864+0000","last_active":"2021-10-08T19:41:15.147919+0000","last_peered":"2021-10-08T19:41:15.147919+0000","last_clean":"2021-10-08T19:41:15.147919+0000","last_became_active":"2021-10-08T19:28:40.100213+0000","last_became_peered":"2021-10-08T19:28:40.100213+0000","last_unstale":"2021-10-08T19:41:15.147919+0000","last_undegraded":"2021-10-08T19:41:15.147919+0000","last_fullsized":"2021-10-08T19:41:15.147919+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:20.149744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:20.149744+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.034036438000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":269,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.141135+0000","last_change":"2021-10-08T19:40:06.317558+0000","last_active":"2021-10-08T19:41:15.141135+0000","last_peered":"2021-10-08T19:41:15.141135+0000","last_clean":"2021-10-08T19:41:15.141135+0000","last_became_active":"2021-10-08T19:29:44.443507+0000","last_became_peered":"2021-10-08T19:29:44.443507+0000","last_unstale":"2021-10-08T19:41:15.141135+0000","last_undegraded":"2021-10-08T19:41:15.141135+0000","last_fullsized":"2021-10-08T19:41:15.141135+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:06.317461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:06.317461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0054001470000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.0","version":"479'9963","reported_seq":10017,"reported_epoch":479,"state":"active+clean","last_fresh":"2021-10-08T19:41:24.577711+0000","last_change":"2021-10-08T19:39:04.508881+0000","last_active":"2021-10-08T19:41:24.577711+0000","last_peered":"2021-10-08T19:41:24.577711+0000","last_clean":"2021-10-08T19:41:24.577711+0000","last_became_active":"2021-10-08T19:39:04.508607+0000","last_became_peered":"2021-10-08T19:39:04.508607+0000","last_unstale":"2021-10-08T19:41:24.577711+0000","last_undegraded":"2021-10-08T19:41:24.577711+0000","last_fullsized":"2021-10-08T19:41:24.577711+0000","mapping_epoch":433,"log_start":"461'5700","ondisk_log_start":"461'5700","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:03.490762+0000","log_size":4263,"ondisk_log_size":4263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":269811712,"num_objects":4117,"num_object_clones":0,"num_object_copies":12351,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4117,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9963,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.a","version":"90'130","reported_seq":403,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.142981+0000","last_change":"2021-10-08T19:40:01.053717+0000","last_active":"2021-10-08T19:41:15.142981+0000","last_peered":"2021-10-08T19:41:15.142981+0000","last_clean":"2021-10-08T19:41:15.142981+0000","last_became_active":"2021-10-08T19:37:19.000525+0000","last_became_peered":"2021-10-08T19:37:19.000525+0000","last_unstale":"2021-10-08T19:41:15.142981+0000","last_undegraded":"2021-10-08T19:41:15.142981+0000","last_fullsized":"2021-10-08T19:41:15.142981+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:40:01.053607+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:40:01.053607+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034190679999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"289'27","reported_seq":217,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.143798+0000","last_change":"2021-10-08T19:40:03.107059+0000","last_active":"2021-10-08T19:41:15.143798+0000","last_peered":"2021-10-08T19:41:15.143798+0000","last_clean":"2021-10-08T19:41:15.143798+0000","last_became_active":"2021-10-08T19:32:45.162914+0000","last_became_peered":"2021-10-08T19:32:45.162914+0000","last_unstale":"2021-10-08T19:41:15.143798+0000","last_undegraded":"2021-10-08T19:41:15.143798+0000","last_fullsized":"2021-10-08T19:41:15.143798+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'27","last_scrub_stamp":"2021-10-08T19:40:03.106967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:40:03.106967+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0080879679999999992,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":550,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":342,"reported_epoch":479,"state":"active+clean","last_fresh":"2021-10-08T19:41:24.519068+0000","last_change":"2021-10-08T19:41:24.519028+0000","last_active":"2021-10-08T19:41:24.519068+0000","last_peered":"2021-10-08T19:41:24.519068+0000","last_clean":"2021-10-08T19:41:24.519068+0000","last_became_active":"2021-10-08T19:36:58.004540+0000","last_became_peered":"2021-10-08T19:36:58.004540+0000","last_unstale":"2021-10-08T19:41:24.519068+0000","last_undegraded":"2021-10-08T19:41:24.519068+0000","last_fullsized":"2021-10-08T19:41:24.519068+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:41:24.518921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:47.613029+0000","last_clean_scrub_stamp":"2021-10-08T19:41:24.518921+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.03479492,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"88'9","reported_seq":712,"reported_epoch":479,"state":"active+clean","last_fresh":"2021-10-08T19:41:21.184397+0000","last_change":"2021-10-08T19:40:01.462959+0000","last_active":"2021-10-08T19:41:21.184397+0000","last_peered":"2021-10-08T19:41:21.184397+0000","last_clean":"2021-10-08T19:41:21.184397+0000","last_became_active":"2021-10-08T19:21:27.636432+0000","last_became_peered":"2021-10-08T19:21:27.636432+0000","last_unstale":"2021-10-08T19:41:21.184397+0000","last_undegraded":"2021-10-08T19:41:21.184397+0000","last_fullsized":"2021-10-08T19:41:21.184397+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'9","last_scrub_stamp":"2021-10-08T19:40:01.462851+0000","last_deep_scrub":"88'9","last_deep_scrub_stamp":"2021-10-08T19:23:00.048245+0000","last_clean_scrub_stamp":"2021-10-08T19:40:01.462851+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.020776886000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":268,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:16.438250+0000","last_change":"2021-10-08T19:41:16.438250+0000","last_active":"2021-10-08T19:41:16.438250+0000","last_peered":"2021-10-08T19:41:16.438250+0000","last_clean":"2021-10-08T19:41:16.438250+0000","last_became_active":"2021-10-08T19:37:19.016085+0000","last_became_peered":"2021-10-08T19:37:19.016085+0000","last_unstale":"2021-10-08T19:41:16.438250+0000","last_undegraded":"2021-10-08T19:41:16.438250+0000","last_fullsized":"2021-10-08T19:41:16.438250+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:54.590301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:37:54.590301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.095282983000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"70'5","reported_seq":269,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.140925+0000","last_change":"2021-10-08T19:40:32.248981+0000","last_active":"2021-10-08T19:41:15.140925+0000","last_peered":"2021-10-08T19:41:15.140925+0000","last_clean":"2021-10-08T19:41:15.140925+0000","last_became_active":"2021-10-08T19:29:40.639786+0000","last_became_peered":"2021-10-08T19:29:40.639786+0000","last_unstale":"2021-10-08T19:41:15.140925+0000","last_undegraded":"2021-10-08T19:41:15.140925+0000","last_fullsized":"2021-10-08T19:41:15.140925+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:40:32.248867+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2021-10-08T19:36:08.760670+0000","last_clean_scrub_stamp":"2021-10-08T19:40:32.248867+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.015954836,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1","version":"479'10175","reported_seq":10229,"reported_epoch":479,"state":"active+clean","last_fresh":"2021-10-08T19:41:23.766340+0000","last_change":"2021-10-08T19:39:04.511987+0000","last_active":"2021-10-08T19:41:23.766340+0000","last_peered":"2021-10-08T19:41:23.766340+0000","last_clean":"2021-10-08T19:41:23.766340+0000","last_became_active":"2021-10-08T19:39:04.511690+0000","last_became_peered":"2021-10-08T19:39:04.511690+0000","last_unstale":"2021-10-08T19:41:23.766340+0000","last_undegraded":"2021-10-08T19:41:23.766340+0000","last_fullsized":"2021-10-08T19:41:23.766340+0000","mapping_epoch":433,"log_start":"461'5900","ondisk_log_start":"461'5900","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:03.490762+0000","log_size":4275,"ondisk_log_size":4275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":282525696,"num_objects":4311,"num_object_clones":0,"num_object_copies":12933,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4311,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10175,"num_write_kb":463552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"289'19","reported_seq":640,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.147583+0000","last_change":"2021-10-08T19:40:33.616897+0000","last_active":"2021-10-08T19:41:15.147583+0000","last_peered":"2021-10-08T19:41:15.147583+0000","last_clean":"2021-10-08T19:41:15.147583+0000","last_became_active":"2021-10-08T19:31:51.677509+0000","last_became_peered":"2021-10-08T19:31:51.677509+0000","last_unstale":"2021-10-08T19:41:15.147583+0000","last_undegraded":"2021-10-08T19:41:15.147583+0000","last_fullsized":"2021-10-08T19:41:15.147583+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:40:33.616776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:40:33.616776+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0050522830000000003,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":770,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":492,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.151162+0000","last_change":"2021-10-08T19:39:09.585407+0000","last_active":"2021-10-08T19:41:15.151162+0000","last_peered":"2021-10-08T19:41:15.151162+0000","last_clean":"2021-10-08T19:41:15.151162+0000","last_became_active":"2021-10-08T19:36:58.001610+0000","last_became_peered":"2021-10-08T19:36:58.001610+0000","last_unstale":"2021-10-08T19:41:15.151162+0000","last_undegraded":"2021-10-08T19:41:15.151162+0000","last_fullsized":"2021-10-08T19:41:15.151162+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:09.585318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:09.585318+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002054714,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":170,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.147889+0000","last_change":"2021-10-08T19:39:21.090794+0000","last_active":"2021-10-08T19:41:15.147889+0000","last_peered":"2021-10-08T19:41:15.147889+0000","last_clean":"2021-10-08T19:41:15.147889+0000","last_became_active":"2021-10-08T19:37:18.997446+0000","last_became_peered":"2021-10-08T19:37:18.997446+0000","last_unstale":"2021-10-08T19:41:15.147889+0000","last_undegraded":"2021-10-08T19:41:15.147889+0000","last_fullsized":"2021-10-08T19:41:15.147889+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:21.090701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:39:21.090701+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001395486,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":275,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.141808+0000","last_change":"2021-10-08T19:40:53.173789+0000","last_active":"2021-10-08T19:41:15.141808+0000","last_peered":"2021-10-08T19:41:15.141808+0000","last_clean":"2021-10-08T19:41:15.141808+0000","last_became_active":"2021-10-08T19:29:40.638099+0000","last_became_peered":"2021-10-08T19:29:40.638099+0000","last_unstale":"2021-10-08T19:41:15.141808+0000","last_undegraded":"2021-10-08T19:41:15.141808+0000","last_fullsized":"2021-10-08T19:41:15.141808+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:53.173689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:17.422176+0000","last_clean_scrub_stamp":"2021-10-08T19:40:53.173689+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0081726460000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":413,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.146841+0000","last_change":"2021-10-08T19:40:08.369310+0000","last_active":"2021-10-08T19:41:15.146841+0000","last_peered":"2021-10-08T19:41:15.146841+0000","last_clean":"2021-10-08T19:41:15.146841+0000","last_became_active":"2021-10-08T19:24:13.506602+0000","last_became_peered":"2021-10-08T19:24:13.506602+0000","last_unstale":"2021-10-08T19:41:15.146841+0000","last_undegraded":"2021-10-08T19:41:15.146841+0000","last_fullsized":"2021-10-08T19:41:15.146841+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:08.369244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:08.369244+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034824579999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"479'9781","reported_seq":9834,"reported_epoch":479,"state":"active+clean","last_fresh":"2021-10-08T19:41:23.506335+0000","last_change":"2021-10-08T19:39:04.506038+0000","last_active":"2021-10-08T19:41:23.506335+0000","last_peered":"2021-10-08T19:41:23.506335+0000","last_clean":"2021-10-08T19:41:23.506335+0000","last_became_active":"2021-10-08T19:39:04.505739+0000","last_became_peered":"2021-10-08T19:39:04.505739+0000","last_unstale":"2021-10-08T19:41:23.506335+0000","last_undegraded":"2021-10-08T19:41:23.506335+0000","last_fullsized":"2021-10-08T19:41:23.506335+0000","mapping_epoch":433,"log_start":"462'5800","ondisk_log_start":"462'5800","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:03.490762+0000","log_size":3981,"ondisk_log_size":3981,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":266010624,"num_objects":4059,"num_object_clones":0,"num_object_copies":12177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4059,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9781,"num_write_kb":442880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7],"acting":[4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"90'130","reported_seq":599,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.141776+0000","last_change":"2021-10-08T19:39:30.252356+0000","last_active":"2021-10-08T19:41:15.141776+0000","last_peered":"2021-10-08T19:41:15.141776+0000","last_clean":"2021-10-08T19:41:15.141776+0000","last_became_active":"2021-10-08T19:29:43.636733+0000","last_became_peered":"2021-10-08T19:29:43.636733+0000","last_unstale":"2021-10-08T19:41:15.141776+0000","last_undegraded":"2021-10-08T19:41:15.141776+0000","last_fullsized":"2021-10-08T19:41:15.141776+0000","mapping_epoch":239,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:39:30.252247+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:39:30.252247+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012156159999999999,"stat_sum":{"num_bytes":327680,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"238'13","reported_seq":420,"reported_epoch":479,"state":"active+clean","last_fresh":"2021-10-08T19:41:21.223473+0000","last_change":"2021-10-08T19:38:32.165269+0000","last_active":"2021-10-08T19:41:21.223473+0000","last_peered":"2021-10-08T19:41:21.223473+0000","last_clean":"2021-10-08T19:41:21.223473+0000","last_became_active":"2021-10-08T19:29:40.640248+0000","last_became_peered":"2021-10-08T19:29:40.640248+0000","last_unstale":"2021-10-08T19:41:21.223473+0000","last_undegraded":"2021-10-08T19:41:21.223473+0000","last_fullsized":"2021-10-08T19:41:21.223473+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"238'13","last_scrub_stamp":"2021-10-08T19:38:32.165194+0000","last_deep_scrub":"91'9","last_deep_scrub_stamp":"2021-10-08T19:23:32.329475+0000","last_clean_scrub_stamp":"2021-10-08T19:38:32.165194+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0056171720000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"289'28","reported_seq":552,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.147055+0000","last_change":"2021-10-08T19:39:11.026869+0000","last_active":"2021-10-08T19:41:15.147055+0000","last_peered":"2021-10-08T19:41:15.147055+0000","last_clean":"2021-10-08T19:41:15.147055+0000","last_became_active":"2021-10-08T19:24:25.098743+0000","last_became_peered":"2021-10-08T19:24:25.098743+0000","last_unstale":"2021-10-08T19:41:15.147055+0000","last_undegraded":"2021-10-08T19:41:15.147055+0000","last_fullsized":"2021-10-08T19:41:15.147055+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'28","last_scrub_stamp":"2021-10-08T19:39:11.026789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:39:11.026789+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0043294240000000001,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":42,"num_read_kb":35,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":423,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.150348+0000","last_change":"2021-10-08T19:39:14.201859+0000","last_active":"2021-10-08T19:41:15.150348+0000","last_peered":"2021-10-08T19:41:15.150348+0000","last_clean":"2021-10-08T19:41:15.150348+0000","last_became_active":"2021-10-08T19:37:45.829953+0000","last_became_peered":"2021-10-08T19:37:45.829953+0000","last_unstale":"2021-10-08T19:41:15.150348+0000","last_undegraded":"2021-10-08T19:41:15.150348+0000","last_fullsized":"2021-10-08T19:41:15.150348+0000","mapping_epoch":407,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":408,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:14.201773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:14.201773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0032499429999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,2],"acting":[6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":481,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.153535+0000","last_change":"2021-10-08T19:40:10.935739+0000","last_active":"2021-10-08T19:41:15.153535+0000","last_peered":"2021-10-08T19:41:15.153535+0000","last_clean":"2021-10-08T19:41:15.153535+0000","last_became_active":"2021-10-08T19:24:25.094848+0000","last_became_peered":"2021-10-08T19:24:25.094848+0000","last_unstale":"2021-10-08T19:41:15.153535+0000","last_undegraded":"2021-10-08T19:41:15.153535+0000","last_fullsized":"2021-10-08T19:41:15.153535+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:10.935616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:40:10.935616+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.087461560999999993,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":436,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.148653+0000","last_change":"2021-10-08T19:39:29.921516+0000","last_active":"2021-10-08T19:41:15.148653+0000","last_peered":"2021-10-08T19:41:15.148653+0000","last_clean":"2021-10-08T19:41:15.148653+0000","last_became_active":"2021-10-08T19:28:40.132751+0000","last_became_peered":"2021-10-08T19:28:40.132751+0000","last_unstale":"2021-10-08T19:41:15.148653+0000","last_undegraded":"2021-10-08T19:41:15.148653+0000","last_fullsized":"2021-10-08T19:41:15.148653+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:29.921447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:29.921447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0045187020000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.f","version":"479'9946","reported_seq":10000,"reported_epoch":479,"state":"active+clean","last_fresh":"2021-10-08T19:41:23.749361+0000","last_change":"2021-10-08T19:39:04.510165+0000","last_active":"2021-10-08T19:41:23.749361+0000","last_peered":"2021-10-08T19:41:23.749361+0000","last_clean":"2021-10-08T19:41:23.749361+0000","last_became_active":"2021-10-08T19:39:04.509869+0000","last_became_peered":"2021-10-08T19:39:04.509869+0000","last_unstale":"2021-10-08T19:41:23.749361+0000","last_undegraded":"2021-10-08T19:41:23.749361+0000","last_fullsized":"2021-10-08T19:41:23.749361+0000","mapping_epoch":433,"log_start":"464'6100","ondisk_log_start":"464'6100","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:03.490762+0000","log_size":3846,"ondisk_log_size":3846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":271450112,"num_objects":4142,"num_object_clones":0,"num_object_copies":12426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4142,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9946,"num_write_kb":450816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.5","version":"90'130","reported_seq":639,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.148503+0000","last_change":"2021-10-08T19:39:26.207889+0000","last_active":"2021-10-08T19:41:15.148503+0000","last_peered":"2021-10-08T19:41:15.148503+0000","last_clean":"2021-10-08T19:41:15.148503+0000","last_became_active":"2021-10-08T19:27:26.590651+0000","last_became_peered":"2021-10-08T19:27:26.590651+0000","last_unstale":"2021-10-08T19:41:15.148503+0000","last_undegraded":"2021-10-08T19:41:15.148503+0000","last_fullsized":"2021-10-08T19:41:15.148503+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:39:26.207770+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:32:14.582883+0000","last_clean_scrub_stamp":"2021-10-08T19:39:26.207770+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011952313000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":476,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.147379+0000","last_change":"2021-10-08T19:39:25.156483+0000","last_active":"2021-10-08T19:41:15.147379+0000","last_peered":"2021-10-08T19:41:15.147379+0000","last_clean":"2021-10-08T19:41:15.147379+0000","last_became_active":"2021-10-08T19:29:40.639405+0000","last_became_peered":"2021-10-08T19:29:40.639405+0000","last_unstale":"2021-10-08T19:41:15.147379+0000","last_undegraded":"2021-10-08T19:41:15.147379+0000","last_fullsized":"2021-10-08T19:41:15.147379+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:25.156355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:39:25.156355+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0062655510000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"289'30","reported_seq":305,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.140770+0000","last_change":"2021-10-08T19:37:55.431244+0000","last_active":"2021-10-08T19:41:15.140770+0000","last_peered":"2021-10-08T19:41:15.140770+0000","last_clean":"2021-10-08T19:41:15.140770+0000","last_became_active":"2021-10-08T19:29:40.635007+0000","last_became_peered":"2021-10-08T19:29:40.635007+0000","last_unstale":"2021-10-08T19:41:15.140770+0000","last_undegraded":"2021-10-08T19:41:15.140770+0000","last_fullsized":"2021-10-08T19:41:15.140770+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'30","last_scrub_stamp":"2021-10-08T19:37:55.431161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:37:55.431161+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0042801929999999998,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":51,"num_read_kb":39,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":318,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.153965+0000","last_change":"2021-10-08T19:40:46.233555+0000","last_active":"2021-10-08T19:41:15.153965+0000","last_peered":"2021-10-08T19:41:15.153965+0000","last_clean":"2021-10-08T19:41:15.153965+0000","last_became_active":"2021-10-08T19:36:58.013501+0000","last_became_peered":"2021-10-08T19:36:58.013501+0000","last_unstale":"2021-10-08T19:41:15.153965+0000","last_undegraded":"2021-10-08T19:41:15.153965+0000","last_fullsized":"2021-10-08T19:41:15.153965+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:46.233456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:40:46.233456+0000","last_clean_scrub_stamp":"2021-10-08T19:40:46.233456+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.006516811,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":474,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.147772+0000","last_change":"2021-10-08T19:40:04.385494+0000","last_active":"2021-10-08T19:41:15.147772+0000","last_peered":"2021-10-08T19:41:15.147772+0000","last_clean":"2021-10-08T19:41:15.147772+0000","last_became_active":"2021-10-08T19:29:40.638253+0000","last_became_peered":"2021-10-08T19:29:40.638253+0000","last_unstale":"2021-10-08T19:41:15.147772+0000","last_undegraded":"2021-10-08T19:41:15.147772+0000","last_fullsized":"2021-10-08T19:41:15.147772+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:04.385386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:40:04.385386+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0092727669999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":269,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.141892+0000","last_change":"2021-10-08T19:40:44.228306+0000","last_active":"2021-10-08T19:41:15.141892+0000","last_peered":"2021-10-08T19:41:15.141892+0000","last_clean":"2021-10-08T19:41:15.141892+0000","last_became_active":"2021-10-08T19:29:40.634579+0000","last_became_peered":"2021-10-08T19:29:40.634579+0000","last_unstale":"2021-10-08T19:41:15.141892+0000","last_undegraded":"2021-10-08T19:41:15.141892+0000","last_fullsized":"2021-10-08T19:41:15.141892+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:44.228198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:44.228198+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013076706,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"479'10046","reported_seq":10100,"reported_epoch":479,"state":"active+clean","last_fresh":"2021-10-08T19:41:24.584261+0000","last_change":"2021-10-08T19:39:04.508265+0000","last_active":"2021-10-08T19:41:24.584261+0000","last_peered":"2021-10-08T19:41:24.584261+0000","last_clean":"2021-10-08T19:41:24.584261+0000","last_became_active":"2021-10-08T19:39:04.507950+0000","last_became_peered":"2021-10-08T19:39:04.507950+0000","last_unstale":"2021-10-08T19:41:24.584261+0000","last_undegraded":"2021-10-08T19:41:24.584261+0000","last_fullsized":"2021-10-08T19:41:24.584261+0000","mapping_epoch":433,"log_start":"461'5800","ondisk_log_start":"461'5800","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:03.490762+0000","log_size":4246,"ondisk_log_size":4246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":269746176,"num_objects":4116,"num_object_clones":0,"num_object_copies":12348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4116,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10046,"num_write_kb":453184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,4],"acting":[1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"90'130","reported_seq":582,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:20.888949+0000","last_change":"2021-10-08T19:41:20.888804+0000","last_active":"2021-10-08T19:41:20.888949+0000","last_peered":"2021-10-08T19:41:20.888949+0000","last_clean":"2021-10-08T19:41:20.888949+0000","last_became_active":"2021-10-08T19:30:00.643797+0000","last_became_peered":"2021-10-08T19:30:00.643797+0000","last_unstale":"2021-10-08T19:41:20.888949+0000","last_undegraded":"2021-10-08T19:41:20.888949+0000","last_fullsized":"2021-10-08T19:41:20.888949+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:41:20.888698+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:41:20.888698+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0053594769999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":419,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:17.860426+0000","last_change":"2021-10-08T19:41:17.860285+0000","last_active":"2021-10-08T19:41:17.860426+0000","last_peered":"2021-10-08T19:41:17.860426+0000","last_clean":"2021-10-08T19:41:17.860426+0000","last_became_active":"2021-10-08T19:24:25.095389+0000","last_became_peered":"2021-10-08T19:24:25.095389+0000","last_unstale":"2021-10-08T19:41:17.860426+0000","last_undegraded":"2021-10-08T19:41:17.860426+0000","last_fullsized":"2021-10-08T19:41:17.860426+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:41:17.859917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:41:17.859917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0055520150000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"289'29","reported_seq":518,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.145225+0000","last_change":"2021-10-08T19:40:39.869360+0000","last_active":"2021-10-08T19:41:15.145225+0000","last_peered":"2021-10-08T19:41:15.145225+0000","last_clean":"2021-10-08T19:41:15.145225+0000","last_became_active":"2021-10-08T19:21:25.741812+0000","last_became_peered":"2021-10-08T19:21:25.741812+0000","last_unstale":"2021-10-08T19:41:15.145225+0000","last_undegraded":"2021-10-08T19:41:15.145225+0000","last_fullsized":"2021-10-08T19:41:15.145225+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'29","last_scrub_stamp":"2021-10-08T19:40:39.869249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:40:39.869249+0000","log_size":29,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0043767700000000003,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":54,"num_read_kb":40,"num_write":32,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"328'2","reported_seq":482,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.152325+0000","last_change":"2021-10-08T19:39:10.604166+0000","last_active":"2021-10-08T19:41:15.152325+0000","last_peered":"2021-10-08T19:41:15.152325+0000","last_clean":"2021-10-08T19:41:15.152325+0000","last_became_active":"2021-10-08T19:36:58.000171+0000","last_became_peered":"2021-10-08T19:36:58.000171+0000","last_unstale":"2021-10-08T19:41:15.152325+0000","last_undegraded":"2021-10-08T19:41:15.152325+0000","last_fullsized":"2021-10-08T19:41:15.152325+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"328'2","last_scrub_stamp":"2021-10-08T19:39:10.604077+0000","last_deep_scrub":"328'2","last_deep_scrub_stamp":"2021-10-08T19:33:29.990395+0000","last_clean_scrub_stamp":"2021-10-08T19:39:10.604077+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0017862959999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":309,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.149827+0000","last_change":"2021-10-08T19:40:09.995072+0000","last_active":"2021-10-08T19:41:15.149827+0000","last_peered":"2021-10-08T19:41:15.149827+0000","last_clean":"2021-10-08T19:41:15.149827+0000","last_became_active":"2021-10-08T19:28:40.140876+0000","last_became_peered":"2021-10-08T19:28:40.140876+0000","last_unstale":"2021-10-08T19:41:15.149827+0000","last_undegraded":"2021-10-08T19:41:15.149827+0000","last_fullsized":"2021-10-08T19:41:15.149827+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:09.994958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:40:09.994958+0000","last_clean_scrub_stamp":"2021-10-08T19:40:09.994958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.065315867,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"70'5","reported_seq":315,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.154372+0000","last_change":"2021-10-08T19:40:44.202234+0000","last_active":"2021-10-08T19:41:15.154372+0000","last_peered":"2021-10-08T19:41:15.154372+0000","last_clean":"2021-10-08T19:41:15.154372+0000","last_became_active":"2021-10-08T19:28:40.150503+0000","last_became_peered":"2021-10-08T19:28:40.150503+0000","last_unstale":"2021-10-08T19:41:15.154372+0000","last_undegraded":"2021-10-08T19:41:15.154372+0000","last_fullsized":"2021-10-08T19:41:15.154372+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:40:44.202122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:44.202122+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.004019262,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.9","version":"479'10085","reported_seq":10139,"reported_epoch":479,"state":"active+clean","last_fresh":"2021-10-08T19:41:24.327799+0000","last_change":"2021-10-08T19:39:04.512253+0000","last_active":"2021-10-08T19:41:24.327799+0000","last_peered":"2021-10-08T19:41:24.327799+0000","last_clean":"2021-10-08T19:41:24.327799+0000","last_became_active":"2021-10-08T19:39:04.511738+0000","last_became_peered":"2021-10-08T19:39:04.511738+0000","last_unstale":"2021-10-08T19:41:24.327799+0000","last_undegraded":"2021-10-08T19:41:24.327799+0000","last_fullsized":"2021-10-08T19:41:24.327799+0000","mapping_epoch":433,"log_start":"463'6100","ondisk_log_start":"463'6100","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:03.490762+0000","log_size":3985,"ondisk_log_size":3985,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":267190272,"num_objects":4077,"num_object_clones":0,"num_object_copies":12231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4077,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10085,"num_write_kb":453184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"90'130","reported_seq":610,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.153928+0000","last_change":"2021-10-08T19:39:12.712490+0000","last_active":"2021-10-08T19:41:15.153928+0000","last_peered":"2021-10-08T19:41:15.153928+0000","last_clean":"2021-10-08T19:41:15.153928+0000","last_became_active":"2021-10-08T19:28:43.178371+0000","last_became_peered":"2021-10-08T19:28:43.178371+0000","last_unstale":"2021-10-08T19:41:15.153928+0000","last_undegraded":"2021-10-08T19:41:15.153928+0000","last_fullsized":"2021-10-08T19:41:15.153928+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:39:12.712371+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:34:13.653248+0000","last_clean_scrub_stamp":"2021-10-08T19:39:12.712371+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0024492619999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":235,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:18.712064+0000","last_change":"2021-10-08T19:41:18.711612+0000","last_active":"2021-10-08T19:41:18.712064+0000","last_peered":"2021-10-08T19:41:18.712064+0000","last_clean":"2021-10-08T19:41:18.712064+0000","last_became_active":"2021-10-08T19:31:22.783759+0000","last_became_peered":"2021-10-08T19:31:22.783759+0000","last_unstale":"2021-10-08T19:41:18.712064+0000","last_undegraded":"2021-10-08T19:41:18.712064+0000","last_fullsized":"2021-10-08T19:41:18.712064+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:41:18.711517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:41:18.711517+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.028952043,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"289'24","reported_seq":570,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.148824+0000","last_change":"2021-10-08T19:39:58.874015+0000","last_active":"2021-10-08T19:41:15.148824+0000","last_peered":"2021-10-08T19:41:15.148824+0000","last_clean":"2021-10-08T19:41:15.148824+0000","last_became_active":"2021-10-08T19:32:45.154743+0000","last_became_peered":"2021-10-08T19:32:45.154743+0000","last_unstale":"2021-10-08T19:41:15.148824+0000","last_undegraded":"2021-10-08T19:41:15.148824+0000","last_fullsized":"2021-10-08T19:41:15.148824+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'24","last_scrub_stamp":"2021-10-08T19:39:58.873935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:39:58.873935+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010739402,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":30,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":477,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:16.975010+0000","last_change":"2021-10-08T19:41:16.974876+0000","last_active":"2021-10-08T19:41:16.975010+0000","last_peered":"2021-10-08T19:41:16.975010+0000","last_clean":"2021-10-08T19:41:16.975010+0000","last_became_active":"2021-10-08T19:36:58.012034+0000","last_became_peered":"2021-10-08T19:36:58.012034+0000","last_unstale":"2021-10-08T19:41:16.975010+0000","last_undegraded":"2021-10-08T19:41:16.975010+0000","last_fullsized":"2021-10-08T19:41:16.975010+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:41:16.974779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:22.163674+0000","last_clean_scrub_stamp":"2021-10-08T19:41:16.974779+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0078097239999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":499,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.146036+0000","last_change":"2021-10-08T19:39:53.907915+0000","last_active":"2021-10-08T19:41:15.146036+0000","last_peered":"2021-10-08T19:41:15.146036+0000","last_clean":"2021-10-08T19:41:15.146036+0000","last_became_active":"2021-10-08T19:29:40.632010+0000","last_became_peered":"2021-10-08T19:29:40.632010+0000","last_unstale":"2021-10-08T19:41:15.146036+0000","last_undegraded":"2021-10-08T19:41:15.146036+0000","last_fullsized":"2021-10-08T19:41:15.146036+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:53.907799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:53.907799+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0094451080000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":211,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.153490+0000","last_change":"2021-10-08T19:39:22.680310+0000","last_active":"2021-10-08T19:41:15.153490+0000","last_peered":"2021-10-08T19:41:15.153490+0000","last_clean":"2021-10-08T19:41:15.153490+0000","last_became_active":"2021-10-08T19:31:51.673821+0000","last_became_peered":"2021-10-08T19:31:51.673821+0000","last_unstale":"2021-10-08T19:41:15.153490+0000","last_undegraded":"2021-10-08T19:41:15.153490+0000","last_fullsized":"2021-10-08T19:41:15.153490+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:22.680215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:21.644827+0000","last_clean_scrub_stamp":"2021-10-08T19:39:22.680215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002643659,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.a","version":"479'10128","reported_seq":10182,"reported_epoch":479,"state":"active+clean","last_fresh":"2021-10-08T19:41:24.279193+0000","last_change":"2021-10-08T19:39:04.774934+0000","last_active":"2021-10-08T19:41:24.279193+0000","last_peered":"2021-10-08T19:41:24.279193+0000","last_clean":"2021-10-08T19:41:24.279193+0000","last_became_active":"2021-10-08T19:39:04.774503+0000","last_became_peered":"2021-10-08T19:39:04.774503+0000","last_unstale":"2021-10-08T19:41:24.279193+0000","last_undegraded":"2021-10-08T19:41:24.279193+0000","last_fullsized":"2021-10-08T19:41:24.279193+0000","mapping_epoch":433,"log_start":"464'6200","ondisk_log_start":"464'6200","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:03.490762+0000","log_size":3928,"ondisk_log_size":3928,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":275513344,"num_objects":4204,"num_object_clones":0,"num_object_copies":12612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4204,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10128,"num_write_kb":458624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":459,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.153544+0000","last_change":"2021-10-08T19:39:59.811372+0000","last_active":"2021-10-08T19:41:15.153544+0000","last_peered":"2021-10-08T19:41:15.153544+0000","last_clean":"2021-10-08T19:41:15.153544+0000","last_became_active":"2021-10-08T19:21:27.636086+0000","last_became_peered":"2021-10-08T19:21:27.636086+0000","last_unstale":"2021-10-08T19:41:15.153544+0000","last_undegraded":"2021-10-08T19:41:15.153544+0000","last_fullsized":"2021-10-08T19:41:15.153544+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:59.811267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:39:59.811267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0070031299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"443'33","reported_seq":452,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.151483+0000","last_change":"2021-10-08T19:39:26.350865+0000","last_active":"2021-10-08T19:41:15.151483+0000","last_peered":"2021-10-08T19:41:15.151483+0000","last_clean":"2021-10-08T19:41:15.151483+0000","last_became_active":"2021-10-08T19:24:25.100384+0000","last_became_peered":"2021-10-08T19:24:25.100384+0000","last_unstale":"2021-10-08T19:41:15.151483+0000","last_undegraded":"2021-10-08T19:41:15.151483+0000","last_fullsized":"2021-10-08T19:41:15.151483+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"443'33","last_scrub_stamp":"2021-10-08T19:39:26.350786+0000","last_deep_scrub":"443'33","last_deep_scrub_stamp":"2021-10-08T19:39:26.350786+0000","last_clean_scrub_stamp":"2021-10-08T19:39:26.350786+0000","log_size":33,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010726793,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":42,"num_read_kb":32,"num_write":25,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"90'130","reported_seq":772,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.151101+0000","last_change":"2021-10-08T19:39:15.614628+0000","last_active":"2021-10-08T19:41:15.151101+0000","last_peered":"2021-10-08T19:41:15.151101+0000","last_clean":"2021-10-08T19:41:15.151101+0000","last_became_active":"2021-10-08T19:27:22.607289+0000","last_became_peered":"2021-10-08T19:27:22.607289+0000","last_unstale":"2021-10-08T19:41:15.151101+0000","last_undegraded":"2021-10-08T19:41:15.151101+0000","last_fullsized":"2021-10-08T19:41:15.151101+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:39:15.614552+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:39:15.614552+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0018892329999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":477,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.143218+0000","last_change":"2021-10-08T19:40:06.128693+0000","last_active":"2021-10-08T19:41:15.143218+0000","last_peered":"2021-10-08T19:41:15.143218+0000","last_clean":"2021-10-08T19:41:15.143218+0000","last_became_active":"2021-10-08T19:37:45.837378+0000","last_became_peered":"2021-10-08T19:37:45.837378+0000","last_unstale":"2021-10-08T19:41:15.143218+0000","last_undegraded":"2021-10-08T19:41:15.143218+0000","last_fullsized":"2021-10-08T19:41:15.143218+0000","mapping_epoch":407,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":408,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:06.128585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:06.128585+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011647138,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":269,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.140682+0000","last_change":"2021-10-08T19:39:19.171728+0000","last_active":"2021-10-08T19:41:15.140682+0000","last_peered":"2021-10-08T19:41:15.140682+0000","last_clean":"2021-10-08T19:41:15.140682+0000","last_became_active":"2021-10-08T19:29:40.638774+0000","last_became_peered":"2021-10-08T19:29:40.638774+0000","last_unstale":"2021-10-08T19:41:15.140682+0000","last_undegraded":"2021-10-08T19:41:15.140682+0000","last_fullsized":"2021-10-08T19:41:15.140682+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:19.171649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:19.171649+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.008189689,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":298,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.141980+0000","last_change":"2021-10-08T19:38:40.123422+0000","last_active":"2021-10-08T19:41:15.141980+0000","last_peered":"2021-10-08T19:41:15.141980+0000","last_clean":"2021-10-08T19:41:15.141980+0000","last_became_active":"2021-10-08T19:37:19.006459+0000","last_became_peered":"2021-10-08T19:37:19.006459+0000","last_unstale":"2021-10-08T19:41:15.141980+0000","last_undegraded":"2021-10-08T19:41:15.141980+0000","last_fullsized":"2021-10-08T19:41:15.141980+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:40.123325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:32:15.872860+0000","last_clean_scrub_stamp":"2021-10-08T19:38:40.123325+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.103398937,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4],"acting":[3,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"479'10204","reported_seq":10258,"reported_epoch":479,"state":"active+clean","last_fresh":"2021-10-08T19:41:24.314189+0000","last_change":"2021-10-08T19:39:04.774874+0000","last_active":"2021-10-08T19:41:24.314189+0000","last_peered":"2021-10-08T19:41:24.314189+0000","last_clean":"2021-10-08T19:41:24.314189+0000","last_became_active":"2021-10-08T19:39:04.774530+0000","last_became_peered":"2021-10-08T19:39:04.774530+0000","last_unstale":"2021-10-08T19:41:24.314189+0000","last_undegraded":"2021-10-08T19:41:24.314189+0000","last_fullsized":"2021-10-08T19:41:24.314189+0000","mapping_epoch":433,"log_start":"465'6300","ondisk_log_start":"465'6300","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:03.490762+0000","log_size":3904,"ondisk_log_size":3904,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":277086208,"num_objects":4228,"num_object_clones":0,"num_object_copies":12684,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4228,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10204,"num_write_kb":461824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"90'130","reported_seq":780,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.152020+0000","last_change":"2021-10-08T19:39:25.754394+0000","last_active":"2021-10-08T19:41:15.152020+0000","last_peered":"2021-10-08T19:41:15.152020+0000","last_clean":"2021-10-08T19:41:15.152020+0000","last_became_active":"2021-10-08T19:27:26.591250+0000","last_became_peered":"2021-10-08T19:27:26.591250+0000","last_unstale":"2021-10-08T19:41:15.152020+0000","last_undegraded":"2021-10-08T19:41:15.152020+0000","last_fullsized":"2021-10-08T19:41:15.152020+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:39:25.754295+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:39:25.754295+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0065366060000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":475,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.143784+0000","last_change":"2021-10-08T19:40:39.008261+0000","last_active":"2021-10-08T19:41:15.143784+0000","last_peered":"2021-10-08T19:41:15.143784+0000","last_clean":"2021-10-08T19:41:15.143784+0000","last_became_active":"2021-10-08T19:21:27.637875+0000","last_became_peered":"2021-10-08T19:21:27.637875+0000","last_unstale":"2021-10-08T19:41:15.143784+0000","last_undegraded":"2021-10-08T19:41:15.143784+0000","last_fullsized":"2021-10-08T19:41:15.143784+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:39.008146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:20.092069+0000","last_clean_scrub_stamp":"2021-10-08T19:40:39.008146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0068776480000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"289'17","reported_seq":223,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.154402+0000","last_change":"2021-10-08T19:40:43.162940+0000","last_active":"2021-10-08T19:41:15.154402+0000","last_peered":"2021-10-08T19:41:15.154402+0000","last_clean":"2021-10-08T19:41:15.154402+0000","last_became_active":"2021-10-08T19:31:51.674965+0000","last_became_peered":"2021-10-08T19:31:51.674965+0000","last_unstale":"2021-10-08T19:41:15.154402+0000","last_undegraded":"2021-10-08T19:41:15.154402+0000","last_fullsized":"2021-10-08T19:41:15.154402+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'17","last_scrub_stamp":"2021-10-08T19:40:43.162834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:40:43.162834+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0077953040000000003,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":23,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":990,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":508,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:17.997820+0000","last_change":"2021-10-08T19:41:17.997697+0000","last_active":"2021-10-08T19:41:17.997820+0000","last_peered":"2021-10-08T19:41:17.997820+0000","last_clean":"2021-10-08T19:41:17.997820+0000","last_became_active":"2021-10-08T19:36:58.015216+0000","last_became_peered":"2021-10-08T19:36:58.015216+0000","last_unstale":"2021-10-08T19:41:17.997820+0000","last_undegraded":"2021-10-08T19:41:17.997820+0000","last_fullsized":"2021-10-08T19:41:17.997820+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:41:17.997605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:41:17.997605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013133647,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"70'5","reported_seq":313,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.150378+0000","last_change":"2021-10-08T19:39:25.676595+0000","last_active":"2021-10-08T19:41:15.150378+0000","last_peered":"2021-10-08T19:41:15.150378+0000","last_clean":"2021-10-08T19:41:15.150378+0000","last_became_active":"2021-10-08T19:28:40.148054+0000","last_became_peered":"2021-10-08T19:28:40.148054+0000","last_unstale":"2021-10-08T19:41:15.150378+0000","last_undegraded":"2021-10-08T19:41:15.150378+0000","last_fullsized":"2021-10-08T19:41:15.150378+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:39:25.676492+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2021-10-08T19:34:18.630378+0000","last_clean_scrub_stamp":"2021-10-08T19:39:25.676492+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014341095999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":493,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.152246+0000","last_change":"2021-10-08T19:40:54.980585+0000","last_active":"2021-10-08T19:41:15.152246+0000","last_peered":"2021-10-08T19:41:15.152246+0000","last_clean":"2021-10-08T19:41:15.152246+0000","last_became_active":"2021-10-08T19:29:40.652528+0000","last_became_peered":"2021-10-08T19:29:40.652528+0000","last_unstale":"2021-10-08T19:41:15.152246+0000","last_undegraded":"2021-10-08T19:41:15.152246+0000","last_fullsized":"2021-10-08T19:41:15.152246+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:54.980484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:40:54.980484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.052397393,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"479'10265","reported_seq":10319,"reported_epoch":479,"state":"active+clean","last_fresh":"2021-10-08T19:41:24.321304+0000","last_change":"2021-10-08T19:39:04.512013+0000","last_active":"2021-10-08T19:41:24.321304+0000","last_peered":"2021-10-08T19:41:24.321304+0000","last_clean":"2021-10-08T19:41:24.321304+0000","last_became_active":"2021-10-08T19:39:04.511692+0000","last_became_peered":"2021-10-08T19:39:04.511692+0000","last_unstale":"2021-10-08T19:41:24.321304+0000","last_undegraded":"2021-10-08T19:41:24.321304+0000","last_fullsized":"2021-10-08T19:41:24.321304+0000","mapping_epoch":433,"log_start":"464'6300","ondisk_log_start":"464'6300","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:03.490762+0000","log_size":3965,"ondisk_log_size":3965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":273874944,"num_objects":4179,"num_object_clones":0,"num_object_copies":12537,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4179,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10265,"num_write_kb":462208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"90'130","reported_seq":408,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.145883+0000","last_change":"2021-10-08T19:39:59.921790+0000","last_active":"2021-10-08T19:41:15.145883+0000","last_peered":"2021-10-08T19:41:15.145883+0000","last_clean":"2021-10-08T19:41:15.145883+0000","last_became_active":"2021-10-08T19:37:19.032630+0000","last_became_peered":"2021-10-08T19:37:19.032630+0000","last_unstale":"2021-10-08T19:41:15.145883+0000","last_undegraded":"2021-10-08T19:41:15.145883+0000","last_fullsized":"2021-10-08T19:41:15.145883+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:39:59.921660+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:39:59.921660+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.01168085,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":481,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.145917+0000","last_change":"2021-10-08T19:39:55.826848+0000","last_active":"2021-10-08T19:41:15.145917+0000","last_peered":"2021-10-08T19:41:15.145917+0000","last_clean":"2021-10-08T19:41:15.145917+0000","last_became_active":"2021-10-08T19:28:40.133414+0000","last_became_peered":"2021-10-08T19:28:40.133414+0000","last_unstale":"2021-10-08T19:41:15.145917+0000","last_undegraded":"2021-10-08T19:41:15.145917+0000","last_fullsized":"2021-10-08T19:41:15.145917+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:55.826735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:39:55.826735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0091553829999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"289'44","reported_seq":571,"reported_epoch":479,"state":"active+clean","last_fresh":"2021-10-08T19:41:21.509687+0000","last_change":"2021-10-08T19:41:21.509547+0000","last_active":"2021-10-08T19:41:21.509687+0000","last_peered":"2021-10-08T19:41:21.509687+0000","last_clean":"2021-10-08T19:41:21.509687+0000","last_became_active":"2021-10-08T19:29:40.626138+0000","last_became_peered":"2021-10-08T19:29:40.626138+0000","last_unstale":"2021-10-08T19:41:21.509687+0000","last_undegraded":"2021-10-08T19:41:21.509687+0000","last_fullsized":"2021-10-08T19:41:21.509687+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'44","last_scrub_stamp":"2021-10-08T19:41:21.509439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:41:21.509439+0000","log_size":44,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0073374210000000002,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":65,"num_read_kb":50,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":1432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":504,"reported_epoch":479,"state":"active+clean","last_fresh":"2021-10-08T19:41:22.536676+0000","last_change":"2021-10-08T19:41:22.536639+0000","last_active":"2021-10-08T19:41:22.536676+0000","last_peered":"2021-10-08T19:41:22.536676+0000","last_clean":"2021-10-08T19:41:22.536676+0000","last_became_active":"2021-10-08T19:37:19.004386+0000","last_became_peered":"2021-10-08T19:37:19.004386+0000","last_unstale":"2021-10-08T19:41:22.536676+0000","last_undegraded":"2021-10-08T19:41:22.536676+0000","last_fullsized":"2021-10-08T19:41:22.536676+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:41:22.536531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:49.623545+0000","last_clean_scrub_stamp":"2021-10-08T19:41:22.536531+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0086989179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":271,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.141718+0000","last_change":"2021-10-08T19:38:00.340784+0000","last_active":"2021-10-08T19:41:15.141718+0000","last_peered":"2021-10-08T19:41:15.141718+0000","last_clean":"2021-10-08T19:41:15.141718+0000","last_became_active":"2021-10-08T19:29:40.637371+0000","last_became_peered":"2021-10-08T19:29:40.637371+0000","last_unstale":"2021-10-08T19:41:15.141718+0000","last_undegraded":"2021-10-08T19:41:15.141718+0000","last_fullsized":"2021-10-08T19:41:15.141718+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:00.340701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:38:00.340701+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.015510070000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":418,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.147448+0000","last_change":"2021-10-08T19:38:52.106606+0000","last_active":"2021-10-08T19:41:15.147448+0000","last_peered":"2021-10-08T19:41:15.147448+0000","last_clean":"2021-10-08T19:41:15.147448+0000","last_became_active":"2021-10-08T19:25:14.550690+0000","last_became_peered":"2021-10-08T19:25:14.550690+0000","last_unstale":"2021-10-08T19:41:15.147448+0000","last_undegraded":"2021-10-08T19:41:15.147448+0000","last_fullsized":"2021-10-08T19:41:15.147448+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:52.106531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:36:09.181866+0000","last_clean_scrub_stamp":"2021-10-08T19:38:52.106531+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034384849999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.d","version":"479'10084","reported_seq":10145,"reported_epoch":479,"state":"active+clean","last_fresh":"2021-10-08T19:41:24.022690+0000","last_change":"2021-10-08T19:40:43.913456+0000","last_active":"2021-10-08T19:41:24.022690+0000","last_peered":"2021-10-08T19:41:24.022690+0000","last_clean":"2021-10-08T19:41:24.022690+0000","last_became_active":"2021-10-08T19:39:04.508623+0000","last_became_peered":"2021-10-08T19:39:04.508623+0000","last_unstale":"2021-10-08T19:41:24.022690+0000","last_undegraded":"2021-10-08T19:41:24.022690+0000","last_fullsized":"2021-10-08T19:41:24.022690+0000","mapping_epoch":433,"log_start":"457'4900","ondisk_log_start":"457'4900","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"469'7402","last_scrub_stamp":"2021-10-08T19:40:43.913335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:40:43.913335+0000","log_size":5184,"ondisk_log_size":5184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":2.962624098,"stat_sum":{"num_bytes":275841048,"num_objects":4210,"num_object_clones":0,"num_object_copies":12630,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4210,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10084,"num_write_kb":457345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6],"acting":[2,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"90'130","reported_seq":740,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.150135+0000","last_change":"2021-10-08T19:40:01.944949+0000","last_active":"2021-10-08T19:41:15.150135+0000","last_peered":"2021-10-08T19:41:15.150135+0000","last_clean":"2021-10-08T19:41:15.150135+0000","last_became_active":"2021-10-08T19:29:43.636820+0000","last_became_peered":"2021-10-08T19:29:43.636820+0000","last_unstale":"2021-10-08T19:41:15.150135+0000","last_undegraded":"2021-10-08T19:41:15.150135+0000","last_fullsized":"2021-10-08T19:41:15.150135+0000","mapping_epoch":239,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:40:01.944834+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:40:01.944834+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0061141190000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"114'10","reported_seq":742,"reported_epoch":479,"state":"active+clean","last_fresh":"2021-10-08T19:41:21.207209+0000","last_change":"2021-10-08T19:40:54.913771+0000","last_active":"2021-10-08T19:41:21.207209+0000","last_peered":"2021-10-08T19:41:21.207209+0000","last_clean":"2021-10-08T19:41:21.207209+0000","last_became_active":"2021-10-08T19:24:25.106695+0000","last_became_peered":"2021-10-08T19:24:25.106695+0000","last_unstale":"2021-10-08T19:41:21.207209+0000","last_undegraded":"2021-10-08T19:41:21.207209+0000","last_fullsized":"2021-10-08T19:41:21.207209+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'10","last_scrub_stamp":"2021-10-08T19:40:54.913650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:40:54.913650+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.006310749,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"289'20","reported_seq":223,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.150544+0000","last_change":"2021-10-08T19:40:48.298186+0000","last_active":"2021-10-08T19:41:15.150544+0000","last_peered":"2021-10-08T19:41:15.150544+0000","last_clean":"2021-10-08T19:41:15.150544+0000","last_became_active":"2021-10-08T19:31:51.675569+0000","last_became_peered":"2021-10-08T19:31:51.675569+0000","last_unstale":"2021-10-08T19:41:15.150544+0000","last_undegraded":"2021-10-08T19:41:15.150544+0000","last_fullsized":"2021-10-08T19:41:15.150544+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'20","last_scrub_stamp":"2021-10-08T19:40:48.298070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:40:48.298070+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0094577930000000008,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":23,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":324,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:17.462451+0000","last_change":"2021-10-08T19:41:17.462310+0000","last_active":"2021-10-08T19:41:17.462451+0000","last_peered":"2021-10-08T19:41:17.462451+0000","last_clean":"2021-10-08T19:41:17.462451+0000","last_became_active":"2021-10-08T19:36:58.013921+0000","last_became_peered":"2021-10-08T19:36:58.013921+0000","last_unstale":"2021-10-08T19:41:17.462451+0000","last_undegraded":"2021-10-08T19:41:17.462451+0000","last_fullsized":"2021-10-08T19:41:17.462451+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:41:17.462204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:45.612819+0000","last_clean_scrub_stamp":"2021-10-08T19:41:17.462204+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0063392600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":483,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.144818+0000","last_change":"2021-10-08T19:40:49.951176+0000","last_active":"2021-10-08T19:41:15.144818+0000","last_peered":"2021-10-08T19:41:15.144818+0000","last_clean":"2021-10-08T19:41:15.144818+0000","last_became_active":"2021-10-08T19:29:40.643614+0000","last_became_peered":"2021-10-08T19:29:40.643614+0000","last_unstale":"2021-10-08T19:41:15.144818+0000","last_undegraded":"2021-10-08T19:41:15.144818+0000","last_fullsized":"2021-10-08T19:41:15.144818+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:49.951046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:40:49.951046+0000","last_clean_scrub_stamp":"2021-10-08T19:40:49.951046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.073125817999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":262,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.141410+0000","last_change":"2021-10-08T19:39:54.093007+0000","last_active":"2021-10-08T19:41:15.141410+0000","last_peered":"2021-10-08T19:41:15.141410+0000","last_clean":"2021-10-08T19:41:15.141410+0000","last_became_active":"2021-10-08T19:37:19.012488+0000","last_became_peered":"2021-10-08T19:37:19.012488+0000","last_unstale":"2021-10-08T19:41:15.141410+0000","last_undegraded":"2021-10-08T19:41:15.141410+0000","last_fullsized":"2021-10-08T19:41:15.141410+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:54.092909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:54.092909+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0066472559999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,2],"acting":[3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.6","version":"479'9931","reported_seq":9991,"reported_epoch":479,"state":"active+clean","last_fresh":"2021-10-08T19:41:23.749960+0000","last_change":"2021-10-08T19:40:53.997643+0000","last_active":"2021-10-08T19:41:23.749960+0000","last_peered":"2021-10-08T19:41:23.749960+0000","last_clean":"2021-10-08T19:41:23.749960+0000","last_became_active":"2021-10-08T19:39:04.514288+0000","last_became_peered":"2021-10-08T19:39:04.514288+0000","last_unstale":"2021-10-08T19:41:23.749960+0000","last_undegraded":"2021-10-08T19:41:23.749960+0000","last_fullsized":"2021-10-08T19:41:23.749960+0000","mapping_epoch":433,"log_start":"459'5100","ondisk_log_start":"459'5100","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"471'7995","last_scrub_stamp":"2021-10-08T19:40:53.997536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:40:53.997536+0000","log_size":4831,"ondisk_log_size":4831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":3.0690331159999999,"stat_sum":{"num_bytes":276758528,"num_objects":4223,"num_object_clones":0,"num_object_copies":12669,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4223,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9931,"num_write_kb":452928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":491,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.142737+0000","last_change":"2021-10-08T19:40:08.190048+0000","last_active":"2021-10-08T19:41:15.142737+0000","last_peered":"2021-10-08T19:41:15.142737+0000","last_clean":"2021-10-08T19:41:15.142737+0000","last_became_active":"2021-10-08T19:28:40.138726+0000","last_became_peered":"2021-10-08T19:28:40.138726+0000","last_unstale":"2021-10-08T19:41:15.142737+0000","last_undegraded":"2021-10-08T19:41:15.142737+0000","last_fullsized":"2021-10-08T19:41:15.142737+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:08.189929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:50.435552+0000","last_clean_scrub_stamp":"2021-10-08T19:40:08.189929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0083115949999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"289'18","reported_seq":570,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.147299+0000","last_change":"2021-10-08T19:38:40.229383+0000","last_active":"2021-10-08T19:41:15.147299+0000","last_peered":"2021-10-08T19:41:15.147299+0000","last_clean":"2021-10-08T19:41:15.147299+0000","last_became_active":"2021-10-08T19:29:40.638957+0000","last_became_peered":"2021-10-08T19:29:40.638957+0000","last_unstale":"2021-10-08T19:41:15.147299+0000","last_undegraded":"2021-10-08T19:41:15.147299+0000","last_fullsized":"2021-10-08T19:41:15.147299+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'18","last_scrub_stamp":"2021-10-08T19:38:40.229289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:38:40.229289+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.015217840999999999,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":25,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"61'2","reported_seq":478,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.147649+0000","last_change":"2021-10-08T19:40:02.407598+0000","last_active":"2021-10-08T19:41:15.147649+0000","last_peered":"2021-10-08T19:41:15.147649+0000","last_clean":"2021-10-08T19:41:15.147649+0000","last_became_active":"2021-10-08T19:21:23.603614+0000","last_became_peered":"2021-10-08T19:21:23.603614+0000","last_unstale":"2021-10-08T19:41:15.147649+0000","last_undegraded":"2021-10-08T19:41:15.147649+0000","last_fullsized":"2021-10-08T19:41:15.147649+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'2","last_scrub_stamp":"2021-10-08T19:40:02.407482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:02.407482+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0060178940000000002,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":271,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.140950+0000","last_change":"2021-10-08T19:39:11.360634+0000","last_active":"2021-10-08T19:41:15.140950+0000","last_peered":"2021-10-08T19:41:15.140950+0000","last_clean":"2021-10-08T19:41:15.140950+0000","last_became_active":"2021-10-08T19:29:40.645211+0000","last_became_peered":"2021-10-08T19:29:40.645211+0000","last_unstale":"2021-10-08T19:41:15.140950+0000","last_undegraded":"2021-10-08T19:41:15.140950+0000","last_fullsized":"2021-10-08T19:41:15.140950+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:11.360528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:11.360528+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.12852046,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":398,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.154519+0000","last_change":"2021-10-08T19:40:03.902724+0000","last_active":"2021-10-08T19:41:15.154519+0000","last_peered":"2021-10-08T19:41:15.154519+0000","last_clean":"2021-10-08T19:41:15.154519+0000","last_became_active":"2021-10-08T19:28:40.100770+0000","last_became_peered":"2021-10-08T19:28:40.100770+0000","last_unstale":"2021-10-08T19:41:15.154519+0000","last_undegraded":"2021-10-08T19:41:15.154519+0000","last_fullsized":"2021-10-08T19:41:15.154519+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:03.902636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:03.902636+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011310317,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"289'15","reported_seq":530,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.148918+0000","last_change":"2021-10-08T19:39:54.875637+0000","last_active":"2021-10-08T19:41:15.148918+0000","last_peered":"2021-10-08T19:41:15.148918+0000","last_clean":"2021-10-08T19:41:15.148918+0000","last_became_active":"2021-10-08T19:29:40.644354+0000","last_became_peered":"2021-10-08T19:29:40.644354+0000","last_unstale":"2021-10-08T19:41:15.148918+0000","last_undegraded":"2021-10-08T19:41:15.148918+0000","last_fullsized":"2021-10-08T19:41:15.148918+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'15","last_scrub_stamp":"2021-10-08T19:39:54.875517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:39:54.875517+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010969082,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":503,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.142666+0000","last_change":"2021-10-08T19:40:32.125560+0000","last_active":"2021-10-08T19:41:15.142666+0000","last_peered":"2021-10-08T19:41:15.142666+0000","last_clean":"2021-10-08T19:41:15.142666+0000","last_became_active":"2021-10-08T19:28:40.139234+0000","last_became_peered":"2021-10-08T19:28:40.139234+0000","last_unstale":"2021-10-08T19:41:15.142666+0000","last_undegraded":"2021-10-08T19:41:15.142666+0000","last_fullsized":"2021-10-08T19:41:15.142666+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:32.125490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:32.125490+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010928068000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":269,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.141980+0000","last_change":"2021-10-08T19:38:51.158307+0000","last_active":"2021-10-08T19:41:15.141980+0000","last_peered":"2021-10-08T19:41:15.141980+0000","last_clean":"2021-10-08T19:41:15.141980+0000","last_became_active":"2021-10-08T19:29:40.645111+0000","last_became_peered":"2021-10-08T19:29:40.645111+0000","last_unstale":"2021-10-08T19:41:15.141980+0000","last_undegraded":"2021-10-08T19:41:15.141980+0000","last_fullsized":"2021-10-08T19:41:15.141980+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:51.158228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:38:51.158228+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020157690000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":469,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.144537+0000","last_change":"2021-10-08T19:40:02.108048+0000","last_active":"2021-10-08T19:41:15.144537+0000","last_peered":"2021-10-08T19:41:15.144537+0000","last_clean":"2021-10-08T19:41:15.144537+0000","last_became_active":"2021-10-08T19:21:29.640674+0000","last_became_peered":"2021-10-08T19:21:29.640674+0000","last_unstale":"2021-10-08T19:41:15.144537+0000","last_undegraded":"2021-10-08T19:41:15.144537+0000","last_fullsized":"2021-10-08T19:41:15.144537+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:02.107943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:40:02.107943+0000","last_clean_scrub_stamp":"2021-10-08T19:40:02.107943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0082285750000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":390,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.152189+0000","last_change":"2021-10-08T19:40:47.809293+0000","last_active":"2021-10-08T19:41:15.152189+0000","last_peered":"2021-10-08T19:41:15.152189+0000","last_clean":"2021-10-08T19:41:15.152189+0000","last_became_active":"2021-10-08T19:25:15.501118+0000","last_became_peered":"2021-10-08T19:25:15.501118+0000","last_unstale":"2021-10-08T19:41:15.152189+0000","last_undegraded":"2021-10-08T19:41:15.152189+0000","last_fullsized":"2021-10-08T19:41:15.152189+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:47.809188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:47.809188+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0032071320000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"289'12","reported_seq":292,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.141904+0000","last_change":"2021-10-08T19:39:58.261469+0000","last_active":"2021-10-08T19:41:15.141904+0000","last_peered":"2021-10-08T19:41:15.141904+0000","last_clean":"2021-10-08T19:41:15.141904+0000","last_became_active":"2021-10-08T19:29:40.644657+0000","last_became_peered":"2021-10-08T19:29:40.644657+0000","last_unstale":"2021-10-08T19:41:15.141904+0000","last_undegraded":"2021-10-08T19:41:15.141904+0000","last_fullsized":"2021-10-08T19:41:15.141904+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'12","last_scrub_stamp":"2021-10-08T19:39:58.261366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:39:58.261366+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0074846620000000004,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":18,"num_read_kb":15,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":431,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.152075+0000","last_change":"2021-10-08T19:39:28.422329+0000","last_active":"2021-10-08T19:41:15.152075+0000","last_peered":"2021-10-08T19:41:15.152075+0000","last_clean":"2021-10-08T19:41:15.152075+0000","last_became_active":"2021-10-08T19:28:40.101898+0000","last_became_peered":"2021-10-08T19:28:40.101898+0000","last_unstale":"2021-10-08T19:41:15.152075+0000","last_undegraded":"2021-10-08T19:41:15.152075+0000","last_fullsized":"2021-10-08T19:41:15.152075+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:28.422254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:16.444582+0000","last_clean_scrub_stamp":"2021-10-08T19:39:28.422254+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0087056440000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":320,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.141517+0000","last_change":"2021-10-08T19:37:49.277058+0000","last_active":"2021-10-08T19:41:15.141517+0000","last_peered":"2021-10-08T19:41:15.141517+0000","last_clean":"2021-10-08T19:41:15.141517+0000","last_became_active":"2021-10-08T19:37:19.011117+0000","last_became_peered":"2021-10-08T19:37:19.011117+0000","last_unstale":"2021-10-08T19:41:15.141517+0000","last_undegraded":"2021-10-08T19:41:15.141517+0000","last_fullsized":"2021-10-08T19:41:15.141517+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:49.276955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:37:49.276955+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014777808,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":481,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.151825+0000","last_change":"2021-10-08T19:40:51.961161+0000","last_active":"2021-10-08T19:41:15.151825+0000","last_peered":"2021-10-08T19:41:15.151825+0000","last_clean":"2021-10-08T19:41:15.151825+0000","last_became_active":"2021-10-08T19:24:25.099371+0000","last_became_peered":"2021-10-08T19:24:25.099371+0000","last_unstale":"2021-10-08T19:41:15.151825+0000","last_undegraded":"2021-10-08T19:41:15.151825+0000","last_fullsized":"2021-10-08T19:41:15.151825+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:51.961084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:40:51.961084+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.038885474000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"70'5","reported_seq":668,"reported_epoch":479,"state":"active+clean","last_fresh":"2021-10-08T19:41:21.872979+0000","last_change":"2021-10-08T19:41:21.872950+0000","last_active":"2021-10-08T19:41:21.872979+0000","last_peered":"2021-10-08T19:41:21.872979+0000","last_clean":"2021-10-08T19:41:21.872979+0000","last_became_active":"2021-10-08T19:31:22.785193+0000","last_became_peered":"2021-10-08T19:31:22.785193+0000","last_unstale":"2021-10-08T19:41:21.872979+0000","last_undegraded":"2021-10-08T19:41:21.872979+0000","last_fullsized":"2021-10-08T19:41:21.872979+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":5,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:41:21.872876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:41:21.872876+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001349397,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"289'20","reported_seq":340,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.141698+0000","last_change":"2021-10-08T19:39:28.248294+0000","last_active":"2021-10-08T19:41:15.141698+0000","last_peered":"2021-10-08T19:41:15.141698+0000","last_clean":"2021-10-08T19:41:15.141698+0000","last_became_active":"2021-10-08T19:31:51.677055+0000","last_became_peered":"2021-10-08T19:31:51.677055+0000","last_unstale":"2021-10-08T19:41:15.141698+0000","last_undegraded":"2021-10-08T19:41:15.141698+0000","last_fullsized":"2021-10-08T19:41:15.141698+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'20","last_scrub_stamp":"2021-10-08T19:39:28.248174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:39:28.248174+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012648767999999999,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":46,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.146955+0000","last_change":"2021-10-08T19:40:39.787067+0000","last_active":"2021-10-08T19:41:15.146955+0000","last_peered":"2021-10-08T19:41:15.146955+0000","last_clean":"2021-10-08T19:41:15.146955+0000","last_became_active":"2021-10-08T19:39:39.136801+0000","last_became_peered":"2021-10-08T19:39:39.136801+0000","last_unstale":"2021-10-08T19:41:15.146955+0000","last_undegraded":"2021-10-08T19:41:15.146955+0000","last_fullsized":"2021-10-08T19:41:15.146955+0000","mapping_epoch":448,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":449,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:39.786960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:39.786960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011731676999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,2],"acting":[4,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"398'12","reported_seq":620,"reported_epoch":479,"state":"active+clean","last_fresh":"2021-10-08T19:41:21.201484+0000","last_change":"2021-10-08T19:39:58.937602+0000","last_active":"2021-10-08T19:41:21.201484+0000","last_peered":"2021-10-08T19:41:21.201484+0000","last_clean":"2021-10-08T19:41:21.201484+0000","last_became_active":"2021-10-08T19:37:19.015189+0000","last_became_peered":"2021-10-08T19:37:19.015189+0000","last_unstale":"2021-10-08T19:41:21.201484+0000","last_undegraded":"2021-10-08T19:41:21.201484+0000","last_fullsized":"2021-10-08T19:41:21.201484+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"398'12","last_scrub_stamp":"2021-10-08T19:39:58.937499+0000","last_deep_scrub":"328'11","last_deep_scrub_stamp":"2021-10-08T19:33:32.545870+0000","last_clean_scrub_stamp":"2021-10-08T19:39:58.937499+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012203161000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":477,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.148734+0000","last_change":"2021-10-08T19:40:11.028411+0000","last_active":"2021-10-08T19:41:15.148734+0000","last_peered":"2021-10-08T19:41:15.148734+0000","last_clean":"2021-10-08T19:41:15.148734+0000","last_became_active":"2021-10-08T19:29:40.644819+0000","last_became_peered":"2021-10-08T19:29:40.644819+0000","last_unstale":"2021-10-08T19:41:15.148734+0000","last_undegraded":"2021-10-08T19:41:15.148734+0000","last_fullsized":"2021-10-08T19:41:15.148734+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:11.028298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:40:11.028298+0000","last_clean_scrub_stamp":"2021-10-08T19:40:11.028298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.053608935000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":386,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.152987+0000","last_change":"2021-10-08T19:40:04.898401+0000","last_active":"2021-10-08T19:41:15.152987+0000","last_peered":"2021-10-08T19:41:15.152987+0000","last_clean":"2021-10-08T19:41:15.152987+0000","last_became_active":"2021-10-08T19:25:15.498770+0000","last_became_peered":"2021-10-08T19:25:15.498770+0000","last_unstale":"2021-10-08T19:41:15.152987+0000","last_undegraded":"2021-10-08T19:41:15.152987+0000","last_fullsized":"2021-10-08T19:41:15.152987+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:04.898293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:04.898293+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010628007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"289'15","reported_seq":131,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.152165+0000","last_change":"2021-10-08T19:39:32.769018+0000","last_active":"2021-10-08T19:41:15.152165+0000","last_peered":"2021-10-08T19:41:15.152165+0000","last_clean":"2021-10-08T19:41:15.152165+0000","last_became_active":"2021-10-08T19:37:19.007551+0000","last_became_peered":"2021-10-08T19:37:19.007551+0000","last_unstale":"2021-10-08T19:41:15.152165+0000","last_undegraded":"2021-10-08T19:41:15.152165+0000","last_fullsized":"2021-10-08T19:41:15.152165+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'15","last_scrub_stamp":"2021-10-08T19:39:32.768897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:39:32.768897+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0067183929999999996,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":487,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.145424+0000","last_change":"2021-10-08T19:39:09.108744+0000","last_active":"2021-10-08T19:41:15.145424+0000","last_peered":"2021-10-08T19:41:15.145424+0000","last_clean":"2021-10-08T19:41:15.145424+0000","last_became_active":"2021-10-08T19:29:44.439397+0000","last_became_peered":"2021-10-08T19:29:44.439397+0000","last_unstale":"2021-10-08T19:41:15.145424+0000","last_undegraded":"2021-10-08T19:41:15.145424+0000","last_fullsized":"2021-10-08T19:41:15.145424+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:09.108669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:09.108669+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.057135996000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"413'11","reported_seq":415,"reported_epoch":479,"state":"active+clean","last_fresh":"2021-10-08T19:41:21.222210+0000","last_change":"2021-10-08T19:37:59.373999+0000","last_active":"2021-10-08T19:41:21.222210+0000","last_peered":"2021-10-08T19:41:21.222210+0000","last_clean":"2021-10-08T19:41:21.222210+0000","last_became_active":"2021-10-08T19:29:40.637650+0000","last_became_peered":"2021-10-08T19:29:40.637650+0000","last_unstale":"2021-10-08T19:41:21.222210+0000","last_undegraded":"2021-10-08T19:41:21.222210+0000","last_fullsized":"2021-10-08T19:41:21.222210+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"413'11","last_scrub_stamp":"2021-10-08T19:37:59.373882+0000","last_deep_scrub":"413'11","last_deep_scrub_stamp":"2021-10-08T19:37:59.373882+0000","last_clean_scrub_stamp":"2021-10-08T19:37:59.373882+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0097897460000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":456,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.147936+0000","last_change":"2021-10-08T19:40:09.484050+0000","last_active":"2021-10-08T19:41:15.147936+0000","last_peered":"2021-10-08T19:41:15.147936+0000","last_clean":"2021-10-08T19:41:15.147936+0000","last_became_active":"2021-10-08T19:21:29.640302+0000","last_became_peered":"2021-10-08T19:21:29.640302+0000","last_unstale":"2021-10-08T19:41:15.147936+0000","last_undegraded":"2021-10-08T19:41:15.147936+0000","last_fullsized":"2021-10-08T19:41:15.147936+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:09.483932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:40:09.483932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.14512376099999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":398,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.146243+0000","last_change":"2021-10-08T19:39:22.092570+0000","last_active":"2021-10-08T19:41:15.146243+0000","last_peered":"2021-10-08T19:41:15.146243+0000","last_clean":"2021-10-08T19:41:15.146243+0000","last_became_active":"2021-10-08T19:29:40.631374+0000","last_became_peered":"2021-10-08T19:29:40.631374+0000","last_unstale":"2021-10-08T19:41:15.146243+0000","last_undegraded":"2021-10-08T19:41:15.146243+0000","last_fullsized":"2021-10-08T19:41:15.146243+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:22.092466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:22.092466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0027849989999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":400,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:21.032638+0000","last_change":"2021-10-08T19:41:21.032638+0000","last_active":"2021-10-08T19:41:21.032638+0000","last_peered":"2021-10-08T19:41:21.032638+0000","last_clean":"2021-10-08T19:41:21.032638+0000","last_became_active":"2021-10-08T19:29:40.652966+0000","last_became_peered":"2021-10-08T19:29:40.652966+0000","last_unstale":"2021-10-08T19:41:21.032638+0000","last_undegraded":"2021-10-08T19:41:21.032638+0000","last_fullsized":"2021-10-08T19:41:21.032638+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:08.748947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:08.748947+0000","last_clean_scrub_stamp":"2021-10-08T19:38:08.748947+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0079490979999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"289'19","reported_seq":223,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.150261+0000","last_change":"2021-10-08T19:39:59.953175+0000","last_active":"2021-10-08T19:41:15.150261+0000","last_peered":"2021-10-08T19:41:15.150261+0000","last_clean":"2021-10-08T19:41:15.150261+0000","last_became_active":"2021-10-08T19:31:51.676961+0000","last_became_peered":"2021-10-08T19:31:51.676961+0000","last_unstale":"2021-10-08T19:41:15.150261+0000","last_undegraded":"2021-10-08T19:41:15.150261+0000","last_fullsized":"2021-10-08T19:41:15.150261+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:39:59.953049+0000","last_deep_scrub":"289'19","last_deep_scrub_stamp":"2021-10-08T19:32:46.539792+0000","last_clean_scrub_stamp":"2021-10-08T19:39:59.953049+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0047403150000000002,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":447,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.149899+0000","last_change":"2021-10-08T19:39:16.255115+0000","last_active":"2021-10-08T19:41:15.149899+0000","last_peered":"2021-10-08T19:41:15.149899+0000","last_clean":"2021-10-08T19:41:15.149899+0000","last_became_active":"2021-10-08T19:31:22.786651+0000","last_became_peered":"2021-10-08T19:31:22.786651+0000","last_unstale":"2021-10-08T19:41:15.149899+0000","last_undegraded":"2021-10-08T19:41:15.149899+0000","last_fullsized":"2021-10-08T19:41:15.149899+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:16.255018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:16.255018+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034406480000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":271,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.140871+0000","last_change":"2021-10-08T19:38:06.367374+0000","last_active":"2021-10-08T19:41:15.140871+0000","last_peered":"2021-10-08T19:41:15.140871+0000","last_clean":"2021-10-08T19:41:15.140871+0000","last_became_active":"2021-10-08T19:29:40.644770+0000","last_became_peered":"2021-10-08T19:29:40.644770+0000","last_unstale":"2021-10-08T19:41:15.140871+0000","last_undegraded":"2021-10-08T19:41:15.140871+0000","last_fullsized":"2021-10-08T19:41:15.140871+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:06.367259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:06.367259+0000","last_clean_scrub_stamp":"2021-10-08T19:38:06.367259+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010215291,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":479,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.144782+0000","last_change":"2021-10-08T19:39:56.867112+0000","last_active":"2021-10-08T19:41:15.144782+0000","last_peered":"2021-10-08T19:41:15.144782+0000","last_clean":"2021-10-08T19:41:15.144782+0000","last_became_active":"2021-10-08T19:28:40.133744+0000","last_became_peered":"2021-10-08T19:28:40.133744+0000","last_unstale":"2021-10-08T19:41:15.144782+0000","last_undegraded":"2021-10-08T19:41:15.144782+0000","last_fullsized":"2021-10-08T19:41:15.144782+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:56.866997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:56.866997+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.058090835,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"289'19","reported_seq":610,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.147358+0000","last_change":"2021-10-08T19:39:17.052667+0000","last_active":"2021-10-08T19:41:15.147358+0000","last_peered":"2021-10-08T19:41:15.147358+0000","last_clean":"2021-10-08T19:41:15.147358+0000","last_became_active":"2021-10-08T19:28:40.100196+0000","last_became_peered":"2021-10-08T19:28:40.100196+0000","last_unstale":"2021-10-08T19:41:15.147358+0000","last_undegraded":"2021-10-08T19:41:15.147358+0000","last_fullsized":"2021-10-08T19:41:15.147358+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:39:17.052565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:39:17.052565+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0059573320000000001,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":317,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.154071+0000","last_change":"2021-10-08T19:40:03.951140+0000","last_active":"2021-10-08T19:41:15.154071+0000","last_peered":"2021-10-08T19:41:15.154071+0000","last_clean":"2021-10-08T19:41:15.154071+0000","last_became_active":"2021-10-08T19:28:40.146673+0000","last_became_peered":"2021-10-08T19:28:40.146673+0000","last_unstale":"2021-10-08T19:41:15.154071+0000","last_undegraded":"2021-10-08T19:41:15.154071+0000","last_fullsized":"2021-10-08T19:41:15.154071+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:03.950996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:09.610637+0000","last_clean_scrub_stamp":"2021-10-08T19:40:03.950996+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.021277893999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":327,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.150622+0000","last_change":"2021-10-08T19:39:54.862550+0000","last_active":"2021-10-08T19:41:15.150622+0000","last_peered":"2021-10-08T19:41:15.150622+0000","last_clean":"2021-10-08T19:41:15.150622+0000","last_became_active":"2021-10-08T19:29:40.638536+0000","last_became_peered":"2021-10-08T19:29:40.638536+0000","last_unstale":"2021-10-08T19:41:15.150622+0000","last_undegraded":"2021-10-08T19:41:15.150622+0000","last_fullsized":"2021-10-08T19:41:15.150622+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:54.862426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:43.186684+0000","last_clean_scrub_stamp":"2021-10-08T19:39:54.862426+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014441246,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":269,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.141344+0000","last_change":"2021-10-08T19:38:47.187888+0000","last_active":"2021-10-08T19:41:15.141344+0000","last_peered":"2021-10-08T19:41:15.141344+0000","last_clean":"2021-10-08T19:41:15.141344+0000","last_became_active":"2021-10-08T19:29:40.634300+0000","last_became_peered":"2021-10-08T19:29:40.634300+0000","last_unstale":"2021-10-08T19:41:15.141344+0000","last_undegraded":"2021-10-08T19:41:15.141344+0000","last_fullsized":"2021-10-08T19:41:15.141344+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:47.187765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:47.187765+0000","last_clean_scrub_stamp":"2021-10-08T19:38:47.187765+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013817288,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"70'5","reported_seq":386,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.149541+0000","last_change":"2021-10-08T19:40:47.760720+0000","last_active":"2021-10-08T19:41:15.149541+0000","last_peered":"2021-10-08T19:41:15.149541+0000","last_clean":"2021-10-08T19:41:15.149541+0000","last_became_active":"2021-10-08T19:25:15.496309+0000","last_became_peered":"2021-10-08T19:25:15.496309+0000","last_unstale":"2021-10-08T19:41:15.149541+0000","last_undegraded":"2021-10-08T19:41:15.149541+0000","last_fullsized":"2021-10-08T19:41:15.149541+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:40:47.760595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:47.760595+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0059370550000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.10","version":"289'8","reported_seq":298,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.141023+0000","last_change":"2021-10-08T19:39:59.311631+0000","last_active":"2021-10-08T19:41:15.141023+0000","last_peered":"2021-10-08T19:41:15.141023+0000","last_clean":"2021-10-08T19:41:15.141023+0000","last_became_active":"2021-10-08T19:32:45.165103+0000","last_became_peered":"2021-10-08T19:32:45.165103+0000","last_unstale":"2021-10-08T19:41:15.141023+0000","last_undegraded":"2021-10-08T19:41:15.141023+0000","last_fullsized":"2021-10-08T19:41:15.141023+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'8","last_scrub_stamp":"2021-10-08T19:39:59.311531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:39:59.311531+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013231531,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":186,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.150124+0000","last_change":"2021-10-08T19:39:53.941356+0000","last_active":"2021-10-08T19:41:15.150124+0000","last_peered":"2021-10-08T19:41:15.150124+0000","last_clean":"2021-10-08T19:41:15.150124+0000","last_became_active":"2021-10-08T19:37:19.009349+0000","last_became_peered":"2021-10-08T19:37:19.009349+0000","last_unstale":"2021-10-08T19:41:15.150124+0000","last_undegraded":"2021-10-08T19:41:15.150124+0000","last_fullsized":"2021-10-08T19:41:15.150124+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:53.941264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:13.716331+0000","last_clean_scrub_stamp":"2021-10-08T19:39:53.941264+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0037200029999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":422,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.152143+0000","last_change":"2021-10-08T19:40:08.939758+0000","last_active":"2021-10-08T19:41:15.152143+0000","last_peered":"2021-10-08T19:41:15.152143+0000","last_clean":"2021-10-08T19:41:15.152143+0000","last_became_active":"2021-10-08T19:24:25.106186+0000","last_became_peered":"2021-10-08T19:24:25.106186+0000","last_unstale":"2021-10-08T19:41:15.152143+0000","last_undegraded":"2021-10-08T19:41:15.152143+0000","last_fullsized":"2021-10-08T19:41:15.152143+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:08.939657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:18.377739+0000","last_clean_scrub_stamp":"2021-10-08T19:40:08.939657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014123263,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":459,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.152100+0000","last_change":"2021-10-08T19:39:23.706599+0000","last_active":"2021-10-08T19:41:15.152100+0000","last_peered":"2021-10-08T19:41:15.152100+0000","last_clean":"2021-10-08T19:41:15.152100+0000","last_became_active":"2021-10-08T19:21:29.642835+0000","last_became_peered":"2021-10-08T19:21:29.642835+0000","last_unstale":"2021-10-08T19:41:15.152100+0000","last_undegraded":"2021-10-08T19:41:15.152100+0000","last_fullsized":"2021-10-08T19:41:15.152100+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:23.706498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:23.706498+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0056310429999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":408,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.145891+0000","last_change":"2021-10-08T19:40:33.560943+0000","last_active":"2021-10-08T19:41:15.145891+0000","last_peered":"2021-10-08T19:41:15.145891+0000","last_clean":"2021-10-08T19:41:15.145891+0000","last_became_active":"2021-10-08T19:28:40.099215+0000","last_became_peered":"2021-10-08T19:28:40.099215+0000","last_unstale":"2021-10-08T19:41:15.145891+0000","last_undegraded":"2021-10-08T19:41:15.145891+0000","last_fullsized":"2021-10-08T19:41:15.145891+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:33.560831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:33.560831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011414511,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"348'24","reported_seq":298,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.141260+0000","last_change":"2021-10-08T19:38:05.385295+0000","last_active":"2021-10-08T19:41:15.141260+0000","last_peered":"2021-10-08T19:41:15.141260+0000","last_clean":"2021-10-08T19:41:15.141260+0000","last_became_active":"2021-10-08T19:29:40.640914+0000","last_became_peered":"2021-10-08T19:29:40.640914+0000","last_unstale":"2021-10-08T19:41:15.141260+0000","last_undegraded":"2021-10-08T19:41:15.141260+0000","last_fullsized":"2021-10-08T19:41:15.141260+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"348'24","last_scrub_stamp":"2021-10-08T19:38:05.385196+0000","last_deep_scrub":"348'24","last_deep_scrub_stamp":"2021-10-08T19:34:53.274250+0000","last_clean_scrub_stamp":"2021-10-08T19:38:05.385196+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0079524399999999999,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":413,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.150262+0000","last_change":"2021-10-08T19:39:30.445681+0000","last_active":"2021-10-08T19:41:15.150262+0000","last_peered":"2021-10-08T19:41:15.150262+0000","last_clean":"2021-10-08T19:41:15.150262+0000","last_became_active":"2021-10-08T19:24:25.098128+0000","last_became_peered":"2021-10-08T19:24:25.098128+0000","last_unstale":"2021-10-08T19:41:15.150262+0000","last_undegraded":"2021-10-08T19:41:15.150262+0000","last_fullsized":"2021-10-08T19:41:15.150262+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:30.445595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:34.508558+0000","last_clean_scrub_stamp":"2021-10-08T19:39:30.445595+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0050654009999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":473,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.151275+0000","last_change":"2021-10-08T19:40:41.841071+0000","last_active":"2021-10-08T19:41:15.151275+0000","last_peered":"2021-10-08T19:41:15.151275+0000","last_clean":"2021-10-08T19:41:15.151275+0000","last_became_active":"2021-10-08T19:24:25.095490+0000","last_became_peered":"2021-10-08T19:24:25.095490+0000","last_unstale":"2021-10-08T19:41:15.151275+0000","last_undegraded":"2021-10-08T19:41:15.151275+0000","last_fullsized":"2021-10-08T19:41:15.151275+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:38.557763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:11.383779+0000","last_clean_scrub_stamp":"2021-10-08T19:38:38.557763+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012167577000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":277,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:16.518063+0000","last_change":"2021-10-08T19:41:16.517571+0000","last_active":"2021-10-08T19:41:16.518063+0000","last_peered":"2021-10-08T19:41:16.518063+0000","last_clean":"2021-10-08T19:41:16.518063+0000","last_became_active":"2021-10-08T19:29:40.639358+0000","last_became_peered":"2021-10-08T19:29:40.639358+0000","last_unstale":"2021-10-08T19:41:16.518063+0000","last_undegraded":"2021-10-08T19:41:16.518063+0000","last_fullsized":"2021-10-08T19:41:16.518063+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:41:16.517497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:36:12.821316+0000","last_clean_scrub_stamp":"2021-10-08T19:41:16.517497+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.133669077,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"289'20","reported_seq":535,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.149130+0000","last_change":"2021-10-08T19:39:16.081314+0000","last_active":"2021-10-08T19:41:15.149130+0000","last_peered":"2021-10-08T19:41:15.149130+0000","last_clean":"2021-10-08T19:41:15.149130+0000","last_became_active":"2021-10-08T19:29:40.636448+0000","last_became_peered":"2021-10-08T19:29:40.636448+0000","last_unstale":"2021-10-08T19:41:15.149130+0000","last_undegraded":"2021-10-08T19:41:15.149130+0000","last_fullsized":"2021-10-08T19:41:15.149130+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'20","last_scrub_stamp":"2021-10-08T19:39:16.081220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:39:16.081220+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0046165160000000002,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":468,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.144249+0000","last_change":"2021-10-08T19:40:38.555450+0000","last_active":"2021-10-08T19:41:15.144249+0000","last_peered":"2021-10-08T19:41:15.144249+0000","last_clean":"2021-10-08T19:41:15.144249+0000","last_became_active":"2021-10-08T19:21:23.604530+0000","last_became_peered":"2021-10-08T19:21:23.604530+0000","last_unstale":"2021-10-08T19:41:15.144249+0000","last_undegraded":"2021-10-08T19:41:15.144249+0000","last_fullsized":"2021-10-08T19:41:15.144249+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:38.555378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:38.555378+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001706328,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1f","version":"114'10","reported_seq":613,"reported_epoch":479,"state":"active+clean","last_fresh":"2021-10-08T19:41:21.206308+0000","last_change":"2021-10-08T19:39:13.217120+0000","last_active":"2021-10-08T19:41:21.206308+0000","last_peered":"2021-10-08T19:41:21.206308+0000","last_clean":"2021-10-08T19:41:21.206308+0000","last_became_active":"2021-10-08T19:24:25.105742+0000","last_became_peered":"2021-10-08T19:24:25.105742+0000","last_unstale":"2021-10-08T19:41:21.206308+0000","last_undegraded":"2021-10-08T19:41:21.206308+0000","last_fullsized":"2021-10-08T19:41:21.206308+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'10","last_scrub_stamp":"2021-10-08T19:39:13.217012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:39:13.217012+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0025013180000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"69'1","reported_seq":458,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.153678+0000","last_change":"2021-10-08T19:40:02.876774+0000","last_active":"2021-10-08T19:41:15.153678+0000","last_peered":"2021-10-08T19:41:15.153678+0000","last_clean":"2021-10-08T19:41:15.153678+0000","last_became_active":"2021-10-08T19:21:29.640296+0000","last_became_peered":"2021-10-08T19:21:29.640296+0000","last_unstale":"2021-10-08T19:41:15.153678+0000","last_undegraded":"2021-10-08T19:41:15.153678+0000","last_fullsized":"2021-10-08T19:41:15.153678+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2021-10-08T19:40:02.876665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:40:02.876665+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011383189,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"390'24","reported_seq":482,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.153963+0000","last_change":"2021-10-08T19:39:33.440040+0000","last_active":"2021-10-08T19:41:15.153963+0000","last_peered":"2021-10-08T19:41:15.153963+0000","last_clean":"2021-10-08T19:41:15.153963+0000","last_became_active":"2021-10-08T19:28:40.126425+0000","last_became_peered":"2021-10-08T19:28:40.126425+0000","last_unstale":"2021-10-08T19:41:15.153963+0000","last_undegraded":"2021-10-08T19:41:15.153963+0000","last_fullsized":"2021-10-08T19:41:15.153963+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"390'24","last_scrub_stamp":"2021-10-08T19:39:33.439960+0000","last_deep_scrub":"390'24","last_deep_scrub_stamp":"2021-10-08T19:39:33.439960+0000","last_clean_scrub_stamp":"2021-10-08T19:39:33.439960+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.030901436000000001,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":269,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.140981+0000","last_change":"2021-10-08T19:37:14.139452+0000","last_active":"2021-10-08T19:41:15.140981+0000","last_peered":"2021-10-08T19:41:15.140981+0000","last_clean":"2021-10-08T19:41:15.140981+0000","last_became_active":"2021-10-08T19:29:40.640952+0000","last_became_peered":"2021-10-08T19:29:40.640952+0000","last_unstale":"2021-10-08T19:41:15.140981+0000","last_undegraded":"2021-10-08T19:41:15.140981+0000","last_fullsized":"2021-10-08T19:41:15.140981+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:14.139384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:37:14.139384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0033835190000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":465,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.149210+0000","last_change":"2021-10-08T19:40:32.036952+0000","last_active":"2021-10-08T19:41:15.149210+0000","last_peered":"2021-10-08T19:41:15.149210+0000","last_clean":"2021-10-08T19:41:15.149210+0000","last_became_active":"2021-10-08T19:21:27.632648+0000","last_became_peered":"2021-10-08T19:21:27.632648+0000","last_unstale":"2021-10-08T19:41:15.149210+0000","last_undegraded":"2021-10-08T19:41:15.149210+0000","last_fullsized":"2021-10-08T19:41:15.149210+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:32.036833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:51.997511+0000","last_clean_scrub_stamp":"2021-10-08T19:40:32.036833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0082112660000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"69'1","reported_seq":313,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.154186+0000","last_change":"2021-10-08T19:40:38.358403+0000","last_active":"2021-10-08T19:41:15.154186+0000","last_peered":"2021-10-08T19:41:15.154186+0000","last_clean":"2021-10-08T19:41:15.154186+0000","last_became_active":"2021-10-08T19:28:40.146302+0000","last_became_peered":"2021-10-08T19:28:40.146302+0000","last_unstale":"2021-10-08T19:41:15.154186+0000","last_undegraded":"2021-10-08T19:41:15.154186+0000","last_fullsized":"2021-10-08T19:41:15.154186+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2021-10-08T19:40:38.358284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:40:38.358284+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.17503824100000001,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"289'27","reported_seq":641,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.144970+0000","last_change":"2021-10-08T19:39:24.100672+0000","last_active":"2021-10-08T19:41:15.144970+0000","last_peered":"2021-10-08T19:41:15.144970+0000","last_clean":"2021-10-08T19:41:15.144970+0000","last_became_active":"2021-10-08T19:29:40.629461+0000","last_became_peered":"2021-10-08T19:29:40.629461+0000","last_unstale":"2021-10-08T19:41:15.144970+0000","last_undegraded":"2021-10-08T19:41:15.144970+0000","last_fullsized":"2021-10-08T19:41:15.144970+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'27","last_scrub_stamp":"2021-10-08T19:39:24.100563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:39:24.100563+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010116653999999999,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":550,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":419,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.150228+0000","last_change":"2021-10-08T19:40:48.873604+0000","last_active":"2021-10-08T19:41:15.150228+0000","last_peered":"2021-10-08T19:41:15.150228+0000","last_clean":"2021-10-08T19:41:15.150228+0000","last_became_active":"2021-10-08T19:24:25.106119+0000","last_became_peered":"2021-10-08T19:24:25.106119+0000","last_unstale":"2021-10-08T19:41:15.150228+0000","last_undegraded":"2021-10-08T19:41:15.150228+0000","last_fullsized":"2021-10-08T19:41:15.150228+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:48.873507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:46.422866+0000","last_clean_scrub_stamp":"2021-10-08T19:40:48.873507+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0080410519999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":311,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.154268+0000","last_change":"2021-10-08T19:39:56.892383+0000","last_active":"2021-10-08T19:41:15.154268+0000","last_peered":"2021-10-08T19:41:15.154268+0000","last_clean":"2021-10-08T19:41:15.154268+0000","last_became_active":"2021-10-08T19:28:40.148009+0000","last_became_peered":"2021-10-08T19:28:40.148009+0000","last_unstale":"2021-10-08T19:41:15.154268+0000","last_undegraded":"2021-10-08T19:41:15.154268+0000","last_fullsized":"2021-10-08T19:41:15.154268+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:56.892286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:39:56.892286+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.018782119,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":470,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.147693+0000","last_change":"2021-10-08T19:38:37.167564+0000","last_active":"2021-10-08T19:41:15.147693+0000","last_peered":"2021-10-08T19:41:15.147693+0000","last_clean":"2021-10-08T19:41:15.147693+0000","last_became_active":"2021-10-08T19:24:25.097782+0000","last_became_peered":"2021-10-08T19:24:25.097782+0000","last_unstale":"2021-10-08T19:41:15.147693+0000","last_undegraded":"2021-10-08T19:41:15.147693+0000","last_fullsized":"2021-10-08T19:41:15.147693+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:37.167455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:37.219503+0000","last_clean_scrub_stamp":"2021-10-08T19:38:37.167455+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0027382449999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"289'18","reported_seq":296,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.141491+0000","last_change":"2021-10-08T19:40:08.385125+0000","last_active":"2021-10-08T19:41:15.141491+0000","last_peered":"2021-10-08T19:41:15.141491+0000","last_clean":"2021-10-08T19:41:15.141491+0000","last_became_active":"2021-10-08T19:29:40.645144+0000","last_became_peered":"2021-10-08T19:29:40.645144+0000","last_unstale":"2021-10-08T19:41:15.141491+0000","last_undegraded":"2021-10-08T19:41:15.141491+0000","last_fullsized":"2021-10-08T19:41:15.141491+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'18","last_scrub_stamp":"2021-10-08T19:40:08.385003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:40:08.385003+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0077571740000000004,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":25,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":269,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.141061+0000","last_change":"2021-10-08T19:39:14.212962+0000","last_active":"2021-10-08T19:41:15.141061+0000","last_peered":"2021-10-08T19:41:15.141061+0000","last_clean":"2021-10-08T19:41:15.141061+0000","last_became_active":"2021-10-08T19:29:44.443807+0000","last_became_peered":"2021-10-08T19:29:44.443807+0000","last_unstale":"2021-10-08T19:41:15.141061+0000","last_undegraded":"2021-10-08T19:41:15.141061+0000","last_fullsized":"2021-10-08T19:41:15.141061+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:14.212865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:32.854550+0000","last_clean_scrub_stamp":"2021-10-08T19:39:14.212865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0077559439999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":476,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.149345+0000","last_change":"2021-10-08T19:39:59.439583+0000","last_active":"2021-10-08T19:41:15.149345+0000","last_peered":"2021-10-08T19:41:15.149345+0000","last_clean":"2021-10-08T19:41:15.149345+0000","last_became_active":"2021-10-08T19:29:40.638352+0000","last_became_peered":"2021-10-08T19:29:40.638352+0000","last_unstale":"2021-10-08T19:41:15.149345+0000","last_undegraded":"2021-10-08T19:41:15.149345+0000","last_fullsized":"2021-10-08T19:41:15.149345+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:59.439435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:39:59.439435+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0082132950000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":287,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.142049+0000","last_change":"2021-10-08T19:39:13.413298+0000","last_active":"2021-10-08T19:41:15.142049+0000","last_peered":"2021-10-08T19:41:15.142049+0000","last_clean":"2021-10-08T19:41:15.142049+0000","last_became_active":"2021-10-08T19:31:22.788455+0000","last_became_peered":"2021-10-08T19:31:22.788455+0000","last_unstale":"2021-10-08T19:41:15.142049+0000","last_undegraded":"2021-10-08T19:41:15.142049+0000","last_fullsized":"2021-10-08T19:41:15.142049+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:13.413194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:32:12.549351+0000","last_clean_scrub_stamp":"2021-10-08T19:39:13.413194+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.173684593,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"289'15","reported_seq":525,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.147832+0000","last_change":"2021-10-08T19:40:12.384765+0000","last_active":"2021-10-08T19:41:15.147832+0000","last_peered":"2021-10-08T19:41:15.147832+0000","last_clean":"2021-10-08T19:41:15.147832+0000","last_became_active":"2021-10-08T19:29:40.631689+0000","last_became_peered":"2021-10-08T19:29:40.631689+0000","last_unstale":"2021-10-08T19:41:15.147832+0000","last_undegraded":"2021-10-08T19:41:15.147832+0000","last_fullsized":"2021-10-08T19:41:15.147832+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'15","last_scrub_stamp":"2021-10-08T19:40:12.384664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:40:12.384664+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012045141000000001,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":467,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.153358+0000","last_change":"2021-10-08T19:39:21.657387+0000","last_active":"2021-10-08T19:41:15.153358+0000","last_peered":"2021-10-08T19:41:15.153358+0000","last_clean":"2021-10-08T19:41:15.153358+0000","last_became_active":"2021-10-08T19:21:23.607785+0000","last_became_peered":"2021-10-08T19:21:23.607785+0000","last_unstale":"2021-10-08T19:41:15.153358+0000","last_undegraded":"2021-10-08T19:41:15.153358+0000","last_fullsized":"2021-10-08T19:41:15.153358+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:21.657316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:21.657316+0000","last_clean_scrub_stamp":"2021-10-08T19:39:21.657316+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034173929999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":472,"reported_epoch":479,"state":"active+clean","last_fresh":"2021-10-08T19:41:22.721911+0000","last_change":"2021-10-08T19:41:22.721884+0000","last_active":"2021-10-08T19:41:22.721911+0000","last_peered":"2021-10-08T19:41:22.721911+0000","last_clean":"2021-10-08T19:41:22.721911+0000","last_became_active":"2021-10-08T19:21:27.633979+0000","last_became_peered":"2021-10-08T19:21:27.633979+0000","last_unstale":"2021-10-08T19:41:22.721911+0000","last_undegraded":"2021-10-08T19:41:22.721911+0000","last_fullsized":"2021-10-08T19:41:22.721911+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:41:22.721778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:27.586341+0000","last_clean_scrub_stamp":"2021-10-08T19:41:22.721778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0057862390000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":479,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.145084+0000","last_change":"2021-10-08T19:39:33.931173+0000","last_active":"2021-10-08T19:41:15.145084+0000","last_peered":"2021-10-08T19:41:15.145084+0000","last_clean":"2021-10-08T19:41:15.145084+0000","last_became_active":"2021-10-08T19:28:40.159162+0000","last_became_peered":"2021-10-08T19:28:40.159162+0000","last_unstale":"2021-10-08T19:41:15.145084+0000","last_undegraded":"2021-10-08T19:41:15.145084+0000","last_fullsized":"2021-10-08T19:41:15.145084+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:33.931043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:33.931043+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.060666474999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"289'7","reported_seq":550,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.147655+0000","last_change":"2021-10-08T19:39:13.080295+0000","last_active":"2021-10-08T19:41:15.147655+0000","last_peered":"2021-10-08T19:41:15.147655+0000","last_clean":"2021-10-08T19:41:15.147655+0000","last_became_active":"2021-10-08T19:31:51.675189+0000","last_became_peered":"2021-10-08T19:31:51.675189+0000","last_unstale":"2021-10-08T19:41:15.147655+0000","last_undegraded":"2021-10-08T19:41:15.147655+0000","last_fullsized":"2021-10-08T19:41:15.147655+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'7","last_scrub_stamp":"2021-10-08T19:39:13.080199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:39:13.080199+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0050767039999999996,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":10,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":489,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.152081+0000","last_change":"2021-10-08T19:40:40.875610+0000","last_active":"2021-10-08T19:41:15.152081+0000","last_peered":"2021-10-08T19:41:15.152081+0000","last_clean":"2021-10-08T19:41:15.152081+0000","last_became_active":"2021-10-08T19:24:25.096225+0000","last_became_peered":"2021-10-08T19:24:25.096225+0000","last_unstale":"2021-10-08T19:41:15.152081+0000","last_undegraded":"2021-10-08T19:41:15.152081+0000","last_fullsized":"2021-10-08T19:41:15.152081+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:40.875537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:29:40.244757+0000","last_clean_scrub_stamp":"2021-10-08T19:40:40.875537+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011385456,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":481,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.151874+0000","last_change":"2021-10-08T19:39:54.903894+0000","last_active":"2021-10-08T19:41:15.151874+0000","last_peered":"2021-10-08T19:41:15.151874+0000","last_clean":"2021-10-08T19:41:15.151874+0000","last_became_active":"2021-10-08T19:28:40.101187+0000","last_became_peered":"2021-10-08T19:28:40.101187+0000","last_unstale":"2021-10-08T19:41:15.151874+0000","last_undegraded":"2021-10-08T19:41:15.151874+0000","last_fullsized":"2021-10-08T19:41:15.151874+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:54.903790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:11.633739+0000","last_clean_scrub_stamp":"2021-10-08T19:39:54.903790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0066268430000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":322,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.149974+0000","last_change":"2021-10-08T19:40:54.582567+0000","last_active":"2021-10-08T19:41:15.149974+0000","last_peered":"2021-10-08T19:41:15.149974+0000","last_clean":"2021-10-08T19:41:15.149974+0000","last_became_active":"2021-10-08T19:37:19.007583+0000","last_became_peered":"2021-10-08T19:37:19.007583+0000","last_unstale":"2021-10-08T19:41:15.149974+0000","last_undegraded":"2021-10-08T19:41:15.149974+0000","last_fullsized":"2021-10-08T19:41:15.149974+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:54.582461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:40:54.582461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.091027166000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"289'19","reported_seq":605,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.146729+0000","last_change":"2021-10-08T19:40:40.799532+0000","last_active":"2021-10-08T19:41:15.146729+0000","last_peered":"2021-10-08T19:41:15.146729+0000","last_clean":"2021-10-08T19:41:15.146729+0000","last_became_active":"2021-10-08T19:28:40.099770+0000","last_became_peered":"2021-10-08T19:28:40.099770+0000","last_unstale":"2021-10-08T19:41:15.146729+0000","last_undegraded":"2021-10-08T19:41:15.146729+0000","last_fullsized":"2021-10-08T19:41:15.146729+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:40:40.799434+0000","last_deep_scrub":"289'19","last_deep_scrub_stamp":"2021-10-08T19:36:15.167374+0000","last_clean_scrub_stamp":"2021-10-08T19:40:40.799434+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0041259089999999997,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":275,"reported_epoch":479,"state":"active+clean","last_fresh":"2021-10-08T19:41:24.255482+0000","last_change":"2021-10-08T19:41:24.255454+0000","last_active":"2021-10-08T19:41:24.255482+0000","last_peered":"2021-10-08T19:41:24.255482+0000","last_clean":"2021-10-08T19:41:24.255482+0000","last_became_active":"2021-10-08T19:29:40.627394+0000","last_became_peered":"2021-10-08T19:29:40.627394+0000","last_unstale":"2021-10-08T19:41:24.255482+0000","last_undegraded":"2021-10-08T19:41:24.255482+0000","last_fullsized":"2021-10-08T19:41:24.255482+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:41:24.255353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:41:24.255353+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0083609789999999993,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":309,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.150121+0000","last_change":"2021-10-08T19:39:24.681886+0000","last_active":"2021-10-08T19:41:15.150121+0000","last_peered":"2021-10-08T19:41:15.150121+0000","last_clean":"2021-10-08T19:41:15.150121+0000","last_became_active":"2021-10-08T19:28:40.145868+0000","last_became_peered":"2021-10-08T19:28:40.145868+0000","last_unstale":"2021-10-08T19:41:15.150121+0000","last_undegraded":"2021-10-08T19:41:15.150121+0000","last_fullsized":"2021-10-08T19:41:15.150121+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:24.681790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:39:24.681790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034071100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":476,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.147169+0000","last_change":"2021-10-08T19:40:50.813705+0000","last_active":"2021-10-08T19:41:15.147169+0000","last_peered":"2021-10-08T19:41:15.147169+0000","last_clean":"2021-10-08T19:41:15.147169+0000","last_became_active":"2021-10-08T19:28:40.099543+0000","last_became_peered":"2021-10-08T19:28:40.099543+0000","last_unstale":"2021-10-08T19:41:15.147169+0000","last_undegraded":"2021-10-08T19:41:15.147169+0000","last_fullsized":"2021-10-08T19:41:15.147169+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:50.813601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:50.032367+0000","last_clean_scrub_stamp":"2021-10-08T19:40:50.813601+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.062705711999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"289'27","reported_seq":303,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.141115+0000","last_change":"2021-10-08T19:38:03.371773+0000","last_active":"2021-10-08T19:41:15.141115+0000","last_peered":"2021-10-08T19:41:15.141115+0000","last_clean":"2021-10-08T19:41:15.141115+0000","last_became_active":"2021-10-08T19:29:40.631002+0000","last_became_peered":"2021-10-08T19:29:40.631002+0000","last_unstale":"2021-10-08T19:41:15.141115+0000","last_undegraded":"2021-10-08T19:41:15.141115+0000","last_fullsized":"2021-10-08T19:41:15.141115+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'27","last_scrub_stamp":"2021-10-08T19:38:03.371690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:38:03.371690+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012656639000000001,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":465,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.148728+0000","last_change":"2021-10-08T19:40:01.981144+0000","last_active":"2021-10-08T19:41:15.148728+0000","last_peered":"2021-10-08T19:41:15.148728+0000","last_clean":"2021-10-08T19:41:15.148728+0000","last_became_active":"2021-10-08T19:21:23.603422+0000","last_became_peered":"2021-10-08T19:21:23.603422+0000","last_unstale":"2021-10-08T19:41:15.148728+0000","last_undegraded":"2021-10-08T19:41:15.148728+0000","last_fullsized":"2021-10-08T19:41:15.148728+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:01.981016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:15.535842+0000","last_clean_scrub_stamp":"2021-10-08T19:40:01.981016+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0019631129999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":496,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.146848+0000","last_change":"2021-10-08T19:39:12.077018+0000","last_active":"2021-10-08T19:41:15.146848+0000","last_peered":"2021-10-08T19:41:15.146848+0000","last_clean":"2021-10-08T19:41:15.146848+0000","last_became_active":"2021-10-08T19:28:40.099286+0000","last_became_peered":"2021-10-08T19:28:40.099286+0000","last_unstale":"2021-10-08T19:41:15.146848+0000","last_undegraded":"2021-10-08T19:41:15.146848+0000","last_fullsized":"2021-10-08T19:41:15.146848+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:12.076904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:31.176160+0000","last_clean_scrub_stamp":"2021-10-08T19:39:12.076904+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.006185444,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":269,"reported_epoch":478,"state":"active+clean","last_fresh":"2021-10-08T19:41:15.141211+0000","last_change":"2021-10-08T19:38:08.397525+0000","last_active":"2021-10-08T19:41:15.141211+0000","last_peered":"2021-10-08T19:41:15.141211+0000","last_clean":"2021-10-08T19:41:15.141211+0000","last_became_active":"2021-10-08T19:29:40.638221+0000","last_became_peered":"2021-10-08T19:29:40.638221+0000","last_unstale":"2021-10-08T19:41:15.141211+0000","last_undegraded":"2021-10-08T19:41:15.141211+0000","last_fullsized":"2021-10-08T19:41:15.141211+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:08.397432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:38:08.397432+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.11831541399999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":16,"stat_sum":{"num_bytes":4376952856,"num_objects":66788,"num_object_clones":0,"num_object_copies":200364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66788,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":160706,"num_write_kb":7279745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":13148958720,"data_stored":13148946504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":67606,"ondisk_log_size":67606,"up":48,"acting":48,"num_store_stats":8},{"poolid":2,"num_pg":42,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":126,"acting":126,"num_store_stats":8},{"poolid":1,"num_pg":11,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1430,"ondisk_log_size":1430,"up":33,"acting":33,"num_store_stats":8},{"poolid":3,"num_pg":23,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":563,"num_read_kb":563,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":778,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":69,"acting":69,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1111,"num_read_kb":868,"num_write":703,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":520,"num_bytes_recovered":10826,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":734,"ondisk_log_size":734,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":84,"ondisk_log_size":84,"up":96,"acting":96,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201524,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1976952,"kb_used_data":1627440,"kb_used_omap":0,"kb_used_meta":349440,"kb_avail":91768200,"statfs":{"total":95995035648,"available":93970636800,"internally_reserved":0,"allocated":1666498560,"data_stored":1666098252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":357826560},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:40:45 2021","interfaces":[{"interface":"back","average":{"1min":1.9670000000000001,"5min":1.587,"15min":1.546},"min":{"1min":0.23400000000000001,"5min":0.223,"15min":0.20100000000000001},"max":{"1min":13.686,"5min":13.686,"15min":26.065000000000001},"last":3.3359999999999999},{"interface":"front","average":{"1min":1.804,"5min":1.4390000000000001,"15min":1.764},"min":{"1min":0.30099999999999999,"5min":0.219,"15min":0.20499999999999999},"max":{"1min":5.0220000000000002,"5min":8.2639999999999993,"15min":25.75},"last":0.317}]},{"osd":1,"last update":"Fri Oct 8 19:40:45 2021","interfaces":[{"interface":"back","average":{"1min":2.5840000000000001,"5min":2.79,"15min":2.2429999999999999},"min":{"1min":0.23200000000000001,"5min":0.215,"15min":0.19600000000000001},"max":{"1min":7.0640000000000001,"5min":87.966999999999999,"15min":87.966999999999999},"last":3.2999999999999998},{"interface":"front","average":{"1min":1.907,"5min":1.4379999999999999,"15min":1.79},"min":{"1min":0.26000000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":9.3510000000000009,"5min":9.3510000000000009,"15min":28.119},"last":2.633}]},{"osd":2,"last update":"Fri Oct 8 19:40:45 2021","interfaces":[{"interface":"back","average":{"1min":2.6070000000000002,"5min":2.5800000000000001,"15min":1.994},"min":{"1min":0.28000000000000003,"5min":0.27600000000000002,"15min":0.255},"max":{"1min":11.23,"5min":81.204999999999998,"15min":81.204999999999998},"last":3.3610000000000002},{"interface":"front","average":{"1min":3.0190000000000001,"5min":2.5870000000000002,"15min":1.96},"min":{"1min":0.26800000000000002,"5min":0.253,"15min":0.253},"max":{"1min":15.632999999999999,"5min":81.022000000000006,"15min":81.022000000000006},"last":4.8920000000000003}]},{"osd":3,"last update":"Fri Oct 8 19:40:45 2021","interfaces":[{"interface":"back","average":{"1min":2.1869999999999998,"5min":2.0249999999999999,"15min":2.3959999999999999},"min":{"1min":0.28799999999999998,"5min":0.28199999999999997,"15min":0.28100000000000003},"max":{"1min":7.3289999999999997,"5min":10.444000000000001,"15min":72.093999999999994},"last":4.9219999999999997},{"interface":"front","average":{"1min":2.3130000000000002,"5min":1.8320000000000001,"15min":2.1970000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28000000000000003},"max":{"1min":13.872,"5min":13.872,"15min":71.864999999999995},"last":0.38200000000000001}]},{"osd":4,"last update":"Fri Oct 8 19:40:45 2021","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.796,"15min":1.244},"min":{"1min":0.254,"5min":0.254,"15min":0.22800000000000001},"max":{"1min":6.2759999999999998,"5min":55.890999999999998,"15min":55.890999999999998},"last":3.5710000000000002},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.8979999999999999,"15min":1.3460000000000001},"min":{"1min":0.25900000000000001,"5min":0.254,"15min":0.254},"max":{"1min":6.9059999999999997,"5min":54.448999999999998,"15min":54.448999999999998},"last":4.9669999999999996}]},{"osd":5,"last update":"Fri Oct 8 19:40:45 2021","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.1799999999999999,"15min":1.147},"min":{"1min":0.30399999999999999,"5min":0.30299999999999999,"15min":0.26800000000000002},"max":{"1min":6.3159999999999998,"5min":6.3159999999999998,"15min":9.9280000000000008},"last":3.383},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.323,"15min":1.2190000000000001},"min":{"1min":0.29999999999999999,"5min":0.28299999999999997,"15min":0.26100000000000001},"max":{"1min":6.9850000000000003,"5min":10.435,"15min":18.655000000000001},"last":4.9470000000000001}]},{"osd":6,"last update":"Fri Oct 8 19:40:45 2021","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.758,"15min":1.3919999999999999},"min":{"1min":0.29899999999999999,"5min":0.28799999999999998,"15min":0.27900000000000003},"max":{"1min":4.633,"5min":58.039000000000001,"15min":58.039000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.996,"15min":1.399},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30299999999999999},"max":{"1min":6.3419999999999996,"5min":58.079999999999998,"15min":58.079999999999998},"last":3.5390000000000001}]}]},{"osd":6,"up_from":47,"seq":201863463160,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2553516,"kb_used_data":2204964,"kb_used_omap":0,"kb_used_meta":348544,"kb_avail":91191636,"statfs":{"total":95995035648,"available":93380235264,"internally_reserved":0,"allocated":2257883136,"data_stored":2257494333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":356909056},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:40:23 2021","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.9410000000000001,"15min":1.617},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":5.1710000000000003,"5min":39.262,"15min":39.262},"last":0.27500000000000002},{"interface":"front","average":{"1min":1.7669999999999999,"5min":2.399,"15min":2.266},"min":{"1min":0.22500000000000001,"5min":0.215,"15min":0.21299999999999999},"max":{"1min":7.4089999999999998,"5min":39.351999999999997,"15min":69.477000000000004},"last":0.998}]},{"osd":1,"last update":"Fri Oct 8 19:40:23 2021","interfaces":[{"interface":"back","average":{"1min":2.3370000000000002,"5min":1.9319999999999999,"15min":1.5089999999999999},"min":{"1min":0.39000000000000001,"5min":0.251,"15min":0.23000000000000001},"max":{"1min":9.7850000000000001,"5min":9.7850000000000001,"15min":14.878},"last":0.223},{"interface":"front","average":{"1min":1.8169999999999999,"5min":1.847,"15min":1.5209999999999999},"min":{"1min":0.27500000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":9.8200000000000003,"5min":9.8200000000000003,"15min":14.779},"last":0.29599999999999999}]},{"osd":2,"last update":"Fri Oct 8 19:40:23 2021","interfaces":[{"interface":"back","average":{"1min":6.5380000000000003,"5min":2.7690000000000001,"15min":2.1789999999999998},"min":{"1min":0.27500000000000002,"5min":0.26000000000000001,"15min":0.251},"max":{"1min":95.846000000000004,"5min":95.846000000000004,"15min":95.846000000000004},"last":0.33700000000000002},{"interface":"front","average":{"1min":6.6109999999999998,"5min":2.9060000000000001,"15min":2.4660000000000002},"min":{"1min":0.252,"5min":0.252,"15min":0.245},"max":{"1min":95.683999999999997,"5min":95.683999999999997,"15min":95.683999999999997},"last":1.0780000000000001}]},{"osd":3,"last update":"Fri Oct 8 19:40:23 2021","interfaces":[{"interface":"back","average":{"1min":7.3170000000000002,"5min":2.9199999999999999,"15min":2.133},"min":{"1min":0.44600000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":96.522000000000006,"5min":96.522000000000006,"15min":96.522000000000006},"last":0.51000000000000001},{"interface":"front","average":{"1min":6.7869999999999999,"5min":3.1669999999999998,"15min":2.0750000000000002},"min":{"1min":0.31900000000000001,"5min":0.317,"15min":0.28000000000000003},"max":{"1min":96.728999999999999,"5min":96.728999999999999,"15min":96.728999999999999},"last":0.35599999999999998}]},{"osd":4,"last update":"Fri Oct 8 19:40:23 2021","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.4099999999999999,"15min":1.1519999999999999},"min":{"1min":0.28199999999999997,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":6.4059999999999997,"5min":6.4059999999999997,"15min":24.516999999999999},"last":1.026},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.6399999999999999,"15min":1.417},"min":{"1min":0.315,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":5.577,"5min":9.9079999999999995,"15min":69.593999999999994},"last":0.47999999999999998}]},{"osd":5,"last update":"Fri Oct 8 19:40:23 2021","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.754,"15min":1.8879999999999999},"min":{"1min":0.308,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":6.4509999999999996,"5min":13.955,"15min":107.485},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.361,"5min":1.647,"15min":2.1019999999999999},"min":{"1min":0.28399999999999997,"5min":0.251,"15min":0.251},"max":{"1min":5.4900000000000002,"5min":7.4900000000000002,"15min":107.90300000000001},"last":1.157}]},{"osd":7,"last update":"Fri Oct 8 19:40:56 2021","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.6499999999999999,"15min":1.2010000000000001},"min":{"1min":0.30399999999999999,"5min":0.29399999999999998,"15min":0.27800000000000002},"max":{"1min":3.75,"5min":8.8840000000000003,"15min":8.8840000000000003},"last":0.59399999999999997},{"interface":"front","average":{"1min":1.8879999999999999,"5min":1.784,"15min":1.405},"min":{"1min":0.36099999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":6.3719999999999999,"5min":8.3740000000000006,"15min":15.962},"last":1.0580000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575115,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2539028,"kb_used_data":2112204,"kb_used_omap":0,"kb_used_meta":426816,"kb_avail":91206124,"statfs":{"total":95995035648,"available":93395070976,"internally_reserved":0,"allocated":2162896896,"data_stored":2162467569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":437059584},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:41:08 2021","interfaces":[{"interface":"back","average":{"1min":2.302,"5min":2.839,"15min":3.194},"min":{"1min":0.221,"5min":0.20100000000000001,"15min":0.188},"max":{"1min":16.417000000000002,"5min":81.459000000000003,"15min":126.256},"last":3.863},{"interface":"front","average":{"1min":3.4460000000000002,"5min":3.395,"15min":3.6230000000000002},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.17799999999999999},"max":{"1min":10.917,"5min":81.853999999999999,"15min":126.176},"last":1.2509999999999999}]},{"osd":2,"last update":"Fri Oct 8 19:40:31 2021","interfaces":[{"interface":"back","average":{"1min":2.3300000000000001,"5min":1.796,"15min":2.335},"min":{"1min":0.252,"5min":0.192,"15min":0.192},"max":{"1min":5.327,"5min":11.497,"15min":102.395},"last":0.49199999999999999},{"interface":"front","average":{"1min":1.913,"5min":1.8200000000000001,"15min":2.7309999999999999},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":7.7350000000000003,"5min":7.7350000000000003,"15min":102.50700000000001},"last":0.441}]},{"osd":3,"last update":"Fri Oct 8 19:40:45 2021","interfaces":[{"interface":"back","average":{"1min":2.6549999999999998,"5min":1.8300000000000001,"15min":2.7909999999999999},"min":{"1min":0.371,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":16.186,"5min":16.186,"15min":105.836},"last":7.2649999999999997},{"interface":"front","average":{"1min":1.71,"5min":1.722,"15min":2.6480000000000001},"min":{"1min":0.33700000000000002,"5min":0.27700000000000002,"15min":0.22900000000000001},"max":{"1min":7.1829999999999998,"5min":9.8460000000000001,"15min":106.12},"last":3.927}]},{"osd":4,"last update":"Fri Oct 8 19:40:50 2021","interfaces":[{"interface":"back","average":{"1min":1.6759999999999999,"5min":1.4550000000000001,"15min":1.958},"min":{"1min":0.29499999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":4.4740000000000002,"5min":6.0659999999999998,"15min":103.538},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.619,"15min":1.8280000000000001},"min":{"1min":0.311,"5min":0.29599999999999999,"15min":0.254},"max":{"1min":4.3129999999999997,"5min":13.9,"15min":102.67100000000001},"last":0.52400000000000002}]},{"osd":5,"last update":"Fri Oct 8 19:41:22 2021","interfaces":[{"interface":"back","average":{"1min":2.4710000000000001,"5min":1.855,"15min":3.3250000000000002},"min":{"1min":0.33900000000000002,"5min":0.29899999999999999,"15min":0.27300000000000002},"max":{"1min":7.3170000000000002,"5min":7.3170000000000002,"15min":262.14100000000002},"last":3.5289999999999999},{"interface":"front","average":{"1min":2.2360000000000002,"5min":1.78,"15min":3.0659999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30099999999999999},"max":{"1min":9.7360000000000007,"5min":9.7360000000000007,"15min":261.959},"last":3.8969999999999998}]},{"osd":6,"last update":"Fri Oct 8 19:40:32 2021","interfaces":[{"interface":"back","average":{"1min":1.583,"5min":1.734,"15min":2.181},"min":{"1min":0.32700000000000001,"5min":0.316,"15min":0.316},"max":{"1min":10.194000000000001,"5min":13.837,"15min":103.73},"last":1.7070000000000001},{"interface":"front","average":{"1min":1.992,"5min":1.641,"15min":2.222},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":7.3490000000000002,"5min":7.3490000000000002,"15min":102.753},"last":3.5529999999999999}]},{"osd":7,"last update":"Fri Oct 8 19:40:50 2021","interfaces":[{"interface":"back","average":{"1min":2.2269999999999999,"5min":1.7609999999999999,"15min":2.597},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.316},"max":{"1min":5.4349999999999996,"5min":7.0979999999999999,"15min":106.011},"last":3.4910000000000001},{"interface":"front","average":{"1min":1.383,"5min":1.5169999999999999,"15min":2.2789999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.34200000000000003},"max":{"1min":5.8600000000000003,"5min":9.7720000000000002,"15min":103.78400000000001},"last":0.68999999999999995}]}]},{"osd":0,"up_from":8,"seq":34359738638,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1779572,"kb_used_data":1366188,"kb_used_omap":0,"kb_used_meta":413376,"kb_avail":91965580,"statfs":{"total":95995035648,"available":94172753920,"internally_reserved":0,"allocated":1398976512,"data_stored":1398579124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":423297024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 8 19:41:10 2021","interfaces":[{"interface":"back","average":{"1min":7.9470000000000001,"5min":3.137,"15min":2.746},"min":{"1min":0.19600000000000001,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":101.68600000000001,"5min":101.68600000000001,"15min":101.68600000000001},"last":0.45700000000000002},{"interface":"front","average":{"1min":8.4179999999999993,"5min":3.1160000000000001,"15min":2.843},"min":{"1min":0.47299999999999998,"5min":0.19900000000000001,"15min":0.19800000000000001},"max":{"1min":101.732,"5min":101.732,"15min":101.732},"last":0.71199999999999997}]},{"osd":2,"last update":"Fri Oct 8 19:40:25 2021","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.663,"15min":2.0209999999999999},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":6.3659999999999997,"5min":9.8030000000000008,"15min":14.814},"last":2.2490000000000001},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.7809999999999999,"15min":1.9610000000000001},"min":{"1min":0.28799999999999998,"5min":0.21099999999999999,"15min":0.20000000000000001},"max":{"1min":3.6640000000000001,"5min":10.509,"15min":10.509},"last":0.35399999999999998}]},{"osd":3,"last update":"Fri Oct 8 19:40:47 2021","interfaces":[{"interface":"back","average":{"1min":3.4980000000000002,"5min":2.0409999999999999,"15min":2.3580000000000001},"min":{"1min":0.41199999999999998,"5min":0.218,"15min":0.217},"max":{"1min":12.782,"5min":12.782,"15min":15.090999999999999},"last":0.26200000000000001},{"interface":"front","average":{"1min":1.9730000000000001,"5min":1.8680000000000001,"15min":1.9790000000000001},"min":{"1min":0.25800000000000001,"5min":0.221,"15min":0.20899999999999999},"max":{"1min":4.4299999999999997,"5min":10.026999999999999,"15min":22.016999999999999},"last":0.38600000000000001}]},{"osd":4,"last update":"Fri Oct 8 19:41:10 2021","interfaces":[{"interface":"back","average":{"1min":1.8069999999999999,"5min":1.865,"15min":1.861},"min":{"1min":0.32600000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":7.6349999999999998,"5min":12.135,"15min":16.805},"last":1.698},{"interface":"front","average":{"1min":1.5960000000000001,"5min":1.591,"15min":1.554},"min":{"1min":0.28499999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":4.4480000000000004,"5min":7.8339999999999996,"15min":11.823},"last":4.79}]},{"osd":5,"last update":"Fri Oct 8 19:41:19 2021","interfaces":[{"interface":"back","average":{"1min":1.9590000000000001,"5min":1.8180000000000001,"15min":1.4890000000000001},"min":{"1min":0.32000000000000001,"5min":0.28199999999999997,"15min":0.27600000000000002},"max":{"1min":5.2140000000000004,"5min":9.9730000000000008,"15min":9.9730000000000008},"last":0.59799999999999998},{"interface":"front","average":{"1min":1.9259999999999999,"5min":2.0939999999999999,"15min":1.903},"min":{"1min":0.38600000000000001,"5min":0.30599999999999999,"15min":0.28599999999999998},"max":{"1min":7.7030000000000003,"5min":12.095000000000001,"15min":15.115},"last":1.835}]},{"osd":6,"last update":"Fri Oct 8 19:40:33 2021","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.653,"15min":1.6930000000000001},"min":{"1min":0.32400000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":3.8050000000000002,"5min":5.931,"15min":11.869},"last":0.64500000000000002},{"interface":"front","average":{"1min":1.7669999999999999,"5min":1.875,"15min":1.736},"min":{"1min":0.39700000000000002,"5min":0.32100000000000001,"15min":0.28199999999999997},"max":{"1min":3.694,"5min":10.002000000000001,"15min":10.002000000000001},"last":0.67300000000000004}]},{"osd":7,"last update":"Fri Oct 8 19:40:47 2021","interfaces":[{"interface":"back","average":{"1min":1.6220000000000001,"5min":1.9830000000000001,"15min":1.96},"min":{"1min":0.42199999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":3.8999999999999999,"5min":13.214,"15min":13.214},"last":3.165},{"interface":"front","average":{"1min":1.5700000000000001,"5min":1.6399999999999999,"15min":1.8280000000000001},"min":{"1min":0.44,"5min":0.315,"15min":0.315},"max":{"1min":3.8290000000000002,"5min":8.7609999999999992,"15min":11.898999999999999},"last":0.85999999999999999}]}]},{"osd":2,"up_from":18,"seq":77309411590,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1995884,"kb_used_data":1635364,"kb_used_omap":0,"kb_used_meta":360320,"kb_avail":91749268,"statfs":{"total":95995035648,"available":93951250432,"internally_reserved":0,"allocated":1674612736,"data_stored":1674223973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":368967680},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:41:21 2021","interfaces":[{"interface":"back","average":{"1min":4.9349999999999996,"5min":2.476,"15min":2.2869999999999999},"min":{"1min":0.318,"5min":0.19600000000000001,"15min":0.184},"max":{"1min":50.759999999999998,"5min":50.759999999999998,"15min":60.990000000000002},"last":0.34599999999999997},{"interface":"front","average":{"1min":5.298,"5min":2.399,"15min":2.2730000000000001},"min":{"1min":0.23000000000000001,"5min":0.193,"15min":0.17999999999999999},"max":{"1min":50.899000000000001,"5min":50.899000000000001,"15min":60.850999999999999},"last":0.54500000000000004}]},{"osd":1,"last update":"Fri Oct 8 19:41:21 2021","interfaces":[{"interface":"back","average":{"1min":4.5949999999999998,"5min":2.4119999999999999,"15min":2.7250000000000001},"min":{"1min":0.215,"5min":0.21299999999999999,"15min":0.19700000000000001},"max":{"1min":50.866999999999997,"5min":50.866999999999997,"15min":63.738},"last":0.32400000000000001},{"interface":"front","average":{"1min":5.556,"5min":2.5419999999999998,"15min":2.9049999999999998},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":50.978000000000002,"5min":50.978000000000002,"15min":63.619999999999997},"last":0.36499999999999999}]},{"osd":3,"last update":"Fri Oct 8 19:40:24 2021","interfaces":[{"interface":"back","average":{"1min":2.1789999999999998,"5min":2.5510000000000002,"15min":3.177},"min":{"1min":0.27600000000000002,"5min":0.245,"15min":0.21199999999999999},"max":{"1min":8.5459999999999994,"5min":67.198999999999998,"15min":67.198999999999998},"last":0.217},{"interface":"front","average":{"1min":2.1619999999999999,"5min":2.5659999999999998,"15min":3.0350000000000001},"min":{"1min":0.26500000000000001,"5min":0.22900000000000001,"15min":0.21299999999999999},"max":{"1min":10.635999999999999,"5min":66.963999999999999,"15min":66.963999999999999},"last":3.903}]},{"osd":4,"last update":"Fri Oct 8 19:40:50 2021","interfaces":[{"interface":"back","average":{"1min":4.4160000000000004,"5min":2.367,"15min":1.831},"min":{"1min":0.38900000000000001,"5min":0.315,"15min":0.26900000000000002},"max":{"1min":52.482999999999997,"5min":52.482999999999997,"15min":52.482999999999997},"last":3.6739999999999999},{"interface":"front","average":{"1min":4.3760000000000003,"5min":2.5,"15min":1.835},"min":{"1min":0.33000000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":51.015000000000001,"5min":51.015000000000001,"15min":51.015000000000001},"last":0.40100000000000002}]},{"osd":5,"last update":"Fri Oct 8 19:41:21 2021","interfaces":[{"interface":"back","average":{"1min":6.3739999999999997,"5min":2.7040000000000002,"15min":1.9950000000000001},"min":{"1min":0.311,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":52.354999999999997,"5min":52.354999999999997,"15min":52.354999999999997},"last":0.42399999999999999},{"interface":"front","average":{"1min":4.452,"5min":2.0819999999999999,"15min":1.9119999999999999},"min":{"1min":0.42599999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":51.082999999999998,"5min":51.082999999999998,"15min":51.082999999999998},"last":0.48199999999999998}]},{"osd":6,"last update":"Fri Oct 8 19:40:24 2021","interfaces":[{"interface":"back","average":{"1min":4.4859999999999998,"5min":2.4169999999999998,"15min":1.8480000000000001},"min":{"1min":0.34899999999999998,"5min":0.33800000000000002,"15min":0.28000000000000003},"max":{"1min":55.970999999999997,"5min":55.970999999999997,"15min":55.970999999999997},"last":5.0389999999999997},{"interface":"front","average":{"1min":4.6619999999999999,"5min":2.4390000000000001,"15min":2.0129999999999999},"min":{"1min":0.36899999999999999,"5min":0.31,"15min":0.31},"max":{"1min":56.433,"5min":56.433,"15min":56.433},"last":0.51400000000000001}]},{"osd":7,"last update":"Fri Oct 8 19:40:50 2021","interfaces":[{"interface":"back","average":{"1min":4.423,"5min":2.359,"15min":2.5049999999999999},"min":{"1min":0.41099999999999998,"5min":0.37,"15min":0.32200000000000001},"max":{"1min":52.610999999999997,"5min":52.610999999999997,"15min":136.00200000000001},"last":3.6299999999999999},{"interface":"front","average":{"1min":4.0739999999999998,"5min":2.339,"15min":2.4609999999999999},"min":{"1min":0.40400000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":51.100999999999999,"5min":51.100999999999999,"15min":133.26300000000001},"last":0.56000000000000005}]}]},{"osd":3,"up_from":24,"seq":103079215364,"num_pgs":77,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2327500,"kb_used_data":1876356,"kb_used_omap":0,"kb_used_meta":451072,"kb_avail":91417652,"statfs":{"total":95995035648,"available":93611675648,"internally_reserved":0,"allocated":1921388544,"data_stored":1920967999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":461897728},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:40:40 2021","interfaces":[{"interface":"back","average":{"1min":2.0550000000000002,"5min":1.631,"15min":2.161},"min":{"1min":0.219,"5min":0.187,"15min":0.17000000000000001},"max":{"1min":12.51,"5min":12.51,"15min":17.553999999999998},"last":2.7010000000000001},{"interface":"front","average":{"1min":2.6160000000000001,"5min":1.9219999999999999,"15min":2.105},"min":{"1min":0.20999999999999999,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":12.93,"5min":12.93,"15min":12.93},"last":0.29299999999999998}]},{"osd":1,"last update":"Fri Oct 8 19:40:40 2021","interfaces":[{"interface":"back","average":{"1min":2.3580000000000001,"5min":1.619,"15min":2.0800000000000001},"min":{"1min":0.249,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":7.9640000000000004,"5min":8.8610000000000007,"15min":37.271999999999998},"last":2.762},{"interface":"front","average":{"1min":1.98,"5min":1.6890000000000001,"15min":2.0449999999999999},"min":{"1min":0.22500000000000001,"5min":0.223,"15min":0.19},"max":{"1min":8.3810000000000002,"5min":9.0229999999999997,"15min":37.033000000000001},"last":6.5830000000000002}]},{"osd":2,"last update":"Fri Oct 8 19:40:40 2021","interfaces":[{"interface":"back","average":{"1min":2.0910000000000002,"5min":1.758,"15min":2.0110000000000001},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":8.359,"5min":10.086,"15min":32.277000000000001},"last":2.867},{"interface":"front","average":{"1min":1.361,"5min":1.5509999999999999,"15min":1.9650000000000001},"min":{"1min":0.252,"5min":0.224,"15min":0.224},"max":{"1min":11.970000000000001,"5min":11.970000000000001,"15min":23.189},"last":2.1560000000000001}]},{"osd":4,"last update":"Fri Oct 8 19:40:54 2021","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.536,"15min":1.7270000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.25600000000000001},"max":{"1min":7.8109999999999999,"5min":8.7940000000000005,"15min":18.064},"last":2.1789999999999998},{"interface":"front","average":{"1min":1.909,"5min":1.9419999999999999,"15min":1.887},"min":{"1min":0.309,"5min":0.28599999999999998,"15min":0.26900000000000002},"max":{"1min":4.5190000000000001,"5min":8.9009999999999998,"15min":18.692},"last":2.6829999999999998}]},{"osd":5,"last update":"Fri Oct 8 19:41:13 2021","interfaces":[{"interface":"back","average":{"1min":2.0790000000000002,"5min":1.609,"15min":1.8300000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":10.055,"5min":10.055,"15min":75.397000000000006},"last":1.857},{"interface":"front","average":{"1min":1.796,"5min":1.8080000000000001,"15min":2.234},"min":{"1min":0.32600000000000001,"5min":0.309,"15min":0.309},"max":{"1min":7.9580000000000002,"5min":8.7579999999999991,"15min":75.680000000000007},"last":2.198}]},{"osd":6,"last update":"Fri Oct 8 19:40:25 2021","interfaces":[{"interface":"back","average":{"1min":10.31,"5min":3.4430000000000001,"15min":2.492},"min":{"1min":0.32800000000000001,"5min":0.32600000000000001,"15min":0.28599999999999998},"max":{"1min":202.99799999999999,"5min":202.99799999999999,"15min":202.99799999999999},"last":2.5219999999999998},{"interface":"front","average":{"1min":10.528,"5min":3.4990000000000001,"15min":2.3109999999999999},"min":{"1min":0.35399999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":202.31200000000001,"5min":202.31200000000001,"15min":202.31200000000001},"last":1.909}]},{"osd":7,"last update":"Fri Oct 8 19:40:54 2021","interfaces":[{"interface":"back","average":{"1min":2.645,"5min":2.0859999999999999,"15min":1.915},"min":{"1min":0.48899999999999999,"5min":0.35799999999999998,"15min":0.32200000000000001},"max":{"1min":13.587,"5min":13.587,"15min":13.587},"last":2.4929999999999999},{"interface":"front","average":{"1min":2.7229999999999999,"5min":2.0070000000000001,"15min":1.7589999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":13.644,"5min":13.644,"15min":13.644},"last":1.885}]}]},{"osd":4,"up_from":30,"seq":128849019134,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1399496,"kb_used_data":1075968,"kb_used_omap":0,"kb_used_meta":323456,"kb_avail":92345656,"statfs":{"total":95995035648,"available":94561951744,"internally_reserved":0,"allocated":1101791232,"data_stored":1101374786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":331218944},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:40:52 2021","interfaces":[{"interface":"back","average":{"1min":1.488,"5min":2.0710000000000002,"15min":1.881},"min":{"1min":0.22500000000000001,"5min":0.20999999999999999,"15min":0.185},"max":{"1min":4.3090000000000002,"5min":58.609999999999999,"15min":82.109999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":1.714,"5min":1.8959999999999999,"15min":1.8959999999999999},"min":{"1min":0.33000000000000002,"5min":0.222,"15min":0.222},"max":{"1min":4.7709999999999999,"5min":58.329999999999998,"15min":82.025999999999996},"last":0.58799999999999997}]},{"osd":1,"last update":"Fri Oct 8 19:40:52 2021","interfaces":[{"interface":"back","average":{"1min":1.8680000000000001,"5min":2.2080000000000002,"15min":2.4940000000000002},"min":{"1min":0.26500000000000001,"5min":0.215,"15min":0.215},"max":{"1min":8.8179999999999996,"5min":65.332999999999998,"15min":122.422},"last":0.53800000000000003},{"interface":"front","average":{"1min":1.905,"5min":2.077,"15min":2.2949999999999999},"min":{"1min":0.255,"5min":0.247,"15min":0.23599999999999999},"max":{"1min":6.1689999999999996,"5min":62.140000000000001,"15min":123.122},"last":0.59899999999999998}]},{"osd":2,"last update":"Fri Oct 8 19:40:52 2021","interfaces":[{"interface":"back","average":{"1min":1.927,"5min":2.4359999999999999,"15min":1.8280000000000001},"min":{"1min":0.30599999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":7.8280000000000003,"5min":60.082999999999998,"15min":60.082999999999998},"last":0.54300000000000004},{"interface":"front","average":{"1min":1.7230000000000001,"5min":2.3650000000000002,"15min":1.778},"min":{"1min":0.33100000000000002,"5min":0.27000000000000002,"15min":0.221},"max":{"1min":7.7439999999999998,"5min":60.539000000000001,"15min":60.539000000000001},"last":0.627}]},{"osd":3,"last update":"Fri Oct 8 19:40:52 2021","interfaces":[{"interface":"back","average":{"1min":1.5209999999999999,"5min":2.5009999999999999,"15min":2.2879999999999998},"min":{"1min":0.36599999999999999,"5min":0.27700000000000002,"15min":0.26500000000000001},"max":{"1min":4.2110000000000003,"5min":59.137,"15min":59.137},"last":16.786000000000001},{"interface":"front","average":{"1min":2.8580000000000001,"5min":2.359,"15min":2.0270000000000001},"min":{"1min":0.32300000000000001,"5min":0.27000000000000002,"15min":0.254},"max":{"1min":11.893000000000001,"5min":59.777000000000001,"15min":59.777000000000001},"last":16.748999999999999}]},{"osd":5,"last update":"Fri Oct 8 19:41:13 2021","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":1.155,"15min":1.0780000000000001},"min":{"1min":0.24099999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":2.722,"5min":10.477,"15min":10.477},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.90200000000000002,"15min":0.93500000000000005},"min":{"1min":0.27300000000000002,"5min":0.25800000000000001,"15min":0.22900000000000001},"max":{"1min":2.9900000000000002,"5min":5.4770000000000003,"15min":8.1319999999999997},"last":0.45900000000000002}]},{"osd":6,"last update":"Fri Oct 8 19:40:28 2021","interfaces":[{"interface":"back","average":{"1min":7.194,"5min":5.3890000000000002,"15min":2.3980000000000001},"min":{"1min":0.35699999999999998,"5min":0.28699999999999998,"15min":0.26400000000000001},"max":{"1min":113.14700000000001,"5min":171.69800000000001,"15min":171.69800000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":7.3010000000000002,"5min":5.5350000000000001,"15min":2.4870000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.247},"max":{"1min":112.651,"5min":171.613,"15min":171.613},"last":0.51300000000000001}]},{"osd":7,"last update":"Fri Oct 8 19:40:52 2021","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.0469999999999999,"15min":0.97099999999999997},"min":{"1min":0.32700000000000001,"5min":0.29499999999999998,"15min":0.29099999999999998},"max":{"1min":3.0720000000000001,"5min":5.2009999999999996,"15min":8.0050000000000008},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":1.1539999999999999,"15min":1.028},"min":{"1min":0.32100000000000001,"5min":0.31900000000000001,"15min":0.26800000000000002},"max":{"1min":1.9319999999999999,"5min":7.702,"15min":7.702},"last":0.498}]}]},{"osd":5,"up_from":38,"seq":163208757498,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1468792,"kb_used_data":1092656,"kb_used_omap":0,"kb_used_meta":376064,"kb_avail":92276360,"statfs":{"total":95995035648,"available":94490992640,"internally_reserved":0,"allocated":1118879744,"data_stored":1118480384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":385089536},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:41:20 2021","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.4890000000000001,"15min":1.5069999999999999},"min":{"1min":0.23000000000000001,"5min":0.20699999999999999,"15min":0.20300000000000001},"max":{"1min":4.8220000000000001,"5min":33.469999999999999,"15min":43.332999999999998},"last":0.23000000000000001},{"interface":"front","average":{"1min":1.446,"5min":1.6279999999999999,"15min":1.657},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.216},"max":{"1min":5.8739999999999997,"5min":32.857999999999997,"15min":42.637},"last":0.77100000000000002}]},{"osd":1,"last update":"Fri Oct 8 19:41:20 2021","interfaces":[{"interface":"back","average":{"1min":2.3759999999999999,"5min":1.865,"15min":1.952},"min":{"1min":0.248,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":9.3010000000000002,"5min":9.3010000000000002,"15min":94.558999999999997},"last":1.3},{"interface":"front","average":{"1min":2.839,"5min":1.732,"15min":1.839},"min":{"1min":0.28100000000000003,"5min":0.25900000000000001,"15min":0.23100000000000001},"max":{"1min":12.756,"5min":12.756,"15min":94.456999999999994},"last":1.2849999999999999}]},{"osd":2,"last update":"Fri Oct 8 19:41:20 2021","interfaces":[{"interface":"back","average":{"1min":1.8,"5min":1.486,"15min":1.52},"min":{"1min":0.26000000000000001,"5min":0.249,"15min":0.249},"max":{"1min":7.4939999999999998,"5min":22.931999999999999,"15min":22.931999999999999},"last":0.26000000000000001},{"interface":"front","average":{"1min":1.8300000000000001,"5min":1.978,"15min":1.5960000000000001},"min":{"1min":0.41799999999999998,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":5.9550000000000001,"5min":22.963999999999999,"15min":22.963999999999999},"last":0.64700000000000002}]},{"osd":3,"last update":"Fri Oct 8 19:41:20 2021","interfaces":[{"interface":"back","average":{"1min":1.9079999999999999,"5min":1.476,"15min":1.696},"min":{"1min":0.311,"5min":0.28000000000000003,"15min":0.27000000000000002},"max":{"1min":5.4020000000000001,"5min":9.5899999999999999,"15min":12.356},"last":0.53800000000000003},{"interface":"front","average":{"1min":2.379,"5min":2.0499999999999998,"15min":2.0499999999999998},"min":{"1min":0.46400000000000002,"5min":0.29999999999999999,"15min":0.218},"max":{"1min":10.663,"5min":10.663,"15min":21.504000000000001},"last":1.345}]},{"osd":4,"last update":"Fri Oct 8 19:41:20 2021","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.0429999999999999,"15min":0.92500000000000004},"min":{"1min":0.28399999999999997,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":2.8690000000000002,"5min":9.1600000000000001,"15min":9.2759999999999998},"last":0.61799999999999999},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.157,"15min":0.97499999999999998},"min":{"1min":0.33900000000000002,"5min":0.26700000000000002,"15min":0.25900000000000001},"max":{"1min":2.782,"5min":11.231,"15min":11.231},"last":2.746}]},{"osd":6,"last update":"Fri Oct 8 19:40:27 2021","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.327,"15min":1.042},"min":{"1min":0.32500000000000001,"5min":0.29399999999999998,"15min":0.255},"max":{"1min":5.2809999999999997,"5min":11.192,"15min":11.192},"last":1.1539999999999999},{"interface":"front","average":{"1min":0.745,"5min":1.296,"15min":1.014},"min":{"1min":0.32100000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":4.032,"5min":11.259,"15min":11.259},"last":0.56799999999999995}]},{"osd":7,"last update":"Fri Oct 8 19:40:48 2021","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.143,"15min":1.111},"min":{"1min":0.34499999999999997,"5min":0.22,"15min":0.22},"max":{"1min":5.8280000000000003,"5min":5.8280000000000003,"15min":29.946999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.92400000000000004,"5min":1.196,"15min":1.1830000000000001},"min":{"1min":0.35499999999999998,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":2.6240000000000001,"5min":12.970000000000001,"15min":29.294},"last":1.1850000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":266240,"data_stored":262688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":327680,"data_stored":327680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1381892096,"data_stored":1381892096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2157314048,"data_stored":2157314048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1643778048,"data_stored":1643773976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1917321216,"data_stored":1917321216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1089867776,"data_stored":1089863704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1097793536,"data_stored":1097793536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":2218266624,"data_stored":2218262552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1642725376,"data_stored":1642725376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-10-08T19:41:28.730 INFO:tasks.cephadm.ceph_manager.ceph:recovered! 2021-10-08T19:41:28.731 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2021-10-08T19:41:28.733 INFO:tasks.thrashosds.thrasher:Setting full ratio to .001 2021-10-08T19:41:28.734 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set-full-ratio .001 2021-10-08T19:41:28.752 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:41:28.754 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:28.755 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:41:28.856 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:41:28.886 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:28.943 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:41:28.946 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:28.947 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:41:29.048 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:41:29.091 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:29.165 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:41:29.169 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:29.170 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:41:29.271 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:41:29.319 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:29 smithi097 ceph-mon[32687]: 11.4 scrub ok 2021-10-08T19:41:29.319 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:29 smithi097 ceph-mon[32687]: 1.9 scrub ok 2021-10-08T19:41:29.320 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:29 smithi097 ceph-mon[32687]: 6.6 deep-scrub ok 2021-10-08T19:41:29.320 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:29 smithi097 ceph-mon[41966]: 11.4 scrub ok 2021-10-08T19:41:29.320 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:29 smithi097 ceph-mon[41966]: 1.9 scrub ok 2021-10-08T19:41:29.321 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:29 smithi097 ceph-mon[41966]: 6.6 deep-scrub ok 2021-10-08T19:41:29.323 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:29.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:29 smithi117 ceph-mon[34585]: 11.4 scrub ok 2021-10-08T19:41:29.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:29 smithi117 ceph-mon[34585]: 1.9 scrub ok 2021-10-08T19:41:29.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:29 smithi117 ceph-mon[34585]: 6.6 deep-scrub ok 2021-10-08T19:41:29.411 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:41:29.422 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:29.423 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:41:29.525 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:41:29.572 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:29.583 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:41:29.647 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:41:29.649 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:29.650 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:41:29.685 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:41:29.751 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:41:29.809 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:30.168 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:41:30.171 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:30.172 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:41:30.172 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:30 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:41:30.173 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:30 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:41:30.173 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:30 smithi097 ceph-mon[41966]: pgmap v1004: 188 pgs: 188 active+clean; 3.9 GiB data, 15 GiB used, 701 GiB / 715 GiB avail; 653 B/s rd, 0 B/s wr, 1k op/s 2021-10-08T19:41:30.173 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:30 smithi097 ceph-mon[41966]: osdmap e482: 8 total, 8 up, 8 in 2021-10-08T19:41:30.174 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:30 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:41:30.174 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:30 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:41:30.174 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:30 smithi097 ceph-mon[32687]: pgmap v1004: 188 pgs: 188 active+clean; 3.9 GiB data, 15 GiB used, 701 GiB / 715 GiB avail; 653 B/s rd, 0 B/s wr, 1k op/s 2021-10-08T19:41:30.174 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:30 smithi097 ceph-mon[32687]: osdmap e482: 8 total, 8 up, 8 in 2021-10-08T19:41:30.273 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:41:30.328 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:30.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:30 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:41:30.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:30 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:41:30.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:30 smithi117 ceph-mon[34585]: pgmap v1004: 188 pgs: 188 active+clean; 3.9 GiB data, 15 GiB used, 701 GiB / 715 GiB avail; 653 B/s rd, 0 B/s wr, 1k op/s 2021-10-08T19:41:30.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:30 smithi117 ceph-mon[34585]: osdmap e482: 8 total, 8 up, 8 in 2021-10-08T19:41:30.448 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set noscrub 2021-10-08T19:41:31.029 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:41:31.037 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:31.038 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:41:31.140 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:41:31.217 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:31.347 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:31 smithi097 ceph-mon[41966]: 11.5 scrub ok 2021-10-08T19:41:31.348 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:31 smithi097 ceph-mon[41966]: 11.c scrub ok 2021-10-08T19:41:31.348 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:31 smithi097 ceph-mon[41966]: 3.f scrub ok 2021-10-08T19:41:31.349 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:31 smithi097 ceph-mon[41966]: 4.1c scrub ok 2021-10-08T19:41:31.349 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:31 smithi097 ceph-mon[41966]: 3.3 scrub ok 2021-10-08T19:41:31.350 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:31 smithi097 ceph-mon[41966]: 4.0 scrub ok 2021-10-08T19:41:31.350 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:31 smithi097 ceph-mon[32687]: 11.5 scrub ok 2021-10-08T19:41:31.352 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:31 smithi097 ceph-mon[32687]: 11.c scrub ok 2021-10-08T19:41:31.353 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:31 smithi097 ceph-mon[32687]: 3.f scrub ok 2021-10-08T19:41:31.353 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:31 smithi097 ceph-mon[32687]: 4.1c scrub ok 2021-10-08T19:41:31.353 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:31 smithi097 ceph-mon[32687]: 3.3 scrub ok 2021-10-08T19:41:31.354 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:31 smithi097 ceph-mon[32687]: 4.0 scrub ok 2021-10-08T19:41:31.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:31 smithi117 ceph-mon[34585]: 11.5 scrub ok 2021-10-08T19:41:31.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:31 smithi117 ceph-mon[34585]: 11.c scrub ok 2021-10-08T19:41:31.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:31 smithi117 ceph-mon[34585]: 3.f scrub ok 2021-10-08T19:41:31.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:31 smithi117 ceph-mon[34585]: 4.1c scrub ok 2021-10-08T19:41:31.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:31 smithi117 ceph-mon[34585]: 3.3 scrub ok 2021-10-08T19:41:31.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:31 smithi117 ceph-mon[34585]: 4.0 scrub ok 2021-10-08T19:41:31.513 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:41:31.520 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:31.523 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:41:31.624 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:41:31.671 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:31.796 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:41:31.802 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:31.804 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:41:31.906 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:41:31.947 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:32.202 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:32 smithi097 ceph-mon[32687]: pgmap v1006: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 3.7 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 842 B/s rd, 0 B/s wr, 896 op/s 2021-10-08T19:41:32.202 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:32 smithi097 ceph-mon[32687]: 5.16 scrub ok 2021-10-08T19:41:32.203 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:32 smithi097 ceph-mon[41966]: pgmap v1006: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 3.7 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 842 B/s rd, 0 B/s wr, 896 op/s 2021-10-08T19:41:32.203 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:32 smithi097 ceph-mon[41966]: 5.16 scrub ok 2021-10-08T19:41:32.315 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:32 smithi117 ceph-mon[34585]: pgmap v1006: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 3.7 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 842 B/s rd, 0 B/s wr, 896 op/s 2021-10-08T19:41:32.315 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:32 smithi117 ceph-mon[34585]: 5.16 scrub ok 2021-10-08T19:41:32.657 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:41:32 smithi117 conmon[69189]: level=error ts=2021-10-08T19:41:32.314Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=1 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:41:32.833 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:41:32.867 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:41:32.905 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:41:32.936 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:41:32.971 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:41:32.973 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:41:32 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:41:32] "GET /metrics HTTP/1.1" 200 155955 "" "Prometheus/2.18.1" 2021-10-08T19:41:33.000 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:41:33.029 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:41:33.072 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:41:33.084 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true' 2021-10-08T19:41:33.084 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true' 2021-10-08T19:41:33.084 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true' 2021-10-08T19:41:33.084 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true' 2021-10-08T19:41:33.085 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true' 2021-10-08T19:41:33.085 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true' 2021-10-08T19:41:33.085 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'true' 2021-10-08T19:41:33.085 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'true' 2021-10-08T19:41:33.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:33 smithi117 ceph-mon[34585]: 4.11 scrub ok 2021-10-08T19:41:33.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:33 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3698519410' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:41:33.475 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:33 smithi097 ceph-mon[32687]: 4.11 scrub ok 2021-10-08T19:41:33.476 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:33 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3698519410' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:41:33.477 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:33 smithi097 ceph-mon[41966]: 4.11 scrub ok 2021-10-08T19:41:33.477 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:33 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3698519410' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:41:34.140 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:41:34.157 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:41:33 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:41:33] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:41:34.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:34 smithi117 ceph-mon[34585]: pgmap v1007: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 3.7 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 680 op/s 2021-10-08T19:41:34.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:34 smithi097 ceph-mon[32687]: pgmap v1007: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 3.7 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 680 op/s 2021-10-08T19:41:34.472 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:41:34 smithi097 conmon[33110]: 172.21.15.117 - - [08/Oct/2021:19:41:34] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:41:34.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:34 smithi097 ceph-mon[41966]: pgmap v1007: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 3.7 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 680 op/s 2021-10-08T19:41:35.071 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:41:35.078 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:35.079 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:41:35.180 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:41:35.219 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:35.258 INFO:journalctl@ceph.osd.2.smithi097.stdout:Oct 08 19:41:34 smithi097 conmon[55904]: 2021-10-08T19:41:34.994+0000 7f5999649700 -1 osd.2 pg_epoch: 482 pg[1.8( v 90'130 (0'0,90'130] local-lis/les=397/398 n=1 ec=170/19 lis/c=397/397 les/c/f=398/398/0 sis=397) [2,5,3] r=0 lpr=397 crt=90'130 mlcod 0'0 active+clean] scrubber pg(1.8) handle_scrub_reserve_grant: received unsolicited reservation grant from osd 5 (0x56222ab434a0) 2021-10-08T19:41:35.278 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:41:35.280 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:35.281 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:41:35.382 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:41:35.437 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:35.583 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:35 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:41:35.584 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:35 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:41:35.584 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:35 smithi097 ceph-mon[32687]: 172.21.15.117 - - [08/Oct/2021:19:41:34] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:41:35.584 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:35 smithi097 ceph-mon[32687]: 11.f scrub ok 2021-10-08T19:41:35.585 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:35 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:41:35.585 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:35 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:41:35.585 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:35 smithi097 ceph-mon[41966]: 172.21.15.117 - - [08/Oct/2021:19:41:34] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:41:35.585 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:35 smithi097 ceph-mon[41966]: 11.f scrub ok 2021-10-08T19:41:35.640 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:41:35.652 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:35.652 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:41:35.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:35 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:41:35.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:35 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:41:35.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:35 smithi117 ceph-mon[34585]: 172.21.15.117 - - [08/Oct/2021:19:41:34] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:41:35.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:35 smithi117 ceph-mon[34585]: 11.f scrub ok 2021-10-08T19:41:35.753 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:41:35.807 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:36.023 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:36.024 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:41:36.024 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:41:36.130 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:41:36.175 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:36.300 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:36 smithi097 ceph-mon[32687]: pgmap v1008: 188 pgs: 1 active+clean+scrubbing, 1 active+clean+scrubbing+deep, 186 active+clean; 3.4 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 35 KiB/s rd, 0 B/s wr, 1.23k op/s 2021-10-08T19:41:36.511 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:41:36.512 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2021-10-08T19:41:36.512 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2021-10-08T19:41:36.512 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2021-10-08T19:41:36.512 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:41:36.520 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:41:36.525 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:36.526 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:41:36.628 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:41:36.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:36 smithi117 ceph-mon[34585]: pgmap v1008: 188 pgs: 1 active+clean+scrubbing, 1 active+clean+scrubbing+deep, 186 active+clean; 3.4 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 35 KiB/s rd, 0 B/s wr, 1.23k op/s 2021-10-08T19:41:36.684 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:36 smithi097 ceph-mon[41966]: pgmap v1008: 188 pgs: 1 active+clean+scrubbing, 1 active+clean+scrubbing+deep, 186 active+clean; 3.4 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 35 KiB/s rd, 0 B/s wr, 1.23k op/s 2021-10-08T19:41:36.689 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:36.783 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:41:36.789 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:36.791 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:41:36.892 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:41:36.919 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:37.309 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2021-10-08T19:41:37.344 INFO:teuthology.orchestra.run.smithi097.stderr:osd set-full-ratio 0.001 2021-10-08T19:41:37.493 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:41:37.506 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:37.508 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:41:37.609 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:41:37.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:37 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/76619378' entity='client.admin' cmd=[{"prefix": "osd set-full-ratio", "ratio": 0.001}]: dispatch 2021-10-08T19:41:37.656 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:41:37 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:41:37.659 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:37 smithi097 conmon[32664]: 2021-10-08T19:41:37.295+0000 7f60621db700 -1 log_channel(cluster) log [ERR] : Health check failed: full ratio(s) out of order (OSD_OUT_OF_ORDER_FULL) 2021-10-08T19:41:37.660 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:37 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/76619378' entity='client.admin' cmd=[{"prefix": "osd set-full-ratio", "ratio": 0.001}]: dispatch 2021-10-08T19:41:37.660 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:37 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/76619378' entity='client.admin' cmd=[{"prefix": "osd set-full-ratio", "ratio": 0.001}]: dispatch 2021-10-08T19:41:37.668 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:38.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:38 smithi117 ceph-mon[34585]: pgmap v1009: 188 pgs: 1 active+clean+scrubbing, 1 active+clean+scrubbing+deep, 186 active+clean; 3.4 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 32 KiB/s rd, 0 B/s wr, 1.11k op/s 2021-10-08T19:41:38.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:38 smithi117 ceph-mon[34585]: Health check failed: full ratio(s) out of order (OSD_OUT_OF_ORDER_FULL) 2021-10-08T19:41:38.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:38 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/76619378' entity='client.admin' cmd='[{"prefix": "osd set-full-ratio", "ratio": 0.001}]': finished 2021-10-08T19:41:38.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:38 smithi117 ceph-mon[34585]: osdmap e483: 8 total, 8 up, 8 in 2021-10-08T19:41:38.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:38 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:41:38.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:38 smithi097 ceph-mon[32687]: pgmap v1009: 188 pgs: 1 active+clean+scrubbing, 1 active+clean+scrubbing+deep, 186 active+clean; 3.4 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 32 KiB/s rd, 0 B/s wr, 1.11k op/s 2021-10-08T19:41:38.724 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:38 smithi097 ceph-mon[32687]: Health check failed: full ratio(s) out of order (OSD_OUT_OF_ORDER_FULL) 2021-10-08T19:41:38.724 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:38 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/76619378' entity='client.admin' cmd='[{"prefix": "osd set-full-ratio", "ratio": 0.001}]': finished 2021-10-08T19:41:38.725 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:38 smithi097 ceph-mon[32687]: osdmap e483: 8 total, 8 up, 8 in 2021-10-08T19:41:38.725 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:38 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:41:38.726 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:38 smithi097 ceph-mon[41966]: pgmap v1009: 188 pgs: 1 active+clean+scrubbing, 1 active+clean+scrubbing+deep, 186 active+clean; 3.4 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 32 KiB/s rd, 0 B/s wr, 1.11k op/s 2021-10-08T19:41:38.726 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:38 smithi097 ceph-mon[41966]: Health check failed: full ratio(s) out of order (OSD_OUT_OF_ORDER_FULL) 2021-10-08T19:41:38.727 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:38 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/76619378' entity='client.admin' cmd='[{"prefix": "osd set-full-ratio", "ratio": 0.001}]': finished 2021-10-08T19:41:38.727 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:38 smithi097 ceph-mon[41966]: osdmap e483: 8 total, 8 up, 8 in 2021-10-08T19:41:38.727 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:38 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:41:38.775 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:41:38.794 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:38.796 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:41:38.897 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:41:38.921 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:39.618 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:41:39.629 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:39.630 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:41:39.631 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:39 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:41:39.631 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:39 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:41:39.631 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:39 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:41:39.631 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:39 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:41:39.632 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:39 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:41:39.632 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:39 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:41:39.632 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:39 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:41:39.633 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:39 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:41:39.639 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2021-10-08T19:41:39.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:39 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:41:39.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:39 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:41:39.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:39 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:41:39.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:39 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:41:39.663 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:41:39.732 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:41:39.763 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:39.816 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:41:39.821 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:39.822 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:41:39.924 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:41:39.985 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:40.187 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:41:40.191 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:40.192 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:41:40.292 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:41:40.294 INFO:tasks.thrashosds.thrasher:Setting full ratio back to .95 2021-10-08T19:41:40.294 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set-full-ratio .95 2021-10-08T19:41:40.321 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:40.374 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:40.376 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:41:40.376 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:41:40.449 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:40 smithi097 ceph-mon[32687]: pgmap v1011: 188 pgs: 1 active+clean+scrubbing+deep, 187 active+clean; 3.3 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 39 KiB/s rd, 0 B/s wr, 1.07k op/s 2021-10-08T19:41:40.478 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:41:40.557 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:40.577 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:41:40.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:40 smithi117 ceph-mon[34585]: pgmap v1011: 188 pgs: 1 active+clean+scrubbing+deep, 187 active+clean; 3.3 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 39 KiB/s rd, 0 B/s wr, 1.07k op/s 2021-10-08T19:41:40.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:40 smithi097 ceph-mon[41966]: pgmap v1011: 188 pgs: 1 active+clean+scrubbing+deep, 187 active+clean; 3.3 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 39 KiB/s rd, 0 B/s wr, 1.07k op/s 2021-10-08T19:41:40.952 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:41:40.959 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:40.960 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:41:41.061 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:41:41.095 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:41.172 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:41.176 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:41:41.177 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:41:41.278 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:41:41.327 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:41.490 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is set 2021-10-08T19:41:41.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:41 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1374689066' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:41:41.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:41 smithi097 ceph-mon[41966]: from='client.26317 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:41:41.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:41 smithi097 ceph-mon[41966]: 11.e scrub ok 2021-10-08T19:41:41.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:41 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1374689066' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:41:41.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:41 smithi097 ceph-mon[32687]: from='client.26317 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:41:41.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:41 smithi097 ceph-mon[32687]: 11.e scrub ok 2021-10-08T19:41:41.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:41 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1374689066' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:41:41.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:41 smithi117 ceph-mon[34585]: from='client.26317 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:41:41.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:41 smithi117 ceph-mon[34585]: 11.e scrub ok 2021-10-08T19:41:42.277 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:41:42.280 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:42.280 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:41:42.382 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:41:42.417 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:42.473 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:41:42.475 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:42.477 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:41:42.578 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:41:42.613 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:42.648 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:42 smithi097 ceph-mon[41966]: pgmap v1012: 188 pgs: 1 active+clean+scrubbing+deep, 187 active+clean; 3.2 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 44 KiB/s rd, 0 B/s wr, 1.02k op/s 2021-10-08T19:41:42.649 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:42 smithi097 ceph-mon[41966]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:41:42.649 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:42 smithi097 ceph-mon[41966]: from='client.26317 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:41:42.649 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:42 smithi097 ceph-mon[41966]: osdmap e484: 8 total, 8 up, 8 in 2021-10-08T19:41:42.649 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:42 smithi097 ceph-mon[32687]: pgmap v1012: 188 pgs: 1 active+clean+scrubbing+deep, 187 active+clean; 3.2 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 44 KiB/s rd, 0 B/s wr, 1.02k op/s 2021-10-08T19:41:42.650 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:42 smithi097 ceph-mon[32687]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:41:42.650 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:42 smithi097 ceph-mon[32687]: from='client.26317 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:41:42.650 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:42 smithi097 ceph-mon[32687]: osdmap e484: 8 total, 8 up, 8 in 2021-10-08T19:41:42.663 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:41:42.668 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:42.669 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:41:42.671 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:42 smithi117 ceph-mon[34585]: pgmap v1012: 188 pgs: 1 active+clean+scrubbing+deep, 187 active+clean; 3.2 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 44 KiB/s rd, 0 B/s wr, 1.02k op/s 2021-10-08T19:41:42.671 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:42 smithi117 ceph-mon[34585]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:41:42.671 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:42 smithi117 ceph-mon[34585]: from='client.26317 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:41:42.672 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:42 smithi117 ceph-mon[34585]: osdmap e484: 8 total, 8 up, 8 in 2021-10-08T19:41:42.771 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:41:42.794 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:42.843 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:41:42.848 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:42.849 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:41:42.950 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:41:42.970 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:41:42 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:41:42] "GET /metrics HTTP/1.1" 200 155850 "" "Prometheus/2.18.1" 2021-10-08T19:41:42.995 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:43.056 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:41:43.059 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:43.060 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:41:43.162 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:41:43.217 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:43.868 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:41:43.868 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:41:43.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:41:43.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:41:43.971 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:41:43.972 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:41:44.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:41:43 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:41:43] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:41:44.296 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:41:44.304 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:44.305 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:41:44.407 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:41:44.425 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:41:44.442 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:44.497 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:41:44.500 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:44.503 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:41:44.606 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:41:44.659 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:44 smithi097 ceph-mon[32687]: pgmap v1014: 188 pgs: 1 active+clean+scrubbing+deep, 187 active+clean; 3.2 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 16 KiB/s rd, 0 B/s wr, 566 op/s 2021-10-08T19:41:44.659 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:44 smithi097 ceph-mon[41966]: pgmap v1014: 188 pgs: 1 active+clean+scrubbing+deep, 187 active+clean; 3.2 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 16 KiB/s rd, 0 B/s wr, 566 op/s 2021-10-08T19:41:44.669 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:44.740 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:41:44.777 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:41:44.813 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:41:44.863 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:41:44.864 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:41:44.871 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:44.872 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:41:44.902 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:41:44.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:44 smithi117 ceph-mon[34585]: pgmap v1014: 188 pgs: 1 active+clean+scrubbing+deep, 187 active+clean; 3.2 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 16 KiB/s rd, 0 B/s wr, 566 op/s 2021-10-08T19:41:44.955 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:41:44.973 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:41:44.987 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:41:44.999 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:45.030 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:41:45.038 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'false' 2021-10-08T19:41:45.038 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'false' 2021-10-08T19:41:45.038 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'false' 2021-10-08T19:41:45.039 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'false' 2021-10-08T19:41:45.039 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'false' 2021-10-08T19:41:45.039 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'false' 2021-10-08T19:41:45.040 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'false' 2021-10-08T19:41:45.040 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'false' 2021-10-08T19:41:45.059 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:41:45.062 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:45.063 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:41:45.164 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:41:45.216 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:45.892 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:45 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3187056990' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:41:45.892 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:45 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3187056990' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:41:45.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:45 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3187056990' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:41:46.029 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2021-10-08T19:41:46.030 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:41:46.119 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set nodeep-scrub 2021-10-08T19:41:46.511 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:41:46.515 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:46.516 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:41:46.617 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:41:46.649 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:46.712 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:41:46.718 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:46.719 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:41:46.820 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:41:46.851 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:46 smithi117 ceph-mon[34585]: pgmap v1015: 188 pgs: 188 active+clean; 2.9 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 1.17k op/s 2021-10-08T19:41:46.854 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:46.923 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:41:46.927 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:46.928 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:41:46.970 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:46 smithi097 ceph-mon[41966]: pgmap v1015: 188 pgs: 188 active+clean; 2.9 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 1.17k op/s 2021-10-08T19:41:46.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:46 smithi097 ceph-mon[32687]: pgmap v1015: 188 pgs: 188 active+clean; 2.9 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 1.17k op/s 2021-10-08T19:41:47.029 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:41:47.166 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:47.655 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:41:47 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:41:47.702 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:41:47.710 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:47.711 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:41:47.813 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:41:47.856 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:47.903 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:41:47.921 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:41:47.923 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:47.923 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:41:47.943 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2021-10-08T19:41:48.025 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:41:48.090 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:48.245 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:41:48.253 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:48.254 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:41:48.354 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:41:48.415 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:48.509 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:48 smithi097 ceph-mon[32687]: pgmap v1016: 188 pgs: 188 active+clean; 2.9 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 14 KiB/s rd, 0 B/s wr, 960 op/s 2021-10-08T19:41:48.509 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:48 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:41:48.510 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:48 smithi097 ceph-mon[41966]: pgmap v1016: 188 pgs: 188 active+clean; 2.9 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 14 KiB/s rd, 0 B/s wr, 960 op/s 2021-10-08T19:41:48.510 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:48 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:41:48.522 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2021-10-08T19:41:48.617 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:41:48.644 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:48.645 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:41:48.746 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:41:48.770 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:48 smithi117 ceph-mon[34585]: pgmap v1016: 188 pgs: 188 active+clean; 2.9 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 14 KiB/s rd, 0 B/s wr, 960 op/s 2021-10-08T19:41:48.771 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:48 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:41:48.772 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:48.824 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:41:48.829 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:48.829 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:41:48.928 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:41:48.930 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:41:48.963 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:49.018 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:41:49.022 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:49.023 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:41:49.124 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:41:49.156 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:49.225 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:41:49.230 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:49.231 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:41:49.332 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:41:49.396 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:49.542 INFO:teuthology.orchestra.run.smithi097.stderr:osd set-full-ratio 0.95 2021-10-08T19:41:49.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:49 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1902297770' entity='client.admin' cmd=[{"prefix": "osd set-full-ratio", "ratio": 0.95}]: dispatch 2021-10-08T19:41:49.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:49 smithi097 ceph-mon[41966]: from='client.36368 ' entity='client.admin' cmd=[{"prefix": "osd set-full-ratio", "ratio": 0.95}]: dispatch 2021-10-08T19:41:49.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:49 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1902297770' entity='client.admin' cmd=[{"prefix": "osd set-full-ratio", "ratio": 0.95}]: dispatch 2021-10-08T19:41:49.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:49 smithi097 ceph-mon[32687]: from='client.36368 ' entity='client.admin' cmd=[{"prefix": "osd set-full-ratio", "ratio": 0.95}]: dispatch 2021-10-08T19:41:49.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:49 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1902297770' entity='client.admin' cmd=[{"prefix": "osd set-full-ratio", "ratio": 0.95}]: dispatch 2021-10-08T19:41:49.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:49 smithi117 ceph-mon[34585]: from='client.36368 ' entity='client.admin' cmd=[{"prefix": "osd set-full-ratio", "ratio": 0.95}]: dispatch 2021-10-08T19:41:50.262 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:41:50.266 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:50.268 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:41:50.370 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:41:50.491 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:50.790 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:41:50.905 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:50 smithi117 ceph-mon[34585]: pgmap v1017: 188 pgs: 188 active+clean; 2.7 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 5.5 KiB/s rd, 0 B/s wr, 971 op/s 2021-10-08T19:41:50.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:50 smithi117 ceph-mon[34585]: Health check cleared: OSD_OUT_OF_ORDER_FULL (was: full ratio(s) out of order) 2021-10-08T19:41:50.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:50 smithi117 ceph-mon[34585]: from='client.36368 ' entity='client.admin' cmd='[{"prefix": "osd set-full-ratio", "ratio": 0.95}]': finished 2021-10-08T19:41:50.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:50 smithi117 ceph-mon[34585]: osdmap e485: 8 total, 8 up, 8 in 2021-10-08T19:41:50.971 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:50 smithi097 ceph-mon[32687]: pgmap v1017: 188 pgs: 188 active+clean; 2.7 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 5.5 KiB/s rd, 0 B/s wr, 971 op/s 2021-10-08T19:41:50.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:50 smithi097 ceph-mon[32687]: Health check cleared: OSD_OUT_OF_ORDER_FULL (was: full ratio(s) out of order) 2021-10-08T19:41:50.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:50 smithi097 ceph-mon[32687]: from='client.36368 ' entity='client.admin' cmd='[{"prefix": "osd set-full-ratio", "ratio": 0.95}]': finished 2021-10-08T19:41:50.972 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:50 smithi097 ceph-mon[32687]: osdmap e485: 8 total, 8 up, 8 in 2021-10-08T19:41:50.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:50 smithi097 ceph-mon[41966]: pgmap v1017: 188 pgs: 188 active+clean; 2.7 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 5.5 KiB/s rd, 0 B/s wr, 971 op/s 2021-10-08T19:41:50.973 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:50 smithi097 ceph-mon[41966]: Health check cleared: OSD_OUT_OF_ORDER_FULL (was: full ratio(s) out of order) 2021-10-08T19:41:50.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:50 smithi097 ceph-mon[41966]: from='client.36368 ' entity='client.admin' cmd='[{"prefix": "osd set-full-ratio", "ratio": 0.95}]': finished 2021-10-08T19:41:50.974 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:50 smithi097 ceph-mon[41966]: osdmap e485: 8 total, 8 up, 8 in 2021-10-08T19:41:50.975 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:41:50.980 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:50.981 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:41:51.082 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:41:51.149 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:51.476 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:41:51.479 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:51.479 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:41:51.580 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:41:51.640 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:52.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:51 smithi097 ceph-mon[41966]: pgmap v1019: 188 pgs: 188 active+clean; 2.5 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1.07k op/s 2021-10-08T19:41:52.224 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:51 smithi097 ceph-mon[32687]: pgmap v1019: 188 pgs: 188 active+clean; 2.5 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1.07k op/s 2021-10-08T19:41:52.316 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:51 smithi117 ceph-mon[34585]: pgmap v1019: 188 pgs: 188 active+clean; 2.5 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1.07k op/s 2021-10-08T19:41:52.316 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:41:52 smithi117 conmon[69189]: level=error ts=2021-10-08T19:41:52.315Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=6 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:41:52.582 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:41:52.594 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:52.594 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:41:52.655 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:41:52 smithi117 conmon[69189]: level=error ts=2021-10-08T19:41:52.316Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=2 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:41:52.695 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:41:52.838 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:52.948 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:52 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/341575924' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:41:52.949 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:41:52 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:41:52] "GET /metrics HTTP/1.1" 200 155850 "" "Prometheus/2.18.1" 2021-10-08T19:41:52.988 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is set 2021-10-08T19:41:53.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:52 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/341575924' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:41:53.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:52 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/341575924' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:41:53.463 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:41:53.467 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:53.467 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:41:53.569 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:41:53.624 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:53.697 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:41:53.699 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:53.700 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:41:53.802 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:41:53.835 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:53.873 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:41:53 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:41:53] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:41:54.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:53 smithi117 ceph-mon[34585]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:41:54.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:53 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/341575924' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:41:54.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:53 smithi117 ceph-mon[34585]: osdmap e486: 8 total, 8 up, 8 in 2021-10-08T19:41:54.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:53 smithi117 ceph-mon[34585]: pgmap v1021: 188 pgs: 188 active+clean; 2.5 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 676 op/s 2021-10-08T19:41:54.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:53 smithi097 ceph-mon[32687]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:41:54.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:53 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/341575924' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:41:54.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:53 smithi097 ceph-mon[32687]: osdmap e486: 8 total, 8 up, 8 in 2021-10-08T19:41:54.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:53 smithi097 ceph-mon[32687]: pgmap v1021: 188 pgs: 188 active+clean; 2.5 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 676 op/s 2021-10-08T19:41:54.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:53 smithi097 ceph-mon[41966]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:41:54.225 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:53 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/341575924' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:41:54.225 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:53 smithi097 ceph-mon[41966]: osdmap e486: 8 total, 8 up, 8 in 2021-10-08T19:41:54.225 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:53 smithi097 ceph-mon[41966]: pgmap v1021: 188 pgs: 188 active+clean; 2.5 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 676 op/s 2021-10-08T19:41:54.335 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:41:54.341 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:54.342 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:41:54.444 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:41:54.490 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:54.618 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:41:54.625 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:54.626 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:41:54.727 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:41:54.763 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:54.847 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:41:54.850 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:54.851 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:41:54.952 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:41:54.998 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:55.106 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:41:55.137 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:41:55.155 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:41:55.171 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:55.172 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:41:55.185 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:41:55.205 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:55 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2331341521' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:41:55.223 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:41:55.246 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:41:55.246 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2021-10-08T19:41:55.247 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.247 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.26125.0:192469 11.b 11:dd9036a6:::benchmark_data_smithi097_295476_object78720:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e486)", 2021-10-08T19:41:55.247 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:41:55.221300+0000", 2021-10-08T19:41:55.247 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.022690757999999998, 2021-10-08T19:41:55.248 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022713985999999999, 2021-10-08T19:41:55.248 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:41:55.248 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2021-10-08T19:41:55.249 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:41:55.249 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.26125", 2021-10-08T19:41:55.250 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:41:55.250 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 192469 2021-10-08T19:41:55.250 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.250 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:41:55.250 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.251 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:41:55.251 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.221300+0000", 2021-10-08T19:41:55.251 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:41:55.251 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.252 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.252 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:41:55.252 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.221300+0000", 2021-10-08T19:41:55.252 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:41:55.252 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.253 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.253 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:41:55.253 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.221298+0000", 2021-10-08T19:41:55.253 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2021-10-08T19:41:55.253 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.254 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.254 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:41:55.254 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.221305+0000", 2021-10-08T19:41:55.255 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6329999999999999e-06 2021-10-08T19:41:55.255 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.255 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.255 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:41:55.255 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.221315+0000", 2021-10-08T19:41:55.256 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0231000000000001e-05 2021-10-08T19:41:55.256 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.256 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.256 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:41:55.256 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.221323+0000", 2021-10-08T19:41:55.257 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6760000000000007e-06 2021-10-08T19:41:55.257 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.257 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.257 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:41:55.258 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.221366+0000", 2021-10-08T19:41:55.258 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3347999999999999e-05 2021-10-08T19:41:55.258 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.259 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.259 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:41:55.259 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.221492+0000", 2021-10-08T19:41:55.259 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000125752 2021-10-08T19:41:55.259 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.260 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.260 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,1", 2021-10-08T19:41:55.260 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.221624+0000", 2021-10-08T19:41:55.260 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013216000000000001 2021-10-08T19:41:55.260 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.261 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.261 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:41:55.261 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.224572+0000", 2021-10-08T19:41:55.261 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029484480000000002 2021-10-08T19:41:55.262 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.262 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.262 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:41:55.262 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.234518+0000", 2021-10-08T19:41:55.262 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0099460499999999997 2021-10-08T19:41:55.263 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:55.263 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:41:55.263 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:55.264 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.265 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.265 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.26125.0:192477 11.b 11:d5ff3348:::benchmark_data_smithi097_295476_object78728:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e486)", 2021-10-08T19:41:55.265 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:41:55.227257+0000", 2021-10-08T19:41:55.266 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.016733337000000001, 2021-10-08T19:41:55.266 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016816964, 2021-10-08T19:41:55.266 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:41:55.266 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2021-10-08T19:41:55.266 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:41:55.267 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.26125", 2021-10-08T19:41:55.267 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:41:55.267 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 192477 2021-10-08T19:41:55.267 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.268 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:41:55.271 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.271 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:41:55.271 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.227257+0000", 2021-10-08T19:41:55.271 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:41:55.272 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.272 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.272 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:41:55.272 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.227257+0000", 2021-10-08T19:41:55.273 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:41:55.273 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.273 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.273 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:41:55.273 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.227256+0000", 2021-10-08T19:41:55.274 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2021-10-08T19:41:55.274 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.274 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.274 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:41:55.275 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.227260+0000", 2021-10-08T19:41:55.275 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.18e-06 2021-10-08T19:41:55.275 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.275 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.275 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:41:55.276 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.227265+0000", 2021-10-08T19:41:55.276 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0170000000000004e-06 2021-10-08T19:41:55.276 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.276 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.277 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:41:55.277 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.227268+0000", 2021-10-08T19:41:55.277 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5250000000000001e-06 2021-10-08T19:41:55.277 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.278 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.278 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:41:55.278 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.227437+0000", 2021-10-08T19:41:55.278 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016886599999999999 2021-10-08T19:41:55.278 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.279 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.279 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:41:55.279 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.227547+0000", 2021-10-08T19:41:55.279 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000109765 2021-10-08T19:41:55.280 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.280 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.280 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,1", 2021-10-08T19:41:55.280 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.227668+0000", 2021-10-08T19:41:55.281 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000120728 2021-10-08T19:41:55.281 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.281 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.281 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:41:55.281 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.231625+0000", 2021-10-08T19:41:55.282 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0039574639999999999 2021-10-08T19:41:55.282 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:55.282 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:41:55.282 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:55.283 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.283 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.283 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.26125.0:192480 11.9 11:94031d55:::benchmark_data_smithi097_295476_object78731:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e486)", 2021-10-08T19:41:55.283 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:41:55.234256+0000", 2021-10-08T19:41:55.283 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0097343250000000003, 2021-10-08T19:41:55.284 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0099012660000000006, 2021-10-08T19:41:55.284 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:41:55.284 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2021-10-08T19:41:55.284 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:41:55.285 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.26125", 2021-10-08T19:41:55.285 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:41:55.285 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 192480 2021-10-08T19:41:55.285 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.285 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:41:55.286 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.286 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:41:55.286 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.234256+0000", 2021-10-08T19:41:55.286 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:41:55.287 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.287 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.287 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:41:55.288 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.234256+0000", 2021-10-08T19:41:55.288 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:41:55.288 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.289 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.289 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:41:55.289 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.234254+0000", 2021-10-08T19:41:55.289 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2021-10-08T19:41:55.289 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.290 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.290 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:41:55.290 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.234260+0000", 2021-10-08T19:41:55.290 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.728e-06 2021-10-08T19:41:55.291 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.291 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.291 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:41:55.291 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.234268+0000", 2021-10-08T19:41:55.291 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0620000000000001e-06 2021-10-08T19:41:55.292 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.292 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.292 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:41:55.292 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.234273+0000", 2021-10-08T19:41:55.293 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1359999999999996e-06 2021-10-08T19:41:55.293 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.293 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.293 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:41:55.293 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.238194+0000", 2021-10-08T19:41:55.294 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0039211159999999997 2021-10-08T19:41:55.294 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.294 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.294 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:41:55.295 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.238312+0000", 2021-10-08T19:41:55.295 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000117668 2021-10-08T19:41:55.295 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.295 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.296 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,6", 2021-10-08T19:41:55.296 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.238424+0000", 2021-10-08T19:41:55.296 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011211 2021-10-08T19:41:55.297 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.297 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.297 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:41:55.297 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.242514+0000", 2021-10-08T19:41:55.298 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.004089489 2021-10-08T19:41:55.298 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:55.298 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:41:55.298 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:55.298 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.299 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.299 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.26125.0:192482 11.b 11:d17d9dc1:::benchmark_data_smithi097_295476_object78733:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e486)", 2021-10-08T19:41:55.299 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:41:55.234288+0000", 2021-10-08T19:41:55.299 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0097021920000000001, 2021-10-08T19:41:55.300 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.009958237, 2021-10-08T19:41:55.300 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:41:55.300 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2021-10-08T19:41:55.300 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:41:55.301 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.26125", 2021-10-08T19:41:55.301 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:41:55.301 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 192482 2021-10-08T19:41:55.301 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.301 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:41:55.302 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.302 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:41:55.302 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.234288+0000", 2021-10-08T19:41:55.302 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:41:55.303 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.303 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.303 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:41:55.303 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.234288+0000", 2021-10-08T19:41:55.303 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:41:55.304 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.304 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.304 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:41:55.304 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.234288+0000", 2021-10-08T19:41:55.305 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2021-10-08T19:41:55.305 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.305 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.305 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:41:55.305 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.234291+0000", 2021-10-08T19:41:55.306 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8430000000000001e-06 2021-10-08T19:41:55.306 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.306 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.306 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:41:55.307 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.234295+0000", 2021-10-08T19:41:55.307 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9309999999999999e-06 2021-10-08T19:41:55.307 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.307 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.307 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:41:55.308 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.234299+0000", 2021-10-08T19:41:55.308 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.839e-06 2021-10-08T19:41:55.308 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.308 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.308 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:41:55.309 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.234546+0000", 2021-10-08T19:41:55.309 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024689299999999998 2021-10-08T19:41:55.309 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.309 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.310 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:41:55.310 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.234677+0000", 2021-10-08T19:41:55.310 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000130591 2021-10-08T19:41:55.310 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.310 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.311 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,1", 2021-10-08T19:41:55.311 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.234817+0000", 2021-10-08T19:41:55.311 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014059000000000001 2021-10-08T19:41:55.311 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:55.312 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:41:55.312 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:55.312 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.312 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.312 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.26125.0:192489 11.9 11:9bfcc185:::benchmark_data_smithi097_295476_object78740:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e486)", 2021-10-08T19:41:55.313 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:41:55.238294+0000", 2021-10-08T19:41:55.313 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.005696815, 2021-10-08T19:41:55.313 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0060187080000000002, 2021-10-08T19:41:55.313 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:41:55.314 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2021-10-08T19:41:55.314 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2021-10-08T19:41:55.314 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.26125", 2021-10-08T19:41:55.314 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:41:55.315 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 192489 2021-10-08T19:41:55.315 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.315 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:41:55.315 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.315 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:41:55.316 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.238294+0000", 2021-10-08T19:41:55.316 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:41:55.316 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.316 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.317 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:41:55.317 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.238294+0000", 2021-10-08T19:41:55.317 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:41:55.317 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.318 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.318 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:41:55.318 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.238291+0000", 2021-10-08T19:41:55.318 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999976 2021-10-08T19:41:55.319 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.319 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.319 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:41:55.319 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.238299+0000", 2021-10-08T19:41:55.320 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7970000000000001e-06 2021-10-08T19:41:55.320 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.320 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.320 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:41:55.321 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.238309+0000", 2021-10-08T19:41:55.321 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0028e-05 2021-10-08T19:41:55.321 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.321 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.321 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:41:55.322 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.238315+0000", 2021-10-08T19:41:55.322 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5289999999999997e-06 2021-10-08T19:41:55.322 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.322 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.323 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:41:55.323 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.240231+0000", 2021-10-08T19:41:55.323 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001915707 2021-10-08T19:41:55.323 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.324 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.324 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:41:55.324 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.240343+0000", 2021-10-08T19:41:55.324 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000112365 2021-10-08T19:41:55.324 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.325 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.325 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0,6", 2021-10-08T19:41:55.325 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.240461+0000", 2021-10-08T19:41:55.325 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000117273 2021-10-08T19:41:55.325 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.326 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.326 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2021-10-08T19:41:55.326 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.242619+0000", 2021-10-08T19:41:55.326 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021586560000000001 2021-10-08T19:41:55.327 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:55.327 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:41:55.327 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:55.327 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.328 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.328 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.26125.0:192488 11.0 e486/433 11:06347962:::benchmark_data_smithi097_295476_object78739:head v 486'11937, mlcod=486'11933)", 2021-10-08T19:41:55.328 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:41:55.241117+0000", 2021-10-08T19:41:55.328 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.002873034, 2021-10-08T19:41:55.329 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032483009999999999, 2021-10-08T19:41:55.329 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:41:55.329 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2021-10-08T19:41:55.329 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:41:55.329 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.330 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:41:55.330 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.241117+0000", 2021-10-08T19:41:55.330 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:41:55.330 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.331 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.331 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:41:55.331 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.241117+0000", 2021-10-08T19:41:55.331 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:41:55.332 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.332 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.332 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:41:55.332 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.241116+0000", 2021-10-08T19:41:55.333 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2021-10-08T19:41:55.333 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.333 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.333 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:41:55.333 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.241125+0000", 2021-10-08T19:41:55.334 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0059999999999998e-06 2021-10-08T19:41:55.334 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.334 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.334 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:41:55.335 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.241135+0000", 2021-10-08T19:41:55.335 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0145e-05 2021-10-08T19:41:55.335 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.335 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.335 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:41:55.336 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.241141+0000", 2021-10-08T19:41:55.336 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9610000000000002e-06 2021-10-08T19:41:55.336 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.336 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.336 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2021-10-08T19:41:55.337 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.241178+0000", 2021-10-08T19:41:55.337 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7171e-05 2021-10-08T19:41:55.337 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.337 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.338 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2021-10-08T19:41:55.338 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.241197+0000", 2021-10-08T19:41:55.338 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8581999999999999e-05 2021-10-08T19:41:55.338 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:55.338 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:41:55.339 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:55.339 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.339 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.339 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop_reply(client.26125.0:192480 11.9 e486/433)", 2021-10-08T19:41:55.340 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:41:55.244358+0000", 2021-10-08T19:41:55.340 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4294967295.9996328, 2021-10-08T19:41:55.340 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4048999999999997e-05, 2021-10-08T19:41:55.340 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:41:55.341 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "queued for pg", 2021-10-08T19:41:55.341 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:41:55.341 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.341 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:41:55.342 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.244358+0000", 2021-10-08T19:41:55.342 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:41:55.342 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.342 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.342 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:41:55.343 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.244358+0000", 2021-10-08T19:41:55.343 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:41:55.343 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.343 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.343 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:41:55.344 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.244357+0000", 2021-10-08T19:41:55.344 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2021-10-08T19:41:55.344 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.344 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.345 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:41:55.345 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.244363+0000", 2021-10-08T19:41:55.345 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8560000000000003e-06 2021-10-08T19:41:55.345 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.345 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.346 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:41:55.346 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.244373+0000", 2021-10-08T19:41:55.346 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0403e-05 2021-10-08T19:41:55.346 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.347 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.347 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:41:55.347 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.244379+0000", 2021-10-08T19:41:55.347 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6670000000000001e-06 2021-10-08T19:41:55.347 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:55.348 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:41:55.348 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:55.348 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.348 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.349 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop_reply(client.26125.0:192489 11.9 e486/433)", 2021-10-08T19:41:55.349 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2021-10-08T19:41:55.244390+0000", 2021-10-08T19:41:55.349 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4294967295.9995999, 2021-10-08T19:41:55.349 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0084999999999998e-05, 2021-10-08T19:41:55.349 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2021-10-08T19:41:55.350 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "queued for pg", 2021-10-08T19:41:55.350 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2021-10-08T19:41:55.350 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.350 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2021-10-08T19:41:55.351 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.244390+0000", 2021-10-08T19:41:55.351 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:41:55.351 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.351 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.352 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2021-10-08T19:41:55.352 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.244390+0000", 2021-10-08T19:41:55.352 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2021-10-08T19:41:55.352 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.352 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.353 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2021-10-08T19:41:55.353 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.244390+0000", 2021-10-08T19:41:55.353 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2021-10-08T19:41:55.353 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.353 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.354 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2021-10-08T19:41:55.354 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.244393+0000", 2021-10-08T19:41:55.354 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.756e-06 2021-10-08T19:41:55.354 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.355 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.355 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2021-10-08T19:41:55.355 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.244397+0000", 2021-10-08T19:41:55.355 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5900000000000001e-06 2021-10-08T19:41:55.355 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:41:55.356 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:41:55.356 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2021-10-08T19:41:55.356 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2021-10-08T19:41:55.244401+0000", 2021-10-08T19:41:55.357 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4790000000000001e-06 2021-10-08T19:41:55.357 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:55.357 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:41:55.357 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:55.358 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:41:55.358 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:41:55.358 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 8 2021-10-08T19:41:55.358 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:41:55.359 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:41:55.360 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:41:55.361 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:55 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2331341521' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:41:55.361 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:55 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2331341521' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:41:55.362 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:41:55.362 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:41:55.375 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:41:55.393 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true' 2021-10-08T19:41:55.394 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true' 2021-10-08T19:41:55.394 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true' 2021-10-08T19:41:55.394 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true' 2021-10-08T19:41:55.394 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true' 2021-10-08T19:41:55.395 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true' 2021-10-08T19:41:55.395 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'true' 2021-10-08T19:41:55.395 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'true' 2021-10-08T19:41:55.723 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:41:55 smithi097 conmon[33110]: 172.21.15.97 - - [08/Oct/2021:19:41:55] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:41:56.100 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 4, 5, 7, 6, 1, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2021-10-08T19:41:56.101 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2021-10-08T19:41:56.101 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd dump -f json-pretty 2021-10-08T19:41:56.335 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:56.451 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:56 smithi097 ceph-mon[32687]: pgmap v1022: 188 pgs: 188 active+clean; 2.2 GiB data, 9.7 GiB used, 705 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.36k op/s 2021-10-08T19:41:56.452 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:56 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:41:56.452 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:56 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:41:56.452 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:56 smithi097 ceph-mon[32687]: 172.21.15.97 - - [08/Oct/2021:19:41:55] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:41:56.453 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:56 smithi097 ceph-mon[41966]: pgmap v1022: 188 pgs: 188 active+clean; 2.2 GiB data, 9.7 GiB used, 705 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.36k op/s 2021-10-08T19:41:56.453 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:56 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:41:56.453 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:56 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:41:56.453 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:56 smithi097 ceph-mon[41966]: 172.21.15.97 - - [08/Oct/2021:19:41:55] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:41:56.514 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:41:56.517 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:56.518 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:41:56.544 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset noscrub 2021-10-08T19:41:56.619 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:41:56.643 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:56 smithi117 ceph-mon[34585]: pgmap v1022: 188 pgs: 188 active+clean; 2.2 GiB data, 9.7 GiB used, 705 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.36k op/s 2021-10-08T19:41:56.644 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:56 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:41:56.644 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:56 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:41:56.644 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:56 smithi117 ceph-mon[34585]: 172.21.15.97 - - [08/Oct/2021:19:41:55] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:41:56.646 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:56.724 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:41:56.726 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:56.727 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:41:56.828 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:41:56.876 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:57.039 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:41:57.048 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:57.049 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:41:57.057 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2021-10-08T19:41:57.151 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:41:57.178 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:57.234 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:41:57.238 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:57.239 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:41:57.251 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:41:57.340 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:41:57.374 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:41:57.386 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:57.490 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:41:57.493 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:57.495 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:41:57.597 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:41:57.637 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:57.655 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:41:57 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:41:57.755 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:41:57.770 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:57.771 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:41:57.872 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:41:57.936 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:58.036 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:41:58.045 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:58.045 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:41:58.148 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:41:58.160 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:41:58.178 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:58.462 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:58 smithi097 ceph-mon[32687]: pgmap v1023: 188 pgs: 188 active+clean; 2.2 GiB data, 9.7 GiB used, 705 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.06k op/s 2021-10-08T19:41:58.462 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:41:58 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:41:58.537 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:41:58.541 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:58.542 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:41:58.643 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:41:58.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:58 smithi097 ceph-mon[41966]: pgmap v1023: 188 pgs: 188 active+clean; 2.2 GiB data, 9.7 GiB used, 705 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.06k op/s 2021-10-08T19:41:58.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:41:58 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:41:58.809 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:58 smithi117 ceph-mon[34585]: pgmap v1023: 188 pgs: 188 active+clean; 2.2 GiB data, 9.7 GiB used, 705 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.06k op/s 2021-10-08T19:41:58.810 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:41:58 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:41:58.812 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:58.889 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:41:58.896 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:58.897 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:41:58.998 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:41:59.031 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:59.102 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:41:59.104 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:59.105 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:41:59.198 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2021-10-08T19:41:59.206 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:41:59.308 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:41:59.954 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:41:59.959 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:41:59.960 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:42:00.062 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:42:00.102 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:00.255 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:42:00.258 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:00.259 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:42:00.360 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:42:00.408 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:00.496 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:00 smithi097 ceph-mon[41966]: pgmap v1024: 188 pgs: 188 active+clean; 2.1 GiB data, 9.2 GiB used, 706 GiB / 715 GiB avail; 537 B/s rd, 0 B/s wr, 917 op/s 2021-10-08T19:42:00.498 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:00 smithi097 ceph-mon[32687]: pgmap v1024: 188 pgs: 188 active+clean; 2.1 GiB data, 9.2 GiB used, 706 GiB / 715 GiB avail; 537 B/s rd, 0 B/s wr, 917 op/s 2021-10-08T19:42:00.519 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:42:00.520 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:00.521 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:42:00.622 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:42:00.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:00 smithi117 ceph-mon[34585]: pgmap v1024: 188 pgs: 188 active+clean; 2.1 GiB data, 9.2 GiB used, 706 GiB / 715 GiB avail; 537 B/s rd, 0 B/s wr, 917 op/s 2021-10-08T19:42:00.681 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:00.790 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:42:00.832 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:42:00.844 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:00.846 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:42:00.950 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:42:01.025 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:01.128 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:42:01.131 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:01.133 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:42:01.237 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:42:01.318 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:01.756 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:42:01.757 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:42:01.757 INFO:teuthology.orchestra.run.smithi097.stdout: "epoch": 486, 2021-10-08T19:42:01.758 INFO:teuthology.orchestra.run.smithi097.stdout: "fsid": "1d01f6d6-286c-11ec-8c25-001a4aab830c", 2021-10-08T19:42:01.758 INFO:teuthology.orchestra.run.smithi097.stdout: "created": "2021-10-08T19:16:25.258003+0000", 2021-10-08T19:42:01.759 INFO:teuthology.orchestra.run.smithi097.stdout: "modified": "2021-10-08T19:41:52.943252+0000", 2021-10-08T19:42:01.759 INFO:teuthology.orchestra.run.smithi097.stdout: "last_up_change": "2021-10-08T19:21:15.388758+0000", 2021-10-08T19:42:01.759 INFO:teuthology.orchestra.run.smithi097.stdout: "last_in_change": "2021-10-08T19:29:39.736986+0000", 2021-10-08T19:42:01.760 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-08T19:42:01.760 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_num": 5806080, 2021-10-08T19:42:01.760 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_set": [ 2021-10-08T19:42:01.760 INFO:teuthology.orchestra.run.smithi097.stdout: "nodeep-scrub", 2021-10-08T19:42:01.761 INFO:teuthology.orchestra.run.smithi097.stdout: "noscrub", 2021-10-08T19:42:01.761 INFO:teuthology.orchestra.run.smithi097.stdout: "pglog_hardlimit", 2021-10-08T19:42:01.761 INFO:teuthology.orchestra.run.smithi097.stdout: "purged_snapdirs", 2021-10-08T19:42:01.761 INFO:teuthology.orchestra.run.smithi097.stdout: "recovery_deletes", 2021-10-08T19:42:01.762 INFO:teuthology.orchestra.run.smithi097.stdout: "sortbitwise" 2021-10-08T19:42:01.762 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:42:01.762 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_version": 18, 2021-10-08T19:42:01.764 INFO:teuthology.orchestra.run.smithi097.stdout: "full_ratio": 0.94999998807907104, 2021-10-08T19:42:01.764 INFO:teuthology.orchestra.run.smithi097.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-08T19:42:01.764 INFO:teuthology.orchestra.run.smithi097.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-08T19:42:01.765 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_snapshot": "", 2021-10-08T19:42:01.765 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_max": 11, 2021-10-08T19:42:01.766 INFO:teuthology.orchestra.run.smithi097.stdout: "max_osd": 8, 2021-10-08T19:42:01.766 INFO:teuthology.orchestra.run.smithi097.stdout: "require_min_compat_client": "luminous", 2021-10-08T19:42:01.766 INFO:teuthology.orchestra.run.smithi097.stdout: "min_compat_client": "luminous", 2021-10-08T19:42:01.767 INFO:teuthology.orchestra.run.smithi097.stdout: "require_osd_release": "quincy", 2021-10-08T19:42:01.767 INFO:teuthology.orchestra.run.smithi097.stdout: "pools": [ 2021-10-08T19:42:01.767 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:01.767 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 1, 2021-10-08T19:42:01.768 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": ".mgr", 2021-10-08T19:42:01.768 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:19:44.413311+0000", 2021-10-08T19:42:01.768 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:42:01.768 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:42:01.769 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:42:01.769 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:42:01.770 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:42:01.770 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:42:01.770 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:42:01.771 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:42:01.771 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:42:01.771 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:42:01.771 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:42:01.774 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:42:01.774 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 11, 2021-10-08T19:42:01.774 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 11, 2021-10-08T19:42:01.774 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 11, 2021-10-08T19:42:01.775 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 11, 2021-10-08T19:42:01.775 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 11, 2021-10-08T19:42:01.775 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:42:01.775 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:42:01.776 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:42:01.776 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:42:01.776 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:42:01.776 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:42:01.776 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:42:01.777 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.777 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "171", 2021-10-08T19:42:01.777 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:42:01.777 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:42:01.778 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "170", 2021-10-08T19:42:01.778 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:42:01.778 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:42:01.778 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:42:01.778 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:42:01.779 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:42:01.779 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:42:01.779 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:42:01.779 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:42:01.779 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:42:01.780 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:42:01.780 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:42:01.780 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:42:01.780 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:42:01.781 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:42:01.781 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:42:01.781 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:42:01.781 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:42:01.781 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:42:01.782 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:42:01.782 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:42:01.782 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:42:01.782 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:42:01.782 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:42:01.783 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.784 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:42:01.784 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:42:01.784 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:42:01.784 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:42:01.785 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:42:01.785 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:42:01.785 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:42:01.786 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:42:01.786 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:42:01.786 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:42:01.786 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:42:01.786 INFO:teuthology.orchestra.run.smithi097.stdout: "options": { 2021-10-08T19:42:01.787 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_min": 1 2021-10-08T19:42:01.787 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.787 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:42:01.787 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": {} 2021-10-08T19:42:01.788 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:01.788 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.788 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:01.788 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 2, 2021-10-08T19:42:01.788 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": ".rgw.root", 2021-10-08T19:42:01.789 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:21:21.940881+0000", 2021-10-08T19:42:01.789 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:42:01.789 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:42:01.790 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:42:01.790 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:42:01.790 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:42:01.790 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:42:01.790 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:42:01.791 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:42:01.791 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:42:01.791 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:42:01.791 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:42:01.792 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:42:01.792 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 42, 2021-10-08T19:42:01.792 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 42, 2021-10-08T19:42:01.792 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 42, 2021-10-08T19:42:01.792 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 42, 2021-10-08T19:42:01.793 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 42, 2021-10-08T19:42:01.793 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:42:01.793 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:42:01.793 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:42:01.794 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:42:01.794 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:42:01.794 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:42:01.794 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:42:01.794 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.795 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "393", 2021-10-08T19:42:01.795 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:42:01.795 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:42:01.795 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "391", 2021-10-08T19:42:01.795 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:42:01.796 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:42:01.796 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:42:01.796 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:42:01.796 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:42:01.797 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:42:01.797 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:42:01.797 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:42:01.797 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:42:01.797 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:42:01.798 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:42:01.798 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:42:01.798 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:42:01.798 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:42:01.799 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:42:01.799 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:42:01.799 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:42:01.799 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:42:01.799 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:42:01.800 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:42:01.800 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:42:01.800 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:42:01.800 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:42:01.800 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.801 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:42:01.801 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:42:01.801 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:42:01.801 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:42:01.801 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:42:01.802 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:42:01.802 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:42:01.802 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:42:01.802 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:42:01.803 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:42:01.803 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:42:01.803 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2021-10-08T19:42:01.803 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:42:01.804 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw": {} 2021-10-08T19:42:01.804 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:01.804 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.804 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:01.804 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 3, 2021-10-08T19:42:01.805 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "iscsi", 2021-10-08T19:42:01.805 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:21:22.536945+0000", 2021-10-08T19:42:01.805 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:42:01.805 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:42:01.805 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:42:01.806 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:42:01.806 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:42:01.806 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:42:01.807 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:42:01.807 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:42:01.807 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:42:01.807 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:42:01.808 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:42:01.808 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:42:01.808 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 23, 2021-10-08T19:42:01.808 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 23, 2021-10-08T19:42:01.808 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 23, 2021-10-08T19:42:01.809 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 23, 2021-10-08T19:42:01.809 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 23, 2021-10-08T19:42:01.809 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:42:01.809 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:42:01.809 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:42:01.810 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:42:01.810 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:42:01.810 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:42:01.810 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:42:01.811 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.811 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "132", 2021-10-08T19:42:01.811 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:42:01.811 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:42:01.811 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "131", 2021-10-08T19:42:01.812 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:42:01.812 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:42:01.812 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:42:01.812 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:42:01.812 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:42:01.813 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:42:01.813 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:42:01.813 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:42:01.813 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:42:01.814 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:42:01.814 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:42:01.814 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:42:01.814 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:42:01.815 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:42:01.815 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:42:01.815 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:42:01.815 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:42:01.815 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:42:01.816 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:42:01.816 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:42:01.816 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:42:01.816 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:42:01.816 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:42:01.817 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.817 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:42:01.817 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:42:01.817 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:42:01.818 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:42:01.818 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:42:01.818 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:42:01.818 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:42:01.818 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:42:01.819 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:42:01.819 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:42:01.819 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:42:01.819 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2021-10-08T19:42:01.820 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:42:01.820 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd": {} 2021-10-08T19:42:01.820 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:01.820 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.820 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:01.821 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 4, 2021-10-08T19:42:01.821 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "default.rgw.log", 2021-10-08T19:42:01.821 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:21:23.886328+0000", 2021-10-08T19:42:01.821 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:42:01.822 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:42:01.822 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:42:01.822 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:42:01.822 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:42:01.822 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:42:01.823 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:42:01.823 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:42:01.823 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:42:01.823 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:42:01.823 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:42:01.824 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:42:01.824 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 32, 2021-10-08T19:42:01.824 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 32, 2021-10-08T19:42:01.824 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 32, 2021-10-08T19:42:01.825 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 32, 2021-10-08T19:42:01.825 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 32, 2021-10-08T19:42:01.825 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:42:01.825 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:42:01.825 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:42:01.826 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:42:01.826 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:42:01.826 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:42:01.826 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:42:01.827 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.827 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "64", 2021-10-08T19:42:01.827 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:42:01.827 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:42:01.827 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2021-10-08T19:42:01.828 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:42:01.828 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:42:01.828 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:42:01.828 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:42:01.828 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:42:01.829 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:42:01.829 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:42:01.829 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:42:01.829 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:42:01.830 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:42:01.830 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:42:01.830 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:42:01.830 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:42:01.830 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:42:01.831 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:42:01.831 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:42:01.831 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:42:01.831 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:42:01.832 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:42:01.832 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:42:01.832 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:42:01.832 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:42:01.832 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:42:01.833 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.833 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:42:01.833 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:42:01.833 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:42:01.833 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:42:01.834 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:42:01.834 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:42:01.834 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:42:01.834 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:42:01.835 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:42:01.835 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:42:01.835 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:42:01.835 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2021-10-08T19:42:01.835 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:42:01.836 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw": {} 2021-10-08T19:42:01.836 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:01.836 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.836 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:01.836 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 5, 2021-10-08T19:42:01.837 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "default.rgw.control", 2021-10-08T19:42:01.837 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:21:25.865032+0000", 2021-10-08T19:42:01.837 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:42:01.837 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:42:01.838 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:42:01.838 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:42:01.838 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:42:01.838 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:42:01.838 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:42:01.839 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:42:01.839 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:42:01.839 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:42:01.839 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:42:01.839 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:42:01.840 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 32, 2021-10-08T19:42:01.840 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 32, 2021-10-08T19:42:01.840 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 32, 2021-10-08T19:42:01.840 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 32, 2021-10-08T19:42:01.841 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 32, 2021-10-08T19:42:01.841 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:42:01.841 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:42:01.841 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:42:01.841 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:42:01.842 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:42:01.842 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:42:01.842 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:42:01.842 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.843 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "66", 2021-10-08T19:42:01.843 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:42:01.843 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:42:01.843 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2021-10-08T19:42:01.843 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:42:01.844 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:42:01.844 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:42:01.844 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:42:01.844 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:42:01.844 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:42:01.845 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:42:01.845 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:42:01.845 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:42:01.845 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:42:01.845 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:42:01.846 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:42:01.846 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:42:01.846 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:42:01.846 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:42:01.847 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:42:01.847 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:42:01.847 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:42:01.847 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:42:01.847 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:42:01.848 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:42:01.848 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:42:01.848 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:42:01.848 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.849 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:42:01.849 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:42:01.849 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:42:01.849 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:42:01.849 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:42:01.850 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:42:01.850 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:42:01.850 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:42:01.850 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:42:01.850 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:42:01.851 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:42:01.851 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2021-10-08T19:42:01.851 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:42:01.851 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw": {} 2021-10-08T19:42:01.851 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:01.852 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.852 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:01.852 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 6, 2021-10-08T19:42:01.852 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "default.rgw.meta", 2021-10-08T19:42:01.853 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:21:27.940767+0000", 2021-10-08T19:42:01.853 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:42:01.853 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:42:01.853 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:42:01.853 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:42:01.854 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:42:01.854 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:42:01.854 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:42:01.854 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:42:01.854 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:42:01.855 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:42:01.855 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:42:01.855 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:42:01.855 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 32, 2021-10-08T19:42:01.856 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 32, 2021-10-08T19:42:01.856 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 32, 2021-10-08T19:42:01.856 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 32, 2021-10-08T19:42:01.856 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 32, 2021-10-08T19:42:01.856 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:42:01.857 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:42:01.857 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:42:01.857 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:42:01.857 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:42:01.858 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:42:01.858 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:42:01.858 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.858 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "350", 2021-10-08T19:42:01.858 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:42:01.859 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:42:01.859 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2021-10-08T19:42:01.859 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:42:01.859 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:42:01.859 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:42:01.860 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:42:01.860 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:42:01.860 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:42:01.860 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:42:01.861 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:42:01.861 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:42:01.861 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:42:01.861 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:42:01.861 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:42:01.862 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:42:01.862 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:42:01.862 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:42:01.862 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:42:01.863 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:42:01.863 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:42:01.863 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:42:01.863 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:42:01.863 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:42:01.864 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:42:01.864 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:42:01.864 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.864 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:42:01.865 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:42:01.865 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:42:01.865 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:42:01.865 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:42:01.865 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:42:01.866 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:42:01.866 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:42:01.866 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:42:01.866 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:42:01.867 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:42:01.867 INFO:teuthology.orchestra.run.smithi097.stdout: "options": { 2021-10-08T19:42:01.867 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_bias": 4, 2021-10-08T19:42:01.867 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_min": 8 2021-10-08T19:42:01.867 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.868 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:42:01.868 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw": {} 2021-10-08T19:42:01.868 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:01.868 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.869 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:01.869 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 11, 2021-10-08T19:42:01.869 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "unique_pool_4", 2021-10-08T19:42:01.869 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:39:02.796147+0000", 2021-10-08T19:42:01.869 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:42:01.870 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:42:01.870 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:42:01.870 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:42:01.870 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:42:01.871 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:42:01.871 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:42:01.871 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:42:01.871 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:42:01.871 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:42:01.872 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:42:01.872 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:42:01.872 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 16, 2021-10-08T19:42:01.872 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 16, 2021-10-08T19:42:01.873 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 16, 2021-10-08T19:42:01.873 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 16, 2021-10-08T19:42:01.873 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 16, 2021-10-08T19:42:01.873 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:42:01.873 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:42:01.874 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:42:01.874 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:42:01.874 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:42:01.874 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:42:01.874 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:42:01.875 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.875 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "436", 2021-10-08T19:42:01.875 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:42:01.875 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:42:01.876 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2021-10-08T19:42:01.876 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:42:01.876 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:42:01.876 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:42:01.876 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:42:01.877 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:42:01.877 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:42:01.877 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:42:01.877 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:42:01.877 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:42:01.878 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:42:01.878 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:42:01.878 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:42:01.878 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:42:01.879 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:42:01.879 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:42:01.879 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:42:01.879 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:42:01.879 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:42:01.880 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:42:01.880 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:42:01.880 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:42:01.880 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:42:01.880 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:42:01.881 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.881 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:42:01.881 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:42:01.881 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:42:01.882 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:42:01.882 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:42:01.882 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:42:01.882 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:42:01.882 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:42:01.883 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:42:01.883 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:42:01.883 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:42:01.883 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2021-10-08T19:42:01.883 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:42:01.884 INFO:teuthology.orchestra.run.smithi097.stdout: "rados": {} 2021-10-08T19:42:01.884 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:01.884 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:01.884 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:42:01.885 INFO:teuthology.orchestra.run.smithi097.stdout: "osds": [ 2021-10-08T19:42:01.885 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:01.885 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 0, 2021-10-08T19:42:01.885 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "9e64e714-a5d5-4fbb-ae2b-1df4bf14b8e0", 2021-10-08T19:42:01.885 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:42:01.886 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:42:01.886 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:42:01.886 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:42:01.886 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:42:01.887 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:42:01.887 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 8, 2021-10-08T19:42:01.887 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 433, 2021-10-08T19:42:01.887 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:42:01.887 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:42:01.888 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:42:01.888 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:01.888 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:01.888 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:01.888 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6801", 2021-10-08T19:42:01.889 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3354161282 2021-10-08T19:42:01.889 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:01.889 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:01.889 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.890 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:42:01.890 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:01.890 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:01.890 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:01.891 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6802", 2021-10-08T19:42:01.891 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3354161282 2021-10-08T19:42:01.891 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:01.891 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:01.892 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.892 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:42:01.892 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:01.892 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:01.892 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:01.893 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6804", 2021-10-08T19:42:01.893 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3354161282 2021-10-08T19:42:01.893 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:01.893 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:01.893 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.894 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:42:01.894 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:01.894 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:01.894 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:01.895 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6803", 2021-10-08T19:42:01.895 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3354161282 2021-10-08T19:42:01.895 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:01.895 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:01.895 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.896 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.97:6801/3354161282", 2021-10-08T19:42:01.896 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.97:6802/3354161282", 2021-10-08T19:42:01.896 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.97:6804/3354161282", 2021-10-08T19:42:01.896 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.97:6803/3354161282", 2021-10-08T19:42:01.896 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:42:01.897 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:42:01.897 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:42:01.897 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:01.897 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.898 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:01.898 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 1, 2021-10-08T19:42:01.898 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "32602a22-f263-4b62-a8d8-50fddfb73fa8", 2021-10-08T19:42:01.898 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:42:01.898 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:42:01.899 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:42:01.899 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 0.99786376953125, 2021-10-08T19:42:01.899 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:42:01.899 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:42:01.900 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 13, 2021-10-08T19:42:01.900 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 433, 2021-10-08T19:42:01.900 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:42:01.900 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:42:01.900 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:42:01.901 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:01.901 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:01.901 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:01.901 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6805", 2021-10-08T19:42:01.901 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 735799205 2021-10-08T19:42:01.902 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:01.902 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:01.902 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.902 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:42:01.903 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:01.903 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:01.903 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:01.903 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6806", 2021-10-08T19:42:01.903 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 735799205 2021-10-08T19:42:01.904 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:01.904 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:01.904 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.904 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:42:01.904 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:01.905 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:01.905 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:01.905 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6808", 2021-10-08T19:42:01.905 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 735799205 2021-10-08T19:42:01.906 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:01.906 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:01.906 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.906 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:42:01.906 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:01.907 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:01.907 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:01.907 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6807", 2021-10-08T19:42:01.907 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 735799205 2021-10-08T19:42:01.907 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:01.908 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:01.908 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.908 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.97:6805/735799205", 2021-10-08T19:42:01.908 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.97:6806/735799205", 2021-10-08T19:42:01.909 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.97:6808/735799205", 2021-10-08T19:42:01.909 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.97:6807/735799205", 2021-10-08T19:42:01.909 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:42:01.909 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:42:01.909 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:42:01.910 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:01.910 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.910 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:01.910 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 2, 2021-10-08T19:42:01.911 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "88e0e4a2-b4a3-4a00-8669-03c3d9b166c5", 2021-10-08T19:42:01.911 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:42:01.911 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:42:01.911 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:42:01.911 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:42:01.912 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:42:01.912 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:42:01.912 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 18, 2021-10-08T19:42:01.912 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 433, 2021-10-08T19:42:01.912 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:42:01.913 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:42:01.913 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:42:01.913 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:01.913 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:01.914 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:01.914 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6809", 2021-10-08T19:42:01.914 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2366482649 2021-10-08T19:42:01.914 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:01.914 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:01.915 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.915 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:42:01.915 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:01.915 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:01.916 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:01.916 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6810", 2021-10-08T19:42:01.916 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2366482649 2021-10-08T19:42:01.916 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:01.916 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:01.917 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.917 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:42:01.917 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:01.917 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:01.918 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:01.918 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6812", 2021-10-08T19:42:01.918 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2366482649 2021-10-08T19:42:01.918 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:01.918 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:01.919 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.919 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:42:01.919 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:01.919 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:01.920 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:01.920 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6811", 2021-10-08T19:42:01.920 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2366482649 2021-10-08T19:42:01.920 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:01.920 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:01.921 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.921 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.97:6809/2366482649", 2021-10-08T19:42:01.921 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.97:6810/2366482649", 2021-10-08T19:42:01.921 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.97:6812/2366482649", 2021-10-08T19:42:01.921 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.97:6811/2366482649", 2021-10-08T19:42:01.922 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:42:01.922 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:42:01.922 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:42:01.922 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:01.923 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.923 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:01.923 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 3, 2021-10-08T19:42:01.923 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "e689d708-b501-4526-a31a-1e598b74654d", 2021-10-08T19:42:01.923 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:42:01.924 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:42:01.924 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:42:01.924 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:42:01.924 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:42:01.925 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:42:01.925 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 24, 2021-10-08T19:42:01.925 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 433, 2021-10-08T19:42:01.925 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:42:01.925 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:42:01.926 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:42:01.926 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:01.926 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:01.926 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:01.927 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6813", 2021-10-08T19:42:01.927 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3191181122 2021-10-08T19:42:01.927 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:01.927 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:01.927 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.928 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:42:01.928 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:01.928 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:01.928 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:01.929 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6814", 2021-10-08T19:42:01.929 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3191181122 2021-10-08T19:42:01.929 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:01.929 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:01.929 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.930 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:42:01.930 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:01.930 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:01.930 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:01.930 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6816", 2021-10-08T19:42:01.931 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3191181122 2021-10-08T19:42:01.931 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:01.931 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:01.931 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.932 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:42:01.932 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:01.932 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:01.932 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:01.932 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6815", 2021-10-08T19:42:01.933 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3191181122 2021-10-08T19:42:01.933 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:01.933 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:01.933 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.933 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.97:6813/3191181122", 2021-10-08T19:42:01.934 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.97:6814/3191181122", 2021-10-08T19:42:01.934 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.97:6816/3191181122", 2021-10-08T19:42:01.934 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.97:6815/3191181122", 2021-10-08T19:42:01.934 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:42:01.935 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:42:01.940 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:42:01.941 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:01.941 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.941 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:01.941 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 4, 2021-10-08T19:42:01.942 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "67e4730a-be1c-4d88-9307-e3c2cf3ab2ef", 2021-10-08T19:42:01.942 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:42:01.942 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:42:01.942 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:42:01.943 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:42:01.943 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:42:01.943 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:42:01.943 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 30, 2021-10-08T19:42:01.943 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 448, 2021-10-08T19:42:01.944 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:42:01.944 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:42:01.944 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:42:01.944 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:01.944 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:01.945 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:01.945 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6800", 2021-10-08T19:42:01.945 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 106778208 2021-10-08T19:42:01.945 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:01.946 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:01.946 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.946 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:42:01.946 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:01.946 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:01.947 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:01.947 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6801", 2021-10-08T19:42:01.947 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 106778208 2021-10-08T19:42:01.947 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:01.947 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:01.948 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.948 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:42:01.948 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:01.948 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:01.949 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:01.949 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6803", 2021-10-08T19:42:01.949 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 106778208 2021-10-08T19:42:01.949 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:01.949 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:01.950 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.950 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:42:01.950 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:01.950 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:01.951 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:01.951 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6802", 2021-10-08T19:42:01.951 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 106778208 2021-10-08T19:42:01.951 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:01.951 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:01.952 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.952 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.117:6800/106778208", 2021-10-08T19:42:01.952 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.117:6801/106778208", 2021-10-08T19:42:01.952 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.117:6803/106778208", 2021-10-08T19:42:01.952 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.117:6802/106778208", 2021-10-08T19:42:01.953 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:42:01.953 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:42:01.953 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:42:01.953 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:01.954 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.954 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:01.954 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 5, 2021-10-08T19:42:01.954 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "f9fd3153-3e4e-4489-8927-a65641f05d42", 2021-10-08T19:42:01.954 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:42:01.955 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:42:01.955 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:42:01.955 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 0.2890472412109375, 2021-10-08T19:42:01.955 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:42:01.956 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:42:01.956 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 38, 2021-10-08T19:42:01.956 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 391, 2021-10-08T19:42:01.956 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:42:01.956 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:42:01.957 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:42:01.957 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:01.957 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:01.957 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:01.957 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6804", 2021-10-08T19:42:01.958 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3199889891 2021-10-08T19:42:01.958 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:01.958 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:01.958 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.959 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:42:01.959 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:01.959 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:01.959 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:01.959 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6805", 2021-10-08T19:42:01.960 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3199889891 2021-10-08T19:42:01.960 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:01.960 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:01.960 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.960 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:42:01.961 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:01.961 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:01.961 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:01.961 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6807", 2021-10-08T19:42:01.962 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3199889891 2021-10-08T19:42:01.962 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:01.962 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:01.962 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.962 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:42:01.963 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:01.963 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:01.963 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:01.963 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6806", 2021-10-08T19:42:01.963 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3199889891 2021-10-08T19:42:01.964 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:01.964 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:01.964 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.964 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.117:6804/3199889891", 2021-10-08T19:42:01.965 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.117:6805/3199889891", 2021-10-08T19:42:01.965 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.117:6807/3199889891", 2021-10-08T19:42:01.965 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.117:6806/3199889891", 2021-10-08T19:42:01.965 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:42:01.965 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:42:01.966 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:42:01.966 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:01.966 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.966 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:01.967 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 6, 2021-10-08T19:42:01.967 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "84898f12-c37d-4eb6-8b71-5b86bfe16e7d", 2021-10-08T19:42:01.967 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:42:01.967 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:42:01.967 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:42:01.968 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:42:01.968 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:42:01.968 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:42:01.968 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 47, 2021-10-08T19:42:01.968 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 433, 2021-10-08T19:42:01.969 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:42:01.969 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:42:01.969 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:42:01.969 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:01.970 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:01.970 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:01.970 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6808", 2021-10-08T19:42:01.970 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2185843951 2021-10-08T19:42:01.970 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:01.971 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:01.971 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.971 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:42:01.971 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:01.972 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:01.972 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:01.972 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6809", 2021-10-08T19:42:01.972 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2185843951 2021-10-08T19:42:01.972 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:01.973 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:01.973 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.973 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:42:01.973 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:01.973 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:01.974 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:01.974 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6811", 2021-10-08T19:42:01.974 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2185843951 2021-10-08T19:42:01.974 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:01.975 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:01.975 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.975 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:42:01.975 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:01.975 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:01.976 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:01.976 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6810", 2021-10-08T19:42:01.976 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2185843951 2021-10-08T19:42:01.976 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:01.977 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:01.977 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.977 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.117:6808/2185843951", 2021-10-08T19:42:01.977 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.117:6809/2185843951", 2021-10-08T19:42:01.977 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.117:6811/2185843951", 2021-10-08T19:42:01.978 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.117:6810/2185843951", 2021-10-08T19:42:01.978 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:42:01.978 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:42:01.978 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:42:01.978 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:01.979 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.979 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:01.979 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 7, 2021-10-08T19:42:01.979 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "529af2ce-2ae9-41ed-8c8e-d133628cfd20", 2021-10-08T19:42:01.980 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:42:01.980 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:42:01.980 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:42:01.980 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:42:01.980 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:42:01.981 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:42:01.981 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 55, 2021-10-08T19:42:01.981 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 433, 2021-10-08T19:42:01.981 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:42:01.981 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:42:01.982 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:42:01.982 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:01.982 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:01.982 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:01.983 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6812", 2021-10-08T19:42:01.983 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2817683239 2021-10-08T19:42:01.983 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:01.983 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:01.983 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.984 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:42:01.984 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:01.984 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:01.984 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:01.984 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6813", 2021-10-08T19:42:01.985 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2817683239 2021-10-08T19:42:01.985 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:01.985 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:01.985 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.986 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:42:01.986 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:01.986 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:01.986 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:01.986 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6815", 2021-10-08T19:42:01.987 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2817683239 2021-10-08T19:42:01.987 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:01.987 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:01.987 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.988 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:42:01.988 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:01.988 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:01.988 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:01.988 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6814", 2021-10-08T19:42:01.989 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2817683239 2021-10-08T19:42:01.989 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:01.989 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:01.989 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.990 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.117:6812/2817683239", 2021-10-08T19:42:01.990 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.117:6813/2817683239", 2021-10-08T19:42:01.990 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.117:6815/2817683239", 2021-10-08T19:42:01.991 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.117:6814/2817683239", 2021-10-08T19:42:01.991 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:42:01.991 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:42:01.991 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:42:01.991 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:01.992 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:01.992 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:42:01.992 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_xinfo": [ 2021-10-08T19:42:01.993 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:01.993 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 0, 2021-10-08T19:42:01.993 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:42:01.993 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:42:01.993 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:42:01.994 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:42:01.994 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:42:01.994 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:41:24.599654+0000", 2021-10-08T19:42:01.994 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:42:01.995 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.995 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:01.995 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 1, 2021-10-08T19:42:01.995 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:42:01.995 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:42:01.996 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:42:01.996 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:42:01.996 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:42:01.996 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:41:01.470497+0000", 2021-10-08T19:42:01.996 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:42:01.997 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.997 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:01.997 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 2, 2021-10-08T19:42:01.998 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:42:01.998 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:42:01.998 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:42:01.998 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:42:01.998 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:42:01.999 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:41:28.772842+0000", 2021-10-08T19:42:01.999 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:42:01.999 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:01.999 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:02.000 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 3, 2021-10-08T19:42:02.000 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:42:02.000 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:42:02.000 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:42:02.000 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:42:02.001 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:42:02.001 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:40:55.635204+0000", 2021-10-08T19:42:02.001 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:42:02.001 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:02.002 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:02.003 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 4, 2021-10-08T19:42:02.003 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:42:02.003 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:42:02.003 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:42:02.003 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:42:02.004 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:42:02.004 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:41:21.115853+0000", 2021-10-08T19:42:02.004 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:42:02.004 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:02.005 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:02.005 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 5, 2021-10-08T19:42:02.005 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:42:02.005 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:42:02.005 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:42:02.006 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:42:02.006 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:42:02.006 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:40:45.947424+0000", 2021-10-08T19:42:02.006 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:42:02.006 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:02.007 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:02.007 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 6, 2021-10-08T19:42:02.007 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:42:02.008 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:42:02.008 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:42:02.008 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:42:02.008 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:42:02.009 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:40:49.591389+0000", 2021-10-08T19:42:02.009 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:42:02.009 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:02.009 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:02.010 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 7, 2021-10-08T19:42:02.010 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:42:02.010 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:42:02.011 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:42:02.011 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:42:02.011 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:42:02.011 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:41:20.788560+0000", 2021-10-08T19:42:02.011 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:42:02.012 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:02.012 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:42:02.012 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_upmap": [ 2021-10-08T19:42:02.013 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:02.013 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "2.12", 2021-10-08T19:42:02.013 INFO:teuthology.orchestra.run.smithi097.stdout: "osds": [ 2021-10-08T19:42:02.013 INFO:teuthology.orchestra.run.smithi097.stdout: 5, 2021-10-08T19:42:02.014 INFO:teuthology.orchestra.run.smithi097.stdout: 4, 2021-10-08T19:42:02.014 INFO:teuthology.orchestra.run.smithi097.stdout: 2 2021-10-08T19:42:02.014 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:02.014 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:02.014 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:42:02.015 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_upmap_items": [ 2021-10-08T19:42:02.015 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:02.015 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "2.0", 2021-10-08T19:42:02.015 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:42:02.016 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:02.016 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 7, 2021-10-08T19:42:02.016 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 2 2021-10-08T19:42:02.016 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:02.017 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:02.017 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:02.017 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:02.018 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "2.3", 2021-10-08T19:42:02.018 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:42:02.018 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:02.018 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 7, 2021-10-08T19:42:02.019 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 4 2021-10-08T19:42:02.019 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:02.019 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:02.019 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:02.019 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:02.020 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "2.7", 2021-10-08T19:42:02.020 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:42:02.020 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:02.020 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 7, 2021-10-08T19:42:02.021 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 1 2021-10-08T19:42:02.021 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:02.021 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:02.021 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:02.021 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:02.022 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "2.1a", 2021-10-08T19:42:02.022 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:42:02.022 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:02.022 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 7, 2021-10-08T19:42:02.022 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 2 2021-10-08T19:42:02.023 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:02.023 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:02.023 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:02.023 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:02.024 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "2.29", 2021-10-08T19:42:02.024 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:42:02.024 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:02.024 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 7, 2021-10-08T19:42:02.024 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 2 2021-10-08T19:42:02.025 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:02.025 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:02.025 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:02.025 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:02.025 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "4.6", 2021-10-08T19:42:02.026 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:42:02.026 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:02.026 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 1, 2021-10-08T19:42:02.026 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 5 2021-10-08T19:42:02.027 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:02.027 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:02.027 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:02.027 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:02.027 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "4.f", 2021-10-08T19:42:02.028 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:42:02.028 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:02.028 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 1, 2021-10-08T19:42:02.028 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 2 2021-10-08T19:42:02.028 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:02.029 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:02.029 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:02.029 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:02.029 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "4.10", 2021-10-08T19:42:02.030 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:42:02.030 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:02.030 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 1, 2021-10-08T19:42:02.030 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 2 2021-10-08T19:42:02.030 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:02.031 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:02.031 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:02.031 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:02.031 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "5.19", 2021-10-08T19:42:02.032 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:42:02.032 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:02.032 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 5, 2021-10-08T19:42:02.032 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 7 2021-10-08T19:42:02.032 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:02.033 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:02.033 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:02.034 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:42:02.034 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_temp": [], 2021-10-08T19:42:02.034 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_temp": [], 2021-10-08T19:42:02.034 INFO:teuthology.orchestra.run.smithi097.stdout: "blocklist": { 2021-10-08T19:42:02.035 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/2600364788": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:42:02.035 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/4129083289": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:42:02.035 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/1443158975": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:42:02.035 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/2472640384": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:42:02.036 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/3196919488": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:42:02.036 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:6800/3195862546": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:42:02.036 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:6800/3931202434": "2021-10-09T19:17:10.051948+0000", 2021-10-08T19:42:02.036 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/2761595213": "2021-10-09T19:17:10.051948+0000", 2021-10-08T19:42:02.037 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/900681504": "2021-10-09T19:17:10.051948+0000", 2021-10-08T19:42:02.037 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/3932251406": "2021-10-09T19:17:10.051948+0000", 2021-10-08T19:42:02.037 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/398006785": "2021-10-09T19:16:48.651177+0000", 2021-10-08T19:42:02.037 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/1642570050": "2021-10-09T19:16:48.651177+0000", 2021-10-08T19:42:02.037 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/300178790": "2021-10-09T19:16:48.651177+0000", 2021-10-08T19:42:02.038 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:6800/845999767": "2021-10-09T19:16:48.651177+0000" 2021-10-08T19:42:02.038 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:02.038 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profiles": { 2021-10-08T19:42:02.038 INFO:teuthology.orchestra.run.smithi097.stdout: "default": { 2021-10-08T19:42:02.039 INFO:teuthology.orchestra.run.smithi097.stdout: "crush-failure-domain": "osd", 2021-10-08T19:42:02.039 INFO:teuthology.orchestra.run.smithi097.stdout: "k": "2", 2021-10-08T19:42:02.040 INFO:teuthology.orchestra.run.smithi097.stdout: "m": "1", 2021-10-08T19:42:02.040 INFO:teuthology.orchestra.run.smithi097.stdout: "plugin": "jerasure", 2021-10-08T19:42:02.040 INFO:teuthology.orchestra.run.smithi097.stdout: "technique": "reed_sol_van" 2021-10-08T19:42:02.041 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:02.041 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:02.041 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps_queue": [], 2021-10-08T19:42:02.041 INFO:teuthology.orchestra.run.smithi097.stdout: "new_removed_snaps": [], 2021-10-08T19:42:02.042 INFO:teuthology.orchestra.run.smithi097.stdout: "new_purged_snaps": [], 2021-10-08T19:42:02.042 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_node_flags": {}, 2021-10-08T19:42:02.042 INFO:teuthology.orchestra.run.smithi097.stdout: "device_class_flags": {}, 2021-10-08T19:42:02.043 INFO:teuthology.orchestra.run.smithi097.stdout: "stretch_mode": { 2021-10-08T19:42:02.043 INFO:teuthology.orchestra.run.smithi097.stdout: "stretch_mode_enabled": false, 2021-10-08T19:42:02.044 INFO:teuthology.orchestra.run.smithi097.stdout: "stretch_bucket_count": 0, 2021-10-08T19:42:02.044 INFO:teuthology.orchestra.run.smithi097.stdout: "degraded_stretch_mode": 0, 2021-10-08T19:42:02.044 INFO:teuthology.orchestra.run.smithi097.stdout: "recovering_stretch_mode": 0, 2021-10-08T19:42:02.044 INFO:teuthology.orchestra.run.smithi097.stdout: "stretch_mode_bucket": 0 2021-10-08T19:42:02.045 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:02.045 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:42:02.046 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:02.047 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:42:02.048 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:42:02.050 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is unset 2021-10-08T19:42:02.150 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:42:02.210 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:01 smithi097 ceph-mon[32687]: pgmap v1025: 188 pgs: 188 active+clean; 1.9 GiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.07k op/s 2021-10-08T19:42:02.211 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:01 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1955588533' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:42:02.211 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:01 smithi097 ceph-mon[32687]: from='client.26338 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:42:02.212 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:01 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3806216524' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2021-10-08T19:42:02.212 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:01 smithi097 ceph-mon[41966]: pgmap v1025: 188 pgs: 188 active+clean; 1.9 GiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.07k op/s 2021-10-08T19:42:02.213 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:01 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1955588533' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:42:02.213 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:01 smithi097 ceph-mon[41966]: from='client.26338 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:42:02.213 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:01 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3806216524' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2021-10-08T19:42:02.218 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:02.330 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:01 smithi117 ceph-mon[34585]: pgmap v1025: 188 pgs: 188 active+clean; 1.9 GiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.07k op/s 2021-10-08T19:42:02.331 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:01 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1955588533' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:42:02.331 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:01 smithi117 ceph-mon[34585]: from='client.26338 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:42:02.331 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:01 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3806216524' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2021-10-08T19:42:02.657 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:42:02 smithi117 conmon[69189]: level=error ts=2021-10-08T19:42:02.315Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=1 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:42:02.934 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:42:02 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:42:02] "GET /metrics HTTP/1.1" 200 155965 "" "Prometheus/2.18.1" 2021-10-08T19:42:02.988 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:42:02.993 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:02.994 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:42:03.096 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:42:03.157 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:03.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:02 smithi097 ceph-mon[32687]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:42:03.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:02 smithi097 ceph-mon[32687]: from='client.26338 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:42:03.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:02 smithi097 ceph-mon[32687]: osdmap e487: 8 total, 8 up, 8 in 2021-10-08T19:42:03.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:02 smithi097 ceph-mon[32687]: 1.8 scrub ok 2021-10-08T19:42:03.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:02 smithi097 ceph-mon[32687]: 4.1e scrub ok 2021-10-08T19:42:03.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:02 smithi097 ceph-mon[41966]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:42:03.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:02 smithi097 ceph-mon[41966]: from='client.26338 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:42:03.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:02 smithi097 ceph-mon[41966]: osdmap e487: 8 total, 8 up, 8 in 2021-10-08T19:42:03.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:02 smithi097 ceph-mon[41966]: 1.8 scrub ok 2021-10-08T19:42:03.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:02 smithi097 ceph-mon[41966]: 4.1e scrub ok 2021-10-08T19:42:03.385 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:42:03.389 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:02 smithi117 ceph-mon[34585]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:42:03.390 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:02 smithi117 ceph-mon[34585]: from='client.26338 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:42:03.390 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:02 smithi117 ceph-mon[34585]: osdmap e487: 8 total, 8 up, 8 in 2021-10-08T19:42:03.390 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:02 smithi117 ceph-mon[34585]: 1.8 scrub ok 2021-10-08T19:42:03.391 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:02 smithi117 ceph-mon[34585]: 4.1e scrub ok 2021-10-08T19:42:03.393 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:03.394 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:42:03.495 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:42:03.565 INFO:tasks.thrashosds.thrasher:j is {'epoch': 486, 'fsid': '1d01f6d6-286c-11ec-8c25-001a4aab830c', 'created': '2021-10-08T19:16:25.258003+0000', 'modified': '2021-10-08T19:41:52.943252+0000', 'last_up_change': '2021-10-08T19:21:15.388758+0000', 'last_in_change': '2021-10-08T19:29:39.736986+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 18, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 11, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'quincy', 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2021-10-08T19:19:44.413311+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 11, 'pg_placement_num': 11, 'pg_placement_num_target': 11, 'pg_num_target': 11, 'pg_num_pending': 11, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '171', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '170', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': '.rgw.root', 'create_time': '2021-10-08T19:21:21.940881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 42, 'pg_placement_num': 42, 'pg_placement_num_target': 42, 'pg_num_target': 42, 'pg_num_pending': 42, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '393', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '391', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 3, 'pool_name': 'iscsi', 'create_time': '2021-10-08T19:21:22.536945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 23, 'pg_placement_num': 23, 'pg_placement_num_target': 23, 'pg_num_target': 23, 'pg_num_pending': 23, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '132', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '131', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 4, 'pool_name': 'default.rgw.log', 'create_time': '2021-10-08T19:21:23.886328+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 5, 'pool_name': 'default.rgw.control', 'create_time': '2021-10-08T19:21:25.865032+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 6, 'pool_name': 'default.rgw.meta', 'create_time': '2021-10-08T19:21:27.940767+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '350', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 8}, 'application_metadata': {'rgw': {}}}, {'pool': 11, 'pool_name': 'unique_pool_4', 'create_time': '2021-10-08T19:39:02.796147+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '436', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}], 'osds': [{'osd': 0, 'uuid': '9e64e714-a5d5-4fbb-ae2b-1df4bf14b8e0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 433, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6801', 'nonce': 3354161282}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6802', 'nonce': 3354161282}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6804', 'nonce': 3354161282}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6803', 'nonce': 3354161282}]}, 'public_addr': '172.21.15.97:6801/3354161282', 'cluster_addr': '172.21.15.97:6802/3354161282', 'heartbeat_back_addr': '172.21.15.97:6804/3354161282', 'heartbeat_front_addr': '172.21.15.97:6803/3354161282', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '32602a22-f263-4b62-a8d8-50fddfb73fa8', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.99786376953125, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 433, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6805', 'nonce': 735799205}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6806', 'nonce': 735799205}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6808', 'nonce': 735799205}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6807', 'nonce': 735799205}]}, 'public_addr': '172.21.15.97:6805/735799205', 'cluster_addr': '172.21.15.97:6806/735799205', 'heartbeat_back_addr': '172.21.15.97:6808/735799205', 'heartbeat_front_addr': '172.21.15.97:6807/735799205', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '88e0e4a2-b4a3-4a00-8669-03c3d9b166c5', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 18, 'up_thru': 433, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6809', 'nonce': 2366482649}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6810', 'nonce': 2366482649}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6812', 'nonce': 2366482649}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6811', 'nonce': 2366482649}]}, 'public_addr': '172.21.15.97:6809/2366482649', 'cluster_addr': '172.21.15.97:6810/2366482649', 'heartbeat_back_addr': '172.21.15.97:6812/2366482649', 'heartbeat_front_addr': '172.21.15.97:6811/2366482649', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': 'e689d708-b501-4526-a31a-1e598b74654d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 24, 'up_thru': 433, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6813', 'nonce': 3191181122}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6814', 'nonce': 3191181122}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6816', 'nonce': 3191181122}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6815', 'nonce': 3191181122}]}, 'public_addr': '172.21.15.97:6813/3191181122', 'cluster_addr': '172.21.15.97:6814/3191181122', 'heartbeat_back_addr': '172.21.15.97:6816/3191181122', 'heartbeat_front_addr': '172.21.15.97:6815/3191181122', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '67e4730a-be1c-4d88-9307-e3c2cf3ab2ef', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 30, 'up_thru': 448, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6800', 'nonce': 106778208}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6801', 'nonce': 106778208}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6803', 'nonce': 106778208}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6802', 'nonce': 106778208}]}, 'public_addr': '172.21.15.117:6800/106778208', 'cluster_addr': '172.21.15.117:6801/106778208', 'heartbeat_back_addr': '172.21.15.117:6803/106778208', 'heartbeat_front_addr': '172.21.15.117:6802/106778208', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'f9fd3153-3e4e-4489-8927-a65641f05d42', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.2890472412109375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 38, 'up_thru': 391, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6804', 'nonce': 3199889891}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6805', 'nonce': 3199889891}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6807', 'nonce': 3199889891}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6806', 'nonce': 3199889891}]}, 'public_addr': '172.21.15.117:6804/3199889891', 'cluster_addr': '172.21.15.117:6805/3199889891', 'heartbeat_back_addr': '172.21.15.117:6807/3199889891', 'heartbeat_front_addr': '172.21.15.117:6806/3199889891', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '84898f12-c37d-4eb6-8b71-5b86bfe16e7d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 47, 'up_thru': 433, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6808', 'nonce': 2185843951}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6809', 'nonce': 2185843951}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6811', 'nonce': 2185843951}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6810', 'nonce': 2185843951}]}, 'public_addr': '172.21.15.117:6808/2185843951', 'cluster_addr': '172.21.15.117:6809/2185843951', 'heartbeat_back_addr': '172.21.15.117:6811/2185843951', 'heartbeat_front_addr': '172.21.15.117:6810/2185843951', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '529af2ce-2ae9-41ed-8c8e-d133628cfd20', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 55, 'up_thru': 433, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6812', 'nonce': 2817683239}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6813', 'nonce': 2817683239}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6815', 'nonce': 2817683239}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6814', 'nonce': 2817683239}]}, 'public_addr': '172.21.15.117:6812/2817683239', 'cluster_addr': '172.21.15.117:6813/2817683239', 'heartbeat_back_addr': '172.21.15.117:6815/2817683239', 'heartbeat_front_addr': '172.21.15.117:6814/2817683239', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:41:24.599654+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:41:01.470497+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:41:28.772842+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:40:55.635204+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:41:21.115853+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:40:45.947424+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:40:49.591389+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:41:20.788560+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '2.12', 'osds': [5, 4, 2]}], 'pg_upmap_items': [{'pgid': '2.0', 'mappings': [{'from': 7, 'to': 2}]}, {'pgid': '2.3', 'mappings': [{'from': 7, 'to': 4}]}, {'pgid': '2.7', 'mappings': [{'from': 7, 'to': 1}]}, {'pgid': '2.1a', 'mappings': [{'from': 7, 'to': 2}]}, {'pgid': '2.29', 'mappings': [{'from': 7, 'to': 2}]}, {'pgid': '4.6', 'mappings': [{'from': 1, 'to': 5}]}, {'pgid': '4.f', 'mappings': [{'from': 1, 'to': 2}]}, {'pgid': '4.10', 'mappings': [{'from': 1, 'to': 2}]}, {'pgid': '5.19', 'mappings': [{'from': 5, 'to': 7}]}], 'pg_temp': [], 'primary_temp': [], 'blocklist': {'172.21.15.97:0/2600364788': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:0/4129083289': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:0/1443158975': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:0/2472640384': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:0/3196919488': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:6800/3195862546': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:6800/3931202434': '2021-10-09T19:17:10.051948+0000', '172.21.15.97:0/2761595213': '2021-10-09T19:17:10.051948+0000', '172.21.15.97:0/900681504': '2021-10-09T19:17:10.051948+0000', '172.21.15.97:0/3932251406': '2021-10-09T19:17:10.051948+0000', '172.21.15.97:0/398006785': '2021-10-09T19:16:48.651177+0000', '172.21.15.97:0/1642570050': '2021-10-09T19:16:48.651177+0000', '172.21.15.97:0/300178790': '2021-10-09T19:16:48.651177+0000', '172.21.15.97:6800/845999767': '2021-10-09T19:16:48.651177+0000'}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2021-10-08T19:42:03.565 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph pg dump --format=json 2021-10-08T19:42:03.590 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:03.802 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:42:03.807 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:03.808 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:42:03.909 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:42:03.947 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:42:03.947 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2021-10-08T19:42:03.948 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2021-10-08T19:42:03.948 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2021-10-08T19:42:03.948 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:42:03.957 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:04.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:42:03 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:42:03] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:42:04.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:03 smithi117 ceph-mon[34585]: pgmap v1027: 188 pgs: 188 active+clean; 1.9 GiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.07k op/s 2021-10-08T19:42:04.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:03 smithi117 ceph-mon[34585]: 2.13 scrub ok 2021-10-08T19:42:04.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:03 smithi097 ceph-mon[41966]: pgmap v1027: 188 pgs: 188 active+clean; 1.9 GiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.07k op/s 2021-10-08T19:42:04.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:03 smithi097 ceph-mon[41966]: 2.13 scrub ok 2021-10-08T19:42:04.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:03 smithi097 ceph-mon[32687]: pgmap v1027: 188 pgs: 188 active+clean; 1.9 GiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.07k op/s 2021-10-08T19:42:04.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:03 smithi097 ceph-mon[32687]: 2.13 scrub ok 2021-10-08T19:42:05.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:04 smithi097 ceph-mon[41966]: 3.15 scrub ok 2021-10-08T19:42:05.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:04 smithi097 ceph-mon[41966]: 5.b scrub ok 2021-10-08T19:42:05.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:04 smithi097 ceph-mon[41966]: 6.9 scrub ok 2021-10-08T19:42:05.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:04 smithi097 ceph-mon[41966]: 2.18 scrub ok 2021-10-08T19:42:05.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:04 smithi097 ceph-mon[32687]: 3.15 scrub ok 2021-10-08T19:42:05.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:04 smithi097 ceph-mon[32687]: 5.b scrub ok 2021-10-08T19:42:05.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:04 smithi097 ceph-mon[32687]: 6.9 scrub ok 2021-10-08T19:42:05.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:04 smithi097 ceph-mon[32687]: 2.18 scrub ok 2021-10-08T19:42:05.222 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:42:05.230 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:05.232 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:42:05.333 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:42:05.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:04 smithi117 ceph-mon[34585]: 3.15 scrub ok 2021-10-08T19:42:05.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:04 smithi117 ceph-mon[34585]: 5.b scrub ok 2021-10-08T19:42:05.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:04 smithi117 ceph-mon[34585]: 6.9 scrub ok 2021-10-08T19:42:05.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:04 smithi117 ceph-mon[34585]: 2.18 scrub ok 2021-10-08T19:42:05.408 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2021-10-08T19:42:05.409 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:05.442 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:42:05.476 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:42:05.479 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:05.479 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:42:05.542 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset nodeep-scrub 2021-10-08T19:42:05.581 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:42:05.614 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:05.669 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:42:05.675 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:05.675 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:42:05.777 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:42:05.813 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:05.866 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:42:05.868 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:05.869 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:42:05.973 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:42:05.987 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:05 smithi117 ceph-mon[34585]: 2.5 scrub ok 2021-10-08T19:42:05.987 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:05 smithi117 ceph-mon[34585]: pgmap v1028: 188 pgs: 188 active+clean; 1.6 GiB data, 7.8 GiB used, 707 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.06k op/s 2021-10-08T19:42:06.003 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:06.060 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:42:06.065 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:06.066 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:42:06.072 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:42:06.118 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:42:06.157 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:42:06.168 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:42:06.192 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:42:06.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:05 smithi097 ceph-mon[32687]: 2.5 scrub ok 2021-10-08T19:42:06.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:05 smithi097 ceph-mon[32687]: pgmap v1028: 188 pgs: 188 active+clean; 1.6 GiB data, 7.8 GiB used, 707 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.06k op/s 2021-10-08T19:42:06.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:05 smithi097 ceph-mon[41966]: 2.5 scrub ok 2021-10-08T19:42:06.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:05 smithi097 ceph-mon[41966]: pgmap v1028: 188 pgs: 188 active+clean; 1.6 GiB data, 7.8 GiB used, 707 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.06k op/s 2021-10-08T19:42:06.226 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:06.231 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:42:06.267 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:42:06.309 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:42:06.338 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:42:06.347 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:42:06.358 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'false' 2021-10-08T19:42:06.358 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'false' 2021-10-08T19:42:06.358 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'false' 2021-10-08T19:42:06.358 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'false' 2021-10-08T19:42:06.359 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'false' 2021-10-08T19:42:06.359 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'false' 2021-10-08T19:42:06.359 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'false' 2021-10-08T19:42:06.359 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'false' 2021-10-08T19:42:06.405 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:42:07.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:06 smithi117 ceph-mon[34585]: 6.d scrub ok 2021-10-08T19:42:07.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:06 smithi117 ceph-mon[34585]: 1.0 scrub ok 2021-10-08T19:42:07.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:06 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1528427036' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:42:07.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:06 smithi097 ceph-mon[32687]: 6.d scrub ok 2021-10-08T19:42:07.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:06 smithi097 ceph-mon[32687]: 1.0 scrub ok 2021-10-08T19:42:07.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:06 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1528427036' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:42:07.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:06 smithi097 ceph-mon[41966]: 6.d scrub ok 2021-10-08T19:42:07.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:06 smithi097 ceph-mon[41966]: 1.0 scrub ok 2021-10-08T19:42:07.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:06 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1528427036' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:42:07.792 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:42:07.798 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:07.798 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:42:07.899 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:42:07.905 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:42:07 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:42:07.936 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:07.996 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:42:08.000 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:08.001 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:42:08.068 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:08 smithi097 ceph-mon[41966]: 11.1 scrub ok 2021-10-08T19:42:08.068 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:08 smithi097 ceph-mon[41966]: 5.14 scrub ok 2021-10-08T19:42:08.068 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:08 smithi097 ceph-mon[41966]: 5.1f scrub ok 2021-10-08T19:42:08.069 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:08 smithi097 ceph-mon[41966]: pgmap v1029: 188 pgs: 188 active+clean; 1.6 GiB data, 7.8 GiB used, 707 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.06k op/s 2021-10-08T19:42:08.069 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:08 smithi097 ceph-mon[41966]: 4.9 scrub ok 2021-10-08T19:42:08.069 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:08 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:42:08.069 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:08 smithi097 ceph-mon[41966]: 3.16 scrub ok 2021-10-08T19:42:08.070 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:08 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:42:08.070 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:08 smithi097 ceph-mon[32687]: 11.1 scrub ok 2021-10-08T19:42:08.070 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:08 smithi097 ceph-mon[32687]: 5.14 scrub ok 2021-10-08T19:42:08.071 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:08 smithi097 ceph-mon[32687]: 5.1f scrub ok 2021-10-08T19:42:08.071 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:08 smithi097 ceph-mon[32687]: pgmap v1029: 188 pgs: 188 active+clean; 1.6 GiB data, 7.8 GiB used, 707 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.06k op/s 2021-10-08T19:42:08.071 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:08 smithi097 ceph-mon[32687]: 4.9 scrub ok 2021-10-08T19:42:08.071 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:08 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:42:08.071 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:08 smithi097 ceph-mon[32687]: 3.16 scrub ok 2021-10-08T19:42:08.072 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:08 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:42:08.073 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:42:07 smithi097 conmon[33110]: 172.21.15.117 - - [08/Oct/2021:19:42:07] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:42:08.102 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:42:08.131 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:08.193 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:42:08.197 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:08.198 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:42:08.199 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:08 smithi117 ceph-mon[34585]: 11.1 scrub ok 2021-10-08T19:42:08.199 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:08 smithi117 ceph-mon[34585]: 5.14 scrub ok 2021-10-08T19:42:08.200 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:08 smithi117 ceph-mon[34585]: 5.1f scrub ok 2021-10-08T19:42:08.200 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:08 smithi117 ceph-mon[34585]: pgmap v1029: 188 pgs: 188 active+clean; 1.6 GiB data, 7.8 GiB used, 707 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.06k op/s 2021-10-08T19:42:08.200 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:08 smithi117 ceph-mon[34585]: 4.9 scrub ok 2021-10-08T19:42:08.200 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:08 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:42:08.201 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:08 smithi117 ceph-mon[34585]: 3.16 scrub ok 2021-10-08T19:42:08.201 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:08 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:42:08.300 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:42:08.358 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:08.505 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:42:08.528 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:08.529 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:42:08.631 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:42:08.681 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:08.886 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:42:08.890 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:08.891 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:42:08.993 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:42:09.060 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:09.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:09 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:42:09.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:09 smithi097 ceph-mon[41966]: 172.21.15.117 - - [08/Oct/2021:19:42:07] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:42:09.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:09 smithi097 ceph-mon[41966]: 2.22 scrub ok 2021-10-08T19:42:09.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:09 smithi097 ceph-mon[41966]: 6.1e scrub ok 2021-10-08T19:42:09.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:09 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:42:09.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:09 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:42:09.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:09 smithi097 ceph-mon[41966]: 4.b scrub ok 2021-10-08T19:42:09.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:09 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:42:09.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:09 smithi097 ceph-mon[32687]: 172.21.15.117 - - [08/Oct/2021:19:42:07] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:42:09.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:09 smithi097 ceph-mon[32687]: 2.22 scrub ok 2021-10-08T19:42:09.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:09 smithi097 ceph-mon[32687]: 6.1e scrub ok 2021-10-08T19:42:09.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:09 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:42:09.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:09 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:42:09.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:09 smithi097 ceph-mon[32687]: 4.b scrub ok 2021-10-08T19:42:09.257 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:42:09.266 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2021-10-08T19:42:09.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:09 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:42:09.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:09 smithi117 ceph-mon[34585]: 172.21.15.117 - - [08/Oct/2021:19:42:07] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:42:09.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:09 smithi117 ceph-mon[34585]: 2.22 scrub ok 2021-10-08T19:42:09.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:09 smithi117 ceph-mon[34585]: 6.1e scrub ok 2021-10-08T19:42:09.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:09 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:42:09.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:09 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:42:09.409 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:09 smithi117 ceph-mon[34585]: 4.b scrub ok 2021-10-08T19:42:09.715 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:42:09.719 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:09.720 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:42:09.821 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:42:09.870 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:10.072 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2021-10-08T19:42:10.122 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:10 smithi097 ceph-mon[41966]: 5.13 scrub ok 2021-10-08T19:42:10.122 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:10 smithi097 ceph-mon[41966]: osdmap e488: 8 total, 8 up, 8 in 2021-10-08T19:42:10.122 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:10 smithi097 ceph-mon[41966]: pgmap v1031: 188 pgs: 188 active+clean; 1.4 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 956 op/s 2021-10-08T19:42:10.123 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:10 smithi097 ceph-mon[41966]: 4.1 scrub ok 2021-10-08T19:42:10.123 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:10 smithi097 ceph-mon[41966]: from='client.26350 v1:172.21.15.97:0/3083417498' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:42:10.124 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:10 smithi097 ceph-mon[32687]: 5.13 scrub ok 2021-10-08T19:42:10.124 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:10 smithi097 ceph-mon[32687]: osdmap e488: 8 total, 8 up, 8 in 2021-10-08T19:42:10.124 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:10 smithi097 ceph-mon[32687]: pgmap v1031: 188 pgs: 188 active+clean; 1.4 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 956 op/s 2021-10-08T19:42:10.125 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:10 smithi097 ceph-mon[32687]: 4.1 scrub ok 2021-10-08T19:42:10.125 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:10 smithi097 ceph-mon[32687]: from='client.26350 v1:172.21.15.97:0/3083417498' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:42:10.409 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:10 smithi117 ceph-mon[34585]: 5.13 scrub ok 2021-10-08T19:42:10.410 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:10 smithi117 ceph-mon[34585]: osdmap e488: 8 total, 8 up, 8 in 2021-10-08T19:42:10.410 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:10 smithi117 ceph-mon[34585]: pgmap v1031: 188 pgs: 188 active+clean; 1.4 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 956 op/s 2021-10-08T19:42:10.410 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:10 smithi117 ceph-mon[34585]: 4.1 scrub ok 2021-10-08T19:42:10.410 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:10 smithi117 ceph-mon[34585]: from='client.26350 v1:172.21.15.97:0/3083417498' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:42:10.682 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:42:10.684 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:10.685 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:42:10.788 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:42:10.846 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:11.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:11 smithi117 ceph-mon[34585]: 11.0 scrub ok 2021-10-08T19:42:11.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:11 smithi117 ceph-mon[34585]: 3.6 scrub ok 2021-10-08T19:42:11.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:11 smithi117 ceph-mon[34585]: 1.3 scrub ok 2021-10-08T19:42:11.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:11 smithi097 ceph-mon[41966]: 11.0 scrub ok 2021-10-08T19:42:11.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:11 smithi097 ceph-mon[41966]: 3.6 scrub ok 2021-10-08T19:42:11.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:11 smithi097 ceph-mon[41966]: 1.3 scrub ok 2021-10-08T19:42:11.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:11 smithi097 ceph-mon[32687]: 11.0 scrub ok 2021-10-08T19:42:11.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:11 smithi097 ceph-mon[32687]: 3.6 scrub ok 2021-10-08T19:42:11.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:11 smithi097 ceph-mon[32687]: 1.3 scrub ok 2021-10-08T19:42:11.528 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:42:11.532 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:11.533 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:42:11.634 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:42:11.662 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:11.698 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:42:11.720 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:42:11.724 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:11.725 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:42:11.754 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":1031,"stamp":"2021-10-08T19:42:09.034969+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1528764636,"num_objects":23513,"num_object_clones":0,"num_object_copies":70539,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23513,"num_whiteouts":0,"num_read":2165,"num_read_kb":1922,"num_write":205170,"num_write_kb":7279784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":533,"num_bytes_recovered":11617,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":70057,"ondisk_log_size":70057,"up":564,"acting":564,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":564,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":7623876,"kb_used_data":4485956,"kb_used_omap":0,"kb_used_meta":3137472,"kb_avail":742337340,"statfs":{"total":767960285184,"available":760153436160,"internally_reserved":0,"allocated":4593618944,"data_stored":4590505676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3212771328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7,1,7,12,8,2,0,5],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-501547008,"num_objects":-7653,"num_object_clones":0,"num_object_copies":-22959,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-7653,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":7653,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.004211"},"pg_stats":[{"pgid":"2.29","version":"0'0","reported_seq":118,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.975589+0000","last_change":"2021-10-08T19:39:15.207230+0000","last_active":"2021-10-08T19:41:52.975589+0000","last_peered":"2021-10-08T19:41:52.975589+0000","last_clean":"2021-10-08T19:41:52.975589+0000","last_became_active":"2021-10-08T19:37:45.848663+0000","last_became_peered":"2021-10-08T19:37:45.848663+0000","last_unstale":"2021-10-08T19:41:52.975589+0000","last_undegraded":"2021-10-08T19:41:52.975589+0000","last_fullsized":"2021-10-08T19:41:52.975589+0000","mapping_epoch":407,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":408,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:15.207136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:30:11.102934+0000","last_clean_scrub_stamp":"2021-10-08T19:39:15.207136+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0027672759999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.28","version":"0'0","reported_seq":109,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.968647+0000","last_change":"2021-10-08T19:39:21.168002+0000","last_active":"2021-10-08T19:41:52.968647+0000","last_peered":"2021-10-08T19:41:52.968647+0000","last_clean":"2021-10-08T19:41:52.968647+0000","last_became_active":"2021-10-08T19:37:00.334502+0000","last_became_peered":"2021-10-08T19:37:00.334502+0000","last_unstale":"2021-10-08T19:41:52.968647+0000","last_undegraded":"2021-10-08T19:41:52.968647+0000","last_fullsized":"2021-10-08T19:41:52.968647+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:21.167907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:21.167907+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0095106210000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.27","version":"0'0","reported_seq":422,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.982765+0000","last_change":"2021-10-08T19:39:12.559639+0000","last_active":"2021-10-08T19:41:52.982765+0000","last_peered":"2021-10-08T19:41:52.982765+0000","last_clean":"2021-10-08T19:41:52.982765+0000","last_became_active":"2021-10-08T19:37:00.342526+0000","last_became_peered":"2021-10-08T19:37:00.342526+0000","last_unstale":"2021-10-08T19:41:52.982765+0000","last_undegraded":"2021-10-08T19:41:52.982765+0000","last_fullsized":"2021-10-08T19:41:52.982765+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:12.559542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:12.559542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0025174720000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.26","version":"0'0","reported_seq":109,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.983596+0000","last_change":"2021-10-08T19:39:13.573021+0000","last_active":"2021-10-08T19:41:52.983596+0000","last_peered":"2021-10-08T19:41:52.983596+0000","last_clean":"2021-10-08T19:41:52.983596+0000","last_became_active":"2021-10-08T19:37:00.340327+0000","last_became_peered":"2021-10-08T19:37:00.340327+0000","last_unstale":"2021-10-08T19:41:52.983596+0000","last_undegraded":"2021-10-08T19:41:52.983596+0000","last_fullsized":"2021-10-08T19:41:52.983596+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:13.572950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:07.710367+0000","last_clean_scrub_stamp":"2021-10-08T19:39:13.572950+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0022297720000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.25","version":"328'2","reported_seq":426,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.969457+0000","last_change":"2021-10-08T19:40:07.331172+0000","last_active":"2021-10-08T19:41:52.969457+0000","last_peered":"2021-10-08T19:41:52.969457+0000","last_clean":"2021-10-08T19:41:52.969457+0000","last_became_active":"2021-10-08T19:37:00.344673+0000","last_became_peered":"2021-10-08T19:37:00.344673+0000","last_unstale":"2021-10-08T19:41:52.969457+0000","last_undegraded":"2021-10-08T19:41:52.969457+0000","last_fullsized":"2021-10-08T19:41:52.969457+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"328'2","last_scrub_stamp":"2021-10-08T19:40:07.331064+0000","last_deep_scrub":"328'2","last_deep_scrub_stamp":"2021-10-08T19:33:29.990395+0000","last_clean_scrub_stamp":"2021-10-08T19:40:07.331064+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010473448999999999,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.24","version":"0'0","reported_seq":115,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.979742+0000","last_change":"2021-10-08T19:40:36.960572+0000","last_active":"2021-10-08T19:41:52.979742+0000","last_peered":"2021-10-08T19:41:52.979742+0000","last_clean":"2021-10-08T19:41:52.979742+0000","last_became_active":"2021-10-08T19:37:00.336960+0000","last_became_peered":"2021-10-08T19:37:00.336960+0000","last_unstale":"2021-10-08T19:41:52.979742+0000","last_undegraded":"2021-10-08T19:41:52.979742+0000","last_fullsized":"2021-10-08T19:41:52.979742+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:36.960483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:36.960483+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0017323569999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.23","version":"0'0","reported_seq":109,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.968839+0000","last_change":"2021-10-08T19:39:26.231063+0000","last_active":"2021-10-08T19:41:52.968839+0000","last_peered":"2021-10-08T19:41:52.968839+0000","last_clean":"2021-10-08T19:41:52.968839+0000","last_became_active":"2021-10-08T19:37:00.347789+0000","last_became_peered":"2021-10-08T19:37:00.347789+0000","last_unstale":"2021-10-08T19:41:52.968839+0000","last_undegraded":"2021-10-08T19:41:52.968839+0000","last_fullsized":"2021-10-08T19:41:52.968839+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:26.230969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:26.230969+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.01135425,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.22","version":"0'0","reported_seq":517,"reported_epoch":487,"state":"active+clean","last_fresh":"2021-10-08T19:42:07.986150+0000","last_change":"2021-10-08T19:42:07.986116+0000","last_active":"2021-10-08T19:42:07.986150+0000","last_peered":"2021-10-08T19:42:07.986150+0000","last_clean":"2021-10-08T19:42:07.986150+0000","last_became_active":"2021-10-08T19:37:00.343394+0000","last_became_peered":"2021-10-08T19:37:00.343394+0000","last_unstale":"2021-10-08T19:42:07.986150+0000","last_undegraded":"2021-10-08T19:42:07.986150+0000","last_fullsized":"2021-10-08T19:42:07.986150+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:42:07.986006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:42:07.986006+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0060216890000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3],"acting":[6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.21","version":"0'0","reported_seq":520,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.971597+0000","last_change":"2021-10-08T19:40:46.823451+0000","last_active":"2021-10-08T19:41:52.971597+0000","last_peered":"2021-10-08T19:41:52.971597+0000","last_clean":"2021-10-08T19:41:52.971597+0000","last_became_active":"2021-10-08T19:37:00.335409+0000","last_became_peered":"2021-10-08T19:37:00.335409+0000","last_unstale":"2021-10-08T19:41:52.971597+0000","last_undegraded":"2021-10-08T19:41:52.971597+0000","last_fullsized":"2021-10-08T19:41:52.971597+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:46.823341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:40:46.823341+0000","last_clean_scrub_stamp":"2021-10-08T19:40:46.823341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0093941830000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7],"acting":[2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.20","version":"0'0","reported_seq":119,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.976840+0000","last_change":"2021-10-08T19:39:11.566964+0000","last_active":"2021-10-08T19:41:52.976840+0000","last_peered":"2021-10-08T19:41:52.976840+0000","last_clean":"2021-10-08T19:41:52.976840+0000","last_became_active":"2021-10-08T19:37:00.341831+0000","last_became_peered":"2021-10-08T19:37:00.341831+0000","last_unstale":"2021-10-08T19:41:52.976840+0000","last_undegraded":"2021-10-08T19:41:52.976840+0000","last_fullsized":"2021-10-08T19:41:52.976840+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:11.566891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:32.922694+0000","last_clean_scrub_stamp":"2021-10-08T19:39:11.566891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0018543839999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.7","version":"487'12406","reported_seq":12474,"reported_epoch":487,"state":"active+clean","last_fresh":"2021-10-08T19:42:04.635606+0000","last_change":"2021-10-08T19:41:21.466917+0000","last_active":"2021-10-08T19:42:04.635606+0000","last_peered":"2021-10-08T19:42:04.635606+0000","last_clean":"2021-10-08T19:42:04.635606+0000","last_became_active":"2021-10-08T19:39:04.771230+0000","last_became_peered":"2021-10-08T19:39:04.771230+0000","last_unstale":"2021-10-08T19:42:04.635606+0000","last_undegraded":"2021-10-08T19:42:04.635606+0000","last_fullsized":"2021-10-08T19:42:04.635606+0000","mapping_epoch":433,"log_start":"473'8200","ondisk_log_start":"473'8200","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"479'9659","last_scrub_stamp":"2021-10-08T19:41:21.466796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:41:21.466796+0000","log_size":4206,"ondisk_log_size":4206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":2.0087995510000001,"stat_sum":{"num_bytes":99745792,"num_objects":1522,"num_object_clones":0,"num_object_copies":4566,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1522,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12406,"num_write_kb":445696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"114'10","reported_seq":755,"reported_epoch":487,"state":"active+clean","last_fresh":"2021-10-08T19:42:01.987894+0000","last_change":"2021-10-08T19:40:34.920105+0000","last_active":"2021-10-08T19:42:01.987894+0000","last_peered":"2021-10-08T19:42:01.987894+0000","last_clean":"2021-10-08T19:42:01.987894+0000","last_became_active":"2021-10-08T19:24:25.096162+0000","last_became_peered":"2021-10-08T19:24:25.096162+0000","last_unstale":"2021-10-08T19:42:01.987894+0000","last_undegraded":"2021-10-08T19:42:01.987894+0000","last_fullsized":"2021-10-08T19:42:01.987894+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'10","last_scrub_stamp":"2021-10-08T19:40:34.920011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:40:34.920011+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002553937,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"482'46","reported_seq":174,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.979575+0000","last_change":"2021-10-08T19:40:31.983322+0000","last_active":"2021-10-08T19:41:52.979575+0000","last_peered":"2021-10-08T19:41:52.979575+0000","last_clean":"2021-10-08T19:41:52.979575+0000","last_became_active":"2021-10-08T19:37:18.998305+0000","last_became_peered":"2021-10-08T19:37:18.998305+0000","last_unstale":"2021-10-08T19:41:52.979575+0000","last_undegraded":"2021-10-08T19:41:52.979575+0000","last_fullsized":"2021-10-08T19:41:52.979575+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'34","last_scrub_stamp":"2021-10-08T19:40:31.983216+0000","last_deep_scrub":"87'22","last_deep_scrub_stamp":"2021-10-08T19:22:58.705632+0000","last_clean_scrub_stamp":"2021-10-08T19:40:31.983216+0000","log_size":46,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012884054000000001,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":507,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.973337+0000","last_change":"2021-10-08T19:41:37.035645+0000","last_active":"2021-10-08T19:41:52.973337+0000","last_peered":"2021-10-08T19:41:52.973337+0000","last_clean":"2021-10-08T19:41:52.973337+0000","last_became_active":"2021-10-08T19:29:40.632678+0000","last_became_peered":"2021-10-08T19:29:40.632678+0000","last_unstale":"2021-10-08T19:41:52.973337+0000","last_undegraded":"2021-10-08T19:41:52.973337+0000","last_fullsized":"2021-10-08T19:41:52.973337+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:55.054274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:55.054274+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.009012684,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":184,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.979548+0000","last_change":"2021-10-08T19:41:15.824286+0000","last_active":"2021-10-08T19:41:52.979548+0000","last_peered":"2021-10-08T19:41:52.979548+0000","last_clean":"2021-10-08T19:41:52.979548+0000","last_became_active":"2021-10-08T19:37:19.000347+0000","last_became_peered":"2021-10-08T19:37:19.000347+0000","last_unstale":"2021-10-08T19:41:52.979548+0000","last_undegraded":"2021-10-08T19:41:52.979548+0000","last_fullsized":"2021-10-08T19:41:52.979548+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:41:15.824215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:08.936801+0000","last_clean_scrub_stamp":"2021-10-08T19:41:15.824215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.036641003999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":405,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.983036+0000","last_change":"2021-10-08T19:41:29.988960+0000","last_active":"2021-10-08T19:41:52.983036+0000","last_peered":"2021-10-08T19:41:52.983036+0000","last_clean":"2021-10-08T19:41:52.983036+0000","last_became_active":"2021-10-08T19:25:15.510457+0000","last_became_peered":"2021-10-08T19:25:15.510457+0000","last_unstale":"2021-10-08T19:41:52.983036+0000","last_undegraded":"2021-10-08T19:41:52.983036+0000","last_fullsized":"2021-10-08T19:41:52.983036+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:41:29.988869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:33:28.036266+0000","last_clean_scrub_stamp":"2021-10-08T19:41:29.988869+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.006050176,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.4","version":"487'12969","reported_seq":13037,"reported_epoch":487,"state":"active+clean","last_fresh":"2021-10-08T19:42:08.722059+0000","last_change":"2021-10-08T19:41:27.501481+0000","last_active":"2021-10-08T19:42:08.722059+0000","last_peered":"2021-10-08T19:42:08.722059+0000","last_clean":"2021-10-08T19:42:08.722059+0000","last_became_active":"2021-10-08T19:39:04.510913+0000","last_became_peered":"2021-10-08T19:39:04.510913+0000","last_unstale":"2021-10-08T19:42:08.722059+0000","last_undegraded":"2021-10-08T19:42:08.722059+0000","last_fullsized":"2021-10-08T19:42:08.722059+0000","mapping_epoch":433,"log_start":"477'9200","ondisk_log_start":"477'9200","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"481'10312","last_scrub_stamp":"2021-10-08T19:41:27.501360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:41:27.501360+0000","log_size":3769,"ondisk_log_size":3769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":1.42255829,"stat_sum":{"num_bytes":86704128,"num_objects":1323,"num_object_clones":0,"num_object_copies":3969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12969,"num_write_kb":457344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"482'25","reported_seq":551,"reported_epoch":487,"state":"active+clean","last_fresh":"2021-10-08T19:42:08.301182+0000","last_change":"2021-10-08T19:42:08.301131+0000","last_active":"2021-10-08T19:42:08.301182+0000","last_peered":"2021-10-08T19:42:08.301182+0000","last_clean":"2021-10-08T19:42:08.301182+0000","last_became_active":"2021-10-08T19:28:40.159729+0000","last_became_peered":"2021-10-08T19:28:40.159729+0000","last_unstale":"2021-10-08T19:42:08.301182+0000","last_undegraded":"2021-10-08T19:42:08.301182+0000","last_fullsized":"2021-10-08T19:42:08.301182+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'25","last_scrub_stamp":"2021-10-08T19:42:08.298419+0000","last_deep_scrub":"337'19","last_deep_scrub_stamp":"2021-10-08T19:34:14.040249+0000","last_clean_scrub_stamp":"2021-10-08T19:42:08.298419+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.020124136000000001,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":343,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.977927+0000","last_change":"2021-10-08T19:41:38.379040+0000","last_active":"2021-10-08T19:41:52.977927+0000","last_peered":"2021-10-08T19:41:52.977927+0000","last_clean":"2021-10-08T19:41:52.977927+0000","last_became_active":"2021-10-08T19:29:40.624977+0000","last_became_peered":"2021-10-08T19:29:40.624977+0000","last_unstale":"2021-10-08T19:41:52.977927+0000","last_undegraded":"2021-10-08T19:41:52.977927+0000","last_fullsized":"2021-10-08T19:41:52.977927+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:33.632818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:33.632818+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014140598000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":499,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.972307+0000","last_change":"2021-10-08T19:40:48.882826+0000","last_active":"2021-10-08T19:41:52.972307+0000","last_peered":"2021-10-08T19:41:52.972307+0000","last_clean":"2021-10-08T19:41:52.972307+0000","last_became_active":"2021-10-08T19:29:40.629422+0000","last_became_peered":"2021-10-08T19:29:40.629422+0000","last_unstale":"2021-10-08T19:41:52.972307+0000","last_undegraded":"2021-10-08T19:41:52.972307+0000","last_fullsized":"2021-10-08T19:41:52.972307+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:48.882724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:40:48.882724+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0032251089999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":477,"reported_epoch":487,"state":"active+clean","last_fresh":"2021-10-08T19:42:04.388573+0000","last_change":"2021-10-08T19:42:04.388531+0000","last_active":"2021-10-08T19:42:04.388573+0000","last_peered":"2021-10-08T19:42:04.388573+0000","last_clean":"2021-10-08T19:42:04.388573+0000","last_became_active":"2021-10-08T19:21:29.643022+0000","last_became_peered":"2021-10-08T19:21:29.643022+0000","last_unstale":"2021-10-08T19:42:04.388573+0000","last_undegraded":"2021-10-08T19:42:04.388573+0000","last_fullsized":"2021-10-08T19:42:04.388573+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:42:04.388425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:26.158421+0000","last_clean_scrub_stamp":"2021-10-08T19:42:04.388425+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.091212318000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"70'5","reported_seq":895,"reported_epoch":487,"state":"active+clean","last_fresh":"2021-10-08T19:42:03.003586+0000","last_change":"2021-10-08T19:38:02.331641+0000","last_active":"2021-10-08T19:42:03.003586+0000","last_peered":"2021-10-08T19:42:03.003586+0000","last_clean":"2021-10-08T19:42:03.003586+0000","last_became_active":"2021-10-08T19:37:19.006464+0000","last_became_peered":"2021-10-08T19:37:19.006464+0000","last_unstale":"2021-10-08T19:42:03.003586+0000","last_undegraded":"2021-10-08T19:42:03.003586+0000","last_fullsized":"2021-10-08T19:42:03.003586+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:38:02.331532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:38:02.331532+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0043661940000000003,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":603,"num_read_kb":603,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":778,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.5","version":"487'12791","reported_seq":12859,"reported_epoch":487,"state":"active+clean","last_fresh":"2021-10-08T19:42:08.737440+0000","last_change":"2021-10-08T19:41:29.896518+0000","last_active":"2021-10-08T19:42:08.737440+0000","last_peered":"2021-10-08T19:42:08.737440+0000","last_clean":"2021-10-08T19:42:08.737440+0000","last_became_active":"2021-10-08T19:39:04.771214+0000","last_became_peered":"2021-10-08T19:39:04.771214+0000","last_unstale":"2021-10-08T19:42:08.737440+0000","last_undegraded":"2021-10-08T19:42:08.737440+0000","last_fullsized":"2021-10-08T19:42:08.737440+0000","mapping_epoch":433,"log_start":"477'9000","ondisk_log_start":"477'9000","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'10274","last_scrub_stamp":"2021-10-08T19:41:29.896389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:41:29.896389+0000","log_size":3791,"ondisk_log_size":3791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.89280107500000006,"stat_sum":{"num_bytes":79364096,"num_objects":1211,"num_object_clones":0,"num_object_copies":3633,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1211,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12791,"num_write_kb":448064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"482'60","reported_seq":563,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.980351+0000","last_change":"2021-10-08T19:40:49.868198+0000","last_active":"2021-10-08T19:41:52.980351+0000","last_peered":"2021-10-08T19:41:52.980351+0000","last_clean":"2021-10-08T19:41:52.980351+0000","last_became_active":"2021-10-08T19:28:40.101648+0000","last_became_peered":"2021-10-08T19:28:40.101648+0000","last_unstale":"2021-10-08T19:41:52.980351+0000","last_undegraded":"2021-10-08T19:41:52.980351+0000","last_fullsized":"2021-10-08T19:41:52.980351+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"428'44","last_scrub_stamp":"2021-10-08T19:40:49.868088+0000","last_deep_scrub":"428'44","last_deep_scrub_stamp":"2021-10-08T19:38:47.335892+0000","last_clean_scrub_stamp":"2021-10-08T19:40:49.868088+0000","log_size":60,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0038363440000000002,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":52,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":485,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.974040+0000","last_change":"2021-10-08T19:40:11.180747+0000","last_active":"2021-10-08T19:41:52.974040+0000","last_peered":"2021-10-08T19:41:52.974040+0000","last_clean":"2021-10-08T19:41:52.974040+0000","last_became_active":"2021-10-08T19:21:23.595919+0000","last_became_peered":"2021-10-08T19:21:23.595919+0000","last_unstale":"2021-10-08T19:41:52.974040+0000","last_undegraded":"2021-10-08T19:41:52.974040+0000","last_fullsized":"2021-10-08T19:41:52.974040+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:11.180640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:40:11.180640+0000","last_clean_scrub_stamp":"2021-10-08T19:40:11.180640+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0088737490000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":493,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.972474+0000","last_change":"2021-10-08T19:41:36.014988+0000","last_active":"2021-10-08T19:41:52.972474+0000","last_peered":"2021-10-08T19:41:52.972474+0000","last_clean":"2021-10-08T19:41:52.972474+0000","last_became_active":"2021-10-08T19:31:22.783725+0000","last_became_peered":"2021-10-08T19:31:22.783725+0000","last_unstale":"2021-10-08T19:41:52.972474+0000","last_undegraded":"2021-10-08T19:41:52.972474+0000","last_fullsized":"2021-10-08T19:41:52.972474+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:31.136290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:39:31.136290+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0053463770000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":483,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.977411+0000","last_change":"2021-10-08T19:39:55.885308+0000","last_active":"2021-10-08T19:41:52.977411+0000","last_peered":"2021-10-08T19:41:52.977411+0000","last_clean":"2021-10-08T19:41:52.977411+0000","last_became_active":"2021-10-08T19:29:40.638354+0000","last_became_peered":"2021-10-08T19:29:40.638354+0000","last_unstale":"2021-10-08T19:41:52.977411+0000","last_undegraded":"2021-10-08T19:41:52.977411+0000","last_fullsized":"2021-10-08T19:41:52.977411+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:55.885197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:39.528699+0000","last_clean_scrub_stamp":"2021-10-08T19:39:55.885197+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011288616,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":410,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.982672+0000","last_change":"2021-10-08T19:39:17.629247+0000","last_active":"2021-10-08T19:41:52.982672+0000","last_peered":"2021-10-08T19:41:52.982672+0000","last_clean":"2021-10-08T19:41:52.982672+0000","last_became_active":"2021-10-08T19:31:22.785590+0000","last_became_peered":"2021-10-08T19:31:22.785590+0000","last_unstale":"2021-10-08T19:41:52.982672+0000","last_undegraded":"2021-10-08T19:41:52.982672+0000","last_fullsized":"2021-10-08T19:41:52.982672+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:17.629178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:17.629178+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001878256,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2","version":"487'12560","reported_seq":12628,"reported_epoch":487,"state":"active+clean","last_fresh":"2021-10-08T19:42:04.062459+0000","last_change":"2021-10-08T19:40:36.563540+0000","last_active":"2021-10-08T19:42:04.062459+0000","last_peered":"2021-10-08T19:42:04.062459+0000","last_clean":"2021-10-08T19:42:04.062459+0000","last_became_active":"2021-10-08T19:39:04.513549+0000","last_became_peered":"2021-10-08T19:39:04.513549+0000","last_unstale":"2021-10-08T19:42:04.062459+0000","last_undegraded":"2021-10-08T19:42:04.062459+0000","last_fullsized":"2021-10-08T19:42:04.062459+0000","mapping_epoch":433,"log_start":"469'7400","ondisk_log_start":"469'7400","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"467'6896","last_scrub_stamp":"2021-10-08T19:40:36.563423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:40:36.563423+0000","log_size":5160,"ondisk_log_size":5160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":3.479033571,"stat_sum":{"num_bytes":103940096,"num_objects":1586,"num_object_clones":0,"num_object_copies":4758,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1586,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12560,"num_write_kb":452672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.8","version":"90'130","reported_seq":479,"reported_epoch":487,"state":"active+clean","last_fresh":"2021-10-08T19:42:02.232031+0000","last_change":"2021-10-08T19:42:02.231994+0000","last_active":"2021-10-08T19:42:02.232031+0000","last_peered":"2021-10-08T19:42:02.232031+0000","last_clean":"2021-10-08T19:42:02.232031+0000","last_became_active":"2021-10-08T19:37:19.009239+0000","last_became_peered":"2021-10-08T19:37:19.009239+0000","last_unstale":"2021-10-08T19:42:02.232031+0000","last_undegraded":"2021-10-08T19:42:02.232031+0000","last_fullsized":"2021-10-08T19:42:02.232031+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:42:02.231888+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:42:02.231888+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0024481160000000002,"stat_sum":{"num_bytes":262688,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"482'53","reported_seq":600,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.969850+0000","last_change":"2021-10-08T19:40:10.405161+0000","last_active":"2021-10-08T19:41:52.969850+0000","last_peered":"2021-10-08T19:41:52.969850+0000","last_clean":"2021-10-08T19:41:52.969850+0000","last_became_active":"2021-10-08T19:28:40.099618+0000","last_became_peered":"2021-10-08T19:28:40.099618+0000","last_unstale":"2021-10-08T19:41:52.969850+0000","last_undegraded":"2021-10-08T19:41:52.969850+0000","last_fullsized":"2021-10-08T19:41:52.969850+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"459'39","last_scrub_stamp":"2021-10-08T19:40:10.405068+0000","last_deep_scrub":"459'39","last_deep_scrub_stamp":"2021-10-08T19:40:10.405068+0000","last_clean_scrub_stamp":"2021-10-08T19:40:10.405068+0000","log_size":53,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.024252185999999998,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":71,"num_read_kb":61,"num_write":46,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"61'1","reported_seq":479,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.980782+0000","last_change":"2021-10-08T19:40:36.925924+0000","last_active":"2021-10-08T19:41:52.980782+0000","last_peered":"2021-10-08T19:41:52.980782+0000","last_clean":"2021-10-08T19:41:52.980782+0000","last_became_active":"2021-10-08T19:21:23.607064+0000","last_became_peered":"2021-10-08T19:21:23.607064+0000","last_unstale":"2021-10-08T19:41:52.980782+0000","last_undegraded":"2021-10-08T19:41:52.980782+0000","last_fullsized":"2021-10-08T19:41:52.980782+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'1","last_scrub_stamp":"2021-10-08T19:40:36.925849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:36.925849+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0081260700000000009,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":323,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.977687+0000","last_change":"2021-10-08T19:40:49.345813+0000","last_active":"2021-10-08T19:41:52.977687+0000","last_peered":"2021-10-08T19:41:52.977687+0000","last_clean":"2021-10-08T19:41:52.977687+0000","last_became_active":"2021-10-08T19:28:40.152478+0000","last_became_peered":"2021-10-08T19:28:40.152478+0000","last_unstale":"2021-10-08T19:41:52.977687+0000","last_undegraded":"2021-10-08T19:41:52.977687+0000","last_fullsized":"2021-10-08T19:41:52.977687+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:49.345703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:30:09.081635+0000","last_clean_scrub_stamp":"2021-10-08T19:40:49.345703+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0058856459999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":497,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.973764+0000","last_change":"2021-10-08T19:40:40.184580+0000","last_active":"2021-10-08T19:41:52.973764+0000","last_peered":"2021-10-08T19:41:52.973764+0000","last_clean":"2021-10-08T19:41:52.973764+0000","last_became_active":"2021-10-08T19:29:40.629424+0000","last_became_peered":"2021-10-08T19:29:40.629424+0000","last_unstale":"2021-10-08T19:41:52.973764+0000","last_undegraded":"2021-10-08T19:41:52.973764+0000","last_fullsized":"2021-10-08T19:41:52.973764+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:40.184460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:40:40.184460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.189286643,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":455,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.980583+0000","last_change":"2021-10-08T19:40:00.916866+0000","last_active":"2021-10-08T19:41:52.980583+0000","last_peered":"2021-10-08T19:41:52.980583+0000","last_clean":"2021-10-08T19:41:52.980583+0000","last_became_active":"2021-10-08T19:31:51.676829+0000","last_became_peered":"2021-10-08T19:31:51.676829+0000","last_unstale":"2021-10-08T19:41:52.980583+0000","last_undegraded":"2021-10-08T19:41:52.980583+0000","last_fullsized":"2021-10-08T19:41:52.980583+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:00.916780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:00.916780+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0077587489999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"487'13293","reported_seq":13355,"reported_epoch":487,"state":"active+clean","last_fresh":"2021-10-08T19:42:08.805503+0000","last_change":"2021-10-08T19:39:04.509158+0000","last_active":"2021-10-08T19:42:08.805503+0000","last_peered":"2021-10-08T19:42:08.805503+0000","last_clean":"2021-10-08T19:42:08.805503+0000","last_became_active":"2021-10-08T19:39:04.508797+0000","last_became_peered":"2021-10-08T19:39:04.508797+0000","last_unstale":"2021-10-08T19:42:08.805503+0000","last_undegraded":"2021-10-08T19:42:08.805503+0000","last_fullsized":"2021-10-08T19:42:08.805503+0000","mapping_epoch":433,"log_start":"476'9000","ondisk_log_start":"476'9000","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:03.490762+0000","log_size":4293,"ondisk_log_size":4293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":89063424,"num_objects":1359,"num_object_clones":0,"num_object_copies":4077,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1359,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13293,"num_write_kb":468864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1],"acting":[6,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.9","version":"90'130","reported_seq":819,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.979775+0000","last_change":"2021-10-08T19:41:28.037638+0000","last_active":"2021-10-08T19:41:52.979775+0000","last_peered":"2021-10-08T19:41:52.979775+0000","last_clean":"2021-10-08T19:41:52.979775+0000","last_became_active":"2021-10-08T19:29:43.634789+0000","last_became_peered":"2021-10-08T19:29:43.634789+0000","last_unstale":"2021-10-08T19:41:52.979775+0000","last_undegraded":"2021-10-08T19:41:52.979775+0000","last_fullsized":"2021-10-08T19:41:52.979775+0000","mapping_epoch":239,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:41:28.037493+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:41:28.037493+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0060675549999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"482'30","reported_seq":597,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.969337+0000","last_change":"2021-10-08T19:40:00.425294+0000","last_active":"2021-10-08T19:41:52.969337+0000","last_peered":"2021-10-08T19:41:52.969337+0000","last_clean":"2021-10-08T19:41:52.969337+0000","last_became_active":"2021-10-08T19:29:40.631807+0000","last_became_peered":"2021-10-08T19:29:40.631807+0000","last_unstale":"2021-10-08T19:41:52.969337+0000","last_undegraded":"2021-10-08T19:41:52.969337+0000","last_fullsized":"2021-10-08T19:41:52.969337+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'20","last_scrub_stamp":"2021-10-08T19:40:00.425194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:40:00.425194+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0087912159999999993,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":40,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":343,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.977688+0000","last_change":"2021-10-08T19:40:02.914149+0000","last_active":"2021-10-08T19:41:52.977688+0000","last_peered":"2021-10-08T19:41:52.977688+0000","last_clean":"2021-10-08T19:41:52.977688+0000","last_became_active":"2021-10-08T19:29:40.638988+0000","last_became_peered":"2021-10-08T19:29:40.638988+0000","last_unstale":"2021-10-08T19:41:52.977688+0000","last_undegraded":"2021-10-08T19:41:52.977688+0000","last_fullsized":"2021-10-08T19:41:52.977688+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:02.914080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:02.914080+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.022904704000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"250'9","reported_seq":740,"reported_epoch":487,"state":"active+clean","last_fresh":"2021-10-08T19:42:01.969538+0000","last_change":"2021-10-08T19:40:04.082786+0000","last_active":"2021-10-08T19:42:01.969538+0000","last_peered":"2021-10-08T19:42:01.969538+0000","last_clean":"2021-10-08T19:42:01.969538+0000","last_became_active":"2021-10-08T19:21:27.637930+0000","last_became_peered":"2021-10-08T19:21:27.637930+0000","last_unstale":"2021-10-08T19:42:01.969538+0000","last_undegraded":"2021-10-08T19:42:01.969538+0000","last_fullsized":"2021-10-08T19:42:01.969538+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'9","last_scrub_stamp":"2021-10-08T19:40:04.082682+0000","last_deep_scrub":"250'9","last_deep_scrub_stamp":"2021-10-08T19:30:04.239189+0000","last_clean_scrub_stamp":"2021-10-08T19:40:04.082682+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0097725820000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":482,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.970285+0000","last_change":"2021-10-08T19:39:20.149864+0000","last_active":"2021-10-08T19:41:52.970285+0000","last_peered":"2021-10-08T19:41:52.970285+0000","last_clean":"2021-10-08T19:41:52.970285+0000","last_became_active":"2021-10-08T19:28:40.100213+0000","last_became_peered":"2021-10-08T19:28:40.100213+0000","last_unstale":"2021-10-08T19:41:52.970285+0000","last_undegraded":"2021-10-08T19:41:52.970285+0000","last_fullsized":"2021-10-08T19:41:52.970285+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:20.149744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:20.149744+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.034036438000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":277,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.969417+0000","last_change":"2021-10-08T19:40:06.317558+0000","last_active":"2021-10-08T19:41:52.969417+0000","last_peered":"2021-10-08T19:41:52.969417+0000","last_clean":"2021-10-08T19:41:52.969417+0000","last_became_active":"2021-10-08T19:29:44.443507+0000","last_became_peered":"2021-10-08T19:29:44.443507+0000","last_unstale":"2021-10-08T19:41:52.969417+0000","last_undegraded":"2021-10-08T19:41:52.969417+0000","last_fullsized":"2021-10-08T19:41:52.969417+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:06.317461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:06.317461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0054001470000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.0","version":"487'12555","reported_seq":12619,"reported_epoch":487,"state":"active+clean","last_fresh":"2021-10-08T19:42:04.623791+0000","last_change":"2021-10-08T19:41:35.405243+0000","last_active":"2021-10-08T19:42:04.623791+0000","last_peered":"2021-10-08T19:42:04.623791+0000","last_clean":"2021-10-08T19:42:04.623791+0000","last_became_active":"2021-10-08T19:39:04.508607+0000","last_became_peered":"2021-10-08T19:39:04.508607+0000","last_unstale":"2021-10-08T19:42:04.623791+0000","last_undegraded":"2021-10-08T19:42:04.623791+0000","last_fullsized":"2021-10-08T19:42:04.623791+0000","mapping_epoch":433,"log_start":"474'8300","ondisk_log_start":"474'8300","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:03.490762+0000","log_size":4255,"ondisk_log_size":4255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":99942400,"num_objects":1525,"num_object_clones":0,"num_object_copies":4575,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1525,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12555,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.a","version":"90'130","reported_seq":411,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.972227+0000","last_change":"2021-10-08T19:40:01.053717+0000","last_active":"2021-10-08T19:41:52.972227+0000","last_peered":"2021-10-08T19:41:52.972227+0000","last_clean":"2021-10-08T19:41:52.972227+0000","last_became_active":"2021-10-08T19:37:19.000525+0000","last_became_peered":"2021-10-08T19:37:19.000525+0000","last_unstale":"2021-10-08T19:41:52.972227+0000","last_undegraded":"2021-10-08T19:41:52.972227+0000","last_fullsized":"2021-10-08T19:41:52.972227+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:40:01.053607+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:40:01.053607+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034190679999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"482'39","reported_seq":243,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.972691+0000","last_change":"2021-10-08T19:40:03.107059+0000","last_active":"2021-10-08T19:41:52.972691+0000","last_peered":"2021-10-08T19:41:52.972691+0000","last_clean":"2021-10-08T19:41:52.972691+0000","last_became_active":"2021-10-08T19:32:45.162914+0000","last_became_peered":"2021-10-08T19:32:45.162914+0000","last_unstale":"2021-10-08T19:41:52.972691+0000","last_undegraded":"2021-10-08T19:41:52.972691+0000","last_fullsized":"2021-10-08T19:41:52.972691+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'27","last_scrub_stamp":"2021-10-08T19:40:03.106967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:40:03.106967+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0080879679999999992,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":550,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":350,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.977306+0000","last_change":"2021-10-08T19:41:24.519028+0000","last_active":"2021-10-08T19:41:52.977306+0000","last_peered":"2021-10-08T19:41:52.977306+0000","last_clean":"2021-10-08T19:41:52.977306+0000","last_became_active":"2021-10-08T19:36:58.004540+0000","last_became_peered":"2021-10-08T19:36:58.004540+0000","last_unstale":"2021-10-08T19:41:52.977306+0000","last_undegraded":"2021-10-08T19:41:52.977306+0000","last_fullsized":"2021-10-08T19:41:52.977306+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:41:24.518921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:47.613029+0000","last_clean_scrub_stamp":"2021-10-08T19:41:24.518921+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.03479492,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"88'9","reported_seq":729,"reported_epoch":487,"state":"active+clean","last_fresh":"2021-10-08T19:42:01.988138+0000","last_change":"2021-10-08T19:40:01.462959+0000","last_active":"2021-10-08T19:42:01.988138+0000","last_peered":"2021-10-08T19:42:01.988138+0000","last_clean":"2021-10-08T19:42:01.988138+0000","last_became_active":"2021-10-08T19:21:27.636432+0000","last_became_peered":"2021-10-08T19:21:27.636432+0000","last_unstale":"2021-10-08T19:42:01.988138+0000","last_undegraded":"2021-10-08T19:42:01.988138+0000","last_fullsized":"2021-10-08T19:42:01.988138+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'9","last_scrub_stamp":"2021-10-08T19:40:01.462851+0000","last_deep_scrub":"88'9","last_deep_scrub_stamp":"2021-10-08T19:23:00.048245+0000","last_clean_scrub_stamp":"2021-10-08T19:40:01.462851+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.020776886000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":276,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.977663+0000","last_change":"2021-10-08T19:41:16.438250+0000","last_active":"2021-10-08T19:41:52.977663+0000","last_peered":"2021-10-08T19:41:52.977663+0000","last_clean":"2021-10-08T19:41:52.977663+0000","last_became_active":"2021-10-08T19:37:19.016085+0000","last_became_peered":"2021-10-08T19:37:19.016085+0000","last_unstale":"2021-10-08T19:41:52.977663+0000","last_undegraded":"2021-10-08T19:41:52.977663+0000","last_fullsized":"2021-10-08T19:41:52.977663+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:37:54.590301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:37:54.590301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.095282983000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"70'5","reported_seq":277,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.969609+0000","last_change":"2021-10-08T19:40:32.248981+0000","last_active":"2021-10-08T19:41:52.969609+0000","last_peered":"2021-10-08T19:41:52.969609+0000","last_clean":"2021-10-08T19:41:52.969609+0000","last_became_active":"2021-10-08T19:29:40.639786+0000","last_became_peered":"2021-10-08T19:29:40.639786+0000","last_unstale":"2021-10-08T19:41:52.969609+0000","last_undegraded":"2021-10-08T19:41:52.969609+0000","last_fullsized":"2021-10-08T19:41:52.969609+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:40:32.248867+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2021-10-08T19:36:08.760670+0000","last_clean_scrub_stamp":"2021-10-08T19:40:32.248867+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.015954836,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1","version":"487'14653","reported_seq":14724,"reported_epoch":487,"state":"active+clean","last_fresh":"2021-10-08T19:42:08.817251+0000","last_change":"2021-10-08T19:42:06.634600+0000","last_active":"2021-10-08T19:42:08.817251+0000","last_peered":"2021-10-08T19:42:08.817251+0000","last_clean":"2021-10-08T19:42:08.817251+0000","last_became_active":"2021-10-08T19:39:04.511690+0000","last_became_peered":"2021-10-08T19:39:04.511690+0000","last_unstale":"2021-10-08T19:42:08.817251+0000","last_undegraded":"2021-10-08T19:42:08.817251+0000","last_fullsized":"2021-10-08T19:42:08.817251+0000","mapping_epoch":433,"log_start":"481'10401","ondisk_log_start":"481'10401","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"487'14505","last_scrub_stamp":"2021-10-08T19:42:06.634518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:42:06.634518+0000","log_size":4252,"ondisk_log_size":4252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.66656623500000001,"stat_sum":{"num_bytes":88014848,"num_objects":1343,"num_object_clones":0,"num_object_copies":4029,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1343,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13143,"num_write_kb":463552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"482'27","reported_seq":660,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.969959+0000","last_change":"2021-10-08T19:40:33.616897+0000","last_active":"2021-10-08T19:41:52.969959+0000","last_peered":"2021-10-08T19:41:52.969959+0000","last_clean":"2021-10-08T19:41:52.969959+0000","last_became_active":"2021-10-08T19:31:51.677509+0000","last_became_peered":"2021-10-08T19:31:51.677509+0000","last_unstale":"2021-10-08T19:41:52.969959+0000","last_undegraded":"2021-10-08T19:41:52.969959+0000","last_fullsized":"2021-10-08T19:41:52.969959+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:40:33.616776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:40:33.616776+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0050522830000000003,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":770,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":500,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.979433+0000","last_change":"2021-10-08T19:39:09.585407+0000","last_active":"2021-10-08T19:41:52.979433+0000","last_peered":"2021-10-08T19:41:52.979433+0000","last_clean":"2021-10-08T19:41:52.979433+0000","last_became_active":"2021-10-08T19:36:58.001610+0000","last_became_peered":"2021-10-08T19:36:58.001610+0000","last_unstale":"2021-10-08T19:41:52.979433+0000","last_undegraded":"2021-10-08T19:41:52.979433+0000","last_fullsized":"2021-10-08T19:41:52.979433+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:09.585318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:09.585318+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002054714,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":178,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.970002+0000","last_change":"2021-10-08T19:39:21.090794+0000","last_active":"2021-10-08T19:41:52.970002+0000","last_peered":"2021-10-08T19:41:52.970002+0000","last_clean":"2021-10-08T19:41:52.970002+0000","last_became_active":"2021-10-08T19:37:18.997446+0000","last_became_peered":"2021-10-08T19:37:18.997446+0000","last_unstale":"2021-10-08T19:41:52.970002+0000","last_undegraded":"2021-10-08T19:41:52.970002+0000","last_fullsized":"2021-10-08T19:41:52.970002+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:21.090701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:39:21.090701+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001395486,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":283,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.969802+0000","last_change":"2021-10-08T19:40:53.173789+0000","last_active":"2021-10-08T19:41:52.969802+0000","last_peered":"2021-10-08T19:41:52.969802+0000","last_clean":"2021-10-08T19:41:52.969802+0000","last_became_active":"2021-10-08T19:29:40.638099+0000","last_became_peered":"2021-10-08T19:29:40.638099+0000","last_unstale":"2021-10-08T19:41:52.969802+0000","last_undegraded":"2021-10-08T19:41:52.969802+0000","last_fullsized":"2021-10-08T19:41:52.969802+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:53.173689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:17.422176+0000","last_clean_scrub_stamp":"2021-10-08T19:40:53.173689+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0081726460000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":421,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.968246+0000","last_change":"2021-10-08T19:40:08.369310+0000","last_active":"2021-10-08T19:41:52.968246+0000","last_peered":"2021-10-08T19:41:52.968246+0000","last_clean":"2021-10-08T19:41:52.968246+0000","last_became_active":"2021-10-08T19:24:13.506602+0000","last_became_peered":"2021-10-08T19:24:13.506602+0000","last_unstale":"2021-10-08T19:41:52.968246+0000","last_undegraded":"2021-10-08T19:41:52.968246+0000","last_fullsized":"2021-10-08T19:41:52.968246+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:08.369244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:08.369244+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034824579999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"487'12597","reported_seq":12665,"reported_epoch":487,"state":"active+clean","last_fresh":"2021-10-08T19:42:08.496273+0000","last_change":"2021-10-08T19:41:41.119119+0000","last_active":"2021-10-08T19:42:08.496273+0000","last_peered":"2021-10-08T19:42:08.496273+0000","last_clean":"2021-10-08T19:42:08.496273+0000","last_became_active":"2021-10-08T19:39:04.505739+0000","last_became_peered":"2021-10-08T19:39:04.505739+0000","last_unstale":"2021-10-08T19:42:08.496273+0000","last_undegraded":"2021-10-08T19:42:08.496273+0000","last_fullsized":"2021-10-08T19:42:08.496273+0000","mapping_epoch":433,"log_start":"476'8600","ondisk_log_start":"476'8600","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"483'10810","last_scrub_stamp":"2021-10-08T19:41:41.118995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:41:41.118995+0000","log_size":3997,"ondisk_log_size":3997,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.98407097399999999,"stat_sum":{"num_bytes":81461248,"num_objects":1243,"num_object_clones":0,"num_object_copies":3729,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1243,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12597,"num_write_kb":442880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7],"acting":[4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"90'130","reported_seq":607,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.969615+0000","last_change":"2021-10-08T19:39:30.252356+0000","last_active":"2021-10-08T19:41:52.969615+0000","last_peered":"2021-10-08T19:41:52.969615+0000","last_clean":"2021-10-08T19:41:52.969615+0000","last_became_active":"2021-10-08T19:29:43.636733+0000","last_became_peered":"2021-10-08T19:29:43.636733+0000","last_unstale":"2021-10-08T19:41:52.969615+0000","last_undegraded":"2021-10-08T19:41:52.969615+0000","last_fullsized":"2021-10-08T19:41:52.969615+0000","mapping_epoch":239,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:39:30.252247+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:39:30.252247+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012156159999999999,"stat_sum":{"num_bytes":327680,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"238'13","reported_seq":436,"reported_epoch":487,"state":"active+clean","last_fresh":"2021-10-08T19:42:01.978760+0000","last_change":"2021-10-08T19:38:32.165269+0000","last_active":"2021-10-08T19:42:01.978760+0000","last_peered":"2021-10-08T19:42:01.978760+0000","last_clean":"2021-10-08T19:42:01.978760+0000","last_became_active":"2021-10-08T19:29:40.640248+0000","last_became_peered":"2021-10-08T19:29:40.640248+0000","last_unstale":"2021-10-08T19:42:01.978760+0000","last_undegraded":"2021-10-08T19:42:01.978760+0000","last_fullsized":"2021-10-08T19:42:01.978760+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"238'13","last_scrub_stamp":"2021-10-08T19:38:32.165194+0000","last_deep_scrub":"91'9","last_deep_scrub_stamp":"2021-10-08T19:23:32.329475+0000","last_clean_scrub_stamp":"2021-10-08T19:38:32.165194+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0056171720000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"482'42","reported_seq":583,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.968448+0000","last_change":"2021-10-08T19:41:41.132146+0000","last_active":"2021-10-08T19:41:52.968448+0000","last_peered":"2021-10-08T19:41:52.968448+0000","last_clean":"2021-10-08T19:41:52.968448+0000","last_became_active":"2021-10-08T19:24:25.098743+0000","last_became_peered":"2021-10-08T19:24:25.098743+0000","last_unstale":"2021-10-08T19:41:52.968448+0000","last_undegraded":"2021-10-08T19:41:52.968448+0000","last_fullsized":"2021-10-08T19:41:52.968448+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'28","last_scrub_stamp":"2021-10-08T19:39:11.026789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:39:11.026789+0000","log_size":42,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0043294240000000001,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":63,"num_read_kb":56,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":431,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.981165+0000","last_change":"2021-10-08T19:39:14.201859+0000","last_active":"2021-10-08T19:41:52.981165+0000","last_peered":"2021-10-08T19:41:52.981165+0000","last_clean":"2021-10-08T19:41:52.981165+0000","last_became_active":"2021-10-08T19:37:45.829953+0000","last_became_peered":"2021-10-08T19:37:45.829953+0000","last_unstale":"2021-10-08T19:41:52.981165+0000","last_undegraded":"2021-10-08T19:41:52.981165+0000","last_fullsized":"2021-10-08T19:41:52.981165+0000","mapping_epoch":407,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":408,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:14.201773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:14.201773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0032499429999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,2],"acting":[6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":489,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.981121+0000","last_change":"2021-10-08T19:40:10.935739+0000","last_active":"2021-10-08T19:41:52.981121+0000","last_peered":"2021-10-08T19:41:52.981121+0000","last_clean":"2021-10-08T19:41:52.981121+0000","last_became_active":"2021-10-08T19:24:25.094848+0000","last_became_peered":"2021-10-08T19:24:25.094848+0000","last_unstale":"2021-10-08T19:41:52.981121+0000","last_undegraded":"2021-10-08T19:41:52.981121+0000","last_fullsized":"2021-10-08T19:41:52.981121+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:10.935616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:40:10.935616+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.087461560999999993,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":444,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.984812+0000","last_change":"2021-10-08T19:39:29.921516+0000","last_active":"2021-10-08T19:41:52.984812+0000","last_peered":"2021-10-08T19:41:52.984812+0000","last_clean":"2021-10-08T19:41:52.984812+0000","last_became_active":"2021-10-08T19:28:40.132751+0000","last_became_peered":"2021-10-08T19:28:40.132751+0000","last_unstale":"2021-10-08T19:41:52.984812+0000","last_undegraded":"2021-10-08T19:41:52.984812+0000","last_fullsized":"2021-10-08T19:41:52.984812+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:29.921447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:29.921447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0045187020000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.f","version":"487'12798","reported_seq":12866,"reported_epoch":487,"state":"active+clean","last_fresh":"2021-10-08T19:42:08.735636+0000","last_change":"2021-10-08T19:41:34.361639+0000","last_active":"2021-10-08T19:42:08.735636+0000","last_peered":"2021-10-08T19:42:08.735636+0000","last_clean":"2021-10-08T19:42:08.735636+0000","last_became_active":"2021-10-08T19:39:04.509869+0000","last_became_peered":"2021-10-08T19:39:04.509869+0000","last_unstale":"2021-10-08T19:42:08.735636+0000","last_undegraded":"2021-10-08T19:42:08.735636+0000","last_fullsized":"2021-10-08T19:42:08.735636+0000","mapping_epoch":433,"log_start":"477'9000","ondisk_log_start":"477'9000","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'10617","last_scrub_stamp":"2021-10-08T19:41:34.361527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:41:34.361527+0000","log_size":3798,"ondisk_log_size":3798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":1.38763769,"stat_sum":{"num_bytes":84541440,"num_objects":1290,"num_object_clones":0,"num_object_copies":3870,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1290,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12798,"num_write_kb":450816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.5","version":"90'130","reported_seq":647,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.969353+0000","last_change":"2021-10-08T19:39:26.207889+0000","last_active":"2021-10-08T19:41:52.969353+0000","last_peered":"2021-10-08T19:41:52.969353+0000","last_clean":"2021-10-08T19:41:52.969353+0000","last_became_active":"2021-10-08T19:27:26.590651+0000","last_became_peered":"2021-10-08T19:27:26.590651+0000","last_unstale":"2021-10-08T19:41:52.969353+0000","last_undegraded":"2021-10-08T19:41:52.969353+0000","last_fullsized":"2021-10-08T19:41:52.969353+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:39:26.207770+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:32:14.582883+0000","last_clean_scrub_stamp":"2021-10-08T19:39:26.207770+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011952313000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":484,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.968741+0000","last_change":"2021-10-08T19:39:25.156483+0000","last_active":"2021-10-08T19:41:52.968741+0000","last_peered":"2021-10-08T19:41:52.968741+0000","last_clean":"2021-10-08T19:41:52.968741+0000","last_became_active":"2021-10-08T19:29:40.639405+0000","last_became_peered":"2021-10-08T19:29:40.639405+0000","last_unstale":"2021-10-08T19:41:52.968741+0000","last_undegraded":"2021-10-08T19:41:52.968741+0000","last_fullsized":"2021-10-08T19:41:52.968741+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:25.156355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:39:25.156355+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0062655510000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"482'42","reported_seq":337,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.968817+0000","last_change":"2021-10-08T19:41:30.286965+0000","last_active":"2021-10-08T19:41:52.968817+0000","last_peered":"2021-10-08T19:41:52.968817+0000","last_clean":"2021-10-08T19:41:52.968817+0000","last_became_active":"2021-10-08T19:29:40.635007+0000","last_became_peered":"2021-10-08T19:29:40.635007+0000","last_unstale":"2021-10-08T19:41:52.968817+0000","last_undegraded":"2021-10-08T19:41:52.968817+0000","last_fullsized":"2021-10-08T19:41:52.968817+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'30","last_scrub_stamp":"2021-10-08T19:41:30.286862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:41:30.286862+0000","log_size":42,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.025802489000000001,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":69,"num_read_kb":57,"num_write":44,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":326,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.978568+0000","last_change":"2021-10-08T19:40:46.233555+0000","last_active":"2021-10-08T19:41:52.978568+0000","last_peered":"2021-10-08T19:41:52.978568+0000","last_clean":"2021-10-08T19:41:52.978568+0000","last_became_active":"2021-10-08T19:36:58.013501+0000","last_became_peered":"2021-10-08T19:36:58.013501+0000","last_unstale":"2021-10-08T19:41:52.978568+0000","last_undegraded":"2021-10-08T19:41:52.978568+0000","last_fullsized":"2021-10-08T19:41:52.978568+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:46.233456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:40:46.233456+0000","last_clean_scrub_stamp":"2021-10-08T19:40:46.233456+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.006516811,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":482,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.968838+0000","last_change":"2021-10-08T19:40:04.385494+0000","last_active":"2021-10-08T19:41:52.968838+0000","last_peered":"2021-10-08T19:41:52.968838+0000","last_clean":"2021-10-08T19:41:52.968838+0000","last_became_active":"2021-10-08T19:29:40.638253+0000","last_became_peered":"2021-10-08T19:29:40.638253+0000","last_unstale":"2021-10-08T19:41:52.968838+0000","last_undegraded":"2021-10-08T19:41:52.968838+0000","last_fullsized":"2021-10-08T19:41:52.968838+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:04.385386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:40:04.385386+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0092727669999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":277,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.970669+0000","last_change":"2021-10-08T19:40:44.228306+0000","last_active":"2021-10-08T19:41:52.970669+0000","last_peered":"2021-10-08T19:41:52.970669+0000","last_clean":"2021-10-08T19:41:52.970669+0000","last_became_active":"2021-10-08T19:29:40.634579+0000","last_became_peered":"2021-10-08T19:29:40.634579+0000","last_unstale":"2021-10-08T19:41:52.970669+0000","last_undegraded":"2021-10-08T19:41:52.970669+0000","last_fullsized":"2021-10-08T19:41:52.970669+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:44.228198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:44.228198+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013076706,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"487'12598","reported_seq":12666,"reported_epoch":487,"state":"active+clean","last_fresh":"2021-10-08T19:42:04.589964+0000","last_change":"2021-10-08T19:41:29.943193+0000","last_active":"2021-10-08T19:42:04.589964+0000","last_peered":"2021-10-08T19:42:04.589964+0000","last_clean":"2021-10-08T19:42:04.589964+0000","last_became_active":"2021-10-08T19:39:04.507950+0000","last_became_peered":"2021-10-08T19:39:04.507950+0000","last_unstale":"2021-10-08T19:42:04.589964+0000","last_undegraded":"2021-10-08T19:42:04.589964+0000","last_fullsized":"2021-10-08T19:42:04.589964+0000","mapping_epoch":433,"log_start":"474'8400","ondisk_log_start":"474'8400","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'10391","last_scrub_stamp":"2021-10-08T19:41:29.943084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:41:29.943084+0000","log_size":4198,"ondisk_log_size":4198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":1.5091715749999999,"stat_sum":{"num_bytes":102498304,"num_objects":1564,"num_object_clones":0,"num_object_copies":4692,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1564,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12598,"num_write_kb":453184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,4],"acting":[1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"90'130","reported_seq":590,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.981746+0000","last_change":"2021-10-08T19:41:20.888804+0000","last_active":"2021-10-08T19:41:52.981746+0000","last_peered":"2021-10-08T19:41:52.981746+0000","last_clean":"2021-10-08T19:41:52.981746+0000","last_became_active":"2021-10-08T19:30:00.643797+0000","last_became_peered":"2021-10-08T19:30:00.643797+0000","last_unstale":"2021-10-08T19:41:52.981746+0000","last_undegraded":"2021-10-08T19:41:52.981746+0000","last_fullsized":"2021-10-08T19:41:52.981746+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:41:20.888698+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:41:20.888698+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0053594769999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":427,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.980432+0000","last_change":"2021-10-08T19:41:17.860285+0000","last_active":"2021-10-08T19:41:52.980432+0000","last_peered":"2021-10-08T19:41:52.980432+0000","last_clean":"2021-10-08T19:41:52.980432+0000","last_became_active":"2021-10-08T19:24:25.095389+0000","last_became_peered":"2021-10-08T19:24:25.095389+0000","last_unstale":"2021-10-08T19:41:52.980432+0000","last_undegraded":"2021-10-08T19:41:52.980432+0000","last_fullsized":"2021-10-08T19:41:52.980432+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:41:17.859917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:41:17.859917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0055520150000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"482'39","reported_seq":541,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.984964+0000","last_change":"2021-10-08T19:40:39.869360+0000","last_active":"2021-10-08T19:41:52.984964+0000","last_peered":"2021-10-08T19:41:52.984964+0000","last_clean":"2021-10-08T19:41:52.984964+0000","last_became_active":"2021-10-08T19:21:25.741812+0000","last_became_peered":"2021-10-08T19:21:25.741812+0000","last_unstale":"2021-10-08T19:41:52.984964+0000","last_undegraded":"2021-10-08T19:41:52.984964+0000","last_fullsized":"2021-10-08T19:41:52.984964+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'29","last_scrub_stamp":"2021-10-08T19:40:39.869249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:40:39.869249+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0043767700000000003,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":69,"num_read_kb":55,"num_write":42,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"328'2","reported_seq":498,"reported_epoch":487,"state":"active+clean","last_fresh":"2021-10-08T19:42:04.859953+0000","last_change":"2021-10-08T19:42:04.859925+0000","last_active":"2021-10-08T19:42:04.859953+0000","last_peered":"2021-10-08T19:42:04.859953+0000","last_clean":"2021-10-08T19:42:04.859953+0000","last_became_active":"2021-10-08T19:36:58.000171+0000","last_became_peered":"2021-10-08T19:36:58.000171+0000","last_unstale":"2021-10-08T19:42:04.859953+0000","last_undegraded":"2021-10-08T19:42:04.859953+0000","last_fullsized":"2021-10-08T19:42:04.859953+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"328'2","last_scrub_stamp":"2021-10-08T19:42:04.859852+0000","last_deep_scrub":"328'2","last_deep_scrub_stamp":"2021-10-08T19:33:29.990395+0000","last_clean_scrub_stamp":"2021-10-08T19:42:04.859852+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0015630080000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":317,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.977022+0000","last_change":"2021-10-08T19:40:09.995072+0000","last_active":"2021-10-08T19:41:52.977022+0000","last_peered":"2021-10-08T19:41:52.977022+0000","last_clean":"2021-10-08T19:41:52.977022+0000","last_became_active":"2021-10-08T19:28:40.140876+0000","last_became_peered":"2021-10-08T19:28:40.140876+0000","last_unstale":"2021-10-08T19:41:52.977022+0000","last_undegraded":"2021-10-08T19:41:52.977022+0000","last_fullsized":"2021-10-08T19:41:52.977022+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:09.994958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:40:09.994958+0000","last_clean_scrub_stamp":"2021-10-08T19:40:09.994958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.065315867,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"70'5","reported_seq":323,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.977926+0000","last_change":"2021-10-08T19:40:44.202234+0000","last_active":"2021-10-08T19:41:52.977926+0000","last_peered":"2021-10-08T19:41:52.977926+0000","last_clean":"2021-10-08T19:41:52.977926+0000","last_became_active":"2021-10-08T19:28:40.150503+0000","last_became_peered":"2021-10-08T19:28:40.150503+0000","last_unstale":"2021-10-08T19:41:52.977926+0000","last_undegraded":"2021-10-08T19:41:52.977926+0000","last_fullsized":"2021-10-08T19:41:52.977926+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:40:44.202122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:44.202122+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.004019262,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.9","version":"487'12621","reported_seq":12683,"reported_epoch":487,"state":"active+clean","last_fresh":"2021-10-08T19:42:04.328764+0000","last_change":"2021-10-08T19:39:04.512253+0000","last_active":"2021-10-08T19:42:04.328764+0000","last_peered":"2021-10-08T19:42:04.328764+0000","last_clean":"2021-10-08T19:42:04.328764+0000","last_became_active":"2021-10-08T19:39:04.511738+0000","last_became_peered":"2021-10-08T19:39:04.511738+0000","last_unstale":"2021-10-08T19:42:04.328764+0000","last_undegraded":"2021-10-08T19:42:04.328764+0000","last_fullsized":"2021-10-08T19:42:04.328764+0000","mapping_epoch":433,"log_start":"475'8700","ondisk_log_start":"475'8700","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:03.490762+0000","log_size":3921,"ondisk_log_size":3921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":100990976,"num_objects":1541,"num_object_clones":0,"num_object_copies":4623,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1541,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12621,"num_write_kb":453184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"90'130","reported_seq":620,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.977876+0000","last_change":"2021-10-08T19:41:36.423274+0000","last_active":"2021-10-08T19:41:52.977876+0000","last_peered":"2021-10-08T19:41:52.977876+0000","last_clean":"2021-10-08T19:41:52.977876+0000","last_became_active":"2021-10-08T19:28:43.178371+0000","last_became_peered":"2021-10-08T19:28:43.178371+0000","last_unstale":"2021-10-08T19:41:52.977876+0000","last_undegraded":"2021-10-08T19:41:52.977876+0000","last_fullsized":"2021-10-08T19:41:52.977876+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:39:12.712371+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:34:13.653248+0000","last_clean_scrub_stamp":"2021-10-08T19:39:12.712371+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0024492619999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":243,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.987081+0000","last_change":"2021-10-08T19:41:18.711612+0000","last_active":"2021-10-08T19:41:52.987081+0000","last_peered":"2021-10-08T19:41:52.987081+0000","last_clean":"2021-10-08T19:41:52.987081+0000","last_became_active":"2021-10-08T19:31:22.783759+0000","last_became_peered":"2021-10-08T19:31:22.783759+0000","last_unstale":"2021-10-08T19:41:52.987081+0000","last_undegraded":"2021-10-08T19:41:52.987081+0000","last_fullsized":"2021-10-08T19:41:52.987081+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:41:18.711517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:41:18.711517+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.028952043,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"482'36","reported_seq":596,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.985016+0000","last_change":"2021-10-08T19:39:58.874015+0000","last_active":"2021-10-08T19:41:52.985016+0000","last_peered":"2021-10-08T19:41:52.985016+0000","last_clean":"2021-10-08T19:41:52.985016+0000","last_became_active":"2021-10-08T19:32:45.154743+0000","last_became_peered":"2021-10-08T19:32:45.154743+0000","last_unstale":"2021-10-08T19:41:52.985016+0000","last_undegraded":"2021-10-08T19:41:52.985016+0000","last_fullsized":"2021-10-08T19:41:52.985016+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'24","last_scrub_stamp":"2021-10-08T19:39:58.873935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:39:58.873935+0000","log_size":36,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010739402,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":48,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":485,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.971457+0000","last_change":"2021-10-08T19:41:16.974876+0000","last_active":"2021-10-08T19:41:52.971457+0000","last_peered":"2021-10-08T19:41:52.971457+0000","last_clean":"2021-10-08T19:41:52.971457+0000","last_became_active":"2021-10-08T19:36:58.012034+0000","last_became_peered":"2021-10-08T19:36:58.012034+0000","last_unstale":"2021-10-08T19:41:52.971457+0000","last_undegraded":"2021-10-08T19:41:52.971457+0000","last_fullsized":"2021-10-08T19:41:52.971457+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:41:16.974779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:22.163674+0000","last_clean_scrub_stamp":"2021-10-08T19:41:16.974779+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0078097239999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":507,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.982831+0000","last_change":"2021-10-08T19:39:53.907915+0000","last_active":"2021-10-08T19:41:52.982831+0000","last_peered":"2021-10-08T19:41:52.982831+0000","last_clean":"2021-10-08T19:41:52.982831+0000","last_became_active":"2021-10-08T19:29:40.632010+0000","last_became_peered":"2021-10-08T19:29:40.632010+0000","last_unstale":"2021-10-08T19:41:52.982831+0000","last_undegraded":"2021-10-08T19:41:52.982831+0000","last_fullsized":"2021-10-08T19:41:52.982831+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:53.907799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:53.907799+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0094451080000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":219,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.977515+0000","last_change":"2021-10-08T19:39:22.680310+0000","last_active":"2021-10-08T19:41:52.977515+0000","last_peered":"2021-10-08T19:41:52.977515+0000","last_clean":"2021-10-08T19:41:52.977515+0000","last_became_active":"2021-10-08T19:31:51.673821+0000","last_became_peered":"2021-10-08T19:31:51.673821+0000","last_unstale":"2021-10-08T19:41:52.977515+0000","last_undegraded":"2021-10-08T19:41:52.977515+0000","last_fullsized":"2021-10-08T19:41:52.977515+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:22.680215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:21.644827+0000","last_clean_scrub_stamp":"2021-10-08T19:39:22.680215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002643659,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.a","version":"487'12728","reported_seq":12790,"reported_epoch":487,"state":"active+clean","last_fresh":"2021-10-08T19:42:04.340821+0000","last_change":"2021-10-08T19:39:04.774934+0000","last_active":"2021-10-08T19:42:04.340821+0000","last_peered":"2021-10-08T19:42:04.340821+0000","last_clean":"2021-10-08T19:42:04.340821+0000","last_became_active":"2021-10-08T19:39:04.774503+0000","last_became_peered":"2021-10-08T19:39:04.774503+0000","last_unstale":"2021-10-08T19:42:04.340821+0000","last_undegraded":"2021-10-08T19:42:04.340821+0000","last_fullsized":"2021-10-08T19:42:04.340821+0000","mapping_epoch":433,"log_start":"476'8800","ondisk_log_start":"476'8800","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:03.490762+0000","log_size":3928,"ondisk_log_size":3928,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":105119744,"num_objects":1604,"num_object_clones":0,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1604,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12728,"num_write_kb":458624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":467,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.983411+0000","last_change":"2021-10-08T19:39:59.811372+0000","last_active":"2021-10-08T19:41:52.983411+0000","last_peered":"2021-10-08T19:41:52.983411+0000","last_clean":"2021-10-08T19:41:52.983411+0000","last_became_active":"2021-10-08T19:21:27.636086+0000","last_became_peered":"2021-10-08T19:21:27.636086+0000","last_unstale":"2021-10-08T19:41:52.983411+0000","last_undegraded":"2021-10-08T19:41:52.983411+0000","last_fullsized":"2021-10-08T19:41:52.983411+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:59.811267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:39:59.811267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0070031299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"482'45","reported_seq":478,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.984695+0000","last_change":"2021-10-08T19:39:26.350865+0000","last_active":"2021-10-08T19:41:52.984695+0000","last_peered":"2021-10-08T19:41:52.984695+0000","last_clean":"2021-10-08T19:41:52.984695+0000","last_became_active":"2021-10-08T19:24:25.100384+0000","last_became_peered":"2021-10-08T19:24:25.100384+0000","last_unstale":"2021-10-08T19:41:52.984695+0000","last_undegraded":"2021-10-08T19:41:52.984695+0000","last_fullsized":"2021-10-08T19:41:52.984695+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"443'33","last_scrub_stamp":"2021-10-08T19:39:26.350786+0000","last_deep_scrub":"443'33","last_deep_scrub_stamp":"2021-10-08T19:39:26.350786+0000","last_clean_scrub_stamp":"2021-10-08T19:39:26.350786+0000","log_size":45,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010726793,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":60,"num_read_kb":50,"num_write":37,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"90'130","reported_seq":788,"reported_epoch":487,"state":"active+clean","last_fresh":"2021-10-08T19:42:05.815868+0000","last_change":"2021-10-08T19:42:05.815835+0000","last_active":"2021-10-08T19:42:05.815868+0000","last_peered":"2021-10-08T19:42:05.815868+0000","last_clean":"2021-10-08T19:42:05.815868+0000","last_became_active":"2021-10-08T19:27:22.607289+0000","last_became_peered":"2021-10-08T19:27:22.607289+0000","last_unstale":"2021-10-08T19:42:05.815868+0000","last_undegraded":"2021-10-08T19:42:05.815868+0000","last_fullsized":"2021-10-08T19:42:05.815868+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:42:05.815760+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:42:05.815760+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0055778160000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":485,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.972550+0000","last_change":"2021-10-08T19:40:06.128693+0000","last_active":"2021-10-08T19:41:52.972550+0000","last_peered":"2021-10-08T19:41:52.972550+0000","last_clean":"2021-10-08T19:41:52.972550+0000","last_became_active":"2021-10-08T19:37:45.837378+0000","last_became_peered":"2021-10-08T19:37:45.837378+0000","last_unstale":"2021-10-08T19:41:52.972550+0000","last_undegraded":"2021-10-08T19:41:52.972550+0000","last_fullsized":"2021-10-08T19:41:52.972550+0000","mapping_epoch":407,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":408,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:06.128585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:06.128585+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011647138,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":277,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.969519+0000","last_change":"2021-10-08T19:39:19.171728+0000","last_active":"2021-10-08T19:41:52.969519+0000","last_peered":"2021-10-08T19:41:52.969519+0000","last_clean":"2021-10-08T19:41:52.969519+0000","last_became_active":"2021-10-08T19:29:40.638774+0000","last_became_peered":"2021-10-08T19:29:40.638774+0000","last_unstale":"2021-10-08T19:41:52.969519+0000","last_undegraded":"2021-10-08T19:41:52.969519+0000","last_fullsized":"2021-10-08T19:41:52.969519+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:19.171649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:19.171649+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.008189689,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":306,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.970824+0000","last_change":"2021-10-08T19:38:40.123422+0000","last_active":"2021-10-08T19:41:52.970824+0000","last_peered":"2021-10-08T19:41:52.970824+0000","last_clean":"2021-10-08T19:41:52.970824+0000","last_became_active":"2021-10-08T19:37:19.006459+0000","last_became_peered":"2021-10-08T19:37:19.006459+0000","last_unstale":"2021-10-08T19:41:52.970824+0000","last_undegraded":"2021-10-08T19:41:52.970824+0000","last_fullsized":"2021-10-08T19:41:52.970824+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:40.123325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:32:15.872860+0000","last_clean_scrub_stamp":"2021-10-08T19:38:40.123325+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.103398937,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4],"acting":[3,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"487'12796","reported_seq":12858,"reported_epoch":487,"state":"active+clean","last_fresh":"2021-10-08T19:42:04.323074+0000","last_change":"2021-10-08T19:39:04.774874+0000","last_active":"2021-10-08T19:42:04.323074+0000","last_peered":"2021-10-08T19:42:04.323074+0000","last_clean":"2021-10-08T19:42:04.323074+0000","last_became_active":"2021-10-08T19:39:04.774530+0000","last_became_peered":"2021-10-08T19:39:04.774530+0000","last_unstale":"2021-10-08T19:42:04.323074+0000","last_undegraded":"2021-10-08T19:42:04.323074+0000","last_fullsized":"2021-10-08T19:42:04.323074+0000","mapping_epoch":433,"log_start":"475'8800","ondisk_log_start":"475'8800","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:03.490762+0000","log_size":3996,"ondisk_log_size":3996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":107216896,"num_objects":1636,"num_object_clones":0,"num_object_copies":4908,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1636,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12796,"num_write_kb":461824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"90'130","reported_seq":788,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.980506+0000","last_change":"2021-10-08T19:39:25.754394+0000","last_active":"2021-10-08T19:41:52.980506+0000","last_peered":"2021-10-08T19:41:52.980506+0000","last_clean":"2021-10-08T19:41:52.980506+0000","last_became_active":"2021-10-08T19:27:26.591250+0000","last_became_peered":"2021-10-08T19:27:26.591250+0000","last_unstale":"2021-10-08T19:41:52.980506+0000","last_undegraded":"2021-10-08T19:41:52.980506+0000","last_fullsized":"2021-10-08T19:41:52.980506+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:39:25.754295+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:39:25.754295+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0065366060000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":483,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.973533+0000","last_change":"2021-10-08T19:40:39.008261+0000","last_active":"2021-10-08T19:41:52.973533+0000","last_peered":"2021-10-08T19:41:52.973533+0000","last_clean":"2021-10-08T19:41:52.973533+0000","last_became_active":"2021-10-08T19:21:27.637875+0000","last_became_peered":"2021-10-08T19:21:27.637875+0000","last_unstale":"2021-10-08T19:41:52.973533+0000","last_undegraded":"2021-10-08T19:41:52.973533+0000","last_fullsized":"2021-10-08T19:41:52.973533+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:39.008146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:20.092069+0000","last_clean_scrub_stamp":"2021-10-08T19:40:39.008146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0068776480000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"482'21","reported_seq":237,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.978921+0000","last_change":"2021-10-08T19:40:43.162940+0000","last_active":"2021-10-08T19:41:52.978921+0000","last_peered":"2021-10-08T19:41:52.978921+0000","last_clean":"2021-10-08T19:41:52.978921+0000","last_became_active":"2021-10-08T19:31:51.674965+0000","last_became_peered":"2021-10-08T19:31:51.674965+0000","last_unstale":"2021-10-08T19:41:52.978921+0000","last_undegraded":"2021-10-08T19:41:52.978921+0000","last_fullsized":"2021-10-08T19:41:52.978921+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'17","last_scrub_stamp":"2021-10-08T19:40:43.162834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:40:43.162834+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0077953040000000003,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":29,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":990,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":516,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.971893+0000","last_change":"2021-10-08T19:41:17.997697+0000","last_active":"2021-10-08T19:41:52.971893+0000","last_peered":"2021-10-08T19:41:52.971893+0000","last_clean":"2021-10-08T19:41:52.971893+0000","last_became_active":"2021-10-08T19:36:58.015216+0000","last_became_peered":"2021-10-08T19:36:58.015216+0000","last_unstale":"2021-10-08T19:41:52.971893+0000","last_undegraded":"2021-10-08T19:41:52.971893+0000","last_fullsized":"2021-10-08T19:41:52.971893+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:41:17.997605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:41:17.997605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013133647,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"70'5","reported_seq":323,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.977235+0000","last_change":"2021-10-08T19:41:41.330459+0000","last_active":"2021-10-08T19:41:52.977235+0000","last_peered":"2021-10-08T19:41:52.977235+0000","last_clean":"2021-10-08T19:41:52.977235+0000","last_became_active":"2021-10-08T19:28:40.148054+0000","last_became_peered":"2021-10-08T19:28:40.148054+0000","last_unstale":"2021-10-08T19:41:52.977235+0000","last_undegraded":"2021-10-08T19:41:52.977235+0000","last_fullsized":"2021-10-08T19:41:52.977235+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:39:25.676492+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2021-10-08T19:34:18.630378+0000","last_clean_scrub_stamp":"2021-10-08T19:39:25.676492+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014341095999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":501,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.982898+0000","last_change":"2021-10-08T19:40:54.980585+0000","last_active":"2021-10-08T19:41:52.982898+0000","last_peered":"2021-10-08T19:41:52.982898+0000","last_clean":"2021-10-08T19:41:52.982898+0000","last_became_active":"2021-10-08T19:29:40.652528+0000","last_became_peered":"2021-10-08T19:29:40.652528+0000","last_unstale":"2021-10-08T19:41:52.982898+0000","last_undegraded":"2021-10-08T19:41:52.982898+0000","last_fullsized":"2021-10-08T19:41:52.982898+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:54.980484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:40:54.980484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.052397393,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"487'12836","reported_seq":12898,"reported_epoch":487,"state":"active+clean","last_fresh":"2021-10-08T19:42:04.268534+0000","last_change":"2021-10-08T19:39:04.512013+0000","last_active":"2021-10-08T19:42:04.268534+0000","last_peered":"2021-10-08T19:42:04.268534+0000","last_clean":"2021-10-08T19:42:04.268534+0000","last_became_active":"2021-10-08T19:39:04.511692+0000","last_became_peered":"2021-10-08T19:39:04.511692+0000","last_unstale":"2021-10-08T19:42:04.268534+0000","last_undegraded":"2021-10-08T19:42:04.268534+0000","last_fullsized":"2021-10-08T19:42:04.268534+0000","mapping_epoch":433,"log_start":"475'8900","ondisk_log_start":"475'8900","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:03.490762+0000","log_size":3936,"ondisk_log_size":3936,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":105381888,"num_objects":1608,"num_object_clones":0,"num_object_copies":4824,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1608,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12836,"num_write_kb":462208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"90'130","reported_seq":416,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.982697+0000","last_change":"2021-10-08T19:39:59.921790+0000","last_active":"2021-10-08T19:41:52.982697+0000","last_peered":"2021-10-08T19:41:52.982697+0000","last_clean":"2021-10-08T19:41:52.982697+0000","last_became_active":"2021-10-08T19:37:19.032630+0000","last_became_peered":"2021-10-08T19:37:19.032630+0000","last_unstale":"2021-10-08T19:41:52.982697+0000","last_undegraded":"2021-10-08T19:41:52.982697+0000","last_fullsized":"2021-10-08T19:41:52.982697+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:39:59.921660+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:39:59.921660+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.01168085,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":489,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.984917+0000","last_change":"2021-10-08T19:39:55.826848+0000","last_active":"2021-10-08T19:41:52.984917+0000","last_peered":"2021-10-08T19:41:52.984917+0000","last_clean":"2021-10-08T19:41:52.984917+0000","last_became_active":"2021-10-08T19:28:40.133414+0000","last_became_peered":"2021-10-08T19:28:40.133414+0000","last_unstale":"2021-10-08T19:41:52.984917+0000","last_undegraded":"2021-10-08T19:41:52.984917+0000","last_fullsized":"2021-10-08T19:41:52.984917+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:55.826735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:39:55.826735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0091553829999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"482'56","reported_seq":605,"reported_epoch":487,"state":"active+clean","last_fresh":"2021-10-08T19:42:01.976854+0000","last_change":"2021-10-08T19:41:21.509547+0000","last_active":"2021-10-08T19:42:01.976854+0000","last_peered":"2021-10-08T19:42:01.976854+0000","last_clean":"2021-10-08T19:42:01.976854+0000","last_became_active":"2021-10-08T19:29:40.626138+0000","last_became_peered":"2021-10-08T19:29:40.626138+0000","last_unstale":"2021-10-08T19:42:01.976854+0000","last_undegraded":"2021-10-08T19:42:01.976854+0000","last_fullsized":"2021-10-08T19:42:01.976854+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'44","last_scrub_stamp":"2021-10-08T19:41:21.509439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:41:21.509439+0000","log_size":56,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0073374210000000002,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":83,"num_read_kb":68,"num_write":50,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":1432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":512,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.977379+0000","last_change":"2021-10-08T19:41:22.536639+0000","last_active":"2021-10-08T19:41:52.977379+0000","last_peered":"2021-10-08T19:41:52.977379+0000","last_clean":"2021-10-08T19:41:52.977379+0000","last_became_active":"2021-10-08T19:37:19.004386+0000","last_became_peered":"2021-10-08T19:37:19.004386+0000","last_unstale":"2021-10-08T19:41:52.977379+0000","last_undegraded":"2021-10-08T19:41:52.977379+0000","last_fullsized":"2021-10-08T19:41:52.977379+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:41:22.536531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:49.623545+0000","last_clean_scrub_stamp":"2021-10-08T19:41:22.536531+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0086989179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":285,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.970391+0000","last_change":"2021-10-08T19:41:28.269109+0000","last_active":"2021-10-08T19:41:52.970391+0000","last_peered":"2021-10-08T19:41:52.970391+0000","last_clean":"2021-10-08T19:41:52.970391+0000","last_became_active":"2021-10-08T19:29:40.637371+0000","last_became_peered":"2021-10-08T19:29:40.637371+0000","last_unstale":"2021-10-08T19:41:52.970391+0000","last_undegraded":"2021-10-08T19:41:52.970391+0000","last_fullsized":"2021-10-08T19:41:52.970391+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:41:28.269002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:41:28.269002+0000","last_clean_scrub_stamp":"2021-10-08T19:41:28.269002+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0092215460000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":432,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.969148+0000","last_change":"2021-10-08T19:41:30.044938+0000","last_active":"2021-10-08T19:41:52.969148+0000","last_peered":"2021-10-08T19:41:52.969148+0000","last_clean":"2021-10-08T19:41:52.969148+0000","last_became_active":"2021-10-08T19:25:14.550690+0000","last_became_peered":"2021-10-08T19:25:14.550690+0000","last_unstale":"2021-10-08T19:41:52.969148+0000","last_undegraded":"2021-10-08T19:41:52.969148+0000","last_fullsized":"2021-10-08T19:41:52.969148+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:41:30.044821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:36:09.181866+0000","last_clean_scrub_stamp":"2021-10-08T19:41:30.044821+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0078369709999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.d","version":"487'12678","reported_seq":12747,"reported_epoch":487,"state":"active+clean","last_fresh":"2021-10-08T19:42:04.043172+0000","last_change":"2021-10-08T19:40:43.913456+0000","last_active":"2021-10-08T19:42:04.043172+0000","last_peered":"2021-10-08T19:42:04.043172+0000","last_clean":"2021-10-08T19:42:04.043172+0000","last_became_active":"2021-10-08T19:39:04.508623+0000","last_became_peered":"2021-10-08T19:39:04.508623+0000","last_unstale":"2021-10-08T19:42:04.043172+0000","last_undegraded":"2021-10-08T19:42:04.043172+0000","last_fullsized":"2021-10-08T19:42:04.043172+0000","mapping_epoch":433,"log_start":"469'7500","ondisk_log_start":"469'7500","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"469'7402","last_scrub_stamp":"2021-10-08T19:40:43.913335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:40:43.913335+0000","log_size":5178,"ondisk_log_size":5178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":2.962624098,"stat_sum":{"num_bytes":105840664,"num_objects":1616,"num_object_clones":0,"num_object_copies":4848,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1616,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":12678,"num_write_kb":457345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6],"acting":[2,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"90'130","reported_seq":748,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.980901+0000","last_change":"2021-10-08T19:40:01.944949+0000","last_active":"2021-10-08T19:41:52.980901+0000","last_peered":"2021-10-08T19:41:52.980901+0000","last_clean":"2021-10-08T19:41:52.980901+0000","last_became_active":"2021-10-08T19:29:43.636820+0000","last_became_peered":"2021-10-08T19:29:43.636820+0000","last_unstale":"2021-10-08T19:41:52.980901+0000","last_undegraded":"2021-10-08T19:41:52.980901+0000","last_fullsized":"2021-10-08T19:41:52.980901+0000","mapping_epoch":239,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:40:01.944834+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:40:01.944834+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0061141190000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"114'10","reported_seq":759,"reported_epoch":487,"state":"active+clean","last_fresh":"2021-10-08T19:42:01.988906+0000","last_change":"2021-10-08T19:40:54.913771+0000","last_active":"2021-10-08T19:42:01.988906+0000","last_peered":"2021-10-08T19:42:01.988906+0000","last_clean":"2021-10-08T19:42:01.988906+0000","last_became_active":"2021-10-08T19:24:25.106695+0000","last_became_peered":"2021-10-08T19:24:25.106695+0000","last_unstale":"2021-10-08T19:42:01.988906+0000","last_undegraded":"2021-10-08T19:42:01.988906+0000","last_fullsized":"2021-10-08T19:42:01.988906+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'10","last_scrub_stamp":"2021-10-08T19:40:54.913650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:40:54.913650+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.006310749,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"482'30","reported_seq":246,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.977550+0000","last_change":"2021-10-08T19:40:48.298186+0000","last_active":"2021-10-08T19:41:52.977550+0000","last_peered":"2021-10-08T19:41:52.977550+0000","last_clean":"2021-10-08T19:41:52.977550+0000","last_became_active":"2021-10-08T19:31:51.675569+0000","last_became_peered":"2021-10-08T19:31:51.675569+0000","last_unstale":"2021-10-08T19:41:52.977550+0000","last_undegraded":"2021-10-08T19:41:52.977550+0000","last_fullsized":"2021-10-08T19:41:52.977550+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'20","last_scrub_stamp":"2021-10-08T19:40:48.298070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:40:48.298070+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0094577930000000008,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":38,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":332,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.977604+0000","last_change":"2021-10-08T19:41:17.462310+0000","last_active":"2021-10-08T19:41:52.977604+0000","last_peered":"2021-10-08T19:41:52.977604+0000","last_clean":"2021-10-08T19:41:52.977604+0000","last_became_active":"2021-10-08T19:36:58.013921+0000","last_became_peered":"2021-10-08T19:36:58.013921+0000","last_unstale":"2021-10-08T19:41:52.977604+0000","last_undegraded":"2021-10-08T19:41:52.977604+0000","last_fullsized":"2021-10-08T19:41:52.977604+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:41:17.462204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:45.612819+0000","last_clean_scrub_stamp":"2021-10-08T19:41:17.462204+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0063392600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":491,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.980492+0000","last_change":"2021-10-08T19:40:49.951176+0000","last_active":"2021-10-08T19:41:52.980492+0000","last_peered":"2021-10-08T19:41:52.980492+0000","last_clean":"2021-10-08T19:41:52.980492+0000","last_became_active":"2021-10-08T19:29:40.643614+0000","last_became_peered":"2021-10-08T19:29:40.643614+0000","last_unstale":"2021-10-08T19:41:52.980492+0000","last_undegraded":"2021-10-08T19:41:52.980492+0000","last_fullsized":"2021-10-08T19:41:52.980492+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:49.951046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:40:49.951046+0000","last_clean_scrub_stamp":"2021-10-08T19:40:49.951046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.073125817999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":270,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.970000+0000","last_change":"2021-10-08T19:39:54.093007+0000","last_active":"2021-10-08T19:41:52.970000+0000","last_peered":"2021-10-08T19:41:52.970000+0000","last_clean":"2021-10-08T19:41:52.970000+0000","last_became_active":"2021-10-08T19:37:19.012488+0000","last_became_peered":"2021-10-08T19:37:19.012488+0000","last_unstale":"2021-10-08T19:41:52.970000+0000","last_undegraded":"2021-10-08T19:41:52.970000+0000","last_fullsized":"2021-10-08T19:41:52.970000+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:54.092909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:54.092909+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0066472559999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,2],"acting":[3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.6","version":"487'12806","reported_seq":12874,"reported_epoch":487,"state":"active+clean","last_fresh":"2021-10-08T19:42:08.773704+0000","last_change":"2021-10-08T19:40:53.997643+0000","last_active":"2021-10-08T19:42:08.773704+0000","last_peered":"2021-10-08T19:42:08.773704+0000","last_clean":"2021-10-08T19:42:08.773704+0000","last_became_active":"2021-10-08T19:39:04.514288+0000","last_became_peered":"2021-10-08T19:39:04.514288+0000","last_unstale":"2021-10-08T19:42:08.773704+0000","last_undegraded":"2021-10-08T19:42:08.773704+0000","last_fullsized":"2021-10-08T19:42:08.773704+0000","mapping_epoch":433,"log_start":"471'8000","ondisk_log_start":"471'8000","created":433,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"471'7995","last_scrub_stamp":"2021-10-08T19:40:53.997536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:03.490762+0000","last_clean_scrub_stamp":"2021-10-08T19:40:53.997536+0000","log_size":4806,"ondisk_log_size":4806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":3.0690331159999999,"stat_sum":{"num_bytes":88342528,"num_objects":1348,"num_object_clones":0,"num_object_copies":4044,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1348,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12806,"num_write_kb":452928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":499,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.971721+0000","last_change":"2021-10-08T19:40:08.190048+0000","last_active":"2021-10-08T19:41:52.971721+0000","last_peered":"2021-10-08T19:41:52.971721+0000","last_clean":"2021-10-08T19:41:52.971721+0000","last_became_active":"2021-10-08T19:28:40.138726+0000","last_became_peered":"2021-10-08T19:28:40.138726+0000","last_unstale":"2021-10-08T19:41:52.971721+0000","last_undegraded":"2021-10-08T19:41:52.971721+0000","last_fullsized":"2021-10-08T19:41:52.971721+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:08.189929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:50.435552+0000","last_clean_scrub_stamp":"2021-10-08T19:40:08.189929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0083115949999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"482'24","reported_seq":595,"reported_epoch":487,"state":"active+clean","last_fresh":"2021-10-08T19:42:07.064703+0000","last_change":"2021-10-08T19:42:07.064660+0000","last_active":"2021-10-08T19:42:07.064703+0000","last_peered":"2021-10-08T19:42:07.064703+0000","last_clean":"2021-10-08T19:42:07.064703+0000","last_became_active":"2021-10-08T19:29:40.638957+0000","last_became_peered":"2021-10-08T19:29:40.638957+0000","last_unstale":"2021-10-08T19:42:07.064703+0000","last_undegraded":"2021-10-08T19:42:07.064703+0000","last_fullsized":"2021-10-08T19:42:07.064703+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'24","last_scrub_stamp":"2021-10-08T19:42:07.064545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:42:07.064545+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010238858,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"61'2","reported_seq":486,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.969859+0000","last_change":"2021-10-08T19:40:02.407598+0000","last_active":"2021-10-08T19:41:52.969859+0000","last_peered":"2021-10-08T19:41:52.969859+0000","last_clean":"2021-10-08T19:41:52.969859+0000","last_became_active":"2021-10-08T19:21:23.603614+0000","last_became_peered":"2021-10-08T19:21:23.603614+0000","last_unstale":"2021-10-08T19:41:52.969859+0000","last_undegraded":"2021-10-08T19:41:52.969859+0000","last_fullsized":"2021-10-08T19:41:52.969859+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'2","last_scrub_stamp":"2021-10-08T19:40:02.407482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:02.407482+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0060178940000000002,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":279,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.969297+0000","last_change":"2021-10-08T19:39:11.360634+0000","last_active":"2021-10-08T19:41:52.969297+0000","last_peered":"2021-10-08T19:41:52.969297+0000","last_clean":"2021-10-08T19:41:52.969297+0000","last_became_active":"2021-10-08T19:29:40.645211+0000","last_became_peered":"2021-10-08T19:29:40.645211+0000","last_unstale":"2021-10-08T19:41:52.969297+0000","last_undegraded":"2021-10-08T19:41:52.969297+0000","last_fullsized":"2021-10-08T19:41:52.969297+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:11.360528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:11.360528+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.12852046,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":406,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.983720+0000","last_change":"2021-10-08T19:40:03.902724+0000","last_active":"2021-10-08T19:41:52.983720+0000","last_peered":"2021-10-08T19:41:52.983720+0000","last_clean":"2021-10-08T19:41:52.983720+0000","last_became_active":"2021-10-08T19:28:40.100770+0000","last_became_peered":"2021-10-08T19:28:40.100770+0000","last_unstale":"2021-10-08T19:41:52.983720+0000","last_undegraded":"2021-10-08T19:41:52.983720+0000","last_fullsized":"2021-10-08T19:41:52.983720+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:03.902636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:03.902636+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011310317,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"482'21","reported_seq":547,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.985115+0000","last_change":"2021-10-08T19:39:54.875637+0000","last_active":"2021-10-08T19:41:52.985115+0000","last_peered":"2021-10-08T19:41:52.985115+0000","last_clean":"2021-10-08T19:41:52.985115+0000","last_became_active":"2021-10-08T19:29:40.644354+0000","last_became_peered":"2021-10-08T19:29:40.644354+0000","last_unstale":"2021-10-08T19:41:52.985115+0000","last_undegraded":"2021-10-08T19:41:52.985115+0000","last_fullsized":"2021-10-08T19:41:52.985115+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'15","last_scrub_stamp":"2021-10-08T19:39:54.875517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:39:54.875517+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010969082,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":511,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.971648+0000","last_change":"2021-10-08T19:40:32.125560+0000","last_active":"2021-10-08T19:41:52.971648+0000","last_peered":"2021-10-08T19:41:52.971648+0000","last_clean":"2021-10-08T19:41:52.971648+0000","last_became_active":"2021-10-08T19:28:40.139234+0000","last_became_peered":"2021-10-08T19:28:40.139234+0000","last_unstale":"2021-10-08T19:41:52.971648+0000","last_undegraded":"2021-10-08T19:41:52.971648+0000","last_fullsized":"2021-10-08T19:41:52.971648+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:32.125490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:32.125490+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010928068000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":277,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.970900+0000","last_change":"2021-10-08T19:38:51.158307+0000","last_active":"2021-10-08T19:41:52.970900+0000","last_peered":"2021-10-08T19:41:52.970900+0000","last_clean":"2021-10-08T19:41:52.970900+0000","last_became_active":"2021-10-08T19:29:40.645111+0000","last_became_peered":"2021-10-08T19:29:40.645111+0000","last_unstale":"2021-10-08T19:41:52.970900+0000","last_undegraded":"2021-10-08T19:41:52.970900+0000","last_fullsized":"2021-10-08T19:41:52.970900+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:51.158228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:38:51.158228+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020157690000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":477,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.973815+0000","last_change":"2021-10-08T19:40:02.108048+0000","last_active":"2021-10-08T19:41:52.973815+0000","last_peered":"2021-10-08T19:41:52.973815+0000","last_clean":"2021-10-08T19:41:52.973815+0000","last_became_active":"2021-10-08T19:21:29.640674+0000","last_became_peered":"2021-10-08T19:21:29.640674+0000","last_unstale":"2021-10-08T19:41:52.973815+0000","last_undegraded":"2021-10-08T19:41:52.973815+0000","last_fullsized":"2021-10-08T19:41:52.973815+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:02.107943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:40:02.107943+0000","last_clean_scrub_stamp":"2021-10-08T19:40:02.107943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0082285750000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":398,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.979924+0000","last_change":"2021-10-08T19:40:47.809293+0000","last_active":"2021-10-08T19:41:52.979924+0000","last_peered":"2021-10-08T19:41:52.979924+0000","last_clean":"2021-10-08T19:41:52.979924+0000","last_became_active":"2021-10-08T19:25:15.501118+0000","last_became_peered":"2021-10-08T19:25:15.501118+0000","last_unstale":"2021-10-08T19:41:52.979924+0000","last_undegraded":"2021-10-08T19:41:52.979924+0000","last_fullsized":"2021-10-08T19:41:52.979924+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:47.809188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:47.809188+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0032071320000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"482'18","reported_seq":309,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.970747+0000","last_change":"2021-10-08T19:39:58.261469+0000","last_active":"2021-10-08T19:41:52.970747+0000","last_peered":"2021-10-08T19:41:52.970747+0000","last_clean":"2021-10-08T19:41:52.970747+0000","last_became_active":"2021-10-08T19:29:40.644657+0000","last_became_peered":"2021-10-08T19:29:40.644657+0000","last_unstale":"2021-10-08T19:41:52.970747+0000","last_undegraded":"2021-10-08T19:41:52.970747+0000","last_fullsized":"2021-10-08T19:41:52.970747+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'12","last_scrub_stamp":"2021-10-08T19:39:58.261366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:39:58.261366+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0074846620000000004,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":27,"num_read_kb":24,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":439,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.979471+0000","last_change":"2021-10-08T19:39:28.422329+0000","last_active":"2021-10-08T19:41:52.979471+0000","last_peered":"2021-10-08T19:41:52.979471+0000","last_clean":"2021-10-08T19:41:52.979471+0000","last_became_active":"2021-10-08T19:28:40.101898+0000","last_became_peered":"2021-10-08T19:28:40.101898+0000","last_unstale":"2021-10-08T19:41:52.979471+0000","last_undegraded":"2021-10-08T19:41:52.979471+0000","last_fullsized":"2021-10-08T19:41:52.979471+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:28.422254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:16.444582+0000","last_clean_scrub_stamp":"2021-10-08T19:39:28.422254+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0087056440000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":334,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.970250+0000","last_change":"2021-10-08T19:41:31.321283+0000","last_active":"2021-10-08T19:41:52.970250+0000","last_peered":"2021-10-08T19:41:52.970250+0000","last_clean":"2021-10-08T19:41:52.970250+0000","last_became_active":"2021-10-08T19:37:19.011117+0000","last_became_peered":"2021-10-08T19:37:19.011117+0000","last_unstale":"2021-10-08T19:41:52.970250+0000","last_undegraded":"2021-10-08T19:41:52.970250+0000","last_fullsized":"2021-10-08T19:41:52.970250+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:41:31.321173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:41:31.321173+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013768213,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":489,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.982493+0000","last_change":"2021-10-08T19:40:51.961161+0000","last_active":"2021-10-08T19:41:52.982493+0000","last_peered":"2021-10-08T19:41:52.982493+0000","last_clean":"2021-10-08T19:41:52.982493+0000","last_became_active":"2021-10-08T19:24:25.099371+0000","last_became_peered":"2021-10-08T19:24:25.099371+0000","last_unstale":"2021-10-08T19:41:52.982493+0000","last_undegraded":"2021-10-08T19:41:52.982493+0000","last_fullsized":"2021-10-08T19:41:52.982493+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:51.961084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:40:51.961084+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.038885474000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"70'5","reported_seq":676,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.977538+0000","last_change":"2021-10-08T19:41:21.872950+0000","last_active":"2021-10-08T19:41:52.977538+0000","last_peered":"2021-10-08T19:41:52.977538+0000","last_clean":"2021-10-08T19:41:52.977538+0000","last_became_active":"2021-10-08T19:31:22.785193+0000","last_became_peered":"2021-10-08T19:31:22.785193+0000","last_unstale":"2021-10-08T19:41:52.977538+0000","last_undegraded":"2021-10-08T19:41:52.977538+0000","last_fullsized":"2021-10-08T19:41:52.977538+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":5,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:41:21.872876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:41:21.872876+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001349397,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"482'30","reported_seq":363,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.969485+0000","last_change":"2021-10-08T19:39:28.248294+0000","last_active":"2021-10-08T19:41:52.969485+0000","last_peered":"2021-10-08T19:41:52.969485+0000","last_clean":"2021-10-08T19:41:52.969485+0000","last_became_active":"2021-10-08T19:31:51.677055+0000","last_became_peered":"2021-10-08T19:31:51.677055+0000","last_unstale":"2021-10-08T19:41:52.969485+0000","last_undegraded":"2021-10-08T19:41:52.969485+0000","last_fullsized":"2021-10-08T19:41:52.969485+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'20","last_scrub_stamp":"2021-10-08T19:39:28.248174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:39:28.248174+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012648767999999999,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":39,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":54,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.968192+0000","last_change":"2021-10-08T19:40:39.787067+0000","last_active":"2021-10-08T19:41:52.968192+0000","last_peered":"2021-10-08T19:41:52.968192+0000","last_clean":"2021-10-08T19:41:52.968192+0000","last_became_active":"2021-10-08T19:39:39.136801+0000","last_became_peered":"2021-10-08T19:39:39.136801+0000","last_unstale":"2021-10-08T19:41:52.968192+0000","last_undegraded":"2021-10-08T19:41:52.968192+0000","last_fullsized":"2021-10-08T19:41:52.968192+0000","mapping_epoch":448,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":449,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:39.786960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:39.786960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011731676999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,2],"acting":[4,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"398'12","reported_seq":636,"reported_epoch":487,"state":"active+clean","last_fresh":"2021-10-08T19:42:01.976811+0000","last_change":"2021-10-08T19:39:58.937602+0000","last_active":"2021-10-08T19:42:01.976811+0000","last_peered":"2021-10-08T19:42:01.976811+0000","last_clean":"2021-10-08T19:42:01.976811+0000","last_became_active":"2021-10-08T19:37:19.015189+0000","last_became_peered":"2021-10-08T19:37:19.015189+0000","last_unstale":"2021-10-08T19:42:01.976811+0000","last_undegraded":"2021-10-08T19:42:01.976811+0000","last_fullsized":"2021-10-08T19:42:01.976811+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"398'12","last_scrub_stamp":"2021-10-08T19:39:58.937499+0000","last_deep_scrub":"328'11","last_deep_scrub_stamp":"2021-10-08T19:33:32.545870+0000","last_clean_scrub_stamp":"2021-10-08T19:39:58.937499+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012203161000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":485,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.984931+0000","last_change":"2021-10-08T19:40:11.028411+0000","last_active":"2021-10-08T19:41:52.984931+0000","last_peered":"2021-10-08T19:41:52.984931+0000","last_clean":"2021-10-08T19:41:52.984931+0000","last_became_active":"2021-10-08T19:29:40.644819+0000","last_became_peered":"2021-10-08T19:29:40.644819+0000","last_unstale":"2021-10-08T19:41:52.984931+0000","last_undegraded":"2021-10-08T19:41:52.984931+0000","last_fullsized":"2021-10-08T19:41:52.984931+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:11.028298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:40:11.028298+0000","last_clean_scrub_stamp":"2021-10-08T19:40:11.028298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.053608935000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":394,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.980636+0000","last_change":"2021-10-08T19:40:04.898401+0000","last_active":"2021-10-08T19:41:52.980636+0000","last_peered":"2021-10-08T19:41:52.980636+0000","last_clean":"2021-10-08T19:41:52.980636+0000","last_became_active":"2021-10-08T19:25:15.498770+0000","last_became_peered":"2021-10-08T19:25:15.498770+0000","last_unstale":"2021-10-08T19:41:52.980636+0000","last_undegraded":"2021-10-08T19:41:52.980636+0000","last_fullsized":"2021-10-08T19:41:52.980636+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:04.898293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:04.898293+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010628007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"482'21","reported_seq":148,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.982821+0000","last_change":"2021-10-08T19:39:32.769018+0000","last_active":"2021-10-08T19:41:52.982821+0000","last_peered":"2021-10-08T19:41:52.982821+0000","last_clean":"2021-10-08T19:41:52.982821+0000","last_became_active":"2021-10-08T19:37:19.007551+0000","last_became_peered":"2021-10-08T19:37:19.007551+0000","last_unstale":"2021-10-08T19:41:52.982821+0000","last_undegraded":"2021-10-08T19:41:52.982821+0000","last_fullsized":"2021-10-08T19:41:52.982821+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'15","last_scrub_stamp":"2021-10-08T19:39:32.768897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:39:32.768897+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0067183929999999996,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":28,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":503,"reported_epoch":487,"state":"active+clean","last_fresh":"2021-10-08T19:42:03.275242+0000","last_change":"2021-10-08T19:42:03.275207+0000","last_active":"2021-10-08T19:42:03.275242+0000","last_peered":"2021-10-08T19:42:03.275242+0000","last_clean":"2021-10-08T19:42:03.275242+0000","last_became_active":"2021-10-08T19:29:44.439397+0000","last_became_peered":"2021-10-08T19:29:44.439397+0000","last_unstale":"2021-10-08T19:42:03.275242+0000","last_undegraded":"2021-10-08T19:42:03.275242+0000","last_fullsized":"2021-10-08T19:42:03.275242+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:42:03.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:42:03.275108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.005851607,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"413'11","reported_seq":433,"reported_epoch":487,"state":"active+clean","last_fresh":"2021-10-08T19:42:01.978665+0000","last_change":"2021-10-08T19:41:26.272792+0000","last_active":"2021-10-08T19:42:01.978665+0000","last_peered":"2021-10-08T19:42:01.978665+0000","last_clean":"2021-10-08T19:42:01.978665+0000","last_became_active":"2021-10-08T19:29:40.637650+0000","last_became_peered":"2021-10-08T19:29:40.637650+0000","last_unstale":"2021-10-08T19:42:01.978665+0000","last_undegraded":"2021-10-08T19:42:01.978665+0000","last_fullsized":"2021-10-08T19:42:01.978665+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"413'11","last_scrub_stamp":"2021-10-08T19:37:59.373882+0000","last_deep_scrub":"413'11","last_deep_scrub_stamp":"2021-10-08T19:37:59.373882+0000","last_clean_scrub_stamp":"2021-10-08T19:37:59.373882+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0097897460000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":464,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.970036+0000","last_change":"2021-10-08T19:40:09.484050+0000","last_active":"2021-10-08T19:41:52.970036+0000","last_peered":"2021-10-08T19:41:52.970036+0000","last_clean":"2021-10-08T19:41:52.970036+0000","last_became_active":"2021-10-08T19:21:29.640302+0000","last_became_peered":"2021-10-08T19:21:29.640302+0000","last_unstale":"2021-10-08T19:41:52.970036+0000","last_undegraded":"2021-10-08T19:41:52.970036+0000","last_fullsized":"2021-10-08T19:41:52.970036+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:09.483932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:40:09.483932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.14512376099999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":406,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.981638+0000","last_change":"2021-10-08T19:39:22.092570+0000","last_active":"2021-10-08T19:41:52.981638+0000","last_peered":"2021-10-08T19:41:52.981638+0000","last_clean":"2021-10-08T19:41:52.981638+0000","last_became_active":"2021-10-08T19:29:40.631374+0000","last_became_peered":"2021-10-08T19:29:40.631374+0000","last_unstale":"2021-10-08T19:41:52.981638+0000","last_undegraded":"2021-10-08T19:41:52.981638+0000","last_fullsized":"2021-10-08T19:41:52.981638+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:22.092466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:22.092466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0027849989999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":414,"reported_epoch":487,"state":"active+clean","last_fresh":"2021-10-08T19:42:03.910002+0000","last_change":"2021-10-08T19:42:03.909963+0000","last_active":"2021-10-08T19:42:03.910002+0000","last_peered":"2021-10-08T19:42:03.910002+0000","last_clean":"2021-10-08T19:42:03.910002+0000","last_became_active":"2021-10-08T19:29:40.652966+0000","last_became_peered":"2021-10-08T19:29:40.652966+0000","last_unstale":"2021-10-08T19:42:03.910002+0000","last_undegraded":"2021-10-08T19:42:03.910002+0000","last_fullsized":"2021-10-08T19:42:03.910002+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:42:03.909859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:08.748947+0000","last_clean_scrub_stamp":"2021-10-08T19:42:03.909859+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040728739999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"482'25","reported_seq":240,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.977424+0000","last_change":"2021-10-08T19:39:59.953175+0000","last_active":"2021-10-08T19:41:52.977424+0000","last_peered":"2021-10-08T19:41:52.977424+0000","last_clean":"2021-10-08T19:41:52.977424+0000","last_became_active":"2021-10-08T19:31:51.676961+0000","last_became_peered":"2021-10-08T19:31:51.676961+0000","last_unstale":"2021-10-08T19:41:52.977424+0000","last_undegraded":"2021-10-08T19:41:52.977424+0000","last_fullsized":"2021-10-08T19:41:52.977424+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:39:59.953049+0000","last_deep_scrub":"289'19","last_deep_scrub_stamp":"2021-10-08T19:32:46.539792+0000","last_clean_scrub_stamp":"2021-10-08T19:39:59.953049+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0047403150000000002,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":28,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":455,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.979818+0000","last_change":"2021-10-08T19:39:16.255115+0000","last_active":"2021-10-08T19:41:52.979818+0000","last_peered":"2021-10-08T19:41:52.979818+0000","last_clean":"2021-10-08T19:41:52.979818+0000","last_became_active":"2021-10-08T19:31:22.786651+0000","last_became_peered":"2021-10-08T19:31:22.786651+0000","last_unstale":"2021-10-08T19:41:52.979818+0000","last_undegraded":"2021-10-08T19:41:52.979818+0000","last_fullsized":"2021-10-08T19:41:52.979818+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:16.255018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:16.255018+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034406480000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":281,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.969544+0000","last_change":"2021-10-08T19:41:33.278706+0000","last_active":"2021-10-08T19:41:52.969544+0000","last_peered":"2021-10-08T19:41:52.969544+0000","last_clean":"2021-10-08T19:41:52.969544+0000","last_became_active":"2021-10-08T19:29:40.644770+0000","last_became_peered":"2021-10-08T19:29:40.644770+0000","last_unstale":"2021-10-08T19:41:52.969544+0000","last_undegraded":"2021-10-08T19:41:52.969544+0000","last_fullsized":"2021-10-08T19:41:52.969544+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:06.367259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:06.367259+0000","last_clean_scrub_stamp":"2021-10-08T19:38:06.367259+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010215291,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":487,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.979260+0000","last_change":"2021-10-08T19:39:56.867112+0000","last_active":"2021-10-08T19:41:52.979260+0000","last_peered":"2021-10-08T19:41:52.979260+0000","last_clean":"2021-10-08T19:41:52.979260+0000","last_became_active":"2021-10-08T19:28:40.133744+0000","last_became_peered":"2021-10-08T19:28:40.133744+0000","last_unstale":"2021-10-08T19:41:52.979260+0000","last_undegraded":"2021-10-08T19:41:52.979260+0000","last_fullsized":"2021-10-08T19:41:52.979260+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:56.866997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:56.866997+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.058090835,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"482'27","reported_seq":630,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.969067+0000","last_change":"2021-10-08T19:39:17.052667+0000","last_active":"2021-10-08T19:41:52.969067+0000","last_peered":"2021-10-08T19:41:52.969067+0000","last_clean":"2021-10-08T19:41:52.969067+0000","last_became_active":"2021-10-08T19:28:40.100196+0000","last_became_peered":"2021-10-08T19:28:40.100196+0000","last_unstale":"2021-10-08T19:41:52.969067+0000","last_undegraded":"2021-10-08T19:41:52.969067+0000","last_fullsized":"2021-10-08T19:41:52.969067+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:39:17.052565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:39:17.052565+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0059573320000000001,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":325,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.978000+0000","last_change":"2021-10-08T19:40:03.951140+0000","last_active":"2021-10-08T19:41:52.978000+0000","last_peered":"2021-10-08T19:41:52.978000+0000","last_clean":"2021-10-08T19:41:52.978000+0000","last_became_active":"2021-10-08T19:28:40.146673+0000","last_became_peered":"2021-10-08T19:28:40.146673+0000","last_unstale":"2021-10-08T19:41:52.978000+0000","last_undegraded":"2021-10-08T19:41:52.978000+0000","last_fullsized":"2021-10-08T19:41:52.978000+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:03.950996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:09.610637+0000","last_clean_scrub_stamp":"2021-10-08T19:40:03.950996+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.021277893999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":335,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.977606+0000","last_change":"2021-10-08T19:39:54.862550+0000","last_active":"2021-10-08T19:41:52.977606+0000","last_peered":"2021-10-08T19:41:52.977606+0000","last_clean":"2021-10-08T19:41:52.977606+0000","last_became_active":"2021-10-08T19:29:40.638536+0000","last_became_peered":"2021-10-08T19:29:40.638536+0000","last_unstale":"2021-10-08T19:41:52.977606+0000","last_undegraded":"2021-10-08T19:41:52.977606+0000","last_fullsized":"2021-10-08T19:41:52.977606+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:54.862426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:43.186684+0000","last_clean_scrub_stamp":"2021-10-08T19:39:54.862426+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014441246,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":277,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.969323+0000","last_change":"2021-10-08T19:38:47.187888+0000","last_active":"2021-10-08T19:41:52.969323+0000","last_peered":"2021-10-08T19:41:52.969323+0000","last_clean":"2021-10-08T19:41:52.969323+0000","last_became_active":"2021-10-08T19:29:40.634300+0000","last_became_peered":"2021-10-08T19:29:40.634300+0000","last_unstale":"2021-10-08T19:41:52.969323+0000","last_undegraded":"2021-10-08T19:41:52.969323+0000","last_fullsized":"2021-10-08T19:41:52.969323+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:47.187765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:47.187765+0000","last_clean_scrub_stamp":"2021-10-08T19:38:47.187765+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013817288,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"70'5","reported_seq":394,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.969470+0000","last_change":"2021-10-08T19:40:47.760720+0000","last_active":"2021-10-08T19:41:52.969470+0000","last_peered":"2021-10-08T19:41:52.969470+0000","last_clean":"2021-10-08T19:41:52.969470+0000","last_became_active":"2021-10-08T19:25:15.496309+0000","last_became_peered":"2021-10-08T19:25:15.496309+0000","last_unstale":"2021-10-08T19:41:52.969470+0000","last_undegraded":"2021-10-08T19:41:52.969470+0000","last_fullsized":"2021-10-08T19:41:52.969470+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:40:47.760595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:47.760595+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0059370550000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.10","version":"482'12","reported_seq":312,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.969760+0000","last_change":"2021-10-08T19:39:59.311631+0000","last_active":"2021-10-08T19:41:52.969760+0000","last_peered":"2021-10-08T19:41:52.969760+0000","last_clean":"2021-10-08T19:41:52.969760+0000","last_became_active":"2021-10-08T19:32:45.165103+0000","last_became_peered":"2021-10-08T19:32:45.165103+0000","last_unstale":"2021-10-08T19:41:52.969760+0000","last_undegraded":"2021-10-08T19:41:52.969760+0000","last_fullsized":"2021-10-08T19:41:52.969760+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'8","last_scrub_stamp":"2021-10-08T19:39:59.311531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:39:59.311531+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013231531,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":16,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":194,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.981594+0000","last_change":"2021-10-08T19:39:53.941356+0000","last_active":"2021-10-08T19:41:52.981594+0000","last_peered":"2021-10-08T19:41:52.981594+0000","last_clean":"2021-10-08T19:41:52.981594+0000","last_became_active":"2021-10-08T19:37:19.009349+0000","last_became_peered":"2021-10-08T19:37:19.009349+0000","last_unstale":"2021-10-08T19:41:52.981594+0000","last_undegraded":"2021-10-08T19:41:52.981594+0000","last_fullsized":"2021-10-08T19:41:52.981594+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:53.941264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:13.716331+0000","last_clean_scrub_stamp":"2021-10-08T19:39:53.941264+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0037200029999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":430,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.979503+0000","last_change":"2021-10-08T19:40:08.939758+0000","last_active":"2021-10-08T19:41:52.979503+0000","last_peered":"2021-10-08T19:41:52.979503+0000","last_clean":"2021-10-08T19:41:52.979503+0000","last_became_active":"2021-10-08T19:24:25.106186+0000","last_became_peered":"2021-10-08T19:24:25.106186+0000","last_unstale":"2021-10-08T19:41:52.979503+0000","last_undegraded":"2021-10-08T19:41:52.979503+0000","last_fullsized":"2021-10-08T19:41:52.979503+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:08.939657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:18.377739+0000","last_clean_scrub_stamp":"2021-10-08T19:40:08.939657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014123263,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":467,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.980546+0000","last_change":"2021-10-08T19:39:23.706599+0000","last_active":"2021-10-08T19:41:52.980546+0000","last_peered":"2021-10-08T19:41:52.980546+0000","last_clean":"2021-10-08T19:41:52.980546+0000","last_became_active":"2021-10-08T19:21:29.642835+0000","last_became_peered":"2021-10-08T19:21:29.642835+0000","last_unstale":"2021-10-08T19:41:52.980546+0000","last_undegraded":"2021-10-08T19:41:52.980546+0000","last_fullsized":"2021-10-08T19:41:52.980546+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:23.706498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:23.706498+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0056310429999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":422,"reported_epoch":487,"state":"active+clean","last_fresh":"2021-10-08T19:42:07.640420+0000","last_change":"2021-10-08T19:42:07.640381+0000","last_active":"2021-10-08T19:42:07.640420+0000","last_peered":"2021-10-08T19:42:07.640420+0000","last_clean":"2021-10-08T19:42:07.640420+0000","last_became_active":"2021-10-08T19:28:40.099215+0000","last_became_peered":"2021-10-08T19:28:40.099215+0000","last_unstale":"2021-10-08T19:42:07.640420+0000","last_undegraded":"2021-10-08T19:42:07.640420+0000","last_fullsized":"2021-10-08T19:42:07.640420+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:42:07.640278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:42:07.640278+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.006052394,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"482'32","reported_seq":324,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.969236+0000","last_change":"2021-10-08T19:41:32.306237+0000","last_active":"2021-10-08T19:41:52.969236+0000","last_peered":"2021-10-08T19:41:52.969236+0000","last_clean":"2021-10-08T19:41:52.969236+0000","last_became_active":"2021-10-08T19:29:40.640914+0000","last_became_peered":"2021-10-08T19:29:40.640914+0000","last_unstale":"2021-10-08T19:41:52.969236+0000","last_undegraded":"2021-10-08T19:41:52.969236+0000","last_fullsized":"2021-10-08T19:41:52.969236+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"348'24","last_scrub_stamp":"2021-10-08T19:41:32.306126+0000","last_deep_scrub":"348'24","last_deep_scrub_stamp":"2021-10-08T19:34:53.274250+0000","last_clean_scrub_stamp":"2021-10-08T19:41:32.306126+0000","log_size":32,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0048356969999999999,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":36,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":421,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.981049+0000","last_change":"2021-10-08T19:39:30.445681+0000","last_active":"2021-10-08T19:41:52.981049+0000","last_peered":"2021-10-08T19:41:52.981049+0000","last_clean":"2021-10-08T19:41:52.981049+0000","last_became_active":"2021-10-08T19:24:25.098128+0000","last_became_peered":"2021-10-08T19:24:25.098128+0000","last_unstale":"2021-10-08T19:41:52.981049+0000","last_undegraded":"2021-10-08T19:41:52.981049+0000","last_fullsized":"2021-10-08T19:41:52.981049+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:30.445595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:34.508558+0000","last_clean_scrub_stamp":"2021-10-08T19:39:30.445595+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0050654009999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":487,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.979653+0000","last_change":"2021-10-08T19:41:25.077211+0000","last_active":"2021-10-08T19:41:52.979653+0000","last_peered":"2021-10-08T19:41:52.979653+0000","last_clean":"2021-10-08T19:41:52.979653+0000","last_became_active":"2021-10-08T19:24:25.095490+0000","last_became_peered":"2021-10-08T19:24:25.095490+0000","last_unstale":"2021-10-08T19:41:52.979653+0000","last_undegraded":"2021-10-08T19:41:52.979653+0000","last_fullsized":"2021-10-08T19:41:52.979653+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:41:25.077109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:11.383779+0000","last_clean_scrub_stamp":"2021-10-08T19:41:25.077109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014373943,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":285,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.969516+0000","last_change":"2021-10-08T19:41:16.517571+0000","last_active":"2021-10-08T19:41:52.969516+0000","last_peered":"2021-10-08T19:41:52.969516+0000","last_clean":"2021-10-08T19:41:52.969516+0000","last_became_active":"2021-10-08T19:29:40.639358+0000","last_became_peered":"2021-10-08T19:29:40.639358+0000","last_unstale":"2021-10-08T19:41:52.969516+0000","last_undegraded":"2021-10-08T19:41:52.969516+0000","last_fullsized":"2021-10-08T19:41:52.969516+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:41:16.517497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:36:12.821316+0000","last_clean_scrub_stamp":"2021-10-08T19:41:16.517497+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.133669077,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"482'30","reported_seq":566,"reported_epoch":487,"state":"active+clean","last_fresh":"2021-10-08T19:42:02.319374+0000","last_change":"2021-10-08T19:42:02.319322+0000","last_active":"2021-10-08T19:42:02.319374+0000","last_peered":"2021-10-08T19:42:02.319374+0000","last_clean":"2021-10-08T19:42:02.319374+0000","last_became_active":"2021-10-08T19:29:40.636448+0000","last_became_peered":"2021-10-08T19:29:40.636448+0000","last_unstale":"2021-10-08T19:42:02.319374+0000","last_undegraded":"2021-10-08T19:42:02.319374+0000","last_fullsized":"2021-10-08T19:42:02.319374+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'30","last_scrub_stamp":"2021-10-08T19:42:02.319197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:42:02.319197+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0069278409999999997,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":40,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":482,"reported_epoch":487,"state":"active+clean","last_fresh":"2021-10-08T19:42:04.574969+0000","last_change":"2021-10-08T19:42:04.574933+0000","last_active":"2021-10-08T19:42:04.574969+0000","last_peered":"2021-10-08T19:42:04.574969+0000","last_clean":"2021-10-08T19:42:04.574969+0000","last_became_active":"2021-10-08T19:21:23.604530+0000","last_became_peered":"2021-10-08T19:21:23.604530+0000","last_unstale":"2021-10-08T19:42:04.574969+0000","last_undegraded":"2021-10-08T19:42:04.574969+0000","last_fullsized":"2021-10-08T19:42:04.574969+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:42:04.574849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:42:04.574849+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.006377878,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1f","version":"114'10","reported_seq":636,"reported_epoch":487,"state":"active+clean","last_fresh":"2021-10-08T19:42:07.025933+0000","last_change":"2021-10-08T19:42:07.025894+0000","last_active":"2021-10-08T19:42:07.025933+0000","last_peered":"2021-10-08T19:42:07.025933+0000","last_clean":"2021-10-08T19:42:07.025933+0000","last_became_active":"2021-10-08T19:24:25.105742+0000","last_became_peered":"2021-10-08T19:24:25.105742+0000","last_unstale":"2021-10-08T19:42:07.025933+0000","last_undegraded":"2021-10-08T19:42:07.025933+0000","last_fullsized":"2021-10-08T19:42:07.025933+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'10","last_scrub_stamp":"2021-10-08T19:42:07.025820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:42:07.025820+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0085062360000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"69'1","reported_seq":466,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.983510+0000","last_change":"2021-10-08T19:40:02.876774+0000","last_active":"2021-10-08T19:41:52.983510+0000","last_peered":"2021-10-08T19:41:52.983510+0000","last_clean":"2021-10-08T19:41:52.983510+0000","last_became_active":"2021-10-08T19:21:29.640296+0000","last_became_peered":"2021-10-08T19:21:29.640296+0000","last_unstale":"2021-10-08T19:41:52.983510+0000","last_undegraded":"2021-10-08T19:41:52.983510+0000","last_fullsized":"2021-10-08T19:41:52.983510+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2021-10-08T19:40:02.876665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:40:02.876665+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011383189,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"482'32","reported_seq":502,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.981411+0000","last_change":"2021-10-08T19:39:33.440040+0000","last_active":"2021-10-08T19:41:52.981411+0000","last_peered":"2021-10-08T19:41:52.981411+0000","last_clean":"2021-10-08T19:41:52.981411+0000","last_became_active":"2021-10-08T19:28:40.126425+0000","last_became_peered":"2021-10-08T19:28:40.126425+0000","last_unstale":"2021-10-08T19:41:52.981411+0000","last_undegraded":"2021-10-08T19:41:52.981411+0000","last_fullsized":"2021-10-08T19:41:52.981411+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"390'24","last_scrub_stamp":"2021-10-08T19:39:33.439960+0000","last_deep_scrub":"390'24","last_deep_scrub_stamp":"2021-10-08T19:39:33.439960+0000","last_clean_scrub_stamp":"2021-10-08T19:39:33.439960+0000","log_size":32,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.030901436000000001,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":36,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":283,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.969072+0000","last_change":"2021-10-08T19:41:25.305455+0000","last_active":"2021-10-08T19:41:52.969072+0000","last_peered":"2021-10-08T19:41:52.969072+0000","last_clean":"2021-10-08T19:41:52.969072+0000","last_became_active":"2021-10-08T19:29:40.640952+0000","last_became_peered":"2021-10-08T19:29:40.640952+0000","last_unstale":"2021-10-08T19:41:52.969072+0000","last_undegraded":"2021-10-08T19:41:52.969072+0000","last_fullsized":"2021-10-08T19:41:52.969072+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:41:25.305353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:41:25.305353+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0059384679999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":473,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.985404+0000","last_change":"2021-10-08T19:40:32.036952+0000","last_active":"2021-10-08T19:41:52.985404+0000","last_peered":"2021-10-08T19:41:52.985404+0000","last_clean":"2021-10-08T19:41:52.985404+0000","last_became_active":"2021-10-08T19:21:27.632648+0000","last_became_peered":"2021-10-08T19:21:27.632648+0000","last_unstale":"2021-10-08T19:41:52.985404+0000","last_undegraded":"2021-10-08T19:41:52.985404+0000","last_fullsized":"2021-10-08T19:41:52.985404+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:32.036833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:51.997511+0000","last_clean_scrub_stamp":"2021-10-08T19:40:32.036833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0082112660000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"69'1","reported_seq":321,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.978081+0000","last_change":"2021-10-08T19:40:38.358403+0000","last_active":"2021-10-08T19:41:52.978081+0000","last_peered":"2021-10-08T19:41:52.978081+0000","last_clean":"2021-10-08T19:41:52.978081+0000","last_became_active":"2021-10-08T19:28:40.146302+0000","last_became_peered":"2021-10-08T19:28:40.146302+0000","last_unstale":"2021-10-08T19:41:52.978081+0000","last_undegraded":"2021-10-08T19:41:52.978081+0000","last_fullsized":"2021-10-08T19:41:52.978081+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2021-10-08T19:40:38.358284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:40:38.358284+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.17503824100000001,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"482'39","reported_seq":673,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.974374+0000","last_change":"2021-10-08T19:41:30.037151+0000","last_active":"2021-10-08T19:41:52.974374+0000","last_peered":"2021-10-08T19:41:52.974374+0000","last_clean":"2021-10-08T19:41:52.974374+0000","last_became_active":"2021-10-08T19:29:40.629461+0000","last_became_peered":"2021-10-08T19:29:40.629461+0000","last_unstale":"2021-10-08T19:41:52.974374+0000","last_undegraded":"2021-10-08T19:41:52.974374+0000","last_fullsized":"2021-10-08T19:41:52.974374+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'27","last_scrub_stamp":"2021-10-08T19:41:30.037032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:41:30.037032+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0057389850000000003,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":62,"num_read_kb":53,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":550,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":427,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.980512+0000","last_change":"2021-10-08T19:40:48.873604+0000","last_active":"2021-10-08T19:41:52.980512+0000","last_peered":"2021-10-08T19:41:52.980512+0000","last_clean":"2021-10-08T19:41:52.980512+0000","last_became_active":"2021-10-08T19:24:25.106119+0000","last_became_peered":"2021-10-08T19:24:25.106119+0000","last_unstale":"2021-10-08T19:41:52.980512+0000","last_undegraded":"2021-10-08T19:41:52.980512+0000","last_fullsized":"2021-10-08T19:41:52.980512+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:48.873507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:46.422866+0000","last_clean_scrub_stamp":"2021-10-08T19:40:48.873507+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0080410519999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":319,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.978171+0000","last_change":"2021-10-08T19:39:56.892383+0000","last_active":"2021-10-08T19:41:52.978171+0000","last_peered":"2021-10-08T19:41:52.978171+0000","last_clean":"2021-10-08T19:41:52.978171+0000","last_became_active":"2021-10-08T19:28:40.148009+0000","last_became_peered":"2021-10-08T19:28:40.148009+0000","last_unstale":"2021-10-08T19:41:52.978171+0000","last_undegraded":"2021-10-08T19:41:52.978171+0000","last_fullsized":"2021-10-08T19:41:52.978171+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:56.892286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:39:56.892286+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.018782119,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":486,"reported_epoch":487,"state":"active+clean","last_fresh":"2021-10-08T19:42:08.049928+0000","last_change":"2021-10-08T19:42:08.049889+0000","last_active":"2021-10-08T19:42:08.049928+0000","last_peered":"2021-10-08T19:42:08.049928+0000","last_clean":"2021-10-08T19:42:08.049928+0000","last_became_active":"2021-10-08T19:24:25.097782+0000","last_became_peered":"2021-10-08T19:24:25.097782+0000","last_unstale":"2021-10-08T19:42:08.049928+0000","last_undegraded":"2021-10-08T19:42:08.049928+0000","last_fullsized":"2021-10-08T19:42:08.049928+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:42:08.049795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:37.219503+0000","last_clean_scrub_stamp":"2021-10-08T19:42:08.049795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0013495639999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"482'24","reported_seq":313,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.972828+0000","last_change":"2021-10-08T19:40:08.385125+0000","last_active":"2021-10-08T19:41:52.972828+0000","last_peered":"2021-10-08T19:41:52.972828+0000","last_clean":"2021-10-08T19:41:52.972828+0000","last_became_active":"2021-10-08T19:29:40.645144+0000","last_became_peered":"2021-10-08T19:29:40.645144+0000","last_unstale":"2021-10-08T19:41:52.972828+0000","last_undegraded":"2021-10-08T19:41:52.972828+0000","last_fullsized":"2021-10-08T19:41:52.972828+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'18","last_scrub_stamp":"2021-10-08T19:40:08.385003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:40:08.385003+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0077571740000000004,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":277,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.969367+0000","last_change":"2021-10-08T19:39:14.212962+0000","last_active":"2021-10-08T19:41:52.969367+0000","last_peered":"2021-10-08T19:41:52.969367+0000","last_clean":"2021-10-08T19:41:52.969367+0000","last_became_active":"2021-10-08T19:29:44.443807+0000","last_became_peered":"2021-10-08T19:29:44.443807+0000","last_unstale":"2021-10-08T19:41:52.969367+0000","last_undegraded":"2021-10-08T19:41:52.969367+0000","last_fullsized":"2021-10-08T19:41:52.969367+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:14.212865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:32.854550+0000","last_clean_scrub_stamp":"2021-10-08T19:39:14.212865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0077559439999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":484,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.969254+0000","last_change":"2021-10-08T19:39:59.439583+0000","last_active":"2021-10-08T19:41:52.969254+0000","last_peered":"2021-10-08T19:41:52.969254+0000","last_clean":"2021-10-08T19:41:52.969254+0000","last_became_active":"2021-10-08T19:29:40.638352+0000","last_became_peered":"2021-10-08T19:29:40.638352+0000","last_unstale":"2021-10-08T19:41:52.969254+0000","last_undegraded":"2021-10-08T19:41:52.969254+0000","last_fullsized":"2021-10-08T19:41:52.969254+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:59.439435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:39:59.439435+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0082132950000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":295,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.970983+0000","last_change":"2021-10-08T19:39:13.413298+0000","last_active":"2021-10-08T19:41:52.970983+0000","last_peered":"2021-10-08T19:41:52.970983+0000","last_clean":"2021-10-08T19:41:52.970983+0000","last_became_active":"2021-10-08T19:31:22.788455+0000","last_became_peered":"2021-10-08T19:31:22.788455+0000","last_unstale":"2021-10-08T19:41:52.970983+0000","last_undegraded":"2021-10-08T19:41:52.970983+0000","last_fullsized":"2021-10-08T19:41:52.970983+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:13.413194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:32:12.549351+0000","last_clean_scrub_stamp":"2021-10-08T19:39:13.413194+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.173684593,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"482'21","reported_seq":542,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.968516+0000","last_change":"2021-10-08T19:40:12.384765+0000","last_active":"2021-10-08T19:41:52.968516+0000","last_peered":"2021-10-08T19:41:52.968516+0000","last_clean":"2021-10-08T19:41:52.968516+0000","last_became_active":"2021-10-08T19:29:40.631689+0000","last_became_peered":"2021-10-08T19:29:40.631689+0000","last_unstale":"2021-10-08T19:41:52.968516+0000","last_undegraded":"2021-10-08T19:41:52.968516+0000","last_fullsized":"2021-10-08T19:41:52.968516+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'15","last_scrub_stamp":"2021-10-08T19:40:12.384664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:40:12.384664+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012045141000000001,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":475,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.983264+0000","last_change":"2021-10-08T19:39:21.657387+0000","last_active":"2021-10-08T19:41:52.983264+0000","last_peered":"2021-10-08T19:41:52.983264+0000","last_clean":"2021-10-08T19:41:52.983264+0000","last_became_active":"2021-10-08T19:21:23.607785+0000","last_became_peered":"2021-10-08T19:21:23.607785+0000","last_unstale":"2021-10-08T19:41:52.983264+0000","last_undegraded":"2021-10-08T19:41:52.983264+0000","last_fullsized":"2021-10-08T19:41:52.983264+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:21.657316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:21.657316+0000","last_clean_scrub_stamp":"2021-10-08T19:39:21.657316+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034173929999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":480,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.984052+0000","last_change":"2021-10-08T19:41:22.721884+0000","last_active":"2021-10-08T19:41:52.984052+0000","last_peered":"2021-10-08T19:41:52.984052+0000","last_clean":"2021-10-08T19:41:52.984052+0000","last_became_active":"2021-10-08T19:21:27.633979+0000","last_became_peered":"2021-10-08T19:21:27.633979+0000","last_unstale":"2021-10-08T19:41:52.984052+0000","last_undegraded":"2021-10-08T19:41:52.984052+0000","last_fullsized":"2021-10-08T19:41:52.984052+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:41:22.721778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:27.586341+0000","last_clean_scrub_stamp":"2021-10-08T19:41:22.721778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0057862390000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":487,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.980879+0000","last_change":"2021-10-08T19:39:33.931173+0000","last_active":"2021-10-08T19:41:52.980879+0000","last_peered":"2021-10-08T19:41:52.980879+0000","last_clean":"2021-10-08T19:41:52.980879+0000","last_became_active":"2021-10-08T19:28:40.159162+0000","last_became_peered":"2021-10-08T19:28:40.159162+0000","last_unstale":"2021-10-08T19:41:52.980879+0000","last_undegraded":"2021-10-08T19:41:52.980879+0000","last_fullsized":"2021-10-08T19:41:52.980879+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:33.931043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:33.931043+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.060666474999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"482'9","reported_seq":561,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.969290+0000","last_change":"2021-10-08T19:39:13.080295+0000","last_active":"2021-10-08T19:41:52.969290+0000","last_peered":"2021-10-08T19:41:52.969290+0000","last_clean":"2021-10-08T19:41:52.969290+0000","last_became_active":"2021-10-08T19:31:51.675189+0000","last_became_peered":"2021-10-08T19:31:51.675189+0000","last_unstale":"2021-10-08T19:41:52.969290+0000","last_undegraded":"2021-10-08T19:41:52.969290+0000","last_fullsized":"2021-10-08T19:41:52.969290+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'7","last_scrub_stamp":"2021-10-08T19:39:13.080199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:39:13.080199+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0050767039999999996,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":13,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":497,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.982745+0000","last_change":"2021-10-08T19:40:40.875610+0000","last_active":"2021-10-08T19:41:52.982745+0000","last_peered":"2021-10-08T19:41:52.982745+0000","last_clean":"2021-10-08T19:41:52.982745+0000","last_became_active":"2021-10-08T19:24:25.096225+0000","last_became_peered":"2021-10-08T19:24:25.096225+0000","last_unstale":"2021-10-08T19:41:52.982745+0000","last_undegraded":"2021-10-08T19:41:52.982745+0000","last_fullsized":"2021-10-08T19:41:52.982745+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:40.875537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:29:40.244757+0000","last_clean_scrub_stamp":"2021-10-08T19:40:40.875537+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011385456,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":489,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.980402+0000","last_change":"2021-10-08T19:39:54.903894+0000","last_active":"2021-10-08T19:41:52.980402+0000","last_peered":"2021-10-08T19:41:52.980402+0000","last_clean":"2021-10-08T19:41:52.980402+0000","last_became_active":"2021-10-08T19:28:40.101187+0000","last_became_peered":"2021-10-08T19:28:40.101187+0000","last_unstale":"2021-10-08T19:41:52.980402+0000","last_undegraded":"2021-10-08T19:41:52.980402+0000","last_fullsized":"2021-10-08T19:41:52.980402+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:54.903790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:11.633739+0000","last_clean_scrub_stamp":"2021-10-08T19:39:54.903790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0066268430000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":330,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.977195+0000","last_change":"2021-10-08T19:40:54.582567+0000","last_active":"2021-10-08T19:41:52.977195+0000","last_peered":"2021-10-08T19:41:52.977195+0000","last_clean":"2021-10-08T19:41:52.977195+0000","last_became_active":"2021-10-08T19:37:19.007583+0000","last_became_peered":"2021-10-08T19:37:19.007583+0000","last_unstale":"2021-10-08T19:41:52.977195+0000","last_undegraded":"2021-10-08T19:41:52.977195+0000","last_fullsized":"2021-10-08T19:41:52.977195+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:54.582461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:40:54.582461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.091027166000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"482'25","reported_seq":622,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.967857+0000","last_change":"2021-10-08T19:40:40.799532+0000","last_active":"2021-10-08T19:41:52.967857+0000","last_peered":"2021-10-08T19:41:52.967857+0000","last_clean":"2021-10-08T19:41:52.967857+0000","last_became_active":"2021-10-08T19:28:40.099770+0000","last_became_peered":"2021-10-08T19:28:40.099770+0000","last_unstale":"2021-10-08T19:41:52.967857+0000","last_undegraded":"2021-10-08T19:41:52.967857+0000","last_fullsized":"2021-10-08T19:41:52.967857+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:40:40.799434+0000","last_deep_scrub":"289'19","last_deep_scrub_stamp":"2021-10-08T19:36:15.167374+0000","last_clean_scrub_stamp":"2021-10-08T19:40:40.799434+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0041259089999999997,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":283,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.970309+0000","last_change":"2021-10-08T19:41:24.255454+0000","last_active":"2021-10-08T19:41:52.970309+0000","last_peered":"2021-10-08T19:41:52.970309+0000","last_clean":"2021-10-08T19:41:52.970309+0000","last_became_active":"2021-10-08T19:29:40.627394+0000","last_became_peered":"2021-10-08T19:29:40.627394+0000","last_unstale":"2021-10-08T19:41:52.970309+0000","last_undegraded":"2021-10-08T19:41:52.970309+0000","last_fullsized":"2021-10-08T19:41:52.970309+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:41:24.255353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:41:24.255353+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0083609789999999993,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":317,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.977391+0000","last_change":"2021-10-08T19:39:24.681886+0000","last_active":"2021-10-08T19:41:52.977391+0000","last_peered":"2021-10-08T19:41:52.977391+0000","last_clean":"2021-10-08T19:41:52.977391+0000","last_became_active":"2021-10-08T19:28:40.145868+0000","last_became_peered":"2021-10-08T19:28:40.145868+0000","last_unstale":"2021-10-08T19:41:52.977391+0000","last_undegraded":"2021-10-08T19:41:52.977391+0000","last_fullsized":"2021-10-08T19:41:52.977391+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:24.681790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:39:24.681790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034071100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":484,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.968430+0000","last_change":"2021-10-08T19:40:50.813705+0000","last_active":"2021-10-08T19:41:52.968430+0000","last_peered":"2021-10-08T19:41:52.968430+0000","last_clean":"2021-10-08T19:41:52.968430+0000","last_became_active":"2021-10-08T19:28:40.099543+0000","last_became_peered":"2021-10-08T19:28:40.099543+0000","last_unstale":"2021-10-08T19:41:52.968430+0000","last_undegraded":"2021-10-08T19:41:52.968430+0000","last_fullsized":"2021-10-08T19:41:52.968430+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:50.813601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:50.032367+0000","last_clean_scrub_stamp":"2021-10-08T19:40:50.813601+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.062705711999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"482'39","reported_seq":329,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.969230+0000","last_change":"2021-10-08T19:38:03.371773+0000","last_active":"2021-10-08T19:41:52.969230+0000","last_peered":"2021-10-08T19:41:52.969230+0000","last_clean":"2021-10-08T19:41:52.969230+0000","last_became_active":"2021-10-08T19:29:40.631002+0000","last_became_peered":"2021-10-08T19:29:40.631002+0000","last_unstale":"2021-10-08T19:41:52.969230+0000","last_undegraded":"2021-10-08T19:41:52.969230+0000","last_fullsized":"2021-10-08T19:41:52.969230+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'27","last_scrub_stamp":"2021-10-08T19:38:03.371690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:38:03.371690+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012656639000000001,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":473,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.985322+0000","last_change":"2021-10-08T19:40:01.981144+0000","last_active":"2021-10-08T19:41:52.985322+0000","last_peered":"2021-10-08T19:41:52.985322+0000","last_clean":"2021-10-08T19:41:52.985322+0000","last_became_active":"2021-10-08T19:21:23.603422+0000","last_became_peered":"2021-10-08T19:21:23.603422+0000","last_unstale":"2021-10-08T19:41:52.985322+0000","last_undegraded":"2021-10-08T19:41:52.985322+0000","last_fullsized":"2021-10-08T19:41:52.985322+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:01.981016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:15.535842+0000","last_clean_scrub_stamp":"2021-10-08T19:40:01.981016+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0019631129999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":504,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.968104+0000","last_change":"2021-10-08T19:39:12.077018+0000","last_active":"2021-10-08T19:41:52.968104+0000","last_peered":"2021-10-08T19:41:52.968104+0000","last_clean":"2021-10-08T19:41:52.968104+0000","last_became_active":"2021-10-08T19:28:40.099286+0000","last_became_peered":"2021-10-08T19:28:40.099286+0000","last_unstale":"2021-10-08T19:41:52.968104+0000","last_undegraded":"2021-10-08T19:41:52.968104+0000","last_fullsized":"2021-10-08T19:41:52.968104+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:12.076904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:31.176160+0000","last_clean_scrub_stamp":"2021-10-08T19:39:12.076904+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.006185444,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":277,"reported_epoch":486,"state":"active+clean","last_fresh":"2021-10-08T19:41:52.969468+0000","last_change":"2021-10-08T19:38:08.397525+0000","last_active":"2021-10-08T19:41:52.969468+0000","last_peered":"2021-10-08T19:41:52.969468+0000","last_clean":"2021-10-08T19:41:52.969468+0000","last_became_active":"2021-10-08T19:29:40.638221+0000","last_became_peered":"2021-10-08T19:29:40.638221+0000","last_unstale":"2021-10-08T19:41:52.969468+0000","last_undegraded":"2021-10-08T19:41:52.969468+0000","last_fullsized":"2021-10-08T19:41:52.969468+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:08.397432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:38:08.397432+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.11831541399999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":16,"stat_sum":{"num_bytes":1528168472,"num_objects":23319,"num_object_clones":0,"num_object_copies":69957,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23319,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":204175,"num_write_kb":7279745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4478611456,"data_stored":4478599240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":67484,"ondisk_log_size":67484,"up":48,"acting":48,"num_store_stats":8},{"poolid":2,"num_pg":42,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":126,"acting":126,"num_store_stats":8},{"poolid":1,"num_pg":11,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1430,"ondisk_log_size":1430,"up":33,"acting":33,"num_store_stats":8},{"poolid":3,"num_pg":23,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":603,"num_read_kb":603,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":778,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":69,"acting":69,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1540,"num_read_kb":1297,"num_write":989,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":520,"num_bytes_recovered":10826,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1020,"ondisk_log_size":1020,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":84,"ondisk_log_size":84,"up":96,"acting":96,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201533,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":879188,"kb_used_data":513292,"kb_used_omap":0,"kb_used_meta":365760,"kb_avail":92865964,"statfs":{"total":95995035648,"available":95094747136,"internally_reserved":0,"allocated":525611008,"data_stored":525226659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":374538240},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,0,1,0,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:41:47 2021","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.488,"15min":1.5009999999999999},"min":{"1min":0.224,"5min":0.223,"15min":0.20100000000000001},"max":{"1min":6.2300000000000004,"5min":13.686,"15min":26.065000000000001},"last":8.952},{"interface":"front","average":{"1min":0.73399999999999999,"5min":1.3009999999999999,"15min":1.5760000000000001},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.20499999999999999},"max":{"1min":2.496,"5min":8.2639999999999993,"15min":25.75},"last":0.41099999999999998}]},{"osd":1,"last update":"Fri Oct 8 19:41:47 2021","interfaces":[{"interface":"back","average":{"1min":6.7750000000000004,"5min":3.7090000000000001,"15min":2.4129999999999998},"min":{"1min":0.25700000000000001,"5min":0.217,"15min":0.19600000000000001},"max":{"1min":95.063000000000002,"5min":95.063000000000002,"15min":95.063000000000002},"last":0.35399999999999998},{"interface":"front","average":{"1min":7.1529999999999996,"5min":2.5550000000000002,"15min":2.1520000000000001},"min":{"1min":0.33400000000000002,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":95.012,"5min":95.012,"15min":95.012},"last":1.645}]},{"osd":2,"last update":"Fri Oct 8 19:41:47 2021","interfaces":[{"interface":"back","average":{"1min":1.6439999999999999,"5min":2.4860000000000002,"15min":1.9119999999999999},"min":{"1min":0.28799999999999998,"5min":0.28000000000000003,"15min":0.255},"max":{"1min":5.3239999999999998,"5min":81.204999999999998,"15min":81.204999999999998},"last":2.6429999999999998},{"interface":"front","average":{"1min":2.089,"5min":2.681,"15min":1.883},"min":{"1min":0.28000000000000003,"5min":0.254,"15min":0.253},"max":{"1min":4.9359999999999999,"5min":81.022000000000006,"15min":81.022000000000006},"last":3.9470000000000001}]},{"osd":3,"last update":"Fri Oct 8 19:41:47 2021","interfaces":[{"interface":"back","average":{"1min":2.0870000000000002,"5min":1.9179999999999999,"15min":2.25},"min":{"1min":0.33000000000000002,"5min":0.28799999999999998,"15min":0.28100000000000003},"max":{"1min":5.6870000000000003,"5min":7.5069999999999997,"15min":72.093999999999994},"last":6.9790000000000001},{"interface":"front","average":{"1min":2.081,"5min":1.9750000000000001,"15min":2.2280000000000002},"min":{"1min":0.28499999999999998,"5min":0.28299999999999997,"15min":0.28000000000000003},"max":{"1min":9.4809999999999999,"5min":13.872,"15min":71.864999999999995},"last":6.835}]},{"osd":4,"last update":"Fri Oct 8 19:41:47 2021","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.6779999999999999,"15min":1.25},"min":{"1min":0.30599999999999999,"5min":0.254,"15min":0.22800000000000001},"max":{"1min":3.5710000000000002,"5min":55.890999999999998,"15min":55.890999999999998},"last":0.28799999999999998},{"interface":"front","average":{"1min":1.117,"5min":1.7370000000000001,"15min":1.371},"min":{"1min":0.29899999999999999,"5min":0.25900000000000001,"15min":0.254},"max":{"1min":4.9669999999999996,"5min":54.448999999999998,"15min":54.448999999999998},"last":1.337}]},{"osd":5,"last update":"Fri Oct 8 19:41:47 2021","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":1.109,"15min":1.139},"min":{"1min":0.33900000000000002,"5min":0.30299999999999999,"15min":0.26800000000000002},"max":{"1min":3.383,"5min":6.3159999999999998,"15min":9.9280000000000008},"last":0.60999999999999999},{"interface":"front","average":{"1min":1.165,"5min":1.157,"15min":1.252},"min":{"1min":0.32800000000000001,"5min":0.29399999999999998,"15min":0.26100000000000001},"max":{"1min":4.9470000000000001,"5min":6.9850000000000003,"15min":18.655000000000001},"last":1.383}]},{"osd":6,"last update":"Fri Oct 8 19:41:47 2021","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.7629999999999999,"15min":1.419},"min":{"1min":0.35199999999999998,"5min":0.28799999999999998,"15min":0.27900000000000003},"max":{"1min":10.943,"5min":58.039000000000001,"15min":58.039000000000001},"last":0.439},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.867,"15min":1.4059999999999999},"min":{"1min":0.316,"5min":0.30599999999999999,"15min":0.30299999999999999},"max":{"1min":3.5750000000000002,"5min":58.079999999999998,"15min":58.079999999999998},"last":0.67400000000000004}]}]},{"osd":6,"up_from":47,"seq":201863463169,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1081288,"kb_used_data":699776,"kb_used_omap":0,"kb_used_meta":381504,"kb_avail":92663864,"statfs":{"total":95995035648,"available":94887796736,"internally_reserved":0,"allocated":716570624,"data_stored":716197780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":390660096},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,2,2,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:41:24 2021","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.9490000000000001,"15min":1.5660000000000001},"min":{"1min":0.215,"5min":0.188,"15min":0.188},"max":{"1min":3.4780000000000002,"5min":39.262,"15min":39.262},"last":0.51500000000000001},{"interface":"front","average":{"1min":2.4860000000000002,"5min":2.484,"15min":2.2770000000000001},"min":{"1min":0.28399999999999997,"5min":0.215,"15min":0.21299999999999999},"max":{"1min":7.0540000000000003,"5min":39.351999999999997,"15min":69.477000000000004},"last":1.6579999999999999}]},{"osd":1,"last update":"Fri Oct 8 19:41:24 2021","interfaces":[{"interface":"back","average":{"1min":2.9199999999999999,"5min":2.129,"15min":1.5700000000000001},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":26.509,"5min":26.509,"15min":26.509},"last":0.39400000000000002},{"interface":"front","average":{"1min":2.9950000000000001,"5min":2.1190000000000002,"15min":1.5860000000000001},"min":{"1min":0.27300000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":26.599,"5min":26.599,"15min":26.599},"last":0.45600000000000002}]},{"osd":2,"last update":"Fri Oct 8 19:41:24 2021","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":2.7450000000000001,"15min":2.0529999999999999},"min":{"1min":0.28100000000000003,"5min":0.26000000000000001,"15min":0.251},"max":{"1min":3.395,"5min":95.846000000000004,"15min":95.846000000000004},"last":1.478},{"interface":"front","average":{"1min":1.1619999999999999,"5min":2.8130000000000002,"15min":2.3180000000000001},"min":{"1min":0.28699999999999998,"5min":0.252,"15min":0.245},"max":{"1min":3.5350000000000001,"5min":95.683999999999997,"15min":95.683999999999997},"last":1.8859999999999999}]},{"osd":3,"last update":"Fri Oct 8 19:41:24 2021","interfaces":[{"interface":"back","average":{"1min":8.7309999999999999,"5min":4.3479999999999999,"15min":2.593},"min":{"1min":0.28199999999999997,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":125.726,"5min":125.726,"15min":125.726},"last":0.72499999999999998},{"interface":"front","average":{"1min":8.5730000000000004,"5min":4.569,"15min":2.4969999999999999},"min":{"1min":0.32000000000000001,"5min":0.317,"15min":0.29099999999999998},"max":{"1min":125.614,"5min":125.614,"15min":125.614},"last":2.125}]},{"osd":4,"last update":"Fri Oct 8 19:41:24 2021","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.339,"15min":1.181},"min":{"1min":0.26800000000000002,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":3.8250000000000002,"5min":6.4059999999999997,"15min":24.516999999999999},"last":2.569},{"interface":"front","average":{"1min":1.024,"5min":1.581,"15min":1.431},"min":{"1min":0.26500000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":3.8359999999999999,"5min":9.9079999999999995,"15min":69.593999999999994},"last":0.41999999999999998}]},{"osd":5,"last update":"Fri Oct 8 19:41:24 2021","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.6699999999999999,"15min":1.9099999999999999},"min":{"1min":0.27600000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":3.5630000000000002,"5min":13.955,"15min":107.485},"last":1.3080000000000001},{"interface":"front","average":{"1min":1.004,"5min":1.429,"15min":2.129},"min":{"1min":0.33700000000000002,"5min":0.251,"15min":0.251},"max":{"1min":5.9720000000000004,"5min":6.952,"15min":107.90300000000001},"last":1.464}]},{"osd":7,"last update":"Fri Oct 8 19:41:57 2021","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.462,"15min":1.2430000000000001},"min":{"1min":0.33500000000000002,"5min":0.29399999999999998,"15min":0.27800000000000002},"max":{"1min":3.9929999999999999,"5min":6.6790000000000003,"15min":8.8840000000000003},"last":0.48999999999999999},{"interface":"front","average":{"1min":1.149,"5min":1.6040000000000001,"15min":1.4279999999999999},"min":{"1min":0.372,"5min":0.32400000000000001,"15min":0.29899999999999999},"max":{"1min":3.6309999999999998,"5min":8.3740000000000006,"15min":15.962},"last":1.0760000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575123,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1246000,"kb_used_data":804648,"kb_used_omap":0,"kb_used_meta":441088,"kb_avail":92499152,"statfs":{"total":95995035648,"available":94719131648,"internally_reserved":0,"allocated":823959552,"data_stored":823546184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":451674112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,6,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:41:08 2021","interfaces":[{"interface":"back","average":{"1min":2.302,"5min":2.839,"15min":3.194},"min":{"1min":0.221,"5min":0.20100000000000001,"15min":0.188},"max":{"1min":16.417000000000002,"5min":81.459000000000003,"15min":126.256},"last":0.32100000000000001},{"interface":"front","average":{"1min":3.4460000000000002,"5min":3.395,"15min":3.6230000000000002},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.17799999999999999},"max":{"1min":10.917,"5min":81.853999999999999,"15min":126.176},"last":0.35999999999999999}]},{"osd":2,"last update":"Fri Oct 8 19:41:32 2021","interfaces":[{"interface":"back","average":{"1min":2.6120000000000001,"5min":2.0289999999999999,"15min":2.1789999999999998},"min":{"1min":0.25900000000000001,"5min":0.192,"15min":0.192},"max":{"1min":16.460000000000001,"5min":16.460000000000001,"15min":102.395},"last":0.29299999999999998},{"interface":"front","average":{"1min":3.3330000000000002,"5min":2.298,"15min":2.7029999999999998},"min":{"1min":0.314,"5min":0.214,"15min":0.214},"max":{"1min":7.907,"5min":7.907,"15min":102.50700000000001},"last":2.2610000000000001}]},{"osd":3,"last update":"Fri Oct 8 19:41:47 2021","interfaces":[{"interface":"back","average":{"1min":6.5190000000000001,"5min":2.8149999999999999,"15min":2.9300000000000002},"min":{"1min":0.35899999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":33.972000000000001,"5min":33.972000000000001,"15min":105.836},"last":0.45300000000000001},{"interface":"front","average":{"1min":4.4720000000000004,"5min":2.3690000000000002,"15min":2.7069999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.22900000000000001},"max":{"1min":33.880000000000003,"5min":33.880000000000003,"15min":106.12},"last":2.093}]},{"osd":4,"last update":"Fri Oct 8 19:41:52 2021","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.423,"15min":1.893},"min":{"1min":0.29499999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":3.9550000000000001,"5min":6.0659999999999998,"15min":103.538},"last":1.9430000000000001},{"interface":"front","average":{"1min":2.294,"5min":1.7909999999999999,"15min":1.8460000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.254},"max":{"1min":9.7639999999999993,"5min":13.9,"15min":102.67100000000001},"last":1.278}]},{"osd":5,"last update":"Fri Oct 8 19:41:22 2021","interfaces":[{"interface":"back","average":{"1min":2.4710000000000001,"5min":1.855,"15min":3.3250000000000002},"min":{"1min":0.33900000000000002,"5min":0.29899999999999999,"15min":0.27300000000000002},"max":{"1min":7.3170000000000002,"5min":7.3170000000000002,"15min":262.14100000000002},"last":0.54400000000000004},{"interface":"front","average":{"1min":2.2360000000000002,"5min":1.78,"15min":3.0659999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30099999999999999},"max":{"1min":9.7360000000000007,"5min":9.7360000000000007,"15min":261.959},"last":0.495}]},{"osd":6,"last update":"Fri Oct 8 19:41:32 2021","interfaces":[{"interface":"back","average":{"1min":1.752,"5min":1.6899999999999999,"15min":2.0329999999999999},"min":{"1min":0.375,"5min":0.316,"15min":0.316},"max":{"1min":4.4980000000000002,"5min":13.837,"15min":103.73},"last":1.98},{"interface":"front","average":{"1min":2.7029999999999998,"5min":1.885,"15min":2.1920000000000002},"min":{"1min":0.33800000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":7.1040000000000001,"5min":7.3490000000000002,"15min":102.753},"last":0.61099999999999999}]},{"osd":7,"last update":"Fri Oct 8 19:41:52 2021","interfaces":[{"interface":"back","average":{"1min":2.734,"5min":1.956,"15min":2.54},"min":{"1min":0.38100000000000001,"5min":0.35099999999999998,"15min":0.316},"max":{"1min":6.4199999999999999,"5min":7.0979999999999999,"15min":106.011},"last":1.1850000000000001},{"interface":"front","average":{"1min":2.2989999999999999,"5min":1.569,"15min":2.2909999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34200000000000003},"max":{"1min":9.6950000000000003,"5min":9.7720000000000002,"15min":103.78400000000001},"last":4.4470000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738647,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":848720,"kb_used_data":431688,"kb_used_omap":0,"kb_used_meta":417024,"kb_avail":92896432,"statfs":{"total":95995035648,"available":95125946368,"internally_reserved":0,"allocated":442048512,"data_stored":441667083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":427032576},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 8 19:41:10 2021","interfaces":[{"interface":"back","average":{"1min":7.9470000000000001,"5min":3.137,"15min":2.746},"min":{"1min":0.19600000000000001,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":101.68600000000001,"5min":101.68600000000001,"15min":101.68600000000001},"last":6.1619999999999999},{"interface":"front","average":{"1min":8.4179999999999993,"5min":3.1160000000000001,"15min":2.843},"min":{"1min":0.47299999999999998,"5min":0.19900000000000001,"15min":0.19800000000000001},"max":{"1min":101.732,"5min":101.732,"15min":101.732},"last":0.56100000000000005}]},{"osd":2,"last update":"Fri Oct 8 19:41:29 2021","interfaces":[{"interface":"back","average":{"1min":2.0579999999999998,"5min":1.873,"15min":1.925},"min":{"1min":0.23999999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":7.2039999999999997,"5min":9.8030000000000008,"15min":14.307},"last":6.093},{"interface":"front","average":{"1min":2.306,"5min":1.9119999999999999,"15min":1.837},"min":{"1min":0.252,"5min":0.23400000000000001,"15min":0.20000000000000001},"max":{"1min":4.7679999999999998,"5min":10.509,"15min":10.509},"last":4.4699999999999998}]},{"osd":3,"last update":"Fri Oct 8 19:41:47 2021","interfaces":[{"interface":"back","average":{"1min":9.2710000000000008,"5min":3.5680000000000001,"15min":2.734},"min":{"1min":0.26200000000000001,"5min":0.218,"15min":0.217},"max":{"1min":104.744,"5min":104.744,"15min":104.744},"last":6.1269999999999998},{"interface":"front","average":{"1min":8.8610000000000007,"5min":3.2170000000000001,"15min":2.3580000000000001},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":101.94,"5min":101.94,"15min":101.94},"last":4.5039999999999996}]},{"osd":4,"last update":"Fri Oct 8 19:41:10 2021","interfaces":[{"interface":"back","average":{"1min":1.8069999999999999,"5min":1.865,"15min":1.861},"min":{"1min":0.32600000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":7.6349999999999998,"5min":12.135,"15min":16.805},"last":2.8300000000000001},{"interface":"front","average":{"1min":1.5960000000000001,"5min":1.591,"15min":1.554},"min":{"1min":0.28499999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":4.4480000000000004,"5min":7.8339999999999996,"15min":11.823},"last":6.0510000000000002}]},{"osd":5,"last update":"Fri Oct 8 19:41:19 2021","interfaces":[{"interface":"back","average":{"1min":1.9590000000000001,"5min":1.8180000000000001,"15min":1.4890000000000001},"min":{"1min":0.32000000000000001,"5min":0.28199999999999997,"15min":0.27600000000000002},"max":{"1min":5.2140000000000004,"5min":9.9730000000000008,"15min":9.9730000000000008},"last":4.5300000000000002},{"interface":"front","average":{"1min":1.9259999999999999,"5min":2.0939999999999999,"15min":1.903},"min":{"1min":0.38600000000000001,"5min":0.30599999999999999,"15min":0.28599999999999998},"max":{"1min":7.7030000000000003,"5min":12.095000000000001,"15min":15.115},"last":2.8050000000000002}]},{"osd":6,"last update":"Fri Oct 8 19:41:34 2021","interfaces":[{"interface":"back","average":{"1min":1.581,"5min":1.6659999999999999,"15min":1.625},"min":{"1min":0.34799999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":4.4690000000000003,"5min":5.931,"15min":11.869},"last":0.52100000000000002},{"interface":"front","average":{"1min":1.929,"5min":1.986,"15min":1.665},"min":{"1min":0.42299999999999999,"5min":0.32100000000000001,"15min":0.28199999999999997},"max":{"1min":4.601,"5min":10.002000000000001,"15min":10.002000000000001},"last":4.5650000000000004}]},{"osd":7,"last update":"Fri Oct 8 19:41:47 2021","interfaces":[{"interface":"back","average":{"1min":2.02,"5min":2.0409999999999999,"15min":1.9099999999999999},"min":{"1min":0.38900000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":7.6749999999999998,"5min":13.214,"15min":13.214},"last":2.7610000000000001},{"interface":"front","average":{"1min":1.631,"5min":1.635,"15min":1.698},"min":{"1min":0.41999999999999998,"5min":0.315,"15min":0.315},"max":{"1min":5.1200000000000001,"5min":8.7609999999999992,"15min":11.898999999999999},"last":0.58099999999999996}]}]},{"osd":2,"up_from":18,"seq":77309411598,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":997960,"kb_used_data":639040,"kb_used_omap":0,"kb_used_meta":358912,"kb_avail":92747192,"statfs":{"total":95995035648,"available":94973124608,"internally_reserved":0,"allocated":654376960,"data_stored":654004156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":367525888},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,0,0,4,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:41:21 2021","interfaces":[{"interface":"back","average":{"1min":4.9349999999999996,"5min":2.476,"15min":2.2869999999999999},"min":{"1min":0.318,"5min":0.19600000000000001,"15min":0.184},"max":{"1min":50.759999999999998,"5min":50.759999999999998,"15min":60.990000000000002},"last":3.7850000000000001},{"interface":"front","average":{"1min":5.298,"5min":2.399,"15min":2.2730000000000001},"min":{"1min":0.23000000000000001,"5min":0.193,"15min":0.17999999999999999},"max":{"1min":50.899000000000001,"5min":50.899000000000001,"15min":60.850999999999999},"last":0.39000000000000001}]},{"osd":1,"last update":"Fri Oct 8 19:41:21 2021","interfaces":[{"interface":"back","average":{"1min":4.5949999999999998,"5min":2.4119999999999999,"15min":2.7250000000000001},"min":{"1min":0.215,"5min":0.21299999999999999,"15min":0.19700000000000001},"max":{"1min":50.866999999999997,"5min":50.866999999999997,"15min":63.738},"last":0.23899999999999999},{"interface":"front","average":{"1min":5.556,"5min":2.5419999999999998,"15min":2.9049999999999998},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":50.978000000000002,"5min":50.978000000000002,"15min":63.619999999999997},"last":0.35699999999999998}]},{"osd":3,"last update":"Fri Oct 8 19:41:25 2021","interfaces":[{"interface":"back","average":{"1min":7.1420000000000003,"5min":3.6709999999999998,"15min":3.1600000000000001},"min":{"1min":0.217,"5min":0.217,"15min":0.21199999999999999},"max":{"1min":51.036999999999999,"5min":67.198999999999998,"15min":67.198999999999998},"last":1.8180000000000001},{"interface":"front","average":{"1min":6.3070000000000004,"5min":3.4660000000000002,"15min":3.0459999999999998},"min":{"1min":0.443,"5min":0.22900000000000001,"15min":0.21299999999999999},"max":{"1min":52.667999999999999,"5min":66.963999999999999,"15min":66.963999999999999},"last":1.7769999999999999}]},{"osd":4,"last update":"Fri Oct 8 19:41:51 2021","interfaces":[{"interface":"back","average":{"1min":1.8320000000000001,"5min":2.294,"15min":1.8140000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.26900000000000002},"max":{"1min":7.2530000000000001,"5min":52.482999999999997,"15min":52.482999999999997},"last":1.8620000000000001},{"interface":"front","average":{"1min":2.5739999999999998,"5min":2.5600000000000001,"15min":1.897},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.26100000000000001},"max":{"1min":10.981999999999999,"5min":51.015000000000001,"15min":51.015000000000001},"last":0.48599999999999999}]},{"osd":5,"last update":"Fri Oct 8 19:41:21 2021","interfaces":[{"interface":"back","average":{"1min":6.3739999999999997,"5min":2.7040000000000002,"15min":1.9950000000000001},"min":{"1min":0.311,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":52.354999999999997,"5min":52.354999999999997,"15min":52.354999999999997},"last":0.501},{"interface":"front","average":{"1min":4.452,"5min":2.0819999999999999,"15min":1.9119999999999999},"min":{"1min":0.42599999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":51.082999999999998,"5min":51.082999999999998,"15min":51.082999999999998},"last":1.4810000000000001}]},{"osd":6,"last update":"Fri Oct 8 19:41:25 2021","interfaces":[{"interface":"back","average":{"1min":4.9509999999999996,"5min":2.9399999999999999,"15min":2.0219999999999998},"min":{"1min":0.34100000000000003,"5min":0.33800000000000002,"15min":0.28000000000000003},"max":{"1min":52.575000000000003,"5min":55.970999999999997,"15min":55.970999999999997},"last":1.8009999999999999},{"interface":"front","average":{"1min":4.351,"5min":2.7930000000000001,"15min":2.0880000000000001},"min":{"1min":0.51400000000000001,"5min":0.31,"15min":0.31},"max":{"1min":51.064,"5min":56.433,"15min":56.433},"last":1.4359999999999999}]},{"osd":7,"last update":"Fri Oct 8 19:41:51 2021","interfaces":[{"interface":"back","average":{"1min":2.258,"5min":2.363,"15min":2.5030000000000001},"min":{"1min":0.38500000000000001,"5min":0.37,"15min":0.32200000000000001},"max":{"1min":8.7919999999999998,"5min":52.610999999999997,"15min":136.00200000000001},"last":1.895},{"interface":"front","average":{"1min":1.5920000000000001,"5min":2.1619999999999999,"15min":2.4209999999999998},"min":{"1min":0.39400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":6.0830000000000002,"5min":51.100999999999999,"15min":133.26300000000001},"last":1.462}]}]},{"osd":3,"up_from":24,"seq":103079215372,"num_pgs":77,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1198504,"kb_used_data":725024,"kb_used_omap":0,"kb_used_meta":473472,"kb_avail":92546648,"statfs":{"total":95995035648,"available":94767767552,"internally_reserved":0,"allocated":742424576,"data_stored":742019990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":484835328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,5,3,0,0,0,5],"upper_bound":256},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:41:40 2021","interfaces":[{"interface":"back","average":{"1min":8.4160000000000004,"5min":2.98,"15min":2.4740000000000002},"min":{"1min":0.216,"5min":0.187,"15min":0.17100000000000001},"max":{"1min":93.194999999999993,"5min":93.194999999999993,"15min":93.194999999999993},"last":0.54000000000000004},{"interface":"front","average":{"1min":7.2590000000000003,"5min":3.0419999999999998,"15min":2.2959999999999998},"min":{"1min":0.19700000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":96.450999999999993,"5min":96.450999999999993,"15min":96.450999999999993},"last":2.2250000000000001}]},{"osd":1,"last update":"Fri Oct 8 19:41:40 2021","interfaces":[{"interface":"back","average":{"1min":2.7890000000000001,"5min":1.867,"15min":2.0139999999999998},"min":{"1min":0.22800000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":8.6519999999999992,"5min":8.8610000000000007,"15min":37.271999999999998},"last":0.26600000000000001},{"interface":"front","average":{"1min":4.343,"5min":2.3130000000000002,"15min":2.109},"min":{"1min":0.30499999999999999,"5min":0.223,"15min":0.19},"max":{"1min":28.356999999999999,"5min":28.356999999999999,"15min":37.033000000000001},"last":2.2160000000000002}]},{"osd":2,"last update":"Fri Oct 8 19:41:40 2021","interfaces":[{"interface":"back","average":{"1min":4.4290000000000003,"5min":2.3860000000000001,"15min":2.0350000000000001},"min":{"1min":0.33100000000000002,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":28.454999999999998,"5min":28.454999999999998,"15min":32.277000000000001},"last":2.153},{"interface":"front","average":{"1min":4.2290000000000001,"5min":2.0600000000000001,"15min":2.0339999999999998},"min":{"1min":0.39100000000000001,"5min":0.224,"15min":0.224},"max":{"1min":10.244999999999999,"5min":11.970000000000001,"15min":23.189},"last":0.57999999999999996}]},{"osd":4,"last update":"Fri Oct 8 19:41:57 2021","interfaces":[{"interface":"back","average":{"1min":2.6549999999999998,"5min":1.589,"15min":1.637},"min":{"1min":0.41199999999999998,"5min":0.28000000000000003,"15min":0.26600000000000001},"max":{"1min":8.5060000000000002,"5min":8.7940000000000005,"15min":13.968},"last":1.9279999999999999},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.722,"15min":1.8480000000000001},"min":{"1min":0.29199999999999998,"5min":0.28599999999999998,"15min":0.26900000000000002},"max":{"1min":3.5670000000000002,"5min":8.9009999999999998,"15min":18.692},"last":1.5309999999999999}]},{"osd":5,"last update":"Fri Oct 8 19:41:13 2021","interfaces":[{"interface":"back","average":{"1min":2.0790000000000002,"5min":1.609,"15min":1.8300000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":10.055,"5min":10.055,"15min":75.397000000000006},"last":2.0529999999999999},{"interface":"front","average":{"1min":1.796,"5min":1.8080000000000001,"15min":2.234},"min":{"1min":0.32600000000000001,"5min":0.309,"15min":0.309},"max":{"1min":7.9580000000000002,"5min":8.7579999999999991,"15min":75.680000000000007},"last":0.51000000000000001}]},{"osd":6,"last update":"Fri Oct 8 19:41:26 2021","interfaces":[{"interface":"back","average":{"1min":1.887,"5min":3.4430000000000001,"15min":2.4020000000000001},"min":{"1min":0.33600000000000002,"5min":0.32600000000000001,"15min":0.28599999999999998},"max":{"1min":4.0380000000000003,"5min":202.99799999999999,"15min":202.99799999999999},"last":1.512},{"interface":"front","average":{"1min":2.1709999999999998,"5min":3.6669999999999998,"15min":2.2890000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":9.9909999999999997,"5min":202.31200000000001,"15min":202.31200000000001},"last":2.0859999999999999}]},{"osd":7,"last update":"Fri Oct 8 19:41:57 2021","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.794,"15min":1.8819999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":3.5329999999999999,"5min":13.587,"15min":13.587},"last":1.482},{"interface":"front","average":{"1min":1.6719999999999999,"5min":1.9690000000000001,"15min":1.7390000000000001},"min":{"1min":0.35699999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":10.026999999999999,"5min":13.644,"15min":13.644},"last":2.1190000000000002}]}]},{"osd":4,"up_from":30,"seq":128849019143,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":661924,"kb_used_data":338460,"kb_used_omap":0,"kb_used_meta":323456,"kb_avail":93083228,"statfs":{"total":95995035648,"available":95317225472,"internally_reserved":0,"allocated":346583040,"data_stored":346182553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":331218944},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:41:53 2021","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":1.9870000000000001,"15min":1.8460000000000001},"min":{"1min":0.24199999999999999,"5min":0.219,"15min":0.185},"max":{"1min":5.7290000000000001,"5min":58.609999999999999,"15min":82.109999999999999},"last":2.3690000000000002},{"interface":"front","average":{"1min":2.0899999999999999,"5min":2.0150000000000001,"15min":1.887},"min":{"1min":0.224,"5min":0.222,"15min":0.222},"max":{"1min":10.403,"5min":58.329999999999998,"15min":82.025999999999996},"last":2.286}]},{"osd":1,"last update":"Fri Oct 8 19:41:53 2021","interfaces":[{"interface":"back","average":{"1min":5.8949999999999996,"5min":3.0310000000000001,"15min":2.7349999999999999},"min":{"1min":0.24099999999999999,"5min":0.215,"15min":0.215},"max":{"1min":65.012,"5min":65.332999999999998,"15min":122.422},"last":0.42299999999999999},{"interface":"front","average":{"1min":5.9509999999999996,"5min":2.9860000000000002,"15min":2.577},"min":{"1min":0.245,"5min":0.245,"15min":0.23599999999999999},"max":{"1min":64.966999999999999,"5min":64.966999999999999,"15min":123.122},"last":2.4460000000000002}]},{"osd":2,"last update":"Fri Oct 8 19:41:53 2021","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":2.4780000000000002,"15min":1.764},"min":{"1min":0.317,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":3.069,"5min":60.082999999999998,"15min":60.082999999999998},"last":2.972},{"interface":"front","average":{"1min":2.758,"5min":2.605,"15min":1.833},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.221},"max":{"1min":11.832000000000001,"5min":60.539000000000001,"15min":60.539000000000001},"last":2.891}]},{"osd":3,"last update":"Fri Oct 8 19:41:53 2021","interfaces":[{"interface":"back","average":{"1min":4.8490000000000002,"5min":3.0139999999999998,"15min":2.367},"min":{"1min":0.32700000000000001,"5min":0.27700000000000002,"15min":0.26500000000000001},"max":{"1min":29.562999999999999,"5min":59.137,"15min":59.137},"last":3.5600000000000001},{"interface":"front","average":{"1min":4.2990000000000004,"5min":2.9039999999999999,"15min":2.1909999999999998},"min":{"1min":0.34599999999999997,"5min":0.27000000000000002,"15min":0.254},"max":{"1min":27.896000000000001,"5min":59.777000000000001,"15min":59.777000000000001},"last":3.4780000000000002}]},{"osd":5,"last update":"Fri Oct 8 19:41:13 2021","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":1.155,"15min":1.0780000000000001},"min":{"1min":0.24099999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":2.722,"5min":10.477,"15min":10.477},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.90200000000000002,"15min":0.93500000000000005},"min":{"1min":0.27300000000000002,"5min":0.25800000000000001,"15min":0.22900000000000001},"max":{"1min":2.9900000000000002,"5min":5.4770000000000003,"15min":8.1319999999999997},"last":4.0549999999999997}]},{"osd":6,"last update":"Fri Oct 8 19:41:31 2021","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":5.4489999999999998,"15min":2.4199999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":9.2370000000000001,"5min":171.69800000000001,"15min":171.69800000000001},"last":2.431},{"interface":"front","average":{"1min":0.81799999999999995,"5min":5.4429999999999996,"15min":2.4969999999999999},"min":{"1min":0.308,"5min":0.27800000000000002,"15min":0.247},"max":{"1min":2.8039999999999998,"5min":171.613,"15min":171.613},"last":0.39500000000000002}]},{"osd":7,"last update":"Fri Oct 8 19:41:53 2021","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.94199999999999995,"15min":0.98099999999999998},"min":{"1min":0.311,"5min":0.29499999999999998,"15min":0.29099999999999998},"max":{"1min":2.742,"5min":5.2009999999999996,"15min":8.0050000000000008},"last":2.5680000000000001},{"interface":"front","average":{"1min":1.556,"5min":1.1639999999999999,"15min":1.0740000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.26800000000000002},"max":{"1min":9.3190000000000008,"5min":9.3190000000000008,"15min":9.3190000000000008},"last":2.46}]}]},{"osd":5,"up_from":38,"seq":163208757507,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":710292,"kb_used_data":334028,"kb_used_omap":0,"kb_used_meta":376256,"kb_avail":93034860,"statfs":{"total":95995035648,"available":95267696640,"internally_reserved":0,"allocated":342044672,"data_stored":341661271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":385286144},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:41:20 2021","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.4890000000000001,"15min":1.5069999999999999},"min":{"1min":0.23000000000000001,"5min":0.20699999999999999,"15min":0.20300000000000001},"max":{"1min":4.8220000000000001,"5min":33.469999999999999,"15min":43.332999999999998},"last":1.637},{"interface":"front","average":{"1min":1.446,"5min":1.6279999999999999,"15min":1.657},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.216},"max":{"1min":5.8739999999999997,"5min":32.857999999999997,"15min":42.637},"last":1.119}]},{"osd":1,"last update":"Fri Oct 8 19:41:20 2021","interfaces":[{"interface":"back","average":{"1min":2.3759999999999999,"5min":1.865,"15min":1.952},"min":{"1min":0.248,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":9.3010000000000002,"5min":9.3010000000000002,"15min":94.558999999999997},"last":3.032},{"interface":"front","average":{"1min":2.839,"5min":1.732,"15min":1.839},"min":{"1min":0.28100000000000003,"5min":0.25900000000000001,"15min":0.23100000000000001},"max":{"1min":12.756,"5min":12.756,"15min":94.456999999999994},"last":0.255}]},{"osd":2,"last update":"Fri Oct 8 19:41:20 2021","interfaces":[{"interface":"back","average":{"1min":1.8,"5min":1.486,"15min":1.52},"min":{"1min":0.26000000000000001,"5min":0.249,"15min":0.249},"max":{"1min":7.4939999999999998,"5min":22.931999999999999,"15min":22.931999999999999},"last":1.657},{"interface":"front","average":{"1min":1.8300000000000001,"5min":1.978,"15min":1.5960000000000001},"min":{"1min":0.41799999999999998,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":5.9550000000000001,"5min":22.963999999999999,"15min":22.963999999999999},"last":0.28199999999999997}]},{"osd":3,"last update":"Fri Oct 8 19:41:20 2021","interfaces":[{"interface":"back","average":{"1min":1.9079999999999999,"5min":1.476,"15min":1.696},"min":{"1min":0.311,"5min":0.28000000000000003,"15min":0.27000000000000002},"max":{"1min":5.4020000000000001,"5min":9.5899999999999999,"15min":12.356},"last":1.6759999999999999},{"interface":"front","average":{"1min":2.379,"5min":2.0499999999999998,"15min":2.0499999999999998},"min":{"1min":0.46400000000000002,"5min":0.29999999999999999,"15min":0.218},"max":{"1min":10.663,"5min":10.663,"15min":21.504000000000001},"last":0.91800000000000004}]},{"osd":4,"last update":"Fri Oct 8 19:41:20 2021","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.0429999999999999,"15min":0.92500000000000004},"min":{"1min":0.28399999999999997,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":2.8690000000000002,"5min":9.1600000000000001,"15min":9.2759999999999998},"last":0.72499999999999998},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.157,"15min":0.97499999999999998},"min":{"1min":0.33900000000000002,"5min":0.26700000000000002,"15min":0.25900000000000001},"max":{"1min":2.782,"5min":11.231,"15min":11.231},"last":1.6040000000000001}]},{"osd":6,"last update":"Fri Oct 8 19:41:30 2021","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.2569999999999999,"15min":1.0249999999999999},"min":{"1min":0.317,"5min":0.29399999999999998,"15min":0.255},"max":{"1min":3.9900000000000002,"5min":11.192,"15min":11.192},"last":0.309},{"interface":"front","average":{"1min":1.304,"5min":1.2350000000000001,"15min":1.044},"min":{"1min":0.36599999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":4.4249999999999998,"5min":11.259,"15min":11.259},"last":9.2029999999999994}]},{"osd":7,"last update":"Fri Oct 8 19:41:48 2021","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":1.071,"15min":1.1000000000000001},"min":{"1min":0.32700000000000001,"5min":0.22,"15min":0.22},"max":{"1min":3.5230000000000001,"5min":5.8280000000000003,"15min":29.946999999999999},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.98599999999999999,"5min":1.075,"15min":1.1719999999999999},"min":{"1min":0.34699999999999998,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":4.3120000000000003,"5min":12.970000000000001,"15min":29.294},"last":1.9139999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":266240,"data_stored":262688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":327680,"data_stored":327680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":431751168,"data_stored":431751168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":817102848,"data_stored":817102848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":632360960,"data_stored":632356888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":731316224,"data_stored":731316224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":338038784,"data_stored":338034712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":338952192,"data_stored":338952192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":686428160,"data_stored":686424088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":502661120,"data_stored":502661120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-10-08T19:42:11.839 INFO:tasks.thrashosds.thrasher:Setting 4.1a to [1, 0, 4, 7, 2, 6] 2021-10-08T19:42:11.840 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '4.1a', '1', '0', '4', '7', '2', '6'] 2021-10-08T19:42:11.840 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd pg-upmap-items 4.1a 1 0 4 7 2 6 2021-10-08T19:42:11.841 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:42:11.871 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:11.931 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:42:11.934 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:11.935 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:42:12.036 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:42:12.063 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:12.117 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:42:12.120 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:12.121 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:42:12.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:12 smithi097 ceph-mon[32687]: pgmap v1032: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 1.2 GiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.16k op/s 2021-10-08T19:42:12.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:12 smithi097 ceph-mon[32687]: 2.d scrub ok 2021-10-08T19:42:12.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:12 smithi097 ceph-mon[41966]: pgmap v1032: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 1.2 GiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.16k op/s 2021-10-08T19:42:12.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:12 smithi097 ceph-mon[41966]: 2.d scrub ok 2021-10-08T19:42:12.222 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:42:12.315 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:42:12 smithi117 conmon[69189]: level=error ts=2021-10-08T19:42:12.314Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=6 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:42:12.316 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:42:12 smithi117 conmon[69189]: level=error ts=2021-10-08T19:42:12.314Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=1 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:42:12.316 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:12 smithi117 ceph-mon[34585]: pgmap v1032: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 1.2 GiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.16k op/s 2021-10-08T19:42:12.316 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:12 smithi117 ceph-mon[34585]: 2.d scrub ok 2021-10-08T19:42:12.325 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2021-10-08T19:42:12.325 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:42:12.335 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:12.577 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:42:12.584 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:12.585 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:42:12.686 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:42:12.747 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:12.972 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:42:12 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:42:12] "GET /metrics HTTP/1.1" 200 156013 "" "Prometheus/2.18.1" 2021-10-08T19:42:13.073 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is unset 2021-10-08T19:42:13.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:13 smithi117 ceph-mon[34585]: 11.3 scrub ok 2021-10-08T19:42:13.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:13 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:42:13.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:13 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:42:13.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:13 smithi117 ceph-mon[34585]: 2.8 scrub ok 2021-10-08T19:42:13.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:13 smithi117 ceph-mon[34585]: osdmap e489: 8 total, 8 up, 8 in 2021-10-08T19:42:13.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:13 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:42:13.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:13 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:42:13.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:13 smithi117 ceph-mon[34585]: 3.12 scrub ok 2021-10-08T19:42:13.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:13 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2599177841' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:42:13.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:13 smithi097 ceph-mon[41966]: 11.3 scrub ok 2021-10-08T19:42:13.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:13 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:42:13.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:13 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:42:13.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:13 smithi097 ceph-mon[41966]: 2.8 scrub ok 2021-10-08T19:42:13.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:13 smithi097 ceph-mon[41966]: osdmap e489: 8 total, 8 up, 8 in 2021-10-08T19:42:13.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:13 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:42:13.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:13 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:42:13.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:13 smithi097 ceph-mon[41966]: 3.12 scrub ok 2021-10-08T19:42:13.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:13 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2599177841' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:42:13.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:13 smithi097 ceph-mon[32687]: 11.3 scrub ok 2021-10-08T19:42:13.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:13 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:42:13.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:13 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:42:13.474 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:13 smithi097 ceph-mon[32687]: 2.8 scrub ok 2021-10-08T19:42:13.474 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:13 smithi097 ceph-mon[32687]: osdmap e489: 8 total, 8 up, 8 in 2021-10-08T19:42:13.474 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:13 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:42:13.475 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:13 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:42:13.475 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:13 smithi097 ceph-mon[32687]: 3.12 scrub ok 2021-10-08T19:42:13.475 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:13 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2599177841' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:42:13.700 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2021-10-08T19:42:13.869 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:42:13 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:42:13] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:42:13.870 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:42:13 smithi117 conmon[69189]: level=error ts=2021-10-08T19:42:13.505Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=2 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:42:14.103 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:42:14.108 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:14.108 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:42:14.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:14 smithi117 ceph-mon[34585]: 2.26 scrub ok 2021-10-08T19:42:14.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:14 smithi117 ceph-mon[34585]: pgmap v1034: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 1.2 GiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 648 op/s 2021-10-08T19:42:14.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:14 smithi117 ceph-mon[34585]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:42:14.158 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:14 smithi117 ceph-mon[34585]: Cluster is now healthy 2021-10-08T19:42:14.159 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:14 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2599177841' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:42:14.160 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:14 smithi117 ceph-mon[34585]: osdmap e490: 8 total, 8 up, 8 in 2021-10-08T19:42:14.160 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:14 smithi117 ceph-mon[34585]: 2.29 scrub ok 2021-10-08T19:42:14.160 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:14 smithi117 ceph-mon[34585]: 2.e scrub ok 2021-10-08T19:42:14.209 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:42:14.250 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:14.338 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:42:14.341 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:14.341 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:42:14.369 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:42:14.443 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:42:14.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:14 smithi097 ceph-mon[41966]: 2.26 scrub ok 2021-10-08T19:42:14.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:14 smithi097 ceph-mon[41966]: pgmap v1034: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 1.2 GiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 648 op/s 2021-10-08T19:42:14.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:14 smithi097 ceph-mon[41966]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:42:14.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:14 smithi097 ceph-mon[41966]: Cluster is now healthy 2021-10-08T19:42:14.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:14 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2599177841' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:42:14.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:14 smithi097 ceph-mon[41966]: osdmap e490: 8 total, 8 up, 8 in 2021-10-08T19:42:14.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:14 smithi097 ceph-mon[41966]: 2.29 scrub ok 2021-10-08T19:42:14.474 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:14 smithi097 ceph-mon[41966]: 2.e scrub ok 2021-10-08T19:42:14.475 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:14 smithi097 ceph-mon[32687]: 2.26 scrub ok 2021-10-08T19:42:14.475 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:14 smithi097 ceph-mon[32687]: pgmap v1034: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 1.2 GiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 648 op/s 2021-10-08T19:42:14.476 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:14 smithi097 ceph-mon[32687]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:42:14.476 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:14 smithi097 ceph-mon[32687]: Cluster is now healthy 2021-10-08T19:42:14.476 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:14 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2599177841' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:42:14.476 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:14 smithi097 ceph-mon[32687]: osdmap e490: 8 total, 8 up, 8 in 2021-10-08T19:42:14.476 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:14 smithi097 ceph-mon[32687]: 2.29 scrub ok 2021-10-08T19:42:14.477 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:14 smithi097 ceph-mon[32687]: 2.e scrub ok 2021-10-08T19:42:14.492 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:14.833 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:42:14.839 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:14.840 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:42:14.875 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:42:14.941 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:42:14.977 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:15.103 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:42:15.112 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:15.112 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:42:15.213 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:42:15.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:15 smithi097 ceph-mon[32687]: 3.0 scrub ok 2021-10-08T19:42:15.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:15 smithi097 ceph-mon[32687]: 2.17 scrub ok 2021-10-08T19:42:15.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:15 smithi097 ceph-mon[32687]: 6.1b scrub ok 2021-10-08T19:42:15.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:15 smithi097 ceph-mon[41966]: 3.0 scrub ok 2021-10-08T19:42:15.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:15 smithi097 ceph-mon[41966]: 2.17 scrub ok 2021-10-08T19:42:15.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:15 smithi097 ceph-mon[41966]: 6.1b scrub ok 2021-10-08T19:42:15.245 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:15 smithi117 ceph-mon[34585]: 3.0 scrub ok 2021-10-08T19:42:15.246 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:15 smithi117 ceph-mon[34585]: 2.17 scrub ok 2021-10-08T19:42:15.246 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:15 smithi117 ceph-mon[34585]: 6.1b scrub ok 2021-10-08T19:42:15.249 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:15.318 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:42:15.320 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:15.321 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:42:15.422 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:42:15.468 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:15.589 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:42:15.599 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:15.600 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:42:15.701 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:42:15.735 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:15.792 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:42:15.793 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:15.794 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:42:15.896 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:42:15.955 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:15.991 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:42:16.046 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:42:16.091 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:42:16.134 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:42:16.135 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:42:16.143 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:16 smithi097 ceph-mon[32687]: 6.4 scrub ok 2021-10-08T19:42:16.144 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:16 smithi097 ceph-mon[32687]: pgmap v1036: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 945 MiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 1.37k op/s 2021-10-08T19:42:16.144 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:16 smithi097 ceph-mon[32687]: 3.c scrub ok 2021-10-08T19:42:16.144 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:16 smithi097 ceph-mon[32687]: 2.14 scrub ok 2021-10-08T19:42:16.145 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:16 smithi097 ceph-mon[32687]: 6.18 scrub ok 2021-10-08T19:42:16.145 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:16 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1548070332' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:42:16.145 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:16.148 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:42:16.149 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:16 smithi097 ceph-mon[41966]: 6.4 scrub ok 2021-10-08T19:42:16.149 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:16 smithi097 ceph-mon[41966]: pgmap v1036: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 945 MiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 1.37k op/s 2021-10-08T19:42:16.149 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:16 smithi097 ceph-mon[41966]: 3.c scrub ok 2021-10-08T19:42:16.150 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:16 smithi097 ceph-mon[41966]: 2.14 scrub ok 2021-10-08T19:42:16.151 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:16 smithi097 ceph-mon[41966]: 6.18 scrub ok 2021-10-08T19:42:16.151 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:16 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1548070332' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:42:16.167 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:42:16.199 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:42:16.232 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:42:16.250 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:42:16.263 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:42:16.280 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:16.434 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true' 2021-10-08T19:42:16.435 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true' 2021-10-08T19:42:16.435 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true' 2021-10-08T19:42:16.435 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true' 2021-10-08T19:42:16.435 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true' 2021-10-08T19:42:16.435 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true' 2021-10-08T19:42:16.436 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'true' 2021-10-08T19:42:16.436 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'true' 2021-10-08T19:42:16.436 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:16.437 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:42:16.438 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:42:16.438 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:16 smithi117 ceph-mon[34585]: 6.4 scrub ok 2021-10-08T19:42:16.439 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:16 smithi117 ceph-mon[34585]: pgmap v1036: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 945 MiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 1.37k op/s 2021-10-08T19:42:16.439 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:16 smithi117 ceph-mon[34585]: 3.c scrub ok 2021-10-08T19:42:16.439 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:16 smithi117 ceph-mon[34585]: 2.14 scrub ok 2021-10-08T19:42:16.439 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:16 smithi117 ceph-mon[34585]: 6.18 scrub ok 2021-10-08T19:42:16.440 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:16 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1548070332' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:42:16.539 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 2021-10-08T19:42:16.572 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:16.656 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:42:16.658 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:16.659 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4' 2021-10-08T19:42:16.760 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:42:16.789 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:16.845 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:42:16.848 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:16.849 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:42:16.909 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set noscrub 2021-10-08T19:42:16.950 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:42:17.030 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:17.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:17 smithi097 ceph-mon[32687]: 4.13 scrub ok 2021-10-08T19:42:17.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:17 smithi097 ceph-mon[32687]: 4.5 scrub ok 2021-10-08T19:42:17.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:17 smithi097 ceph-mon[41966]: 4.13 scrub ok 2021-10-08T19:42:17.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:17 smithi097 ceph-mon[41966]: 4.5 scrub ok 2021-10-08T19:42:17.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:17 smithi117 ceph-mon[34585]: 4.13 scrub ok 2021-10-08T19:42:17.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:17 smithi117 ceph-mon[34585]: 4.5 scrub ok 2021-10-08T19:42:17.834 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:17.836 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:42:17.836 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:42:17.906 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:42:17 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:42:17.942 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:42:18.022 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:18.108 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:18 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:42:18.108 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:18 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:42:18.109 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:18 smithi097 ceph-mon[32687]: pgmap v1037: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 945 MiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.03k op/s 2021-10-08T19:42:18.109 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:18 smithi097 ceph-mon[32687]: osdmap e491: 8 total, 8 up, 8 in 2021-10-08T19:42:18.110 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:18 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:42:18.110 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:18 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:42:18.110 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:18 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:42:18.111 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:18 smithi097 ceph-mon[41966]: pgmap v1037: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 945 MiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.03k op/s 2021-10-08T19:42:18.111 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:18 smithi097 ceph-mon[41966]: osdmap e491: 8 total, 8 up, 8 in 2021-10-08T19:42:18.111 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:18 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:42:18.115 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:42:18.124 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:18.125 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:42:18.226 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:42:18.281 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:18.339 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:42:18.339 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2021-10-08T19:42:18.339 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:18.340 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.26125.0:216922 11.e 11:75f0bf44:::benchmark_data_smithi097_295476_object103173:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e491)", 2021-10-08T19:42:18.340 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:42:18.331276+0000", 2021-10-08T19:42:18.340 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.0049078409999999996, 2021-10-08T19:42:18.340 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049395999999999997, 2021-10-08T19:42:18.340 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:18.341 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "waiting for sub ops", 2021-10-08T19:42:18.341 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:42:18.341 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.26125", 2021-10-08T19:42:18.341 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:42:18.342 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 216922 2021-10-08T19:42:18.342 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:18.342 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:18.342 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:18.342 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:18.343 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:18.331276+0000", 2021-10-08T19:42:18.343 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:18.343 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:18.343 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:18.344 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:18.344 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:18.331276+0000", 2021-10-08T19:42:18.344 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:18.344 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:18.345 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:18.345 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:18.345 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:18.331274+0000", 2021-10-08T19:42:18.346 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:42:18.346 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:18.346 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:18.346 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:18.347 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:18.331281+0000", 2021-10-08T19:42:18.347 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1080000000000004e-06 2021-10-08T19:42:18.347 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:18.347 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:18.348 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:18.348 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:18.331295+0000", 2021-10-08T19:42:18.348 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3278999999999999e-05 2021-10-08T19:42:18.348 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:18.350 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:18.350 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:18.350 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:18.331302+0000", 2021-10-08T19:42:18.351 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4309999999999997e-06 2021-10-08T19:42:18.351 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:18.352 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:18.352 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:18.353 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:18.331353+0000", 2021-10-08T19:42:18.353 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1275e-05 2021-10-08T19:42:18.353 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:18.353 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:18.354 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:18.354 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:18.331489+0000", 2021-10-08T19:42:18.354 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013537299999999999 2021-10-08T19:42:18.354 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:18.354 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:18.355 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 1,7", 2021-10-08T19:42:18.355 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:18.331619+0000", 2021-10-08T19:42:18.355 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013081200000000001 2021-10-08T19:42:18.355 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:18.356 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:18.356 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:42:18.356 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:18.334588+0000", 2021-10-08T19:42:18.357 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0029682829999999999 2021-10-08T19:42:18.357 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:18.357 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:18.357 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:18.358 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:18.358 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:18.358 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.26125.0:216925 11.7 e491/433 11:e1957f9e:::benchmark_data_smithi097_295476_object103176:head v 491'13306, mlcod=491'13304)", 2021-10-08T19:42:18.358 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:42:18.334188+0000", 2021-10-08T19:42:18.359 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.0019956779999999999, 2021-10-08T19:42:18.359 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021196650000000002, 2021-10-08T19:42:18.359 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:18.359 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2021-10-08T19:42:18.359 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:18.360 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:18.360 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:18.360 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:18.334188+0000", 2021-10-08T19:42:18.360 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:18.360 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:18.361 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:18.361 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:18.361 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:18.334188+0000", 2021-10-08T19:42:18.361 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:18.362 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:18.362 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:18.363 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:18.363 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:18.334187+0000", 2021-10-08T19:42:18.363 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:42:18.363 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:18.364 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:18.364 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:18.364 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:18.334198+0000", 2021-10-08T19:42:18.364 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1185999999999999e-05 2021-10-08T19:42:18.365 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:18.365 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:18.365 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:18.365 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:18.334213+0000", 2021-10-08T19:42:18.366 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4518000000000001e-05 2021-10-08T19:42:18.366 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:18.366 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:18.366 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:18.367 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:18.334220+0000", 2021-10-08T19:42:18.367 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0589999999999997e-06 2021-10-08T19:42:18.367 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:18.367 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:18.368 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:18.368 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:18.335508+0000", 2021-10-08T19:42:18.368 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012884019999999999 2021-10-08T19:42:18.368 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:18.369 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:18.369 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:18.369 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:18.335526+0000", 2021-10-08T19:42:18.369 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7552000000000001e-05 2021-10-08T19:42:18.369 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:18.370 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:18.370 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:18.370 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:18.370 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:18.371 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.26125.0:216927 11.c e491/433 11:39c09950:::benchmark_data_smithi097_295476_object103178:head v 491'13473, mlcod=491'13471)", 2021-10-08T19:42:18.371 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:42:18.334232+0000", 2021-10-08T19:42:18.371 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.001951709, 2021-10-08T19:42:18.371 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021130760000000002, 2021-10-08T19:42:18.371 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:18.372 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2021-10-08T19:42:18.372 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:18.372 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:18.372 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:18.372 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:18.334232+0000", 2021-10-08T19:42:18.373 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:18.373 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:18.374 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:18.374 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:18.374 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:18.334232+0000", 2021-10-08T19:42:18.374 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:18.375 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:18.375 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:18.375 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:18.375 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:18.334232+0000", 2021-10-08T19:42:18.375 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999995 2021-10-08T19:42:18.376 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:18.376 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:18.376 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:18.376 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:18.334237+0000", 2021-10-08T19:42:18.376 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0409999999999997e-06 2021-10-08T19:42:18.377 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:18.377 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:18.377 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:18.377 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:18.334242+0000", 2021-10-08T19:42:18.378 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.3009999999999997e-06 2021-10-08T19:42:18.378 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:18.378 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:18.378 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:18.378 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:18.334246+0000", 2021-10-08T19:42:18.379 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1790000000000001e-06 2021-10-08T19:42:18.379 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:18.379 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:18.379 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:18.379 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:18.334308+0000", 2021-10-08T19:42:18.380 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1661000000000005e-05 2021-10-08T19:42:18.380 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:18.380 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:18.380 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:18.381 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:18.334329+0000", 2021-10-08T19:42:18.381 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0988999999999998e-05 2021-10-08T19:42:18.381 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:18.381 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:18.381 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:18.382 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:18.382 INFO:teuthology.orchestra.run.smithi117.stdout: ], 2021-10-08T19:42:18.382 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 3 2021-10-08T19:42:18.382 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:42:18.383 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:18 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:42:18.383 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:18 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:42:18.384 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:18 smithi117 ceph-mon[34585]: pgmap v1037: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 945 MiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.03k op/s 2021-10-08T19:42:18.384 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:18 smithi117 ceph-mon[34585]: osdmap e491: 8 total, 8 up, 8 in 2021-10-08T19:42:18.384 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:18 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:42:18.385 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:18.385 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:42:18.386 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:42:18.488 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:42:18.531 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:18.849 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:42:18.855 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:18.856 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:42:18.933 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:42:18.958 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:42:19.022 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:19.123 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:42:19.128 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:19.128 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:42:19.130 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:19 smithi097 ceph-mon[41966]: 4.19 deep-scrub ok 2021-10-08T19:42:19.130 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:19 smithi097 ceph-mon[41966]: 2.7 scrub ok 2021-10-08T19:42:19.230 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:42:19.281 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:19.388 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:19 smithi117 ceph-mon[34585]: 4.19 deep-scrub ok 2021-10-08T19:42:19.389 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:19 smithi117 ceph-mon[34585]: 2.7 scrub ok 2021-10-08T19:42:19.391 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2021-10-08T19:42:19.459 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:19 smithi097 ceph-mon[32687]: 4.19 deep-scrub ok 2021-10-08T19:42:19.459 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:19 smithi097 ceph-mon[32687]: 2.7 scrub ok 2021-10-08T19:42:19.537 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:42:19.560 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:19.562 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:42:19.663 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:42:19.746 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:19.862 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:42:19.867 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:42:19.875 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:19.877 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:42:19.945 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2021-10-08T19:42:19.979 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:42:20.074 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:20.209 INFO:teuthology.orchestra.run.smithi097.stderr:set 4.1a pg_upmap_items mapping to [1->0,4->7,2->6] 2021-10-08T19:42:20.245 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:20 smithi097 ceph-mon[41966]: 5.19 scrub ok 2021-10-08T19:42:20.246 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:20 smithi097 ceph-mon[41966]: pgmap v1039: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 794 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 733 B/s rd, 0 B/s wr, 1.11k op/s 2021-10-08T19:42:20.246 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:20 smithi097 ceph-mon[41966]: 6.7 deep-scrub ok 2021-10-08T19:42:20.246 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:20 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2154200085' entity='client.admin' cmd=[{"prefix": "osd pg-upmap-items", "pgid": "4.1a", "id": [1, 0, 4, 7, 2, 6]}]: dispatch 2021-10-08T19:42:20.247 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:20 smithi097 ceph-mon[41966]: from='client.36410 ' entity='client.admin' cmd=[{"prefix": "osd pg-upmap-items", "pgid": "4.1a", "id": [1, 0, 4, 7, 2, 6]}]: dispatch 2021-10-08T19:42:20.247 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:20 smithi097 ceph-mon[32687]: 5.19 scrub ok 2021-10-08T19:42:20.247 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:20 smithi097 ceph-mon[32687]: pgmap v1039: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 794 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 733 B/s rd, 0 B/s wr, 1.11k op/s 2021-10-08T19:42:20.247 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:20 smithi097 ceph-mon[32687]: 6.7 deep-scrub ok 2021-10-08T19:42:20.248 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:20 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2154200085' entity='client.admin' cmd=[{"prefix": "osd pg-upmap-items", "pgid": "4.1a", "id": [1, 0, 4, 7, 2, 6]}]: dispatch 2021-10-08T19:42:20.248 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:20 smithi097 ceph-mon[32687]: from='client.36410 ' entity='client.admin' cmd=[{"prefix": "osd pg-upmap-items", "pgid": "4.1a", "id": [1, 0, 4, 7, 2, 6]}]: dispatch 2021-10-08T19:42:20.320 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:42:20.335 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:20.336 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:42:20.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:20 smithi117 ceph-mon[34585]: 5.19 scrub ok 2021-10-08T19:42:20.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:20 smithi117 ceph-mon[34585]: pgmap v1039: 188 pgs: 1 active+clean+scrubbing, 187 active+clean; 794 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 733 B/s rd, 0 B/s wr, 1.11k op/s 2021-10-08T19:42:20.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:20 smithi117 ceph-mon[34585]: 6.7 deep-scrub ok 2021-10-08T19:42:20.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:20 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2154200085' entity='client.admin' cmd=[{"prefix": "osd pg-upmap-items", "pgid": "4.1a", "id": [1, 0, 4, 7, 2, 6]}]: dispatch 2021-10-08T19:42:20.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:20 smithi117 ceph-mon[34585]: from='client.36410 ' entity='client.admin' cmd=[{"prefix": "osd pg-upmap-items", "pgid": "4.1a", "id": [1, 0, 4, 7, 2, 6]}]: dispatch 2021-10-08T19:42:20.438 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:42:20.489 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:21.434 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:42:21.438 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:21.439 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:42:21.476 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:21 smithi097 ceph-mon[32687]: from='client.36410 ' entity='client.admin' cmd='[{"prefix": "osd pg-upmap-items", "pgid": "4.1a", "id": [1, 0, 4, 7, 2, 6]}]': finished 2021-10-08T19:42:21.476 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:21 smithi097 ceph-mon[32687]: osdmap e492: 8 total, 8 up, 8 in 2021-10-08T19:42:21.476 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:21 smithi097 ceph-mon[41966]: from='client.36410 ' entity='client.admin' cmd='[{"prefix": "osd pg-upmap-items", "pgid": "4.1a", "id": [1, 0, 4, 7, 2, 6]}]': finished 2021-10-08T19:42:21.477 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:21 smithi097 ceph-mon[41966]: osdmap e492: 8 total, 8 up, 8 in 2021-10-08T19:42:21.540 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:42:21.647 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:21 smithi117 ceph-mon[34585]: from='client.36410 ' entity='client.admin' cmd='[{"prefix": "osd pg-upmap-items", "pgid": "4.1a", "id": [1, 0, 4, 7, 2, 6]}]': finished 2021-10-08T19:42:21.648 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:21 smithi117 ceph-mon[34585]: osdmap e492: 8 total, 8 up, 8 in 2021-10-08T19:42:21.656 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:21.876 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:42:21.886 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:21.887 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:42:21.989 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:42:22.043 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:22.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:22 smithi097 ceph-mon[41966]: 2.27 scrub ok 2021-10-08T19:42:22.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:22 smithi097 ceph-mon[41966]: pgmap v1041: 188 pgs: 188 active+clean; 606 MiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1.35k op/s 2021-10-08T19:42:22.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:22 smithi097 ceph-mon[41966]: 5.17 scrub ok 2021-10-08T19:42:22.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:22 smithi097 ceph-mon[41966]: osdmap e493: 8 total, 8 up, 8 in 2021-10-08T19:42:22.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:22 smithi097 ceph-mon[32687]: 2.27 scrub ok 2021-10-08T19:42:22.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:22 smithi097 ceph-mon[32687]: pgmap v1041: 188 pgs: 188 active+clean; 606 MiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1.35k op/s 2021-10-08T19:42:22.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:22 smithi097 ceph-mon[32687]: 5.17 scrub ok 2021-10-08T19:42:22.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:22 smithi097 ceph-mon[32687]: osdmap e493: 8 total, 8 up, 8 in 2021-10-08T19:42:22.517 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:42:22.518 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2021-10-08T19:42:22.518 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2021-10-08T19:42:22.518 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2021-10-08T19:42:22.518 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:42:22.543 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:42:22 smithi117 conmon[69189]: level=error ts=2021-10-08T19:42:22.314Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=2 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:42:22.543 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:22 smithi117 ceph-mon[34585]: 2.27 scrub ok 2021-10-08T19:42:22.543 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:22 smithi117 ceph-mon[34585]: pgmap v1041: 188 pgs: 188 active+clean; 606 MiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1.35k op/s 2021-10-08T19:42:22.544 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:22 smithi117 ceph-mon[34585]: 5.17 scrub ok 2021-10-08T19:42:22.544 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:22 smithi117 ceph-mon[34585]: osdmap e493: 8 total, 8 up, 8 in 2021-10-08T19:42:22.872 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:42:22.873 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:42:22.883 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:22.884 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:42:22.970 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:42:22 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:42:22] "GET /metrics HTTP/1.1" 200 156013 "" "Prometheus/2.18.1" 2021-10-08T19:42:22.987 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:42:23.026 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:23.084 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:42:23.089 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:23.090 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:42:23.191 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:42:23.262 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:23.360 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:23 smithi097 ceph-mon[32687]: 3.1 scrub ok 2021-10-08T19:42:23.361 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:23 smithi097 ceph-mon[41966]: 3.1 scrub ok 2021-10-08T19:42:23.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:23 smithi117 ceph-mon[34585]: 3.1 scrub ok 2021-10-08T19:42:23.429 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:42:23.436 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:23.437 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:42:23.537 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:42:23.558 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2021-10-08T19:42:23.572 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:23.645 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:42:23.647 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:23.648 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:42:23.749 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:42:23.823 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:24.023 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:42:24.157 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:42:23 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:42:23] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:42:24.182 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:42:24.185 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:24.186 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:42:24.230 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is set 2021-10-08T19:42:24.287 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:42:24.346 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:24.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:24 smithi097 ceph-mon[41966]: pgmap v1043: 188 pgs: 188 active+clean; 606 MiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 904 op/s 2021-10-08T19:42:24.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:24 smithi097 ceph-mon[41966]: 1.1 scrub ok 2021-10-08T19:42:24.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:24 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1418689638' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:42:24.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:24 smithi097 ceph-mon[41966]: from='client.36416 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:42:24.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:24 smithi097 ceph-mon[32687]: pgmap v1043: 188 pgs: 188 active+clean; 606 MiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 904 op/s 2021-10-08T19:42:24.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:24 smithi097 ceph-mon[32687]: 1.1 scrub ok 2021-10-08T19:42:24.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:24 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1418689638' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:42:24.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:24 smithi097 ceph-mon[32687]: from='client.36416 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:42:24.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:24 smithi117 ceph-mon[34585]: pgmap v1043: 188 pgs: 188 active+clean; 606 MiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 904 op/s 2021-10-08T19:42:24.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:24 smithi117 ceph-mon[34585]: 1.1 scrub ok 2021-10-08T19:42:24.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:24 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1418689638' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:42:24.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:24 smithi117 ceph-mon[34585]: from='client.36416 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2021-10-08T19:42:25.263 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:42:25.273 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:25.274 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:42:25.375 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:42:25.457 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:25.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:25 smithi117 ceph-mon[34585]: 5.12 scrub ok 2021-10-08T19:42:25.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:25 smithi117 ceph-mon[34585]: 5.7 deep-scrub ok 2021-10-08T19:42:25.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:25 smithi117 ceph-mon[34585]: 5.0 scrub ok 2021-10-08T19:42:25.659 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:25 smithi117 ceph-mon[34585]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:42:25.659 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:25 smithi117 ceph-mon[34585]: from='client.36416 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:42:25.659 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:25 smithi117 ceph-mon[34585]: osdmap e494: 8 total, 8 up, 8 in 2021-10-08T19:42:25.659 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:25 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:42:25.660 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:25 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:42:25.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:25 smithi097 ceph-mon[32687]: 5.12 scrub ok 2021-10-08T19:42:25.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:25 smithi097 ceph-mon[32687]: 5.7 deep-scrub ok 2021-10-08T19:42:25.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:25 smithi097 ceph-mon[32687]: 5.0 scrub ok 2021-10-08T19:42:25.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:25 smithi097 ceph-mon[32687]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:42:25.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:25 smithi097 ceph-mon[32687]: from='client.36416 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:42:25.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:25 smithi097 ceph-mon[32687]: osdmap e494: 8 total, 8 up, 8 in 2021-10-08T19:42:25.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:25 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:42:25.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:25 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:42:25.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:25 smithi097 ceph-mon[41966]: 5.12 scrub ok 2021-10-08T19:42:25.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:25 smithi097 ceph-mon[41966]: 5.7 deep-scrub ok 2021-10-08T19:42:25.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:25 smithi097 ceph-mon[41966]: 5.0 scrub ok 2021-10-08T19:42:25.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:25 smithi097 ceph-mon[41966]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:42:25.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:25 smithi097 ceph-mon[41966]: from='client.36416 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2021-10-08T19:42:25.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:25 smithi097 ceph-mon[41966]: osdmap e494: 8 total, 8 up, 8 in 2021-10-08T19:42:25.725 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:25 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:42:25.725 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:25 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:42:26.023 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:42:26.028 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:26.031 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:42:26.132 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:42:26.164 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:26.287 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:42:26.289 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:26.290 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:42:26.291 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:26 smithi117 ceph-mon[34585]: pgmap v1045: 188 pgs: 188 active+clean; 291 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1.34k op/s; 18 B/s, 0 objects/s recovering 2021-10-08T19:42:26.291 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:26 smithi117 ceph-mon[34585]: osdmap e495: 8 total, 8 up, 8 in 2021-10-08T19:42:26.393 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:42:26.435 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:26 smithi097 ceph-mon[32687]: pgmap v1045: 188 pgs: 188 active+clean; 291 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1.34k op/s; 18 B/s, 0 objects/s recovering 2021-10-08T19:42:26.436 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:26 smithi097 ceph-mon[32687]: osdmap e495: 8 total, 8 up, 8 in 2021-10-08T19:42:26.436 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:26 smithi097 ceph-mon[41966]: pgmap v1045: 188 pgs: 188 active+clean; 291 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1.34k op/s; 18 B/s, 0 objects/s recovering 2021-10-08T19:42:26.436 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:26 smithi097 ceph-mon[41966]: osdmap e495: 8 total, 8 up, 8 in 2021-10-08T19:42:26.444 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:26.557 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:42:26.563 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:42:26.575 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:26.576 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:42:26.598 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:42:26.613 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:42:26.614 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2021-10-08T19:42:26.614 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2021-10-08T19:42:26.614 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2021-10-08T19:42:26.615 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.615 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15870.0:98131 10.e 10:72fd9984:::benchmark_data_smithi097_245820_object98130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e385)", 2021-10-08T19:42:26.615 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:36:35.785491+0000", 2021-10-08T19:42:26.615 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 350.82410719699999, 2021-10-08T19:42:26.616 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.138727929, 2021-10-08T19:42:26.617 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:26.617 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:26.617 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:42:26.618 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15870", 2021-10-08T19:42:26.618 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1128006081", 2021-10-08T19:42:26.618 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 98131 2021-10-08T19:42:26.618 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.618 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:26.619 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.619 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:26.619 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:35.785491+0000", 2021-10-08T19:42:26.620 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:26.620 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.620 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.620 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:26.621 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:35.785491+0000", 2021-10-08T19:42:26.621 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:26.621 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.621 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.621 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:26.622 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:35.785488+0000", 2021-10-08T19:42:26.622 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:42:26.622 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.622 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.623 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:26.623 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:35.785540+0000", 2021-10-08T19:42:26.623 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1428999999999998e-05 2021-10-08T19:42:26.623 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.623 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.624 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:26.624 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:35.785549+0000", 2021-10-08T19:42:26.624 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6409999999999997e-06 2021-10-08T19:42:26.624 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.624 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.625 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:26.625 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:35.785554+0000", 2021-10-08T19:42:26.625 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9520000000000002e-06 2021-10-08T19:42:26.625 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.625 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.626 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:26.626 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:35.785593+0000", 2021-10-08T19:42:26.626 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8250000000000001e-05 2021-10-08T19:42:26.626 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.626 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.627 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:26.627 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:35.785691+0000", 2021-10-08T19:42:26.627 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7952e-05 2021-10-08T19:42:26.627 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.628 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.628 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 2,6", 2021-10-08T19:42:26.628 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:35.785812+0000", 2021-10-08T19:42:26.628 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000121617 2021-10-08T19:42:26.628 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.629 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.629 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:42:26.629 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:35.792398+0000", 2021-10-08T19:42:26.629 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.006585774 2021-10-08T19:42:26.629 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.630 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.630 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:26.630 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:35.792437+0000", 2021-10-08T19:42:26.630 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9096e-05 2021-10-08T19:42:26.630 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.631 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.631 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:26.631 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:35.924129+0000", 2021-10-08T19:42:26.631 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.13169236300000001 2021-10-08T19:42:26.631 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.632 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.632 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:26.632 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:35.924181+0000", 2021-10-08T19:42:26.632 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1727999999999997e-05 2021-10-08T19:42:26.633 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.633 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.633 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:26.633 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:35.924219+0000", 2021-10-08T19:42:26.633 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7549999999999998e-05 2021-10-08T19:42:26.634 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:26.634 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:26.634 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:26.634 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.634 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.635 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15870.0:98132 10.e 10:7f6a4b6f:::benchmark_data_smithi097_245820_object98131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e385)", 2021-10-08T19:42:26.635 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:36:35.785562+0000", 2021-10-08T19:42:26.635 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 350.82403561900003, 2021-10-08T19:42:26.635 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.144279457, 2021-10-08T19:42:26.635 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:26.636 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:26.636 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:42:26.636 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15870", 2021-10-08T19:42:26.636 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1128006081", 2021-10-08T19:42:26.636 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 98132 2021-10-08T19:42:26.637 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.637 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:26.637 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.637 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:26.638 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:35.785562+0000", 2021-10-08T19:42:26.638 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:26.638 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.638 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.639 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:26.639 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:35.785562+0000", 2021-10-08T19:42:26.639 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:26.639 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.640 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.640 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:26.640 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:35.785562+0000", 2021-10-08T19:42:26.640 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999995 2021-10-08T19:42:26.640 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.641 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.641 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:26.641 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:35.785603+0000", 2021-10-08T19:42:26.641 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0809999999999997e-05 2021-10-08T19:42:26.641 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.642 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.642 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:26.642 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:35.785607+0000", 2021-10-08T19:42:26.642 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7400000000000004e-06 2021-10-08T19:42:26.642 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.643 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.643 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:26.643 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:35.785610+0000", 2021-10-08T19:42:26.643 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.1039999999999998e-06 2021-10-08T19:42:26.643 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.644 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.644 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:26.644 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:35.790458+0000", 2021-10-08T19:42:26.644 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0048472699999999999 2021-10-08T19:42:26.645 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.645 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.645 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:26.645 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:35.790584+0000", 2021-10-08T19:42:26.645 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012667599999999999 2021-10-08T19:42:26.646 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.646 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.646 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 2,6", 2021-10-08T19:42:26.646 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:35.790708+0000", 2021-10-08T19:42:26.647 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012317 2021-10-08T19:42:26.647 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.647 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.647 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:42:26.647 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:35.792732+0000", 2021-10-08T19:42:26.648 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020249249999999999 2021-10-08T19:42:26.648 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.648 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.649 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:26.649 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:35.794984+0000", 2021-10-08T19:42:26.649 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022515880000000001 2021-10-08T19:42:26.649 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.649 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.650 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:26.650 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:35.929753+0000", 2021-10-08T19:42:26.650 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.13476938599999999 2021-10-08T19:42:26.650 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.650 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.651 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:26.651 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:35.929805+0000", 2021-10-08T19:42:26.651 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1489000000000001e-05 2021-10-08T19:42:26.651 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.651 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.652 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:26.652 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:35.929842+0000", 2021-10-08T19:42:26.652 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6952000000000001e-05 2021-10-08T19:42:26.652 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:26.653 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:26.653 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:26.653 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.653 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.653 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15870.0:98523 10.1 10:89e95556:::benchmark_data_smithi097_245820_object98522:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e385)", 2021-10-08T19:42:26.654 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:36:36.248075+0000", 2021-10-08T19:42:26.654 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 350.361522718, 2021-10-08T19:42:26.654 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.161449131, 2021-10-08T19:42:26.654 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:26.654 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:26.655 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:42:26.655 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15870", 2021-10-08T19:42:26.655 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1128006081", 2021-10-08T19:42:26.655 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 98523 2021-10-08T19:42:26.655 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.656 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:26.656 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.656 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:26.656 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:36.248075+0000", 2021-10-08T19:42:26.657 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:26.657 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.657 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.657 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:26.658 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:36.248075+0000", 2021-10-08T19:42:26.658 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:26.658 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.658 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.659 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:26.659 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:36.248073+0000", 2021-10-08T19:42:26.659 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:42:26.659 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.659 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.660 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:26.660 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:36.248124+0000", 2021-10-08T19:42:26.660 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0346999999999998e-05 2021-10-08T19:42:26.660 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.660 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.662 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:26.663 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:36.248139+0000", 2021-10-08T19:42:26.663 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5730999999999999e-05 2021-10-08T19:42:26.663 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.663 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.663 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:26.664 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:36.248146+0000", 2021-10-08T19:42:26.664 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5339999999999996e-06 2021-10-08T19:42:26.664 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.664 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.665 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:26.665 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:36.248200+0000", 2021-10-08T19:42:26.665 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.3729e-05 2021-10-08T19:42:26.665 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.665 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.666 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:26.666 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:36.248389+0000", 2021-10-08T19:42:26.666 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00018955 2021-10-08T19:42:26.666 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.667 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.667 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,7", 2021-10-08T19:42:26.667 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:36.248596+0000", 2021-10-08T19:42:26.668 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00020718099999999999 2021-10-08T19:42:26.668 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.668 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.668 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:42:26.668 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:36.250942+0000", 2021-10-08T19:42:26.669 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0023460379999999999 2021-10-08T19:42:26.669 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.669 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.669 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:26.670 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:36.252954+0000", 2021-10-08T19:42:26.670 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002011774 2021-10-08T19:42:26.670 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.671 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.671 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:26.671 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:36.409412+0000", 2021-10-08T19:42:26.671 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.1564574 2021-10-08T19:42:26.671 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.672 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.672 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:26.672 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:36.409483+0000", 2021-10-08T19:42:26.672 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1789e-05 2021-10-08T19:42:26.673 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.673 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.673 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:26.673 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:36.409524+0000", 2021-10-08T19:42:26.673 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1029000000000003e-05 2021-10-08T19:42:26.674 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:26.674 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:26.674 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:26.674 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.675 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.675 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15870.0:101960 10.1 10:892d1116:::benchmark_data_smithi097_245820_object101959:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e386)", 2021-10-08T19:42:26.675 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:36:39.683487+0000", 2021-10-08T19:42:26.675 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 346.92611108400001, 2021-10-08T19:42:26.676 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.12615555000000001, 2021-10-08T19:42:26.676 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:26.676 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:26.676 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:42:26.676 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15870", 2021-10-08T19:42:26.677 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1128006081", 2021-10-08T19:42:26.677 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 101960 2021-10-08T19:42:26.677 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.677 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:26.678 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.678 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:26.678 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:39.683487+0000", 2021-10-08T19:42:26.678 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:26.678 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.679 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.679 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:26.679 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:39.683487+0000", 2021-10-08T19:42:26.679 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:26.679 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.680 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.680 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:26.680 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:39.683485+0000", 2021-10-08T19:42:26.680 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:42:26.681 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.681 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.681 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:26.681 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:39.683518+0000", 2021-10-08T19:42:26.681 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.3699999999999999e-05 2021-10-08T19:42:26.682 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.682 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.682 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:26.682 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:39.683531+0000", 2021-10-08T19:42:26.682 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.24e-05 2021-10-08T19:42:26.683 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.683 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.683 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:26.683 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:39.683538+0000", 2021-10-08T19:42:26.683 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.9269999999999999e-06 2021-10-08T19:42:26.684 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.684 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.684 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:26.685 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:39.683595+0000", 2021-10-08T19:42:26.685 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6795000000000001e-05 2021-10-08T19:42:26.685 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.685 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.685 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:26.686 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:39.683734+0000", 2021-10-08T19:42:26.686 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013994100000000001 2021-10-08T19:42:26.686 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.686 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.687 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,7", 2021-10-08T19:42:26.687 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:39.683889+0000", 2021-10-08T19:42:26.687 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015409399999999999 2021-10-08T19:42:26.687 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.688 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.688 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:42:26.688 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:39.686541+0000", 2021-10-08T19:42:26.688 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0026525860000000002 2021-10-08T19:42:26.688 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.689 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.689 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:26.689 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:39.692889+0000", 2021-10-08T19:42:26.689 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.006347948 2021-10-08T19:42:26.689 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.690 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.690 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:26.690 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:39.809557+0000", 2021-10-08T19:42:26.690 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.11666778999999999 2021-10-08T19:42:26.691 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.691 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.691 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:26.691 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:39.809600+0000", 2021-10-08T19:42:26.691 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2979000000000003e-05 2021-10-08T19:42:26.692 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.692 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.692 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:26.692 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:39.809642+0000", 2021-10-08T19:42:26.692 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2589999999999997e-05 2021-10-08T19:42:26.693 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:26.693 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:26.693 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:26.693 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.694 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.694 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15870.0:101965 10.e 10:788d5dc8:::benchmark_data_smithi097_245820_object101964:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e386)", 2021-10-08T19:42:26.694 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:36:39.683816+0000", 2021-10-08T19:42:26.694 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 346.92578181099998, 2021-10-08T19:42:26.694 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.13216677199999999, 2021-10-08T19:42:26.695 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:26.695 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:26.695 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:42:26.695 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15870", 2021-10-08T19:42:26.696 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1128006081", 2021-10-08T19:42:26.696 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 101965 2021-10-08T19:42:26.696 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.696 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:26.697 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.697 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:26.697 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:39.683816+0000", 2021-10-08T19:42:26.698 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:26.698 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.698 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.698 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:26.698 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:39.683816+0000", 2021-10-08T19:42:26.699 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:26.699 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.699 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.699 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:26.700 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:39.683815+0000", 2021-10-08T19:42:26.700 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:42:26.700 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.700 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.701 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:26.701 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:39.683846+0000", 2021-10-08T19:42:26.701 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.1312000000000001e-05 2021-10-08T19:42:26.701 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.702 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.702 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:26.702 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:39.683856+0000", 2021-10-08T19:42:26.702 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.533e-06 2021-10-08T19:42:26.702 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.703 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.703 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:26.703 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:39.683862+0000", 2021-10-08T19:42:26.703 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2400000000000004e-06 2021-10-08T19:42:26.704 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.704 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.704 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:26.704 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:39.689671+0000", 2021-10-08T19:42:26.704 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0058088849999999997 2021-10-08T19:42:26.705 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.705 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.705 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:26.705 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:39.689800+0000", 2021-10-08T19:42:26.706 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012928399999999999 2021-10-08T19:42:26.706 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.706 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.706 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 2,6", 2021-10-08T19:42:26.706 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:39.689945+0000", 2021-10-08T19:42:26.707 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014480100000000001 2021-10-08T19:42:26.707 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.707 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.707 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:42:26.707 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:39.692388+0000", 2021-10-08T19:42:26.708 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024436150000000001 2021-10-08T19:42:26.708 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.708 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.708 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:26.709 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:39.694924+0000", 2021-10-08T19:42:26.709 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0025360370000000001 2021-10-08T19:42:26.709 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.709 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.709 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:26.710 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:39.815887+0000", 2021-10-08T19:42:26.710 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.120962442 2021-10-08T19:42:26.710 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.710 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.711 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:26.711 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:39.815946+0000", 2021-10-08T19:42:26.711 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8860999999999998e-05 2021-10-08T19:42:26.711 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.711 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.712 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:26.712 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:39.815983+0000", 2021-10-08T19:42:26.712 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7286000000000002e-05 2021-10-08T19:42:26.712 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:26.713 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:26.713 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:26.713 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.713 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.713 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15870.0:101973 10.e 10:70da79de:::benchmark_data_smithi097_245820_object101972:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e386)", 2021-10-08T19:42:26.714 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:36:39.692322+0000", 2021-10-08T19:42:26.714 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 346.91727603999999, 2021-10-08T19:42:26.714 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.12765210099999999, 2021-10-08T19:42:26.714 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:26.714 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:26.715 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:42:26.715 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15870", 2021-10-08T19:42:26.715 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1128006081", 2021-10-08T19:42:26.715 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 101973 2021-10-08T19:42:26.716 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.716 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:26.716 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.716 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:26.716 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:39.692322+0000", 2021-10-08T19:42:26.717 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:26.717 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.717 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.717 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:26.717 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:39.692322+0000", 2021-10-08T19:42:26.718 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:26.718 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.718 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.718 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:26.718 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:39.692320+0000", 2021-10-08T19:42:26.719 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:42:26.719 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.719 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.719 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:26.720 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:39.692389+0000", 2021-10-08T19:42:26.720 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.9068999999999999e-05 2021-10-08T19:42:26.720 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.720 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.720 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:26.721 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:39.692433+0000", 2021-10-08T19:42:26.721 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.3429e-05 2021-10-08T19:42:26.721 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.721 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.721 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:26.722 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:39.692471+0000", 2021-10-08T19:42:26.722 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8733000000000003e-05 2021-10-08T19:42:26.722 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.722 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.722 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:26.723 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:39.692513+0000", 2021-10-08T19:42:26.723 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1816000000000001e-05 2021-10-08T19:42:26.723 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.723 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.724 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:26.724 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:39.692663+0000", 2021-10-08T19:42:26.724 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014971900000000001 2021-10-08T19:42:26.724 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.724 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.725 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 2,6", 2021-10-08T19:42:26.725 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:39.692835+0000", 2021-10-08T19:42:26.725 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000172468 2021-10-08T19:42:26.725 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.726 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.726 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:26.726 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:39.694945+0000", 2021-10-08T19:42:26.726 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021094859999999998 2021-10-08T19:42:26.726 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.727 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.727 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:42:26.727 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:39.695074+0000", 2021-10-08T19:42:26.727 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000129462 2021-10-08T19:42:26.728 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.728 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.728 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:26.728 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:39.819866+0000", 2021-10-08T19:42:26.729 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.124791844 2021-10-08T19:42:26.729 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.729 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.729 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:26.729 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:39.819930+0000", 2021-10-08T19:42:26.730 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4177000000000006e-05 2021-10-08T19:42:26.730 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.730 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.730 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:26.730 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:36:39.819974+0000", 2021-10-08T19:42:26.731 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.3812e-05 2021-10-08T19:42:26.731 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:26.731 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:26.731 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:26.732 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.732 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.732 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15870.0:122394 10.1 10:868e0221:::benchmark_data_smithi097_245820_object3892:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e393)", 2021-10-08T19:42:26.732 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:37:00.182757+0000", 2021-10-08T19:42:26.733 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 326.42684072399999, 2021-10-08T19:42:26.733 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.123962737, 2021-10-08T19:42:26.733 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:26.733 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:26.734 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:42:26.734 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15870", 2021-10-08T19:42:26.734 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1128006081", 2021-10-08T19:42:26.734 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 122394 2021-10-08T19:42:26.735 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.735 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:26.735 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.736 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:26.736 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:00.182757+0000", 2021-10-08T19:42:26.736 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:26.736 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.736 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.737 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:26.737 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:00.182757+0000", 2021-10-08T19:42:26.737 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:26.737 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.737 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.738 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:26.738 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:00.182757+0000", 2021-10-08T19:42:26.738 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999995 2021-10-08T19:42:26.738 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.739 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.739 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:26.739 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:00.182760+0000", 2021-10-08T19:42:26.739 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.0879999999999999e-06 2021-10-08T19:42:26.740 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.740 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.740 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:26.740 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:00.182765+0000", 2021-10-08T19:42:26.740 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5130000000000004e-06 2021-10-08T19:42:26.741 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.741 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.741 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:26.741 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:00.182768+0000", 2021-10-08T19:42:26.741 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.0359999999999998e-06 2021-10-08T19:42:26.742 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.742 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.742 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:26.742 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:00.184274+0000", 2021-10-08T19:42:26.743 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001505803 2021-10-08T19:42:26.743 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.743 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.743 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:26.743 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:00.184388+0000", 2021-10-08T19:42:26.744 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011438900000000001 2021-10-08T19:42:26.744 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.744 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.744 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,7", 2021-10-08T19:42:26.745 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:00.185213+0000", 2021-10-08T19:42:26.745 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00082463499999999999 2021-10-08T19:42:26.745 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.746 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.746 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:42:26.746 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:00.189929+0000", 2021-10-08T19:42:26.746 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0047163120000000003 2021-10-08T19:42:26.746 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.747 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.747 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:26.747 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:00.195286+0000", 2021-10-08T19:42:26.747 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053566229999999996 2021-10-08T19:42:26.748 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.748 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.748 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:26.748 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:00.306633+0000", 2021-10-08T19:42:26.748 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.111346772 2021-10-08T19:42:26.749 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.749 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.749 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:26.749 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:00.306683+0000", 2021-10-08T19:42:26.749 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9758e-05 2021-10-08T19:42:26.750 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.750 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.750 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:26.750 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:00.306720+0000", 2021-10-08T19:42:26.750 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7503999999999999e-05 2021-10-08T19:42:26.751 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:26.751 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:26.751 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:26.751 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.752 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.752 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15870.0:138040 10.e 10:7f14f857:::benchmark_data_smithi097_245820_object19538:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e396)", 2021-10-08T19:42:26.752 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:37:13.984518+0000", 2021-10-08T19:42:26.752 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 312.62507961799997, 2021-10-08T19:42:26.752 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.195546834, 2021-10-08T19:42:26.753 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:26.753 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:26.753 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:42:26.753 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15870", 2021-10-08T19:42:26.753 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1128006081", 2021-10-08T19:42:26.754 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 138040 2021-10-08T19:42:26.754 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.754 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:26.754 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.755 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:26.755 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:13.984518+0000", 2021-10-08T19:42:26.755 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:26.755 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.755 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.756 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:26.756 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:13.984518+0000", 2021-10-08T19:42:26.756 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:26.756 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.756 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.757 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:26.757 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:13.984517+0000", 2021-10-08T19:42:26.757 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:42:26.757 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.757 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.758 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:26.758 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:13.984523+0000", 2021-10-08T19:42:26.758 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5809999999999996e-06 2021-10-08T19:42:26.758 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.759 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.759 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:26.759 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:13.984530+0000", 2021-10-08T19:42:26.759 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6499999999999996e-06 2021-10-08T19:42:26.759 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.760 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.760 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:26.760 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:13.984535+0000", 2021-10-08T19:42:26.760 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5000000000000001e-06 2021-10-08T19:42:26.761 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.761 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.761 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:26.761 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:13.984567+0000", 2021-10-08T19:42:26.761 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2719999999999998e-05 2021-10-08T19:42:26.762 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.762 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.762 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:26.762 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:13.984646+0000", 2021-10-08T19:42:26.762 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8807000000000006e-05 2021-10-08T19:42:26.763 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.763 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.763 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 2,6", 2021-10-08T19:42:26.763 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:13.984721+0000", 2021-10-08T19:42:26.763 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4788000000000003e-05 2021-10-08T19:42:26.764 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.764 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.764 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:26.764 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:14.173893+0000", 2021-10-08T19:42:26.765 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.18917171899999999 2021-10-08T19:42:26.765 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.765 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.765 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:26.765 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:14.173931+0000", 2021-10-08T19:42:26.766 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8058000000000001e-05 2021-10-08T19:42:26.766 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.766 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.766 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:42:26.767 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:14.179968+0000", 2021-10-08T19:42:26.767 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0060370199999999997 2021-10-08T19:42:26.767 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.767 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.768 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:26.768 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:14.180022+0000", 2021-10-08T19:42:26.768 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.3838000000000002e-05 2021-10-08T19:42:26.768 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.768 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.769 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:26.769 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:14.180065+0000", 2021-10-08T19:42:26.769 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.3614e-05 2021-10-08T19:42:26.769 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:26.769 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:26.770 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:26.770 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.770 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.770 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop_reply(client.15870.0:138040 10.e e396/355 ondisk, result = 0)", 2021-10-08T19:42:26.770 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:37:13.986897+0000", 2021-10-08T19:42:26.771 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 312.62270090300001, 2021-10-08T19:42:26.771 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.186998155, 2021-10-08T19:42:26.771 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:26.771 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2021-10-08T19:42:26.772 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:26.772 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.772 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:26.772 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:13.986897+0000", 2021-10-08T19:42:26.772 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:26.773 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.773 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.773 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:26.773 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:13.986897+0000", 2021-10-08T19:42:26.773 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:26.774 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.774 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.774 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:26.775 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:13.986896+0000", 2021-10-08T19:42:26.775 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:42:26.775 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.775 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.776 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:26.776 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:13.986901+0000", 2021-10-08T19:42:26.776 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.3449999999999996e-06 2021-10-08T19:42:26.776 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.776 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.777 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:26.777 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:14.171730+0000", 2021-10-08T19:42:26.777 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.18482863099999999 2021-10-08T19:42:26.777 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.778 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.778 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:26.778 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:14.171741+0000", 2021-10-08T19:42:26.778 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.118e-05 2021-10-08T19:42:26.778 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.779 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.779 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:26.779 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:14.173876+0000", 2021-10-08T19:42:26.779 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021354149999999999 2021-10-08T19:42:26.780 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.780 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.780 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:26.780 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:14.173884+0000", 2021-10-08T19:42:26.781 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0860000000000002e-06 2021-10-08T19:42:26.781 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.781 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.781 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:26.782 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:14.173895+0000", 2021-10-08T19:42:26.782 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0861e-05 2021-10-08T19:42:26.782 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:26.782 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:26.782 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:26.783 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.783 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.783 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15870.0:171129 10.e 10:73b4ccb4:::benchmark_data_smithi097_245820_object52627:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e407)", 2021-10-08T19:42:26.783 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:37:45.432272+0000", 2021-10-08T19:42:26.784 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 281.17732628599998, 2021-10-08T19:42:26.784 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.12962267899999999, 2021-10-08T19:42:26.784 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:26.784 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:26.785 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:42:26.785 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15870", 2021-10-08T19:42:26.785 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1128006081", 2021-10-08T19:42:26.786 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 171129 2021-10-08T19:42:26.786 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.786 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:26.786 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.787 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:26.787 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:45.432272+0000", 2021-10-08T19:42:26.787 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:26.787 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.787 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.788 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:26.788 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:45.432272+0000", 2021-10-08T19:42:26.788 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:26.788 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.789 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.789 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:26.789 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:45.432270+0000", 2021-10-08T19:42:26.789 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:42:26.789 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.790 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.790 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:26.790 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:45.432277+0000", 2021-10-08T19:42:26.790 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2860000000000002e-06 2021-10-08T19:42:26.790 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.791 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.791 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:26.791 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:45.432290+0000", 2021-10-08T19:42:26.791 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3380000000000001e-05 2021-10-08T19:42:26.791 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.792 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.792 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:26.792 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:45.432296+0000", 2021-10-08T19:42:26.792 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.913e-06 2021-10-08T19:42:26.792 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.793 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.793 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:26.793 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:45.432334+0000", 2021-10-08T19:42:26.793 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7891e-05 2021-10-08T19:42:26.794 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.794 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.794 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:26.794 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:45.432444+0000", 2021-10-08T19:42:26.795 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000109585 2021-10-08T19:42:26.795 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.795 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.795 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 2,6", 2021-10-08T19:42:26.795 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:45.432567+0000", 2021-10-08T19:42:26.796 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012384700000000001 2021-10-08T19:42:26.796 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.796 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.796 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:42:26.796 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:45.435683+0000", 2021-10-08T19:42:26.797 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031158090000000002 2021-10-08T19:42:26.797 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.797 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.797 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:26.798 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:45.438564+0000", 2021-10-08T19:42:26.798 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028804600000000001 2021-10-08T19:42:26.798 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.798 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.798 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:26.799 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:45.561805+0000", 2021-10-08T19:42:26.799 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.123241511 2021-10-08T19:42:26.799 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.799 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.799 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:26.800 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:45.561855+0000", 2021-10-08T19:42:26.800 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0133999999999998e-05 2021-10-08T19:42:26.800 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.800 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.801 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:26.801 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:45.561894+0000", 2021-10-08T19:42:26.801 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9059e-05 2021-10-08T19:42:26.801 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:26.801 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:26.802 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:26.802 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.802 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.802 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15870.0:171130 10.e 10:7b690dc8:::benchmark_data_smithi097_245820_object52628:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e407)", 2021-10-08T19:42:26.803 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:37:45.436035+0000", 2021-10-08T19:42:26.803 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 281.17356350900002, 2021-10-08T19:42:26.803 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.12764703499999999, 2021-10-08T19:42:26.803 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:26.803 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:26.804 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:42:26.804 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15870", 2021-10-08T19:42:26.804 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1128006081", 2021-10-08T19:42:26.804 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 171130 2021-10-08T19:42:26.805 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.805 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:26.805 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.805 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:26.806 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:45.436035+0000", 2021-10-08T19:42:26.806 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:26.806 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.806 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.807 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:26.807 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:45.436035+0000", 2021-10-08T19:42:26.807 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:26.807 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.807 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.808 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:26.808 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:45.436032+0000", 2021-10-08T19:42:26.808 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:42:26.808 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.809 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.809 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:26.809 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:45.436047+0000", 2021-10-08T19:42:26.809 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4939999999999999e-05 2021-10-08T19:42:26.809 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.810 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.810 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:26.810 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:45.436059+0000", 2021-10-08T19:42:26.810 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1467e-05 2021-10-08T19:42:26.811 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.811 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.811 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:26.811 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:45.436066+0000", 2021-10-08T19:42:26.811 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.08e-06 2021-10-08T19:42:26.812 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.812 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.812 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:26.812 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:45.436110+0000", 2021-10-08T19:42:26.813 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4350000000000001e-05 2021-10-08T19:42:26.813 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.813 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.813 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:26.813 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:45.436248+0000", 2021-10-08T19:42:26.814 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000137534 2021-10-08T19:42:26.814 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.814 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.815 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 2,6", 2021-10-08T19:42:26.815 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:45.436379+0000", 2021-10-08T19:42:26.815 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013169700000000001 2021-10-08T19:42:26.815 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.816 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.816 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:26.816 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:45.438814+0000", 2021-10-08T19:42:26.816 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024349369999999999 2021-10-08T19:42:26.816 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.817 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.817 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:42:26.817 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:45.438827+0000", 2021-10-08T19:42:26.817 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2619999999999999e-05 2021-10-08T19:42:26.818 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.818 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.818 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:26.818 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:45.563598+0000", 2021-10-08T19:42:26.818 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.12477112899999999 2021-10-08T19:42:26.819 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.819 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.819 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:26.819 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:45.563644+0000", 2021-10-08T19:42:26.820 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.6038999999999997e-05 2021-10-08T19:42:26.820 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.820 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.820 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:26.820 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:45.563682+0000", 2021-10-08T19:42:26.821 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7360000000000001e-05 2021-10-08T19:42:26.821 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:26.821 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:26.821 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:26.821 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.822 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.822 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15870.0:175899 10.e 10:71248530:::benchmark_data_smithi097_245820_object57397:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e409)", 2021-10-08T19:42:26.822 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:37:49.899930+0000", 2021-10-08T19:42:26.822 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 276.70966774800002, 2021-10-08T19:42:26.823 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.17888717000000001, 2021-10-08T19:42:26.823 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:26.823 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:26.823 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:42:26.823 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15870", 2021-10-08T19:42:26.824 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1128006081", 2021-10-08T19:42:26.824 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 175899 2021-10-08T19:42:26.824 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.824 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:26.824 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.825 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:26.825 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:49.899930+0000", 2021-10-08T19:42:26.825 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:26.825 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.826 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.826 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:26.826 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:49.899930+0000", 2021-10-08T19:42:26.826 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:26.826 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.827 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.827 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:26.827 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:49.899928+0000", 2021-10-08T19:42:26.827 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:42:26.827 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.828 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.828 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:26.828 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:49.899935+0000", 2021-10-08T19:42:26.828 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4450000000000001e-06 2021-10-08T19:42:26.829 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.829 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.829 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:26.829 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:49.899947+0000", 2021-10-08T19:42:26.829 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2374999999999999e-05 2021-10-08T19:42:26.830 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.830 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.830 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:26.830 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:49.899954+0000", 2021-10-08T19:42:26.830 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4500000000000001e-06 2021-10-08T19:42:26.831 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.831 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.831 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:26.831 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:49.899998+0000", 2021-10-08T19:42:26.832 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4656000000000001e-05 2021-10-08T19:42:26.832 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.832 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.832 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:26.833 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:49.900116+0000", 2021-10-08T19:42:26.833 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000117547 2021-10-08T19:42:26.833 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.833 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.834 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 2,6", 2021-10-08T19:42:26.834 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:49.900243+0000", 2021-10-08T19:42:26.834 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012678200000000001 2021-10-08T19:42:26.834 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.835 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.835 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:42:26.835 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:49.904614+0000", 2021-10-08T19:42:26.835 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0043713789999999999 2021-10-08T19:42:26.836 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.836 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.836 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:26.836 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:49.908139+0000", 2021-10-08T19:42:26.836 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0035251599999999998 2021-10-08T19:42:26.837 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.837 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.837 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:26.837 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:50.078725+0000", 2021-10-08T19:42:26.837 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.17058566 2021-10-08T19:42:26.838 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.838 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.838 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:26.838 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:50.078776+0000", 2021-10-08T19:42:26.839 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1100999999999997e-05 2021-10-08T19:42:26.839 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.839 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.839 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:26.839 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:50.078817+0000", 2021-10-08T19:42:26.840 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1451e-05 2021-10-08T19:42:26.840 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:26.840 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:26.840 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:26.840 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.841 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.841 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15870.0:175904 10.e 10:7bd867ed:::benchmark_data_smithi097_245820_object57402:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e409)", 2021-10-08T19:42:26.841 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:37:49.900097+0000", 2021-10-08T19:42:26.841 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 276.70950064099998, 2021-10-08T19:42:26.841 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.18153095999999999, 2021-10-08T19:42:26.842 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:26.842 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:26.842 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:42:26.842 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15870", 2021-10-08T19:42:26.843 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1128006081", 2021-10-08T19:42:26.843 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 175904 2021-10-08T19:42:26.843 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.843 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:26.843 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.844 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:26.844 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:49.900097+0000", 2021-10-08T19:42:26.844 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:26.844 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.845 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.845 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:26.845 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:49.900097+0000", 2021-10-08T19:42:26.845 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:26.845 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.846 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.846 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:26.846 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:49.900097+0000", 2021-10-08T19:42:26.846 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:42:26.847 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.847 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.847 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:26.847 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:49.900100+0000", 2021-10-08T19:42:26.847 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.631e-06 2021-10-08T19:42:26.848 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.848 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.848 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:26.848 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:49.900107+0000", 2021-10-08T19:42:26.848 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6490000000000002e-06 2021-10-08T19:42:26.849 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.849 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.849 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:26.849 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:49.900111+0000", 2021-10-08T19:42:26.849 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1860000000000002e-06 2021-10-08T19:42:26.850 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.850 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.850 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:26.850 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:49.902417+0000", 2021-10-08T19:42:26.851 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0023057400000000001 2021-10-08T19:42:26.851 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.851 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.851 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:26.851 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:49.902542+0000", 2021-10-08T19:42:26.852 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012556199999999999 2021-10-08T19:42:26.852 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.852 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.852 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 2,6", 2021-10-08T19:42:26.852 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:49.902666+0000", 2021-10-08T19:42:26.853 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000124089 2021-10-08T19:42:26.853 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.853 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.853 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:42:26.854 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:49.904941+0000", 2021-10-08T19:42:26.854 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022743210000000002 2021-10-08T19:42:26.854 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.854 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.854 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:26.855 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:49.911362+0000", 2021-10-08T19:42:26.855 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0064210439999999999 2021-10-08T19:42:26.855 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.855 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.855 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:26.856 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:50.081531+0000", 2021-10-08T19:42:26.856 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.17016894099999999 2021-10-08T19:42:26.856 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.856 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.856 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:26.857 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:50.081585+0000", 2021-10-08T19:42:26.857 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4339999999999998e-05 2021-10-08T19:42:26.857 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.857 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.857 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:26.858 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:50.081628+0000", 2021-10-08T19:42:26.858 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.3248000000000003e-05 2021-10-08T19:42:26.858 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:26.858 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:26.859 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:26.859 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.859 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.859 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15870.0:175909 10.e 10:7914d25a:::benchmark_data_smithi097_245820_object57407:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e409)", 2021-10-08T19:42:26.859 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:37:49.908157+0000", 2021-10-08T19:42:26.860 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 276.70144101300002, 2021-10-08T19:42:26.860 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.17363004300000001, 2021-10-08T19:42:26.860 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:26.860 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:26.860 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:42:26.861 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15870", 2021-10-08T19:42:26.861 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1128006081", 2021-10-08T19:42:26.861 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 175909 2021-10-08T19:42:26.861 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.862 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:26.862 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.862 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:26.862 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:49.908157+0000", 2021-10-08T19:42:26.862 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:26.863 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.863 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.863 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:26.863 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:49.908157+0000", 2021-10-08T19:42:26.863 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:26.864 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.864 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.864 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:26.864 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:49.908155+0000", 2021-10-08T19:42:26.864 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:42:26.865 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.865 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.865 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:26.865 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:49.908161+0000", 2021-10-08T19:42:26.866 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7790000000000001e-06 2021-10-08T19:42:26.866 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.866 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.866 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:26.866 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:49.908177+0000", 2021-10-08T19:42:26.867 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6246999999999999e-05 2021-10-08T19:42:26.867 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.867 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.867 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:26.867 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:49.908184+0000", 2021-10-08T19:42:26.868 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4790000000000001e-06 2021-10-08T19:42:26.868 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.868 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.868 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:26.868 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:49.908230+0000", 2021-10-08T19:42:26.869 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.6288000000000001e-05 2021-10-08T19:42:26.869 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.869 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.869 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:26.870 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:49.908354+0000", 2021-10-08T19:42:26.870 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012404000000000001 2021-10-08T19:42:26.870 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.870 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.870 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 2,6", 2021-10-08T19:42:26.871 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:49.908508+0000", 2021-10-08T19:42:26.871 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000154108 2021-10-08T19:42:26.871 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.871 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.871 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:42:26.872 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:49.910749+0000", 2021-10-08T19:42:26.872 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022407019999999998 2021-10-08T19:42:26.872 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.872 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.872 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:26.873 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:49.911711+0000", 2021-10-08T19:42:26.873 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00096232499999999999 2021-10-08T19:42:26.873 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.873 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.873 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:26.874 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:50.081697+0000", 2021-10-08T19:42:26.874 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.16998614000000001 2021-10-08T19:42:26.874 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.874 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.875 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:26.875 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:50.081750+0000", 2021-10-08T19:42:26.875 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2182000000000003e-05 2021-10-08T19:42:26.875 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.875 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.876 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:26.876 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:37:50.081787+0000", 2021-10-08T19:42:26.876 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7379000000000002e-05 2021-10-08T19:42:26.876 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:26.876 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:26.877 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:26.877 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.877 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.877 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.26125.0:89308 11.e 11:72cc9f14:::benchmark_data_smithi097_295476_object89307:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e460)", 2021-10-08T19:42:26.877 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:40:14.329307+0000", 2021-10-08T19:42:26.878 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 132.28029143800001, 2021-10-08T19:42:26.878 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.16243429100000001, 2021-10-08T19:42:26.878 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:26.878 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:26.879 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:42:26.879 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.26125", 2021-10-08T19:42:26.879 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:42:26.879 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 89308 2021-10-08T19:42:26.879 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.880 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:26.880 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.880 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:26.880 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:14.329307+0000", 2021-10-08T19:42:26.880 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:26.881 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.881 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.881 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:26.881 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:14.329307+0000", 2021-10-08T19:42:26.881 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:26.882 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.882 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.882 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:26.882 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:14.329305+0000", 2021-10-08T19:42:26.882 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:42:26.883 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.883 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.883 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:26.883 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:14.329375+0000", 2021-10-08T19:42:26.883 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0496999999999999e-05 2021-10-08T19:42:26.884 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.884 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.884 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:26.884 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:14.329388+0000", 2021-10-08T19:42:26.885 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2839e-05 2021-10-08T19:42:26.885 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.885 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.885 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:26.885 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:14.329395+0000", 2021-10-08T19:42:26.886 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1189999999999999e-06 2021-10-08T19:42:26.886 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.886 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.886 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:26.886 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:14.329443+0000", 2021-10-08T19:42:26.887 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7796000000000001e-05 2021-10-08T19:42:26.887 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.887 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.887 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:26.887 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:14.329591+0000", 2021-10-08T19:42:26.888 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014860900000000001 2021-10-08T19:42:26.888 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.888 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.888 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 1,7", 2021-10-08T19:42:26.888 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:14.329749+0000", 2021-10-08T19:42:26.889 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000157386 2021-10-08T19:42:26.889 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.889 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.889 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:42:26.890 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:14.331914+0000", 2021-10-08T19:42:26.890 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002164792 2021-10-08T19:42:26.890 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.890 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.890 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:26.891 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:14.333038+0000", 2021-10-08T19:42:26.891 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0011239640000000001 2021-10-08T19:42:26.891 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.891 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.892 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:26.892 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:14.491674+0000", 2021-10-08T19:42:26.892 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.15863606999999999 2021-10-08T19:42:26.892 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.892 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.893 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:26.893 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:14.491715+0000", 2021-10-08T19:42:26.893 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0827000000000001e-05 2021-10-08T19:42:26.893 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.893 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.894 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:26.894 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:14.491741+0000", 2021-10-08T19:42:26.894 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6349000000000001e-05 2021-10-08T19:42:26.894 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:26.894 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:26.895 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:26.895 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.895 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.895 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.26125.0:89311 11.e 11:7aebfaf3:::benchmark_data_smithi097_295476_object89310:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e460)", 2021-10-08T19:42:26.895 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:40:14.334470+0000", 2021-10-08T19:42:26.896 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 132.27512770600001, 2021-10-08T19:42:26.896 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.157343759, 2021-10-08T19:42:26.896 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:26.896 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:26.897 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:42:26.897 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.26125", 2021-10-08T19:42:26.897 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:42:26.897 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 89311 2021-10-08T19:42:26.897 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.898 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:26.898 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.898 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:26.898 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:14.334470+0000", 2021-10-08T19:42:26.898 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:26.899 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.899 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.899 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:26.899 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:14.334470+0000", 2021-10-08T19:42:26.899 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:26.900 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.900 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.900 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:26.900 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:14.334468+0000", 2021-10-08T19:42:26.900 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:42:26.901 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.901 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.901 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:26.901 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:14.334523+0000", 2021-10-08T19:42:26.901 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5627999999999997e-05 2021-10-08T19:42:26.902 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.902 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.902 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:26.902 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:14.334535+0000", 2021-10-08T19:42:26.903 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1827e-05 2021-10-08T19:42:26.903 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.903 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.903 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:26.903 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:14.334541+0000", 2021-10-08T19:42:26.904 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2499999999999997e-06 2021-10-08T19:42:26.904 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.904 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.904 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:26.904 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:14.334578+0000", 2021-10-08T19:42:26.905 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7487000000000002e-05 2021-10-08T19:42:26.905 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.905 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.905 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:26.905 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:14.334690+0000", 2021-10-08T19:42:26.906 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112409 2021-10-08T19:42:26.906 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.906 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.906 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 1,7", 2021-10-08T19:42:26.906 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:14.334807+0000", 2021-10-08T19:42:26.907 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011633099999999999 2021-10-08T19:42:26.907 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.907 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.907 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:42:26.907 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:14.336671+0000", 2021-10-08T19:42:26.908 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001864187 2021-10-08T19:42:26.908 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.908 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.908 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:26.909 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:14.336910+0000", 2021-10-08T19:42:26.909 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000239285 2021-10-08T19:42:26.909 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.909 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.910 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:26.910 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:14.491766+0000", 2021-10-08T19:42:26.910 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.15485587100000001 2021-10-08T19:42:26.910 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.910 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.911 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:26.911 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:14.491794+0000", 2021-10-08T19:42:26.911 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7637999999999999e-05 2021-10-08T19:42:26.911 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.911 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.912 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:26.912 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:14.491814+0000", 2021-10-08T19:42:26.912 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0296999999999999e-05 2021-10-08T19:42:26.912 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:26.913 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:26.913 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:26.913 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.913 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.913 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.26125.0:103653 11.e 11:7fe65c66:::benchmark_data_smithi097_295476_object103652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e466)", 2021-10-08T19:42:26.914 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:40:28.921222+0000", 2021-10-08T19:42:26.914 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 117.688375998, 2021-10-08T19:42:26.914 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.142256144, 2021-10-08T19:42:26.914 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:26.914 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:26.915 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:42:26.915 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.26125", 2021-10-08T19:42:26.915 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:42:26.915 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 103653 2021-10-08T19:42:26.915 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.916 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:26.916 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.916 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:26.916 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:28.921222+0000", 2021-10-08T19:42:26.917 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:26.917 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.917 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.917 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:26.917 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:28.921222+0000", 2021-10-08T19:42:26.918 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:26.918 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.918 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.918 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:26.918 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:28.921219+0000", 2021-10-08T19:42:26.919 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999971 2021-10-08T19:42:26.919 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.919 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.919 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:26.919 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:28.921263+0000", 2021-10-08T19:42:26.920 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.3245999999999999e-05 2021-10-08T19:42:26.920 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.920 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.920 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:26.921 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:28.921283+0000", 2021-10-08T19:42:26.921 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0718999999999999e-05 2021-10-08T19:42:26.921 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.921 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.921 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:26.922 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:28.921293+0000", 2021-10-08T19:42:26.922 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.1980000000000007e-06 2021-10-08T19:42:26.922 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.922 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.922 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:26.923 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:28.921347+0000", 2021-10-08T19:42:26.923 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4627999999999999e-05 2021-10-08T19:42:26.923 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.923 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.923 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:26.924 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:28.921496+0000", 2021-10-08T19:42:26.924 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000148894 2021-10-08T19:42:26.924 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.924 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.924 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 1,7", 2021-10-08T19:42:26.925 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:28.921926+0000", 2021-10-08T19:42:26.925 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00042956100000000002 2021-10-08T19:42:26.925 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.925 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.926 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:42:26.926 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:28.924492+0000", 2021-10-08T19:42:26.926 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0025662459999999999 2021-10-08T19:42:26.926 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.926 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.927 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:26.927 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:28.924980+0000", 2021-10-08T19:42:26.927 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00048823999999999997 2021-10-08T19:42:26.927 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.927 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.928 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:26.928 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:29.063361+0000", 2021-10-08T19:42:26.928 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.138381226 2021-10-08T19:42:26.928 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.928 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.929 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:26.929 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:29.063431+0000", 2021-10-08T19:42:26.929 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.9292e-05 2021-10-08T19:42:26.929 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.929 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.930 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:26.930 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:29.063478+0000", 2021-10-08T19:42:26.930 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7559999999999999e-05 2021-10-08T19:42:26.930 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:26.931 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:26.931 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:26.931 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.931 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.931 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.26125.0:106123 11.e 11:79558f0f:::benchmark_data_smithi097_295476_object106122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e466)", 2021-10-08T19:42:26.932 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:40:31.590477+0000", 2021-10-08T19:42:26.932 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 115.01912119399999, 2021-10-08T19:42:26.932 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.172067731, 2021-10-08T19:42:26.932 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:26.932 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:26.933 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:42:26.933 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.26125", 2021-10-08T19:42:26.933 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:42:26.933 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 106123 2021-10-08T19:42:26.933 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.934 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:26.934 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.934 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:26.934 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.590477+0000", 2021-10-08T19:42:26.934 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:26.935 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.935 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.935 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:26.935 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.590477+0000", 2021-10-08T19:42:26.935 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:26.936 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.936 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.936 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:26.936 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.590474+0000", 2021-10-08T19:42:26.936 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999971 2021-10-08T19:42:26.937 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.937 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.937 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:26.937 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.590519+0000", 2021-10-08T19:42:26.937 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4438999999999999e-05 2021-10-08T19:42:26.938 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.938 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.938 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:26.938 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.590529+0000", 2021-10-08T19:42:26.939 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0771000000000001e-05 2021-10-08T19:42:26.939 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.939 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.939 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:26.939 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.590535+0000", 2021-10-08T19:42:26.940 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5099999999999998e-06 2021-10-08T19:42:26.940 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.940 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.940 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:26.940 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.590577+0000", 2021-10-08T19:42:26.941 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1961e-05 2021-10-08T19:42:26.941 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.941 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.941 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:26.941 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.590711+0000", 2021-10-08T19:42:26.942 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013442799999999999 2021-10-08T19:42:26.942 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.942 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.942 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 1,7", 2021-10-08T19:42:26.943 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.590884+0000", 2021-10-08T19:42:26.943 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017237700000000001 2021-10-08T19:42:26.943 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.943 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.943 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:26.944 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.597110+0000", 2021-10-08T19:42:26.944 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0062260470000000002 2021-10-08T19:42:26.944 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.944 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.944 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:42:26.945 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.597128+0000", 2021-10-08T19:42:26.945 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8335999999999999e-05 2021-10-08T19:42:26.945 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.945 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.945 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:26.946 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.762475+0000", 2021-10-08T19:42:26.946 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.16534706800000001 2021-10-08T19:42:26.946 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.946 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.946 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:26.947 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.762520+0000", 2021-10-08T19:42:26.947 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4901999999999998e-05 2021-10-08T19:42:26.947 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.947 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.948 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:26.948 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.762545+0000", 2021-10-08T19:42:26.948 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4516999999999999e-05 2021-10-08T19:42:26.948 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:26.948 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:26.949 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:26.949 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.949 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.949 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.26125.0:106133 11.e 11:73ad8965:::benchmark_data_smithi097_295476_object106132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e466)", 2021-10-08T19:42:26.949 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:40:31.597449+0000", 2021-10-08T19:42:26.950 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 115.01214863, 2021-10-08T19:42:26.950 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.165337069, 2021-10-08T19:42:26.950 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:26.950 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:26.951 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:42:26.951 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.26125", 2021-10-08T19:42:26.951 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:42:26.951 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 106133 2021-10-08T19:42:26.951 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.952 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:26.952 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.952 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:26.952 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.597449+0000", 2021-10-08T19:42:26.952 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:26.953 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.953 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.953 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:26.953 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.597449+0000", 2021-10-08T19:42:26.953 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:26.954 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.954 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.954 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:26.954 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.597447+0000", 2021-10-08T19:42:26.955 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:42:26.955 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.955 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.955 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:26.955 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.597501+0000", 2021-10-08T19:42:26.956 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4496000000000001e-05 2021-10-08T19:42:26.956 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.956 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.956 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:26.956 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.597514+0000", 2021-10-08T19:42:26.957 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2129e-05 2021-10-08T19:42:26.957 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.957 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.957 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:26.957 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.597520+0000", 2021-10-08T19:42:26.958 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9839999999999998e-06 2021-10-08T19:42:26.958 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.958 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.958 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:26.959 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.597565+0000", 2021-10-08T19:42:26.959 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5547000000000003e-05 2021-10-08T19:42:26.959 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.959 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.959 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:26.960 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.597723+0000", 2021-10-08T19:42:26.960 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000157701 2021-10-08T19:42:26.960 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.960 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.961 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 1,7", 2021-10-08T19:42:26.961 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.597897+0000", 2021-10-08T19:42:26.961 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017429500000000001 2021-10-08T19:42:26.961 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.961 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.962 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:42:26.962 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.599861+0000", 2021-10-08T19:42:26.962 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001963916 2021-10-08T19:42:26.962 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.962 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.963 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:26.963 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.600127+0000", 2021-10-08T19:42:26.963 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00026565699999999998 2021-10-08T19:42:26.963 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.963 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.964 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:26.964 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.762692+0000", 2021-10-08T19:42:26.964 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.16256528000000001 2021-10-08T19:42:26.964 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.964 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.965 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:26.965 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.762747+0000", 2021-10-08T19:42:26.965 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4956e-05 2021-10-08T19:42:26.965 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.965 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.966 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:26.966 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.762786+0000", 2021-10-08T19:42:26.966 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9595999999999998e-05 2021-10-08T19:42:26.966 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:26.967 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:26.967 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:26.967 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.967 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.968 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.26125.0:106139 11.e 11:7e6f7e1d:::benchmark_data_smithi097_295476_object106138:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e466)", 2021-10-08T19:42:26.968 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:40:31.601950+0000", 2021-10-08T19:42:26.968 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 115.007648351, 2021-10-08T19:42:26.968 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.16096450800000001, 2021-10-08T19:42:26.968 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:26.969 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:26.969 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:42:26.969 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.26125", 2021-10-08T19:42:26.969 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:42:26.969 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 106139 2021-10-08T19:42:26.970 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.970 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:26.970 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.970 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:26.971 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.601950+0000", 2021-10-08T19:42:26.971 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:26.971 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.971 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.971 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:26.972 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.601950+0000", 2021-10-08T19:42:26.972 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:26.972 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.972 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.972 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:26.973 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.601948+0000", 2021-10-08T19:42:26.973 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:42:26.973 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.973 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.973 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:26.974 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.601998+0000", 2021-10-08T19:42:26.974 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0226000000000003e-05 2021-10-08T19:42:26.974 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.974 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.975 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:26.975 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.602009+0000", 2021-10-08T19:42:26.975 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1282e-05 2021-10-08T19:42:26.975 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.975 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.976 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:26.976 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.602014+0000", 2021-10-08T19:42:26.976 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7999999999999998e-06 2021-10-08T19:42:26.976 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.976 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.977 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:26.977 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.602062+0000", 2021-10-08T19:42:26.977 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7542e-05 2021-10-08T19:42:26.977 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.977 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.978 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:26.978 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.602200+0000", 2021-10-08T19:42:26.978 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013801800000000001 2021-10-08T19:42:26.978 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.979 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.979 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 1,7", 2021-10-08T19:42:26.979 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.602385+0000", 2021-10-08T19:42:26.979 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00018529899999999999 2021-10-08T19:42:26.979 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.980 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.980 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:42:26.980 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.603942+0000", 2021-10-08T19:42:26.980 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00155685 2021-10-08T19:42:26.980 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.981 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.981 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:26.981 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.604306+0000", 2021-10-08T19:42:26.981 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000364495 2021-10-08T19:42:26.981 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.982 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.982 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:26.982 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.762838+0000", 2021-10-08T19:42:26.982 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.15853160999999999 2021-10-08T19:42:26.983 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.983 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.983 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:26.983 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.762880+0000", 2021-10-08T19:42:26.983 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1826000000000002e-05 2021-10-08T19:42:26.984 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:26.984 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:26.984 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:26.984 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.762914+0000", 2021-10-08T19:42:26.984 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4437000000000002e-05 2021-10-08T19:42:26.985 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:26.985 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:26.985 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:26.985 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:26.985 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:26.986 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:42:26.986 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:42:26.988 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:42:26.988 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:42:26.989 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:42:26.989 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:42:26.989 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:42:26.989 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:42:26.990 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'false' 2021-10-08T19:42:26.990 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'false' 2021-10-08T19:42:26.990 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'false' 2021-10-08T19:42:26.990 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'false' 2021-10-08T19:42:26.991 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'false' 2021-10-08T19:42:26.991 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'false' 2021-10-08T19:42:26.991 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'false' 2021-10-08T19:42:26.991 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'false' 2021-10-08T19:42:27.027 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:27.102 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:42:27.105 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:27.105 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:42:27.207 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 2021-10-08T19:42:27.239 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:27.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:27 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2309336075' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:42:27.529 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:42:27.534 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:27.535 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5' 2021-10-08T19:42:27.546 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2021-10-08T19:42:27.637 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:42:27.680 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:27 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2309336075' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:42:27.681 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:27 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2309336075' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:42:27.686 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:27.831 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:42:27.835 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 4, 5, 7, 6, 1, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2021-10-08T19:42:27.835 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2021-10-08T19:42:27.836 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd dump -f json-pretty 2021-10-08T19:42:27.850 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:27.851 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:42:27.905 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:42:27 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:42:27.952 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:42:27.998 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:28.040 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd set nodeep-scrub 2021-10-08T19:42:28.087 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:42:28.090 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:28.091 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:42:28.192 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:42:28.242 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:28.309 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:42:28.312 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:28.313 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:42:28.371 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:42:28.414 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:42:28.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:28 smithi097 ceph-mon[32687]: pgmap v1047: 188 pgs: 188 active+clean; 291 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 682 B/s rd, 0 B/s wr, 839 op/s; 18 B/s, 0 objects/s recovering 2021-10-08T19:42:28.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:28 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:42:28.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:28 smithi097 ceph-mon[41966]: pgmap v1047: 188 pgs: 188 active+clean; 291 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 682 B/s rd, 0 B/s wr, 839 op/s; 18 B/s, 0 objects/s recovering 2021-10-08T19:42:28.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:28 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:42:28.487 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:28.537 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:28 smithi117 ceph-mon[34585]: pgmap v1047: 188 pgs: 188 active+clean; 291 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 682 B/s rd, 0 B/s wr, 839 op/s; 18 B/s, 0 objects/s recovering 2021-10-08T19:42:28.537 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:28 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:42:28.553 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Removed 113746 objects 2021-10-08T19:42:28.554 INFO:tasks.radosbench.radosbench.0.smithi097.stdout:Clean up completed and total clean up time :108.844 2021-10-08T19:42:28.554 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:42:28.719 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:42:28.722 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:28.723 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:42:28.824 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:42:28.849 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:28.945 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:42:28.949 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:28.950 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:42:29.044 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:42:29.051 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:42:29.077 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:29.719 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:42:29.723 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:29.724 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:42:29.825 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:42:29.856 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:29.872 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2021-10-08T19:42:30.016 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:42:30.019 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:30.019 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:42:30.121 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:42:30.157 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:30.364 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:42:30.369 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:30.369 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:42:30.414 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:30 smithi097 ceph-mon[41966]: pgmap v1048: 188 pgs: 188 active+clean; 159 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 521 B/s rd, 0 B/s wr, 911 op/s; 13 B/s, 0 objects/s recovering 2021-10-08T19:42:30.415 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:30 smithi097 ceph-mon[32687]: pgmap v1048: 188 pgs: 188 active+clean; 159 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 521 B/s rd, 0 B/s wr, 911 op/s; 13 B/s, 0 objects/s recovering 2021-10-08T19:42:30.471 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:42:30.475 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:42:30.500 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:30.591 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:30 smithi117 ceph-mon[34585]: pgmap v1048: 188 pgs: 188 active+clean; 159 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 521 B/s rd, 0 B/s wr, 911 op/s; 13 B/s, 0 objects/s recovering 2021-10-08T19:42:31.103 INFO:tasks.cephadm.ceph_manager.ceph:removing pool_name unique_pool_4 2021-10-08T19:42:31.104 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd pool rm unique_pool_4 unique_pool_4 --yes-i-really-really-mean-it 2021-10-08T19:42:31.204 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:42:31.204 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2021-10-08T19:42:31.204 INFO:teuthology.orchestra.run.smithi097.stdout: "epoch": 495, 2021-10-08T19:42:31.205 INFO:teuthology.orchestra.run.smithi097.stdout: "fsid": "1d01f6d6-286c-11ec-8c25-001a4aab830c", 2021-10-08T19:42:31.205 INFO:teuthology.orchestra.run.smithi097.stdout: "created": "2021-10-08T19:16:25.258003+0000", 2021-10-08T19:42:31.205 INFO:teuthology.orchestra.run.smithi097.stdout: "modified": "2021-10-08T19:42:25.226934+0000", 2021-10-08T19:42:31.205 INFO:teuthology.orchestra.run.smithi097.stdout: "last_up_change": "2021-10-08T19:21:15.388758+0000", 2021-10-08T19:42:31.205 INFO:teuthology.orchestra.run.smithi097.stdout: "last_in_change": "2021-10-08T19:29:39.736986+0000", 2021-10-08T19:42:31.206 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-08T19:42:31.206 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_num": 5801984, 2021-10-08T19:42:31.206 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_set": [ 2021-10-08T19:42:31.206 INFO:teuthology.orchestra.run.smithi097.stdout: "noscrub", 2021-10-08T19:42:31.207 INFO:teuthology.orchestra.run.smithi097.stdout: "pglog_hardlimit", 2021-10-08T19:42:31.207 INFO:teuthology.orchestra.run.smithi097.stdout: "purged_snapdirs", 2021-10-08T19:42:31.207 INFO:teuthology.orchestra.run.smithi097.stdout: "recovery_deletes", 2021-10-08T19:42:31.207 INFO:teuthology.orchestra.run.smithi097.stdout: "sortbitwise" 2021-10-08T19:42:31.208 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:42:31.208 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_version": 18, 2021-10-08T19:42:31.208 INFO:teuthology.orchestra.run.smithi097.stdout: "full_ratio": 0.94999998807907104, 2021-10-08T19:42:31.208 INFO:teuthology.orchestra.run.smithi097.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-08T19:42:31.208 INFO:teuthology.orchestra.run.smithi097.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-08T19:42:31.209 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_snapshot": "", 2021-10-08T19:42:31.209 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_max": 11, 2021-10-08T19:42:31.209 INFO:teuthology.orchestra.run.smithi097.stdout: "max_osd": 8, 2021-10-08T19:42:31.209 INFO:teuthology.orchestra.run.smithi097.stdout: "require_min_compat_client": "luminous", 2021-10-08T19:42:31.209 INFO:teuthology.orchestra.run.smithi097.stdout: "min_compat_client": "luminous", 2021-10-08T19:42:31.210 INFO:teuthology.orchestra.run.smithi097.stdout: "require_osd_release": "quincy", 2021-10-08T19:42:31.210 INFO:teuthology.orchestra.run.smithi097.stdout: "pools": [ 2021-10-08T19:42:31.210 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.210 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 1, 2021-10-08T19:42:31.211 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": ".mgr", 2021-10-08T19:42:31.211 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:19:44.413311+0000", 2021-10-08T19:42:31.211 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:42:31.211 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:42:31.212 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:42:31.212 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:42:31.212 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:42:31.212 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:42:31.212 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:42:31.213 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:42:31.213 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:42:31.213 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:42:31.214 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:42:31.214 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:42:31.214 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 11, 2021-10-08T19:42:31.214 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 11, 2021-10-08T19:42:31.214 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 11, 2021-10-08T19:42:31.215 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 11, 2021-10-08T19:42:31.215 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 11, 2021-10-08T19:42:31.215 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:42:31.215 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:42:31.216 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:42:31.216 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:42:31.216 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:42:31.216 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:42:31.216 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:42:31.217 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.217 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "171", 2021-10-08T19:42:31.217 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:42:31.217 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:42:31.218 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "170", 2021-10-08T19:42:31.218 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:42:31.218 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:42:31.218 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:42:31.218 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:42:31.219 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:42:31.219 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:42:31.219 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:42:31.219 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:42:31.219 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:42:31.220 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:42:31.220 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:42:31.220 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:42:31.220 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:42:31.221 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:42:31.221 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:42:31.221 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:42:31.221 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:42:31.221 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:42:31.222 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:42:31.222 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:42:31.222 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:42:31.222 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:42:31.223 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:42:31.223 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.223 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:42:31.224 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:42:31.224 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:42:31.224 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:42:31.224 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:42:31.225 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:42:31.225 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:42:31.225 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:42:31.225 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:42:31.226 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:42:31.226 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:42:31.226 INFO:teuthology.orchestra.run.smithi097.stdout: "options": { 2021-10-08T19:42:31.226 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_min": 1 2021-10-08T19:42:31.226 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.227 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:42:31.227 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": {} 2021-10-08T19:42:31.227 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:31.227 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.228 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.228 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 2, 2021-10-08T19:42:31.228 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": ".rgw.root", 2021-10-08T19:42:31.228 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:21:21.940881+0000", 2021-10-08T19:42:31.228 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:42:31.229 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:42:31.229 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:42:31.229 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:42:31.229 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:42:31.229 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:42:31.230 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:42:31.230 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:42:31.230 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:42:31.230 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:42:31.231 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:42:31.231 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:42:31.231 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 42, 2021-10-08T19:42:31.231 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 42, 2021-10-08T19:42:31.231 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 42, 2021-10-08T19:42:31.232 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 42, 2021-10-08T19:42:31.232 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 42, 2021-10-08T19:42:31.232 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:42:31.232 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:42:31.233 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:42:31.233 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:42:31.233 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:42:31.233 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:42:31.233 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:42:31.234 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.234 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "393", 2021-10-08T19:42:31.234 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:42:31.234 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:42:31.234 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "391", 2021-10-08T19:42:31.235 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:42:31.235 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:42:31.235 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:42:31.235 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:42:31.236 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:42:31.236 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:42:31.236 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:42:31.236 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:42:31.236 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:42:31.237 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:42:31.237 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:42:31.237 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:42:31.237 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:42:31.238 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:42:31.238 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:42:31.238 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:42:31.238 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:42:31.238 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:42:31.239 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:42:31.239 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:42:31.239 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:42:31.239 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:42:31.239 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:42:31.240 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.240 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:42:31.240 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:42:31.240 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:42:31.241 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:42:31.241 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:42:31.241 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:42:31.241 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:42:31.241 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:42:31.242 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:42:31.242 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:42:31.242 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:42:31.242 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2021-10-08T19:42:31.243 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:42:31.243 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw": {} 2021-10-08T19:42:31.243 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:31.243 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.243 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.244 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 3, 2021-10-08T19:42:31.244 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "iscsi", 2021-10-08T19:42:31.244 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:21:22.536945+0000", 2021-10-08T19:42:31.244 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:42:31.245 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:42:31.245 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:42:31.245 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:42:31.245 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:42:31.245 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:42:31.246 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:42:31.246 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:42:31.246 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:42:31.246 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:42:31.247 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:42:31.247 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:42:31.247 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 23, 2021-10-08T19:42:31.247 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 23, 2021-10-08T19:42:31.248 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 23, 2021-10-08T19:42:31.248 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 23, 2021-10-08T19:42:31.248 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 23, 2021-10-08T19:42:31.248 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:42:31.249 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:42:31.249 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:42:31.249 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:42:31.249 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:42:31.249 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:42:31.250 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:42:31.250 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.250 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "132", 2021-10-08T19:42:31.250 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:42:31.251 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:42:31.251 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "131", 2021-10-08T19:42:31.251 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:42:31.251 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:42:31.251 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:42:31.252 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:42:31.252 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:42:31.252 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:42:31.252 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:42:31.253 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:42:31.253 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:42:31.253 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:42:31.253 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:42:31.253 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:42:31.254 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:42:31.254 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:42:31.254 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:42:31.254 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:42:31.255 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:42:31.255 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:42:31.255 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:42:31.255 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:42:31.255 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:42:31.256 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:42:31.256 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:42:31.256 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.256 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:42:31.256 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:42:31.257 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:42:31.257 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:42:31.257 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:42:31.257 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:42:31.258 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:42:31.258 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:42:31.258 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:42:31.258 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:42:31.259 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:42:31.259 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2021-10-08T19:42:31.259 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:42:31.259 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd": {} 2021-10-08T19:42:31.259 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:31.260 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.260 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.260 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 4, 2021-10-08T19:42:31.260 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "default.rgw.log", 2021-10-08T19:42:31.260 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:21:23.886328+0000", 2021-10-08T19:42:31.261 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:42:31.261 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:42:31.261 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:42:31.261 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:42:31.262 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:42:31.262 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:42:31.262 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:42:31.262 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:42:31.262 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:42:31.263 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:42:31.263 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:42:31.263 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:42:31.263 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 32, 2021-10-08T19:42:31.264 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 32, 2021-10-08T19:42:31.264 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 32, 2021-10-08T19:42:31.264 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 32, 2021-10-08T19:42:31.264 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 32, 2021-10-08T19:42:31.264 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:42:31.265 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:42:31.265 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:42:31.265 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:42:31.265 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:42:31.266 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:42:31.266 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:42:31.266 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.266 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "64", 2021-10-08T19:42:31.266 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:42:31.267 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:42:31.267 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2021-10-08T19:42:31.267 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:42:31.267 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:42:31.268 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:42:31.268 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:42:31.268 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:42:31.268 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:42:31.268 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:42:31.269 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:42:31.269 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:42:31.269 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:42:31.269 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:42:31.270 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:42:31.270 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:42:31.270 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:42:31.270 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:42:31.270 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:42:31.271 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:42:31.271 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:42:31.271 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:42:31.271 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:42:31.272 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:42:31.272 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:42:31.272 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:42:31.272 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.272 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:42:31.273 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:42:31.273 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:42:31.273 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:42:31.273 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:42:31.274 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:42:31.274 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:42:31.274 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:42:31.274 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:42:31.274 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:42:31.275 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:42:31.275 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2021-10-08T19:42:31.275 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:42:31.275 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw": {} 2021-10-08T19:42:31.276 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:31.276 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.276 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.276 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 5, 2021-10-08T19:42:31.276 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "default.rgw.control", 2021-10-08T19:42:31.277 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:21:25.865032+0000", 2021-10-08T19:42:31.277 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:42:31.277 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:42:31.277 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:42:31.277 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:42:31.278 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:42:31.278 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:42:31.278 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:42:31.278 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:42:31.279 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:42:31.279 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:42:31.279 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:42:31.279 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:42:31.279 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 32, 2021-10-08T19:42:31.280 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 32, 2021-10-08T19:42:31.280 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 32, 2021-10-08T19:42:31.280 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 32, 2021-10-08T19:42:31.280 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 32, 2021-10-08T19:42:31.281 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:42:31.281 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:42:31.281 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:42:31.281 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:42:31.281 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:42:31.282 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:42:31.282 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:42:31.282 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.282 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "66", 2021-10-08T19:42:31.283 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:42:31.283 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:42:31.283 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2021-10-08T19:42:31.283 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:42:31.283 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:42:31.284 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:42:31.284 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:42:31.284 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:42:31.284 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:42:31.285 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:42:31.285 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:42:31.285 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:42:31.285 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:42:31.285 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:42:31.286 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:42:31.286 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:42:31.286 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:42:31.286 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:42:31.287 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:42:31.287 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:42:31.287 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:42:31.287 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:42:31.287 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:42:31.288 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:42:31.288 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:42:31.288 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:42:31.288 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.288 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:42:31.289 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:42:31.289 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:42:31.289 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:42:31.289 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:42:31.290 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:42:31.290 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:42:31.290 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:42:31.290 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:42:31.291 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:42:31.291 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:42:31.291 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2021-10-08T19:42:31.291 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:42:31.291 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw": {} 2021-10-08T19:42:31.292 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:31.292 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.292 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.292 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 6, 2021-10-08T19:42:31.292 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "default.rgw.meta", 2021-10-08T19:42:31.293 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:21:27.940767+0000", 2021-10-08T19:42:31.293 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:42:31.293 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:42:31.293 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:42:31.294 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:42:31.294 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:42:31.294 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:42:31.294 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:42:31.294 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:42:31.295 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:42:31.295 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:42:31.295 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:42:31.295 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:42:31.296 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 32, 2021-10-08T19:42:31.296 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 32, 2021-10-08T19:42:31.296 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 32, 2021-10-08T19:42:31.296 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 32, 2021-10-08T19:42:31.296 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 32, 2021-10-08T19:42:31.297 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:42:31.297 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:42:31.297 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:42:31.297 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:42:31.297 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:42:31.298 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:42:31.298 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:42:31.298 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.298 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "350", 2021-10-08T19:42:31.299 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:42:31.299 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:42:31.299 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2021-10-08T19:42:31.299 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:42:31.299 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:42:31.300 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:42:31.300 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:42:31.300 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:42:31.300 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:42:31.301 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:42:31.301 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:42:31.301 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:42:31.301 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:42:31.301 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:42:31.302 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:42:31.302 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:42:31.302 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:42:31.302 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:42:31.303 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:42:31.303 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:42:31.303 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:42:31.303 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:42:31.304 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:42:31.304 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:42:31.304 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:42:31.304 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:42:31.305 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.305 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:42:31.305 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:42:31.305 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:42:31.305 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:42:31.306 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:42:31.306 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:42:31.306 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:42:31.306 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:42:31.307 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:42:31.307 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:42:31.307 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:42:31.307 INFO:teuthology.orchestra.run.smithi097.stdout: "options": { 2021-10-08T19:42:31.307 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_bias": 4, 2021-10-08T19:42:31.308 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_min": 8 2021-10-08T19:42:31.308 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.308 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:42:31.308 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw": {} 2021-10-08T19:42:31.309 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:31.309 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.309 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.309 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 11, 2021-10-08T19:42:31.310 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "unique_pool_4", 2021-10-08T19:42:31.310 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2021-10-08T19:39:02.796147+0000", 2021-10-08T19:42:31.310 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2021-10-08T19:42:31.310 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2021-10-08T19:42:31.310 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2021-10-08T19:42:31.311 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 3, 2021-10-08T19:42:31.311 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 2, 2021-10-08T19:42:31.311 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2021-10-08T19:42:31.311 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2021-10-08T19:42:31.311 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2021-10-08T19:42:31.312 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2021-10-08T19:42:31.312 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2021-10-08T19:42:31.312 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2021-10-08T19:42:31.312 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2021-10-08T19:42:31.313 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 16, 2021-10-08T19:42:31.313 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 16, 2021-10-08T19:42:31.313 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 16, 2021-10-08T19:42:31.314 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 16, 2021-10-08T19:42:31.314 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 16, 2021-10-08T19:42:31.314 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2021-10-08T19:42:31.314 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2021-10-08T19:42:31.315 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2021-10-08T19:42:31.315 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2021-10-08T19:42:31.315 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2021-10-08T19:42:31.315 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2021-10-08T19:42:31.315 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2021-10-08T19:42:31.316 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.316 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "436", 2021-10-08T19:42:31.316 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2021-10-08T19:42:31.316 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-08T19:42:31.316 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2021-10-08T19:42:31.317 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2021-10-08T19:42:31.317 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2021-10-08T19:42:31.317 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2021-10-08T19:42:31.317 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2021-10-08T19:42:31.318 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2021-10-08T19:42:31.318 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2021-10-08T19:42:31.318 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2021-10-08T19:42:31.318 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2021-10-08T19:42:31.318 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2021-10-08T19:42:31.319 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2021-10-08T19:42:31.319 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2021-10-08T19:42:31.319 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2021-10-08T19:42:31.319 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2021-10-08T19:42:31.320 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2021-10-08T19:42:31.320 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2021-10-08T19:42:31.320 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-08T19:42:31.320 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-08T19:42:31.320 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-08T19:42:31.321 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2021-10-08T19:42:31.321 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2021-10-08T19:42:31.321 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2021-10-08T19:42:31.321 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2021-10-08T19:42:31.322 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2021-10-08T19:42:31.322 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.322 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2021-10-08T19:42:31.322 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2021-10-08T19:42:31.322 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2021-10-08T19:42:31.323 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2021-10-08T19:42:31.323 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2021-10-08T19:42:31.323 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2021-10-08T19:42:31.323 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2021-10-08T19:42:31.324 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2021-10-08T19:42:31.324 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2021-10-08T19:42:31.324 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2021-10-08T19:42:31.324 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2021-10-08T19:42:31.324 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2021-10-08T19:42:31.325 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2021-10-08T19:42:31.325 INFO:teuthology.orchestra.run.smithi097.stdout: "rados": {} 2021-10-08T19:42:31.325 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:31.325 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:31.325 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:42:31.326 INFO:teuthology.orchestra.run.smithi097.stdout: "osds": [ 2021-10-08T19:42:31.326 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.326 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 0, 2021-10-08T19:42:31.326 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "9e64e714-a5d5-4fbb-ae2b-1df4bf14b8e0", 2021-10-08T19:42:31.327 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:42:31.327 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:42:31.327 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:42:31.327 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:42:31.327 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:42:31.328 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:42:31.328 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 8, 2021-10-08T19:42:31.328 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 433, 2021-10-08T19:42:31.328 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:42:31.329 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:42:31.329 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:42:31.329 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:31.329 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.329 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:31.330 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6801", 2021-10-08T19:42:31.330 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3354161282 2021-10-08T19:42:31.330 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:31.330 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:31.331 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.331 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:42:31.331 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:31.331 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.331 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:31.332 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6802", 2021-10-08T19:42:31.332 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3354161282 2021-10-08T19:42:31.332 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:31.332 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:31.332 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.333 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:42:31.333 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:31.333 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.333 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:31.333 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6804", 2021-10-08T19:42:31.334 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3354161282 2021-10-08T19:42:31.334 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:31.334 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:31.334 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.335 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:42:31.335 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:31.335 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.335 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:31.335 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6803", 2021-10-08T19:42:31.336 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3354161282 2021-10-08T19:42:31.336 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:31.336 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:31.336 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.336 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.97:6801/3354161282", 2021-10-08T19:42:31.337 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.97:6802/3354161282", 2021-10-08T19:42:31.337 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.97:6804/3354161282", 2021-10-08T19:42:31.337 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.97:6803/3354161282", 2021-10-08T19:42:31.337 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:42:31.338 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:42:31.338 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:42:31.338 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:31.338 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.338 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.339 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 1, 2021-10-08T19:42:31.339 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "32602a22-f263-4b62-a8d8-50fddfb73fa8", 2021-10-08T19:42:31.339 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:42:31.339 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:42:31.340 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:42:31.340 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 0.99786376953125, 2021-10-08T19:42:31.340 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:42:31.340 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:42:31.340 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 13, 2021-10-08T19:42:31.341 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 433, 2021-10-08T19:42:31.341 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:42:31.341 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:42:31.341 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:42:31.341 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:31.342 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.342 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:31.342 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6805", 2021-10-08T19:42:31.342 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 735799205 2021-10-08T19:42:31.343 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:31.343 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:31.343 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.343 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:42:31.343 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:31.344 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.344 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:31.344 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6806", 2021-10-08T19:42:31.344 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 735799205 2021-10-08T19:42:31.344 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:31.345 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:31.345 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.345 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:42:31.345 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:31.346 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.346 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:31.346 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6808", 2021-10-08T19:42:31.346 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 735799205 2021-10-08T19:42:31.346 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:31.347 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:31.347 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.347 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:42:31.347 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:31.348 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.348 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:31.348 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6807", 2021-10-08T19:42:31.348 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 735799205 2021-10-08T19:42:31.348 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:31.349 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:31.349 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.349 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.97:6805/735799205", 2021-10-08T19:42:31.349 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.97:6806/735799205", 2021-10-08T19:42:31.350 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.97:6808/735799205", 2021-10-08T19:42:31.350 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.97:6807/735799205", 2021-10-08T19:42:31.350 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:42:31.350 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:42:31.350 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:42:31.351 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:31.351 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.351 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.351 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 2, 2021-10-08T19:42:31.351 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "88e0e4a2-b4a3-4a00-8669-03c3d9b166c5", 2021-10-08T19:42:31.352 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:42:31.352 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:42:31.352 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:42:31.352 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:42:31.353 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:42:31.353 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:42:31.353 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 18, 2021-10-08T19:42:31.353 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 433, 2021-10-08T19:42:31.353 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:42:31.354 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:42:31.354 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:42:31.354 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:31.354 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.354 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:31.355 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6809", 2021-10-08T19:42:31.355 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2366482649 2021-10-08T19:42:31.355 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:31.355 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:31.355 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.356 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:42:31.356 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:31.356 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.356 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:31.357 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6810", 2021-10-08T19:42:31.357 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2366482649 2021-10-08T19:42:31.357 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:31.357 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:31.357 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.358 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:42:31.358 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:31.358 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.358 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:31.358 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6812", 2021-10-08T19:42:31.359 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2366482649 2021-10-08T19:42:31.359 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:31.359 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:31.359 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.360 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:42:31.360 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:31.360 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.360 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:31.360 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6811", 2021-10-08T19:42:31.361 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2366482649 2021-10-08T19:42:31.361 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:31.361 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:31.361 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.361 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.97:6809/2366482649", 2021-10-08T19:42:31.362 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.97:6810/2366482649", 2021-10-08T19:42:31.362 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.97:6812/2366482649", 2021-10-08T19:42:31.362 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.97:6811/2366482649", 2021-10-08T19:42:31.362 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:42:31.362 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:42:31.363 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:42:31.363 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:31.363 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.363 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.364 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 3, 2021-10-08T19:42:31.364 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "e689d708-b501-4526-a31a-1e598b74654d", 2021-10-08T19:42:31.364 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:42:31.364 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:42:31.364 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:42:31.365 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:42:31.365 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:42:31.365 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:42:31.365 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 24, 2021-10-08T19:42:31.366 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 433, 2021-10-08T19:42:31.366 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:42:31.366 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:42:31.366 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:42:31.366 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:31.367 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.367 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:31.367 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6813", 2021-10-08T19:42:31.367 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3191181122 2021-10-08T19:42:31.368 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:31.368 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:31.368 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.368 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:42:31.368 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:31.369 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.369 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:31.369 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6814", 2021-10-08T19:42:31.369 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3191181122 2021-10-08T19:42:31.369 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:31.370 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:31.370 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.370 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:42:31.370 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:31.371 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.371 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:31.371 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6816", 2021-10-08T19:42:31.371 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3191181122 2021-10-08T19:42:31.371 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:31.372 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:31.372 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.372 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:42:31.372 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:31.372 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.373 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:31.373 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6815", 2021-10-08T19:42:31.373 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3191181122 2021-10-08T19:42:31.373 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:31.374 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:31.374 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.374 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.97:6813/3191181122", 2021-10-08T19:42:31.374 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.97:6814/3191181122", 2021-10-08T19:42:31.374 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.97:6816/3191181122", 2021-10-08T19:42:31.375 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.97:6815/3191181122", 2021-10-08T19:42:31.375 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:42:31.375 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:42:31.375 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:42:31.376 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:31.376 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.376 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.376 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 4, 2021-10-08T19:42:31.376 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "67e4730a-be1c-4d88-9307-e3c2cf3ab2ef", 2021-10-08T19:42:31.377 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:42:31.377 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:42:31.377 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:42:31.377 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:42:31.377 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:42:31.378 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:42:31.378 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 30, 2021-10-08T19:42:31.378 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 448, 2021-10-08T19:42:31.378 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:42:31.379 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:42:31.379 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:42:31.379 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:31.379 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.379 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:31.380 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6800", 2021-10-08T19:42:31.380 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 106778208 2021-10-08T19:42:31.380 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:31.380 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:31.380 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.381 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:42:31.381 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:31.381 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.381 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:31.381 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6801", 2021-10-08T19:42:31.382 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 106778208 2021-10-08T19:42:31.382 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:31.382 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:31.382 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.383 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:42:31.383 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:31.383 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.383 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:31.383 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6803", 2021-10-08T19:42:31.384 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 106778208 2021-10-08T19:42:31.384 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:31.384 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:31.384 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.384 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:42:31.385 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:31.385 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.385 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:31.385 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6802", 2021-10-08T19:42:31.386 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 106778208 2021-10-08T19:42:31.386 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:31.386 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:31.386 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.386 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.117:6800/106778208", 2021-10-08T19:42:31.387 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.117:6801/106778208", 2021-10-08T19:42:31.387 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.117:6803/106778208", 2021-10-08T19:42:31.387 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.117:6802/106778208", 2021-10-08T19:42:31.387 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:42:31.388 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:42:31.388 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:42:31.388 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:31.388 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.388 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.389 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 5, 2021-10-08T19:42:31.389 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "f9fd3153-3e4e-4489-8927-a65641f05d42", 2021-10-08T19:42:31.389 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:42:31.389 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:42:31.389 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:42:31.390 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 0.2890472412109375, 2021-10-08T19:42:31.390 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:42:31.390 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:42:31.390 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 38, 2021-10-08T19:42:31.391 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 391, 2021-10-08T19:42:31.391 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:42:31.391 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:42:31.391 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:42:31.391 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:31.392 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.392 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:31.392 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6804", 2021-10-08T19:42:31.392 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3199889891 2021-10-08T19:42:31.392 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:31.393 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:31.393 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.393 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:42:31.393 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:31.393 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.394 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:31.394 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6805", 2021-10-08T19:42:31.394 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3199889891 2021-10-08T19:42:31.394 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:31.395 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:31.395 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.395 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:42:31.395 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:31.395 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.396 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:31.396 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6807", 2021-10-08T19:42:31.396 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3199889891 2021-10-08T19:42:31.396 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:31.396 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:31.397 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.397 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:42:31.397 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:31.397 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.398 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:31.398 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6806", 2021-10-08T19:42:31.398 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3199889891 2021-10-08T19:42:31.398 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:31.398 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:31.399 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.399 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.117:6804/3199889891", 2021-10-08T19:42:31.399 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.117:6805/3199889891", 2021-10-08T19:42:31.399 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.117:6807/3199889891", 2021-10-08T19:42:31.399 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.117:6806/3199889891", 2021-10-08T19:42:31.400 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:42:31.400 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:42:31.400 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:42:31.400 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:31.401 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.401 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.401 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 6, 2021-10-08T19:42:31.401 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "84898f12-c37d-4eb6-8b71-5b86bfe16e7d", 2021-10-08T19:42:31.401 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:42:31.402 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:42:31.402 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:42:31.402 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:42:31.402 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:42:31.402 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:42:31.403 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 47, 2021-10-08T19:42:31.403 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 433, 2021-10-08T19:42:31.403 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:42:31.404 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:42:31.404 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:42:31.404 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:31.404 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.405 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:31.405 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6808", 2021-10-08T19:42:31.405 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2185843951 2021-10-08T19:42:31.405 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:31.405 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:31.406 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.406 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:42:31.406 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:31.406 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.407 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:31.407 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6809", 2021-10-08T19:42:31.407 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2185843951 2021-10-08T19:42:31.407 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:31.407 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:31.408 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.408 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:42:31.408 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:31.408 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.409 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:31.409 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6811", 2021-10-08T19:42:31.409 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2185843951 2021-10-08T19:42:31.409 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:31.409 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:31.410 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.410 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:42:31.410 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:31.410 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.410 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:31.411 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6810", 2021-10-08T19:42:31.411 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2185843951 2021-10-08T19:42:31.411 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:31.411 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:31.412 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.412 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.117:6808/2185843951", 2021-10-08T19:42:31.412 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.117:6809/2185843951", 2021-10-08T19:42:31.412 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.117:6811/2185843951", 2021-10-08T19:42:31.412 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.117:6810/2185843951", 2021-10-08T19:42:31.413 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:42:31.413 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:42:31.413 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:42:31.413 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:31.413 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.414 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.414 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 7, 2021-10-08T19:42:31.414 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "529af2ce-2ae9-41ed-8c8e-d133628cfd20", 2021-10-08T19:42:31.414 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2021-10-08T19:42:31.415 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2021-10-08T19:42:31.415 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2021-10-08T19:42:31.415 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2021-10-08T19:42:31.415 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2021-10-08T19:42:31.415 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2021-10-08T19:42:31.416 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 55, 2021-10-08T19:42:31.416 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 492, 2021-10-08T19:42:31.416 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2021-10-08T19:42:31.416 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2021-10-08T19:42:31.417 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2021-10-08T19:42:31.417 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:31.417 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.417 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:31.417 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6812", 2021-10-08T19:42:31.418 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2817683239 2021-10-08T19:42:31.418 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:31.418 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:31.418 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.418 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2021-10-08T19:42:31.419 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:31.419 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.419 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:31.419 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6813", 2021-10-08T19:42:31.420 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2817683239 2021-10-08T19:42:31.420 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:31.420 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:31.420 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.420 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2021-10-08T19:42:31.421 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:31.421 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.421 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:31.421 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6815", 2021-10-08T19:42:31.421 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2817683239 2021-10-08T19:42:31.422 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:31.422 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:31.422 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.422 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2021-10-08T19:42:31.423 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2021-10-08T19:42:31.423 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.423 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2021-10-08T19:42:31.423 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.117:6814", 2021-10-08T19:42:31.423 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2817683239 2021-10-08T19:42:31.424 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:31.424 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:31.424 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.424 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.117:6812/2817683239", 2021-10-08T19:42:31.425 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.117:6813/2817683239", 2021-10-08T19:42:31.425 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.117:6815/2817683239", 2021-10-08T19:42:31.425 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.117:6814/2817683239", 2021-10-08T19:42:31.425 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2021-10-08T19:42:31.426 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2021-10-08T19:42:31.426 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2021-10-08T19:42:31.426 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:31.426 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:31.426 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:42:31.427 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_xinfo": [ 2021-10-08T19:42:31.427 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.427 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 0, 2021-10-08T19:42:31.427 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:42:31.428 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:42:31.428 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:42:31.428 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:42:31.428 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:42:31.428 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:42:24.767382+0000", 2021-10-08T19:42:31.429 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:42:31.429 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.429 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.429 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 1, 2021-10-08T19:42:31.429 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:42:31.430 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:42:31.430 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:42:31.430 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:42:31.430 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:42:31.431 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:42:12.104243+0000", 2021-10-08T19:42:31.431 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:42:31.431 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.431 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.431 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 2, 2021-10-08T19:42:31.432 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:42:31.432 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:42:31.432 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:42:31.432 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:42:31.432 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:42:31.433 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:41:28.772842+0000", 2021-10-08T19:42:31.433 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:42:31.433 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.433 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.434 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 3, 2021-10-08T19:42:31.434 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:42:31.434 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:42:31.434 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:42:31.434 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:42:31.435 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:42:31.435 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:42:11.762844+0000", 2021-10-08T19:42:31.435 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:42:31.435 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.436 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.436 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 4, 2021-10-08T19:42:31.436 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:42:31.436 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:42:31.437 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:42:31.437 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:42:31.437 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:42:31.437 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:41:21.115853+0000", 2021-10-08T19:42:31.437 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:42:31.438 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.438 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.438 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 5, 2021-10-08T19:42:31.438 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:42:31.438 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:42:31.439 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:42:31.439 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:42:31.439 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:42:31.439 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:42:08.166538+0000", 2021-10-08T19:42:31.440 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:42:31.440 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.440 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.440 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 6, 2021-10-08T19:42:31.440 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:42:31.441 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:42:31.441 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:42:31.441 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:42:31.441 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:42:31.441 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:42:16.950689+0000", 2021-10-08T19:42:31.442 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:42:31.442 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.442 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.442 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 7, 2021-10-08T19:42:31.443 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2021-10-08T19:42:31.443 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2021-10-08T19:42:31.443 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2021-10-08T19:42:31.443 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540138303579357183, 2021-10-08T19:42:31.443 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2021-10-08T19:42:31.444 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2021-10-08T19:41:20.788560+0000", 2021-10-08T19:42:31.444 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2021-10-08T19:42:31.444 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:31.444 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:42:31.444 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_upmap": [ 2021-10-08T19:42:31.445 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.445 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "2.12", 2021-10-08T19:42:31.445 INFO:teuthology.orchestra.run.smithi097.stdout: "osds": [ 2021-10-08T19:42:31.445 INFO:teuthology.orchestra.run.smithi097.stdout: 5, 2021-10-08T19:42:31.446 INFO:teuthology.orchestra.run.smithi097.stdout: 4, 2021-10-08T19:42:31.446 INFO:teuthology.orchestra.run.smithi097.stdout: 2 2021-10-08T19:42:31.446 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:31.446 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:31.446 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:42:31.447 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_upmap_items": [ 2021-10-08T19:42:31.447 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.447 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "2.0", 2021-10-08T19:42:31.447 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:42:31.447 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.448 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 7, 2021-10-08T19:42:31.448 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 2 2021-10-08T19:42:31.448 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:31.448 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:31.449 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.449 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.449 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "2.3", 2021-10-08T19:42:31.449 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:42:31.449 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.450 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 7, 2021-10-08T19:42:31.450 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 4 2021-10-08T19:42:31.450 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:31.450 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:31.450 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.451 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.451 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "2.7", 2021-10-08T19:42:31.451 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:42:31.451 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.452 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 7, 2021-10-08T19:42:31.452 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 1 2021-10-08T19:42:31.452 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:31.452 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:31.452 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.453 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.453 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "2.1a", 2021-10-08T19:42:31.453 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:42:31.453 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.454 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 7, 2021-10-08T19:42:31.454 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 2 2021-10-08T19:42:31.454 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:31.454 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:31.454 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.455 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.455 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "2.29", 2021-10-08T19:42:31.455 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:42:31.455 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.456 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 7, 2021-10-08T19:42:31.456 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 2 2021-10-08T19:42:31.456 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:31.456 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:31.456 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.457 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.457 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "4.6", 2021-10-08T19:42:31.457 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:42:31.457 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.457 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 1, 2021-10-08T19:42:31.458 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 5 2021-10-08T19:42:31.458 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:31.458 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:31.458 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.459 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.459 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "4.f", 2021-10-08T19:42:31.459 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:42:31.459 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.459 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 1, 2021-10-08T19:42:31.460 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 2 2021-10-08T19:42:31.460 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:31.460 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:31.460 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.460 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.461 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "4.10", 2021-10-08T19:42:31.461 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:42:31.461 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.461 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 1, 2021-10-08T19:42:31.462 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 2 2021-10-08T19:42:31.462 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:31.462 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:31.462 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.462 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.463 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "4.1a", 2021-10-08T19:42:31.463 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:42:31.463 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.463 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 4, 2021-10-08T19:42:31.463 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 7 2021-10-08T19:42:31.464 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:31.464 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:31.464 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.464 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.464 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "5.19", 2021-10-08T19:42:31.465 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2021-10-08T19:42:31.465 INFO:teuthology.orchestra.run.smithi097.stdout: { 2021-10-08T19:42:31.465 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 5, 2021-10-08T19:42:31.465 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 7 2021-10-08T19:42:31.466 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:31.466 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2021-10-08T19:42:31.466 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:31.466 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2021-10-08T19:42:31.466 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_temp": [], 2021-10-08T19:42:31.467 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_temp": [], 2021-10-08T19:42:31.467 INFO:teuthology.orchestra.run.smithi097.stdout: "blocklist": { 2021-10-08T19:42:31.467 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/2600364788": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:42:31.467 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/4129083289": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:42:31.467 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/1443158975": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:42:31.468 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/2472640384": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:42:31.468 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/3196919488": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:42:31.468 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:6800/3195862546": "2021-10-09T19:21:42.325540+0000", 2021-10-08T19:42:31.468 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:6800/3931202434": "2021-10-09T19:17:10.051948+0000", 2021-10-08T19:42:31.469 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/2761595213": "2021-10-09T19:17:10.051948+0000", 2021-10-08T19:42:31.469 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/900681504": "2021-10-09T19:17:10.051948+0000", 2021-10-08T19:42:31.469 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/3932251406": "2021-10-09T19:17:10.051948+0000", 2021-10-08T19:42:31.469 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/398006785": "2021-10-09T19:16:48.651177+0000", 2021-10-08T19:42:31.469 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/1642570050": "2021-10-09T19:16:48.651177+0000", 2021-10-08T19:42:31.470 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:0/300178790": "2021-10-09T19:16:48.651177+0000", 2021-10-08T19:42:31.470 INFO:teuthology.orchestra.run.smithi097.stdout: "172.21.15.97:6800/845999767": "2021-10-09T19:16:48.651177+0000" 2021-10-08T19:42:31.470 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.470 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profiles": { 2021-10-08T19:42:31.470 INFO:teuthology.orchestra.run.smithi097.stdout: "default": { 2021-10-08T19:42:31.471 INFO:teuthology.orchestra.run.smithi097.stdout: "crush-failure-domain": "osd", 2021-10-08T19:42:31.471 INFO:teuthology.orchestra.run.smithi097.stdout: "k": "2", 2021-10-08T19:42:31.471 INFO:teuthology.orchestra.run.smithi097.stdout: "m": "1", 2021-10-08T19:42:31.471 INFO:teuthology.orchestra.run.smithi097.stdout: "plugin": "jerasure", 2021-10-08T19:42:31.471 INFO:teuthology.orchestra.run.smithi097.stdout: "technique": "reed_sol_van" 2021-10-08T19:42:31.472 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:31.472 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2021-10-08T19:42:31.472 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps_queue": [], 2021-10-08T19:42:31.472 INFO:teuthology.orchestra.run.smithi097.stdout: "new_removed_snaps": [], 2021-10-08T19:42:31.473 INFO:teuthology.orchestra.run.smithi097.stdout: "new_purged_snaps": [], 2021-10-08T19:42:31.473 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_node_flags": {}, 2021-10-08T19:42:31.473 INFO:teuthology.orchestra.run.smithi097.stdout: "device_class_flags": {}, 2021-10-08T19:42:31.473 INFO:teuthology.orchestra.run.smithi097.stdout: "stretch_mode": { 2021-10-08T19:42:31.473 INFO:teuthology.orchestra.run.smithi097.stdout: "stretch_mode_enabled": false, 2021-10-08T19:42:31.474 INFO:teuthology.orchestra.run.smithi097.stdout: "stretch_bucket_count": 0, 2021-10-08T19:42:31.474 INFO:teuthology.orchestra.run.smithi097.stdout: "degraded_stretch_mode": 0, 2021-10-08T19:42:31.474 INFO:teuthology.orchestra.run.smithi097.stdout: "recovering_stretch_mode": 0, 2021-10-08T19:42:31.474 INFO:teuthology.orchestra.run.smithi097.stdout: "stretch_mode_bucket": 0 2021-10-08T19:42:31.474 INFO:teuthology.orchestra.run.smithi097.stdout: } 2021-10-08T19:42:31.475 INFO:teuthology.orchestra.run.smithi097.stdout:} 2021-10-08T19:42:31.476 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2021-10-08T19:42:31.476 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:42:31.552 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:42:31.555 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:31.556 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:42:31.658 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:42:31.691 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:42:31 smithi097 conmon[33110]: 172.21.15.97 - - [08/Oct/2021:19:42:31] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:42:31.693 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:31.941 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:31 smithi097 ceph-mon[32687]: pgmap v1049: 188 pgs: 188 active+clean; 710 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.21k op/s; 13 B/s, 0 objects/s recovering 2021-10-08T19:42:31.941 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:31 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1368257848' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2021-10-08T19:42:31.941 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:31 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:42:31.942 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:31 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:42:31.942 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:31 smithi097 ceph-mon[32687]: 172.21.15.97 - - [08/Oct/2021:19:42:31] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:42:31.942 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:31 smithi097 ceph-mon[41966]: pgmap v1049: 188 pgs: 188 active+clean; 710 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.21k op/s; 13 B/s, 0 objects/s recovering 2021-10-08T19:42:31.943 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:31 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1368257848' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2021-10-08T19:42:31.943 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:31 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:42:31.943 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:31 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:42:31.944 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:31 smithi097 ceph-mon[41966]: 172.21.15.97 - - [08/Oct/2021:19:42:31] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:42:32.050 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:42:32.074 INFO:tasks.thrashosds.thrasher:j is {'epoch': 495, 'fsid': '1d01f6d6-286c-11ec-8c25-001a4aab830c', 'created': '2021-10-08T19:16:25.258003+0000', 'modified': '2021-10-08T19:42:25.226934+0000', 'last_up_change': '2021-10-08T19:21:15.388758+0000', 'last_in_change': '2021-10-08T19:29:39.736986+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 18, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 11, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'quincy', 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2021-10-08T19:19:44.413311+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 11, 'pg_placement_num': 11, 'pg_placement_num_target': 11, 'pg_num_target': 11, 'pg_num_pending': 11, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '171', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '170', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': '.rgw.root', 'create_time': '2021-10-08T19:21:21.940881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 42, 'pg_placement_num': 42, 'pg_placement_num_target': 42, 'pg_num_target': 42, 'pg_num_pending': 42, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '393', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '391', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 3, 'pool_name': 'iscsi', 'create_time': '2021-10-08T19:21:22.536945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 23, 'pg_placement_num': 23, 'pg_placement_num_target': 23, 'pg_num_target': 23, 'pg_num_pending': 23, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '132', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '131', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 4, 'pool_name': 'default.rgw.log', 'create_time': '2021-10-08T19:21:23.886328+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 5, 'pool_name': 'default.rgw.control', 'create_time': '2021-10-08T19:21:25.865032+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 6, 'pool_name': 'default.rgw.meta', 'create_time': '2021-10-08T19:21:27.940767+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '350', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 8}, 'application_metadata': {'rgw': {}}}, {'pool': 11, 'pool_name': 'unique_pool_4', 'create_time': '2021-10-08T19:39:02.796147+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '436', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}], 'osds': [{'osd': 0, 'uuid': '9e64e714-a5d5-4fbb-ae2b-1df4bf14b8e0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 433, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6801', 'nonce': 3354161282}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6802', 'nonce': 3354161282}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6804', 'nonce': 3354161282}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6803', 'nonce': 3354161282}]}, 'public_addr': '172.21.15.97:6801/3354161282', 'cluster_addr': '172.21.15.97:6802/3354161282', 'heartbeat_back_addr': '172.21.15.97:6804/3354161282', 'heartbeat_front_addr': '172.21.15.97:6803/3354161282', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '32602a22-f263-4b62-a8d8-50fddfb73fa8', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.99786376953125, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 433, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6805', 'nonce': 735799205}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6806', 'nonce': 735799205}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6808', 'nonce': 735799205}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6807', 'nonce': 735799205}]}, 'public_addr': '172.21.15.97:6805/735799205', 'cluster_addr': '172.21.15.97:6806/735799205', 'heartbeat_back_addr': '172.21.15.97:6808/735799205', 'heartbeat_front_addr': '172.21.15.97:6807/735799205', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '88e0e4a2-b4a3-4a00-8669-03c3d9b166c5', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 18, 'up_thru': 433, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6809', 'nonce': 2366482649}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6810', 'nonce': 2366482649}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6812', 'nonce': 2366482649}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6811', 'nonce': 2366482649}]}, 'public_addr': '172.21.15.97:6809/2366482649', 'cluster_addr': '172.21.15.97:6810/2366482649', 'heartbeat_back_addr': '172.21.15.97:6812/2366482649', 'heartbeat_front_addr': '172.21.15.97:6811/2366482649', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': 'e689d708-b501-4526-a31a-1e598b74654d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 24, 'up_thru': 433, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6813', 'nonce': 3191181122}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6814', 'nonce': 3191181122}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6816', 'nonce': 3191181122}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6815', 'nonce': 3191181122}]}, 'public_addr': '172.21.15.97:6813/3191181122', 'cluster_addr': '172.21.15.97:6814/3191181122', 'heartbeat_back_addr': '172.21.15.97:6816/3191181122', 'heartbeat_front_addr': '172.21.15.97:6815/3191181122', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '67e4730a-be1c-4d88-9307-e3c2cf3ab2ef', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 30, 'up_thru': 448, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6800', 'nonce': 106778208}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6801', 'nonce': 106778208}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6803', 'nonce': 106778208}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6802', 'nonce': 106778208}]}, 'public_addr': '172.21.15.117:6800/106778208', 'cluster_addr': '172.21.15.117:6801/106778208', 'heartbeat_back_addr': '172.21.15.117:6803/106778208', 'heartbeat_front_addr': '172.21.15.117:6802/106778208', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'f9fd3153-3e4e-4489-8927-a65641f05d42', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.2890472412109375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 38, 'up_thru': 391, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6804', 'nonce': 3199889891}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6805', 'nonce': 3199889891}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6807', 'nonce': 3199889891}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6806', 'nonce': 3199889891}]}, 'public_addr': '172.21.15.117:6804/3199889891', 'cluster_addr': '172.21.15.117:6805/3199889891', 'heartbeat_back_addr': '172.21.15.117:6807/3199889891', 'heartbeat_front_addr': '172.21.15.117:6806/3199889891', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '84898f12-c37d-4eb6-8b71-5b86bfe16e7d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 47, 'up_thru': 433, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6808', 'nonce': 2185843951}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6809', 'nonce': 2185843951}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6811', 'nonce': 2185843951}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6810', 'nonce': 2185843951}]}, 'public_addr': '172.21.15.117:6808/2185843951', 'cluster_addr': '172.21.15.117:6809/2185843951', 'heartbeat_back_addr': '172.21.15.117:6811/2185843951', 'heartbeat_front_addr': '172.21.15.117:6810/2185843951', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '529af2ce-2ae9-41ed-8c8e-d133628cfd20', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 55, 'up_thru': 492, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6812', 'nonce': 2817683239}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6813', 'nonce': 2817683239}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6815', 'nonce': 2817683239}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.117:6814', 'nonce': 2817683239}]}, 'public_addr': '172.21.15.117:6812/2817683239', 'cluster_addr': '172.21.15.117:6813/2817683239', 'heartbeat_back_addr': '172.21.15.117:6815/2817683239', 'heartbeat_front_addr': '172.21.15.117:6814/2817683239', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:42:24.767382+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:42:12.104243+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:41:28.772842+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:42:11.762844+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:41:21.115853+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:42:08.166538+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:42:16.950689+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138303579357183, 'old_weight': 0, 'last_purged_snaps_scrub': '2021-10-08T19:41:20.788560+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '2.12', 'osds': [5, 4, 2]}], 'pg_upmap_items': [{'pgid': '2.0', 'mappings': [{'from': 7, 'to': 2}]}, {'pgid': '2.3', 'mappings': [{'from': 7, 'to': 4}]}, {'pgid': '2.7', 'mappings': [{'from': 7, 'to': 1}]}, {'pgid': '2.1a', 'mappings': [{'from': 7, 'to': 2}]}, {'pgid': '2.29', 'mappings': [{'from': 7, 'to': 2}]}, {'pgid': '4.6', 'mappings': [{'from': 1, 'to': 5}]}, {'pgid': '4.f', 'mappings': [{'from': 1, 'to': 2}]}, {'pgid': '4.10', 'mappings': [{'from': 1, 'to': 2}]}, {'pgid': '4.1a', 'mappings': [{'from': 4, 'to': 7}]}, {'pgid': '5.19', 'mappings': [{'from': 5, 'to': 7}]}], 'pg_temp': [], 'primary_temp': [], 'blocklist': {'172.21.15.97:0/2600364788': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:0/4129083289': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:0/1443158975': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:0/2472640384': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:0/3196919488': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:6800/3195862546': '2021-10-09T19:21:42.325540+0000', '172.21.15.97:6800/3931202434': '2021-10-09T19:17:10.051948+0000', '172.21.15.97:0/2761595213': '2021-10-09T19:17:10.051948+0000', '172.21.15.97:0/900681504': '2021-10-09T19:17:10.051948+0000', '172.21.15.97:0/3932251406': '2021-10-09T19:17:10.051948+0000', '172.21.15.97:0/398006785': '2021-10-09T19:16:48.651177+0000', '172.21.15.97:0/1642570050': '2021-10-09T19:16:48.651177+0000', '172.21.15.97:0/300178790': '2021-10-09T19:16:48.651177+0000', '172.21.15.97:6800/845999767': '2021-10-09T19:16:48.651177+0000'}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2021-10-08T19:42:32.075 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph pg dump --format=json 2021-10-08T19:42:32.076 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:42:32.080 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:32.081 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:42:32.183 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:42:32.217 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:32.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:31 smithi117 ceph-mon[34585]: pgmap v1049: 188 pgs: 188 active+clean; 710 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.21k op/s; 13 B/s, 0 objects/s recovering 2021-10-08T19:42:32.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:31 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1368257848' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2021-10-08T19:42:32.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:31 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:42:32.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:31 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:42:32.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:31 smithi117 ceph-mon[34585]: 172.21.15.97 - - [08/Oct/2021:19:42:31] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:42:32.407 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:42:32.411 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:32.411 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:42:32.475 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2021-10-08T19:42:32.513 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:42:32.547 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:32.594 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:42:32.597 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:32.597 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:42:32.698 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 2021-10-08T19:42:32.727 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:32.776 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:42:32.778 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:32.779 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7' 2021-10-08T19:42:32.831 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:42:32.881 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 2021-10-08T19:42:32.906 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:42:32 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:42:32] "GET /metrics HTTP/1.1" 200 155977 "" "Prometheus/2.18.1" 2021-10-08T19:42:32.909 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:32.956 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is set 2021-10-08T19:42:33.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:32 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2695847383' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:42:33.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:32 smithi117 ceph-mon[34585]: from='client.26386 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:42:33.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:32 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2695847383' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:42:33.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:32 smithi097 ceph-mon[41966]: from='client.26386 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:42:33.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:32 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2695847383' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:42:33.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:32 smithi097 ceph-mon[32687]: from='client.26386 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:42:33.254 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:42:33.256 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:33.257 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3' 2021-10-08T19:42:33.358 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:42:33.383 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:33.729 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:42:33.731 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:33.732 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:42:33.834 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:42:33.859 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:33.956 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:42:33.959 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:33.959 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:42:33.975 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:42:34.034 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:33 smithi097 ceph-mon[41966]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:42:34.035 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:33 smithi097 ceph-mon[41966]: from='client.26386 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:42:34.035 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:33 smithi097 ceph-mon[41966]: osdmap e496: 8 total, 8 up, 8 in 2021-10-08T19:42:34.035 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:33 smithi097 ceph-mon[41966]: pgmap v1051: 188 pgs: 188 active+clean; 710 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 581 op/s 2021-10-08T19:42:34.036 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:33 smithi097 ceph-mon[32687]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:42:34.036 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:33 smithi097 ceph-mon[32687]: from='client.26386 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:42:34.037 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:33 smithi097 ceph-mon[32687]: osdmap e496: 8 total, 8 up, 8 in 2021-10-08T19:42:34.037 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:33 smithi097 ceph-mon[32687]: pgmap v1051: 188 pgs: 188 active+clean; 710 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 581 op/s 2021-10-08T19:42:34.061 DEBUG:teuthology.orchestra.run.smithi117:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 2021-10-08T19:42:34.090 INFO:teuthology.orchestra.run.smithi117.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:34.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:33 smithi117 ceph-mon[34585]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:42:34.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:33 smithi117 ceph-mon[34585]: from='client.26386 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2021-10-08T19:42:34.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:33 smithi117 ceph-mon[34585]: osdmap e496: 8 total, 8 up, 8 in 2021-10-08T19:42:34.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:33 smithi117 ceph-mon[34585]: pgmap v1051: 188 pgs: 188 active+clean; 710 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 581 op/s 2021-10-08T19:42:34.157 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:42:33 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:42:33] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:42:34.445 INFO:teuthology.orchestra.run.smithi117.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:42:34.448 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:34.448 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi117 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6' 2021-10-08T19:42:34.549 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 2021-10-08T19:42:34.575 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:34.781 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:34.781 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:42:34.782 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0' 2021-10-08T19:42:34.883 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 2021-10-08T19:42:34.908 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:34.941 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2021-10-08T19:42:34.951 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2021-10-08T19:42:34.952 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2021-10-08T19:42:34.961 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2021-10-08T19:42:34.963 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:42:34.979 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:34.980 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2' 2021-10-08T19:42:34.989 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'unique_pool_4' removed 2021-10-08T19:42:35.015 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2021-10-08T19:42:35.040 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2021-10-08T19:42:35.062 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2021-10-08T19:42:35.081 DEBUG:teuthology.orchestra.run.smithi097:> sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 2021-10-08T19:42:35.085 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2021-10-08T19:42:35.107 INFO:teuthology.orchestra.run.smithi097.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2021-10-08T19:42:35.113 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2021-10-08T19:42:35.140 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2021-10-08T19:42:35.141 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true' 2021-10-08T19:42:35.141 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true' 2021-10-08T19:42:35.141 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true' 2021-10-08T19:42:35.141 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true' 2021-10-08T19:42:35.141 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true' 2021-10-08T19:42:35.142 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true' 2021-10-08T19:42:35.142 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = 'true' 2021-10-08T19:42:35.142 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = 'true' 2021-10-08T19:42:35.155 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:34 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3884539893' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_4", "pool2": "unique_pool_4", "yes_i_really_really_mean_it": true}]: dispatch 2021-10-08T19:42:35.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:34 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3950977681' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:42:35.163 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:34 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3884539893' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_4", "pool2": "unique_pool_4", "yes_i_really_really_mean_it": true}]: dispatch 2021-10-08T19:42:35.163 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:34 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3950977681' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:42:35.164 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:34 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3884539893' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_4", "pool2": "unique_pool_4", "yes_i_really_really_mean_it": true}]: dispatch 2021-10-08T19:42:35.164 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:34 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3950977681' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2021-10-08T19:42:35.798 INFO:teuthology.orchestra.run.smithi097.stderr:Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:42:35.800 DEBUG:teuthology.orchestra.run:got remote process result: 125 2021-10-08T19:42:35.801 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi097 with status 125: 'sudo docker kill -s 1 ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1' 2021-10-08T19:42:35.808 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2021-10-08T19:42:35.819 INFO:tasks.thrashosds:joining thrashosds 2021-10-08T19:42:35.966 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2021-10-08T19:42:36.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:35 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3884539893' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_4", "pool2": "unique_pool_4", "yes_i_really_really_mean_it": true}]': finished 2021-10-08T19:42:36.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:35 smithi097 ceph-mon[41966]: osdmap e497: 8 total, 8 up, 8 in 2021-10-08T19:42:36.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:35 smithi097 ceph-mon[41966]: pgmap v1053: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-10-08T19:42:36.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:35 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3884539893' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_4", "pool2": "unique_pool_4", "yes_i_really_really_mean_it": true}]': finished 2021-10-08T19:42:36.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:35 smithi097 ceph-mon[32687]: osdmap e497: 8 total, 8 up, 8 in 2021-10-08T19:42:36.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:35 smithi097 ceph-mon[32687]: pgmap v1053: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-10-08T19:42:36.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:35 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3884539893' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_4", "pool2": "unique_pool_4", "yes_i_really_really_mean_it": true}]': finished 2021-10-08T19:42:36.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:35 smithi117 ceph-mon[34585]: osdmap e497: 8 total, 8 up, 8 in 2021-10-08T19:42:36.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:35 smithi117 ceph-mon[34585]: pgmap v1053: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-10-08T19:42:36.492 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:42:36.785 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset noscrub 2021-10-08T19:42:37.246 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:42:37.503 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:42:37.508 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2021-10-08T19:42:37.655 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:42:37 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:42:38.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:38 smithi097 ceph-mon[32687]: pgmap v1054: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-10-08T19:42:38.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:38 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:42:38.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:38 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:42:38.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:38 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:42:38.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:38 smithi097 ceph-mon[32687]: from='client.26404 v1:172.21.15.97:0/3516813867' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:42:38.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:38 smithi097 ceph-mon[41966]: pgmap v1054: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-10-08T19:42:38.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:38 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:42:38.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:38 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:42:38.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:38 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:42:38.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:38 smithi097 ceph-mon[41966]: from='client.26404 v1:172.21.15.97:0/3516813867' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:42:38.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:38 smithi117 ceph-mon[34585]: pgmap v1054: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-10-08T19:42:38.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:38 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:42:38.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:38 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:42:38.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:38 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:42:38.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:38 smithi117 ceph-mon[34585]: from='client.26404 v1:172.21.15.97:0/3516813867' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:42:38.591 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":1054,"stamp":"2021-10-08T19:42:37.042832+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596164,"num_objects":194,"num_object_clones":0,"num_object_copies":582,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":2193,"num_read_kb":1950,"num_write":995,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":537,"num_bytes_recovered":11727,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2580,"ondisk_log_size":2580,"up":516,"acting":516,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":564,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":3215360,"kb_used_data":7872,"kb_used_omap":0,"kb_used_meta":3207424,"kb_avail":746745856,"statfs":{"total":767960285184,"available":764667756544,"internally_reserved":0,"allocated":8060928,"data_stored":5015002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3284402176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-165806104,"num_objects":-2531,"num_object_clones":0,"num_object_copies":-7593,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2531,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":-224963,"num_write_kb":-7279745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002184"},"pg_stats":[{"pgid":"2.29","version":"0'0","reported_seq":133,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.251453+0000","last_change":"2021-10-08T19:42:13.116420+0000","last_active":"2021-10-08T19:42:25.251453+0000","last_peered":"2021-10-08T19:42:25.251453+0000","last_clean":"2021-10-08T19:42:25.251453+0000","last_became_active":"2021-10-08T19:37:45.848663+0000","last_became_peered":"2021-10-08T19:37:45.848663+0000","last_unstale":"2021-10-08T19:42:25.251453+0000","last_undegraded":"2021-10-08T19:42:25.251453+0000","last_fullsized":"2021-10-08T19:42:25.251453+0000","mapping_epoch":407,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":408,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:42:13.116316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:30:11.102934+0000","last_clean_scrub_stamp":"2021-10-08T19:42:13.116316+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.092535919999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.28","version":"0'0","reported_seq":118,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.247501+0000","last_change":"2021-10-08T19:39:21.168002+0000","last_active":"2021-10-08T19:42:25.247501+0000","last_peered":"2021-10-08T19:42:25.247501+0000","last_clean":"2021-10-08T19:42:25.247501+0000","last_became_active":"2021-10-08T19:37:00.334502+0000","last_became_peered":"2021-10-08T19:37:00.334502+0000","last_unstale":"2021-10-08T19:42:25.247501+0000","last_undegraded":"2021-10-08T19:42:25.247501+0000","last_fullsized":"2021-10-08T19:42:25.247501+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:21.167907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:21.167907+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0095106210000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.27","version":"0'0","reported_seq":437,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.257797+0000","last_change":"2021-10-08T19:42:20.925388+0000","last_active":"2021-10-08T19:42:25.257797+0000","last_peered":"2021-10-08T19:42:25.257797+0000","last_clean":"2021-10-08T19:42:25.257797+0000","last_became_active":"2021-10-08T19:37:00.342526+0000","last_became_peered":"2021-10-08T19:37:00.342526+0000","last_unstale":"2021-10-08T19:42:25.257797+0000","last_undegraded":"2021-10-08T19:42:25.257797+0000","last_fullsized":"2021-10-08T19:42:25.257797+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:42:20.925285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:42:20.925285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.034644155000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.26","version":"0'0","reported_seq":124,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.257761+0000","last_change":"2021-10-08T19:42:12.727134+0000","last_active":"2021-10-08T19:42:25.257761+0000","last_peered":"2021-10-08T19:42:25.257761+0000","last_clean":"2021-10-08T19:42:25.257761+0000","last_became_active":"2021-10-08T19:37:00.340327+0000","last_became_peered":"2021-10-08T19:37:00.340327+0000","last_unstale":"2021-10-08T19:42:25.257761+0000","last_undegraded":"2021-10-08T19:42:25.257761+0000","last_fullsized":"2021-10-08T19:42:25.257761+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:42:12.727047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:07.710367+0000","last_clean_scrub_stamp":"2021-10-08T19:42:12.727047+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0036580110000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.25","version":"328'2","reported_seq":435,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.242556+0000","last_change":"2021-10-08T19:40:07.331172+0000","last_active":"2021-10-08T19:42:25.242556+0000","last_peered":"2021-10-08T19:42:25.242556+0000","last_clean":"2021-10-08T19:42:25.242556+0000","last_became_active":"2021-10-08T19:37:00.344673+0000","last_became_peered":"2021-10-08T19:37:00.344673+0000","last_unstale":"2021-10-08T19:42:25.242556+0000","last_undegraded":"2021-10-08T19:42:25.242556+0000","last_fullsized":"2021-10-08T19:42:25.242556+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"328'2","last_scrub_stamp":"2021-10-08T19:40:07.331064+0000","last_deep_scrub":"328'2","last_deep_scrub_stamp":"2021-10-08T19:33:29.990395+0000","last_clean_scrub_stamp":"2021-10-08T19:40:07.331064+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010473448999999999,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.24","version":"0'0","reported_seq":124,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.251539+0000","last_change":"2021-10-08T19:40:36.960572+0000","last_active":"2021-10-08T19:42:25.251539+0000","last_peered":"2021-10-08T19:42:25.251539+0000","last_clean":"2021-10-08T19:42:25.251539+0000","last_became_active":"2021-10-08T19:37:00.336960+0000","last_became_peered":"2021-10-08T19:37:00.336960+0000","last_unstale":"2021-10-08T19:42:25.251539+0000","last_undegraded":"2021-10-08T19:42:25.251539+0000","last_fullsized":"2021-10-08T19:42:25.251539+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:36.960483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:36.960483+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0017323569999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.23","version":"0'0","reported_seq":118,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.254315+0000","last_change":"2021-10-08T19:39:26.231063+0000","last_active":"2021-10-08T19:42:25.254315+0000","last_peered":"2021-10-08T19:42:25.254315+0000","last_clean":"2021-10-08T19:42:25.254315+0000","last_became_active":"2021-10-08T19:37:00.347789+0000","last_became_peered":"2021-10-08T19:37:00.347789+0000","last_unstale":"2021-10-08T19:42:25.254315+0000","last_undegraded":"2021-10-08T19:42:25.254315+0000","last_fullsized":"2021-10-08T19:42:25.254315+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:26.230969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:26.230969+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.01135425,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.22","version":"0'0","reported_seq":526,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.252459+0000","last_change":"2021-10-08T19:42:07.986116+0000","last_active":"2021-10-08T19:42:25.252459+0000","last_peered":"2021-10-08T19:42:25.252459+0000","last_clean":"2021-10-08T19:42:25.252459+0000","last_became_active":"2021-10-08T19:37:00.343394+0000","last_became_peered":"2021-10-08T19:37:00.343394+0000","last_unstale":"2021-10-08T19:42:25.252459+0000","last_undegraded":"2021-10-08T19:42:25.252459+0000","last_fullsized":"2021-10-08T19:42:25.252459+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:42:07.986006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:42:07.986006+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0060216890000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3],"acting":[6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.21","version":"0'0","reported_seq":529,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.247062+0000","last_change":"2021-10-08T19:40:46.823451+0000","last_active":"2021-10-08T19:42:25.247062+0000","last_peered":"2021-10-08T19:42:25.247062+0000","last_clean":"2021-10-08T19:42:25.247062+0000","last_became_active":"2021-10-08T19:37:00.335409+0000","last_became_peered":"2021-10-08T19:37:00.335409+0000","last_unstale":"2021-10-08T19:42:25.247062+0000","last_undegraded":"2021-10-08T19:42:25.247062+0000","last_fullsized":"2021-10-08T19:42:25.247062+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:46.823341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:40:46.823341+0000","last_clean_scrub_stamp":"2021-10-08T19:40:46.823341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0093941830000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7],"acting":[2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.20","version":"0'0","reported_seq":128,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.255078+0000","last_change":"2021-10-08T19:39:11.566964+0000","last_active":"2021-10-08T19:42:25.255078+0000","last_peered":"2021-10-08T19:42:25.255078+0000","last_clean":"2021-10-08T19:42:25.255078+0000","last_became_active":"2021-10-08T19:37:00.341831+0000","last_became_peered":"2021-10-08T19:37:00.341831+0000","last_unstale":"2021-10-08T19:42:25.255078+0000","last_undegraded":"2021-10-08T19:42:25.255078+0000","last_fullsized":"2021-10-08T19:42:25.255078+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:11.566891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:32.922694+0000","last_clean_scrub_stamp":"2021-10-08T19:39:11.566891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0018543839999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"114'10","reported_seq":769,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:31.994772+0000","last_change":"2021-10-08T19:40:34.920105+0000","last_active":"2021-10-08T19:42:31.994772+0000","last_peered":"2021-10-08T19:42:31.994772+0000","last_clean":"2021-10-08T19:42:31.994772+0000","last_became_active":"2021-10-08T19:24:25.096162+0000","last_became_peered":"2021-10-08T19:24:25.096162+0000","last_unstale":"2021-10-08T19:42:31.994772+0000","last_undegraded":"2021-10-08T19:42:31.994772+0000","last_fullsized":"2021-10-08T19:42:31.994772+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'10","last_scrub_stamp":"2021-10-08T19:40:34.920011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:40:34.920011+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002553937,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"482'46","reported_seq":183,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.255663+0000","last_change":"2021-10-08T19:40:31.983322+0000","last_active":"2021-10-08T19:42:25.255663+0000","last_peered":"2021-10-08T19:42:25.255663+0000","last_clean":"2021-10-08T19:42:25.255663+0000","last_became_active":"2021-10-08T19:37:18.998305+0000","last_became_peered":"2021-10-08T19:37:18.998305+0000","last_unstale":"2021-10-08T19:42:25.255663+0000","last_undegraded":"2021-10-08T19:42:25.255663+0000","last_fullsized":"2021-10-08T19:42:25.255663+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'34","last_scrub_stamp":"2021-10-08T19:40:31.983216+0000","last_deep_scrub":"87'22","last_deep_scrub_stamp":"2021-10-08T19:22:58.705632+0000","last_clean_scrub_stamp":"2021-10-08T19:40:31.983216+0000","log_size":46,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012884054000000001,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":522,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.250450+0000","last_change":"2021-10-08T19:42:13.395772+0000","last_active":"2021-10-08T19:42:25.250450+0000","last_peered":"2021-10-08T19:42:25.250450+0000","last_clean":"2021-10-08T19:42:25.250450+0000","last_became_active":"2021-10-08T19:29:40.632678+0000","last_became_peered":"2021-10-08T19:29:40.632678+0000","last_unstale":"2021-10-08T19:42:25.250450+0000","last_undegraded":"2021-10-08T19:42:25.250450+0000","last_fullsized":"2021-10-08T19:42:25.250450+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:42:13.395679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:42:13.395679+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003682907,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":193,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.252704+0000","last_change":"2021-10-08T19:41:15.824286+0000","last_active":"2021-10-08T19:42:25.252704+0000","last_peered":"2021-10-08T19:42:25.252704+0000","last_clean":"2021-10-08T19:42:25.252704+0000","last_became_active":"2021-10-08T19:37:19.000347+0000","last_became_peered":"2021-10-08T19:37:19.000347+0000","last_unstale":"2021-10-08T19:42:25.252704+0000","last_undegraded":"2021-10-08T19:42:25.252704+0000","last_fullsized":"2021-10-08T19:42:25.252704+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:41:15.824215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:08.936801+0000","last_clean_scrub_stamp":"2021-10-08T19:41:15.824215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.036641003999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":414,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.258068+0000","last_change":"2021-10-08T19:41:29.988960+0000","last_active":"2021-10-08T19:42:25.258068+0000","last_peered":"2021-10-08T19:42:25.258068+0000","last_clean":"2021-10-08T19:42:25.258068+0000","last_became_active":"2021-10-08T19:25:15.510457+0000","last_became_peered":"2021-10-08T19:25:15.510457+0000","last_unstale":"2021-10-08T19:42:25.258068+0000","last_undegraded":"2021-10-08T19:42:25.258068+0000","last_fullsized":"2021-10-08T19:42:25.258068+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:41:29.988869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:33:28.036266+0000","last_clean_scrub_stamp":"2021-10-08T19:41:29.988869+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.006050176,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"482'25","reported_seq":560,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.244184+0000","last_change":"2021-10-08T19:42:08.301131+0000","last_active":"2021-10-08T19:42:25.244184+0000","last_peered":"2021-10-08T19:42:25.244184+0000","last_clean":"2021-10-08T19:42:25.244184+0000","last_became_active":"2021-10-08T19:28:40.159729+0000","last_became_peered":"2021-10-08T19:28:40.159729+0000","last_unstale":"2021-10-08T19:42:25.244184+0000","last_undegraded":"2021-10-08T19:42:25.244184+0000","last_fullsized":"2021-10-08T19:42:25.244184+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'25","last_scrub_stamp":"2021-10-08T19:42:08.298419+0000","last_deep_scrub":"337'19","last_deep_scrub_stamp":"2021-10-08T19:34:14.040249+0000","last_clean_scrub_stamp":"2021-10-08T19:42:08.298419+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.020124136000000001,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":358,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.247400+0000","last_change":"2021-10-08T19:42:11.562482+0000","last_active":"2021-10-08T19:42:25.247400+0000","last_peered":"2021-10-08T19:42:25.247400+0000","last_clean":"2021-10-08T19:42:25.247400+0000","last_became_active":"2021-10-08T19:29:40.624977+0000","last_became_peered":"2021-10-08T19:29:40.624977+0000","last_unstale":"2021-10-08T19:42:25.247400+0000","last_undegraded":"2021-10-08T19:42:25.247400+0000","last_fullsized":"2021-10-08T19:42:25.247400+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:42:11.562400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:42:11.562400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0094070319999999992,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":508,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.249473+0000","last_change":"2021-10-08T19:40:48.882826+0000","last_active":"2021-10-08T19:42:25.249473+0000","last_peered":"2021-10-08T19:42:25.249473+0000","last_clean":"2021-10-08T19:42:25.249473+0000","last_became_active":"2021-10-08T19:29:40.629422+0000","last_became_peered":"2021-10-08T19:29:40.629422+0000","last_unstale":"2021-10-08T19:42:25.249473+0000","last_undegraded":"2021-10-08T19:42:25.249473+0000","last_fullsized":"2021-10-08T19:42:25.249473+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:48.882724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:40:48.882724+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0032251089999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":486,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.243830+0000","last_change":"2021-10-08T19:42:04.388531+0000","last_active":"2021-10-08T19:42:25.243830+0000","last_peered":"2021-10-08T19:42:25.243830+0000","last_clean":"2021-10-08T19:42:25.243830+0000","last_became_active":"2021-10-08T19:21:29.643022+0000","last_became_peered":"2021-10-08T19:21:29.643022+0000","last_unstale":"2021-10-08T19:42:25.243830+0000","last_undegraded":"2021-10-08T19:42:25.243830+0000","last_fullsized":"2021-10-08T19:42:25.243830+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:42:04.388425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:26.158421+0000","last_clean_scrub_stamp":"2021-10-08T19:42:04.388425+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.091212318000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"70'5","reported_seq":940,"reported_epoch":496,"state":"active+clean","last_fresh":"2021-10-08T19:42:33.231093+0000","last_change":"2021-10-08T19:42:15.063805+0000","last_active":"2021-10-08T19:42:33.231093+0000","last_peered":"2021-10-08T19:42:33.231093+0000","last_clean":"2021-10-08T19:42:33.231093+0000","last_became_active":"2021-10-08T19:37:19.006464+0000","last_became_peered":"2021-10-08T19:37:19.006464+0000","last_unstale":"2021-10-08T19:42:33.231093+0000","last_undegraded":"2021-10-08T19:42:33.231093+0000","last_fullsized":"2021-10-08T19:42:33.231093+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:42:15.063694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:42:15.063694+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.015662216999999999,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":633,"num_read_kb":633,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":778,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"482'60","reported_seq":572,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.252929+0000","last_change":"2021-10-08T19:40:49.868198+0000","last_active":"2021-10-08T19:42:25.252929+0000","last_peered":"2021-10-08T19:42:25.252929+0000","last_clean":"2021-10-08T19:42:25.252929+0000","last_became_active":"2021-10-08T19:28:40.101648+0000","last_became_peered":"2021-10-08T19:28:40.101648+0000","last_unstale":"2021-10-08T19:42:25.252929+0000","last_undegraded":"2021-10-08T19:42:25.252929+0000","last_fullsized":"2021-10-08T19:42:25.252929+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"428'44","last_scrub_stamp":"2021-10-08T19:40:49.868088+0000","last_deep_scrub":"428'44","last_deep_scrub_stamp":"2021-10-08T19:38:47.335892+0000","last_clean_scrub_stamp":"2021-10-08T19:40:49.868088+0000","log_size":60,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0038363440000000002,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":52,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":494,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.249972+0000","last_change":"2021-10-08T19:40:11.180747+0000","last_active":"2021-10-08T19:42:25.249972+0000","last_peered":"2021-10-08T19:42:25.249972+0000","last_clean":"2021-10-08T19:42:25.249972+0000","last_became_active":"2021-10-08T19:21:23.595919+0000","last_became_peered":"2021-10-08T19:21:23.595919+0000","last_unstale":"2021-10-08T19:42:25.249972+0000","last_undegraded":"2021-10-08T19:42:25.249972+0000","last_fullsized":"2021-10-08T19:42:25.249972+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:11.180640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:40:11.180640+0000","last_clean_scrub_stamp":"2021-10-08T19:40:11.180640+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0088737490000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":508,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.249214+0000","last_change":"2021-10-08T19:42:04.265625+0000","last_active":"2021-10-08T19:42:25.249214+0000","last_peered":"2021-10-08T19:42:25.249214+0000","last_clean":"2021-10-08T19:42:25.249214+0000","last_became_active":"2021-10-08T19:31:22.783725+0000","last_became_peered":"2021-10-08T19:31:22.783725+0000","last_unstale":"2021-10-08T19:42:25.249214+0000","last_undegraded":"2021-10-08T19:42:25.249214+0000","last_fullsized":"2021-10-08T19:42:25.249214+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:42:04.265535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:42:04.265535+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0072296349999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":492,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.255301+0000","last_change":"2021-10-08T19:39:55.885308+0000","last_active":"2021-10-08T19:42:25.255301+0000","last_peered":"2021-10-08T19:42:25.255301+0000","last_clean":"2021-10-08T19:42:25.255301+0000","last_became_active":"2021-10-08T19:29:40.638354+0000","last_became_peered":"2021-10-08T19:29:40.638354+0000","last_unstale":"2021-10-08T19:42:25.255301+0000","last_undegraded":"2021-10-08T19:42:25.255301+0000","last_fullsized":"2021-10-08T19:42:25.255301+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:55.885197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:39.528699+0000","last_clean_scrub_stamp":"2021-10-08T19:39:55.885197+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011288616,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":419,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.258685+0000","last_change":"2021-10-08T19:39:17.629247+0000","last_active":"2021-10-08T19:42:25.258685+0000","last_peered":"2021-10-08T19:42:25.258685+0000","last_clean":"2021-10-08T19:42:25.258685+0000","last_became_active":"2021-10-08T19:31:22.785590+0000","last_became_peered":"2021-10-08T19:31:22.785590+0000","last_unstale":"2021-10-08T19:42:25.258685+0000","last_undegraded":"2021-10-08T19:42:25.258685+0000","last_fullsized":"2021-10-08T19:42:25.258685+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:17.629178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:17.629178+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001878256,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.8","version":"90'130","reported_seq":488,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.247004+0000","last_change":"2021-10-08T19:42:02.231994+0000","last_active":"2021-10-08T19:42:25.247004+0000","last_peered":"2021-10-08T19:42:25.247004+0000","last_clean":"2021-10-08T19:42:25.247004+0000","last_became_active":"2021-10-08T19:37:19.009239+0000","last_became_peered":"2021-10-08T19:37:19.009239+0000","last_unstale":"2021-10-08T19:42:25.247004+0000","last_undegraded":"2021-10-08T19:42:25.247004+0000","last_fullsized":"2021-10-08T19:42:25.247004+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:42:02.231888+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:42:02.231888+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0024481160000000002,"stat_sum":{"num_bytes":262688,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"482'53","reported_seq":609,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.242971+0000","last_change":"2021-10-08T19:40:10.405161+0000","last_active":"2021-10-08T19:42:25.242971+0000","last_peered":"2021-10-08T19:42:25.242971+0000","last_clean":"2021-10-08T19:42:25.242971+0000","last_became_active":"2021-10-08T19:28:40.099618+0000","last_became_peered":"2021-10-08T19:28:40.099618+0000","last_unstale":"2021-10-08T19:42:25.242971+0000","last_undegraded":"2021-10-08T19:42:25.242971+0000","last_fullsized":"2021-10-08T19:42:25.242971+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"459'39","last_scrub_stamp":"2021-10-08T19:40:10.405068+0000","last_deep_scrub":"459'39","last_deep_scrub_stamp":"2021-10-08T19:40:10.405068+0000","last_clean_scrub_stamp":"2021-10-08T19:40:10.405068+0000","log_size":53,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.024252185999999998,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":71,"num_read_kb":61,"num_write":46,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"61'1","reported_seq":488,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.256387+0000","last_change":"2021-10-08T19:40:36.925924+0000","last_active":"2021-10-08T19:42:25.256387+0000","last_peered":"2021-10-08T19:42:25.256387+0000","last_clean":"2021-10-08T19:42:25.256387+0000","last_became_active":"2021-10-08T19:21:23.607064+0000","last_became_peered":"2021-10-08T19:21:23.607064+0000","last_unstale":"2021-10-08T19:42:25.256387+0000","last_undegraded":"2021-10-08T19:42:25.256387+0000","last_fullsized":"2021-10-08T19:42:25.256387+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'1","last_scrub_stamp":"2021-10-08T19:40:36.925849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:36.925849+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0081260700000000009,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":332,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.251586+0000","last_change":"2021-10-08T19:40:49.345813+0000","last_active":"2021-10-08T19:42:25.251586+0000","last_peered":"2021-10-08T19:42:25.251586+0000","last_clean":"2021-10-08T19:42:25.251586+0000","last_became_active":"2021-10-08T19:28:40.152478+0000","last_became_peered":"2021-10-08T19:28:40.152478+0000","last_unstale":"2021-10-08T19:42:25.251586+0000","last_undegraded":"2021-10-08T19:42:25.251586+0000","last_fullsized":"2021-10-08T19:42:25.251586+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:49.345703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:30:09.081635+0000","last_clean_scrub_stamp":"2021-10-08T19:40:49.345703+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0058856459999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":506,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.249279+0000","last_change":"2021-10-08T19:40:40.184580+0000","last_active":"2021-10-08T19:42:25.249279+0000","last_peered":"2021-10-08T19:42:25.249279+0000","last_clean":"2021-10-08T19:42:25.249279+0000","last_became_active":"2021-10-08T19:29:40.629424+0000","last_became_peered":"2021-10-08T19:29:40.629424+0000","last_unstale":"2021-10-08T19:42:25.249279+0000","last_undegraded":"2021-10-08T19:42:25.249279+0000","last_fullsized":"2021-10-08T19:42:25.249279+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:40.184460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:40:40.184460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.189286643,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":464,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.253049+0000","last_change":"2021-10-08T19:40:00.916866+0000","last_active":"2021-10-08T19:42:25.253049+0000","last_peered":"2021-10-08T19:42:25.253049+0000","last_clean":"2021-10-08T19:42:25.253049+0000","last_became_active":"2021-10-08T19:31:51.676829+0000","last_became_peered":"2021-10-08T19:31:51.676829+0000","last_unstale":"2021-10-08T19:42:25.253049+0000","last_undegraded":"2021-10-08T19:42:25.253049+0000","last_fullsized":"2021-10-08T19:42:25.253049+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:00.916780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:00.916780+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0077587489999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.9","version":"90'130","reported_seq":828,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.255184+0000","last_change":"2021-10-08T19:41:28.037638+0000","last_active":"2021-10-08T19:42:25.255184+0000","last_peered":"2021-10-08T19:42:25.255184+0000","last_clean":"2021-10-08T19:42:25.255184+0000","last_became_active":"2021-10-08T19:29:43.634789+0000","last_became_peered":"2021-10-08T19:29:43.634789+0000","last_unstale":"2021-10-08T19:42:25.255184+0000","last_undegraded":"2021-10-08T19:42:25.255184+0000","last_fullsized":"2021-10-08T19:42:25.255184+0000","mapping_epoch":239,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:41:28.037493+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:41:28.037493+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0060675549999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"482'30","reported_seq":606,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.242309+0000","last_change":"2021-10-08T19:40:00.425294+0000","last_active":"2021-10-08T19:42:25.242309+0000","last_peered":"2021-10-08T19:42:25.242309+0000","last_clean":"2021-10-08T19:42:25.242309+0000","last_became_active":"2021-10-08T19:29:40.631807+0000","last_became_peered":"2021-10-08T19:29:40.631807+0000","last_unstale":"2021-10-08T19:42:25.242309+0000","last_undegraded":"2021-10-08T19:42:25.242309+0000","last_fullsized":"2021-10-08T19:42:25.242309+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'20","last_scrub_stamp":"2021-10-08T19:40:00.425194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:40:00.425194+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0087912159999999993,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":40,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":352,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.246756+0000","last_change":"2021-10-08T19:40:02.914149+0000","last_active":"2021-10-08T19:42:25.246756+0000","last_peered":"2021-10-08T19:42:25.246756+0000","last_clean":"2021-10-08T19:42:25.246756+0000","last_became_active":"2021-10-08T19:29:40.638988+0000","last_became_peered":"2021-10-08T19:29:40.638988+0000","last_unstale":"2021-10-08T19:42:25.246756+0000","last_undegraded":"2021-10-08T19:42:25.246756+0000","last_fullsized":"2021-10-08T19:42:25.246756+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:02.914080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:02.914080+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.022904704000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"250'9","reported_seq":755,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:31.994786+0000","last_change":"2021-10-08T19:40:04.082786+0000","last_active":"2021-10-08T19:42:31.994786+0000","last_peered":"2021-10-08T19:42:31.994786+0000","last_clean":"2021-10-08T19:42:31.994786+0000","last_became_active":"2021-10-08T19:21:27.637930+0000","last_became_peered":"2021-10-08T19:21:27.637930+0000","last_unstale":"2021-10-08T19:42:31.994786+0000","last_undegraded":"2021-10-08T19:42:31.994786+0000","last_fullsized":"2021-10-08T19:42:31.994786+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'9","last_scrub_stamp":"2021-10-08T19:40:04.082682+0000","last_deep_scrub":"250'9","last_deep_scrub_stamp":"2021-10-08T19:30:04.239189+0000","last_clean_scrub_stamp":"2021-10-08T19:40:04.082682+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0097725820000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":491,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.242850+0000","last_change":"2021-10-08T19:39:20.149864+0000","last_active":"2021-10-08T19:42:25.242850+0000","last_peered":"2021-10-08T19:42:25.242850+0000","last_clean":"2021-10-08T19:42:25.242850+0000","last_became_active":"2021-10-08T19:28:40.100213+0000","last_became_peered":"2021-10-08T19:28:40.100213+0000","last_unstale":"2021-10-08T19:42:25.242850+0000","last_undegraded":"2021-10-08T19:42:25.242850+0000","last_fullsized":"2021-10-08T19:42:25.242850+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:20.149744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:20.149744+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.034036438000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":286,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.254853+0000","last_change":"2021-10-08T19:40:06.317558+0000","last_active":"2021-10-08T19:42:25.254853+0000","last_peered":"2021-10-08T19:42:25.254853+0000","last_clean":"2021-10-08T19:42:25.254853+0000","last_became_active":"2021-10-08T19:29:44.443507+0000","last_became_peered":"2021-10-08T19:29:44.443507+0000","last_unstale":"2021-10-08T19:42:25.254853+0000","last_undegraded":"2021-10-08T19:42:25.254853+0000","last_fullsized":"2021-10-08T19:42:25.254853+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:06.317461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:06.317461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0054001470000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.a","version":"90'130","reported_seq":420,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.249357+0000","last_change":"2021-10-08T19:40:01.053717+0000","last_active":"2021-10-08T19:42:25.249357+0000","last_peered":"2021-10-08T19:42:25.249357+0000","last_clean":"2021-10-08T19:42:25.249357+0000","last_became_active":"2021-10-08T19:37:19.000525+0000","last_became_peered":"2021-10-08T19:37:19.000525+0000","last_unstale":"2021-10-08T19:42:25.249357+0000","last_undegraded":"2021-10-08T19:42:25.249357+0000","last_fullsized":"2021-10-08T19:42:25.249357+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:40:01.053607+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:40:01.053607+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034190679999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"482'39","reported_seq":252,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.249158+0000","last_change":"2021-10-08T19:40:03.107059+0000","last_active":"2021-10-08T19:42:25.249158+0000","last_peered":"2021-10-08T19:42:25.249158+0000","last_clean":"2021-10-08T19:42:25.249158+0000","last_became_active":"2021-10-08T19:32:45.162914+0000","last_became_peered":"2021-10-08T19:32:45.162914+0000","last_unstale":"2021-10-08T19:42:25.249158+0000","last_undegraded":"2021-10-08T19:42:25.249158+0000","last_fullsized":"2021-10-08T19:42:25.249158+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'27","last_scrub_stamp":"2021-10-08T19:40:03.106967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:40:03.106967+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0080879679999999992,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":550,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":359,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.246014+0000","last_change":"2021-10-08T19:41:24.519028+0000","last_active":"2021-10-08T19:42:25.246014+0000","last_peered":"2021-10-08T19:42:25.246014+0000","last_clean":"2021-10-08T19:42:25.246014+0000","last_became_active":"2021-10-08T19:36:58.004540+0000","last_became_peered":"2021-10-08T19:36:58.004540+0000","last_unstale":"2021-10-08T19:42:25.246014+0000","last_undegraded":"2021-10-08T19:42:25.246014+0000","last_fullsized":"2021-10-08T19:42:25.246014+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:41:24.518921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:47.613029+0000","last_clean_scrub_stamp":"2021-10-08T19:41:24.518921+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.03479492,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"88'9","reported_seq":743,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:31.994839+0000","last_change":"2021-10-08T19:40:01.462959+0000","last_active":"2021-10-08T19:42:31.994839+0000","last_peered":"2021-10-08T19:42:31.994839+0000","last_clean":"2021-10-08T19:42:31.994839+0000","last_became_active":"2021-10-08T19:21:27.636432+0000","last_became_peered":"2021-10-08T19:21:27.636432+0000","last_unstale":"2021-10-08T19:42:31.994839+0000","last_undegraded":"2021-10-08T19:42:31.994839+0000","last_fullsized":"2021-10-08T19:42:31.994839+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'9","last_scrub_stamp":"2021-10-08T19:40:01.462851+0000","last_deep_scrub":"88'9","last_deep_scrub_stamp":"2021-10-08T19:23:00.048245+0000","last_clean_scrub_stamp":"2021-10-08T19:40:01.462851+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.020776886000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":291,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.247203+0000","last_change":"2021-10-08T19:42:05.645999+0000","last_active":"2021-10-08T19:42:25.247203+0000","last_peered":"2021-10-08T19:42:25.247203+0000","last_clean":"2021-10-08T19:42:25.247203+0000","last_became_active":"2021-10-08T19:37:19.016085+0000","last_became_peered":"2021-10-08T19:37:19.016085+0000","last_unstale":"2021-10-08T19:42:25.247203+0000","last_undegraded":"2021-10-08T19:42:25.247203+0000","last_fullsized":"2021-10-08T19:42:25.247203+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:42:05.645900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:42:05.645900+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.14483043200000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"70'5","reported_seq":286,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.248048+0000","last_change":"2021-10-08T19:40:32.248981+0000","last_active":"2021-10-08T19:42:25.248048+0000","last_peered":"2021-10-08T19:42:25.248048+0000","last_clean":"2021-10-08T19:42:25.248048+0000","last_became_active":"2021-10-08T19:29:40.639786+0000","last_became_peered":"2021-10-08T19:29:40.639786+0000","last_unstale":"2021-10-08T19:42:25.248048+0000","last_undegraded":"2021-10-08T19:42:25.248048+0000","last_fullsized":"2021-10-08T19:42:25.248048+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:40:32.248867+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2021-10-08T19:36:08.760670+0000","last_clean_scrub_stamp":"2021-10-08T19:40:32.248867+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.015954836,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"482'27","reported_seq":669,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.242543+0000","last_change":"2021-10-08T19:40:33.616897+0000","last_active":"2021-10-08T19:42:25.242543+0000","last_peered":"2021-10-08T19:42:25.242543+0000","last_clean":"2021-10-08T19:42:25.242543+0000","last_became_active":"2021-10-08T19:31:51.677509+0000","last_became_peered":"2021-10-08T19:31:51.677509+0000","last_unstale":"2021-10-08T19:42:25.242543+0000","last_undegraded":"2021-10-08T19:42:25.242543+0000","last_fullsized":"2021-10-08T19:42:25.242543+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:40:33.616776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:40:33.616776+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0050522830000000003,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":770,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":515,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.255497+0000","last_change":"2021-10-08T19:42:11.773723+0000","last_active":"2021-10-08T19:42:25.255497+0000","last_peered":"2021-10-08T19:42:25.255497+0000","last_clean":"2021-10-08T19:42:25.255497+0000","last_became_active":"2021-10-08T19:36:58.001610+0000","last_became_peered":"2021-10-08T19:36:58.001610+0000","last_unstale":"2021-10-08T19:42:25.255497+0000","last_undegraded":"2021-10-08T19:42:25.255497+0000","last_fullsized":"2021-10-08T19:42:25.255497+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:42:11.773654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:42:11.773654+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0071159020000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":187,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.242901+0000","last_change":"2021-10-08T19:39:21.090794+0000","last_active":"2021-10-08T19:42:25.242901+0000","last_peered":"2021-10-08T19:42:25.242901+0000","last_clean":"2021-10-08T19:42:25.242901+0000","last_became_active":"2021-10-08T19:37:18.997446+0000","last_became_peered":"2021-10-08T19:37:18.997446+0000","last_unstale":"2021-10-08T19:42:25.242901+0000","last_undegraded":"2021-10-08T19:42:25.242901+0000","last_fullsized":"2021-10-08T19:42:25.242901+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:21.090701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:39:21.090701+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001395486,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":292,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.255581+0000","last_change":"2021-10-08T19:40:53.173789+0000","last_active":"2021-10-08T19:42:25.255581+0000","last_peered":"2021-10-08T19:42:25.255581+0000","last_clean":"2021-10-08T19:42:25.255581+0000","last_became_active":"2021-10-08T19:29:40.638099+0000","last_became_peered":"2021-10-08T19:29:40.638099+0000","last_unstale":"2021-10-08T19:42:25.255581+0000","last_undegraded":"2021-10-08T19:42:25.255581+0000","last_fullsized":"2021-10-08T19:42:25.255581+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:53.173689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:17.422176+0000","last_clean_scrub_stamp":"2021-10-08T19:40:53.173689+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0081726460000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":430,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.241747+0000","last_change":"2021-10-08T19:40:08.369310+0000","last_active":"2021-10-08T19:42:25.241747+0000","last_peered":"2021-10-08T19:42:25.241747+0000","last_clean":"2021-10-08T19:42:25.241747+0000","last_became_active":"2021-10-08T19:24:13.506602+0000","last_became_peered":"2021-10-08T19:24:13.506602+0000","last_unstale":"2021-10-08T19:42:25.241747+0000","last_undegraded":"2021-10-08T19:42:25.241747+0000","last_fullsized":"2021-10-08T19:42:25.241747+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:08.369244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:08.369244+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034824579999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"90'130","reported_seq":616,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.255581+0000","last_change":"2021-10-08T19:39:30.252356+0000","last_active":"2021-10-08T19:42:25.255581+0000","last_peered":"2021-10-08T19:42:25.255581+0000","last_clean":"2021-10-08T19:42:25.255581+0000","last_became_active":"2021-10-08T19:29:43.636733+0000","last_became_peered":"2021-10-08T19:29:43.636733+0000","last_unstale":"2021-10-08T19:42:25.255581+0000","last_undegraded":"2021-10-08T19:42:25.255581+0000","last_fullsized":"2021-10-08T19:42:25.255581+0000","mapping_epoch":239,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:39:30.252247+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:39:30.252247+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012156159999999999,"stat_sum":{"num_bytes":327680,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"238'13","reported_seq":457,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:31.994803+0000","last_change":"2021-10-08T19:42:24.120995+0000","last_active":"2021-10-08T19:42:31.994803+0000","last_peered":"2021-10-08T19:42:31.994803+0000","last_clean":"2021-10-08T19:42:31.994803+0000","last_became_active":"2021-10-08T19:29:40.640248+0000","last_became_peered":"2021-10-08T19:29:40.640248+0000","last_unstale":"2021-10-08T19:42:31.994803+0000","last_undegraded":"2021-10-08T19:42:31.994803+0000","last_fullsized":"2021-10-08T19:42:31.994803+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"238'13","last_scrub_stamp":"2021-10-08T19:42:24.120884+0000","last_deep_scrub":"91'9","last_deep_scrub_stamp":"2021-10-08T19:23:32.329475+0000","last_clean_scrub_stamp":"2021-10-08T19:42:24.120884+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.028452767,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"482'42","reported_seq":598,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.241867+0000","last_change":"2021-10-08T19:42:09.062332+0000","last_active":"2021-10-08T19:42:25.241867+0000","last_peered":"2021-10-08T19:42:25.241867+0000","last_clean":"2021-10-08T19:42:25.241867+0000","last_became_active":"2021-10-08T19:24:25.098743+0000","last_became_peered":"2021-10-08T19:24:25.098743+0000","last_unstale":"2021-10-08T19:42:25.241867+0000","last_undegraded":"2021-10-08T19:42:25.241867+0000","last_fullsized":"2021-10-08T19:42:25.241867+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'42","last_scrub_stamp":"2021-10-08T19:42:09.062232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:42:09.062232+0000","log_size":42,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0060526909999999998,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":63,"num_read_kb":56,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":446,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.251806+0000","last_change":"2021-10-08T19:42:18.058501+0000","last_active":"2021-10-08T19:42:25.251806+0000","last_peered":"2021-10-08T19:42:25.251806+0000","last_clean":"2021-10-08T19:42:25.251806+0000","last_became_active":"2021-10-08T19:37:45.829953+0000","last_became_peered":"2021-10-08T19:37:45.829953+0000","last_unstale":"2021-10-08T19:42:25.251806+0000","last_undegraded":"2021-10-08T19:42:25.251806+0000","last_fullsized":"2021-10-08T19:42:25.251806+0000","mapping_epoch":407,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":408,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:42:18.058409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:42:18.058409+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0078833879999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,2],"acting":[6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":498,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.256575+0000","last_change":"2021-10-08T19:40:10.935739+0000","last_active":"2021-10-08T19:42:25.256575+0000","last_peered":"2021-10-08T19:42:25.256575+0000","last_clean":"2021-10-08T19:42:25.256575+0000","last_became_active":"2021-10-08T19:24:25.094848+0000","last_became_peered":"2021-10-08T19:24:25.094848+0000","last_unstale":"2021-10-08T19:42:25.256575+0000","last_undegraded":"2021-10-08T19:42:25.256575+0000","last_fullsized":"2021-10-08T19:42:25.256575+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:10.935616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:40:10.935616+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.087461560999999993,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":459,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.243324+0000","last_change":"2021-10-08T19:42:10.229997+0000","last_active":"2021-10-08T19:42:25.243324+0000","last_peered":"2021-10-08T19:42:25.243324+0000","last_clean":"2021-10-08T19:42:25.243324+0000","last_became_active":"2021-10-08T19:28:40.132751+0000","last_became_peered":"2021-10-08T19:28:40.132751+0000","last_unstale":"2021-10-08T19:42:25.243324+0000","last_undegraded":"2021-10-08T19:42:25.243324+0000","last_fullsized":"2021-10-08T19:42:25.243324+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:42:10.229899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:42:10.229899+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.018016369000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"90'130","reported_seq":656,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.243131+0000","last_change":"2021-10-08T19:39:26.207889+0000","last_active":"2021-10-08T19:42:25.243131+0000","last_peered":"2021-10-08T19:42:25.243131+0000","last_clean":"2021-10-08T19:42:25.243131+0000","last_became_active":"2021-10-08T19:27:26.590651+0000","last_became_peered":"2021-10-08T19:27:26.590651+0000","last_unstale":"2021-10-08T19:42:25.243131+0000","last_undegraded":"2021-10-08T19:42:25.243131+0000","last_fullsized":"2021-10-08T19:42:25.243131+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:39:26.207770+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:32:14.582883+0000","last_clean_scrub_stamp":"2021-10-08T19:39:26.207770+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011952313000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":493,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.242006+0000","last_change":"2021-10-08T19:39:25.156483+0000","last_active":"2021-10-08T19:42:25.242006+0000","last_peered":"2021-10-08T19:42:25.242006+0000","last_clean":"2021-10-08T19:42:25.242006+0000","last_became_active":"2021-10-08T19:29:40.639405+0000","last_became_peered":"2021-10-08T19:29:40.639405+0000","last_unstale":"2021-10-08T19:42:25.242006+0000","last_undegraded":"2021-10-08T19:42:25.242006+0000","last_fullsized":"2021-10-08T19:42:25.242006+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:25.156355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:39:25.156355+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0062655510000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"482'42","reported_seq":346,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.247814+0000","last_change":"2021-10-08T19:41:30.286965+0000","last_active":"2021-10-08T19:42:25.247814+0000","last_peered":"2021-10-08T19:42:25.247814+0000","last_clean":"2021-10-08T19:42:25.247814+0000","last_became_active":"2021-10-08T19:29:40.635007+0000","last_became_peered":"2021-10-08T19:29:40.635007+0000","last_unstale":"2021-10-08T19:42:25.247814+0000","last_undegraded":"2021-10-08T19:42:25.247814+0000","last_fullsized":"2021-10-08T19:42:25.247814+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'30","last_scrub_stamp":"2021-10-08T19:41:30.286862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:41:30.286862+0000","log_size":42,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.025802489000000001,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":69,"num_read_kb":57,"num_write":44,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":335,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.246728+0000","last_change":"2021-10-08T19:40:46.233555+0000","last_active":"2021-10-08T19:42:25.246728+0000","last_peered":"2021-10-08T19:42:25.246728+0000","last_clean":"2021-10-08T19:42:25.246728+0000","last_became_active":"2021-10-08T19:36:58.013501+0000","last_became_peered":"2021-10-08T19:36:58.013501+0000","last_unstale":"2021-10-08T19:42:25.246728+0000","last_undegraded":"2021-10-08T19:42:25.246728+0000","last_fullsized":"2021-10-08T19:42:25.246728+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:46.233456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:40:46.233456+0000","last_clean_scrub_stamp":"2021-10-08T19:40:46.233456+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.006516811,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":491,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.242286+0000","last_change":"2021-10-08T19:40:04.385494+0000","last_active":"2021-10-08T19:42:25.242286+0000","last_peered":"2021-10-08T19:42:25.242286+0000","last_clean":"2021-10-08T19:42:25.242286+0000","last_became_active":"2021-10-08T19:29:40.638253+0000","last_became_peered":"2021-10-08T19:29:40.638253+0000","last_unstale":"2021-10-08T19:42:25.242286+0000","last_undegraded":"2021-10-08T19:42:25.242286+0000","last_fullsized":"2021-10-08T19:42:25.242286+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:04.385386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:40:04.385386+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0092727669999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":286,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.254811+0000","last_change":"2021-10-08T19:40:44.228306+0000","last_active":"2021-10-08T19:42:25.254811+0000","last_peered":"2021-10-08T19:42:25.254811+0000","last_clean":"2021-10-08T19:42:25.254811+0000","last_became_active":"2021-10-08T19:29:40.634579+0000","last_became_peered":"2021-10-08T19:29:40.634579+0000","last_unstale":"2021-10-08T19:42:25.254811+0000","last_undegraded":"2021-10-08T19:42:25.254811+0000","last_fullsized":"2021-10-08T19:42:25.254811+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:44.228198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:44.228198+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013076706,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"90'130","reported_seq":599,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.251311+0000","last_change":"2021-10-08T19:41:20.888804+0000","last_active":"2021-10-08T19:42:25.251311+0000","last_peered":"2021-10-08T19:42:25.251311+0000","last_clean":"2021-10-08T19:42:25.251311+0000","last_became_active":"2021-10-08T19:30:00.643797+0000","last_became_peered":"2021-10-08T19:30:00.643797+0000","last_unstale":"2021-10-08T19:42:25.251311+0000","last_undegraded":"2021-10-08T19:42:25.251311+0000","last_fullsized":"2021-10-08T19:42:25.251311+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:41:20.888698+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:41:20.888698+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0053594769999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":436,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.252972+0000","last_change":"2021-10-08T19:41:17.860285+0000","last_active":"2021-10-08T19:42:25.252972+0000","last_peered":"2021-10-08T19:42:25.252972+0000","last_clean":"2021-10-08T19:42:25.252972+0000","last_became_active":"2021-10-08T19:24:25.095389+0000","last_became_peered":"2021-10-08T19:24:25.095389+0000","last_unstale":"2021-10-08T19:42:25.252972+0000","last_undegraded":"2021-10-08T19:42:25.252972+0000","last_fullsized":"2021-10-08T19:42:25.252972+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:41:17.859917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:41:17.859917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0055520150000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"482'39","reported_seq":550,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.243906+0000","last_change":"2021-10-08T19:40:39.869360+0000","last_active":"2021-10-08T19:42:25.243906+0000","last_peered":"2021-10-08T19:42:25.243906+0000","last_clean":"2021-10-08T19:42:25.243906+0000","last_became_active":"2021-10-08T19:21:25.741812+0000","last_became_peered":"2021-10-08T19:21:25.741812+0000","last_unstale":"2021-10-08T19:42:25.243906+0000","last_undegraded":"2021-10-08T19:42:25.243906+0000","last_fullsized":"2021-10-08T19:42:25.243906+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'29","last_scrub_stamp":"2021-10-08T19:40:39.869249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:40:39.869249+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0043767700000000003,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":69,"num_read_kb":55,"num_write":42,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"328'2","reported_seq":507,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.258859+0000","last_change":"2021-10-08T19:42:04.859925+0000","last_active":"2021-10-08T19:42:25.258859+0000","last_peered":"2021-10-08T19:42:25.258859+0000","last_clean":"2021-10-08T19:42:25.258859+0000","last_became_active":"2021-10-08T19:36:58.000171+0000","last_became_peered":"2021-10-08T19:36:58.000171+0000","last_unstale":"2021-10-08T19:42:25.258859+0000","last_undegraded":"2021-10-08T19:42:25.258859+0000","last_fullsized":"2021-10-08T19:42:25.258859+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"328'2","last_scrub_stamp":"2021-10-08T19:42:04.859852+0000","last_deep_scrub":"328'2","last_deep_scrub_stamp":"2021-10-08T19:33:29.990395+0000","last_clean_scrub_stamp":"2021-10-08T19:42:04.859852+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0015630080000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":326,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.245787+0000","last_change":"2021-10-08T19:40:09.995072+0000","last_active":"2021-10-08T19:42:25.245787+0000","last_peered":"2021-10-08T19:42:25.245787+0000","last_clean":"2021-10-08T19:42:25.245787+0000","last_became_active":"2021-10-08T19:28:40.140876+0000","last_became_peered":"2021-10-08T19:28:40.140876+0000","last_unstale":"2021-10-08T19:42:25.245787+0000","last_undegraded":"2021-10-08T19:42:25.245787+0000","last_fullsized":"2021-10-08T19:42:25.245787+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:09.994958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:40:09.994958+0000","last_clean_scrub_stamp":"2021-10-08T19:40:09.994958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.065315867,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"70'5","reported_seq":332,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.251865+0000","last_change":"2021-10-08T19:40:44.202234+0000","last_active":"2021-10-08T19:42:25.251865+0000","last_peered":"2021-10-08T19:42:25.251865+0000","last_clean":"2021-10-08T19:42:25.251865+0000","last_became_active":"2021-10-08T19:28:40.150503+0000","last_became_peered":"2021-10-08T19:28:40.150503+0000","last_unstale":"2021-10-08T19:42:25.251865+0000","last_undegraded":"2021-10-08T19:42:25.251865+0000","last_fullsized":"2021-10-08T19:42:25.251865+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:40:44.202122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:44.202122+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.004019262,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"90'130","reported_seq":635,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.248640+0000","last_change":"2021-10-08T19:42:10.588514+0000","last_active":"2021-10-08T19:42:25.248640+0000","last_peered":"2021-10-08T19:42:25.248640+0000","last_clean":"2021-10-08T19:42:25.248640+0000","last_became_active":"2021-10-08T19:28:43.178371+0000","last_became_peered":"2021-10-08T19:28:43.178371+0000","last_unstale":"2021-10-08T19:42:25.248640+0000","last_undegraded":"2021-10-08T19:42:25.248640+0000","last_fullsized":"2021-10-08T19:42:25.248640+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:42:10.588404+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:34:13.653248+0000","last_clean_scrub_stamp":"2021-10-08T19:42:10.588404+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0042251559999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":258,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.251196+0000","last_change":"2021-10-08T19:42:23.891904+0000","last_active":"2021-10-08T19:42:25.251196+0000","last_peered":"2021-10-08T19:42:25.251196+0000","last_clean":"2021-10-08T19:42:25.251196+0000","last_became_active":"2021-10-08T19:31:22.783759+0000","last_became_peered":"2021-10-08T19:31:22.783759+0000","last_unstale":"2021-10-08T19:42:25.251196+0000","last_undegraded":"2021-10-08T19:42:25.251196+0000","last_fullsized":"2021-10-08T19:42:25.251196+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:42:23.891779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:42:23.891779+0000","last_clean_scrub_stamp":"2021-10-08T19:42:23.891779+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.052152670999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"482'36","reported_seq":605,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.243485+0000","last_change":"2021-10-08T19:39:58.874015+0000","last_active":"2021-10-08T19:42:25.243485+0000","last_peered":"2021-10-08T19:42:25.243485+0000","last_clean":"2021-10-08T19:42:25.243485+0000","last_became_active":"2021-10-08T19:32:45.154743+0000","last_became_peered":"2021-10-08T19:32:45.154743+0000","last_unstale":"2021-10-08T19:42:25.243485+0000","last_undegraded":"2021-10-08T19:42:25.243485+0000","last_fullsized":"2021-10-08T19:42:25.243485+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'24","last_scrub_stamp":"2021-10-08T19:39:58.873935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:39:58.873935+0000","log_size":36,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010739402,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":48,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":494,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.247095+0000","last_change":"2021-10-08T19:41:16.974876+0000","last_active":"2021-10-08T19:42:25.247095+0000","last_peered":"2021-10-08T19:42:25.247095+0000","last_clean":"2021-10-08T19:42:25.247095+0000","last_became_active":"2021-10-08T19:36:58.012034+0000","last_became_peered":"2021-10-08T19:36:58.012034+0000","last_unstale":"2021-10-08T19:42:25.247095+0000","last_undegraded":"2021-10-08T19:42:25.247095+0000","last_fullsized":"2021-10-08T19:42:25.247095+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:41:16.974779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:22.163674+0000","last_clean_scrub_stamp":"2021-10-08T19:41:16.974779+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0078097239999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":522,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.243484+0000","last_change":"2021-10-08T19:42:22.328323+0000","last_active":"2021-10-08T19:42:25.243484+0000","last_peered":"2021-10-08T19:42:25.243484+0000","last_clean":"2021-10-08T19:42:25.243484+0000","last_became_active":"2021-10-08T19:29:40.632010+0000","last_became_peered":"2021-10-08T19:29:40.632010+0000","last_unstale":"2021-10-08T19:42:25.243484+0000","last_undegraded":"2021-10-08T19:42:25.243484+0000","last_fullsized":"2021-10-08T19:42:25.243484+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:42:22.328248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:42:22.328248+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0042751170000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":234,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.251382+0000","last_change":"2021-10-08T19:42:14.715168+0000","last_active":"2021-10-08T19:42:25.251382+0000","last_peered":"2021-10-08T19:42:25.251382+0000","last_clean":"2021-10-08T19:42:25.251382+0000","last_became_active":"2021-10-08T19:31:51.673821+0000","last_became_peered":"2021-10-08T19:31:51.673821+0000","last_unstale":"2021-10-08T19:42:25.251382+0000","last_undegraded":"2021-10-08T19:42:25.251382+0000","last_fullsized":"2021-10-08T19:42:25.251382+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:42:14.715053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:21.644827+0000","last_clean_scrub_stamp":"2021-10-08T19:42:14.715053+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.007383779,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":476,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.257796+0000","last_change":"2021-10-08T19:39:59.811372+0000","last_active":"2021-10-08T19:42:25.257796+0000","last_peered":"2021-10-08T19:42:25.257796+0000","last_clean":"2021-10-08T19:42:25.257796+0000","last_became_active":"2021-10-08T19:21:27.636086+0000","last_became_peered":"2021-10-08T19:21:27.636086+0000","last_unstale":"2021-10-08T19:42:25.257796+0000","last_undegraded":"2021-10-08T19:42:25.257796+0000","last_fullsized":"2021-10-08T19:42:25.257796+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:59.811267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:39:59.811267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0070031299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"482'45","reported_seq":493,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.252787+0000","last_change":"2021-10-08T19:42:16.067468+0000","last_active":"2021-10-08T19:42:25.252787+0000","last_peered":"2021-10-08T19:42:25.252787+0000","last_clean":"2021-10-08T19:42:25.252787+0000","last_became_active":"2021-10-08T19:24:25.100384+0000","last_became_peered":"2021-10-08T19:24:25.100384+0000","last_unstale":"2021-10-08T19:42:25.252787+0000","last_undegraded":"2021-10-08T19:42:25.252787+0000","last_fullsized":"2021-10-08T19:42:25.252787+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'45","last_scrub_stamp":"2021-10-08T19:42:16.067358+0000","last_deep_scrub":"443'33","last_deep_scrub_stamp":"2021-10-08T19:39:26.350786+0000","last_clean_scrub_stamp":"2021-10-08T19:42:16.067358+0000","log_size":45,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0045516890000000003,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":60,"num_read_kb":50,"num_write":37,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"90'130","reported_seq":797,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.255403+0000","last_change":"2021-10-08T19:42:05.815835+0000","last_active":"2021-10-08T19:42:25.255403+0000","last_peered":"2021-10-08T19:42:25.255403+0000","last_clean":"2021-10-08T19:42:25.255403+0000","last_became_active":"2021-10-08T19:27:22.607289+0000","last_became_peered":"2021-10-08T19:27:22.607289+0000","last_unstale":"2021-10-08T19:42:25.255403+0000","last_undegraded":"2021-10-08T19:42:25.255403+0000","last_fullsized":"2021-10-08T19:42:25.255403+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:42:05.815760+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:42:05.815760+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0055778160000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":494,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.249299+0000","last_change":"2021-10-08T19:40:06.128693+0000","last_active":"2021-10-08T19:42:25.249299+0000","last_peered":"2021-10-08T19:42:25.249299+0000","last_clean":"2021-10-08T19:42:25.249299+0000","last_became_active":"2021-10-08T19:37:45.837378+0000","last_became_peered":"2021-10-08T19:37:45.837378+0000","last_unstale":"2021-10-08T19:42:25.249299+0000","last_undegraded":"2021-10-08T19:42:25.249299+0000","last_fullsized":"2021-10-08T19:42:25.249299+0000","mapping_epoch":407,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":408,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:06.128585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:06.128585+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011647138,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":286,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.255669+0000","last_change":"2021-10-08T19:39:19.171728+0000","last_active":"2021-10-08T19:42:25.255669+0000","last_peered":"2021-10-08T19:42:25.255669+0000","last_clean":"2021-10-08T19:42:25.255669+0000","last_became_active":"2021-10-08T19:29:40.638774+0000","last_became_peered":"2021-10-08T19:29:40.638774+0000","last_unstale":"2021-10-08T19:42:25.255669+0000","last_undegraded":"2021-10-08T19:42:25.255669+0000","last_fullsized":"2021-10-08T19:42:25.255669+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:19.171649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:19.171649+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.008189689,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":321,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.254971+0000","last_change":"2021-10-08T19:42:19.157914+0000","last_active":"2021-10-08T19:42:25.254971+0000","last_peered":"2021-10-08T19:42:25.254971+0000","last_clean":"2021-10-08T19:42:25.254971+0000","last_became_active":"2021-10-08T19:37:19.006459+0000","last_became_peered":"2021-10-08T19:37:19.006459+0000","last_unstale":"2021-10-08T19:42:25.254971+0000","last_undegraded":"2021-10-08T19:42:25.254971+0000","last_fullsized":"2021-10-08T19:42:25.254971+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:42:19.157813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:42:19.157813+0000","last_clean_scrub_stamp":"2021-10-08T19:42:19.157813+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.152151007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4],"acting":[3,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"90'130","reported_seq":797,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.255646+0000","last_change":"2021-10-08T19:39:25.754394+0000","last_active":"2021-10-08T19:42:25.255646+0000","last_peered":"2021-10-08T19:42:25.255646+0000","last_clean":"2021-10-08T19:42:25.255646+0000","last_became_active":"2021-10-08T19:27:26.591250+0000","last_became_peered":"2021-10-08T19:27:26.591250+0000","last_unstale":"2021-10-08T19:42:25.255646+0000","last_undegraded":"2021-10-08T19:42:25.255646+0000","last_fullsized":"2021-10-08T19:42:25.255646+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:39:25.754295+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:39:25.754295+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0065366060000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":492,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.250627+0000","last_change":"2021-10-08T19:40:39.008261+0000","last_active":"2021-10-08T19:42:25.250627+0000","last_peered":"2021-10-08T19:42:25.250627+0000","last_clean":"2021-10-08T19:42:25.250627+0000","last_became_active":"2021-10-08T19:21:27.637875+0000","last_became_peered":"2021-10-08T19:21:27.637875+0000","last_unstale":"2021-10-08T19:42:25.250627+0000","last_undegraded":"2021-10-08T19:42:25.250627+0000","last_fullsized":"2021-10-08T19:42:25.250627+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:39.008146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:20.092069+0000","last_clean_scrub_stamp":"2021-10-08T19:40:39.008146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0068776480000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"482'21","reported_seq":246,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.247876+0000","last_change":"2021-10-08T19:40:43.162940+0000","last_active":"2021-10-08T19:42:25.247876+0000","last_peered":"2021-10-08T19:42:25.247876+0000","last_clean":"2021-10-08T19:42:25.247876+0000","last_became_active":"2021-10-08T19:31:51.674965+0000","last_became_peered":"2021-10-08T19:31:51.674965+0000","last_unstale":"2021-10-08T19:42:25.247876+0000","last_undegraded":"2021-10-08T19:42:25.247876+0000","last_fullsized":"2021-10-08T19:42:25.247876+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'17","last_scrub_stamp":"2021-10-08T19:40:43.162834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:40:43.162834+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0077953040000000003,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":29,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":990,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":525,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.247416+0000","last_change":"2021-10-08T19:41:17.997697+0000","last_active":"2021-10-08T19:42:25.247416+0000","last_peered":"2021-10-08T19:42:25.247416+0000","last_clean":"2021-10-08T19:42:25.247416+0000","last_became_active":"2021-10-08T19:36:58.015216+0000","last_became_peered":"2021-10-08T19:36:58.015216+0000","last_unstale":"2021-10-08T19:42:25.247416+0000","last_undegraded":"2021-10-08T19:42:25.247416+0000","last_fullsized":"2021-10-08T19:42:25.247416+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:41:17.997605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:41:17.997605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013133647,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"70'5","reported_seq":338,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.246137+0000","last_change":"2021-10-08T19:42:13.603386+0000","last_active":"2021-10-08T19:42:25.246137+0000","last_peered":"2021-10-08T19:42:25.246137+0000","last_clean":"2021-10-08T19:42:25.246137+0000","last_became_active":"2021-10-08T19:28:40.148054+0000","last_became_peered":"2021-10-08T19:28:40.148054+0000","last_unstale":"2021-10-08T19:42:25.246137+0000","last_undegraded":"2021-10-08T19:42:25.246137+0000","last_fullsized":"2021-10-08T19:42:25.246137+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:42:13.603281+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2021-10-08T19:34:18.630378+0000","last_clean_scrub_stamp":"2021-10-08T19:42:13.603281+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001966668,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":510,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.258813+0000","last_change":"2021-10-08T19:40:54.980585+0000","last_active":"2021-10-08T19:42:25.258813+0000","last_peered":"2021-10-08T19:42:25.258813+0000","last_clean":"2021-10-08T19:42:25.258813+0000","last_became_active":"2021-10-08T19:29:40.652528+0000","last_became_peered":"2021-10-08T19:29:40.652528+0000","last_unstale":"2021-10-08T19:42:25.258813+0000","last_undegraded":"2021-10-08T19:42:25.258813+0000","last_fullsized":"2021-10-08T19:42:25.258813+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:54.980484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:40:54.980484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.052397393,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"90'130","reported_seq":431,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.243345+0000","last_change":"2021-10-08T19:42:23.317397+0000","last_active":"2021-10-08T19:42:25.243345+0000","last_peered":"2021-10-08T19:42:25.243345+0000","last_clean":"2021-10-08T19:42:25.243345+0000","last_became_active":"2021-10-08T19:37:19.032630+0000","last_became_peered":"2021-10-08T19:37:19.032630+0000","last_unstale":"2021-10-08T19:42:25.243345+0000","last_undegraded":"2021-10-08T19:42:25.243345+0000","last_fullsized":"2021-10-08T19:42:25.243345+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:42:23.317260+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:42:23.317260+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.022860803999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":498,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.245013+0000","last_change":"2021-10-08T19:39:55.826848+0000","last_active":"2021-10-08T19:42:25.245013+0000","last_peered":"2021-10-08T19:42:25.245013+0000","last_clean":"2021-10-08T19:42:25.245013+0000","last_became_active":"2021-10-08T19:28:40.133414+0000","last_became_peered":"2021-10-08T19:28:40.133414+0000","last_unstale":"2021-10-08T19:42:25.245013+0000","last_undegraded":"2021-10-08T19:42:25.245013+0000","last_fullsized":"2021-10-08T19:42:25.245013+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:55.826735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:39:55.826735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0091553829999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"482'56","reported_seq":620,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:31.994808+0000","last_change":"2021-10-08T19:41:21.509547+0000","last_active":"2021-10-08T19:42:31.994808+0000","last_peered":"2021-10-08T19:42:31.994808+0000","last_clean":"2021-10-08T19:42:31.994808+0000","last_became_active":"2021-10-08T19:29:40.626138+0000","last_became_peered":"2021-10-08T19:29:40.626138+0000","last_unstale":"2021-10-08T19:42:31.994808+0000","last_undegraded":"2021-10-08T19:42:31.994808+0000","last_fullsized":"2021-10-08T19:42:31.994808+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'44","last_scrub_stamp":"2021-10-08T19:41:21.509439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:41:21.509439+0000","log_size":56,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0073374210000000002,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":83,"num_read_kb":68,"num_write":50,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":1432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":521,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.246339+0000","last_change":"2021-10-08T19:41:22.536639+0000","last_active":"2021-10-08T19:42:25.246339+0000","last_peered":"2021-10-08T19:42:25.246339+0000","last_clean":"2021-10-08T19:42:25.246339+0000","last_became_active":"2021-10-08T19:37:19.004386+0000","last_became_peered":"2021-10-08T19:37:19.004386+0000","last_unstale":"2021-10-08T19:42:25.246339+0000","last_undegraded":"2021-10-08T19:42:25.246339+0000","last_fullsized":"2021-10-08T19:42:25.246339+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:41:22.536531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:49.623545+0000","last_clean_scrub_stamp":"2021-10-08T19:41:22.536531+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0086989179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":294,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.254549+0000","last_change":"2021-10-08T19:41:28.269109+0000","last_active":"2021-10-08T19:42:25.254549+0000","last_peered":"2021-10-08T19:42:25.254549+0000","last_clean":"2021-10-08T19:42:25.254549+0000","last_became_active":"2021-10-08T19:29:40.637371+0000","last_became_peered":"2021-10-08T19:29:40.637371+0000","last_unstale":"2021-10-08T19:42:25.254549+0000","last_undegraded":"2021-10-08T19:42:25.254549+0000","last_fullsized":"2021-10-08T19:42:25.254549+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:41:28.269002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:41:28.269002+0000","last_clean_scrub_stamp":"2021-10-08T19:41:28.269002+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0092215460000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":441,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.242420+0000","last_change":"2021-10-08T19:41:30.044938+0000","last_active":"2021-10-08T19:42:25.242420+0000","last_peered":"2021-10-08T19:42:25.242420+0000","last_clean":"2021-10-08T19:42:25.242420+0000","last_became_active":"2021-10-08T19:25:14.550690+0000","last_became_peered":"2021-10-08T19:25:14.550690+0000","last_unstale":"2021-10-08T19:42:25.242420+0000","last_undegraded":"2021-10-08T19:42:25.242420+0000","last_fullsized":"2021-10-08T19:42:25.242420+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:41:30.044821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:36:09.181866+0000","last_clean_scrub_stamp":"2021-10-08T19:41:30.044821+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0078369709999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.7","version":"90'130","reported_seq":757,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.251583+0000","last_change":"2021-10-08T19:40:01.944949+0000","last_active":"2021-10-08T19:42:25.251583+0000","last_peered":"2021-10-08T19:42:25.251583+0000","last_clean":"2021-10-08T19:42:25.251583+0000","last_became_active":"2021-10-08T19:29:43.636820+0000","last_became_peered":"2021-10-08T19:29:43.636820+0000","last_unstale":"2021-10-08T19:42:25.251583+0000","last_undegraded":"2021-10-08T19:42:25.251583+0000","last_fullsized":"2021-10-08T19:42:25.251583+0000","mapping_epoch":239,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:40:01.944834+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:40:01.944834+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0061141190000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"114'10","reported_seq":773,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:31.994786+0000","last_change":"2021-10-08T19:40:54.913771+0000","last_active":"2021-10-08T19:42:31.994786+0000","last_peered":"2021-10-08T19:42:31.994786+0000","last_clean":"2021-10-08T19:42:31.994786+0000","last_became_active":"2021-10-08T19:24:25.106695+0000","last_became_peered":"2021-10-08T19:24:25.106695+0000","last_unstale":"2021-10-08T19:42:31.994786+0000","last_undegraded":"2021-10-08T19:42:31.994786+0000","last_fullsized":"2021-10-08T19:42:31.994786+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'10","last_scrub_stamp":"2021-10-08T19:40:54.913650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:40:54.913650+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.006310749,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"482'30","reported_seq":255,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.246543+0000","last_change":"2021-10-08T19:40:48.298186+0000","last_active":"2021-10-08T19:42:25.246543+0000","last_peered":"2021-10-08T19:42:25.246543+0000","last_clean":"2021-10-08T19:42:25.246543+0000","last_became_active":"2021-10-08T19:31:51.675569+0000","last_became_peered":"2021-10-08T19:31:51.675569+0000","last_unstale":"2021-10-08T19:42:25.246543+0000","last_undegraded":"2021-10-08T19:42:25.246543+0000","last_fullsized":"2021-10-08T19:42:25.246543+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'20","last_scrub_stamp":"2021-10-08T19:40:48.298070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:40:48.298070+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0094577930000000008,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":38,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":341,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.251485+0000","last_change":"2021-10-08T19:41:17.462310+0000","last_active":"2021-10-08T19:42:25.251485+0000","last_peered":"2021-10-08T19:42:25.251485+0000","last_clean":"2021-10-08T19:42:25.251485+0000","last_became_active":"2021-10-08T19:36:58.013921+0000","last_became_peered":"2021-10-08T19:36:58.013921+0000","last_unstale":"2021-10-08T19:42:25.251485+0000","last_undegraded":"2021-10-08T19:42:25.251485+0000","last_fullsized":"2021-10-08T19:42:25.251485+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:41:17.462204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:45.612819+0000","last_clean_scrub_stamp":"2021-10-08T19:41:17.462204+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0063392600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":500,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.242831+0000","last_change":"2021-10-08T19:40:49.951176+0000","last_active":"2021-10-08T19:42:25.242831+0000","last_peered":"2021-10-08T19:42:25.242831+0000","last_clean":"2021-10-08T19:42:25.242831+0000","last_became_active":"2021-10-08T19:29:40.643614+0000","last_became_peered":"2021-10-08T19:29:40.643614+0000","last_unstale":"2021-10-08T19:42:25.242831+0000","last_undegraded":"2021-10-08T19:42:25.242831+0000","last_fullsized":"2021-10-08T19:42:25.242831+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:49.951046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:40:49.951046+0000","last_clean_scrub_stamp":"2021-10-08T19:40:49.951046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.073125817999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":279,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.253881+0000","last_change":"2021-10-08T19:39:54.093007+0000","last_active":"2021-10-08T19:42:25.253881+0000","last_peered":"2021-10-08T19:42:25.253881+0000","last_clean":"2021-10-08T19:42:25.253881+0000","last_became_active":"2021-10-08T19:37:19.012488+0000","last_became_peered":"2021-10-08T19:37:19.012488+0000","last_unstale":"2021-10-08T19:42:25.253881+0000","last_undegraded":"2021-10-08T19:42:25.253881+0000","last_fullsized":"2021-10-08T19:42:25.253881+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:54.092909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:39:54.092909+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0066472559999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,2],"acting":[3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":508,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.247377+0000","last_change":"2021-10-08T19:40:08.190048+0000","last_active":"2021-10-08T19:42:25.247377+0000","last_peered":"2021-10-08T19:42:25.247377+0000","last_clean":"2021-10-08T19:42:25.247377+0000","last_became_active":"2021-10-08T19:28:40.138726+0000","last_became_peered":"2021-10-08T19:28:40.138726+0000","last_unstale":"2021-10-08T19:42:25.247377+0000","last_undegraded":"2021-10-08T19:42:25.247377+0000","last_fullsized":"2021-10-08T19:42:25.247377+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:08.189929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:50.435552+0000","last_clean_scrub_stamp":"2021-10-08T19:40:08.189929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0083115949999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"482'24","reported_seq":604,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.241965+0000","last_change":"2021-10-08T19:42:07.064660+0000","last_active":"2021-10-08T19:42:25.241965+0000","last_peered":"2021-10-08T19:42:25.241965+0000","last_clean":"2021-10-08T19:42:25.241965+0000","last_became_active":"2021-10-08T19:29:40.638957+0000","last_became_peered":"2021-10-08T19:29:40.638957+0000","last_unstale":"2021-10-08T19:42:25.241965+0000","last_undegraded":"2021-10-08T19:42:25.241965+0000","last_fullsized":"2021-10-08T19:42:25.241965+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'24","last_scrub_stamp":"2021-10-08T19:42:07.064545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:42:07.064545+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010238858,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"61'2","reported_seq":495,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.242772+0000","last_change":"2021-10-08T19:40:02.407598+0000","last_active":"2021-10-08T19:42:25.242772+0000","last_peered":"2021-10-08T19:42:25.242772+0000","last_clean":"2021-10-08T19:42:25.242772+0000","last_became_active":"2021-10-08T19:21:23.603614+0000","last_became_peered":"2021-10-08T19:21:23.603614+0000","last_unstale":"2021-10-08T19:42:25.242772+0000","last_undegraded":"2021-10-08T19:42:25.242772+0000","last_fullsized":"2021-10-08T19:42:25.242772+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'2","last_scrub_stamp":"2021-10-08T19:40:02.407482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:02.407482+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0060178940000000002,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":288,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.254697+0000","last_change":"2021-10-08T19:39:11.360634+0000","last_active":"2021-10-08T19:42:25.254697+0000","last_peered":"2021-10-08T19:42:25.254697+0000","last_clean":"2021-10-08T19:42:25.254697+0000","last_became_active":"2021-10-08T19:29:40.645211+0000","last_became_peered":"2021-10-08T19:29:40.645211+0000","last_unstale":"2021-10-08T19:42:25.254697+0000","last_undegraded":"2021-10-08T19:42:25.254697+0000","last_fullsized":"2021-10-08T19:42:25.254697+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:11.360528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:11.360528+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.12852046,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":415,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.257850+0000","last_change":"2021-10-08T19:40:03.902724+0000","last_active":"2021-10-08T19:42:25.257850+0000","last_peered":"2021-10-08T19:42:25.257850+0000","last_clean":"2021-10-08T19:42:25.257850+0000","last_became_active":"2021-10-08T19:28:40.100770+0000","last_became_peered":"2021-10-08T19:28:40.100770+0000","last_unstale":"2021-10-08T19:42:25.257850+0000","last_undegraded":"2021-10-08T19:42:25.257850+0000","last_fullsized":"2021-10-08T19:42:25.257850+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:03.902636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:03.902636+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011310317,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"482'21","reported_seq":556,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.243568+0000","last_change":"2021-10-08T19:39:54.875637+0000","last_active":"2021-10-08T19:42:25.243568+0000","last_peered":"2021-10-08T19:42:25.243568+0000","last_clean":"2021-10-08T19:42:25.243568+0000","last_became_active":"2021-10-08T19:29:40.644354+0000","last_became_peered":"2021-10-08T19:29:40.644354+0000","last_unstale":"2021-10-08T19:42:25.243568+0000","last_undegraded":"2021-10-08T19:42:25.243568+0000","last_fullsized":"2021-10-08T19:42:25.243568+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'15","last_scrub_stamp":"2021-10-08T19:39:54.875517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:39:54.875517+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010969082,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":520,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.247301+0000","last_change":"2021-10-08T19:40:32.125560+0000","last_active":"2021-10-08T19:42:25.247301+0000","last_peered":"2021-10-08T19:42:25.247301+0000","last_clean":"2021-10-08T19:42:25.247301+0000","last_became_active":"2021-10-08T19:28:40.139234+0000","last_became_peered":"2021-10-08T19:28:40.139234+0000","last_unstale":"2021-10-08T19:42:25.247301+0000","last_undegraded":"2021-10-08T19:42:25.247301+0000","last_fullsized":"2021-10-08T19:42:25.247301+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:32.125490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:32.125490+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010928068000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":292,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.255047+0000","last_change":"2021-10-08T19:42:21.056709+0000","last_active":"2021-10-08T19:42:25.255047+0000","last_peered":"2021-10-08T19:42:25.255047+0000","last_clean":"2021-10-08T19:42:25.255047+0000","last_became_active":"2021-10-08T19:29:40.645111+0000","last_became_peered":"2021-10-08T19:29:40.645111+0000","last_unstale":"2021-10-08T19:42:25.255047+0000","last_undegraded":"2021-10-08T19:42:25.255047+0000","last_fullsized":"2021-10-08T19:42:25.255047+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:42:21.056613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:42:21.056613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0070312079999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":486,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.249731+0000","last_change":"2021-10-08T19:40:02.108048+0000","last_active":"2021-10-08T19:42:25.249731+0000","last_peered":"2021-10-08T19:42:25.249731+0000","last_clean":"2021-10-08T19:42:25.249731+0000","last_became_active":"2021-10-08T19:21:29.640674+0000","last_became_peered":"2021-10-08T19:21:29.640674+0000","last_unstale":"2021-10-08T19:42:25.249731+0000","last_undegraded":"2021-10-08T19:42:25.249731+0000","last_fullsized":"2021-10-08T19:42:25.249731+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:02.107943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:40:02.107943+0000","last_clean_scrub_stamp":"2021-10-08T19:40:02.107943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0082285750000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":407,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.255325+0000","last_change":"2021-10-08T19:40:47.809293+0000","last_active":"2021-10-08T19:42:25.255325+0000","last_peered":"2021-10-08T19:42:25.255325+0000","last_clean":"2021-10-08T19:42:25.255325+0000","last_became_active":"2021-10-08T19:25:15.501118+0000","last_became_peered":"2021-10-08T19:25:15.501118+0000","last_unstale":"2021-10-08T19:42:25.255325+0000","last_undegraded":"2021-10-08T19:42:25.255325+0000","last_fullsized":"2021-10-08T19:42:25.255325+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:47.809188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:47.809188+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0032071320000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"482'18","reported_seq":318,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.254888+0000","last_change":"2021-10-08T19:39:58.261469+0000","last_active":"2021-10-08T19:42:25.254888+0000","last_peered":"2021-10-08T19:42:25.254888+0000","last_clean":"2021-10-08T19:42:25.254888+0000","last_became_active":"2021-10-08T19:29:40.644657+0000","last_became_peered":"2021-10-08T19:29:40.644657+0000","last_unstale":"2021-10-08T19:42:25.254888+0000","last_undegraded":"2021-10-08T19:42:25.254888+0000","last_fullsized":"2021-10-08T19:42:25.254888+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'12","last_scrub_stamp":"2021-10-08T19:39:58.261366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:39:58.261366+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0074846620000000004,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":27,"num_read_kb":24,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":448,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.252571+0000","last_change":"2021-10-08T19:39:28.422329+0000","last_active":"2021-10-08T19:42:25.252571+0000","last_peered":"2021-10-08T19:42:25.252571+0000","last_clean":"2021-10-08T19:42:25.252571+0000","last_became_active":"2021-10-08T19:28:40.101898+0000","last_became_peered":"2021-10-08T19:28:40.101898+0000","last_unstale":"2021-10-08T19:42:25.252571+0000","last_undegraded":"2021-10-08T19:42:25.252571+0000","last_fullsized":"2021-10-08T19:42:25.252571+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:28.422254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:16.444582+0000","last_clean_scrub_stamp":"2021-10-08T19:39:28.422254+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0087056440000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":343,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.254409+0000","last_change":"2021-10-08T19:41:31.321283+0000","last_active":"2021-10-08T19:42:25.254409+0000","last_peered":"2021-10-08T19:42:25.254409+0000","last_clean":"2021-10-08T19:42:25.254409+0000","last_became_active":"2021-10-08T19:37:19.011117+0000","last_became_peered":"2021-10-08T19:37:19.011117+0000","last_unstale":"2021-10-08T19:42:25.254409+0000","last_undegraded":"2021-10-08T19:42:25.254409+0000","last_fullsized":"2021-10-08T19:42:25.254409+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:41:31.321173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:41:31.321173+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013768213,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":498,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.258592+0000","last_change":"2021-10-08T19:40:51.961161+0000","last_active":"2021-10-08T19:42:25.258592+0000","last_peered":"2021-10-08T19:42:25.258592+0000","last_clean":"2021-10-08T19:42:25.258592+0000","last_became_active":"2021-10-08T19:24:25.099371+0000","last_became_peered":"2021-10-08T19:24:25.099371+0000","last_unstale":"2021-10-08T19:42:25.258592+0000","last_undegraded":"2021-10-08T19:42:25.258592+0000","last_fullsized":"2021-10-08T19:42:25.258592+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:51.961084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:40:51.961084+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.038885474000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"70'5","reported_seq":685,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.250548+0000","last_change":"2021-10-08T19:41:21.872950+0000","last_active":"2021-10-08T19:42:25.250548+0000","last_peered":"2021-10-08T19:42:25.250548+0000","last_clean":"2021-10-08T19:42:25.250548+0000","last_became_active":"2021-10-08T19:31:22.785193+0000","last_became_peered":"2021-10-08T19:31:22.785193+0000","last_unstale":"2021-10-08T19:42:25.250548+0000","last_undegraded":"2021-10-08T19:42:25.250548+0000","last_fullsized":"2021-10-08T19:42:25.250548+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":5,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:41:21.872876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:41:21.872876+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001349397,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"482'30","reported_seq":372,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.255482+0000","last_change":"2021-10-08T19:39:28.248294+0000","last_active":"2021-10-08T19:42:25.255482+0000","last_peered":"2021-10-08T19:42:25.255482+0000","last_clean":"2021-10-08T19:42:25.255482+0000","last_became_active":"2021-10-08T19:31:51.677055+0000","last_became_peered":"2021-10-08T19:31:51.677055+0000","last_unstale":"2021-10-08T19:42:25.255482+0000","last_undegraded":"2021-10-08T19:42:25.255482+0000","last_fullsized":"2021-10-08T19:42:25.255482+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'20","last_scrub_stamp":"2021-10-08T19:39:28.248174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:39:28.248174+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012648767999999999,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":39,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":63,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.241820+0000","last_change":"2021-10-08T19:40:39.787067+0000","last_active":"2021-10-08T19:42:25.241820+0000","last_peered":"2021-10-08T19:42:25.241820+0000","last_clean":"2021-10-08T19:42:25.241820+0000","last_became_active":"2021-10-08T19:39:39.136801+0000","last_became_peered":"2021-10-08T19:39:39.136801+0000","last_unstale":"2021-10-08T19:42:25.241820+0000","last_undegraded":"2021-10-08T19:42:25.241820+0000","last_fullsized":"2021-10-08T19:42:25.241820+0000","mapping_epoch":448,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":449,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:39.786960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:39.786960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011731676999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,2],"acting":[4,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"398'12","reported_seq":651,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:31.994826+0000","last_change":"2021-10-08T19:39:58.937602+0000","last_active":"2021-10-08T19:42:31.994826+0000","last_peered":"2021-10-08T19:42:31.994826+0000","last_clean":"2021-10-08T19:42:31.994826+0000","last_became_active":"2021-10-08T19:37:19.015189+0000","last_became_peered":"2021-10-08T19:37:19.015189+0000","last_unstale":"2021-10-08T19:42:31.994826+0000","last_undegraded":"2021-10-08T19:42:31.994826+0000","last_fullsized":"2021-10-08T19:42:31.994826+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"398'12","last_scrub_stamp":"2021-10-08T19:39:58.937499+0000","last_deep_scrub":"328'11","last_deep_scrub_stamp":"2021-10-08T19:33:32.545870+0000","last_clean_scrub_stamp":"2021-10-08T19:39:58.937499+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012203161000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":494,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.243402+0000","last_change":"2021-10-08T19:40:11.028411+0000","last_active":"2021-10-08T19:42:25.243402+0000","last_peered":"2021-10-08T19:42:25.243402+0000","last_clean":"2021-10-08T19:42:25.243402+0000","last_became_active":"2021-10-08T19:29:40.644819+0000","last_became_peered":"2021-10-08T19:29:40.644819+0000","last_unstale":"2021-10-08T19:42:25.243402+0000","last_undegraded":"2021-10-08T19:42:25.243402+0000","last_fullsized":"2021-10-08T19:42:25.243402+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:11.028298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:40:11.028298+0000","last_clean_scrub_stamp":"2021-10-08T19:40:11.028298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.053608935000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":403,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.256322+0000","last_change":"2021-10-08T19:40:04.898401+0000","last_active":"2021-10-08T19:42:25.256322+0000","last_peered":"2021-10-08T19:42:25.256322+0000","last_clean":"2021-10-08T19:42:25.256322+0000","last_became_active":"2021-10-08T19:25:15.498770+0000","last_became_peered":"2021-10-08T19:25:15.498770+0000","last_unstale":"2021-10-08T19:42:25.256322+0000","last_undegraded":"2021-10-08T19:42:25.256322+0000","last_fullsized":"2021-10-08T19:42:25.256322+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:04.898293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:04.898293+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.010628007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"482'21","reported_seq":157,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.258769+0000","last_change":"2021-10-08T19:39:32.769018+0000","last_active":"2021-10-08T19:42:25.258769+0000","last_peered":"2021-10-08T19:42:25.258769+0000","last_clean":"2021-10-08T19:42:25.258769+0000","last_became_active":"2021-10-08T19:37:19.007551+0000","last_became_peered":"2021-10-08T19:37:19.007551+0000","last_unstale":"2021-10-08T19:42:25.258769+0000","last_undegraded":"2021-10-08T19:42:25.258769+0000","last_fullsized":"2021-10-08T19:42:25.258769+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'15","last_scrub_stamp":"2021-10-08T19:39:32.768897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:39:32.768897+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0067183929999999996,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":28,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":512,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.244099+0000","last_change":"2021-10-08T19:42:03.275207+0000","last_active":"2021-10-08T19:42:25.244099+0000","last_peered":"2021-10-08T19:42:25.244099+0000","last_clean":"2021-10-08T19:42:25.244099+0000","last_became_active":"2021-10-08T19:29:44.439397+0000","last_became_peered":"2021-10-08T19:29:44.439397+0000","last_unstale":"2021-10-08T19:42:25.244099+0000","last_undegraded":"2021-10-08T19:42:25.244099+0000","last_fullsized":"2021-10-08T19:42:25.244099+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:42:03.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:42:03.275108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.005851607,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"413'11","reported_seq":454,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:31.994810+0000","last_change":"2021-10-08T19:42:07.012171+0000","last_active":"2021-10-08T19:42:31.994810+0000","last_peered":"2021-10-08T19:42:31.994810+0000","last_clean":"2021-10-08T19:42:31.994810+0000","last_became_active":"2021-10-08T19:29:40.637650+0000","last_became_peered":"2021-10-08T19:29:40.637650+0000","last_unstale":"2021-10-08T19:42:31.994810+0000","last_undegraded":"2021-10-08T19:42:31.994810+0000","last_fullsized":"2021-10-08T19:42:31.994810+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"413'11","last_scrub_stamp":"2021-10-08T19:42:07.012038+0000","last_deep_scrub":"413'11","last_deep_scrub_stamp":"2021-10-08T19:37:59.373882+0000","last_clean_scrub_stamp":"2021-10-08T19:42:07.012038+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.028997823999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":473,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.242966+0000","last_change":"2021-10-08T19:40:09.484050+0000","last_active":"2021-10-08T19:42:25.242966+0000","last_peered":"2021-10-08T19:42:25.242966+0000","last_clean":"2021-10-08T19:42:25.242966+0000","last_became_active":"2021-10-08T19:21:29.640302+0000","last_became_peered":"2021-10-08T19:21:29.640302+0000","last_unstale":"2021-10-08T19:42:25.242966+0000","last_undegraded":"2021-10-08T19:42:25.242966+0000","last_fullsized":"2021-10-08T19:42:25.242966+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:09.483932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:40:09.483932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.14512376099999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":421,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.245488+0000","last_change":"2021-10-08T19:42:12.220400+0000","last_active":"2021-10-08T19:42:25.245488+0000","last_peered":"2021-10-08T19:42:25.245488+0000","last_clean":"2021-10-08T19:42:25.245488+0000","last_became_active":"2021-10-08T19:29:40.631374+0000","last_became_peered":"2021-10-08T19:29:40.631374+0000","last_unstale":"2021-10-08T19:42:25.245488+0000","last_undegraded":"2021-10-08T19:42:25.245488+0000","last_fullsized":"2021-10-08T19:42:25.245488+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:42:12.220290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:42:12.220290+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014669556,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":423,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.258542+0000","last_change":"2021-10-08T19:42:03.909963+0000","last_active":"2021-10-08T19:42:25.258542+0000","last_peered":"2021-10-08T19:42:25.258542+0000","last_clean":"2021-10-08T19:42:25.258542+0000","last_became_active":"2021-10-08T19:29:40.652966+0000","last_became_peered":"2021-10-08T19:29:40.652966+0000","last_unstale":"2021-10-08T19:42:25.258542+0000","last_undegraded":"2021-10-08T19:42:25.258542+0000","last_fullsized":"2021-10-08T19:42:25.258542+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:42:03.909859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:08.748947+0000","last_clean_scrub_stamp":"2021-10-08T19:42:03.909859+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040728739999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"482'25","reported_seq":249,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.246255+0000","last_change":"2021-10-08T19:39:59.953175+0000","last_active":"2021-10-08T19:42:25.246255+0000","last_peered":"2021-10-08T19:42:25.246255+0000","last_clean":"2021-10-08T19:42:25.246255+0000","last_became_active":"2021-10-08T19:31:51.676961+0000","last_became_peered":"2021-10-08T19:31:51.676961+0000","last_unstale":"2021-10-08T19:42:25.246255+0000","last_undegraded":"2021-10-08T19:42:25.246255+0000","last_fullsized":"2021-10-08T19:42:25.246255+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:39:59.953049+0000","last_deep_scrub":"289'19","last_deep_scrub_stamp":"2021-10-08T19:32:46.539792+0000","last_clean_scrub_stamp":"2021-10-08T19:39:59.953049+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0047403150000000002,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":28,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":470,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.251623+0000","last_change":"2021-10-08T19:42:15.100529+0000","last_active":"2021-10-08T19:42:25.251623+0000","last_peered":"2021-10-08T19:42:25.251623+0000","last_clean":"2021-10-08T19:42:25.251623+0000","last_became_active":"2021-10-08T19:31:22.786651+0000","last_became_peered":"2021-10-08T19:31:22.786651+0000","last_unstale":"2021-10-08T19:42:25.251623+0000","last_undegraded":"2021-10-08T19:42:25.251623+0000","last_fullsized":"2021-10-08T19:42:25.251623+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:42:15.099225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:42:15.099225+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.007474578,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":296,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.254614+0000","last_change":"2021-10-08T19:42:09.029512+0000","last_active":"2021-10-08T19:42:25.254614+0000","last_peered":"2021-10-08T19:42:25.254614+0000","last_clean":"2021-10-08T19:42:25.254614+0000","last_became_active":"2021-10-08T19:29:40.644770+0000","last_became_peered":"2021-10-08T19:29:40.644770+0000","last_unstale":"2021-10-08T19:42:25.254614+0000","last_undegraded":"2021-10-08T19:42:25.254614+0000","last_fullsized":"2021-10-08T19:42:25.254614+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:42:09.029411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:06.367259+0000","last_clean_scrub_stamp":"2021-10-08T19:42:09.029411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.021944285000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":496,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.242817+0000","last_change":"2021-10-08T19:39:56.867112+0000","last_active":"2021-10-08T19:42:25.242817+0000","last_peered":"2021-10-08T19:42:25.242817+0000","last_clean":"2021-10-08T19:42:25.242817+0000","last_became_active":"2021-10-08T19:28:40.133744+0000","last_became_peered":"2021-10-08T19:28:40.133744+0000","last_unstale":"2021-10-08T19:42:25.242817+0000","last_undegraded":"2021-10-08T19:42:25.242817+0000","last_fullsized":"2021-10-08T19:42:25.242817+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:56.866997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:56.866997+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.058090835,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"482'27","reported_seq":645,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.242339+0000","last_change":"2021-10-08T19:42:15.992609+0000","last_active":"2021-10-08T19:42:25.242339+0000","last_peered":"2021-10-08T19:42:25.242339+0000","last_clean":"2021-10-08T19:42:25.242339+0000","last_became_active":"2021-10-08T19:28:40.100196+0000","last_became_peered":"2021-10-08T19:28:40.100196+0000","last_unstale":"2021-10-08T19:42:25.242339+0000","last_undegraded":"2021-10-08T19:42:25.242339+0000","last_fullsized":"2021-10-08T19:42:25.242339+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'27","last_scrub_stamp":"2021-10-08T19:42:15.992528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:42:15.992528+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.023590362,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":334,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.247465+0000","last_change":"2021-10-08T19:40:03.951140+0000","last_active":"2021-10-08T19:42:25.247465+0000","last_peered":"2021-10-08T19:42:25.247465+0000","last_clean":"2021-10-08T19:42:25.247465+0000","last_became_active":"2021-10-08T19:28:40.146673+0000","last_became_peered":"2021-10-08T19:28:40.146673+0000","last_unstale":"2021-10-08T19:42:25.247465+0000","last_undegraded":"2021-10-08T19:42:25.247465+0000","last_fullsized":"2021-10-08T19:42:25.247465+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:03.950996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:09.610637+0000","last_clean_scrub_stamp":"2021-10-08T19:40:03.950996+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.021277893999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":350,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.246622+0000","last_change":"2021-10-08T19:42:23.822615+0000","last_active":"2021-10-08T19:42:25.246622+0000","last_peered":"2021-10-08T19:42:25.246622+0000","last_clean":"2021-10-08T19:42:25.246622+0000","last_became_active":"2021-10-08T19:29:40.638536+0000","last_became_peered":"2021-10-08T19:29:40.638536+0000","last_unstale":"2021-10-08T19:42:25.246622+0000","last_undegraded":"2021-10-08T19:42:25.246622+0000","last_fullsized":"2021-10-08T19:42:25.246622+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:42:23.822512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:43.186684+0000","last_clean_scrub_stamp":"2021-10-08T19:42:23.822512+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.018222445,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":286,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.257301+0000","last_change":"2021-10-08T19:38:47.187888+0000","last_active":"2021-10-08T19:42:25.257301+0000","last_peered":"2021-10-08T19:42:25.257301+0000","last_clean":"2021-10-08T19:42:25.257301+0000","last_became_active":"2021-10-08T19:29:40.634300+0000","last_became_peered":"2021-10-08T19:29:40.634300+0000","last_unstale":"2021-10-08T19:42:25.257301+0000","last_undegraded":"2021-10-08T19:42:25.257301+0000","last_fullsized":"2021-10-08T19:42:25.257301+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:38:47.187765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:47.187765+0000","last_clean_scrub_stamp":"2021-10-08T19:38:47.187765+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013817288,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"70'5","reported_seq":403,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.242450+0000","last_change":"2021-10-08T19:40:47.760720+0000","last_active":"2021-10-08T19:42:25.242450+0000","last_peered":"2021-10-08T19:42:25.242450+0000","last_clean":"2021-10-08T19:42:25.242450+0000","last_became_active":"2021-10-08T19:25:15.496309+0000","last_became_peered":"2021-10-08T19:25:15.496309+0000","last_unstale":"2021-10-08T19:42:25.242450+0000","last_undegraded":"2021-10-08T19:42:25.242450+0000","last_fullsized":"2021-10-08T19:42:25.242450+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:40:47.760595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:40:47.760595+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0059370550000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.10","version":"482'12","reported_seq":321,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.248248+0000","last_change":"2021-10-08T19:39:59.311631+0000","last_active":"2021-10-08T19:42:25.248248+0000","last_peered":"2021-10-08T19:42:25.248248+0000","last_clean":"2021-10-08T19:42:25.248248+0000","last_became_active":"2021-10-08T19:32:45.165103+0000","last_became_peered":"2021-10-08T19:32:45.165103+0000","last_unstale":"2021-10-08T19:42:25.248248+0000","last_undegraded":"2021-10-08T19:42:25.248248+0000","last_fullsized":"2021-10-08T19:42:25.248248+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'8","last_scrub_stamp":"2021-10-08T19:39:59.311531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:39:59.311531+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.013231531,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":16,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":203,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.251189+0000","last_change":"2021-10-08T19:39:53.941356+0000","last_active":"2021-10-08T19:42:25.251189+0000","last_peered":"2021-10-08T19:42:25.251189+0000","last_clean":"2021-10-08T19:42:25.251189+0000","last_became_active":"2021-10-08T19:37:19.009349+0000","last_became_peered":"2021-10-08T19:37:19.009349+0000","last_unstale":"2021-10-08T19:42:25.251189+0000","last_undegraded":"2021-10-08T19:42:25.251189+0000","last_fullsized":"2021-10-08T19:42:25.251189+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:53.941264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:13.716331+0000","last_clean_scrub_stamp":"2021-10-08T19:39:53.941264+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0037200029999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":439,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.252713+0000","last_change":"2021-10-08T19:40:08.939758+0000","last_active":"2021-10-08T19:42:25.252713+0000","last_peered":"2021-10-08T19:42:25.252713+0000","last_clean":"2021-10-08T19:42:25.252713+0000","last_became_active":"2021-10-08T19:24:25.106186+0000","last_became_peered":"2021-10-08T19:24:25.106186+0000","last_unstale":"2021-10-08T19:42:25.252713+0000","last_undegraded":"2021-10-08T19:42:25.252713+0000","last_fullsized":"2021-10-08T19:42:25.252713+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:08.939657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:18.377739+0000","last_clean_scrub_stamp":"2021-10-08T19:40:08.939657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014123263,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":476,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.255663+0000","last_change":"2021-10-08T19:39:23.706599+0000","last_active":"2021-10-08T19:42:25.255663+0000","last_peered":"2021-10-08T19:42:25.255663+0000","last_clean":"2021-10-08T19:42:25.255663+0000","last_became_active":"2021-10-08T19:21:29.642835+0000","last_became_peered":"2021-10-08T19:21:29.642835+0000","last_unstale":"2021-10-08T19:42:25.255663+0000","last_undegraded":"2021-10-08T19:42:25.255663+0000","last_fullsized":"2021-10-08T19:42:25.255663+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:23.706498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:39:23.706498+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0056310429999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":431,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.250634+0000","last_change":"2021-10-08T19:42:07.640381+0000","last_active":"2021-10-08T19:42:25.250634+0000","last_peered":"2021-10-08T19:42:25.250634+0000","last_clean":"2021-10-08T19:42:25.250634+0000","last_became_active":"2021-10-08T19:28:40.099215+0000","last_became_peered":"2021-10-08T19:28:40.099215+0000","last_unstale":"2021-10-08T19:42:25.250634+0000","last_undegraded":"2021-10-08T19:42:25.250634+0000","last_fullsized":"2021-10-08T19:42:25.250634+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:42:07.640278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:42:07.640278+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.006052394,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"482'32","reported_seq":333,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.257247+0000","last_change":"2021-10-08T19:41:32.306237+0000","last_active":"2021-10-08T19:42:25.257247+0000","last_peered":"2021-10-08T19:42:25.257247+0000","last_clean":"2021-10-08T19:42:25.257247+0000","last_became_active":"2021-10-08T19:29:40.640914+0000","last_became_peered":"2021-10-08T19:29:40.640914+0000","last_unstale":"2021-10-08T19:42:25.257247+0000","last_undegraded":"2021-10-08T19:42:25.257247+0000","last_fullsized":"2021-10-08T19:42:25.257247+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"348'24","last_scrub_stamp":"2021-10-08T19:41:32.306126+0000","last_deep_scrub":"348'24","last_deep_scrub_stamp":"2021-10-08T19:34:53.274250+0000","last_clean_scrub_stamp":"2021-10-08T19:41:32.306126+0000","log_size":32,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0048356969999999999,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":36,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":436,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.251722+0000","last_change":"2021-10-08T19:42:14.048715+0000","last_active":"2021-10-08T19:42:25.251722+0000","last_peered":"2021-10-08T19:42:25.251722+0000","last_clean":"2021-10-08T19:42:25.251722+0000","last_became_active":"2021-10-08T19:24:25.098128+0000","last_became_peered":"2021-10-08T19:24:25.098128+0000","last_unstale":"2021-10-08T19:42:25.251722+0000","last_undegraded":"2021-10-08T19:42:25.251722+0000","last_fullsized":"2021-10-08T19:42:25.251722+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:42:14.048641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:34.508558+0000","last_clean_scrub_stamp":"2021-10-08T19:42:14.048641+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0014501970000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":496,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.255744+0000","last_change":"2021-10-08T19:41:25.077211+0000","last_active":"2021-10-08T19:42:25.255744+0000","last_peered":"2021-10-08T19:42:25.255744+0000","last_clean":"2021-10-08T19:42:25.255744+0000","last_became_active":"2021-10-08T19:24:25.095490+0000","last_became_peered":"2021-10-08T19:24:25.095490+0000","last_unstale":"2021-10-08T19:42:25.255744+0000","last_undegraded":"2021-10-08T19:42:25.255744+0000","last_fullsized":"2021-10-08T19:42:25.255744+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:41:25.077109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:11.383779+0000","last_clean_scrub_stamp":"2021-10-08T19:41:25.077109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.014373943,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":294,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.255013+0000","last_change":"2021-10-08T19:41:16.517571+0000","last_active":"2021-10-08T19:42:25.255013+0000","last_peered":"2021-10-08T19:42:25.255013+0000","last_clean":"2021-10-08T19:42:25.255013+0000","last_became_active":"2021-10-08T19:29:40.639358+0000","last_became_peered":"2021-10-08T19:29:40.639358+0000","last_unstale":"2021-10-08T19:42:25.255013+0000","last_undegraded":"2021-10-08T19:42:25.255013+0000","last_fullsized":"2021-10-08T19:42:25.255013+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:41:16.517497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:36:12.821316+0000","last_clean_scrub_stamp":"2021-10-08T19:41:16.517497+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.133669077,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"482'30","reported_seq":575,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.243812+0000","last_change":"2021-10-08T19:42:02.319322+0000","last_active":"2021-10-08T19:42:25.243812+0000","last_peered":"2021-10-08T19:42:25.243812+0000","last_clean":"2021-10-08T19:42:25.243812+0000","last_became_active":"2021-10-08T19:29:40.636448+0000","last_became_peered":"2021-10-08T19:29:40.636448+0000","last_unstale":"2021-10-08T19:42:25.243812+0000","last_undegraded":"2021-10-08T19:42:25.243812+0000","last_fullsized":"2021-10-08T19:42:25.243812+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'30","last_scrub_stamp":"2021-10-08T19:42:02.319197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:42:02.319197+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0069278409999999997,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":40,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":491,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.250151+0000","last_change":"2021-10-08T19:42:04.574933+0000","last_active":"2021-10-08T19:42:25.250151+0000","last_peered":"2021-10-08T19:42:25.250151+0000","last_clean":"2021-10-08T19:42:25.250151+0000","last_became_active":"2021-10-08T19:21:23.604530+0000","last_became_peered":"2021-10-08T19:21:23.604530+0000","last_unstale":"2021-10-08T19:42:25.250151+0000","last_undegraded":"2021-10-08T19:42:25.250151+0000","last_fullsized":"2021-10-08T19:42:25.250151+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:42:04.574849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:42:04.574849+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.006377878,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1f","version":"114'10","reported_seq":650,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:31.994839+0000","last_change":"2021-10-08T19:42:07.025894+0000","last_active":"2021-10-08T19:42:31.994839+0000","last_peered":"2021-10-08T19:42:31.994839+0000","last_clean":"2021-10-08T19:42:31.994839+0000","last_became_active":"2021-10-08T19:24:25.105742+0000","last_became_peered":"2021-10-08T19:24:25.105742+0000","last_unstale":"2021-10-08T19:42:31.994839+0000","last_undegraded":"2021-10-08T19:42:31.994839+0000","last_fullsized":"2021-10-08T19:42:31.994839+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'10","last_scrub_stamp":"2021-10-08T19:42:07.025820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:42:07.025820+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0085062360000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"69'1","reported_seq":475,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.257959+0000","last_change":"2021-10-08T19:40:02.876774+0000","last_active":"2021-10-08T19:42:25.257959+0000","last_peered":"2021-10-08T19:42:25.257959+0000","last_clean":"2021-10-08T19:42:25.257959+0000","last_became_active":"2021-10-08T19:21:29.640296+0000","last_became_peered":"2021-10-08T19:21:29.640296+0000","last_unstale":"2021-10-08T19:42:25.257959+0000","last_undegraded":"2021-10-08T19:42:25.257959+0000","last_fullsized":"2021-10-08T19:42:25.257959+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2021-10-08T19:40:02.876665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:40:02.876665+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011383189,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"482'32","reported_seq":511,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.252516+0000","last_change":"2021-10-08T19:39:33.440040+0000","last_active":"2021-10-08T19:42:25.252516+0000","last_peered":"2021-10-08T19:42:25.252516+0000","last_clean":"2021-10-08T19:42:25.252516+0000","last_became_active":"2021-10-08T19:28:40.126425+0000","last_became_peered":"2021-10-08T19:28:40.126425+0000","last_unstale":"2021-10-08T19:42:25.252516+0000","last_undegraded":"2021-10-08T19:42:25.252516+0000","last_fullsized":"2021-10-08T19:42:25.252516+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"390'24","last_scrub_stamp":"2021-10-08T19:39:33.439960+0000","last_deep_scrub":"390'24","last_deep_scrub_stamp":"2021-10-08T19:39:33.439960+0000","last_clean_scrub_stamp":"2021-10-08T19:39:33.439960+0000","log_size":32,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.030901436000000001,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":36,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":292,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.257059+0000","last_change":"2021-10-08T19:41:25.305455+0000","last_active":"2021-10-08T19:42:25.257059+0000","last_peered":"2021-10-08T19:42:25.257059+0000","last_clean":"2021-10-08T19:42:25.257059+0000","last_became_active":"2021-10-08T19:29:40.640952+0000","last_became_peered":"2021-10-08T19:29:40.640952+0000","last_unstale":"2021-10-08T19:42:25.257059+0000","last_undegraded":"2021-10-08T19:42:25.257059+0000","last_fullsized":"2021-10-08T19:42:25.257059+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:41:25.305353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:41:25.305353+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0059384679999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":482,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.243888+0000","last_change":"2021-10-08T19:40:32.036952+0000","last_active":"2021-10-08T19:42:25.243888+0000","last_peered":"2021-10-08T19:42:25.243888+0000","last_clean":"2021-10-08T19:42:25.243888+0000","last_became_active":"2021-10-08T19:21:27.632648+0000","last_became_peered":"2021-10-08T19:21:27.632648+0000","last_unstale":"2021-10-08T19:42:25.243888+0000","last_undegraded":"2021-10-08T19:42:25.243888+0000","last_fullsized":"2021-10-08T19:42:25.243888+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:32.036833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:51.997511+0000","last_clean_scrub_stamp":"2021-10-08T19:40:32.036833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0082112660000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"69'1","reported_seq":330,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.247538+0000","last_change":"2021-10-08T19:40:38.358403+0000","last_active":"2021-10-08T19:42:25.247538+0000","last_peered":"2021-10-08T19:42:25.247538+0000","last_clean":"2021-10-08T19:42:25.247538+0000","last_became_active":"2021-10-08T19:28:40.146302+0000","last_became_peered":"2021-10-08T19:28:40.146302+0000","last_unstale":"2021-10-08T19:42:25.247538+0000","last_undegraded":"2021-10-08T19:42:25.247538+0000","last_fullsized":"2021-10-08T19:42:25.247538+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2021-10-08T19:40:38.358284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:40:38.358284+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.17503824100000001,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"482'39","reported_seq":682,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.250330+0000","last_change":"2021-10-08T19:41:30.037151+0000","last_active":"2021-10-08T19:42:25.250330+0000","last_peered":"2021-10-08T19:42:25.250330+0000","last_clean":"2021-10-08T19:42:25.250330+0000","last_became_active":"2021-10-08T19:29:40.629461+0000","last_became_peered":"2021-10-08T19:29:40.629461+0000","last_unstale":"2021-10-08T19:42:25.250330+0000","last_undegraded":"2021-10-08T19:42:25.250330+0000","last_fullsized":"2021-10-08T19:42:25.250330+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'27","last_scrub_stamp":"2021-10-08T19:41:30.037032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:41:30.037032+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0057389850000000003,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":62,"num_read_kb":53,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":550,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":436,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.253010+0000","last_change":"2021-10-08T19:40:48.873604+0000","last_active":"2021-10-08T19:42:25.253010+0000","last_peered":"2021-10-08T19:42:25.253010+0000","last_clean":"2021-10-08T19:42:25.253010+0000","last_became_active":"2021-10-08T19:24:25.106119+0000","last_became_peered":"2021-10-08T19:24:25.106119+0000","last_unstale":"2021-10-08T19:42:25.253010+0000","last_undegraded":"2021-10-08T19:42:25.253010+0000","last_fullsized":"2021-10-08T19:42:25.253010+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:48.873507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:46.422866+0000","last_clean_scrub_stamp":"2021-10-08T19:40:48.873507+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0080410519999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":328,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.247606+0000","last_change":"2021-10-08T19:39:56.892383+0000","last_active":"2021-10-08T19:42:25.247606+0000","last_peered":"2021-10-08T19:42:25.247606+0000","last_clean":"2021-10-08T19:42:25.247606+0000","last_became_active":"2021-10-08T19:28:40.148009+0000","last_became_peered":"2021-10-08T19:28:40.148009+0000","last_unstale":"2021-10-08T19:42:25.247606+0000","last_undegraded":"2021-10-08T19:42:25.247606+0000","last_fullsized":"2021-10-08T19:42:25.247606+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:56.892286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:39:56.892286+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.018782119,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":495,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.242624+0000","last_change":"2021-10-08T19:42:08.049889+0000","last_active":"2021-10-08T19:42:25.242624+0000","last_peered":"2021-10-08T19:42:25.242624+0000","last_clean":"2021-10-08T19:42:25.242624+0000","last_became_active":"2021-10-08T19:24:25.097782+0000","last_became_peered":"2021-10-08T19:24:25.097782+0000","last_unstale":"2021-10-08T19:42:25.242624+0000","last_undegraded":"2021-10-08T19:42:25.242624+0000","last_fullsized":"2021-10-08T19:42:25.242624+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:42:08.049795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:37.219503+0000","last_clean_scrub_stamp":"2021-10-08T19:42:08.049795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0013495639999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"482'24","reported_seq":322,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.254018+0000","last_change":"2021-10-08T19:40:08.385125+0000","last_active":"2021-10-08T19:42:25.254018+0000","last_peered":"2021-10-08T19:42:25.254018+0000","last_clean":"2021-10-08T19:42:25.254018+0000","last_became_active":"2021-10-08T19:29:40.645144+0000","last_became_peered":"2021-10-08T19:29:40.645144+0000","last_unstale":"2021-10-08T19:42:25.254018+0000","last_undegraded":"2021-10-08T19:42:25.254018+0000","last_fullsized":"2021-10-08T19:42:25.254018+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'18","last_scrub_stamp":"2021-10-08T19:40:08.385003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:40:08.385003+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0077571740000000004,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":286,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.254776+0000","last_change":"2021-10-08T19:39:14.212962+0000","last_active":"2021-10-08T19:42:25.254776+0000","last_peered":"2021-10-08T19:42:25.254776+0000","last_clean":"2021-10-08T19:42:25.254776+0000","last_became_active":"2021-10-08T19:29:44.443807+0000","last_became_peered":"2021-10-08T19:29:44.443807+0000","last_unstale":"2021-10-08T19:42:25.254776+0000","last_undegraded":"2021-10-08T19:42:25.254776+0000","last_fullsized":"2021-10-08T19:42:25.254776+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:14.212865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:32.854550+0000","last_clean_scrub_stamp":"2021-10-08T19:39:14.212865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0077559439999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":493,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.242210+0000","last_change":"2021-10-08T19:39:59.439583+0000","last_active":"2021-10-08T19:42:25.242210+0000","last_peered":"2021-10-08T19:42:25.242210+0000","last_clean":"2021-10-08T19:42:25.242210+0000","last_became_active":"2021-10-08T19:29:40.638352+0000","last_became_peered":"2021-10-08T19:29:40.638352+0000","last_unstale":"2021-10-08T19:42:25.242210+0000","last_undegraded":"2021-10-08T19:42:25.242210+0000","last_fullsized":"2021-10-08T19:42:25.242210+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:59.439435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:39:59.439435+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0082132950000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":304,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.257167+0000","last_change":"2021-10-08T19:39:13.413298+0000","last_active":"2021-10-08T19:42:25.257167+0000","last_peered":"2021-10-08T19:42:25.257167+0000","last_clean":"2021-10-08T19:42:25.257167+0000","last_became_active":"2021-10-08T19:31:22.788455+0000","last_became_peered":"2021-10-08T19:31:22.788455+0000","last_unstale":"2021-10-08T19:42:25.257167+0000","last_undegraded":"2021-10-08T19:42:25.257167+0000","last_fullsized":"2021-10-08T19:42:25.257167+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:13.413194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:32:12.549351+0000","last_clean_scrub_stamp":"2021-10-08T19:39:13.413194+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.173684593,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"482'21","reported_seq":23,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.255411+0000","last_change":"2021-10-08T19:42:21.886065+0000","last_active":"2021-10-08T19:42:25.255411+0000","last_peered":"2021-10-08T19:42:25.255411+0000","last_clean":"2021-10-08T19:42:25.255411+0000","last_became_active":"2021-10-08T19:42:21.193316+0000","last_became_peered":"2021-10-08T19:42:21.193316+0000","last_unstale":"2021-10-08T19:42:25.255411+0000","last_undegraded":"2021-10-08T19:42:25.255411+0000","last_fullsized":"2021-10-08T19:42:25.255411+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'15","last_scrub_stamp":"2021-10-08T19:40:12.384664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:40:12.384664+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.012045141000000001,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":28,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0],"acting":[7,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":484,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.257700+0000","last_change":"2021-10-08T19:39:21.657387+0000","last_active":"2021-10-08T19:42:25.257700+0000","last_peered":"2021-10-08T19:42:25.257700+0000","last_clean":"2021-10-08T19:42:25.257700+0000","last_became_active":"2021-10-08T19:21:23.607785+0000","last_became_peered":"2021-10-08T19:21:23.607785+0000","last_unstale":"2021-10-08T19:42:25.257700+0000","last_undegraded":"2021-10-08T19:42:25.257700+0000","last_fullsized":"2021-10-08T19:42:25.257700+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:21.657316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:21.657316+0000","last_clean_scrub_stamp":"2021-10-08T19:39:21.657316+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034173929999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":489,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.250842+0000","last_change":"2021-10-08T19:41:22.721884+0000","last_active":"2021-10-08T19:42:25.250842+0000","last_peered":"2021-10-08T19:42:25.250842+0000","last_clean":"2021-10-08T19:42:25.250842+0000","last_became_active":"2021-10-08T19:21:27.633979+0000","last_became_peered":"2021-10-08T19:21:27.633979+0000","last_unstale":"2021-10-08T19:42:25.250842+0000","last_undegraded":"2021-10-08T19:42:25.250842+0000","last_fullsized":"2021-10-08T19:42:25.250842+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:41:22.721778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:27.586341+0000","last_clean_scrub_stamp":"2021-10-08T19:41:22.721778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0057862390000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":502,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.243142+0000","last_change":"2021-10-08T19:42:15.287978+0000","last_active":"2021-10-08T19:42:25.243142+0000","last_peered":"2021-10-08T19:42:25.243142+0000","last_clean":"2021-10-08T19:42:25.243142+0000","last_became_active":"2021-10-08T19:28:40.159162+0000","last_became_peered":"2021-10-08T19:28:40.159162+0000","last_unstale":"2021-10-08T19:42:25.243142+0000","last_undegraded":"2021-10-08T19:42:25.243142+0000","last_fullsized":"2021-10-08T19:42:25.243142+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:42:15.287874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:42:15.287874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.050359929999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"482'9","reported_seq":572,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.242563+0000","last_change":"2021-10-08T19:42:10.080524+0000","last_active":"2021-10-08T19:42:25.242563+0000","last_peered":"2021-10-08T19:42:25.242563+0000","last_clean":"2021-10-08T19:42:25.242563+0000","last_became_active":"2021-10-08T19:31:51.675189+0000","last_became_peered":"2021-10-08T19:31:51.675189+0000","last_unstale":"2021-10-08T19:42:25.242563+0000","last_undegraded":"2021-10-08T19:42:25.242563+0000","last_fullsized":"2021-10-08T19:42:25.242563+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'7","last_scrub_stamp":"2021-10-08T19:39:13.080199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:39:13.080199+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0050767039999999996,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":13,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":506,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.258725+0000","last_change":"2021-10-08T19:40:40.875610+0000","last_active":"2021-10-08T19:42:25.258725+0000","last_peered":"2021-10-08T19:42:25.258725+0000","last_clean":"2021-10-08T19:42:25.258725+0000","last_became_active":"2021-10-08T19:24:25.096225+0000","last_became_peered":"2021-10-08T19:24:25.096225+0000","last_unstale":"2021-10-08T19:42:25.258725+0000","last_undegraded":"2021-10-08T19:42:25.258725+0000","last_fullsized":"2021-10-08T19:42:25.258725+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:40.875537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:29:40.244757+0000","last_clean_scrub_stamp":"2021-10-08T19:40:40.875537+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.011385456,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":498,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.255535+0000","last_change":"2021-10-08T19:39:54.903894+0000","last_active":"2021-10-08T19:42:25.255535+0000","last_peered":"2021-10-08T19:42:25.255535+0000","last_clean":"2021-10-08T19:42:25.255535+0000","last_became_active":"2021-10-08T19:28:40.101187+0000","last_became_peered":"2021-10-08T19:28:40.101187+0000","last_unstale":"2021-10-08T19:42:25.255535+0000","last_undegraded":"2021-10-08T19:42:25.255535+0000","last_fullsized":"2021-10-08T19:42:25.255535+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:54.903790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:11.633739+0000","last_clean_scrub_stamp":"2021-10-08T19:39:54.903790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0066268430000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":339,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.245939+0000","last_change":"2021-10-08T19:40:54.582567+0000","last_active":"2021-10-08T19:42:25.245939+0000","last_peered":"2021-10-08T19:42:25.245939+0000","last_clean":"2021-10-08T19:42:25.245939+0000","last_became_active":"2021-10-08T19:37:19.007583+0000","last_became_peered":"2021-10-08T19:37:19.007583+0000","last_unstale":"2021-10-08T19:42:25.245939+0000","last_undegraded":"2021-10-08T19:42:25.245939+0000","last_fullsized":"2021-10-08T19:42:25.245939+0000","mapping_epoch":397,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":398,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:54.582461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:40:54.582461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.091027166000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"482'25","reported_seq":631,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.241697+0000","last_change":"2021-10-08T19:40:40.799532+0000","last_active":"2021-10-08T19:42:25.241697+0000","last_peered":"2021-10-08T19:42:25.241697+0000","last_clean":"2021-10-08T19:42:25.241697+0000","last_became_active":"2021-10-08T19:28:40.099770+0000","last_became_peered":"2021-10-08T19:28:40.099770+0000","last_unstale":"2021-10-08T19:42:25.241697+0000","last_undegraded":"2021-10-08T19:42:25.241697+0000","last_fullsized":"2021-10-08T19:42:25.241697+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"289'19","last_scrub_stamp":"2021-10-08T19:40:40.799434+0000","last_deep_scrub":"289'19","last_deep_scrub_stamp":"2021-10-08T19:36:15.167374+0000","last_clean_scrub_stamp":"2021-10-08T19:40:40.799434+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0041259089999999997,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":292,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.254478+0000","last_change":"2021-10-08T19:41:24.255454+0000","last_active":"2021-10-08T19:42:25.254478+0000","last_peered":"2021-10-08T19:42:25.254478+0000","last_clean":"2021-10-08T19:42:25.254478+0000","last_became_active":"2021-10-08T19:29:40.627394+0000","last_became_peered":"2021-10-08T19:29:40.627394+0000","last_unstale":"2021-10-08T19:42:25.254478+0000","last_undegraded":"2021-10-08T19:42:25.254478+0000","last_fullsized":"2021-10-08T19:42:25.254478+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:41:24.255353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:41:24.255353+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0083609789999999993,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":332,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.246086+0000","last_change":"2021-10-08T19:42:18.780010+0000","last_active":"2021-10-08T19:42:25.246086+0000","last_peered":"2021-10-08T19:42:25.246086+0000","last_clean":"2021-10-08T19:42:25.246086+0000","last_became_active":"2021-10-08T19:28:40.145868+0000","last_became_peered":"2021-10-08T19:28:40.145868+0000","last_unstale":"2021-10-08T19:42:25.246086+0000","last_undegraded":"2021-10-08T19:42:25.246086+0000","last_fullsized":"2021-10-08T19:42:25.246086+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:42:18.779909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:42:18.779909+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002913241,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":493,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.241992+0000","last_change":"2021-10-08T19:40:50.813705+0000","last_active":"2021-10-08T19:42:25.241992+0000","last_peered":"2021-10-08T19:42:25.241992+0000","last_clean":"2021-10-08T19:42:25.241992+0000","last_became_active":"2021-10-08T19:28:40.099543+0000","last_became_peered":"2021-10-08T19:28:40.099543+0000","last_unstale":"2021-10-08T19:42:25.241992+0000","last_undegraded":"2021-10-08T19:42:25.241992+0000","last_fullsized":"2021-10-08T19:42:25.241992+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:50.813601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:50.032367+0000","last_clean_scrub_stamp":"2021-10-08T19:40:50.813601+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.062705711999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"491'46","reported_seq":351,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.257162+0000","last_change":"2021-10-08T19:42:17.985956+0000","last_active":"2021-10-08T19:42:25.257162+0000","last_peered":"2021-10-08T19:42:25.257162+0000","last_clean":"2021-10-08T19:42:25.257162+0000","last_became_active":"2021-10-08T19:29:40.631002+0000","last_became_peered":"2021-10-08T19:29:40.631002+0000","last_unstale":"2021-10-08T19:42:25.257162+0000","last_undegraded":"2021-10-08T19:42:25.257162+0000","last_fullsized":"2021-10-08T19:42:25.257162+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"491'46","last_scrub_stamp":"2021-10-08T19:42:17.985848+0000","last_deep_scrub":"491'46","last_deep_scrub_stamp":"2021-10-08T19:42:17.985848+0000","last_clean_scrub_stamp":"2021-10-08T19:42:17.985848+0000","log_size":46,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.027350965000000001,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":482,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.243420+0000","last_change":"2021-10-08T19:40:01.981144+0000","last_active":"2021-10-08T19:42:25.243420+0000","last_peered":"2021-10-08T19:42:25.243420+0000","last_clean":"2021-10-08T19:42:25.243420+0000","last_became_active":"2021-10-08T19:21:23.603422+0000","last_became_peered":"2021-10-08T19:21:23.603422+0000","last_unstale":"2021-10-08T19:42:25.243420+0000","last_undegraded":"2021-10-08T19:42:25.243420+0000","last_fullsized":"2021-10-08T19:42:25.243420+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:40:01.981016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:15.535842+0000","last_clean_scrub_stamp":"2021-10-08T19:40:01.981016+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0019631129999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":513,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.241830+0000","last_change":"2021-10-08T19:39:12.077018+0000","last_active":"2021-10-08T19:42:25.241830+0000","last_peered":"2021-10-08T19:42:25.241830+0000","last_clean":"2021-10-08T19:42:25.241830+0000","last_became_active":"2021-10-08T19:28:40.099286+0000","last_became_peered":"2021-10-08T19:28:40.099286+0000","last_unstale":"2021-10-08T19:42:25.241830+0000","last_undegraded":"2021-10-08T19:42:25.241830+0000","last_fullsized":"2021-10-08T19:42:25.241830+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:39:12.076904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:31.176160+0000","last_clean_scrub_stamp":"2021-10-08T19:39:12.076904+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.006185444,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":292,"reported_epoch":495,"state":"active+clean","last_fresh":"2021-10-08T19:42:25.254933+0000","last_change":"2021-10-08T19:42:14.217960+0000","last_active":"2021-10-08T19:42:25.254933+0000","last_peered":"2021-10-08T19:42:25.254933+0000","last_clean":"2021-10-08T19:42:25.254933+0000","last_became_active":"2021-10-08T19:29:40.638221+0000","last_became_peered":"2021-10-08T19:29:40.638221+0000","last_unstale":"2021-10-08T19:42:25.254933+0000","last_undegraded":"2021-10-08T19:42:25.254933+0000","last_fullsized":"2021-10-08T19:42:25.254933+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:42:14.217872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:42:14.217872+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.126590442,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":42,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":126,"acting":126,"num_store_stats":8},{"poolid":1,"num_pg":11,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1430,"ondisk_log_size":1430,"up":33,"acting":33,"num_store_stats":8},{"poolid":3,"num_pg":23,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":633,"num_read_kb":633,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":778,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":69,"acting":69,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1539,"num_read_kb":1296,"num_write":989,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":524,"num_bytes_recovered":10936,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1027,"ondisk_log_size":1027,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":84,"ondisk_log_size":84,"up":96,"acting":96,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201538,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":368384,"kb_used_data":1080,"kb_used_omap":0,"kb_used_meta":367296,"kb_avail":93376768,"statfs":{"total":95995035648,"available":95617810432,"internally_reserved":0,"allocated":1105920,"data_stored":728384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":376111104},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:41:47 2021","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.488,"15min":1.5009999999999999},"min":{"1min":0.224,"5min":0.223,"15min":0.20100000000000001},"max":{"1min":6.2300000000000004,"5min":13.686,"15min":26.065000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":1.3009999999999999,"15min":1.5760000000000001},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.20499999999999999},"max":{"1min":2.496,"5min":8.2639999999999993,"15min":25.75},"last":0.41499999999999998}]},{"osd":1,"last update":"Fri Oct 8 19:41:47 2021","interfaces":[{"interface":"back","average":{"1min":6.7750000000000004,"5min":3.7090000000000001,"15min":2.4129999999999998},"min":{"1min":0.25700000000000001,"5min":0.217,"15min":0.19600000000000001},"max":{"1min":95.063000000000002,"5min":95.063000000000002,"15min":95.063000000000002},"last":0.46700000000000003},{"interface":"front","average":{"1min":7.1529999999999996,"5min":2.5550000000000002,"15min":2.1520000000000001},"min":{"1min":0.33400000000000002,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":95.012,"5min":95.012,"15min":95.012},"last":0.32300000000000001}]},{"osd":2,"last update":"Fri Oct 8 19:41:47 2021","interfaces":[{"interface":"back","average":{"1min":1.6439999999999999,"5min":2.4860000000000002,"15min":1.9119999999999999},"min":{"1min":0.28799999999999998,"5min":0.28000000000000003,"15min":0.255},"max":{"1min":5.3239999999999998,"5min":81.204999999999998,"15min":81.204999999999998},"last":0.51000000000000001},{"interface":"front","average":{"1min":2.089,"5min":2.681,"15min":1.883},"min":{"1min":0.28000000000000003,"5min":0.254,"15min":0.253},"max":{"1min":4.9359999999999999,"5min":81.022000000000006,"15min":81.022000000000006},"last":0.33800000000000002}]},{"osd":3,"last update":"Fri Oct 8 19:41:47 2021","interfaces":[{"interface":"back","average":{"1min":2.0870000000000002,"5min":1.9179999999999999,"15min":2.25},"min":{"1min":0.33000000000000002,"5min":0.28799999999999998,"15min":0.28100000000000003},"max":{"1min":5.6870000000000003,"5min":7.5069999999999997,"15min":72.093999999999994},"last":0.377},{"interface":"front","average":{"1min":2.081,"5min":1.9750000000000001,"15min":2.2280000000000002},"min":{"1min":0.28499999999999998,"5min":0.28299999999999997,"15min":0.28000000000000003},"max":{"1min":9.4809999999999999,"5min":13.872,"15min":71.864999999999995},"last":0.35699999999999998}]},{"osd":4,"last update":"Fri Oct 8 19:41:47 2021","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.6779999999999999,"15min":1.25},"min":{"1min":0.30599999999999999,"5min":0.254,"15min":0.22800000000000001},"max":{"1min":3.5710000000000002,"5min":55.890999999999998,"15min":55.890999999999998},"last":0.39700000000000002},{"interface":"front","average":{"1min":1.117,"5min":1.7370000000000001,"15min":1.371},"min":{"1min":0.29899999999999999,"5min":0.25900000000000001,"15min":0.254},"max":{"1min":4.9669999999999996,"5min":54.448999999999998,"15min":54.448999999999998},"last":0.42199999999999999}]},{"osd":5,"last update":"Fri Oct 8 19:41:47 2021","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":1.109,"15min":1.139},"min":{"1min":0.33900000000000002,"5min":0.30299999999999999,"15min":0.26800000000000002},"max":{"1min":3.383,"5min":6.3159999999999998,"15min":9.9280000000000008},"last":0.42999999999999999},{"interface":"front","average":{"1min":1.165,"5min":1.157,"15min":1.252},"min":{"1min":0.32800000000000001,"5min":0.29399999999999998,"15min":0.26100000000000001},"max":{"1min":4.9470000000000001,"5min":6.9850000000000003,"15min":18.655000000000001},"last":0.40400000000000003}]},{"osd":6,"last update":"Fri Oct 8 19:41:47 2021","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.7629999999999999,"15min":1.419},"min":{"1min":0.35199999999999998,"5min":0.28799999999999998,"15min":0.27900000000000003},"max":{"1min":10.943,"5min":58.039000000000001,"15min":58.039000000000001},"last":0.38900000000000001},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.867,"15min":1.4059999999999999},"min":{"1min":0.316,"5min":0.30599999999999999,"15min":0.30299999999999999},"max":{"1min":3.5750000000000002,"5min":58.079999999999998,"15min":58.079999999999998},"last":0.56299999999999994}]}]},{"osd":6,"up_from":47,"seq":201863463174,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":394104,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":393344,"kb_avail":93351048,"statfs":{"total":95995035648,"available":95591473152,"internally_reserved":0,"allocated":770048,"data_stored":406864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":402784256},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:42:28 2021","interfaces":[{"interface":"back","average":{"1min":1.4399999999999999,"5min":1.7969999999999999,"15min":1.454},"min":{"1min":0.245,"5min":0.188,"15min":0.188},"max":{"1min":3.9449999999999998,"5min":39.262,"15min":39.262},"last":0.251},{"interface":"front","average":{"1min":1.637,"5min":2.246,"15min":2.1680000000000001},"min":{"1min":0.26700000000000002,"5min":0.215,"15min":0.21299999999999999},"max":{"1min":5.3470000000000004,"5min":39.351999999999997,"15min":69.477000000000004},"last":1.0640000000000001}]},{"osd":1,"last update":"Fri Oct 8 19:42:28 2021","interfaces":[{"interface":"back","average":{"1min":3.1019999999999999,"5min":2.395,"15min":1.6850000000000001},"min":{"1min":0.28299999999999997,"5min":0.223,"15min":0.223},"max":{"1min":31.504999999999999,"5min":31.504999999999999,"15min":31.504999999999999},"last":7.9909999999999997},{"interface":"front","average":{"1min":3.5840000000000001,"5min":2.387,"15min":1.7450000000000001},"min":{"1min":0.34399999999999997,"5min":0.27300000000000002,"15min":0.24399999999999999},"max":{"1min":31.512,"5min":31.512,"15min":31.512},"last":8.0229999999999997}]},{"osd":2,"last update":"Fri Oct 8 19:42:28 2021","interfaces":[{"interface":"back","average":{"1min":1.6970000000000001,"5min":2.593,"15min":2.0169999999999999},"min":{"1min":0.29599999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":5.0030000000000001,"5min":95.846000000000004,"15min":95.846000000000004},"last":0.68899999999999995},{"interface":"front","average":{"1min":2.0779999999999998,"5min":2.5499999999999998,"15min":2.319},"min":{"1min":0.28899999999999998,"5min":0.252,"15min":0.252},"max":{"1min":7.8949999999999996,"5min":95.683999999999997,"15min":95.683999999999997},"last":7.8949999999999996}]},{"osd":3,"last update":"Fri Oct 8 19:42:28 2021","interfaces":[{"interface":"back","average":{"1min":3.2509999999999999,"5min":4.5659999999999998,"15min":2.5419999999999998},"min":{"1min":0.29699999999999999,"5min":0.27500000000000002,"15min":0.27000000000000002},"max":{"1min":32.808999999999997,"5min":125.726,"15min":125.726},"last":1.895},{"interface":"front","average":{"1min":4.04,"5min":4.6890000000000001,"15min":2.5790000000000002},"min":{"1min":0.32500000000000001,"5min":0.31900000000000001,"15min":0.29099999999999998},"max":{"1min":32.628999999999998,"5min":125.614,"15min":125.614},"last":7.6210000000000004}]},{"osd":4,"last update":"Fri Oct 8 19:42:28 2021","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.1859999999999999,"15min":1.2130000000000001},"min":{"1min":0.27200000000000002,"5min":0.26700000000000002,"15min":0.19600000000000001},"max":{"1min":3.5329999999999999,"5min":6.4059999999999997,"15min":24.516999999999999},"last":1.246},{"interface":"front","average":{"1min":0.86699999999999999,"5min":1.262,"15min":1.4379999999999999},"min":{"1min":0.31900000000000001,"5min":0.26500000000000001,"15min":0.23100000000000001},"max":{"1min":2.476,"5min":8.8379999999999992,"15min":69.593999999999994},"last":0.34300000000000003}]},{"osd":5,"last update":"Fri Oct 8 19:42:28 2021","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.4410000000000001,"15min":1.964},"min":{"1min":0.31,"5min":0.27600000000000002,"15min":0.22900000000000001},"max":{"1min":4.0700000000000003,"5min":8.0830000000000002,"15min":107.485},"last":1.274},{"interface":"front","average":{"1min":0.88500000000000001,"5min":1.1950000000000001,"15min":2.125},"min":{"1min":0.32800000000000001,"5min":0.28399999999999997,"15min":0.251},"max":{"1min":2.504,"5min":5.9720000000000004,"15min":107.90300000000001},"last":0.378}]},{"osd":7,"last update":"Fri Oct 8 19:41:57 2021","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.462,"15min":1.2430000000000001},"min":{"1min":0.33500000000000002,"5min":0.29399999999999998,"15min":0.27800000000000002},"max":{"1min":3.9929999999999999,"5min":6.6790000000000003,"15min":8.8840000000000003},"last":0.39600000000000002},{"interface":"front","average":{"1min":1.149,"5min":1.6040000000000001,"15min":1.4279999999999999},"min":{"1min":0.372,"5min":0.32400000000000001,"15min":0.29899999999999999},"max":{"1min":3.6309999999999998,"5min":8.3740000000000006,"15min":15.962},"last":2.1459999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575129,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":442532,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":441728,"kb_avail":93302620,"statfs":{"total":95995035648,"available":95541882880,"internally_reserved":0,"allocated":815104,"data_stored":407324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":452329472},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:42:13 2021","interfaces":[{"interface":"back","average":{"1min":1.498,"5min":2.786,"15min":3.0960000000000001},"min":{"1min":0.19,"5min":0.19,"15min":0.188},"max":{"1min":4.7839999999999998,"5min":81.459000000000003,"15min":126.256},"last":0.308},{"interface":"front","average":{"1min":3.3999999999999999,"5min":3.706,"15min":3.468},"min":{"1min":0.255,"5min":0.18099999999999999,"15min":0.17799999999999999},"max":{"1min":9.7029999999999994,"5min":81.853999999999999,"15min":126.176},"last":0.40100000000000002}]},{"osd":2,"last update":"Fri Oct 8 19:41:32 2021","interfaces":[{"interface":"back","average":{"1min":2.6120000000000001,"5min":2.0289999999999999,"15min":2.1789999999999998},"min":{"1min":0.25900000000000001,"5min":0.192,"15min":0.192},"max":{"1min":16.460000000000001,"5min":16.460000000000001,"15min":102.395},"last":0.371},{"interface":"front","average":{"1min":3.3330000000000002,"5min":2.298,"15min":2.7029999999999998},"min":{"1min":0.314,"5min":0.214,"15min":0.214},"max":{"1min":7.907,"5min":7.907,"15min":102.50700000000001},"last":0.33500000000000002}]},{"osd":3,"last update":"Fri Oct 8 19:41:47 2021","interfaces":[{"interface":"back","average":{"1min":6.5190000000000001,"5min":2.8149999999999999,"15min":2.9300000000000002},"min":{"1min":0.35899999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":33.972000000000001,"5min":33.972000000000001,"15min":105.836},"last":0.36499999999999999},{"interface":"front","average":{"1min":4.4720000000000004,"5min":2.3690000000000002,"15min":2.7069999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.22900000000000001},"max":{"1min":33.880000000000003,"5min":33.880000000000003,"15min":106.12},"last":0.41799999999999998}]},{"osd":4,"last update":"Fri Oct 8 19:41:52 2021","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.423,"15min":1.893},"min":{"1min":0.29499999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":3.9550000000000001,"5min":6.0659999999999998,"15min":103.538},"last":0.38700000000000001},{"interface":"front","average":{"1min":2.294,"5min":1.7909999999999999,"15min":1.8460000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.254},"max":{"1min":9.7639999999999993,"5min":13.9,"15min":102.67100000000001},"last":0.45100000000000001}]},{"osd":5,"last update":"Fri Oct 8 19:42:24 2021","interfaces":[{"interface":"back","average":{"1min":2.9119999999999999,"5min":2.1000000000000001,"15min":3.2490000000000001},"min":{"1min":0.31900000000000001,"5min":0.29899999999999999,"15min":0.27300000000000002},"max":{"1min":9.7929999999999993,"5min":9.7929999999999993,"15min":262.14100000000002},"last":0.47899999999999998},{"interface":"front","average":{"1min":1.786,"5min":1.6879999999999999,"15min":3.0249999999999999},"min":{"1min":0.309,"5min":0.30199999999999999,"15min":0.30099999999999999},"max":{"1min":4.9279999999999999,"5min":9.7360000000000007,"15min":261.959},"last":0.497}]},{"osd":6,"last update":"Fri Oct 8 19:41:32 2021","interfaces":[{"interface":"back","average":{"1min":1.752,"5min":1.6899999999999999,"15min":2.0329999999999999},"min":{"1min":0.375,"5min":0.316,"15min":0.316},"max":{"1min":4.4980000000000002,"5min":13.837,"15min":103.73},"last":0.42899999999999999},{"interface":"front","average":{"1min":2.7029999999999998,"5min":1.885,"15min":2.1920000000000002},"min":{"1min":0.33800000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":7.1040000000000001,"5min":7.3490000000000002,"15min":102.753},"last":0.56100000000000005}]},{"osd":7,"last update":"Fri Oct 8 19:41:52 2021","interfaces":[{"interface":"back","average":{"1min":2.734,"5min":1.956,"15min":2.54},"min":{"1min":0.38100000000000001,"5min":0.35099999999999998,"15min":0.316},"max":{"1min":6.4199999999999999,"5min":7.0979999999999999,"15min":106.011},"last":0.58999999999999997},{"interface":"front","average":{"1min":2.2989999999999999,"5min":1.569,"15min":2.2909999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34200000000000003},"max":{"1min":9.6950000000000003,"5min":9.7720000000000002,"15min":103.78400000000001},"last":0.57099999999999995}]}]},{"osd":0,"up_from":8,"seq":34359738652,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":430724,"kb_used_data":764,"kb_used_omap":0,"kb_used_meta":429952,"kb_avail":93314428,"statfs":{"total":95995035648,"available":95553974272,"internally_reserved":0,"allocated":782336,"data_stored":406495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":440270848},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 8 19:42:10 2021","interfaces":[{"interface":"back","average":{"1min":3.742,"5min":3.5369999999999999,"15min":2.8069999999999999},"min":{"1min":0.214,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":23.809000000000001,"5min":101.68600000000001,"15min":101.68600000000001},"last":0.34499999999999997},{"interface":"front","average":{"1min":3.363,"5min":3.4710000000000001,"15min":2.7679999999999998},"min":{"1min":0.29499999999999998,"5min":0.20599999999999999,"15min":0.19800000000000001},"max":{"1min":24.835000000000001,"5min":101.732,"15min":101.732},"last":0.28199999999999997}]},{"osd":2,"last update":"Fri Oct 8 19:42:31 2021","interfaces":[{"interface":"back","average":{"1min":2.7269999999999999,"5min":1.9890000000000001,"15min":1.752},"min":{"1min":0.253,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":11.01,"5min":11.01,"15min":12.164999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":2.3999999999999999,"5min":1.881,"15min":1.7929999999999999},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":7.5030000000000001,"5min":10.509,"15min":10.509},"last":0.40300000000000002}]},{"osd":3,"last update":"Fri Oct 8 19:41:47 2021","interfaces":[{"interface":"back","average":{"1min":9.2710000000000008,"5min":3.5680000000000001,"15min":2.734},"min":{"1min":0.26200000000000001,"5min":0.218,"15min":0.217},"max":{"1min":104.744,"5min":104.744,"15min":104.744},"last":0.35599999999999998},{"interface":"front","average":{"1min":8.8610000000000007,"5min":3.2170000000000001,"15min":2.3580000000000001},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":101.94,"5min":101.94,"15min":101.94},"last":0.435}]},{"osd":4,"last update":"Fri Oct 8 19:42:10 2021","interfaces":[{"interface":"back","average":{"1min":2.1579999999999999,"5min":2.0529999999999999,"15min":1.8460000000000001},"min":{"1min":0.32700000000000001,"5min":0.26400000000000001,"15min":0.22900000000000001},"max":{"1min":8.7170000000000005,"5min":12.135,"15min":16.805},"last":0.46899999999999997},{"interface":"front","average":{"1min":1.8400000000000001,"5min":1.649,"15min":1.498},"min":{"1min":0.32200000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":6.0720000000000001,"5min":7.8339999999999996,"15min":11.823},"last":0.39700000000000002}]},{"osd":5,"last update":"Fri Oct 8 19:42:20 2021","interfaces":[{"interface":"back","average":{"1min":1.653,"5min":1.6930000000000001,"15min":1.5429999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.27600000000000002},"max":{"1min":6.3010000000000002,"5min":7.25,"15min":9.9730000000000008},"last":0.63300000000000001},{"interface":"front","average":{"1min":1.8200000000000001,"5min":2.1520000000000001,"15min":1.7989999999999999},"min":{"1min":0.38300000000000001,"5min":0.32100000000000001,"15min":0.28599999999999998},"max":{"1min":8.6899999999999995,"5min":12.095000000000001,"15min":15.115},"last":0.5}]},{"osd":6,"last update":"Fri Oct 8 19:41:34 2021","interfaces":[{"interface":"back","average":{"1min":1.581,"5min":1.6659999999999999,"15min":1.625},"min":{"1min":0.34799999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":4.4690000000000003,"5min":5.931,"15min":11.869},"last":0.49099999999999999},{"interface":"front","average":{"1min":1.929,"5min":1.986,"15min":1.665},"min":{"1min":0.42299999999999999,"5min":0.32100000000000001,"15min":0.28199999999999997},"max":{"1min":4.601,"5min":10.002000000000001,"15min":10.002000000000001},"last":0.61299999999999999}]},{"osd":7,"last update":"Fri Oct 8 19:41:47 2021","interfaces":[{"interface":"back","average":{"1min":2.02,"5min":2.0409999999999999,"15min":1.9099999999999999},"min":{"1min":0.38900000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":7.6749999999999998,"5min":13.214,"15min":13.214},"last":0.52800000000000002},{"interface":"front","average":{"1min":1.631,"5min":1.635,"15min":1.698},"min":{"1min":0.41999999999999998,"5min":0.315,"15min":0.315},"max":{"1min":5.1200000000000001,"5min":8.7609999999999992,"15min":11.898999999999999},"last":0.51400000000000001}]}]},{"osd":2,"up_from":18,"seq":77309411604,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":379320,"kb_used_data":1008,"kb_used_omap":0,"kb_used_meta":378304,"kb_avail":93365832,"statfs":{"total":95995035648,"available":95606611968,"internally_reserved":0,"allocated":1032192,"data_stored":669048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":387383296},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:42:23 2021","interfaces":[{"interface":"back","average":{"1min":1.708,"5min":2.4460000000000002,"15min":2.129},"min":{"1min":0.23799999999999999,"5min":0.19600000000000001,"15min":0.184},"max":{"1min":4.5620000000000003,"5min":50.759999999999998,"15min":60.990000000000002},"last":0.77400000000000002},{"interface":"front","average":{"1min":1.452,"5min":2.339,"15min":2.077},"min":{"1min":0.26900000000000002,"5min":0.193,"15min":0.17999999999999999},"max":{"1min":10.286,"5min":50.899000000000001,"15min":60.850999999999999},"last":0.41599999999999998}]},{"osd":1,"last update":"Fri Oct 8 19:42:23 2021","interfaces":[{"interface":"back","average":{"1min":1.8200000000000001,"5min":2.3919999999999999,"15min":2.6600000000000001},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.19700000000000001},"max":{"1min":4.7850000000000001,"5min":50.866999999999997,"15min":63.738},"last":0.71299999999999997},{"interface":"front","average":{"1min":3.0110000000000001,"5min":2.8479999999999999,"15min":2.7909999999999999},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":14.153,"5min":50.978000000000002,"15min":63.619999999999997},"last":0.48699999999999999}]},{"osd":3,"last update":"Fri Oct 8 19:42:26 2021","interfaces":[{"interface":"back","average":{"1min":2.2650000000000001,"5min":3.0630000000000002,"15min":2.9289999999999998},"min":{"1min":0.28699999999999998,"5min":0.217,"15min":0.21199999999999999},"max":{"1min":6.625,"5min":51.036999999999999,"15min":67.198999999999998},"last":0.372},{"interface":"front","average":{"1min":2.6760000000000002,"5min":2.8199999999999998,"15min":2.9359999999999999},"min":{"1min":0.318,"5min":0.26500000000000001,"15min":0.21299999999999999},"max":{"1min":8.8179999999999996,"5min":52.667999999999999,"15min":66.963999999999999},"last":0.36399999999999999}]},{"osd":4,"last update":"Fri Oct 8 19:41:51 2021","interfaces":[{"interface":"back","average":{"1min":1.8320000000000001,"5min":2.294,"15min":1.8140000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.26900000000000002},"max":{"1min":7.2530000000000001,"5min":52.482999999999997,"15min":52.482999999999997},"last":0.59099999999999997},{"interface":"front","average":{"1min":2.5739999999999998,"5min":2.5600000000000001,"15min":1.897},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.26100000000000001},"max":{"1min":10.981999999999999,"5min":51.015000000000001,"15min":51.015000000000001},"last":0.52400000000000002}]},{"osd":5,"last update":"Fri Oct 8 19:42:23 2021","interfaces":[{"interface":"back","average":{"1min":2.4449999999999998,"5min":2.8050000000000002,"15min":1.9990000000000001},"min":{"1min":0.34200000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":8.6509999999999998,"5min":52.354999999999997,"15min":52.354999999999997},"last":0.55100000000000005},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.9890000000000001,"15min":1.8580000000000001},"min":{"1min":0.307,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":4.0860000000000003,"5min":51.082999999999998,"15min":51.082999999999998},"last":0.54200000000000004}]},{"osd":6,"last update":"Fri Oct 8 19:42:26 2021","interfaces":[{"interface":"back","average":{"1min":2.665,"5min":2.9889999999999999,"15min":2.012},"min":{"1min":0.34999999999999998,"5min":0.33800000000000002,"15min":0.28000000000000003},"max":{"1min":8.7550000000000008,"5min":55.970999999999997,"15min":55.970999999999997},"last":0.50800000000000001},{"interface":"front","average":{"1min":1.4510000000000001,"5min":2.7189999999999999,"15min":2.004},"min":{"1min":0.437,"5min":0.36899999999999999,"15min":0.31},"max":{"1min":4.282,"5min":56.433,"15min":56.433},"last":0.441}]},{"osd":7,"last update":"Fri Oct 8 19:41:51 2021","interfaces":[{"interface":"back","average":{"1min":2.258,"5min":2.363,"15min":2.5030000000000001},"min":{"1min":0.38500000000000001,"5min":0.37,"15min":0.32200000000000001},"max":{"1min":8.7919999999999998,"5min":52.610999999999997,"15min":136.00200000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":1.5920000000000001,"5min":2.1619999999999999,"15min":2.4209999999999998},"min":{"1min":0.39400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":6.0830000000000002,"5min":51.100999999999999,"15min":133.26300000000001},"last":0.57799999999999996}]}]},{"osd":3,"up_from":24,"seq":103079215378,"num_pgs":77,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":478684,"kb_used_data":1364,"kb_used_omap":0,"kb_used_meta":477312,"kb_avail":93266468,"statfs":{"total":95995035648,"available":95504863232,"internally_reserved":0,"allocated":1396736,"data_stored":997738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":488767488},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:41:40 2021","interfaces":[{"interface":"back","average":{"1min":8.4160000000000004,"5min":2.98,"15min":2.4740000000000002},"min":{"1min":0.216,"5min":0.187,"15min":0.17100000000000001},"max":{"1min":93.194999999999993,"5min":93.194999999999993,"15min":93.194999999999993},"last":0.53200000000000003},{"interface":"front","average":{"1min":7.2590000000000003,"5min":3.0419999999999998,"15min":2.2959999999999998},"min":{"1min":0.19700000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":96.450999999999993,"5min":96.450999999999993,"15min":96.450999999999993},"last":0.46899999999999997}]},{"osd":1,"last update":"Fri Oct 8 19:41:40 2021","interfaces":[{"interface":"back","average":{"1min":2.7890000000000001,"5min":1.867,"15min":2.0139999999999998},"min":{"1min":0.22800000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":8.6519999999999992,"5min":8.8610000000000007,"15min":37.271999999999998},"last":0.55900000000000005},{"interface":"front","average":{"1min":4.343,"5min":2.3130000000000002,"15min":2.109},"min":{"1min":0.30499999999999999,"5min":0.223,"15min":0.19},"max":{"1min":28.356999999999999,"5min":28.356999999999999,"15min":37.033000000000001},"last":0.54700000000000004}]},{"osd":2,"last update":"Fri Oct 8 19:41:40 2021","interfaces":[{"interface":"back","average":{"1min":4.4290000000000003,"5min":2.3860000000000001,"15min":2.0350000000000001},"min":{"1min":0.33100000000000002,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":28.454999999999998,"5min":28.454999999999998,"15min":32.277000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":4.2290000000000001,"5min":2.0600000000000001,"15min":2.0339999999999998},"min":{"1min":0.39100000000000001,"5min":0.224,"15min":0.224},"max":{"1min":10.244999999999999,"5min":11.970000000000001,"15min":23.189},"last":0.57099999999999995}]},{"osd":4,"last update":"Fri Oct 8 19:41:57 2021","interfaces":[{"interface":"back","average":{"1min":2.6549999999999998,"5min":1.589,"15min":1.637},"min":{"1min":0.41199999999999998,"5min":0.28000000000000003,"15min":0.26600000000000001},"max":{"1min":8.5060000000000002,"5min":8.7940000000000005,"15min":13.968},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.722,"15min":1.8480000000000001},"min":{"1min":0.29199999999999998,"5min":0.28599999999999998,"15min":0.26900000000000002},"max":{"1min":3.5670000000000002,"5min":8.9009999999999998,"15min":18.692},"last":0.58599999999999997}]},{"osd":5,"last update":"Fri Oct 8 19:42:13 2021","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.462,"15min":1.758},"min":{"1min":0.30299999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":7.5220000000000002,"5min":10.055,"15min":75.397000000000006},"last":0.627},{"interface":"front","average":{"1min":2.3180000000000001,"5min":1.6950000000000001,"15min":2.1600000000000001},"min":{"1min":0.51000000000000001,"5min":0.309,"15min":0.309},"max":{"1min":8.5429999999999993,"5min":8.7579999999999991,"15min":75.680000000000007},"last":0.68100000000000005}]},{"osd":6,"last update":"Fri Oct 8 19:42:27 2021","interfaces":[{"interface":"back","average":{"1min":1.958,"5min":3.476,"15min":2.3599999999999999},"min":{"1min":0.34000000000000002,"5min":0.32800000000000001,"15min":0.28599999999999998},"max":{"1min":5.3570000000000002,"5min":202.99799999999999,"15min":202.99799999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":1.006,"5min":3.448,"15min":2.2229999999999999},"min":{"1min":0.32800000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":2.3239999999999998,"5min":202.31200000000001,"15min":202.31200000000001},"last":0.76600000000000001}]},{"osd":7,"last update":"Fri Oct 8 19:41:57 2021","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.794,"15min":1.8819999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":3.5329999999999999,"5min":13.587,"15min":13.587},"last":0.62},{"interface":"front","average":{"1min":1.6719999999999999,"5min":1.9690000000000001,"15min":1.7390000000000001},"min":{"1min":0.35699999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":10.026999999999999,"5min":13.644,"15min":13.644},"last":0.67100000000000004}]}]},{"osd":4,"up_from":30,"seq":128849019148,"num_pgs":75,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":328016,"kb_used_data":776,"kb_used_omap":0,"kb_used_meta":327232,"kb_avail":93417136,"statfs":{"total":95995035648,"available":95659147264,"internally_reserved":0,"allocated":794624,"data_stored":407783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":335085568},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:41:53 2021","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":1.9870000000000001,"15min":1.8460000000000001},"min":{"1min":0.24199999999999999,"5min":0.219,"15min":0.185},"max":{"1min":5.7290000000000001,"5min":58.609999999999999,"15min":82.109999999999999},"last":0.26600000000000001},{"interface":"front","average":{"1min":2.0899999999999999,"5min":2.0150000000000001,"15min":1.887},"min":{"1min":0.224,"5min":0.222,"15min":0.222},"max":{"1min":10.403,"5min":58.329999999999998,"15min":82.025999999999996},"last":0.57199999999999995}]},{"osd":1,"last update":"Fri Oct 8 19:41:53 2021","interfaces":[{"interface":"back","average":{"1min":5.8949999999999996,"5min":3.0310000000000001,"15min":2.7349999999999999},"min":{"1min":0.24099999999999999,"5min":0.215,"15min":0.215},"max":{"1min":65.012,"5min":65.332999999999998,"15min":122.422},"last":1.968},{"interface":"front","average":{"1min":5.9509999999999996,"5min":2.9860000000000002,"15min":2.577},"min":{"1min":0.245,"5min":0.245,"15min":0.23599999999999999},"max":{"1min":64.966999999999999,"5min":64.966999999999999,"15min":123.122},"last":1.1639999999999999}]},{"osd":2,"last update":"Fri Oct 8 19:41:53 2021","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":2.4780000000000002,"15min":1.764},"min":{"1min":0.317,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":3.069,"5min":60.082999999999998,"15min":60.082999999999998},"last":0.73499999999999999},{"interface":"front","average":{"1min":2.758,"5min":2.605,"15min":1.833},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.221},"max":{"1min":11.832000000000001,"5min":60.539000000000001,"15min":60.539000000000001},"last":0.51500000000000001}]},{"osd":3,"last update":"Fri Oct 8 19:41:53 2021","interfaces":[{"interface":"back","average":{"1min":4.8490000000000002,"5min":3.0139999999999998,"15min":2.367},"min":{"1min":0.32700000000000001,"5min":0.27700000000000002,"15min":0.26500000000000001},"max":{"1min":29.562999999999999,"5min":59.137,"15min":59.137},"last":0.84299999999999997},{"interface":"front","average":{"1min":4.2990000000000004,"5min":2.9039999999999999,"15min":2.1909999999999998},"min":{"1min":0.34599999999999997,"5min":0.27000000000000002,"15min":0.254},"max":{"1min":27.896000000000001,"5min":59.777000000000001,"15min":59.777000000000001},"last":0.71699999999999997}]},{"osd":5,"last update":"Fri Oct 8 19:42:17 2021","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.86099999999999999,"15min":1.044},"min":{"1min":0.27400000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.552,"5min":3.4489999999999998,"15min":10.477},"last":0.32100000000000001},{"interface":"front","average":{"1min":1.141,"5min":0.86299999999999999,"15min":0.97299999999999998},"min":{"1min":0.34599999999999997,"5min":0.25800000000000001,"15min":0.22900000000000001},"max":{"1min":4.0549999999999997,"5min":4.1760000000000002,"15min":8.1319999999999997},"last":0.502}]},{"osd":6,"last update":"Fri Oct 8 19:42:32 2021","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":4.5259999999999998,"15min":2.448},"min":{"1min":0.30599999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":4.1159999999999997,"5min":171.69800000000001,"15min":171.69800000000001},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.82999999999999996,"5min":4.4580000000000002,"15min":2.4700000000000002},"min":{"1min":0.374,"5min":0.27800000000000002,"15min":0.247},"max":{"1min":2.3809999999999998,"5min":171.613,"15min":171.613},"last":0.42999999999999999}]},{"osd":7,"last update":"Fri Oct 8 19:41:53 2021","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.94199999999999995,"15min":0.98099999999999998},"min":{"1min":0.311,"5min":0.29499999999999998,"15min":0.29099999999999998},"max":{"1min":2.742,"5min":5.2009999999999996,"15min":8.0050000000000008},"last":0.45100000000000001},{"interface":"front","average":{"1min":1.556,"5min":1.1639999999999999,"15min":1.0740000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.26800000000000002},"max":{"1min":9.3190000000000008,"5min":9.3190000000000008,"15min":9.3190000000000008},"last":0.47699999999999998}]}]},{"osd":5,"up_from":38,"seq":163208757512,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":393596,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":392256,"kb_avail":93351556,"statfs":{"total":95995035648,"available":95591993344,"internally_reserved":0,"allocated":1363968,"data_stored":991366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":401670144},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:42:22 2021","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":1.4019999999999999,"15min":1.4730000000000001},"min":{"1min":0.22800000000000001,"5min":0.20699999999999999,"15min":0.20300000000000001},"max":{"1min":3.0680000000000001,"5min":33.469999999999999,"15min":43.332999999999998},"last":0.39100000000000001},{"interface":"front","average":{"1min":1.464,"5min":1.6799999999999999,"15min":1.6439999999999999},"min":{"1min":0.23999999999999999,"5min":0.22700000000000001,"15min":0.216},"max":{"1min":7.6890000000000001,"5min":32.857999999999997,"15min":42.637},"last":0.42899999999999999}]},{"osd":1,"last update":"Fri Oct 8 19:42:22 2021","interfaces":[{"interface":"back","average":{"1min":1.704,"5min":1.8320000000000001,"15min":1.96},"min":{"1min":0.25700000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":7.5860000000000003,"5min":9.3010000000000002,"15min":94.558999999999997},"last":0.41099999999999998},{"interface":"front","average":{"1min":1.4810000000000001,"5min":1.708,"15min":1.8300000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":7.5970000000000004,"5min":12.756,"15min":94.456999999999994},"last":0.40400000000000003}]},{"osd":2,"last update":"Fri Oct 8 19:42:22 2021","interfaces":[{"interface":"back","average":{"1min":1.5629999999999999,"5min":1.5700000000000001,"15min":1.464},"min":{"1min":0.29199999999999998,"5min":0.251,"15min":0.249},"max":{"1min":5.8010000000000002,"5min":22.931999999999999,"15min":22.931999999999999},"last":0.33800000000000002},{"interface":"front","average":{"1min":1.948,"5min":2.052,"15min":1.6000000000000001},"min":{"1min":0.28199999999999997,"5min":0.251,"15min":0.24099999999999999},"max":{"1min":7.9139999999999997,"5min":22.963999999999999,"15min":22.963999999999999},"last":0.36399999999999999}]},{"osd":3,"last update":"Fri Oct 8 19:42:22 2021","interfaces":[{"interface":"back","average":{"1min":2.0019999999999998,"5min":1.5,"15min":1.7010000000000001},"min":{"1min":0.318,"5min":0.29599999999999999,"15min":0.27000000000000002},"max":{"1min":10.827999999999999,"5min":10.827999999999999,"15min":12.356},"last":0.41799999999999998},{"interface":"front","average":{"1min":2.762,"5min":2.1880000000000002,"15min":2.0249999999999999},"min":{"1min":0.32200000000000001,"5min":0.29999999999999999,"15min":0.218},"max":{"1min":26.771000000000001,"5min":26.771000000000001,"15min":26.771000000000001},"last":0.38100000000000001}]},{"osd":4,"last update":"Fri Oct 8 19:42:22 2021","interfaces":[{"interface":"back","average":{"1min":3.5920000000000001,"5min":1.554,"15min":1.1000000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":67.369,"5min":67.369,"15min":67.369},"last":0.318},{"interface":"front","average":{"1min":3.9359999999999999,"5min":1.7709999999999999,"15min":1.175},"min":{"1min":0.32100000000000001,"5min":0.26700000000000002,"15min":0.25900000000000001},"max":{"1min":67.468999999999994,"5min":67.468999999999994,"15min":67.468999999999994},"last":0.47299999999999998}]},{"osd":6,"last update":"Fri Oct 8 19:42:31 2021","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":1.0269999999999999,"15min":1.0349999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.255},"max":{"1min":6.6600000000000001,"5min":6.6600000000000001,"15min":11.192},"last":0.497},{"interface":"front","average":{"1min":1.373,"5min":1.1519999999999999,"15min":1.089},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":9.2029999999999994,"5min":9.2029999999999994,"15min":11.259},"last":0.44400000000000001}]},{"osd":7,"last update":"Fri Oct 8 19:41:48 2021","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":1.071,"15min":1.1000000000000001},"min":{"1min":0.32700000000000001,"5min":0.22,"15min":0.22},"max":{"1min":3.5230000000000001,"5min":5.8280000000000003,"15min":29.946999999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.98599999999999999,"5min":1.075,"15min":1.1719999999999999},"min":{"1min":0.34699999999999998,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":4.3120000000000003,"5min":12.970000000000001,"15min":29.294},"last":0.46000000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":266240,"data_stored":262688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":327680,"data_stored":327680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-10-08T19:42:38.602 INFO:tasks.thrashosds.thrasher:Setting 2.19 to [5, 4, 3, 1, 2, 0] 2021-10-08T19:42:38.603 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '2.19', '5', '4', '3', '1', '2', '0'] 2021-10-08T19:42:38.603 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd pg-upmap-items 2.19 5 4 3 1 2 0 2021-10-08T19:42:38.936 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:42:38.971 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:42:38 smithi097 conmon[33110]: 172.21.15.117 - - [08/Oct/2021:19:42:38] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:42:39.112 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:42:39.112 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2021-10-08T19:42:39.113 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2021-10-08T19:42:39.113 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2021-10-08T19:42:39.113 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.113 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.25465.0:196898 9.7 9:e39e61ee:::benchmark_data_smithi097_196985_object81207:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e341)", 2021-10-08T19:42:39.114 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:34:26.365248+0000", 2021-10-08T19:42:39.114 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 492.74410380299997, 2021-10-08T19:42:39.114 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.30782482700000002, 2021-10-08T19:42:39.114 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:39.115 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:39.115 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:42:39.115 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.25465", 2021-10-08T19:42:39.115 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:42:39.116 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 196898 2021-10-08T19:42:39.116 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.116 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:39.116 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.116 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:39.117 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.365248+0000", 2021-10-08T19:42:39.117 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:39.117 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.117 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.117 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:39.118 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.365248+0000", 2021-10-08T19:42:39.118 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:39.118 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.118 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.119 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:39.119 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.365247+0000", 2021-10-08T19:42:39.119 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:42:39.119 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.120 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.120 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:39.120 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.365253+0000", 2021-10-08T19:42:39.120 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.178e-06 2021-10-08T19:42:39.121 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.121 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.121 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:39.122 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.365261+0000", 2021-10-08T19:42:39.122 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.14e-06 2021-10-08T19:42:39.122 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.122 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.122 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:39.123 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.365266+0000", 2021-10-08T19:42:39.123 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.6789999999999996e-06 2021-10-08T19:42:39.123 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.123 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.123 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:39.124 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.365413+0000", 2021-10-08T19:42:39.124 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014674499999999999 2021-10-08T19:42:39.124 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.124 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.125 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:39.125 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.365538+0000", 2021-10-08T19:42:39.125 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012537099999999999 2021-10-08T19:42:39.125 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.125 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.126 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 3,7", 2021-10-08T19:42:39.126 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.365657+0000", 2021-10-08T19:42:39.126 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011871600000000001 2021-10-08T19:42:39.126 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.127 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.127 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:39.127 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.370420+0000", 2021-10-08T19:42:39.127 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0047631130000000002 2021-10-08T19:42:39.127 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.128 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.128 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:42:39.128 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.370426+0000", 2021-10-08T19:42:39.128 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0349999999999998e-06 2021-10-08T19:42:39.129 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.129 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.129 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:39.129 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.672985+0000", 2021-10-08T19:42:39.130 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.302559676 2021-10-08T19:42:39.130 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.130 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.130 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:39.130 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.673033+0000", 2021-10-08T19:42:39.131 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7033000000000002e-05 2021-10-08T19:42:39.131 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.131 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.131 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:39.132 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.673073+0000", 2021-10-08T19:42:39.132 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0756000000000001e-05 2021-10-08T19:42:39.132 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:39.132 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:39.132 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:39.133 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.133 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.133 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.25465.0:196900 9.7 9:ea9fb75a:::benchmark_data_smithi097_196985_object81209:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e341)", 2021-10-08T19:42:39.133 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:34:26.365339+0000", 2021-10-08T19:42:39.134 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 492.74401326100002, 2021-10-08T19:42:39.134 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.30804772800000002, 2021-10-08T19:42:39.134 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:39.134 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:39.134 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:42:39.135 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.25465", 2021-10-08T19:42:39.135 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:42:39.135 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 196900 2021-10-08T19:42:39.135 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.136 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:39.136 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.136 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:39.136 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.365339+0000", 2021-10-08T19:42:39.136 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:39.137 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.137 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.137 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:39.137 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.365339+0000", 2021-10-08T19:42:39.138 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:39.138 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.138 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.138 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:39.138 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.365338+0000", 2021-10-08T19:42:39.139 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:42:39.139 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.139 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.139 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:39.140 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.365344+0000", 2021-10-08T19:42:39.140 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.144e-06 2021-10-08T19:42:39.140 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.140 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.140 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:39.141 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.365354+0000", 2021-10-08T19:42:39.141 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0475999999999999e-05 2021-10-08T19:42:39.141 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.141 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.142 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:39.142 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.365360+0000", 2021-10-08T19:42:39.142 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9340000000000003e-06 2021-10-08T19:42:39.142 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.143 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.143 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:39.143 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.367883+0000", 2021-10-08T19:42:39.143 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0025224890000000002 2021-10-08T19:42:39.143 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.144 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.144 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:39.144 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.367991+0000", 2021-10-08T19:42:39.144 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010832000000000001 2021-10-08T19:42:39.144 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.145 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.145 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 3,7", 2021-10-08T19:42:39.145 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.368088+0000", 2021-10-08T19:42:39.145 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7156000000000003e-05 2021-10-08T19:42:39.146 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.146 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.146 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:39.146 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.371513+0000", 2021-10-08T19:42:39.146 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0034250859999999999 2021-10-08T19:42:39.147 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.147 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.147 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:42:39.147 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.372513+0000", 2021-10-08T19:42:39.148 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00099992399999999991 2021-10-08T19:42:39.148 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.148 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.148 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:39.149 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.673323+0000", 2021-10-08T19:42:39.149 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.30081016199999999 2021-10-08T19:42:39.149 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.149 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.149 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:39.150 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.673356+0000", 2021-10-08T19:42:39.150 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2431000000000002e-05 2021-10-08T19:42:39.150 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.150 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.151 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:39.151 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.673387+0000", 2021-10-08T19:42:39.151 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.1034999999999997e-05 2021-10-08T19:42:39.151 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:39.151 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:39.152 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:39.152 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.152 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.152 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.25465.0:196901 9.f 9:ff36b7c0:::benchmark_data_smithi097_196985_object81210:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e341)", 2021-10-08T19:42:39.152 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:34:26.365366+0000", 2021-10-08T19:42:39.153 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 492.74398613599999, 2021-10-08T19:42:39.153 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.30780639199999998, 2021-10-08T19:42:39.153 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:39.153 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:39.154 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:42:39.154 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.25465", 2021-10-08T19:42:39.154 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:42:39.154 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 196901 2021-10-08T19:42:39.154 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.155 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:39.155 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.155 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:39.155 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.365366+0000", 2021-10-08T19:42:39.156 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:39.156 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.156 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.156 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:39.156 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.365366+0000", 2021-10-08T19:42:39.157 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:39.157 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.157 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.157 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:39.158 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.365366+0000", 2021-10-08T19:42:39.158 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999995 2021-10-08T19:42:39.158 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.158 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.158 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:39.159 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.365369+0000", 2021-10-08T19:42:39.159 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.021e-06 2021-10-08T19:42:39.159 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.159 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.160 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:39.160 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.365373+0000", 2021-10-08T19:42:39.160 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7840000000000003e-06 2021-10-08T19:42:39.160 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.160 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.161 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:39.161 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.365377+0000", 2021-10-08T19:42:39.161 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7699999999999999e-06 2021-10-08T19:42:39.161 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.161 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.162 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:39.162 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.370449+0000", 2021-10-08T19:42:39.162 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0050719789999999999 2021-10-08T19:42:39.162 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.163 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.163 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:39.163 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.370540+0000", 2021-10-08T19:42:39.163 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0994000000000003e-05 2021-10-08T19:42:39.163 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.164 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.164 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 1,3", 2021-10-08T19:42:39.164 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.370618+0000", 2021-10-08T19:42:39.164 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.7661000000000001e-05 2021-10-08T19:42:39.165 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.165 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.165 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:42:39.165 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.372673+0000", 2021-10-08T19:42:39.166 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020556369999999999 2021-10-08T19:42:39.166 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.166 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.166 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:39.166 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.377298+0000", 2021-10-08T19:42:39.167 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046249619999999998 2021-10-08T19:42:39.167 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.167 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.167 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:39.167 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.673106+0000", 2021-10-08T19:42:39.168 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.29580804999999999 2021-10-08T19:42:39.168 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.168 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.168 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:39.169 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.673141+0000", 2021-10-08T19:42:39.169 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4195e-05 2021-10-08T19:42:39.169 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.169 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.169 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:39.170 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.673173+0000", 2021-10-08T19:42:39.170 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.1909999999999998e-05 2021-10-08T19:42:39.170 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:39.170 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:39.171 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:39.171 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.171 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.171 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.25465.0:196912 9.f 9:f88ace3a:::benchmark_data_smithi097_196985_object81221:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e341)", 2021-10-08T19:42:39.171 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:34:26.373197+0000", 2021-10-08T19:42:39.172 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 492.73615478300002, 2021-10-08T19:42:39.172 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.30009342100000003, 2021-10-08T19:42:39.172 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:39.172 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:39.173 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:42:39.173 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.25465", 2021-10-08T19:42:39.173 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:42:39.173 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 196912 2021-10-08T19:42:39.173 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.174 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:39.174 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.174 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:39.174 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.373197+0000", 2021-10-08T19:42:39.175 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:39.175 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.175 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.175 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:39.176 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.373197+0000", 2021-10-08T19:42:39.176 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:39.176 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.176 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.176 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:39.177 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.373196+0000", 2021-10-08T19:42:39.177 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:42:39.177 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.177 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.178 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:39.178 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.373201+0000", 2021-10-08T19:42:39.178 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.237e-06 2021-10-08T19:42:39.178 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.178 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.179 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:39.179 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.373209+0000", 2021-10-08T19:42:39.179 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.7160000000000003e-06 2021-10-08T19:42:39.179 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.180 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.180 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:39.180 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.373213+0000", 2021-10-08T19:42:39.180 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4209999999999997e-06 2021-10-08T19:42:39.180 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.181 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.181 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:39.181 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.373247+0000", 2021-10-08T19:42:39.181 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.3589e-05 2021-10-08T19:42:39.182 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.182 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.182 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:39.182 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.373317+0000", 2021-10-08T19:42:39.182 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0178000000000005e-05 2021-10-08T19:42:39.183 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.183 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.183 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 1,3", 2021-10-08T19:42:39.183 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.373384+0000", 2021-10-08T19:42:39.184 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6342999999999998e-05 2021-10-08T19:42:39.184 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.184 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.184 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:39.184 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.377329+0000", 2021-10-08T19:42:39.185 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0039457090000000004 2021-10-08T19:42:39.185 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.185 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.185 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:42:39.186 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.377378+0000", 2021-10-08T19:42:39.186 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8912000000000002e-05 2021-10-08T19:42:39.186 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.186 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.186 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:39.187 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.673227+0000", 2021-10-08T19:42:39.187 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.29584895700000002 2021-10-08T19:42:39.187 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.187 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.188 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:39.188 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.673259+0000", 2021-10-08T19:42:39.188 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2360000000000002e-05 2021-10-08T19:42:39.188 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.188 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.189 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:39.189 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.673291+0000", 2021-10-08T19:42:39.189 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.1384999999999999e-05 2021-10-08T19:42:39.189 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:39.190 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:39.190 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:39.190 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.190 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.190 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.25465.0:196914 9.7 9:e4d40b7e:::benchmark_data_smithi097_196985_object81223:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e341)", 2021-10-08T19:42:39.191 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:34:26.375242+0000", 2021-10-08T19:42:39.191 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 492.73411006100002, 2021-10-08T19:42:39.191 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.29828389500000002, 2021-10-08T19:42:39.191 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:39.192 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:39.192 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:42:39.192 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.25465", 2021-10-08T19:42:39.192 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:42:39.192 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 196914 2021-10-08T19:42:39.193 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.193 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:39.193 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.193 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:39.193 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.375242+0000", 2021-10-08T19:42:39.194 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:39.194 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.194 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.194 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:39.195 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.375242+0000", 2021-10-08T19:42:39.195 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:39.195 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.195 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.195 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:39.196 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.375241+0000", 2021-10-08T19:42:39.196 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:42:39.196 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.196 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.197 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:39.197 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.375247+0000", 2021-10-08T19:42:39.197 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2060000000000004e-06 2021-10-08T19:42:39.197 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.197 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.198 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:39.198 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.375256+0000", 2021-10-08T19:42:39.198 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7229999999999999e-06 2021-10-08T19:42:39.198 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.199 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.199 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:39.199 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.375261+0000", 2021-10-08T19:42:39.199 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.3680000000000004e-06 2021-10-08T19:42:39.199 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.200 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.200 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:39.200 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.375295+0000", 2021-10-08T19:42:39.200 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4091000000000003e-05 2021-10-08T19:42:39.201 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.201 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.201 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:39.201 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.375367+0000", 2021-10-08T19:42:39.201 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1917999999999998e-05 2021-10-08T19:42:39.202 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.202 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.202 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 3,7", 2021-10-08T19:42:39.202 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.375435+0000", 2021-10-08T19:42:39.202 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8609000000000007e-05 2021-10-08T19:42:39.203 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.203 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.203 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:42:39.203 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.377663+0000", 2021-10-08T19:42:39.204 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022277870000000002 2021-10-08T19:42:39.204 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.204 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.204 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:39.204 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.378535+0000", 2021-10-08T19:42:39.205 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00087142399999999998 2021-10-08T19:42:39.205 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.205 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.205 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:39.205 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.673444+0000", 2021-10-08T19:42:39.206 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.29490908500000002 2021-10-08T19:42:39.206 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.206 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.206 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:39.207 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.673490+0000", 2021-10-08T19:42:39.207 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.6164e-05 2021-10-08T19:42:39.207 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.207 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.207 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:39.208 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.673526+0000", 2021-10-08T19:42:39.208 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6145e-05 2021-10-08T19:42:39.208 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:39.208 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:39.208 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:39.209 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.209 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.209 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:196909 9.b e341/290 9:d3161f3e:::benchmark_data_smithi097_196985_object81218:head v 341'12204, mlcod=341'12201)", 2021-10-08T19:42:39.209 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:34:26.382214+0000", 2021-10-08T19:42:39.210 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 492.72713821299999, 2021-10-08T19:42:39.210 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.28828398500000002, 2021-10-08T19:42:39.210 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:39.210 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:39.210 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:39.211 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.211 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:39.211 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.382214+0000", 2021-10-08T19:42:39.211 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:39.212 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.212 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.212 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:39.212 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.382214+0000", 2021-10-08T19:42:39.213 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:39.213 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.213 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.213 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:39.213 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.382213+0000", 2021-10-08T19:42:39.214 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:42:39.214 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.214 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.214 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:39.215 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.382220+0000", 2021-10-08T19:42:39.215 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5939999999999996e-06 2021-10-08T19:42:39.215 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.215 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.215 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:39.216 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.382229+0000", 2021-10-08T19:42:39.216 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4509999999999992e-06 2021-10-08T19:42:39.216 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.216 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.216 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:39.217 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.382233+0000", 2021-10-08T19:42:39.217 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0300000000000004e-06 2021-10-08T19:42:39.217 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.217 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.217 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:39.218 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.382266+0000", 2021-10-08T19:42:39.218 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.3704000000000001e-05 2021-10-08T19:42:39.218 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.218 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.219 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:39.219 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.382279+0000", 2021-10-08T19:42:39.219 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2233e-05 2021-10-08T19:42:39.219 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.219 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.220 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:39.220 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.670469+0000", 2021-10-08T19:42:39.220 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.28819015799999997 2021-10-08T19:42:39.220 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.221 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.221 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:39.221 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.670498+0000", 2021-10-08T19:42:39.221 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9147000000000001e-05 2021-10-08T19:42:39.221 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:39.222 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:39.222 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:39.222 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.222 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.222 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.25465.0:196922 9.f 9:f24a480b:::benchmark_data_smithi097_196985_object81231:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e341)", 2021-10-08T19:42:39.223 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:34:26.382741+0000", 2021-10-08T19:42:39.223 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 492.72661138400002, 2021-10-08T19:42:39.223 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.29074443999999999, 2021-10-08T19:42:39.223 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:39.224 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:39.224 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:42:39.224 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.25465", 2021-10-08T19:42:39.224 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:42:39.224 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 196922 2021-10-08T19:42:39.225 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.225 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:39.225 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.225 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:39.225 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.382741+0000", 2021-10-08T19:42:39.226 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:39.226 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.226 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.226 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:39.227 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.382741+0000", 2021-10-08T19:42:39.227 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:39.227 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.227 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.227 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:39.228 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.382739+0000", 2021-10-08T19:42:39.228 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:42:39.228 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.228 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.228 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:39.229 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.382745+0000", 2021-10-08T19:42:39.229 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9859999999999999e-06 2021-10-08T19:42:39.229 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.229 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.230 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:39.230 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.382753+0000", 2021-10-08T19:42:39.230 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.354e-06 2021-10-08T19:42:39.230 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.230 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.231 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:39.231 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.382758+0000", 2021-10-08T19:42:39.231 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.549e-06 2021-10-08T19:42:39.231 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.231 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.232 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:39.232 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.382806+0000", 2021-10-08T19:42:39.232 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8489999999999998e-05 2021-10-08T19:42:39.232 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.232 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.233 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:39.233 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.382926+0000", 2021-10-08T19:42:39.233 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000120147 2021-10-08T19:42:39.233 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.234 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.234 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 1,3", 2021-10-08T19:42:39.234 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.383050+0000", 2021-10-08T19:42:39.234 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012329600000000001 2021-10-08T19:42:39.234 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.235 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.235 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:42:39.235 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.672948+0000", 2021-10-08T19:42:39.235 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.28989825699999999 2021-10-08T19:42:39.235 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.236 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.236 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:39.236 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.673201+0000", 2021-10-08T19:42:39.236 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00025325400000000001 2021-10-08T19:42:39.237 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.237 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.237 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:39.237 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.673417+0000", 2021-10-08T19:42:39.237 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000215565 2021-10-08T19:42:39.238 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.238 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.238 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:39.238 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.673449+0000", 2021-10-08T19:42:39.238 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.1766e-05 2021-10-08T19:42:39.239 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.239 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.239 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:39.239 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.673485+0000", 2021-10-08T19:42:39.240 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6740999999999999e-05 2021-10-08T19:42:39.240 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:39.240 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:39.240 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:39.240 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.241 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.241 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.25465.0:196923 9.7 9:ecfe363a:::benchmark_data_smithi097_196985_object81232:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e341)", 2021-10-08T19:42:39.241 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:34:26.385228+0000", 2021-10-08T19:42:39.241 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 492.72412449299998, 2021-10-08T19:42:39.242 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.29412065399999998, 2021-10-08T19:42:39.242 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:39.242 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:39.242 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:42:39.242 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.25465", 2021-10-08T19:42:39.243 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:42:39.243 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 196923 2021-10-08T19:42:39.243 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.243 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:39.243 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.244 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:39.244 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.385228+0000", 2021-10-08T19:42:39.244 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:39.244 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.245 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.245 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:39.245 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.385228+0000", 2021-10-08T19:42:39.245 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:39.245 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.246 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.246 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:39.246 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.385226+0000", 2021-10-08T19:42:39.246 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:42:39.247 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.247 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.247 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:39.247 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.385233+0000", 2021-10-08T19:42:39.247 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7970000000000003e-06 2021-10-08T19:42:39.248 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.248 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.248 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:39.248 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.385241+0000", 2021-10-08T19:42:39.248 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.7679999999999997e-06 2021-10-08T19:42:39.249 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.249 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.249 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:39.249 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.385246+0000", 2021-10-08T19:42:39.250 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7829999999999998e-06 2021-10-08T19:42:39.250 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.250 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.250 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:39.250 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.385280+0000", 2021-10-08T19:42:39.251 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.3550000000000002e-05 2021-10-08T19:42:39.251 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.251 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.251 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:39.252 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.385353+0000", 2021-10-08T19:42:39.252 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3337000000000006e-05 2021-10-08T19:42:39.252 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.252 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.252 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 3,7", 2021-10-08T19:42:39.253 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.385432+0000", 2021-10-08T19:42:39.253 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9299000000000001e-05 2021-10-08T19:42:39.253 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.253 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.254 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:39.254 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.673636+0000", 2021-10-08T19:42:39.254 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.288203818 2021-10-08T19:42:39.254 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.254 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.255 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:42:39.255 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.676303+0000", 2021-10-08T19:42:39.255 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0026671580000000002 2021-10-08T19:42:39.255 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.255 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.256 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:39.256 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.679256+0000", 2021-10-08T19:42:39.256 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0029524759999999999 2021-10-08T19:42:39.256 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.257 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.257 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:39.257 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.679310+0000", 2021-10-08T19:42:39.257 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.3844000000000002e-05 2021-10-08T19:42:39.257 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.258 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.258 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:39.258 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.679348+0000", 2021-10-08T19:42:39.258 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8735000000000001e-05 2021-10-08T19:42:39.258 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:39.259 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:39.259 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:39.259 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.259 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.260 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:196920 9.8 e341/290 9:1ab5a2ea:::benchmark_data_smithi097_196985_object81229:head v 341'12502, mlcod=341'12497)", 2021-10-08T19:42:39.260 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:34:26.385351+0000", 2021-10-08T19:42:39.260 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 492.72400170899999, 2021-10-08T19:42:39.260 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.28931272600000002, 2021-10-08T19:42:39.260 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:39.261 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:39.261 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:39.261 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.261 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:39.262 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.385351+0000", 2021-10-08T19:42:39.262 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:39.262 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.262 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.262 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:39.263 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.385351+0000", 2021-10-08T19:42:39.263 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:39.263 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.263 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.263 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:39.264 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.385350+0000", 2021-10-08T19:42:39.264 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967296 2021-10-08T19:42:39.264 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.264 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.264 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:39.265 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.385353+0000", 2021-10-08T19:42:39.265 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.1020000000000001e-06 2021-10-08T19:42:39.265 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.265 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.266 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:39.266 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.385356+0000", 2021-10-08T19:42:39.266 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8140000000000001e-06 2021-10-08T19:42:39.266 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.266 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.267 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:39.267 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.385358+0000", 2021-10-08T19:42:39.267 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0949999999999998e-06 2021-10-08T19:42:39.267 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.267 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.268 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:39.268 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.385388+0000", 2021-10-08T19:42:39.268 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9281999999999998e-05 2021-10-08T19:42:39.268 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.269 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.269 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:39.269 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.385400+0000", 2021-10-08T19:42:39.269 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2456999999999999e-05 2021-10-08T19:42:39.269 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.270 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.270 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:39.270 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.674629+0000", 2021-10-08T19:42:39.270 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.289228981 2021-10-08T19:42:39.271 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.271 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.271 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:39.271 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.674663+0000", 2021-10-08T19:42:39.271 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4217999999999997e-05 2021-10-08T19:42:39.272 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:39.272 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:39.272 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:39.273 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.273 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.273 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:196925 9.5 e341/290 9:ac405794:::benchmark_data_smithi097_196985_object81234:head v 341'12168, mlcod=341'12166)", 2021-10-08T19:42:39.273 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:34:26.386749+0000", 2021-10-08T19:42:39.273 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 492.72260324500002, 2021-10-08T19:42:39.274 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.28911487400000002, 2021-10-08T19:42:39.274 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:39.274 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:39.274 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:39.275 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.275 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:39.275 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.386749+0000", 2021-10-08T19:42:39.275 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:39.275 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.276 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.276 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:39.276 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.386749+0000", 2021-10-08T19:42:39.276 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:39.276 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.277 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.277 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:39.277 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.386749+0000", 2021-10-08T19:42:39.277 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999995 2021-10-08T19:42:39.278 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.278 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.278 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:39.278 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.386753+0000", 2021-10-08T19:42:39.279 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4649999999999996e-06 2021-10-08T19:42:39.279 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.279 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.279 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:39.279 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.670607+0000", 2021-10-08T19:42:39.280 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.28385440200000001 2021-10-08T19:42:39.280 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.280 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.280 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:39.281 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.670614+0000", 2021-10-08T19:42:39.281 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8159999999999996e-06 2021-10-08T19:42:39.281 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.281 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.281 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:39.282 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.670652+0000", 2021-10-08T19:42:39.282 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7335000000000001e-05 2021-10-08T19:42:39.282 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.282 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.283 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:39.283 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.670672+0000", 2021-10-08T19:42:39.283 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.016e-05 2021-10-08T19:42:39.283 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.283 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.284 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:39.284 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.675839+0000", 2021-10-08T19:42:39.284 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0051676250000000003 2021-10-08T19:42:39.284 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.284 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.285 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:39.285 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:26.675864+0000", 2021-10-08T19:42:39.285 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4553e-05 2021-10-08T19:42:39.285 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:39.285 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:39.286 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:39.286 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.286 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.286 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.26125.0:49206 11.7 e447/433 11:ec5b754a:::benchmark_data_smithi097_295476_object49205:head v 447'3025, mlcod=447'3023)", 2021-10-08T19:42:39.287 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:39:37.460099+0000", 2021-10-08T19:42:39.287 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 181.649253031, 2021-10-08T19:42:39.287 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020047801000000001, 2021-10-08T19:42:39.287 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:39.288 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:39.288 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:39.288 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.288 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:39.288 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:37.460099+0000", 2021-10-08T19:42:39.289 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:39.289 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.289 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.289 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:39.289 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:37.460099+0000", 2021-10-08T19:42:39.290 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:39.290 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.290 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.290 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:39.291 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:37.460098+0000", 2021-10-08T19:42:39.291 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:42:39.291 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.291 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.291 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:39.292 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:37.478438+0000", 2021-10-08T19:42:39.292 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018340281 2021-10-08T19:42:39.292 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.292 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.292 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:39.293 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:37.478450+0000", 2021-10-08T19:42:39.293 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2269000000000001e-05 2021-10-08T19:42:39.293 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.293 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.293 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:39.294 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:37.478456+0000", 2021-10-08T19:42:39.294 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6799999999999998e-06 2021-10-08T19:42:39.294 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.294 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.295 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:39.295 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:37.478524+0000", 2021-10-08T19:42:39.295 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7708999999999998e-05 2021-10-08T19:42:39.295 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.295 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.296 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:39.296 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:37.478545+0000", 2021-10-08T19:42:39.296 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1585000000000001e-05 2021-10-08T19:42:39.296 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.296 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.297 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:39.297 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:37.480112+0000", 2021-10-08T19:42:39.297 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0015663879999999999 2021-10-08T19:42:39.297 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.297 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.298 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:39.298 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:37.480147+0000", 2021-10-08T19:42:39.298 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.5394e-05 2021-10-08T19:42:39.298 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:39.299 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:39.299 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:39.299 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.299 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.299 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.26125.0:69093 11.7 e455/433 11:e2e28a57:::benchmark_data_smithi097_295476_object69092:head v 455'4278, mlcod=455'4276)", 2021-10-08T19:42:39.300 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:39:55.013528+0000", 2021-10-08T19:42:39.300 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 164.095824687, 2021-10-08T19:42:39.300 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.033469116, 2021-10-08T19:42:39.300 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:39.300 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:39.301 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:39.301 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.301 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:39.301 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:55.013528+0000", 2021-10-08T19:42:39.301 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:39.302 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.302 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.302 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:39.302 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:55.013528+0000", 2021-10-08T19:42:39.303 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:39.303 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.303 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.303 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:39.303 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:55.013526+0000", 2021-10-08T19:42:39.304 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:42:39.304 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.304 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.304 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:39.304 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:55.043475+0000", 2021-10-08T19:42:39.305 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.029948997000000002 2021-10-08T19:42:39.305 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.305 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.305 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:39.305 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:55.043492+0000", 2021-10-08T19:42:39.306 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7048999999999999e-05 2021-10-08T19:42:39.306 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.306 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.306 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:39.306 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:55.043499+0000", 2021-10-08T19:42:39.307 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.311e-06 2021-10-08T19:42:39.307 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.307 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.307 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:39.307 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:55.043551+0000", 2021-10-08T19:42:39.308 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1365e-05 2021-10-08T19:42:39.308 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.308 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.308 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:39.308 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:55.043583+0000", 2021-10-08T19:42:39.309 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2311999999999998e-05 2021-10-08T19:42:39.309 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.309 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.309 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:39.309 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:55.046955+0000", 2021-10-08T19:42:39.310 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003372547 2021-10-08T19:42:39.310 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.310 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.310 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:39.311 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:55.046997+0000", 2021-10-08T19:42:39.311 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1248999999999998e-05 2021-10-08T19:42:39.311 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:39.311 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:39.311 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:39.312 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.312 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.312 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.26125.0:70649 11.8 e455/433 11:15c6b83b:::benchmark_data_smithi097_295476_object70648:head v 455'4489, mlcod=455'4487)", 2021-10-08T19:42:39.312 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:39:56.388866+0000", 2021-10-08T19:42:39.312 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 162.72048599600001, 2021-10-08T19:42:39.313 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.021748291999999999, 2021-10-08T19:42:39.313 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:39.313 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:39.313 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:39.314 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.314 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:39.314 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:56.388866+0000", 2021-10-08T19:42:39.314 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:39.314 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.315 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.315 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:39.315 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:56.388866+0000", 2021-10-08T19:42:39.315 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:39.316 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.316 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.316 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:39.316 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:56.388864+0000", 2021-10-08T19:42:39.316 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:42:39.317 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.317 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.317 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:39.317 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:56.388905+0000", 2021-10-08T19:42:39.317 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0113e-05 2021-10-08T19:42:39.318 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.318 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.318 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:39.318 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:56.388919+0000", 2021-10-08T19:42:39.318 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.467e-05 2021-10-08T19:42:39.319 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.319 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.319 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:39.319 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:56.388926+0000", 2021-10-08T19:42:39.319 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3459999999999999e-06 2021-10-08T19:42:39.320 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.320 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.320 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:39.320 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:56.388965+0000", 2021-10-08T19:42:39.320 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9203999999999999e-05 2021-10-08T19:42:39.321 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.321 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.321 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:39.321 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:56.388986+0000", 2021-10-08T19:42:39.322 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1682999999999999e-05 2021-10-08T19:42:39.322 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.322 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.322 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:39.322 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:56.410563+0000", 2021-10-08T19:42:39.323 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.021576090999999999 2021-10-08T19:42:39.323 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.323 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.323 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:39.323 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:56.410615+0000", 2021-10-08T19:42:39.324 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2018999999999998e-05 2021-10-08T19:42:39.324 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:39.324 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:39.324 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:39.324 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.325 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.325 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.26125.0:70652 11.8 e455/433 11:1816acf9:::benchmark_data_smithi097_295476_object70651:head v 455'4490, mlcod=455'4487)", 2021-10-08T19:42:39.325 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:39:56.391459+0000", 2021-10-08T19:42:39.325 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 162.71789332099999, 2021-10-08T19:42:39.325 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.022015094999999998, 2021-10-08T19:42:39.326 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:39.326 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:39.326 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:39.326 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.327 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:39.327 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:56.391459+0000", 2021-10-08T19:42:39.327 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:39.327 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.327 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.328 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:39.328 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:56.391459+0000", 2021-10-08T19:42:39.328 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:39.328 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.328 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.329 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:39.329 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:56.391457+0000", 2021-10-08T19:42:39.329 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:42:39.329 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.329 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.330 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:39.330 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:56.391498+0000", 2021-10-08T19:42:39.330 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0738000000000002e-05 2021-10-08T19:42:39.330 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.331 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.331 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:39.331 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:56.391512+0000", 2021-10-08T19:42:39.331 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3766e-05 2021-10-08T19:42:39.331 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.332 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.332 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:39.332 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:56.391519+0000", 2021-10-08T19:42:39.332 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6529999999999997e-06 2021-10-08T19:42:39.332 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.333 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.333 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:39.333 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:56.393606+0000", 2021-10-08T19:42:39.333 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020871739999999998 2021-10-08T19:42:39.333 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.334 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.334 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:39.334 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:56.393629+0000", 2021-10-08T19:42:39.334 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3155000000000001e-05 2021-10-08T19:42:39.334 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.335 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.335 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:39.335 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:56.413202+0000", 2021-10-08T19:42:39.335 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019573284 2021-10-08T19:42:39.335 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.336 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.336 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:39.336 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:56.413474+0000", 2021-10-08T19:42:39.336 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00027177400000000002 2021-10-08T19:42:39.336 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:39.337 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:39.337 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:39.337 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.337 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.338 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.26125.0:105680 11.7 e466/433 11:e03ca116:::benchmark_data_smithi097_295476_object105679:head v 466'6492, mlcod=466'6490)", 2021-10-08T19:42:39.338 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:40:31.128688+0000", 2021-10-08T19:42:39.338 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 127.980664656, 2021-10-08T19:42:39.338 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025540561, 2021-10-08T19:42:39.338 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:39.339 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:39.339 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:39.339 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.339 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:39.339 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.128688+0000", 2021-10-08T19:42:39.340 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:39.340 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.340 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.340 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:39.341 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.128688+0000", 2021-10-08T19:42:39.341 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:39.341 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.341 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.341 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:39.342 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.128686+0000", 2021-10-08T19:42:39.342 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:42:39.342 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.342 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.342 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:39.343 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.151312+0000", 2021-10-08T19:42:39.343 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.022626380000000001 2021-10-08T19:42:39.343 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.343 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.343 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:39.344 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.151342+0000", 2021-10-08T19:42:39.344 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9519999999999999e-05 2021-10-08T19:42:39.344 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.344 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.344 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:39.345 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.151367+0000", 2021-10-08T19:42:39.345 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5432999999999999e-05 2021-10-08T19:42:39.345 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.345 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.345 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:39.346 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.151439+0000", 2021-10-08T19:42:39.346 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1676999999999998e-05 2021-10-08T19:42:39.346 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.346 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.347 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:39.347 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.151483+0000", 2021-10-08T19:42:39.347 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4319e-05 2021-10-08T19:42:39.347 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.347 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.348 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:39.348 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.154192+0000", 2021-10-08T19:42:39.348 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027092459999999998 2021-10-08T19:42:39.348 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.348 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.349 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:39.349 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.154228+0000", 2021-10-08T19:42:39.349 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.5726000000000003e-05 2021-10-08T19:42:39.349 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:39.349 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:39.350 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:39.350 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.350 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.350 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.26125.0:106189 11.a e466/433 11:506d2689:::benchmark_data_smithi097_295476_object106188:head v 466'6657, mlcod=466'6654)", 2021-10-08T19:42:39.351 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:40:31.794355+0000", 2021-10-08T19:42:39.351 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 127.31499733699999, 2021-10-08T19:42:39.351 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020571187000000001, 2021-10-08T19:42:39.351 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:39.351 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:39.352 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:39.352 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.352 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:39.352 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.794355+0000", 2021-10-08T19:42:39.352 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:39.353 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.353 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.353 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:39.353 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.794355+0000", 2021-10-08T19:42:39.353 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:39.354 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.354 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.354 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:39.354 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.794354+0000", 2021-10-08T19:42:39.354 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:42:39.355 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.355 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.355 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:39.355 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.794392+0000", 2021-10-08T19:42:39.355 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8245999999999999e-05 2021-10-08T19:42:39.356 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.356 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.356 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:39.356 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.794401+0000", 2021-10-08T19:42:39.356 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.4169999999999998e-06 2021-10-08T19:42:39.357 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.357 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.357 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:39.357 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.794407+0000", 2021-10-08T19:42:39.357 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.242e-06 2021-10-08T19:42:39.358 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.358 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.358 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:39.358 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.799518+0000", 2021-10-08T19:42:39.359 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0051116900000000003 2021-10-08T19:42:39.359 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.359 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.359 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:39.359 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.799534+0000", 2021-10-08T19:42:39.360 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5194000000000001e-05 2021-10-08T19:42:39.360 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.360 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.360 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:39.360 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.814879+0000", 2021-10-08T19:42:39.361 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015345911 2021-10-08T19:42:39.361 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.361 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.361 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:39.361 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.814926+0000", 2021-10-08T19:42:39.362 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.6659000000000002e-05 2021-10-08T19:42:39.362 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:39.362 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:39.362 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:39.362 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.363 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.363 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.26125.0:106191 11.a e466/433 11:505b415b:::benchmark_data_smithi097_295476_object106190:head v 466'6658, mlcod=466'6654)", 2021-10-08T19:42:39.363 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:40:31.799289+0000", 2021-10-08T19:42:39.363 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 127.310063442, 2021-10-08T19:42:39.364 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015659988, 2021-10-08T19:42:39.364 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:39.364 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:39.364 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:39.364 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.365 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:39.365 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.799289+0000", 2021-10-08T19:42:39.365 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:39.365 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.365 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.366 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:39.366 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.799289+0000", 2021-10-08T19:42:39.366 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:39.366 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.366 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.367 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:39.367 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.799288+0000", 2021-10-08T19:42:39.367 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999995 2021-10-08T19:42:39.367 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.367 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.368 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:39.368 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.799329+0000", 2021-10-08T19:42:39.368 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0763999999999998e-05 2021-10-08T19:42:39.368 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.368 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.369 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:39.369 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.799336+0000", 2021-10-08T19:42:39.369 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.9820000000000002e-06 2021-10-08T19:42:39.369 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.370 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.370 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:39.370 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.799341+0000", 2021-10-08T19:42:39.370 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8049999999999997e-06 2021-10-08T19:42:39.370 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.371 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.371 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:39.371 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.804795+0000", 2021-10-08T19:42:39.371 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054538039999999996 2021-10-08T19:42:39.371 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.372 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.372 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:39.372 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.804816+0000", 2021-10-08T19:42:39.372 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1444e-05 2021-10-08T19:42:39.373 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.373 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.373 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:39.373 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.814933+0000", 2021-10-08T19:42:39.373 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010116676999999999 2021-10-08T19:42:39.374 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.374 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.374 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:39.374 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.814949+0000", 2021-10-08T19:42:39.375 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6155999999999999e-05 2021-10-08T19:42:39.375 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:39.375 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:39.375 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:39.375 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.376 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.376 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.26125.0:130896 11.a e473/433 11:59c33d8c:::benchmark_data_smithi097_295476_object17147:head v 473'8216, mlcod=473'8213)", 2021-10-08T19:42:39.376 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:40:56.106614+0000", 2021-10-08T19:42:39.376 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 103.002737748, 2021-10-08T19:42:39.376 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019147391, 2021-10-08T19:42:39.377 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:39.377 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:39.377 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:39.377 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.377 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:39.378 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:56.106614+0000", 2021-10-08T19:42:39.378 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:39.378 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.378 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.379 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:39.379 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:56.106614+0000", 2021-10-08T19:42:39.379 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:39.379 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.379 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.380 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:39.380 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:56.106613+0000", 2021-10-08T19:42:39.380 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:42:39.380 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.380 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.381 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:39.381 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:56.106622+0000", 2021-10-08T19:42:39.381 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.8389999999999996e-06 2021-10-08T19:42:39.381 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.381 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.382 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:39.382 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:56.106632+0000", 2021-10-08T19:42:39.382 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.027e-05 2021-10-08T19:42:39.382 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.382 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.383 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:39.383 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:56.106638+0000", 2021-10-08T19:42:39.383 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0059999999999998e-06 2021-10-08T19:42:39.383 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.384 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.384 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:39.384 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:56.108792+0000", 2021-10-08T19:42:39.384 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021532919999999998 2021-10-08T19:42:39.384 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.385 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.385 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:39.385 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:56.108812+0000", 2021-10-08T19:42:39.385 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0324999999999999e-05 2021-10-08T19:42:39.385 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.386 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.386 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:39.386 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:56.125721+0000", 2021-10-08T19:42:39.386 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016908863999999999 2021-10-08T19:42:39.387 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.387 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.387 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:39.387 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:56.125762+0000", 2021-10-08T19:42:39.387 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1170000000000001e-05 2021-10-08T19:42:39.388 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:39.388 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:39.388 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:39.388 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.388 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.389 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.26125.0:171093 11.a e482/433 11:55407ec8:::benchmark_data_smithi097_295476_object57344:head v 482'10778, mlcod=482'10774)", 2021-10-08T19:42:39.389 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:41:33.768570+0000", 2021-10-08T19:42:39.389 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 65.340782653000005, 2021-10-08T19:42:39.389 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015639506000000001, 2021-10-08T19:42:39.390 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:39.390 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:39.390 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:39.390 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.390 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:39.391 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.768570+0000", 2021-10-08T19:42:39.391 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:39.391 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.391 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.392 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:39.392 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.768570+0000", 2021-10-08T19:42:39.392 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:39.392 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.392 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.393 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:39.393 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.768569+0000", 2021-10-08T19:42:39.393 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999995 2021-10-08T19:42:39.393 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.393 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.394 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:39.394 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.768577+0000", 2021-10-08T19:42:39.394 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.943e-06 2021-10-08T19:42:39.394 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.395 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.395 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:39.395 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.768582+0000", 2021-10-08T19:42:39.395 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.3759999999999999e-06 2021-10-08T19:42:39.395 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.396 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.396 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:39.396 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.768586+0000", 2021-10-08T19:42:39.396 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.569e-06 2021-10-08T19:42:39.396 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.397 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.397 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:39.397 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.770734+0000", 2021-10-08T19:42:39.397 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021476490000000002 2021-10-08T19:42:39.398 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.398 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.398 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:39.398 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.770753+0000", 2021-10-08T19:42:39.398 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9035999999999999e-05 2021-10-08T19:42:39.399 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.399 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.399 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:39.399 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.784169+0000", 2021-10-08T19:42:39.399 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013416693 2021-10-08T19:42:39.400 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.400 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.400 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:39.400 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.784209+0000", 2021-10-08T19:42:39.401 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9669999999999998e-05 2021-10-08T19:42:39.401 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:39.401 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:39.401 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:39.401 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.402 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.402 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.26125.0:198543 11.5 e486/433 11:a324f09c:::benchmark_data_smithi097_295476_object84794:head v 486'12274, mlcod=486'12271)", 2021-10-08T19:42:39.402 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:42:01.000340+0000", 2021-10-08T19:42:39.402 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 38.109012675000002, 2021-10-08T19:42:39.403 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016521890000000001, 2021-10-08T19:42:39.403 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:39.403 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:39.403 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:39.403 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.404 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:39.404 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:01.000340+0000", 2021-10-08T19:42:39.404 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:39.404 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.404 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.405 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:39.405 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:01.000340+0000", 2021-10-08T19:42:39.405 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:39.405 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.405 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.406 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:39.406 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:01.000339+0000", 2021-10-08T19:42:39.406 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:42:39.406 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.407 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.407 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:39.407 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:01.000345+0000", 2021-10-08T19:42:39.407 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8329999999999996e-06 2021-10-08T19:42:39.407 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.408 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.408 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:39.408 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:01.000353+0000", 2021-10-08T19:42:39.408 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5989999999999996e-06 2021-10-08T19:42:39.409 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.409 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.409 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:39.409 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:01.000357+0000", 2021-10-08T19:42:39.409 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.3290000000000004e-06 2021-10-08T19:42:39.410 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.410 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.410 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:39.410 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:01.009813+0000", 2021-10-08T19:42:39.410 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094556629999999996 2021-10-08T19:42:39.411 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.411 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.411 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:39.411 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:01.009837+0000", 2021-10-08T19:42:39.412 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3651000000000001e-05 2021-10-08T19:42:39.412 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.412 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.412 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:39.412 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:01.016821+0000", 2021-10-08T19:42:39.413 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0069842410000000004 2021-10-08T19:42:39.413 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:39.413 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:39.413 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:39.413 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:01.016861+0000", 2021-10-08T19:42:39.414 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0535999999999999e-05 2021-10-08T19:42:39.414 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:39.414 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:39.414 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:39.414 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:39.415 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:39.415 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:42:39.416 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:39 smithi097 ceph-mon[41966]: osdmap e498: 8 total, 8 up, 8 in 2021-10-08T19:42:39.416 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:39 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:42:39.416 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:39 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:42:39.417 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:39 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:42:39.417 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:39 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:42:39.417 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:39 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:42:39.417 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:39 smithi117 ceph-mon[34585]: osdmap e498: 8 total, 8 up, 8 in 2021-10-08T19:42:39.418 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:39 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:42:39.418 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:39 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:42:39.418 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:39 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:42:39.418 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:39 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:42:39.418 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:39 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:42:39.419 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:39 smithi097 ceph-mon[32687]: osdmap e498: 8 total, 8 up, 8 in 2021-10-08T19:42:39.419 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:39 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:42:39.419 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:39 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:42:39.419 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:39 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:42:39.420 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:39 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:42:39.420 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:39 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:42:39.827 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2021-10-08T19:42:40.101 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:42:40.123 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is unset 2021-10-08T19:42:40.362 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:40 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:42:40.362 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:40 smithi117 ceph-mon[34585]: 172.21.15.117 - - [08/Oct/2021:19:42:38] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:42:40.363 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:40 smithi117 ceph-mon[34585]: pgmap v1056: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 671 B/s rd, 0 op/s 2021-10-08T19:42:40.363 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:40 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2876212159' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:42:40.363 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:40 smithi117 ceph-mon[34585]: from='client.26410 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:42:40.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:40 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:42:40.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:40 smithi097 ceph-mon[32687]: 172.21.15.117 - - [08/Oct/2021:19:42:38] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:42:40.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:40 smithi097 ceph-mon[32687]: pgmap v1056: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 671 B/s rd, 0 op/s 2021-10-08T19:42:40.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:40 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2876212159' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:42:40.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:40 smithi097 ceph-mon[32687]: from='client.26410 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:42:40.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:40 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:42:40.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:40 smithi097 ceph-mon[41966]: 172.21.15.117 - - [08/Oct/2021:19:42:38] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:42:40.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:40 smithi097 ceph-mon[41966]: pgmap v1056: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 671 B/s rd, 0 op/s 2021-10-08T19:42:40.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:40 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2876212159' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:42:40.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:40 smithi097 ceph-mon[41966]: from='client.26410 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2021-10-08T19:42:40.745 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd unset nodeep-scrub 2021-10-08T19:42:41.038 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:42:41.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:41 smithi117 ceph-mon[34585]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:42:41.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:41 smithi117 ceph-mon[34585]: from='client.26410 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:42:41.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:41 smithi117 ceph-mon[34585]: osdmap e499: 8 total, 8 up, 8 in 2021-10-08T19:42:41.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:41 smithi097 ceph-mon[41966]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:42:41.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:41 smithi097 ceph-mon[41966]: from='client.26410 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:42:41.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:41 smithi097 ceph-mon[41966]: osdmap e499: 8 total, 8 up, 8 in 2021-10-08T19:42:41.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:41 smithi097 ceph-mon[32687]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2021-10-08T19:42:41.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:41 smithi097 ceph-mon[32687]: from='client.26410 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2021-10-08T19:42:41.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:41 smithi097 ceph-mon[32687]: osdmap e499: 8 total, 8 up, 8 in 2021-10-08T19:42:41.958 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:42:41.959 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2021-10-08T19:42:41.959 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2021-10-08T19:42:41.960 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:42:42.126 INFO:teuthology.orchestra.run.smithi097.stderr:set 2.19 pg_upmap_items mapping to [5->4,3->1,2->0] 2021-10-08T19:42:42.405 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:42:42 smithi117 conmon[69189]: level=error ts=2021-10-08T19:42:42.314Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=1 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:42:42.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:42 smithi117 ceph-mon[34585]: 2.20 scrub ok 2021-10-08T19:42:42.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:42 smithi117 ceph-mon[34585]: 4.1b scrub ok 2021-10-08T19:42:42.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:42 smithi117 ceph-mon[34585]: pgmap v1058: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 841 B/s rd, 0 op/s 2021-10-08T19:42:42.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:42 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2777017736' entity='client.admin' cmd=[{"prefix": "osd pg-upmap-items", "pgid": "2.19", "id": [5, 4, 3, 1, 2, 0]}]: dispatch 2021-10-08T19:42:42.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:42 smithi117 ceph-mon[34585]: from='client.36455 ' entity='client.admin' cmd=[{"prefix": "osd pg-upmap-items", "pgid": "2.19", "id": [5, 4, 3, 1, 2, 0]}]: dispatch 2021-10-08T19:42:42.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:42 smithi117 ceph-mon[34585]: 5.5 scrub ok 2021-10-08T19:42:42.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:42 smithi117 ceph-mon[34585]: 5.15 scrub ok 2021-10-08T19:42:42.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:42 smithi097 ceph-mon[32687]: 2.20 scrub ok 2021-10-08T19:42:42.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:42 smithi097 ceph-mon[32687]: 4.1b scrub ok 2021-10-08T19:42:42.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:42 smithi097 ceph-mon[32687]: pgmap v1058: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 841 B/s rd, 0 op/s 2021-10-08T19:42:42.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:42 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2777017736' entity='client.admin' cmd=[{"prefix": "osd pg-upmap-items", "pgid": "2.19", "id": [5, 4, 3, 1, 2, 0]}]: dispatch 2021-10-08T19:42:42.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:42 smithi097 ceph-mon[32687]: from='client.36455 ' entity='client.admin' cmd=[{"prefix": "osd pg-upmap-items", "pgid": "2.19", "id": [5, 4, 3, 1, 2, 0]}]: dispatch 2021-10-08T19:42:42.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:42 smithi097 ceph-mon[32687]: 5.5 scrub ok 2021-10-08T19:42:42.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:42 smithi097 ceph-mon[32687]: 5.15 scrub ok 2021-10-08T19:42:42.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:42 smithi097 ceph-mon[41966]: 2.20 scrub ok 2021-10-08T19:42:42.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:42 smithi097 ceph-mon[41966]: 4.1b scrub ok 2021-10-08T19:42:42.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:42 smithi097 ceph-mon[41966]: pgmap v1058: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 841 B/s rd, 0 op/s 2021-10-08T19:42:42.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:42 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2777017736' entity='client.admin' cmd=[{"prefix": "osd pg-upmap-items", "pgid": "2.19", "id": [5, 4, 3, 1, 2, 0]}]: dispatch 2021-10-08T19:42:42.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:42 smithi097 ceph-mon[41966]: from='client.36455 ' entity='client.admin' cmd=[{"prefix": "osd pg-upmap-items", "pgid": "2.19", "id": [5, 4, 3, 1, 2, 0]}]: dispatch 2021-10-08T19:42:42.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:42 smithi097 ceph-mon[41966]: 5.5 scrub ok 2021-10-08T19:42:42.474 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:42 smithi097 ceph-mon[41966]: 5.15 scrub ok 2021-10-08T19:42:42.601 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2021-10-08T19:42:42.874 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:42:42.957 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:42:42 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:42:42] "GET /metrics HTTP/1.1" 200 154886 "" "Prometheus/2.18.1" 2021-10-08T19:42:43.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:43 smithi097 ceph-mon[32687]: 2.1c scrub ok 2021-10-08T19:42:43.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:43 smithi097 ceph-mon[32687]: 6.e scrub ok 2021-10-08T19:42:43.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:43 smithi097 ceph-mon[32687]: from='client.36455 ' entity='client.admin' cmd='[{"prefix": "osd pg-upmap-items", "pgid": "2.19", "id": [5, 4, 3, 1, 2, 0]}]': finished 2021-10-08T19:42:43.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:43 smithi097 ceph-mon[32687]: osdmap e500: 8 total, 8 up, 8 in 2021-10-08T19:42:43.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:42:43.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:43 smithi097 ceph-mon[32687]: 4.12 scrub ok 2021-10-08T19:42:43.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:42:43.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:43 smithi097 ceph-mon[41966]: 2.1c scrub ok 2021-10-08T19:42:43.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:43 smithi097 ceph-mon[41966]: 6.e scrub ok 2021-10-08T19:42:43.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:43 smithi097 ceph-mon[41966]: from='client.36455 ' entity='client.admin' cmd='[{"prefix": "osd pg-upmap-items", "pgid": "2.19", "id": [5, 4, 3, 1, 2, 0]}]': finished 2021-10-08T19:42:43.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:43 smithi097 ceph-mon[41966]: osdmap e500: 8 total, 8 up, 8 in 2021-10-08T19:42:43.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:42:43.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:43 smithi097 ceph-mon[41966]: 4.12 scrub ok 2021-10-08T19:42:43.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:42:43.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:43 smithi117 ceph-mon[34585]: 2.1c scrub ok 2021-10-08T19:42:43.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:43 smithi117 ceph-mon[34585]: 6.e scrub ok 2021-10-08T19:42:43.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:43 smithi117 ceph-mon[34585]: from='client.36455 ' entity='client.admin' cmd='[{"prefix": "osd pg-upmap-items", "pgid": "2.19", "id": [5, 4, 3, 1, 2, 0]}]': finished 2021-10-08T19:42:43.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:43 smithi117 ceph-mon[34585]: osdmap e500: 8 total, 8 up, 8 in 2021-10-08T19:42:43.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:42:43.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:43 smithi117 ceph-mon[34585]: 4.12 scrub ok 2021-10-08T19:42:43.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:42:44.124 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:42:43 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:42:43] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:42:44.144 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is unset 2021-10-08T19:42:44.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:44 smithi117 ceph-mon[34585]: pgmap v1060: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:42:44.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:44 smithi117 ceph-mon[34585]: osdmap e501: 8 total, 8 up, 8 in 2021-10-08T19:42:44.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:44 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/640687258' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:42:44.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:44 smithi117 ceph-mon[34585]: from='client.26422 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:42:44.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:44 smithi117 ceph-mon[34585]: 2.15 scrub ok 2021-10-08T19:42:44.468 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:42:44.469 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2021-10-08T19:42:44.469 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2021-10-08T19:42:44.469 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2021-10-08T19:42:44.469 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:42:44.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:44 smithi097 ceph-mon[32687]: pgmap v1060: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:42:44.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:44 smithi097 ceph-mon[32687]: osdmap e501: 8 total, 8 up, 8 in 2021-10-08T19:42:44.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:44 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/640687258' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:42:44.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:44 smithi097 ceph-mon[32687]: from='client.26422 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:42:44.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:44 smithi097 ceph-mon[32687]: 2.15 scrub ok 2021-10-08T19:42:44.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:44 smithi097 ceph-mon[41966]: pgmap v1060: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:42:44.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:44 smithi097 ceph-mon[41966]: osdmap e501: 8 total, 8 up, 8 in 2021-10-08T19:42:44.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:44 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/640687258' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:42:44.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:44 smithi097 ceph-mon[41966]: from='client.26422 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2021-10-08T19:42:44.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:44 smithi097 ceph-mon[41966]: 2.15 scrub ok 2021-10-08T19:42:45.100 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2021-10-08T19:42:45.373 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:42:45.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:45 smithi117 ceph-mon[34585]: 2.11 scrub ok 2021-10-08T19:42:45.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:45 smithi117 ceph-mon[34585]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:42:45.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:45 smithi117 ceph-mon[34585]: Cluster is now healthy 2021-10-08T19:42:45.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:45 smithi117 ceph-mon[34585]: from='client.26422 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:42:45.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:45 smithi117 ceph-mon[34585]: osdmap e502: 8 total, 8 up, 8 in 2021-10-08T19:42:45.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:45 smithi097 ceph-mon[32687]: 2.11 scrub ok 2021-10-08T19:42:45.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:45 smithi097 ceph-mon[32687]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:42:45.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:45 smithi097 ceph-mon[32687]: Cluster is now healthy 2021-10-08T19:42:45.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:45 smithi097 ceph-mon[32687]: from='client.26422 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:42:45.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:45 smithi097 ceph-mon[32687]: osdmap e502: 8 total, 8 up, 8 in 2021-10-08T19:42:45.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:45 smithi097 ceph-mon[41966]: 2.11 scrub ok 2021-10-08T19:42:45.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:45 smithi097 ceph-mon[41966]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2021-10-08T19:42:45.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:45 smithi097 ceph-mon[41966]: Cluster is now healthy 2021-10-08T19:42:45.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:45 smithi097 ceph-mon[41966]: from='client.26422 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2021-10-08T19:42:45.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:45 smithi097 ceph-mon[41966]: osdmap e502: 8 total, 8 up, 8 in 2021-10-08T19:42:46.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:46 smithi117 ceph-mon[34585]: pgmap v1063: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2021-10-08T19:42:46.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:46 smithi117 ceph-mon[34585]: 1.a scrub ok 2021-10-08T19:42:46.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:46 smithi117 ceph-mon[34585]: 4.16 scrub ok 2021-10-08T19:42:46.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:46 smithi097 ceph-mon[32687]: pgmap v1063: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2021-10-08T19:42:46.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:46 smithi097 ceph-mon[32687]: 1.a scrub ok 2021-10-08T19:42:46.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:46 smithi097 ceph-mon[32687]: 4.16 scrub ok 2021-10-08T19:42:46.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:46 smithi097 ceph-mon[41966]: pgmap v1063: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2021-10-08T19:42:46.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:46 smithi097 ceph-mon[41966]: 1.a scrub ok 2021-10-08T19:42:46.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:46 smithi097 ceph-mon[41966]: 4.16 scrub ok 2021-10-08T19:42:46.950 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:42:46.950 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2021-10-08T19:42:46.951 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2021-10-08T19:42:46.951 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2021-10-08T19:42:46.951 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:46.951 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.26125.0:106121 11.3 11:c0882b5a:::benchmark_data_smithi097_295476_object106120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e466)", 2021-10-08T19:42:46.952 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:40:31.585698+0000", 2021-10-08T19:42:46.952 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 135.361373238, 2021-10-08T19:42:46.952 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.16877445399999999, 2021-10-08T19:42:46.952 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:46.952 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:46.953 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:42:46.953 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.26125", 2021-10-08T19:42:46.953 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:42:46.953 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 106121 2021-10-08T19:42:46.954 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:46.955 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:46.955 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:46.955 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:46.956 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.585698+0000", 2021-10-08T19:42:46.956 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:46.956 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:46.956 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:46.956 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:46.957 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.585698+0000", 2021-10-08T19:42:46.957 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:46.957 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:46.957 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:46.958 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:46.958 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.585696+0000", 2021-10-08T19:42:46.958 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:42:46.958 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:46.959 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:46.959 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:46.959 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.585727+0000", 2021-10-08T19:42:46.959 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.1656000000000003e-05 2021-10-08T19:42:46.959 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:46.960 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:46.960 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:46.960 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.585740+0000", 2021-10-08T19:42:46.960 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2713e-05 2021-10-08T19:42:46.961 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:46.961 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:46.961 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:46.961 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.585746+0000", 2021-10-08T19:42:46.962 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4579999999999998e-06 2021-10-08T19:42:46.962 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:46.962 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:46.962 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:46.962 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.588039+0000", 2021-10-08T19:42:46.963 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002292405 2021-10-08T19:42:46.963 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:46.963 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:46.963 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:46.964 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.588169+0000", 2021-10-08T19:42:46.964 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013060799999999999 2021-10-08T19:42:46.964 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:46.964 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:46.965 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 1,7", 2021-10-08T19:42:46.965 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.588325+0000", 2021-10-08T19:42:46.965 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015523199999999999 2021-10-08T19:42:46.965 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:46.965 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:46.966 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:42:46.966 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.597658+0000", 2021-10-08T19:42:46.966 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0093330180000000002 2021-10-08T19:42:46.966 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:46.966 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:46.967 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:46.967 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.598826+0000", 2021-10-08T19:42:46.967 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0011684810000000001 2021-10-08T19:42:46.967 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:46.968 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:46.968 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:46.968 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.754390+0000", 2021-10-08T19:42:46.968 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.15556377399999999 2021-10-08T19:42:46.968 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:46.969 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:46.969 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:46.969 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.754437+0000", 2021-10-08T19:42:46.969 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.6749999999999998e-05 2021-10-08T19:42:46.970 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:46.970 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:46.970 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:46.970 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.754473+0000", 2021-10-08T19:42:46.970 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.5979000000000002e-05 2021-10-08T19:42:46.971 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:46.971 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:46.971 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:46.971 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:46.972 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:46.972 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.26125.0:106129 11.3 11:c79fe91e:::benchmark_data_smithi097_295476_object106128:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e466)", 2021-10-08T19:42:46.972 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:40:31.593151+0000", 2021-10-08T19:42:46.972 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 135.35392078800001, 2021-10-08T19:42:46.972 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.16538981799999999, 2021-10-08T19:42:46.973 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:46.973 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:46.973 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:42:46.973 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.26125", 2021-10-08T19:42:46.974 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:42:46.974 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 106129 2021-10-08T19:42:46.974 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:46.974 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:46.974 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:46.975 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:46.975 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.593151+0000", 2021-10-08T19:42:46.975 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:46.975 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:46.975 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:46.976 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:46.976 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.593151+0000", 2021-10-08T19:42:46.976 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:46.976 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:46.977 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:46.977 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:46.977 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.593150+0000", 2021-10-08T19:42:46.977 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:42:46.977 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:46.978 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:46.978 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:46.978 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.593177+0000", 2021-10-08T19:42:46.978 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6968e-05 2021-10-08T19:42:46.979 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:46.979 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:46.979 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:46.979 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.593184+0000", 2021-10-08T19:42:46.979 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1230000000000002e-06 2021-10-08T19:42:46.980 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:46.980 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:46.980 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:46.980 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.593188+0000", 2021-10-08T19:42:46.981 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.6090000000000003e-06 2021-10-08T19:42:46.981 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:46.981 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:46.981 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:46.981 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.593227+0000", 2021-10-08T19:42:46.982 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8439999999999998e-05 2021-10-08T19:42:46.982 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:46.982 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:46.982 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:46.982 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.593363+0000", 2021-10-08T19:42:46.983 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013655699999999999 2021-10-08T19:42:46.983 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:46.983 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:46.983 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 1,7", 2021-10-08T19:42:46.984 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.595428+0000", 2021-10-08T19:42:46.984 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020648329999999999 2021-10-08T19:42:46.984 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:46.984 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:46.984 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:46.985 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.599051+0000", 2021-10-08T19:42:46.985 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003623111 2021-10-08T19:42:46.985 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:46.985 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:46.985 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:42:46.986 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.599815+0000", 2021-10-08T19:42:46.986 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00076394699999999996 2021-10-08T19:42:46.986 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:46.987 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:46.987 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:46.987 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.758431+0000", 2021-10-08T19:42:46.987 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.15861551400000001 2021-10-08T19:42:46.987 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:46.988 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:46.988 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:46.988 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.758498+0000", 2021-10-08T19:42:46.988 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6909999999999995e-05 2021-10-08T19:42:46.989 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:46.989 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:46.989 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:46.989 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:31.758541+0000", 2021-10-08T19:42:46.990 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2789e-05 2021-10-08T19:42:46.990 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:46.991 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:46.991 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:46.991 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:46.991 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:46.992 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.26125.0:131312 11.1 11:83438874:::benchmark_data_smithi097_295476_object17563:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e473)", 2021-10-08T19:42:46.992 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:40:56.432815+0000", 2021-10-08T19:42:46.992 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 110.51425701300001, 2021-10-08T19:42:46.992 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.134158638, 2021-10-08T19:42:46.993 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:46.993 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:46.993 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:42:46.993 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.26125", 2021-10-08T19:42:46.994 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:42:46.994 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 131312 2021-10-08T19:42:46.994 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:46.995 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:46.995 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:46.995 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:46.995 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:56.432815+0000", 2021-10-08T19:42:46.995 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:46.996 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:46.996 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:46.996 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:46.996 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:56.432815+0000", 2021-10-08T19:42:46.997 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:46.997 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:46.997 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:46.997 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:46.998 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:56.432813+0000", 2021-10-08T19:42:46.998 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:42:46.998 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:46.998 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:46.998 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:46.999 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:56.432819+0000", 2021-10-08T19:42:46.999 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2060000000000004e-06 2021-10-08T19:42:46.999 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:46.999 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.000 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:47.000 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:56.432830+0000", 2021-10-08T19:42:47.000 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1472e-05 2021-10-08T19:42:47.000 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.001 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.001 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:47.001 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:56.432837+0000", 2021-10-08T19:42:47.002 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8510000000000001e-06 2021-10-08T19:42:47.002 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.002 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.003 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:47.003 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:56.432882+0000", 2021-10-08T19:42:47.003 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4573000000000002e-05 2021-10-08T19:42:47.003 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.004 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.004 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:47.004 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:56.433009+0000", 2021-10-08T19:42:47.004 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012731799999999999 2021-10-08T19:42:47.005 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.005 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.005 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,3", 2021-10-08T19:42:47.005 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:56.433149+0000", 2021-10-08T19:42:47.006 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000140288 2021-10-08T19:42:47.006 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.006 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.006 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:42:47.006 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:56.439258+0000", 2021-10-08T19:42:47.007 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0061085150000000001 2021-10-08T19:42:47.007 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.007 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.007 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:47.008 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:56.440499+0000", 2021-10-08T19:42:47.008 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012405719999999999 2021-10-08T19:42:47.008 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.008 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.009 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:47.009 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:56.566908+0000", 2021-10-08T19:42:47.009 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.12640926 2021-10-08T19:42:47.009 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.009 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.010 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:47.010 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:56.566945+0000", 2021-10-08T19:42:47.010 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6998000000000001e-05 2021-10-08T19:42:47.010 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.011 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.011 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:47.011 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:40:56.566973+0000", 2021-10-08T19:42:47.011 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8297999999999999e-05 2021-10-08T19:42:47.012 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:47.012 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:47.012 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:47.012 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.013 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.013 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.26125.0:171109 11.1 11:8444d1ba:::benchmark_data_smithi097_295476_object57360:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e482)", 2021-10-08T19:42:47.013 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:41:33.793654+0000", 2021-10-08T19:42:47.013 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 73.153417285000003, 2021-10-08T19:42:47.013 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.17323529600000001, 2021-10-08T19:42:47.014 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:47.014 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:47.014 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:42:47.014 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.26125", 2021-10-08T19:42:47.015 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:42:47.015 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 171109 2021-10-08T19:42:47.015 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.015 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:47.016 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.016 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:47.016 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.793654+0000", 2021-10-08T19:42:47.016 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:47.016 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.017 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.017 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:47.017 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.793654+0000", 2021-10-08T19:42:47.017 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:47.018 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.018 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.018 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:47.018 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.793652+0000", 2021-10-08T19:42:47.019 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:42:47.019 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.019 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.019 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:47.019 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.793658+0000", 2021-10-08T19:42:47.020 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9739999999999999e-06 2021-10-08T19:42:47.020 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.020 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.020 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:47.021 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.793665+0000", 2021-10-08T19:42:47.021 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5220000000000001e-06 2021-10-08T19:42:47.021 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.021 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.021 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:47.022 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.793670+0000", 2021-10-08T19:42:47.022 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.3980000000000001e-06 2021-10-08T19:42:47.022 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.022 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.023 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:47.023 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.828108+0000", 2021-10-08T19:42:47.023 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.034438509999999999 2021-10-08T19:42:47.023 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.023 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.024 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:47.024 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.828181+0000", 2021-10-08T19:42:47.024 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2886000000000007e-05 2021-10-08T19:42:47.024 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.024 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.025 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,3", 2021-10-08T19:42:47.025 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.828262+0000", 2021-10-08T19:42:47.025 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0465999999999998e-05 2021-10-08T19:42:47.025 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.026 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.026 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:42:47.026 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.837280+0000", 2021-10-08T19:42:47.026 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0090184470000000006 2021-10-08T19:42:47.026 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.027 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.027 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:47.027 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.850350+0000", 2021-10-08T19:42:47.027 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013069701 2021-10-08T19:42:47.028 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.028 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.028 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:47.028 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.966826+0000", 2021-10-08T19:42:47.029 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.11647604 2021-10-08T19:42:47.029 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.029 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.029 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:47.030 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.966861+0000", 2021-10-08T19:42:47.030 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4962999999999997e-05 2021-10-08T19:42:47.030 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.030 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.031 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:47.031 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.966890+0000", 2021-10-08T19:42:47.031 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8702000000000001e-05 2021-10-08T19:42:47.031 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:47.031 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:47.032 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:47.032 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.032 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.032 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.26125.0:171136 11.1 11:84a35693:::benchmark_data_smithi097_295476_object57387:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e482)", 2021-10-08T19:42:47.033 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:41:33.814537+0000", 2021-10-08T19:42:47.033 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 73.132534296000003, 2021-10-08T19:42:47.033 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.155905613, 2021-10-08T19:42:47.033 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:47.033 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:47.034 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:42:47.034 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.26125", 2021-10-08T19:42:47.034 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:42:47.034 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 171136 2021-10-08T19:42:47.035 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.035 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:47.035 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.035 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:47.035 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.814537+0000", 2021-10-08T19:42:47.036 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:47.036 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.036 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.036 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:47.036 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.814537+0000", 2021-10-08T19:42:47.037 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:47.037 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.037 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.037 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:47.038 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.814536+0000", 2021-10-08T19:42:47.038 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:42:47.038 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.038 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.039 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:47.039 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.814542+0000", 2021-10-08T19:42:47.039 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8930000000000002e-06 2021-10-08T19:42:47.039 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.040 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.040 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:47.040 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.814556+0000", 2021-10-08T19:42:47.040 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3925e-05 2021-10-08T19:42:47.041 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.041 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.041 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:47.041 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.814562+0000", 2021-10-08T19:42:47.041 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4119999999999998e-06 2021-10-08T19:42:47.042 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.042 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.042 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:47.042 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.830562+0000", 2021-10-08T19:42:47.043 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015999631 2021-10-08T19:42:47.043 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.044 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.044 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:47.044 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.830679+0000", 2021-10-08T19:42:47.044 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000117796 2021-10-08T19:42:47.044 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.045 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.045 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,3", 2021-10-08T19:42:47.045 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.830771+0000", 2021-10-08T19:42:47.045 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.1139999999999998e-05 2021-10-08T19:42:47.046 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.046 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.046 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:42:47.047 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.837286+0000", 2021-10-08T19:42:47.047 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0065150629999999998 2021-10-08T19:42:47.047 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.047 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.048 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:47.048 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.850377+0000", 2021-10-08T19:42:47.048 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013091518999999999 2021-10-08T19:42:47.048 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.049 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.049 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:47.049 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.970354+0000", 2021-10-08T19:42:47.049 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.119977001 2021-10-08T19:42:47.050 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.050 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.050 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:47.050 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.970403+0000", 2021-10-08T19:42:47.050 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8989000000000001e-05 2021-10-08T19:42:47.051 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.051 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.051 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:47.051 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.970443+0000", 2021-10-08T19:42:47.052 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9734999999999998e-05 2021-10-08T19:42:47.052 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:47.052 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:47.052 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:47.052 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.053 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.053 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.26125.0:171146 11.1 11:8a1a4481:::benchmark_data_smithi097_295476_object57397:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e482)", 2021-10-08T19:42:47.053 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:41:33.826224+0000", 2021-10-08T19:42:47.053 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 73.120847026000007, 2021-10-08T19:42:47.054 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.144330866, 2021-10-08T19:42:47.054 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:47.054 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:47.054 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:42:47.055 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.26125", 2021-10-08T19:42:47.055 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:42:47.055 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 171146 2021-10-08T19:42:47.055 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.055 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:47.056 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.056 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:47.056 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.826224+0000", 2021-10-08T19:42:47.056 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:47.057 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.057 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.057 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:47.057 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.826224+0000", 2021-10-08T19:42:47.058 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:47.058 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.058 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.058 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:47.058 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.826223+0000", 2021-10-08T19:42:47.059 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:42:47.059 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.059 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.060 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:47.060 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.826230+0000", 2021-10-08T19:42:47.060 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.9929999999999998e-06 2021-10-08T19:42:47.060 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.060 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.061 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:47.061 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.826240+0000", 2021-10-08T19:42:47.061 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0703000000000001e-05 2021-10-08T19:42:47.061 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.061 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.062 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:47.062 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.826246+0000", 2021-10-08T19:42:47.062 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2280000000000003e-06 2021-10-08T19:42:47.062 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.063 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.063 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:47.063 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.832521+0000", 2021-10-08T19:42:47.063 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0062747740000000003 2021-10-08T19:42:47.064 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.064 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.067 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:47.067 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.832597+0000", 2021-10-08T19:42:47.068 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6139999999999999e-05 2021-10-08T19:42:47.068 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.068 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.068 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,3", 2021-10-08T19:42:47.069 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.832683+0000", 2021-10-08T19:42:47.069 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5594999999999996e-05 2021-10-08T19:42:47.069 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.069 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.070 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:42:47.070 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.837291+0000", 2021-10-08T19:42:47.070 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004608226 2021-10-08T19:42:47.070 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.070 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.071 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:47.071 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.850411+0000", 2021-10-08T19:42:47.071 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013119356 2021-10-08T19:42:47.071 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.071 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.072 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:47.072 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.970483+0000", 2021-10-08T19:42:47.072 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.12007232299999999 2021-10-08T19:42:47.072 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.073 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.073 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:47.073 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.970522+0000", 2021-10-08T19:42:47.073 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8921000000000002e-05 2021-10-08T19:42:47.073 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.074 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.074 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:47.074 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.970555+0000", 2021-10-08T19:42:47.074 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.358e-05 2021-10-08T19:42:47.074 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:47.075 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:47.075 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:47.075 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.075 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.075 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.26125.0:171150 11.1 11:8b097ce6:::benchmark_data_smithi097_295476_object57401:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e482)", 2021-10-08T19:42:47.076 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:41:33.834038+0000", 2021-10-08T19:42:47.076 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 73.113033482999995, 2021-10-08T19:42:47.076 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.13662031499999999, 2021-10-08T19:42:47.076 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:47.077 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:47.077 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:42:47.077 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.26125", 2021-10-08T19:42:47.077 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:42:47.077 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 171150 2021-10-08T19:42:47.078 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.078 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:47.078 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.078 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:47.079 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.834038+0000", 2021-10-08T19:42:47.079 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:47.079 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.079 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.079 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:47.080 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.834038+0000", 2021-10-08T19:42:47.080 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:47.080 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.080 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.080 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:47.081 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.834037+0000", 2021-10-08T19:42:47.081 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:42:47.081 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.081 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.082 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:47.082 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.834042+0000", 2021-10-08T19:42:47.082 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6919999999999999e-06 2021-10-08T19:42:47.082 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.082 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.083 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:47.083 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.834050+0000", 2021-10-08T19:42:47.083 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5900000000000002e-06 2021-10-08T19:42:47.083 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.084 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.084 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:47.084 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.834054+0000", 2021-10-08T19:42:47.084 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0169999999999998e-06 2021-10-08T19:42:47.084 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.085 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.085 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:47.085 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.834939+0000", 2021-10-08T19:42:47.085 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00088544800000000005 2021-10-08T19:42:47.085 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.086 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.086 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:47.086 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.835050+0000", 2021-10-08T19:42:47.086 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000110549 2021-10-08T19:42:47.087 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.087 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.087 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,3", 2021-10-08T19:42:47.087 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.835145+0000", 2021-10-08T19:42:47.087 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.4621000000000001e-05 2021-10-08T19:42:47.088 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.088 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.088 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:42:47.088 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.837496+0000", 2021-10-08T19:42:47.088 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0023513560000000002 2021-10-08T19:42:47.089 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.089 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.089 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:47.089 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.850447+0000", 2021-10-08T19:42:47.090 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012951004 2021-10-08T19:42:47.090 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.090 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.090 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:47.090 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.970585+0000", 2021-10-08T19:42:47.091 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.12013824400000001 2021-10-08T19:42:47.091 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.091 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.091 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:47.092 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.970623+0000", 2021-10-08T19:42:47.092 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7570000000000001e-05 2021-10-08T19:42:47.092 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.092 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.092 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:47.093 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.970658+0000", 2021-10-08T19:42:47.093 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.5652999999999999e-05 2021-10-08T19:42:47.093 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:47.093 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:47.093 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:47.094 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.094 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.094 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.26125.0:171159 11.1 11:8862c561:::benchmark_data_smithi097_295476_object57410:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e482)", 2021-10-08T19:42:47.094 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:41:33.845860+0000", 2021-10-08T19:42:47.095 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 73.101211473000006, 2021-10-08T19:42:47.095 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.129160623, 2021-10-08T19:42:47.095 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:47.095 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:47.095 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:42:47.096 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.26125", 2021-10-08T19:42:47.096 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:42:47.096 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 171159 2021-10-08T19:42:47.096 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.097 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:47.097 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.097 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:47.097 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.845860+0000", 2021-10-08T19:42:47.097 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:47.098 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.098 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.098 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:47.098 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.845860+0000", 2021-10-08T19:42:47.099 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:47.099 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.099 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.099 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:47.099 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.845857+0000", 2021-10-08T19:42:47.100 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999971 2021-10-08T19:42:47.100 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.100 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.100 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:47.100 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.845868+0000", 2021-10-08T19:42:47.101 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1080000000000001e-05 2021-10-08T19:42:47.101 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.101 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.101 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:47.101 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.845883+0000", 2021-10-08T19:42:47.102 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4963999999999999e-05 2021-10-08T19:42:47.102 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.102 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.102 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:47.103 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.845890+0000", 2021-10-08T19:42:47.103 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7449999999999998e-06 2021-10-08T19:42:47.103 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.103 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.103 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:47.104 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.845939+0000", 2021-10-08T19:42:47.104 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8612999999999997e-05 2021-10-08T19:42:47.104 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.104 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.105 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:47.105 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.846082+0000", 2021-10-08T19:42:47.105 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000143449 2021-10-08T19:42:47.105 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.105 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.106 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,3", 2021-10-08T19:42:47.106 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.846244+0000", 2021-10-08T19:42:47.106 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016187299999999999 2021-10-08T19:42:47.106 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.106 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.107 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:42:47.107 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.848922+0000", 2021-10-08T19:42:47.107 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0026779270000000001 2021-10-08T19:42:47.107 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.108 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.108 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:47.108 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.851973+0000", 2021-10-08T19:42:47.108 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0030511269999999998 2021-10-08T19:42:47.108 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.109 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.109 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:47.109 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.974937+0000", 2021-10-08T19:42:47.109 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.12296393999999999 2021-10-08T19:42:47.109 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.110 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.110 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:47.110 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.974977+0000", 2021-10-08T19:42:47.110 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9555999999999999e-05 2021-10-08T19:42:47.111 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.111 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.111 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:47.111 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:33.975021+0000", 2021-10-08T19:42:47.111 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4004000000000001e-05 2021-10-08T19:42:47.112 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:47.112 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:47.112 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:47.112 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.112 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.113 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.26125.0:173649 11.1 11:8ea92f22:::benchmark_data_smithi097_295476_object59900:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e482)", 2021-10-08T19:42:47.113 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:41:36.833326+0000", 2021-10-08T19:42:47.113 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 70.113745836999996, 2021-10-08T19:42:47.113 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.141430368, 2021-10-08T19:42:47.114 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:47.114 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:47.114 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:42:47.114 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.26125", 2021-10-08T19:42:47.114 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:42:47.115 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 173649 2021-10-08T19:42:47.115 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.115 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:47.115 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.115 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:47.116 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:36.833326+0000", 2021-10-08T19:42:47.116 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:47.116 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.116 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.117 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:47.117 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:36.833326+0000", 2021-10-08T19:42:47.117 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:47.117 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.117 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.118 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:47.118 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:36.833324+0000", 2021-10-08T19:42:47.118 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:42:47.118 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.118 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.119 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:47.119 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:36.833330+0000", 2021-10-08T19:42:47.119 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9109999999999998e-06 2021-10-08T19:42:47.119 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.120 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.120 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:47.120 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:36.833358+0000", 2021-10-08T19:42:47.120 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8186000000000001e-05 2021-10-08T19:42:47.120 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.121 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.121 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:47.121 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:36.833363+0000", 2021-10-08T19:42:47.121 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.78e-06 2021-10-08T19:42:47.121 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.122 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.122 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:47.122 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:36.833415+0000", 2021-10-08T19:42:47.122 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2138000000000001e-05 2021-10-08T19:42:47.122 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.123 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.123 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:47.123 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:36.833544+0000", 2021-10-08T19:42:47.123 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012934200000000001 2021-10-08T19:42:47.124 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.124 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.124 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,3", 2021-10-08T19:42:47.124 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:36.833678+0000", 2021-10-08T19:42:47.124 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013384099999999999 2021-10-08T19:42:47.125 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.125 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.125 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:42:47.125 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:36.836279+0000", 2021-10-08T19:42:47.126 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0026011179999999999 2021-10-08T19:42:47.126 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.126 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.126 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:47.126 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:36.858112+0000", 2021-10-08T19:42:47.127 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.021833047000000001 2021-10-08T19:42:47.127 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.127 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.127 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:47.127 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:36.974681+0000", 2021-10-08T19:42:47.128 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.116568203 2021-10-08T19:42:47.128 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.128 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.128 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:47.129 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:36.974718+0000", 2021-10-08T19:42:47.129 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7079999999999997e-05 2021-10-08T19:42:47.129 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.129 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.129 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:47.130 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:36.974756+0000", 2021-10-08T19:42:47.130 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8374999999999998e-05 2021-10-08T19:42:47.130 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:47.130 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:47.131 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:47.131 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.131 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.131 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.26125.0:173664 11.1 11:81319967:::benchmark_data_smithi097_295476_object59915:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e482)", 2021-10-08T19:42:47.131 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:41:36.848607+0000", 2021-10-08T19:42:47.132 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 70.098464527999994, 2021-10-08T19:42:47.132 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.16613350299999999, 2021-10-08T19:42:47.132 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:47.132 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:47.133 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:42:47.133 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.26125", 2021-10-08T19:42:47.133 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:42:47.133 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 173664 2021-10-08T19:42:47.133 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.134 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:47.134 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.134 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:47.134 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:36.848607+0000", 2021-10-08T19:42:47.134 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:47.135 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.135 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.135 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:47.135 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:36.848607+0000", 2021-10-08T19:42:47.135 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:47.136 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.136 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.136 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:47.136 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:36.848605+0000", 2021-10-08T19:42:47.137 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:42:47.137 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.137 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.137 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:47.137 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:36.848612+0000", 2021-10-08T19:42:47.138 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3159999999999999e-06 2021-10-08T19:42:47.138 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.138 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.138 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:47.139 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:36.848622+0000", 2021-10-08T19:42:47.139 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0414000000000001e-05 2021-10-08T19:42:47.139 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.139 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.139 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:47.140 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:36.848629+0000", 2021-10-08T19:42:47.140 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1069999999999999e-06 2021-10-08T19:42:47.140 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.140 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.140 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:47.141 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:36.851693+0000", 2021-10-08T19:42:47.141 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00306354 2021-10-08T19:42:47.141 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.141 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.141 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:47.142 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:36.851813+0000", 2021-10-08T19:42:47.142 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012028600000000001 2021-10-08T19:42:47.142 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.142 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.143 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,3", 2021-10-08T19:42:47.143 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:36.852225+0000", 2021-10-08T19:42:47.143 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00041188599999999998 2021-10-08T19:42:47.143 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.143 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.144 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:42:47.144 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:36.854905+0000", 2021-10-08T19:42:47.144 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0026794919999999999 2021-10-08T19:42:47.144 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.145 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.145 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:47.145 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:36.860688+0000", 2021-10-08T19:42:47.145 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0057831860000000001 2021-10-08T19:42:47.145 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.146 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.146 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:47.146 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:37.014666+0000", 2021-10-08T19:42:47.146 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.153978262 2021-10-08T19:42:47.146 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.147 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.147 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:47.147 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:37.014715+0000", 2021-10-08T19:42:47.147 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9085000000000002e-05 2021-10-08T19:42:47.147 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.148 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.148 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:47.148 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:37.014740+0000", 2021-10-08T19:42:47.148 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5380000000000001e-05 2021-10-08T19:42:47.149 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:47.149 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:47.149 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:47.149 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.149 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.150 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.26125.0:173672 11.1 11:8e970ecd:::benchmark_data_smithi097_295476_object59923:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e482)", 2021-10-08T19:42:47.150 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:41:36.863417+0000", 2021-10-08T19:42:47.150 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 70.083654456000005, 2021-10-08T19:42:47.150 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.151525619, 2021-10-08T19:42:47.150 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:47.151 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:47.151 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:42:47.151 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.26125", 2021-10-08T19:42:47.151 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:42:47.152 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 173672 2021-10-08T19:42:47.152 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.152 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:47.152 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.152 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:47.153 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:36.863417+0000", 2021-10-08T19:42:47.153 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:47.153 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.153 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.154 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:47.154 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:36.863417+0000", 2021-10-08T19:42:47.154 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:47.154 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.154 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.155 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:47.155 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:36.863415+0000", 2021-10-08T19:42:47.155 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:42:47.155 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.155 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.156 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:47.156 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:36.863422+0000", 2021-10-08T19:42:47.156 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8480000000000003e-06 2021-10-08T19:42:47.156 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.156 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.157 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:47.157 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:36.863434+0000", 2021-10-08T19:42:47.157 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1802e-05 2021-10-08T19:42:47.157 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.158 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.158 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:47.158 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:36.863438+0000", 2021-10-08T19:42:47.159 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.6179999999999997e-06 2021-10-08T19:42:47.159 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.159 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.160 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:47.160 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:36.863500+0000", 2021-10-08T19:42:47.160 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1691000000000003e-05 2021-10-08T19:42:47.160 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.160 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.161 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:47.161 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:36.863601+0000", 2021-10-08T19:42:47.161 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010103 2021-10-08T19:42:47.161 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.162 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.162 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,3", 2021-10-08T19:42:47.162 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:36.863688+0000", 2021-10-08T19:42:47.162 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6874999999999997e-05 2021-10-08T19:42:47.162 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.163 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.163 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:42:47.163 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:36.865578+0000", 2021-10-08T19:42:47.163 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001890269 2021-10-08T19:42:47.164 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.164 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.164 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:47.164 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:36.865984+0000", 2021-10-08T19:42:47.164 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00040530900000000002 2021-10-08T19:42:47.165 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.165 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.165 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:47.165 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:37.014862+0000", 2021-10-08T19:42:47.165 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.14887795000000001 2021-10-08T19:42:47.166 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.166 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.166 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:47.166 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:37.014904+0000", 2021-10-08T19:42:47.167 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2759999999999997e-05 2021-10-08T19:42:47.167 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.167 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.167 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:47.167 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:37.014943+0000", 2021-10-08T19:42:47.168 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8399000000000003e-05 2021-10-08T19:42:47.168 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:47.168 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:47.168 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:47.168 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.169 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.169 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.26125.0:193218 11.1 11:8fa765d7:::benchmark_data_smithi097_295476_object79469:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e486)", 2021-10-08T19:42:47.169 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:41:55.848769+0000", 2021-10-08T19:42:47.169 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 51.098302631999999, 2021-10-08T19:42:47.170 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.12836035100000001, 2021-10-08T19:42:47.170 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:47.170 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:47.170 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:42:47.170 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.26125", 2021-10-08T19:42:47.171 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:42:47.171 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 193218 2021-10-08T19:42:47.171 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.171 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:47.172 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.172 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:47.172 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:55.848769+0000", 2021-10-08T19:42:47.172 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:47.172 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.173 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.173 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:47.173 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:55.848769+0000", 2021-10-08T19:42:47.173 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:47.173 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.174 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.174 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:47.174 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:55.848768+0000", 2021-10-08T19:42:47.174 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999995 2021-10-08T19:42:47.175 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.175 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.175 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:47.175 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:55.848771+0000", 2021-10-08T19:42:47.175 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8289999999999999e-06 2021-10-08T19:42:47.176 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.176 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.176 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:47.176 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:55.848776+0000", 2021-10-08T19:42:47.176 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0409999999999997e-06 2021-10-08T19:42:47.177 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.177 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.177 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:47.177 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:55.848780+0000", 2021-10-08T19:42:47.177 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8800000000000001e-06 2021-10-08T19:42:47.178 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.178 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.178 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:47.178 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:55.848814+0000", 2021-10-08T19:42:47.179 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.3711000000000003e-05 2021-10-08T19:42:47.179 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.179 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.179 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:47.179 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:55.851442+0000", 2021-10-08T19:42:47.180 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0026287319999999999 2021-10-08T19:42:47.180 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.180 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.180 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,3", 2021-10-08T19:42:47.180 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:55.851577+0000", 2021-10-08T19:42:47.181 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000135043 2021-10-08T19:42:47.181 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.181 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.181 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:42:47.182 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:55.853928+0000", 2021-10-08T19:42:47.182 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0023501049999999999 2021-10-08T19:42:47.182 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.182 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.182 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:47.183 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:55.859534+0000", 2021-10-08T19:42:47.183 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0056066129999999999 2021-10-08T19:42:47.183 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.183 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.183 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:47.184 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:55.977024+0000", 2021-10-08T19:42:47.184 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.11748974199999999 2021-10-08T19:42:47.184 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.184 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.185 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:47.185 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:55.977074+0000", 2021-10-08T19:42:47.185 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0423000000000002e-05 2021-10-08T19:42:47.185 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.185 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.186 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:47.186 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:41:55.977129+0000", 2021-10-08T19:42:47.186 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4914999999999999e-05 2021-10-08T19:42:47.186 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:47.186 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:47.187 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:47.187 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.187 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.187 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.26125.0:220116 11.1 11:889a9316:::benchmark_data_smithi097_295476_object106367:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e493)", 2021-10-08T19:42:47.187 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:42:21.488570+0000", 2021-10-08T19:42:47.188 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 25.458501496, 2021-10-08T19:42:47.188 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.149580033, 2021-10-08T19:42:47.188 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:47.188 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:47.189 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:42:47.189 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.26125", 2021-10-08T19:42:47.189 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:42:47.189 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 220116 2021-10-08T19:42:47.189 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.190 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:47.190 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.190 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:47.190 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:21.488570+0000", 2021-10-08T19:42:47.191 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:47.191 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.191 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.191 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:47.191 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:21.488570+0000", 2021-10-08T19:42:47.192 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:47.192 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.192 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.192 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:47.192 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:21.488569+0000", 2021-10-08T19:42:47.193 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:42:47.193 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.193 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.193 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:47.193 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:21.488573+0000", 2021-10-08T19:42:47.194 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9509999999999999e-06 2021-10-08T19:42:47.194 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.194 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.194 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:47.194 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:21.488579+0000", 2021-10-08T19:42:47.195 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3260000000000001e-06 2021-10-08T19:42:47.195 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.195 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.195 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:47.196 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:21.488584+0000", 2021-10-08T19:42:47.196 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0579999999999999e-06 2021-10-08T19:42:47.196 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.196 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.196 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:47.197 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:21.488627+0000", 2021-10-08T19:42:47.197 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.3293e-05 2021-10-08T19:42:47.197 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.197 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.197 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:47.198 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:21.488747+0000", 2021-10-08T19:42:47.198 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000120531 2021-10-08T19:42:47.198 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.198 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.198 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,3", 2021-10-08T19:42:47.199 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:21.488860+0000", 2021-10-08T19:42:47.199 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011272700000000001 2021-10-08T19:42:47.199 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.199 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.200 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:42:47.200 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:21.494123+0000", 2021-10-08T19:42:47.200 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0052632540000000002 2021-10-08T19:42:47.200 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.201 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.201 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:47.201 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:21.494695+0000", 2021-10-08T19:42:47.201 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00057186300000000004 2021-10-08T19:42:47.201 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.202 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.202 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:47.202 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:21.638073+0000", 2021-10-08T19:42:47.202 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.14337820100000001 2021-10-08T19:42:47.203 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.203 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.203 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:47.203 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:21.638109+0000", 2021-10-08T19:42:47.203 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6003000000000001e-05 2021-10-08T19:42:47.204 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.204 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.204 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:47.204 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:21.638150+0000", 2021-10-08T19:42:47.204 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0676000000000002e-05 2021-10-08T19:42:47.205 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:47.205 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:47.205 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:47.205 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.205 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.206 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.26125.0:220136 11.1 11:8ee7c1d2:::benchmark_data_smithi097_295476_object106387:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e493)", 2021-10-08T19:42:47.206 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:42:21.505889+0000", 2021-10-08T19:42:47.206 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 25.441182253000001, 2021-10-08T19:42:47.206 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.13374602299999999, 2021-10-08T19:42:47.207 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:47.207 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:47.207 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:42:47.207 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.26125", 2021-10-08T19:42:47.208 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:42:47.208 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 220136 2021-10-08T19:42:47.208 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.208 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:47.208 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.209 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:47.209 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:21.505889+0000", 2021-10-08T19:42:47.209 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:47.209 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.209 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.210 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:47.210 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:21.505889+0000", 2021-10-08T19:42:47.210 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:47.211 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.211 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.211 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:47.211 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:21.505887+0000", 2021-10-08T19:42:47.212 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:42:47.212 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.212 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.212 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:47.212 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:21.505894+0000", 2021-10-08T19:42:47.213 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6520000000000006e-06 2021-10-08T19:42:47.213 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.213 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.213 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:47.214 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:21.505904+0000", 2021-10-08T19:42:47.214 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6239999999999997e-06 2021-10-08T19:42:47.214 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.214 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.214 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:47.215 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:21.505909+0000", 2021-10-08T19:42:47.215 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8369999999999996e-06 2021-10-08T19:42:47.215 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.215 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.215 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:47.216 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:21.505952+0000", 2021-10-08T19:42:47.216 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2787000000000002e-05 2021-10-08T19:42:47.216 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.216 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.217 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:47.217 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:21.506029+0000", 2021-10-08T19:42:47.217 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6957000000000002e-05 2021-10-08T19:42:47.217 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.217 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.218 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,3", 2021-10-08T19:42:47.218 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:21.506098+0000", 2021-10-08T19:42:47.218 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.9751000000000004e-05 2021-10-08T19:42:47.218 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.218 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.219 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:42:47.219 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:21.508076+0000", 2021-10-08T19:42:47.219 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0019776799999999999 2021-10-08T19:42:47.219 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.220 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.221 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:47.221 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:21.510290+0000", 2021-10-08T19:42:47.221 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022134770000000002 2021-10-08T19:42:47.222 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.222 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.222 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:47.222 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:21.639547+0000", 2021-10-08T19:42:47.222 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.12925698399999999 2021-10-08T19:42:47.223 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.223 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.223 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:47.223 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:21.639597+0000", 2021-10-08T19:42:47.224 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0283e-05 2021-10-08T19:42:47.224 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.224 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.224 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:47.224 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:21.639635+0000", 2021-10-08T19:42:47.225 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8438e-05 2021-10-08T19:42:47.225 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:47.225 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:47.225 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:47.226 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.226 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.226 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.26125.0:220139 11.1 11:82b3e932:::benchmark_data_smithi097_295476_object106390:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e493)", 2021-10-08T19:42:47.226 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:42:21.508165+0000", 2021-10-08T19:42:47.227 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 25.438906296999999, 2021-10-08T19:42:47.227 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.133132321, 2021-10-08T19:42:47.227 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:47.227 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:47.227 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:42:47.228 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.26125", 2021-10-08T19:42:47.228 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:42:47.228 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 220139 2021-10-08T19:42:47.228 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.228 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:47.229 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.229 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:47.229 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:21.508165+0000", 2021-10-08T19:42:47.229 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:47.230 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.230 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.230 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:47.231 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:21.508165+0000", 2021-10-08T19:42:47.231 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:47.232 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.232 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.235 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:47.235 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:21.508163+0000", 2021-10-08T19:42:47.235 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:42:47.236 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.236 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.236 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:47.237 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:21.508170+0000", 2021-10-08T19:42:47.237 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.72e-06 2021-10-08T19:42:47.237 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.237 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.237 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:47.238 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:21.508181+0000", 2021-10-08T19:42:47.238 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0519999999999999e-05 2021-10-08T19:42:47.238 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.243 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.244 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:47.385 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:21.508188+0000", 2021-10-08T19:42:47.385 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.9009999999999997e-06 2021-10-08T19:42:47.385 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.385 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.386 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:47.386 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:21.508250+0000", 2021-10-08T19:42:47.386 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2315000000000002e-05 2021-10-08T19:42:47.386 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.387 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.387 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:47.387 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:21.508375+0000", 2021-10-08T19:42:47.387 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012515200000000001 2021-10-08T19:42:47.388 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.388 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.388 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,3", 2021-10-08T19:42:47.389 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:21.508519+0000", 2021-10-08T19:42:47.389 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014387100000000001 2021-10-08T19:42:47.389 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.389 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.389 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:42:47.390 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:21.510466+0000", 2021-10-08T19:42:47.390 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001946576 2021-10-08T19:42:47.390 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.390 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.391 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:47.391 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:21.511437+0000", 2021-10-08T19:42:47.391 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000971739 2021-10-08T19:42:47.392 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.392 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.392 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:47.392 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:21.641208+0000", 2021-10-08T19:42:47.393 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.129771001 2021-10-08T19:42:47.393 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.393 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.393 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:47.393 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:21.641257+0000", 2021-10-08T19:42:47.394 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8560000000000003e-05 2021-10-08T19:42:47.394 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.394 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.394 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:47.394 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:21.641298+0000", 2021-10-08T19:42:47.395 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0688000000000001e-05 2021-10-08T19:42:47.395 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:47.395 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:47.395 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:47.396 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.396 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.396 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.26125.0:220147 11.1 11:8a87a3f1:::benchmark_data_smithi097_295476_object106398:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e493)", 2021-10-08T19:42:47.396 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:42:21.517298+0000", 2021-10-08T19:42:47.396 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 25.429773037, 2021-10-08T19:42:47.397 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.128638215, 2021-10-08T19:42:47.397 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:47.397 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:47.397 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:42:47.398 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.26125", 2021-10-08T19:42:47.398 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:42:47.398 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 220147 2021-10-08T19:42:47.398 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.399 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:47.399 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.399 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:47.400 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:21.517298+0000", 2021-10-08T19:42:47.400 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:47.400 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.400 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.401 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:47.401 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:21.517298+0000", 2021-10-08T19:42:47.401 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:47.401 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.401 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.402 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:47.402 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:21.517297+0000", 2021-10-08T19:42:47.402 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:42:47.402 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.403 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.403 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:47.403 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:21.517302+0000", 2021-10-08T19:42:47.404 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.6070000000000001e-06 2021-10-08T19:42:47.404 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.405 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.405 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:47.405 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:21.517311+0000", 2021-10-08T19:42:47.405 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.4739999999999994e-06 2021-10-08T19:42:47.406 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.406 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.407 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:47.407 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:21.517321+0000", 2021-10-08T19:42:47.407 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0061000000000001e-05 2021-10-08T19:42:47.407 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.408 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.408 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:47.408 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:21.517355+0000", 2021-10-08T19:42:47.408 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.3157000000000001e-05 2021-10-08T19:42:47.408 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.409 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.409 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:47.409 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:21.517440+0000", 2021-10-08T19:42:47.409 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5234000000000004e-05 2021-10-08T19:42:47.410 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.410 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.410 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,3", 2021-10-08T19:42:47.410 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:21.517524+0000", 2021-10-08T19:42:47.411 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3770000000000006e-05 2021-10-08T19:42:47.411 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.411 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.411 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:42:47.412 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:21.519199+0000", 2021-10-08T19:42:47.412 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001675974 2021-10-08T19:42:47.412 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.412 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.412 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:47.413 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:21.520109+0000", 2021-10-08T19:42:47.413 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00090940200000000002 2021-10-08T19:42:47.413 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.413 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.413 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:47.414 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:21.645853+0000", 2021-10-08T19:42:47.414 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.12574418000000001 2021-10-08T19:42:47.414 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.414 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.415 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:47.415 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:21.645899+0000", 2021-10-08T19:42:47.415 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5759e-05 2021-10-08T19:42:47.415 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.415 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.416 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:47.416 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:21.645937+0000", 2021-10-08T19:42:47.416 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7868999999999999e-05 2021-10-08T19:42:47.417 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:47.417 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:47.417 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:47.418 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.418 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.418 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.26125.0:223335 11.1 11:82ba5172:::benchmark_data_smithi097_295476_object109586:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e494)", 2021-10-08T19:42:47.418 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:42:24.540407+0000", 2021-10-08T19:42:47.418 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 22.406664059000001, 2021-10-08T19:42:47.419 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.227921545, 2021-10-08T19:42:47.419 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:47.419 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:47.420 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:42:47.420 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.26125", 2021-10-08T19:42:47.420 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:42:47.421 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 223335 2021-10-08T19:42:47.421 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.421 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:47.421 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.421 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:47.422 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.540407+0000", 2021-10-08T19:42:47.422 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:47.422 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.423 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.423 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:47.424 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.540407+0000", 2021-10-08T19:42:47.424 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:47.424 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.425 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.425 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:47.426 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.540406+0000", 2021-10-08T19:42:47.426 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:42:47.426 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.427 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.427 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:47.427 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.540414+0000", 2021-10-08T19:42:47.428 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8339999999999999e-06 2021-10-08T19:42:47.428 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.428 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.428 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:47.429 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.540425+0000", 2021-10-08T19:42:47.429 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0789e-05 2021-10-08T19:42:47.429 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.429 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.430 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:47.430 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.540430+0000", 2021-10-08T19:42:47.430 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.789e-06 2021-10-08T19:42:47.430 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.431 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.431 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:47.431 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.540487+0000", 2021-10-08T19:42:47.432 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6708e-05 2021-10-08T19:42:47.432 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.432 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.432 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:47.432 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.540635+0000", 2021-10-08T19:42:47.433 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014791500000000001 2021-10-08T19:42:47.433 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.433 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.433 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,3", 2021-10-08T19:42:47.433 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.540793+0000", 2021-10-08T19:42:47.434 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015798599999999999 2021-10-08T19:42:47.434 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.434 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.434 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:42:47.435 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.544651+0000", 2021-10-08T19:42:47.435 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003858373 2021-10-08T19:42:47.435 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.435 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.435 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:47.436 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.547478+0000", 2021-10-08T19:42:47.436 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028270330000000001 2021-10-08T19:42:47.436 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.436 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.436 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:47.437 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.768244+0000", 2021-10-08T19:42:47.437 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.220765511 2021-10-08T19:42:47.437 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.437 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.437 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:47.438 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.768286+0000", 2021-10-08T19:42:47.438 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2490000000000001e-05 2021-10-08T19:42:47.438 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.438 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.439 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:47.439 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.768329+0000", 2021-10-08T19:42:47.439 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2605999999999998e-05 2021-10-08T19:42:47.439 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:47.439 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:47.440 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:47.440 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.440 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.440 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.26125.0:223346 11.1 11:893203e5:::benchmark_data_smithi097_295476_object109597:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e494)", 2021-10-08T19:42:47.440 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:42:24.550269+0000", 2021-10-08T19:42:47.441 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 22.396802798, 2021-10-08T19:42:47.441 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.231920455, 2021-10-08T19:42:47.441 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:47.441 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:47.441 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:42:47.442 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.26125", 2021-10-08T19:42:47.442 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:42:47.442 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 223346 2021-10-08T19:42:47.442 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.442 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:47.443 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.443 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:47.443 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.550269+0000", 2021-10-08T19:42:47.443 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:47.443 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.444 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.444 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:47.444 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.550269+0000", 2021-10-08T19:42:47.445 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:47.445 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.445 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.445 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:47.446 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.550267+0000", 2021-10-08T19:42:47.446 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:42:47.446 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.446 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.446 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:47.447 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.550273+0000", 2021-10-08T19:42:47.447 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.725e-06 2021-10-08T19:42:47.447 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.447 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.447 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:47.448 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.550286+0000", 2021-10-08T19:42:47.448 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3071000000000001e-05 2021-10-08T19:42:47.448 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.448 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.448 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:47.449 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.550293+0000", 2021-10-08T19:42:47.449 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.64e-06 2021-10-08T19:42:47.449 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.449 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.449 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:47.450 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.550340+0000", 2021-10-08T19:42:47.450 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7298e-05 2021-10-08T19:42:47.450 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.450 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.450 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:47.451 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.550477+0000", 2021-10-08T19:42:47.451 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013680699999999999 2021-10-08T19:42:47.451 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.451 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.452 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,3", 2021-10-08T19:42:47.452 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.550588+0000", 2021-10-08T19:42:47.452 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011126 2021-10-08T19:42:47.452 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.452 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.453 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:42:47.453 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.552405+0000", 2021-10-08T19:42:47.453 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001816752 2021-10-08T19:42:47.453 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.453 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.454 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:47.454 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.553901+0000", 2021-10-08T19:42:47.454 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001495728 2021-10-08T19:42:47.454 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.455 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.455 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:47.455 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.782099+0000", 2021-10-08T19:42:47.455 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.22819756399999999 2021-10-08T19:42:47.456 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.456 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.456 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:47.456 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.782148+0000", 2021-10-08T19:42:47.456 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9568999999999999e-05 2021-10-08T19:42:47.457 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.457 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.457 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:47.457 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.782189+0000", 2021-10-08T19:42:47.457 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1099000000000001e-05 2021-10-08T19:42:47.458 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:47.458 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:47.458 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:47.458 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.458 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.459 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.26125.0:223350 11.1 11:8b95b51a:::benchmark_data_smithi097_295476_object109601:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e494)", 2021-10-08T19:42:47.459 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:42:24.554095+0000", 2021-10-08T19:42:47.459 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 22.392976784999998, 2021-10-08T19:42:47.459 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.22821904600000001, 2021-10-08T19:42:47.460 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:47.460 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:47.460 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:42:47.460 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.26125", 2021-10-08T19:42:47.460 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:42:47.461 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 223350 2021-10-08T19:42:47.461 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.461 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:47.461 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.461 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:47.462 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.554095+0000", 2021-10-08T19:42:47.462 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:47.462 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.462 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.462 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:47.463 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.554095+0000", 2021-10-08T19:42:47.463 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:47.463 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.463 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.464 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:47.464 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.554093+0000", 2021-10-08T19:42:47.464 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:42:47.464 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.464 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.465 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:47.465 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.554100+0000", 2021-10-08T19:42:47.465 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8539999999999999e-06 2021-10-08T19:42:47.465 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.466 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.467 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:47.467 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.554116+0000", 2021-10-08T19:42:47.468 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6447e-05 2021-10-08T19:42:47.468 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.468 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.468 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:47.469 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.554123+0000", 2021-10-08T19:42:47.469 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1489999999999997e-06 2021-10-08T19:42:47.469 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.470 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.470 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:47.470 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.554170+0000", 2021-10-08T19:42:47.470 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.6947000000000003e-05 2021-10-08T19:42:47.470 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.471 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.471 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:47.471 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.554297+0000", 2021-10-08T19:42:47.471 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012617800000000001 2021-10-08T19:42:47.471 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.472 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.472 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,3", 2021-10-08T19:42:47.472 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.554433+0000", 2021-10-08T19:42:47.473 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013643699999999999 2021-10-08T19:42:47.473 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.473 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.473 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:42:47.474 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.557999+0000", 2021-10-08T19:42:47.475 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00356588 2021-10-08T19:42:47.475 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.475 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.475 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:47.475 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.558940+0000", 2021-10-08T19:42:47.476 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00094078200000000003 2021-10-08T19:42:47.476 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.476 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.476 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:47.477 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.782237+0000", 2021-10-08T19:42:47.477 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.22329719000000001 2021-10-08T19:42:47.477 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.477 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.477 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:47.478 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.782280+0000", 2021-10-08T19:42:47.478 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2781000000000003e-05 2021-10-08T19:42:47.478 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.478 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.478 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:47.479 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.782314+0000", 2021-10-08T19:42:47.479 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4173e-05 2021-10-08T19:42:47.479 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:47.479 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:47.479 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:47.480 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.480 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.480 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.26125.0:223353 11.1 11:81d2c061:::benchmark_data_smithi097_295476_object109604:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e494)", 2021-10-08T19:42:47.480 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:42:24.554362+0000", 2021-10-08T19:42:47.481 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 22.392709994000001, 2021-10-08T19:42:47.481 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.228049788, 2021-10-08T19:42:47.481 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:47.481 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:47.481 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:42:47.482 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.26125", 2021-10-08T19:42:47.482 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:42:47.482 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 223353 2021-10-08T19:42:47.482 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.483 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:47.483 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.484 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:47.484 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.554362+0000", 2021-10-08T19:42:47.485 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:47.486 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.486 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.486 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:47.487 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.554362+0000", 2021-10-08T19:42:47.487 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:47.487 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.487 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.487 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:47.488 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.554360+0000", 2021-10-08T19:42:47.488 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:42:47.489 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.489 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.489 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:47.490 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.554368+0000", 2021-10-08T19:42:47.490 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3690000000000001e-06 2021-10-08T19:42:47.491 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.491 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.491 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:47.491 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.554375+0000", 2021-10-08T19:42:47.492 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0439999999999998e-06 2021-10-08T19:42:47.492 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.492 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.492 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:47.492 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.554379+0000", 2021-10-08T19:42:47.493 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1080000000000003e-06 2021-10-08T19:42:47.493 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.493 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.493 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:47.494 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.556414+0000", 2021-10-08T19:42:47.494 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020352259999999998 2021-10-08T19:42:47.494 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.494 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.495 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:47.495 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.556504+0000", 2021-10-08T19:42:47.495 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9709000000000005e-05 2021-10-08T19:42:47.495 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.495 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.496 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,3", 2021-10-08T19:42:47.496 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.556581+0000", 2021-10-08T19:42:47.496 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.7386999999999996e-05 2021-10-08T19:42:47.496 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.497 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.497 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:42:47.497 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.558082+0000", 2021-10-08T19:42:47.497 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0015006570000000001 2021-10-08T19:42:47.497 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.498 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.498 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:47.498 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.558993+0000", 2021-10-08T19:42:47.498 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00091105899999999998 2021-10-08T19:42:47.499 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.499 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.499 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:47.499 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.782345+0000", 2021-10-08T19:42:47.499 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.22335199 2021-10-08T19:42:47.500 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.501 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.501 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:47.501 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.782380+0000", 2021-10-08T19:42:47.501 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.5485999999999999e-05 2021-10-08T19:42:47.502 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:47.502 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:47.502 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:47.502 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.782411+0000", 2021-10-08T19:42:47.503 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.1012000000000001e-05 2021-10-08T19:42:47.503 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:47.503 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:47.503 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:47.503 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:47.504 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:47.504 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:42:47.505 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:47 smithi097 ceph-mon[32687]: 4.1f scrub ok 2021-10-08T19:42:47.505 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:47 smithi097 ceph-mon[32687]: 6.12 deep-scrub ok 2021-10-08T19:42:47.505 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:47 smithi097 ceph-mon[32687]: 2.1f scrub ok 2021-10-08T19:42:47.506 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:47 smithi117 ceph-mon[34585]: 4.1f scrub ok 2021-10-08T19:42:47.506 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:47 smithi117 ceph-mon[34585]: 6.12 deep-scrub ok 2021-10-08T19:42:47.506 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:47 smithi117 ceph-mon[34585]: 2.1f scrub ok 2021-10-08T19:42:47.507 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:47 smithi097 ceph-mon[41966]: 4.1f scrub ok 2021-10-08T19:42:47.507 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:47 smithi097 ceph-mon[41966]: 6.12 deep-scrub ok 2021-10-08T19:42:47.507 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:47 smithi097 ceph-mon[41966]: 2.1f scrub ok 2021-10-08T19:42:47.542 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2021-10-08T19:42:47.813 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:42:47.874 INFO:tasks.thrashosds.thrasher:fixing pg num pool iscsi 2021-10-08T19:42:47.874 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd pool set iscsi pgp_num 23 2021-10-08T19:42:47.905 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:42:47 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:42:48.165 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:42:48.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:48 smithi097 ceph-mon[32687]: 3.d scrub ok 2021-10-08T19:42:48.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:48 smithi097 ceph-mon[32687]: pgmap v1064: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:42:48.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:48 smithi097 ceph-mon[32687]: 6.14 scrub ok 2021-10-08T19:42:48.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:48 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:42:48.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:48 smithi097 ceph-mon[41966]: 3.d scrub ok 2021-10-08T19:42:48.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:48 smithi097 ceph-mon[41966]: pgmap v1064: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:42:48.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:48 smithi097 ceph-mon[41966]: 6.14 scrub ok 2021-10-08T19:42:48.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:48 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:42:48.370 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:48 smithi117 ceph-mon[34585]: 3.d scrub ok 2021-10-08T19:42:48.371 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:48 smithi117 ceph-mon[34585]: pgmap v1064: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:42:48.371 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:48 smithi117 ceph-mon[34585]: 6.14 scrub ok 2021-10-08T19:42:48.371 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:48 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:42:49.373 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:42:49.373 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2021-10-08T19:42:49.373 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2021-10-08T19:42:49.374 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:42:49.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:49 smithi117 ceph-mon[34585]: 4.6 scrub ok 2021-10-08T19:42:49.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:49 smithi117 ceph-mon[34585]: 5.1b scrub ok 2021-10-08T19:42:49.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:49 smithi097 ceph-mon[41966]: 4.6 scrub ok 2021-10-08T19:42:49.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:49 smithi097 ceph-mon[41966]: 5.1b scrub ok 2021-10-08T19:42:49.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:49 smithi097 ceph-mon[32687]: 4.6 scrub ok 2021-10-08T19:42:49.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:49 smithi097 ceph-mon[32687]: 5.1b scrub ok 2021-10-08T19:42:49.966 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2021-10-08T19:42:50.166 INFO:teuthology.orchestra.run.smithi097.stderr:set pool 3 pgp_num to 23 2021-10-08T19:42:50.237 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:42:50.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:50 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:42:50.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:50 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:42:50.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:50 smithi117 ceph-mon[34585]: pgmap v1065: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 739 B/s rd, 0 op/s 2021-10-08T19:42:50.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:50 smithi117 ceph-mon[34585]: osdmap e503: 8 total, 8 up, 8 in 2021-10-08T19:42:50.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:50 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2056008133' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "iscsi", "var": "pgp_num", "val": "23"}]: dispatch 2021-10-08T19:42:50.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:50 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:42:50.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:50 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:42:50.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:50 smithi097 ceph-mon[32687]: pgmap v1065: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 739 B/s rd, 0 op/s 2021-10-08T19:42:50.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:50 smithi097 ceph-mon[32687]: osdmap e503: 8 total, 8 up, 8 in 2021-10-08T19:42:50.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:50 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2056008133' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "iscsi", "var": "pgp_num", "val": "23"}]: dispatch 2021-10-08T19:42:50.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:50 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:42:50.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:50 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:42:50.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:50 smithi097 ceph-mon[41966]: pgmap v1065: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 739 B/s rd, 0 op/s 2021-10-08T19:42:50.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:50 smithi097 ceph-mon[41966]: osdmap e503: 8 total, 8 up, 8 in 2021-10-08T19:42:50.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:50 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2056008133' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "iscsi", "var": "pgp_num", "val": "23"}]: dispatch 2021-10-08T19:42:50.821 INFO:tasks.thrashosds.thrasher:fixing pg num pool .rgw.root 2021-10-08T19:42:50.821 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd pool set .rgw.root pgp_num 42 2021-10-08T19:42:51.101 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:42:51.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:51 smithi097 ceph-mon[41966]: 1.2 deep-scrub ok 2021-10-08T19:42:51.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:51 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:42:51.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:51 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:42:51.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:51 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2056008133' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "iscsi", "var": "pgp_num", "val": "23"}]': finished 2021-10-08T19:42:51.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:51 smithi097 ceph-mon[41966]: osdmap e504: 8 total, 8 up, 8 in 2021-10-08T19:42:51.474 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:51 smithi097 ceph-mon[41966]: 6.10 scrub ok 2021-10-08T19:42:51.474 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:51 smithi097 ceph-mon[41966]: 5.1d deep-scrub ok 2021-10-08T19:42:51.474 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:51 smithi097 ceph-mon[32687]: 1.2 deep-scrub ok 2021-10-08T19:42:51.476 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:51 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:42:51.476 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:51 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:42:51.477 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:51 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2056008133' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "iscsi", "var": "pgp_num", "val": "23"}]': finished 2021-10-08T19:42:51.477 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:51 smithi097 ceph-mon[32687]: osdmap e504: 8 total, 8 up, 8 in 2021-10-08T19:42:51.477 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:51 smithi097 ceph-mon[32687]: 6.10 scrub ok 2021-10-08T19:42:51.477 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:51 smithi097 ceph-mon[32687]: 5.1d deep-scrub ok 2021-10-08T19:42:51.586 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:51 smithi117 ceph-mon[34585]: 1.2 deep-scrub ok 2021-10-08T19:42:51.587 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:51 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:42:51.587 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:51 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:42:51.587 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:51 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2056008133' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "iscsi", "var": "pgp_num", "val": "23"}]': finished 2021-10-08T19:42:51.587 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:51 smithi117 ceph-mon[34585]: osdmap e504: 8 total, 8 up, 8 in 2021-10-08T19:42:51.588 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:51 smithi117 ceph-mon[34585]: 6.10 scrub ok 2021-10-08T19:42:51.588 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:51 smithi117 ceph-mon[34585]: 5.1d deep-scrub ok 2021-10-08T19:42:51.805 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:42:51.806 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2021-10-08T19:42:51.806 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2021-10-08T19:42:51.807 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2021-10-08T19:42:51.807 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:42:52.431 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:52 smithi117 ceph-mon[34585]: 3.a scrub ok 2021-10-08T19:42:52.431 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:52 smithi117 ceph-mon[34585]: 5.1a deep-scrub ok 2021-10-08T19:42:52.431 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:52 smithi117 ceph-mon[34585]: pgmap v1068: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2021-10-08T19:42:52.431 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:52 smithi117 ceph-mon[34585]: 5.18 scrub ok 2021-10-08T19:42:52.432 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:52 smithi117 ceph-mon[34585]: 6.16 scrub ok 2021-10-08T19:42:52.433 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2021-10-08T19:42:52.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:52 smithi097 ceph-mon[32687]: 3.a scrub ok 2021-10-08T19:42:52.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:52 smithi097 ceph-mon[32687]: 5.1a deep-scrub ok 2021-10-08T19:42:52.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:52 smithi097 ceph-mon[32687]: pgmap v1068: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2021-10-08T19:42:52.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:52 smithi097 ceph-mon[32687]: 5.18 scrub ok 2021-10-08T19:42:52.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:52 smithi097 ceph-mon[32687]: 6.16 scrub ok 2021-10-08T19:42:52.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:52 smithi097 ceph-mon[41966]: 3.a scrub ok 2021-10-08T19:42:52.474 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:52 smithi097 ceph-mon[41966]: 5.1a deep-scrub ok 2021-10-08T19:42:52.474 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:52 smithi097 ceph-mon[41966]: pgmap v1068: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2021-10-08T19:42:52.474 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:52 smithi097 ceph-mon[41966]: 5.18 scrub ok 2021-10-08T19:42:52.474 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:52 smithi097 ceph-mon[41966]: 6.16 scrub ok 2021-10-08T19:42:52.710 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.b/config 2021-10-08T19:42:52.970 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:42:52 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:42:52] "GET /metrics HTTP/1.1" 200 154886 "" "Prometheus/2.18.1" 2021-10-08T19:42:53.245 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:53 smithi117 ceph-mon[34585]: 1.5 scrub ok 2021-10-08T19:42:53.246 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:53 smithi117 ceph-mon[34585]: 6.1 deep-scrub ok 2021-10-08T19:42:53.428 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:53 smithi097 ceph-mon[41966]: 1.5 scrub ok 2021-10-08T19:42:53.429 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:53 smithi097 ceph-mon[41966]: 6.1 deep-scrub ok 2021-10-08T19:42:53.429 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:53 smithi097 ceph-mon[32687]: 1.5 scrub ok 2021-10-08T19:42:53.429 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:53 smithi097 ceph-mon[32687]: 6.1 deep-scrub ok 2021-10-08T19:42:54.124 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:42:53 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:42:53] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:42:54.175 INFO:teuthology.orchestra.run.smithi097.stderr:set pool 2 pgp_num to 42 2021-10-08T19:42:54.339 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2021-10-08T19:42:54.339 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2021-10-08T19:42:54.340 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2021-10-08T19:42:54.340 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2021-10-08T19:42:54.340 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.340 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.25465.0:169838 9.3 9:cc713d20:::benchmark_data_smithi097_196985_object54147:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e334)", 2021-10-08T19:42:54.341 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:34:02.168016+0000", 2021-10-08T19:42:54.341 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 532.16873549399998, 2021-10-08T19:42:54.341 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.18378728999999999, 2021-10-08T19:42:54.342 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:54.342 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:54.342 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:42:54.342 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.25465", 2021-10-08T19:42:54.343 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:42:54.343 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 169838 2021-10-08T19:42:54.343 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.344 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:54.344 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.344 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:54.344 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.168016+0000", 2021-10-08T19:42:54.345 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:54.345 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.346 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.346 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:54.346 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.168016+0000", 2021-10-08T19:42:54.347 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:54.348 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.348 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.349 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:54.349 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.168015+0000", 2021-10-08T19:42:54.350 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:42:54.350 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.351 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.351 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:54.352 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.168020+0000", 2021-10-08T19:42:54.352 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.651e-06 2021-10-08T19:42:54.352 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.353 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.353 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:54.354 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.168028+0000", 2021-10-08T19:42:54.354 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4300000000000006e-06 2021-10-08T19:42:54.355 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.355 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.356 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:54.356 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.168034+0000", 2021-10-08T19:42:54.357 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6500000000000001e-06 2021-10-08T19:42:54.357 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.357 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.358 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:54.358 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.170324+0000", 2021-10-08T19:42:54.359 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022904560000000002 2021-10-08T19:42:54.359 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.360 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.360 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:54.361 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.170455+0000", 2021-10-08T19:42:54.361 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013018900000000001 2021-10-08T19:42:54.361 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.362 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.362 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 1,3", 2021-10-08T19:42:54.363 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.170588+0000", 2021-10-08T19:42:54.363 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000133814 2021-10-08T19:42:54.364 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.364 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.365 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:42:54.365 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.172605+0000", 2021-10-08T19:42:54.365 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002016847 2021-10-08T19:42:54.366 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.366 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.367 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:54.367 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.176258+0000", 2021-10-08T19:42:54.368 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036532439999999999 2021-10-08T19:42:54.368 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.369 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.369 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:54.369 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.351710+0000", 2021-10-08T19:42:54.370 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.175451194 2021-10-08T19:42:54.370 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.370 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.371 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:54.371 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.351762+0000", 2021-10-08T19:42:54.372 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2623000000000001e-05 2021-10-08T19:42:54.373 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.373 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.374 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:54.374 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:02.351804+0000", 2021-10-08T19:42:54.374 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1440000000000003e-05 2021-10-08T19:42:54.375 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:54.375 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:54.375 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:54.376 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.376 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.376 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:209975 9.1 e343/290 9:89bb0ba3:::benchmark_data_smithi097_196985_object94284:head v 343'12999, mlcod=343'12997)", 2021-10-08T19:42:54.376 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:34:38.428534+0000", 2021-10-08T19:42:54.377 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 495.90821802900001, 2021-10-08T19:42:54.377 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.236116147, 2021-10-08T19:42:54.377 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:54.377 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:54.378 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:54.378 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.378 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:54.378 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.428534+0000", 2021-10-08T19:42:54.379 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:54.379 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.379 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.379 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:54.380 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.428534+0000", 2021-10-08T19:42:54.380 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:54.380 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.380 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.381 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:54.381 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.428533+0000", 2021-10-08T19:42:54.381 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:42:54.381 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.382 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.382 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:54.382 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.428540+0000", 2021-10-08T19:42:54.382 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.109e-06 2021-10-08T19:42:54.383 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.383 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.383 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:54.384 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.428549+0000", 2021-10-08T19:42:54.384 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3249999999999997e-06 2021-10-08T19:42:54.385 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.385 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.385 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:54.385 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.428555+0000", 2021-10-08T19:42:54.385 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8220000000000003e-06 2021-10-08T19:42:54.386 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.386 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.386 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:54.386 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.428601+0000", 2021-10-08T19:42:54.387 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5527e-05 2021-10-08T19:42:54.387 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.387 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.387 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:54.388 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.428618+0000", 2021-10-08T19:42:54.388 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7547e-05 2021-10-08T19:42:54.388 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.388 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.388 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:54.389 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.664627+0000", 2021-10-08T19:42:54.389 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.23600927099999999 2021-10-08T19:42:54.389 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.389 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.390 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:54.390 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.664650+0000", 2021-10-08T19:42:54.390 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2654999999999999e-05 2021-10-08T19:42:54.391 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:54.391 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:54.391 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:54.391 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.392 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.392 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:209977 9.a e343/290 9:575a8bb2:::benchmark_data_smithi097_196985_object94286:head v 343'13104, mlcod=343'13101)", 2021-10-08T19:42:54.392 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:34:38.431569+0000", 2021-10-08T19:42:54.392 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 495.90518271399998, 2021-10-08T19:42:54.393 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.234467443, 2021-10-08T19:42:54.393 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:54.394 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:54.394 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:54.394 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.395 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:54.395 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.431569+0000", 2021-10-08T19:42:54.396 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:54.396 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.396 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.396 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:54.397 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.431569+0000", 2021-10-08T19:42:54.397 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:54.397 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.397 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.397 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:54.398 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.431568+0000", 2021-10-08T19:42:54.398 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:42:54.398 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.398 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.399 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:54.399 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.431574+0000", 2021-10-08T19:42:54.399 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0970000000000002e-06 2021-10-08T19:42:54.399 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.400 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.400 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:54.400 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.661194+0000", 2021-10-08T19:42:54.400 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.229619776 2021-10-08T19:42:54.401 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.401 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.401 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:54.401 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.661212+0000", 2021-10-08T19:42:54.401 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8576e-05 2021-10-08T19:42:54.402 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.402 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.402 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:54.403 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.661306+0000", 2021-10-08T19:42:54.403 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3208000000000006e-05 2021-10-08T19:42:54.403 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.404 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.404 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:54.404 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.661367+0000", 2021-10-08T19:42:54.404 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1753000000000003e-05 2021-10-08T19:42:54.405 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.405 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.405 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:54.406 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.666011+0000", 2021-10-08T19:42:54.406 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046439899999999998 2021-10-08T19:42:54.406 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.406 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.407 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:54.407 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.666037+0000", 2021-10-08T19:42:54.407 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5211999999999998e-05 2021-10-08T19:42:54.407 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:54.408 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:54.408 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:54.408 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.409 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.409 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.25465.0:209980 9.e 9:7c138995:::benchmark_data_smithi097_196985_object94289:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e343)", 2021-10-08T19:42:54.409 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:34:38.435304+0000", 2021-10-08T19:42:54.410 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 495.90144784799998, 2021-10-08T19:42:54.410 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.23664207800000001, 2021-10-08T19:42:54.410 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:54.410 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:54.411 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:42:54.411 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.25465", 2021-10-08T19:42:54.411 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1100482753", 2021-10-08T19:42:54.411 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 209980 2021-10-08T19:42:54.412 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.412 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:54.412 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.412 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:54.413 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.435304+0000", 2021-10-08T19:42:54.413 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:54.415 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.416 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.416 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:54.417 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.435304+0000", 2021-10-08T19:42:54.417 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:54.418 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.418 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.418 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:54.419 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.435302+0000", 2021-10-08T19:42:54.419 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:42:54.419 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.419 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.419 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:54.420 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.435308+0000", 2021-10-08T19:42:54.420 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0190000000000003e-06 2021-10-08T19:42:54.420 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.420 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.421 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:54.421 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.661204+0000", 2021-10-08T19:42:54.421 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.225895185 2021-10-08T19:42:54.422 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.422 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.422 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:54.422 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.661231+0000", 2021-10-08T19:42:54.423 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7769000000000001e-05 2021-10-08T19:42:54.423 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.423 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.423 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:54.424 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.661484+0000", 2021-10-08T19:42:54.424 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000252372 2021-10-08T19:42:54.424 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.424 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.424 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:54.425 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.661605+0000", 2021-10-08T19:42:54.425 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012129 2021-10-08T19:42:54.425 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.425 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.426 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 1,4", 2021-10-08T19:42:54.426 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.661795+0000", 2021-10-08T19:42:54.426 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00018975099999999999 2021-10-08T19:42:54.427 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.427 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.427 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:42:54.428 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.666573+0000", 2021-10-08T19:42:54.428 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0047777619999999996 2021-10-08T19:42:54.428 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.428 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.429 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:54.429 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.666621+0000", 2021-10-08T19:42:54.429 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8196999999999999e-05 2021-10-08T19:42:54.429 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.430 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.430 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:54.430 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.671845+0000", 2021-10-08T19:42:54.430 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0052243530000000002 2021-10-08T19:42:54.430 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.431 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.431 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:54.431 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.671905+0000", 2021-10-08T19:42:54.431 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0053999999999998e-05 2021-10-08T19:42:54.432 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.432 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.432 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:54.432 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.671946+0000", 2021-10-08T19:42:54.432 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1006e-05 2021-10-08T19:42:54.433 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:54.433 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:54.433 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:54.433 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.434 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.434 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_repop(client.25465.0:209994 9.9 e343/290 9:93bcfe32:::benchmark_data_smithi097_196985_object94303:head v 343'13083, mlcod=343'13081)", 2021-10-08T19:42:54.434 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:34:38.454236+0000", 2021-10-08T19:42:54.434 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 495.88251553399999, 2021-10-08T19:42:54.434 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.21043297699999999, 2021-10-08T19:42:54.435 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:54.435 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:54.435 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:54.435 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.436 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:54.436 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.454236+0000", 2021-10-08T19:42:54.436 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:54.436 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.436 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.437 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:54.437 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.454236+0000", 2021-10-08T19:42:54.437 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:54.437 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.438 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.438 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:54.438 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.454233+0000", 2021-10-08T19:42:54.438 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999962 2021-10-08T19:42:54.439 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.439 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.439 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:54.439 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.454252+0000", 2021-10-08T19:42:54.439 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9372999999999999e-05 2021-10-08T19:42:54.440 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.440 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.440 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:54.440 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.661194+0000", 2021-10-08T19:42:54.440 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.20694248000000001 2021-10-08T19:42:54.441 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.441 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.441 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:54.441 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.661217+0000", 2021-10-08T19:42:54.442 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2983e-05 2021-10-08T19:42:54.442 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.442 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.442 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:54.443 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.661547+0000", 2021-10-08T19:42:54.443 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00032985499999999999 2021-10-08T19:42:54.443 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.443 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.444 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:54.444 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.661567+0000", 2021-10-08T19:42:54.444 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9718999999999999e-05 2021-10-08T19:42:54.444 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.444 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.445 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:54.445 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.664652+0000", 2021-10-08T19:42:54.445 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0030853310000000002 2021-10-08T19:42:54.446 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.446 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.446 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:54.447 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:34:38.664669+0000", 2021-10-08T19:42:54.447 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7008999999999999e-05 2021-10-08T19:42:54.447 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:54.448 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:54.448 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:54.448 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.449 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.449 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.15870.0:55048 10.c 10:36071c76:::benchmark_data_smithi097_245820_object55047:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e371)", 2021-10-08T19:42:54.449 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:35:55.919347+0000", 2021-10-08T19:42:54.449 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 418.41740502499999, 2021-10-08T19:42:54.450 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.201994387, 2021-10-08T19:42:54.450 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:54.450 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:54.450 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:42:54.451 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.15870", 2021-10-08T19:42:54.451 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1128006081", 2021-10-08T19:42:54.451 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 55048 2021-10-08T19:42:54.451 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.451 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:54.452 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.452 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:54.452 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:35:55.919347+0000", 2021-10-08T19:42:54.452 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:54.452 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.453 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.453 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:54.453 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:35:55.919347+0000", 2021-10-08T19:42:54.454 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:54.454 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.454 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.454 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:54.455 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:35:55.919345+0000", 2021-10-08T19:42:54.455 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:42:54.455 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.455 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.456 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:54.456 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:35:55.919394+0000", 2021-10-08T19:42:54.456 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9344000000000001e-05 2021-10-08T19:42:54.456 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.457 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.457 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:54.457 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:35:55.919413+0000", 2021-10-08T19:42:54.457 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9347e-05 2021-10-08T19:42:54.457 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.458 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.458 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:54.458 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:35:55.919422+0000", 2021-10-08T19:42:54.458 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2849999999999995e-06 2021-10-08T19:42:54.459 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.459 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.459 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:54.459 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:35:55.919490+0000", 2021-10-08T19:42:54.460 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7917999999999996e-05 2021-10-08T19:42:54.460 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.460 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.460 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:54.460 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:35:55.919645+0000", 2021-10-08T19:42:54.461 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015573099999999999 2021-10-08T19:42:54.461 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.461 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.461 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 0,4", 2021-10-08T19:42:54.461 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:35:55.919785+0000", 2021-10-08T19:42:54.462 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013953500000000001 2021-10-08T19:42:54.462 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.462 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.462 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:42:54.463 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:35:55.921831+0000", 2021-10-08T19:42:54.463 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020465219999999998 2021-10-08T19:42:54.463 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.463 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.463 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:54.464 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:35:55.922670+0000", 2021-10-08T19:42:54.464 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00083903799999999996 2021-10-08T19:42:54.464 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.464 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.465 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:54.465 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:35:56.121241+0000", 2021-10-08T19:42:54.465 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.19857038900000001 2021-10-08T19:42:54.465 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.465 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.466 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:54.466 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:35:56.121302+0000", 2021-10-08T19:42:54.466 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1616000000000001e-05 2021-10-08T19:42:54.466 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.466 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.467 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:54.467 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:35:56.121341+0000", 2021-10-08T19:42:54.467 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8800999999999997e-05 2021-10-08T19:42:54.467 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:54.468 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:54.468 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:54.468 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.468 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.469 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.26125.0:50065 11.4 11:271cd449:::benchmark_data_smithi097_295476_object50064:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e448)", 2021-10-08T19:42:54.469 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:39:38.253906+0000", 2021-10-08T19:42:54.469 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 196.082846227, 2021-10-08T19:42:54.469 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.47711858099999999, 2021-10-08T19:42:54.469 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:54.470 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:54.470 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:42:54.470 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.26125", 2021-10-08T19:42:54.470 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:42:54.471 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 50065 2021-10-08T19:42:54.471 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.471 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:54.471 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.471 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:54.472 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:38.253906+0000", 2021-10-08T19:42:54.472 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:54.472 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.472 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.473 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:54.473 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:38.253906+0000", 2021-10-08T19:42:54.473 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:54.473 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.473 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.474 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:54.474 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:38.253903+0000", 2021-10-08T19:42:54.474 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:42:54.474 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.475 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.475 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:54.475 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:38.253960+0000", 2021-10-08T19:42:54.475 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6891999999999997e-05 2021-10-08T19:42:54.475 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.476 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.476 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:54.476 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:38.253976+0000", 2021-10-08T19:42:54.476 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5872e-05 2021-10-08T19:42:54.476 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.477 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.477 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:54.477 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:38.253983+0000", 2021-10-08T19:42:54.477 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.764e-06 2021-10-08T19:42:54.478 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.478 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.478 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:54.478 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:38.254032+0000", 2021-10-08T19:42:54.479 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9651999999999998e-05 2021-10-08T19:42:54.479 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.479 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.479 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:54.479 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:38.254150+0000", 2021-10-08T19:42:54.480 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000117411 2021-10-08T19:42:54.480 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.480 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.480 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 2,6", 2021-10-08T19:42:54.480 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:38.254267+0000", 2021-10-08T19:42:54.481 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000116845 2021-10-08T19:42:54.481 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.481 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.481 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:42:54.482 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:38.256337+0000", 2021-10-08T19:42:54.482 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020707 2021-10-08T19:42:54.482 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.482 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.483 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:54.483 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:38.261811+0000", 2021-10-08T19:42:54.483 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054738249999999999 2021-10-08T19:42:54.483 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.483 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.484 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:54.484 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:38.730891+0000", 2021-10-08T19:42:54.484 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.46908010999999999 2021-10-08T19:42:54.484 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.485 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.485 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:54.485 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:38.730951+0000", 2021-10-08T19:42:54.485 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9765999999999997e-05 2021-10-08T19:42:54.485 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.486 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.486 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:54.486 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:39:38.731024+0000", 2021-10-08T19:42:54.486 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3127999999999995e-05 2021-10-08T19:42:54.487 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:54.487 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:54.487 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:54.487 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.488 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.488 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.26125.0:223352 11.f 11:fd7d9657:::benchmark_data_smithi097_295476_object109603:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e494)", 2021-10-08T19:42:54.488 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:42:24.554211+0000", 2021-10-08T19:42:54.488 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 29.782541108, 2021-10-08T19:42:54.488 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.22075576099999999, 2021-10-08T19:42:54.489 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:54.489 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:54.489 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:42:54.489 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.26125", 2021-10-08T19:42:54.489 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:42:54.490 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 223352 2021-10-08T19:42:54.490 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.490 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:54.490 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.491 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:54.491 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.554211+0000", 2021-10-08T19:42:54.491 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:54.491 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.492 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.492 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:54.492 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.554211+0000", 2021-10-08T19:42:54.492 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:54.493 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.493 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.493 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:54.493 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.554209+0000", 2021-10-08T19:42:54.493 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:42:54.494 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.494 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.494 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:54.494 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.554218+0000", 2021-10-08T19:42:54.495 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6279999999999994e-06 2021-10-08T19:42:54.495 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.495 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.495 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:54.495 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.554230+0000", 2021-10-08T19:42:54.496 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1849e-05 2021-10-08T19:42:54.496 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.496 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.496 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:54.496 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.554236+0000", 2021-10-08T19:42:54.497 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4189999999999999e-06 2021-10-08T19:42:54.497 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.497 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.497 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:54.498 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.555978+0000", 2021-10-08T19:42:54.498 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0017414329999999999 2021-10-08T19:42:54.498 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.498 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.498 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:54.499 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.556104+0000", 2021-10-08T19:42:54.499 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000126728 2021-10-08T19:42:54.499 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.500 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.500 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 1,2", 2021-10-08T19:42:54.500 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.556235+0000", 2021-10-08T19:42:54.500 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013014400000000001 2021-10-08T19:42:54.501 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.501 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.501 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:42:54.501 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.557856+0000", 2021-10-08T19:42:54.501 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0016212620000000001 2021-10-08T19:42:54.502 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.502 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.502 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:54.502 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.559585+0000", 2021-10-08T19:42:54.502 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0017296080000000001 2021-10-08T19:42:54.503 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.503 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.503 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:54.503 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.774866+0000", 2021-10-08T19:42:54.504 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.21528096099999999 2021-10-08T19:42:54.504 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.504 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.504 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:54.504 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.774923+0000", 2021-10-08T19:42:54.505 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6158e-05 2021-10-08T19:42:54.505 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.505 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.505 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:54.506 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.774967+0000", 2021-10-08T19:42:54.506 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.3964999999999997e-05 2021-10-08T19:42:54.506 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:54.506 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:54.506 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:54.507 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.508 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.508 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.26125.0:223354 11.f 11:fc7243dc:::benchmark_data_smithi097_295476_object109605:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e494)", 2021-10-08T19:42:54.508 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:42:24.558247+0000", 2021-10-08T19:42:54.509 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 29.778504487999999, 2021-10-08T19:42:54.509 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.22014573100000001, 2021-10-08T19:42:54.509 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:54.509 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2021-10-08T19:42:54.509 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:42:54.510 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.26125", 2021-10-08T19:42:54.510 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/3149839055", 2021-10-08T19:42:54.510 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 223354 2021-10-08T19:42:54.510 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.511 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:54.511 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.511 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:54.511 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.558247+0000", 2021-10-08T19:42:54.511 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:54.512 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.512 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.512 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:54.512 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.558247+0000", 2021-10-08T19:42:54.513 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:54.513 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.513 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.513 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:54.513 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.558246+0000", 2021-10-08T19:42:54.514 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:42:54.514 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.514 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.514 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:54.515 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.558251+0000", 2021-10-08T19:42:54.515 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5110000000000003e-06 2021-10-08T19:42:54.515 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.515 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.515 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:54.516 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.558262+0000", 2021-10-08T19:42:54.516 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0309000000000001e-05 2021-10-08T19:42:54.516 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.516 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.517 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:54.517 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.558270+0000", 2021-10-08T19:42:54.517 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0630000000000006e-06 2021-10-08T19:42:54.517 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.517 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.518 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:54.518 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.558311+0000", 2021-10-08T19:42:54.518 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1418999999999998e-05 2021-10-08T19:42:54.518 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.518 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.519 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:54.519 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.558396+0000", 2021-10-08T19:42:54.519 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4525999999999997e-05 2021-10-08T19:42:54.519 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.520 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.520 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for subops from 1,2", 2021-10-08T19:42:54.520 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.558470+0000", 2021-10-08T19:42:54.520 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4202999999999994e-05 2021-10-08T19:42:54.520 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.521 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.521 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op_commit", 2021-10-08T19:42:54.521 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.559747+0000", 2021-10-08T19:42:54.521 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012768250000000001 2021-10-08T19:42:54.522 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.522 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.522 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:54.522 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.775032+0000", 2021-10-08T19:42:54.522 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.21528565799999999 2021-10-08T19:42:54.523 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.523 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.523 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_commit_rec", 2021-10-08T19:42:54.523 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.778324+0000", 2021-10-08T19:42:54.523 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032919329999999999 2021-10-08T19:42:54.524 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.524 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.524 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2021-10-08T19:42:54.524 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.778364+0000", 2021-10-08T19:42:54.525 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9475999999999999e-05 2021-10-08T19:42:54.525 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.525 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.525 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:54.525 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:24.778393+0000", 2021-10-08T19:42:54.526 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9315999999999998e-05 2021-10-08T19:42:54.526 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:54.526 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:54.526 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:54.527 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.527 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.527 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.14457.0:2974 5.9 5:93e5b521:::notify.7:head [watch ping cookie 94629485178112 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e497)", 2021-10-08T19:42:54.527 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:42:41.996515+0000", 2021-10-08T19:42:54.528 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 12.340237295, 2021-10-08T19:42:54.528 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000274262, 2021-10-08T19:42:54.528 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:54.528 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2021-10-08T19:42:54.529 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:42:54.529 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.14457", 2021-10-08T19:42:54.529 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1622493358", 2021-10-08T19:42:54.529 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 2974 2021-10-08T19:42:54.529 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.530 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:54.530 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.530 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:54.530 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:41.996515+0000", 2021-10-08T19:42:54.531 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:54.531 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.531 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.531 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:54.531 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:41.996515+0000", 2021-10-08T19:42:54.532 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:54.532 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.532 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.532 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:54.532 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:41.996513+0000", 2021-10-08T19:42:54.533 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:42:54.533 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.533 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.533 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:54.533 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:41.996519+0000", 2021-10-08T19:42:54.534 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1290000000000001e-06 2021-10-08T19:42:54.534 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.534 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.534 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:54.535 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:41.996529+0000", 2021-10-08T19:42:54.535 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.5899999999999997e-06 2021-10-08T19:42:54.535 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.535 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.536 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:54.536 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:41.996538+0000", 2021-10-08T19:42:54.536 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6190000000000006e-06 2021-10-08T19:42:54.536 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.537 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.537 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:54.537 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:41.996634+0000", 2021-10-08T19:42:54.537 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.5255999999999997e-05 2021-10-08T19:42:54.537 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.538 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.538 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:54.538 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:41.996716+0000", 2021-10-08T19:42:54.538 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2395e-05 2021-10-08T19:42:54.538 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.539 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.539 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:54.539 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:41.996789+0000", 2021-10-08T19:42:54.539 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2879000000000005e-05 2021-10-08T19:42:54.539 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:54.540 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:54.540 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:54.540 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.540 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.541 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.24511.0:45 3.11 3:88c1567c:::rbd_trash_purge_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e484)", 2021-10-08T19:42:54.541 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:42:42.639743+0000", 2021-10-08T19:42:54.541 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 11.697008927000001, 2021-10-08T19:42:54.541 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00039430200000000002, 2021-10-08T19:42:54.541 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:54.542 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2021-10-08T19:42:54.542 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:42:54.542 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.24511", 2021-10-08T19:42:54.542 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/560730001", 2021-10-08T19:42:54.542 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 45 2021-10-08T19:42:54.543 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.543 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:54.543 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.543 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:54.544 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:42.639743+0000", 2021-10-08T19:42:54.544 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:54.544 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.544 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.544 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:54.545 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:42.639743+0000", 2021-10-08T19:42:54.545 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:54.545 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.545 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.545 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:54.546 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:42.639739+0000", 2021-10-08T19:42:54.546 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999962 2021-10-08T19:42:54.546 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.546 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.547 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:54.547 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:42.639755+0000", 2021-10-08T19:42:54.547 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5855999999999999e-05 2021-10-08T19:42:54.547 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.547 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.548 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:54.548 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:42.639780+0000", 2021-10-08T19:42:54.548 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4720999999999999e-05 2021-10-08T19:42:54.548 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.548 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.549 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:54.549 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:42.639789+0000", 2021-10-08T19:42:54.549 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.132e-06 2021-10-08T19:42:54.549 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.550 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.550 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:54.550 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:42.640029+0000", 2021-10-08T19:42:54.550 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000239814 2021-10-08T19:42:54.550 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.551 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.551 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:54.551 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:42.640137+0000", 2021-10-08T19:42:54.551 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010839499999999999 2021-10-08T19:42:54.552 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:54.552 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:54.552 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:54.552 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.552 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.553 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDScrubReserve(4.16 REQUEST e502)", 2021-10-08T19:42:54.553 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:42:45.371144+0000", 2021-10-08T19:42:54.553 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 8.9656075489999996, 2021-10-08T19:42:54.553 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000140092, 2021-10-08T19:42:54.553 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:54.554 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2021-10-08T19:42:54.554 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:54.554 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.554 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:54.555 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:45.371144+0000", 2021-10-08T19:42:54.555 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:54.555 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.555 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.555 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:54.556 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:45.371144+0000", 2021-10-08T19:42:54.556 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:54.556 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.556 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.556 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:54.557 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:45.371142+0000", 2021-10-08T19:42:54.557 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999971 2021-10-08T19:42:54.557 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.557 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.558 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:54.558 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:45.371155+0000", 2021-10-08T19:42:54.558 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3857e-05 2021-10-08T19:42:54.558 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.558 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.559 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:54.559 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:45.371177+0000", 2021-10-08T19:42:54.559 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1729000000000002e-05 2021-10-08T19:42:54.559 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.559 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.560 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:54.560 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:45.371185+0000", 2021-10-08T19:42:54.560 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.106e-06 2021-10-08T19:42:54.560 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.560 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.561 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:54.561 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:45.371247+0000", 2021-10-08T19:42:54.561 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1389000000000005e-05 2021-10-08T19:42:54.561 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.561 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.562 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:54.562 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:45.371259+0000", 2021-10-08T19:42:54.562 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2103000000000001e-05 2021-10-08T19:42:54.562 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.563 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.563 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:54.563 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:45.371284+0000", 2021-10-08T19:42:54.563 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5712999999999999e-05 2021-10-08T19:42:54.563 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:54.564 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:54.564 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:54.564 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.564 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.564 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "replica_scrub(pg: 4.16,from:0'0,to:482'21,epoch:502/236,start:4:68000000::::0,end:MAX,chunky:1,deep:0,version:9,allow_preemption:1,priority=5)", 2021-10-08T19:42:54.565 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:42:45.371898+0000", 2021-10-08T19:42:54.565 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 8.9648542589999991, 2021-10-08T19:42:54.565 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013483399999999999, 2021-10-08T19:42:54.565 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:54.566 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2021-10-08T19:42:54.566 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:54.566 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.566 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:54.566 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:45.371898+0000", 2021-10-08T19:42:54.567 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:54.567 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.567 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.567 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:54.567 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:45.371898+0000", 2021-10-08T19:42:54.568 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:54.568 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.568 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.568 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:54.568 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:45.371897+0000", 2021-10-08T19:42:54.569 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.999999 2021-10-08T19:42:54.569 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.569 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.569 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:54.570 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:45.371905+0000", 2021-10-08T19:42:54.570 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3229999999999998e-06 2021-10-08T19:42:54.570 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.570 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.570 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:54.571 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:45.371915+0000", 2021-10-08T19:42:54.571 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0378e-05 2021-10-08T19:42:54.571 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.571 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.572 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:54.572 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:45.371920+0000", 2021-10-08T19:42:54.572 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2660000000000003e-06 2021-10-08T19:42:54.573 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.573 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.573 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:54.573 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:45.371987+0000", 2021-10-08T19:42:54.573 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7234e-05 2021-10-08T19:42:54.574 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.574 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.574 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:54.574 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:45.372003+0000", 2021-10-08T19:42:54.575 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5996000000000001e-05 2021-10-08T19:42:54.575 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.575 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.575 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:54.575 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:45.372032+0000", 2021-10-08T19:42:54.576 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9584e-05 2021-10-08T19:42:54.576 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:54.576 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:54.576 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:54.576 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.577 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.577 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.14457.0:2983 5.9 5:93e5b521:::notify.7:head [watch ping cookie 94629485178112 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e499)", 2021-10-08T19:42:54.577 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:42:46.997573+0000", 2021-10-08T19:42:54.577 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 7.3391791299999998, 2021-10-08T19:42:54.577 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00066171800000000005, 2021-10-08T19:42:54.578 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:54.578 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2021-10-08T19:42:54.578 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:42:54.578 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.14457", 2021-10-08T19:42:54.579 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1622493358", 2021-10-08T19:42:54.579 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 2983 2021-10-08T19:42:54.579 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.579 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:54.579 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.580 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:54.580 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:46.997573+0000", 2021-10-08T19:42:54.580 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:54.580 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.580 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.581 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:54.581 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:46.997573+0000", 2021-10-08T19:42:54.581 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:54.581 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.582 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.582 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:54.582 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:46.997570+0000", 2021-10-08T19:42:54.582 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999976 2021-10-08T19:42:54.582 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.583 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.583 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:54.583 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:46.997585+0000", 2021-10-08T19:42:54.583 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4249e-05 2021-10-08T19:42:54.584 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.584 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.584 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:54.584 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:46.997607+0000", 2021-10-08T19:42:54.584 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2217000000000001e-05 2021-10-08T19:42:54.585 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.585 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.585 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:54.585 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:46.997627+0000", 2021-10-08T19:42:54.586 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9966000000000002e-05 2021-10-08T19:42:54.586 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.586 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.591 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:54.591 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:46.998032+0000", 2021-10-08T19:42:54.591 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000404888 2021-10-08T19:42:54.591 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.592 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.592 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:54.592 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:46.998126+0000", 2021-10-08T19:42:54.592 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.4369000000000004e-05 2021-10-08T19:42:54.592 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.593 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.593 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:54.593 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:46.998234+0000", 2021-10-08T19:42:54.593 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000108362 2021-10-08T19:42:54.594 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:54.594 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:54.594 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:54.594 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.594 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.595 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDScrubReserve(6.14 REQUEST e502)", 2021-10-08T19:42:54.595 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:42:47.287029+0000", 2021-10-08T19:42:54.595 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 7.049722847, 2021-10-08T19:42:54.595 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013658499999999999, 2021-10-08T19:42:54.595 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:54.596 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2021-10-08T19:42:54.596 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:54.596 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.596 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:54.597 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:47.287029+0000", 2021-10-08T19:42:54.597 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:54.597 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.597 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.597 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:54.598 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:47.287029+0000", 2021-10-08T19:42:54.598 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:54.598 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.598 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.599 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:54.599 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:47.287027+0000", 2021-10-08T19:42:54.599 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999981 2021-10-08T19:42:54.599 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.599 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.600 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:54.600 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:47.287036+0000", 2021-10-08T19:42:54.600 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3929999999999997e-06 2021-10-08T19:42:54.600 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.601 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.601 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:54.601 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:47.287054+0000", 2021-10-08T19:42:54.601 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7974000000000001e-05 2021-10-08T19:42:54.601 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.602 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.602 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:54.602 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:47.287061+0000", 2021-10-08T19:42:54.602 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.9840000000000004e-06 2021-10-08T19:42:54.603 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.603 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.603 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:54.603 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:47.287115+0000", 2021-10-08T19:42:54.603 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.3745000000000001e-05 2021-10-08T19:42:54.604 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.604 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.604 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:54.604 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:47.287133+0000", 2021-10-08T19:42:54.605 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7730000000000001e-05 2021-10-08T19:42:54.605 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.605 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.605 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:54.605 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:47.287166+0000", 2021-10-08T19:42:54.606 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2882000000000001e-05 2021-10-08T19:42:54.606 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:54.606 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:54.606 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:54.607 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.607 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.607 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDScrubReserve(6.14 RELEASE e502)", 2021-10-08T19:42:54.607 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:42:47.290138+0000", 2021-10-08T19:42:54.607 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 7.0466135110000003, 2021-10-08T19:42:54.608 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014442099999999999, 2021-10-08T19:42:54.608 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:54.608 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2021-10-08T19:42:54.608 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:54.609 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.609 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:54.609 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:47.290138+0000", 2021-10-08T19:42:54.609 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:54.609 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.610 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.610 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:54.610 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:47.290138+0000", 2021-10-08T19:42:54.610 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:54.610 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.611 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.611 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:54.611 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:47.290138+0000", 2021-10-08T19:42:54.611 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999995 2021-10-08T19:42:54.612 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.612 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.612 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:54.612 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:47.290142+0000", 2021-10-08T19:42:54.612 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0280000000000002e-06 2021-10-08T19:42:54.613 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.613 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.613 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:54.613 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:47.290153+0000", 2021-10-08T19:42:54.613 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1474999999999999e-05 2021-10-08T19:42:54.614 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.614 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.614 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:54.614 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:47.290158+0000", 2021-10-08T19:42:54.614 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9660000000000004e-06 2021-10-08T19:42:54.615 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.615 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.615 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:54.615 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:47.290263+0000", 2021-10-08T19:42:54.616 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000104535 2021-10-08T19:42:54.616 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.616 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.616 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:54.616 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:47.290270+0000", 2021-10-08T19:42:54.617 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0530000000000001e-06 2021-10-08T19:42:54.617 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.617 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.617 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:54.617 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:47.290283+0000", 2021-10-08T19:42:54.618 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2974e-05 2021-10-08T19:42:54.618 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:54.618 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:54.618 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:54.619 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.619 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.619 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDScrubReserve(6.16 REQUEST e504)", 2021-10-08T19:42:54.619 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:42:51.376985+0000", 2021-10-08T19:42:54.619 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 2.959766423, 2021-10-08T19:42:54.620 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00019254299999999999, 2021-10-08T19:42:54.620 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:54.620 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2021-10-08T19:42:54.620 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:54.621 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.621 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:54.621 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:51.376985+0000", 2021-10-08T19:42:54.621 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:54.621 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.622 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.622 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:54.622 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:51.376985+0000", 2021-10-08T19:42:54.622 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:54.622 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.623 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.623 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:54.623 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:51.376985+0000", 2021-10-08T19:42:54.623 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999995 2021-10-08T19:42:54.624 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.624 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.624 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:54.624 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:51.376988+0000", 2021-10-08T19:42:54.624 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7800000000000001e-06 2021-10-08T19:42:54.625 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.625 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.625 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:54.625 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:51.377025+0000", 2021-10-08T19:42:54.625 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6665999999999998e-05 2021-10-08T19:42:54.626 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.626 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.626 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:54.626 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:51.377036+0000", 2021-10-08T19:42:54.627 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1803e-05 2021-10-08T19:42:54.627 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.627 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.627 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:54.628 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:51.377120+0000", 2021-10-08T19:42:54.628 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3455000000000006e-05 2021-10-08T19:42:54.628 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.628 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.629 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:54.629 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:51.377140+0000", 2021-10-08T19:42:54.629 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9828999999999999e-05 2021-10-08T19:42:54.629 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.629 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.630 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:54.630 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:51.377178+0000", 2021-10-08T19:42:54.630 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8257000000000003e-05 2021-10-08T19:42:54.630 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:54.630 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:54.631 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:54.631 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.631 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.631 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDScrubReserve(6.16 RELEASE e504)", 2021-10-08T19:42:54.632 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:42:51.419793+0000", 2021-10-08T19:42:54.632 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 2.9169592280000001, 2021-10-08T19:42:54.632 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015119800000000001, 2021-10-08T19:42:54.632 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:54.632 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2021-10-08T19:42:54.633 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:54.633 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.633 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:54.633 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:51.419793+0000", 2021-10-08T19:42:54.634 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:54.634 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.634 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.634 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:54.634 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:51.419793+0000", 2021-10-08T19:42:54.635 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:54.635 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.635 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.635 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:54.636 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:51.419785+0000", 2021-10-08T19:42:54.636 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999928 2021-10-08T19:42:54.636 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.636 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.636 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:54.637 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:51.419806+0000", 2021-10-08T19:42:54.637 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0163e-05 2021-10-08T19:42:54.637 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.637 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.637 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:54.638 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:51.419830+0000", 2021-10-08T19:42:54.638 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4083e-05 2021-10-08T19:42:54.638 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.638 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.638 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:54.639 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:51.419840+0000", 2021-10-08T19:42:54.639 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0411000000000001e-05 2021-10-08T19:42:54.639 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.639 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.640 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:54.640 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:51.419895+0000", 2021-10-08T19:42:54.640 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5336e-05 2021-10-08T19:42:54.640 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.641 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.641 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:54.641 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:51.419911+0000", 2021-10-08T19:42:54.641 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5395000000000001e-05 2021-10-08T19:42:54.641 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.642 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.642 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:54.642 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:51.419944+0000", 2021-10-08T19:42:54.642 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.3068000000000003e-05 2021-10-08T19:42:54.642 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:54.643 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:54.643 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:54.643 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.643 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.644 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.14457.0:2992 5.9 5:93e5b521:::notify.7:head [watch ping cookie 94629485178112 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e502)", 2021-10-08T19:42:54.644 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:42:51.998341+0000", 2021-10-08T19:42:54.644 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 2.3384109120000001, 2021-10-08T19:42:54.644 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00031715699999999999, 2021-10-08T19:42:54.644 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:54.645 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2021-10-08T19:42:54.645 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2021-10-08T19:42:54.645 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.14457", 2021-10-08T19:42:54.645 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "v1:172.21.15.97:0/1622493358", 2021-10-08T19:42:54.646 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 2992 2021-10-08T19:42:54.646 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.646 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:54.646 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.646 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:54.647 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:51.998341+0000", 2021-10-08T19:42:54.647 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:54.647 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.647 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.648 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:54.648 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:51.998341+0000", 2021-10-08T19:42:54.648 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:54.648 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.648 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.649 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:54.649 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:51.998340+0000", 2021-10-08T19:42:54.649 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999986 2021-10-08T19:42:54.649 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.649 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.650 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:54.650 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:51.998346+0000", 2021-10-08T19:42:54.650 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2389999999999999e-06 2021-10-08T19:42:54.650 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.651 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.651 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:54.651 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:51.998355+0000", 2021-10-08T19:42:54.651 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3880000000000006e-06 2021-10-08T19:42:54.651 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.652 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.652 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:54.652 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:51.998365+0000", 2021-10-08T19:42:54.652 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3179999999999996e-06 2021-10-08T19:42:54.653 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.653 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.653 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:54.653 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:51.998475+0000", 2021-10-08T19:42:54.653 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010997600000000001 2021-10-08T19:42:54.654 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.654 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.654 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:54.654 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:51.998557+0000", 2021-10-08T19:42:54.655 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2164999999999997e-05 2021-10-08T19:42:54.655 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.655 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.655 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:54.655 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:51.998658+0000", 2021-10-08T19:42:54.656 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000101285 2021-10-08T19:42:54.656 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:54.656 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:54.656 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:54.656 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.657 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.657 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDScrubReserve(2.a REQUEST e504)", 2021-10-08T19:42:54.657 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2021-10-08T19:42:53.607108+0000", 2021-10-08T19:42:54.657 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.72964411600000001, 2021-10-08T19:42:54.657 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000201833, 2021-10-08T19:42:54.658 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2021-10-08T19:42:54.658 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2021-10-08T19:42:54.658 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2021-10-08T19:42:54.658 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.659 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2021-10-08T19:42:54.659 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:53.607108+0000", 2021-10-08T19:42:54.659 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:54.659 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.659 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.660 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2021-10-08T19:42:54.660 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:53.607108+0000", 2021-10-08T19:42:54.660 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2021-10-08T19:42:54.660 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.660 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.661 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2021-10-08T19:42:54.661 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:53.607105+0000", 2021-10-08T19:42:54.661 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4294967295.9999967 2021-10-08T19:42:54.661 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.662 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.662 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2021-10-08T19:42:54.662 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:53.607118+0000", 2021-10-08T19:42:54.662 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2972999999999999e-05 2021-10-08T19:42:54.662 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.663 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.663 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2021-10-08T19:42:54.663 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:53.607145+0000", 2021-10-08T19:42:54.663 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7846000000000001e-05 2021-10-08T19:42:54.664 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.664 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.664 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2021-10-08T19:42:54.664 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:53.607159+0000", 2021-10-08T19:42:54.664 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3097e-05 2021-10-08T19:42:54.665 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.665 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.665 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2021-10-08T19:42:54.665 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:53.607234+0000", 2021-10-08T19:42:54.666 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5717999999999996e-05 2021-10-08T19:42:54.666 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.666 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.666 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2021-10-08T19:42:54.666 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:53.607255+0000", 2021-10-08T19:42:54.667 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0392999999999999e-05 2021-10-08T19:42:54.667 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2021-10-08T19:42:54.667 INFO:teuthology.orchestra.run.smithi117.stdout: { 2021-10-08T19:42:54.667 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2021-10-08T19:42:54.668 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2021-10-08T19:42:53.607310+0000", 2021-10-08T19:42:54.668 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4938999999999997e-05 2021-10-08T19:42:54.668 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:54.668 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:54.668 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:54.669 INFO:teuthology.orchestra.run.smithi117.stdout: } 2021-10-08T19:42:54.669 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2021-10-08T19:42:54.669 INFO:teuthology.orchestra.run.smithi117.stdout:} 2021-10-08T19:42:54.670 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:54 smithi097 ceph-mon[32687]: 1.7 scrub ok 2021-10-08T19:42:54.670 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:54 smithi097 ceph-mon[32687]: 4.15 scrub ok 2021-10-08T19:42:54.671 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:54 smithi097 ceph-mon[32687]: pgmap v1069: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:42:54.671 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:54 smithi097 ceph-mon[32687]: 5.1 scrub ok 2021-10-08T19:42:54.671 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:54 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1056298913' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": ".rgw.root", "var": "pgp_num", "val": "42"}]: dispatch 2021-10-08T19:42:54.671 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:54 smithi097 ceph-mon[32687]: 2.a scrub ok 2021-10-08T19:42:54.672 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:54 smithi117 ceph-mon[34585]: 1.7 scrub ok 2021-10-08T19:42:54.672 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:54 smithi117 ceph-mon[34585]: 4.15 scrub ok 2021-10-08T19:42:54.672 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:54 smithi117 ceph-mon[34585]: pgmap v1069: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:42:54.672 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:54 smithi117 ceph-mon[34585]: 5.1 scrub ok 2021-10-08T19:42:54.673 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:54 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1056298913' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": ".rgw.root", "var": "pgp_num", "val": "42"}]: dispatch 2021-10-08T19:42:54.673 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:54 smithi117 ceph-mon[34585]: 2.a scrub ok 2021-10-08T19:42:54.673 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:54 smithi097 ceph-mon[41966]: 1.7 scrub ok 2021-10-08T19:42:54.673 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:54 smithi097 ceph-mon[41966]: 4.15 scrub ok 2021-10-08T19:42:54.674 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:54 smithi097 ceph-mon[41966]: pgmap v1069: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:42:54.674 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:54 smithi097 ceph-mon[41966]: 5.1 scrub ok 2021-10-08T19:42:54.674 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:54 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1056298913' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": ".rgw.root", "var": "pgp_num", "val": "42"}]: dispatch 2021-10-08T19:42:54.674 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:54 smithi097 ceph-mon[41966]: 2.a scrub ok 2021-10-08T19:42:55.296 INFO:tasks.thrashosds.thrasher:fixing pg num pool .mgr 2021-10-08T19:42:55.296 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd pool set .mgr pgp_num 11 2021-10-08T19:42:55.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:55 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1056298913' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": ".rgw.root", "var": "pgp_num", "val": "42"}]': finished 2021-10-08T19:42:55.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:55 smithi117 ceph-mon[34585]: osdmap e505: 8 total, 8 up, 8 in 2021-10-08T19:42:55.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:55 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1056298913' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": ".rgw.root", "var": "pgp_num", "val": "42"}]': finished 2021-10-08T19:42:55.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:55 smithi097 ceph-mon[41966]: osdmap e505: 8 total, 8 up, 8 in 2021-10-08T19:42:55.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:55 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1056298913' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": ".rgw.root", "var": "pgp_num", "val": "42"}]': finished 2021-10-08T19:42:55.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:55 smithi097 ceph-mon[32687]: osdmap e505: 8 total, 8 up, 8 in 2021-10-08T19:42:55.757 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:42:56.436 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:56 smithi097 ceph-mon[41966]: pgmap v1071: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2021-10-08T19:42:56.437 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:56 smithi097 ceph-mon[41966]: 6.11 scrub ok 2021-10-08T19:42:56.437 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:56 smithi097 ceph-mon[41966]: 5.1e scrub ok 2021-10-08T19:42:56.438 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:56 smithi097 ceph-mon[32687]: pgmap v1071: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2021-10-08T19:42:56.438 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:56 smithi097 ceph-mon[32687]: 6.11 scrub ok 2021-10-08T19:42:56.439 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:56 smithi097 ceph-mon[32687]: 5.1e scrub ok 2021-10-08T19:42:56.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:56 smithi117 ceph-mon[34585]: pgmap v1071: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2021-10-08T19:42:56.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:56 smithi117 ceph-mon[34585]: 6.11 scrub ok 2021-10-08T19:42:56.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:56 smithi117 ceph-mon[34585]: 5.1e scrub ok 2021-10-08T19:42:57.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:57 smithi097 ceph-mon[41966]: 6.1c scrub ok 2021-10-08T19:42:57.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:57 smithi097 ceph-mon[41966]: 6.0 scrub ok 2021-10-08T19:42:57.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:57 smithi097 ceph-mon[32687]: 6.1c scrub ok 2021-10-08T19:42:57.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:57 smithi097 ceph-mon[32687]: 6.0 scrub ok 2021-10-08T19:42:57.478 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:57 smithi117 ceph-mon[34585]: 6.1c scrub ok 2021-10-08T19:42:57.479 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:57 smithi117 ceph-mon[34585]: 6.0 scrub ok 2021-10-08T19:42:57.905 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:42:57 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:42:58.193 INFO:teuthology.orchestra.run.smithi097.stderr:set pool 1 pgp_num to 11 2021-10-08T19:42:58.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:58 smithi097 ceph-mon[41966]: 5.4 scrub ok 2021-10-08T19:42:58.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:58 smithi097 ceph-mon[41966]: pgmap v1072: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2021-10-08T19:42:58.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:58 smithi097 ceph-mon[41966]: 2.1b scrub ok 2021-10-08T19:42:58.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:58 smithi097 ceph-mon[41966]: 5.d deep-scrub ok 2021-10-08T19:42:58.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:58 smithi097 ceph-mon[41966]: 4.3 scrub ok 2021-10-08T19:42:58.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:58 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:42:58.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:58 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/927622666' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": ".mgr", "var": "pgp_num", "val": "11"}]: dispatch 2021-10-08T19:42:58.474 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:58 smithi097 ceph-mon[32687]: 5.4 scrub ok 2021-10-08T19:42:58.475 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:58 smithi097 ceph-mon[32687]: pgmap v1072: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2021-10-08T19:42:58.475 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:58 smithi097 ceph-mon[32687]: 2.1b scrub ok 2021-10-08T19:42:58.476 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:58 smithi097 ceph-mon[32687]: 5.d deep-scrub ok 2021-10-08T19:42:58.476 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:58 smithi097 ceph-mon[32687]: 4.3 scrub ok 2021-10-08T19:42:58.476 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:58 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:42:58.477 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:58 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/927622666' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": ".mgr", "var": "pgp_num", "val": "11"}]: dispatch 2021-10-08T19:42:58.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:58 smithi117 ceph-mon[34585]: 5.4 scrub ok 2021-10-08T19:42:58.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:58 smithi117 ceph-mon[34585]: pgmap v1072: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2021-10-08T19:42:58.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:58 smithi117 ceph-mon[34585]: 2.1b scrub ok 2021-10-08T19:42:58.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:58 smithi117 ceph-mon[34585]: 5.d deep-scrub ok 2021-10-08T19:42:58.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:58 smithi117 ceph-mon[34585]: 4.3 scrub ok 2021-10-08T19:42:58.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:58 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:42:58.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:58 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/927622666' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": ".mgr", "var": "pgp_num", "val": "11"}]: dispatch 2021-10-08T19:42:58.954 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2021-10-08T19:42:59.220 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:42:59 smithi097 conmon[33110]: 172.21.15.97 - - [08/Oct/2021:19:42:59] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:42:59.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:59 smithi097 ceph-mon[32687]: 6.8 scrub ok 2021-10-08T19:42:59.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:59 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/927622666' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": ".mgr", "var": "pgp_num", "val": "11"}]': finished 2021-10-08T19:42:59.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:59 smithi097 ceph-mon[32687]: osdmap e506: 8 total, 8 up, 8 in 2021-10-08T19:42:59.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:59 smithi097 ceph-mon[32687]: 3.4 scrub ok 2021-10-08T19:42:59.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:42:59 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:42:59.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:59 smithi097 ceph-mon[41966]: 6.8 scrub ok 2021-10-08T19:42:59.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:59 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/927622666' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": ".mgr", "var": "pgp_num", "val": "11"}]': finished 2021-10-08T19:42:59.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:59 smithi097 ceph-mon[41966]: osdmap e506: 8 total, 8 up, 8 in 2021-10-08T19:42:59.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:59 smithi097 ceph-mon[41966]: 3.4 scrub ok 2021-10-08T19:42:59.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:42:59 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:42:59.243 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:42:59.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:59 smithi117 ceph-mon[34585]: 6.8 scrub ok 2021-10-08T19:42:59.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:59 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/927622666' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": ".mgr", "var": "pgp_num", "val": "11"}]': finished 2021-10-08T19:42:59.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:59 smithi117 ceph-mon[34585]: osdmap e506: 8 total, 8 up, 8 in 2021-10-08T19:42:59.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:59 smithi117 ceph-mon[34585]: 3.4 scrub ok 2021-10-08T19:42:59.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:42:59 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:43:00.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:00 smithi117 ceph-mon[34585]: 2.16 deep-scrub ok 2021-10-08T19:43:00.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:00 smithi117 ceph-mon[34585]: 3.13 scrub ok 2021-10-08T19:43:00.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:00 smithi117 ceph-mon[34585]: pgmap v1074: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:43:00.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:00 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:43:00.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:00 smithi117 ceph-mon[34585]: 172.21.15.97 - - [08/Oct/2021:19:42:59] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:43:00.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:00 smithi117 ceph-mon[34585]: 2.28 scrub ok 2021-10-08T19:43:00.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:00 smithi097 ceph-mon[32687]: 2.16 deep-scrub ok 2021-10-08T19:43:00.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:00 smithi097 ceph-mon[32687]: 3.13 scrub ok 2021-10-08T19:43:00.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:00 smithi097 ceph-mon[32687]: pgmap v1074: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:43:00.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:00 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:43:00.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:00 smithi097 ceph-mon[32687]: 172.21.15.97 - - [08/Oct/2021:19:42:59] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:43:00.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:00 smithi097 ceph-mon[32687]: 2.28 scrub ok 2021-10-08T19:43:00.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:00 smithi097 ceph-mon[41966]: 2.16 deep-scrub ok 2021-10-08T19:43:00.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:00 smithi097 ceph-mon[41966]: 3.13 scrub ok 2021-10-08T19:43:00.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:00 smithi097 ceph-mon[41966]: pgmap v1074: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:43:00.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:00 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:43:00.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:00 smithi097 ceph-mon[41966]: 172.21.15.97 - - [08/Oct/2021:19:42:59] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:43:00.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:00 smithi097 ceph-mon[41966]: 2.28 scrub ok 2021-10-08T19:43:00.925 INFO:teuthology.orchestra.run.smithi097.stdout:mon.a: {} 2021-10-08T19:43:00.934 INFO:teuthology.orchestra.run.smithi097.stdout:mon.c: {} 2021-10-08T19:43:00.944 INFO:teuthology.orchestra.run.smithi097.stdout:mon.b: {} 2021-10-08T19:43:00.945 INFO:teuthology.orchestra.run.smithi097.stderr:mon.a: mon_osd_down_out_interval = '600' (not observed, change may require restart) 2021-10-08T19:43:00.945 INFO:teuthology.orchestra.run.smithi097.stderr:mon.c: mon_osd_down_out_interval = '600' (not observed, change may require restart) 2021-10-08T19:43:00.946 INFO:teuthology.orchestra.run.smithi097.stderr:mon.b: mon_osd_down_out_interval = '600' (not observed, change may require restart) 2021-10-08T19:43:01.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:01 smithi097 ceph-mon[32687]: 4.f deep-scrub ok 2021-10-08T19:43:01.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:01 smithi097 ceph-mon[32687]: 5.3 scrub ok 2021-10-08T19:43:01.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:01 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3127831707' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-10-08T19:43:01.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:01 smithi097 ceph-mon[41966]: 4.f deep-scrub ok 2021-10-08T19:43:01.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:01 smithi097 ceph-mon[41966]: 5.3 scrub ok 2021-10-08T19:43:01.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:01 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3127831707' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-10-08T19:43:01.592 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd reweight 0 1 2021-10-08T19:43:01.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:01 smithi117 ceph-mon[34585]: 4.f deep-scrub ok 2021-10-08T19:43:01.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:01 smithi117 ceph-mon[34585]: 5.3 scrub ok 2021-10-08T19:43:01.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:01 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3127831707' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-10-08T19:43:01.865 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:43:02.376 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:02 smithi097 ceph-mon[32687]: pgmap v1075: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:02.377 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:02 smithi097 ceph-mon[32687]: 4.2 scrub ok 2021-10-08T19:43:02.377 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:02 smithi097 ceph-mon[41966]: pgmap v1075: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:02.377 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:02 smithi097 ceph-mon[41966]: 4.2 scrub ok 2021-10-08T19:43:02.660 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:43:02 smithi117 conmon[69189]: level=error ts=2021-10-08T19:43:02.314Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=1 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:43:02.663 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:02 smithi117 ceph-mon[34585]: pgmap v1075: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:02.665 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:02 smithi117 ceph-mon[34585]: 4.2 scrub ok 2021-10-08T19:43:02.970 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:43:02 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:43:02] "GET /metrics HTTP/1.1" 200 154878 "" "Prometheus/2.18.1" 2021-10-08T19:43:03.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:03 smithi097 ceph-mon[41966]: 5.f scrub ok 2021-10-08T19:43:03.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:03 smithi097 ceph-mon[32687]: 5.f scrub ok 2021-10-08T19:43:03.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:03 smithi117 ceph-mon[34585]: 5.f scrub ok 2021-10-08T19:43:04.156 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:43:03 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:43:03] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:43:04.214 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.0 to 1 (10000) 2021-10-08T19:43:04.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:04 smithi097 ceph-mon[32687]: 5.e scrub ok 2021-10-08T19:43:04.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:04 smithi097 ceph-mon[32687]: pgmap v1076: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-10-08T19:43:04.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:04 smithi097 ceph-mon[32687]: 3.2 scrub ok 2021-10-08T19:43:04.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:04 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1916023278' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2021-10-08T19:43:04.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:04 smithi097 ceph-mon[41966]: 5.e scrub ok 2021-10-08T19:43:04.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:04 smithi097 ceph-mon[41966]: pgmap v1076: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-10-08T19:43:04.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:04 smithi097 ceph-mon[41966]: 3.2 scrub ok 2021-10-08T19:43:04.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:04 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1916023278' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2021-10-08T19:43:04.659 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:04 smithi117 ceph-mon[34585]: 5.e scrub ok 2021-10-08T19:43:04.660 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:04 smithi117 ceph-mon[34585]: pgmap v1076: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-10-08T19:43:04.660 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:04 smithi117 ceph-mon[34585]: 3.2 scrub ok 2021-10-08T19:43:04.660 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:04 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1916023278' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2021-10-08T19:43:04.879 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd primary-affinity 0 1 2021-10-08T19:43:05.153 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:43:05.211 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:43:04 smithi097 conmon[33110]: 172.21.15.117 - - [08/Oct/2021:19:43:04] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:43:05.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:05 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1916023278' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2021-10-08T19:43:05.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:05 smithi097 ceph-mon[32687]: osdmap e507: 8 total, 8 up, 8 in 2021-10-08T19:43:05.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:05 smithi097 ceph-mon[32687]: 6.1f scrub ok 2021-10-08T19:43:05.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:05 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:43:05.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:05 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1916023278' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2021-10-08T19:43:05.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:05 smithi097 ceph-mon[41966]: osdmap e507: 8 total, 8 up, 8 in 2021-10-08T19:43:05.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:05 smithi097 ceph-mon[41966]: 6.1f scrub ok 2021-10-08T19:43:05.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:05 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:43:05.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:05 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1916023278' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2021-10-08T19:43:05.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:05 smithi117 ceph-mon[34585]: osdmap e507: 8 total, 8 up, 8 in 2021-10-08T19:43:05.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:05 smithi117 ceph-mon[34585]: 6.1f scrub ok 2021-10-08T19:43:05.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:05 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:43:06.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:06 smithi097 ceph-mon[32687]: 5.11 scrub ok 2021-10-08T19:43:06.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:06 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:43:06.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:06 smithi097 ceph-mon[32687]: 172.21.15.117 - - [08/Oct/2021:19:43:04] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:43:06.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:06 smithi097 ceph-mon[32687]: pgmap v1078: 172 pgs: 1 active+clean+scrubbing, 171 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:06.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:06 smithi097 ceph-mon[32687]: 3.e deep-scrub ok 2021-10-08T19:43:06.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:06 smithi097 ceph-mon[32687]: 2.c scrub ok 2021-10-08T19:43:06.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:06 smithi097 ceph-mon[32687]: 2.6 scrub ok 2021-10-08T19:43:06.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:06 smithi097 ceph-mon[41966]: 5.11 scrub ok 2021-10-08T19:43:06.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:06 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:43:06.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:06 smithi097 ceph-mon[41966]: 172.21.15.117 - - [08/Oct/2021:19:43:04] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:43:06.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:06 smithi097 ceph-mon[41966]: pgmap v1078: 172 pgs: 1 active+clean+scrubbing, 171 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:06.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:06 smithi097 ceph-mon[41966]: 3.e deep-scrub ok 2021-10-08T19:43:06.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:06 smithi097 ceph-mon[41966]: 2.c scrub ok 2021-10-08T19:43:06.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:06 smithi097 ceph-mon[41966]: 2.6 scrub ok 2021-10-08T19:43:06.659 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:06 smithi117 ceph-mon[34585]: 5.11 scrub ok 2021-10-08T19:43:06.659 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:06 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:43:06.660 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:06 smithi117 ceph-mon[34585]: 172.21.15.117 - - [08/Oct/2021:19:43:04] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:43:06.660 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:06 smithi117 ceph-mon[34585]: pgmap v1078: 172 pgs: 1 active+clean+scrubbing, 171 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:06.660 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:06 smithi117 ceph-mon[34585]: 3.e deep-scrub ok 2021-10-08T19:43:06.660 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:06 smithi117 ceph-mon[34585]: 2.c scrub ok 2021-10-08T19:43:06.660 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:06 smithi117 ceph-mon[34585]: 2.6 scrub ok 2021-10-08T19:43:07.231 INFO:teuthology.orchestra.run.smithi097.stderr:set osd.0 primary-affinity to 1 (8655362) 2021-10-08T19:43:07.482 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:07 smithi117 ceph-mon[34585]: 4.1a scrub ok 2021-10-08T19:43:07.483 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:07 smithi117 ceph-mon[34585]: 2.3 scrub ok 2021-10-08T19:43:07.483 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:07 smithi117 ceph-mon[34585]: 6.b scrub ok 2021-10-08T19:43:07.483 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:07 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/4020757005' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 0, "weight": 1.0}]: dispatch 2021-10-08T19:43:07.483 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:07 smithi117 ceph-mon[34585]: from='client.26464 ' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 0, "weight": 1.0}]: dispatch 2021-10-08T19:43:07.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:07 smithi097 ceph-mon[32687]: 4.1a scrub ok 2021-10-08T19:43:07.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:07 smithi097 ceph-mon[32687]: 2.3 scrub ok 2021-10-08T19:43:07.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:07 smithi097 ceph-mon[32687]: 6.b scrub ok 2021-10-08T19:43:07.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:07 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/4020757005' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 0, "weight": 1.0}]: dispatch 2021-10-08T19:43:07.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:07 smithi097 ceph-mon[32687]: from='client.26464 ' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 0, "weight": 1.0}]: dispatch 2021-10-08T19:43:07.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:07 smithi097 ceph-mon[41966]: 4.1a scrub ok 2021-10-08T19:43:07.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:07 smithi097 ceph-mon[41966]: 2.3 scrub ok 2021-10-08T19:43:07.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:07 smithi097 ceph-mon[41966]: 6.b scrub ok 2021-10-08T19:43:07.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:07 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/4020757005' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 0, "weight": 1.0}]: dispatch 2021-10-08T19:43:07.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:07 smithi097 ceph-mon[41966]: from='client.26464 ' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 0, "weight": 1.0}]: dispatch 2021-10-08T19:43:07.876 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd reweight 1 1 2021-10-08T19:43:07.905 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:43:07 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:43:08.149 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:43:08.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:08 smithi117 ceph-mon[34585]: pgmap v1079: 172 pgs: 1 active+clean+scrubbing, 171 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-10-08T19:43:08.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:08 smithi117 ceph-mon[34585]: 5.9 scrub ok 2021-10-08T19:43:08.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:08 smithi117 ceph-mon[34585]: from='client.26464 ' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 0, "weight": 1.0}]': finished 2021-10-08T19:43:08.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:08 smithi117 ceph-mon[34585]: osdmap e508: 8 total, 8 up, 8 in 2021-10-08T19:43:08.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:08 smithi117 ceph-mon[34585]: 1.4 scrub ok 2021-10-08T19:43:08.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:08 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:43:08.665 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:08 smithi097 ceph-mon[41966]: pgmap v1079: 172 pgs: 1 active+clean+scrubbing, 171 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-10-08T19:43:08.666 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:08 smithi097 ceph-mon[41966]: 5.9 scrub ok 2021-10-08T19:43:08.666 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:08 smithi097 ceph-mon[41966]: from='client.26464 ' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 0, "weight": 1.0}]': finished 2021-10-08T19:43:08.666 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:08 smithi097 ceph-mon[41966]: osdmap e508: 8 total, 8 up, 8 in 2021-10-08T19:43:08.666 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:08 smithi097 ceph-mon[41966]: 1.4 scrub ok 2021-10-08T19:43:08.666 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:08 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:43:08.667 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:08 smithi097 ceph-mon[32687]: pgmap v1079: 172 pgs: 1 active+clean+scrubbing, 171 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-10-08T19:43:08.667 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:08 smithi097 ceph-mon[32687]: 5.9 scrub ok 2021-10-08T19:43:08.667 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:08 smithi097 ceph-mon[32687]: from='client.26464 ' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 0, "weight": 1.0}]': finished 2021-10-08T19:43:08.668 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:08 smithi097 ceph-mon[32687]: osdmap e508: 8 total, 8 up, 8 in 2021-10-08T19:43:08.668 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:08 smithi097 ceph-mon[32687]: 1.4 scrub ok 2021-10-08T19:43:08.668 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:08 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:43:09.629 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:09 smithi097 ceph-mon[41966]: 2.24 scrub ok 2021-10-08T19:43:09.629 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:09 smithi097 ceph-mon[41966]: 4.14 scrub ok 2021-10-08T19:43:09.630 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:09 smithi097 ceph-mon[32687]: 2.24 scrub ok 2021-10-08T19:43:09.631 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:09 smithi097 ceph-mon[32687]: 4.14 scrub ok 2021-10-08T19:43:09.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:09 smithi117 ceph-mon[34585]: 2.24 scrub ok 2021-10-08T19:43:09.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:09 smithi117 ceph-mon[34585]: 4.14 scrub ok 2021-10-08T19:43:10.239 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.1 to 1 (10000) 2021-10-08T19:43:10.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:10 smithi117 ceph-mon[34585]: pgmap v1081: 172 pgs: 1 active+clean+scrubbing, 171 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:43:10.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:10 smithi117 ceph-mon[34585]: 6.3 scrub ok 2021-10-08T19:43:10.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:10 smithi117 ceph-mon[34585]: 5.8 scrub ok 2021-10-08T19:43:10.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:10 smithi117 ceph-mon[34585]: 6.1d scrub ok 2021-10-08T19:43:10.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:10 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1969407678' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2021-10-08T19:43:10.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:10 smithi117 ceph-mon[34585]: from='client.26470 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2021-10-08T19:43:10.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:10 smithi097 ceph-mon[41966]: pgmap v1081: 172 pgs: 1 active+clean+scrubbing, 171 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:43:10.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:10 smithi097 ceph-mon[41966]: 6.3 scrub ok 2021-10-08T19:43:10.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:10 smithi097 ceph-mon[41966]: 5.8 scrub ok 2021-10-08T19:43:10.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:10 smithi097 ceph-mon[41966]: 6.1d scrub ok 2021-10-08T19:43:10.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:10 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1969407678' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2021-10-08T19:43:10.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:10 smithi097 ceph-mon[41966]: from='client.26470 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2021-10-08T19:43:10.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:10 smithi097 ceph-mon[32687]: pgmap v1081: 172 pgs: 1 active+clean+scrubbing, 171 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:43:10.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:10 smithi097 ceph-mon[32687]: 6.3 scrub ok 2021-10-08T19:43:10.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:10 smithi097 ceph-mon[32687]: 5.8 scrub ok 2021-10-08T19:43:10.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:10 smithi097 ceph-mon[32687]: 6.1d scrub ok 2021-10-08T19:43:10.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:10 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1969407678' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2021-10-08T19:43:10.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:10 smithi097 ceph-mon[32687]: from='client.26470 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2021-10-08T19:43:10.924 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd primary-affinity 1 1 2021-10-08T19:43:11.210 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:43:11.493 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:11 smithi097 ceph-mon[41966]: 4.a scrub ok 2021-10-08T19:43:11.493 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:11 smithi097 ceph-mon[41966]: from='client.26470 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2021-10-08T19:43:11.494 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:11 smithi097 ceph-mon[41966]: osdmap e509: 8 total, 8 up, 8 in 2021-10-08T19:43:11.498 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:11 smithi097 ceph-mon[32687]: 4.a scrub ok 2021-10-08T19:43:11.498 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:11 smithi097 ceph-mon[32687]: from='client.26470 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2021-10-08T19:43:11.498 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:11 smithi097 ceph-mon[32687]: osdmap e509: 8 total, 8 up, 8 in 2021-10-08T19:43:11.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:11 smithi117 ceph-mon[34585]: 4.a scrub ok 2021-10-08T19:43:11.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:11 smithi117 ceph-mon[34585]: from='client.26470 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2021-10-08T19:43:11.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:11 smithi117 ceph-mon[34585]: osdmap e509: 8 total, 8 up, 8 in 2021-10-08T19:43:12.636 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:12 smithi097 ceph-mon[41966]: pgmap v1083: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2021-10-08T19:43:12.636 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:12 smithi097 ceph-mon[41966]: 2.b scrub ok 2021-10-08T19:43:12.637 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:12 smithi097 ceph-mon[32687]: pgmap v1083: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2021-10-08T19:43:12.637 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:12 smithi097 ceph-mon[32687]: 2.b scrub ok 2021-10-08T19:43:12.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:12 smithi117 ceph-mon[34585]: pgmap v1083: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2021-10-08T19:43:12.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:12 smithi117 ceph-mon[34585]: 2.b scrub ok 2021-10-08T19:43:12.970 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:43:12 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:43:12] "GET /metrics HTTP/1.1" 200 154880 "" "Prometheus/2.18.1" 2021-10-08T19:43:13.243 INFO:teuthology.orchestra.run.smithi097.stderr:set osd.1 primary-affinity to 1 (8655362) 2021-10-08T19:43:13.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:13 smithi117 ceph-mon[34585]: 2.1a scrub ok 2021-10-08T19:43:13.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:13 smithi117 ceph-mon[34585]: 2.23 deep-scrub ok 2021-10-08T19:43:13.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:13 smithi117 ceph-mon[34585]: 2.10 scrub ok 2021-10-08T19:43:13.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:13 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3595789427' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 1, "weight": 1.0}]: dispatch 2021-10-08T19:43:13.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:13 smithi117 ceph-mon[34585]: from='client.26476 ' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 1, "weight": 1.0}]: dispatch 2021-10-08T19:43:13.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:13 smithi097 ceph-mon[32687]: 2.1a scrub ok 2021-10-08T19:43:13.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:13 smithi097 ceph-mon[32687]: 2.23 deep-scrub ok 2021-10-08T19:43:13.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:13 smithi097 ceph-mon[32687]: 2.10 scrub ok 2021-10-08T19:43:13.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:13 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3595789427' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 1, "weight": 1.0}]: dispatch 2021-10-08T19:43:13.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:13 smithi097 ceph-mon[32687]: from='client.26476 ' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 1, "weight": 1.0}]: dispatch 2021-10-08T19:43:13.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:13 smithi097 ceph-mon[41966]: 2.1a scrub ok 2021-10-08T19:43:13.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:13 smithi097 ceph-mon[41966]: 2.23 deep-scrub ok 2021-10-08T19:43:13.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:13 smithi097 ceph-mon[41966]: 2.10 scrub ok 2021-10-08T19:43:13.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:13 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3595789427' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 1, "weight": 1.0}]: dispatch 2021-10-08T19:43:13.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:13 smithi097 ceph-mon[41966]: from='client.26476 ' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 1, "weight": 1.0}]: dispatch 2021-10-08T19:43:13.918 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd reweight 2 1 2021-10-08T19:43:14.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:43:13 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:43:13] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:43:14.197 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:43:14.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:14 smithi117 ceph-mon[34585]: pgmap v1084: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:43:14.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:14 smithi117 ceph-mon[34585]: 5.1c scrub ok 2021-10-08T19:43:14.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:14 smithi117 ceph-mon[34585]: 4.8 scrub ok 2021-10-08T19:43:14.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:14 smithi117 ceph-mon[34585]: from='client.26476 ' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 1, "weight": 1.0}]': finished 2021-10-08T19:43:14.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:14 smithi117 ceph-mon[34585]: osdmap e510: 8 total, 8 up, 8 in 2021-10-08T19:43:14.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:14 smithi117 ceph-mon[34585]: 5.a scrub ok 2021-10-08T19:43:14.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:14 smithi097 ceph-mon[41966]: pgmap v1084: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:43:14.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:14 smithi097 ceph-mon[41966]: 5.1c scrub ok 2021-10-08T19:43:14.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:14 smithi097 ceph-mon[41966]: 4.8 scrub ok 2021-10-08T19:43:14.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:14 smithi097 ceph-mon[41966]: from='client.26476 ' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 1, "weight": 1.0}]': finished 2021-10-08T19:43:14.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:14 smithi097 ceph-mon[41966]: osdmap e510: 8 total, 8 up, 8 in 2021-10-08T19:43:14.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:14 smithi097 ceph-mon[41966]: 5.a scrub ok 2021-10-08T19:43:14.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:14 smithi097 ceph-mon[32687]: pgmap v1084: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:43:14.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:14 smithi097 ceph-mon[32687]: 5.1c scrub ok 2021-10-08T19:43:14.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:14 smithi097 ceph-mon[32687]: 4.8 scrub ok 2021-10-08T19:43:14.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:14 smithi097 ceph-mon[32687]: from='client.26476 ' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 1, "weight": 1.0}]': finished 2021-10-08T19:43:14.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:14 smithi097 ceph-mon[32687]: osdmap e510: 8 total, 8 up, 8 in 2021-10-08T19:43:14.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:14 smithi097 ceph-mon[32687]: 5.a scrub ok 2021-10-08T19:43:15.578 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:15 smithi097 ceph-mon[41966]: 5.6 scrub ok 2021-10-08T19:43:15.578 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:15 smithi097 ceph-mon[32687]: 5.6 scrub ok 2021-10-08T19:43:15.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:15 smithi117 ceph-mon[34585]: 5.6 scrub ok 2021-10-08T19:43:16.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:16 smithi117 ceph-mon[34585]: pgmap v1086: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2021-10-08T19:43:16.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:16 smithi117 ceph-mon[34585]: 3.5 scrub ok 2021-10-08T19:43:16.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:16 smithi117 ceph-mon[34585]: 6.f scrub ok 2021-10-08T19:43:16.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:16 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2891227620' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2021-10-08T19:43:16.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:16 smithi097 ceph-mon[32687]: pgmap v1086: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2021-10-08T19:43:16.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:16 smithi097 ceph-mon[32687]: 3.5 scrub ok 2021-10-08T19:43:16.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:16 smithi097 ceph-mon[32687]: 6.f scrub ok 2021-10-08T19:43:16.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:16 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2891227620' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2021-10-08T19:43:16.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:16 smithi097 ceph-mon[41966]: pgmap v1086: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2021-10-08T19:43:16.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:16 smithi097 ceph-mon[41966]: 3.5 scrub ok 2021-10-08T19:43:16.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:16 smithi097 ceph-mon[41966]: 6.f scrub ok 2021-10-08T19:43:16.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:16 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2891227620' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2021-10-08T19:43:16.954 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.2 to 1 (10000) 2021-10-08T19:43:17.625 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:17 smithi097 ceph-mon[32687]: 4.b scrub ok 2021-10-08T19:43:17.625 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:17 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2891227620' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2021-10-08T19:43:17.625 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:17 smithi097 ceph-mon[32687]: osdmap e511: 8 total, 8 up, 8 in 2021-10-08T19:43:17.626 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:17 smithi097 ceph-mon[41966]: 4.b scrub ok 2021-10-08T19:43:17.626 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:17 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2891227620' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2021-10-08T19:43:17.626 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:17 smithi097 ceph-mon[41966]: osdmap e511: 8 total, 8 up, 8 in 2021-10-08T19:43:17.628 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd primary-affinity 2 1 2021-10-08T19:43:17.655 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:43:17 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:43:17.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:17 smithi117 ceph-mon[34585]: 4.b scrub ok 2021-10-08T19:43:17.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:17 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2891227620' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2021-10-08T19:43:17.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:17 smithi117 ceph-mon[34585]: osdmap e511: 8 total, 8 up, 8 in 2021-10-08T19:43:17.911 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:43:18.443 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:18 smithi097 ceph-mon[41966]: pgmap v1088: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 750 B/s rd, 0 op/s 2021-10-08T19:43:18.444 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:18 smithi097 ceph-mon[41966]: 4.10 scrub ok 2021-10-08T19:43:18.444 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:18 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:43:18.445 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:18 smithi097 ceph-mon[41966]: 4.7 scrub ok 2021-10-08T19:43:18.445 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:18 smithi097 ceph-mon[41966]: 6.a scrub ok 2021-10-08T19:43:18.445 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:18 smithi097 ceph-mon[32687]: pgmap v1088: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 750 B/s rd, 0 op/s 2021-10-08T19:43:18.445 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:18 smithi097 ceph-mon[32687]: 4.10 scrub ok 2021-10-08T19:43:18.446 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:18 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:43:18.446 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:18 smithi097 ceph-mon[32687]: 4.7 scrub ok 2021-10-08T19:43:18.446 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:18 smithi097 ceph-mon[32687]: 6.a scrub ok 2021-10-08T19:43:18.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:18 smithi117 ceph-mon[34585]: pgmap v1088: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 750 B/s rd, 0 op/s 2021-10-08T19:43:18.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:18 smithi117 ceph-mon[34585]: 4.10 scrub ok 2021-10-08T19:43:18.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:18 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:43:18.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:18 smithi117 ceph-mon[34585]: 4.7 scrub ok 2021-10-08T19:43:18.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:18 smithi117 ceph-mon[34585]: 6.a scrub ok 2021-10-08T19:43:19.511 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:19 smithi097 ceph-mon[32687]: 2.21 scrub ok 2021-10-08T19:43:19.512 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:19 smithi097 ceph-mon[41966]: 2.21 scrub ok 2021-10-08T19:43:19.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:19 smithi117 ceph-mon[34585]: 2.21 scrub ok 2021-10-08T19:43:20.264 INFO:teuthology.orchestra.run.smithi097.stderr:set osd.2 primary-affinity to 1 (8655362) 2021-10-08T19:43:20.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:20 smithi117 ceph-mon[34585]: pgmap v1089: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:43:20.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:20 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/2750769997' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 2, "weight": 1.0}]: dispatch 2021-10-08T19:43:20.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:20 smithi117 ceph-mon[34585]: from='client.26488 ' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 2, "weight": 1.0}]: dispatch 2021-10-08T19:43:20.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:20 smithi097 ceph-mon[32687]: pgmap v1089: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:43:20.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:20 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/2750769997' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 2, "weight": 1.0}]: dispatch 2021-10-08T19:43:20.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:20 smithi097 ceph-mon[32687]: from='client.26488 ' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 2, "weight": 1.0}]: dispatch 2021-10-08T19:43:20.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:20 smithi097 ceph-mon[41966]: pgmap v1089: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:43:20.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:20 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/2750769997' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 2, "weight": 1.0}]: dispatch 2021-10-08T19:43:20.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:20 smithi097 ceph-mon[41966]: from='client.26488 ' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 2, "weight": 1.0}]: dispatch 2021-10-08T19:43:20.942 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd reweight 3 1 2021-10-08T19:43:21.292 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:43:21.585 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:21 smithi097 ceph-mon[41966]: 4.17 scrub ok 2021-10-08T19:43:21.585 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:21 smithi097 ceph-mon[41966]: from='client.26488 ' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 2, "weight": 1.0}]': finished 2021-10-08T19:43:21.585 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:21 smithi097 ceph-mon[41966]: osdmap e512: 8 total, 8 up, 8 in 2021-10-08T19:43:21.586 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:21 smithi097 ceph-mon[41966]: 2.1 deep-scrub ok 2021-10-08T19:43:21.586 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:21 smithi097 ceph-mon[32687]: 4.17 scrub ok 2021-10-08T19:43:21.586 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:21 smithi097 ceph-mon[32687]: from='client.26488 ' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 2, "weight": 1.0}]': finished 2021-10-08T19:43:21.586 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:21 smithi097 ceph-mon[32687]: osdmap e512: 8 total, 8 up, 8 in 2021-10-08T19:43:21.587 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:21 smithi097 ceph-mon[32687]: 2.1 deep-scrub ok 2021-10-08T19:43:21.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:21 smithi117 ceph-mon[34585]: 4.17 scrub ok 2021-10-08T19:43:21.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:21 smithi117 ceph-mon[34585]: from='client.26488 ' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 2, "weight": 1.0}]': finished 2021-10-08T19:43:21.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:21 smithi117 ceph-mon[34585]: osdmap e512: 8 total, 8 up, 8 in 2021-10-08T19:43:21.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:21 smithi117 ceph-mon[34585]: 2.1 deep-scrub ok 2021-10-08T19:43:22.648 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:22 smithi097 ceph-mon[41966]: 2.18 scrub ok 2021-10-08T19:43:22.649 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:22 smithi097 ceph-mon[41966]: pgmap v1091: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2021-10-08T19:43:22.649 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:22 smithi097 ceph-mon[41966]: 4.1e deep-scrub ok 2021-10-08T19:43:22.649 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:22 smithi097 ceph-mon[32687]: 2.18 scrub ok 2021-10-08T19:43:22.650 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:22 smithi097 ceph-mon[32687]: pgmap v1091: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2021-10-08T19:43:22.650 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:22 smithi097 ceph-mon[32687]: 4.1e deep-scrub ok 2021-10-08T19:43:22.655 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:43:22 smithi117 conmon[69189]: level=error ts=2021-10-08T19:43:22.314Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=6 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:43:22.655 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:43:22 smithi117 conmon[69189]: level=error ts=2021-10-08T19:43:22.314Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=1 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:43:22.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:22 smithi117 ceph-mon[34585]: 2.18 scrub ok 2021-10-08T19:43:22.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:22 smithi117 ceph-mon[34585]: pgmap v1091: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2021-10-08T19:43:22.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:22 smithi117 ceph-mon[34585]: 4.1e deep-scrub ok 2021-10-08T19:43:22.970 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:43:22 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:43:22] "GET /metrics HTTP/1.1" 200 154880 "" "Prometheus/2.18.1" 2021-10-08T19:43:23.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:23 smithi097 ceph-mon[32687]: 6.19 scrub ok 2021-10-08T19:43:23.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:23 smithi097 ceph-mon[32687]: 3.10 scrub ok 2021-10-08T19:43:23.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:23 smithi097 ceph-mon[41966]: 6.19 scrub ok 2021-10-08T19:43:23.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:23 smithi097 ceph-mon[41966]: 3.10 scrub ok 2021-10-08T19:43:23.656 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:43:23 smithi117 conmon[69189]: level=error ts=2021-10-08T19:43:23.505Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=2 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:43:23.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:23 smithi117 ceph-mon[34585]: 6.19 scrub ok 2021-10-08T19:43:23.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:23 smithi117 ceph-mon[34585]: 3.10 scrub ok 2021-10-08T19:43:24.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:43:23 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:43:23] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:43:24.286 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.3 to 1 (10000) 2021-10-08T19:43:24.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:24 smithi117 ceph-mon[34585]: pgmap v1092: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:43:24.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:24 smithi117 ceph-mon[34585]: 3.b scrub ok 2021-10-08T19:43:24.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:24 smithi117 ceph-mon[34585]: 2.0 scrub ok 2021-10-08T19:43:24.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:24 smithi117 ceph-mon[34585]: 5.c scrub ok 2021-10-08T19:43:24.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:24 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3137303565' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2021-10-08T19:43:24.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:24 smithi117 ceph-mon[34585]: from='client.26494 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2021-10-08T19:43:24.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:24 smithi097 ceph-mon[32687]: pgmap v1092: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:43:24.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:24 smithi097 ceph-mon[32687]: 3.b scrub ok 2021-10-08T19:43:24.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:24 smithi097 ceph-mon[32687]: 2.0 scrub ok 2021-10-08T19:43:24.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:24 smithi097 ceph-mon[32687]: 5.c scrub ok 2021-10-08T19:43:24.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:24 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3137303565' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2021-10-08T19:43:24.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:24 smithi097 ceph-mon[32687]: from='client.26494 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2021-10-08T19:43:24.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:24 smithi097 ceph-mon[41966]: pgmap v1092: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:43:24.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:24 smithi097 ceph-mon[41966]: 3.b scrub ok 2021-10-08T19:43:24.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:24 smithi097 ceph-mon[41966]: 2.0 scrub ok 2021-10-08T19:43:24.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:24 smithi097 ceph-mon[41966]: 5.c scrub ok 2021-10-08T19:43:24.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:24 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3137303565' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2021-10-08T19:43:24.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:24 smithi097 ceph-mon[41966]: from='client.26494 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2021-10-08T19:43:24.959 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd primary-affinity 3 1 2021-10-08T19:43:25.403 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:43:25.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:25 smithi117 ceph-mon[34585]: from='client.26494 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2021-10-08T19:43:25.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:25 smithi117 ceph-mon[34585]: osdmap e513: 8 total, 8 up, 8 in 2021-10-08T19:43:25.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:25 smithi097 ceph-mon[41966]: from='client.26494 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2021-10-08T19:43:25.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:25 smithi097 ceph-mon[41966]: osdmap e513: 8 total, 8 up, 8 in 2021-10-08T19:43:25.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:25 smithi097 ceph-mon[32687]: from='client.26494 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2021-10-08T19:43:25.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:25 smithi097 ceph-mon[32687]: osdmap e513: 8 total, 8 up, 8 in 2021-10-08T19:43:26.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:26 smithi097 ceph-mon[32687]: 2.1d scrub ok 2021-10-08T19:43:26.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:26 smithi097 ceph-mon[32687]: pgmap v1094: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:26.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:26 smithi097 ceph-mon[32687]: 3.6 scrub ok 2021-10-08T19:43:26.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:26 smithi097 ceph-mon[41966]: 2.1d scrub ok 2021-10-08T19:43:26.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:26 smithi097 ceph-mon[41966]: pgmap v1094: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:26.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:26 smithi097 ceph-mon[41966]: 3.6 scrub ok 2021-10-08T19:43:26.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:26 smithi117 ceph-mon[34585]: 2.1d scrub ok 2021-10-08T19:43:26.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:26 smithi117 ceph-mon[34585]: pgmap v1094: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:26.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:26 smithi117 ceph-mon[34585]: 3.6 scrub ok 2021-10-08T19:43:27.101 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:43:26 smithi097 conmon[33110]: 172.21.15.97 - - [08/Oct/2021:19:43:26] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:43:27.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:27 smithi117 ceph-mon[34585]: 3.11 scrub ok 2021-10-08T19:43:27.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:27 smithi117 ceph-mon[34585]: 6.9 deep-scrub ok 2021-10-08T19:43:27.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:27 smithi117 ceph-mon[34585]: 4.1c scrub ok 2021-10-08T19:43:27.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:27 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:43:27.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:27 smithi097 ceph-mon[32687]: 3.11 scrub ok 2021-10-08T19:43:27.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:27 smithi097 ceph-mon[32687]: 6.9 deep-scrub ok 2021-10-08T19:43:27.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:27 smithi097 ceph-mon[32687]: 4.1c scrub ok 2021-10-08T19:43:27.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:27 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:43:27.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:27 smithi097 ceph-mon[41966]: 3.11 scrub ok 2021-10-08T19:43:27.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:27 smithi097 ceph-mon[41966]: 6.9 deep-scrub ok 2021-10-08T19:43:27.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:27 smithi097 ceph-mon[41966]: 4.1c scrub ok 2021-10-08T19:43:27.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:27 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:43:27.906 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:43:27 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:43:28.297 INFO:teuthology.orchestra.run.smithi097.stderr:set osd.3 primary-affinity to 1 (8655362) 2021-10-08T19:43:28.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:28 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:43:28.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:28 smithi117 ceph-mon[34585]: 172.21.15.97 - - [08/Oct/2021:19:43:26] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:43:28.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:28 smithi117 ceph-mon[34585]: 2.f scrub ok 2021-10-08T19:43:28.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:28 smithi117 ceph-mon[34585]: pgmap v1095: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:28.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:28 smithi117 ceph-mon[34585]: 6.5 scrub ok 2021-10-08T19:43:28.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:28 smithi117 ceph-mon[34585]: 4.1d scrub ok 2021-10-08T19:43:28.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:28 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3487264069' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 3, "weight": 1.0}]: dispatch 2021-10-08T19:43:28.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:28 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:43:28.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:28 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:43:28.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:28 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:43:28.659 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:28 smithi117 ceph-mon[34585]: 5.b scrub ok 2021-10-08T19:43:28.659 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:28 smithi117 ceph-mon[34585]: 1.6 scrub ok 2021-10-08T19:43:28.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:28 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:43:28.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:28 smithi097 ceph-mon[32687]: 172.21.15.97 - - [08/Oct/2021:19:43:26] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:43:28.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:28 smithi097 ceph-mon[32687]: 2.f scrub ok 2021-10-08T19:43:28.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:28 smithi097 ceph-mon[32687]: pgmap v1095: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:28.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:28 smithi097 ceph-mon[32687]: 6.5 scrub ok 2021-10-08T19:43:28.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:28 smithi097 ceph-mon[32687]: 4.1d scrub ok 2021-10-08T19:43:28.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:28 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3487264069' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 3, "weight": 1.0}]: dispatch 2021-10-08T19:43:28.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:28 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:43:28.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:28 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:43:28.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:28 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:43:28.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:28 smithi097 ceph-mon[32687]: 5.b scrub ok 2021-10-08T19:43:28.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:28 smithi097 ceph-mon[32687]: 1.6 scrub ok 2021-10-08T19:43:28.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:28 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:43:28.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:28 smithi097 ceph-mon[41966]: 172.21.15.97 - - [08/Oct/2021:19:43:26] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:43:28.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:28 smithi097 ceph-mon[41966]: 2.f scrub ok 2021-10-08T19:43:28.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:28 smithi097 ceph-mon[41966]: pgmap v1095: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:28.725 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:28 smithi097 ceph-mon[41966]: 6.5 scrub ok 2021-10-08T19:43:28.725 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:28 smithi097 ceph-mon[41966]: 4.1d scrub ok 2021-10-08T19:43:28.726 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:28 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3487264069' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 3, "weight": 1.0}]: dispatch 2021-10-08T19:43:28.726 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:28 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:43:28.726 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:28 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:43:28.726 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:28 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:43:28.726 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:28 smithi097 ceph-mon[41966]: 5.b scrub ok 2021-10-08T19:43:28.727 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:28 smithi097 ceph-mon[41966]: 1.6 scrub ok 2021-10-08T19:43:28.998 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd reweight 4 1 2021-10-08T19:43:29.270 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:43:29.307 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:29 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3487264069' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 3, "weight": 1.0}]': finished 2021-10-08T19:43:29.308 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:29 smithi097 ceph-mon[32687]: osdmap e514: 8 total, 8 up, 8 in 2021-10-08T19:43:29.308 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:29 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:43:29.308 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:29 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:43:29.309 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:29 smithi097 ceph-mon[32687]: 4.4 scrub ok 2021-10-08T19:43:29.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:29 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3487264069' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 3, "weight": 1.0}]': finished 2021-10-08T19:43:29.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:29 smithi117 ceph-mon[34585]: osdmap e514: 8 total, 8 up, 8 in 2021-10-08T19:43:29.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:29 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:43:29.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:29 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:43:29.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:29 smithi117 ceph-mon[34585]: 4.4 scrub ok 2021-10-08T19:43:29.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:29 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3487264069' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 3, "weight": 1.0}]': finished 2021-10-08T19:43:29.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:29 smithi097 ceph-mon[41966]: osdmap e514: 8 total, 8 up, 8 in 2021-10-08T19:43:29.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:29 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:43:29.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:29 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:43:29.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:29 smithi097 ceph-mon[41966]: 4.4 scrub ok 2021-10-08T19:43:30.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:30 smithi117 ceph-mon[34585]: pgmap v1097: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:43:30.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:30 smithi117 ceph-mon[34585]: 2.13 scrub ok 2021-10-08T19:43:30.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:30 smithi117 ceph-mon[34585]: osdmap e515: 8 total, 8 up, 8 in 2021-10-08T19:43:30.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:30 smithi117 ceph-mon[34585]: 2.19 scrub ok 2021-10-08T19:43:30.667 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:30 smithi097 ceph-mon[41966]: pgmap v1097: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:43:30.667 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:30 smithi097 ceph-mon[41966]: 2.13 scrub ok 2021-10-08T19:43:30.667 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:30 smithi097 ceph-mon[41966]: osdmap e515: 8 total, 8 up, 8 in 2021-10-08T19:43:30.667 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:30 smithi097 ceph-mon[41966]: 2.19 scrub ok 2021-10-08T19:43:30.668 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:30 smithi097 ceph-mon[32687]: pgmap v1097: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:43:30.668 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:30 smithi097 ceph-mon[32687]: 2.13 scrub ok 2021-10-08T19:43:30.668 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:30 smithi097 ceph-mon[32687]: osdmap e515: 8 total, 8 up, 8 in 2021-10-08T19:43:30.669 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:30 smithi097 ceph-mon[32687]: 2.19 scrub ok 2021-10-08T19:43:31.308 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:43:30 smithi097 conmon[33110]: 172.21.15.117 - - [08/Oct/2021:19:43:30] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:43:31.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:31 smithi117 ceph-mon[34585]: 3.12 scrub ok 2021-10-08T19:43:31.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:31 smithi117 ceph-mon[34585]: 1.8 scrub ok 2021-10-08T19:43:31.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:31 smithi117 ceph-mon[34585]: 5.2 deep-scrub ok 2021-10-08T19:43:31.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:31 smithi117 ceph-mon[34585]: 2.2 scrub ok 2021-10-08T19:43:31.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:31 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:43:31.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:31 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/282115200' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2021-10-08T19:43:31.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:31 smithi097 ceph-mon[32687]: 3.12 scrub ok 2021-10-08T19:43:31.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:31 smithi097 ceph-mon[32687]: 1.8 scrub ok 2021-10-08T19:43:31.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:31 smithi097 ceph-mon[32687]: 5.2 deep-scrub ok 2021-10-08T19:43:31.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:31 smithi097 ceph-mon[32687]: 2.2 scrub ok 2021-10-08T19:43:31.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:31 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:43:31.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:31 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/282115200' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2021-10-08T19:43:31.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:31 smithi097 ceph-mon[41966]: 3.12 scrub ok 2021-10-08T19:43:31.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:31 smithi097 ceph-mon[41966]: 1.8 scrub ok 2021-10-08T19:43:31.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:31 smithi097 ceph-mon[41966]: 5.2 deep-scrub ok 2021-10-08T19:43:31.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:31 smithi097 ceph-mon[41966]: 2.2 scrub ok 2021-10-08T19:43:31.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:31 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:43:31.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:31 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/282115200' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2021-10-08T19:43:31.989 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.4 to 1 (10000) 2021-10-08T19:43:32.639 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:32 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:43:32.639 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:32 smithi097 ceph-mon[41966]: 172.21.15.117 - - [08/Oct/2021:19:43:30] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:43:32.639 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:32 smithi097 ceph-mon[41966]: 6.15 scrub ok 2021-10-08T19:43:32.640 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:32 smithi097 ceph-mon[41966]: pgmap v1099: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2021-10-08T19:43:32.640 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:32 smithi097 ceph-mon[41966]: 3.7 scrub ok 2021-10-08T19:43:32.640 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:32 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/282115200' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]': finished 2021-10-08T19:43:32.640 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:32 smithi097 ceph-mon[41966]: osdmap e516: 8 total, 8 up, 8 in 2021-10-08T19:43:32.641 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:32 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:43:32.641 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:32 smithi097 ceph-mon[32687]: 172.21.15.117 - - [08/Oct/2021:19:43:30] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:43:32.641 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:32 smithi097 ceph-mon[32687]: 6.15 scrub ok 2021-10-08T19:43:32.641 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:32 smithi097 ceph-mon[32687]: pgmap v1099: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2021-10-08T19:43:32.642 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:32 smithi097 ceph-mon[32687]: 3.7 scrub ok 2021-10-08T19:43:32.642 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:32 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/282115200' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]': finished 2021-10-08T19:43:32.642 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:32 smithi097 ceph-mon[32687]: osdmap e516: 8 total, 8 up, 8 in 2021-10-08T19:43:32.643 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd primary-affinity 4 1 2021-10-08T19:43:32.655 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:43:32 smithi117 conmon[69189]: level=error ts=2021-10-08T19:43:32.314Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=2 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:43:32.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:32 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:43:32.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:32 smithi117 ceph-mon[34585]: 172.21.15.117 - - [08/Oct/2021:19:43:30] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:43:32.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:32 smithi117 ceph-mon[34585]: 6.15 scrub ok 2021-10-08T19:43:32.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:32 smithi117 ceph-mon[34585]: pgmap v1099: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2021-10-08T19:43:32.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:32 smithi117 ceph-mon[34585]: 3.7 scrub ok 2021-10-08T19:43:32.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:32 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/282115200' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]': finished 2021-10-08T19:43:32.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:32 smithi117 ceph-mon[34585]: osdmap e516: 8 total, 8 up, 8 in 2021-10-08T19:43:32.925 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:43:32.970 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:43:32 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:43:32] "GET /metrics HTTP/1.1" 200 154880 "" "Prometheus/2.18.1" 2021-10-08T19:43:33.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:33 smithi097 ceph-mon[32687]: 5.10 scrub ok 2021-10-08T19:43:33.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:33 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:43:33.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:33 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:43:33.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:33 smithi097 ceph-mon[32687]: 1.1 scrub ok 2021-10-08T19:43:33.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:33 smithi097 ceph-mon[32687]: 2.e scrub ok 2021-10-08T19:43:33.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:33 smithi097 ceph-mon[32687]: 2.4 scrub ok 2021-10-08T19:43:33.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:33 smithi097 ceph-mon[32687]: osdmap e517: 8 total, 8 up, 8 in 2021-10-08T19:43:33.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:33 smithi097 ceph-mon[41966]: 5.10 scrub ok 2021-10-08T19:43:33.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:33 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:43:33.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:33 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:43:33.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:33 smithi097 ceph-mon[41966]: 1.1 scrub ok 2021-10-08T19:43:33.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:33 smithi097 ceph-mon[41966]: 2.e scrub ok 2021-10-08T19:43:33.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:33 smithi097 ceph-mon[41966]: 2.4 scrub ok 2021-10-08T19:43:33.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:33 smithi097 ceph-mon[41966]: osdmap e517: 8 total, 8 up, 8 in 2021-10-08T19:43:33.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:33 smithi117 ceph-mon[34585]: 5.10 scrub ok 2021-10-08T19:43:33.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:33 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:43:33.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:33 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:43:33.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:33 smithi117 ceph-mon[34585]: 1.1 scrub ok 2021-10-08T19:43:33.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:33 smithi117 ceph-mon[34585]: 2.e scrub ok 2021-10-08T19:43:33.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:33 smithi117 ceph-mon[34585]: 2.4 scrub ok 2021-10-08T19:43:33.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:33 smithi117 ceph-mon[34585]: osdmap e517: 8 total, 8 up, 8 in 2021-10-08T19:43:34.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:43:33 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:43:33] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:43:34.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:34 smithi117 ceph-mon[34585]: 2.25 scrub ok 2021-10-08T19:43:34.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:34 smithi117 ceph-mon[34585]: 1.9 scrub ok 2021-10-08T19:43:34.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:34 smithi117 ceph-mon[34585]: pgmap v1102: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2021-10-08T19:43:34.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:34 smithi117 ceph-mon[34585]: 2.22 scrub ok 2021-10-08T19:43:34.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:34 smithi097 ceph-mon[32687]: 2.25 scrub ok 2021-10-08T19:43:34.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:34 smithi097 ceph-mon[32687]: 1.9 scrub ok 2021-10-08T19:43:34.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:34 smithi097 ceph-mon[32687]: pgmap v1102: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2021-10-08T19:43:34.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:34 smithi097 ceph-mon[32687]: 2.22 scrub ok 2021-10-08T19:43:34.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:34 smithi097 ceph-mon[41966]: 2.25 scrub ok 2021-10-08T19:43:34.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:34 smithi097 ceph-mon[41966]: 1.9 scrub ok 2021-10-08T19:43:34.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:34 smithi097 ceph-mon[41966]: pgmap v1102: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2021-10-08T19:43:34.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:34 smithi097 ceph-mon[41966]: 2.22 scrub ok 2021-10-08T19:43:35.329 INFO:teuthology.orchestra.run.smithi097.stderr:set osd.4 primary-affinity to 1 (8655362) 2021-10-08T19:43:35.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:35 smithi117 ceph-mon[34585]: 3.f deep-scrub ok 2021-10-08T19:43:35.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:35 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1109174448' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 4, "weight": 1.0}]: dispatch 2021-10-08T19:43:35.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:35 smithi117 ceph-mon[34585]: from='client.26512 ' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 4, "weight": 1.0}]: dispatch 2021-10-08T19:43:35.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:35 smithi097 ceph-mon[41966]: 3.f deep-scrub ok 2021-10-08T19:43:35.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:35 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1109174448' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 4, "weight": 1.0}]: dispatch 2021-10-08T19:43:35.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:35 smithi097 ceph-mon[41966]: from='client.26512 ' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 4, "weight": 1.0}]: dispatch 2021-10-08T19:43:35.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:35 smithi097 ceph-mon[32687]: 3.f deep-scrub ok 2021-10-08T19:43:35.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:35 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1109174448' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 4, "weight": 1.0}]: dispatch 2021-10-08T19:43:35.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:35 smithi097 ceph-mon[32687]: from='client.26512 ' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 4, "weight": 1.0}]: dispatch 2021-10-08T19:43:36.004 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd reweight 5 1 2021-10-08T19:43:36.281 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:43:36.327 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:36 smithi097 ceph-mon[32687]: 1.0 scrub ok 2021-10-08T19:43:36.327 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:36 smithi097 ceph-mon[32687]: pgmap v1103: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2021-10-08T19:43:36.327 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:36 smithi097 ceph-mon[32687]: from='client.26512 ' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 4, "weight": 1.0}]': finished 2021-10-08T19:43:36.328 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:36 smithi097 ceph-mon[32687]: osdmap e518: 8 total, 8 up, 8 in 2021-10-08T19:43:36.328 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:36 smithi097 ceph-mon[32687]: 2.29 scrub ok 2021-10-08T19:43:36.328 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:36 smithi097 ceph-mon[32687]: 2.9 scrub ok 2021-10-08T19:43:36.328 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:36 smithi097 ceph-mon[32687]: 3.16 scrub ok 2021-10-08T19:43:36.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:36 smithi117 ceph-mon[34585]: 1.0 scrub ok 2021-10-08T19:43:36.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:36 smithi117 ceph-mon[34585]: pgmap v1103: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2021-10-08T19:43:36.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:36 smithi117 ceph-mon[34585]: from='client.26512 ' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 4, "weight": 1.0}]': finished 2021-10-08T19:43:36.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:36 smithi117 ceph-mon[34585]: osdmap e518: 8 total, 8 up, 8 in 2021-10-08T19:43:36.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:36 smithi117 ceph-mon[34585]: 2.29 scrub ok 2021-10-08T19:43:36.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:36 smithi117 ceph-mon[34585]: 2.9 scrub ok 2021-10-08T19:43:36.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:36 smithi117 ceph-mon[34585]: 3.16 scrub ok 2021-10-08T19:43:36.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:36 smithi097 ceph-mon[41966]: 1.0 scrub ok 2021-10-08T19:43:36.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:36 smithi097 ceph-mon[41966]: pgmap v1103: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2021-10-08T19:43:36.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:36 smithi097 ceph-mon[41966]: from='client.26512 ' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 4, "weight": 1.0}]': finished 2021-10-08T19:43:36.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:36 smithi097 ceph-mon[41966]: osdmap e518: 8 total, 8 up, 8 in 2021-10-08T19:43:36.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:36 smithi097 ceph-mon[41966]: 2.29 scrub ok 2021-10-08T19:43:36.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:36 smithi097 ceph-mon[41966]: 2.9 scrub ok 2021-10-08T19:43:36.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:36 smithi097 ceph-mon[41966]: 3.16 scrub ok 2021-10-08T19:43:37.624 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:37 smithi097 ceph-mon[41966]: 6.18 scrub ok 2021-10-08T19:43:37.624 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:37 smithi097 ceph-mon[41966]: 2.14 scrub ok 2021-10-08T19:43:37.624 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:37 smithi097 ceph-mon[41966]: 5.7 scrub ok 2021-10-08T19:43:37.625 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:37 smithi097 ceph-mon[32687]: 6.18 scrub ok 2021-10-08T19:43:37.625 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:37 smithi097 ceph-mon[32687]: 2.14 scrub ok 2021-10-08T19:43:37.625 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:37 smithi097 ceph-mon[32687]: 5.7 scrub ok 2021-10-08T19:43:37.655 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:43:37 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:43:37.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:37 smithi117 ceph-mon[34585]: 6.18 scrub ok 2021-10-08T19:43:37.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:37 smithi117 ceph-mon[34585]: 2.14 scrub ok 2021-10-08T19:43:37.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:37 smithi117 ceph-mon[34585]: 5.7 scrub ok 2021-10-08T19:43:38.342 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.5 to 1 (10000) 2021-10-08T19:43:38.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:38 smithi117 ceph-mon[34585]: 4.d scrub ok 2021-10-08T19:43:38.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:38 smithi117 ceph-mon[34585]: pgmap v1105: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:43:38.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:38 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:43:38.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:38 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1248047375' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2021-10-08T19:43:38.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:38 smithi117 ceph-mon[34585]: from='client.26518 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2021-10-08T19:43:38.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:38 smithi097 ceph-mon[41966]: 4.d scrub ok 2021-10-08T19:43:38.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:38 smithi097 ceph-mon[41966]: pgmap v1105: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:43:38.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:38 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:43:38.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:38 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1248047375' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2021-10-08T19:43:38.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:38 smithi097 ceph-mon[41966]: from='client.26518 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2021-10-08T19:43:38.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:38 smithi097 ceph-mon[32687]: 4.d scrub ok 2021-10-08T19:43:38.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:38 smithi097 ceph-mon[32687]: pgmap v1105: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:43:38.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:38 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:43:38.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:38 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1248047375' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2021-10-08T19:43:38.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:38 smithi097 ceph-mon[32687]: from='client.26518 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2021-10-08T19:43:39.023 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd primary-affinity 5 1 2021-10-08T19:43:39.302 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:43:39.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:39 smithi117 ceph-mon[34585]: from='client.26518 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]': finished 2021-10-08T19:43:39.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:39 smithi117 ceph-mon[34585]: osdmap e519: 8 total, 8 up, 8 in 2021-10-08T19:43:39.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:39 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:43:39.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:39 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:43:39.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:39 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:43:39.659 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:39 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:43:39.660 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:39 smithi117 ceph-mon[34585]: 3.8 deep-scrub ok 2021-10-08T19:43:39.660 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:39 smithi117 ceph-mon[34585]: 2.17 scrub ok 2021-10-08T19:43:39.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:39 smithi097 ceph-mon[32687]: from='client.26518 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]': finished 2021-10-08T19:43:39.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:39 smithi097 ceph-mon[32687]: osdmap e519: 8 total, 8 up, 8 in 2021-10-08T19:43:39.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:39 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:43:39.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:39 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:43:39.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:39 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:43:39.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:39 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:43:39.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:39 smithi097 ceph-mon[32687]: 3.8 deep-scrub ok 2021-10-08T19:43:39.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:39 smithi097 ceph-mon[32687]: 2.17 scrub ok 2021-10-08T19:43:39.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:39 smithi097 ceph-mon[41966]: from='client.26518 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]': finished 2021-10-08T19:43:39.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:39 smithi097 ceph-mon[41966]: osdmap e519: 8 total, 8 up, 8 in 2021-10-08T19:43:39.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:39 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:43:39.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:39 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:43:39.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:39 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:43:39.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:39 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:43:39.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:39 smithi097 ceph-mon[41966]: 3.8 deep-scrub ok 2021-10-08T19:43:39.725 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:39 smithi097 ceph-mon[41966]: 2.17 scrub ok 2021-10-08T19:43:40.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:40 smithi117 ceph-mon[34585]: 3.15 deep-scrub ok 2021-10-08T19:43:40.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:40 smithi117 ceph-mon[34585]: 6.2 scrub ok 2021-10-08T19:43:40.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:40 smithi117 ceph-mon[34585]: pgmap v1107: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 843 B/s rd, 0 op/s 2021-10-08T19:43:40.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:40 smithi117 ceph-mon[34585]: 2.7 scrub ok 2021-10-08T19:43:40.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:40 smithi097 ceph-mon[41966]: 3.15 deep-scrub ok 2021-10-08T19:43:40.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:40 smithi097 ceph-mon[41966]: 6.2 scrub ok 2021-10-08T19:43:40.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:40 smithi097 ceph-mon[41966]: pgmap v1107: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 843 B/s rd, 0 op/s 2021-10-08T19:43:40.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:40 smithi097 ceph-mon[41966]: 2.7 scrub ok 2021-10-08T19:43:40.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:40 smithi097 ceph-mon[32687]: 3.15 deep-scrub ok 2021-10-08T19:43:40.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:40 smithi097 ceph-mon[32687]: 6.2 scrub ok 2021-10-08T19:43:40.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:40 smithi097 ceph-mon[32687]: pgmap v1107: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 843 B/s rd, 0 op/s 2021-10-08T19:43:40.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:40 smithi097 ceph-mon[32687]: 2.7 scrub ok 2021-10-08T19:43:41.353 INFO:teuthology.orchestra.run.smithi097.stderr:set osd.5 primary-affinity to 1 (8655362) 2021-10-08T19:43:42.018 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd reweight 6 1 2021-10-08T19:43:42.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:41 smithi097 ceph-mon[41966]: 5.1f scrub ok 2021-10-08T19:43:42.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:41 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:43:42.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:41 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:43:42.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:41 smithi097 ceph-mon[41966]: 4.c scrub ok 2021-10-08T19:43:42.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:41 smithi097 ceph-mon[41966]: pgmap v1108: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:42.222 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:41 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/431319227' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 5, "weight": 1.0}]: dispatch 2021-10-08T19:43:42.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:41 smithi097 ceph-mon[41966]: from='client.26524 ' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 5, "weight": 1.0}]: dispatch 2021-10-08T19:43:42.223 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:41 smithi097 ceph-mon[41966]: from='client.26524 ' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 5, "weight": 1.0}]': finished 2021-10-08T19:43:42.224 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:41 smithi097 ceph-mon[41966]: osdmap e520: 8 total, 8 up, 8 in 2021-10-08T19:43:42.225 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:41 smithi097 ceph-mon[32687]: 5.1f scrub ok 2021-10-08T19:43:42.225 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:41 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:43:42.226 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:41 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:43:42.226 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:41 smithi097 ceph-mon[32687]: 4.c scrub ok 2021-10-08T19:43:42.227 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:41 smithi097 ceph-mon[32687]: pgmap v1108: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:42.227 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:41 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/431319227' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 5, "weight": 1.0}]: dispatch 2021-10-08T19:43:42.227 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:41 smithi097 ceph-mon[32687]: from='client.26524 ' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 5, "weight": 1.0}]: dispatch 2021-10-08T19:43:42.228 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:41 smithi097 ceph-mon[32687]: from='client.26524 ' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 5, "weight": 1.0}]': finished 2021-10-08T19:43:42.228 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:41 smithi097 ceph-mon[32687]: osdmap e520: 8 total, 8 up, 8 in 2021-10-08T19:43:42.295 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:43:42.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:41 smithi117 ceph-mon[34585]: 5.1f scrub ok 2021-10-08T19:43:42.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:41 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:43:42.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:41 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:43:42.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:41 smithi117 ceph-mon[34585]: 4.c scrub ok 2021-10-08T19:43:42.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:41 smithi117 ceph-mon[34585]: pgmap v1108: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:42.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:41 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/431319227' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 5, "weight": 1.0}]: dispatch 2021-10-08T19:43:42.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:41 smithi117 ceph-mon[34585]: from='client.26524 ' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 5, "weight": 1.0}]: dispatch 2021-10-08T19:43:42.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:41 smithi117 ceph-mon[34585]: from='client.26524 ' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 5, "weight": 1.0}]': finished 2021-10-08T19:43:42.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:41 smithi117 ceph-mon[34585]: osdmap e520: 8 total, 8 up, 8 in 2021-10-08T19:43:42.897 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:43:42 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:43:42] "GET /metrics HTTP/1.1" 200 154882 "" "Prometheus/2.18.1" 2021-10-08T19:43:43.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:42 smithi097 ceph-mon[41966]: 4.5 scrub ok 2021-10-08T19:43:43.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:42 smithi097 ceph-mon[41966]: osdmap e521: 8 total, 8 up, 8 in 2021-10-08T19:43:43.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:42 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:43:43.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:42 smithi097 ceph-mon[41966]: 5.19 scrub ok 2021-10-08T19:43:43.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:42 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:43:43.221 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:42 smithi097 ceph-mon[32687]: 4.5 scrub ok 2021-10-08T19:43:43.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:42 smithi097 ceph-mon[32687]: osdmap e521: 8 total, 8 up, 8 in 2021-10-08T19:43:43.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:42 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:43:43.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:42 smithi097 ceph-mon[32687]: 5.19 scrub ok 2021-10-08T19:43:43.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:42 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:43:43.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:42 smithi117 ceph-mon[34585]: 4.5 scrub ok 2021-10-08T19:43:43.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:42 smithi117 ceph-mon[34585]: osdmap e521: 8 total, 8 up, 8 in 2021-10-08T19:43:43.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:42 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:43:43.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:42 smithi117 ceph-mon[34585]: 5.19 scrub ok 2021-10-08T19:43:43.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:42 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:43:44.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:43:43 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:43:43] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:43:44.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:43 smithi117 ceph-mon[34585]: pgmap v1111: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:43:44.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:43 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:43:44.157 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:43 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:43:44.220 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:43 smithi097 ceph-mon[41966]: pgmap v1111: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:43:44.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:43 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:43:44.221 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:43 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:43:44.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:43 smithi097 ceph-mon[32687]: pgmap v1111: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:43:44.222 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:43 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:43:44.223 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:43 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:43:44.975 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.6 to 1 (10000) 2021-10-08T19:43:45.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:44 smithi117 ceph-mon[34585]: 6.4 scrub ok 2021-10-08T19:43:45.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:44 smithi117 ceph-mon[34585]: 2.8 scrub ok 2021-10-08T19:43:45.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:44 smithi117 ceph-mon[34585]: 2.12 deep-scrub ok 2021-10-08T19:43:45.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:44 smithi117 ceph-mon[34585]: osdmap e522: 8 total, 8 up, 8 in 2021-10-08T19:43:45.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:44 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3996382910' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2021-10-08T19:43:45.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:44 smithi117 ceph-mon[34585]: from='client.26530 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2021-10-08T19:43:45.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:44 smithi097 ceph-mon[32687]: 6.4 scrub ok 2021-10-08T19:43:45.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:44 smithi097 ceph-mon[32687]: 2.8 scrub ok 2021-10-08T19:43:45.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:44 smithi097 ceph-mon[32687]: 2.12 deep-scrub ok 2021-10-08T19:43:45.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:44 smithi097 ceph-mon[32687]: osdmap e522: 8 total, 8 up, 8 in 2021-10-08T19:43:45.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:44 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3996382910' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2021-10-08T19:43:45.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:44 smithi097 ceph-mon[32687]: from='client.26530 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2021-10-08T19:43:45.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:44 smithi097 ceph-mon[41966]: 6.4 scrub ok 2021-10-08T19:43:45.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:44 smithi097 ceph-mon[41966]: 2.8 scrub ok 2021-10-08T19:43:45.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:44 smithi097 ceph-mon[41966]: 2.12 deep-scrub ok 2021-10-08T19:43:45.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:44 smithi097 ceph-mon[41966]: osdmap e522: 8 total, 8 up, 8 in 2021-10-08T19:43:45.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:44 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3996382910' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2021-10-08T19:43:45.474 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:44 smithi097 ceph-mon[41966]: from='client.26530 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2021-10-08T19:43:45.671 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd primary-affinity 6 1 2021-10-08T19:43:45.949 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:43:46.407 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:45 smithi117 ceph-mon[34585]: 3.0 deep-scrub ok 2021-10-08T19:43:46.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:45 smithi117 ceph-mon[34585]: from='client.26530 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]': finished 2021-10-08T19:43:46.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:45 smithi117 ceph-mon[34585]: osdmap e523: 8 total, 8 up, 8 in 2021-10-08T19:43:46.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:45 smithi117 ceph-mon[34585]: pgmap v1114: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 19 KiB/s rd, 18 op/s; 97 B/s, 0 objects/s recovering 2021-10-08T19:43:46.408 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:45 smithi117 ceph-mon[34585]: 6.17 deep-scrub ok 2021-10-08T19:43:46.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:45 smithi097 ceph-mon[32687]: 3.0 deep-scrub ok 2021-10-08T19:43:46.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:45 smithi097 ceph-mon[32687]: from='client.26530 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]': finished 2021-10-08T19:43:46.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:45 smithi097 ceph-mon[32687]: osdmap e523: 8 total, 8 up, 8 in 2021-10-08T19:43:46.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:45 smithi097 ceph-mon[32687]: pgmap v1114: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 19 KiB/s rd, 18 op/s; 97 B/s, 0 objects/s recovering 2021-10-08T19:43:46.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:45 smithi097 ceph-mon[32687]: 6.17 deep-scrub ok 2021-10-08T19:43:46.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:45 smithi097 ceph-mon[41966]: 3.0 deep-scrub ok 2021-10-08T19:43:46.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:45 smithi097 ceph-mon[41966]: from='client.26530 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]': finished 2021-10-08T19:43:46.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:45 smithi097 ceph-mon[41966]: osdmap e523: 8 total, 8 up, 8 in 2021-10-08T19:43:46.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:45 smithi097 ceph-mon[41966]: pgmap v1114: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 19 KiB/s rd, 18 op/s; 97 B/s, 0 objects/s recovering 2021-10-08T19:43:46.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:45 smithi097 ceph-mon[41966]: 6.17 deep-scrub ok 2021-10-08T19:43:47.236 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:46 smithi097 ceph-mon[41966]: 2.5 deep-scrub ok 2021-10-08T19:43:47.236 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:46 smithi097 ceph-mon[32687]: 2.5 deep-scrub ok 2021-10-08T19:43:47.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:46 smithi117 ceph-mon[34585]: 2.5 deep-scrub ok 2021-10-08T19:43:47.905 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:43:47 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:43:47.995 INFO:teuthology.orchestra.run.smithi097.stderr:set osd.6 primary-affinity to 1 (8655362) 2021-10-08T19:43:48.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:47 smithi117 ceph-mon[34585]: 1.3 scrub ok 2021-10-08T19:43:48.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:47 smithi117 ceph-mon[34585]: pgmap v1115: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 13 KiB/s rd, 13 op/s; 68 B/s, 0 objects/s recovering 2021-10-08T19:43:48.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:47 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:43:48.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:47 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/108568033' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 6, "weight": 1.0}]: dispatch 2021-10-08T19:43:48.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:47 smithi117 ceph-mon[34585]: from='client.26536 ' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 6, "weight": 1.0}]: dispatch 2021-10-08T19:43:48.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:47 smithi097 ceph-mon[41966]: 1.3 scrub ok 2021-10-08T19:43:48.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:47 smithi097 ceph-mon[41966]: pgmap v1115: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 13 KiB/s rd, 13 op/s; 68 B/s, 0 objects/s recovering 2021-10-08T19:43:48.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:47 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:43:48.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:47 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/108568033' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 6, "weight": 1.0}]: dispatch 2021-10-08T19:43:48.474 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:47 smithi097 ceph-mon[41966]: from='client.26536 ' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 6, "weight": 1.0}]: dispatch 2021-10-08T19:43:48.475 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:47 smithi097 ceph-mon[32687]: 1.3 scrub ok 2021-10-08T19:43:48.475 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:47 smithi097 ceph-mon[32687]: pgmap v1115: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 13 KiB/s rd, 13 op/s; 68 B/s, 0 objects/s recovering 2021-10-08T19:43:48.475 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:47 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:43:48.475 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:47 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/108568033' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 6, "weight": 1.0}]: dispatch 2021-10-08T19:43:48.476 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:47 smithi097 ceph-mon[32687]: from='client.26536 ' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 6, "weight": 1.0}]: dispatch 2021-10-08T19:43:48.808 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd reweight 7 1 2021-10-08T19:43:49.097 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:43:49.220 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:48 smithi097 ceph-mon[32687]: 2.d scrub ok 2021-10-08T19:43:49.272 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:48 smithi097 ceph-mon[32687]: from='client.26536 ' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 6, "weight": 1.0}]': finished 2021-10-08T19:43:49.272 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:48 smithi097 ceph-mon[32687]: osdmap e524: 8 total, 8 up, 8 in 2021-10-08T19:43:49.273 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:48 smithi097 ceph-mon[41966]: 2.d scrub ok 2021-10-08T19:43:49.273 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:48 smithi097 ceph-mon[41966]: from='client.26536 ' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 6, "weight": 1.0}]': finished 2021-10-08T19:43:49.273 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:48 smithi097 ceph-mon[41966]: osdmap e524: 8 total, 8 up, 8 in 2021-10-08T19:43:49.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:48 smithi117 ceph-mon[34585]: 2.d scrub ok 2021-10-08T19:43:49.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:48 smithi117 ceph-mon[34585]: from='client.26536 ' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 6, "weight": 1.0}]': finished 2021-10-08T19:43:49.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:48 smithi117 ceph-mon[34585]: osdmap e524: 8 total, 8 up, 8 in 2021-10-08T19:43:50.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:50 smithi117 ceph-mon[34585]: 5.12 scrub ok 2021-10-08T19:43:50.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:50 smithi117 ceph-mon[34585]: pgmap v1117: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 13 KiB/s rd, 13 op/s; 64 B/s, 0 objects/s recovering 2021-10-08T19:43:50.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:50 smithi097 ceph-mon[41966]: 5.12 scrub ok 2021-10-08T19:43:50.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:50 smithi097 ceph-mon[41966]: pgmap v1117: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 13 KiB/s rd, 13 op/s; 64 B/s, 0 objects/s recovering 2021-10-08T19:43:50.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:50 smithi097 ceph-mon[32687]: 5.12 scrub ok 2021-10-08T19:43:50.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:50 smithi097 ceph-mon[32687]: pgmap v1117: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 13 KiB/s rd, 13 op/s; 64 B/s, 0 objects/s recovering 2021-10-08T19:43:51.282 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:51 smithi117 ceph-mon[34585]: 4.16 scrub ok 2021-10-08T19:43:51.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:51 smithi097 ceph-mon[32687]: 4.16 scrub ok 2021-10-08T19:43:51.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:51 smithi097 ceph-mon[41966]: 4.16 scrub ok 2021-10-08T19:43:52.016 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.7 to 1 (10000) 2021-10-08T19:43:52.315 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:52 smithi117 ceph-mon[34585]: pgmap v1118: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 721 B/s rd, 0 op/s 2021-10-08T19:43:52.315 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:52 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3182253095' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2021-10-08T19:43:52.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:52 smithi097 ceph-mon[32687]: pgmap v1118: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 721 B/s rd, 0 op/s 2021-10-08T19:43:52.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:52 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3182253095' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2021-10-08T19:43:52.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:52 smithi097 ceph-mon[41966]: pgmap v1118: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 721 B/s rd, 0 op/s 2021-10-08T19:43:52.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:52 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3182253095' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2021-10-08T19:43:52.655 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:43:52 smithi117 conmon[69189]: level=error ts=2021-10-08T19:43:52.314Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=1 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:43:52.738 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd primary-affinity 7 1 2021-10-08T19:43:52.970 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:43:52 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:43:52] "GET /metrics HTTP/1.1" 200 154882 "" "Prometheus/2.18.1" 2021-10-08T19:43:53.038 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:43:53.305 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:53 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3182253095' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]': finished 2021-10-08T19:43:53.305 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:53 smithi097 ceph-mon[41966]: osdmap e525: 8 total, 8 up, 8 in 2021-10-08T19:43:53.306 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:53 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3182253095' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]': finished 2021-10-08T19:43:53.306 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:53 smithi097 ceph-mon[32687]: osdmap e525: 8 total, 8 up, 8 in 2021-10-08T19:43:53.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:53 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3182253095' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]': finished 2021-10-08T19:43:53.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:53 smithi117 ceph-mon[34585]: osdmap e525: 8 total, 8 up, 8 in 2021-10-08T19:43:54.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:43:53 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:43:53] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:43:54.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:54 smithi117 ceph-mon[34585]: 2.27 scrub ok 2021-10-08T19:43:54.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:54 smithi117 ceph-mon[34585]: pgmap v1120: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:43:54.156 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:54 smithi117 ceph-mon[34585]: 5.16 scrub ok 2021-10-08T19:43:54.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:54 smithi097 ceph-mon[32687]: 2.27 scrub ok 2021-10-08T19:43:54.474 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:54 smithi097 ceph-mon[32687]: pgmap v1120: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:43:54.475 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:54 smithi097 ceph-mon[32687]: 5.16 scrub ok 2021-10-08T19:43:54.477 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:54 smithi097 ceph-mon[41966]: 2.27 scrub ok 2021-10-08T19:43:54.479 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:54 smithi097 ceph-mon[41966]: pgmap v1120: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:43:54.479 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:54 smithi097 ceph-mon[41966]: 5.16 scrub ok 2021-10-08T19:43:54.970 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:43:54 smithi097 conmon[33110]: 172.21.15.97 - - [08/Oct/2021:19:43:54] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:43:55.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:55 smithi117 ceph-mon[34585]: 6.13 deep-scrub ok 2021-10-08T19:43:55.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:55 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:43:55.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:55 smithi097 ceph-mon[32687]: 6.13 deep-scrub ok 2021-10-08T19:43:55.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:55 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:43:55.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:55 smithi097 ceph-mon[41966]: 6.13 deep-scrub ok 2021-10-08T19:43:55.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:55 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:43:56.029 INFO:teuthology.orchestra.run.smithi097.stderr:set osd.7 primary-affinity to 1 (8655362) 2021-10-08T19:43:56.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:56 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:43:56.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:56 smithi117 ceph-mon[34585]: 172.21.15.97 - - [08/Oct/2021:19:43:54] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:43:56.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:56 smithi117 ceph-mon[34585]: pgmap v1121: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:56.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:56 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1878666817' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 7, "weight": 1.0}]: dispatch 2021-10-08T19:43:56.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:56 smithi117 ceph-mon[34585]: 6.d scrub ok 2021-10-08T19:43:56.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:56 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:43:56.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:56 smithi097 ceph-mon[32687]: 172.21.15.97 - - [08/Oct/2021:19:43:54] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:43:56.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:56 smithi097 ceph-mon[32687]: pgmap v1121: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:56.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:56 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1878666817' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 7, "weight": 1.0}]: dispatch 2021-10-08T19:43:56.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:56 smithi097 ceph-mon[32687]: 6.d scrub ok 2021-10-08T19:43:56.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:56 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:43:56.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:56 smithi097 ceph-mon[41966]: 172.21.15.97 - - [08/Oct/2021:19:43:54] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:43:56.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:56 smithi097 ceph-mon[41966]: pgmap v1121: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:56.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:56 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1878666817' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 7, "weight": 1.0}]: dispatch 2021-10-08T19:43:56.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:56 smithi097 ceph-mon[41966]: 6.d scrub ok 2021-10-08T19:43:56.698 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2021-10-08T19:43:56.699 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2021-10-08T19:43:56.699 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2021-10-08T19:43:56.699 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2021-10-08T19:43:56.700 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2021-10-08T19:43:56.700 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd dump --format=json 2021-10-08T19:43:56.984 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:43:57.272 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:43:57 smithi097 conmon[33110]: 172.21.15.117 - - [08/Oct/2021:19:43:57] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:43:57.273 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:57 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1878666817' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 7, "weight": 1.0}]': finished 2021-10-08T19:43:57.273 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:57 smithi097 ceph-mon[32687]: osdmap e526: 8 total, 8 up, 8 in 2021-10-08T19:43:57.274 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:57 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1878666817' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 7, "weight": 1.0}]': finished 2021-10-08T19:43:57.274 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:57 smithi097 ceph-mon[41966]: osdmap e526: 8 total, 8 up, 8 in 2021-10-08T19:43:57.405 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:57 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1878666817' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 7, "weight": 1.0}]': finished 2021-10-08T19:43:57.406 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:57 smithi117 ceph-mon[34585]: osdmap e526: 8 total, 8 up, 8 in 2021-10-08T19:43:57.905 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:43:57 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:43:58.455 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:58 smithi097 ceph-mon[41966]: 2.26 scrub ok 2021-10-08T19:43:58.456 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:58 smithi097 ceph-mon[41966]: pgmap v1123: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:43:58.456 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:58 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:43:58.456 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:58 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:43:58.456 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:58 smithi097 ceph-mon[41966]: 172.21.15.117 - - [08/Oct/2021:19:43:57] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:43:58.457 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:58 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:43:58.457 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:58 smithi097 ceph-mon[41966]: 6.c scrub ok 2021-10-08T19:43:58.457 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:58 smithi097 ceph-mon[41966]: 3.c scrub ok 2021-10-08T19:43:58.458 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:58 smithi097 ceph-mon[32687]: 2.26 scrub ok 2021-10-08T19:43:58.458 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:58 smithi097 ceph-mon[32687]: pgmap v1123: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:43:58.458 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:58 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:43:58.458 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:58 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:43:58.458 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:58 smithi097 ceph-mon[32687]: 172.21.15.117 - - [08/Oct/2021:19:43:57] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:43:58.459 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:58 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:43:58.459 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:58 smithi097 ceph-mon[32687]: 6.c scrub ok 2021-10-08T19:43:58.459 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:58 smithi097 ceph-mon[32687]: 3.c scrub ok 2021-10-08T19:43:58.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:58 smithi117 ceph-mon[34585]: 2.26 scrub ok 2021-10-08T19:43:58.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:58 smithi117 ceph-mon[34585]: pgmap v1123: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:43:58.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:58 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:43:58.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:58 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:43:58.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:58 smithi117 ceph-mon[34585]: 172.21.15.117 - - [08/Oct/2021:19:43:57] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:43:58.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:58 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:43:58.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:58 smithi117 ceph-mon[34585]: 6.c scrub ok 2021-10-08T19:43:58.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:58 smithi117 ceph-mon[34585]: 3.c scrub ok 2021-10-08T19:43:58.816 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:43:58.817 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":527,"fsid":"1d01f6d6-286c-11ec-8c25-001a4aab830c","created":"2021-10-08T19:16:25.258003+0000","modified":"2021-10-08T19:43:58.178114+0000","last_up_change":"2021-10-08T19:21:15.388758+0000","last_in_change":"2021-10-08T19:29:39.736986+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2021-10-08T19:19:44.413311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":11,"pg_placement_num":11,"pg_placement_num_target":11,"pg_num_target":11,"pg_num_pending":11,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"506","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"170","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":".rgw.root","create_time":"2021-10-08T19:21:21.940881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":42,"pg_placement_num":42,"pg_placement_num_target":42,"pg_num_target":42,"pg_num_pending":42,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"505","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"391","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":3,"pool_name":"iscsi","create_time":"2021-10-08T19:21:22.536945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":23,"pg_placement_num":23,"pg_placement_num_target":23,"pg_num_target":23,"pg_num_pending":23,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"504","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"131","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"default.rgw.log","create_time":"2021-10-08T19:21:23.886328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":5,"pool_name":"default.rgw.control","create_time":"2021-10-08T19:21:25.865032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2021-10-08T19:21:27.940767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"350","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":8},"application_metadata":{"rgw":{}}}],"osds":[{"osd":0,"uuid":"9e64e714-a5d5-4fbb-ae2b-1df4bf14b8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":433,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6801","nonce":3354161282}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6802","nonce":3354161282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6804","nonce":3354161282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6803","nonce":3354161282}]},"public_addr":"172.21.15.97:6801/3354161282","cluster_addr":"172.21.15.97:6802/3354161282","heartbeat_back_addr":"172.21.15.97:6804/3354161282","heartbeat_front_addr":"172.21.15.97:6803/3354161282","state":["exists","up"]},{"osd":1,"uuid":"32602a22-f263-4b62-a8d8-50fddfb73fa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":500,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6805","nonce":735799205}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6806","nonce":735799205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6808","nonce":735799205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6807","nonce":735799205}]},"public_addr":"172.21.15.97:6805/735799205","cluster_addr":"172.21.15.97:6806/735799205","heartbeat_back_addr":"172.21.15.97:6808/735799205","heartbeat_front_addr":"172.21.15.97:6807/735799205","state":["exists","up"]},{"osd":2,"uuid":"88e0e4a2-b4a3-4a00-8669-03c3d9b166c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":433,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6809","nonce":2366482649}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6810","nonce":2366482649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6812","nonce":2366482649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6811","nonce":2366482649}]},"public_addr":"172.21.15.97:6809/2366482649","cluster_addr":"172.21.15.97:6810/2366482649","heartbeat_back_addr":"172.21.15.97:6812/2366482649","heartbeat_front_addr":"172.21.15.97:6811/2366482649","state":["exists","up"]},{"osd":3,"uuid":"e689d708-b501-4526-a31a-1e598b74654d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":433,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6813","nonce":3191181122}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6814","nonce":3191181122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6816","nonce":3191181122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6815","nonce":3191181122}]},"public_addr":"172.21.15.97:6813/3191181122","cluster_addr":"172.21.15.97:6814/3191181122","heartbeat_back_addr":"172.21.15.97:6816/3191181122","heartbeat_front_addr":"172.21.15.97:6815/3191181122","state":["exists","up"]},{"osd":4,"uuid":"67e4730a-be1c-4d88-9307-e3c2cf3ab2ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":448,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6800","nonce":106778208}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6801","nonce":106778208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6803","nonce":106778208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6802","nonce":106778208}]},"public_addr":"172.21.15.117:6800/106778208","cluster_addr":"172.21.15.117:6801/106778208","heartbeat_back_addr":"172.21.15.117:6803/106778208","heartbeat_front_addr":"172.21.15.117:6802/106778208","state":["exists","up"]},{"osd":5,"uuid":"f9fd3153-3e4e-4489-8927-a65641f05d42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":520,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6804","nonce":3199889891}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6805","nonce":3199889891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6807","nonce":3199889891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6806","nonce":3199889891}]},"public_addr":"172.21.15.117:6804/3199889891","cluster_addr":"172.21.15.117:6805/3199889891","heartbeat_back_addr":"172.21.15.117:6807/3199889891","heartbeat_front_addr":"172.21.15.117:6806/3199889891","state":["exists","up"]},{"osd":6,"uuid":"84898f12-c37d-4eb6-8b71-5b86bfe16e7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":433,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6808","nonce":2185843951}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6809","nonce":2185843951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6811","nonce":2185843951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6810","nonce":2185843951}]},"public_addr":"172.21.15.117:6808/2185843951","cluster_addr":"172.21.15.117:6809/2185843951","heartbeat_back_addr":"172.21.15.117:6811/2185843951","heartbeat_front_addr":"172.21.15.117:6810/2185843951","state":["exists","up"]},{"osd":7,"uuid":"529af2ce-2ae9-41ed-8c8e-d133628cfd20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":492,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6812","nonce":2817683239}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6813","nonce":2817683239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6815","nonce":2817683239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6814","nonce":2817683239}]},"public_addr":"172.21.15.117:6812/2817683239","cluster_addr":"172.21.15.117:6813/2817683239","heartbeat_back_addr":"172.21.15.117:6815/2817683239","heartbeat_front_addr":"172.21.15.117:6814/2817683239","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:43:43.305069+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:43:32.149803+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:42:48.956018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:43:27.490771+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:42:37.313017+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:43:28.294982+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:43:40.923806+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:43:57.932016+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"2.12","osds":[5,4,2]}],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":2}]},{"pgid":"2.3","mappings":[{"from":7,"to":4}]},{"pgid":"2.7","mappings":[{"from":7,"to":1}]},{"pgid":"2.19","mappings":[{"from":3,"to":1}]},{"pgid":"2.1a","mappings":[{"from":7,"to":2}]},{"pgid":"2.29","mappings":[{"from":7,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.1a","mappings":[{"from":4,"to":7}]},{"pgid":"5.19","mappings":[{"from":5,"to":7}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.97:0/2600364788":"2021-10-09T19:21:42.325540+0000","172.21.15.97:0/4129083289":"2021-10-09T19:21:42.325540+0000","172.21.15.97:0/1443158975":"2021-10-09T19:21:42.325540+0000","172.21.15.97:0/2472640384":"2021-10-09T19:21:42.325540+0000","172.21.15.97:0/3196919488":"2021-10-09T19:21:42.325540+0000","172.21.15.97:6800/3195862546":"2021-10-09T19:21:42.325540+0000","172.21.15.97:6800/3931202434":"2021-10-09T19:17:10.051948+0000","172.21.15.97:0/2761595213":"2021-10-09T19:17:10.051948+0000","172.21.15.97:0/900681504":"2021-10-09T19:17:10.051948+0000","172.21.15.97:0/3932251406":"2021-10-09T19:17:10.051948+0000","172.21.15.97:0/398006785":"2021-10-09T19:16:48.651177+0000","172.21.15.97:0/1642570050":"2021-10-09T19:16:48.651177+0000","172.21.15.97:0/300178790":"2021-10-09T19:16:48.651177+0000","172.21.15.97:6800/845999767":"2021-10-09T19:16:48.651177+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-10-08T19:43:59.191 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:59 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:43:59.192 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:59 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:43:59.426 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2021-10-08T19:43:59.427 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd dump --format=json 2021-10-08T19:43:59.449 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:59 smithi097 ceph-mon[32687]: osdmap e527: 8 total, 8 up, 8 in 2021-10-08T19:43:59.450 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:59 smithi097 ceph-mon[32687]: 3.5 deep-scrub ok 2021-10-08T19:43:59.450 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:43:59 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/59308701' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-10-08T19:43:59.451 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:59 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:43:59.451 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:59 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:43:59.451 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:59 smithi097 ceph-mon[41966]: osdmap e527: 8 total, 8 up, 8 in 2021-10-08T19:43:59.451 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:59 smithi097 ceph-mon[41966]: 3.5 deep-scrub ok 2021-10-08T19:43:59.452 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:43:59 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/59308701' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-10-08T19:43:59.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:59 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:43:59.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:59 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:43:59.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:59 smithi117 ceph-mon[34585]: osdmap e527: 8 total, 8 up, 8 in 2021-10-08T19:43:59.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:59 smithi117 ceph-mon[34585]: 3.5 deep-scrub ok 2021-10-08T19:43:59.659 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:43:59 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/59308701' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-10-08T19:43:59.703 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:44:00.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:00 smithi097 ceph-mon[41966]: pgmap v1125: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2021-10-08T19:44:00.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:00 smithi097 ceph-mon[41966]: 6.10 scrub ok 2021-10-08T19:44:00.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:00 smithi097 ceph-mon[41966]: 2.2 scrub ok 2021-10-08T19:44:00.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:00 smithi097 ceph-mon[32687]: pgmap v1125: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2021-10-08T19:44:00.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:00 smithi097 ceph-mon[32687]: 6.10 scrub ok 2021-10-08T19:44:00.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:00 smithi097 ceph-mon[32687]: 2.2 scrub ok 2021-10-08T19:44:00.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:00 smithi117 ceph-mon[34585]: pgmap v1125: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2021-10-08T19:44:00.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:00 smithi117 ceph-mon[34585]: 6.10 scrub ok 2021-10-08T19:44:00.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:00 smithi117 ceph-mon[34585]: 2.2 scrub ok 2021-10-08T19:44:01.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:01 smithi097 ceph-mon[32687]: 3.1 scrub ok 2021-10-08T19:44:01.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:01 smithi097 ceph-mon[41966]: 3.1 scrub ok 2021-10-08T19:44:01.503 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:44:01.504 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":527,"fsid":"1d01f6d6-286c-11ec-8c25-001a4aab830c","created":"2021-10-08T19:16:25.258003+0000","modified":"2021-10-08T19:43:58.178114+0000","last_up_change":"2021-10-08T19:21:15.388758+0000","last_in_change":"2021-10-08T19:29:39.736986+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2021-10-08T19:19:44.413311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":11,"pg_placement_num":11,"pg_placement_num_target":11,"pg_num_target":11,"pg_num_pending":11,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"506","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"170","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":".rgw.root","create_time":"2021-10-08T19:21:21.940881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":42,"pg_placement_num":42,"pg_placement_num_target":42,"pg_num_target":42,"pg_num_pending":42,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"505","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"391","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":3,"pool_name":"iscsi","create_time":"2021-10-08T19:21:22.536945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":23,"pg_placement_num":23,"pg_placement_num_target":23,"pg_num_target":23,"pg_num_pending":23,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"504","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"131","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"default.rgw.log","create_time":"2021-10-08T19:21:23.886328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":5,"pool_name":"default.rgw.control","create_time":"2021-10-08T19:21:25.865032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2021-10-08T19:21:27.940767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"350","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":8},"application_metadata":{"rgw":{}}}],"osds":[{"osd":0,"uuid":"9e64e714-a5d5-4fbb-ae2b-1df4bf14b8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":433,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6801","nonce":3354161282}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6802","nonce":3354161282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6804","nonce":3354161282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6803","nonce":3354161282}]},"public_addr":"172.21.15.97:6801/3354161282","cluster_addr":"172.21.15.97:6802/3354161282","heartbeat_back_addr":"172.21.15.97:6804/3354161282","heartbeat_front_addr":"172.21.15.97:6803/3354161282","state":["exists","up"]},{"osd":1,"uuid":"32602a22-f263-4b62-a8d8-50fddfb73fa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":500,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6805","nonce":735799205}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6806","nonce":735799205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6808","nonce":735799205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6807","nonce":735799205}]},"public_addr":"172.21.15.97:6805/735799205","cluster_addr":"172.21.15.97:6806/735799205","heartbeat_back_addr":"172.21.15.97:6808/735799205","heartbeat_front_addr":"172.21.15.97:6807/735799205","state":["exists","up"]},{"osd":2,"uuid":"88e0e4a2-b4a3-4a00-8669-03c3d9b166c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":433,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6809","nonce":2366482649}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6810","nonce":2366482649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6812","nonce":2366482649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6811","nonce":2366482649}]},"public_addr":"172.21.15.97:6809/2366482649","cluster_addr":"172.21.15.97:6810/2366482649","heartbeat_back_addr":"172.21.15.97:6812/2366482649","heartbeat_front_addr":"172.21.15.97:6811/2366482649","state":["exists","up"]},{"osd":3,"uuid":"e689d708-b501-4526-a31a-1e598b74654d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":433,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6813","nonce":3191181122}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6814","nonce":3191181122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6816","nonce":3191181122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6815","nonce":3191181122}]},"public_addr":"172.21.15.97:6813/3191181122","cluster_addr":"172.21.15.97:6814/3191181122","heartbeat_back_addr":"172.21.15.97:6816/3191181122","heartbeat_front_addr":"172.21.15.97:6815/3191181122","state":["exists","up"]},{"osd":4,"uuid":"67e4730a-be1c-4d88-9307-e3c2cf3ab2ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":448,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6800","nonce":106778208}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6801","nonce":106778208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6803","nonce":106778208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6802","nonce":106778208}]},"public_addr":"172.21.15.117:6800/106778208","cluster_addr":"172.21.15.117:6801/106778208","heartbeat_back_addr":"172.21.15.117:6803/106778208","heartbeat_front_addr":"172.21.15.117:6802/106778208","state":["exists","up"]},{"osd":5,"uuid":"f9fd3153-3e4e-4489-8927-a65641f05d42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":520,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6804","nonce":3199889891}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6805","nonce":3199889891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6807","nonce":3199889891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6806","nonce":3199889891}]},"public_addr":"172.21.15.117:6804/3199889891","cluster_addr":"172.21.15.117:6805/3199889891","heartbeat_back_addr":"172.21.15.117:6807/3199889891","heartbeat_front_addr":"172.21.15.117:6806/3199889891","state":["exists","up"]},{"osd":6,"uuid":"84898f12-c37d-4eb6-8b71-5b86bfe16e7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":433,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6808","nonce":2185843951}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6809","nonce":2185843951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6811","nonce":2185843951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6810","nonce":2185843951}]},"public_addr":"172.21.15.117:6808/2185843951","cluster_addr":"172.21.15.117:6809/2185843951","heartbeat_back_addr":"172.21.15.117:6811/2185843951","heartbeat_front_addr":"172.21.15.117:6810/2185843951","state":["exists","up"]},{"osd":7,"uuid":"529af2ce-2ae9-41ed-8c8e-d133628cfd20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":492,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6812","nonce":2817683239}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6813","nonce":2817683239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6815","nonce":2817683239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6814","nonce":2817683239}]},"public_addr":"172.21.15.117:6812/2817683239","cluster_addr":"172.21.15.117:6813/2817683239","heartbeat_back_addr":"172.21.15.117:6815/2817683239","heartbeat_front_addr":"172.21.15.117:6814/2817683239","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:43:43.305069+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:43:32.149803+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:42:48.956018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:43:27.490771+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:42:37.313017+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:43:28.294982+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:43:40.923806+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:43:57.932016+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"2.12","osds":[5,4,2]}],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":2}]},{"pgid":"2.3","mappings":[{"from":7,"to":4}]},{"pgid":"2.7","mappings":[{"from":7,"to":1}]},{"pgid":"2.19","mappings":[{"from":3,"to":1}]},{"pgid":"2.1a","mappings":[{"from":7,"to":2}]},{"pgid":"2.29","mappings":[{"from":7,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.1a","mappings":[{"from":4,"to":7}]},{"pgid":"5.19","mappings":[{"from":5,"to":7}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.97:0/2600364788":"2021-10-09T19:21:42.325540+0000","172.21.15.97:0/4129083289":"2021-10-09T19:21:42.325540+0000","172.21.15.97:0/1443158975":"2021-10-09T19:21:42.325540+0000","172.21.15.97:0/2472640384":"2021-10-09T19:21:42.325540+0000","172.21.15.97:0/3196919488":"2021-10-09T19:21:42.325540+0000","172.21.15.97:6800/3195862546":"2021-10-09T19:21:42.325540+0000","172.21.15.97:6800/3931202434":"2021-10-09T19:17:10.051948+0000","172.21.15.97:0/2761595213":"2021-10-09T19:17:10.051948+0000","172.21.15.97:0/900681504":"2021-10-09T19:17:10.051948+0000","172.21.15.97:0/3932251406":"2021-10-09T19:17:10.051948+0000","172.21.15.97:0/398006785":"2021-10-09T19:16:48.651177+0000","172.21.15.97:0/1642570050":"2021-10-09T19:16:48.651177+0000","172.21.15.97:0/300178790":"2021-10-09T19:16:48.651177+0000","172.21.15.97:6800/845999767":"2021-10-09T19:16:48.651177+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-10-08T19:44:01.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:01 smithi117 ceph-mon[34585]: 3.1 scrub ok 2021-10-08T19:44:02.069 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph tell osd.0 flush_pg_stats 2021-10-08T19:44:02.382 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:44:02.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:02 smithi097 ceph-mon[41966]: pgmap v1126: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:02.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:02 smithi097 ceph-mon[41966]: 2.20 scrub ok 2021-10-08T19:44:02.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:02 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1574298308' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-10-08T19:44:02.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:02 smithi097 ceph-mon[32687]: pgmap v1126: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:02.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:02 smithi097 ceph-mon[32687]: 2.20 scrub ok 2021-10-08T19:44:02.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:02 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1574298308' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-10-08T19:44:02.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:02 smithi117 ceph-mon[34585]: pgmap v1126: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:02.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:02 smithi117 ceph-mon[34585]: 2.20 scrub ok 2021-10-08T19:44:02.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:02 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1574298308' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-10-08T19:44:02.895 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:44:02 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:44:02] "GET /metrics HTTP/1.1" 200 154883 "" "Prometheus/2.18.1" 2021-10-08T19:44:03.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:03 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:44:03.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:03 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:44:03.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:03 smithi097 ceph-mon[32687]: 2.1f scrub ok 2021-10-08T19:44:03.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:03 smithi097 ceph-mon[32687]: 4.11 deep-scrub ok 2021-10-08T19:44:03.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:03 smithi097 ceph-mon[32687]: 2.3 scrub ok 2021-10-08T19:44:03.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:03 smithi097 ceph-mon[32687]: osdmap e528: 8 total, 8 up, 8 in 2021-10-08T19:44:03.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:03 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:44:03.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:03 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:44:03.474 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:03 smithi097 ceph-mon[41966]: 2.1f scrub ok 2021-10-08T19:44:03.474 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:03 smithi097 ceph-mon[41966]: 4.11 deep-scrub ok 2021-10-08T19:44:03.474 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:03 smithi097 ceph-mon[41966]: 2.3 scrub ok 2021-10-08T19:44:03.474 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:03 smithi097 ceph-mon[41966]: osdmap e528: 8 total, 8 up, 8 in 2021-10-08T19:44:03.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:03 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:44:03.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:03 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:44:03.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:03 smithi117 ceph-mon[34585]: 2.1f scrub ok 2021-10-08T19:44:03.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:03 smithi117 ceph-mon[34585]: 4.11 deep-scrub ok 2021-10-08T19:44:03.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:03 smithi117 ceph-mon[34585]: 2.3 scrub ok 2021-10-08T19:44:03.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:03 smithi117 ceph-mon[34585]: osdmap e528: 8 total, 8 up, 8 in 2021-10-08T19:44:04.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:44:03 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:44:03] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:44:04.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:04 smithi097 ceph-mon[32687]: pgmap v1128: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 726 B/s rd, 0 op/s 2021-10-08T19:44:04.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:04 smithi097 ceph-mon[32687]: 6.6 scrub ok 2021-10-08T19:44:04.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:04 smithi097 ceph-mon[32687]: 6.7 deep-scrub ok 2021-10-08T19:44:04.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:04 smithi097 ceph-mon[41966]: pgmap v1128: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 726 B/s rd, 0 op/s 2021-10-08T19:44:04.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:04 smithi097 ceph-mon[41966]: 6.6 scrub ok 2021-10-08T19:44:04.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:04 smithi097 ceph-mon[41966]: 6.7 deep-scrub ok 2021-10-08T19:44:04.519 INFO:teuthology.orchestra.run.smithi097.stdout:34359738671 2021-10-08T19:44:04.519 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph tell osd.1 flush_pg_stats 2021-10-08T19:44:04.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:04 smithi117 ceph-mon[34585]: pgmap v1128: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 726 B/s rd, 0 op/s 2021-10-08T19:44:04.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:04 smithi117 ceph-mon[34585]: 6.6 scrub ok 2021-10-08T19:44:04.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:04 smithi117 ceph-mon[34585]: 6.7 deep-scrub ok 2021-10-08T19:44:04.797 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:44:05.355 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:05 smithi097 ceph-mon[41966]: 3.a scrub ok 2021-10-08T19:44:05.356 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:05 smithi097 ceph-mon[41966]: 3.9 scrub ok 2021-10-08T19:44:05.356 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:05 smithi097 ceph-mon[41966]: 5.1d scrub ok 2021-10-08T19:44:05.356 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:05 smithi097 ceph-mon[41966]: 5.d scrub ok 2021-10-08T19:44:05.357 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:05 smithi097 ceph-mon[41966]: 2.1e scrub ok 2021-10-08T19:44:05.357 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:05 smithi097 ceph-mon[41966]: 1.a scrub ok 2021-10-08T19:44:05.357 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:05 smithi097 ceph-mon[32687]: 3.a scrub ok 2021-10-08T19:44:05.357 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:05 smithi097 ceph-mon[32687]: 3.9 scrub ok 2021-10-08T19:44:05.358 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:05 smithi097 ceph-mon[32687]: 5.1d scrub ok 2021-10-08T19:44:05.358 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:05 smithi097 ceph-mon[32687]: 5.d scrub ok 2021-10-08T19:44:05.358 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:05 smithi097 ceph-mon[32687]: 2.1e scrub ok 2021-10-08T19:44:05.358 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:05 smithi097 ceph-mon[32687]: 1.a scrub ok 2021-10-08T19:44:05.659 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:05 smithi117 ceph-mon[34585]: 3.a scrub ok 2021-10-08T19:44:05.659 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:05 smithi117 ceph-mon[34585]: 3.9 scrub ok 2021-10-08T19:44:05.659 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:05 smithi117 ceph-mon[34585]: 5.1d scrub ok 2021-10-08T19:44:05.660 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:05 smithi117 ceph-mon[34585]: 5.d scrub ok 2021-10-08T19:44:05.660 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:05 smithi117 ceph-mon[34585]: 2.1e scrub ok 2021-10-08T19:44:05.660 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:05 smithi117 ceph-mon[34585]: 1.a scrub ok 2021-10-08T19:44:06.468 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:06 smithi097 ceph-mon[41966]: pgmap v1129: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:06.469 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:06 smithi097 ceph-mon[41966]: 4.0 scrub ok 2021-10-08T19:44:06.469 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:06 smithi097 ceph-mon[32687]: pgmap v1129: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:06.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:06 smithi097 ceph-mon[32687]: 4.0 scrub ok 2021-10-08T19:44:06.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:06 smithi117 ceph-mon[34585]: pgmap v1129: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:06.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:06 smithi117 ceph-mon[34585]: 4.0 scrub ok 2021-10-08T19:44:07.044 INFO:teuthology.orchestra.run.smithi097.stdout:55834575148 2021-10-08T19:44:07.045 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph tell osd.2 flush_pg_stats 2021-10-08T19:44:07.325 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:44:07.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:07 smithi097 ceph-mon[32687]: 1.2 scrub ok 2021-10-08T19:44:07.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:07 smithi097 ceph-mon[32687]: 3.4 deep-scrub ok 2021-10-08T19:44:07.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:07 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:44:07.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:07 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:44:07.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:07 smithi097 ceph-mon[32687]: 5.15 scrub ok 2021-10-08T19:44:07.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:07 smithi097 ceph-mon[32687]: osdmap e529: 8 total, 8 up, 8 in 2021-10-08T19:44:07.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:07 smithi097 ceph-mon[41966]: 1.2 scrub ok 2021-10-08T19:44:07.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:07 smithi097 ceph-mon[41966]: 3.4 deep-scrub ok 2021-10-08T19:44:07.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:07 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:44:07.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:07 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:44:07.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:07 smithi097 ceph-mon[41966]: 5.15 scrub ok 2021-10-08T19:44:07.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:07 smithi097 ceph-mon[41966]: osdmap e529: 8 total, 8 up, 8 in 2021-10-08T19:44:07.527 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:07 smithi117 ceph-mon[34585]: 1.2 scrub ok 2021-10-08T19:44:07.527 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:07 smithi117 ceph-mon[34585]: 3.4 deep-scrub ok 2021-10-08T19:44:07.528 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:07 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:44:07.528 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:07 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:44:07.528 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:07 smithi117 ceph-mon[34585]: 5.15 scrub ok 2021-10-08T19:44:07.528 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:07 smithi117 ceph-mon[34585]: osdmap e529: 8 total, 8 up, 8 in 2021-10-08T19:44:07.906 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:44:07 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:44:08.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:08 smithi097 ceph-mon[41966]: pgmap v1131: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:44:08.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:08 smithi097 ceph-mon[41966]: 5.14 deep-scrub ok 2021-10-08T19:44:08.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:08 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:44:08.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:08 smithi097 ceph-mon[32687]: pgmap v1131: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:44:08.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:08 smithi097 ceph-mon[32687]: 5.14 deep-scrub ok 2021-10-08T19:44:08.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:08 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:44:08.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:08 smithi117 ceph-mon[34585]: pgmap v1131: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:44:08.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:08 smithi117 ceph-mon[34585]: 5.14 deep-scrub ok 2021-10-08T19:44:08.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:08 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:44:09.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:09 smithi097 ceph-mon[32687]: 6.12 scrub ok 2021-10-08T19:44:09.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:09 smithi097 ceph-mon[41966]: 6.12 scrub ok 2021-10-08T19:44:09.524 INFO:teuthology.orchestra.run.smithi097.stdout:77309411623 2021-10-08T19:44:09.525 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph tell osd.3 flush_pg_stats 2021-10-08T19:44:09.659 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:09 smithi117 ceph-mon[34585]: 6.12 scrub ok 2021-10-08T19:44:09.804 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:44:10.327 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:10 smithi097 ceph-mon[41966]: 3.d scrub ok 2021-10-08T19:44:10.327 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:10 smithi097 ceph-mon[41966]: 2.15 scrub ok 2021-10-08T19:44:10.327 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:10 smithi097 ceph-mon[41966]: pgmap v1132: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:10.327 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:10 smithi097 ceph-mon[41966]: 5.17 scrub ok 2021-10-08T19:44:10.328 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:10 smithi097 ceph-mon[32687]: 3.d scrub ok 2021-10-08T19:44:10.328 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:10 smithi097 ceph-mon[32687]: 2.15 scrub ok 2021-10-08T19:44:10.328 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:10 smithi097 ceph-mon[32687]: pgmap v1132: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:10.329 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:10 smithi097 ceph-mon[32687]: 5.17 scrub ok 2021-10-08T19:44:10.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:10 smithi117 ceph-mon[34585]: 3.d scrub ok 2021-10-08T19:44:10.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:10 smithi117 ceph-mon[34585]: 2.15 scrub ok 2021-10-08T19:44:10.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:10 smithi117 ceph-mon[34585]: pgmap v1132: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:10.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:10 smithi117 ceph-mon[34585]: 5.17 scrub ok 2021-10-08T19:44:11.359 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:11 smithi097 ceph-mon[41966]: 4.6 scrub ok 2021-10-08T19:44:11.360 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:11 smithi097 ceph-mon[32687]: 4.6 scrub ok 2021-10-08T19:44:11.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:11 smithi117 ceph-mon[34585]: 4.6 scrub ok 2021-10-08T19:44:11.968 INFO:teuthology.orchestra.run.smithi097.stdout:103079215398 2021-10-08T19:44:11.969 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph tell osd.4 flush_pg_stats 2021-10-08T19:44:12.246 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:44:12.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:12 smithi097 ceph-mon[32687]: pgmap v1133: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:12.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:12 smithi097 ceph-mon[41966]: pgmap v1133: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:12.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:12 smithi117 ceph-mon[34585]: pgmap v1133: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:12.656 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:44:12 smithi117 conmon[69189]: level=error ts=2021-10-08T19:44:12.314Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=1 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:44:12.753 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:44:12 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:44:12] "GET /metrics HTTP/1.1" 200 154882 "" "Prometheus/2.18.1" 2021-10-08T19:44:13.596 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:13 smithi097 ceph-mon[41966]: 6.0 scrub ok 2021-10-08T19:44:13.597 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:13 smithi097 ceph-mon[41966]: 5.0 scrub ok 2021-10-08T19:44:13.597 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:13 smithi097 ceph-mon[32687]: 6.0 scrub ok 2021-10-08T19:44:13.597 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:13 smithi097 ceph-mon[32687]: 5.0 scrub ok 2021-10-08T19:44:13.659 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:13 smithi117 ceph-mon[34585]: 6.0 scrub ok 2021-10-08T19:44:13.659 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:13 smithi117 ceph-mon[34585]: 5.0 scrub ok 2021-10-08T19:44:14.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:44:13 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:44:13] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:44:14.464 INFO:teuthology.orchestra.run.smithi097.stdout:128849019169 2021-10-08T19:44:14.465 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph tell osd.5 flush_pg_stats 2021-10-08T19:44:14.488 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:14 smithi097 ceph-mon[41966]: 4.1f scrub ok 2021-10-08T19:44:14.488 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:14 smithi097 ceph-mon[41966]: 4.e scrub ok 2021-10-08T19:44:14.488 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:14 smithi097 ceph-mon[41966]: pgmap v1134: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:44:14.489 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:14 smithi097 ceph-mon[41966]: 5.13 scrub ok 2021-10-08T19:44:14.489 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:14 smithi097 ceph-mon[41966]: 2.c scrub ok 2021-10-08T19:44:14.490 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:14 smithi097 ceph-mon[32687]: 4.1f scrub ok 2021-10-08T19:44:14.490 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:14 smithi097 ceph-mon[32687]: 4.e scrub ok 2021-10-08T19:44:14.490 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:14 smithi097 ceph-mon[32687]: pgmap v1134: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:44:14.490 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:14 smithi097 ceph-mon[32687]: 5.13 scrub ok 2021-10-08T19:44:14.491 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:14 smithi097 ceph-mon[32687]: 2.c scrub ok 2021-10-08T19:44:14.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:14 smithi117 ceph-mon[34585]: 4.1f scrub ok 2021-10-08T19:44:14.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:14 smithi117 ceph-mon[34585]: 4.e scrub ok 2021-10-08T19:44:14.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:14 smithi117 ceph-mon[34585]: pgmap v1134: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:44:14.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:14 smithi117 ceph-mon[34585]: 5.13 scrub ok 2021-10-08T19:44:14.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:14 smithi117 ceph-mon[34585]: 2.c scrub ok 2021-10-08T19:44:14.736 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:44:15.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:15 smithi117 ceph-mon[34585]: 4.18 deep-scrub ok 2021-10-08T19:44:15.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:15 smithi117 ceph-mon[34585]: 5.5 deep-scrub ok 2021-10-08T19:44:15.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:15 smithi097 ceph-mon[41966]: 4.18 deep-scrub ok 2021-10-08T19:44:15.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:15 smithi097 ceph-mon[41966]: 5.5 deep-scrub ok 2021-10-08T19:44:15.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:15 smithi097 ceph-mon[32687]: 4.18 deep-scrub ok 2021-10-08T19:44:15.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:15 smithi097 ceph-mon[32687]: 5.5 deep-scrub ok 2021-10-08T19:44:16.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:16 smithi117 ceph-mon[34585]: 2.11 deep-scrub ok 2021-10-08T19:44:16.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:16 smithi117 ceph-mon[34585]: pgmap v1135: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:44:16.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:16 smithi117 ceph-mon[34585]: 2.1c scrub ok 2021-10-08T19:44:16.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:16 smithi117 ceph-mon[34585]: 6.1a scrub ok 2021-10-08T19:44:16.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:16 smithi117 ceph-mon[34585]: 5.1e scrub ok 2021-10-08T19:44:16.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:16 smithi097 ceph-mon[32687]: 2.11 deep-scrub ok 2021-10-08T19:44:16.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:16 smithi097 ceph-mon[32687]: pgmap v1135: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:44:16.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:16 smithi097 ceph-mon[32687]: 2.1c scrub ok 2021-10-08T19:44:16.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:16 smithi097 ceph-mon[32687]: 6.1a scrub ok 2021-10-08T19:44:16.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:16 smithi097 ceph-mon[32687]: 5.1e scrub ok 2021-10-08T19:44:16.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:16 smithi097 ceph-mon[41966]: 2.11 deep-scrub ok 2021-10-08T19:44:16.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:16 smithi097 ceph-mon[41966]: pgmap v1135: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:44:16.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:16 smithi097 ceph-mon[41966]: 2.1c scrub ok 2021-10-08T19:44:16.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:16 smithi097 ceph-mon[41966]: 6.1a scrub ok 2021-10-08T19:44:16.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:16 smithi097 ceph-mon[41966]: 5.1e scrub ok 2021-10-08T19:44:17.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:17 smithi097 ceph-mon[32687]: 4.a scrub ok 2021-10-08T19:44:17.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:17 smithi097 ceph-mon[32687]: 3.14 scrub ok 2021-10-08T19:44:17.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:17 smithi097 ceph-mon[41966]: 4.a scrub ok 2021-10-08T19:44:17.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:17 smithi097 ceph-mon[41966]: 3.14 scrub ok 2021-10-08T19:44:17.538 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:17 smithi117 ceph-mon[34585]: 4.a scrub ok 2021-10-08T19:44:17.538 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:17 smithi117 ceph-mon[34585]: 3.14 scrub ok 2021-10-08T19:44:17.809 INFO:teuthology.orchestra.run.smithi097.stdout:163208757533 2021-10-08T19:44:17.810 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph tell osd.6 flush_pg_stats 2021-10-08T19:44:17.905 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:44:17 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:44:18.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:18 smithi097 ceph-mon[32687]: 2.a scrub ok 2021-10-08T19:44:18.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:18 smithi097 ceph-mon[32687]: pgmap v1136: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2021-10-08T19:44:18.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:18 smithi097 ceph-mon[32687]: 6.8 scrub ok 2021-10-08T19:44:18.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:18 smithi097 ceph-mon[32687]: 6.1b scrub ok 2021-10-08T19:44:18.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:18 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:44:18.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:18 smithi097 ceph-mon[41966]: 2.a scrub ok 2021-10-08T19:44:18.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:18 smithi097 ceph-mon[41966]: pgmap v1136: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2021-10-08T19:44:18.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:18 smithi097 ceph-mon[41966]: 6.8 scrub ok 2021-10-08T19:44:18.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:18 smithi097 ceph-mon[41966]: 6.1b scrub ok 2021-10-08T19:44:18.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:18 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:44:18.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:18 smithi117 ceph-mon[34585]: 2.a scrub ok 2021-10-08T19:44:18.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:18 smithi117 ceph-mon[34585]: pgmap v1136: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2021-10-08T19:44:18.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:18 smithi117 ceph-mon[34585]: 6.8 scrub ok 2021-10-08T19:44:18.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:18 smithi117 ceph-mon[34585]: 6.1b scrub ok 2021-10-08T19:44:18.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:18 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:44:18.664 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:44:19.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:19 smithi117 ceph-mon[34585]: 1.7 scrub ok 2021-10-08T19:44:19.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:19 smithi117 ceph-mon[34585]: 6.1 scrub ok 2021-10-08T19:44:19.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:19 smithi117 ceph-mon[34585]: 4.1a scrub ok 2021-10-08T19:44:19.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:19 smithi117 ceph-mon[34585]: 5.8 deep-scrub ok 2021-10-08T19:44:19.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:19 smithi097 ceph-mon[32687]: 1.7 scrub ok 2021-10-08T19:44:19.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:19 smithi097 ceph-mon[32687]: 6.1 scrub ok 2021-10-08T19:44:19.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:19 smithi097 ceph-mon[32687]: 4.1a scrub ok 2021-10-08T19:44:19.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:19 smithi097 ceph-mon[32687]: 5.8 deep-scrub ok 2021-10-08T19:44:19.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:19 smithi097 ceph-mon[41966]: 1.7 scrub ok 2021-10-08T19:44:19.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:19 smithi097 ceph-mon[41966]: 6.1 scrub ok 2021-10-08T19:44:19.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:19 smithi097 ceph-mon[41966]: 4.1a scrub ok 2021-10-08T19:44:19.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:19 smithi097 ceph-mon[41966]: 5.8 deep-scrub ok 2021-10-08T19:44:20.500 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:20 smithi097 ceph-mon[32687]: 4.12 scrub ok 2021-10-08T19:44:20.500 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:20 smithi097 ceph-mon[32687]: pgmap v1137: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:20.501 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:20 smithi097 ceph-mon[32687]: 4.f scrub ok 2021-10-08T19:44:20.501 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:20 smithi097 ceph-mon[41966]: 4.12 scrub ok 2021-10-08T19:44:20.501 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:20 smithi097 ceph-mon[41966]: pgmap v1137: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:20.502 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:20 smithi097 ceph-mon[41966]: 4.f scrub ok 2021-10-08T19:44:20.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:20 smithi117 ceph-mon[34585]: 4.12 scrub ok 2021-10-08T19:44:20.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:20 smithi117 ceph-mon[34585]: pgmap v1137: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:20.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:20 smithi117 ceph-mon[34585]: 4.f scrub ok 2021-10-08T19:44:21.114 INFO:teuthology.orchestra.run.smithi097.stdout:201863463196 2021-10-08T19:44:21.115 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph tell osd.7 flush_pg_stats 2021-10-08T19:44:21.422 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:44:21.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:21 smithi097 ceph-mon[41966]: 5.11 scrub ok 2021-10-08T19:44:21.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:21 smithi097 ceph-mon[41966]: 4.3 deep-scrub ok 2021-10-08T19:44:21.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:21 smithi097 ceph-mon[41966]: 4.19 scrub ok 2021-10-08T19:44:21.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:21 smithi097 ceph-mon[32687]: 5.11 scrub ok 2021-10-08T19:44:21.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:21 smithi097 ceph-mon[32687]: 4.3 deep-scrub ok 2021-10-08T19:44:21.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:21 smithi097 ceph-mon[32687]: 4.19 scrub ok 2021-10-08T19:44:21.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:21 smithi117 ceph-mon[34585]: 5.11 scrub ok 2021-10-08T19:44:21.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:21 smithi117 ceph-mon[34585]: 4.3 deep-scrub ok 2021-10-08T19:44:21.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:21 smithi117 ceph-mon[34585]: 4.19 scrub ok 2021-10-08T19:44:22.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:22 smithi097 ceph-mon[32687]: pgmap v1138: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:22.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:22 smithi097 ceph-mon[32687]: 6.16 scrub ok 2021-10-08T19:44:22.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:22 smithi097 ceph-mon[32687]: 3.3 scrub ok 2021-10-08T19:44:22.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:22 smithi097 ceph-mon[32687]: 5.1b scrub ok 2021-10-08T19:44:22.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:22 smithi097 ceph-mon[41966]: pgmap v1138: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:22.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:22 smithi097 ceph-mon[41966]: 6.16 scrub ok 2021-10-08T19:44:22.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:22 smithi097 ceph-mon[41966]: 3.3 scrub ok 2021-10-08T19:44:22.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:22 smithi097 ceph-mon[41966]: 5.1b scrub ok 2021-10-08T19:44:22.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:22 smithi117 ceph-mon[34585]: pgmap v1138: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:22.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:22 smithi117 ceph-mon[34585]: 6.16 scrub ok 2021-10-08T19:44:22.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:22 smithi117 ceph-mon[34585]: 3.3 scrub ok 2021-10-08T19:44:22.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:22 smithi117 ceph-mon[34585]: 5.1b scrub ok 2021-10-08T19:44:22.969 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:44:22 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:44:22] "GET /metrics HTTP/1.1" 200 154882 "" "Prometheus/2.18.1" 2021-10-08T19:44:23.224 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:44:23 smithi097 conmon[33110]: 172.21.15.97 - - [08/Oct/2021:19:44:23] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:44:23.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:23 smithi117 ceph-mon[34585]: 2.28 scrub ok 2021-10-08T19:44:23.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:23 smithi117 ceph-mon[34585]: 4.15 scrub ok 2021-10-08T19:44:23.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:23 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:44:23.720 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:44:23 smithi097 conmon[33110]: 172.21.15.117 - - [08/Oct/2021:19:44:23] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:44:23.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:23 smithi097 ceph-mon[32687]: 2.28 scrub ok 2021-10-08T19:44:23.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:23 smithi097 ceph-mon[32687]: 4.15 scrub ok 2021-10-08T19:44:23.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:23 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:44:23.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:23 smithi097 ceph-mon[41966]: 2.28 scrub ok 2021-10-08T19:44:23.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:23 smithi097 ceph-mon[41966]: 4.15 scrub ok 2021-10-08T19:44:23.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:23 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:44:23.915 INFO:teuthology.orchestra.run.smithi097.stdout:236223201560 2021-10-08T19:44:23.916 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd last-stat-seq osd.0 2021-10-08T19:44:24.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:44:23 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:44:23] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:44:24.193 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:44:24.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:24 smithi117 ceph-mon[34585]: 6.1c scrub ok 2021-10-08T19:44:24.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:24 smithi117 ceph-mon[34585]: pgmap v1139: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:24.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:24 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:44:24.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:24 smithi117 ceph-mon[34585]: 172.21.15.97 - - [08/Oct/2021:19:44:23] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:44:24.659 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:24 smithi117 ceph-mon[34585]: 6.1e scrub ok 2021-10-08T19:44:24.659 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:24 smithi117 ceph-mon[34585]: 6.14 scrub ok 2021-10-08T19:44:24.659 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:24 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:44:24.659 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:24 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:44:24.660 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:24 smithi117 ceph-mon[34585]: 172.21.15.117 - - [08/Oct/2021:19:44:23] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:44:24.713 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:24 smithi097 ceph-mon[41966]: 6.1c scrub ok 2021-10-08T19:44:24.713 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:24 smithi097 ceph-mon[41966]: pgmap v1139: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:24.714 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:24 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:44:24.714 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:24 smithi097 ceph-mon[41966]: 172.21.15.97 - - [08/Oct/2021:19:44:23] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:44:24.714 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:24 smithi097 ceph-mon[41966]: 6.1e scrub ok 2021-10-08T19:44:24.715 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:24 smithi097 ceph-mon[41966]: 6.14 scrub ok 2021-10-08T19:44:24.715 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:24 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:44:24.715 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:24 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:44:24.715 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:24 smithi097 ceph-mon[41966]: 172.21.15.117 - - [08/Oct/2021:19:44:23] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:44:24.716 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:24 smithi097 ceph-mon[32687]: 6.1c scrub ok 2021-10-08T19:44:24.716 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:24 smithi097 ceph-mon[32687]: pgmap v1139: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:24.716 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:24 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:44:24.716 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:24 smithi097 ceph-mon[32687]: 172.21.15.97 - - [08/Oct/2021:19:44:23] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:44:24.717 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:24 smithi097 ceph-mon[32687]: 6.1e scrub ok 2021-10-08T19:44:24.717 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:24 smithi097 ceph-mon[32687]: 6.14 scrub ok 2021-10-08T19:44:24.717 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:24 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:44:24.717 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:24 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:44:24.718 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:24 smithi097 ceph-mon[32687]: 172.21.15.117 - - [08/Oct/2021:19:44:23] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:44:25.543 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:25 smithi097 ceph-mon[41966]: 2.10 scrub ok 2021-10-08T19:44:25.543 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:25 smithi097 ceph-mon[32687]: 2.10 scrub ok 2021-10-08T19:44:25.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:25 smithi117 ceph-mon[34585]: 2.10 scrub ok 2021-10-08T19:44:25.924 INFO:teuthology.orchestra.run.smithi097.stdout:34359738675 2021-10-08T19:44:26.555 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:26 smithi097 ceph-mon[41966]: pgmap v1140: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:26.555 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:26 smithi097 ceph-mon[41966]: 5.3 scrub ok 2021-10-08T19:44:26.556 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:26 smithi097 ceph-mon[41966]: 4.9 scrub ok 2021-10-08T19:44:26.556 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:26 smithi097 ceph-mon[41966]: 2.16 scrub ok 2021-10-08T19:44:26.556 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:26 smithi097 ceph-mon[41966]: 6.11 scrub ok 2021-10-08T19:44:26.556 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:26 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/158938214' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2021-10-08T19:44:26.557 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:26 smithi097 ceph-mon[32687]: pgmap v1140: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:26.557 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:26 smithi097 ceph-mon[32687]: 5.3 scrub ok 2021-10-08T19:44:26.558 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:26 smithi097 ceph-mon[32687]: 4.9 scrub ok 2021-10-08T19:44:26.558 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:26 smithi097 ceph-mon[32687]: 2.16 scrub ok 2021-10-08T19:44:26.558 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:26 smithi097 ceph-mon[32687]: 6.11 scrub ok 2021-10-08T19:44:26.558 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:26 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/158938214' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2021-10-08T19:44:26.559 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738671 got 34359738675 for osd.0 2021-10-08T19:44:26.560 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd last-stat-seq osd.1 2021-10-08T19:44:26.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:26 smithi117 ceph-mon[34585]: pgmap v1140: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:26.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:26 smithi117 ceph-mon[34585]: 5.3 scrub ok 2021-10-08T19:44:26.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:26 smithi117 ceph-mon[34585]: 4.9 scrub ok 2021-10-08T19:44:26.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:26 smithi117 ceph-mon[34585]: 2.16 scrub ok 2021-10-08T19:44:26.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:26 smithi117 ceph-mon[34585]: 6.11 scrub ok 2021-10-08T19:44:26.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:26 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/158938214' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2021-10-08T19:44:26.831 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:44:27.422 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:27 smithi097 ceph-mon[41966]: 4.b scrub ok 2021-10-08T19:44:27.423 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:27 smithi097 ceph-mon[41966]: 5.f scrub ok 2021-10-08T19:44:27.423 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:27 smithi097 ceph-mon[32687]: 4.b scrub ok 2021-10-08T19:44:27.423 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:27 smithi097 ceph-mon[32687]: 5.f scrub ok 2021-10-08T19:44:27.549 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:27 smithi117 ceph-mon[34585]: 4.b scrub ok 2021-10-08T19:44:27.549 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:27 smithi117 ceph-mon[34585]: 5.f scrub ok 2021-10-08T19:44:27.905 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:44:27 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:44:28.634 INFO:teuthology.orchestra.run.smithi097.stdout:55834575152 2021-10-08T19:44:28.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:28 smithi117 ceph-mon[34585]: 4.2 scrub ok 2021-10-08T19:44:28.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:28 smithi117 ceph-mon[34585]: pgmap v1141: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:28.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:28 smithi117 ceph-mon[34585]: 4.1 scrub ok 2021-10-08T19:44:28.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:28 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:44:28.657 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:28 smithi097 ceph-mon[41966]: 4.2 scrub ok 2021-10-08T19:44:28.657 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:28 smithi097 ceph-mon[41966]: pgmap v1141: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:28.658 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:28 smithi097 ceph-mon[41966]: 4.1 scrub ok 2021-10-08T19:44:28.658 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:28 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:44:28.658 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:28 smithi097 ceph-mon[32687]: 4.2 scrub ok 2021-10-08T19:44:28.658 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:28 smithi097 ceph-mon[32687]: pgmap v1141: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:28.659 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:28 smithi097 ceph-mon[32687]: 4.1 scrub ok 2021-10-08T19:44:28.659 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:28 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:44:29.322 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834575148 got 55834575152 for osd.1 2021-10-08T19:44:29.323 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd last-stat-seq osd.2 2021-10-08T19:44:29.596 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:44:29.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:29 smithi117 ceph-mon[34585]: 6.19 scrub ok 2021-10-08T19:44:29.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:29 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/1648566684' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2021-10-08T19:44:29.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:29 smithi097 ceph-mon[32687]: 6.19 scrub ok 2021-10-08T19:44:29.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:29 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/1648566684' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2021-10-08T19:44:29.720 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:29 smithi097 ceph-mon[41966]: 6.19 scrub ok 2021-10-08T19:44:29.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:29 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/1648566684' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2021-10-08T19:44:30.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:30 smithi097 ceph-mon[32687]: pgmap v1142: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:44:30.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:30 smithi097 ceph-mon[41966]: pgmap v1142: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:44:30.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:30 smithi117 ceph-mon[34585]: pgmap v1142: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:44:31.287 INFO:teuthology.orchestra.run.smithi097.stdout:77309411627 2021-10-08T19:44:31.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:31 smithi117 ceph-mon[34585]: 6.1d scrub ok 2021-10-08T19:44:31.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:31 smithi117 ceph-mon[34585]: 6.9 scrub ok 2021-10-08T19:44:31.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:31 smithi097 ceph-mon[41966]: 6.1d scrub ok 2021-10-08T19:44:31.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:31 smithi097 ceph-mon[41966]: 6.9 scrub ok 2021-10-08T19:44:31.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:31 smithi097 ceph-mon[32687]: 6.1d scrub ok 2021-10-08T19:44:31.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:31 smithi097 ceph-mon[32687]: 6.9 scrub ok 2021-10-08T19:44:31.922 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411623 got 77309411627 for osd.2 2021-10-08T19:44:31.923 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd last-stat-seq osd.3 2021-10-08T19:44:32.196 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:44:32.651 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:32 smithi097 ceph-mon[41966]: pgmap v1143: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:32.652 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:32 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/265774075' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2021-10-08T19:44:32.652 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:32 smithi097 ceph-mon[41966]: 5.a scrub ok 2021-10-08T19:44:32.652 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:32 smithi097 ceph-mon[32687]: pgmap v1143: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:32.653 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:32 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/265774075' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2021-10-08T19:44:32.653 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:32 smithi097 ceph-mon[32687]: 5.a scrub ok 2021-10-08T19:44:32.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:32 smithi117 ceph-mon[34585]: pgmap v1143: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:32.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:32 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/265774075' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2021-10-08T19:44:32.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:32 smithi117 ceph-mon[34585]: 5.a scrub ok 2021-10-08T19:44:32.656 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:44:32 smithi117 conmon[69189]: level=error ts=2021-10-08T19:44:32.314Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=6 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:44:32.656 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:44:32 smithi117 conmon[69189]: level=error ts=2021-10-08T19:44:32.314Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=1 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:44:32.971 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:44:32 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:44:32] "GET /metrics HTTP/1.1" 200 154884 "" "Prometheus/2.18.1" 2021-10-08T19:44:33.558 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:33 smithi097 ceph-mon[41966]: 5.1a deep-scrub ok 2021-10-08T19:44:33.558 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:33 smithi097 ceph-mon[41966]: 6.1f scrub ok 2021-10-08T19:44:33.559 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:33 smithi097 ceph-mon[32687]: 5.1a deep-scrub ok 2021-10-08T19:44:33.559 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:33 smithi097 ceph-mon[32687]: 6.1f scrub ok 2021-10-08T19:44:33.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:33 smithi117 ceph-mon[34585]: 5.1a deep-scrub ok 2021-10-08T19:44:33.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:33 smithi117 ceph-mon[34585]: 6.1f scrub ok 2021-10-08T19:44:33.656 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:44:33 smithi117 conmon[69189]: level=error ts=2021-10-08T19:44:33.505Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=2 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:44:33.941 INFO:teuthology.orchestra.run.smithi097.stdout:103079215402 2021-10-08T19:44:34.155 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:44:33 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:44:33] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:44:34.562 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:34 smithi097 ceph-mon[41966]: 2.6 scrub ok 2021-10-08T19:44:34.562 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:34 smithi097 ceph-mon[41966]: pgmap v1144: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:34.563 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:34 smithi097 ceph-mon[41966]: 2.18 deep-scrub ok 2021-10-08T19:44:34.563 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:34 smithi097 ceph-mon[41966]: 4.13 scrub ok 2021-10-08T19:44:34.563 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:34 smithi097 ceph-mon[41966]: 1.4 scrub ok 2021-10-08T19:44:34.563 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:34 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/145373005' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2021-10-08T19:44:34.564 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:34 smithi097 ceph-mon[32687]: 2.6 scrub ok 2021-10-08T19:44:34.564 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:34 smithi097 ceph-mon[32687]: pgmap v1144: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:34.564 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:34 smithi097 ceph-mon[32687]: 2.18 deep-scrub ok 2021-10-08T19:44:34.565 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:34 smithi097 ceph-mon[32687]: 4.13 scrub ok 2021-10-08T19:44:34.565 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:34 smithi097 ceph-mon[32687]: 1.4 scrub ok 2021-10-08T19:44:34.565 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:34 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/145373005' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2021-10-08T19:44:34.567 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215398 got 103079215402 for osd.3 2021-10-08T19:44:34.568 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd last-stat-seq osd.4 2021-10-08T19:44:34.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:34 smithi117 ceph-mon[34585]: 2.6 scrub ok 2021-10-08T19:44:34.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:34 smithi117 ceph-mon[34585]: pgmap v1144: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:34.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:34 smithi117 ceph-mon[34585]: 2.18 deep-scrub ok 2021-10-08T19:44:34.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:34 smithi117 ceph-mon[34585]: 4.13 scrub ok 2021-10-08T19:44:34.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:34 smithi117 ceph-mon[34585]: 1.4 scrub ok 2021-10-08T19:44:34.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:34 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/145373005' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2021-10-08T19:44:34.847 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:44:35.435 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:35 smithi097 ceph-mon[41966]: 3.e scrub ok 2021-10-08T19:44:35.436 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:35 smithi097 ceph-mon[41966]: 4.1e scrub ok 2021-10-08T19:44:35.436 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:35 smithi097 ceph-mon[32687]: 3.e scrub ok 2021-10-08T19:44:35.437 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:35 smithi097 ceph-mon[32687]: 4.1e scrub ok 2021-10-08T19:44:35.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:35 smithi117 ceph-mon[34585]: 3.e scrub ok 2021-10-08T19:44:35.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:35 smithi117 ceph-mon[34585]: 4.1e scrub ok 2021-10-08T19:44:36.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:36 smithi097 ceph-mon[32687]: pgmap v1145: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:36.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:36 smithi097 ceph-mon[32687]: 4.1b scrub ok 2021-10-08T19:44:36.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:36 smithi097 ceph-mon[32687]: 2.1a scrub ok 2021-10-08T19:44:36.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:36 smithi097 ceph-mon[41966]: pgmap v1145: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:36.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:36 smithi097 ceph-mon[41966]: 4.1b scrub ok 2021-10-08T19:44:36.472 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:36 smithi097 ceph-mon[41966]: 2.1a scrub ok 2021-10-08T19:44:36.601 INFO:teuthology.orchestra.run.smithi097.stdout:128849019173 2021-10-08T19:44:36.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:36 smithi117 ceph-mon[34585]: pgmap v1145: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:36.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:36 smithi117 ceph-mon[34585]: 4.1b scrub ok 2021-10-08T19:44:36.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:36 smithi117 ceph-mon[34585]: 2.1a scrub ok 2021-10-08T19:44:37.273 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849019169 got 128849019173 for osd.4 2021-10-08T19:44:37.274 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd last-stat-seq osd.5 2021-10-08T19:44:37.549 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:44:37.560 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:37 smithi117 ceph-mon[34585]: 3.13 scrub ok 2021-10-08T19:44:37.560 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:37 smithi117 ceph-mon[34585]: 3.2 scrub ok 2021-10-08T19:44:37.560 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:37 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/827808860' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2021-10-08T19:44:37.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:37 smithi097 ceph-mon[32687]: 3.13 scrub ok 2021-10-08T19:44:37.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:37 smithi097 ceph-mon[32687]: 3.2 scrub ok 2021-10-08T19:44:37.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:37 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/827808860' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2021-10-08T19:44:37.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:37 smithi097 ceph-mon[41966]: 3.13 scrub ok 2021-10-08T19:44:37.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:37 smithi097 ceph-mon[41966]: 3.2 scrub ok 2021-10-08T19:44:37.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:37 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/827808860' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2021-10-08T19:44:37.905 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:44:37 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:44:38.470 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:38 smithi097 ceph-mon[32687]: 5.c scrub ok 2021-10-08T19:44:38.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:38 smithi097 ceph-mon[32687]: pgmap v1146: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:38.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:38 smithi097 ceph-mon[32687]: 4.8 scrub ok 2021-10-08T19:44:38.471 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:38 smithi097 ceph-mon[32687]: 5.1 scrub ok 2021-10-08T19:44:38.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:38 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:44:38.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:38 smithi097 ceph-mon[41966]: 5.c scrub ok 2021-10-08T19:44:38.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:38 smithi097 ceph-mon[41966]: pgmap v1146: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:38.473 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:38 smithi097 ceph-mon[41966]: 4.8 scrub ok 2021-10-08T19:44:38.474 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:38 smithi097 ceph-mon[41966]: 5.1 scrub ok 2021-10-08T19:44:38.474 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:38 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:44:38.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:38 smithi117 ceph-mon[34585]: 5.c scrub ok 2021-10-08T19:44:38.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:38 smithi117 ceph-mon[34585]: pgmap v1146: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:38.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:38 smithi117 ceph-mon[34585]: 4.8 scrub ok 2021-10-08T19:44:38.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:38 smithi117 ceph-mon[34585]: 5.1 scrub ok 2021-10-08T19:44:38.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:38 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:44:39.343 INFO:teuthology.orchestra.run.smithi097.stdout:163208757537 2021-10-08T19:44:39.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:39 smithi117 ceph-mon[34585]: 2.23 scrub ok 2021-10-08T19:44:39.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:39 smithi117 ceph-mon[34585]: 6.e scrub ok 2021-10-08T19:44:39.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:39 smithi117 ceph-mon[34585]: 6.f scrub ok 2021-10-08T19:44:39.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:39 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:44:39.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:39 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:44:39.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:39 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:44:39.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:39 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:44:39.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:39 smithi097 ceph-mon[32687]: 2.23 scrub ok 2021-10-08T19:44:39.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:39 smithi097 ceph-mon[32687]: 6.e scrub ok 2021-10-08T19:44:39.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:39 smithi097 ceph-mon[32687]: 6.f scrub ok 2021-10-08T19:44:39.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:39 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:44:39.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:39 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:44:39.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:39 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:44:39.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:39 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:44:39.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:39 smithi097 ceph-mon[41966]: 2.23 scrub ok 2021-10-08T19:44:39.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:39 smithi097 ceph-mon[41966]: 6.e scrub ok 2021-10-08T19:44:39.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:39 smithi097 ceph-mon[41966]: 6.f scrub ok 2021-10-08T19:44:39.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:39 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:44:39.725 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:39 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:44:39.725 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:39 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:44:39.725 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:39 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:44:39.979 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757533 got 163208757537 for osd.5 2021-10-08T19:44:39.980 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd last-stat-seq osd.6 2021-10-08T19:44:40.253 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:44:40.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:40 smithi117 ceph-mon[34585]: pgmap v1147: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:40.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:40 smithi117 ceph-mon[34585]: 4.17 deep-scrub ok 2021-10-08T19:44:40.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:40 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/4024872973' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2021-10-08T19:44:40.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:40 smithi097 ceph-mon[32687]: pgmap v1147: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:40.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:40 smithi097 ceph-mon[32687]: 4.17 deep-scrub ok 2021-10-08T19:44:40.723 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:40 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/4024872973' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2021-10-08T19:44:40.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:40 smithi097 ceph-mon[41966]: pgmap v1147: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:40.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:40 smithi097 ceph-mon[41966]: 4.17 deep-scrub ok 2021-10-08T19:44:40.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:40 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/4024872973' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2021-10-08T19:44:41.649 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:41 smithi097 ceph-mon[41966]: 6.b scrub ok 2021-10-08T19:44:41.649 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:41 smithi097 ceph-mon[32687]: 6.b scrub ok 2021-10-08T19:44:41.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:41 smithi117 ceph-mon[34585]: 6.b scrub ok 2021-10-08T19:44:42.036 INFO:teuthology.orchestra.run.smithi097.stdout:201863463200 2021-10-08T19:44:42.639 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:42 smithi097 ceph-mon[41966]: pgmap v1148: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:42.639 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:42 smithi097 ceph-mon[41966]: 2.21 scrub ok 2021-10-08T19:44:42.639 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:42 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3915171476' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2021-10-08T19:44:42.640 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:42 smithi097 ceph-mon[32687]: pgmap v1148: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:42.640 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:42 smithi097 ceph-mon[32687]: 2.21 scrub ok 2021-10-08T19:44:42.641 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:42 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3915171476' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2021-10-08T19:44:42.642 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863463196 got 201863463200 for osd.6 2021-10-08T19:44:42.642 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph osd last-stat-seq osd.7 2021-10-08T19:44:42.655 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:44:42 smithi117 conmon[69189]: level=error ts=2021-10-08T19:44:42.314Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=2 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:44:42.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:42 smithi117 ceph-mon[34585]: pgmap v1148: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:42.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:42 smithi117 ceph-mon[34585]: 2.21 scrub ok 2021-10-08T19:44:42.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:42 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3915171476' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2021-10-08T19:44:42.913 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:44:42.970 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:44:42 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:44:42] "GET /metrics HTTP/1.1" 200 154883 "" "Prometheus/2.18.1" 2021-10-08T19:44:43.409 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:43 smithi097 ceph-mon[41966]: 3.6 scrub ok 2021-10-08T19:44:43.409 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:43 smithi097 ceph-mon[41966]: 5.18 scrub ok 2021-10-08T19:44:43.410 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:43 smithi097 ceph-mon[41966]: 2.1b scrub ok 2021-10-08T19:44:43.410 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:44:43.410 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:43 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:44:43.411 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:43 smithi097 ceph-mon[32687]: 3.6 scrub ok 2021-10-08T19:44:43.411 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:43 smithi097 ceph-mon[32687]: 5.18 scrub ok 2021-10-08T19:44:43.411 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:43 smithi097 ceph-mon[32687]: 2.1b scrub ok 2021-10-08T19:44:43.411 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:44:43.412 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:43 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:44:43.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:43 smithi117 ceph-mon[34585]: 3.6 scrub ok 2021-10-08T19:44:43.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:43 smithi117 ceph-mon[34585]: 5.18 scrub ok 2021-10-08T19:44:43.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:43 smithi117 ceph-mon[34585]: 2.1b scrub ok 2021-10-08T19:44:43.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:44:43.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:43 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:44:44.060 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:44:43 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:44:43] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:44:44.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:44 smithi117 ceph-mon[34585]: 5.4 scrub ok 2021-10-08T19:44:44.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:44 smithi117 ceph-mon[34585]: pgmap v1149: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:44.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:44 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:44:44.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:44 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:44:44.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:44 smithi117 ceph-mon[34585]: 2.24 scrub ok 2021-10-08T19:44:44.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:44 smithi097 ceph-mon[32687]: 5.4 scrub ok 2021-10-08T19:44:44.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:44 smithi097 ceph-mon[32687]: pgmap v1149: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:44.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:44 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:44:44.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:44 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:44:44.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:44 smithi097 ceph-mon[32687]: 2.24 scrub ok 2021-10-08T19:44:44.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:44 smithi097 ceph-mon[41966]: 5.4 scrub ok 2021-10-08T19:44:44.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:44 smithi097 ceph-mon[41966]: pgmap v1149: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:44.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:44 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:44:44.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:44 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:44:44.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:44 smithi097 ceph-mon[41966]: 2.24 scrub ok 2021-10-08T19:44:45.340 INFO:teuthology.orchestra.run.smithi097.stdout:236223201565 2021-10-08T19:44:45.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:45 smithi117 ceph-mon[34585]: 5.9 scrub ok 2021-10-08T19:44:45.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:45 smithi117 ceph-mon[34585]: 4.4 scrub ok 2021-10-08T19:44:45.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:45 smithi117 ceph-mon[34585]: 2.13 scrub ok 2021-10-08T19:44:45.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:45 smithi117 ceph-mon[34585]: osdmap e530: 8 total, 8 up, 8 in 2021-10-08T19:44:45.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:45 smithi117 ceph-mon[34585]: 6.a deep-scrub ok 2021-10-08T19:44:45.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:45 smithi117 ceph-mon[34585]: 3.10 scrub ok 2021-10-08T19:44:45.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:45 smithi097 ceph-mon[32687]: 5.9 scrub ok 2021-10-08T19:44:45.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:45 smithi097 ceph-mon[32687]: 4.4 scrub ok 2021-10-08T19:44:45.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:45 smithi097 ceph-mon[32687]: 2.13 scrub ok 2021-10-08T19:44:45.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:45 smithi097 ceph-mon[32687]: osdmap e530: 8 total, 8 up, 8 in 2021-10-08T19:44:45.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:45 smithi097 ceph-mon[32687]: 6.a deep-scrub ok 2021-10-08T19:44:45.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:45 smithi097 ceph-mon[32687]: 3.10 scrub ok 2021-10-08T19:44:45.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:45 smithi097 ceph-mon[41966]: 5.9 scrub ok 2021-10-08T19:44:45.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:45 smithi097 ceph-mon[41966]: 4.4 scrub ok 2021-10-08T19:44:45.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:45 smithi097 ceph-mon[41966]: 2.13 scrub ok 2021-10-08T19:44:45.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:45 smithi097 ceph-mon[41966]: osdmap e530: 8 total, 8 up, 8 in 2021-10-08T19:44:45.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:45 smithi097 ceph-mon[41966]: 6.a deep-scrub ok 2021-10-08T19:44:45.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:45 smithi097 ceph-mon[41966]: 3.10 scrub ok 2021-10-08T19:44:46.087 INFO:tasks.cephadm.ceph_manager.ceph:need seq 236223201560 got 236223201565 for osd.7 2021-10-08T19:44:46.088 INFO:tasks.cephadm.ceph_manager.ceph:waiting for recovery to complete 2021-10-08T19:44:46.088 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph pg dump --format=json 2021-10-08T19:44:46.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:46 smithi117 ceph-mon[34585]: pgmap v1151: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:44:46.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:46 smithi117 ceph-mon[34585]: from='client.? v1:172.21.15.97:0/3403263849' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2021-10-08T19:44:46.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:46 smithi117 ceph-mon[34585]: 2.22 scrub ok 2021-10-08T19:44:46.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:46 smithi097 ceph-mon[32687]: pgmap v1151: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:44:46.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:46 smithi097 ceph-mon[32687]: from='client.? v1:172.21.15.97:0/3403263849' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2021-10-08T19:44:46.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:46 smithi097 ceph-mon[32687]: 2.22 scrub ok 2021-10-08T19:44:46.722 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:46 smithi097 ceph-mon[41966]: pgmap v1151: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:44:46.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:46 smithi097 ceph-mon[41966]: from='client.? v1:172.21.15.97:0/3403263849' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2021-10-08T19:44:46.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:46 smithi097 ceph-mon[41966]: 2.22 scrub ok 2021-10-08T19:44:46.916 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:44:47.449 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:47 smithi097 ceph-mon[41966]: 2.9 scrub ok 2021-10-08T19:44:47.450 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:47 smithi097 ceph-mon[41966]: 2.1 scrub ok 2021-10-08T19:44:47.450 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:47 smithi097 ceph-mon[32687]: 2.9 scrub ok 2021-10-08T19:44:47.450 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:47 smithi097 ceph-mon[32687]: 2.1 scrub ok 2021-10-08T19:44:47.658 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:44:47 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:44:47.659 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:47 smithi117 ceph-mon[34585]: 2.9 scrub ok 2021-10-08T19:44:47.659 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:47 smithi117 ceph-mon[34585]: 2.1 scrub ok 2021-10-08T19:44:48.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:48 smithi117 ceph-mon[34585]: 2.1d scrub ok 2021-10-08T19:44:48.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:48 smithi117 ceph-mon[34585]: pgmap v1152: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:44:48.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:48 smithi117 ceph-mon[34585]: 5.6 scrub ok 2021-10-08T19:44:48.696 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:44:48.703 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2021-10-08T19:44:48.716 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:48 smithi097 ceph-mon[41966]: 2.1d scrub ok 2021-10-08T19:44:48.716 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:48 smithi097 ceph-mon[41966]: pgmap v1152: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:44:48.716 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:48 smithi097 ceph-mon[41966]: 5.6 scrub ok 2021-10-08T19:44:48.717 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:48 smithi097 ceph-mon[32687]: 2.1d scrub ok 2021-10-08T19:44:48.717 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:48 smithi097 ceph-mon[32687]: pgmap v1152: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:44:48.717 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:48 smithi097 ceph-mon[32687]: 5.6 scrub ok 2021-10-08T19:44:49.285 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":1152,"stamp":"2021-10-08T19:44:47.081006+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596164,"num_objects":194,"num_object_clones":0,"num_object_copies":582,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":2393,"num_read_kb":2150,"num_write":995,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":538,"num_bytes_recovered":12116,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2604,"ondisk_log_size":2604,"up":516,"acting":516,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":516,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":3252728,"kb_used_data":7928,"kb_used_omap":0,"kb_used_meta":3244736,"kb_avail":746708488,"statfs":{"total":767960285184,"available":764629491712,"internally_reserved":0,"allocated":8118272,"data_stored":4961260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3322609664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002861"},"pg_stats":[{"pgid":"2.29","version":"0'0","reported_seq":172,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:03.463077+0000","last_change":"2021-10-08T19:43:35.589984+0000","last_active":"2021-10-08T19:44:03.463077+0000","last_peered":"2021-10-08T19:44:03.463077+0000","last_clean":"2021-10-08T19:44:03.463077+0000","last_became_active":"2021-10-08T19:37:45.848663+0000","last_became_peered":"2021-10-08T19:37:45.848663+0000","last_unstale":"2021-10-08T19:44:03.463077+0000","last_undegraded":"2021-10-08T19:44:03.463077+0000","last_fullsized":"2021-10-08T19:44:03.463077+0000","mapping_epoch":407,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":408,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:35.589837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:30:11.102934+0000","last_clean_scrub_stamp":"2021-10-08T19:43:35.589837+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0026742670000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.28","version":"0'0","reported_seq":164,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:22.374519+0000","last_change":"2021-10-08T19:44:22.374033+0000","last_active":"2021-10-08T19:44:22.374519+0000","last_peered":"2021-10-08T19:44:22.374519+0000","last_clean":"2021-10-08T19:44:22.374519+0000","last_became_active":"2021-10-08T19:37:00.334502+0000","last_became_peered":"2021-10-08T19:37:00.334502+0000","last_unstale":"2021-10-08T19:44:22.374519+0000","last_undegraded":"2021-10-08T19:44:22.374519+0000","last_fullsized":"2021-10-08T19:44:22.374519+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:22.373961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:44:22.373961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0033987969999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.27","version":"0'0","reported_seq":476,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:03.497560+0000","last_change":"2021-10-08T19:43:52.935508+0000","last_active":"2021-10-08T19:44:03.497560+0000","last_peered":"2021-10-08T19:44:03.497560+0000","last_clean":"2021-10-08T19:44:03.497560+0000","last_became_active":"2021-10-08T19:37:00.342526+0000","last_became_peered":"2021-10-08T19:37:00.342526+0000","last_unstale":"2021-10-08T19:44:03.497560+0000","last_undegraded":"2021-10-08T19:44:03.497560+0000","last_fullsized":"2021-10-08T19:44:03.497560+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:52.935432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:43:52.935432+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001380771,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.26","version":"0'0","reported_seq":163,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:03.497366+0000","last_change":"2021-10-08T19:43:57.043253+0000","last_active":"2021-10-08T19:44:03.497366+0000","last_peered":"2021-10-08T19:44:03.497366+0000","last_clean":"2021-10-08T19:44:03.497366+0000","last_became_active":"2021-10-08T19:37:00.340327+0000","last_became_peered":"2021-10-08T19:37:00.340327+0000","last_unstale":"2021-10-08T19:44:03.497366+0000","last_undegraded":"2021-10-08T19:44:03.497366+0000","last_fullsized":"2021-10-08T19:44:03.497366+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:57.043176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:07.710367+0000","last_clean_scrub_stamp":"2021-10-08T19:43:57.043176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0013828989999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.25","version":"328'2","reported_seq":474,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:02.960226+0000","last_change":"2021-10-08T19:43:32.944412+0000","last_active":"2021-10-08T19:44:02.960226+0000","last_peered":"2021-10-08T19:44:02.960226+0000","last_clean":"2021-10-08T19:44:02.960226+0000","last_became_active":"2021-10-08T19:37:00.344673+0000","last_became_peered":"2021-10-08T19:37:00.344673+0000","last_unstale":"2021-10-08T19:44:02.960226+0000","last_undegraded":"2021-10-08T19:44:02.960226+0000","last_fullsized":"2021-10-08T19:44:02.960226+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"328'2","last_scrub_stamp":"2021-10-08T19:43:32.944317+0000","last_deep_scrub":"328'2","last_deep_scrub_stamp":"2021-10-08T19:33:29.990395+0000","last_clean_scrub_stamp":"2021-10-08T19:43:32.944317+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002362126,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.24","version":"0'0","reported_seq":169,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:43.848809+0000","last_change":"2021-10-08T19:44:43.848767+0000","last_active":"2021-10-08T19:44:43.848809+0000","last_peered":"2021-10-08T19:44:43.848809+0000","last_clean":"2021-10-08T19:44:43.848809+0000","last_became_active":"2021-10-08T19:37:00.336960+0000","last_became_peered":"2021-10-08T19:37:00.336960+0000","last_unstale":"2021-10-08T19:44:43.848809+0000","last_undegraded":"2021-10-08T19:44:43.848809+0000","last_fullsized":"2021-10-08T19:44:43.848809+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:43.848682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:44:43.848682+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0015245300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.23","version":"0'0","reported_seq":164,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:38.253681+0000","last_change":"2021-10-08T19:44:38.253222+0000","last_active":"2021-10-08T19:44:38.253681+0000","last_peered":"2021-10-08T19:44:38.253681+0000","last_clean":"2021-10-08T19:44:38.253681+0000","last_became_active":"2021-10-08T19:37:00.347789+0000","last_became_peered":"2021-10-08T19:37:00.347789+0000","last_unstale":"2021-10-08T19:44:38.253681+0000","last_undegraded":"2021-10-08T19:44:38.253681+0000","last_fullsized":"2021-10-08T19:44:38.253681+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:38.253146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:43:12.301558+0000","last_clean_scrub_stamp":"2021-10-08T19:44:38.253146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003481105,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.22","version":"0'0","reported_seq":565,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:03.463484+0000","last_change":"2021-10-08T19:43:33.590444+0000","last_active":"2021-10-08T19:44:03.463484+0000","last_peered":"2021-10-08T19:44:03.463484+0000","last_clean":"2021-10-08T19:44:03.463484+0000","last_became_active":"2021-10-08T19:37:00.343394+0000","last_became_peered":"2021-10-08T19:37:00.343394+0000","last_unstale":"2021-10-08T19:44:03.463484+0000","last_undegraded":"2021-10-08T19:44:03.463484+0000","last_fullsized":"2021-10-08T19:44:03.463484+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:33.590356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:43:33.590356+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0017614989999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3],"acting":[6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.21","version":"0'0","reported_seq":576,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:41.392168+0000","last_change":"2021-10-08T19:44:41.392126+0000","last_active":"2021-10-08T19:44:41.392168+0000","last_peered":"2021-10-08T19:44:41.392168+0000","last_clean":"2021-10-08T19:44:41.392168+0000","last_became_active":"2021-10-08T19:37:00.335409+0000","last_became_peered":"2021-10-08T19:37:00.335409+0000","last_unstale":"2021-10-08T19:44:41.392168+0000","last_undegraded":"2021-10-08T19:44:41.392168+0000","last_fullsized":"2021-10-08T19:44:41.392168+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:41.392036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:40:46.823341+0000","last_clean_scrub_stamp":"2021-10-08T19:44:41.392036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0017290000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7],"acting":[2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.20","version":"0'0","reported_seq":173,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:03.496183+0000","last_change":"2021-10-08T19:44:01.084271+0000","last_active":"2021-10-08T19:44:03.496183+0000","last_peered":"2021-10-08T19:44:03.496183+0000","last_clean":"2021-10-08T19:44:03.496183+0000","last_became_active":"2021-10-08T19:37:00.341831+0000","last_became_peered":"2021-10-08T19:37:00.341831+0000","last_unstale":"2021-10-08T19:44:03.496183+0000","last_undegraded":"2021-10-08T19:44:03.496183+0000","last_fullsized":"2021-10-08T19:44:03.496183+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:01.084174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:32.922694+0000","last_clean_scrub_stamp":"2021-10-08T19:44:01.084174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001851856,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"114'10","reported_seq":834,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:37.019699+0000","last_change":"2021-10-08T19:43:07.077926+0000","last_active":"2021-10-08T19:44:37.019699+0000","last_peered":"2021-10-08T19:44:37.019699+0000","last_clean":"2021-10-08T19:44:37.019699+0000","last_became_active":"2021-10-08T19:24:25.096162+0000","last_became_peered":"2021-10-08T19:24:25.096162+0000","last_unstale":"2021-10-08T19:44:37.019699+0000","last_undegraded":"2021-10-08T19:44:37.019699+0000","last_fullsized":"2021-10-08T19:44:37.019699+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'10","last_scrub_stamp":"2021-10-08T19:43:07.077808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:43:07.077808+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002397616,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"482'46","reported_seq":193,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:37.261544+0000","last_change":"2021-10-08T19:44:37.261502+0000","last_active":"2021-10-08T19:44:37.261544+0000","last_peered":"2021-10-08T19:44:37.261544+0000","last_clean":"2021-10-08T19:44:37.261544+0000","last_became_active":"2021-10-08T19:43:42.361177+0000","last_became_peered":"2021-10-08T19:43:42.361177+0000","last_unstale":"2021-10-08T19:44:37.261544+0000","last_undegraded":"2021-10-08T19:44:37.261544+0000","last_fullsized":"2021-10-08T19:44:37.261544+0000","mapping_epoch":520,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":521,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'46","last_scrub_stamp":"2021-10-08T19:44:37.261362+0000","last_deep_scrub":"87'22","last_deep_scrub_stamp":"2021-10-08T19:22:58.705632+0000","last_clean_scrub_stamp":"2021-10-08T19:44:37.261362+0000","log_size":46,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0026964799999999998,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":60,"num_read_kb":51,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":561,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:02.958857+0000","last_change":"2021-10-08T19:43:32.569138+0000","last_active":"2021-10-08T19:44:02.958857+0000","last_peered":"2021-10-08T19:44:02.958857+0000","last_clean":"2021-10-08T19:44:02.958857+0000","last_became_active":"2021-10-08T19:29:40.632678+0000","last_became_peered":"2021-10-08T19:29:40.632678+0000","last_unstale":"2021-10-08T19:44:02.958857+0000","last_undegraded":"2021-10-08T19:44:02.958857+0000","last_fullsized":"2021-10-08T19:44:02.958857+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:32.569040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:43:32.569040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0037520399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":398,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:03.544703+0000","last_change":"2021-10-08T19:43:42.360351+0000","last_active":"2021-10-08T19:44:03.544703+0000","last_peered":"2021-10-08T19:44:03.544703+0000","last_clean":"2021-10-08T19:44:03.544703+0000","last_became_active":"2021-10-08T19:43:42.359904+0000","last_became_peered":"2021-10-08T19:43:42.359904+0000","last_unstale":"2021-10-08T19:44:03.544703+0000","last_undegraded":"2021-10-08T19:44:03.544703+0000","last_fullsized":"2021-10-08T19:44:03.544703+0000","mapping_epoch":520,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":521,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:17.705846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:08.936801+0000","last_clean_scrub_stamp":"2021-10-08T19:43:17.705846+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.00168849,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":453,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:03.497653+0000","last_change":"2021-10-08T19:43:33.990688+0000","last_active":"2021-10-08T19:44:03.497653+0000","last_peered":"2021-10-08T19:44:03.497653+0000","last_clean":"2021-10-08T19:44:03.497653+0000","last_became_active":"2021-10-08T19:25:15.510457+0000","last_became_peered":"2021-10-08T19:25:15.510457+0000","last_unstale":"2021-10-08T19:44:03.497653+0000","last_undegraded":"2021-10-08T19:44:03.497653+0000","last_fullsized":"2021-10-08T19:44:03.497653+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:33.990597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:43:33.990597+0000","last_clean_scrub_stamp":"2021-10-08T19:43:33.990597+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0017240689999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"482'25","reported_seq":605,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:26.198109+0000","last_change":"2021-10-08T19:44:26.198064+0000","last_active":"2021-10-08T19:44:26.198109+0000","last_peered":"2021-10-08T19:44:26.198109+0000","last_clean":"2021-10-08T19:44:26.198109+0000","last_became_active":"2021-10-08T19:28:40.159729+0000","last_became_peered":"2021-10-08T19:28:40.159729+0000","last_unstale":"2021-10-08T19:44:26.198109+0000","last_undegraded":"2021-10-08T19:44:26.198109+0000","last_fullsized":"2021-10-08T19:44:26.198109+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'25","last_scrub_stamp":"2021-10-08T19:44:26.197954+0000","last_deep_scrub":"337'19","last_deep_scrub_stamp":"2021-10-08T19:34:14.040249+0000","last_clean_scrub_stamp":"2021-10-08T19:44:26.197954+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0025774980000000001,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":398,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.435343+0000","last_change":"2021-10-08T19:43:47.814571+0000","last_active":"2021-10-08T19:44:07.435343+0000","last_peered":"2021-10-08T19:44:07.435343+0000","last_clean":"2021-10-08T19:44:07.435343+0000","last_became_active":"2021-10-08T19:29:40.624977+0000","last_became_peered":"2021-10-08T19:29:40.624977+0000","last_unstale":"2021-10-08T19:44:07.435343+0000","last_undegraded":"2021-10-08T19:44:07.435343+0000","last_fullsized":"2021-10-08T19:44:07.435343+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:47.814477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:43:47.814477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0035767479999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":553,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:31.323917+0000","last_change":"2021-10-08T19:44:31.323891+0000","last_active":"2021-10-08T19:44:31.323917+0000","last_peered":"2021-10-08T19:44:31.323917+0000","last_clean":"2021-10-08T19:44:31.323917+0000","last_became_active":"2021-10-08T19:29:40.629422+0000","last_became_peered":"2021-10-08T19:29:40.629422+0000","last_unstale":"2021-10-08T19:44:31.323917+0000","last_undegraded":"2021-10-08T19:44:31.323917+0000","last_fullsized":"2021-10-08T19:44:31.323917+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:31.323819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:44:31.323819+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001723266,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":531,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:30.250460+0000","last_change":"2021-10-08T19:44:30.250419+0000","last_active":"2021-10-08T19:44:30.250460+0000","last_peered":"2021-10-08T19:44:30.250460+0000","last_clean":"2021-10-08T19:44:30.250460+0000","last_became_active":"2021-10-08T19:21:29.643022+0000","last_became_peered":"2021-10-08T19:21:29.643022+0000","last_unstale":"2021-10-08T19:44:30.250460+0000","last_undegraded":"2021-10-08T19:44:30.250460+0000","last_fullsized":"2021-10-08T19:44:30.250460+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:30.250322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:43:26.395040+0000","last_clean_scrub_stamp":"2021-10-08T19:44:30.250322+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.079062984000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"70'5","reported_seq":1233,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:42.446746+0000","last_change":"2021-10-08T19:43:57.719172+0000","last_active":"2021-10-08T19:44:42.446746+0000","last_peered":"2021-10-08T19:44:42.446746+0000","last_clean":"2021-10-08T19:44:42.446746+0000","last_became_active":"2021-10-08T19:43:42.359412+0000","last_became_peered":"2021-10-08T19:43:42.359412+0000","last_unstale":"2021-10-08T19:44:42.446746+0000","last_undegraded":"2021-10-08T19:44:42.446746+0000","last_fullsized":"2021-10-08T19:44:42.446746+0000","mapping_epoch":520,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":521,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:43:57.719081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:43:57.719081+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040136850000000003,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":835,"num_read_kb":835,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1167,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"482'60","reported_seq":617,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:15.597813+0000","last_change":"2021-10-08T19:44:15.597778+0000","last_active":"2021-10-08T19:44:15.597813+0000","last_peered":"2021-10-08T19:44:15.597813+0000","last_clean":"2021-10-08T19:44:15.597813+0000","last_became_active":"2021-10-08T19:28:40.101648+0000","last_became_peered":"2021-10-08T19:28:40.101648+0000","last_unstale":"2021-10-08T19:44:15.597813+0000","last_undegraded":"2021-10-08T19:44:15.597813+0000","last_fullsized":"2021-10-08T19:44:15.597813+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'60","last_scrub_stamp":"2021-10-08T19:44:15.597685+0000","last_deep_scrub":"428'44","last_deep_scrub_stamp":"2021-10-08T19:38:47.335892+0000","last_clean_scrub_stamp":"2021-10-08T19:44:15.597685+0000","log_size":60,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0028980680000000002,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":52,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":539,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:13.513863+0000","last_change":"2021-10-08T19:44:13.513827+0000","last_active":"2021-10-08T19:44:13.513863+0000","last_peered":"2021-10-08T19:44:13.513863+0000","last_clean":"2021-10-08T19:44:13.513863+0000","last_became_active":"2021-10-08T19:21:23.595919+0000","last_became_peered":"2021-10-08T19:21:23.595919+0000","last_unstale":"2021-10-08T19:44:13.513863+0000","last_undegraded":"2021-10-08T19:44:13.513863+0000","last_fullsized":"2021-10-08T19:44:13.513863+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:13.513750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:40:11.180640+0000","last_clean_scrub_stamp":"2021-10-08T19:44:13.513750+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0035534780000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":547,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:02.958350+0000","last_change":"2021-10-08T19:43:27.580927+0000","last_active":"2021-10-08T19:44:02.958350+0000","last_peered":"2021-10-08T19:44:02.958350+0000","last_clean":"2021-10-08T19:44:02.958350+0000","last_became_active":"2021-10-08T19:31:22.783725+0000","last_became_peered":"2021-10-08T19:31:22.783725+0000","last_unstale":"2021-10-08T19:44:02.958350+0000","last_undegraded":"2021-10-08T19:44:02.958350+0000","last_fullsized":"2021-10-08T19:44:02.958350+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:27.580846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:43:27.580846+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034466229999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":537,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:17.084204+0000","last_change":"2021-10-08T19:44:17.084168+0000","last_active":"2021-10-08T19:44:17.084204+0000","last_peered":"2021-10-08T19:44:17.084204+0000","last_clean":"2021-10-08T19:44:17.084204+0000","last_became_active":"2021-10-08T19:29:40.638354+0000","last_became_peered":"2021-10-08T19:29:40.638354+0000","last_unstale":"2021-10-08T19:44:17.084204+0000","last_undegraded":"2021-10-08T19:44:17.084204+0000","last_fullsized":"2021-10-08T19:44:17.084204+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:17.084077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:39.528699+0000","last_clean_scrub_stamp":"2021-10-08T19:44:17.084077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0019057309999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":464,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:09.056086+0000","last_change":"2021-10-08T19:44:09.056047+0000","last_active":"2021-10-08T19:44:09.056086+0000","last_peered":"2021-10-08T19:44:09.056086+0000","last_clean":"2021-10-08T19:44:09.056086+0000","last_became_active":"2021-10-08T19:31:22.785590+0000","last_became_peered":"2021-10-08T19:31:22.785590+0000","last_unstale":"2021-10-08T19:44:09.056086+0000","last_undegraded":"2021-10-08T19:44:09.056086+0000","last_fullsized":"2021-10-08T19:44:09.056086+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:09.055954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:44:09.055954+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0018020309999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.8","version":"90'130","reported_seq":497,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:03.544589+0000","last_change":"2021-10-08T19:43:42.355565+0000","last_active":"2021-10-08T19:44:03.544589+0000","last_peered":"2021-10-08T19:44:03.544589+0000","last_clean":"2021-10-08T19:44:03.544589+0000","last_became_active":"2021-10-08T19:43:42.355121+0000","last_became_peered":"2021-10-08T19:43:42.355121+0000","last_unstale":"2021-10-08T19:44:03.544589+0000","last_undegraded":"2021-10-08T19:44:03.544589+0000","last_fullsized":"2021-10-08T19:44:03.544589+0000","mapping_epoch":520,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":521,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:43:30.574762+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:43:30.574762+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.016276585,"stat_sum":{"num_bytes":262688,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"482'53","reported_seq":648,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:02.960564+0000","last_change":"2021-10-08T19:43:36.989846+0000","last_active":"2021-10-08T19:44:02.960564+0000","last_peered":"2021-10-08T19:44:02.960564+0000","last_clean":"2021-10-08T19:44:02.960564+0000","last_became_active":"2021-10-08T19:28:40.099618+0000","last_became_peered":"2021-10-08T19:28:40.099618+0000","last_unstale":"2021-10-08T19:44:02.960564+0000","last_undegraded":"2021-10-08T19:44:02.960564+0000","last_fullsized":"2021-10-08T19:44:02.960564+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'53","last_scrub_stamp":"2021-10-08T19:43:36.989744+0000","last_deep_scrub":"459'39","last_deep_scrub_stamp":"2021-10-08T19:40:10.405068+0000","last_clean_scrub_stamp":"2021-10-08T19:43:36.989744+0000","log_size":53,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0030917660000000001,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":71,"num_read_kb":61,"num_write":46,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"61'1","reported_seq":527,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:03.496909+0000","last_change":"2021-10-08T19:43:11.150272+0000","last_active":"2021-10-08T19:44:03.496909+0000","last_peered":"2021-10-08T19:44:03.496909+0000","last_clean":"2021-10-08T19:44:03.496909+0000","last_became_active":"2021-10-08T19:21:23.607064+0000","last_became_peered":"2021-10-08T19:21:23.607064+0000","last_unstale":"2021-10-08T19:44:03.496909+0000","last_undegraded":"2021-10-08T19:44:03.496909+0000","last_fullsized":"2021-10-08T19:44:03.496909+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'1","last_scrub_stamp":"2021-10-08T19:43:11.150171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:43:11.150171+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0041021870000000002,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":378,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:36.917428+0000","last_change":"2021-10-08T19:44:36.917285+0000","last_active":"2021-10-08T19:44:36.917428+0000","last_peered":"2021-10-08T19:44:36.917428+0000","last_clean":"2021-10-08T19:44:36.917428+0000","last_became_active":"2021-10-08T19:28:40.152478+0000","last_became_peered":"2021-10-08T19:28:40.152478+0000","last_unstale":"2021-10-08T19:44:36.917428+0000","last_undegraded":"2021-10-08T19:44:36.917428+0000","last_fullsized":"2021-10-08T19:44:36.917428+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:36.917215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:30:09.081635+0000","last_clean_scrub_stamp":"2021-10-08T19:44:36.917215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001566469,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":551,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:38.434421+0000","last_change":"2021-10-08T19:44:38.434382+0000","last_active":"2021-10-08T19:44:38.434421+0000","last_peered":"2021-10-08T19:44:38.434421+0000","last_clean":"2021-10-08T19:44:38.434421+0000","last_became_active":"2021-10-08T19:29:40.629424+0000","last_became_peered":"2021-10-08T19:29:40.629424+0000","last_unstale":"2021-10-08T19:44:38.434421+0000","last_undegraded":"2021-10-08T19:44:38.434421+0000","last_fullsized":"2021-10-08T19:44:38.434421+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:38.434282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:44:38.434282+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.12070544499999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":509,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:03.463986+0000","last_change":"2021-10-08T19:44:03.462895+0000","last_active":"2021-10-08T19:44:03.463986+0000","last_peered":"2021-10-08T19:44:03.463986+0000","last_clean":"2021-10-08T19:44:03.463986+0000","last_became_active":"2021-10-08T19:31:51.676829+0000","last_became_peered":"2021-10-08T19:31:51.676829+0000","last_unstale":"2021-10-08T19:44:03.463986+0000","last_undegraded":"2021-10-08T19:44:03.463986+0000","last_fullsized":"2021-10-08T19:44:03.463986+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:03.462805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:44:03.462805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0018734800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.9","version":"90'130","reported_seq":867,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:03.496358+0000","last_change":"2021-10-08T19:43:32.989110+0000","last_active":"2021-10-08T19:44:03.496358+0000","last_peered":"2021-10-08T19:44:03.496358+0000","last_clean":"2021-10-08T19:44:03.496358+0000","last_became_active":"2021-10-08T19:29:43.634789+0000","last_became_peered":"2021-10-08T19:29:43.634789+0000","last_unstale":"2021-10-08T19:44:03.496358+0000","last_undegraded":"2021-10-08T19:44:03.496358+0000","last_fullsized":"2021-10-08T19:44:03.496358+0000","mapping_epoch":239,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:43:32.989009+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:43:32.989009+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001960626,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"482'30","reported_seq":645,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:02.960238+0000","last_change":"2021-10-08T19:43:41.046748+0000","last_active":"2021-10-08T19:44:02.960238+0000","last_peered":"2021-10-08T19:44:02.960238+0000","last_clean":"2021-10-08T19:44:02.960238+0000","last_became_active":"2021-10-08T19:29:40.631807+0000","last_became_peered":"2021-10-08T19:29:40.631807+0000","last_unstale":"2021-10-08T19:44:02.960238+0000","last_undegraded":"2021-10-08T19:44:02.960238+0000","last_fullsized":"2021-10-08T19:44:02.960238+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'30","last_scrub_stamp":"2021-10-08T19:43:41.046653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:43:41.046653+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040118599999999999,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":40,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":398,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:16.967677+0000","last_change":"2021-10-08T19:44:16.967563+0000","last_active":"2021-10-08T19:44:16.967677+0000","last_peered":"2021-10-08T19:44:16.967677+0000","last_clean":"2021-10-08T19:44:16.967677+0000","last_became_active":"2021-10-08T19:29:40.638988+0000","last_became_peered":"2021-10-08T19:29:40.638988+0000","last_unstale":"2021-10-08T19:44:16.967677+0000","last_undegraded":"2021-10-08T19:44:16.967677+0000","last_fullsized":"2021-10-08T19:44:16.967677+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:16.967492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:44:16.967492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001580864,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"250'9","reported_seq":826,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:37.019478+0000","last_change":"2021-10-08T19:44:04.481562+0000","last_active":"2021-10-08T19:44:37.019478+0000","last_peered":"2021-10-08T19:44:37.019478+0000","last_clean":"2021-10-08T19:44:37.019478+0000","last_became_active":"2021-10-08T19:21:27.637930+0000","last_became_peered":"2021-10-08T19:21:27.637930+0000","last_unstale":"2021-10-08T19:44:37.019478+0000","last_undegraded":"2021-10-08T19:44:37.019478+0000","last_fullsized":"2021-10-08T19:44:37.019478+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'9","last_scrub_stamp":"2021-10-08T19:44:04.481429+0000","last_deep_scrub":"250'9","last_deep_scrub_stamp":"2021-10-08T19:42:57.267401+0000","last_clean_scrub_stamp":"2021-10-08T19:44:04.481429+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0042711520000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":536,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:38.289000+0000","last_change":"2021-10-08T19:44:38.288956+0000","last_active":"2021-10-08T19:44:38.289000+0000","last_peered":"2021-10-08T19:44:38.289000+0000","last_clean":"2021-10-08T19:44:38.289000+0000","last_became_active":"2021-10-08T19:28:40.100213+0000","last_became_peered":"2021-10-08T19:28:40.100213+0000","last_unstale":"2021-10-08T19:44:38.289000+0000","last_undegraded":"2021-10-08T19:44:38.289000+0000","last_fullsized":"2021-10-08T19:44:38.289000+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:38.288860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:44:38.288860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.025296393,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":326,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.505383+0000","last_change":"2021-10-08T19:43:23.274513+0000","last_active":"2021-10-08T19:44:07.505383+0000","last_peered":"2021-10-08T19:44:07.505383+0000","last_clean":"2021-10-08T19:44:07.505383+0000","last_became_active":"2021-10-08T19:29:44.443507+0000","last_became_peered":"2021-10-08T19:29:44.443507+0000","last_unstale":"2021-10-08T19:44:07.505383+0000","last_undegraded":"2021-10-08T19:44:07.505383+0000","last_fullsized":"2021-10-08T19:44:07.505383+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:23.274409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:43:23.274409+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034335289999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.a","version":"90'130","reported_seq":569,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:04.624057+0000","last_change":"2021-10-08T19:44:04.623908+0000","last_active":"2021-10-08T19:44:04.624057+0000","last_peered":"2021-10-08T19:44:04.624057+0000","last_clean":"2021-10-08T19:44:04.624057+0000","last_became_active":"2021-10-08T19:43:42.356894+0000","last_became_peered":"2021-10-08T19:43:42.356894+0000","last_unstale":"2021-10-08T19:44:04.624057+0000","last_undegraded":"2021-10-08T19:44:04.624057+0000","last_fullsized":"2021-10-08T19:44:04.624057+0000","mapping_epoch":520,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":521,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:44:04.623821+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:44:04.623821+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0016262080000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.f","version":"506'46","reported_seq":304,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:19.534244+0000","last_change":"2021-10-08T19:44:19.534216+0000","last_active":"2021-10-08T19:44:19.534244+0000","last_peered":"2021-10-08T19:44:19.534244+0000","last_clean":"2021-10-08T19:44:19.534244+0000","last_became_active":"2021-10-08T19:32:45.162914+0000","last_became_peered":"2021-10-08T19:32:45.162914+0000","last_unstale":"2021-10-08T19:44:19.534244+0000","last_undegraded":"2021-10-08T19:44:19.534244+0000","last_fullsized":"2021-10-08T19:44:19.534244+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"506'46","last_scrub_stamp":"2021-10-08T19:44:19.534144+0000","last_deep_scrub":"506'46","last_deep_scrub_stamp":"2021-10-08T19:43:00.309790+0000","last_clean_scrub_stamp":"2021-10-08T19:44:19.534144+0000","log_size":46,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039803729999999997,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":550,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":399,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.435038+0000","last_change":"2021-10-08T19:43:35.662165+0000","last_active":"2021-10-08T19:44:07.435038+0000","last_peered":"2021-10-08T19:44:07.435038+0000","last_clean":"2021-10-08T19:44:07.435038+0000","last_became_active":"2021-10-08T19:36:58.004540+0000","last_became_peered":"2021-10-08T19:36:58.004540+0000","last_unstale":"2021-10-08T19:44:07.435038+0000","last_undegraded":"2021-10-08T19:44:07.435038+0000","last_fullsized":"2021-10-08T19:44:07.435038+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:35.662069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:47.613029+0000","last_clean_scrub_stamp":"2021-10-08T19:43:35.662069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039195790000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"88'9","reported_seq":808,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:37.019704+0000","last_change":"2021-10-08T19:43:03.016770+0000","last_active":"2021-10-08T19:44:37.019704+0000","last_peered":"2021-10-08T19:44:37.019704+0000","last_clean":"2021-10-08T19:44:37.019704+0000","last_became_active":"2021-10-08T19:21:27.636432+0000","last_became_peered":"2021-10-08T19:21:27.636432+0000","last_unstale":"2021-10-08T19:44:37.019704+0000","last_undegraded":"2021-10-08T19:44:37.019704+0000","last_fullsized":"2021-10-08T19:44:37.019704+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'9","last_scrub_stamp":"2021-10-08T19:43:03.016630+0000","last_deep_scrub":"88'9","last_deep_scrub_stamp":"2021-10-08T19:23:00.048245+0000","last_clean_scrub_stamp":"2021-10-08T19:43:03.016630+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0023407620000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":408,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:03.545270+0000","last_change":"2021-10-08T19:43:55.796004+0000","last_active":"2021-10-08T19:44:03.545270+0000","last_peered":"2021-10-08T19:44:03.545270+0000","last_clean":"2021-10-08T19:44:03.545270+0000","last_became_active":"2021-10-08T19:43:42.363326+0000","last_became_peered":"2021-10-08T19:43:42.363326+0000","last_unstale":"2021-10-08T19:44:03.545270+0000","last_undegraded":"2021-10-08T19:44:03.545270+0000","last_fullsized":"2021-10-08T19:44:03.545270+0000","mapping_epoch":520,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":521,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:55.795882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:43:55.795882+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.075679722000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.8","version":"70'5","reported_seq":326,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.504768+0000","last_change":"2021-10-08T19:43:38.484912+0000","last_active":"2021-10-08T19:44:07.504768+0000","last_peered":"2021-10-08T19:44:07.504768+0000","last_clean":"2021-10-08T19:44:07.504768+0000","last_became_active":"2021-10-08T19:29:40.639786+0000","last_became_peered":"2021-10-08T19:29:40.639786+0000","last_unstale":"2021-10-08T19:44:07.504768+0000","last_undegraded":"2021-10-08T19:44:07.504768+0000","last_fullsized":"2021-10-08T19:44:07.504768+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:43:38.484838+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2021-10-08T19:43:38.484838+0000","last_clean_scrub_stamp":"2021-10-08T19:43:38.484838+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039408949999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"482'27","reported_seq":708,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:13.063866+0000","last_change":"2021-10-08T19:44:13.063833+0000","last_active":"2021-10-08T19:44:13.063866+0000","last_peered":"2021-10-08T19:44:13.063866+0000","last_clean":"2021-10-08T19:44:13.063866+0000","last_became_active":"2021-10-08T19:31:51.677509+0000","last_became_peered":"2021-10-08T19:31:51.677509+0000","last_unstale":"2021-10-08T19:44:13.063866+0000","last_undegraded":"2021-10-08T19:44:13.063866+0000","last_fullsized":"2021-10-08T19:44:13.063866+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'27","last_scrub_stamp":"2021-10-08T19:44:13.063736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:44:13.063736+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0028980329999999999,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":770,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":554,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:03.496424+0000","last_change":"2021-10-08T19:43:43.861314+0000","last_active":"2021-10-08T19:44:03.496424+0000","last_peered":"2021-10-08T19:44:03.496424+0000","last_clean":"2021-10-08T19:44:03.496424+0000","last_became_active":"2021-10-08T19:36:58.001610+0000","last_became_peered":"2021-10-08T19:36:58.001610+0000","last_unstale":"2021-10-08T19:44:03.496424+0000","last_undegraded":"2021-10-08T19:44:03.496424+0000","last_fullsized":"2021-10-08T19:44:03.496424+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:43.861228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:43:43.861228+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0017534670000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":406,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:26.317538+0000","last_change":"2021-10-08T19:44:26.317491+0000","last_active":"2021-10-08T19:44:26.317538+0000","last_peered":"2021-10-08T19:44:26.317538+0000","last_clean":"2021-10-08T19:44:26.317538+0000","last_became_active":"2021-10-08T19:43:42.362791+0000","last_became_peered":"2021-10-08T19:43:42.362791+0000","last_unstale":"2021-10-08T19:44:26.317538+0000","last_undegraded":"2021-10-08T19:44:26.317538+0000","last_fullsized":"2021-10-08T19:44:26.317538+0000","mapping_epoch":520,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":521,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:26.317390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:44:26.317390+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034651090000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":332,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.505152+0000","last_change":"2021-10-08T19:43:57.547647+0000","last_active":"2021-10-08T19:44:07.505152+0000","last_peered":"2021-10-08T19:44:07.505152+0000","last_clean":"2021-10-08T19:44:07.505152+0000","last_became_active":"2021-10-08T19:29:40.638099+0000","last_became_peered":"2021-10-08T19:29:40.638099+0000","last_unstale":"2021-10-08T19:44:07.505152+0000","last_undegraded":"2021-10-08T19:44:07.505152+0000","last_fullsized":"2021-10-08T19:44:07.505152+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:57.547572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:17.422176+0000","last_clean_scrub_stamp":"2021-10-08T19:43:57.547572+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034099680000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":469,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:04.098061+0000","last_change":"2021-10-08T19:44:04.097615+0000","last_active":"2021-10-08T19:44:04.098061+0000","last_peered":"2021-10-08T19:44:04.098061+0000","last_clean":"2021-10-08T19:44:04.098061+0000","last_became_active":"2021-10-08T19:24:13.506602+0000","last_became_peered":"2021-10-08T19:24:13.506602+0000","last_unstale":"2021-10-08T19:44:04.098061+0000","last_undegraded":"2021-10-08T19:44:04.098061+0000","last_fullsized":"2021-10-08T19:44:04.098061+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:04.097532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:44:04.097532+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003431403,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"90'130","reported_seq":662,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:33.336363+0000","last_change":"2021-10-08T19:44:33.335898+0000","last_active":"2021-10-08T19:44:33.336363+0000","last_peered":"2021-10-08T19:44:33.336363+0000","last_clean":"2021-10-08T19:44:33.336363+0000","last_became_active":"2021-10-08T19:29:43.636733+0000","last_became_peered":"2021-10-08T19:29:43.636733+0000","last_unstale":"2021-10-08T19:44:33.336363+0000","last_undegraded":"2021-10-08T19:44:33.336363+0000","last_fullsized":"2021-10-08T19:44:33.336363+0000","mapping_epoch":239,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:44:33.335810+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:44:33.335810+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.004332893,"stat_sum":{"num_bytes":327680,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"238'13","reported_seq":523,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:42.020604+0000","last_change":"2021-10-08T19:44:12.448248+0000","last_active":"2021-10-08T19:44:42.020604+0000","last_peered":"2021-10-08T19:44:42.020604+0000","last_clean":"2021-10-08T19:44:42.020604+0000","last_became_active":"2021-10-08T19:29:40.640248+0000","last_became_peered":"2021-10-08T19:29:40.640248+0000","last_unstale":"2021-10-08T19:44:42.020604+0000","last_undegraded":"2021-10-08T19:44:42.020604+0000","last_fullsized":"2021-10-08T19:44:42.020604+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"238'13","last_scrub_stamp":"2021-10-08T19:44:12.448167+0000","last_deep_scrub":"91'9","last_deep_scrub_stamp":"2021-10-08T19:23:32.329475+0000","last_clean_scrub_stamp":"2021-10-08T19:44:12.448167+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040240370000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"482'42","reported_seq":637,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:27.170448+0000","last_change":"2021-10-08T19:44:27.170413+0000","last_active":"2021-10-08T19:44:27.170448+0000","last_peered":"2021-10-08T19:44:27.170448+0000","last_clean":"2021-10-08T19:44:27.170448+0000","last_became_active":"2021-10-08T19:24:25.098743+0000","last_became_peered":"2021-10-08T19:24:25.098743+0000","last_unstale":"2021-10-08T19:44:27.170448+0000","last_undegraded":"2021-10-08T19:44:27.170448+0000","last_fullsized":"2021-10-08T19:44:27.170448+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'42","last_scrub_stamp":"2021-10-08T19:44:27.170319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:44:27.170319+0000","log_size":42,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039817330000000003,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":63,"num_read_kb":56,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":485,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:03.464441+0000","last_change":"2021-10-08T19:43:39.608441+0000","last_active":"2021-10-08T19:44:03.464441+0000","last_peered":"2021-10-08T19:44:03.464441+0000","last_clean":"2021-10-08T19:44:03.464441+0000","last_became_active":"2021-10-08T19:37:45.829953+0000","last_became_peered":"2021-10-08T19:37:45.829953+0000","last_unstale":"2021-10-08T19:44:03.464441+0000","last_undegraded":"2021-10-08T19:44:03.464441+0000","last_fullsized":"2021-10-08T19:44:03.464441+0000","mapping_epoch":407,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":408,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:39.608352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:43:39.608352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0019339330000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,2],"acting":[6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":537,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:03.497141+0000","last_change":"2021-10-08T19:43:09.170507+0000","last_active":"2021-10-08T19:44:03.497141+0000","last_peered":"2021-10-08T19:44:03.497141+0000","last_clean":"2021-10-08T19:44:03.497141+0000","last_became_active":"2021-10-08T19:24:25.094848+0000","last_became_peered":"2021-10-08T19:24:25.094848+0000","last_unstale":"2021-10-08T19:44:03.497141+0000","last_undegraded":"2021-10-08T19:44:03.497141+0000","last_fullsized":"2021-10-08T19:44:03.497141+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:09.170379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:43:09.170379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.079291384000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":504,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:42.113261+0000","last_change":"2021-10-08T19:44:42.113218+0000","last_active":"2021-10-08T19:44:42.113261+0000","last_peered":"2021-10-08T19:44:42.113261+0000","last_clean":"2021-10-08T19:44:42.113261+0000","last_became_active":"2021-10-08T19:28:40.132751+0000","last_became_peered":"2021-10-08T19:28:40.132751+0000","last_unstale":"2021-10-08T19:44:42.113261+0000","last_undegraded":"2021-10-08T19:44:42.113261+0000","last_fullsized":"2021-10-08T19:44:42.113261+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:42.113143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:44:42.113143+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001778857,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"90'130","reported_seq":695,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:02.960114+0000","last_change":"2021-10-08T19:42:52.073943+0000","last_active":"2021-10-08T19:44:02.960114+0000","last_peered":"2021-10-08T19:44:02.960114+0000","last_clean":"2021-10-08T19:44:02.960114+0000","last_became_active":"2021-10-08T19:27:26.590651+0000","last_became_peered":"2021-10-08T19:27:26.590651+0000","last_unstale":"2021-10-08T19:44:02.960114+0000","last_undegraded":"2021-10-08T19:44:02.960114+0000","last_fullsized":"2021-10-08T19:44:02.960114+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:42:52.073856+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:32:14.582883+0000","last_clean_scrub_stamp":"2021-10-08T19:42:52.073856+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001467267,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":538,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:37.303067+0000","last_change":"2021-10-08T19:44:37.303032+0000","last_active":"2021-10-08T19:44:37.303067+0000","last_peered":"2021-10-08T19:44:37.303067+0000","last_clean":"2021-10-08T19:44:37.303067+0000","last_became_active":"2021-10-08T19:29:40.639405+0000","last_became_peered":"2021-10-08T19:29:40.639405+0000","last_unstale":"2021-10-08T19:44:37.303067+0000","last_undegraded":"2021-10-08T19:44:37.303067+0000","last_fullsized":"2021-10-08T19:44:37.303067+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:37.302941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:44:37.302941+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034398969999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"482'42","reported_seq":386,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.504659+0000","last_change":"2021-10-08T19:44:05.507176+0000","last_active":"2021-10-08T19:44:07.504659+0000","last_peered":"2021-10-08T19:44:07.504659+0000","last_clean":"2021-10-08T19:44:07.504659+0000","last_became_active":"2021-10-08T19:29:40.635007+0000","last_became_peered":"2021-10-08T19:29:40.635007+0000","last_unstale":"2021-10-08T19:44:07.504659+0000","last_undegraded":"2021-10-08T19:44:07.504659+0000","last_fullsized":"2021-10-08T19:44:07.504659+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'42","last_scrub_stamp":"2021-10-08T19:44:05.507103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:44:05.507103+0000","log_size":42,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0041393580000000001,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":69,"num_read_kb":57,"num_write":44,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":381,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:32.967758+0000","last_change":"2021-10-08T19:44:32.967285+0000","last_active":"2021-10-08T19:44:32.967758+0000","last_peered":"2021-10-08T19:44:32.967758+0000","last_clean":"2021-10-08T19:44:32.967758+0000","last_became_active":"2021-10-08T19:36:58.013501+0000","last_became_peered":"2021-10-08T19:36:58.013501+0000","last_unstale":"2021-10-08T19:44:32.967758+0000","last_undegraded":"2021-10-08T19:44:32.967758+0000","last_fullsized":"2021-10-08T19:44:32.967758+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:32.967205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:40:46.233456+0000","last_clean_scrub_stamp":"2021-10-08T19:44:32.967205+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034883309999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":530,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:02.960092+0000","last_change":"2021-10-08T19:43:39.006720+0000","last_active":"2021-10-08T19:44:02.960092+0000","last_peered":"2021-10-08T19:44:02.960092+0000","last_clean":"2021-10-08T19:44:02.960092+0000","last_became_active":"2021-10-08T19:29:40.638253+0000","last_became_peered":"2021-10-08T19:29:40.638253+0000","last_unstale":"2021-10-08T19:44:02.960092+0000","last_undegraded":"2021-10-08T19:44:02.960092+0000","last_fullsized":"2021-10-08T19:44:02.960092+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:39.006635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:43:39.006635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0035757430000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":326,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.505600+0000","last_change":"2021-10-08T19:43:31.399544+0000","last_active":"2021-10-08T19:44:07.505600+0000","last_peered":"2021-10-08T19:44:07.505600+0000","last_clean":"2021-10-08T19:44:07.505600+0000","last_became_active":"2021-10-08T19:29:40.634579+0000","last_became_peered":"2021-10-08T19:29:40.634579+0000","last_unstale":"2021-10-08T19:44:07.505600+0000","last_undegraded":"2021-10-08T19:44:07.505600+0000","last_fullsized":"2021-10-08T19:44:07.505600+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:31.399443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:43:31.399443+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.00164226,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"90'130","reported_seq":638,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:03.464052+0000","last_change":"2021-10-08T19:43:27.587031+0000","last_active":"2021-10-08T19:44:03.464052+0000","last_peered":"2021-10-08T19:44:03.464052+0000","last_clean":"2021-10-08T19:44:03.464052+0000","last_became_active":"2021-10-08T19:30:00.643797+0000","last_became_peered":"2021-10-08T19:30:00.643797+0000","last_unstale":"2021-10-08T19:44:03.464052+0000","last_undegraded":"2021-10-08T19:44:03.464052+0000","last_fullsized":"2021-10-08T19:44:03.464052+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:43:27.586947+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:43:27.586947+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0014889339999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":475,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:03.463873+0000","last_change":"2021-10-08T19:43:30.592864+0000","last_active":"2021-10-08T19:44:03.463873+0000","last_peered":"2021-10-08T19:44:03.463873+0000","last_clean":"2021-10-08T19:44:03.463873+0000","last_became_active":"2021-10-08T19:24:25.095389+0000","last_became_peered":"2021-10-08T19:24:25.095389+0000","last_unstale":"2021-10-08T19:44:03.463873+0000","last_undegraded":"2021-10-08T19:44:03.463873+0000","last_fullsized":"2021-10-08T19:44:03.463873+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:30.592790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:43:30.592790+0000","last_clean_scrub_stamp":"2021-10-08T19:43:30.592790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0018600299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"529'47","reported_seq":603,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:20.135672+0000","last_change":"2021-10-08T19:44:20.135631+0000","last_active":"2021-10-08T19:44:20.135672+0000","last_peered":"2021-10-08T19:44:20.135672+0000","last_clean":"2021-10-08T19:44:20.135672+0000","last_became_active":"2021-10-08T19:21:25.741812+0000","last_became_peered":"2021-10-08T19:21:25.741812+0000","last_unstale":"2021-10-08T19:44:20.135672+0000","last_undegraded":"2021-10-08T19:44:20.135672+0000","last_fullsized":"2021-10-08T19:44:20.135672+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"529'47","last_scrub_stamp":"2021-10-08T19:44:20.135556+0000","last_deep_scrub":"529'47","last_deep_scrub_stamp":"2021-10-08T19:44:20.135556+0000","last_clean_scrub_stamp":"2021-10-08T19:44:20.135556+0000","log_size":47,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0068859580000000002,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":69,"num_read_kb":55,"num_write":42,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"328'2","reported_seq":546,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:03.497300+0000","last_change":"2021-10-08T19:43:45.878311+0000","last_active":"2021-10-08T19:44:03.497300+0000","last_peered":"2021-10-08T19:44:03.497300+0000","last_clean":"2021-10-08T19:44:03.497300+0000","last_became_active":"2021-10-08T19:36:58.000171+0000","last_became_peered":"2021-10-08T19:36:58.000171+0000","last_unstale":"2021-10-08T19:44:03.497300+0000","last_undegraded":"2021-10-08T19:44:03.497300+0000","last_fullsized":"2021-10-08T19:44:03.497300+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"328'2","last_scrub_stamp":"2021-10-08T19:43:45.878217+0000","last_deep_scrub":"328'2","last_deep_scrub_stamp":"2021-10-08T19:43:45.878217+0000","last_clean_scrub_stamp":"2021-10-08T19:43:45.878217+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001853307,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":372,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:18.011741+0000","last_change":"2021-10-08T19:44:18.011620+0000","last_active":"2021-10-08T19:44:18.011741+0000","last_peered":"2021-10-08T19:44:18.011741+0000","last_clean":"2021-10-08T19:44:18.011741+0000","last_became_active":"2021-10-08T19:28:40.140876+0000","last_became_peered":"2021-10-08T19:28:40.140876+0000","last_unstale":"2021-10-08T19:44:18.011741+0000","last_undegraded":"2021-10-08T19:44:18.011741+0000","last_fullsized":"2021-10-08T19:44:18.011741+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:18.011525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:42:52.629131+0000","last_clean_scrub_stamp":"2021-10-08T19:44:18.011525+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.051124036999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"70'5","reported_seq":378,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.435564+0000","last_change":"2021-10-08T19:44:06.089112+0000","last_active":"2021-10-08T19:44:07.435564+0000","last_peered":"2021-10-08T19:44:07.435564+0000","last_clean":"2021-10-08T19:44:07.435564+0000","last_became_active":"2021-10-08T19:28:40.150503+0000","last_became_peered":"2021-10-08T19:28:40.150503+0000","last_unstale":"2021-10-08T19:44:07.435564+0000","last_undegraded":"2021-10-08T19:44:07.435564+0000","last_fullsized":"2021-10-08T19:44:07.435564+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:44:06.089022+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2021-10-08T19:44:06.089022+0000","last_clean_scrub_stamp":"2021-10-08T19:44:06.089022+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001932053,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"90'130","reported_seq":675,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.435343+0000","last_change":"2021-10-08T19:43:46.816862+0000","last_active":"2021-10-08T19:44:07.435343+0000","last_peered":"2021-10-08T19:44:07.435343+0000","last_clean":"2021-10-08T19:44:07.435343+0000","last_became_active":"2021-10-08T19:28:43.178371+0000","last_became_peered":"2021-10-08T19:28:43.178371+0000","last_unstale":"2021-10-08T19:44:07.435343+0000","last_undegraded":"2021-10-08T19:44:07.435343+0000","last_fullsized":"2021-10-08T19:44:07.435343+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:43:46.816760+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:34:13.653248+0000","last_clean_scrub_stamp":"2021-10-08T19:43:46.816760+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001916423,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":297,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:03.545261+0000","last_change":"2021-10-08T19:43:36.697575+0000","last_active":"2021-10-08T19:44:03.545261+0000","last_peered":"2021-10-08T19:44:03.545261+0000","last_clean":"2021-10-08T19:44:03.545261+0000","last_became_active":"2021-10-08T19:31:22.783759+0000","last_became_peered":"2021-10-08T19:31:22.783759+0000","last_unstale":"2021-10-08T19:44:03.545261+0000","last_undegraded":"2021-10-08T19:44:03.545261+0000","last_fullsized":"2021-10-08T19:44:03.545261+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:36.697477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:42:23.891779+0000","last_clean_scrub_stamp":"2021-10-08T19:43:36.697477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.022209505000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"482'36","reported_seq":650,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:10.225731+0000","last_change":"2021-10-08T19:44:10.225682+0000","last_active":"2021-10-08T19:44:10.225731+0000","last_peered":"2021-10-08T19:44:10.225731+0000","last_clean":"2021-10-08T19:44:10.225731+0000","last_became_active":"2021-10-08T19:32:45.154743+0000","last_became_peered":"2021-10-08T19:32:45.154743+0000","last_unstale":"2021-10-08T19:44:10.225731+0000","last_undegraded":"2021-10-08T19:44:10.225731+0000","last_fullsized":"2021-10-08T19:44:10.225731+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'36","last_scrub_stamp":"2021-10-08T19:44:10.225560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:44:10.225560+0000","log_size":36,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002873357,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":48,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":533,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:02.957789+0000","last_change":"2021-10-08T19:43:23.555051+0000","last_active":"2021-10-08T19:44:02.957789+0000","last_peered":"2021-10-08T19:44:02.957789+0000","last_clean":"2021-10-08T19:44:02.957789+0000","last_became_active":"2021-10-08T19:36:58.012034+0000","last_became_peered":"2021-10-08T19:36:58.012034+0000","last_unstale":"2021-10-08T19:44:02.957789+0000","last_undegraded":"2021-10-08T19:44:02.957789+0000","last_fullsized":"2021-10-08T19:44:02.957789+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:23.554955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:22.163674+0000","last_clean_scrub_stamp":"2021-10-08T19:43:23.554955+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0016886939999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":561,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:03.544470+0000","last_change":"2021-10-08T19:44:00.287365+0000","last_active":"2021-10-08T19:44:03.544470+0000","last_peered":"2021-10-08T19:44:03.544470+0000","last_clean":"2021-10-08T19:44:03.544470+0000","last_became_active":"2021-10-08T19:29:40.632010+0000","last_became_peered":"2021-10-08T19:29:40.632010+0000","last_unstale":"2021-10-08T19:44:03.544470+0000","last_undegraded":"2021-10-08T19:44:03.544470+0000","last_fullsized":"2021-10-08T19:44:03.544470+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:00.287278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:44:00.287278+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0018405209999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":274,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.435296+0000","last_change":"2021-10-08T19:43:43.798795+0000","last_active":"2021-10-08T19:44:07.435296+0000","last_peered":"2021-10-08T19:44:07.435296+0000","last_clean":"2021-10-08T19:44:07.435296+0000","last_became_active":"2021-10-08T19:31:51.673821+0000","last_became_peered":"2021-10-08T19:31:51.673821+0000","last_unstale":"2021-10-08T19:44:07.435296+0000","last_undegraded":"2021-10-08T19:44:07.435296+0000","last_fullsized":"2021-10-08T19:44:07.435296+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:43.798725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:21.644827+0000","last_clean_scrub_stamp":"2021-10-08T19:43:43.798725+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0017321769999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":521,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:42.779795+0000","last_change":"2021-10-08T19:44:42.779736+0000","last_active":"2021-10-08T19:44:42.779795+0000","last_peered":"2021-10-08T19:44:42.779795+0000","last_clean":"2021-10-08T19:44:42.779795+0000","last_became_active":"2021-10-08T19:21:27.636086+0000","last_became_peered":"2021-10-08T19:21:27.636086+0000","last_unstale":"2021-10-08T19:44:42.779795+0000","last_undegraded":"2021-10-08T19:44:42.779795+0000","last_fullsized":"2021-10-08T19:44:42.779795+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:42.779642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:44:42.779642+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0035086610000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"482'45","reported_seq":532,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:03.464136+0000","last_change":"2021-10-08T19:43:41.658768+0000","last_active":"2021-10-08T19:44:03.464136+0000","last_peered":"2021-10-08T19:44:03.464136+0000","last_clean":"2021-10-08T19:44:03.464136+0000","last_became_active":"2021-10-08T19:24:25.100384+0000","last_became_peered":"2021-10-08T19:24:25.100384+0000","last_unstale":"2021-10-08T19:44:03.464136+0000","last_undegraded":"2021-10-08T19:44:03.464136+0000","last_fullsized":"2021-10-08T19:44:03.464136+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'45","last_scrub_stamp":"2021-10-08T19:43:41.658672+0000","last_deep_scrub":"443'33","last_deep_scrub_stamp":"2021-10-08T19:39:26.350786+0000","last_clean_scrub_stamp":"2021-10-08T19:43:41.658672+0000","log_size":45,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002589025,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":60,"num_read_kb":50,"num_write":37,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"90'130","reported_seq":836,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:03.496449+0000","last_change":"2021-10-08T19:43:35.007656+0000","last_active":"2021-10-08T19:44:03.496449+0000","last_peered":"2021-10-08T19:44:03.496449+0000","last_clean":"2021-10-08T19:44:03.496449+0000","last_became_active":"2021-10-08T19:27:22.607289+0000","last_became_peered":"2021-10-08T19:27:22.607289+0000","last_unstale":"2021-10-08T19:44:03.496449+0000","last_undegraded":"2021-10-08T19:44:03.496449+0000","last_fullsized":"2021-10-08T19:44:03.496449+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:43:35.007540+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:43:35.007540+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0019949149999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":411,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:03.544846+0000","last_change":"2021-10-08T19:44:02.620350+0000","last_active":"2021-10-08T19:44:03.544846+0000","last_peered":"2021-10-08T19:44:03.544846+0000","last_clean":"2021-10-08T19:44:03.544846+0000","last_became_active":"2021-10-08T19:43:42.362318+0000","last_became_peered":"2021-10-08T19:43:42.362318+0000","last_unstale":"2021-10-08T19:44:03.544846+0000","last_undegraded":"2021-10-08T19:44:03.544846+0000","last_fullsized":"2021-10-08T19:44:03.544846+0000","mapping_epoch":520,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":521,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:02.620274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:44:02.620274+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034383669999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":332,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:36.247232+0000","last_change":"2021-10-08T19:44:36.246761+0000","last_active":"2021-10-08T19:44:36.247232+0000","last_peered":"2021-10-08T19:44:36.247232+0000","last_clean":"2021-10-08T19:44:36.247232+0000","last_became_active":"2021-10-08T19:29:40.638774+0000","last_became_peered":"2021-10-08T19:29:40.638774+0000","last_unstale":"2021-10-08T19:44:36.247232+0000","last_undegraded":"2021-10-08T19:44:36.247232+0000","last_fullsized":"2021-10-08T19:44:36.247232+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:36.246681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:44:36.246681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039073049999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":404,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:03.696921+0000","last_change":"2021-10-08T19:44:03.696492+0000","last_active":"2021-10-08T19:44:03.696921+0000","last_peered":"2021-10-08T19:44:03.696921+0000","last_clean":"2021-10-08T19:44:03.696921+0000","last_became_active":"2021-10-08T19:43:42.362294+0000","last_became_peered":"2021-10-08T19:43:42.362294+0000","last_unstale":"2021-10-08T19:44:03.696921+0000","last_undegraded":"2021-10-08T19:44:03.696921+0000","last_fullsized":"2021-10-08T19:44:03.696921+0000","mapping_epoch":520,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":521,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:03.696366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:44:03.696366+0000","last_clean_scrub_stamp":"2021-10-08T19:44:03.696366+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.094157303999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"90'130","reported_seq":842,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:06.037926+0000","last_change":"2021-10-08T19:44:06.037484+0000","last_active":"2021-10-08T19:44:06.037926+0000","last_peered":"2021-10-08T19:44:06.037926+0000","last_clean":"2021-10-08T19:44:06.037926+0000","last_became_active":"2021-10-08T19:27:26.591250+0000","last_became_peered":"2021-10-08T19:27:26.591250+0000","last_unstale":"2021-10-08T19:44:06.037926+0000","last_undegraded":"2021-10-08T19:44:06.037926+0000","last_fullsized":"2021-10-08T19:44:06.037926+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:44:06.037381+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:42:49.880376+0000","last_clean_scrub_stamp":"2021-10-08T19:44:06.037381+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0038755090000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":531,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:02.959026+0000","last_change":"2021-10-08T19:43:14.430558+0000","last_active":"2021-10-08T19:44:02.959026+0000","last_peered":"2021-10-08T19:44:02.959026+0000","last_clean":"2021-10-08T19:44:02.959026+0000","last_became_active":"2021-10-08T19:21:27.637875+0000","last_became_peered":"2021-10-08T19:21:27.637875+0000","last_unstale":"2021-10-08T19:44:02.959026+0000","last_undegraded":"2021-10-08T19:44:02.959026+0000","last_fullsized":"2021-10-08T19:44:02.959026+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:14.430478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:20.092069+0000","last_clean_scrub_stamp":"2021-10-08T19:43:14.430478+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003587926,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"482'21","reported_seq":286,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.435498+0000","last_change":"2021-10-08T19:43:17.539850+0000","last_active":"2021-10-08T19:44:07.435498+0000","last_peered":"2021-10-08T19:44:07.435498+0000","last_clean":"2021-10-08T19:44:07.435498+0000","last_became_active":"2021-10-08T19:31:51.674965+0000","last_became_peered":"2021-10-08T19:31:51.674965+0000","last_unstale":"2021-10-08T19:44:07.435498+0000","last_undegraded":"2021-10-08T19:44:07.435498+0000","last_fullsized":"2021-10-08T19:44:07.435498+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'21","last_scrub_stamp":"2021-10-08T19:43:17.539762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:43:17.539762+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0044519049999999999,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":29,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":990,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":564,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:02.958293+0000","last_change":"2021-10-08T19:43:20.421978+0000","last_active":"2021-10-08T19:44:02.958293+0000","last_peered":"2021-10-08T19:44:02.958293+0000","last_clean":"2021-10-08T19:44:02.958293+0000","last_became_active":"2021-10-08T19:36:58.015216+0000","last_became_peered":"2021-10-08T19:36:58.015216+0000","last_unstale":"2021-10-08T19:44:02.958293+0000","last_undegraded":"2021-10-08T19:44:02.958293+0000","last_fullsized":"2021-10-08T19:44:02.958293+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:20.421882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:43:20.421882+0000","last_clean_scrub_stamp":"2021-10-08T19:43:20.421882+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0038968560000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"70'5","reported_seq":378,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.435023+0000","last_change":"2021-10-08T19:43:44.780066+0000","last_active":"2021-10-08T19:44:07.435023+0000","last_peered":"2021-10-08T19:44:07.435023+0000","last_clean":"2021-10-08T19:44:07.435023+0000","last_became_active":"2021-10-08T19:28:40.148054+0000","last_became_peered":"2021-10-08T19:28:40.148054+0000","last_unstale":"2021-10-08T19:44:07.435023+0000","last_undegraded":"2021-10-08T19:44:07.435023+0000","last_fullsized":"2021-10-08T19:44:07.435023+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:43:44.779965+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2021-10-08T19:43:44.779965+0000","last_clean_scrub_stamp":"2021-10-08T19:43:44.779965+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002218093,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":549,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:03.497298+0000","last_change":"2021-10-08T19:43:27.069655+0000","last_active":"2021-10-08T19:44:03.497298+0000","last_peered":"2021-10-08T19:44:03.497298+0000","last_clean":"2021-10-08T19:44:03.497298+0000","last_became_active":"2021-10-08T19:29:40.652528+0000","last_became_peered":"2021-10-08T19:29:40.652528+0000","last_unstale":"2021-10-08T19:44:03.497298+0000","last_undegraded":"2021-10-08T19:44:03.497298+0000","last_fullsized":"2021-10-08T19:44:03.497298+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:27.069527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:43:27.069527+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.039835228,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"90'130","reported_seq":562,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:03.544467+0000","last_change":"2021-10-08T19:43:42.355766+0000","last_active":"2021-10-08T19:44:03.544467+0000","last_peered":"2021-10-08T19:44:03.544467+0000","last_clean":"2021-10-08T19:44:03.544467+0000","last_became_active":"2021-10-08T19:43:42.355280+0000","last_became_peered":"2021-10-08T19:43:42.355280+0000","last_unstale":"2021-10-08T19:44:03.544467+0000","last_undegraded":"2021-10-08T19:44:03.544467+0000","last_fullsized":"2021-10-08T19:44:03.544467+0000","mapping_epoch":520,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":521,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:43:32.243834+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:43:32.243834+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001876345,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,2],"acting":[5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":543,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:14.239736+0000","last_change":"2021-10-08T19:44:14.239693+0000","last_active":"2021-10-08T19:44:14.239736+0000","last_peered":"2021-10-08T19:44:14.239736+0000","last_clean":"2021-10-08T19:44:14.239736+0000","last_became_active":"2021-10-08T19:28:40.133414+0000","last_became_peered":"2021-10-08T19:28:40.133414+0000","last_unstale":"2021-10-08T19:44:14.239736+0000","last_undegraded":"2021-10-08T19:44:14.239736+0000","last_fullsized":"2021-10-08T19:44:14.239736+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:14.239615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:44:14.239615+0000","last_clean_scrub_stamp":"2021-10-08T19:44:14.239615+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001652913,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"482'56","reported_seq":692,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:43.972858+0000","last_change":"2021-10-08T19:44:43.972702+0000","last_active":"2021-10-08T19:44:43.972858+0000","last_peered":"2021-10-08T19:44:43.972858+0000","last_clean":"2021-10-08T19:44:43.972858+0000","last_became_active":"2021-10-08T19:29:40.626138+0000","last_became_peered":"2021-10-08T19:29:40.626138+0000","last_unstale":"2021-10-08T19:44:43.972858+0000","last_undegraded":"2021-10-08T19:44:43.972858+0000","last_fullsized":"2021-10-08T19:44:43.972858+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'56","last_scrub_stamp":"2021-10-08T19:44:43.972623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:44:43.972623+0000","log_size":56,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0027913030000000002,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":83,"num_read_kb":68,"num_write":50,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":1432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":437,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:03.544814+0000","last_change":"2021-10-08T19:43:59.691595+0000","last_active":"2021-10-08T19:44:03.544814+0000","last_peered":"2021-10-08T19:44:03.544814+0000","last_clean":"2021-10-08T19:44:03.544814+0000","last_became_active":"2021-10-08T19:43:42.363317+0000","last_became_peered":"2021-10-08T19:43:42.363317+0000","last_unstale":"2021-10-08T19:44:03.544814+0000","last_undegraded":"2021-10-08T19:44:03.544814+0000","last_fullsized":"2021-10-08T19:44:03.544814+0000","mapping_epoch":520,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":521,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:59.691516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:49.623545+0000","last_clean_scrub_stamp":"2021-10-08T19:43:59.691516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0017733060000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":334,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.505477+0000","last_change":"2021-10-08T19:44:03.500360+0000","last_active":"2021-10-08T19:44:07.505477+0000","last_peered":"2021-10-08T19:44:07.505477+0000","last_clean":"2021-10-08T19:44:07.505477+0000","last_became_active":"2021-10-08T19:29:40.637371+0000","last_became_peered":"2021-10-08T19:29:40.637371+0000","last_unstale":"2021-10-08T19:44:07.505477+0000","last_undegraded":"2021-10-08T19:44:07.505477+0000","last_fullsized":"2021-10-08T19:44:07.505477+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:03.500262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:41:28.269002+0000","last_clean_scrub_stamp":"2021-10-08T19:44:03.500262+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0065337579999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":480,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:21.248204+0000","last_change":"2021-10-08T19:44:21.248168+0000","last_active":"2021-10-08T19:44:21.248204+0000","last_peered":"2021-10-08T19:44:21.248204+0000","last_clean":"2021-10-08T19:44:21.248204+0000","last_became_active":"2021-10-08T19:25:14.550690+0000","last_became_peered":"2021-10-08T19:25:14.550690+0000","last_unstale":"2021-10-08T19:44:21.248204+0000","last_undegraded":"2021-10-08T19:44:21.248204+0000","last_fullsized":"2021-10-08T19:44:21.248204+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:21.248049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:36:09.181866+0000","last_clean_scrub_stamp":"2021-10-08T19:44:21.248049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034333340000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.7","version":"90'130","reported_seq":802,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:17.613843+0000","last_change":"2021-10-08T19:44:17.613810+0000","last_active":"2021-10-08T19:44:17.613843+0000","last_peered":"2021-10-08T19:44:17.613843+0000","last_clean":"2021-10-08T19:44:17.613843+0000","last_became_active":"2021-10-08T19:29:43.636820+0000","last_became_peered":"2021-10-08T19:29:43.636820+0000","last_unstale":"2021-10-08T19:44:17.613843+0000","last_undegraded":"2021-10-08T19:44:17.613843+0000","last_fullsized":"2021-10-08T19:44:17.613843+0000","mapping_epoch":239,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:44:17.613738+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:44:17.613738+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001717189,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"114'10","reported_seq":844,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:37.019453+0000","last_change":"2021-10-08T19:44:25.233642+0000","last_active":"2021-10-08T19:44:37.019453+0000","last_peered":"2021-10-08T19:44:37.019453+0000","last_clean":"2021-10-08T19:44:37.019453+0000","last_became_active":"2021-10-08T19:24:25.106695+0000","last_became_peered":"2021-10-08T19:24:25.106695+0000","last_unstale":"2021-10-08T19:44:37.019453+0000","last_undegraded":"2021-10-08T19:44:37.019453+0000","last_fullsized":"2021-10-08T19:44:37.019453+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'10","last_scrub_stamp":"2021-10-08T19:44:25.233559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:44:25.233559+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0022387990000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"482'30","reported_seq":301,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:26.891929+0000","last_change":"2021-10-08T19:44:26.891812+0000","last_active":"2021-10-08T19:44:26.891929+0000","last_peered":"2021-10-08T19:44:26.891929+0000","last_clean":"2021-10-08T19:44:26.891929+0000","last_became_active":"2021-10-08T19:31:51.675569+0000","last_became_peered":"2021-10-08T19:31:51.675569+0000","last_unstale":"2021-10-08T19:44:26.891929+0000","last_undegraded":"2021-10-08T19:44:26.891929+0000","last_fullsized":"2021-10-08T19:44:26.891929+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'30","last_scrub_stamp":"2021-10-08T19:44:26.891733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:44:26.891733+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002589835,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":38,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":381,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.435318+0000","last_change":"2021-10-08T19:43:32.662404+0000","last_active":"2021-10-08T19:44:07.435318+0000","last_peered":"2021-10-08T19:44:07.435318+0000","last_clean":"2021-10-08T19:44:07.435318+0000","last_became_active":"2021-10-08T19:36:58.013921+0000","last_became_peered":"2021-10-08T19:36:58.013921+0000","last_unstale":"2021-10-08T19:44:07.435318+0000","last_undegraded":"2021-10-08T19:44:07.435318+0000","last_fullsized":"2021-10-08T19:44:07.435318+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:32.662322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:45.612819+0000","last_clean_scrub_stamp":"2021-10-08T19:43:32.662322+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0018789329999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":545,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:12.298113+0000","last_change":"2021-10-08T19:44:12.298071+0000","last_active":"2021-10-08T19:44:12.298113+0000","last_peered":"2021-10-08T19:44:12.298113+0000","last_clean":"2021-10-08T19:44:12.298113+0000","last_became_active":"2021-10-08T19:29:40.643614+0000","last_became_peered":"2021-10-08T19:29:40.643614+0000","last_unstale":"2021-10-08T19:44:12.298113+0000","last_undegraded":"2021-10-08T19:44:12.298113+0000","last_fullsized":"2021-10-08T19:44:12.298113+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:12.297973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:40:49.951046+0000","last_clean_scrub_stamp":"2021-10-08T19:44:12.297973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.043712507999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":368,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:03.545020+0000","last_change":"2021-10-08T19:43:58.695557+0000","last_active":"2021-10-08T19:44:03.545020+0000","last_peered":"2021-10-08T19:44:03.545020+0000","last_clean":"2021-10-08T19:44:03.545020+0000","last_became_active":"2021-10-08T19:43:42.356866+0000","last_became_peered":"2021-10-08T19:43:42.356866+0000","last_unstale":"2021-10-08T19:44:03.545020+0000","last_undegraded":"2021-10-08T19:44:03.545020+0000","last_fullsized":"2021-10-08T19:44:03.545020+0000","mapping_epoch":520,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":521,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:58.695454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:43:58.695454+0000","last_clean_scrub_stamp":"2021-10-08T19:43:58.695454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034599510000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":553,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:18.481490+0000","last_change":"2021-10-08T19:44:18.481465+0000","last_active":"2021-10-08T19:44:18.481490+0000","last_peered":"2021-10-08T19:44:18.481490+0000","last_clean":"2021-10-08T19:44:18.481490+0000","last_became_active":"2021-10-08T19:28:40.138726+0000","last_became_peered":"2021-10-08T19:28:40.138726+0000","last_unstale":"2021-10-08T19:44:18.481490+0000","last_undegraded":"2021-10-08T19:44:18.481490+0000","last_fullsized":"2021-10-08T19:44:18.481490+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:18.481390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:44:18.481390+0000","last_clean_scrub_stamp":"2021-10-08T19:44:18.481390+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001319691,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"482'24","reported_seq":643,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:25.243664+0000","last_change":"2021-10-08T19:44:25.243627+0000","last_active":"2021-10-08T19:44:25.243664+0000","last_peered":"2021-10-08T19:44:25.243664+0000","last_clean":"2021-10-08T19:44:25.243664+0000","last_became_active":"2021-10-08T19:29:40.638957+0000","last_became_peered":"2021-10-08T19:29:40.638957+0000","last_unstale":"2021-10-08T19:44:25.243664+0000","last_undegraded":"2021-10-08T19:44:25.243664+0000","last_fullsized":"2021-10-08T19:44:25.243664+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'24","last_scrub_stamp":"2021-10-08T19:44:25.243540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:44:25.243540+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0041699679999999996,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"61'2","reported_seq":534,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:02.960747+0000","last_change":"2021-10-08T19:43:26.903114+0000","last_active":"2021-10-08T19:44:02.960747+0000","last_peered":"2021-10-08T19:44:02.960747+0000","last_clean":"2021-10-08T19:44:02.960747+0000","last_became_active":"2021-10-08T19:21:23.603614+0000","last_became_peered":"2021-10-08T19:21:23.603614+0000","last_unstale":"2021-10-08T19:44:02.960747+0000","last_undegraded":"2021-10-08T19:44:02.960747+0000","last_fullsized":"2021-10-08T19:44:02.960747+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'2","last_scrub_stamp":"2021-10-08T19:43:26.903007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:43:26.903007+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001771749,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":334,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:40.403144+0000","last_change":"2021-10-08T19:44:40.402748+0000","last_active":"2021-10-08T19:44:40.403144+0000","last_peered":"2021-10-08T19:44:40.403144+0000","last_clean":"2021-10-08T19:44:40.403144+0000","last_became_active":"2021-10-08T19:29:40.645211+0000","last_became_peered":"2021-10-08T19:29:40.645211+0000","last_unstale":"2021-10-08T19:44:40.403144+0000","last_undegraded":"2021-10-08T19:44:40.403144+0000","last_fullsized":"2021-10-08T19:44:40.403144+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:40.402627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:44:40.402627+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.11534380900000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":460,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:33.952824+0000","last_change":"2021-10-08T19:44:33.952787+0000","last_active":"2021-10-08T19:44:33.952824+0000","last_peered":"2021-10-08T19:44:33.952824+0000","last_clean":"2021-10-08T19:44:33.952824+0000","last_became_active":"2021-10-08T19:28:40.100770+0000","last_became_peered":"2021-10-08T19:28:40.100770+0000","last_unstale":"2021-10-08T19:44:33.952824+0000","last_undegraded":"2021-10-08T19:44:33.952824+0000","last_fullsized":"2021-10-08T19:44:33.952824+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:33.952700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:43:05.053806+0000","last_clean_scrub_stamp":"2021-10-08T19:44:33.952700+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001614004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"482'21","reported_seq":601,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:03.545072+0000","last_change":"2021-10-08T19:43:50.286856+0000","last_active":"2021-10-08T19:44:03.545072+0000","last_peered":"2021-10-08T19:44:03.545072+0000","last_clean":"2021-10-08T19:44:03.545072+0000","last_became_active":"2021-10-08T19:29:40.644354+0000","last_became_peered":"2021-10-08T19:29:40.644354+0000","last_unstale":"2021-10-08T19:44:03.545072+0000","last_undegraded":"2021-10-08T19:44:03.545072+0000","last_fullsized":"2021-10-08T19:44:03.545072+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'21","last_scrub_stamp":"2021-10-08T19:43:50.286775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:43:50.286775+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0023922610000000001,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":565,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:24.420932+0000","last_change":"2021-10-08T19:44:24.420906+0000","last_active":"2021-10-08T19:44:24.420932+0000","last_peered":"2021-10-08T19:44:24.420932+0000","last_clean":"2021-10-08T19:44:24.420932+0000","last_became_active":"2021-10-08T19:28:40.139234+0000","last_became_peered":"2021-10-08T19:28:40.139234+0000","last_unstale":"2021-10-08T19:44:24.420932+0000","last_undegraded":"2021-10-08T19:44:24.420932+0000","last_fullsized":"2021-10-08T19:44:24.420932+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:24.420831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:44:24.420831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0014914800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":332,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:09.458230+0000","last_change":"2021-10-08T19:44:09.458119+0000","last_active":"2021-10-08T19:44:09.458230+0000","last_peered":"2021-10-08T19:44:09.458230+0000","last_clean":"2021-10-08T19:44:09.458230+0000","last_became_active":"2021-10-08T19:29:40.645111+0000","last_became_peered":"2021-10-08T19:29:40.645111+0000","last_unstale":"2021-10-08T19:44:09.458230+0000","last_undegraded":"2021-10-08T19:44:09.458230+0000","last_fullsized":"2021-10-08T19:44:09.458230+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:09.458038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:44:09.458038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.00158056,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":531,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:23.445406+0000","last_change":"2021-10-08T19:44:23.445384+0000","last_active":"2021-10-08T19:44:23.445406+0000","last_peered":"2021-10-08T19:44:23.445406+0000","last_clean":"2021-10-08T19:44:23.445406+0000","last_became_active":"2021-10-08T19:21:29.640674+0000","last_became_peered":"2021-10-08T19:21:29.640674+0000","last_unstale":"2021-10-08T19:44:23.445406+0000","last_undegraded":"2021-10-08T19:44:23.445406+0000","last_fullsized":"2021-10-08T19:44:23.445406+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:23.445313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:40:02.107943+0000","last_clean_scrub_stamp":"2021-10-08T19:44:23.445313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034294149999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":446,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:03.496494+0000","last_change":"2021-10-08T19:43:26.001362+0000","last_active":"2021-10-08T19:44:03.496494+0000","last_peered":"2021-10-08T19:44:03.496494+0000","last_clean":"2021-10-08T19:44:03.496494+0000","last_became_active":"2021-10-08T19:25:15.501118+0000","last_became_peered":"2021-10-08T19:25:15.501118+0000","last_unstale":"2021-10-08T19:44:03.496494+0000","last_undegraded":"2021-10-08T19:44:03.496494+0000","last_fullsized":"2021-10-08T19:44:03.496494+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:26.001289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:43:26.001289+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0014320649999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"529'21","reported_seq":367,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:39.301078+0000","last_change":"2021-10-08T19:44:39.300975+0000","last_active":"2021-10-08T19:44:39.301078+0000","last_peered":"2021-10-08T19:44:39.301078+0000","last_clean":"2021-10-08T19:44:39.301078+0000","last_became_active":"2021-10-08T19:29:40.644657+0000","last_became_peered":"2021-10-08T19:29:40.644657+0000","last_unstale":"2021-10-08T19:44:39.301078+0000","last_undegraded":"2021-10-08T19:44:39.301078+0000","last_fullsized":"2021-10-08T19:44:39.301078+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"529'21","last_scrub_stamp":"2021-10-08T19:44:39.300908+0000","last_deep_scrub":"529'21","last_deep_scrub_stamp":"2021-10-08T19:44:39.300908+0000","last_clean_scrub_stamp":"2021-10-08T19:44:39.300908+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0036883770000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":27,"num_read_kb":24,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":493,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:14.609357+0000","last_change":"2021-10-08T19:44:14.609324+0000","last_active":"2021-10-08T19:44:14.609357+0000","last_peered":"2021-10-08T19:44:14.609357+0000","last_clean":"2021-10-08T19:44:14.609357+0000","last_became_active":"2021-10-08T19:28:40.101898+0000","last_became_peered":"2021-10-08T19:28:40.101898+0000","last_unstale":"2021-10-08T19:44:14.609357+0000","last_undegraded":"2021-10-08T19:44:14.609357+0000","last_fullsized":"2021-10-08T19:44:14.609357+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:14.609230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:44:14.609230+0000","last_clean_scrub_stamp":"2021-10-08T19:44:14.609230+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001907066,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":424,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:03.545297+0000","last_change":"2021-10-08T19:43:53.793211+0000","last_active":"2021-10-08T19:44:03.545297+0000","last_peered":"2021-10-08T19:44:03.545297+0000","last_clean":"2021-10-08T19:44:03.545297+0000","last_became_active":"2021-10-08T19:43:42.363001+0000","last_became_peered":"2021-10-08T19:43:42.363001+0000","last_unstale":"2021-10-08T19:44:03.545297+0000","last_undegraded":"2021-10-08T19:44:03.545297+0000","last_fullsized":"2021-10-08T19:44:03.545297+0000","mapping_epoch":520,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":521,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:53.793114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:43:53.793114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034425800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":537,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:03.496912+0000","last_change":"2021-10-08T19:43:31.025106+0000","last_active":"2021-10-08T19:44:03.496912+0000","last_peered":"2021-10-08T19:44:03.496912+0000","last_clean":"2021-10-08T19:44:03.496912+0000","last_became_active":"2021-10-08T19:24:25.099371+0000","last_became_peered":"2021-10-08T19:24:25.099371+0000","last_unstale":"2021-10-08T19:44:03.496912+0000","last_undegraded":"2021-10-08T19:44:03.496912+0000","last_fullsized":"2021-10-08T19:44:03.496912+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:31.024998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:43:31.024998+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.034141114,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"70'5","reported_seq":724,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:03.462996+0000","last_change":"2021-10-08T19:43:22.664692+0000","last_active":"2021-10-08T19:44:03.462996+0000","last_peered":"2021-10-08T19:44:03.462996+0000","last_clean":"2021-10-08T19:44:03.462996+0000","last_became_active":"2021-10-08T19:31:22.785193+0000","last_became_peered":"2021-10-08T19:31:22.785193+0000","last_unstale":"2021-10-08T19:44:03.462996+0000","last_undegraded":"2021-10-08T19:44:03.462996+0000","last_fullsized":"2021-10-08T19:44:03.462996+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":5,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:43:22.664600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:43:22.664600+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001752361,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"482'30","reported_seq":412,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.505032+0000","last_change":"2021-10-08T19:43:08.355257+0000","last_active":"2021-10-08T19:44:07.505032+0000","last_peered":"2021-10-08T19:44:07.505032+0000","last_clean":"2021-10-08T19:44:07.505032+0000","last_became_active":"2021-10-08T19:31:51.677055+0000","last_became_peered":"2021-10-08T19:31:51.677055+0000","last_unstale":"2021-10-08T19:44:07.505032+0000","last_undegraded":"2021-10-08T19:44:07.505032+0000","last_fullsized":"2021-10-08T19:44:07.505032+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'30","last_scrub_stamp":"2021-10-08T19:43:08.355175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:43:08.355175+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0042544920000000003,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":39,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":410,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:03.544731+0000","last_change":"2021-10-08T19:43:43.874219+0000","last_active":"2021-10-08T19:44:03.544731+0000","last_peered":"2021-10-08T19:44:03.544731+0000","last_clean":"2021-10-08T19:44:03.544731+0000","last_became_active":"2021-10-08T19:43:42.361387+0000","last_became_peered":"2021-10-08T19:43:42.361387+0000","last_unstale":"2021-10-08T19:44:03.544731+0000","last_undegraded":"2021-10-08T19:44:03.544731+0000","last_fullsized":"2021-10-08T19:44:03.544731+0000","mapping_epoch":520,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":521,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:43.874111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:43:43.874111+0000","last_clean_scrub_stamp":"2021-10-08T19:43:43.874111+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001658964,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,2],"acting":[5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"521'13","reported_seq":634,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:37.019698+0000","last_change":"2021-10-08T19:44:06.653632+0000","last_active":"2021-10-08T19:44:37.019698+0000","last_peered":"2021-10-08T19:44:37.019698+0000","last_clean":"2021-10-08T19:44:37.019698+0000","last_became_active":"2021-10-08T19:43:42.364023+0000","last_became_peered":"2021-10-08T19:43:42.364023+0000","last_unstale":"2021-10-08T19:44:37.019698+0000","last_undegraded":"2021-10-08T19:44:37.019698+0000","last_fullsized":"2021-10-08T19:44:37.019698+0000","mapping_epoch":520,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":521,"parent":"0.0","parent_split_bits":0,"last_scrub":"521'13","last_scrub_stamp":"2021-10-08T19:44:06.653539+0000","last_deep_scrub":"328'11","last_deep_scrub_stamp":"2021-10-08T19:33:32.545870+0000","last_clean_scrub_stamp":"2021-10-08T19:44:06.653539+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039457989999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":539,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:21.194056+0000","last_change":"2021-10-08T19:44:21.194000+0000","last_active":"2021-10-08T19:44:21.194056+0000","last_peered":"2021-10-08T19:44:21.194056+0000","last_clean":"2021-10-08T19:44:21.194056+0000","last_became_active":"2021-10-08T19:29:40.644819+0000","last_became_peered":"2021-10-08T19:29:40.644819+0000","last_unstale":"2021-10-08T19:44:21.194056+0000","last_undegraded":"2021-10-08T19:44:21.194056+0000","last_fullsized":"2021-10-08T19:44:21.194056+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:21.193888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:40:11.028298+0000","last_clean_scrub_stamp":"2021-10-08T19:44:21.193888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.044088605000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":448,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:35.900221+0000","last_change":"2021-10-08T19:44:35.900175+0000","last_active":"2021-10-08T19:44:35.900221+0000","last_peered":"2021-10-08T19:44:35.900221+0000","last_clean":"2021-10-08T19:44:35.900221+0000","last_became_active":"2021-10-08T19:25:15.498770+0000","last_became_peered":"2021-10-08T19:25:15.498770+0000","last_unstale":"2021-10-08T19:44:35.900221+0000","last_undegraded":"2021-10-08T19:44:35.900221+0000","last_fullsized":"2021-10-08T19:44:35.900221+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:35.900070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:44:35.900070+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0035205639999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"482'21","reported_seq":167,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:22.449914+0000","last_change":"2021-10-08T19:44:22.449885+0000","last_active":"2021-10-08T19:44:22.449914+0000","last_peered":"2021-10-08T19:44:22.449914+0000","last_clean":"2021-10-08T19:44:22.449914+0000","last_became_active":"2021-10-08T19:43:42.361269+0000","last_became_peered":"2021-10-08T19:43:42.361269+0000","last_unstale":"2021-10-08T19:44:22.449914+0000","last_undegraded":"2021-10-08T19:44:22.449914+0000","last_fullsized":"2021-10-08T19:44:22.449914+0000","mapping_epoch":520,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":521,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'21","last_scrub_stamp":"2021-10-08T19:44:22.449806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:44:22.449806+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039632490000000003,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":33,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":551,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:03.544904+0000","last_change":"2021-10-08T19:43:29.285261+0000","last_active":"2021-10-08T19:44:03.544904+0000","last_peered":"2021-10-08T19:44:03.544904+0000","last_clean":"2021-10-08T19:44:03.544904+0000","last_became_active":"2021-10-08T19:29:44.439397+0000","last_became_peered":"2021-10-08T19:29:44.439397+0000","last_unstale":"2021-10-08T19:44:03.544904+0000","last_undegraded":"2021-10-08T19:44:03.544904+0000","last_fullsized":"2021-10-08T19:44:03.544904+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:29.285182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:43:29.285182+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0020916120000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"413'11","reported_seq":520,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:42.020591+0000","last_change":"2021-10-08T19:44:07.507331+0000","last_active":"2021-10-08T19:44:42.020591+0000","last_peered":"2021-10-08T19:44:42.020591+0000","last_clean":"2021-10-08T19:44:42.020591+0000","last_became_active":"2021-10-08T19:29:40.637650+0000","last_became_peered":"2021-10-08T19:29:40.637650+0000","last_unstale":"2021-10-08T19:44:42.020591+0000","last_undegraded":"2021-10-08T19:44:42.020591+0000","last_fullsized":"2021-10-08T19:44:42.020591+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"413'11","last_scrub_stamp":"2021-10-08T19:44:07.507258+0000","last_deep_scrub":"413'11","last_deep_scrub_stamp":"2021-10-08T19:44:07.507258+0000","last_clean_scrub_stamp":"2021-10-08T19:44:07.507258+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0046863729999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":512,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:02.960882+0000","last_change":"2021-10-08T19:43:45.182184+0000","last_active":"2021-10-08T19:44:02.960882+0000","last_peered":"2021-10-08T19:44:02.960882+0000","last_clean":"2021-10-08T19:44:02.960882+0000","last_became_active":"2021-10-08T19:21:29.640302+0000","last_became_peered":"2021-10-08T19:21:29.640302+0000","last_unstale":"2021-10-08T19:44:02.960882+0000","last_undegraded":"2021-10-08T19:44:02.960882+0000","last_fullsized":"2021-10-08T19:44:02.960882+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:45.182074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:43:45.182074+0000","last_clean_scrub_stamp":"2021-10-08T19:43:45.182074+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.11619307600000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":460,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:03.544672+0000","last_change":"2021-10-08T19:43:30.271451+0000","last_active":"2021-10-08T19:44:03.544672+0000","last_peered":"2021-10-08T19:44:03.544672+0000","last_clean":"2021-10-08T19:44:03.544672+0000","last_became_active":"2021-10-08T19:29:40.631374+0000","last_became_peered":"2021-10-08T19:29:40.631374+0000","last_unstale":"2021-10-08T19:44:03.544672+0000","last_undegraded":"2021-10-08T19:44:03.544672+0000","last_fullsized":"2021-10-08T19:44:03.544672+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:30.271366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:43:30.271366+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001939503,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":462,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:03.497194+0000","last_change":"2021-10-08T19:43:38.882738+0000","last_active":"2021-10-08T19:44:03.497194+0000","last_peered":"2021-10-08T19:44:03.497194+0000","last_clean":"2021-10-08T19:44:03.497194+0000","last_became_active":"2021-10-08T19:29:40.652966+0000","last_became_peered":"2021-10-08T19:29:40.652966+0000","last_unstale":"2021-10-08T19:44:03.497194+0000","last_undegraded":"2021-10-08T19:44:03.497194+0000","last_fullsized":"2021-10-08T19:44:03.497194+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:38.882647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:43:38.882647+0000","last_clean_scrub_stamp":"2021-10-08T19:43:38.882647+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0056038829999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"482'25","reported_seq":295,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:18.967565+0000","last_change":"2021-10-08T19:44:18.967433+0000","last_active":"2021-10-08T19:44:18.967565+0000","last_peered":"2021-10-08T19:44:18.967565+0000","last_clean":"2021-10-08T19:44:18.967565+0000","last_became_active":"2021-10-08T19:31:51.676961+0000","last_became_peered":"2021-10-08T19:31:51.676961+0000","last_unstale":"2021-10-08T19:44:18.967565+0000","last_undegraded":"2021-10-08T19:44:18.967565+0000","last_fullsized":"2021-10-08T19:44:18.967565+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'25","last_scrub_stamp":"2021-10-08T19:44:18.967342+0000","last_deep_scrub":"289'19","last_deep_scrub_stamp":"2021-10-08T19:32:46.539792+0000","last_clean_scrub_stamp":"2021-10-08T19:44:18.967342+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0021871439999999998,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":28,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":509,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:03.463911+0000","last_change":"2021-10-08T19:43:36.614267+0000","last_active":"2021-10-08T19:44:03.463911+0000","last_peered":"2021-10-08T19:44:03.463911+0000","last_clean":"2021-10-08T19:44:03.463911+0000","last_became_active":"2021-10-08T19:31:22.786651+0000","last_became_peered":"2021-10-08T19:31:22.786651+0000","last_unstale":"2021-10-08T19:44:03.463911+0000","last_undegraded":"2021-10-08T19:44:03.463911+0000","last_fullsized":"2021-10-08T19:44:03.463911+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:36.614176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:43:36.614176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0016601840000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":336,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:13.455724+0000","last_change":"2021-10-08T19:44:13.455238+0000","last_active":"2021-10-08T19:44:13.455724+0000","last_peered":"2021-10-08T19:44:13.455724+0000","last_clean":"2021-10-08T19:44:13.455724+0000","last_became_active":"2021-10-08T19:29:40.644770+0000","last_became_peered":"2021-10-08T19:29:40.644770+0000","last_unstale":"2021-10-08T19:44:13.455724+0000","last_undegraded":"2021-10-08T19:44:13.455724+0000","last_fullsized":"2021-10-08T19:44:13.455724+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:13.455165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:06.367259+0000","last_clean_scrub_stamp":"2021-10-08T19:44:13.455165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003431501,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":541,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:03.544323+0000","last_change":"2021-10-08T19:43:59.322065+0000","last_active":"2021-10-08T19:44:03.544323+0000","last_peered":"2021-10-08T19:44:03.544323+0000","last_clean":"2021-10-08T19:44:03.544323+0000","last_became_active":"2021-10-08T19:28:40.133744+0000","last_became_peered":"2021-10-08T19:28:40.133744+0000","last_unstale":"2021-10-08T19:44:03.544323+0000","last_undegraded":"2021-10-08T19:44:03.544323+0000","last_fullsized":"2021-10-08T19:44:03.544323+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:59.321972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:43:59.321972+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.038212232999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"482'27","reported_seq":684,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:33.269324+0000","last_change":"2021-10-08T19:44:33.269293+0000","last_active":"2021-10-08T19:44:33.269324+0000","last_peered":"2021-10-08T19:44:33.269324+0000","last_clean":"2021-10-08T19:44:33.269324+0000","last_became_active":"2021-10-08T19:28:40.100196+0000","last_became_peered":"2021-10-08T19:28:40.100196+0000","last_unstale":"2021-10-08T19:44:33.269324+0000","last_undegraded":"2021-10-08T19:44:33.269324+0000","last_fullsized":"2021-10-08T19:44:33.269324+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'27","last_scrub_stamp":"2021-10-08T19:44:33.269208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:44:33.269208+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040027709999999996,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":380,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:09.059942+0000","last_change":"2021-10-08T19:44:09.059458+0000","last_active":"2021-10-08T19:44:09.059942+0000","last_peered":"2021-10-08T19:44:09.059942+0000","last_clean":"2021-10-08T19:44:09.059942+0000","last_became_active":"2021-10-08T19:28:40.146673+0000","last_became_peered":"2021-10-08T19:28:40.146673+0000","last_unstale":"2021-10-08T19:44:09.059942+0000","last_undegraded":"2021-10-08T19:44:09.059942+0000","last_fullsized":"2021-10-08T19:44:09.059942+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:09.059388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:09.610637+0000","last_clean_scrub_stamp":"2021-10-08T19:44:09.059388+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034079589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":390,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.435070+0000","last_change":"2021-10-08T19:43:48.807796+0000","last_active":"2021-10-08T19:44:07.435070+0000","last_peered":"2021-10-08T19:44:07.435070+0000","last_clean":"2021-10-08T19:44:07.435070+0000","last_became_active":"2021-10-08T19:29:40.638536+0000","last_became_peered":"2021-10-08T19:29:40.638536+0000","last_unstale":"2021-10-08T19:44:07.435070+0000","last_undegraded":"2021-10-08T19:44:07.435070+0000","last_fullsized":"2021-10-08T19:44:07.435070+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:48.807716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:43.186684+0000","last_clean_scrub_stamp":"2021-10-08T19:43:48.807716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001800294,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":332,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:25.390713+0000","last_change":"2021-10-08T19:44:25.390376+0000","last_active":"2021-10-08T19:44:25.390713+0000","last_peered":"2021-10-08T19:44:25.390713+0000","last_clean":"2021-10-08T19:44:25.390713+0000","last_became_active":"2021-10-08T19:29:40.634300+0000","last_became_peered":"2021-10-08T19:29:40.634300+0000","last_unstale":"2021-10-08T19:44:25.390713+0000","last_undegraded":"2021-10-08T19:44:25.390713+0000","last_fullsized":"2021-10-08T19:44:25.390713+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:25.390220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:47.187765+0000","last_clean_scrub_stamp":"2021-10-08T19:44:25.390220+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.023411802999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"70'5","reported_seq":442,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:16.194397+0000","last_change":"2021-10-08T19:44:16.194360+0000","last_active":"2021-10-08T19:44:16.194397+0000","last_peered":"2021-10-08T19:44:16.194397+0000","last_clean":"2021-10-08T19:44:16.194397+0000","last_became_active":"2021-10-08T19:25:15.496309+0000","last_became_peered":"2021-10-08T19:25:15.496309+0000","last_unstale":"2021-10-08T19:44:16.194397+0000","last_undegraded":"2021-10-08T19:44:16.194397+0000","last_fullsized":"2021-10-08T19:44:16.194397+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:44:16.194265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:44:16.194265+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034600260000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.10","version":"482'12","reported_seq":361,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.504775+0000","last_change":"2021-10-08T19:43:17.301895+0000","last_active":"2021-10-08T19:44:07.504775+0000","last_peered":"2021-10-08T19:44:07.504775+0000","last_clean":"2021-10-08T19:44:07.504775+0000","last_became_active":"2021-10-08T19:32:45.165103+0000","last_became_peered":"2021-10-08T19:32:45.165103+0000","last_unstale":"2021-10-08T19:44:07.504775+0000","last_undegraded":"2021-10-08T19:44:07.504775+0000","last_fullsized":"2021-10-08T19:44:07.504775+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'12","last_scrub_stamp":"2021-10-08T19:43:17.301805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:43:17.301805+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039943310000000003,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":16,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":410,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:25.365997+0000","last_change":"2021-10-08T19:44:25.365959+0000","last_active":"2021-10-08T19:44:25.365997+0000","last_peered":"2021-10-08T19:44:25.365997+0000","last_clean":"2021-10-08T19:44:25.365997+0000","last_became_active":"2021-10-08T19:43:42.356665+0000","last_became_peered":"2021-10-08T19:43:42.356665+0000","last_unstale":"2021-10-08T19:44:25.365997+0000","last_undegraded":"2021-10-08T19:44:25.365997+0000","last_fullsized":"2021-10-08T19:44:25.365997+0000","mapping_epoch":520,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":521,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:25.365837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:42:58.532200+0000","last_clean_scrub_stamp":"2021-10-08T19:44:25.365837+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0033825539999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":484,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:19.680658+0000","last_change":"2021-10-08T19:44:19.680632+0000","last_active":"2021-10-08T19:44:19.680658+0000","last_peered":"2021-10-08T19:44:19.680658+0000","last_clean":"2021-10-08T19:44:19.680658+0000","last_became_active":"2021-10-08T19:24:25.106186+0000","last_became_peered":"2021-10-08T19:24:25.106186+0000","last_unstale":"2021-10-08T19:44:19.680658+0000","last_undegraded":"2021-10-08T19:44:19.680658+0000","last_fullsized":"2021-10-08T19:44:19.680658+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:19.680564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:18.377739+0000","last_clean_scrub_stamp":"2021-10-08T19:44:19.680564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0013746979999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":521,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:08.068202+0000","last_change":"2021-10-08T19:44:08.068159+0000","last_active":"2021-10-08T19:44:08.068202+0000","last_peered":"2021-10-08T19:44:08.068202+0000","last_clean":"2021-10-08T19:44:08.068202+0000","last_became_active":"2021-10-08T19:21:29.642835+0000","last_became_peered":"2021-10-08T19:21:29.642835+0000","last_unstale":"2021-10-08T19:44:08.068202+0000","last_undegraded":"2021-10-08T19:44:08.068202+0000","last_fullsized":"2021-10-08T19:44:08.068202+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:08.068064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:42:45.950622+0000","last_clean_scrub_stamp":"2021-10-08T19:44:08.068064+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034228079999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":470,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:03.545114+0000","last_change":"2021-10-08T19:43:35.715140+0000","last_active":"2021-10-08T19:44:03.545114+0000","last_peered":"2021-10-08T19:44:03.545114+0000","last_clean":"2021-10-08T19:44:03.545114+0000","last_became_active":"2021-10-08T19:28:40.099215+0000","last_became_peered":"2021-10-08T19:28:40.099215+0000","last_unstale":"2021-10-08T19:44:03.545114+0000","last_undegraded":"2021-10-08T19:44:03.545114+0000","last_fullsized":"2021-10-08T19:44:03.545114+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:35.715052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:43:35.715052+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003769395,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"482'32","reported_seq":373,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.504880+0000","last_change":"2021-10-08T19:44:02.545842+0000","last_active":"2021-10-08T19:44:07.504880+0000","last_peered":"2021-10-08T19:44:07.504880+0000","last_clean":"2021-10-08T19:44:07.504880+0000","last_became_active":"2021-10-08T19:29:40.640914+0000","last_became_peered":"2021-10-08T19:29:40.640914+0000","last_unstale":"2021-10-08T19:44:07.504880+0000","last_undegraded":"2021-10-08T19:44:07.504880+0000","last_fullsized":"2021-10-08T19:44:07.504880+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'32","last_scrub_stamp":"2021-10-08T19:44:02.545762+0000","last_deep_scrub":"482'32","last_deep_scrub_stamp":"2021-10-08T19:44:02.545762+0000","last_clean_scrub_stamp":"2021-10-08T19:44:02.545762+0000","log_size":32,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0041064810000000004,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":36,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":475,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:03.464397+0000","last_change":"2021-10-08T19:43:38.644798+0000","last_active":"2021-10-08T19:44:03.464397+0000","last_peered":"2021-10-08T19:44:03.464397+0000","last_clean":"2021-10-08T19:44:03.464397+0000","last_became_active":"2021-10-08T19:24:25.098128+0000","last_became_peered":"2021-10-08T19:24:25.098128+0000","last_unstale":"2021-10-08T19:44:03.464397+0000","last_undegraded":"2021-10-08T19:44:03.464397+0000","last_fullsized":"2021-10-08T19:44:03.464397+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:38.644709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:34.508558+0000","last_clean_scrub_stamp":"2021-10-08T19:43:38.644709+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0019679739999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":535,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:03.496593+0000","last_change":"2021-10-08T19:43:31.971870+0000","last_active":"2021-10-08T19:44:03.496593+0000","last_peered":"2021-10-08T19:44:03.496593+0000","last_clean":"2021-10-08T19:44:03.496593+0000","last_became_active":"2021-10-08T19:24:25.095490+0000","last_became_peered":"2021-10-08T19:24:25.095490+0000","last_unstale":"2021-10-08T19:44:03.496593+0000","last_undegraded":"2021-10-08T19:44:03.496593+0000","last_fullsized":"2021-10-08T19:44:03.496593+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:31.971782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:11.383779+0000","last_clean_scrub_stamp":"2021-10-08T19:43:31.971782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0017384480000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":334,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.505466+0000","last_change":"2021-10-08T19:43:54.647112+0000","last_active":"2021-10-08T19:44:07.505466+0000","last_peered":"2021-10-08T19:44:07.505466+0000","last_clean":"2021-10-08T19:44:07.505466+0000","last_became_active":"2021-10-08T19:29:40.639358+0000","last_became_peered":"2021-10-08T19:29:40.639358+0000","last_unstale":"2021-10-08T19:44:07.505466+0000","last_undegraded":"2021-10-08T19:44:07.505466+0000","last_fullsized":"2021-10-08T19:44:07.505466+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:54.646997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:43:54.646997+0000","last_clean_scrub_stamp":"2021-10-08T19:43:54.646997+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.118729475,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"512'35","reported_seq":625,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:34.152553+0000","last_change":"2021-10-08T19:44:34.152522+0000","last_active":"2021-10-08T19:44:34.152553+0000","last_peered":"2021-10-08T19:44:34.152553+0000","last_clean":"2021-10-08T19:44:34.152553+0000","last_became_active":"2021-10-08T19:29:40.636448+0000","last_became_peered":"2021-10-08T19:29:40.636448+0000","last_unstale":"2021-10-08T19:44:34.152553+0000","last_undegraded":"2021-10-08T19:44:34.152553+0000","last_fullsized":"2021-10-08T19:44:34.152553+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"512'35","last_scrub_stamp":"2021-10-08T19:44:34.152446+0000","last_deep_scrub":"512'35","last_deep_scrub_stamp":"2021-10-08T19:43:21.411862+0000","last_clean_scrub_stamp":"2021-10-08T19:44:34.152446+0000","log_size":35,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0024610949999999999,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":40,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":536,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:33.219602+0000","last_change":"2021-10-08T19:44:33.219570+0000","last_active":"2021-10-08T19:44:33.219602+0000","last_peered":"2021-10-08T19:44:33.219602+0000","last_clean":"2021-10-08T19:44:33.219602+0000","last_became_active":"2021-10-08T19:21:23.604530+0000","last_became_peered":"2021-10-08T19:21:23.604530+0000","last_unstale":"2021-10-08T19:44:33.219602+0000","last_undegraded":"2021-10-08T19:44:33.219602+0000","last_fullsized":"2021-10-08T19:44:33.219602+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:33.219478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:44:33.219478+0000","last_clean_scrub_stamp":"2021-10-08T19:44:33.219478+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.00160524,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1f","version":"114'10","reported_seq":715,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:37.019698+0000","last_change":"2021-10-08T19:43:40.657826+0000","last_active":"2021-10-08T19:44:37.019698+0000","last_peered":"2021-10-08T19:44:37.019698+0000","last_clean":"2021-10-08T19:44:37.019698+0000","last_became_active":"2021-10-08T19:24:25.105742+0000","last_became_peered":"2021-10-08T19:24:25.105742+0000","last_unstale":"2021-10-08T19:44:37.019698+0000","last_undegraded":"2021-10-08T19:44:37.019698+0000","last_fullsized":"2021-10-08T19:44:37.019698+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'10","last_scrub_stamp":"2021-10-08T19:43:40.657729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:43:40.657729+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001956078,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"69'1","reported_seq":520,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:23.018509+0000","last_change":"2021-10-08T19:44:23.018483+0000","last_active":"2021-10-08T19:44:23.018509+0000","last_peered":"2021-10-08T19:44:23.018509+0000","last_clean":"2021-10-08T19:44:23.018509+0000","last_became_active":"2021-10-08T19:21:29.640296+0000","last_became_peered":"2021-10-08T19:21:29.640296+0000","last_unstale":"2021-10-08T19:44:23.018509+0000","last_undegraded":"2021-10-08T19:44:23.018509+0000","last_fullsized":"2021-10-08T19:44:23.018509+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2021-10-08T19:44:23.018395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:44:23.018395+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039883970000000003,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"482'32","reported_seq":556,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:12.607995+0000","last_change":"2021-10-08T19:44:12.607964+0000","last_active":"2021-10-08T19:44:12.607995+0000","last_peered":"2021-10-08T19:44:12.607995+0000","last_clean":"2021-10-08T19:44:12.607995+0000","last_became_active":"2021-10-08T19:28:40.126425+0000","last_became_peered":"2021-10-08T19:28:40.126425+0000","last_unstale":"2021-10-08T19:44:12.607995+0000","last_undegraded":"2021-10-08T19:44:12.607995+0000","last_fullsized":"2021-10-08T19:44:12.607995+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'32","last_scrub_stamp":"2021-10-08T19:44:12.607868+0000","last_deep_scrub":"390'24","last_deep_scrub_stamp":"2021-10-08T19:39:33.439960+0000","last_clean_scrub_stamp":"2021-10-08T19:44:12.607868+0000","log_size":32,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002780706,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":36,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":45,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.434819+0000","last_change":"2021-10-08T19:43:29.728876+0000","last_active":"2021-10-08T19:44:07.434819+0000","last_peered":"2021-10-08T19:44:07.434819+0000","last_clean":"2021-10-08T19:44:07.434819+0000","last_became_active":"2021-10-08T19:42:43.406316+0000","last_became_peered":"2021-10-08T19:42:43.406316+0000","last_unstale":"2021-10-08T19:44:07.434819+0000","last_undegraded":"2021-10-08T19:44:07.434819+0000","last_fullsized":"2021-10-08T19:44:07.434819+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:29.728809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:43:29.728809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002986626,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,0],"acting":[1,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":527,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:15.219316+0000","last_change":"2021-10-08T19:44:15.219289+0000","last_active":"2021-10-08T19:44:15.219316+0000","last_peered":"2021-10-08T19:44:15.219316+0000","last_clean":"2021-10-08T19:44:15.219316+0000","last_became_active":"2021-10-08T19:21:27.632648+0000","last_became_peered":"2021-10-08T19:21:27.632648+0000","last_unstale":"2021-10-08T19:44:15.219316+0000","last_undegraded":"2021-10-08T19:44:15.219316+0000","last_fullsized":"2021-10-08T19:44:15.219316+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:15.219222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:51.997511+0000","last_clean_scrub_stamp":"2021-10-08T19:44:15.219222+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001605567,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"69'1","reported_seq":376,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:30.081971+0000","last_change":"2021-10-08T19:44:30.081573+0000","last_active":"2021-10-08T19:44:30.081971+0000","last_peered":"2021-10-08T19:44:30.081971+0000","last_clean":"2021-10-08T19:44:30.081971+0000","last_became_active":"2021-10-08T19:28:40.146302+0000","last_became_peered":"2021-10-08T19:28:40.146302+0000","last_unstale":"2021-10-08T19:44:30.081971+0000","last_undegraded":"2021-10-08T19:44:30.081971+0000","last_fullsized":"2021-10-08T19:44:30.081971+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2021-10-08T19:44:30.081456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:44:30.081456+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.13169661899999999,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"482'39","reported_seq":721,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:02.958765+0000","last_change":"2021-10-08T19:43:26.583829+0000","last_active":"2021-10-08T19:44:02.958765+0000","last_peered":"2021-10-08T19:44:02.958765+0000","last_clean":"2021-10-08T19:44:02.958765+0000","last_became_active":"2021-10-08T19:29:40.629461+0000","last_became_peered":"2021-10-08T19:29:40.629461+0000","last_unstale":"2021-10-08T19:44:02.958765+0000","last_undegraded":"2021-10-08T19:44:02.958765+0000","last_fullsized":"2021-10-08T19:44:02.958765+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'39","last_scrub_stamp":"2021-10-08T19:43:26.583750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:43:26.583750+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040397640000000004,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":62,"num_read_kb":53,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":550,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":481,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:35.728472+0000","last_change":"2021-10-08T19:44:35.728431+0000","last_active":"2021-10-08T19:44:35.728472+0000","last_peered":"2021-10-08T19:44:35.728472+0000","last_clean":"2021-10-08T19:44:35.728472+0000","last_became_active":"2021-10-08T19:24:25.106119+0000","last_became_peered":"2021-10-08T19:24:25.106119+0000","last_unstale":"2021-10-08T19:44:35.728472+0000","last_undegraded":"2021-10-08T19:44:35.728472+0000","last_fullsized":"2021-10-08T19:44:35.728472+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:35.728341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:46.422866+0000","last_clean_scrub_stamp":"2021-10-08T19:44:35.728341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0019124120000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":374,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.435477+0000","last_change":"2021-10-08T19:44:04.163252+0000","last_active":"2021-10-08T19:44:07.435477+0000","last_peered":"2021-10-08T19:44:07.435477+0000","last_clean":"2021-10-08T19:44:07.435477+0000","last_became_active":"2021-10-08T19:28:40.148009+0000","last_became_peered":"2021-10-08T19:28:40.148009+0000","last_unstale":"2021-10-08T19:44:07.435477+0000","last_undegraded":"2021-10-08T19:44:07.435477+0000","last_fullsized":"2021-10-08T19:44:07.435477+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:04.163174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:42:50.576827+0000","last_clean_scrub_stamp":"2021-10-08T19:44:04.163174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003422394,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":534,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:23.226119+0000","last_change":"2021-10-08T19:44:23.226089+0000","last_active":"2021-10-08T19:44:23.226119+0000","last_peered":"2021-10-08T19:44:23.226119+0000","last_clean":"2021-10-08T19:44:23.226119+0000","last_became_active":"2021-10-08T19:24:25.097782+0000","last_became_peered":"2021-10-08T19:24:25.097782+0000","last_unstale":"2021-10-08T19:44:23.226119+0000","last_undegraded":"2021-10-08T19:44:23.226119+0000","last_fullsized":"2021-10-08T19:44:23.226119+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:23.226015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:37.219503+0000","last_clean_scrub_stamp":"2021-10-08T19:44:23.226015+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0013459279999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"482'24","reported_seq":362,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.505200+0000","last_change":"2021-10-08T19:43:27.383996+0000","last_active":"2021-10-08T19:44:07.505200+0000","last_peered":"2021-10-08T19:44:07.505200+0000","last_clean":"2021-10-08T19:44:07.505200+0000","last_became_active":"2021-10-08T19:29:40.645144+0000","last_became_peered":"2021-10-08T19:29:40.645144+0000","last_unstale":"2021-10-08T19:44:07.505200+0000","last_undegraded":"2021-10-08T19:44:07.505200+0000","last_fullsized":"2021-10-08T19:44:07.505200+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'24","last_scrub_stamp":"2021-10-08T19:43:27.383927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:43:27.383927+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039786200000000004,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":332,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:42.344694+0000","last_change":"2021-10-08T19:44:42.344223+0000","last_active":"2021-10-08T19:44:42.344694+0000","last_peered":"2021-10-08T19:44:42.344694+0000","last_clean":"2021-10-08T19:44:42.344694+0000","last_became_active":"2021-10-08T19:29:44.443807+0000","last_became_peered":"2021-10-08T19:29:44.443807+0000","last_unstale":"2021-10-08T19:44:42.344694+0000","last_undegraded":"2021-10-08T19:44:42.344694+0000","last_fullsized":"2021-10-08T19:44:42.344694+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:42.344156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:32.854550+0000","last_clean_scrub_stamp":"2021-10-08T19:44:42.344156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0036140259999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":532,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:02.960099+0000","last_change":"2021-10-08T19:43:13.079640+0000","last_active":"2021-10-08T19:44:02.960099+0000","last_peered":"2021-10-08T19:44:02.960099+0000","last_clean":"2021-10-08T19:44:02.960099+0000","last_became_active":"2021-10-08T19:29:40.638352+0000","last_became_peered":"2021-10-08T19:29:40.638352+0000","last_unstale":"2021-10-08T19:44:02.960099+0000","last_undegraded":"2021-10-08T19:44:02.960099+0000","last_fullsized":"2021-10-08T19:44:02.960099+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:13.079549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:43:13.079549+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0033821950000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":350,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:32.481533+0000","last_change":"2021-10-08T19:44:32.481249+0000","last_active":"2021-10-08T19:44:32.481533+0000","last_peered":"2021-10-08T19:44:32.481533+0000","last_clean":"2021-10-08T19:44:32.481533+0000","last_became_active":"2021-10-08T19:31:22.788455+0000","last_became_peered":"2021-10-08T19:31:22.788455+0000","last_unstale":"2021-10-08T19:44:32.481533+0000","last_undegraded":"2021-10-08T19:44:32.481533+0000","last_fullsized":"2021-10-08T19:44:32.481533+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:32.481119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:32:12.549351+0000","last_clean_scrub_stamp":"2021-10-08T19:44:32.481119+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.140691813,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"482'21","reported_seq":68,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:18.116575+0000","last_change":"2021-10-08T19:44:18.116540+0000","last_active":"2021-10-08T19:44:18.116575+0000","last_peered":"2021-10-08T19:44:18.116575+0000","last_clean":"2021-10-08T19:44:18.116575+0000","last_became_active":"2021-10-08T19:42:21.193316+0000","last_became_peered":"2021-10-08T19:42:21.193316+0000","last_unstale":"2021-10-08T19:44:18.116575+0000","last_undegraded":"2021-10-08T19:44:18.116575+0000","last_fullsized":"2021-10-08T19:44:18.116575+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'21","last_scrub_stamp":"2021-10-08T19:44:18.116455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:44:18.116455+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039572349999999999,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":28,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0],"acting":[7,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":529,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:15.145475+0000","last_change":"2021-10-08T19:44:15.145430+0000","last_active":"2021-10-08T19:44:15.145475+0000","last_peered":"2021-10-08T19:44:15.145475+0000","last_clean":"2021-10-08T19:44:15.145475+0000","last_became_active":"2021-10-08T19:21:23.607785+0000","last_became_peered":"2021-10-08T19:21:23.607785+0000","last_unstale":"2021-10-08T19:44:15.145475+0000","last_undegraded":"2021-10-08T19:44:15.145475+0000","last_fullsized":"2021-10-08T19:44:15.145475+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:15.145331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:21.657316+0000","last_clean_scrub_stamp":"2021-10-08T19:44:15.145331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0033755410000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":534,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:21.469995+0000","last_change":"2021-10-08T19:44:21.469961+0000","last_active":"2021-10-08T19:44:21.469995+0000","last_peered":"2021-10-08T19:44:21.469995+0000","last_clean":"2021-10-08T19:44:21.469995+0000","last_became_active":"2021-10-08T19:21:27.633979+0000","last_became_peered":"2021-10-08T19:21:27.633979+0000","last_unstale":"2021-10-08T19:44:21.469995+0000","last_undegraded":"2021-10-08T19:44:21.469995+0000","last_fullsized":"2021-10-08T19:44:21.469995+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:21.469889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:27.586341+0000","last_clean_scrub_stamp":"2021-10-08T19:44:21.469889+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003433714,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":541,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:03.544656+0000","last_change":"2021-10-08T19:43:36.299221+0000","last_active":"2021-10-08T19:44:03.544656+0000","last_peered":"2021-10-08T19:44:03.544656+0000","last_clean":"2021-10-08T19:44:03.544656+0000","last_became_active":"2021-10-08T19:28:40.159162+0000","last_became_peered":"2021-10-08T19:28:40.159162+0000","last_unstale":"2021-10-08T19:44:03.544656+0000","last_undegraded":"2021-10-08T19:44:03.544656+0000","last_fullsized":"2021-10-08T19:44:03.544656+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:36.299121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:43:36.299121+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.044022105999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"482'9","reported_seq":617,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:35.258339+0000","last_change":"2021-10-08T19:44:35.258301+0000","last_active":"2021-10-08T19:44:35.258339+0000","last_peered":"2021-10-08T19:44:35.258339+0000","last_clean":"2021-10-08T19:44:35.258339+0000","last_became_active":"2021-10-08T19:31:51.675189+0000","last_became_peered":"2021-10-08T19:31:51.675189+0000","last_unstale":"2021-10-08T19:44:35.258339+0000","last_undegraded":"2021-10-08T19:44:35.258339+0000","last_fullsized":"2021-10-08T19:44:35.258339+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'9","last_scrub_stamp":"2021-10-08T19:44:35.258200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:44:35.258200+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040287980000000001,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":13,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":545,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:03.497140+0000","last_change":"2021-10-08T19:43:25.042749+0000","last_active":"2021-10-08T19:44:03.497140+0000","last_peered":"2021-10-08T19:44:03.497140+0000","last_clean":"2021-10-08T19:44:03.497140+0000","last_became_active":"2021-10-08T19:24:25.096225+0000","last_became_peered":"2021-10-08T19:24:25.096225+0000","last_unstale":"2021-10-08T19:44:03.497140+0000","last_undegraded":"2021-10-08T19:44:03.497140+0000","last_fullsized":"2021-10-08T19:44:03.497140+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:25.042661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:29:40.244757+0000","last_clean_scrub_stamp":"2021-10-08T19:43:25.042661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001568741,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":543,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:32.010939+0000","last_change":"2021-10-08T19:44:32.010908+0000","last_active":"2021-10-08T19:44:32.010939+0000","last_peered":"2021-10-08T19:44:32.010939+0000","last_clean":"2021-10-08T19:44:32.010939+0000","last_became_active":"2021-10-08T19:28:40.101187+0000","last_became_peered":"2021-10-08T19:28:40.101187+0000","last_unstale":"2021-10-08T19:44:32.010939+0000","last_undegraded":"2021-10-08T19:44:32.010939+0000","last_fullsized":"2021-10-08T19:44:32.010939+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:32.010806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:44:32.010806+0000","last_clean_scrub_stamp":"2021-10-08T19:44:32.010806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034254799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":422,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:28.255060+0000","last_change":"2021-10-08T19:44:28.254999+0000","last_active":"2021-10-08T19:44:28.255060+0000","last_peered":"2021-10-08T19:44:28.255060+0000","last_clean":"2021-10-08T19:44:28.255060+0000","last_became_active":"2021-10-08T19:43:42.364088+0000","last_became_peered":"2021-10-08T19:43:42.364088+0000","last_unstale":"2021-10-08T19:44:28.255060+0000","last_undegraded":"2021-10-08T19:44:28.255060+0000","last_fullsized":"2021-10-08T19:44:28.255060+0000","mapping_epoch":520,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":521,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:28.254903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:44:28.254903+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.027700637,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"482'25","reported_seq":670,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:14.112240+0000","last_change":"2021-10-08T19:44:14.112206+0000","last_active":"2021-10-08T19:44:14.112240+0000","last_peered":"2021-10-08T19:44:14.112240+0000","last_clean":"2021-10-08T19:44:14.112240+0000","last_became_active":"2021-10-08T19:28:40.099770+0000","last_became_peered":"2021-10-08T19:28:40.099770+0000","last_unstale":"2021-10-08T19:44:14.112240+0000","last_undegraded":"2021-10-08T19:44:14.112240+0000","last_fullsized":"2021-10-08T19:44:14.112240+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'25","last_scrub_stamp":"2021-10-08T19:44:14.112110+0000","last_deep_scrub":"482'25","last_deep_scrub_stamp":"2021-10-08T19:44:14.112110+0000","last_clean_scrub_stamp":"2021-10-08T19:44:14.112110+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039897500000000002,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":332,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.505446+0000","last_change":"2021-10-08T19:44:04.517186+0000","last_active":"2021-10-08T19:44:07.505446+0000","last_peered":"2021-10-08T19:44:07.505446+0000","last_clean":"2021-10-08T19:44:07.505446+0000","last_became_active":"2021-10-08T19:29:40.627394+0000","last_became_peered":"2021-10-08T19:29:40.627394+0000","last_unstale":"2021-10-08T19:44:07.505446+0000","last_undegraded":"2021-10-08T19:44:07.505446+0000","last_fullsized":"2021-10-08T19:44:07.505446+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:04.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:44:04.517067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0036211080000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":372,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.435054+0000","last_change":"2021-10-08T19:43:42.762761+0000","last_active":"2021-10-08T19:44:07.435054+0000","last_peered":"2021-10-08T19:44:07.435054+0000","last_clean":"2021-10-08T19:44:07.435054+0000","last_became_active":"2021-10-08T19:28:40.145868+0000","last_became_peered":"2021-10-08T19:28:40.145868+0000","last_unstale":"2021-10-08T19:44:07.435054+0000","last_undegraded":"2021-10-08T19:44:07.435054+0000","last_fullsized":"2021-10-08T19:44:07.435054+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:42.762612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:43:42.762612+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0021516899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":532,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:15.185642+0000","last_change":"2021-10-08T19:44:15.185579+0000","last_active":"2021-10-08T19:44:15.185642+0000","last_peered":"2021-10-08T19:44:15.185642+0000","last_clean":"2021-10-08T19:44:15.185642+0000","last_became_active":"2021-10-08T19:28:40.099543+0000","last_became_peered":"2021-10-08T19:28:40.099543+0000","last_unstale":"2021-10-08T19:44:15.185642+0000","last_undegraded":"2021-10-08T19:44:15.185642+0000","last_fullsized":"2021-10-08T19:44:15.185642+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:15.185452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:50.032367+0000","last_clean_scrub_stamp":"2021-10-08T19:44:15.185452+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.033493497999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"491'46","reported_seq":391,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:20.289193+0000","last_change":"2021-10-08T19:44:20.288713+0000","last_active":"2021-10-08T19:44:20.289193+0000","last_peered":"2021-10-08T19:44:20.289193+0000","last_clean":"2021-10-08T19:44:20.289193+0000","last_became_active":"2021-10-08T19:29:40.631002+0000","last_became_peered":"2021-10-08T19:29:40.631002+0000","last_unstale":"2021-10-08T19:44:20.289193+0000","last_undegraded":"2021-10-08T19:44:20.289193+0000","last_fullsized":"2021-10-08T19:44:20.289193+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"491'46","last_scrub_stamp":"2021-10-08T19:44:20.288638+0000","last_deep_scrub":"491'46","last_deep_scrub_stamp":"2021-10-08T19:42:17.985848+0000","last_clean_scrub_stamp":"2021-10-08T19:44:20.288638+0000","log_size":46,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040014680000000002,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":527,"reported_epoch":528,"state":"active+clean","last_fresh":"2021-10-08T19:44:03.545114+0000","last_change":"2021-10-08T19:44:02.280317+0000","last_active":"2021-10-08T19:44:03.545114+0000","last_peered":"2021-10-08T19:44:03.545114+0000","last_clean":"2021-10-08T19:44:03.545114+0000","last_became_active":"2021-10-08T19:21:23.603422+0000","last_became_peered":"2021-10-08T19:21:23.603422+0000","last_unstale":"2021-10-08T19:44:03.545114+0000","last_undegraded":"2021-10-08T19:44:03.545114+0000","last_fullsized":"2021-10-08T19:44:03.545114+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:02.280237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:15.535842+0000","last_clean_scrub_stamp":"2021-10-08T19:44:02.280237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002152241,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":558,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:42.284889+0000","last_change":"2021-10-08T19:44:42.284861+0000","last_active":"2021-10-08T19:44:42.284889+0000","last_peered":"2021-10-08T19:44:42.284889+0000","last_clean":"2021-10-08T19:44:42.284889+0000","last_became_active":"2021-10-08T19:28:40.099286+0000","last_became_peered":"2021-10-08T19:28:40.099286+0000","last_unstale":"2021-10-08T19:44:42.284889+0000","last_undegraded":"2021-10-08T19:44:42.284889+0000","last_fullsized":"2021-10-08T19:44:42.284889+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:42.284773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:31.176160+0000","last_clean_scrub_stamp":"2021-10-08T19:44:42.284773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003609878,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":332,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:17.494037+0000","last_change":"2021-10-08T19:44:17.493596+0000","last_active":"2021-10-08T19:44:17.494037+0000","last_peered":"2021-10-08T19:44:17.494037+0000","last_clean":"2021-10-08T19:44:17.494037+0000","last_became_active":"2021-10-08T19:29:40.638221+0000","last_became_peered":"2021-10-08T19:29:40.638221+0000","last_unstale":"2021-10-08T19:44:17.494037+0000","last_undegraded":"2021-10-08T19:44:17.494037+0000","last_fullsized":"2021-10-08T19:44:17.494037+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:17.493507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:44:17.493507+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.11828785999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":42,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":126,"acting":126,"num_store_stats":8},{"poolid":1,"num_pg":11,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1430,"ondisk_log_size":1430,"up":33,"acting":33,"num_store_stats":8},{"poolid":3,"num_pg":23,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":835,"num_read_kb":835,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1167,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":69,"acting":69,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1537,"num_read_kb":1294,"num_write":989,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":524,"num_bytes_recovered":10936,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1050,"ondisk_log_size":1050,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":85,"ondisk_log_size":85,"up":96,"acting":96,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201565,"num_pgs":75,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":370000,"kb_used_data":1096,"kb_used_omap":0,"kb_used_meta":368896,"kb_avail":93375152,"statfs":{"total":95995035648,"available":95616155648,"internally_reserved":0,"allocated":1122304,"data_stored":726974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":377749504},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:43:50 2021","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":1.212,"15min":1.45},"min":{"1min":0.29599999999999999,"5min":0.223,"15min":0.20699999999999999},"max":{"1min":0.81299999999999994,"5min":13.686,"15min":26.065000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":1.2150000000000001,"15min":1.55},"min":{"1min":0.25800000000000001,"5min":0.21299999999999999,"15min":0.20499999999999999},"max":{"1min":0.69899999999999995,"5min":26.914000000000001,"15min":26.914000000000001},"last":0.48299999999999998}]},{"osd":1,"last update":"Fri Oct 8 19:43:50 2021","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":2.4849999999999999,"15min":2.383},"min":{"1min":0.27800000000000002,"5min":0.20799999999999999,"15min":0.19600000000000001},"max":{"1min":0.65100000000000002,"5min":95.063000000000002,"15min":95.063000000000002},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.48899999999999999,"5min":2.266,"15min":2.1110000000000002},"min":{"1min":0.32100000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.753,"5min":95.012,"15min":95.012},"last":0.53700000000000003}]},{"osd":2,"last update":"Fri Oct 8 19:43:50 2021","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":1.601,"15min":1.889},"min":{"1min":0.33000000000000002,"5min":0.27900000000000003,"15min":0.255},"max":{"1min":0.65200000000000002,"5min":22.867000000000001,"15min":81.204999999999998},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":1.516,"15min":1.786},"min":{"1min":0.374,"5min":0.26800000000000002,"15min":0.253},"max":{"1min":0.69699999999999995,"5min":15.632999999999999,"15min":81.022000000000006},"last":0.62}]},{"osd":3,"last update":"Fri Oct 8 19:43:50 2021","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":1.5529999999999999,"15min":2.1230000000000002},"min":{"1min":0.38,"5min":0.28799999999999998,"15min":0.28100000000000003},"max":{"1min":0.75600000000000001,"5min":7.3289999999999997,"15min":72.093999999999994},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.51600000000000001,"5min":1.601,"15min":2.1309999999999998},"min":{"1min":0.30099999999999999,"5min":0.28299999999999997,"15min":0.28000000000000003},"max":{"1min":0.67400000000000004,"5min":24.152999999999999,"15min":71.864999999999995},"last":0.57399999999999995}]},{"osd":4,"last update":"Fri Oct 8 19:43:50 2021","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.89300000000000002,"15min":1.22},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.22800000000000001},"max":{"1min":0.77800000000000002,"5min":6.2759999999999998,"15min":55.890999999999998},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.92000000000000004,"15min":1.359},"min":{"1min":0.317,"5min":0.25900000000000001,"15min":0.254},"max":{"1min":0.79300000000000004,"5min":6.9059999999999997,"15min":54.448999999999998},"last":0.73499999999999999}]},{"osd":5,"last update":"Fri Oct 8 19:43:50 2021","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.85599999999999998,"15min":1.1120000000000001},"min":{"1min":0.34899999999999998,"5min":0.30399999999999999,"15min":0.26800000000000002},"max":{"1min":0.78300000000000003,"5min":6.3159999999999998,"15min":9.9280000000000008},"last":0.746},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.92200000000000004,"15min":1.2589999999999999},"min":{"1min":0.39000000000000001,"5min":0.27500000000000002,"15min":0.26100000000000001},"max":{"1min":0.82699999999999996,"5min":6.9850000000000003,"15min":18.655000000000001},"last":0.76400000000000001}]},{"osd":6,"last update":"Fri Oct 8 19:43:50 2021","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.92200000000000004,"15min":1.3819999999999999},"min":{"1min":0.371,"5min":0.29199999999999998,"15min":0.27900000000000003},"max":{"1min":0.80000000000000004,"5min":10.943,"15min":58.039000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":1.0600000000000001,"15min":1.3939999999999999},"min":{"1min":0.40500000000000003,"5min":0.30599999999999999,"15min":0.30299999999999999},"max":{"1min":0.85199999999999998,"5min":6.3419999999999996,"15min":58.079999999999998},"last":0.77100000000000002}]}]},{"osd":6,"up_from":47,"seq":201863463201,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":400124,"kb_used_data":756,"kb_used_omap":0,"kb_used_meta":399360,"kb_avail":93345028,"statfs":{"total":95995035648,"available":95585308672,"internally_reserved":0,"allocated":774144,"data_stored":398377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":408944640},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:44:31 2021","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.96199999999999997,"15min":1.272},"min":{"1min":0.27100000000000002,"5min":0.188,"15min":0.188},"max":{"1min":0.70699999999999996,"5min":5.1710000000000003,"15min":39.262},"last":0.62},{"interface":"front","average":{"1min":0.48799999999999999,"5min":1.373,"15min":1.772},"min":{"1min":0.35099999999999998,"5min":0.22500000000000001,"15min":0.215},"max":{"1min":0.63600000000000001,"5min":7.4089999999999998,"15min":39.351999999999997},"last":0.73199999999999998}]},{"osd":1,"last update":"Fri Oct 8 19:44:31 2021","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":1.8779999999999999,"15min":1.637},"min":{"1min":0.33800000000000002,"5min":0.223,"15min":0.223},"max":{"1min":0.68100000000000005,"5min":31.504999999999999,"15min":31.504999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.53900000000000003,"5min":1.891,"15min":1.6739999999999999},"min":{"1min":0.35599999999999998,"5min":0.27300000000000002,"15min":0.24399999999999999},"max":{"1min":0.68500000000000005,"5min":31.512,"15min":31.512},"last":0.69499999999999995}]},{"osd":2,"last update":"Fri Oct 8 19:44:31 2021","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":2.0990000000000002,"15min":1.659},"min":{"1min":0.33600000000000002,"5min":0.27500000000000002,"15min":0.26000000000000001},"max":{"1min":0.76300000000000001,"5min":95.846000000000004,"15min":95.846000000000004},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.505,"5min":2.1760000000000002,"15min":1.962},"min":{"1min":0.33800000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.72199999999999998,"5min":95.683999999999997,"15min":95.683999999999997},"last":0.79600000000000004}]},{"osd":3,"last update":"Fri Oct 8 19:44:31 2021","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":4.0650000000000004,"15min":2.444},"min":{"1min":0.378,"5min":0.28199999999999997,"15min":0.27000000000000002},"max":{"1min":0.64300000000000002,"5min":125.726,"15min":125.726},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":4.1079999999999997,"15min":2.4860000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.29099999999999998},"max":{"1min":0.71999999999999997,"5min":125.614,"15min":125.614},"last":0.65700000000000003}]},{"osd":4,"last update":"Fri Oct 8 19:44:31 2021","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.81000000000000005,"15min":1.202},"min":{"1min":0.378,"5min":0.26800000000000002,"15min":0.19600000000000001},"max":{"1min":0.63800000000000001,"5min":6.4059999999999997,"15min":24.516999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.86699999999999999,"15min":1.1659999999999999},"min":{"1min":0.42699999999999999,"5min":0.26500000000000001,"15min":0.23100000000000001},"max":{"1min":0.73499999999999999,"5min":5.577,"15min":9.9079999999999995},"last":0.70799999999999996}]},{"osd":5,"last update":"Fri Oct 8 19:44:31 2021","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.94099999999999995,"15min":1.954},"min":{"1min":0.437,"5min":0.27600000000000002,"15min":0.22900000000000001},"max":{"1min":0.69799999999999995,"5min":6.4509999999999996,"15min":107.485},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.87,"15min":1.8460000000000001},"min":{"1min":0.46700000000000003,"5min":0.28399999999999997,"15min":0.251},"max":{"1min":0.76000000000000001,"5min":5.9720000000000004,"15min":107.90300000000001},"last":0.63500000000000001}]},{"osd":7,"last update":"Fri Oct 8 19:43:59 2021","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":1.071,"15min":1.2649999999999999},"min":{"1min":0.439,"5min":0.30399999999999999,"15min":0.27800000000000002},"max":{"1min":0.874,"5min":5.3120000000000003,"15min":8.8840000000000003},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.622,"5min":1.0660000000000001,"15min":1.427},"min":{"1min":0.44800000000000001,"5min":0.34000000000000002,"15min":0.29899999999999999},"max":{"1min":0.87,"5min":6.3719999999999999,"15min":15.962},"last":0.872}]}]},{"osd":1,"up_from":13,"seq":55834575156,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":448488,"kb_used_data":800,"kb_used_omap":0,"kb_used_meta":447680,"kb_avail":93296664,"statfs":{"total":95995035648,"available":95535783936,"internally_reserved":0,"allocated":819200,"data_stored":398837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":458424320},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:44:16 2021","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":1.173,"15min":2.7810000000000001},"min":{"1min":0.192,"5min":0.19,"15min":0.188},"max":{"1min":0.45400000000000001,"5min":16.417000000000002,"15min":126.256},"last":0.23100000000000001},{"interface":"front","average":{"1min":0.33900000000000002,"5min":2.137,"15min":3.1320000000000001},"min":{"1min":0.23599999999999999,"5min":0.18099999999999999,"15min":0.17799999999999999},"max":{"1min":0.501,"5min":13.038,"15min":126.176},"last":0.32500000000000001}]},{"osd":2,"last update":"Fri Oct 8 19:44:42 2021","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":1.4910000000000001,"15min":1.883},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":0.41799999999999998,"5min":16.460000000000001,"15min":102.395},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.32200000000000001,"5min":1.891,"15min":2.2450000000000001},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.47599999999999998,"5min":10.68,"15min":102.50700000000001},"last":0.24199999999999999}]},{"osd":3,"last update":"Fri Oct 8 19:43:51 2021","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":3.0899999999999999,"15min":2.8290000000000002},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.61599999999999999,"5min":33.972000000000001,"15min":105.836},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.373,"5min":2.0830000000000002,"15min":2.6190000000000002},"min":{"1min":0.27800000000000002,"5min":0.26800000000000002,"15min":0.22900000000000001},"max":{"1min":0.48599999999999999,"5min":33.880000000000003,"15min":106.12},"last":0.314}]},{"osd":4,"last update":"Fri Oct 8 19:43:57 2021","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":1.143,"15min":1.7869999999999999},"min":{"1min":0.377,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.79700000000000004,"5min":5.5449999999999999,"15min":103.538},"last":0.435},{"interface":"front","average":{"1min":0.53700000000000003,"5min":1.3180000000000001,"15min":1.819},"min":{"1min":0.38400000000000001,"5min":0.26400000000000001,"15min":0.254},"max":{"1min":0.83199999999999996,"5min":9.7639999999999993,"15min":102.67100000000001},"last":0.45800000000000002}]},{"osd":5,"last update":"Fri Oct 8 19:44:32 2021","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":1.7749999999999999,"15min":3.097},"min":{"1min":0.32400000000000001,"5min":0.29899999999999999,"15min":0.27300000000000002},"max":{"1min":0.78800000000000003,"5min":10.553000000000001,"15min":262.14100000000002},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":1.401,"15min":2.976},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.78000000000000003,"5min":9.7360000000000007,"15min":261.959},"last":0.42299999999999999}]},{"osd":6,"last update":"Fri Oct 8 19:44:42 2021","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":1.3300000000000001,"15min":1.9079999999999999},"min":{"1min":0.376,"5min":0.32700000000000001,"15min":0.316},"max":{"1min":0.747,"5min":17.477,"15min":103.73},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":1.8260000000000001,"15min":2.024},"min":{"1min":0.33900000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.745,"5min":10.503,"15min":102.753},"last":0.46999999999999997}]},{"osd":7,"last update":"Fri Oct 8 19:43:57 2021","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":2.4790000000000001,"15min":2.665},"min":{"1min":0.46000000000000002,"5min":0.35099999999999998,"15min":0.316},"max":{"1min":0.77900000000000003,"5min":62.408999999999999,"15min":106.011},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":1.968,"15min":2.4649999999999999},"min":{"1min":0.44900000000000001,"5min":0.34899999999999998,"15min":0.34200000000000003},"max":{"1min":0.72599999999999998,"5min":62.826999999999998,"15min":103.78400000000001},"last":0.48899999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738679,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":432136,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":431360,"kb_avail":93313016,"statfs":{"total":95995035648,"available":95552528384,"internally_reserved":0,"allocated":786432,"data_stored":398008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":441712640},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 8 19:44:17 2021","interfaces":[{"interface":"back","average":{"1min":0.29399999999999998,"5min":2.831,"15min":2.4940000000000002},"min":{"1min":0.22,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":0.41799999999999998,"5min":101.68600000000001,"15min":101.68600000000001},"last":0.314},{"interface":"front","average":{"1min":0.36099999999999999,"5min":3.0579999999999998,"15min":2.5950000000000002},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.19800000000000001},"max":{"1min":0.49299999999999999,"5min":101.732,"15min":101.732},"last":0.23200000000000001}]},{"osd":2,"last update":"Fri Oct 8 19:44:38 2021","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":1.3680000000000001,"15min":1.6419999999999999},"min":{"1min":0.246,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.46200000000000002,"5min":11.01,"15min":12.164999999999999},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.33200000000000002,"5min":1.3460000000000001,"15min":1.6519999999999999},"min":{"1min":0.23100000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.56799999999999995,"5min":7.5030000000000001,"15min":10.509},"last":0.29299999999999998}]},{"osd":3,"last update":"Fri Oct 8 19:43:49 2021","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":3.3919999999999999,"15min":2.5209999999999999},"min":{"1min":0.29899999999999999,"5min":0.26200000000000001,"15min":0.217},"max":{"1min":2.4249999999999998,"5min":104.744,"15min":104.744},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.35299999999999998,"5min":2.8330000000000002,"15min":2.3119999999999998},"min":{"1min":0.26300000000000001,"5min":0.187,"15min":0.187},"max":{"1min":0.48999999999999999,"5min":101.94,"15min":101.94},"last":0.32700000000000001}]},{"osd":4,"last update":"Fri Oct 8 19:44:17 2021","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":1.4950000000000001,"15min":1.7050000000000001},"min":{"1min":0.32300000000000001,"5min":0.28499999999999998,"15min":0.22900000000000001},"max":{"1min":0.75700000000000001,"5min":12.081,"15min":16.805},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.58999999999999997,"5min":1.4690000000000001,"15min":1.419},"min":{"1min":0.35799999999999998,"5min":0.28499999999999998,"15min":0.27400000000000002},"max":{"1min":0.91100000000000003,"5min":9.9749999999999996,"15min":9.9749999999999996},"last":0.83499999999999996}]},{"osd":5,"last update":"Fri Oct 8 19:44:22 2021","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":1.2150000000000001,"15min":1.478},"min":{"1min":0.41999999999999998,"5min":0.311,"15min":0.28199999999999997},"max":{"1min":0.89900000000000002,"5min":6.3010000000000002,"15min":9.9730000000000008},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.625,"5min":1.3420000000000001,"15min":1.6519999999999999},"min":{"1min":0.38200000000000001,"5min":0.32100000000000001,"15min":0.28599999999999998},"max":{"1min":0.93400000000000005,"5min":8.6899999999999995,"15min":15.115},"last":0.57399999999999995}]},{"osd":6,"last update":"Fri Oct 8 19:43:40 2021","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":1.3460000000000001,"15min":1.4470000000000001},"min":{"1min":0.375,"5min":0.32400000000000001,"15min":0.30599999999999999},"max":{"1min":0.91300000000000003,"5min":6.7069999999999999,"15min":7.165},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.57999999999999996,"5min":1.4450000000000001,"15min":1.679},"min":{"1min":0.42599999999999999,"5min":0.38,"15min":0.28199999999999997},"max":{"1min":0.88400000000000001,"5min":6.2569999999999997,"15min":10.002000000000001},"last":0.81699999999999995}]},{"osd":7,"last update":"Fri Oct 8 19:43:49 2021","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":1.4410000000000001,"15min":1.74},"min":{"1min":0.45300000000000001,"5min":0.38900000000000001,"15min":0.33200000000000002},"max":{"1min":0.78300000000000003,"5min":8.6519999999999992,"15min":13.214},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":1.399,"15min":1.5880000000000001},"min":{"1min":0.45500000000000002,"5min":0.40200000000000002,"15min":0.315},"max":{"1min":0.82799999999999996,"5min":6.6799999999999997,"15min":9.8849999999999998},"last":0.78700000000000003}]}]},{"osd":2,"up_from":18,"seq":77309411631,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":376828,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":375808,"kb_avail":93368324,"statfs":{"total":95995035648,"available":95609163776,"internally_reserved":0,"allocated":1036288,"data_stored":660561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":384827392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:44:26 2021","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":1.8100000000000001,"15min":1.9019999999999999},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.184},"max":{"1min":0.71299999999999997,"5min":50.759999999999998,"15min":60.990000000000002},"last":0.21199999999999999},{"interface":"front","average":{"1min":0.34499999999999997,"5min":1.653,"15min":1.8620000000000001},"min":{"1min":0.222,"5min":0.222,"15min":0.17999999999999999},"max":{"1min":0.77100000000000002,"5min":50.899000000000001,"15min":60.850999999999999},"last":0.33400000000000002}]},{"osd":1,"last update":"Fri Oct 8 19:44:26 2021","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":1.843,"15min":2.391},"min":{"1min":0.23899999999999999,"5min":0.20999999999999999,"15min":0.19700000000000001},"max":{"1min":0.47499999999999998,"5min":50.866999999999997,"15min":63.738},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.36899999999999999,"5min":2.2850000000000001,"15min":2.6779999999999999},"min":{"1min":0.25700000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":1.1100000000000001,"5min":50.978000000000002,"15min":63.619999999999997},"last":0.38100000000000001}]},{"osd":3,"last update":"Fri Oct 8 19:44:32 2021","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":2.4750000000000001,"15min":2.8279999999999998},"min":{"1min":0.249,"5min":0.217,"15min":0.21199999999999999},"max":{"1min":1.0209999999999999,"5min":51.036999999999999,"15min":67.198999999999998},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.379,"5min":2.3809999999999998,"15min":2.7570000000000001},"min":{"1min":0.29999999999999999,"5min":0.25800000000000001,"15min":0.21299999999999999},"max":{"1min":0.80300000000000005,"5min":52.667999999999999,"15min":66.963999999999999},"last":0.26500000000000001}]},{"osd":4,"last update":"Fri Oct 8 19:43:54 2021","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":1.871,"15min":1.6879999999999999},"min":{"1min":0.35299999999999998,"5min":0.29699999999999999,"15min":0.27800000000000002},"max":{"1min":0.81899999999999995,"5min":52.482999999999997,"15min":52.482999999999997},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":1.9510000000000001,"15min":1.744},"min":{"1min":0.40600000000000003,"5min":0.30199999999999999,"15min":0.26100000000000001},"max":{"1min":0.83599999999999997,"5min":51.015000000000001,"15min":51.015000000000001},"last":0.61099999999999999}]},{"osd":5,"last update":"Fri Oct 8 19:44:26 2021","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":2.2530000000000001,"15min":1.913},"min":{"1min":0.34100000000000003,"5min":0.311,"15min":0.28000000000000003},"max":{"1min":0.95799999999999996,"5min":52.354999999999997,"15min":52.354999999999997},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.59499999999999997,"5min":1.647,"15min":1.6140000000000001},"min":{"1min":0.40300000000000002,"5min":0.307,"15min":0.29199999999999998},"max":{"1min":0.96699999999999997,"5min":51.082999999999998,"15min":51.082999999999998},"last":0.52100000000000002}]},{"osd":6,"last update":"Fri Oct 8 19:44:32 2021","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":2.6480000000000001,"15min":1.8759999999999999},"min":{"1min":0.44,"5min":0.34100000000000003,"15min":0.28000000000000003},"max":{"1min":1.161,"5min":55.970999999999997,"15min":55.970999999999997},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.60599999999999998,"5min":2.3330000000000002,"15min":1.8700000000000001},"min":{"1min":0.42599999999999999,"5min":0.36899999999999999,"15min":0.31},"max":{"1min":1.0049999999999999,"5min":56.433,"15min":56.433},"last":0.49299999999999999}]},{"osd":7,"last update":"Fri Oct 8 19:43:54 2021","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":1.966,"15min":2.3769999999999998},"min":{"1min":0.438,"5min":0.38500000000000001,"15min":0.32200000000000001},"max":{"1min":0.92600000000000005,"5min":52.610999999999997,"15min":136.00200000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":1.6990000000000001,"15min":2.2040000000000002},"min":{"1min":0.45800000000000002,"5min":0.39400000000000002,"15min":0.33400000000000002},"max":{"1min":0.88600000000000001,"5min":51.100999999999999,"15min":133.26300000000001},"last":0.57299999999999995}]}]},{"osd":3,"up_from":24,"seq":103079215405,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":480416,"kb_used_data":1368,"kb_used_omap":0,"kb_used_meta":479040,"kb_avail":93264736,"statfs":{"total":95995035648,"available":95503089664,"internally_reserved":0,"allocated":1400832,"data_stored":989251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":490536960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:43:47 2021","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":2.6629999999999998,"15min":2.3639999999999999},"min":{"1min":0.214,"5min":0.188,"15min":0.187},"max":{"1min":0.42299999999999999,"5min":93.194999999999993,"15min":93.194999999999993},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.33500000000000002,"5min":2.5600000000000001,"15min":2.1030000000000002},"min":{"1min":0.252,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.44600000000000001,"5min":96.450999999999993,"15min":96.450999999999993},"last":0.45200000000000001}]},{"osd":1,"last update":"Fri Oct 8 19:43:47 2021","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":1.78,"15min":1.869},"min":{"1min":0.24399999999999999,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.47699999999999998,"5min":9.9239999999999995,"15min":37.271999999999998},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.31900000000000001,"5min":1.962,"15min":1.885},"min":{"1min":0.25,"5min":0.22500000000000001,"15min":0.19},"max":{"1min":0.40000000000000002,"5min":28.356999999999999,"15min":37.033000000000001},"last":0.41099999999999998}]},{"osd":2,"last update":"Fri Oct 8 19:43:47 2021","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":1.833,"15min":1.655},"min":{"1min":0.27000000000000002,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.46300000000000002,"5min":28.454999999999998,"15min":28.454999999999998},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.378,"5min":1.8320000000000001,"15min":1.9950000000000001},"min":{"1min":0.30299999999999999,"5min":0.252,"15min":0.224},"max":{"1min":0.47599999999999998,"5min":18.041,"15min":23.189},"last":0.47399999999999998}]},{"osd":4,"last update":"Fri Oct 8 19:44:05 2021","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":1.377,"15min":1.6180000000000001},"min":{"1min":0.30599999999999999,"5min":0.28000000000000003,"15min":0.26600000000000001},"max":{"1min":0.75,"5min":8.5060000000000002,"15min":13.968},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.51600000000000001,"5min":1.2390000000000001,"15min":1.7390000000000001},"min":{"1min":0.34499999999999997,"5min":0.28599999999999998,"15min":0.26900000000000002},"max":{"1min":0.63500000000000001,"5min":5.3109999999999999,"15min":15.414},"last":0.55700000000000005}]},{"osd":5,"last update":"Fri Oct 8 19:44:16 2021","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":1.222,"15min":1.6299999999999999},"min":{"1min":0.34799999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.86499999999999999,"5min":10.055,"15min":75.397000000000006},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":1.3580000000000001,"15min":2.0920000000000001},"min":{"1min":0.44700000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.72599999999999998,"5min":8.5429999999999993,"15min":75.680000000000007},"last":0.51100000000000001}]},{"osd":6,"last update":"Fri Oct 8 19:44:28 2021","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":3.0640000000000001,"15min":2.1850000000000001},"min":{"1min":0.42299999999999999,"5min":0.32800000000000001,"15min":0.28599999999999998},"max":{"1min":0.80300000000000005,"5min":202.99799999999999,"15min":202.99799999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":2.9790000000000001,"15min":2.0670000000000002},"min":{"1min":0.374,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.93899999999999995,"5min":202.31200000000001,"15min":202.31200000000001},"last":0.56599999999999995}]},{"osd":7,"last update":"Fri Oct 8 19:44:05 2021","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":1.456,"15min":1.8400000000000001},"min":{"1min":0.439,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.755,"5min":13.587,"15min":13.587},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":1.3819999999999999,"15min":1.5660000000000001},"min":{"1min":0.443,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.79000000000000004,"5min":13.644,"15min":13.644},"last":0.63900000000000001}]}]},{"osd":4,"up_from":30,"seq":128849019175,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":337428,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":336640,"kb_avail":93407724,"statfs":{"total":95995035648,"available":95649509376,"internally_reserved":0,"allocated":798720,"data_stored":399296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":344719360},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:43:55 2021","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":1.508,"15min":1.728},"min":{"1min":0.32400000000000001,"5min":0.22500000000000001,"15min":0.188},"max":{"1min":0.73699999999999999,"5min":58.609999999999999,"15min":82.109999999999999},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":1.8200000000000001,"15min":1.7150000000000001},"min":{"1min":0.36199999999999999,"5min":0.224,"15min":0.222},"max":{"1min":0.78100000000000003,"5min":58.329999999999998,"15min":82.025999999999996},"last":0.63700000000000001}]},{"osd":1,"last update":"Fri Oct 8 19:43:55 2021","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":2.71,"15min":2.552},"min":{"1min":0.34799999999999998,"5min":0.24099999999999999,"15min":0.215},"max":{"1min":0.80200000000000005,"5min":65.332999999999998,"15min":122.422},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":2.8130000000000002,"15min":2.5230000000000001},"min":{"1min":0.33800000000000002,"5min":0.245,"15min":0.23599999999999999},"max":{"1min":0.80700000000000005,"5min":64.966999999999999,"15min":123.122},"last":0.52100000000000002}]},{"osd":2,"last update":"Fri Oct 8 19:43:55 2021","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":2.0739999999999998,"15min":1.5840000000000001},"min":{"1min":0.35499999999999998,"5min":0.30599999999999999,"15min":0.22600000000000001},"max":{"1min":0.78300000000000003,"5min":60.082999999999998,"15min":60.082999999999998},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.629,"5min":2.1520000000000001,"15min":1.6779999999999999},"min":{"1min":0.39200000000000002,"5min":0.28799999999999998,"15min":0.221},"max":{"1min":1.5600000000000001,"5min":60.539000000000001,"15min":60.539000000000001},"last":0.56000000000000005}]},{"osd":3,"last update":"Fri Oct 8 19:43:55 2021","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":3.0790000000000002,"15min":2.2530000000000001},"min":{"1min":0.42699999999999999,"5min":0.32700000000000001,"15min":0.27700000000000002},"max":{"1min":0.68600000000000005,"5min":59.137,"15min":59.137},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":3.0169999999999999,"15min":2.2280000000000002},"min":{"1min":0.41999999999999998,"5min":0.32300000000000001,"15min":0.254},"max":{"1min":0.76600000000000001,"5min":59.777000000000001,"15min":59.777000000000001},"last":0.51300000000000001}]},{"osd":5,"last update":"Fri Oct 8 19:44:19 2021","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.66400000000000003,"15min":1.0229999999999999},"min":{"1min":0.30299999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.64600000000000002,"5min":3.4489999999999998,"15min":10.477},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.75700000000000001,"15min":0.94699999999999995},"min":{"1min":0.35899999999999999,"5min":0.25800000000000001,"15min":0.23999999999999999},"max":{"1min":0.74299999999999999,"5min":4.0549999999999997,"15min":8.1319999999999997},"last":0.54800000000000004}]},{"osd":6,"last update":"Fri Oct 8 19:44:37 2021","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":2.1179999999999999,"15min":2.403},"min":{"1min":0.33100000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.74299999999999999,"5min":113.14700000000001,"15min":171.69800000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.58399999999999996,"5min":2.0110000000000001,"15min":2.4399999999999999},"min":{"1min":0.36799999999999999,"5min":0.27800000000000002,"15min":0.26600000000000001},"max":{"1min":0.77900000000000003,"5min":112.651,"15min":171.613},"last":0.59099999999999997}]},{"osd":7,"last update":"Fri Oct 8 19:43:55 2021","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.74199999999999999,"15min":0.97999999999999998},"min":{"1min":0.39200000000000002,"5min":0.29499999999999998,"15min":0.29099999999999998},"max":{"1min":0.75600000000000001,"5min":3.0720000000000001,"15min":8.0050000000000008},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.86799999999999999,"15min":1.0449999999999999},"min":{"1min":0.42799999999999999,"5min":0.29199999999999998,"15min":0.26800000000000002},"max":{"1min":0.83199999999999996,"5min":9.3190000000000008,"15min":9.3190000000000008},"last":0.68600000000000005}]}]},{"osd":5,"up_from":38,"seq":163208757539,"num_pgs":62,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":407308,"kb_used_data":1348,"kb_used_omap":0,"kb_used_meta":405952,"kb_avail":93337844,"statfs":{"total":95995035648,"available":95577952256,"internally_reserved":0,"allocated":1380352,"data_stored":989956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":415694848},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:44:24 2021","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.85099999999999998,"15min":1.403},"min":{"1min":0.30099999999999999,"5min":0.20899999999999999,"15min":0.20300000000000001},"max":{"1min":0.55200000000000005,"5min":4.8220000000000001,"15min":43.332999999999998},"last":0.38},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.94599999999999995,"15min":1.514},"min":{"1min":0.28299999999999997,"5min":0.22700000000000001,"15min":0.216},"max":{"1min":0.65500000000000003,"5min":7.6890000000000001,"15min":42.637},"last":0.45700000000000002}]},{"osd":1,"last update":"Fri Oct 8 19:44:24 2021","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":1.278,"15min":1.788},"min":{"1min":0.34200000000000003,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.65600000000000003,"5min":9.3010000000000002,"15min":94.558999999999997},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.48899999999999999,"5min":1.373,"15min":1.681},"min":{"1min":0.35199999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.67500000000000004,"5min":12.756,"15min":94.456999999999994},"last":0.46899999999999997}]},{"osd":2,"last update":"Fri Oct 8 19:44:24 2021","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":1.075,"15min":1.244},"min":{"1min":0.30099999999999999,"5min":0.26000000000000001,"15min":0.249},"max":{"1min":0.64300000000000002,"5min":7.4939999999999998,"15min":22.931999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.48199999999999998,"5min":1.2789999999999999,"15min":1.4470000000000001},"min":{"1min":0.316,"5min":0.251,"15min":0.24099999999999999},"max":{"1min":0.64500000000000002,"5min":7.9139999999999997,"15min":22.963999999999999},"last":0.55100000000000005}]},{"osd":3,"last update":"Fri Oct 8 19:44:24 2021","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":1.218,"15min":1.4890000000000001},"min":{"1min":0.34300000000000003,"5min":0.30099999999999999,"15min":0.27000000000000002},"max":{"1min":0.68200000000000005,"5min":10.827999999999999,"15min":11.685},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":1.6220000000000001,"15min":1.821},"min":{"1min":0.318,"5min":0.318,"15min":0.218},"max":{"1min":0.63300000000000001,"5min":26.771000000000001,"15min":26.771000000000001},"last":0.42199999999999999}]},{"osd":4,"last update":"Fri Oct 8 19:44:24 2021","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":1.341,"15min":1.0700000000000001},"min":{"1min":0.26600000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.67200000000000004,"5min":67.369,"15min":67.369},"last":0.5},{"interface":"front","average":{"1min":0.48799999999999999,"5min":1.4279999999999999,"15min":1.1599999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.25900000000000001},"max":{"1min":0.72999999999999998,"5min":67.468999999999994,"15min":67.468999999999994},"last":0.59299999999999997}]},{"osd":6,"last update":"Fri Oct 8 19:44:36 2021","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.82699999999999996,"15min":1.014},"min":{"1min":0.33500000000000002,"5min":0.28100000000000003,"15min":0.255},"max":{"1min":0.75800000000000001,"5min":6.6600000000000001,"15min":11.192},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.91400000000000003,"15min":1.0640000000000001},"min":{"1min":0.38100000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.78600000000000003,"5min":9.2029999999999994,"15min":11.259},"last":0.54300000000000004}]},{"osd":7,"last update":"Fri Oct 8 19:43:53 2021","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.85799999999999998,"15min":1.087},"min":{"1min":0.40300000000000002,"5min":0.32300000000000001,"15min":0.22},"max":{"1min":0.72399999999999998,"5min":5.8280000000000003,"15min":29.946999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.80300000000000005,"15min":1.137},"min":{"1min":0.44400000000000001,"5min":0.34699999999999998,"15min":0.23699999999999999},"max":{"1min":0.85999999999999999,"5min":4.3120000000000003,"15min":29.294},"last":0.60199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":266240,"data_stored":262688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":327680,"data_stored":327680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-10-08T19:44:49.299 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph pg dump --format=json 2021-10-08T19:44:49.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:49 smithi117 ceph-mon[34585]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:44:49.655 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:49 smithi117 ceph-mon[34585]: 5.b scrub ok 2021-10-08T19:44:49.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:49 smithi097 ceph-mon[32687]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:44:49.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:49 smithi097 ceph-mon[32687]: 5.b scrub ok 2021-10-08T19:44:49.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:49 smithi097 ceph-mon[41966]: from='client.14538 v1:172.21.15.117:0/3225059782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:44:49.721 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:49 smithi097 ceph-mon[41966]: 5.b scrub ok 2021-10-08T19:44:49.802 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:44:50.155 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:44:49 smithi097 conmon[33110]: 172.21.15.117 - - [08/Oct/2021:19:44:49] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:44:50.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:50 smithi097 ceph-mon[41966]: from='client.16752 v1:172.21.15.97:0/2061749625' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:44:50.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:50 smithi097 ceph-mon[41966]: pgmap v1153: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:44:50.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:50 smithi097 ceph-mon[41966]: 3.12 scrub ok 2021-10-08T19:44:50.470 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:50 smithi097 ceph-mon[41966]: 5.e scrub ok 2021-10-08T19:44:50.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:50 smithi097 ceph-mon[41966]: 4.10 scrub ok 2021-10-08T19:44:50.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:50 smithi097 ceph-mon[41966]: 2.e scrub ok 2021-10-08T19:44:50.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:50 smithi097 ceph-mon[41966]: 1.8 scrub ok 2021-10-08T19:44:50.471 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:50 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:44:50.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:50 smithi097 ceph-mon[32687]: from='client.16752 v1:172.21.15.97:0/2061749625' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:44:50.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:50 smithi097 ceph-mon[32687]: pgmap v1153: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:44:50.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:50 smithi097 ceph-mon[32687]: 3.12 scrub ok 2021-10-08T19:44:50.472 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:50 smithi097 ceph-mon[32687]: 5.e scrub ok 2021-10-08T19:44:50.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:50 smithi097 ceph-mon[32687]: 4.10 scrub ok 2021-10-08T19:44:50.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:50 smithi097 ceph-mon[32687]: 2.e scrub ok 2021-10-08T19:44:50.473 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:50 smithi097 ceph-mon[32687]: 1.8 scrub ok 2021-10-08T19:44:50.474 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:50 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:44:50.656 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:50 smithi117 ceph-mon[34585]: from='client.16752 v1:172.21.15.97:0/2061749625' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:44:50.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:50 smithi117 ceph-mon[34585]: pgmap v1153: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:44:50.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:50 smithi117 ceph-mon[34585]: 3.12 scrub ok 2021-10-08T19:44:50.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:50 smithi117 ceph-mon[34585]: 5.e scrub ok 2021-10-08T19:44:50.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:50 smithi117 ceph-mon[34585]: 4.10 scrub ok 2021-10-08T19:44:50.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:50 smithi117 ceph-mon[34585]: 2.e scrub ok 2021-10-08T19:44:50.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:50 smithi117 ceph-mon[34585]: 1.8 scrub ok 2021-10-08T19:44:50.659 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:50 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:44:51.457 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:51 smithi097 ceph-mon[32687]: 2.b scrub ok 2021-10-08T19:44:51.457 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:51 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:44:51.457 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:51 smithi097 ceph-mon[32687]: 172.21.15.117 - - [08/Oct/2021:19:44:49] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:44:51.458 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:51 smithi097 ceph-mon[32687]: 5.1c scrub ok 2021-10-08T19:44:51.458 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:51 smithi097 ceph-mon[32687]: 2.0 scrub ok 2021-10-08T19:44:51.458 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:51 smithi097 ceph-mon[32687]: 2.14 scrub ok 2021-10-08T19:44:51.458 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:51 smithi097 ceph-mon[32687]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:44:51.459 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:51 smithi097 ceph-mon[41966]: 2.b scrub ok 2021-10-08T19:44:51.459 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:51 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:44:51.463 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:51 smithi097 ceph-mon[41966]: 172.21.15.117 - - [08/Oct/2021:19:44:49] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:44:51.463 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:51 smithi097 ceph-mon[41966]: 5.1c scrub ok 2021-10-08T19:44:51.463 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:51 smithi097 ceph-mon[41966]: 2.0 scrub ok 2021-10-08T19:44:51.463 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:51 smithi097 ceph-mon[41966]: 2.14 scrub ok 2021-10-08T19:44:51.464 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:51 smithi097 ceph-mon[41966]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:44:51.464 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:44:51 smithi097 conmon[33110]: 172.21.15.97 - - [08/Oct/2021:19:44:51] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:44:51.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:51 smithi117 ceph-mon[34585]: 2.b scrub ok 2021-10-08T19:44:51.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:51 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi117. 2021-10-08T19:44:51.659 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:51 smithi117 ceph-mon[34585]: 172.21.15.117 - - [08/Oct/2021:19:44:49] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:44:51.659 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:51 smithi117 ceph-mon[34585]: 5.1c scrub ok 2021-10-08T19:44:51.659 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:51 smithi117 ceph-mon[34585]: 2.0 scrub ok 2021-10-08T19:44:51.659 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:51 smithi117 ceph-mon[34585]: 2.14 scrub ok 2021-10-08T19:44:51.659 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:51 smithi117 ceph-mon[34585]: from='mgr.24493 v1:172.21.15.97:0/2023641354' entity='mgr.y' 2021-10-08T19:44:51.847 INFO:teuthology.orchestra.run.smithi097.stdout: 2021-10-08T19:44:51.850 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2021-10-08T19:44:52.427 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":1154,"stamp":"2021-10-08T19:44:51.082036+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596164,"num_objects":194,"num_object_clones":0,"num_object_copies":582,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":2398,"num_read_kb":2155,"num_write":995,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":538,"num_bytes_recovered":12116,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2604,"ondisk_log_size":2604,"up":516,"acting":516,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":516,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":3236440,"kb_used_data":8024,"kb_used_omap":0,"kb_used_meta":3228352,"kb_avail":746724776,"statfs":{"total":767960285184,"available":764646170624,"internally_reserved":0,"allocated":8216576,"data_stored":5015588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3305832448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002773"},"pg_stats":[{"pgid":"2.29","version":"0'0","reported_seq":173,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.665992+0000","last_change":"2021-10-08T19:43:35.589984+0000","last_active":"2021-10-08T19:44:07.665992+0000","last_peered":"2021-10-08T19:44:07.665992+0000","last_clean":"2021-10-08T19:44:07.665992+0000","last_became_active":"2021-10-08T19:37:45.848663+0000","last_became_peered":"2021-10-08T19:37:45.848663+0000","last_unstale":"2021-10-08T19:44:07.665992+0000","last_undegraded":"2021-10-08T19:44:07.665992+0000","last_fullsized":"2021-10-08T19:44:07.665992+0000","mapping_epoch":407,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":408,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:35.589837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:30:11.102934+0000","last_clean_scrub_stamp":"2021-10-08T19:43:35.589837+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0026742670000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.28","version":"0'0","reported_seq":164,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:22.374519+0000","last_change":"2021-10-08T19:44:22.374033+0000","last_active":"2021-10-08T19:44:22.374519+0000","last_peered":"2021-10-08T19:44:22.374519+0000","last_clean":"2021-10-08T19:44:22.374519+0000","last_became_active":"2021-10-08T19:37:00.334502+0000","last_became_peered":"2021-10-08T19:37:00.334502+0000","last_unstale":"2021-10-08T19:44:22.374519+0000","last_undegraded":"2021-10-08T19:44:22.374519+0000","last_fullsized":"2021-10-08T19:44:22.374519+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:22.373961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:44:22.373961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0033987969999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.27","version":"0'0","reported_seq":477,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.508123+0000","last_change":"2021-10-08T19:43:52.935508+0000","last_active":"2021-10-08T19:44:07.508123+0000","last_peered":"2021-10-08T19:44:07.508123+0000","last_clean":"2021-10-08T19:44:07.508123+0000","last_became_active":"2021-10-08T19:37:00.342526+0000","last_became_peered":"2021-10-08T19:37:00.342526+0000","last_unstale":"2021-10-08T19:44:07.508123+0000","last_undegraded":"2021-10-08T19:44:07.508123+0000","last_fullsized":"2021-10-08T19:44:07.508123+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:52.935432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:43:52.935432+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001380771,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.26","version":"0'0","reported_seq":164,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.507993+0000","last_change":"2021-10-08T19:43:57.043253+0000","last_active":"2021-10-08T19:44:07.507993+0000","last_peered":"2021-10-08T19:44:07.507993+0000","last_clean":"2021-10-08T19:44:07.507993+0000","last_became_active":"2021-10-08T19:37:00.340327+0000","last_became_peered":"2021-10-08T19:37:00.340327+0000","last_unstale":"2021-10-08T19:44:07.507993+0000","last_undegraded":"2021-10-08T19:44:07.507993+0000","last_fullsized":"2021-10-08T19:44:07.507993+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:57.043176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:07.710367+0000","last_clean_scrub_stamp":"2021-10-08T19:43:57.043176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0013828989999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.25","version":"328'2","reported_seq":475,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:06.966224+0000","last_change":"2021-10-08T19:43:32.944412+0000","last_active":"2021-10-08T19:44:06.966224+0000","last_peered":"2021-10-08T19:44:06.966224+0000","last_clean":"2021-10-08T19:44:06.966224+0000","last_became_active":"2021-10-08T19:37:00.344673+0000","last_became_peered":"2021-10-08T19:37:00.344673+0000","last_unstale":"2021-10-08T19:44:06.966224+0000","last_undegraded":"2021-10-08T19:44:06.966224+0000","last_fullsized":"2021-10-08T19:44:06.966224+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"328'2","last_scrub_stamp":"2021-10-08T19:43:32.944317+0000","last_deep_scrub":"328'2","last_deep_scrub_stamp":"2021-10-08T19:33:29.990395+0000","last_clean_scrub_stamp":"2021-10-08T19:43:32.944317+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002362126,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.24","version":"0'0","reported_seq":170,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:43.848932+0000","last_change":"2021-10-08T19:44:43.848767+0000","last_active":"2021-10-08T19:44:43.848932+0000","last_peered":"2021-10-08T19:44:43.848932+0000","last_clean":"2021-10-08T19:44:43.848932+0000","last_became_active":"2021-10-08T19:37:00.336960+0000","last_became_peered":"2021-10-08T19:37:00.336960+0000","last_unstale":"2021-10-08T19:44:43.848932+0000","last_undegraded":"2021-10-08T19:44:43.848932+0000","last_fullsized":"2021-10-08T19:44:43.848932+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:43.848682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:44:43.848682+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0015245300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.23","version":"0'0","reported_seq":164,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:38.253681+0000","last_change":"2021-10-08T19:44:38.253222+0000","last_active":"2021-10-08T19:44:38.253681+0000","last_peered":"2021-10-08T19:44:38.253681+0000","last_clean":"2021-10-08T19:44:38.253681+0000","last_became_active":"2021-10-08T19:37:00.347789+0000","last_became_peered":"2021-10-08T19:37:00.347789+0000","last_unstale":"2021-10-08T19:44:38.253681+0000","last_undegraded":"2021-10-08T19:44:38.253681+0000","last_fullsized":"2021-10-08T19:44:38.253681+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:38.253146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:43:12.301558+0000","last_clean_scrub_stamp":"2021-10-08T19:44:38.253146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003481105,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.22","version":"0'0","reported_seq":572,"reported_epoch":530,"state":"active+clean","last_fresh":"2021-10-08T19:44:45.859078+0000","last_change":"2021-10-08T19:44:45.859045+0000","last_active":"2021-10-08T19:44:45.859078+0000","last_peered":"2021-10-08T19:44:45.859078+0000","last_clean":"2021-10-08T19:44:45.859078+0000","last_became_active":"2021-10-08T19:37:00.343394+0000","last_became_peered":"2021-10-08T19:37:00.343394+0000","last_unstale":"2021-10-08T19:44:45.859078+0000","last_undegraded":"2021-10-08T19:44:45.859078+0000","last_fullsized":"2021-10-08T19:44:45.859078+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:45.858973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:44:45.858973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0015371639999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3],"acting":[6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.21","version":"0'0","reported_seq":577,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:41.392292+0000","last_change":"2021-10-08T19:44:41.392126+0000","last_active":"2021-10-08T19:44:41.392292+0000","last_peered":"2021-10-08T19:44:41.392292+0000","last_clean":"2021-10-08T19:44:41.392292+0000","last_became_active":"2021-10-08T19:37:00.335409+0000","last_became_peered":"2021-10-08T19:37:00.335409+0000","last_unstale":"2021-10-08T19:44:41.392292+0000","last_undegraded":"2021-10-08T19:44:41.392292+0000","last_fullsized":"2021-10-08T19:44:41.392292+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:41.392036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:40:46.823341+0000","last_clean_scrub_stamp":"2021-10-08T19:44:41.392036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0017290000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7],"acting":[2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.20","version":"0'0","reported_seq":174,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.507092+0000","last_change":"2021-10-08T19:44:01.084271+0000","last_active":"2021-10-08T19:44:07.507092+0000","last_peered":"2021-10-08T19:44:07.507092+0000","last_clean":"2021-10-08T19:44:07.507092+0000","last_became_active":"2021-10-08T19:37:00.341831+0000","last_became_peered":"2021-10-08T19:37:00.341831+0000","last_unstale":"2021-10-08T19:44:07.507092+0000","last_undegraded":"2021-10-08T19:44:07.507092+0000","last_fullsized":"2021-10-08T19:44:07.507092+0000","mapping_epoch":393,"log_start":"0'0","ondisk_log_start":"0'0","created":391,"last_epoch_clean":394,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:01.084174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:32.922694+0000","last_clean_scrub_stamp":"2021-10-08T19:44:01.084174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001851856,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"114'10","reported_seq":842,"reported_epoch":530,"state":"active+clean","last_fresh":"2021-10-08T19:44:44.502933+0000","last_change":"2021-10-08T19:44:43.802123+0000","last_active":"2021-10-08T19:44:44.502933+0000","last_peered":"2021-10-08T19:44:44.502933+0000","last_clean":"2021-10-08T19:44:44.502933+0000","last_became_active":"2021-10-08T19:24:25.096162+0000","last_became_peered":"2021-10-08T19:24:25.096162+0000","last_unstale":"2021-10-08T19:44:44.502933+0000","last_undegraded":"2021-10-08T19:44:44.502933+0000","last_fullsized":"2021-10-08T19:44:44.502933+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'10","last_scrub_stamp":"2021-10-08T19:44:43.802042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:44:43.802042+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002192678,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"482'46","reported_seq":194,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:37.261698+0000","last_change":"2021-10-08T19:44:37.261502+0000","last_active":"2021-10-08T19:44:37.261698+0000","last_peered":"2021-10-08T19:44:37.261698+0000","last_clean":"2021-10-08T19:44:37.261698+0000","last_became_active":"2021-10-08T19:43:42.361177+0000","last_became_peered":"2021-10-08T19:43:42.361177+0000","last_unstale":"2021-10-08T19:44:37.261698+0000","last_undegraded":"2021-10-08T19:44:37.261698+0000","last_fullsized":"2021-10-08T19:44:37.261698+0000","mapping_epoch":520,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":521,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'46","last_scrub_stamp":"2021-10-08T19:44:37.261362+0000","last_deep_scrub":"87'22","last_deep_scrub_stamp":"2021-10-08T19:22:58.705632+0000","last_clean_scrub_stamp":"2021-10-08T19:44:37.261362+0000","log_size":46,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0026964799999999998,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":60,"num_read_kb":51,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":562,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:06.967134+0000","last_change":"2021-10-08T19:43:32.569138+0000","last_active":"2021-10-08T19:44:06.967134+0000","last_peered":"2021-10-08T19:44:06.967134+0000","last_clean":"2021-10-08T19:44:06.967134+0000","last_became_active":"2021-10-08T19:29:40.632678+0000","last_became_peered":"2021-10-08T19:29:40.632678+0000","last_unstale":"2021-10-08T19:44:06.967134+0000","last_undegraded":"2021-10-08T19:44:06.967134+0000","last_fullsized":"2021-10-08T19:44:06.967134+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:32.569040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:43:32.569040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0037520399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":405,"reported_epoch":530,"state":"active+clean","last_fresh":"2021-10-08T19:44:44.366475+0000","last_change":"2021-10-08T19:44:44.366439+0000","last_active":"2021-10-08T19:44:44.366475+0000","last_peered":"2021-10-08T19:44:44.366475+0000","last_clean":"2021-10-08T19:44:44.366475+0000","last_became_active":"2021-10-08T19:43:42.359904+0000","last_became_peered":"2021-10-08T19:43:42.359904+0000","last_unstale":"2021-10-08T19:44:44.366475+0000","last_undegraded":"2021-10-08T19:44:44.366475+0000","last_fullsized":"2021-10-08T19:44:44.366475+0000","mapping_epoch":520,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":521,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:44.366364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:44:44.366364+0000","last_clean_scrub_stamp":"2021-10-08T19:44:44.366364+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.023281884999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":454,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.508277+0000","last_change":"2021-10-08T19:43:33.990688+0000","last_active":"2021-10-08T19:44:07.508277+0000","last_peered":"2021-10-08T19:44:07.508277+0000","last_clean":"2021-10-08T19:44:07.508277+0000","last_became_active":"2021-10-08T19:25:15.510457+0000","last_became_peered":"2021-10-08T19:25:15.510457+0000","last_unstale":"2021-10-08T19:44:07.508277+0000","last_undegraded":"2021-10-08T19:44:07.508277+0000","last_fullsized":"2021-10-08T19:44:07.508277+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:33.990597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:43:33.990597+0000","last_clean_scrub_stamp":"2021-10-08T19:43:33.990597+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0017240689999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"482'25","reported_seq":606,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:26.198234+0000","last_change":"2021-10-08T19:44:26.198064+0000","last_active":"2021-10-08T19:44:26.198234+0000","last_peered":"2021-10-08T19:44:26.198234+0000","last_clean":"2021-10-08T19:44:26.198234+0000","last_became_active":"2021-10-08T19:28:40.159729+0000","last_became_peered":"2021-10-08T19:28:40.159729+0000","last_unstale":"2021-10-08T19:44:26.198234+0000","last_undegraded":"2021-10-08T19:44:26.198234+0000","last_fullsized":"2021-10-08T19:44:26.198234+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'25","last_scrub_stamp":"2021-10-08T19:44:26.197954+0000","last_deep_scrub":"337'19","last_deep_scrub_stamp":"2021-10-08T19:34:14.040249+0000","last_clean_scrub_stamp":"2021-10-08T19:44:26.197954+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0025774980000000001,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":398,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.435343+0000","last_change":"2021-10-08T19:43:47.814571+0000","last_active":"2021-10-08T19:44:07.435343+0000","last_peered":"2021-10-08T19:44:07.435343+0000","last_clean":"2021-10-08T19:44:07.435343+0000","last_became_active":"2021-10-08T19:29:40.624977+0000","last_became_peered":"2021-10-08T19:29:40.624977+0000","last_unstale":"2021-10-08T19:44:07.435343+0000","last_undegraded":"2021-10-08T19:44:07.435343+0000","last_fullsized":"2021-10-08T19:44:07.435343+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:47.814477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:43:47.814477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0035767479999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":554,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:31.324037+0000","last_change":"2021-10-08T19:44:31.323891+0000","last_active":"2021-10-08T19:44:31.324037+0000","last_peered":"2021-10-08T19:44:31.324037+0000","last_clean":"2021-10-08T19:44:31.324037+0000","last_became_active":"2021-10-08T19:29:40.629422+0000","last_became_peered":"2021-10-08T19:29:40.629422+0000","last_unstale":"2021-10-08T19:44:31.324037+0000","last_undegraded":"2021-10-08T19:44:31.324037+0000","last_fullsized":"2021-10-08T19:44:31.324037+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:31.323819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:44:31.323819+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001723266,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":532,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:30.250561+0000","last_change":"2021-10-08T19:44:30.250419+0000","last_active":"2021-10-08T19:44:30.250561+0000","last_peered":"2021-10-08T19:44:30.250561+0000","last_clean":"2021-10-08T19:44:30.250561+0000","last_became_active":"2021-10-08T19:21:29.643022+0000","last_became_peered":"2021-10-08T19:21:29.643022+0000","last_unstale":"2021-10-08T19:44:30.250561+0000","last_undegraded":"2021-10-08T19:44:30.250561+0000","last_fullsized":"2021-10-08T19:44:30.250561+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:30.250322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:43:26.395040+0000","last_clean_scrub_stamp":"2021-10-08T19:44:30.250322+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.079062984000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"70'5","reported_seq":1239,"reported_epoch":530,"state":"active+clean","last_fresh":"2021-10-08T19:44:47.453803+0000","last_change":"2021-10-08T19:43:57.719172+0000","last_active":"2021-10-08T19:44:47.453803+0000","last_peered":"2021-10-08T19:44:47.453803+0000","last_clean":"2021-10-08T19:44:47.453803+0000","last_became_active":"2021-10-08T19:43:42.359412+0000","last_became_peered":"2021-10-08T19:43:42.359412+0000","last_unstale":"2021-10-08T19:44:47.453803+0000","last_undegraded":"2021-10-08T19:44:47.453803+0000","last_fullsized":"2021-10-08T19:44:47.453803+0000","mapping_epoch":520,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":521,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:43:57.719081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:43:57.719081+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040136850000000003,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":840,"num_read_kb":840,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1167,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"482'60","reported_seq":618,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:15.597951+0000","last_change":"2021-10-08T19:44:15.597778+0000","last_active":"2021-10-08T19:44:15.597951+0000","last_peered":"2021-10-08T19:44:15.597951+0000","last_clean":"2021-10-08T19:44:15.597951+0000","last_became_active":"2021-10-08T19:28:40.101648+0000","last_became_peered":"2021-10-08T19:28:40.101648+0000","last_unstale":"2021-10-08T19:44:15.597951+0000","last_undegraded":"2021-10-08T19:44:15.597951+0000","last_fullsized":"2021-10-08T19:44:15.597951+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'60","last_scrub_stamp":"2021-10-08T19:44:15.597685+0000","last_deep_scrub":"428'44","last_deep_scrub_stamp":"2021-10-08T19:38:47.335892+0000","last_clean_scrub_stamp":"2021-10-08T19:44:15.597685+0000","log_size":60,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0028980680000000002,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":52,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":540,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:13.514310+0000","last_change":"2021-10-08T19:44:13.513827+0000","last_active":"2021-10-08T19:44:13.514310+0000","last_peered":"2021-10-08T19:44:13.514310+0000","last_clean":"2021-10-08T19:44:13.514310+0000","last_became_active":"2021-10-08T19:21:23.595919+0000","last_became_peered":"2021-10-08T19:21:23.595919+0000","last_unstale":"2021-10-08T19:44:13.514310+0000","last_undegraded":"2021-10-08T19:44:13.514310+0000","last_fullsized":"2021-10-08T19:44:13.514310+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:13.513750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:40:11.180640+0000","last_clean_scrub_stamp":"2021-10-08T19:44:13.513750+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0035534780000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":554,"reported_epoch":530,"state":"active+clean","last_fresh":"2021-10-08T19:44:48.333871+0000","last_change":"2021-10-08T19:44:48.333834+0000","last_active":"2021-10-08T19:44:48.333871+0000","last_peered":"2021-10-08T19:44:48.333871+0000","last_clean":"2021-10-08T19:44:48.333871+0000","last_became_active":"2021-10-08T19:31:22.783725+0000","last_became_peered":"2021-10-08T19:31:22.783725+0000","last_unstale":"2021-10-08T19:44:48.333871+0000","last_undegraded":"2021-10-08T19:44:48.333871+0000","last_fullsized":"2021-10-08T19:44:48.333871+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:48.333733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:44:48.333733+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034233599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":538,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:17.084358+0000","last_change":"2021-10-08T19:44:17.084168+0000","last_active":"2021-10-08T19:44:17.084358+0000","last_peered":"2021-10-08T19:44:17.084358+0000","last_clean":"2021-10-08T19:44:17.084358+0000","last_became_active":"2021-10-08T19:29:40.638354+0000","last_became_peered":"2021-10-08T19:29:40.638354+0000","last_unstale":"2021-10-08T19:44:17.084358+0000","last_undegraded":"2021-10-08T19:44:17.084358+0000","last_fullsized":"2021-10-08T19:44:17.084358+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:17.084077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:39.528699+0000","last_clean_scrub_stamp":"2021-10-08T19:44:17.084077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0019057309999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":465,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:09.056200+0000","last_change":"2021-10-08T19:44:09.056047+0000","last_active":"2021-10-08T19:44:09.056200+0000","last_peered":"2021-10-08T19:44:09.056200+0000","last_clean":"2021-10-08T19:44:09.056200+0000","last_became_active":"2021-10-08T19:31:22.785590+0000","last_became_peered":"2021-10-08T19:31:22.785590+0000","last_unstale":"2021-10-08T19:44:09.056200+0000","last_undegraded":"2021-10-08T19:44:09.056200+0000","last_fullsized":"2021-10-08T19:44:09.056200+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:09.055954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:44:09.055954+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0018020309999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.8","version":"90'130","reported_seq":498,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.666139+0000","last_change":"2021-10-08T19:43:42.355565+0000","last_active":"2021-10-08T19:44:07.666139+0000","last_peered":"2021-10-08T19:44:07.666139+0000","last_clean":"2021-10-08T19:44:07.666139+0000","last_became_active":"2021-10-08T19:43:42.355121+0000","last_became_peered":"2021-10-08T19:43:42.355121+0000","last_unstale":"2021-10-08T19:44:07.666139+0000","last_undegraded":"2021-10-08T19:44:07.666139+0000","last_fullsized":"2021-10-08T19:44:07.666139+0000","mapping_epoch":520,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":521,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:43:30.574762+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:43:30.574762+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.016276585,"stat_sum":{"num_bytes":262688,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"482'53","reported_seq":649,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:06.966625+0000","last_change":"2021-10-08T19:43:36.989846+0000","last_active":"2021-10-08T19:44:06.966625+0000","last_peered":"2021-10-08T19:44:06.966625+0000","last_clean":"2021-10-08T19:44:06.966625+0000","last_became_active":"2021-10-08T19:28:40.099618+0000","last_became_peered":"2021-10-08T19:28:40.099618+0000","last_unstale":"2021-10-08T19:44:06.966625+0000","last_undegraded":"2021-10-08T19:44:06.966625+0000","last_fullsized":"2021-10-08T19:44:06.966625+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'53","last_scrub_stamp":"2021-10-08T19:43:36.989744+0000","last_deep_scrub":"459'39","last_deep_scrub_stamp":"2021-10-08T19:40:10.405068+0000","last_clean_scrub_stamp":"2021-10-08T19:43:36.989744+0000","log_size":53,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0030917660000000001,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":71,"num_read_kb":61,"num_write":46,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"61'1","reported_seq":528,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.507801+0000","last_change":"2021-10-08T19:43:11.150272+0000","last_active":"2021-10-08T19:44:07.507801+0000","last_peered":"2021-10-08T19:44:07.507801+0000","last_clean":"2021-10-08T19:44:07.507801+0000","last_became_active":"2021-10-08T19:21:23.607064+0000","last_became_peered":"2021-10-08T19:21:23.607064+0000","last_unstale":"2021-10-08T19:44:07.507801+0000","last_undegraded":"2021-10-08T19:44:07.507801+0000","last_fullsized":"2021-10-08T19:44:07.507801+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'1","last_scrub_stamp":"2021-10-08T19:43:11.150171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:43:11.150171+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0041021870000000002,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":378,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:36.917428+0000","last_change":"2021-10-08T19:44:36.917285+0000","last_active":"2021-10-08T19:44:36.917428+0000","last_peered":"2021-10-08T19:44:36.917428+0000","last_clean":"2021-10-08T19:44:36.917428+0000","last_became_active":"2021-10-08T19:28:40.152478+0000","last_became_peered":"2021-10-08T19:28:40.152478+0000","last_unstale":"2021-10-08T19:44:36.917428+0000","last_undegraded":"2021-10-08T19:44:36.917428+0000","last_fullsized":"2021-10-08T19:44:36.917428+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:36.917215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:30:09.081635+0000","last_clean_scrub_stamp":"2021-10-08T19:44:36.917215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001566469,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":552,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:38.434835+0000","last_change":"2021-10-08T19:44:38.434382+0000","last_active":"2021-10-08T19:44:38.434835+0000","last_peered":"2021-10-08T19:44:38.434835+0000","last_clean":"2021-10-08T19:44:38.434835+0000","last_became_active":"2021-10-08T19:29:40.629424+0000","last_became_peered":"2021-10-08T19:29:40.629424+0000","last_unstale":"2021-10-08T19:44:38.434835+0000","last_undegraded":"2021-10-08T19:44:38.434835+0000","last_fullsized":"2021-10-08T19:44:38.434835+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:38.434282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:44:38.434282+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.12070544499999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":510,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.666640+0000","last_change":"2021-10-08T19:44:03.462895+0000","last_active":"2021-10-08T19:44:07.666640+0000","last_peered":"2021-10-08T19:44:07.666640+0000","last_clean":"2021-10-08T19:44:07.666640+0000","last_became_active":"2021-10-08T19:31:51.676829+0000","last_became_peered":"2021-10-08T19:31:51.676829+0000","last_unstale":"2021-10-08T19:44:07.666640+0000","last_undegraded":"2021-10-08T19:44:07.666640+0000","last_fullsized":"2021-10-08T19:44:07.666640+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:03.462805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:44:03.462805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0018734800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.9","version":"90'130","reported_seq":868,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.507194+0000","last_change":"2021-10-08T19:43:32.989110+0000","last_active":"2021-10-08T19:44:07.507194+0000","last_peered":"2021-10-08T19:44:07.507194+0000","last_clean":"2021-10-08T19:44:07.507194+0000","last_became_active":"2021-10-08T19:29:43.634789+0000","last_became_peered":"2021-10-08T19:29:43.634789+0000","last_unstale":"2021-10-08T19:44:07.507194+0000","last_undegraded":"2021-10-08T19:44:07.507194+0000","last_fullsized":"2021-10-08T19:44:07.507194+0000","mapping_epoch":239,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:43:32.989009+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:43:32.989009+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001960626,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"482'30","reported_seq":646,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:06.966030+0000","last_change":"2021-10-08T19:43:41.046748+0000","last_active":"2021-10-08T19:44:06.966030+0000","last_peered":"2021-10-08T19:44:06.966030+0000","last_clean":"2021-10-08T19:44:06.966030+0000","last_became_active":"2021-10-08T19:29:40.631807+0000","last_became_peered":"2021-10-08T19:29:40.631807+0000","last_unstale":"2021-10-08T19:44:06.966030+0000","last_undegraded":"2021-10-08T19:44:06.966030+0000","last_fullsized":"2021-10-08T19:44:06.966030+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'30","last_scrub_stamp":"2021-10-08T19:43:41.046653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:43:41.046653+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040118599999999999,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":40,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":398,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:16.967677+0000","last_change":"2021-10-08T19:44:16.967563+0000","last_active":"2021-10-08T19:44:16.967677+0000","last_peered":"2021-10-08T19:44:16.967677+0000","last_clean":"2021-10-08T19:44:16.967677+0000","last_became_active":"2021-10-08T19:29:40.638988+0000","last_became_peered":"2021-10-08T19:29:40.638988+0000","last_unstale":"2021-10-08T19:44:16.967677+0000","last_undegraded":"2021-10-08T19:44:16.967677+0000","last_fullsized":"2021-10-08T19:44:16.967677+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:16.967492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:44:16.967492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001580864,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"250'9","reported_seq":828,"reported_epoch":530,"state":"active+clean","last_fresh":"2021-10-08T19:44:44.328173+0000","last_change":"2021-10-08T19:44:04.481562+0000","last_active":"2021-10-08T19:44:44.328173+0000","last_peered":"2021-10-08T19:44:44.328173+0000","last_clean":"2021-10-08T19:44:44.328173+0000","last_became_active":"2021-10-08T19:21:27.637930+0000","last_became_peered":"2021-10-08T19:21:27.637930+0000","last_unstale":"2021-10-08T19:44:44.328173+0000","last_undegraded":"2021-10-08T19:44:44.328173+0000","last_fullsized":"2021-10-08T19:44:44.328173+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'9","last_scrub_stamp":"2021-10-08T19:44:04.481429+0000","last_deep_scrub":"250'9","last_deep_scrub_stamp":"2021-10-08T19:42:57.267401+0000","last_clean_scrub_stamp":"2021-10-08T19:44:04.481429+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0042711520000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":537,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:38.289123+0000","last_change":"2021-10-08T19:44:38.288956+0000","last_active":"2021-10-08T19:44:38.289123+0000","last_peered":"2021-10-08T19:44:38.289123+0000","last_clean":"2021-10-08T19:44:38.289123+0000","last_became_active":"2021-10-08T19:28:40.100213+0000","last_became_peered":"2021-10-08T19:28:40.100213+0000","last_unstale":"2021-10-08T19:44:38.289123+0000","last_undegraded":"2021-10-08T19:44:38.289123+0000","last_fullsized":"2021-10-08T19:44:38.289123+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:38.288860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:44:38.288860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.025296393,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":326,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.505383+0000","last_change":"2021-10-08T19:43:23.274513+0000","last_active":"2021-10-08T19:44:07.505383+0000","last_peered":"2021-10-08T19:44:07.505383+0000","last_clean":"2021-10-08T19:44:07.505383+0000","last_became_active":"2021-10-08T19:29:44.443507+0000","last_became_peered":"2021-10-08T19:29:44.443507+0000","last_unstale":"2021-10-08T19:44:07.505383+0000","last_undegraded":"2021-10-08T19:44:07.505383+0000","last_fullsized":"2021-10-08T19:44:07.505383+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:23.274409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:43:23.274409+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034335289999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.a","version":"90'130","reported_seq":570,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.666432+0000","last_change":"2021-10-08T19:44:04.623908+0000","last_active":"2021-10-08T19:44:07.666432+0000","last_peered":"2021-10-08T19:44:07.666432+0000","last_clean":"2021-10-08T19:44:07.666432+0000","last_became_active":"2021-10-08T19:43:42.356894+0000","last_became_peered":"2021-10-08T19:43:42.356894+0000","last_unstale":"2021-10-08T19:44:07.666432+0000","last_undegraded":"2021-10-08T19:44:07.666432+0000","last_fullsized":"2021-10-08T19:44:07.666432+0000","mapping_epoch":520,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":521,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:44:04.623821+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:44:04.623821+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0016262080000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.f","version":"506'46","reported_seq":305,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:19.534687+0000","last_change":"2021-10-08T19:44:19.534216+0000","last_active":"2021-10-08T19:44:19.534687+0000","last_peered":"2021-10-08T19:44:19.534687+0000","last_clean":"2021-10-08T19:44:19.534687+0000","last_became_active":"2021-10-08T19:32:45.162914+0000","last_became_peered":"2021-10-08T19:32:45.162914+0000","last_unstale":"2021-10-08T19:44:19.534687+0000","last_undegraded":"2021-10-08T19:44:19.534687+0000","last_fullsized":"2021-10-08T19:44:19.534687+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"506'46","last_scrub_stamp":"2021-10-08T19:44:19.534144+0000","last_deep_scrub":"506'46","last_deep_scrub_stamp":"2021-10-08T19:43:00.309790+0000","last_clean_scrub_stamp":"2021-10-08T19:44:19.534144+0000","log_size":46,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039803729999999997,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":550,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":405,"reported_epoch":530,"state":"active+clean","last_fresh":"2021-10-08T19:44:45.989126+0000","last_change":"2021-10-08T19:44:45.989067+0000","last_active":"2021-10-08T19:44:45.989126+0000","last_peered":"2021-10-08T19:44:45.989126+0000","last_clean":"2021-10-08T19:44:45.989126+0000","last_became_active":"2021-10-08T19:36:58.004540+0000","last_became_peered":"2021-10-08T19:36:58.004540+0000","last_unstale":"2021-10-08T19:44:45.989126+0000","last_undegraded":"2021-10-08T19:44:45.989126+0000","last_fullsized":"2021-10-08T19:44:45.989126+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:45.988989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:47.613029+0000","last_clean_scrub_stamp":"2021-10-08T19:44:45.988989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0015150579999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"88'9","reported_seq":810,"reported_epoch":530,"state":"active+clean","last_fresh":"2021-10-08T19:44:44.504515+0000","last_change":"2021-10-08T19:43:03.016770+0000","last_active":"2021-10-08T19:44:44.504515+0000","last_peered":"2021-10-08T19:44:44.504515+0000","last_clean":"2021-10-08T19:44:44.504515+0000","last_became_active":"2021-10-08T19:21:27.636432+0000","last_became_peered":"2021-10-08T19:21:27.636432+0000","last_unstale":"2021-10-08T19:44:44.504515+0000","last_undegraded":"2021-10-08T19:44:44.504515+0000","last_fullsized":"2021-10-08T19:44:44.504515+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'9","last_scrub_stamp":"2021-10-08T19:43:03.016630+0000","last_deep_scrub":"88'9","last_deep_scrub_stamp":"2021-10-08T19:23:00.048245+0000","last_clean_scrub_stamp":"2021-10-08T19:43:03.016630+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0023407620000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":409,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.668778+0000","last_change":"2021-10-08T19:43:55.796004+0000","last_active":"2021-10-08T19:44:07.668778+0000","last_peered":"2021-10-08T19:44:07.668778+0000","last_clean":"2021-10-08T19:44:07.668778+0000","last_became_active":"2021-10-08T19:43:42.363326+0000","last_became_peered":"2021-10-08T19:43:42.363326+0000","last_unstale":"2021-10-08T19:44:07.668778+0000","last_undegraded":"2021-10-08T19:44:07.668778+0000","last_fullsized":"2021-10-08T19:44:07.668778+0000","mapping_epoch":520,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":521,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:55.795882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:43:55.795882+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.075679722000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.8","version":"70'5","reported_seq":326,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.504768+0000","last_change":"2021-10-08T19:43:38.484912+0000","last_active":"2021-10-08T19:44:07.504768+0000","last_peered":"2021-10-08T19:44:07.504768+0000","last_clean":"2021-10-08T19:44:07.504768+0000","last_became_active":"2021-10-08T19:29:40.639786+0000","last_became_peered":"2021-10-08T19:29:40.639786+0000","last_unstale":"2021-10-08T19:44:07.504768+0000","last_undegraded":"2021-10-08T19:44:07.504768+0000","last_fullsized":"2021-10-08T19:44:07.504768+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:43:38.484838+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2021-10-08T19:43:38.484838+0000","last_clean_scrub_stamp":"2021-10-08T19:43:38.484838+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039408949999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"482'27","reported_seq":709,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:13.063981+0000","last_change":"2021-10-08T19:44:13.063833+0000","last_active":"2021-10-08T19:44:13.063981+0000","last_peered":"2021-10-08T19:44:13.063981+0000","last_clean":"2021-10-08T19:44:13.063981+0000","last_became_active":"2021-10-08T19:31:51.677509+0000","last_became_peered":"2021-10-08T19:31:51.677509+0000","last_unstale":"2021-10-08T19:44:13.063981+0000","last_undegraded":"2021-10-08T19:44:13.063981+0000","last_fullsized":"2021-10-08T19:44:13.063981+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'27","last_scrub_stamp":"2021-10-08T19:44:13.063736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:44:13.063736+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0028980329999999999,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":770,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":555,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.507337+0000","last_change":"2021-10-08T19:43:43.861314+0000","last_active":"2021-10-08T19:44:07.507337+0000","last_peered":"2021-10-08T19:44:07.507337+0000","last_clean":"2021-10-08T19:44:07.507337+0000","last_became_active":"2021-10-08T19:36:58.001610+0000","last_became_peered":"2021-10-08T19:36:58.001610+0000","last_unstale":"2021-10-08T19:44:07.507337+0000","last_undegraded":"2021-10-08T19:44:07.507337+0000","last_fullsized":"2021-10-08T19:44:07.507337+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:43.861228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:43:43.861228+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0017534670000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":407,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:26.317950+0000","last_change":"2021-10-08T19:44:26.317491+0000","last_active":"2021-10-08T19:44:26.317950+0000","last_peered":"2021-10-08T19:44:26.317950+0000","last_clean":"2021-10-08T19:44:26.317950+0000","last_became_active":"2021-10-08T19:43:42.362791+0000","last_became_peered":"2021-10-08T19:43:42.362791+0000","last_unstale":"2021-10-08T19:44:26.317950+0000","last_undegraded":"2021-10-08T19:44:26.317950+0000","last_fullsized":"2021-10-08T19:44:26.317950+0000","mapping_epoch":520,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":521,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:26.317390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:44:26.317390+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034651090000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":332,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.505152+0000","last_change":"2021-10-08T19:43:57.547647+0000","last_active":"2021-10-08T19:44:07.505152+0000","last_peered":"2021-10-08T19:44:07.505152+0000","last_clean":"2021-10-08T19:44:07.505152+0000","last_became_active":"2021-10-08T19:29:40.638099+0000","last_became_peered":"2021-10-08T19:29:40.638099+0000","last_unstale":"2021-10-08T19:44:07.505152+0000","last_undegraded":"2021-10-08T19:44:07.505152+0000","last_fullsized":"2021-10-08T19:44:07.505152+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:57.547572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:17.422176+0000","last_clean_scrub_stamp":"2021-10-08T19:43:57.547572+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034099680000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":470,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:06.965383+0000","last_change":"2021-10-08T19:44:04.097615+0000","last_active":"2021-10-08T19:44:06.965383+0000","last_peered":"2021-10-08T19:44:06.965383+0000","last_clean":"2021-10-08T19:44:06.965383+0000","last_became_active":"2021-10-08T19:24:13.506602+0000","last_became_peered":"2021-10-08T19:24:13.506602+0000","last_unstale":"2021-10-08T19:44:06.965383+0000","last_undegraded":"2021-10-08T19:44:06.965383+0000","last_fullsized":"2021-10-08T19:44:06.965383+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:04.097532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:44:04.097532+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003431403,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"90'130","reported_seq":662,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:33.336363+0000","last_change":"2021-10-08T19:44:33.335898+0000","last_active":"2021-10-08T19:44:33.336363+0000","last_peered":"2021-10-08T19:44:33.336363+0000","last_clean":"2021-10-08T19:44:33.336363+0000","last_became_active":"2021-10-08T19:29:43.636733+0000","last_became_peered":"2021-10-08T19:29:43.636733+0000","last_unstale":"2021-10-08T19:44:33.336363+0000","last_undegraded":"2021-10-08T19:44:33.336363+0000","last_fullsized":"2021-10-08T19:44:33.336363+0000","mapping_epoch":239,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:44:33.335810+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:44:33.335810+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.004332893,"stat_sum":{"num_bytes":327680,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"238'13","reported_seq":524,"reported_epoch":530,"state":"active+clean","last_fresh":"2021-10-08T19:44:44.325717+0000","last_change":"2021-10-08T19:44:12.448248+0000","last_active":"2021-10-08T19:44:44.325717+0000","last_peered":"2021-10-08T19:44:44.325717+0000","last_clean":"2021-10-08T19:44:44.325717+0000","last_became_active":"2021-10-08T19:29:40.640248+0000","last_became_peered":"2021-10-08T19:29:40.640248+0000","last_unstale":"2021-10-08T19:44:44.325717+0000","last_undegraded":"2021-10-08T19:44:44.325717+0000","last_fullsized":"2021-10-08T19:44:44.325717+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"238'13","last_scrub_stamp":"2021-10-08T19:44:12.448167+0000","last_deep_scrub":"91'9","last_deep_scrub_stamp":"2021-10-08T19:23:32.329475+0000","last_clean_scrub_stamp":"2021-10-08T19:44:12.448167+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040240370000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"482'42","reported_seq":638,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:27.170868+0000","last_change":"2021-10-08T19:44:27.170413+0000","last_active":"2021-10-08T19:44:27.170868+0000","last_peered":"2021-10-08T19:44:27.170868+0000","last_clean":"2021-10-08T19:44:27.170868+0000","last_became_active":"2021-10-08T19:24:25.098743+0000","last_became_peered":"2021-10-08T19:24:25.098743+0000","last_unstale":"2021-10-08T19:44:27.170868+0000","last_undegraded":"2021-10-08T19:44:27.170868+0000","last_fullsized":"2021-10-08T19:44:27.170868+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'42","last_scrub_stamp":"2021-10-08T19:44:27.170319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:44:27.170319+0000","log_size":42,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039817330000000003,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":63,"num_read_kb":56,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":486,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.667171+0000","last_change":"2021-10-08T19:43:39.608441+0000","last_active":"2021-10-08T19:44:07.667171+0000","last_peered":"2021-10-08T19:44:07.667171+0000","last_clean":"2021-10-08T19:44:07.667171+0000","last_became_active":"2021-10-08T19:37:45.829953+0000","last_became_peered":"2021-10-08T19:37:45.829953+0000","last_unstale":"2021-10-08T19:44:07.667171+0000","last_undegraded":"2021-10-08T19:44:07.667171+0000","last_fullsized":"2021-10-08T19:44:07.667171+0000","mapping_epoch":407,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":408,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:39.608352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:43:39.608352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0019339330000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,2],"acting":[6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":538,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.507986+0000","last_change":"2021-10-08T19:43:09.170507+0000","last_active":"2021-10-08T19:44:07.507986+0000","last_peered":"2021-10-08T19:44:07.507986+0000","last_clean":"2021-10-08T19:44:07.507986+0000","last_became_active":"2021-10-08T19:24:25.094848+0000","last_became_peered":"2021-10-08T19:24:25.094848+0000","last_unstale":"2021-10-08T19:44:07.507986+0000","last_undegraded":"2021-10-08T19:44:07.507986+0000","last_fullsized":"2021-10-08T19:44:07.507986+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:09.170379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:43:09.170379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.079291384000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":505,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:42.113360+0000","last_change":"2021-10-08T19:44:42.113218+0000","last_active":"2021-10-08T19:44:42.113360+0000","last_peered":"2021-10-08T19:44:42.113360+0000","last_clean":"2021-10-08T19:44:42.113360+0000","last_became_active":"2021-10-08T19:28:40.132751+0000","last_became_peered":"2021-10-08T19:28:40.132751+0000","last_unstale":"2021-10-08T19:44:42.113360+0000","last_undegraded":"2021-10-08T19:44:42.113360+0000","last_fullsized":"2021-10-08T19:44:42.113360+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:42.113143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:44:42.113143+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001778857,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"90'130","reported_seq":696,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:06.966117+0000","last_change":"2021-10-08T19:42:52.073943+0000","last_active":"2021-10-08T19:44:06.966117+0000","last_peered":"2021-10-08T19:44:06.966117+0000","last_clean":"2021-10-08T19:44:06.966117+0000","last_became_active":"2021-10-08T19:27:26.590651+0000","last_became_peered":"2021-10-08T19:27:26.590651+0000","last_unstale":"2021-10-08T19:44:06.966117+0000","last_undegraded":"2021-10-08T19:44:06.966117+0000","last_fullsized":"2021-10-08T19:44:06.966117+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:42:52.073856+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:32:14.582883+0000","last_clean_scrub_stamp":"2021-10-08T19:42:52.073856+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001467267,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":539,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:37.303494+0000","last_change":"2021-10-08T19:44:37.303032+0000","last_active":"2021-10-08T19:44:37.303494+0000","last_peered":"2021-10-08T19:44:37.303494+0000","last_clean":"2021-10-08T19:44:37.303494+0000","last_became_active":"2021-10-08T19:29:40.639405+0000","last_became_peered":"2021-10-08T19:29:40.639405+0000","last_unstale":"2021-10-08T19:44:37.303494+0000","last_undegraded":"2021-10-08T19:44:37.303494+0000","last_fullsized":"2021-10-08T19:44:37.303494+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:37.302941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:44:37.302941+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034398969999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"482'42","reported_seq":386,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.504659+0000","last_change":"2021-10-08T19:44:05.507176+0000","last_active":"2021-10-08T19:44:07.504659+0000","last_peered":"2021-10-08T19:44:07.504659+0000","last_clean":"2021-10-08T19:44:07.504659+0000","last_became_active":"2021-10-08T19:29:40.635007+0000","last_became_peered":"2021-10-08T19:29:40.635007+0000","last_unstale":"2021-10-08T19:44:07.504659+0000","last_undegraded":"2021-10-08T19:44:07.504659+0000","last_fullsized":"2021-10-08T19:44:07.504659+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'42","last_scrub_stamp":"2021-10-08T19:44:05.507103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:44:05.507103+0000","log_size":42,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0041393580000000001,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":69,"num_read_kb":57,"num_write":44,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":381,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:32.967758+0000","last_change":"2021-10-08T19:44:32.967285+0000","last_active":"2021-10-08T19:44:32.967758+0000","last_peered":"2021-10-08T19:44:32.967758+0000","last_clean":"2021-10-08T19:44:32.967758+0000","last_became_active":"2021-10-08T19:36:58.013501+0000","last_became_peered":"2021-10-08T19:36:58.013501+0000","last_unstale":"2021-10-08T19:44:32.967758+0000","last_undegraded":"2021-10-08T19:44:32.967758+0000","last_fullsized":"2021-10-08T19:44:32.967758+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:32.967205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:40:46.233456+0000","last_clean_scrub_stamp":"2021-10-08T19:44:32.967205+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034883309999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":531,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:06.965934+0000","last_change":"2021-10-08T19:43:39.006720+0000","last_active":"2021-10-08T19:44:06.965934+0000","last_peered":"2021-10-08T19:44:06.965934+0000","last_clean":"2021-10-08T19:44:06.965934+0000","last_became_active":"2021-10-08T19:29:40.638253+0000","last_became_peered":"2021-10-08T19:29:40.638253+0000","last_unstale":"2021-10-08T19:44:06.965934+0000","last_undegraded":"2021-10-08T19:44:06.965934+0000","last_fullsized":"2021-10-08T19:44:06.965934+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:39.006635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:43:39.006635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0035757430000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":326,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.505600+0000","last_change":"2021-10-08T19:43:31.399544+0000","last_active":"2021-10-08T19:44:07.505600+0000","last_peered":"2021-10-08T19:44:07.505600+0000","last_clean":"2021-10-08T19:44:07.505600+0000","last_became_active":"2021-10-08T19:29:40.634579+0000","last_became_peered":"2021-10-08T19:29:40.634579+0000","last_unstale":"2021-10-08T19:44:07.505600+0000","last_undegraded":"2021-10-08T19:44:07.505600+0000","last_fullsized":"2021-10-08T19:44:07.505600+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:31.399443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:43:31.399443+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.00164226,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"90'130","reported_seq":639,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.667026+0000","last_change":"2021-10-08T19:43:27.587031+0000","last_active":"2021-10-08T19:44:07.667026+0000","last_peered":"2021-10-08T19:44:07.667026+0000","last_clean":"2021-10-08T19:44:07.667026+0000","last_became_active":"2021-10-08T19:30:00.643797+0000","last_became_peered":"2021-10-08T19:30:00.643797+0000","last_unstale":"2021-10-08T19:44:07.667026+0000","last_undegraded":"2021-10-08T19:44:07.667026+0000","last_fullsized":"2021-10-08T19:44:07.667026+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:43:27.586947+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:43:27.586947+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0014889339999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":476,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.666426+0000","last_change":"2021-10-08T19:43:30.592864+0000","last_active":"2021-10-08T19:44:07.666426+0000","last_peered":"2021-10-08T19:44:07.666426+0000","last_clean":"2021-10-08T19:44:07.666426+0000","last_became_active":"2021-10-08T19:24:25.095389+0000","last_became_peered":"2021-10-08T19:24:25.095389+0000","last_unstale":"2021-10-08T19:44:07.666426+0000","last_undegraded":"2021-10-08T19:44:07.666426+0000","last_fullsized":"2021-10-08T19:44:07.666426+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:30.592790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:43:30.592790+0000","last_clean_scrub_stamp":"2021-10-08T19:43:30.592790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0018600299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"529'47","reported_seq":604,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:20.135807+0000","last_change":"2021-10-08T19:44:20.135631+0000","last_active":"2021-10-08T19:44:20.135807+0000","last_peered":"2021-10-08T19:44:20.135807+0000","last_clean":"2021-10-08T19:44:20.135807+0000","last_became_active":"2021-10-08T19:21:25.741812+0000","last_became_peered":"2021-10-08T19:21:25.741812+0000","last_unstale":"2021-10-08T19:44:20.135807+0000","last_undegraded":"2021-10-08T19:44:20.135807+0000","last_fullsized":"2021-10-08T19:44:20.135807+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"529'47","last_scrub_stamp":"2021-10-08T19:44:20.135556+0000","last_deep_scrub":"529'47","last_deep_scrub_stamp":"2021-10-08T19:44:20.135556+0000","last_clean_scrub_stamp":"2021-10-08T19:44:20.135556+0000","log_size":47,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0068859580000000002,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":69,"num_read_kb":55,"num_write":42,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"328'2","reported_seq":547,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.507971+0000","last_change":"2021-10-08T19:43:45.878311+0000","last_active":"2021-10-08T19:44:07.507971+0000","last_peered":"2021-10-08T19:44:07.507971+0000","last_clean":"2021-10-08T19:44:07.507971+0000","last_became_active":"2021-10-08T19:36:58.000171+0000","last_became_peered":"2021-10-08T19:36:58.000171+0000","last_unstale":"2021-10-08T19:44:07.507971+0000","last_undegraded":"2021-10-08T19:44:07.507971+0000","last_fullsized":"2021-10-08T19:44:07.507971+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"328'2","last_scrub_stamp":"2021-10-08T19:43:45.878217+0000","last_deep_scrub":"328'2","last_deep_scrub_stamp":"2021-10-08T19:43:45.878217+0000","last_clean_scrub_stamp":"2021-10-08T19:43:45.878217+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001853307,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":372,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:18.011741+0000","last_change":"2021-10-08T19:44:18.011620+0000","last_active":"2021-10-08T19:44:18.011741+0000","last_peered":"2021-10-08T19:44:18.011741+0000","last_clean":"2021-10-08T19:44:18.011741+0000","last_became_active":"2021-10-08T19:28:40.140876+0000","last_became_peered":"2021-10-08T19:28:40.140876+0000","last_unstale":"2021-10-08T19:44:18.011741+0000","last_undegraded":"2021-10-08T19:44:18.011741+0000","last_fullsized":"2021-10-08T19:44:18.011741+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:18.011525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:42:52.629131+0000","last_clean_scrub_stamp":"2021-10-08T19:44:18.011525+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.051124036999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"70'5","reported_seq":378,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.435564+0000","last_change":"2021-10-08T19:44:06.089112+0000","last_active":"2021-10-08T19:44:07.435564+0000","last_peered":"2021-10-08T19:44:07.435564+0000","last_clean":"2021-10-08T19:44:07.435564+0000","last_became_active":"2021-10-08T19:28:40.150503+0000","last_became_peered":"2021-10-08T19:28:40.150503+0000","last_unstale":"2021-10-08T19:44:07.435564+0000","last_undegraded":"2021-10-08T19:44:07.435564+0000","last_fullsized":"2021-10-08T19:44:07.435564+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":4,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:44:06.089022+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2021-10-08T19:44:06.089022+0000","last_clean_scrub_stamp":"2021-10-08T19:44:06.089022+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001932053,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"90'130","reported_seq":675,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.435343+0000","last_change":"2021-10-08T19:43:46.816862+0000","last_active":"2021-10-08T19:44:07.435343+0000","last_peered":"2021-10-08T19:44:07.435343+0000","last_clean":"2021-10-08T19:44:07.435343+0000","last_became_active":"2021-10-08T19:28:43.178371+0000","last_became_peered":"2021-10-08T19:28:43.178371+0000","last_unstale":"2021-10-08T19:44:07.435343+0000","last_undegraded":"2021-10-08T19:44:07.435343+0000","last_fullsized":"2021-10-08T19:44:07.435343+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:43:46.816760+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:34:13.653248+0000","last_clean_scrub_stamp":"2021-10-08T19:43:46.816760+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001916423,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":298,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.668538+0000","last_change":"2021-10-08T19:43:36.697575+0000","last_active":"2021-10-08T19:44:07.668538+0000","last_peered":"2021-10-08T19:44:07.668538+0000","last_clean":"2021-10-08T19:44:07.668538+0000","last_became_active":"2021-10-08T19:31:22.783759+0000","last_became_peered":"2021-10-08T19:31:22.783759+0000","last_unstale":"2021-10-08T19:44:07.668538+0000","last_undegraded":"2021-10-08T19:44:07.668538+0000","last_fullsized":"2021-10-08T19:44:07.668538+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:36.697477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:42:23.891779+0000","last_clean_scrub_stamp":"2021-10-08T19:43:36.697477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.022209505000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"482'36","reported_seq":651,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:10.225866+0000","last_change":"2021-10-08T19:44:10.225682+0000","last_active":"2021-10-08T19:44:10.225866+0000","last_peered":"2021-10-08T19:44:10.225866+0000","last_clean":"2021-10-08T19:44:10.225866+0000","last_became_active":"2021-10-08T19:32:45.154743+0000","last_became_peered":"2021-10-08T19:32:45.154743+0000","last_unstale":"2021-10-08T19:44:10.225866+0000","last_undegraded":"2021-10-08T19:44:10.225866+0000","last_fullsized":"2021-10-08T19:44:10.225866+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'36","last_scrub_stamp":"2021-10-08T19:44:10.225560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:44:10.225560+0000","log_size":36,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002873357,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":48,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":534,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:06.966165+0000","last_change":"2021-10-08T19:43:23.555051+0000","last_active":"2021-10-08T19:44:06.966165+0000","last_peered":"2021-10-08T19:44:06.966165+0000","last_clean":"2021-10-08T19:44:06.966165+0000","last_became_active":"2021-10-08T19:36:58.012034+0000","last_became_peered":"2021-10-08T19:36:58.012034+0000","last_unstale":"2021-10-08T19:44:06.966165+0000","last_undegraded":"2021-10-08T19:44:06.966165+0000","last_fullsized":"2021-10-08T19:44:06.966165+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:23.554955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:22.163674+0000","last_clean_scrub_stamp":"2021-10-08T19:43:23.554955+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0016886939999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":562,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:06.966696+0000","last_change":"2021-10-08T19:44:00.287365+0000","last_active":"2021-10-08T19:44:06.966696+0000","last_peered":"2021-10-08T19:44:06.966696+0000","last_clean":"2021-10-08T19:44:06.966696+0000","last_became_active":"2021-10-08T19:29:40.632010+0000","last_became_peered":"2021-10-08T19:29:40.632010+0000","last_unstale":"2021-10-08T19:44:06.966696+0000","last_undegraded":"2021-10-08T19:44:06.966696+0000","last_fullsized":"2021-10-08T19:44:06.966696+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:00.287278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:44:00.287278+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0018405209999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":274,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.435296+0000","last_change":"2021-10-08T19:43:43.798795+0000","last_active":"2021-10-08T19:44:07.435296+0000","last_peered":"2021-10-08T19:44:07.435296+0000","last_clean":"2021-10-08T19:44:07.435296+0000","last_became_active":"2021-10-08T19:31:51.673821+0000","last_became_peered":"2021-10-08T19:31:51.673821+0000","last_unstale":"2021-10-08T19:44:07.435296+0000","last_undegraded":"2021-10-08T19:44:07.435296+0000","last_fullsized":"2021-10-08T19:44:07.435296+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:43.798725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:21.644827+0000","last_clean_scrub_stamp":"2021-10-08T19:43:43.798725+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0017321769999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":522,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:42.780186+0000","last_change":"2021-10-08T19:44:42.779736+0000","last_active":"2021-10-08T19:44:42.780186+0000","last_peered":"2021-10-08T19:44:42.780186+0000","last_clean":"2021-10-08T19:44:42.780186+0000","last_became_active":"2021-10-08T19:21:27.636086+0000","last_became_peered":"2021-10-08T19:21:27.636086+0000","last_unstale":"2021-10-08T19:44:42.780186+0000","last_undegraded":"2021-10-08T19:44:42.780186+0000","last_fullsized":"2021-10-08T19:44:42.780186+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:42.779642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:44:42.779642+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0035086610000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"482'45","reported_seq":533,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.667138+0000","last_change":"2021-10-08T19:43:41.658768+0000","last_active":"2021-10-08T19:44:07.667138+0000","last_peered":"2021-10-08T19:44:07.667138+0000","last_clean":"2021-10-08T19:44:07.667138+0000","last_became_active":"2021-10-08T19:24:25.100384+0000","last_became_peered":"2021-10-08T19:24:25.100384+0000","last_unstale":"2021-10-08T19:44:07.667138+0000","last_undegraded":"2021-10-08T19:44:07.667138+0000","last_fullsized":"2021-10-08T19:44:07.667138+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'45","last_scrub_stamp":"2021-10-08T19:43:41.658672+0000","last_deep_scrub":"443'33","last_deep_scrub_stamp":"2021-10-08T19:39:26.350786+0000","last_clean_scrub_stamp":"2021-10-08T19:43:41.658672+0000","log_size":45,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002589025,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":60,"num_read_kb":50,"num_write":37,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"90'130","reported_seq":837,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.507340+0000","last_change":"2021-10-08T19:43:35.007656+0000","last_active":"2021-10-08T19:44:07.507340+0000","last_peered":"2021-10-08T19:44:07.507340+0000","last_clean":"2021-10-08T19:44:07.507340+0000","last_became_active":"2021-10-08T19:27:22.607289+0000","last_became_peered":"2021-10-08T19:27:22.607289+0000","last_unstale":"2021-10-08T19:44:07.507340+0000","last_undegraded":"2021-10-08T19:44:07.507340+0000","last_fullsized":"2021-10-08T19:44:07.507340+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:43:35.007540+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:43:35.007540+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0019949149999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":412,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.668159+0000","last_change":"2021-10-08T19:44:02.620350+0000","last_active":"2021-10-08T19:44:07.668159+0000","last_peered":"2021-10-08T19:44:07.668159+0000","last_clean":"2021-10-08T19:44:07.668159+0000","last_became_active":"2021-10-08T19:43:42.362318+0000","last_became_peered":"2021-10-08T19:43:42.362318+0000","last_unstale":"2021-10-08T19:44:07.668159+0000","last_undegraded":"2021-10-08T19:44:07.668159+0000","last_fullsized":"2021-10-08T19:44:07.668159+0000","mapping_epoch":520,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":521,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:02.620274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:44:02.620274+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034383669999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":332,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:36.247232+0000","last_change":"2021-10-08T19:44:36.246761+0000","last_active":"2021-10-08T19:44:36.247232+0000","last_peered":"2021-10-08T19:44:36.247232+0000","last_clean":"2021-10-08T19:44:36.247232+0000","last_became_active":"2021-10-08T19:29:40.638774+0000","last_became_peered":"2021-10-08T19:29:40.638774+0000","last_unstale":"2021-10-08T19:44:36.247232+0000","last_undegraded":"2021-10-08T19:44:36.247232+0000","last_fullsized":"2021-10-08T19:44:36.247232+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:36.246681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:44:36.246681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039073049999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":405,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.668760+0000","last_change":"2021-10-08T19:44:03.696492+0000","last_active":"2021-10-08T19:44:07.668760+0000","last_peered":"2021-10-08T19:44:07.668760+0000","last_clean":"2021-10-08T19:44:07.668760+0000","last_became_active":"2021-10-08T19:43:42.362294+0000","last_became_peered":"2021-10-08T19:43:42.362294+0000","last_unstale":"2021-10-08T19:44:07.668760+0000","last_undegraded":"2021-10-08T19:44:07.668760+0000","last_fullsized":"2021-10-08T19:44:07.668760+0000","mapping_epoch":520,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":521,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:03.696366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:44:03.696366+0000","last_clean_scrub_stamp":"2021-10-08T19:44:03.696366+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.094157303999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"90'130","reported_seq":843,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.507945+0000","last_change":"2021-10-08T19:44:06.037484+0000","last_active":"2021-10-08T19:44:07.507945+0000","last_peered":"2021-10-08T19:44:07.507945+0000","last_clean":"2021-10-08T19:44:07.507945+0000","last_became_active":"2021-10-08T19:27:26.591250+0000","last_became_peered":"2021-10-08T19:27:26.591250+0000","last_unstale":"2021-10-08T19:44:07.507945+0000","last_undegraded":"2021-10-08T19:44:07.507945+0000","last_fullsized":"2021-10-08T19:44:07.507945+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:44:06.037381+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:42:49.880376+0000","last_clean_scrub_stamp":"2021-10-08T19:44:06.037381+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0038755090000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":538,"reported_epoch":530,"state":"active+clean","last_fresh":"2021-10-08T19:44:47.330995+0000","last_change":"2021-10-08T19:44:47.330972+0000","last_active":"2021-10-08T19:44:47.330995+0000","last_peered":"2021-10-08T19:44:47.330995+0000","last_clean":"2021-10-08T19:44:47.330995+0000","last_became_active":"2021-10-08T19:21:27.637875+0000","last_became_peered":"2021-10-08T19:21:27.637875+0000","last_unstale":"2021-10-08T19:44:47.330995+0000","last_undegraded":"2021-10-08T19:44:47.330995+0000","last_fullsized":"2021-10-08T19:44:47.330995+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:47.330907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:20.092069+0000","last_clean_scrub_stamp":"2021-10-08T19:44:47.330907+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034754780000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"482'21","reported_seq":286,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.435498+0000","last_change":"2021-10-08T19:43:17.539850+0000","last_active":"2021-10-08T19:44:07.435498+0000","last_peered":"2021-10-08T19:44:07.435498+0000","last_clean":"2021-10-08T19:44:07.435498+0000","last_became_active":"2021-10-08T19:31:51.674965+0000","last_became_peered":"2021-10-08T19:31:51.674965+0000","last_unstale":"2021-10-08T19:44:07.435498+0000","last_undegraded":"2021-10-08T19:44:07.435498+0000","last_fullsized":"2021-10-08T19:44:07.435498+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'21","last_scrub_stamp":"2021-10-08T19:43:17.539762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:43:17.539762+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0044519049999999999,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":29,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":990,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":571,"reported_epoch":530,"state":"active+clean","last_fresh":"2021-10-08T19:44:46.293291+0000","last_change":"2021-10-08T19:44:46.293246+0000","last_active":"2021-10-08T19:44:46.293291+0000","last_peered":"2021-10-08T19:44:46.293291+0000","last_clean":"2021-10-08T19:44:46.293291+0000","last_became_active":"2021-10-08T19:36:58.015216+0000","last_became_peered":"2021-10-08T19:36:58.015216+0000","last_unstale":"2021-10-08T19:44:46.293291+0000","last_undegraded":"2021-10-08T19:44:46.293291+0000","last_fullsized":"2021-10-08T19:44:46.293291+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:46.293120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:43:20.421882+0000","last_clean_scrub_stamp":"2021-10-08T19:44:46.293120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0018932739999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"70'5","reported_seq":378,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.435023+0000","last_change":"2021-10-08T19:43:44.780066+0000","last_active":"2021-10-08T19:44:07.435023+0000","last_peered":"2021-10-08T19:44:07.435023+0000","last_clean":"2021-10-08T19:44:07.435023+0000","last_became_active":"2021-10-08T19:28:40.148054+0000","last_became_peered":"2021-10-08T19:28:40.148054+0000","last_unstale":"2021-10-08T19:44:07.435023+0000","last_undegraded":"2021-10-08T19:44:07.435023+0000","last_fullsized":"2021-10-08T19:44:07.435023+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:43:44.779965+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2021-10-08T19:43:44.779965+0000","last_clean_scrub_stamp":"2021-10-08T19:43:44.779965+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002218093,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":550,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.507885+0000","last_change":"2021-10-08T19:43:27.069655+0000","last_active":"2021-10-08T19:44:07.507885+0000","last_peered":"2021-10-08T19:44:07.507885+0000","last_clean":"2021-10-08T19:44:07.507885+0000","last_became_active":"2021-10-08T19:29:40.652528+0000","last_became_peered":"2021-10-08T19:29:40.652528+0000","last_unstale":"2021-10-08T19:44:07.507885+0000","last_undegraded":"2021-10-08T19:44:07.507885+0000","last_fullsized":"2021-10-08T19:44:07.507885+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:27.069527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:43:27.069527+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.039835228,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"90'130","reported_seq":563,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.666316+0000","last_change":"2021-10-08T19:43:42.355766+0000","last_active":"2021-10-08T19:44:07.666316+0000","last_peered":"2021-10-08T19:44:07.666316+0000","last_clean":"2021-10-08T19:44:07.666316+0000","last_became_active":"2021-10-08T19:43:42.355280+0000","last_became_peered":"2021-10-08T19:43:42.355280+0000","last_unstale":"2021-10-08T19:44:07.666316+0000","last_undegraded":"2021-10-08T19:44:07.666316+0000","last_fullsized":"2021-10-08T19:44:07.666316+0000","mapping_epoch":520,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":521,"parent":"0.0","parent_split_bits":4,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:43:32.243834+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:43:32.243834+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001876345,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,2],"acting":[5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":544,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:14.239840+0000","last_change":"2021-10-08T19:44:14.239693+0000","last_active":"2021-10-08T19:44:14.239840+0000","last_peered":"2021-10-08T19:44:14.239840+0000","last_clean":"2021-10-08T19:44:14.239840+0000","last_became_active":"2021-10-08T19:28:40.133414+0000","last_became_peered":"2021-10-08T19:28:40.133414+0000","last_unstale":"2021-10-08T19:44:14.239840+0000","last_undegraded":"2021-10-08T19:44:14.239840+0000","last_fullsized":"2021-10-08T19:44:14.239840+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:14.239615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:44:14.239615+0000","last_clean_scrub_stamp":"2021-10-08T19:44:14.239615+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001652913,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"482'56","reported_seq":693,"reported_epoch":530,"state":"active+clean","last_fresh":"2021-10-08T19:44:44.503248+0000","last_change":"2021-10-08T19:44:43.972702+0000","last_active":"2021-10-08T19:44:44.503248+0000","last_peered":"2021-10-08T19:44:44.503248+0000","last_clean":"2021-10-08T19:44:44.503248+0000","last_became_active":"2021-10-08T19:29:40.626138+0000","last_became_peered":"2021-10-08T19:29:40.626138+0000","last_unstale":"2021-10-08T19:44:44.503248+0000","last_undegraded":"2021-10-08T19:44:44.503248+0000","last_fullsized":"2021-10-08T19:44:44.503248+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'56","last_scrub_stamp":"2021-10-08T19:44:43.972623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:44:43.972623+0000","log_size":56,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0027913030000000002,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":83,"num_read_kb":68,"num_write":50,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":1432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":438,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.666527+0000","last_change":"2021-10-08T19:43:59.691595+0000","last_active":"2021-10-08T19:44:07.666527+0000","last_peered":"2021-10-08T19:44:07.666527+0000","last_clean":"2021-10-08T19:44:07.666527+0000","last_became_active":"2021-10-08T19:43:42.363317+0000","last_became_peered":"2021-10-08T19:43:42.363317+0000","last_unstale":"2021-10-08T19:44:07.666527+0000","last_undegraded":"2021-10-08T19:44:07.666527+0000","last_fullsized":"2021-10-08T19:44:07.666527+0000","mapping_epoch":520,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":521,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:59.691516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:49.623545+0000","last_clean_scrub_stamp":"2021-10-08T19:43:59.691516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0017733060000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":334,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.505477+0000","last_change":"2021-10-08T19:44:03.500360+0000","last_active":"2021-10-08T19:44:07.505477+0000","last_peered":"2021-10-08T19:44:07.505477+0000","last_clean":"2021-10-08T19:44:07.505477+0000","last_became_active":"2021-10-08T19:29:40.637371+0000","last_became_peered":"2021-10-08T19:29:40.637371+0000","last_unstale":"2021-10-08T19:44:07.505477+0000","last_undegraded":"2021-10-08T19:44:07.505477+0000","last_fullsized":"2021-10-08T19:44:07.505477+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:03.500262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:41:28.269002+0000","last_clean_scrub_stamp":"2021-10-08T19:44:03.500262+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0065337579999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":481,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:21.248576+0000","last_change":"2021-10-08T19:44:21.248168+0000","last_active":"2021-10-08T19:44:21.248576+0000","last_peered":"2021-10-08T19:44:21.248576+0000","last_clean":"2021-10-08T19:44:21.248576+0000","last_became_active":"2021-10-08T19:25:14.550690+0000","last_became_peered":"2021-10-08T19:25:14.550690+0000","last_unstale":"2021-10-08T19:44:21.248576+0000","last_undegraded":"2021-10-08T19:44:21.248576+0000","last_fullsized":"2021-10-08T19:44:21.248576+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:21.248049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:36:09.181866+0000","last_clean_scrub_stamp":"2021-10-08T19:44:21.248049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034333340000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.7","version":"90'130","reported_seq":803,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:17.613967+0000","last_change":"2021-10-08T19:44:17.613810+0000","last_active":"2021-10-08T19:44:17.613967+0000","last_peered":"2021-10-08T19:44:17.613967+0000","last_clean":"2021-10-08T19:44:17.613967+0000","last_became_active":"2021-10-08T19:29:43.636820+0000","last_became_peered":"2021-10-08T19:29:43.636820+0000","last_unstale":"2021-10-08T19:44:17.613967+0000","last_undegraded":"2021-10-08T19:44:17.613967+0000","last_fullsized":"2021-10-08T19:44:17.613967+0000","mapping_epoch":239,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":3,"last_scrub":"90'130","last_scrub_stamp":"2021-10-08T19:44:17.613738+0000","last_deep_scrub":"90'130","last_deep_scrub_stamp":"2021-10-08T19:23:28.284249+0000","last_clean_scrub_stamp":"2021-10-08T19:44:17.613738+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001717189,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"114'10","reported_seq":846,"reported_epoch":530,"state":"active+clean","last_fresh":"2021-10-08T19:44:44.345412+0000","last_change":"2021-10-08T19:44:25.233642+0000","last_active":"2021-10-08T19:44:44.345412+0000","last_peered":"2021-10-08T19:44:44.345412+0000","last_clean":"2021-10-08T19:44:44.345412+0000","last_became_active":"2021-10-08T19:24:25.106695+0000","last_became_peered":"2021-10-08T19:24:25.106695+0000","last_unstale":"2021-10-08T19:44:44.345412+0000","last_undegraded":"2021-10-08T19:44:44.345412+0000","last_fullsized":"2021-10-08T19:44:44.345412+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'10","last_scrub_stamp":"2021-10-08T19:44:25.233559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:44:25.233559+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0022387990000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"482'30","reported_seq":301,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:26.891929+0000","last_change":"2021-10-08T19:44:26.891812+0000","last_active":"2021-10-08T19:44:26.891929+0000","last_peered":"2021-10-08T19:44:26.891929+0000","last_clean":"2021-10-08T19:44:26.891929+0000","last_became_active":"2021-10-08T19:31:51.675569+0000","last_became_peered":"2021-10-08T19:31:51.675569+0000","last_unstale":"2021-10-08T19:44:26.891929+0000","last_undegraded":"2021-10-08T19:44:26.891929+0000","last_fullsized":"2021-10-08T19:44:26.891929+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'30","last_scrub_stamp":"2021-10-08T19:44:26.891733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:44:26.891733+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002589835,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":38,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":381,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.435318+0000","last_change":"2021-10-08T19:43:32.662404+0000","last_active":"2021-10-08T19:44:07.435318+0000","last_peered":"2021-10-08T19:44:07.435318+0000","last_clean":"2021-10-08T19:44:07.435318+0000","last_became_active":"2021-10-08T19:36:58.013921+0000","last_became_peered":"2021-10-08T19:36:58.013921+0000","last_unstale":"2021-10-08T19:44:07.435318+0000","last_undegraded":"2021-10-08T19:44:07.435318+0000","last_fullsized":"2021-10-08T19:44:07.435318+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":392,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:32.662322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:45.612819+0000","last_clean_scrub_stamp":"2021-10-08T19:43:32.662322+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0018789329999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":546,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:12.298183+0000","last_change":"2021-10-08T19:44:12.298071+0000","last_active":"2021-10-08T19:44:12.298183+0000","last_peered":"2021-10-08T19:44:12.298183+0000","last_clean":"2021-10-08T19:44:12.298183+0000","last_became_active":"2021-10-08T19:29:40.643614+0000","last_became_peered":"2021-10-08T19:29:40.643614+0000","last_unstale":"2021-10-08T19:44:12.298183+0000","last_undegraded":"2021-10-08T19:44:12.298183+0000","last_fullsized":"2021-10-08T19:44:12.298183+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:12.297973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:40:49.951046+0000","last_clean_scrub_stamp":"2021-10-08T19:44:12.297973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.043712507999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":369,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.668411+0000","last_change":"2021-10-08T19:43:58.695557+0000","last_active":"2021-10-08T19:44:07.668411+0000","last_peered":"2021-10-08T19:44:07.668411+0000","last_clean":"2021-10-08T19:44:07.668411+0000","last_became_active":"2021-10-08T19:43:42.356866+0000","last_became_peered":"2021-10-08T19:43:42.356866+0000","last_unstale":"2021-10-08T19:44:07.668411+0000","last_undegraded":"2021-10-08T19:44:07.668411+0000","last_fullsized":"2021-10-08T19:44:07.668411+0000","mapping_epoch":520,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":521,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:58.695454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:43:58.695454+0000","last_clean_scrub_stamp":"2021-10-08T19:43:58.695454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034599510000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":554,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:18.481582+0000","last_change":"2021-10-08T19:44:18.481465+0000","last_active":"2021-10-08T19:44:18.481582+0000","last_peered":"2021-10-08T19:44:18.481582+0000","last_clean":"2021-10-08T19:44:18.481582+0000","last_became_active":"2021-10-08T19:28:40.138726+0000","last_became_peered":"2021-10-08T19:28:40.138726+0000","last_unstale":"2021-10-08T19:44:18.481582+0000","last_undegraded":"2021-10-08T19:44:18.481582+0000","last_fullsized":"2021-10-08T19:44:18.481582+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:18.481390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:44:18.481390+0000","last_clean_scrub_stamp":"2021-10-08T19:44:18.481390+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001319691,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"482'24","reported_seq":644,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:25.244054+0000","last_change":"2021-10-08T19:44:25.243627+0000","last_active":"2021-10-08T19:44:25.244054+0000","last_peered":"2021-10-08T19:44:25.244054+0000","last_clean":"2021-10-08T19:44:25.244054+0000","last_became_active":"2021-10-08T19:29:40.638957+0000","last_became_peered":"2021-10-08T19:29:40.638957+0000","last_unstale":"2021-10-08T19:44:25.244054+0000","last_undegraded":"2021-10-08T19:44:25.244054+0000","last_fullsized":"2021-10-08T19:44:25.244054+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'24","last_scrub_stamp":"2021-10-08T19:44:25.243540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:44:25.243540+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0041699679999999996,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"61'2","reported_seq":535,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:06.966508+0000","last_change":"2021-10-08T19:43:26.903114+0000","last_active":"2021-10-08T19:44:06.966508+0000","last_peered":"2021-10-08T19:44:06.966508+0000","last_clean":"2021-10-08T19:44:06.966508+0000","last_became_active":"2021-10-08T19:21:23.603614+0000","last_became_peered":"2021-10-08T19:21:23.603614+0000","last_unstale":"2021-10-08T19:44:06.966508+0000","last_undegraded":"2021-10-08T19:44:06.966508+0000","last_fullsized":"2021-10-08T19:44:06.966508+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'2","last_scrub_stamp":"2021-10-08T19:43:26.903007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:43:26.903007+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001771749,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":334,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:40.403144+0000","last_change":"2021-10-08T19:44:40.402748+0000","last_active":"2021-10-08T19:44:40.403144+0000","last_peered":"2021-10-08T19:44:40.403144+0000","last_clean":"2021-10-08T19:44:40.403144+0000","last_became_active":"2021-10-08T19:29:40.645211+0000","last_became_peered":"2021-10-08T19:29:40.645211+0000","last_unstale":"2021-10-08T19:44:40.403144+0000","last_undegraded":"2021-10-08T19:44:40.403144+0000","last_fullsized":"2021-10-08T19:44:40.403144+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:40.402627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:44:40.402627+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.11534380900000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":461,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:33.952925+0000","last_change":"2021-10-08T19:44:33.952787+0000","last_active":"2021-10-08T19:44:33.952925+0000","last_peered":"2021-10-08T19:44:33.952925+0000","last_clean":"2021-10-08T19:44:33.952925+0000","last_became_active":"2021-10-08T19:28:40.100770+0000","last_became_peered":"2021-10-08T19:28:40.100770+0000","last_unstale":"2021-10-08T19:44:33.952925+0000","last_undegraded":"2021-10-08T19:44:33.952925+0000","last_fullsized":"2021-10-08T19:44:33.952925+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:33.952700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:43:05.053806+0000","last_clean_scrub_stamp":"2021-10-08T19:44:33.952700+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001614004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"482'21","reported_seq":602,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:06.968347+0000","last_change":"2021-10-08T19:43:50.286856+0000","last_active":"2021-10-08T19:44:06.968347+0000","last_peered":"2021-10-08T19:44:06.968347+0000","last_clean":"2021-10-08T19:44:06.968347+0000","last_became_active":"2021-10-08T19:29:40.644354+0000","last_became_peered":"2021-10-08T19:29:40.644354+0000","last_unstale":"2021-10-08T19:44:06.968347+0000","last_undegraded":"2021-10-08T19:44:06.968347+0000","last_fullsized":"2021-10-08T19:44:06.968347+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'21","last_scrub_stamp":"2021-10-08T19:43:50.286775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:43:50.286775+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0023922610000000001,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":566,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:24.421035+0000","last_change":"2021-10-08T19:44:24.420906+0000","last_active":"2021-10-08T19:44:24.421035+0000","last_peered":"2021-10-08T19:44:24.421035+0000","last_clean":"2021-10-08T19:44:24.421035+0000","last_became_active":"2021-10-08T19:28:40.139234+0000","last_became_peered":"2021-10-08T19:28:40.139234+0000","last_unstale":"2021-10-08T19:44:24.421035+0000","last_undegraded":"2021-10-08T19:44:24.421035+0000","last_fullsized":"2021-10-08T19:44:24.421035+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:24.420831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:44:24.420831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0014914800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":332,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:09.458230+0000","last_change":"2021-10-08T19:44:09.458119+0000","last_active":"2021-10-08T19:44:09.458230+0000","last_peered":"2021-10-08T19:44:09.458230+0000","last_clean":"2021-10-08T19:44:09.458230+0000","last_became_active":"2021-10-08T19:29:40.645111+0000","last_became_peered":"2021-10-08T19:29:40.645111+0000","last_unstale":"2021-10-08T19:44:09.458230+0000","last_undegraded":"2021-10-08T19:44:09.458230+0000","last_fullsized":"2021-10-08T19:44:09.458230+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:09.458038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:44:09.458038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.00158056,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":532,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:23.445887+0000","last_change":"2021-10-08T19:44:23.445384+0000","last_active":"2021-10-08T19:44:23.445887+0000","last_peered":"2021-10-08T19:44:23.445887+0000","last_clean":"2021-10-08T19:44:23.445887+0000","last_became_active":"2021-10-08T19:21:29.640674+0000","last_became_peered":"2021-10-08T19:21:29.640674+0000","last_unstale":"2021-10-08T19:44:23.445887+0000","last_undegraded":"2021-10-08T19:44:23.445887+0000","last_fullsized":"2021-10-08T19:44:23.445887+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:23.445313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:40:02.107943+0000","last_clean_scrub_stamp":"2021-10-08T19:44:23.445313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034294149999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":447,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.507301+0000","last_change":"2021-10-08T19:43:26.001362+0000","last_active":"2021-10-08T19:44:07.507301+0000","last_peered":"2021-10-08T19:44:07.507301+0000","last_clean":"2021-10-08T19:44:07.507301+0000","last_became_active":"2021-10-08T19:25:15.501118+0000","last_became_peered":"2021-10-08T19:25:15.501118+0000","last_unstale":"2021-10-08T19:44:07.507301+0000","last_undegraded":"2021-10-08T19:44:07.507301+0000","last_fullsized":"2021-10-08T19:44:07.507301+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:26.001289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:43:26.001289+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0014320649999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"529'21","reported_seq":367,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:39.301078+0000","last_change":"2021-10-08T19:44:39.300975+0000","last_active":"2021-10-08T19:44:39.301078+0000","last_peered":"2021-10-08T19:44:39.301078+0000","last_clean":"2021-10-08T19:44:39.301078+0000","last_became_active":"2021-10-08T19:29:40.644657+0000","last_became_peered":"2021-10-08T19:29:40.644657+0000","last_unstale":"2021-10-08T19:44:39.301078+0000","last_undegraded":"2021-10-08T19:44:39.301078+0000","last_fullsized":"2021-10-08T19:44:39.301078+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"529'21","last_scrub_stamp":"2021-10-08T19:44:39.300908+0000","last_deep_scrub":"529'21","last_deep_scrub_stamp":"2021-10-08T19:44:39.300908+0000","last_clean_scrub_stamp":"2021-10-08T19:44:39.300908+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0036883770000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":27,"num_read_kb":24,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":494,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:14.609517+0000","last_change":"2021-10-08T19:44:14.609324+0000","last_active":"2021-10-08T19:44:14.609517+0000","last_peered":"2021-10-08T19:44:14.609517+0000","last_clean":"2021-10-08T19:44:14.609517+0000","last_became_active":"2021-10-08T19:28:40.101898+0000","last_became_peered":"2021-10-08T19:28:40.101898+0000","last_unstale":"2021-10-08T19:44:14.609517+0000","last_undegraded":"2021-10-08T19:44:14.609517+0000","last_fullsized":"2021-10-08T19:44:14.609517+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:14.609230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:44:14.609230+0000","last_clean_scrub_stamp":"2021-10-08T19:44:14.609230+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001907066,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":425,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.668810+0000","last_change":"2021-10-08T19:43:53.793211+0000","last_active":"2021-10-08T19:44:07.668810+0000","last_peered":"2021-10-08T19:44:07.668810+0000","last_clean":"2021-10-08T19:44:07.668810+0000","last_became_active":"2021-10-08T19:43:42.363001+0000","last_became_peered":"2021-10-08T19:43:42.363001+0000","last_unstale":"2021-10-08T19:44:07.668810+0000","last_undegraded":"2021-10-08T19:44:07.668810+0000","last_fullsized":"2021-10-08T19:44:07.668810+0000","mapping_epoch":520,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":521,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:53.793114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:43:53.793114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034425800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":538,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.507666+0000","last_change":"2021-10-08T19:43:31.025106+0000","last_active":"2021-10-08T19:44:07.507666+0000","last_peered":"2021-10-08T19:44:07.507666+0000","last_clean":"2021-10-08T19:44:07.507666+0000","last_became_active":"2021-10-08T19:24:25.099371+0000","last_became_peered":"2021-10-08T19:24:25.099371+0000","last_unstale":"2021-10-08T19:44:07.507666+0000","last_undegraded":"2021-10-08T19:44:07.507666+0000","last_fullsized":"2021-10-08T19:44:07.507666+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:31.024998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:43:31.024998+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.034141114,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"70'5","reported_seq":731,"reported_epoch":530,"state":"active+clean","last_fresh":"2021-10-08T19:44:44.855894+0000","last_change":"2021-10-08T19:44:44.855855+0000","last_active":"2021-10-08T19:44:44.855894+0000","last_peered":"2021-10-08T19:44:44.855894+0000","last_clean":"2021-10-08T19:44:44.855894+0000","last_became_active":"2021-10-08T19:31:22.785193+0000","last_became_peered":"2021-10-08T19:31:22.785193+0000","last_unstale":"2021-10-08T19:44:44.855894+0000","last_undegraded":"2021-10-08T19:44:44.855894+0000","last_fullsized":"2021-10-08T19:44:44.855894+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":5,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:44:44.855741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:44:44.855741+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001780439,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"482'30","reported_seq":412,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.505032+0000","last_change":"2021-10-08T19:43:08.355257+0000","last_active":"2021-10-08T19:44:07.505032+0000","last_peered":"2021-10-08T19:44:07.505032+0000","last_clean":"2021-10-08T19:44:07.505032+0000","last_became_active":"2021-10-08T19:31:51.677055+0000","last_became_peered":"2021-10-08T19:31:51.677055+0000","last_unstale":"2021-10-08T19:44:07.505032+0000","last_undegraded":"2021-10-08T19:44:07.505032+0000","last_fullsized":"2021-10-08T19:44:07.505032+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'30","last_scrub_stamp":"2021-10-08T19:43:08.355175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:43:08.355175+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0042544920000000003,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":39,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":411,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.666446+0000","last_change":"2021-10-08T19:43:43.874219+0000","last_active":"2021-10-08T19:44:07.666446+0000","last_peered":"2021-10-08T19:44:07.666446+0000","last_clean":"2021-10-08T19:44:07.666446+0000","last_became_active":"2021-10-08T19:43:42.361387+0000","last_became_peered":"2021-10-08T19:43:42.361387+0000","last_unstale":"2021-10-08T19:44:07.666446+0000","last_undegraded":"2021-10-08T19:44:07.666446+0000","last_fullsized":"2021-10-08T19:44:07.666446+0000","mapping_epoch":520,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":521,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:43.874111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:43:43.874111+0000","last_clean_scrub_stamp":"2021-10-08T19:43:43.874111+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001658964,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,2],"acting":[5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"521'13","reported_seq":636,"reported_epoch":530,"state":"active+clean","last_fresh":"2021-10-08T19:44:44.324959+0000","last_change":"2021-10-08T19:44:06.653632+0000","last_active":"2021-10-08T19:44:44.324959+0000","last_peered":"2021-10-08T19:44:44.324959+0000","last_clean":"2021-10-08T19:44:44.324959+0000","last_became_active":"2021-10-08T19:43:42.364023+0000","last_became_peered":"2021-10-08T19:43:42.364023+0000","last_unstale":"2021-10-08T19:44:44.324959+0000","last_undegraded":"2021-10-08T19:44:44.324959+0000","last_fullsized":"2021-10-08T19:44:44.324959+0000","mapping_epoch":520,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":521,"parent":"0.0","parent_split_bits":0,"last_scrub":"521'13","last_scrub_stamp":"2021-10-08T19:44:06.653539+0000","last_deep_scrub":"328'11","last_deep_scrub_stamp":"2021-10-08T19:33:32.545870+0000","last_clean_scrub_stamp":"2021-10-08T19:44:06.653539+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039457989999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":540,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:21.194355+0000","last_change":"2021-10-08T19:44:21.194000+0000","last_active":"2021-10-08T19:44:21.194355+0000","last_peered":"2021-10-08T19:44:21.194355+0000","last_clean":"2021-10-08T19:44:21.194355+0000","last_became_active":"2021-10-08T19:29:40.644819+0000","last_became_peered":"2021-10-08T19:29:40.644819+0000","last_unstale":"2021-10-08T19:44:21.194355+0000","last_undegraded":"2021-10-08T19:44:21.194355+0000","last_fullsized":"2021-10-08T19:44:21.194355+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:21.193888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:40:11.028298+0000","last_clean_scrub_stamp":"2021-10-08T19:44:21.193888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.044088605000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":449,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:35.900619+0000","last_change":"2021-10-08T19:44:35.900175+0000","last_active":"2021-10-08T19:44:35.900619+0000","last_peered":"2021-10-08T19:44:35.900619+0000","last_clean":"2021-10-08T19:44:35.900619+0000","last_became_active":"2021-10-08T19:25:15.498770+0000","last_became_peered":"2021-10-08T19:25:15.498770+0000","last_unstale":"2021-10-08T19:44:35.900619+0000","last_undegraded":"2021-10-08T19:44:35.900619+0000","last_fullsized":"2021-10-08T19:44:35.900619+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:35.900070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:44:35.900070+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0035205639999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"482'21","reported_seq":168,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:22.450358+0000","last_change":"2021-10-08T19:44:22.449885+0000","last_active":"2021-10-08T19:44:22.450358+0000","last_peered":"2021-10-08T19:44:22.450358+0000","last_clean":"2021-10-08T19:44:22.450358+0000","last_became_active":"2021-10-08T19:43:42.361269+0000","last_became_peered":"2021-10-08T19:43:42.361269+0000","last_unstale":"2021-10-08T19:44:22.450358+0000","last_undegraded":"2021-10-08T19:44:22.450358+0000","last_fullsized":"2021-10-08T19:44:22.450358+0000","mapping_epoch":520,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":521,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'21","last_scrub_stamp":"2021-10-08T19:44:22.449806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:44:22.449806+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039632490000000003,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":33,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":558,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:44.125345+0000","last_change":"2021-10-08T19:44:44.125208+0000","last_active":"2021-10-08T19:44:44.125345+0000","last_peered":"2021-10-08T19:44:44.125345+0000","last_clean":"2021-10-08T19:44:44.125345+0000","last_became_active":"2021-10-08T19:29:44.439397+0000","last_became_peered":"2021-10-08T19:29:44.439397+0000","last_unstale":"2021-10-08T19:44:44.125345+0000","last_undegraded":"2021-10-08T19:44:44.125345+0000","last_fullsized":"2021-10-08T19:44:44.125345+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:44.125111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:44:44.125111+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001742106,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"413'11","reported_seq":521,"reported_epoch":530,"state":"active+clean","last_fresh":"2021-10-08T19:44:44.326629+0000","last_change":"2021-10-08T19:44:07.507331+0000","last_active":"2021-10-08T19:44:44.326629+0000","last_peered":"2021-10-08T19:44:44.326629+0000","last_clean":"2021-10-08T19:44:44.326629+0000","last_became_active":"2021-10-08T19:29:40.637650+0000","last_became_peered":"2021-10-08T19:29:40.637650+0000","last_unstale":"2021-10-08T19:44:44.326629+0000","last_undegraded":"2021-10-08T19:44:44.326629+0000","last_fullsized":"2021-10-08T19:44:44.326629+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"413'11","last_scrub_stamp":"2021-10-08T19:44:07.507258+0000","last_deep_scrub":"413'11","last_deep_scrub_stamp":"2021-10-08T19:44:07.507258+0000","last_clean_scrub_stamp":"2021-10-08T19:44:07.507258+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0046863729999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":513,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:06.966732+0000","last_change":"2021-10-08T19:43:45.182184+0000","last_active":"2021-10-08T19:44:06.966732+0000","last_peered":"2021-10-08T19:44:06.966732+0000","last_clean":"2021-10-08T19:44:06.966732+0000","last_became_active":"2021-10-08T19:21:29.640302+0000","last_became_peered":"2021-10-08T19:21:29.640302+0000","last_unstale":"2021-10-08T19:44:06.966732+0000","last_undegraded":"2021-10-08T19:44:06.966732+0000","last_fullsized":"2021-10-08T19:44:06.966732+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:45.182074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:43:45.182074+0000","last_clean_scrub_stamp":"2021-10-08T19:43:45.182074+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.11619307600000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":461,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:06.968327+0000","last_change":"2021-10-08T19:43:30.271451+0000","last_active":"2021-10-08T19:44:06.968327+0000","last_peered":"2021-10-08T19:44:06.968327+0000","last_clean":"2021-10-08T19:44:06.968327+0000","last_became_active":"2021-10-08T19:29:40.631374+0000","last_became_peered":"2021-10-08T19:29:40.631374+0000","last_unstale":"2021-10-08T19:44:06.968327+0000","last_undegraded":"2021-10-08T19:44:06.968327+0000","last_fullsized":"2021-10-08T19:44:06.968327+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:30.271366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:43:30.271366+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001939503,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":463,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.507620+0000","last_change":"2021-10-08T19:43:38.882738+0000","last_active":"2021-10-08T19:44:07.507620+0000","last_peered":"2021-10-08T19:44:07.507620+0000","last_clean":"2021-10-08T19:44:07.507620+0000","last_became_active":"2021-10-08T19:29:40.652966+0000","last_became_peered":"2021-10-08T19:29:40.652966+0000","last_unstale":"2021-10-08T19:44:07.507620+0000","last_undegraded":"2021-10-08T19:44:07.507620+0000","last_fullsized":"2021-10-08T19:44:07.507620+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:38.882647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:43:38.882647+0000","last_clean_scrub_stamp":"2021-10-08T19:43:38.882647+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0056038829999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"482'25","reported_seq":295,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:18.967565+0000","last_change":"2021-10-08T19:44:18.967433+0000","last_active":"2021-10-08T19:44:18.967565+0000","last_peered":"2021-10-08T19:44:18.967565+0000","last_clean":"2021-10-08T19:44:18.967565+0000","last_became_active":"2021-10-08T19:31:51.676961+0000","last_became_peered":"2021-10-08T19:31:51.676961+0000","last_unstale":"2021-10-08T19:44:18.967565+0000","last_undegraded":"2021-10-08T19:44:18.967565+0000","last_fullsized":"2021-10-08T19:44:18.967565+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'25","last_scrub_stamp":"2021-10-08T19:44:18.967342+0000","last_deep_scrub":"289'19","last_deep_scrub_stamp":"2021-10-08T19:32:46.539792+0000","last_clean_scrub_stamp":"2021-10-08T19:44:18.967342+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0021871439999999998,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":28,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":510,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.667068+0000","last_change":"2021-10-08T19:43:36.614267+0000","last_active":"2021-10-08T19:44:07.667068+0000","last_peered":"2021-10-08T19:44:07.667068+0000","last_clean":"2021-10-08T19:44:07.667068+0000","last_became_active":"2021-10-08T19:31:22.786651+0000","last_became_peered":"2021-10-08T19:31:22.786651+0000","last_unstale":"2021-10-08T19:44:07.667068+0000","last_undegraded":"2021-10-08T19:44:07.667068+0000","last_fullsized":"2021-10-08T19:44:07.667068+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:36.614176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:43:36.614176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0016601840000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":336,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:13.455724+0000","last_change":"2021-10-08T19:44:13.455238+0000","last_active":"2021-10-08T19:44:13.455724+0000","last_peered":"2021-10-08T19:44:13.455724+0000","last_clean":"2021-10-08T19:44:13.455724+0000","last_became_active":"2021-10-08T19:29:40.644770+0000","last_became_peered":"2021-10-08T19:29:40.644770+0000","last_unstale":"2021-10-08T19:44:13.455724+0000","last_undegraded":"2021-10-08T19:44:13.455724+0000","last_fullsized":"2021-10-08T19:44:13.455724+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:13.455165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:06.367259+0000","last_clean_scrub_stamp":"2021-10-08T19:44:13.455165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003431501,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":542,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:06.968692+0000","last_change":"2021-10-08T19:43:59.322065+0000","last_active":"2021-10-08T19:44:06.968692+0000","last_peered":"2021-10-08T19:44:06.968692+0000","last_clean":"2021-10-08T19:44:06.968692+0000","last_became_active":"2021-10-08T19:28:40.133744+0000","last_became_peered":"2021-10-08T19:28:40.133744+0000","last_unstale":"2021-10-08T19:44:06.968692+0000","last_undegraded":"2021-10-08T19:44:06.968692+0000","last_fullsized":"2021-10-08T19:44:06.968692+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:59.321972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:43:59.321972+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.038212232999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"482'27","reported_seq":685,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:33.269762+0000","last_change":"2021-10-08T19:44:33.269293+0000","last_active":"2021-10-08T19:44:33.269762+0000","last_peered":"2021-10-08T19:44:33.269762+0000","last_clean":"2021-10-08T19:44:33.269762+0000","last_became_active":"2021-10-08T19:28:40.100196+0000","last_became_peered":"2021-10-08T19:28:40.100196+0000","last_unstale":"2021-10-08T19:44:33.269762+0000","last_undegraded":"2021-10-08T19:44:33.269762+0000","last_fullsized":"2021-10-08T19:44:33.269762+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'27","last_scrub_stamp":"2021-10-08T19:44:33.269208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:44:33.269208+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040027709999999996,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":380,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:09.059942+0000","last_change":"2021-10-08T19:44:09.059458+0000","last_active":"2021-10-08T19:44:09.059942+0000","last_peered":"2021-10-08T19:44:09.059942+0000","last_clean":"2021-10-08T19:44:09.059942+0000","last_became_active":"2021-10-08T19:28:40.146673+0000","last_became_peered":"2021-10-08T19:28:40.146673+0000","last_unstale":"2021-10-08T19:44:09.059942+0000","last_undegraded":"2021-10-08T19:44:09.059942+0000","last_fullsized":"2021-10-08T19:44:09.059942+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:09.059388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:09.610637+0000","last_clean_scrub_stamp":"2021-10-08T19:44:09.059388+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034079589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":390,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.435070+0000","last_change":"2021-10-08T19:43:48.807796+0000","last_active":"2021-10-08T19:44:07.435070+0000","last_peered":"2021-10-08T19:44:07.435070+0000","last_clean":"2021-10-08T19:44:07.435070+0000","last_became_active":"2021-10-08T19:29:40.638536+0000","last_became_peered":"2021-10-08T19:29:40.638536+0000","last_unstale":"2021-10-08T19:44:07.435070+0000","last_undegraded":"2021-10-08T19:44:07.435070+0000","last_fullsized":"2021-10-08T19:44:07.435070+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:48.807716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:43.186684+0000","last_clean_scrub_stamp":"2021-10-08T19:43:48.807716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001800294,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":332,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:25.390713+0000","last_change":"2021-10-08T19:44:25.390376+0000","last_active":"2021-10-08T19:44:25.390713+0000","last_peered":"2021-10-08T19:44:25.390713+0000","last_clean":"2021-10-08T19:44:25.390713+0000","last_became_active":"2021-10-08T19:29:40.634300+0000","last_became_peered":"2021-10-08T19:29:40.634300+0000","last_unstale":"2021-10-08T19:44:25.390713+0000","last_undegraded":"2021-10-08T19:44:25.390713+0000","last_fullsized":"2021-10-08T19:44:25.390713+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:25.390220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:47.187765+0000","last_clean_scrub_stamp":"2021-10-08T19:44:25.390220+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.023411802999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"70'5","reported_seq":443,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:16.194826+0000","last_change":"2021-10-08T19:44:16.194360+0000","last_active":"2021-10-08T19:44:16.194826+0000","last_peered":"2021-10-08T19:44:16.194826+0000","last_clean":"2021-10-08T19:44:16.194826+0000","last_became_active":"2021-10-08T19:25:15.496309+0000","last_became_peered":"2021-10-08T19:25:15.496309+0000","last_unstale":"2021-10-08T19:44:16.194826+0000","last_undegraded":"2021-10-08T19:44:16.194826+0000","last_fullsized":"2021-10-08T19:44:16.194826+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":5,"last_scrub":"70'5","last_scrub_stamp":"2021-10-08T19:44:16.194265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:44:16.194265+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034600260000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.10","version":"482'12","reported_seq":367,"reported_epoch":530,"state":"active+clean","last_fresh":"2021-10-08T19:44:49.229921+0000","last_change":"2021-10-08T19:44:49.229896+0000","last_active":"2021-10-08T19:44:49.229921+0000","last_peered":"2021-10-08T19:44:49.229921+0000","last_clean":"2021-10-08T19:44:49.229921+0000","last_became_active":"2021-10-08T19:32:45.165103+0000","last_became_peered":"2021-10-08T19:32:45.165103+0000","last_unstale":"2021-10-08T19:44:49.229921+0000","last_undegraded":"2021-10-08T19:44:49.229921+0000","last_fullsized":"2021-10-08T19:44:49.229921+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'12","last_scrub_stamp":"2021-10-08T19:44:49.229824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:44:49.229824+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003426779,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":16,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":411,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:25.366366+0000","last_change":"2021-10-08T19:44:25.365959+0000","last_active":"2021-10-08T19:44:25.366366+0000","last_peered":"2021-10-08T19:44:25.366366+0000","last_clean":"2021-10-08T19:44:25.366366+0000","last_became_active":"2021-10-08T19:43:42.356665+0000","last_became_peered":"2021-10-08T19:43:42.356665+0000","last_unstale":"2021-10-08T19:44:25.366366+0000","last_undegraded":"2021-10-08T19:44:25.366366+0000","last_fullsized":"2021-10-08T19:44:25.366366+0000","mapping_epoch":520,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":521,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:25.365837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:42:58.532200+0000","last_clean_scrub_stamp":"2021-10-08T19:44:25.365837+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0033825539999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":485,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:19.680750+0000","last_change":"2021-10-08T19:44:19.680632+0000","last_active":"2021-10-08T19:44:19.680750+0000","last_peered":"2021-10-08T19:44:19.680750+0000","last_clean":"2021-10-08T19:44:19.680750+0000","last_became_active":"2021-10-08T19:24:25.106186+0000","last_became_peered":"2021-10-08T19:24:25.106186+0000","last_unstale":"2021-10-08T19:44:19.680750+0000","last_undegraded":"2021-10-08T19:44:19.680750+0000","last_fullsized":"2021-10-08T19:44:19.680750+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:19.680564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:34:18.377739+0000","last_clean_scrub_stamp":"2021-10-08T19:44:19.680564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0013746979999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":522,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:08.068615+0000","last_change":"2021-10-08T19:44:08.068159+0000","last_active":"2021-10-08T19:44:08.068615+0000","last_peered":"2021-10-08T19:44:08.068615+0000","last_clean":"2021-10-08T19:44:08.068615+0000","last_became_active":"2021-10-08T19:21:29.642835+0000","last_became_peered":"2021-10-08T19:21:29.642835+0000","last_unstale":"2021-10-08T19:44:08.068615+0000","last_undegraded":"2021-10-08T19:44:08.068615+0000","last_fullsized":"2021-10-08T19:44:08.068615+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:08.068064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:42:45.950622+0000","last_clean_scrub_stamp":"2021-10-08T19:44:08.068064+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034228079999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":471,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.668412+0000","last_change":"2021-10-08T19:43:35.715140+0000","last_active":"2021-10-08T19:44:07.668412+0000","last_peered":"2021-10-08T19:44:07.668412+0000","last_clean":"2021-10-08T19:44:07.668412+0000","last_became_active":"2021-10-08T19:28:40.099215+0000","last_became_peered":"2021-10-08T19:28:40.099215+0000","last_unstale":"2021-10-08T19:44:07.668412+0000","last_undegraded":"2021-10-08T19:44:07.668412+0000","last_fullsized":"2021-10-08T19:44:07.668412+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:35.715052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:43:35.715052+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003769395,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"482'32","reported_seq":373,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.504880+0000","last_change":"2021-10-08T19:44:02.545842+0000","last_active":"2021-10-08T19:44:07.504880+0000","last_peered":"2021-10-08T19:44:07.504880+0000","last_clean":"2021-10-08T19:44:07.504880+0000","last_became_active":"2021-10-08T19:29:40.640914+0000","last_became_peered":"2021-10-08T19:29:40.640914+0000","last_unstale":"2021-10-08T19:44:07.504880+0000","last_undegraded":"2021-10-08T19:44:07.504880+0000","last_fullsized":"2021-10-08T19:44:07.504880+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'32","last_scrub_stamp":"2021-10-08T19:44:02.545762+0000","last_deep_scrub":"482'32","last_deep_scrub_stamp":"2021-10-08T19:44:02.545762+0000","last_clean_scrub_stamp":"2021-10-08T19:44:02.545762+0000","log_size":32,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0041064810000000004,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":36,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":476,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.667076+0000","last_change":"2021-10-08T19:43:38.644798+0000","last_active":"2021-10-08T19:44:07.667076+0000","last_peered":"2021-10-08T19:44:07.667076+0000","last_clean":"2021-10-08T19:44:07.667076+0000","last_became_active":"2021-10-08T19:24:25.098128+0000","last_became_peered":"2021-10-08T19:24:25.098128+0000","last_unstale":"2021-10-08T19:44:07.667076+0000","last_undegraded":"2021-10-08T19:44:07.667076+0000","last_fullsized":"2021-10-08T19:44:07.667076+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:38.644709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:34.508558+0000","last_clean_scrub_stamp":"2021-10-08T19:43:38.644709+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0019679739999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":536,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.508124+0000","last_change":"2021-10-08T19:43:31.971870+0000","last_active":"2021-10-08T19:44:07.508124+0000","last_peered":"2021-10-08T19:44:07.508124+0000","last_clean":"2021-10-08T19:44:07.508124+0000","last_became_active":"2021-10-08T19:24:25.095490+0000","last_became_peered":"2021-10-08T19:24:25.095490+0000","last_unstale":"2021-10-08T19:44:07.508124+0000","last_undegraded":"2021-10-08T19:44:07.508124+0000","last_fullsized":"2021-10-08T19:44:07.508124+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:31.971782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:11.383779+0000","last_clean_scrub_stamp":"2021-10-08T19:43:31.971782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0017384480000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":334,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.505466+0000","last_change":"2021-10-08T19:43:54.647112+0000","last_active":"2021-10-08T19:44:07.505466+0000","last_peered":"2021-10-08T19:44:07.505466+0000","last_clean":"2021-10-08T19:44:07.505466+0000","last_became_active":"2021-10-08T19:29:40.639358+0000","last_became_peered":"2021-10-08T19:29:40.639358+0000","last_unstale":"2021-10-08T19:44:07.505466+0000","last_undegraded":"2021-10-08T19:44:07.505466+0000","last_fullsized":"2021-10-08T19:44:07.505466+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:54.646997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:43:54.646997+0000","last_clean_scrub_stamp":"2021-10-08T19:43:54.646997+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.118729475,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"512'35","reported_seq":626,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:34.152635+0000","last_change":"2021-10-08T19:44:34.152522+0000","last_active":"2021-10-08T19:44:34.152635+0000","last_peered":"2021-10-08T19:44:34.152635+0000","last_clean":"2021-10-08T19:44:34.152635+0000","last_became_active":"2021-10-08T19:29:40.636448+0000","last_became_peered":"2021-10-08T19:29:40.636448+0000","last_unstale":"2021-10-08T19:44:34.152635+0000","last_undegraded":"2021-10-08T19:44:34.152635+0000","last_fullsized":"2021-10-08T19:44:34.152635+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"512'35","last_scrub_stamp":"2021-10-08T19:44:34.152446+0000","last_deep_scrub":"512'35","last_deep_scrub_stamp":"2021-10-08T19:43:21.411862+0000","last_clean_scrub_stamp":"2021-10-08T19:44:34.152446+0000","log_size":35,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0024610949999999999,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":40,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":537,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:33.219699+0000","last_change":"2021-10-08T19:44:33.219570+0000","last_active":"2021-10-08T19:44:33.219699+0000","last_peered":"2021-10-08T19:44:33.219699+0000","last_clean":"2021-10-08T19:44:33.219699+0000","last_became_active":"2021-10-08T19:21:23.604530+0000","last_became_peered":"2021-10-08T19:21:23.604530+0000","last_unstale":"2021-10-08T19:44:33.219699+0000","last_undegraded":"2021-10-08T19:44:33.219699+0000","last_fullsized":"2021-10-08T19:44:33.219699+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:33.219478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:44:33.219478+0000","last_clean_scrub_stamp":"2021-10-08T19:44:33.219478+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.00160524,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1f","version":"114'10","reported_seq":717,"reported_epoch":530,"state":"active+clean","last_fresh":"2021-10-08T19:44:44.345387+0000","last_change":"2021-10-08T19:43:40.657826+0000","last_active":"2021-10-08T19:44:44.345387+0000","last_peered":"2021-10-08T19:44:44.345387+0000","last_clean":"2021-10-08T19:44:44.345387+0000","last_became_active":"2021-10-08T19:24:25.105742+0000","last_became_peered":"2021-10-08T19:24:25.105742+0000","last_unstale":"2021-10-08T19:44:44.345387+0000","last_undegraded":"2021-10-08T19:44:44.345387+0000","last_fullsized":"2021-10-08T19:44:44.345387+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'10","last_scrub_stamp":"2021-10-08T19:43:40.657729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:43:40.657729+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001956078,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"69'1","reported_seq":521,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:23.018949+0000","last_change":"2021-10-08T19:44:23.018483+0000","last_active":"2021-10-08T19:44:23.018949+0000","last_peered":"2021-10-08T19:44:23.018949+0000","last_clean":"2021-10-08T19:44:23.018949+0000","last_became_active":"2021-10-08T19:21:29.640296+0000","last_became_peered":"2021-10-08T19:21:29.640296+0000","last_unstale":"2021-10-08T19:44:23.018949+0000","last_undegraded":"2021-10-08T19:44:23.018949+0000","last_fullsized":"2021-10-08T19:44:23.018949+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2021-10-08T19:44:23.018395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:44:23.018395+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039883970000000003,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"482'32","reported_seq":557,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:12.608092+0000","last_change":"2021-10-08T19:44:12.607964+0000","last_active":"2021-10-08T19:44:12.608092+0000","last_peered":"2021-10-08T19:44:12.608092+0000","last_clean":"2021-10-08T19:44:12.608092+0000","last_became_active":"2021-10-08T19:28:40.126425+0000","last_became_peered":"2021-10-08T19:28:40.126425+0000","last_unstale":"2021-10-08T19:44:12.608092+0000","last_undegraded":"2021-10-08T19:44:12.608092+0000","last_fullsized":"2021-10-08T19:44:12.608092+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'32","last_scrub_stamp":"2021-10-08T19:44:12.607868+0000","last_deep_scrub":"390'24","last_deep_scrub_stamp":"2021-10-08T19:39:33.439960+0000","last_clean_scrub_stamp":"2021-10-08T19:44:12.607868+0000","log_size":32,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002780706,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":36,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":45,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.434819+0000","last_change":"2021-10-08T19:43:29.728876+0000","last_active":"2021-10-08T19:44:07.434819+0000","last_peered":"2021-10-08T19:44:07.434819+0000","last_clean":"2021-10-08T19:44:07.434819+0000","last_became_active":"2021-10-08T19:42:43.406316+0000","last_became_peered":"2021-10-08T19:42:43.406316+0000","last_unstale":"2021-10-08T19:44:07.434819+0000","last_undegraded":"2021-10-08T19:44:07.434819+0000","last_fullsized":"2021-10-08T19:44:07.434819+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:29.728809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:43:29.728809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002986626,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,0],"acting":[1,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":528,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:15.219420+0000","last_change":"2021-10-08T19:44:15.219289+0000","last_active":"2021-10-08T19:44:15.219420+0000","last_peered":"2021-10-08T19:44:15.219420+0000","last_clean":"2021-10-08T19:44:15.219420+0000","last_became_active":"2021-10-08T19:21:27.632648+0000","last_became_peered":"2021-10-08T19:21:27.632648+0000","last_unstale":"2021-10-08T19:44:15.219420+0000","last_undegraded":"2021-10-08T19:44:15.219420+0000","last_fullsized":"2021-10-08T19:44:15.219420+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:15.219222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:38:51.997511+0000","last_clean_scrub_stamp":"2021-10-08T19:44:15.219222+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.001605567,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"69'1","reported_seq":376,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:30.081971+0000","last_change":"2021-10-08T19:44:30.081573+0000","last_active":"2021-10-08T19:44:30.081971+0000","last_peered":"2021-10-08T19:44:30.081971+0000","last_clean":"2021-10-08T19:44:30.081971+0000","last_became_active":"2021-10-08T19:28:40.146302+0000","last_became_peered":"2021-10-08T19:28:40.146302+0000","last_unstale":"2021-10-08T19:44:30.081971+0000","last_undegraded":"2021-10-08T19:44:30.081971+0000","last_fullsized":"2021-10-08T19:44:30.081971+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2021-10-08T19:44:30.081456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:44:30.081456+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.13169661899999999,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"482'39","reported_seq":722,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:06.967017+0000","last_change":"2021-10-08T19:43:26.583829+0000","last_active":"2021-10-08T19:44:06.967017+0000","last_peered":"2021-10-08T19:44:06.967017+0000","last_clean":"2021-10-08T19:44:06.967017+0000","last_became_active":"2021-10-08T19:29:40.629461+0000","last_became_peered":"2021-10-08T19:29:40.629461+0000","last_unstale":"2021-10-08T19:44:06.967017+0000","last_undegraded":"2021-10-08T19:44:06.967017+0000","last_fullsized":"2021-10-08T19:44:06.967017+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'39","last_scrub_stamp":"2021-10-08T19:43:26.583750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:43:26.583750+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040397640000000004,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":62,"num_read_kb":53,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":550,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":482,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:35.728576+0000","last_change":"2021-10-08T19:44:35.728431+0000","last_active":"2021-10-08T19:44:35.728576+0000","last_peered":"2021-10-08T19:44:35.728576+0000","last_clean":"2021-10-08T19:44:35.728576+0000","last_became_active":"2021-10-08T19:24:25.106119+0000","last_became_peered":"2021-10-08T19:24:25.106119+0000","last_unstale":"2021-10-08T19:44:35.728576+0000","last_undegraded":"2021-10-08T19:44:35.728576+0000","last_fullsized":"2021-10-08T19:44:35.728576+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:35.728341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:46.422866+0000","last_clean_scrub_stamp":"2021-10-08T19:44:35.728341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0019124120000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":374,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.435477+0000","last_change":"2021-10-08T19:44:04.163252+0000","last_active":"2021-10-08T19:44:07.435477+0000","last_peered":"2021-10-08T19:44:07.435477+0000","last_clean":"2021-10-08T19:44:07.435477+0000","last_became_active":"2021-10-08T19:28:40.148009+0000","last_became_peered":"2021-10-08T19:28:40.148009+0000","last_unstale":"2021-10-08T19:44:07.435477+0000","last_undegraded":"2021-10-08T19:44:07.435477+0000","last_fullsized":"2021-10-08T19:44:07.435477+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:04.163174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:42:50.576827+0000","last_clean_scrub_stamp":"2021-10-08T19:44:04.163174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003422394,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":535,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:23.226226+0000","last_change":"2021-10-08T19:44:23.226089+0000","last_active":"2021-10-08T19:44:23.226226+0000","last_peered":"2021-10-08T19:44:23.226226+0000","last_clean":"2021-10-08T19:44:23.226226+0000","last_became_active":"2021-10-08T19:24:25.097782+0000","last_became_peered":"2021-10-08T19:24:25.097782+0000","last_unstale":"2021-10-08T19:44:23.226226+0000","last_undegraded":"2021-10-08T19:44:23.226226+0000","last_fullsized":"2021-10-08T19:44:23.226226+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:23.226015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:27:37.219503+0000","last_clean_scrub_stamp":"2021-10-08T19:44:23.226015+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0013459279999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"482'24","reported_seq":362,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.505200+0000","last_change":"2021-10-08T19:43:27.383996+0000","last_active":"2021-10-08T19:44:07.505200+0000","last_peered":"2021-10-08T19:44:07.505200+0000","last_clean":"2021-10-08T19:44:07.505200+0000","last_became_active":"2021-10-08T19:29:40.645144+0000","last_became_peered":"2021-10-08T19:29:40.645144+0000","last_unstale":"2021-10-08T19:44:07.505200+0000","last_undegraded":"2021-10-08T19:44:07.505200+0000","last_fullsized":"2021-10-08T19:44:07.505200+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'24","last_scrub_stamp":"2021-10-08T19:43:27.383927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:43:27.383927+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039786200000000004,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":332,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:42.344694+0000","last_change":"2021-10-08T19:44:42.344223+0000","last_active":"2021-10-08T19:44:42.344694+0000","last_peered":"2021-10-08T19:44:42.344694+0000","last_clean":"2021-10-08T19:44:42.344694+0000","last_became_active":"2021-10-08T19:29:44.443807+0000","last_became_peered":"2021-10-08T19:29:44.443807+0000","last_unstale":"2021-10-08T19:44:42.344694+0000","last_undegraded":"2021-10-08T19:44:42.344694+0000","last_fullsized":"2021-10-08T19:44:42.344694+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:42.344156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:32.854550+0000","last_clean_scrub_stamp":"2021-10-08T19:44:42.344156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0036140259999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":533,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:06.965953+0000","last_change":"2021-10-08T19:43:13.079640+0000","last_active":"2021-10-08T19:44:06.965953+0000","last_peered":"2021-10-08T19:44:06.965953+0000","last_clean":"2021-10-08T19:44:06.965953+0000","last_became_active":"2021-10-08T19:29:40.638352+0000","last_became_peered":"2021-10-08T19:29:40.638352+0000","last_unstale":"2021-10-08T19:44:06.965953+0000","last_undegraded":"2021-10-08T19:44:06.965953+0000","last_fullsized":"2021-10-08T19:44:06.965953+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:13.079549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:43:13.079549+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0033821950000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":350,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:32.481533+0000","last_change":"2021-10-08T19:44:32.481249+0000","last_active":"2021-10-08T19:44:32.481533+0000","last_peered":"2021-10-08T19:44:32.481533+0000","last_clean":"2021-10-08T19:44:32.481533+0000","last_became_active":"2021-10-08T19:31:22.788455+0000","last_became_peered":"2021-10-08T19:31:22.788455+0000","last_unstale":"2021-10-08T19:44:32.481533+0000","last_undegraded":"2021-10-08T19:44:32.481533+0000","last_fullsized":"2021-10-08T19:44:32.481533+0000","mapping_epoch":283,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:32.481119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:32:12.549351+0000","last_clean_scrub_stamp":"2021-10-08T19:44:32.481119+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.140691813,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"482'21","reported_seq":69,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:18.117014+0000","last_change":"2021-10-08T19:44:18.116540+0000","last_active":"2021-10-08T19:44:18.117014+0000","last_peered":"2021-10-08T19:44:18.117014+0000","last_clean":"2021-10-08T19:44:18.117014+0000","last_became_active":"2021-10-08T19:42:21.193316+0000","last_became_peered":"2021-10-08T19:42:21.193316+0000","last_unstale":"2021-10-08T19:44:18.117014+0000","last_undegraded":"2021-10-08T19:44:18.117014+0000","last_fullsized":"2021-10-08T19:44:18.117014+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'21","last_scrub_stamp":"2021-10-08T19:44:18.116455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:44:18.116455+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039572349999999999,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":28,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0],"acting":[7,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":530,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:15.145883+0000","last_change":"2021-10-08T19:44:15.145430+0000","last_active":"2021-10-08T19:44:15.145883+0000","last_peered":"2021-10-08T19:44:15.145883+0000","last_clean":"2021-10-08T19:44:15.145883+0000","last_became_active":"2021-10-08T19:21:23.607785+0000","last_became_peered":"2021-10-08T19:21:23.607785+0000","last_unstale":"2021-10-08T19:44:15.145883+0000","last_undegraded":"2021-10-08T19:44:15.145883+0000","last_fullsized":"2021-10-08T19:44:15.145883+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:15.145331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:39:21.657316+0000","last_clean_scrub_stamp":"2021-10-08T19:44:15.145331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0033755410000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":535,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:21.470445+0000","last_change":"2021-10-08T19:44:21.469961+0000","last_active":"2021-10-08T19:44:21.470445+0000","last_peered":"2021-10-08T19:44:21.470445+0000","last_clean":"2021-10-08T19:44:21.470445+0000","last_became_active":"2021-10-08T19:21:27.633979+0000","last_became_peered":"2021-10-08T19:21:27.633979+0000","last_unstale":"2021-10-08T19:44:21.470445+0000","last_undegraded":"2021-10-08T19:44:21.470445+0000","last_fullsized":"2021-10-08T19:44:21.470445+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:21.469889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:35:27.586341+0000","last_clean_scrub_stamp":"2021-10-08T19:44:21.469889+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003433714,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":542,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:06.968972+0000","last_change":"2021-10-08T19:43:36.299221+0000","last_active":"2021-10-08T19:44:06.968972+0000","last_peered":"2021-10-08T19:44:06.968972+0000","last_clean":"2021-10-08T19:44:06.968972+0000","last_became_active":"2021-10-08T19:28:40.159162+0000","last_became_peered":"2021-10-08T19:28:40.159162+0000","last_unstale":"2021-10-08T19:44:06.968972+0000","last_undegraded":"2021-10-08T19:44:06.968972+0000","last_fullsized":"2021-10-08T19:44:06.968972+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:36.299121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:43:36.299121+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.044022105999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"482'9","reported_seq":618,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:35.258739+0000","last_change":"2021-10-08T19:44:35.258301+0000","last_active":"2021-10-08T19:44:35.258739+0000","last_peered":"2021-10-08T19:44:35.258739+0000","last_clean":"2021-10-08T19:44:35.258739+0000","last_became_active":"2021-10-08T19:31:51.675189+0000","last_became_peered":"2021-10-08T19:31:51.675189+0000","last_unstale":"2021-10-08T19:44:35.258739+0000","last_undegraded":"2021-10-08T19:44:35.258739+0000","last_fullsized":"2021-10-08T19:44:35.258739+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'9","last_scrub_stamp":"2021-10-08T19:44:35.258200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:24.589054+0000","last_clean_scrub_stamp":"2021-10-08T19:44:35.258200+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040287980000000001,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":13,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":552,"reported_epoch":530,"state":"active+clean","last_fresh":"2021-10-08T19:44:46.698572+0000","last_change":"2021-10-08T19:44:46.698540+0000","last_active":"2021-10-08T19:44:46.698572+0000","last_peered":"2021-10-08T19:44:46.698572+0000","last_clean":"2021-10-08T19:44:46.698572+0000","last_became_active":"2021-10-08T19:24:25.096225+0000","last_became_peered":"2021-10-08T19:24:25.096225+0000","last_unstale":"2021-10-08T19:44:46.698572+0000","last_undegraded":"2021-10-08T19:44:46.698572+0000","last_fullsized":"2021-10-08T19:44:46.698572+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:46.698450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:29:40.244757+0000","last_clean_scrub_stamp":"2021-10-08T19:44:46.698450+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0014808429999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":544,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:32.011359+0000","last_change":"2021-10-08T19:44:32.010908+0000","last_active":"2021-10-08T19:44:32.011359+0000","last_peered":"2021-10-08T19:44:32.011359+0000","last_clean":"2021-10-08T19:44:32.011359+0000","last_became_active":"2021-10-08T19:28:40.101187+0000","last_became_peered":"2021-10-08T19:28:40.101187+0000","last_unstale":"2021-10-08T19:44:32.011359+0000","last_undegraded":"2021-10-08T19:44:32.011359+0000","last_fullsized":"2021-10-08T19:44:32.011359+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:32.010806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:44:32.010806+0000","last_clean_scrub_stamp":"2021-10-08T19:44:32.010806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0034254799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":423,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:28.255237+0000","last_change":"2021-10-08T19:44:28.254999+0000","last_active":"2021-10-08T19:44:28.255237+0000","last_peered":"2021-10-08T19:44:28.255237+0000","last_clean":"2021-10-08T19:44:28.255237+0000","last_became_active":"2021-10-08T19:43:42.364088+0000","last_became_peered":"2021-10-08T19:43:42.364088+0000","last_unstale":"2021-10-08T19:44:28.255237+0000","last_undegraded":"2021-10-08T19:44:28.255237+0000","last_fullsized":"2021-10-08T19:44:28.255237+0000","mapping_epoch":520,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":521,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:28.254903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:44:28.254903+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.027700637,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"482'25","reported_seq":671,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:14.112647+0000","last_change":"2021-10-08T19:44:14.112206+0000","last_active":"2021-10-08T19:44:14.112647+0000","last_peered":"2021-10-08T19:44:14.112647+0000","last_clean":"2021-10-08T19:44:14.112647+0000","last_became_active":"2021-10-08T19:28:40.099770+0000","last_became_peered":"2021-10-08T19:28:40.099770+0000","last_unstale":"2021-10-08T19:44:14.112647+0000","last_undegraded":"2021-10-08T19:44:14.112647+0000","last_fullsized":"2021-10-08T19:44:14.112647+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"482'25","last_scrub_stamp":"2021-10-08T19:44:14.112110+0000","last_deep_scrub":"482'25","last_deep_scrub_stamp":"2021-10-08T19:44:14.112110+0000","last_clean_scrub_stamp":"2021-10-08T19:44:14.112110+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0039897500000000002,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":332,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.505446+0000","last_change":"2021-10-08T19:44:04.517186+0000","last_active":"2021-10-08T19:44:07.505446+0000","last_peered":"2021-10-08T19:44:07.505446+0000","last_clean":"2021-10-08T19:44:07.505446+0000","last_became_active":"2021-10-08T19:29:40.627394+0000","last_became_peered":"2021-10-08T19:29:40.627394+0000","last_unstale":"2021-10-08T19:44:07.505446+0000","last_undegraded":"2021-10-08T19:44:07.505446+0000","last_fullsized":"2021-10-08T19:44:07.505446+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:04.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:22.582293+0000","last_clean_scrub_stamp":"2021-10-08T19:44:04.517067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0036211080000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":372,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:07.435054+0000","last_change":"2021-10-08T19:43:42.762761+0000","last_active":"2021-10-08T19:44:07.435054+0000","last_peered":"2021-10-08T19:44:07.435054+0000","last_clean":"2021-10-08T19:44:07.435054+0000","last_became_active":"2021-10-08T19:28:40.145868+0000","last_became_peered":"2021-10-08T19:28:40.145868+0000","last_unstale":"2021-10-08T19:44:07.435054+0000","last_undegraded":"2021-10-08T19:44:07.435054+0000","last_fullsized":"2021-10-08T19:44:07.435054+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:43:42.762612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:26.604244+0000","last_clean_scrub_stamp":"2021-10-08T19:43:42.762612+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0021516899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":533,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:15.186023+0000","last_change":"2021-10-08T19:44:15.185579+0000","last_active":"2021-10-08T19:44:15.186023+0000","last_peered":"2021-10-08T19:44:15.186023+0000","last_clean":"2021-10-08T19:44:15.186023+0000","last_became_active":"2021-10-08T19:28:40.099543+0000","last_became_peered":"2021-10-08T19:28:40.099543+0000","last_unstale":"2021-10-08T19:44:15.186023+0000","last_undegraded":"2021-10-08T19:44:15.186023+0000","last_fullsized":"2021-10-08T19:44:15.186023+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:15.185452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:22:50.032367+0000","last_clean_scrub_stamp":"2021-10-08T19:44:15.185452+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.033493497999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"491'46","reported_seq":391,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:20.289193+0000","last_change":"2021-10-08T19:44:20.288713+0000","last_active":"2021-10-08T19:44:20.289193+0000","last_peered":"2021-10-08T19:44:20.289193+0000","last_clean":"2021-10-08T19:44:20.289193+0000","last_became_active":"2021-10-08T19:29:40.631002+0000","last_became_peered":"2021-10-08T19:29:40.631002+0000","last_unstale":"2021-10-08T19:44:20.289193+0000","last_undegraded":"2021-10-08T19:44:20.289193+0000","last_fullsized":"2021-10-08T19:44:20.289193+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"491'46","last_scrub_stamp":"2021-10-08T19:44:20.288638+0000","last_deep_scrub":"491'46","last_deep_scrub_stamp":"2021-10-08T19:42:17.985848+0000","last_clean_scrub_stamp":"2021-10-08T19:44:20.288638+0000","log_size":46,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.0040014680000000002,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":528,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:06.968926+0000","last_change":"2021-10-08T19:44:02.280317+0000","last_active":"2021-10-08T19:44:06.968926+0000","last_peered":"2021-10-08T19:44:06.968926+0000","last_clean":"2021-10-08T19:44:06.968926+0000","last_became_active":"2021-10-08T19:21:23.603422+0000","last_became_peered":"2021-10-08T19:21:23.603422+0000","last_unstale":"2021-10-08T19:44:06.968926+0000","last_undegraded":"2021-10-08T19:44:06.968926+0000","last_fullsized":"2021-10-08T19:44:06.968926+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:02.280237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:28:15.535842+0000","last_clean_scrub_stamp":"2021-10-08T19:44:02.280237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.002152241,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":559,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:42.285326+0000","last_change":"2021-10-08T19:44:42.284861+0000","last_active":"2021-10-08T19:44:42.285326+0000","last_peered":"2021-10-08T19:44:42.285326+0000","last_clean":"2021-10-08T19:44:42.285326+0000","last_became_active":"2021-10-08T19:28:40.099286+0000","last_became_peered":"2021-10-08T19:28:40.099286+0000","last_unstale":"2021-10-08T19:44:42.285326+0000","last_undegraded":"2021-10-08T19:44:42.285326+0000","last_fullsized":"2021-10-08T19:44:42.285326+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:42.284773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:31:31.176160+0000","last_clean_scrub_stamp":"2021-10-08T19:44:42.284773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.003609878,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":332,"reported_epoch":529,"state":"active+clean","last_fresh":"2021-10-08T19:44:17.494037+0000","last_change":"2021-10-08T19:44:17.493596+0000","last_active":"2021-10-08T19:44:17.494037+0000","last_peered":"2021-10-08T19:44:17.494037+0000","last_clean":"2021-10-08T19:44:17.494037+0000","last_became_active":"2021-10-08T19:29:40.638221+0000","last_became_peered":"2021-10-08T19:29:40.638221+0000","last_unstale":"2021-10-08T19:44:17.494037+0000","last_undegraded":"2021-10-08T19:44:17.494037+0000","last_fullsized":"2021-10-08T19:44:17.494037+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:44:17.493507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:21:28.621762+0000","last_clean_scrub_stamp":"2021-10-08T19:44:17.493507+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0.11828785999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":42,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":126,"acting":126,"num_store_stats":8},{"poolid":1,"num_pg":11,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1430,"ondisk_log_size":1430,"up":33,"acting":33,"num_store_stats":8},{"poolid":3,"num_pg":23,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":840,"num_read_kb":840,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1167,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":69,"acting":69,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1537,"num_read_kb":1294,"num_write":989,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":524,"num_bytes_recovered":10936,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1050,"ondisk_log_size":1050,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":85,"ondisk_log_size":85,"up":96,"acting":96,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201566,"num_pgs":75,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":370012,"kb_used_data":1108,"kb_used_omap":0,"kb_used_meta":368896,"kb_avail":93375140,"statfs":{"total":95995035648,"available":95616143360,"internally_reserved":0,"allocated":1134592,"data_stored":733765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":377749504},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:43:50 2021","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":1.212,"15min":1.45},"min":{"1min":0.29599999999999999,"5min":0.223,"15min":0.20699999999999999},"max":{"1min":0.81299999999999994,"5min":13.686,"15min":26.065000000000001},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.47099999999999997,"5min":1.2150000000000001,"15min":1.55},"min":{"1min":0.25800000000000001,"5min":0.21299999999999999,"15min":0.20499999999999999},"max":{"1min":0.69899999999999995,"5min":26.914000000000001,"15min":26.914000000000001},"last":0.39700000000000002}]},{"osd":1,"last update":"Fri Oct 8 19:43:50 2021","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":2.4849999999999999,"15min":2.383},"min":{"1min":0.27800000000000002,"5min":0.20799999999999999,"15min":0.19600000000000001},"max":{"1min":0.65100000000000002,"5min":95.063000000000002,"15min":95.063000000000002},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.48899999999999999,"5min":2.266,"15min":2.1110000000000002},"min":{"1min":0.32100000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.753,"5min":95.012,"15min":95.012},"last":0.437}]},{"osd":2,"last update":"Fri Oct 8 19:43:50 2021","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":1.601,"15min":1.889},"min":{"1min":0.33000000000000002,"5min":0.27900000000000003,"15min":0.255},"max":{"1min":0.65200000000000002,"5min":22.867000000000001,"15min":81.204999999999998},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.49299999999999999,"5min":1.516,"15min":1.786},"min":{"1min":0.374,"5min":0.26800000000000002,"15min":0.253},"max":{"1min":0.69699999999999995,"5min":15.632999999999999,"15min":81.022000000000006},"last":0.45700000000000002}]},{"osd":3,"last update":"Fri Oct 8 19:43:50 2021","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":1.5529999999999999,"15min":2.1230000000000002},"min":{"1min":0.38,"5min":0.28799999999999998,"15min":0.28100000000000003},"max":{"1min":0.75600000000000001,"5min":7.3289999999999997,"15min":72.093999999999994},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":1.601,"15min":2.1309999999999998},"min":{"1min":0.30099999999999999,"5min":0.28299999999999997,"15min":0.28000000000000003},"max":{"1min":0.67400000000000004,"5min":24.152999999999999,"15min":71.864999999999995},"last":0.35699999999999998}]},{"osd":4,"last update":"Fri Oct 8 19:43:50 2021","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.89300000000000002,"15min":1.22},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.22800000000000001},"max":{"1min":0.77800000000000002,"5min":6.2759999999999998,"15min":55.890999999999998},"last":0.316},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.92000000000000004,"15min":1.359},"min":{"1min":0.317,"5min":0.25900000000000001,"15min":0.254},"max":{"1min":0.79300000000000004,"5min":6.9059999999999997,"15min":54.448999999999998},"last":0.499}]},{"osd":5,"last update":"Fri Oct 8 19:43:50 2021","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.85599999999999998,"15min":1.1120000000000001},"min":{"1min":0.34899999999999998,"5min":0.30399999999999999,"15min":0.26800000000000002},"max":{"1min":0.78300000000000003,"5min":6.3159999999999998,"15min":9.9280000000000008},"last":0.374},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.92200000000000004,"15min":1.2589999999999999},"min":{"1min":0.39000000000000001,"5min":0.27500000000000002,"15min":0.26100000000000001},"max":{"1min":0.82699999999999996,"5min":6.9850000000000003,"15min":18.655000000000001},"last":0.48099999999999998}]},{"osd":6,"last update":"Fri Oct 8 19:43:50 2021","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.92200000000000004,"15min":1.3819999999999999},"min":{"1min":0.371,"5min":0.29199999999999998,"15min":0.27900000000000003},"max":{"1min":0.80000000000000004,"5min":10.943,"15min":58.039000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":1.0600000000000001,"15min":1.3939999999999999},"min":{"1min":0.40500000000000003,"5min":0.30599999999999999,"15min":0.30299999999999999},"max":{"1min":0.85199999999999998,"5min":6.3419999999999996,"15min":58.079999999999998},"last":0.48999999999999999}]}]},{"osd":6,"up_from":47,"seq":201863463202,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":400136,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":399360,"kb_avail":93345016,"statfs":{"total":95995035648,"available":95585296384,"internally_reserved":0,"allocated":786432,"data_stored":405168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":408944640},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:44:31 2021","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.96199999999999997,"15min":1.272},"min":{"1min":0.27100000000000002,"5min":0.188,"15min":0.188},"max":{"1min":0.70699999999999996,"5min":5.1710000000000003,"15min":39.262},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.48799999999999999,"5min":1.373,"15min":1.772},"min":{"1min":0.35099999999999998,"5min":0.22500000000000001,"15min":0.215},"max":{"1min":0.63600000000000001,"5min":7.4089999999999998,"15min":39.351999999999997},"last":0.33600000000000002}]},{"osd":1,"last update":"Fri Oct 8 19:44:31 2021","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":1.8779999999999999,"15min":1.637},"min":{"1min":0.33800000000000002,"5min":0.223,"15min":0.223},"max":{"1min":0.68100000000000005,"5min":31.504999999999999,"15min":31.504999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":1.891,"15min":1.6739999999999999},"min":{"1min":0.35599999999999998,"5min":0.27300000000000002,"15min":0.24399999999999999},"max":{"1min":0.68500000000000005,"5min":31.512,"15min":31.512},"last":0.38300000000000001}]},{"osd":2,"last update":"Fri Oct 8 19:44:31 2021","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":2.0990000000000002,"15min":1.659},"min":{"1min":0.33600000000000002,"5min":0.27500000000000002,"15min":0.26000000000000001},"max":{"1min":0.76300000000000001,"5min":95.846000000000004,"15min":95.846000000000004},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.505,"5min":2.1760000000000002,"15min":1.962},"min":{"1min":0.33800000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.72199999999999998,"5min":95.683999999999997,"15min":95.683999999999997},"last":0.37}]},{"osd":3,"last update":"Fri Oct 8 19:44:31 2021","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":4.0650000000000004,"15min":2.444},"min":{"1min":0.378,"5min":0.28199999999999997,"15min":0.27000000000000002},"max":{"1min":0.64300000000000002,"5min":125.726,"15min":125.726},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":4.1079999999999997,"15min":2.4860000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.29099999999999998},"max":{"1min":0.71999999999999997,"5min":125.614,"15min":125.614},"last":0.35299999999999998}]},{"osd":4,"last update":"Fri Oct 8 19:44:31 2021","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.81000000000000005,"15min":1.202},"min":{"1min":0.378,"5min":0.26800000000000002,"15min":0.19600000000000001},"max":{"1min":0.63800000000000001,"5min":6.4059999999999997,"15min":24.516999999999999},"last":0.435},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.86699999999999999,"15min":1.1659999999999999},"min":{"1min":0.42699999999999999,"5min":0.26500000000000001,"15min":0.23100000000000001},"max":{"1min":0.73499999999999999,"5min":5.577,"15min":9.9079999999999995},"last":0.44400000000000001}]},{"osd":5,"last update":"Fri Oct 8 19:44:31 2021","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.94099999999999995,"15min":1.954},"min":{"1min":0.437,"5min":0.27600000000000002,"15min":0.22900000000000001},"max":{"1min":0.69799999999999995,"5min":6.4509999999999996,"15min":107.485},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.87,"15min":1.8460000000000001},"min":{"1min":0.46700000000000003,"5min":0.28399999999999997,"15min":0.251},"max":{"1min":0.76000000000000001,"5min":5.9720000000000004,"15min":107.90300000000001},"last":0.495}]},{"osd":7,"last update":"Fri Oct 8 19:43:59 2021","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":1.071,"15min":1.2649999999999999},"min":{"1min":0.439,"5min":0.30399999999999999,"15min":0.27800000000000002},"max":{"1min":0.874,"5min":5.3120000000000003,"15min":8.8840000000000003},"last":0.505},{"interface":"front","average":{"1min":0.622,"5min":1.0660000000000001,"15min":1.427},"min":{"1min":0.44800000000000001,"5min":0.34000000000000002,"15min":0.29899999999999999},"max":{"1min":0.87,"5min":6.3719999999999999,"15min":15.962},"last":0.45700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575157,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":448500,"kb_used_data":812,"kb_used_omap":0,"kb_used_meta":447680,"kb_avail":93296652,"statfs":{"total":95995035648,"available":95535771648,"internally_reserved":0,"allocated":831488,"data_stored":405628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":458424320},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:44:16 2021","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":1.173,"15min":2.7810000000000001},"min":{"1min":0.192,"5min":0.19,"15min":0.188},"max":{"1min":0.45400000000000001,"5min":16.417000000000002,"15min":126.256},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.33900000000000002,"5min":2.137,"15min":3.1320000000000001},"min":{"1min":0.23599999999999999,"5min":0.18099999999999999,"15min":0.17799999999999999},"max":{"1min":0.501,"5min":13.038,"15min":126.176},"last":0.311}]},{"osd":2,"last update":"Fri Oct 8 19:44:42 2021","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":1.4910000000000001,"15min":1.883},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":0.41799999999999998,"5min":16.460000000000001,"15min":102.395},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.32200000000000001,"5min":1.891,"15min":2.2450000000000001},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.47599999999999998,"5min":10.68,"15min":102.50700000000001},"last":0.27100000000000002}]},{"osd":3,"last update":"Fri Oct 8 19:43:51 2021","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":3.0899999999999999,"15min":2.8290000000000002},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.61599999999999999,"5min":33.972000000000001,"15min":105.836},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.373,"5min":2.0830000000000002,"15min":2.6190000000000002},"min":{"1min":0.27800000000000002,"5min":0.26800000000000002,"15min":0.22900000000000001},"max":{"1min":0.48599999999999999,"5min":33.880000000000003,"15min":106.12},"last":0.38500000000000001}]},{"osd":4,"last update":"Fri Oct 8 19:43:57 2021","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":1.143,"15min":1.7869999999999999},"min":{"1min":0.377,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.79700000000000004,"5min":5.5449999999999999,"15min":103.538},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":1.3180000000000001,"15min":1.819},"min":{"1min":0.38400000000000001,"5min":0.26400000000000001,"15min":0.254},"max":{"1min":0.83199999999999996,"5min":9.7639999999999993,"15min":102.67100000000001},"last":0.48999999999999999}]},{"osd":5,"last update":"Fri Oct 8 19:44:32 2021","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":1.7749999999999999,"15min":3.097},"min":{"1min":0.32400000000000001,"5min":0.29899999999999999,"15min":0.27300000000000002},"max":{"1min":0.78800000000000003,"5min":10.553000000000001,"15min":262.14100000000002},"last":0.433},{"interface":"front","average":{"1min":0.56200000000000006,"5min":1.401,"15min":2.976},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.78000000000000003,"5min":9.7360000000000007,"15min":261.959},"last":0.46700000000000003}]},{"osd":6,"last update":"Fri Oct 8 19:44:42 2021","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":1.3300000000000001,"15min":1.9079999999999999},"min":{"1min":0.376,"5min":0.32700000000000001,"15min":0.316},"max":{"1min":0.747,"5min":17.477,"15min":103.73},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":1.8260000000000001,"15min":2.024},"min":{"1min":0.33900000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.745,"5min":10.503,"15min":102.753},"last":0.40300000000000002}]},{"osd":7,"last update":"Fri Oct 8 19:43:57 2021","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":2.4790000000000001,"15min":2.665},"min":{"1min":0.46000000000000002,"5min":0.35099999999999998,"15min":0.316},"max":{"1min":0.77900000000000003,"5min":62.408999999999999,"15min":106.011},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":1.968,"15min":2.4649999999999999},"min":{"1min":0.44900000000000001,"5min":0.34899999999999998,"15min":0.34200000000000003},"max":{"1min":0.72599999999999998,"5min":62.826999999999998,"15min":103.78400000000001},"last":0.56999999999999995}]}]},{"osd":0,"up_from":8,"seq":34359738680,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":432148,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":431360,"kb_avail":93313004,"statfs":{"total":95995035648,"available":95552516096,"internally_reserved":0,"allocated":798720,"data_stored":404799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":441712640},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 8 19:44:17 2021","interfaces":[{"interface":"back","average":{"1min":0.29399999999999998,"5min":2.831,"15min":2.4940000000000002},"min":{"1min":0.22,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":0.41799999999999998,"5min":101.68600000000001,"15min":101.68600000000001},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.36099999999999999,"5min":3.0579999999999998,"15min":2.5950000000000002},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.19800000000000001},"max":{"1min":0.49299999999999999,"5min":101.732,"15min":101.732},"last":0.27000000000000002}]},{"osd":2,"last update":"Fri Oct 8 19:44:38 2021","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":1.3680000000000001,"15min":1.6419999999999999},"min":{"1min":0.246,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.46200000000000002,"5min":11.01,"15min":12.164999999999999},"last":0.311},{"interface":"front","average":{"1min":0.33200000000000002,"5min":1.3460000000000001,"15min":1.6519999999999999},"min":{"1min":0.23100000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.56799999999999995,"5min":7.5030000000000001,"15min":10.509},"last":0.254}]},{"osd":3,"last update":"Fri Oct 8 19:43:49 2021","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":3.3919999999999999,"15min":2.5209999999999999},"min":{"1min":0.29899999999999999,"5min":0.26200000000000001,"15min":0.217},"max":{"1min":2.4249999999999998,"5min":104.744,"15min":104.744},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.35299999999999998,"5min":2.8330000000000002,"15min":2.3119999999999998},"min":{"1min":0.26300000000000001,"5min":0.187,"15min":0.187},"max":{"1min":0.48999999999999999,"5min":101.94,"15min":101.94},"last":0.28799999999999998}]},{"osd":4,"last update":"Fri Oct 8 19:44:17 2021","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":1.4950000000000001,"15min":1.7050000000000001},"min":{"1min":0.32300000000000001,"5min":0.28499999999999998,"15min":0.22900000000000001},"max":{"1min":0.75700000000000001,"5min":12.081,"15min":16.805},"last":0.38},{"interface":"front","average":{"1min":0.58999999999999997,"5min":1.4690000000000001,"15min":1.419},"min":{"1min":0.35799999999999998,"5min":0.28499999999999998,"15min":0.27400000000000002},"max":{"1min":0.91100000000000003,"5min":9.9749999999999996,"15min":9.9749999999999996},"last":0.41999999999999998}]},{"osd":5,"last update":"Fri Oct 8 19:44:22 2021","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":1.2150000000000001,"15min":1.478},"min":{"1min":0.41999999999999998,"5min":0.311,"15min":0.28199999999999997},"max":{"1min":0.89900000000000002,"5min":6.3010000000000002,"15min":9.9730000000000008},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.625,"5min":1.3420000000000001,"15min":1.6519999999999999},"min":{"1min":0.38200000000000001,"5min":0.32100000000000001,"15min":0.28599999999999998},"max":{"1min":0.93400000000000005,"5min":8.6899999999999995,"15min":15.115},"last":0.50800000000000001}]},{"osd":6,"last update":"Fri Oct 8 19:44:45 2021","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":1.157,"15min":1.4059999999999999},"min":{"1min":0.44400000000000001,"5min":0.32400000000000001,"15min":0.30599999999999999},"max":{"1min":1.0129999999999999,"5min":6.7069999999999999,"15min":7.165},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.626,"5min":1.337,"15min":1.6020000000000001},"min":{"1min":0.40400000000000003,"5min":0.38,"15min":0.28199999999999997},"max":{"1min":0.97999999999999998,"5min":6.2569999999999997,"15min":10.002000000000001},"last":0.45500000000000002}]},{"osd":7,"last update":"Fri Oct 8 19:43:49 2021","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":1.4410000000000001,"15min":1.74},"min":{"1min":0.45300000000000001,"5min":0.38900000000000001,"15min":0.33200000000000002},"max":{"1min":0.78300000000000003,"5min":8.6519999999999992,"15min":13.214},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":1.399,"15min":1.5880000000000001},"min":{"1min":0.45500000000000002,"5min":0.40200000000000002,"15min":0.315},"max":{"1min":0.82799999999999996,"5min":6.6799999999999997,"15min":9.8849999999999998},"last":0.38600000000000001}]}]},{"osd":2,"up_from":18,"seq":77309411632,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":376840,"kb_used_data":1024,"kb_used_omap":0,"kb_used_meta":375808,"kb_avail":93368312,"statfs":{"total":95995035648,"available":95609151488,"internally_reserved":0,"allocated":1048576,"data_stored":667352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":384827392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:44:26 2021","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":1.8100000000000001,"15min":1.9019999999999999},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.184},"max":{"1min":0.71299999999999997,"5min":50.759999999999998,"15min":60.990000000000002},"last":0.22700000000000001},{"interface":"front","average":{"1min":0.34499999999999997,"5min":1.653,"15min":1.8620000000000001},"min":{"1min":0.222,"5min":0.222,"15min":0.17999999999999999},"max":{"1min":0.77100000000000002,"5min":50.899000000000001,"15min":60.850999999999999},"last":0.47399999999999998}]},{"osd":1,"last update":"Fri Oct 8 19:44:26 2021","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":1.843,"15min":2.391},"min":{"1min":0.23899999999999999,"5min":0.20999999999999999,"15min":0.19700000000000001},"max":{"1min":0.47499999999999998,"5min":50.866999999999997,"15min":63.738},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.36899999999999999,"5min":2.2850000000000001,"15min":2.6779999999999999},"min":{"1min":0.25700000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":1.1100000000000001,"5min":50.978000000000002,"15min":63.619999999999997},"last":0.442}]},{"osd":3,"last update":"Fri Oct 8 19:44:32 2021","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":2.4750000000000001,"15min":2.8279999999999998},"min":{"1min":0.249,"5min":0.217,"15min":0.21199999999999999},"max":{"1min":1.0209999999999999,"5min":51.036999999999999,"15min":67.198999999999998},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.379,"5min":2.3809999999999998,"15min":2.7570000000000001},"min":{"1min":0.29999999999999999,"5min":0.25800000000000001,"15min":0.21299999999999999},"max":{"1min":0.80300000000000005,"5min":52.667999999999999,"15min":66.963999999999999},"last":0.36099999999999999}]},{"osd":4,"last update":"Fri Oct 8 19:43:54 2021","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":1.871,"15min":1.6879999999999999},"min":{"1min":0.35299999999999998,"5min":0.29699999999999999,"15min":0.27800000000000002},"max":{"1min":0.81899999999999995,"5min":52.482999999999997,"15min":52.482999999999997},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":1.9510000000000001,"15min":1.744},"min":{"1min":0.40600000000000003,"5min":0.30199999999999999,"15min":0.26100000000000001},"max":{"1min":0.83599999999999997,"5min":51.015000000000001,"15min":51.015000000000001},"last":0.51700000000000002}]},{"osd":5,"last update":"Fri Oct 8 19:44:26 2021","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":2.2530000000000001,"15min":1.913},"min":{"1min":0.34100000000000003,"5min":0.311,"15min":0.28000000000000003},"max":{"1min":0.95799999999999996,"5min":52.354999999999997,"15min":52.354999999999997},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.59499999999999997,"5min":1.647,"15min":1.6140000000000001},"min":{"1min":0.40300000000000002,"5min":0.307,"15min":0.29199999999999998},"max":{"1min":0.96699999999999997,"5min":51.082999999999998,"15min":51.082999999999998},"last":0.41999999999999998}]},{"osd":6,"last update":"Fri Oct 8 19:44:32 2021","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":2.6480000000000001,"15min":1.8759999999999999},"min":{"1min":0.44,"5min":0.34100000000000003,"15min":0.28000000000000003},"max":{"1min":1.161,"5min":55.970999999999997,"15min":55.970999999999997},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":2.3330000000000002,"15min":1.8700000000000001},"min":{"1min":0.42599999999999999,"5min":0.36899999999999999,"15min":0.31},"max":{"1min":1.0049999999999999,"5min":56.433,"15min":56.433},"last":0.50700000000000001}]},{"osd":7,"last update":"Fri Oct 8 19:43:54 2021","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":1.966,"15min":2.3769999999999998},"min":{"1min":0.438,"5min":0.38500000000000001,"15min":0.32200000000000001},"max":{"1min":0.92600000000000005,"5min":52.610999999999997,"15min":136.00200000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":1.6990000000000001,"15min":2.2040000000000002},"min":{"1min":0.45800000000000002,"5min":0.39400000000000002,"15min":0.33400000000000002},"max":{"1min":0.88600000000000001,"5min":51.100999999999999,"15min":133.26300000000001},"last":0.46400000000000002}]}]},{"osd":3,"up_from":24,"seq":103079215406,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":480428,"kb_used_data":1380,"kb_used_omap":0,"kb_used_meta":479040,"kb_avail":93264724,"statfs":{"total":95995035648,"available":95503077376,"internally_reserved":0,"allocated":1413120,"data_stored":996042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":490536960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:43:47 2021","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":2.6629999999999998,"15min":2.3639999999999999},"min":{"1min":0.214,"5min":0.188,"15min":0.187},"max":{"1min":0.42299999999999999,"5min":93.194999999999993,"15min":93.194999999999993},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.33500000000000002,"5min":2.5600000000000001,"15min":2.1030000000000002},"min":{"1min":0.252,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.44600000000000001,"5min":96.450999999999993,"15min":96.450999999999993},"last":0.34799999999999998}]},{"osd":1,"last update":"Fri Oct 8 19:43:47 2021","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":1.78,"15min":1.869},"min":{"1min":0.24399999999999999,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.47699999999999998,"5min":9.9239999999999995,"15min":37.271999999999998},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.31900000000000001,"5min":1.962,"15min":1.885},"min":{"1min":0.25,"5min":0.22500000000000001,"15min":0.19},"max":{"1min":0.40000000000000002,"5min":28.356999999999999,"15min":37.033000000000001},"last":0.377}]},{"osd":2,"last update":"Fri Oct 8 19:43:47 2021","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":1.833,"15min":1.655},"min":{"1min":0.27000000000000002,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.46300000000000002,"5min":28.454999999999998,"15min":28.454999999999998},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.378,"5min":1.8320000000000001,"15min":1.9950000000000001},"min":{"1min":0.30299999999999999,"5min":0.252,"15min":0.224},"max":{"1min":0.47599999999999998,"5min":18.041,"15min":23.189},"last":0.432}]},{"osd":4,"last update":"Fri Oct 8 19:44:05 2021","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":1.377,"15min":1.6180000000000001},"min":{"1min":0.30599999999999999,"5min":0.28000000000000003,"15min":0.26600000000000001},"max":{"1min":0.75,"5min":8.5060000000000002,"15min":13.968},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":1.2390000000000001,"15min":1.7390000000000001},"min":{"1min":0.34499999999999997,"5min":0.28599999999999998,"15min":0.26900000000000002},"max":{"1min":0.63500000000000001,"5min":5.3109999999999999,"15min":15.414},"last":0.52300000000000002}]},{"osd":5,"last update":"Fri Oct 8 19:44:16 2021","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":1.222,"15min":1.6299999999999999},"min":{"1min":0.34799999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.86499999999999999,"5min":10.055,"15min":75.397000000000006},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":1.3580000000000001,"15min":2.0920000000000001},"min":{"1min":0.44700000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.72599999999999998,"5min":8.5429999999999993,"15min":75.680000000000007},"last":0.47099999999999997}]},{"osd":6,"last update":"Fri Oct 8 19:44:28 2021","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":3.0640000000000001,"15min":2.1850000000000001},"min":{"1min":0.42299999999999999,"5min":0.32800000000000001,"15min":0.28599999999999998},"max":{"1min":0.80300000000000005,"5min":202.99799999999999,"15min":202.99799999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":2.9790000000000001,"15min":2.0670000000000002},"min":{"1min":0.374,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.93899999999999995,"5min":202.31200000000001,"15min":202.31200000000001},"last":0.47799999999999998}]},{"osd":7,"last update":"Fri Oct 8 19:44:05 2021","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":1.456,"15min":1.8400000000000001},"min":{"1min":0.439,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.755,"5min":13.587,"15min":13.587},"last":0.5},{"interface":"front","average":{"1min":0.59199999999999997,"5min":1.3819999999999999,"15min":1.5660000000000001},"min":{"1min":0.443,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.79000000000000004,"5min":13.644,"15min":13.644},"last":0.54200000000000004}]}]},{"osd":4,"up_from":30,"seq":128849019176,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":337440,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":336640,"kb_avail":93407712,"statfs":{"total":95995035648,"available":95649497088,"internally_reserved":0,"allocated":811008,"data_stored":406087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":344719360},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:43:55 2021","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":1.508,"15min":1.728},"min":{"1min":0.32400000000000001,"5min":0.22500000000000001,"15min":0.188},"max":{"1min":0.73699999999999999,"5min":58.609999999999999,"15min":82.109999999999999},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.51400000000000001,"5min":1.8200000000000001,"15min":1.7150000000000001},"min":{"1min":0.36199999999999999,"5min":0.224,"15min":0.222},"max":{"1min":0.78100000000000003,"5min":58.329999999999998,"15min":82.025999999999996},"last":0.42299999999999999}]},{"osd":1,"last update":"Fri Oct 8 19:43:55 2021","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":2.71,"15min":2.552},"min":{"1min":0.34799999999999998,"5min":0.24099999999999999,"15min":0.215},"max":{"1min":0.80200000000000005,"5min":65.332999999999998,"15min":122.422},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":2.8130000000000002,"15min":2.5230000000000001},"min":{"1min":0.33800000000000002,"5min":0.245,"15min":0.23599999999999999},"max":{"1min":0.80700000000000005,"5min":64.966999999999999,"15min":123.122},"last":0.32200000000000001}]},{"osd":2,"last update":"Fri Oct 8 19:43:55 2021","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":2.0739999999999998,"15min":1.5840000000000001},"min":{"1min":0.35499999999999998,"5min":0.30599999999999999,"15min":0.22600000000000001},"max":{"1min":0.78300000000000003,"5min":60.082999999999998,"15min":60.082999999999998},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.629,"5min":2.1520000000000001,"15min":1.6779999999999999},"min":{"1min":0.39200000000000002,"5min":0.28799999999999998,"15min":0.221},"max":{"1min":1.5600000000000001,"5min":60.539000000000001,"15min":60.539000000000001},"last":0.46000000000000002}]},{"osd":3,"last update":"Fri Oct 8 19:43:55 2021","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":3.0790000000000002,"15min":2.2530000000000001},"min":{"1min":0.42699999999999999,"5min":0.32700000000000001,"15min":0.27700000000000002},"max":{"1min":0.68600000000000005,"5min":59.137,"15min":59.137},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":3.0169999999999999,"15min":2.2280000000000002},"min":{"1min":0.41999999999999998,"5min":0.32300000000000001,"15min":0.254},"max":{"1min":0.76600000000000001,"5min":59.777000000000001,"15min":59.777000000000001},"last":0.33800000000000002}]},{"osd":5,"last update":"Fri Oct 8 19:44:19 2021","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.66400000000000003,"15min":1.0229999999999999},"min":{"1min":0.30299999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.64600000000000002,"5min":3.4489999999999998,"15min":10.477},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.75700000000000001,"15min":0.94699999999999995},"min":{"1min":0.35899999999999999,"5min":0.25800000000000001,"15min":0.23999999999999999},"max":{"1min":0.74299999999999999,"5min":4.0549999999999997,"15min":8.1319999999999997},"last":0.36199999999999999}]},{"osd":6,"last update":"Fri Oct 8 19:44:37 2021","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":2.1179999999999999,"15min":2.403},"min":{"1min":0.33100000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.74299999999999999,"5min":113.14700000000001,"15min":171.69800000000001},"last":0.498},{"interface":"front","average":{"1min":0.58399999999999996,"5min":2.0110000000000001,"15min":2.4399999999999999},"min":{"1min":0.36799999999999999,"5min":0.27800000000000002,"15min":0.26600000000000001},"max":{"1min":0.77900000000000003,"5min":112.651,"15min":171.613},"last":0.372}]},{"osd":7,"last update":"Fri Oct 8 19:43:55 2021","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.74199999999999999,"15min":0.97999999999999998},"min":{"1min":0.39200000000000002,"5min":0.29499999999999998,"15min":0.29099999999999998},"max":{"1min":0.75600000000000001,"5min":3.0720000000000001,"15min":8.0050000000000008},"last":0.438},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.86799999999999999,"15min":1.0449999999999999},"min":{"1min":0.42799999999999999,"5min":0.29199999999999998,"15min":0.26800000000000002},"max":{"1min":0.83199999999999996,"5min":9.3190000000000008,"15min":9.3190000000000008},"last":0.51300000000000001}]}]},{"osd":5,"up_from":38,"seq":163208757540,"num_pgs":62,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":390936,"kb_used_data":1360,"kb_used_omap":0,"kb_used_meta":389568,"kb_avail":93354216,"statfs":{"total":95995035648,"available":95594717184,"internally_reserved":0,"allocated":1392640,"data_stored":996747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":398917632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:44:24 2021","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.85099999999999998,"15min":1.403},"min":{"1min":0.30099999999999999,"5min":0.20899999999999999,"15min":0.20300000000000001},"max":{"1min":0.55200000000000005,"5min":4.8220000000000001,"15min":43.332999999999998},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.94599999999999995,"15min":1.514},"min":{"1min":0.28299999999999997,"5min":0.22700000000000001,"15min":0.216},"max":{"1min":0.65500000000000003,"5min":7.6890000000000001,"15min":42.637},"last":0.47499999999999998}]},{"osd":1,"last update":"Fri Oct 8 19:44:24 2021","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":1.278,"15min":1.788},"min":{"1min":0.34200000000000003,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.65600000000000003,"5min":9.3010000000000002,"15min":94.558999999999997},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.48899999999999999,"5min":1.373,"15min":1.681},"min":{"1min":0.35199999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.67500000000000004,"5min":12.756,"15min":94.456999999999994},"last":0.54500000000000004}]},{"osd":2,"last update":"Fri Oct 8 19:44:24 2021","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":1.075,"15min":1.244},"min":{"1min":0.30099999999999999,"5min":0.26000000000000001,"15min":0.249},"max":{"1min":0.64300000000000002,"5min":7.4939999999999998,"15min":22.931999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.48199999999999998,"5min":1.2789999999999999,"15min":1.4470000000000001},"min":{"1min":0.316,"5min":0.251,"15min":0.24099999999999999},"max":{"1min":0.64500000000000002,"5min":7.9139999999999997,"15min":22.963999999999999},"last":0.59599999999999997}]},{"osd":3,"last update":"Fri Oct 8 19:44:24 2021","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":1.218,"15min":1.4890000000000001},"min":{"1min":0.34300000000000003,"5min":0.30099999999999999,"15min":0.27000000000000002},"max":{"1min":0.68200000000000005,"5min":10.827999999999999,"15min":11.685},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.49199999999999999,"5min":1.6220000000000001,"15min":1.821},"min":{"1min":0.318,"5min":0.318,"15min":0.218},"max":{"1min":0.63300000000000001,"5min":26.771000000000001,"15min":26.771000000000001},"last":0.55900000000000005}]},{"osd":4,"last update":"Fri Oct 8 19:44:24 2021","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":1.341,"15min":1.0700000000000001},"min":{"1min":0.26600000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.67200000000000004,"5min":67.369,"15min":67.369},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.48799999999999999,"5min":1.4279999999999999,"15min":1.1599999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.25900000000000001},"max":{"1min":0.72999999999999998,"5min":67.468999999999994,"15min":67.468999999999994},"last":0.48799999999999999}]},{"osd":6,"last update":"Fri Oct 8 19:44:36 2021","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.82699999999999996,"15min":1.014},"min":{"1min":0.33500000000000002,"5min":0.28100000000000003,"15min":0.255},"max":{"1min":0.75800000000000001,"5min":6.6600000000000001,"15min":11.192},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.91400000000000003,"15min":1.0640000000000001},"min":{"1min":0.38100000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.78600000000000003,"5min":9.2029999999999994,"15min":11.259},"last":0.40899999999999997}]},{"osd":7,"last update":"Fri Oct 8 19:43:53 2021","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.85799999999999998,"15min":1.087},"min":{"1min":0.40300000000000002,"5min":0.32300000000000001,"15min":0.22},"max":{"1min":0.72399999999999998,"5min":5.8280000000000003,"15min":29.946999999999999},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.80300000000000005,"15min":1.137},"min":{"1min":0.44400000000000001,"5min":0.34699999999999998,"15min":0.23699999999999999},"max":{"1min":0.85999999999999999,"5min":4.3120000000000003,"15min":29.294},"last":0.43099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":266240,"data_stored":262688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":327680,"data_stored":327680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-10-08T19:44:52.438 INFO:tasks.cephadm.ceph_manager.ceph:recovered! 2021-10-08T19:44:52.439 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 1d01f6d6-286c-11ec-8c25-001a4aab830c -- ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2021-10-08T19:44:52.650 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:52 smithi097 ceph-mon[41966]: 6.3 scrub ok 2021-10-08T19:44:52.651 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:52 smithi097 ceph-mon[41966]: 4.7 scrub ok 2021-10-08T19:44:52.651 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:52 smithi097 ceph-mon[41966]: pgmap v1154: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:44:52.651 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:52 smithi097 ceph-mon[41966]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:44:52.652 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:52 smithi097 ceph-mon[41966]: 172.21.15.97 - - [08/Oct/2021:19:44:51] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:44:52.652 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:52 smithi097 ceph-mon[32687]: 6.3 scrub ok 2021-10-08T19:44:52.652 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:52 smithi097 ceph-mon[32687]: 4.7 scrub ok 2021-10-08T19:44:52.658 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:52 smithi097 ceph-mon[32687]: pgmap v1154: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:44:52.658 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:52 smithi097 ceph-mon[32687]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:44:52.659 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:52 smithi097 ceph-mon[32687]: 172.21.15.97 - - [08/Oct/2021:19:44:51] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:44:52.661 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:52 smithi117 ceph-mon[34585]: 6.3 scrub ok 2021-10-08T19:44:52.661 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:52 smithi117 ceph-mon[34585]: 4.7 scrub ok 2021-10-08T19:44:52.661 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:52 smithi117 ceph-mon[34585]: pgmap v1154: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:44:52.662 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:52 smithi117 ceph-mon[34585]: Received up-to-date metadata from agent on host smithi097. 2021-10-08T19:44:52.662 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:52 smithi117 ceph-mon[34585]: 172.21.15.97 - - [08/Oct/2021:19:44:51] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:44:52.718 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/1d01f6d6-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:44:52.912 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:44:52 smithi097 conmon[33110]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:44:52] "GET /metrics HTTP/1.1" 200 154883 "" "Prometheus/2.18.1" 2021-10-08T19:44:53.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:53 smithi117 ceph-mon[34585]: from='client.16758 v1:172.21.15.97:0/1261764739' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:44:53.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:53 smithi117 ceph-mon[34585]: 6.18 scrub ok 2021-10-08T19:44:53.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:53 smithi117 ceph-mon[34585]: 3.16 scrub ok 2021-10-08T19:44:53.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:53 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:44:53.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:53 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:44:53.659 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:53 smithi117 ceph-mon[34585]: 2.7 scrub ok 2021-10-08T19:44:53.720 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:53 smithi097 ceph-mon[32687]: from='client.16758 v1:172.21.15.97:0/1261764739' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:44:53.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:53 smithi097 ceph-mon[32687]: 6.18 scrub ok 2021-10-08T19:44:53.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:53 smithi097 ceph-mon[32687]: 3.16 scrub ok 2021-10-08T19:44:53.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:53 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:44:53.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:53 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:44:53.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:53 smithi097 ceph-mon[32687]: 2.7 scrub ok 2021-10-08T19:44:53.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:53 smithi097 ceph-mon[41966]: from='client.16758 v1:172.21.15.97:0/1261764739' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:44:53.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:53 smithi097 ceph-mon[41966]: 6.18 scrub ok 2021-10-08T19:44:53.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:53 smithi097 ceph-mon[41966]: 3.16 scrub ok 2021-10-08T19:44:53.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:53 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:44:53.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:53 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:44:53.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:53 smithi097 ceph-mon[41966]: 2.7 scrub ok 2021-10-08T19:44:54.156 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:44:53 smithi117 conmon[36778]: ::ffff:172.21.15.117 - - [08/Oct/2021:19:44:53] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:44:54.657 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:54 smithi117 ceph-mon[34585]: purged_snaps scrub starts 2021-10-08T19:44:54.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:54 smithi117 ceph-mon[34585]: purged_snaps scrub ok 2021-10-08T19:44:54.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:54 smithi117 ceph-mon[34585]: 1.3 scrub ok 2021-10-08T19:44:54.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:54 smithi117 ceph-mon[34585]: pgmap v1155: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:44:54.658 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:54 smithi117 ceph-mon[34585]: osdmap e531: 8 total, 8 up, 8 in 2021-10-08T19:44:54.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:54 smithi097 ceph-mon[32687]: purged_snaps scrub starts 2021-10-08T19:44:54.721 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:54 smithi097 ceph-mon[32687]: purged_snaps scrub ok 2021-10-08T19:44:54.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:54 smithi097 ceph-mon[32687]: 1.3 scrub ok 2021-10-08T19:44:54.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:54 smithi097 ceph-mon[32687]: pgmap v1155: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:44:54.722 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:54 smithi097 ceph-mon[32687]: osdmap e531: 8 total, 8 up, 8 in 2021-10-08T19:44:54.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:54 smithi097 ceph-mon[41966]: purged_snaps scrub starts 2021-10-08T19:44:54.723 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:54 smithi097 ceph-mon[41966]: purged_snaps scrub ok 2021-10-08T19:44:54.724 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:54 smithi097 ceph-mon[41966]: 1.3 scrub ok 2021-10-08T19:44:54.725 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:54 smithi097 ceph-mon[41966]: pgmap v1155: 172 pgs: 172 active+clean; 582 KiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:44:54.725 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:54 smithi097 ceph-mon[41966]: osdmap e531: 8 total, 8 up, 8 in 2021-10-08T19:44:55.012 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2021-10-08T19:44:55.024 INFO:tasks.cephadm:Teardown begin 2021-10-08T19:44:55.025 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2021-10-08T19:44:55.052 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2021-10-08T19:44:55.089 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2021-10-08T19:44:55.089 DEBUG:teuthology.orchestra.run.smithi097:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2021-10-08T19:44:55.133 DEBUG:teuthology.orchestra.run.smithi117:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2021-10-08T19:44:55.149 INFO:tasks.cephadm:Stopping all daemons... 2021-10-08T19:44:55.150 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2021-10-08T19:44:55.150 DEBUG:teuthology.orchestra.run.smithi097:> sudo systemctl stop ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@mon.a 2021-10-08T19:44:55.347 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:55 smithi097 systemd[1]: Stopping Ceph mon.a for 1d01f6d6-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:44:55.347 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:55 smithi097 bash[359890]: Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-mon.a found: no such container 2021-10-08T19:44:55.348 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:55 smithi097 conmon[32664]: 2021-10-08T19:44:55.343+0000 7f60651e1700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2021-10-08T19:44:55.348 INFO:journalctl@ceph.mon.a.smithi097.stdout:Oct 08 19:44:55 smithi097 conmon[32664]: 2021-10-08T19:44:55.343+0000 7f60651e1700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2021-10-08T19:44:56.098 DEBUG:teuthology.orchestra.run.smithi097:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@mon.a.service' 2021-10-08T19:44:56.159 DEBUG:teuthology.orchestra.run:got remote process result: None 2021-10-08T19:44:56.160 INFO:tasks.cephadm.mon.a:Stopped mon.a 2021-10-08T19:44:56.161 INFO:tasks.cephadm.mon.b:Stopping mon.c... 2021-10-08T19:44:56.163 DEBUG:teuthology.orchestra.run.smithi097:> sudo systemctl stop ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@mon.c 2021-10-08T19:44:56.329 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:56 smithi097 systemd[1]: Stopping Ceph mon.c for 1d01f6d6-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:44:56.330 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:56 smithi097 bash[360094]: Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-mon.c found: no such container 2021-10-08T19:44:56.330 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:56 smithi097 conmon[41943]: 2021-10-08T19:44:56.326+0000 7f48d740d700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2021-10-08T19:44:56.330 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:56 smithi097 conmon[41943]: 2021-10-08T19:44:56.326+0000 7f48d740d700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2021-10-08T19:44:56.630 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:56 smithi097 bash[360094]: dd7b5445b0b2148eabb7f54f4a357b8651e49105753b215085048998f4b4612a 2021-10-08T19:44:56.631 INFO:journalctl@ceph.mon.c.smithi097.stdout:Oct 08 19:44:56 smithi097 bash[360094]: Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-mon.c found: no such container 2021-10-08T19:44:57.107 DEBUG:teuthology.orchestra.run.smithi097:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@mon.c.service' 2021-10-08T19:44:57.142 DEBUG:teuthology.orchestra.run:got remote process result: None 2021-10-08T19:44:57.143 INFO:tasks.cephadm.mon.b:Stopped mon.c 2021-10-08T19:44:57.143 INFO:tasks.cephadm.mon.b:Stopping mon.b... 2021-10-08T19:44:57.143 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@mon.b 2021-10-08T19:44:57.571 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:57 smithi117 systemd[1]: Stopping Ceph mon.b for 1d01f6d6-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:44:57.571 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:57 smithi117 bash[222519]: Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-mon.b found: no such container 2021-10-08T19:44:57.571 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:57 smithi117 conmon[34529]: 2021-10-08T19:44:57.330+0000 7f9489159700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2021-10-08T19:44:57.571 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:57 smithi117 conmon[34529]: 2021-10-08T19:44:57.330+0000 7f9489159700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2021-10-08T19:44:57.906 INFO:journalctl@ceph.iscsi.iscsi.a.smithi117.stdout:Oct 08 19:44:57 smithi117 conmon[58440]: debug there is no tcmu-runner data available 2021-10-08T19:44:57.906 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:57 smithi117 bash[222519]: 32f4b15cf9fb9e2802530a7206349e01243fbcf7094c8ceeff451e1fba109c01 2021-10-08T19:44:57.907 INFO:journalctl@ceph.mon.b.smithi117.stdout:Oct 08 19:44:57 smithi117 bash[222519]: Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-mon.b found: no such container 2021-10-08T19:44:58.363 DEBUG:teuthology.orchestra.run.smithi117:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@mon.b.service' 2021-10-08T19:44:58.435 DEBUG:teuthology.orchestra.run:got remote process result: None 2021-10-08T19:44:58.436 INFO:tasks.cephadm.mon.b:Stopped mon.b 2021-10-08T19:44:58.436 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2021-10-08T19:44:58.437 DEBUG:teuthology.orchestra.run.smithi097:> sudo systemctl stop ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@mgr.y 2021-10-08T19:44:58.720 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:44:58 smithi097 systemd[1]: Stopping Ceph mgr.y for 1d01f6d6-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:44:58.720 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:44:58 smithi097 bash[360310]: Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-mgr.y found: no such container 2021-10-08T19:44:58.720 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:44:58 smithi097 conmon[33110]: 2021-10-08T19:44:58.628+0000 7f26fe3cb700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mgr -n mgr.y -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2021-10-08T19:44:58.721 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Oct 08 19:44:58 smithi097 conmon[33110]: 2021-10-08T19:44:58.628+0000 7f26fe3cb700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2021-10-08T19:44:59.324 DEBUG:teuthology.orchestra.run.smithi097:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@mgr.y.service' 2021-10-08T19:44:59.363 DEBUG:teuthology.orchestra.run:got remote process result: None 2021-10-08T19:44:59.364 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2021-10-08T19:44:59.364 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2021-10-08T19:44:59.364 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@mgr.x 2021-10-08T19:44:59.905 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:44:59 smithi117 systemd[1]: Stopping Ceph mgr.x for 1d01f6d6-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:44:59.906 INFO:journalctl@ceph.mgr.x.smithi117.stdout:Oct 08 19:44:59 smithi117 bash[222737]: Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-mgr.x found: no such container 2021-10-08T19:45:00.231 DEBUG:teuthology.orchestra.run.smithi117:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@mgr.x.service' 2021-10-08T19:45:00.267 DEBUG:teuthology.orchestra.run:got remote process result: None 2021-10-08T19:45:00.268 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2021-10-08T19:45:00.268 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2021-10-08T19:45:00.269 DEBUG:teuthology.orchestra.run.smithi097:> sudo systemctl stop ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@osd.0 2021-10-08T19:45:00.720 INFO:journalctl@ceph.osd.0.smithi097.stdout:Oct 08 19:45:00 smithi097 systemd[1]: Stopping Ceph osd.0 for 1d01f6d6-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:45:00.721 INFO:journalctl@ceph.osd.0.smithi097.stdout:Oct 08 19:45:00 smithi097 bash[360521]: Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:45:00.721 INFO:journalctl@ceph.osd.0.smithi097.stdout:Oct 08 19:45:00 smithi097 conmon[47373]: 2021-10-08T19:45:00.487+0000 7f8351035700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2021-10-08T19:45:00.721 INFO:journalctl@ceph.osd.0.smithi097.stdout:Oct 08 19:45:00 smithi097 conmon[47373]: 2021-10-08T19:45:00.487+0000 7f8351035700 -1 osd.0 531 *** Got signal Terminated *** 2021-10-08T19:45:00.721 INFO:journalctl@ceph.osd.0.smithi097.stdout:Oct 08 19:45:00 smithi097 conmon[47373]: 2021-10-08T19:45:00.487+0000 7f8351035700 -1 osd.0 531 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-10-08T19:45:01.470 INFO:journalctl@ceph.osd.0.smithi097.stdout:Oct 08 19:45:01 smithi097 bash[360521]: a20725bbf6e733eb0316d3be26afe518ba87054a8a10c76da47560ac3f0ca286 2021-10-08T19:45:01.470 INFO:journalctl@ceph.osd.0.smithi097.stdout:Oct 08 19:45:01 smithi097 bash[360521]: Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:45:02.570 DEBUG:teuthology.orchestra.run.smithi097:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@osd.0.service' 2021-10-08T19:45:02.608 DEBUG:teuthology.orchestra.run:got remote process result: None 2021-10-08T19:45:02.608 INFO:tasks.cephadm.osd.0:Stopped osd.0 2021-10-08T19:45:02.609 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2021-10-08T19:45:02.609 DEBUG:teuthology.orchestra.run.smithi097:> sudo systemctl stop ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@osd.1 2021-10-08T19:45:02.655 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:45:02 smithi117 conmon[69189]: level=error ts=2021-10-08T19:45:02.314Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=1 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:45:02.971 INFO:journalctl@ceph.osd.1.smithi097.stdout:Oct 08 19:45:02 smithi097 systemd[1]: Stopping Ceph osd.1 for 1d01f6d6-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:45:02.971 INFO:journalctl@ceph.osd.1.smithi097.stdout:Oct 08 19:45:02 smithi097 bash[361001]: Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:45:02.971 INFO:journalctl@ceph.osd.1.smithi097.stdout:Oct 08 19:45:02 smithi097 conmon[51607]: 2021-10-08T19:45:02.808+0000 7f6f3f8d6700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2021-10-08T19:45:02.971 INFO:journalctl@ceph.osd.1.smithi097.stdout:Oct 08 19:45:02 smithi097 conmon[51607]: 2021-10-08T19:45:02.808+0000 7f6f3f8d6700 -1 osd.1 531 *** Got signal Terminated *** 2021-10-08T19:45:02.972 INFO:journalctl@ceph.osd.1.smithi097.stdout:Oct 08 19:45:02 smithi097 conmon[51607]: 2021-10-08T19:45:02.808+0000 7f6f3f8d6700 -1 osd.1 531 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-10-08T19:45:03.719 INFO:journalctl@ceph.osd.1.smithi097.stdout:Oct 08 19:45:03 smithi097 bash[361001]: 21e73c70dd44e733e909f14e867b9718e25e856cdfdc07d54ce1202e7ef9120d 2021-10-08T19:45:03.720 INFO:journalctl@ceph.osd.1.smithi097.stdout:Oct 08 19:45:03 smithi097 bash[361001]: Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:45:04.752 DEBUG:teuthology.orchestra.run.smithi097:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@osd.1.service' 2021-10-08T19:45:04.789 DEBUG:teuthology.orchestra.run:got remote process result: None 2021-10-08T19:45:04.790 INFO:tasks.cephadm.osd.1:Stopped osd.1 2021-10-08T19:45:04.790 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2021-10-08T19:45:04.790 DEBUG:teuthology.orchestra.run.smithi097:> sudo systemctl stop ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@osd.2 2021-10-08T19:45:05.220 INFO:journalctl@ceph.osd.2.smithi097.stdout:Oct 08 19:45:04 smithi097 systemd[1]: Stopping Ceph osd.2 for 1d01f6d6-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:45:05.220 INFO:journalctl@ceph.osd.2.smithi097.stdout:Oct 08 19:45:04 smithi097 bash[361490]: Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:45:05.221 INFO:journalctl@ceph.osd.2.smithi097.stdout:Oct 08 19:45:04 smithi097 conmon[55904]: 2021-10-08T19:45:04.992+0000 7f59b8ef4700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2021-10-08T19:45:05.221 INFO:journalctl@ceph.osd.2.smithi097.stdout:Oct 08 19:45:04 smithi097 conmon[55904]: 2021-10-08T19:45:04.992+0000 7f59b8ef4700 -1 osd.2 531 *** Got signal Terminated *** 2021-10-08T19:45:05.221 INFO:journalctl@ceph.osd.2.smithi097.stdout:Oct 08 19:45:04 smithi097 conmon[55904]: 2021-10-08T19:45:04.992+0000 7f59b8ef4700 -1 osd.2 531 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-10-08T19:45:05.720 INFO:journalctl@ceph.osd.2.smithi097.stdout:Oct 08 19:45:05 smithi097 bash[361490]: 2a1df96a9fe2dd57d38eaa2b020c6946d17ed8c0fe36f79964660b92d6690b7d 2021-10-08T19:45:05.720 INFO:journalctl@ceph.osd.2.smithi097.stdout:Oct 08 19:45:05 smithi097 bash[361490]: Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:45:06.868 DEBUG:teuthology.orchestra.run.smithi097:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@osd.2.service' 2021-10-08T19:45:06.909 DEBUG:teuthology.orchestra.run:got remote process result: None 2021-10-08T19:45:06.910 INFO:tasks.cephadm.osd.2:Stopped osd.2 2021-10-08T19:45:06.911 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2021-10-08T19:45:06.911 DEBUG:teuthology.orchestra.run.smithi097:> sudo systemctl stop ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@osd.3 2021-10-08T19:45:07.118 INFO:journalctl@ceph.osd.3.smithi097.stdout:Oct 08 19:45:06 smithi097 systemd[1]: Stopping Ceph osd.3 for 1d01f6d6-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:45:07.119 INFO:journalctl@ceph.osd.3.smithi097.stdout:Oct 08 19:45:07 smithi097 bash[361972]: Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:45:07.474 INFO:journalctl@ceph.osd.3.smithi097.stdout:Oct 08 19:45:07 smithi097 conmon[59546]: 2021-10-08T19:45:07.116+0000 7facb60bc700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2021-10-08T19:45:07.475 INFO:journalctl@ceph.osd.3.smithi097.stdout:Oct 08 19:45:07 smithi097 conmon[59546]: 2021-10-08T19:45:07.476 INFO:journalctl@ceph.osd.3.smithi097.stdout:Oct 08 19:45:07 smithi097 conmon[59546]: 2021-10-08T19:45:07.116+0000 7facb60bc700 -1 osd.3 531 *** Got signal Terminated *** 2021-10-08T19:45:07.476 INFO:journalctl@ceph.osd.3.smithi097.stdout:Oct 08 19:45:07 smithi097 conmon[59546]: 2021-10-08T19:45:07.116+0000 7facb60bc700 -1 osd.3 531 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-10-08T19:45:07.972 INFO:journalctl@ceph.osd.3.smithi097.stdout:Oct 08 19:45:07 smithi097 bash[361972]: 3e88d32dae129f80997f04e46e1d407a0e4cb85a8c1b777662d112fbb0eb7b19 2021-10-08T19:45:07.973 INFO:journalctl@ceph.osd.3.smithi097.stdout:Oct 08 19:45:07 smithi097 bash[361972]: Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:45:09.055 DEBUG:teuthology.orchestra.run.smithi097:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@osd.3.service' 2021-10-08T19:45:09.092 DEBUG:teuthology.orchestra.run:got remote process result: None 2021-10-08T19:45:09.092 INFO:tasks.cephadm.osd.3:Stopped osd.3 2021-10-08T19:45:09.093 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2021-10-08T19:45:09.093 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@osd.4 2021-10-08T19:45:09.406 INFO:journalctl@ceph.osd.4.smithi117.stdout:Oct 08 19:45:09 smithi117 systemd[1]: Stopping Ceph osd.4 for 1d01f6d6-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:45:09.406 INFO:journalctl@ceph.osd.4.smithi117.stdout:Oct 08 19:45:09 smithi117 bash[222944]: Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:45:09.406 INFO:journalctl@ceph.osd.4.smithi117.stdout:Oct 08 19:45:09 smithi117 conmon[42287]: 2021-10-08T19:45:09.287+0000 7f7ea72b4700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2021-10-08T19:45:09.407 INFO:journalctl@ceph.osd.4.smithi117.stdout:Oct 08 19:45:09 smithi117 conmon[42287]: 2021-10-08T19:45:09.287+0000 7f7ea72b4700 -1 osd.4 531 *** Got signal Terminated *** 2021-10-08T19:45:09.407 INFO:journalctl@ceph.osd.4.smithi117.stdout:Oct 08 19:45:09 smithi117 conmon[42287]: 2021-10-08T19:45:09.287+0000 7f7ea72b4700 -1 osd.4 531 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-10-08T19:45:10.235 INFO:journalctl@ceph.osd.4.smithi117.stdout:Oct 08 19:45:09 smithi117 bash[222944]: 7d5159cdabd02f5aa0464f13eda533a69a3a4cbc6d20a784bd9d9db5c2c2910f 2021-10-08T19:45:10.235 INFO:journalctl@ceph.osd.4.smithi117.stdout:Oct 08 19:45:10 smithi117 bash[222944]: Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:45:11.780 DEBUG:teuthology.orchestra.run.smithi117:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@osd.4.service' 2021-10-08T19:45:11.818 DEBUG:teuthology.orchestra.run:got remote process result: None 2021-10-08T19:45:11.818 INFO:tasks.cephadm.osd.4:Stopped osd.4 2021-10-08T19:45:11.819 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2021-10-08T19:45:11.819 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@osd.5 2021-10-08T19:45:12.078 INFO:journalctl@ceph.osd.5.smithi117.stdout:Oct 08 19:45:11 smithi117 systemd[1]: Stopping Ceph osd.5 for 1d01f6d6-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:45:12.078 INFO:journalctl@ceph.osd.5.smithi117.stdout:Oct 08 19:45:11 smithi117 bash[223593]: Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:45:12.390 INFO:journalctl@ceph.osd.5.smithi117.stdout:Oct 08 19:45:12 smithi117 conmon[46504]: 2021-10-08T19:45:12.075+0000 7f7c1800c700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2021-10-08T19:45:12.390 INFO:journalctl@ceph.osd.5.smithi117.stdout:Oct 08 19:45:12 smithi117 conmon[46504]: 2021-10-08T19:45:12.075+0000 7f7c1800c700 -1 osd.5 531 *** Got signal Terminated *** 2021-10-08T19:45:12.391 INFO:journalctl@ceph.osd.5.smithi117.stdout:Oct 08 19:45:12 smithi117 conmon[46504]: 2021-10-08T19:45:12.075+0000 7f7c1800c700 -1 osd.5 531 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-10-08T19:45:12.655 INFO:journalctl@ceph.osd.5.smithi117.stdout:Oct 08 19:45:12 smithi117 bash[223593]: 134da392c01e3beda51a17b257b35f0c9cc665f919422afc9afd6f386e88cd73 2021-10-08T19:45:12.655 INFO:journalctl@ceph.osd.5.smithi117.stdout:Oct 08 19:45:12 smithi117 bash[223593]: Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:45:14.628 DEBUG:teuthology.orchestra.run.smithi117:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@osd.5.service' 2021-10-08T19:45:14.669 DEBUG:teuthology.orchestra.run:got remote process result: None 2021-10-08T19:45:14.669 INFO:tasks.cephadm.osd.5:Stopped osd.5 2021-10-08T19:45:14.670 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2021-10-08T19:45:14.670 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@osd.6 2021-10-08T19:45:14.894 INFO:journalctl@ceph.osd.6.smithi117.stdout:Oct 08 19:45:14 smithi117 systemd[1]: Stopping Ceph osd.6 for 1d01f6d6-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:45:14.895 INFO:journalctl@ceph.osd.6.smithi117.stdout:Oct 08 19:45:14 smithi117 bash[224539]: Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:45:15.156 INFO:journalctl@ceph.osd.6.smithi117.stdout:Oct 08 19:45:14 smithi117 conmon[50186]: 2021-10-08T19:45:14.891+0000 7f0fcaf60700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2021-10-08T19:45:15.156 INFO:journalctl@ceph.osd.6.smithi117.stdout:Oct 08 19:45:14 smithi117 conmon[50186]: 2021-10-08T19:45:14.891+0000 7f0fcaf60700 -1 osd.6 531 *** Got signal Terminated *** 2021-10-08T19:45:15.156 INFO:journalctl@ceph.osd.6.smithi117.stdout:Oct 08 19:45:14 smithi117 conmon[50186]: 2021-10-08T19:45:14.891+0000 7f0fcaf60700 -1 osd.6 531 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-10-08T19:45:15.905 INFO:journalctl@ceph.osd.6.smithi117.stdout:Oct 08 19:45:15 smithi117 bash[224539]: dea459032327868aaf213178c2b33f39ebaaabfbc84de04e2d0abe63d652459f 2021-10-08T19:45:15.905 INFO:journalctl@ceph.osd.6.smithi117.stdout:Oct 08 19:45:15 smithi117 bash[224539]: Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:45:17.287 DEBUG:teuthology.orchestra.run.smithi117:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@osd.6.service' 2021-10-08T19:45:17.349 DEBUG:teuthology.orchestra.run:got remote process result: None 2021-10-08T19:45:17.350 INFO:tasks.cephadm.osd.6:Stopped osd.6 2021-10-08T19:45:17.350 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2021-10-08T19:45:17.351 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@osd.7 2021-10-08T19:45:17.576 INFO:journalctl@ceph.osd.7.smithi117.stdout:Oct 08 19:45:17 smithi117 systemd[1]: Stopping Ceph osd.7 for 1d01f6d6-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:45:17.577 INFO:journalctl@ceph.osd.7.smithi117.stdout:Oct 08 19:45:17 smithi117 bash[225588]: Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:45:17.905 INFO:journalctl@ceph.osd.7.smithi117.stdout:Oct 08 19:45:17 smithi117 conmon[54364]: 2021-10-08T19:45:17.573+0000 7ff3a90eb700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2021-10-08T19:45:17.906 INFO:journalctl@ceph.osd.7.smithi117.stdout:Oct 08 19:45:17 smithi117 conmon[54364]: 2021-10-08T19:45:17.573+0000 7ff3a90eb700 -1 osd.7 531 *** Got signal Terminated *** 2021-10-08T19:45:17.907 INFO:journalctl@ceph.osd.7.smithi117.stdout:Oct 08 19:45:17 smithi117 conmon[54364]: 2021-10-08T19:45:17.573+0000 7ff3a90eb700 -1 osd.7 531 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-10-08T19:45:18.409 INFO:journalctl@ceph.osd.7.smithi117.stdout:Oct 08 19:45:17 smithi117 bash[225588]: f4a278b0b653ab2377d8c2f2b48f8b714ce2258a4733ae02b4caf80030d17748 2021-10-08T19:45:18.409 INFO:journalctl@ceph.osd.7.smithi117.stdout:Oct 08 19:45:18 smithi117 bash[225588]: Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:45:20.184 DEBUG:teuthology.orchestra.run.smithi117:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@osd.7.service' 2021-10-08T19:45:20.221 DEBUG:teuthology.orchestra.run:got remote process result: None 2021-10-08T19:45:20.221 INFO:tasks.cephadm.osd.7:Stopped osd.7 2021-10-08T19:45:20.222 INFO:tasks.cephadm.ceph.rgw.foo.a:Stopping rgw.foo.a... 2021-10-08T19:45:20.222 DEBUG:teuthology.orchestra.run.smithi097:> sudo systemctl stop ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@rgw.foo.a 2021-10-08T19:45:20.721 INFO:journalctl@ceph.rgw.foo.a.smithi097.stdout:Oct 08 19:45:20 smithi097 systemd[1]: Stopping Ceph rgw.foo.a for 1d01f6d6-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:45:20.721 INFO:journalctl@ceph.rgw.foo.a.smithi097.stdout:Oct 08 19:45:20 smithi097 bash[363904]: Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-rgw.foo.a found: no such container 2021-10-08T19:45:20.722 INFO:journalctl@ceph.rgw.foo.a.smithi097.stdout:Oct 08 19:45:20 smithi097 conmon[64564]: 2021-10-08T19:45:20.417+0000 7fbfc143a700 -1 received signal: Terminated from /dev/init -- /usr/bin/radosgw -n client.rgw.foo.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2021-10-08T19:45:20.722 INFO:journalctl@ceph.rgw.foo.a.smithi097.stdout:Oct 08 19:45:20 smithi097 conmon[64564]: 2021-10-08T19:45:20.417+0000 7fbfd058b400 -1 rgw dbstore: shutting down 2021-10-08T19:45:22.655 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:45:22 smithi117 conmon[69189]: level=error ts=2021-10-08T19:45:22.314Z caller=notifier.go:527 component=notifier alertmanager=http://127.0.1.1:9093/api/v1/alerts count=1 msg="Error sending alert" err="Post \"http://127.0.1.1:9093/api/v1/alerts\": dial tcp 127.0.1.1:9093: connect: connection refused" 2021-10-08T19:45:30.917 DEBUG:teuthology.orchestra.run.smithi097:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@rgw.foo.a.service' 2021-10-08T19:45:30.956 DEBUG:teuthology.orchestra.run:got remote process result: None 2021-10-08T19:45:30.956 INFO:tasks.cephadm.ceph.rgw.foo.a:Stopped rgw.foo.a 2021-10-08T19:45:30.957 INFO:tasks.cephadm.prometheus.a:Stopping prometheus.a... 2021-10-08T19:45:30.957 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c@prometheus.a 2021-10-08T19:45:31.411 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:45:30 smithi117 systemd[1]: Stopping Ceph prometheus.a for 1d01f6d6-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:45:31.411 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:45:31 smithi117 bash[226426]: Error: no container with name or ID ceph-1d01f6d6-286c-11ec-8c25-001a4aab830c-prometheus.a found: no such container 2021-10-08T19:45:31.411 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:45:31 smithi117 conmon[69189]: level=warn ts=2021-10-08T19:45:31.151Z caller=main.go:524 msg="Received SIGTERM, exiting gracefully..." 2021-10-08T19:45:31.412 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:45:31 smithi117 conmon[69189]: level=info ts=2021-10-08T19:45:31.151Z caller=main.go:547 msg="Stopping scrape discovery manager..." 2021-10-08T19:45:31.412 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:45:31 smithi117 conmon[69189]: level=info ts=2021-10-08T19:45:31.151Z caller=main.go:561 msg="Stopping notify discovery manager..." 2021-10-08T19:45:31.412 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:45:31 smithi117 conmon[69189]: level=info ts=2021-10-08T19:45:31.151Z caller=main.go:583 msg="Stopping scrape manager..." 2021-10-08T19:45:31.412 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:45:31 smithi117 conmon[69189]: level=info ts=2021-10-08T19:45:31.151Z caller=main.go:543 msg="Scrape discovery manager stopped" 2021-10-08T19:45:31.413 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:45:31 smithi117 conmon[69189]: level=info ts=2021-10-08T19:45:31.151Z caller=main.go:557 msg="Notify discovery manager stopped" 2021-10-08T19:45:31.413 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:45:31 smithi117 conmon[69189]: level=info ts=2021-10-08T19:45:31.151Z caller=manager.go:882 component="rule manager" msg="Stopping rule manager..." 2021-10-08T19:45:31.413 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:45:31 smithi117 conmon[69189]: level=info ts=2021-10-08T19:45:31.151Z caller=manager.go:892 component="rule manager" msg="Rule manager stopped" 2021-10-08T19:45:31.413 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:45:31 smithi117 conmon[69189]: level=info ts=2021-10-08T19:45:31.151Z caller=main.go:577 msg="Scrape manager stopped" 2021-10-08T19:45:31.413 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:45:31 smithi117 conmon[69189]: level=info ts=2021-10-08T19:45:31.151Z caller=notifier.go:601 component=notifier msg="Stopping notification manager..." 2021-10-08T19:45:31.414 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:45:31 smithi117 conmon[69189]: level=info ts=2021-10-08T19:45:31.151Z caller=main.go:749 msg="Notifier manager stopped" 2021-10-08T19:45:31.414 INFO:journalctl@ceph.prometheus.a.smithi117.stdout:Oct 08 19:45:31 smithi117 conmon[69189]: level=info ts=2021-10-08T19:45:31.152Z caller=main.go:761 msg="See you next time!" 2021-10-08T19:45:31.505 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2021-10-08T19:45:31.507 DEBUG:teuthology.task.console_log:Killing console logger for smithi097 2021-10-08T19:45:31.508 DEBUG:teuthology.task.console_log:Killing console logger for smithi117 2021-10-08T19:45:31.509 DEBUG:teuthology.exit:Finished running handlers